2023-07-27T13:53:08.360 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-27T13:53:08.361 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354395 --description fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} --name yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354395/orig.config.yaml 2023-07-27T13:53:08.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T13:53:12.074 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354395 branch: wip-yuri10-testing-2023-07-26-0858-pacific description: fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} email: yweinste@redhat.com first_in_suite: false job_id: '7354395' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri10-testing-2023-07-26-0858-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-07-26-0858-pacific sha1: cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f owner: scheduled_yuriw@teuthology priority: 95 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 536 sha1: cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri10-testing-2023-07-26-0858-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f targets: smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWuWUcyh0iEuOjz5rn3MV4Zrxu9bZhvpXD1pULC+4G+MKGSDXWhHAn7p9mQlwrCG/63L1hlnGyqiNoBDqZI++9jtMV8myBROiytka62byHxvDO5GUztTJxLTOfMpro9DCxmolmFIQPIhxoTTYk7ykKBJJSPCKbVwgNhZIJwIPekNm6MC4K/QwahKHIixy3h2Op9vCcyVoEpN9E1K1WdiUAdgJrkcTBbJcr/It5A7bGfwr+z8MHO0CSMZW47W1zAvaGItSzsAjULCFdegalsniWYbfOvpck7SmYb3/3wh97v6ejFIaPxSmuGuGHyQGI3JjvftD7YkLv+Va8hO7BTmjqHLtRmx/DIs3V9ypai4yV68P/xPU+htQ1cTO/Yu6YMybTa/9y3DiSzMf1+3UwgFiYUy5+Q11ulAQwxmHGHWUuDlhqE0skEN5O154F4LHKyirzYLcwo45mkYnWk1D7ATAG5RY1V1PRWs37GeikTCkWQFCnBuYQ2Uo3IUlv7oAcQQs= smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC51lPnlM/5rjd8Af/cwrhO72ybl4STES6wJQTHSL9A74BwVZkWa5uofvh9WQFmr6chZTQjtMOutIJUb5/5Dobl4xdxKDEi1zOcYpJdH8d49cgP4baICS4of9gD7J5ahNveWygIhTE/vJKx0QZpv4tDeLPZMzRoF15CUyh+7ESZQrVnY8B7gTVir9+I4vUIMOzE5N82CW6J0lx7iSBCyGa5JJrHnDlO+yqVUabY7XmHebD4MTKrypMd1+j5lDreFH4gPPs09PuA8REQs9yrjMhHXO9cbjDzENQpGDQCEfpxWXqzyx9Uf9R5Hio6hGE59zkAKTlnr6Sz7mX7nUN4uJD/Z9wAi3PV5f3x+Ja5Osoxo/yEzfspOanWPRM2v3SGqiKHqj67+QShhpCqfq8UxnUvk9buZ2VQwAl4oSrOrR1G3avTTOR5bb0bPr8n0eDNLe4jHd+JVy+5p9PlYkpO6ps/A85vLIMFi+sW1ucm31oNlSTpXqES8gFSlJGfHxW+sSM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 407880c6d3fb77318fff01c863715090f9c2de69 timestamp: 2023-07-27_03:42:08 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-27T13:53:12.074 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/qa; will attempt to use it 2023-07-27T13:53:12.075 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/qa/tasks 2023-07-27T13:53:12.076 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-27T13:53:12.080 INFO:teuthology.task.internal:Checking packages... 2023-07-27T13:53:12.111 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f' 2023-07-27T13:53:12.111 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-27T13:53:12.112 INFO:teuthology.packaging:ref: None 2023-07-27T13:53:12.112 INFO:teuthology.packaging:tag: None 2023-07-27T13:53:12.112 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-07-26-0858-pacific 2023-07-27T13:53:12.112 INFO:teuthology.packaging:sha1: cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f 2023-07-27T13:53:12.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2023-07-26-0858-pacific 2023-07-27T13:53:22.395 INFO:teuthology.task.internal:Found packages for ceph version 16.2.13-434.gcb5f5cfb 2023-07-27T13:53:22.396 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-27T13:53:22.402 INFO:teuthology.task.internal:no buildpackages task found 2023-07-27T13:53:22.403 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-27T13:53:22.410 INFO:teuthology.task.internal:Saving configuration 2023-07-27T13:53:22.439 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-27T13:53:22.446 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T13:53:27.479 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 13:45:49.269076', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMby7u9sdASsVUYhCW2lOt/9zS5wKwv7yrIBc2Ffha7EbVIAhzGjw4us5ZFgJRL7w7hdauWC09flAM53/jR7LI0='} 2023-07-27T13:53:32.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 13:45:49.266714', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHn9+vbe3EGI+rWYfXWFtMfBZjvJxRRTFTnntjD7Rxmv8SW8gQhTtqq/o/PmJNx4UDQIOHSHlrGrgPIf1CLej4='} 2023-07-27T13:53:32.513 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-27T13:53:32.525 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-27T13:53:32.525 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-27T13:53:32.525 INFO:teuthology.run_tasks:Running task console_log... 2023-07-27T13:53:47.624 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99223a9ee0>, signals=[15]) 2023-07-27T13:53:47.625 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-27T13:53:47.632 INFO:teuthology.task.internal:Opening connections... 2023-07-27T13:53:47.633 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T13:53:47.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T13:53:47.703 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T13:53:47.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T13:53:47.775 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-27T13:53:47.781 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-07-27T13:53:47.804 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-07-27T13:53:47.805 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-07-27T13:53:47.865 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-07-27T13:53:47.865 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2023-07-27T13:53:47.866 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-07-27T13:53:47.866 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-07-27T13:53:47.866 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2023-07-27T13:53:47.866 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-07-27T13:53:47.866 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T13:53:47.866 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-07-27T13:53:47.866 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T13:53:47.866 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-07-27T13:53:47.867 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T13:53:47.867 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T13:53:47.867 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T13:53:47.868 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-07-27T13:53:52.893 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-07-27T13:53:52.935 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-07-27T13:53:52.935 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-07-27T13:53:52.996 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-07-27T13:53:52.996 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-07-27T13:53:52.996 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-07-27T13:53:52.996 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-07-27T13:53:52.996 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-07-27T13:53:52.996 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-07-27T13:53:52.997 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T13:53:52.997 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-07-27T13:53:52.997 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T13:53:52.997 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-07-27T13:53:52.997 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T13:53:52.997 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T13:53:52.997 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T13:53:52.998 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-27T13:53:58.025 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-27T13:53:58.036 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-27T13:53:58.042 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-27T13:53:58.042 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2023-07-27T13:53:58.045 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2023-07-27T13:53:58.066 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-27T13:53:58.073 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-27T13:53:58.073 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2023-07-27T13:53:58.106 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2023-07-27T13:53:58.140 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-27T13:54:08.216 INFO:teuthology.run_tasks:Running task kernel... 2023-07-27T13:54:08.233 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-07-27T13:54:08.234 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-27T13:54:08.235 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-27T13:54:08.235 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-27T13:54:08.236 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-27T13:54:08.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T13:54:08.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-27T13:54:08.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T13:54:08.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-27T13:54:09.281 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8e3722cc016410c8de834520a714aab9f006b92a 2023-07-27T13:54:09.282 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8e3722cc016410c8de834520a714aab9f006b92a"... 2023-07-27T13:54:09.282 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-07-27T13:54:09.303 INFO:teuthology.orchestra.run.smithi115.stdout:4.18.0-489.el8.x86_64 2023-07-27T13:54:09.303 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 8e3722cc016410c8de834520a714aab9f006b92a 2023-07-27T13:54:09.304 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-27T13:54:09.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum upgrade -y linux-firmware 2023-07-27T13:54:09.320 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8e3722cc016410c8de834520a714aab9f006b92a 2023-07-27T13:54:09.321 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8e3722cc016410c8de834520a714aab9f006b92a"... 2023-07-27T13:54:09.321 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2023-07-27T13:54:09.343 INFO:teuthology.orchestra.run.smithi159.stdout:4.18.0-489.el8.x86_64 2023-07-27T13:54:09.343 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 8e3722cc016410c8de834520a714aab9f006b92a 2023-07-27T13:54:09.343 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-27T13:54:09.344 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum upgrade -y linux-firmware 2023-07-27T13:54:29.998 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - AppStream 1.7 MB/s | 31 MB 00:18 2023-07-27T13:54:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - AppStream 1.6 MB/s | 31 MB 00:18 2023-07-27T13:54:48.963 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - BaseOS 3.1 MB/s | 41 MB 00:13 2023-07-27T13:54:55.505 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - Extras 30 kB/s | 18 kB 00:00 2023-07-27T13:54:56.080 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.6 kB 00:00 2023-07-27T13:54:56.407 INFO:teuthology.orchestra.run.smithi159.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-07-27T13:54:59.677 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 16 MB 00:03 2023-07-27T13:55:01.853 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - BaseOS 1.6 MB/s | 41 MB 00:25 2023-07-27T13:55:03.384 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 540 kB/s | 24 kB 00:00 2023-07-27T13:55:06.815 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2023-07-27T13:55:06.816 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-07-27T13:55:06.816 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repo Size 2023-07-27T13:55:06.816 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-07-27T13:55:06.817 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2023-07-27T13:55:06.817 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-27T13:55:06.817 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T13:55:06.817 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2023-07-27T13:55:06.818 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-07-27T13:55:06.818 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 1 Package 2023-07-27T13:55:06.818 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T13:55:06.818 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 266 M 2023-07-27T13:55:06.818 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2023-07-27T13:55:08.746 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras 20 kB/s | 18 kB 00:00 2023-07-27T13:55:12.604 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras common packages 1.8 kB/s | 6.6 kB 00:03 2023-07-27T13:55:13.106 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 9.8 kB/s | 3.5 kB 00:00 2023-07-27T13:55:14.198 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-07-27T13:55:17.914 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 542 kB/s | 24 kB 00:00 2023-07-27T13:55:21.377 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2023-07-27T13:55:21.378 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-07-27T13:55:21.378 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2023-07-27T13:55:21.378 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-07-27T13:55:21.378 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2023-07-27T13:55:21.379 INFO:teuthology.orchestra.run.smithi115.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-27T13:55:21.379 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T13:55:21.379 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2023-07-27T13:55:21.379 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-07-27T13:55:21.379 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 1 Package 2023-07-27T13:55:21.379 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T13:55:21.380 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 266 M 2023-07-27T13:55:21.380 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2023-07-27T13:58:49.744 INFO:teuthology.orchestra.run.smithi159.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 1.2 MB/s | 266 MB 03:42 2023-07-27T13:58:49.744 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2023-07-27T13:58:49.745 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.2 MB/s | 266 MB 03:42 2023-07-27T13:58:51.327 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2023-07-27T13:58:51.407 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2023-07-27T13:58:51.408 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2023-07-27T13:58:53.064 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2023-07-27T13:58:53.102 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2023-07-27T13:59:10.889 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2023-07-27T13:59:11.270 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-27T13:59:11.550 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T13:59:11.773 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T13:59:11.773 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-27T13:59:12.426 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T13:59:12.426 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T13:59:12.426 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2023-07-27T13:59:12.427 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-27T13:59:12.427 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T13:59:12.427 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2023-07-27T13:59:12.585 INFO:teuthology.task.kernel:Downloading kernel 8e3722cc016410c8de834520a714aab9f006b92a on client.1... 2023-07-27T13:59:12.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e3722cc016410c8de834520a714aab9f006b92a 2023-07-27T13:59:12.931 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/8e3722cc016410c8de834520a714aab9f006b92a/centos/8/flavors/default/x86_64/ 2023-07-27T13:59:12.931 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_g8e3722cc0164-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/8e3722cc016410c8de834520a714aab9f006b92a/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-27T13:59:12.934 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi159.front.sepia.ceph.com to complete... 2023-07-27T13:59:13.048 INFO:teuthology.orchestra.run.smithi115.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 1.1 MB/s | 266 MB 03:51 2023-07-27T13:59:13.049 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2023-07-27T13:59:13.049 INFO:teuthology.orchestra.run.smithi115.stdout:Total 1.1 MB/s | 266 MB 03:51 2023-07-27T13:59:14.625 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2023-07-27T13:59:14.699 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2023-07-27T13:59:14.699 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2023-07-27T13:59:16.368 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2023-07-27T13:59:16.395 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2023-07-27T13:59:34.117 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2023-07-27T13:59:34.502 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-27T13:59:34.756 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T13:59:34.989 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T13:59:34.989 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-27T13:59:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-27T13:59:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T13:59:35.735 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2023-07-27T13:59:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-27T13:59:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T13:59:35.736 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2023-07-27T13:59:35.897 INFO:teuthology.task.kernel:Downloading kernel 8e3722cc016410c8de834520a714aab9f006b92a on client.0... 2023-07-27T13:59:35.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e3722cc016410c8de834520a714aab9f006b92a 2023-07-27T13:59:40.207 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/8e3722cc016410c8de834520a714aab9f006b92a/centos/8/flavors/default/x86_64/ 2023-07-27T13:59:40.208 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_g8e3722cc0164-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/8e3722cc016410c8de834520a714aab9f006b92a/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-27T13:59:40.212 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi115.front.sepia.ceph.com to complete... 2023-07-27T14:03:39.155 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27 14:03:39 URL:https://4.chacra.ceph.com/r/kernel/testing/8e3722cc016410c8de834520a714aab9f006b92a/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_g8e3722cc0164-1.x86_64.rpm [380683860/380683860] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-27T14:03:39.156 INFO:teuthology.orchestra.run.smithi159.stderr:FINISHED --2023-07-27 14:03:39-- 2023-07-27T14:03:39.156 INFO:teuthology.orchestra.run.smithi159.stderr:Total wall clock time: 4m 26s 2023-07-27T14:03:39.156 INFO:teuthology.orchestra.run.smithi159.stderr:Downloaded: 1 files, 363M in 4m 26s (1.37 MB/s) 2023-07-27T14:03:39.157 INFO:teuthology.task.kernel:Installing kernel 8e3722cc016410c8de834520a714aab9f006b92a on client.1... 2023-07-27T14:03:39.158 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-27T14:03:40.842 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying... ######################################## 2023-07-27T14:03:40.887 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing... ######################################## 2023-07-27T14:03:40.997 INFO:teuthology.orchestra.run.smithi159.stdout:Updating / installing... 2023-07-27T14:03:44.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27 14:03:44 URL:https://4.chacra.ceph.com/r/kernel/testing/8e3722cc016410c8de834520a714aab9f006b92a/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_g8e3722cc0164-1.x86_64.rpm [380683860/380683860] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-27T14:03:44.746 INFO:teuthology.orchestra.run.smithi115.stderr:FINISHED --2023-07-27 14:03:44-- 2023-07-27T14:03:44.746 INFO:teuthology.orchestra.run.smithi115.stderr:Total wall clock time: 4m 5s 2023-07-27T14:03:44.747 INFO:teuthology.orchestra.run.smithi115.stderr:Downloaded: 1 files, 363M in 4m 4s (1.49 MB/s) 2023-07-27T14:03:44.747 INFO:teuthology.task.kernel:Installing kernel 8e3722cc016410c8de834520a714aab9f006b92a on client.0... 2023-07-27T14:03:44.748 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-27T14:03:46.418 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying... ######################################## 2023-07-27T14:03:46.460 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing... ######################################## 2023-07-27T14:03:46.570 INFO:teuthology.orchestra.run.smithi115.stdout:Updating / installing... 2023-07-27T14:04:18.920 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-6.5.0_rc1_g8e3722cc0164-1 ######################################## 2023-07-27T14:04:24.760 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-6.5.0_rc1_g8e3722cc0164-1 ######################################## 2023-07-27T14:04:42.682 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-27T14:04:42.683 DEBUG:teuthology.orchestra.run.smithi159:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-27T14:04:42.734 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/System.map-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:42.734 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/config-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:42.734 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/vmlinuz-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:42.734 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:42.734 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel 2023-07-27T14:04:42.735 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch 2023-07-27T14:04:42.735 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86 2023-07-27T14:04:42.735 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto 2023-07-27T14:04:42.735 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-27T14:04:42.735 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-27T14:04:42.735 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-27T14:04:42.735 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-27T14:04:42.736 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-27T14:04:42.736 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-27T14:04:42.736 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-27T14:04:42.736 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-27T14:04:42.736 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-27T14:04:42.736 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-27T14:04:42.736 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-27T14:04:42.736 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-27T14:04:42.737 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-27T14:04:42.737 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-27T14:04:42.737 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-27T14:04:42.737 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-27T14:04:42.737 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-27T14:04:42.737 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-27T14:04:42.737 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-27T14:04:42.738 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-27T14:04:42.738 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kernel 2023-07-27T14:04:42.738 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kernel/cpu 2023-07-27T14:04:42.738 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kernel/cpu/mce 2023-07-27T14:04:42.738 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-27T14:04:42.738 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kvm 2023-07-27T14:04:42.738 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-27T14:04:42.738 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-27T14:04:42.739 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kvm/kvm.ko 2023-07-27T14:04:42.739 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto 2023-07-27T14:04:42.739 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/ansi_cprng.ko 2023-07-27T14:04:42.739 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/anubis.ko 2023-07-27T14:04:42.739 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/arc4.ko 2023-07-27T14:04:42.739 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx 2023-07-27T14:04:42.739 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_memcpy.ko 2023-07-27T14:04:42.740 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_pq.ko 2023-07-27T14:04:42.740 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-27T14:04:42.740 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_tx.ko 2023-07-27T14:04:42.740 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_xor.ko 2023-07-27T14:04:42.740 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/raid6test.ko 2023-07-27T14:04:42.740 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/authenc.ko 2023-07-27T14:04:42.740 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/authencesn.ko 2023-07-27T14:04:42.741 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/blake2b_generic.ko 2023-07-27T14:04:42.741 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/blowfish_common.ko 2023-07-27T14:04:42.741 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/blowfish_generic.ko 2023-07-27T14:04:42.741 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/camellia_generic.ko 2023-07-27T14:04:42.741 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cast5_generic.ko 2023-07-27T14:04:42.741 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cast6_generic.ko 2023-07-27T14:04:42.741 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cast_common.ko 2023-07-27T14:04:42.741 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/ccm.ko 2023-07-27T14:04:42.742 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cmac.ko 2023-07-27T14:04:42.742 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/crc32_generic.ko 2023-07-27T14:04:42.742 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/crypto_engine.ko 2023-07-27T14:04:42.742 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/crypto_user.ko 2023-07-27T14:04:42.742 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cts.ko 2023-07-27T14:04:42.742 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/des_generic.ko 2023-07-27T14:04:42.742 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/dh_generic.ko 2023-07-27T14:04:42.742 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/echainiv.ko 2023-07-27T14:04:42.743 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/essiv.ko 2023-07-27T14:04:42.743 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/fcrypt.ko 2023-07-27T14:04:42.743 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/khazad.ko 2023-07-27T14:04:42.743 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/lz4.ko 2023-07-27T14:04:42.743 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/lz4hc.ko 2023-07-27T14:04:42.743 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/md4.ko 2023-07-27T14:04:42.743 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/michael_mic.ko 2023-07-27T14:04:42.744 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/pcbc.ko 2023-07-27T14:04:42.744 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/pcrypt.ko 2023-07-27T14:04:42.744 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/rmd160.ko 2023-07-27T14:04:42.744 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/seed.ko 2023-07-27T14:04:42.744 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/serpent_generic.ko 2023-07-27T14:04:42.744 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/tcrypt.ko 2023-07-27T14:04:42.744 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/tea.ko 2023-07-27T14:04:42.744 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/twofish_common.ko 2023-07-27T14:04:42.745 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/twofish_generic.ko 2023-07-27T14:04:42.745 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/vmac.ko 2023-07-27T14:04:42.745 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/wp512.ko 2023-07-27T14:04:42.745 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/xcbc.ko 2023-07-27T14:04:42.745 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/xor.ko 2023-07-27T14:04:42.745 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/xxhash_generic.ko 2023-07-27T14:04:42.745 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers 2023-07-27T14:04:42.746 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi 2023-07-27T14:04:42.746 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-27T14:04:42.746 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/acpi_pad.ko 2023-07-27T14:04:42.746 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/custom_method.ko 2023-07-27T14:04:42.746 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/ec_sys.ko 2023-07-27T14:04:42.746 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/platform_profile.ko 2023-07-27T14:04:42.746 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/sbs.ko 2023-07-27T14:04:42.746 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/sbshc.ko 2023-07-27T14:04:42.747 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/video.ko 2023-07-27T14:04:42.747 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata 2023-07-27T14:04:42.747 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/acard-ahci.ko 2023-07-27T14:04:42.747 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/ahci_platform.ko 2023-07-27T14:04:42.747 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/ata_generic.ko 2023-07-27T14:04:42.747 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/libahci_platform.ko 2023-07-27T14:04:42.747 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_acpi.ko 2023-07-27T14:04:42.748 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_ali.ko 2023-07-27T14:04:42.748 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_amd.ko 2023-07-27T14:04:42.748 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_artop.ko 2023-07-27T14:04:42.748 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_atiixp.ko 2023-07-27T14:04:42.748 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_atp867x.ko 2023-07-27T14:04:42.748 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_cmd640.ko 2023-07-27T14:04:42.748 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_cmd64x.ko 2023-07-27T14:04:42.748 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_cypress.ko 2023-07-27T14:04:42.749 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_efar.ko 2023-07-27T14:04:42.749 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_hpt366.ko 2023-07-27T14:04:42.749 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_hpt37x.ko 2023-07-27T14:04:42.749 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-27T14:04:42.749 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-27T14:04:42.749 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_it8213.ko 2023-07-27T14:04:42.749 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_it821x.ko 2023-07-27T14:04:42.749 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_jmicron.ko 2023-07-27T14:04:42.750 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_marvell.ko 2023-07-27T14:04:42.750 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_mpiix.ko 2023-07-27T14:04:42.750 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_netcell.ko 2023-07-27T14:04:42.750 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_ninja32.ko 2023-07-27T14:04:42.750 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_ns87410.ko 2023-07-27T14:04:42.750 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_ns87415.ko 2023-07-27T14:04:42.750 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_oldpiix.ko 2023-07-27T14:04:42.751 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_opti.ko 2023-07-27T14:04:42.751 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_optidma.ko 2023-07-27T14:04:42.751 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_pcmcia.ko 2023-07-27T14:04:42.751 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-27T14:04:42.751 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-27T14:04:42.751 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_piccolo.ko 2023-07-27T14:04:42.751 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_rdc.ko 2023-07-27T14:04:42.751 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_sch.ko 2023-07-27T14:04:42.752 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_serverworks.ko 2023-07-27T14:04:42.752 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_sil680.ko 2023-07-27T14:04:42.752 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_sis.ko 2023-07-27T14:04:42.752 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_sl82c105.ko 2023-07-27T14:04:42.752 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_triflex.ko 2023-07-27T14:04:42.752 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_via.ko 2023-07-27T14:04:42.752 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pdc_adma.ko 2023-07-27T14:04:42.753 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_inic162x.ko 2023-07-27T14:04:42.753 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_mv.ko 2023-07-27T14:04:42.753 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_nv.ko 2023-07-27T14:04:42.753 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_promise.ko 2023-07-27T14:04:42.753 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_qstor.ko 2023-07-27T14:04:42.753 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_sil.ko 2023-07-27T14:04:42.753 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_sil24.ko 2023-07-27T14:04:42.753 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_sis.ko 2023-07-27T14:04:42.754 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_svw.ko 2023-07-27T14:04:42.754 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_sx4.ko 2023-07-27T14:04:42.754 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_uli.ko 2023-07-27T14:04:42.754 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_via.ko 2023-07-27T14:04:42.754 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_vsc.ko 2023-07-27T14:04:42.754 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/auxdisplay 2023-07-27T14:04:42.754 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/auxdisplay/ks0108.ko 2023-07-27T14:04:42.755 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/base 2023-07-27T14:04:42.755 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/base/regmap 2023-07-27T14:04:42.755 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-27T14:04:42.755 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-27T14:04:42.755 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/bcma 2023-07-27T14:04:42.755 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/bcma/bcma.ko 2023-07-27T14:04:42.755 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block 2023-07-27T14:04:42.755 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/aoe 2023-07-27T14:04:42.756 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/aoe/aoe.ko 2023-07-27T14:04:42.756 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/brd.ko 2023-07-27T14:04:42.756 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/drbd 2023-07-27T14:04:42.756 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/drbd/drbd.ko 2023-07-27T14:04:42.756 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/floppy.ko 2023-07-27T14:04:42.756 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/loop.ko 2023-07-27T14:04:42.756 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/mtip32xx 2023-07-27T14:04:42.757 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-27T14:04:42.757 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/nbd.ko 2023-07-27T14:04:42.757 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/null_blk 2023-07-27T14:04:42.757 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/null_blk/null_blk.ko 2023-07-27T14:04:42.757 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/pktcdvd.ko 2023-07-27T14:04:42.757 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/rbd.ko 2023-07-27T14:04:42.757 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/virtio_blk.ko 2023-07-27T14:04:42.757 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/xen-blkback 2023-07-27T14:04:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-27T14:04:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/xen-blkfront.ko 2023-07-27T14:04:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/zram 2023-07-27T14:04:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/zram/zram.ko 2023-07-27T14:04:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char 2023-07-27T14:04:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hangcheck-timer.ko 2023-07-27T14:04:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random 2023-07-27T14:04:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-27T14:04:42.759 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-27T14:04:42.759 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-27T14:04:42.759 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/via-rng.ko 2023-07-27T14:04:42.759 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-27T14:04:42.759 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi 2023-07-27T14:04:42.759 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-27T14:04:42.759 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-27T14:04:42.760 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-27T14:04:42.760 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-27T14:04:42.760 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-27T14:04:42.760 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-27T14:04:42.760 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/lp.ko 2023-07-27T14:04:42.760 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/mwave 2023-07-27T14:04:42.760 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/mwave/mwave.ko 2023-07-27T14:04:42.760 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ppdev.ko 2023-07-27T14:04:42.761 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tlclk.ko 2023-07-27T14:04:42.761 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm 2023-07-27T14:04:42.761 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm.ko 2023-07-27T14:04:42.761 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-27T14:04:42.761 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-27T14:04:42.761 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-27T14:04:42.761 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-27T14:04:42.761 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-27T14:04:42.762 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/uv_mmtimer.ko 2023-07-27T14:04:42.762 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/virtio_console.ko 2023-07-27T14:04:42.762 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq 2023-07-27T14:04:42.762 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-27T14:04:42.762 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-27T14:04:42.762 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-27T14:04:42.762 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-27T14:04:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-27T14:04:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-27T14:04:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto 2023-07-27T14:04:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/ccp 2023-07-27T14:04:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-27T14:04:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/ccp/ccp.ko 2023-07-27T14:04:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel 2023-07-27T14:04:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat 2023-07-27T14:04:42.764 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat/qat_common 2023-07-27T14:04:42.764 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-27T14:04:42.764 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-27T14:04:42.764 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-27T14:04:42.764 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/padlock-aes.ko 2023-07-27T14:04:42.764 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/padlock-sha.ko 2023-07-27T14:04:42.764 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/virtio 2023-07-27T14:04:42.765 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-27T14:04:42.765 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dca 2023-07-27T14:04:42.765 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dca/dca.ko 2023-07-27T14:04:42.765 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/devfreq 2023-07-27T14:04:42.765 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-27T14:04:42.765 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma 2023-07-27T14:04:42.765 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma/dw 2023-07-27T14:04:42.765 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-27T14:04:42.766 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma/ioat 2023-07-27T14:04:42.766 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-27T14:04:42.766 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac 2023-07-27T14:04:42.766 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/amd64_edac.ko 2023-07-27T14:04:42.766 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/e752x_edac.ko 2023-07-27T14:04:42.766 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/edac_mce_amd.ko 2023-07-27T14:04:42.766 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i3000_edac.ko 2023-07-27T14:04:42.767 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i3200_edac.ko 2023-07-27T14:04:42.767 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i5100_edac.ko 2023-07-27T14:04:42.767 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i5400_edac.ko 2023-07-27T14:04:42.767 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i7300_edac.ko 2023-07-27T14:04:42.767 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i7core_edac.ko 2023-07-27T14:04:42.767 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i82975x_edac.ko 2023-07-27T14:04:42.767 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/ie31200_edac.ko 2023-07-27T14:04:42.767 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/sb_edac.ko 2023-07-27T14:04:42.768 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/x38_edac.ko 2023-07-27T14:04:42.768 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/firmware 2023-07-27T14:04:42.768 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/firmware/edd.ko 2023-07-27T14:04:42.768 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-27T14:04:42.768 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/gpio 2023-07-27T14:04:42.768 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/gpio/gpio-ich.ko 2023-07-27T14:04:42.768 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-27T14:04:42.769 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid 2023-07-27T14:04:42.769 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-appleir.ko 2023-07-27T14:04:42.769 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-aureal.ko 2023-07-27T14:04:42.769 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-axff.ko 2023-07-27T14:04:42.769 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-dr.ko 2023-07-27T14:04:42.769 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-elecom.ko 2023-07-27T14:04:42.769 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-elo.ko 2023-07-27T14:04:42.769 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-emsff.ko 2023-07-27T14:04:42.770 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-gaff.ko 2023-07-27T14:04:42.770 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-gt683r.ko 2023-07-27T14:04:42.770 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-gyration.ko 2023-07-27T14:04:42.770 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-27T14:04:42.770 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-27T14:04:42.770 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-holtekff.ko 2023-07-27T14:04:42.770 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-hyperv.ko 2023-07-27T14:04:42.770 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-icade.ko 2023-07-27T14:04:42.771 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-keytouch.ko 2023-07-27T14:04:42.771 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-kye.ko 2023-07-27T14:04:42.771 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-lcpower.ko 2023-07-27T14:04:42.771 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-led.ko 2023-07-27T14:04:42.771 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-lenovo.ko 2023-07-27T14:04:42.771 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-27T14:04:42.771 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-27T14:04:42.771 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-multitouch.ko 2023-07-27T14:04:42.772 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-ortek.ko 2023-07-27T14:04:42.772 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-penmount.ko 2023-07-27T14:04:42.772 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-petalynx.ko 2023-07-27T14:04:42.772 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-picolcd.ko 2023-07-27T14:04:42.772 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-pl.ko 2023-07-27T14:04:42.772 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-plantronics.ko 2023-07-27T14:04:42.772 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-primax.ko 2023-07-27T14:04:42.773 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-rmi.ko 2023-07-27T14:04:42.773 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-27T14:04:42.773 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-common.ko 2023-07-27T14:04:42.773 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-27T14:04:42.773 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-27T14:04:42.773 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-27T14:04:42.773 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-27T14:04:42.773 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-27T14:04:42.774 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-27T14:04:42.774 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-27T14:04:42.774 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-27T14:04:42.774 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-27T14:04:42.774 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat.ko 2023-07-27T14:04:42.774 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-saitek.ko 2023-07-27T14:04:42.774 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-samsung.ko 2023-07-27T14:04:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-27T14:04:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-sjoy.ko 2023-07-27T14:04:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-sony.ko 2023-07-27T14:04:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-speedlink.ko 2023-07-27T14:04:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-steelseries.ko 2023-07-27T14:04:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-sunplus.ko 2023-07-27T14:04:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-27T14:04:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-tivo.ko 2023-07-27T14:04:42.776 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-tmff.ko 2023-07-27T14:04:42.776 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-topseed.ko 2023-07-27T14:04:42.776 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-twinhan.ko 2023-07-27T14:04:42.776 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-uclogic.ko 2023-07-27T14:04:42.776 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-waltop.ko 2023-07-27T14:04:42.776 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-wiimote.ko 2023-07-27T14:04:42.776 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-xinmo.ko 2023-07-27T14:04:42.777 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-zpff.ko 2023-07-27T14:04:42.777 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-zydacron.ko 2023-07-27T14:04:42.777 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/uhid.ko 2023-07-27T14:04:42.777 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/wacom.ko 2023-07-27T14:04:42.777 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hv 2023-07-27T14:04:42.777 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hv/hv_balloon.ko 2023-07-27T14:04:42.777 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hv/hv_utils.ko 2023-07-27T14:04:42.777 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hv/hv_vmbus.ko 2023-07-27T14:04:42.778 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon 2023-07-27T14:04:42.778 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/abituguru.ko 2023-07-27T14:04:42.778 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/abituguru3.ko 2023-07-27T14:04:42.778 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-27T14:04:42.778 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ad7414.ko 2023-07-27T14:04:42.778 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ad7418.ko 2023-07-27T14:04:42.778 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adc128d818.ko 2023-07-27T14:04:42.779 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm1025.ko 2023-07-27T14:04:42.779 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm1026.ko 2023-07-27T14:04:42.779 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm1029.ko 2023-07-27T14:04:42.779 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm1031.ko 2023-07-27T14:04:42.779 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm9240.ko 2023-07-27T14:04:42.779 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ads7828.ko 2023-07-27T14:04:42.779 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7410.ko 2023-07-27T14:04:42.779 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7411.ko 2023-07-27T14:04:42.780 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7462.ko 2023-07-27T14:04:42.780 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7470.ko 2023-07-27T14:04:42.780 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7475.ko 2023-07-27T14:04:42.780 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7x10.ko 2023-07-27T14:04:42.780 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/amc6821.ko 2023-07-27T14:04:42.780 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/applesmc.ko 2023-07-27T14:04:42.780 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/asb100.ko 2023-07-27T14:04:42.781 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/asc7621.ko 2023-07-27T14:04:42.781 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-27T14:04:42.781 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/atxp1.ko 2023-07-27T14:04:42.781 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/coretemp.ko 2023-07-27T14:04:42.781 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-27T14:04:42.781 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/dme1737.ko 2023-07-27T14:04:42.781 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ds1621.ko 2023-07-27T14:04:42.781 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ds620.ko 2023-07-27T14:04:42.782 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/emc1403.ko 2023-07-27T14:04:42.782 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/emc6w201.ko 2023-07-27T14:04:42.782 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/f71805f.ko 2023-07-27T14:04:42.782 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/f71882fg.ko 2023-07-27T14:04:42.782 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/f75375s.ko 2023-07-27T14:04:42.782 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/fam15h_power.ko 2023-07-27T14:04:42.782 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/fschmd.ko 2023-07-27T14:04:42.783 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/g760a.ko 2023-07-27T14:04:42.783 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/g762.ko 2023-07-27T14:04:42.783 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/gl518sm.ko 2023-07-27T14:04:42.783 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/gl520sm.ko 2023-07-27T14:04:42.783 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-27T14:04:42.783 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/i5500_temp.ko 2023-07-27T14:04:42.783 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/i5k_amb.ko 2023-07-27T14:04:42.783 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ibmaem.ko 2023-07-27T14:04:42.784 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ibmpex.ko 2023-07-27T14:04:42.784 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ina209.ko 2023-07-27T14:04:42.784 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ina2xx.ko 2023-07-27T14:04:42.784 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/it87.ko 2023-07-27T14:04:42.784 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/k10temp.ko 2023-07-27T14:04:42.784 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/k8temp.ko 2023-07-27T14:04:42.784 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lineage-pem.ko 2023-07-27T14:04:42.785 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm63.ko 2023-07-27T14:04:42.785 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm73.ko 2023-07-27T14:04:42.785 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm75.ko 2023-07-27T14:04:42.785 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm77.ko 2023-07-27T14:04:42.785 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm78.ko 2023-07-27T14:04:42.785 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm80.ko 2023-07-27T14:04:42.785 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm83.ko 2023-07-27T14:04:42.785 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm85.ko 2023-07-27T14:04:42.786 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm87.ko 2023-07-27T14:04:42.786 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm90.ko 2023-07-27T14:04:42.786 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm92.ko 2023-07-27T14:04:42.786 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm93.ko 2023-07-27T14:04:42.786 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm95234.ko 2023-07-27T14:04:42.786 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm95241.ko 2023-07-27T14:04:42.786 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm95245.ko 2023-07-27T14:04:42.786 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc2945.ko 2023-07-27T14:04:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4151.ko 2023-07-27T14:04:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4215.ko 2023-07-27T14:04:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4222.ko 2023-07-27T14:04:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4245.ko 2023-07-27T14:04:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4260.ko 2023-07-27T14:04:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4261.ko 2023-07-27T14:04:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max16065.ko 2023-07-27T14:04:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max1619.ko 2023-07-27T14:04:42.788 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max1668.ko 2023-07-27T14:04:42.788 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max197.ko 2023-07-27T14:04:42.788 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max6639.ko 2023-07-27T14:04:42.788 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max6650.ko 2023-07-27T14:04:42.788 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max6697.ko 2023-07-27T14:04:42.788 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/mcp3021.ko 2023-07-27T14:04:42.788 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/nct6683.ko 2023-07-27T14:04:42.789 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/nct6775-core.ko 2023-07-27T14:04:42.789 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/nct6775.ko 2023-07-27T14:04:42.789 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/nct7802.ko 2023-07-27T14:04:42.789 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pc87360.ko 2023-07-27T14:04:42.789 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pc87427.ko 2023-07-27T14:04:42.789 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pcf8591.ko 2023-07-27T14:04:42.789 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus 2023-07-27T14:04:42.789 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-27T14:04:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-27T14:04:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-27T14:04:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-27T14:04:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-27T14:04:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-27T14:04:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-27T14:04:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-27T14:04:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-27T14:04:42.791 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-27T14:04:42.791 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-27T14:04:42.791 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-27T14:04:42.791 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/powr1220.ko 2023-07-27T14:04:42.791 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sch5627.ko 2023-07-27T14:04:42.791 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sch5636.ko 2023-07-27T14:04:42.791 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-27T14:04:42.792 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sht15.ko 2023-07-27T14:04:42.792 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sht21.ko 2023-07-27T14:04:42.792 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/shtc1.ko 2023-07-27T14:04:42.792 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sis5595.ko 2023-07-27T14:04:42.792 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/smsc47b397.ko 2023-07-27T14:04:42.792 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/smsc47m1.ko 2023-07-27T14:04:42.792 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/smsc47m192.ko 2023-07-27T14:04:42.792 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/thmc50.ko 2023-07-27T14:04:42.793 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/tmp102.ko 2023-07-27T14:04:42.793 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/tmp103.ko 2023-07-27T14:04:42.793 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/tmp401.ko 2023-07-27T14:04:42.793 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/tmp421.ko 2023-07-27T14:04:42.793 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/via-cputemp.ko 2023-07-27T14:04:42.793 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/via686a.ko 2023-07-27T14:04:42.793 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/vt1211.ko 2023-07-27T14:04:42.794 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/vt8231.ko 2023-07-27T14:04:42.794 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83627ehf.ko 2023-07-27T14:04:42.794 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83627hf.ko 2023-07-27T14:04:42.794 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83781d.ko 2023-07-27T14:04:42.794 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83791d.ko 2023-07-27T14:04:42.794 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83792d.ko 2023-07-27T14:04:42.794 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83793.ko 2023-07-27T14:04:42.794 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83795.ko 2023-07-27T14:04:42.795 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83l785ts.ko 2023-07-27T14:04:42.795 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83l786ng.ko 2023-07-27T14:04:42.795 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c 2023-07-27T14:04:42.795 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/algos 2023-07-27T14:04:42.795 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-27T14:04:42.795 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-27T14:04:42.795 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses 2023-07-27T14:04:42.795 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-27T14:04:42.796 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-27T14:04:42.796 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-27T14:04:42.796 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-27T14:04:42.796 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-27T14:04:42.796 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-27T14:04:42.796 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-27T14:04:42.796 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-27T14:04:42.797 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-27T14:04:42.797 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-27T14:04:42.797 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-27T14:04:42.797 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-27T14:04:42.797 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-27T14:04:42.797 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-27T14:04:42.797 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-27T14:04:42.797 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-27T14:04:42.798 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-27T14:04:42.798 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-27T14:04:42.798 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-27T14:04:42.798 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-27T14:04:42.798 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-27T14:04:42.798 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-27T14:04:42.798 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-27T14:04:42.799 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-dev.ko 2023-07-27T14:04:42.799 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-mux.ko 2023-07-27T14:04:42.799 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-27T14:04:42.799 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-smbus.ko 2023-07-27T14:04:42.799 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-stub.ko 2023-07-27T14:04:42.799 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband 2023-07-27T14:04:42.799 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core 2023-07-27T14:04:42.799 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-27T14:04:42.800 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/ib_core.ko 2023-07-27T14:04:42.800 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-27T14:04:42.800 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-27T14:04:42.800 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-27T14:04:42.800 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-27T14:04:42.801 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-27T14:04:42.801 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw 2023-07-27T14:04:42.801 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/cxgb4 2023-07-27T14:04:42.801 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-27T14:04:42.801 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mlx4 2023-07-27T14:04:42.801 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-27T14:04:42.802 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mlx5 2023-07-27T14:04:42.802 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-27T14:04:42.802 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mthca 2023-07-27T14:04:42.802 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-27T14:04:42.802 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp 2023-07-27T14:04:42.802 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/ipoib 2023-07-27T14:04:42.802 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-27T14:04:42.802 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/iser 2023-07-27T14:04:42.803 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-27T14:04:42.803 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/isert 2023-07-27T14:04:42.803 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-27T14:04:42.803 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/srp 2023-07-27T14:04:42.803 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-27T14:04:42.803 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/srpt 2023-07-27T14:04:42.803 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-27T14:04:42.803 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input 2023-07-27T14:04:42.804 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport 2023-07-27T14:04:42.804 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-27T14:04:42.804 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-27T14:04:42.804 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/gameport.ko 2023-07-27T14:04:42.804 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/lightning.ko 2023-07-27T14:04:42.804 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/ns558.ko 2023-07-27T14:04:42.804 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/joydev.ko 2023-07-27T14:04:42.805 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/keyboard 2023-07-27T14:04:42.805 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-27T14:04:42.805 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse 2023-07-27T14:04:42.806 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/appletouch.ko 2023-07-27T14:04:42.806 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/bcm5974.ko 2023-07-27T14:04:42.806 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/cyapatp.ko 2023-07-27T14:04:42.806 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-27T14:04:42.806 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/sermouse.ko 2023-07-27T14:04:42.806 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-27T14:04:42.806 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-27T14:04:42.807 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-27T14:04:42.807 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/rmi4 2023-07-27T14:04:42.807 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-27T14:04:42.807 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio 2023-07-27T14:04:42.807 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio/altera_ps2.ko 2023-07-27T14:04:42.807 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio/arc_ps2.ko 2023-07-27T14:04:42.807 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-27T14:04:42.807 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio/serio_raw.ko 2023-07-27T14:04:42.808 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/sparse-keymap.ko 2023-07-27T14:04:42.808 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/iommu 2023-07-27T14:04:42.808 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/iommu/amd 2023-07-27T14:04:42.808 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-27T14:04:42.808 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds 2023-07-27T14:04:42.808 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/leds-blinkm.ko 2023-07-27T14:04:42.808 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/leds-lm3530.ko 2023-07-27T14:04:42.809 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/leds-lp3944.ko 2023-07-27T14:04:42.809 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/leds-ss4200.ko 2023-07-27T14:04:42.809 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger 2023-07-27T14:04:42.809 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-27T14:04:42.809 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-27T14:04:42.809 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-27T14:04:42.809 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-27T14:04:42.809 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-27T14:04:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-27T14:04:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-27T14:04:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-27T14:04:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md 2023-07-27T14:04:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/bcache 2023-07-27T14:04:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/bcache/bcache.ko 2023-07-27T14:04:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-bio-prison.ko 2023-07-27T14:04:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-cache-smq.ko 2023-07-27T14:04:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-cache.ko 2023-07-27T14:04:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-crypt.ko 2023-07-27T14:04:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-delay.ko 2023-07-27T14:04:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-flakey.ko 2023-07-27T14:04:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-log-userspace.ko 2023-07-27T14:04:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-multipath.ko 2023-07-27T14:04:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-queue-length.ko 2023-07-27T14:04:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-raid.ko 2023-07-27T14:04:42.812 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-round-robin.ko 2023-07-27T14:04:42.812 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-service-time.ko 2023-07-27T14:04:42.812 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-switch.ko 2023-07-27T14:04:42.812 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-thin-pool.ko 2023-07-27T14:04:42.812 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-verity.ko 2023-07-27T14:04:42.812 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/faulty.ko 2023-07-27T14:04:42.812 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/linear.ko 2023-07-27T14:04:42.813 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/multipath.ko 2023-07-27T14:04:42.813 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/persistent-data 2023-07-27T14:04:42.813 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-27T14:04:42.813 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/raid0.ko 2023-07-27T14:04:42.813 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/raid1.ko 2023-07-27T14:04:42.813 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/raid10.ko 2023-07-27T14:04:42.813 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/raid456.ko 2023-07-27T14:04:42.814 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message 2023-07-27T14:04:42.814 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion 2023-07-27T14:04:42.814 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptbase.ko 2023-07-27T14:04:42.814 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptctl.ko 2023-07-27T14:04:42.814 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptfc.ko 2023-07-27T14:04:42.814 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptlan.ko 2023-07-27T14:04:42.814 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptsas.ko 2023-07-27T14:04:42.814 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptscsih.ko 2023-07-27T14:04:42.815 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptspi.ko 2023-07-27T14:04:42.815 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd 2023-07-27T14:04:42.815 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/lpc_ich.ko 2023-07-27T14:04:42.815 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/lpc_sch.ko 2023-07-27T14:04:42.815 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/mfd-core.ko 2023-07-27T14:04:42.815 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/sm501.ko 2023-07-27T14:04:42.815 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/viperboard.ko 2023-07-27T14:04:42.816 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/vx855.ko 2023-07-27T14:04:42.816 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/wl1273-core.ko 2023-07-27T14:04:42.816 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc 2023-07-27T14:04:42.816 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/altera-stapl 2023-07-27T14:04:42.816 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-27T14:04:42.816 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/apds9802als.ko 2023-07-27T14:04:42.816 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/apds990x.ko 2023-07-27T14:04:42.817 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/bh1770glc.ko 2023-07-27T14:04:42.817 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/cb710 2023-07-27T14:04:42.817 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/cb710/cb710.ko 2023-07-27T14:04:42.817 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom 2023-07-27T14:04:42.817 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom/at24.ko 2023-07-27T14:04:42.817 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-27T14:04:42.817 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-27T14:04:42.818 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom/max6875.ko 2023-07-27T14:04:42.818 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/enclosure.ko 2023-07-27T14:04:42.818 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/hpilo.ko 2023-07-27T14:04:42.818 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/isl29003.ko 2023-07-27T14:04:42.818 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/isl29020.ko 2023-07-27T14:04:42.818 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/lis3lv02d 2023-07-27T14:04:42.818 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-27T14:04:42.819 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-27T14:04:42.819 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/mei 2023-07-27T14:04:42.819 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/mei/mei-me.ko 2023-07-27T14:04:42.819 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/mei/mei-txe.ko 2023-07-27T14:04:42.819 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/mei/mei.ko 2023-07-27T14:04:42.819 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-gru 2023-07-27T14:04:42.819 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-27T14:04:42.820 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-xp 2023-07-27T14:04:42.820 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-27T14:04:42.820 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-27T14:04:42.820 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-27T14:04:42.820 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/tifm_7xx1.ko 2023-07-27T14:04:42.820 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/tifm_core.ko 2023-07-27T14:04:42.820 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/tsl2550.ko 2023-07-27T14:04:42.821 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/vmw_balloon.ko 2023-07-27T14:04:42.821 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/vmw_vmci 2023-07-27T14:04:42.821 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-27T14:04:42.821 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net 2023-07-27T14:04:42.821 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/bonding 2023-07-27T14:04:42.821 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/bonding/bonding.ko 2023-07-27T14:04:42.821 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa 2023-07-27T14:04:42.822 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/b53 2023-07-27T14:04:42.822 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-27T14:04:42.822 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-27T14:04:42.822 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-27T14:04:42.822 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/mv88e6xxx 2023-07-27T14:04:42.822 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-27T14:04:42.822 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dummy.ko 2023-07-27T14:04:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/eql.ko 2023-07-27T14:04:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet 2023-07-27T14:04:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com 2023-07-27T14:04:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-27T14:04:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-27T14:04:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-27T14:04:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-27T14:04:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390 2023-07-27T14:04:42.824 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-27T14:04:42.824 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-27T14:04:42.824 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-27T14:04:42.824 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-27T14:04:42.824 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/adaptec 2023-07-27T14:04:42.824 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-27T14:04:42.824 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/agere 2023-07-27T14:04:42.825 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-27T14:04:42.825 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/alteon 2023-07-27T14:04:42.825 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-27T14:04:42.825 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/altera 2023-07-27T14:04:42.825 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-27T14:04:42.825 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/amd 2023-07-27T14:04:42.825 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-27T14:04:42.825 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-27T14:04:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-27T14:04:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros 2023-07-27T14:04:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/alx 2023-07-27T14:04:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-27T14:04:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-27T14:04:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-27T14:04:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-27T14:04:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-27T14:04:42.827 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atlx 2023-07-27T14:04:42.827 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-27T14:04:42.827 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-27T14:04:42.827 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom 2023-07-27T14:04:42.827 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-27T14:04:42.827 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-27T14:04:42.827 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-27T14:04:42.828 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-27T14:04:42.828 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-27T14:04:42.828 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/genet 2023-07-27T14:04:42.828 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-27T14:04:42.828 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-27T14:04:42.828 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/brocade 2023-07-27T14:04:42.828 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/brocade/bna 2023-07-27T14:04:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-27T14:04:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio 2023-07-27T14:04:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-27T14:04:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-27T14:04:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-27T14:04:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-27T14:04:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-27T14:04:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-27T14:04:42.830 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-27T14:04:42.830 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-27T14:04:42.830 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-27T14:04:42.830 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-27T14:04:42.830 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/cisco 2023-07-27T14:04:42.830 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/cisco/enic 2023-07-27T14:04:42.830 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-27T14:04:42.830 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec 2023-07-27T14:04:42.831 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip 2023-07-27T14:04:42.831 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-27T14:04:42.831 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-27T14:04:42.831 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-27T14:04:42.831 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-27T14:04:42.831 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-27T14:04:42.831 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-27T14:04:42.831 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dlink 2023-07-27T14:04:42.832 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-27T14:04:42.832 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-27T14:04:42.832 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dnet.ko 2023-07-27T14:04:42.832 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/emulex 2023-07-27T14:04:42.832 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/emulex/benet 2023-07-27T14:04:42.832 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-27T14:04:42.832 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/ethoc.ko 2023-07-27T14:04:42.833 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/fealnx.ko 2023-07-27T14:04:42.833 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel 2023-07-27T14:04:42.833 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-27T14:04:42.833 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e1000 2023-07-27T14:04:42.833 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-27T14:04:42.833 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e1000e 2023-07-27T14:04:42.833 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-27T14:04:42.833 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/fm10k 2023-07-27T14:04:42.834 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-27T14:04:42.834 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/i40e 2023-07-27T14:04:42.834 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-27T14:04:42.834 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/iavf 2023-07-27T14:04:42.834 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-27T14:04:42.834 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/igb 2023-07-27T14:04:42.834 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-27T14:04:42.835 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/igbvf 2023-07-27T14:04:42.835 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-27T14:04:42.835 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-27T14:04:42.835 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-27T14:04:42.835 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-27T14:04:42.835 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-27T14:04:42.835 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/jme.ko 2023-07-27T14:04:42.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/marvell 2023-07-27T14:04:42.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-27T14:04:42.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-27T14:04:42.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-27T14:04:42.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox 2023-07-27T14:04:42.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-27T14:04:42.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-27T14:04:42.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-27T14:04:42.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-27T14:04:42.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-27T14:04:42.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-27T14:04:42.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/micrel 2023-07-27T14:04:42.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-27T14:04:42.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/myricom 2023-07-27T14:04:42.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-27T14:04:42.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-27T14:04:42.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/natsemi 2023-07-27T14:04:42.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-27T14:04:42.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-27T14:04:42.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/neterion 2023-07-27T14:04:42.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-27T14:04:42.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/nvidia 2023-07-27T14:04:42.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-27T14:04:42.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/packetengines 2023-07-27T14:04:42.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-27T14:04:42.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-27T14:04:42.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic 2023-07-27T14:04:42.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-27T14:04:42.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-27T14:04:42.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-27T14:04:42.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-27T14:04:42.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-27T14:04:42.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/rdc 2023-07-27T14:04:42.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-27T14:04:42.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek 2023-07-27T14:04:42.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-27T14:04:42.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-27T14:04:42.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-27T14:04:42.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-27T14:04:42.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/rocker 2023-07-27T14:04:42.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-27T14:04:42.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sfc 2023-07-27T14:04:42.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-27T14:04:42.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/silan 2023-07-27T14:04:42.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-27T14:04:42.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sis 2023-07-27T14:04:42.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-27T14:04:42.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-27T14:04:42.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc 2023-07-27T14:04:42.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-27T14:04:42.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-27T14:04:42.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-27T14:04:42.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-27T14:04:42.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/stmicro 2023-07-27T14:04:42.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-27T14:04:42.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-27T14:04:42.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-27T14:04:42.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun 2023-07-27T14:04:42.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-27T14:04:42.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-27T14:04:42.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-27T14:04:42.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-27T14:04:42.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/tehuti 2023-07-27T14:04:42.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-27T14:04:42.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/ti 2023-07-27T14:04:42.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-27T14:04:42.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/via 2023-07-27T14:04:42.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-27T14:04:42.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-27T14:04:42.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/wiznet 2023-07-27T14:04:42.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-27T14:04:42.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-27T14:04:42.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/xircom 2023-07-27T14:04:42.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-27T14:04:42.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/geneve.ko 2023-07-27T14:04:42.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/hyperv 2023-07-27T14:04:42.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-27T14:04:42.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ieee802154 2023-07-27T14:04:42.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-27T14:04:42.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ifb.ko 2023-07-27T14:04:42.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ipvlan 2023-07-27T14:04:42.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-27T14:04:42.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/macvlan.ko 2023-07-27T14:04:42.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/macvtap.ko 2023-07-27T14:04:42.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio 2023-07-27T14:04:42.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio.ko 2023-07-27T14:04:42.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-27T14:04:42.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-27T14:04:42.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-27T14:04:42.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mii.ko 2023-07-27T14:04:42.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/net_failover.ko 2023-07-27T14:04:42.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/netconsole.ko 2023-07-27T14:04:42.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/nlmon.ko 2023-07-27T14:04:42.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/pcs 2023-07-27T14:04:42.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-27T14:04:42.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-27T14:04:42.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy 2023-07-27T14:04:42.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/amd.ko 2023-07-27T14:04:42.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-27T14:04:42.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-27T14:04:42.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-27T14:04:42.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/bcm87xx.ko 2023-07-27T14:04:42.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/broadcom.ko 2023-07-27T14:04:42.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/cicada.ko 2023-07-27T14:04:42.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/davicom.ko 2023-07-27T14:04:42.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/dp83640.ko 2023-07-27T14:04:42.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/et1011c.ko 2023-07-27T14:04:42.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/icplus.ko 2023-07-27T14:04:42.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/lxt.ko 2023-07-27T14:04:42.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/marvell.ko 2023-07-27T14:04:42.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/micrel.ko 2023-07-27T14:04:42.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/national.ko 2023-07-27T14:04:42.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/phylink.ko 2023-07-27T14:04:42.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/qsemi.ko 2023-07-27T14:04:42.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/realtek.ko 2023-07-27T14:04:42.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/smsc.ko 2023-07-27T14:04:42.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/ste10Xp.ko 2023-07-27T14:04:42.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/vitesse.ko 2023-07-27T14:04:42.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp 2023-07-27T14:04:42.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-27T14:04:42.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_async.ko 2023-07-27T14:04:42.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-27T14:04:42.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-27T14:04:42.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-27T14:04:42.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-27T14:04:42.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/pppoe.ko 2023-07-27T14:04:42.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/pppox.ko 2023-07-27T14:04:42.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/pptp.ko 2023-07-27T14:04:42.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/slip 2023-07-27T14:04:42.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/slip/slhc.ko 2023-07-27T14:04:42.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/slip/slip.ko 2023-07-27T14:04:42.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/sungem_phy.ko 2023-07-27T14:04:42.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/tap.ko 2023-07-27T14:04:42.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team 2023-07-27T14:04:42.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team.ko 2023-07-27T14:04:42.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-27T14:04:42.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-27T14:04:42.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-27T14:04:42.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_random.ko 2023-07-27T14:04:42.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-27T14:04:42.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/tun.ko 2023-07-27T14:04:42.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/veth.ko 2023-07-27T14:04:42.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/virtio_net.ko 2023-07-27T14:04:42.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/vmxnet3 2023-07-27T14:04:42.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-27T14:04:42.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/vxlan 2023-07-27T14:04:42.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/vxlan/vxlan.ko 2023-07-27T14:04:42.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/xen-netback 2023-07-27T14:04:42.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-27T14:04:42.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/xen-netfront.ko 2023-07-27T14:04:42.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ntb 2023-07-27T14:04:42.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ntb/ntb.ko 2023-07-27T14:04:42.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/nvme 2023-07-27T14:04:42.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/nvme/host 2023-07-27T14:04:42.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/nvme/host/nvme-core.ko 2023-07-27T14:04:42.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/nvme/host/nvme.ko 2023-07-27T14:04:42.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport 2023-07-27T14:04:42.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport/parport.ko 2023-07-27T14:04:42.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport/parport_cs.ko 2023-07-27T14:04:42.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport/parport_pc.ko 2023-07-27T14:04:42.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport/parport_serial.ko 2023-07-27T14:04:42.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci 2023-07-27T14:04:42.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/hotplug 2023-07-27T14:04:42.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-27T14:04:42.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/pcie 2023-07-27T14:04:42.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-27T14:04:42.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/xen-pcifront.ko 2023-07-27T14:04:42.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pcmcia 2023-07-27T14:04:42.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pcmcia/i82092.ko 2023-07-27T14:04:42.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pcmcia/pd6729.ko 2023-07-27T14:04:42.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-27T14:04:42.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pinctrl 2023-07-27T14:04:42.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pinctrl/intel 2023-07-27T14:04:42.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-27T14:04:42.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform 2023-07-27T14:04:42.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86 2023-07-27T14:04:42.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-27T14:04:42.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/acerhdf.ko 2023-07-27T14:04:42.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-27T14:04:42.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-27T14:04:42.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-27T14:04:42.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-27T14:04:42.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-27T14:04:42.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-27T14:04:42.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-27T14:04:42.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-27T14:04:42.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-27T14:04:42.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/hdaps.ko 2023-07-27T14:04:42.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/intel 2023-07-27T14:04:42.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-27T14:04:42.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/intel_ips.ko 2023-07-27T14:04:42.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-27T14:04:42.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-27T14:04:42.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-27T14:04:42.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-27T14:04:42.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-27T14:04:42.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-27T14:04:42.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-27T14:04:42.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-27T14:04:42.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-27T14:04:42.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/wmi.ko 2023-07-27T14:04:42.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/powercap 2023-07-27T14:04:42.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-27T14:04:42.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-27T14:04:42.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps 2023-07-27T14:04:42.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/clients 2023-07-27T14:04:42.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-27T14:04:42.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-27T14:04:42.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/clients/pps_parport.ko 2023-07-27T14:04:42.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/pps_core.ko 2023-07-27T14:04:42.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ptp 2023-07-27T14:04:42.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ptp/ptp.ko 2023-07-27T14:04:42.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ptp/ptp_kvm.ko 2023-07-27T14:04:42.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc 2023-07-27T14:04:42.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-27T14:04:42.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-27T14:04:42.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-27T14:04:42.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-27T14:04:42.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-27T14:04:42.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-27T14:04:42.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-27T14:04:42.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-27T14:04:42.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-27T14:04:42.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-27T14:04:42.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-27T14:04:42.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-em3027.ko 2023-07-27T14:04:42.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-27T14:04:42.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-27T14:04:42.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-27T14:04:42.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-27T14:04:42.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-27T14:04:42.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-27T14:04:42.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-max6900.ko 2023-07-27T14:04:42.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-27T14:04:42.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-27T14:04:42.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-27T14:04:42.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-27T14:04:42.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-27T14:04:42.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-27T14:04:42.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-27T14:04:42.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-27T14:04:42.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-27T14:04:42.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-27T14:04:42.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-27T14:04:42.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-27T14:04:42.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-x1205.ko 2023-07-27T14:04:42.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi 2023-07-27T14:04:42.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/3w-9xxx.ko 2023-07-27T14:04:42.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/3w-sas.ko 2023-07-27T14:04:42.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/3w-xxxx.ko 2023-07-27T14:04:42.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/BusLogic.ko 2023-07-27T14:04:42.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/a100u2w.ko 2023-07-27T14:04:42.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aacraid 2023-07-27T14:04:42.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-27T14:04:42.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/advansys.ko 2023-07-27T14:04:42.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aic7xxx 2023-07-27T14:04:42.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-27T14:04:42.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-27T14:04:42.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/am53c974.ko 2023-07-27T14:04:42.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/arcmsr 2023-07-27T14:04:42.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-27T14:04:42.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/atp870u.ko 2023-07-27T14:04:42.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/be2iscsi 2023-07-27T14:04:42.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-27T14:04:42.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bfa 2023-07-27T14:04:42.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bfa/bfa.ko 2023-07-27T14:04:42.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bnx2fc 2023-07-27T14:04:42.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-27T14:04:42.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bnx2i 2023-07-27T14:04:42.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-27T14:04:42.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/ch.ko 2023-07-27T14:04:42.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/csiostor 2023-07-27T14:04:42.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-27T14:04:42.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi 2023-07-27T14:04:42.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-27T14:04:42.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-27T14:04:42.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-27T14:04:42.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-27T14:04:42.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-27T14:04:42.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/dc395x.ko 2023-07-27T14:04:42.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler 2023-07-27T14:04:42.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-27T14:04:42.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-27T14:04:42.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-27T14:04:42.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-27T14:04:42.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/dmx3191d.ko 2023-07-27T14:04:42.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/esas2r 2023-07-27T14:04:42.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-27T14:04:42.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/esp_scsi.ko 2023-07-27T14:04:42.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fcoe 2023-07-27T14:04:42.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-27T14:04:42.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-27T14:04:42.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fnic 2023-07-27T14:04:42.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fnic/fnic.ko 2023-07-27T14:04:42.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/hpsa.ko 2023-07-27T14:04:42.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/hptiop.ko 2023-07-27T14:04:42.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/hv_storvsc.ko 2023-07-27T14:04:42.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/initio.ko 2023-07-27T14:04:42.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/ipr.ko 2023-07-27T14:04:42.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/ips.ko 2023-07-27T14:04:42.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/isci 2023-07-27T14:04:42.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/isci/isci.ko 2023-07-27T14:04:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-27T14:04:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-27T14:04:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libfc 2023-07-27T14:04:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libfc/libfc.ko 2023-07-27T14:04:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libiscsi.ko 2023-07-27T14:04:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-27T14:04:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libsas 2023-07-27T14:04:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libsas/libsas.ko 2023-07-27T14:04:42.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/lpfc 2023-07-27T14:04:42.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-27T14:04:42.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid 2023-07-27T14:04:42.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid.ko 2023-07-27T14:04:42.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-27T14:04:42.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-27T14:04:42.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-27T14:04:42.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mpt3sas 2023-07-27T14:04:42.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-27T14:04:42.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mvsas 2023-07-27T14:04:42.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-27T14:04:42.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mvumi.ko 2023-07-27T14:04:42.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/pm8001 2023-07-27T14:04:42.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-27T14:04:42.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/pmcraid.ko 2023-07-27T14:04:42.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla1280.ko 2023-07-27T14:04:42.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla2xxx 2023-07-27T14:04:42.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-27T14:04:42.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-27T14:04:42.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla4xxx 2023-07-27T14:04:42.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-27T14:04:42.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/raid_class.ko 2023-07-27T14:04:42.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_debug.ko 2023-07-27T14:04:42.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-27T14:04:42.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-27T14:04:42.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-27T14:04:42.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-27T14:04:42.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-27T14:04:42.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/ses.ko 2023-07-27T14:04:42.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/st.ko 2023-07-27T14:04:42.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/stex.ko 2023-07-27T14:04:42.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/sym53c8xx_2 2023-07-27T14:04:42.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-27T14:04:42.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/virtio_scsi.ko 2023-07-27T14:04:42.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-27T14:04:42.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/wd719x.ko 2023-07-27T14:04:42.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ssb 2023-07-27T14:04:42.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ssb/ssb.ko 2023-07-27T14:04:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target 2023-07-27T14:04:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/iscsi 2023-07-27T14:04:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-27T14:04:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/loopback 2023-07-27T14:04:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-27T14:04:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_file.ko 2023-07-27T14:04:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_iblock.ko 2023-07-27T14:04:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_mod.ko 2023-07-27T14:04:42.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_pscsi.ko 2023-07-27T14:04:42.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_user.ko 2023-07-27T14:04:42.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/tcm_fc 2023-07-27T14:04:42.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-27T14:04:42.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal 2023-07-27T14:04:42.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel 2023-07-27T14:04:42.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal 2023-07-27T14:04:42.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-27T14:04:42.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-27T14:04:42.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-27T14:04:42.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-27T14:04:42.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-27T14:04:42.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-27T14:04:42.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-27T14:04:42.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-27T14:04:42.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-27T14:04:42.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-27T14:04:42.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-27T14:04:42.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-27T14:04:42.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-27T14:04:42.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-27T14:04:42.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-27T14:04:42.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty 2023-07-27T14:04:42.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/ipwireless 2023-07-27T14:04:42.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-27T14:04:42.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/n_gsm.ko 2023-07-27T14:04:42.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/n_hdlc.ko 2023-07-27T14:04:42.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/nozomi.ko 2023-07-27T14:04:42.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial 2023-07-27T14:04:42.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/8250 2023-07-27T14:04:42.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-27T14:04:42.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/arc_uart.ko 2023-07-27T14:04:42.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/jsm 2023-07-27T14:04:42.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-27T14:04:42.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/synclink_gt.ko 2023-07-27T14:04:42.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs 2023-07-27T14:04:42.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs/core 2023-07-27T14:04:42.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-27T14:04:42.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs/host 2023-07-27T14:04:42.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-27T14:04:42.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio 2023-07-27T14:04:42.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio.ko 2023-07-27T14:04:42.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio_aec.ko 2023-07-27T14:04:42.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio_cif.ko 2023-07-27T14:04:42.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio_pci_generic.ko 2023-07-27T14:04:42.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio_sercos3.ko 2023-07-27T14:04:42.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb 2023-07-27T14:04:42.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class 2023-07-27T14:04:42.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class/cdc-acm.ko 2023-07-27T14:04:42.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-27T14:04:42.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class/usblp.ko 2023-07-27T14:04:42.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class/usbtmc.ko 2023-07-27T14:04:42.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/host 2023-07-27T14:04:42.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-27T14:04:42.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/image 2023-07-27T14:04:42.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/image/mdc800.ko 2023-07-27T14:04:42.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/image/microtek.ko 2023-07-27T14:04:42.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc 2023-07-27T14:04:42.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/adutux.ko 2023-07-27T14:04:42.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/appledisplay.ko 2023-07-27T14:04:42.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/emi26.ko 2023-07-27T14:04:42.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/emi62.ko 2023-07-27T14:04:42.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/ezusb.ko 2023-07-27T14:04:42.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/idmouse.ko 2023-07-27T14:04:42.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/iowarrior.ko 2023-07-27T14:04:42.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-27T14:04:42.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/ldusb.ko 2023-07-27T14:04:42.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/legousbtower.ko 2023-07-27T14:04:42.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/sisusbvga 2023-07-27T14:04:42.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-27T14:04:42.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-27T14:04:42.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/usb3503.ko 2023-07-27T14:04:42.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/usblcd.ko 2023-07-27T14:04:42.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-27T14:04:42.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/uss720.ko 2023-07-27T14:04:42.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/yurex.ko 2023-07-27T14:04:42.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/phy 2023-07-27T14:04:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/phy/phy-generic.ko 2023-07-27T14:04:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial 2023-07-27T14:04:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/aircable.ko 2023-07-27T14:04:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ark3116.ko 2023-07-27T14:04:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-27T14:04:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ch341.ko 2023-07-27T14:04:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/cp210x.ko 2023-07-27T14:04:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/cyberjack.ko 2023-07-27T14:04:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-27T14:04:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-27T14:04:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/empeg.ko 2023-07-27T14:04:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-27T14:04:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-27T14:04:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-27T14:04:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/io_ti.ko 2023-07-27T14:04:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ipaq.ko 2023-07-27T14:04:42.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ipw.ko 2023-07-27T14:04:42.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ir-usb.ko 2023-07-27T14:04:42.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-27T14:04:42.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/keyspan.ko 2023-07-27T14:04:42.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-27T14:04:42.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-27T14:04:42.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-27T14:04:42.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/mct_u232.ko 2023-07-27T14:04:42.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/mos7720.ko 2023-07-27T14:04:42.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/mos7840.ko 2023-07-27T14:04:42.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/navman.ko 2023-07-27T14:04:42.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/omninet.ko 2023-07-27T14:04:42.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/opticon.ko 2023-07-27T14:04:42.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/option.ko 2023-07-27T14:04:42.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/oti6858.ko 2023-07-27T14:04:42.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/pl2303.ko 2023-07-27T14:04:42.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/qcaux.ko 2023-07-27T14:04:42.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/qcserial.ko 2023-07-27T14:04:42.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/quatech2.ko 2023-07-27T14:04:42.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/safe_serial.ko 2023-07-27T14:04:42.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/sierra.ko 2023-07-27T14:04:42.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-27T14:04:42.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ssu100.ko 2023-07-27T14:04:42.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/symbolserial.ko 2023-07-27T14:04:42.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-27T14:04:42.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-27T14:04:42.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/usb_debug.ko 2023-07-27T14:04:42.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-27T14:04:42.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/visor.ko 2023-07-27T14:04:42.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/whiteheat.ko 2023-07-27T14:04:42.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-27T14:04:42.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage 2023-07-27T14:04:42.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/uas.ko 2023-07-27T14:04:42.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-27T14:04:42.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-27T14:04:42.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-27T14:04:42.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-27T14:04:42.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-27T14:04:42.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-27T14:04:42.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-27T14:04:42.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-karma.ko 2023-07-27T14:04:42.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-27T14:04:42.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-27T14:04:42.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-27T14:04:42.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-27T14:04:42.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-27T14:04:42.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/usb-storage.ko 2023-07-27T14:04:42.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/usbip 2023-07-27T14:04:42.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-27T14:04:42.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-27T14:04:42.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-27T14:04:42.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio 2023-07-27T14:04:42.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/pci 2023-07-27T14:04:42.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-27T14:04:42.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-27T14:04:42.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/vfio.ko 2023-07-27T14:04:42.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-27T14:04:42.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost 2023-07-27T14:04:42.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost/vhost.ko 2023-07-27T14:04:42.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-27T14:04:42.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost/vhost_net.ko 2023-07-27T14:04:42.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost/vhost_scsi.ko 2023-07-27T14:04:42.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video 2023-07-27T14:04:42.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video/backlight 2023-07-27T14:04:42.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video/backlight/apple_bl.ko 2023-07-27T14:04:42.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video/backlight/lcd.ko 2023-07-27T14:04:42.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-27T14:04:42.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio 2023-07-27T14:04:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio.ko 2023-07-27T14:04:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_balloon.ko 2023-07-27T14:04:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_mmio.ko 2023-07-27T14:04:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_pci.ko 2023-07-27T14:04:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-27T14:04:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-27T14:04:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_ring.ko 2023-07-27T14:04:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1 2023-07-27T14:04:42.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/masters 2023-07-27T14:04:42.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/masters/ds2482.ko 2023-07-27T14:04:42.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/masters/ds2490.ko 2023-07-27T14:04:42.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves 2023-07-27T14:04:42.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-27T14:04:42.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-27T14:04:42.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-27T14:04:42.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-27T14:04:42.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-27T14:04:42.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-27T14:04:42.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-27T14:04:42.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-27T14:04:42.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-27T14:04:42.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-27T14:04:42.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-27T14:04:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/wire.ko 2023-07-27T14:04:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog 2023-07-27T14:04:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-27T14:04:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-27T14:04:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-27T14:04:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/hpwdt.ko 2023-07-27T14:04:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/i6300esb.ko 2023-07-27T14:04:42.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-27T14:04:42.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-27T14:04:42.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/ib700wdt.ko 2023-07-27T14:04:42.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/ibmasr.ko 2023-07-27T14:04:42.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-27T14:04:42.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-27T14:04:42.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/it87_wdt.ko 2023-07-27T14:04:42.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/machzwd.ko 2023-07-27T14:04:42.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/nv_tco.ko 2023-07-27T14:04:42.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-27T14:04:42.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-27T14:04:42.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-27T14:04:42.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-27T14:04:42.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/softdog.ko 2023-07-27T14:04:42.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-27T14:04:42.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/via_wdt.ko 2023-07-27T14:04:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-27T14:04:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-27T14:04:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-27T14:04:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/wdt_pci.ko 2023-07-27T14:04:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/xen_wdt.ko 2023-07-27T14:04:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen 2023-07-27T14:04:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-27T14:04:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-evtchn.ko 2023-07-27T14:04:42.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-gntalloc.ko 2023-07-27T14:04:42.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-gntdev.ko 2023-07-27T14:04:42.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-pciback 2023-07-27T14:04:42.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-27T14:04:42.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-privcmd.ko 2023-07-27T14:04:42.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xenfs 2023-07-27T14:04:42.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-27T14:04:42.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs 2023-07-27T14:04:42.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/9p 2023-07-27T14:04:42.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/9p/9p.ko 2023-07-27T14:04:42.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/affs 2023-07-27T14:04:42.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/affs/affs.ko 2023-07-27T14:04:42.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/befs 2023-07-27T14:04:42.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/befs/befs.ko 2023-07-27T14:04:42.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/binfmt_misc.ko 2023-07-27T14:04:42.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/btrfs 2023-07-27T14:04:42.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/btrfs/btrfs.ko 2023-07-27T14:04:42.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/cachefiles 2023-07-27T14:04:42.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/cachefiles/cachefiles.ko 2023-07-27T14:04:42.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ceph 2023-07-27T14:04:42.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ceph/ceph.ko 2023-07-27T14:04:42.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/coda 2023-07-27T14:04:42.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/coda/coda.ko 2023-07-27T14:04:42.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/cramfs 2023-07-27T14:04:42.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/cramfs/cramfs.ko 2023-07-27T14:04:42.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/dlm 2023-07-27T14:04:42.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/dlm/dlm.ko 2023-07-27T14:04:42.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ecryptfs 2023-07-27T14:04:42.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-27T14:04:42.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/f2fs 2023-07-27T14:04:42.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/f2fs/f2fs.ko 2023-07-27T14:04:42.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fat 2023-07-27T14:04:42.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fat/fat.ko 2023-07-27T14:04:42.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fat/msdos.ko 2023-07-27T14:04:42.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fat/vfat.ko 2023-07-27T14:04:42.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fscache 2023-07-27T14:04:42.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fscache/fscache.ko 2023-07-27T14:04:42.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fuse 2023-07-27T14:04:42.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fuse/cuse.ko 2023-07-27T14:04:42.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fuse/fuse.ko 2023-07-27T14:04:42.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/gfs2 2023-07-27T14:04:42.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/gfs2/gfs2.ko 2023-07-27T14:04:42.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/hfs 2023-07-27T14:04:42.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/hfs/hfs.ko 2023-07-27T14:04:42.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/hfsplus 2023-07-27T14:04:42.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/hfsplus/hfsplus.ko 2023-07-27T14:04:42.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/isofs 2023-07-27T14:04:42.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/isofs/isofs.ko 2023-07-27T14:04:42.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/jfs 2023-07-27T14:04:42.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/jfs/jfs.ko 2023-07-27T14:04:42.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/lockd 2023-07-27T14:04:42.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/lockd/lockd.ko 2023-07-27T14:04:42.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/minix 2023-07-27T14:04:42.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/minix/minix.ko 2023-07-27T14:04:42.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/netfs 2023-07-27T14:04:42.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/netfs/netfs.ko 2023-07-27T14:04:42.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs 2023-07-27T14:04:42.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/blocklayout 2023-07-27T14:04:42.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-27T14:04:42.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/filelayout 2023-07-27T14:04:42.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-27T14:04:42.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/flexfilelayout 2023-07-27T14:04:42.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-27T14:04:42.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/nfs.ko 2023-07-27T14:04:42.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/nfsv3.ko 2023-07-27T14:04:42.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/nfsv4.ko 2023-07-27T14:04:42.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs_common 2023-07-27T14:04:42.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs_common/grace.ko 2023-07-27T14:04:42.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs_common/nfs_acl.ko 2023-07-27T14:04:42.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfsd 2023-07-27T14:04:42.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfsd/nfsd.ko 2023-07-27T14:04:42.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nilfs2 2023-07-27T14:04:42.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nilfs2/nilfs2.ko 2023-07-27T14:04:42.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls 2023-07-27T14:04:42.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-celtic.ko 2023-07-27T14:04:42.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-centeuro.ko 2023-07-27T14:04:42.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-croatian.ko 2023-07-27T14:04:42.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-cyrillic.ko 2023-07-27T14:04:42.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-gaelic.ko 2023-07-27T14:04:42.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-greek.ko 2023-07-27T14:04:42.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-iceland.ko 2023-07-27T14:04:42.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-inuit.ko 2023-07-27T14:04:42.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-roman.ko 2023-07-27T14:04:42.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-romanian.ko 2023-07-27T14:04:42.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-turkish.ko 2023-07-27T14:04:42.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp1250.ko 2023-07-27T14:04:42.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp1251.ko 2023-07-27T14:04:42.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp1255.ko 2023-07-27T14:04:42.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp737.ko 2023-07-27T14:04:42.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp775.ko 2023-07-27T14:04:42.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp850.ko 2023-07-27T14:04:42.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp852.ko 2023-07-27T14:04:42.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp855.ko 2023-07-27T14:04:42.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp857.ko 2023-07-27T14:04:42.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp860.ko 2023-07-27T14:04:42.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp861.ko 2023-07-27T14:04:42.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp862.ko 2023-07-27T14:04:42.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp863.ko 2023-07-27T14:04:42.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp864.ko 2023-07-27T14:04:42.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp865.ko 2023-07-27T14:04:42.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp866.ko 2023-07-27T14:04:42.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp869.ko 2023-07-27T14:04:42.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp874.ko 2023-07-27T14:04:42.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp932.ko 2023-07-27T14:04:42.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp936.ko 2023-07-27T14:04:42.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp949.ko 2023-07-27T14:04:42.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp950.ko 2023-07-27T14:04:42.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_euc-jp.ko 2023-07-27T14:04:42.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-1.ko 2023-07-27T14:04:42.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-13.ko 2023-07-27T14:04:42.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-14.ko 2023-07-27T14:04:42.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-15.ko 2023-07-27T14:04:42.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-2.ko 2023-07-27T14:04:42.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-3.ko 2023-07-27T14:04:42.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-4.ko 2023-07-27T14:04:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-5.ko 2023-07-27T14:04:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-6.ko 2023-07-27T14:04:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-7.ko 2023-07-27T14:04:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-9.ko 2023-07-27T14:04:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_koi8-r.ko 2023-07-27T14:04:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_koi8-ru.ko 2023-07-27T14:04:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_koi8-u.ko 2023-07-27T14:04:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_utf8.ko 2023-07-27T14:04:42.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2 2023-07-27T14:04:42.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/cluster 2023-07-27T14:04:42.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-27T14:04:42.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/dlm 2023-07-27T14:04:42.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-27T14:04:42.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/dlmfs 2023-07-27T14:04:42.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-27T14:04:42.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/ocfs2.ko 2023-07-27T14:04:42.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-27T14:04:42.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-27T14:04:42.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-27T14:04:42.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/overlayfs 2023-07-27T14:04:42.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/overlayfs/overlay.ko 2023-07-27T14:04:42.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/pstore 2023-07-27T14:04:42.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/pstore/ramoops.ko 2023-07-27T14:04:42.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/reiserfs 2023-07-27T14:04:42.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/reiserfs/reiserfs.ko 2023-07-27T14:04:42.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/romfs 2023-07-27T14:04:42.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/romfs/romfs.ko 2023-07-27T14:04:42.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb 2023-07-27T14:04:42.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/client 2023-07-27T14:04:42.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/client/cifs.ko 2023-07-27T14:04:42.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/common 2023-07-27T14:04:42.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/common/cifs_arc4.ko 2023-07-27T14:04:42.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/common/cifs_md4.ko 2023-07-27T14:04:42.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/squashfs 2023-07-27T14:04:42.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/squashfs/squashfs.ko 2023-07-27T14:04:42.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/sysv 2023-07-27T14:04:42.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/sysv/sysv.ko 2023-07-27T14:04:42.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/udf 2023-07-27T14:04:42.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/udf/udf.ko 2023-07-27T14:04:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ufs 2023-07-27T14:04:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ufs/ufs.ko 2023-07-27T14:04:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/xfs 2023-07-27T14:04:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/xfs/xfs.ko 2023-07-27T14:04:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel 2023-07-27T14:04:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/rcu 2023-07-27T14:04:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/rcu/rcutorture.ko 2023-07-27T14:04:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/torture.ko 2023-07-27T14:04:42.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/trace 2023-07-27T14:04:42.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-27T14:04:42.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib 2023-07-27T14:04:42.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/asn1_encoder.ko 2023-07-27T14:04:42.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crc-itu-t.ko 2023-07-27T14:04:42.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crc8.ko 2023-07-27T14:04:42.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crypto 2023-07-27T14:04:42.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crypto/libarc4.ko 2023-07-27T14:04:42.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crypto/libdes.ko 2023-07-27T14:04:42.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/libcrc32c.ko 2023-07-27T14:04:42.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/lru_cache.ko 2023-07-27T14:04:42.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/lz4 2023-07-27T14:04:42.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/lz4/lz4_compress.ko 2023-07-27T14:04:42.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/lz4/lz4hc_compress.ko 2023-07-27T14:04:42.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/math 2023-07-27T14:04:42.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/math/cordic.ko 2023-07-27T14:04:42.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/raid6 2023-07-27T14:04:42.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/raid6/raid6_pq.ko 2023-07-27T14:04:42.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/reed_solomon 2023-07-27T14:04:42.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-27T14:04:42.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/ts_bm.ko 2023-07-27T14:04:42.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/ts_fsm.ko 2023-07-27T14:04:42.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/ts_kmp.ko 2023-07-27T14:04:42.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/zstd 2023-07-27T14:04:42.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/zstd/zstd_compress.ko 2023-07-27T14:04:42.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/mm 2023-07-27T14:04:42.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/mm/hwpoison-inject.ko 2023-07-27T14:04:42.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net 2023-07-27T14:04:42.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan 2023-07-27T14:04:42.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/6lowpan.ko 2023-07-27T14:04:42.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_dest.ko 2023-07-27T14:04:42.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_fragment.ko 2023-07-27T14:04:42.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_hop.ko 2023-07-27T14:04:42.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-27T14:04:42.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_mobility.ko 2023-07-27T14:04:42.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_routing.ko 2023-07-27T14:04:42.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_udp.ko 2023-07-27T14:04:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802 2023-07-27T14:04:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/garp.ko 2023-07-27T14:04:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/mrp.ko 2023-07-27T14:04:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/p8022.ko 2023-07-27T14:04:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/psnap.ko 2023-07-27T14:04:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/stp.ko 2023-07-27T14:04:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/8021q 2023-07-27T14:04:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/8021q/8021q.ko 2023-07-27T14:04:42.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p 2023-07-27T14:04:42.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p/9pnet.ko 2023-07-27T14:04:42.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p/9pnet_fd.ko 2023-07-27T14:04:42.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p/9pnet_rdma.ko 2023-07-27T14:04:42.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p/9pnet_virtio.ko 2023-07-27T14:04:42.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/batman-adv 2023-07-27T14:04:42.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/batman-adv/batman-adv.ko 2023-07-27T14:04:42.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge 2023-07-27T14:04:42.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/br_netfilter.ko 2023-07-27T14:04:42.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/bridge.ko 2023-07-27T14:04:42.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter 2023-07-27T14:04:42.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-27T14:04:42.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-27T14:04:42.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-27T14:04:42.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-27T14:04:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-27T14:04:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-27T14:04:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-27T14:04:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-27T14:04:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-27T14:04:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-27T14:04:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-27T14:04:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-27T14:04:42.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-27T14:04:42.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-27T14:04:42.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-27T14:04:42.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-27T14:04:42.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-27T14:04:42.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-27T14:04:42.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-27T14:04:42.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-27T14:04:42.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebtables.ko 2023-07-27T14:04:42.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-27T14:04:42.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-27T14:04:42.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-27T14:04:42.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ceph 2023-07-27T14:04:42.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ceph/libceph.ko 2023-07-27T14:04:42.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/core 2023-07-27T14:04:42.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/core/failover.ko 2023-07-27T14:04:42.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/core/pktgen.ko 2023-07-27T14:04:42.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp 2023-07-27T14:04:42.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp/dccp.ko 2023-07-27T14:04:42.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp/dccp_diag.ko 2023-07-27T14:04:42.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp/dccp_ipv4.ko 2023-07-27T14:04:42.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp/dccp_ipv6.ko 2023-07-27T14:04:42.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dns_resolver 2023-07-27T14:04:42.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dns_resolver/dns_resolver.ko 2023-07-27T14:04:42.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa 2023-07-27T14:04:42.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/dsa_core.ko 2023-07-27T14:04:42.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/tag_brcm.ko 2023-07-27T14:04:42.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/tag_dsa.ko 2023-07-27T14:04:42.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/tag_none.ko 2023-07-27T14:04:42.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/tag_trailer.ko 2023-07-27T14:04:42.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154 2023-07-27T14:04:42.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154/6lowpan 2023-07-27T14:04:42.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-27T14:04:42.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154/ieee802154.ko 2023-07-27T14:04:42.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-27T14:04:42.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4 2023-07-27T14:04:42.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ah4.ko 2023-07-27T14:04:42.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/esp4.ko 2023-07-27T14:04:42.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/fou.ko 2023-07-27T14:04:42.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/gre.ko 2023-07-27T14:04:42.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/inet_diag.ko 2023-07-27T14:04:42.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ip_gre.ko 2023-07-27T14:04:42.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ip_tunnel.ko 2023-07-27T14:04:42.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ip_vti.ko 2023-07-27T14:04:42.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ipcomp.ko 2023-07-27T14:04:42.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ipip.ko 2023-07-27T14:04:42.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter 2023-07-27T14:04:42.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-27T14:04:42.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-27T14:04:42.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-27T14:04:42.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-27T14:04:42.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-27T14:04:42.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-27T14:04:42.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-27T14:04:42.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-27T14:04:42.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-27T14:04:42.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-27T14:04:42.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-27T14:04:42.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-27T14:04:42.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-27T14:04:42.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-27T14:04:42.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-27T14:04:42.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-27T14:04:42.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-27T14:04:42.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-27T14:04:42.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-27T14:04:42.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-27T14:04:42.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-27T14:04:42.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_bic.ko 2023-07-27T14:04:42.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_dctcp.ko 2023-07-27T14:04:42.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_diag.ko 2023-07-27T14:04:42.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_highspeed.ko 2023-07-27T14:04:42.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_htcp.ko 2023-07-27T14:04:42.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_hybla.ko 2023-07-27T14:04:42.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_illinois.ko 2023-07-27T14:04:42.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_lp.ko 2023-07-27T14:04:42.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_scalable.ko 2023-07-27T14:04:42.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_vegas.ko 2023-07-27T14:04:42.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_veno.ko 2023-07-27T14:04:42.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_westwood.ko 2023-07-27T14:04:42.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_yeah.ko 2023-07-27T14:04:42.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tunnel4.ko 2023-07-27T14:04:42.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/udp_diag.ko 2023-07-27T14:04:42.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/udp_tunnel.ko 2023-07-27T14:04:42.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-27T14:04:42.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6 2023-07-27T14:04:42.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ah6.ko 2023-07-27T14:04:42.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/esp6.ko 2023-07-27T14:04:42.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/fou6.ko 2023-07-27T14:04:42.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ip6_tunnel.ko 2023-07-27T14:04:42.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-27T14:04:42.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ip6_vti.ko 2023-07-27T14:04:42.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ipcomp6.ko 2023-07-27T14:04:42.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter 2023-07-27T14:04:42.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-27T14:04:42.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-27T14:04:42.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-27T14:04:42.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-27T14:04:42.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-27T14:04:42.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-27T14:04:42.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-27T14:04:42.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-27T14:04:42.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-27T14:04:42.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-27T14:04:42.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-27T14:04:42.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-27T14:04:42.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-27T14:04:42.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-27T14:04:42.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-27T14:04:42.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-27T14:04:42.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-27T14:04:42.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-27T14:04:42.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-27T14:04:42.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-27T14:04:42.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-27T14:04:42.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-27T14:04:42.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-27T14:04:42.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-27T14:04:42.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/sit.ko 2023-07-27T14:04:42.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/tunnel6.ko 2023-07-27T14:04:42.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-27T14:04:42.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/key 2023-07-27T14:04:42.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/key/af_key.ko 2023-07-27T14:04:42.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp 2023-07-27T14:04:42.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_core.ko 2023-07-27T14:04:42.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-27T14:04:42.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_eth.ko 2023-07-27T14:04:42.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_ip.ko 2023-07-27T14:04:42.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_ip6.ko 2023-07-27T14:04:42.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_netlink.ko 2023-07-27T14:04:42.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_ppp.ko 2023-07-27T14:04:42.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/llc 2023-07-27T14:04:42.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/llc/llc.ko 2023-07-27T14:04:42.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/mac802154 2023-07-27T14:04:42.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/mac802154/mac802154.ko 2023-07-27T14:04:42.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/mpls 2023-07-27T14:04:42.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/mpls/mpls_gso.ko 2023-07-27T14:04:42.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter 2023-07-27T14:04:42.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset 2023-07-27T14:04:42.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set.ko 2023-07-27T14:04:42.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-27T14:04:42.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-27T14:04:42.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-27T14:04:42.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-27T14:04:42.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-27T14:04:42.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-27T14:04:42.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-27T14:04:42.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-27T14:04:42.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-27T14:04:42.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-27T14:04:42.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-27T14:04:42.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-27T14:04:42.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-27T14:04:42.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-27T14:04:42.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-27T14:04:42.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs 2023-07-27T14:04:42.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-27T14:04:42.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-27T14:04:42.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-27T14:04:42.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-27T14:04:42.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-27T14:04:42.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-27T14:04:42.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-27T14:04:42.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-27T14:04:42.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-27T14:04:42.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-27T14:04:42.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-27T14:04:42.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-27T14:04:42.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-27T14:04:42.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-27T14:04:42.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conncount.ko 2023-07-27T14:04:42.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack.ko 2023-07-27T14:04:42.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-27T14:04:42.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-27T14:04:42.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-27T14:04:42.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-27T14:04:42.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-27T14:04:42.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-27T14:04:42.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-27T14:04:42.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-27T14:04:42.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-27T14:04:42.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-27T14:04:42.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-27T14:04:42.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-27T14:04:42.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-27T14:04:42.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_flow_table.ko 2023-07-27T14:04:42.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-27T14:04:42.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_log_syslog.ko 2023-07-27T14:04:42.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat.ko 2023-07-27T14:04:42.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-27T14:04:42.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-27T14:04:42.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_irc.ko 2023-07-27T14:04:42.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_sip.ko 2023-07-27T14:04:42.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-27T14:04:42.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-27T14:04:42.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_tables.ko 2023-07-27T14:04:42.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink.ko 2023-07-27T14:04:42.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-27T14:04:42.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink_log.ko 2023-07-27T14:04:42.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-27T14:04:42.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-27T14:04:42.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_chain_nat.ko 2023-07-27T14:04:42.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_compat.ko 2023-07-27T14:04:42.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_ct.ko 2023-07-27T14:04:42.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-27T14:04:42.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_fib.ko 2023-07-27T14:04:42.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-27T14:04:42.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_hash.ko 2023-07-27T14:04:42.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_limit.ko 2023-07-27T14:04:42.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_log.ko 2023-07-27T14:04:42.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_masq.ko 2023-07-27T14:04:42.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_nat.ko 2023-07-27T14:04:42.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_numgen.ko 2023-07-27T14:04:42.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_queue.ko 2023-07-27T14:04:42.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_quota.ko 2023-07-27T14:04:42.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_redir.ko 2023-07-27T14:04:42.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_reject.ko 2023-07-27T14:04:42.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_reject_inet.ko 2023-07-27T14:04:42.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_socket.ko 2023-07-27T14:04:42.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_tunnel.ko 2023-07-27T14:04:42.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_AUDIT.ko 2023-07-27T14:04:42.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-27T14:04:42.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-27T14:04:42.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-27T14:04:42.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_CT.ko 2023-07-27T14:04:42.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_DSCP.ko 2023-07-27T14:04:42.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_HL.ko 2023-07-27T14:04:42.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_HMARK.ko 2023-07-27T14:04:42.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-27T14:04:42.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_LED.ko 2023-07-27T14:04:42.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_LOG.ko 2023-07-27T14:04:42.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-27T14:04:42.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_NETMAP.ko 2023-07-27T14:04:42.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_NFLOG.ko 2023-07-27T14:04:42.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-27T14:04:42.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_RATEEST.ko 2023-07-27T14:04:42.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-27T14:04:42.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_SECMARK.ko 2023-07-27T14:04:42.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-27T14:04:42.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-27T14:04:42.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TEE.ko 2023-07-27T14:04:42.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TPROXY.ko 2023-07-27T14:04:42.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TRACE.ko 2023-07-27T14:04:42.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_addrtype.ko 2023-07-27T14:04:42.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_bpf.ko 2023-07-27T14:04:42.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_cgroup.ko 2023-07-27T14:04:42.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_cluster.ko 2023-07-27T14:04:42.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_comment.ko 2023-07-27T14:04:42.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_connbytes.ko 2023-07-27T14:04:42.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_connlabel.ko 2023-07-27T14:04:42.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_connlimit.ko 2023-07-27T14:04:42.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_connmark.ko 2023-07-27T14:04:42.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_conntrack.ko 2023-07-27T14:04:42.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_cpu.ko 2023-07-27T14:04:42.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_dccp.ko 2023-07-27T14:04:42.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_devgroup.ko 2023-07-27T14:04:42.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_dscp.ko 2023-07-27T14:04:42.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_ecn.ko 2023-07-27T14:04:42.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_esp.ko 2023-07-27T14:04:42.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_hashlimit.ko 2023-07-27T14:04:42.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_helper.ko 2023-07-27T14:04:42.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_hl.ko 2023-07-27T14:04:42.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_ipcomp.ko 2023-07-27T14:04:42.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_iprange.ko 2023-07-27T14:04:42.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_ipvs.ko 2023-07-27T14:04:42.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_l2tp.ko 2023-07-27T14:04:42.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_length.ko 2023-07-27T14:04:42.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_limit.ko 2023-07-27T14:04:42.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_mac.ko 2023-07-27T14:04:42.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_mark.ko 2023-07-27T14:04:42.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_multiport.ko 2023-07-27T14:04:42.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_nat.ko 2023-07-27T14:04:42.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_nfacct.ko 2023-07-27T14:04:42.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_osf.ko 2023-07-27T14:04:42.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_owner.ko 2023-07-27T14:04:42.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_physdev.ko 2023-07-27T14:04:42.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_pkttype.ko 2023-07-27T14:04:42.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_policy.ko 2023-07-27T14:04:42.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_quota.ko 2023-07-27T14:04:42.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_rateest.ko 2023-07-27T14:04:42.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_realm.ko 2023-07-27T14:04:42.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_recent.ko 2023-07-27T14:04:42.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_sctp.ko 2023-07-27T14:04:42.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_set.ko 2023-07-27T14:04:42.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_socket.ko 2023-07-27T14:04:42.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_state.ko 2023-07-27T14:04:42.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_statistic.ko 2023-07-27T14:04:42.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_string.ko 2023-07-27T14:04:42.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_tcpmss.ko 2023-07-27T14:04:42.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_time.ko 2023-07-27T14:04:42.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_u32.ko 2023-07-27T14:04:42.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netlink 2023-07-27T14:04:42.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netlink/netlink_diag.ko 2023-07-27T14:04:42.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/nsh 2023-07-27T14:04:42.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/nsh/nsh.ko 2023-07-27T14:04:42.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch 2023-07-27T14:04:42.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch/openvswitch.ko 2023-07-27T14:04:42.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch/vport-geneve.ko 2023-07-27T14:04:42.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch/vport-gre.ko 2023-07-27T14:04:42.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch/vport-vxlan.ko 2023-07-27T14:04:42.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/packet 2023-07-27T14:04:42.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/packet/af_packet_diag.ko 2023-07-27T14:04:42.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/rds 2023-07-27T14:04:42.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/rds/rds.ko 2023-07-27T14:04:42.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/rds/rds_rdma.ko 2023-07-27T14:04:42.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/rds/rds_tcp.ko 2023-07-27T14:04:42.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched 2023-07-27T14:04:42.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_csum.ko 2023-07-27T14:04:42.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_gact.ko 2023-07-27T14:04:42.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_ipt.ko 2023-07-27T14:04:42.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_mirred.ko 2023-07-27T14:04:42.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_nat.ko 2023-07-27T14:04:42.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_pedit.ko 2023-07-27T14:04:42.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_police.ko 2023-07-27T14:04:42.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_simple.ko 2023-07-27T14:04:42.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_skbedit.ko 2023-07-27T14:04:42.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_vlan.ko 2023-07-27T14:04:42.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_basic.ko 2023-07-27T14:04:42.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_bpf.ko 2023-07-27T14:04:42.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_flow.ko 2023-07-27T14:04:42.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_fw.ko 2023-07-27T14:04:42.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_route.ko 2023-07-27T14:04:42.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_u32.ko 2023-07-27T14:04:42.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_cmp.ko 2023-07-27T14:04:42.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_ipset.ko 2023-07-27T14:04:42.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_meta.ko 2023-07-27T14:04:42.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_nbyte.ko 2023-07-27T14:04:42.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_text.ko 2023-07-27T14:04:42.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_u32.ko 2023-07-27T14:04:42.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_choke.ko 2023-07-27T14:04:42.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_codel.ko 2023-07-27T14:04:42.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_drr.ko 2023-07-27T14:04:42.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_fq.ko 2023-07-27T14:04:42.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_gred.ko 2023-07-27T14:04:42.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_hfsc.ko 2023-07-27T14:04:42.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_hhf.ko 2023-07-27T14:04:42.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_htb.ko 2023-07-27T14:04:42.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_ingress.ko 2023-07-27T14:04:42.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_mqprio.ko 2023-07-27T14:04:42.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_mqprio_lib.ko 2023-07-27T14:04:42.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_multiq.ko 2023-07-27T14:04:42.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_netem.ko 2023-07-27T14:04:42.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_pie.ko 2023-07-27T14:04:42.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_plug.ko 2023-07-27T14:04:42.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_prio.ko 2023-07-27T14:04:42.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_qfq.ko 2023-07-27T14:04:42.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_red.ko 2023-07-27T14:04:42.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_sfb.ko 2023-07-27T14:04:42.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_sfq.ko 2023-07-27T14:04:42.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_tbf.ko 2023-07-27T14:04:42.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_teql.ko 2023-07-27T14:04:42.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sctp 2023-07-27T14:04:42.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sctp/sctp.ko 2023-07-27T14:04:42.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sctp/sctp_diag.ko 2023-07-27T14:04:42.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc 2023-07-27T14:04:42.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/auth_gss 2023-07-27T14:04:42.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-27T14:04:42.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-27T14:04:42.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/sunrpc.ko 2023-07-27T14:04:42.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/xprtrdma 2023-07-27T14:04:42.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-27T14:04:42.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/tipc 2023-07-27T14:04:42.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/tipc/diag.ko 2023-07-27T14:04:42.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/tipc/tipc.ko 2023-07-27T14:04:42.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/unix 2023-07-27T14:04:42.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/unix/unix_diag.ko 2023-07-27T14:04:42.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock 2023-07-27T14:04:42.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-27T14:04:42.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-27T14:04:42.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vsock.ko 2023-07-27T14:04:42.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-27T14:04:42.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-27T14:04:42.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/xfrm 2023-07-27T14:04:42.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-27T14:04:42.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security 2023-07-27T14:04:42.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys 2023-07-27T14:04:42.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys/encrypted-keys 2023-07-27T14:04:42.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-27T14:04:42.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys/trusted-keys 2023-07-27T14:04:42.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys/trusted-keys/trusted.ko 2023-07-27T14:04:42.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/virt 2023-07-27T14:04:42.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/virt/lib 2023-07-27T14:04:42.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/virt/lib/irqbypass.ko 2023-07-27T14:04:42.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.alias 2023-07-27T14:04:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.alias.bin 2023-07-27T14:04:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.builtin 2023-07-27T14:04:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.builtin.bin 2023-07-27T14:04:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.builtin.modinfo 2023-07-27T14:04:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.dep 2023-07-27T14:04:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.dep.bin 2023-07-27T14:04:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.devname 2023-07-27T14:04:42.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.order 2023-07-27T14:04:42.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.softdep 2023-07-27T14:04:42.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.symbols 2023-07-27T14:04:42.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.symbols.bin 2023-07-27T14:04:42.993 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:42.994 DEBUG:teuthology.orchestra.run.smithi159:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-27T14:04:43.020 INFO:teuthology.orchestra.run.smithi159.stdout:postinstall scriptlet (using /bin/sh): 2023-07-27T14:04:43.020 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-g8e3722cc0164 -a -r /boot/System.map-6.5.0-rc1-g8e3722cc0164 ]; then 2023-07-27T14:04:43.020 INFO:teuthology.orchestra.run.smithi159.stdout:cp /boot/vmlinuz-6.5.0-rc1-g8e3722cc0164 /boot/.vmlinuz-6.5.0-rc1-g8e3722cc0164-rpm 2023-07-27T14:04:43.020 INFO:teuthology.orchestra.run.smithi159.stdout:cp /boot/System.map-6.5.0-rc1-g8e3722cc0164 /boot/.System.map-6.5.0-rc1-g8e3722cc0164-rpm 2023-07-27T14:04:43.021 INFO:teuthology.orchestra.run.smithi159.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-g8e3722cc0164 /boot/System.map-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:43.021 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/installkernel 6.5.0-rc1-g8e3722cc0164 /boot/.vmlinuz-6.5.0-rc1-g8e3722cc0164-rpm /boot/.System.map-6.5.0-rc1-g8e3722cc0164-rpm 2023-07-27T14:04:43.021 INFO:teuthology.orchestra.run.smithi159.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-g8e3722cc0164-rpm /boot/.System.map-6.5.0-rc1-g8e3722cc0164-rpm 2023-07-27T14:04:43.021 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-07-27T14:04:43.021 INFO:teuthology.orchestra.run.smithi159.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-27T14:04:43.021 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-27T14:04:43.021 INFO:teuthology.orchestra.run.smithi159.stdout:new-kernel-pkg --remove 6.5.0-rc1-g8e3722cc0164 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-g8e3722cc0164.img 2023-07-27T14:04:43.021 INFO:teuthology.orchestra.run.smithi159.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-27T14:04:43.022 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-install remove 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:43.022 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-07-27T14:04:43.022 INFO:teuthology.orchestra.run.smithi159.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-27T14:04:43.022 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-27T14:04:43.022 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:43.022 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-07-27T14:04:43.023 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2023-07-27T14:04:43.095 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2023-07-27T14:04:43.095 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2023-07-27T14:04:43.095 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.02 2023-07-27T14:04:43.096 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 129.el8 2023-07-27T14:04:43.096 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2023-07-27T14:04:43.096 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-27T14:04:43.096 INFO:teuthology.orchestra.run.smithi159.stdout:Group : System Environment/Base 2023-07-27T14:04:43.096 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 9265586 2023-07-27T14:04:43.096 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2023-07-27T14:04:43.096 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-27T14:04:43.097 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-27T14:04:43.097 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-27T14:04:43.097 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-27T14:04:43.097 INFO:teuthology.orchestra.run.smithi159.stdout:Relocations : (not relocatable) 2023-07-27T14:04:43.097 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : CentOS BuildSystem 2023-07-27T14:04:43.097 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2023-07-27T14:04:43.097 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-27T14:04:43.097 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2023-07-27T14:04:43.098 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2023-07-27T14:04:43.098 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:04:43.098 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-27T14:04:43.098 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-27T14:04:43.098 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-27T14:04:43.098 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2023-07-27T14:04:43.098 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:04:43.098 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2023-07-27T14:04:43.099 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-27T14:04:43.100 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:43.100 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-27T14:04:47.670 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2023-07-27T14:04:48.764 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-27T14:04:48.765 DEBUG:teuthology.orchestra.run.smithi115:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-27T14:04:48.812 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/System.map-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:48.812 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/config-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:48.812 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/vmlinuz-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:48.813 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:48.813 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel 2023-07-27T14:04:48.813 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch 2023-07-27T14:04:48.813 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86 2023-07-27T14:04:48.813 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto 2023-07-27T14:04:48.813 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-27T14:04:48.813 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-27T14:04:48.814 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-27T14:04:48.814 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-27T14:04:48.814 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-27T14:04:48.814 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-27T14:04:48.814 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-27T14:04:48.814 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-27T14:04:48.814 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-27T14:04:48.814 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-27T14:04:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-27T14:04:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-27T14:04:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-27T14:04:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-27T14:04:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-27T14:04:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-27T14:04:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-27T14:04:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-27T14:04:48.816 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-27T14:04:48.816 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-27T14:04:48.816 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kernel 2023-07-27T14:04:48.816 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kernel/cpu 2023-07-27T14:04:48.816 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kernel/cpu/mce 2023-07-27T14:04:48.816 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-27T14:04:48.816 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kvm 2023-07-27T14:04:48.816 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-27T14:04:48.817 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-27T14:04:48.817 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/arch/x86/kvm/kvm.ko 2023-07-27T14:04:48.817 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto 2023-07-27T14:04:48.817 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/ansi_cprng.ko 2023-07-27T14:04:48.817 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/anubis.ko 2023-07-27T14:04:48.817 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/arc4.ko 2023-07-27T14:04:48.817 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx 2023-07-27T14:04:48.817 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_memcpy.ko 2023-07-27T14:04:48.818 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_pq.ko 2023-07-27T14:04:48.818 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-27T14:04:48.818 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_tx.ko 2023-07-27T14:04:48.818 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/async_xor.ko 2023-07-27T14:04:48.818 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/async_tx/raid6test.ko 2023-07-27T14:04:48.818 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/authenc.ko 2023-07-27T14:04:48.818 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/authencesn.ko 2023-07-27T14:04:48.819 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/blake2b_generic.ko 2023-07-27T14:04:48.819 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/blowfish_common.ko 2023-07-27T14:04:48.819 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/blowfish_generic.ko 2023-07-27T14:04:48.819 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/camellia_generic.ko 2023-07-27T14:04:48.819 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cast5_generic.ko 2023-07-27T14:04:48.819 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cast6_generic.ko 2023-07-27T14:04:48.819 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cast_common.ko 2023-07-27T14:04:48.819 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/ccm.ko 2023-07-27T14:04:48.820 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cmac.ko 2023-07-27T14:04:48.820 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/crc32_generic.ko 2023-07-27T14:04:48.820 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/crypto_engine.ko 2023-07-27T14:04:48.820 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/crypto_user.ko 2023-07-27T14:04:48.820 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/cts.ko 2023-07-27T14:04:48.820 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/des_generic.ko 2023-07-27T14:04:48.820 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/dh_generic.ko 2023-07-27T14:04:48.820 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/echainiv.ko 2023-07-27T14:04:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/essiv.ko 2023-07-27T14:04:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/fcrypt.ko 2023-07-27T14:04:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/khazad.ko 2023-07-27T14:04:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/lz4.ko 2023-07-27T14:04:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/lz4hc.ko 2023-07-27T14:04:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/md4.ko 2023-07-27T14:04:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/michael_mic.ko 2023-07-27T14:04:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/pcbc.ko 2023-07-27T14:04:48.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/pcrypt.ko 2023-07-27T14:04:48.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/rmd160.ko 2023-07-27T14:04:48.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/seed.ko 2023-07-27T14:04:48.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/serpent_generic.ko 2023-07-27T14:04:48.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/tcrypt.ko 2023-07-27T14:04:48.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/tea.ko 2023-07-27T14:04:48.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/twofish_common.ko 2023-07-27T14:04:48.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/twofish_generic.ko 2023-07-27T14:04:48.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/vmac.ko 2023-07-27T14:04:48.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/wp512.ko 2023-07-27T14:04:48.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/xcbc.ko 2023-07-27T14:04:48.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/xor.ko 2023-07-27T14:04:48.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/crypto/xxhash_generic.ko 2023-07-27T14:04:48.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers 2023-07-27T14:04:48.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi 2023-07-27T14:04:48.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-27T14:04:48.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/acpi_pad.ko 2023-07-27T14:04:48.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/custom_method.ko 2023-07-27T14:04:48.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/ec_sys.ko 2023-07-27T14:04:48.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/platform_profile.ko 2023-07-27T14:04:48.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/sbs.ko 2023-07-27T14:04:48.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/sbshc.ko 2023-07-27T14:04:48.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/acpi/video.ko 2023-07-27T14:04:48.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata 2023-07-27T14:04:48.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/acard-ahci.ko 2023-07-27T14:04:48.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/ahci_platform.ko 2023-07-27T14:04:48.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/ata_generic.ko 2023-07-27T14:04:48.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/libahci_platform.ko 2023-07-27T14:04:48.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_acpi.ko 2023-07-27T14:04:48.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_ali.ko 2023-07-27T14:04:48.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_amd.ko 2023-07-27T14:04:48.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_artop.ko 2023-07-27T14:04:48.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_atiixp.ko 2023-07-27T14:04:48.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_atp867x.ko 2023-07-27T14:04:48.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_cmd640.ko 2023-07-27T14:04:48.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_cmd64x.ko 2023-07-27T14:04:48.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_cypress.ko 2023-07-27T14:04:48.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_efar.ko 2023-07-27T14:04:48.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_hpt366.ko 2023-07-27T14:04:48.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_hpt37x.ko 2023-07-27T14:04:48.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-27T14:04:48.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-27T14:04:48.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_it8213.ko 2023-07-27T14:04:48.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_it821x.ko 2023-07-27T14:04:48.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_jmicron.ko 2023-07-27T14:04:48.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_marvell.ko 2023-07-27T14:04:48.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_mpiix.ko 2023-07-27T14:04:48.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_netcell.ko 2023-07-27T14:04:48.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_ninja32.ko 2023-07-27T14:04:48.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_ns87410.ko 2023-07-27T14:04:48.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_ns87415.ko 2023-07-27T14:04:48.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_oldpiix.ko 2023-07-27T14:04:48.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_opti.ko 2023-07-27T14:04:48.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_optidma.ko 2023-07-27T14:04:48.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_pcmcia.ko 2023-07-27T14:04:48.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-27T14:04:48.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-27T14:04:48.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_piccolo.ko 2023-07-27T14:04:48.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_rdc.ko 2023-07-27T14:04:48.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_sch.ko 2023-07-27T14:04:48.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_serverworks.ko 2023-07-27T14:04:48.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_sil680.ko 2023-07-27T14:04:48.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_sis.ko 2023-07-27T14:04:48.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_sl82c105.ko 2023-07-27T14:04:48.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_triflex.ko 2023-07-27T14:04:48.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pata_via.ko 2023-07-27T14:04:48.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/pdc_adma.ko 2023-07-27T14:04:48.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_inic162x.ko 2023-07-27T14:04:48.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_mv.ko 2023-07-27T14:04:48.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_nv.ko 2023-07-27T14:04:48.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_promise.ko 2023-07-27T14:04:48.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_qstor.ko 2023-07-27T14:04:48.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_sil.ko 2023-07-27T14:04:48.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_sil24.ko 2023-07-27T14:04:48.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_sis.ko 2023-07-27T14:04:48.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_svw.ko 2023-07-27T14:04:48.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_sx4.ko 2023-07-27T14:04:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_uli.ko 2023-07-27T14:04:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_via.ko 2023-07-27T14:04:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ata/sata_vsc.ko 2023-07-27T14:04:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/auxdisplay 2023-07-27T14:04:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/auxdisplay/ks0108.ko 2023-07-27T14:04:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/base 2023-07-27T14:04:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/base/regmap 2023-07-27T14:04:48.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-27T14:04:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-27T14:04:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/bcma 2023-07-27T14:04:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/bcma/bcma.ko 2023-07-27T14:04:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block 2023-07-27T14:04:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/aoe 2023-07-27T14:04:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/aoe/aoe.ko 2023-07-27T14:04:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/brd.ko 2023-07-27T14:04:48.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/drbd 2023-07-27T14:04:48.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/drbd/drbd.ko 2023-07-27T14:04:48.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/floppy.ko 2023-07-27T14:04:48.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/loop.ko 2023-07-27T14:04:48.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/mtip32xx 2023-07-27T14:04:48.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-27T14:04:48.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/nbd.ko 2023-07-27T14:04:48.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/null_blk 2023-07-27T14:04:48.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/null_blk/null_blk.ko 2023-07-27T14:04:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/pktcdvd.ko 2023-07-27T14:04:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/rbd.ko 2023-07-27T14:04:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/virtio_blk.ko 2023-07-27T14:04:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/xen-blkback 2023-07-27T14:04:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-27T14:04:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/xen-blkfront.ko 2023-07-27T14:04:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/zram 2023-07-27T14:04:48.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/block/zram/zram.ko 2023-07-27T14:04:48.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char 2023-07-27T14:04:48.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hangcheck-timer.ko 2023-07-27T14:04:48.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random 2023-07-27T14:04:48.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-27T14:04:48.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-27T14:04:48.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-27T14:04:48.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/via-rng.ko 2023-07-27T14:04:48.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-27T14:04:48.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi 2023-07-27T14:04:48.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-27T14:04:48.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-27T14:04:48.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-27T14:04:48.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-27T14:04:48.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-27T14:04:48.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-27T14:04:48.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/lp.ko 2023-07-27T14:04:48.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/mwave 2023-07-27T14:04:48.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/mwave/mwave.ko 2023-07-27T14:04:48.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/ppdev.ko 2023-07-27T14:04:48.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tlclk.ko 2023-07-27T14:04:48.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm 2023-07-27T14:04:48.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm.ko 2023-07-27T14:04:48.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-27T14:04:48.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-27T14:04:48.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-27T14:04:48.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-27T14:04:48.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-27T14:04:48.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/uv_mmtimer.ko 2023-07-27T14:04:48.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/char/virtio_console.ko 2023-07-27T14:04:48.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq 2023-07-27T14:04:48.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-27T14:04:48.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-27T14:04:48.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-27T14:04:48.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-27T14:04:48.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-27T14:04:48.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-27T14:04:48.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto 2023-07-27T14:04:48.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/ccp 2023-07-27T14:04:48.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-27T14:04:48.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/ccp/ccp.ko 2023-07-27T14:04:48.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel 2023-07-27T14:04:48.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat 2023-07-27T14:04:48.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat/qat_common 2023-07-27T14:04:48.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-27T14:04:48.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-27T14:04:48.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-27T14:04:48.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/padlock-aes.ko 2023-07-27T14:04:48.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/padlock-sha.ko 2023-07-27T14:04:48.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/virtio 2023-07-27T14:04:48.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-27T14:04:48.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dca 2023-07-27T14:04:48.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dca/dca.ko 2023-07-27T14:04:48.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/devfreq 2023-07-27T14:04:48.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-27T14:04:48.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma 2023-07-27T14:04:48.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma/dw 2023-07-27T14:04:48.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-27T14:04:48.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma/ioat 2023-07-27T14:04:48.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-27T14:04:48.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac 2023-07-27T14:04:48.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/amd64_edac.ko 2023-07-27T14:04:48.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/e752x_edac.ko 2023-07-27T14:04:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/edac_mce_amd.ko 2023-07-27T14:04:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i3000_edac.ko 2023-07-27T14:04:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i3200_edac.ko 2023-07-27T14:04:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i5100_edac.ko 2023-07-27T14:04:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i5400_edac.ko 2023-07-27T14:04:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i7300_edac.ko 2023-07-27T14:04:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i7core_edac.ko 2023-07-27T14:04:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/i82975x_edac.ko 2023-07-27T14:04:48.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/ie31200_edac.ko 2023-07-27T14:04:48.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/sb_edac.ko 2023-07-27T14:04:48.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/edac/x38_edac.ko 2023-07-27T14:04:48.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/firmware 2023-07-27T14:04:48.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/firmware/edd.ko 2023-07-27T14:04:48.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-27T14:04:48.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/gpio 2023-07-27T14:04:48.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/gpio/gpio-ich.ko 2023-07-27T14:04:48.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-27T14:04:48.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid 2023-07-27T14:04:48.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-appleir.ko 2023-07-27T14:04:48.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-aureal.ko 2023-07-27T14:04:48.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-axff.ko 2023-07-27T14:04:48.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-dr.ko 2023-07-27T14:04:48.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-elecom.ko 2023-07-27T14:04:48.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-elo.ko 2023-07-27T14:04:48.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-emsff.ko 2023-07-27T14:04:48.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-gaff.ko 2023-07-27T14:04:48.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-gt683r.ko 2023-07-27T14:04:48.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-gyration.ko 2023-07-27T14:04:48.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-27T14:04:48.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-27T14:04:48.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-holtekff.ko 2023-07-27T14:04:48.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-hyperv.ko 2023-07-27T14:04:48.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-icade.ko 2023-07-27T14:04:48.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-keytouch.ko 2023-07-27T14:04:48.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-kye.ko 2023-07-27T14:04:48.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-lcpower.ko 2023-07-27T14:04:48.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-led.ko 2023-07-27T14:04:48.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-lenovo.ko 2023-07-27T14:04:48.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-27T14:04:48.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-27T14:04:48.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-multitouch.ko 2023-07-27T14:04:48.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-ortek.ko 2023-07-27T14:04:48.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-penmount.ko 2023-07-27T14:04:48.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-petalynx.ko 2023-07-27T14:04:48.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-picolcd.ko 2023-07-27T14:04:48.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-pl.ko 2023-07-27T14:04:48.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-plantronics.ko 2023-07-27T14:04:48.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-primax.ko 2023-07-27T14:04:48.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-rmi.ko 2023-07-27T14:04:48.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-27T14:04:48.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-common.ko 2023-07-27T14:04:48.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-27T14:04:48.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-27T14:04:48.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-27T14:04:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-27T14:04:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-27T14:04:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-27T14:04:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-27T14:04:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-27T14:04:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-27T14:04:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-roccat.ko 2023-07-27T14:04:48.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-saitek.ko 2023-07-27T14:04:48.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-samsung.ko 2023-07-27T14:04:48.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-27T14:04:48.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-sjoy.ko 2023-07-27T14:04:48.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-sony.ko 2023-07-27T14:04:48.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-speedlink.ko 2023-07-27T14:04:48.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-steelseries.ko 2023-07-27T14:04:48.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-sunplus.ko 2023-07-27T14:04:48.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-27T14:04:48.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-tivo.ko 2023-07-27T14:04:48.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-tmff.ko 2023-07-27T14:04:48.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-topseed.ko 2023-07-27T14:04:48.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-twinhan.ko 2023-07-27T14:04:48.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-uclogic.ko 2023-07-27T14:04:48.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-waltop.ko 2023-07-27T14:04:48.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-wiimote.ko 2023-07-27T14:04:48.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-xinmo.ko 2023-07-27T14:04:48.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-zpff.ko 2023-07-27T14:04:48.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/hid-zydacron.ko 2023-07-27T14:04:48.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/uhid.ko 2023-07-27T14:04:48.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hid/wacom.ko 2023-07-27T14:04:48.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hv 2023-07-27T14:04:48.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hv/hv_balloon.ko 2023-07-27T14:04:48.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hv/hv_utils.ko 2023-07-27T14:04:48.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hv/hv_vmbus.ko 2023-07-27T14:04:48.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon 2023-07-27T14:04:48.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/abituguru.ko 2023-07-27T14:04:48.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/abituguru3.ko 2023-07-27T14:04:48.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-27T14:04:48.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ad7414.ko 2023-07-27T14:04:48.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ad7418.ko 2023-07-27T14:04:48.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adc128d818.ko 2023-07-27T14:04:48.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm1025.ko 2023-07-27T14:04:48.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm1026.ko 2023-07-27T14:04:48.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm1029.ko 2023-07-27T14:04:48.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm1031.ko 2023-07-27T14:04:48.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adm9240.ko 2023-07-27T14:04:48.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ads7828.ko 2023-07-27T14:04:48.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7410.ko 2023-07-27T14:04:48.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7411.ko 2023-07-27T14:04:48.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7462.ko 2023-07-27T14:04:48.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7470.ko 2023-07-27T14:04:48.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7475.ko 2023-07-27T14:04:48.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/adt7x10.ko 2023-07-27T14:04:48.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/amc6821.ko 2023-07-27T14:04:48.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/applesmc.ko 2023-07-27T14:04:48.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/asb100.ko 2023-07-27T14:04:48.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/asc7621.ko 2023-07-27T14:04:48.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-27T14:04:48.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/atxp1.ko 2023-07-27T14:04:48.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/coretemp.ko 2023-07-27T14:04:48.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-27T14:04:48.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/dme1737.ko 2023-07-27T14:04:48.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ds1621.ko 2023-07-27T14:04:48.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ds620.ko 2023-07-27T14:04:48.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/emc1403.ko 2023-07-27T14:04:48.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/emc6w201.ko 2023-07-27T14:04:48.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/f71805f.ko 2023-07-27T14:04:48.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/f71882fg.ko 2023-07-27T14:04:48.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/f75375s.ko 2023-07-27T14:04:48.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/fam15h_power.ko 2023-07-27T14:04:48.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/fschmd.ko 2023-07-27T14:04:48.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/g760a.ko 2023-07-27T14:04:48.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/g762.ko 2023-07-27T14:04:48.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/gl518sm.ko 2023-07-27T14:04:48.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/gl520sm.ko 2023-07-27T14:04:48.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-27T14:04:48.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/i5500_temp.ko 2023-07-27T14:04:48.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/i5k_amb.ko 2023-07-27T14:04:48.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ibmaem.ko 2023-07-27T14:04:48.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ibmpex.ko 2023-07-27T14:04:48.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ina209.ko 2023-07-27T14:04:48.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ina2xx.ko 2023-07-27T14:04:48.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/it87.ko 2023-07-27T14:04:48.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/k10temp.ko 2023-07-27T14:04:48.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/k8temp.ko 2023-07-27T14:04:48.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lineage-pem.ko 2023-07-27T14:04:48.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm63.ko 2023-07-27T14:04:48.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm73.ko 2023-07-27T14:04:48.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm75.ko 2023-07-27T14:04:48.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm77.ko 2023-07-27T14:04:48.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm78.ko 2023-07-27T14:04:48.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm80.ko 2023-07-27T14:04:48.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm83.ko 2023-07-27T14:04:48.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm85.ko 2023-07-27T14:04:48.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm87.ko 2023-07-27T14:04:48.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm90.ko 2023-07-27T14:04:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm92.ko 2023-07-27T14:04:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm93.ko 2023-07-27T14:04:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm95234.ko 2023-07-27T14:04:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm95241.ko 2023-07-27T14:04:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/lm95245.ko 2023-07-27T14:04:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc2945.ko 2023-07-27T14:04:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4151.ko 2023-07-27T14:04:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4215.ko 2023-07-27T14:04:48.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4222.ko 2023-07-27T14:04:48.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4245.ko 2023-07-27T14:04:48.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4260.ko 2023-07-27T14:04:48.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/ltc4261.ko 2023-07-27T14:04:48.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max16065.ko 2023-07-27T14:04:48.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max1619.ko 2023-07-27T14:04:48.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max1668.ko 2023-07-27T14:04:48.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max197.ko 2023-07-27T14:04:48.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max6639.ko 2023-07-27T14:04:48.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max6650.ko 2023-07-27T14:04:48.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/max6697.ko 2023-07-27T14:04:48.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/mcp3021.ko 2023-07-27T14:04:48.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/nct6683.ko 2023-07-27T14:04:48.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/nct6775-core.ko 2023-07-27T14:04:48.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/nct6775.ko 2023-07-27T14:04:48.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/nct7802.ko 2023-07-27T14:04:48.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pc87360.ko 2023-07-27T14:04:48.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pc87427.ko 2023-07-27T14:04:48.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pcf8591.ko 2023-07-27T14:04:48.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus 2023-07-27T14:04:48.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-27T14:04:48.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-27T14:04:48.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-27T14:04:48.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-27T14:04:48.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-27T14:04:48.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-27T14:04:48.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-27T14:04:48.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-27T14:04:48.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-27T14:04:48.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-27T14:04:48.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-27T14:04:48.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-27T14:04:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/powr1220.ko 2023-07-27T14:04:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sch5627.ko 2023-07-27T14:04:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sch5636.ko 2023-07-27T14:04:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-27T14:04:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sht15.ko 2023-07-27T14:04:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sht21.ko 2023-07-27T14:04:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/shtc1.ko 2023-07-27T14:04:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/sis5595.ko 2023-07-27T14:04:48.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/smsc47b397.ko 2023-07-27T14:04:48.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/smsc47m1.ko 2023-07-27T14:04:48.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/smsc47m192.ko 2023-07-27T14:04:48.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/thmc50.ko 2023-07-27T14:04:48.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/tmp102.ko 2023-07-27T14:04:48.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/tmp103.ko 2023-07-27T14:04:48.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/tmp401.ko 2023-07-27T14:04:48.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/tmp421.ko 2023-07-27T14:04:48.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/via-cputemp.ko 2023-07-27T14:04:48.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/via686a.ko 2023-07-27T14:04:48.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/vt1211.ko 2023-07-27T14:04:48.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/vt8231.ko 2023-07-27T14:04:48.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83627ehf.ko 2023-07-27T14:04:48.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83627hf.ko 2023-07-27T14:04:48.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83781d.ko 2023-07-27T14:04:48.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83791d.ko 2023-07-27T14:04:48.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83792d.ko 2023-07-27T14:04:48.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83793.ko 2023-07-27T14:04:48.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83795.ko 2023-07-27T14:04:48.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83l785ts.ko 2023-07-27T14:04:48.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/hwmon/w83l786ng.ko 2023-07-27T14:04:48.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c 2023-07-27T14:04:48.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/algos 2023-07-27T14:04:48.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-27T14:04:48.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-27T14:04:48.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses 2023-07-27T14:04:48.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-27T14:04:48.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-27T14:04:48.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-27T14:04:48.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-27T14:04:48.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-27T14:04:48.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-27T14:04:48.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-27T14:04:48.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-27T14:04:48.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-27T14:04:48.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-27T14:04:48.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-27T14:04:48.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-27T14:04:48.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-27T14:04:48.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-27T14:04:48.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-27T14:04:48.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-27T14:04:48.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-27T14:04:48.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-27T14:04:48.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-27T14:04:48.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-27T14:04:48.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-27T14:04:48.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-27T14:04:48.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-27T14:04:48.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-dev.ko 2023-07-27T14:04:48.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-mux.ko 2023-07-27T14:04:48.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-27T14:04:48.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-smbus.ko 2023-07-27T14:04:48.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/i2c/i2c-stub.ko 2023-07-27T14:04:48.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband 2023-07-27T14:04:48.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core 2023-07-27T14:04:48.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-27T14:04:48.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/ib_core.ko 2023-07-27T14:04:48.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-27T14:04:48.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-27T14:04:48.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-27T14:04:48.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-27T14:04:48.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-27T14:04:48.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw 2023-07-27T14:04:48.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/cxgb4 2023-07-27T14:04:48.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-27T14:04:48.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mlx4 2023-07-27T14:04:48.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-27T14:04:48.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mlx5 2023-07-27T14:04:48.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-27T14:04:48.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mthca 2023-07-27T14:04:48.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-27T14:04:48.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp 2023-07-27T14:04:48.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/ipoib 2023-07-27T14:04:48.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-27T14:04:48.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/iser 2023-07-27T14:04:48.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-27T14:04:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/isert 2023-07-27T14:04:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-27T14:04:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/srp 2023-07-27T14:04:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-27T14:04:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/srpt 2023-07-27T14:04:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-27T14:04:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input 2023-07-27T14:04:48.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport 2023-07-27T14:04:48.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-27T14:04:48.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-27T14:04:48.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/gameport.ko 2023-07-27T14:04:48.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/lightning.ko 2023-07-27T14:04:48.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/gameport/ns558.ko 2023-07-27T14:04:48.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/joydev.ko 2023-07-27T14:04:48.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/keyboard 2023-07-27T14:04:48.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-27T14:04:48.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse 2023-07-27T14:04:48.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/appletouch.ko 2023-07-27T14:04:48.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/bcm5974.ko 2023-07-27T14:04:48.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/cyapatp.ko 2023-07-27T14:04:48.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-27T14:04:48.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/sermouse.ko 2023-07-27T14:04:48.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-27T14:04:48.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-27T14:04:48.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-27T14:04:48.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/rmi4 2023-07-27T14:04:48.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-27T14:04:48.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio 2023-07-27T14:04:48.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio/altera_ps2.ko 2023-07-27T14:04:48.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio/arc_ps2.ko 2023-07-27T14:04:48.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-27T14:04:48.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/serio/serio_raw.ko 2023-07-27T14:04:48.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/input/sparse-keymap.ko 2023-07-27T14:04:48.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/iommu 2023-07-27T14:04:48.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/iommu/amd 2023-07-27T14:04:48.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-27T14:04:48.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds 2023-07-27T14:04:48.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/leds-blinkm.ko 2023-07-27T14:04:48.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/leds-lm3530.ko 2023-07-27T14:04:48.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/leds-lp3944.ko 2023-07-27T14:04:48.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/leds-ss4200.ko 2023-07-27T14:04:48.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger 2023-07-27T14:04:48.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-27T14:04:48.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-27T14:04:48.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-27T14:04:48.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-27T14:04:48.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-27T14:04:48.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-27T14:04:48.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-27T14:04:48.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-27T14:04:48.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md 2023-07-27T14:04:48.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/bcache 2023-07-27T14:04:48.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/bcache/bcache.ko 2023-07-27T14:04:48.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-bio-prison.ko 2023-07-27T14:04:48.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-cache-smq.ko 2023-07-27T14:04:48.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-cache.ko 2023-07-27T14:04:48.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-crypt.ko 2023-07-27T14:04:48.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-delay.ko 2023-07-27T14:04:48.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-flakey.ko 2023-07-27T14:04:48.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-log-userspace.ko 2023-07-27T14:04:48.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-multipath.ko 2023-07-27T14:04:48.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-queue-length.ko 2023-07-27T14:04:48.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-raid.ko 2023-07-27T14:04:48.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-round-robin.ko 2023-07-27T14:04:48.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-service-time.ko 2023-07-27T14:04:48.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-switch.ko 2023-07-27T14:04:48.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-thin-pool.ko 2023-07-27T14:04:48.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/dm-verity.ko 2023-07-27T14:04:48.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/faulty.ko 2023-07-27T14:04:48.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/linear.ko 2023-07-27T14:04:48.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/multipath.ko 2023-07-27T14:04:48.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/persistent-data 2023-07-27T14:04:48.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-27T14:04:48.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/raid0.ko 2023-07-27T14:04:48.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/raid1.ko 2023-07-27T14:04:48.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/raid10.ko 2023-07-27T14:04:48.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/md/raid456.ko 2023-07-27T14:04:48.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message 2023-07-27T14:04:48.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion 2023-07-27T14:04:48.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptbase.ko 2023-07-27T14:04:48.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptctl.ko 2023-07-27T14:04:48.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptfc.ko 2023-07-27T14:04:48.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptlan.ko 2023-07-27T14:04:48.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptsas.ko 2023-07-27T14:04:48.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptscsih.ko 2023-07-27T14:04:48.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/message/fusion/mptspi.ko 2023-07-27T14:04:48.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd 2023-07-27T14:04:48.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/lpc_ich.ko 2023-07-27T14:04:48.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/lpc_sch.ko 2023-07-27T14:04:48.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/mfd-core.ko 2023-07-27T14:04:48.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/sm501.ko 2023-07-27T14:04:48.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/viperboard.ko 2023-07-27T14:04:48.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/vx855.ko 2023-07-27T14:04:48.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/mfd/wl1273-core.ko 2023-07-27T14:04:48.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc 2023-07-27T14:04:48.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/altera-stapl 2023-07-27T14:04:48.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-27T14:04:48.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/apds9802als.ko 2023-07-27T14:04:48.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/apds990x.ko 2023-07-27T14:04:48.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/bh1770glc.ko 2023-07-27T14:04:48.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/cb710 2023-07-27T14:04:48.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/cb710/cb710.ko 2023-07-27T14:04:48.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom 2023-07-27T14:04:48.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom/at24.ko 2023-07-27T14:04:48.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-27T14:04:48.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-27T14:04:48.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/eeprom/max6875.ko 2023-07-27T14:04:48.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/enclosure.ko 2023-07-27T14:04:48.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/hpilo.ko 2023-07-27T14:04:48.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/isl29003.ko 2023-07-27T14:04:48.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/isl29020.ko 2023-07-27T14:04:48.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/lis3lv02d 2023-07-27T14:04:48.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-27T14:04:48.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-27T14:04:48.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/mei 2023-07-27T14:04:48.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/mei/mei-me.ko 2023-07-27T14:04:48.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/mei/mei-txe.ko 2023-07-27T14:04:48.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/mei/mei.ko 2023-07-27T14:04:48.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-gru 2023-07-27T14:04:48.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-27T14:04:48.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-xp 2023-07-27T14:04:48.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-27T14:04:48.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-27T14:04:48.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-27T14:04:48.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/tifm_7xx1.ko 2023-07-27T14:04:48.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/tifm_core.ko 2023-07-27T14:04:48.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/tsl2550.ko 2023-07-27T14:04:48.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/vmw_balloon.ko 2023-07-27T14:04:48.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/vmw_vmci 2023-07-27T14:04:48.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-27T14:04:48.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net 2023-07-27T14:04:48.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/bonding 2023-07-27T14:04:48.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/bonding/bonding.ko 2023-07-27T14:04:48.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa 2023-07-27T14:04:48.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/b53 2023-07-27T14:04:48.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-27T14:04:48.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-27T14:04:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-27T14:04:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/mv88e6xxx 2023-07-27T14:04:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-27T14:04:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/dummy.ko 2023-07-27T14:04:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/eql.ko 2023-07-27T14:04:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet 2023-07-27T14:04:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com 2023-07-27T14:04:48.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-27T14:04:48.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-27T14:04:48.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-27T14:04:48.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-27T14:04:48.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390 2023-07-27T14:04:48.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-27T14:04:48.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-27T14:04:48.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-27T14:04:48.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-27T14:04:48.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/adaptec 2023-07-27T14:04:48.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-27T14:04:48.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/agere 2023-07-27T14:04:48.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-27T14:04:48.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/alteon 2023-07-27T14:04:48.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-27T14:04:48.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/altera 2023-07-27T14:04:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-27T14:04:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/amd 2023-07-27T14:04:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-27T14:04:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-27T14:04:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-27T14:04:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros 2023-07-27T14:04:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/alx 2023-07-27T14:04:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-27T14:04:48.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-27T14:04:48.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-27T14:04:48.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-27T14:04:48.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-27T14:04:48.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atlx 2023-07-27T14:04:48.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-27T14:04:48.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-27T14:04:48.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom 2023-07-27T14:04:48.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-27T14:04:48.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-27T14:04:48.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-27T14:04:48.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-27T14:04:48.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-27T14:04:48.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/genet 2023-07-27T14:04:48.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-27T14:04:48.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-27T14:04:48.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/brocade 2023-07-27T14:04:48.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/brocade/bna 2023-07-27T14:04:48.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-27T14:04:48.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio 2023-07-27T14:04:48.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-27T14:04:48.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-27T14:04:48.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-27T14:04:48.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-27T14:04:48.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-27T14:04:48.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-27T14:04:48.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-27T14:04:48.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-27T14:04:48.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-27T14:04:48.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-27T14:04:48.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/cisco 2023-07-27T14:04:48.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/cisco/enic 2023-07-27T14:04:48.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-27T14:04:48.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec 2023-07-27T14:04:48.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip 2023-07-27T14:04:48.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-27T14:04:48.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-27T14:04:48.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-27T14:04:48.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-27T14:04:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-27T14:04:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-27T14:04:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dlink 2023-07-27T14:04:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-27T14:04:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-27T14:04:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/dnet.ko 2023-07-27T14:04:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/emulex 2023-07-27T14:04:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/emulex/benet 2023-07-27T14:04:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-27T14:04:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/ethoc.ko 2023-07-27T14:04:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/fealnx.ko 2023-07-27T14:04:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel 2023-07-27T14:04:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-27T14:04:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e1000 2023-07-27T14:04:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-27T14:04:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e1000e 2023-07-27T14:04:48.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-27T14:04:48.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/fm10k 2023-07-27T14:04:48.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-27T14:04:48.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/i40e 2023-07-27T14:04:48.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-27T14:04:48.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/iavf 2023-07-27T14:04:48.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-27T14:04:48.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/igb 2023-07-27T14:04:48.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-27T14:04:48.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/igbvf 2023-07-27T14:04:48.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-27T14:04:48.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-27T14:04:48.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-27T14:04:48.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-27T14:04:48.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-27T14:04:48.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/jme.ko 2023-07-27T14:04:48.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/marvell 2023-07-27T14:04:48.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-27T14:04:48.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-27T14:04:48.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-27T14:04:48.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox 2023-07-27T14:04:48.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-27T14:04:48.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-27T14:04:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-27T14:04:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-27T14:04:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-27T14:04:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-27T14:04:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/micrel 2023-07-27T14:04:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-27T14:04:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/myricom 2023-07-27T14:04:48.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-27T14:04:48.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-27T14:04:48.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/natsemi 2023-07-27T14:04:48.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-27T14:04:48.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-27T14:04:48.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/neterion 2023-07-27T14:04:48.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-27T14:04:48.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/nvidia 2023-07-27T14:04:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-27T14:04:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/packetengines 2023-07-27T14:04:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-27T14:04:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-27T14:04:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic 2023-07-27T14:04:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-27T14:04:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-27T14:04:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-27T14:04:48.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-27T14:04:48.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-27T14:04:48.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/rdc 2023-07-27T14:04:48.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-27T14:04:48.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek 2023-07-27T14:04:48.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-27T14:04:48.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-27T14:04:48.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-27T14:04:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-27T14:04:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/rocker 2023-07-27T14:04:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-27T14:04:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sfc 2023-07-27T14:04:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-27T14:04:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/silan 2023-07-27T14:04:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-27T14:04:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sis 2023-07-27T14:04:48.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-27T14:04:48.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-27T14:04:48.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc 2023-07-27T14:04:48.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-27T14:04:48.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-27T14:04:48.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-27T14:04:48.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-27T14:04:48.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/stmicro 2023-07-27T14:04:48.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-27T14:04:48.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-27T14:04:48.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-27T14:04:48.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun 2023-07-27T14:04:48.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-27T14:04:48.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-27T14:04:48.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-27T14:04:48.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-27T14:04:48.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/tehuti 2023-07-27T14:04:48.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-27T14:04:48.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/ti 2023-07-27T14:04:48.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-27T14:04:48.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/via 2023-07-27T14:04:48.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-27T14:04:48.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-27T14:04:48.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/wiznet 2023-07-27T14:04:48.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-27T14:04:48.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-27T14:04:48.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/xircom 2023-07-27T14:04:48.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-27T14:04:48.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/geneve.ko 2023-07-27T14:04:48.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/hyperv 2023-07-27T14:04:48.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-27T14:04:48.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ieee802154 2023-07-27T14:04:48.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-27T14:04:48.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ifb.ko 2023-07-27T14:04:48.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ipvlan 2023-07-27T14:04:48.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-27T14:04:48.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/macvlan.ko 2023-07-27T14:04:48.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/macvtap.ko 2023-07-27T14:04:48.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio 2023-07-27T14:04:48.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio.ko 2023-07-27T14:04:48.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-27T14:04:48.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-27T14:04:48.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-27T14:04:48.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/mii.ko 2023-07-27T14:04:48.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/net_failover.ko 2023-07-27T14:04:48.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/netconsole.ko 2023-07-27T14:04:48.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/nlmon.ko 2023-07-27T14:04:48.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/pcs 2023-07-27T14:04:48.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-27T14:04:48.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-27T14:04:48.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy 2023-07-27T14:04:48.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/amd.ko 2023-07-27T14:04:48.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-27T14:04:48.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-27T14:04:48.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-27T14:04:48.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/bcm87xx.ko 2023-07-27T14:04:48.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/broadcom.ko 2023-07-27T14:04:48.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/cicada.ko 2023-07-27T14:04:48.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/davicom.ko 2023-07-27T14:04:48.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/dp83640.ko 2023-07-27T14:04:48.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/et1011c.ko 2023-07-27T14:04:48.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/icplus.ko 2023-07-27T14:04:48.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/lxt.ko 2023-07-27T14:04:48.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/marvell.ko 2023-07-27T14:04:48.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/micrel.ko 2023-07-27T14:04:48.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/national.ko 2023-07-27T14:04:48.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/phylink.ko 2023-07-27T14:04:48.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/qsemi.ko 2023-07-27T14:04:48.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/realtek.ko 2023-07-27T14:04:48.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/smsc.ko 2023-07-27T14:04:48.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/ste10Xp.ko 2023-07-27T14:04:48.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/phy/vitesse.ko 2023-07-27T14:04:48.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp 2023-07-27T14:04:48.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-27T14:04:48.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_async.ko 2023-07-27T14:04:48.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-27T14:04:48.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-27T14:04:48.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-27T14:04:48.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-27T14:04:48.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/pppoe.ko 2023-07-27T14:04:48.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/pppox.ko 2023-07-27T14:04:48.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/ppp/pptp.ko 2023-07-27T14:04:48.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/slip 2023-07-27T14:04:48.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/slip/slhc.ko 2023-07-27T14:04:48.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/slip/slip.ko 2023-07-27T14:04:48.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/sungem_phy.ko 2023-07-27T14:04:48.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/tap.ko 2023-07-27T14:04:48.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team 2023-07-27T14:04:48.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team.ko 2023-07-27T14:04:48.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-27T14:04:48.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-27T14:04:48.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-27T14:04:48.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_random.ko 2023-07-27T14:04:48.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-27T14:04:48.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/tun.ko 2023-07-27T14:04:48.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/veth.ko 2023-07-27T14:04:48.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/virtio_net.ko 2023-07-27T14:04:48.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/vmxnet3 2023-07-27T14:04:48.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-27T14:04:48.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/vxlan 2023-07-27T14:04:48.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/vxlan/vxlan.ko 2023-07-27T14:04:48.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/xen-netback 2023-07-27T14:04:48.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-27T14:04:48.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/net/xen-netfront.ko 2023-07-27T14:04:48.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ntb 2023-07-27T14:04:48.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ntb/ntb.ko 2023-07-27T14:04:48.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/nvme 2023-07-27T14:04:48.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/nvme/host 2023-07-27T14:04:48.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/nvme/host/nvme-core.ko 2023-07-27T14:04:48.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/nvme/host/nvme.ko 2023-07-27T14:04:48.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport 2023-07-27T14:04:48.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport/parport.ko 2023-07-27T14:04:48.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport/parport_cs.ko 2023-07-27T14:04:48.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport/parport_pc.ko 2023-07-27T14:04:48.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/parport/parport_serial.ko 2023-07-27T14:04:48.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci 2023-07-27T14:04:48.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/hotplug 2023-07-27T14:04:48.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-27T14:04:48.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/pcie 2023-07-27T14:04:48.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-27T14:04:48.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pci/xen-pcifront.ko 2023-07-27T14:04:48.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pcmcia 2023-07-27T14:04:48.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pcmcia/i82092.ko 2023-07-27T14:04:48.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pcmcia/pd6729.ko 2023-07-27T14:04:48.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-27T14:04:48.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pinctrl 2023-07-27T14:04:48.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pinctrl/intel 2023-07-27T14:04:48.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-27T14:04:48.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform 2023-07-27T14:04:48.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86 2023-07-27T14:04:48.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-27T14:04:48.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/acerhdf.ko 2023-07-27T14:04:48.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-27T14:04:48.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-27T14:04:48.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-27T14:04:48.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-27T14:04:48.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-27T14:04:48.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-27T14:04:48.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-27T14:04:48.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-27T14:04:48.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-27T14:04:48.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/hdaps.ko 2023-07-27T14:04:48.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/intel 2023-07-27T14:04:48.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-27T14:04:48.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/intel_ips.ko 2023-07-27T14:04:48.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-27T14:04:48.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-27T14:04:48.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-27T14:04:48.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-27T14:04:48.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-27T14:04:48.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-27T14:04:48.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-27T14:04:48.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-27T14:04:48.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-27T14:04:48.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/platform/x86/wmi.ko 2023-07-27T14:04:48.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/powercap 2023-07-27T14:04:48.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-27T14:04:48.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-27T14:04:48.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps 2023-07-27T14:04:48.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/clients 2023-07-27T14:04:48.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-27T14:04:48.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-27T14:04:48.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/clients/pps_parport.ko 2023-07-27T14:04:48.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/pps/pps_core.ko 2023-07-27T14:04:48.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ptp 2023-07-27T14:04:48.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ptp/ptp.ko 2023-07-27T14:04:48.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ptp/ptp_kvm.ko 2023-07-27T14:04:48.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc 2023-07-27T14:04:48.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-27T14:04:48.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-27T14:04:48.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-27T14:04:48.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-27T14:04:48.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-27T14:04:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-27T14:04:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-27T14:04:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-27T14:04:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-27T14:04:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-27T14:04:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-27T14:04:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-em3027.ko 2023-07-27T14:04:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-27T14:04:48.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-27T14:04:48.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-27T14:04:48.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-27T14:04:48.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-27T14:04:48.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-27T14:04:48.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-max6900.ko 2023-07-27T14:04:48.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-27T14:04:48.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-27T14:04:48.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-27T14:04:48.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-27T14:04:48.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-27T14:04:48.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-27T14:04:48.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-27T14:04:48.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-27T14:04:48.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-27T14:04:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-27T14:04:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-27T14:04:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-27T14:04:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/rtc/rtc-x1205.ko 2023-07-27T14:04:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi 2023-07-27T14:04:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/3w-9xxx.ko 2023-07-27T14:04:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/3w-sas.ko 2023-07-27T14:04:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/3w-xxxx.ko 2023-07-27T14:04:48.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/BusLogic.ko 2023-07-27T14:04:48.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/a100u2w.ko 2023-07-27T14:04:48.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aacraid 2023-07-27T14:04:48.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-27T14:04:48.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/advansys.ko 2023-07-27T14:04:48.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aic7xxx 2023-07-27T14:04:48.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-27T14:04:48.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-27T14:04:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/am53c974.ko 2023-07-27T14:04:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/arcmsr 2023-07-27T14:04:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-27T14:04:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/atp870u.ko 2023-07-27T14:04:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/be2iscsi 2023-07-27T14:04:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-27T14:04:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bfa 2023-07-27T14:04:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bfa/bfa.ko 2023-07-27T14:04:48.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bnx2fc 2023-07-27T14:04:48.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-27T14:04:48.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bnx2i 2023-07-27T14:04:48.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-27T14:04:48.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/ch.ko 2023-07-27T14:04:48.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/csiostor 2023-07-27T14:04:48.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-27T14:04:48.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi 2023-07-27T14:04:48.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-27T14:04:48.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-27T14:04:48.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-27T14:04:48.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-27T14:04:48.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-27T14:04:48.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/dc395x.ko 2023-07-27T14:04:48.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler 2023-07-27T14:04:48.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-27T14:04:48.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-27T14:04:48.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-27T14:04:48.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-27T14:04:48.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/dmx3191d.ko 2023-07-27T14:04:48.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/esas2r 2023-07-27T14:04:48.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-27T14:04:48.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/esp_scsi.ko 2023-07-27T14:04:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fcoe 2023-07-27T14:04:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-27T14:04:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-27T14:04:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fnic 2023-07-27T14:04:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/fnic/fnic.ko 2023-07-27T14:04:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/hpsa.ko 2023-07-27T14:04:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/hptiop.ko 2023-07-27T14:04:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/hv_storvsc.ko 2023-07-27T14:04:48.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/initio.ko 2023-07-27T14:04:48.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/ipr.ko 2023-07-27T14:04:48.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/ips.ko 2023-07-27T14:04:48.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/isci 2023-07-27T14:04:48.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/isci/isci.ko 2023-07-27T14:04:48.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-27T14:04:48.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-27T14:04:48.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libfc 2023-07-27T14:04:48.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libfc/libfc.ko 2023-07-27T14:04:48.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libiscsi.ko 2023-07-27T14:04:48.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-27T14:04:48.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libsas 2023-07-27T14:04:48.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/libsas/libsas.ko 2023-07-27T14:04:48.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/lpfc 2023-07-27T14:04:48.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-27T14:04:48.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid 2023-07-27T14:04:48.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid.ko 2023-07-27T14:04:48.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-27T14:04:48.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-27T14:04:48.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-27T14:04:48.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mpt3sas 2023-07-27T14:04:48.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-27T14:04:48.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mvsas 2023-07-27T14:04:48.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-27T14:04:48.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/mvumi.ko 2023-07-27T14:04:48.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/pm8001 2023-07-27T14:04:48.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-27T14:04:48.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/pmcraid.ko 2023-07-27T14:04:48.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla1280.ko 2023-07-27T14:04:48.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla2xxx 2023-07-27T14:04:48.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-27T14:04:48.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-27T14:04:48.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla4xxx 2023-07-27T14:04:48.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-27T14:04:48.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/raid_class.ko 2023-07-27T14:04:48.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_debug.ko 2023-07-27T14:04:48.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-27T14:04:48.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-27T14:04:48.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-27T14:04:48.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-27T14:04:48.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-27T14:04:48.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/ses.ko 2023-07-27T14:04:48.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/st.ko 2023-07-27T14:04:48.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/stex.ko 2023-07-27T14:04:48.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/sym53c8xx_2 2023-07-27T14:04:48.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-27T14:04:48.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/virtio_scsi.ko 2023-07-27T14:04:48.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-27T14:04:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/scsi/wd719x.ko 2023-07-27T14:04:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ssb 2023-07-27T14:04:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ssb/ssb.ko 2023-07-27T14:04:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target 2023-07-27T14:04:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/iscsi 2023-07-27T14:04:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-27T14:04:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/loopback 2023-07-27T14:04:48.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-27T14:04:48.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_file.ko 2023-07-27T14:04:48.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_iblock.ko 2023-07-27T14:04:48.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_mod.ko 2023-07-27T14:04:48.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_pscsi.ko 2023-07-27T14:04:48.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/target_core_user.ko 2023-07-27T14:04:48.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/tcm_fc 2023-07-27T14:04:48.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-27T14:04:48.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal 2023-07-27T14:04:48.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel 2023-07-27T14:04:48.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal 2023-07-27T14:04:48.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-27T14:04:48.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-27T14:04:48.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-27T14:04:48.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-27T14:04:48.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-27T14:04:48.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-27T14:04:48.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-27T14:04:48.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-27T14:04:48.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-27T14:04:48.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-27T14:04:48.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-27T14:04:48.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-27T14:04:48.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-27T14:04:48.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-27T14:04:48.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-27T14:04:48.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty 2023-07-27T14:04:48.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/ipwireless 2023-07-27T14:04:48.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-27T14:04:48.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/n_gsm.ko 2023-07-27T14:04:48.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/n_hdlc.ko 2023-07-27T14:04:48.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/nozomi.ko 2023-07-27T14:04:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial 2023-07-27T14:04:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/8250 2023-07-27T14:04:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-27T14:04:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/arc_uart.ko 2023-07-27T14:04:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/jsm 2023-07-27T14:04:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-27T14:04:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/tty/synclink_gt.ko 2023-07-27T14:04:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs 2023-07-27T14:04:48.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs/core 2023-07-27T14:04:48.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-27T14:04:48.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs/host 2023-07-27T14:04:48.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-27T14:04:48.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio 2023-07-27T14:04:48.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio.ko 2023-07-27T14:04:48.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio_aec.ko 2023-07-27T14:04:48.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio_cif.ko 2023-07-27T14:04:48.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio_pci_generic.ko 2023-07-27T14:04:48.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/uio/uio_sercos3.ko 2023-07-27T14:04:48.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb 2023-07-27T14:04:48.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class 2023-07-27T14:04:48.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class/cdc-acm.ko 2023-07-27T14:04:48.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-27T14:04:48.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class/usblp.ko 2023-07-27T14:04:48.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/class/usbtmc.ko 2023-07-27T14:04:48.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/host 2023-07-27T14:04:48.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-27T14:04:48.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/image 2023-07-27T14:04:48.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/image/mdc800.ko 2023-07-27T14:04:48.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/image/microtek.ko 2023-07-27T14:04:48.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc 2023-07-27T14:04:48.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/adutux.ko 2023-07-27T14:04:48.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/appledisplay.ko 2023-07-27T14:04:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/emi26.ko 2023-07-27T14:04:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/emi62.ko 2023-07-27T14:04:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/ezusb.ko 2023-07-27T14:04:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/idmouse.ko 2023-07-27T14:04:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/iowarrior.ko 2023-07-27T14:04:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-27T14:04:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/ldusb.ko 2023-07-27T14:04:48.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/legousbtower.ko 2023-07-27T14:04:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/sisusbvga 2023-07-27T14:04:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-27T14:04:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-27T14:04:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/usb3503.ko 2023-07-27T14:04:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/usblcd.ko 2023-07-27T14:04:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-27T14:04:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/uss720.ko 2023-07-27T14:04:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/misc/yurex.ko 2023-07-27T14:04:48.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/phy 2023-07-27T14:04:48.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/phy/phy-generic.ko 2023-07-27T14:04:48.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial 2023-07-27T14:04:48.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/aircable.ko 2023-07-27T14:04:48.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ark3116.ko 2023-07-27T14:04:48.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-27T14:04:48.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ch341.ko 2023-07-27T14:04:48.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/cp210x.ko 2023-07-27T14:04:48.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/cyberjack.ko 2023-07-27T14:04:48.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-27T14:04:48.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-27T14:04:48.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/empeg.ko 2023-07-27T14:04:48.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-27T14:04:48.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-27T14:04:48.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-27T14:04:48.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/io_ti.ko 2023-07-27T14:04:48.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ipaq.ko 2023-07-27T14:04:48.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ipw.ko 2023-07-27T14:04:48.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ir-usb.ko 2023-07-27T14:04:48.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-27T14:04:48.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/keyspan.ko 2023-07-27T14:04:48.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-27T14:04:48.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-27T14:04:48.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-27T14:04:48.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/mct_u232.ko 2023-07-27T14:04:48.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/mos7720.ko 2023-07-27T14:04:48.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/mos7840.ko 2023-07-27T14:04:48.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/navman.ko 2023-07-27T14:04:48.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/omninet.ko 2023-07-27T14:04:48.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/opticon.ko 2023-07-27T14:04:48.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/option.ko 2023-07-27T14:04:48.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/oti6858.ko 2023-07-27T14:04:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/pl2303.ko 2023-07-27T14:04:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/qcaux.ko 2023-07-27T14:04:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/qcserial.ko 2023-07-27T14:04:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/quatech2.ko 2023-07-27T14:04:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/safe_serial.ko 2023-07-27T14:04:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/sierra.ko 2023-07-27T14:04:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-27T14:04:48.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ssu100.ko 2023-07-27T14:04:48.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/symbolserial.ko 2023-07-27T14:04:48.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-27T14:04:48.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-27T14:04:48.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/usb_debug.ko 2023-07-27T14:04:48.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-27T14:04:48.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/visor.ko 2023-07-27T14:04:48.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/whiteheat.ko 2023-07-27T14:04:48.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-27T14:04:48.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage 2023-07-27T14:04:48.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/uas.ko 2023-07-27T14:04:48.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-27T14:04:48.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-27T14:04:48.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-27T14:04:48.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-27T14:04:48.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-27T14:04:48.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-27T14:04:48.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-27T14:04:48.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-karma.ko 2023-07-27T14:04:48.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-27T14:04:48.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-27T14:04:48.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-27T14:04:48.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-27T14:04:48.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-27T14:04:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/storage/usb-storage.ko 2023-07-27T14:04:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/usbip 2023-07-27T14:04:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-27T14:04:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-27T14:04:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-27T14:04:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio 2023-07-27T14:04:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/pci 2023-07-27T14:04:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-27T14:04:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-27T14:04:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/vfio.ko 2023-07-27T14:04:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-27T14:04:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost 2023-07-27T14:04:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost/vhost.ko 2023-07-27T14:04:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-27T14:04:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost/vhost_net.ko 2023-07-27T14:04:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/vhost/vhost_scsi.ko 2023-07-27T14:04:48.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video 2023-07-27T14:04:48.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video/backlight 2023-07-27T14:04:48.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video/backlight/apple_bl.ko 2023-07-27T14:04:48.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video/backlight/lcd.ko 2023-07-27T14:04:48.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-27T14:04:48.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio 2023-07-27T14:04:48.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio.ko 2023-07-27T14:04:48.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_balloon.ko 2023-07-27T14:04:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_mmio.ko 2023-07-27T14:04:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_pci.ko 2023-07-27T14:04:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-27T14:04:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-27T14:04:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/virtio/virtio_ring.ko 2023-07-27T14:04:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1 2023-07-27T14:04:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/masters 2023-07-27T14:04:48.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/masters/ds2482.ko 2023-07-27T14:04:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/masters/ds2490.ko 2023-07-27T14:04:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves 2023-07-27T14:04:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-27T14:04:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-27T14:04:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-27T14:04:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-27T14:04:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-27T14:04:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-27T14:04:48.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-27T14:04:48.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-27T14:04:48.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-27T14:04:48.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-27T14:04:48.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-27T14:04:48.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/w1/wire.ko 2023-07-27T14:04:48.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog 2023-07-27T14:04:48.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-27T14:04:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-27T14:04:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-27T14:04:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/hpwdt.ko 2023-07-27T14:04:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/i6300esb.ko 2023-07-27T14:04:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-27T14:04:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-27T14:04:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/ib700wdt.ko 2023-07-27T14:04:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/ibmasr.ko 2023-07-27T14:04:48.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-27T14:04:48.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-27T14:04:48.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/it87_wdt.ko 2023-07-27T14:04:48.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/machzwd.ko 2023-07-27T14:04:48.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/nv_tco.ko 2023-07-27T14:04:48.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-27T14:04:48.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-27T14:04:48.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-27T14:04:48.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-27T14:04:48.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/softdog.ko 2023-07-27T14:04:48.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-27T14:04:48.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/via_wdt.ko 2023-07-27T14:04:48.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-27T14:04:48.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-27T14:04:48.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-27T14:04:48.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/wdt_pci.ko 2023-07-27T14:04:48.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/watchdog/xen_wdt.ko 2023-07-27T14:04:48.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen 2023-07-27T14:04:48.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-27T14:04:48.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-evtchn.ko 2023-07-27T14:04:48.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-gntalloc.ko 2023-07-27T14:04:48.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-gntdev.ko 2023-07-27T14:04:48.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-pciback 2023-07-27T14:04:48.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-27T14:04:48.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xen-privcmd.ko 2023-07-27T14:04:48.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xenfs 2023-07-27T14:04:48.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-27T14:04:48.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs 2023-07-27T14:04:48.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/9p 2023-07-27T14:04:48.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/9p/9p.ko 2023-07-27T14:04:48.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/affs 2023-07-27T14:04:48.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/affs/affs.ko 2023-07-27T14:04:48.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/befs 2023-07-27T14:04:48.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/befs/befs.ko 2023-07-27T14:04:48.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/binfmt_misc.ko 2023-07-27T14:04:48.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/btrfs 2023-07-27T14:04:48.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/btrfs/btrfs.ko 2023-07-27T14:04:48.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/cachefiles 2023-07-27T14:04:48.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/cachefiles/cachefiles.ko 2023-07-27T14:04:48.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ceph 2023-07-27T14:04:48.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ceph/ceph.ko 2023-07-27T14:04:48.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/coda 2023-07-27T14:04:48.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/coda/coda.ko 2023-07-27T14:04:48.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/cramfs 2023-07-27T14:04:48.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/cramfs/cramfs.ko 2023-07-27T14:04:48.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/dlm 2023-07-27T14:04:48.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/dlm/dlm.ko 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ecryptfs 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/f2fs 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/f2fs/f2fs.ko 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fat 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fat/fat.ko 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fat/msdos.ko 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fat/vfat.ko 2023-07-27T14:04:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fscache 2023-07-27T14:04:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fscache/fscache.ko 2023-07-27T14:04:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fuse 2023-07-27T14:04:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fuse/cuse.ko 2023-07-27T14:04:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/fuse/fuse.ko 2023-07-27T14:04:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/gfs2 2023-07-27T14:04:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/gfs2/gfs2.ko 2023-07-27T14:04:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/hfs 2023-07-27T14:04:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/hfs/hfs.ko 2023-07-27T14:04:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/hfsplus 2023-07-27T14:04:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/hfsplus/hfsplus.ko 2023-07-27T14:04:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/isofs 2023-07-27T14:04:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/isofs/isofs.ko 2023-07-27T14:04:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/jfs 2023-07-27T14:04:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/jfs/jfs.ko 2023-07-27T14:04:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/lockd 2023-07-27T14:04:48.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/lockd/lockd.ko 2023-07-27T14:04:48.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/minix 2023-07-27T14:04:48.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/minix/minix.ko 2023-07-27T14:04:48.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/netfs 2023-07-27T14:04:48.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/netfs/netfs.ko 2023-07-27T14:04:48.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs 2023-07-27T14:04:48.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/blocklayout 2023-07-27T14:04:48.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-27T14:04:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/filelayout 2023-07-27T14:04:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-27T14:04:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/flexfilelayout 2023-07-27T14:04:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-27T14:04:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/nfs.ko 2023-07-27T14:04:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/nfsv3.ko 2023-07-27T14:04:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs/nfsv4.ko 2023-07-27T14:04:48.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs_common 2023-07-27T14:04:48.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs_common/grace.ko 2023-07-27T14:04:48.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfs_common/nfs_acl.ko 2023-07-27T14:04:48.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfsd 2023-07-27T14:04:48.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nfsd/nfsd.ko 2023-07-27T14:04:48.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nilfs2 2023-07-27T14:04:48.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nilfs2/nilfs2.ko 2023-07-27T14:04:48.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls 2023-07-27T14:04:48.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-celtic.ko 2023-07-27T14:04:48.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-centeuro.ko 2023-07-27T14:04:48.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-croatian.ko 2023-07-27T14:04:48.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-cyrillic.ko 2023-07-27T14:04:48.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-gaelic.ko 2023-07-27T14:04:48.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-greek.ko 2023-07-27T14:04:48.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-iceland.ko 2023-07-27T14:04:48.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-inuit.ko 2023-07-27T14:04:48.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-roman.ko 2023-07-27T14:04:48.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-romanian.ko 2023-07-27T14:04:48.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/mac-turkish.ko 2023-07-27T14:04:48.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp1250.ko 2023-07-27T14:04:48.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp1251.ko 2023-07-27T14:04:48.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp1255.ko 2023-07-27T14:04:48.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp737.ko 2023-07-27T14:04:48.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp775.ko 2023-07-27T14:04:48.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp850.ko 2023-07-27T14:04:48.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp852.ko 2023-07-27T14:04:48.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp855.ko 2023-07-27T14:04:48.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp857.ko 2023-07-27T14:04:48.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp860.ko 2023-07-27T14:04:48.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp861.ko 2023-07-27T14:04:48.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp862.ko 2023-07-27T14:04:48.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp863.ko 2023-07-27T14:04:48.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp864.ko 2023-07-27T14:04:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp865.ko 2023-07-27T14:04:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp866.ko 2023-07-27T14:04:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp869.ko 2023-07-27T14:04:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp874.ko 2023-07-27T14:04:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp932.ko 2023-07-27T14:04:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp936.ko 2023-07-27T14:04:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp949.ko 2023-07-27T14:04:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_cp950.ko 2023-07-27T14:04:48.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_euc-jp.ko 2023-07-27T14:04:48.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-1.ko 2023-07-27T14:04:48.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-13.ko 2023-07-27T14:04:48.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-14.ko 2023-07-27T14:04:48.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-15.ko 2023-07-27T14:04:48.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-2.ko 2023-07-27T14:04:48.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-3.ko 2023-07-27T14:04:48.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-4.ko 2023-07-27T14:04:48.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-5.ko 2023-07-27T14:04:48.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-6.ko 2023-07-27T14:04:48.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-7.ko 2023-07-27T14:04:48.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_iso8859-9.ko 2023-07-27T14:04:48.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_koi8-r.ko 2023-07-27T14:04:48.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_koi8-ru.ko 2023-07-27T14:04:48.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_koi8-u.ko 2023-07-27T14:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/nls/nls_utf8.ko 2023-07-27T14:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2 2023-07-27T14:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/cluster 2023-07-27T14:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-27T14:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/dlm 2023-07-27T14:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-27T14:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/dlmfs 2023-07-27T14:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-27T14:04:48.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/ocfs2.ko 2023-07-27T14:04:48.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-27T14:04:48.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-27T14:04:48.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-27T14:04:48.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/overlayfs 2023-07-27T14:04:48.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/overlayfs/overlay.ko 2023-07-27T14:04:48.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/pstore 2023-07-27T14:04:48.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/pstore/ramoops.ko 2023-07-27T14:04:49.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/reiserfs 2023-07-27T14:04:49.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/reiserfs/reiserfs.ko 2023-07-27T14:04:49.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/romfs 2023-07-27T14:04:49.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/romfs/romfs.ko 2023-07-27T14:04:49.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb 2023-07-27T14:04:49.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/client 2023-07-27T14:04:49.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/client/cifs.ko 2023-07-27T14:04:49.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/common 2023-07-27T14:04:49.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/common/cifs_arc4.ko 2023-07-27T14:04:49.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/smb/common/cifs_md4.ko 2023-07-27T14:04:49.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/squashfs 2023-07-27T14:04:49.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/squashfs/squashfs.ko 2023-07-27T14:04:49.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/sysv 2023-07-27T14:04:49.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/sysv/sysv.ko 2023-07-27T14:04:49.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/udf 2023-07-27T14:04:49.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/udf/udf.ko 2023-07-27T14:04:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ufs 2023-07-27T14:04:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/ufs/ufs.ko 2023-07-27T14:04:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/xfs 2023-07-27T14:04:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/fs/xfs/xfs.ko 2023-07-27T14:04:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel 2023-07-27T14:04:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/rcu 2023-07-27T14:04:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/rcu/rcutorture.ko 2023-07-27T14:04:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/torture.ko 2023-07-27T14:04:49.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/trace 2023-07-27T14:04:49.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-27T14:04:49.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib 2023-07-27T14:04:49.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/asn1_encoder.ko 2023-07-27T14:04:49.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crc-itu-t.ko 2023-07-27T14:04:49.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crc8.ko 2023-07-27T14:04:49.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crypto 2023-07-27T14:04:49.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crypto/libarc4.ko 2023-07-27T14:04:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/crypto/libdes.ko 2023-07-27T14:04:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/libcrc32c.ko 2023-07-27T14:04:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/lru_cache.ko 2023-07-27T14:04:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/lz4 2023-07-27T14:04:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/lz4/lz4_compress.ko 2023-07-27T14:04:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/lz4/lz4hc_compress.ko 2023-07-27T14:04:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/math 2023-07-27T14:04:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/math/cordic.ko 2023-07-27T14:04:49.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/raid6 2023-07-27T14:04:49.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/raid6/raid6_pq.ko 2023-07-27T14:04:49.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/reed_solomon 2023-07-27T14:04:49.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-27T14:04:49.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/ts_bm.ko 2023-07-27T14:04:49.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/ts_fsm.ko 2023-07-27T14:04:49.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/ts_kmp.ko 2023-07-27T14:04:49.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/zstd 2023-07-27T14:04:49.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/lib/zstd/zstd_compress.ko 2023-07-27T14:04:49.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/mm 2023-07-27T14:04:49.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/mm/hwpoison-inject.ko 2023-07-27T14:04:49.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net 2023-07-27T14:04:49.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan 2023-07-27T14:04:49.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/6lowpan.ko 2023-07-27T14:04:49.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_dest.ko 2023-07-27T14:04:49.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_fragment.ko 2023-07-27T14:04:49.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_hop.ko 2023-07-27T14:04:49.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-27T14:04:49.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_mobility.ko 2023-07-27T14:04:49.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_routing.ko 2023-07-27T14:04:49.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/6lowpan/nhc_udp.ko 2023-07-27T14:04:49.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802 2023-07-27T14:04:49.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/garp.ko 2023-07-27T14:04:49.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/mrp.ko 2023-07-27T14:04:49.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/p8022.ko 2023-07-27T14:04:49.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/psnap.ko 2023-07-27T14:04:49.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/802/stp.ko 2023-07-27T14:04:49.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/8021q 2023-07-27T14:04:49.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/8021q/8021q.ko 2023-07-27T14:04:49.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p 2023-07-27T14:04:49.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p/9pnet.ko 2023-07-27T14:04:49.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p/9pnet_fd.ko 2023-07-27T14:04:49.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p/9pnet_rdma.ko 2023-07-27T14:04:49.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/9p/9pnet_virtio.ko 2023-07-27T14:04:49.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/batman-adv 2023-07-27T14:04:49.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/batman-adv/batman-adv.ko 2023-07-27T14:04:49.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge 2023-07-27T14:04:49.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/br_netfilter.ko 2023-07-27T14:04:49.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/bridge.ko 2023-07-27T14:04:49.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter 2023-07-27T14:04:49.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-27T14:04:49.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-27T14:04:49.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-27T14:04:49.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-27T14:04:49.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-27T14:04:49.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-27T14:04:49.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-27T14:04:49.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-27T14:04:49.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-27T14:04:49.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-27T14:04:49.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-27T14:04:49.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-27T14:04:49.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-27T14:04:49.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-27T14:04:49.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-27T14:04:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-27T14:04:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-27T14:04:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-27T14:04:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-27T14:04:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-27T14:04:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/ebtables.ko 2023-07-27T14:04:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-27T14:04:49.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-27T14:04:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-27T14:04:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ceph 2023-07-27T14:04:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ceph/libceph.ko 2023-07-27T14:04:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/core 2023-07-27T14:04:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/core/failover.ko 2023-07-27T14:04:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/core/pktgen.ko 2023-07-27T14:04:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp 2023-07-27T14:04:49.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp/dccp.ko 2023-07-27T14:04:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp/dccp_diag.ko 2023-07-27T14:04:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp/dccp_ipv4.ko 2023-07-27T14:04:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dccp/dccp_ipv6.ko 2023-07-27T14:04:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dns_resolver 2023-07-27T14:04:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dns_resolver/dns_resolver.ko 2023-07-27T14:04:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa 2023-07-27T14:04:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/dsa_core.ko 2023-07-27T14:04:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/tag_brcm.ko 2023-07-27T14:04:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/tag_dsa.ko 2023-07-27T14:04:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/tag_none.ko 2023-07-27T14:04:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/dsa/tag_trailer.ko 2023-07-27T14:04:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154 2023-07-27T14:04:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154/6lowpan 2023-07-27T14:04:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-27T14:04:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154/ieee802154.ko 2023-07-27T14:04:49.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-27T14:04:49.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4 2023-07-27T14:04:49.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ah4.ko 2023-07-27T14:04:49.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/esp4.ko 2023-07-27T14:04:49.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/fou.ko 2023-07-27T14:04:49.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/gre.ko 2023-07-27T14:04:49.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/inet_diag.ko 2023-07-27T14:04:49.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ip_gre.ko 2023-07-27T14:04:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ip_tunnel.ko 2023-07-27T14:04:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ip_vti.ko 2023-07-27T14:04:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ipcomp.ko 2023-07-27T14:04:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/ipip.ko 2023-07-27T14:04:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter 2023-07-27T14:04:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-27T14:04:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-27T14:04:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-27T14:04:49.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-27T14:04:49.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-27T14:04:49.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-27T14:04:49.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-27T14:04:49.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-27T14:04:49.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-27T14:04:49.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-27T14:04:49.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-27T14:04:49.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-27T14:04:49.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-27T14:04:49.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-27T14:04:49.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-27T14:04:49.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-27T14:04:49.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-27T14:04:49.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-27T14:04:49.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-27T14:04:49.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-27T14:04:49.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-27T14:04:49.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_bic.ko 2023-07-27T14:04:49.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_dctcp.ko 2023-07-27T14:04:49.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_diag.ko 2023-07-27T14:04:49.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_highspeed.ko 2023-07-27T14:04:49.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_htcp.ko 2023-07-27T14:04:49.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_hybla.ko 2023-07-27T14:04:49.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_illinois.ko 2023-07-27T14:04:49.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_lp.ko 2023-07-27T14:04:49.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_scalable.ko 2023-07-27T14:04:49.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_vegas.ko 2023-07-27T14:04:49.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_veno.ko 2023-07-27T14:04:49.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_westwood.ko 2023-07-27T14:04:49.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tcp_yeah.ko 2023-07-27T14:04:49.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/tunnel4.ko 2023-07-27T14:04:49.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/udp_diag.ko 2023-07-27T14:04:49.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/udp_tunnel.ko 2023-07-27T14:04:49.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-27T14:04:49.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6 2023-07-27T14:04:49.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ah6.ko 2023-07-27T14:04:49.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/esp6.ko 2023-07-27T14:04:49.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/fou6.ko 2023-07-27T14:04:49.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ip6_tunnel.ko 2023-07-27T14:04:49.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-27T14:04:49.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ip6_vti.ko 2023-07-27T14:04:49.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/ipcomp6.ko 2023-07-27T14:04:49.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter 2023-07-27T14:04:49.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-27T14:04:49.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-27T14:04:49.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-27T14:04:49.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-27T14:04:49.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-27T14:04:49.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-27T14:04:49.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-27T14:04:49.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-27T14:04:49.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-27T14:04:49.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-27T14:04:49.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-27T14:04:49.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-27T14:04:49.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-27T14:04:49.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-27T14:04:49.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-27T14:04:49.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-27T14:04:49.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-27T14:04:49.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-27T14:04:49.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-27T14:04:49.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-27T14:04:49.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-27T14:04:49.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-27T14:04:49.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-27T14:04:49.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-27T14:04:49.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/sit.ko 2023-07-27T14:04:49.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/tunnel6.ko 2023-07-27T14:04:49.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-27T14:04:49.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/key 2023-07-27T14:04:49.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/key/af_key.ko 2023-07-27T14:04:49.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp 2023-07-27T14:04:49.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_core.ko 2023-07-27T14:04:49.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-27T14:04:49.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_eth.ko 2023-07-27T14:04:49.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_ip.ko 2023-07-27T14:04:49.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_ip6.ko 2023-07-27T14:04:49.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_netlink.ko 2023-07-27T14:04:49.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/l2tp/l2tp_ppp.ko 2023-07-27T14:04:49.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/llc 2023-07-27T14:04:49.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/llc/llc.ko 2023-07-27T14:04:49.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/mac802154 2023-07-27T14:04:49.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/mac802154/mac802154.ko 2023-07-27T14:04:49.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/mpls 2023-07-27T14:04:49.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/mpls/mpls_gso.ko 2023-07-27T14:04:49.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter 2023-07-27T14:04:49.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset 2023-07-27T14:04:49.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set.ko 2023-07-27T14:04:49.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-27T14:04:49.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-27T14:04:49.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-27T14:04:49.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-27T14:04:49.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-27T14:04:49.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-27T14:04:49.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-27T14:04:49.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-27T14:04:49.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-27T14:04:49.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-27T14:04:49.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-27T14:04:49.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-27T14:04:49.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-27T14:04:49.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-27T14:04:49.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-27T14:04:49.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs 2023-07-27T14:04:49.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-27T14:04:49.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-27T14:04:49.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-27T14:04:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-27T14:04:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-27T14:04:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-27T14:04:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-27T14:04:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-27T14:04:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-27T14:04:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-27T14:04:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-27T14:04:49.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-27T14:04:49.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-27T14:04:49.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-27T14:04:49.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conncount.ko 2023-07-27T14:04:49.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack.ko 2023-07-27T14:04:49.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-27T14:04:49.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-27T14:04:49.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-27T14:04:49.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-27T14:04:49.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-27T14:04:49.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-27T14:04:49.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-27T14:04:49.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-27T14:04:49.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-27T14:04:49.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-27T14:04:49.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-27T14:04:49.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-27T14:04:49.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-27T14:04:49.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_flow_table.ko 2023-07-27T14:04:49.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-27T14:04:49.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_log_syslog.ko 2023-07-27T14:04:49.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat.ko 2023-07-27T14:04:49.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-27T14:04:49.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-27T14:04:49.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_irc.ko 2023-07-27T14:04:49.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_sip.ko 2023-07-27T14:04:49.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-27T14:04:49.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-27T14:04:49.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nf_tables.ko 2023-07-27T14:04:49.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink.ko 2023-07-27T14:04:49.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-27T14:04:49.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink_log.ko 2023-07-27T14:04:49.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-27T14:04:49.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-27T14:04:49.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_chain_nat.ko 2023-07-27T14:04:49.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_compat.ko 2023-07-27T14:04:49.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_ct.ko 2023-07-27T14:04:49.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-27T14:04:49.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_fib.ko 2023-07-27T14:04:49.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-27T14:04:49.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_hash.ko 2023-07-27T14:04:49.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_limit.ko 2023-07-27T14:04:49.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_log.ko 2023-07-27T14:04:49.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_masq.ko 2023-07-27T14:04:49.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_nat.ko 2023-07-27T14:04:49.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_numgen.ko 2023-07-27T14:04:49.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_queue.ko 2023-07-27T14:04:49.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_quota.ko 2023-07-27T14:04:49.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_redir.ko 2023-07-27T14:04:49.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_reject.ko 2023-07-27T14:04:49.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_reject_inet.ko 2023-07-27T14:04:49.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_socket.ko 2023-07-27T14:04:49.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/nft_tunnel.ko 2023-07-27T14:04:49.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_AUDIT.ko 2023-07-27T14:04:49.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-27T14:04:49.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-27T14:04:49.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-27T14:04:49.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_CT.ko 2023-07-27T14:04:49.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_DSCP.ko 2023-07-27T14:04:49.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_HL.ko 2023-07-27T14:04:49.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_HMARK.ko 2023-07-27T14:04:49.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-27T14:04:49.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_LED.ko 2023-07-27T14:04:49.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_LOG.ko 2023-07-27T14:04:49.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-27T14:04:49.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_NETMAP.ko 2023-07-27T14:04:49.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_NFLOG.ko 2023-07-27T14:04:49.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-27T14:04:49.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_RATEEST.ko 2023-07-27T14:04:49.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-27T14:04:49.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_SECMARK.ko 2023-07-27T14:04:49.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-27T14:04:49.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-27T14:04:49.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TEE.ko 2023-07-27T14:04:49.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TPROXY.ko 2023-07-27T14:04:49.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_TRACE.ko 2023-07-27T14:04:49.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_addrtype.ko 2023-07-27T14:04:49.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_bpf.ko 2023-07-27T14:04:49.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_cgroup.ko 2023-07-27T14:04:49.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_cluster.ko 2023-07-27T14:04:49.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_comment.ko 2023-07-27T14:04:49.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_connbytes.ko 2023-07-27T14:04:49.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_connlabel.ko 2023-07-27T14:04:49.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_connlimit.ko 2023-07-27T14:04:49.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_connmark.ko 2023-07-27T14:04:49.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_conntrack.ko 2023-07-27T14:04:49.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_cpu.ko 2023-07-27T14:04:49.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_dccp.ko 2023-07-27T14:04:49.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_devgroup.ko 2023-07-27T14:04:49.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_dscp.ko 2023-07-27T14:04:49.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_ecn.ko 2023-07-27T14:04:49.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_esp.ko 2023-07-27T14:04:49.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_hashlimit.ko 2023-07-27T14:04:49.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_helper.ko 2023-07-27T14:04:49.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_hl.ko 2023-07-27T14:04:49.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_ipcomp.ko 2023-07-27T14:04:49.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_iprange.ko 2023-07-27T14:04:49.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_ipvs.ko 2023-07-27T14:04:49.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_l2tp.ko 2023-07-27T14:04:49.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_length.ko 2023-07-27T14:04:49.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_limit.ko 2023-07-27T14:04:49.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_mac.ko 2023-07-27T14:04:49.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_mark.ko 2023-07-27T14:04:49.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_multiport.ko 2023-07-27T14:04:49.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_nat.ko 2023-07-27T14:04:49.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_nfacct.ko 2023-07-27T14:04:49.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_osf.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_owner.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_physdev.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_pkttype.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_policy.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_quota.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_rateest.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_realm.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_recent.ko 2023-07-27T14:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_sctp.ko 2023-07-27T14:04:49.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_set.ko 2023-07-27T14:04:49.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_socket.ko 2023-07-27T14:04:49.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_state.ko 2023-07-27T14:04:49.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_statistic.ko 2023-07-27T14:04:49.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_string.ko 2023-07-27T14:04:49.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_tcpmss.ko 2023-07-27T14:04:49.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_time.ko 2023-07-27T14:04:49.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netfilter/xt_u32.ko 2023-07-27T14:04:49.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netlink 2023-07-27T14:04:49.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/netlink/netlink_diag.ko 2023-07-27T14:04:49.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/nsh 2023-07-27T14:04:49.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/nsh/nsh.ko 2023-07-27T14:04:49.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch 2023-07-27T14:04:49.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch/openvswitch.ko 2023-07-27T14:04:49.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch/vport-geneve.ko 2023-07-27T14:04:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch/vport-gre.ko 2023-07-27T14:04:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/openvswitch/vport-vxlan.ko 2023-07-27T14:04:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/packet 2023-07-27T14:04:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/packet/af_packet_diag.ko 2023-07-27T14:04:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/rds 2023-07-27T14:04:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/rds/rds.ko 2023-07-27T14:04:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/rds/rds_rdma.ko 2023-07-27T14:04:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/rds/rds_tcp.ko 2023-07-27T14:04:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched 2023-07-27T14:04:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_csum.ko 2023-07-27T14:04:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_gact.ko 2023-07-27T14:04:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_ipt.ko 2023-07-27T14:04:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_mirred.ko 2023-07-27T14:04:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_nat.ko 2023-07-27T14:04:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_pedit.ko 2023-07-27T14:04:49.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_police.ko 2023-07-27T14:04:49.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_simple.ko 2023-07-27T14:04:49.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_skbedit.ko 2023-07-27T14:04:49.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/act_vlan.ko 2023-07-27T14:04:49.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_basic.ko 2023-07-27T14:04:49.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_bpf.ko 2023-07-27T14:04:49.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_flow.ko 2023-07-27T14:04:49.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_fw.ko 2023-07-27T14:04:49.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_route.ko 2023-07-27T14:04:49.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/cls_u32.ko 2023-07-27T14:04:49.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_cmp.ko 2023-07-27T14:04:49.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_ipset.ko 2023-07-27T14:04:49.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_meta.ko 2023-07-27T14:04:49.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_nbyte.ko 2023-07-27T14:04:49.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_text.ko 2023-07-27T14:04:49.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/em_u32.ko 2023-07-27T14:04:49.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_choke.ko 2023-07-27T14:04:49.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_codel.ko 2023-07-27T14:04:49.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_drr.ko 2023-07-27T14:04:49.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_fq.ko 2023-07-27T14:04:49.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_gred.ko 2023-07-27T14:04:49.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_hfsc.ko 2023-07-27T14:04:49.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_hhf.ko 2023-07-27T14:04:49.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_htb.ko 2023-07-27T14:04:49.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_ingress.ko 2023-07-27T14:04:49.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_mqprio.ko 2023-07-27T14:04:49.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_mqprio_lib.ko 2023-07-27T14:04:49.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_multiq.ko 2023-07-27T14:04:49.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_netem.ko 2023-07-27T14:04:49.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_pie.ko 2023-07-27T14:04:49.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_plug.ko 2023-07-27T14:04:49.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_prio.ko 2023-07-27T14:04:49.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_qfq.ko 2023-07-27T14:04:49.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_red.ko 2023-07-27T14:04:49.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_sfb.ko 2023-07-27T14:04:49.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_sfq.ko 2023-07-27T14:04:49.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_tbf.ko 2023-07-27T14:04:49.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sched/sch_teql.ko 2023-07-27T14:04:49.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sctp 2023-07-27T14:04:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sctp/sctp.ko 2023-07-27T14:04:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sctp/sctp_diag.ko 2023-07-27T14:04:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc 2023-07-27T14:04:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/auth_gss 2023-07-27T14:04:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-27T14:04:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-27T14:04:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/sunrpc.ko 2023-07-27T14:04:49.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/xprtrdma 2023-07-27T14:04:49.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-27T14:04:49.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/tipc 2023-07-27T14:04:49.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/tipc/diag.ko 2023-07-27T14:04:49.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/tipc/tipc.ko 2023-07-27T14:04:49.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/unix 2023-07-27T14:04:49.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/unix/unix_diag.ko 2023-07-27T14:04:49.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock 2023-07-27T14:04:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-27T14:04:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-27T14:04:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vsock.ko 2023-07-27T14:04:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-27T14:04:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-27T14:04:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/xfrm 2023-07-27T14:04:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-27T14:04:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security 2023-07-27T14:04:49.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys 2023-07-27T14:04:49.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys/encrypted-keys 2023-07-27T14:04:49.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-27T14:04:49.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys/trusted-keys 2023-07-27T14:04:49.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/security/keys/trusted-keys/trusted.ko 2023-07-27T14:04:49.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/virt 2023-07-27T14:04:49.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/virt/lib 2023-07-27T14:04:49.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/kernel/virt/lib/irqbypass.ko 2023-07-27T14:04:49.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.alias 2023-07-27T14:04:49.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.alias.bin 2023-07-27T14:04:49.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.builtin 2023-07-27T14:04:49.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.builtin.bin 2023-07-27T14:04:49.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.builtin.modinfo 2023-07-27T14:04:49.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.dep 2023-07-27T14:04:49.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.dep.bin 2023-07-27T14:04:49.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.devname 2023-07-27T14:04:49.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.order 2023-07-27T14:04:49.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.softdep 2023-07-27T14:04:49.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.symbols 2023-07-27T14:04:49.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.5.0-rc1-g8e3722cc0164/modules.symbols.bin 2023-07-27T14:04:49.062 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:49.063 DEBUG:teuthology.orchestra.run.smithi115:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-27T14:04:49.089 INFO:teuthology.orchestra.run.smithi115.stdout:postinstall scriptlet (using /bin/sh): 2023-07-27T14:04:49.089 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-g8e3722cc0164 -a -r /boot/System.map-6.5.0-rc1-g8e3722cc0164 ]; then 2023-07-27T14:04:49.089 INFO:teuthology.orchestra.run.smithi115.stdout:cp /boot/vmlinuz-6.5.0-rc1-g8e3722cc0164 /boot/.vmlinuz-6.5.0-rc1-g8e3722cc0164-rpm 2023-07-27T14:04:49.089 INFO:teuthology.orchestra.run.smithi115.stdout:cp /boot/System.map-6.5.0-rc1-g8e3722cc0164 /boot/.System.map-6.5.0-rc1-g8e3722cc0164-rpm 2023-07-27T14:04:49.090 INFO:teuthology.orchestra.run.smithi115.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-g8e3722cc0164 /boot/System.map-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:49.090 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/installkernel 6.5.0-rc1-g8e3722cc0164 /boot/.vmlinuz-6.5.0-rc1-g8e3722cc0164-rpm /boot/.System.map-6.5.0-rc1-g8e3722cc0164-rpm 2023-07-27T14:04:49.090 INFO:teuthology.orchestra.run.smithi115.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-g8e3722cc0164-rpm /boot/.System.map-6.5.0-rc1-g8e3722cc0164-rpm 2023-07-27T14:04:49.090 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-07-27T14:04:49.090 INFO:teuthology.orchestra.run.smithi115.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-27T14:04:49.090 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-27T14:04:49.090 INFO:teuthology.orchestra.run.smithi115.stdout:new-kernel-pkg --remove 6.5.0-rc1-g8e3722cc0164 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-g8e3722cc0164.img 2023-07-27T14:04:49.091 INFO:teuthology.orchestra.run.smithi115.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-27T14:04:49.091 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-install remove 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:49.091 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-07-27T14:04:49.091 INFO:teuthology.orchestra.run.smithi115.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-27T14:04:49.091 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-27T14:04:49.091 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:49.091 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-07-27T14:04:49.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2023-07-27T14:04:49.167 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2023-07-27T14:04:49.167 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2023-07-27T14:04:49.168 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.02 2023-07-27T14:04:49.168 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 129.el8 2023-07-27T14:04:49.169 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2023-07-27T14:04:49.169 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-27T14:04:49.169 INFO:teuthology.orchestra.run.smithi115.stdout:Group : System Environment/Base 2023-07-27T14:04:49.169 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 9265586 2023-07-27T14:04:49.169 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2023-07-27T14:04:49.169 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-27T14:04:49.169 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-27T14:04:49.170 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-27T14:04:49.170 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-27T14:04:49.170 INFO:teuthology.orchestra.run.smithi115.stdout:Relocations : (not relocatable) 2023-07-27T14:04:49.170 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : CentOS BuildSystem 2023-07-27T14:04:49.170 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2023-07-27T14:04:49.170 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-27T14:04:49.170 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2023-07-27T14:04:49.171 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2023-07-27T14:04:49.171 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:04:49.171 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-27T14:04:49.171 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-27T14:04:49.171 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-27T14:04:49.171 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2023-07-27T14:04:49.171 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:04:49.172 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2023-07-27T14:04:49.172 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-27T14:04:49.173 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:49.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-27T14:04:49.957 INFO:teuthology.orchestra.run.smithi159.stderr:done 2023-07-27T14:04:49.958 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2023-07-27T14:04:49.992 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.LTHep9gDJ7 2023-07-27T14:04:49.993 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LTHep9gDJ7 2023-07-27T14:04:50.067 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.LTHep9gDJ7 2023-07-27T14:04:50.226 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.LTHep9gDJ7 is 6KB 2023-07-27T14:04:50.273 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.LTHep9gDJ7 2023-07-27T14:04:50.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2023-07-27T14:04:50.368 INFO:teuthology.orchestra.run.smithi159.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-27T14:04:50.368 INFO:teuthology.orchestra.run.smithi159.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-27T14:04:50.369 INFO:teuthology.orchestra.run.smithi159.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-27T14:04:50.369 INFO:teuthology.orchestra.run.smithi159.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-g8e3722cc0164.conf 2023-07-27T14:04:50.370 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:50.503 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2023-07-27T14:04:53.958 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2023-07-27T14:04:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:done 2023-07-27T14:04:56.259 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-07-27T14:04:56.297 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.ExCcghqIJ1 2023-07-27T14:04:56.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ExCcghqIJ1 2023-07-27T14:04:56.372 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.ExCcghqIJ1 2023-07-27T14:04:56.515 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.ExCcghqIJ1 is 6KB 2023-07-27T14:04:56.562 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.ExCcghqIJ1 2023-07-27T14:04:56.579 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2023-07-27T14:04:56.644 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-27T14:04:56.644 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-27T14:04:56.645 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-27T14:04:56.645 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-g8e3722cc0164.conf 2023-07-27T14:04:56.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-g8e3722cc0164 2023-07-27T14:04:56.809 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2023-07-27T14:05:20.528 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-27T14:05:20.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-27T14:05:20.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:05:26.812 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-27T14:05:26.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-27T14:05:26.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:05:43.920 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-27T14:05:50.320 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-27T14:05:52.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-27T14:05:52.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:05:59.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-27T14:05:59.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:06:22.832 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-27T14:06:34.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-27T14:06:34.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:06:37.904 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-27T14:06:52.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-27T14:06:52.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:06:53.239 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-07-27T14:06:53.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-27T14:06:53.631 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc1-g8e3722cc0164"... 2023-07-27T14:06:53.631 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-07-27T14:06:53.676 INFO:teuthology.orchestra.run.smithi115.stdout:6.5.0-rc1-g8e3722cc0164 2023-07-27T14:06:53.676 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-g8e3722cc0164 vs 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:06:53.676 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-27T14:06:53.676 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-27T14:06:54.678 DEBUG:teuthology.parallel:result is None 2023-07-27T14:06:57.929 DEBUG:teuthology.orchestra.remote:timed out 2023-07-27T14:07:09.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-27T14:07:09.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:07:10.517 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-07-27T14:07:10.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-27T14:07:10.927 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc1-g8e3722cc0164"... 2023-07-27T14:07:10.928 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2023-07-27T14:07:10.973 INFO:teuthology.orchestra.run.smithi159.stdout:6.5.0-rc1-g8e3722cc0164 2023-07-27T14:07:10.973 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-g8e3722cc0164 vs 6.5.0-rc1-g8e3722cc0164 2023-07-27T14:07:10.974 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-27T14:07:10.974 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-27T14:07:11.975 DEBUG:teuthology.parallel:result is None 2023-07-27T14:07:11.975 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-27T14:07:11.983 INFO:teuthology.task.internal:Creating test directory... 2023-07-27T14:07:11.984 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-27T14:07:11.989 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-27T14:07:12.040 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-27T14:07:12.051 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-27T14:07:12.061 INFO:teuthology.task.internal:Creating archive directory... 2023-07-27T14:07:12.061 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-27T14:07:12.066 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-27T14:07:12.133 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-27T14:07:12.139 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-27T14:07:12.140 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-27T14:07:12.144 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-27T14:07:12.247 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-27T14:07:12.268 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-27T14:07:12.286 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-27T14:07:12.325 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-27T14:07:12.328 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-27T14:07:12.335 INFO:teuthology.task.internal:Configuring sudo... 2023-07-27T14:07:12.336 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-27T14:07:12.340 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-27T14:07:12.410 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-27T14:07:12.425 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-27T14:07:12.426 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-27T14:07:12.430 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-27T14:07:12.476 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-27T14:07:13.834 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-27T14:07:13.912 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-27T14:07:13.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-27T14:07:14.061 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:07:14.062 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-27T14:07:14.131 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-27T14:07:14.212 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-27T14:07:14.286 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-27T14:07:14.361 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-27T14:07:14.431 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:07:14.431 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-27T14:07:14.501 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2023-07-27T14:07:14.507 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2023-07-27T14:07:14.620 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-27T14:07:14.661 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-27T14:07:15.062 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-27T14:07:15.070 INFO:teuthology.task.internal:Starting timer... 2023-07-27T14:07:15.070 INFO:teuthology.run_tasks:Running task pcp... 2023-07-27T14:07:15.079 INFO:teuthology.run_tasks:Running task selinux... 2023-07-27T14:07:15.087 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-07-27T14:07:15.088 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2023-07-27T14:07:15.248 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2023-07-27T14:07:15.251 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2023-07-27T14:07:15.393 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2023-07-27T14:07:15.397 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-27T14:07:15.397 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2023-07-27T14:07:15.450 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2023-07-27T14:07:15.451 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2023-07-27T14:07:15.502 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2023-07-27T14:07:15.502 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi115.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2023-07-27T14:07:15.503 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-27T14:07:15.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:07:15.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-27T14:07:15.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:07:15.645 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-27T14:07:15.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2023-07-27T14:07:15.713 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2023-07-27T14:07:15.782 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-27T14:07:15.791 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-27T14:07:15.792 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-27T14:07:15.813 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-27T14:07:15.815 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi115.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-27T14:18:54.810 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2023-07-27T14:18:54.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-27T14:18:54.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:18:59.903 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-07-27T14:19:00.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-27T14:19:00.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-27T14:19:00.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:19:05.123 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-07-27T14:19:05.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-27T14:19:05.250 INFO:teuthology.run_tasks:Running task clock... 2023-07-27T14:19:05.262 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-27T14:19:05.263 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-27T14:19:05.263 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-27T14:19:05.269 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-27T14:19:05.269 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-27T14:19:05.348 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-27T14:19:05.349 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-27T14:19:05.380 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-27T14:19:05.382 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-27T14:19:05.468 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2023-07-27T14:19:05.469 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2023-07-27T14:19:05.496 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2023-07-27T14:19:05.497 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2023-07-27T14:19:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-27T14:19:05.530 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-27T14:19:05.561 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-27T14:19:05.563 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-27T14:19:05.654 INFO:teuthology.orchestra.run.smithi159.stderr:bash: ntpq: command not found 2023-07-27T14:19:05.659 INFO:teuthology.orchestra.run.smithi115.stderr:bash: ntpq: command not found 2023-07-27T14:19:05.661 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-27T14:19:05.661 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2023-07-27T14:19:05.661 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T14:19:05.661 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T14:19:05.662 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T14:19:05.662 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T14:19:05.667 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-27T14:19:05.667 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2023-07-27T14:19:05.667 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T14:19:05.667 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T14:19:05.667 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T14:19:05.668 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-27T14:19:05.669 INFO:teuthology.run_tasks:Running task install... 2023-07-27T14:19:05.677 DEBUG:teuthology.task.install:project ceph 2023-07-27T14:19:05.678 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f'}} 2023-07-27T14:19:05.678 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f'} 2023-07-27T14:19:05.678 INFO:teuthology.task.install:Using flavor: default 2023-07-27T14:19:05.687 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-27T14:19:05.688 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-27T14:19:05.689 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f', 'tag': None, 'wait_for_package': False} 2023-07-27T14:19:05.689 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f 2023-07-27T14:19:05.692 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f', 'tag': None, 'wait_for_package': False} 2023-07-27T14:19:05.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f 2023-07-27T14:19:11.073 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-26-0858-pacific/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/centos/8/flavors/default/ 2023-07-27T14:19:11.073 INFO:teuthology.task.install.rpm:Package version is 16.2.13-434.gcb5f5cfb 2023-07-27T14:19:11.305 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-26-0858-pacific/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/centos/8/flavors/default/ 2023-07-27T14:19:11.305 INFO:teuthology.task.install.rpm:Package version is 16.2.13-434.gcb5f5cfb 2023-07-27T14:19:11.346 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-26-0858-pacific/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-26-0858-pacific/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-26-0858-pacific/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-27T14:19:11.346 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:19:11.346 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-27T14:19:11.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-27T14:19:11.424 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-27T14:19:11.539 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-27T14:19:11.565 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-26-0858-pacific/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-26-0858-pacific/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-26-0858-pacific/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-27T14:19:11.565 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:19:11.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-27T14:19:11.636 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-27T14:19:11.642 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-27T14:19:11.643 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-27T14:19:11.705 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2023-07-27T14:19:11.708 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2023-07-27T14:19:11.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-27T14:19:11.850 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-27T14:19:11.918 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2023-07-27T14:19:11.921 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2023-07-27T14:19:12.058 INFO:teuthology.orchestra.run.smithi159.stdout:73 files removed 2023-07-27T14:19:12.093 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-27T14:19:12.266 INFO:teuthology.orchestra.run.smithi115.stdout:73 files removed 2023-07-27T14:19:12.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-27T14:19:13.563 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 82 kB/s | 76 kB 00:00 2023-07-27T14:19:13.892 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 73 kB/s | 76 kB 00:01 2023-07-27T14:19:14.080 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 32 kB/s | 15 kB 00:00 2023-07-27T14:19:14.368 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 35 kB/s | 15 kB 00:00 2023-07-27T14:19:14.506 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 3.6 kB/s | 1.4 kB 00:00 2023-07-27T14:19:14.827 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 3.3 kB/s | 1.4 kB 00:00 2023-07-27T14:19:33.715 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - AppStream 1.6 MB/s | 31 MB 00:18 2023-07-27T14:19:41.328 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - AppStream 1.1 MB/s | 31 MB 00:26 2023-07-27T14:20:19.540 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - BaseOS 1.0 MB/s | 41 MB 00:39 2023-07-27T14:20:26.564 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras 24 kB/s | 18 kB 00:00 2023-07-27T14:20:28.206 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras common packages 4.5 kB/s | 6.6 kB 00:01 2023-07-27T14:20:29.082 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - PowerTools 8.7 MB/s | 6.3 MB 00:00 2023-07-27T14:20:30.626 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-27T14:21:03.220 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 493 kB/s | 16 MB 00:32 2023-07-27T14:21:07.887 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 64 kB/s | 24 kB 00:00 2023-07-27T14:21:11.858 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-27T14:21:11.859 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-27T14:21:11.871 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-27T14:21:11.872 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-27T14:21:11.872 INFO:teuthology.orchestra.run.smithi115.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-27T14:21:11.874 INFO:teuthology.orchestra.run.smithi115.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-27T14:21:11.875 INFO:teuthology.orchestra.run.smithi115.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-27T14:21:11.876 INFO:teuthology.orchestra.run.smithi115.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-27T14:21:11.879 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-27T14:21:11.880 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-27T14:21:12.067 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2023-07-27T14:21:12.081 INFO:teuthology.orchestra.run.smithi115.stdout:==================================================================================================== 2023-07-27T14:21:12.081 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2023-07-27T14:21:12.081 INFO:teuthology.orchestra.run.smithi115.stdout:==================================================================================================== 2023-07-27T14:21:12.081 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2023-07-27T14:21:12.081 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-27T14:21:12.081 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 6.4 k 2023-07-27T14:21:12.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 6.1 M 2023-07-27T14:21:12.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 910 k 2023-07-27T14:21:12.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 161 k 2023-07-27T14:21:12.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 1.6 M 2023-07-27T14:21:12.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 116 k 2023-07-27T14:21:12.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 3.1 M 2023-07-27T14:21:12.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 8.6 M 2023-07-27T14:21:12.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 27 k 2023-07-27T14:21:12.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 12 M 2023-07-27T14:21:12.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 51 M 2023-07-27T14:21:12.083 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 84 k 2023-07-27T14:21:12.083 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 256 k 2023-07-27T14:21:12.083 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 19 k 2023-07-27T14:21:12.083 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-27T14:21:12.083 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-27T14:21:12.084 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-27T14:21:12.084 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 25 k 2023-07-27T14:21:12.084 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 824 k 2023-07-27T14:21:12.084 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 131 k 2023-07-27T14:21:12.084 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-27T14:21:12.084 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-27T14:21:12.084 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-27T14:21:12.085 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 215 k 2023-07-27T14:21:12.085 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 389 k 2023-07-27T14:21:12.085 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 369 k 2023-07-27T14:21:12.085 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 114 k 2023-07-27T14:21:12.085 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 88 k 2023-07-27T14:21:12.085 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 3.7 M 2023-07-27T14:21:12.085 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 173 k 2023-07-27T14:21:12.085 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-27T14:21:12.086 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2023-07-27T14:21:12.086 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-27T14:21:12.086 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-27T14:21:12.086 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-27T14:21:12.086 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-27T14:21:12.086 INFO:teuthology.orchestra.run.smithi115.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-27T14:21:12.086 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-27T14:21:12.087 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-27T14:21:12.087 INFO:teuthology.orchestra.run.smithi115.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-27T14:21:12.087 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 3.7 M 2023-07-27T14:21:12.087 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 4.2 M 2023-07-27T14:21:12.087 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-27T14:21:12.087 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-27T14:21:12.087 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-27T14:21:12.088 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-27T14:21:12.088 INFO:teuthology.orchestra.run.smithi115.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-27T14:21:12.088 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-27T14:21:12.088 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2023-07-27T14:21:12.088 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-27T14:21:12.088 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 24 M 2023-07-27T14:21:12.088 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 24 k 2023-07-27T14:21:12.088 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 2.4 M 2023-07-27T14:21:12.089 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 244 k 2023-07-27T14:21:12.089 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 5.0 M 2023-07-27T14:21:12.089 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 18 M 2023-07-27T14:21:12.089 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 15 k 2023-07-27T14:21:12.089 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 26 k 2023-07-27T14:21:12.089 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-27T14:21:12.089 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-27T14:21:12.090 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-27T14:21:12.090 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-27T14:21:12.090 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-27T14:21:12.090 INFO:teuthology.orchestra.run.smithi115.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-07-27T14:21:12.090 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 174 k 2023-07-27T14:21:12.090 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-27T14:21:12.090 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-27T14:21:12.090 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-27T14:21:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-27T14:21:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-27T14:21:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 493 k 2023-07-27T14:21:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-27T14:21:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 3.8 M 2023-07-27T14:21:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-27T14:21:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-27T14:21:12.091 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-27T14:21:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-27T14:21:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-27T14:21:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-27T14:21:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-27T14:21:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-27T14:21:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-27T14:21:12.092 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-27T14:21:12.093 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-27T14:21:12.093 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-27T14:21:12.093 INFO:teuthology.orchestra.run.smithi115.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-07-27T14:21:12.093 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-27T14:21:12.093 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-27T14:21:12.093 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-27T14:21:12.093 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-27T14:21:12.093 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 45 k 2023-07-27T14:21:12.094 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 99 k 2023-07-27T14:21:12.094 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-27T14:21:12.094 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-27T14:21:12.094 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-27T14:21:12.094 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-27T14:21:12.094 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-27T14:21:12.094 INFO:teuthology.orchestra.run.smithi115.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-07-27T14:21:12.094 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-27T14:21:12.095 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-27T14:21:12.095 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-27T14:21:12.095 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-27T14:21:12.095 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-27T14:21:12.095 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-27T14:21:12.095 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-27T14:21:12.095 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-27T14:21:12.095 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-27T14:21:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-27T14:21:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-27T14:21:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-27T14:21:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-27T14:21:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-27T14:21:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-27T14:21:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-27T14:21:12.097 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-27T14:21:12.097 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-27T14:21:12.097 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-27T14:21:12.097 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-27T14:21:12.097 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-27T14:21:12.097 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-27T14:21:12.097 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-27T14:21:12.097 INFO:teuthology.orchestra.run.smithi115.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-07-27T14:21:12.098 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-27T14:21:12.098 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-27T14:21:12.098 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-27T14:21:12.098 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-27T14:21:12.098 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-27T14:21:12.098 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-27T14:21:12.098 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-27T14:21:12.098 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-27T14:21:12.099 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-27T14:21:12.099 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-27T14:21:12.099 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-27T14:21:12.099 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-27T14:21:12.099 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-27T14:21:12.099 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-27T14:21:12.099 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-27T14:21:12.099 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-27T14:21:12.100 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-27T14:21:12.100 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-27T14:21:12.100 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:21:12.100 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2023-07-27T14:21:12.100 INFO:teuthology.orchestra.run.smithi115.stdout:==================================================================================================== 2023-07-27T14:21:12.100 INFO:teuthology.orchestra.run.smithi115.stdout:Install 123 Packages 2023-07-27T14:21:12.100 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 16 Packages 2023-07-27T14:21:12.101 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:21:12.101 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 209 M 2023-07-27T14:21:12.101 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2023-07-27T14:21:12.921 INFO:teuthology.orchestra.run.smithi115.stdout:(1/139): ceph-16.2.13-434.gcb5f5cfb.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2023-07-27T14:21:13.763 INFO:teuthology.orchestra.run.smithi115.stdout:(2/139): ceph-fuse-16.2.13-434.gcb5f5cfb.el8.x8 1.1 MB/s | 910 kB 00:00 2023-07-27T14:21:13.897 INFO:teuthology.orchestra.run.smithi115.stdout:(3/139): ceph-immutable-object-cache-16.2.13-43 1.2 MB/s | 161 kB 00:00 2023-07-27T14:21:15.406 INFO:teuthology.orchestra.run.smithi115.stdout:(4/139): ceph-mds-16.2.13-434.gcb5f5cfb.el8.x86 1.6 MB/s | 2.4 MB 00:01 2023-07-27T14:21:16.347 INFO:teuthology.orchestra.run.smithi115.stdout:(5/139): ceph-base-16.2.13-434.gcb5f5cfb.el8.x8 1.7 MB/s | 6.1 MB 00:03 2023-07-27T14:21:16.810 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - BaseOS 469 kB/s | 41 MB 01:29 2023-07-27T14:21:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:(6/139): ceph-mgr-16.2.13-434.gcb5f5cfb.el8.x86 561 kB/s | 1.6 MB 00:02 2023-07-27T14:21:21.056 INFO:teuthology.orchestra.run.smithi115.stdout:(7/139): ceph-mon-16.2.13-434.gcb5f5cfb.el8.x86 1.1 MB/s | 5.0 MB 00:04 2023-07-27T14:21:24.862 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - Extras 10 kB/s | 18 kB 00:01 2023-07-27T14:21:25.504 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.6 kB 00:00 2023-07-27T14:21:26.764 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 8 - PowerTools 5.6 MB/s | 6.3 MB 00:01 2023-07-27T14:21:28.691 INFO:teuthology.orchestra.run.smithi159.stdout:Copr repo for python3-asyncssh owned by ceph 5.7 kB/s | 3.5 kB 00:00 2023-07-27T14:21:52.265 INFO:teuthology.orchestra.run.smithi115.stdout:(8/139): ceph-radosgw-16.2.13-434.gcb5f5cfb.el8 378 kB/s | 12 MB 00:31 2023-07-27T14:21:52.398 INFO:teuthology.orchestra.run.smithi115.stdout:(9/139): ceph-selinux-16.2.13-434.gcb5f5cfb.el8 193 kB/s | 26 kB 00:00 2023-07-27T14:21:53.865 INFO:teuthology.orchestra.run.smithi115.stdout:(10/139): ceph-common-16.2.13-434.gcb5f5cfb.el8 600 kB/s | 24 MB 00:41 2023-07-27T14:21:54.090 INFO:teuthology.orchestra.run.smithi115.stdout:(11/139): cephfs-mirror-16.2.13-434.gcb5f5cfb.e 1.1 MB/s | 256 kB 00:00 2023-07-27T14:21:54.215 INFO:teuthology.orchestra.run.smithi115.stdout:(12/139): libcephfs-devel-16.2.13-434.gcb5f5cfb 205 kB/s | 25 kB 00:00 2023-07-27T14:21:54.857 INFO:teuthology.orchestra.run.smithi115.stdout:(13/139): libcephfs2-16.2.13-434.gcb5f5cfb.el8. 1.3 MB/s | 824 kB 00:00 2023-07-27T14:21:55.116 INFO:teuthology.orchestra.run.smithi115.stdout:(14/139): libcephsqlite-16.2.13-434.gcb5f5cfb.e 674 kB/s | 174 kB 00:00 2023-07-27T14:21:55.266 INFO:teuthology.orchestra.run.smithi115.stdout:(15/139): librados-devel-16.2.13-434.gcb5f5cfb. 875 kB/s | 131 kB 00:00 2023-07-27T14:21:55.658 INFO:teuthology.orchestra.run.smithi115.stdout:(16/139): libradosstriper1-16.2.13-434.gcb5f5cf 1.2 MB/s | 493 kB 00:00 2023-07-27T14:21:58.350 INFO:teuthology.orchestra.run.smithi115.stdout:(17/139): librgw2-16.2.13-434.gcb5f5cfb.el8.x86 1.4 MB/s | 3.8 MB 00:02 2023-07-27T14:21:58.509 INFO:teuthology.orchestra.run.smithi115.stdout:(18/139): python3-ceph-argparse-16.2.13-434.gcb 284 kB/s | 45 kB 00:00 2023-07-27T14:21:58.775 INFO:teuthology.orchestra.run.smithi115.stdout:(19/139): python3-ceph-common-16.2.13-434.gcb5f 370 kB/s | 99 kB 00:00 2023-07-27T14:21:59.059 INFO:teuthology.orchestra.run.smithi115.stdout:(20/139): python3-cephfs-16.2.13-434.gcb5f5cfb. 760 kB/s | 215 kB 00:00 2023-07-27T14:21:59.460 INFO:teuthology.orchestra.run.smithi115.stdout:(21/139): python3-rados-16.2.13-434.gcb5f5cfb.e 972 kB/s | 389 kB 00:00 2023-07-27T14:21:59.735 INFO:teuthology.orchestra.run.smithi115.stdout:(22/139): python3-rbd-16.2.13-434.gcb5f5cfb.el8 1.3 MB/s | 369 kB 00:00 2023-07-27T14:21:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:(23/139): python3-rgw-16.2.13-434.gcb5f5cfb.el8 687 kB/s | 114 kB 00:00 2023-07-27T14:22:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:(24/139): rbd-fuse-16.2.13-434.gcb5f5cfb.el8.x8 530 kB/s | 88 kB 00:00 2023-07-27T14:22:02.460 INFO:teuthology.orchestra.run.smithi115.stdout:(25/139): ceph-osd-16.2.13-434.gcb5f5cfb.el8.x8 425 kB/s | 18 MB 00:44 2023-07-27T14:22:03.269 INFO:teuthology.orchestra.run.smithi115.stdout:(26/139): rbd-nbd-16.2.13-434.gcb5f5cfb.el8.x86 215 kB/s | 173 kB 00:00 2023-07-27T14:22:03.419 INFO:teuthology.orchestra.run.smithi115.stdout:(27/139): ceph-grafana-dashboards-16.2.13-434.g 163 kB/s | 24 kB 00:00 2023-07-27T14:22:03.895 INFO:teuthology.orchestra.run.smithi115.stdout:(28/139): ceph-mgr-cephadm-16.2.13-434.gcb5f5cf 244 kB/s | 116 kB 00:00 2023-07-27T14:22:08.145 INFO:teuthology.orchestra.run.smithi115.stdout:(29/139): rbd-mirror-16.2.13-434.gcb5f5cfb.el8. 466 kB/s | 3.7 MB 00:08 2023-07-27T14:22:10.276 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 386 kB/s | 16 MB 00:41 2023-07-27T14:22:12.578 INFO:teuthology.orchestra.run.smithi115.stdout:(30/139): ceph-mgr-dashboard-16.2.13-434.gcb5f5 369 kB/s | 3.1 MB 00:08 2023-07-27T14:22:13.337 INFO:teuthology.orchestra.run.smithi115.stdout:(31/139): ceph-mgr-modules-core-16.2.13-434.gcb 321 kB/s | 244 kB 00:00 2023-07-27T14:22:13.495 INFO:teuthology.orchestra.run.smithi115.stdout:(32/139): ceph-mgr-rook-16.2.13-434.gcb5f5cfb.e 173 kB/s | 27 kB 00:00 2023-07-27T14:22:13.629 INFO:teuthology.orchestra.run.smithi115.stdout:(33/139): ceph-prometheus-alerts-16.2.13-434.gc 111 kB/s | 15 kB 00:00 2023-07-27T14:22:13.912 INFO:teuthology.orchestra.run.smithi115.stdout:(34/139): cephadm-16.2.13-434.gcb5f5cfb.el8.noa 297 kB/s | 84 kB 00:00 2023-07-27T14:22:13.996 INFO:teuthology.orchestra.run.smithi115.stdout:(35/139): cephfs-top-16.2.13-434.gcb5f5cfb.el8. 223 kB/s | 19 kB 00:00 2023-07-27T14:22:14.455 INFO:teuthology.orchestra.run.smithi115.stdout:(36/139): automake-1.16.1-7.el8.noarch.rpm 1.5 MB/s | 713 kB 00:00 2023-07-27T14:22:14.588 INFO:teuthology.orchestra.run.smithi115.stdout:(37/139): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2023-07-27T14:22:14.680 INFO:teuthology.orchestra.run.smithi115.stdout:(38/139): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2023-07-27T14:22:14.756 INFO:teuthology.orchestra.run.smithi115.stdout:(39/139): jq-1.6-7.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-07-27T14:22:14.768 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 388 kB/s | 24 kB 00:00 2023-07-27T14:22:14.839 INFO:teuthology.orchestra.run.smithi115.stdout:(40/139): librdkafka-0.11.4-3.el8.x86_64.rpm 4.2 MB/s | 354 kB 00:00 2023-07-27T14:22:14.981 INFO:teuthology.orchestra.run.smithi115.stdout:(41/139): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2023-07-27T14:22:15.057 INFO:teuthology.orchestra.run.smithi115.stdout:(42/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-07-27T14:22:15.182 INFO:teuthology.orchestra.run.smithi115.stdout:(43/139): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2023-07-27T14:22:15.833 INFO:teuthology.orchestra.run.smithi115.stdout:(44/139): openblas-0.3.15-4.el8.x86_64.rpm 7.3 MB/s | 4.7 MB 00:00 2023-07-27T14:22:16.741 INFO:teuthology.orchestra.run.smithi115.stdout:(45/139): openblas-threads-0.3.15-4.el8.x86_64. 5.3 MB/s | 4.9 MB 00:00 2023-07-27T14:22:18.100 INFO:teuthology.orchestra.run.smithi115.stdout:(46/139): python3-babel-2.5.1-7.el8.noarch.rpm 3.5 MB/s | 4.8 MB 00:01 2023-07-27T14:22:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:(47/139): python3-jinja2-2.10.1-3.el8.noarch.rp 2.0 MB/s | 538 kB 00:00 2023-07-27T14:22:18.467 INFO:teuthology.orchestra.run.smithi115.stdout:(48/139): python3-jsonpatch-1.21-2.el8.noarch.r 245 kB/s | 27 kB 00:00 2023-07-27T14:22:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:(49/139): python3-jsonpointer-1.10-11.el8.noarc 184 kB/s | 20 kB 00:00 2023-07-27T14:22:18.731 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-27T14:22:18.731 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-27T14:22:18.743 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-27T14:22:18.744 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-27T14:22:18.744 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-27T14:22:18.745 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-27T14:22:18.746 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-27T14:22:18.748 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-27T14:22:18.751 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-27T14:22:18.752 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-27T14:22:18.759 INFO:teuthology.orchestra.run.smithi115.stdout:(50/139): python3-mako-1.0.6-14.el8.noarch.rpm 857 kB/s | 157 kB 00:00 2023-07-27T14:22:18.860 INFO:teuthology.orchestra.run.smithi115.stdout:(51/139): python3-markupsafe-0.23-19.el8.x86_64 389 kB/s | 39 kB 00:00 2023-07-27T14:22:18.941 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2023-07-27T14:22:18.954 INFO:teuthology.orchestra.run.smithi159.stdout:==================================================================================================== 2023-07-27T14:22:18.955 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2023-07-27T14:22:18.955 INFO:teuthology.orchestra.run.smithi159.stdout:==================================================================================================== 2023-07-27T14:22:18.955 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2023-07-27T14:22:18.955 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-27T14:22:18.955 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 6.4 k 2023-07-27T14:22:18.955 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 6.1 M 2023-07-27T14:22:18.956 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 910 k 2023-07-27T14:22:18.956 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 161 k 2023-07-27T14:22:18.956 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 1.6 M 2023-07-27T14:22:18.956 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 116 k 2023-07-27T14:22:18.956 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 3.1 M 2023-07-27T14:22:18.956 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 8.6 M 2023-07-27T14:22:18.957 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 27 k 2023-07-27T14:22:18.957 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 12 M 2023-07-27T14:22:18.957 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 51 M 2023-07-27T14:22:18.957 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 84 k 2023-07-27T14:22:18.957 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 256 k 2023-07-27T14:22:18.957 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 19 k 2023-07-27T14:22:18.957 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-27T14:22:18.957 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-27T14:22:18.958 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-27T14:22:18.958 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 25 k 2023-07-27T14:22:18.958 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 824 k 2023-07-27T14:22:18.958 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 131 k 2023-07-27T14:22:18.958 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-27T14:22:18.958 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-27T14:22:18.958 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-27T14:22:18.959 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 215 k 2023-07-27T14:22:18.959 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 389 k 2023-07-27T14:22:18.959 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 369 k 2023-07-27T14:22:18.959 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 114 k 2023-07-27T14:22:18.959 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 88 k 2023-07-27T14:22:18.959 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 3.7 M 2023-07-27T14:22:18.959 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 173 k 2023-07-27T14:22:18.959 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-27T14:22:18.960 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2023-07-27T14:22:18.960 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-27T14:22:18.960 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-27T14:22:18.960 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-27T14:22:18.960 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-27T14:22:18.960 INFO:teuthology.orchestra.run.smithi159.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-27T14:22:18.960 INFO:teuthology.orchestra.run.smithi159.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-27T14:22:18.961 INFO:teuthology.orchestra.run.smithi159.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-27T14:22:18.961 INFO:teuthology.orchestra.run.smithi159.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-27T14:22:18.961 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 3.7 M 2023-07-27T14:22:18.961 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 4.2 M 2023-07-27T14:22:18.961 INFO:teuthology.orchestra.run.smithi159.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-27T14:22:18.962 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-27T14:22:18.962 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-27T14:22:18.962 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-27T14:22:18.962 INFO:teuthology.orchestra.run.smithi159.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-27T14:22:18.962 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-27T14:22:18.962 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2023-07-27T14:22:18.962 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-27T14:22:18.962 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 24 M 2023-07-27T14:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 24 k 2023-07-27T14:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 2.4 M 2023-07-27T14:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 244 k 2023-07-27T14:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 5.0 M 2023-07-27T14:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 18 M 2023-07-27T14:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:16.2.13-434.gcb5f5cfb.el8 ceph-noarch 15 k 2023-07-27T14:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 26 k 2023-07-27T14:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-27T14:22:18.964 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-27T14:22:18.964 INFO:teuthology.orchestra.run.smithi159.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-27T14:22:18.964 INFO:teuthology.orchestra.run.smithi159.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-27T14:22:18.964 INFO:teuthology.orchestra.run.smithi159.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-27T14:22:18.964 INFO:teuthology.orchestra.run.smithi159.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-07-27T14:22:18.964 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 174 k 2023-07-27T14:22:18.964 INFO:teuthology.orchestra.run.smithi159.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-27T14:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-27T14:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-27T14:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-27T14:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-27T14:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 493 k 2023-07-27T14:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-27T14:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 3.8 M 2023-07-27T14:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-27T14:22:18.966 INFO:teuthology.orchestra.run.smithi159.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-27T14:22:18.966 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-27T14:22:18.966 INFO:teuthology.orchestra.run.smithi159.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-27T14:22:18.966 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-27T14:22:18.966 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-27T14:22:18.966 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-27T14:22:18.966 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-27T14:22:18.966 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-27T14:22:18.967 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-27T14:22:18.967 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-27T14:22:18.967 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-27T14:22:18.967 INFO:teuthology.orchestra.run.smithi159.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-07-27T14:22:18.967 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-27T14:22:18.967 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-27T14:22:18.967 INFO:teuthology.orchestra.run.smithi159.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-27T14:22:18.968 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-27T14:22:18.968 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 45 k 2023-07-27T14:22:18.968 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:16.2.13-434.gcb5f5cfb.el8 ceph 99 k 2023-07-27T14:22:18.968 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-27T14:22:18.968 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-27T14:22:18.968 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-27T14:22:18.969 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-27T14:22:18.969 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-27T14:22:18.969 INFO:teuthology.orchestra.run.smithi159.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-07-27T14:22:18.969 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-27T14:22:18.969 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-27T14:22:18.969 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-27T14:22:18.969 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-27T14:22:18.969 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-27T14:22:18.970 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-27T14:22:18.970 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-27T14:22:18.970 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-27T14:22:18.970 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-27T14:22:18.970 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-27T14:22:18.970 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-27T14:22:18.970 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-27T14:22:18.970 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-27T14:22:18.971 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-27T14:22:18.971 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-27T14:22:18.971 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-27T14:22:18.971 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-27T14:22:18.971 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-27T14:22:18.971 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-27T14:22:18.971 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-27T14:22:18.971 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-27T14:22:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-27T14:22:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-27T14:22:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-07-27T14:22:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-27T14:22:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-27T14:22:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-27T14:22:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-27T14:22:18.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-27T14:22:18.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-27T14:22:18.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-27T14:22:18.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-27T14:22:18.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-27T14:22:18.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-27T14:22:18.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-27T14:22:18.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-27T14:22:18.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-27T14:22:18.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-27T14:22:18.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-27T14:22:18.974 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-27T14:22:18.974 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-27T14:22:18.974 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-27T14:22:18.974 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:22:18.974 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2023-07-27T14:22:18.975 INFO:teuthology.orchestra.run.smithi159.stdout:==================================================================================================== 2023-07-27T14:22:18.975 INFO:teuthology.orchestra.run.smithi159.stdout:Install 123 Packages 2023-07-27T14:22:18.975 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 16 Packages 2023-07-27T14:22:18.975 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:22:18.976 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 209 M 2023-07-27T14:22:18.976 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2023-07-27T14:22:19.735 INFO:teuthology.orchestra.run.smithi115.stdout:(52/139): python3-numpy-1.14.3-10.el8.x86_64.rp 4.3 MB/s | 3.7 MB 00:00 2023-07-27T14:22:19.827 INFO:teuthology.orchestra.run.smithi115.stdout:(53/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-07-27T14:22:19.919 INFO:teuthology.orchestra.run.smithi115.stdout:(54/139): python3-prettytable-0.7.2-14.el8.noar 480 kB/s | 44 kB 00:00 2023-07-27T14:22:20.044 INFO:teuthology.orchestra.run.smithi115.stdout:(55/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 828 kB/s | 103 kB 00:00 2023-07-27T14:22:20.153 INFO:teuthology.orchestra.run.smithi115.stdout:(56/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-07-27T14:22:20.237 INFO:teuthology.orchestra.run.smithi159.stdout:(1/139): ceph-16.2.13-434.gcb5f5cfb.el8.x86_64. 16 kB/s | 6.4 kB 00:00 2023-07-27T14:22:20.262 INFO:teuthology.orchestra.run.smithi115.stdout:(57/139): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-07-27T14:22:20.370 INFO:teuthology.orchestra.run.smithi115.stdout:(58/139): python3-pytz-2017.2-9.el8.noarch.rpm 502 kB/s | 54 kB 00:00 2023-07-27T14:22:21.695 INFO:teuthology.orchestra.run.smithi159.stdout:(2/139): ceph-fuse-16.2.13-434.gcb5f5cfb.el8.x8 624 kB/s | 910 kB 00:01 2023-07-27T14:22:22.379 INFO:teuthology.orchestra.run.smithi159.stdout:(3/139): ceph-immutable-object-cache-16.2.13-43 236 kB/s | 161 kB 00:00 2023-07-27T14:22:27.979 INFO:teuthology.orchestra.run.smithi159.stdout:(4/139): ceph-mds-16.2.13-434.gcb5f5cfb.el8.x86 447 kB/s | 2.4 MB 00:05 2023-07-27T14:22:30.380 INFO:teuthology.orchestra.run.smithi159.stdout:(5/139): ceph-mgr-16.2.13-434.gcb5f5cfb.el8.x86 685 kB/s | 1.6 MB 00:02 2023-07-27T14:22:32.978 INFO:teuthology.orchestra.run.smithi115.stdout:(59/139): ceph-mgr-diskprediction-local-16.2.13 354 kB/s | 8.6 MB 00:24 2023-07-27T14:22:33.287 INFO:teuthology.orchestra.run.smithi115.stdout:(60/139): python3-werkzeug-0.12.2-4.el8.noarch. 1.5 MB/s | 457 kB 00:00 2023-07-27T14:22:33.544 INFO:teuthology.orchestra.run.smithi115.stdout:(61/139): socat-1.7.4.1-1.el8.x86_64.rpm 1.2 MB/s | 323 kB 00:00 2023-07-27T14:22:33.637 INFO:teuthology.orchestra.run.smithi115.stdout:(62/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 758 kB/s | 71 kB 00:00 2023-07-27T14:22:34.004 INFO:teuthology.orchestra.run.smithi115.stdout:(63/139): elfutils-libelf-devel-0.189-2.el8.x86 168 kB/s | 61 kB 00:00 2023-07-27T14:22:34.271 INFO:teuthology.orchestra.run.smithi115.stdout:(64/139): python3-scipy-1.0.0-21.module_el8.5.0 1.0 MB/s | 14 MB 00:13 2023-07-27T14:22:34.297 INFO:teuthology.orchestra.run.smithi115.stdout:(65/139): fuse-2.9.7-17.el8.x86_64.rpm 284 kB/s | 83 kB 00:00 2023-07-27T14:22:34.397 INFO:teuthology.orchestra.run.smithi159.stdout:(6/139): ceph-base-16.2.13-434.gcb5f5cfb.el8.x8 426 kB/s | 6.1 MB 00:14 2023-07-27T14:22:34.722 INFO:teuthology.orchestra.run.smithi115.stdout:(66/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 107 kB/s | 48 kB 00:00 2023-07-27T14:22:34.881 INFO:teuthology.orchestra.run.smithi115.stdout:(67/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 118 kB/s | 19 kB 00:00 2023-07-27T14:22:35.131 INFO:teuthology.orchestra.run.smithi115.stdout:(68/139): libcom_err-devel-1.45.6-5.el8.x86_64. 155 kB/s | 39 kB 00:00 2023-07-27T14:22:35.806 INFO:teuthology.orchestra.run.smithi115.stdout:(69/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 372 kB/s | 561 kB 00:01 2023-07-27T14:22:36.156 INFO:teuthology.orchestra.run.smithi115.stdout:(70/139): libquadmath-8.5.0-20.el8.x86_64.rpm 493 kB/s | 172 kB 00:00 2023-07-27T14:22:36.340 INFO:teuthology.orchestra.run.smithi115.stdout:(71/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 256 kB/s | 47 kB 00:00 2023-07-27T14:22:36.815 INFO:teuthology.orchestra.run.smithi115.stdout:(72/139): libselinux-devel-2.9-8.el8.x86_64.rpm 422 kB/s | 200 kB 00:00 2023-07-27T14:22:37.074 INFO:teuthology.orchestra.run.smithi115.stdout:(73/139): libsepol-devel-2.9-3.el8.x86_64.rpm 337 kB/s | 87 kB 00:00 2023-07-27T14:22:37.316 INFO:teuthology.orchestra.run.smithi115.stdout:(74/139): libuuid-devel-2.32.1-42.el8.x86_64.rp 411 kB/s | 99 kB 00:00 2023-07-27T14:22:37.416 INFO:teuthology.orchestra.run.smithi115.stdout:(75/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 181 kB/s | 18 kB 00:00 2023-07-27T14:22:37.525 INFO:teuthology.orchestra.run.smithi115.stdout:(76/139): libgfortran-8.5.0-20.el8.x86_64.rpm 270 kB/s | 645 kB 00:02 2023-07-27T14:22:37.575 INFO:teuthology.orchestra.run.smithi115.stdout:(77/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 276 kB/s | 44 kB 00:00 2023-07-27T14:22:39.058 INFO:teuthology.orchestra.run.smithi115.stdout:(78/139): pcre2-devel-10.32-3.el8.x86_64.rpm 408 kB/s | 605 kB 00:01 2023-07-27T14:22:39.609 INFO:teuthology.orchestra.run.smithi115.stdout:(79/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 416 kB/s | 229 kB 00:00 2023-07-27T14:22:40.151 INFO:teuthology.orchestra.run.smithi115.stdout:(80/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 407 kB/s | 220 kB 00:00 2023-07-27T14:22:41.093 INFO:teuthology.orchestra.run.smithi115.stdout:(81/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 264 kB/s | 249 kB 00:00 2023-07-27T14:22:41.364 INFO:teuthology.orchestra.run.smithi159.stdout:(7/139): ceph-mon-16.2.13-434.gcb5f5cfb.el8.x86 468 kB/s | 5.0 MB 00:10 2023-07-27T14:22:43.993 INFO:teuthology.orchestra.run.smithi115.stdout:(82/139): python3-cryptography-3.2.1-6.el8.x86_ 221 kB/s | 641 kB 00:02 2023-07-27T14:22:44.235 INFO:teuthology.orchestra.run.smithi115.stdout:(83/139): python3-jwt-1.6.1-2.el8.noarch.rpm 176 kB/s | 43 kB 00:00 2023-07-27T14:22:44.827 INFO:teuthology.orchestra.run.smithi115.stdout:(84/139): python3-oauthlib-2.1.0-1.el8.noarch.r 262 kB/s | 155 kB 00:00 2023-07-27T14:22:45.227 INFO:teuthology.orchestra.run.smithi115.stdout:(85/139): python3-pycparser-2.14-14.el8.noarch. 273 kB/s | 109 kB 00:00 2023-07-27T14:22:45.410 INFO:teuthology.orchestra.run.smithi115.stdout:(86/139): python3-requests-oauthlib-1.0.0-1.el8 232 kB/s | 43 kB 00:00 2023-07-27T14:22:45.744 INFO:teuthology.orchestra.run.smithi115.stdout:(87/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 224 kB/s | 74 kB 00:00 2023-07-27T14:22:45.994 INFO:teuthology.orchestra.run.smithi115.stdout:(88/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 232 kB/s | 58 kB 00:00 2023-07-27T14:22:46.761 INFO:teuthology.orchestra.run.smithi115.stdout:(89/139): gperftools-libs-2.7-9.el8.x86_64.rpm 399 kB/s | 306 kB 00:00 2023-07-27T14:22:47.053 INFO:teuthology.orchestra.run.smithi115.stdout:(90/139): leveldb-1.22-1.el8.x86_64.rpm 621 kB/s | 181 kB 00:00 2023-07-27T14:22:47.128 INFO:teuthology.orchestra.run.smithi115.stdout:(91/139): liboath-2.6.2-3.el8.x86_64.rpm 787 kB/s | 59 kB 00:00 2023-07-27T14:22:47.295 INFO:teuthology.orchestra.run.smithi115.stdout:(92/139): libunwind-1.3.1-3.el8.x86_64.rpm 451 kB/s | 75 kB 00:00 2023-07-27T14:22:47.396 INFO:teuthology.orchestra.run.smithi115.stdout:(93/139): python3-apipkg-1.5-6.el8.noarch.rpm 212 kB/s | 21 kB 00:00 2023-07-27T14:22:47.505 INFO:teuthology.orchestra.run.smithi115.stdout:(94/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-07-27T14:22:47.722 INFO:teuthology.orchestra.run.smithi115.stdout:(95/139): python3-beautifulsoup4-4.6.3-2.el8.1. 855 kB/s | 185 kB 00:00 2023-07-27T14:22:47.847 INFO:teuthology.orchestra.run.smithi115.stdout:(96/139): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2023-07-27T14:22:47.964 INFO:teuthology.orchestra.run.smithi115.stdout:(97/139): python3-certifi-2018.10.15-7.el8.noar 140 kB/s | 16 kB 00:00 2023-07-27T14:22:48.248 INFO:teuthology.orchestra.run.smithi115.stdout:(98/139): python3-cheroot-8.5.2-1.el8.noarch.rp 609 kB/s | 173 kB 00:00 2023-07-27T14:22:48.606 INFO:teuthology.orchestra.run.smithi115.stdout:(99/139): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2023-07-27T14:22:48.973 INFO:teuthology.orchestra.run.smithi115.stdout:(100/139): python3-execnet-1.7.1-1.el8.noarch.r 970 kB/s | 355 kB 00:00 2023-07-27T14:22:49.073 INFO:teuthology.orchestra.run.smithi115.stdout:(101/139): python3-google-auth-1.1.1-10.el8.noa 813 kB/s | 81 kB 00:00 2023-07-27T14:22:49.199 INFO:teuthology.orchestra.run.smithi115.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-07-27T14:22:49.349 INFO:teuthology.orchestra.run.smithi115.stdout:(103/139): python3-jaraco-functools-2.0-4.el8.n 117 kB/s | 18 kB 00:00 2023-07-27T14:22:50.291 INFO:teuthology.orchestra.run.smithi115.stdout:(104/139): openssl-devel-1.1.1k-9.el8.x86_64.rp 255 kB/s | 3.2 MB 00:12 2023-07-27T14:22:50.925 INFO:teuthology.orchestra.run.smithi115.stdout:(105/139): python3-kubernetes-11.0.0-6.el8.noar 758 kB/s | 1.2 MB 00:01 2023-07-27T14:22:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:(106/139): python3-logutils-0.3.5-11.el8.noarch 64 kB/s | 49 kB 00:00 2023-07-27T14:22:51.125 INFO:teuthology.orchestra.run.smithi115.stdout:(107/139): python3-more-itertools-7.2.0-3.el8.n 293 kB/s | 59 kB 00:00 2023-07-27T14:22:51.251 INFO:teuthology.orchestra.run.smithi115.stdout:(108/139): python3-portend-2.6-1.el8.noarch.rpm 125 kB/s | 16 kB 00:00 2023-07-27T14:22:51.376 INFO:teuthology.orchestra.run.smithi115.stdout:(109/139): python3-remoto-1.2.1-1.el8.noarch.rp 392 kB/s | 49 kB 00:00 2023-07-27T14:22:51.509 INFO:teuthology.orchestra.run.smithi115.stdout:(110/139): python3-repoze-lru-0.7-6.el8.noarch. 252 kB/s | 34 kB 00:00 2023-07-27T14:22:51.959 INFO:teuthology.orchestra.run.smithi115.stdout:(111/139): python3-routes-2.4.1-12.el8.noarch.r 437 kB/s | 196 kB 00:00 2023-07-27T14:22:52.185 INFO:teuthology.orchestra.run.smithi115.stdout:(112/139): python3-rsa-4.9-2.el8.noarch.rpm 285 kB/s | 64 kB 00:00 2023-07-27T14:22:52.327 INFO:teuthology.orchestra.run.smithi115.stdout:(113/139): python3-simplegeneric-0.8.1-17.el8.n 132 kB/s | 19 kB 00:00 2023-07-27T14:22:52.469 INFO:teuthology.orchestra.run.smithi115.stdout:(114/139): python3-singledispatch-3.4.0.3-18.el 169 kB/s | 24 kB 00:00 2023-07-27T14:22:53.094 INFO:teuthology.orchestra.run.smithi115.stdout:(115/139): python3-pecan-1.3.2-9.el8.noarch.rpm 139 kB/s | 283 kB 00:02 2023-07-27T14:22:53.286 INFO:teuthology.orchestra.run.smithi115.stdout:(116/139): python3-tempora-1.14.1-5.el8.noarch. 36 kB/s | 29 kB 00:00 2023-07-27T14:22:53.361 INFO:teuthology.orchestra.run.smithi115.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 103 kB/s | 27 kB 00:00 2023-07-27T14:22:54.403 INFO:teuthology.orchestra.run.smithi115.stdout:(118/139): python3-waitress-1.4.3-1.el8.noarch. 229 kB/s | 255 kB 00:01 2023-07-27T14:22:54.554 INFO:teuthology.orchestra.run.smithi115.stdout:(119/139): python3-websocket-client-0.56.0-5.el 408 kB/s | 61 kB 00:00 2023-07-27T14:22:54.845 INFO:teuthology.orchestra.run.smithi115.stdout:(120/139): python3-webtest-2.0.33-1.el8.noarch. 293 kB/s | 85 kB 00:00 2023-07-27T14:22:54.956 INFO:teuthology.orchestra.run.smithi115.stdout:(121/139): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-07-27T14:22:55.563 INFO:teuthology.orchestra.run.smithi115.stdout:(122/139): python3-webob-1.8.5-1.el8.1.noarch.r 114 kB/s | 251 kB 00:02 2023-07-27T14:22:58.798 INFO:teuthology.orchestra.run.smithi159.stdout:(8/139): ceph-radosgw-16.2.13-434.gcb5f5cfb.el8 677 kB/s | 12 MB 00:17 2023-07-27T14:22:59.248 INFO:teuthology.orchestra.run.smithi159.stdout:(9/139): ceph-selinux-16.2.13-434.gcb5f5cfb.el8 57 kB/s | 26 kB 00:00 2023-07-27T14:23:00.446 INFO:teuthology.orchestra.run.smithi115.stdout:(123/139): librados2-16.2.13-434.gcb5f5cfb.el8. 698 kB/s | 3.7 MB 00:05 2023-07-27T14:23:00.515 INFO:teuthology.orchestra.run.smithi159.stdout:(10/139): ceph-common-16.2.13-434.gcb5f5cfb.el8 608 kB/s | 24 MB 00:40 2023-07-27T14:23:00.815 INFO:teuthology.orchestra.run.smithi159.stdout:(11/139): cephfs-mirror-16.2.13-434.gcb5f5cfb.e 857 kB/s | 256 kB 00:00 2023-07-27T14:23:00.923 INFO:teuthology.orchestra.run.smithi159.stdout:(12/139): libcephfs-devel-16.2.13-434.gcb5f5cfb 236 kB/s | 25 kB 00:00 2023-07-27T14:23:01.047 INFO:teuthology.orchestra.run.smithi115.stdout:(124/139): NetworkManager-initscripts-updown-1. 240 kB/s | 143 kB 00:00 2023-07-27T14:23:01.214 INFO:teuthology.orchestra.run.smithi115.stdout:(125/139): elfutils-debuginfod-client-0.189-2.e 456 kB/s | 76 kB 00:00 2023-07-27T14:23:01.599 INFO:teuthology.orchestra.run.smithi159.stdout:(13/139): libcephfs2-16.2.13-434.gcb5f5cfb.el8. 1.2 MB/s | 824 kB 00:00 2023-07-27T14:23:01.766 INFO:teuthology.orchestra.run.smithi159.stdout:(14/139): libcephsqlite-16.2.13-434.gcb5f5cfb.e 1.0 MB/s | 174 kB 00:00 2023-07-27T14:23:01.772 INFO:teuthology.orchestra.run.smithi115.stdout:(126/139): elfutils-libelf-0.189-2.el8.x86_64.r 415 kB/s | 232 kB 00:00 2023-07-27T14:23:01.900 INFO:teuthology.orchestra.run.smithi159.stdout:(15/139): librados-devel-16.2.13-434.gcb5f5cfb. 983 kB/s | 131 kB 00:00 2023-07-27T14:23:02.147 INFO:teuthology.orchestra.run.smithi115.stdout:(127/139): elfutils-libs-0.189-2.el8.x86_64.rpm 807 kB/s | 302 kB 00:00 2023-07-27T14:23:02.341 INFO:teuthology.orchestra.run.smithi159.stdout:(16/139): libradosstriper1-16.2.13-434.gcb5f5cf 1.1 MB/s | 493 kB 00:00 2023-07-27T14:23:02.623 INFO:teuthology.orchestra.run.smithi115.stdout:(128/139): librbd1-16.2.13-434.gcb5f5cfb.el8.x8 606 kB/s | 4.2 MB 00:07 2023-07-27T14:23:03.047 INFO:teuthology.orchestra.run.smithi115.stdout:(129/139): libblkid-2.32.1-42.el8.x86_64.rpm 520 kB/s | 220 kB 00:00 2023-07-27T14:23:03.165 INFO:teuthology.orchestra.run.smithi115.stdout:(130/139): iproute-6.2.0-2.el8.x86_64.rpm 866 kB/s | 880 kB 00:01 2023-07-27T14:23:03.398 INFO:teuthology.orchestra.run.smithi115.stdout:(131/139): libfdisk-2.32.1-42.el8.x86_64.rpm 722 kB/s | 253 kB 00:00 2023-07-27T14:23:03.490 INFO:teuthology.orchestra.run.smithi115.stdout:(132/139): libmount-2.32.1-42.el8.x86_64.rpm 727 kB/s | 236 kB 00:00 2023-07-27T14:23:03.607 INFO:teuthology.orchestra.run.smithi115.stdout:(133/139): libsmartcols-2.32.1-42.el8.x86_64.rp 860 kB/s | 179 kB 00:00 2023-07-27T14:23:03.682 INFO:teuthology.orchestra.run.smithi115.stdout:(134/139): libuuid-2.32.1-42.el8.x86_64.rpm 514 kB/s | 98 kB 00:00 2023-07-27T14:23:03.891 INFO:teuthology.orchestra.run.smithi115.stdout:(135/139): util-linux-user-2.32.1-42.el8.x86_64 491 kB/s | 102 kB 00:00 2023-07-27T14:23:04.466 INFO:teuthology.orchestra.run.smithi115.stdout:(136/139): xfsdump-3.1.8-6.el8.x86_64.rpm 581 kB/s | 334 kB 00:00 2023-07-27T14:23:05.308 INFO:teuthology.orchestra.run.smithi115.stdout:(137/139): util-linux-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 2.6 MB 00:01 2023-07-27T14:23:05.792 INFO:teuthology.orchestra.run.smithi115.stdout:(138/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 836 kB/s | 1.1 MB 00:01 2023-07-27T14:23:06.794 INFO:teuthology.orchestra.run.smithi159.stdout:(17/139): librgw2-16.2.13-434.gcb5f5cfb.el8.x86 867 kB/s | 3.8 MB 00:04 2023-07-27T14:23:07.084 INFO:teuthology.orchestra.run.smithi159.stdout:(18/139): ceph-osd-16.2.13-434.gcb5f5cfb.el8.x8 573 kB/s | 18 MB 00:32 2023-07-27T14:23:07.101 INFO:teuthology.orchestra.run.smithi159.stdout:(19/139): python3-ceph-argparse-16.2.13-434.gcb 145 kB/s | 45 kB 00:00 2023-07-27T14:23:07.243 INFO:teuthology.orchestra.run.smithi159.stdout:(20/139): python3-ceph-common-16.2.13-434.gcb5f 623 kB/s | 99 kB 00:00 2023-07-27T14:23:07.418 INFO:teuthology.orchestra.run.smithi159.stdout:(21/139): python3-cephfs-16.2.13-434.gcb5f5cfb. 679 kB/s | 215 kB 00:00 2023-07-27T14:23:07.769 INFO:teuthology.orchestra.run.smithi159.stdout:(22/139): python3-rados-16.2.13-434.gcb5f5cfb.e 741 kB/s | 389 kB 00:00 2023-07-27T14:23:07.819 INFO:teuthology.orchestra.run.smithi159.stdout:(23/139): python3-rbd-16.2.13-434.gcb5f5cfb.el8 923 kB/s | 369 kB 00:00 2023-07-27T14:23:07.936 INFO:teuthology.orchestra.run.smithi159.stdout:(24/139): python3-rgw-16.2.13-434.gcb5f5cfb.el8 685 kB/s | 114 kB 00:00 2023-07-27T14:23:07.978 INFO:teuthology.orchestra.run.smithi159.stdout:(25/139): rbd-fuse-16.2.13-434.gcb5f5cfb.el8.x8 556 kB/s | 88 kB 00:00 2023-07-27T14:23:08.278 INFO:teuthology.orchestra.run.smithi159.stdout:(26/139): rbd-nbd-16.2.13-434.gcb5f5cfb.el8.x86 578 kB/s | 173 kB 00:00 2023-07-27T14:23:08.687 INFO:teuthology.orchestra.run.smithi159.stdout:(27/139): ceph-grafana-dashboards-16.2.13-434.g 60 kB/s | 24 kB 00:00 2023-07-27T14:23:09.070 INFO:teuthology.orchestra.run.smithi159.stdout:(28/139): ceph-mgr-cephadm-16.2.13-434.gcb5f5cf 303 kB/s | 116 kB 00:00 2023-07-27T14:23:14.846 INFO:teuthology.orchestra.run.smithi159.stdout:(29/139): ceph-mgr-dashboard-16.2.13-434.gcb5f5 554 kB/s | 3.1 MB 00:05 2023-07-27T14:23:15.055 INFO:teuthology.orchestra.run.smithi159.stdout:(30/139): rbd-mirror-16.2.13-434.gcb5f5cfb.el8. 528 kB/s | 3.7 MB 00:07 2023-07-27T14:23:15.438 INFO:teuthology.orchestra.run.smithi159.stdout:(31/139): ceph-mgr-modules-core-16.2.13-434.gcb 636 kB/s | 244 kB 00:00 2023-07-27T14:23:15.531 INFO:teuthology.orchestra.run.smithi159.stdout:(32/139): ceph-mgr-rook-16.2.13-434.gcb5f5cfb.e 299 kB/s | 27 kB 00:00 2023-07-27T14:23:15.622 INFO:teuthology.orchestra.run.smithi159.stdout:(33/139): ceph-prometheus-alerts-16.2.13-434.gc 162 kB/s | 15 kB 00:00 2023-07-27T14:23:15.773 INFO:teuthology.orchestra.run.smithi159.stdout:(34/139): cephadm-16.2.13-434.gcb5f5cfb.el8.noa 562 kB/s | 84 kB 00:00 2023-07-27T14:23:15.865 INFO:teuthology.orchestra.run.smithi159.stdout:(35/139): cephfs-top-16.2.13-434.gcb5f5cfb.el8. 203 kB/s | 19 kB 00:00 2023-07-27T14:23:16.790 INFO:teuthology.orchestra.run.smithi159.stdout:(36/139): automake-1.16.1-7.el8.noarch.rpm 772 kB/s | 713 kB 00:00 2023-07-27T14:23:17.199 INFO:teuthology.orchestra.run.smithi159.stdout:(37/139): bison-3.0.4-10.el8.x86_64.rpm 1.6 MB/s | 688 kB 00:00 2023-07-27T14:23:17.374 INFO:teuthology.orchestra.run.smithi159.stdout:(38/139): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-07-27T14:23:17.508 INFO:teuthology.orchestra.run.smithi159.stdout:(39/139): jq-1.6-7.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-07-27T14:23:17.708 INFO:teuthology.orchestra.run.smithi159.stdout:(40/139): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-07-27T14:23:17.933 INFO:teuthology.orchestra.run.smithi159.stdout:(41/139): libtool-2.4.6-25.el8.x86_64.rpm 3.1 MB/s | 709 kB 00:00 2023-07-27T14:23:18.042 INFO:teuthology.orchestra.run.smithi159.stdout:(42/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-07-27T14:23:18.126 INFO:teuthology.orchestra.run.smithi159.stdout:(43/139): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-07-27T14:23:18.976 INFO:teuthology.orchestra.run.smithi159.stdout:(44/139): openblas-0.3.15-4.el8.x86_64.rpm 5.6 MB/s | 4.7 MB 00:00 2023-07-27T14:23:19.584 INFO:teuthology.orchestra.run.smithi159.stdout:(45/139): openblas-threads-0.3.15-4.el8.x86_64. 8.0 MB/s | 4.9 MB 00:00 2023-07-27T14:23:20.427 INFO:teuthology.orchestra.run.smithi159.stdout:(46/139): python3-babel-2.5.1-7.el8.noarch.rpm 5.7 MB/s | 4.8 MB 00:00 2023-07-27T14:23:20.577 INFO:teuthology.orchestra.run.smithi159.stdout:(47/139): python3-jinja2-2.10.1-3.el8.noarch.rp 3.5 MB/s | 538 kB 00:00 2023-07-27T14:23:20.661 INFO:teuthology.orchestra.run.smithi159.stdout:(48/139): python3-jsonpatch-1.21-2.el8.noarch.r 318 kB/s | 27 kB 00:00 2023-07-27T14:23:20.728 INFO:teuthology.orchestra.run.smithi159.stdout:(49/139): python3-jsonpointer-1.10-11.el8.noarc 299 kB/s | 20 kB 00:00 2023-07-27T14:23:21.161 INFO:teuthology.orchestra.run.smithi159.stdout:(50/139): python3-mako-1.0.6-14.el8.noarch.rpm 362 kB/s | 157 kB 00:00 2023-07-27T14:23:21.245 INFO:teuthology.orchestra.run.smithi159.stdout:(51/139): python3-markupsafe-0.23-19.el8.x86_64 466 kB/s | 39 kB 00:00 2023-07-27T14:23:22.221 INFO:teuthology.orchestra.run.smithi159.stdout:(52/139): python3-numpy-1.14.3-10.el8.x86_64.rp 3.8 MB/s | 3.7 MB 00:00 2023-07-27T14:23:22.346 INFO:teuthology.orchestra.run.smithi159.stdout:(53/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-07-27T14:23:22.413 INFO:teuthology.orchestra.run.smithi159.stdout:(54/139): python3-prettytable-0.7.2-14.el8.noar 655 kB/s | 44 kB 00:00 2023-07-27T14:23:22.713 INFO:teuthology.orchestra.run.smithi159.stdout:(55/139): ceph-mgr-diskprediction-local-16.2.13 1.1 MB/s | 8.6 MB 00:07 2023-07-27T14:23:22.738 INFO:teuthology.orchestra.run.smithi159.stdout:(56/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 318 kB/s | 103 kB 00:00 2023-07-27T14:23:22.839 INFO:teuthology.orchestra.run.smithi159.stdout:(57/139): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-07-27T14:23:22.939 INFO:teuthology.orchestra.run.smithi159.stdout:(58/139): python3-pytz-2017.2-9.el8.noarch.rpm 543 kB/s | 54 kB 00:00 2023-07-27T14:23:22.981 INFO:teuthology.orchestra.run.smithi159.stdout:(59/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 473 kB/s | 126 kB 00:00 2023-07-27T14:23:23.398 INFO:teuthology.orchestra.run.smithi159.stdout:(60/139): python3-werkzeug-0.12.2-4.el8.noarch. 1.1 MB/s | 457 kB 00:00 2023-07-27T14:23:23.649 INFO:teuthology.orchestra.run.smithi159.stdout:(61/139): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2023-07-27T14:23:23.924 INFO:teuthology.orchestra.run.smithi159.stdout:(62/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 257 kB/s | 71 kB 00:00 2023-07-27T14:23:24.424 INFO:teuthology.orchestra.run.smithi159.stdout:(63/139): elfutils-libelf-devel-0.189-2.el8.x86 123 kB/s | 61 kB 00:00 2023-07-27T14:23:24.758 INFO:teuthology.orchestra.run.smithi159.stdout:(64/139): fuse-2.9.7-17.el8.x86_64.rpm 249 kB/s | 83 kB 00:00 2023-07-27T14:23:24.967 INFO:teuthology.orchestra.run.smithi159.stdout:(65/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 231 kB/s | 48 kB 00:00 2023-07-27T14:23:26.591 INFO:teuthology.orchestra.run.smithi115.stdout:(139/139): ceph-test-16.2.13-434.gcb5f5cfb.el8. 558 kB/s | 51 MB 01:34 2023-07-27T14:23:26.594 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2023-07-27T14:23:26.594 INFO:teuthology.orchestra.run.smithi115.stdout:Total 1.6 MB/s | 209 MB 02:14 2023-07-27T14:23:26.852 INFO:teuthology.orchestra.run.smithi159.stdout:(66/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 297 kB/s | 561 kB 00:01 2023-07-27T14:23:27.025 INFO:teuthology.orchestra.run.smithi159.stdout:(67/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 108 kB/s | 19 kB 00:00 2023-07-27T14:23:27.284 INFO:teuthology.orchestra.run.smithi159.stdout:(68/139): libcom_err-devel-1.45.6-5.el8.x86_64. 150 kB/s | 39 kB 00:00 2023-07-27T14:23:28.262 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2023-07-27T14:23:28.676 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2023-07-27T14:23:28.676 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2023-07-27T14:23:30.171 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2023-07-27T14:23:30.174 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2023-07-27T14:23:30.593 INFO:teuthology.orchestra.run.smithi159.stdout:(69/139): libgfortran-8.5.0-20.el8.x86_64.rpm 195 kB/s | 645 kB 00:03 2023-07-27T14:23:31.693 INFO:teuthology.orchestra.run.smithi159.stdout:(70/139): libquadmath-8.5.0-20.el8.x86_64.rpm 157 kB/s | 172 kB 00:01 2023-07-27T14:23:31.968 INFO:teuthology.orchestra.run.smithi159.stdout:(71/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 171 kB/s | 47 kB 00:00 2023-07-27T14:23:33.569 INFO:teuthology.orchestra.run.smithi159.stdout:(72/139): libselinux-devel-2.9-8.el8.x86_64.rpm 125 kB/s | 200 kB 00:01 2023-07-27T14:23:34.169 INFO:teuthology.orchestra.run.smithi159.stdout:(73/139): libsepol-devel-2.9-3.el8.x86_64.rpm 145 kB/s | 87 kB 00:00 2023-07-27T14:23:35.328 INFO:teuthology.orchestra.run.smithi159.stdout:(74/139): libuuid-devel-2.32.1-42.el8.x86_64.rp 86 kB/s | 99 kB 00:01 2023-07-27T14:23:35.367 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2023-07-27T14:23:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/1 2023-07-27T14:23:35.470 INFO:teuthology.orchestra.run.smithi159.stdout:(75/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 128 kB/s | 18 kB 00:00 2023-07-27T14:23:35.602 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 1/155 2023-07-27T14:23:35.680 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/155 2023-07-27T14:23:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 2/155 2023-07-27T14:23:35.878 INFO:teuthology.orchestra.run.smithi159.stdout:(76/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 107 kB/s | 44 kB 00:00 2023-07-27T14:23:35.940 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 2/155 2023-07-27T14:23:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-07-27T14:23:36.377 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/155 2023-07-27T14:23:36.607 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/155 2023-07-27T14:23:36.822 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-07-27T14:23:36.968 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-07-27T14:23:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-07-27T14:23:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 8/155 2023-07-27T14:23:37.795 INFO:teuthology.orchestra.run.smithi159.stdout:(77/139): python3-scipy-1.0.0-21.module_el8.5.0 943 kB/s | 14 MB 00:14 2023-07-27T14:23:38.044 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 8/155 2023-07-27T14:23:38.235 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 9/155 2023-07-27T14:23:38.375 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 9/155 2023-07-27T14:23:38.585 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 10/155 2023-07-27T14:23:38.686 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 10/155 2023-07-27T14:23:38.899 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:16.2.13-434.gcb5f5cfb.el8.x86_64 11/155 2023-07-27T14:23:39.034 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-07-27T14:23:39.213 INFO:teuthology.orchestra.run.smithi159.stdout:(78/139): pcre2-devel-10.32-3.el8.x86_64.rpm 427 kB/s | 605 kB 00:01 2023-07-27T14:23:39.448 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-07-27T14:23:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:(79/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 655 kB/s | 229 kB 00:00 2023-07-27T14:23:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 13/155 2023-07-27T14:23:39.830 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 13/155 2023-07-27T14:23:39.913 INFO:teuthology.orchestra.run.smithi159.stdout:(80/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 630 kB/s | 220 kB 00:00 2023-07-27T14:23:40.043 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-07-27T14:23:40.132 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-07-27T14:23:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-07-27T14:23:40.455 INFO:teuthology.orchestra.run.smithi159.stdout:(81/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 459 kB/s | 249 kB 00:00 2023-07-27T14:23:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-07-27T14:23:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:16.2.13-434.gcb5f5cfb.el8.x86_64 17/155 2023-07-27T14:23:40.783 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:16.2.13-434.gcb5f5cfb.el8.x86_64 17/155 2023-07-27T14:23:40.993 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:16.2.13-434.gcb5f5cfb.el8.x86 18/155 2023-07-27T14:23:41.134 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:16.2.13-434.gcb5f5cfb.el8.x86 18/155 2023-07-27T14:23:41.335 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-07-27T14:23:41.494 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-07-27T14:23:41.643 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-07-27T14:23:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-07-27T14:23:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:(82/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 543 kB/s | 3.2 MB 00:05 2023-07-27T14:23:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:(83/139): python3-cryptography-3.2.1-6.el8.x86_ 432 kB/s | 641 kB 00:01 2023-07-27T14:23:41.943 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-07-27T14:23:42.006 INFO:teuthology.orchestra.run.smithi159.stdout:(84/139): python3-jwt-1.6.1-2.el8.noarch.rpm 319 kB/s | 43 kB 00:00 2023-07-27T14:23:42.231 INFO:teuthology.orchestra.run.smithi159.stdout:(85/139): python3-pycparser-2.14-14.el8.noarch. 486 kB/s | 109 kB 00:00 2023-07-27T14:23:42.265 INFO:teuthology.orchestra.run.smithi159.stdout:(86/139): python3-oauthlib-2.1.0-1.el8.noarch.r 476 kB/s | 155 kB 00:00 2023-07-27T14:23:42.307 INFO:teuthology.orchestra.run.smithi159.stdout:(87/139): python3-requests-oauthlib-1.0.0-1.el8 567 kB/s | 43 kB 00:00 2023-07-27T14:23:42.432 INFO:teuthology.orchestra.run.smithi159.stdout:(88/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 446 kB/s | 74 kB 00:00 2023-07-27T14:23:42.457 INFO:teuthology.orchestra.run.smithi159.stdout:(89/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 387 kB/s | 58 kB 00:00 2023-07-27T14:23:42.645 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-07-27T14:23:42.758 INFO:teuthology.orchestra.run.smithi159.stdout:(90/139): leveldb-1.22-1.el8.x86_64.rpm 604 kB/s | 181 kB 00:00 2023-07-27T14:23:42.775 INFO:teuthology.orchestra.run.smithi159.stdout:(91/139): gperftools-libs-2.7-9.el8.x86_64.rpm 895 kB/s | 306 kB 00:00 2023-07-27T14:23:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-07-27T14:23:42.850 INFO:teuthology.orchestra.run.smithi159.stdout:(92/139): liboath-2.6.2-3.el8.x86_64.rpm 640 kB/s | 59 kB 00:00 2023-07-27T14:23:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 750 kB/s | 75 kB 00:00 2023-07-27T14:23:42.926 INFO:teuthology.orchestra.run.smithi159.stdout:(94/139): python3-apipkg-1.5-6.el8.noarch.rpm 282 kB/s | 21 kB 00:00 2023-07-27T14:23:42.988 INFO:teuthology.orchestra.run.smithi159.stdout:(95/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 388 kB/s | 44 kB 00:00 2023-07-27T14:23:43.052 INFO:teuthology.orchestra.run.smithi159.stdout:(96/139): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-07-27T14:23:43.085 INFO:teuthology.orchestra.run.smithi159.stdout:(97/139): python3-cachetools-3.1.1-4.el8.noarch 343 kB/s | 33 kB 00:00 2023-07-27T14:23:43.152 INFO:teuthology.orchestra.run.smithi159.stdout:(98/139): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-07-27T14:23:43.202 INFO:teuthology.orchestra.run.smithi159.stdout:(99/139): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-07-27T14:23:43.328 INFO:teuthology.orchestra.run.smithi159.stdout:(100/139): python3-cherrypy-18.4.0-1.el8.noarch 2.1 MB/s | 384 kB 00:00 2023-07-27T14:23:43.353 INFO:teuthology.orchestra.run.smithi159.stdout:(101/139): python3-execnet-1.7.1-1.el8.noarch.r 2.3 MB/s | 355 kB 00:00 2023-07-27T14:23:43.395 INFO:teuthology.orchestra.run.smithi159.stdout:(102/139): python3-google-auth-1.1.1-10.el8.noa 1.2 MB/s | 81 kB 00:00 2023-07-27T14:23:43.437 INFO:teuthology.orchestra.run.smithi159.stdout:(103/139): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-07-27T14:23:43.471 INFO:teuthology.orchestra.run.smithi159.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 233 kB/s | 18 kB 00:00 2023-07-27T14:23:43.523 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-07-27T14:23:43.546 INFO:teuthology.orchestra.run.smithi159.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 647 kB/s | 49 kB 00:00 2023-07-27T14:23:43.630 INFO:teuthology.orchestra.run.smithi159.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 708 kB/s | 59 kB 00:00 2023-07-27T14:23:43.663 INFO:teuthology.orchestra.run.smithi159.stdout:(107/139): python3-kubernetes-11.0.0-6.el8.noar 5.2 MB/s | 1.2 MB 00:00 2023-07-27T14:23:43.668 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-07-27T14:23:43.730 INFO:teuthology.orchestra.run.smithi159.stdout:(108/139): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-07-27T14:23:43.756 INFO:teuthology.orchestra.run.smithi159.stdout:(109/139): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-07-27T14:23:43.806 INFO:teuthology.orchestra.run.smithi159.stdout:(110/139): python3-remoto-1.2.1-1.el8.noarch.rp 652 kB/s | 49 kB 00:00 2023-07-27T14:23:43.840 INFO:teuthology.orchestra.run.smithi159.stdout:(111/139): python3-repoze-lru-0.7-6.el8.noarch. 404 kB/s | 34 kB 00:00 2023-07-27T14:23:43.898 INFO:teuthology.orchestra.run.smithi159.stdout:(112/139): python3-routes-2.4.1-12.el8.noarch.r 2.1 MB/s | 196 kB 00:00 2023-07-27T14:23:43.915 INFO:teuthology.orchestra.run.smithi159.stdout:(113/139): python3-rsa-4.9-2.el8.noarch.rpm 855 kB/s | 64 kB 00:00 2023-07-27T14:23:43.982 INFO:teuthology.orchestra.run.smithi159.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 225 kB/s | 19 kB 00:00 2023-07-27T14:23:44.008 INFO:teuthology.orchestra.run.smithi159.stdout:(115/139): python3-singledispatch-3.4.0.3-18.el 260 kB/s | 24 kB 00:00 2023-07-27T14:23:44.066 INFO:teuthology.orchestra.run.smithi159.stdout:(116/139): python3-tempora-1.14.1-5.el8.noarch. 351 kB/s | 29 kB 00:00 2023-07-27T14:23:44.092 INFO:teuthology.orchestra.run.smithi159.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 329 kB/s | 27 kB 00:00 2023-07-27T14:23:44.159 INFO:teuthology.orchestra.run.smithi159.stdout:(118/139): python3-waitress-1.4.3-1.el8.noarch. 2.7 MB/s | 255 kB 00:00 2023-07-27T14:23:44.201 INFO:teuthology.orchestra.run.smithi159.stdout:(119/139): python3-webob-1.8.5-1.el8.1.noarch.r 2.3 MB/s | 251 kB 00:00 2023-07-27T14:23:44.242 INFO:teuthology.orchestra.run.smithi159.stdout:(120/139): python3-websocket-client-0.56.0-5.el 735 kB/s | 61 kB 00:00 2023-07-27T14:23:44.335 INFO:teuthology.orchestra.run.smithi159.stdout:(121/139): python3-webtest-2.0.33-1.el8.noarch. 640 kB/s | 85 kB 00:00 2023-07-27T14:23:44.360 INFO:teuthology.orchestra.run.smithi159.stdout:(122/139): python3-zc-lockfile-2.0-2.el8.noarch 196 kB/s | 23 kB 00:00 2023-07-27T14:23:44.530 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-07-27T14:23:44.854 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-07-27T14:23:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-07-27T14:23:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/155 2023-07-27T14:23:45.432 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-07-27T14:23:45.674 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:16.2.13-434.gcb5f5cfb.el8. 29/155 2023-07-27T14:23:45.817 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:16.2.13-434.gcb5f5cfb.el 30/155 2023-07-27T14:23:46.070 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:16.2.13-434.gcb5f5cfb.el8.x86_6 31/155 2023-07-27T14:23:47.165 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-07-27T14:23:47.516 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-07-27T14:23:47.812 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-07-27T14:23:48.009 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-07-27T14:23:48.518 INFO:teuthology.orchestra.run.smithi159.stdout:(123/139): librados2-16.2.13-434.gcb5f5cfb.el8. 917 kB/s | 3.7 MB 00:04 2023-07-27T14:23:48.911 INFO:teuthology.orchestra.run.smithi159.stdout:(124/139): NetworkManager-initscripts-updown-1. 366 kB/s | 143 kB 00:00 2023-07-27T14:23:48.969 INFO:teuthology.orchestra.run.smithi159.stdout:(125/139): librbd1-16.2.13-434.gcb5f5cfb.el8.x8 928 kB/s | 4.2 MB 00:04 2023-07-27T14:23:49.086 INFO:teuthology.orchestra.run.smithi159.stdout:(126/139): elfutils-debuginfod-client-0.189-2.e 434 kB/s | 76 kB 00:00 2023-07-27T14:23:49.436 INFO:teuthology.orchestra.run.smithi159.stdout:(127/139): elfutils-libelf-0.189-2.el8.x86_64.r 496 kB/s | 232 kB 00:00 2023-07-27T14:23:49.537 INFO:teuthology.orchestra.run.smithi159.stdout:(128/139): elfutils-libs-0.189-2.el8.x86_64.rpm 672 kB/s | 302 kB 00:00 2023-07-27T14:23:49.828 INFO:teuthology.orchestra.run.smithi159.stdout:(129/139): libblkid-2.32.1-42.el8.x86_64.rpm 756 kB/s | 220 kB 00:00 2023-07-27T14:23:50.112 INFO:teuthology.orchestra.run.smithi159.stdout:(130/139): libfdisk-2.32.1-42.el8.x86_64.rpm 895 kB/s | 253 kB 00:00 2023-07-27T14:23:50.122 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-07-27T14:23:50.281 INFO:teuthology.orchestra.run.smithi159.stdout:(131/139): iproute-6.2.0-2.el8.x86_64.rpm 1.0 MB/s | 880 kB 00:00 2023-07-27T14:23:50.465 INFO:teuthology.orchestra.run.smithi159.stdout:(132/139): libmount-2.32.1-42.el8.x86_64.rpm 671 kB/s | 236 kB 00:00 2023-07-27T14:23:50.482 INFO:teuthology.orchestra.run.smithi159.stdout:(133/139): libsmartcols-2.32.1-42.el8.x86_64.rp 896 kB/s | 179 kB 00:00 2023-07-27T14:23:50.598 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-07-27T14:23:50.607 INFO:teuthology.orchestra.run.smithi159.stdout:(134/139): libuuid-2.32.1-42.el8.x86_64.rpm 694 kB/s | 98 kB 00:00 2023-07-27T14:23:50.741 INFO:teuthology.orchestra.run.smithi159.stdout:(135/139): util-linux-user-2.32.1-42.el8.x86_64 768 kB/s | 102 kB 00:00 2023-07-27T14:23:50.767 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-07-27T14:23:50.938 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-07-27T14:23:51.154 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 39/155 2023-07-27T14:23:51.166 INFO:teuthology.orchestra.run.smithi159.stdout:(136/139): xfsdump-3.1.8-6.el8.x86_64.rpm 786 kB/s | 334 kB 00:00 2023-07-27T14:23:51.364 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 40/155 2023-07-27T14:23:51.366 INFO:teuthology.orchestra.run.smithi159.stdout:(137/139): util-linux-2.32.1-42.el8.x86_64.rpm 2.9 MB/s | 2.6 MB 00:00 2023-07-27T14:23:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_6 41/155 2023-07-27T14:23:51.766 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/155 2023-07-27T14:23:51.945 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/155 2023-07-27T14:23:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/155 2023-07-27T14:23:52.192 INFO:teuthology.orchestra.run.smithi159.stdout:(138/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 1.1 MB/s | 1.1 MB 00:01 2023-07-27T14:23:52.236 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/155 2023-07-27T14:23:52.450 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/155 2023-07-27T14:23:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/155 2023-07-27T14:23:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/155 2023-07-27T14:23:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/155 2023-07-27T14:23:53.457 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/155 2023-07-27T14:23:53.751 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/155 2023-07-27T14:23:53.779 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/155 2023-07-27T14:23:53.982 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-07-27T14:23:54.266 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-07-27T14:23:54.466 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-07-27T14:23:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-07-27T14:23:54.763 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-07-27T14:23:54.947 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-07-27T14:23:55.130 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-07-27T14:23:55.303 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/155 2023-07-27T14:23:55.457 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/155 2023-07-27T14:23:55.623 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/155 2023-07-27T14:23:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/155 2023-07-27T14:23:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/155 2023-07-27T14:23:56.146 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/155 2023-07-27T14:23:56.354 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/155 2023-07-27T14:23:56.623 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/155 2023-07-27T14:23:56.850 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/155 2023-07-27T14:23:57.227 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/155 2023-07-27T14:23:57.475 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/155 2023-07-27T14:23:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/155 2023-07-27T14:23:57.927 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/155 2023-07-27T14:23:58.134 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 69/155 2023-07-27T14:23:58.339 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/155 2023-07-27T14:23:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 71/155 2023-07-27T14:23:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/155 2023-07-27T14:23:59.648 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/155 2023-07-27T14:23:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/155 2023-07-27T14:24:00.120 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/155 2023-07-27T14:24:00.372 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/155 2023-07-27T14:24:00.593 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/155 2023-07-27T14:24:01.869 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/155 2023-07-27T14:24:02.093 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/155 2023-07-27T14:24:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/155 2023-07-27T14:24:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/155 2023-07-27T14:24:02.860 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/155 2023-07-27T14:24:03.128 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/155 2023-07-27T14:24:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/155 2023-07-27T14:24:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/155 2023-07-27T14:24:03.897 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/155 2023-07-27T14:24:04.051 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 87/155 2023-07-27T14:24:04.217 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 88/155 2023-07-27T14:24:04.555 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 89/155 2023-07-27T14:24:04.829 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 90/155 2023-07-27T14:24:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 91/155 2023-07-27T14:24:05.190 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 92/155 2023-07-27T14:24:05.393 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 93/155 2023-07-27T14:24:05.611 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.7-17.el8.x86_64 94/155 2023-07-27T14:24:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 95/155 2023-07-27T14:24:06.017 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/155 2023-07-27T14:24:06.174 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/155 2023-07-27T14:24:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 98/155 2023-07-27T14:24:09.166 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 98/155 2023-07-27T14:24:10.041 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 98/155 2023-07-27T14:24:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:16.2.13-434.gcb5f5cfb.el8.x86_64 99/155 2023-07-27T14:24:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:16.2.13-434.gcb5f5cfb.el8.x86_64 99/155 2023-07-27T14:24:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:16.2.13-434.gcb5f5cfb.el8.x86_64 100/155 2023-07-27T14:24:11.934 INFO:teuthology.orchestra.run.smithi159.stdout:(139/139): ceph-test-16.2.13-434.gcb5f5cfb.el8. 724 kB/s | 51 MB 01:12 2023-07-27T14:24:11.936 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2023-07-27T14:24:11.937 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.8 MB/s | 209 MB 01:52 2023-07-27T14:24:13.614 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2023-07-27T14:24:14.029 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2023-07-27T14:24:14.030 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2023-07-27T14:24:15.804 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2023-07-27T14:24:15.807 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2023-07-27T14:24:21.010 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2023-07-27T14:24:21.066 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/1 2023-07-27T14:24:21.245 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 1/155 2023-07-27T14:24:21.353 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 1/155 2023-07-27T14:24:21.529 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 2/155 2023-07-27T14:24:21.627 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 2/155 2023-07-27T14:24:21.773 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-07-27T14:24:22.015 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/155 2023-07-27T14:24:22.284 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/155 2023-07-27T14:24:22.526 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-07-27T14:24:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-07-27T14:24:23.121 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-07-27T14:24:23.320 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 8/155 2023-07-27T14:24:23.800 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 8/155 2023-07-27T14:24:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 9/155 2023-07-27T14:24:24.168 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 9/155 2023-07-27T14:24:24.337 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 10/155 2023-07-27T14:24:24.454 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 10/155 2023-07-27T14:24:24.676 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:16.2.13-434.gcb5f5cfb.el8.x86_64 11/155 2023-07-27T14:24:24.854 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-07-27T14:24:25.270 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-07-27T14:24:25.404 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 13/155 2023-07-27T14:24:25.642 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 13/155 2023-07-27T14:24:25.854 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-07-27T14:24:25.935 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-07-27T14:24:26.170 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-07-27T14:24:26.361 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-07-27T14:24:26.495 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:16.2.13-434.gcb5f5cfb.el8.x86_64 17/155 2023-07-27T14:24:26.602 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:16.2.13-434.gcb5f5cfb.el8.x86_64 17/155 2023-07-27T14:24:26.754 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:16.2.13-434.gcb5f5cfb.el8.x86 18/155 2023-07-27T14:24:26.886 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:16.2.13-434.gcb5f5cfb.el8.x86 18/155 2023-07-27T14:24:27.113 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-07-27T14:24:27.275 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-07-27T14:24:27.462 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-07-27T14:24:27.621 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-07-27T14:24:27.770 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-07-27T14:24:28.459 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-07-27T14:24:28.645 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-07-27T14:24:29.373 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-07-27T14:24:29.528 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-07-27T14:24:30.388 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-07-27T14:24:30.724 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-07-27T14:24:30.930 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-07-27T14:24:31.094 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/155 2023-07-27T14:24:31.149 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:16.2.13-434.gcb5f5cfb.el8.x86_64 100/155 2023-07-27T14:24:31.149 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2023-07-27T14:24:31.149 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2023-07-27T14:24:31.150 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2023-07-27T14:24:31.150 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /run 2023-07-27T14:24:31.150 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2023-07-27T14:24:31.150 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2023-07-27T14:24:31.150 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2023-07-27T14:24:31.150 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2023-07-27T14:24:31.150 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2023-07-27T14:24:31.151 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:24:31.292 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-07-27T14:24:31.552 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:16.2.13-434.gcb5f5cfb.el8. 29/155 2023-07-27T14:24:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:16.2.13-434.gcb5f5cfb.el8.x86_64 101/155 2023-07-27T14:24:31.694 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:16.2.13-434.gcb5f5cfb.el 30/155 2023-07-27T14:24:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:16.2.13-434.gcb5f5cfb.el8.x86_6 31/155 2023-07-27T14:24:32.054 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:16.2.13-434.gcb5f5cfb.el8.x86_64 101/155 2023-07-27T14:24:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:16.2.13-434.gcb5f5cfb.el8.x86_64 102/155 2023-07-27T14:24:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-07-27T14:24:33.378 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-07-27T14:24:33.691 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-07-27T14:24:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-07-27T14:24:33.877 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:16.2.13-434.gcb5f5cfb.el8.x86_64 102/155 2023-07-27T14:24:34.096 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 103/155 2023-07-27T14:24:34.158 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 103/155 2023-07-27T14:24:34.330 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-07-27T14:24:34.517 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-07-27T14:24:34.712 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-07-27T14:24:34.789 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-07-27T14:24:35.081 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-07-27T14:24:35.304 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.1-7.el8.noarch 108/155 2023-07-27T14:24:35.947 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 109/155 2023-07-27T14:24:35.985 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-07-27T14:24:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 109/155 2023-07-27T14:24:36.254 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:16.2.13-434.gcb5f5cfb.e 110/155 2023-07-27T14:24:36.293 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-07-27T14:24:36.444 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:16.2.13-434.gcb5f5cfb. 111/155 2023-07-27T14:24:36.487 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-07-27T14:24:36.637 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:16.2.13-434.gcb5f5cfb.el8.noa 112/155 2023-07-27T14:24:36.658 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-07-27T14:24:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 39/155 2023-07-27T14:24:37.051 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 40/155 2023-07-27T14:24:37.266 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_6 41/155 2023-07-27T14:24:37.440 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/155 2023-07-27T14:24:37.602 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/155 2023-07-27T14:24:37.752 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.13-434.gcb5f5cfb.el8.noa 112/155 2023-07-27T14:24:37.803 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/155 2023-07-27T14:24:37.903 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/155 2023-07-27T14:24:38.053 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:16.2.13-434.gcb5f5cfb.el8.n 113/155 2023-07-27T14:24:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/155 2023-07-27T14:24:38.195 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/155 2023-07-27T14:24:38.350 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/155 2023-07-27T14:24:38.528 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/155 2023-07-27T14:24:39.115 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/155 2023-07-27T14:24:39.231 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.13-434.gcb5f5cfb.el8.n 113/155 2023-07-27T14:24:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/155 2023-07-27T14:24:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/155 2023-07-27T14:24:39.420 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.13-434.gcb5 114/155 2023-07-27T14:24:39.547 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.13-434.gcb5 114/155 2023-07-27T14:24:39.628 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-07-27T14:24:39.915 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-07-27T14:24:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:16.2.13-434.gcb5f5cfb.el 115/155 2023-07-27T14:24:40.111 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-07-27T14:24:40.162 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:16.2.13-434.gcb5f5cfb.el8.x86_64 116/155 2023-07-27T14:24:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:16.2.13-434.gcb5f5cfb.el8.x86_64 116/155 2023-07-27T14:24:40.250 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-07-27T14:24:40.399 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-07-27T14:24:40.420 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:16.2.13-434.gcb5f5cfb.el8.noarch 117/155 2023-07-27T14:24:40.447 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.13-434.gcb5f5cfb.el8.noarch 117/155 2023-07-27T14:24:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-07-27T14:24:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:16.2.13-434.gcb5f5cfb.el8.x86_64 118/155 2023-07-27T14:24:40.823 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-07-27T14:24:40.853 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-07-27T14:24:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/155 2023-07-27T14:24:41.377 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/155 2023-07-27T14:24:41.553 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/155 2023-07-27T14:24:41.711 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/155 2023-07-27T14:24:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/155 2023-07-27T14:24:42.041 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/155 2023-07-27T14:24:42.250 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/155 2023-07-27T14:24:42.511 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/155 2023-07-27T14:24:42.695 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/155 2023-07-27T14:24:43.042 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/155 2023-07-27T14:24:43.286 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/155 2023-07-27T14:24:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/155 2023-07-27T14:24:43.798 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/155 2023-07-27T14:24:43.980 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 69/155 2023-07-27T14:24:44.183 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/155 2023-07-27T14:24:44.393 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 71/155 2023-07-27T14:24:44.622 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/155 2023-07-27T14:24:45.035 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/155 2023-07-27T14:24:45.294 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/155 2023-07-27T14:24:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/155 2023-07-27T14:24:45.734 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-07-27T14:24:45.758 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/155 2023-07-27T14:24:45.980 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/155 2023-07-27T14:24:47.048 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:16.2.13-434.gcb5f5cfb.el8.x86_64 120/155 2023-07-27T14:24:47.274 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/155 2023-07-27T14:24:47.303 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 121/155 2023-07-27T14:24:47.426 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 121/155 2023-07-27T14:24:47.513 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/155 2023-07-27T14:24:47.611 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:16.2.13-434.gcb5f5 122/155 2023-07-27T14:24:47.681 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.13-434.gcb5f5 122/155 2023-07-27T14:24:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/155 2023-07-27T14:24:47.861 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 123/155 2023-07-27T14:24:48.053 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/155 2023-07-27T14:24:48.258 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephfs-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 123/155 2023-07-27T14:24:48.290 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/155 2023-07-27T14:24:48.461 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 124/155 2023-07-27T14:24:48.535 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/155 2023-07-27T14:24:48.593 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 124/155 2023-07-27T14:24:48.726 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/155 2023-07-27T14:24:49.046 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/155 2023-07-27T14:24:49.275 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/155 2023-07-27T14:24:49.447 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 87/155 2023-07-27T14:24:49.631 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 88/155 2023-07-27T14:24:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 125/155 2023-07-27T14:24:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 89/155 2023-07-27T14:24:50.083 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-07-27T14:24:50.174 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 90/155 2023-07-27T14:24:50.351 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 127/155 2023-07-27T14:24:50.369 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 91/155 2023-07-27T14:24:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 128/155 2023-07-27T14:24:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 92/155 2023-07-27T14:24:50.748 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-07-27T14:24:50.772 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 93/155 2023-07-27T14:24:50.964 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.7-17.el8.x86_64 94/155 2023-07-27T14:24:50.996 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_ 130/155 2023-07-27T14:24:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 95/155 2023-07-27T14:24:51.191 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-07-27T14:24:51.371 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/155 2023-07-27T14:24:51.386 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-top-2:16.2.13-434.gcb5f5cfb.el8.noarch 132/155 2023-07-27T14:24:51.545 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/155 2023-07-27T14:24:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 133/155 2023-07-27T14:24:51.982 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 134/155 2023-07-27T14:24:52.263 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-07-27T14:24:52.444 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 136/155 2023-07-27T14:24:52.470 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 136/155 2023-07-27T14:24:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-07-27T14:24:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-07-27T14:24:52.992 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-07-27T14:24:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-07-27T14:24:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-07-27T14:24:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-07-27T14:24:53.504 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-07-27T14:24:53.633 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-07-27T14:24:53.633 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-07-27T14:24:53.881 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-07-27T14:24:53.882 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-07-27T14:24:54.180 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-07-27T14:24:54.197 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-07-27T14:24:54.316 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-07-27T14:24:54.317 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-07-27T14:24:54.340 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 98/155 2023-07-27T14:24:54.561 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 98/155 2023-07-27T14:24:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-07-27T14:24:54.746 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-07-27T14:24:54.921 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-07-27T14:24:55.137 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-07-27T14:24:55.137 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-07-27T14:24:55.362 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 98/155 2023-07-27T14:24:55.413 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-07-27T14:24:55.414 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-07-27T14:24:55.622 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-07-27T14:24:55.622 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-07-27T14:24:55.707 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:16.2.13-434.gcb5f5cfb.el8.x86_64 99/155 2023-07-27T14:24:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-07-27T14:24:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-07-27T14:24:55.914 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:16.2.13-434.gcb5f5cfb.el8.x86_64 99/155 2023-07-27T14:24:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:16.2.13-434.gcb5f5cfb.el8.x86_64 100/155 2023-07-27T14:24:56.063 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-07-27T14:24:56.064 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-07-27T14:24:56.280 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-07-27T14:24:56.503 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-07-27T14:24:56.721 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-07-27T14:24:56.721 INFO:teuthology.orchestra.run.smithi115.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-27T14:24:56.721 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:24:57.414 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:16.2.13-434.gcb5f5cfb.el8.x86_64 1/155 2023-07-27T14:24:57.415 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2/155 2023-07-27T14:24:57.415 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 3/155 2023-07-27T14:24:57.415 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 4/155 2023-07-27T14:24:57.415 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:16.2.13-434.gcb5f5 5/155 2023-07-27T14:24:57.415 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:16.2.13-434.gcb5f5cfb.el8.x86_64 6/155 2023-07-27T14:24:57.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:16.2.13-434.gcb5f5cfb.el8.x86_64 7/155 2023-07-27T14:24:57.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:16.2.13-434.gcb5f5cfb.el8.x86_64 8/155 2023-07-27T14:24:57.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 9/155 2023-07-27T14:24:57.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 10/155 2023-07-27T14:24:57.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:16.2.13-434.gcb5f5cfb.el8.x86_64 11/155 2023-07-27T14:24:57.416 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:16.2.13-434.gcb5f5cfb.el8.x86_64 12/155 2023-07-27T14:24:57.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 13/155 2023-07-27T14:24:57.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_ 14/155 2023-07-27T14:24:57.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 15/155 2023-07-27T14:24:57.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:16.2.13-434.gcb5f5cfb.el8.x86_64 16/155 2023-07-27T14:24:57.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_6 17/155 2023-07-27T14:24:57.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:16.2.13-434.gcb5f5cfb.el8.x86 18/155 2023-07-27T14:24:57.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 19/155 2023-07-27T14:24:57.417 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:16.2.13-434.gcb5f5cfb.el 20/155 2023-07-27T14:24:57.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:16.2.13-434.gcb5f5cfb.el8. 21/155 2023-07-27T14:24:57.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:16.2.13-434.gcb5f5cfb.el8.x86_6 22/155 2023-07-27T14:24:57.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:16.2.13-434.gcb5f5cfb.el8.x86_64 23/155 2023-07-27T14:24:57.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 24/155 2023-07-27T14:24:57.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 25/155 2023-07-27T14:24:57.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 26/155 2023-07-27T14:24:57.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 27/155 2023-07-27T14:24:57.418 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 28/155 2023-07-27T14:24:57.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:16.2.13-434.gcb5f5cfb. 29/155 2023-07-27T14:24:57.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:16.2.13-434.gcb5f5cfb.el8.noa 30/155 2023-07-27T14:24:57.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:16.2.13-434.gcb5f5cfb.el8.n 31/155 2023-07-27T14:24:57.419 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.13-434.gcb5 32/155 2023-07-27T14:24:57.420 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:16.2.13-434.gcb5f5cfb.el 33/155 2023-07-27T14:24:57.420 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:16.2.13-434.gcb5f5cfb.el8.noarch 34/155 2023-07-27T14:24:57.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:16.2.13-434.gcb5f5cfb.e 35/155 2023-07-27T14:24:57.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 36/155 2023-07-27T14:24:57.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-top-2:16.2.13-434.gcb5f5cfb.el8.noarch 37/155 2023-07-27T14:24:57.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.1-7.el8.noarch 38/155 2023-07-27T14:24:57.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.0.4-10.el8.x86_64 39/155 2023-07-27T14:24:57.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.1-9.el8.x86_64 40/155 2023-07-27T14:24:57.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.6-7.el8.x86_64 41/155 2023-07-27T14:24:57.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 42/155 2023-07-27T14:24:57.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 43/155 2023-07-27T14:24:57.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 44/155 2023-07-27T14:24:57.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 45/155 2023-07-27T14:24:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 46/155 2023-07-27T14:24:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 47/155 2023-07-27T14:24:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 48/155 2023-07-27T14:24:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 49/155 2023-07-27T14:24:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/155 2023-07-27T14:24:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/155 2023-07-27T14:24:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 52/155 2023-07-27T14:24:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 53/155 2023-07-27T14:24:57.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 54/155 2023-07-27T14:24:57.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 55/155 2023-07-27T14:24:57.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 56/155 2023-07-27T14:24:57.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/155 2023-07-27T14:24:57.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/155 2023-07-27T14:24:57.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/155 2023-07-27T14:24:57.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 60/155 2023-07-27T14:24:57.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 61/155 2023-07-27T14:24:57.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/155 2023-07-27T14:24:57.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/155 2023-07-27T14:24:57.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 64/155 2023-07-27T14:24:57.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 65/155 2023-07-27T14:24:57.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 66/155 2023-07-27T14:24:57.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 67/155 2023-07-27T14:24:57.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 68/155 2023-07-27T14:24:57.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 69/155 2023-07-27T14:24:57.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 70/155 2023-07-27T14:24:57.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 71/155 2023-07-27T14:24:57.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 72/155 2023-07-27T14:24:57.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 73/155 2023-07-27T14:24:57.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 74/155 2023-07-27T14:24:57.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/155 2023-07-27T14:24:57.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 76/155 2023-07-27T14:24:57.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 77/155 2023-07-27T14:24:57.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/155 2023-07-27T14:24:57.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 79/155 2023-07-27T14:24:57.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 80/155 2023-07-27T14:24:57.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 81/155 2023-07-27T14:24:57.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 82/155 2023-07-27T14:24:57.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 83/155 2023-07-27T14:24:57.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 84/155 2023-07-27T14:24:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/155 2023-07-27T14:24:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/155 2023-07-27T14:24:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 87/155 2023-07-27T14:24:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 88/155 2023-07-27T14:24:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/155 2023-07-27T14:24:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 90/155 2023-07-27T14:24:57.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/155 2023-07-27T14:24:57.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : leveldb-1.22-1.el8.x86_64 92/155 2023-07-27T14:24:57.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-07-27T14:24:57.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-07-27T14:24:57.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 95/155 2023-07-27T14:24:57.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-07-27T14:24:57.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-07-27T14:24:57.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-07-27T14:24:57.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-07-27T14:24:57.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-07-27T14:24:57.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-07-27T14:24:57.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 102/155 2023-07-27T14:24:57.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/155 2023-07-27T14:24:57.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/155 2023-07-27T14:24:57.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/155 2023-07-27T14:24:57.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/155 2023-07-27T14:24:57.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/155 2023-07-27T14:24:57.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/155 2023-07-27T14:24:57.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-07-27T14:24:57.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-07-27T14:24:57.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 111/155 2023-07-27T14:24:57.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/155 2023-07-27T14:24:57.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/155 2023-07-27T14:24:57.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 114/155 2023-07-27T14:24:57.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/155 2023-07-27T14:24:57.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/155 2023-07-27T14:24:57.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/155 2023-07-27T14:24:57.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/155 2023-07-27T14:24:57.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 119/155 2023-07-27T14:24:57.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/155 2023-07-27T14:24:57.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/155 2023-07-27T14:24:57.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/155 2023-07-27T14:24:57.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/155 2023-07-27T14:24:57.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 124/155 2023-07-27T14:24:57.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-07-27T14:24:57.443 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 126/155 2023-07-27T14:24:57.443 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-07-27T14:24:57.443 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 128/155 2023-07-27T14:24:57.443 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-07-27T14:24:57.443 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 130/155 2023-07-27T14:24:57.443 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-07-27T14:24:57.443 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 132/155 2023-07-27T14:24:57.444 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-07-27T14:24:57.444 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 134/155 2023-07-27T14:24:57.444 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-07-27T14:24:57.444 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-07-27T14:24:57.444 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-07-27T14:24:57.444 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 138/155 2023-07-27T14:24:57.445 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-07-27T14:24:57.445 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 140/155 2023-07-27T14:24:57.445 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-07-27T14:24:57.445 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 142/155 2023-07-27T14:24:57.445 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-07-27T14:24:57.446 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 144/155 2023-07-27T14:24:57.446 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-07-27T14:24:57.446 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 146/155 2023-07-27T14:24:57.446 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-07-27T14:24:57.446 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 148/155 2023-07-27T14:24:57.446 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-07-27T14:24:57.446 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 150/155 2023-07-27T14:24:57.446 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-07-27T14:24:57.447 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-07-27T14:24:57.447 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-07-27T14:24:57.447 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-07-27T14:24:59.500 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-07-27T14:24:59.501 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:24:59.501 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2023-07-27T14:24:59.501 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-27T14:24:59.501 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-27T14:24:59.501 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-27T14:24:59.502 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-27T14:24:59.502 INFO:teuthology.orchestra.run.smithi115.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-27T14:24:59.502 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-27T14:24:59.502 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-27T14:24:59.502 INFO:teuthology.orchestra.run.smithi115.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-27T14:24:59.502 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.502 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.502 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-27T14:24:59.503 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-27T14:24:59.503 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-27T14:24:59.503 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-27T14:24:59.503 INFO:teuthology.orchestra.run.smithi115.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-27T14:24:59.503 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-27T14:24:59.503 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2023-07-27T14:24:59.503 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.1-7.el8.noarch 2023-07-27T14:24:59.503 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.0.4-10.el8.x86_64 2023-07-27T14:24:59.504 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.504 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.504 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.504 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.504 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.504 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.504 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.505 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.505 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.505 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.505 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.505 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.505 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.505 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.505 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.506 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.506 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.506 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.506 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.506 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.506 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.506 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:24:59.506 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-27T14:24:59.507 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.1-9.el8.x86_64 2023-07-27T14:24:59.507 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-27T14:24:59.507 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-27T14:24:59.507 INFO:teuthology.orchestra.run.smithi115.stdout: jq-1.6-7.el8.x86_64 2023-07-27T14:24:59.507 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-27T14:24:59.507 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-27T14:24:59.507 INFO:teuthology.orchestra.run.smithi115.stdout: leveldb-1.22-1.el8.x86_64 2023-07-27T14:24:59.507 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-27T14:24:59.508 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.508 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.508 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.508 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-27T14:24:59.508 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-27T14:24:59.508 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-27T14:24:59.508 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-27T14:24:59.509 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-27T14:24:59.509 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.509 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.509 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-27T14:24:59.509 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.509 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-27T14:24:59.509 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-27T14:24:59.509 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-27T14:24:59.510 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-27T14:24:59.510 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-27T14:24:59.510 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-27T14:24:59.510 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-27T14:24:59.510 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-27T14:24:59.510 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-27T14:24:59.510 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-27T14:24:59.510 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-27T14:24:59.511 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-27T14:24:59.511 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-27T14:24:59.511 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-27T14:24:59.511 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-27T14:24:59.511 INFO:teuthology.orchestra.run.smithi115.stdout: python3-apipkg-1.5-6.el8.noarch 2023-07-27T14:24:59.511 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-27T14:24:59.511 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-27T14:24:59.511 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-27T14:24:59.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-27T14:24:59.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-27T14:24:59.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-27T14:24:59.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-27T14:24:59.512 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-27T14:24:59.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-27T14:24:59.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-07-27T14:24:59.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-27T14:24:59.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-27T14:24:59.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-27T14:24:59.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-27T14:24:59.513 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-27T14:24:59.514 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-27T14:24:59.514 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-27T14:24:59.514 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-27T14:24:59.514 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-27T14:24:59.514 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-27T14:24:59.514 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-27T14:24:59.514 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-27T14:24:59.514 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-27T14:24:59.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-27T14:24:59.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-27T14:24:59.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-27T14:24:59.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-2.6-1.el8.noarch 2023-07-27T14:24:59.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-27T14:24:59.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-27T14:24:59.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-27T14:24:59.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-27T14:24:59.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-27T14:24:59.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-27T14:24:59.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-07-27T14:24:59.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-27T14:24:59.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-27T14:24:59.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.517 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-27T14:24:59.517 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-27T14:24:59.517 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-27T14:24:59.517 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-27T14:24:59.517 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-27T14:24:59.517 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-27T14:24:59.517 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-27T14:24:59.517 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-27T14:24:59.518 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-27T14:24:59.518 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-27T14:24:59.518 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-27T14:24:59.518 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-27T14:24:59.518 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-27T14:24:59.518 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.518 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.518 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:24:59.519 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-27T14:24:59.519 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-27T14:24:59.519 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-27T14:24:59.519 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-27T14:24:59.520 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:24:59.520 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2023-07-27T14:24:59.797 DEBUG:teuthology.parallel:result is None 2023-07-27T14:25:16.554 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:16.2.13-434.gcb5f5cfb.el8.x86_64 100/155 2023-07-27T14:25:16.555 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2023-07-27T14:25:16.555 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2023-07-27T14:25:16.555 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /dev 2023-07-27T14:25:16.555 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /run 2023-07-27T14:25:16.555 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2023-07-27T14:25:16.555 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2023-07-27T14:25:16.556 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2023-07-27T14:25:16.556 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2023-07-27T14:25:16.556 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /dev 2023-07-27T14:25:16.556 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:25:16.960 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:16.2.13-434.gcb5f5cfb.el8.x86_64 101/155 2023-07-27T14:25:17.462 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:16.2.13-434.gcb5f5cfb.el8.x86_64 101/155 2023-07-27T14:25:17.652 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:16.2.13-434.gcb5f5cfb.el8.x86_64 102/155 2023-07-27T14:25:19.284 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:16.2.13-434.gcb5f5cfb.el8.x86_64 102/155 2023-07-27T14:25:19.477 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 103/155 2023-07-27T14:25:19.538 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 103/155 2023-07-27T14:25:19.727 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-07-27T14:25:19.932 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-07-27T14:25:20.126 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-07-27T14:25:20.222 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-07-27T14:25:20.479 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-07-27T14:25:20.693 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.1-7.el8.noarch 108/155 2023-07-27T14:25:21.333 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 109/155 2023-07-27T14:25:21.542 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 109/155 2023-07-27T14:25:21.685 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:16.2.13-434.gcb5f5cfb.e 110/155 2023-07-27T14:25:21.883 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:16.2.13-434.gcb5f5cfb. 111/155 2023-07-27T14:25:22.076 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:16.2.13-434.gcb5f5cfb.el8.noa 112/155 2023-07-27T14:25:23.184 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.13-434.gcb5f5cfb.el8.noa 112/155 2023-07-27T14:25:23.446 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:16.2.13-434.gcb5f5cfb.el8.n 113/155 2023-07-27T14:25:24.632 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.13-434.gcb5f5cfb.el8.n 113/155 2023-07-27T14:25:24.817 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.13-434.gcb5 114/155 2023-07-27T14:25:24.943 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.13-434.gcb5 114/155 2023-07-27T14:25:25.348 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:16.2.13-434.gcb5f5cfb.el 115/155 2023-07-27T14:25:25.564 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:16.2.13-434.gcb5f5cfb.el8.x86_64 116/155 2023-07-27T14:25:25.618 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:16.2.13-434.gcb5f5cfb.el8.x86_64 116/155 2023-07-27T14:25:25.768 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:16.2.13-434.gcb5f5cfb.el8.noarch 117/155 2023-07-27T14:25:25.794 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.13-434.gcb5f5cfb.el8.noarch 117/155 2023-07-27T14:25:26.012 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:16.2.13-434.gcb5f5cfb.el8.x86_64 118/155 2023-07-27T14:25:26.176 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-07-27T14:25:31.078 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-07-27T14:25:32.342 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:16.2.13-434.gcb5f5cfb.el8.x86_64 120/155 2023-07-27T14:25:32.580 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 121/155 2023-07-27T14:25:32.705 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 121/155 2023-07-27T14:25:32.901 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:16.2.13-434.gcb5f5 122/155 2023-07-27T14:25:32.972 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.13-434.gcb5f5 122/155 2023-07-27T14:25:33.151 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 123/155 2023-07-27T14:25:33.549 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 123/155 2023-07-27T14:25:33.735 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 124/155 2023-07-27T14:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 124/155 2023-07-27T14:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 125/155 2023-07-27T14:25:35.415 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-07-27T14:25:35.649 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 127/155 2023-07-27T14:25:35.831 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 128/155 2023-07-27T14:25:35.988 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-07-27T14:25:36.204 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_ 130/155 2023-07-27T14:25:36.415 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-07-27T14:25:36.618 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:16.2.13-434.gcb5f5cfb.el8.noarch 132/155 2023-07-27T14:25:36.827 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 133/155 2023-07-27T14:25:37.191 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 134/155 2023-07-27T14:25:37.419 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-07-27T14:25:37.615 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 136/155 2023-07-27T14:25:37.644 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 136/155 2023-07-27T14:25:37.861 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-07-27T14:25:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-07-27T14:25:38.194 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-07-27T14:25:38.400 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-07-27T14:25:38.426 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-07-27T14:25:38.586 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-07-27T14:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-07-27T14:25:38.922 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-07-27T14:25:38.922 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-07-27T14:25:39.163 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-07-27T14:25:39.163 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-07-27T14:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-07-27T14:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-07-27T14:25:39.506 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-07-27T14:25:39.507 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-07-27T14:25:39.758 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-07-27T14:25:39.927 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-07-27T14:25:40.082 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-07-27T14:25:40.327 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-07-27T14:25:40.327 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-07-27T14:25:40.545 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-07-27T14:25:40.545 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-07-27T14:25:40.762 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-07-27T14:25:40.762 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-07-27T14:25:40.978 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-07-27T14:25:40.979 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-07-27T14:25:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-07-27T14:25:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-07-27T14:25:41.411 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-07-27T14:25:41.643 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-07-27T14:25:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-07-27T14:25:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-27T14:25:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:25:42.593 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:16.2.13-434.gcb5f5cfb.el8.x86_64 1/155 2023-07-27T14:25:42.593 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2/155 2023-07-27T14:25:42.593 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 3/155 2023-07-27T14:25:42.595 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 4/155 2023-07-27T14:25:42.595 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:16.2.13-434.gcb5f5 5/155 2023-07-27T14:25:42.596 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:16.2.13-434.gcb5f5cfb.el8.x86_64 6/155 2023-07-27T14:25:42.596 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:16.2.13-434.gcb5f5cfb.el8.x86_64 7/155 2023-07-27T14:25:42.596 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:16.2.13-434.gcb5f5cfb.el8.x86_64 8/155 2023-07-27T14:25:42.597 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 9/155 2023-07-27T14:25:42.597 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 10/155 2023-07-27T14:25:42.597 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:16.2.13-434.gcb5f5cfb.el8.x86_64 11/155 2023-07-27T14:25:42.597 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:16.2.13-434.gcb5f5cfb.el8.x86_64 12/155 2023-07-27T14:25:42.598 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 13/155 2023-07-27T14:25:42.598 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_ 14/155 2023-07-27T14:25:42.598 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 15/155 2023-07-27T14:25:42.598 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:16.2.13-434.gcb5f5cfb.el8.x86_64 16/155 2023-07-27T14:25:42.599 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_6 17/155 2023-07-27T14:25:42.599 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:16.2.13-434.gcb5f5cfb.el8.x86 18/155 2023-07-27T14:25:42.599 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 19/155 2023-07-27T14:25:42.600 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:16.2.13-434.gcb5f5cfb.el 20/155 2023-07-27T14:25:42.600 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:16.2.13-434.gcb5f5cfb.el8. 21/155 2023-07-27T14:25:42.600 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:16.2.13-434.gcb5f5cfb.el8.x86_6 22/155 2023-07-27T14:25:42.601 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:16.2.13-434.gcb5f5cfb.el8.x86_64 23/155 2023-07-27T14:25:42.601 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 24/155 2023-07-27T14:25:42.601 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 25/155 2023-07-27T14:25:42.601 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 26/155 2023-07-27T14:25:42.602 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 27/155 2023-07-27T14:25:42.602 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 28/155 2023-07-27T14:25:42.602 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:16.2.13-434.gcb5f5cfb. 29/155 2023-07-27T14:25:42.603 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:16.2.13-434.gcb5f5cfb.el8.noa 30/155 2023-07-27T14:25:42.603 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:16.2.13-434.gcb5f5cfb.el8.n 31/155 2023-07-27T14:25:42.603 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.13-434.gcb5 32/155 2023-07-27T14:25:42.603 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:16.2.13-434.gcb5f5cfb.el 33/155 2023-07-27T14:25:42.603 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:16.2.13-434.gcb5f5cfb.el8.noarch 34/155 2023-07-27T14:25:42.604 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:16.2.13-434.gcb5f5cfb.e 35/155 2023-07-27T14:25:42.604 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 36/155 2023-07-27T14:25:42.604 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:16.2.13-434.gcb5f5cfb.el8.noarch 37/155 2023-07-27T14:25:42.604 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.1-7.el8.noarch 38/155 2023-07-27T14:25:42.605 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.0.4-10.el8.x86_64 39/155 2023-07-27T14:25:42.605 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.1-9.el8.x86_64 40/155 2023-07-27T14:25:42.605 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jq-1.6-7.el8.x86_64 41/155 2023-07-27T14:25:42.606 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 42/155 2023-07-27T14:25:42.606 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 43/155 2023-07-27T14:25:42.606 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 44/155 2023-07-27T14:25:42.606 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 45/155 2023-07-27T14:25:42.606 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 46/155 2023-07-27T14:25:42.606 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 47/155 2023-07-27T14:25:42.606 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 48/155 2023-07-27T14:25:42.607 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 49/155 2023-07-27T14:25:42.607 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/155 2023-07-27T14:25:42.607 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/155 2023-07-27T14:25:42.607 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 52/155 2023-07-27T14:25:42.607 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 53/155 2023-07-27T14:25:42.607 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 54/155 2023-07-27T14:25:42.607 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 55/155 2023-07-27T14:25:42.607 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 56/155 2023-07-27T14:25:42.608 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/155 2023-07-27T14:25:42.608 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/155 2023-07-27T14:25:42.608 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/155 2023-07-27T14:25:42.608 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 60/155 2023-07-27T14:25:42.608 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 61/155 2023-07-27T14:25:42.608 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/155 2023-07-27T14:25:42.608 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/155 2023-07-27T14:25:42.609 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 64/155 2023-07-27T14:25:42.609 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 65/155 2023-07-27T14:25:42.609 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 66/155 2023-07-27T14:25:42.609 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 67/155 2023-07-27T14:25:42.609 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 68/155 2023-07-27T14:25:42.609 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 69/155 2023-07-27T14:25:42.609 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 70/155 2023-07-27T14:25:42.609 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 71/155 2023-07-27T14:25:42.610 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 72/155 2023-07-27T14:25:42.610 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 73/155 2023-07-27T14:25:42.610 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 74/155 2023-07-27T14:25:42.610 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/155 2023-07-27T14:25:42.610 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 76/155 2023-07-27T14:25:42.610 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 77/155 2023-07-27T14:25:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/155 2023-07-27T14:25:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 79/155 2023-07-27T14:25:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 80/155 2023-07-27T14:25:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 81/155 2023-07-27T14:25:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 82/155 2023-07-27T14:25:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 83/155 2023-07-27T14:25:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 84/155 2023-07-27T14:25:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/155 2023-07-27T14:25:42.612 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/155 2023-07-27T14:25:42.612 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 87/155 2023-07-27T14:25:42.612 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 88/155 2023-07-27T14:25:42.612 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/155 2023-07-27T14:25:42.613 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 90/155 2023-07-27T14:25:42.613 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/155 2023-07-27T14:25:42.613 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : leveldb-1.22-1.el8.x86_64 92/155 2023-07-27T14:25:42.613 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-07-27T14:25:42.613 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-07-27T14:25:42.613 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 95/155 2023-07-27T14:25:42.613 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-07-27T14:25:42.613 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-07-27T14:25:42.614 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-07-27T14:25:42.614 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-07-27T14:25:42.614 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-07-27T14:25:42.614 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-07-27T14:25:42.614 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 102/155 2023-07-27T14:25:42.614 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/155 2023-07-27T14:25:42.614 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/155 2023-07-27T14:25:42.615 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/155 2023-07-27T14:25:42.615 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/155 2023-07-27T14:25:42.615 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/155 2023-07-27T14:25:42.615 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/155 2023-07-27T14:25:42.615 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-07-27T14:25:42.615 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-07-27T14:25:42.615 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 111/155 2023-07-27T14:25:42.616 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/155 2023-07-27T14:25:42.616 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/155 2023-07-27T14:25:42.616 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 114/155 2023-07-27T14:25:42.616 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/155 2023-07-27T14:25:42.616 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/155 2023-07-27T14:25:42.616 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/155 2023-07-27T14:25:42.616 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/155 2023-07-27T14:25:42.617 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 119/155 2023-07-27T14:25:42.617 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/155 2023-07-27T14:25:42.617 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/155 2023-07-27T14:25:42.617 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/155 2023-07-27T14:25:42.617 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/155 2023-07-27T14:25:42.617 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 124/155 2023-07-27T14:25:42.617 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-07-27T14:25:42.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 126/155 2023-07-27T14:25:42.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-07-27T14:25:42.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 128/155 2023-07-27T14:25:42.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-07-27T14:25:42.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 130/155 2023-07-27T14:25:42.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-07-27T14:25:42.618 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 132/155 2023-07-27T14:25:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-07-27T14:25:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 134/155 2023-07-27T14:25:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-07-27T14:25:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-07-27T14:25:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-07-27T14:25:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 138/155 2023-07-27T14:25:42.619 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-07-27T14:25:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 140/155 2023-07-27T14:25:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-07-27T14:25:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 142/155 2023-07-27T14:25:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-07-27T14:25:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 144/155 2023-07-27T14:25:42.620 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-07-27T14:25:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 146/155 2023-07-27T14:25:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-07-27T14:25:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 148/155 2023-07-27T14:25:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-07-27T14:25:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 150/155 2023-07-27T14:25:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-07-27T14:25:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-07-27T14:25:42.621 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-07-27T14:25:42.622 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-07-27T14:25:44.673 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-07-27T14:25:44.673 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:25:44.674 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2023-07-27T14:25:44.674 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-27T14:25:44.674 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-27T14:25:44.674 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-27T14:25:44.674 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-27T14:25:44.674 INFO:teuthology.orchestra.run.smithi159.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-27T14:25:44.675 INFO:teuthology.orchestra.run.smithi159.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-27T14:25:44.675 INFO:teuthology.orchestra.run.smithi159.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-27T14:25:44.675 INFO:teuthology.orchestra.run.smithi159.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-27T14:25:44.675 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.675 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.675 INFO:teuthology.orchestra.run.smithi159.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-27T14:25:44.675 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-27T14:25:44.676 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-27T14:25:44.676 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-27T14:25:44.676 INFO:teuthology.orchestra.run.smithi159.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-27T14:25:44.676 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-27T14:25:44.676 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2023-07-27T14:25:44.676 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.1-7.el8.noarch 2023-07-27T14:25:44.677 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.0.4-10.el8.x86_64 2023-07-27T14:25:44.677 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.677 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.677 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.677 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.677 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.677 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.678 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.678 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.678 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.678 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.678 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.678 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.678 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.679 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.679 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.679 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.679 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.679 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.679 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.679 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.680 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.680 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:16.2.13-434.gcb5f5cfb.el8.noarch 2023-07-27T14:25:44.680 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-27T14:25:44.680 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.1-9.el8.x86_64 2023-07-27T14:25:44.680 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-27T14:25:44.680 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-27T14:25:44.680 INFO:teuthology.orchestra.run.smithi159.stdout: jq-1.6-7.el8.x86_64 2023-07-27T14:25:44.681 INFO:teuthology.orchestra.run.smithi159.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-27T14:25:44.681 INFO:teuthology.orchestra.run.smithi159.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-27T14:25:44.681 INFO:teuthology.orchestra.run.smithi159.stdout: leveldb-1.22-1.el8.x86_64 2023-07-27T14:25:44.681 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-27T14:25:44.681 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.681 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.681 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.682 INFO:teuthology.orchestra.run.smithi159.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-27T14:25:44.682 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-27T14:25:44.682 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-27T14:25:44.682 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-27T14:25:44.682 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-27T14:25:44.682 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.682 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.683 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-27T14:25:44.683 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.683 INFO:teuthology.orchestra.run.smithi159.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-27T14:25:44.683 INFO:teuthology.orchestra.run.smithi159.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-27T14:25:44.683 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-27T14:25:44.683 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-27T14:25:44.683 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-27T14:25:44.683 INFO:teuthology.orchestra.run.smithi159.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-27T14:25:44.684 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-27T14:25:44.684 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-27T14:25:44.684 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-27T14:25:44.684 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-27T14:25:44.684 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-27T14:25:44.684 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-27T14:25:44.684 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-27T14:25:44.685 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-27T14:25:44.685 INFO:teuthology.orchestra.run.smithi159.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-27T14:25:44.685 INFO:teuthology.orchestra.run.smithi159.stdout: python3-apipkg-1.5-6.el8.noarch 2023-07-27T14:25:44.685 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-27T14:25:44.685 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-27T14:25:44.685 INFO:teuthology.orchestra.run.smithi159.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-27T14:25:44.685 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-27T14:25:44.686 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.686 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.686 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.686 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-27T14:25:44.686 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-27T14:25:44.686 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-27T14:25:44.687 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-27T14:25:44.687 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-27T14:25:44.687 INFO:teuthology.orchestra.run.smithi159.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-07-27T14:25:44.687 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-27T14:25:44.687 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-27T14:25:44.687 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-27T14:25:44.687 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-27T14:25:44.687 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-27T14:25:44.688 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-27T14:25:44.688 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-27T14:25:44.688 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-27T14:25:44.688 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-27T14:25:44.688 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-27T14:25:44.688 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-27T14:25:44.689 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-27T14:25:44.689 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-27T14:25:44.689 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-27T14:25:44.689 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-27T14:25:44.689 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-27T14:25:44.689 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-2.6-1.el8.noarch 2023-07-27T14:25:44.689 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-27T14:25:44.690 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-27T14:25:44.690 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-27T14:25:44.690 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-27T14:25:44.690 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-27T14:25:44.690 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-27T14:25:44.690 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.690 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.690 INFO:teuthology.orchestra.run.smithi159.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-07-27T14:25:44.691 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-27T14:25:44.691 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-27T14:25:44.691 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.691 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-27T14:25:44.691 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-27T14:25:44.691 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-27T14:25:44.691 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-27T14:25:44.692 INFO:teuthology.orchestra.run.smithi159.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-27T14:25:44.692 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-27T14:25:44.692 INFO:teuthology.orchestra.run.smithi159.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-27T14:25:44.692 INFO:teuthology.orchestra.run.smithi159.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-27T14:25:44.692 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-27T14:25:44.692 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-27T14:25:44.692 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-27T14:25:44.693 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-27T14:25:44.693 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-27T14:25:44.693 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.693 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.693 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:16.2.13-434.gcb5f5cfb.el8.x86_64 2023-07-27T14:25:44.693 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-27T14:25:44.693 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-27T14:25:44.694 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-27T14:25:44.695 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-27T14:25:44.695 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:25:44.695 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2023-07-27T14:25:44.969 DEBUG:teuthology.parallel:result is None 2023-07-27T14:25:44.970 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f 2023-07-27T14:25:50.312 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-27T14:25:50.374 INFO:teuthology.orchestra.run.smithi115.stdout:16.2.13-434.gcb5f5cfb.el8 2023-07-27T14:25:50.375 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-434.gcb5f5cfb.el8 2023-07-27T14:25:50.375 INFO:teuthology.task.install:The correct ceph version 16.2.13-434.gcb5f5cfb is installed. 2023-07-27T14:25:50.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f 2023-07-27T14:25:50.632 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-27T14:25:50.689 INFO:teuthology.orchestra.run.smithi159.stdout:16.2.13-434.gcb5f5cfb.el8 2023-07-27T14:25:50.690 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-434.gcb5f5cfb.el8 2023-07-27T14:25:50.691 INFO:teuthology.task.install:The correct ceph version 16.2.13-434.gcb5f5cfb is installed. 2023-07-27T14:25:50.691 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-27T14:25:50.692 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:25:50.693 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-27T14:25:50.774 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:25:50.774 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-27T14:25:50.849 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-27T14:25:50.849 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:25:50.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2023-07-27T14:25:50.921 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-27T14:25:51.030 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:25:51.031 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2023-07-27T14:25:51.102 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-27T14:25:51.212 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-27T14:25:51.213 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:25:51.213 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-27T14:25:51.282 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-27T14:25:51.391 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:25:51.391 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-27T14:25:51.461 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-27T14:25:51.570 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-27T14:25:51.570 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:25:51.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2023-07-27T14:25:51.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-27T14:25:51.749 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:25:51.750 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2023-07-27T14:25:51.818 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-27T14:25:51.933 INFO:teuthology.run_tasks:Running task ceph... 2023-07-27T14:25:52.034 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-27T14:25:52.035 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2023-07-27T14:25:52.039 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /var/log/ceph 2023-07-27T14:25:52.108 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-27T14:25:52.109 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-27T14:25:52.113 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-27T14:25:52.182 INFO:tasks.ceph:Creating extra log directories... 2023-07-27T14:25:52.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-27T14:25:52.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-27T14:25:52.267 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-27T14:25:52.268 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-27T14:25:52.268 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-27T14:25:52.268 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:25:52.268 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-27T14:25:52.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-27T14:25:57.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-27T14:25:57.602 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:25:57.603 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-27T14:25:57.655 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-27T14:25:57.874 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-27T14:25:57.948 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-27T14:25:57.948 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-27T14:25:57.949 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354395', 'branch': 'wip-yuri10-testing-2023-07-26-0858-pacific', 'description': 'fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7354395', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-07-26-0858-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-07-26-0858-pacific', 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 95, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 536, 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-07-26-0858-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f', 'targets': {'smithi115.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWuWUcyh0iEuOjz5rn3MV4Zrxu9bZhvpXD1pULC+4G+MKGSDXWhHAn7p9mQlwrCG/63L1hlnGyqiNoBDqZI++9jtMV8myBROiytka62byHxvDO5GUztTJxLTOfMpro9DCxmolmFIQPIhxoTTYk7ykKBJJSPCKbVwgNhZIJwIPekNm6MC4K/QwahKHIixy3h2Op9vCcyVoEpN9E1K1WdiUAdgJrkcTBbJcr/It5A7bGfwr+z8MHO0CSMZW47W1zAvaGItSzsAjULCFdegalsniWYbfOvpck7SmYb3/3wh97v6ejFIaPxSmuGuGHyQGI3JjvftD7YkLv+Va8hO7BTmjqHLtRmx/DIs3V9ypai4yV68P/xPU+htQ1cTO/Yu6YMybTa/9y3DiSzMf1+3UwgFiYUy5+Q11ulAQwxmHGHWUuDlhqE0skEN5O154F4LHKyirzYLcwo45mkYnWk1D7ATAG5RY1V1PRWs37GeikTCkWQFCnBuYQ2Uo3IUlv7oAcQQs=', 'smithi159.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC51lPnlM/5rjd8Af/cwrhO72ybl4STES6wJQTHSL9A74BwVZkWa5uofvh9WQFmr6chZTQjtMOutIJUb5/5Dobl4xdxKDEi1zOcYpJdH8d49cgP4baICS4of9gD7J5ahNveWygIhTE/vJKx0QZpv4tDeLPZMzRoF15CUyh+7ESZQrVnY8B7gTVir9+I4vUIMOzE5N82CW6J0lx7iSBCyGa5JJrHnDlO+yqVUabY7XmHebD4MTKrypMd1+j5lDreFH4gPPs09PuA8REQs9yrjMhHXO9cbjDzENQpGDQCEfpxWXqzyx9Uf9R5Hio6hGE59zkAKTlnr6Sz7mX7nUN4uJD/Z9wAi3PV5f3x+Ja5Osoxo/yEzfspOanWPRM2v3SGqiKHqj67+QShhpCqfq8UxnUvk9buZ2VQwAl4oSrOrR1G3avTTOR5bb0bPr8n0eDNLe4jHd+JVy+5p9PlYkpO6ps/A85vLIMFi+sW1ucm31oNlSTpXqES8gFSlJGfHxW+sSM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'cb5f5cfb818b41468cb6ad4a547c95ba2fc8159f'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '407880c6d3fb77318fff01c863715090f9c2de69', 'timestamp': '2023-07-27_03:42:08', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-27T14:25:57.949 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-27T14:25:57.954 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-27T14:25:58.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2023-07-27T14:25:58.005 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/run/ceph 2023-07-27T14:25:58.075 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:25:58.075 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2023-07-27T14:25:58.121 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-27T14:25:58.122 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2023-07-27T14:25:58.207 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-27T14:25:58.208 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T14:25:58.208 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-27T14:25:58.208 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T14:25:58.209 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T14:25:58.209 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-07-27 14:24:56.930831223 +0000 2023-07-27T14:25:58.209 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-07-27 14:17:28.316193543 +0000 2023-07-27T14:25:58.210 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-07-27 14:17:28.316193543 +0000 2023-07-27T14:25:58.210 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-07-27 14:17:28.287194102 +0000 2023-07-27T14:25:58.210 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-27T14:25:58.277 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:25:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:25:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000299914 s, 1.7 MB/s 2023-07-27T14:25:58.280 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-27T14:25:58.329 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2023-07-27T14:25:58.374 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-27T14:25:58.375 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T14:25:58.375 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-27T14:25:58.375 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T14:25:58.375 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T14:25:58.375 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-07-27 14:24:56.930831223 +0000 2023-07-27T14:25:58.375 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-07-27 14:17:29.207176374 +0000 2023-07-27T14:25:58.376 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-07-27 14:17:29.207176374 +0000 2023-07-27T14:25:58.376 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-07-27 14:17:29.182176856 +0000 2023-07-27T14:25:58.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-27T14:25:58.480 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:25:58.480 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:25:58.481 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000283646 s, 1.8 MB/s 2023-07-27T14:25:58.483 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-27T14:25:58.531 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2023-07-27T14:25:58.577 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-27T14:25:58.577 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T14:25:58.577 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-27T14:25:58.578 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T14:25:58.578 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T14:25:58.578 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-07-27 14:24:56.930831223 +0000 2023-07-27T14:25:58.578 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-07-27 14:17:30.082159514 +0000 2023-07-27T14:25:58.578 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-07-27 14:17:30.082159514 +0000 2023-07-27T14:25:58.578 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-07-27 14:17:30.055160034 +0000 2023-07-27T14:25:58.579 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-27T14:25:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:25:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:25:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00028096 s, 1.8 MB/s 2023-07-27T14:25:58.685 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-27T14:25:58.733 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2023-07-27T14:25:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-27T14:25:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T14:25:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-27T14:25:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T14:25:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T14:25:58.778 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-07-27 14:24:56.930831223 +0000 2023-07-27T14:25:58.779 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-07-27 14:17:30.951142769 +0000 2023-07-27T14:25:58.779 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-07-27 14:17:30.951142769 +0000 2023-07-27T14:25:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-07-27 14:17:30.927143232 +0000 2023-07-27T14:25:58.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-27T14:25:58.883 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:25:58.883 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:25:58.884 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000456687 s, 1.1 MB/s 2023-07-27T14:25:58.886 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-27T14:25:58.933 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T14:25:58.934 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:25:58.934 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2023-07-27T14:25:58.985 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-27T14:25:58.985 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2023-07-27T14:25:59.034 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-27T14:25:59.034 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T14:25:59.034 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-27T14:25:59.034 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T14:25:59.034 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T14:25:59.034 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-07-27 14:25:42.057066502 +0000 2023-07-27T14:25:59.035 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-07-27 14:17:37.004645422 +0000 2023-07-27T14:25:59.035 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-07-27 14:17:37.004645422 +0000 2023-07-27T14:25:59.035 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-07-27 14:17:36.979645870 +0000 2023-07-27T14:25:59.035 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-27T14:25:59.103 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-07-27T14:25:59.104 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-07-27T14:25:59.104 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000318883 s, 1.6 MB/s 2023-07-27T14:25:59.106 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-27T14:25:59.155 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2023-07-27T14:25:59.200 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-27T14:25:59.200 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T14:25:59.201 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-27T14:25:59.201 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T14:25:59.201 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T14:25:59.201 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-07-27 14:25:42.058066484 +0000 2023-07-27T14:25:59.201 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-07-27 14:17:37.864630004 +0000 2023-07-27T14:25:59.201 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-07-27 14:17:37.864630004 +0000 2023-07-27T14:25:59.201 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-07-27 14:17:37.838630470 +0000 2023-07-27T14:25:59.202 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-27T14:25:59.306 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-07-27T14:25:59.307 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-07-27T14:25:59.307 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000294778 s, 1.7 MB/s 2023-07-27T14:25:59.309 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-27T14:25:59.357 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2023-07-27T14:25:59.403 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-27T14:25:59.404 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T14:25:59.404 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-27T14:25:59.404 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T14:25:59.404 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T14:25:59.404 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-07-27 14:25:42.058066484 +0000 2023-07-27T14:25:59.404 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-07-27 14:17:38.730614478 +0000 2023-07-27T14:25:59.405 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-07-27 14:17:38.730614478 +0000 2023-07-27T14:25:59.405 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-07-27 14:17:38.707614890 +0000 2023-07-27T14:25:59.405 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-27T14:25:59.471 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-07-27T14:25:59.471 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-07-27T14:25:59.471 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000279352 s, 1.8 MB/s 2023-07-27T14:25:59.473 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-27T14:25:59.521 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2023-07-27T14:25:59.567 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-27T14:25:59.567 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-27T14:25:59.568 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-27T14:25:59.568 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-27T14:25:59.568 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-07-27T14:25:59.568 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-07-27 14:25:42.058066484 +0000 2023-07-27T14:25:59.568 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-07-27 14:17:39.592599023 +0000 2023-07-27T14:25:59.568 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-07-27 14:17:39.592599023 +0000 2023-07-27T14:25:59.568 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-07-27 14:17:39.566599490 +0000 2023-07-27T14:25:59.569 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-27T14:25:59.673 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-07-27T14:25:59.674 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-07-27T14:25:59.674 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000291039 s, 1.8 MB/s 2023-07-27T14:25:59.676 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-27T14:25:59.724 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T14:25:59.725 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-27T14:25:59.725 INFO:tasks.ceph:Generating config... 2023-07-27T14:25:59.726 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-27T14:25:59.727 INFO:tasks.ceph:[client] debug client = 20 2023-07-27T14:25:59.727 INFO:tasks.ceph:[client] debug ms = 1 2023-07-27T14:25:59.727 INFO:tasks.ceph:[client] pid file = 2023-07-27T14:25:59.728 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-27T14:25:59.728 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-27T14:25:59.728 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-27T14:25:59.729 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-27T14:25:59.729 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-27T14:25:59.729 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-27T14:25:59.729 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-27T14:25:59.730 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-27T14:25:59.730 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-27T14:25:59.730 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-27T14:25:59.731 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-27T14:25:59.731 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-27T14:25:59.731 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-27T14:25:59.731 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-27T14:25:59.732 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-27T14:25:59.732 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-27T14:25:59.732 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-27T14:25:59.732 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-27T14:25:59.732 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-27T14:25:59.733 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-27T14:25:59.733 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-27T14:25:59.733 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-27T14:25:59.733 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-27T14:25:59.733 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-27T14:25:59.734 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-27T14:25:59.734 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-27T14:25:59.734 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-27T14:25:59.734 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-27T14:25:59.734 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-27T14:25:59.735 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-27T14:25:59.735 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-27T14:25:59.735 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-27T14:25:59.736 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-27T14:25:59.736 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-27T14:25:59.736 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-27T14:25:59.736 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-27T14:25:59.737 INFO:tasks.ceph:Setting up mon.a... 2023-07-27T14:25:59.737 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-27T14:25:59.908 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.keyring 2023-07-27T14:25:59.913 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-27T14:26:00.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-27T14:26:00.077 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.115'), ('mon.b', '172.21.15.159'), ('mon.c', '[v2:172.21.15.159:3301,v1:172.21.15.159:6790]')] 2023-07-27T14:26:00.078 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.115,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-27T14:26:00.079 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:00.079 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-27T14:26:00.130 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.115 --add b 172.21.15.159 --addv c '[v2:172.21.15.159:3301,v1:172.21.15.159:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:00.250 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:00.251 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: generated fsid 0ede6e86-fb6a-4237-aa30-ce93d50f4d08 2023-07-27T14:26:00.251 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 0 2023-07-27T14:26:00.251 INFO:teuthology.orchestra.run.smithi115.stdout:fsid 0ede6e86-fb6a-4237-aa30-ce93d50f4d08 2023-07-27T14:26:00.251 INFO:teuthology.orchestra.run.smithi115.stdout:last_changed 2023-07-27T14:26:00.244644+0000 2023-07-27T14:26:00.251 INFO:teuthology.orchestra.run.smithi115.stdout:created 2023-07-27T14:26:00.244644+0000 2023-07-27T14:26:00.251 INFO:teuthology.orchestra.run.smithi115.stdout:min_mon_release 0 (unknown) 2023-07-27T14:26:00.251 INFO:teuthology.orchestra.run.smithi115.stdout:election_strategy: 1 2023-07-27T14:26:00.252 INFO:teuthology.orchestra.run.smithi115.stdout:0: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.a 2023-07-27T14:26:00.252 INFO:teuthology.orchestra.run.smithi115.stdout:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2023-07-27T14:26:00.252 INFO:teuthology.orchestra.run.smithi115.stdout:2: [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] mon.c 2023-07-27T14:26:00.252 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-27T14:26:00.253 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-27T14:26:00.298 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0ede6e86-fb6a-4237-aa30-ce93d50f4d08... 2023-07-27T14:26:00.299 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-27T14:26:00.343 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-27T14:26:00.455 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2023-07-27T14:26:00.456 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2023-07-27T14:26:00.456 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-27T14:26:00.456 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2023-07-27T14:26:00.456 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.456 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2023-07-27T14:26:00.456 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.457 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2023-07-27T14:26:00.457 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.457 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2023-07-27T14:26:00.457 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2023-07-27T14:26:00.457 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.457 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2023-07-27T14:26:00.457 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2023-07-27T14:26:00.458 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.458 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-27T14:26:00.458 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2023-07-27T14:26:00.458 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.458 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2023-07-27T14:26:00.458 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-27T14:26:00.458 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.458 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2023-07-27T14:26:00.459 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.459 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2023-07-27T14:26:00.459 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2023-07-27T14:26:00.459 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2023-07-27T14:26:00.459 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2023-07-27T14:26:00.459 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2023-07-27T14:26:00.459 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2023-07-27T14:26:00.459 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2023-07-27T14:26:00.460 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-27T14:26:00.460 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-27T14:26:00.460 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2023-07-27T14:26:00.460 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.460 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-07-27T14:26:00.460 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.460 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2023-07-27T14:26:00.460 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2023-07-27T14:26:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2023-07-27T14:26:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2023-07-27T14:26:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2023-07-27T14:26:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.115,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]" 2023-07-27T14:26:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on skipped message = False 2023-07-27T14:26:00.461 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 0ede6e86-fb6a-4237-aa30-ce93d50f4d08 2023-07-27T14:26:00.462 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.462 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2023-07-27T14:26:00.462 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2023-07-27T14:26:00.462 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.462 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2023-07-27T14:26:00.462 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2023-07-27T14:26:00.462 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.463 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2023-07-27T14:26:00.463 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2023-07-27T14:26:00.463 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.463 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2023-07-27T14:26:00.463 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2023-07-27T14:26:00.463 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2023-07-27T14:26:00.463 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.463 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2023-07-27T14:26:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2023-07-27T14:26:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2023-07-27T14:26:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2023-07-27T14:26:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2023-07-27T14:26:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.465 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2023-07-27T14:26:00.465 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2023-07-27T14:26:00.465 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.465 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2023-07-27T14:26:00.465 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2023-07-27T14:26:00.465 INFO:teuthology.orchestra.run.smithi115.stdout: bdev async discard = True 2023-07-27T14:26:00.465 INFO:teuthology.orchestra.run.smithi115.stdout: bdev enable discard = True 2023-07-27T14:26:00.465 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore allocator = bitmap 2023-07-27T14:26:00.466 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2023-07-27T14:26:00.466 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2023-07-27T14:26:00.466 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 1/20 2023-07-27T14:26:00.466 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 1/20 2023-07-27T14:26:00.466 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-07-27T14:26:00.466 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2023-07-27T14:26:00.467 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 4/10 2023-07-27T14:26:00.467 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2023-07-27T14:26:00.467 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2023-07-27T14:26:00.467 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2023-07-27T14:26:00.467 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2023-07-27T14:26:00.467 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2023-07-27T14:26:00.468 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-07-27T14:26:00.468 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.468 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2023-07-27T14:26:00.468 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-07-27T14:26:00.468 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2023-07-27T14:26:00.468 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-07-27T14:26:00.468 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-07-27T14:26:00.468 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-07-27T14:26:00.469 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-07-27T14:26:00.469 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2023-07-27T14:26:00.469 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-07-27T14:26:00.469 INFO:teuthology.orchestra.run.smithi115.stdout: debug finisher = 20 2023-07-27T14:26:00.469 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.469 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2023-07-27T14:26:00.469 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-07-27T14:26:00.469 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-07-27T14:26:00.470 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2023-07-27T14:26:00.470 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-07-27T14:26:00.470 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2023-07-27T14:26:00.470 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2023-07-27T14:26:00.470 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-07-27T14:26:00.470 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2023-07-27T14:26:00.470 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2023-07-27T14:26:00.470 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-07-27T14:26:00.471 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.471 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-27T14:26:00.471 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2023-07-27T14:26:00.471 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2023-07-27T14:26:00.471 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.471 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2023-07-27T14:26:00.471 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-27T14:26:00.471 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-27T14:26:00.472 INFO:teuthology.orchestra.run.smithi115.stdout: mon op complaint time = 120 2023-07-27T14:26:00.472 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:00.472 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2023-07-27T14:26:00.472 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2023-07-27T14:26:00.472 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2023-07-27T14:26:00.472 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2023-07-27T14:26:00.472 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-27T14:26:00.473 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-27T14:26:00.473 INFO:teuthology.orchestra.run.smithi115.stdout: client mount timeout = 600 2023-07-27T14:26:00.473 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-07-27T14:26:00.473 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-07-27T14:26:00.473 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = "" 2023-07-27T14:26:00.473 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-07-27T14:26:00.473 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-07-27T14:26:00.473 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2023-07-27T14:26:00.474 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2023-07-27T14:26:00.474 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2023-07-27T14:26:00.474 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-07-27T14:26:00.474 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-07-27T14:26:00.474 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-07-27T14:26:00.474 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-07-27T14:26:00.474 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2023-07-27T14:26:00.474 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds = 20 2023-07-27T14:26:00.475 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-07-27T14:26:00.475 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug frag = True 2023-07-27T14:26:00.475 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug scatterstat = True 2023-07-27T14:26:00.475 INFO:teuthology.orchestra.run.smithi115.stdout: mds op complaint time = 180 2023-07-27T14:26:00.475 INFO:teuthology.orchestra.run.smithi115.stdout: mds verify scatter = True 2023-07-27T14:26:00.475 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-07-27T14:26:00.475 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-07-27T14:26:00.475 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-07-27T14:26:00.476 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2023-07-27T14:26:00.476 INFO:teuthology.orchestra.run.smithi159.stdout: chdir = "" 2023-07-27T14:26:00.476 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-27T14:26:00.476 INFO:teuthology.orchestra.run.smithi159.stdout: auth supported = cephx 2023-07-27T14:26:00.477 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.477 INFO:teuthology.orchestra.run.smithi159.stdout: filestore xattr use omap = true 2023-07-27T14:26:00.477 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.477 INFO:teuthology.orchestra.run.smithi159.stdout: mon clock drift allowed = 1.000 2023-07-27T14:26:00.477 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.477 INFO:teuthology.orchestra.run.smithi159.stdout: osd crush chooseleaf type = 0 2023-07-27T14:26:00.477 INFO:teuthology.orchestra.run.smithi159.stdout: auth debug = true 2023-07-27T14:26:00.478 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.478 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on old message = true 2023-07-27T14:26:00.478 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on bug = true 2023-07-27T14:26:00.478 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.478 INFO:teuthology.orchestra.run.smithi159.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-27T14:26:00.478 INFO:teuthology.orchestra.run.smithi159.stdout: mon pg warn max object skew = 0 2023-07-27T14:26:00.478 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.478 INFO:teuthology.orchestra.run.smithi159.stdout: # disable pg_autoscaler by default for new pools 2023-07-27T14:26:00.479 INFO:teuthology.orchestra.run.smithi159.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-27T14:26:00.479 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.479 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default size = 2 2023-07-27T14:26:00.479 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.479 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow primary affinity = true 2023-07-27T14:26:00.479 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow pg remap = true 2023-07-27T14:26:00.479 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on legacy crush tunables = false 2023-07-27T14:26:00.480 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on crush straw calc version zero = false 2023-07-27T14:26:00.480 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on no sortbitwise = false 2023-07-27T14:26:00.480 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on osd down out interval zero = false 2023-07-27T14:26:00.480 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on too few osds = false 2023-07-27T14:26:00.480 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-27T14:26:00.480 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-27T14:26:00.480 INFO:teuthology.orchestra.run.smithi159.stdout: mon_allow_pool_size_one = true 2023-07-27T14:26:00.480 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.481 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-07-27T14:26:00.481 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.481 INFO:teuthology.orchestra.run.smithi159.stdout: osd default data pool replay window = 5 2023-07-27T14:26:00.481 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.481 INFO:teuthology.orchestra.run.smithi159.stdout: mon allow pool delete = true 2023-07-27T14:26:00.481 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.481 INFO:teuthology.orchestra.run.smithi159.stdout: mon cluster log file level = debug 2023-07-27T14:26:00.482 INFO:teuthology.orchestra.run.smithi159.stdout: debug asserts on shutdown = true 2023-07-27T14:26:00.482 INFO:teuthology.orchestra.run.smithi159.stdout: mon health detail to clog = false 2023-07-27T14:26:00.482 INFO:teuthology.orchestra.run.smithi159.stdout: mon host = "172.21.15.115,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]" 2023-07-27T14:26:00.482 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on skipped message = False 2023-07-27T14:26:00.482 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 0ede6e86-fb6a-4237-aa30-ce93d50f4d08 2023-07-27T14:26:00.482 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.482 INFO:teuthology.orchestra.run.smithi159.stdout:[osd] 2023-07-27T14:26:00.482 INFO:teuthology.orchestra.run.smithi159.stdout: osd journal size = 100 2023-07-27T14:26:00.483 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.483 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub load threshold = 5.0 2023-07-27T14:26:00.483 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub max interval = 600 2023-07-27T14:26:00.483 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.483 INFO:teuthology.orchestra.run.smithi159.stdout: osd recover clone overlap = true 2023-07-27T14:26:00.483 INFO:teuthology.orchestra.run.smithi159.stdout: osd recovery max chunk = 1048576 2023-07-27T14:26:00.483 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.483 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug shutdown = true 2023-07-27T14:26:00.484 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug op order = true 2023-07-27T14:26:00.484 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug verify stray on activate = true 2023-07-27T14:26:00.484 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.484 INFO:teuthology.orchestra.run.smithi159.stdout: osd open classes on start = true 2023-07-27T14:26:00.484 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug pg log writeout = true 2023-07-27T14:26:00.484 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.484 INFO:teuthology.orchestra.run.smithi159.stdout: osd deep scrub update digest min age = 30 2023-07-27T14:26:00.484 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.485 INFO:teuthology.orchestra.run.smithi159.stdout: osd map max advance = 10 2023-07-27T14:26:00.485 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.485 INFO:teuthology.orchestra.run.smithi159.stdout: journal zero on create = true 2023-07-27T14:26:00.485 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.485 INFO:teuthology.orchestra.run.smithi159.stdout: filestore ondisk finisher threads = 3 2023-07-27T14:26:00.485 INFO:teuthology.orchestra.run.smithi159.stdout: filestore apply finisher threads = 3 2023-07-27T14:26:00.485 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.485 INFO:teuthology.orchestra.run.smithi159.stdout: bdev debug aio = true 2023-07-27T14:26:00.486 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug misdirected ops = true 2023-07-27T14:26:00.486 INFO:teuthology.orchestra.run.smithi159.stdout: bdev async discard = True 2023-07-27T14:26:00.486 INFO:teuthology.orchestra.run.smithi159.stdout: bdev enable discard = True 2023-07-27T14:26:00.486 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore allocator = bitmap 2023-07-27T14:26:00.486 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore block size = 96636764160 2023-07-27T14:26:00.486 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore fsck on mount = True 2023-07-27T14:26:00.486 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluefs = 1/20 2023-07-27T14:26:00.486 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluestore = 1/20 2023-07-27T14:26:00.487 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-07-27T14:26:00.487 INFO:teuthology.orchestra.run.smithi159.stdout: debug osd = 20 2023-07-27T14:26:00.487 INFO:teuthology.orchestra.run.smithi159.stdout: debug rocksdb = 4/10 2023-07-27T14:26:00.487 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd backfillfull_ratio = 0.85 2023-07-27T14:26:00.487 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd full ratio = 0.9 2023-07-27T14:26:00.487 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd nearfull ratio = 0.8 2023-07-27T14:26:00.487 INFO:teuthology.orchestra.run.smithi159.stdout: osd failsafe full ratio = 0.95 2023-07-27T14:26:00.487 INFO:teuthology.orchestra.run.smithi159.stdout: osd objectstore = bluestore 2023-07-27T14:26:00.488 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2023-07-27T14:26:00.488 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.488 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr] 2023-07-27T14:26:00.488 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-07-27T14:26:00.488 INFO:teuthology.orchestra.run.smithi159.stdout: debug mgr = 20 2023-07-27T14:26:00.488 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2023-07-27T14:26:00.488 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2023-07-27T14:26:00.488 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2023-07-27T14:26:00.489 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2023-07-27T14:26:00.489 INFO:teuthology.orchestra.run.smithi159.stdout: mgr/telemetry/nag = false 2023-07-27T14:26:00.489 INFO:teuthology.orchestra.run.smithi159.stdout: debug client = 20 2023-07-27T14:26:00.489 INFO:teuthology.orchestra.run.smithi159.stdout: debug finisher = 20 2023-07-27T14:26:00.489 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.489 INFO:teuthology.orchestra.run.smithi159.stdout:[mon] 2023-07-27T14:26:00.489 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-07-27T14:26:00.489 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2023-07-27T14:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: debug paxos = 20 2023-07-27T14:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2023-07-27T14:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: mon data avail warn = 5 2023-07-27T14:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: mon mgr mkfs grace = 240 2023-07-27T14:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2023-07-27T14:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd reporter subtree level = osd 2023-07-27T14:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd prime pg temp = true 2023-07-27T14:26:00.490 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2023-07-27T14:26:00.491 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.491 INFO:teuthology.orchestra.run.smithi159.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-27T14:26:00.491 INFO:teuthology.orchestra.run.smithi159.stdout: auth mon ticket ttl = 660 # 11m 2023-07-27T14:26:00.491 INFO:teuthology.orchestra.run.smithi159.stdout: auth service ticket ttl = 240 # 4m 2023-07-27T14:26:00.491 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.491 INFO:teuthology.orchestra.run.smithi159.stdout: # don't complain about insecure global_id in the test suite 2023-07-27T14:26:00.491 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-27T14:26:00.491 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-27T14:26:00.492 INFO:teuthology.orchestra.run.smithi159.stdout: mon op complaint time = 120 2023-07-27T14:26:00.492 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-27T14:26:00.492 INFO:teuthology.orchestra.run.smithi159.stdout:[client] 2023-07-27T14:26:00.492 INFO:teuthology.orchestra.run.smithi159.stdout: rgw cache enabled = true 2023-07-27T14:26:00.492 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable ops log = true 2023-07-27T14:26:00.492 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable usage log = true 2023-07-27T14:26:00.492 INFO:teuthology.orchestra.run.smithi159.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-27T14:26:00.492 INFO:teuthology.orchestra.run.smithi159.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-27T14:26:00.493 INFO:teuthology.orchestra.run.smithi159.stdout: client mount timeout = 600 2023-07-27T14:26:00.493 INFO:teuthology.orchestra.run.smithi159.stdout: debug client = 20 2023-07-27T14:26:00.493 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-07-27T14:26:00.493 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = "" 2023-07-27T14:26:00.493 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2023-07-27T14:26:00.493 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2023-07-27T14:26:00.493 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.a] 2023-07-27T14:26:00.493 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.b] 2023-07-27T14:26:00.494 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.c] 2023-07-27T14:26:00.494 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2023-07-27T14:26:00.494 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2023-07-27T14:26:00.494 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2023-07-27T14:26:00.494 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2023-07-27T14:26:00.494 INFO:teuthology.orchestra.run.smithi159.stdout:[mds] 2023-07-27T14:26:00.494 INFO:teuthology.orchestra.run.smithi159.stdout: debug mds = 20 2023-07-27T14:26:00.494 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-07-27T14:26:00.495 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug frag = True 2023-07-27T14:26:00.495 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug scatterstat = True 2023-07-27T14:26:00.495 INFO:teuthology.orchestra.run.smithi159.stdout: mds op complaint time = 180 2023-07-27T14:26:00.495 INFO:teuthology.orchestra.run.smithi159.stdout: mds verify scatter = True 2023-07-27T14:26:00.495 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2023-07-27T14:26:00.495 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2023-07-27T14:26:00.495 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2023-07-27T14:26:00.497 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-27T14:26:00.497 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-27T14:26:00.601 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-27T14:26:00.602 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:00.602 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-27T14:26:00.648 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:00.648 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-27T14:26:00.733 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:26:00.733 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:00.733 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-27T14:26:00.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-27T14:26:00.865 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:00.866 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:00.950 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:26:00.951 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:00.951 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-27T14:26:00.951 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-27T14:26:01.048 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:01.048 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:01.133 INFO:tasks.ceph:Setting up mon nodes... 2023-07-27T14:26:01.134 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-27T14:26:01.134 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-27T14:26:01.249 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-27T14:26:01.254 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-27T14:26:02.455 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-27T14:26:02.461 INFO:tasks.ceph:Setting up mds nodes... 2023-07-27T14:26:02.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-27T14:26:02.585 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-27T14:26:02.590 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-27T14:26:02.659 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-27T14:26:02.773 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-27T14:26:02.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-27T14:26:02.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-27T14:26:02.973 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-27T14:26:02.978 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-27T14:26:03.049 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-27T14:26:03.166 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-27T14:26:03.171 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-27T14:26:03.241 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-27T14:26:03.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-27T14:26:03.332 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-27T14:26:03.361 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-27T14:26:03.450 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-27T14:26:03.479 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-27T14:26:03.569 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-27T14:26:03.599 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-27T14:26:03.690 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-27T14:26:03.719 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-27T14:26:03.720 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-27T14:26:03.720 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-27T14:26:03.789 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T14:26:03.789 INFO:tasks.ceph:role: osd.0 2023-07-27T14:26:03.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:26:03.790 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-27T14:26:03.865 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T14:26:03.865 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T14:26:03.866 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T14:26:03.866 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T14:26:03.866 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T14:26:03.866 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-07-27T14:26:03.866 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T14:26:03.866 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T14:26:03.866 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T14:26:03.866 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T14:26:04.295 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-07-27T14:26:04.299 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-07-27T14:26:04.299 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-27T14:26:04.507 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-27T14:26:04.585 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-27T14:26:04.653 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T14:26:04.653 INFO:tasks.ceph:role: osd.1 2023-07-27T14:26:04.654 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:26:04.654 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-27T14:26:04.729 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T14:26:04.729 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T14:26:04.730 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T14:26:04.730 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T14:26:04.730 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T14:26:04.730 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-07-27T14:26:04.730 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T14:26:04.730 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T14:26:04.730 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T14:26:04.731 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T14:26:05.160 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-07-27T14:26:05.163 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-07-27T14:26:05.164 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-27T14:26:05.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-27T14:26:05.393 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-27T14:26:05.462 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T14:26:05.462 INFO:tasks.ceph:role: osd.2 2023-07-27T14:26:05.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:26:05.464 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-27T14:26:05.542 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T14:26:05.542 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T14:26:05.542 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T14:26:05.542 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T14:26:05.542 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T14:26:05.543 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-07-27T14:26:05.543 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T14:26:05.543 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T14:26:05.543 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T14:26:05.543 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T14:26:05.990 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-07-27T14:26:05.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-07-27T14:26:05.994 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-27T14:26:06.192 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-27T14:26:06.270 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-27T14:26:06.339 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-27T14:26:06.339 INFO:tasks.ceph:role: osd.3 2023-07-27T14:26:06.340 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:26:06.340 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-27T14:26:06.415 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T14:26:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T14:26:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T14:26:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T14:26:06.417 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T14:26:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-07-27T14:26:06.417 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T14:26:06.417 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T14:26:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T14:26:06.417 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T14:26:06.850 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-07-27T14:26:06.854 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-07-27T14:26:06.855 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-27T14:26:06.979 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-27T14:26:07.058 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:07.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:07.188+0000 7f4271d4e200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-27T14:26:07.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:07.189+0000 7f4271d4e200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-27T14:26:07.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:07.189+0000 7f4271d4e200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-27T14:26:07.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:07.189+0000 7f4271d4e200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-27T14:26:07.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:07.189+0000 7f4271d4e200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-27T14:26:07.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:07.191+0000 7f4271d4e200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-27T14:26:10.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-27T14:26:10.394 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:10.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:10.485+0000 7f929f50e200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-27T14:26:10.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:10.485+0000 7f929f50e200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-27T14:26:10.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:10.485+0000 7f929f50e200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-27T14:26:10.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:10.485+0000 7f929f50e200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-27T14:26:10.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:10.485+0000 7f929f50e200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-27T14:26:10.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:10.487+0000 7f929f50e200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-27T14:26:13.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-27T14:26:13.693 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:13.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:13.783+0000 7feebd4b8200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-27T14:26:13.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:13.783+0000 7feebd4b8200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-27T14:26:13.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:13.783+0000 7feebd4b8200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-27T14:26:13.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:13.783+0000 7feebd4b8200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-27T14:26:13.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:13.783+0000 7feebd4b8200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-27T14:26:13.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:13.785+0000 7feebd4b8200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-27T14:26:16.913 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-27T14:26:16.982 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:17.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:17.071+0000 7f448b519200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-27T14:26:17.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:17.071+0000 7f448b519200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-27T14:26:17.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:17.071+0000 7f448b519200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-27T14:26:17.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:17.071+0000 7f448b519200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-27T14:26:17.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:17.071+0000 7f448b519200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-27T14:26:17.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:17.073+0000 7f448b519200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-27T14:26:20.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-27T14:26:20.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-27T14:26:20.352 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T14:26:20.352 INFO:tasks.ceph:role: osd.4 2023-07-27T14:26:20.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:26:20.352 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-27T14:26:20.431 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T14:26:20.432 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T14:26:20.432 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T14:26:20.432 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T14:26:20.432 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T14:26:20.432 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-07-27T14:26:20.432 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T14:26:20.432 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T14:26:20.433 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T14:26:20.433 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T14:26:20.871 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-07-27T14:26:20.876 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-07-27T14:26:20.876 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-27T14:26:21.083 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-27T14:26:21.163 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-27T14:26:21.233 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T14:26:21.233 INFO:tasks.ceph:role: osd.5 2023-07-27T14:26:21.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:26:21.234 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-27T14:26:21.311 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T14:26:21.312 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T14:26:21.312 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T14:26:21.312 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T14:26:21.312 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T14:26:21.312 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-07-27T14:26:21.312 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T14:26:21.312 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T14:26:21.313 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T14:26:21.313 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T14:26:21.720 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-07-27T14:26:21.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-07-27T14:26:21.725 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-27T14:26:21.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-27T14:26:21.934 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-27T14:26:22.004 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T14:26:22.004 INFO:tasks.ceph:role: osd.6 2023-07-27T14:26:22.005 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:26:22.005 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-27T14:26:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T14:26:22.082 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T14:26:22.083 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T14:26:22.083 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T14:26:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T14:26:22.083 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-07-27T14:26:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T14:26:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T14:26:22.084 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T14:26:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T14:26:22.527 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-07-27T14:26:22.531 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-07-27T14:26:22.531 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-27T14:26:22.719 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-27T14:26:22.798 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-27T14:26:22.869 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-27T14:26:22.869 INFO:tasks.ceph:role: osd.7 2023-07-27T14:26:22.869 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:26:22.870 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-27T14:26:22.946 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-27T14:26:22.946 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-27T14:26:22.946 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-27T14:26:22.947 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-27T14:26:22.947 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-27T14:26:22.947 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-07-27T14:26:22.947 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-27T14:26:22.947 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-27T14:26:22.947 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-27T14:26:22.947 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-27T14:26:23.380 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-07-27T14:26:23.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-07-27T14:26:23.384 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-27T14:26:23.509 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-27T14:26:23.584 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:23.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:23.697+0000 7fe1c714f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-27T14:26:23.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:23.697+0000 7fe1c714f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-27T14:26:23.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:23.697+0000 7fe1c714f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-27T14:26:23.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:23.697+0000 7fe1c714f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-27T14:26:23.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:23.698+0000 7fe1c714f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-27T14:26:23.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:23.699+0000 7fe1c714f200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-27T14:26:26.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-27T14:26:26.907 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:27.006 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:26.997+0000 7fa6ab493200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-27T14:26:27.006 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:26.997+0000 7fa6ab493200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-27T14:26:27.007 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:26.997+0000 7fa6ab493200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-27T14:26:27.007 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:26.997+0000 7fa6ab493200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-27T14:26:27.007 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:26.997+0000 7fa6ab493200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-27T14:26:27.008 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:26.999+0000 7fa6ab493200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-27T14:26:27.951 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:26:27.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:26:30.128 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-27T14:26:30.201 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:30.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:30.291+0000 7f839a5f0200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-27T14:26:30.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:30.291+0000 7f839a5f0200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-27T14:26:30.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:30.291+0000 7f839a5f0200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-27T14:26:30.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:30.292+0000 7f839a5f0200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-27T14:26:30.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:30.292+0000 7f839a5f0200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-27T14:26:30.302 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:30.293+0000 7f839a5f0200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-27T14:26:33.428 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-27T14:26:33.500 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:33.589+0000 7fc04c026200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-27T14:26:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:33.589+0000 7fc04c026200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-27T14:26:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:33.589+0000 7fc04c026200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-27T14:26:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:33.589+0000 7fc04c026200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-27T14:26:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:33.589+0000 7fc04c026200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-27T14:26:33.600 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:33.591+0000 7fc04c026200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-27T14:26:36.722 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-27T14:26:36.794 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-27T14:26:36.794 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:36.794 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-27T14:26:36.871 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:36.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-27T14:26:36.941 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:36.942 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-27T14:26:37.049 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:37.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-27T14:26:37.156 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:37.156 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-27T14:26:37.262 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:37.263 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-27T14:26:37.370 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:37.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-27T14:26:37.478 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:37.478 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-27T14:26:37.550 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:37.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-27T14:26:37.661 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:37.662 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-27T14:26:37.771 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:37.771 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-27T14:26:37.880 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:37.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-27T14:26:37.989 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:37.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-27T14:26:38.099 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:38.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-27T14:26:38.209 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:38.209 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-27T14:26:38.259 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:38.260 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-27T14:26:38.306 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:38.307 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-27T14:26:38.351 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:38.352 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-27T14:26:38.436 INFO:tasks.ceph:Adding keys to all mons... 2023-07-27T14:26:38.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-27T14:26:38.441 DEBUG:teuthology.orchestra.run.smithi159:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-27T14:26:38.510 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2023-07-27T14:26:38.510 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg== 2023-07-27T14:26:38.511 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-07-27T14:26:38.511 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw== 2023-07-27T14:26:38.511 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-07-27T14:26:38.511 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA== 2023-07-27T14:26:38.512 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2023-07-27T14:26:38.512 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA== 2023-07-27T14:26:38.512 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2023-07-27T14:26:38.513 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ== 2023-07-27T14:26:38.513 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2023-07-27T14:26:38.513 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ== 2023-07-27T14:26:38.513 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2023-07-27T14:26:38.513 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w== 2023-07-27T14:26:38.513 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2023-07-27T14:26:38.514 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug== 2023-07-27T14:26:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-07-27T14:26:38.514 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA== 2023-07-27T14:26:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-07-27T14:26:38.514 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw== 2023-07-27T14:26:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2023-07-27T14:26:38.514 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg== 2023-07-27T14:26:38.515 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2023-07-27T14:26:38.515 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA== 2023-07-27T14:26:38.515 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2023-07-27T14:26:38.515 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg== 2023-07-27T14:26:38.515 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2023-07-27T14:26:38.515 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg== 2023-07-27T14:26:38.515 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2023-07-27T14:26:38.516 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg== 2023-07-27T14:26:38.516 INFO:teuthology.orchestra.run.smithi115.stdout:[client.2] 2023-07-27T14:26:38.516 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg== 2023-07-27T14:26:38.516 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2023-07-27T14:26:38.516 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g== 2023-07-27T14:26:38.516 INFO:teuthology.orchestra.run.smithi115.stdout:[client.3] 2023-07-27T14:26:38.516 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ== 2023-07-27T14:26:38.543 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.y] 2023-07-27T14:26:38.543 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg== 2023-07-27T14:26:38.544 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2023-07-27T14:26:38.544 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw== 2023-07-27T14:26:38.544 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2023-07-27T14:26:38.544 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA== 2023-07-27T14:26:38.544 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.0] 2023-07-27T14:26:38.544 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA== 2023-07-27T14:26:38.545 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.1] 2023-07-27T14:26:38.545 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ== 2023-07-27T14:26:38.545 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.2] 2023-07-27T14:26:38.545 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ== 2023-07-27T14:26:38.545 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.3] 2023-07-27T14:26:38.545 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w== 2023-07-27T14:26:38.545 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.x] 2023-07-27T14:26:38.545 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug== 2023-07-27T14:26:38.546 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2023-07-27T14:26:38.546 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA== 2023-07-27T14:26:38.546 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2023-07-27T14:26:38.546 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw== 2023-07-27T14:26:38.546 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.4] 2023-07-27T14:26:38.546 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg== 2023-07-27T14:26:38.546 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.5] 2023-07-27T14:26:38.546 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA== 2023-07-27T14:26:38.547 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.6] 2023-07-27T14:26:38.547 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg== 2023-07-27T14:26:38.547 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.7] 2023-07-27T14:26:38.547 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg== 2023-07-27T14:26:38.547 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2023-07-27T14:26:38.547 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg== 2023-07-27T14:26:38.547 INFO:teuthology.orchestra.run.smithi159.stdout:[client.2] 2023-07-27T14:26:38.548 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg== 2023-07-27T14:26:38.548 INFO:teuthology.orchestra.run.smithi159.stdout:[client.1] 2023-07-27T14:26:38.548 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g== 2023-07-27T14:26:38.549 INFO:teuthology.orchestra.run.smithi159.stdout:[client.3] 2023-07-27T14:26:38.549 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ== 2023-07-27T14:26:38.550 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-27T14:26:38.562 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-27T14:26:38.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T14:26:38.695 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T14:26:38.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T14:26:38.805 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T14:26:38.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:38.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.016 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.126 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.231 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-27T14:26:39.337 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-27T14:26:39.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T14:26:39.443 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T14:26:39.547 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T14:26:39.552 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-27T14:26:39.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.662 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.764 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.769 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.875 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.978 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:39.982 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-27T14:26:40.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T14:26:40.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T14:26:40.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T14:26:40.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T14:26:40.303 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T14:26:40.307 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T14:26:40.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T14:26:40.416 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-27T14:26:40.521 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-27T14:26:40.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-27T14:26:40.590 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-27T14:26:40.704 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-27T14:26:40.773 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-27T14:26:40.843 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-27T14:26:40.960 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-27T14:26:41.031 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-27T14:26:41.100 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-27T14:26:41.215 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-27T14:26:41.285 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:41.289 DEBUG:teuthology.orchestra.run.smithi159:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-27T14:26:41.335 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-27T14:26:41.335 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-27T14:26:41.336 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-27T14:26:41.376 INFO:tasks.ceph.mon.a:Started 2023-07-27T14:26:41.376 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-27T14:26:41.376 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-27T14:26:41.380 INFO:tasks.ceph.mon.b:Started 2023-07-27T14:26:41.381 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-27T14:26:41.381 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-27T14:26:41.385 INFO:tasks.ceph.mon.c:Started 2023-07-27T14:26:41.385 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-27T14:26:41.385 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-27T14:26:41.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-27T14:26:41.389 INFO:tasks.ceph.mgr.y:Started 2023-07-27T14:26:41.390 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-27T14:26:41.390 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-27T14:26:41.394 INFO:tasks.ceph.mgr.x:Started 2023-07-27T14:26:41.394 INFO:tasks.ceph:Setting crush tunables to default 2023-07-27T14:26:41.394 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd crush tunables default 2023-07-27T14:26:41.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.576+0000 7ff43afff700 1 Processor -- start 2023-07-27T14:26:41.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.576+0000 7ff43afff700 1 -- start start 2023-07-27T14:26:41.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff43afff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 0x7ff434154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff43afff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff43414b1e0 0x7ff434062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff43afff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4341553f0 con 0x7ff4340c5c50 2023-07-27T14:26:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff43afff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff434157a50 con 0x7ff43414ae00 2023-07-27T14:26:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff43afff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff434157d10 con 0x7ff43414b1e0 2023-07-27T14:26:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff438d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 0x7ff434154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff438d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 0x7ff434154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51224/0 (socket says 172.21.15.115:51224) 2023-07-27T14:26:41.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff438d9b700 1 -- 172.21.15.115:0/139995177 learned_addr learned my addr 172.21.15.115:0/139995177 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:41.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff43959c700 1 --1- 172.21.15.115:0/139995177 >> v1:172.21.15.115:6789/0 conn(0x7ff4340c5c50 0x7ff4340a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46072/0 (socket says 172.21.15.115:46072) 2023-07-27T14:26:41.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff433fff700 1 --2- 172.21.15.115:0/139995177 >> v2:172.21.15.159:3300/0 conn(0x7ff43414b1e0 0x7ff434062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:41.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff438d9b700 1 -- 172.21.15.115:0/139995177 >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 msgr2=0x7ff434154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-27T14:26:41.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff438d9b700 1 -- 172.21.15.115:0/139995177 >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 msgr2=0x7ff434154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-27T14:26:41.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff438d9b700 1 --2- 172.21.15.115:0/139995177 >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 0x7ff434154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-07-27T14:26:41.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff433fff700 1 -- 172.21.15.115:0/139995177 >> v2:172.21.15.159:3300/0 conn(0x7ff43414b1e0 msgr2=0x7ff434062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-27T14:26:41.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff433fff700 1 -- 172.21.15.115:0/139995177 >> v2:172.21.15.159:3300/0 conn(0x7ff43414b1e0 msgr2=0x7ff434062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-27T14:26:41.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff438d9b700 1 --2- 172.21.15.115:0/139995177 >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 0x7ff434154f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-07-27T14:26:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff433fff700 1 --2- 172.21.15.115:0/139995177 >> v2:172.21.15.159:3300/0 conn(0x7ff43414b1e0 0x7ff434062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-07-27T14:26:41.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.578+0000 7ff433fff700 1 --2- 172.21.15.115:0/139995177 >> v2:172.21.15.159:3300/0 conn(0x7ff43414b1e0 0x7ff434062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-07-27T14:26:41.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.767+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466283494 0 0) 0x7ff4341553f0 con 0x7ff4340c5c50 2023-07-27T14:26:41.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.767+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4240033f0 con 0x7ff4340c5c50 2023-07-27T14:26:41.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1886829229 0 0) 0x7ff4240033f0 con 0x7ff4340c5c50 2023-07-27T14:26:41.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 >> v2:172.21.15.159:3300/0 conn(0x7ff43414b1e0 msgr2=0x7ff434062b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T14:26:41.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 --2- 172.21.15.115:0/139995177 >> v2:172.21.15.159:3300/0 conn(0x7ff43414b1e0 0x7ff434062b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 msgr2=0x7ff434154f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-27T14:26:41.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 --2- 172.21.15.115:0/139995177 >> v2:172.21.15.115:3300/0 conn(0x7ff43414ae00 0x7ff434154f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434157ff0 con 0x7ff4340c5c50 2023-07-27T14:26:41.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7ff42c001470 con 0x7ff4340c5c50 2023-07-27T14:26:41.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 >> v1:172.21.15.115:6789/0 conn(0x7ff4340c5c50 legacy=0x7ff4340a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:41.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4240038e0 0x7ff424003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:41.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff424004690 0x7ff424004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:41.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff424005000 0x7ff42400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:41.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434157a50 con 0x7ff424005000 2023-07-27T14:26:41.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434157d10 con 0x7ff424004690 2023-07-27T14:26:41.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.768+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42400bfb0 con 0x7ff4240038e0 2023-07-27T14:26:41.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff433fff700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff424004690 0x7ff424004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:41.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff438d9b700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4240038e0 0x7ff424003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:41.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff43959c700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff424005000 0x7ff42400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:41.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff438d9b700 1 -- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff424004690 msgr2=0x7ff424004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:41.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff438d9b700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff424004690 0x7ff424004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff438d9b700 1 -- 172.21.15.115:0/139995177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff424005000 msgr2=0x7ff42400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:41.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff438d9b700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff424005000 0x7ff42400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff438d9b700 1 -- 172.21.15.115:0/139995177 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240033f0 con 0x7ff4240038e0 2023-07-27T14:26:41.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff43959c700 1 -- 172.21.15.115:0/139995177 reap_dead start 2023-07-27T14:26:41.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff433fff700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff424004690 0x7ff424004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:26:41.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.769+0000 7ff438d9b700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4240038e0 0x7ff424003d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff428009db0 tx=0x7ff4280091a0).ready entity=mon.2 client_cookie=11a93e7e35e6de30 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:41.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.771+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280097a0 con 0x7ff4240038e0 2023-07-27T14:26:41.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42800f040 con 0x7ff4240038e0 2023-07-27T14:26:41.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff4337fe700 1 -- 172.21.15.115:0/139995177 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428007d80 con 0x7ff4240038e0 2023-07-27T14:26:41.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff43afff700 1 -- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4240038e0 msgr2=0x7ff424003d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:41.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff43afff700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4240038e0 0x7ff424003d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff428009db0 tx=0x7ff4280091a0).stop 2023-07-27T14:26:41.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff43afff700 1 -- 172.21.15.115:0/139995177 shutdown_connections 2023-07-27T14:26:41.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff43afff700 1 --2- 172.21.15.115:0/139995177 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4240038e0 0x7ff424003d20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff43afff700 1 -- 172.21.15.115:0/139995177 >> 172.21.15.115:0/139995177 conn(0x7ff43405e940 msgr2=0x7ff4340cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:41.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff43afff700 1 -- 172.21.15.115:0/139995177 shutdown_connections 2023-07-27T14:26:41.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.772+0000 7ff43afff700 1 -- 172.21.15.115:0/139995177 wait complete. 2023-07-27T14:26:41.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.774+0000 7ff43afff700 1 Processor -- start 2023-07-27T14:26:41.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.775+0000 7ff43afff700 1 -- start start 2023-07-27T14:26:41.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff43afff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4240038e0 0x7ff434164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:41.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff43afff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff434150b80 0x7ff43414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:41.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff43afff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff43414f240 0x7ff43414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:41.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff43afff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4341653e0 con 0x7ff4240038e0 2023-07-27T14:26:41.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff43afff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4341512d0 con 0x7ff43414f240 2023-07-27T14:26:41.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff43afff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4341515b0 con 0x7ff434150b80 2023-07-27T14:26:41.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff438d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4240038e0 0x7ff434164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:41.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff438d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4240038e0 0x7ff434164ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51272/0 (socket says 172.21.15.115:51272) 2023-07-27T14:26:41.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff438d9b700 1 -- 172.21.15.115:0/1665037643 learned_addr learned my addr 172.21.15.115:0/1665037643 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:41.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff433fff700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff434150b80 0x7ff43414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:41.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.776+0000 7ff43959c700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff43414f240 0x7ff43414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:41.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.777+0000 7ff438d9b700 1 -- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff434150b80 msgr2=0x7ff43414ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:41.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.777+0000 7ff438d9b700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff434150b80 0x7ff43414ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.777+0000 7ff438d9b700 1 -- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff43414f240 msgr2=0x7ff43414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:41.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.777+0000 7ff438d9b700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff43414f240 0x7ff43414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.777+0000 7ff438d9b700 1 -- 172.21.15.115:0/1665037643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434151890 con 0x7ff4240038e0 2023-07-27T14:26:41.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.777+0000 7ff43959c700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff43414f240 0x7ff43414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:41.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.777+0000 7ff438d9b700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4240038e0 0x7ff434164ef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff42400c140 tx=0x7ff428017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:41.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.778+0000 7ff430ff9700 1 -- 172.21.15.115:0/1665037643 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428007e50 con 0x7ff4240038e0 2023-07-27T14:26:41.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.778+0000 7ff430ff9700 1 -- 172.21.15.115:0/1665037643 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff428014860 con 0x7ff4240038e0 2023-07-27T14:26:41.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.778+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff434151b70 con 0x7ff4240038e0 2023-07-27T14:26:41.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.778+0000 7ff430ff9700 1 -- 172.21.15.115:0/1665037643 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428014c20 con 0x7ff4240038e0 2023-07-27T14:26:41.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.778+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43414d550 con 0x7ff4240038e0 2023-07-27T14:26:41.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.778+0000 7ff430ff9700 1 -- 172.21.15.115:0/1665037643 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7ff428025030 con 0x7ff4240038e0 2023-07-27T14:26:41.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.778+0000 7ff430ff9700 1 -- 172.21.15.115:0/1665037643 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff428028440 con 0x7ff4240038e0 2023-07-27T14:26:41.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.779+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4340ae5d0 con 0x7ff4240038e0 2023-07-27T14:26:41.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.782+0000 7ff430ff9700 1 -- 172.21.15.115:0/1665037643 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff42802d060 con 0x7ff4240038e0 2023-07-27T14:26:41.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.855+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff43406c470 con 0x7ff4240038e0 2023-07-27T14:26:41.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.858+0000 7ff430ff9700 1 -- 172.21.15.115:0/1665037643 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff428023070 con 0x7ff4240038e0 2023-07-27T14:26:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4240038e0 msgr2=0x7ff434164ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4240038e0 0x7ff434164ef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff42400c140 tx=0x7ff428017000).stop 2023-07-27T14:26:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 shutdown_connections 2023-07-27T14:26:41.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff43414f240 0x7ff43414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4240038e0 0x7ff434164ef0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 --2- 172.21.15.115:0/1665037643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff434150b80 0x7ff43414ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:41.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 >> 172.21.15.115:0/1665037643 conn(0x7ff43405e940 msgr2=0x7ff4341537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:41.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 shutdown_connections 2023-07-27T14:26:41.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:41.860+0000 7ff43afff700 1 -- 172.21.15.115:0/1665037643 wait complete. 2023-07-27T14:26:41.873 INFO:teuthology.orchestra.run.smithi115.stderr:adjusted tunables profile to default 2023-07-27T14:26:41.895 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-27T14:26:41.896 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:41.896 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-27T14:26:41.935 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:41.924+0000 7f63f8a14680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-27T14:26:41.962 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:41.951+0000 7fa808608680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-27T14:26:41.969 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:41.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-27T14:26:42.021 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:42.010+0000 7f63f8a14680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-27T14:26:42.039 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:42.040 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-27T14:26:42.055 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:42.044+0000 7fa808608680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-27T14:26:42.124 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-07-27T14:26:42.125 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-27T14:26:42.239 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:42.240 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-27T14:26:42.310 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:42.311 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-27T14:26:42.421 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:42.421 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-27T14:26:42.516 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:42.505+0000 7f63f8a14680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-27T14:26:42.534 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-07-27T14:26:42.535 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-27T14:26:42.577 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:42.566+0000 7fa808608680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-27T14:26:42.603 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new b6afaa2a-decb-4ace-a5f7-029b4d847b66 0 2023-07-27T14:26:42.829 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.817+0000 7fd5485ff700 1 Processor -- start 2023-07-27T14:26:42.829 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.817+0000 7fd5485ff700 1 -- start start 2023-07-27T14:26:42.831 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.818+0000 7fd5485ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014ae00 0x7fd540154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:42.831 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.818+0000 7fd5485ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd54014b1e0 0x7fd540062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:42.831 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd5485ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5401553f0 con 0x7fd5400c5c50 2023-07-27T14:26:42.831 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd5485ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd540157a50 con 0x7fd54014b1e0 2023-07-27T14:26:42.831 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd5485ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd540157d10 con 0x7fd54014ae00 2023-07-27T14:26:42.832 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd54639b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014ae00 0x7fd540154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:42.832 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd546b9c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fd5400c5c50 0x7fd5400a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53236/0 (socket says 172.21.15.159:53236) 2023-07-27T14:26:42.832 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd546b9c700 1 -- 172.21.15.159:0/161111868 learned_addr learned my addr 172.21.15.159:0/161111868 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:26:42.832 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd545b9a700 1 --2- 172.21.15.159:0/161111868 >> v2:172.21.15.115:3300/0 conn(0x7fd54014b1e0 0x7fd540062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:42.832 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd54639b700 1 -- 172.21.15.159:0/161111868 >> v2:172.21.15.115:3300/0 conn(0x7fd54014b1e0 msgr2=0x7fd540062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:42.832 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd54639b700 1 --2- 172.21.15.159:0/161111868 >> v2:172.21.15.115:3300/0 conn(0x7fd54014b1e0 0x7fd540062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:42.832 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd54639b700 1 -- 172.21.15.159:0/161111868 >> v1:172.21.15.159:6789/0 conn(0x7fd5400c5c50 legacy=0x7fd5400a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:42.833 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd545399700 1 -- 172.21.15.159:0/161111868 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237731861 0 0) 0x7fd5401553f0 con 0x7fd5400c5c50 2023-07-27T14:26:42.833 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd54639b700 1 -- 172.21.15.159:0/161111868 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540157ff0 con 0x7fd54014ae00 2023-07-27T14:26:42.833 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.819+0000 7fd54639b700 1 --2- 172.21.15.159:0/161111868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014ae00 0x7fd540154f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd53c009760 tx=0x7fd53c009060).ready entity=mon.2 client_cookie=1def78e6b2178822 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:42.834 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd545399700 1 -- 172.21.15.159:0/161111868 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00f510 con 0x7fd54014ae00 2023-07-27T14:26:42.834 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd545399700 1 -- 172.21.15.159:0/161111868 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00f670 con 0x7fd54014ae00 2023-07-27T14:26:42.834 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd545399700 1 -- 172.21.15.159:0/161111868 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00f9f0 con 0x7fd54014ae00 2023-07-27T14:26:42.834 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd5485ff700 1 -- 172.21.15.159:0/161111868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014ae00 msgr2=0x7fd540154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:42.834 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd5485ff700 1 --2- 172.21.15.159:0/161111868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014ae00 0x7fd540154f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd53c009760 tx=0x7fd53c009060).stop 2023-07-27T14:26:42.835 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd5485ff700 1 -- 172.21.15.159:0/161111868 shutdown_connections 2023-07-27T14:26:42.835 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd5485ff700 1 --2- 172.21.15.159:0/161111868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014ae00 0x7fd540154f00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:42.835 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd5485ff700 1 --2- 172.21.15.159:0/161111868 >> v2:172.21.15.115:3300/0 conn(0x7fd54014b1e0 0x7fd540062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:42.835 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd5485ff700 1 -- 172.21.15.159:0/161111868 >> 172.21.15.159:0/161111868 conn(0x7fd54005e940 msgr2=0x7fd5400cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:42.835 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd5485ff700 1 -- 172.21.15.159:0/161111868 shutdown_connections 2023-07-27T14:26:42.835 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.820+0000 7fd5485ff700 1 -- 172.21.15.159:0/161111868 wait complete. 2023-07-27T14:26:42.836 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.822+0000 7fd5485ff700 1 Processor -- start 2023-07-27T14:26:42.836 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.822+0000 7fd5485ff700 1 -- start start 2023-07-27T14:26:42.837 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd5485ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5400c5c50 0x7fd540149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:42.837 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd5485ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd54014ae00 0x7fd540154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:42.838 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd5485ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014b1e0 0x7fd540154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:42.838 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd5485ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd540149e20 con 0x7fd5400c5c50 2023-07-27T14:26:42.838 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd5485ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5401567f0 con 0x7fd54014ae00 2023-07-27T14:26:42.838 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd5485ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd540156ad0 con 0x7fd54014b1e0 2023-07-27T14:26:42.838 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd545b9a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd54014ae00 0x7fd540154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:42.838 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd546b9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014b1e0 0x7fd540154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:42.838 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd545b9a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd54014ae00 0x7fd540154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38892/0 (socket says 172.21.15.159:38892) 2023-07-27T14:26:42.839 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd545b9a700 1 -- 172.21.15.159:0/3045932875 learned_addr learned my addr 172.21.15.159:0/3045932875 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:42.839 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.823+0000 7fd54639b700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5400c5c50 0x7fd540149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:42.839 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd546b9c700 1 -- 172.21.15.159:0/3045932875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd54014ae00 msgr2=0x7fd540154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:42.839 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd546b9c700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd54014ae00 0x7fd540154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:42.839 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd546b9c700 1 -- 172.21.15.159:0/3045932875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5400c5c50 msgr2=0x7fd540149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:42.839 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd546b9c700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5400c5c50 0x7fd540149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:42.839 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd546b9c700 1 -- 172.21.15.159:0/3045932875 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0092a0 con 0x7fd54014b1e0 2023-07-27T14:26:42.840 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd54639b700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5400c5c50 0x7fd540149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:26:42.840 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd546b9c700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014b1e0 0x7fd540154b60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd53800c810 tx=0x7fd538007f90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:42.840 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd5367fc700 1 -- 172.21.15.159:0/3045932875 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538005d30 con 0x7fd54014b1e0 2023-07-27T14:26:42.840 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd5367fc700 1 -- 172.21.15.159:0/3045932875 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd538005e90 con 0x7fd54014b1e0 2023-07-27T14:26:42.840 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd5367fc700 1 -- 172.21.15.159:0/3045932875 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538007300 con 0x7fd54014b1e0 2023-07-27T14:26:42.840 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd540156db0 con 0x7fd54014b1e0 2023-07-27T14:26:42.840 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.824+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd540157370 con 0x7fd54014b1e0 2023-07-27T14:26:42.841 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.825+0000 7fd5367fc700 1 -- 172.21.15.159:0/3045932875 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fd538010070 con 0x7fd54014b1e0 2023-07-27T14:26:42.841 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.825+0000 7fd5367fc700 1 -- 172.21.15.159:0/3045932875 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fd538013bf0 con 0x7fd54014b1e0 2023-07-27T14:26:42.841 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.825+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5400acc50 con 0x7fd54014b1e0 2023-07-27T14:26:42.841 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.828+0000 7fd5367fc700 1 -- 172.21.15.159:0/3045932875 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd538013e30 con 0x7fd54014b1e0 2023-07-27T14:26:42.922 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.910+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b6afaa2a-decb-4ace-a5f7-029b4d847b66", "id": 0} v 0) v1 -- 0x7fd540157560 con 0x7fd54014b1e0 2023-07-27T14:26:42.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.919+0000 7fd5367fc700 1 -- 172.21.15.159:0/3045932875 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6afaa2a-decb-4ace-a5f7-029b4d847b66", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd538027400 con 0x7fd54014b1e0 2023-07-27T14:26:42.931 INFO:teuthology.orchestra.run.smithi159.stdout:0 2023-07-27T14:26:42.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014b1e0 msgr2=0x7fd540154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:42.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014b1e0 0x7fd540154b60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd53800c810 tx=0x7fd538007f90).stop 2023-07-27T14:26:42.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 shutdown_connections 2023-07-27T14:26:42.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd54014b1e0 0x7fd540154b60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:42.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5400c5c50 0x7fd540149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:42.933 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 --2- 172.21.15.159:0/3045932875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd54014ae00 0x7fd540154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:42.933 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 >> 172.21.15.159:0/3045932875 conn(0x7fd54005e940 msgr2=0x7fd5400c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:42.933 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 shutdown_connections 2023-07-27T14:26:42.933 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:42.920+0000 7fd5485ff700 1 -- 172.21.15.159:0/3045932875 wait complete. 2023-07-27T14:26:42.948 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new fa8a1b32-3d88-4eea-8cc6-2046fc002bd7 1 2023-07-27T14:26:43.133 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.121+0000 7fd07efff700 1 Processor -- start 2023-07-27T14:26:43.133 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.122+0000 7fd07efff700 1 -- start start 2023-07-27T14:26:43.135 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.123+0000 7fd07efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd07814ae00 0x7fd078154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.135 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.123+0000 7fd07efff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd07814b1e0 0x7fd078062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.135 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.123+0000 7fd07efff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0781553f0 con 0x7fd0780c5c50 2023-07-27T14:26:43.135 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.123+0000 7fd07efff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd078157a50 con 0x7fd07814b1e0 2023-07-27T14:26:43.135 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.123+0000 7fd07efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd078157d10 con 0x7fd07814ae00 2023-07-27T14:26:43.137 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd07cd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd07814ae00 0x7fd078154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.137 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd07cd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd07814ae00 0x7fd078154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:51220/0 (socket says 172.21.15.159:51220) 2023-07-27T14:26:43.137 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd07cd9b700 1 -- 172.21.15.159:0/3339382277 learned_addr learned my addr 172.21.15.159:0/3339382277 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:43.137 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd077fff700 1 --2- 172.21.15.159:0/3339382277 >> v2:172.21.15.115:3300/0 conn(0x7fd07814b1e0 0x7fd078062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.137 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd07cd9b700 1 -- 172.21.15.159:0/3339382277 >> v2:172.21.15.115:3300/0 conn(0x7fd07814b1e0 msgr2=0x7fd078062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:43.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd07cd9b700 1 --2- 172.21.15.159:0/3339382277 >> v2:172.21.15.115:3300/0 conn(0x7fd07814b1e0 0x7fd078062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd07cd9b700 1 -- 172.21.15.159:0/3339382277 >> v1:172.21.15.115:6789/0 conn(0x7fd0780c5c50 legacy=0x7fd0780a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd07cd9b700 1 -- 172.21.15.159:0/3339382277 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078157ff0 con 0x7fd07814ae00 2023-07-27T14:26:43.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd0777fe700 1 -- 172.21.15.159:0/3339382277 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965943000 0 0) 0x7fd0781553f0 con 0x7fd0780c5c50 2023-07-27T14:26:43.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.124+0000 7fd07cd9b700 1 --2- 172.21.15.159:0/3339382277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd07814ae00 0x7fd078154f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fd06c006fd0 tx=0x7fd06c0090f0).ready entity=mon.2 client_cookie=d705bfcf18d3cbe2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:43.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd0777fe700 1 -- 172.21.15.159:0/3339382277 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c00b580 con 0x7fd07814ae00 2023-07-27T14:26:43.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd0777fe700 1 -- 172.21.15.159:0/3339382277 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c00b6e0 con 0x7fd07814ae00 2023-07-27T14:26:43.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd0777fe700 1 -- 172.21.15.159:0/3339382277 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c00ba60 con 0x7fd07814ae00 2023-07-27T14:26:43.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd07efff700 1 -- 172.21.15.159:0/3339382277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd07814ae00 msgr2=0x7fd078154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd07efff700 1 --2- 172.21.15.159:0/3339382277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd07814ae00 0x7fd078154f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fd06c006fd0 tx=0x7fd06c0090f0).stop 2023-07-27T14:26:43.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd07efff700 1 -- 172.21.15.159:0/3339382277 shutdown_connections 2023-07-27T14:26:43.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd07efff700 1 --2- 172.21.15.159:0/3339382277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd07814ae00 0x7fd078154f00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd07efff700 1 --2- 172.21.15.159:0/3339382277 >> v2:172.21.15.115:3300/0 conn(0x7fd07814b1e0 0x7fd078062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.125+0000 7fd07efff700 1 -- 172.21.15.159:0/3339382277 >> 172.21.15.159:0/3339382277 conn(0x7fd07805e940 msgr2=0x7fd0780cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:43.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.126+0000 7fd07efff700 1 -- 172.21.15.159:0/3339382277 shutdown_connections 2023-07-27T14:26:43.140 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.126+0000 7fd07efff700 1 -- 172.21.15.159:0/3339382277 wait complete. 2023-07-27T14:26:43.141 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.127+0000 7fd07efff700 1 Processor -- start 2023-07-27T14:26:43.141 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.127+0000 7fd07efff700 1 -- start start 2023-07-27T14:26:43.142 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.128+0000 7fd07efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0780c5c50 0x7fd0781498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.142 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.128+0000 7fd07efff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07814ae00 0x7fd078154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.142 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.128+0000 7fd07efff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd07814b1e0 0x7fd07814a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.142 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.128+0000 7fd07efff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780adf70 con 0x7fd07814b1e0 2023-07-27T14:26:43.142 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.128+0000 7fd07efff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078157760 con 0x7fd07814ae00 2023-07-27T14:26:43.142 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.128+0000 7fd07efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0781571a0 con 0x7fd0780c5c50 2023-07-27T14:26:43.142 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0780c5c50 0x7fd0781498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.143 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0780c5c50 0x7fd0781498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:51230/0 (socket says 172.21.15.159:51230) 2023-07-27T14:26:43.143 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 -- 172.21.15.159:0/23383661 learned_addr learned my addr 172.21.15.159:0/23383661 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:43.143 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd077fff700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07814ae00 0x7fd078154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.143 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07d59c700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd07814b1e0 0x7fd07814a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.143 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 -- 172.21.15.159:0/23383661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07814ae00 msgr2=0x7fd078154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.143 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07814ae00 0x7fd078154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.143 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 -- 172.21.15.159:0/23383661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd07814b1e0 msgr2=0x7fd07814a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.144 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd07814b1e0 0x7fd07814a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.144 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 -- 172.21.15.159:0/23383661 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c009370 con 0x7fd0780c5c50 2023-07-27T14:26:43.144 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd07cd9b700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0780c5c50 0x7fd0781498a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd06c009130 tx=0x7fd06c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:43.144 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.129+0000 7fd074ff9700 1 -- 172.21.15.159:0/23383661 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c000bc0 con 0x7fd0780c5c50 2023-07-27T14:26:43.144 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.130+0000 7fd074ff9700 1 -- 172.21.15.159:0/23383661 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c00b850 con 0x7fd0780c5c50 2023-07-27T14:26:43.144 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.130+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd078157480 con 0x7fd0780c5c50 2023-07-27T14:26:43.144 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.130+0000 7fd074ff9700 1 -- 172.21.15.159:0/23383661 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c01c670 con 0x7fd0780c5c50 2023-07-27T14:26:43.144 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.130+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd078156ce0 con 0x7fd0780c5c50 2023-07-27T14:26:43.145 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.130+0000 7fd074ff9700 1 -- 172.21.15.159:0/23383661 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fd06c02c070 con 0x7fd0780c5c50 2023-07-27T14:26:43.145 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.130+0000 7fd074ff9700 1 -- 172.21.15.159:0/23383661 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fd06c00b9c0 con 0x7fd0780c5c50 2023-07-27T14:26:43.145 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.131+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0780ca500 con 0x7fd0780c5c50 2023-07-27T14:26:43.146 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.133+0000 7fd074ff9700 1 -- 172.21.15.159:0/23383661 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd06c044e50 con 0x7fd0780c5c50 2023-07-27T14:26:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.217+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fa8a1b32-3d88-4eea-8cc6-2046fc002bd7", "id": 1} v 0) v1 -- 0x7fd07806c470 con 0x7fd0780c5c50 2023-07-27T14:26:43.237 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.225+0000 7fd074ff9700 1 -- 172.21.15.159:0/23383661 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa8a1b32-3d88-4eea-8cc6-2046fc002bd7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd06c033070 con 0x7fd0780c5c50 2023-07-27T14:26:43.238 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:26:43.240 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.226+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0780c5c50 msgr2=0x7fd0781498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.240 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.226+0000 7fd07efff700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0780c5c50 0x7fd0781498a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd06c009130 tx=0x7fd06c017000).stop 2023-07-27T14:26:43.240 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.226+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 shutdown_connections 2023-07-27T14:26:43.241 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.226+0000 7fd07efff700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd07814b1e0 0x7fd07814a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.241 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.227+0000 7fd07efff700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0780c5c50 0x7fd0781498a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.241 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.227+0000 7fd07efff700 1 --2- 172.21.15.159:0/23383661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd07814ae00 0x7fd078154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.241 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.227+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 >> 172.21.15.159:0/23383661 conn(0x7fd07805e940 msgr2=0x7fd0780c9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:43.242 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.227+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 shutdown_connections 2023-07-27T14:26:43.242 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.227+0000 7fd07efff700 1 -- 172.21.15.159:0/23383661 wait complete. 2023-07-27T14:26:43.255 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new c9616e0b-b6b7-4caa-a515-239d3c36116c 2 2023-07-27T14:26:43.432 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:43.421+0000 7f63f8a14680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-27T14:26:43.436 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:43.426+0000 7fa808608680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-27T14:26:43.471 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.459+0000 7f8b36bff700 1 Processor -- start 2023-07-27T14:26:43.471 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.459+0000 7f8b36bff700 1 -- start start 2023-07-27T14:26:43.472 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b36bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8b3014ae00 0x7f8b30154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.473 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b36bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014b1e0 0x7f8b30062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.473 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b36bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b301553f0 con 0x7f8b300c5c50 2023-07-27T14:26:43.473 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b36bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b30157a50 con 0x7f8b3014ae00 2023-07-27T14:26:43.473 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b36bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30157d10 con 0x7f8b3014b1e0 2023-07-27T14:26:43.473 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b2ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014b1e0 0x7f8b30062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.473 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b2ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014b1e0 0x7f8b30062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:51232/0 (socket says 172.21.15.159:51232) 2023-07-27T14:26:43.473 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b2ffff700 1 -- 172.21.15.159:0/1775903877 learned_addr learned my addr 172.21.15.159:0/1775903877 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:43.474 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b3499b700 1 --2- 172.21.15.159:0/1775903877 >> v2:172.21.15.115:3300/0 conn(0x7f8b3014ae00 0x7f8b30154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.475 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b2ffff700 1 -- 172.21.15.159:0/1775903877 >> v2:172.21.15.115:3300/0 conn(0x7f8b3014ae00 msgr2=0x7f8b30154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:43.475 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b2ffff700 1 --2- 172.21.15.159:0/1775903877 >> v2:172.21.15.115:3300/0 conn(0x7f8b3014ae00 0x7f8b30154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.475 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b2ffff700 1 -- 172.21.15.159:0/1775903877 >> v1:172.21.15.115:6789/0 conn(0x7f8b300c5c50 legacy=0x7f8b300a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.475 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.461+0000 7f8b2ffff700 1 -- 172.21.15.159:0/1775903877 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30157ff0 con 0x7f8b3014b1e0 2023-07-27T14:26:43.475 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b2ffff700 1 --2- 172.21.15.159:0/1775903877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014b1e0 0x7f8b30062b50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8b1c006fd0 tx=0x7f8b1c0090f0).ready entity=mon.2 client_cookie=c97c5830df15f054 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:43.475 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b2f7fe700 1 -- 172.21.15.159:0/1775903877 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00b580 con 0x7f8b3014b1e0 2023-07-27T14:26:43.476 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b2f7fe700 1 -- 172.21.15.159:0/1775903877 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00b6e0 con 0x7f8b3014b1e0 2023-07-27T14:26:43.476 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b2f7fe700 1 -- 172.21.15.159:0/1775903877 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00ba60 con 0x7f8b3014b1e0 2023-07-27T14:26:43.476 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b36bff700 1 -- 172.21.15.159:0/1775903877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014b1e0 msgr2=0x7f8b30062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.476 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b36bff700 1 --2- 172.21.15.159:0/1775903877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014b1e0 0x7f8b30062b50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8b1c006fd0 tx=0x7f8b1c0090f0).stop 2023-07-27T14:26:43.476 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b36bff700 1 -- 172.21.15.159:0/1775903877 shutdown_connections 2023-07-27T14:26:43.476 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b36bff700 1 --2- 172.21.15.159:0/1775903877 >> v2:172.21.15.115:3300/0 conn(0x7f8b3014ae00 0x7f8b30154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.476 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b36bff700 1 --2- 172.21.15.159:0/1775903877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014b1e0 0x7f8b30062b50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.477 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.462+0000 7f8b36bff700 1 -- 172.21.15.159:0/1775903877 >> 172.21.15.159:0/1775903877 conn(0x7f8b3005e940 msgr2=0x7f8b300cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:43.477 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.463+0000 7f8b36bff700 1 -- 172.21.15.159:0/1775903877 shutdown_connections 2023-07-27T14:26:43.477 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.463+0000 7f8b36bff700 1 -- 172.21.15.159:0/1775903877 wait complete. 2023-07-27T14:26:43.478 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.464+0000 7f8b36bff700 1 Processor -- start 2023-07-27T14:26:43.478 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.464+0000 7f8b36bff700 1 -- start start 2023-07-27T14:26:43.479 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b36bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b300c5c50 0x7f8b300af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.479 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b36bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014ae00 0x7f8b30164c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.479 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b36bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b3014b1e0 0x7f8b300c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.479 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b36bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300af500 con 0x7f8b300c5c50 2023-07-27T14:26:43.479 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b36bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30165180 con 0x7f8b3014b1e0 2023-07-27T14:26:43.479 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b36bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30164800 con 0x7f8b3014ae00 2023-07-27T14:26:43.479 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b3499b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b300c5c50 0x7f8b300af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b3519c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b3014b1e0 0x7f8b300c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b3499b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b300c5c50 0x7f8b300af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.159:36242/0 (socket says 172.21.15.159:36242) 2023-07-27T14:26:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.465+0000 7f8b3499b700 1 -- 172.21.15.159:0/1790816309 learned_addr learned my addr 172.21.15.159:0/1790816309 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b2ffff700 1 --2- 172.21.15.159:0/1790816309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014ae00 0x7f8b30164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b3499b700 1 -- 172.21.15.159:0/1790816309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014ae00 msgr2=0x7f8b30164c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b3499b700 1 --2- 172.21.15.159:0/1790816309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014ae00 0x7f8b30164c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b3499b700 1 -- 172.21.15.159:0/1790816309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b3014b1e0 msgr2=0x7f8b300c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b3499b700 1 --2- 172.21.15.159:0/1790816309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b3014b1e0 0x7f8b300c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.481 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b3499b700 1 -- 172.21.15.159:0/1790816309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c009370 con 0x7f8b300c5c50 2023-07-27T14:26:43.481 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b3499b700 1 --2- 172.21.15.159:0/1790816309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b300c5c50 0x7f8b300af010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8b2400e960 tx=0x7f8b24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:43.481 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b2cff9700 1 -- 172.21.15.159:0/1790816309 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24012600 con 0x7f8b300c5c50 2023-07-27T14:26:43.481 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b2cff9700 1 -- 172.21.15.159:0/1790816309 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24012760 con 0x7f8b300c5c50 2023-07-27T14:26:43.481 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b2cff9700 1 -- 172.21.15.159:0/1790816309 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24012ae0 con 0x7f8b300c5c50 2023-07-27T14:26:43.481 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.466+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b300c2aa0 con 0x7f8b300c5c50 2023-07-27T14:26:43.481 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.467+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b300c2fe0 con 0x7f8b300c5c50 2023-07-27T14:26:43.482 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.467+0000 7f8b2cff9700 1 -- 172.21.15.159:0/1790816309 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f8b24022070 con 0x7f8b300c5c50 2023-07-27T14:26:43.482 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.467+0000 7f8b2cff9700 1 -- 172.21.15.159:0/1790816309 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f8b2401bab0 con 0x7f8b300c5c50 2023-07-27T14:26:43.482 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.468+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b30164ae0 con 0x7f8b300c5c50 2023-07-27T14:26:43.482 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.470+0000 7f8b2cff9700 1 -- 172.21.15.159:0/1790816309 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8b2403ae50 con 0x7f8b300c5c50 2023-07-27T14:26:43.522 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:43.511+0000 7fa808608680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-27T14:26:43.523 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:43.511+0000 7f63f8a14680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-27T14:26:43.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.554+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9616e0b-b6b7-4caa-a515-239d3c36116c", "id": 2} v 0) v1 -- 0x7f8b3006c470 con 0x7f8b300c5c50 2023-07-27T14:26:43.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.561+0000 7f8b2cff9700 1 -- 172.21.15.159:0/1790816309 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9616e0b-b6b7-4caa-a515-239d3c36116c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8b24029070 con 0x7f8b300c5c50 2023-07-27T14:26:43.573 INFO:teuthology.orchestra.run.smithi159.stdout:2 2023-07-27T14:26:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.562+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b300c5c50 msgr2=0x7f8b300af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.563+0000 7f8b36bff700 1 --2- 172.21.15.159:0/1790816309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b300c5c50 0x7f8b300af010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8b2400e960 tx=0x7f8b24009060).stop 2023-07-27T14:26:43.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.563+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 shutdown_connections 2023-07-27T14:26:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.563+0000 7f8b36bff700 1 --2- 172.21.15.159:0/1790816309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b3014b1e0 0x7f8b300c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.563+0000 7f8b36bff700 1 --2- 172.21.15.159:0/1790816309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b300c5c50 0x7f8b300af010 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.563+0000 7f8b36bff700 1 --2- 172.21.15.159:0/1790816309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b3014ae00 0x7f8b30164c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.563+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 >> 172.21.15.159:0/1790816309 conn(0x7f8b3005e940 msgr2=0x7f8b300a9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.563+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 shutdown_connections 2023-07-27T14:26:43.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.563+0000 7f8b36bff700 1 -- 172.21.15.159:0/1790816309 wait complete. 2023-07-27T14:26:43.591 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 915cb3df-6f6f-47f7-92a8-fa4ae4167471 3 2023-07-27T14:26:43.752 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:43.741+0000 7fa808608680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-27T14:26:43.767 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:43.755+0000 7f63f8a14680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-27T14:26:43.780 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.769+0000 7f16f7dff700 1 Processor -- start 2023-07-27T14:26:43.781 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.769+0000 7f16f7dff700 1 -- start start 2023-07-27T14:26:43.783 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f7dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f16f014ae00 0x7f16f0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.783 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f7dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f16f014b1e0 0x7f16f0062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.783 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f7dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f01553f0 con 0x7f16f00c5c50 2023-07-27T14:26:43.783 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f7dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f0157a50 con 0x7f16f014b1e0 2023-07-27T14:26:43.783 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f7dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f0157d10 con 0x7f16f014ae00 2023-07-27T14:26:43.783 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f5b9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f16f014ae00 0x7f16f0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.784 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f5b9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f16f014ae00 0x7f16f0154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38922/0 (socket says 172.21.15.159:38922) 2023-07-27T14:26:43.784 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f5b9b700 1 -- 172.21.15.159:0/3063786620 learned_addr learned my addr 172.21.15.159:0/3063786620 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:43.784 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.771+0000 7f16f539a700 1 --2- 172.21.15.159:0/3063786620 >> v2:172.21.15.115:3300/0 conn(0x7f16f014b1e0 0x7f16f0062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.785 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f5b9b700 1 -- 172.21.15.159:0/3063786620 >> v2:172.21.15.115:3300/0 conn(0x7f16f014b1e0 msgr2=0x7f16f0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:43.785 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f5b9b700 1 --2- 172.21.15.159:0/3063786620 >> v2:172.21.15.115:3300/0 conn(0x7f16f014b1e0 0x7f16f0062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.785 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f5b9b700 1 -- 172.21.15.159:0/3063786620 >> v1:172.21.15.115:6789/0 conn(0x7f16f00c5c50 legacy=0x7f16f00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.786 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f5b9b700 1 -- 172.21.15.159:0/3063786620 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0157ff0 con 0x7f16f014ae00 2023-07-27T14:26:43.786 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f4b99700 1 -- 172.21.15.159:0/3063786620 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068437470 0 0) 0x7f16f01553f0 con 0x7f16f00c5c50 2023-07-27T14:26:43.786 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f5b9b700 1 --2- 172.21.15.159:0/3063786620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f014ae00 0x7f16f0154f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f16f0155580 tx=0x7f16ec0090f0).ready entity=mon.1 client_cookie=6c1e80785c90837b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:43.786 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f4b99700 1 -- 172.21.15.159:0/3063786620 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00b520 con 0x7f16f014ae00 2023-07-27T14:26:43.786 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f4b99700 1 -- 172.21.15.159:0/3063786620 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00b680 con 0x7f16f014ae00 2023-07-27T14:26:43.786 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.772+0000 7f16f4b99700 1 -- 172.21.15.159:0/3063786620 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00ba00 con 0x7f16f014ae00 2023-07-27T14:26:43.786 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.773+0000 7f16f7dff700 1 -- 172.21.15.159:0/3063786620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f014ae00 msgr2=0x7f16f0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.787 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.773+0000 7f16f7dff700 1 --2- 172.21.15.159:0/3063786620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f014ae00 0x7f16f0154f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f16f0155580 tx=0x7f16ec0090f0).stop 2023-07-27T14:26:43.787 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.773+0000 7f16f7dff700 1 -- 172.21.15.159:0/3063786620 shutdown_connections 2023-07-27T14:26:43.787 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.773+0000 7f16f7dff700 1 --2- 172.21.15.159:0/3063786620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f014ae00 0x7f16f0154f00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.787 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.773+0000 7f16f7dff700 1 --2- 172.21.15.159:0/3063786620 >> v2:172.21.15.115:3300/0 conn(0x7f16f014b1e0 0x7f16f0062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.787 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.773+0000 7f16f7dff700 1 -- 172.21.15.159:0/3063786620 >> 172.21.15.159:0/3063786620 conn(0x7f16f005e940 msgr2=0x7f16f00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:43.787 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.773+0000 7f16f7dff700 1 -- 172.21.15.159:0/3063786620 shutdown_connections 2023-07-27T14:26:43.787 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.773+0000 7f16f7dff700 1 -- 172.21.15.159:0/3063786620 wait complete. 2023-07-27T14:26:43.789 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.774+0000 7f16f7dff700 1 Processor -- start 2023-07-27T14:26:43.789 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.775+0000 7f16f7dff700 1 -- start start 2023-07-27T14:26:43.789 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.775+0000 7f16f7dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f00c5c50 0x7f16f0167a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.789 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f7dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16f014ae00 0x7f16f00c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.790 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f7dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16f014b1e0 0x7f16f00ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:43.790 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f7dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0167000 con 0x7f16f014ae00 2023-07-27T14:26:43.790 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f7dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01675c0 con 0x7f16f00c5c50 2023-07-27T14:26:43.790 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f7dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00c2430 con 0x7f16f014b1e0 2023-07-27T14:26:43.790 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f5b9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f00c5c50 0x7f16f0167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.790 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f5b9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f00c5c50 0x7f16f0167a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38924/0 (socket says 172.21.15.159:38924) 2023-07-27T14:26:43.790 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f5b9b700 1 -- 172.21.15.159:0/112198898 learned_addr learned my addr 172.21.15.159:0/112198898 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:43.791 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f639c700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16f014b1e0 0x7f16f00ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.791 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f539a700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16f014ae00 0x7f16f00c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:43.791 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f539a700 1 -- 172.21.15.159:0/112198898 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16f014b1e0 msgr2=0x7f16f00ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.791 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f539a700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16f014b1e0 0x7f16f00ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.791 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f539a700 1 -- 172.21.15.159:0/112198898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f00c5c50 msgr2=0x7f16f0167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.791 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f539a700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f00c5c50 0x7f16f0167a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.791 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f539a700 1 -- 172.21.15.159:0/112198898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec009370 con 0x7f16f014ae00 2023-07-27T14:26:43.791 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.776+0000 7f16f5b9b700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f00c5c50 0x7f16f0167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:26:43.792 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.777+0000 7f16f539a700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16f014ae00 0x7f16f00c1c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f16e000e6f0 tx=0x7f16e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:43.792 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.777+0000 7f16e5ffb700 1 -- 172.21.15.159:0/112198898 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0012600 con 0x7f16f014ae00 2023-07-27T14:26:43.792 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.777+0000 7f16e5ffb700 1 -- 172.21.15.159:0/112198898 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0012760 con 0x7f16f014ae00 2023-07-27T14:26:43.792 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.777+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f00c2710 con 0x7f16f014ae00 2023-07-27T14:26:43.792 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.777+0000 7f16e5ffb700 1 -- 172.21.15.159:0/112198898 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0012ae0 con 0x7f16f014ae00 2023-07-27T14:26:43.792 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.777+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f00c2140 con 0x7f16f014ae00 2023-07-27T14:26:43.792 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.777+0000 7f16e5ffb700 1 -- 172.21.15.159:0/112198898 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f16e0022070 con 0x7f16f014ae00 2023-07-27T14:26:43.793 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.777+0000 7f16e5ffb700 1 -- 172.21.15.159:0/112198898 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f16e001a3b0 con 0x7f16f014ae00 2023-07-27T14:26:43.793 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.778+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f0167750 con 0x7f16f014ae00 2023-07-27T14:26:43.793 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.781+0000 7f16e5ffb700 1 -- 172.21.15.159:0/112198898 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f16e003ae50 con 0x7f16f014ae00 2023-07-27T14:26:43.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.864+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "915cb3df-6f6f-47f7-92a8-fa4ae4167471", "id": 3} v 0) v1 -- 0x7f16f0167f40 con 0x7f16f014ae00 2023-07-27T14:26:43.880 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.869+0000 7f16e5ffb700 1 -- 172.21.15.159:0/112198898 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "915cb3df-6f6f-47f7-92a8-fa4ae4167471", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16e0029070 con 0x7f16f014ae00 2023-07-27T14:26:43.881 INFO:teuthology.orchestra.run.smithi159.stdout:3 2023-07-27T14:26:43.881 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16f014ae00 msgr2=0x7f16f00c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:43.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16f014ae00 0x7f16f00c1c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f16e000e6f0 tx=0x7f16e0009060).stop 2023-07-27T14:26:43.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 shutdown_connections 2023-07-27T14:26:43.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f16f014b1e0 0x7f16f00ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16f00c5c50 0x7f16f0167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 --2- 172.21.15.159:0/112198898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f16f014ae00 0x7f16f00c1c50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:43.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 >> 172.21.15.159:0/112198898 conn(0x7f16f005e940 msgr2=0x7f16f0152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:43.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 shutdown_connections 2023-07-27T14:26:43.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:43.870+0000 7f16f7dff700 1 -- 172.21.15.159:0/112198898 wait complete. 2023-07-27T14:26:43.898 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 88231f0c-75b9-431e-9f8b-3661fe57ffe8 4 2023-07-27T14:26:44.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.073+0000 7efde4bff700 1 Processor -- start 2023-07-27T14:26:44.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.073+0000 7efde4bff700 1 -- start start 2023-07-27T14:26:44.086 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.074+0000 7efde4bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efde01522a0 0x7efde00638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efde4bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efde0152680 0x7efde0152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efde4bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde0063430 con 0x7efde0062320 2023-07-27T14:26:44.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efde4bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00c3a70 con 0x7efde01522a0 2023-07-27T14:26:44.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efde4bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde0152060 con 0x7efde0152680 2023-07-27T14:26:44.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdded9d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efde0152680 0x7efde0152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdded9d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efde0152680 0x7efde0152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38926/0 (socket says 172.21.15.159:38926) 2023-07-27T14:26:44.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdded9d700 1 -- 172.21.15.159:0/2641234002 learned_addr learned my addr 172.21.15.159:0/2641234002 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:44.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdddd9b700 1 --1- 172.21.15.159:0/2641234002 >> v1:172.21.15.159:6789/0 conn(0x7efde0062320 0x7efde00c3360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53250/0 (socket says 172.21.15.159:53250) 2023-07-27T14:26:44.088 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdde59c700 1 --2- 172.21.15.159:0/2641234002 >> v2:172.21.15.115:3300/0 conn(0x7efde01522a0 0x7efde00638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.089 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdded9d700 1 -- 172.21.15.159:0/2641234002 >> v2:172.21.15.115:3300/0 conn(0x7efde01522a0 msgr2=0x7efde00638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:44.089 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdded9d700 1 --2- 172.21.15.159:0/2641234002 >> v2:172.21.15.115:3300/0 conn(0x7efde01522a0 0x7efde00638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.089 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdded9d700 1 -- 172.21.15.159:0/2641234002 >> v1:172.21.15.159:6789/0 conn(0x7efde0062320 legacy=0x7efde00c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.089 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdded9d700 1 -- 172.21.15.159:0/2641234002 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0062820 con 0x7efde0152680 2023-07-27T14:26:44.089 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.075+0000 7efdded9d700 1 --2- 172.21.15.159:0/2641234002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0152680 0x7efde0152aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7efde005fbb0 tx=0x7efdd8009840).ready entity=mon.1 client_cookie=5fe71770f9cd02a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:44.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efddd59a700 1 -- 172.21.15.159:0/2641234002 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800e070 con 0x7efde0152680 2023-07-27T14:26:44.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efddd59a700 1 -- 172.21.15.159:0/2641234002 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd800ba20 con 0x7efde0152680 2023-07-27T14:26:44.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efddd59a700 1 -- 172.21.15.159:0/2641234002 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800bda0 con 0x7efde0152680 2023-07-27T14:26:44.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efde4bff700 1 -- 172.21.15.159:0/2641234002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0152680 msgr2=0x7efde0152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efde4bff700 1 --2- 172.21.15.159:0/2641234002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0152680 0x7efde0152aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7efde005fbb0 tx=0x7efdd8009840).stop 2023-07-27T14:26:44.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efde4bff700 1 -- 172.21.15.159:0/2641234002 shutdown_connections 2023-07-27T14:26:44.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efde4bff700 1 --2- 172.21.15.159:0/2641234002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0152680 0x7efde0152aa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efde4bff700 1 --2- 172.21.15.159:0/2641234002 >> v2:172.21.15.115:3300/0 conn(0x7efde01522a0 0x7efde00638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.091 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efde4bff700 1 -- 172.21.15.159:0/2641234002 >> 172.21.15.159:0/2641234002 conn(0x7efde00c7b90 msgr2=0x7efde00c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:44.091 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efde4bff700 1 -- 172.21.15.159:0/2641234002 shutdown_connections 2023-07-27T14:26:44.091 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.076+0000 7efde4bff700 1 -- 172.21.15.159:0/2641234002 wait complete. 2023-07-27T14:26:44.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.078+0000 7efde4bff700 1 Processor -- start 2023-07-27T14:26:44.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.078+0000 7efde4bff700 1 -- start start 2023-07-27T14:26:44.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efde4bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0062320 0x7efde014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efde4bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde01522a0 0x7efde0069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efde4bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efde0152680 0x7efde0153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efde4bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0069680 con 0x7efde01522a0 2023-07-27T14:26:44.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efde4bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0154170 con 0x7efde0062320 2023-07-27T14:26:44.094 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efde4bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde01543f0 con 0x7efde0152680 2023-07-27T14:26:44.094 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efdde59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0062320 0x7efde014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.094 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efdddd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde01522a0 0x7efde0069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.094 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efdde59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0062320 0x7efde014e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38934/0 (socket says 172.21.15.159:38934) 2023-07-27T14:26:44.094 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efdde59c700 1 -- 172.21.15.159:0/3307243159 learned_addr learned my addr 172.21.15.159:0/3307243159 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:44.094 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.079+0000 7efdded9d700 1 --2- 172.21.15.159:0/3307243159 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efde0152680 0x7efde0153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.095 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdddd9b700 1 -- 172.21.15.159:0/3307243159 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efde0152680 msgr2=0x7efde0153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.095 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdddd9b700 1 --2- 172.21.15.159:0/3307243159 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efde0152680 0x7efde0153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.095 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdddd9b700 1 -- 172.21.15.159:0/3307243159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0062320 msgr2=0x7efde014e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.095 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdddd9b700 1 --2- 172.21.15.159:0/3307243159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0062320 0x7efde014e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.095 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdddd9b700 1 -- 172.21.15.159:0/3307243159 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8009ae0 con 0x7efde01522a0 2023-07-27T14:26:44.095 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdddd9b700 1 --2- 172.21.15.159:0/3307243159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde01522a0 0x7efde0069190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7efde0062750 tx=0x7efdd4007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:44.095 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdce7fc700 1 -- 172.21.15.159:0/3307243159 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40070d0 con 0x7efde01522a0 2023-07-27T14:26:44.096 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdce7fc700 1 -- 172.21.15.159:0/3307243159 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd4007230 con 0x7efde01522a0 2023-07-27T14:26:44.096 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde01546d0 con 0x7efde01522a0 2023-07-27T14:26:44.096 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdce7fc700 1 -- 172.21.15.159:0/3307243159 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40075b0 con 0x7efde01522a0 2023-07-27T14:26:44.096 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde0154c90 con 0x7efde01522a0 2023-07-27T14:26:44.096 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.080+0000 7efdce7fc700 1 -- 172.21.15.159:0/3307243159 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7efdd4010070 con 0x7efde01522a0 2023-07-27T14:26:44.096 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.081+0000 7efdce7fc700 1 -- 172.21.15.159:0/3307243159 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7efdd4005b50 con 0x7efde01522a0 2023-07-27T14:26:44.096 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.081+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde00a82c0 con 0x7efde01522a0 2023-07-27T14:26:44.097 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.084+0000 7efdce7fc700 1 -- 172.21.15.159:0/3307243159 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7efde00a82c0 con 0x7efde01522a0 2023-07-27T14:26:44.178 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.166+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88231f0c-75b9-431e-9f8b-3661fe57ffe8", "id": 4} v 0) v1 -- 0x7efde005dfc0 con 0x7efde01522a0 2023-07-27T14:26:44.185 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.174+0000 7efdce7fc700 1 -- 172.21.15.159:0/3307243159 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88231f0c-75b9-431e-9f8b-3661fe57ffe8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efdd40134f0 con 0x7efde01522a0 2023-07-27T14:26:44.186 INFO:teuthology.orchestra.run.smithi159.stdout:4 2023-07-27T14:26:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde01522a0 msgr2=0x7efde0069190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 --2- 172.21.15.159:0/3307243159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde01522a0 0x7efde0069190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7efde0062750 tx=0x7efdd4007d30).stop 2023-07-27T14:26:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 shutdown_connections 2023-07-27T14:26:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 --2- 172.21.15.159:0/3307243159 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efde0152680 0x7efde0153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.187 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 --2- 172.21.15.159:0/3307243159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0062320 0x7efde014e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 --2- 172.21.15.159:0/3307243159 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde01522a0 0x7efde0069190 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 >> 172.21.15.159:0/3307243159 conn(0x7efde00c7b90 msgr2=0x7efde00bc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 shutdown_connections 2023-07-27T14:26:44.188 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.175+0000 7efde4bff700 1 -- 172.21.15.159:0/3307243159 wait complete. 2023-07-27T14:26:44.204 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new d6202331-b147-42cd-b935-d857c25b32bf 5 2023-07-27T14:26:44.281 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:44.270+0000 7fa808608680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-27T14:26:44.334 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:44.323+0000 7f63f8a14680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-27T14:26:44.387 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.375+0000 7f476fdff700 1 Processor -- start 2023-07-27T14:26:44.387 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.376+0000 7f476fdff700 1 -- start start 2023-07-27T14:26:44.389 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476fdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f476814ae00 0x7f4768154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.389 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476fdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4768063260 0x7f47680a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.389 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476fdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47681553f0 con 0x7f476814b1e0 2023-07-27T14:26:44.389 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476fdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4768157a50 con 0x7f476814ae00 2023-07-27T14:26:44.389 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476fdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4768157d10 con 0x7f4768063260 2023-07-27T14:26:44.389 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476e39c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4768063260 0x7f47680a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.390 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476e39c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4768063260 0x7f47680a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38944/0 (socket says 172.21.15.159:38944) 2023-07-27T14:26:44.390 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476e39c700 1 -- 172.21.15.159:0/4232485772 learned_addr learned my addr 172.21.15.159:0/4232485772 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:44.390 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476db9b700 1 --2- 172.21.15.159:0/4232485772 >> v2:172.21.15.115:3300/0 conn(0x7f476814ae00 0x7f4768154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.391 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476e39c700 1 -- 172.21.15.159:0/4232485772 >> v2:172.21.15.115:3300/0 conn(0x7f476814ae00 msgr2=0x7f4768154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:44.391 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.377+0000 7f476e39c700 1 --2- 172.21.15.159:0/4232485772 >> v2:172.21.15.115:3300/0 conn(0x7f476814ae00 0x7f4768154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.391 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.378+0000 7f476e39c700 1 -- 172.21.15.159:0/4232485772 >> v1:172.21.15.115:6789/0 conn(0x7f476814b1e0 legacy=0x7f4768062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.391 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.378+0000 7f476e39c700 1 -- 172.21.15.159:0/4232485772 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768157ff0 con 0x7f4768063260 2023-07-27T14:26:44.391 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.378+0000 7f476e39c700 1 --2- 172.21.15.159:0/4232485772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f47680a98c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4768083430 tx=0x7f4760009840).ready entity=mon.1 client_cookie=686a90c5b6e49cf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:44.392 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.378+0000 7f476cb99700 1 -- 172.21.15.159:0/4232485772 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476000e070 con 0x7f4768063260 2023-07-27T14:26:44.392 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.378+0000 7f476cb99700 1 -- 172.21.15.159:0/4232485772 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476000ba20 con 0x7f4768063260 2023-07-27T14:26:44.392 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.378+0000 7f476cb99700 1 -- 172.21.15.159:0/4232485772 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476000bda0 con 0x7f4768063260 2023-07-27T14:26:44.392 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.378+0000 7f476fdff700 1 -- 172.21.15.159:0/4232485772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 msgr2=0x7f47680a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.392 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.378+0000 7f476fdff700 1 --2- 172.21.15.159:0/4232485772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f47680a98c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f4768083430 tx=0x7f4760009840).stop 2023-07-27T14:26:44.392 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.379+0000 7f476fdff700 1 -- 172.21.15.159:0/4232485772 shutdown_connections 2023-07-27T14:26:44.392 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.379+0000 7f476fdff700 1 --2- 172.21.15.159:0/4232485772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f47680a98c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.393 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.379+0000 7f476fdff700 1 --2- 172.21.15.159:0/4232485772 >> v2:172.21.15.115:3300/0 conn(0x7f476814ae00 0x7f4768154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.393 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.379+0000 7f476fdff700 1 -- 172.21.15.159:0/4232485772 >> 172.21.15.159:0/4232485772 conn(0x7f476805e940 msgr2=0x7f47680cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:44.393 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.379+0000 7f476fdff700 1 -- 172.21.15.159:0/4232485772 shutdown_connections 2023-07-27T14:26:44.393 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.379+0000 7f476fdff700 1 -- 172.21.15.159:0/4232485772 wait complete. 2023-07-27T14:26:44.394 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.381+0000 7f476fdff700 1 Processor -- start 2023-07-27T14:26:44.394 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.381+0000 7f476fdff700 1 -- start start 2023-07-27T14:26:44.394 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.382+0000 7f476fdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f476814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.394 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.382+0000 7f476fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f476814ae00 0x7f4768149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.382+0000 7f476fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476814b1e0 0x7f47680afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.382+0000 7f476fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476814c8e0 con 0x7f476814b1e0 2023-07-27T14:26:44.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.382+0000 7f476fdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476814a1c0 con 0x7f4768063260 2023-07-27T14:26:44.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.382+0000 7f476fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47680b0230 con 0x7f476814ae00 2023-07-27T14:26:44.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.382+0000 7f476db9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f476814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476db9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f476814b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38950/0 (socket says 172.21.15.159:38950) 2023-07-27T14:26:44.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476db9b700 1 -- 172.21.15.159:0/223067963 learned_addr learned my addr 172.21.15.159:0/223067963 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:44.396 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476d39a700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f476814ae00 0x7f4768149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.396 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476e39c700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476814b1e0 0x7f47680afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476db9b700 1 -- 172.21.15.159:0/223067963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f476814ae00 msgr2=0x7f4768149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476db9b700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f476814ae00 0x7f4768149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476db9b700 1 -- 172.21.15.159:0/223067963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476814b1e0 msgr2=0x7f47680afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476db9b700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476814b1e0 0x7f47680afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476db9b700 1 -- 172.21.15.159:0/223067963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4760009ae0 con 0x7f4768063260 2023-07-27T14:26:44.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476db9b700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f476814b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f476400e960 tx=0x7f4764009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:44.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f475dffb700 1 -- 172.21.15.159:0/223067963 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764012600 con 0x7f4768063260 2023-07-27T14:26:44.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f475dffb700 1 -- 172.21.15.159:0/223067963 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764012760 con 0x7f4768063260 2023-07-27T14:26:44.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476814bcd0 con 0x7f4768063260 2023-07-27T14:26:44.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.383+0000 7f475dffb700 1 -- 172.21.15.159:0/223067963 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764012ae0 con 0x7f4768063260 2023-07-27T14:26:44.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.384+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476814c290 con 0x7f4768063260 2023-07-27T14:26:44.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.384+0000 7f475dffb700 1 -- 172.21.15.159:0/223067963 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f476401b660 con 0x7f4768063260 2023-07-27T14:26:44.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.384+0000 7f475dffb700 1 -- 172.21.15.159:0/223067963 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f476401a3b0 con 0x7f4768063260 2023-07-27T14:26:44.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.385+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476814cdd0 con 0x7f4768063260 2023-07-27T14:26:44.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.387+0000 7f475dffb700 1 -- 172.21.15.159:0/223067963 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f476403ae50 con 0x7f4768063260 2023-07-27T14:26:44.404 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:44.393+0000 7fa808608680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-27T14:26:44.462 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:44.450+0000 7f63f8a14680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-27T14:26:44.480 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.469+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6202331-b147-42cd-b935-d857c25b32bf", "id": 5} v 0) v1 -- 0x7f476806c470 con 0x7f4768063260 2023-07-27T14:26:44.489 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.477+0000 7f475dffb700 1 -- 172.21.15.159:0/223067963 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6202331-b147-42cd-b935-d857c25b32bf", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4764029030 con 0x7f4768063260 2023-07-27T14:26:44.489 INFO:teuthology.orchestra.run.smithi159.stdout:5 2023-07-27T14:26:44.490 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.478+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 msgr2=0x7f476814b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.490 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.478+0000 7f476fdff700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f476814b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f476400e960 tx=0x7f4764009060).stop 2023-07-27T14:26:44.490 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.478+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 shutdown_connections 2023-07-27T14:26:44.490 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.478+0000 7f476fdff700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476814b1e0 0x7f47680afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.491 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.478+0000 7f476fdff700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4768063260 0x7f476814b610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.491 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.478+0000 7f476fdff700 1 --2- 172.21.15.159:0/223067963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f476814ae00 0x7f4768149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.491 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.478+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 >> 172.21.15.159:0/223067963 conn(0x7f476805e940 msgr2=0x7f4768153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:44.491 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.478+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 shutdown_connections 2023-07-27T14:26:44.491 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.479+0000 7f476fdff700 1 -- 172.21.15.159:0/223067963 wait complete. 2023-07-27T14:26:44.507 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new f62d46d3-3060-4a27-b34e-954afc2fed95 6 2023-07-27T14:26:44.586 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:44.575+0000 7fa808608680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-27T14:26:44.658 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:44.647+0000 7f63f8a14680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-27T14:26:44.683 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:44.671+0000 7fa808608680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-27T14:26:44.695 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.683+0000 7fde545ff700 1 Processor -- start 2023-07-27T14:26:44.695 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.683+0000 7fde545ff700 1 -- start start 2023-07-27T14:26:44.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.684+0000 7fde545ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14ae00 0x7fde4c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.684+0000 7fde545ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fde4c063260 0x7fde4c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.684+0000 7fde545ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c1553f0 con 0x7fde4c14b1e0 2023-07-27T14:26:44.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.684+0000 7fde545ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c157a50 con 0x7fde4c063260 2023-07-27T14:26:44.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.684+0000 7fde545ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c157d10 con 0x7fde4c14ae00 2023-07-27T14:26:44.698 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde5239b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14ae00 0x7fde4c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde51b9a700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fde4c14b1e0 0x7fde4c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53262/0 (socket says 172.21.15.159:53262) 2023-07-27T14:26:44.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde51b9a700 1 -- 172.21.15.159:0/1416694582 learned_addr learned my addr 172.21.15.159:0/1416694582 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:26:44.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde52b9c700 1 --2- 172.21.15.159:0/1416694582 >> v2:172.21.15.159:3300/0 conn(0x7fde4c063260 0x7fde4c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde5239b700 1 -- 172.21.15.159:0/1416694582 >> v2:172.21.15.159:3300/0 conn(0x7fde4c063260 msgr2=0x7fde4c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:44.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde5239b700 1 --2- 172.21.15.159:0/1416694582 >> v2:172.21.15.159:3300/0 conn(0x7fde4c063260 0x7fde4c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde5239b700 1 -- 172.21.15.159:0/1416694582 >> v1:172.21.15.159:6789/0 conn(0x7fde4c14b1e0 legacy=0x7fde4c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde5239b700 1 -- 172.21.15.159:0/1416694582 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c157ff0 con 0x7fde4c14ae00 2023-07-27T14:26:44.700 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.685+0000 7fde5239b700 1 --2- 172.21.15.159:0/1416694582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14ae00 0x7fde4c154f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fde48009760 tx=0x7fde48009060).ready entity=mon.2 client_cookie=32b17564765f13d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:44.700 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde51399700 1 -- 172.21.15.159:0/1416694582 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800f510 con 0x7fde4c14ae00 2023-07-27T14:26:44.700 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde51399700 1 -- 172.21.15.159:0/1416694582 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4800f670 con 0x7fde4c14ae00 2023-07-27T14:26:44.700 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde51399700 1 -- 172.21.15.159:0/1416694582 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800f9f0 con 0x7fde4c14ae00 2023-07-27T14:26:44.700 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde545ff700 1 -- 172.21.15.159:0/1416694582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14ae00 msgr2=0x7fde4c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.700 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde545ff700 1 --2- 172.21.15.159:0/1416694582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14ae00 0x7fde4c154f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fde48009760 tx=0x7fde48009060).stop 2023-07-27T14:26:44.701 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde545ff700 1 -- 172.21.15.159:0/1416694582 shutdown_connections 2023-07-27T14:26:44.701 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde545ff700 1 --2- 172.21.15.159:0/1416694582 >> v2:172.21.15.159:3300/0 conn(0x7fde4c063260 0x7fde4c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.701 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde545ff700 1 --2- 172.21.15.159:0/1416694582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14ae00 0x7fde4c154f00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.701 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde545ff700 1 -- 172.21.15.159:0/1416694582 >> 172.21.15.159:0/1416694582 conn(0x7fde4c05e940 msgr2=0x7fde4c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:44.701 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde545ff700 1 -- 172.21.15.159:0/1416694582 shutdown_connections 2023-07-27T14:26:44.701 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.686+0000 7fde545ff700 1 -- 172.21.15.159:0/1416694582 wait complete. 2023-07-27T14:26:44.703 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.688+0000 7fde545ff700 1 Processor -- start 2023-07-27T14:26:44.704 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.688+0000 7fde545ff700 1 -- start start 2023-07-27T14:26:44.704 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde545ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde4c063260 0x7fde4c0b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.704 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde545ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde4c14ae00 0x7fde4c0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.704 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde545ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14b1e0 0x7fde4c147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:44.704 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde545ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c89c0 con 0x7fde4c14ae00 2023-07-27T14:26:44.704 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde545ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c146ad0 con 0x7fde4c063260 2023-07-27T14:26:44.704 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde545ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c8c10 con 0x7fde4c14b1e0 2023-07-27T14:26:44.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde5239b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde4c063260 0x7fde4c0b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde52b9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14b1e0 0x7fde4c147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde5239b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde4c063260 0x7fde4c0b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38978/0 (socket says 172.21.15.159:38978) 2023-07-27T14:26:44.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde5239b700 1 -- 172.21.15.159:0/3854369514 learned_addr learned my addr 172.21.15.159:0/3854369514 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:44.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.689+0000 7fde51b9a700 1 --2- 172.21.15.159:0/3854369514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde4c14ae00 0x7fde4c0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:44.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde52b9c700 1 -- 172.21.15.159:0/3854369514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde4c063260 msgr2=0x7fde4c0b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.705 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde52b9c700 1 --2- 172.21.15.159:0/3854369514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde4c063260 0x7fde4c0b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde52b9c700 1 -- 172.21.15.159:0/3854369514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde4c14ae00 msgr2=0x7fde4c0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde52b9c700 1 --2- 172.21.15.159:0/3854369514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde4c14ae00 0x7fde4c0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde52b9c700 1 -- 172.21.15.159:0/3854369514 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde480092a0 con 0x7fde4c14b1e0 2023-07-27T14:26:44.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde52b9c700 1 --2- 172.21.15.159:0/3854369514 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14b1e0 0x7fde4c147710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fde44009e50 tx=0x7fde4400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:44.706 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde427fc700 1 -- 172.21.15.159:0/3854369514 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400caa0 con 0x7fde4c14b1e0 2023-07-27T14:26:44.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde427fc700 1 -- 172.21.15.159:0/3854369514 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4400f040 con 0x7fde4c14b1e0 2023-07-27T14:26:44.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c0c91d0 con 0x7fde4c14b1e0 2023-07-27T14:26:44.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde427fc700 1 -- 172.21.15.159:0/3854369514 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400ce10 con 0x7fde4c14b1e0 2023-07-27T14:26:44.707 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c0c9790 con 0x7fde4c14b1e0 2023-07-27T14:26:44.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.690+0000 7fde427fc700 1 -- 172.21.15.159:0/3854369514 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fde44013870 con 0x7fde4c14b1e0 2023-07-27T14:26:44.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.691+0000 7fde427fc700 1 -- 172.21.15.159:0/3854369514 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fde44013b00 con 0x7fde4c14b1e0 2023-07-27T14:26:44.708 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.691+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c0c9b00 con 0x7fde4c14b1e0 2023-07-27T14:26:44.709 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.694+0000 7fde427fc700 1 -- 172.21.15.159:0/3854369514 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fde44013e40 con 0x7fde4c14b1e0 2023-07-27T14:26:44.760 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:44.748+0000 7f63f8a14680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-27T14:26:44.770 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:44.759+0000 7fa808608680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-27T14:26:44.789 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.777+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f62d46d3-3060-4a27-b34e-954afc2fed95", "id": 6} v 0) v1 -- 0x7fde4c06c470 con 0x7fde4c14b1e0 2023-07-27T14:26:44.797 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.785+0000 7fde427fc700 1 -- 172.21.15.159:0/3854369514 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f62d46d3-3060-4a27-b34e-954afc2fed95", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde4401d5f0 con 0x7fde4c14b1e0 2023-07-27T14:26:44.797 INFO:teuthology.orchestra.run.smithi159.stdout:6 2023-07-27T14:26:44.798 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14b1e0 msgr2=0x7fde4c147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:44.798 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 --2- 172.21.15.159:0/3854369514 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14b1e0 0x7fde4c147710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fde44009e50 tx=0x7fde4400b040).stop 2023-07-27T14:26:44.798 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 shutdown_connections 2023-07-27T14:26:44.798 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 --2- 172.21.15.159:0/3854369514 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde4c14b1e0 0x7fde4c147710 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.798 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 --2- 172.21.15.159:0/3854369514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde4c063260 0x7fde4c0b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.798 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 --2- 172.21.15.159:0/3854369514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde4c14ae00 0x7fde4c0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:44.799 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 >> 172.21.15.159:0/3854369514 conn(0x7fde4c05e940 msgr2=0x7fde4c148c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:44.799 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 shutdown_connections 2023-07-27T14:26:44.799 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.786+0000 7fde545ff700 1 -- 172.21.15.159:0/3854369514 wait complete. 2023-07-27T14:26:44.814 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 271856c5-2665-4174-bebd-58bc2c1dde74 7 2023-07-27T14:26:44.859 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:44.847+0000 7f63f8a14680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-27T14:26:45.005 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.993+0000 7f7052dff700 1 Processor -- start 2023-07-27T14:26:45.005 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.993+0000 7f7052dff700 1 -- start start 2023-07-27T14:26:45.007 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7052dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c0aab30 0x7f704c156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.007 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7052dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f704c0aaf10 0x7f704c0c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.007 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7052dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704c156070 con 0x7f704c065f10 2023-07-27T14:26:45.007 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7052dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704c152210 con 0x7f704c0aaf10 2023-07-27T14:26:45.007 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7052dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0c3380 con 0x7f704c0aab30 2023-07-27T14:26:45.008 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7050b9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c0aab30 0x7f704c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.008 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7050b9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c0aab30 0x7f704c156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:51278/0 (socket says 172.21.15.159:51278) 2023-07-27T14:26:45.008 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7050b9b700 1 -- 172.21.15.159:0/3867485435 learned_addr learned my addr 172.21.15.159:0/3867485435 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:45.008 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f704bfff700 1 --2- 172.21.15.159:0/3867485435 >> v2:172.21.15.159:3300/0 conn(0x7f704c0aaf10 0x7f704c0c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.010 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7050b9b700 1 -- 172.21.15.159:0/3867485435 >> v2:172.21.15.159:3300/0 conn(0x7f704c0aaf10 msgr2=0x7f704c0c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:45.010 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7050b9b700 1 --2- 172.21.15.159:0/3867485435 >> v2:172.21.15.159:3300/0 conn(0x7f704c0aaf10 0x7f704c0c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.010 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7050b9b700 1 -- 172.21.15.159:0/3867485435 >> v1:172.21.15.159:6789/0 conn(0x7f704c065f10 legacy=0x7f704c0bd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.010 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.995+0000 7f7050b9b700 1 -- 172.21.15.159:0/3867485435 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c155a20 con 0x7f704c0aab30 2023-07-27T14:26:45.010 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.996+0000 7f704bfff700 1 --2- 172.21.15.159:0/3867485435 >> v2:172.21.15.159:3300/0 conn(0x7f704c0aaf10 0x7f704c0c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:26:45.010 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.996+0000 7f7050b9b700 1 --2- 172.21.15.159:0/3867485435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c0aab30 0x7f704c156500 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f7040006fd0 tx=0x7f70400090f0).ready entity=mon.2 client_cookie=a21a88ce6fafa903 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:45.011 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.996+0000 7f704b7fe700 1 -- 172.21.15.159:0/3867485435 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000b580 con 0x7f704c0aab30 2023-07-27T14:26:45.011 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.996+0000 7f704b7fe700 1 -- 172.21.15.159:0/3867485435 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000b6e0 con 0x7f704c0aab30 2023-07-27T14:26:45.011 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.996+0000 7f704b7fe700 1 -- 172.21.15.159:0/3867485435 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000ba60 con 0x7f704c0aab30 2023-07-27T14:26:45.011 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.996+0000 7f7052dff700 1 -- 172.21.15.159:0/3867485435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c0aab30 msgr2=0x7f704c156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.011 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.996+0000 7f7052dff700 1 --2- 172.21.15.159:0/3867485435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c0aab30 0x7f704c156500 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f7040006fd0 tx=0x7f70400090f0).stop 2023-07-27T14:26:45.011 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.997+0000 7f7052dff700 1 -- 172.21.15.159:0/3867485435 shutdown_connections 2023-07-27T14:26:45.012 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.997+0000 7f7052dff700 1 --2- 172.21.15.159:0/3867485435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c0aab30 0x7f704c156500 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.012 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.997+0000 7f7052dff700 1 --2- 172.21.15.159:0/3867485435 >> v2:172.21.15.159:3300/0 conn(0x7f704c0aaf10 0x7f704c0c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.012 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.997+0000 7f7052dff700 1 -- 172.21.15.159:0/3867485435 >> 172.21.15.159:0/3867485435 conn(0x7f704c05e8f0 msgr2=0x7f704c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:45.012 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.997+0000 7f7052dff700 1 -- 172.21.15.159:0/3867485435 shutdown_connections 2023-07-27T14:26:45.012 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.997+0000 7f7052dff700 1 -- 172.21.15.159:0/3867485435 wait complete. 2023-07-27T14:26:45.012 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.998+0000 7f7052dff700 1 Processor -- start 2023-07-27T14:26:45.013 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.998+0000 7f7052dff700 1 -- start start 2023-07-27T14:26:45.014 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7052dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c065f10 0x7f704c1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.015 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7052dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f704c0aab30 0x7f704c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.015 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7052dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f704c0aaf10 0x7f704c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.015 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7052dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0646f0 con 0x7f704c0aaf10 2023-07-27T14:26:45.015 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7052dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0649d0 con 0x7f704c0aab30 2023-07-27T14:26:45.015 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7052dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c064cb0 con 0x7f704c065f10 2023-07-27T14:26:45.015 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7050b9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c065f10 0x7f704c1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.016 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7050b9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c065f10 0x7f704c1523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:51294/0 (socket says 172.21.15.159:51294) 2023-07-27T14:26:45.016 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f7050b9b700 1 -- 172.21.15.159:0/4146699161 learned_addr learned my addr 172.21.15.159:0/4146699161 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:26:45.016 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:44.999+0000 7f704bfff700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f704c0aab30 0x7f704c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.017 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f705139c700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f704c0aaf10 0x7f704c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.017 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7050b9b700 1 -- 172.21.15.159:0/4146699161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f704c0aab30 msgr2=0x7f704c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.017 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7050b9b700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f704c0aab30 0x7f704c14f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.018 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7050b9b700 1 -- 172.21.15.159:0/4146699161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f704c0aaf10 msgr2=0x7f704c0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.018 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7050b9b700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f704c0aaf10 0x7f704c0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.018 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7050b9b700 1 -- 172.21.15.159:0/4146699161 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380092a0 con 0x7f704c065f10 2023-07-27T14:26:45.018 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f705139c700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f704c0aaf10 0x7f704c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7050b9b700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c065f10 0x7f704c1523e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f7040009fd0 tx=0x7f7040017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7048ff9700 1 -- 172.21.15.159:0/4146699161 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040000bc0 con 0x7f704c065f10 2023-07-27T14:26:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7048ff9700 1 -- 172.21.15.159:0/4146699161 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000b850 con 0x7f704c065f10 2023-07-27T14:26:45.020 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040009370 con 0x7f704c065f10 2023-07-27T14:26:45.020 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.000+0000 7f7048ff9700 1 -- 172.21.15.159:0/4146699161 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040000d20 con 0x7f704c065f10 2023-07-27T14:26:45.020 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.001+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c065270 con 0x7f704c065f10 2023-07-27T14:26:45.021 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.001+0000 7f7048ff9700 1 -- 172.21.15.159:0/4146699161 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f704002c070 con 0x7f704c065f10 2023-07-27T14:26:45.021 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.001+0000 7f7048ff9700 1 -- 172.21.15.159:0/4146699161 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f7040025ae0 con 0x7f704c065f10 2023-07-27T14:26:45.021 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.002+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704c06c470 con 0x7f704c065f10 2023-07-27T14:26:45.022 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.004+0000 7f7048ff9700 1 -- 172.21.15.159:0/4146699161 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f7040044e50 con 0x7f704c065f10 2023-07-27T14:26:45.084 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:45.073+0000 7fa808608680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-27T14:26:45.098 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.086+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "271856c5-2665-4174-bebd-58bc2c1dde74", "id": 7} v 0) v1 -- 0x7f704c155d00 con 0x7f704c065f10 2023-07-27T14:26:45.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.094+0000 7f7048ff9700 1 -- 172.21.15.159:0/4146699161 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "271856c5-2665-4174-bebd-58bc2c1dde74", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7040033030 con 0x7f704c065f10 2023-07-27T14:26:45.107 INFO:teuthology.orchestra.run.smithi159.stdout:7 2023-07-27T14:26:45.107 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.095+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c065f10 msgr2=0x7f704c1523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.095+0000 7f7052dff700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c065f10 0x7f704c1523e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f7040009fd0 tx=0x7f7040017000).stop 2023-07-27T14:26:45.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.095+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 shutdown_connections 2023-07-27T14:26:45.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.095+0000 7f7052dff700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f704c0aaf10 0x7f704c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.095+0000 7f7052dff700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f704c065f10 0x7f704c1523e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.095+0000 7f7052dff700 1 --2- 172.21.15.159:0/4146699161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f704c0aab30 0x7f704c14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.095+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 >> 172.21.15.159:0/4146699161 conn(0x7f704c05e8f0 msgr2=0x7f704c06b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:45.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.096+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 shutdown_connections 2023-07-27T14:26:45.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:26:45.096+0000 7f7052dff700 1 -- 172.21.15.159:0/4146699161 wait complete. 2023-07-27T14:26:45.125 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-27T14:26:45.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-27T14:26:45.130 INFO:tasks.ceph.osd.0:Started 2023-07-27T14:26:45.130 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-27T14:26:45.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-27T14:26:45.134 INFO:tasks.ceph.osd.1:Started 2023-07-27T14:26:45.134 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-27T14:26:45.135 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-27T14:26:45.138 INFO:tasks.ceph.osd.2:Started 2023-07-27T14:26:45.139 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-27T14:26:45.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-27T14:26:45.144 INFO:tasks.ceph.osd.3:Started 2023-07-27T14:26:45.144 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-27T14:26:45.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-27T14:26:45.170 INFO:tasks.ceph.osd.4:Started 2023-07-27T14:26:45.170 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-27T14:26:45.170 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-27T14:26:45.174 INFO:tasks.ceph.osd.5:Started 2023-07-27T14:26:45.175 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-27T14:26:45.175 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-27T14:26:45.179 INFO:tasks.ceph.osd.6:Started 2023-07-27T14:26:45.180 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-27T14:26:45.180 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-27T14:26:45.185 INFO:tasks.ceph.osd.7:Started 2023-07-27T14:26:45.185 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:26:45.198 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:45.187+0000 7f63f8a14680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-27T14:26:45.367 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:45.355+0000 7fa808608680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-27T14:26:45.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.415+0000 7fd48c7ff700 1 Processor -- start 2023-07-27T14:26:45.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.416+0000 7fd48c7ff700 1 -- start start 2023-07-27T14:26:45.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48c7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd484153ec0 0x7fd4840a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48c7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48c7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd4840aaa40 0x7fd4840645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48c7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd484064ad0 con 0x7fd484153ec0 2023-07-27T14:26:45.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48c7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4840aa4d0 con 0x7fd4840aaa40 2023-07-27T14:26:45.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48c7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840c05c0 con 0x7fd4840aa050 2023-07-27T14:26:45.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48a59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd484153ec0 0x7fd4840a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48a59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd484153ec0 0x7fd4840a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51664/0 (socket says 172.21.15.115:51664) 2023-07-27T14:26:45.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48a59b700 1 -- 172.21.15.115:0/1799079452 learned_addr learned my addr 172.21.15.115:0/1799079452 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:45.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd48ad9c700 1 --2- 172.21.15.115:0/1799079452 >> v2:172.21.15.159:3300/0 conn(0x7fd4840aaa40 0x7fd4840645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.417+0000 7fd489d9a700 1 --2- 172.21.15.115:0/1799079452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd48a59b700 1 -- 172.21.15.115:0/1799079452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 msgr2=0x7fd4840640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:45.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd48a59b700 1 --2- 172.21.15.115:0/1799079452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd48a59b700 1 -- 172.21.15.115:0/1799079452 >> v2:172.21.15.159:3300/0 conn(0x7fd4840aaa40 msgr2=0x7fd4840645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:45.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd48a59b700 1 --2- 172.21.15.115:0/1799079452 >> v2:172.21.15.159:3300/0 conn(0x7fd4840aaa40 0x7fd4840645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd48a59b700 1 -- 172.21.15.115:0/1799079452 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4840bfc90 con 0x7fd484153ec0 2023-07-27T14:26:45.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd489d9a700 1 --2- 172.21.15.115:0/1799079452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:45.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd48a59b700 1 --2- 172.21.15.115:0/1799079452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd484153ec0 0x7fd4840a9b60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd48405fc30 tx=0x7fd4800090f0).ready entity=mon.0 client_cookie=d644bb991be0f180 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:45.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd489599700 1 -- 172.21.15.115:0/1799079452 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48000b520 con 0x7fd484153ec0 2023-07-27T14:26:45.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd489599700 1 -- 172.21.15.115:0/1799079452 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48000b680 con 0x7fd484153ec0 2023-07-27T14:26:45.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.418+0000 7fd489599700 1 -- 172.21.15.115:0/1799079452 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48000ba00 con 0x7fd484153ec0 2023-07-27T14:26:45.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 -- 172.21.15.115:0/1799079452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd484153ec0 msgr2=0x7fd4840a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 --2- 172.21.15.115:0/1799079452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd484153ec0 0x7fd4840a9b60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd48405fc30 tx=0x7fd4800090f0).stop 2023-07-27T14:26:45.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 -- 172.21.15.115:0/1799079452 shutdown_connections 2023-07-27T14:26:45.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 --2- 172.21.15.115:0/1799079452 >> v2:172.21.15.159:3300/0 conn(0x7fd4840aaa40 0x7fd4840645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 --2- 172.21.15.115:0/1799079452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd484153ec0 0x7fd4840a9b60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 --2- 172.21.15.115:0/1799079452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 -- 172.21.15.115:0/1799079452 >> 172.21.15.115:0/1799079452 conn(0x7fd4840cb610 msgr2=0x7fd4840c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:45.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 -- 172.21.15.115:0/1799079452 shutdown_connections 2023-07-27T14:26:45.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.419+0000 7fd48c7ff700 1 -- 172.21.15.115:0/1799079452 wait complete. 2023-07-27T14:26:45.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.420+0000 7fd48c7ff700 1 Processor -- start 2023-07-27T14:26:45.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.420+0000 7fd48c7ff700 1 -- start start 2023-07-27T14:26:45.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.421+0000 7fd48c7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.421+0000 7fd48c7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4840aaa40 0x7fd4840adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.421+0000 7fd48c7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd484153ec0 0x7fd4840ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:45.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.421+0000 7fd48c7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840c2840 con 0x7fd4840aaa40 2023-07-27T14:26:45.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.421+0000 7fd48c7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840c1c30 con 0x7fd484153ec0 2023-07-27T14:26:45.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.421+0000 7fd48c7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840c1f10 con 0x7fd4840aa050 2023-07-27T14:26:45.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd489d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4840aaa40 0x7fd4840adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48a59b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48ad9c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd484153ec0 0x7fd4840ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:45.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd489d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4840aaa40 0x7fd4840adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51678/0 (socket says 172.21.15.115:51678) 2023-07-27T14:26:45.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48ad9c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd484153ec0 0x7fd4840ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:41194/0 (socket says 172.21.15.115:41194) 2023-07-27T14:26:45.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48a59b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:47852/0 (socket says 172.21.15.115:47852) 2023-07-27T14:26:45.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd489d9a700 1 -- 172.21.15.115:0/3637164203 learned_addr learned my addr 172.21.15.115:0/3637164203 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:45.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48ad9c700 1 -- 172.21.15.115:0/3637164203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 msgr2=0x7fd4840afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48ad9c700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48ad9c700 1 -- 172.21.15.115:0/3637164203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4840aaa40 msgr2=0x7fd4840adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48ad9c700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4840aaa40 0x7fd4840adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48ad9c700 1 -- 172.21.15.115:0/3637164203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd480009370 con 0x7fd484153ec0 2023-07-27T14:26:45.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48a59b700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:26:45.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd489d9a700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4840aaa40 0x7fd4840adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:26:45.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.422+0000 7fd48ad9c700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd484153ec0 0x7fd4840ae030 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd4840c75e0 tx=0x7fd47c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:45.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.423+0000 7fd47a7fc700 1 -- 172.21.15.115:0/3637164203 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00ca70 con 0x7fd484153ec0 2023-07-27T14:26:45.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.423+0000 7fd47a7fc700 1 -- 172.21.15.115:0/3637164203 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00f040 con 0x7fd484153ec0 2023-07-27T14:26:45.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.423+0000 7fd47a7fc700 1 -- 172.21.15.115:0/3637164203 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00cde0 con 0x7fd484153ec0 2023-07-27T14:26:45.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.423+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4840c21f0 con 0x7fd484153ec0 2023-07-27T14:26:45.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.423+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4841503d0 con 0x7fd484153ec0 2023-07-27T14:26:45.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.423+0000 7fd47a7fc700 1 -- 172.21.15.115:0/3637164203 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fd47c013870 con 0x7fd484153ec0 2023-07-27T14:26:45.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.423+0000 7fd47a7fc700 1 -- 172.21.15.115:0/3637164203 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fd47c01db60 con 0x7fd484153ec0 2023-07-27T14:26:45.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.424+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48406c470 con 0x7fd484153ec0 2023-07-27T14:26:45.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.427+0000 7fd47a7fc700 1 -- 172.21.15.115:0/3637164203 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd47c013b00 con 0x7fd484153ec0 2023-07-27T14:26:45.503 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:45.491+0000 7f63f8a14680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-27T14:26:45.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.497+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4840c8230 con 0x7fd484153ec0 2023-07-27T14:26:45.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.498+0000 7fd47a7fc700 1 -- 172.21.15.115:0/3637164203 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7fd47c013ca0 con 0x7fd484153ec0 2023-07-27T14:26:45.509 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:45.510 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":10,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:26:45.089531+0000","last_up_change":"0.000000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:26:45.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd484153ec0 msgr2=0x7fd4840ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:45.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd484153ec0 0x7fd4840ae030 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd4840c75e0 tx=0x7fd47c00b040).stop 2023-07-27T14:26:45.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 shutdown_connections 2023-07-27T14:26:45.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd484153ec0 0x7fd4840ae030 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4840aa050 0x7fd4840afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 --2- 172.21.15.115:0/3637164203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4840aaa40 0x7fd4840adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:45.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 >> 172.21.15.115:0/3637164203 conn(0x7fd4840cb610 msgr2=0x7fd4840aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:45.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 shutdown_connections 2023-07-27T14:26:45.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:45.499+0000 7fd48c7ff700 1 -- 172.21.15.115:0/3637164203 wait complete. 2023-07-27T14:26:45.527 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-27T14:26:45.528 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-27T14:26:45.850 INFO:tasks.ceph.osd.3.smithi115.stderr:2023-07-27T14:26:45.839+0000 7f4f6b27a200 -1 Falling back to public interface 2023-07-27T14:26:45.852 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-07-27T14:26:45.840+0000 7f883a53c200 -1 Falling back to public interface 2023-07-27T14:26:45.861 INFO:tasks.ceph.osd.1.smithi115.stderr:2023-07-27T14:26:45.849+0000 7fb5cb0e8200 -1 Falling back to public interface 2023-07-27T14:26:45.861 INFO:tasks.ceph.osd.2.smithi115.stderr:2023-07-27T14:26:45.850+0000 7f239efc2200 -1 Falling back to public interface 2023-07-27T14:26:45.862 INFO:tasks.ceph.osd.2.smithi115.stderr:2023-07-27T14:26:45.851+0000 7f2395dfd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6813/0: (98) Address already in use 2023-07-27T14:26:45.867 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-07-27T14:26:45.856+0000 7fbcd5a54200 -1 Falling back to public interface 2023-07-27T14:26:45.870 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-07-27T14:26:45.858+0000 7febaa132200 -1 Falling back to public interface 2023-07-27T14:26:45.875 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-07-27T14:26:45.864+0000 7ffbd5f25200 -1 Falling back to public interface 2023-07-27T14:26:45.894 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-07-27T14:26:45.882+0000 7fda2689b200 -1 Falling back to public interface 2023-07-27T14:26:46.210 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:46.199+0000 7fa808608680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-27T14:26:46.298 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:46.286+0000 7fa808608680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-27T14:26:46.332 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-27T14:26:46.339 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:46.327+0000 7f63f8a14680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-27T14:26:46.399 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:46.388+0000 7fa808608680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-27T14:26:46.427 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:46.415+0000 7f63f8a14680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-27T14:26:46.501 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.489+0000 7f099d9ff700 1 Processor -- start 2023-07-27T14:26:46.501 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.490+0000 7f099d9ff700 1 -- start start 2023-07-27T14:26:46.505 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f099d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 0x7f09980bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:46.505 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f099d9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09981577e0 0x7f09980c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:46.506 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f099d9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980c2ab0 con 0x7f09980c37e0 2023-07-27T14:26:46.506 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f099d9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980bc8a0 con 0x7f09981577e0 2023-07-27T14:26:46.506 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f099d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09980c2290 con 0x7f0998157400 2023-07-27T14:26:46.506 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f09967fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09981577e0 0x7f09980c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:46.507 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f09967fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09981577e0 0x7f09980c1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51692/0 (socket says 172.21.15.115:51692) 2023-07-27T14:26:46.507 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f09967fc700 1 -- 172.21.15.115:0/2083681620 learned_addr learned my addr 172.21.15.115:0/2083681620 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:46.507 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.491+0000 7f0996ffd700 1 --2- 172.21.15.115:0/2083681620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 0x7f09980bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:46.507 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.492+0000 7f09967fc700 1 -- 172.21.15.115:0/2083681620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 msgr2=0x7f09980bc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:46.508 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.492+0000 7f09967fc700 1 --2- 172.21.15.115:0/2083681620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 0x7f09980bc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:46.508 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.492+0000 7f09967fc700 1 -- 172.21.15.115:0/2083681620 >> v1:172.21.15.159:6789/0 conn(0x7f09980c37e0 legacy=0x7f0998157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:46.508 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.492+0000 7f09967fc700 1 -- 172.21.15.115:0/2083681620 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980c24e0 con 0x7f09981577e0 2023-07-27T14:26:46.509 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.492+0000 7f09967fc700 1 --2- 172.21.15.115:0/2083681620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09981577e0 0x7f09980c1da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f098c006fd0 tx=0x7f098c0090f0).ready entity=mon.0 client_cookie=40f528bd3ab7c6dc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:46.509 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.492+0000 7f0995ffb700 1 -- 172.21.15.115:0/2083681620 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00b580 con 0x7f09981577e0 2023-07-27T14:26:46.509 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.492+0000 7f0995ffb700 1 -- 172.21.15.115:0/2083681620 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00b6e0 con 0x7f09981577e0 2023-07-27T14:26:46.510 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.492+0000 7f0995ffb700 1 -- 172.21.15.115:0/2083681620 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00ba60 con 0x7f09981577e0 2023-07-27T14:26:46.510 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.493+0000 7f099d9ff700 1 -- 172.21.15.115:0/2083681620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09981577e0 msgr2=0x7f09980c1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:46.510 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.493+0000 7f099d9ff700 1 --2- 172.21.15.115:0/2083681620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09981577e0 0x7f09980c1da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f098c006fd0 tx=0x7f098c0090f0).stop 2023-07-27T14:26:46.511 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.493+0000 7f099d9ff700 1 -- 172.21.15.115:0/2083681620 shutdown_connections 2023-07-27T14:26:46.511 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.493+0000 7f099d9ff700 1 --2- 172.21.15.115:0/2083681620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 0x7f09980bc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:46.511 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.493+0000 7f099d9ff700 1 --2- 172.21.15.115:0/2083681620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09981577e0 0x7f09980c1da0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:46.511 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.493+0000 7f099d9ff700 1 -- 172.21.15.115:0/2083681620 >> 172.21.15.115:0/2083681620 conn(0x7f0998062320 msgr2=0x7f0998062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:46.512 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.493+0000 7f099d9ff700 1 -- 172.21.15.115:0/2083681620 shutdown_connections 2023-07-27T14:26:46.512 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.493+0000 7f099d9ff700 1 -- 172.21.15.115:0/2083681620 wait complete. 2023-07-27T14:26:46.516 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.494+0000 7f099d9ff700 1 Processor -- start 2023-07-27T14:26:46.516 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.494+0000 7f099d9ff700 1 -- start start 2023-07-27T14:26:46.516 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.495+0000 7f099d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c37e0 0x7f099814b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:46.517 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.495+0000 7f099d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 0x7f09980aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:46.517 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.495+0000 7f099d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09981577e0 0x7f09980a6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:46.517 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.495+0000 7f099d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099814bc60 con 0x7f09980c37e0 2023-07-27T14:26:46.518 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.495+0000 7f099d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980c5570 con 0x7f09981577e0 2023-07-27T14:26:46.518 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.495+0000 7f099d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09980ab220 con 0x7f0998157400 2023-07-27T14:26:46.518 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c37e0 0x7f099814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:46.518 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c37e0 0x7f099814b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51702/0 (socket says 172.21.15.115:51702) 2023-07-27T14:26:46.519 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 -- 172.21.15.115:0/3264841396 learned_addr learned my addr 172.21.15.115:0/3264841396 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:46.519 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f09967fc700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 0x7f09980aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:46.519 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f09977fe700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09981577e0 0x7f09980a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:46.520 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 -- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 msgr2=0x7f09980aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:46.520 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 0x7f09980aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:46.520 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 -- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09981577e0 msgr2=0x7f09980a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:46.520 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09981577e0 0x7f09980a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:46.521 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 -- 172.21.15.115:0/3264841396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009370 con 0x7f09980c37e0 2023-07-27T14:26:46.521 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f09977fe700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09981577e0 0x7f09980a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:46.521 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f0996ffd700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c37e0 0x7f099814b770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f098800e930 tx=0x7f0988009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:46.521 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f097effd700 1 -- 172.21.15.115:0/3264841396 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800c670 con 0x7f09980c37e0 2023-07-27T14:26:46.522 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f097effd700 1 -- 172.21.15.115:0/3264841396 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098800c7d0 con 0x7f09980c37e0 2023-07-27T14:26:46.522 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f097effd700 1 -- 172.21.15.115:0/3264841396 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800cb50 con 0x7f09980c37e0 2023-07-27T14:26:46.522 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.496+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09980ab500 con 0x7f09980c37e0 2023-07-27T14:26:46.522 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.497+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09980c5780 con 0x7f09980c37e0 2023-07-27T14:26:46.523 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.497+0000 7f097effd700 1 -- 172.21.15.115:0/3264841396 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f0988022070 con 0x7f09980c37e0 2023-07-27T14:26:46.523 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.497+0000 7f097effd700 1 -- 172.21.15.115:0/3264841396 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f0988012af0 con 0x7f09980c37e0 2023-07-27T14:26:46.523 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.498+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09980c5af0 con 0x7f09980c37e0 2023-07-27T14:26:46.523 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.500+0000 7f097effd700 1 -- 172.21.15.115:0/3264841396 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f098803ae50 con 0x7f09980c37e0 2023-07-27T14:26:46.525 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:46.513+0000 7f63f8a14680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-27T14:26:46.581 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.570+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f099806c470 con 0x7f09980c37e0 2023-07-27T14:26:46.582 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.570+0000 7f097effd700 1 -- 172.21.15.115:0/3264841396 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f0988029030 con 0x7f09980c37e0 2023-07-27T14:26:46.582 INFO:teuthology.misc.health.smithi115.stdout: 2023-07-27T14:26:46.583 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":10,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:26:45.089531+0000","last_up_change":"0.000000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:26:46.583 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.571+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c37e0 msgr2=0x7f099814b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:46.584 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.571+0000 7f099d9ff700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c37e0 0x7f099814b770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f098800e930 tx=0x7f0988009060).stop 2023-07-27T14:26:46.584 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.571+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 shutdown_connections 2023-07-27T14:26:46.584 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.571+0000 7f099d9ff700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09981577e0 0x7f09980a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:46.584 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.571+0000 7f099d9ff700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c37e0 0x7f099814b770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:46.584 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.571+0000 7f099d9ff700 1 --2- 172.21.15.115:0/3264841396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0998157400 0x7f09980aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:46.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.571+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 >> 172.21.15.115:0/3264841396 conn(0x7f0998062320 msgr2=0x7f09981563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:46.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.572+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 shutdown_connections 2023-07-27T14:26:46.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:46.572+0000 7f099d9ff700 1 -- 172.21.15.115:0/3264841396 wait complete. 2023-07-27T14:26:46.596 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:46.584+0000 7fa808608680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-27T14:26:46.597 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-27T14:26:46.688 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:46.676+0000 7fa808608680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-27T14:26:46.714 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:46.702+0000 7f63f8a14680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-27T14:26:46.805 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:46.793+0000 7f63f8a14680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-27T14:26:46.832 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:46.821+0000 7fa808608680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-27T14:26:46.949 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:46.937+0000 7f63f8a14680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-27T14:26:46.963 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:46.951+0000 7fa808608680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-27T14:26:47.081 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:47.069+0000 7f63f8a14680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-27T14:26:47.345 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:47.333+0000 7fa808608680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-27T14:26:47.434 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:47.423+0000 7fa808608680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-27T14:26:47.467 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:47.455+0000 7f63f8a14680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-27T14:26:47.560 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-07-27T14:26:47.548+0000 7f63f8a14680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-27T14:26:48.451 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:48.439+0000 7fa7b81fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-27T14:26:48.455 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:26:48.443+0000 7fa7b81fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-27T14:26:49.608 INFO:tasks.ceph.osd.3.smithi115.stderr:2023-07-27T14:26:49.596+0000 7f4f6b27a200 -1 osd.3 0 log_to_monitors {default=true} 2023-07-27T14:26:49.618 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-07-27T14:26:49.606+0000 7f883a53c200 -1 osd.4 0 log_to_monitors {default=true} 2023-07-27T14:26:49.661 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-07-27T14:26:49.649+0000 7ffbd5f25200 -1 osd.7 0 log_to_monitors {default=true} 2023-07-27T14:26:49.668 INFO:tasks.ceph.osd.2.smithi115.stderr:2023-07-27T14:26:49.657+0000 7f239efc2200 -1 osd.2 0 log_to_monitors {default=true} 2023-07-27T14:26:49.677 INFO:tasks.ceph.osd.1.smithi115.stderr:2023-07-27T14:26:49.665+0000 7fb5cb0e8200 -1 osd.1 0 log_to_monitors {default=true} 2023-07-27T14:26:49.680 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-07-27T14:26:49.668+0000 7fbcd5a54200 -1 osd.0 0 log_to_monitors {default=true} 2023-07-27T14:26:49.688 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-07-27T14:26:49.676+0000 7febaa132200 -1 osd.6 0 log_to_monitors {default=true} 2023-07-27T14:26:49.706 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-07-27T14:26:49.694+0000 7fda2689b200 -1 osd.5 0 log_to_monitors {default=true} 2023-07-27T14:26:51.566 INFO:tasks.ceph.osd.1.smithi115.stderr:2023-07-27T14:26:51.554+0000 7fb5be7f6700 -1 osd.1 0 waiting for initial osdmap 2023-07-27T14:26:51.567 INFO:tasks.ceph.osd.3.smithi115.stderr:2023-07-27T14:26:51.553+0000 7f4f5e9f6700 -1 osd.3 0 waiting for initial osdmap 2023-07-27T14:26:51.567 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-07-27T14:26:51.555+0000 7fbcc91f6700 -1 osd.0 0 waiting for initial osdmap 2023-07-27T14:26:51.567 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-07-27T14:26:51.554+0000 7feb9d7f6700 -1 osd.6 0 waiting for initial osdmap 2023-07-27T14:26:51.568 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-07-27T14:26:51.554+0000 7fda19ff6700 -1 osd.5 0 waiting for initial osdmap 2023-07-27T14:26:51.568 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-07-27T14:26:51.555+0000 7f882dbf6700 -1 osd.4 0 waiting for initial osdmap 2023-07-27T14:26:51.568 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-07-27T14:26:51.555+0000 7ffbc95f6700 -1 osd.7 0 waiting for initial osdmap 2023-07-27T14:26:51.569 INFO:tasks.ceph.osd.2.smithi115.stderr:2023-07-27T14:26:51.556+0000 7f23925f6700 -1 osd.2 0 waiting for initial osdmap 2023-07-27T14:26:51.577 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-07-27T14:26:51.565+0000 7fbcc55fa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T14:26:51.577 INFO:tasks.ceph.osd.2.smithi115.stderr:2023-07-27T14:26:51.565+0000 7f238e9fa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T14:26:51.578 INFO:tasks.ceph.osd.1.smithi115.stderr:2023-07-27T14:26:51.565+0000 7fb5babfa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T14:26:51.578 INFO:tasks.ceph.osd.3.smithi115.stderr:2023-07-27T14:26:51.565+0000 7f4f5adfa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T14:26:51.579 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-07-27T14:26:51.565+0000 7f8829ffa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T14:26:51.579 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-07-27T14:26:51.565+0000 7fda163fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T14:26:51.579 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-07-27T14:26:51.565+0000 7ffbc59fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T14:26:51.580 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-07-27T14:26:51.565+0000 7feb99bfa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-27T14:26:53.403 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-27T14:26:53.581 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.569+0000 7f7e15bff700 1 Processor -- start 2023-07-27T14:26:53.581 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.569+0000 7f7e15bff700 1 -- start start 2023-07-27T14:26:53.582 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.570+0000 7f7e15bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e100aaa40 0x7f7e100640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.582 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.570+0000 7f7e15bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100aa4d0 con 0x7f7e10153ec0 2023-07-27T14:26:53.583 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.570+0000 7f7e15bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100c05c0 con 0x7f7e101542a0 2023-07-27T14:26:53.583 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.570+0000 7f7e15bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100aa270 con 0x7f7e100aaa40 2023-07-27T14:26:53.584 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7e10153ec0 0x7f7e100a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37278/0 (socket says 172.21.15.115:37278) 2023-07-27T14:26:53.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0f7fe700 1 -- 172.21.15.115:0/346736654 learned_addr learned my addr 172.21.15.115:0/346736654 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:26:53.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0effd700 1 --2- 172.21.15.115:0/346736654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e100aaa40 0x7f7e100640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0e7fc700 1 -- 172.21.15.115:0/346736654 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224773117 0 0) 0x7f7e00001110 con 0x7f7e10153ec0 2023-07-27T14:26:53.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0e7fc700 1 -- 172.21.15.115:0/346736654 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df80033f0 con 0x7f7e10153ec0 2023-07-27T14:26:53.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0e7fc700 1 -- 172.21.15.115:0/346736654 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009199266 0 0) 0x7f7e100c05c0 con 0x7f7e101542a0 2023-07-27T14:26:53.585 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0e7fc700 1 -- 172.21.15.115:0/346736654 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e00001110 con 0x7f7e101542a0 2023-07-27T14:26:53.586 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0effd700 1 -- 172.21.15.115:0/346736654 >> v1:172.21.15.159:6789/0 conn(0x7f7e101542a0 legacy=0x7f7e100c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.586 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0effd700 1 -- 172.21.15.115:0/346736654 >> v1:172.21.15.115:6789/0 conn(0x7f7e10153ec0 legacy=0x7f7e100a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.586 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0effd700 1 -- 172.21.15.115:0/346736654 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100bfc90 con 0x7f7e100aaa40 2023-07-27T14:26:53.586 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.571+0000 7f7e0effd700 1 --2- 172.21.15.115:0/346736654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e100aaa40 0x7f7e100640f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7e04009790 tx=0x7f7e04009060).ready entity=mon.2 client_cookie=b9c072f7ac78ef6a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:53.586 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e0e7fc700 1 -- 172.21.15.115:0/346736654 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400f510 con 0x7f7e100aaa40 2023-07-27T14:26:53.586 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e0e7fc700 1 -- 172.21.15.115:0/346736654 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400f670 con 0x7f7e100aaa40 2023-07-27T14:26:53.586 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e0e7fc700 1 -- 172.21.15.115:0/346736654 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400f9f0 con 0x7f7e100aaa40 2023-07-27T14:26:53.586 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e15bff700 1 -- 172.21.15.115:0/346736654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e100aaa40 msgr2=0x7f7e100640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.587 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e15bff700 1 --2- 172.21.15.115:0/346736654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e100aaa40 0x7f7e100640f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7e04009790 tx=0x7f7e04009060).stop 2023-07-27T14:26:53.587 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e15bff700 1 -- 172.21.15.115:0/346736654 shutdown_connections 2023-07-27T14:26:53.587 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e15bff700 1 --2- 172.21.15.115:0/346736654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e100aaa40 0x7f7e100640f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.588 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e15bff700 1 -- 172.21.15.115:0/346736654 >> 172.21.15.115:0/346736654 conn(0x7f7e100cb610 msgr2=0x7f7e100c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:53.588 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e15bff700 1 -- 172.21.15.115:0/346736654 shutdown_connections 2023-07-27T14:26:53.588 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.572+0000 7f7e15bff700 1 -- 172.21.15.115:0/346736654 wait complete. 2023-07-27T14:26:53.590 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.574+0000 7f7e15bff700 1 Processor -- start 2023-07-27T14:26:53.590 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.574+0000 7f7e15bff700 1 -- start start 2023-07-27T14:26:53.590 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e15bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e100aaa40 0x7f7e10165820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.590 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e15bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e10153ec0 0x7f7e100aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.591 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e15bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e101542a0 0x7f7e10152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.591 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e15bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100af660 con 0x7f7e100aaa40 2023-07-27T14:26:53.591 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e15bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100c4550 con 0x7f7e101542a0 2023-07-27T14:26:53.591 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e15bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100c47f0 con 0x7f7e10153ec0 2023-07-27T14:26:53.591 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e100aaa40 0x7f7e10165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.591 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e100aaa40 0x7f7e10165820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43686/0 (socket says 172.21.15.115:43686) 2023-07-27T14:26:53.591 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0f7fe700 1 -- 172.21.15.115:0/1398628428 learned_addr learned my addr 172.21.15.115:0/1398628428 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:53.591 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0effd700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e10153ec0 0x7f7e100aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.592 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0ffff700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e101542a0 0x7f7e10152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.592 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0f7fe700 1 -- 172.21.15.115:0/1398628428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e10153ec0 msgr2=0x7f7e100aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.592 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0f7fe700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e10153ec0 0x7f7e100aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.592 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0f7fe700 1 -- 172.21.15.115:0/1398628428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e101542a0 msgr2=0x7f7e10152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.592 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.575+0000 7f7e0f7fe700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e101542a0 0x7f7e10152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.592 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.576+0000 7f7e0f7fe700 1 -- 172.21.15.115:0/1398628428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040092a0 con 0x7f7e100aaa40 2023-07-27T14:26:53.593 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.576+0000 7f7e0f7fe700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e100aaa40 0x7f7e10165820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7e0000c790 tx=0x7f7e00007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:53.593 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.576+0000 7f7df77fe700 1 -- 172.21.15.115:0/1398628428 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000072e0 con 0x7f7e100aaa40 2023-07-27T14:26:53.593 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.576+0000 7f7df77fe700 1 -- 172.21.15.115:0/1398628428 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00007440 con 0x7f7e100aaa40 2023-07-27T14:26:53.593 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.576+0000 7f7df77fe700 1 -- 172.21.15.115:0/1398628428 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000057a0 con 0x7f7e100aaa40 2023-07-27T14:26:53.593 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.576+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e100c4ad0 con 0x7f7e100aaa40 2023-07-27T14:26:53.593 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.576+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e100c86d0 con 0x7f7e100aaa40 2023-07-27T14:26:53.593 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.577+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1006c470 con 0x7f7e100aaa40 2023-07-27T14:26:53.593 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.578+0000 7f7df77fe700 1 -- 172.21.15.115:0/1398628428 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7e00010070 con 0x7f7e100aaa40 2023-07-27T14:26:53.594 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.579+0000 7f7df77fe700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dfc05ed60 0x7f7dfc061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.594 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.579+0000 7f7df77fe700 1 -- 172.21.15.115:0/1398628428 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f7e00078cb0 con 0x7f7e100aaa40 2023-07-27T14:26:53.594 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.579+0000 7f7e0effd700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dfc05ed60 0x7f7dfc061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.595 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.580+0000 7f7e0effd700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dfc05ed60 0x7f7dfc061220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7e100aae20 tx=0x7f7e04017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:53.596 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.584+0000 7f7df77fe700 1 -- 172.21.15.115:0/1398628428 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e0004a6a0 con 0x7f7e100aaa40 2023-07-27T14:26:53.769 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.757+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e100aa4d0 con 0x7f7e100aaa40 2023-07-27T14:26:53.770 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.758+0000 7f7df77fe700 1 -- 172.21.15.115:0/1398628428 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12324 (secure 0 0 0) 0x7f7e100aa4d0 con 0x7f7e100aaa40 2023-07-27T14:26:53.770 INFO:teuthology.misc.health.smithi115.stdout: 2023-07-27T14:26:53.771 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":14,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:26:53.562833+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:26:53.772 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dfc05ed60 msgr2=0x7f7dfc061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.773 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dfc05ed60 0x7f7dfc061220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7e100aae20 tx=0x7f7e04017000).stop 2023-07-27T14:26:53.773 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e100aaa40 msgr2=0x7f7e10165820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.773 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e100aaa40 0x7f7e10165820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7e0000c790 tx=0x7f7e00007d20).stop 2023-07-27T14:26:53.773 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 shutdown_connections 2023-07-27T14:26:53.773 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dfc05ed60 0x7f7dfc061220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.774 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e101542a0 0x7f7e10152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.774 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e100aaa40 0x7f7e10165820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.774 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 --2- 172.21.15.115:0/1398628428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e10153ec0 0x7f7e100aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.774 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 >> 172.21.15.115:0/1398628428 conn(0x7f7e100cb610 msgr2=0x7f7e100c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:53.774 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 shutdown_connections 2023-07-27T14:26:53.774 INFO:teuthology.misc.health.smithi115.stderr:2023-07-27T14:26:53.760+0000 7f7e15bff700 1 -- 172.21.15.115:0/1398628428 wait complete. 2023-07-27T14:26:53.787 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-27T14:26:53.788 INFO:tasks.ceph:Creating RBD pool 2023-07-27T14:26:53.788 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-27T14:26:53.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.958+0000 7eff30bff700 1 Processor -- start 2023-07-27T14:26:53.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.958+0000 7eff30bff700 1 -- start start 2023-07-27T14:26:53.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff30bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff2c14ae00 0x7eff2c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff30bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14b1e0 0x7eff2c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff30bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7eff2c0c5c50 0x7eff2c063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff30bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c063530 con 0x7eff2c14ae00 2023-07-27T14:26:53.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff30bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c1553f0 con 0x7eff2c0c5c50 2023-07-27T14:26:53.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff30bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c157a50 con 0x7eff2c14b1e0 2023-07-27T14:26:53.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2a59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff2c14ae00 0x7eff2c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2a59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff2c14ae00 0x7eff2c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43700/0 (socket says 172.21.15.115:43700) 2023-07-27T14:26:53.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2a59c700 1 -- 172.21.15.115:0/617996872 learned_addr learned my addr 172.21.15.115:0/617996872 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:53.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff29d9b700 1 --2- 172.21.15.115:0/617996872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14b1e0 0x7eff2c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2ad9d700 1 --2- 172.21.15.115:0/617996872 >> v2:172.21.15.159:3300/0 conn(0x7eff2c0c5c50 0x7eff2c063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2a59c700 1 -- 172.21.15.115:0/617996872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14b1e0 msgr2=0x7eff2c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:53.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2a59c700 1 --2- 172.21.15.115:0/617996872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14b1e0 0x7eff2c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2a59c700 1 -- 172.21.15.115:0/617996872 >> v2:172.21.15.159:3300/0 conn(0x7eff2c0c5c50 msgr2=0x7eff2c063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:53.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2a59c700 1 --2- 172.21.15.115:0/617996872 >> v2:172.21.15.159:3300/0 conn(0x7eff2c0c5c50 0x7eff2c063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.960+0000 7eff2a59c700 1 -- 172.21.15.115:0/617996872 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c157d10 con 0x7eff2c14ae00 2023-07-27T14:26:53.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff2a59c700 1 --2- 172.21.15.115:0/617996872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c14ae00 0x7eff2c154f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7eff2c084190 tx=0x7eff1c0090f0).ready entity=mon.0 client_cookie=cd2c4230f4ad981c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:53.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff2959a700 1 -- 172.21.15.115:0/617996872 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00b600 con 0x7eff2c14ae00 2023-07-27T14:26:53.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff2959a700 1 -- 172.21.15.115:0/617996872 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00b760 con 0x7eff2c14ae00 2023-07-27T14:26:53.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff2959a700 1 -- 172.21.15.115:0/617996872 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00bae0 con 0x7eff2c14ae00 2023-07-27T14:26:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff30bff700 1 -- 172.21.15.115:0/617996872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c14ae00 msgr2=0x7eff2c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff30bff700 1 --2- 172.21.15.115:0/617996872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c14ae00 0x7eff2c154f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7eff2c084190 tx=0x7eff1c0090f0).stop 2023-07-27T14:26:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff30bff700 1 -- 172.21.15.115:0/617996872 shutdown_connections 2023-07-27T14:26:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff30bff700 1 --2- 172.21.15.115:0/617996872 >> v2:172.21.15.159:3300/0 conn(0x7eff2c0c5c50 0x7eff2c063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff30bff700 1 --2- 172.21.15.115:0/617996872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c14ae00 0x7eff2c154f00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff30bff700 1 --2- 172.21.15.115:0/617996872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14b1e0 0x7eff2c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff30bff700 1 -- 172.21.15.115:0/617996872 >> 172.21.15.115:0/617996872 conn(0x7eff2c05e940 msgr2=0x7eff2c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.961+0000 7eff30bff700 1 -- 172.21.15.115:0/617996872 shutdown_connections 2023-07-27T14:26:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.962+0000 7eff30bff700 1 -- 172.21.15.115:0/617996872 wait complete. 2023-07-27T14:26:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.963+0000 7eff30bff700 1 Processor -- start 2023-07-27T14:26:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.963+0000 7eff30bff700 1 -- start start 2023-07-27T14:26:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff30bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c5c50 0x7eff2c0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff30bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14ae00 0x7eff2c0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff30bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff2c14b1e0 0x7eff2c0af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff30bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0adce0 con 0x7eff2c0c5c50 2023-07-27T14:26:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff30bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0adfc0 con 0x7eff2c14b1e0 2023-07-27T14:26:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff30bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0ae2a0 con 0x7eff2c14ae00 2023-07-27T14:26:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff2a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c5c50 0x7eff2c0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff2a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c5c50 0x7eff2c0aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43702/0 (socket says 172.21.15.115:43702) 2023-07-27T14:26:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff2a59c700 1 -- 172.21.15.115:0/3780029756 learned_addr learned my addr 172.21.15.115:0/3780029756 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff2ad9d700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff2c14b1e0 0x7eff2c0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.964+0000 7eff29d9b700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14ae00 0x7eff2c0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff2a59c700 1 -- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14ae00 msgr2=0x7eff2c0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff2a59c700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14ae00 0x7eff2c0aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff2a59c700 1 -- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff2c14b1e0 msgr2=0x7eff2c0af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff2a59c700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff2c14b1e0 0x7eff2c0af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff2a59c700 1 -- 172.21.15.115:0/3780029756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c009370 con 0x7eff2c0c5c50 2023-07-27T14:26:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff29d9b700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14ae00 0x7eff2c0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff2a59c700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c5c50 0x7eff2c0aeaa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7eff1c009130 tx=0x7eff1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff1a7fc700 1 -- 172.21.15.115:0/3780029756 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c006a40 con 0x7eff2c0c5c50 2023-07-27T14:26:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff1a7fc700 1 -- 172.21.15.115:0/3780029756 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00b8d0 con 0x7eff2c0c5c50 2023-07-27T14:26:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff1a7fc700 1 -- 172.21.15.115:0/3780029756 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c01c670 con 0x7eff2c0c5c50 2023-07-27T14:26:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c0ae580 con 0x7eff2c0c5c50 2023-07-27T14:26:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.965+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c0c4920 con 0x7eff2c0c5c50 2023-07-27T14:26:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.966+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c06c470 con 0x7eff2c0c5c50 2023-07-27T14:26:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.967+0000 7eff1a7fc700 1 -- 172.21.15.115:0/3780029756 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7eff1c00f070 con 0x7eff2c0c5c50 2023-07-27T14:26:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.968+0000 7eff1a7fc700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff0c05ed90 0x7eff0c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:53.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.968+0000 7eff1a7fc700 1 -- 172.21.15.115:0/3780029756 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7eff1c07acc0 con 0x7eff2c0c5c50 2023-07-27T14:26:53.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.968+0000 7eff29d9b700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff0c05ed90 0x7eff0c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:53.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.969+0000 7eff29d9b700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff0c05ed90 0x7eff0c061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7eff20006fd0 tx=0x7eff20008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:53.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:53.972+0000 7eff1a7fc700 1 -- 172.21.15.115:0/3780029756 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff1c04c730 con 0x7eff2c0c5c50 2023-07-27T14:26:54.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.141+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7eff2c0ade20 con 0x7eff2c0c5c50 2023-07-27T14:26:54.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.572+0000 7eff1a7fc700 1 -- 172.21.15.115:0/3780029756 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7eff2c0ade20 con 0x7eff2c0c5c50 2023-07-27T14:26:54.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff0c05ed90 msgr2=0x7eff0c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:54.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff0c05ed90 0x7eff0c061250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7eff20006fd0 tx=0x7eff20008040).stop 2023-07-27T14:26:54.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c5c50 msgr2=0x7eff2c0aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:54.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c5c50 0x7eff2c0aeaa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7eff1c009130 tx=0x7eff1c017000).stop 2023-07-27T14:26:54.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 shutdown_connections 2023-07-27T14:26:54.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff0c05ed90 0x7eff0c061250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:54.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff2c14b1e0 0x7eff2c0af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:54.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c5c50 0x7eff2c0aeaa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:54.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 --2- 172.21.15.115:0/3780029756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c14ae00 0x7eff2c0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:54.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 >> 172.21.15.115:0/3780029756 conn(0x7eff2c05e940 msgr2=0x7eff2c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:54.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 shutdown_connections 2023-07-27T14:26:54.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.575+0000 7eff30bff700 1 -- 172.21.15.115:0/3780029756 wait complete. 2023-07-27T14:26:54.589 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'rbd' created 2023-07-27T14:26:54.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-27T14:26:54.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.780+0000 7f30859ff700 1 Processor -- start 2023-07-27T14:26:54.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.780+0000 7f30859ff700 1 -- start start 2023-07-27T14:26:54.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.781+0000 7f30859ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f308014ae00 0x7f3080154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.781+0000 7f30859ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30801553f0 con 0x7f3080063260 2023-07-27T14:26:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.781+0000 7f30859ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3080157a50 con 0x7f308014b1e0 2023-07-27T14:26:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.781+0000 7f30859ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3080157d10 con 0x7f308014ae00 2023-07-27T14:26:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f308014ae00 0x7f3080154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3080063260 0x7f30800a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37292/0 (socket says 172.21.15.115:37292) 2023-07-27T14:26:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307f7fe700 1 -- 172.21.15.115:0/3697403993 learned_addr learned my addr 172.21.15.115:0/3697403993 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:26:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307effd700 1 -- 172.21.15.115:0/3697403993 >> v1:172.21.15.159:6789/0 conn(0x7f308014b1e0 legacy=0x7f3080062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307effd700 1 -- 172.21.15.115:0/3697403993 >> v1:172.21.15.115:6789/0 conn(0x7f3080063260 legacy=0x7f30800a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307effd700 1 -- 172.21.15.115:0/3697403993 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3080157ff0 con 0x7f308014ae00 2023-07-27T14:26:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307dffb700 1 -- 172.21.15.115:0/3697403993 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658461132 0 0) 0x7f30801553f0 con 0x7f3080063260 2023-07-27T14:26:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307effd700 1 --2- 172.21.15.115:0/3697403993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f308014ae00 0x7f3080154f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3070009760 tx=0x7f3070009060).ready entity=mon.0 client_cookie=e7436c72d9ffaff3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307dffb700 1 -- 172.21.15.115:0/3697403993 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307000b580 con 0x7f308014ae00 2023-07-27T14:26:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307dffb700 1 -- 172.21.15.115:0/3697403993 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307000b6e0 con 0x7f308014ae00 2023-07-27T14:26:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.782+0000 7f307dffb700 1 -- 172.21.15.115:0/3697403993 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307000ba60 con 0x7f308014ae00 2023-07-27T14:26:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.783+0000 7f30859ff700 1 -- 172.21.15.115:0/3697403993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f308014ae00 msgr2=0x7f3080154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.783+0000 7f30859ff700 1 --2- 172.21.15.115:0/3697403993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f308014ae00 0x7f3080154f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3070009760 tx=0x7f3070009060).stop 2023-07-27T14:26:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.783+0000 7f30859ff700 1 -- 172.21.15.115:0/3697403993 shutdown_connections 2023-07-27T14:26:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.783+0000 7f30859ff700 1 --2- 172.21.15.115:0/3697403993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f308014ae00 0x7f3080154f00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.783+0000 7f30859ff700 1 -- 172.21.15.115:0/3697403993 >> 172.21.15.115:0/3697403993 conn(0x7f308005e940 msgr2=0x7f30800cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.783+0000 7f30859ff700 1 -- 172.21.15.115:0/3697403993 shutdown_connections 2023-07-27T14:26:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.783+0000 7f30859ff700 1 -- 172.21.15.115:0/3697403993 wait complete. 2023-07-27T14:26:54.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.784+0000 7f30859ff700 1 Processor -- start 2023-07-27T14:26:54.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.785+0000 7f30859ff700 1 -- start start 2023-07-27T14:26:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.785+0000 7f30859ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3080063260 0x7f30801491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.785+0000 7f30859ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f308014ae00 0x7f308014d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f30859ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f308014b1e0 0x7f308014d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f30859ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3080164140 con 0x7f3080063260 2023-07-27T14:26:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f30859ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30801643e0 con 0x7f308014ae00 2023-07-27T14:26:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f30859ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30801646c0 con 0x7f308014b1e0 2023-07-27T14:26:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3080063260 0x7f30801491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3080063260 0x7f30801491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43728/0 (socket says 172.21.15.115:43728) 2023-07-27T14:26:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 -- 172.21.15.115:0/2944468096 learned_addr learned my addr 172.21.15.115:0/2944468096 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307f7fe700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f308014b1e0 0x7f308014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307e7fc700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f308014ae00 0x7f308014d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 -- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f308014b1e0 msgr2=0x7f308014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f308014b1e0 0x7f308014d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 -- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f308014ae00 msgr2=0x7f308014d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f308014ae00 0x7f308014d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 -- 172.21.15.115:0/2944468096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700092a0 con 0x7f3080063260 2023-07-27T14:26:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307e7fc700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f308014ae00 0x7f308014d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.786+0000 7f307effd700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3080063260 0x7f30801491d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3080155580 tx=0x7f3070017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.787+0000 7f3066ffd700 1 -- 172.21.15.115:0/2944468096 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307000ba60 con 0x7f3080063260 2023-07-27T14:26:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.787+0000 7f3066ffd700 1 -- 172.21.15.115:0/2944468096 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3070000c90 con 0x7f3080063260 2023-07-27T14:26:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.787+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30801649a0 con 0x7f3080063260 2023-07-27T14:26:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.787+0000 7f3066ffd700 1 -- 172.21.15.115:0/2944468096 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307001b660 con 0x7f3080063260 2023-07-27T14:26:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.787+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3080164ec0 con 0x7f3080063260 2023-07-27T14:26:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.788+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3080164d10 con 0x7f3080063260 2023-07-27T14:26:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.789+0000 7f3066ffd700 1 -- 172.21.15.115:0/2944468096 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f307000f070 con 0x7f3080063260 2023-07-27T14:26:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.789+0000 7f3066ffd700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f306c05ed90 0x7f306c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:54.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.790+0000 7f3066ffd700 1 -- 172.21.15.115:0/2944468096 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5258+0+0 (secure 0 0 0) 0x7f307007b3f0 con 0x7f3080063260 2023-07-27T14:26:54.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.790+0000 7f307e7fc700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f306c05ed90 0x7f306c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:54.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.790+0000 7f307e7fc700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f306c05ed90 0x7f306c061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f308014b5e0 tx=0x7f3074009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:54.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.794+0000 7f3066ffd700 1 -- 172.21.15.115:0/2944468096 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f307004cb80 con 0x7f3080063260 2023-07-27T14:26:54.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:54.964+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f308006c470 con 0x7f3080063260 2023-07-27T14:26:55.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.573+0000 7f3066ffd700 1 -- 172.21.15.115:0/2944468096 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f30700501a0 con 0x7f3080063260 2023-07-27T14:26:55.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f306c05ed90 msgr2=0x7f306c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:55.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f306c05ed90 0x7f306c061250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f308014b5e0 tx=0x7f3074009040).stop 2023-07-27T14:26:55.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3080063260 msgr2=0x7f30801491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:55.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3080063260 0x7f30801491d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3080155580 tx=0x7f3070017000).stop 2023-07-27T14:26:55.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 shutdown_connections 2023-07-27T14:26:55.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f306c05ed90 0x7f306c061250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:55.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f308014b1e0 0x7f308014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:55.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3080063260 0x7f30801491d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:55.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 --2- 172.21.15.115:0/2944468096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f308014ae00 0x7f308014d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:55.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.576+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 >> 172.21.15.115:0/2944468096 conn(0x7f308005e940 msgr2=0x7f30800c0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:55.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.577+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 shutdown_connections 2023-07-27T14:26:55.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.577+0000 7f30859ff700 1 -- 172.21.15.115:0/2944468096 wait complete. 2023-07-27T14:26:55.591 INFO:teuthology.orchestra.run.smithi115.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-27T14:26:55.609 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-27T14:26:55.610 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:26:55.610 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:26:55.614 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:26:55.614 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:26:55.615 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:26:55.618 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:26:55.619 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:26:55.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:26:55.624 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:26:55.624 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:26:55.624 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:26:55.628 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:26:55.629 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-27T14:26:55.629 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:26:55.761 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:26:55.764 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:26:55.775 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:26:55.776 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:26:55.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.820+0000 7fed2f9ff700 1 Processor -- start 2023-07-27T14:26:55.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.820+0000 7fed2f9ff700 1 -- start start 2023-07-27T14:26:55.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.821+0000 7fed2f9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed281542a0 0x7fed2815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:55.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.821+0000 7fed2f9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280aa4d0 con 0x7fed280aaa40 2023-07-27T14:26:55.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.821+0000 7fed2f9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280c05c0 con 0x7fed28153ec0 2023-07-27T14:26:55.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.821+0000 7fed2f9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280c1a60 con 0x7fed281542a0 2023-07-27T14:26:55.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed2cf9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fed280aaa40 0x7fed280640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37300/0 (socket says 172.21.15.115:37300) 2023-07-27T14:26:55.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed2cf9a700 1 -- 172.21.15.115:0/2857519503 learned_addr learned my addr 172.21.15.115:0/2857519503 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:26:55.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed2df9c700 1 --2- 172.21.15.115:0/2857519503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed281542a0 0x7fed2815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:55.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed1ffff700 1 -- 172.21.15.115:0/2857519503 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231496026 0 0) 0x7fed18001110 con 0x7fed280aaa40 2023-07-27T14:26:55.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed1ffff700 1 -- 172.21.15.115:0/2857519503 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed140033f0 con 0x7fed280aaa40 2023-07-27T14:26:55.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed1ffff700 1 -- 172.21.15.115:0/2857519503 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621004451 0 0) 0x7fed280c05c0 con 0x7fed28153ec0 2023-07-27T14:26:55.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed1ffff700 1 -- 172.21.15.115:0/2857519503 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed18001110 con 0x7fed28153ec0 2023-07-27T14:26:55.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed2df9c700 1 -- 172.21.15.115:0/2857519503 >> v1:172.21.15.159:6789/0 conn(0x7fed28153ec0 legacy=0x7fed280a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:55.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed2df9c700 1 -- 172.21.15.115:0/2857519503 >> v1:172.21.15.115:6789/0 conn(0x7fed280aaa40 legacy=0x7fed280640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:55.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed2df9c700 1 -- 172.21.15.115:0/2857519503 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280aa270 con 0x7fed281542a0 2023-07-27T14:26:55.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.822+0000 7fed2df9c700 1 --2- 172.21.15.115:0/2857519503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed281542a0 0x7fed2815efc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fed20009e90 tx=0x7fed20009780).ready entity=mon.2 client_cookie=5278f500bc57b07c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:55.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed1ffff700 1 -- 172.21.15.115:0/2857519503 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000e070 con 0x7fed281542a0 2023-07-27T14:26:55.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed1ffff700 1 -- 172.21.15.115:0/2857519503 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000bab0 con 0x7fed281542a0 2023-07-27T14:26:55.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed1ffff700 1 -- 172.21.15.115:0/2857519503 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000be30 con 0x7fed281542a0 2023-07-27T14:26:55.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed2f9ff700 1 -- 172.21.15.115:0/2857519503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed281542a0 msgr2=0x7fed2815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:55.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed2f9ff700 1 --2- 172.21.15.115:0/2857519503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed281542a0 0x7fed2815efc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fed20009e90 tx=0x7fed20009780).stop 2023-07-27T14:26:55.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed2f9ff700 1 -- 172.21.15.115:0/2857519503 shutdown_connections 2023-07-27T14:26:55.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed2f9ff700 1 --2- 172.21.15.115:0/2857519503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed281542a0 0x7fed2815efc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:55.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed2f9ff700 1 -- 172.21.15.115:0/2857519503 >> 172.21.15.115:0/2857519503 conn(0x7fed280cb610 msgr2=0x7fed280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:55.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed2f9ff700 1 -- 172.21.15.115:0/2857519503 shutdown_connections 2023-07-27T14:26:55.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.823+0000 7fed2f9ff700 1 -- 172.21.15.115:0/2857519503 wait complete. 2023-07-27T14:26:55.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.825+0000 7fed2f9ff700 1 Processor -- start 2023-07-27T14:26:55.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.825+0000 7fed2f9ff700 1 -- start start 2023-07-27T14:26:55.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2f9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed280aaa40 0x7fed28148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:55.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2f9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed28153ec0 0x7fed280adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:55.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2f9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed281542a0 0x7fed280c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2f9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed280af130 con 0x7fed280aaa40 2023-07-27T14:26:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2f9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed280ae520 con 0x7fed281542a0 2023-07-27T14:26:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2f9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280ae800 con 0x7fed28153ec0 2023-07-27T14:26:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2d79b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed280aaa40 0x7fed28148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2d79b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed280aaa40 0x7fed28148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43760/0 (socket says 172.21.15.115:43760) 2023-07-27T14:26:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2d79b700 1 -- 172.21.15.115:0/3694713250 learned_addr learned my addr 172.21.15.115:0/3694713250 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2cf9a700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed28153ec0 0x7fed280adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2df9c700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed281542a0 0x7fed280c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2d79b700 1 -- 172.21.15.115:0/3694713250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed28153ec0 msgr2=0x7fed280adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2d79b700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed28153ec0 0x7fed280adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2d79b700 1 -- 172.21.15.115:0/3694713250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed281542a0 msgr2=0x7fed280c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2d79b700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed281542a0 0x7fed280c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.826+0000 7fed2d79b700 1 -- 172.21.15.115:0/3694713250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20009a20 con 0x7fed280aaa40 2023-07-27T14:26:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.827+0000 7fed2d79b700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed280aaa40 0x7fed28148810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fed2400c490 tx=0x7fed24007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.827+0000 7fed1d7fa700 1 -- 172.21.15.115:0/3694713250 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400ce40 con 0x7fed280aaa40 2023-07-27T14:26:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.827+0000 7fed1d7fa700 1 -- 172.21.15.115:0/3694713250 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2400f470 con 0x7fed280aaa40 2023-07-27T14:26:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.827+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed280aeae0 con 0x7fed280aaa40 2023-07-27T14:26:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.827+0000 7fed1d7fa700 1 -- 172.21.15.115:0/3694713250 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400f810 con 0x7fed280aaa40 2023-07-27T14:26:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.827+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed28148d00 con 0x7fed280aaa40 2023-07-27T14:26:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.828+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2806c470 con 0x7fed280aaa40 2023-07-27T14:26:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.829+0000 7fed1d7fa700 1 -- 172.21.15.115:0/3694713250 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fed24019030 con 0x7fed280aaa40 2023-07-27T14:26:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.830+0000 7fed1d7fa700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed0c05ed60 0x7fed0c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.830+0000 7fed1d7fa700 1 -- 172.21.15.115:0/3694713250 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fed24078bd0 con 0x7fed280aaa40 2023-07-27T14:26:55.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.830+0000 7fed2cf9a700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed0c05ed60 0x7fed0c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:55.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.830+0000 7fed2cf9a700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed0c05ed60 0x7fed0c061220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fed2814c9d0 tx=0x7fed18009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:55.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:55.833+0000 7fed1d7fa700 1 -- 172.21.15.115:0/3694713250 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed2404a4c0 con 0x7fed280aaa40 2023-07-27T14:26:56.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.003+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed280bfc90 con 0x7fed280aaa40 2023-07-27T14:26:56.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.004+0000 7fed1d7fa700 1 -- 172.21.15.115:0/3694713250 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13866 (secure 0 0 0) 0x7fed2404dae0 con 0x7fed280aaa40 2023-07-27T14:26:56.017 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:56.017 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":16,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:26:55.570533+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:26:56.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed0c05ed60 msgr2=0x7fed0c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed0c05ed60 0x7fed0c061220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fed2814c9d0 tx=0x7fed18009040).stop 2023-07-27T14:26:56.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed280aaa40 msgr2=0x7fed28148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed280aaa40 0x7fed28148810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fed2400c490 tx=0x7fed24007c90).stop 2023-07-27T14:26:56.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 shutdown_connections 2023-07-27T14:26:56.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed0c05ed60 0x7fed0c061220 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed281542a0 0x7fed280c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed280aaa40 0x7fed28148810 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 --2- 172.21.15.115:0/3694713250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed28153ec0 0x7fed280adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.006+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 >> 172.21.15.115:0/3694713250 conn(0x7fed280cb610 msgr2=0x7fed280ab760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:56.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.007+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 shutdown_connections 2023-07-27T14:26:56.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.007+0000 7fed2f9ff700 1 -- 172.21.15.115:0/3694713250 wait complete. 2023-07-27T14:26:56.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:26:56.036 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:26:56.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.214+0000 7f37e7fff700 1 Processor -- start 2023-07-27T14:26:56.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.214+0000 7f37e7fff700 1 -- start start 2023-07-27T14:26:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e7fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e01553f0 con 0x7f37e0063260 2023-07-27T14:26:56.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e7fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e0157a50 con 0x7f37e014ae00 2023-07-27T14:26:56.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0157d10 con 0x7f37e014b1e0 2023-07-27T14:26:56.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e5d9b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f37e014ae00 0x7f37e0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:37902/0 (socket says 172.21.15.115:37902) 2023-07-27T14:26:56.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e5d9b700 1 -- 172.21.15.115:0/3884861549 learned_addr learned my addr 172.21.15.115:0/3884861549 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:26:56.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e559a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f37e0063260 0x7f37e00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37306/0 (socket says 172.21.15.115:37306) 2023-07-27T14:26:56.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e659c700 1 --2- 172.21.15.115:0/3884861549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e4d99700 1 -- 172.21.15.115:0/3884861549 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617987024 0 0) 0x7f37e0157a50 con 0x7f37e014ae00 2023-07-27T14:26:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.216+0000 7f37e4d99700 1 -- 172.21.15.115:0/3884861549 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37cc0033f0 con 0x7f37e014ae00 2023-07-27T14:26:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e4d99700 1 -- 172.21.15.115:0/3884861549 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099247012 0 0) 0x7f37e01553f0 con 0x7f37e0063260 2023-07-27T14:26:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e4d99700 1 -- 172.21.15.115:0/3884861549 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e0157a50 con 0x7f37e0063260 2023-07-27T14:26:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e659c700 1 -- 172.21.15.115:0/3884861549 >> v1:172.21.15.159:6789/0 conn(0x7f37e014ae00 legacy=0x7f37e0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e659c700 1 -- 172.21.15.115:0/3884861549 >> v1:172.21.15.115:6789/0 conn(0x7f37e0063260 legacy=0x7f37e00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e659c700 1 -- 172.21.15.115:0/3884861549 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0157ff0 con 0x7f37e014b1e0 2023-07-27T14:26:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e659c700 1 --2- 172.21.15.115:0/3884861549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e0154f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f37d8009e90 tx=0x7f37d8009780).ready entity=mon.2 client_cookie=ae07793da13643fa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e4d99700 1 -- 172.21.15.115:0/3884861549 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d800e070 con 0x7f37e014b1e0 2023-07-27T14:26:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e4d99700 1 -- 172.21.15.115:0/3884861549 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d800bab0 con 0x7f37e014b1e0 2023-07-27T14:26:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.217+0000 7f37e4d99700 1 -- 172.21.15.115:0/3884861549 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d800be30 con 0x7f37e014b1e0 2023-07-27T14:26:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.218+0000 7f37e7fff700 1 -- 172.21.15.115:0/3884861549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 msgr2=0x7f37e0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.218+0000 7f37e7fff700 1 --2- 172.21.15.115:0/3884861549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e0154f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f37d8009e90 tx=0x7f37d8009780).stop 2023-07-27T14:26:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.218+0000 7f37e7fff700 1 -- 172.21.15.115:0/3884861549 shutdown_connections 2023-07-27T14:26:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.218+0000 7f37e7fff700 1 --2- 172.21.15.115:0/3884861549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e0154f00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.218+0000 7f37e7fff700 1 -- 172.21.15.115:0/3884861549 >> 172.21.15.115:0/3884861549 conn(0x7f37e005e940 msgr2=0x7f37e00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.218+0000 7f37e7fff700 1 -- 172.21.15.115:0/3884861549 shutdown_connections 2023-07-27T14:26:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.218+0000 7f37e7fff700 1 -- 172.21.15.115:0/3884861549 wait complete. 2023-07-27T14:26:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.220+0000 7f37e7fff700 1 Processor -- start 2023-07-27T14:26:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.220+0000 7f37e7fff700 1 -- start start 2023-07-27T14:26:56.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.221+0000 7f37e7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37e0063260 0x7f37e014a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.221+0000 7f37e7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37e014ae00 0x7f37e00a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.221+0000 7f37e7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e00aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.221+0000 7f37e7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00aa670 con 0x7f37e014ae00 2023-07-27T14:26:56.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.221+0000 7f37e7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00c2ce0 con 0x7f37e0063260 2023-07-27T14:26:56.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.221+0000 7f37e7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00c2e70 con 0x7f37e014b1e0 2023-07-27T14:26:56.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.221+0000 7f37e559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37e014ae00 0x7f37e00a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37e014ae00 0x7f37e00a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43772/0 (socket says 172.21.15.115:43772) 2023-07-27T14:26:56.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e559a700 1 -- 172.21.15.115:0/2894758568 learned_addr learned my addr 172.21.15.115:0/2894758568 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:56.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e5d9b700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37e0063260 0x7f37e014a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e659c700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e00aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e559a700 1 -- 172.21.15.115:0/2894758568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 msgr2=0x7f37e00aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e559a700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e00aa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e559a700 1 -- 172.21.15.115:0/2894758568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37e0063260 msgr2=0x7f37e014a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e559a700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37e0063260 0x7f37e014a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e559a700 1 -- 172.21.15.115:0/2894758568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d8009a20 con 0x7f37e014ae00 2023-07-27T14:26:56.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e559a700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37e014ae00 0x7f37e00a9c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f37d000c4c0 tx=0x7f37d0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:56.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37d5ffb700 1 -- 172.21.15.115:0/2894758568 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000ce10 con 0x7f37e014ae00 2023-07-27T14:26:56.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37d5ffb700 1 -- 172.21.15.115:0/2894758568 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d00072e0 con 0x7f37e014ae00 2023-07-27T14:26:56.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e00ae9b0 con 0x7f37e014ae00 2023-07-27T14:26:56.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37d5ffb700 1 -- 172.21.15.115:0/2894758568 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d00056e0 con 0x7f37e014ae00 2023-07-27T14:26:56.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.222+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e00aef70 con 0x7f37e014ae00 2023-07-27T14:26:56.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.223+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e006c470 con 0x7f37e014ae00 2023-07-27T14:26:56.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.224+0000 7f37d5ffb700 1 -- 172.21.15.115:0/2894758568 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f37d001a060 con 0x7f37e014ae00 2023-07-27T14:26:56.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.225+0000 7f37d5ffb700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37c405ed90 0x7f37c4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.225+0000 7f37d5ffb700 1 -- 172.21.15.115:0/2894758568 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f37d0078ae0 con 0x7f37e014ae00 2023-07-27T14:26:56.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.225+0000 7f37e5d9b700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37c405ed90 0x7f37c4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.226+0000 7f37e5d9b700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37c405ed90 0x7f37c4061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f37dc005750 tx=0x7f37dc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:56.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.229+0000 7f37d5ffb700 1 -- 172.21.15.115:0/2894758568 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37d004a2c0 con 0x7f37e014ae00 2023-07-27T14:26:56.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.396+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f37e00c2fb0 con 0x7f37e014ae00 2023-07-27T14:26:56.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.396+0000 7f37d5ffb700 1 -- 172.21.15.115:0/2894758568 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f37d0018070 con 0x7f37e014ae00 2023-07-27T14:26:56.409 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:26:56.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.398+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37c405ed90 msgr2=0x7f37c4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.398+0000 7f37e7fff700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37c405ed90 0x7f37c4061250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f37dc005750 tx=0x7f37dc009040).stop 2023-07-27T14:26:56.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.398+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37e014ae00 msgr2=0x7f37e00a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.398+0000 7f37e7fff700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37e014ae00 0x7f37e00a9c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f37d000c4c0 tx=0x7f37d0007c50).stop 2023-07-27T14:26:56.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.399+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 shutdown_connections 2023-07-27T14:26:56.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.399+0000 7f37e7fff700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37c405ed90 0x7f37c4061250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.399+0000 7f37e7fff700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37e014b1e0 0x7f37e00aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.399+0000 7f37e7fff700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37e0063260 0x7f37e014a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.399+0000 7f37e7fff700 1 --2- 172.21.15.115:0/2894758568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37e014ae00 0x7f37e00a9c90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.399+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 >> 172.21.15.115:0/2894758568 conn(0x7f37e005e940 msgr2=0x7f37e00ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:56.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.399+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 shutdown_connections 2023-07-27T14:26:56.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.399+0000 7f37e7fff700 1 -- 172.21.15.115:0/2894758568 wait complete. 2023-07-27T14:26:56.428 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:26:56.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.609+0000 7f81771ff700 1 Processor -- start 2023-07-27T14:26:56.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.610+0000 7f81771ff700 1 -- start start 2023-07-27T14:26:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f81771ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8170063260 0x7f8170154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f81771ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f817014b1e0 0x7f81700a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f81771ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81701553f0 con 0x7f817014ae00 2023-07-27T14:26:56.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f81771ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8170157a50 con 0x7f817014b1e0 2023-07-27T14:26:56.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f81771ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8170157d10 con 0x7f8170063260 2023-07-27T14:26:56.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f816ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8170063260 0x7f8170154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f816ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8170063260 0x7f8170154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:58554/0 (socket says 172.21.15.115:58554) 2023-07-27T14:26:56.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f816ffff700 1 -- 172.21.15.115:0/2077948925 learned_addr learned my addr 172.21.15.115:0/2077948925 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:56.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f817579c700 1 --2- 172.21.15.115:0/2077948925 >> v2:172.21.15.159:3300/0 conn(0x7f817014b1e0 0x7f81700a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.611+0000 7f8174f9b700 1 --1- 172.21.15.115:0/2077948925 >> v1:172.21.15.159:6789/0 conn(0x7f817014ae00 0x7f8170062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:37912/0 (socket says 172.21.15.115:37912) 2023-07-27T14:26:56.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816ffff700 1 -- 172.21.15.115:0/2077948925 >> v2:172.21.15.159:3300/0 conn(0x7f817014b1e0 msgr2=0x7f81700a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:56.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816ffff700 1 --2- 172.21.15.115:0/2077948925 >> v2:172.21.15.159:3300/0 conn(0x7f817014b1e0 0x7f81700a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816ffff700 1 -- 172.21.15.115:0/2077948925 >> v1:172.21.15.159:6789/0 conn(0x7f817014ae00 legacy=0x7f8170062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816f7fe700 1 -- 172.21.15.115:0/2077948925 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276476663 0 0) 0x7f81701553f0 con 0x7f817014ae00 2023-07-27T14:26:56.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816ffff700 1 -- 172.21.15.115:0/2077948925 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170157ff0 con 0x7f8170063260 2023-07-27T14:26:56.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f817579c700 1 --2- 172.21.15.115:0/2077948925 >> v2:172.21.15.159:3300/0 conn(0x7f817014b1e0 0x7f81700a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:26:56.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816ffff700 1 --2- 172.21.15.115:0/2077948925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8170063260 0x7f8170154f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f815c006fd0 tx=0x7f815c0090f0).ready entity=mon.2 client_cookie=63e1ffbe85341744 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:56.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816f7fe700 1 -- 172.21.15.115:0/2077948925 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00b580 con 0x7f8170063260 2023-07-27T14:26:56.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816f7fe700 1 -- 172.21.15.115:0/2077948925 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c00b6e0 con 0x7f8170063260 2023-07-27T14:26:56.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.612+0000 7f816f7fe700 1 -- 172.21.15.115:0/2077948925 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00ba60 con 0x7f8170063260 2023-07-27T14:26:56.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.613+0000 7f81771ff700 1 -- 172.21.15.115:0/2077948925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8170063260 msgr2=0x7f8170154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.613+0000 7f81771ff700 1 --2- 172.21.15.115:0/2077948925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8170063260 0x7f8170154f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f815c006fd0 tx=0x7f815c0090f0).stop 2023-07-27T14:26:56.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.613+0000 7f81771ff700 1 -- 172.21.15.115:0/2077948925 shutdown_connections 2023-07-27T14:26:56.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.613+0000 7f81771ff700 1 --2- 172.21.15.115:0/2077948925 >> v2:172.21.15.159:3300/0 conn(0x7f817014b1e0 0x7f81700a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.613+0000 7f81771ff700 1 --2- 172.21.15.115:0/2077948925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8170063260 0x7f8170154f00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.613+0000 7f81771ff700 1 -- 172.21.15.115:0/2077948925 >> 172.21.15.115:0/2077948925 conn(0x7f817005e940 msgr2=0x7f81700cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:56.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.613+0000 7f81771ff700 1 -- 172.21.15.115:0/2077948925 shutdown_connections 2023-07-27T14:26:56.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.613+0000 7f81771ff700 1 -- 172.21.15.115:0/2077948925 wait complete. 2023-07-27T14:26:56.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.615+0000 7f81771ff700 1 Processor -- start 2023-07-27T14:26:56.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.615+0000 7f81771ff700 1 -- start start 2023-07-27T14:26:56.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.616+0000 7f81771ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8170063260 0x7f81700c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.616+0000 7f81771ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f817014ae00 0x7f81700c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f81771ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f817014b1e0 0x7f8170149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f81771ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81700c22a0 con 0x7f817014ae00 2023-07-27T14:26:56.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f81771ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81700c2580 con 0x7f8170063260 2023-07-27T14:26:56.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f81771ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700c2860 con 0x7f817014b1e0 2023-07-27T14:26:56.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f817014ae00 0x7f81700c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f817014ae00 0x7f81700c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43776/0 (socket says 172.21.15.115:43776) 2023-07-27T14:26:56.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 -- 172.21.15.115:0/1385917452 learned_addr learned my addr 172.21.15.115:0/1385917452 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:56.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 -- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f817014b1e0 msgr2=0x7f8170149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f817579c700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f817014b1e0 0x7f8170149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f8174f9b700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8170063260 0x7f81700c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f817014b1e0 0x7f8170149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 -- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8170063260 msgr2=0x7f81700c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8170063260 0x7f81700c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 -- 172.21.15.115:0/1385917452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168009a20 con 0x7f817014ae00 2023-07-27T14:26:56.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f817579c700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f817014b1e0 0x7f8170149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:26:56.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f8174f9b700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8170063260 0x7f81700c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:26:56.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.617+0000 7f816ffff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f817014ae00 0x7f81700c4310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f815c009fd0 tx=0x7f815c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:56.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.618+0000 7f816cff9700 1 -- 172.21.15.115:0/1385917452 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c006a40 con 0x7f817014ae00 2023-07-27T14:26:56.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.618+0000 7f816cff9700 1 -- 172.21.15.115:0/1385917452 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c00b850 con 0x7f817014ae00 2023-07-27T14:26:56.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.618+0000 7f816cff9700 1 -- 172.21.15.115:0/1385917452 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c01c670 con 0x7f817014ae00 2023-07-27T14:26:56.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.618+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815c009370 con 0x7f817014ae00 2023-07-27T14:26:56.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.618+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81700c2e20 con 0x7f817014ae00 2023-07-27T14:26:56.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.619+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81700c2fb0 con 0x7f817014ae00 2023-07-27T14:26:56.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.620+0000 7f816cff9700 1 -- 172.21.15.115:0/1385917452 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f815c02c070 con 0x7f817014ae00 2023-07-27T14:26:56.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.621+0000 7f816cff9700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f815405edc0 0x7f8154061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:56.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.621+0000 7f816cff9700 1 -- 172.21.15.115:0/1385917452 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f815c07b3c0 con 0x7f817014ae00 2023-07-27T14:26:56.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.621+0000 7f8174f9b700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f815405edc0 0x7f8154061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:56.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.621+0000 7f8174f9b700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f815405edc0 0x7f8154061280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8164001750 tx=0x7f8164009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:56.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.625+0000 7f816cff9700 1 -- 172.21.15.115:0/1385917452 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f815c04cba0 con 0x7f817014ae00 2023-07-27T14:26:56.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.798+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f817006c470 con 0x7f817014ae00 2023-07-27T14:26:56.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.798+0000 7f816cff9700 1 -- 172.21.15.115:0/1385917452 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f815c02a020 con 0x7f817014ae00 2023-07-27T14:26:56.811 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:26:56.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f815405edc0 msgr2=0x7f8154061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f815405edc0 0x7f8154061280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8164001750 tx=0x7f8164009040).stop 2023-07-27T14:26:56.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f817014ae00 msgr2=0x7f81700c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:56.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f817014ae00 0x7f81700c4310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f815c009fd0 tx=0x7f815c017000).stop 2023-07-27T14:26:56.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 shutdown_connections 2023-07-27T14:26:56.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f815405edc0 0x7f8154061280 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f817014b1e0 0x7f8170149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8170063260 0x7f81700c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 --2- 172.21.15.115:0/1385917452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f817014ae00 0x7f81700c4310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:56.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 >> 172.21.15.115:0/1385917452 conn(0x7f817005e940 msgr2=0x7f817014a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:56.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 shutdown_connections 2023-07-27T14:26:56.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:56.800+0000 7f81771ff700 1 -- 172.21.15.115:0/1385917452 wait complete. 2023-07-27T14:26:56.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:26:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.004+0000 7f194ebff700 1 Processor -- start 2023-07-27T14:26:57.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.005+0000 7f194ebff700 1 -- start start 2023-07-27T14:26:57.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.006+0000 7f194ebff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19480aaa40 0x7f19480640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.006+0000 7f194ebff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19480aa4d0 con 0x7f19481542a0 2023-07-27T14:26:57.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.006+0000 7f194ebff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19480c05c0 con 0x7f1948153ec0 2023-07-27T14:26:57.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.006+0000 7f194ebff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19480aa270 con 0x7f19480aaa40 2023-07-27T14:26:57.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.006+0000 7f1947fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19480aaa40 0x7f19480640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.006+0000 7f194d19c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f19481542a0 0x7f19480c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37320/0 (socket says 172.21.15.115:37320) 2023-07-27T14:26:57.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.006+0000 7f194d19c700 1 -- 172.21.15.115:0/461000086 learned_addr learned my addr 172.21.15.115:0/461000086 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:26:57.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f1947fff700 1 -- 172.21.15.115:0/461000086 >> v1:172.21.15.159:6789/0 conn(0x7f1948153ec0 legacy=0x7f19480a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f1947fff700 1 -- 172.21.15.115:0/461000086 >> v1:172.21.15.115:6789/0 conn(0x7f19481542a0 legacy=0x7f19480c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f1947fff700 1 -- 172.21.15.115:0/461000086 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480bfc90 con 0x7f19480aaa40 2023-07-27T14:26:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f19477fe700 1 -- 172.21.15.115:0/461000086 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250294537 0 0) 0x7f1940001490 con 0x7f19481542a0 2023-07-27T14:26:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f1947fff700 1 --2- 172.21.15.115:0/461000086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19480aaa40 0x7f19480640f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1934009760 tx=0x7f1934009060).ready entity=mon.0 client_cookie=7e41cc36aa86f6a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f19477fe700 1 -- 172.21.15.115:0/461000086 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400b580 con 0x7f19480aaa40 2023-07-27T14:26:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f19477fe700 1 -- 172.21.15.115:0/461000086 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400b6e0 con 0x7f19480aaa40 2023-07-27T14:26:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f19477fe700 1 -- 172.21.15.115:0/461000086 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400ba60 con 0x7f19480aaa40 2023-07-27T14:26:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f194ebff700 1 -- 172.21.15.115:0/461000086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19480aaa40 msgr2=0x7f19480640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.007+0000 7f194ebff700 1 --2- 172.21.15.115:0/461000086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19480aaa40 0x7f19480640f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1934009760 tx=0x7f1934009060).stop 2023-07-27T14:26:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.008+0000 7f194ebff700 1 -- 172.21.15.115:0/461000086 shutdown_connections 2023-07-27T14:26:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.008+0000 7f194ebff700 1 --2- 172.21.15.115:0/461000086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19480aaa40 0x7f19480640f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.008+0000 7f194ebff700 1 -- 172.21.15.115:0/461000086 >> 172.21.15.115:0/461000086 conn(0x7f19480cb610 msgr2=0x7f19480c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.008+0000 7f194ebff700 1 -- 172.21.15.115:0/461000086 shutdown_connections 2023-07-27T14:26:57.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.008+0000 7f194ebff700 1 -- 172.21.15.115:0/461000086 wait complete. 2023-07-27T14:26:57.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.009+0000 7f194ebff700 1 Processor -- start 2023-07-27T14:26:57.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.009+0000 7f194ebff700 1 -- start start 2023-07-27T14:26:57.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194ebff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19480aaa40 0x7f194814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194ebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1948153ec0 0x7f19480c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194ebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19481542a0 0x7f19480c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194ebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948159000 con 0x7f19481542a0 2023-07-27T14:26:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194ebff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19481592e0 con 0x7f19480aaa40 2023-07-27T14:26:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194ebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19480add00 con 0x7f1948153ec0 2023-07-27T14:26:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194d19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19481542a0 0x7f19480c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194d19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19481542a0 0x7f19480c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43784/0 (socket says 172.21.15.115:43784) 2023-07-27T14:26:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.010+0000 7f194d19c700 1 -- 172.21.15.115:0/5921447 learned_addr learned my addr 172.21.15.115:0/5921447 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:57.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f1947fff700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1948153ec0 0x7f19480c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194c99b700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19480aaa40 0x7f194814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194d19c700 1 -- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1948153ec0 msgr2=0x7f19480c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194d19c700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1948153ec0 0x7f19480c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194d19c700 1 -- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19480aaa40 msgr2=0x7f194814f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194d19c700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19480aaa40 0x7f194814f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194d19c700 1 -- 172.21.15.115:0/5921447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340092a0 con 0x7f19481542a0 2023-07-27T14:26:57.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194c99b700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19480aaa40 0x7f194814f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f1947fff700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1948153ec0 0x7f19480c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194d19c700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19481542a0 0x7f19480c4220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f194000c810 tx=0x7f19400014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f1944ff9700 1 -- 172.21.15.115:0/5921447 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940005d30 con 0x7f19481542a0 2023-07-27T14:26:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f1944ff9700 1 -- 172.21.15.115:0/5921447 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940005e90 con 0x7f19481542a0 2023-07-27T14:26:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19480adfe0 con 0x7f19481542a0 2023-07-27T14:26:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f1944ff9700 1 -- 172.21.15.115:0/5921447 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940007340 con 0x7f19481542a0 2023-07-27T14:26:57.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.011+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194814fdd0 con 0x7f19481542a0 2023-07-27T14:26:57.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.012+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194806c470 con 0x7f19481542a0 2023-07-27T14:26:57.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.013+0000 7f1944ff9700 1 -- 172.21.15.115:0/5921447 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1940010030 con 0x7f19481542a0 2023-07-27T14:26:57.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.014+0000 7f1944ff9700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f192c05ed60 0x7f192c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.014+0000 7f1944ff9700 1 -- 172.21.15.115:0/5921447 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1940079530 con 0x7f19481542a0 2023-07-27T14:26:57.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.014+0000 7f194c99b700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f192c05ed60 0x7f192c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.015+0000 7f194c99b700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f192c05ed60 0x7f192c061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f193c001730 tx=0x7f193c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.018+0000 7f1944ff9700 1 -- 172.21.15.115:0/5921447 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f194004ae20 con 0x7f19481542a0 2023-07-27T14:26:57.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.228+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19480aa4d0 con 0x7f19481542a0 2023-07-27T14:26:57.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.229+0000 7f1944ff9700 1 -- 172.21.15.115:0/5921447 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f19480aa4d0 con 0x7f19481542a0 2023-07-27T14:26:57.241 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:57.242 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-27T14:26:57.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f192c05ed60 msgr2=0x7f192c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f192c05ed60 0x7f192c061220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f193c001730 tx=0x7f193c009040).stop 2023-07-27T14:26:57.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19481542a0 msgr2=0x7f19480c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19481542a0 0x7f19480c4220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f194000c810 tx=0x7f19400014d0).stop 2023-07-27T14:26:57.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 shutdown_connections 2023-07-27T14:26:57.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f192c05ed60 0x7f192c061220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19481542a0 0x7f19480c4220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19480aaa40 0x7f194814f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 --2- 172.21.15.115:0/5921447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1948153ec0 0x7f19480c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 >> 172.21.15.115:0/5921447 conn(0x7f19480cb610 msgr2=0x7f1948156990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:57.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 shutdown_connections 2023-07-27T14:26:57.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.231+0000 7f194ebff700 1 -- 172.21.15.115:0/5921447 wait complete. 2023-07-27T14:26:57.245 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 3 2023-07-27T14:26:57.260 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:26:57.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.434+0000 7f57cd3ff700 1 Processor -- start 2023-07-27T14:26:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.434+0000 7f57cd3ff700 1 -- start start 2023-07-27T14:26:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.435+0000 7f57cd3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57c80aaa40 0x7f57c80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.435+0000 7f57cd3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80aa4d0 con 0x7f57c8153ec0 2023-07-27T14:26:57.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.435+0000 7f57cd3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80c05c0 con 0x7f57c81542a0 2023-07-27T14:26:57.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.435+0000 7f57cd3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c80aa270 con 0x7f57c80aaa40 2023-07-27T14:26:57.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c67fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57c80aaa40 0x7f57c80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f57c8153ec0 0x7f57c80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37336/0 (socket says 172.21.15.115:37336) 2023-07-27T14:26:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c6ffd700 1 -- 172.21.15.115:0/4000860137 learned_addr learned my addr 172.21.15.115:0/4000860137 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:26:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c5ffb700 1 -- 172.21.15.115:0/4000860137 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096058188 0 0) 0x7f57b8001110 con 0x7f57c8153ec0 2023-07-27T14:26:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c5ffb700 1 -- 172.21.15.115:0/4000860137 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57b00033f0 con 0x7f57c8153ec0 2023-07-27T14:26:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c67fc700 1 -- 172.21.15.115:0/4000860137 >> v1:172.21.15.159:6789/0 conn(0x7f57c81542a0 legacy=0x7f57c80c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c67fc700 1 -- 172.21.15.115:0/4000860137 >> v1:172.21.15.115:6789/0 conn(0x7f57c8153ec0 legacy=0x7f57c80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c67fc700 1 -- 172.21.15.115:0/4000860137 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80bfc90 con 0x7f57c80aaa40 2023-07-27T14:26:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c67fc700 1 --2- 172.21.15.115:0/4000860137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c80aaa40 0x7f57c80640f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f57bc009760 tx=0x7f57bc009060).ready entity=mon.0 client_cookie=b8aef2e468dfee2e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c5ffb700 1 -- 172.21.15.115:0/4000860137 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc00f510 con 0x7f57c80aaa40 2023-07-27T14:26:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c5ffb700 1 -- 172.21.15.115:0/4000860137 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc00f670 con 0x7f57c80aaa40 2023-07-27T14:26:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.436+0000 7f57c5ffb700 1 -- 172.21.15.115:0/4000860137 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc00f9f0 con 0x7f57c80aaa40 2023-07-27T14:26:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.437+0000 7f57cd3ff700 1 -- 172.21.15.115:0/4000860137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c80aaa40 msgr2=0x7f57c80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.437+0000 7f57cd3ff700 1 --2- 172.21.15.115:0/4000860137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c80aaa40 0x7f57c80640f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f57bc009760 tx=0x7f57bc009060).stop 2023-07-27T14:26:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.437+0000 7f57cd3ff700 1 -- 172.21.15.115:0/4000860137 shutdown_connections 2023-07-27T14:26:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.437+0000 7f57cd3ff700 1 --2- 172.21.15.115:0/4000860137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c80aaa40 0x7f57c80640f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.437+0000 7f57cd3ff700 1 -- 172.21.15.115:0/4000860137 >> 172.21.15.115:0/4000860137 conn(0x7f57c80cb610 msgr2=0x7f57c80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:57.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.437+0000 7f57cd3ff700 1 -- 172.21.15.115:0/4000860137 shutdown_connections 2023-07-27T14:26:57.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.437+0000 7f57cd3ff700 1 -- 172.21.15.115:0/4000860137 wait complete. 2023-07-27T14:26:57.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.439+0000 7f57cd3ff700 1 Processor -- start 2023-07-27T14:26:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.439+0000 7f57cd3ff700 1 -- start start 2023-07-27T14:26:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57cd3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57c80aaa40 0x7f57c8144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57cd3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c8153ec0 0x7f57c80af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57cd3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c81542a0 0x7f57c80afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57cd3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b02c0 con 0x7f57c8153ec0 2023-07-27T14:26:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57cd3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80c1c30 con 0x7f57c81542a0 2023-07-27T14:26:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57cd3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80ae7c0 con 0x7f57c80aaa40 2023-07-27T14:26:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c8153ec0 0x7f57c80af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c8153ec0 0x7f57c80af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43798/0 (socket says 172.21.15.115:43798) 2023-07-27T14:26:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 -- 172.21.15.115:0/3453870573 learned_addr learned my addr 172.21.15.115:0/3453870573 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c6ffd700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57c80aaa40 0x7f57c8144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c77fe700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c81542a0 0x7f57c80afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 -- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57c80aaa40 msgr2=0x7f57c8144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57c80aaa40 0x7f57c8144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 -- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c81542a0 msgr2=0x7f57c80afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c81542a0 0x7f57c80afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 -- 172.21.15.115:0/3453870573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc0092a0 con 0x7f57c8153ec0 2023-07-27T14:26:57.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c77fe700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c81542a0 0x7f57c80afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:26:57.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.440+0000 7f57c67fc700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c8153ec0 0x7f57c80af8e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f57c805fc60 tx=0x7f57bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.441+0000 7f57aeffd700 1 -- 172.21.15.115:0/3453870573 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc00f7e0 con 0x7f57c8153ec0 2023-07-27T14:26:57.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.441+0000 7f57aeffd700 1 -- 172.21.15.115:0/3453870573 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc00f940 con 0x7f57c8153ec0 2023-07-27T14:26:57.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.441+0000 7f57aeffd700 1 -- 172.21.15.115:0/3453870573 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc01b660 con 0x7f57c8153ec0 2023-07-27T14:26:57.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.441+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c80aeaa0 con 0x7f57c8153ec0 2023-07-27T14:26:57.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.441+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c80af060 con 0x7f57c8153ec0 2023-07-27T14:26:57.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.442+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c80c1e50 con 0x7f57c8153ec0 2023-07-27T14:26:57.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.443+0000 7f57aeffd700 1 -- 172.21.15.115:0/3453870573 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f57bc00f070 con 0x7f57c8153ec0 2023-07-27T14:26:57.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.443+0000 7f57aeffd700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57b405ed90 0x7f57b4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.444+0000 7f57aeffd700 1 -- 172.21.15.115:0/3453870573 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f57bc07b240 con 0x7f57c8153ec0 2023-07-27T14:26:57.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.444+0000 7f57c6ffd700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57b405ed90 0x7f57b4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.444+0000 7f57c6ffd700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57b405ed90 0x7f57b4061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f57b8001270 tx=0x7f57b8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.447+0000 7f57aeffd700 1 -- 172.21.15.115:0/3453870573 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57c80c1e50 con 0x7f57c8153ec0 2023-07-27T14:26:57.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.620+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57c806c470 con 0x7f57c8153ec0 2023-07-27T14:26:57.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.621+0000 7f57aeffd700 1 -- 172.21.15.115:0/3453870573 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13853 (secure 0 0 0) 0x7f57bc04ca20 con 0x7f57c8153ec0 2023-07-27T14:26:57.634 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:57.634 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":18,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:26:57.582656+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:26:57.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57b405ed90 msgr2=0x7f57b4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57b405ed90 0x7f57b4061250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f57b8001270 tx=0x7f57b8009040).stop 2023-07-27T14:26:57.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c8153ec0 msgr2=0x7f57c80af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c8153ec0 0x7f57c80af8e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f57c805fc60 tx=0x7f57bc017000).stop 2023-07-27T14:26:57.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 shutdown_connections 2023-07-27T14:26:57.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57b405ed90 0x7f57b4061250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c81542a0 0x7f57c80afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57c80aaa40 0x7f57c8144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.623+0000 7f57cd3ff700 1 --2- 172.21.15.115:0/3453870573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57c8153ec0 0x7f57c80af8e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.624+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 >> 172.21.15.115:0/3453870573 conn(0x7f57c80cb610 msgr2=0x7f57c8154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:57.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.624+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 shutdown_connections 2023-07-27T14:26:57.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.624+0000 7f57cd3ff700 1 -- 172.21.15.115:0/3453870573 wait complete. 2023-07-27T14:26:57.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:26:57.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:26:57.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.834+0000 7f85053ff700 1 Processor -- start 2023-07-27T14:26:57.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.834+0000 7f85053ff700 1 -- start start 2023-07-27T14:26:57.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.835+0000 7f85053ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f850014ae00 0x7f8500154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.835+0000 7f85053ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f850014b1e0 0x7f8500062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.835+0000 7f85053ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85000c5c50 0x7f8500063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.835+0000 7f85053ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8500063530 con 0x7f850014b1e0 2023-07-27T14:26:57.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.835+0000 7f85053ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85001553f0 con 0x7f850014ae00 2023-07-27T14:26:57.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.835+0000 7f85053ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8500157a50 con 0x7f85000c5c50 2023-07-27T14:26:57.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f850014b1e0 0x7f8500062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f850014b1e0 0x7f8500062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43806/0 (socket says 172.21.15.115:43806) 2023-07-27T14:26:57.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 -- 172.21.15.115:0/1795562721 learned_addr learned my addr 172.21.15.115:0/1795562721 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:57.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84ff7fe700 1 --2- 172.21.15.115:0/1795562721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85000c5c50 0x7f8500063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84feffd700 1 --2- 172.21.15.115:0/1795562721 >> v2:172.21.15.159:3300/0 conn(0x7f850014ae00 0x7f8500154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 -- 172.21.15.115:0/1795562721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85000c5c50 msgr2=0x7f8500063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:57.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 --2- 172.21.15.115:0/1795562721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85000c5c50 0x7f8500063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 -- 172.21.15.115:0/1795562721 >> v2:172.21.15.159:3300/0 conn(0x7f850014ae00 msgr2=0x7f8500154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:57.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 --2- 172.21.15.115:0/1795562721 >> v2:172.21.15.159:3300/0 conn(0x7f850014ae00 0x7f8500154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 -- 172.21.15.115:0/1795562721 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500157d10 con 0x7f850014b1e0 2023-07-27T14:26:57.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84feffd700 1 --2- 172.21.15.115:0/1795562721 >> v2:172.21.15.159:3300/0 conn(0x7f850014ae00 0x7f8500154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:57.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.836+0000 7f84fe7fc700 1 --2- 172.21.15.115:0/1795562721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500062b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f85000caaf0 tx=0x7f84f40090f0).ready entity=mon.0 client_cookie=bfc3127f40dd693f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f84fdffb700 1 -- 172.21.15.115:0/1795562721 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400b520 con 0x7f850014b1e0 2023-07-27T14:26:57.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f84fdffb700 1 -- 172.21.15.115:0/1795562721 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f400b680 con 0x7f850014b1e0 2023-07-27T14:26:57.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f84fdffb700 1 -- 172.21.15.115:0/1795562721 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400ba00 con 0x7f850014b1e0 2023-07-27T14:26:57.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 -- 172.21.15.115:0/1795562721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 msgr2=0x7f8500062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 --2- 172.21.15.115:0/1795562721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500062b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f85000caaf0 tx=0x7f84f40090f0).stop 2023-07-27T14:26:57.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 -- 172.21.15.115:0/1795562721 shutdown_connections 2023-07-27T14:26:57.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 --2- 172.21.15.115:0/1795562721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85000c5c50 0x7f8500063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 --2- 172.21.15.115:0/1795562721 >> v2:172.21.15.159:3300/0 conn(0x7f850014ae00 0x7f8500154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 --2- 172.21.15.115:0/1795562721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500062b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 -- 172.21.15.115:0/1795562721 >> 172.21.15.115:0/1795562721 conn(0x7f850005e940 msgr2=0x7f85000cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:57.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 -- 172.21.15.115:0/1795562721 shutdown_connections 2023-07-27T14:26:57.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.837+0000 7f85053ff700 1 -- 172.21.15.115:0/1795562721 wait complete. 2023-07-27T14:26:57.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.839+0000 7f85053ff700 1 Processor -- start 2023-07-27T14:26:57.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.839+0000 7f85053ff700 1 -- start start 2023-07-27T14:26:57.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f85053ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85000c5c50 0x7f85000af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f85053ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f850014ae00 0x7f8500140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f85053ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f85053ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500156450 con 0x7f850014b1e0 2023-07-27T14:26:57.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f85053ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000b0a60 con 0x7f85000c5c50 2023-07-27T14:26:57.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f85053ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000afe50 con 0x7f850014ae00 2023-07-27T14:26:57.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84ff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84ff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43818/0 (socket says 172.21.15.115:43818) 2023-07-27T14:26:57.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84ff7fe700 1 -- 172.21.15.115:0/4270304996 learned_addr learned my addr 172.21.15.115:0/4270304996 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:57.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84fe7fc700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f850014ae00 0x7f8500140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84feffd700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85000c5c50 0x7f85000af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84ff7fe700 1 -- 172.21.15.115:0/4270304996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f850014ae00 msgr2=0x7f8500140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84ff7fe700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f850014ae00 0x7f8500140690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84ff7fe700 1 -- 172.21.15.115:0/4270304996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85000c5c50 msgr2=0x7f85000af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:57.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84ff7fe700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85000c5c50 0x7f85000af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:57.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.840+0000 7f84ff7fe700 1 -- 172.21.15.115:0/4270304996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4009370 con 0x7f850014b1e0 2023-07-27T14:26:57.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.841+0000 7f84ff7fe700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500155590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f84f8009d70 tx=0x7f84f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.841+0000 7f84e6ffd700 1 -- 172.21.15.115:0/4270304996 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800caa0 con 0x7f850014b1e0 2023-07-27T14:26:57.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.841+0000 7f84e6ffd700 1 -- 172.21.15.115:0/4270304996 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f800f040 con 0x7f850014b1e0 2023-07-27T14:26:57.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.841+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85000b0130 con 0x7f850014b1e0 2023-07-27T14:26:57.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.841+0000 7f84e6ffd700 1 -- 172.21.15.115:0/4270304996 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800ce10 con 0x7f850014b1e0 2023-07-27T14:26:57.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.841+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85000b06f0 con 0x7f850014b1e0 2023-07-27T14:26:57.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.842+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850006c470 con 0x7f850014b1e0 2023-07-27T14:26:57.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.843+0000 7f84e6ffd700 1 -- 172.21.15.115:0/4270304996 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f84f8013610 con 0x7f850014b1e0 2023-07-27T14:26:57.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.844+0000 7f84e6ffd700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84ec05ed90 0x7f84ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:57.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.844+0000 7f84e6ffd700 1 -- 172.21.15.115:0/4270304996 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f84f807a020 con 0x7f850014b1e0 2023-07-27T14:26:57.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.844+0000 7f84feffd700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84ec05ed90 0x7f84ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:57.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.844+0000 7f84feffd700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84ec05ed90 0x7f84ec061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f84f0006d80 tx=0x7f84f0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:57.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:57.848+0000 7f84e6ffd700 1 -- 172.21.15.115:0/4270304996 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84f804b910 con 0x7f850014b1e0 2023-07-27T14:26:58.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.014+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8500153ed0 con 0x7f850014b1e0 2023-07-27T14:26:58.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.014+0000 7f84e6ffd700 1 -- 172.21.15.115:0/4270304996 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f84f804ef30 con 0x7f850014b1e0 2023-07-27T14:26:58.027 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:26:58.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84ec05ed90 msgr2=0x7f84ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84ec05ed90 0x7f84ec061250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f84f0006d80 tx=0x7f84f0008040).stop 2023-07-27T14:26:58.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 msgr2=0x7f8500155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500155590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f84f8009d70 tx=0x7f84f800b040).stop 2023-07-27T14:26:58.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 shutdown_connections 2023-07-27T14:26:58.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84ec05ed90 0x7f84ec061250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f850014b1e0 0x7f8500155590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85000c5c50 0x7f85000af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 --2- 172.21.15.115:0/4270304996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f850014ae00 0x7f8500140690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 >> 172.21.15.115:0/4270304996 conn(0x7f850005e940 msgr2=0x7f850014a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:58.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 shutdown_connections 2023-07-27T14:26:58.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.016+0000 7f85053ff700 1 -- 172.21.15.115:0/4270304996 wait complete. 2023-07-27T14:26:58.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:26:58.082 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:26:58.095 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:26:58.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.228+0000 7f542bfff700 1 Processor -- start 2023-07-27T14:26:58.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.228+0000 7f542bfff700 1 -- start start 2023-07-27T14:26:58.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.229+0000 7f542bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5424063260 0x7f5424154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.229+0000 7f542bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f542414b1e0 0x7f54240a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.229+0000 7f542bfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54241553f0 con 0x7f542414ae00 2023-07-27T14:26:58.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.229+0000 7f542bfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5424157a50 con 0x7f5424063260 2023-07-27T14:26:58.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.229+0000 7f542bfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5424157d10 con 0x7f542414b1e0 2023-07-27T14:26:58.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f542959a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5424063260 0x7f5424154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f5429d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f542414ae00 0x7f5424062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37350/0 (socket says 172.21.15.115:37350) 2023-07-27T14:26:58.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f5429d9b700 1 -- 172.21.15.115:0/1638201078 learned_addr learned my addr 172.21.15.115:0/1638201078 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:26:58.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f542a59c700 1 --2- 172.21.15.115:0/1638201078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f542414b1e0 0x7f54240a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f542959a700 1 -- 172.21.15.115:0/1638201078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f542414b1e0 msgr2=0x7f54240a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:58.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f542959a700 1 --2- 172.21.15.115:0/1638201078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f542414b1e0 0x7f54240a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f542959a700 1 -- 172.21.15.115:0/1638201078 >> v1:172.21.15.115:6789/0 conn(0x7f542414ae00 legacy=0x7f5424062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f5428d99700 1 -- 172.21.15.115:0/1638201078 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573772904 0 0) 0x7f54241553f0 con 0x7f542414ae00 2023-07-27T14:26:58.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f542959a700 1 -- 172.21.15.115:0/1638201078 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5424157ff0 con 0x7f5424063260 2023-07-27T14:26:58.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.230+0000 7f542959a700 1 --2- 172.21.15.115:0/1638201078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5424063260 0x7f5424154f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5414009760 tx=0x7f5414009060).ready entity=mon.0 client_cookie=ba6c8b9d6ed4c071 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:58.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f5428d99700 1 -- 172.21.15.115:0/1638201078 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400b580 con 0x7f5424063260 2023-07-27T14:26:58.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f5428d99700 1 -- 172.21.15.115:0/1638201078 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541400b6e0 con 0x7f5424063260 2023-07-27T14:26:58.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f5428d99700 1 -- 172.21.15.115:0/1638201078 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400ba60 con 0x7f5424063260 2023-07-27T14:26:58.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f542bfff700 1 -- 172.21.15.115:0/1638201078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5424063260 msgr2=0x7f5424154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f542bfff700 1 --2- 172.21.15.115:0/1638201078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5424063260 0x7f5424154f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5414009760 tx=0x7f5414009060).stop 2023-07-27T14:26:58.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f542bfff700 1 -- 172.21.15.115:0/1638201078 shutdown_connections 2023-07-27T14:26:58.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f542bfff700 1 --2- 172.21.15.115:0/1638201078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f542414b1e0 0x7f54240a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f542bfff700 1 --2- 172.21.15.115:0/1638201078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5424063260 0x7f5424154f00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f542bfff700 1 -- 172.21.15.115:0/1638201078 >> 172.21.15.115:0/1638201078 conn(0x7f542405e940 msgr2=0x7f54240cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:58.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f542bfff700 1 -- 172.21.15.115:0/1638201078 shutdown_connections 2023-07-27T14:26:58.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.231+0000 7f542bfff700 1 -- 172.21.15.115:0/1638201078 wait complete. 2023-07-27T14:26:58.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.233+0000 7f542bfff700 1 Processor -- start 2023-07-27T14:26:58.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.233+0000 7f542bfff700 1 -- start start 2023-07-27T14:26:58.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424063260 0x7f5424164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f542414ae00 0x7f5424149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f542414b1e0 0x7f54240c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542bfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54240aa320 con 0x7f542414ae00 2023-07-27T14:26:58.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424164e40 con 0x7f542414b1e0 2023-07-27T14:26:58.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542bfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54241656f0 con 0x7f5424063260 2023-07-27T14:26:58.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f542414ae00 0x7f5424149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f542414ae00 0x7f5424149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43828/0 (socket says 172.21.15.115:43828) 2023-07-27T14:26:58.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 -- 172.21.15.115:0/157203333 learned_addr learned my addr 172.21.15.115:0/157203333 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:58.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f5429d9b700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424063260 0x7f5424164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542a59c700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f542414b1e0 0x7f54240c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 -- 172.21.15.115:0/157203333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424063260 msgr2=0x7f5424164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424063260 0x7f5424164950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 -- 172.21.15.115:0/157203333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f542414b1e0 msgr2=0x7f54240c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f542414b1e0 0x7f54240c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 -- 172.21.15.115:0/157203333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54140092a0 con 0x7f542414ae00 2023-07-27T14:26:58.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.234+0000 7f542959a700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f542414ae00 0x7f5424149fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5414009eb0 tx=0x7f5414017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:58.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.235+0000 7f5419ffb700 1 -- 172.21.15.115:0/157203333 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400b850 con 0x7f542414ae00 2023-07-27T14:26:58.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.235+0000 7f5419ffb700 1 -- 172.21.15.115:0/157203333 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541400b9b0 con 0x7f542414ae00 2023-07-27T14:26:58.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.235+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542414a4a0 con 0x7f542414ae00 2023-07-27T14:26:58.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.235+0000 7f5419ffb700 1 -- 172.21.15.115:0/157203333 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541401b690 con 0x7f542414ae00 2023-07-27T14:26:58.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.235+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54240abb90 con 0x7f542414ae00 2023-07-27T14:26:58.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.236+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542406c470 con 0x7f542414ae00 2023-07-27T14:26:58.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.236+0000 7f5419ffb700 1 -- 172.21.15.115:0/157203333 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f541400f070 con 0x7f542414ae00 2023-07-27T14:26:58.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.237+0000 7f5419ffb700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f540805ed90 0x7f5408061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.237+0000 7f5419ffb700 1 -- 172.21.15.115:0/157203333 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f541407afe0 con 0x7f542414ae00 2023-07-27T14:26:58.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.237+0000 7f5429d9b700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f540805ed90 0x7f5408061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.238+0000 7f5429d9b700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f540805ed90 0x7f5408061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f54200011e0 tx=0x7f5420009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:58.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.241+0000 7f5419ffb700 1 -- 172.21.15.115:0/157203333 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f541404c8b0 con 0x7f542414ae00 2023-07-27T14:26:58.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.409+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54240ac9f0 con 0x7f542414ae00 2023-07-27T14:26:58.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.410+0000 7f5419ffb700 1 -- 172.21.15.115:0/157203333 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f541404fed0 con 0x7f542414ae00 2023-07-27T14:26:58.422 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:26:58.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.411+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f540805ed90 msgr2=0x7f5408061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f540805ed90 0x7f5408061250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f54200011e0 tx=0x7f5420009040).stop 2023-07-27T14:26:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f542414ae00 msgr2=0x7f5424149fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f542414ae00 0x7f5424149fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5414009eb0 tx=0x7f5414017000).stop 2023-07-27T14:26:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 shutdown_connections 2023-07-27T14:26:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f540805ed90 0x7f5408061250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f542414b1e0 0x7f54240c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5424063260 0x7f5424164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 --2- 172.21.15.115:0/157203333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f542414ae00 0x7f5424149fb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 >> 172.21.15.115:0/157203333 conn(0x7f542405e940 msgr2=0x7f54240c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:58.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 shutdown_connections 2023-07-27T14:26:58.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.412+0000 7f542bfff700 1 -- 172.21.15.115:0/157203333 wait complete. 2023-07-27T14:26:58.442 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:26:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.657+0000 7fcdf6bff700 1 Processor -- start 2023-07-27T14:26:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.657+0000 7fcdf6bff700 1 -- start start 2023-07-27T14:26:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.658+0000 7fcdf6bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcdf0153ec0 0x7fcdf00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.658+0000 7fcdf6bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf00aa050 0x7fcdf00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.658+0000 7fcdf6bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf00aa4d0 con 0x7fcdf00aaa40 2023-07-27T14:26:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.658+0000 7fcdf6bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf00c05c0 con 0x7fcdf0153ec0 2023-07-27T14:26:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.658+0000 7fcdf6bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00c1a60 con 0x7fcdf00aa050 2023-07-27T14:26:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.659+0000 7fcdeffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf00aa050 0x7fcdf00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.659+0000 7fcdf499b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcdf0153ec0 0x7fcdf00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.659+0000 7fcdf519c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fcdf00aaa40 0x7fcdf0157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:37944/0 (socket says 172.21.15.115:37944) 2023-07-27T14:26:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.659+0000 7fcdf519c700 1 -- 172.21.15.115:0/3117299266 learned_addr learned my addr 172.21.15.115:0/3117299266 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:26:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.659+0000 7fcdeffff700 1 -- 172.21.15.115:0/3117299266 >> v2:172.21.15.159:3300/0 conn(0x7fcdf0153ec0 msgr2=0x7fcdf00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.659+0000 7fcdeffff700 1 --2- 172.21.15.115:0/3117299266 >> v2:172.21.15.159:3300/0 conn(0x7fcdf0153ec0 0x7fcdf00a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.659+0000 7fcdeffff700 1 -- 172.21.15.115:0/3117299266 >> v1:172.21.15.159:6789/0 conn(0x7fcdf00aaa40 legacy=0x7fcdf0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.660+0000 7fcdeffff700 1 -- 172.21.15.115:0/3117299266 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00bfc90 con 0x7fcdf00aa050 2023-07-27T14:26:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.659+0000 7fcdef7fe700 1 -- 172.21.15.115:0/3117299266 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855677128 0 0) 0x7fcde8001490 con 0x7fcdf00aaa40 2023-07-27T14:26:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.660+0000 7fcdf499b700 1 --2- 172.21.15.115:0/3117299266 >> v2:172.21.15.159:3300/0 conn(0x7fcdf0153ec0 0x7fcdf00a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:26:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.660+0000 7fcdeffff700 1 --2- 172.21.15.115:0/3117299266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf00aa050 0x7fcdf00640f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcddc009760 tx=0x7fcddc009060).ready entity=mon.2 client_cookie=789b4f57d680bb65 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.660+0000 7fcdef7fe700 1 -- 172.21.15.115:0/3117299266 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00f510 con 0x7fcdf00aa050 2023-07-27T14:26:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.660+0000 7fcdef7fe700 1 -- 172.21.15.115:0/3117299266 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc00f670 con 0x7fcdf00aa050 2023-07-27T14:26:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.660+0000 7fcdef7fe700 1 -- 172.21.15.115:0/3117299266 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00f9f0 con 0x7fcdf00aa050 2023-07-27T14:26:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.660+0000 7fcdf6bff700 1 -- 172.21.15.115:0/3117299266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf00aa050 msgr2=0x7fcdf00640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.660+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/3117299266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf00aa050 0x7fcdf00640f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcddc009760 tx=0x7fcddc009060).stop 2023-07-27T14:26:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.661+0000 7fcdf6bff700 1 -- 172.21.15.115:0/3117299266 shutdown_connections 2023-07-27T14:26:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.661+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/3117299266 >> v2:172.21.15.159:3300/0 conn(0x7fcdf0153ec0 0x7fcdf00a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.661+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/3117299266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf00aa050 0x7fcdf00640f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.661+0000 7fcdf6bff700 1 -- 172.21.15.115:0/3117299266 >> 172.21.15.115:0/3117299266 conn(0x7fcdf00cb610 msgr2=0x7fcdf00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.661+0000 7fcdf6bff700 1 -- 172.21.15.115:0/3117299266 shutdown_connections 2023-07-27T14:26:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.661+0000 7fcdf6bff700 1 -- 172.21.15.115:0/3117299266 wait complete. 2023-07-27T14:26:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.662+0000 7fcdf6bff700 1 Processor -- start 2023-07-27T14:26:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.662+0000 7fcdf6bff700 1 -- start start 2023-07-27T14:26:58.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.663+0000 7fcdf6bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf00aa050 0x7fcdf0149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.663+0000 7fcdf6bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdf00aaa40 0x7fcdf00642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.663+0000 7fcdf6bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf0153ec0 0x7fcdf00c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.663+0000 7fcdf6bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00c25d0 con 0x7fcdf00aaa40 2023-07-27T14:26:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.663+0000 7fcdf6bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00c2910 con 0x7fcdf00aa050 2023-07-27T14:26:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.663+0000 7fcdf6bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00c2010 con 0x7fcdf0153ec0 2023-07-27T14:26:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdf00aaa40 0x7fcdf00642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdf00aaa40 0x7fcdf00642b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43842/0 (socket says 172.21.15.115:43842) 2023-07-27T14:26:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 -- 172.21.15.115:0/4193202441 learned_addr learned my addr 172.21.15.115:0/4193202441 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdf499b700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf00aa050 0x7fcdf0149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdf519c700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf0153ec0 0x7fcdf00c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 -- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf0153ec0 msgr2=0x7fcdf00c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf0153ec0 0x7fcdf00c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 -- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf00aa050 msgr2=0x7fcdf0149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf00aa050 0x7fcdf0149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 -- 172.21.15.115:0/4193202441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40092a0 con 0x7fcdf00aaa40 2023-07-27T14:26:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdf499b700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf00aa050 0x7fcdf0149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:26:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdf519c700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf0153ec0 0x7fcdf00c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:26:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdeffff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdf00aaa40 0x7fcdf00642b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fcdf005fc60 tx=0x7fcddc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdecff9700 1 -- 172.21.15.115:0/4193202441 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00f7e0 con 0x7fcdf00aaa40 2023-07-27T14:26:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdecff9700 1 -- 172.21.15.115:0/4193202441 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc00f960 con 0x7fcdf00aaa40 2023-07-27T14:26:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcddc0092a0 con 0x7fcdf00aaa40 2023-07-27T14:26:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.664+0000 7fcdecff9700 1 -- 172.21.15.115:0/4193202441 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc01b660 con 0x7fcdf00aaa40 2023-07-27T14:26:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.665+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf00c2bb0 con 0x7fcdf00aaa40 2023-07-27T14:26:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.665+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf006c470 con 0x7fcdf00aaa40 2023-07-27T14:26:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.666+0000 7fcdecff9700 1 -- 172.21.15.115:0/4193202441 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcddc02b070 con 0x7fcdf00aaa40 2023-07-27T14:26:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.667+0000 7fcdecff9700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcdd405ed60 0x7fcdd4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.667+0000 7fcdecff9700 1 -- 172.21.15.115:0/4193202441 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fcddc07b0f0 con 0x7fcdf00aaa40 2023-07-27T14:26:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.667+0000 7fcdf499b700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcdd405ed60 0x7fcdd4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.668+0000 7fcdf499b700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcdd405ed60 0x7fcdd4061220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcde4009270 tx=0x7fcde4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.671+0000 7fcdecff9700 1 -- 172.21.15.115:0/4193202441 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcddc04c910 con 0x7fcdf00aaa40 2023-07-27T14:26:58.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.847+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcdf00bff70 con 0x7fcdf00aaa40 2023-07-27T14:26:58.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.847+0000 7fcdecff9700 1 -- 172.21.15.115:0/4193202441 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7fcddc0290a0 con 0x7fcdf00aaa40 2023-07-27T14:26:58.860 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:26:58.860 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:26:58.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:26:58.861 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:26:58.861 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:26:58.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:26:58.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:26:58.861 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:26:58.861 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:26:58.861 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:26:58.862 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:26:58.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcdd405ed60 msgr2=0x7fcdd4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcdd405ed60 0x7fcdd4061220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcde4009270 tx=0x7fcde4008040).stop 2023-07-27T14:26:58.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdf00aaa40 msgr2=0x7fcdf00642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:58.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdf00aaa40 0x7fcdf00642b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fcdf005fc60 tx=0x7fcddc017000).stop 2023-07-27T14:26:58.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 shutdown_connections 2023-07-27T14:26:58.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcdd405ed60 0x7fcdd4061220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdf0153ec0 0x7fcdf00c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf00aa050 0x7fcdf0149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 --2- 172.21.15.115:0/4193202441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdf00aaa40 0x7fcdf00642b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:58.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 >> 172.21.15.115:0/4193202441 conn(0x7fcdf00cb610 msgr2=0x7fcdf00abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:58.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.849+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 shutdown_connections 2023-07-27T14:26:58.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:58.850+0000 7fcdf6bff700 1 -- 172.21.15.115:0/4193202441 wait complete. 2023-07-27T14:26:58.879 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:26:58.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:26:59.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.059+0000 7fcb9f5ff700 1 Processor -- start 2023-07-27T14:26:59.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.059+0000 7fcb9f5ff700 1 -- start start 2023-07-27T14:26:59.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9f5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb980c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:59.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9f5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb98064230 0x7fcb980656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:59.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9f5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcb98065bc0 0x7fcb98157a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:59.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9f5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb98062320 con 0x7fcb98064230 2023-07-27T14:26:59.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9f5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb98066070 con 0x7fcb98065bc0 2023-07-27T14:26:59.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9f5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98064a80 con 0x7fcb98153e00 2023-07-27T14:26:59.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9cb9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb98064230 0x7fcb980656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:59.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9cb9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb98064230 0x7fcb980656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43856/0 (socket says 172.21.15.115:43856) 2023-07-27T14:26:59.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9cb9a700 1 -- 172.21.15.115:0/1493476034 learned_addr learned my addr 172.21.15.115:0/1493476034 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:59.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9db9c700 1 --2- 172.21.15.115:0/1493476034 >> v2:172.21.15.159:3300/0 conn(0x7fcb98065bc0 0x7fcb98157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:59.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9d39b700 1 --2- 172.21.15.115:0/1493476034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb980c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:59.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9cb9a700 1 -- 172.21.15.115:0/1493476034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 msgr2=0x7fcb980c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:59.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.061+0000 7fcb9cb9a700 1 --2- 172.21.15.115:0/1493476034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb980c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9cb9a700 1 -- 172.21.15.115:0/1493476034 >> v2:172.21.15.159:3300/0 conn(0x7fcb98065bc0 msgr2=0x7fcb98157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:26:59.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9cb9a700 1 --2- 172.21.15.115:0/1493476034 >> v2:172.21.15.159:3300/0 conn(0x7fcb98065bc0 0x7fcb98157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9cb9a700 1 -- 172.21.15.115:0/1493476034 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98064d60 con 0x7fcb98064230 2023-07-27T14:26:59.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9d39b700 1 --2- 172.21.15.115:0/1493476034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb980c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:26:59.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9cb9a700 1 --2- 172.21.15.115:0/1493476034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98064230 0x7fcb980656d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fcb88006fd0 tx=0x7fcb880090f0).ready entity=mon.0 client_cookie=b4aada94273fb14a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:59.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb8ffff700 1 -- 172.21.15.115:0/1493476034 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800b600 con 0x7fcb98064230 2023-07-27T14:26:59.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb8ffff700 1 -- 172.21.15.115:0/1493476034 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8800b760 con 0x7fcb98064230 2023-07-27T14:26:59.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb8ffff700 1 -- 172.21.15.115:0/1493476034 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800bae0 con 0x7fcb98064230 2023-07-27T14:26:59.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1493476034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98064230 msgr2=0x7fcb980656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:59.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1493476034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98064230 0x7fcb980656d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fcb88006fd0 tx=0x7fcb880090f0).stop 2023-07-27T14:26:59.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1493476034 shutdown_connections 2023-07-27T14:26:59.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1493476034 >> v2:172.21.15.159:3300/0 conn(0x7fcb98065bc0 0x7fcb98157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.062+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1493476034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb980c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.063+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1493476034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98064230 0x7fcb980656d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.063+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1493476034 >> 172.21.15.115:0/1493476034 conn(0x7fcb980c7b90 msgr2=0x7fcb980c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:59.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.063+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1493476034 shutdown_connections 2023-07-27T14:26:59.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.063+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1493476034 wait complete. 2023-07-27T14:26:59.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.064+0000 7fcb9f5ff700 1 Processor -- start 2023-07-27T14:26:59.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.064+0000 7fcb9f5ff700 1 -- start start 2023-07-27T14:26:59.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9f5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb98064230 0x7fcb980acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:59.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9f5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98065bc0 0x7fcb980a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:59.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9f5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb98069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:59.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9f5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98093360 con 0x7fcb98065bc0 2023-07-27T14:26:59.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9f5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98094630 con 0x7fcb98064230 2023-07-27T14:26:59.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9f5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98093a20 con 0x7fcb98153e00 2023-07-27T14:26:59.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9cb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98065bc0 0x7fcb980a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:59.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9cb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98065bc0 0x7fcb980a9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43862/0 (socket says 172.21.15.115:43862) 2023-07-27T14:26:59.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9cb9a700 1 -- 172.21.15.115:0/1683529153 learned_addr learned my addr 172.21.15.115:0/1683529153 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:26:59.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9d39b700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb98064230 0x7fcb980acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:59.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.065+0000 7fcb9db9c700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb98069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:59.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9cb9a700 1 -- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 msgr2=0x7fcb98069740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:59.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9cb9a700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb98069740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9cb9a700 1 -- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb98064230 msgr2=0x7fcb980acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:59.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9cb9a700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb98064230 0x7fcb980acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9cb9a700 1 -- 172.21.15.115:0/1683529153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88009370 con 0x7fcb98065bc0 2023-07-27T14:26:59.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9db9c700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb98069740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:26:59.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9cb9a700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98065bc0 0x7fcb980a9580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fcb88011000 tx=0x7fcb88017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:59.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb8d7fa700 1 -- 172.21.15.115:0/1683529153 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800b8d0 con 0x7fcb98065bc0 2023-07-27T14:26:59.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb8d7fa700 1 -- 172.21.15.115:0/1683529153 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8800ba50 con 0x7fcb98065bc0 2023-07-27T14:26:59.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb98093d00 con 0x7fcb98065bc0 2023-07-27T14:26:59.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb8d7fa700 1 -- 172.21.15.115:0/1683529153 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8801c670 con 0x7fcb98065bc0 2023-07-27T14:26:59.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.066+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb980942c0 con 0x7fcb98065bc0 2023-07-27T14:26:59.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.067+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9806c470 con 0x7fcb98065bc0 2023-07-27T14:26:59.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.068+0000 7fcb8d7fa700 1 -- 172.21.15.115:0/1683529153 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcb8802c070 con 0x7fcb98065bc0 2023-07-27T14:26:59.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.069+0000 7fcb8d7fa700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb7c05ed90 0x7fcb7c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:26:59.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.069+0000 7fcb8d7fa700 1 -- 172.21.15.115:0/1683529153 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fcb8807b460 con 0x7fcb98065bc0 2023-07-27T14:26:59.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.069+0000 7fcb9d39b700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb7c05ed90 0x7fcb7c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:26:59.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.070+0000 7fcb9d39b700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb7c05ed90 0x7fcb7c061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fcb9400ab40 tx=0x7fcb94008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:26:59.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.073+0000 7fcb8d7fa700 1 -- 172.21.15.115:0/1683529153 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb8804cc40 con 0x7fcb98065bc0 2023-07-27T14:26:59.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.243+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fcb980c4390 con 0x7fcb98065bc0 2023-07-27T14:26:59.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.781+0000 7fcb8d7fa700 1 -- 172.21.15.115:0/1683529153 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7fcb8802a070 con 0x7fcb98065bc0 2023-07-27T14:26:59.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb7c05ed90 msgr2=0x7fcb7c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:59.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb7c05ed90 0x7fcb7c061250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fcb9400ab40 tx=0x7fcb94008040).stop 2023-07-27T14:26:59.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98065bc0 msgr2=0x7fcb980a9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:26:59.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98065bc0 0x7fcb980a9580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fcb88011000 tx=0x7fcb88017000).stop 2023-07-27T14:26:59.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 shutdown_connections 2023-07-27T14:26:59.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb7c05ed90 0x7fcb7c061250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb98153e00 0x7fcb98069740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb98064230 0x7fcb980acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 --2- 172.21.15.115:0/1683529153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb98065bc0 0x7fcb980a9580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:26:59.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.785+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 >> 172.21.15.115:0/1683529153 conn(0x7fcb980c7b90 msgr2=0x7fcb980c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:26:59.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.786+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 shutdown_connections 2023-07-27T14:26:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:26:59.786+0000 7fcb9f5ff700 1 -- 172.21.15.115:0/1683529153 wait complete. 2023-07-27T14:26:59.804 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:26:59.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:27:00.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.002+0000 7f34a6fff700 1 Processor -- start 2023-07-27T14:27:00.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.002+0000 7f34a6fff700 1 -- start start 2023-07-27T14:27:00.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.003+0000 7f34a6fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34a014ae00 0x7f34a0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:00.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a6fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f34a0063260 0x7f34a00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:00.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a6fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a01553f0 con 0x7f34a014b1e0 2023-07-27T14:27:00.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a6fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a0157a50 con 0x7f34a014ae00 2023-07-27T14:27:00.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a6fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a0157d10 con 0x7f34a0063260 2023-07-27T14:27:00.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a4d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34a014ae00 0x7f34a0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:00.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f349ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f34a014b1e0 0x7f34a0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37366/0 (socket says 172.21.15.115:37366) 2023-07-27T14:27:00.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f349ffff700 1 -- 172.21.15.115:0/3377315256 learned_addr learned my addr 172.21.15.115:0/3377315256 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:00.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a559c700 1 --2- 172.21.15.115:0/3377315256 >> v2:172.21.15.159:3300/0 conn(0x7f34a0063260 0x7f34a00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f349f7fe700 1 -- 172.21.15.115:0/3377315256 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983410376 0 0) 0x7f34a01553f0 con 0x7f34a014b1e0 2023-07-27T14:27:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f349f7fe700 1 -- 172.21.15.115:0/3377315256 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34900033f0 con 0x7f34a014b1e0 2023-07-27T14:27:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a4d9b700 1 -- 172.21.15.115:0/3377315256 >> v2:172.21.15.159:3300/0 conn(0x7f34a0063260 msgr2=0x7f34a00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a4d9b700 1 --2- 172.21.15.115:0/3377315256 >> v2:172.21.15.159:3300/0 conn(0x7f34a0063260 0x7f34a00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a4d9b700 1 -- 172.21.15.115:0/3377315256 >> v1:172.21.15.115:6789/0 conn(0x7f34a014b1e0 legacy=0x7f34a0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.004+0000 7f34a4d9b700 1 -- 172.21.15.115:0/3377315256 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0157ff0 con 0x7f34a014ae00 2023-07-27T14:27:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a4d9b700 1 --2- 172.21.15.115:0/3377315256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a014ae00 0x7f34a0154f00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f34a0083430 tx=0x7f3494009060).ready entity=mon.0 client_cookie=7119d572e9b34880 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f349f7fe700 1 -- 172.21.15.115:0/3377315256 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400f510 con 0x7f34a014ae00 2023-07-27T14:27:00.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f349f7fe700 1 -- 172.21.15.115:0/3377315256 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400f670 con 0x7f34a014ae00 2023-07-27T14:27:00.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f349f7fe700 1 -- 172.21.15.115:0/3377315256 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400f9f0 con 0x7f34a014ae00 2023-07-27T14:27:00.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a6fff700 1 -- 172.21.15.115:0/3377315256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a014ae00 msgr2=0x7f34a0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:00.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a6fff700 1 --2- 172.21.15.115:0/3377315256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a014ae00 0x7f34a0154f00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f34a0083430 tx=0x7f3494009060).stop 2023-07-27T14:27:00.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a6fff700 1 -- 172.21.15.115:0/3377315256 shutdown_connections 2023-07-27T14:27:00.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a6fff700 1 --2- 172.21.15.115:0/3377315256 >> v2:172.21.15.159:3300/0 conn(0x7f34a0063260 0x7f34a00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a6fff700 1 --2- 172.21.15.115:0/3377315256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a014ae00 0x7f34a0154f00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a6fff700 1 -- 172.21.15.115:0/3377315256 >> 172.21.15.115:0/3377315256 conn(0x7f34a005e940 msgr2=0x7f34a00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a6fff700 1 -- 172.21.15.115:0/3377315256 shutdown_connections 2023-07-27T14:27:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.005+0000 7f34a6fff700 1 -- 172.21.15.115:0/3377315256 wait complete. 2023-07-27T14:27:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.007+0000 7f34a6fff700 1 Processor -- start 2023-07-27T14:27:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.007+0000 7f34a6fff700 1 -- start start 2023-07-27T14:27:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a6fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a0063260 0x7f34a00ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a6fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34a014ae00 0x7f34a013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a6fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a014b1e0 0x7f34a00c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:00.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a6fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00af9b0 con 0x7f34a0063260 2023-07-27T14:27:00.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a6fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00aea60 con 0x7f34a014b1e0 2023-07-27T14:27:00.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a6fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00aed30 con 0x7f34a014ae00 2023-07-27T14:27:00.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a4d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a0063260 0x7f34a00ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:00.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a4d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a0063260 0x7f34a00ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43890/0 (socket says 172.21.15.115:43890) 2023-07-27T14:27:00.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a4d9b700 1 -- 172.21.15.115:0/1926862266 learned_addr learned my addr 172.21.15.115:0/1926862266 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:00.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f34a559c700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a014b1e0 0x7f34a00c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:00.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.008+0000 7f349ffff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34a014ae00 0x7f34a013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:00.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f34a4d9b700 1 -- 172.21.15.115:0/1926862266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34a014ae00 msgr2=0x7f34a013f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:00.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f34a4d9b700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34a014ae00 0x7f34a013f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f34a4d9b700 1 -- 172.21.15.115:0/1926862266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a014b1e0 msgr2=0x7f34a00c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:00.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f34a4d9b700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a014b1e0 0x7f34a00c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f34a4d9b700 1 -- 172.21.15.115:0/1926862266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940092a0 con 0x7f34a0063260 2023-07-27T14:27:00.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f34a4d9b700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a0063260 0x7f34a00ae570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3494009dd0 tx=0x7f3494017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:00.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f349cff9700 1 -- 172.21.15.115:0/1926862266 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400f7e0 con 0x7f34a0063260 2023-07-27T14:27:00.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f349cff9700 1 -- 172.21.15.115:0/1926862266 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400f940 con 0x7f34a0063260 2023-07-27T14:27:00.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a00af010 con 0x7f34a0063260 2023-07-27T14:27:00.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f349cff9700 1 -- 172.21.15.115:0/1926862266 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349401b660 con 0x7f34a0063260 2023-07-27T14:27:00.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.009+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a00af5d0 con 0x7f34a0063260 2023-07-27T14:27:00.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.010+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a00afc20 con 0x7f34a0063260 2023-07-27T14:27:00.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.011+0000 7f349cff9700 1 -- 172.21.15.115:0/1926862266 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f349402b070 con 0x7f34a0063260 2023-07-27T14:27:00.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.012+0000 7f349cff9700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f348405ed90 0x7f3484061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:00.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.012+0000 7f349cff9700 1 -- 172.21.15.115:0/1926862266 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f349407b270 con 0x7f34a0063260 2023-07-27T14:27:00.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.012+0000 7f349ffff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f348405ed90 0x7f3484061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:00.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.013+0000 7f349ffff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f348405ed90 0x7f3484061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f348c007fd0 tx=0x7f348c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:00.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.017+0000 7f349cff9700 1 -- 172.21.15.115:0/1926862266 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f349404c8e0 con 0x7f34a0063260 2023-07-27T14:27:00.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.185+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f34a006c470 con 0x7f34a0063260 2023-07-27T14:27:00.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.789+0000 7f349cff9700 1 -- 172.21.15.115:0/1926862266 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f34940290d0 con 0x7f34a0063260 2023-07-27T14:27:00.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.797+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f348405ed90 msgr2=0x7f3484061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:00.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.797+0000 7f34a6fff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f348405ed90 0x7f3484061250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f348c007fd0 tx=0x7f348c009040).stop 2023-07-27T14:27:00.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.797+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a0063260 msgr2=0x7f34a00ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:00.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.797+0000 7f34a6fff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a0063260 0x7f34a00ae570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3494009dd0 tx=0x7f3494017000).stop 2023-07-27T14:27:00.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.799+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 shutdown_connections 2023-07-27T14:27:00.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.799+0000 7f34a6fff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f348405ed90 0x7f3484061250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.799+0000 7f34a6fff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34a014b1e0 0x7f34a00c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.799+0000 7f34a6fff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34a0063260 0x7f34a00ae570 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.799+0000 7f34a6fff700 1 --2- 172.21.15.115:0/1926862266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34a014ae00 0x7f34a013f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:00.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.799+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 >> 172.21.15.115:0/1926862266 conn(0x7f34a005e940 msgr2=0x7f34a00ac6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:00.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.803+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 shutdown_connections 2023-07-27T14:27:00.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:00.803+0000 7f34a6fff700 1 -- 172.21.15.115:0/1926862266 wait complete. 2023-07-27T14:27:00.823 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:27:00.848 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:27:01.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.026+0000 7f5e91fff700 1 Processor -- start 2023-07-27T14:27:01.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.026+0000 7f5e91fff700 1 -- start start 2023-07-27T14:27:01.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e91fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e8c14ae00 0x7f5e8c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e91fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5e8c063260 0x7f5e8c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e91fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c1553f0 con 0x7f5e8c14b1e0 2023-07-27T14:27:01.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e91fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c157a50 con 0x7f5e8c14ae00 2023-07-27T14:27:01.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e91fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c157d10 con 0x7f5e8c063260 2023-07-27T14:27:01.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e8b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e8c14ae00 0x7f5e8c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e8affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5e8c14b1e0 0x7f5e8c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37372/0 (socket says 172.21.15.115:37372) 2023-07-27T14:27:01.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e8affd700 1 -- 172.21.15.115:0/934945239 learned_addr learned my addr 172.21.15.115:0/934945239 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:01.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e8bfff700 1 --2- 172.21.15.115:0/934945239 >> v2:172.21.15.159:3300/0 conn(0x7f5e8c063260 0x7f5e8c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e8b7fe700 1 -- 172.21.15.115:0/934945239 >> v2:172.21.15.159:3300/0 conn(0x7f5e8c063260 msgr2=0x7f5e8c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:01.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e8b7fe700 1 --2- 172.21.15.115:0/934945239 >> v2:172.21.15.159:3300/0 conn(0x7f5e8c063260 0x7f5e8c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e8b7fe700 1 -- 172.21.15.115:0/934945239 >> v1:172.21.15.115:6789/0 conn(0x7f5e8c14b1e0 legacy=0x7f5e8c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e8b7fe700 1 -- 172.21.15.115:0/934945239 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c157ff0 con 0x7f5e8c14ae00 2023-07-27T14:27:01.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.028+0000 7f5e8a7fc700 1 -- 172.21.15.115:0/934945239 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955928977 0 0) 0x7f5e8c1553f0 con 0x7f5e8c14b1e0 2023-07-27T14:27:01.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e8bfff700 1 --2- 172.21.15.115:0/934945239 >> v2:172.21.15.159:3300/0 conn(0x7f5e8c063260 0x7f5e8c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:01.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e8b7fe700 1 --2- 172.21.15.115:0/934945239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c14ae00 0x7f5e8c154f00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5e8c083430 tx=0x7f5e7c009060).ready entity=mon.0 client_cookie=e47c36ee1c07674d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e8a7fc700 1 -- 172.21.15.115:0/934945239 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00b580 con 0x7f5e8c14ae00 2023-07-27T14:27:01.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e8a7fc700 1 -- 172.21.15.115:0/934945239 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00b6e0 con 0x7f5e8c14ae00 2023-07-27T14:27:01.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e8a7fc700 1 -- 172.21.15.115:0/934945239 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00ba60 con 0x7f5e8c14ae00 2023-07-27T14:27:01.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e91fff700 1 -- 172.21.15.115:0/934945239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c14ae00 msgr2=0x7f5e8c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e91fff700 1 --2- 172.21.15.115:0/934945239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c14ae00 0x7f5e8c154f00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5e8c083430 tx=0x7f5e7c009060).stop 2023-07-27T14:27:01.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e91fff700 1 -- 172.21.15.115:0/934945239 shutdown_connections 2023-07-27T14:27:01.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e91fff700 1 --2- 172.21.15.115:0/934945239 >> v2:172.21.15.159:3300/0 conn(0x7f5e8c063260 0x7f5e8c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e91fff700 1 --2- 172.21.15.115:0/934945239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c14ae00 0x7f5e8c154f00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.029+0000 7f5e91fff700 1 -- 172.21.15.115:0/934945239 >> 172.21.15.115:0/934945239 conn(0x7f5e8c05e940 msgr2=0x7f5e8c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:01.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.030+0000 7f5e91fff700 1 -- 172.21.15.115:0/934945239 shutdown_connections 2023-07-27T14:27:01.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.030+0000 7f5e91fff700 1 -- 172.21.15.115:0/934945239 wait complete. 2023-07-27T14:27:01.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.032+0000 7f5e91fff700 1 Processor -- start 2023-07-27T14:27:01.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.032+0000 7f5e91fff700 1 -- start start 2023-07-27T14:27:01.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e91fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c063260 0x7f5e8c0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e91fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8c14ae00 0x7f5e8c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e91fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c14b1e0 0x7f5e8c167910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e91fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0af290 con 0x7f5e8c063260 2023-07-27T14:27:01.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e91fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0c2140 con 0x7f5e8c14b1e0 2023-07-27T14:27:01.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e91fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0ae3a0 con 0x7f5e8c14ae00 2023-07-27T14:27:01.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c063260 0x7f5e8c0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c063260 0x7f5e8c0c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43908/0 (socket says 172.21.15.115:43908) 2023-07-27T14:27:01.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8b7fe700 1 -- 172.21.15.115:0/4280480645 learned_addr learned my addr 172.21.15.115:0/4280480645 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:01.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8affd700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8c14ae00 0x7f5e8c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8bfff700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c14b1e0 0x7f5e8c167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8b7fe700 1 -- 172.21.15.115:0/4280480645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8c14ae00 msgr2=0x7f5e8c156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8b7fe700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8c14ae00 0x7f5e8c156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8b7fe700 1 -- 172.21.15.115:0/4280480645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c14b1e0 msgr2=0x7f5e8c167910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8b7fe700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c14b1e0 0x7f5e8c167910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.033+0000 7f5e8b7fe700 1 -- 172.21.15.115:0/4280480645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0092a0 con 0x7f5e8c063260 2023-07-27T14:27:01.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.034+0000 7f5e8b7fe700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c063260 0x7f5e8c0c1c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5e8c155580 tx=0x7f5e7c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.034+0000 7f5e737fe700 1 -- 172.21.15.115:0/4280480645 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00b850 con 0x7f5e8c063260 2023-07-27T14:27:01.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.034+0000 7f5e737fe700 1 -- 172.21.15.115:0/4280480645 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00b9b0 con 0x7f5e8c063260 2023-07-27T14:27:01.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.034+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c0ae680 con 0x7f5e8c063260 2023-07-27T14:27:01.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.034+0000 7f5e737fe700 1 -- 172.21.15.115:0/4280480645 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c01b620 con 0x7f5e8c063260 2023-07-27T14:27:01.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.034+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c0aec40 con 0x7f5e8c063260 2023-07-27T14:27:01.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.035+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c06c470 con 0x7f5e8c063260 2023-07-27T14:27:01.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.036+0000 7f5e737fe700 1 -- 172.21.15.115:0/4280480645 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5e7c02b070 con 0x7f5e8c063260 2023-07-27T14:27:01.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.037+0000 7f5e737fe700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e7805ed60 0x7f5e78061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.037+0000 7f5e737fe700 1 -- 172.21.15.115:0/4280480645 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f5e7c07b9f0 con 0x7f5e8c063260 2023-07-27T14:27:01.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.037+0000 7f5e8affd700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e7805ed60 0x7f5e78061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.038+0000 7f5e8affd700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e7805ed60 0x7f5e78061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5e8c0b0d30 tx=0x7f5e80009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.041+0000 7f5e737fe700 1 -- 172.21.15.115:0/4280480645 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5e7c04cee0 con 0x7f5e8c063260 2023-07-27T14:27:01.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.250+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5e8c0c0890 con 0x7f5e8c063260 2023-07-27T14:27:01.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.259+0000 7f5e737fe700 1 -- 172.21.15.115:0/4280480645 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5e7c029020 con 0x7f5e8c063260 2023-07-27T14:27:01.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.265+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e7805ed60 msgr2=0x7f5e78061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.265+0000 7f5e91fff700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e7805ed60 0x7f5e78061220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5e8c0b0d30 tx=0x7f5e80009040).stop 2023-07-27T14:27:01.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.265+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c063260 msgr2=0x7f5e8c0c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.265+0000 7f5e91fff700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c063260 0x7f5e8c0c1c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5e8c155580 tx=0x7f5e7c017000).stop 2023-07-27T14:27:01.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.265+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 shutdown_connections 2023-07-27T14:27:01.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.265+0000 7f5e91fff700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e7805ed60 0x7f5e78061220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.266+0000 7f5e91fff700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e8c14b1e0 0x7f5e8c167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.266+0000 7f5e91fff700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e8c063260 0x7f5e8c0c1c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.266+0000 7f5e91fff700 1 --2- 172.21.15.115:0/4280480645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e8c14ae00 0x7f5e8c156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.266+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 >> 172.21.15.115:0/4280480645 conn(0x7f5e8c05e940 msgr2=0x7f5e8c1544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:01.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.266+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 shutdown_connections 2023-07-27T14:27:01.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.267+0000 7f5e91fff700 1 -- 172.21.15.115:0/4280480645 wait complete. 2023-07-27T14:27:01.283 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 3 and data pool 4 2023-07-27T14:27:01.309 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:01.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.484+0000 7f3d52dff700 1 Processor -- start 2023-07-27T14:27:01.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.484+0000 7f3d52dff700 1 -- start start 2023-07-27T14:27:01.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d52dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3d4c153ec0 0x7f3d4c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d52dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0aa4d0 con 0x7f3d4c0aa050 2023-07-27T14:27:01.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d52dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0c05c0 con 0x7f3d4c0aaa40 2023-07-27T14:27:01.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d52dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c0bfc90 con 0x7f3d4c153ec0 2023-07-27T14:27:01.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d50b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3d4c153ec0 0x7f3d4c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d4bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3d4c0aa050 0x7f3d4c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37386/0 (socket says 172.21.15.115:37386) 2023-07-27T14:27:01.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d4bfff700 1 -- 172.21.15.115:0/3822145831 learned_addr learned my addr 172.21.15.115:0/3822145831 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:01.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d50b9b700 1 -- 172.21.15.115:0/3822145831 >> v1:172.21.15.159:6789/0 conn(0x7f3d4c0aaa40 legacy=0x7f3d4c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:01.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d50b9b700 1 -- 172.21.15.115:0/3822145831 >> v1:172.21.15.115:6789/0 conn(0x7f3d4c0aa050 legacy=0x7f3d4c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d4b7fe700 1 -- 172.21.15.115:0/3822145831 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439086498 0 0) 0x7f3d38001110 con 0x7f3d4c0aa050 2023-07-27T14:27:01.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.486+0000 7f3d50b9b700 1 -- 172.21.15.115:0/3822145831 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0bff70 con 0x7f3d4c153ec0 2023-07-27T14:27:01.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d50b9b700 1 --2- 172.21.15.115:0/3822145831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0a9b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3d40009760 tx=0x7f3d40009060).ready entity=mon.0 client_cookie=3487946510214d60 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d4b7fe700 1 -- 172.21.15.115:0/3822145831 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000b520 con 0x7f3d4c153ec0 2023-07-27T14:27:01.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d4b7fe700 1 -- 172.21.15.115:0/3822145831 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4000b680 con 0x7f3d4c153ec0 2023-07-27T14:27:01.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d4b7fe700 1 -- 172.21.15.115:0/3822145831 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000ba00 con 0x7f3d4c153ec0 2023-07-27T14:27:01.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d52dff700 1 -- 172.21.15.115:0/3822145831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 msgr2=0x7f3d4c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d52dff700 1 --2- 172.21.15.115:0/3822145831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0a9b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3d40009760 tx=0x7f3d40009060).stop 2023-07-27T14:27:01.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d52dff700 1 -- 172.21.15.115:0/3822145831 shutdown_connections 2023-07-27T14:27:01.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d52dff700 1 --2- 172.21.15.115:0/3822145831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0a9b60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.487+0000 7f3d52dff700 1 -- 172.21.15.115:0/3822145831 >> 172.21.15.115:0/3822145831 conn(0x7f3d4c0cb610 msgr2=0x7f3d4c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:01.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.488+0000 7f3d52dff700 1 -- 172.21.15.115:0/3822145831 shutdown_connections 2023-07-27T14:27:01.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.488+0000 7f3d52dff700 1 -- 172.21.15.115:0/3822145831 wait complete. 2023-07-27T14:27:01.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.489+0000 7f3d52dff700 1 Processor -- start 2023-07-27T14:27:01.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.489+0000 7f3d52dff700 1 -- start start 2023-07-27T14:27:01.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d52dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d4c0aa050 0x7f3d4c0c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d52dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3d4c0aaa40 0x7f3d4c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d52dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d52dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c164090 con 0x7f3d4c153ec0 2023-07-27T14:27:01.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d52dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c164350 con 0x7f3d4c0aa050 2023-07-27T14:27:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d52dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c164630 con 0x7f3d4c0aaa40 2023-07-27T14:27:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d5139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d5139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43934/0 (socket says 172.21.15.115:43934) 2023-07-27T14:27:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d5139c700 1 -- 172.21.15.115:0/2285600019 learned_addr learned my addr 172.21.15.115:0/2285600019 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d50b9b700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d4c0aa050 0x7f3d4c0c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.490+0000 7f3d4bfff700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3d4c0aaa40 0x7f3d4c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d5139c700 1 -- 172.21.15.115:0/2285600019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3d4c0aaa40 msgr2=0x7f3d4c150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d5139c700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3d4c0aaa40 0x7f3d4c150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d5139c700 1 -- 172.21.15.115:0/2285600019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d4c0aa050 msgr2=0x7f3d4c0c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d5139c700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d4c0aa050 0x7f3d4c0c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d5139c700 1 -- 172.21.15.115:0/2285600019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400092a0 con 0x7f3d4c153ec0 2023-07-27T14:27:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d5139c700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0ab8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3d4400c810 tx=0x7f3d44002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d48ff9700 1 -- 172.21.15.115:0/2285600019 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400e4a0 con 0x7f3d4c153ec0 2023-07-27T14:27:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d48ff9700 1 -- 172.21.15.115:0/2285600019 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400e620 con 0x7f3d4c153ec0 2023-07-27T14:27:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d48ff9700 1 -- 172.21.15.115:0/2285600019 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400e9e0 con 0x7f3d4c153ec0 2023-07-27T14:27:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c164910 con 0x7f3d4c153ec0 2023-07-27T14:27:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.491+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c0c49a0 con 0x7f3d4c153ec0 2023-07-27T14:27:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.492+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c06c470 con 0x7f3d4c153ec0 2023-07-27T14:27:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.493+0000 7f3d48ff9700 1 -- 172.21.15.115:0/2285600019 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3d44019030 con 0x7f3d4c153ec0 2023-07-27T14:27:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.494+0000 7f3d48ff9700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3d3005ed60 0x7f3d30061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.494+0000 7f3d48ff9700 1 -- 172.21.15.115:0/2285600019 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d44079150 con 0x7f3d4c153ec0 2023-07-27T14:27:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.494+0000 7f3d50b9b700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3d3005ed60 0x7f3d30061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.495+0000 7f3d50b9b700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3d3005ed60 0x7f3d30061220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3d4c161cb0 tx=0x7f3d40017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.498+0000 7f3d48ff9700 1 -- 172.21.15.115:0/2285600019 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d440488f0 con 0x7f3d4c153ec0 2023-07-27T14:27:01.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.669+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d4c0c0250 con 0x7f3d4c153ec0 2023-07-27T14:27:01.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.670+0000 7f3d48ff9700 1 -- 172.21.15.115:0/2285600019 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17085 (secure 0 0 0) 0x7f3d44017070 con 0x7f3d4c153ec0 2023-07-27T14:27:01.683 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:01.684 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":21,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:01.252370+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:01.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.672+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3d3005ed60 msgr2=0x7f3d30061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.672+0000 7f3d52dff700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3d3005ed60 0x7f3d30061220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3d4c161cb0 tx=0x7f3d40017000).stop 2023-07-27T14:27:01.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.672+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 msgr2=0x7f3d4c0ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.672+0000 7f3d52dff700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0ab8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3d4400c810 tx=0x7f3d44002530).stop 2023-07-27T14:27:01.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.672+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 shutdown_connections 2023-07-27T14:27:01.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.672+0000 7f3d52dff700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3d3005ed60 0x7f3d30061220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.673+0000 7f3d52dff700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d4c153ec0 0x7f3d4c0ab8f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.673+0000 7f3d52dff700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d4c0aa050 0x7f3d4c0c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.673+0000 7f3d52dff700 1 --2- 172.21.15.115:0/2285600019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3d4c0aaa40 0x7f3d4c150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.673+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 >> 172.21.15.115:0/2285600019 conn(0x7f3d4c0cb610 msgr2=0x7f3d4c0ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.673+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 shutdown_connections 2023-07-27T14:27:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.673+0000 7f3d52dff700 1 -- 172.21.15.115:0/2285600019 wait complete. 2023-07-27T14:27:01.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:01.784 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-07-27T14:27:01.771+0000 7f0412ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:27:01.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.880+0000 7f1a8a9ff700 1 Processor -- start 2023-07-27T14:27:01.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.880+0000 7f1a8a9ff700 1 -- start start 2023-07-27T14:27:01.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.881+0000 7f1a8a9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1a84153ec0 0x7f1a840a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.881+0000 7f1a8a9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840aa4d0 con 0x7f1a840aaa40 2023-07-27T14:27:01.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.881+0000 7f1a8a9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840c05c0 con 0x7f1a840aa050 2023-07-27T14:27:01.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.881+0000 7f1a8a9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840bfc90 con 0x7f1a84153ec0 2023-07-27T14:27:01.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.881+0000 7f1a88f9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1a840aaa40 0x7f1a840c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37394/0 (socket says 172.21.15.115:37394) 2023-07-27T14:27:01.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.881+0000 7f1a88f9c700 1 -- 172.21.15.115:0/2932579611 learned_addr learned my addr 172.21.15.115:0/2932579611 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:01.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a83fff700 1 --2- 172.21.15.115:0/2932579611 >> v2:172.21.15.159:3300/0 conn(0x7f1a84153ec0 0x7f1a840a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279650687 0 0) 0x7f1a7c001490 con 0x7f1a840aaa40 2023-07-27T14:27:01.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a700033f0 con 0x7f1a840aaa40 2023-07-27T14:27:01.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950775504 0 0) 0x7f1a840c05c0 con 0x7f1a840aa050 2023-07-27T14:27:01.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a7c001490 con 0x7f1a840aa050 2023-07-27T14:27:01.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 955634246 0 0) 0x7f1a700033f0 con 0x7f1a840aaa40 2023-07-27T14:27:01.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 >> v2:172.21.15.159:3300/0 conn(0x7f1a84153ec0 msgr2=0x7f1a840a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:01.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 --2- 172.21.15.115:0/2932579611 >> v2:172.21.15.159:3300/0 conn(0x7f1a84153ec0 0x7f1a840a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 >> v1:172.21.15.159:6789/0 conn(0x7f1a840aa050 legacy=0x7f1a840640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840bff70 con 0x7f1a840aaa40 2023-07-27T14:27:01.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1a7c001980 con 0x7f1a840aaa40 2023-07-27T14:27:01.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 >> v1:172.21.15.115:6789/0 conn(0x7f1a840aaa40 legacy=0x7f1a840c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70004690 0x7f1a70004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a70005000 0x7f1a7000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840bfc90 con 0x7f1a70003a70 2023-07-27T14:27:01.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7000bf60 con 0x7f1a70004690 2023-07-27T14:27:01.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.882+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7000c0d0 con 0x7f1a70005000 2023-07-27T14:27:01.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a83fff700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a7bfff700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70004690 0x7f1a70004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a88f9c700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a70005000 0x7f1a7000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a83fff700 1 -- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a70005000 msgr2=0x7f1a7000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:01.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a83fff700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a70005000 0x7f1a7000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a83fff700 1 -- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70004690 msgr2=0x7f1a70004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:01.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a83fff700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70004690 0x7f1a70004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a83fff700 1 -- 172.21.15.115:0/2932579611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700033f0 con 0x7f1a70003a70 2023-07-27T14:27:01.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a7bfff700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70004690 0x7f1a70004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:01.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a88f9c700 1 -- 172.21.15.115:0/2932579611 reap_dead start 2023-07-27T14:27:01.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a83fff700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a70003e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f1a74009a80 tx=0x7f1a74009060).ready entity=mon.0 client_cookie=cc54f9cc8c673cb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74009430 con 0x7f1a70003a70 2023-07-27T14:27:01.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400e640 con 0x7f1a70003a70 2023-07-27T14:27:01.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.883+0000 7f1a837fe700 1 -- 172.21.15.115:0/2932579611 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400e9c0 con 0x7f1a70003a70 2023-07-27T14:27:01.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.884+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/2932579611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 msgr2=0x7f1a70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.884+0000 7f1a8a9ff700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a70003e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f1a74009a80 tx=0x7f1a74009060).stop 2023-07-27T14:27:01.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.884+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/2932579611 shutdown_connections 2023-07-27T14:27:01.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.884+0000 7f1a8a9ff700 1 --2- 172.21.15.115:0/2932579611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a70003e70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.884+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/2932579611 >> 172.21.15.115:0/2932579611 conn(0x7f1a840cb610 msgr2=0x7f1a840c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:01.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.884+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/2932579611 shutdown_connections 2023-07-27T14:27:01.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.884+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/2932579611 wait complete. 2023-07-27T14:27:01.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.885+0000 7f1a8a9ff700 1 Processor -- start 2023-07-27T14:27:01.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.886+0000 7f1a8a9ff700 1 -- start start 2023-07-27T14:27:01.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.886+0000 7f1a8a9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a840a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.886+0000 7f1a8a9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84152860 0x7f1a84152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.886+0000 7f1a8a9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a840c2c00 0x7f1a840c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.886+0000 7f1a8a9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840c44d0 con 0x7f1a70003a70 2023-07-27T14:27:01.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.886+0000 7f1a8a9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a841531d0 con 0x7f1a84152860 2023-07-27T14:27:01.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.886+0000 7f1a8a9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840c38c0 con 0x7f1a840c2c00 2023-07-27T14:27:01.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a840a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a840a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43954/0 (socket says 172.21.15.115:43954) 2023-07-27T14:27:01.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 -- 172.21.15.115:0/3313573611 learned_addr learned my addr 172.21.15.115:0/3313573611 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:01.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a7bfff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84152860 0x7f1a84152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 -- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a840c2c00 msgr2=0x7f1a840c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a88f9c700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a840c2c00 0x7f1a840c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a840c2c00 0x7f1a840c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 -- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84152860 msgr2=0x7f1a84152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:01.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84152860 0x7f1a84152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:01.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 -- 172.21.15.115:0/3313573611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840c3ba0 con 0x7f1a70003a70 2023-07-27T14:27:01.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a7bfff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84152860 0x7f1a84152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:01.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a83fff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a840a9280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1a7400e4b0 tx=0x7f1a7401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a80ff9700 1 -- 172.21.15.115:0/3313573611 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400ed70 con 0x7f1a70003a70 2023-07-27T14:27:01.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.887+0000 7f1a80ff9700 1 -- 172.21.15.115:0/3313573611 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400eed0 con 0x7f1a70003a70 2023-07-27T14:27:01.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.888+0000 7f1a80ff9700 1 -- 172.21.15.115:0/3313573611 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400e9c0 con 0x7f1a70003a70 2023-07-27T14:27:01.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.888+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840c3e80 con 0x7f1a70003a70 2023-07-27T14:27:01.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.888+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840c3570 con 0x7f1a70003a70 2023-07-27T14:27:01.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.889+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8406c470 con 0x7f1a70003a70 2023-07-27T14:27:01.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.889+0000 7f1a80ff9700 1 -- 172.21.15.115:0/3313573611 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1a7402b030 con 0x7f1a70003a70 2023-07-27T14:27:01.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.890+0000 7f1a80ff9700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1a6405ed60 0x7f1a64061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:01.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.890+0000 7f1a80ff9700 1 -- 172.21.15.115:0/3313573611 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1a7407af10 con 0x7f1a70003a70 2023-07-27T14:27:01.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.890+0000 7f1a7bfff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1a6405ed60 0x7f1a64061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:01.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.891+0000 7f1a7bfff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1a6405ed60 0x7f1a64061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1a6c007fd0 tx=0x7f1a6c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:01.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:01.894+0000 7f1a80ff9700 1 -- 172.21.15.115:0/3313573611 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1a7404c450 con 0x7f1a70003a70 2023-07-27T14:27:02.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.066+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a840c0250 con 0x7f1a70003a70 2023-07-27T14:27:02.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.067+0000 7f1a80ff9700 1 -- 172.21.15.115:0/3313573611 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17085 (secure 0 0 0) 0x7f1a74016030 con 0x7f1a70003a70 2023-07-27T14:27:02.080 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:02.080 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":21,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:01.252370+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1a6405ed60 msgr2=0x7f1a64061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1a6405ed60 0x7f1a64061220 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1a6c007fd0 tx=0x7f1a6c009040).stop 2023-07-27T14:27:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 msgr2=0x7f1a840a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a840a9280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1a7400e4b0 tx=0x7f1a7401a000).stop 2023-07-27T14:27:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 shutdown_connections 2023-07-27T14:27:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1a6405ed60 0x7f1a64061220 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1a840c2c00 0x7f1a840c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a70003a70 0x7f1a840a9280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 --2- 172.21.15.115:0/3313573611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a84152860 0x7f1a84152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 >> 172.21.15.115:0/3313573611 conn(0x7f1a840cb610 msgr2=0x7f1a840c0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 shutdown_connections 2023-07-27T14:27:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.069+0000 7f1a8a9ff700 1 -- 172.21.15.115:0/3313573611 wait complete. 2023-07-27T14:27:02.099 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:27:02.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.279+0000 7f78c0dff700 1 Processor -- start 2023-07-27T14:27:02.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.279+0000 7f78c0dff700 1 -- start start 2023-07-27T14:27:02.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.280+0000 7f78c0dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78bc14ae00 0x7f78bc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:02.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.280+0000 7f78c0dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f78bc14b1e0 0x7f78bc062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:02.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.280+0000 7f78c0dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc1553f0 con 0x7f78bc0c5c50 2023-07-27T14:27:02.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.280+0000 7f78c0dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc157a50 con 0x7f78bc14ae00 2023-07-27T14:27:02.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.280+0000 7f78c0dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc157d10 con 0x7f78bc14b1e0 2023-07-27T14:27:02.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78ba59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78bc14ae00 0x7f78bc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:02.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78ba59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78bc14ae00 0x7f78bc154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43966/0 (socket says 172.21.15.115:43966) 2023-07-27T14:27:02.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78ba59c700 1 -- 172.21.15.115:0/3253896459 learned_addr learned my addr 172.21.15.115:0/3253896459 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:02.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78b9d9b700 1 --2- 172.21.15.115:0/3253896459 >> v2:172.21.15.159:3300/0 conn(0x7f78bc14b1e0 0x7f78bc062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:02.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78ba59c700 1 -- 172.21.15.115:0/3253896459 >> v2:172.21.15.159:3300/0 conn(0x7f78bc14b1e0 msgr2=0x7f78bc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:02.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78ba59c700 1 --2- 172.21.15.115:0/3253896459 >> v2:172.21.15.159:3300/0 conn(0x7f78bc14b1e0 0x7f78bc062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78ba59c700 1 -- 172.21.15.115:0/3253896459 >> v1:172.21.15.159:6789/0 conn(0x7f78bc0c5c50 legacy=0x7f78bc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:02.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78ba59c700 1 -- 172.21.15.115:0/3253896459 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc157ff0 con 0x7f78bc14ae00 2023-07-27T14:27:02.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.281+0000 7f78ba59c700 1 --2- 172.21.15.115:0/3253896459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc154f00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f78bc155580 tx=0x7f78ac0090f0).ready entity=mon.0 client_cookie=bdef8235f6e015a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:02.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78b959a700 1 -- 172.21.15.115:0/3253896459 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00b600 con 0x7f78bc14ae00 2023-07-27T14:27:02.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78b959a700 1 -- 172.21.15.115:0/3253896459 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac00b760 con 0x7f78bc14ae00 2023-07-27T14:27:02.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78b959a700 1 -- 172.21.15.115:0/3253896459 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00bae0 con 0x7f78bc14ae00 2023-07-27T14:27:02.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78c0dff700 1 -- 172.21.15.115:0/3253896459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 msgr2=0x7f78bc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:02.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78c0dff700 1 --2- 172.21.15.115:0/3253896459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc154f00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f78bc155580 tx=0x7f78ac0090f0).stop 2023-07-27T14:27:02.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78c0dff700 1 -- 172.21.15.115:0/3253896459 shutdown_connections 2023-07-27T14:27:02.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78c0dff700 1 --2- 172.21.15.115:0/3253896459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc154f00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78c0dff700 1 --2- 172.21.15.115:0/3253896459 >> v2:172.21.15.159:3300/0 conn(0x7f78bc14b1e0 0x7f78bc062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78c0dff700 1 -- 172.21.15.115:0/3253896459 >> 172.21.15.115:0/3253896459 conn(0x7f78bc05e940 msgr2=0x7f78bc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:02.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78c0dff700 1 -- 172.21.15.115:0/3253896459 shutdown_connections 2023-07-27T14:27:02.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.282+0000 7f78c0dff700 1 -- 172.21.15.115:0/3253896459 wait complete. 2023-07-27T14:27:02.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.284+0000 7f78c0dff700 1 Processor -- start 2023-07-27T14:27:02.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.284+0000 7f78c0dff700 1 -- start start 2023-07-27T14:27:02.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78c0dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0c5c50 0x7f78bc14a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:02.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78c0dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78c0dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78bc14b1e0 0x7f78bc164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78c0dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc165130 con 0x7f78bc14ae00 2023-07-27T14:27:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78c0dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc164e00 con 0x7f78bc0c5c50 2023-07-27T14:27:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78c0dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0c4890 con 0x7f78bc14b1e0 2023-07-27T14:27:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78b9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78b9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc0c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43978/0 (socket says 172.21.15.115:43978) 2023-07-27T14:27:02.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78b9d9b700 1 -- 172.21.15.115:0/1196790680 learned_addr learned my addr 172.21.15.115:0/1196790680 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:02.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78ba59c700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0c5c50 0x7f78bc14a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:02.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78bad9d700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78bc14b1e0 0x7f78bc164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:02.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78b9d9b700 1 -- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78bc14b1e0 msgr2=0x7f78bc164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:02.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78b9d9b700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78bc14b1e0 0x7f78bc164910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78b9d9b700 1 -- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0c5c50 msgr2=0x7f78bc14a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78b9d9b700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0c5c50 0x7f78bc14a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78b9d9b700 1 -- 172.21.15.115:0/1196790680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009370 con 0x7f78bc14ae00 2023-07-27T14:27:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.285+0000 7f78ba59c700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0c5c50 0x7f78bc14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.286+0000 7f78b9d9b700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc0c4220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f78b0006980 tx=0x7f78b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.286+0000 7f78aa7fc700 1 -- 172.21.15.115:0/1196790680 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b00125f0 con 0x7f78bc14ae00 2023-07-27T14:27:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.286+0000 7f78aa7fc700 1 -- 172.21.15.115:0/1196790680 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0012750 con 0x7f78bc14ae00 2023-07-27T14:27:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.286+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc0c4b70 con 0x7f78bc14ae00 2023-07-27T14:27:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.286+0000 7f78aa7fc700 1 -- 172.21.15.115:0/1196790680 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0012ad0 con 0x7f78bc14ae00 2023-07-27T14:27:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.286+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc0c5130 con 0x7f78bc14ae00 2023-07-27T14:27:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.287+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc06c470 con 0x7f78bc14ae00 2023-07-27T14:27:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.288+0000 7f78aa7fc700 1 -- 172.21.15.115:0/1196790680 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f78b0013480 con 0x7f78bc14ae00 2023-07-27T14:27:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.288+0000 7f78aa7fc700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f789c05ed90 0x7f789c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.289+0000 7f78aa7fc700 1 -- 172.21.15.115:0/1196790680 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f78b0079ed0 con 0x7f78bc14ae00 2023-07-27T14:27:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.289+0000 7f78ba59c700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f789c05ed90 0x7f789c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.289+0000 7f78ba59c700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f789c05ed90 0x7f789c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f78bc155580 tx=0x7f78ac017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.292+0000 7f78aa7fc700 1 -- 172.21.15.115:0/1196790680 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78b004b300 con 0x7f78bc14ae00 2023-07-27T14:27:02.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:02.504+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f78bc165270 con 0x7f78bc14ae00 2023-07-27T14:27:03.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.264+0000 7f78aa7fc700 1 -- 172.21.15.115:0/1196790680 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f78b004e920 con 0x7f78bc14ae00 2023-07-27T14:27:03.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f789c05ed90 msgr2=0x7f789c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:03.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f789c05ed90 0x7f789c061250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f78bc155580 tx=0x7f78ac017000).stop 2023-07-27T14:27:03.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 msgr2=0x7f78bc0c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:03.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc0c4220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f78b0006980 tx=0x7f78b0008040).stop 2023-07-27T14:27:03.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 shutdown_connections 2023-07-27T14:27:03.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f789c05ed90 0x7f789c061250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78bc14b1e0 0x7f78bc164910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78bc0c5c50 0x7f78bc14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 --2- 172.21.15.115:0/1196790680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc14ae00 0x7f78bc0c4220 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.267+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 >> 172.21.15.115:0/1196790680 conn(0x7f78bc05e940 msgr2=0x7f78bc152330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:03.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.268+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 shutdown_connections 2023-07-27T14:27:03.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.268+0000 7f78c0dff700 1 -- 172.21.15.115:0/1196790680 wait complete. 2023-07-27T14:27:03.300 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:27:03.301 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:27:03.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.481+0000 7fa5affff700 1 Processor -- start 2023-07-27T14:27:03.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.482+0000 7fa5affff700 1 -- start start 2023-07-27T14:27:03.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5affff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a813a350 0x7fa5a8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5affff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa5a80c36b0 0x7fa5a81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5affff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80bd9a0 con 0x7fa5a813a730 2023-07-27T14:27:03.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5affff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a8066400 con 0x7fa5a80c36b0 2023-07-27T14:27:03.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5affff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8158ae0 con 0x7fa5a813a350 2023-07-27T14:27:03.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5ad59a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa5a813a730 0x7fa5a80c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37404/0 (socket says 172.21.15.115:37404) 2023-07-27T14:27:03.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5ad59a700 1 -- 172.21.15.115:0/3341045927 learned_addr learned my addr 172.21.15.115:0/3341045927 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:03.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5ae59c700 1 --2- 172.21.15.115:0/3341045927 >> v2:172.21.15.159:3300/0 conn(0x7fa5a80c36b0 0x7fa5a81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.483+0000 7fa5add9b700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a813a350 0x7fa5a8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884172989 0 0) 0x7fa5a80bd9a0 con 0x7fa5a813a730 2023-07-27T14:27:03.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5940033f0 con 0x7fa5a813a730 2023-07-27T14:27:03.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4106112752 0 0) 0x7fa5940033f0 con 0x7fa5a813a730 2023-07-27T14:27:03.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a813a350 msgr2=0x7fa5a8065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:03.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a813a350 0x7fa5a8065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 >> v2:172.21.15.159:3300/0 conn(0x7fa5a80c36b0 msgr2=0x7fa5a81585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:03.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 --2- 172.21.15.115:0/3341045927 >> v2:172.21.15.159:3300/0 conn(0x7fa5a80c36b0 0x7fa5a81585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8066610 con 0x7fa5a813a730 2023-07-27T14:27:03.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fa598001470 con 0x7fa5a813a730 2023-07-27T14:27:03.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 >> v1:172.21.15.115:6789/0 conn(0x7fa5a813a730 legacy=0x7fa5a80c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:03.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa594003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa594004690 0x7fa594004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a813a350 0x7fa594005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8066400 con 0x7fa594003960 2023-07-27T14:27:03.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8158ae0 con 0x7fa594004690 2023-07-27T14:27:03.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59400b8e0 con 0x7fa5a813a350 2023-07-27T14:27:03.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5ae59c700 1 --2- 172.21.15.115:0/3341045927 >> v2:172.21.15.159:3300/0 conn(0x7fa5a80c36b0 0x7fa5a81585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:03.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5add9b700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa594003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5ad59a700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa594004690 0x7fa594004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.484+0000 7fa5ae59c700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a813a350 0x7fa594005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5add9b700 1 -- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a813a350 msgr2=0x7fa594005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:03.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5add9b700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a813a350 0x7fa594005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5add9b700 1 -- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa594004690 msgr2=0x7fa594004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5add9b700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa594004690 0x7fa594004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5add9b700 1 -- 172.21.15.115:0/3341045927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5940033f0 con 0x7fa594003960 2023-07-27T14:27:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5add9b700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa594003d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa5a4009a80 tx=0x7fa5a4009060).ready entity=mon.0 client_cookie=20ae8631411e81fc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4009430 con 0x7fa594003960 2023-07-27T14:27:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a400e640 con 0x7fa594003960 2023-07-27T14:27:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5acd99700 1 -- 172.21.15.115:0/3341045927 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a400e9c0 con 0x7fa594003960 2023-07-27T14:27:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5affff700 1 -- 172.21.15.115:0/3341045927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 msgr2=0x7fa594003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5affff700 1 --2- 172.21.15.115:0/3341045927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa594003d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa5a4009a80 tx=0x7fa5a4009060).stop 2023-07-27T14:27:03.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.485+0000 7fa5ae59c700 1 -- 172.21.15.115:0/3341045927 reap_dead start 2023-07-27T14:27:03.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.486+0000 7fa5affff700 1 -- 172.21.15.115:0/3341045927 shutdown_connections 2023-07-27T14:27:03.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.486+0000 7fa5affff700 1 -- 172.21.15.115:0/3341045927 >> 172.21.15.115:0/3341045927 conn(0x7fa5a805e8f0 msgr2=0x7fa5a80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:03.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.486+0000 7fa5affff700 1 -- 172.21.15.115:0/3341045927 shutdown_connections 2023-07-27T14:27:03.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.486+0000 7fa5affff700 1 -- 172.21.15.115:0/3341045927 wait complete. 2023-07-27T14:27:03.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.487+0000 7fa5affff700 1 Processor -- start 2023-07-27T14:27:03.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.487+0000 7fa5affff700 1 -- start start 2023-07-27T14:27:03.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5affff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa5a8155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5affff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a8155f40 0x7fa5a80c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5affff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a80c2800 0x7fa5a80bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5affff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8156fd0 con 0x7fa594003960 2023-07-27T14:27:03.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5affff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80c2c60 con 0x7fa5a80c2800 2023-07-27T14:27:03.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5affff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81563c0 con 0x7fa5a8155f40 2023-07-27T14:27:03.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5add9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa5a8155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5add9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa5a8155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43986/0 (socket says 172.21.15.115:43986) 2023-07-27T14:27:03.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.488+0000 7fa5add9b700 1 -- 172.21.15.115:0/1300530130 learned_addr learned my addr 172.21.15.115:0/1300530130 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:03.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5ad59a700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a8155f40 0x7fa5a80c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5ae59c700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a80c2800 0x7fa5a80bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5add9b700 1 -- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a8155f40 msgr2=0x7fa5a80c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:03.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5add9b700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a8155f40 0x7fa5a80c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5add9b700 1 -- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a80c2800 msgr2=0x7fa5a80bfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:03.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5add9b700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a80c2800 0x7fa5a80bfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:03.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5add9b700 1 -- 172.21.15.115:0/1300530130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a81566a0 con 0x7fa594003960 2023-07-27T14:27:03.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5ad59a700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a8155f40 0x7fa5a80c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:03.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5ae59c700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a80c2800 0x7fa5a80bfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:03.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5add9b700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa5a8155a50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa5940055c0 tx=0x7fa5a401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:03.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa59dffb700 1 -- 172.21.15.115:0/1300530130 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4000cb0 con 0x7fa594003960 2023-07-27T14:27:03.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa59dffb700 1 -- 172.21.15.115:0/1300530130 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a400e7b0 con 0x7fa594003960 2023-07-27T14:27:03.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a8156980 con 0x7fa594003960 2023-07-27T14:27:03.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa59dffb700 1 -- 172.21.15.115:0/1300530130 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4026690 con 0x7fa594003960 2023-07-27T14:27:03.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.489+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a80bff30 con 0x7fa594003960 2023-07-27T14:27:03.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.490+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a806c470 con 0x7fa594003960 2023-07-27T14:27:03.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.491+0000 7fa59dffb700 1 -- 172.21.15.115:0/1300530130 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa5a402c020 con 0x7fa594003960 2023-07-27T14:27:03.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.492+0000 7fa59dffb700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa58c05ed90 0x7fa58c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:03.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.492+0000 7fa59dffb700 1 -- 172.21.15.115:0/1300530130 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa5a407b8a0 con 0x7fa594003960 2023-07-27T14:27:03.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.492+0000 7fa5ad59a700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa58c05ed90 0x7fa58c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:03.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.493+0000 7fa5ad59a700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa58c05ed90 0x7fa58c061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa598001ed0 tx=0x7fa598009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:03.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.496+0000 7fa59dffb700 1 -- 172.21.15.115:0/1300530130 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5a404cd30 con 0x7fa594003960 2023-07-27T14:27:03.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:03.710+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa5a80bdc10 con 0x7fa594003960 2023-07-27T14:27:04.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.272+0000 7fa59dffb700 1 -- 172.21.15.115:0/1300530130 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5a4016020 con 0x7fa594003960 2023-07-27T14:27:04.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.274+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa58c05ed90 msgr2=0x7fa58c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.274+0000 7fa5affff700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa58c05ed90 0x7fa58c061250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa598001ed0 tx=0x7fa598009040).stop 2023-07-27T14:27:04.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.274+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 msgr2=0x7fa5a8155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.274+0000 7fa5affff700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa5a8155a50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa5940055c0 tx=0x7fa5a401a000).stop 2023-07-27T14:27:04.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.275+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 shutdown_connections 2023-07-27T14:27:04.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.275+0000 7fa5affff700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa58c05ed90 0x7fa58c061250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.275+0000 7fa5affff700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5a80c2800 0x7fa5a80bfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.275+0000 7fa5affff700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa594003960 0x7fa5a8155a50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.275+0000 7fa5affff700 1 --2- 172.21.15.115:0/1300530130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5a8155f40 0x7fa5a80c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.275+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 >> 172.21.15.115:0/1300530130 conn(0x7fa5a805e8f0 msgr2=0x7fa5a8153940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:04.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.275+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 shutdown_connections 2023-07-27T14:27:04.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.275+0000 7fa5affff700 1 -- 172.21.15.115:0/1300530130 wait complete. 2023-07-27T14:27:04.306 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:27:04.307 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:27:04.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.484+0000 7f644fbff700 1 Processor -- start 2023-07-27T14:27:04.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.484+0000 7f644fbff700 1 -- start start 2023-07-27T14:27:04.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.485+0000 7f644fbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6448153ec0 0x7f64480a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.485+0000 7f644fbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64480aa050 0x7f64480640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.485+0000 7f644fbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64480aa4d0 con 0x7f64480aaa40 2023-07-27T14:27:04.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.485+0000 7f644fbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64480c05c0 con 0x7f64480aa050 2023-07-27T14:27:04.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.485+0000 7f644fbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64480c1a60 con 0x7f6448153ec0 2023-07-27T14:27:04.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d19a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64480aa050 0x7f64480640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d19a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64480aa050 0x7f64480640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55518/0 (socket says 172.21.15.115:55518) 2023-07-27T14:27:04.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d19a700 1 -- 172.21.15.115:0/3929773448 learned_addr learned my addr 172.21.15.115:0/3929773448 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:04.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d99b700 1 --2- 172.21.15.115:0/3929773448 >> v2:172.21.15.159:3300/0 conn(0x7f6448153ec0 0x7f64480a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d19a700 1 -- 172.21.15.115:0/3929773448 >> v2:172.21.15.159:3300/0 conn(0x7f6448153ec0 msgr2=0x7f64480a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:04.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d19a700 1 --2- 172.21.15.115:0/3929773448 >> v2:172.21.15.159:3300/0 conn(0x7f6448153ec0 0x7f64480a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d19a700 1 -- 172.21.15.115:0/3929773448 >> v1:172.21.15.159:6789/0 conn(0x7f64480aaa40 legacy=0x7f6448157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:04.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d19a700 1 -- 172.21.15.115:0/3929773448 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480bfc90 con 0x7f64480aa050 2023-07-27T14:27:04.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644d19a700 1 --2- 172.21.15.115:0/3929773448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64480640f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6448083e30 tx=0x7f64380090f0).ready entity=mon.0 client_cookie=fc33a48654223736 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:04.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.486+0000 7f644c999700 1 -- 172.21.15.115:0/3929773448 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800b5a0 con 0x7f64480aa050 2023-07-27T14:27:04.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644c999700 1 -- 172.21.15.115:0/3929773448 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800b700 con 0x7f64480aa050 2023-07-27T14:27:04.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644c999700 1 -- 172.21.15.115:0/3929773448 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800ba80 con 0x7f64480aa050 2023-07-27T14:27:04.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644fbff700 1 -- 172.21.15.115:0/3929773448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 msgr2=0x7f64480640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644fbff700 1 --2- 172.21.15.115:0/3929773448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64480640f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6448083e30 tx=0x7f64380090f0).stop 2023-07-27T14:27:04.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644fbff700 1 -- 172.21.15.115:0/3929773448 shutdown_connections 2023-07-27T14:27:04.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644fbff700 1 --2- 172.21.15.115:0/3929773448 >> v2:172.21.15.159:3300/0 conn(0x7f6448153ec0 0x7f64480a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644fbff700 1 --2- 172.21.15.115:0/3929773448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64480640f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644fbff700 1 -- 172.21.15.115:0/3929773448 >> 172.21.15.115:0/3929773448 conn(0x7f64480cb610 msgr2=0x7f64480c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:04.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644fbff700 1 -- 172.21.15.115:0/3929773448 shutdown_connections 2023-07-27T14:27:04.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.487+0000 7f644fbff700 1 -- 172.21.15.115:0/3929773448 wait complete. 2023-07-27T14:27:04.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.489+0000 7f644fbff700 1 Processor -- start 2023-07-27T14:27:04.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.489+0000 7f644fbff700 1 -- start start 2023-07-27T14:27:04.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644fbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64481528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644fbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64480aaa40 0x7f64480c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644fbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6448153ec0 0x7f6448164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644fbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64481523f0 con 0x7f64480aa050 2023-07-27T14:27:04.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644fbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480a98b0 con 0x7f6448153ec0 2023-07-27T14:27:04.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644fbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64481644b0 con 0x7f64480aaa40 2023-07-27T14:27:04.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64481528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64481528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55532/0 (socket says 172.21.15.115:55532) 2023-07-27T14:27:04.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 -- 172.21.15.115:0/4119569417 learned_addr learned my addr 172.21.15.115:0/4119569417 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:04.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d19a700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64480aaa40 0x7f64480c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644e19c700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6448153ec0 0x7f6448164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 -- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64480aaa40 msgr2=0x7f64480c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64480aaa40 0x7f64480c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 -- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6448153ec0 msgr2=0x7f6448164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6448153ec0 0x7f6448164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 -- 172.21.15.115:0/4119569417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6438009370 con 0x7f64480aa050 2023-07-27T14:27:04.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644e19c700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6448153ec0 0x7f6448164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:04.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.490+0000 7f644d99b700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64481528e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f644400d8c0 tx=0x7f6444008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:04.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.491+0000 7f643dffb700 1 -- 172.21.15.115:0/4119569417 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444009550 con 0x7f64480aa050 2023-07-27T14:27:04.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.491+0000 7f643dffb700 1 -- 172.21.15.115:0/4119569417 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440096b0 con 0x7f64480aa050 2023-07-27T14:27:04.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.491+0000 7f643dffb700 1 -- 172.21.15.115:0/4119569417 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444009a30 con 0x7f64480aa050 2023-07-27T14:27:04.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.491+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6448153150 con 0x7f64480aa050 2023-07-27T14:27:04.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.491+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6448164140 con 0x7f64480aa050 2023-07-27T14:27:04.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.492+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6448164790 con 0x7f64480aa050 2023-07-27T14:27:04.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.493+0000 7f643dffb700 1 -- 172.21.15.115:0/4119569417 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6444013480 con 0x7f64480aa050 2023-07-27T14:27:04.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.493+0000 7f643dffb700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f642c05ed60 0x7f642c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.494+0000 7f643dffb700 1 -- 172.21.15.115:0/4119569417 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6444079a90 con 0x7f64480aa050 2023-07-27T14:27:04.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.494+0000 7f644d19a700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f642c05ed60 0x7f642c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.494+0000 7f644d19a700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f642c05ed60 0x7f642c061220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6438009130 tx=0x7f6438015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:04.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.500+0000 7f643dffb700 1 -- 172.21.15.115:0/4119569417 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f644404aec0 con 0x7f64480aa050 2023-07-27T14:27:04.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.709+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f644806c470 con 0x7f64480aa050 2023-07-27T14:27:04.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.710+0000 7f643dffb700 1 -- 172.21.15.115:0/4119569417 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4492 (secure 0 0 0) 0x7f644806c470 con 0x7f64480aa050 2023-07-27T14:27:04.724 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:04.725 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:27:01.252698+0000","modified":"2023-07-27T14:27:04.264437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-07-27T14:27:04.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f642c05ed60 msgr2=0x7f642c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f642c05ed60 0x7f642c061220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6438009130 tx=0x7f6438015000).stop 2023-07-27T14:27:04.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 msgr2=0x7f64481528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64481528e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f644400d8c0 tx=0x7f6444008040).stop 2023-07-27T14:27:04.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 shutdown_connections 2023-07-27T14:27:04.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f642c05ed60 0x7f642c061220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6448153ec0 0x7f6448164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64480aa050 0x7f64481528e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 --2- 172.21.15.115:0/4119569417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64480aaa40 0x7f64480c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 >> 172.21.15.115:0/4119569417 conn(0x7f64480cb610 msgr2=0x7f64480ab660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:04.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.712+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 shutdown_connections 2023-07-27T14:27:04.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.713+0000 7f644fbff700 1 -- 172.21.15.115:0/4119569417 wait complete. 2023-07-27T14:27:04.728 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 7 2023-07-27T14:27:04.748 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:04.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.922+0000 7f94e71ff700 1 Processor -- start 2023-07-27T14:27:04.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.923+0000 7f94e71ff700 1 -- start start 2023-07-27T14:27:04.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.924+0000 7f94e71ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94e00aaa40 0x7f94e00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.924+0000 7f94e71ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00aa4d0 con 0x7f94e01542a0 2023-07-27T14:27:04.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.924+0000 7f94e71ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00c05c0 con 0x7f94e0153ec0 2023-07-27T14:27:04.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.924+0000 7f94e71ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e00aa270 con 0x7f94e00aaa40 2023-07-27T14:27:04.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.924+0000 7f94dffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94e00aaa40 0x7f94e00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.924+0000 7f94e579c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f94e01542a0 0x7f94e00c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38506/0 (socket says 172.21.15.115:38506) 2023-07-27T14:27:04.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.924+0000 7f94e579c700 1 -- 172.21.15.115:0/945798698 learned_addr learned my addr 172.21.15.115:0/945798698 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:04.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.924+0000 7f94dffff700 1 -- 172.21.15.115:0/945798698 >> v1:172.21.15.159:6789/0 conn(0x7f94e0153ec0 legacy=0x7f94e00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94dffff700 1 -- 172.21.15.115:0/945798698 >> v1:172.21.15.115:6789/0 conn(0x7f94e01542a0 legacy=0x7f94e00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94dffff700 1 -- 172.21.15.115:0/945798698 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00bfc90 con 0x7f94e00aaa40 2023-07-27T14:27:04.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94df7fe700 1 -- 172.21.15.115:0/945798698 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335583548 0 0) 0x7f94d8001490 con 0x7f94e01542a0 2023-07-27T14:27:04.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94dffff700 1 --2- 172.21.15.115:0/945798698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e00aaa40 0x7f94e00640f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f94cc009760 tx=0x7f94cc009060).ready entity=mon.0 client_cookie=f44694c4ba8b9ca6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:04.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94df7fe700 1 -- 172.21.15.115:0/945798698 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00b580 con 0x7f94e00aaa40 2023-07-27T14:27:04.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94df7fe700 1 -- 172.21.15.115:0/945798698 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc00b6e0 con 0x7f94e00aaa40 2023-07-27T14:27:04.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94df7fe700 1 -- 172.21.15.115:0/945798698 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00ba60 con 0x7f94e00aaa40 2023-07-27T14:27:04.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94e71ff700 1 -- 172.21.15.115:0/945798698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e00aaa40 msgr2=0x7f94e00640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94e71ff700 1 --2- 172.21.15.115:0/945798698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e00aaa40 0x7f94e00640f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f94cc009760 tx=0x7f94cc009060).stop 2023-07-27T14:27:04.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.925+0000 7f94e71ff700 1 -- 172.21.15.115:0/945798698 shutdown_connections 2023-07-27T14:27:04.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.926+0000 7f94e71ff700 1 --2- 172.21.15.115:0/945798698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e00aaa40 0x7f94e00640f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.926+0000 7f94e71ff700 1 -- 172.21.15.115:0/945798698 >> 172.21.15.115:0/945798698 conn(0x7f94e00cb610 msgr2=0x7f94e00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:04.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.926+0000 7f94e71ff700 1 -- 172.21.15.115:0/945798698 shutdown_connections 2023-07-27T14:27:04.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.926+0000 7f94e71ff700 1 -- 172.21.15.115:0/945798698 wait complete. 2023-07-27T14:27:04.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.927+0000 7f94e71ff700 1 Processor -- start 2023-07-27T14:27:04.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.927+0000 7f94e71ff700 1 -- start start 2023-07-27T14:27:04.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e71ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e00aaa40 0x7f94e0150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e71ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94e0153ec0 0x7f94e014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e71ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e01542a0 0x7f94e00c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e71ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0164540 con 0x7f94e01542a0 2023-07-27T14:27:04.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e71ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0165030 con 0x7f94e00aaa40 2023-07-27T14:27:04.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e71ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0159d60 con 0x7f94e0153ec0 2023-07-27T14:27:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e579c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e01542a0 0x7f94e00c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e579c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e01542a0 0x7f94e00c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55560/0 (socket says 172.21.15.115:55560) 2023-07-27T14:27:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.928+0000 7f94e579c700 1 -- 172.21.15.115:0/907789197 learned_addr learned my addr 172.21.15.115:0/907789197 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e4f9b700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e00aaa40 0x7f94e0150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94dffff700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94e0153ec0 0x7f94e014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e579c700 1 -- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94e0153ec0 msgr2=0x7f94e014f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e579c700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94e0153ec0 0x7f94e014f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e579c700 1 -- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e00aaa40 msgr2=0x7f94e0150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:04.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e579c700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e00aaa40 0x7f94e0150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:04.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e579c700 1 -- 172.21.15.115:0/907789197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc0092a0 con 0x7f94e01542a0 2023-07-27T14:27:04.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94dffff700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94e0153ec0 0x7f94e014f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:04.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e579c700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e01542a0 0x7f94e00c3ec0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f94d800c810 tx=0x7f94d80014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:04.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94dcff9700 1 -- 172.21.15.115:0/907789197 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8005d30 con 0x7f94e01542a0 2023-07-27T14:27:04.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94dcff9700 1 -- 172.21.15.115:0/907789197 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8005e90 con 0x7f94e01542a0 2023-07-27T14:27:04.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94dcff9700 1 -- 172.21.15.115:0/907789197 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8007320 con 0x7f94e01542a0 2023-07-27T14:27:04.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e0164740 con 0x7f94e01542a0 2023-07-27T14:27:04.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.929+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e01649e0 con 0x7f94e01542a0 2023-07-27T14:27:04.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.931+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e01651c0 con 0x7f94e01542a0 2023-07-27T14:27:04.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.931+0000 7f94dcff9700 1 -- 172.21.15.115:0/907789197 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f94d8010030 con 0x7f94e01542a0 2023-07-27T14:27:04.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.932+0000 7f94dcff9700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f94c405ed60 0x7f94c4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:04.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.932+0000 7f94dcff9700 1 -- 172.21.15.115:0/907789197 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f94d8079720 con 0x7f94e01542a0 2023-07-27T14:27:04.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.933+0000 7f94e4f9b700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f94c405ed60 0x7f94c4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:04.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.933+0000 7f94e4f9b700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f94c405ed60 0x7f94c4061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f94e0152880 tx=0x7f94d4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:04.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:04.936+0000 7f94dcff9700 1 -- 172.21.15.115:0/907789197 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94d804ac60 con 0x7f94e01542a0 2023-07-27T14:27:05.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.105+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94e00aa4d0 con 0x7f94e01542a0 2023-07-27T14:27:05.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.106+0000 7f94dcff9700 1 -- 172.21.15.115:0/907789197 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f94e00aa4d0 con 0x7f94e01542a0 2023-07-27T14:27:05.120 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:05.120 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:05.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f94c405ed60 msgr2=0x7f94c4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f94c405ed60 0x7f94c4061220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f94e0152880 tx=0x7f94d4009040).stop 2023-07-27T14:27:05.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e01542a0 msgr2=0x7f94e00c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e01542a0 0x7f94e00c3ec0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f94d800c810 tx=0x7f94d80014a0).stop 2023-07-27T14:27:05.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 shutdown_connections 2023-07-27T14:27:05.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f94c405ed60 0x7f94c4061220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e01542a0 0x7f94e00c3ec0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94e00aaa40 0x7f94e0150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 --2- 172.21.15.115:0/907789197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94e0153ec0 0x7f94e014f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 >> 172.21.15.115:0/907789197 conn(0x7f94e00cb610 msgr2=0x7f94e015a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:05.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 shutdown_connections 2023-07-27T14:27:05.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.108+0000 7f94e71ff700 1 -- 172.21.15.115:0/907789197 wait complete. 2023-07-27T14:27:05.139 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:27:05.140 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:27:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.315+0000 7efec81ff700 1 Processor -- start 2023-07-27T14:27:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.315+0000 7efec81ff700 1 -- start start 2023-07-27T14:27:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.316+0000 7efec81ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.316+0000 7efec81ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec00aa4d0 con 0x7efec00aaa40 2023-07-27T14:27:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.316+0000 7efec81ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec00c05c0 con 0x7efec00aa050 2023-07-27T14:27:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.316+0000 7efec81ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00bfc90 con 0x7efec0153ec0 2023-07-27T14:27:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.316+0000 7efec679c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efec00aaa40 0x7efec00c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38510/0 (socket says 172.21.15.115:38510) 2023-07-27T14:27:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.316+0000 7efec679c700 1 -- 172.21.15.115:0/31885187 learned_addr learned my addr 172.21.15.115:0/31885187 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.316+0000 7efec5f9b700 1 --2- 172.21.15.115:0/31885187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec4f99700 1 -- 172.21.15.115:0/31885187 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185082388 0 0) 0x7efeb8001490 con 0x7efec00aaa40 2023-07-27T14:27:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec4f99700 1 -- 172.21.15.115:0/31885187 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeac0033f0 con 0x7efec00aaa40 2023-07-27T14:27:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec4f99700 1 -- 172.21.15.115:0/31885187 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327009096 0 0) 0x7efec00c05c0 con 0x7efec00aa050 2023-07-27T14:27:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec4f99700 1 -- 172.21.15.115:0/31885187 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb8001490 con 0x7efec00aa050 2023-07-27T14:27:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec5f9b700 1 -- 172.21.15.115:0/31885187 >> v1:172.21.15.159:6789/0 conn(0x7efec00aa050 legacy=0x7efec00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec5f9b700 1 -- 172.21.15.115:0/31885187 >> v1:172.21.15.115:6789/0 conn(0x7efec00aaa40 legacy=0x7efec00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec5f9b700 1 -- 172.21.15.115:0/31885187 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00bff70 con 0x7efec0153ec0 2023-07-27T14:27:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec5f9b700 1 --2- 172.21.15.115:0/31885187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec00a9b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efebc009790 tx=0x7efebc009060).ready entity=mon.2 client_cookie=75af100799d039a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.317+0000 7efec4f99700 1 -- 172.21.15.115:0/31885187 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00f510 con 0x7efec0153ec0 2023-07-27T14:27:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec4f99700 1 -- 172.21.15.115:0/31885187 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00f670 con 0x7efec0153ec0 2023-07-27T14:27:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec4f99700 1 -- 172.21.15.115:0/31885187 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00f9f0 con 0x7efec0153ec0 2023-07-27T14:27:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec81ff700 1 -- 172.21.15.115:0/31885187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 msgr2=0x7efec00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec81ff700 1 --2- 172.21.15.115:0/31885187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec00a9b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efebc009790 tx=0x7efebc009060).stop 2023-07-27T14:27:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec81ff700 1 -- 172.21.15.115:0/31885187 shutdown_connections 2023-07-27T14:27:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec81ff700 1 --2- 172.21.15.115:0/31885187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec00a9b60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec81ff700 1 -- 172.21.15.115:0/31885187 >> 172.21.15.115:0/31885187 conn(0x7efec00cb610 msgr2=0x7efec00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:05.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec81ff700 1 -- 172.21.15.115:0/31885187 shutdown_connections 2023-07-27T14:27:05.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.318+0000 7efec81ff700 1 -- 172.21.15.115:0/31885187 wait complete. 2023-07-27T14:27:05.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.320+0000 7efec81ff700 1 Processor -- start 2023-07-27T14:27:05.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.320+0000 7efec81ff700 1 -- start start 2023-07-27T14:27:05.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec81ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec00aa050 0x7efec00c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec81ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efec00aaa40 0x7efec0152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec81ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec014e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec81ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c2ea0 con 0x7efec00aa050 2023-07-27T14:27:05.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec81ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c2210 con 0x7efec00aaa40 2023-07-27T14:27:05.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec81ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c24f0 con 0x7efec0153ec0 2023-07-27T14:27:05.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec5f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec00aa050 0x7efec00c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec5f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec00aa050 0x7efec00c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55576/0 (socket says 172.21.15.115:55576) 2023-07-27T14:27:05.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec5f9b700 1 -- 172.21.15.115:0/468918680 learned_addr learned my addr 172.21.15.115:0/468918680 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:05.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec579a700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efec00aaa40 0x7efec0152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec679c700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec5f9b700 1 -- 172.21.15.115:0/468918680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 msgr2=0x7efec014e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec5f9b700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec014e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec5f9b700 1 -- 172.21.15.115:0/468918680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efec00aaa40 msgr2=0x7efec0152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec5f9b700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efec00aaa40 0x7efec0152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.321+0000 7efec5f9b700 1 -- 172.21.15.115:0/468918680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0092a0 con 0x7efec00aa050 2023-07-27T14:27:05.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.322+0000 7efec5f9b700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec00aa050 0x7efec00c1c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efec005fc60 tx=0x7efebc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:05.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.322+0000 7efeb5ffb700 1 -- 172.21.15.115:0/468918680 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00fe80 con 0x7efec00aa050 2023-07-27T14:27:05.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.322+0000 7efeb5ffb700 1 -- 172.21.15.115:0/468918680 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00f7e0 con 0x7efec00aa050 2023-07-27T14:27:05.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.322+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec00c27d0 con 0x7efec00aa050 2023-07-27T14:27:05.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.322+0000 7efeb5ffb700 1 -- 172.21.15.115:0/468918680 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc01b640 con 0x7efec00aa050 2023-07-27T14:27:05.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.322+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec01534b0 con 0x7efec00aa050 2023-07-27T14:27:05.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.323+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec00c3180 con 0x7efec00aa050 2023-07-27T14:27:05.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.324+0000 7efeb5ffb700 1 -- 172.21.15.115:0/468918680 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7efebc02b070 con 0x7efec00aa050 2023-07-27T14:27:05.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.324+0000 7efeb5ffb700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efea405ed90 0x7efea4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.324+0000 7efeb5ffb700 1 -- 172.21.15.115:0/468918680 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efebc07b2c0 con 0x7efec00aa050 2023-07-27T14:27:05.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.325+0000 7efec579a700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efea405ed90 0x7efea4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.325+0000 7efec579a700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efea405ed90 0x7efea4061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efec015b110 tx=0x7efeb0007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:05.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.328+0000 7efeb5ffb700 1 -- 172.21.15.115:0/468918680 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efebc04c750 con 0x7efec00aa050 2023-07-27T14:27:05.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.494+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efec00c2fe0 con 0x7efea405ed90 2023-07-27T14:27:05.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.505+0000 7efeb5ffb700 1 -- 172.21.15.115:0/468918680 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336318 (secure 0 0 0) 0x7efeb0002730 con 0x7efea405ed90 2023-07-27T14:27:05.522 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:05.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.509+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efea405ed90 msgr2=0x7efea4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.509+0000 7efec81ff700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efea405ed90 0x7efea4061250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efec015b110 tx=0x7efeb0007bd0).stop 2023-07-27T14:27:05.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.509+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec00aa050 msgr2=0x7efec00c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.509+0000 7efec81ff700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec00aa050 0x7efec00c1c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efec005fc60 tx=0x7efebc017000).stop 2023-07-27T14:27:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.510+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 shutdown_connections 2023-07-27T14:27:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.510+0000 7efec81ff700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efea405ed90 0x7efea4061250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.510+0000 7efec81ff700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efec0153ec0 0x7efec014e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.510+0000 7efec81ff700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efec00aa050 0x7efec00c1c30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.510+0000 7efec81ff700 1 --2- 172.21.15.115:0/468918680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efec00aaa40 0x7efec0152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.510+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 >> 172.21.15.115:0/468918680 conn(0x7efec00cb610 msgr2=0x7efec00abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.510+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 shutdown_connections 2023-07-27T14:27:05.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.510+0000 7efec81ff700 1 -- 172.21.15.115:0/468918680 wait complete. 2023-07-27T14:27:05.526 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:27:05.540 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-07-27T14:27:05.437631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":270,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41476,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":39616,"kb_avail":754933244,"statfs":{"total":773094113280,"available":773051641856,"internally_reserved":0,"allocated":1839104,"data_stored":656644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40566784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284762+0000","last_change":"2023-07-27T14:27:01.270326+0000","last_active":"2023-07-27T14:27:01.284762+0000","last_peered":"2023-07-27T14:27:01.284762+0000","last_clean":"2023-07-27T14:27:01.284762+0000","last_became_active":"2023-07-27T14:27:01.270013+0000","last_became_peered":"2023-07-27T14:27:01.270013+0000","last_unstale":"2023-07-27T14:27:01.284762+0000","last_undegraded":"2023-07-27T14:27:01.284762+0000","last_fullsized":"2023-07-27T14:27:01.284762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.818798+0000","last_change":"2023-07-27T14:27:00.817070+0000","last_active":"2023-07-27T14:27:00.818798+0000","last_peered":"2023-07-27T14:27:00.818798+0000","last_clean":"2023-07-27T14:27:00.818798+0000","last_became_active":"2023-07-27T14:27:00.816729+0000","last_became_peered":"2023-07-27T14:27:00.816729+0000","last_unstale":"2023-07-27T14:27:00.818798+0000","last_undegraded":"2023-07-27T14:27:00.818798+0000","last_fullsized":"2023-07-27T14:27:00.818798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285407+0000","last_change":"2023-07-27T14:27:01.281932+0000","last_active":"2023-07-27T14:27:01.285407+0000","last_peered":"2023-07-27T14:27:01.285407+0000","last_clean":"2023-07-27T14:27:01.285407+0000","last_became_active":"2023-07-27T14:27:01.279991+0000","last_became_peered":"2023-07-27T14:27:01.279991+0000","last_unstale":"2023-07-27T14:27:01.285407+0000","last_undegraded":"2023-07-27T14:27:01.285407+0000","last_fullsized":"2023-07-27T14:27:01.285407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.818620+0000","last_change":"2023-07-27T14:27:00.816788+0000","last_active":"2023-07-27T14:27:00.818620+0000","last_peered":"2023-07-27T14:27:00.818620+0000","last_clean":"2023-07-27T14:27:00.818620+0000","last_became_active":"2023-07-27T14:27:00.816483+0000","last_became_peered":"2023-07-27T14:27:00.816483+0000","last_unstale":"2023-07-27T14:27:00.818620+0000","last_undegraded":"2023-07-27T14:27:00.818620+0000","last_fullsized":"2023-07-27T14:27:00.818620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283092+0000","last_change":"2023-07-27T14:27:01.283092+0000","last_active":"2023-07-27T14:27:01.283092+0000","last_peered":"2023-07-27T14:27:01.283092+0000","last_clean":"2023-07-27T14:27:01.283092+0000","last_became_active":"2023-07-27T14:27:01.281682+0000","last_became_peered":"2023-07-27T14:27:01.281682+0000","last_unstale":"2023-07-27T14:27:01.283092+0000","last_undegraded":"2023-07-27T14:27:01.283092+0000","last_fullsized":"2023-07-27T14:27:01.283092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.259837+0000","last_change":"2023-07-27T14:27:00.824445+0000","last_active":"2023-07-27T14:27:01.259837+0000","last_peered":"2023-07-27T14:27:01.259837+0000","last_clean":"2023-07-27T14:27:01.259837+0000","last_became_active":"2023-07-27T14:27:00.824146+0000","last_became_peered":"2023-07-27T14:27:00.824146+0000","last_unstale":"2023-07-27T14:27:01.259837+0000","last_undegraded":"2023-07-27T14:27:01.259837+0000","last_fullsized":"2023-07-27T14:27:01.259837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281942+0000","last_change":"2023-07-27T14:27:01.270550+0000","last_active":"2023-07-27T14:27:01.281942+0000","last_peered":"2023-07-27T14:27:01.281942+0000","last_clean":"2023-07-27T14:27:01.281942+0000","last_became_active":"2023-07-27T14:27:01.270242+0000","last_became_peered":"2023-07-27T14:27:01.270242+0000","last_unstale":"2023-07-27T14:27:01.281942+0000","last_undegraded":"2023-07-27T14:27:01.281942+0000","last_fullsized":"2023-07-27T14:27:01.281942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264077+0000","last_change":"2023-07-27T14:27:00.811927+0000","last_active":"2023-07-27T14:27:01.264077+0000","last_peered":"2023-07-27T14:27:01.264077+0000","last_clean":"2023-07-27T14:27:01.264077+0000","last_became_active":"2023-07-27T14:27:00.810673+0000","last_became_peered":"2023-07-27T14:27:00.810673+0000","last_unstale":"2023-07-27T14:27:01.264077+0000","last_undegraded":"2023-07-27T14:27:01.264077+0000","last_fullsized":"2023-07-27T14:27:01.264077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282015+0000","last_change":"2023-07-27T14:27:01.273486+0000","last_active":"2023-07-27T14:27:01.282015+0000","last_peered":"2023-07-27T14:27:01.282015+0000","last_clean":"2023-07-27T14:27:01.282015+0000","last_became_active":"2023-07-27T14:27:01.273227+0000","last_became_peered":"2023-07-27T14:27:01.273227+0000","last_unstale":"2023-07-27T14:27:01.282015+0000","last_undegraded":"2023-07-27T14:27:01.282015+0000","last_fullsized":"2023-07-27T14:27:01.282015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269519+0000","last_change":"2023-07-27T14:27:00.808357+0000","last_active":"2023-07-27T14:27:01.269519+0000","last_peered":"2023-07-27T14:27:01.269519+0000","last_clean":"2023-07-27T14:27:01.269519+0000","last_became_active":"2023-07-27T14:27:00.808008+0000","last_became_peered":"2023-07-27T14:27:00.808008+0000","last_unstale":"2023-07-27T14:27:01.269519+0000","last_undegraded":"2023-07-27T14:27:01.269519+0000","last_fullsized":"2023-07-27T14:27:01.269519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.272065+0000","last_change":"2023-07-27T14:27:01.272065+0000","last_active":"2023-07-27T14:27:01.272065+0000","last_peered":"2023-07-27T14:27:01.272065+0000","last_clean":"2023-07-27T14:27:01.272065+0000","last_became_active":"2023-07-27T14:27:01.270787+0000","last_became_peered":"2023-07-27T14:27:01.270787+0000","last_unstale":"2023-07-27T14:27:01.272065+0000","last_undegraded":"2023-07-27T14:27:01.272065+0000","last_fullsized":"2023-07-27T14:27:01.272065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287688+0000","last_change":"2023-07-27T14:27:00.823544+0000","last_active":"2023-07-27T14:27:01.287688+0000","last_peered":"2023-07-27T14:27:01.287688+0000","last_clean":"2023-07-27T14:27:01.287688+0000","last_became_active":"2023-07-27T14:27:00.823167+0000","last_became_peered":"2023-07-27T14:27:00.823167+0000","last_unstale":"2023-07-27T14:27:01.287688+0000","last_undegraded":"2023-07-27T14:27:01.287688+0000","last_fullsized":"2023-07-27T14:27:01.287688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290104+0000","last_change":"2023-07-27T14:27:01.290104+0000","last_active":"2023-07-27T14:27:01.290104+0000","last_peered":"2023-07-27T14:27:01.290104+0000","last_clean":"2023-07-27T14:27:01.290104+0000","last_became_active":"2023-07-27T14:27:01.289787+0000","last_became_peered":"2023-07-27T14:27:01.289787+0000","last_unstale":"2023-07-27T14:27:01.290104+0000","last_undegraded":"2023-07-27T14:27:01.290104+0000","last_fullsized":"2023-07-27T14:27:01.290104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293367+0000","last_change":"2023-07-27T14:27:00.818297+0000","last_active":"2023-07-27T14:27:01.293367+0000","last_peered":"2023-07-27T14:27:01.293367+0000","last_clean":"2023-07-27T14:27:01.293367+0000","last_became_active":"2023-07-27T14:27:00.817529+0000","last_became_peered":"2023-07-27T14:27:00.817529+0000","last_unstale":"2023-07-27T14:27:01.293367+0000","last_undegraded":"2023-07-27T14:27:01.293367+0000","last_fullsized":"2023-07-27T14:27:01.293367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286467+0000","last_change":"2023-07-27T14:27:01.270184+0000","last_active":"2023-07-27T14:27:01.286467+0000","last_peered":"2023-07-27T14:27:01.286467+0000","last_clean":"2023-07-27T14:27:01.286467+0000","last_became_active":"2023-07-27T14:27:01.269909+0000","last_became_peered":"2023-07-27T14:27:01.269909+0000","last_unstale":"2023-07-27T14:27:01.286467+0000","last_undegraded":"2023-07-27T14:27:01.286467+0000","last_fullsized":"2023-07-27T14:27:01.286467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264279+0000","last_change":"2023-07-27T14:27:00.822093+0000","last_active":"2023-07-27T14:27:01.264279+0000","last_peered":"2023-07-27T14:27:01.264279+0000","last_clean":"2023-07-27T14:27:01.264279+0000","last_became_active":"2023-07-27T14:27:00.821821+0000","last_became_peered":"2023-07-27T14:27:00.821821+0000","last_unstale":"2023-07-27T14:27:01.264279+0000","last_undegraded":"2023-07-27T14:27:01.264279+0000","last_fullsized":"2023-07-27T14:27:01.264279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296579+0000","last_change":"2023-07-27T14:27:01.289067+0000","last_active":"2023-07-27T14:27:01.296579+0000","last_peered":"2023-07-27T14:27:01.296579+0000","last_clean":"2023-07-27T14:27:01.296579+0000","last_became_active":"2023-07-27T14:27:01.288634+0000","last_became_peered":"2023-07-27T14:27:01.288634+0000","last_unstale":"2023-07-27T14:27:01.296579+0000","last_undegraded":"2023-07-27T14:27:01.296579+0000","last_fullsized":"2023-07-27T14:27:01.296579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265111+0000","last_change":"2023-07-27T14:27:00.805268+0000","last_active":"2023-07-27T14:27:01.265111+0000","last_peered":"2023-07-27T14:27:01.265111+0000","last_clean":"2023-07-27T14:27:01.265111+0000","last_became_active":"2023-07-27T14:27:00.804950+0000","last_became_peered":"2023-07-27T14:27:00.804950+0000","last_unstale":"2023-07-27T14:27:01.265111+0000","last_undegraded":"2023-07-27T14:27:01.265111+0000","last_fullsized":"2023-07-27T14:27:01.265111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284549+0000","last_change":"2023-07-27T14:27:01.281253+0000","last_active":"2023-07-27T14:27:01.284549+0000","last_peered":"2023-07-27T14:27:01.284549+0000","last_clean":"2023-07-27T14:27:01.284549+0000","last_became_active":"2023-07-27T14:27:01.280227+0000","last_became_peered":"2023-07-27T14:27:01.280227+0000","last_unstale":"2023-07-27T14:27:01.284549+0000","last_undegraded":"2023-07-27T14:27:01.284549+0000","last_fullsized":"2023-07-27T14:27:01.284549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.823815+0000","last_change":"2023-07-27T14:27:00.817281+0000","last_active":"2023-07-27T14:27:00.823815+0000","last_peered":"2023-07-27T14:27:00.823815+0000","last_clean":"2023-07-27T14:27:00.823815+0000","last_became_active":"2023-07-27T14:27:00.817008+0000","last_became_peered":"2023-07-27T14:27:00.817008+0000","last_unstale":"2023-07-27T14:27:00.823815+0000","last_undegraded":"2023-07-27T14:27:00.823815+0000","last_fullsized":"2023-07-27T14:27:00.823815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286934+0000","last_change":"2023-07-27T14:27:01.281135+0000","last_active":"2023-07-27T14:27:01.286934+0000","last_peered":"2023-07-27T14:27:01.286934+0000","last_clean":"2023-07-27T14:27:01.286934+0000","last_became_active":"2023-07-27T14:27:01.280869+0000","last_became_peered":"2023-07-27T14:27:01.280869+0000","last_unstale":"2023-07-27T14:27:01.286934+0000","last_undegraded":"2023-07-27T14:27:01.286934+0000","last_fullsized":"2023-07-27T14:27:01.286934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283625+0000","last_change":"2023-07-27T14:27:00.810416+0000","last_active":"2023-07-27T14:27:01.283625+0000","last_peered":"2023-07-27T14:27:01.283625+0000","last_clean":"2023-07-27T14:27:01.283625+0000","last_became_active":"2023-07-27T14:27:00.809422+0000","last_became_peered":"2023-07-27T14:27:00.809422+0000","last_unstale":"2023-07-27T14:27:01.283625+0000","last_undegraded":"2023-07-27T14:27:01.283625+0000","last_fullsized":"2023-07-27T14:27:01.283625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.291617+0000","last_change":"2023-07-27T14:27:01.286563+0000","last_active":"2023-07-27T14:27:01.291617+0000","last_peered":"2023-07-27T14:27:01.291617+0000","last_clean":"2023-07-27T14:27:01.291617+0000","last_became_active":"2023-07-27T14:27:01.285925+0000","last_became_peered":"2023-07-27T14:27:01.285925+0000","last_unstale":"2023-07-27T14:27:01.291617+0000","last_undegraded":"2023-07-27T14:27:01.291617+0000","last_fullsized":"2023-07-27T14:27:01.291617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.262173+0000","last_change":"2023-07-27T14:27:00.819013+0000","last_active":"2023-07-27T14:27:01.262173+0000","last_peered":"2023-07-27T14:27:01.262173+0000","last_clean":"2023-07-27T14:27:01.262173+0000","last_became_active":"2023-07-27T14:27:00.818612+0000","last_became_peered":"2023-07-27T14:27:00.818612+0000","last_unstale":"2023-07-27T14:27:01.262173+0000","last_undegraded":"2023-07-27T14:27:01.262173+0000","last_fullsized":"2023-07-27T14:27:01.262173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294061+0000","last_change":"2023-07-27T14:27:01.294061+0000","last_active":"2023-07-27T14:27:01.294061+0000","last_peered":"2023-07-27T14:27:01.294061+0000","last_clean":"2023-07-27T14:27:01.294061+0000","last_became_active":"2023-07-27T14:27:01.293437+0000","last_became_peered":"2023-07-27T14:27:01.293437+0000","last_unstale":"2023-07-27T14:27:01.294061+0000","last_undegraded":"2023-07-27T14:27:01.294061+0000","last_fullsized":"2023-07-27T14:27:01.294061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295572+0000","last_change":"2023-07-27T14:27:00.819217+0000","last_active":"2023-07-27T14:27:01.295572+0000","last_peered":"2023-07-27T14:27:01.295572+0000","last_clean":"2023-07-27T14:27:01.295572+0000","last_became_active":"2023-07-27T14:27:00.818691+0000","last_became_peered":"2023-07-27T14:27:00.818691+0000","last_unstale":"2023-07-27T14:27:01.295572+0000","last_undegraded":"2023-07-27T14:27:01.295572+0000","last_fullsized":"2023-07-27T14:27:01.295572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270147+0000","last_change":"2023-07-27T14:27:01.270147+0000","last_active":"2023-07-27T14:27:01.270147+0000","last_peered":"2023-07-27T14:27:01.270147+0000","last_clean":"2023-07-27T14:27:01.270147+0000","last_became_active":"2023-07-27T14:27:01.269862+0000","last_became_peered":"2023-07-27T14:27:01.269862+0000","last_unstale":"2023-07-27T14:27:01.270147+0000","last_undegraded":"2023-07-27T14:27:01.270147+0000","last_fullsized":"2023-07-27T14:27:01.270147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.815874+0000","last_change":"2023-07-27T14:27:00.812553+0000","last_active":"2023-07-27T14:27:00.815874+0000","last_peered":"2023-07-27T14:27:00.815874+0000","last_clean":"2023-07-27T14:27:00.815874+0000","last_became_active":"2023-07-27T14:27:00.812263+0000","last_became_peered":"2023-07-27T14:27:00.812263+0000","last_unstale":"2023-07-27T14:27:00.815874+0000","last_undegraded":"2023-07-27T14:27:00.815874+0000","last_fullsized":"2023-07-27T14:27:00.815874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284961+0000","last_change":"2023-07-27T14:27:01.280658+0000","last_active":"2023-07-27T14:27:01.284961+0000","last_peered":"2023-07-27T14:27:01.284961+0000","last_clean":"2023-07-27T14:27:01.284961+0000","last_became_active":"2023-07-27T14:27:01.279608+0000","last_became_peered":"2023-07-27T14:27:01.279608+0000","last_unstale":"2023-07-27T14:27:01.284961+0000","last_undegraded":"2023-07-27T14:27:01.284961+0000","last_fullsized":"2023-07-27T14:27:01.284961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268276+0000","last_change":"2023-07-27T14:27:00.821769+0000","last_active":"2023-07-27T14:27:01.268276+0000","last_peered":"2023-07-27T14:27:01.268276+0000","last_clean":"2023-07-27T14:27:01.268276+0000","last_became_active":"2023-07-27T14:27:00.820693+0000","last_became_peered":"2023-07-27T14:27:00.820693+0000","last_unstale":"2023-07-27T14:27:01.268276+0000","last_undegraded":"2023-07-27T14:27:01.268276+0000","last_fullsized":"2023-07-27T14:27:01.268276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290729+0000","last_change":"2023-07-27T14:27:01.290729+0000","last_active":"2023-07-27T14:27:01.290729+0000","last_peered":"2023-07-27T14:27:01.290729+0000","last_clean":"2023-07-27T14:27:01.290729+0000","last_became_active":"2023-07-27T14:27:01.290315+0000","last_became_peered":"2023-07-27T14:27:01.290315+0000","last_unstale":"2023-07-27T14:27:01.290729+0000","last_undegraded":"2023-07-27T14:27:01.290729+0000","last_fullsized":"2023-07-27T14:27:01.290729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284546+0000","last_change":"2023-07-27T14:27:00.815996+0000","last_active":"2023-07-27T14:27:01.284546+0000","last_peered":"2023-07-27T14:27:01.284546+0000","last_clean":"2023-07-27T14:27:01.284546+0000","last_became_active":"2023-07-27T14:27:00.815664+0000","last_became_peered":"2023-07-27T14:27:00.815664+0000","last_unstale":"2023-07-27T14:27:01.284546+0000","last_undegraded":"2023-07-27T14:27:01.284546+0000","last_fullsized":"2023-07-27T14:27:01.284546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288903+0000","last_change":"2023-07-27T14:27:01.288903+0000","last_active":"2023-07-27T14:27:01.288903+0000","last_peered":"2023-07-27T14:27:01.288903+0000","last_clean":"2023-07-27T14:27:01.288903+0000","last_became_active":"2023-07-27T14:27:01.288173+0000","last_became_peered":"2023-07-27T14:27:01.288173+0000","last_unstale":"2023-07-27T14:27:01.288903+0000","last_undegraded":"2023-07-27T14:27:01.288903+0000","last_fullsized":"2023-07-27T14:27:01.288903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.819380+0000","last_change":"2023-07-27T14:27:00.817983+0000","last_active":"2023-07-27T14:27:00.819380+0000","last_peered":"2023-07-27T14:27:00.819380+0000","last_clean":"2023-07-27T14:27:00.819380+0000","last_became_active":"2023-07-27T14:27:00.817662+0000","last_became_peered":"2023-07-27T14:27:00.817662+0000","last_unstale":"2023-07-27T14:27:00.819380+0000","last_undegraded":"2023-07-27T14:27:00.819380+0000","last_fullsized":"2023-07-27T14:27:00.819380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294765+0000","last_change":"2023-07-27T14:27:01.294765+0000","last_active":"2023-07-27T14:27:01.294765+0000","last_peered":"2023-07-27T14:27:01.294765+0000","last_clean":"2023-07-27T14:27:01.294765+0000","last_became_active":"2023-07-27T14:27:01.294406+0000","last_became_peered":"2023-07-27T14:27:01.294406+0000","last_unstale":"2023-07-27T14:27:01.294765+0000","last_undegraded":"2023-07-27T14:27:01.294765+0000","last_fullsized":"2023-07-27T14:27:01.294765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.824528+0000","last_change":"2023-07-27T14:27:00.820810+0000","last_active":"2023-07-27T14:27:00.824528+0000","last_peered":"2023-07-27T14:27:00.824528+0000","last_clean":"2023-07-27T14:27:00.824528+0000","last_became_active":"2023-07-27T14:27:00.820044+0000","last_became_peered":"2023-07-27T14:27:00.820044+0000","last_unstale":"2023-07-27T14:27:00.824528+0000","last_undegraded":"2023-07-27T14:27:00.824528+0000","last_fullsized":"2023-07-27T14:27:00.824528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.275611+0000","last_change":"2023-07-27T14:27:01.275611+0000","last_active":"2023-07-27T14:27:01.275611+0000","last_peered":"2023-07-27T14:27:01.275611+0000","last_clean":"2023-07-27T14:27:01.275611+0000","last_became_active":"2023-07-27T14:27:01.275350+0000","last_became_peered":"2023-07-27T14:27:01.275350+0000","last_unstale":"2023-07-27T14:27:01.275611+0000","last_undegraded":"2023-07-27T14:27:01.275611+0000","last_fullsized":"2023-07-27T14:27:01.275611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260311+0000","last_change":"2023-07-27T14:27:00.818518+0000","last_active":"2023-07-27T14:27:01.260311+0000","last_peered":"2023-07-27T14:27:01.260311+0000","last_clean":"2023-07-27T14:27:01.260311+0000","last_became_active":"2023-07-27T14:27:00.818212+0000","last_became_peered":"2023-07-27T14:27:00.818212+0000","last_unstale":"2023-07-27T14:27:01.260311+0000","last_undegraded":"2023-07-27T14:27:01.260311+0000","last_fullsized":"2023-07-27T14:27:01.260311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.791767+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:27:00.791767+0000","last_peered":"2023-07-27T14:27:00.791767+0000","last_clean":"2023-07-27T14:27:00.791767+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:27:00.791767+0000","last_undegraded":"2023-07-27T14:27:00.791767+0000","last_fullsized":"2023-07-27T14:27:00.791767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269206+0000","last_change":"2023-07-27T14:27:00.821466+0000","last_active":"2023-07-27T14:27:01.269206+0000","last_peered":"2023-07-27T14:27:01.269206+0000","last_clean":"2023-07-27T14:27:01.269206+0000","last_became_active":"2023-07-27T14:27:00.820503+0000","last_became_peered":"2023-07-27T14:27:00.820503+0000","last_unstale":"2023-07-27T14:27:01.269206+0000","last_undegraded":"2023-07-27T14:27:01.269206+0000","last_fullsized":"2023-07-27T14:27:01.269206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281635+0000","last_change":"2023-07-27T14:27:01.281635+0000","last_active":"2023-07-27T14:27:01.281635+0000","last_peered":"2023-07-27T14:27:01.281635+0000","last_clean":"2023-07-27T14:27:01.281635+0000","last_became_active":"2023-07-27T14:27:01.281373+0000","last_became_peered":"2023-07-27T14:27:01.281373+0000","last_unstale":"2023-07-27T14:27:01.281635+0000","last_undegraded":"2023-07-27T14:27:01.281635+0000","last_fullsized":"2023-07-27T14:27:01.281635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270038+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:27:01.270038+0000","last_peered":"2023-07-27T14:27:01.270038+0000","last_clean":"2023-07-27T14:27:01.270038+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:27:01.270038+0000","last_undegraded":"2023-07-27T14:27:01.270038+0000","last_fullsized":"2023-07-27T14:27:01.270038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.827844+0000","last_change":"2023-07-27T14:27:00.824620+0000","last_active":"2023-07-27T14:27:00.827844+0000","last_peered":"2023-07-27T14:27:00.827844+0000","last_clean":"2023-07-27T14:27:00.827844+0000","last_became_active":"2023-07-27T14:27:00.824324+0000","last_became_peered":"2023-07-27T14:27:00.824324+0000","last_unstale":"2023-07-27T14:27:00.827844+0000","last_undegraded":"2023-07-27T14:27:00.827844+0000","last_fullsized":"2023-07-27T14:27:00.827844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.275718+0000","last_change":"2023-07-27T14:27:01.275718+0000","last_active":"2023-07-27T14:27:01.275718+0000","last_peered":"2023-07-27T14:27:01.275718+0000","last_clean":"2023-07-27T14:27:01.275718+0000","last_became_active":"2023-07-27T14:27:01.275463+0000","last_became_peered":"2023-07-27T14:27:01.275463+0000","last_unstale":"2023-07-27T14:27:01.275718+0000","last_undegraded":"2023-07-27T14:27:01.275718+0000","last_fullsized":"2023-07-27T14:27:01.275718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282173+0000","last_change":"2023-07-27T14:27:01.282173+0000","last_active":"2023-07-27T14:27:01.282173+0000","last_peered":"2023-07-27T14:27:01.282173+0000","last_clean":"2023-07-27T14:27:01.282173+0000","last_became_active":"2023-07-27T14:27:01.281870+0000","last_became_peered":"2023-07-27T14:27:01.281870+0000","last_unstale":"2023-07-27T14:27:01.282173+0000","last_undegraded":"2023-07-27T14:27:01.282173+0000","last_fullsized":"2023-07-27T14:27:01.282173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270296+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:27:01.270296+0000","last_peered":"2023-07-27T14:27:01.270296+0000","last_clean":"2023-07-27T14:27:01.270296+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:27:01.270296+0000","last_undegraded":"2023-07-27T14:27:01.270296+0000","last_fullsized":"2023-07-27T14:27:01.270296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.814490+0000","last_change":"2023-07-27T14:27:00.806662+0000","last_active":"2023-07-27T14:27:00.814490+0000","last_peered":"2023-07-27T14:27:00.814490+0000","last_clean":"2023-07-27T14:27:00.814490+0000","last_became_active":"2023-07-27T14:27:00.806332+0000","last_became_peered":"2023-07-27T14:27:00.806332+0000","last_unstale":"2023-07-27T14:27:00.814490+0000","last_undegraded":"2023-07-27T14:27:00.814490+0000","last_fullsized":"2023-07-27T14:27:00.814490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294577+0000","last_change":"2023-07-27T14:27:01.294577+0000","last_active":"2023-07-27T14:27:01.294577+0000","last_peered":"2023-07-27T14:27:01.294577+0000","last_clean":"2023-07-27T14:27:01.294577+0000","last_became_active":"2023-07-27T14:27:01.294285+0000","last_became_peered":"2023-07-27T14:27:01.294285+0000","last_unstale":"2023-07-27T14:27:01.294577+0000","last_undegraded":"2023-07-27T14:27:01.294577+0000","last_fullsized":"2023-07-27T14:27:01.294577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268394+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:27:01.268394+0000","last_peered":"2023-07-27T14:27:01.268394+0000","last_clean":"2023-07-27T14:27:01.268394+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:27:01.268394+0000","last_undegraded":"2023-07-27T14:27:01.268394+0000","last_fullsized":"2023-07-27T14:27:01.268394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.798083+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:27:00.798083+0000","last_peered":"2023-07-27T14:27:00.798083+0000","last_clean":"2023-07-27T14:27:00.798083+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:27:00.798083+0000","last_undegraded":"2023-07-27T14:27:00.798083+0000","last_fullsized":"2023-07-27T14:27:00.798083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260911+0000","last_change":"2023-07-27T14:27:00.820288+0000","last_active":"2023-07-27T14:27:01.260911+0000","last_peered":"2023-07-27T14:27:01.260911+0000","last_clean":"2023-07-27T14:27:01.260911+0000","last_became_active":"2023-07-27T14:27:00.818566+0000","last_became_peered":"2023-07-27T14:27:00.818566+0000","last_unstale":"2023-07-27T14:27:01.260911+0000","last_undegraded":"2023-07-27T14:27:01.260911+0000","last_fullsized":"2023-07-27T14:27:01.260911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285387+0000","last_change":"2023-07-27T14:27:01.281461+0000","last_active":"2023-07-27T14:27:01.285387+0000","last_peered":"2023-07-27T14:27:01.285387+0000","last_clean":"2023-07-27T14:27:01.285387+0000","last_became_active":"2023-07-27T14:27:01.280500+0000","last_became_peered":"2023-07-27T14:27:01.280500+0000","last_unstale":"2023-07-27T14:27:01.285387+0000","last_undegraded":"2023-07-27T14:27:01.285387+0000","last_fullsized":"2023-07-27T14:27:01.285387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.798184+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:27:00.798184+0000","last_peered":"2023-07-27T14:27:00.798184+0000","last_clean":"2023-07-27T14:27:00.798184+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:27:00.798184+0000","last_undegraded":"2023-07-27T14:27:00.798184+0000","last_fullsized":"2023-07-27T14:27:00.798184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265806+0000","last_change":"2023-07-27T14:27:00.821693+0000","last_active":"2023-07-27T14:27:01.265806+0000","last_peered":"2023-07-27T14:27:01.265806+0000","last_clean":"2023-07-27T14:27:01.265806+0000","last_became_active":"2023-07-27T14:27:00.821333+0000","last_became_peered":"2023-07-27T14:27:00.821333+0000","last_unstale":"2023-07-27T14:27:01.265806+0000","last_undegraded":"2023-07-27T14:27:01.265806+0000","last_fullsized":"2023-07-27T14:27:01.265806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.798461+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:27:00.798461+0000","last_peered":"2023-07-27T14:27:00.798461+0000","last_clean":"2023-07-27T14:27:00.798461+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:27:00.798461+0000","last_undegraded":"2023-07-27T14:27:00.798461+0000","last_fullsized":"2023-07-27T14:27:00.798461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.806843+0000","last_change":"2023-07-27T14:27:00.803181+0000","last_active":"2023-07-27T14:27:00.806843+0000","last_peered":"2023-07-27T14:27:00.806843+0000","last_clean":"2023-07-27T14:27:00.806843+0000","last_became_active":"2023-07-27T14:27:00.802812+0000","last_became_peered":"2023-07-27T14:27:00.802812+0000","last_unstale":"2023-07-27T14:27:00.806843+0000","last_undegraded":"2023-07-27T14:27:00.806843+0000","last_fullsized":"2023-07-27T14:27:00.806843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287297+0000","last_change":"2023-07-27T14:27:01.285120+0000","last_active":"2023-07-27T14:27:01.287297+0000","last_peered":"2023-07-27T14:27:01.287297+0000","last_clean":"2023-07-27T14:27:01.287297+0000","last_became_active":"2023-07-27T14:27:01.284758+0000","last_became_peered":"2023-07-27T14:27:01.284758+0000","last_unstale":"2023-07-27T14:27:01.287297+0000","last_undegraded":"2023-07-27T14:27:01.287297+0000","last_fullsized":"2023-07-27T14:27:01.287297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288456+0000","last_change":"2023-07-27T14:27:00.822951+0000","last_active":"2023-07-27T14:27:01.288456+0000","last_peered":"2023-07-27T14:27:01.288456+0000","last_clean":"2023-07-27T14:27:01.288456+0000","last_became_active":"2023-07-27T14:27:00.822642+0000","last_became_peered":"2023-07-27T14:27:00.822642+0000","last_unstale":"2023-07-27T14:27:01.288456+0000","last_undegraded":"2023-07-27T14:27:01.288456+0000","last_fullsized":"2023-07-27T14:27:01.288456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.790773+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:27:00.790773+0000","last_peered":"2023-07-27T14:27:00.790773+0000","last_clean":"2023-07-27T14:27:00.790773+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:27:00.790773+0000","last_undegraded":"2023-07-27T14:27:00.790773+0000","last_fullsized":"2023-07-27T14:27:00.790773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281966+0000","last_change":"2023-07-27T14:27:01.274025+0000","last_active":"2023-07-27T14:27:01.281966+0000","last_peered":"2023-07-27T14:27:01.281966+0000","last_clean":"2023-07-27T14:27:01.281966+0000","last_became_active":"2023-07-27T14:27:01.273760+0000","last_became_peered":"2023-07-27T14:27:01.273760+0000","last_unstale":"2023-07-27T14:27:01.281966+0000","last_undegraded":"2023-07-27T14:27:01.281966+0000","last_fullsized":"2023-07-27T14:27:01.281966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.793374+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:27:00.793374+0000","last_peered":"2023-07-27T14:27:00.793374+0000","last_clean":"2023-07-27T14:27:00.793374+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:27:00.793374+0000","last_undegraded":"2023-07-27T14:27:00.793374+0000","last_fullsized":"2023-07-27T14:27:00.793374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.266294+0000","last_change":"2023-07-27T14:27:00.809142+0000","last_active":"2023-07-27T14:27:01.266294+0000","last_peered":"2023-07-27T14:27:01.266294+0000","last_clean":"2023-07-27T14:27:01.266294+0000","last_became_active":"2023-07-27T14:27:00.808822+0000","last_became_peered":"2023-07-27T14:27:00.808822+0000","last_unstale":"2023-07-27T14:27:01.266294+0000","last_undegraded":"2023-07-27T14:27:01.266294+0000","last_fullsized":"2023-07-27T14:27:01.266294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293162+0000","last_change":"2023-07-27T14:27:01.293162+0000","last_active":"2023-07-27T14:27:01.293162+0000","last_peered":"2023-07-27T14:27:01.293162+0000","last_clean":"2023-07-27T14:27:01.293162+0000","last_became_active":"2023-07-27T14:27:01.292764+0000","last_became_peered":"2023-07-27T14:27:01.292764+0000","last_unstale":"2023-07-27T14:27:01.293162+0000","last_undegraded":"2023-07-27T14:27:01.293162+0000","last_fullsized":"2023-07-27T14:27:01.293162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286788+0000","last_change":"2023-07-27T14:27:01.278950+0000","last_active":"2023-07-27T14:27:01.286788+0000","last_peered":"2023-07-27T14:27:01.286788+0000","last_clean":"2023-07-27T14:27:01.286788+0000","last_became_active":"2023-07-27T14:27:01.278643+0000","last_became_peered":"2023-07-27T14:27:01.278643+0000","last_unstale":"2023-07-27T14:27:01.286788+0000","last_undegraded":"2023-07-27T14:27:01.286788+0000","last_fullsized":"2023-07-27T14:27:01.286788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265962+0000","last_change":"2023-07-27T14:27:00.820665+0000","last_active":"2023-07-27T14:27:01.265962+0000","last_peered":"2023-07-27T14:27:01.265962+0000","last_clean":"2023-07-27T14:27:01.265962+0000","last_became_active":"2023-07-27T14:27:00.820385+0000","last_became_peered":"2023-07-27T14:27:00.820385+0000","last_unstale":"2023-07-27T14:27:01.265962+0000","last_undegraded":"2023-07-27T14:27:01.265962+0000","last_fullsized":"2023-07-27T14:27:01.265962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293370+0000","last_change":"2023-07-27T14:27:01.293370+0000","last_active":"2023-07-27T14:27:01.293370+0000","last_peered":"2023-07-27T14:27:01.293370+0000","last_clean":"2023-07-27T14:27:01.293370+0000","last_became_active":"2023-07-27T14:27:01.293073+0000","last_became_peered":"2023-07-27T14:27:01.293073+0000","last_unstale":"2023-07-27T14:27:01.293370+0000","last_undegraded":"2023-07-27T14:27:01.293370+0000","last_fullsized":"2023-07-27T14:27:01.293370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268393+0000","last_change":"2023-07-27T14:27:00.821425+0000","last_active":"2023-07-27T14:27:01.268393+0000","last_peered":"2023-07-27T14:27:01.268393+0000","last_clean":"2023-07-27T14:27:01.268393+0000","last_became_active":"2023-07-27T14:27:00.820969+0000","last_became_peered":"2023-07-27T14:27:00.820969+0000","last_unstale":"2023-07-27T14:27:01.268393+0000","last_undegraded":"2023-07-27T14:27:01.268393+0000","last_fullsized":"2023-07-27T14:27:01.268393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293918+0000","last_change":"2023-07-27T14:27:01.293918+0000","last_active":"2023-07-27T14:27:01.293918+0000","last_peered":"2023-07-27T14:27:01.293918+0000","last_clean":"2023-07-27T14:27:01.293918+0000","last_became_active":"2023-07-27T14:27:01.293535+0000","last_became_peered":"2023-07-27T14:27:01.293535+0000","last_unstale":"2023-07-27T14:27:01.293918+0000","last_undegraded":"2023-07-27T14:27:01.293918+0000","last_fullsized":"2023-07-27T14:27:01.293918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295160+0000","last_change":"2023-07-27T14:27:00.821100+0000","last_active":"2023-07-27T14:27:01.295160+0000","last_peered":"2023-07-27T14:27:01.295160+0000","last_clean":"2023-07-27T14:27:01.295160+0000","last_became_active":"2023-07-27T14:27:00.820834+0000","last_became_peered":"2023-07-27T14:27:00.820834+0000","last_unstale":"2023-07-27T14:27:01.295160+0000","last_undegraded":"2023-07-27T14:27:01.295160+0000","last_fullsized":"2023-07-27T14:27:01.295160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282491+0000","last_change":"2023-07-27T14:27:01.279306+0000","last_active":"2023-07-27T14:27:01.282491+0000","last_peered":"2023-07-27T14:27:01.282491+0000","last_clean":"2023-07-27T14:27:01.282491+0000","last_became_active":"2023-07-27T14:27:01.279053+0000","last_became_peered":"2023-07-27T14:27:01.279053+0000","last_unstale":"2023-07-27T14:27:01.282491+0000","last_undegraded":"2023-07-27T14:27:01.282491+0000","last_fullsized":"2023-07-27T14:27:01.282491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282641+0000","last_change":"2023-07-27T14:27:00.821978+0000","last_active":"2023-07-27T14:27:01.282641+0000","last_peered":"2023-07-27T14:27:01.282641+0000","last_clean":"2023-07-27T14:27:01.282641+0000","last_became_active":"2023-07-27T14:27:00.821626+0000","last_became_peered":"2023-07-27T14:27:00.821626+0000","last_unstale":"2023-07-27T14:27:01.282641+0000","last_undegraded":"2023-07-27T14:27:01.282641+0000","last_fullsized":"2023-07-27T14:27:01.282641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289940+0000","last_change":"2023-07-27T14:27:01.289940+0000","last_active":"2023-07-27T14:27:01.289940+0000","last_peered":"2023-07-27T14:27:01.289940+0000","last_clean":"2023-07-27T14:27:01.289940+0000","last_became_active":"2023-07-27T14:27:01.289604+0000","last_became_peered":"2023-07-27T14:27:01.289604+0000","last_unstale":"2023-07-27T14:27:01.289940+0000","last_undegraded":"2023-07-27T14:27:01.289940+0000","last_fullsized":"2023-07-27T14:27:01.289940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282827+0000","last_change":"2023-07-27T14:27:00.811768+0000","last_active":"2023-07-27T14:27:01.282827+0000","last_peered":"2023-07-27T14:27:01.282827+0000","last_clean":"2023-07-27T14:27:01.282827+0000","last_became_active":"2023-07-27T14:27:00.811467+0000","last_became_peered":"2023-07-27T14:27:00.811467+0000","last_unstale":"2023-07-27T14:27:01.282827+0000","last_undegraded":"2023-07-27T14:27:01.282827+0000","last_fullsized":"2023-07-27T14:27:01.282827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.271866+0000","last_change":"2023-07-27T14:27:01.271866+0000","last_active":"2023-07-27T14:27:01.271866+0000","last_peered":"2023-07-27T14:27:01.271866+0000","last_clean":"2023-07-27T14:27:01.271866+0000","last_became_active":"2023-07-27T14:27:01.271572+0000","last_became_peered":"2023-07-27T14:27:01.271572+0000","last_unstale":"2023-07-27T14:27:01.271866+0000","last_undegraded":"2023-07-27T14:27:01.271866+0000","last_fullsized":"2023-07-27T14:27:01.271866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.812354+0000","last_change":"2023-07-27T14:27:00.809399+0000","last_active":"2023-07-27T14:27:00.812354+0000","last_peered":"2023-07-27T14:27:00.812354+0000","last_clean":"2023-07-27T14:27:00.812354+0000","last_became_active":"2023-07-27T14:27:00.809047+0000","last_became_peered":"2023-07-27T14:27:00.809047+0000","last_unstale":"2023-07-27T14:27:00.812354+0000","last_undegraded":"2023-07-27T14:27:00.812354+0000","last_fullsized":"2023-07-27T14:27:00.812354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.277061+0000","last_change":"2023-07-27T14:27:01.277061+0000","last_active":"2023-07-27T14:27:01.277061+0000","last_peered":"2023-07-27T14:27:01.277061+0000","last_clean":"2023-07-27T14:27:01.277061+0000","last_became_active":"2023-07-27T14:27:01.276810+0000","last_became_peered":"2023-07-27T14:27:01.276810+0000","last_unstale":"2023-07-27T14:27:01.277061+0000","last_undegraded":"2023-07-27T14:27:01.277061+0000","last_fullsized":"2023-07-27T14:27:01.277061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270326+0000","last_change":"2023-07-27T14:27:00.810515+0000","last_active":"2023-07-27T14:27:01.270326+0000","last_peered":"2023-07-27T14:27:01.270326+0000","last_clean":"2023-07-27T14:27:01.270326+0000","last_became_active":"2023-07-27T14:27:00.810250+0000","last_became_peered":"2023-07-27T14:27:00.810250+0000","last_unstale":"2023-07-27T14:27:01.270326+0000","last_undegraded":"2023-07-27T14:27:01.270326+0000","last_fullsized":"2023-07-27T14:27:01.270326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296559+0000","last_change":"2023-07-27T14:27:01.288902+0000","last_active":"2023-07-27T14:27:01.296559+0000","last_peered":"2023-07-27T14:27:01.296559+0000","last_clean":"2023-07-27T14:27:01.296559+0000","last_became_active":"2023-07-27T14:27:01.288298+0000","last_became_peered":"2023-07-27T14:27:01.288298+0000","last_unstale":"2023-07-27T14:27:01.296559+0000","last_undegraded":"2023-07-27T14:27:01.296559+0000","last_fullsized":"2023-07-27T14:27:01.296559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270140+0000","last_change":"2023-07-27T14:27:00.821272+0000","last_active":"2023-07-27T14:27:01.270140+0000","last_peered":"2023-07-27T14:27:01.270140+0000","last_clean":"2023-07-27T14:27:01.270140+0000","last_became_active":"2023-07-27T14:27:00.820947+0000","last_became_peered":"2023-07-27T14:27:00.820947+0000","last_unstale":"2023-07-27T14:27:01.270140+0000","last_undegraded":"2023-07-27T14:27:01.270140+0000","last_fullsized":"2023-07-27T14:27:01.270140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.273588+0000","last_change":"2023-07-27T14:27:01.273588+0000","last_active":"2023-07-27T14:27:01.273588+0000","last_peered":"2023-07-27T14:27:01.273588+0000","last_clean":"2023-07-27T14:27:01.273588+0000","last_became_active":"2023-07-27T14:27:01.273352+0000","last_became_peered":"2023-07-27T14:27:01.273352+0000","last_unstale":"2023-07-27T14:27:01.273588+0000","last_undegraded":"2023-07-27T14:27:01.273588+0000","last_fullsized":"2023-07-27T14:27:01.273588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265785+0000","last_change":"2023-07-27T14:27:00.820075+0000","last_active":"2023-07-27T14:27:01.265785+0000","last_peered":"2023-07-27T14:27:01.265785+0000","last_clean":"2023-07-27T14:27:01.265785+0000","last_became_active":"2023-07-27T14:27:00.819794+0000","last_became_peered":"2023-07-27T14:27:00.819794+0000","last_unstale":"2023-07-27T14:27:01.265785+0000","last_undegraded":"2023-07-27T14:27:01.265785+0000","last_fullsized":"2023-07-27T14:27:01.265785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283080+0000","last_change":"2023-07-27T14:27:01.280882+0000","last_active":"2023-07-27T14:27:01.283080+0000","last_peered":"2023-07-27T14:27:01.283080+0000","last_clean":"2023-07-27T14:27:01.283080+0000","last_became_active":"2023-07-27T14:27:01.280339+0000","last_became_peered":"2023-07-27T14:27:01.280339+0000","last_unstale":"2023-07-27T14:27:01.283080+0000","last_undegraded":"2023-07-27T14:27:01.283080+0000","last_fullsized":"2023-07-27T14:27:01.283080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260518+0000","last_change":"2023-07-27T14:27:00.820859+0000","last_active":"2023-07-27T14:27:01.260518+0000","last_peered":"2023-07-27T14:27:01.260518+0000","last_clean":"2023-07-27T14:27:01.260518+0000","last_became_active":"2023-07-27T14:27:00.820298+0000","last_became_peered":"2023-07-27T14:27:00.820298+0000","last_unstale":"2023-07-27T14:27:01.260518+0000","last_undegraded":"2023-07-27T14:27:01.260518+0000","last_fullsized":"2023-07-27T14:27:01.260518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294252+0000","last_change":"2023-07-27T14:27:01.294252+0000","last_active":"2023-07-27T14:27:01.294252+0000","last_peered":"2023-07-27T14:27:01.294252+0000","last_clean":"2023-07-27T14:27:01.294252+0000","last_became_active":"2023-07-27T14:27:01.293925+0000","last_became_peered":"2023-07-27T14:27:01.293925+0000","last_unstale":"2023-07-27T14:27:01.294252+0000","last_undegraded":"2023-07-27T14:27:01.294252+0000","last_fullsized":"2023-07-27T14:27:01.294252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.818775+0000","last_change":"2023-07-27T14:27:00.816789+0000","last_active":"2023-07-27T14:27:00.818775+0000","last_peered":"2023-07-27T14:27:00.818775+0000","last_clean":"2023-07-27T14:27:00.818775+0000","last_became_active":"2023-07-27T14:27:00.816454+0000","last_became_peered":"2023-07-27T14:27:00.816454+0000","last_unstale":"2023-07-27T14:27:00.818775+0000","last_undegraded":"2023-07-27T14:27:00.818775+0000","last_fullsized":"2023-07-27T14:27:00.818775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281998+0000","last_change":"2023-07-27T14:27:01.270224+0000","last_active":"2023-07-27T14:27:01.281998+0000","last_peered":"2023-07-27T14:27:01.281998+0000","last_clean":"2023-07-27T14:27:01.281998+0000","last_became_active":"2023-07-27T14:27:01.269914+0000","last_became_peered":"2023-07-27T14:27:01.269914+0000","last_unstale":"2023-07-27T14:27:01.281998+0000","last_undegraded":"2023-07-27T14:27:01.281998+0000","last_fullsized":"2023-07-27T14:27:01.281998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.812821+0000","last_change":"2023-07-27T14:27:00.805825+0000","last_active":"2023-07-27T14:27:00.812821+0000","last_peered":"2023-07-27T14:27:00.812821+0000","last_clean":"2023-07-27T14:27:00.812821+0000","last_became_active":"2023-07-27T14:27:00.805285+0000","last_became_peered":"2023-07-27T14:27:00.805285+0000","last_unstale":"2023-07-27T14:27:00.812821+0000","last_undegraded":"2023-07-27T14:27:00.812821+0000","last_fullsized":"2023-07-27T14:27:00.812821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.278889+0000","last_change":"2023-07-27T14:27:01.278889+0000","last_active":"2023-07-27T14:27:01.278889+0000","last_peered":"2023-07-27T14:27:01.278889+0000","last_clean":"2023-07-27T14:27:01.278889+0000","last_became_active":"2023-07-27T14:27:01.277699+0000","last_became_peered":"2023-07-27T14:27:01.277699+0000","last_unstale":"2023-07-27T14:27:01.278889+0000","last_undegraded":"2023-07-27T14:27:01.278889+0000","last_fullsized":"2023-07-27T14:27:01.278889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260325+0000","last_change":"2023-07-27T14:27:00.818272+0000","last_active":"2023-07-27T14:27:01.260325+0000","last_peered":"2023-07-27T14:27:01.260325+0000","last_clean":"2023-07-27T14:27:01.260325+0000","last_became_active":"2023-07-27T14:27:00.817922+0000","last_became_peered":"2023-07-27T14:27:00.817922+0000","last_unstale":"2023-07-27T14:27:01.260325+0000","last_undegraded":"2023-07-27T14:27:01.260325+0000","last_fullsized":"2023-07-27T14:27:01.260325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281674+0000","last_change":"2023-07-27T14:27:01.277882+0000","last_active":"2023-07-27T14:27:01.281674+0000","last_peered":"2023-07-27T14:27:01.281674+0000","last_clean":"2023-07-27T14:27:01.281674+0000","last_became_active":"2023-07-27T14:27:01.276949+0000","last_became_peered":"2023-07-27T14:27:01.276949+0000","last_unstale":"2023-07-27T14:27:01.281674+0000","last_undegraded":"2023-07-27T14:27:01.281674+0000","last_fullsized":"2023-07-27T14:27:01.281674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269102+0000","last_change":"2023-07-27T14:27:00.822718+0000","last_active":"2023-07-27T14:27:01.269102+0000","last_peered":"2023-07-27T14:27:01.269102+0000","last_clean":"2023-07-27T14:27:01.269102+0000","last_became_active":"2023-07-27T14:27:00.822424+0000","last_became_peered":"2023-07-27T14:27:00.822424+0000","last_unstale":"2023-07-27T14:27:01.269102+0000","last_undegraded":"2023-07-27T14:27:01.269102+0000","last_fullsized":"2023-07-27T14:27:01.269102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295205+0000","last_change":"2023-07-27T14:27:01.295205+0000","last_active":"2023-07-27T14:27:01.295205+0000","last_peered":"2023-07-27T14:27:01.295205+0000","last_clean":"2023-07-27T14:27:01.295205+0000","last_became_active":"2023-07-27T14:27:01.294982+0000","last_became_peered":"2023-07-27T14:27:01.294982+0000","last_unstale":"2023-07-27T14:27:01.295205+0000","last_undegraded":"2023-07-27T14:27:01.295205+0000","last_fullsized":"2023-07-27T14:27:01.295205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260244+0000","last_change":"2023-07-27T14:27:00.821157+0000","last_active":"2023-07-27T14:27:01.260244+0000","last_peered":"2023-07-27T14:27:01.260244+0000","last_clean":"2023-07-27T14:27:01.260244+0000","last_became_active":"2023-07-27T14:27:00.820866+0000","last_became_peered":"2023-07-27T14:27:00.820866+0000","last_unstale":"2023-07-27T14:27:01.260244+0000","last_undegraded":"2023-07-27T14:27:01.260244+0000","last_fullsized":"2023-07-27T14:27:01.260244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.279179+0000","last_change":"2023-07-27T14:27:01.274421+0000","last_active":"2023-07-27T14:27:01.279179+0000","last_peered":"2023-07-27T14:27:01.279179+0000","last_clean":"2023-07-27T14:27:01.279179+0000","last_became_active":"2023-07-27T14:27:01.274184+0000","last_became_peered":"2023-07-27T14:27:01.274184+0000","last_unstale":"2023-07-27T14:27:01.279179+0000","last_undegraded":"2023-07-27T14:27:01.279179+0000","last_fullsized":"2023-07-27T14:27:01.279179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270247+0000","last_change":"2023-07-27T14:27:00.800329+0000","last_active":"2023-07-27T14:27:01.270247+0000","last_peered":"2023-07-27T14:27:01.270247+0000","last_clean":"2023-07-27T14:27:01.270247+0000","last_became_active":"2023-07-27T14:27:00.799971+0000","last_became_peered":"2023-07-27T14:27:00.799971+0000","last_unstale":"2023-07-27T14:27:01.270247+0000","last_undegraded":"2023-07-27T14:27:01.270247+0000","last_fullsized":"2023-07-27T14:27:01.270247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290197+0000","last_change":"2023-07-27T14:27:01.290197+0000","last_active":"2023-07-27T14:27:01.290197+0000","last_peered":"2023-07-27T14:27:01.290197+0000","last_clean":"2023-07-27T14:27:01.290197+0000","last_became_active":"2023-07-27T14:27:01.289777+0000","last_became_peered":"2023-07-27T14:27:01.289777+0000","last_unstale":"2023-07-27T14:27:01.290197+0000","last_undegraded":"2023-07-27T14:27:01.290197+0000","last_fullsized":"2023-07-27T14:27:01.290197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290972+0000","last_change":"2023-07-27T14:27:00.812501+0000","last_active":"2023-07-27T14:27:01.290972+0000","last_peered":"2023-07-27T14:27:01.290972+0000","last_clean":"2023-07-27T14:27:01.290972+0000","last_became_active":"2023-07-27T14:27:00.810185+0000","last_became_peered":"2023-07-27T14:27:00.810185+0000","last_unstale":"2023-07-27T14:27:01.290972+0000","last_undegraded":"2023-07-27T14:27:01.290972+0000","last_fullsized":"2023-07-27T14:27:01.290972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281360+0000","last_change":"2023-07-27T14:27:01.281360+0000","last_active":"2023-07-27T14:27:01.281360+0000","last_peered":"2023-07-27T14:27:01.281360+0000","last_clean":"2023-07-27T14:27:01.281360+0000","last_became_active":"2023-07-27T14:27:01.279561+0000","last_became_peered":"2023-07-27T14:27:01.279561+0000","last_unstale":"2023-07-27T14:27:01.281360+0000","last_undegraded":"2023-07-27T14:27:01.281360+0000","last_fullsized":"2023-07-27T14:27:01.281360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.825166+0000","last_change":"2023-07-27T14:27:00.821016+0000","last_active":"2023-07-27T14:27:00.825166+0000","last_peered":"2023-07-27T14:27:00.825166+0000","last_clean":"2023-07-27T14:27:00.825166+0000","last_became_active":"2023-07-27T14:27:00.820542+0000","last_became_peered":"2023-07-27T14:27:00.820542+0000","last_unstale":"2023-07-27T14:27:00.825166+0000","last_undegraded":"2023-07-27T14:27:00.825166+0000","last_fullsized":"2023-07-27T14:27:00.825166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281760+0000","last_change":"2023-07-27T14:27:01.279230+0000","last_active":"2023-07-27T14:27:01.281760+0000","last_peered":"2023-07-27T14:27:01.281760+0000","last_clean":"2023-07-27T14:27:01.281760+0000","last_became_active":"2023-07-27T14:27:01.278983+0000","last_became_peered":"2023-07-27T14:27:01.278983+0000","last_unstale":"2023-07-27T14:27:01.281760+0000","last_undegraded":"2023-07-27T14:27:01.281760+0000","last_fullsized":"2023-07-27T14:27:01.281760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263370+0000","last_change":"2023-07-27T14:27:00.807042+0000","last_active":"2023-07-27T14:27:01.263370+0000","last_peered":"2023-07-27T14:27:01.263370+0000","last_clean":"2023-07-27T14:27:01.263370+0000","last_became_active":"2023-07-27T14:27:00.805697+0000","last_became_peered":"2023-07-27T14:27:00.805697+0000","last_unstale":"2023-07-27T14:27:01.263370+0000","last_undegraded":"2023-07-27T14:27:01.263370+0000","last_fullsized":"2023-07-27T14:27:01.263370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285431+0000","last_change":"2023-07-27T14:27:01.283982+0000","last_active":"2023-07-27T14:27:01.285431+0000","last_peered":"2023-07-27T14:27:01.285431+0000","last_clean":"2023-07-27T14:27:01.285431+0000","last_became_active":"2023-07-27T14:27:01.283720+0000","last_became_peered":"2023-07-27T14:27:01.283720+0000","last_unstale":"2023-07-27T14:27:01.285431+0000","last_undegraded":"2023-07-27T14:27:01.285431+0000","last_fullsized":"2023-07-27T14:27:01.285431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270872+0000","last_change":"2023-07-27T14:27:00.803325+0000","last_active":"2023-07-27T14:27:01.270872+0000","last_peered":"2023-07-27T14:27:01.270872+0000","last_clean":"2023-07-27T14:27:01.270872+0000","last_became_active":"2023-07-27T14:27:00.802962+0000","last_became_peered":"2023-07-27T14:27:00.802962+0000","last_unstale":"2023-07-27T14:27:01.270872+0000","last_undegraded":"2023-07-27T14:27:01.270872+0000","last_fullsized":"2023-07-27T14:27:01.270872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.280016+0000","last_change":"2023-07-27T14:27:01.280016+0000","last_active":"2023-07-27T14:27:01.280016+0000","last_peered":"2023-07-27T14:27:01.280016+0000","last_clean":"2023-07-27T14:27:01.280016+0000","last_became_active":"2023-07-27T14:27:01.279475+0000","last_became_peered":"2023-07-27T14:27:01.279475+0000","last_unstale":"2023-07-27T14:27:01.280016+0000","last_undegraded":"2023-07-27T14:27:01.280016+0000","last_fullsized":"2023-07-27T14:27:01.280016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268740+0000","last_change":"2023-07-27T14:27:00.808976+0000","last_active":"2023-07-27T14:27:01.268740+0000","last_peered":"2023-07-27T14:27:01.268740+0000","last_clean":"2023-07-27T14:27:01.268740+0000","last_became_active":"2023-07-27T14:27:00.808693+0000","last_became_peered":"2023-07-27T14:27:00.808693+0000","last_unstale":"2023-07-27T14:27:01.268740+0000","last_undegraded":"2023-07-27T14:27:01.268740+0000","last_fullsized":"2023-07-27T14:27:01.268740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281655+0000","last_change":"2023-07-27T14:27:01.277692+0000","last_active":"2023-07-27T14:27:01.281655+0000","last_peered":"2023-07-27T14:27:01.281655+0000","last_clean":"2023-07-27T14:27:01.281655+0000","last_became_active":"2023-07-27T14:27:01.277446+0000","last_became_peered":"2023-07-27T14:27:01.277446+0000","last_unstale":"2023-07-27T14:27:01.281655+0000","last_undegraded":"2023-07-27T14:27:01.281655+0000","last_fullsized":"2023-07-27T14:27:01.281655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289999+0000","last_change":"2023-07-27T14:27:00.804577+0000","last_active":"2023-07-27T14:27:01.289999+0000","last_peered":"2023-07-27T14:27:01.289999+0000","last_clean":"2023-07-27T14:27:01.289999+0000","last_became_active":"2023-07-27T14:27:00.804260+0000","last_became_peered":"2023-07-27T14:27:00.804260+0000","last_unstale":"2023-07-27T14:27:01.289999+0000","last_undegraded":"2023-07-27T14:27:01.289999+0000","last_fullsized":"2023-07-27T14:27:01.289999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287961+0000","last_change":"2023-07-27T14:27:01.283951+0000","last_active":"2023-07-27T14:27:01.287961+0000","last_peered":"2023-07-27T14:27:01.287961+0000","last_clean":"2023-07-27T14:27:01.287961+0000","last_became_active":"2023-07-27T14:27:01.283632+0000","last_became_peered":"2023-07-27T14:27:01.283632+0000","last_unstale":"2023-07-27T14:27:01.287961+0000","last_undegraded":"2023-07-27T14:27:01.287961+0000","last_fullsized":"2023-07-27T14:27:01.287961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.825813+0000","last_change":"2023-07-27T14:27:00.824631+0000","last_active":"2023-07-27T14:27:00.825813+0000","last_peered":"2023-07-27T14:27:00.825813+0000","last_clean":"2023-07-27T14:27:00.825813+0000","last_became_active":"2023-07-27T14:27:00.824325+0000","last_became_peered":"2023-07-27T14:27:00.824325+0000","last_unstale":"2023-07-27T14:27:00.825813+0000","last_undegraded":"2023-07-27T14:27:00.825813+0000","last_fullsized":"2023-07-27T14:27:00.825813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289044+0000","last_change":"2023-07-27T14:27:01.289044+0000","last_active":"2023-07-27T14:27:01.289044+0000","last_peered":"2023-07-27T14:27:01.289044+0000","last_clean":"2023-07-27T14:27:01.289044+0000","last_became_active":"2023-07-27T14:27:01.288554+0000","last_became_peered":"2023-07-27T14:27:01.288554+0000","last_unstale":"2023-07-27T14:27:01.289044+0000","last_undegraded":"2023-07-27T14:27:01.289044+0000","last_fullsized":"2023-07-27T14:27:01.289044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265219+0000","last_change":"2023-07-27T14:27:00.809620+0000","last_active":"2023-07-27T14:27:01.265219+0000","last_peered":"2023-07-27T14:27:01.265219+0000","last_clean":"2023-07-27T14:27:01.265219+0000","last_became_active":"2023-07-27T14:27:00.808904+0000","last_became_peered":"2023-07-27T14:27:00.808904+0000","last_unstale":"2023-07-27T14:27:01.265219+0000","last_undegraded":"2023-07-27T14:27:01.265219+0000","last_fullsized":"2023-07-27T14:27:01.265219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290692+0000","last_change":"2023-07-27T14:27:01.289240+0000","last_active":"2023-07-27T14:27:01.290692+0000","last_peered":"2023-07-27T14:27:01.290692+0000","last_clean":"2023-07-27T14:27:01.290692+0000","last_became_active":"2023-07-27T14:27:01.288802+0000","last_became_peered":"2023-07-27T14:27:01.288802+0000","last_unstale":"2023-07-27T14:27:01.290692+0000","last_undegraded":"2023-07-27T14:27:01.290692+0000","last_fullsized":"2023-07-27T14:27:01.290692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281879+0000","last_change":"2023-07-27T14:27:00.822946+0000","last_active":"2023-07-27T14:27:01.281879+0000","last_peered":"2023-07-27T14:27:01.281879+0000","last_clean":"2023-07-27T14:27:01.281879+0000","last_became_active":"2023-07-27T14:27:00.822588+0000","last_became_peered":"2023-07-27T14:27:00.822588+0000","last_unstale":"2023-07-27T14:27:01.281879+0000","last_undegraded":"2023-07-27T14:27:01.281879+0000","last_fullsized":"2023-07-27T14:27:01.281879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286750+0000","last_change":"2023-07-27T14:27:01.282869+0000","last_active":"2023-07-27T14:27:01.286750+0000","last_peered":"2023-07-27T14:27:01.286750+0000","last_clean":"2023-07-27T14:27:01.286750+0000","last_became_active":"2023-07-27T14:27:01.282606+0000","last_became_peered":"2023-07-27T14:27:01.282606+0000","last_unstale":"2023-07-27T14:27:01.286750+0000","last_undegraded":"2023-07-27T14:27:01.286750+0000","last_fullsized":"2023-07-27T14:27:01.286750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293253+0000","last_change":"2023-07-27T14:27:00.818598+0000","last_active":"2023-07-27T14:27:01.293253+0000","last_peered":"2023-07-27T14:27:01.293253+0000","last_clean":"2023-07-27T14:27:01.293253+0000","last_became_active":"2023-07-27T14:27:00.817968+0000","last_became_peered":"2023-07-27T14:27:00.817968+0000","last_unstale":"2023-07-27T14:27:01.293253+0000","last_undegraded":"2023-07-27T14:27:01.293253+0000","last_fullsized":"2023-07-27T14:27:01.293253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284237+0000","last_change":"2023-07-27T14:27:01.280850+0000","last_active":"2023-07-27T14:27:01.284237+0000","last_peered":"2023-07-27T14:27:01.284237+0000","last_clean":"2023-07-27T14:27:01.284237+0000","last_became_active":"2023-07-27T14:27:01.280558+0000","last_became_peered":"2023-07-27T14:27:01.280558+0000","last_unstale":"2023-07-27T14:27:01.284237+0000","last_undegraded":"2023-07-27T14:27:01.284237+0000","last_fullsized":"2023-07-27T14:27:01.284237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.813188+0000","last_change":"2023-07-27T14:27:00.809897+0000","last_active":"2023-07-27T14:27:00.813188+0000","last_peered":"2023-07-27T14:27:00.813188+0000","last_clean":"2023-07-27T14:27:00.813188+0000","last_became_active":"2023-07-27T14:27:00.809579+0000","last_became_peered":"2023-07-27T14:27:00.809579+0000","last_unstale":"2023-07-27T14:27:00.813188+0000","last_undegraded":"2023-07-27T14:27:00.813188+0000","last_fullsized":"2023-07-27T14:27:00.813188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.274427+0000","last_change":"2023-07-27T14:27:01.274427+0000","last_active":"2023-07-27T14:27:01.274427+0000","last_peered":"2023-07-27T14:27:01.274427+0000","last_clean":"2023-07-27T14:27:01.274427+0000","last_became_active":"2023-07-27T14:27:01.273859+0000","last_became_peered":"2023-07-27T14:27:01.273859+0000","last_unstale":"2023-07-27T14:27:01.274427+0000","last_undegraded":"2023-07-27T14:27:01.274427+0000","last_fullsized":"2023-07-27T14:27:01.274427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.813220+0000","last_change":"2023-07-27T14:27:00.809959+0000","last_active":"2023-07-27T14:27:00.813220+0000","last_peered":"2023-07-27T14:27:00.813220+0000","last_clean":"2023-07-27T14:27:00.813220+0000","last_became_active":"2023-07-27T14:27:00.809036+0000","last_became_peered":"2023-07-27T14:27:00.809036+0000","last_unstale":"2023-07-27T14:27:00.813220+0000","last_undegraded":"2023-07-27T14:27:00.813220+0000","last_fullsized":"2023-07-27T14:27:00.813220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288447+0000","last_change":"2023-07-27T14:27:01.288447+0000","last_active":"2023-07-27T14:27:01.288447+0000","last_peered":"2023-07-27T14:27:01.288447+0000","last_clean":"2023-07-27T14:27:01.288447+0000","last_became_active":"2023-07-27T14:27:01.288075+0000","last_became_peered":"2023-07-27T14:27:01.288075+0000","last_unstale":"2023-07-27T14:27:01.288447+0000","last_undegraded":"2023-07-27T14:27:01.288447+0000","last_fullsized":"2023-07-27T14:27:01.288447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.823858+0000","last_change":"2023-07-27T14:27:00.817201+0000","last_active":"2023-07-27T14:27:00.823858+0000","last_peered":"2023-07-27T14:27:00.823858+0000","last_clean":"2023-07-27T14:27:00.823858+0000","last_became_active":"2023-07-27T14:27:00.816881+0000","last_became_peered":"2023-07-27T14:27:00.816881+0000","last_unstale":"2023-07-27T14:27:00.823858+0000","last_undegraded":"2023-07-27T14:27:00.823858+0000","last_fullsized":"2023-07-27T14:27:00.823858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289747+0000","last_change":"2023-07-27T14:27:01.288012+0000","last_active":"2023-07-27T14:27:01.289747+0000","last_peered":"2023-07-27T14:27:01.289747+0000","last_clean":"2023-07-27T14:27:01.289747+0000","last_became_active":"2023-07-27T14:27:01.287599+0000","last_became_peered":"2023-07-27T14:27:01.287599+0000","last_unstale":"2023-07-27T14:27:01.289747+0000","last_undegraded":"2023-07-27T14:27:01.289747+0000","last_fullsized":"2023-07-27T14:27:01.289747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260793+0000","last_change":"2023-07-27T14:27:00.818067+0000","last_active":"2023-07-27T14:27:01.260793+0000","last_peered":"2023-07-27T14:27:01.260793+0000","last_clean":"2023-07-27T14:27:01.260793+0000","last_became_active":"2023-07-27T14:27:00.817737+0000","last_became_peered":"2023-07-27T14:27:00.817737+0000","last_unstale":"2023-07-27T14:27:01.260793+0000","last_undegraded":"2023-07-27T14:27:01.260793+0000","last_fullsized":"2023-07-27T14:27:01.260793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282575+0000","last_change":"2023-07-27T14:27:01.280475+0000","last_active":"2023-07-27T14:27:01.282575+0000","last_peered":"2023-07-27T14:27:01.282575+0000","last_clean":"2023-07-27T14:27:01.282575+0000","last_became_active":"2023-07-27T14:27:01.280167+0000","last_became_peered":"2023-07-27T14:27:01.280167+0000","last_unstale":"2023-07-27T14:27:01.282575+0000","last_undegraded":"2023-07-27T14:27:01.282575+0000","last_fullsized":"2023-07-27T14:27:01.282575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.814604+0000","last_change":"2023-07-27T14:27:00.811588+0000","last_active":"2023-07-27T14:27:00.814604+0000","last_peered":"2023-07-27T14:27:00.814604+0000","last_clean":"2023-07-27T14:27:00.814604+0000","last_became_active":"2023-07-27T14:27:00.811302+0000","last_became_peered":"2023-07-27T14:27:00.811302+0000","last_unstale":"2023-07-27T14:27:00.814604+0000","last_undegraded":"2023-07-27T14:27:00.814604+0000","last_fullsized":"2023-07-27T14:27:00.814604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293325+0000","last_change":"2023-07-27T14:27:01.293325+0000","last_active":"2023-07-27T14:27:01.293325+0000","last_peered":"2023-07-27T14:27:01.293325+0000","last_clean":"2023-07-27T14:27:01.293325+0000","last_became_active":"2023-07-27T14:27:01.293018+0000","last_became_peered":"2023-07-27T14:27:01.293018+0000","last_unstale":"2023-07-27T14:27:01.293325+0000","last_undegraded":"2023-07-27T14:27:01.293325+0000","last_fullsized":"2023-07-27T14:27:01.293325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288042+0000","last_change":"2023-07-27T14:27:00.804784+0000","last_active":"2023-07-27T14:27:01.288042+0000","last_peered":"2023-07-27T14:27:01.288042+0000","last_clean":"2023-07-27T14:27:01.288042+0000","last_became_active":"2023-07-27T14:27:00.804479+0000","last_became_peered":"2023-07-27T14:27:00.804479+0000","last_unstale":"2023-07-27T14:27:01.288042+0000","last_undegraded":"2023-07-27T14:27:01.288042+0000","last_fullsized":"2023-07-27T14:27:01.288042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283937+0000","last_change":"2023-07-27T14:27:01.283937+0000","last_active":"2023-07-27T14:27:01.283937+0000","last_peered":"2023-07-27T14:27:01.283937+0000","last_clean":"2023-07-27T14:27:01.283937+0000","last_became_active":"2023-07-27T14:27:01.283504+0000","last_became_peered":"2023-07-27T14:27:01.283504+0000","last_unstale":"2023-07-27T14:27:01.283937+0000","last_undegraded":"2023-07-27T14:27:01.283937+0000","last_fullsized":"2023-07-27T14:27:01.283937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264392+0000","last_change":"2023-07-27T14:27:00.807294+0000","last_active":"2023-07-27T14:27:01.264392+0000","last_peered":"2023-07-27T14:27:01.264392+0000","last_clean":"2023-07-27T14:27:01.264392+0000","last_became_active":"2023-07-27T14:27:00.805155+0000","last_became_peered":"2023-07-27T14:27:00.805155+0000","last_unstale":"2023-07-27T14:27:01.264392+0000","last_undegraded":"2023-07-27T14:27:01.264392+0000","last_fullsized":"2023-07-27T14:27:01.264392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284985+0000","last_change":"2023-07-27T14:27:01.280972+0000","last_active":"2023-07-27T14:27:01.284985+0000","last_peered":"2023-07-27T14:27:01.284985+0000","last_clean":"2023-07-27T14:27:01.284985+0000","last_became_active":"2023-07-27T14:27:01.280394+0000","last_became_peered":"2023-07-27T14:27:01.280394+0000","last_unstale":"2023-07-27T14:27:01.284985+0000","last_undegraded":"2023-07-27T14:27:01.284985+0000","last_fullsized":"2023-07-27T14:27:01.284985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287681+0000","last_change":"2023-07-27T14:27:00.821247+0000","last_active":"2023-07-27T14:27:01.287681+0000","last_peered":"2023-07-27T14:27:01.287681+0000","last_clean":"2023-07-27T14:27:01.287681+0000","last_became_active":"2023-07-27T14:27:00.820300+0000","last_became_peered":"2023-07-27T14:27:00.820300+0000","last_unstale":"2023-07-27T14:27:01.287681+0000","last_undegraded":"2023-07-27T14:27:01.287681+0000","last_fullsized":"2023-07-27T14:27:01.287681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294103+0000","last_change":"2023-07-27T14:27:01.294103+0000","last_active":"2023-07-27T14:27:01.294103+0000","last_peered":"2023-07-27T14:27:01.294103+0000","last_clean":"2023-07-27T14:27:01.294103+0000","last_became_active":"2023-07-27T14:27:01.293567+0000","last_became_peered":"2023-07-27T14:27:01.293567+0000","last_unstale":"2023-07-27T14:27:01.294103+0000","last_undegraded":"2023-07-27T14:27:01.294103+0000","last_fullsized":"2023-07-27T14:27:01.294103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263146+0000","last_change":"2023-07-27T14:27:00.809881+0000","last_active":"2023-07-27T14:27:01.263146+0000","last_peered":"2023-07-27T14:27:01.263146+0000","last_clean":"2023-07-27T14:27:01.263146+0000","last_became_active":"2023-07-27T14:27:00.809012+0000","last_became_peered":"2023-07-27T14:27:00.809012+0000","last_unstale":"2023-07-27T14:27:01.263146+0000","last_undegraded":"2023-07-27T14:27:01.263146+0000","last_fullsized":"2023-07-27T14:27:01.263146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.274666+0000","last_change":"2023-07-27T14:27:01.274666+0000","last_active":"2023-07-27T14:27:01.274666+0000","last_peered":"2023-07-27T14:27:01.274666+0000","last_clean":"2023-07-27T14:27:01.274666+0000","last_became_active":"2023-07-27T14:27:01.272660+0000","last_became_peered":"2023-07-27T14:27:01.272660+0000","last_unstale":"2023-07-27T14:27:01.274666+0000","last_undegraded":"2023-07-27T14:27:01.274666+0000","last_fullsized":"2023-07-27T14:27:01.274666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.807427+0000","last_change":"2023-07-27T14:27:00.805779+0000","last_active":"2023-07-27T14:27:00.807427+0000","last_peered":"2023-07-27T14:27:00.807427+0000","last_clean":"2023-07-27T14:27:00.807427+0000","last_became_active":"2023-07-27T14:27:00.805502+0000","last_became_peered":"2023-07-27T14:27:00.805502+0000","last_unstale":"2023-07-27T14:27:00.807427+0000","last_undegraded":"2023-07-27T14:27:00.807427+0000","last_fullsized":"2023-07-27T14:27:00.807427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296549+0000","last_change":"2023-07-27T14:27:01.289809+0000","last_active":"2023-07-27T14:27:01.296549+0000","last_peered":"2023-07-27T14:27:01.296549+0000","last_clean":"2023-07-27T14:27:01.296549+0000","last_became_active":"2023-07-27T14:27:01.289534+0000","last_became_peered":"2023-07-27T14:27:01.289534+0000","last_unstale":"2023-07-27T14:27:01.296549+0000","last_undegraded":"2023-07-27T14:27:01.296549+0000","last_fullsized":"2023-07-27T14:27:01.296549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284667+0000","last_change":"2023-07-27T14:27:00.807339+0000","last_active":"2023-07-27T14:27:01.284667+0000","last_peered":"2023-07-27T14:27:01.284667+0000","last_clean":"2023-07-27T14:27:01.284667+0000","last_became_active":"2023-07-27T14:27:00.806613+0000","last_became_peered":"2023-07-27T14:27:00.806613+0000","last_unstale":"2023-07-27T14:27:01.284667+0000","last_undegraded":"2023-07-27T14:27:01.284667+0000","last_fullsized":"2023-07-27T14:27:01.284667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":245760,"data_stored":80404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5156,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366684,"statfs":{"total":96636764160,"available":96631484416,"internally_reserved":0,"allocated":225280,"data_stored":80436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":217088,"data_stored":78990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7210000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7440000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.016}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":229376,"data_stored":85694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":233472,"data_stored":85764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366612,"statfs":{"total":96636764160,"available":96631410688,"internally_reserved":0,"allocated":233472,"data_stored":85784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5232,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366608,"statfs":{"total":96636764160,"available":96631406592,"internally_reserved":0,"allocated":237568,"data_stored":80582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":217088,"data_stored":78990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:27:05.550 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:27:05.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.755+0000 7f9fd73ff700 1 Processor -- start 2023-07-27T14:27:05.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.755+0000 7f9fd73ff700 1 -- start start 2023-07-27T14:27:05.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.756+0000 7f9fd73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd0153ec0 0x7f9fd00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.756+0000 7f9fd73ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9fd00aaa40 0x7f9fd00c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.756+0000 7f9fd73ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd00aa4d0 con 0x7f9fd00aa050 2023-07-27T14:27:05.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.756+0000 7f9fd73ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd00c05c0 con 0x7f9fd00aaa40 2023-07-27T14:27:05.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.756+0000 7f9fd73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd00bfc90 con 0x7f9fd0153ec0 2023-07-27T14:27:05.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.756+0000 7f9fd499a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9fd00aa050 0x7f9fd00640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38516/0 (socket says 172.21.15.115:38516) 2023-07-27T14:27:05.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.756+0000 7f9fd499a700 1 -- 172.21.15.115:0/3775478066 learned_addr learned my addr 172.21.15.115:0/3775478066 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:05.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.756+0000 7f9fd599c700 1 --2- 172.21.15.115:0/3775478066 >> v2:172.21.15.115:3300/0 conn(0x7f9fd00aaa40 0x7f9fd00c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fd519b700 1 --2- 172.21.15.115:0/3775478066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd0153ec0 0x7f9fd00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fc7fff700 1 -- 172.21.15.115:0/3775478066 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344292748 0 0) 0x7f9fc0001110 con 0x7f9fd00aa050 2023-07-27T14:27:05.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fc7fff700 1 -- 172.21.15.115:0/3775478066 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fbc0033f0 con 0x7f9fd00aa050 2023-07-27T14:27:05.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fd599c700 1 -- 172.21.15.115:0/3775478066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd0153ec0 msgr2=0x7f9fd00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:05.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fd599c700 1 --2- 172.21.15.115:0/3775478066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd0153ec0 0x7f9fd00a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fd599c700 1 -- 172.21.15.115:0/3775478066 >> v1:172.21.15.115:6789/0 conn(0x7f9fd00aa050 legacy=0x7f9fd00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fd599c700 1 -- 172.21.15.115:0/3775478066 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd00bff70 con 0x7f9fd00aaa40 2023-07-27T14:27:05.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fd599c700 1 --2- 172.21.15.115:0/3775478066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd00aaa40 0x7f9fd00c0a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f9fc8009760 tx=0x7f9fc8009060).ready entity=mon.0 client_cookie=595ebe7a50dd212e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:05.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fc7fff700 1 -- 172.21.15.115:0/3775478066 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800d4a0 con 0x7f9fd00aaa40 2023-07-27T14:27:05.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fc7fff700 1 -- 172.21.15.115:0/3775478066 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc800d600 con 0x7f9fd00aaa40 2023-07-27T14:27:05.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.757+0000 7f9fc7fff700 1 -- 172.21.15.115:0/3775478066 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800d980 con 0x7f9fd00aaa40 2023-07-27T14:27:05.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.758+0000 7f9fd73ff700 1 -- 172.21.15.115:0/3775478066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd00aaa40 msgr2=0x7f9fd00c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.758+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/3775478066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd00aaa40 0x7f9fd00c0a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f9fc8009760 tx=0x7f9fc8009060).stop 2023-07-27T14:27:05.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.758+0000 7f9fd73ff700 1 -- 172.21.15.115:0/3775478066 shutdown_connections 2023-07-27T14:27:05.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.758+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/3775478066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd0153ec0 0x7f9fd00a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.758+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/3775478066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd00aaa40 0x7f9fd00c0a50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.758+0000 7f9fd73ff700 1 -- 172.21.15.115:0/3775478066 >> 172.21.15.115:0/3775478066 conn(0x7f9fd00cb610 msgr2=0x7f9fd00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:05.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.758+0000 7f9fd73ff700 1 -- 172.21.15.115:0/3775478066 shutdown_connections 2023-07-27T14:27:05.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.758+0000 7f9fd73ff700 1 -- 172.21.15.115:0/3775478066 wait complete. 2023-07-27T14:27:05.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.760+0000 7f9fd73ff700 1 Processor -- start 2023-07-27T14:27:05.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.760+0000 7f9fd73ff700 1 -- start start 2023-07-27T14:27:05.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.761+0000 7f9fd73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd00aa050 0x7f9fd01682d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.761+0000 7f9fd73ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd00aaa40 0x7f9fd00acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.761+0000 7f9fd73ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd0153ec0 0x7f9fd0151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd73ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd01687c0 con 0x7f9fd0153ec0 2023-07-27T14:27:05.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd73ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0152f40 con 0x7f9fd00aaa40 2023-07-27T14:27:05.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0150b70 con 0x7f9fd00aa050 2023-07-27T14:27:05.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd0153ec0 0x7f9fd0151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd0153ec0 0x7f9fd0151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55606/0 (socket says 172.21.15.115:55606) 2023-07-27T14:27:05.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 -- 172.21.15.115:0/977896077 learned_addr learned my addr 172.21.15.115:0/977896077 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:05.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd519b700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd00aa050 0x7f9fd01682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd499a700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd00aaa40 0x7f9fd00acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 -- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd00aa050 msgr2=0x7f9fd01682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd00aa050 0x7f9fd01682d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 -- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd00aaa40 msgr2=0x7f9fd00acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd00aaa40 0x7f9fd00acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 -- 172.21.15.115:0/977896077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc80092a0 con 0x7f9fd0153ec0 2023-07-27T14:27:05.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd499a700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd00aaa40 0x7f9fd00acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:05.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fd599c700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd0153ec0 0x7f9fd0151650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9fd005fc60 tx=0x7f9fc8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:05.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.762+0000 7f9fc57fa700 1 -- 172.21.15.115:0/977896077 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800d770 con 0x7f9fd0153ec0 2023-07-27T14:27:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.763+0000 7f9fc57fa700 1 -- 172.21.15.115:0/977896077 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc800d8d0 con 0x7f9fd0153ec0 2023-07-27T14:27:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.763+0000 7f9fc57fa700 1 -- 172.21.15.115:0/977896077 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc801d640 con 0x7f9fd0153ec0 2023-07-27T14:27:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.763+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd0150e50 con 0x7f9fd0153ec0 2023-07-27T14:27:05.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.763+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd00ad260 con 0x7f9fd0153ec0 2023-07-27T14:27:05.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.764+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd01509d0 con 0x7f9fd0153ec0 2023-07-27T14:27:05.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.764+0000 7f9fc57fa700 1 -- 172.21.15.115:0/977896077 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9fc800f070 con 0x7f9fd0153ec0 2023-07-27T14:27:05.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.765+0000 7f9fc57fa700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fb405ed90 0x7f9fb4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:05.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.765+0000 7f9fc57fa700 1 -- 172.21.15.115:0/977896077 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9fc807b340 con 0x7f9fd0153ec0 2023-07-27T14:27:05.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.765+0000 7f9fd519b700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fb405ed90 0x7f9fb4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:05.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.766+0000 7f9fd519b700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fb405ed90 0x7f9fb4061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9fcc009fd0 tx=0x7f9fcc00b040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:05.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.769+0000 7f9fc57fa700 1 -- 172.21.15.115:0/977896077 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9fd01509d0 con 0x7f9fd0153ec0 2023-07-27T14:27:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.934+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fd01509d0 con 0x7f9fb405ed90 2023-07-27T14:27:05.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.943+0000 7f9fc57fa700 1 -- 172.21.15.115:0/977896077 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336318 (secure 0 0 0) 0x7f9fd01509d0 con 0x7f9fb405ed90 2023-07-27T14:27:05.960 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:05.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fb405ed90 msgr2=0x7f9fb4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fb405ed90 0x7f9fb4061250 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9fcc009fd0 tx=0x7f9fcc00b040).stop 2023-07-27T14:27:05.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd0153ec0 msgr2=0x7f9fd0151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:05.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd0153ec0 0x7f9fd0151650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9fd005fc60 tx=0x7f9fc8016000).stop 2023-07-27T14:27:05.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 shutdown_connections 2023-07-27T14:27:05.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fb405ed90 0x7f9fb4061250 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd0153ec0 0x7f9fd0151650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd00aa050 0x7f9fd01682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 --2- 172.21.15.115:0/977896077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd00aaa40 0x7f9fd00acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:05.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 >> 172.21.15.115:0/977896077 conn(0x7f9fd00cb610 msgr2=0x7f9fd00c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:05.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 shutdown_connections 2023-07-27T14:27:05.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:05.948+0000 7f9fd73ff700 1 -- 172.21.15.115:0/977896077 wait complete. 2023-07-27T14:27:05.964 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:27:05.979 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-07-27T14:27:05.437631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":270,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41476,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":39616,"kb_avail":754933244,"statfs":{"total":773094113280,"available":773051641856,"internally_reserved":0,"allocated":1839104,"data_stored":656644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40566784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284762+0000","last_change":"2023-07-27T14:27:01.270326+0000","last_active":"2023-07-27T14:27:01.284762+0000","last_peered":"2023-07-27T14:27:01.284762+0000","last_clean":"2023-07-27T14:27:01.284762+0000","last_became_active":"2023-07-27T14:27:01.270013+0000","last_became_peered":"2023-07-27T14:27:01.270013+0000","last_unstale":"2023-07-27T14:27:01.284762+0000","last_undegraded":"2023-07-27T14:27:01.284762+0000","last_fullsized":"2023-07-27T14:27:01.284762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.818798+0000","last_change":"2023-07-27T14:27:00.817070+0000","last_active":"2023-07-27T14:27:00.818798+0000","last_peered":"2023-07-27T14:27:00.818798+0000","last_clean":"2023-07-27T14:27:00.818798+0000","last_became_active":"2023-07-27T14:27:00.816729+0000","last_became_peered":"2023-07-27T14:27:00.816729+0000","last_unstale":"2023-07-27T14:27:00.818798+0000","last_undegraded":"2023-07-27T14:27:00.818798+0000","last_fullsized":"2023-07-27T14:27:00.818798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285407+0000","last_change":"2023-07-27T14:27:01.281932+0000","last_active":"2023-07-27T14:27:01.285407+0000","last_peered":"2023-07-27T14:27:01.285407+0000","last_clean":"2023-07-27T14:27:01.285407+0000","last_became_active":"2023-07-27T14:27:01.279991+0000","last_became_peered":"2023-07-27T14:27:01.279991+0000","last_unstale":"2023-07-27T14:27:01.285407+0000","last_undegraded":"2023-07-27T14:27:01.285407+0000","last_fullsized":"2023-07-27T14:27:01.285407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.818620+0000","last_change":"2023-07-27T14:27:00.816788+0000","last_active":"2023-07-27T14:27:00.818620+0000","last_peered":"2023-07-27T14:27:00.818620+0000","last_clean":"2023-07-27T14:27:00.818620+0000","last_became_active":"2023-07-27T14:27:00.816483+0000","last_became_peered":"2023-07-27T14:27:00.816483+0000","last_unstale":"2023-07-27T14:27:00.818620+0000","last_undegraded":"2023-07-27T14:27:00.818620+0000","last_fullsized":"2023-07-27T14:27:00.818620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283092+0000","last_change":"2023-07-27T14:27:01.283092+0000","last_active":"2023-07-27T14:27:01.283092+0000","last_peered":"2023-07-27T14:27:01.283092+0000","last_clean":"2023-07-27T14:27:01.283092+0000","last_became_active":"2023-07-27T14:27:01.281682+0000","last_became_peered":"2023-07-27T14:27:01.281682+0000","last_unstale":"2023-07-27T14:27:01.283092+0000","last_undegraded":"2023-07-27T14:27:01.283092+0000","last_fullsized":"2023-07-27T14:27:01.283092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.259837+0000","last_change":"2023-07-27T14:27:00.824445+0000","last_active":"2023-07-27T14:27:01.259837+0000","last_peered":"2023-07-27T14:27:01.259837+0000","last_clean":"2023-07-27T14:27:01.259837+0000","last_became_active":"2023-07-27T14:27:00.824146+0000","last_became_peered":"2023-07-27T14:27:00.824146+0000","last_unstale":"2023-07-27T14:27:01.259837+0000","last_undegraded":"2023-07-27T14:27:01.259837+0000","last_fullsized":"2023-07-27T14:27:01.259837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281942+0000","last_change":"2023-07-27T14:27:01.270550+0000","last_active":"2023-07-27T14:27:01.281942+0000","last_peered":"2023-07-27T14:27:01.281942+0000","last_clean":"2023-07-27T14:27:01.281942+0000","last_became_active":"2023-07-27T14:27:01.270242+0000","last_became_peered":"2023-07-27T14:27:01.270242+0000","last_unstale":"2023-07-27T14:27:01.281942+0000","last_undegraded":"2023-07-27T14:27:01.281942+0000","last_fullsized":"2023-07-27T14:27:01.281942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264077+0000","last_change":"2023-07-27T14:27:00.811927+0000","last_active":"2023-07-27T14:27:01.264077+0000","last_peered":"2023-07-27T14:27:01.264077+0000","last_clean":"2023-07-27T14:27:01.264077+0000","last_became_active":"2023-07-27T14:27:00.810673+0000","last_became_peered":"2023-07-27T14:27:00.810673+0000","last_unstale":"2023-07-27T14:27:01.264077+0000","last_undegraded":"2023-07-27T14:27:01.264077+0000","last_fullsized":"2023-07-27T14:27:01.264077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282015+0000","last_change":"2023-07-27T14:27:01.273486+0000","last_active":"2023-07-27T14:27:01.282015+0000","last_peered":"2023-07-27T14:27:01.282015+0000","last_clean":"2023-07-27T14:27:01.282015+0000","last_became_active":"2023-07-27T14:27:01.273227+0000","last_became_peered":"2023-07-27T14:27:01.273227+0000","last_unstale":"2023-07-27T14:27:01.282015+0000","last_undegraded":"2023-07-27T14:27:01.282015+0000","last_fullsized":"2023-07-27T14:27:01.282015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269519+0000","last_change":"2023-07-27T14:27:00.808357+0000","last_active":"2023-07-27T14:27:01.269519+0000","last_peered":"2023-07-27T14:27:01.269519+0000","last_clean":"2023-07-27T14:27:01.269519+0000","last_became_active":"2023-07-27T14:27:00.808008+0000","last_became_peered":"2023-07-27T14:27:00.808008+0000","last_unstale":"2023-07-27T14:27:01.269519+0000","last_undegraded":"2023-07-27T14:27:01.269519+0000","last_fullsized":"2023-07-27T14:27:01.269519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.272065+0000","last_change":"2023-07-27T14:27:01.272065+0000","last_active":"2023-07-27T14:27:01.272065+0000","last_peered":"2023-07-27T14:27:01.272065+0000","last_clean":"2023-07-27T14:27:01.272065+0000","last_became_active":"2023-07-27T14:27:01.270787+0000","last_became_peered":"2023-07-27T14:27:01.270787+0000","last_unstale":"2023-07-27T14:27:01.272065+0000","last_undegraded":"2023-07-27T14:27:01.272065+0000","last_fullsized":"2023-07-27T14:27:01.272065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287688+0000","last_change":"2023-07-27T14:27:00.823544+0000","last_active":"2023-07-27T14:27:01.287688+0000","last_peered":"2023-07-27T14:27:01.287688+0000","last_clean":"2023-07-27T14:27:01.287688+0000","last_became_active":"2023-07-27T14:27:00.823167+0000","last_became_peered":"2023-07-27T14:27:00.823167+0000","last_unstale":"2023-07-27T14:27:01.287688+0000","last_undegraded":"2023-07-27T14:27:01.287688+0000","last_fullsized":"2023-07-27T14:27:01.287688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290104+0000","last_change":"2023-07-27T14:27:01.290104+0000","last_active":"2023-07-27T14:27:01.290104+0000","last_peered":"2023-07-27T14:27:01.290104+0000","last_clean":"2023-07-27T14:27:01.290104+0000","last_became_active":"2023-07-27T14:27:01.289787+0000","last_became_peered":"2023-07-27T14:27:01.289787+0000","last_unstale":"2023-07-27T14:27:01.290104+0000","last_undegraded":"2023-07-27T14:27:01.290104+0000","last_fullsized":"2023-07-27T14:27:01.290104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293367+0000","last_change":"2023-07-27T14:27:00.818297+0000","last_active":"2023-07-27T14:27:01.293367+0000","last_peered":"2023-07-27T14:27:01.293367+0000","last_clean":"2023-07-27T14:27:01.293367+0000","last_became_active":"2023-07-27T14:27:00.817529+0000","last_became_peered":"2023-07-27T14:27:00.817529+0000","last_unstale":"2023-07-27T14:27:01.293367+0000","last_undegraded":"2023-07-27T14:27:01.293367+0000","last_fullsized":"2023-07-27T14:27:01.293367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286467+0000","last_change":"2023-07-27T14:27:01.270184+0000","last_active":"2023-07-27T14:27:01.286467+0000","last_peered":"2023-07-27T14:27:01.286467+0000","last_clean":"2023-07-27T14:27:01.286467+0000","last_became_active":"2023-07-27T14:27:01.269909+0000","last_became_peered":"2023-07-27T14:27:01.269909+0000","last_unstale":"2023-07-27T14:27:01.286467+0000","last_undegraded":"2023-07-27T14:27:01.286467+0000","last_fullsized":"2023-07-27T14:27:01.286467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264279+0000","last_change":"2023-07-27T14:27:00.822093+0000","last_active":"2023-07-27T14:27:01.264279+0000","last_peered":"2023-07-27T14:27:01.264279+0000","last_clean":"2023-07-27T14:27:01.264279+0000","last_became_active":"2023-07-27T14:27:00.821821+0000","last_became_peered":"2023-07-27T14:27:00.821821+0000","last_unstale":"2023-07-27T14:27:01.264279+0000","last_undegraded":"2023-07-27T14:27:01.264279+0000","last_fullsized":"2023-07-27T14:27:01.264279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296579+0000","last_change":"2023-07-27T14:27:01.289067+0000","last_active":"2023-07-27T14:27:01.296579+0000","last_peered":"2023-07-27T14:27:01.296579+0000","last_clean":"2023-07-27T14:27:01.296579+0000","last_became_active":"2023-07-27T14:27:01.288634+0000","last_became_peered":"2023-07-27T14:27:01.288634+0000","last_unstale":"2023-07-27T14:27:01.296579+0000","last_undegraded":"2023-07-27T14:27:01.296579+0000","last_fullsized":"2023-07-27T14:27:01.296579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265111+0000","last_change":"2023-07-27T14:27:00.805268+0000","last_active":"2023-07-27T14:27:01.265111+0000","last_peered":"2023-07-27T14:27:01.265111+0000","last_clean":"2023-07-27T14:27:01.265111+0000","last_became_active":"2023-07-27T14:27:00.804950+0000","last_became_peered":"2023-07-27T14:27:00.804950+0000","last_unstale":"2023-07-27T14:27:01.265111+0000","last_undegraded":"2023-07-27T14:27:01.265111+0000","last_fullsized":"2023-07-27T14:27:01.265111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284549+0000","last_change":"2023-07-27T14:27:01.281253+0000","last_active":"2023-07-27T14:27:01.284549+0000","last_peered":"2023-07-27T14:27:01.284549+0000","last_clean":"2023-07-27T14:27:01.284549+0000","last_became_active":"2023-07-27T14:27:01.280227+0000","last_became_peered":"2023-07-27T14:27:01.280227+0000","last_unstale":"2023-07-27T14:27:01.284549+0000","last_undegraded":"2023-07-27T14:27:01.284549+0000","last_fullsized":"2023-07-27T14:27:01.284549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.823815+0000","last_change":"2023-07-27T14:27:00.817281+0000","last_active":"2023-07-27T14:27:00.823815+0000","last_peered":"2023-07-27T14:27:00.823815+0000","last_clean":"2023-07-27T14:27:00.823815+0000","last_became_active":"2023-07-27T14:27:00.817008+0000","last_became_peered":"2023-07-27T14:27:00.817008+0000","last_unstale":"2023-07-27T14:27:00.823815+0000","last_undegraded":"2023-07-27T14:27:00.823815+0000","last_fullsized":"2023-07-27T14:27:00.823815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286934+0000","last_change":"2023-07-27T14:27:01.281135+0000","last_active":"2023-07-27T14:27:01.286934+0000","last_peered":"2023-07-27T14:27:01.286934+0000","last_clean":"2023-07-27T14:27:01.286934+0000","last_became_active":"2023-07-27T14:27:01.280869+0000","last_became_peered":"2023-07-27T14:27:01.280869+0000","last_unstale":"2023-07-27T14:27:01.286934+0000","last_undegraded":"2023-07-27T14:27:01.286934+0000","last_fullsized":"2023-07-27T14:27:01.286934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283625+0000","last_change":"2023-07-27T14:27:00.810416+0000","last_active":"2023-07-27T14:27:01.283625+0000","last_peered":"2023-07-27T14:27:01.283625+0000","last_clean":"2023-07-27T14:27:01.283625+0000","last_became_active":"2023-07-27T14:27:00.809422+0000","last_became_peered":"2023-07-27T14:27:00.809422+0000","last_unstale":"2023-07-27T14:27:01.283625+0000","last_undegraded":"2023-07-27T14:27:01.283625+0000","last_fullsized":"2023-07-27T14:27:01.283625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.291617+0000","last_change":"2023-07-27T14:27:01.286563+0000","last_active":"2023-07-27T14:27:01.291617+0000","last_peered":"2023-07-27T14:27:01.291617+0000","last_clean":"2023-07-27T14:27:01.291617+0000","last_became_active":"2023-07-27T14:27:01.285925+0000","last_became_peered":"2023-07-27T14:27:01.285925+0000","last_unstale":"2023-07-27T14:27:01.291617+0000","last_undegraded":"2023-07-27T14:27:01.291617+0000","last_fullsized":"2023-07-27T14:27:01.291617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.262173+0000","last_change":"2023-07-27T14:27:00.819013+0000","last_active":"2023-07-27T14:27:01.262173+0000","last_peered":"2023-07-27T14:27:01.262173+0000","last_clean":"2023-07-27T14:27:01.262173+0000","last_became_active":"2023-07-27T14:27:00.818612+0000","last_became_peered":"2023-07-27T14:27:00.818612+0000","last_unstale":"2023-07-27T14:27:01.262173+0000","last_undegraded":"2023-07-27T14:27:01.262173+0000","last_fullsized":"2023-07-27T14:27:01.262173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294061+0000","last_change":"2023-07-27T14:27:01.294061+0000","last_active":"2023-07-27T14:27:01.294061+0000","last_peered":"2023-07-27T14:27:01.294061+0000","last_clean":"2023-07-27T14:27:01.294061+0000","last_became_active":"2023-07-27T14:27:01.293437+0000","last_became_peered":"2023-07-27T14:27:01.293437+0000","last_unstale":"2023-07-27T14:27:01.294061+0000","last_undegraded":"2023-07-27T14:27:01.294061+0000","last_fullsized":"2023-07-27T14:27:01.294061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295572+0000","last_change":"2023-07-27T14:27:00.819217+0000","last_active":"2023-07-27T14:27:01.295572+0000","last_peered":"2023-07-27T14:27:01.295572+0000","last_clean":"2023-07-27T14:27:01.295572+0000","last_became_active":"2023-07-27T14:27:00.818691+0000","last_became_peered":"2023-07-27T14:27:00.818691+0000","last_unstale":"2023-07-27T14:27:01.295572+0000","last_undegraded":"2023-07-27T14:27:01.295572+0000","last_fullsized":"2023-07-27T14:27:01.295572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270147+0000","last_change":"2023-07-27T14:27:01.270147+0000","last_active":"2023-07-27T14:27:01.270147+0000","last_peered":"2023-07-27T14:27:01.270147+0000","last_clean":"2023-07-27T14:27:01.270147+0000","last_became_active":"2023-07-27T14:27:01.269862+0000","last_became_peered":"2023-07-27T14:27:01.269862+0000","last_unstale":"2023-07-27T14:27:01.270147+0000","last_undegraded":"2023-07-27T14:27:01.270147+0000","last_fullsized":"2023-07-27T14:27:01.270147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.815874+0000","last_change":"2023-07-27T14:27:00.812553+0000","last_active":"2023-07-27T14:27:00.815874+0000","last_peered":"2023-07-27T14:27:00.815874+0000","last_clean":"2023-07-27T14:27:00.815874+0000","last_became_active":"2023-07-27T14:27:00.812263+0000","last_became_peered":"2023-07-27T14:27:00.812263+0000","last_unstale":"2023-07-27T14:27:00.815874+0000","last_undegraded":"2023-07-27T14:27:00.815874+0000","last_fullsized":"2023-07-27T14:27:00.815874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284961+0000","last_change":"2023-07-27T14:27:01.280658+0000","last_active":"2023-07-27T14:27:01.284961+0000","last_peered":"2023-07-27T14:27:01.284961+0000","last_clean":"2023-07-27T14:27:01.284961+0000","last_became_active":"2023-07-27T14:27:01.279608+0000","last_became_peered":"2023-07-27T14:27:01.279608+0000","last_unstale":"2023-07-27T14:27:01.284961+0000","last_undegraded":"2023-07-27T14:27:01.284961+0000","last_fullsized":"2023-07-27T14:27:01.284961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268276+0000","last_change":"2023-07-27T14:27:00.821769+0000","last_active":"2023-07-27T14:27:01.268276+0000","last_peered":"2023-07-27T14:27:01.268276+0000","last_clean":"2023-07-27T14:27:01.268276+0000","last_became_active":"2023-07-27T14:27:00.820693+0000","last_became_peered":"2023-07-27T14:27:00.820693+0000","last_unstale":"2023-07-27T14:27:01.268276+0000","last_undegraded":"2023-07-27T14:27:01.268276+0000","last_fullsized":"2023-07-27T14:27:01.268276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290729+0000","last_change":"2023-07-27T14:27:01.290729+0000","last_active":"2023-07-27T14:27:01.290729+0000","last_peered":"2023-07-27T14:27:01.290729+0000","last_clean":"2023-07-27T14:27:01.290729+0000","last_became_active":"2023-07-27T14:27:01.290315+0000","last_became_peered":"2023-07-27T14:27:01.290315+0000","last_unstale":"2023-07-27T14:27:01.290729+0000","last_undegraded":"2023-07-27T14:27:01.290729+0000","last_fullsized":"2023-07-27T14:27:01.290729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284546+0000","last_change":"2023-07-27T14:27:00.815996+0000","last_active":"2023-07-27T14:27:01.284546+0000","last_peered":"2023-07-27T14:27:01.284546+0000","last_clean":"2023-07-27T14:27:01.284546+0000","last_became_active":"2023-07-27T14:27:00.815664+0000","last_became_peered":"2023-07-27T14:27:00.815664+0000","last_unstale":"2023-07-27T14:27:01.284546+0000","last_undegraded":"2023-07-27T14:27:01.284546+0000","last_fullsized":"2023-07-27T14:27:01.284546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288903+0000","last_change":"2023-07-27T14:27:01.288903+0000","last_active":"2023-07-27T14:27:01.288903+0000","last_peered":"2023-07-27T14:27:01.288903+0000","last_clean":"2023-07-27T14:27:01.288903+0000","last_became_active":"2023-07-27T14:27:01.288173+0000","last_became_peered":"2023-07-27T14:27:01.288173+0000","last_unstale":"2023-07-27T14:27:01.288903+0000","last_undegraded":"2023-07-27T14:27:01.288903+0000","last_fullsized":"2023-07-27T14:27:01.288903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.819380+0000","last_change":"2023-07-27T14:27:00.817983+0000","last_active":"2023-07-27T14:27:00.819380+0000","last_peered":"2023-07-27T14:27:00.819380+0000","last_clean":"2023-07-27T14:27:00.819380+0000","last_became_active":"2023-07-27T14:27:00.817662+0000","last_became_peered":"2023-07-27T14:27:00.817662+0000","last_unstale":"2023-07-27T14:27:00.819380+0000","last_undegraded":"2023-07-27T14:27:00.819380+0000","last_fullsized":"2023-07-27T14:27:00.819380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294765+0000","last_change":"2023-07-27T14:27:01.294765+0000","last_active":"2023-07-27T14:27:01.294765+0000","last_peered":"2023-07-27T14:27:01.294765+0000","last_clean":"2023-07-27T14:27:01.294765+0000","last_became_active":"2023-07-27T14:27:01.294406+0000","last_became_peered":"2023-07-27T14:27:01.294406+0000","last_unstale":"2023-07-27T14:27:01.294765+0000","last_undegraded":"2023-07-27T14:27:01.294765+0000","last_fullsized":"2023-07-27T14:27:01.294765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.824528+0000","last_change":"2023-07-27T14:27:00.820810+0000","last_active":"2023-07-27T14:27:00.824528+0000","last_peered":"2023-07-27T14:27:00.824528+0000","last_clean":"2023-07-27T14:27:00.824528+0000","last_became_active":"2023-07-27T14:27:00.820044+0000","last_became_peered":"2023-07-27T14:27:00.820044+0000","last_unstale":"2023-07-27T14:27:00.824528+0000","last_undegraded":"2023-07-27T14:27:00.824528+0000","last_fullsized":"2023-07-27T14:27:00.824528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.275611+0000","last_change":"2023-07-27T14:27:01.275611+0000","last_active":"2023-07-27T14:27:01.275611+0000","last_peered":"2023-07-27T14:27:01.275611+0000","last_clean":"2023-07-27T14:27:01.275611+0000","last_became_active":"2023-07-27T14:27:01.275350+0000","last_became_peered":"2023-07-27T14:27:01.275350+0000","last_unstale":"2023-07-27T14:27:01.275611+0000","last_undegraded":"2023-07-27T14:27:01.275611+0000","last_fullsized":"2023-07-27T14:27:01.275611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260311+0000","last_change":"2023-07-27T14:27:00.818518+0000","last_active":"2023-07-27T14:27:01.260311+0000","last_peered":"2023-07-27T14:27:01.260311+0000","last_clean":"2023-07-27T14:27:01.260311+0000","last_became_active":"2023-07-27T14:27:00.818212+0000","last_became_peered":"2023-07-27T14:27:00.818212+0000","last_unstale":"2023-07-27T14:27:01.260311+0000","last_undegraded":"2023-07-27T14:27:01.260311+0000","last_fullsized":"2023-07-27T14:27:01.260311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.791767+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:27:00.791767+0000","last_peered":"2023-07-27T14:27:00.791767+0000","last_clean":"2023-07-27T14:27:00.791767+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:27:00.791767+0000","last_undegraded":"2023-07-27T14:27:00.791767+0000","last_fullsized":"2023-07-27T14:27:00.791767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269206+0000","last_change":"2023-07-27T14:27:00.821466+0000","last_active":"2023-07-27T14:27:01.269206+0000","last_peered":"2023-07-27T14:27:01.269206+0000","last_clean":"2023-07-27T14:27:01.269206+0000","last_became_active":"2023-07-27T14:27:00.820503+0000","last_became_peered":"2023-07-27T14:27:00.820503+0000","last_unstale":"2023-07-27T14:27:01.269206+0000","last_undegraded":"2023-07-27T14:27:01.269206+0000","last_fullsized":"2023-07-27T14:27:01.269206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281635+0000","last_change":"2023-07-27T14:27:01.281635+0000","last_active":"2023-07-27T14:27:01.281635+0000","last_peered":"2023-07-27T14:27:01.281635+0000","last_clean":"2023-07-27T14:27:01.281635+0000","last_became_active":"2023-07-27T14:27:01.281373+0000","last_became_peered":"2023-07-27T14:27:01.281373+0000","last_unstale":"2023-07-27T14:27:01.281635+0000","last_undegraded":"2023-07-27T14:27:01.281635+0000","last_fullsized":"2023-07-27T14:27:01.281635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270038+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:27:01.270038+0000","last_peered":"2023-07-27T14:27:01.270038+0000","last_clean":"2023-07-27T14:27:01.270038+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:27:01.270038+0000","last_undegraded":"2023-07-27T14:27:01.270038+0000","last_fullsized":"2023-07-27T14:27:01.270038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.827844+0000","last_change":"2023-07-27T14:27:00.824620+0000","last_active":"2023-07-27T14:27:00.827844+0000","last_peered":"2023-07-27T14:27:00.827844+0000","last_clean":"2023-07-27T14:27:00.827844+0000","last_became_active":"2023-07-27T14:27:00.824324+0000","last_became_peered":"2023-07-27T14:27:00.824324+0000","last_unstale":"2023-07-27T14:27:00.827844+0000","last_undegraded":"2023-07-27T14:27:00.827844+0000","last_fullsized":"2023-07-27T14:27:00.827844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.275718+0000","last_change":"2023-07-27T14:27:01.275718+0000","last_active":"2023-07-27T14:27:01.275718+0000","last_peered":"2023-07-27T14:27:01.275718+0000","last_clean":"2023-07-27T14:27:01.275718+0000","last_became_active":"2023-07-27T14:27:01.275463+0000","last_became_peered":"2023-07-27T14:27:01.275463+0000","last_unstale":"2023-07-27T14:27:01.275718+0000","last_undegraded":"2023-07-27T14:27:01.275718+0000","last_fullsized":"2023-07-27T14:27:01.275718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282173+0000","last_change":"2023-07-27T14:27:01.282173+0000","last_active":"2023-07-27T14:27:01.282173+0000","last_peered":"2023-07-27T14:27:01.282173+0000","last_clean":"2023-07-27T14:27:01.282173+0000","last_became_active":"2023-07-27T14:27:01.281870+0000","last_became_peered":"2023-07-27T14:27:01.281870+0000","last_unstale":"2023-07-27T14:27:01.282173+0000","last_undegraded":"2023-07-27T14:27:01.282173+0000","last_fullsized":"2023-07-27T14:27:01.282173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270296+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:27:01.270296+0000","last_peered":"2023-07-27T14:27:01.270296+0000","last_clean":"2023-07-27T14:27:01.270296+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:27:01.270296+0000","last_undegraded":"2023-07-27T14:27:01.270296+0000","last_fullsized":"2023-07-27T14:27:01.270296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.814490+0000","last_change":"2023-07-27T14:27:00.806662+0000","last_active":"2023-07-27T14:27:00.814490+0000","last_peered":"2023-07-27T14:27:00.814490+0000","last_clean":"2023-07-27T14:27:00.814490+0000","last_became_active":"2023-07-27T14:27:00.806332+0000","last_became_peered":"2023-07-27T14:27:00.806332+0000","last_unstale":"2023-07-27T14:27:00.814490+0000","last_undegraded":"2023-07-27T14:27:00.814490+0000","last_fullsized":"2023-07-27T14:27:00.814490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294577+0000","last_change":"2023-07-27T14:27:01.294577+0000","last_active":"2023-07-27T14:27:01.294577+0000","last_peered":"2023-07-27T14:27:01.294577+0000","last_clean":"2023-07-27T14:27:01.294577+0000","last_became_active":"2023-07-27T14:27:01.294285+0000","last_became_peered":"2023-07-27T14:27:01.294285+0000","last_unstale":"2023-07-27T14:27:01.294577+0000","last_undegraded":"2023-07-27T14:27:01.294577+0000","last_fullsized":"2023-07-27T14:27:01.294577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268394+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:27:01.268394+0000","last_peered":"2023-07-27T14:27:01.268394+0000","last_clean":"2023-07-27T14:27:01.268394+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:27:01.268394+0000","last_undegraded":"2023-07-27T14:27:01.268394+0000","last_fullsized":"2023-07-27T14:27:01.268394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.798083+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:27:00.798083+0000","last_peered":"2023-07-27T14:27:00.798083+0000","last_clean":"2023-07-27T14:27:00.798083+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:27:00.798083+0000","last_undegraded":"2023-07-27T14:27:00.798083+0000","last_fullsized":"2023-07-27T14:27:00.798083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260911+0000","last_change":"2023-07-27T14:27:00.820288+0000","last_active":"2023-07-27T14:27:01.260911+0000","last_peered":"2023-07-27T14:27:01.260911+0000","last_clean":"2023-07-27T14:27:01.260911+0000","last_became_active":"2023-07-27T14:27:00.818566+0000","last_became_peered":"2023-07-27T14:27:00.818566+0000","last_unstale":"2023-07-27T14:27:01.260911+0000","last_undegraded":"2023-07-27T14:27:01.260911+0000","last_fullsized":"2023-07-27T14:27:01.260911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285387+0000","last_change":"2023-07-27T14:27:01.281461+0000","last_active":"2023-07-27T14:27:01.285387+0000","last_peered":"2023-07-27T14:27:01.285387+0000","last_clean":"2023-07-27T14:27:01.285387+0000","last_became_active":"2023-07-27T14:27:01.280500+0000","last_became_peered":"2023-07-27T14:27:01.280500+0000","last_unstale":"2023-07-27T14:27:01.285387+0000","last_undegraded":"2023-07-27T14:27:01.285387+0000","last_fullsized":"2023-07-27T14:27:01.285387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.798184+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:27:00.798184+0000","last_peered":"2023-07-27T14:27:00.798184+0000","last_clean":"2023-07-27T14:27:00.798184+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:27:00.798184+0000","last_undegraded":"2023-07-27T14:27:00.798184+0000","last_fullsized":"2023-07-27T14:27:00.798184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265806+0000","last_change":"2023-07-27T14:27:00.821693+0000","last_active":"2023-07-27T14:27:01.265806+0000","last_peered":"2023-07-27T14:27:01.265806+0000","last_clean":"2023-07-27T14:27:01.265806+0000","last_became_active":"2023-07-27T14:27:00.821333+0000","last_became_peered":"2023-07-27T14:27:00.821333+0000","last_unstale":"2023-07-27T14:27:01.265806+0000","last_undegraded":"2023-07-27T14:27:01.265806+0000","last_fullsized":"2023-07-27T14:27:01.265806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.798461+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:27:00.798461+0000","last_peered":"2023-07-27T14:27:00.798461+0000","last_clean":"2023-07-27T14:27:00.798461+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:27:00.798461+0000","last_undegraded":"2023-07-27T14:27:00.798461+0000","last_fullsized":"2023-07-27T14:27:00.798461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.806843+0000","last_change":"2023-07-27T14:27:00.803181+0000","last_active":"2023-07-27T14:27:00.806843+0000","last_peered":"2023-07-27T14:27:00.806843+0000","last_clean":"2023-07-27T14:27:00.806843+0000","last_became_active":"2023-07-27T14:27:00.802812+0000","last_became_peered":"2023-07-27T14:27:00.802812+0000","last_unstale":"2023-07-27T14:27:00.806843+0000","last_undegraded":"2023-07-27T14:27:00.806843+0000","last_fullsized":"2023-07-27T14:27:00.806843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287297+0000","last_change":"2023-07-27T14:27:01.285120+0000","last_active":"2023-07-27T14:27:01.287297+0000","last_peered":"2023-07-27T14:27:01.287297+0000","last_clean":"2023-07-27T14:27:01.287297+0000","last_became_active":"2023-07-27T14:27:01.284758+0000","last_became_peered":"2023-07-27T14:27:01.284758+0000","last_unstale":"2023-07-27T14:27:01.287297+0000","last_undegraded":"2023-07-27T14:27:01.287297+0000","last_fullsized":"2023-07-27T14:27:01.287297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288456+0000","last_change":"2023-07-27T14:27:00.822951+0000","last_active":"2023-07-27T14:27:01.288456+0000","last_peered":"2023-07-27T14:27:01.288456+0000","last_clean":"2023-07-27T14:27:01.288456+0000","last_became_active":"2023-07-27T14:27:00.822642+0000","last_became_peered":"2023-07-27T14:27:00.822642+0000","last_unstale":"2023-07-27T14:27:01.288456+0000","last_undegraded":"2023-07-27T14:27:01.288456+0000","last_fullsized":"2023-07-27T14:27:01.288456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.790773+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:27:00.790773+0000","last_peered":"2023-07-27T14:27:00.790773+0000","last_clean":"2023-07-27T14:27:00.790773+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:27:00.790773+0000","last_undegraded":"2023-07-27T14:27:00.790773+0000","last_fullsized":"2023-07-27T14:27:00.790773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281966+0000","last_change":"2023-07-27T14:27:01.274025+0000","last_active":"2023-07-27T14:27:01.281966+0000","last_peered":"2023-07-27T14:27:01.281966+0000","last_clean":"2023-07-27T14:27:01.281966+0000","last_became_active":"2023-07-27T14:27:01.273760+0000","last_became_peered":"2023-07-27T14:27:01.273760+0000","last_unstale":"2023-07-27T14:27:01.281966+0000","last_undegraded":"2023-07-27T14:27:01.281966+0000","last_fullsized":"2023-07-27T14:27:01.281966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.793374+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:27:00.793374+0000","last_peered":"2023-07-27T14:27:00.793374+0000","last_clean":"2023-07-27T14:27:00.793374+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:27:00.793374+0000","last_undegraded":"2023-07-27T14:27:00.793374+0000","last_fullsized":"2023-07-27T14:27:00.793374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.266294+0000","last_change":"2023-07-27T14:27:00.809142+0000","last_active":"2023-07-27T14:27:01.266294+0000","last_peered":"2023-07-27T14:27:01.266294+0000","last_clean":"2023-07-27T14:27:01.266294+0000","last_became_active":"2023-07-27T14:27:00.808822+0000","last_became_peered":"2023-07-27T14:27:00.808822+0000","last_unstale":"2023-07-27T14:27:01.266294+0000","last_undegraded":"2023-07-27T14:27:01.266294+0000","last_fullsized":"2023-07-27T14:27:01.266294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293162+0000","last_change":"2023-07-27T14:27:01.293162+0000","last_active":"2023-07-27T14:27:01.293162+0000","last_peered":"2023-07-27T14:27:01.293162+0000","last_clean":"2023-07-27T14:27:01.293162+0000","last_became_active":"2023-07-27T14:27:01.292764+0000","last_became_peered":"2023-07-27T14:27:01.292764+0000","last_unstale":"2023-07-27T14:27:01.293162+0000","last_undegraded":"2023-07-27T14:27:01.293162+0000","last_fullsized":"2023-07-27T14:27:01.293162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286788+0000","last_change":"2023-07-27T14:27:01.278950+0000","last_active":"2023-07-27T14:27:01.286788+0000","last_peered":"2023-07-27T14:27:01.286788+0000","last_clean":"2023-07-27T14:27:01.286788+0000","last_became_active":"2023-07-27T14:27:01.278643+0000","last_became_peered":"2023-07-27T14:27:01.278643+0000","last_unstale":"2023-07-27T14:27:01.286788+0000","last_undegraded":"2023-07-27T14:27:01.286788+0000","last_fullsized":"2023-07-27T14:27:01.286788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265962+0000","last_change":"2023-07-27T14:27:00.820665+0000","last_active":"2023-07-27T14:27:01.265962+0000","last_peered":"2023-07-27T14:27:01.265962+0000","last_clean":"2023-07-27T14:27:01.265962+0000","last_became_active":"2023-07-27T14:27:00.820385+0000","last_became_peered":"2023-07-27T14:27:00.820385+0000","last_unstale":"2023-07-27T14:27:01.265962+0000","last_undegraded":"2023-07-27T14:27:01.265962+0000","last_fullsized":"2023-07-27T14:27:01.265962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293370+0000","last_change":"2023-07-27T14:27:01.293370+0000","last_active":"2023-07-27T14:27:01.293370+0000","last_peered":"2023-07-27T14:27:01.293370+0000","last_clean":"2023-07-27T14:27:01.293370+0000","last_became_active":"2023-07-27T14:27:01.293073+0000","last_became_peered":"2023-07-27T14:27:01.293073+0000","last_unstale":"2023-07-27T14:27:01.293370+0000","last_undegraded":"2023-07-27T14:27:01.293370+0000","last_fullsized":"2023-07-27T14:27:01.293370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268393+0000","last_change":"2023-07-27T14:27:00.821425+0000","last_active":"2023-07-27T14:27:01.268393+0000","last_peered":"2023-07-27T14:27:01.268393+0000","last_clean":"2023-07-27T14:27:01.268393+0000","last_became_active":"2023-07-27T14:27:00.820969+0000","last_became_peered":"2023-07-27T14:27:00.820969+0000","last_unstale":"2023-07-27T14:27:01.268393+0000","last_undegraded":"2023-07-27T14:27:01.268393+0000","last_fullsized":"2023-07-27T14:27:01.268393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293918+0000","last_change":"2023-07-27T14:27:01.293918+0000","last_active":"2023-07-27T14:27:01.293918+0000","last_peered":"2023-07-27T14:27:01.293918+0000","last_clean":"2023-07-27T14:27:01.293918+0000","last_became_active":"2023-07-27T14:27:01.293535+0000","last_became_peered":"2023-07-27T14:27:01.293535+0000","last_unstale":"2023-07-27T14:27:01.293918+0000","last_undegraded":"2023-07-27T14:27:01.293918+0000","last_fullsized":"2023-07-27T14:27:01.293918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295160+0000","last_change":"2023-07-27T14:27:00.821100+0000","last_active":"2023-07-27T14:27:01.295160+0000","last_peered":"2023-07-27T14:27:01.295160+0000","last_clean":"2023-07-27T14:27:01.295160+0000","last_became_active":"2023-07-27T14:27:00.820834+0000","last_became_peered":"2023-07-27T14:27:00.820834+0000","last_unstale":"2023-07-27T14:27:01.295160+0000","last_undegraded":"2023-07-27T14:27:01.295160+0000","last_fullsized":"2023-07-27T14:27:01.295160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282491+0000","last_change":"2023-07-27T14:27:01.279306+0000","last_active":"2023-07-27T14:27:01.282491+0000","last_peered":"2023-07-27T14:27:01.282491+0000","last_clean":"2023-07-27T14:27:01.282491+0000","last_became_active":"2023-07-27T14:27:01.279053+0000","last_became_peered":"2023-07-27T14:27:01.279053+0000","last_unstale":"2023-07-27T14:27:01.282491+0000","last_undegraded":"2023-07-27T14:27:01.282491+0000","last_fullsized":"2023-07-27T14:27:01.282491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282641+0000","last_change":"2023-07-27T14:27:00.821978+0000","last_active":"2023-07-27T14:27:01.282641+0000","last_peered":"2023-07-27T14:27:01.282641+0000","last_clean":"2023-07-27T14:27:01.282641+0000","last_became_active":"2023-07-27T14:27:00.821626+0000","last_became_peered":"2023-07-27T14:27:00.821626+0000","last_unstale":"2023-07-27T14:27:01.282641+0000","last_undegraded":"2023-07-27T14:27:01.282641+0000","last_fullsized":"2023-07-27T14:27:01.282641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289940+0000","last_change":"2023-07-27T14:27:01.289940+0000","last_active":"2023-07-27T14:27:01.289940+0000","last_peered":"2023-07-27T14:27:01.289940+0000","last_clean":"2023-07-27T14:27:01.289940+0000","last_became_active":"2023-07-27T14:27:01.289604+0000","last_became_peered":"2023-07-27T14:27:01.289604+0000","last_unstale":"2023-07-27T14:27:01.289940+0000","last_undegraded":"2023-07-27T14:27:01.289940+0000","last_fullsized":"2023-07-27T14:27:01.289940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282827+0000","last_change":"2023-07-27T14:27:00.811768+0000","last_active":"2023-07-27T14:27:01.282827+0000","last_peered":"2023-07-27T14:27:01.282827+0000","last_clean":"2023-07-27T14:27:01.282827+0000","last_became_active":"2023-07-27T14:27:00.811467+0000","last_became_peered":"2023-07-27T14:27:00.811467+0000","last_unstale":"2023-07-27T14:27:01.282827+0000","last_undegraded":"2023-07-27T14:27:01.282827+0000","last_fullsized":"2023-07-27T14:27:01.282827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.271866+0000","last_change":"2023-07-27T14:27:01.271866+0000","last_active":"2023-07-27T14:27:01.271866+0000","last_peered":"2023-07-27T14:27:01.271866+0000","last_clean":"2023-07-27T14:27:01.271866+0000","last_became_active":"2023-07-27T14:27:01.271572+0000","last_became_peered":"2023-07-27T14:27:01.271572+0000","last_unstale":"2023-07-27T14:27:01.271866+0000","last_undegraded":"2023-07-27T14:27:01.271866+0000","last_fullsized":"2023-07-27T14:27:01.271866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.812354+0000","last_change":"2023-07-27T14:27:00.809399+0000","last_active":"2023-07-27T14:27:00.812354+0000","last_peered":"2023-07-27T14:27:00.812354+0000","last_clean":"2023-07-27T14:27:00.812354+0000","last_became_active":"2023-07-27T14:27:00.809047+0000","last_became_peered":"2023-07-27T14:27:00.809047+0000","last_unstale":"2023-07-27T14:27:00.812354+0000","last_undegraded":"2023-07-27T14:27:00.812354+0000","last_fullsized":"2023-07-27T14:27:00.812354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.277061+0000","last_change":"2023-07-27T14:27:01.277061+0000","last_active":"2023-07-27T14:27:01.277061+0000","last_peered":"2023-07-27T14:27:01.277061+0000","last_clean":"2023-07-27T14:27:01.277061+0000","last_became_active":"2023-07-27T14:27:01.276810+0000","last_became_peered":"2023-07-27T14:27:01.276810+0000","last_unstale":"2023-07-27T14:27:01.277061+0000","last_undegraded":"2023-07-27T14:27:01.277061+0000","last_fullsized":"2023-07-27T14:27:01.277061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270326+0000","last_change":"2023-07-27T14:27:00.810515+0000","last_active":"2023-07-27T14:27:01.270326+0000","last_peered":"2023-07-27T14:27:01.270326+0000","last_clean":"2023-07-27T14:27:01.270326+0000","last_became_active":"2023-07-27T14:27:00.810250+0000","last_became_peered":"2023-07-27T14:27:00.810250+0000","last_unstale":"2023-07-27T14:27:01.270326+0000","last_undegraded":"2023-07-27T14:27:01.270326+0000","last_fullsized":"2023-07-27T14:27:01.270326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296559+0000","last_change":"2023-07-27T14:27:01.288902+0000","last_active":"2023-07-27T14:27:01.296559+0000","last_peered":"2023-07-27T14:27:01.296559+0000","last_clean":"2023-07-27T14:27:01.296559+0000","last_became_active":"2023-07-27T14:27:01.288298+0000","last_became_peered":"2023-07-27T14:27:01.288298+0000","last_unstale":"2023-07-27T14:27:01.296559+0000","last_undegraded":"2023-07-27T14:27:01.296559+0000","last_fullsized":"2023-07-27T14:27:01.296559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270140+0000","last_change":"2023-07-27T14:27:00.821272+0000","last_active":"2023-07-27T14:27:01.270140+0000","last_peered":"2023-07-27T14:27:01.270140+0000","last_clean":"2023-07-27T14:27:01.270140+0000","last_became_active":"2023-07-27T14:27:00.820947+0000","last_became_peered":"2023-07-27T14:27:00.820947+0000","last_unstale":"2023-07-27T14:27:01.270140+0000","last_undegraded":"2023-07-27T14:27:01.270140+0000","last_fullsized":"2023-07-27T14:27:01.270140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.273588+0000","last_change":"2023-07-27T14:27:01.273588+0000","last_active":"2023-07-27T14:27:01.273588+0000","last_peered":"2023-07-27T14:27:01.273588+0000","last_clean":"2023-07-27T14:27:01.273588+0000","last_became_active":"2023-07-27T14:27:01.273352+0000","last_became_peered":"2023-07-27T14:27:01.273352+0000","last_unstale":"2023-07-27T14:27:01.273588+0000","last_undegraded":"2023-07-27T14:27:01.273588+0000","last_fullsized":"2023-07-27T14:27:01.273588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265785+0000","last_change":"2023-07-27T14:27:00.820075+0000","last_active":"2023-07-27T14:27:01.265785+0000","last_peered":"2023-07-27T14:27:01.265785+0000","last_clean":"2023-07-27T14:27:01.265785+0000","last_became_active":"2023-07-27T14:27:00.819794+0000","last_became_peered":"2023-07-27T14:27:00.819794+0000","last_unstale":"2023-07-27T14:27:01.265785+0000","last_undegraded":"2023-07-27T14:27:01.265785+0000","last_fullsized":"2023-07-27T14:27:01.265785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283080+0000","last_change":"2023-07-27T14:27:01.280882+0000","last_active":"2023-07-27T14:27:01.283080+0000","last_peered":"2023-07-27T14:27:01.283080+0000","last_clean":"2023-07-27T14:27:01.283080+0000","last_became_active":"2023-07-27T14:27:01.280339+0000","last_became_peered":"2023-07-27T14:27:01.280339+0000","last_unstale":"2023-07-27T14:27:01.283080+0000","last_undegraded":"2023-07-27T14:27:01.283080+0000","last_fullsized":"2023-07-27T14:27:01.283080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260518+0000","last_change":"2023-07-27T14:27:00.820859+0000","last_active":"2023-07-27T14:27:01.260518+0000","last_peered":"2023-07-27T14:27:01.260518+0000","last_clean":"2023-07-27T14:27:01.260518+0000","last_became_active":"2023-07-27T14:27:00.820298+0000","last_became_peered":"2023-07-27T14:27:00.820298+0000","last_unstale":"2023-07-27T14:27:01.260518+0000","last_undegraded":"2023-07-27T14:27:01.260518+0000","last_fullsized":"2023-07-27T14:27:01.260518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294252+0000","last_change":"2023-07-27T14:27:01.294252+0000","last_active":"2023-07-27T14:27:01.294252+0000","last_peered":"2023-07-27T14:27:01.294252+0000","last_clean":"2023-07-27T14:27:01.294252+0000","last_became_active":"2023-07-27T14:27:01.293925+0000","last_became_peered":"2023-07-27T14:27:01.293925+0000","last_unstale":"2023-07-27T14:27:01.294252+0000","last_undegraded":"2023-07-27T14:27:01.294252+0000","last_fullsized":"2023-07-27T14:27:01.294252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.818775+0000","last_change":"2023-07-27T14:27:00.816789+0000","last_active":"2023-07-27T14:27:00.818775+0000","last_peered":"2023-07-27T14:27:00.818775+0000","last_clean":"2023-07-27T14:27:00.818775+0000","last_became_active":"2023-07-27T14:27:00.816454+0000","last_became_peered":"2023-07-27T14:27:00.816454+0000","last_unstale":"2023-07-27T14:27:00.818775+0000","last_undegraded":"2023-07-27T14:27:00.818775+0000","last_fullsized":"2023-07-27T14:27:00.818775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281998+0000","last_change":"2023-07-27T14:27:01.270224+0000","last_active":"2023-07-27T14:27:01.281998+0000","last_peered":"2023-07-27T14:27:01.281998+0000","last_clean":"2023-07-27T14:27:01.281998+0000","last_became_active":"2023-07-27T14:27:01.269914+0000","last_became_peered":"2023-07-27T14:27:01.269914+0000","last_unstale":"2023-07-27T14:27:01.281998+0000","last_undegraded":"2023-07-27T14:27:01.281998+0000","last_fullsized":"2023-07-27T14:27:01.281998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.812821+0000","last_change":"2023-07-27T14:27:00.805825+0000","last_active":"2023-07-27T14:27:00.812821+0000","last_peered":"2023-07-27T14:27:00.812821+0000","last_clean":"2023-07-27T14:27:00.812821+0000","last_became_active":"2023-07-27T14:27:00.805285+0000","last_became_peered":"2023-07-27T14:27:00.805285+0000","last_unstale":"2023-07-27T14:27:00.812821+0000","last_undegraded":"2023-07-27T14:27:00.812821+0000","last_fullsized":"2023-07-27T14:27:00.812821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.278889+0000","last_change":"2023-07-27T14:27:01.278889+0000","last_active":"2023-07-27T14:27:01.278889+0000","last_peered":"2023-07-27T14:27:01.278889+0000","last_clean":"2023-07-27T14:27:01.278889+0000","last_became_active":"2023-07-27T14:27:01.277699+0000","last_became_peered":"2023-07-27T14:27:01.277699+0000","last_unstale":"2023-07-27T14:27:01.278889+0000","last_undegraded":"2023-07-27T14:27:01.278889+0000","last_fullsized":"2023-07-27T14:27:01.278889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260325+0000","last_change":"2023-07-27T14:27:00.818272+0000","last_active":"2023-07-27T14:27:01.260325+0000","last_peered":"2023-07-27T14:27:01.260325+0000","last_clean":"2023-07-27T14:27:01.260325+0000","last_became_active":"2023-07-27T14:27:00.817922+0000","last_became_peered":"2023-07-27T14:27:00.817922+0000","last_unstale":"2023-07-27T14:27:01.260325+0000","last_undegraded":"2023-07-27T14:27:01.260325+0000","last_fullsized":"2023-07-27T14:27:01.260325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281674+0000","last_change":"2023-07-27T14:27:01.277882+0000","last_active":"2023-07-27T14:27:01.281674+0000","last_peered":"2023-07-27T14:27:01.281674+0000","last_clean":"2023-07-27T14:27:01.281674+0000","last_became_active":"2023-07-27T14:27:01.276949+0000","last_became_peered":"2023-07-27T14:27:01.276949+0000","last_unstale":"2023-07-27T14:27:01.281674+0000","last_undegraded":"2023-07-27T14:27:01.281674+0000","last_fullsized":"2023-07-27T14:27:01.281674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269102+0000","last_change":"2023-07-27T14:27:00.822718+0000","last_active":"2023-07-27T14:27:01.269102+0000","last_peered":"2023-07-27T14:27:01.269102+0000","last_clean":"2023-07-27T14:27:01.269102+0000","last_became_active":"2023-07-27T14:27:00.822424+0000","last_became_peered":"2023-07-27T14:27:00.822424+0000","last_unstale":"2023-07-27T14:27:01.269102+0000","last_undegraded":"2023-07-27T14:27:01.269102+0000","last_fullsized":"2023-07-27T14:27:01.269102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295205+0000","last_change":"2023-07-27T14:27:01.295205+0000","last_active":"2023-07-27T14:27:01.295205+0000","last_peered":"2023-07-27T14:27:01.295205+0000","last_clean":"2023-07-27T14:27:01.295205+0000","last_became_active":"2023-07-27T14:27:01.294982+0000","last_became_peered":"2023-07-27T14:27:01.294982+0000","last_unstale":"2023-07-27T14:27:01.295205+0000","last_undegraded":"2023-07-27T14:27:01.295205+0000","last_fullsized":"2023-07-27T14:27:01.295205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260244+0000","last_change":"2023-07-27T14:27:00.821157+0000","last_active":"2023-07-27T14:27:01.260244+0000","last_peered":"2023-07-27T14:27:01.260244+0000","last_clean":"2023-07-27T14:27:01.260244+0000","last_became_active":"2023-07-27T14:27:00.820866+0000","last_became_peered":"2023-07-27T14:27:00.820866+0000","last_unstale":"2023-07-27T14:27:01.260244+0000","last_undegraded":"2023-07-27T14:27:01.260244+0000","last_fullsized":"2023-07-27T14:27:01.260244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.279179+0000","last_change":"2023-07-27T14:27:01.274421+0000","last_active":"2023-07-27T14:27:01.279179+0000","last_peered":"2023-07-27T14:27:01.279179+0000","last_clean":"2023-07-27T14:27:01.279179+0000","last_became_active":"2023-07-27T14:27:01.274184+0000","last_became_peered":"2023-07-27T14:27:01.274184+0000","last_unstale":"2023-07-27T14:27:01.279179+0000","last_undegraded":"2023-07-27T14:27:01.279179+0000","last_fullsized":"2023-07-27T14:27:01.279179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270247+0000","last_change":"2023-07-27T14:27:00.800329+0000","last_active":"2023-07-27T14:27:01.270247+0000","last_peered":"2023-07-27T14:27:01.270247+0000","last_clean":"2023-07-27T14:27:01.270247+0000","last_became_active":"2023-07-27T14:27:00.799971+0000","last_became_peered":"2023-07-27T14:27:00.799971+0000","last_unstale":"2023-07-27T14:27:01.270247+0000","last_undegraded":"2023-07-27T14:27:01.270247+0000","last_fullsized":"2023-07-27T14:27:01.270247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290197+0000","last_change":"2023-07-27T14:27:01.290197+0000","last_active":"2023-07-27T14:27:01.290197+0000","last_peered":"2023-07-27T14:27:01.290197+0000","last_clean":"2023-07-27T14:27:01.290197+0000","last_became_active":"2023-07-27T14:27:01.289777+0000","last_became_peered":"2023-07-27T14:27:01.289777+0000","last_unstale":"2023-07-27T14:27:01.290197+0000","last_undegraded":"2023-07-27T14:27:01.290197+0000","last_fullsized":"2023-07-27T14:27:01.290197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290972+0000","last_change":"2023-07-27T14:27:00.812501+0000","last_active":"2023-07-27T14:27:01.290972+0000","last_peered":"2023-07-27T14:27:01.290972+0000","last_clean":"2023-07-27T14:27:01.290972+0000","last_became_active":"2023-07-27T14:27:00.810185+0000","last_became_peered":"2023-07-27T14:27:00.810185+0000","last_unstale":"2023-07-27T14:27:01.290972+0000","last_undegraded":"2023-07-27T14:27:01.290972+0000","last_fullsized":"2023-07-27T14:27:01.290972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281360+0000","last_change":"2023-07-27T14:27:01.281360+0000","last_active":"2023-07-27T14:27:01.281360+0000","last_peered":"2023-07-27T14:27:01.281360+0000","last_clean":"2023-07-27T14:27:01.281360+0000","last_became_active":"2023-07-27T14:27:01.279561+0000","last_became_peered":"2023-07-27T14:27:01.279561+0000","last_unstale":"2023-07-27T14:27:01.281360+0000","last_undegraded":"2023-07-27T14:27:01.281360+0000","last_fullsized":"2023-07-27T14:27:01.281360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.825166+0000","last_change":"2023-07-27T14:27:00.821016+0000","last_active":"2023-07-27T14:27:00.825166+0000","last_peered":"2023-07-27T14:27:00.825166+0000","last_clean":"2023-07-27T14:27:00.825166+0000","last_became_active":"2023-07-27T14:27:00.820542+0000","last_became_peered":"2023-07-27T14:27:00.820542+0000","last_unstale":"2023-07-27T14:27:00.825166+0000","last_undegraded":"2023-07-27T14:27:00.825166+0000","last_fullsized":"2023-07-27T14:27:00.825166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281760+0000","last_change":"2023-07-27T14:27:01.279230+0000","last_active":"2023-07-27T14:27:01.281760+0000","last_peered":"2023-07-27T14:27:01.281760+0000","last_clean":"2023-07-27T14:27:01.281760+0000","last_became_active":"2023-07-27T14:27:01.278983+0000","last_became_peered":"2023-07-27T14:27:01.278983+0000","last_unstale":"2023-07-27T14:27:01.281760+0000","last_undegraded":"2023-07-27T14:27:01.281760+0000","last_fullsized":"2023-07-27T14:27:01.281760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263370+0000","last_change":"2023-07-27T14:27:00.807042+0000","last_active":"2023-07-27T14:27:01.263370+0000","last_peered":"2023-07-27T14:27:01.263370+0000","last_clean":"2023-07-27T14:27:01.263370+0000","last_became_active":"2023-07-27T14:27:00.805697+0000","last_became_peered":"2023-07-27T14:27:00.805697+0000","last_unstale":"2023-07-27T14:27:01.263370+0000","last_undegraded":"2023-07-27T14:27:01.263370+0000","last_fullsized":"2023-07-27T14:27:01.263370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285431+0000","last_change":"2023-07-27T14:27:01.283982+0000","last_active":"2023-07-27T14:27:01.285431+0000","last_peered":"2023-07-27T14:27:01.285431+0000","last_clean":"2023-07-27T14:27:01.285431+0000","last_became_active":"2023-07-27T14:27:01.283720+0000","last_became_peered":"2023-07-27T14:27:01.283720+0000","last_unstale":"2023-07-27T14:27:01.285431+0000","last_undegraded":"2023-07-27T14:27:01.285431+0000","last_fullsized":"2023-07-27T14:27:01.285431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270872+0000","last_change":"2023-07-27T14:27:00.803325+0000","last_active":"2023-07-27T14:27:01.270872+0000","last_peered":"2023-07-27T14:27:01.270872+0000","last_clean":"2023-07-27T14:27:01.270872+0000","last_became_active":"2023-07-27T14:27:00.802962+0000","last_became_peered":"2023-07-27T14:27:00.802962+0000","last_unstale":"2023-07-27T14:27:01.270872+0000","last_undegraded":"2023-07-27T14:27:01.270872+0000","last_fullsized":"2023-07-27T14:27:01.270872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.280016+0000","last_change":"2023-07-27T14:27:01.280016+0000","last_active":"2023-07-27T14:27:01.280016+0000","last_peered":"2023-07-27T14:27:01.280016+0000","last_clean":"2023-07-27T14:27:01.280016+0000","last_became_active":"2023-07-27T14:27:01.279475+0000","last_became_peered":"2023-07-27T14:27:01.279475+0000","last_unstale":"2023-07-27T14:27:01.280016+0000","last_undegraded":"2023-07-27T14:27:01.280016+0000","last_fullsized":"2023-07-27T14:27:01.280016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268740+0000","last_change":"2023-07-27T14:27:00.808976+0000","last_active":"2023-07-27T14:27:01.268740+0000","last_peered":"2023-07-27T14:27:01.268740+0000","last_clean":"2023-07-27T14:27:01.268740+0000","last_became_active":"2023-07-27T14:27:00.808693+0000","last_became_peered":"2023-07-27T14:27:00.808693+0000","last_unstale":"2023-07-27T14:27:01.268740+0000","last_undegraded":"2023-07-27T14:27:01.268740+0000","last_fullsized":"2023-07-27T14:27:01.268740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281655+0000","last_change":"2023-07-27T14:27:01.277692+0000","last_active":"2023-07-27T14:27:01.281655+0000","last_peered":"2023-07-27T14:27:01.281655+0000","last_clean":"2023-07-27T14:27:01.281655+0000","last_became_active":"2023-07-27T14:27:01.277446+0000","last_became_peered":"2023-07-27T14:27:01.277446+0000","last_unstale":"2023-07-27T14:27:01.281655+0000","last_undegraded":"2023-07-27T14:27:01.281655+0000","last_fullsized":"2023-07-27T14:27:01.281655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289999+0000","last_change":"2023-07-27T14:27:00.804577+0000","last_active":"2023-07-27T14:27:01.289999+0000","last_peered":"2023-07-27T14:27:01.289999+0000","last_clean":"2023-07-27T14:27:01.289999+0000","last_became_active":"2023-07-27T14:27:00.804260+0000","last_became_peered":"2023-07-27T14:27:00.804260+0000","last_unstale":"2023-07-27T14:27:01.289999+0000","last_undegraded":"2023-07-27T14:27:01.289999+0000","last_fullsized":"2023-07-27T14:27:01.289999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287961+0000","last_change":"2023-07-27T14:27:01.283951+0000","last_active":"2023-07-27T14:27:01.287961+0000","last_peered":"2023-07-27T14:27:01.287961+0000","last_clean":"2023-07-27T14:27:01.287961+0000","last_became_active":"2023-07-27T14:27:01.283632+0000","last_became_peered":"2023-07-27T14:27:01.283632+0000","last_unstale":"2023-07-27T14:27:01.287961+0000","last_undegraded":"2023-07-27T14:27:01.287961+0000","last_fullsized":"2023-07-27T14:27:01.287961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.825813+0000","last_change":"2023-07-27T14:27:00.824631+0000","last_active":"2023-07-27T14:27:00.825813+0000","last_peered":"2023-07-27T14:27:00.825813+0000","last_clean":"2023-07-27T14:27:00.825813+0000","last_became_active":"2023-07-27T14:27:00.824325+0000","last_became_peered":"2023-07-27T14:27:00.824325+0000","last_unstale":"2023-07-27T14:27:00.825813+0000","last_undegraded":"2023-07-27T14:27:00.825813+0000","last_fullsized":"2023-07-27T14:27:00.825813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289044+0000","last_change":"2023-07-27T14:27:01.289044+0000","last_active":"2023-07-27T14:27:01.289044+0000","last_peered":"2023-07-27T14:27:01.289044+0000","last_clean":"2023-07-27T14:27:01.289044+0000","last_became_active":"2023-07-27T14:27:01.288554+0000","last_became_peered":"2023-07-27T14:27:01.288554+0000","last_unstale":"2023-07-27T14:27:01.289044+0000","last_undegraded":"2023-07-27T14:27:01.289044+0000","last_fullsized":"2023-07-27T14:27:01.289044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265219+0000","last_change":"2023-07-27T14:27:00.809620+0000","last_active":"2023-07-27T14:27:01.265219+0000","last_peered":"2023-07-27T14:27:01.265219+0000","last_clean":"2023-07-27T14:27:01.265219+0000","last_became_active":"2023-07-27T14:27:00.808904+0000","last_became_peered":"2023-07-27T14:27:00.808904+0000","last_unstale":"2023-07-27T14:27:01.265219+0000","last_undegraded":"2023-07-27T14:27:01.265219+0000","last_fullsized":"2023-07-27T14:27:01.265219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290692+0000","last_change":"2023-07-27T14:27:01.289240+0000","last_active":"2023-07-27T14:27:01.290692+0000","last_peered":"2023-07-27T14:27:01.290692+0000","last_clean":"2023-07-27T14:27:01.290692+0000","last_became_active":"2023-07-27T14:27:01.288802+0000","last_became_peered":"2023-07-27T14:27:01.288802+0000","last_unstale":"2023-07-27T14:27:01.290692+0000","last_undegraded":"2023-07-27T14:27:01.290692+0000","last_fullsized":"2023-07-27T14:27:01.290692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281879+0000","last_change":"2023-07-27T14:27:00.822946+0000","last_active":"2023-07-27T14:27:01.281879+0000","last_peered":"2023-07-27T14:27:01.281879+0000","last_clean":"2023-07-27T14:27:01.281879+0000","last_became_active":"2023-07-27T14:27:00.822588+0000","last_became_peered":"2023-07-27T14:27:00.822588+0000","last_unstale":"2023-07-27T14:27:01.281879+0000","last_undegraded":"2023-07-27T14:27:01.281879+0000","last_fullsized":"2023-07-27T14:27:01.281879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286750+0000","last_change":"2023-07-27T14:27:01.282869+0000","last_active":"2023-07-27T14:27:01.286750+0000","last_peered":"2023-07-27T14:27:01.286750+0000","last_clean":"2023-07-27T14:27:01.286750+0000","last_became_active":"2023-07-27T14:27:01.282606+0000","last_became_peered":"2023-07-27T14:27:01.282606+0000","last_unstale":"2023-07-27T14:27:01.286750+0000","last_undegraded":"2023-07-27T14:27:01.286750+0000","last_fullsized":"2023-07-27T14:27:01.286750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293253+0000","last_change":"2023-07-27T14:27:00.818598+0000","last_active":"2023-07-27T14:27:01.293253+0000","last_peered":"2023-07-27T14:27:01.293253+0000","last_clean":"2023-07-27T14:27:01.293253+0000","last_became_active":"2023-07-27T14:27:00.817968+0000","last_became_peered":"2023-07-27T14:27:00.817968+0000","last_unstale":"2023-07-27T14:27:01.293253+0000","last_undegraded":"2023-07-27T14:27:01.293253+0000","last_fullsized":"2023-07-27T14:27:01.293253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284237+0000","last_change":"2023-07-27T14:27:01.280850+0000","last_active":"2023-07-27T14:27:01.284237+0000","last_peered":"2023-07-27T14:27:01.284237+0000","last_clean":"2023-07-27T14:27:01.284237+0000","last_became_active":"2023-07-27T14:27:01.280558+0000","last_became_peered":"2023-07-27T14:27:01.280558+0000","last_unstale":"2023-07-27T14:27:01.284237+0000","last_undegraded":"2023-07-27T14:27:01.284237+0000","last_fullsized":"2023-07-27T14:27:01.284237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.813188+0000","last_change":"2023-07-27T14:27:00.809897+0000","last_active":"2023-07-27T14:27:00.813188+0000","last_peered":"2023-07-27T14:27:00.813188+0000","last_clean":"2023-07-27T14:27:00.813188+0000","last_became_active":"2023-07-27T14:27:00.809579+0000","last_became_peered":"2023-07-27T14:27:00.809579+0000","last_unstale":"2023-07-27T14:27:00.813188+0000","last_undegraded":"2023-07-27T14:27:00.813188+0000","last_fullsized":"2023-07-27T14:27:00.813188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.274427+0000","last_change":"2023-07-27T14:27:01.274427+0000","last_active":"2023-07-27T14:27:01.274427+0000","last_peered":"2023-07-27T14:27:01.274427+0000","last_clean":"2023-07-27T14:27:01.274427+0000","last_became_active":"2023-07-27T14:27:01.273859+0000","last_became_peered":"2023-07-27T14:27:01.273859+0000","last_unstale":"2023-07-27T14:27:01.274427+0000","last_undegraded":"2023-07-27T14:27:01.274427+0000","last_fullsized":"2023-07-27T14:27:01.274427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.813220+0000","last_change":"2023-07-27T14:27:00.809959+0000","last_active":"2023-07-27T14:27:00.813220+0000","last_peered":"2023-07-27T14:27:00.813220+0000","last_clean":"2023-07-27T14:27:00.813220+0000","last_became_active":"2023-07-27T14:27:00.809036+0000","last_became_peered":"2023-07-27T14:27:00.809036+0000","last_unstale":"2023-07-27T14:27:00.813220+0000","last_undegraded":"2023-07-27T14:27:00.813220+0000","last_fullsized":"2023-07-27T14:27:00.813220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288447+0000","last_change":"2023-07-27T14:27:01.288447+0000","last_active":"2023-07-27T14:27:01.288447+0000","last_peered":"2023-07-27T14:27:01.288447+0000","last_clean":"2023-07-27T14:27:01.288447+0000","last_became_active":"2023-07-27T14:27:01.288075+0000","last_became_peered":"2023-07-27T14:27:01.288075+0000","last_unstale":"2023-07-27T14:27:01.288447+0000","last_undegraded":"2023-07-27T14:27:01.288447+0000","last_fullsized":"2023-07-27T14:27:01.288447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.823858+0000","last_change":"2023-07-27T14:27:00.817201+0000","last_active":"2023-07-27T14:27:00.823858+0000","last_peered":"2023-07-27T14:27:00.823858+0000","last_clean":"2023-07-27T14:27:00.823858+0000","last_became_active":"2023-07-27T14:27:00.816881+0000","last_became_peered":"2023-07-27T14:27:00.816881+0000","last_unstale":"2023-07-27T14:27:00.823858+0000","last_undegraded":"2023-07-27T14:27:00.823858+0000","last_fullsized":"2023-07-27T14:27:00.823858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289747+0000","last_change":"2023-07-27T14:27:01.288012+0000","last_active":"2023-07-27T14:27:01.289747+0000","last_peered":"2023-07-27T14:27:01.289747+0000","last_clean":"2023-07-27T14:27:01.289747+0000","last_became_active":"2023-07-27T14:27:01.287599+0000","last_became_peered":"2023-07-27T14:27:01.287599+0000","last_unstale":"2023-07-27T14:27:01.289747+0000","last_undegraded":"2023-07-27T14:27:01.289747+0000","last_fullsized":"2023-07-27T14:27:01.289747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260793+0000","last_change":"2023-07-27T14:27:00.818067+0000","last_active":"2023-07-27T14:27:01.260793+0000","last_peered":"2023-07-27T14:27:01.260793+0000","last_clean":"2023-07-27T14:27:01.260793+0000","last_became_active":"2023-07-27T14:27:00.817737+0000","last_became_peered":"2023-07-27T14:27:00.817737+0000","last_unstale":"2023-07-27T14:27:01.260793+0000","last_undegraded":"2023-07-27T14:27:01.260793+0000","last_fullsized":"2023-07-27T14:27:01.260793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282575+0000","last_change":"2023-07-27T14:27:01.280475+0000","last_active":"2023-07-27T14:27:01.282575+0000","last_peered":"2023-07-27T14:27:01.282575+0000","last_clean":"2023-07-27T14:27:01.282575+0000","last_became_active":"2023-07-27T14:27:01.280167+0000","last_became_peered":"2023-07-27T14:27:01.280167+0000","last_unstale":"2023-07-27T14:27:01.282575+0000","last_undegraded":"2023-07-27T14:27:01.282575+0000","last_fullsized":"2023-07-27T14:27:01.282575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.814604+0000","last_change":"2023-07-27T14:27:00.811588+0000","last_active":"2023-07-27T14:27:00.814604+0000","last_peered":"2023-07-27T14:27:00.814604+0000","last_clean":"2023-07-27T14:27:00.814604+0000","last_became_active":"2023-07-27T14:27:00.811302+0000","last_became_peered":"2023-07-27T14:27:00.811302+0000","last_unstale":"2023-07-27T14:27:00.814604+0000","last_undegraded":"2023-07-27T14:27:00.814604+0000","last_fullsized":"2023-07-27T14:27:00.814604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293325+0000","last_change":"2023-07-27T14:27:01.293325+0000","last_active":"2023-07-27T14:27:01.293325+0000","last_peered":"2023-07-27T14:27:01.293325+0000","last_clean":"2023-07-27T14:27:01.293325+0000","last_became_active":"2023-07-27T14:27:01.293018+0000","last_became_peered":"2023-07-27T14:27:01.293018+0000","last_unstale":"2023-07-27T14:27:01.293325+0000","last_undegraded":"2023-07-27T14:27:01.293325+0000","last_fullsized":"2023-07-27T14:27:01.293325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288042+0000","last_change":"2023-07-27T14:27:00.804784+0000","last_active":"2023-07-27T14:27:01.288042+0000","last_peered":"2023-07-27T14:27:01.288042+0000","last_clean":"2023-07-27T14:27:01.288042+0000","last_became_active":"2023-07-27T14:27:00.804479+0000","last_became_peered":"2023-07-27T14:27:00.804479+0000","last_unstale":"2023-07-27T14:27:01.288042+0000","last_undegraded":"2023-07-27T14:27:01.288042+0000","last_fullsized":"2023-07-27T14:27:01.288042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283937+0000","last_change":"2023-07-27T14:27:01.283937+0000","last_active":"2023-07-27T14:27:01.283937+0000","last_peered":"2023-07-27T14:27:01.283937+0000","last_clean":"2023-07-27T14:27:01.283937+0000","last_became_active":"2023-07-27T14:27:01.283504+0000","last_became_peered":"2023-07-27T14:27:01.283504+0000","last_unstale":"2023-07-27T14:27:01.283937+0000","last_undegraded":"2023-07-27T14:27:01.283937+0000","last_fullsized":"2023-07-27T14:27:01.283937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264392+0000","last_change":"2023-07-27T14:27:00.807294+0000","last_active":"2023-07-27T14:27:01.264392+0000","last_peered":"2023-07-27T14:27:01.264392+0000","last_clean":"2023-07-27T14:27:01.264392+0000","last_became_active":"2023-07-27T14:27:00.805155+0000","last_became_peered":"2023-07-27T14:27:00.805155+0000","last_unstale":"2023-07-27T14:27:01.264392+0000","last_undegraded":"2023-07-27T14:27:01.264392+0000","last_fullsized":"2023-07-27T14:27:01.264392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284985+0000","last_change":"2023-07-27T14:27:01.280972+0000","last_active":"2023-07-27T14:27:01.284985+0000","last_peered":"2023-07-27T14:27:01.284985+0000","last_clean":"2023-07-27T14:27:01.284985+0000","last_became_active":"2023-07-27T14:27:01.280394+0000","last_became_peered":"2023-07-27T14:27:01.280394+0000","last_unstale":"2023-07-27T14:27:01.284985+0000","last_undegraded":"2023-07-27T14:27:01.284985+0000","last_fullsized":"2023-07-27T14:27:01.284985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287681+0000","last_change":"2023-07-27T14:27:00.821247+0000","last_active":"2023-07-27T14:27:01.287681+0000","last_peered":"2023-07-27T14:27:01.287681+0000","last_clean":"2023-07-27T14:27:01.287681+0000","last_became_active":"2023-07-27T14:27:00.820300+0000","last_became_peered":"2023-07-27T14:27:00.820300+0000","last_unstale":"2023-07-27T14:27:01.287681+0000","last_undegraded":"2023-07-27T14:27:01.287681+0000","last_fullsized":"2023-07-27T14:27:01.287681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.294103+0000","last_change":"2023-07-27T14:27:01.294103+0000","last_active":"2023-07-27T14:27:01.294103+0000","last_peered":"2023-07-27T14:27:01.294103+0000","last_clean":"2023-07-27T14:27:01.294103+0000","last_became_active":"2023-07-27T14:27:01.293567+0000","last_became_peered":"2023-07-27T14:27:01.293567+0000","last_unstale":"2023-07-27T14:27:01.294103+0000","last_undegraded":"2023-07-27T14:27:01.294103+0000","last_fullsized":"2023-07-27T14:27:01.294103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263146+0000","last_change":"2023-07-27T14:27:00.809881+0000","last_active":"2023-07-27T14:27:01.263146+0000","last_peered":"2023-07-27T14:27:01.263146+0000","last_clean":"2023-07-27T14:27:01.263146+0000","last_became_active":"2023-07-27T14:27:00.809012+0000","last_became_peered":"2023-07-27T14:27:00.809012+0000","last_unstale":"2023-07-27T14:27:01.263146+0000","last_undegraded":"2023-07-27T14:27:01.263146+0000","last_fullsized":"2023-07-27T14:27:01.263146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.274666+0000","last_change":"2023-07-27T14:27:01.274666+0000","last_active":"2023-07-27T14:27:01.274666+0000","last_peered":"2023-07-27T14:27:01.274666+0000","last_clean":"2023-07-27T14:27:01.274666+0000","last_became_active":"2023-07-27T14:27:01.272660+0000","last_became_peered":"2023-07-27T14:27:01.272660+0000","last_unstale":"2023-07-27T14:27:01.274666+0000","last_undegraded":"2023-07-27T14:27:01.274666+0000","last_fullsized":"2023-07-27T14:27:01.274666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-27T14:27:00.807427+0000","last_change":"2023-07-27T14:27:00.805779+0000","last_active":"2023-07-27T14:27:00.807427+0000","last_peered":"2023-07-27T14:27:00.807427+0000","last_clean":"2023-07-27T14:27:00.807427+0000","last_became_active":"2023-07-27T14:27:00.805502+0000","last_became_peered":"2023-07-27T14:27:00.805502+0000","last_unstale":"2023-07-27T14:27:00.807427+0000","last_undegraded":"2023-07-27T14:27:00.807427+0000","last_fullsized":"2023-07-27T14:27:00.807427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296549+0000","last_change":"2023-07-27T14:27:01.289809+0000","last_active":"2023-07-27T14:27:01.296549+0000","last_peered":"2023-07-27T14:27:01.296549+0000","last_clean":"2023-07-27T14:27:01.296549+0000","last_became_active":"2023-07-27T14:27:01.289534+0000","last_became_peered":"2023-07-27T14:27:01.289534+0000","last_unstale":"2023-07-27T14:27:01.296549+0000","last_undegraded":"2023-07-27T14:27:01.296549+0000","last_fullsized":"2023-07-27T14:27:01.296549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284667+0000","last_change":"2023-07-27T14:27:00.807339+0000","last_active":"2023-07-27T14:27:01.284667+0000","last_peered":"2023-07-27T14:27:01.284667+0000","last_clean":"2023-07-27T14:27:01.284667+0000","last_became_active":"2023-07-27T14:27:00.806613+0000","last_became_peered":"2023-07-27T14:27:00.806613+0000","last_unstale":"2023-07-27T14:27:01.284667+0000","last_undegraded":"2023-07-27T14:27:01.284667+0000","last_fullsized":"2023-07-27T14:27:01.284667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":245760,"data_stored":80404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5156,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366684,"statfs":{"total":96636764160,"available":96631484416,"internally_reserved":0,"allocated":225280,"data_stored":80436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":217088,"data_stored":78990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7210000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7440000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.016}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":229376,"data_stored":85694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":233472,"data_stored":85764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366612,"statfs":{"total":96636764160,"available":96631410688,"internally_reserved":0,"allocated":233472,"data_stored":85784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5232,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366608,"statfs":{"total":96636764160,"available":96631406592,"internally_reserved":0,"allocated":237568,"data_stored":80582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":217088,"data_stored":78990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:27:05.986 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:27:05.987 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-27T14:27:05.987 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-27T14:27:05.987 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-27T14:27:05.988 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-27T14:27:06.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.191+0000 7f53055ff700 1 Processor -- start 2023-07-27T14:27:06.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.192+0000 7f53055ff700 1 -- start start 2023-07-27T14:27:06.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.193+0000 7f53055ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5300153ec0 0x7f53000a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.193+0000 7f53055ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53000aa4d0 con 0x7f53000aaa40 2023-07-27T14:27:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.193+0000 7f53055ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53000c05c0 con 0x7f53000aa050 2023-07-27T14:27:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.193+0000 7f53055ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53000bfc90 con 0x7f5300153ec0 2023-07-27T14:27:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.193+0000 7f52feffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5300153ec0 0x7f53000a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.193+0000 7f52ff7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f53000aaa40 0x7f53000c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38524/0 (socket says 172.21.15.115:38524) 2023-07-27T14:27:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.193+0000 7f52ff7fe700 1 -- 172.21.15.115:0/2434711445 learned_addr learned my addr 172.21.15.115:0/2434711445 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.194+0000 7f52feffd700 1 -- 172.21.15.115:0/2434711445 >> v1:172.21.15.159:6789/0 conn(0x7f53000aa050 legacy=0x7f53000640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.194+0000 7f52feffd700 1 -- 172.21.15.115:0/2434711445 >> v1:172.21.15.115:6789/0 conn(0x7f53000aaa40 legacy=0x7f53000c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.194+0000 7f52feffd700 1 -- 172.21.15.115:0/2434711445 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53000bff70 con 0x7f5300153ec0 2023-07-27T14:27:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.194+0000 7f52feffd700 1 --2- 172.21.15.115:0/2434711445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f53000a9b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f52f0009760 tx=0x7f52f0009060).ready entity=mon.0 client_cookie=ba0f0fb3fd667212 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.194+0000 7f52fdffb700 1 -- 172.21.15.115:0/2434711445 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f000b580 con 0x7f5300153ec0 2023-07-27T14:27:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.194+0000 7f52fdffb700 1 -- 172.21.15.115:0/2434711445 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f000b6e0 con 0x7f5300153ec0 2023-07-27T14:27:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.194+0000 7f52fdffb700 1 -- 172.21.15.115:0/2434711445 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f000ba60 con 0x7f5300153ec0 2023-07-27T14:27:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.195+0000 7f53055ff700 1 -- 172.21.15.115:0/2434711445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 msgr2=0x7f53000a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.195+0000 7f53055ff700 1 --2- 172.21.15.115:0/2434711445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f53000a9b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f52f0009760 tx=0x7f52f0009060).stop 2023-07-27T14:27:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.195+0000 7f53055ff700 1 -- 172.21.15.115:0/2434711445 shutdown_connections 2023-07-27T14:27:06.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.195+0000 7f53055ff700 1 --2- 172.21.15.115:0/2434711445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f53000a9b60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.195+0000 7f53055ff700 1 -- 172.21.15.115:0/2434711445 >> 172.21.15.115:0/2434711445 conn(0x7f53000cb610 msgr2=0x7f53000c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:06.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.195+0000 7f53055ff700 1 -- 172.21.15.115:0/2434711445 shutdown_connections 2023-07-27T14:27:06.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.195+0000 7f53055ff700 1 -- 172.21.15.115:0/2434711445 wait complete. 2023-07-27T14:27:06.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.196+0000 7f53055ff700 1 Processor -- start 2023-07-27T14:27:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.196+0000 7f53055ff700 1 -- start start 2023-07-27T14:27:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.197+0000 7f53055ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53000aa050 0x7f53001671b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.197+0000 7f53055ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53000aaa40 0x7f5300152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.197+0000 7f53055ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f5300153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.197+0000 7f53055ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53001650a0 con 0x7f5300153ec0 2023-07-27T14:27:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.197+0000 7f53055ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5300164500 con 0x7f53000aaa40 2023-07-27T14:27:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.197+0000 7f53055ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5300164770 con 0x7f53000aa050 2023-07-27T14:27:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f5300153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f5300153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55618/0 (socket says 172.21.15.115:55618) 2023-07-27T14:27:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 -- 172.21.15.115:0/2733071111 learned_addr learned my addr 172.21.15.115:0/2733071111 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52feffd700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53000aa050 0x7f53001671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52fe7fc700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53000aaa40 0x7f5300152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 -- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53000aa050 msgr2=0x7f53001671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53000aa050 0x7f53001671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 -- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53000aaa40 msgr2=0x7f5300152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53000aaa40 0x7f5300152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 -- 172.21.15.115:0/2733071111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f00092a0 con 0x7f5300153ec0 2023-07-27T14:27:06.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52fe7fc700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53000aaa40 0x7f5300152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:06.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52ff7fe700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f5300153090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f52f800c7c0 tx=0x7f52f8001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:06.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52e6ffd700 1 -- 172.21.15.115:0/2733071111 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8005d30 con 0x7f5300153ec0 2023-07-27T14:27:06.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52e6ffd700 1 -- 172.21.15.115:0/2733071111 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8005e90 con 0x7f5300153ec0 2023-07-27T14:27:06.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5300164a50 con 0x7f5300153ec0 2023-07-27T14:27:06.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f52e6ffd700 1 -- 172.21.15.115:0/2733071111 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8007320 con 0x7f5300153ec0 2023-07-27T14:27:06.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.198+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5300153580 con 0x7f5300153ec0 2023-07-27T14:27:06.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.199+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530006c470 con 0x7f5300153ec0 2023-07-27T14:27:06.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.200+0000 7f52e6ffd700 1 -- 172.21.15.115:0/2733071111 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f52f8010030 con 0x7f5300153ec0 2023-07-27T14:27:06.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.201+0000 7f52e6ffd700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52ec05ed60 0x7f52ec061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.201+0000 7f52e6ffd700 1 -- 172.21.15.115:0/2733071111 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f52f80798d0 con 0x7f5300153ec0 2023-07-27T14:27:06.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.201+0000 7f52feffd700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52ec05ed60 0x7f52ec061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.202+0000 7f52feffd700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52ec05ed60 0x7f52ec061220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f53000b0270 tx=0x7f52f0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:06.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.205+0000 7f52e6ffd700 1 -- 172.21.15.115:0/2733071111 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f52f804ad60 con 0x7f5300153ec0 2023-07-27T14:27:06.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.419+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f53000c0250 con 0x7f5300153ec0 2023-07-27T14:27:06.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.422+0000 7f52e6ffd700 1 -- 172.21.15.115:0/2733071111 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148525 (secure 0 0 0) 0x7f52f804e380 con 0x7f5300153ec0 2023-07-27T14:27:06.438 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:06.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52ec05ed60 msgr2=0x7f52ec061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52ec05ed60 0x7f52ec061220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f53000b0270 tx=0x7f52f0017000).stop 2023-07-27T14:27:06.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 msgr2=0x7f5300153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f5300153090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f52f800c7c0 tx=0x7f52f8001560).stop 2023-07-27T14:27:06.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 shutdown_connections 2023-07-27T14:27:06.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52ec05ed60 0x7f52ec061220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5300153ec0 0x7f5300153090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53000aa050 0x7f53001671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 --2- 172.21.15.115:0/2733071111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53000aaa40 0x7f5300152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 >> 172.21.15.115:0/2733071111 conn(0x7f53000cb610 msgr2=0x7f53000ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:06.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 shutdown_connections 2023-07-27T14:27:06.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.425+0000 7f53055ff700 1 -- 172.21.15.115:0/2733071111 wait complete. 2023-07-27T14:27:06.455 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":4,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":110949},{"type":"v1","addr":"172.21.15.115:6833","nonce":110949}]},"active_addr":"172.21.15.115:6833/110949","active_change":"2023-07-27T14:26:47.426058+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3236987787}]},{"addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":727155745}]}]} 2023-07-27T14:27:06.461 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-27T14:27:06.461 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-27T14:27:06.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:06.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.638+0000 7f0f21bff700 1 Processor -- start 2023-07-27T14:27:06.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.638+0000 7f0f21bff700 1 -- start start 2023-07-27T14:27:06.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.639+0000 7f0f21bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f1c153ec0 0x7f0f1c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.639+0000 7f0f21bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1c0aa4d0 con 0x7f0f1c0aaa40 2023-07-27T14:27:06.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.639+0000 7f0f21bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1c0c05c0 con 0x7f0f1c0aa050 2023-07-27T14:27:06.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.639+0000 7f0f21bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c0bfc90 con 0x7f0f1c153ec0 2023-07-27T14:27:06.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f1c153ec0 0x7f0f1c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0f1c0aaa40 0x7f0f1c0c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38532/0 (socket says 172.21.15.115:38532) 2023-07-27T14:27:06.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1bfff700 1 -- 172.21.15.115:0/2102017762 learned_addr learned my addr 172.21.15.115:0/2102017762 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:06.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1b7fe700 1 -- 172.21.15.115:0/2102017762 >> v1:172.21.15.159:6789/0 conn(0x7f0f1c0aa050 legacy=0x7f0f1c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1b7fe700 1 -- 172.21.15.115:0/2102017762 >> v1:172.21.15.115:6789/0 conn(0x7f0f1c0aaa40 legacy=0x7f0f1c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1b7fe700 1 -- 172.21.15.115:0/2102017762 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0bff70 con 0x7f0f1c153ec0 2023-07-27T14:27:06.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1a7fc700 1 -- 172.21.15.115:0/2102017762 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209327099 0 0) 0x7f0f14001490 con 0x7f0f1c0aaa40 2023-07-27T14:27:06.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1b7fe700 1 --2- 172.21.15.115:0/2102017762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c0a9b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0f0c009760 tx=0x7f0f0c009060).ready entity=mon.0 client_cookie=86bfa60c8560bae0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:06.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.640+0000 7f0f1a7fc700 1 -- 172.21.15.115:0/2102017762 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c00b580 con 0x7f0f1c153ec0 2023-07-27T14:27:06.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f1a7fc700 1 -- 172.21.15.115:0/2102017762 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c00b6e0 con 0x7f0f1c153ec0 2023-07-27T14:27:06.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f1a7fc700 1 -- 172.21.15.115:0/2102017762 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c00ba60 con 0x7f0f1c153ec0 2023-07-27T14:27:06.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f21bff700 1 -- 172.21.15.115:0/2102017762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 msgr2=0x7f0f1c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f21bff700 1 --2- 172.21.15.115:0/2102017762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c0a9b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0f0c009760 tx=0x7f0f0c009060).stop 2023-07-27T14:27:06.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f21bff700 1 -- 172.21.15.115:0/2102017762 shutdown_connections 2023-07-27T14:27:06.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f21bff700 1 --2- 172.21.15.115:0/2102017762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c0a9b60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f21bff700 1 -- 172.21.15.115:0/2102017762 >> 172.21.15.115:0/2102017762 conn(0x7f0f1c0cb610 msgr2=0x7f0f1c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:06.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f21bff700 1 -- 172.21.15.115:0/2102017762 shutdown_connections 2023-07-27T14:27:06.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.641+0000 7f0f21bff700 1 -- 172.21.15.115:0/2102017762 wait complete. 2023-07-27T14:27:06.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.643+0000 7f0f21bff700 1 Processor -- start 2023-07-27T14:27:06.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.643+0000 7f0f21bff700 1 -- start start 2023-07-27T14:27:06.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f21bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1c0aa050 0x7f0f1c164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f21bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1c0aaa40 0x7f0f1c166e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f21bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f21bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0c33f0 con 0x7f0f1c153ec0 2023-07-27T14:27:06.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f21bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c164670 con 0x7f0f1c0aaa40 2023-07-27T14:27:06.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f21bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c152170 con 0x7f0f1c0aa050 2023-07-27T14:27:06.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c1516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55636/0 (socket says 172.21.15.115:55636) 2023-07-27T14:27:06.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1bfff700 1 -- 172.21.15.115:0/3875095649 learned_addr learned my addr 172.21.15.115:0/3875095649 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:06.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1b7fe700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1c0aa050 0x7f0f1c164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1affd700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1c0aaa40 0x7f0f1c166e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1bfff700 1 -- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1c0aa050 msgr2=0x7f0f1c164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1bfff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1c0aa050 0x7f0f1c164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1bfff700 1 -- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1c0aaa40 msgr2=0x7f0f1c166e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1bfff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1c0aaa40 0x7f0f1c166e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.644+0000 7f0f1bfff700 1 -- 172.21.15.115:0/3875095649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0092a0 con 0x7f0f1c153ec0 2023-07-27T14:27:06.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.645+0000 7f0f1affd700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1c0aaa40 0x7f0f1c166e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:06.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.645+0000 7f0f1bfff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c1516e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0f1400c7e0 tx=0x7f0f14007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:06.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.645+0000 7f0f037fe700 1 -- 172.21.15.115:0/3875095649 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14005d30 con 0x7f0f1c153ec0 2023-07-27T14:27:06.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.645+0000 7f0f037fe700 1 -- 172.21.15.115:0/3875095649 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f14005e90 con 0x7f0f1c153ec0 2023-07-27T14:27:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.645+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c0c2da0 con 0x7f0f1c153ec0 2023-07-27T14:27:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.645+0000 7f0f037fe700 1 -- 172.21.15.115:0/3875095649 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14007320 con 0x7f0f1c153ec0 2023-07-27T14:27:06.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.645+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c150680 con 0x7f0f1c153ec0 2023-07-27T14:27:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.646+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1c0c2c00 con 0x7f0f1c153ec0 2023-07-27T14:27:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.647+0000 7f0f037fe700 1 -- 172.21.15.115:0/3875095649 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0f14010030 con 0x7f0f1c153ec0 2023-07-27T14:27:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.647+0000 7f0f037fe700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0f0805ed60 0x7f0f08061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.647+0000 7f0f037fe700 1 -- 172.21.15.115:0/3875095649 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0f140799b0 con 0x7f0f1c153ec0 2023-07-27T14:27:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.648+0000 7f0f1b7fe700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0f0805ed60 0x7f0f08061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:06.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.648+0000 7f0f1b7fe700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0f0805ed60 0x7f0f08061220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0f0c006e00 tx=0x7f0f0c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:06.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.652+0000 7f0f037fe700 1 -- 172.21.15.115:0/3875095649 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0f1c0c2c00 con 0x7f0f1c153ec0 2023-07-27T14:27:06.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.824+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f1c0aa4d0 con 0x7f0f1c153ec0 2023-07-27T14:27:06.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.824+0000 7f0f037fe700 1 -- 172.21.15.115:0/3875095649 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f0f1c0aa4d0 con 0x7f0f1c153ec0 2023-07-27T14:27:06.839 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:06.840 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0f0805ed60 msgr2=0x7f0f08061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0f0805ed60 0x7f0f08061220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0f0c006e00 tx=0x7f0f0c017000).stop 2023-07-27T14:27:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 msgr2=0x7f0f1c1516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c1516e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0f1400c7e0 tx=0x7f0f14007dd0).stop 2023-07-27T14:27:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 shutdown_connections 2023-07-27T14:27:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0f0805ed60 0x7f0f08061220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f1c153ec0 0x7f0f1c1516e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1c0aa050 0x7f0f1c164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 --2- 172.21.15.115:0/3875095649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1c0aaa40 0x7f0f1c166e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:06.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 >> 172.21.15.115:0/3875095649 conn(0x7f0f1c0cb610 msgr2=0x7f0f1c0abc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:06.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 shutdown_connections 2023-07-27T14:27:06.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:06.827+0000 7f0f21bff700 1 -- 172.21.15.115:0/3875095649 wait complete. 2023-07-27T14:27:06.858 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-27T14:27:06.858 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:07.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.033+0000 7fc463fff700 1 Processor -- start 2023-07-27T14:27:07.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.034+0000 7fc463fff700 1 -- start start 2023-07-27T14:27:07.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc463fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc45c1542a0 0x7fc45c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc463fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c0aa4d0 con 0x7fc45c0aaa40 2023-07-27T14:27:07.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc463fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c0c05c0 con 0x7fc45c153ec0 2023-07-27T14:27:07.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc463fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0c1a60 con 0x7fc45c1542a0 2023-07-27T14:27:07.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc46159a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc45c0aaa40 0x7fc45c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38538/0 (socket says 172.21.15.115:38538) 2023-07-27T14:27:07.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc46159a700 1 -- 172.21.15.115:0/4010099576 learned_addr learned my addr 172.21.15.115:0/4010099576 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:07.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760488611 0 0) 0x7fc44c001110 con 0x7fc45c0aaa40 2023-07-27T14:27:07.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4480033f0 con 0x7fc45c0aaa40 2023-07-27T14:27:07.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.035+0000 7fc46259c700 1 --2- 172.21.15.115:0/4010099576 >> v2:172.21.15.159:3300/0 conn(0x7fc45c1542a0 0x7fc45c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1169313376 0 0) 0x7fc4480033f0 con 0x7fc45c0aaa40 2023-07-27T14:27:07.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 >> v2:172.21.15.159:3300/0 conn(0x7fc45c1542a0 msgr2=0x7fc45c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:07.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 --2- 172.21.15.115:0/4010099576 >> v2:172.21.15.159:3300/0 conn(0x7fc45c1542a0 0x7fc45c15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 >> v1:172.21.15.159:6789/0 conn(0x7fc45c153ec0 legacy=0x7fc45c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0aa270 con 0x7fc45c0aaa40 2023-07-27T14:27:07.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fc44c001600 con 0x7fc45c0aaa40 2023-07-27T14:27:07.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 >> v1:172.21.15.115:6789/0 conn(0x7fc45c0aaa40 legacy=0x7fc45c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4480038e0 0x7fc448003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc448004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448005000 0x7fc44800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0c1a60 con 0x7fc448004690 2023-07-27T14:27:07.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44800bf60 con 0x7fc448005000 2023-07-27T14:27:07.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44800c0f0 con 0x7fc4480038e0 2023-07-27T14:27:07.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc46159a700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc448004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc46259c700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448005000 0x7fc44800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.036+0000 7fc461d9b700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4480038e0 0x7fc448003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc46159a700 1 -- 172.21.15.115:0/4010099576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4480038e0 msgr2=0x7fc448003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:07.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc46159a700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4480038e0 0x7fc448003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc46159a700 1 -- 172.21.15.115:0/4010099576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448005000 msgr2=0x7fc44800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:07.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc46159a700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc448005000 0x7fc44800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc46159a700 1 -- 172.21.15.115:0/4010099576 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480033f0 con 0x7fc448004690 2023-07-27T14:27:07.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc46259c700 1 -- 172.21.15.115:0/4010099576 reap_dead start 2023-07-27T14:27:07.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc46159a700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc448004b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc44c00c390 tx=0x7fc45c0c1ba0).ready entity=mon.0 client_cookie=95140529d670609a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c007c00 con 0x7fc448004690 2023-07-27T14:27:07.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c00cbe0 con 0x7fc448004690 2023-07-27T14:27:07.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc460d99700 1 -- 172.21.15.115:0/4010099576 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0070d0 con 0x7fc448004690 2023-07-27T14:27:07.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc463fff700 1 -- 172.21.15.115:0/4010099576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 msgr2=0x7fc448004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.037+0000 7fc463fff700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc448004b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc44c00c390 tx=0x7fc45c0c1ba0).stop 2023-07-27T14:27:07.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.038+0000 7fc463fff700 1 -- 172.21.15.115:0/4010099576 shutdown_connections 2023-07-27T14:27:07.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.038+0000 7fc463fff700 1 --2- 172.21.15.115:0/4010099576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc448004b10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.038+0000 7fc463fff700 1 -- 172.21.15.115:0/4010099576 >> 172.21.15.115:0/4010099576 conn(0x7fc45c0cb610 msgr2=0x7fc45c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:07.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.038+0000 7fc463fff700 1 -- 172.21.15.115:0/4010099576 shutdown_connections 2023-07-27T14:27:07.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.038+0000 7fc463fff700 1 -- 172.21.15.115:0/4010099576 wait complete. 2023-07-27T14:27:07.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.039+0000 7fc463fff700 1 Processor -- start 2023-07-27T14:27:07.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.039+0000 7fc463fff700 1 -- start start 2023-07-27T14:27:07.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc463fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc45c142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc463fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc45c0afdd0 0x7fc45c0b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc463fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc45c0c3bb0 0x7fc45c0c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc463fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0af8c0 con 0x7fc448004690 2023-07-27T14:27:07.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc463fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c157b40 con 0x7fc45c0c3bb0 2023-07-27T14:27:07.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc463fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c158100 con 0x7fc45c0afdd0 2023-07-27T14:27:07.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc461d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc45c142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc461d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc45c142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55662/0 (socket says 172.21.15.115:55662) 2023-07-27T14:27:07.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc461d9b700 1 -- 172.21.15.115:0/3916078826 learned_addr learned my addr 172.21.15.115:0/3916078826 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:07.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc46159a700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc45c0afdd0 0x7fc45c0b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.040+0000 7fc46259c700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc45c0c3bb0 0x7fc45c0c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc461d9b700 1 -- 172.21.15.115:0/3916078826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc45c0afdd0 msgr2=0x7fc45c0b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc461d9b700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc45c0afdd0 0x7fc45c0b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc461d9b700 1 -- 172.21.15.115:0/3916078826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc45c0c3bb0 msgr2=0x7fc45c0c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc461d9b700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc45c0c3bb0 0x7fc45c0c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc461d9b700 1 -- 172.21.15.115:0/3916078826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0b0740 con 0x7fc448004690 2023-07-27T14:27:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc461d9b700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc45c142580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc4580026a0 tx=0x7fc458007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc451ffb700 1 -- 172.21.15.115:0/3916078826 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458007240 con 0x7fc448004690 2023-07-27T14:27:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc451ffb700 1 -- 172.21.15.115:0/3916078826 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4580073a0 con 0x7fc448004690 2023-07-27T14:27:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc451ffb700 1 -- 172.21.15.115:0/3916078826 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580066a0 con 0x7fc448004690 2023-07-27T14:27:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c0c4890 con 0x7fc448004690 2023-07-27T14:27:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.041+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c157d90 con 0x7fc448004690 2023-07-27T14:27:07.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.042+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c1583e0 con 0x7fc448004690 2023-07-27T14:27:07.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.043+0000 7fc451ffb700 1 -- 172.21.15.115:0/3916078826 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc458006a10 con 0x7fc448004690 2023-07-27T14:27:07.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.044+0000 7fc451ffb700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc44005ed90 0x7fc440061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.044+0000 7fc451ffb700 1 -- 172.21.15.115:0/3916078826 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc458079de0 con 0x7fc448004690 2023-07-27T14:27:07.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.044+0000 7fc46159a700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc44005ed90 0x7fc440061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.044+0000 7fc46159a700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc44005ed90 0x7fc440061250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc45c0ac3b0 tx=0x7fc44c010000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.048+0000 7fc451ffb700 1 -- 172.21.15.115:0/3916078826 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc45804b270 con 0x7fc448004690 2023-07-27T14:27:07.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.218+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc45c06c470 con 0x7fc448004690 2023-07-27T14:27:07.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.219+0000 7fc451ffb700 1 -- 172.21.15.115:0/3916078826 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7fc45804e890 con 0x7fc448004690 2023-07-27T14:27:07.233 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:07.233 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:07.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc44005ed90 msgr2=0x7fc440061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc44005ed90 0x7fc440061250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc45c0ac3b0 tx=0x7fc44c010000).stop 2023-07-27T14:27:07.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 msgr2=0x7fc45c142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc45c142580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc4580026a0 tx=0x7fc458007bb0).stop 2023-07-27T14:27:07.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 shutdown_connections 2023-07-27T14:27:07.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc44005ed90 0x7fc440061250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc45c0c3bb0 0x7fc45c0c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc448004690 0x7fc45c142580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 --2- 172.21.15.115:0/3916078826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc45c0afdd0 0x7fc45c0b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 >> 172.21.15.115:0/3916078826 conn(0x7fc45c0cb610 msgr2=0x7fc45c0ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:07.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 shutdown_connections 2023-07-27T14:27:07.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.221+0000 7fc463fff700 1 -- 172.21.15.115:0/3916078826 wait complete. 2023-07-27T14:27:07.252 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-27T14:27:07.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.428+0000 7f882cfff700 1 Processor -- start 2023-07-27T14:27:07.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.428+0000 7f882cfff700 1 -- start start 2023-07-27T14:27:07.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f882cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8828153ec0 0x7f88280a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f882cfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f88280aa050 0x7f88280640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f882cfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88280aa4d0 con 0x7f88280aaa40 2023-07-27T14:27:07.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f882cfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88280c05c0 con 0x7f88280aa050 2023-07-27T14:27:07.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f882cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88280c1a60 con 0x7f8828153ec0 2023-07-27T14:27:07.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f8826d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f88280aaa40 0x7f8828157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38554/0 (socket says 172.21.15.115:38554) 2023-07-27T14:27:07.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f8826d9d700 1 -- 172.21.15.115:0/1560366828 learned_addr learned my addr 172.21.15.115:0/1560366828 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:07.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f882659c700 1 --2- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8828153ec0 0x7f88280a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.429+0000 7f8825d9b700 1 --2- 172.21.15.115:0/1560366828 >> v2:172.21.15.159:3300/0 conn(0x7f88280aa050 0x7f88280640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f882559a700 1 -- 172.21.15.115:0/1560366828 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552610234 0 0) 0x7f8820001490 con 0x7f88280aaa40 2023-07-27T14:27:07.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f882559a700 1 -- 172.21.15.115:0/1560366828 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88100033f0 con 0x7f88280aaa40 2023-07-27T14:27:07.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f8825d9b700 1 -- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8828153ec0 msgr2=0x7f88280a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:07.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f8825d9b700 1 --2- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8828153ec0 0x7f88280a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f8825d9b700 1 -- 172.21.15.115:0/1560366828 >> v1:172.21.15.115:6789/0 conn(0x7f88280aaa40 legacy=0x7f8828157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f8825d9b700 1 -- 172.21.15.115:0/1560366828 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88280bfc90 con 0x7f88280aa050 2023-07-27T14:27:07.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f882659c700 1 --2- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8828153ec0 0x7f88280a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:07.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f8825d9b700 1 --2- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88280aa050 0x7f88280640f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f881c009760 tx=0x7f881c009060).ready entity=mon.1 client_cookie=b3119da3c6c54247 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.430+0000 7f882559a700 1 -- 172.21.15.115:0/1560366828 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00d4a0 con 0x7f88280aa050 2023-07-27T14:27:07.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882559a700 1 -- 172.21.15.115:0/1560366828 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00d600 con 0x7f88280aa050 2023-07-27T14:27:07.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882559a700 1 -- 172.21.15.115:0/1560366828 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00d980 con 0x7f88280aa050 2023-07-27T14:27:07.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882cfff700 1 -- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88280aa050 msgr2=0x7f88280640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882cfff700 1 --2- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88280aa050 0x7f88280640f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f881c009760 tx=0x7f881c009060).stop 2023-07-27T14:27:07.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882cfff700 1 -- 172.21.15.115:0/1560366828 shutdown_connections 2023-07-27T14:27:07.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882cfff700 1 --2- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8828153ec0 0x7f88280a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882cfff700 1 --2- 172.21.15.115:0/1560366828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88280aa050 0x7f88280640f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882cfff700 1 -- 172.21.15.115:0/1560366828 >> 172.21.15.115:0/1560366828 conn(0x7f88280cb610 msgr2=0x7f88280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:07.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882cfff700 1 -- 172.21.15.115:0/1560366828 shutdown_connections 2023-07-27T14:27:07.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.431+0000 7f882cfff700 1 -- 172.21.15.115:0/1560366828 wait complete. 2023-07-27T14:27:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.433+0000 7f882cfff700 1 Processor -- start 2023-07-27T14:27:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.433+0000 7f882cfff700 1 -- start start 2023-07-27T14:27:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f882cfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88280aa050 0x7f882814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f882cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f88280aaa40 0x7f88281642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f882cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828153ec0 0x7f88280c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f882cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88280c1cc0 con 0x7f8828153ec0 2023-07-27T14:27:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f882cfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8828152de0 con 0x7f88280aa050 2023-07-27T14:27:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f882cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88281530c0 con 0x7f88280aaa40 2023-07-27T14:27:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8826d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828153ec0 0x7f88280c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8826d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828153ec0 0x7f88280c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55668/0 (socket says 172.21.15.115:55668) 2023-07-27T14:27:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8826d9d700 1 -- 172.21.15.115:0/3321225265 learned_addr learned my addr 172.21.15.115:0/3321225265 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f882659c700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88280aa050 0x7f882814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8825d9b700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f88280aaa40 0x7f88281642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8826d9d700 1 -- 172.21.15.115:0/3321225265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f88280aaa40 msgr2=0x7f88281642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8826d9d700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f88280aaa40 0x7f88281642d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8826d9d700 1 -- 172.21.15.115:0/3321225265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88280aa050 msgr2=0x7f882814cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8826d9d700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88280aa050 0x7f882814cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.434+0000 7f8826d9d700 1 -- 172.21.15.115:0/3321225265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88180092a0 con 0x7f8828153ec0 2023-07-27T14:27:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.435+0000 7f8826d9d700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828153ec0 0x7f88280c3010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8820002250 tx=0x7f8820007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.435+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820005d30 con 0x7f8828153ec0 2023-07-27T14:27:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.435+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820005e90 con 0x7f8828153ec0 2023-07-27T14:27:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.435+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c0092a0 con 0x7f8828153ec0 2023-07-27T14:27:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.435+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820007320 con 0x7f8828153ec0 2023-07-27T14:27:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.435+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8828153680 con 0x7f8828153ec0 2023-07-27T14:27:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.436+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f882806c470 con 0x7f8828153ec0 2023-07-27T14:27:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.437+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8820010030 con 0x7f8828153ec0 2023-07-27T14:27:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.437+0000 7f88167fc700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f880805ed60 0x7f8808061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.438+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f88200799a0 con 0x7f8828153ec0 2023-07-27T14:27:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.438+0000 7f882659c700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f880805ed60 0x7f8808061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.438+0000 7f88167fc700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6824/111291,v1:172.21.15.115:6825/111291] conn(0x7f8808068100 0x7f880806a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.438+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 --> [v2:172.21.15.115:6824/111291,v1:172.21.15.115:6825/111291] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f880806abe0 con 0x7f8808068100 2023-07-27T14:27:07.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.438+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f882007e220 con 0x7f8828153ec0 2023-07-27T14:27:07.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.438+0000 7f8825d9b700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6824/111291,v1:172.21.15.115:6825/111291] conn(0x7f8808068100 0x7f880806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.438+0000 7f882659c700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f880805ed60 0x7f8808061220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8818009270 tx=0x7f8818008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.438+0000 7f8825d9b700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6824/111291,v1:172.21.15.115:6825/111291] conn(0x7f8808068100 0x7f880806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.439+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 <== osd.0 v2:172.21.15.115:6824/111291 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f880806abe0 con 0x7f8808068100 2023-07-27T14:27:07.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.454+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 --> [v2:172.21.15.115:6824/111291,v1:172.21.15.115:6825/111291] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88280c1e30 con 0x7f8808068100 2023-07-27T14:27:07.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f88167fc700 1 -- 172.21.15.115:0/3321225265 <== osd.0 v2:172.21.15.115:6824/111291 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f88280c1e30 con 0x7f8808068100 2023-07-27T14:27:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6824/111291,v1:172.21.15.115:6825/111291] conn(0x7f8808068100 msgr2=0x7f880806a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6824/111291,v1:172.21.15.115:6825/111291] conn(0x7f8808068100 0x7f880806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f880805ed60 msgr2=0x7f8808061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f880805ed60 0x7f8808061220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8818009270 tx=0x7f8818008040).stop 2023-07-27T14:27:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828153ec0 msgr2=0x7f88280c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 --2- 172.21.15.115:0/3321225265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828153ec0 0x7f88280c3010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8820002250 tx=0x7f8820007dd0).stop 2023-07-27T14:27:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f8826d9d700 1 -- 172.21.15.115:0/3321225265 reap_dead start 2023-07-27T14:27:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 shutdown_connections 2023-07-27T14:27:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 >> 172.21.15.115:0/3321225265 conn(0x7f88280cb610 msgr2=0x7f88280ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 shutdown_connections 2023-07-27T14:27:07.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.455+0000 7f882cfff700 1 -- 172.21.15.115:0/3321225265 wait complete. 2023-07-27T14:27:07.484 INFO:teuthology.orchestra.run.smithi115.stdout:55834574853 2023-07-27T14:27:07.485 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-27T14:27:07.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.660+0000 7fcdbcbff700 1 Processor -- start 2023-07-27T14:27:07.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.660+0000 7fcdbcbff700 1 -- start start 2023-07-27T14:27:07.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdbcbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcdb80aaa40 0x7fcdb80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdbcbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb80aa4d0 con 0x7fcdb8153ec0 2023-07-27T14:27:07.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdbcbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb80c05c0 con 0x7fcdb81542a0 2023-07-27T14:27:07.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdbcbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb80aa270 con 0x7fcdb80aaa40 2023-07-27T14:27:07.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdb5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcdb80aaa40 0x7fcdb80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdb659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcdb8153ec0 0x7fcdb80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38570/0 (socket says 172.21.15.115:38570) 2023-07-27T14:27:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdb659c700 1 -- 172.21.15.115:0/3644248140 learned_addr learned my addr 172.21.15.115:0/3644248140 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:07.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdb559a700 1 -- 172.21.15.115:0/3644248140 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678357742 0 0) 0x7fcda8001110 con 0x7fcdb8153ec0 2023-07-27T14:27:07.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdb559a700 1 -- 172.21.15.115:0/3644248140 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda00033f0 con 0x7fcdb8153ec0 2023-07-27T14:27:07.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdb5d9b700 1 -- 172.21.15.115:0/3644248140 >> v1:172.21.15.159:6789/0 conn(0x7fcdb81542a0 legacy=0x7fcdb80c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:07.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdb5d9b700 1 -- 172.21.15.115:0/3644248140 >> v1:172.21.15.115:6789/0 conn(0x7fcdb8153ec0 legacy=0x7fcdb80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.662+0000 7fcdb5d9b700 1 -- 172.21.15.115:0/3644248140 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb80bfc90 con 0x7fcdb80aaa40 2023-07-27T14:27:07.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdb5d9b700 1 --2- 172.21.15.115:0/3644248140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb80aaa40 0x7fcdb80640f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fcdac009760 tx=0x7fcdac009060).ready entity=mon.0 client_cookie=90e23d99a6edbb07 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdb559a700 1 -- 172.21.15.115:0/3644248140 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac00f510 con 0x7fcdb80aaa40 2023-07-27T14:27:07.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdb559a700 1 -- 172.21.15.115:0/3644248140 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac00f670 con 0x7fcdb80aaa40 2023-07-27T14:27:07.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdb559a700 1 -- 172.21.15.115:0/3644248140 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac00f9f0 con 0x7fcdb80aaa40 2023-07-27T14:27:07.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdbcbff700 1 -- 172.21.15.115:0/3644248140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb80aaa40 msgr2=0x7fcdb80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdbcbff700 1 --2- 172.21.15.115:0/3644248140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb80aaa40 0x7fcdb80640f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fcdac009760 tx=0x7fcdac009060).stop 2023-07-27T14:27:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdbcbff700 1 -- 172.21.15.115:0/3644248140 shutdown_connections 2023-07-27T14:27:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdbcbff700 1 --2- 172.21.15.115:0/3644248140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb80aaa40 0x7fcdb80640f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdbcbff700 1 -- 172.21.15.115:0/3644248140 >> 172.21.15.115:0/3644248140 conn(0x7fcdb80cb610 msgr2=0x7fcdb80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdbcbff700 1 -- 172.21.15.115:0/3644248140 shutdown_connections 2023-07-27T14:27:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.663+0000 7fcdbcbff700 1 -- 172.21.15.115:0/3644248140 wait complete. 2023-07-27T14:27:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.665+0000 7fcdbcbff700 1 Processor -- start 2023-07-27T14:27:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.665+0000 7fcdbcbff700 1 -- start start 2023-07-27T14:27:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdbcbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb80aaa40 0x7fcdb8158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdbcbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb8153ec0 0x7fcdb814bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdbcbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb81542a0 0x7fcdb8159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdbcbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8158f40 con 0x7fcdb8153ec0 2023-07-27T14:27:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdbcbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb814c460 con 0x7fcdb81542a0 2023-07-27T14:27:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdbcbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8159130 con 0x7fcdb80aaa40 2023-07-27T14:27:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdb5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb8153ec0 0x7fcdb814bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdb5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb8153ec0 0x7fcdb814bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55694/0 (socket says 172.21.15.115:55694) 2023-07-27T14:27:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdb5d9b700 1 -- 172.21.15.115:0/2711982878 learned_addr learned my addr 172.21.15.115:0/2711982878 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdb659c700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb80aaa40 0x7fcdb8158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.666+0000 7fcdb5d9b700 1 -- 172.21.15.115:0/2711982878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb80aaa40 msgr2=0x7fcdb8158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdb5d9b700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb80aaa40 0x7fcdb8158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdb5d9b700 1 -- 172.21.15.115:0/2711982878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb81542a0 msgr2=0x7fcdb8159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdb6d9d700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb81542a0 0x7fcdb8159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdb5d9b700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb81542a0 0x7fcdb8159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdb5d9b700 1 -- 172.21.15.115:0/2711982878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0092a0 con 0x7fcdb8153ec0 2023-07-27T14:27:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdb659c700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb80aaa40 0x7fcdb8158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdb6d9d700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb81542a0 0x7fcdb8159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdb5d9b700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb8153ec0 0x7fcdb814bf70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcdb805fc60 tx=0x7fcdac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac006cd0 con 0x7fcdb8153ec0 2023-07-27T14:27:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac000c90 con 0x7fcdb8153ec0 2023-07-27T14:27:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac00f9f0 con 0x7fcdb8153ec0 2023-07-27T14:27:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb8159410 con 0x7fcdb8153ec0 2023-07-27T14:27:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.667+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb81599d0 con 0x7fcdb8153ec0 2023-07-27T14:27:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.668+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdb80ae3b0 con 0x7fcdb8153ec0 2023-07-27T14:27:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.669+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcdac02b070 con 0x7fcdb8153ec0 2023-07-27T14:27:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.670+0000 7fcda67fc700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9805ed60 0x7fcd98061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.670+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcdac07b3b0 con 0x7fcdb8153ec0 2023-07-27T14:27:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.670+0000 7fcdb659c700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9805ed60 0x7fcd98061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.670+0000 7fcda67fc700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6808/111288,v1:172.21.15.115:6810/111288] conn(0x7fcd98068100 0x7fcd9806a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.670+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 --> [v2:172.21.15.115:6808/111288,v1:172.21.15.115:6810/111288] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd9806abe0 con 0x7fcd98068100 2023-07-27T14:27:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.670+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdac07d910 con 0x7fcdb8153ec0 2023-07-27T14:27:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.670+0000 7fcdb6d9d700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6808/111288,v1:172.21.15.115:6810/111288] conn(0x7fcd98068100 0x7fcd9806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.670+0000 7fcdb659c700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9805ed60 0x7fcd98061220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fcda8007fd0 tx=0x7fcda8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.671+0000 7fcdb6d9d700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6808/111288,v1:172.21.15.115:6810/111288] conn(0x7fcd98068100 0x7fcd9806a560 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.671+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 <== osd.1 v2:172.21.15.115:6808/111288 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fcd9806abe0 con 0x7fcd98068100 2023-07-27T14:27:07.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.687+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 --> [v2:172.21.15.115:6808/111288,v1:172.21.15.115:6810/111288] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdb806c470 con 0x7fcd98068100 2023-07-27T14:27:07.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.687+0000 7fcda67fc700 1 -- 172.21.15.115:0/2711982878 <== osd.1 v2:172.21.15.115:6808/111288 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcdb806c470 con 0x7fcd98068100 2023-07-27T14:27:07.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.687+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6808/111288,v1:172.21.15.115:6810/111288] conn(0x7fcd98068100 msgr2=0x7fcd9806a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.687+0000 7fcdbcbff700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6808/111288,v1:172.21.15.115:6810/111288] conn(0x7fcd98068100 0x7fcd9806a560 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9805ed60 msgr2=0x7fcd98061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdbcbff700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9805ed60 0x7fcd98061220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fcda8007fd0 tx=0x7fcda8009040).stop 2023-07-27T14:27:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb8153ec0 msgr2=0x7fcdb814bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdbcbff700 1 --2- 172.21.15.115:0/2711982878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb8153ec0 0x7fcdb814bf70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcdb805fc60 tx=0x7fcdac017000).stop 2023-07-27T14:27:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdb6d9d700 1 -- 172.21.15.115:0/2711982878 reap_dead start 2023-07-27T14:27:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 shutdown_connections 2023-07-27T14:27:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 >> 172.21.15.115:0/2711982878 conn(0x7fcdb80cb610 msgr2=0x7fcdb80abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 shutdown_connections 2023-07-27T14:27:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.688+0000 7fcdbcbff700 1 -- 172.21.15.115:0/2711982878 wait complete. 2023-07-27T14:27:07.717 INFO:teuthology.orchestra.run.smithi115.stdout:55834574852 2023-07-27T14:27:07.717 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-27T14:27:07.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.893+0000 7fef065ff700 1 Processor -- start 2023-07-27T14:27:07.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.893+0000 7fef065ff700 1 -- start start 2023-07-27T14:27:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.894+0000 7fef065ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fef00153ec0 0x7fef000a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.894+0000 7fef065ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef000aaa40 0x7fef000c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.894+0000 7fef065ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000aa4d0 con 0x7fef000aa050 2023-07-27T14:27:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.894+0000 7fef065ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000c05c0 con 0x7fef000aaa40 2023-07-27T14:27:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.894+0000 7fef065ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000bfc90 con 0x7fef00153ec0 2023-07-27T14:27:07.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.894+0000 7feeff7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fef000aa050 0x7fef000640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38586/0 (socket says 172.21.15.115:38586) 2023-07-27T14:27:07.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.894+0000 7fef04b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef000aaa40 0x7fef000c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.894+0000 7feeff7fe700 1 -- 172.21.15.115:0/4048981943 learned_addr learned my addr 172.21.15.115:0/4048981943 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7feefffff700 1 --2- 172.21.15.115:0/4048981943 >> v2:172.21.15.159:3300/0 conn(0x7fef00153ec0 0x7fef000a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7feefeffd700 1 -- 172.21.15.115:0/4048981943 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674967040 0 0) 0x7feef4001110 con 0x7fef000aa050 2023-07-27T14:27:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7feefeffd700 1 -- 172.21.15.115:0/4048981943 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee80033f0 con 0x7fef000aa050 2023-07-27T14:27:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7fef04b9c700 1 -- 172.21.15.115:0/4048981943 >> v2:172.21.15.159:3300/0 conn(0x7fef00153ec0 msgr2=0x7fef000a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7fef04b9c700 1 --2- 172.21.15.115:0/4048981943 >> v2:172.21.15.159:3300/0 conn(0x7fef00153ec0 0x7fef000a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7fef04b9c700 1 -- 172.21.15.115:0/4048981943 >> v1:172.21.15.115:6789/0 conn(0x7fef000aa050 legacy=0x7fef000640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7fef04b9c700 1 -- 172.21.15.115:0/4048981943 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000bff70 con 0x7fef000aaa40 2023-07-27T14:27:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7fef04b9c700 1 --2- 172.21.15.115:0/4048981943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef000aaa40 0x7fef000c0a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fef00083e30 tx=0x7feef8009780).ready entity=mon.0 client_cookie=b94f6ba4b50d57f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7feefeffd700 1 -- 172.21.15.115:0/4048981943 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800e070 con 0x7fef000aaa40 2023-07-27T14:27:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7feefeffd700 1 -- 172.21.15.115:0/4048981943 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800bab0 con 0x7fef000aaa40 2023-07-27T14:27:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.895+0000 7feefeffd700 1 -- 172.21.15.115:0/4048981943 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800be30 con 0x7fef000aaa40 2023-07-27T14:27:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.896+0000 7fef065ff700 1 -- 172.21.15.115:0/4048981943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef000aaa40 msgr2=0x7fef000c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.896+0000 7fef065ff700 1 --2- 172.21.15.115:0/4048981943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef000aaa40 0x7fef000c0a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fef00083e30 tx=0x7feef8009780).stop 2023-07-27T14:27:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.896+0000 7fef065ff700 1 -- 172.21.15.115:0/4048981943 shutdown_connections 2023-07-27T14:27:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.896+0000 7fef065ff700 1 --2- 172.21.15.115:0/4048981943 >> v2:172.21.15.159:3300/0 conn(0x7fef00153ec0 0x7fef000a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.896+0000 7fef065ff700 1 --2- 172.21.15.115:0/4048981943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef000aaa40 0x7fef000c0a50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.896+0000 7fef065ff700 1 -- 172.21.15.115:0/4048981943 >> 172.21.15.115:0/4048981943 conn(0x7fef000cb610 msgr2=0x7fef000c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.896+0000 7fef065ff700 1 -- 172.21.15.115:0/4048981943 shutdown_connections 2023-07-27T14:27:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.896+0000 7fef065ff700 1 -- 172.21.15.115:0/4048981943 wait complete. 2023-07-27T14:27:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.897+0000 7fef065ff700 1 Processor -- start 2023-07-27T14:27:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.898+0000 7fef065ff700 1 -- start start 2023-07-27T14:27:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.898+0000 7fef065ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef000aa050 0x7fef00166d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.898+0000 7fef065ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef000aaa40 0x7fef00152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.898+0000 7fef065ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef00153ec0 0x7fef00152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.898+0000 7fef065ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000af4f0 con 0x7fef00153ec0 2023-07-27T14:27:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.898+0000 7fef065ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00152f20 con 0x7fef000aaa40 2023-07-27T14:27:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.898+0000 7fef065ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000ae8e0 con 0x7fef000aa050 2023-07-27T14:27:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef00153ec0 0x7fef00152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef00153ec0 0x7fef00152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55714/0 (socket says 172.21.15.115:55714) 2023-07-27T14:27:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 -- 172.21.15.115:0/3248501749 learned_addr learned my addr 172.21.15.115:0/3248501749 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7feeff7fe700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef000aaa40 0x7fef00152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7feefffff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef000aa050 0x7fef00166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 -- 172.21.15.115:0/3248501749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef000aa050 msgr2=0x7fef00166d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef000aa050 0x7fef00166d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 -- 172.21.15.115:0/3248501749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef000aaa40 msgr2=0x7fef00152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef000aaa40 0x7fef00152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 -- 172.21.15.115:0/3248501749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8009a20 con 0x7fef00153ec0 2023-07-27T14:27:07.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7feefffff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef000aa050 0x7fef00166d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:07.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef04b9c700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef00153ec0 0x7fef00152a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fef00060760 tx=0x7feef8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef801d630 con 0x7fef00153ec0 2023-07-27T14:27:07.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef801d790 con 0x7fef00153ec0 2023-07-27T14:27:07.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.899+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef000aebc0 con 0x7fef00153ec0 2023-07-27T14:27:07.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.900+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef801db30 con 0x7fef00153ec0 2023-07-27T14:27:07.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.900+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000af180 con 0x7fef00153ec0 2023-07-27T14:27:07.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.900+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef0006c470 con 0x7fef00153ec0 2023-07-27T14:27:07.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.901+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feef8026410 con 0x7fef00153ec0 2023-07-27T14:27:07.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.902+0000 7feee7fff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feeec05ed90 0x7feeec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.902+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feef807bb60 con 0x7fef00153ec0 2023-07-27T14:27:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.903+0000 7feefffff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feeec05ed90 0x7feeec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.903+0000 7feee7fff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6809/111293,v1:172.21.15.115:6811/111293] conn(0x7feeec068130 0x7feeec06a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.903+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 --> [v2:172.21.15.115:6809/111293,v1:172.21.15.115:6811/111293] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feeec06ac10 con 0x7feeec068130 2023-07-27T14:27:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.903+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7feef8080220 con 0x7fef00153ec0 2023-07-27T14:27:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.903+0000 7feeff7fe700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6809/111293,v1:172.21.15.115:6811/111293] conn(0x7feeec068130 0x7feeec06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.903+0000 7feefffff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feeec05ed90 0x7feeec061250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fef00148710 tx=0x7feef0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.903+0000 7feeff7fe700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6809/111293,v1:172.21.15.115:6811/111293] conn(0x7feeec068130 0x7feeec06a590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:07.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.904+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 <== osd.2 v2:172.21.15.115:6809/111293 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7feeec06ac10 con 0x7feeec068130 2023-07-27T14:27:07.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.919+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 --> [v2:172.21.15.115:6809/111293,v1:172.21.15.115:6811/111293] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef000c0250 con 0x7feeec068130 2023-07-27T14:27:07.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.919+0000 7feee7fff700 1 -- 172.21.15.115:0/3248501749 <== osd.2 v2:172.21.15.115:6809/111293 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef000c0250 con 0x7feeec068130 2023-07-27T14:27:07.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.919+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6809/111293,v1:172.21.15.115:6811/111293] conn(0x7feeec068130 msgr2=0x7feeec06a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.919+0000 7fef065ff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6809/111293,v1:172.21.15.115:6811/111293] conn(0x7feeec068130 0x7feeec06a590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feeec05ed90 msgr2=0x7feeec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef065ff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feeec05ed90 0x7feeec061250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fef00148710 tx=0x7feef0008040).stop 2023-07-27T14:27:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef00153ec0 msgr2=0x7fef00152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef065ff700 1 --2- 172.21.15.115:0/3248501749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef00153ec0 0x7fef00152a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fef00060760 tx=0x7feef8009780).stop 2023-07-27T14:27:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef04b9c700 1 -- 172.21.15.115:0/3248501749 reap_dead start 2023-07-27T14:27:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 shutdown_connections 2023-07-27T14:27:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 >> 172.21.15.115:0/3248501749 conn(0x7fef000cb610 msgr2=0x7fef000c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 shutdown_connections 2023-07-27T14:27:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:07.920+0000 7fef065ff700 1 -- 172.21.15.115:0/3248501749 wait complete. 2023-07-27T14:27:07.949 INFO:teuthology.orchestra.run.smithi115.stdout:55834574853 2023-07-27T14:27:07.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-27T14:27:08.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.123+0000 7f82f4bff700 1 Processor -- start 2023-07-27T14:27:08.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.124+0000 7f82f4bff700 1 -- start start 2023-07-27T14:27:08.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82f4bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f0153ec0 0x7f82f00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82f4bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f82f00aa050 0x7f82f00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82f4bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f00aa4d0 con 0x7f82f00aaa40 2023-07-27T14:27:08.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82f4bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00c05c0 con 0x7f82f00aa050 2023-07-27T14:27:08.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82f4bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c1a60 con 0x7f82f0153ec0 2023-07-27T14:27:08.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82eed9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f82f00aaa40 0x7f82f0157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38598/0 (socket says 172.21.15.115:38598) 2023-07-27T14:27:08.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82eed9d700 1 -- 172.21.15.115:0/2180223701 learned_addr learned my addr 172.21.15.115:0/2180223701 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:08.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82ee59c700 1 --2- 172.21.15.115:0/2180223701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f0153ec0 0x7f82f00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.125+0000 7f82edd9b700 1 --2- 172.21.15.115:0/2180223701 >> v2:172.21.15.159:3300/0 conn(0x7f82f00aa050 0x7f82f00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ed59a700 1 -- 172.21.15.115:0/2180223701 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859774659 0 0) 0x7f82e8001490 con 0x7f82f00aaa40 2023-07-27T14:27:08.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ed59a700 1 -- 172.21.15.115:0/2180223701 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d80033f0 con 0x7f82f00aaa40 2023-07-27T14:27:08.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ee59c700 1 -- 172.21.15.115:0/2180223701 >> v2:172.21.15.159:3300/0 conn(0x7f82f00aa050 msgr2=0x7f82f00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:08.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ee59c700 1 --2- 172.21.15.115:0/2180223701 >> v2:172.21.15.159:3300/0 conn(0x7f82f00aa050 0x7f82f00640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ee59c700 1 -- 172.21.15.115:0/2180223701 >> v1:172.21.15.115:6789/0 conn(0x7f82f00aaa40 legacy=0x7f82f0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ee59c700 1 -- 172.21.15.115:0/2180223701 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00bfc90 con 0x7f82f0153ec0 2023-07-27T14:27:08.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ee59c700 1 --2- 172.21.15.115:0/2180223701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f0153ec0 0x7f82f00a9b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f82e0009760 tx=0x7f82e0009060).ready entity=mon.2 client_cookie=c1020af3d6351b5a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ed59a700 1 -- 172.21.15.115:0/2180223701 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000d4a0 con 0x7f82f0153ec0 2023-07-27T14:27:08.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ed59a700 1 -- 172.21.15.115:0/2180223701 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000d600 con 0x7f82f0153ec0 2023-07-27T14:27:08.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.126+0000 7f82ed59a700 1 -- 172.21.15.115:0/2180223701 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000d980 con 0x7f82f0153ec0 2023-07-27T14:27:08.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.127+0000 7f82f4bff700 1 -- 172.21.15.115:0/2180223701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f0153ec0 msgr2=0x7f82f00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.127+0000 7f82f4bff700 1 --2- 172.21.15.115:0/2180223701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f0153ec0 0x7f82f00a9b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f82e0009760 tx=0x7f82e0009060).stop 2023-07-27T14:27:08.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.127+0000 7f82f4bff700 1 -- 172.21.15.115:0/2180223701 shutdown_connections 2023-07-27T14:27:08.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.127+0000 7f82f4bff700 1 --2- 172.21.15.115:0/2180223701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f0153ec0 0x7f82f00a9b60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.127+0000 7f82f4bff700 1 --2- 172.21.15.115:0/2180223701 >> v2:172.21.15.159:3300/0 conn(0x7f82f00aa050 0x7f82f00640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.127+0000 7f82f4bff700 1 -- 172.21.15.115:0/2180223701 >> 172.21.15.115:0/2180223701 conn(0x7f82f00cb610 msgr2=0x7f82f00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:08.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.127+0000 7f82f4bff700 1 -- 172.21.15.115:0/2180223701 shutdown_connections 2023-07-27T14:27:08.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.127+0000 7f82f4bff700 1 -- 172.21.15.115:0/2180223701 wait complete. 2023-07-27T14:27:08.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.128+0000 7f82f4bff700 1 Processor -- start 2023-07-27T14:27:08.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.129+0000 7f82f4bff700 1 -- start start 2023-07-27T14:27:08.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.129+0000 7f82f4bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f00aa050 0x7f82f0164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82f4bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f00aaa40 0x7f82f01684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82f4bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f0153ec0 0x7f82f01689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82f4bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c3840 con 0x7f82f0153ec0 2023-07-27T14:27:08.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82f4bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0151760 con 0x7f82f00aaa40 2023-07-27T14:27:08.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82f4bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c2f10 con 0x7f82f00aa050 2023-07-27T14:27:08.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f0153ec0 0x7f82f01689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f0153ec0 0x7f82f01689d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55730/0 (socket says 172.21.15.115:55730) 2023-07-27T14:27:08.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 -- 172.21.15.115:0/1636630642 learned_addr learned my addr 172.21.15.115:0/1636630642 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:08.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82edd9b700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f00aaa40 0x7f82f01684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82ee59c700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f00aa050 0x7f82f0164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 -- 172.21.15.115:0/1636630642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f00aa050 msgr2=0x7f82f0164870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f00aa050 0x7f82f0164870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 -- 172.21.15.115:0/1636630642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f00aaa40 msgr2=0x7f82f01684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f00aaa40 0x7f82f01684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 -- 172.21.15.115:0/1636630642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00092a0 con 0x7f82f0153ec0 2023-07-27T14:27:08.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82ee59c700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f00aa050 0x7f82f0164870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:08.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82eed9d700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f0153ec0 0x7f82f01689d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f82e8002250 tx=0x7f82e8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.130+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8005d30 con 0x7f82f0153ec0 2023-07-27T14:27:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.131+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e8005e90 con 0x7f82f0153ec0 2023-07-27T14:27:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.131+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8007320 con 0x7f82f0153ec0 2023-07-27T14:27:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.131+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00c31f0 con 0x7f82f0153ec0 2023-07-27T14:27:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.131+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f00af060 con 0x7f82f0153ec0 2023-07-27T14:27:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.132+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82f006c470 con 0x7f82f0153ec0 2023-07-27T14:27:08.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.132+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f82e8010030 con 0x7f82f0153ec0 2023-07-27T14:27:08.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.133+0000 7f82de7fc700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d005ed60 0x7f82d0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.133+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f82e8079900 con 0x7f82f0153ec0 2023-07-27T14:27:08.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.133+0000 7f82ee59c700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d005ed60 0x7f82d0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.133+0000 7f82de7fc700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6800/111287,v1:172.21.15.115:6801/111287] conn(0x7f82d0068100 0x7f82d006a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.133+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 --> [v2:172.21.15.115:6800/111287,v1:172.21.15.115:6801/111287] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82d006abe0 con 0x7f82d0068100 2023-07-27T14:27:08.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.133+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82e807e220 con 0x7f82f0153ec0 2023-07-27T14:27:08.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.134+0000 7f82edd9b700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6800/111287,v1:172.21.15.115:6801/111287] conn(0x7f82d0068100 0x7f82d006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.134+0000 7f82ee59c700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d005ed60 0x7f82d0061220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f82e000d260 tx=0x7f82e0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.134+0000 7f82edd9b700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6800/111287,v1:172.21.15.115:6801/111287] conn(0x7f82d0068100 0x7f82d006a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.135+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 <== osd.3 v2:172.21.15.115:6800/111287 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f82d006abe0 con 0x7f82d0068100 2023-07-27T14:27:08.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.149+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 --> [v2:172.21.15.115:6800/111287,v1:172.21.15.115:6801/111287] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82f00aa4d0 con 0x7f82d0068100 2023-07-27T14:27:08.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82de7fc700 1 -- 172.21.15.115:0/1636630642 <== osd.3 v2:172.21.15.115:6800/111287 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f82f00aa4d0 con 0x7f82d0068100 2023-07-27T14:27:08.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6800/111287,v1:172.21.15.115:6801/111287] conn(0x7f82d0068100 msgr2=0x7f82d006a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82f4bff700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6800/111287,v1:172.21.15.115:6801/111287] conn(0x7f82d0068100 0x7f82d006a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d005ed60 msgr2=0x7f82d0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82f4bff700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d005ed60 0x7f82d0061220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f82e000d260 tx=0x7f82e0016000).stop 2023-07-27T14:27:08.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f0153ec0 msgr2=0x7f82f01689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82f4bff700 1 --2- 172.21.15.115:0/1636630642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f0153ec0 0x7f82f01689d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f82e8002250 tx=0x7f82e8007dd0).stop 2023-07-27T14:27:08.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82eed9d700 1 -- 172.21.15.115:0/1636630642 reap_dead start 2023-07-27T14:27:08.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 shutdown_connections 2023-07-27T14:27:08.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.150+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 >> 172.21.15.115:0/1636630642 conn(0x7f82f00cb610 msgr2=0x7f82f00acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:08.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.151+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 shutdown_connections 2023-07-27T14:27:08.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.151+0000 7f82f4bff700 1 -- 172.21.15.115:0/1636630642 wait complete. 2023-07-27T14:27:08.180 INFO:teuthology.orchestra.run.smithi115.stdout:55834574852 2023-07-27T14:27:08.180 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-27T14:27:08.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.357+0000 7fe2c27ff700 1 Processor -- start 2023-07-27T14:27:08.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.358+0000 7fe2c27ff700 1 -- start start 2023-07-27T14:27:08.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.359+0000 7fe2c27ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe2bc153ec0 0x7fe2bc0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.359+0000 7fe2c27ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2bc0aa050 0x7fe2bc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.359+0000 7fe2c27ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2bc0aa4d0 con 0x7fe2bc0aaa40 2023-07-27T14:27:08.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.359+0000 7fe2c27ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2bc0c05c0 con 0x7fe2bc0aa050 2023-07-27T14:27:08.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.359+0000 7fe2c27ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2bc0c1a60 con 0x7fe2bc153ec0 2023-07-27T14:27:08.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.359+0000 7fe2c0d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe2bc0aaa40 0x7fe2bc157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38602/0 (socket says 172.21.15.115:38602) 2023-07-27T14:27:08.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.359+0000 7fe2c0d9c700 1 -- 172.21.15.115:0/2941743840 learned_addr learned my addr 172.21.15.115:0/2941743840 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:08.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.359+0000 7fe2bb7fe700 1 --2- 172.21.15.115:0/2941743840 >> v2:172.21.15.115:3300/0 conn(0x7fe2bc0aa050 0x7fe2bc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2bbfff700 1 --2- 172.21.15.115:0/2941743840 >> v2:172.21.15.159:3300/0 conn(0x7fe2bc153ec0 0x7fe2bc0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2baffd700 1 -- 172.21.15.115:0/2941743840 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184878833 0 0) 0x7fe2b4001490 con 0x7fe2bc0aaa40 2023-07-27T14:27:08.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2baffd700 1 -- 172.21.15.115:0/2941743840 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a40033f0 con 0x7fe2bc0aaa40 2023-07-27T14:27:08.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2bb7fe700 1 -- 172.21.15.115:0/2941743840 >> v2:172.21.15.159:3300/0 conn(0x7fe2bc153ec0 msgr2=0x7fe2bc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:08.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2bb7fe700 1 --2- 172.21.15.115:0/2941743840 >> v2:172.21.15.159:3300/0 conn(0x7fe2bc153ec0 0x7fe2bc0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2bb7fe700 1 -- 172.21.15.115:0/2941743840 >> v1:172.21.15.115:6789/0 conn(0x7fe2bc0aaa40 legacy=0x7fe2bc157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2bb7fe700 1 -- 172.21.15.115:0/2941743840 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc0bfc90 con 0x7fe2bc0aa050 2023-07-27T14:27:08.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2bb7fe700 1 --2- 172.21.15.115:0/2941743840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0aa050 0x7fe2bc0640f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe2bc083e30 tx=0x7fe2b0009060).ready entity=mon.0 client_cookie=c927d97909d126cd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2baffd700 1 -- 172.21.15.115:0/2941743840 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000d4a0 con 0x7fe2bc0aa050 2023-07-27T14:27:08.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2baffd700 1 -- 172.21.15.115:0/2941743840 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b000d600 con 0x7fe2bc0aa050 2023-07-27T14:27:08.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.360+0000 7fe2baffd700 1 -- 172.21.15.115:0/2941743840 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000d980 con 0x7fe2bc0aa050 2023-07-27T14:27:08.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.361+0000 7fe2c27ff700 1 -- 172.21.15.115:0/2941743840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0aa050 msgr2=0x7fe2bc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.361+0000 7fe2c27ff700 1 --2- 172.21.15.115:0/2941743840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0aa050 0x7fe2bc0640f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe2bc083e30 tx=0x7fe2b0009060).stop 2023-07-27T14:27:08.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.361+0000 7fe2c27ff700 1 -- 172.21.15.115:0/2941743840 shutdown_connections 2023-07-27T14:27:08.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.361+0000 7fe2c27ff700 1 --2- 172.21.15.115:0/2941743840 >> v2:172.21.15.159:3300/0 conn(0x7fe2bc153ec0 0x7fe2bc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.361+0000 7fe2c27ff700 1 --2- 172.21.15.115:0/2941743840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0aa050 0x7fe2bc0640f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.361+0000 7fe2c27ff700 1 -- 172.21.15.115:0/2941743840 >> 172.21.15.115:0/2941743840 conn(0x7fe2bc0cb610 msgr2=0x7fe2bc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:08.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.361+0000 7fe2c27ff700 1 -- 172.21.15.115:0/2941743840 shutdown_connections 2023-07-27T14:27:08.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.361+0000 7fe2c27ff700 1 -- 172.21.15.115:0/2941743840 wait complete. 2023-07-27T14:27:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.362+0000 7fe2c27ff700 1 Processor -- start 2023-07-27T14:27:08.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.362+0000 7fe2c27ff700 1 -- start start 2023-07-27T14:27:08.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.363+0000 7fe2c27ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aa050 0x7fe2bc14c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.363+0000 7fe2c27ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0aaa40 0x7fe2bc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.363+0000 7fe2c27ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc153ec0 0x7fe2bc0ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.363+0000 7fe2c27ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0af450 con 0x7fe2bc153ec0 2023-07-27T14:27:08.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.363+0000 7fe2c27ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0ae840 con 0x7fe2bc0aa050 2023-07-27T14:27:08.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.363+0000 7fe2c27ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0aeb20 con 0x7fe2bc0aaa40 2023-07-27T14:27:08.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc153ec0 0x7fe2bc0ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc153ec0 0x7fe2bc0ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55762/0 (socket says 172.21.15.115:55762) 2023-07-27T14:27:08.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 -- 172.21.15.115:0/3135282676 learned_addr learned my addr 172.21.15.115:0/3135282676 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:08.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2bb7fe700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0aaa40 0x7fe2bc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2bbfff700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aa050 0x7fe2bc14c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 -- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0aaa40 msgr2=0x7fe2bc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc0aaa40 0x7fe2bc0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 -- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aa050 msgr2=0x7fe2bc14c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aa050 0x7fe2bc14c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 -- 172.21.15.115:0/3135282676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00092a0 con 0x7fe2bc153ec0 2023-07-27T14:27:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c0d9c700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc153ec0 0x7fe2bc0ae270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fe2b4005ad0 tx=0x7fe2b4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4005d30 con 0x7fe2bc153ec0 2023-07-27T14:27:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4005e90 con 0x7fe2bc153ec0 2023-07-27T14:27:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4007320 con 0x7fe2bc153ec0 2023-07-27T14:27:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.364+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc0aee00 con 0x7fe2bc153ec0 2023-07-27T14:27:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.365+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc0c27e0 con 0x7fe2bc153ec0 2023-07-27T14:27:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.365+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2bc06c470 con 0x7fe2bc153ec0 2023-07-27T14:27:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.366+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe2b4010030 con 0x7fe2bc153ec0 2023-07-27T14:27:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.367+0000 7fe2a3fff700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2a805ed60 0x7fe2a8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.367+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe2b40798d0 con 0x7fe2bc153ec0 2023-07-27T14:27:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.367+0000 7fe2bbfff700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2a805ed60 0x7fe2a8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.367+0000 7fe2a3fff700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:6800/111537,v1:172.21.15.159:6801/111537] conn(0x7fe2a8068100 0x7fe2a806a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.367+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 --> [v2:172.21.15.159:6800/111537,v1:172.21.15.159:6801/111537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2a806abe0 con 0x7fe2a8068100 2023-07-27T14:27:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.367+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2b407e220 con 0x7fe2bc153ec0 2023-07-27T14:27:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.368+0000 7fe2bbfff700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2a805ed60 0x7fe2a8061220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe2ac009b90 tx=0x7fe2ac009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.368+0000 7fe2bb7fe700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:6800/111537,v1:172.21.15.159:6801/111537] conn(0x7fe2a8068100 0x7fe2a806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.368+0000 7fe2bb7fe700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:6800/111537,v1:172.21.15.159:6801/111537] conn(0x7fe2a8068100 0x7fe2a806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.369+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 <== osd.4 v2:172.21.15.159:6800/111537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe2a806abe0 con 0x7fe2a8068100 2023-07-27T14:27:08.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.384+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 --> [v2:172.21.15.159:6800/111537,v1:172.21.15.159:6801/111537] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2bc0aa4d0 con 0x7fe2a8068100 2023-07-27T14:27:08.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.384+0000 7fe2a3fff700 1 -- 172.21.15.115:0/3135282676 <== osd.4 v2:172.21.15.159:6800/111537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2bc0aa4d0 con 0x7fe2a8068100 2023-07-27T14:27:08.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:6800/111537,v1:172.21.15.159:6801/111537] conn(0x7fe2a8068100 msgr2=0x7fe2a806a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.159:6800/111537,v1:172.21.15.159:6801/111537] conn(0x7fe2a8068100 0x7fe2a806a560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2a805ed60 msgr2=0x7fe2a8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2a805ed60 0x7fe2a8061220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe2ac009b90 tx=0x7fe2ac009060).stop 2023-07-27T14:27:08.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc153ec0 msgr2=0x7fe2bc0ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 --2- 172.21.15.115:0/3135282676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc153ec0 0x7fe2bc0ae270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fe2b4005ad0 tx=0x7fe2b4007e10).stop 2023-07-27T14:27:08.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c0d9c700 1 -- 172.21.15.115:0/3135282676 reap_dead start 2023-07-27T14:27:08.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 shutdown_connections 2023-07-27T14:27:08.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 >> 172.21.15.115:0/3135282676 conn(0x7fe2bc0cb610 msgr2=0x7fe2bc0ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:08.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 shutdown_connections 2023-07-27T14:27:08.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.385+0000 7fe2c27ff700 1 -- 172.21.15.115:0/3135282676 wait complete. 2023-07-27T14:27:08.414 INFO:teuthology.orchestra.run.smithi115.stdout:55834574852 2023-07-27T14:27:08.414 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-27T14:27:08.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.589+0000 7f7642dff700 1 Processor -- start 2023-07-27T14:27:08.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.589+0000 7f7642dff700 1 -- start start 2023-07-27T14:27:08.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.590+0000 7f7642dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f763c153ec0 0x7f763c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.590+0000 7f7642dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c0aa050 0x7f763c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.590+0000 7f7642dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f763c0aaa40 0x7f763c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.590+0000 7f7642dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c064ad0 con 0x7f763c0aaa40 2023-07-27T14:27:08.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.590+0000 7f7642dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0aa4d0 con 0x7f763c153ec0 2023-07-27T14:27:08.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.590+0000 7f7642dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0c05c0 con 0x7f763c0aa050 2023-07-27T14:27:08.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f763c0aaa40 0x7f763c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f763c0aaa40 0x7f763c0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55778/0 (socket says 172.21.15.115:55778) 2023-07-27T14:27:08.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 -- 172.21.15.115:0/2305859222 learned_addr learned my addr 172.21.15.115:0/2305859222 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:08.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f763bfff700 1 --2- 172.21.15.115:0/2305859222 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c0aa050 0x7f763c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f7640b9b700 1 --2- 172.21.15.115:0/2305859222 >> v2:172.21.15.159:3300/0 conn(0x7f763c153ec0 0x7f763c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 -- 172.21.15.115:0/2305859222 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c0aa050 msgr2=0x7f763c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:08.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 --2- 172.21.15.115:0/2305859222 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c0aa050 0x7f763c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 -- 172.21.15.115:0/2305859222 >> v2:172.21.15.159:3300/0 conn(0x7f763c153ec0 msgr2=0x7f763c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:08.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 --2- 172.21.15.115:0/2305859222 >> v2:172.21.15.159:3300/0 conn(0x7f763c153ec0 0x7f763c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 -- 172.21.15.115:0/2305859222 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0bfc90 con 0x7f763c0aaa40 2023-07-27T14:27:08.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f7640b9b700 1 --2- 172.21.15.115:0/2305859222 >> v2:172.21.15.159:3300/0 conn(0x7f763c153ec0 0x7f763c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:08.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.591+0000 7f764139c700 1 --2- 172.21.15.115:0/2305859222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 0x7f763c0645e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f763c083e30 tx=0x7f7634009840).ready entity=mon.0 client_cookie=aeadae5bde703af6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f763b7fe700 1 -- 172.21.15.115:0/2305859222 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400e070 con 0x7f763c0aaa40 2023-07-27T14:27:08.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f763b7fe700 1 -- 172.21.15.115:0/2305859222 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763400ba50 con 0x7f763c0aaa40 2023-07-27T14:27:08.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f763b7fe700 1 -- 172.21.15.115:0/2305859222 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400bdd0 con 0x7f763c0aaa40 2023-07-27T14:27:08.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 -- 172.21.15.115:0/2305859222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 msgr2=0x7f763c0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 --2- 172.21.15.115:0/2305859222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 0x7f763c0645e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f763c083e30 tx=0x7f7634009840).stop 2023-07-27T14:27:08.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 -- 172.21.15.115:0/2305859222 shutdown_connections 2023-07-27T14:27:08.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 --2- 172.21.15.115:0/2305859222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 0x7f763c0645e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 --2- 172.21.15.115:0/2305859222 >> v2:172.21.15.159:3300/0 conn(0x7f763c153ec0 0x7f763c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 --2- 172.21.15.115:0/2305859222 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c0aa050 0x7f763c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 -- 172.21.15.115:0/2305859222 >> 172.21.15.115:0/2305859222 conn(0x7f763c0cb610 msgr2=0x7f763c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:08.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 -- 172.21.15.115:0/2305859222 shutdown_connections 2023-07-27T14:27:08.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.592+0000 7f7642dff700 1 -- 172.21.15.115:0/2305859222 wait complete. 2023-07-27T14:27:08.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.594+0000 7f7642dff700 1 Processor -- start 2023-07-27T14:27:08.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.594+0000 7f7642dff700 1 -- start start 2023-07-27T14:27:08.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f7642dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f763c0aa050 0x7f763c142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f7642dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 0x7f763c163a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f7642dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c153ec0 0x7f763c152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f7642dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c151070 con 0x7f763c0aaa40 2023-07-27T14:27:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f7642dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c163f30 con 0x7f763c0aa050 2023-07-27T14:27:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f7642dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c150460 con 0x7f763c153ec0 2023-07-27T14:27:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f763bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 0x7f763c163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f763bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 0x7f763c163a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55782/0 (socket says 172.21.15.115:55782) 2023-07-27T14:27:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f763bfff700 1 -- 172.21.15.115:0/3859509463 learned_addr learned my addr 172.21.15.115:0/3859509463 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f764139c700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c153ec0 0x7f763c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f7640b9b700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f763c0aa050 0x7f763c142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f763bfff700 1 -- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c153ec0 msgr2=0x7f763c152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f763bfff700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f763c153ec0 0x7f763c152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f763bfff700 1 -- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f763c0aa050 msgr2=0x7f763c142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f763bfff700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f763c0aa050 0x7f763c142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.595+0000 7f763bfff700 1 -- 172.21.15.115:0/3859509463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7634009ae0 con 0x7f763c0aaa40 2023-07-27T14:27:08.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.596+0000 7f763bfff700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 0x7f763c163a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f762800d890 tx=0x7f7628008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.596+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280125f0 con 0x7f763c0aaa40 2023-07-27T14:27:08.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.596+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628012750 con 0x7f763c0aaa40 2023-07-27T14:27:08.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.596+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c150740 con 0x7f763c0aaa40 2023-07-27T14:27:08.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.596+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628012ad0 con 0x7f763c0aaa40 2023-07-27T14:27:08.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.596+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c150d00 con 0x7f763c0aaa40 2023-07-27T14:27:08.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.597+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f763c06c470 con 0x7f763c0aaa40 2023-07-27T14:27:08.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.598+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7628013480 con 0x7f763c0aaa40 2023-07-27T14:27:08.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.599+0000 7f7638ff9700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f762005ed90 0x7f7620061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.599+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7628079e20 con 0x7f763c0aaa40 2023-07-27T14:27:08.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.599+0000 7f7640b9b700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f762005ed90 0x7f7620061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.599+0000 7f7638ff9700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:6824/111548,v1:172.21.15.159:6825/111548] conn(0x7f7620068130 0x7f762006a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.599+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 --> [v2:172.21.15.159:6824/111548,v1:172.21.15.159:6825/111548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f762006ac10 con 0x7f7620068130 2023-07-27T14:27:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.599+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f762807c380 con 0x7f763c0aaa40 2023-07-27T14:27:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.599+0000 7f7640b9b700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f762005ed90 0x7f7620061250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7630006d80 tx=0x7f7630008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.600+0000 7f764139c700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:6824/111548,v1:172.21.15.159:6825/111548] conn(0x7f7620068130 0x7f762006a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.600+0000 7f764139c700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:6824/111548,v1:172.21.15.159:6825/111548] conn(0x7f7620068130 0x7f762006a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.601+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 <== osd.5 v2:172.21.15.159:6824/111548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f762006ac10 con 0x7f7620068130 2023-07-27T14:27:08.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.615+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 --> [v2:172.21.15.159:6824/111548,v1:172.21.15.159:6825/111548] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f763c0bff70 con 0x7f7620068130 2023-07-27T14:27:08.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.616+0000 7f7638ff9700 1 -- 172.21.15.115:0/3859509463 <== osd.5 v2:172.21.15.159:6824/111548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f763c0bff70 con 0x7f7620068130 2023-07-27T14:27:08.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.616+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:6824/111548,v1:172.21.15.159:6825/111548] conn(0x7f7620068130 msgr2=0x7f762006a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.616+0000 7f7642dff700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.159:6824/111548,v1:172.21.15.159:6825/111548] conn(0x7f7620068130 0x7f762006a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f762005ed90 msgr2=0x7f7620061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f7642dff700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f762005ed90 0x7f7620061250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7630006d80 tx=0x7f7630008040).stop 2023-07-27T14:27:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 msgr2=0x7f763c163a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f7642dff700 1 --2- 172.21.15.115:0/3859509463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f763c0aaa40 0x7f763c163a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f762800d890 tx=0x7f7628008040).stop 2023-07-27T14:27:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f764139c700 1 -- 172.21.15.115:0/3859509463 reap_dead start 2023-07-27T14:27:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 shutdown_connections 2023-07-27T14:27:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 >> 172.21.15.115:0/3859509463 conn(0x7f763c0cb610 msgr2=0x7f763c0c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 shutdown_connections 2023-07-27T14:27:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.617+0000 7f7642dff700 1 -- 172.21.15.115:0/3859509463 wait complete. 2023-07-27T14:27:08.646 INFO:teuthology.orchestra.run.smithi115.stdout:55834574854 2023-07-27T14:27:08.647 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-27T14:27:08.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.825+0000 7faae49ff700 1 Processor -- start 2023-07-27T14:27:08.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.825+0000 7faae49ff700 1 -- start start 2023-07-27T14:27:08.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faae49ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faae01542a0 0x7faae015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faae49ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae00aa4d0 con 0x7faae00aaa40 2023-07-27T14:27:08.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faae49ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae00c05c0 con 0x7faae0153ec0 2023-07-27T14:27:08.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faae49ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae00c1a60 con 0x7faae01542a0 2023-07-27T14:27:08.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faaddd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7faae00aaa40 0x7faae00640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38618/0 (socket says 172.21.15.115:38618) 2023-07-27T14:27:08.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faaddd9b700 1 -- 172.21.15.115:0/1428865963 learned_addr learned my addr 172.21.15.115:0/1428865963 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:08.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faaded9d700 1 --2- 172.21.15.115:0/1428865963 >> v2:172.21.15.159:3300/0 conn(0x7faae01542a0 0x7faae015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012809694 0 0) 0x7faad4001110 con 0x7faae00aaa40 2023-07-27T14:27:08.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac80033f0 con 0x7faae00aaa40 2023-07-27T14:27:08.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029797533 0 0) 0x7faae00c05c0 con 0x7faae0153ec0 2023-07-27T14:27:08.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad4001110 con 0x7faae0153ec0 2023-07-27T14:27:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4082992826 0 0) 0x7faac80033f0 con 0x7faae00aaa40 2023-07-27T14:27:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 >> v2:172.21.15.159:3300/0 conn(0x7faae01542a0 msgr2=0x7faae015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.827+0000 7faadd59a700 1 --2- 172.21.15.115:0/1428865963 >> v2:172.21.15.159:3300/0 conn(0x7faae01542a0 0x7faae015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 >> v1:172.21.15.159:6789/0 conn(0x7faae0153ec0 legacy=0x7faae00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00aa270 con 0x7faae00aaa40 2023-07-27T14:27:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7faad4001600 con 0x7faae00aaa40 2023-07-27T14:27:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaded9d700 1 --2- 172.21.15.115:0/1428865963 >> v2:172.21.15.159:3300/0 conn(0x7faae01542a0 0x7faae015efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 >> v1:172.21.15.115:6789/0 conn(0x7faae00aaa40 legacy=0x7faae00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac8003a70 0x7faac8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac8004690 0x7faac8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac8005000 0x7faac800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c1a60 con 0x7faac8005000 2023-07-27T14:27:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac800bf60 con 0x7faac8003a70 2023-07-27T14:27:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac800c0d0 con 0x7faac8004690 2023-07-27T14:27:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaded9d700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac8005000 0x7faac800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faade59c700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac8003a70 0x7faac8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaddd9b700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac8004690 0x7faac8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaded9d700 1 -- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac8004690 msgr2=0x7faac8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaded9d700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac8004690 0x7faac8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaded9d700 1 -- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac8003a70 msgr2=0x7faac8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaded9d700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac8003a70 0x7faac8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaded9d700 1 -- 172.21.15.115:0/1428865963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80033f0 con 0x7faac8005000 2023-07-27T14:27:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faade59c700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac8003a70 0x7faac8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.828+0000 7faaded9d700 1 -- 172.21.15.115:0/1428865963 reap_dead start 2023-07-27T14:27:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faaded9d700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac8005000 0x7faac800b8e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7faae0064d00 tx=0x7faad800b040).ready entity=mon.0 client_cookie=5902dcf731e7e7f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8009c50 con 0x7faac8005000 2023-07-27T14:27:08.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad800f040 con 0x7faac8005000 2023-07-27T14:27:08.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faadd59a700 1 -- 172.21.15.115:0/1428865963 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800ee50 con 0x7faac8005000 2023-07-27T14:27:08.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faae49ff700 1 -- 172.21.15.115:0/1428865963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac8005000 msgr2=0x7faac800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faae49ff700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac8005000 0x7faac800b8e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7faae0064d00 tx=0x7faad800b040).stop 2023-07-27T14:27:08.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faae49ff700 1 -- 172.21.15.115:0/1428865963 shutdown_connections 2023-07-27T14:27:08.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faae49ff700 1 --2- 172.21.15.115:0/1428865963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac8005000 0x7faac800b8e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faae49ff700 1 -- 172.21.15.115:0/1428865963 >> 172.21.15.115:0/1428865963 conn(0x7faae00cb610 msgr2=0x7faae00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:08.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faae49ff700 1 -- 172.21.15.115:0/1428865963 shutdown_connections 2023-07-27T14:27:08.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.829+0000 7faae49ff700 1 -- 172.21.15.115:0/1428865963 wait complete. 2023-07-27T14:27:08.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.831+0000 7faae49ff700 1 Processor -- start 2023-07-27T14:27:08.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.831+0000 7faae49ff700 1 -- start start 2023-07-27T14:27:08.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faae49ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac8005000 0x7faae00adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faae49ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae014e7c0 0x7faae014e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faae49ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00c8810 0x7faae00c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faae49ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00aef80 con 0x7faae00c8810 2023-07-27T14:27:08.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faae49ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c9180 con 0x7faae014e7c0 2023-07-27T14:27:08.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faae49ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae00ae370 con 0x7faac8005000 2023-07-27T14:27:08.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00c8810 0x7faae00c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00c8810 0x7faae00c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55800/0 (socket says 172.21.15.115:55800) 2023-07-27T14:27:08.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 -- 172.21.15.115:0/3754403242 learned_addr learned my addr 172.21.15.115:0/3754403242 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:08.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 -- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac8005000 msgr2=0x7faae00adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac8005000 0x7faae00adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:08.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 -- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae014e7c0 msgr2=0x7faae014e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaddd9b700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae014e7c0 0x7faae014e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae014e7c0 0x7faae014e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 -- 172.21.15.115:0/3754403242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00ae650 con 0x7faae00c8810 2023-07-27T14:27:08.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaddd9b700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae014e7c0 0x7faae014e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:08.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.832+0000 7faaded9d700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00c8810 0x7faae00c8c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7faad8008000 tx=0x7faad8018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.833+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad80093a0 con 0x7faae00c8810 2023-07-27T14:27:08.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.833+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad8009c50 con 0x7faae00c8810 2023-07-27T14:27:08.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.833+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad801e840 con 0x7faae00c8810 2023-07-27T14:27:08.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.833+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00ae930 con 0x7faae00c8810 2023-07-27T14:27:08.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.833+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae00ae030 con 0x7faae00c8810 2023-07-27T14:27:08.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.834+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faae006c470 con 0x7faae00c8810 2023-07-27T14:27:08.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.835+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7faad8019070 con 0x7faae00c8810 2023-07-27T14:27:08.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.835+0000 7faace7fc700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faac005edc0 0x7faac0061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.835+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faad807c190 con 0x7faae00c8810 2023-07-27T14:27:08.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.836+0000 7faade59c700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faac005edc0 0x7faac0061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.836+0000 7faace7fc700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:6808/111538,v1:172.21.15.159:6809/111538] conn(0x7faac0068160 0x7faac006a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:08.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.836+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 --> [v2:172.21.15.159:6808/111538,v1:172.21.15.159:6809/111538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faac006ac40 con 0x7faac0068160 2023-07-27T14:27:08.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.836+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faad807e6f0 con 0x7faae00c8810 2023-07-27T14:27:08.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.836+0000 7faade59c700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faac005edc0 0x7faac0061280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7faad0003750 tx=0x7faad0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.836+0000 7faaddd9b700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:6808/111538,v1:172.21.15.159:6809/111538] conn(0x7faac0068160 0x7faac006a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:08.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.837+0000 7faaddd9b700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:6808/111538,v1:172.21.15.159:6809/111538] conn(0x7faac0068160 0x7faac006a5c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:08.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.837+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 <== osd.6 v2:172.21.15.159:6808/111538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7faac006ac40 con 0x7faac0068160 2023-07-27T14:27:08.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.852+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 --> [v2:172.21.15.159:6808/111538,v1:172.21.15.159:6809/111538] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faae00bfc90 con 0x7faac0068160 2023-07-27T14:27:08.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faace7fc700 1 -- 172.21.15.115:0/3754403242 <== osd.6 v2:172.21.15.159:6808/111538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faae00bfc90 con 0x7faac0068160 2023-07-27T14:27:08.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:6808/111538,v1:172.21.15.159:6809/111538] conn(0x7faac0068160 msgr2=0x7faac006a5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.159:6808/111538,v1:172.21.15.159:6809/111538] conn(0x7faac0068160 0x7faac006a5c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:08.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faac005edc0 msgr2=0x7faac0061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faac005edc0 0x7faac0061280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7faad0003750 tx=0x7faad0009040).stop 2023-07-27T14:27:08.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00c8810 msgr2=0x7faae00c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:08.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 --2- 172.21.15.115:0/3754403242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00c8810 0x7faae00c8c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7faad8008000 tx=0x7faad8018000).stop 2023-07-27T14:27:08.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faaded9d700 1 -- 172.21.15.115:0/3754403242 reap_dead start 2023-07-27T14:27:08.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 shutdown_connections 2023-07-27T14:27:08.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 >> 172.21.15.115:0/3754403242 conn(0x7faae00cb610 msgr2=0x7faae00c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:08.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 shutdown_connections 2023-07-27T14:27:08.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:08.854+0000 7faae49ff700 1 -- 172.21.15.115:0/3754403242 wait complete. 2023-07-27T14:27:08.883 INFO:teuthology.orchestra.run.smithi115.stdout:55834574853 2023-07-27T14:27:08.884 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-27T14:27:09.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.058+0000 7fdf4e5ff700 1 Processor -- start 2023-07-27T14:27:09.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.058+0000 7fdf4e5ff700 1 -- start start 2023-07-27T14:27:09.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.059+0000 7fdf4e5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf480a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.059+0000 7fdf4e5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdf480aaa40 0x7fdf480c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.059+0000 7fdf4e5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf480aa4d0 con 0x7fdf480aa050 2023-07-27T14:27:09.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.059+0000 7fdf4e5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf480c05c0 con 0x7fdf480aaa40 2023-07-27T14:27:09.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.059+0000 7fdf4e5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480bfc90 con 0x7fdf48153ec0 2023-07-27T14:27:09.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf47fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf480a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf47fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf480a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:35058/0 (socket says 172.21.15.115:35058) 2023-07-27T14:27:09.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf4cb9c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdf480aaa40 0x7fdf480c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf47fff700 1 -- 172.21.15.115:0/242024966 learned_addr learned my addr 172.21.15.115:0/242024966 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:09.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf47fff700 1 -- 172.21.15.115:0/242024966 >> v2:172.21.15.159:3300/0 conn(0x7fdf480aaa40 msgr2=0x7fdf480c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:09.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf47fff700 1 --2- 172.21.15.115:0/242024966 >> v2:172.21.15.159:3300/0 conn(0x7fdf480aaa40 0x7fdf480c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf47fff700 1 -- 172.21.15.115:0/242024966 >> v1:172.21.15.159:6789/0 conn(0x7fdf480aa050 legacy=0x7fdf480640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf47fff700 1 -- 172.21.15.115:0/242024966 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf480bff70 con 0x7fdf48153ec0 2023-07-27T14:27:09.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.060+0000 7fdf4cb9c700 1 --2- 172.21.15.115:0/242024966 >> v2:172.21.15.159:3300/0 conn(0x7fdf480aaa40 0x7fdf480c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:09.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf47fff700 1 --2- 172.21.15.115:0/242024966 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf480a9b60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fdf38006fd0 tx=0x7fdf380090f0).ready entity=mon.2 client_cookie=55708069443c793c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:09.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf46ffd700 1 -- 172.21.15.115:0/242024966 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800b580 con 0x7fdf48153ec0 2023-07-27T14:27:09.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf46ffd700 1 -- 172.21.15.115:0/242024966 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3800b6e0 con 0x7fdf48153ec0 2023-07-27T14:27:09.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf46ffd700 1 -- 172.21.15.115:0/242024966 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800ba60 con 0x7fdf48153ec0 2023-07-27T14:27:09.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/242024966 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 msgr2=0x7fdf480a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf4e5ff700 1 --2- 172.21.15.115:0/242024966 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf480a9b60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fdf38006fd0 tx=0x7fdf380090f0).stop 2023-07-27T14:27:09.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/242024966 shutdown_connections 2023-07-27T14:27:09.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf4e5ff700 1 --2- 172.21.15.115:0/242024966 >> v2:172.21.15.159:3300/0 conn(0x7fdf480aaa40 0x7fdf480c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf4e5ff700 1 --2- 172.21.15.115:0/242024966 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf480a9b60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/242024966 >> 172.21.15.115:0/242024966 conn(0x7fdf480cb610 msgr2=0x7fdf480c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:09.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/242024966 shutdown_connections 2023-07-27T14:27:09.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.061+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/242024966 wait complete. 2023-07-27T14:27:09.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.063+0000 7fdf4e5ff700 1 Processor -- start 2023-07-27T14:27:09.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.063+0000 7fdf4e5ff700 1 -- start start 2023-07-27T14:27:09.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf4e5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf480aa050 0x7fdf48150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf4e5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf480aaa40 0x7fdf481519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf4e5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf48151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf4e5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48150720 con 0x7fdf480aaa40 2023-07-27T14:27:09.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf4e5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48151540 con 0x7fdf480aa050 2023-07-27T14:27:09.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf4e5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48150930 con 0x7fdf48153ec0 2023-07-27T14:27:09.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf480aaa40 0x7fdf481519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf480aaa40 0x7fdf481519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55804/0 (socket says 172.21.15.115:55804) 2023-07-27T14:27:09.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.064+0000 7fdf477fe700 1 -- 172.21.15.115:0/132828011 learned_addr learned my addr 172.21.15.115:0/132828011 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:09.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf4cb9c700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf48151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf47fff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf480aa050 0x7fdf48150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf477fe700 1 -- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 msgr2=0x7fdf48151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf477fe700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf48153ec0 0x7fdf48151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf477fe700 1 -- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf480aa050 msgr2=0x7fdf48150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf477fe700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf480aa050 0x7fdf48150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf477fe700 1 -- 172.21.15.115:0/132828011 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf40009a20 con 0x7fdf480aaa40 2023-07-27T14:27:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf47fff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf480aa050 0x7fdf48150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf477fe700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf480aaa40 0x7fdf481519d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdf3c00c440 tx=0x7fdf3c007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00f470 con 0x7fdf480aaa40 2023-07-27T14:27:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c00f5d0 con 0x7fdf480aaa40 2023-07-27T14:27:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00f970 con 0x7fdf480aaa40 2023-07-27T14:27:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf38009370 con 0x7fdf480aaa40 2023-07-27T14:27:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.065+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf48150ef0 con 0x7fdf480aaa40 2023-07-27T14:27:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.066+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf4806c470 con 0x7fdf480aaa40 2023-07-27T14:27:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.067+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdf3c022070 con 0x7fdf480aaa40 2023-07-27T14:27:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.068+0000 7fdf2ffff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3405ed90 0x7fdf34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.068+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf3c079950 con 0x7fdf480aaa40 2023-07-27T14:27:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.068+0000 7fdf47fff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3405ed90 0x7fdf34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.068+0000 7fdf2ffff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:6816/111541,v1:172.21.15.159:6817/111541] conn(0x7fdf34068130 0x7fdf3406a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.068+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 --> [v2:172.21.15.159:6816/111541,v1:172.21.15.159:6817/111541] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf3406ac10 con 0x7fdf34068130 2023-07-27T14:27:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.068+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf3c079c40 con 0x7fdf480aaa40 2023-07-27T14:27:09.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.069+0000 7fdf4cb9c700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:6816/111541,v1:172.21.15.159:6817/111541] conn(0x7fdf34068130 0x7fdf3406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.069+0000 7fdf47fff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3405ed90 0x7fdf34061250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdf3800b340 tx=0x7fdf38017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:09.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.069+0000 7fdf4cb9c700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:6816/111541,v1:172.21.15.159:6817/111541] conn(0x7fdf34068130 0x7fdf3406a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:09.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.070+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 <== osd.7 v2:172.21.15.159:6816/111541 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fdf3406ac10 con 0x7fdf34068130 2023-07-27T14:27:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.085+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 --> [v2:172.21.15.159:6816/111541,v1:172.21.15.159:6817/111541] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf480aa4d0 con 0x7fdf34068130 2023-07-27T14:27:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.085+0000 7fdf2ffff700 1 -- 172.21.15.115:0/132828011 <== osd.7 v2:172.21.15.159:6816/111541 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf480aa4d0 con 0x7fdf34068130 2023-07-27T14:27:09.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:6816/111541,v1:172.21.15.159:6817/111541] conn(0x7fdf34068130 msgr2=0x7fdf3406a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.159:6816/111541,v1:172.21.15.159:6817/111541] conn(0x7fdf34068130 0x7fdf3406a590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3405ed90 msgr2=0x7fdf34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3405ed90 0x7fdf34061250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdf3800b340 tx=0x7fdf38017000).stop 2023-07-27T14:27:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf480aaa40 msgr2=0x7fdf481519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 --2- 172.21.15.115:0/132828011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf480aaa40 0x7fdf481519d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdf3c00c440 tx=0x7fdf3c007d00).stop 2023-07-27T14:27:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4cb9c700 1 -- 172.21.15.115:0/132828011 reap_dead start 2023-07-27T14:27:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 shutdown_connections 2023-07-27T14:27:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 >> 172.21.15.115:0/132828011 conn(0x7fdf480cb610 msgr2=0x7fdf480acf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 shutdown_connections 2023-07-27T14:27:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.086+0000 7fdf4e5ff700 1 -- 172.21.15.115:0/132828011 wait complete. 2023-07-27T14:27:09.116 INFO:teuthology.orchestra.run.smithi115.stdout:55834574854 2023-07-27T14:27:09.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-27T14:27:09.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.293+0000 7f0781fff700 1 Processor -- start 2023-07-27T14:27:09.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.293+0000 7f0781fff700 1 -- start start 2023-07-27T14:27:09.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f0781fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f077c0aaa40 0x7f077c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f0781fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0aa4d0 con 0x7f077c153ec0 2023-07-27T14:27:09.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f0781fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0c05c0 con 0x7f077c1542a0 2023-07-27T14:27:09.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f0781fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0aa270 con 0x7f077c0aaa40 2023-07-27T14:27:09.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f077b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f077c153ec0 0x7f077c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38622/0 (socket says 172.21.15.115:38622) 2023-07-27T14:27:09.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f077b7fe700 1 -- 172.21.15.115:0/1960919796 learned_addr learned my addr 172.21.15.115:0/1960919796 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:09.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f077affd700 1 --2- 172.21.15.115:0/1960919796 >> v2:172.21.15.159:3300/0 conn(0x7f077c0aaa40 0x7f077c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f077a7fc700 1 -- 172.21.15.115:0/1960919796 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251524922 0 0) 0x7f076c001110 con 0x7f077c153ec0 2023-07-27T14:27:09.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.295+0000 7f077a7fc700 1 -- 172.21.15.115:0/1960919796 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07640033f0 con 0x7f077c153ec0 2023-07-27T14:27:09.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077a7fc700 1 -- 172.21.15.115:0/1960919796 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272525420 0 0) 0x7f077c0c05c0 con 0x7f077c1542a0 2023-07-27T14:27:09.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077a7fc700 1 -- 172.21.15.115:0/1960919796 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f076c001110 con 0x7f077c1542a0 2023-07-27T14:27:09.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077a7fc700 1 -- 172.21.15.115:0/1960919796 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206626187 0 0) 0x7f07640033f0 con 0x7f077c153ec0 2023-07-27T14:27:09.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077affd700 1 -- 172.21.15.115:0/1960919796 >> v1:172.21.15.159:6789/0 conn(0x7f077c1542a0 legacy=0x7f077c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077affd700 1 -- 172.21.15.115:0/1960919796 >> v1:172.21.15.115:6789/0 conn(0x7f077c153ec0 legacy=0x7f077c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077affd700 1 -- 172.21.15.115:0/1960919796 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0bfc90 con 0x7f077c0aaa40 2023-07-27T14:27:09.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077affd700 1 --2- 172.21.15.115:0/1960919796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c0aaa40 0x7f077c0640f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0770009760 tx=0x7f0770009060).ready entity=mon.1 client_cookie=a9ead424c872bb88 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:09.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077a7fc700 1 -- 172.21.15.115:0/1960919796 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c001600 con 0x7f077c0aaa40 2023-07-27T14:27:09.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077a7fc700 1 -- 172.21.15.115:0/1960919796 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0770011400 con 0x7f077c0aaa40 2023-07-27T14:27:09.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.296+0000 7f077a7fc700 1 -- 172.21.15.115:0/1960919796 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770011780 con 0x7f077c0aaa40 2023-07-27T14:27:09.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.297+0000 7f0781fff700 1 -- 172.21.15.115:0/1960919796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c0aaa40 msgr2=0x7f077c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.297+0000 7f0781fff700 1 --2- 172.21.15.115:0/1960919796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c0aaa40 0x7f077c0640f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0770009760 tx=0x7f0770009060).stop 2023-07-27T14:27:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.297+0000 7f0781fff700 1 -- 172.21.15.115:0/1960919796 shutdown_connections 2023-07-27T14:27:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.297+0000 7f0781fff700 1 --2- 172.21.15.115:0/1960919796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c0aaa40 0x7f077c0640f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.297+0000 7f0781fff700 1 -- 172.21.15.115:0/1960919796 >> 172.21.15.115:0/1960919796 conn(0x7f077c0cb610 msgr2=0x7f077c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.297+0000 7f0781fff700 1 -- 172.21.15.115:0/1960919796 shutdown_connections 2023-07-27T14:27:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.297+0000 7f0781fff700 1 -- 172.21.15.115:0/1960919796 wait complete. 2023-07-27T14:27:09.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.298+0000 7f0781fff700 1 Processor -- start 2023-07-27T14:27:09.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.298+0000 7f0781fff700 1 -- start start 2023-07-27T14:27:09.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.299+0000 7f0781fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c0aaa40 0x7f077c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.299+0000 7f0781fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c153ec0 0x7f077c0afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.299+0000 7f0781fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f077c1542a0 0x7f077c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.299+0000 7f0781fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c14fc60 con 0x7f077c0aaa40 2023-07-27T14:27:09.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.299+0000 7f0781fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0aeb10 con 0x7f077c153ec0 2023-07-27T14:27:09.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.299+0000 7f0781fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0aedf0 con 0x7f077c1542a0 2023-07-27T14:27:09.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c0aaa40 0x7f077c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c0aaa40 0x7f077c14f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55808/0 (socket says 172.21.15.115:55808) 2023-07-27T14:27:09.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 -- 172.21.15.115:0/3648887419 learned_addr learned my addr 172.21.15.115:0/3648887419 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:09.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077affd700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c153ec0 0x7f077c0afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077bfff700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f077c1542a0 0x7f077c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 -- 172.21.15.115:0/3648887419 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f077c1542a0 msgr2=0x7f077c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f077c1542a0 0x7f077c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 -- 172.21.15.115:0/3648887419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c153ec0 msgr2=0x7f077c0afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c153ec0 0x7f077c0afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 -- 172.21.15.115:0/3648887419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700092a0 con 0x7f077c0aaa40 2023-07-27T14:27:09.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f077b7fe700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c0aaa40 0x7f077c14f420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f076c00c930 tx=0x7f076c001ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:09.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f07637fe700 1 -- 172.21.15.115:0/3648887419 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c007170 con 0x7f077c0aaa40 2023-07-27T14:27:09.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f07637fe700 1 -- 172.21.15.115:0/3648887419 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c0072f0 con 0x7f077c0aaa40 2023-07-27T14:27:09.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c0af0d0 con 0x7f077c0aaa40 2023-07-27T14:27:09.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.300+0000 7f07637fe700 1 -- 172.21.15.115:0/3648887419 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c0048c0 con 0x7f077c0aaa40 2023-07-27T14:27:09.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.301+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c0af690 con 0x7f077c0aaa40 2023-07-27T14:27:09.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.302+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c06c470 con 0x7f077c0aaa40 2023-07-27T14:27:09.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.302+0000 7f07637fe700 1 -- 172.21.15.115:0/3648887419 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f076c010070 con 0x7f077c0aaa40 2023-07-27T14:27:09.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.303+0000 7f07637fe700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076805ed90 0x7f0768061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:09.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.303+0000 7f07637fe700 1 -- 172.21.15.115:0/3648887419 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f076c0799d0 con 0x7f077c0aaa40 2023-07-27T14:27:09.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.303+0000 7f077affd700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076805ed90 0x7f0768061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:09.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.304+0000 7f077affd700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076805ed90 0x7f0768061250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f077c0aae20 tx=0x7f0770016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:09.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.307+0000 7f07637fe700 1 -- 172.21.15.115:0/3648887419 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f076c04ae60 con 0x7f077c0aaa40 2023-07-27T14:27:09.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.477+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f077c0aa4d0 con 0x7f077c0aaa40 2023-07-27T14:27:09.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.477+0000 7f07637fe700 1 -- 172.21.15.115:0/3648887419 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f077c0aa4d0 con 0x7f077c0aaa40 2023-07-27T14:27:09.491 INFO:teuthology.orchestra.run.smithi115.stdout:55834574852 2023-07-27T14:27:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076805ed90 msgr2=0x7f0768061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076805ed90 0x7f0768061250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f077c0aae20 tx=0x7f0770016000).stop 2023-07-27T14:27:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c0aaa40 msgr2=0x7f077c14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c0aaa40 0x7f077c14f420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f076c00c930 tx=0x7f076c001ce0).stop 2023-07-27T14:27:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 shutdown_connections 2023-07-27T14:27:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076805ed90 0x7f0768061250 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f077c1542a0 0x7f077c153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077c0aaa40 0x7f077c14f420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 --2- 172.21.15.115:0/3648887419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077c153ec0 0x7f077c0afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 >> 172.21.15.115:0/3648887419 conn(0x7f077c0cb610 msgr2=0x7f077c0aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 shutdown_connections 2023-07-27T14:27:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:09.479+0000 7f0781fff700 1 -- 172.21.15.115:0/3648887419 wait complete. 2023-07-27T14:27:09.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-07-27T14:27:10.512 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-27T14:27:10.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.698+0000 7f26a3fff700 1 Processor -- start 2023-07-27T14:27:10.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.698+0000 7f26a3fff700 1 -- start start 2023-07-27T14:27:10.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.699+0000 7f26a3fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c153ec0 0x7f269c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:10.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.699+0000 7f26a3fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c0aa4d0 con 0x7f269c0aaa40 2023-07-27T14:27:10.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.699+0000 7f26a3fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c0c05c0 con 0x7f269c0aa050 2023-07-27T14:27:10.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.699+0000 7f26a3fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0bfc90 con 0x7f269c153ec0 2023-07-27T14:27:10.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.699+0000 7f26a259c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f269c0aaa40 0x7f269c0c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38638/0 (socket says 172.21.15.115:38638) 2023-07-27T14:27:10.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.699+0000 7f26a259c700 1 -- 172.21.15.115:0/2692782245 learned_addr learned my addr 172.21.15.115:0/2692782245 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:10.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a1d9b700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c153ec0 0x7f269c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:10.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590342887 0 0) 0x7f2694001490 con 0x7f269c0aaa40 2023-07-27T14:27:10.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26880033f0 con 0x7f269c0aaa40 2023-07-27T14:27:10.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682084701 0 0) 0x7f269c0c05c0 con 0x7f269c0aa050 2023-07-27T14:27:10.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2694001490 con 0x7f269c0aa050 2023-07-27T14:27:10.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4151101763 0 0) 0x7f26880033f0 con 0x7f269c0aaa40 2023-07-27T14:27:10.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c153ec0 msgr2=0x7f269c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:10.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c153ec0 0x7f269c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 >> v1:172.21.15.159:6789/0 conn(0x7f269c0aa050 legacy=0x7f269c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:10.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c0bff70 con 0x7f269c0aaa40 2023-07-27T14:27:10.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f2694001980 con 0x7f269c0aaa40 2023-07-27T14:27:10.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 >> v1:172.21.15.115:6789/0 conn(0x7f269c0aaa40 legacy=0x7f269c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:10.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c153ec0 0x7f2688003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:10.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f2688004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:10.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004b80 0x7f2688005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:10.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0bfc90 con 0x7f2688003fb0 2023-07-27T14:27:10.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268800b990 con 0x7f2688004b80 2023-07-27T14:27:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268800bb50 con 0x7f269c153ec0 2023-07-27T14:27:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.700+0000 7f26a159a700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f2688004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a1d9b700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c153ec0 0x7f2688003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a259c700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004b80 0x7f2688005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a159a700 1 -- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c153ec0 msgr2=0x7f2688003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a159a700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c153ec0 0x7f2688003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a159a700 1 -- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004b80 msgr2=0x7f2688005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:10.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a159a700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004b80 0x7f2688005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a159a700 1 -- 172.21.15.115:0/2692782245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880033f0 con 0x7f2688003fb0 2023-07-27T14:27:10.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a159a700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f2688004690 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f269c0c8200 tx=0x7f268c007bb0).ready entity=mon.0 client_cookie=9108794642848231 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:10.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c007020 con 0x7f2688003fb0 2023-07-27T14:27:10.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c007180 con 0x7f2688003fb0 2023-07-27T14:27:10.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.701+0000 7f26a0d99700 1 -- 172.21.15.115:0/2692782245 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c007500 con 0x7f2688003fb0 2023-07-27T14:27:10.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.702+0000 7f26a3fff700 1 -- 172.21.15.115:0/2692782245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 msgr2=0x7f2688004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:10.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.702+0000 7f26a3fff700 1 --2- 172.21.15.115:0/2692782245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f2688004690 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f269c0c8200 tx=0x7f268c007bb0).stop 2023-07-27T14:27:10.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.702+0000 7f26a259c700 1 -- 172.21.15.115:0/2692782245 reap_dead start 2023-07-27T14:27:10.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.702+0000 7f26a3fff700 1 -- 172.21.15.115:0/2692782245 shutdown_connections 2023-07-27T14:27:10.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.702+0000 7f26a3fff700 1 -- 172.21.15.115:0/2692782245 >> 172.21.15.115:0/2692782245 conn(0x7f269c0cb610 msgr2=0x7f269c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:10.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.702+0000 7f26a3fff700 1 -- 172.21.15.115:0/2692782245 shutdown_connections 2023-07-27T14:27:10.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.702+0000 7f26a3fff700 1 -- 172.21.15.115:0/2692782245 wait complete. 2023-07-27T14:27:10.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.703+0000 7f26a3fff700 1 Processor -- start 2023-07-27T14:27:10.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.703+0000 7f26a3fff700 1 -- start start 2023-07-27T14:27:10.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f269c14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:10.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a3fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c150060 0x7f269c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:10.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a3fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f269c1504e0 0x7f269c1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:10.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a3fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c14f480 con 0x7f2688003fb0 2023-07-27T14:27:10.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a3fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c152da0 con 0x7f269c1504e0 2023-07-27T14:27:10.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a3fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c150a40 con 0x7f269c150060 2023-07-27T14:27:10.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f269c14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:10.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f269c14ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55816/0 (socket says 172.21.15.115:55816) 2023-07-27T14:27:10.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.704+0000 7f26a1d9b700 1 -- 172.21.15.115:0/2696843018 learned_addr learned my addr 172.21.15.115:0/2696843018 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:10.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a259c700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f269c1504e0 0x7f269c1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:10.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a159a700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c150060 0x7f269c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:10.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a1d9b700 1 -- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c150060 msgr2=0x7f269c1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:10.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a1d9b700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c150060 0x7f269c1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a1d9b700 1 -- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f269c1504e0 msgr2=0x7f269c1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:10.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a1d9b700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f269c1504e0 0x7f269c1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a1d9b700 1 -- 172.21.15.115:0/2696843018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c150d20 con 0x7f2688003fb0 2023-07-27T14:27:10.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a259c700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f269c1504e0 0x7f269c1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:10.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a1d9b700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f269c14ef90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2698011a20 tx=0x7f2698009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:10.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f2691ffb700 1 -- 172.21.15.115:0/2696843018 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800f940 con 0x7f2688003fb0 2023-07-27T14:27:10.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f2691ffb700 1 -- 172.21.15.115:0/2696843018 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269800faa0 con 0x7f2688003fb0 2023-07-27T14:27:10.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f2691ffb700 1 -- 172.21.15.115:0/2696843018 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800fe20 con 0x7f2688003fb0 2023-07-27T14:27:10.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c151000 con 0x7f2688003fb0 2023-07-27T14:27:10.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.705+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c1515c0 con 0x7f2688003fb0 2023-07-27T14:27:10.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.706+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c06c470 con 0x7f2688003fb0 2023-07-27T14:27:10.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.707+0000 7f2691ffb700 1 -- 172.21.15.115:0/2696843018 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2698024070 con 0x7f2688003fb0 2023-07-27T14:27:10.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.708+0000 7f2691ffb700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005ed90 0x7f2680061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:10.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.708+0000 7f2691ffb700 1 -- 172.21.15.115:0/2696843018 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f269807a590 con 0x7f2688003fb0 2023-07-27T14:27:10.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.708+0000 7f26a159a700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005ed90 0x7f2680061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:10.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.708+0000 7f26a159a700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005ed90 0x7f2680061250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f269c0c8200 tx=0x7f268c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:10.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.712+0000 7f2691ffb700 1 -- 172.21.15.115:0/2696843018 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f269804bb30 con 0x7f2688003fb0 2023-07-27T14:27:10.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.881+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f269c0c0250 con 0x7f2688003fb0 2023-07-27T14:27:10.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.881+0000 7f2691ffb700 1 -- 172.21.15.115:0/2696843018 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f269804f150 con 0x7f2688003fb0 2023-07-27T14:27:10.895 INFO:teuthology.orchestra.run.smithi115.stdout:55834574854 2023-07-27T14:27:10.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005ed90 msgr2=0x7f2680061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:10.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005ed90 0x7f2680061250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f269c0c8200 tx=0x7f268c016000).stop 2023-07-27T14:27:10.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 msgr2=0x7f269c14ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:10.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f269c14ef90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2698011a20 tx=0x7f2698009060).stop 2023-07-27T14:27:10.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 shutdown_connections 2023-07-27T14:27:10.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005ed90 0x7f2680061250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f269c1504e0 0x7f269c1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2688003fb0 0x7f269c14ef90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 --2- 172.21.15.115:0/2696843018 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f269c150060 0x7f269c1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:10.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 >> 172.21.15.115:0/2696843018 conn(0x7f269c0cb610 msgr2=0x7f269c0abad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:10.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 shutdown_connections 2023-07-27T14:27:10.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:10.883+0000 7f26a3fff700 1 -- 172.21.15.115:0/2696843018 wait complete. 2023-07-27T14:27:10.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2023-07-27T14:27:10.914 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-27T14:27:11.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.088+0000 7f98139ff700 1 Processor -- start 2023-07-27T14:27:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.088+0000 7f98139ff700 1 -- start start 2023-07-27T14:27:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.089+0000 7f98139ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f980c153ec0 0x7f980c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.089+0000 7f98139ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aa050 0x7f980c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.089+0000 7f98139ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c0aa4d0 con 0x7f980c0aaa40 2023-07-27T14:27:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.089+0000 7f98139ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0c05c0 con 0x7f980c153ec0 2023-07-27T14:27:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.089+0000 7f98139ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0c1a60 con 0x7f980c0aa050 2023-07-27T14:27:11.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.089+0000 7f9811f9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f980c0aaa40 0x7f980c157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38640/0 (socket says 172.21.15.115:38640) 2023-07-27T14:27:11.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.089+0000 7f981179b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f980c153ec0 0x7f980c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f9811f9c700 1 -- 172.21.15.115:0/1082092582 learned_addr learned my addr 172.21.15.115:0/1082092582 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:11.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f9810f9a700 1 --2- 172.21.15.115:0/1082092582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aa050 0x7f980c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f9803fff700 1 -- 172.21.15.115:0/1082092582 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195497101 0 0) 0x7f9804001490 con 0x7f980c0aaa40 2023-07-27T14:27:11.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f9803fff700 1 -- 172.21.15.115:0/1082092582 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f80033f0 con 0x7f980c0aaa40 2023-07-27T14:27:11.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f981179b700 1 -- 172.21.15.115:0/1082092582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aa050 msgr2=0x7f980c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:11.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f981179b700 1 --2- 172.21.15.115:0/1082092582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aa050 0x7f980c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f981179b700 1 -- 172.21.15.115:0/1082092582 >> v1:172.21.15.115:6789/0 conn(0x7f980c0aaa40 legacy=0x7f980c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f981179b700 1 -- 172.21.15.115:0/1082092582 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0bfc90 con 0x7f980c153ec0 2023-07-27T14:27:11.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f981179b700 1 --2- 172.21.15.115:0/1082092582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c0a9b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9808009760 tx=0x7f9808009060).ready entity=mon.0 client_cookie=f53f54eaccc69aa1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f9803fff700 1 -- 172.21.15.115:0/1082092582 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800d4a0 con 0x7f980c153ec0 2023-07-27T14:27:11.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f9803fff700 1 -- 172.21.15.115:0/1082092582 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800d600 con 0x7f980c153ec0 2023-07-27T14:27:11.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.090+0000 7f9803fff700 1 -- 172.21.15.115:0/1082092582 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800d980 con 0x7f980c153ec0 2023-07-27T14:27:11.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.091+0000 7f98139ff700 1 -- 172.21.15.115:0/1082092582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 msgr2=0x7f980c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.091+0000 7f98139ff700 1 --2- 172.21.15.115:0/1082092582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c0a9b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9808009760 tx=0x7f9808009060).stop 2023-07-27T14:27:11.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.091+0000 7f98139ff700 1 -- 172.21.15.115:0/1082092582 shutdown_connections 2023-07-27T14:27:11.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.091+0000 7f98139ff700 1 --2- 172.21.15.115:0/1082092582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c0a9b60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.091+0000 7f98139ff700 1 --2- 172.21.15.115:0/1082092582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aa050 0x7f980c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.091+0000 7f98139ff700 1 -- 172.21.15.115:0/1082092582 >> 172.21.15.115:0/1082092582 conn(0x7f980c0cb610 msgr2=0x7f980c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:11.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.091+0000 7f98139ff700 1 -- 172.21.15.115:0/1082092582 shutdown_connections 2023-07-27T14:27:11.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.091+0000 7f98139ff700 1 -- 172.21.15.115:0/1082092582 wait complete. 2023-07-27T14:27:11.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.092+0000 7f98139ff700 1 Processor -- start 2023-07-27T14:27:11.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.093+0000 7f98139ff700 1 -- start start 2023-07-27T14:27:11.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.093+0000 7f98139ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f980c0aa050 0x7f980c0c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f98139ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aaa40 0x7f980c1648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f98139ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f98139ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0c3bf0 con 0x7f980c153ec0 2023-07-27T14:27:11.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f98139ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c164dc0 con 0x7f980c0aa050 2023-07-27T14:27:11.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f98139ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0c9f20 con 0x7f980c0aaa40 2023-07-27T14:27:11.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c1524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55836/0 (socket says 172.21.15.115:55836) 2023-07-27T14:27:11.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 -- 172.21.15.115:0/2767975001 learned_addr learned my addr 172.21.15.115:0/2767975001 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:11.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 -- 172.21.15.115:0/2767975001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aaa40 msgr2=0x7f980c1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aaa40 0x7f980c1648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:11.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 -- 172.21.15.115:0/2767975001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f980c0aa050 msgr2=0x7f980c0c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f981179b700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f980c0aa050 0x7f980c0c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f980c0aa050 0x7f980c0c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 -- 172.21.15.115:0/2767975001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080092a0 con 0x7f980c153ec0 2023-07-27T14:27:11.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f981179b700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f980c0aa050 0x7f980c0c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:11.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.094+0000 7f9811f9c700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c1524b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f980400c790 tx=0x7f9804007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.095+0000 7f98017fa700 1 -- 172.21.15.115:0/2767975001 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804005d30 con 0x7f980c153ec0 2023-07-27T14:27:11.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.095+0000 7f98017fa700 1 -- 172.21.15.115:0/2767975001 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9804005e90 con 0x7f980c153ec0 2023-07-27T14:27:11.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.095+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c0c2fe0 con 0x7f980c153ec0 2023-07-27T14:27:11.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.095+0000 7f98017fa700 1 -- 172.21.15.115:0/2767975001 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804007320 con 0x7f980c153ec0 2023-07-27T14:27:11.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.095+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c0c35a0 con 0x7f980c153ec0 2023-07-27T14:27:11.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.096+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c0c4570 con 0x7f980c153ec0 2023-07-27T14:27:11.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.096+0000 7f98017fa700 1 -- 172.21.15.115:0/2767975001 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9804010030 con 0x7f980c153ec0 2023-07-27T14:27:11.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.097+0000 7f98017fa700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f005ed60 0x7f97f0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.097+0000 7f98017fa700 1 -- 172.21.15.115:0/2767975001 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9804079990 con 0x7f980c153ec0 2023-07-27T14:27:11.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.098+0000 7f981179b700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f005ed60 0x7f97f0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.098+0000 7f981179b700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f005ed60 0x7f97f0061220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f980c0c4800 tx=0x7f9808016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.101+0000 7f98017fa700 1 -- 172.21.15.115:0/2767975001 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f980404ae20 con 0x7f980c153ec0 2023-07-27T14:27:11.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.271+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f980c0aa4d0 con 0x7f980c153ec0 2023-07-27T14:27:11.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.271+0000 7f98017fa700 1 -- 172.21.15.115:0/2767975001 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f980c0aa4d0 con 0x7f980c153ec0 2023-07-27T14:27:11.285 INFO:teuthology.orchestra.run.smithi115.stdout:55834574853 2023-07-27T14:27:11.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f005ed60 msgr2=0x7f97f0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f005ed60 0x7f97f0061220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f980c0c4800 tx=0x7f9808016000).stop 2023-07-27T14:27:11.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 msgr2=0x7f980c1524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c1524b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f980400c790 tx=0x7f9804007db0).stop 2023-07-27T14:27:11.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 shutdown_connections 2023-07-27T14:27:11.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f005ed60 0x7f97f0061220 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f980c153ec0 0x7f980c1524b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f980c0aa050 0x7f980c0c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 --2- 172.21.15.115:0/2767975001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f980c0aaa40 0x7f980c1648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:11.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 >> 172.21.15.115:0/2767975001 conn(0x7f980c0cb610 msgr2=0x7f980c0640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:11.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 shutdown_connections 2023-07-27T14:27:11.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.273+0000 7f98139ff700 1 -- 172.21.15.115:0/2767975001 wait complete. 2023-07-27T14:27:11.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.1 2023-07-27T14:27:11.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-27T14:27:11.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.479+0000 7f94589ff700 1 Processor -- start 2023-07-27T14:27:11.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.479+0000 7f94589ff700 1 -- start start 2023-07-27T14:27:11.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f94589ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9454153ec0 0x7f94540a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f94589ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94540aa050 0x7f94540640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f94589ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94540aa4d0 con 0x7f94540aaa40 2023-07-27T14:27:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f94589ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94540c05c0 con 0x7f9454153ec0 2023-07-27T14:27:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f94589ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94540c1a60 con 0x7f94540aa050 2023-07-27T14:27:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f945259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9454153ec0 0x7f94540a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f9452d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f94540aaa40 0x7f9454157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38654/0 (socket says 172.21.15.115:38654) 2023-07-27T14:27:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f9452d9d700 1 -- 172.21.15.115:0/1041927834 learned_addr learned my addr 172.21.15.115:0/1041927834 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f9451d9b700 1 --2- 172.21.15.115:0/1041927834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94540aa050 0x7f94540640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f945159a700 1 -- 172.21.15.115:0/1041927834 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862488466 0 0) 0x7f944c001490 con 0x7f94540aaa40 2023-07-27T14:27:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f945259c700 1 -- 172.21.15.115:0/1041927834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94540aa050 msgr2=0x7f94540640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f945259c700 1 --2- 172.21.15.115:0/1041927834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94540aa050 0x7f94540640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f945259c700 1 -- 172.21.15.115:0/1041927834 >> v1:172.21.15.115:6789/0 conn(0x7f94540aaa40 legacy=0x7f9454157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f945259c700 1 -- 172.21.15.115:0/1041927834 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94540bfc90 con 0x7f9454153ec0 2023-07-27T14:27:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.481+0000 7f9451d9b700 1 --2- 172.21.15.115:0/1041927834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94540aa050 0x7f94540640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f945259c700 1 --2- 172.21.15.115:0/1041927834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9454153ec0 0x7f94540a9b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f9444009760 tx=0x7f9444009060).ready entity=mon.0 client_cookie=241c197c512a7a2e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f945159a700 1 -- 172.21.15.115:0/1041927834 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400b580 con 0x7f9454153ec0 2023-07-27T14:27:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f945159a700 1 -- 172.21.15.115:0/1041927834 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400b6e0 con 0x7f9454153ec0 2023-07-27T14:27:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f945159a700 1 -- 172.21.15.115:0/1041927834 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400ba60 con 0x7f9454153ec0 2023-07-27T14:27:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f94589ff700 1 -- 172.21.15.115:0/1041927834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9454153ec0 msgr2=0x7f94540a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f94589ff700 1 --2- 172.21.15.115:0/1041927834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9454153ec0 0x7f94540a9b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f9444009760 tx=0x7f9444009060).stop 2023-07-27T14:27:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f94589ff700 1 -- 172.21.15.115:0/1041927834 shutdown_connections 2023-07-27T14:27:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f94589ff700 1 --2- 172.21.15.115:0/1041927834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9454153ec0 0x7f94540a9b60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f94589ff700 1 --2- 172.21.15.115:0/1041927834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94540aa050 0x7f94540640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f94589ff700 1 -- 172.21.15.115:0/1041927834 >> 172.21.15.115:0/1041927834 conn(0x7f94540cb610 msgr2=0x7f94540c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.482+0000 7f94589ff700 1 -- 172.21.15.115:0/1041927834 shutdown_connections 2023-07-27T14:27:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.483+0000 7f94589ff700 1 -- 172.21.15.115:0/1041927834 wait complete. 2023-07-27T14:27:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.484+0000 7f94589ff700 1 Processor -- start 2023-07-27T14:27:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.485+0000 7f94589ff700 1 -- start start 2023-07-27T14:27:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f94589ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94540aa050 0x7f9454167860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f94589ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94540aaa40 0x7f9454167d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f94589ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9454153ec0 0x7f94540c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f94589ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94540c4790 con 0x7f94540aaa40 2023-07-27T14:27:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f94589ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9454168240 con 0x7f94540aa050 2023-07-27T14:27:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f94589ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94540c44b0 con 0x7f9454153ec0 2023-07-27T14:27:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f9451d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94540aaa40 0x7f9454167d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f9451d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94540aaa40 0x7f9454167d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55852/0 (socket says 172.21.15.115:55852) 2023-07-27T14:27:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f9451d9b700 1 -- 172.21.15.115:0/891412275 learned_addr learned my addr 172.21.15.115:0/891412275 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:11.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f9452d9d700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9454153ec0 0x7f94540c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.486+0000 7f945259c700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94540aa050 0x7f9454167860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f9451d9b700 1 -- 172.21.15.115:0/891412275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9454153ec0 msgr2=0x7f94540c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f9451d9b700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9454153ec0 0x7f94540c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f9451d9b700 1 -- 172.21.15.115:0/891412275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94540aa050 msgr2=0x7f9454167860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f9451d9b700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94540aa050 0x7f9454167860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f9451d9b700 1 -- 172.21.15.115:0/891412275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94440092a0 con 0x7f94540aaa40 2023-07-27T14:27:11.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f9451d9b700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94540aaa40 0x7f9454167d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f944800c880 tx=0x7f9448008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f94427fc700 1 -- 172.21.15.115:0/891412275 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448010580 con 0x7f94540aaa40 2023-07-27T14:27:11.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f94427fc700 1 -- 172.21.15.115:0/891412275 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94480106e0 con 0x7f94540aaa40 2023-07-27T14:27:11.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9454165600 con 0x7f94540aaa40 2023-07-27T14:27:11.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f94427fc700 1 -- 172.21.15.115:0/891412275 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448010a60 con 0x7f94540aaa40 2023-07-27T14:27:11.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.487+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9454165bc0 con 0x7f94540aaa40 2023-07-27T14:27:11.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.488+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9454165460 con 0x7f94540aaa40 2023-07-27T14:27:11.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.489+0000 7f94427fc700 1 -- 172.21.15.115:0/891412275 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f944801b460 con 0x7f94540aaa40 2023-07-27T14:27:11.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.490+0000 7f94427fc700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405ed60 0x7f9434061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.490+0000 7f94427fc700 1 -- 172.21.15.115:0/891412275 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9448079ce0 con 0x7f94540aaa40 2023-07-27T14:27:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.490+0000 7f945259c700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405ed60 0x7f9434061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.490+0000 7f945259c700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405ed60 0x7f9434061220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9444006d30 tx=0x7f9444017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.494+0000 7f94427fc700 1 -- 172.21.15.115:0/891412275 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9454165460 con 0x7f94540aaa40 2023-07-27T14:27:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.667+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9454165460 con 0x7f94540aaa40 2023-07-27T14:27:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.667+0000 7f94427fc700 1 -- 172.21.15.115:0/891412275 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9454165460 con 0x7f94540aaa40 2023-07-27T14:27:11.682 INFO:teuthology.orchestra.run.smithi115.stdout:55834574854 2023-07-27T14:27:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.669+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405ed60 msgr2=0x7f9434061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.669+0000 7f94589ff700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405ed60 0x7f9434061220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9444006d30 tx=0x7f9444017000).stop 2023-07-27T14:27:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.669+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94540aaa40 msgr2=0x7f9454167d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.669+0000 7f94589ff700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94540aaa40 0x7f9454167d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f944800c880 tx=0x7f9448008040).stop 2023-07-27T14:27:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.670+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 shutdown_connections 2023-07-27T14:27:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.670+0000 7f94589ff700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405ed60 0x7f9434061220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.670+0000 7f94589ff700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9454153ec0 0x7f94540c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.670+0000 7f94589ff700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94540aa050 0x7f9454167860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.670+0000 7f94589ff700 1 --2- 172.21.15.115:0/891412275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94540aaa40 0x7f9454167d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.670+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 >> 172.21.15.115:0/891412275 conn(0x7f94540cb610 msgr2=0x7f94540c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.670+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 shutdown_connections 2023-07-27T14:27:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.670+0000 7f94589ff700 1 -- 172.21.15.115:0/891412275 wait complete. 2023-07-27T14:27:11.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-07-27T14:27:11.701 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-27T14:27:11.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.876+0000 7f4545bff700 1 Processor -- start 2023-07-27T14:27:11.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.876+0000 7f4545bff700 1 -- start start 2023-07-27T14:27:11.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.877+0000 7f4545bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 0x7f45400640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.877+0000 7f4545bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45401542a0 0x7f45400645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.877+0000 7f4545bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45400aa4d0 con 0x7f4540153ec0 2023-07-27T14:27:11.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.877+0000 7f4545bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540064ad0 con 0x7f45401542a0 2023-07-27T14:27:11.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f4545bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400c05c0 con 0x7f45400aaa40 2023-07-27T14:27:11.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4540153ec0 0x7f45400a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38656/0 (socket says 172.21.15.115:38656) 2023-07-27T14:27:11.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453f7fe700 1 -- 172.21.15.115:0/79244433 learned_addr learned my addr 172.21.15.115:0/79244433 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:11.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453effd700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 0x7f45400640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453ffff700 1 --2- 172.21.15.115:0/79244433 >> v2:172.21.15.159:3300/0 conn(0x7f45401542a0 0x7f45400645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600087211 0 0) 0x7f4530001110 con 0x7f4540153ec0 2023-07-27T14:27:11.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45280033f0 con 0x7f4540153ec0 2023-07-27T14:27:11.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 744151284 0 0) 0x7f45280033f0 con 0x7f4540153ec0 2023-07-27T14:27:11.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 msgr2=0x7f45400640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:11.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 0x7f45400640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 >> v2:172.21.15.159:3300/0 conn(0x7f45401542a0 msgr2=0x7f45400645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:11.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 --2- 172.21.15.115:0/79244433 >> v2:172.21.15.159:3300/0 conn(0x7f45401542a0 0x7f45400645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400c1a60 con 0x7f4540153ec0 2023-07-27T14:27:11.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4530001600 con 0x7f4540153ec0 2023-07-27T14:27:11.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453ffff700 1 --2- 172.21.15.115:0/79244433 >> v2:172.21.15.159:3300/0 conn(0x7f45401542a0 0x7f45400645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:11.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.878+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 >> v1:172.21.15.115:6789/0 conn(0x7f4540153ec0 legacy=0x7f45400a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453e7fc700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 0x7f45280038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453e7fc700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4528003e10 0x7f4528004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453e7fc700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4528004b80 0x7f4528005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4540064ad0 con 0x7f4528003e10 2023-07-27T14:27:11.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400c05c0 con 0x7f4528004b80 2023-07-27T14:27:11.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452800b8e0 con 0x7f45400aaa40 2023-07-27T14:27:11.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453effd700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4528003e10 0x7f4528004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453f7fe700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 0x7f45280038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453ffff700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4528004b80 0x7f4528005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453effd700 1 -- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 msgr2=0x7f45280038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:11.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453effd700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 0x7f45280038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453effd700 1 -- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4528004b80 msgr2=0x7f4528005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:11.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453effd700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4528004b80 0x7f4528005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453effd700 1 -- 172.21.15.115:0/79244433 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280033f0 con 0x7f4528003e10 2023-07-27T14:27:11.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453f7fe700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45400aaa40 0x7f45280038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:11.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.879+0000 7f453effd700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4528003e10 0x7f4528004690 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4534009a80 tx=0x7f4534009060).ready entity=mon.0 client_cookie=c0dd25c1ea4244c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534009430 con 0x7f4528003e10 2023-07-27T14:27:11.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453400e640 con 0x7f4528003e10 2023-07-27T14:27:11.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f453e7fc700 1 -- 172.21.15.115:0/79244433 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400e9c0 con 0x7f4528003e10 2023-07-27T14:27:11.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f4545bff700 1 -- 172.21.15.115:0/79244433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4528003e10 msgr2=0x7f4528004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f4545bff700 1 --2- 172.21.15.115:0/79244433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4528003e10 0x7f4528004690 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4534009a80 tx=0x7f4534009060).stop 2023-07-27T14:27:11.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f453ffff700 1 -- 172.21.15.115:0/79244433 reap_dead start 2023-07-27T14:27:11.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f4545bff700 1 -- 172.21.15.115:0/79244433 shutdown_connections 2023-07-27T14:27:11.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f4545bff700 1 -- 172.21.15.115:0/79244433 >> 172.21.15.115:0/79244433 conn(0x7f45400cb610 msgr2=0x7f45400c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f4545bff700 1 -- 172.21.15.115:0/79244433 shutdown_connections 2023-07-27T14:27:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.880+0000 7f4545bff700 1 -- 172.21.15.115:0/79244433 wait complete. 2023-07-27T14:27:11.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.882+0000 7f4545bff700 1 Processor -- start 2023-07-27T14:27:11.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.882+0000 7f4545bff700 1 -- start start 2023-07-27T14:27:11.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f4545bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4528003e10 0x7f45401651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f4545bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540152d70 0x7f4540167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f4545bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45401531f0 0x7f45401680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f4545bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400a9800 con 0x7f45401531f0 2023-07-27T14:27:11.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f4545bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4540164d60 con 0x7f4540152d70 2023-07-27T14:27:11.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f4545bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4540150380 con 0x7f4528003e10 2023-07-27T14:27:11.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45401531f0 0x7f45401680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45401531f0 0x7f45401680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55872/0 (socket says 172.21.15.115:55872) 2023-07-27T14:27:11.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453ffff700 1 -- 172.21.15.115:0/3120509173 learned_addr learned my addr 172.21.15.115:0/3120509173 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:11.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453f7fe700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4528003e10 0x7f45401651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453effd700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540152d70 0x7f4540167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453ffff700 1 -- 172.21.15.115:0/3120509173 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4528003e10 msgr2=0x7f45401651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453ffff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4528003e10 0x7f45401651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453ffff700 1 -- 172.21.15.115:0/3120509173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540152d70 msgr2=0x7f4540167bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:11.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453ffff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540152d70 0x7f4540167bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:11.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.883+0000 7f453ffff700 1 -- 172.21.15.115:0/3120509173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540168720 con 0x7f45401531f0 2023-07-27T14:27:11.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.884+0000 7f453ffff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45401531f0 0x7f45401680c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f45400607e0 tx=0x7f453800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.884+0000 7f45277fe700 1 -- 172.21.15.115:0/3120509173 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800e070 con 0x7f45401531f0 2023-07-27T14:27:11.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.884+0000 7f45277fe700 1 -- 172.21.15.115:0/3120509173 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538011c50 con 0x7f45401531f0 2023-07-27T14:27:11.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.884+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4540168a00 con 0x7f45401531f0 2023-07-27T14:27:11.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.884+0000 7f45277fe700 1 -- 172.21.15.115:0/3120509173 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538016450 con 0x7f45401531f0 2023-07-27T14:27:11.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.884+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45401649f0 con 0x7f45401531f0 2023-07-27T14:27:11.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.885+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4540164ef0 con 0x7f45401531f0 2023-07-27T14:27:11.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.886+0000 7f45277fe700 1 -- 172.21.15.115:0/3120509173 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f453801d030 con 0x7f45401531f0 2023-07-27T14:27:11.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.886+0000 7f45277fe700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05ed90 0x7f452c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.886+0000 7f45277fe700 1 -- 172.21.15.115:0/3120509173 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f453807a090 con 0x7f45401531f0 2023-07-27T14:27:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.887+0000 7f453f7fe700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05ed90 0x7f452c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.887+0000 7f453f7fe700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05ed90 0x7f452c061250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4530001010 tx=0x7f4530000cc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:11.891+0000 7f45277fe700 1 -- 172.21.15.115:0/3120509173 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f453804b570 con 0x7f45401531f0 2023-07-27T14:27:12.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.058+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f45400bff60 con 0x7f45401531f0 2023-07-27T14:27:12.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.059+0000 7f45277fe700 1 -- 172.21.15.115:0/3120509173 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f453804eb90 con 0x7f45401531f0 2023-07-27T14:27:12.073 INFO:teuthology.orchestra.run.smithi115.stdout:55834574853 2023-07-27T14:27:12.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05ed90 msgr2=0x7f452c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05ed90 0x7f452c061250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4530001010 tx=0x7f4530000cc0).stop 2023-07-27T14:27:12.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45401531f0 msgr2=0x7f45401680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45401531f0 0x7f45401680c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f45400607e0 tx=0x7f453800b040).stop 2023-07-27T14:27:12.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 shutdown_connections 2023-07-27T14:27:12.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05ed90 0x7f452c061250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45401531f0 0x7f45401680c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4528003e10 0x7f45401651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 --2- 172.21.15.115:0/3120509173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540152d70 0x7f4540167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 >> 172.21.15.115:0/3120509173 conn(0x7f45400cb610 msgr2=0x7f45400c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:12.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 shutdown_connections 2023-07-27T14:27:12.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.061+0000 7f4545bff700 1 -- 172.21.15.115:0/3120509173 wait complete. 2023-07-27T14:27:12.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2023-07-27T14:27:12.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-27T14:27:12.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.266+0000 7f8cec3ff700 1 Processor -- start 2023-07-27T14:27:12.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.267+0000 7f8cec3ff700 1 -- start start 2023-07-27T14:27:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cec3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ce4153ec0 0x7f8ce40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cec3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8ce40aaa40 0x7f8ce40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cec3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce40aa4d0 con 0x7f8ce40aa050 2023-07-27T14:27:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cec3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce40c05c0 con 0x7f8ce4153ec0 2023-07-27T14:27:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cec3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce40bfc90 con 0x7f8ce40aaa40 2023-07-27T14:27:12.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cea19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ce4153ec0 0x7f8ce40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cea19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ce4153ec0 0x7f8ce40a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55878/0 (socket says 172.21.15.115:55878) 2023-07-27T14:27:12.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cea19b700 1 -- 172.21.15.115:0/634716900 learned_addr learned my addr 172.21.15.115:0/634716900 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:12.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.268+0000 7f8cea99c700 1 --2- 172.21.15.115:0/634716900 >> v2:172.21.15.159:3300/0 conn(0x7f8ce40aaa40 0x7f8ce40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8cea19b700 1 -- 172.21.15.115:0/634716900 >> v2:172.21.15.159:3300/0 conn(0x7f8ce40aaa40 msgr2=0x7f8ce40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:12.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8cea19b700 1 --2- 172.21.15.115:0/634716900 >> v2:172.21.15.159:3300/0 conn(0x7f8ce40aaa40 0x7f8ce40c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8cea19b700 1 -- 172.21.15.115:0/634716900 >> v1:172.21.15.159:6789/0 conn(0x7f8ce40aa050 legacy=0x7f8ce40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8cea19b700 1 -- 172.21.15.115:0/634716900 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce40bff70 con 0x7f8ce4153ec0 2023-07-27T14:27:12.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8cea19b700 1 --2- 172.21.15.115:0/634716900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce4153ec0 0x7f8ce40a9b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8ce40c5470 tx=0x7f8ce00090f0).ready entity=mon.0 client_cookie=81da6c87ceaf0668 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:12.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8ce9199700 1 -- 172.21.15.115:0/634716900 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000b520 con 0x7f8ce4153ec0 2023-07-27T14:27:12.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8ce9199700 1 -- 172.21.15.115:0/634716900 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce000b680 con 0x7f8ce4153ec0 2023-07-27T14:27:12.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8ce9199700 1 -- 172.21.15.115:0/634716900 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000ba00 con 0x7f8ce4153ec0 2023-07-27T14:27:12.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8cec3ff700 1 -- 172.21.15.115:0/634716900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce4153ec0 msgr2=0x7f8ce40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.269+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/634716900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce4153ec0 0x7f8ce40a9b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8ce40c5470 tx=0x7f8ce00090f0).stop 2023-07-27T14:27:12.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.270+0000 7f8cec3ff700 1 -- 172.21.15.115:0/634716900 shutdown_connections 2023-07-27T14:27:12.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.270+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/634716900 >> v2:172.21.15.159:3300/0 conn(0x7f8ce40aaa40 0x7f8ce40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.270+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/634716900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce4153ec0 0x7f8ce40a9b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.270+0000 7f8cec3ff700 1 -- 172.21.15.115:0/634716900 >> 172.21.15.115:0/634716900 conn(0x7f8ce40cb610 msgr2=0x7f8ce40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:12.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.270+0000 7f8cec3ff700 1 -- 172.21.15.115:0/634716900 shutdown_connections 2023-07-27T14:27:12.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.270+0000 7f8cec3ff700 1 -- 172.21.15.115:0/634716900 wait complete. 2023-07-27T14:27:12.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.272+0000 7f8cec3ff700 1 Processor -- start 2023-07-27T14:27:12.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.272+0000 7f8cec3ff700 1 -- start start 2023-07-27T14:27:12.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.273+0000 7f8cec3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce40aa050 0x7f8ce40c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.273+0000 7f8cec3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce40aaa40 0x7f8ce414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.273+0000 7f8cec3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ce4153ec0 0x7f8ce40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.273+0000 7f8cec3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4153800 con 0x7f8ce40aaa40 2023-07-27T14:27:12.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.273+0000 7f8cec3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40c3580 con 0x7f8ce40aa050 2023-07-27T14:27:12.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.273+0000 7f8cec3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4163fc0 con 0x7f8ce4153ec0 2023-07-27T14:27:12.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.273+0000 7f8ce999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce40aaa40 0x7f8ce414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8ce999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce40aaa40 0x7f8ce414c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55894/0 (socket says 172.21.15.115:55894) 2023-07-27T14:27:12.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8ce999a700 1 -- 172.21.15.115:0/319241000 learned_addr learned my addr 172.21.15.115:0/319241000 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:12.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8cea19b700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce40aa050 0x7f8ce40c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8cea99c700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ce4153ec0 0x7f8ce40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8ce999a700 1 -- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ce4153ec0 msgr2=0x7f8ce40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8ce999a700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ce4153ec0 0x7f8ce40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8ce999a700 1 -- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce40aa050 msgr2=0x7f8ce40c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8ce999a700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce40aa050 0x7f8ce40c2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8ce999a700 1 -- 172.21.15.115:0/319241000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0009370 con 0x7f8ce40aaa40 2023-07-27T14:27:12.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8cea99c700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ce4153ec0 0x7f8ce40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:12.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8ce999a700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce40aaa40 0x7f8ce414c940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8cd400c4c0 tx=0x7f8cd4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:12.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8cda7fc700 1 -- 172.21.15.115:0/319241000 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4007020 con 0x7f8ce40aaa40 2023-07-27T14:27:12.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8cda7fc700 1 -- 172.21.15.115:0/319241000 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd4001e90 con 0x7f8ce40aaa40 2023-07-27T14:27:12.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8cda7fc700 1 -- 172.21.15.115:0/319241000 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40073b0 con 0x7f8ce40aaa40 2023-07-27T14:27:12.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce4153240 con 0x7f8ce40aaa40 2023-07-27T14:27:12.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.274+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce40c3210 con 0x7f8ce40aaa40 2023-07-27T14:27:12.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.275+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce40c3710 con 0x7f8ce40aaa40 2023-07-27T14:27:12.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.276+0000 7f8cda7fc700 1 -- 172.21.15.115:0/319241000 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8cd4010070 con 0x7f8ce40aaa40 2023-07-27T14:27:12.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.277+0000 7f8cda7fc700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8cc805ede0 0x7f8cc80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.277+0000 7f8cda7fc700 1 -- 172.21.15.115:0/319241000 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8cd40792b0 con 0x7f8ce40aaa40 2023-07-27T14:27:12.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.277+0000 7f8cea19b700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8cc805ede0 0x7f8cc80612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.278+0000 7f8cea19b700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8cc805ede0 0x7f8cc80612a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f8ce0009130 tx=0x7f8ce0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:12.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.281+0000 7f8cda7fc700 1 -- 172.21.15.115:0/319241000 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8cd404a7c0 con 0x7f8ce40aaa40 2023-07-27T14:27:12.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.448+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8ce40aa4d0 con 0x7f8ce40aaa40 2023-07-27T14:27:12.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.448+0000 7f8cda7fc700 1 -- 172.21.15.115:0/319241000 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ce40aa4d0 con 0x7f8ce40aaa40 2023-07-27T14:27:12.462 INFO:teuthology.orchestra.run.smithi115.stdout:55834574853 2023-07-27T14:27:12.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8cc805ede0 msgr2=0x7f8cc80612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8cc805ede0 0x7f8cc80612a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f8ce0009130 tx=0x7f8ce0017000).stop 2023-07-27T14:27:12.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce40aaa40 msgr2=0x7f8ce414c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce40aaa40 0x7f8ce414c940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8cd400c4c0 tx=0x7f8cd4007e00).stop 2023-07-27T14:27:12.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 shutdown_connections 2023-07-27T14:27:12.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8cc805ede0 0x7f8cc80612a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ce4153ec0 0x7f8ce40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ce40aa050 0x7f8ce40c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 --2- 172.21.15.115:0/319241000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ce40aaa40 0x7f8ce414c940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 >> 172.21.15.115:0/319241000 conn(0x7f8ce40cb610 msgr2=0x7f8ce40ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:12.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 shutdown_connections 2023-07-27T14:27:12.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.450+0000 7f8cec3ff700 1 -- 172.21.15.115:0/319241000 wait complete. 2023-07-27T14:27:12.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2023-07-27T14:27:12.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-27T14:27:12.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.658+0000 7f3babfff700 1 Processor -- start 2023-07-27T14:27:12.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.658+0000 7f3babfff700 1 -- start start 2023-07-27T14:27:12.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.659+0000 7f3babfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3ba4153ec0 0x7f3ba40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.659+0000 7f3babfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 0x7f3ba40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.659+0000 7f3babfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba40aa4d0 con 0x7f3ba40aaa40 2023-07-27T14:27:12.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.659+0000 7f3babfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba40c05c0 con 0x7f3ba4153ec0 2023-07-27T14:27:12.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.659+0000 7f3babfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c1a60 con 0x7f3ba40aa050 2023-07-27T14:27:12.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba9d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3ba4153ec0 0x7f3ba40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3baa59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3ba40aaa40 0x7f3ba4157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38672/0 (socket says 172.21.15.115:38672) 2023-07-27T14:27:12.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3baa59c700 1 -- 172.21.15.115:0/744739205 learned_addr learned my addr 172.21.15.115:0/744739205 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:12.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba959a700 1 --2- 172.21.15.115:0/744739205 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 0x7f3ba40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba8d99700 1 -- 172.21.15.115:0/744739205 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943070156 0 0) 0x7f3b9c001490 con 0x7f3ba40aaa40 2023-07-27T14:27:12.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba8d99700 1 -- 172.21.15.115:0/744739205 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b900033f0 con 0x7f3ba40aaa40 2023-07-27T14:27:12.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba9d9b700 1 -- 172.21.15.115:0/744739205 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 msgr2=0x7f3ba40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:12.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba9d9b700 1 --2- 172.21.15.115:0/744739205 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 0x7f3ba40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba9d9b700 1 -- 172.21.15.115:0/744739205 >> v1:172.21.15.115:6789/0 conn(0x7f3ba40aaa40 legacy=0x7f3ba4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba9d9b700 1 -- 172.21.15.115:0/744739205 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba40bfc90 con 0x7f3ba4153ec0 2023-07-27T14:27:12.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.660+0000 7f3ba9d9b700 1 --2- 172.21.15.115:0/744739205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40a9b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f3ba0009760 tx=0x7f3ba0009060).ready entity=mon.0 client_cookie=d104474a1bbae047 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:12.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3ba8d99700 1 -- 172.21.15.115:0/744739205 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000d4a0 con 0x7f3ba4153ec0 2023-07-27T14:27:12.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3ba8d99700 1 -- 172.21.15.115:0/744739205 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000d600 con 0x7f3ba4153ec0 2023-07-27T14:27:12.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3ba8d99700 1 -- 172.21.15.115:0/744739205 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000d980 con 0x7f3ba4153ec0 2023-07-27T14:27:12.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3babfff700 1 -- 172.21.15.115:0/744739205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 msgr2=0x7f3ba40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3babfff700 1 --2- 172.21.15.115:0/744739205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40a9b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f3ba0009760 tx=0x7f3ba0009060).stop 2023-07-27T14:27:12.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3babfff700 1 -- 172.21.15.115:0/744739205 shutdown_connections 2023-07-27T14:27:12.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3babfff700 1 --2- 172.21.15.115:0/744739205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40a9b60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3babfff700 1 --2- 172.21.15.115:0/744739205 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 0x7f3ba40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3babfff700 1 -- 172.21.15.115:0/744739205 >> 172.21.15.115:0/744739205 conn(0x7f3ba40cb610 msgr2=0x7f3ba40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:12.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3babfff700 1 -- 172.21.15.115:0/744739205 shutdown_connections 2023-07-27T14:27:12.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.661+0000 7f3babfff700 1 -- 172.21.15.115:0/744739205 wait complete. 2023-07-27T14:27:12.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.663+0000 7f3babfff700 1 Processor -- start 2023-07-27T14:27:12.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.663+0000 7f3babfff700 1 -- start start 2023-07-27T14:27:12.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3babfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 0x7f3ba4148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3babfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40aaa40 0x7f3ba40c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3babfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3babfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4150c60 con 0x7f3ba4153ec0 2023-07-27T14:27:12.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3babfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c3ef0 con 0x7f3ba40aaa40 2023-07-27T14:27:12.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3babfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c41d0 con 0x7f3ba40aa050 2023-07-27T14:27:12.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3baa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3baa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55926/0 (socket says 172.21.15.115:55926) 2023-07-27T14:27:12.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3baa59c700 1 -- 172.21.15.115:0/2410397306 learned_addr learned my addr 172.21.15.115:0/2410397306 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:12.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3ba959a700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40aaa40 0x7f3ba40c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3ba9d9b700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 0x7f3ba4148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3baa59c700 1 -- 172.21.15.115:0/2410397306 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 msgr2=0x7f3ba4148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3baa59c700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 0x7f3ba4148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3baa59c700 1 -- 172.21.15.115:0/2410397306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40aaa40 msgr2=0x7f3ba40c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3baa59c700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40aaa40 0x7f3ba40c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.664+0000 7f3baa59c700 1 -- 172.21.15.115:0/2410397306 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00092a0 con 0x7f3ba4153ec0 2023-07-27T14:27:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.665+0000 7f3baa59c700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40c30f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3b9c00c790 tx=0x7f3b9c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.665+0000 7f3b99ffb700 1 -- 172.21.15.115:0/2410397306 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c005d30 con 0x7f3ba4153ec0 2023-07-27T14:27:12.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.665+0000 7f3b99ffb700 1 -- 172.21.15.115:0/2410397306 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c005e90 con 0x7f3ba4153ec0 2023-07-27T14:27:12.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.665+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba40c44b0 con 0x7f3ba4153ec0 2023-07-27T14:27:12.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.665+0000 7f3b99ffb700 1 -- 172.21.15.115:0/2410397306 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c007320 con 0x7f3ba4153ec0 2023-07-27T14:27:12.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.665+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba414ef50 con 0x7f3ba4153ec0 2023-07-27T14:27:12.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.666+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba4150e10 con 0x7f3ba4153ec0 2023-07-27T14:27:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.667+0000 7f3b99ffb700 1 -- 172.21.15.115:0/2410397306 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b9c010030 con 0x7f3ba4153ec0 2023-07-27T14:27:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.667+0000 7f3b99ffb700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b8805ed60 0x7f3b88061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.668+0000 7f3b99ffb700 1 -- 172.21.15.115:0/2410397306 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3b9c079990 con 0x7f3ba4153ec0 2023-07-27T14:27:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.668+0000 7f3ba9d9b700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b8805ed60 0x7f3b88061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.668+0000 7f3ba9d9b700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b8805ed60 0x7f3b88061220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3ba000d260 tx=0x7f3ba0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:12.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.672+0000 7f3b99ffb700 1 -- 172.21.15.115:0/2410397306 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ba4150e10 con 0x7f3ba4153ec0 2023-07-27T14:27:12.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.843+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3ba40aa4d0 con 0x7f3ba4153ec0 2023-07-27T14:27:12.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.843+0000 7f3b99ffb700 1 -- 172.21.15.115:0/2410397306 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ba40aa4d0 con 0x7f3ba4153ec0 2023-07-27T14:27:12.857 INFO:teuthology.orchestra.run.smithi115.stdout:55834574854 2023-07-27T14:27:12.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.845+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b8805ed60 msgr2=0x7f3b88061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.845+0000 7f3babfff700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b8805ed60 0x7f3b88061220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3ba000d260 tx=0x7f3ba0016000).stop 2023-07-27T14:27:12.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.845+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 msgr2=0x7f3ba40c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:12.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.845+0000 7f3babfff700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40c30f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3b9c00c790 tx=0x7f3b9c007db0).stop 2023-07-27T14:27:12.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.846+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 shutdown_connections 2023-07-27T14:27:12.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.846+0000 7f3babfff700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b8805ed60 0x7f3b88061220 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.846+0000 7f3babfff700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ba4153ec0 0x7f3ba40c30f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.846+0000 7f3babfff700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ba40aa050 0x7f3ba4148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.846+0000 7f3babfff700 1 --2- 172.21.15.115:0/2410397306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ba40aaa40 0x7f3ba40c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:12.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.846+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 >> 172.21.15.115:0/2410397306 conn(0x7f3ba40cb610 msgr2=0x7f3ba40abad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:12.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.846+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 shutdown_connections 2023-07-27T14:27:12.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:12.846+0000 7f3babfff700 1 -- 172.21.15.115:0/2410397306 wait complete. 2023-07-27T14:27:12.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-07-27T14:27:12.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-27T14:27:13.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.053+0000 7f31031ff700 1 Processor -- start 2023-07-27T14:27:13.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.053+0000 7f31031ff700 1 -- start start 2023-07-27T14:27:13.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f31031ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f30fc153ec0 0x7f30fc0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f31031ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f31031ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc0aa4d0 con 0x7f30fc0aaa40 2023-07-27T14:27:13.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f31031ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30fc0c05c0 con 0x7f30fc153ec0 2023-07-27T14:27:13.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f31031ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0c1a60 con 0x7f30fc0aa050 2023-07-27T14:27:13.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f310179c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f30fc0aaa40 0x7f30fc157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38674/0 (socket says 172.21.15.115:38674) 2023-07-27T14:27:13.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f310179c700 1 -- 172.21.15.115:0/525124926 learned_addr learned my addr 172.21.15.115:0/525124926 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:13.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f3100f9b700 1 --2- 172.21.15.115:0/525124926 >> v2:172.21.15.159:3300/0 conn(0x7f30fc153ec0 0x7f30fc0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fbfff700 1 --2- 172.21.15.115:0/525124926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fb7fe700 1 -- 172.21.15.115:0/525124926 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646179445 0 0) 0x7f30f4001490 con 0x7f30fc0aaa40 2023-07-27T14:27:13.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fb7fe700 1 -- 172.21.15.115:0/525124926 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec0033f0 con 0x7f30fc0aaa40 2023-07-27T14:27:13.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fbfff700 1 -- 172.21.15.115:0/525124926 >> v2:172.21.15.159:3300/0 conn(0x7f30fc153ec0 msgr2=0x7f30fc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:13.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fbfff700 1 --2- 172.21.15.115:0/525124926 >> v2:172.21.15.159:3300/0 conn(0x7f30fc153ec0 0x7f30fc0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fbfff700 1 -- 172.21.15.115:0/525124926 >> v1:172.21.15.115:6789/0 conn(0x7f30fc0aaa40 legacy=0x7f30fc157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fb7fe700 1 -- 172.21.15.115:0/525124926 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427728158 0 0) 0x7f30ec0033f0 con 0x7f30fc0aaa40 2023-07-27T14:27:13.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fbfff700 1 -- 172.21.15.115:0/525124926 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc0bfc90 con 0x7f30fc0aa050 2023-07-27T14:27:13.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fbfff700 1 --2- 172.21.15.115:0/525124926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc0640f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f30e8009760 tx=0x7f30e8009060).ready entity=mon.2 client_cookie=17208729d491e984 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fb7fe700 1 -- 172.21.15.115:0/525124926 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800d4a0 con 0x7f30fc0aa050 2023-07-27T14:27:13.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.055+0000 7f30fb7fe700 1 -- 172.21.15.115:0/525124926 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800d600 con 0x7f30fc0aa050 2023-07-27T14:27:13.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f30fb7fe700 1 -- 172.21.15.115:0/525124926 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800d980 con 0x7f30fc0aa050 2023-07-27T14:27:13.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f31031ff700 1 -- 172.21.15.115:0/525124926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 msgr2=0x7f30fc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f31031ff700 1 --2- 172.21.15.115:0/525124926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc0640f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f30e8009760 tx=0x7f30e8009060).stop 2023-07-27T14:27:13.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f31031ff700 1 -- 172.21.15.115:0/525124926 shutdown_connections 2023-07-27T14:27:13.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f31031ff700 1 --2- 172.21.15.115:0/525124926 >> v2:172.21.15.159:3300/0 conn(0x7f30fc153ec0 0x7f30fc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f31031ff700 1 --2- 172.21.15.115:0/525124926 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc0640f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f31031ff700 1 -- 172.21.15.115:0/525124926 >> 172.21.15.115:0/525124926 conn(0x7f30fc0cb610 msgr2=0x7f30fc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:13.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f31031ff700 1 -- 172.21.15.115:0/525124926 shutdown_connections 2023-07-27T14:27:13.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.056+0000 7f31031ff700 1 -- 172.21.15.115:0/525124926 wait complete. 2023-07-27T14:27:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f31031ff700 1 Processor -- start 2023-07-27T14:27:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f31031ff700 1 -- start start 2023-07-27T14:27:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f31031ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f31031ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc0aaa40 0x7f30fc1645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f31031ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30fc153ec0 0x7f30fc150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f31031ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0c37e0 con 0x7f30fc153ec0 2023-07-27T14:27:13.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f31031ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc14c6b0 con 0x7f30fc0aaa40 2023-07-27T14:27:13.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f31031ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0c2eb0 con 0x7f30fc0aa050 2023-07-27T14:27:13.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30fc153ec0 0x7f30fc150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30fc153ec0 0x7f30fc150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55936/0 (socket says 172.21.15.115:55936) 2023-07-27T14:27:13.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 -- 172.21.15.115:0/2844124063 learned_addr learned my addr 172.21.15.115:0/2844124063 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:13.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f3100f9b700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f30fbfff700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc0aaa40 0x7f30fc1645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 -- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 msgr2=0x7f30fc14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc14c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 -- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc0aaa40 msgr2=0x7f30fc1645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc0aaa40 0x7f30fc1645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 -- 172.21.15.115:0/2844124063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80092a0 con 0x7f30fc153ec0 2023-07-27T14:27:13.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f30fbfff700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc0aaa40 0x7f30fc1645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:13.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.059+0000 7f310179c700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30fc153ec0 0x7f30fc150c00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f30f400c7e0 tx=0x7f30f4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.060+0000 7f30f8ff9700 1 -- 172.21.15.115:0/2844124063 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4004c40 con 0x7f30fc153ec0 2023-07-27T14:27:13.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.060+0000 7f30f8ff9700 1 -- 172.21.15.115:0/2844124063 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f4004dc0 con 0x7f30fc153ec0 2023-07-27T14:27:13.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.060+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc0c3190 con 0x7f30fc153ec0 2023-07-27T14:27:13.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.060+0000 7f30f8ff9700 1 -- 172.21.15.115:0/2844124063 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f40073c0 con 0x7f30fc153ec0 2023-07-27T14:27:13.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.060+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc164ab0 con 0x7f30fc153ec0 2023-07-27T14:27:13.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.061+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc0c3950 con 0x7f30fc153ec0 2023-07-27T14:27:13.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.061+0000 7f30f8ff9700 1 -- 172.21.15.115:0/2844124063 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f30f401b060 con 0x7f30fc153ec0 2023-07-27T14:27:13.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.063+0000 7f30f8ff9700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f30e005ed60 0x7f30e0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.063+0000 7f30f8ff9700 1 -- 172.21.15.115:0/2844124063 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f30f4079500 con 0x7f30fc153ec0 2023-07-27T14:27:13.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.063+0000 7f3100f9b700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f30e005ed60 0x7f30e0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.063+0000 7f3100f9b700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f30e005ed60 0x7f30e0061220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f30f0009b90 tx=0x7f30f0009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.067+0000 7f30f8ff9700 1 -- 172.21.15.115:0/2844124063 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30f404a990 con 0x7f30fc153ec0 2023-07-27T14:27:13.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.238+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f30fc0aa4d0 con 0x7f30fc153ec0 2023-07-27T14:27:13.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.239+0000 7f30f8ff9700 1 -- 172.21.15.115:0/2844124063 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30fc0aa4d0 con 0x7f30fc153ec0 2023-07-27T14:27:13.253 INFO:teuthology.orchestra.run.smithi115.stdout:55834574853 2023-07-27T14:27:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f30e005ed60 msgr2=0x7f30e0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f30e005ed60 0x7f30e0061220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f30f0009b90 tx=0x7f30f0009060).stop 2023-07-27T14:27:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30fc153ec0 msgr2=0x7f30fc150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30fc153ec0 0x7f30fc150c00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f30f400c7e0 tx=0x7f30f4007af0).stop 2023-07-27T14:27:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 shutdown_connections 2023-07-27T14:27:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f30e005ed60 0x7f30e0061220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30fc153ec0 0x7f30fc150c00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f30fc0aa050 0x7f30fc14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 --2- 172.21.15.115:0/2844124063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc0aaa40 0x7f30fc1645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 >> 172.21.15.115:0/2844124063 conn(0x7f30fc0cb610 msgr2=0x7f30fc0ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:13.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 shutdown_connections 2023-07-27T14:27:13.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.242+0000 7f31031ff700 1 -- 172.21.15.115:0/2844124063 wait complete. 2023-07-27T14:27:13.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-07-27T14:27:13.272 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-27T14:27:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.447+0000 7f6025fff700 1 Processor -- start 2023-07-27T14:27:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.448+0000 7f6025fff700 1 -- start start 2023-07-27T14:27:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f6025fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 0x7f60200bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f6025fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6020154440 0x7f60200bc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f6025fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200c2ed0 con 0x7f60200a4c80 2023-07-27T14:27:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f6025fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200bc720 con 0x7f6020154440 2023-07-27T14:27:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f6025fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200a58d0 con 0x7f6020154060 2023-07-27T14:27:13.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f601effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6020154440 0x7f60200bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f601ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f60200a4c80 0x7f60200a50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38688/0 (socket says 172.21.15.115:38688) 2023-07-27T14:27:13.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f601ffff700 1 -- 172.21.15.115:0/2163739663 learned_addr learned my addr 172.21.15.115:0/2163739663 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:13.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f601f7fe700 1 --2- 172.21.15.115:0/2163739663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 0x7f60200bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f601e7fc700 1 -- 172.21.15.115:0/2163739663 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661506344 0 0) 0x7f60200c2ed0 con 0x7f60200a4c80 2023-07-27T14:27:13.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f601effd700 1 -- 172.21.15.115:0/2163739663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 msgr2=0x7f60200bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:13.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.449+0000 7f601effd700 1 --2- 172.21.15.115:0/2163739663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 0x7f60200bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.450+0000 7f601effd700 1 -- 172.21.15.115:0/2163739663 >> v1:172.21.15.115:6789/0 conn(0x7f60200a4c80 legacy=0x7f60200a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.450+0000 7f601effd700 1 -- 172.21.15.115:0/2163739663 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200a5bb0 con 0x7f6020154440 2023-07-27T14:27:13.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.450+0000 7f601effd700 1 --2- 172.21.15.115:0/2163739663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6020154440 0x7f60200bc230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6014009760 tx=0x7f6014009060).ready entity=mon.0 client_cookie=f06a5d806c9b9163 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.450+0000 7f601e7fc700 1 -- 172.21.15.115:0/2163739663 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400b580 con 0x7f6020154440 2023-07-27T14:27:13.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.450+0000 7f601e7fc700 1 -- 172.21.15.115:0/2163739663 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601400b6e0 con 0x7f6020154440 2023-07-27T14:27:13.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.450+0000 7f601e7fc700 1 -- 172.21.15.115:0/2163739663 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400ba60 con 0x7f6020154440 2023-07-27T14:27:13.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.450+0000 7f6025fff700 1 -- 172.21.15.115:0/2163739663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6020154440 msgr2=0x7f60200bc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.450+0000 7f6025fff700 1 --2- 172.21.15.115:0/2163739663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6020154440 0x7f60200bc230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6014009760 tx=0x7f6014009060).stop 2023-07-27T14:27:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.451+0000 7f6025fff700 1 -- 172.21.15.115:0/2163739663 shutdown_connections 2023-07-27T14:27:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.451+0000 7f6025fff700 1 --2- 172.21.15.115:0/2163739663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 0x7f60200bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.451+0000 7f6025fff700 1 --2- 172.21.15.115:0/2163739663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6020154440 0x7f60200bc230 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.451+0000 7f6025fff700 1 -- 172.21.15.115:0/2163739663 >> 172.21.15.115:0/2163739663 conn(0x7f6020062320 msgr2=0x7f6020062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.451+0000 7f6025fff700 1 -- 172.21.15.115:0/2163739663 shutdown_connections 2023-07-27T14:27:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.451+0000 7f6025fff700 1 -- 172.21.15.115:0/2163739663 wait complete. 2023-07-27T14:27:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.452+0000 7f6025fff700 1 Processor -- start 2023-07-27T14:27:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.452+0000 7f6025fff700 1 -- start start 2023-07-27T14:27:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f6025fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60200a4c80 0x7f60200a7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f6025fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 0x7f60200ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f6025fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6020154440 0x7f6020150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f6025fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200a7ab0 con 0x7f60200a4c80 2023-07-27T14:27:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f6025fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c49c0 con 0x7f6020154440 2023-07-27T14:27:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f6025fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200c4ca0 con 0x7f6020154060 2023-07-27T14:27:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60200a4c80 0x7f60200a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60200a4c80 0x7f60200a7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55946/0 (socket says 172.21.15.115:55946) 2023-07-27T14:27:13.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.453+0000 7f601f7fe700 1 -- 172.21.15.115:0/4070832443 learned_addr learned my addr 172.21.15.115:0/4070832443 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:13.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f601effd700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 0x7f60200ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f601ffff700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6020154440 0x7f6020150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f601f7fe700 1 -- 172.21.15.115:0/4070832443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 msgr2=0x7f60200ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f601f7fe700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 0x7f60200ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f601f7fe700 1 -- 172.21.15.115:0/4070832443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6020154440 msgr2=0x7f6020150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f601f7fe700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6020154440 0x7f6020150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f601f7fe700 1 -- 172.21.15.115:0/4070832443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140092a0 con 0x7f60200a4c80 2023-07-27T14:27:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f601f7fe700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60200a4c80 0x7f60200a7260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f601000d890 tx=0x7f6010008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f60077fe700 1 -- 172.21.15.115:0/4070832443 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60100125f0 con 0x7f60200a4c80 2023-07-27T14:27:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f60077fe700 1 -- 172.21.15.115:0/4070832443 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010012750 con 0x7f60200a4c80 2023-07-27T14:27:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60200c4f80 con 0x7f60200a4c80 2023-07-27T14:27:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f60077fe700 1 -- 172.21.15.115:0/4070832443 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010012ad0 con 0x7f60200a4c80 2023-07-27T14:27:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.454+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60200a7750 con 0x7f60200a4c80 2023-07-27T14:27:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.455+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602006c470 con 0x7f60200a4c80 2023-07-27T14:27:13.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.456+0000 7f60077fe700 1 -- 172.21.15.115:0/4070832443 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6010013480 con 0x7f60200a4c80 2023-07-27T14:27:13.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.457+0000 7f60077fe700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f600c05ed90 0x7f600c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.457+0000 7f60077fe700 1 -- 172.21.15.115:0/4070832443 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6010079bd0 con 0x7f60200a4c80 2023-07-27T14:27:13.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.457+0000 7f601effd700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f600c05ed90 0x7f600c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.458+0000 7f601effd700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f600c05ed90 0x7f600c061250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6014009760 tx=0x7f6014017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.461+0000 7f60077fe700 1 -- 172.21.15.115:0/4070832443 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f601004b000 con 0x7f60200a4c80 2023-07-27T14:27:13.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.635+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f602005f5e0 con 0x7f60200a4c80 2023-07-27T14:27:13.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.635+0000 7f60077fe700 1 -- 172.21.15.115:0/4070832443 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f601004e620 con 0x7f60200a4c80 2023-07-27T14:27:13.648 INFO:teuthology.orchestra.run.smithi115.stdout:55834574854 2023-07-27T14:27:13.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f600c05ed90 msgr2=0x7f600c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f600c05ed90 0x7f600c061250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6014009760 tx=0x7f6014017000).stop 2023-07-27T14:27:13.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60200a4c80 msgr2=0x7f60200a7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60200a4c80 0x7f60200a7260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f601000d890 tx=0x7f6010008040).stop 2023-07-27T14:27:13.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 shutdown_connections 2023-07-27T14:27:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f600c05ed90 0x7f600c061250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6020154440 0x7f6020150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60200a4c80 0x7f60200a7260 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 --2- 172.21.15.115:0/4070832443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6020154060 0x7f60200ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 >> 172.21.15.115:0/4070832443 conn(0x7f6020062320 msgr2=0x7f60200682e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 shutdown_connections 2023-07-27T14:27:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.637+0000 7f6025fff700 1 -- 172.21.15.115:0/4070832443 wait complete. 2023-07-27T14:27:13.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-07-27T14:27:13.667 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-27T14:27:13.668 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:27:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.842+0000 7f91c97ff700 1 Processor -- start 2023-07-27T14:27:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.842+0000 7f91c97ff700 1 -- start start 2023-07-27T14:27:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c97ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f91c4153ec0 0x7f91c40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c97ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f91c40aa050 0x7f91c40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c97ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c40aa4d0 con 0x7f91c40aaa40 2023-07-27T14:27:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c97ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c40c05c0 con 0x7f91c40aa050 2023-07-27T14:27:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c97ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c40c1a60 con 0x7f91c4153ec0 2023-07-27T14:27:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c27fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f91c40aa050 0x7f91c40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f91c40aaa40 0x7f91c4157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33576/0 (socket says 172.21.15.115:33576) 2023-07-27T14:27:13.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c37fe700 1 -- 172.21.15.115:0/2087554995 learned_addr learned my addr 172.21.15.115:0/2087554995 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:13.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c2ffd700 1 --2- 172.21.15.115:0/2087554995 >> v2:172.21.15.159:3300/0 conn(0x7f91c4153ec0 0x7f91c40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c27fc700 1 -- 172.21.15.115:0/2087554995 >> v2:172.21.15.159:3300/0 conn(0x7f91c4153ec0 msgr2=0x7f91c40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c27fc700 1 --2- 172.21.15.115:0/2087554995 >> v2:172.21.15.159:3300/0 conn(0x7f91c4153ec0 0x7f91c40a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c27fc700 1 -- 172.21.15.115:0/2087554995 >> v1:172.21.15.115:6789/0 conn(0x7f91c40aaa40 legacy=0x7f91c4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c1ffb700 1 -- 172.21.15.115:0/2087554995 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003026379 0 0) 0x7f91bc001490 con 0x7f91c40aaa40 2023-07-27T14:27:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.844+0000 7f91c27fc700 1 -- 172.21.15.115:0/2087554995 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c40bfc90 con 0x7f91c40aa050 2023-07-27T14:27:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c27fc700 1 --2- 172.21.15.115:0/2087554995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c40aa050 0x7f91c40640f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f91c4083e30 tx=0x7f91b8009060).ready entity=mon.0 client_cookie=8471d7660a23c8e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c1ffb700 1 -- 172.21.15.115:0/2087554995 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800f510 con 0x7f91c40aa050 2023-07-27T14:27:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c1ffb700 1 -- 172.21.15.115:0/2087554995 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800f670 con 0x7f91c40aa050 2023-07-27T14:27:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c1ffb700 1 -- 172.21.15.115:0/2087554995 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800f9f0 con 0x7f91c40aa050 2023-07-27T14:27:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c97ff700 1 -- 172.21.15.115:0/2087554995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c40aa050 msgr2=0x7f91c40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c97ff700 1 --2- 172.21.15.115:0/2087554995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c40aa050 0x7f91c40640f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f91c4083e30 tx=0x7f91b8009060).stop 2023-07-27T14:27:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c97ff700 1 -- 172.21.15.115:0/2087554995 shutdown_connections 2023-07-27T14:27:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c97ff700 1 --2- 172.21.15.115:0/2087554995 >> v2:172.21.15.159:3300/0 conn(0x7f91c4153ec0 0x7f91c40a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c97ff700 1 --2- 172.21.15.115:0/2087554995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c40aa050 0x7f91c40640f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.845+0000 7f91c97ff700 1 -- 172.21.15.115:0/2087554995 >> 172.21.15.115:0/2087554995 conn(0x7f91c40cb610 msgr2=0x7f91c40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.846+0000 7f91c97ff700 1 -- 172.21.15.115:0/2087554995 shutdown_connections 2023-07-27T14:27:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.846+0000 7f91c97ff700 1 -- 172.21.15.115:0/2087554995 wait complete. 2023-07-27T14:27:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.847+0000 7f91c97ff700 1 Processor -- start 2023-07-27T14:27:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.847+0000 7f91c97ff700 1 -- start start 2023-07-27T14:27:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c97ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91c40aa050 0x7f91c40c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c97ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91c40aaa40 0x7f91c41542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c97ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c4153ec0 0x7f91c4167d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c97ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4154790 con 0x7f91c4153ec0 2023-07-27T14:27:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c97ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40aff20 con 0x7f91c40aa050 2023-07-27T14:27:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c97ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40b0200 con 0x7f91c40aaa40 2023-07-27T14:27:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c4153ec0 0x7f91c4167d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c2ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91c40aa050 0x7f91c40c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.848+0000 7f91c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c4153ec0 0x7f91c4167d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47414/0 (socket says 172.21.15.115:47414) 2023-07-27T14:27:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c37fe700 1 -- 172.21.15.115:0/87558835 learned_addr learned my addr 172.21.15.115:0/87558835 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c27fc700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91c40aaa40 0x7f91c41542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c37fe700 1 -- 172.21.15.115:0/87558835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91c40aaa40 msgr2=0x7f91c41542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c37fe700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91c40aaa40 0x7f91c41542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c37fe700 1 -- 172.21.15.115:0/87558835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91c40aa050 msgr2=0x7f91c40c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c37fe700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91c40aa050 0x7f91c40c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c37fe700 1 -- 172.21.15.115:0/87558835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80092a0 con 0x7f91c4153ec0 2023-07-27T14:27:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c2ffd700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91c40aa050 0x7f91c40c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c37fe700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c4153ec0 0x7f91c4167d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f91bc00c810 tx=0x7f91bc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91aaffd700 1 -- 172.21.15.115:0/87558835 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc005d30 con 0x7f91c4153ec0 2023-07-27T14:27:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91aaffd700 1 -- 172.21.15.115:0/87558835 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc005e90 con 0x7f91c4153ec0 2023-07-27T14:27:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c40b04e0 con 0x7f91c4153ec0 2023-07-27T14:27:13.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91aaffd700 1 -- 172.21.15.115:0/87558835 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc007320 con 0x7f91c4153ec0 2023-07-27T14:27:13.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.849+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4168200 con 0x7f91c4153ec0 2023-07-27T14:27:13.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.851+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c406c470 con 0x7f91c4153ec0 2023-07-27T14:27:13.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.851+0000 7f91aaffd700 1 -- 172.21.15.115:0/87558835 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f91bc010030 con 0x7f91c4153ec0 2023-07-27T14:27:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.852+0000 7f91aaffd700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91b005ed60 0x7f91b0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.852+0000 7f91aaffd700 1 -- 172.21.15.115:0/87558835 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f91bc0797c0 con 0x7f91c4153ec0 2023-07-27T14:27:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.852+0000 7f91c2ffd700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91b005ed60 0x7f91b0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.853+0000 7f91c2ffd700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91b005ed60 0x7f91b0061220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f91b4009f90 tx=0x7f91b4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:13.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:13.856+0000 7f91aaffd700 1 -- 172.21.15.115:0/87558835 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91bc04ad60 con 0x7f91c4153ec0 2023-07-27T14:27:14.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.022+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91c40aa4d0 con 0x7f91b005ed60 2023-07-27T14:27:14.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.032+0000 7f91aaffd700 1 -- 172.21.15.115:0/87558835 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336299 (secure 0 0 0) 0x7f91c40aa4d0 con 0x7f91b005ed60 2023-07-27T14:27:14.048 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:14.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91b005ed60 msgr2=0x7f91b0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91b005ed60 0x7f91b0061220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f91b4009f90 tx=0x7f91b4009060).stop 2023-07-27T14:27:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c4153ec0 msgr2=0x7f91c4167d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c4153ec0 0x7f91c4167d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f91bc00c810 tx=0x7f91bc007d70).stop 2023-07-27T14:27:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 shutdown_connections 2023-07-27T14:27:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91b005ed60 0x7f91b0061220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91c4153ec0 0x7f91c4167d10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91c40aa050 0x7f91c40c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 --2- 172.21.15.115:0/87558835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91c40aaa40 0x7f91c41542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.036+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 >> 172.21.15.115:0/87558835 conn(0x7f91c40cb610 msgr2=0x7f91c40c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:14.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.037+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 shutdown_connections 2023-07-27T14:27:14.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.037+0000 7f91c97ff700 1 -- 172.21.15.115:0/87558835 wait complete. 2023-07-27T14:27:14.052 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:27:14.067 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-27T14:27:13.439210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41600,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":39680,"kb_avail":754933120,"statfs":{"total":773094113280,"available":773051514880,"internally_reserved":0,"allocated":1900544,"data_stored":690164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40632320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001579"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284762+0000","last_change":"2023-07-27T14:27:01.270326+0000","last_active":"2023-07-27T14:27:01.284762+0000","last_peered":"2023-07-27T14:27:01.284762+0000","last_clean":"2023-07-27T14:27:01.284762+0000","last_became_active":"2023-07-27T14:27:01.270013+0000","last_became_peered":"2023-07-27T14:27:01.270013+0000","last_unstale":"2023-07-27T14:27:01.284762+0000","last_undegraded":"2023-07-27T14:27:01.284762+0000","last_fullsized":"2023-07-27T14:27:01.284762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.280302+0000","last_change":"2023-07-27T14:27:00.817070+0000","last_active":"2023-07-27T14:27:01.280302+0000","last_peered":"2023-07-27T14:27:01.280302+0000","last_clean":"2023-07-27T14:27:01.280302+0000","last_became_active":"2023-07-27T14:27:00.816729+0000","last_became_peered":"2023-07-27T14:27:00.816729+0000","last_unstale":"2023-07-27T14:27:01.280302+0000","last_undegraded":"2023-07-27T14:27:01.280302+0000","last_fullsized":"2023-07-27T14:27:01.280302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285407+0000","last_change":"2023-07-27T14:27:01.281932+0000","last_active":"2023-07-27T14:27:01.285407+0000","last_peered":"2023-07-27T14:27:01.285407+0000","last_clean":"2023-07-27T14:27:01.285407+0000","last_became_active":"2023-07-27T14:27:01.279991+0000","last_became_peered":"2023-07-27T14:27:01.279991+0000","last_unstale":"2023-07-27T14:27:01.285407+0000","last_undegraded":"2023-07-27T14:27:01.285407+0000","last_fullsized":"2023-07-27T14:27:01.285407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.267835+0000","last_change":"2023-07-27T14:27:00.816788+0000","last_active":"2023-07-27T14:27:01.267835+0000","last_peered":"2023-07-27T14:27:01.267835+0000","last_clean":"2023-07-27T14:27:01.267835+0000","last_became_active":"2023-07-27T14:27:00.816483+0000","last_became_peered":"2023-07-27T14:27:00.816483+0000","last_unstale":"2023-07-27T14:27:01.267835+0000","last_undegraded":"2023-07-27T14:27:01.267835+0000","last_fullsized":"2023-07-27T14:27:01.267835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288441+0000","last_change":"2023-07-27T14:27:01.283092+0000","last_active":"2023-07-27T14:27:01.288441+0000","last_peered":"2023-07-27T14:27:01.288441+0000","last_clean":"2023-07-27T14:27:01.288441+0000","last_became_active":"2023-07-27T14:27:01.281682+0000","last_became_peered":"2023-07-27T14:27:01.281682+0000","last_unstale":"2023-07-27T14:27:01.288441+0000","last_undegraded":"2023-07-27T14:27:01.288441+0000","last_fullsized":"2023-07-27T14:27:01.288441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.259837+0000","last_change":"2023-07-27T14:27:00.824445+0000","last_active":"2023-07-27T14:27:01.259837+0000","last_peered":"2023-07-27T14:27:01.259837+0000","last_clean":"2023-07-27T14:27:01.259837+0000","last_became_active":"2023-07-27T14:27:00.824146+0000","last_became_peered":"2023-07-27T14:27:00.824146+0000","last_unstale":"2023-07-27T14:27:01.259837+0000","last_undegraded":"2023-07-27T14:27:01.259837+0000","last_fullsized":"2023-07-27T14:27:01.259837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281942+0000","last_change":"2023-07-27T14:27:01.270550+0000","last_active":"2023-07-27T14:27:01.281942+0000","last_peered":"2023-07-27T14:27:01.281942+0000","last_clean":"2023-07-27T14:27:01.281942+0000","last_became_active":"2023-07-27T14:27:01.270242+0000","last_became_peered":"2023-07-27T14:27:01.270242+0000","last_unstale":"2023-07-27T14:27:01.281942+0000","last_undegraded":"2023-07-27T14:27:01.281942+0000","last_fullsized":"2023-07-27T14:27:01.281942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264077+0000","last_change":"2023-07-27T14:27:00.811927+0000","last_active":"2023-07-27T14:27:01.264077+0000","last_peered":"2023-07-27T14:27:01.264077+0000","last_clean":"2023-07-27T14:27:01.264077+0000","last_became_active":"2023-07-27T14:27:00.810673+0000","last_became_peered":"2023-07-27T14:27:00.810673+0000","last_unstale":"2023-07-27T14:27:01.264077+0000","last_undegraded":"2023-07-27T14:27:01.264077+0000","last_fullsized":"2023-07-27T14:27:01.264077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282015+0000","last_change":"2023-07-27T14:27:01.273486+0000","last_active":"2023-07-27T14:27:01.282015+0000","last_peered":"2023-07-27T14:27:01.282015+0000","last_clean":"2023-07-27T14:27:01.282015+0000","last_became_active":"2023-07-27T14:27:01.273227+0000","last_became_peered":"2023-07-27T14:27:01.273227+0000","last_unstale":"2023-07-27T14:27:01.282015+0000","last_undegraded":"2023-07-27T14:27:01.282015+0000","last_fullsized":"2023-07-27T14:27:01.282015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269519+0000","last_change":"2023-07-27T14:27:00.808357+0000","last_active":"2023-07-27T14:27:01.269519+0000","last_peered":"2023-07-27T14:27:01.269519+0000","last_clean":"2023-07-27T14:27:01.269519+0000","last_became_active":"2023-07-27T14:27:00.808008+0000","last_became_peered":"2023-07-27T14:27:00.808008+0000","last_unstale":"2023-07-27T14:27:01.269519+0000","last_undegraded":"2023-07-27T14:27:01.269519+0000","last_fullsized":"2023-07-27T14:27:01.269519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.275273+0000","last_change":"2023-07-27T14:27:01.272065+0000","last_active":"2023-07-27T14:27:01.275273+0000","last_peered":"2023-07-27T14:27:01.275273+0000","last_clean":"2023-07-27T14:27:01.275273+0000","last_became_active":"2023-07-27T14:27:01.270787+0000","last_became_peered":"2023-07-27T14:27:01.270787+0000","last_unstale":"2023-07-27T14:27:01.275273+0000","last_undegraded":"2023-07-27T14:27:01.275273+0000","last_fullsized":"2023-07-27T14:27:01.275273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287817+0000","last_change":"2023-07-27T14:27:00.823544+0000","last_active":"2023-07-27T14:27:01.287817+0000","last_peered":"2023-07-27T14:27:01.287817+0000","last_clean":"2023-07-27T14:27:01.287817+0000","last_became_active":"2023-07-27T14:27:00.823167+0000","last_became_peered":"2023-07-27T14:27:00.823167+0000","last_unstale":"2023-07-27T14:27:01.287817+0000","last_undegraded":"2023-07-27T14:27:01.287817+0000","last_fullsized":"2023-07-27T14:27:01.287817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.297002+0000","last_change":"2023-07-27T14:27:01.290104+0000","last_active":"2023-07-27T14:27:01.297002+0000","last_peered":"2023-07-27T14:27:01.297002+0000","last_clean":"2023-07-27T14:27:01.297002+0000","last_became_active":"2023-07-27T14:27:01.289787+0000","last_became_peered":"2023-07-27T14:27:01.289787+0000","last_unstale":"2023-07-27T14:27:01.297002+0000","last_undegraded":"2023-07-27T14:27:01.297002+0000","last_fullsized":"2023-07-27T14:27:01.297002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293463+0000","last_change":"2023-07-27T14:27:00.818297+0000","last_active":"2023-07-27T14:27:01.293463+0000","last_peered":"2023-07-27T14:27:01.293463+0000","last_clean":"2023-07-27T14:27:01.293463+0000","last_became_active":"2023-07-27T14:27:00.817529+0000","last_became_peered":"2023-07-27T14:27:00.817529+0000","last_unstale":"2023-07-27T14:27:01.293463+0000","last_undegraded":"2023-07-27T14:27:01.293463+0000","last_fullsized":"2023-07-27T14:27:01.293463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286467+0000","last_change":"2023-07-27T14:27:01.270184+0000","last_active":"2023-07-27T14:27:01.286467+0000","last_peered":"2023-07-27T14:27:01.286467+0000","last_clean":"2023-07-27T14:27:01.286467+0000","last_became_active":"2023-07-27T14:27:01.269909+0000","last_became_peered":"2023-07-27T14:27:01.269909+0000","last_unstale":"2023-07-27T14:27:01.286467+0000","last_undegraded":"2023-07-27T14:27:01.286467+0000","last_fullsized":"2023-07-27T14:27:01.286467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293730+0000","last_change":"2023-07-27T14:27:00.822093+0000","last_active":"2023-07-27T14:27:01.293730+0000","last_peered":"2023-07-27T14:27:01.293730+0000","last_clean":"2023-07-27T14:27:01.293730+0000","last_became_active":"2023-07-27T14:27:00.821821+0000","last_became_peered":"2023-07-27T14:27:00.821821+0000","last_unstale":"2023-07-27T14:27:01.293730+0000","last_undegraded":"2023-07-27T14:27:01.293730+0000","last_fullsized":"2023-07-27T14:27:01.293730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296579+0000","last_change":"2023-07-27T14:27:01.289067+0000","last_active":"2023-07-27T14:27:01.296579+0000","last_peered":"2023-07-27T14:27:01.296579+0000","last_clean":"2023-07-27T14:27:01.296579+0000","last_became_active":"2023-07-27T14:27:01.288634+0000","last_became_peered":"2023-07-27T14:27:01.288634+0000","last_unstale":"2023-07-27T14:27:01.296579+0000","last_undegraded":"2023-07-27T14:27:01.296579+0000","last_fullsized":"2023-07-27T14:27:01.296579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265111+0000","last_change":"2023-07-27T14:27:00.805268+0000","last_active":"2023-07-27T14:27:01.265111+0000","last_peered":"2023-07-27T14:27:01.265111+0000","last_clean":"2023-07-27T14:27:01.265111+0000","last_became_active":"2023-07-27T14:27:00.804950+0000","last_became_peered":"2023-07-27T14:27:00.804950+0000","last_unstale":"2023-07-27T14:27:01.265111+0000","last_undegraded":"2023-07-27T14:27:01.265111+0000","last_fullsized":"2023-07-27T14:27:01.265111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284549+0000","last_change":"2023-07-27T14:27:01.281253+0000","last_active":"2023-07-27T14:27:01.284549+0000","last_peered":"2023-07-27T14:27:01.284549+0000","last_clean":"2023-07-27T14:27:01.284549+0000","last_became_active":"2023-07-27T14:27:01.280227+0000","last_became_peered":"2023-07-27T14:27:01.280227+0000","last_unstale":"2023-07-27T14:27:01.284549+0000","last_undegraded":"2023-07-27T14:27:01.284549+0000","last_fullsized":"2023-07-27T14:27:01.284549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.262929+0000","last_change":"2023-07-27T14:27:00.817281+0000","last_active":"2023-07-27T14:27:01.262929+0000","last_peered":"2023-07-27T14:27:01.262929+0000","last_clean":"2023-07-27T14:27:01.262929+0000","last_became_active":"2023-07-27T14:27:00.817008+0000","last_became_peered":"2023-07-27T14:27:00.817008+0000","last_unstale":"2023-07-27T14:27:01.262929+0000","last_undegraded":"2023-07-27T14:27:01.262929+0000","last_fullsized":"2023-07-27T14:27:01.262929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286934+0000","last_change":"2023-07-27T14:27:01.281135+0000","last_active":"2023-07-27T14:27:01.286934+0000","last_peered":"2023-07-27T14:27:01.286934+0000","last_clean":"2023-07-27T14:27:01.286934+0000","last_became_active":"2023-07-27T14:27:01.280869+0000","last_became_peered":"2023-07-27T14:27:01.280869+0000","last_unstale":"2023-07-27T14:27:01.286934+0000","last_undegraded":"2023-07-27T14:27:01.286934+0000","last_fullsized":"2023-07-27T14:27:01.286934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283835+0000","last_change":"2023-07-27T14:27:00.810416+0000","last_active":"2023-07-27T14:27:01.283835+0000","last_peered":"2023-07-27T14:27:01.283835+0000","last_clean":"2023-07-27T14:27:01.283835+0000","last_became_active":"2023-07-27T14:27:00.809422+0000","last_became_peered":"2023-07-27T14:27:00.809422+0000","last_unstale":"2023-07-27T14:27:01.283835+0000","last_undegraded":"2023-07-27T14:27:01.283835+0000","last_fullsized":"2023-07-27T14:27:01.283835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.291617+0000","last_change":"2023-07-27T14:27:01.286563+0000","last_active":"2023-07-27T14:27:01.291617+0000","last_peered":"2023-07-27T14:27:01.291617+0000","last_clean":"2023-07-27T14:27:01.291617+0000","last_became_active":"2023-07-27T14:27:01.285925+0000","last_became_peered":"2023-07-27T14:27:01.285925+0000","last_unstale":"2023-07-27T14:27:01.291617+0000","last_undegraded":"2023-07-27T14:27:01.291617+0000","last_fullsized":"2023-07-27T14:27:01.291617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293048+0000","last_change":"2023-07-27T14:27:00.819013+0000","last_active":"2023-07-27T14:27:01.293048+0000","last_peered":"2023-07-27T14:27:01.293048+0000","last_clean":"2023-07-27T14:27:01.293048+0000","last_became_active":"2023-07-27T14:27:00.818612+0000","last_became_peered":"2023-07-27T14:27:00.818612+0000","last_unstale":"2023-07-27T14:27:01.293048+0000","last_undegraded":"2023-07-27T14:27:01.293048+0000","last_fullsized":"2023-07-27T14:27:01.293048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299226+0000","last_change":"2023-07-27T14:27:01.294061+0000","last_active":"2023-07-27T14:27:01.299226+0000","last_peered":"2023-07-27T14:27:01.299226+0000","last_clean":"2023-07-27T14:27:01.299226+0000","last_became_active":"2023-07-27T14:27:01.293437+0000","last_became_peered":"2023-07-27T14:27:01.293437+0000","last_unstale":"2023-07-27T14:27:01.299226+0000","last_undegraded":"2023-07-27T14:27:01.299226+0000","last_fullsized":"2023-07-27T14:27:01.299226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295767+0000","last_change":"2023-07-27T14:27:00.819217+0000","last_active":"2023-07-27T14:27:01.295767+0000","last_peered":"2023-07-27T14:27:01.295767+0000","last_clean":"2023-07-27T14:27:01.295767+0000","last_became_active":"2023-07-27T14:27:00.818691+0000","last_became_peered":"2023-07-27T14:27:00.818691+0000","last_unstale":"2023-07-27T14:27:01.295767+0000","last_undegraded":"2023-07-27T14:27:01.295767+0000","last_fullsized":"2023-07-27T14:27:01.295767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.276891+0000","last_change":"2023-07-27T14:27:01.270147+0000","last_active":"2023-07-27T14:27:01.276891+0000","last_peered":"2023-07-27T14:27:01.276891+0000","last_clean":"2023-07-27T14:27:01.276891+0000","last_became_active":"2023-07-27T14:27:01.269862+0000","last_became_peered":"2023-07-27T14:27:01.269862+0000","last_unstale":"2023-07-27T14:27:01.276891+0000","last_undegraded":"2023-07-27T14:27:01.276891+0000","last_fullsized":"2023-07-27T14:27:01.276891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263675+0000","last_change":"2023-07-27T14:27:00.812553+0000","last_active":"2023-07-27T14:27:01.263675+0000","last_peered":"2023-07-27T14:27:01.263675+0000","last_clean":"2023-07-27T14:27:01.263675+0000","last_became_active":"2023-07-27T14:27:00.812263+0000","last_became_peered":"2023-07-27T14:27:00.812263+0000","last_unstale":"2023-07-27T14:27:01.263675+0000","last_undegraded":"2023-07-27T14:27:01.263675+0000","last_fullsized":"2023-07-27T14:27:01.263675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284961+0000","last_change":"2023-07-27T14:27:01.280658+0000","last_active":"2023-07-27T14:27:01.284961+0000","last_peered":"2023-07-27T14:27:01.284961+0000","last_clean":"2023-07-27T14:27:01.284961+0000","last_became_active":"2023-07-27T14:27:01.279608+0000","last_became_peered":"2023-07-27T14:27:01.279608+0000","last_unstale":"2023-07-27T14:27:01.284961+0000","last_undegraded":"2023-07-27T14:27:01.284961+0000","last_fullsized":"2023-07-27T14:27:01.284961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268276+0000","last_change":"2023-07-27T14:27:00.821769+0000","last_active":"2023-07-27T14:27:01.268276+0000","last_peered":"2023-07-27T14:27:01.268276+0000","last_clean":"2023-07-27T14:27:01.268276+0000","last_became_active":"2023-07-27T14:27:00.820693+0000","last_became_peered":"2023-07-27T14:27:00.820693+0000","last_unstale":"2023-07-27T14:27:01.268276+0000","last_undegraded":"2023-07-27T14:27:01.268276+0000","last_fullsized":"2023-07-27T14:27:01.268276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.297086+0000","last_change":"2023-07-27T14:27:01.290729+0000","last_active":"2023-07-27T14:27:01.297086+0000","last_peered":"2023-07-27T14:27:01.297086+0000","last_clean":"2023-07-27T14:27:01.297086+0000","last_became_active":"2023-07-27T14:27:01.290315+0000","last_became_peered":"2023-07-27T14:27:01.290315+0000","last_unstale":"2023-07-27T14:27:01.297086+0000","last_undegraded":"2023-07-27T14:27:01.297086+0000","last_fullsized":"2023-07-27T14:27:01.297086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284546+0000","last_change":"2023-07-27T14:27:00.815996+0000","last_active":"2023-07-27T14:27:01.284546+0000","last_peered":"2023-07-27T14:27:01.284546+0000","last_clean":"2023-07-27T14:27:01.284546+0000","last_became_active":"2023-07-27T14:27:00.815664+0000","last_became_peered":"2023-07-27T14:27:00.815664+0000","last_unstale":"2023-07-27T14:27:01.284546+0000","last_undegraded":"2023-07-27T14:27:01.284546+0000","last_fullsized":"2023-07-27T14:27:01.284546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296898+0000","last_change":"2023-07-27T14:27:01.288903+0000","last_active":"2023-07-27T14:27:01.296898+0000","last_peered":"2023-07-27T14:27:01.296898+0000","last_clean":"2023-07-27T14:27:01.296898+0000","last_became_active":"2023-07-27T14:27:01.288173+0000","last_became_peered":"2023-07-27T14:27:01.288173+0000","last_unstale":"2023-07-27T14:27:01.296898+0000","last_undegraded":"2023-07-27T14:27:01.296898+0000","last_fullsized":"2023-07-27T14:27:01.296898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263383+0000","last_change":"2023-07-27T14:27:00.817983+0000","last_active":"2023-07-27T14:27:01.263383+0000","last_peered":"2023-07-27T14:27:01.263383+0000","last_clean":"2023-07-27T14:27:01.263383+0000","last_became_active":"2023-07-27T14:27:00.817662+0000","last_became_peered":"2023-07-27T14:27:00.817662+0000","last_unstale":"2023-07-27T14:27:01.263383+0000","last_undegraded":"2023-07-27T14:27:01.263383+0000","last_fullsized":"2023-07-27T14:27:01.263383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299262+0000","last_change":"2023-07-27T14:27:01.294765+0000","last_active":"2023-07-27T14:27:01.299262+0000","last_peered":"2023-07-27T14:27:01.299262+0000","last_clean":"2023-07-27T14:27:01.299262+0000","last_became_active":"2023-07-27T14:27:01.294406+0000","last_became_peered":"2023-07-27T14:27:01.294406+0000","last_unstale":"2023-07-27T14:27:01.299262+0000","last_undegraded":"2023-07-27T14:27:01.299262+0000","last_fullsized":"2023-07-27T14:27:01.299262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283951+0000","last_change":"2023-07-27T14:27:00.820810+0000","last_active":"2023-07-27T14:27:01.283951+0000","last_peered":"2023-07-27T14:27:01.283951+0000","last_clean":"2023-07-27T14:27:01.283951+0000","last_became_active":"2023-07-27T14:27:00.820044+0000","last_became_peered":"2023-07-27T14:27:00.820044+0000","last_unstale":"2023-07-27T14:27:01.283951+0000","last_undegraded":"2023-07-27T14:27:01.283951+0000","last_fullsized":"2023-07-27T14:27:01.283951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285719+0000","last_change":"2023-07-27T14:27:01.275611+0000","last_active":"2023-07-27T14:27:01.285719+0000","last_peered":"2023-07-27T14:27:01.285719+0000","last_clean":"2023-07-27T14:27:01.285719+0000","last_became_active":"2023-07-27T14:27:01.275350+0000","last_became_peered":"2023-07-27T14:27:01.275350+0000","last_unstale":"2023-07-27T14:27:01.285719+0000","last_undegraded":"2023-07-27T14:27:01.285719+0000","last_fullsized":"2023-07-27T14:27:01.285719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260311+0000","last_change":"2023-07-27T14:27:00.818518+0000","last_active":"2023-07-27T14:27:01.260311+0000","last_peered":"2023-07-27T14:27:01.260311+0000","last_clean":"2023-07-27T14:27:01.260311+0000","last_became_active":"2023-07-27T14:27:00.818212+0000","last_became_peered":"2023-07-27T14:27:00.818212+0000","last_unstale":"2023-07-27T14:27:01.260311+0000","last_undegraded":"2023-07-27T14:27:01.260311+0000","last_fullsized":"2023-07-27T14:27:01.260311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268832+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:27:01.268832+0000","last_peered":"2023-07-27T14:27:01.268832+0000","last_clean":"2023-07-27T14:27:01.268832+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:27:01.268832+0000","last_undegraded":"2023-07-27T14:27:01.268832+0000","last_fullsized":"2023-07-27T14:27:01.268832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269206+0000","last_change":"2023-07-27T14:27:00.821466+0000","last_active":"2023-07-27T14:27:01.269206+0000","last_peered":"2023-07-27T14:27:01.269206+0000","last_clean":"2023-07-27T14:27:01.269206+0000","last_became_active":"2023-07-27T14:27:00.820503+0000","last_became_peered":"2023-07-27T14:27:00.820503+0000","last_unstale":"2023-07-27T14:27:01.269206+0000","last_undegraded":"2023-07-27T14:27:01.269206+0000","last_fullsized":"2023-07-27T14:27:01.269206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287169+0000","last_change":"2023-07-27T14:27:01.281635+0000","last_active":"2023-07-27T14:27:01.287169+0000","last_peered":"2023-07-27T14:27:01.287169+0000","last_clean":"2023-07-27T14:27:01.287169+0000","last_became_active":"2023-07-27T14:27:01.281373+0000","last_became_peered":"2023-07-27T14:27:01.281373+0000","last_unstale":"2023-07-27T14:27:01.287169+0000","last_undegraded":"2023-07-27T14:27:01.287169+0000","last_fullsized":"2023-07-27T14:27:01.287169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270038+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:27:01.270038+0000","last_peered":"2023-07-27T14:27:01.270038+0000","last_clean":"2023-07-27T14:27:01.270038+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:27:01.270038+0000","last_undegraded":"2023-07-27T14:27:01.270038+0000","last_fullsized":"2023-07-27T14:27:01.270038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281414+0000","last_change":"2023-07-27T14:27:00.824620+0000","last_active":"2023-07-27T14:27:01.281414+0000","last_peered":"2023-07-27T14:27:01.281414+0000","last_clean":"2023-07-27T14:27:01.281414+0000","last_became_active":"2023-07-27T14:27:00.824324+0000","last_became_peered":"2023-07-27T14:27:00.824324+0000","last_unstale":"2023-07-27T14:27:01.281414+0000","last_undegraded":"2023-07-27T14:27:01.281414+0000","last_fullsized":"2023-07-27T14:27:01.281414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285758+0000","last_change":"2023-07-27T14:27:01.275718+0000","last_active":"2023-07-27T14:27:01.285758+0000","last_peered":"2023-07-27T14:27:01.285758+0000","last_clean":"2023-07-27T14:27:01.285758+0000","last_became_active":"2023-07-27T14:27:01.275463+0000","last_became_peered":"2023-07-27T14:27:01.275463+0000","last_unstale":"2023-07-27T14:27:01.285758+0000","last_undegraded":"2023-07-27T14:27:01.285758+0000","last_fullsized":"2023-07-27T14:27:01.285758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287139+0000","last_change":"2023-07-27T14:27:01.282173+0000","last_active":"2023-07-27T14:27:01.287139+0000","last_peered":"2023-07-27T14:27:01.287139+0000","last_clean":"2023-07-27T14:27:01.287139+0000","last_became_active":"2023-07-27T14:27:01.281870+0000","last_became_peered":"2023-07-27T14:27:01.281870+0000","last_unstale":"2023-07-27T14:27:01.287139+0000","last_undegraded":"2023-07-27T14:27:01.287139+0000","last_fullsized":"2023-07-27T14:27:01.287139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270296+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:27:01.270296+0000","last_peered":"2023-07-27T14:27:01.270296+0000","last_clean":"2023-07-27T14:27:01.270296+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:27:01.270296+0000","last_undegraded":"2023-07-27T14:27:01.270296+0000","last_fullsized":"2023-07-27T14:27:01.270296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264337+0000","last_change":"2023-07-27T14:27:00.806662+0000","last_active":"2023-07-27T14:27:01.264337+0000","last_peered":"2023-07-27T14:27:01.264337+0000","last_clean":"2023-07-27T14:27:01.264337+0000","last_became_active":"2023-07-27T14:27:00.806332+0000","last_became_peered":"2023-07-27T14:27:00.806332+0000","last_unstale":"2023-07-27T14:27:01.264337+0000","last_undegraded":"2023-07-27T14:27:01.264337+0000","last_fullsized":"2023-07-27T14:27:01.264337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.301639+0000","last_change":"2023-07-27T14:27:01.294577+0000","last_active":"2023-07-27T14:27:01.301639+0000","last_peered":"2023-07-27T14:27:01.301639+0000","last_clean":"2023-07-27T14:27:01.301639+0000","last_became_active":"2023-07-27T14:27:01.294285+0000","last_became_peered":"2023-07-27T14:27:01.294285+0000","last_unstale":"2023-07-27T14:27:01.301639+0000","last_undegraded":"2023-07-27T14:27:01.301639+0000","last_fullsized":"2023-07-27T14:27:01.301639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268394+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:27:01.268394+0000","last_peered":"2023-07-27T14:27:01.268394+0000","last_clean":"2023-07-27T14:27:01.268394+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:27:01.268394+0000","last_undegraded":"2023-07-27T14:27:01.268394+0000","last_fullsized":"2023-07-27T14:27:01.268394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.261907+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:27:01.261907+0000","last_peered":"2023-07-27T14:27:01.261907+0000","last_clean":"2023-07-27T14:27:01.261907+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:27:01.261907+0000","last_undegraded":"2023-07-27T14:27:01.261907+0000","last_fullsized":"2023-07-27T14:27:01.261907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260911+0000","last_change":"2023-07-27T14:27:00.820288+0000","last_active":"2023-07-27T14:27:01.260911+0000","last_peered":"2023-07-27T14:27:01.260911+0000","last_clean":"2023-07-27T14:27:01.260911+0000","last_became_active":"2023-07-27T14:27:00.818566+0000","last_became_peered":"2023-07-27T14:27:00.818566+0000","last_unstale":"2023-07-27T14:27:01.260911+0000","last_undegraded":"2023-07-27T14:27:01.260911+0000","last_fullsized":"2023-07-27T14:27:01.260911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285387+0000","last_change":"2023-07-27T14:27:01.281461+0000","last_active":"2023-07-27T14:27:01.285387+0000","last_peered":"2023-07-27T14:27:01.285387+0000","last_clean":"2023-07-27T14:27:01.285387+0000","last_became_active":"2023-07-27T14:27:01.280500+0000","last_became_peered":"2023-07-27T14:27:01.280500+0000","last_unstale":"2023-07-27T14:27:01.285387+0000","last_undegraded":"2023-07-27T14:27:01.285387+0000","last_fullsized":"2023-07-27T14:27:01.285387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.262018+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:27:01.262018+0000","last_peered":"2023-07-27T14:27:01.262018+0000","last_clean":"2023-07-27T14:27:01.262018+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:27:01.262018+0000","last_undegraded":"2023-07-27T14:27:01.262018+0000","last_fullsized":"2023-07-27T14:27:01.262018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265806+0000","last_change":"2023-07-27T14:27:00.821693+0000","last_active":"2023-07-27T14:27:01.265806+0000","last_peered":"2023-07-27T14:27:01.265806+0000","last_clean":"2023-07-27T14:27:01.265806+0000","last_became_active":"2023-07-27T14:27:00.821333+0000","last_became_peered":"2023-07-27T14:27:00.821333+0000","last_unstale":"2023-07-27T14:27:01.265806+0000","last_undegraded":"2023-07-27T14:27:01.265806+0000","last_fullsized":"2023-07-27T14:27:01.265806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263547+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:27:01.263547+0000","last_peered":"2023-07-27T14:27:01.263547+0000","last_clean":"2023-07-27T14:27:01.263547+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:27:01.263547+0000","last_undegraded":"2023-07-27T14:27:01.263547+0000","last_fullsized":"2023-07-27T14:27:01.263547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268983+0000","last_change":"2023-07-27T14:27:00.803181+0000","last_active":"2023-07-27T14:27:01.268983+0000","last_peered":"2023-07-27T14:27:01.268983+0000","last_clean":"2023-07-27T14:27:01.268983+0000","last_became_active":"2023-07-27T14:27:00.802812+0000","last_became_peered":"2023-07-27T14:27:00.802812+0000","last_unstale":"2023-07-27T14:27:01.268983+0000","last_undegraded":"2023-07-27T14:27:01.268983+0000","last_fullsized":"2023-07-27T14:27:01.268983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287297+0000","last_change":"2023-07-27T14:27:01.285120+0000","last_active":"2023-07-27T14:27:01.287297+0000","last_peered":"2023-07-27T14:27:01.287297+0000","last_clean":"2023-07-27T14:27:01.287297+0000","last_became_active":"2023-07-27T14:27:01.284758+0000","last_became_peered":"2023-07-27T14:27:01.284758+0000","last_unstale":"2023-07-27T14:27:01.287297+0000","last_undegraded":"2023-07-27T14:27:01.287297+0000","last_fullsized":"2023-07-27T14:27:01.287297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288456+0000","last_change":"2023-07-27T14:27:00.822951+0000","last_active":"2023-07-27T14:27:01.288456+0000","last_peered":"2023-07-27T14:27:01.288456+0000","last_clean":"2023-07-27T14:27:01.288456+0000","last_became_active":"2023-07-27T14:27:00.822642+0000","last_became_peered":"2023-07-27T14:27:00.822642+0000","last_unstale":"2023-07-27T14:27:01.288456+0000","last_undegraded":"2023-07-27T14:27:01.288456+0000","last_fullsized":"2023-07-27T14:27:01.288456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268617+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:27:01.268617+0000","last_peered":"2023-07-27T14:27:01.268617+0000","last_clean":"2023-07-27T14:27:01.268617+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:27:01.268617+0000","last_undegraded":"2023-07-27T14:27:01.268617+0000","last_fullsized":"2023-07-27T14:27:01.268617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281966+0000","last_change":"2023-07-27T14:27:01.274025+0000","last_active":"2023-07-27T14:27:01.281966+0000","last_peered":"2023-07-27T14:27:01.281966+0000","last_clean":"2023-07-27T14:27:01.281966+0000","last_became_active":"2023-07-27T14:27:01.273760+0000","last_became_peered":"2023-07-27T14:27:01.273760+0000","last_unstale":"2023-07-27T14:27:01.281966+0000","last_undegraded":"2023-07-27T14:27:01.281966+0000","last_fullsized":"2023-07-27T14:27:01.281966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264130+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:27:01.264130+0000","last_peered":"2023-07-27T14:27:01.264130+0000","last_clean":"2023-07-27T14:27:01.264130+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:27:01.264130+0000","last_undegraded":"2023-07-27T14:27:01.264130+0000","last_fullsized":"2023-07-27T14:27:01.264130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.266294+0000","last_change":"2023-07-27T14:27:00.809142+0000","last_active":"2023-07-27T14:27:01.266294+0000","last_peered":"2023-07-27T14:27:01.266294+0000","last_clean":"2023-07-27T14:27:01.266294+0000","last_became_active":"2023-07-27T14:27:00.808822+0000","last_became_peered":"2023-07-27T14:27:00.808822+0000","last_unstale":"2023-07-27T14:27:01.266294+0000","last_undegraded":"2023-07-27T14:27:01.266294+0000","last_fullsized":"2023-07-27T14:27:01.266294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299128+0000","last_change":"2023-07-27T14:27:01.293162+0000","last_active":"2023-07-27T14:27:01.299128+0000","last_peered":"2023-07-27T14:27:01.299128+0000","last_clean":"2023-07-27T14:27:01.299128+0000","last_became_active":"2023-07-27T14:27:01.292764+0000","last_became_peered":"2023-07-27T14:27:01.292764+0000","last_unstale":"2023-07-27T14:27:01.299128+0000","last_undegraded":"2023-07-27T14:27:01.299128+0000","last_fullsized":"2023-07-27T14:27:01.299128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286788+0000","last_change":"2023-07-27T14:27:01.278950+0000","last_active":"2023-07-27T14:27:01.286788+0000","last_peered":"2023-07-27T14:27:01.286788+0000","last_clean":"2023-07-27T14:27:01.286788+0000","last_became_active":"2023-07-27T14:27:01.278643+0000","last_became_peered":"2023-07-27T14:27:01.278643+0000","last_unstale":"2023-07-27T14:27:01.286788+0000","last_undegraded":"2023-07-27T14:27:01.286788+0000","last_fullsized":"2023-07-27T14:27:01.286788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265962+0000","last_change":"2023-07-27T14:27:00.820665+0000","last_active":"2023-07-27T14:27:01.265962+0000","last_peered":"2023-07-27T14:27:01.265962+0000","last_clean":"2023-07-27T14:27:01.265962+0000","last_became_active":"2023-07-27T14:27:00.820385+0000","last_became_peered":"2023-07-27T14:27:00.820385+0000","last_unstale":"2023-07-27T14:27:01.265962+0000","last_undegraded":"2023-07-27T14:27:01.265962+0000","last_fullsized":"2023-07-27T14:27:01.265962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299158+0000","last_change":"2023-07-27T14:27:01.293370+0000","last_active":"2023-07-27T14:27:01.299158+0000","last_peered":"2023-07-27T14:27:01.299158+0000","last_clean":"2023-07-27T14:27:01.299158+0000","last_became_active":"2023-07-27T14:27:01.293073+0000","last_became_peered":"2023-07-27T14:27:01.293073+0000","last_unstale":"2023-07-27T14:27:01.299158+0000","last_undegraded":"2023-07-27T14:27:01.299158+0000","last_fullsized":"2023-07-27T14:27:01.299158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268393+0000","last_change":"2023-07-27T14:27:00.821425+0000","last_active":"2023-07-27T14:27:01.268393+0000","last_peered":"2023-07-27T14:27:01.268393+0000","last_clean":"2023-07-27T14:27:01.268393+0000","last_became_active":"2023-07-27T14:27:00.820969+0000","last_became_peered":"2023-07-27T14:27:00.820969+0000","last_unstale":"2023-07-27T14:27:01.268393+0000","last_undegraded":"2023-07-27T14:27:01.268393+0000","last_fullsized":"2023-07-27T14:27:01.268393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299195+0000","last_change":"2023-07-27T14:27:01.293918+0000","last_active":"2023-07-27T14:27:01.299195+0000","last_peered":"2023-07-27T14:27:01.299195+0000","last_clean":"2023-07-27T14:27:01.299195+0000","last_became_active":"2023-07-27T14:27:01.293535+0000","last_became_peered":"2023-07-27T14:27:01.293535+0000","last_unstale":"2023-07-27T14:27:01.299195+0000","last_undegraded":"2023-07-27T14:27:01.299195+0000","last_fullsized":"2023-07-27T14:27:01.299195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295160+0000","last_change":"2023-07-27T14:27:00.821100+0000","last_active":"2023-07-27T14:27:01.295160+0000","last_peered":"2023-07-27T14:27:01.295160+0000","last_clean":"2023-07-27T14:27:01.295160+0000","last_became_active":"2023-07-27T14:27:00.820834+0000","last_became_peered":"2023-07-27T14:27:00.820834+0000","last_unstale":"2023-07-27T14:27:01.295160+0000","last_undegraded":"2023-07-27T14:27:01.295160+0000","last_fullsized":"2023-07-27T14:27:01.295160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282491+0000","last_change":"2023-07-27T14:27:01.279306+0000","last_active":"2023-07-27T14:27:01.282491+0000","last_peered":"2023-07-27T14:27:01.282491+0000","last_clean":"2023-07-27T14:27:01.282491+0000","last_became_active":"2023-07-27T14:27:01.279053+0000","last_became_peered":"2023-07-27T14:27:01.279053+0000","last_unstale":"2023-07-27T14:27:01.282491+0000","last_undegraded":"2023-07-27T14:27:01.282491+0000","last_fullsized":"2023-07-27T14:27:01.282491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282641+0000","last_change":"2023-07-27T14:27:00.821978+0000","last_active":"2023-07-27T14:27:01.282641+0000","last_peered":"2023-07-27T14:27:01.282641+0000","last_clean":"2023-07-27T14:27:01.282641+0000","last_became_active":"2023-07-27T14:27:00.821626+0000","last_became_peered":"2023-07-27T14:27:00.821626+0000","last_unstale":"2023-07-27T14:27:01.282641+0000","last_undegraded":"2023-07-27T14:27:01.282641+0000","last_fullsized":"2023-07-27T14:27:01.282641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.297029+0000","last_change":"2023-07-27T14:27:01.289940+0000","last_active":"2023-07-27T14:27:01.297029+0000","last_peered":"2023-07-27T14:27:01.297029+0000","last_clean":"2023-07-27T14:27:01.297029+0000","last_became_active":"2023-07-27T14:27:01.289604+0000","last_became_peered":"2023-07-27T14:27:01.289604+0000","last_unstale":"2023-07-27T14:27:01.297029+0000","last_undegraded":"2023-07-27T14:27:01.297029+0000","last_fullsized":"2023-07-27T14:27:01.297029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282827+0000","last_change":"2023-07-27T14:27:00.811768+0000","last_active":"2023-07-27T14:27:01.282827+0000","last_peered":"2023-07-27T14:27:01.282827+0000","last_clean":"2023-07-27T14:27:01.282827+0000","last_became_active":"2023-07-27T14:27:00.811467+0000","last_became_peered":"2023-07-27T14:27:00.811467+0000","last_unstale":"2023-07-27T14:27:01.282827+0000","last_undegraded":"2023-07-27T14:27:01.282827+0000","last_fullsized":"2023-07-27T14:27:01.282827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.275243+0000","last_change":"2023-07-27T14:27:01.271866+0000","last_active":"2023-07-27T14:27:01.275243+0000","last_peered":"2023-07-27T14:27:01.275243+0000","last_clean":"2023-07-27T14:27:01.275243+0000","last_became_active":"2023-07-27T14:27:01.271572+0000","last_became_peered":"2023-07-27T14:27:01.271572+0000","last_unstale":"2023-07-27T14:27:01.275243+0000","last_undegraded":"2023-07-27T14:27:01.275243+0000","last_fullsized":"2023-07-27T14:27:01.275243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263223+0000","last_change":"2023-07-27T14:27:00.809399+0000","last_active":"2023-07-27T14:27:01.263223+0000","last_peered":"2023-07-27T14:27:01.263223+0000","last_clean":"2023-07-27T14:27:01.263223+0000","last_became_active":"2023-07-27T14:27:00.809047+0000","last_became_peered":"2023-07-27T14:27:00.809047+0000","last_unstale":"2023-07-27T14:27:01.263223+0000","last_undegraded":"2023-07-27T14:27:01.263223+0000","last_fullsized":"2023-07-27T14:27:01.263223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286895+0000","last_change":"2023-07-27T14:27:01.277061+0000","last_active":"2023-07-27T14:27:01.286895+0000","last_peered":"2023-07-27T14:27:01.286895+0000","last_clean":"2023-07-27T14:27:01.286895+0000","last_became_active":"2023-07-27T14:27:01.276810+0000","last_became_peered":"2023-07-27T14:27:01.276810+0000","last_unstale":"2023-07-27T14:27:01.286895+0000","last_undegraded":"2023-07-27T14:27:01.286895+0000","last_fullsized":"2023-07-27T14:27:01.286895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270326+0000","last_change":"2023-07-27T14:27:00.810515+0000","last_active":"2023-07-27T14:27:01.270326+0000","last_peered":"2023-07-27T14:27:01.270326+0000","last_clean":"2023-07-27T14:27:01.270326+0000","last_became_active":"2023-07-27T14:27:00.810250+0000","last_became_peered":"2023-07-27T14:27:00.810250+0000","last_unstale":"2023-07-27T14:27:01.270326+0000","last_undegraded":"2023-07-27T14:27:01.270326+0000","last_fullsized":"2023-07-27T14:27:01.270326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296559+0000","last_change":"2023-07-27T14:27:01.288902+0000","last_active":"2023-07-27T14:27:01.296559+0000","last_peered":"2023-07-27T14:27:01.296559+0000","last_clean":"2023-07-27T14:27:01.296559+0000","last_became_active":"2023-07-27T14:27:01.288298+0000","last_became_peered":"2023-07-27T14:27:01.288298+0000","last_unstale":"2023-07-27T14:27:01.296559+0000","last_undegraded":"2023-07-27T14:27:01.296559+0000","last_fullsized":"2023-07-27T14:27:01.296559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270140+0000","last_change":"2023-07-27T14:27:00.821272+0000","last_active":"2023-07-27T14:27:01.270140+0000","last_peered":"2023-07-27T14:27:01.270140+0000","last_clean":"2023-07-27T14:27:01.270140+0000","last_became_active":"2023-07-27T14:27:00.820947+0000","last_became_peered":"2023-07-27T14:27:00.820947+0000","last_unstale":"2023-07-27T14:27:01.270140+0000","last_undegraded":"2023-07-27T14:27:01.270140+0000","last_fullsized":"2023-07-27T14:27:01.270140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.277787+0000","last_change":"2023-07-27T14:27:01.273588+0000","last_active":"2023-07-27T14:27:01.277787+0000","last_peered":"2023-07-27T14:27:01.277787+0000","last_clean":"2023-07-27T14:27:01.277787+0000","last_became_active":"2023-07-27T14:27:01.273352+0000","last_became_peered":"2023-07-27T14:27:01.273352+0000","last_unstale":"2023-07-27T14:27:01.277787+0000","last_undegraded":"2023-07-27T14:27:01.277787+0000","last_fullsized":"2023-07-27T14:27:01.277787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265785+0000","last_change":"2023-07-27T14:27:00.820075+0000","last_active":"2023-07-27T14:27:01.265785+0000","last_peered":"2023-07-27T14:27:01.265785+0000","last_clean":"2023-07-27T14:27:01.265785+0000","last_became_active":"2023-07-27T14:27:00.819794+0000","last_became_peered":"2023-07-27T14:27:00.819794+0000","last_unstale":"2023-07-27T14:27:01.265785+0000","last_undegraded":"2023-07-27T14:27:01.265785+0000","last_fullsized":"2023-07-27T14:27:01.265785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283080+0000","last_change":"2023-07-27T14:27:01.280882+0000","last_active":"2023-07-27T14:27:01.283080+0000","last_peered":"2023-07-27T14:27:01.283080+0000","last_clean":"2023-07-27T14:27:01.283080+0000","last_became_active":"2023-07-27T14:27:01.280339+0000","last_became_peered":"2023-07-27T14:27:01.280339+0000","last_unstale":"2023-07-27T14:27:01.283080+0000","last_undegraded":"2023-07-27T14:27:01.283080+0000","last_fullsized":"2023-07-27T14:27:01.283080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260518+0000","last_change":"2023-07-27T14:27:00.820859+0000","last_active":"2023-07-27T14:27:01.260518+0000","last_peered":"2023-07-27T14:27:01.260518+0000","last_clean":"2023-07-27T14:27:01.260518+0000","last_became_active":"2023-07-27T14:27:00.820298+0000","last_became_peered":"2023-07-27T14:27:00.820298+0000","last_unstale":"2023-07-27T14:27:01.260518+0000","last_undegraded":"2023-07-27T14:27:01.260518+0000","last_fullsized":"2023-07-27T14:27:01.260518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299244+0000","last_change":"2023-07-27T14:27:01.294252+0000","last_active":"2023-07-27T14:27:01.299244+0000","last_peered":"2023-07-27T14:27:01.299244+0000","last_clean":"2023-07-27T14:27:01.299244+0000","last_became_active":"2023-07-27T14:27:01.293925+0000","last_became_peered":"2023-07-27T14:27:01.293925+0000","last_unstale":"2023-07-27T14:27:01.299244+0000","last_undegraded":"2023-07-27T14:27:01.299244+0000","last_fullsized":"2023-07-27T14:27:01.299244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268711+0000","last_change":"2023-07-27T14:27:00.816789+0000","last_active":"2023-07-27T14:27:01.268711+0000","last_peered":"2023-07-27T14:27:01.268711+0000","last_clean":"2023-07-27T14:27:01.268711+0000","last_became_active":"2023-07-27T14:27:00.816454+0000","last_became_peered":"2023-07-27T14:27:00.816454+0000","last_unstale":"2023-07-27T14:27:01.268711+0000","last_undegraded":"2023-07-27T14:27:01.268711+0000","last_fullsized":"2023-07-27T14:27:01.268711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281998+0000","last_change":"2023-07-27T14:27:01.270224+0000","last_active":"2023-07-27T14:27:01.281998+0000","last_peered":"2023-07-27T14:27:01.281998+0000","last_clean":"2023-07-27T14:27:01.281998+0000","last_became_active":"2023-07-27T14:27:01.269914+0000","last_became_peered":"2023-07-27T14:27:01.269914+0000","last_unstale":"2023-07-27T14:27:01.281998+0000","last_undegraded":"2023-07-27T14:27:01.281998+0000","last_fullsized":"2023-07-27T14:27:01.281998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-27T14:27:04.777547+0000","last_change":"2023-07-27T14:27:00.805825+0000","last_active":"2023-07-27T14:27:04.777547+0000","last_peered":"2023-07-27T14:27:04.777547+0000","last_clean":"2023-07-27T14:27:04.777547+0000","last_became_active":"2023-07-27T14:27:00.805285+0000","last_became_peered":"2023-07-27T14:27:00.805285+0000","last_unstale":"2023-07-27T14:27:04.777547+0000","last_undegraded":"2023-07-27T14:27:04.777547+0000","last_fullsized":"2023-07-27T14:27:04.777547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286764+0000","last_change":"2023-07-27T14:27:01.278889+0000","last_active":"2023-07-27T14:27:01.286764+0000","last_peered":"2023-07-27T14:27:01.286764+0000","last_clean":"2023-07-27T14:27:01.286764+0000","last_became_active":"2023-07-27T14:27:01.277699+0000","last_became_peered":"2023-07-27T14:27:01.277699+0000","last_unstale":"2023-07-27T14:27:01.286764+0000","last_undegraded":"2023-07-27T14:27:01.286764+0000","last_fullsized":"2023-07-27T14:27:01.286764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260325+0000","last_change":"2023-07-27T14:27:00.818272+0000","last_active":"2023-07-27T14:27:01.260325+0000","last_peered":"2023-07-27T14:27:01.260325+0000","last_clean":"2023-07-27T14:27:01.260325+0000","last_became_active":"2023-07-27T14:27:00.817922+0000","last_became_peered":"2023-07-27T14:27:00.817922+0000","last_unstale":"2023-07-27T14:27:01.260325+0000","last_undegraded":"2023-07-27T14:27:01.260325+0000","last_fullsized":"2023-07-27T14:27:01.260325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281674+0000","last_change":"2023-07-27T14:27:01.277882+0000","last_active":"2023-07-27T14:27:01.281674+0000","last_peered":"2023-07-27T14:27:01.281674+0000","last_clean":"2023-07-27T14:27:01.281674+0000","last_became_active":"2023-07-27T14:27:01.276949+0000","last_became_peered":"2023-07-27T14:27:01.276949+0000","last_unstale":"2023-07-27T14:27:01.281674+0000","last_undegraded":"2023-07-27T14:27:01.281674+0000","last_fullsized":"2023-07-27T14:27:01.281674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269102+0000","last_change":"2023-07-27T14:27:00.822718+0000","last_active":"2023-07-27T14:27:01.269102+0000","last_peered":"2023-07-27T14:27:01.269102+0000","last_clean":"2023-07-27T14:27:01.269102+0000","last_became_active":"2023-07-27T14:27:00.822424+0000","last_became_peered":"2023-07-27T14:27:00.822424+0000","last_unstale":"2023-07-27T14:27:01.269102+0000","last_undegraded":"2023-07-27T14:27:01.269102+0000","last_fullsized":"2023-07-27T14:27:01.269102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299280+0000","last_change":"2023-07-27T14:27:01.295205+0000","last_active":"2023-07-27T14:27:01.299280+0000","last_peered":"2023-07-27T14:27:01.299280+0000","last_clean":"2023-07-27T14:27:01.299280+0000","last_became_active":"2023-07-27T14:27:01.294982+0000","last_became_peered":"2023-07-27T14:27:01.294982+0000","last_unstale":"2023-07-27T14:27:01.299280+0000","last_undegraded":"2023-07-27T14:27:01.299280+0000","last_fullsized":"2023-07-27T14:27:01.299280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260244+0000","last_change":"2023-07-27T14:27:00.821157+0000","last_active":"2023-07-27T14:27:01.260244+0000","last_peered":"2023-07-27T14:27:01.260244+0000","last_clean":"2023-07-27T14:27:01.260244+0000","last_became_active":"2023-07-27T14:27:00.820866+0000","last_became_peered":"2023-07-27T14:27:00.820866+0000","last_unstale":"2023-07-27T14:27:01.260244+0000","last_undegraded":"2023-07-27T14:27:01.260244+0000","last_fullsized":"2023-07-27T14:27:01.260244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.279179+0000","last_change":"2023-07-27T14:27:01.274421+0000","last_active":"2023-07-27T14:27:01.279179+0000","last_peered":"2023-07-27T14:27:01.279179+0000","last_clean":"2023-07-27T14:27:01.279179+0000","last_became_active":"2023-07-27T14:27:01.274184+0000","last_became_peered":"2023-07-27T14:27:01.274184+0000","last_unstale":"2023-07-27T14:27:01.279179+0000","last_undegraded":"2023-07-27T14:27:01.279179+0000","last_fullsized":"2023-07-27T14:27:01.279179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270247+0000","last_change":"2023-07-27T14:27:00.800329+0000","last_active":"2023-07-27T14:27:01.270247+0000","last_peered":"2023-07-27T14:27:01.270247+0000","last_clean":"2023-07-27T14:27:01.270247+0000","last_became_active":"2023-07-27T14:27:00.799971+0000","last_became_peered":"2023-07-27T14:27:00.799971+0000","last_unstale":"2023-07-27T14:27:01.270247+0000","last_undegraded":"2023-07-27T14:27:01.270247+0000","last_fullsized":"2023-07-27T14:27:01.270247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.297068+0000","last_change":"2023-07-27T14:27:01.290197+0000","last_active":"2023-07-27T14:27:01.297068+0000","last_peered":"2023-07-27T14:27:01.297068+0000","last_clean":"2023-07-27T14:27:01.297068+0000","last_became_active":"2023-07-27T14:27:01.289777+0000","last_became_peered":"2023-07-27T14:27:01.289777+0000","last_unstale":"2023-07-27T14:27:01.297068+0000","last_undegraded":"2023-07-27T14:27:01.297068+0000","last_fullsized":"2023-07-27T14:27:01.297068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290972+0000","last_change":"2023-07-27T14:27:00.812501+0000","last_active":"2023-07-27T14:27:01.290972+0000","last_peered":"2023-07-27T14:27:01.290972+0000","last_clean":"2023-07-27T14:27:01.290972+0000","last_became_active":"2023-07-27T14:27:00.810185+0000","last_became_peered":"2023-07-27T14:27:00.810185+0000","last_unstale":"2023-07-27T14:27:01.290972+0000","last_undegraded":"2023-07-27T14:27:01.290972+0000","last_fullsized":"2023-07-27T14:27:01.290972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289510+0000","last_change":"2023-07-27T14:27:01.281360+0000","last_active":"2023-07-27T14:27:01.289510+0000","last_peered":"2023-07-27T14:27:01.289510+0000","last_clean":"2023-07-27T14:27:01.289510+0000","last_became_active":"2023-07-27T14:27:01.279561+0000","last_became_peered":"2023-07-27T14:27:01.279561+0000","last_unstale":"2023-07-27T14:27:01.289510+0000","last_undegraded":"2023-07-27T14:27:01.289510+0000","last_fullsized":"2023-07-27T14:27:01.289510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263513+0000","last_change":"2023-07-27T14:27:00.821016+0000","last_active":"2023-07-27T14:27:01.263513+0000","last_peered":"2023-07-27T14:27:01.263513+0000","last_clean":"2023-07-27T14:27:01.263513+0000","last_became_active":"2023-07-27T14:27:00.820542+0000","last_became_peered":"2023-07-27T14:27:00.820542+0000","last_unstale":"2023-07-27T14:27:01.263513+0000","last_undegraded":"2023-07-27T14:27:01.263513+0000","last_fullsized":"2023-07-27T14:27:01.263513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281760+0000","last_change":"2023-07-27T14:27:01.279230+0000","last_active":"2023-07-27T14:27:01.281760+0000","last_peered":"2023-07-27T14:27:01.281760+0000","last_clean":"2023-07-27T14:27:01.281760+0000","last_became_active":"2023-07-27T14:27:01.278983+0000","last_became_peered":"2023-07-27T14:27:01.278983+0000","last_unstale":"2023-07-27T14:27:01.281760+0000","last_undegraded":"2023-07-27T14:27:01.281760+0000","last_fullsized":"2023-07-27T14:27:01.281760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288581+0000","last_change":"2023-07-27T14:27:00.807042+0000","last_active":"2023-07-27T14:27:01.288581+0000","last_peered":"2023-07-27T14:27:01.288581+0000","last_clean":"2023-07-27T14:27:01.288581+0000","last_became_active":"2023-07-27T14:27:00.805697+0000","last_became_peered":"2023-07-27T14:27:00.805697+0000","last_unstale":"2023-07-27T14:27:01.288581+0000","last_undegraded":"2023-07-27T14:27:01.288581+0000","last_fullsized":"2023-07-27T14:27:01.288581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285431+0000","last_change":"2023-07-27T14:27:01.283982+0000","last_active":"2023-07-27T14:27:01.285431+0000","last_peered":"2023-07-27T14:27:01.285431+0000","last_clean":"2023-07-27T14:27:01.285431+0000","last_became_active":"2023-07-27T14:27:01.283720+0000","last_became_peered":"2023-07-27T14:27:01.283720+0000","last_unstale":"2023-07-27T14:27:01.285431+0000","last_undegraded":"2023-07-27T14:27:01.285431+0000","last_fullsized":"2023-07-27T14:27:01.285431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270872+0000","last_change":"2023-07-27T14:27:00.803325+0000","last_active":"2023-07-27T14:27:01.270872+0000","last_peered":"2023-07-27T14:27:01.270872+0000","last_clean":"2023-07-27T14:27:01.270872+0000","last_became_active":"2023-07-27T14:27:00.802962+0000","last_became_peered":"2023-07-27T14:27:00.802962+0000","last_unstale":"2023-07-27T14:27:01.270872+0000","last_undegraded":"2023-07-27T14:27:01.270872+0000","last_fullsized":"2023-07-27T14:27:01.270872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287648+0000","last_change":"2023-07-27T14:27:01.280016+0000","last_active":"2023-07-27T14:27:01.287648+0000","last_peered":"2023-07-27T14:27:01.287648+0000","last_clean":"2023-07-27T14:27:01.287648+0000","last_became_active":"2023-07-27T14:27:01.279475+0000","last_became_peered":"2023-07-27T14:27:01.279475+0000","last_unstale":"2023-07-27T14:27:01.287648+0000","last_undegraded":"2023-07-27T14:27:01.287648+0000","last_fullsized":"2023-07-27T14:27:01.287648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268740+0000","last_change":"2023-07-27T14:27:00.808976+0000","last_active":"2023-07-27T14:27:01.268740+0000","last_peered":"2023-07-27T14:27:01.268740+0000","last_clean":"2023-07-27T14:27:01.268740+0000","last_became_active":"2023-07-27T14:27:00.808693+0000","last_became_peered":"2023-07-27T14:27:00.808693+0000","last_unstale":"2023-07-27T14:27:01.268740+0000","last_undegraded":"2023-07-27T14:27:01.268740+0000","last_fullsized":"2023-07-27T14:27:01.268740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281655+0000","last_change":"2023-07-27T14:27:01.277692+0000","last_active":"2023-07-27T14:27:01.281655+0000","last_peered":"2023-07-27T14:27:01.281655+0000","last_clean":"2023-07-27T14:27:01.281655+0000","last_became_active":"2023-07-27T14:27:01.277446+0000","last_became_peered":"2023-07-27T14:27:01.277446+0000","last_unstale":"2023-07-27T14:27:01.281655+0000","last_undegraded":"2023-07-27T14:27:01.281655+0000","last_fullsized":"2023-07-27T14:27:01.281655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289999+0000","last_change":"2023-07-27T14:27:00.804577+0000","last_active":"2023-07-27T14:27:01.289999+0000","last_peered":"2023-07-27T14:27:01.289999+0000","last_clean":"2023-07-27T14:27:01.289999+0000","last_became_active":"2023-07-27T14:27:00.804260+0000","last_became_peered":"2023-07-27T14:27:00.804260+0000","last_unstale":"2023-07-27T14:27:01.289999+0000","last_undegraded":"2023-07-27T14:27:01.289999+0000","last_fullsized":"2023-07-27T14:27:01.289999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287961+0000","last_change":"2023-07-27T14:27:01.283951+0000","last_active":"2023-07-27T14:27:01.287961+0000","last_peered":"2023-07-27T14:27:01.287961+0000","last_clean":"2023-07-27T14:27:01.287961+0000","last_became_active":"2023-07-27T14:27:01.283632+0000","last_became_peered":"2023-07-27T14:27:01.283632+0000","last_unstale":"2023-07-27T14:27:01.287961+0000","last_undegraded":"2023-07-27T14:27:01.287961+0000","last_fullsized":"2023-07-27T14:27:01.287961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.267667+0000","last_change":"2023-07-27T14:27:00.824631+0000","last_active":"2023-07-27T14:27:01.267667+0000","last_peered":"2023-07-27T14:27:01.267667+0000","last_clean":"2023-07-27T14:27:01.267667+0000","last_became_active":"2023-07-27T14:27:00.824325+0000","last_became_peered":"2023-07-27T14:27:00.824325+0000","last_unstale":"2023-07-27T14:27:01.267667+0000","last_undegraded":"2023-07-27T14:27:01.267667+0000","last_fullsized":"2023-07-27T14:27:01.267667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296913+0000","last_change":"2023-07-27T14:27:01.289044+0000","last_active":"2023-07-27T14:27:01.296913+0000","last_peered":"2023-07-27T14:27:01.296913+0000","last_clean":"2023-07-27T14:27:01.296913+0000","last_became_active":"2023-07-27T14:27:01.288554+0000","last_became_peered":"2023-07-27T14:27:01.288554+0000","last_unstale":"2023-07-27T14:27:01.296913+0000","last_undegraded":"2023-07-27T14:27:01.296913+0000","last_fullsized":"2023-07-27T14:27:01.296913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265219+0000","last_change":"2023-07-27T14:27:00.809620+0000","last_active":"2023-07-27T14:27:01.265219+0000","last_peered":"2023-07-27T14:27:01.265219+0000","last_clean":"2023-07-27T14:27:01.265219+0000","last_became_active":"2023-07-27T14:27:00.808904+0000","last_became_peered":"2023-07-27T14:27:00.808904+0000","last_unstale":"2023-07-27T14:27:01.265219+0000","last_undegraded":"2023-07-27T14:27:01.265219+0000","last_fullsized":"2023-07-27T14:27:01.265219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290692+0000","last_change":"2023-07-27T14:27:01.289240+0000","last_active":"2023-07-27T14:27:01.290692+0000","last_peered":"2023-07-27T14:27:01.290692+0000","last_clean":"2023-07-27T14:27:01.290692+0000","last_became_active":"2023-07-27T14:27:01.288802+0000","last_became_peered":"2023-07-27T14:27:01.288802+0000","last_unstale":"2023-07-27T14:27:01.290692+0000","last_undegraded":"2023-07-27T14:27:01.290692+0000","last_fullsized":"2023-07-27T14:27:01.290692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281879+0000","last_change":"2023-07-27T14:27:00.822946+0000","last_active":"2023-07-27T14:27:01.281879+0000","last_peered":"2023-07-27T14:27:01.281879+0000","last_clean":"2023-07-27T14:27:01.281879+0000","last_became_active":"2023-07-27T14:27:00.822588+0000","last_became_peered":"2023-07-27T14:27:00.822588+0000","last_unstale":"2023-07-27T14:27:01.281879+0000","last_undegraded":"2023-07-27T14:27:01.281879+0000","last_fullsized":"2023-07-27T14:27:01.281879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286750+0000","last_change":"2023-07-27T14:27:01.282869+0000","last_active":"2023-07-27T14:27:01.286750+0000","last_peered":"2023-07-27T14:27:01.286750+0000","last_clean":"2023-07-27T14:27:01.286750+0000","last_became_active":"2023-07-27T14:27:01.282606+0000","last_became_peered":"2023-07-27T14:27:01.282606+0000","last_unstale":"2023-07-27T14:27:01.286750+0000","last_undegraded":"2023-07-27T14:27:01.286750+0000","last_fullsized":"2023-07-27T14:27:01.286750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.301997+0000","last_change":"2023-07-27T14:27:00.818598+0000","last_active":"2023-07-27T14:27:01.301997+0000","last_peered":"2023-07-27T14:27:01.301997+0000","last_clean":"2023-07-27T14:27:01.301997+0000","last_became_active":"2023-07-27T14:27:00.817968+0000","last_became_peered":"2023-07-27T14:27:00.817968+0000","last_unstale":"2023-07-27T14:27:01.301997+0000","last_undegraded":"2023-07-27T14:27:01.301997+0000","last_fullsized":"2023-07-27T14:27:01.301997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284237+0000","last_change":"2023-07-27T14:27:01.280850+0000","last_active":"2023-07-27T14:27:01.284237+0000","last_peered":"2023-07-27T14:27:01.284237+0000","last_clean":"2023-07-27T14:27:01.284237+0000","last_became_active":"2023-07-27T14:27:01.280558+0000","last_became_peered":"2023-07-27T14:27:01.280558+0000","last_unstale":"2023-07-27T14:27:01.284237+0000","last_undegraded":"2023-07-27T14:27:01.284237+0000","last_fullsized":"2023-07-27T14:27:01.284237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263271+0000","last_change":"2023-07-27T14:27:00.809897+0000","last_active":"2023-07-27T14:27:01.263271+0000","last_peered":"2023-07-27T14:27:01.263271+0000","last_clean":"2023-07-27T14:27:01.263271+0000","last_became_active":"2023-07-27T14:27:00.809579+0000","last_became_peered":"2023-07-27T14:27:00.809579+0000","last_unstale":"2023-07-27T14:27:01.263271+0000","last_undegraded":"2023-07-27T14:27:01.263271+0000","last_fullsized":"2023-07-27T14:27:01.263271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284844+0000","last_change":"2023-07-27T14:27:01.274427+0000","last_active":"2023-07-27T14:27:01.284844+0000","last_peered":"2023-07-27T14:27:01.284844+0000","last_clean":"2023-07-27T14:27:01.284844+0000","last_became_active":"2023-07-27T14:27:01.273859+0000","last_became_peered":"2023-07-27T14:27:01.273859+0000","last_unstale":"2023-07-27T14:27:01.284844+0000","last_undegraded":"2023-07-27T14:27:01.284844+0000","last_fullsized":"2023-07-27T14:27:01.284844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264973+0000","last_change":"2023-07-27T14:27:00.809959+0000","last_active":"2023-07-27T14:27:01.264973+0000","last_peered":"2023-07-27T14:27:01.264973+0000","last_clean":"2023-07-27T14:27:01.264973+0000","last_became_active":"2023-07-27T14:27:00.809036+0000","last_became_peered":"2023-07-27T14:27:00.809036+0000","last_unstale":"2023-07-27T14:27:01.264973+0000","last_undegraded":"2023-07-27T14:27:01.264973+0000","last_fullsized":"2023-07-27T14:27:01.264973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296775+0000","last_change":"2023-07-27T14:27:01.288447+0000","last_active":"2023-07-27T14:27:01.296775+0000","last_peered":"2023-07-27T14:27:01.296775+0000","last_clean":"2023-07-27T14:27:01.296775+0000","last_became_active":"2023-07-27T14:27:01.288075+0000","last_became_peered":"2023-07-27T14:27:01.288075+0000","last_unstale":"2023-07-27T14:27:01.296775+0000","last_undegraded":"2023-07-27T14:27:01.296775+0000","last_fullsized":"2023-07-27T14:27:01.296775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.262354+0000","last_change":"2023-07-27T14:27:00.817201+0000","last_active":"2023-07-27T14:27:01.262354+0000","last_peered":"2023-07-27T14:27:01.262354+0000","last_clean":"2023-07-27T14:27:01.262354+0000","last_became_active":"2023-07-27T14:27:00.816881+0000","last_became_peered":"2023-07-27T14:27:00.816881+0000","last_unstale":"2023-07-27T14:27:01.262354+0000","last_undegraded":"2023-07-27T14:27:01.262354+0000","last_fullsized":"2023-07-27T14:27:01.262354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289747+0000","last_change":"2023-07-27T14:27:01.288012+0000","last_active":"2023-07-27T14:27:01.289747+0000","last_peered":"2023-07-27T14:27:01.289747+0000","last_clean":"2023-07-27T14:27:01.289747+0000","last_became_active":"2023-07-27T14:27:01.287599+0000","last_became_peered":"2023-07-27T14:27:01.287599+0000","last_unstale":"2023-07-27T14:27:01.289747+0000","last_undegraded":"2023-07-27T14:27:01.289747+0000","last_fullsized":"2023-07-27T14:27:01.289747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260793+0000","last_change":"2023-07-27T14:27:00.818067+0000","last_active":"2023-07-27T14:27:01.260793+0000","last_peered":"2023-07-27T14:27:01.260793+0000","last_clean":"2023-07-27T14:27:01.260793+0000","last_became_active":"2023-07-27T14:27:00.817737+0000","last_became_peered":"2023-07-27T14:27:00.817737+0000","last_unstale":"2023-07-27T14:27:01.260793+0000","last_undegraded":"2023-07-27T14:27:01.260793+0000","last_fullsized":"2023-07-27T14:27:01.260793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282575+0000","last_change":"2023-07-27T14:27:01.280475+0000","last_active":"2023-07-27T14:27:01.282575+0000","last_peered":"2023-07-27T14:27:01.282575+0000","last_clean":"2023-07-27T14:27:01.282575+0000","last_became_active":"2023-07-27T14:27:01.280167+0000","last_became_peered":"2023-07-27T14:27:01.280167+0000","last_unstale":"2023-07-27T14:27:01.282575+0000","last_undegraded":"2023-07-27T14:27:01.282575+0000","last_fullsized":"2023-07-27T14:27:01.282575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263001+0000","last_change":"2023-07-27T14:27:00.811588+0000","last_active":"2023-07-27T14:27:01.263001+0000","last_peered":"2023-07-27T14:27:01.263001+0000","last_clean":"2023-07-27T14:27:01.263001+0000","last_became_active":"2023-07-27T14:27:00.811302+0000","last_became_peered":"2023-07-27T14:27:00.811302+0000","last_unstale":"2023-07-27T14:27:01.263001+0000","last_undegraded":"2023-07-27T14:27:01.263001+0000","last_fullsized":"2023-07-27T14:27:01.263001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299156+0000","last_change":"2023-07-27T14:27:01.293325+0000","last_active":"2023-07-27T14:27:01.299156+0000","last_peered":"2023-07-27T14:27:01.299156+0000","last_clean":"2023-07-27T14:27:01.299156+0000","last_became_active":"2023-07-27T14:27:01.293018+0000","last_became_peered":"2023-07-27T14:27:01.293018+0000","last_unstale":"2023-07-27T14:27:01.299156+0000","last_undegraded":"2023-07-27T14:27:01.299156+0000","last_fullsized":"2023-07-27T14:27:01.299156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288042+0000","last_change":"2023-07-27T14:27:00.804784+0000","last_active":"2023-07-27T14:27:01.288042+0000","last_peered":"2023-07-27T14:27:01.288042+0000","last_clean":"2023-07-27T14:27:01.288042+0000","last_became_active":"2023-07-27T14:27:00.804479+0000","last_became_peered":"2023-07-27T14:27:00.804479+0000","last_unstale":"2023-07-27T14:27:01.288042+0000","last_undegraded":"2023-07-27T14:27:01.288042+0000","last_fullsized":"2023-07-27T14:27:01.288042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288469+0000","last_change":"2023-07-27T14:27:01.283937+0000","last_active":"2023-07-27T14:27:01.288469+0000","last_peered":"2023-07-27T14:27:01.288469+0000","last_clean":"2023-07-27T14:27:01.288469+0000","last_became_active":"2023-07-27T14:27:01.283504+0000","last_became_peered":"2023-07-27T14:27:01.283504+0000","last_unstale":"2023-07-27T14:27:01.288469+0000","last_undegraded":"2023-07-27T14:27:01.288469+0000","last_fullsized":"2023-07-27T14:27:01.288469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289392+0000","last_change":"2023-07-27T14:27:00.807294+0000","last_active":"2023-07-27T14:27:01.289392+0000","last_peered":"2023-07-27T14:27:01.289392+0000","last_clean":"2023-07-27T14:27:01.289392+0000","last_became_active":"2023-07-27T14:27:00.805155+0000","last_became_peered":"2023-07-27T14:27:00.805155+0000","last_unstale":"2023-07-27T14:27:01.289392+0000","last_undegraded":"2023-07-27T14:27:01.289392+0000","last_fullsized":"2023-07-27T14:27:01.289392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284985+0000","last_change":"2023-07-27T14:27:01.280972+0000","last_active":"2023-07-27T14:27:01.284985+0000","last_peered":"2023-07-27T14:27:01.284985+0000","last_clean":"2023-07-27T14:27:01.284985+0000","last_became_active":"2023-07-27T14:27:01.280394+0000","last_became_peered":"2023-07-27T14:27:01.280394+0000","last_unstale":"2023-07-27T14:27:01.284985+0000","last_undegraded":"2023-07-27T14:27:01.284985+0000","last_fullsized":"2023-07-27T14:27:01.284985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287681+0000","last_change":"2023-07-27T14:27:00.821247+0000","last_active":"2023-07-27T14:27:01.287681+0000","last_peered":"2023-07-27T14:27:01.287681+0000","last_clean":"2023-07-27T14:27:01.287681+0000","last_became_active":"2023-07-27T14:27:00.820300+0000","last_became_peered":"2023-07-27T14:27:00.820300+0000","last_unstale":"2023-07-27T14:27:01.287681+0000","last_undegraded":"2023-07-27T14:27:01.287681+0000","last_fullsized":"2023-07-27T14:27:01.287681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299213+0000","last_change":"2023-07-27T14:27:01.294103+0000","last_active":"2023-07-27T14:27:01.299213+0000","last_peered":"2023-07-27T14:27:01.299213+0000","last_clean":"2023-07-27T14:27:01.299213+0000","last_became_active":"2023-07-27T14:27:01.293567+0000","last_became_peered":"2023-07-27T14:27:01.293567+0000","last_unstale":"2023-07-27T14:27:01.299213+0000","last_undegraded":"2023-07-27T14:27:01.299213+0000","last_fullsized":"2023-07-27T14:27:01.299213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263146+0000","last_change":"2023-07-27T14:27:00.809881+0000","last_active":"2023-07-27T14:27:01.263146+0000","last_peered":"2023-07-27T14:27:01.263146+0000","last_clean":"2023-07-27T14:27:01.263146+0000","last_became_active":"2023-07-27T14:27:00.809012+0000","last_became_peered":"2023-07-27T14:27:00.809012+0000","last_unstale":"2023-07-27T14:27:01.263146+0000","last_undegraded":"2023-07-27T14:27:01.263146+0000","last_fullsized":"2023-07-27T14:27:01.263146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284867+0000","last_change":"2023-07-27T14:27:01.274666+0000","last_active":"2023-07-27T14:27:01.284867+0000","last_peered":"2023-07-27T14:27:01.284867+0000","last_clean":"2023-07-27T14:27:01.284867+0000","last_became_active":"2023-07-27T14:27:01.272660+0000","last_became_peered":"2023-07-27T14:27:01.272660+0000","last_unstale":"2023-07-27T14:27:01.284867+0000","last_undegraded":"2023-07-27T14:27:01.284867+0000","last_fullsized":"2023-07-27T14:27:01.284867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268785+0000","last_change":"2023-07-27T14:27:00.805779+0000","last_active":"2023-07-27T14:27:01.268785+0000","last_peered":"2023-07-27T14:27:01.268785+0000","last_clean":"2023-07-27T14:27:01.268785+0000","last_became_active":"2023-07-27T14:27:00.805502+0000","last_became_peered":"2023-07-27T14:27:00.805502+0000","last_unstale":"2023-07-27T14:27:01.268785+0000","last_undegraded":"2023-07-27T14:27:01.268785+0000","last_fullsized":"2023-07-27T14:27:01.268785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296549+0000","last_change":"2023-07-27T14:27:01.289809+0000","last_active":"2023-07-27T14:27:01.296549+0000","last_peered":"2023-07-27T14:27:01.296549+0000","last_clean":"2023-07-27T14:27:01.296549+0000","last_became_active":"2023-07-27T14:27:01.289534+0000","last_became_peered":"2023-07-27T14:27:01.289534+0000","last_unstale":"2023-07-27T14:27:01.296549+0000","last_undegraded":"2023-07-27T14:27:01.296549+0000","last_fullsized":"2023-07-27T14:27:01.296549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284811+0000","last_change":"2023-07-27T14:27:00.807339+0000","last_active":"2023-07-27T14:27:01.284811+0000","last_peered":"2023-07-27T14:27:01.284811+0000","last_clean":"2023-07-27T14:27:01.284811+0000","last_became_active":"2023-07-27T14:27:00.806613+0000","last_became_peered":"2023-07-27T14:27:00.806613+0000","last_unstale":"2023-07-27T14:27:01.284811+0000","last_undegraded":"2023-07-27T14:27:01.284811+0000","last_fullsized":"2023-07-27T14:27:01.284811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5252,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366588,"statfs":{"total":96636764160,"available":96631386112,"internally_reserved":0,"allocated":258048,"data_stored":87108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":237568,"data_stored":87140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":229376,"data_stored":85694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":229376,"data_stored":85694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":233472,"data_stored":85764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366612,"statfs":{"total":96636764160,"available":96631410688,"internally_reserved":0,"allocated":233472,"data_stored":85784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":87286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:27:14.075 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:27:14.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.281+0000 7fdaaebff700 1 Processor -- start 2023-07-27T14:27:14.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.281+0000 7fdaaebff700 1 -- start start 2023-07-27T14:27:14.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.282+0000 7fdaaebff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdaa80aaa40 0x7fdaa80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.282+0000 7fdaaebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.282+0000 7fdaaebff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa80aa4d0 con 0x7fdaa8153ec0 2023-07-27T14:27:14.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.282+0000 7fdaaebff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa8064ad0 con 0x7fdaa80aaa40 2023-07-27T14:27:14.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.282+0000 7fdaaebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80c05c0 con 0x7fdaa81542a0 2023-07-27T14:27:14.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.282+0000 7fdaa7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdaa80aaa40 0x7fdaa80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.282+0000 7fdaa7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdaa80aaa40 0x7fdaa80640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47418/0 (socket says 172.21.15.115:47418) 2023-07-27T14:27:14.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.282+0000 7fdaa7fff700 1 -- 172.21.15.115:0/2939762472 learned_addr learned my addr 172.21.15.115:0/2939762472 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:14.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaad19c700 1 --2- 172.21.15.115:0/2939762472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaa7fff700 1 -- 172.21.15.115:0/2939762472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 msgr2=0x7fdaa80645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:14.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaa7fff700 1 --2- 172.21.15.115:0/2939762472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa80645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaa7fff700 1 -- 172.21.15.115:0/2939762472 >> v1:172.21.15.159:6789/0 conn(0x7fdaa8153ec0 legacy=0x7fdaa80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaa7fff700 1 -- 172.21.15.115:0/2939762472 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80c1a60 con 0x7fdaa80aaa40 2023-07-27T14:27:14.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaad19c700 1 --2- 172.21.15.115:0/2939762472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:14.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaa7fff700 1 --2- 172.21.15.115:0/2939762472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80640f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fda94006fd0 tx=0x7fda940090f0).ready entity=mon.0 client_cookie=840c3a906d82f09d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:14.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaa77fe700 1 -- 172.21.15.115:0/2939762472 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400b600 con 0x7fdaa80aaa40 2023-07-27T14:27:14.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaa77fe700 1 -- 172.21.15.115:0/2939762472 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400b760 con 0x7fdaa80aaa40 2023-07-27T14:27:14.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.283+0000 7fdaa77fe700 1 -- 172.21.15.115:0/2939762472 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400bae0 con 0x7fdaa80aaa40 2023-07-27T14:27:14.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.284+0000 7fdaaebff700 1 -- 172.21.15.115:0/2939762472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 msgr2=0x7fdaa80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.284+0000 7fdaaebff700 1 --2- 172.21.15.115:0/2939762472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80640f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fda94006fd0 tx=0x7fda940090f0).stop 2023-07-27T14:27:14.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.284+0000 7fdaaebff700 1 -- 172.21.15.115:0/2939762472 shutdown_connections 2023-07-27T14:27:14.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.284+0000 7fdaaebff700 1 --2- 172.21.15.115:0/2939762472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.284+0000 7fdaaebff700 1 --2- 172.21.15.115:0/2939762472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80640f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.284+0000 7fdaaebff700 1 -- 172.21.15.115:0/2939762472 >> 172.21.15.115:0/2939762472 conn(0x7fdaa80cb610 msgr2=0x7fdaa80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:14.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.284+0000 7fdaaebff700 1 -- 172.21.15.115:0/2939762472 shutdown_connections 2023-07-27T14:27:14.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.284+0000 7fdaaebff700 1 -- 172.21.15.115:0/2939762472 wait complete. 2023-07-27T14:27:14.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.285+0000 7fdaaebff700 1 Processor -- start 2023-07-27T14:27:14.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.286+0000 7fdaaebff700 1 -- start start 2023-07-27T14:27:14.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.286+0000 7fdaaebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.286+0000 7fdaaebff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa8153ec0 0x7fdaa80ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.286+0000 7fdaaebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa813f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.286+0000 7fdaaebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80ae960 con 0x7fdaa80aaa40 2023-07-27T14:27:14.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.286+0000 7fdaaebff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80c36d0 con 0x7fdaa8153ec0 2023-07-27T14:27:14.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.286+0000 7fdaaebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80ade40 con 0x7fdaa81542a0 2023-07-27T14:27:14.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80c2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47432/0 (socket says 172.21.15.115:47432) 2023-07-27T14:27:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 -- 172.21.15.115:0/3265826137 learned_addr learned my addr 172.21.15.115:0/3265826137 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaad19c700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa813f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaa7fff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa8153ec0 0x7fdaa80ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 -- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 msgr2=0x7fdaa813f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa813f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 -- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa8153ec0 msgr2=0x7fdaa80ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa8153ec0 0x7fdaa80ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 -- 172.21.15.115:0/3265826137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94009370 con 0x7fdaa80aaa40 2023-07-27T14:27:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaa7fff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa8153ec0 0x7fdaa80ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaac99b700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80c2450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fda9c00c4c0 tx=0x7fda9c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaa4ff9700 1 -- 172.21.15.115:0/3265826137 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c007020 con 0x7fdaa80aaa40 2023-07-27T14:27:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaa4ff9700 1 -- 172.21.15.115:0/3265826137 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c001e90 con 0x7fdaa80aaa40 2023-07-27T14:27:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa80c2ac0 con 0x7fdaa80aaa40 2023-07-27T14:27:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.287+0000 7fdaa4ff9700 1 -- 172.21.15.115:0/3265826137 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0073b0 con 0x7fdaa80aaa40 2023-07-27T14:27:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.288+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa80c3080 con 0x7fdaa80aaa40 2023-07-27T14:27:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.288+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa806c470 con 0x7fdaa80aaa40 2023-07-27T14:27:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.289+0000 7fdaa4ff9700 1 -- 172.21.15.115:0/3265826137 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fda9c010070 con 0x7fdaa80aaa40 2023-07-27T14:27:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.290+0000 7fdaa4ff9700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8c05ed90 0x7fda8c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.290+0000 7fdaa4ff9700 1 -- 172.21.15.115:0/3265826137 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fda9c079250 con 0x7fdaa80aaa40 2023-07-27T14:27:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.291+0000 7fdaa7fff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8c05ed90 0x7fda8c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.291+0000 7fdaa7fff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8c05ed90 0x7fda8c061250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fdaa80aae20 tx=0x7fda94017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:14.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.294+0000 7fdaa4ff9700 1 -- 172.21.15.115:0/3265826137 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda9c04a6e0 con 0x7fdaa80aaa40 2023-07-27T14:27:14.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.457+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdaa80aa4d0 con 0x7fda8c05ed90 2023-07-27T14:27:14.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.467+0000 7fdaa4ff9700 1 -- 172.21.15.115:0/3265826137 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336299 (secure 0 0 0) 0x7fdaa80aa4d0 con 0x7fda8c05ed90 2023-07-27T14:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:14.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8c05ed90 msgr2=0x7fda8c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8c05ed90 0x7fda8c061250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fdaa80aae20 tx=0x7fda94017000).stop 2023-07-27T14:27:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 msgr2=0x7fdaa80c2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80c2450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fda9c00c4c0 tx=0x7fda9c007e00).stop 2023-07-27T14:27:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 shutdown_connections 2023-07-27T14:27:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8c05ed90 0x7fda8c061250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa81542a0 0x7fdaa813f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaa80aaa40 0x7fdaa80c2450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 --2- 172.21.15.115:0/3265826137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa8153ec0 0x7fdaa80ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 >> 172.21.15.115:0/3265826137 conn(0x7fdaa80cb610 msgr2=0x7fdaa80ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 shutdown_connections 2023-07-27T14:27:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.471+0000 7fdaaebff700 1 -- 172.21.15.115:0/3265826137 wait complete. 2023-07-27T14:27:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-27T14:27:13.439210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41600,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":39680,"kb_avail":754933120,"statfs":{"total":773094113280,"available":773051514880,"internally_reserved":0,"allocated":1900544,"data_stored":690164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40632320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001579"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284762+0000","last_change":"2023-07-27T14:27:01.270326+0000","last_active":"2023-07-27T14:27:01.284762+0000","last_peered":"2023-07-27T14:27:01.284762+0000","last_clean":"2023-07-27T14:27:01.284762+0000","last_became_active":"2023-07-27T14:27:01.270013+0000","last_became_peered":"2023-07-27T14:27:01.270013+0000","last_unstale":"2023-07-27T14:27:01.284762+0000","last_undegraded":"2023-07-27T14:27:01.284762+0000","last_fullsized":"2023-07-27T14:27:01.284762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.280302+0000","last_change":"2023-07-27T14:27:00.817070+0000","last_active":"2023-07-27T14:27:01.280302+0000","last_peered":"2023-07-27T14:27:01.280302+0000","last_clean":"2023-07-27T14:27:01.280302+0000","last_became_active":"2023-07-27T14:27:00.816729+0000","last_became_peered":"2023-07-27T14:27:00.816729+0000","last_unstale":"2023-07-27T14:27:01.280302+0000","last_undegraded":"2023-07-27T14:27:01.280302+0000","last_fullsized":"2023-07-27T14:27:01.280302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285407+0000","last_change":"2023-07-27T14:27:01.281932+0000","last_active":"2023-07-27T14:27:01.285407+0000","last_peered":"2023-07-27T14:27:01.285407+0000","last_clean":"2023-07-27T14:27:01.285407+0000","last_became_active":"2023-07-27T14:27:01.279991+0000","last_became_peered":"2023-07-27T14:27:01.279991+0000","last_unstale":"2023-07-27T14:27:01.285407+0000","last_undegraded":"2023-07-27T14:27:01.285407+0000","last_fullsized":"2023-07-27T14:27:01.285407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.267835+0000","last_change":"2023-07-27T14:27:00.816788+0000","last_active":"2023-07-27T14:27:01.267835+0000","last_peered":"2023-07-27T14:27:01.267835+0000","last_clean":"2023-07-27T14:27:01.267835+0000","last_became_active":"2023-07-27T14:27:00.816483+0000","last_became_peered":"2023-07-27T14:27:00.816483+0000","last_unstale":"2023-07-27T14:27:01.267835+0000","last_undegraded":"2023-07-27T14:27:01.267835+0000","last_fullsized":"2023-07-27T14:27:01.267835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288441+0000","last_change":"2023-07-27T14:27:01.283092+0000","last_active":"2023-07-27T14:27:01.288441+0000","last_peered":"2023-07-27T14:27:01.288441+0000","last_clean":"2023-07-27T14:27:01.288441+0000","last_became_active":"2023-07-27T14:27:01.281682+0000","last_became_peered":"2023-07-27T14:27:01.281682+0000","last_unstale":"2023-07-27T14:27:01.288441+0000","last_undegraded":"2023-07-27T14:27:01.288441+0000","last_fullsized":"2023-07-27T14:27:01.288441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.259837+0000","last_change":"2023-07-27T14:27:00.824445+0000","last_active":"2023-07-27T14:27:01.259837+0000","last_peered":"2023-07-27T14:27:01.259837+0000","last_clean":"2023-07-27T14:27:01.259837+0000","last_became_active":"2023-07-27T14:27:00.824146+0000","last_became_peered":"2023-07-27T14:27:00.824146+0000","last_unstale":"2023-07-27T14:27:01.259837+0000","last_undegraded":"2023-07-27T14:27:01.259837+0000","last_fullsized":"2023-07-27T14:27:01.259837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281942+0000","last_change":"2023-07-27T14:27:01.270550+0000","last_active":"2023-07-27T14:27:01.281942+0000","last_peered":"2023-07-27T14:27:01.281942+0000","last_clean":"2023-07-27T14:27:01.281942+0000","last_became_active":"2023-07-27T14:27:01.270242+0000","last_became_peered":"2023-07-27T14:27:01.270242+0000","last_unstale":"2023-07-27T14:27:01.281942+0000","last_undegraded":"2023-07-27T14:27:01.281942+0000","last_fullsized":"2023-07-27T14:27:01.281942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264077+0000","last_change":"2023-07-27T14:27:00.811927+0000","last_active":"2023-07-27T14:27:01.264077+0000","last_peered":"2023-07-27T14:27:01.264077+0000","last_clean":"2023-07-27T14:27:01.264077+0000","last_became_active":"2023-07-27T14:27:00.810673+0000","last_became_peered":"2023-07-27T14:27:00.810673+0000","last_unstale":"2023-07-27T14:27:01.264077+0000","last_undegraded":"2023-07-27T14:27:01.264077+0000","last_fullsized":"2023-07-27T14:27:01.264077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282015+0000","last_change":"2023-07-27T14:27:01.273486+0000","last_active":"2023-07-27T14:27:01.282015+0000","last_peered":"2023-07-27T14:27:01.282015+0000","last_clean":"2023-07-27T14:27:01.282015+0000","last_became_active":"2023-07-27T14:27:01.273227+0000","last_became_peered":"2023-07-27T14:27:01.273227+0000","last_unstale":"2023-07-27T14:27:01.282015+0000","last_undegraded":"2023-07-27T14:27:01.282015+0000","last_fullsized":"2023-07-27T14:27:01.282015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269519+0000","last_change":"2023-07-27T14:27:00.808357+0000","last_active":"2023-07-27T14:27:01.269519+0000","last_peered":"2023-07-27T14:27:01.269519+0000","last_clean":"2023-07-27T14:27:01.269519+0000","last_became_active":"2023-07-27T14:27:00.808008+0000","last_became_peered":"2023-07-27T14:27:00.808008+0000","last_unstale":"2023-07-27T14:27:01.269519+0000","last_undegraded":"2023-07-27T14:27:01.269519+0000","last_fullsized":"2023-07-27T14:27:01.269519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.275273+0000","last_change":"2023-07-27T14:27:01.272065+0000","last_active":"2023-07-27T14:27:01.275273+0000","last_peered":"2023-07-27T14:27:01.275273+0000","last_clean":"2023-07-27T14:27:01.275273+0000","last_became_active":"2023-07-27T14:27:01.270787+0000","last_became_peered":"2023-07-27T14:27:01.270787+0000","last_unstale":"2023-07-27T14:27:01.275273+0000","last_undegraded":"2023-07-27T14:27:01.275273+0000","last_fullsized":"2023-07-27T14:27:01.275273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287817+0000","last_change":"2023-07-27T14:27:00.823544+0000","last_active":"2023-07-27T14:27:01.287817+0000","last_peered":"2023-07-27T14:27:01.287817+0000","last_clean":"2023-07-27T14:27:01.287817+0000","last_became_active":"2023-07-27T14:27:00.823167+0000","last_became_peered":"2023-07-27T14:27:00.823167+0000","last_unstale":"2023-07-27T14:27:01.287817+0000","last_undegraded":"2023-07-27T14:27:01.287817+0000","last_fullsized":"2023-07-27T14:27:01.287817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.297002+0000","last_change":"2023-07-27T14:27:01.290104+0000","last_active":"2023-07-27T14:27:01.297002+0000","last_peered":"2023-07-27T14:27:01.297002+0000","last_clean":"2023-07-27T14:27:01.297002+0000","last_became_active":"2023-07-27T14:27:01.289787+0000","last_became_peered":"2023-07-27T14:27:01.289787+0000","last_unstale":"2023-07-27T14:27:01.297002+0000","last_undegraded":"2023-07-27T14:27:01.297002+0000","last_fullsized":"2023-07-27T14:27:01.297002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293463+0000","last_change":"2023-07-27T14:27:00.818297+0000","last_active":"2023-07-27T14:27:01.293463+0000","last_peered":"2023-07-27T14:27:01.293463+0000","last_clean":"2023-07-27T14:27:01.293463+0000","last_became_active":"2023-07-27T14:27:00.817529+0000","last_became_peered":"2023-07-27T14:27:00.817529+0000","last_unstale":"2023-07-27T14:27:01.293463+0000","last_undegraded":"2023-07-27T14:27:01.293463+0000","last_fullsized":"2023-07-27T14:27:01.293463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286467+0000","last_change":"2023-07-27T14:27:01.270184+0000","last_active":"2023-07-27T14:27:01.286467+0000","last_peered":"2023-07-27T14:27:01.286467+0000","last_clean":"2023-07-27T14:27:01.286467+0000","last_became_active":"2023-07-27T14:27:01.269909+0000","last_became_peered":"2023-07-27T14:27:01.269909+0000","last_unstale":"2023-07-27T14:27:01.286467+0000","last_undegraded":"2023-07-27T14:27:01.286467+0000","last_fullsized":"2023-07-27T14:27:01.286467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293730+0000","last_change":"2023-07-27T14:27:00.822093+0000","last_active":"2023-07-27T14:27:01.293730+0000","last_peered":"2023-07-27T14:27:01.293730+0000","last_clean":"2023-07-27T14:27:01.293730+0000","last_became_active":"2023-07-27T14:27:00.821821+0000","last_became_peered":"2023-07-27T14:27:00.821821+0000","last_unstale":"2023-07-27T14:27:01.293730+0000","last_undegraded":"2023-07-27T14:27:01.293730+0000","last_fullsized":"2023-07-27T14:27:01.293730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296579+0000","last_change":"2023-07-27T14:27:01.289067+0000","last_active":"2023-07-27T14:27:01.296579+0000","last_peered":"2023-07-27T14:27:01.296579+0000","last_clean":"2023-07-27T14:27:01.296579+0000","last_became_active":"2023-07-27T14:27:01.288634+0000","last_became_peered":"2023-07-27T14:27:01.288634+0000","last_unstale":"2023-07-27T14:27:01.296579+0000","last_undegraded":"2023-07-27T14:27:01.296579+0000","last_fullsized":"2023-07-27T14:27:01.296579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265111+0000","last_change":"2023-07-27T14:27:00.805268+0000","last_active":"2023-07-27T14:27:01.265111+0000","last_peered":"2023-07-27T14:27:01.265111+0000","last_clean":"2023-07-27T14:27:01.265111+0000","last_became_active":"2023-07-27T14:27:00.804950+0000","last_became_peered":"2023-07-27T14:27:00.804950+0000","last_unstale":"2023-07-27T14:27:01.265111+0000","last_undegraded":"2023-07-27T14:27:01.265111+0000","last_fullsized":"2023-07-27T14:27:01.265111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284549+0000","last_change":"2023-07-27T14:27:01.281253+0000","last_active":"2023-07-27T14:27:01.284549+0000","last_peered":"2023-07-27T14:27:01.284549+0000","last_clean":"2023-07-27T14:27:01.284549+0000","last_became_active":"2023-07-27T14:27:01.280227+0000","last_became_peered":"2023-07-27T14:27:01.280227+0000","last_unstale":"2023-07-27T14:27:01.284549+0000","last_undegraded":"2023-07-27T14:27:01.284549+0000","last_fullsized":"2023-07-27T14:27:01.284549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.262929+0000","last_change":"2023-07-27T14:27:00.817281+0000","last_active":"2023-07-27T14:27:01.262929+0000","last_peered":"2023-07-27T14:27:01.262929+0000","last_clean":"2023-07-27T14:27:01.262929+0000","last_became_active":"2023-07-27T14:27:00.817008+0000","last_became_peered":"2023-07-27T14:27:00.817008+0000","last_unstale":"2023-07-27T14:27:01.262929+0000","last_undegraded":"2023-07-27T14:27:01.262929+0000","last_fullsized":"2023-07-27T14:27:01.262929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286934+0000","last_change":"2023-07-27T14:27:01.281135+0000","last_active":"2023-07-27T14:27:01.286934+0000","last_peered":"2023-07-27T14:27:01.286934+0000","last_clean":"2023-07-27T14:27:01.286934+0000","last_became_active":"2023-07-27T14:27:01.280869+0000","last_became_peered":"2023-07-27T14:27:01.280869+0000","last_unstale":"2023-07-27T14:27:01.286934+0000","last_undegraded":"2023-07-27T14:27:01.286934+0000","last_fullsized":"2023-07-27T14:27:01.286934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283835+0000","last_change":"2023-07-27T14:27:00.810416+0000","last_active":"2023-07-27T14:27:01.283835+0000","last_peered":"2023-07-27T14:27:01.283835+0000","last_clean":"2023-07-27T14:27:01.283835+0000","last_became_active":"2023-07-27T14:27:00.809422+0000","last_became_peered":"2023-07-27T14:27:00.809422+0000","last_unstale":"2023-07-27T14:27:01.283835+0000","last_undegraded":"2023-07-27T14:27:01.283835+0000","last_fullsized":"2023-07-27T14:27:01.283835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.291617+0000","last_change":"2023-07-27T14:27:01.286563+0000","last_active":"2023-07-27T14:27:01.291617+0000","last_peered":"2023-07-27T14:27:01.291617+0000","last_clean":"2023-07-27T14:27:01.291617+0000","last_became_active":"2023-07-27T14:27:01.285925+0000","last_became_peered":"2023-07-27T14:27:01.285925+0000","last_unstale":"2023-07-27T14:27:01.291617+0000","last_undegraded":"2023-07-27T14:27:01.291617+0000","last_fullsized":"2023-07-27T14:27:01.291617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.293048+0000","last_change":"2023-07-27T14:27:00.819013+0000","last_active":"2023-07-27T14:27:01.293048+0000","last_peered":"2023-07-27T14:27:01.293048+0000","last_clean":"2023-07-27T14:27:01.293048+0000","last_became_active":"2023-07-27T14:27:00.818612+0000","last_became_peered":"2023-07-27T14:27:00.818612+0000","last_unstale":"2023-07-27T14:27:01.293048+0000","last_undegraded":"2023-07-27T14:27:01.293048+0000","last_fullsized":"2023-07-27T14:27:01.293048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299226+0000","last_change":"2023-07-27T14:27:01.294061+0000","last_active":"2023-07-27T14:27:01.299226+0000","last_peered":"2023-07-27T14:27:01.299226+0000","last_clean":"2023-07-27T14:27:01.299226+0000","last_became_active":"2023-07-27T14:27:01.293437+0000","last_became_peered":"2023-07-27T14:27:01.293437+0000","last_unstale":"2023-07-27T14:27:01.299226+0000","last_undegraded":"2023-07-27T14:27:01.299226+0000","last_fullsized":"2023-07-27T14:27:01.299226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295767+0000","last_change":"2023-07-27T14:27:00.819217+0000","last_active":"2023-07-27T14:27:01.295767+0000","last_peered":"2023-07-27T14:27:01.295767+0000","last_clean":"2023-07-27T14:27:01.295767+0000","last_became_active":"2023-07-27T14:27:00.818691+0000","last_became_peered":"2023-07-27T14:27:00.818691+0000","last_unstale":"2023-07-27T14:27:01.295767+0000","last_undegraded":"2023-07-27T14:27:01.295767+0000","last_fullsized":"2023-07-27T14:27:01.295767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.276891+0000","last_change":"2023-07-27T14:27:01.270147+0000","last_active":"2023-07-27T14:27:01.276891+0000","last_peered":"2023-07-27T14:27:01.276891+0000","last_clean":"2023-07-27T14:27:01.276891+0000","last_became_active":"2023-07-27T14:27:01.269862+0000","last_became_peered":"2023-07-27T14:27:01.269862+0000","last_unstale":"2023-07-27T14:27:01.276891+0000","last_undegraded":"2023-07-27T14:27:01.276891+0000","last_fullsized":"2023-07-27T14:27:01.276891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263675+0000","last_change":"2023-07-27T14:27:00.812553+0000","last_active":"2023-07-27T14:27:01.263675+0000","last_peered":"2023-07-27T14:27:01.263675+0000","last_clean":"2023-07-27T14:27:01.263675+0000","last_became_active":"2023-07-27T14:27:00.812263+0000","last_became_peered":"2023-07-27T14:27:00.812263+0000","last_unstale":"2023-07-27T14:27:01.263675+0000","last_undegraded":"2023-07-27T14:27:01.263675+0000","last_fullsized":"2023-07-27T14:27:01.263675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284961+0000","last_change":"2023-07-27T14:27:01.280658+0000","last_active":"2023-07-27T14:27:01.284961+0000","last_peered":"2023-07-27T14:27:01.284961+0000","last_clean":"2023-07-27T14:27:01.284961+0000","last_became_active":"2023-07-27T14:27:01.279608+0000","last_became_peered":"2023-07-27T14:27:01.279608+0000","last_unstale":"2023-07-27T14:27:01.284961+0000","last_undegraded":"2023-07-27T14:27:01.284961+0000","last_fullsized":"2023-07-27T14:27:01.284961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268276+0000","last_change":"2023-07-27T14:27:00.821769+0000","last_active":"2023-07-27T14:27:01.268276+0000","last_peered":"2023-07-27T14:27:01.268276+0000","last_clean":"2023-07-27T14:27:01.268276+0000","last_became_active":"2023-07-27T14:27:00.820693+0000","last_became_peered":"2023-07-27T14:27:00.820693+0000","last_unstale":"2023-07-27T14:27:01.268276+0000","last_undegraded":"2023-07-27T14:27:01.268276+0000","last_fullsized":"2023-07-27T14:27:01.268276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.297086+0000","last_change":"2023-07-27T14:27:01.290729+0000","last_active":"2023-07-27T14:27:01.297086+0000","last_peered":"2023-07-27T14:27:01.297086+0000","last_clean":"2023-07-27T14:27:01.297086+0000","last_became_active":"2023-07-27T14:27:01.290315+0000","last_became_peered":"2023-07-27T14:27:01.290315+0000","last_unstale":"2023-07-27T14:27:01.297086+0000","last_undegraded":"2023-07-27T14:27:01.297086+0000","last_fullsized":"2023-07-27T14:27:01.297086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284546+0000","last_change":"2023-07-27T14:27:00.815996+0000","last_active":"2023-07-27T14:27:01.284546+0000","last_peered":"2023-07-27T14:27:01.284546+0000","last_clean":"2023-07-27T14:27:01.284546+0000","last_became_active":"2023-07-27T14:27:00.815664+0000","last_became_peered":"2023-07-27T14:27:00.815664+0000","last_unstale":"2023-07-27T14:27:01.284546+0000","last_undegraded":"2023-07-27T14:27:01.284546+0000","last_fullsized":"2023-07-27T14:27:01.284546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296898+0000","last_change":"2023-07-27T14:27:01.288903+0000","last_active":"2023-07-27T14:27:01.296898+0000","last_peered":"2023-07-27T14:27:01.296898+0000","last_clean":"2023-07-27T14:27:01.296898+0000","last_became_active":"2023-07-27T14:27:01.288173+0000","last_became_peered":"2023-07-27T14:27:01.288173+0000","last_unstale":"2023-07-27T14:27:01.296898+0000","last_undegraded":"2023-07-27T14:27:01.296898+0000","last_fullsized":"2023-07-27T14:27:01.296898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263383+0000","last_change":"2023-07-27T14:27:00.817983+0000","last_active":"2023-07-27T14:27:01.263383+0000","last_peered":"2023-07-27T14:27:01.263383+0000","last_clean":"2023-07-27T14:27:01.263383+0000","last_became_active":"2023-07-27T14:27:00.817662+0000","last_became_peered":"2023-07-27T14:27:00.817662+0000","last_unstale":"2023-07-27T14:27:01.263383+0000","last_undegraded":"2023-07-27T14:27:01.263383+0000","last_fullsized":"2023-07-27T14:27:01.263383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299262+0000","last_change":"2023-07-27T14:27:01.294765+0000","last_active":"2023-07-27T14:27:01.299262+0000","last_peered":"2023-07-27T14:27:01.299262+0000","last_clean":"2023-07-27T14:27:01.299262+0000","last_became_active":"2023-07-27T14:27:01.294406+0000","last_became_peered":"2023-07-27T14:27:01.294406+0000","last_unstale":"2023-07-27T14:27:01.299262+0000","last_undegraded":"2023-07-27T14:27:01.299262+0000","last_fullsized":"2023-07-27T14:27:01.299262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283951+0000","last_change":"2023-07-27T14:27:00.820810+0000","last_active":"2023-07-27T14:27:01.283951+0000","last_peered":"2023-07-27T14:27:01.283951+0000","last_clean":"2023-07-27T14:27:01.283951+0000","last_became_active":"2023-07-27T14:27:00.820044+0000","last_became_peered":"2023-07-27T14:27:00.820044+0000","last_unstale":"2023-07-27T14:27:01.283951+0000","last_undegraded":"2023-07-27T14:27:01.283951+0000","last_fullsized":"2023-07-27T14:27:01.283951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285719+0000","last_change":"2023-07-27T14:27:01.275611+0000","last_active":"2023-07-27T14:27:01.285719+0000","last_peered":"2023-07-27T14:27:01.285719+0000","last_clean":"2023-07-27T14:27:01.285719+0000","last_became_active":"2023-07-27T14:27:01.275350+0000","last_became_peered":"2023-07-27T14:27:01.275350+0000","last_unstale":"2023-07-27T14:27:01.285719+0000","last_undegraded":"2023-07-27T14:27:01.285719+0000","last_fullsized":"2023-07-27T14:27:01.285719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260311+0000","last_change":"2023-07-27T14:27:00.818518+0000","last_active":"2023-07-27T14:27:01.260311+0000","last_peered":"2023-07-27T14:27:01.260311+0000","last_clean":"2023-07-27T14:27:01.260311+0000","last_became_active":"2023-07-27T14:27:00.818212+0000","last_became_peered":"2023-07-27T14:27:00.818212+0000","last_unstale":"2023-07-27T14:27:01.260311+0000","last_undegraded":"2023-07-27T14:27:01.260311+0000","last_fullsized":"2023-07-27T14:27:01.260311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268832+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:27:01.268832+0000","last_peered":"2023-07-27T14:27:01.268832+0000","last_clean":"2023-07-27T14:27:01.268832+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:27:01.268832+0000","last_undegraded":"2023-07-27T14:27:01.268832+0000","last_fullsized":"2023-07-27T14:27:01.268832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269206+0000","last_change":"2023-07-27T14:27:00.821466+0000","last_active":"2023-07-27T14:27:01.269206+0000","last_peered":"2023-07-27T14:27:01.269206+0000","last_clean":"2023-07-27T14:27:01.269206+0000","last_became_active":"2023-07-27T14:27:00.820503+0000","last_became_peered":"2023-07-27T14:27:00.820503+0000","last_unstale":"2023-07-27T14:27:01.269206+0000","last_undegraded":"2023-07-27T14:27:01.269206+0000","last_fullsized":"2023-07-27T14:27:01.269206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287169+0000","last_change":"2023-07-27T14:27:01.281635+0000","last_active":"2023-07-27T14:27:01.287169+0000","last_peered":"2023-07-27T14:27:01.287169+0000","last_clean":"2023-07-27T14:27:01.287169+0000","last_became_active":"2023-07-27T14:27:01.281373+0000","last_became_peered":"2023-07-27T14:27:01.281373+0000","last_unstale":"2023-07-27T14:27:01.287169+0000","last_undegraded":"2023-07-27T14:27:01.287169+0000","last_fullsized":"2023-07-27T14:27:01.287169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270038+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:27:01.270038+0000","last_peered":"2023-07-27T14:27:01.270038+0000","last_clean":"2023-07-27T14:27:01.270038+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:27:01.270038+0000","last_undegraded":"2023-07-27T14:27:01.270038+0000","last_fullsized":"2023-07-27T14:27:01.270038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281414+0000","last_change":"2023-07-27T14:27:00.824620+0000","last_active":"2023-07-27T14:27:01.281414+0000","last_peered":"2023-07-27T14:27:01.281414+0000","last_clean":"2023-07-27T14:27:01.281414+0000","last_became_active":"2023-07-27T14:27:00.824324+0000","last_became_peered":"2023-07-27T14:27:00.824324+0000","last_unstale":"2023-07-27T14:27:01.281414+0000","last_undegraded":"2023-07-27T14:27:01.281414+0000","last_fullsized":"2023-07-27T14:27:01.281414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285758+0000","last_change":"2023-07-27T14:27:01.275718+0000","last_active":"2023-07-27T14:27:01.285758+0000","last_peered":"2023-07-27T14:27:01.285758+0000","last_clean":"2023-07-27T14:27:01.285758+0000","last_became_active":"2023-07-27T14:27:01.275463+0000","last_became_peered":"2023-07-27T14:27:01.275463+0000","last_unstale":"2023-07-27T14:27:01.285758+0000","last_undegraded":"2023-07-27T14:27:01.285758+0000","last_fullsized":"2023-07-27T14:27:01.285758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287139+0000","last_change":"2023-07-27T14:27:01.282173+0000","last_active":"2023-07-27T14:27:01.287139+0000","last_peered":"2023-07-27T14:27:01.287139+0000","last_clean":"2023-07-27T14:27:01.287139+0000","last_became_active":"2023-07-27T14:27:01.281870+0000","last_became_peered":"2023-07-27T14:27:01.281870+0000","last_unstale":"2023-07-27T14:27:01.287139+0000","last_undegraded":"2023-07-27T14:27:01.287139+0000","last_fullsized":"2023-07-27T14:27:01.287139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270296+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:27:01.270296+0000","last_peered":"2023-07-27T14:27:01.270296+0000","last_clean":"2023-07-27T14:27:01.270296+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:27:01.270296+0000","last_undegraded":"2023-07-27T14:27:01.270296+0000","last_fullsized":"2023-07-27T14:27:01.270296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264337+0000","last_change":"2023-07-27T14:27:00.806662+0000","last_active":"2023-07-27T14:27:01.264337+0000","last_peered":"2023-07-27T14:27:01.264337+0000","last_clean":"2023-07-27T14:27:01.264337+0000","last_became_active":"2023-07-27T14:27:00.806332+0000","last_became_peered":"2023-07-27T14:27:00.806332+0000","last_unstale":"2023-07-27T14:27:01.264337+0000","last_undegraded":"2023-07-27T14:27:01.264337+0000","last_fullsized":"2023-07-27T14:27:01.264337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.301639+0000","last_change":"2023-07-27T14:27:01.294577+0000","last_active":"2023-07-27T14:27:01.301639+0000","last_peered":"2023-07-27T14:27:01.301639+0000","last_clean":"2023-07-27T14:27:01.301639+0000","last_became_active":"2023-07-27T14:27:01.294285+0000","last_became_peered":"2023-07-27T14:27:01.294285+0000","last_unstale":"2023-07-27T14:27:01.301639+0000","last_undegraded":"2023-07-27T14:27:01.301639+0000","last_fullsized":"2023-07-27T14:27:01.301639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268394+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:27:01.268394+0000","last_peered":"2023-07-27T14:27:01.268394+0000","last_clean":"2023-07-27T14:27:01.268394+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:27:01.268394+0000","last_undegraded":"2023-07-27T14:27:01.268394+0000","last_fullsized":"2023-07-27T14:27:01.268394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.261907+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:27:01.261907+0000","last_peered":"2023-07-27T14:27:01.261907+0000","last_clean":"2023-07-27T14:27:01.261907+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:27:01.261907+0000","last_undegraded":"2023-07-27T14:27:01.261907+0000","last_fullsized":"2023-07-27T14:27:01.261907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260911+0000","last_change":"2023-07-27T14:27:00.820288+0000","last_active":"2023-07-27T14:27:01.260911+0000","last_peered":"2023-07-27T14:27:01.260911+0000","last_clean":"2023-07-27T14:27:01.260911+0000","last_became_active":"2023-07-27T14:27:00.818566+0000","last_became_peered":"2023-07-27T14:27:00.818566+0000","last_unstale":"2023-07-27T14:27:01.260911+0000","last_undegraded":"2023-07-27T14:27:01.260911+0000","last_fullsized":"2023-07-27T14:27:01.260911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285387+0000","last_change":"2023-07-27T14:27:01.281461+0000","last_active":"2023-07-27T14:27:01.285387+0000","last_peered":"2023-07-27T14:27:01.285387+0000","last_clean":"2023-07-27T14:27:01.285387+0000","last_became_active":"2023-07-27T14:27:01.280500+0000","last_became_peered":"2023-07-27T14:27:01.280500+0000","last_unstale":"2023-07-27T14:27:01.285387+0000","last_undegraded":"2023-07-27T14:27:01.285387+0000","last_fullsized":"2023-07-27T14:27:01.285387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.262018+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:27:01.262018+0000","last_peered":"2023-07-27T14:27:01.262018+0000","last_clean":"2023-07-27T14:27:01.262018+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:27:01.262018+0000","last_undegraded":"2023-07-27T14:27:01.262018+0000","last_fullsized":"2023-07-27T14:27:01.262018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265806+0000","last_change":"2023-07-27T14:27:00.821693+0000","last_active":"2023-07-27T14:27:01.265806+0000","last_peered":"2023-07-27T14:27:01.265806+0000","last_clean":"2023-07-27T14:27:01.265806+0000","last_became_active":"2023-07-27T14:27:00.821333+0000","last_became_peered":"2023-07-27T14:27:00.821333+0000","last_unstale":"2023-07-27T14:27:01.265806+0000","last_undegraded":"2023-07-27T14:27:01.265806+0000","last_fullsized":"2023-07-27T14:27:01.265806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263547+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:27:01.263547+0000","last_peered":"2023-07-27T14:27:01.263547+0000","last_clean":"2023-07-27T14:27:01.263547+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:27:01.263547+0000","last_undegraded":"2023-07-27T14:27:01.263547+0000","last_fullsized":"2023-07-27T14:27:01.263547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268983+0000","last_change":"2023-07-27T14:27:00.803181+0000","last_active":"2023-07-27T14:27:01.268983+0000","last_peered":"2023-07-27T14:27:01.268983+0000","last_clean":"2023-07-27T14:27:01.268983+0000","last_became_active":"2023-07-27T14:27:00.802812+0000","last_became_peered":"2023-07-27T14:27:00.802812+0000","last_unstale":"2023-07-27T14:27:01.268983+0000","last_undegraded":"2023-07-27T14:27:01.268983+0000","last_fullsized":"2023-07-27T14:27:01.268983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287297+0000","last_change":"2023-07-27T14:27:01.285120+0000","last_active":"2023-07-27T14:27:01.287297+0000","last_peered":"2023-07-27T14:27:01.287297+0000","last_clean":"2023-07-27T14:27:01.287297+0000","last_became_active":"2023-07-27T14:27:01.284758+0000","last_became_peered":"2023-07-27T14:27:01.284758+0000","last_unstale":"2023-07-27T14:27:01.287297+0000","last_undegraded":"2023-07-27T14:27:01.287297+0000","last_fullsized":"2023-07-27T14:27:01.287297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288456+0000","last_change":"2023-07-27T14:27:00.822951+0000","last_active":"2023-07-27T14:27:01.288456+0000","last_peered":"2023-07-27T14:27:01.288456+0000","last_clean":"2023-07-27T14:27:01.288456+0000","last_became_active":"2023-07-27T14:27:00.822642+0000","last_became_peered":"2023-07-27T14:27:00.822642+0000","last_unstale":"2023-07-27T14:27:01.288456+0000","last_undegraded":"2023-07-27T14:27:01.288456+0000","last_fullsized":"2023-07-27T14:27:01.288456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268617+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:27:01.268617+0000","last_peered":"2023-07-27T14:27:01.268617+0000","last_clean":"2023-07-27T14:27:01.268617+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:27:01.268617+0000","last_undegraded":"2023-07-27T14:27:01.268617+0000","last_fullsized":"2023-07-27T14:27:01.268617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281966+0000","last_change":"2023-07-27T14:27:01.274025+0000","last_active":"2023-07-27T14:27:01.281966+0000","last_peered":"2023-07-27T14:27:01.281966+0000","last_clean":"2023-07-27T14:27:01.281966+0000","last_became_active":"2023-07-27T14:27:01.273760+0000","last_became_peered":"2023-07-27T14:27:01.273760+0000","last_unstale":"2023-07-27T14:27:01.281966+0000","last_undegraded":"2023-07-27T14:27:01.281966+0000","last_fullsized":"2023-07-27T14:27:01.281966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264130+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:27:01.264130+0000","last_peered":"2023-07-27T14:27:01.264130+0000","last_clean":"2023-07-27T14:27:01.264130+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:27:01.264130+0000","last_undegraded":"2023-07-27T14:27:01.264130+0000","last_fullsized":"2023-07-27T14:27:01.264130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.266294+0000","last_change":"2023-07-27T14:27:00.809142+0000","last_active":"2023-07-27T14:27:01.266294+0000","last_peered":"2023-07-27T14:27:01.266294+0000","last_clean":"2023-07-27T14:27:01.266294+0000","last_became_active":"2023-07-27T14:27:00.808822+0000","last_became_peered":"2023-07-27T14:27:00.808822+0000","last_unstale":"2023-07-27T14:27:01.266294+0000","last_undegraded":"2023-07-27T14:27:01.266294+0000","last_fullsized":"2023-07-27T14:27:01.266294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299128+0000","last_change":"2023-07-27T14:27:01.293162+0000","last_active":"2023-07-27T14:27:01.299128+0000","last_peered":"2023-07-27T14:27:01.299128+0000","last_clean":"2023-07-27T14:27:01.299128+0000","last_became_active":"2023-07-27T14:27:01.292764+0000","last_became_peered":"2023-07-27T14:27:01.292764+0000","last_unstale":"2023-07-27T14:27:01.299128+0000","last_undegraded":"2023-07-27T14:27:01.299128+0000","last_fullsized":"2023-07-27T14:27:01.299128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286788+0000","last_change":"2023-07-27T14:27:01.278950+0000","last_active":"2023-07-27T14:27:01.286788+0000","last_peered":"2023-07-27T14:27:01.286788+0000","last_clean":"2023-07-27T14:27:01.286788+0000","last_became_active":"2023-07-27T14:27:01.278643+0000","last_became_peered":"2023-07-27T14:27:01.278643+0000","last_unstale":"2023-07-27T14:27:01.286788+0000","last_undegraded":"2023-07-27T14:27:01.286788+0000","last_fullsized":"2023-07-27T14:27:01.286788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265962+0000","last_change":"2023-07-27T14:27:00.820665+0000","last_active":"2023-07-27T14:27:01.265962+0000","last_peered":"2023-07-27T14:27:01.265962+0000","last_clean":"2023-07-27T14:27:01.265962+0000","last_became_active":"2023-07-27T14:27:00.820385+0000","last_became_peered":"2023-07-27T14:27:00.820385+0000","last_unstale":"2023-07-27T14:27:01.265962+0000","last_undegraded":"2023-07-27T14:27:01.265962+0000","last_fullsized":"2023-07-27T14:27:01.265962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299158+0000","last_change":"2023-07-27T14:27:01.293370+0000","last_active":"2023-07-27T14:27:01.299158+0000","last_peered":"2023-07-27T14:27:01.299158+0000","last_clean":"2023-07-27T14:27:01.299158+0000","last_became_active":"2023-07-27T14:27:01.293073+0000","last_became_peered":"2023-07-27T14:27:01.293073+0000","last_unstale":"2023-07-27T14:27:01.299158+0000","last_undegraded":"2023-07-27T14:27:01.299158+0000","last_fullsized":"2023-07-27T14:27:01.299158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268393+0000","last_change":"2023-07-27T14:27:00.821425+0000","last_active":"2023-07-27T14:27:01.268393+0000","last_peered":"2023-07-27T14:27:01.268393+0000","last_clean":"2023-07-27T14:27:01.268393+0000","last_became_active":"2023-07-27T14:27:00.820969+0000","last_became_peered":"2023-07-27T14:27:00.820969+0000","last_unstale":"2023-07-27T14:27:01.268393+0000","last_undegraded":"2023-07-27T14:27:01.268393+0000","last_fullsized":"2023-07-27T14:27:01.268393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299195+0000","last_change":"2023-07-27T14:27:01.293918+0000","last_active":"2023-07-27T14:27:01.299195+0000","last_peered":"2023-07-27T14:27:01.299195+0000","last_clean":"2023-07-27T14:27:01.299195+0000","last_became_active":"2023-07-27T14:27:01.293535+0000","last_became_peered":"2023-07-27T14:27:01.293535+0000","last_unstale":"2023-07-27T14:27:01.299195+0000","last_undegraded":"2023-07-27T14:27:01.299195+0000","last_fullsized":"2023-07-27T14:27:01.299195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.295160+0000","last_change":"2023-07-27T14:27:00.821100+0000","last_active":"2023-07-27T14:27:01.295160+0000","last_peered":"2023-07-27T14:27:01.295160+0000","last_clean":"2023-07-27T14:27:01.295160+0000","last_became_active":"2023-07-27T14:27:00.820834+0000","last_became_peered":"2023-07-27T14:27:00.820834+0000","last_unstale":"2023-07-27T14:27:01.295160+0000","last_undegraded":"2023-07-27T14:27:01.295160+0000","last_fullsized":"2023-07-27T14:27:01.295160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282491+0000","last_change":"2023-07-27T14:27:01.279306+0000","last_active":"2023-07-27T14:27:01.282491+0000","last_peered":"2023-07-27T14:27:01.282491+0000","last_clean":"2023-07-27T14:27:01.282491+0000","last_became_active":"2023-07-27T14:27:01.279053+0000","last_became_peered":"2023-07-27T14:27:01.279053+0000","last_unstale":"2023-07-27T14:27:01.282491+0000","last_undegraded":"2023-07-27T14:27:01.282491+0000","last_fullsized":"2023-07-27T14:27:01.282491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282641+0000","last_change":"2023-07-27T14:27:00.821978+0000","last_active":"2023-07-27T14:27:01.282641+0000","last_peered":"2023-07-27T14:27:01.282641+0000","last_clean":"2023-07-27T14:27:01.282641+0000","last_became_active":"2023-07-27T14:27:00.821626+0000","last_became_peered":"2023-07-27T14:27:00.821626+0000","last_unstale":"2023-07-27T14:27:01.282641+0000","last_undegraded":"2023-07-27T14:27:01.282641+0000","last_fullsized":"2023-07-27T14:27:01.282641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.297029+0000","last_change":"2023-07-27T14:27:01.289940+0000","last_active":"2023-07-27T14:27:01.297029+0000","last_peered":"2023-07-27T14:27:01.297029+0000","last_clean":"2023-07-27T14:27:01.297029+0000","last_became_active":"2023-07-27T14:27:01.289604+0000","last_became_peered":"2023-07-27T14:27:01.289604+0000","last_unstale":"2023-07-27T14:27:01.297029+0000","last_undegraded":"2023-07-27T14:27:01.297029+0000","last_fullsized":"2023-07-27T14:27:01.297029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282827+0000","last_change":"2023-07-27T14:27:00.811768+0000","last_active":"2023-07-27T14:27:01.282827+0000","last_peered":"2023-07-27T14:27:01.282827+0000","last_clean":"2023-07-27T14:27:01.282827+0000","last_became_active":"2023-07-27T14:27:00.811467+0000","last_became_peered":"2023-07-27T14:27:00.811467+0000","last_unstale":"2023-07-27T14:27:01.282827+0000","last_undegraded":"2023-07-27T14:27:01.282827+0000","last_fullsized":"2023-07-27T14:27:01.282827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.275243+0000","last_change":"2023-07-27T14:27:01.271866+0000","last_active":"2023-07-27T14:27:01.275243+0000","last_peered":"2023-07-27T14:27:01.275243+0000","last_clean":"2023-07-27T14:27:01.275243+0000","last_became_active":"2023-07-27T14:27:01.271572+0000","last_became_peered":"2023-07-27T14:27:01.271572+0000","last_unstale":"2023-07-27T14:27:01.275243+0000","last_undegraded":"2023-07-27T14:27:01.275243+0000","last_fullsized":"2023-07-27T14:27:01.275243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263223+0000","last_change":"2023-07-27T14:27:00.809399+0000","last_active":"2023-07-27T14:27:01.263223+0000","last_peered":"2023-07-27T14:27:01.263223+0000","last_clean":"2023-07-27T14:27:01.263223+0000","last_became_active":"2023-07-27T14:27:00.809047+0000","last_became_peered":"2023-07-27T14:27:00.809047+0000","last_unstale":"2023-07-27T14:27:01.263223+0000","last_undegraded":"2023-07-27T14:27:01.263223+0000","last_fullsized":"2023-07-27T14:27:01.263223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286895+0000","last_change":"2023-07-27T14:27:01.277061+0000","last_active":"2023-07-27T14:27:01.286895+0000","last_peered":"2023-07-27T14:27:01.286895+0000","last_clean":"2023-07-27T14:27:01.286895+0000","last_became_active":"2023-07-27T14:27:01.276810+0000","last_became_peered":"2023-07-27T14:27:01.276810+0000","last_unstale":"2023-07-27T14:27:01.286895+0000","last_undegraded":"2023-07-27T14:27:01.286895+0000","last_fullsized":"2023-07-27T14:27:01.286895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270326+0000","last_change":"2023-07-27T14:27:00.810515+0000","last_active":"2023-07-27T14:27:01.270326+0000","last_peered":"2023-07-27T14:27:01.270326+0000","last_clean":"2023-07-27T14:27:01.270326+0000","last_became_active":"2023-07-27T14:27:00.810250+0000","last_became_peered":"2023-07-27T14:27:00.810250+0000","last_unstale":"2023-07-27T14:27:01.270326+0000","last_undegraded":"2023-07-27T14:27:01.270326+0000","last_fullsized":"2023-07-27T14:27:01.270326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296559+0000","last_change":"2023-07-27T14:27:01.288902+0000","last_active":"2023-07-27T14:27:01.296559+0000","last_peered":"2023-07-27T14:27:01.296559+0000","last_clean":"2023-07-27T14:27:01.296559+0000","last_became_active":"2023-07-27T14:27:01.288298+0000","last_became_peered":"2023-07-27T14:27:01.288298+0000","last_unstale":"2023-07-27T14:27:01.296559+0000","last_undegraded":"2023-07-27T14:27:01.296559+0000","last_fullsized":"2023-07-27T14:27:01.296559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270140+0000","last_change":"2023-07-27T14:27:00.821272+0000","last_active":"2023-07-27T14:27:01.270140+0000","last_peered":"2023-07-27T14:27:01.270140+0000","last_clean":"2023-07-27T14:27:01.270140+0000","last_became_active":"2023-07-27T14:27:00.820947+0000","last_became_peered":"2023-07-27T14:27:00.820947+0000","last_unstale":"2023-07-27T14:27:01.270140+0000","last_undegraded":"2023-07-27T14:27:01.270140+0000","last_fullsized":"2023-07-27T14:27:01.270140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.277787+0000","last_change":"2023-07-27T14:27:01.273588+0000","last_active":"2023-07-27T14:27:01.277787+0000","last_peered":"2023-07-27T14:27:01.277787+0000","last_clean":"2023-07-27T14:27:01.277787+0000","last_became_active":"2023-07-27T14:27:01.273352+0000","last_became_peered":"2023-07-27T14:27:01.273352+0000","last_unstale":"2023-07-27T14:27:01.277787+0000","last_undegraded":"2023-07-27T14:27:01.277787+0000","last_fullsized":"2023-07-27T14:27:01.277787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265785+0000","last_change":"2023-07-27T14:27:00.820075+0000","last_active":"2023-07-27T14:27:01.265785+0000","last_peered":"2023-07-27T14:27:01.265785+0000","last_clean":"2023-07-27T14:27:01.265785+0000","last_became_active":"2023-07-27T14:27:00.819794+0000","last_became_peered":"2023-07-27T14:27:00.819794+0000","last_unstale":"2023-07-27T14:27:01.265785+0000","last_undegraded":"2023-07-27T14:27:01.265785+0000","last_fullsized":"2023-07-27T14:27:01.265785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.283080+0000","last_change":"2023-07-27T14:27:01.280882+0000","last_active":"2023-07-27T14:27:01.283080+0000","last_peered":"2023-07-27T14:27:01.283080+0000","last_clean":"2023-07-27T14:27:01.283080+0000","last_became_active":"2023-07-27T14:27:01.280339+0000","last_became_peered":"2023-07-27T14:27:01.280339+0000","last_unstale":"2023-07-27T14:27:01.283080+0000","last_undegraded":"2023-07-27T14:27:01.283080+0000","last_fullsized":"2023-07-27T14:27:01.283080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260518+0000","last_change":"2023-07-27T14:27:00.820859+0000","last_active":"2023-07-27T14:27:01.260518+0000","last_peered":"2023-07-27T14:27:01.260518+0000","last_clean":"2023-07-27T14:27:01.260518+0000","last_became_active":"2023-07-27T14:27:00.820298+0000","last_became_peered":"2023-07-27T14:27:00.820298+0000","last_unstale":"2023-07-27T14:27:01.260518+0000","last_undegraded":"2023-07-27T14:27:01.260518+0000","last_fullsized":"2023-07-27T14:27:01.260518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299244+0000","last_change":"2023-07-27T14:27:01.294252+0000","last_active":"2023-07-27T14:27:01.299244+0000","last_peered":"2023-07-27T14:27:01.299244+0000","last_clean":"2023-07-27T14:27:01.299244+0000","last_became_active":"2023-07-27T14:27:01.293925+0000","last_became_peered":"2023-07-27T14:27:01.293925+0000","last_unstale":"2023-07-27T14:27:01.299244+0000","last_undegraded":"2023-07-27T14:27:01.299244+0000","last_fullsized":"2023-07-27T14:27:01.299244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268711+0000","last_change":"2023-07-27T14:27:00.816789+0000","last_active":"2023-07-27T14:27:01.268711+0000","last_peered":"2023-07-27T14:27:01.268711+0000","last_clean":"2023-07-27T14:27:01.268711+0000","last_became_active":"2023-07-27T14:27:00.816454+0000","last_became_peered":"2023-07-27T14:27:00.816454+0000","last_unstale":"2023-07-27T14:27:01.268711+0000","last_undegraded":"2023-07-27T14:27:01.268711+0000","last_fullsized":"2023-07-27T14:27:01.268711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281998+0000","last_change":"2023-07-27T14:27:01.270224+0000","last_active":"2023-07-27T14:27:01.281998+0000","last_peered":"2023-07-27T14:27:01.281998+0000","last_clean":"2023-07-27T14:27:01.281998+0000","last_became_active":"2023-07-27T14:27:01.269914+0000","last_became_peered":"2023-07-27T14:27:01.269914+0000","last_unstale":"2023-07-27T14:27:01.281998+0000","last_undegraded":"2023-07-27T14:27:01.281998+0000","last_fullsized":"2023-07-27T14:27:01.281998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-27T14:27:04.777547+0000","last_change":"2023-07-27T14:27:00.805825+0000","last_active":"2023-07-27T14:27:04.777547+0000","last_peered":"2023-07-27T14:27:04.777547+0000","last_clean":"2023-07-27T14:27:04.777547+0000","last_became_active":"2023-07-27T14:27:00.805285+0000","last_became_peered":"2023-07-27T14:27:00.805285+0000","last_unstale":"2023-07-27T14:27:04.777547+0000","last_undegraded":"2023-07-27T14:27:04.777547+0000","last_fullsized":"2023-07-27T14:27:04.777547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286764+0000","last_change":"2023-07-27T14:27:01.278889+0000","last_active":"2023-07-27T14:27:01.286764+0000","last_peered":"2023-07-27T14:27:01.286764+0000","last_clean":"2023-07-27T14:27:01.286764+0000","last_became_active":"2023-07-27T14:27:01.277699+0000","last_became_peered":"2023-07-27T14:27:01.277699+0000","last_unstale":"2023-07-27T14:27:01.286764+0000","last_undegraded":"2023-07-27T14:27:01.286764+0000","last_fullsized":"2023-07-27T14:27:01.286764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260325+0000","last_change":"2023-07-27T14:27:00.818272+0000","last_active":"2023-07-27T14:27:01.260325+0000","last_peered":"2023-07-27T14:27:01.260325+0000","last_clean":"2023-07-27T14:27:01.260325+0000","last_became_active":"2023-07-27T14:27:00.817922+0000","last_became_peered":"2023-07-27T14:27:00.817922+0000","last_unstale":"2023-07-27T14:27:01.260325+0000","last_undegraded":"2023-07-27T14:27:01.260325+0000","last_fullsized":"2023-07-27T14:27:01.260325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281674+0000","last_change":"2023-07-27T14:27:01.277882+0000","last_active":"2023-07-27T14:27:01.281674+0000","last_peered":"2023-07-27T14:27:01.281674+0000","last_clean":"2023-07-27T14:27:01.281674+0000","last_became_active":"2023-07-27T14:27:01.276949+0000","last_became_peered":"2023-07-27T14:27:01.276949+0000","last_unstale":"2023-07-27T14:27:01.281674+0000","last_undegraded":"2023-07-27T14:27:01.281674+0000","last_fullsized":"2023-07-27T14:27:01.281674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.269102+0000","last_change":"2023-07-27T14:27:00.822718+0000","last_active":"2023-07-27T14:27:01.269102+0000","last_peered":"2023-07-27T14:27:01.269102+0000","last_clean":"2023-07-27T14:27:01.269102+0000","last_became_active":"2023-07-27T14:27:00.822424+0000","last_became_peered":"2023-07-27T14:27:00.822424+0000","last_unstale":"2023-07-27T14:27:01.269102+0000","last_undegraded":"2023-07-27T14:27:01.269102+0000","last_fullsized":"2023-07-27T14:27:01.269102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299280+0000","last_change":"2023-07-27T14:27:01.295205+0000","last_active":"2023-07-27T14:27:01.299280+0000","last_peered":"2023-07-27T14:27:01.299280+0000","last_clean":"2023-07-27T14:27:01.299280+0000","last_became_active":"2023-07-27T14:27:01.294982+0000","last_became_peered":"2023-07-27T14:27:01.294982+0000","last_unstale":"2023-07-27T14:27:01.299280+0000","last_undegraded":"2023-07-27T14:27:01.299280+0000","last_fullsized":"2023-07-27T14:27:01.299280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260244+0000","last_change":"2023-07-27T14:27:00.821157+0000","last_active":"2023-07-27T14:27:01.260244+0000","last_peered":"2023-07-27T14:27:01.260244+0000","last_clean":"2023-07-27T14:27:01.260244+0000","last_became_active":"2023-07-27T14:27:00.820866+0000","last_became_peered":"2023-07-27T14:27:00.820866+0000","last_unstale":"2023-07-27T14:27:01.260244+0000","last_undegraded":"2023-07-27T14:27:01.260244+0000","last_fullsized":"2023-07-27T14:27:01.260244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.279179+0000","last_change":"2023-07-27T14:27:01.274421+0000","last_active":"2023-07-27T14:27:01.279179+0000","last_peered":"2023-07-27T14:27:01.279179+0000","last_clean":"2023-07-27T14:27:01.279179+0000","last_became_active":"2023-07-27T14:27:01.274184+0000","last_became_peered":"2023-07-27T14:27:01.274184+0000","last_unstale":"2023-07-27T14:27:01.279179+0000","last_undegraded":"2023-07-27T14:27:01.279179+0000","last_fullsized":"2023-07-27T14:27:01.279179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270247+0000","last_change":"2023-07-27T14:27:00.800329+0000","last_active":"2023-07-27T14:27:01.270247+0000","last_peered":"2023-07-27T14:27:01.270247+0000","last_clean":"2023-07-27T14:27:01.270247+0000","last_became_active":"2023-07-27T14:27:00.799971+0000","last_became_peered":"2023-07-27T14:27:00.799971+0000","last_unstale":"2023-07-27T14:27:01.270247+0000","last_undegraded":"2023-07-27T14:27:01.270247+0000","last_fullsized":"2023-07-27T14:27:01.270247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.297068+0000","last_change":"2023-07-27T14:27:01.290197+0000","last_active":"2023-07-27T14:27:01.297068+0000","last_peered":"2023-07-27T14:27:01.297068+0000","last_clean":"2023-07-27T14:27:01.297068+0000","last_became_active":"2023-07-27T14:27:01.289777+0000","last_became_peered":"2023-07-27T14:27:01.289777+0000","last_unstale":"2023-07-27T14:27:01.297068+0000","last_undegraded":"2023-07-27T14:27:01.297068+0000","last_fullsized":"2023-07-27T14:27:01.297068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290972+0000","last_change":"2023-07-27T14:27:00.812501+0000","last_active":"2023-07-27T14:27:01.290972+0000","last_peered":"2023-07-27T14:27:01.290972+0000","last_clean":"2023-07-27T14:27:01.290972+0000","last_became_active":"2023-07-27T14:27:00.810185+0000","last_became_peered":"2023-07-27T14:27:00.810185+0000","last_unstale":"2023-07-27T14:27:01.290972+0000","last_undegraded":"2023-07-27T14:27:01.290972+0000","last_fullsized":"2023-07-27T14:27:01.290972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289510+0000","last_change":"2023-07-27T14:27:01.281360+0000","last_active":"2023-07-27T14:27:01.289510+0000","last_peered":"2023-07-27T14:27:01.289510+0000","last_clean":"2023-07-27T14:27:01.289510+0000","last_became_active":"2023-07-27T14:27:01.279561+0000","last_became_peered":"2023-07-27T14:27:01.279561+0000","last_unstale":"2023-07-27T14:27:01.289510+0000","last_undegraded":"2023-07-27T14:27:01.289510+0000","last_fullsized":"2023-07-27T14:27:01.289510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263513+0000","last_change":"2023-07-27T14:27:00.821016+0000","last_active":"2023-07-27T14:27:01.263513+0000","last_peered":"2023-07-27T14:27:01.263513+0000","last_clean":"2023-07-27T14:27:01.263513+0000","last_became_active":"2023-07-27T14:27:00.820542+0000","last_became_peered":"2023-07-27T14:27:00.820542+0000","last_unstale":"2023-07-27T14:27:01.263513+0000","last_undegraded":"2023-07-27T14:27:01.263513+0000","last_fullsized":"2023-07-27T14:27:01.263513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281760+0000","last_change":"2023-07-27T14:27:01.279230+0000","last_active":"2023-07-27T14:27:01.281760+0000","last_peered":"2023-07-27T14:27:01.281760+0000","last_clean":"2023-07-27T14:27:01.281760+0000","last_became_active":"2023-07-27T14:27:01.278983+0000","last_became_peered":"2023-07-27T14:27:01.278983+0000","last_unstale":"2023-07-27T14:27:01.281760+0000","last_undegraded":"2023-07-27T14:27:01.281760+0000","last_fullsized":"2023-07-27T14:27:01.281760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288581+0000","last_change":"2023-07-27T14:27:00.807042+0000","last_active":"2023-07-27T14:27:01.288581+0000","last_peered":"2023-07-27T14:27:01.288581+0000","last_clean":"2023-07-27T14:27:01.288581+0000","last_became_active":"2023-07-27T14:27:00.805697+0000","last_became_peered":"2023-07-27T14:27:00.805697+0000","last_unstale":"2023-07-27T14:27:01.288581+0000","last_undegraded":"2023-07-27T14:27:01.288581+0000","last_fullsized":"2023-07-27T14:27:01.288581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.285431+0000","last_change":"2023-07-27T14:27:01.283982+0000","last_active":"2023-07-27T14:27:01.285431+0000","last_peered":"2023-07-27T14:27:01.285431+0000","last_clean":"2023-07-27T14:27:01.285431+0000","last_became_active":"2023-07-27T14:27:01.283720+0000","last_became_peered":"2023-07-27T14:27:01.283720+0000","last_unstale":"2023-07-27T14:27:01.285431+0000","last_undegraded":"2023-07-27T14:27:01.285431+0000","last_fullsized":"2023-07-27T14:27:01.285431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.270872+0000","last_change":"2023-07-27T14:27:00.803325+0000","last_active":"2023-07-27T14:27:01.270872+0000","last_peered":"2023-07-27T14:27:01.270872+0000","last_clean":"2023-07-27T14:27:01.270872+0000","last_became_active":"2023-07-27T14:27:00.802962+0000","last_became_peered":"2023-07-27T14:27:00.802962+0000","last_unstale":"2023-07-27T14:27:01.270872+0000","last_undegraded":"2023-07-27T14:27:01.270872+0000","last_fullsized":"2023-07-27T14:27:01.270872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287648+0000","last_change":"2023-07-27T14:27:01.280016+0000","last_active":"2023-07-27T14:27:01.287648+0000","last_peered":"2023-07-27T14:27:01.287648+0000","last_clean":"2023-07-27T14:27:01.287648+0000","last_became_active":"2023-07-27T14:27:01.279475+0000","last_became_peered":"2023-07-27T14:27:01.279475+0000","last_unstale":"2023-07-27T14:27:01.287648+0000","last_undegraded":"2023-07-27T14:27:01.287648+0000","last_fullsized":"2023-07-27T14:27:01.287648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268740+0000","last_change":"2023-07-27T14:27:00.808976+0000","last_active":"2023-07-27T14:27:01.268740+0000","last_peered":"2023-07-27T14:27:01.268740+0000","last_clean":"2023-07-27T14:27:01.268740+0000","last_became_active":"2023-07-27T14:27:00.808693+0000","last_became_peered":"2023-07-27T14:27:00.808693+0000","last_unstale":"2023-07-27T14:27:01.268740+0000","last_undegraded":"2023-07-27T14:27:01.268740+0000","last_fullsized":"2023-07-27T14:27:01.268740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281655+0000","last_change":"2023-07-27T14:27:01.277692+0000","last_active":"2023-07-27T14:27:01.281655+0000","last_peered":"2023-07-27T14:27:01.281655+0000","last_clean":"2023-07-27T14:27:01.281655+0000","last_became_active":"2023-07-27T14:27:01.277446+0000","last_became_peered":"2023-07-27T14:27:01.277446+0000","last_unstale":"2023-07-27T14:27:01.281655+0000","last_undegraded":"2023-07-27T14:27:01.281655+0000","last_fullsized":"2023-07-27T14:27:01.281655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289999+0000","last_change":"2023-07-27T14:27:00.804577+0000","last_active":"2023-07-27T14:27:01.289999+0000","last_peered":"2023-07-27T14:27:01.289999+0000","last_clean":"2023-07-27T14:27:01.289999+0000","last_became_active":"2023-07-27T14:27:00.804260+0000","last_became_peered":"2023-07-27T14:27:00.804260+0000","last_unstale":"2023-07-27T14:27:01.289999+0000","last_undegraded":"2023-07-27T14:27:01.289999+0000","last_fullsized":"2023-07-27T14:27:01.289999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287961+0000","last_change":"2023-07-27T14:27:01.283951+0000","last_active":"2023-07-27T14:27:01.287961+0000","last_peered":"2023-07-27T14:27:01.287961+0000","last_clean":"2023-07-27T14:27:01.287961+0000","last_became_active":"2023-07-27T14:27:01.283632+0000","last_became_peered":"2023-07-27T14:27:01.283632+0000","last_unstale":"2023-07-27T14:27:01.287961+0000","last_undegraded":"2023-07-27T14:27:01.287961+0000","last_fullsized":"2023-07-27T14:27:01.287961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.267667+0000","last_change":"2023-07-27T14:27:00.824631+0000","last_active":"2023-07-27T14:27:01.267667+0000","last_peered":"2023-07-27T14:27:01.267667+0000","last_clean":"2023-07-27T14:27:01.267667+0000","last_became_active":"2023-07-27T14:27:00.824325+0000","last_became_peered":"2023-07-27T14:27:00.824325+0000","last_unstale":"2023-07-27T14:27:01.267667+0000","last_undegraded":"2023-07-27T14:27:01.267667+0000","last_fullsized":"2023-07-27T14:27:01.267667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296913+0000","last_change":"2023-07-27T14:27:01.289044+0000","last_active":"2023-07-27T14:27:01.296913+0000","last_peered":"2023-07-27T14:27:01.296913+0000","last_clean":"2023-07-27T14:27:01.296913+0000","last_became_active":"2023-07-27T14:27:01.288554+0000","last_became_peered":"2023-07-27T14:27:01.288554+0000","last_unstale":"2023-07-27T14:27:01.296913+0000","last_undegraded":"2023-07-27T14:27:01.296913+0000","last_fullsized":"2023-07-27T14:27:01.296913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.265219+0000","last_change":"2023-07-27T14:27:00.809620+0000","last_active":"2023-07-27T14:27:01.265219+0000","last_peered":"2023-07-27T14:27:01.265219+0000","last_clean":"2023-07-27T14:27:01.265219+0000","last_became_active":"2023-07-27T14:27:00.808904+0000","last_became_peered":"2023-07-27T14:27:00.808904+0000","last_unstale":"2023-07-27T14:27:01.265219+0000","last_undegraded":"2023-07-27T14:27:01.265219+0000","last_fullsized":"2023-07-27T14:27:01.265219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.290692+0000","last_change":"2023-07-27T14:27:01.289240+0000","last_active":"2023-07-27T14:27:01.290692+0000","last_peered":"2023-07-27T14:27:01.290692+0000","last_clean":"2023-07-27T14:27:01.290692+0000","last_became_active":"2023-07-27T14:27:01.288802+0000","last_became_peered":"2023-07-27T14:27:01.288802+0000","last_unstale":"2023-07-27T14:27:01.290692+0000","last_undegraded":"2023-07-27T14:27:01.290692+0000","last_fullsized":"2023-07-27T14:27:01.290692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.281879+0000","last_change":"2023-07-27T14:27:00.822946+0000","last_active":"2023-07-27T14:27:01.281879+0000","last_peered":"2023-07-27T14:27:01.281879+0000","last_clean":"2023-07-27T14:27:01.281879+0000","last_became_active":"2023-07-27T14:27:00.822588+0000","last_became_peered":"2023-07-27T14:27:00.822588+0000","last_unstale":"2023-07-27T14:27:01.281879+0000","last_undegraded":"2023-07-27T14:27:01.281879+0000","last_fullsized":"2023-07-27T14:27:01.281879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.286750+0000","last_change":"2023-07-27T14:27:01.282869+0000","last_active":"2023-07-27T14:27:01.286750+0000","last_peered":"2023-07-27T14:27:01.286750+0000","last_clean":"2023-07-27T14:27:01.286750+0000","last_became_active":"2023-07-27T14:27:01.282606+0000","last_became_peered":"2023-07-27T14:27:01.282606+0000","last_unstale":"2023-07-27T14:27:01.286750+0000","last_undegraded":"2023-07-27T14:27:01.286750+0000","last_fullsized":"2023-07-27T14:27:01.286750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.301997+0000","last_change":"2023-07-27T14:27:00.818598+0000","last_active":"2023-07-27T14:27:01.301997+0000","last_peered":"2023-07-27T14:27:01.301997+0000","last_clean":"2023-07-27T14:27:01.301997+0000","last_became_active":"2023-07-27T14:27:00.817968+0000","last_became_peered":"2023-07-27T14:27:00.817968+0000","last_unstale":"2023-07-27T14:27:01.301997+0000","last_undegraded":"2023-07-27T14:27:01.301997+0000","last_fullsized":"2023-07-27T14:27:01.301997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284237+0000","last_change":"2023-07-27T14:27:01.280850+0000","last_active":"2023-07-27T14:27:01.284237+0000","last_peered":"2023-07-27T14:27:01.284237+0000","last_clean":"2023-07-27T14:27:01.284237+0000","last_became_active":"2023-07-27T14:27:01.280558+0000","last_became_peered":"2023-07-27T14:27:01.280558+0000","last_unstale":"2023-07-27T14:27:01.284237+0000","last_undegraded":"2023-07-27T14:27:01.284237+0000","last_fullsized":"2023-07-27T14:27:01.284237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263271+0000","last_change":"2023-07-27T14:27:00.809897+0000","last_active":"2023-07-27T14:27:01.263271+0000","last_peered":"2023-07-27T14:27:01.263271+0000","last_clean":"2023-07-27T14:27:01.263271+0000","last_became_active":"2023-07-27T14:27:00.809579+0000","last_became_peered":"2023-07-27T14:27:00.809579+0000","last_unstale":"2023-07-27T14:27:01.263271+0000","last_undegraded":"2023-07-27T14:27:01.263271+0000","last_fullsized":"2023-07-27T14:27:01.263271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284844+0000","last_change":"2023-07-27T14:27:01.274427+0000","last_active":"2023-07-27T14:27:01.284844+0000","last_peered":"2023-07-27T14:27:01.284844+0000","last_clean":"2023-07-27T14:27:01.284844+0000","last_became_active":"2023-07-27T14:27:01.273859+0000","last_became_peered":"2023-07-27T14:27:01.273859+0000","last_unstale":"2023-07-27T14:27:01.284844+0000","last_undegraded":"2023-07-27T14:27:01.284844+0000","last_fullsized":"2023-07-27T14:27:01.284844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.264973+0000","last_change":"2023-07-27T14:27:00.809959+0000","last_active":"2023-07-27T14:27:01.264973+0000","last_peered":"2023-07-27T14:27:01.264973+0000","last_clean":"2023-07-27T14:27:01.264973+0000","last_became_active":"2023-07-27T14:27:00.809036+0000","last_became_peered":"2023-07-27T14:27:00.809036+0000","last_unstale":"2023-07-27T14:27:01.264973+0000","last_undegraded":"2023-07-27T14:27:01.264973+0000","last_fullsized":"2023-07-27T14:27:01.264973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296775+0000","last_change":"2023-07-27T14:27:01.288447+0000","last_active":"2023-07-27T14:27:01.296775+0000","last_peered":"2023-07-27T14:27:01.296775+0000","last_clean":"2023-07-27T14:27:01.296775+0000","last_became_active":"2023-07-27T14:27:01.288075+0000","last_became_peered":"2023-07-27T14:27:01.288075+0000","last_unstale":"2023-07-27T14:27:01.296775+0000","last_undegraded":"2023-07-27T14:27:01.296775+0000","last_fullsized":"2023-07-27T14:27:01.296775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.262354+0000","last_change":"2023-07-27T14:27:00.817201+0000","last_active":"2023-07-27T14:27:01.262354+0000","last_peered":"2023-07-27T14:27:01.262354+0000","last_clean":"2023-07-27T14:27:01.262354+0000","last_became_active":"2023-07-27T14:27:00.816881+0000","last_became_peered":"2023-07-27T14:27:00.816881+0000","last_unstale":"2023-07-27T14:27:01.262354+0000","last_undegraded":"2023-07-27T14:27:01.262354+0000","last_fullsized":"2023-07-27T14:27:01.262354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289747+0000","last_change":"2023-07-27T14:27:01.288012+0000","last_active":"2023-07-27T14:27:01.289747+0000","last_peered":"2023-07-27T14:27:01.289747+0000","last_clean":"2023-07-27T14:27:01.289747+0000","last_became_active":"2023-07-27T14:27:01.287599+0000","last_became_peered":"2023-07-27T14:27:01.287599+0000","last_unstale":"2023-07-27T14:27:01.289747+0000","last_undegraded":"2023-07-27T14:27:01.289747+0000","last_fullsized":"2023-07-27T14:27:01.289747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.260793+0000","last_change":"2023-07-27T14:27:00.818067+0000","last_active":"2023-07-27T14:27:01.260793+0000","last_peered":"2023-07-27T14:27:01.260793+0000","last_clean":"2023-07-27T14:27:01.260793+0000","last_became_active":"2023-07-27T14:27:00.817737+0000","last_became_peered":"2023-07-27T14:27:00.817737+0000","last_unstale":"2023-07-27T14:27:01.260793+0000","last_undegraded":"2023-07-27T14:27:01.260793+0000","last_fullsized":"2023-07-27T14:27:01.260793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.282575+0000","last_change":"2023-07-27T14:27:01.280475+0000","last_active":"2023-07-27T14:27:01.282575+0000","last_peered":"2023-07-27T14:27:01.282575+0000","last_clean":"2023-07-27T14:27:01.282575+0000","last_became_active":"2023-07-27T14:27:01.280167+0000","last_became_peered":"2023-07-27T14:27:01.280167+0000","last_unstale":"2023-07-27T14:27:01.282575+0000","last_undegraded":"2023-07-27T14:27:01.282575+0000","last_fullsized":"2023-07-27T14:27:01.282575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263001+0000","last_change":"2023-07-27T14:27:00.811588+0000","last_active":"2023-07-27T14:27:01.263001+0000","last_peered":"2023-07-27T14:27:01.263001+0000","last_clean":"2023-07-27T14:27:01.263001+0000","last_became_active":"2023-07-27T14:27:00.811302+0000","last_became_peered":"2023-07-27T14:27:00.811302+0000","last_unstale":"2023-07-27T14:27:01.263001+0000","last_undegraded":"2023-07-27T14:27:01.263001+0000","last_fullsized":"2023-07-27T14:27:01.263001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299156+0000","last_change":"2023-07-27T14:27:01.293325+0000","last_active":"2023-07-27T14:27:01.299156+0000","last_peered":"2023-07-27T14:27:01.299156+0000","last_clean":"2023-07-27T14:27:01.299156+0000","last_became_active":"2023-07-27T14:27:01.293018+0000","last_became_peered":"2023-07-27T14:27:01.293018+0000","last_unstale":"2023-07-27T14:27:01.299156+0000","last_undegraded":"2023-07-27T14:27:01.299156+0000","last_fullsized":"2023-07-27T14:27:01.299156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288042+0000","last_change":"2023-07-27T14:27:00.804784+0000","last_active":"2023-07-27T14:27:01.288042+0000","last_peered":"2023-07-27T14:27:01.288042+0000","last_clean":"2023-07-27T14:27:01.288042+0000","last_became_active":"2023-07-27T14:27:00.804479+0000","last_became_peered":"2023-07-27T14:27:00.804479+0000","last_unstale":"2023-07-27T14:27:01.288042+0000","last_undegraded":"2023-07-27T14:27:01.288042+0000","last_fullsized":"2023-07-27T14:27:01.288042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.288469+0000","last_change":"2023-07-27T14:27:01.283937+0000","last_active":"2023-07-27T14:27:01.288469+0000","last_peered":"2023-07-27T14:27:01.288469+0000","last_clean":"2023-07-27T14:27:01.288469+0000","last_became_active":"2023-07-27T14:27:01.283504+0000","last_became_peered":"2023-07-27T14:27:01.283504+0000","last_unstale":"2023-07-27T14:27:01.288469+0000","last_undegraded":"2023-07-27T14:27:01.288469+0000","last_fullsized":"2023-07-27T14:27:01.288469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.289392+0000","last_change":"2023-07-27T14:27:00.807294+0000","last_active":"2023-07-27T14:27:01.289392+0000","last_peered":"2023-07-27T14:27:01.289392+0000","last_clean":"2023-07-27T14:27:01.289392+0000","last_became_active":"2023-07-27T14:27:00.805155+0000","last_became_peered":"2023-07-27T14:27:00.805155+0000","last_unstale":"2023-07-27T14:27:01.289392+0000","last_undegraded":"2023-07-27T14:27:01.289392+0000","last_fullsized":"2023-07-27T14:27:01.289392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284985+0000","last_change":"2023-07-27T14:27:01.280972+0000","last_active":"2023-07-27T14:27:01.284985+0000","last_peered":"2023-07-27T14:27:01.284985+0000","last_clean":"2023-07-27T14:27:01.284985+0000","last_became_active":"2023-07-27T14:27:01.280394+0000","last_became_peered":"2023-07-27T14:27:01.280394+0000","last_unstale":"2023-07-27T14:27:01.284985+0000","last_undegraded":"2023-07-27T14:27:01.284985+0000","last_fullsized":"2023-07-27T14:27:01.284985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.287681+0000","last_change":"2023-07-27T14:27:00.821247+0000","last_active":"2023-07-27T14:27:01.287681+0000","last_peered":"2023-07-27T14:27:01.287681+0000","last_clean":"2023-07-27T14:27:01.287681+0000","last_became_active":"2023-07-27T14:27:00.820300+0000","last_became_peered":"2023-07-27T14:27:00.820300+0000","last_unstale":"2023-07-27T14:27:01.287681+0000","last_undegraded":"2023-07-27T14:27:01.287681+0000","last_fullsized":"2023-07-27T14:27:01.287681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.299213+0000","last_change":"2023-07-27T14:27:01.294103+0000","last_active":"2023-07-27T14:27:01.299213+0000","last_peered":"2023-07-27T14:27:01.299213+0000","last_clean":"2023-07-27T14:27:01.299213+0000","last_became_active":"2023-07-27T14:27:01.293567+0000","last_became_peered":"2023-07-27T14:27:01.293567+0000","last_unstale":"2023-07-27T14:27:01.299213+0000","last_undegraded":"2023-07-27T14:27:01.299213+0000","last_fullsized":"2023-07-27T14:27:01.299213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.263146+0000","last_change":"2023-07-27T14:27:00.809881+0000","last_active":"2023-07-27T14:27:01.263146+0000","last_peered":"2023-07-27T14:27:01.263146+0000","last_clean":"2023-07-27T14:27:01.263146+0000","last_became_active":"2023-07-27T14:27:00.809012+0000","last_became_peered":"2023-07-27T14:27:00.809012+0000","last_unstale":"2023-07-27T14:27:01.263146+0000","last_undegraded":"2023-07-27T14:27:01.263146+0000","last_fullsized":"2023-07-27T14:27:01.263146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284867+0000","last_change":"2023-07-27T14:27:01.274666+0000","last_active":"2023-07-27T14:27:01.284867+0000","last_peered":"2023-07-27T14:27:01.284867+0000","last_clean":"2023-07-27T14:27:01.284867+0000","last_became_active":"2023-07-27T14:27:01.272660+0000","last_became_peered":"2023-07-27T14:27:01.272660+0000","last_unstale":"2023-07-27T14:27:01.284867+0000","last_undegraded":"2023-07-27T14:27:01.284867+0000","last_fullsized":"2023-07-27T14:27:01.284867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.268785+0000","last_change":"2023-07-27T14:27:00.805779+0000","last_active":"2023-07-27T14:27:01.268785+0000","last_peered":"2023-07-27T14:27:01.268785+0000","last_clean":"2023-07-27T14:27:01.268785+0000","last_became_active":"2023-07-27T14:27:00.805502+0000","last_became_peered":"2023-07-27T14:27:00.805502+0000","last_unstale":"2023-07-27T14:27:01.268785+0000","last_undegraded":"2023-07-27T14:27:01.268785+0000","last_fullsized":"2023-07-27T14:27:01.268785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.296549+0000","last_change":"2023-07-27T14:27:01.289809+0000","last_active":"2023-07-27T14:27:01.296549+0000","last_peered":"2023-07-27T14:27:01.296549+0000","last_clean":"2023-07-27T14:27:01.296549+0000","last_became_active":"2023-07-27T14:27:01.289534+0000","last_became_peered":"2023-07-27T14:27:01.289534+0000","last_unstale":"2023-07-27T14:27:01.296549+0000","last_undegraded":"2023-07-27T14:27:01.296549+0000","last_fullsized":"2023-07-27T14:27:01.296549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:27:00.781524+0000","last_clean_scrub_stamp":"2023-07-27T14:27:00.781524+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-27T14:27:01.284811+0000","last_change":"2023-07-27T14:27:00.807339+0000","last_active":"2023-07-27T14:27:01.284811+0000","last_peered":"2023-07-27T14:27:01.284811+0000","last_clean":"2023-07-27T14:27:01.284811+0000","last_became_active":"2023-07-27T14:27:00.806613+0000","last_became_peered":"2023-07-27T14:27:00.806613+0000","last_unstale":"2023-07-27T14:27:01.284811+0000","last_undegraded":"2023-07-27T14:27:01.284811+0000","last_fullsized":"2023-07-27T14:27:01.284811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:59.775778+0000","last_clean_scrub_stamp":"2023-07-27T14:26:59.775778+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5252,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366588,"statfs":{"total":96636764160,"available":96631386112,"internally_reserved":0,"allocated":258048,"data_stored":87108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":237568,"data_stored":87140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":229376,"data_stored":85694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":229376,"data_stored":85694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":233472,"data_stored":85764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5228,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366612,"statfs":{"total":96636764160,"available":96631410688,"internally_reserved":0,"allocated":233472,"data_stored":85784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":249856,"data_stored":87286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":229376,"data_stored":85694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:27:14.508 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-27T14:27:14.508 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-27T14:27:14.509 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-27T14:27:14.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-27T14:27:14.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.714+0000 7f08717ff700 1 Processor -- start 2023-07-27T14:27:14.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.714+0000 7f08717ff700 1 -- start start 2023-07-27T14:27:14.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f08717ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f086c1540e0 0x7f086c0a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f08717ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f086c0c0b70 0x7f086c0c1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f08717ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0c9a80 con 0x7f086c0c5d80 2023-07-27T14:27:14.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f08717ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0c8e70 con 0x7f086c0c0b70 2023-07-27T14:27:14.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f08717ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0c9150 con 0x7f086c1540e0 2023-07-27T14:27:14.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f086a7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f086c0c5d80 0x7f086c0c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33580/0 (socket says 172.21.15.115:33580) 2023-07-27T14:27:14.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f086a7fc700 1 -- 172.21.15.115:0/370438563 learned_addr learned my addr 172.21.15.115:0/370438563 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:14.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f086affd700 1 --2- 172.21.15.115:0/370438563 >> v2:172.21.15.159:3300/0 conn(0x7f086c1540e0 0x7f086c0a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.715+0000 7f086b7fe700 1 --2- 172.21.15.115:0/370438563 >> v2:172.21.15.115:3300/0 conn(0x7f086c0c0b70 0x7f086c0c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f0869ffb700 1 -- 172.21.15.115:0/370438563 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315832486 0 0) 0x7f086c0c9a80 con 0x7f086c0c5d80 2023-07-27T14:27:14.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f0869ffb700 1 -- 172.21.15.115:0/370438563 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08540033f0 con 0x7f086c0c5d80 2023-07-27T14:27:14.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f086affd700 1 -- 172.21.15.115:0/370438563 >> v2:172.21.15.115:3300/0 conn(0x7f086c0c0b70 msgr2=0x7f086c0c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:14.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f086affd700 1 --2- 172.21.15.115:0/370438563 >> v2:172.21.15.115:3300/0 conn(0x7f086c0c0b70 0x7f086c0c1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f086affd700 1 -- 172.21.15.115:0/370438563 >> v1:172.21.15.115:6789/0 conn(0x7f086c0c5d80 legacy=0x7f086c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f086affd700 1 -- 172.21.15.115:0/370438563 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0c9430 con 0x7f086c1540e0 2023-07-27T14:27:14.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f086affd700 1 --2- 172.21.15.115:0/370438563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c1540e0 0x7f086c0a79b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f086c083e30 tx=0x7f085c009060).ready entity=mon.1 client_cookie=452f8d16d4f29991 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f0869ffb700 1 -- 172.21.15.115:0/370438563 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00d4a0 con 0x7f086c1540e0 2023-07-27T14:27:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f0869ffb700 1 -- 172.21.15.115:0/370438563 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00d600 con 0x7f086c1540e0 2023-07-27T14:27:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.716+0000 7f0869ffb700 1 -- 172.21.15.115:0/370438563 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00d980 con 0x7f086c1540e0 2023-07-27T14:27:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.717+0000 7f08717ff700 1 -- 172.21.15.115:0/370438563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c1540e0 msgr2=0x7f086c0a79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.717+0000 7f08717ff700 1 --2- 172.21.15.115:0/370438563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c1540e0 0x7f086c0a79b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f086c083e30 tx=0x7f085c009060).stop 2023-07-27T14:27:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.717+0000 7f08717ff700 1 -- 172.21.15.115:0/370438563 shutdown_connections 2023-07-27T14:27:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.717+0000 7f08717ff700 1 --2- 172.21.15.115:0/370438563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c1540e0 0x7f086c0a79b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.717+0000 7f08717ff700 1 --2- 172.21.15.115:0/370438563 >> v2:172.21.15.115:3300/0 conn(0x7f086c0c0b70 0x7f086c0c1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.717+0000 7f08717ff700 1 -- 172.21.15.115:0/370438563 >> 172.21.15.115:0/370438563 conn(0x7f086c05e650 msgr2=0x7f086c0cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.717+0000 7f08717ff700 1 -- 172.21.15.115:0/370438563 shutdown_connections 2023-07-27T14:27:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.717+0000 7f08717ff700 1 -- 172.21.15.115:0/370438563 wait complete. 2023-07-27T14:27:14.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.718+0000 7f08717ff700 1 Processor -- start 2023-07-27T14:27:14.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.718+0000 7f08717ff700 1 -- start start 2023-07-27T14:27:14.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.719+0000 7f08717ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c0c0b70 0x7f086c0ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.719+0000 7f08717ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f086c0c5d80 0x7f086c0aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.719+0000 7f08717ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086c1540e0 0x7f086c1644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.719+0000 7f08717ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c165fe0 con 0x7f086c1540e0 2023-07-27T14:27:14.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.719+0000 7f08717ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0af4b0 con 0x7f086c0c0b70 2023-07-27T14:27:14.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.719+0000 7f08717ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1656b0 con 0x7f086c0c5d80 2023-07-27T14:27:14.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086c1540e0 0x7f086c1644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086c1540e0 0x7f086c1644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47458/0 (socket says 172.21.15.115:47458) 2023-07-27T14:27:14.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 -- 172.21.15.115:0/3183138025 learned_addr learned my addr 172.21.15.115:0/3183138025 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:14.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086affd700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c0c0b70 0x7f086c0ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086a7fc700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f086c0c5d80 0x7f086c0aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 -- 172.21.15.115:0/3183138025 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f086c0c5d80 msgr2=0x7f086c0aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f086c0c5d80 0x7f086c0aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 -- 172.21.15.115:0/3183138025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c0c0b70 msgr2=0x7f086c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c0c0b70 0x7f086c0ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 -- 172.21.15.115:0/3183138025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0092a0 con 0x7f086c1540e0 2023-07-27T14:27:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f086b7fe700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086c1540e0 0x7f086c1644e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0864009e90 tx=0x7f086400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f0852ffd700 1 -- 172.21.15.115:0/3183138025 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400caa0 con 0x7f086c1540e0 2023-07-27T14:27:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f0852ffd700 1 -- 172.21.15.115:0/3183138025 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400f040 con 0x7f086c1540e0 2023-07-27T14:27:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.720+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c165990 con 0x7f086c1540e0 2023-07-27T14:27:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.721+0000 7f0852ffd700 1 -- 172.21.15.115:0/3183138025 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400ce10 con 0x7f086c1540e0 2023-07-27T14:27:14.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.721+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0af160 con 0x7f086c1540e0 2023-07-27T14:27:14.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.722+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c0a9f60 con 0x7f086c1540e0 2023-07-27T14:27:14.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.722+0000 7f0852ffd700 1 -- 172.21.15.115:0/3183138025 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0864013610 con 0x7f086c1540e0 2023-07-27T14:27:14.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.723+0000 7f0852ffd700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f085805ed90 0x7f0858061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:14.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.723+0000 7f0852ffd700 1 -- 172.21.15.115:0/3183138025 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f086407a600 con 0x7f086c1540e0 2023-07-27T14:27:14.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.723+0000 7f086affd700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f085805ed90 0x7f0858061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:14.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.724+0000 7f086affd700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f085805ed90 0x7f0858061250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f085c009fd0 tx=0x7f085c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:14.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.727+0000 7f0852ffd700 1 -- 172.21.15.115:0/3183138025 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f086c0a9f60 con 0x7f086c1540e0 2023-07-27T14:27:14.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.934+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f086c0a9f60 con 0x7f086c1540e0 2023-07-27T14:27:14.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.934+0000 7f0852ffd700 1 -- 172.21.15.115:0/3183138025 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f086c0a9f60 con 0x7f086c1540e0 2023-07-27T14:27:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.936+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f085805ed90 msgr2=0x7f0858061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.936+0000 7f08717ff700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f085805ed90 0x7f0858061250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f085c009fd0 tx=0x7f085c016000).stop 2023-07-27T14:27:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.936+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086c1540e0 msgr2=0x7f086c1644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.936+0000 7f08717ff700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086c1540e0 0x7f086c1644e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0864009e90 tx=0x7f086400b040).stop 2023-07-27T14:27:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.937+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 shutdown_connections 2023-07-27T14:27:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.937+0000 7f08717ff700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f085805ed90 0x7f0858061250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.937+0000 7f08717ff700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086c1540e0 0x7f086c1644e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.937+0000 7f08717ff700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f086c0c0b70 0x7f086c0ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.937+0000 7f08717ff700 1 --2- 172.21.15.115:0/3183138025 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f086c0c5d80 0x7f086c0aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:14.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.937+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 >> 172.21.15.115:0/3183138025 conn(0x7f086c05e650 msgr2=0x7f086c151440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:14.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.937+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 shutdown_connections 2023-07-27T14:27:14.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:14.937+0000 7f08717ff700 1 -- 172.21.15.115:0/3183138025 wait complete. 2023-07-27T14:27:14.967 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-27T14:27:14.967 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-27T14:27:14.968 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:15.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.143+0000 7fda2a7ff700 1 Processor -- start 2023-07-27T14:27:15.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.143+0000 7fda2a7ff700 1 -- start start 2023-07-27T14:27:15.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.144+0000 7fda2a7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda2414fbd0 0x7fda24064b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.144+0000 7fda2a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.144+0000 7fda2a7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda241532a0 con 0x7fda240c3470 2023-07-27T14:27:15.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.144+0000 7fda2a7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240c3c90 con 0x7fda2414fbd0 2023-07-27T14:27:15.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.144+0000 7fda2a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda24064060 con 0x7fda240c3850 2023-07-27T14:27:15.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda23fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fda240c3470 0x7fda2414f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33590/0 (socket says 172.21.15.115:33590) 2023-07-27T14:27:15.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda23fff700 1 -- 172.21.15.115:0/370240673 learned_addr learned my addr 172.21.15.115:0/370240673 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:15.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda237fe700 1 --2- 172.21.15.115:0/370240673 >> v2:172.21.15.115:3300/0 conn(0x7fda2414fbd0 0x7fda24064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda28d9c700 1 --2- 172.21.15.115:0/370240673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda237fe700 1 -- 172.21.15.115:0/370240673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 msgr2=0x7fda24152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:15.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda237fe700 1 --2- 172.21.15.115:0/370240673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda237fe700 1 -- 172.21.15.115:0/370240673 >> v1:172.21.15.115:6789/0 conn(0x7fda240c3470 legacy=0x7fda2414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda237fe700 1 -- 172.21.15.115:0/370240673 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24064340 con 0x7fda2414fbd0 2023-07-27T14:27:15.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda28d9c700 1 --2- 172.21.15.115:0/370240673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:15.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda22ffd700 1 -- 172.21.15.115:0/370240673 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796500107 0 0) 0x7fda241532a0 con 0x7fda240c3470 2023-07-27T14:27:15.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.145+0000 7fda237fe700 1 --2- 172.21.15.115:0/370240673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda2414fbd0 0x7fda24064b40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fda18009760 tx=0x7fda18009060).ready entity=mon.0 client_cookie=22b256b249eacc57 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda22ffd700 1 -- 172.21.15.115:0/370240673 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800b580 con 0x7fda2414fbd0 2023-07-27T14:27:15.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda22ffd700 1 -- 172.21.15.115:0/370240673 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800b6e0 con 0x7fda2414fbd0 2023-07-27T14:27:15.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda22ffd700 1 -- 172.21.15.115:0/370240673 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800ba60 con 0x7fda2414fbd0 2023-07-27T14:27:15.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda2a7ff700 1 -- 172.21.15.115:0/370240673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda2414fbd0 msgr2=0x7fda24064b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/370240673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda2414fbd0 0x7fda24064b40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fda18009760 tx=0x7fda18009060).stop 2023-07-27T14:27:15.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda2a7ff700 1 -- 172.21.15.115:0/370240673 shutdown_connections 2023-07-27T14:27:15.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/370240673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/370240673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda2414fbd0 0x7fda24064b40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda2a7ff700 1 -- 172.21.15.115:0/370240673 >> 172.21.15.115:0/370240673 conn(0x7fda24062320 msgr2=0x7fda24062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:15.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda2a7ff700 1 -- 172.21.15.115:0/370240673 shutdown_connections 2023-07-27T14:27:15.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.146+0000 7fda2a7ff700 1 -- 172.21.15.115:0/370240673 wait complete. 2023-07-27T14:27:15.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.148+0000 7fda2a7ff700 1 Processor -- start 2023-07-27T14:27:15.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.149+0000 7fda2a7ff700 1 -- start start 2023-07-27T14:27:15.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda2a7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda240c3470 0x7fda24137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda2a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda2a7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda2414fbd0 0x7fda24165c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda2a7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240abf50 con 0x7fda240c3470 2023-07-27T14:27:15.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda2a7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240a8b50 con 0x7fda2414fbd0 2023-07-27T14:27:15.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda2a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240a8e30 con 0x7fda240c3850 2023-07-27T14:27:15.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda23fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda240c3470 0x7fda24137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda23fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda240c3470 0x7fda24137630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47468/0 (socket says 172.21.15.115:47468) 2023-07-27T14:27:15.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda23fff700 1 -- 172.21.15.115:0/454027529 learned_addr learned my addr 172.21.15.115:0/454027529 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:15.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda237fe700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda28d9c700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda2414fbd0 0x7fda24165c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda23fff700 1 -- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 msgr2=0x7fda24165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda23fff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda23fff700 1 -- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda2414fbd0 msgr2=0x7fda24165c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda23fff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda2414fbd0 0x7fda24165c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda23fff700 1 -- 172.21.15.115:0/454027529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda180092a0 con 0x7fda240c3470 2023-07-27T14:27:15.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.150+0000 7fda28d9c700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda2414fbd0 0x7fda24165c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:15.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.151+0000 7fda23fff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda240c3470 0x7fda24137630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fda1400c4e0 tx=0x7fda14007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.151+0000 7fda0bfff700 1 -- 172.21.15.115:0/454027529 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140072e0 con 0x7fda240c3470 2023-07-27T14:27:15.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.151+0000 7fda0bfff700 1 -- 172.21.15.115:0/454027529 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14007440 con 0x7fda240c3470 2023-07-27T14:27:15.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.151+0000 7fda0bfff700 1 -- 172.21.15.115:0/454027529 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140057a0 con 0x7fda240c3470 2023-07-27T14:27:15.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.151+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda240abbe0 con 0x7fda240c3470 2023-07-27T14:27:15.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.151+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda240a8790 con 0x7fda240c3470 2023-07-27T14:27:15.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.152+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2406c470 con 0x7fda240c3470 2023-07-27T14:27:15.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.153+0000 7fda0bfff700 1 -- 172.21.15.115:0/454027529 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fda14010070 con 0x7fda240c3470 2023-07-27T14:27:15.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.153+0000 7fda0bfff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda1005ed90 0x7fda10061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.154+0000 7fda0bfff700 1 -- 172.21.15.115:0/454027529 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fda140792c0 con 0x7fda240c3470 2023-07-27T14:27:15.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.154+0000 7fda237fe700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda1005ed90 0x7fda10061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.154+0000 7fda237fe700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda1005ed90 0x7fda10061250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fda1800b340 tx=0x7fda18017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.157+0000 7fda0bfff700 1 -- 172.21.15.115:0/454027529 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda1404a750 con 0x7fda240c3470 2023-07-27T14:27:15.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.327+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda24064620 con 0x7fda240c3470 2023-07-27T14:27:15.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.328+0000 7fda0bfff700 1 -- 172.21.15.115:0/454027529 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7fda1404dd70 con 0x7fda240c3470 2023-07-27T14:27:15.342 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:15.342 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:15.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.330+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda1005ed90 msgr2=0x7fda10061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.330+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda1005ed90 0x7fda10061250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fda1800b340 tx=0x7fda18017000).stop 2023-07-27T14:27:15.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.330+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda240c3470 msgr2=0x7fda24137630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.330+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda240c3470 0x7fda24137630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fda1400c4e0 tx=0x7fda14007c70).stop 2023-07-27T14:27:15.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.331+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 shutdown_connections 2023-07-27T14:27:15.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.331+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda1005ed90 0x7fda10061250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.331+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda2414fbd0 0x7fda24165c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.331+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda240c3470 0x7fda24137630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.331+0000 7fda2a7ff700 1 --2- 172.21.15.115:0/454027529 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda240c3850 0x7fda24165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.331+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 >> 172.21.15.115:0/454027529 conn(0x7fda24062320 msgr2=0x7fda241382e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:15.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.331+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 shutdown_connections 2023-07-27T14:27:15.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.331+0000 7fda2a7ff700 1 -- 172.21.15.115:0/454027529 wait complete. 2023-07-27T14:27:15.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:26:59.286583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:27:00.228329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:27:15.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:27:15.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.540+0000 7f2c4bbff700 1 Processor -- start 2023-07-27T14:27:15.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.540+0000 7f2c4bbff700 1 -- start start 2023-07-27T14:27:15.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c4414ae00 0x7f2c44154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4bbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2c4414b1e0 0x7f2c44062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4bbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c441553f0 con 0x7f2c440c5c50 2023-07-27T14:27:15.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4bbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c44157a50 con 0x7f2c4414b1e0 2023-07-27T14:27:15.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44157d10 con 0x7f2c4414ae00 2023-07-27T14:27:15.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4919a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2c4414b1e0 0x7f2c44062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4919a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2c4414b1e0 0x7f2c44062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47478/0 (socket says 172.21.15.115:47478) 2023-07-27T14:27:15.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4919a700 1 -- 172.21.15.115:0/1272910504 learned_addr learned my addr 172.21.15.115:0/1272910504 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:15.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4999b700 1 --2- 172.21.15.115:0/1272910504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c4414ae00 0x7f2c44154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4919a700 1 -- 172.21.15.115:0/1272910504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c4414ae00 msgr2=0x7f2c44154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:15.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4919a700 1 --2- 172.21.15.115:0/1272910504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c4414ae00 0x7f2c44154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4919a700 1 -- 172.21.15.115:0/1272910504 >> v1:172.21.15.159:6789/0 conn(0x7f2c440c5c50 legacy=0x7f2c440a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c4919a700 1 -- 172.21.15.115:0/1272910504 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44157ff0 con 0x7f2c4414b1e0 2023-07-27T14:27:15.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.542+0000 7f2c48999700 1 -- 172.21.15.115:0/1272910504 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268387927 0 0) 0x7f2c441553f0 con 0x7f2c440c5c50 2023-07-27T14:27:15.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c4919a700 1 --2- 172.21.15.115:0/1272910504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414b1e0 0x7f2c44062b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2c34006fd0 tx=0x7f2c340090f0).ready entity=mon.0 client_cookie=3e44323265671d44 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c48999700 1 -- 172.21.15.115:0/1272910504 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400b580 con 0x7f2c4414b1e0 2023-07-27T14:27:15.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c48999700 1 -- 172.21.15.115:0/1272910504 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3400b6e0 con 0x7f2c4414b1e0 2023-07-27T14:27:15.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c48999700 1 -- 172.21.15.115:0/1272910504 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400ba60 con 0x7f2c4414b1e0 2023-07-27T14:27:15.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1272910504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414b1e0 msgr2=0x7f2c44062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1272910504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414b1e0 0x7f2c44062b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2c34006fd0 tx=0x7f2c340090f0).stop 2023-07-27T14:27:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1272910504 shutdown_connections 2023-07-27T14:27:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1272910504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c4414ae00 0x7f2c44154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1272910504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414b1e0 0x7f2c44062b50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.543+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1272910504 >> 172.21.15.115:0/1272910504 conn(0x7f2c4405e940 msgr2=0x7f2c440cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.544+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1272910504 shutdown_connections 2023-07-27T14:27:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.544+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1272910504 wait complete. 2023-07-27T14:27:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.545+0000 7f2c4bbff700 1 Processor -- start 2023-07-27T14:27:15.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.545+0000 7f2c4bbff700 1 -- start start 2023-07-27T14:27:15.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c440c5c50 0x7f2c4414a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4bbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414ae00 0x7f2c44149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4bbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c4414b1e0 0x7f2c44155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4bbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4414abe0 con 0x7f2c4414ae00 2023-07-27T14:27:15.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4bbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440c1c50 con 0x7f2c4414b1e0 2023-07-27T14:27:15.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440c1f30 con 0x7f2c440c5c50 2023-07-27T14:27:15.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414ae00 0x7f2c44149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414ae00 0x7f2c44149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47484/0 (socket says 172.21.15.115:47484) 2023-07-27T14:27:15.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4919a700 1 -- 172.21.15.115:0/1454905019 learned_addr learned my addr 172.21.15.115:0/1454905019 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:15.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4999b700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c440c5c50 0x7f2c4414a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.546+0000 7f2c4a19c700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c4414b1e0 0x7f2c44155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4919a700 1 -- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c440c5c50 msgr2=0x7f2c4414a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4919a700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c440c5c50 0x7f2c4414a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4919a700 1 -- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c4414b1e0 msgr2=0x7f2c44155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4919a700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c4414b1e0 0x7f2c44155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4919a700 1 -- 172.21.15.115:0/1454905019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c34009370 con 0x7f2c4414ae00 2023-07-27T14:27:15.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4a19c700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c4414b1e0 0x7f2c44155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:15.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4919a700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414ae00 0x7f2c44149e60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2c34011000 tx=0x7f2c34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c39ffb700 1 -- 172.21.15.115:0/1454905019 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400b850 con 0x7f2c4414ae00 2023-07-27T14:27:15.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c39ffb700 1 -- 172.21.15.115:0/1454905019 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3400b9b0 con 0x7f2c4414ae00 2023-07-27T14:27:15.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c440c2210 con 0x7f2c4414ae00 2023-07-27T14:27:15.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c39ffb700 1 -- 172.21.15.115:0/1454905019 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3401d680 con 0x7f2c4414ae00 2023-07-27T14:27:15.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.547+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c440c27d0 con 0x7f2c4414ae00 2023-07-27T14:27:15.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.548+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4406c470 con 0x7f2c4414ae00 2023-07-27T14:27:15.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.549+0000 7f2c39ffb700 1 -- 172.21.15.115:0/1454905019 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2c34023020 con 0x7f2c4414ae00 2023-07-27T14:27:15.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.550+0000 7f2c39ffb700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2c2805ed90 0x7f2c28061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.550+0000 7f2c39ffb700 1 -- 172.21.15.115:0/1454905019 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2c3407b970 con 0x7f2c4414ae00 2023-07-27T14:27:15.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.551+0000 7f2c4999b700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2c2805ed90 0x7f2c28061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.551+0000 7f2c4999b700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2c2805ed90 0x7f2c28061250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2c40009c30 tx=0x7f2c40009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.555+0000 7f2c39ffb700 1 -- 172.21.15.115:0/1454905019 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c3404ce90 con 0x7f2c4414ae00 2023-07-27T14:27:15.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.724+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2c44153eb0 con 0x7f2c4414ae00 2023-07-27T14:27:15.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.724+0000 7f2c39ffb700 1 -- 172.21.15.115:0/1454905019 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2c340504b0 con 0x7f2c4414ae00 2023-07-27T14:27:15.738 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:27:15.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2c2805ed90 msgr2=0x7f2c28061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2c2805ed90 0x7f2c28061250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2c40009c30 tx=0x7f2c40009060).stop 2023-07-27T14:27:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414ae00 msgr2=0x7f2c44149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414ae00 0x7f2c44149e60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f2c34011000 tx=0x7f2c34017000).stop 2023-07-27T14:27:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 shutdown_connections 2023-07-27T14:27:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2c2805ed90 0x7f2c28061250 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c4414b1e0 0x7f2c44155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c440c5c50 0x7f2c4414a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 --2- 172.21.15.115:0/1454905019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c4414ae00 0x7f2c44149e60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 >> 172.21.15.115:0/1454905019 conn(0x7f2c4405e940 msgr2=0x7f2c440aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:15.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 shutdown_connections 2023-07-27T14:27:15.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.726+0000 7f2c4bbff700 1 -- 172.21.15.115:0/1454905019 wait complete. 2023-07-27T14:27:15.757 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:27:15.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.934+0000 7f4ef35ff700 1 Processor -- start 2023-07-27T14:27:15.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.935+0000 7f4ef35ff700 1 -- start start 2023-07-27T14:27:15.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef35ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4eec14ae00 0x7f4eec154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef35ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14b1e0 0x7f4eec062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef35ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec1553f0 con 0x7f4eec0c5c50 2023-07-27T14:27:15.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef35ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec157a50 con 0x7f4eec14ae00 2023-07-27T14:27:15.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef35ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec157d10 con 0x7f4eec14b1e0 2023-07-27T14:27:15.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef1b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4eec0c5c50 0x7f4eec0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33592/0 (socket says 172.21.15.115:33592) 2023-07-27T14:27:15.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef1b9c700 1 -- 172.21.15.115:0/1551381301 learned_addr learned my addr 172.21.15.115:0/1551381301 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:15.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef0b9a700 1 --2- 172.21.15.115:0/1551381301 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14b1e0 0x7f4eec062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.936+0000 7f4ef139b700 1 --2- 172.21.15.115:0/1551381301 >> v2:172.21.15.159:3300/0 conn(0x7f4eec14ae00 0x7f4eec154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.937+0000 7f4ee3fff700 1 -- 172.21.15.115:0/1551381301 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328314658 0 0) 0x7f4eec1553f0 con 0x7f4eec0c5c50 2023-07-27T14:27:15.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.937+0000 7f4ee3fff700 1 -- 172.21.15.115:0/1551381301 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed80033f0 con 0x7f4eec0c5c50 2023-07-27T14:27:15.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.937+0000 7f4ef0b9a700 1 -- 172.21.15.115:0/1551381301 >> v2:172.21.15.159:3300/0 conn(0x7f4eec14ae00 msgr2=0x7f4eec154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:15.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.937+0000 7f4ef0b9a700 1 --2- 172.21.15.115:0/1551381301 >> v2:172.21.15.159:3300/0 conn(0x7f4eec14ae00 0x7f4eec154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.937+0000 7f4ef0b9a700 1 -- 172.21.15.115:0/1551381301 >> v1:172.21.15.115:6789/0 conn(0x7f4eec0c5c50 legacy=0x7f4eec0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.937+0000 7f4ef0b9a700 1 -- 172.21.15.115:0/1551381301 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec157ff0 con 0x7f4eec14b1e0 2023-07-27T14:27:15.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.937+0000 7f4ef139b700 1 --2- 172.21.15.115:0/1551381301 >> v2:172.21.15.159:3300/0 conn(0x7f4eec14ae00 0x7f4eec154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:15.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.937+0000 7f4ef0b9a700 1 --2- 172.21.15.115:0/1551381301 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14b1e0 0x7f4eec062b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4edc009760 tx=0x7f4edc009060).ready entity=mon.2 client_cookie=292e9775bef99601 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ee3fff700 1 -- 172.21.15.115:0/1551381301 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00d4a0 con 0x7f4eec14b1e0 2023-07-27T14:27:15.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ee3fff700 1 -- 172.21.15.115:0/1551381301 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc00d600 con 0x7f4eec14b1e0 2023-07-27T14:27:15.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ee3fff700 1 -- 172.21.15.115:0/1551381301 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00d980 con 0x7f4eec14b1e0 2023-07-27T14:27:15.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ef35ff700 1 -- 172.21.15.115:0/1551381301 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14b1e0 msgr2=0x7f4eec062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/1551381301 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14b1e0 0x7f4eec062b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4edc009760 tx=0x7f4edc009060).stop 2023-07-27T14:27:15.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ef35ff700 1 -- 172.21.15.115:0/1551381301 shutdown_connections 2023-07-27T14:27:15.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/1551381301 >> v2:172.21.15.159:3300/0 conn(0x7f4eec14ae00 0x7f4eec154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/1551381301 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14b1e0 0x7f4eec062b50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:15.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ef35ff700 1 -- 172.21.15.115:0/1551381301 >> 172.21.15.115:0/1551381301 conn(0x7f4eec05e940 msgr2=0x7f4eec0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:15.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ef35ff700 1 -- 172.21.15.115:0/1551381301 shutdown_connections 2023-07-27T14:27:15.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.938+0000 7f4ef35ff700 1 -- 172.21.15.115:0/1551381301 wait complete. 2023-07-27T14:27:15.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.940+0000 7f4ef35ff700 1 Processor -- start 2023-07-27T14:27:15.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.940+0000 7f4ef35ff700 1 -- start start 2023-07-27T14:27:15.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef35ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec0c5c50 0x7f4eec13e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef35ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14ae00 0x7f4eec0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef35ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec14b1e0 0x7f4eec0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef35ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0ae540 con 0x7f4eec0c5c50 2023-07-27T14:27:15.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef35ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0c27d0 con 0x7f4eec14b1e0 2023-07-27T14:27:15.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef35ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1573a0 con 0x7f4eec14ae00 2023-07-27T14:27:15.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec0c5c50 0x7f4eec13e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec0c5c50 0x7f4eec13e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47496/0 (socket says 172.21.15.115:47496) 2023-07-27T14:27:15.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 -- 172.21.15.115:0/3125394007 learned_addr learned my addr 172.21.15.115:0/3125394007 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:15.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 -- 172.21.15.115:0/3125394007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14ae00 msgr2=0x7f4eec0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14ae00 0x7f4eec0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:15.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 -- 172.21.15.115:0/3125394007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec14b1e0 msgr2=0x7f4eec0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:15.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec14b1e0 0x7f4eec0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:15.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 -- 172.21.15.115:0/3125394007 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80092a0 con 0x7f4eec0c5c50 2023-07-27T14:27:15.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.941+0000 7f4ef139b700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec0c5c50 0x7f4eec13e780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4ee800ea20 tx=0x7f4ee8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.942+0000 7f4ee17fa700 1 -- 172.21.15.115:0/3125394007 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800c850 con 0x7f4eec0c5c50 2023-07-27T14:27:15.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.942+0000 7f4ee17fa700 1 -- 172.21.15.115:0/3125394007 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800c9b0 con 0x7f4eec0c5c50 2023-07-27T14:27:15.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.942+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc0092a0 con 0x7f4eec0c5c50 2023-07-27T14:27:15.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.942+0000 7f4ee17fa700 1 -- 172.21.15.115:0/3125394007 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800cd30 con 0x7f4eec0c5c50 2023-07-27T14:27:15.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.942+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec0aea20 con 0x7f4eec0c5c50 2023-07-27T14:27:15.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.943+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec06c470 con 0x7f4eec0c5c50 2023-07-27T14:27:15.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.943+0000 7f4ee17fa700 1 -- 172.21.15.115:0/3125394007 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ee8022070 con 0x7f4eec0c5c50 2023-07-27T14:27:15.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.944+0000 7f4ee17fa700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005ed90 0x7f4ed0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:15.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.945+0000 7f4ee17fa700 1 -- 172.21.15.115:0/3125394007 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4ee807a1e0 con 0x7f4eec0c5c50 2023-07-27T14:27:15.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.945+0000 7f4ef0b9a700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005ed90 0x7f4ed0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:15.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.945+0000 7f4ef0b9a700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005ed90 0x7f4ed0061250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4eec14b5e0 tx=0x7f4edc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:15.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:15.949+0000 7f4ee17fa700 1 -- 172.21.15.115:0/3125394007 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ee804b670 con 0x7f4eec0c5c50 2023-07-27T14:27:16.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.116+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4eec13ec70 con 0x7f4eec0c5c50 2023-07-27T14:27:16.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.116+0000 7f4ee17fa700 1 -- 172.21.15.115:0/3125394007 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4ee804ec90 con 0x7f4eec0c5c50 2023-07-27T14:27:16.130 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:27:16.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005ed90 msgr2=0x7f4ed0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005ed90 0x7f4ed0061250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4eec14b5e0 tx=0x7f4edc016000).stop 2023-07-27T14:27:16.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec0c5c50 msgr2=0x7f4eec13e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec0c5c50 0x7f4eec13e780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f4ee800ea20 tx=0x7f4ee8009060).stop 2023-07-27T14:27:16.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 shutdown_connections 2023-07-27T14:27:16.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005ed90 0x7f4ed0061250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec14b1e0 0x7f4eec0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:16.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec0c5c50 0x7f4eec13e780 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 --2- 172.21.15.115:0/3125394007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec14ae00 0x7f4eec0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:16.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.118+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 >> 172.21.15.115:0/3125394007 conn(0x7f4eec05e940 msgr2=0x7f4eec152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:16.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.119+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 shutdown_connections 2023-07-27T14:27:16.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.119+0000 7f4ef35ff700 1 -- 172.21.15.115:0/3125394007 wait complete. 2023-07-27T14:27:16.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:27:16.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.326+0000 7fba4ddff700 1 Processor -- start 2023-07-27T14:27:16.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.326+0000 7fba4ddff700 1 -- start start 2023-07-27T14:27:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba4ddff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fba48063260 0x7fba48154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba4ddff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fba4814b1e0 0x7fba480a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba4ddff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba481553f0 con 0x7fba4814ae00 2023-07-27T14:27:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba4ddff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba48157a50 con 0x7fba48063260 2023-07-27T14:27:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba4ddff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba48157d10 con 0x7fba4814b1e0 2023-07-27T14:27:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba46ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fba48063260 0x7fba48154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba46ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fba48063260 0x7fba48154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47508/0 (socket says 172.21.15.115:47508) 2023-07-27T14:27:16.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba46ffd700 1 -- 172.21.15.115:0/2193296636 learned_addr learned my addr 172.21.15.115:0/2193296636 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:16.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba47fff700 1 --2- 172.21.15.115:0/2193296636 >> v2:172.21.15.159:3300/0 conn(0x7fba4814b1e0 0x7fba480a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba46ffd700 1 -- 172.21.15.115:0/2193296636 >> v2:172.21.15.159:3300/0 conn(0x7fba4814b1e0 msgr2=0x7fba480a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:16.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba46ffd700 1 --2- 172.21.15.115:0/2193296636 >> v2:172.21.15.159:3300/0 conn(0x7fba4814b1e0 0x7fba480a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba46ffd700 1 -- 172.21.15.115:0/2193296636 >> v1:172.21.15.159:6789/0 conn(0x7fba4814ae00 legacy=0x7fba48062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.328+0000 7fba46ffd700 1 -- 172.21.15.115:0/2193296636 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48157ff0 con 0x7fba48063260 2023-07-27T14:27:16.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba46ffd700 1 --2- 172.21.15.115:0/2193296636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba48154f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fba48083430 tx=0x7fba3c0090f0).ready entity=mon.0 client_cookie=65ca5128f4052182 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:16.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba467fc700 1 -- 172.21.15.115:0/2193296636 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00b520 con 0x7fba48063260 2023-07-27T14:27:16.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba467fc700 1 -- 172.21.15.115:0/2193296636 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c00b680 con 0x7fba48063260 2023-07-27T14:27:16.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba467fc700 1 -- 172.21.15.115:0/2193296636 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00ba00 con 0x7fba48063260 2023-07-27T14:27:16.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba4ddff700 1 -- 172.21.15.115:0/2193296636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 msgr2=0x7fba48154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba4ddff700 1 --2- 172.21.15.115:0/2193296636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba48154f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fba48083430 tx=0x7fba3c0090f0).stop 2023-07-27T14:27:16.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba4ddff700 1 -- 172.21.15.115:0/2193296636 shutdown_connections 2023-07-27T14:27:16.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba4ddff700 1 --2- 172.21.15.115:0/2193296636 >> v2:172.21.15.159:3300/0 conn(0x7fba4814b1e0 0x7fba480a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba4ddff700 1 --2- 172.21.15.115:0/2193296636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba48154f00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba4ddff700 1 -- 172.21.15.115:0/2193296636 >> 172.21.15.115:0/2193296636 conn(0x7fba4805e940 msgr2=0x7fba480cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:16.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba4ddff700 1 -- 172.21.15.115:0/2193296636 shutdown_connections 2023-07-27T14:27:16.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.329+0000 7fba4ddff700 1 -- 172.21.15.115:0/2193296636 wait complete. 2023-07-27T14:27:16.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.331+0000 7fba4ddff700 1 Processor -- start 2023-07-27T14:27:16.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.331+0000 7fba4ddff700 1 -- start start 2023-07-27T14:27:16.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba4ddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba480c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba4ddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba4814ae00 0x7fba48152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba4ddff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4814b1e0 0x7fba480afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba4ddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba48164d80 con 0x7fba48063260 2023-07-27T14:27:16.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba4ddff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba480aec60 con 0x7fba4814b1e0 2023-07-27T14:27:16.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba4ddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba480aef40 con 0x7fba4814ae00 2023-07-27T14:27:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba480c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba480c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47510/0 (socket says 172.21.15.115:47510) 2023-07-27T14:27:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba477fe700 1 -- 172.21.15.115:0/3989495130 learned_addr learned my addr 172.21.15.115:0/3989495130 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba46ffd700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba4814ae00 0x7fba48152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.332+0000 7fba47fff700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4814b1e0 0x7fba480afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba477fe700 1 -- 172.21.15.115:0/3989495130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba4814ae00 msgr2=0x7fba48152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba477fe700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba4814ae00 0x7fba48152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba477fe700 1 -- 172.21.15.115:0/3989495130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4814b1e0 msgr2=0x7fba480afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba477fe700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4814b1e0 0x7fba480afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba477fe700 1 -- 172.21.15.115:0/3989495130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c009370 con 0x7fba48063260 2023-07-27T14:27:16.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba477fe700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba480c5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fba3800c4c0 tx=0x7fba38007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:16.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba2f7fe700 1 -- 172.21.15.115:0/3989495130 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800ce70 con 0x7fba48063260 2023-07-27T14:27:16.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba2f7fe700 1 -- 172.21.15.115:0/3989495130 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba38001e90 con 0x7fba48063260 2023-07-27T14:27:16.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba2f7fe700 1 -- 172.21.15.115:0/3989495130 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38007250 con 0x7fba48063260 2023-07-27T14:27:16.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba480af220 con 0x7fba48063260 2023-07-27T14:27:16.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.333+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba481496e0 con 0x7fba48063260 2023-07-27T14:27:16.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.334+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4806c470 con 0x7fba48063260 2023-07-27T14:27:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.335+0000 7fba2f7fe700 1 -- 172.21.15.115:0/3989495130 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fba38010070 con 0x7fba48063260 2023-07-27T14:27:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.336+0000 7fba2f7fe700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba3405ed90 0x7fba34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.336+0000 7fba2f7fe700 1 -- 172.21.15.115:0/3989495130 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fba38079360 con 0x7fba48063260 2023-07-27T14:27:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.336+0000 7fba46ffd700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba3405ed90 0x7fba34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.336+0000 7fba46ffd700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba3405ed90 0x7fba34061250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fba48063660 tx=0x7fba3c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:16.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.340+0000 7fba2f7fe700 1 -- 172.21.15.115:0/3989495130 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba3804a7f0 con 0x7fba48063260 2023-07-27T14:27:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.508+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba4806b9c0 con 0x7fba48063260 2023-07-27T14:27:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.508+0000 7fba2f7fe700 1 -- 172.21.15.115:0/3989495130 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba3804de10 con 0x7fba48063260 2023-07-27T14:27:16.522 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:16.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba3405ed90 msgr2=0x7fba34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba3405ed90 0x7fba34061250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fba48063660 tx=0x7fba3c017000).stop 2023-07-27T14:27:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 msgr2=0x7fba480c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba480c5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fba3800c4c0 tx=0x7fba38007e00).stop 2023-07-27T14:27:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 shutdown_connections 2023-07-27T14:27:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba3405ed90 0x7fba34061250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba4814b1e0 0x7fba480afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba48063260 0x7fba480c5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 --2- 172.21.15.115:0/3989495130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba4814ae00 0x7fba48152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.510+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 >> 172.21.15.115:0/3989495130 conn(0x7fba4805e940 msgr2=0x7fba481544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:16.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.511+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 shutdown_connections 2023-07-27T14:27:16.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.511+0000 7fba4ddff700 1 -- 172.21.15.115:0/3989495130 wait complete. 2023-07-27T14:27:16.541 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:27:16.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.720+0000 7f9de87ff700 1 Processor -- start 2023-07-27T14:27:16.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.720+0000 7f9de87ff700 1 -- start start 2023-07-27T14:27:16.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.721+0000 7f9de87ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c58d0 0x7f9de0150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.721+0000 7f9de87ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9de00c3100 0x7f9de00c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.721+0000 7f9de87ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de00c0ea0 con 0x7f9de01509b0 2023-07-27T14:27:16.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.721+0000 7f9de87ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de0068e10 con 0x7f9de00c3100 2023-07-27T14:27:16.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.721+0000 7f9de87ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0151280 con 0x7f9de00c58d0 2023-07-27T14:27:16.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de6d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9de00c3100 0x7f9de00c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de6d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9de00c3100 0x7f9de00c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47514/0 (socket says 172.21.15.115:47514) 2023-07-27T14:27:16.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de6d9c700 1 -- 172.21.15.115:0/3024701266 learned_addr learned my addr 172.21.15.115:0/3024701266 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:16.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de5d9a700 1 --2- 172.21.15.115:0/3024701266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c58d0 0x7f9de0150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de6d9c700 1 -- 172.21.15.115:0/3024701266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c58d0 msgr2=0x7f9de0150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:16.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de6d9c700 1 --2- 172.21.15.115:0/3024701266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c58d0 0x7f9de0150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de6d9c700 1 -- 172.21.15.115:0/3024701266 >> v1:172.21.15.159:6789/0 conn(0x7f9de01509b0 legacy=0x7f9de0154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de6d9c700 1 -- 172.21.15.115:0/3024701266 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de0155190 con 0x7f9de00c3100 2023-07-27T14:27:16.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de6d9c700 1 --2- 172.21.15.115:0/3024701266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de00c3100 0x7f9de00c3590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f9dd800d1a0 tx=0x7f9dd800ba50).ready entity=mon.0 client_cookie=a69fefe301ff38b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:16.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de5599700 1 -- 172.21.15.115:0/3024701266 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8010070 con 0x7f9de00c3100 2023-07-27T14:27:16.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de5599700 1 -- 172.21.15.115:0/3024701266 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd800de10 con 0x7f9de00c3100 2023-07-27T14:27:16.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.722+0000 7f9de5599700 1 -- 172.21.15.115:0/3024701266 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800b2e0 con 0x7f9de00c3100 2023-07-27T14:27:16.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.723+0000 7f9de87ff700 1 -- 172.21.15.115:0/3024701266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de00c3100 msgr2=0x7f9de00c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.723+0000 7f9de87ff700 1 --2- 172.21.15.115:0/3024701266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de00c3100 0x7f9de00c3590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f9dd800d1a0 tx=0x7f9dd800ba50).stop 2023-07-27T14:27:16.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.723+0000 7f9de87ff700 1 -- 172.21.15.115:0/3024701266 shutdown_connections 2023-07-27T14:27:16.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.723+0000 7f9de87ff700 1 --2- 172.21.15.115:0/3024701266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de00c3100 0x7f9de00c3590 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.723+0000 7f9de87ff700 1 --2- 172.21.15.115:0/3024701266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c58d0 0x7f9de0150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.723+0000 7f9de87ff700 1 -- 172.21.15.115:0/3024701266 >> 172.21.15.115:0/3024701266 conn(0x7f9de0062320 msgr2=0x7f9de0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:16.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.723+0000 7f9de87ff700 1 -- 172.21.15.115:0/3024701266 shutdown_connections 2023-07-27T14:27:16.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.723+0000 7f9de87ff700 1 -- 172.21.15.115:0/3024701266 wait complete. 2023-07-27T14:27:16.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.724+0000 7f9de87ff700 1 Processor -- start 2023-07-27T14:27:16.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.725+0000 7f9de87ff700 1 -- start start 2023-07-27T14:27:16.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de87ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c3100 0x7f9de00a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de87ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00c58d0 0x7f9de00a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de87ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de01509b0 0x7f9de00a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de87ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de014a500 con 0x7f9de01509b0 2023-07-27T14:27:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de87ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00a9c70 con 0x7f9de00c58d0 2023-07-27T14:27:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de87ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00a9f50 con 0x7f9de00c3100 2023-07-27T14:27:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de6d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de01509b0 0x7f9de00a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de6d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de01509b0 0x7f9de00a5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47522/0 (socket says 172.21.15.115:47522) 2023-07-27T14:27:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de6d9c700 1 -- 172.21.15.115:0/275831947 learned_addr learned my addr 172.21.15.115:0/275831947 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:16.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de659b700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c3100 0x7f9de00a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de5d9a700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00c58d0 0x7f9de00a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de6d9c700 1 -- 172.21.15.115:0/275831947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c3100 msgr2=0x7f9de00a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de6d9c700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c3100 0x7f9de00a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de6d9c700 1 -- 172.21.15.115:0/275831947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00c58d0 msgr2=0x7f9de00a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de6d9c700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00c58d0 0x7f9de00a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.726+0000 7f9de6d9c700 1 -- 172.21.15.115:0/275831947 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd800bcf0 con 0x7f9de01509b0 2023-07-27T14:27:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.727+0000 7f9de6d9c700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de01509b0 0x7f9de00a5930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9de00bd810 tx=0x7f9de0068f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.727+0000 7f9dd67fc700 1 -- 172.21.15.115:0/275831947 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800b0d0 con 0x7f9de01509b0 2023-07-27T14:27:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.727+0000 7f9dd67fc700 1 -- 172.21.15.115:0/275831947 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd800b230 con 0x7f9de01509b0 2023-07-27T14:27:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.727+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de00aa230 con 0x7f9de01509b0 2023-07-27T14:27:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.727+0000 7f9dd67fc700 1 -- 172.21.15.115:0/275831947 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8015630 con 0x7f9de01509b0 2023-07-27T14:27:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.727+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de00a5460 con 0x7f9de01509b0 2023-07-27T14:27:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.728+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de014a670 con 0x7f9de01509b0 2023-07-27T14:27:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.729+0000 7f9dd67fc700 1 -- 172.21.15.115:0/275831947 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9dd8025030 con 0x7f9de01509b0 2023-07-27T14:27:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.729+0000 7f9dd67fc700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9dc405ed90 0x7f9dc4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.730+0000 7f9dd67fc700 1 -- 172.21.15.115:0/275831947 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9dd807ad20 con 0x7f9de01509b0 2023-07-27T14:27:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.730+0000 7f9de659b700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9dc405ed90 0x7f9dc4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:16.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.730+0000 7f9de659b700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9dc405ed90 0x7f9dc4061250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9ddc003860 tx=0x7f9ddc007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:16.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.734+0000 7f9dd67fc700 1 -- 172.21.15.115:0/275831947 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9dd804c370 con 0x7f9de01509b0 2023-07-27T14:27:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.907+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9de006c470 con 0x7f9de01509b0 2023-07-27T14:27:16.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.908+0000 7f9dd67fc700 1 -- 172.21.15.115:0/275831947 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9dd8023070 con 0x7f9de01509b0 2023-07-27T14:27:16.921 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:16.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9dc405ed90 msgr2=0x7f9dc4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9dc405ed90 0x7f9dc4061250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9ddc003860 tx=0x7f9ddc007d40).stop 2023-07-27T14:27:16.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de01509b0 msgr2=0x7f9de00a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:16.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de01509b0 0x7f9de00a5930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9de00bd810 tx=0x7f9de0068f50).stop 2023-07-27T14:27:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 shutdown_connections 2023-07-27T14:27:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9dc405ed90 0x7f9dc4061250 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9de01509b0 0x7f9de00a5930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9de00c3100 0x7f9de00a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 --2- 172.21.15.115:0/275831947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9de00c58d0 0x7f9de00a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 >> 172.21.15.115:0/275831947 conn(0x7f9de0062320 msgr2=0x7f9de00692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 shutdown_connections 2023-07-27T14:27:16.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:16.910+0000 7f9de87ff700 1 -- 172.21.15.115:0/275831947 wait complete. 2023-07-27T14:27:16.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:27:17.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.114+0000 7f4ae15ff700 1 Processor -- start 2023-07-27T14:27:17.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.114+0000 7f4ae15ff700 1 -- start start 2023-07-27T14:27:17.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.115+0000 7f4ae15ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4adc1542a0 0x7f4adc15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.115+0000 7f4ae15ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc0aa4d0 con 0x7f4adc153ec0 2023-07-27T14:27:17.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.115+0000 7f4ae15ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc0c05c0 con 0x7f4adc0aaa40 2023-07-27T14:27:17.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.115+0000 7f4ae15ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc0c1a60 con 0x7f4adc1542a0 2023-07-27T14:27:17.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4adaffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4adc153ec0 0x7f4adc0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33604/0 (socket says 172.21.15.115:33604) 2023-07-27T14:27:17.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4adaffd700 1 -- 172.21.15.115:0/2589950525 learned_addr learned my addr 172.21.15.115:0/2589950525 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:17.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4adb7fe700 1 --2- 172.21.15.115:0/2589950525 >> v2:172.21.15.115:3300/0 conn(0x7f4adc1542a0 0x7f4adc15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4ad9ffb700 1 -- 172.21.15.115:0/2589950525 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635192751 0 0) 0x7f4acc001110 con 0x7f4adc153ec0 2023-07-27T14:27:17.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4ad9ffb700 1 -- 172.21.15.115:0/2589950525 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac40033f0 con 0x7f4adc153ec0 2023-07-27T14:27:17.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4adb7fe700 1 -- 172.21.15.115:0/2589950525 >> v1:172.21.15.159:6789/0 conn(0x7f4adc0aaa40 legacy=0x7f4adc0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4adb7fe700 1 -- 172.21.15.115:0/2589950525 >> v1:172.21.15.115:6789/0 conn(0x7f4adc153ec0 legacy=0x7f4adc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4adb7fe700 1 -- 172.21.15.115:0/2589950525 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc0aa270 con 0x7f4adc1542a0 2023-07-27T14:27:17.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4adb7fe700 1 --2- 172.21.15.115:0/2589950525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc15efc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f4ad4009e60 tx=0x7f4ad4009780).ready entity=mon.0 client_cookie=940a1546f3cfdeeb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.116+0000 7f4ad9ffb700 1 -- 172.21.15.115:0/2589950525 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400e070 con 0x7f4adc1542a0 2023-07-27T14:27:17.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ad9ffb700 1 -- 172.21.15.115:0/2589950525 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad400bb60 con 0x7f4adc1542a0 2023-07-27T14:27:17.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ad9ffb700 1 -- 172.21.15.115:0/2589950525 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4012410 con 0x7f4adc1542a0 2023-07-27T14:27:17.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ae15ff700 1 -- 172.21.15.115:0/2589950525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 msgr2=0x7f4adc15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ae15ff700 1 --2- 172.21.15.115:0/2589950525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc15efc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f4ad4009e60 tx=0x7f4ad4009780).stop 2023-07-27T14:27:17.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ae15ff700 1 -- 172.21.15.115:0/2589950525 shutdown_connections 2023-07-27T14:27:17.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ae15ff700 1 --2- 172.21.15.115:0/2589950525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc15efc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ae15ff700 1 -- 172.21.15.115:0/2589950525 >> 172.21.15.115:0/2589950525 conn(0x7f4adc0cb610 msgr2=0x7f4adc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:17.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ae15ff700 1 -- 172.21.15.115:0/2589950525 shutdown_connections 2023-07-27T14:27:17.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.117+0000 7f4ae15ff700 1 -- 172.21.15.115:0/2589950525 wait complete. 2023-07-27T14:27:17.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.119+0000 7f4ae15ff700 1 Processor -- start 2023-07-27T14:27:17.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.119+0000 7f4ae15ff700 1 -- start start 2023-07-27T14:27:17.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4ae15ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4adc0aaa40 0x7f4adc141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4ae15ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc153ec0 0x7f4adc0c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4ae15ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4ae15ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0c9d00 con 0x7f4adc1542a0 2023-07-27T14:27:17.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4ae15ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc164c10 con 0x7f4adc153ec0 2023-07-27T14:27:17.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4ae15ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc164300 con 0x7f4adc0aaa40 2023-07-27T14:27:17.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc0c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47534/0 (socket says 172.21.15.115:47534) 2023-07-27T14:27:17.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 -- 172.21.15.115:0/3532620257 learned_addr learned my addr 172.21.15.115:0/3532620257 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:17.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4ada7fc700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc153ec0 0x7f4adc0c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adaffd700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4adc0aaa40 0x7f4adc141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 -- 172.21.15.115:0/3532620257 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4adc0aaa40 msgr2=0x7f4adc141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4adc0aaa40 0x7f4adc141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 -- 172.21.15.115:0/3532620257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc153ec0 msgr2=0x7f4adc0c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc153ec0 0x7f4adc0c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 -- 172.21.15.115:0/3532620257 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad4009a20 con 0x7f4adc1542a0 2023-07-27T14:27:17.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.120+0000 7f4adb7fe700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc0c9810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f4ad4011000 tx=0x7f4adc0c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.121+0000 7f4ac2ffd700 1 -- 172.21.15.115:0/3532620257 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4012410 con 0x7f4adc1542a0 2023-07-27T14:27:17.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.121+0000 7f4ac2ffd700 1 -- 172.21.15.115:0/3532620257 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad401d630 con 0x7f4adc1542a0 2023-07-27T14:27:17.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.121+0000 7f4ac2ffd700 1 -- 172.21.15.115:0/3532620257 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad401d9d0 con 0x7f4adc1542a0 2023-07-27T14:27:17.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.121+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc0c1dd0 con 0x7f4adc1542a0 2023-07-27T14:27:17.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.121+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc1648a0 con 0x7f4adc1542a0 2023-07-27T14:27:17.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.122+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc164da0 con 0x7f4adc1542a0 2023-07-27T14:27:17.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.123+0000 7f4ac2ffd700 1 -- 172.21.15.115:0/3532620257 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ad401dd40 con 0x7f4adc1542a0 2023-07-27T14:27:17.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.124+0000 7f4ac2ffd700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac805ed90 0x7f4ac8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.124+0000 7f4ac2ffd700 1 -- 172.21.15.115:0/3532620257 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4ad407ba30 con 0x7f4adc1542a0 2023-07-27T14:27:17.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.124+0000 7f4adaffd700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac805ed90 0x7f4ac8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.124+0000 7f4adaffd700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac805ed90 0x7f4ac8061250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4acc001270 tx=0x7f4acc007a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.128+0000 7f4ac2ffd700 1 -- 172.21.15.115:0/3532620257 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ad404cec0 con 0x7f4adc1542a0 2023-07-27T14:27:17.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.343+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4adc06c470 con 0x7f4adc1542a0 2023-07-27T14:27:17.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.343+0000 7f4ac2ffd700 1 -- 172.21.15.115:0/3532620257 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4492 (secure 0 0 0) 0x7f4ad40504e0 con 0x7f4adc1542a0 2023-07-27T14:27:17.358 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:17.358 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:27:01.252698+0000","modified":"2023-07-27T14:27:04.264437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-07-27T14:27:17.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac805ed90 msgr2=0x7f4ac8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac805ed90 0x7f4ac8061250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4acc001270 tx=0x7f4acc007a70).stop 2023-07-27T14:27:17.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 msgr2=0x7f4adc0c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc0c9810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f4ad4011000 tx=0x7f4adc0c0530).stop 2023-07-27T14:27:17.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 shutdown_connections 2023-07-27T14:27:17.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac805ed90 0x7f4ac8061250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4adc1542a0 0x7f4adc0c9810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4adc0aaa40 0x7f4adc141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 --2- 172.21.15.115:0/3532620257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4adc153ec0 0x7f4adc0c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 >> 172.21.15.115:0/3532620257 conn(0x7f4adc0cb610 msgr2=0x7f4adc0afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:17.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 shutdown_connections 2023-07-27T14:27:17.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.346+0000 7f4ae15ff700 1 -- 172.21.15.115:0/3532620257 wait complete. 2023-07-27T14:27:17.363 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 7 2023-07-27T14:27:17.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:17.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.552+0000 7ffaa93ff700 1 Processor -- start 2023-07-27T14:27:17.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.552+0000 7ffaa93ff700 1 -- start start 2023-07-27T14:27:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.553+0000 7ffaa93ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffaa40aaa40 0x7ffaa40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.553+0000 7ffaa93ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffaa41542a0 0x7ffaa40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.553+0000 7ffaa93ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40aa4d0 con 0x7ffaa4153ec0 2023-07-27T14:27:17.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.553+0000 7ffaa93ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa4064ad0 con 0x7ffaa40aaa40 2023-07-27T14:27:17.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.553+0000 7ffaa93ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40c05c0 con 0x7ffaa41542a0 2023-07-27T14:27:17.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa27fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffaa40aaa40 0x7ffaa40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa27fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffaa40aaa40 0x7ffaa40640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47550/0 (socket says 172.21.15.115:47550) 2023-07-27T14:27:17.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa27fc700 1 -- 172.21.15.115:0/3932959530 learned_addr learned my addr 172.21.15.115:0/3932959530 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:17.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa37fe700 1 --2- 172.21.15.115:0/3932959530 >> v2:172.21.15.159:3300/0 conn(0x7ffaa41542a0 0x7ffaa40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa27fc700 1 -- 172.21.15.115:0/3932959530 >> v2:172.21.15.159:3300/0 conn(0x7ffaa41542a0 msgr2=0x7ffaa40645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa27fc700 1 --2- 172.21.15.115:0/3932959530 >> v2:172.21.15.159:3300/0 conn(0x7ffaa41542a0 0x7ffaa40645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa27fc700 1 -- 172.21.15.115:0/3932959530 >> v1:172.21.15.159:6789/0 conn(0x7ffaa4153ec0 legacy=0x7ffaa40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa27fc700 1 -- 172.21.15.115:0/3932959530 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40c1a60 con 0x7ffaa40aaa40 2023-07-27T14:27:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.554+0000 7ffaa27fc700 1 --2- 172.21.15.115:0/3932959530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa40aaa40 0x7ffaa40640f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ffaa40c5470 tx=0x7ffa980090f0).ready entity=mon.0 client_cookie=2b62e8a5a7a4a024 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa1ffb700 1 -- 172.21.15.115:0/3932959530 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800b520 con 0x7ffaa40aaa40 2023-07-27T14:27:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa1ffb700 1 -- 172.21.15.115:0/3932959530 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9800b680 con 0x7ffaa40aaa40 2023-07-27T14:27:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa1ffb700 1 -- 172.21.15.115:0/3932959530 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800ba00 con 0x7ffaa40aaa40 2023-07-27T14:27:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa93ff700 1 -- 172.21.15.115:0/3932959530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa40aaa40 msgr2=0x7ffaa40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/3932959530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa40aaa40 0x7ffaa40640f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ffaa40c5470 tx=0x7ffa980090f0).stop 2023-07-27T14:27:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa93ff700 1 -- 172.21.15.115:0/3932959530 shutdown_connections 2023-07-27T14:27:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/3932959530 >> v2:172.21.15.159:3300/0 conn(0x7ffaa41542a0 0x7ffaa40645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/3932959530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa40aaa40 0x7ffaa40640f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa93ff700 1 -- 172.21.15.115:0/3932959530 >> 172.21.15.115:0/3932959530 conn(0x7ffaa40cb610 msgr2=0x7ffaa40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa93ff700 1 -- 172.21.15.115:0/3932959530 shutdown_connections 2023-07-27T14:27:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.555+0000 7ffaa93ff700 1 -- 172.21.15.115:0/3932959530 wait complete. 2023-07-27T14:27:17.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.557+0000 7ffaa93ff700 1 Processor -- start 2023-07-27T14:27:17.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.557+0000 7ffaa93ff700 1 -- start start 2023-07-27T14:27:17.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa93ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffaa40aaa40 0x7ffaa4141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa93ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaa4153ec0 0x7ffaa40c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa93ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa41542a0 0x7ffaa40ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa93ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa414da20 con 0x7ffaa41542a0 2023-07-27T14:27:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa93ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4141d60 con 0x7ffaa4153ec0 2023-07-27T14:27:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa93ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa414ef60 con 0x7ffaa40aaa40 2023-07-27T14:27:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa41542a0 0x7ffaa40ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa41542a0 0x7ffaa40ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47562/0 (socket says 172.21.15.115:47562) 2023-07-27T14:27:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 -- 172.21.15.115:0/1194944073 learned_addr learned my addr 172.21.15.115:0/1194944073 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 -- 172.21.15.115:0/1194944073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffaa40aaa40 msgr2=0x7ffaa4141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffaa40aaa40 0x7ffaa4141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa27fc700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaa4153ec0 0x7ffaa40c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 -- 172.21.15.115:0/1194944073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaa4153ec0 msgr2=0x7ffaa40c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaa4153ec0 0x7ffaa40c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 -- 172.21.15.115:0/1194944073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009370 con 0x7ffaa41542a0 2023-07-27T14:27:17.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa27fc700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaa4153ec0 0x7ffaa40c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:17.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.558+0000 7ffaa37fe700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa41542a0 0x7ffaa40ab340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ffa9c009d70 tx=0x7ffa9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.559+0000 7ffa8affd700 1 -- 172.21.15.115:0/1194944073 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00caf0 con 0x7ffaa41542a0 2023-07-27T14:27:17.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.559+0000 7ffa8affd700 1 -- 172.21.15.115:0/1194944073 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00f040 con 0x7ffaa41542a0 2023-07-27T14:27:17.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.559+0000 7ffa8affd700 1 -- 172.21.15.115:0/1194944073 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00ce60 con 0x7ffaa41542a0 2023-07-27T14:27:17.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.559+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa414e350 con 0x7ffaa41542a0 2023-07-27T14:27:17.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.559+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa414e910 con 0x7ffaa41542a0 2023-07-27T14:27:17.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.560+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa406c470 con 0x7ffaa41542a0 2023-07-27T14:27:17.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.561+0000 7ffa8affd700 1 -- 172.21.15.115:0/1194944073 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ffa9c013610 con 0x7ffaa41542a0 2023-07-27T14:27:17.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.562+0000 7ffa8affd700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa9005ed90 0x7ffa90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.562+0000 7ffa8affd700 1 -- 172.21.15.115:0/1194944073 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffa9c07a560 con 0x7ffaa41542a0 2023-07-27T14:27:17.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.562+0000 7ffaa2ffd700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa9005ed90 0x7ffa90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.562+0000 7ffaa2ffd700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa9005ed90 0x7ffa90061250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ffa94007fd0 tx=0x7ffa94007930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.566+0000 7ffa8affd700 1 -- 172.21.15.115:0/1194944073 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa9c04b9f0 con 0x7ffaa41542a0 2023-07-27T14:27:17.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.736+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaa40c8230 con 0x7ffaa41542a0 2023-07-27T14:27:17.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.737+0000 7ffa8affd700 1 -- 172.21.15.115:0/1194944073 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7ffa9c04f010 con 0x7ffaa41542a0 2023-07-27T14:27:17.750 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:17.750 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:17.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.738+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa9005ed90 msgr2=0x7ffa90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.738+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa9005ed90 0x7ffa90061250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ffa94007fd0 tx=0x7ffa94007930).stop 2023-07-27T14:27:17.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa41542a0 msgr2=0x7ffaa40ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa41542a0 0x7ffaa40ab340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ffa9c009d70 tx=0x7ffa9c00b040).stop 2023-07-27T14:27:17.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 shutdown_connections 2023-07-27T14:27:17.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa9005ed90 0x7ffa90061250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa41542a0 0x7ffaa40ab340 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffaa40aaa40 0x7ffaa4141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:17.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 --2- 172.21.15.115:0/1194944073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffaa4153ec0 0x7ffaa40c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 >> 172.21.15.115:0/1194944073 conn(0x7ffaa40cb610 msgr2=0x7ffaa40c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:17.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 shutdown_connections 2023-07-27T14:27:17.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.739+0000 7ffaa93ff700 1 -- 172.21.15.115:0/1194944073 wait complete. 2023-07-27T14:27:17.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:26:59.286583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:27:00.228329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:27:17.770 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:27:17.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.948+0000 7f84fdbff700 1 Processor -- start 2023-07-27T14:27:17.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.948+0000 7f84fdbff700 1 -- start start 2023-07-27T14:27:17.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.949+0000 7f84fdbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84f813a350 0x7f84f8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.949+0000 7f84fdbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f84f813a730 0x7f84f81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.949+0000 7f84fdbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f80bd9a0 con 0x7f84f80c2fa0 2023-07-27T14:27:17.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.949+0000 7f84fdbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f8066400 con 0x7f84f813a350 2023-07-27T14:27:17.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.949+0000 7f84fdbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f8158ae0 con 0x7f84f813a730 2023-07-27T14:27:17.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.949+0000 7f84f77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84f813a350 0x7f84f8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.949+0000 7f84f7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f84f80c2fa0 0x7f84f8067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33610/0 (socket says 172.21.15.115:33610) 2023-07-27T14:27:17.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f7fff700 1 -- 172.21.15.115:0/1634368219 learned_addr learned my addr 172.21.15.115:0/1634368219 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:17.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f6ffd700 1 --2- 172.21.15.115:0/1634368219 >> v2:172.21.15.159:3300/0 conn(0x7f84f813a730 0x7f84f81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f77fe700 1 -- 172.21.15.115:0/1634368219 >> v2:172.21.15.159:3300/0 conn(0x7f84f813a730 msgr2=0x7f84f81585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:17.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f77fe700 1 --2- 172.21.15.115:0/1634368219 >> v2:172.21.15.159:3300/0 conn(0x7f84f813a730 0x7f84f81585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f77fe700 1 -- 172.21.15.115:0/1634368219 >> v1:172.21.15.115:6789/0 conn(0x7f84f80c2fa0 legacy=0x7f84f8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f77fe700 1 -- 172.21.15.115:0/1634368219 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f8066610 con 0x7f84f813a350 2023-07-27T14:27:17.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f67fc700 1 -- 172.21.15.115:0/1634368219 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735291179 0 0) 0x7f84f80bd9a0 con 0x7f84f80c2fa0 2023-07-27T14:27:17.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f6ffd700 1 --2- 172.21.15.115:0/1634368219 >> v2:172.21.15.159:3300/0 conn(0x7f84f813a730 0x7f84f81585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:17.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f77fe700 1 --2- 172.21.15.115:0/1634368219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8065f10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f84f8069070 tx=0x7f84e8009060).ready entity=mon.0 client_cookie=3d18ee826b427b31 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f67fc700 1 -- 172.21.15.115:0/1634368219 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e800b580 con 0x7f84f813a350 2023-07-27T14:27:17.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f67fc700 1 -- 172.21.15.115:0/1634368219 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e800b6e0 con 0x7f84f813a350 2023-07-27T14:27:17.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.950+0000 7f84f67fc700 1 -- 172.21.15.115:0/1634368219 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e800ba60 con 0x7f84f813a350 2023-07-27T14:27:17.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.951+0000 7f84fdbff700 1 -- 172.21.15.115:0/1634368219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 msgr2=0x7f84f8065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.951+0000 7f84fdbff700 1 --2- 172.21.15.115:0/1634368219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8065f10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f84f8069070 tx=0x7f84e8009060).stop 2023-07-27T14:27:17.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.951+0000 7f84fdbff700 1 -- 172.21.15.115:0/1634368219 shutdown_connections 2023-07-27T14:27:17.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.951+0000 7f84fdbff700 1 --2- 172.21.15.115:0/1634368219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8065f10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.951+0000 7f84fdbff700 1 --2- 172.21.15.115:0/1634368219 >> v2:172.21.15.159:3300/0 conn(0x7f84f813a730 0x7f84f81585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:17.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.951+0000 7f84fdbff700 1 -- 172.21.15.115:0/1634368219 >> 172.21.15.115:0/1634368219 conn(0x7f84f805e8f0 msgr2=0x7f84f80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:17.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.951+0000 7f84fdbff700 1 -- 172.21.15.115:0/1634368219 shutdown_connections 2023-07-27T14:27:17.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.951+0000 7f84fdbff700 1 -- 172.21.15.115:0/1634368219 wait complete. 2023-07-27T14:27:17.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.952+0000 7f84fdbff700 1 Processor -- start 2023-07-27T14:27:17.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.953+0000 7f84fdbff700 1 -- start start 2023-07-27T14:27:17.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84fdbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f80c2fa0 0x7f84f80c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84fdbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84fdbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f813a730 0x7f84f80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84fdbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80aa8e0 con 0x7f84f813a350 2023-07-27T14:27:17.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84fdbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8153310 con 0x7f84f80c2fa0 2023-07-27T14:27:17.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84fdbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80aa590 con 0x7f84f813a730 2023-07-27T14:27:17.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47580/0 (socket says 172.21.15.115:47580) 2023-07-27T14:27:17.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 -- 172.21.15.115:0/3035640746 learned_addr learned my addr 172.21.15.115:0/3035640746 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:17.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 -- 172.21.15.115:0/3035640746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f813a730 msgr2=0x7f84f80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f813a730 0x7f84f80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:17.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 -- 172.21.15.115:0/3035640746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f80c2fa0 msgr2=0x7f84f80c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:17.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f80c2fa0 0x7f84f80c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:17.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 -- 172.21.15.115:0/3035640746 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80092a0 con 0x7f84f813a350 2023-07-27T14:27:17.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.954+0000 7f84f6ffd700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8152e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f84ec00c8b0 tx=0x7f84ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.955+0000 7f84df7fe700 1 -- 172.21.15.115:0/3035640746 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec010580 con 0x7f84f813a350 2023-07-27T14:27:17.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.955+0000 7f84df7fe700 1 -- 172.21.15.115:0/3035640746 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec0106e0 con 0x7f84f813a350 2023-07-27T14:27:17.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.955+0000 7f84df7fe700 1 -- 172.21.15.115:0/3035640746 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec010a60 con 0x7f84f813a350 2023-07-27T14:27:17.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.955+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f80a9980 con 0x7f84f813a350 2023-07-27T14:27:17.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.955+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f80a9f40 con 0x7f84f813a350 2023-07-27T14:27:17.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.956+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f806c470 con 0x7f84f813a350 2023-07-27T14:27:17.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.957+0000 7f84df7fe700 1 -- 172.21.15.115:0/3035640746 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f84ec01b460 con 0x7f84f813a350 2023-07-27T14:27:17.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.957+0000 7f84df7fe700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84e405ed90 0x7f84e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:17.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.957+0000 7f84df7fe700 1 -- 172.21.15.115:0/3035640746 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f84ec079d20 con 0x7f84f813a350 2023-07-27T14:27:17.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.958+0000 7f84f77fe700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84e405ed90 0x7f84e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:17.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.958+0000 7f84f77fe700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84e405ed90 0x7f84e4061250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f84e800b340 tx=0x7f84e8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:17.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:17.961+0000 7f84df7fe700 1 -- 172.21.15.115:0/3035640746 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84ec04b150 con 0x7f84f813a350 2023-07-27T14:27:18.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.127+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f84f80aa6d0 con 0x7f84f813a350 2023-07-27T14:27:18.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.128+0000 7f84df7fe700 1 -- 172.21.15.115:0/3035640746 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f84ec04e770 con 0x7f84f813a350 2023-07-27T14:27:18.141 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:27:18.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84e405ed90 msgr2=0x7f84e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84e405ed90 0x7f84e4061250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f84e800b340 tx=0x7f84e8017000).stop 2023-07-27T14:27:18.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 msgr2=0x7f84f8152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8152e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f84ec00c8b0 tx=0x7f84ec008040).stop 2023-07-27T14:27:18.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 shutdown_connections 2023-07-27T14:27:18.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f84e405ed90 0x7f84e4061250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f813a730 0x7f84f80abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:18.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f80c2fa0 0x7f84f80c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:18.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 --2- 172.21.15.115:0/3035640746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f813a350 0x7f84f8152e20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 >> 172.21.15.115:0/3035640746 conn(0x7f84f805e8f0 msgr2=0x7f84f8064ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:18.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 shutdown_connections 2023-07-27T14:27:18.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.130+0000 7f84fdbff700 1 -- 172.21.15.115:0/3035640746 wait complete. 2023-07-27T14:27:18.161 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:27:18.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.339+0000 7f83fb5ff700 1 Processor -- start 2023-07-27T14:27:18.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.339+0000 7f83fb5ff700 1 -- start start 2023-07-27T14:27:18.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.340+0000 7f83fb5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f4063260 0x7f83f4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.340+0000 7f83fb5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f83f414b1e0 0x7f83f40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.340+0000 7f83fb5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f41553f0 con 0x7f83f414ae00 2023-07-27T14:27:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.340+0000 7f83fb5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f4157a50 con 0x7f83f414b1e0 2023-07-27T14:27:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.340+0000 7f83fb5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4157d10 con 0x7f83f4063260 2023-07-27T14:27:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.340+0000 7f83f9b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f83f414b1e0 0x7f83f40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.340+0000 7f83f939b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f83f414ae00 0x7f83f4062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33618/0 (socket says 172.21.15.115:33618) 2023-07-27T14:27:18.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.340+0000 7f83f939b700 1 -- 172.21.15.115:0/1498452028 learned_addr learned my addr 172.21.15.115:0/1498452028 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:18.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83f8b9a700 1 --2- 172.21.15.115:0/1498452028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f4063260 0x7f83f4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83f9b9c700 1 -- 172.21.15.115:0/1498452028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f4063260 msgr2=0x7f83f4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:18.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83f9b9c700 1 --2- 172.21.15.115:0/1498452028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f4063260 0x7f83f4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83f9b9c700 1 -- 172.21.15.115:0/1498452028 >> v1:172.21.15.115:6789/0 conn(0x7f83f414ae00 legacy=0x7f83f4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83f9b9c700 1 -- 172.21.15.115:0/1498452028 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4157ff0 con 0x7f83f414b1e0 2023-07-27T14:27:18.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83ebfff700 1 -- 172.21.15.115:0/1498452028 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798778786 0 0) 0x7f83f41553f0 con 0x7f83f414ae00 2023-07-27T14:27:18.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83f9b9c700 1 --2- 172.21.15.115:0/1498452028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f40a98c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f83ec009e60 tx=0x7f83ec009780).ready entity=mon.0 client_cookie=f1be52a24550d4a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:18.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83ebfff700 1 -- 172.21.15.115:0/1498452028 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00e070 con 0x7f83f414b1e0 2023-07-27T14:27:18.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83ebfff700 1 -- 172.21.15.115:0/1498452028 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00bc30 con 0x7f83f414b1e0 2023-07-27T14:27:18.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.341+0000 7f83ebfff700 1 -- 172.21.15.115:0/1498452028 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec012410 con 0x7f83f414b1e0 2023-07-27T14:27:18.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.342+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1498452028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 msgr2=0x7f83f40a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.342+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1498452028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f40a98c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f83ec009e60 tx=0x7f83ec009780).stop 2023-07-27T14:27:18.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.342+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1498452028 shutdown_connections 2023-07-27T14:27:18.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.342+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1498452028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f40a98c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.342+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1498452028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f4063260 0x7f83f4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.342+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1498452028 >> 172.21.15.115:0/1498452028 conn(0x7f83f405e940 msgr2=0x7f83f40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:18.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.342+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1498452028 shutdown_connections 2023-07-27T14:27:18.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.342+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1498452028 wait complete. 2023-07-27T14:27:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.343+0000 7f83fb5ff700 1 Processor -- start 2023-07-27T14:27:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.344+0000 7f83fb5ff700 1 -- start start 2023-07-27T14:27:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.344+0000 7f83fb5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83f4063260 0x7f83f40ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.344+0000 7f83fb5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f414ae00 0x7f83f4164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83fb5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83fb5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40ac540 con 0x7f83f414b1e0 2023-07-27T14:27:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83fb5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4164780 con 0x7f83f4063260 2023-07-27T14:27:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83fb5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40aafb0 con 0x7f83f414ae00 2023-07-27T14:27:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f414a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47594/0 (socket says 172.21.15.115:47594) 2023-07-27T14:27:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 -- 172.21.15.115:0/1028621446 learned_addr learned my addr 172.21.15.115:0/1028621446 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f8b9a700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f414ae00 0x7f83f4164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f939b700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83f4063260 0x7f83f40ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 -- 172.21.15.115:0/1028621446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f414ae00 msgr2=0x7f83f4164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f414ae00 0x7f83f4164290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 -- 172.21.15.115:0/1028621446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83f4063260 msgr2=0x7f83f40ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83f4063260 0x7f83f40ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 -- 172.21.15.115:0/1028621446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009a20 con 0x7f83f414b1e0 2023-07-27T14:27:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83f9b9c700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f414a4e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f83ec00b6c0 tx=0x7f83ec009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83e97fa700 1 -- 172.21.15.115:0/1028621446 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec011750 con 0x7f83f414b1e0 2023-07-27T14:27:18.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83e97fa700 1 -- 172.21.15.115:0/1028621446 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec0118d0 con 0x7f83f414b1e0 2023-07-27T14:27:18.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.345+0000 7f83e97fa700 1 -- 172.21.15.115:0/1028621446 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec011c90 con 0x7f83f414b1e0 2023-07-27T14:27:18.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.346+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f40ab290 con 0x7f83f414b1e0 2023-07-27T14:27:18.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.346+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f40ab850 con 0x7f83f414b1e0 2023-07-27T14:27:18.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.347+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f40abea0 con 0x7f83f414b1e0 2023-07-27T14:27:18.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.347+0000 7f83e97fa700 1 -- 172.21.15.115:0/1028621446 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f83ec01d630 con 0x7f83f414b1e0 2023-07-27T14:27:18.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.348+0000 7f83e97fa700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83d805ed90 0x7f83d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.348+0000 7f83e97fa700 1 -- 172.21.15.115:0/1028621446 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f83ec07bf30 con 0x7f83f414b1e0 2023-07-27T14:27:18.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.349+0000 7f83f939b700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83d805ed90 0x7f83d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.349+0000 7f83f939b700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83d805ed90 0x7f83d8061250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f83f40acd80 tx=0x7f83f0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:18.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.352+0000 7f83e97fa700 1 -- 172.21.15.115:0/1028621446 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83ec04d3c0 con 0x7f83f414b1e0 2023-07-27T14:27:18.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.519+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83f406c470 con 0x7f83f414b1e0 2023-07-27T14:27:18.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.520+0000 7f83e97fa700 1 -- 172.21.15.115:0/1028621446 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83ec0509e0 con 0x7f83f414b1e0 2023-07-27T14:27:18.533 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:27:18.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83d805ed90 msgr2=0x7f83d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83d805ed90 0x7f83d8061250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f83f40acd80 tx=0x7f83f0009040).stop 2023-07-27T14:27:18.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 msgr2=0x7f83f414a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f414a4e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f83ec00b6c0 tx=0x7f83ec009780).stop 2023-07-27T14:27:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 shutdown_connections 2023-07-27T14:27:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83d805ed90 0x7f83d8061250 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f414b1e0 0x7f83f414a4e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83f4063260 0x7f83f40ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 --2- 172.21.15.115:0/1028621446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83f414ae00 0x7f83f4164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 >> 172.21.15.115:0/1028621446 conn(0x7f83f405e940 msgr2=0x7f83f4152330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:18.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 shutdown_connections 2023-07-27T14:27:18.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.522+0000 7f83fb5ff700 1 -- 172.21.15.115:0/1028621446 wait complete. 2023-07-27T14:27:18.552 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:27:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.730+0000 7f7ddf7ff700 1 Processor -- start 2023-07-27T14:27:18.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.730+0000 7f7ddf7ff700 1 -- start start 2023-07-27T14:27:18.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.731+0000 7f7ddf7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7dd814ae00 0x7f7dd8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.731+0000 7f7ddf7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd81553f0 con 0x7f7dd8063260 2023-07-27T14:27:18.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.731+0000 7f7ddf7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd8157a50 con 0x7f7dd814b1e0 2023-07-27T14:27:18.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.731+0000 7f7ddf7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd8157d10 con 0x7f7dd814ae00 2023-07-27T14:27:18.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7dddd9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7dd8063260 0x7f7dd80a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33622/0 (socket says 172.21.15.115:33622) 2023-07-27T14:27:18.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7dddd9c700 1 -- 172.21.15.115:0/2117551416 learned_addr learned my addr 172.21.15.115:0/2117551416 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:18.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7ddd59b700 1 --2- 172.21.15.115:0/2117551416 >> v2:172.21.15.115:3300/0 conn(0x7f7dd814ae00 0x7f7dd8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7dcffff700 1 -- 172.21.15.115:0/2117551416 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266218772 0 0) 0x7f7dd81553f0 con 0x7f7dd8063260 2023-07-27T14:27:18.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7dcffff700 1 -- 172.21.15.115:0/2117551416 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc40033f0 con 0x7f7dd8063260 2023-07-27T14:27:18.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7ddd59b700 1 -- 172.21.15.115:0/2117551416 >> v1:172.21.15.159:6789/0 conn(0x7f7dd814b1e0 legacy=0x7f7dd8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7ddd59b700 1 -- 172.21.15.115:0/2117551416 >> v1:172.21.15.115:6789/0 conn(0x7f7dd8063260 legacy=0x7f7dd80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7ddd59b700 1 -- 172.21.15.115:0/2117551416 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8157ff0 con 0x7f7dd814ae00 2023-07-27T14:27:18.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7ddd59b700 1 --2- 172.21.15.115:0/2117551416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd8154f00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f7dd4009760 tx=0x7f7dd4009060).ready entity=mon.0 client_cookie=721ed7f2c56d828c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:18.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7dcffff700 1 -- 172.21.15.115:0/2117551416 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400f510 con 0x7f7dd814ae00 2023-07-27T14:27:18.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7dcffff700 1 -- 172.21.15.115:0/2117551416 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd400f670 con 0x7f7dd814ae00 2023-07-27T14:27:18.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.732+0000 7f7dcffff700 1 -- 172.21.15.115:0/2117551416 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400f9f0 con 0x7f7dd814ae00 2023-07-27T14:27:18.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.733+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/2117551416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 msgr2=0x7f7dd8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.733+0000 7f7ddf7ff700 1 --2- 172.21.15.115:0/2117551416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd8154f00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f7dd4009760 tx=0x7f7dd4009060).stop 2023-07-27T14:27:18.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.733+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/2117551416 shutdown_connections 2023-07-27T14:27:18.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.733+0000 7f7ddf7ff700 1 --2- 172.21.15.115:0/2117551416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd8154f00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.733+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/2117551416 >> 172.21.15.115:0/2117551416 conn(0x7f7dd805e940 msgr2=0x7f7dd80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:18.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.733+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/2117551416 shutdown_connections 2023-07-27T14:27:18.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.733+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/2117551416 wait complete. 2023-07-27T14:27:18.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.734+0000 7f7ddf7ff700 1 Processor -- start 2023-07-27T14:27:18.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.735+0000 7f7ddf7ff700 1 -- start start 2023-07-27T14:27:18.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddf7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dd8063260 0x7f7dd80ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddf7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd814e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddf7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7dd814b1e0 0x7f7dd814a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddf7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80c4b50 con 0x7f7dd814ae00 2023-07-27T14:27:18.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddf7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80c9350 con 0x7f7dd8063260 2023-07-27T14:27:18.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddf7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80c9630 con 0x7f7dd814b1e0 2023-07-27T14:27:18.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd814e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd814e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47604/0 (socket says 172.21.15.115:47604) 2023-07-27T14:27:18.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 -- 172.21.15.115:0/800483829 learned_addr learned my addr 172.21.15.115:0/800483829 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:18.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddd59b700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dd8063260 0x7f7dd80ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7dddd9c700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7dd814b1e0 0x7f7dd814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 -- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7dd814b1e0 msgr2=0x7f7dd814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7dd814b1e0 0x7f7dd814a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 -- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dd8063260 msgr2=0x7f7dd80ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dd8063260 0x7f7dd80ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 -- 172.21.15.115:0/800483829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40092a0 con 0x7f7dd814ae00 2023-07-27T14:27:18.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddd59b700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dd8063260 0x7f7dd80ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:18.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.736+0000 7f7ddcd9a700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd814e140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f7dc800c4c0 tx=0x7f7dc8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:18.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.737+0000 7f7dcd7fa700 1 -- 172.21.15.115:0/800483829 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8007020 con 0x7f7dd814ae00 2023-07-27T14:27:18.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.737+0000 7f7dcd7fa700 1 -- 172.21.15.115:0/800483829 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8007180 con 0x7f7dd814ae00 2023-07-27T14:27:18.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.737+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd80c9910 con 0x7f7dd814ae00 2023-07-27T14:27:18.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.737+0000 7f7dcd7fa700 1 -- 172.21.15.115:0/800483829 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8007520 con 0x7f7dd814ae00 2023-07-27T14:27:18.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.737+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd80c9ed0 con 0x7f7dd814ae00 2023-07-27T14:27:18.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.738+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd806c470 con 0x7f7dd814ae00 2023-07-27T14:27:18.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.739+0000 7f7dcd7fa700 1 -- 172.21.15.115:0/800483829 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7dc8010070 con 0x7f7dd814ae00 2023-07-27T14:27:18.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.740+0000 7f7dcd7fa700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dbc05ed90 0x7f7dbc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:18.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.740+0000 7f7dcd7fa700 1 -- 172.21.15.115:0/800483829 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7dc8078eb0 con 0x7f7dd814ae00 2023-07-27T14:27:18.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.740+0000 7f7ddd59b700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dbc05ed90 0x7f7dbc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:18.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.740+0000 7f7ddd59b700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dbc05ed90 0x7f7dbc061250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7dd81676b0 tx=0x7f7dd4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:18.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.743+0000 7f7dcd7fa700 1 -- 172.21.15.115:0/800483829 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7dc80478f0 con 0x7f7dd814ae00 2023-07-27T14:27:18.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.911+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7dd80c1080 con 0x7f7dd814ae00 2023-07-27T14:27:18.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.912+0000 7f7dcd7fa700 1 -- 172.21.15.115:0/800483829 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7dc804a340 con 0x7f7dd814ae00 2023-07-27T14:27:18.926 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:18.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dbc05ed90 msgr2=0x7f7dbc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dbc05ed90 0x7f7dbc061250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7dd81676b0 tx=0x7f7dd4017000).stop 2023-07-27T14:27:18.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 msgr2=0x7f7dd814e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:18.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd814e140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f7dc800c4c0 tx=0x7f7dc8007dd0).stop 2023-07-27T14:27:18.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 shutdown_connections 2023-07-27T14:27:18.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7dbc05ed90 0x7f7dbc061250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7dd814b1e0 0x7f7dd814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dd8063260 0x7f7dd80ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 --2- 172.21.15.115:0/800483829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7dd814ae00 0x7f7dd814e140 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:18.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 >> 172.21.15.115:0/800483829 conn(0x7f7dd805e940 msgr2=0x7f7dd80c08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:18.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.914+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 shutdown_connections 2023-07-27T14:27:18.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:18.915+0000 7f7ddf7ff700 1 -- 172.21.15.115:0/800483829 wait complete. 2023-07-27T14:27:18.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:27:19.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.124+0000 7f20f23ff700 1 Processor -- start 2023-07-27T14:27:19.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.124+0000 7f20f23ff700 1 -- start start 2023-07-27T14:27:19.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.125+0000 7f20f23ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20ec063260 0x7f20ec154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.125+0000 7f20f23ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec1553f0 con 0x7f20ec14ae00 2023-07-27T14:27:19.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.125+0000 7f20f23ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec157a50 con 0x7f20ec14b1e0 2023-07-27T14:27:19.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.125+0000 7f20f23ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec157d10 con 0x7f20ec063260 2023-07-27T14:27:19.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20ebfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f20ec14ae00 0x7f20ec062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33632/0 (socket says 172.21.15.115:33632) 2023-07-27T14:27:19.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20ebfff700 1 -- 172.21.15.115:0/2083304055 learned_addr learned my addr 172.21.15.115:0/2083304055 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:19.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eb7fe700 1 --2- 172.21.15.115:0/2083304055 >> v2:172.21.15.115:3300/0 conn(0x7f20ec063260 0x7f20ec154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eaffd700 1 -- 172.21.15.115:0/2083304055 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785733672 0 0) 0x7f20ec1553f0 con 0x7f20ec14ae00 2023-07-27T14:27:19.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eaffd700 1 -- 172.21.15.115:0/2083304055 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d40033f0 con 0x7f20ec14ae00 2023-07-27T14:27:19.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eb7fe700 1 -- 172.21.15.115:0/2083304055 >> v1:172.21.15.159:6789/0 conn(0x7f20ec14b1e0 legacy=0x7f20ec0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eaffd700 1 -- 172.21.15.115:0/2083304055 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800307185 0 0) 0x7f20ec157a50 con 0x7f20ec14b1e0 2023-07-27T14:27:19.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eb7fe700 1 -- 172.21.15.115:0/2083304055 >> v1:172.21.15.115:6789/0 conn(0x7f20ec14ae00 legacy=0x7f20ec062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eb7fe700 1 -- 172.21.15.115:0/2083304055 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec157ff0 con 0x7f20ec063260 2023-07-27T14:27:19.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eb7fe700 1 --2- 172.21.15.115:0/2083304055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec063260 0x7f20ec154f00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f20e0009760 tx=0x7f20e0009060).ready entity=mon.0 client_cookie=b102d8f31fd9d200 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.126+0000 7f20eaffd700 1 -- 172.21.15.115:0/2083304055 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000f510 con 0x7f20ec063260 2023-07-27T14:27:19.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20eaffd700 1 -- 172.21.15.115:0/2083304055 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000f670 con 0x7f20ec063260 2023-07-27T14:27:19.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20eaffd700 1 -- 172.21.15.115:0/2083304055 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000f9f0 con 0x7f20ec063260 2023-07-27T14:27:19.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20f23ff700 1 -- 172.21.15.115:0/2083304055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec063260 msgr2=0x7f20ec154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20f23ff700 1 --2- 172.21.15.115:0/2083304055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec063260 0x7f20ec154f00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f20e0009760 tx=0x7f20e0009060).stop 2023-07-27T14:27:19.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20f23ff700 1 -- 172.21.15.115:0/2083304055 shutdown_connections 2023-07-27T14:27:19.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20f23ff700 1 --2- 172.21.15.115:0/2083304055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec063260 0x7f20ec154f00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20f23ff700 1 -- 172.21.15.115:0/2083304055 >> 172.21.15.115:0/2083304055 conn(0x7f20ec05e940 msgr2=0x7f20ec0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:19.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20f23ff700 1 -- 172.21.15.115:0/2083304055 shutdown_connections 2023-07-27T14:27:19.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.127+0000 7f20f23ff700 1 -- 172.21.15.115:0/2083304055 wait complete. 2023-07-27T14:27:19.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.129+0000 7f20f23ff700 1 Processor -- start 2023-07-27T14:27:19.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.129+0000 7f20f23ff700 1 -- start start 2023-07-27T14:27:19.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20f23ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec063260 0x7f20ec13e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20f23ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec14ae00 0x7f20ec14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20f23ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20ec14b1e0 0x7f20ec0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20f23ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec14d890 con 0x7f20ec14ae00 2023-07-27T14:27:19.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20f23ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec14cc80 con 0x7f20ec063260 2023-07-27T14:27:19.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20f23ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec14cf60 con 0x7f20ec14b1e0 2023-07-27T14:27:19.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec14ae00 0x7f20ec14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec14ae00 0x7f20ec14dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47610/0 (socket says 172.21.15.115:47610) 2023-07-27T14:27:19.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 -- 172.21.15.115:0/1879727697 learned_addr learned my addr 172.21.15.115:0/1879727697 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:19.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 -- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20ec14b1e0 msgr2=0x7f20ec0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20ebfff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec063260 0x7f20ec13e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20f099c700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20ec14b1e0 0x7f20ec0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20ec14b1e0 0x7f20ec0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 -- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec063260 msgr2=0x7f20ec13e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec063260 0x7f20ec13e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 -- 172.21.15.115:0/1879727697 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00092a0 con 0x7f20ec14ae00 2023-07-27T14:27:19.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20ebfff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec063260 0x7f20ec13e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:19.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20f099c700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20ec14b1e0 0x7f20ec0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:19.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.130+0000 7f20eb7fe700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec14ae00 0x7f20ec14dd20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f20ec155580 tx=0x7f20e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.131+0000 7f20d3fff700 1 -- 172.21.15.115:0/1879727697 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000f7e0 con 0x7f20ec14ae00 2023-07-27T14:27:19.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.131+0000 7f20d3fff700 1 -- 172.21.15.115:0/1879727697 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000f940 con 0x7f20ec14ae00 2023-07-27T14:27:19.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.131+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec14d240 con 0x7f20ec14ae00 2023-07-27T14:27:19.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.131+0000 7f20d3fff700 1 -- 172.21.15.115:0/1879727697 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e001b650 con 0x7f20ec14ae00 2023-07-27T14:27:19.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.131+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec13e910 con 0x7f20ec14ae00 2023-07-27T14:27:19.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.132+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec14da00 con 0x7f20ec14ae00 2023-07-27T14:27:19.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.133+0000 7f20d3fff700 1 -- 172.21.15.115:0/1879727697 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f20e000f070 con 0x7f20ec14ae00 2023-07-27T14:27:19.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.134+0000 7f20d3fff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d805ed90 0x7f20d8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.134+0000 7f20d3fff700 1 -- 172.21.15.115:0/1879727697 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f20e007b0e0 con 0x7f20ec14ae00 2023-07-27T14:27:19.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.134+0000 7f20ebfff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d805ed90 0x7f20d8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.135+0000 7f20ebfff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d805ed90 0x7f20d8061250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f20dc005750 tx=0x7f20dc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.138+0000 7f20d3fff700 1 -- 172.21.15.115:0/1879727697 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20e004c680 con 0x7f20ec14ae00 2023-07-27T14:27:19.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.307+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20ec06c470 con 0x7f20ec14ae00 2023-07-27T14:27:19.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.308+0000 7f20d3fff700 1 -- 172.21.15.115:0/1879727697 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20e004fca0 con 0x7f20ec14ae00 2023-07-27T14:27:19.322 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:19.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d805ed90 msgr2=0x7f20d8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d805ed90 0x7f20d8061250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f20dc005750 tx=0x7f20dc009040).stop 2023-07-27T14:27:19.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec14ae00 msgr2=0x7f20ec14dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec14ae00 0x7f20ec14dd20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f20ec155580 tx=0x7f20e0017000).stop 2023-07-27T14:27:19.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 shutdown_connections 2023-07-27T14:27:19.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d805ed90 0x7f20d8061250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20ec14b1e0 0x7f20ec0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec063260 0x7f20ec13e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 --2- 172.21.15.115:0/1879727697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20ec14ae00 0x7f20ec14dd20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 >> 172.21.15.115:0/1879727697 conn(0x7f20ec05e940 msgr2=0x7f20ec0a9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:19.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 shutdown_connections 2023-07-27T14:27:19.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.310+0000 7f20f23ff700 1 -- 172.21.15.115:0/1879727697 wait complete. 2023-07-27T14:27:19.341 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:27:19.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.515+0000 7f6dee9ff700 1 Processor -- start 2023-07-27T14:27:19.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.516+0000 7f6dee9ff700 1 -- start start 2023-07-27T14:27:19.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.517+0000 7f6dee9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6de8153ec0 0x7f6de80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.517+0000 7f6dee9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6de80aaa40 0x7f6de80c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.517+0000 7f6dee9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de80aa4d0 con 0x7f6de80aa050 2023-07-27T14:27:19.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.517+0000 7f6dee9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de80c05c0 con 0x7f6de80aaa40 2023-07-27T14:27:19.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.517+0000 7f6dee9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de80bfc90 con 0x7f6de8153ec0 2023-07-27T14:27:19.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.517+0000 7f6de77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6de80aa050 0x7f6de80640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33648/0 (socket says 172.21.15.115:33648) 2023-07-27T14:27:19.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.517+0000 7f6de77fe700 1 -- 172.21.15.115:0/216403798 learned_addr learned my addr 172.21.15.115:0/216403798 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:19.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.517+0000 7f6decf9c700 1 --2- 172.21.15.115:0/216403798 >> v2:172.21.15.115:3300/0 conn(0x7f6de80aaa40 0x7f6de80c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6de7fff700 1 --2- 172.21.15.115:0/216403798 >> v2:172.21.15.159:3300/0 conn(0x7f6de8153ec0 0x7f6de80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6de6ffd700 1 -- 172.21.15.115:0/216403798 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672874636 0 0) 0x7f6ddc001110 con 0x7f6de80aa050 2023-07-27T14:27:19.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6de6ffd700 1 -- 172.21.15.115:0/216403798 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd00033f0 con 0x7f6de80aa050 2023-07-27T14:27:19.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6decf9c700 1 -- 172.21.15.115:0/216403798 >> v2:172.21.15.159:3300/0 conn(0x7f6de8153ec0 msgr2=0x7f6de80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:19.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6decf9c700 1 --2- 172.21.15.115:0/216403798 >> v2:172.21.15.159:3300/0 conn(0x7f6de8153ec0 0x7f6de80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6decf9c700 1 -- 172.21.15.115:0/216403798 >> v1:172.21.15.115:6789/0 conn(0x7f6de80aa050 legacy=0x7f6de80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6decf9c700 1 -- 172.21.15.115:0/216403798 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de80bff70 con 0x7f6de80aaa40 2023-07-27T14:27:19.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6decf9c700 1 --2- 172.21.15.115:0/216403798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aaa40 0x7f6de80c0a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f6de8083e30 tx=0x7f6de0009780).ready entity=mon.0 client_cookie=679902933e8daa00 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6de6ffd700 1 -- 172.21.15.115:0/216403798 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000e070 con 0x7f6de80aaa40 2023-07-27T14:27:19.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6de6ffd700 1 -- 172.21.15.115:0/216403798 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de000bab0 con 0x7f6de80aaa40 2023-07-27T14:27:19.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.518+0000 7f6de6ffd700 1 -- 172.21.15.115:0/216403798 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000be30 con 0x7f6de80aaa40 2023-07-27T14:27:19.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.519+0000 7f6dee9ff700 1 -- 172.21.15.115:0/216403798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aaa40 msgr2=0x7f6de80c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.519+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/216403798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aaa40 0x7f6de80c0a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f6de8083e30 tx=0x7f6de0009780).stop 2023-07-27T14:27:19.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.519+0000 7f6dee9ff700 1 -- 172.21.15.115:0/216403798 shutdown_connections 2023-07-27T14:27:19.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.519+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/216403798 >> v2:172.21.15.159:3300/0 conn(0x7f6de8153ec0 0x7f6de80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.519+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/216403798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aaa40 0x7f6de80c0a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.519+0000 7f6dee9ff700 1 -- 172.21.15.115:0/216403798 >> 172.21.15.115:0/216403798 conn(0x7f6de80cb610 msgr2=0x7f6de80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:19.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.519+0000 7f6dee9ff700 1 -- 172.21.15.115:0/216403798 shutdown_connections 2023-07-27T14:27:19.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.519+0000 7f6dee9ff700 1 -- 172.21.15.115:0/216403798 wait complete. 2023-07-27T14:27:19.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.521+0000 7f6dee9ff700 1 Processor -- start 2023-07-27T14:27:19.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.521+0000 7f6dee9ff700 1 -- start start 2023-07-27T14:27:19.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6dee9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aa050 0x7f6de8166d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6dee9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6de80aaa40 0x7f6de8152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6dee9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6de8153ec0 0x7f6de8152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6dee9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80af4f0 con 0x7f6de80aa050 2023-07-27T14:27:19.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6dee9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8152f20 con 0x7f6de80aaa40 2023-07-27T14:27:19.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6dee9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80ae8e0 con 0x7f6de8153ec0 2023-07-27T14:27:19.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aa050 0x7f6de8166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aa050 0x7f6de8166d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47634/0 (socket says 172.21.15.115:47634) 2023-07-27T14:27:19.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 -- 172.21.15.115:0/3723720060 learned_addr learned my addr 172.21.15.115:0/3723720060 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:19.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 -- 172.21.15.115:0/3723720060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6de8153ec0 msgr2=0x7f6de8152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6de8153ec0 0x7f6de8152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:19.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 -- 172.21.15.115:0/3723720060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6de80aaa40 msgr2=0x7f6de8152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6de80aaa40 0x7f6de8152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:19.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 -- 172.21.15.115:0/3723720060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de0009a20 con 0x7f6de80aa050 2023-07-27T14:27:19.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6de7fff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aa050 0x7f6de8166d50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f6dd800e900 tx=0x7f6dd8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.522+0000 7f6dcffff700 1 -- 172.21.15.115:0/3723720060 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800c640 con 0x7f6de80aa050 2023-07-27T14:27:19.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.523+0000 7f6dcffff700 1 -- 172.21.15.115:0/3723720060 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd800c7a0 con 0x7f6de80aa050 2023-07-27T14:27:19.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.523+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de80aebc0 con 0x7f6de80aa050 2023-07-27T14:27:19.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.523+0000 7f6dcffff700 1 -- 172.21.15.115:0/3723720060 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800cb20 con 0x7f6de80aa050 2023-07-27T14:27:19.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.523+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de80af180 con 0x7f6de80aa050 2023-07-27T14:27:19.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.524+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de806c470 con 0x7f6de80aa050 2023-07-27T14:27:19.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.525+0000 7f6dcffff700 1 -- 172.21.15.115:0/3723720060 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6dd8022070 con 0x7f6de80aa050 2023-07-27T14:27:19.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.525+0000 7f6dcffff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6dd405ed90 0x7f6dd4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.525+0000 7f6dcffff700 1 -- 172.21.15.115:0/3723720060 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6dd8079df0 con 0x7f6de80aa050 2023-07-27T14:27:19.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.526+0000 7f6de77fe700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6dd405ed90 0x7f6dd4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.526+0000 7f6de77fe700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6dd405ed90 0x7f6dd4061250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f6ddc005750 tx=0x7f6ddc0011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.530+0000 7f6dcffff700 1 -- 172.21.15.115:0/3723720060 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dd804b390 con 0x7f6de80aa050 2023-07-27T14:27:19.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.742+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6de80c0250 con 0x7f6de80aa050 2023-07-27T14:27:19.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.742+0000 7f6dcffff700 1 -- 172.21.15.115:0/3723720060 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4492 (secure 0 0 0) 0x7f6dd8016030 con 0x7f6de80aa050 2023-07-27T14:27:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:19.756 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:27:01.252698+0000","modified":"2023-07-27T14:27:04.264437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-07-27T14:27:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.744+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6dd405ed90 msgr2=0x7f6dd4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.744+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6dd405ed90 0x7f6dd4061250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f6ddc005750 tx=0x7f6ddc0011a0).stop 2023-07-27T14:27:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.744+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aa050 msgr2=0x7f6de8166d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.744+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aa050 0x7f6de8166d50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f6dd800e900 tx=0x7f6dd8009060).stop 2023-07-27T14:27:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.745+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 shutdown_connections 2023-07-27T14:27:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.745+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6dd405ed90 0x7f6dd4061250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.745+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6de8153ec0 0x7f6de8152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.745+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6de80aa050 0x7f6de8166d50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.745+0000 7f6dee9ff700 1 --2- 172.21.15.115:0/3723720060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6de80aaa40 0x7f6de8152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.745+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 >> 172.21.15.115:0/3723720060 conn(0x7f6de80cb610 msgr2=0x7f6de80c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:19.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.745+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 shutdown_connections 2023-07-27T14:27:19.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.745+0000 7f6dee9ff700 1 -- 172.21.15.115:0/3723720060 wait complete. 2023-07-27T14:27:19.760 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 7 2023-07-27T14:27:19.776 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:19.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.951+0000 7f2e58bff700 1 Processor -- start 2023-07-27T14:27:19.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.951+0000 7f2e58bff700 1 -- start start 2023-07-27T14:27:19.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.952+0000 7f2e58bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e541542a0 0x7f2e5415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.952+0000 7f2e58bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540aa4d0 con 0x7f2e540aaa40 2023-07-27T14:27:19.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.952+0000 7f2e58bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540c05c0 con 0x7f2e54153ec0 2023-07-27T14:27:19.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.952+0000 7f2e58bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e540c1a60 con 0x7f2e541542a0 2023-07-27T14:27:19.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.952+0000 7f2e51d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2e540aaa40 0x7f2e540640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33652/0 (socket says 172.21.15.115:33652) 2023-07-27T14:27:19.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.952+0000 7f2e51d9b700 1 -- 172.21.15.115:0/3467516367 learned_addr learned my addr 172.21.15.115:0/3467516367 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:19.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e52d9d700 1 --2- 172.21.15.115:0/3467516367 >> v2:172.21.15.115:3300/0 conn(0x7f2e541542a0 0x7f2e5415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e5159a700 1 -- 172.21.15.115:0/3467516367 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615601636 0 0) 0x7f2e48001110 con 0x7f2e540aaa40 2023-07-27T14:27:19.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e5159a700 1 -- 172.21.15.115:0/3467516367 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0033f0 con 0x7f2e540aaa40 2023-07-27T14:27:19.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e52d9d700 1 -- 172.21.15.115:0/3467516367 >> v1:172.21.15.159:6789/0 conn(0x7f2e54153ec0 legacy=0x7f2e540a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e52d9d700 1 -- 172.21.15.115:0/3467516367 >> v1:172.21.15.115:6789/0 conn(0x7f2e540aaa40 legacy=0x7f2e540640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e52d9d700 1 -- 172.21.15.115:0/3467516367 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540aa270 con 0x7f2e541542a0 2023-07-27T14:27:19.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e52d9d700 1 --2- 172.21.15.115:0/3467516367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e541542a0 0x7f2e5415efc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f2e4c009e60 tx=0x7f2e4c009780).ready entity=mon.0 client_cookie=3415b50629e9a1d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e5159a700 1 -- 172.21.15.115:0/3467516367 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00e070 con 0x7f2e541542a0 2023-07-27T14:27:19.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e5159a700 1 -- 172.21.15.115:0/3467516367 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00bb60 con 0x7f2e541542a0 2023-07-27T14:27:19.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.953+0000 7f2e5159a700 1 -- 172.21.15.115:0/3467516367 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c012410 con 0x7f2e541542a0 2023-07-27T14:27:19.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.954+0000 7f2e58bff700 1 -- 172.21.15.115:0/3467516367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e541542a0 msgr2=0x7f2e5415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.954+0000 7f2e58bff700 1 --2- 172.21.15.115:0/3467516367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e541542a0 0x7f2e5415efc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f2e4c009e60 tx=0x7f2e4c009780).stop 2023-07-27T14:27:19.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.954+0000 7f2e58bff700 1 -- 172.21.15.115:0/3467516367 shutdown_connections 2023-07-27T14:27:19.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.954+0000 7f2e58bff700 1 --2- 172.21.15.115:0/3467516367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e541542a0 0x7f2e5415efc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:19.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.954+0000 7f2e58bff700 1 -- 172.21.15.115:0/3467516367 >> 172.21.15.115:0/3467516367 conn(0x7f2e540cb610 msgr2=0x7f2e540c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:19.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.954+0000 7f2e58bff700 1 -- 172.21.15.115:0/3467516367 shutdown_connections 2023-07-27T14:27:19.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.954+0000 7f2e58bff700 1 -- 172.21.15.115:0/3467516367 wait complete. 2023-07-27T14:27:19.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.955+0000 7f2e58bff700 1 Processor -- start 2023-07-27T14:27:19.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.956+0000 7f2e58bff700 1 -- start start 2023-07-27T14:27:19.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.956+0000 7f2e58bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5413aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.956+0000 7f2e58bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 0x7f2e540c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.956+0000 7f2e58bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 0x7f2e540c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.956+0000 7f2e58bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540c4d50 con 0x7f2e540aaa40 2023-07-27T14:27:19.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.956+0000 7f2e58bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540c42b0 con 0x7f2e541542a0 2023-07-27T14:27:19.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.956+0000 7f2e58bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540c1f80 con 0x7f2e54153ec0 2023-07-27T14:27:19.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5413aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5413aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47650/0 (socket says 172.21.15.115:47650) 2023-07-27T14:27:19.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 -- 172.21.15.115:0/3085440333 learned_addr learned my addr 172.21.15.115:0/3085440333 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:19.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 -- 172.21.15.115:0/3085440333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 msgr2=0x7f2e540c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 0x7f2e540c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:19.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 -- 172.21.15.115:0/3085440333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 msgr2=0x7f2e540c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:19.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 0x7f2e540c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:19.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 -- 172.21.15.115:0/3085440333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009a20 con 0x7f2e540aaa40 2023-07-27T14:27:19.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e5259c700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5413aef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f2e4400c4c0 tx=0x7f2e44007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e427fc700 1 -- 172.21.15.115:0/3085440333 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44007020 con 0x7f2e540aaa40 2023-07-27T14:27:19.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e427fc700 1 -- 172.21.15.115:0/3085440333 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44001e90 con 0x7f2e540aaa40 2023-07-27T14:27:19.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e540c44b0 con 0x7f2e540aaa40 2023-07-27T14:27:19.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.957+0000 7f2e427fc700 1 -- 172.21.15.115:0/3085440333 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440073b0 con 0x7f2e540aaa40 2023-07-27T14:27:19.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.958+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e540c4a70 con 0x7f2e540aaa40 2023-07-27T14:27:19.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.959+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5406c470 con 0x7f2e540aaa40 2023-07-27T14:27:19.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.959+0000 7f2e427fc700 1 -- 172.21.15.115:0/3085440333 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f2e44010070 con 0x7f2e540aaa40 2023-07-27T14:27:19.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.960+0000 7f2e427fc700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405ed90 0x7f2e34061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:19.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.960+0000 7f2e427fc700 1 -- 172.21.15.115:0/3085440333 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2e440794a0 con 0x7f2e540aaa40 2023-07-27T14:27:19.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.960+0000 7f2e51d9b700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405ed90 0x7f2e34061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:19.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.961+0000 7f2e51d9b700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405ed90 0x7f2e34061250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2e48005750 tx=0x7f2e480011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:19.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:19.964+0000 7f2e427fc700 1 -- 172.21.15.115:0/3085440333 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e4404a930 con 0x7f2e540aaa40 2023-07-27T14:27:20.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.134+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e540c8230 con 0x7f2e540aaa40 2023-07-27T14:27:20.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.135+0000 7f2e427fc700 1 -- 172.21.15.115:0/3085440333 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f2e4404df50 con 0x7f2e540aaa40 2023-07-27T14:27:20.149 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:20.149 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:20.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405ed90 msgr2=0x7f2e34061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405ed90 0x7f2e34061250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2e48005750 tx=0x7f2e480011a0).stop 2023-07-27T14:27:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 msgr2=0x7f2e5413aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5413aef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f2e4400c4c0 tx=0x7f2e44007e00).stop 2023-07-27T14:27:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 shutdown_connections 2023-07-27T14:27:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405ed90 0x7f2e34061250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 0x7f2e540c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5413aef0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 --2- 172.21.15.115:0/3085440333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 0x7f2e540c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:20.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 >> 172.21.15.115:0/3085440333 conn(0x7f2e540cb610 msgr2=0x7f2e540ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:20.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 shutdown_connections 2023-07-27T14:27:20.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.137+0000 7f2e58bff700 1 -- 172.21.15.115:0/3085440333 wait complete. 2023-07-27T14:27:20.168 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:27:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.340+0000 7f15357ff700 1 Processor -- start 2023-07-27T14:27:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.340+0000 7f15357ff700 1 -- start start 2023-07-27T14:27:20.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.341+0000 7f15357ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1530065ff0 0x7f1530066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:20.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.341+0000 7f15357ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1530067080 con 0x7f1530151d70 2023-07-27T14:27:20.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.341+0000 7f15357ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1530066df0 con 0x7f1530066960 2023-07-27T14:27:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.341+0000 7f15357ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1530063a90 con 0x7f1530065ff0 2023-07-27T14:27:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.341+0000 7f152effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1530151d70 0x7f1530155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33656/0 (socket says 172.21.15.115:33656) 2023-07-27T14:27:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.341+0000 7f152effd700 1 -- 172.21.15.115:0/2165212977 learned_addr learned my addr 172.21.15.115:0/2165212977 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152e7fc700 1 --2- 172.21.15.115:0/2165212977 >> v2:172.21.15.159:3300/0 conn(0x7f1530065ff0 0x7f1530066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152dffb700 1 -- 172.21.15.115:0/2165212977 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523208420 0 0) 0x7f1530067080 con 0x7f1530151d70 2023-07-27T14:27:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152dffb700 1 -- 172.21.15.115:0/2165212977 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15180033f0 con 0x7f1530151d70 2023-07-27T14:27:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152e7fc700 1 -- 172.21.15.115:0/2165212977 >> v1:172.21.15.159:6789/0 conn(0x7f1530066960 legacy=0x7f1530067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152dffb700 1 -- 172.21.15.115:0/2165212977 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282214242 0 0) 0x7f1530066df0 con 0x7f1530066960 2023-07-27T14:27:20.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152e7fc700 1 -- 172.21.15.115:0/2165212977 >> v1:172.21.15.115:6789/0 conn(0x7f1530151d70 legacy=0x7f1530155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152e7fc700 1 -- 172.21.15.115:0/2165212977 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300634d0 con 0x7f1530065ff0 2023-07-27T14:27:20.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152e7fc700 1 --2- 172.21.15.115:0/2165212977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530065ff0 0x7f1530066470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1524009760 tx=0x7f1524009060).ready entity=mon.1 client_cookie=5f49eab95e7c2e76 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:20.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.342+0000 7f152dffb700 1 -- 172.21.15.115:0/2165212977 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400f510 con 0x7f1530065ff0 2023-07-27T14:27:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f152dffb700 1 -- 172.21.15.115:0/2165212977 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152400f670 con 0x7f1530065ff0 2023-07-27T14:27:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f152dffb700 1 -- 172.21.15.115:0/2165212977 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400f9f0 con 0x7f1530065ff0 2023-07-27T14:27:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f15357ff700 1 -- 172.21.15.115:0/2165212977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530065ff0 msgr2=0x7f1530066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f15357ff700 1 --2- 172.21.15.115:0/2165212977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530065ff0 0x7f1530066470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1524009760 tx=0x7f1524009060).stop 2023-07-27T14:27:20.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f15357ff700 1 -- 172.21.15.115:0/2165212977 shutdown_connections 2023-07-27T14:27:20.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f15357ff700 1 --2- 172.21.15.115:0/2165212977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530065ff0 0x7f1530066470 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f15357ff700 1 -- 172.21.15.115:0/2165212977 >> 172.21.15.115:0/2165212977 conn(0x7f15300c89a0 msgr2=0x7f15300c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:20.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f15357ff700 1 -- 172.21.15.115:0/2165212977 shutdown_connections 2023-07-27T14:27:20.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.343+0000 7f15357ff700 1 -- 172.21.15.115:0/2165212977 wait complete. 2023-07-27T14:27:20.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.345+0000 7f15357ff700 1 Processor -- start 2023-07-27T14:27:20.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.345+0000 7f15357ff700 1 -- start start 2023-07-27T14:27:20.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f15357ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1530065ff0 0x7f1530167610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:20.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f15357ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530066960 0x7f15300ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:20.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f15357ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530151d70 0x7f153014afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:20.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f15357ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153014b4d0 con 0x7f1530151d70 2023-07-27T14:27:20.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f15357ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1530167bf0 con 0x7f1530066960 2023-07-27T14:27:20.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f15357ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1530167ed0 con 0x7f1530065ff0 2023-07-27T14:27:20.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530151d70 0x7f153014afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:20.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530151d70 0x7f153014afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47656/0 (socket says 172.21.15.115:47656) 2023-07-27T14:27:20.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 -- 172.21.15.115:0/1756029200 learned_addr learned my addr 172.21.15.115:0/1756029200 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:20.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152e7fc700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530066960 0x7f15300ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:20.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 -- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1530065ff0 msgr2=0x7f1530167610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152effd700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1530065ff0 0x7f1530167610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:20.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1530065ff0 0x7f1530167610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 -- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530066960 msgr2=0x7f15300ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530066960 0x7f15300ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 -- 172.21.15.115:0/1756029200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240092a0 con 0x7f1530151d70 2023-07-27T14:27:20.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152e7fc700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530066960 0x7f15300ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:20.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152effd700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1530065ff0 0x7f1530167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:20.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.346+0000 7f152f7fe700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530151d70 0x7f153014afe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f152800c760 tx=0x7f1528007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:20.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.347+0000 7f1516ffd700 1 -- 172.21.15.115:0/1756029200 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528001630 con 0x7f1530151d70 2023-07-27T14:27:20.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.347+0000 7f1516ffd700 1 -- 172.21.15.115:0/1756029200 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528010510 con 0x7f1530151d70 2023-07-27T14:27:20.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.347+0000 7f1516ffd700 1 -- 172.21.15.115:0/1756029200 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15280108d0 con 0x7f1530151d70 2023-07-27T14:27:20.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.347+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15301681b0 con 0x7f1530151d70 2023-07-27T14:27:20.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.347+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1530150400 con 0x7f1530151d70 2023-07-27T14:27:20.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.348+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153006c470 con 0x7f1530151d70 2023-07-27T14:27:20.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.349+0000 7f1516ffd700 1 -- 172.21.15.115:0/1756029200 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1528003020 con 0x7f1530151d70 2023-07-27T14:27:20.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.350+0000 7f1516ffd700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f151c05ed90 0x7f151c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:20.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.350+0000 7f1516ffd700 1 -- 172.21.15.115:0/1756029200 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1528079840 con 0x7f1530151d70 2023-07-27T14:27:20.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.350+0000 7f152effd700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f151c05ed90 0x7f151c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:20.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.350+0000 7f152effd700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f151c05ed90 0x7f151c061250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1520005750 tx=0x7f1520009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:20.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.354+0000 7f1516ffd700 1 -- 172.21.15.115:0/1756029200 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f152804ade0 con 0x7f1530151d70 2023-07-27T14:27:20.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.561+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1530068720 con 0x7f1530151d70 2023-07-27T14:27:20.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.562+0000 7f1516ffd700 1 -- 172.21.15.115:0/1756029200 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4492 (secure 0 0 0) 0x7f152804e400 con 0x7f1530151d70 2023-07-27T14:27:20.576 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:20.576 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:27:01.252698+0000","modified":"2023-07-27T14:27:04.264437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-07-27T14:27:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f151c05ed90 msgr2=0x7f151c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f151c05ed90 0x7f151c061250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1520005750 tx=0x7f1520009040).stop 2023-07-27T14:27:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530151d70 msgr2=0x7f153014afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530151d70 0x7f153014afe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f152800c760 tx=0x7f1528007f10).stop 2023-07-27T14:27:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 shutdown_connections 2023-07-27T14:27:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f151c05ed90 0x7f151c061250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530151d70 0x7f153014afe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1530065ff0 0x7f1530167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 --2- 172.21.15.115:0/1756029200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1530066960 0x7f15300ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 >> 172.21.15.115:0/1756029200 conn(0x7f15300c89a0 msgr2=0x7f15301534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 shutdown_connections 2023-07-27T14:27:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:20.564+0000 7f15357ff700 1 -- 172.21.15.115:0/1756029200 wait complete. 2023-07-27T14:27:20.580 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 7 2023-07-27T14:27:20.998 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:27:01.252698+0000', 'modified': '2023-07-27T14:27:04.264437+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6835/3004855447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6833', 'nonce': 3004855447}, {'type': 'v1', 'addr': '172.21.15.159:6835', 'nonce': 3004855447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:27:20.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:27:20.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-27T14:27:21.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.176+0000 7f7989dff700 1 Processor -- start 2023-07-27T14:27:21.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.177+0000 7f7989dff700 1 -- start start 2023-07-27T14:27:21.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.178+0000 7f7989dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f79840aaa40 0x7f79840640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.178+0000 7f7989dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79841542a0 0x7f79840645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.178+0000 7f7989dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79840aa4d0 con 0x7f7984153ec0 2023-07-27T14:27:21.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.178+0000 7f7989dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7984064ad0 con 0x7f79841542a0 2023-07-27T14:27:21.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.178+0000 7f7989dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840c05c0 con 0x7f79840aaa40 2023-07-27T14:27:21.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.178+0000 7f7983fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79841542a0 0x7f79840645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.178+0000 7f7983fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79841542a0 0x7f79840645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47668/0 (socket says 172.21.15.115:47668) 2023-07-27T14:27:21.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.178+0000 7f7983fff700 1 -- 172.21.15.115:0/1332522538 learned_addr learned my addr 172.21.15.115:0/1332522538 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:21.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f7982ffd700 1 --2- 172.21.15.115:0/1332522538 >> v2:172.21.15.159:3300/0 conn(0x7f79840aaa40 0x7f79840640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f7983fff700 1 -- 172.21.15.115:0/1332522538 >> v2:172.21.15.159:3300/0 conn(0x7f79840aaa40 msgr2=0x7f79840640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f7983fff700 1 --2- 172.21.15.115:0/1332522538 >> v2:172.21.15.159:3300/0 conn(0x7f79840aaa40 0x7f79840640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f7983fff700 1 -- 172.21.15.115:0/1332522538 >> v1:172.21.15.159:6789/0 conn(0x7f7984153ec0 legacy=0x7f79840a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f7983fff700 1 -- 172.21.15.115:0/1332522538 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840c1a60 con 0x7f79841542a0 2023-07-27T14:27:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f7982ffd700 1 --2- 172.21.15.115:0/1332522538 >> v2:172.21.15.159:3300/0 conn(0x7f79840aaa40 0x7f79840640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f7983fff700 1 --2- 172.21.15.115:0/1332522538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840645e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f798406c0d0 tx=0x7f797c009840).ready entity=mon.0 client_cookie=9d8f44dedbaa729f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f79827fc700 1 -- 172.21.15.115:0/1332522538 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c00e070 con 0x7f79841542a0 2023-07-27T14:27:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f79827fc700 1 -- 172.21.15.115:0/1332522538 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c00ba50 con 0x7f79841542a0 2023-07-27T14:27:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.179+0000 7f79827fc700 1 -- 172.21.15.115:0/1332522538 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c00bdd0 con 0x7f79841542a0 2023-07-27T14:27:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.180+0000 7f7989dff700 1 -- 172.21.15.115:0/1332522538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 msgr2=0x7f79840645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.180+0000 7f7989dff700 1 --2- 172.21.15.115:0/1332522538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840645e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f798406c0d0 tx=0x7f797c009840).stop 2023-07-27T14:27:21.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.180+0000 7f7989dff700 1 -- 172.21.15.115:0/1332522538 shutdown_connections 2023-07-27T14:27:21.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.180+0000 7f7989dff700 1 --2- 172.21.15.115:0/1332522538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840645e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.180+0000 7f7989dff700 1 --2- 172.21.15.115:0/1332522538 >> v2:172.21.15.159:3300/0 conn(0x7f79840aaa40 0x7f79840640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.180+0000 7f7989dff700 1 -- 172.21.15.115:0/1332522538 >> 172.21.15.115:0/1332522538 conn(0x7f79840cb610 msgr2=0x7f79840c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:21.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.180+0000 7f7989dff700 1 -- 172.21.15.115:0/1332522538 shutdown_connections 2023-07-27T14:27:21.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.180+0000 7f7989dff700 1 -- 172.21.15.115:0/1332522538 wait complete. 2023-07-27T14:27:21.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.181+0000 7f7989dff700 1 Processor -- start 2023-07-27T14:27:21.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.182+0000 7f7989dff700 1 -- start start 2023-07-27T14:27:21.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.182+0000 7f7989dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79840aaa40 0x7f79840b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.182+0000 7f7989dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7984153ec0 0x7f798413e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.182+0000 7f7989dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.182+0000 7f7989dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840aeba0 con 0x7f79841542a0 2023-07-27T14:27:21.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.182+0000 7f7989dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7984151ad0 con 0x7f79840aaa40 2023-07-27T14:27:21.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.182+0000 7f7989dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79841657e0 con 0x7f7984153ec0 2023-07-27T14:27:21.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47684/0 (socket says 172.21.15.115:47684) 2023-07-27T14:27:21.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 -- 172.21.15.115:0/839274065 learned_addr learned my addr 172.21.15.115:0/839274065 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:21.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 -- 172.21.15.115:0/839274065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7984153ec0 msgr2=0x7f798413e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7984153ec0 0x7f798413e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:21.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 -- 172.21.15.115:0/839274065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79840aaa40 msgr2=0x7f79840b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79840aaa40 0x7f79840b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 -- 172.21.15.115:0/839274065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c009ae0 con 0x7f79841542a0 2023-07-27T14:27:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7983fff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840ab070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f797c010000 tx=0x7f79840c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f796b7fe700 1 -- 172.21.15.115:0/839274065 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c009500 con 0x7f79841542a0 2023-07-27T14:27:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f796b7fe700 1 -- 172.21.15.115:0/839274065 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c01c400 con 0x7f79841542a0 2023-07-27T14:27:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f7989dff700 1 -- 172.21.15.115:0/839274065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79840adf20 con 0x7f79841542a0 2023-07-27T14:27:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.183+0000 7f796b7fe700 1 -- 172.21.15.115:0/839274065 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c01c780 con 0x7f79841542a0 2023-07-27T14:27:21.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.184+0000 7f7989dff700 1 -- 172.21.15.115:0/839274065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79840ae4e0 con 0x7f79841542a0 2023-07-27T14:27:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.185+0000 7f796b7fe700 1 -- 172.21.15.115:0/839274065 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f797c01cbb0 con 0x7f79841542a0 2023-07-27T14:27:21.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.186+0000 7f796b7fe700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f797005ed90 0x7f7970061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.186+0000 7f796b7fe700 1 -- 172.21.15.115:0/839274065 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f797c07b830 con 0x7f79841542a0 2023-07-27T14:27:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.187+0000 7f79837fe700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f797005ed90 0x7f7970061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.187+0000 7f79837fe700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f797005ed90 0x7f7970061250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7974001510 tx=0x7f79740079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.188+0000 7f79a1224b80 1 Processor -- start 2023-07-27T14:27:21.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.189+0000 7f79a1224b80 1 -- start start 2023-07-27T14:27:21.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.189+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.189+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce35830 0x55990ce5bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.189+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce5c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.189+0000 7f79a1224b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cd4a9c0 con 0x55990ce0d5c0 2023-07-27T14:27:21.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.189+0000 7f79a1224b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cd5fcc0 con 0x55990ce35830 2023-07-27T14:27:21.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.189+0000 7f79a1224b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55990cd26e10 con 0x55990ce0ff60 2023-07-27T14:27:21.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47700/0 (socket says 172.21.15.115:47700) 2023-07-27T14:27:21.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 -- 172.21.15.115:0/3004058084 learned_addr learned my addr 172.21.15.115:0/3004058084 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 -- 172.21.15.115:0/3004058084 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 msgr2=0x55990ce5c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce5c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f7982ffd700 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce35830 0x55990ce5bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 -- 172.21.15.115:0/3004058084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce35830 msgr2=0x55990ce5bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce35830 0x55990ce5bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 -- 172.21.15.115:0/3004058084 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55990cd589a0 con 0x55990ce0d5c0 2023-07-27T14:27:21.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f7982ffd700 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce35830 0x55990ce5bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79837fe700 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0d9a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f79740148c0 tx=0x7f7974010000).ready entity=mon.0 client_cookie=9ed084441bf7b7c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79689fe700 1 -- 172.21.15.115:0/3004058084 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740168b0 con 0x55990ce0d5c0 2023-07-27T14:27:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79689fe700 1 -- 172.21.15.115:0/3004058084 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974001e90 con 0x55990ce0d5c0 2023-07-27T14:27:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.190+0000 7f79689fe700 1 -- 172.21.15.115:0/3004058084 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974016c40 con 0x55990ce0d5c0 2023-07-27T14:27:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 -- 172.21.15.115:0/3004058084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 msgr2=0x55990ce0d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0d9a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f79740148c0 tx=0x7f7974010000).stop 2023-07-27T14:27:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 -- 172.21.15.115:0/3004058084 shutdown_connections 2023-07-27T14:27:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce5c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:21.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0d9a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 --2- 172.21.15.115:0/3004058084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce35830 0x55990ce5bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 -- 172.21.15.115:0/3004058084 >> 172.21.15.115:0/3004058084 conn(0x55990cc78940 msgr2=0x55990ce566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:21.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 -- 172.21.15.115:0/3004058084 shutdown_connections 2023-07-27T14:27:21.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.191+0000 7f79a1224b80 1 -- 172.21.15.115:0/3004058084 wait complete. 2023-07-27T14:27:21.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.192+0000 7f79a1224b80 1 -- start start 2023-07-27T14:27:21.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.192+0000 7f79a1224b80 1 Processor -- start 2023-07-27T14:27:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0d5c0 0x55990ce54230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0ff60 0x55990ce54720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 0x55990ce4ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f79a1224b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990ce54c10 con 0x55990ce0ff60 2023-07-27T14:27:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f79a1224b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990ce500d0 con 0x55990ce2e3f0 2023-07-27T14:27:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f79a1224b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55990ce4d010 con 0x55990ce0d5c0 2023-07-27T14:27:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f79a1224b80 10 client.0 ll_register_callbacks cb 0x55990cd124a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:27:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f7982ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0ff60 0x55990ce54720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f7982ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0ff60 0x55990ce54720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47702/0 (socket says 172.21.15.115:47702) 2023-07-27T14:27:21.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f7982ffd700 1 -- 172.21.15.115:0/2500050946 learned_addr learned my addr 172.21.15.115:0/2500050946 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:21.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f79837fe700 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0d5c0 0x55990ce54230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.193+0000 7f7983fff700 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 0x55990ce4ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7982ffd700 1 -- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0d5c0 msgr2=0x55990ce54230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7982ffd700 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0d5c0 0x55990ce54230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7982ffd700 1 -- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 msgr2=0x55990ce4ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7982ffd700 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 0x55990ce4ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7982ffd700 1 -- 172.21.15.115:0/2500050946 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7974014590 con 0x55990ce0ff60 2023-07-27T14:27:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7982ffd700 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0ff60 0x55990ce54720 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f797800d270 tx=0x7f7978008040).ready entity=mon.0 client_cookie=282102e7fe083b86 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7961ffb700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:27:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7961ffb700 1 -- 172.21.15.115:0/2500050946 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800ddb0 con 0x55990ce0ff60 2023-07-27T14:27:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f79a1224b80 1 -- 172.21.15.115:0/2500050946 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55990ce07d50 con 0x55990ce0ff60 2023-07-27T14:27:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7961ffb700 1 -- 172.21.15.115:0/2500050946 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7978012480 con 0x55990ce0ff60 2023-07-27T14:27:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f7961ffb700 1 -- 172.21.15.115:0/2500050946 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7978012850 con 0x55990ce0ff60 2023-07-27T14:27:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f79a1224b80 10 client.4701 fetch_fsmap learned FSMap version 7 2023-07-27T14:27:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.194+0000 7f79a1224b80 1 -- 172.21.15.115:0/2500050946 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55990cd54190 con 0x55990ce0ff60 2023-07-27T14:27:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f7961ffb700 1 -- 172.21.15.115:0/2500050946 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55990ce07d50 con 0x55990ce0ff60 2023-07-27T14:27:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f7961ffb700 1 -- 172.21.15.115:0/2500050946 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79780129b0 con 0x55990ce0ff60 2023-07-27T14:27:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f79a1224b80 10 client.4701 fetch_fsmap finished waiting for FSMap version 7 2023-07-27T14:27:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f79a1224b80 10 client.4701 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T14:27:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f79a1224b80 20 client.4701 populate_metadata read hostname 'smithi115' 2023-07-27T14:27:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] conn(0x55990ce4f770 0x55990ce3b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f79a1224b80 4 client.4701 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:27:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f79a1224b80 1 -- 172.21.15.115:0/2500050946 --> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55990cbc8ef0 con 0x55990ce4f770 2023-07-27T14:27:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.195+0000 7f79837fe700 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] conn(0x55990ce4f770 0x55990ce3b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.196+0000 7f79837fe700 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] conn(0x55990ce4f770 0x55990ce3b110 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=115a452335793891 server_cookie=7f52d8393299b7f8 in_seq=0 out_seq=0 2023-07-27T14:27:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.196+0000 7f7961ffb700 10 client.4701 ms_handle_connect on v2:172.21.15.159:6833/3004855447 2023-07-27T14:27:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.197+0000 7f7961ffb700 1 -- 172.21.15.115:0/2500050946 <== mds.0 v2:172.21.15.159:6833/3004855447 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x55990cbc8ef0 con 0x55990ce4f770 2023-07-27T14:27:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.197+0000 7f7961ffb700 10 client.4701 handle_command_reply: tid=0 2023-07-27T14:27:21.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.197+0000 7f79a1224b80 1 client.4701 shutdown 2023-07-27T14:27:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.197+0000 7f79a1224b80 1 -- 172.21.15.115:0/2500050946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0ff60 msgr2=0x55990ce54720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.197+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0ff60 0x55990ce54720 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f797800d270 tx=0x7f7978008040).stop 2023-07-27T14:27:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 1 -- 172.21.15.115:0/2500050946 shutdown_connections 2023-07-27T14:27:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] conn(0x55990ce4f770 0x55990ce3b110 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 0x55990ce4ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0d5c0 0x55990ce54230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2500050946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0ff60 0x55990ce54720 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 1 -- 172.21.15.115:0/2500050946 >> 172.21.15.115:0/2500050946 conn(0x55990cc78940 msgr2=0x55990ce093a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:21.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f7961ffb700 0 client.4701 ms_handle_reset on v2:172.21.15.159:6833/3004855447 2023-07-27T14:27:21.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 1 -- 172.21.15.115:0/2500050946 shutdown_connections 2023-07-27T14:27:21.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 1 -- 172.21.15.115:0/2500050946 wait complete. 2023-07-27T14:27:21.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.198+0000 7f79a1224b80 20 client.4701 trim_cache size 0 max 16384 2023-07-27T14:27:21.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.214+0000 7f79a1224b80 1 Processor -- start 2023-07-27T14:27:21.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.214+0000 7f79a1224b80 1 -- start start 2023-07-27T14:27:21.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce39d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 0x55990ce4d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79a1224b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990ce0faa0 con 0x55990ce0d5c0 2023-07-27T14:27:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79a1224b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990ce0d250 con 0x55990ce2e3f0 2023-07-27T14:27:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79a1224b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55990ce0e990 con 0x55990ce0ff60 2023-07-27T14:27:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79837fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79837fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47708/0 (socket says 172.21.15.115:47708) 2023-07-27T14:27:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.215+0000 7f79837fe700 1 -- 172.21.15.115:0/2624757138 learned_addr learned my addr 172.21.15.115:0/2624757138 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f7982ffd700 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce39d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f7983fff700 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 0x55990ce4d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79837fe700 1 -- 172.21.15.115:0/2624757138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 msgr2=0x55990ce39d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79837fe700 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce39d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79837fe700 1 -- 172.21.15.115:0/2624757138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 msgr2=0x55990ce4d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79837fe700 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 0x55990ce4d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79837fe700 1 -- 172.21.15.115:0/2624757138 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55990cd53ee0 con 0x55990ce0d5c0 2023-07-27T14:27:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79837fe700 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0a6a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x55990ce39420 tx=0x7f7974003000).ready entity=mon.0 client_cookie=3207ebbe83ed572f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79691ff700 1 -- 172.21.15.115:0/2624757138 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740168b0 con 0x55990ce0d5c0 2023-07-27T14:27:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79691ff700 1 -- 172.21.15.115:0/2624757138 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974016a10 con 0x55990ce0d5c0 2023-07-27T14:27:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79691ff700 1 -- 172.21.15.115:0/2624757138 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797402f4c0 con 0x55990ce0d5c0 2023-07-27T14:27:21.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79a1224b80 1 -- 172.21.15.115:0/2624757138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 msgr2=0x55990ce0a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.216+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0a6a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x55990ce39420 tx=0x7f7974003000).stop 2023-07-27T14:27:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.217+0000 7f79a1224b80 1 -- 172.21.15.115:0/2624757138 shutdown_connections 2023-07-27T14:27:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.217+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce2e3f0 0x55990ce4d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.217+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce0d5c0 0x55990ce0a6a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.217+0000 7f79a1224b80 1 --2- 172.21.15.115:0/2624757138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce39d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.217+0000 7f79a1224b80 1 -- 172.21.15.115:0/2624757138 >> 172.21.15.115:0/2624757138 conn(0x55990cc78940 msgr2=0x55990ce55b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.217+0000 7f79a1224b80 1 -- 172.21.15.115:0/2624757138 shutdown_connections 2023-07-27T14:27:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.217+0000 7f79a1224b80 1 -- 172.21.15.115:0/2624757138 wait complete. 2023-07-27T14:27:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.217+0000 7f79a1224b80 1 -- start start 2023-07-27T14:27:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.218+0000 7f79a1224b80 1 Processor -- start 2023-07-27T14:27:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.218+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce0d5c0 0x55990ceb86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.218+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce55a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.218+0000 7f79a1224b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce2e3f0 0x55990ce56470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f79a1224b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990ce2c520 con 0x55990ce2e3f0 2023-07-27T14:27:21.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f79a1224b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990ce570b0 con 0x55990ce0d5c0 2023-07-27T14:27:21.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f79a1224b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55990ceb8250 con 0x55990ce0ff60 2023-07-27T14:27:21.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f79a1224b80 10 client.0 ll_register_callbacks cb 0x55990cd124a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:27:21.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce2e3f0 0x55990ce56470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce2e3f0 0x55990ce56470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47720/0 (socket says 172.21.15.115:47720) 2023-07-27T14:27:21.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 -- 172.21.15.115:0/1354084539 learned_addr learned my addr 172.21.15.115:0/1354084539 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:21.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 -- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 msgr2=0x55990ce55a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce55a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:21.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 -- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce0d5c0 msgr2=0x55990ceb86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f79837fe700 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce0d5c0 0x55990ceb86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce0d5c0 0x55990ceb86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 -- 172.21.15.115:0/1354084539 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55990cd589a0 con 0x55990ce2e3f0 2023-07-27T14:27:21.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7983fff700 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce2e3f0 0x55990ce56470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f797c0508b0 tx=0x7f797c028040).ready entity=mon.0 client_cookie=47690d24e6190b8b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7961ffb700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:27:21.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.219+0000 7f7961ffb700 1 -- 172.21.15.115:0/1354084539 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c055070 con 0x55990ce2e3f0 2023-07-27T14:27:21.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 1 -- 172.21.15.115:0/1354084539 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7974001e90 con 0x55990ce2e3f0 2023-07-27T14:27:21.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f7961ffb700 1 -- 172.21.15.115:0/1354084539 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f797c04fe70 con 0x55990ce2e3f0 2023-07-27T14:27:21.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f7961ffb700 1 -- 172.21.15.115:0/1354084539 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f797c04ccc0 con 0x55990ce2e3f0 2023-07-27T14:27:21.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 10 client.4707 fetch_fsmap learned FSMap version 7 2023-07-27T14:27:21.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 1 -- 172.21.15.115:0/1354084539 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55990cbce1d0 con 0x55990ce2e3f0 2023-07-27T14:27:21.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f7961ffb700 1 -- 172.21.15.115:0/1354084539 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974001e90 con 0x55990ce2e3f0 2023-07-27T14:27:21.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f7961ffb700 1 -- 172.21.15.115:0/1354084539 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f797c050bb0 con 0x55990ce2e3f0 2023-07-27T14:27:21.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 10 client.4707 fetch_fsmap finished waiting for FSMap version 7 2023-07-27T14:27:21.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 10 client.4707 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T14:27:21.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 20 client.4707 populate_metadata read hostname 'smithi115' 2023-07-27T14:27:21.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] conn(0x55990ce6bc80 0x55990ce6c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 4 client.4707 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-07-27T14:27:21.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79a1224b80 1 -- 172.21.15.115:0/1354084539 --> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55990cbfe040 con 0x55990ce6bc80 2023-07-27T14:27:21.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.220+0000 7f79837fe700 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] conn(0x55990ce6bc80 0x55990ce6c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.221+0000 7f7961ffb700 10 client.4707 ms_handle_connect on v2:172.21.15.159:6833/3004855447 2023-07-27T14:27:21.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.221+0000 7f79837fe700 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] conn(0x55990ce6bc80 0x55990ce6c060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=758b2dc1b2a740e5 server_cookie=9012415afcbb99a in_seq=0 out_seq=0 2023-07-27T14:27:21.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.221+0000 7f7961ffb700 1 -- 172.21.15.115:0/1354084539 <== mds.0 v2:172.21.15.159:6833/3004855447 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55990cbfe040 con 0x55990ce6bc80 2023-07-27T14:27:21.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.221+0000 7f7961ffb700 10 client.4707 handle_command_reply: tid=0 2023-07-27T14:27:21.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.221+0000 7f79a1224b80 1 client.4707 shutdown 2023-07-27T14:27:21.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 -- 172.21.15.115:0/1354084539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce2e3f0 msgr2=0x55990ce56470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce2e3f0 0x55990ce56470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f797c0508b0 tx=0x7f797c028040).stop 2023-07-27T14:27:21.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 -- 172.21.15.115:0/1354084539 shutdown_connections 2023-07-27T14:27:21.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55990ce2e3f0 0x55990ce56470 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:6833/3004855447,v1:172.21.15.159:6835/3004855447] conn(0x55990ce6bc80 0x55990ce6c060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55990ce0d5c0 0x55990ceb86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 --2- 172.21.15.115:0/1354084539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55990ce0ff60 0x55990ce55a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:21.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f7961ffb700 0 client.4707 ms_handle_reset on v2:172.21.15.159:6833/3004855447 2023-07-27T14:27:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 -- 172.21.15.115:0/1354084539 >> 172.21.15.115:0/1354084539 conn(0x55990cc78940 msgr2=0x55990ce08550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 -- 172.21.15.115:0/1354084539 shutdown_connections 2023-07-27T14:27:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 1 -- 172.21.15.115:0/1354084539 wait complete. 2023-07-27T14:27:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f79a1224b80 20 client.4707 trim_cache size 0 max 16384 2023-07-27T14:27:21.245 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:27:21.246 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:27:21.246 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:27:21.246 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4279, 2023-07-27T14:27:21.246 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:27:21.246 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:27:21.246 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:27:21.246 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 19.965212770000001, 2023-07-27T14:27:21.247 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 7, 2023-07-27T14:27:21.247 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 22, 2023-07-27T14:27:21.247 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 22, 2023-07-27T14:27:21.247 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 25.452999997999999 2023-07-27T14:27:21.247 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:27:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f7989dff700 1 -- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f797005ed90 msgr2=0x7f7970061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f7989dff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f797005ed90 0x7f7970061250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7974001510 tx=0x7f79740079c0).stop 2023-07-27T14:27:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f7989dff700 1 -- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 msgr2=0x7f79840ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.222+0000 7f7989dff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840ab070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f797c010000 tx=0x7f79840c0530).stop 2023-07-27T14:27:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.223+0000 7f7989dff700 1 -- 172.21.15.115:0/839274065 shutdown_connections 2023-07-27T14:27:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.223+0000 7f7989dff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f797005ed90 0x7f7970061250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.223+0000 7f7989dff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79841542a0 0x7f79840ab070 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.223+0000 7f7989dff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79840aaa40 0x7f79840b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.223+0000 7f7989dff700 1 --2- 172.21.15.115:0/839274065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7984153ec0 0x7f798413e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.223+0000 7f7989dff700 1 -- 172.21.15.115:0/839274065 >> 172.21.15.115:0/839274065 conn(0x7f79840cb610 msgr2=0x7f79840c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.223+0000 7f7989dff700 1 -- 172.21.15.115:0/839274065 shutdown_connections 2023-07-27T14:27:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.223+0000 7f7989dff700 1 -- 172.21.15.115:0/839274065 wait complete. 2023-07-27T14:27:21.252 INFO:teuthology.run_tasks:Running task kclient... 2023-07-27T14:27:21.275 INFO:tasks.kclient:Mounting kernel clients... 2023-07-27T14:27:21.276 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-27T14:27:21.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:21.277 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:27:21.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:21.325 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-07-27T14:27:21.398 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-07-27T14:27:21.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:27:21.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:21.401 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:27:21.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:21.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-07-27T14:27:21.520 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-07-27T14:27:21.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:27:21.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:21.524 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:27:21.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:21.578 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-07-27T14:27:21.657 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2023-07-27T14:27:21.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:27:21.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:21.661 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:27:21.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:21.708 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-07-27T14:27:21.781 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2023-07-27T14:27:21.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:27:21.784 INFO:tasks.kclient:client.0 config is {} 2023-07-27T14:27:21.784 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:27:21.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.928+0000 7f71587ff700 1 Processor -- start 2023-07-27T14:27:21.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.929+0000 7f71587ff700 1 -- start start 2023-07-27T14:27:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f71587ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7150154190 0x7f71500a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f71587ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f71500c64b0 0x7f71500641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f71587ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71500646c0 0x7f71500bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f71587ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71500aa640 con 0x7f71500646c0 2023-07-27T14:27:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f71587ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7150064b70 con 0x7f71500c64b0 2023-07-27T14:27:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f71587ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7150158e00 con 0x7f7150154190 2023-07-27T14:27:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f7156d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71500646c0 0x7f71500bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f7156d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71500646c0 0x7f71500bfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47732/0 (socket says 172.21.15.115:47732) 2023-07-27T14:27:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f7156d9c700 1 -- 172.21.15.115:0/2768057213 learned_addr learned my addr 172.21.15.115:0/2768057213 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f715659b700 1 --2- 172.21.15.115:0/2768057213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7150154190 0x7f71500a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.930+0000 7f7155d9a700 1 --2- 172.21.15.115:0/2768057213 >> v2:172.21.15.159:3300/0 conn(0x7f71500c64b0 0x7f71500641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7156d9c700 1 -- 172.21.15.115:0/2768057213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7150154190 msgr2=0x7f71500a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7156d9c700 1 --2- 172.21.15.115:0/2768057213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7150154190 0x7f71500a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7156d9c700 1 -- 172.21.15.115:0/2768057213 >> v2:172.21.15.159:3300/0 conn(0x7f71500c64b0 msgr2=0x7f71500641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:21.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7156d9c700 1 --2- 172.21.15.115:0/2768057213 >> v2:172.21.15.159:3300/0 conn(0x7f71500c64b0 0x7f71500641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7156d9c700 1 -- 172.21.15.115:0/2768057213 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150158040 con 0x7f71500646c0 2023-07-27T14:27:21.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7156d9c700 1 --2- 172.21.15.115:0/2768057213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f71500bfc00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7150084030 tx=0x7f7148009840).ready entity=mon.0 client_cookie=44c32ab23f44ba95 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7155599700 1 -- 172.21.15.115:0/2768057213 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714800e070 con 0x7f71500646c0 2023-07-27T14:27:21.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7155599700 1 -- 172.21.15.115:0/2768057213 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714800ba50 con 0x7f71500646c0 2023-07-27T14:27:21.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f7155599700 1 -- 172.21.15.115:0/2768057213 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714800bdd0 con 0x7f71500646c0 2023-07-27T14:27:21.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f71587ff700 1 -- 172.21.15.115:0/2768057213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 msgr2=0x7f71500bfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.931+0000 7f71587ff700 1 --2- 172.21.15.115:0/2768057213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f71500bfc00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7150084030 tx=0x7f7148009840).stop 2023-07-27T14:27:21.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.932+0000 7f71587ff700 1 -- 172.21.15.115:0/2768057213 shutdown_connections 2023-07-27T14:27:21.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.932+0000 7f71587ff700 1 --2- 172.21.15.115:0/2768057213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f71500bfc00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.932+0000 7f71587ff700 1 --2- 172.21.15.115:0/2768057213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7150154190 0x7f71500a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.932+0000 7f71587ff700 1 --2- 172.21.15.115:0/2768057213 >> v2:172.21.15.159:3300/0 conn(0x7f71500c64b0 0x7f71500641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.932+0000 7f71587ff700 1 -- 172.21.15.115:0/2768057213 >> 172.21.15.115:0/2768057213 conn(0x7f71500cb730 msgr2=0x7f71500c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:21.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.932+0000 7f71587ff700 1 -- 172.21.15.115:0/2768057213 shutdown_connections 2023-07-27T14:27:21.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.932+0000 7f71587ff700 1 -- 172.21.15.115:0/2768057213 wait complete. 2023-07-27T14:27:21.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.933+0000 7f71587ff700 1 Processor -- start 2023-07-27T14:27:21.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.933+0000 7f71587ff700 1 -- start start 2023-07-27T14:27:21.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f71587ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f7150140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f71587ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71500c64b0 0x7f71500b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f71587ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7150154190 0x7f71501533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f71587ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7150156490 con 0x7f71500646c0 2023-07-27T14:27:21.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f71587ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500b0100 con 0x7f7150154190 2023-07-27T14:27:21.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f71587ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7150155460 con 0x7f71500c64b0 2023-07-27T14:27:21.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f715659b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f7150140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f715659b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f7150140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47742/0 (socket says 172.21.15.115:47742) 2023-07-27T14:27:21.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f715659b700 1 -- 172.21.15.115:0/2658089808 learned_addr learned my addr 172.21.15.115:0/2658089808 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:21.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.934+0000 7f7155d9a700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71500c64b0 0x7f71500b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f7156d9c700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7150154190 0x7f71501533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f715659b700 1 -- 172.21.15.115:0/2658089808 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71500c64b0 msgr2=0x7f71500b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f715659b700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71500c64b0 0x7f71500b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f715659b700 1 -- 172.21.15.115:0/2658089808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7150154190 msgr2=0x7f71501533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:21.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f715659b700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7150154190 0x7f71501533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:21.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f715659b700 1 -- 172.21.15.115:0/2658089808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009ae0 con 0x7f71500646c0 2023-07-27T14:27:21.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f715659b700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f7150140050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f714c00d890 tx=0x7f714c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f71467fc700 1 -- 172.21.15.115:0/2658089808 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c011590 con 0x7f71500646c0 2023-07-27T14:27:21.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f71467fc700 1 -- 172.21.15.115:0/2658089808 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c0116f0 con 0x7f71500646c0 2023-07-27T14:27:21.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f71467fc700 1 -- 172.21.15.115:0/2658089808 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c011a70 con 0x7f71500646c0 2023-07-27T14:27:21.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71500af7d0 con 0x7f71500646c0 2023-07-27T14:27:21.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.935+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71500afd90 con 0x7f71500646c0 2023-07-27T14:27:21.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.936+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71500b03e0 con 0x7f71500646c0 2023-07-27T14:27:21.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.937+0000 7f71467fc700 1 -- 172.21.15.115:0/2658089808 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f714c01c460 con 0x7f71500646c0 2023-07-27T14:27:21.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.938+0000 7f71467fc700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f713405ed90 0x7f7134061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:21.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.938+0000 7f71467fc700 1 -- 172.21.15.115:0/2658089808 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f714c079b00 con 0x7f71500646c0 2023-07-27T14:27:21.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.938+0000 7f7155d9a700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f713405ed90 0x7f7134061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:21.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.939+0000 7f7155d9a700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f713405ed90 0x7f7134061250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7150154160 tx=0x7f7140008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:21.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:21.943+0000 7f71467fc700 1 -- 172.21.15.115:0/2658089808 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f714c07be60 con 0x7f71500646c0 2023-07-27T14:27:22.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.158+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f715005f0c0 con 0x7f71500646c0 2023-07-27T14:27:22.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.158+0000 7f71467fc700 1 -- 172.21.15.115:0/2658089808 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f714c04af30 con 0x7f71500646c0 2023-07-27T14:27:22.173 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:27:22.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f713405ed90 msgr2=0x7f7134061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f713405ed90 0x7f7134061250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7150154160 tx=0x7f7140008040).stop 2023-07-27T14:27:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 msgr2=0x7f7150140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f7150140050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f714c00d890 tx=0x7f714c008040).stop 2023-07-27T14:27:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 shutdown_connections 2023-07-27T14:27:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f713405ed90 0x7f7134061250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7150154190 0x7f71501533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71500646c0 0x7f7150140050 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 --2- 172.21.15.115:0/2658089808 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71500c64b0 0x7f71500b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.160+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 >> 172.21.15.115:0/2658089808 conn(0x7f71500cb730 msgr2=0x7f7150152840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.161+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 shutdown_connections 2023-07-27T14:27:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:22.161+0000 7f71587ff700 1 -- 172.21.15.115:0/2658089808 wait complete. 2023-07-27T14:27:22.188 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T14:27:22.189 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:27:22.189 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:27:22.189 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:27:22.189 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:27:22.190 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T14:27:22.190 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T14:27:22.190 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:27:22.190 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:27:22.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:22.191 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:27:22.237 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:27:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:27:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:27:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:27:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:22.238 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:27:22.238 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:27:22.239 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:22.239 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:27:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:27:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41959sec preferred_lft 41959sec 2023-07-27T14:27:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:27:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:22.241 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-27T14:27:22.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:22.241 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:22.242 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:22.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2023-07-27T14:27:22.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2023-07-27T14:27:22.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2023-07-27T14:27:22.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-27T14:27:22.243 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:22.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:22.709 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:27:22.815 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:27:22.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:22.819 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:27:22.896 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:27:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:27:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:27:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:27:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:27:22.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:22.898 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:22.899 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:22.899 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:27:22.899 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:27:22.899 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:27:22.900 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:23.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:23.588 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:27:23.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:23.636 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-07-27T14:27:23.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:23.683 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:23.683 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:23.684 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:27:23.684 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-27T14:27:23.685 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:23.865 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-27T14:27:23.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:23.866 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:23.866 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:23.866 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-27T14:27:23.867 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-27T14:27:23.867 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-27T14:27:23.867 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-27T14:27:23.867 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-27T14:27:23.867 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:24.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:24.142 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:24.142 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:24.142 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:27:24.142 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2023-07-27T14:27:24.143 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:24.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:24.314 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:27:24.360 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:27:24.361 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:24.499 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:24.499 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:27:24.949 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:24.949 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:27:24.953 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:27:24.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:24.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:27:25.025 INFO:tasks.kclient:client.2 config is {} 2023-07-27T14:27:25.025 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:27:25.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.168+0000 7ff73bdff700 1 Processor -- start 2023-07-27T14:27:25.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.168+0000 7ff73bdff700 1 -- start start 2023-07-27T14:27:25.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff73bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 0x7ff734154350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:25.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff73bdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff7340c5bf0 0x7ff7340c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:25.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff73bdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7340c6590 con 0x7ff734153f70 2023-07-27T14:27:25.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff73bdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7340bfc10 con 0x7ff7340c5bf0 2023-07-27T14:27:25.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff73bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340c0750 con 0x7ff7340aac40 2023-07-27T14:27:25.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff73a39c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff7340c5bf0 0x7ff7340c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:25.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff739b9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff734153f70 0x7ff7340a9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55742/0 (socket says 172.21.15.115:55742) 2023-07-27T14:27:25.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff739b9b700 1 -- 172.21.15.115:0/4016940960 learned_addr learned my addr 172.21.15.115:0/4016940960 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:25.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.170+0000 7ff73939a700 1 --2- 172.21.15.115:0/4016940960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 0x7ff734154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:25.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff73a39c700 1 -- 172.21.15.115:0/4016940960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 msgr2=0x7ff734154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:25.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff73a39c700 1 --2- 172.21.15.115:0/4016940960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 0x7ff734154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff73a39c700 1 -- 172.21.15.115:0/4016940960 >> v1:172.21.15.115:6789/0 conn(0x7ff734153f70 legacy=0x7ff7340a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:25.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff738b99700 1 -- 172.21.15.115:0/4016940960 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762925842 0 0) 0x7ff730001110 con 0x7ff734153f70 2023-07-27T14:27:25.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff73a39c700 1 -- 172.21.15.115:0/4016940960 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7340bfe20 con 0x7ff7340c5bf0 2023-07-27T14:27:25.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff73a39c700 1 --2- 172.21.15.115:0/4016940960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c60a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7ff72c009e60 tx=0x7ff72c009780).ready entity=mon.0 client_cookie=f0742cc9f484192c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:25.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff738b99700 1 -- 172.21.15.115:0/4016940960 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00e070 con 0x7ff7340c5bf0 2023-07-27T14:27:25.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff738b99700 1 -- 172.21.15.115:0/4016940960 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c00bc30 con 0x7ff7340c5bf0 2023-07-27T14:27:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff738b99700 1 -- 172.21.15.115:0/4016940960 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c012410 con 0x7ff7340c5bf0 2023-07-27T14:27:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff73bdff700 1 -- 172.21.15.115:0/4016940960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 msgr2=0x7ff7340c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.171+0000 7ff73bdff700 1 --2- 172.21.15.115:0/4016940960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c60a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7ff72c009e60 tx=0x7ff72c009780).stop 2023-07-27T14:27:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.172+0000 7ff73bdff700 1 -- 172.21.15.115:0/4016940960 shutdown_connections 2023-07-27T14:27:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.172+0000 7ff73bdff700 1 --2- 172.21.15.115:0/4016940960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c60a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.172+0000 7ff73bdff700 1 --2- 172.21.15.115:0/4016940960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 0x7ff734154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.172+0000 7ff73bdff700 1 -- 172.21.15.115:0/4016940960 >> 172.21.15.115:0/4016940960 conn(0x7ff7340cb780 msgr2=0x7ff7340c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.172+0000 7ff73bdff700 1 -- 172.21.15.115:0/4016940960 shutdown_connections 2023-07-27T14:27:25.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.172+0000 7ff73bdff700 1 -- 172.21.15.115:0/4016940960 wait complete. 2023-07-27T14:27:25.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.173+0000 7ff73bdff700 1 Processor -- start 2023-07-27T14:27:25.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.173+0000 7ff73bdff700 1 -- start start 2023-07-27T14:27:25.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.174+0000 7ff73bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 0x7ff7340af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:25.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.174+0000 7ff73bdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:25.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.174+0000 7ff73bdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff734153f70 0x7ff73414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:25.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.174+0000 7ff73bdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340c4a10 con 0x7ff7340c5bf0 2023-07-27T14:27:25.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.174+0000 7ff73bdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340c1ef0 con 0x7ff734153f70 2023-07-27T14:27:25.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.174+0000 7ff73bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340c21d0 con 0x7ff7340aac40 2023-07-27T14:27:25.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:25.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53326/0 (socket says 172.21.15.115:53326) 2023-07-27T14:27:25.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 -- 172.21.15.115:0/492935391 learned_addr learned my addr 172.21.15.115:0/492935391 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:25.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff739b9b700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 0x7ff7340af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:25.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73a39c700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff734153f70 0x7ff73414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:25.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 -- 172.21.15.115:0/492935391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 msgr2=0x7ff7340af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:25.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 0x7ff7340af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 -- 172.21.15.115:0/492935391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff734153f70 msgr2=0x7ff73414fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:25.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff734153f70 0x7ff73414fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 -- 172.21.15.115:0/492935391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c009a20 con 0x7ff7340c5bf0 2023-07-27T14:27:25.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73939a700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c4230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7ff72400d890 tx=0x7ff724008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:25.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff729ffb700 1 -- 172.21.15.115:0/492935391 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724011590 con 0x7ff7340c5bf0 2023-07-27T14:27:25.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff729ffb700 1 -- 172.21.15.115:0/492935391 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7240116f0 con 0x7ff7340c5bf0 2023-07-27T14:27:25.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7340c24b0 con 0x7ff7340c5bf0 2023-07-27T14:27:25.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.175+0000 7ff729ffb700 1 -- 172.21.15.115:0/492935391 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724011a70 con 0x7ff7340c5bf0 2023-07-27T14:27:25.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.176+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7340c4720 con 0x7ff7340c5bf0 2023-07-27T14:27:25.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.176+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7340c2950 con 0x7ff7340c5bf0 2023-07-27T14:27:25.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.177+0000 7ff729ffb700 1 -- 172.21.15.115:0/492935391 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff72401c460 con 0x7ff7340c5bf0 2023-07-27T14:27:25.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.178+0000 7ff729ffb700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff71805ed90 0x7ff718061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:25.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.178+0000 7ff729ffb700 1 -- 172.21.15.115:0/492935391 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff724079a90 con 0x7ff7340c5bf0 2023-07-27T14:27:25.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.178+0000 7ff739b9b700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff71805ed90 0x7ff718061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:25.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.179+0000 7ff739b9b700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff71805ed90 0x7ff718061250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff730007fd0 tx=0x7ff730007dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:25.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.182+0000 7ff729ffb700 1 -- 172.21.15.115:0/492935391 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff72404aec0 con 0x7ff7340c5bf0 2023-07-27T14:27:25.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.396+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff73405f0c0 con 0x7ff7340c5bf0 2023-07-27T14:27:25.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.396+0000 7ff729ffb700 1 -- 172.21.15.115:0/492935391 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff724079030 con 0x7ff7340c5bf0 2023-07-27T14:27:25.412 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:27:25.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.398+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff71805ed90 msgr2=0x7ff718061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:25.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.398+0000 7ff73bdff700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff71805ed90 0x7ff718061250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff730007fd0 tx=0x7ff730007dd0).stop 2023-07-27T14:27:25.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 msgr2=0x7ff7340c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:25.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c4230 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7ff72400d890 tx=0x7ff724008040).stop 2023-07-27T14:27:25.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 shutdown_connections 2023-07-27T14:27:25.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff71805ed90 0x7ff718061250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff734153f70 0x7ff73414fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7340aac40 0x7ff7340af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 --2- 172.21.15.115:0/492935391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7340c5bf0 0x7ff7340c4230 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:25.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 >> 172.21.15.115:0/492935391 conn(0x7ff7340cb780 msgr2=0x7ff734152c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:25.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 shutdown_connections 2023-07-27T14:27:25.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:25.399+0000 7ff73bdff700 1 -- 172.21.15.115:0/492935391 wait complete. 2023-07-27T14:27:25.428 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T14:27:25.428 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:27:25.428 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:27:25.428 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-27T14:27:25.429 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-27T14:27:25.429 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T14:27:25.429 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T14:27:25.429 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:27:25.429 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-27T14:27:25.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:25.430 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:27:25.477 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:27:25.477 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:27:25.477 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:27:25.478 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:25.478 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:27:25.478 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:25.478 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:25.478 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:25.478 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:27:25.479 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:25.479 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:25.479 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:27:25.479 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:25.479 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:25.479 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:27:25.479 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:25.480 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:27:25.480 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41956sec preferred_lft 41956sec 2023-07-27T14:27:25.480 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:27:25.480 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:25.480 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:27:25.480 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:25.480 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:27:25.481 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:25.481 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:27:25.481 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:25.481 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:27:25.481 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:27:25.481 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:27:25.481 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:25.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:25.483 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:27:25.590 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:27:25.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:25.593 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:27:25.642 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:27:25.642 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:27:25.642 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:27:25.643 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:27:25.643 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:27:25.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:25.643 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:25.644 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:25.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:27:25.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:27:25.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:27:25.645 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:25.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:25.813 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:27:25.860 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:27:25.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:25.861 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-07-27T14:27:25.946 INFO:teuthology.orchestra.run.smithi115.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-27T14:27:25.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:25.947 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:25.948 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:25.948 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:27:25.948 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-27T14:27:25.948 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:26.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:26.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-27T14:27:26.200 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:27:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:27:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:27:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:27:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:26.201 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:27:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 8e:29:97:0a:38:62 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-27T14:27:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-27T14:27:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::8c29:97ff:fe0a:3862/64 scope link 2023-07-27T14:27:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:26.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:26.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-27T14:27:26.274 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:27:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:27:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:27:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:27:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:26.275 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:27:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 8e:29:97:0a:38:62 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-27T14:27:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-27T14:27:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::8c29:97ff:fe0a:3862/64 scope link 2023-07-27T14:27:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:26.276 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-27T14:27:26.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:26.277 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:26.277 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:26.278 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-27T14:27:26.278 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-27T14:27:26.278 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-27T14:27:26.278 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-27T14:27:26.279 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-27T14:27:26.279 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:26.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:26.527 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:27:26.527 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:27:26.527 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.1 up 2023-07-27T14:27:26.528 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.1 master ceph-brx 2023-07-27T14:27:26.528 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:27:26.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:26.701 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-07-27T14:27:26.747 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:27:26.747 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:26.884 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:26.884 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:27:26.911 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:26.911 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:27:26.916 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:27:26.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:26.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-27T14:27:26.986 INFO:tasks.kclient:client.1 config is {} 2023-07-27T14:27:26.986 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:27:27.155 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.140+0000 7f92565ff700 1 Processor -- start 2023-07-27T14:27:27.155 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.140+0000 7f92565ff700 1 -- start start 2023-07-27T14:27:27.156 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f92565ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500c64b0 0x7f92500641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:27.157 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f92565ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f92500646c0 0x7f9250154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:27.157 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f92565ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9250064b50 con 0x7f9250154190 2023-07-27T14:27:27.157 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f92565ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92500aa640 con 0x7f92500646c0 2023-07-27T14:27:27.157 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f92565ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9250158e00 con 0x7f92500c64b0 2023-07-27T14:27:27.157 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f924f7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500c64b0 0x7f92500641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:27.157 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f924f7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500c64b0 0x7f92500641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:35654/0 (socket says 172.21.15.159:35654) 2023-07-27T14:27:27.158 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f924f7fe700 1 -- 172.21.15.159:0/1074403187 learned_addr learned my addr 172.21.15.159:0/1074403187 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:27:27.158 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.142+0000 7f9254b9c700 1 --2- 172.21.15.159:0/1074403187 >> v2:172.21.15.115:3300/0 conn(0x7f92500646c0 0x7f9250154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:27.159 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f924f7fe700 1 -- 172.21.15.159:0/1074403187 >> v2:172.21.15.115:3300/0 conn(0x7f92500646c0 msgr2=0x7f9250154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:27.159 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f924f7fe700 1 --2- 172.21.15.159:0/1074403187 >> v2:172.21.15.115:3300/0 conn(0x7f92500646c0 0x7f9250154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.159 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f924f7fe700 1 -- 172.21.15.159:0/1074403187 >> v1:172.21.15.115:6789/0 conn(0x7f9250154190 legacy=0x7f92500a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:27.159 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f924f7fe700 1 -- 172.21.15.159:0/1074403187 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250158040 con 0x7f92500c64b0 2023-07-27T14:27:27.159 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f924f7fe700 1 --2- 172.21.15.159:0/1074403187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500c64b0 0x7f92500641d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9244006fd0 tx=0x7f92440090f0).ready entity=mon.2 client_cookie=68cb89bdf253bea9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:27.160 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f924effd700 1 -- 172.21.15.159:0/1074403187 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400b580 con 0x7f92500c64b0 2023-07-27T14:27:27.160 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f924effd700 1 -- 172.21.15.159:0/1074403187 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400b6e0 con 0x7f92500c64b0 2023-07-27T14:27:27.160 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f924effd700 1 -- 172.21.15.159:0/1074403187 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400ba80 con 0x7f92500c64b0 2023-07-27T14:27:27.160 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f92565ff700 1 -- 172.21.15.159:0/1074403187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500c64b0 msgr2=0x7f92500641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:27.160 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.143+0000 7f92565ff700 1 --2- 172.21.15.159:0/1074403187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500c64b0 0x7f92500641d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9244006fd0 tx=0x7f92440090f0).stop 2023-07-27T14:27:27.160 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.144+0000 7f92565ff700 1 -- 172.21.15.159:0/1074403187 shutdown_connections 2023-07-27T14:27:27.160 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.144+0000 7f92565ff700 1 --2- 172.21.15.159:0/1074403187 >> v2:172.21.15.115:3300/0 conn(0x7f92500646c0 0x7f9250154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.161 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.144+0000 7f92565ff700 1 --2- 172.21.15.159:0/1074403187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500c64b0 0x7f92500641d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.161 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.144+0000 7f92565ff700 1 -- 172.21.15.159:0/1074403187 >> 172.21.15.159:0/1074403187 conn(0x7f92500cb730 msgr2=0x7f92500c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:27.161 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.144+0000 7f92565ff700 1 -- 172.21.15.159:0/1074403187 shutdown_connections 2023-07-27T14:27:27.161 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.144+0000 7f92565ff700 1 -- 172.21.15.159:0/1074403187 wait complete. 2023-07-27T14:27:27.163 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.145+0000 7f92565ff700 1 Processor -- start 2023-07-27T14:27:27.163 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.145+0000 7f92565ff700 1 -- start start 2023-07-27T14:27:27.163 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f92565ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500646c0 0x7f92501449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:27.163 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f92565ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92500c64b0 0x7f92500af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:27.163 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f92565ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9250154190 0x7f92500af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:27.163 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f92565ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500c2eb0 con 0x7f9250154190 2023-07-27T14:27:27.163 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f92565ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500c22a0 con 0x7f92500c64b0 2023-07-27T14:27:27.164 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f92565ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500c2580 con 0x7f92500646c0 2023-07-27T14:27:27.164 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f924ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500646c0 0x7f92501449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:27.164 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f924f7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92500c64b0 0x7f92500af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:27.164 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f924ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500646c0 0x7f92501449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:35656/0 (socket says 172.21.15.159:35656) 2023-07-27T14:27:27.164 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f924f7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92500c64b0 0x7f92500af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43186/0 (socket says 172.21.15.159:43186) 2023-07-27T14:27:27.164 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.146+0000 7f924ffff700 1 -- 172.21.15.159:0/1603898860 learned_addr learned my addr 172.21.15.159:0/1603898860 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:27:27.164 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f9254b9c700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9250154190 0x7f92500af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:27.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f924ffff700 1 -- 172.21.15.159:0/1603898860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92500c64b0 msgr2=0x7f92500af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:27.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f924ffff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92500c64b0 0x7f92500af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f924ffff700 1 -- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9250154190 msgr2=0x7f92500af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:27.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f924ffff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9250154190 0x7f92500af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f924ffff700 1 -- 172.21.15.159:0/1603898860 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244009370 con 0x7f92500646c0 2023-07-27T14:27:27.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f9254b9c700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9250154190 0x7f92500af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:27.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f924ffff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500646c0 0x7f92501449b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f924000c4c0 tx=0x7f9240007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:27.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f9237fff700 1 -- 172.21.15.159:0/1603898860 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000ce70 con 0x7f92500646c0 2023-07-27T14:27:27.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f9237fff700 1 -- 172.21.15.159:0/1603898860 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240001e90 con 0x7f92500646c0 2023-07-27T14:27:27.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92500c2860 con 0x7f92500646c0 2023-07-27T14:27:27.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f9237fff700 1 -- 172.21.15.159:0/1603898860 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240007250 con 0x7f92500646c0 2023-07-27T14:27:27.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.147+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9250144ea0 con 0x7f92500646c0 2023-07-27T14:27:27.167 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.149+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925005f0c0 con 0x7f92500646c0 2023-07-27T14:27:27.167 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.149+0000 7f9237fff700 1 -- 172.21.15.159:0/1603898860 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9240010070 con 0x7f92500646c0 2023-07-27T14:27:27.167 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.150+0000 7f9237fff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f923c05ed90 0x7f923c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:27.167 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.150+0000 7f9237fff700 1 -- 172.21.15.159:0/1603898860 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9240079280 con 0x7f92500646c0 2023-07-27T14:27:27.167 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.151+0000 7f924f7fe700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f923c05ed90 0x7f923c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:27.167 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.151+0000 7f924f7fe700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f923c05ed90 0x7f923c061250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f924400b340 tx=0x7f9244017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:27.170 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.156+0000 7f9237fff700 1 -- 172.21.15.159:0/1603898860 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f924004a820 con 0x7f92500646c0 2023-07-27T14:27:27.379 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.365+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9250083500 con 0x7f92500646c0 2023-07-27T14:27:27.380 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.365+0000 7f9237fff700 1 -- 172.21.15.159:0/1603898860 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f924004de40 con 0x7f92500646c0 2023-07-27T14:27:27.380 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:27:27.382 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f923c05ed90 msgr2=0x7f923c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:27.382 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f923c05ed90 0x7f923c061250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f924400b340 tx=0x7f9244017000).stop 2023-07-27T14:27:27.382 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500646c0 msgr2=0x7f92501449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:27.382 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500646c0 0x7f92501449b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f924000c4c0 tx=0x7f9240007e00).stop 2023-07-27T14:27:27.382 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 shutdown_connections 2023-07-27T14:27:27.382 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f923c05ed90 0x7f923c061250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.382 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9250154190 0x7f92500af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.383 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92500646c0 0x7f92501449b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.383 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 --2- 172.21.15.159:0/1603898860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92500c64b0 0x7f92500af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:27.383 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 >> 172.21.15.159:0/1603898860 conn(0x7f92500cb730 msgr2=0x7f92500c5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:27.383 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 shutdown_connections 2023-07-27T14:27:27.383 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:27.367+0000 7f92565ff700 1 -- 172.21.15.159:0/1603898860 wait complete. 2023-07-27T14:27:27.396 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T14:27:27.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:27:27.397 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:27:27.397 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:27:27.397 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:27:27.397 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T14:27:27.398 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T14:27:27.398 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:27:27.398 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:27:27.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:27.398 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:27:27.444 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:27:27.445 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:27:27.445 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:27:27.445 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:27.445 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:27:27.445 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:27.445 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:27.446 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:27.446 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:27:27.446 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:27.446 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:27.446 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:27:27.446 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:27.446 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:27.446 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:27:27.447 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:27.447 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:27:27.447 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41949sec preferred_lft 41949sec 2023-07-27T14:27:27.447 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:27:27.447 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:27.448 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-27T14:27:27.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:27.449 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:27.449 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:27.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2023-07-27T14:27:27.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2023-07-27T14:27:27.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2023-07-27T14:27:27.450 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-27T14:27:27.450 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:27.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:27.922 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:27:28.032 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:27:28.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:28.035 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:27:28.113 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:27:28.113 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:27:28.114 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:27:28.114 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:27:28.114 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:27:28.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:28.115 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:28.116 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:28.116 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:27:28.116 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:27:28.116 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:27:28.117 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:28.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:27:28.223 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:27:28.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:28.835 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:27:28.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:28.882 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2023-07-27T14:27:28.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:28.929 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:28.929 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:28.930 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:27:28.930 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-27T14:27:28.930 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:29.072 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-27T14:27:29.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:29.073 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:29.073 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:29.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-27T14:27:29.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-27T14:27:29.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-27T14:27:29.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-27T14:27:29.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-27T14:27:29.075 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:29.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:29.350 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:29.351 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:29.351 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:27:29.351 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2023-07-27T14:27:29.351 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:29.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:29.525 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:27:29.570 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:27:29.571 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:29.709 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:29.710 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:27:30.159 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:30.159 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:27:30.163 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:27:30.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:30.164 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:27:30.234 INFO:tasks.kclient:client.3 config is {} 2023-07-27T14:27:30.235 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:27:30.394 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.379+0000 7f86c75ff700 1 Processor -- start 2023-07-27T14:27:30.394 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.379+0000 7f86c75ff700 1 -- start start 2023-07-27T14:27:30.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.380+0000 7f86c75ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:30.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.380+0000 7f86c75ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c0064b50 con 0x7f86c00646c0 2023-07-27T14:27:30.395 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.380+0000 7f86c75ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c0158e00 con 0x7f86c0154190 2023-07-27T14:27:30.396 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.380+0000 7f86c75ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00aa640 con 0x7f86c00c64b0 2023-07-27T14:27:30.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86c539b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f86c0154190 0x7f86c00a9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:48542/0 (socket says 172.21.15.159:48542) 2023-07-27T14:27:30.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86c539b700 1 -- 172.21.15.159:0/2181617908 learned_addr learned my addr 172.21.15.159:0/2181617908 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:27:30.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86c4b9a700 1 --2- 172.21.15.159:0/2181617908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:30.397 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86b7fff700 1 -- 172.21.15.159:0/2181617908 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036687263 0 0) 0x7f86c0158e00 con 0x7f86c0154190 2023-07-27T14:27:30.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86b7fff700 1 -- 172.21.15.159:0/2181617908 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86ac0033f0 con 0x7f86c0154190 2023-07-27T14:27:30.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86c4b9a700 1 -- 172.21.15.159:0/2181617908 >> v1:172.21.15.159:6789/0 conn(0x7f86c0154190 legacy=0x7f86c00a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:30.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86c4b9a700 1 -- 172.21.15.159:0/2181617908 >> v1:172.21.15.115:6789/0 conn(0x7f86c00646c0 legacy=0x7f86c0154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:30.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86c4b9a700 1 -- 172.21.15.159:0/2181617908 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0158040 con 0x7f86c00c64b0 2023-07-27T14:27:30.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.381+0000 7f86c4b9a700 1 --2- 172.21.15.159:0/2181617908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00641d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f86b0009790 tx=0x7f86b0009060).ready entity=mon.2 client_cookie=87edc732f7ad04b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:30.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86b7fff700 1 -- 172.21.15.159:0/2181617908 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00090d0 con 0x7f86c00c64b0 2023-07-27T14:27:30.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86b7fff700 1 -- 172.21.15.159:0/2181617908 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000f510 con 0x7f86c00c64b0 2023-07-27T14:27:30.398 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86b7fff700 1 -- 172.21.15.159:0/2181617908 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000f890 con 0x7f86c00c64b0 2023-07-27T14:27:30.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86c75ff700 1 -- 172.21.15.159:0/2181617908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 msgr2=0x7f86c00641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:30.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86c75ff700 1 --2- 172.21.15.159:0/2181617908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00641d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f86b0009790 tx=0x7f86b0009060).stop 2023-07-27T14:27:30.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86c75ff700 1 -- 172.21.15.159:0/2181617908 shutdown_connections 2023-07-27T14:27:30.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86c75ff700 1 --2- 172.21.15.159:0/2181617908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00641d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:30.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86c75ff700 1 -- 172.21.15.159:0/2181617908 >> 172.21.15.159:0/2181617908 conn(0x7f86c00cb730 msgr2=0x7f86c00c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:30.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86c75ff700 1 -- 172.21.15.159:0/2181617908 shutdown_connections 2023-07-27T14:27:30.399 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.382+0000 7f86c75ff700 1 -- 172.21.15.159:0/2181617908 wait complete. 2023-07-27T14:27:30.401 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.384+0000 7f86c75ff700 1 Processor -- start 2023-07-27T14:27:30.401 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.384+0000 7f86c75ff700 1 -- start start 2023-07-27T14:27:30.401 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c75ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c00646c0 0x7f86c0147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:30.402 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c75ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:30.402 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c75ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c0154190 0x7f86c00c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:30.402 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c75ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00c4eb0 con 0x7f86c0154190 2023-07-27T14:27:30.402 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c75ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00b0660 con 0x7f86c00646c0 2023-07-27T14:27:30.402 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c75ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00afa50 con 0x7f86c00c64b0 2023-07-27T14:27:30.402 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c4b9a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:30.402 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c539b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c00646c0 0x7f86c0147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:30.403 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c4b9a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:38290/0 (socket says 172.21.15.159:38290) 2023-07-27T14:27:30.403 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c4b9a700 1 -- 172.21.15.159:0/4012662263 learned_addr learned my addr 172.21.15.159:0/4012662263 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:27:30.403 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.385+0000 7f86c5b9c700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c0154190 0x7f86c00c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:30.403 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86c4b9a700 1 -- 172.21.15.159:0/4012662263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c00646c0 msgr2=0x7f86c0147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:30.403 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86c4b9a700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c00646c0 0x7f86c0147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:30.403 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86c4b9a700 1 -- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c0154190 msgr2=0x7f86c00c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:30.403 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86c4b9a700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c0154190 0x7f86c00c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:30.404 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86c4b9a700 1 -- 172.21.15.159:0/4012662263 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00092a0 con 0x7f86c00c64b0 2023-07-27T14:27:30.404 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86c4b9a700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00c44d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f86b0009e30 tx=0x7f86b0017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:30.404 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86b57fa700 1 -- 172.21.15.159:0/4012662263 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000f680 con 0x7f86c00c64b0 2023-07-27T14:27:30.404 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86b57fa700 1 -- 172.21.15.159:0/4012662263 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000f7e0 con 0x7f86c00c64b0 2023-07-27T14:27:30.404 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c00afd30 con 0x7f86c00c64b0 2023-07-27T14:27:30.404 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86b57fa700 1 -- 172.21.15.159:0/4012662263 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000fe80 con 0x7f86c00c64b0 2023-07-27T14:27:30.404 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.386+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c00b02f0 con 0x7f86c00c64b0 2023-07-27T14:27:30.405 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.387+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c00c6f10 con 0x7f86c00c64b0 2023-07-27T14:27:30.405 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.388+0000 7f86b57fa700 1 -- 172.21.15.159:0/4012662263 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f86b000f070 con 0x7f86c00c64b0 2023-07-27T14:27:30.405 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.389+0000 7f86b57fa700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f86a405ed90 0x7f86a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:30.406 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.389+0000 7f86b57fa700 1 -- 172.21.15.159:0/4012662263 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f86b007b360 con 0x7f86c00c64b0 2023-07-27T14:27:30.406 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.390+0000 7f86c539b700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f86a405ed90 0x7f86a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:30.406 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.390+0000 7f86c539b700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f86a405ed90 0x7f86a4061250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f86bc005750 tx=0x7f86bc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:30.408 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.393+0000 7f86b57fa700 1 -- 172.21.15.159:0/4012662263 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f86b004c790 con 0x7f86c00c64b0 2023-07-27T14:27:30.616 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.601+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86c00b07d0 con 0x7f86c00c64b0 2023-07-27T14:27:30.616 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.601+0000 7f86b57fa700 1 -- 172.21.15.159:0/4012662263 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f86b004fdb0 con 0x7f86c00c64b0 2023-07-27T14:27:30.617 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:27:30.619 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f86a405ed90 msgr2=0x7f86a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:30.619 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f86a405ed90 0x7f86a4061250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f86bc005750 tx=0x7f86bc009040).stop 2023-07-27T14:27:30.619 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 msgr2=0x7f86c00c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:30.619 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00c44d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f86b0009e30 tx=0x7f86b0017000).stop 2023-07-27T14:27:30.619 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 shutdown_connections 2023-07-27T14:27:30.620 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f86a405ed90 0x7f86a4061250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:30.620 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86c0154190 0x7f86c00c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:30.620 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c00646c0 0x7f86c0147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:30.620 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 --2- 172.21.15.159:0/4012662263 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86c00c64b0 0x7f86c00c44d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:30.620 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.603+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 >> 172.21.15.159:0/4012662263 conn(0x7f86c00cb730 msgr2=0x7f86c0155a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:30.620 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.604+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 shutdown_connections 2023-07-27T14:27:30.620 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:27:30.604+0000 7f86c75ff700 1 -- 172.21.15.159:0/4012662263 wait complete. 2023-07-27T14:27:30.634 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-27T14:27:30.635 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:27:30.635 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:27:30.635 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-27T14:27:30.635 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-27T14:27:30.636 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-27T14:27:30.636 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-27T14:27:30.636 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:27:30.637 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-27T14:27:30.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:30.637 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:27:30.684 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:27:30.684 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:27:30.684 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:27:30.685 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:30.685 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:27:30.685 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:30.685 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:30.685 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:30.685 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:27:30.685 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:30.686 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:30.686 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:27:30.686 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:27:30.686 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:30.686 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:27:30.686 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:30.686 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:27:30.686 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41946sec preferred_lft 41946sec 2023-07-27T14:27:30.687 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:27:30.687 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:30.687 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:27:30.687 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:27:30.687 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:27:30.687 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:30.687 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:27:30.687 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:30.688 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:27:30.688 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:27:30.688 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link tentative 2023-07-27T14:27:30.688 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:30.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:30.689 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:27:30.756 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:27:30.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:30.760 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:27:30.809 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:27:30.809 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:27:30.810 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:27:30.810 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:27:30.810 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:27:30.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:30.811 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:30.811 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:30.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:27:30.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:27:30.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:27:30.812 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:30.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:30.982 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:27:31.028 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:27:31.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:31.030 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2023-07-27T14:27:31.076 INFO:teuthology.orchestra.run.smithi159.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-27T14:27:31.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:31.077 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:31.077 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:31.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:27:31.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-27T14:27:31.078 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:31.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:31.259 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-27T14:27:31.330 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:27:31.330 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:27:31.330 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:27:31.331 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:31.331 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:27:31.331 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:31.331 INFO:teuthology.orchestra.run.smithi159.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:27:31.331 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 46:3f:19:a6:78:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-27T14:27:31.331 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-27T14:27:31.331 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:31.332 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::443f:19ff:fea6:78ef/64 scope link tentative 2023-07-27T14:27:31.332 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:31.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:31.333 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-27T14:27:31.404 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:27:31.404 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:27:31.404 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:27:31.404 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:31.405 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:27:31.405 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:31.405 INFO:teuthology.orchestra.run.smithi159.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:27:31.405 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 46:3f:19:a6:78:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-27T14:27:31.405 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-27T14:27:31.405 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:31.405 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::443f:19ff:fea6:78ef/64 scope link 2023-07-27T14:27:31.405 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:27:31.407 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-27T14:27:31.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:31.407 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:31.407 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:31.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-27T14:27:31.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-27T14:27:31.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-27T14:27:31.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-27T14:27:31.409 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-27T14:27:31.409 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:31.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:31.664 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:27:31.664 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:27:31.664 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.1 up 2023-07-27T14:27:31.665 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.1 master ceph-brx 2023-07-27T14:27:31.665 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:27:31.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:31.839 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-07-27T14:27:31.885 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:27:31.885 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:31.982 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:31.983 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:27:32.008 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:27:32.008 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:27:32.013 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:27:32.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:32.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-27T14:27:32.083 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-27T14:27:32.100 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.281+0000 7fc09bfff700 1 Processor -- start 2023-07-27T14:27:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.281+0000 7fc09bfff700 1 -- start start 2023-07-27T14:27:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc09bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094151d70 0x7fc094155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc09bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc094065ff0 0x7fc094066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc09bfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc094067080 con 0x7fc094066960 2023-07-27T14:27:32.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc09bfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc094063a90 con 0x7fc094065ff0 2023-07-27T14:27:32.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc09bfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc094068570 con 0x7fc094151d70 2023-07-27T14:27:32.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc09959a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc094065ff0 0x7fc094066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc09a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc094066960 0x7fc094157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55746/0 (socket says 172.21.15.115:55746) 2023-07-27T14:27:32.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc09a59c700 1 -- 172.21.15.115:0/1001664672 learned_addr learned my addr 172.21.15.115:0/1001664672 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:32.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.282+0000 7fc099d9b700 1 --2- 172.21.15.115:0/1001664672 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094151d70 0x7fc094155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc098d99700 1 -- 172.21.15.115:0/1001664672 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103053046 0 0) 0x7fc094067080 con 0x7fc094066960 2023-07-27T14:27:32.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc09959a700 1 -- 172.21.15.115:0/1001664672 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094151d70 msgr2=0x7fc094155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:32.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc09959a700 1 --2- 172.21.15.115:0/1001664672 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094151d70 0x7fc094155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc09959a700 1 -- 172.21.15.115:0/1001664672 >> v1:172.21.15.115:6789/0 conn(0x7fc094066960 legacy=0x7fc094157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc09959a700 1 -- 172.21.15.115:0/1001664672 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094066e10 con 0x7fc094065ff0 2023-07-27T14:27:32.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc09959a700 1 --2- 172.21.15.115:0/1001664672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc094066470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fc084009760 tx=0x7fc084009060).ready entity=mon.0 client_cookie=df363a7145986ec2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:32.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc098d99700 1 -- 172.21.15.115:0/1001664672 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400f510 con 0x7fc094065ff0 2023-07-27T14:27:32.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc098d99700 1 -- 172.21.15.115:0/1001664672 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400f670 con 0x7fc094065ff0 2023-07-27T14:27:32.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.283+0000 7fc098d99700 1 -- 172.21.15.115:0/1001664672 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400f9f0 con 0x7fc094065ff0 2023-07-27T14:27:32.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.284+0000 7fc09bfff700 1 -- 172.21.15.115:0/1001664672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 msgr2=0x7fc094066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.284+0000 7fc09bfff700 1 --2- 172.21.15.115:0/1001664672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc094066470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fc084009760 tx=0x7fc084009060).stop 2023-07-27T14:27:32.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.284+0000 7fc09bfff700 1 -- 172.21.15.115:0/1001664672 shutdown_connections 2023-07-27T14:27:32.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.284+0000 7fc09bfff700 1 --2- 172.21.15.115:0/1001664672 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094151d70 0x7fc094155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.284+0000 7fc09bfff700 1 --2- 172.21.15.115:0/1001664672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc094066470 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.284+0000 7fc09bfff700 1 -- 172.21.15.115:0/1001664672 >> 172.21.15.115:0/1001664672 conn(0x7fc0940c89a0 msgr2=0x7fc0940c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:32.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.284+0000 7fc09bfff700 1 -- 172.21.15.115:0/1001664672 shutdown_connections 2023-07-27T14:27:32.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.284+0000 7fc09bfff700 1 -- 172.21.15.115:0/1001664672 wait complete. 2023-07-27T14:27:32.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.285+0000 7fc09bfff700 1 Processor -- start 2023-07-27T14:27:32.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.285+0000 7fc09bfff700 1 -- start start 2023-07-27T14:27:32.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.286+0000 7fc09bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc0940a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.286+0000 7fc09bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094066960 0x7fc09414c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.286+0000 7fc09bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094151d70 0x7fc09414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.286+0000 7fc09bfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09414d030 con 0x7fc094065ff0 2023-07-27T14:27:32.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.286+0000 7fc09bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940ab950 con 0x7fc094151d70 2023-07-27T14:27:32.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.286+0000 7fc09bfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940aaac0 con 0x7fc094066960 2023-07-27T14:27:32.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc0940a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc0940a6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53338/0 (socket says 172.21.15.115:53338) 2023-07-27T14:27:32.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 -- 172.21.15.115:0/3092195359 learned_addr learned my addr 172.21.15.115:0/3092195359 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:32.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc09959a700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094066960 0x7fc09414c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc09a59c700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094151d70 0x7fc09414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 -- 172.21.15.115:0/3092195359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094066960 msgr2=0x7fc09414c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094066960 0x7fc09414c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 -- 172.21.15.115:0/3092195359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094151d70 msgr2=0x7fc09414cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094151d70 0x7fc09414cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 -- 172.21.15.115:0/3092195359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0840092a0 con 0x7fc094065ff0 2023-07-27T14:27:32.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc099d9b700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc0940a6b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc09000e900 tx=0x7fc090009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:32.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc089ffb700 1 -- 172.21.15.115:0/3092195359 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090012600 con 0x7fc094065ff0 2023-07-27T14:27:32.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc089ffb700 1 -- 172.21.15.115:0/3092195359 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090012760 con 0x7fc094065ff0 2023-07-27T14:27:32.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0940aada0 con 0x7fc094065ff0 2023-07-27T14:27:32.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.287+0000 7fc089ffb700 1 -- 172.21.15.115:0/3092195359 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090012ae0 con 0x7fc094065ff0 2023-07-27T14:27:32.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.288+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940abc10 con 0x7fc094065ff0 2023-07-27T14:27:32.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.289+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940abe30 con 0x7fc094065ff0 2023-07-27T14:27:32.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.289+0000 7fc089ffb700 1 -- 172.21.15.115:0/3092195359 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc090022070 con 0x7fc094065ff0 2023-07-27T14:27:32.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.290+0000 7fc089ffb700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc07805ed60 0x7fc078061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.290+0000 7fc089ffb700 1 -- 172.21.15.115:0/3092195359 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc090079d90 con 0x7fc094065ff0 2023-07-27T14:27:32.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.290+0000 7fc09959a700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc07805ed60 0x7fc078061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.291+0000 7fc09959a700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc07805ed60 0x7fc078061220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc084009760 tx=0x7fc084017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:32.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.295+0000 7fc089ffb700 1 -- 172.21.15.115:0/3092195359 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc09004b220 con 0x7fc094065ff0 2023-07-27T14:27:32.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.462+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc09406c470 con 0x7fc094065ff0 2023-07-27T14:27:32.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.463+0000 7fc089ffb700 1 -- 172.21.15.115:0/3092195359 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7fc09004e840 con 0x7fc094065ff0 2023-07-27T14:27:32.479 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:32.479 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:32.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.465+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc07805ed60 msgr2=0x7fc078061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.465+0000 7fc09bfff700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc07805ed60 0x7fc078061220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc084009760 tx=0x7fc084017000).stop 2023-07-27T14:27:32.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.465+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 msgr2=0x7fc0940a6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.465+0000 7fc09bfff700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc0940a6b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc09000e900 tx=0x7fc090009060).stop 2023-07-27T14:27:32.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.466+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 shutdown_connections 2023-07-27T14:27:32.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.466+0000 7fc09bfff700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc07805ed60 0x7fc078061220 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.466+0000 7fc09bfff700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094151d70 0x7fc09414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.466+0000 7fc09bfff700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc094065ff0 0x7fc0940a6b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.466+0000 7fc09bfff700 1 --2- 172.21.15.115:0/3092195359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc094066960 0x7fc09414c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.466+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 >> 172.21.15.115:0/3092195359 conn(0x7fc0940c89a0 msgr2=0x7fc094153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:32.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.466+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 shutdown_connections 2023-07-27T14:27:32.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.466+0000 7fc09bfff700 1 -- 172.21.15.115:0/3092195359 wait complete. 2023-07-27T14:27:32.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:26:59.286583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:27:00.228329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:27:32.499 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:27:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.674+0000 7f0b747ff700 1 Processor -- start 2023-07-27T14:27:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.674+0000 7f0b747ff700 1 -- start start 2023-07-27T14:27:32.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.675+0000 7f0b747ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b6c14ae00 0x7f0b6c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.675+0000 7f0b747ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 0x7f0b6c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.675+0000 7f0b747ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c1553f0 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.675+0000 7f0b747ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c157a50 con 0x7f0b6c14ae00 2023-07-27T14:27:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.675+0000 7f0b747ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c157d10 con 0x7f0b6c063260 2023-07-27T14:27:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.675+0000 7f0b7259b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b6c14ae00 0x7f0b6c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.675+0000 7f0b71d9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0b6c14b1e0 0x7f0b6c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55760/0 (socket says 172.21.15.115:55760) 2023-07-27T14:27:32.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.675+0000 7f0b71d9a700 1 -- 172.21.15.115:0/591340954 learned_addr learned my addr 172.21.15.115:0/591340954 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:32.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b72d9c700 1 --2- 172.21.15.115:0/591340954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 0x7f0b6c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b7259b700 1 -- 172.21.15.115:0/591340954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 msgr2=0x7f0b6c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:32.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b7259b700 1 --2- 172.21.15.115:0/591340954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 0x7f0b6c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b7259b700 1 -- 172.21.15.115:0/591340954 >> v1:172.21.15.115:6789/0 conn(0x7f0b6c14b1e0 legacy=0x7f0b6c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b7259b700 1 -- 172.21.15.115:0/591340954 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c157ff0 con 0x7f0b6c14ae00 2023-07-27T14:27:32.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b71599700 1 -- 172.21.15.115:0/591340954 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696023778 0 0) 0x7f0b6c1553f0 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b7259b700 1 --2- 172.21.15.115:0/591340954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14ae00 0x7f0b6c154f00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f0b68009760 tx=0x7f0b68009060).ready entity=mon.0 client_cookie=483aa9bae5d111be server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:32.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b71599700 1 -- 172.21.15.115:0/591340954 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800b580 con 0x7f0b6c14ae00 2023-07-27T14:27:32.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b71599700 1 -- 172.21.15.115:0/591340954 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800b6e0 con 0x7f0b6c14ae00 2023-07-27T14:27:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.676+0000 7f0b71599700 1 -- 172.21.15.115:0/591340954 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800ba60 con 0x7f0b6c14ae00 2023-07-27T14:27:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.677+0000 7f0b747ff700 1 -- 172.21.15.115:0/591340954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14ae00 msgr2=0x7f0b6c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.677+0000 7f0b747ff700 1 --2- 172.21.15.115:0/591340954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14ae00 0x7f0b6c154f00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f0b68009760 tx=0x7f0b68009060).stop 2023-07-27T14:27:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.677+0000 7f0b747ff700 1 -- 172.21.15.115:0/591340954 shutdown_connections 2023-07-27T14:27:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.677+0000 7f0b747ff700 1 --2- 172.21.15.115:0/591340954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 0x7f0b6c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.677+0000 7f0b747ff700 1 --2- 172.21.15.115:0/591340954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14ae00 0x7f0b6c154f00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.677+0000 7f0b747ff700 1 -- 172.21.15.115:0/591340954 >> 172.21.15.115:0/591340954 conn(0x7f0b6c05e940 msgr2=0x7f0b6c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:32.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.677+0000 7f0b747ff700 1 -- 172.21.15.115:0/591340954 shutdown_connections 2023-07-27T14:27:32.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.677+0000 7f0b747ff700 1 -- 172.21.15.115:0/591340954 wait complete. 2023-07-27T14:27:32.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.678+0000 7f0b747ff700 1 Processor -- start 2023-07-27T14:27:32.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.679+0000 7f0b747ff700 1 -- start start 2023-07-27T14:27:32.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b747ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 0x7f0b6c168110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b747ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c14ae00 0x7f0b6c142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b747ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14b1e0 0x7f0b6c149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b747ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0aff50 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b747ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c168600 con 0x7f0b6c14ae00 2023-07-27T14:27:32.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b747ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0af340 con 0x7f0b6c063260 2023-07-27T14:27:32.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14b1e0 0x7f0b6c149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14b1e0 0x7f0b6c149150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53348/0 (socket says 172.21.15.115:53348) 2023-07-27T14:27:32.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 -- 172.21.15.115:0/3212235703 learned_addr learned my addr 172.21.15.115:0/3212235703 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:32.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b7259b700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 0x7f0b6c168110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b71d9a700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c14ae00 0x7f0b6c142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 -- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 msgr2=0x7f0b6c168110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 0x7f0b6c168110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 -- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c14ae00 msgr2=0x7f0b6c142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c14ae00 0x7f0b6c142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 -- 172.21.15.115:0/3212235703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680092a0 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b71d9a700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c14ae00 0x7f0b6c142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:32.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.680+0000 7f0b72d9c700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14b1e0 0x7f0b6c149150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f0b64007ef0 tx=0x7f0b64009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:32.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.681+0000 7f0b627fc700 1 -- 172.21.15.115:0/3212235703 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400ebe0 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.681+0000 7f0b627fc700 1 -- 172.21.15.115:0/3212235703 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6400ed40 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.681+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c0af620 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.681+0000 7f0b627fc700 1 -- 172.21.15.115:0/3212235703 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64014610 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.681+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c0afbe0 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.682+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c0b0100 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.683+0000 7f0b627fc700 1 -- 172.21.15.115:0/3212235703 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0b6401b030 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.683+0000 7f0b627fc700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b5005ed90 0x7f0b50061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:32.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.684+0000 7f0b627fc700 1 -- 172.21.15.115:0/3212235703 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b64079f70 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.684+0000 7f0b7259b700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b5005ed90 0x7f0b50061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:32.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.684+0000 7f0b7259b700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b5005ed90 0x7f0b50061250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0b6800b340 tx=0x7f0b68017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:32.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.687+0000 7f0b627fc700 1 -- 172.21.15.115:0/3212235703 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b6c0b0100 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.862+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0b6c06c470 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.863+0000 7f0b627fc700 1 -- 172.21.15.115:0/3212235703 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0b6404b400 con 0x7f0b6c14b1e0 2023-07-27T14:27:32.879 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:27:32.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b5005ed90 msgr2=0x7f0b50061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b5005ed90 0x7f0b50061250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0b6800b340 tx=0x7f0b68017000).stop 2023-07-27T14:27:32.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14b1e0 msgr2=0x7f0b6c149150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:32.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14b1e0 0x7f0b6c149150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f0b64007ef0 tx=0x7f0b64009840).stop 2023-07-27T14:27:32.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 shutdown_connections 2023-07-27T14:27:32.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b5005ed90 0x7f0b50061250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b6c14b1e0 0x7f0b6c149150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b6c063260 0x7f0b6c168110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 --2- 172.21.15.115:0/3212235703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b6c14ae00 0x7f0b6c142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:32.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 >> 172.21.15.115:0/3212235703 conn(0x7f0b6c05e940 msgr2=0x7f0b6c151880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:32.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 shutdown_connections 2023-07-27T14:27:32.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:32.865+0000 7f0b747ff700 1 -- 172.21.15.115:0/3212235703 wait complete. 2023-07-27T14:27:32.897 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:27:33.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.072+0000 7fe3b9f9d700 1 Processor -- start 2023-07-27T14:27:33.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.072+0000 7fe3b9f9d700 1 -- start start 2023-07-27T14:27:33.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.073+0000 7fe3b9f9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3b4150d50 0x7fe3b40c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.073+0000 7fe3b9f9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4064c20 0x7fe3b40650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.073+0000 7fe3b9f9d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b40bcc00 con 0x7fe3b40bb4b0 2023-07-27T14:27:33.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.073+0000 7fe3b9f9d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b4068e20 con 0x7fe3b4150d50 2023-07-27T14:27:33.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.073+0000 7fe3b9f9d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4065590 con 0x7fe3b4064c20 2023-07-27T14:27:33.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b979c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe3b40bb4b0 0x7fe3b40692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55762/0 (socket says 172.21.15.115:55762) 2023-07-27T14:27:33.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b979c700 1 -- 172.21.15.115:0/2043759492 learned_addr learned my addr 172.21.15.115:0/2043759492 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:33.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b8f9b700 1 --2- 172.21.15.115:0/2043759492 >> v2:172.21.15.115:3300/0 conn(0x7fe3b4150d50 0x7fe3b40c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b3fff700 1 --2- 172.21.15.115:0/2043759492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4064c20 0x7fe3b40650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b8f9b700 1 -- 172.21.15.115:0/2043759492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4064c20 msgr2=0x7fe3b40650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:33.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b8f9b700 1 --2- 172.21.15.115:0/2043759492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4064c20 0x7fe3b40650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b8f9b700 1 -- 172.21.15.115:0/2043759492 >> v1:172.21.15.115:6789/0 conn(0x7fe3b40bb4b0 legacy=0x7fe3b40692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b8f9b700 1 -- 172.21.15.115:0/2043759492 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40bc0c0 con 0x7fe3b4150d50 2023-07-27T14:27:33.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b37fe700 1 -- 172.21.15.115:0/2043759492 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745490041 0 0) 0x7fe3b40bcc00 con 0x7fe3b40bb4b0 2023-07-27T14:27:33.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b8f9b700 1 --2- 172.21.15.115:0/2043759492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4150d50 0x7fe3b40c0b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fe3a8009760 tx=0x7fe3a8009060).ready entity=mon.0 client_cookie=b166ac33d1cf2631 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b37fe700 1 -- 172.21.15.115:0/2043759492 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800f510 con 0x7fe3b4150d50 2023-07-27T14:27:33.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b37fe700 1 -- 172.21.15.115:0/2043759492 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a800f670 con 0x7fe3b4150d50 2023-07-27T14:27:33.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.074+0000 7fe3b37fe700 1 -- 172.21.15.115:0/2043759492 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800f9f0 con 0x7fe3b4150d50 2023-07-27T14:27:33.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.075+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/2043759492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4150d50 msgr2=0x7fe3b40c0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.075+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/2043759492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4150d50 0x7fe3b40c0b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fe3a8009760 tx=0x7fe3a8009060).stop 2023-07-27T14:27:33.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.075+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/2043759492 shutdown_connections 2023-07-27T14:27:33.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.075+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/2043759492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4150d50 0x7fe3b40c0b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.075+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/2043759492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4064c20 0x7fe3b40650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.075+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/2043759492 >> 172.21.15.115:0/2043759492 conn(0x7fe3b40c6fe0 msgr2=0x7fe3b40c2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:33.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.075+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/2043759492 shutdown_connections 2023-07-27T14:27:33.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.075+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/2043759492 wait complete. 2023-07-27T14:27:33.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.077+0000 7fe3b9f9d700 1 Processor -- start 2023-07-27T14:27:33.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.077+0000 7fe3b9f9d700 1 -- start start 2023-07-27T14:27:33.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b9f9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4064c20 0x7fe3b40a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b9f9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40bb4b0 0x7fe3b414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b9f9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4150d50 0x7fe3b40a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b9f9d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b414dfb0 con 0x7fe3b4064c20 2023-07-27T14:27:33.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b9f9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b414e280 con 0x7fe3b40bb4b0 2023-07-27T14:27:33.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b9f9d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b414e560 con 0x7fe3b4150d50 2023-07-27T14:27:33.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b8f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4064c20 0x7fe3b40a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b8f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4064c20 0x7fe3b40a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53364/0 (socket says 172.21.15.115:53364) 2023-07-27T14:27:33.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b8f9b700 1 -- 172.21.15.115:0/1998462872 learned_addr learned my addr 172.21.15.115:0/1998462872 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:33.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b979c700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4150d50 0x7fe3b40a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b3fff700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40bb4b0 0x7fe3b414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b8f9b700 1 -- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4150d50 msgr2=0x7fe3b40a88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b8f9b700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4150d50 0x7fe3b40a88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b8f9b700 1 -- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40bb4b0 msgr2=0x7fe3b414dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.078+0000 7fe3b8f9b700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40bb4b0 0x7fe3b414dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b8f9b700 1 -- 172.21.15.115:0/1998462872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a80092a0 con 0x7fe3b4064c20 2023-07-27T14:27:33.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b3fff700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40bb4b0 0x7fe3b414dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:33.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b979c700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4150d50 0x7fe3b40a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:33.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b8f9b700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4064c20 0x7fe3b40a07f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe3b40607e0 tx=0x7fe3a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b0ff9700 1 -- 172.21.15.115:0/1998462872 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80117e0 con 0x7fe3b4064c20 2023-07-27T14:27:33.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b0ff9700 1 -- 172.21.15.115:0/1998462872 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8011960 con 0x7fe3b4064c20 2023-07-27T14:27:33.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b0ff9700 1 -- 172.21.15.115:0/1998462872 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8011d20 con 0x7fe3b4064c20 2023-07-27T14:27:33.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b414e840 con 0x7fe3b4064c20 2023-07-27T14:27:33.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.079+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b414ee00 con 0x7fe3b4064c20 2023-07-27T14:27:33.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.080+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b414ef90 con 0x7fe3b4064c20 2023-07-27T14:27:33.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.081+0000 7fe3b0ff9700 1 -- 172.21.15.115:0/1998462872 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe3a800f070 con 0x7fe3b4064c20 2023-07-27T14:27:33.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.082+0000 7fe3b0ff9700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe39805ed90 0x7fe398061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.083+0000 7fe3b0ff9700 1 -- 172.21.15.115:0/1998462872 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe3a807ae10 con 0x7fe3b4064c20 2023-07-27T14:27:33.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.083+0000 7fe3b3fff700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe39805ed90 0x7fe398061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.083+0000 7fe3b3fff700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe39805ed90 0x7fe398061250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe3a0006d80 tx=0x7fe3a0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.087+0000 7fe3b0ff9700 1 -- 172.21.15.115:0/1998462872 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3a804c350 con 0x7fe3b4064c20 2023-07-27T14:27:33.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.254+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3b414f170 con 0x7fe3b4064c20 2023-07-27T14:27:33.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.254+0000 7fe3b0ff9700 1 -- 172.21.15.115:0/1998462872 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3a8027070 con 0x7fe3b4064c20 2023-07-27T14:27:33.270 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:27:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe39805ed90 msgr2=0x7fe398061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe39805ed90 0x7fe398061250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe3a0006d80 tx=0x7fe3a0008040).stop 2023-07-27T14:27:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4064c20 msgr2=0x7fe3b40a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4064c20 0x7fe3b40a07f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe3b40607e0 tx=0x7fe3a8017000).stop 2023-07-27T14:27:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 shutdown_connections 2023-07-27T14:27:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe39805ed90 0x7fe398061250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b4150d50 0x7fe3b40a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3b4064c20 0x7fe3b40a07f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 --2- 172.21.15.115:0/1998462872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b40bb4b0 0x7fe3b414dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 >> 172.21.15.115:0/1998462872 conn(0x7fe3b40c6fe0 msgr2=0x7fe3b40692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:33.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 shutdown_connections 2023-07-27T14:27:33.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.256+0000 7fe3b9f9d700 1 -- 172.21.15.115:0/1998462872 wait complete. 2023-07-27T14:27:33.290 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:27:33.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.467+0000 7fecb4bff700 1 Processor -- start 2023-07-27T14:27:33.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.467+0000 7fecb4bff700 1 -- start start 2023-07-27T14:27:33.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.468+0000 7fecb4bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecb0063260 0x7fecb0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.468+0000 7fecb4bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fecb014b1e0 0x7fecb00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.468+0000 7fecb4bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb01553f0 con 0x7fecb014ae00 2023-07-27T14:27:33.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.468+0000 7fecb4bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb0157a50 con 0x7fecb0063260 2023-07-27T14:27:33.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.468+0000 7fecb4bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb0157d10 con 0x7fecb014b1e0 2023-07-27T14:27:33.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecadd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecb0063260 0x7fecb0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecadd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecb0063260 0x7fecb0154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53372/0 (socket says 172.21.15.115:53372) 2023-07-27T14:27:33.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecadd9b700 1 -- 172.21.15.115:0/1847583856 learned_addr learned my addr 172.21.15.115:0/1847583856 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:33.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecaed9d700 1 --2- 172.21.15.115:0/1847583856 >> v2:172.21.15.159:3300/0 conn(0x7fecb014b1e0 0x7fecb00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecadd9b700 1 -- 172.21.15.115:0/1847583856 >> v2:172.21.15.159:3300/0 conn(0x7fecb014b1e0 msgr2=0x7fecb00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:33.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecadd9b700 1 --2- 172.21.15.115:0/1847583856 >> v2:172.21.15.159:3300/0 conn(0x7fecb014b1e0 0x7fecb00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecadd9b700 1 -- 172.21.15.115:0/1847583856 >> v1:172.21.15.159:6789/0 conn(0x7fecb014ae00 legacy=0x7fecb0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:33.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecadd9b700 1 -- 172.21.15.115:0/1847583856 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0157ff0 con 0x7fecb0063260 2023-07-27T14:27:33.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecadd9b700 1 --2- 172.21.15.115:0/1847583856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb0063260 0x7fecb0154f00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fecb0083430 tx=0x7feca40090f0).ready entity=mon.0 client_cookie=a639afd811ab1422 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecad59a700 1 -- 172.21.15.115:0/1847583856 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400b5a0 con 0x7fecb0063260 2023-07-27T14:27:33.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecad59a700 1 -- 172.21.15.115:0/1847583856 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca400b700 con 0x7fecb0063260 2023-07-27T14:27:33.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.469+0000 7fecad59a700 1 -- 172.21.15.115:0/1847583856 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400ba80 con 0x7fecb0063260 2023-07-27T14:27:33.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.470+0000 7fecb4bff700 1 -- 172.21.15.115:0/1847583856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb0063260 msgr2=0x7fecb0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.470+0000 7fecb4bff700 1 --2- 172.21.15.115:0/1847583856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb0063260 0x7fecb0154f00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fecb0083430 tx=0x7feca40090f0).stop 2023-07-27T14:27:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.470+0000 7fecb4bff700 1 -- 172.21.15.115:0/1847583856 shutdown_connections 2023-07-27T14:27:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.470+0000 7fecb4bff700 1 --2- 172.21.15.115:0/1847583856 >> v2:172.21.15.159:3300/0 conn(0x7fecb014b1e0 0x7fecb00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.470+0000 7fecb4bff700 1 --2- 172.21.15.115:0/1847583856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb0063260 0x7fecb0154f00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.470+0000 7fecb4bff700 1 -- 172.21.15.115:0/1847583856 >> 172.21.15.115:0/1847583856 conn(0x7fecb005e940 msgr2=0x7fecb00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.470+0000 7fecb4bff700 1 -- 172.21.15.115:0/1847583856 shutdown_connections 2023-07-27T14:27:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.470+0000 7fecb4bff700 1 -- 172.21.15.115:0/1847583856 wait complete. 2023-07-27T14:27:33.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.472+0000 7fecb4bff700 1 Processor -- start 2023-07-27T14:27:33.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.472+0000 7fecb4bff700 1 -- start start 2023-07-27T14:27:33.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.473+0000 7fecb4bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb0063260 0x7fecb0149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecb4bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb014ae00 0x7fecb00aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecb4bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecb014b1e0 0x7fecb00c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecb4bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00b00b0 con 0x7fecb014ae00 2023-07-27T14:27:33.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecb4bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00af4a0 con 0x7fecb0063260 2023-07-27T14:27:33.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecb4bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00af780 con 0x7fecb014b1e0 2023-07-27T14:27:33.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb014ae00 0x7fecb00aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb014ae00 0x7fecb00aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53378/0 (socket says 172.21.15.115:53378) 2023-07-27T14:27:33.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 -- 172.21.15.115:0/2612945067 learned_addr learned my addr 172.21.15.115:0/2612945067 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:33.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecae59c700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb0063260 0x7fecb0149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 -- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecb014b1e0 msgr2=0x7fecb00c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecaed9d700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecb014b1e0 0x7fecb00c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecb014b1e0 0x7fecb00c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 -- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb0063260 msgr2=0x7fecb0149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb0063260 0x7fecb0149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 -- 172.21.15.115:0/2612945067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009370 con 0x7fecb014ae00 2023-07-27T14:27:33.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecae59c700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb0063260 0x7fecb0149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:33.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecaed9d700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecb014b1e0 0x7fecb00c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:33.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.474+0000 7fecadd9b700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb014ae00 0x7fecb00aeb30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7feca4009130 tx=0x7feca4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.475+0000 7fec9e7fc700 1 -- 172.21.15.115:0/2612945067 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400b870 con 0x7fecb014ae00 2023-07-27T14:27:33.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.475+0000 7fec9e7fc700 1 -- 172.21.15.115:0/2612945067 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca400b9d0 con 0x7fecb014ae00 2023-07-27T14:27:33.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.475+0000 7fec9e7fc700 1 -- 172.21.15.115:0/2612945067 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca401c670 con 0x7fecb014ae00 2023-07-27T14:27:33.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.475+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb00afa60 con 0x7fecb014ae00 2023-07-27T14:27:33.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.475+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb0149a00 con 0x7fecb014ae00 2023-07-27T14:27:33.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.476+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb0149c20 con 0x7fecb014ae00 2023-07-27T14:27:33.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.477+0000 7fec9e7fc700 1 -- 172.21.15.115:0/2612945067 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7feca400f070 con 0x7fecb014ae00 2023-07-27T14:27:33.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.478+0000 7fec9e7fc700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec9005ed90 0x7fec90061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.478+0000 7fec9e7fc700 1 -- 172.21.15.115:0/2612945067 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feca407b290 con 0x7fecb014ae00 2023-07-27T14:27:33.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.478+0000 7fecae59c700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec9005ed90 0x7fec90061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.478+0000 7fecae59c700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec9005ed90 0x7fec90061250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7feca00026f0 tx=0x7feca0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.482+0000 7fec9e7fc700 1 -- 172.21.15.115:0/2612945067 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feca404c7d0 con 0x7fecb014ae00 2023-07-27T14:27:33.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.653+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fecb00c1c30 con 0x7fecb014ae00 2023-07-27T14:27:33.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.654+0000 7fec9e7fc700 1 -- 172.21.15.115:0/2612945067 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7feca4020020 con 0x7fecb014ae00 2023-07-27T14:27:33.670 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:33.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec9005ed90 msgr2=0x7fec90061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec9005ed90 0x7fec90061250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7feca00026f0 tx=0x7feca0009040).stop 2023-07-27T14:27:33.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb014ae00 msgr2=0x7fecb00aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb014ae00 0x7fecb00aeb30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7feca4009130 tx=0x7feca4015000).stop 2023-07-27T14:27:33.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 shutdown_connections 2023-07-27T14:27:33.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec9005ed90 0x7fec90061250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecb014b1e0 0x7fecb00c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecb0063260 0x7fecb0149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 --2- 172.21.15.115:0/2612945067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb014ae00 0x7fecb00aeb30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 >> 172.21.15.115:0/2612945067 conn(0x7fecb005e940 msgr2=0x7fecb014a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:33.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 shutdown_connections 2023-07-27T14:27:33.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.656+0000 7fecb4bff700 1 -- 172.21.15.115:0/2612945067 wait complete. 2023-07-27T14:27:33.689 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:27:33.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.866+0000 7f14c99ff700 1 Processor -- start 2023-07-27T14:27:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.866+0000 7f14c99ff700 1 -- start start 2023-07-27T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.867+0000 7f14c99ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f14c414ae00 0x7f14c4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.867+0000 7f14c99ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c414b1e0 0x7f14c4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.867+0000 7f14c99ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c41553f0 con 0x7f14c40c5c50 2023-07-27T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.867+0000 7f14c99ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c4157a50 con 0x7f14c414ae00 2023-07-27T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.867+0000 7f14c99ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4157d10 con 0x7f14c414b1e0 2023-07-27T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f14c40c5c50 0x7f14c40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34378/0 (socket says 172.21.15.115:34378) 2023-07-27T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c37fe700 1 -- 172.21.15.115:0/3843573492 learned_addr learned my addr 172.21.15.115:0/3843573492 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c2ffd700 1 --2- 172.21.15.115:0/3843573492 >> v2:172.21.15.159:3300/0 conn(0x7f14c414ae00 0x7f14c4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c27fc700 1 --2- 172.21.15.115:0/3843573492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c414b1e0 0x7f14c4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c1ffb700 1 -- 172.21.15.115:0/3843573492 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217341761 0 0) 0x7f14c41553f0 con 0x7f14c40c5c50 2023-07-27T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c1ffb700 1 -- 172.21.15.115:0/3843573492 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ac0033f0 con 0x7f14c40c5c50 2023-07-27T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c27fc700 1 -- 172.21.15.115:0/3843573492 >> v2:172.21.15.159:3300/0 conn(0x7f14c414ae00 msgr2=0x7f14c4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c27fc700 1 --2- 172.21.15.115:0/3843573492 >> v2:172.21.15.159:3300/0 conn(0x7f14c414ae00 0x7f14c4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c27fc700 1 -- 172.21.15.115:0/3843573492 >> v1:172.21.15.115:6789/0 conn(0x7f14c40c5c50 legacy=0x7f14c40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c27fc700 1 -- 172.21.15.115:0/3843573492 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4157ff0 con 0x7f14c414b1e0 2023-07-27T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.868+0000 7f14c2ffd700 1 --2- 172.21.15.115:0/3843573492 >> v2:172.21.15.159:3300/0 conn(0x7f14c414ae00 0x7f14c4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c27fc700 1 --2- 172.21.15.115:0/3843573492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c414b1e0 0x7f14c4062b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f14b8009760 tx=0x7f14b8009060).ready entity=mon.2 client_cookie=d4a35b880f1277ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c1ffb700 1 -- 172.21.15.115:0/3843573492 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b800d4a0 con 0x7f14c414b1e0 2023-07-27T14:27:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c1ffb700 1 -- 172.21.15.115:0/3843573492 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b800d600 con 0x7f14c414b1e0 2023-07-27T14:27:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c1ffb700 1 -- 172.21.15.115:0/3843573492 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b800d980 con 0x7f14c414b1e0 2023-07-27T14:27:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c99ff700 1 -- 172.21.15.115:0/3843573492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c414b1e0 msgr2=0x7f14c4062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3843573492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c414b1e0 0x7f14c4062b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f14b8009760 tx=0x7f14b8009060).stop 2023-07-27T14:27:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c99ff700 1 -- 172.21.15.115:0/3843573492 shutdown_connections 2023-07-27T14:27:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3843573492 >> v2:172.21.15.159:3300/0 conn(0x7f14c414ae00 0x7f14c4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3843573492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c414b1e0 0x7f14c4062b50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c99ff700 1 -- 172.21.15.115:0/3843573492 >> 172.21.15.115:0/3843573492 conn(0x7f14c405e940 msgr2=0x7f14c40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c99ff700 1 -- 172.21.15.115:0/3843573492 shutdown_connections 2023-07-27T14:27:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.869+0000 7f14c99ff700 1 -- 172.21.15.115:0/3843573492 wait complete. 2023-07-27T14:27:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.871+0000 7f14c99ff700 1 Processor -- start 2023-07-27T14:27:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.871+0000 7f14c99ff700 1 -- start start 2023-07-27T14:27:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c99ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c40c5c50 0x7f14c413e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c99ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c414ae00 0x7f14c40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c99ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c414b1e0 0x7f14c40ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c99ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40ae540 con 0x7f14c414b1e0 2023-07-27T14:27:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c99ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40c27d0 con 0x7f14c414ae00 2023-07-27T14:27:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c99ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c41573a0 con 0x7f14c40c5c50 2023-07-27T14:27:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c414b1e0 0x7f14c40ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c414b1e0 0x7f14c40ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34644/0 (socket says 172.21.15.115:34644) 2023-07-27T14:27:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c37fe700 1 -- 172.21.15.115:0/3154372450 learned_addr learned my addr 172.21.15.115:0/3154372450 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c2ffd700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c40c5c50 0x7f14c413e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.872+0000 7f14c27fc700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c414ae00 0x7f14c40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c37fe700 1 -- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c40c5c50 msgr2=0x7f14c413e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c37fe700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c40c5c50 0x7f14c413e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c37fe700 1 -- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c414ae00 msgr2=0x7f14c40adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c37fe700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c414ae00 0x7f14c40adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c37fe700 1 -- 172.21.15.115:0/3154372450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b40092a0 con 0x7f14c414b1e0 2023-07-27T14:27:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c27fc700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c414ae00 0x7f14c40adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c37fe700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c414b1e0 0x7f14c40ae050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f14bc005ad0 tx=0x7f14bc001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14aaffd700 1 -- 172.21.15.115:0/3154372450 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc005d30 con 0x7f14c414b1e0 2023-07-27T14:27:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14aaffd700 1 -- 172.21.15.115:0/3154372450 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc005e90 con 0x7f14c414b1e0 2023-07-27T14:27:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14aaffd700 1 -- 172.21.15.115:0/3154372450 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc007320 con 0x7f14c414b1e0 2023-07-27T14:27:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b80092a0 con 0x7f14c414b1e0 2023-07-27T14:27:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.873+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c40aea20 con 0x7f14c414b1e0 2023-07-27T14:27:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.874+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c40c2990 con 0x7f14c414b1e0 2023-07-27T14:27:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.875+0000 7f14aaffd700 1 -- 172.21.15.115:0/3154372450 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f14bc010030 con 0x7f14c414b1e0 2023-07-27T14:27:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.876+0000 7f14aaffd700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14b005ed90 0x7f14b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.876+0000 7f14aaffd700 1 -- 172.21.15.115:0/3154372450 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f14bc079b60 con 0x7f14c414b1e0 2023-07-27T14:27:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.876+0000 7f14c2ffd700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14b005ed90 0x7f14b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.877+0000 7f14c2ffd700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14b005ed90 0x7f14b0061250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f14b4009dc0 tx=0x7f14b4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:33.880+0000 7f14aaffd700 1 -- 172.21.15.115:0/3154372450 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f14bc04b0a0 con 0x7f14c414b1e0 2023-07-27T14:27:34.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.049+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14c406c470 con 0x7f14c414b1e0 2023-07-27T14:27:34.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.049+0000 7f14aaffd700 1 -- 172.21.15.115:0/3154372450 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14bc04e6c0 con 0x7f14c414b1e0 2023-07-27T14:27:34.065 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:34.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.051+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14b005ed90 msgr2=0x7f14b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14b005ed90 0x7f14b0061250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f14b4009dc0 tx=0x7f14b4009060).stop 2023-07-27T14:27:34.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c414b1e0 msgr2=0x7f14c40ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c414b1e0 0x7f14c40ae050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f14bc005ad0 tx=0x7f14bc001650).stop 2023-07-27T14:27:34.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 shutdown_connections 2023-07-27T14:27:34.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14b005ed90 0x7f14b0061250 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c414b1e0 0x7f14c40ae050 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14c40c5c50 0x7f14c413e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 --2- 172.21.15.115:0/3154372450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14c414ae00 0x7f14c40adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 >> 172.21.15.115:0/3154372450 conn(0x7f14c405e940 msgr2=0x7f14c4152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:34.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 shutdown_connections 2023-07-27T14:27:34.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.052+0000 7f14c99ff700 1 -- 172.21.15.115:0/3154372450 wait complete. 2023-07-27T14:27:34.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:34.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.255+0000 7f49bdfff700 1 Processor -- start 2023-07-27T14:27:34.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.256+0000 7f49bdfff700 1 -- start start 2023-07-27T14:27:34.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49bdfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b8153ec0 0x7f49b80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49bdfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49b80aaa40 0x7f49b80c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49bdfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b80aa4d0 con 0x7f49b80aa050 2023-07-27T14:27:34.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49bdfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b80c05c0 con 0x7f49b80aaa40 2023-07-27T14:27:34.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49bdfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80bfc90 con 0x7f49b8153ec0 2023-07-27T14:27:34.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49b7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49b80aaa40 0x7f49b80c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49b7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49b80aaa40 0x7f49b80c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34654/0 (socket says 172.21.15.115:34654) 2023-07-27T14:27:34.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49b7fff700 1 -- 172.21.15.115:0/366228408 learned_addr learned my addr 172.21.15.115:0/366228408 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:34.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.257+0000 7f49b77fe700 1 --2- 172.21.15.115:0/366228408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b8153ec0 0x7f49b80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b7fff700 1 -- 172.21.15.115:0/366228408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b8153ec0 msgr2=0x7f49b80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:34.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b7fff700 1 --2- 172.21.15.115:0/366228408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b8153ec0 0x7f49b80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b7fff700 1 -- 172.21.15.115:0/366228408 >> v1:172.21.15.159:6789/0 conn(0x7f49b80aa050 legacy=0x7f49b80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b7fff700 1 -- 172.21.15.115:0/366228408 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80bff70 con 0x7f49b80aaa40 2023-07-27T14:27:34.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b77fe700 1 --2- 172.21.15.115:0/366228408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b8153ec0 0x7f49b80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:34.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b7fff700 1 --2- 172.21.15.115:0/366228408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80c0a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f49b0009f20 tx=0x7f49b0009840).ready entity=mon.0 client_cookie=ebae65515e45c1f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:34.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b67fc700 1 -- 172.21.15.115:0/366228408 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000e070 con 0x7f49b80aaa40 2023-07-27T14:27:34.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b67fc700 1 -- 172.21.15.115:0/366228408 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b000ba80 con 0x7f49b80aaa40 2023-07-27T14:27:34.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.258+0000 7f49b67fc700 1 -- 172.21.15.115:0/366228408 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000be00 con 0x7f49b80aaa40 2023-07-27T14:27:34.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.259+0000 7f49bdfff700 1 -- 172.21.15.115:0/366228408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 msgr2=0x7f49b80c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.259+0000 7f49bdfff700 1 --2- 172.21.15.115:0/366228408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80c0a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f49b0009f20 tx=0x7f49b0009840).stop 2023-07-27T14:27:34.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.259+0000 7f49bdfff700 1 -- 172.21.15.115:0/366228408 shutdown_connections 2023-07-27T14:27:34.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.259+0000 7f49bdfff700 1 --2- 172.21.15.115:0/366228408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b8153ec0 0x7f49b80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.259+0000 7f49bdfff700 1 --2- 172.21.15.115:0/366228408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80c0a50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.259+0000 7f49bdfff700 1 -- 172.21.15.115:0/366228408 >> 172.21.15.115:0/366228408 conn(0x7f49b80cb610 msgr2=0x7f49b80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:34.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.259+0000 7f49bdfff700 1 -- 172.21.15.115:0/366228408 shutdown_connections 2023-07-27T14:27:34.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.259+0000 7f49bdfff700 1 -- 172.21.15.115:0/366228408 wait complete. 2023-07-27T14:27:34.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.260+0000 7f49bdfff700 1 Processor -- start 2023-07-27T14:27:34.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.260+0000 7f49bdfff700 1 -- start start 2023-07-27T14:27:34.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.261+0000 7f49bdfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b80aa050 0x7f49b80c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.261+0000 7f49bdfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b8144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.261+0000 7f49bdfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b8144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.261+0000 7f49bdfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81453e0 con 0x7f49b80aaa40 2023-07-27T14:27:34.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.261+0000 7f49bdfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8151020 con 0x7f49b8153ec0 2023-07-27T14:27:34.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.261+0000 7f49bdfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80c3cf0 con 0x7f49b80aa050 2023-07-27T14:27:34.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.261+0000 7f49b6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b8144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b8144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34658/0 (socket says 172.21.15.115:34658) 2023-07-27T14:27:34.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b6ffd700 1 -- 172.21.15.115:0/909171963 learned_addr learned my addr 172.21.15.115:0/909171963 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:34.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b77fe700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b80aa050 0x7f49b80c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b7fff700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b8144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b6ffd700 1 -- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b80aa050 msgr2=0x7f49b80c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b6ffd700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b80aa050 0x7f49b80c0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b6ffd700 1 -- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 msgr2=0x7f49b8144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b6ffd700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b8144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b6ffd700 1 -- 172.21.15.115:0/909171963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b0009ae0 con 0x7f49b80aaa40 2023-07-27T14:27:34.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b7fff700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b8144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:34.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b77fe700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b80aa050 0x7f49b80c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:34.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49b6ffd700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b8144a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f49ac00c440 tx=0x7f49ac007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:34.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f499f7fe700 1 -- 172.21.15.115:0/909171963 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac007020 con 0x7f49b80aaa40 2023-07-27T14:27:34.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f499f7fe700 1 -- 172.21.15.115:0/909171963 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac007180 con 0x7f49b80aaa40 2023-07-27T14:27:34.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b81506f0 con 0x7f49b80aaa40 2023-07-27T14:27:34.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.262+0000 7f499f7fe700 1 -- 172.21.15.115:0/909171963 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac007520 con 0x7f49b80aaa40 2023-07-27T14:27:34.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.263+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b8150cb0 con 0x7f49b80aaa40 2023-07-27T14:27:34.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.263+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b806c470 con 0x7f49b80aaa40 2023-07-27T14:27:34.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.264+0000 7f499f7fe700 1 -- 172.21.15.115:0/909171963 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f49ac010070 con 0x7f49b80aaa40 2023-07-27T14:27:34.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.265+0000 7f499f7fe700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a405ed90 0x7f49a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.265+0000 7f499f7fe700 1 -- 172.21.15.115:0/909171963 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f49ac079370 con 0x7f49b80aaa40 2023-07-27T14:27:34.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.265+0000 7f49b77fe700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a405ed90 0x7f49a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.266+0000 7f49b77fe700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a405ed90 0x7f49a4061250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f49a8006d80 tx=0x7f49a8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:34.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.269+0000 7f499f7fe700 1 -- 172.21.15.115:0/909171963 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49ac04a800 con 0x7f49b80aaa40 2023-07-27T14:27:34.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.436+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49b80aa4d0 con 0x7f49b80aaa40 2023-07-27T14:27:34.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.437+0000 7f499f7fe700 1 -- 172.21.15.115:0/909171963 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f49b80aa4d0 con 0x7f49b80aaa40 2023-07-27T14:27:34.453 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:34.453 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:34.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a405ed90 msgr2=0x7f49a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a405ed90 0x7f49a4061250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f49a8006d80 tx=0x7f49a8008040).stop 2023-07-27T14:27:34.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 msgr2=0x7f49b8144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b8144a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f49ac00c440 tx=0x7f49ac007d40).stop 2023-07-27T14:27:34.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 shutdown_connections 2023-07-27T14:27:34.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a405ed90 0x7f49a4061250 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b8144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b80aa050 0x7f49b80c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 --2- 172.21.15.115:0/909171963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b8144a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 >> 172.21.15.115:0/909171963 conn(0x7f49b80cb610 msgr2=0x7f49b80ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:34.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 shutdown_connections 2023-07-27T14:27:34.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.439+0000 7f49bdfff700 1 -- 172.21.15.115:0/909171963 wait complete. 2023-07-27T14:27:34.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:26:59.286583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:27:00.228329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:27:34.473 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:27:34.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.648+0000 7f42b41ff700 1 Processor -- start 2023-07-27T14:27:34.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.648+0000 7f42b41ff700 1 -- start start 2023-07-27T14:27:34.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.649+0000 7f42b41ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f42ac14ae00 0x7f42ac154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.649+0000 7f42b41ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac063260 0x7f42ac0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.649+0000 7f42b41ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ac1553f0 con 0x7f42ac14b1e0 2023-07-27T14:27:34.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.649+0000 7f42b41ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac157a50 con 0x7f42ac14ae00 2023-07-27T14:27:34.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.649+0000 7f42b41ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac157d10 con 0x7f42ac063260 2023-07-27T14:27:34.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.649+0000 7f42b179a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f42ac14b1e0 0x7f42ac062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34384/0 (socket says 172.21.15.115:34384) 2023-07-27T14:27:34.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.649+0000 7f42b179a700 1 -- 172.21.15.115:0/2821660111 learned_addr learned my addr 172.21.15.115:0/2821660111 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:34.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b1f9b700 1 --2- 172.21.15.115:0/2821660111 >> v2:172.21.15.159:3300/0 conn(0x7f42ac14ae00 0x7f42ac154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b279c700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac063260 0x7f42ac0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946196904 0 0) 0x7f42ac1553f0 con 0x7f42ac14b1e0 2023-07-27T14:27:34.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42980033f0 con 0x7f42ac14b1e0 2023-07-27T14:27:34.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015802340 0 0) 0x7f42980033f0 con 0x7f42ac14b1e0 2023-07-27T14:27:34.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac063260 msgr2=0x7f42ac0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:34.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac063260 0x7f42ac0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 >> v2:172.21.15.159:3300/0 conn(0x7f42ac14ae00 msgr2=0x7f42ac154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:34.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 --2- 172.21.15.115:0/2821660111 >> v2:172.21.15.159:3300/0 conn(0x7f42ac14ae00 0x7f42ac154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac157ff0 con 0x7f42ac14b1e0 2023-07-27T14:27:34.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f429c001470 con 0x7f42ac14b1e0 2023-07-27T14:27:34.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 >> v1:172.21.15.115:6789/0 conn(0x7f42ac14b1e0 legacy=0x7f42ac062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42980038e0 0x7f4298003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4298004690 0x7f4298004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac063260 0x7f4298005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac157a50 con 0x7f42980038e0 2023-07-27T14:27:34.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac157d10 con 0x7f4298004690 2023-07-27T14:27:34.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429800b8e0 con 0x7f42ac063260 2023-07-27T14:27:34.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.650+0000 7f42b1f9b700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42980038e0 0x7f4298003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b179a700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4298004690 0x7f4298004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b279c700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac063260 0x7f4298005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b1f9b700 1 -- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac063260 msgr2=0x7f4298005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:34.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b1f9b700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac063260 0x7f4298005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b1f9b700 1 -- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4298004690 msgr2=0x7f4298004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:34.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b1f9b700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4298004690 0x7f4298004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b1f9b700 1 -- 172.21.15.115:0/2821660111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980033f0 con 0x7f42980038e0 2023-07-27T14:27:34.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b179a700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4298004690 0x7f4298004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:34.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b1f9b700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42980038e0 0x7f4298003d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f42a8009a80 tx=0x7f42a8009060).ready entity=mon.0 client_cookie=4f465808e9636584 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:34.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a8009430 con 0x7f42980038e0 2023-07-27T14:27:34.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a800e640 con 0x7f42980038e0 2023-07-27T14:27:34.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.651+0000 7f42b0f99700 1 -- 172.21.15.115:0/2821660111 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a800e9c0 con 0x7f42980038e0 2023-07-27T14:27:34.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.652+0000 7f42b41ff700 1 -- 172.21.15.115:0/2821660111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42980038e0 msgr2=0x7f4298003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.652+0000 7f42b41ff700 1 --2- 172.21.15.115:0/2821660111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42980038e0 0x7f4298003d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f42a8009a80 tx=0x7f42a8009060).stop 2023-07-27T14:27:34.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.652+0000 7f42b279c700 1 -- 172.21.15.115:0/2821660111 reap_dead start 2023-07-27T14:27:34.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.652+0000 7f42b41ff700 1 -- 172.21.15.115:0/2821660111 shutdown_connections 2023-07-27T14:27:34.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.652+0000 7f42b41ff700 1 -- 172.21.15.115:0/2821660111 >> 172.21.15.115:0/2821660111 conn(0x7f42ac05e940 msgr2=0x7f42ac0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:34.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.652+0000 7f42b41ff700 1 -- 172.21.15.115:0/2821660111 shutdown_connections 2023-07-27T14:27:34.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.652+0000 7f42b41ff700 1 -- 172.21.15.115:0/2821660111 wait complete. 2023-07-27T14:27:34.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.654+0000 7f42b41ff700 1 Processor -- start 2023-07-27T14:27:34.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.654+0000 7f42b41ff700 1 -- start start 2023-07-27T14:27:34.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.655+0000 7f42b41ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42980038e0 0x7f42ac0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.655+0000 7f42b41ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac0b0280 0x7f42ac155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.655+0000 7f42b41ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac0b0700 0x7f42ac153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.655+0000 7f42b41ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac149370 con 0x7f42ac0b0280 2023-07-27T14:27:34.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.655+0000 7f42b41ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac0c2530 con 0x7f42980038e0 2023-07-27T14:27:34.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.655+0000 7f42b41ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac0c2d20 con 0x7f42ac0b0700 2023-07-27T14:27:34.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac0b0280 0x7f42ac155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac0b0280 0x7f42ac155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34676/0 (socket says 172.21.15.115:34676) 2023-07-27T14:27:34.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 -- 172.21.15.115:0/2737197555 learned_addr learned my addr 172.21.15.115:0/2737197555 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:34.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b1f9b700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42980038e0 0x7f42ac0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b279c700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac0b0700 0x7f42ac153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 -- 172.21.15.115:0/2737197555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac0b0700 msgr2=0x7f42ac153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac0b0700 0x7f42ac153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 -- 172.21.15.115:0/2737197555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42980038e0 msgr2=0x7f42ac0c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42980038e0 0x7f42ac0c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 -- 172.21.15.115:0/2737197555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac0c2fc0 con 0x7f42ac0b0280 2023-07-27T14:27:34.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.656+0000 7f42b179a700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac0b0280 0x7f42ac155f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f429c00e830 tx=0x7f429c001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:34.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.657+0000 7f42a1ffb700 1 -- 172.21.15.115:0/2737197555 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c010520 con 0x7f42ac0b0280 2023-07-27T14:27:34.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.657+0000 7f42a1ffb700 1 -- 172.21.15.115:0/2737197555 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c010680 con 0x7f42ac0b0280 2023-07-27T14:27:34.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.657+0000 7f42a1ffb700 1 -- 172.21.15.115:0/2737197555 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c010a00 con 0x7f42ac0b0280 2023-07-27T14:27:34.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.657+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac0c3300 con 0x7f42ac0b0280 2023-07-27T14:27:34.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.657+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac0c3b40 con 0x7f42ac0b0280 2023-07-27T14:27:34.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.658+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac06c470 con 0x7f42ac0b0280 2023-07-27T14:27:34.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.658+0000 7f42a1ffb700 1 -- 172.21.15.115:0/2737197555 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f429c014430 con 0x7f42ac0b0280 2023-07-27T14:27:34.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.659+0000 7f42a1ffb700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429005ed90 0x7f4290061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:34.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.659+0000 7f42a1ffb700 1 -- 172.21.15.115:0/2737197555 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f429c079dd0 con 0x7f42ac0b0280 2023-07-27T14:27:34.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.659+0000 7f42b1f9b700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429005ed90 0x7f4290061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:34.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.660+0000 7f42b1f9b700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429005ed90 0x7f4290061250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f42a8006d50 tx=0x7f42a801a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:34.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.663+0000 7f42a1ffb700 1 -- 172.21.15.115:0/2737197555 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f429c04b200 con 0x7f42ac0b0280 2023-07-27T14:27:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.831+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f42ac0c3490 con 0x7f42ac0b0280 2023-07-27T14:27:34.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.832+0000 7f42a1ffb700 1 -- 172.21.15.115:0/2737197555 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f429c04e820 con 0x7f42ac0b0280 2023-07-27T14:27:34.848 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:27:34.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429005ed90 msgr2=0x7f4290061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429005ed90 0x7f4290061250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f42a8006d50 tx=0x7f42a801a000).stop 2023-07-27T14:27:34.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac0b0280 msgr2=0x7f42ac155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:34.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac0b0280 0x7f42ac155f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f429c00e830 tx=0x7f429c001e90).stop 2023-07-27T14:27:34.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 shutdown_connections 2023-07-27T14:27:34.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429005ed90 0x7f4290061250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ac0b0700 0x7f42ac153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42980038e0 0x7f42ac0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 --2- 172.21.15.115:0/2737197555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ac0b0280 0x7f42ac155f80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:34.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 >> 172.21.15.115:0/2737197555 conn(0x7f42ac05e940 msgr2=0x7f42ac0ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:34.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 shutdown_connections 2023-07-27T14:27:34.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:34.834+0000 7f42b41ff700 1 -- 172.21.15.115:0/2737197555 wait complete. 2023-07-27T14:27:34.866 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:27:35.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.040+0000 7f750d7ff700 1 Processor -- start 2023-07-27T14:27:35.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.041+0000 7f750d7ff700 1 -- start start 2023-07-27T14:27:35.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f750d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7508063260 0x7f7508154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f750d7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75081553f0 con 0x7f750814ae00 2023-07-27T14:27:35.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f750d7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7508157a50 con 0x7f750814b1e0 2023-07-27T14:27:35.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f750d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7508157d10 con 0x7f7508063260 2023-07-27T14:27:35.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f7506ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f750814ae00 0x7f7508062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34396/0 (socket says 172.21.15.115:34396) 2023-07-27T14:27:35.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f7506ffd700 1 -- 172.21.15.115:0/3161231544 learned_addr learned my addr 172.21.15.115:0/3161231544 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:35.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070010783 0 0) 0x7f75081553f0 con 0x7f750814ae00 2023-07-27T14:27:35.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f00033f0 con 0x7f750814ae00 2023-07-27T14:27:35.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.042+0000 7f75067fc700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7508063260 0x7f7508154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 877662930 0 0) 0x7f74f00033f0 con 0x7f750814ae00 2023-07-27T14:27:35.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7508063260 msgr2=0x7f7508154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:35.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7508063260 0x7f7508154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 >> v1:172.21.15.159:6789/0 conn(0x7f750814b1e0 legacy=0x7f75080a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508157ff0 con 0x7f750814ae00 2023-07-27T14:27:35.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f74f8001470 con 0x7f750814ae00 2023-07-27T14:27:35.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 >> v1:172.21.15.115:6789/0 conn(0x7f750814ae00 legacy=0x7f7508062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f74f0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f0004690 0x7f74f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7508063260 0x7f74f0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7508157d10 con 0x7f74f0003910 2023-07-27T14:27:35.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f000b910 con 0x7f74f0004690 2023-07-27T14:27:35.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f000bad0 con 0x7f7508063260 2023-07-27T14:27:35.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f7506ffd700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f74f0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f75067fc700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f0004690 0x7f74f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.043+0000 7f75077fe700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7508063260 0x7f74f0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7506ffd700 1 -- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7508063260 msgr2=0x7f74f0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:35.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7506ffd700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7508063260 0x7f74f0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7506ffd700 1 -- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f0004690 msgr2=0x7f74f0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:35.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7506ffd700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f0004690 0x7f74f0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7506ffd700 1 -- 172.21.15.115:0/3161231544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f00033f0 con 0x7f74f0003910 2023-07-27T14:27:35.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7506ffd700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f74f0003d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f74f800c160 tx=0x7f750814eb20).ready entity=mon.0 client_cookie=c853aabcb8912df6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f800ca90 con 0x7f74f0003910 2023-07-27T14:27:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f800cbf0 con 0x7f74f0003910 2023-07-27T14:27:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f7505ffb700 1 -- 172.21.15.115:0/3161231544 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f80070d0 con 0x7f74f0003910 2023-07-27T14:27:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f750d7ff700 1 -- 172.21.15.115:0/3161231544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 msgr2=0x7f74f0003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f750d7ff700 1 --2- 172.21.15.115:0/3161231544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f74f0003d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f74f800c160 tx=0x7f750814eb20).stop 2023-07-27T14:27:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.044+0000 7f75077fe700 1 -- 172.21.15.115:0/3161231544 reap_dead start 2023-07-27T14:27:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.045+0000 7f750d7ff700 1 -- 172.21.15.115:0/3161231544 shutdown_connections 2023-07-27T14:27:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.045+0000 7f750d7ff700 1 -- 172.21.15.115:0/3161231544 >> 172.21.15.115:0/3161231544 conn(0x7f750805e940 msgr2=0x7f75080cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:35.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.045+0000 7f750d7ff700 1 -- 172.21.15.115:0/3161231544 shutdown_connections 2023-07-27T14:27:35.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.045+0000 7f750d7ff700 1 -- 172.21.15.115:0/3161231544 wait complete. 2023-07-27T14:27:35.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.046+0000 7f750d7ff700 1 Processor -- start 2023-07-27T14:27:35.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.046+0000 7f750d7ff700 1 -- start start 2023-07-27T14:27:35.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f750d7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f75080c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f750d7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75080c2140 0x7f75080c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f750d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75080c43a0 0x7f75080c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f750d7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75081390b0 con 0x7f74f0003910 2023-07-27T14:27:35.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f750d7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080ae680 con 0x7f75080c2140 2023-07-27T14:27:35.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f750d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75080aef20 con 0x7f75080c43a0 2023-07-27T14:27:35.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f7506ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f75080c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f7506ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f75080c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34694/0 (socket says 172.21.15.115:34694) 2023-07-27T14:27:35.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f7506ffd700 1 -- 172.21.15.115:0/6748530 learned_addr learned my addr 172.21.15.115:0/6748530 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:35.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.047+0000 7f75067fc700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75080c2140 0x7f75080c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f75077fe700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75080c43a0 0x7f75080c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f7506ffd700 1 -- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75080c43a0 msgr2=0x7f75080c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f7506ffd700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75080c43a0 0x7f75080c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f7506ffd700 1 -- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75080c2140 msgr2=0x7f75080c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f7506ffd700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75080c2140 0x7f75080c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f7506ffd700 1 -- 172.21.15.115:0/6748530 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080c25c0 con 0x7f74f0003910 2023-07-27T14:27:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f75077fe700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75080c43a0 0x7f75080c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f7506ffd700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f75080c1c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f74f8007b40 tx=0x7f74f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f74eeffd700 1 -- 172.21.15.115:0/6748530 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f80017a0 con 0x7f74f0003910 2023-07-27T14:27:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f74eeffd700 1 -- 172.21.15.115:0/6748530 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f80046b0 con 0x7f74f0003910 2023-07-27T14:27:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75080ac360 con 0x7f74f0003910 2023-07-27T14:27:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f74eeffd700 1 -- 172.21.15.115:0/6748530 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8004a50 con 0x7f74f0003910 2023-07-27T14:27:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.048+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75080aebb0 con 0x7f74f0003910 2023-07-27T14:27:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.049+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750806c470 con 0x7f74f0003910 2023-07-27T14:27:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.050+0000 7f74eeffd700 1 -- 172.21.15.115:0/6748530 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f74f8010070 con 0x7f74f0003910 2023-07-27T14:27:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.051+0000 7f74eeffd700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74f405ed90 0x7f74f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.051+0000 7f74eeffd700 1 -- 172.21.15.115:0/6748530 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f74f807a250 con 0x7f74f0003910 2023-07-27T14:27:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.051+0000 7f75067fc700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74f405ed90 0x7f74f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.052+0000 7f75067fc700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74f405ed90 0x7f74f4061250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7508065080 tx=0x7f74fc009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.055+0000 7f74eeffd700 1 -- 172.21.15.115:0/6748530 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74f804b6e0 con 0x7f74f0003910 2023-07-27T14:27:35.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.220+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7508064dd0 con 0x7f74f0003910 2023-07-27T14:27:35.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.220+0000 7f74eeffd700 1 -- 172.21.15.115:0/6748530 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74f8025020 con 0x7f74f0003910 2023-07-27T14:27:35.236 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:27:35.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74f405ed90 msgr2=0x7f74f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74f405ed90 0x7f74f4061250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7508065080 tx=0x7f74fc009060).stop 2023-07-27T14:27:35.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 msgr2=0x7f75080c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f75080c1c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f74f8007b40 tx=0x7f74f8015000).stop 2023-07-27T14:27:35.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 shutdown_connections 2023-07-27T14:27:35.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74f405ed90 0x7f74f4061250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75080c43a0 0x7f75080c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74f0003910 0x7f75080c1c50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 --2- 172.21.15.115:0/6748530 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75080c2140 0x7f75080c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 >> 172.21.15.115:0/6748530 conn(0x7f750805e940 msgr2=0x7f75080a9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:35.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.222+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 shutdown_connections 2023-07-27T14:27:35.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.223+0000 7f750d7ff700 1 -- 172.21.15.115:0/6748530 wait complete. 2023-07-27T14:27:35.255 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:27:35.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.430+0000 7fd0681ff700 1 Processor -- start 2023-07-27T14:27:35.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.430+0000 7fd0681ff700 1 -- start start 2023-07-27T14:27:35.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd0681ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014ae00 0x7fd060154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd0681ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd060063260 0x7fd0600a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd0681ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0601553f0 con 0x7fd06014b1e0 2023-07-27T14:27:35.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd0681ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd060157a50 con 0x7fd060063260 2023-07-27T14:27:35.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd0681ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd060157d10 con 0x7fd06014ae00 2023-07-27T14:27:35.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd06679c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd060063260 0x7fd0600a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd06679c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd060063260 0x7fd0600a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34708/0 (socket says 172.21.15.115:34708) 2023-07-27T14:27:35.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd06679c700 1 -- 172.21.15.115:0/840791272 learned_addr learned my addr 172.21.15.115:0/840791272 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:35.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd065f9b700 1 --2- 172.21.15.115:0/840791272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014ae00 0x7fd060154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd06679c700 1 -- 172.21.15.115:0/840791272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014ae00 msgr2=0x7fd060154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:35.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd06679c700 1 --2- 172.21.15.115:0/840791272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014ae00 0x7fd060154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd06679c700 1 -- 172.21.15.115:0/840791272 >> v1:172.21.15.159:6789/0 conn(0x7fd06014b1e0 legacy=0x7fd060062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.432+0000 7fd06679c700 1 -- 172.21.15.115:0/840791272 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060157ff0 con 0x7fd060063260 2023-07-27T14:27:35.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd06679c700 1 --2- 172.21.15.115:0/840791272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0600a98c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fd058009f20 tx=0x7fd058009840).ready entity=mon.0 client_cookie=6260965edcdf7ff8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd064f99700 1 -- 172.21.15.115:0/840791272 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800e070 con 0x7fd060063260 2023-07-27T14:27:35.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd064f99700 1 -- 172.21.15.115:0/840791272 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05800ba80 con 0x7fd060063260 2023-07-27T14:27:35.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd064f99700 1 -- 172.21.15.115:0/840791272 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800be00 con 0x7fd060063260 2023-07-27T14:27:35.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd0681ff700 1 -- 172.21.15.115:0/840791272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 msgr2=0x7fd0600a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd0681ff700 1 --2- 172.21.15.115:0/840791272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0600a98c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fd058009f20 tx=0x7fd058009840).stop 2023-07-27T14:27:35.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd0681ff700 1 -- 172.21.15.115:0/840791272 shutdown_connections 2023-07-27T14:27:35.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd0681ff700 1 --2- 172.21.15.115:0/840791272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014ae00 0x7fd060154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd0681ff700 1 --2- 172.21.15.115:0/840791272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0600a98c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd0681ff700 1 -- 172.21.15.115:0/840791272 >> 172.21.15.115:0/840791272 conn(0x7fd06005e940 msgr2=0x7fd0600cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:35.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd0681ff700 1 -- 172.21.15.115:0/840791272 shutdown_connections 2023-07-27T14:27:35.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.433+0000 7fd0681ff700 1 -- 172.21.15.115:0/840791272 wait complete. 2023-07-27T14:27:35.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.435+0000 7fd0681ff700 1 Processor -- start 2023-07-27T14:27:35.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.435+0000 7fd0681ff700 1 -- start start 2023-07-27T14:27:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd0681ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0601495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd0681ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd06014ae00 0x7fd0600c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd0681ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014b1e0 0x7fd0600c0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd0681ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600c2f40 con 0x7fd060063260 2023-07-27T14:27:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd0681ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600aeff0 con 0x7fd06014ae00 2023-07-27T14:27:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd0681ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600c26a0 con 0x7fd06014b1e0 2023-07-27T14:27:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd065f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0601495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd065f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0601495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34720/0 (socket says 172.21.15.115:34720) 2023-07-27T14:27:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd065f9b700 1 -- 172.21.15.115:0/3102469383 learned_addr learned my addr 172.21.15.115:0/3102469383 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.436+0000 7fd06579a700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd06014ae00 0x7fd0600c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd065f9b700 1 -- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014b1e0 msgr2=0x7fd0600c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd06679c700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014b1e0 0x7fd0600c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd065f9b700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014b1e0 0x7fd0600c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd065f9b700 1 -- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd06014ae00 msgr2=0x7fd0600c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd065f9b700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd06014ae00 0x7fd0600c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd065f9b700 1 -- 172.21.15.115:0/3102469383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009ae0 con 0x7fd060063260 2023-07-27T14:27:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd06579a700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd06014ae00 0x7fd0600c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd065f9b700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0601495f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd05c00d890 tx=0x7fd05c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd055ffb700 1 -- 172.21.15.115:0/3102469383 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0125f0 con 0x7fd060063260 2023-07-27T14:27:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd055ffb700 1 -- 172.21.15.115:0/3102469383 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c012750 con 0x7fd060063260 2023-07-27T14:27:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd055ffb700 1 -- 172.21.15.115:0/3102469383 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c012ad0 con 0x7fd060063260 2023-07-27T14:27:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0600c2980 con 0x7fd060063260 2023-07-27T14:27:35.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.437+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd060157260 con 0x7fd060063260 2023-07-27T14:27:35.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.438+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0600aedc0 con 0x7fd060063260 2023-07-27T14:27:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.439+0000 7fd055ffb700 1 -- 172.21.15.115:0/3102469383 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd05c013480 con 0x7fd060063260 2023-07-27T14:27:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.440+0000 7fd055ffb700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd04405ed90 0x7fd044061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.440+0000 7fd055ffb700 1 -- 172.21.15.115:0/3102469383 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd05c079a90 con 0x7fd060063260 2023-07-27T14:27:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.440+0000 7fd06579a700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd04405ed90 0x7fd044061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.441+0000 7fd06579a700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd04405ed90 0x7fd044061250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd0600c8000 tx=0x7fd050009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.444+0000 7fd055ffb700 1 -- 172.21.15.115:0/3102469383 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd05c04afd0 con 0x7fd060063260 2023-07-27T14:27:35.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.616+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0600af2d0 con 0x7fd060063260 2023-07-27T14:27:35.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.617+0000 7fd055ffb700 1 -- 172.21.15.115:0/3102469383 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd05c04e5f0 con 0x7fd060063260 2023-07-27T14:27:35.633 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:35.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd04405ed90 msgr2=0x7fd044061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd04405ed90 0x7fd044061250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd0600c8000 tx=0x7fd050009040).stop 2023-07-27T14:27:35.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 msgr2=0x7fd0601495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0601495f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd05c00d890 tx=0x7fd05c008040).stop 2023-07-27T14:27:35.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 shutdown_connections 2023-07-27T14:27:35.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd04405ed90 0x7fd044061250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd06014b1e0 0x7fd0600c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd060063260 0x7fd0601495f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 --2- 172.21.15.115:0/3102469383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd06014ae00 0x7fd0600c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 >> 172.21.15.115:0/3102469383 conn(0x7fd06005e940 msgr2=0x7fd060152030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 shutdown_connections 2023-07-27T14:27:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.619+0000 7fd0681ff700 1 -- 172.21.15.115:0/3102469383 wait complete. 2023-07-27T14:27:35.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:27:35.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.829+0000 7fd6fe9ff700 1 Processor -- start 2023-07-27T14:27:35.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.829+0000 7fd6fe9ff700 1 -- start start 2023-07-27T14:27:35.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.830+0000 7fd6fe9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd6f814ae00 0x7fd6f8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.830+0000 7fd6fe9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd6f814b1e0 0x7fd6f8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.830+0000 7fd6fe9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f80c5c50 0x7fd6f8063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.830+0000 7fd6fe9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f8063530 con 0x7fd6f814ae00 2023-07-27T14:27:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.830+0000 7fd6fe9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f81553f0 con 0x7fd6f814b1e0 2023-07-27T14:27:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.830+0000 7fd6fe9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f8157a50 con 0x7fd6f80c5c50 2023-07-27T14:27:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd6f814ae00 0x7fd6f8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd6f814ae00 0x7fd6f8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34730/0 (socket says 172.21.15.115:34730) 2023-07-27T14:27:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 -- 172.21.15.115:0/3575477717 learned_addr learned my addr 172.21.15.115:0/3575477717 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:35.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6fcf9c700 1 --2- 172.21.15.115:0/3575477717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f80c5c50 0x7fd6f8063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f77fe700 1 --2- 172.21.15.115:0/3575477717 >> v2:172.21.15.159:3300/0 conn(0x7fd6f814b1e0 0x7fd6f8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 -- 172.21.15.115:0/3575477717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f80c5c50 msgr2=0x7fd6f8063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:35.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 --2- 172.21.15.115:0/3575477717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f80c5c50 0x7fd6f8063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 -- 172.21.15.115:0/3575477717 >> v2:172.21.15.159:3300/0 conn(0x7fd6f814b1e0 msgr2=0x7fd6f8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:35.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 --2- 172.21.15.115:0/3575477717 >> v2:172.21.15.159:3300/0 conn(0x7fd6f814b1e0 0x7fd6f8062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 -- 172.21.15.115:0/3575477717 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8157d10 con 0x7fd6f814ae00 2023-07-27T14:27:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f77fe700 1 --2- 172.21.15.115:0/3575477717 >> v2:172.21.15.159:3300/0 conn(0x7fd6f814b1e0 0x7fd6f8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f7fff700 1 --2- 172.21.15.115:0/3575477717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f814ae00 0x7fd6f8154f00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd6f80cbc00 tx=0x7fd6e80090f0).ready entity=mon.0 client_cookie=c4e7113f28a193ac server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f6ffd700 1 -- 172.21.15.115:0/3575477717 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800b520 con 0x7fd6f814ae00 2023-07-27T14:27:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f6ffd700 1 -- 172.21.15.115:0/3575477717 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800b680 con 0x7fd6f814ae00 2023-07-27T14:27:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.831+0000 7fd6f6ffd700 1 -- 172.21.15.115:0/3575477717 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800ba00 con 0x7fd6f814ae00 2023-07-27T14:27:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/3575477717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f814ae00 msgr2=0x7fd6f8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/3575477717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f814ae00 0x7fd6f8154f00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd6f80cbc00 tx=0x7fd6e80090f0).stop 2023-07-27T14:27:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/3575477717 shutdown_connections 2023-07-27T14:27:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/3575477717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f80c5c50 0x7fd6f8063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/3575477717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f814ae00 0x7fd6f8154f00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/3575477717 >> v2:172.21.15.159:3300/0 conn(0x7fd6f814b1e0 0x7fd6f8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/3575477717 >> 172.21.15.115:0/3575477717 conn(0x7fd6f805e940 msgr2=0x7fd6f80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/3575477717 shutdown_connections 2023-07-27T14:27:35.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.832+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/3575477717 wait complete. 2023-07-27T14:27:35.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.834+0000 7fd6fe9ff700 1 Processor -- start 2023-07-27T14:27:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.834+0000 7fd6fe9ff700 1 -- start start 2023-07-27T14:27:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6fe9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f80c5c50 0x7fd6f80b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6fe9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f814ae00 0x7fd6f8163d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6fe9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f814b1e0 0x7fd6f80ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6fe9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80c40c0 con 0x7fd6f80c5c50 2023-07-27T14:27:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6fe9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80c4610 con 0x7fd6f814b1e0 2023-07-27T14:27:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6fe9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80c2fc0 con 0x7fd6f814ae00 2023-07-27T14:27:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f80c5c50 0x7fd6f80b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f80c5c50 0x7fd6f80b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34746/0 (socket says 172.21.15.115:34746) 2023-07-27T14:27:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f7fff700 1 -- 172.21.15.115:0/569645123 learned_addr learned my addr 172.21.15.115:0/569645123 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f77fe700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f814ae00 0x7fd6f8163d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f7fff700 1 -- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f814ae00 msgr2=0x7fd6f8163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6fcf9c700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f814b1e0 0x7fd6f80ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f7fff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f814ae00 0x7fd6f8163d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f7fff700 1 -- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f814b1e0 msgr2=0x7fd6f80ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f7fff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f814b1e0 0x7fd6f80ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f7fff700 1 -- 172.21.15.115:0/569645123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e8009370 con 0x7fd6f80c5c50 2023-07-27T14:27:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6f77fe700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f814ae00 0x7fd6f8163d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.835+0000 7fd6fcf9c700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f814b1e0 0x7fd6f80ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.836+0000 7fd6f7fff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f80c5c50 0x7fd6f80b0560 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd6f80caac0 tx=0x7fd6e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.836+0000 7fd6dffff700 1 -- 172.21.15.115:0/569645123 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800be90 con 0x7fd6f80c5c50 2023-07-27T14:27:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.836+0000 7fd6dffff700 1 -- 172.21.15.115:0/569645123 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800b7f0 con 0x7fd6f80c5c50 2023-07-27T14:27:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.836+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f80c32a0 con 0x7fd6f80c5c50 2023-07-27T14:27:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.836+0000 7fd6dffff700 1 -- 172.21.15.115:0/569645123 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e801c650 con 0x7fd6f80c5c50 2023-07-27T14:27:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.836+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f80b0a50 con 0x7fd6f80c5c50 2023-07-27T14:27:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.837+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f806c470 con 0x7fd6f80c5c50 2023-07-27T14:27:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.838+0000 7fd6dffff700 1 -- 172.21.15.115:0/569645123 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd6e8022030 con 0x7fd6f80c5c50 2023-07-27T14:27:35.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.838+0000 7fd6dffff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405ed90 0x7fd6e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:35.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.838+0000 7fd6dffff700 1 -- 172.21.15.115:0/569645123 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd6e807b9f0 con 0x7fd6f80c5c50 2023-07-27T14:27:35.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.839+0000 7fd6f77fe700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405ed90 0x7fd6e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:35.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.839+0000 7fd6f77fe700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405ed90 0x7fd6e4061250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd6ec006d80 tx=0x7fd6ec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:35.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:35.843+0000 7fd6dffff700 1 -- 172.21.15.115:0/569645123 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd6e804ce80 con 0x7fd6f80c5c50 2023-07-27T14:27:36.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.013+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6f80cb900 con 0x7fd6f80c5c50 2023-07-27T14:27:36.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.013+0000 7fd6dffff700 1 -- 172.21.15.115:0/569645123 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6e8020070 con 0x7fd6f80c5c50 2023-07-27T14:27:36.030 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405ed90 msgr2=0x7fd6e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405ed90 0x7fd6e4061250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd6ec006d80 tx=0x7fd6ec008040).stop 2023-07-27T14:27:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f80c5c50 msgr2=0x7fd6f80b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f80c5c50 0x7fd6f80b0560 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd6f80caac0 tx=0x7fd6e8017000).stop 2023-07-27T14:27:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 shutdown_connections 2023-07-27T14:27:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405ed90 0x7fd6e4061250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f814b1e0 0x7fd6f80ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f80c5c50 0x7fd6f80b0560 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 --2- 172.21.15.115:0/569645123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f814ae00 0x7fd6f8163d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 >> 172.21.15.115:0/569645123 conn(0x7fd6f805e940 msgr2=0x7fd6f81527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:36.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 shutdown_connections 2023-07-27T14:27:36.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.016+0000 7fd6fe9ff700 1 -- 172.21.15.115:0/569645123 wait complete. 2023-07-27T14:27:36.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:36.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.219+0000 7f57753ff700 1 Processor -- start 2023-07-27T14:27:36.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.220+0000 7f57753ff700 1 -- start start 2023-07-27T14:27:36.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f57753ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f57753ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57700aa050 0x7f57700640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f57753ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57700aa4d0 con 0x7f57700aaa40 2023-07-27T14:27:36.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f57753ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700c05c0 con 0x7f57700aa050 2023-07-27T14:27:36.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f57753ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700c1a60 con 0x7f5770153ec0 2023-07-27T14:27:36.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f576e7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57700aa050 0x7f57700640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f576f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f57700aaa40 0x7f5770157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34410/0 (socket says 172.21.15.115:34410) 2023-07-27T14:27:36.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f576f7fe700 1 -- 172.21.15.115:0/854845606 learned_addr learned my addr 172.21.15.115:0/854845606 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:36.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.221+0000 7f576effd700 1 --2- 172.21.15.115:0/854845606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576dffb700 1 -- 172.21.15.115:0/854845606 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598280084 0 0) 0x7f5768001490 con 0x7f57700aaa40 2023-07-27T14:27:36.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576e7fc700 1 -- 172.21.15.115:0/854845606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 msgr2=0x7f57700a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:36.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576e7fc700 1 --2- 172.21.15.115:0/854845606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576e7fc700 1 -- 172.21.15.115:0/854845606 >> v1:172.21.15.115:6789/0 conn(0x7f57700aaa40 legacy=0x7f5770157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576e7fc700 1 -- 172.21.15.115:0/854845606 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700bfc90 con 0x7f57700aa050 2023-07-27T14:27:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576e7fc700 1 --2- 172.21.15.115:0/854845606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aa050 0x7f57700640f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5764009760 tx=0x7f5764009060).ready entity=mon.0 client_cookie=cf4a1c25d7d6fa1a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576dffb700 1 -- 172.21.15.115:0/854845606 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400b580 con 0x7f57700aa050 2023-07-27T14:27:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576dffb700 1 -- 172.21.15.115:0/854845606 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400b6e0 con 0x7f57700aa050 2023-07-27T14:27:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f576dffb700 1 -- 172.21.15.115:0/854845606 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400ba60 con 0x7f57700aa050 2023-07-27T14:27:36.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f57753ff700 1 -- 172.21.15.115:0/854845606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aa050 msgr2=0x7f57700640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.222+0000 7f57753ff700 1 --2- 172.21.15.115:0/854845606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aa050 0x7f57700640f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5764009760 tx=0x7f5764009060).stop 2023-07-27T14:27:36.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.223+0000 7f57753ff700 1 -- 172.21.15.115:0/854845606 shutdown_connections 2023-07-27T14:27:36.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.223+0000 7f57753ff700 1 --2- 172.21.15.115:0/854845606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.223+0000 7f57753ff700 1 --2- 172.21.15.115:0/854845606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aa050 0x7f57700640f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.223+0000 7f57753ff700 1 -- 172.21.15.115:0/854845606 >> 172.21.15.115:0/854845606 conn(0x7f57700cb610 msgr2=0x7f57700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:36.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.223+0000 7f57753ff700 1 -- 172.21.15.115:0/854845606 shutdown_connections 2023-07-27T14:27:36.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.223+0000 7f57753ff700 1 -- 172.21.15.115:0/854845606 wait complete. 2023-07-27T14:27:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.224+0000 7f57753ff700 1 Processor -- start 2023-07-27T14:27:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.224+0000 7f57753ff700 1 -- start start 2023-07-27T14:27:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.225+0000 7f57753ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57700aa050 0x7f577014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.225+0000 7f57753ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aaa40 0x7f5770153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.225+0000 7f57753ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.225+0000 7f57753ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014d0a0 con 0x7f57700aaa40 2023-07-27T14:27:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.225+0000 7f57753ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57700c2130 con 0x7f57700aa050 2023-07-27T14:27:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.225+0000 7f57753ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700c2410 con 0x7f5770153ec0 2023-07-27T14:27:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aaa40 0x7f5770153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aaa40 0x7f5770153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34752/0 (socket says 172.21.15.115:34752) 2023-07-27T14:27:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 -- 172.21.15.115:0/2752692788 learned_addr learned my addr 172.21.15.115:0/2752692788 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576f7fe700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576effd700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57700aa050 0x7f577014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 -- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 msgr2=0x7f57700aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 -- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57700aa050 msgr2=0x7f577014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57700aa050 0x7f577014cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 -- 172.21.15.115:0/2752692788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640092a0 con 0x7f57700aaa40 2023-07-27T14:27:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576effd700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57700aa050 0x7f577014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576f7fe700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f576e7fc700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aaa40 0x7f5770153050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f577005fc60 tx=0x7f5764017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f5756ffd700 1 -- 172.21.15.115:0/2752692788 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400b850 con 0x7f57700aaa40 2023-07-27T14:27:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f5756ffd700 1 -- 172.21.15.115:0/2752692788 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400b9b0 con 0x7f57700aaa40 2023-07-27T14:27:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57700c26f0 con 0x7f57700aaa40 2023-07-27T14:27:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.226+0000 7f5756ffd700 1 -- 172.21.15.115:0/2752692788 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576401b640 con 0x7f57700aaa40 2023-07-27T14:27:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.227+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770153540 con 0x7f57700aaa40 2023-07-27T14:27:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.228+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577006c470 con 0x7f57700aaa40 2023-07-27T14:27:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.228+0000 7f5756ffd700 1 -- 172.21.15.115:0/2752692788 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f576402b070 con 0x7f57700aaa40 2023-07-27T14:27:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.229+0000 7f5756ffd700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f575c05ed60 0x7f575c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.229+0000 7f5756ffd700 1 -- 172.21.15.115:0/2752692788 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f576407b4c0 con 0x7f57700aaa40 2023-07-27T14:27:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.229+0000 7f576effd700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f575c05ed60 0x7f575c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.230+0000 7f576effd700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f575c05ed60 0x7f575c061220 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5760006fd0 tx=0x7f5760008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.233+0000 7f5756ffd700 1 -- 172.21.15.115:0/2752692788 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f576404ca60 con 0x7f57700aaa40 2023-07-27T14:27:36.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.403+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57700bff70 con 0x7f57700aaa40 2023-07-27T14:27:36.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.404+0000 7f5756ffd700 1 -- 172.21.15.115:0/2752692788 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f576401f090 con 0x7f57700aaa40 2023-07-27T14:27:36.420 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:36.420 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:36.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f575c05ed60 msgr2=0x7f575c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f575c05ed60 0x7f575c061220 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5760006fd0 tx=0x7f5760008040).stop 2023-07-27T14:27:36.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aaa40 msgr2=0x7f5770153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aaa40 0x7f5770153050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f577005fc60 tx=0x7f5764017000).stop 2023-07-27T14:27:36.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 shutdown_connections 2023-07-27T14:27:36.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f575c05ed60 0x7f575c061220 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5770153ec0 0x7f57700aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57700aa050 0x7f577014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 --2- 172.21.15.115:0/2752692788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700aaa40 0x7f5770153050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 >> 172.21.15.115:0/2752692788 conn(0x7f57700cb610 msgr2=0x7f57700ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:36.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 shutdown_connections 2023-07-27T14:27:36.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.406+0000 7f57753ff700 1 -- 172.21.15.115:0/2752692788 wait complete. 2023-07-27T14:27:36.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:26:59.286583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:27:00.228329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:27:36.441 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:27:36.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.616+0000 7f7bb4bff700 1 Processor -- start 2023-07-27T14:27:36.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.616+0000 7f7bb4bff700 1 -- start start 2023-07-27T14:27:36.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.617+0000 7f7bb4bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 0x7f7bb0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.617+0000 7f7bb4bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb01553f0 con 0x7f7bb014b1e0 2023-07-27T14:27:36.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.617+0000 7f7bb4bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb0157a50 con 0x7f7bb0063260 2023-07-27T14:27:36.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.617+0000 7f7bb4bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0157d10 con 0x7f7bb014ae00 2023-07-27T14:27:36.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7badd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7bb014b1e0 0x7f7bb0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34416/0 (socket says 172.21.15.115:34416) 2023-07-27T14:27:36.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7badd9b700 1 -- 172.21.15.115:0/751389028 learned_addr learned my addr 172.21.15.115:0/751389028 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:36.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bae59c700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 0x7f7bb0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328155802 0 0) 0x7f7bb01553f0 con 0x7f7bb014b1e0 2023-07-27T14:27:36.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b980033f0 con 0x7f7bb014b1e0 2023-07-27T14:27:36.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586640141 0 0) 0x7f7bb0157a50 con 0x7f7bb0063260 2023-07-27T14:27:36.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb01553f0 con 0x7f7bb0063260 2023-07-27T14:27:36.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 522157137 0 0) 0x7f7b980033f0 con 0x7f7bb014b1e0 2023-07-27T14:27:36.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 msgr2=0x7f7bb0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:36.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 0x7f7bb0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 >> v1:172.21.15.159:6789/0 conn(0x7f7bb0063260 legacy=0x7f7bb00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb0157ff0 con 0x7f7bb014b1e0 2023-07-27T14:27:36.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f7ba4001470 con 0x7f7bb014b1e0 2023-07-27T14:27:36.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bae59c700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 0x7f7bb0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:36.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.618+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 >> v1:172.21.15.115:6789/0 conn(0x7f7bb014b1e0 legacy=0x7f7bb0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7bad59a700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 0x7f7b98003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7bad59a700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98003f90 0x7f7b98004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7bad59a700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b98004b80 0x7f7b98005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0157d10 con 0x7f7b98004b80 2023-07-27T14:27:36.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9800b940 con 0x7f7b98003f90 2023-07-27T14:27:36.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9800bb00 con 0x7f7bb014ae00 2023-07-27T14:27:36.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7baed9d700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b98004b80 0x7f7b98005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7bae59c700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 0x7f7b98003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7badd9b700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98003f90 0x7f7b98004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7baed9d700 1 -- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 msgr2=0x7f7b98003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:36.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7baed9d700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb014ae00 0x7f7b98003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7baed9d700 1 -- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98003f90 msgr2=0x7f7b98004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:36.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7baed9d700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98003f90 0x7f7b98004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7baed9d700 1 -- 172.21.15.115:0/751389028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba00092a0 con 0x7f7b98004b80 2023-07-27T14:27:36.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.619+0000 7f7baed9d700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b98004b80 0x7f7b98005000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f7ba8001f90 tx=0x7f7ba8007f30).ready entity=mon.0 client_cookie=ed49adcd4b402b70 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:36.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba80020f0 con 0x7f7b98004b80 2023-07-27T14:27:36.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba8006a20 con 0x7f7b98004b80 2023-07-27T14:27:36.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bad59a700 1 -- 172.21.15.115:0/751389028 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8006dc0 con 0x7f7b98004b80 2023-07-27T14:27:36.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bb4bff700 1 -- 172.21.15.115:0/751389028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b98004b80 msgr2=0x7f7b98005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bb4bff700 1 --2- 172.21.15.115:0/751389028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b98004b80 0x7f7b98005000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f7ba8001f90 tx=0x7f7ba8007f30).stop 2023-07-27T14:27:36.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7baed9d700 1 -- 172.21.15.115:0/751389028 reap_dead start 2023-07-27T14:27:36.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bb4bff700 1 -- 172.21.15.115:0/751389028 shutdown_connections 2023-07-27T14:27:36.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bb4bff700 1 -- 172.21.15.115:0/751389028 >> 172.21.15.115:0/751389028 conn(0x7f7bb005e940 msgr2=0x7f7bb00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:36.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bb4bff700 1 -- 172.21.15.115:0/751389028 shutdown_connections 2023-07-27T14:27:36.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.620+0000 7f7bb4bff700 1 -- 172.21.15.115:0/751389028 wait complete. 2023-07-27T14:27:36.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.622+0000 7f7bb4bff700 1 Processor -- start 2023-07-27T14:27:36.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.622+0000 7f7bb4bff700 1 -- start start 2023-07-27T14:27:36.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7bb4bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98004b80 0x7f7bb014cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7bb4bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb0164d30 0x7f7bb0156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7bb4bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb0150cf0 0x7f7bb0151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7bb4bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb014e180 con 0x7f7bb0164d30 2023-07-27T14:27:36.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7bb4bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0151660 con 0x7f7b98004b80 2023-07-27T14:27:36.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7bb4bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb014b8f0 con 0x7f7bb0150cf0 2023-07-27T14:27:36.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7badd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb0164d30 0x7f7bb0156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7badd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb0164d30 0x7f7bb0156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34760/0 (socket says 172.21.15.115:34760) 2023-07-27T14:27:36.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7badd9b700 1 -- 172.21.15.115:0/181552991 learned_addr learned my addr 172.21.15.115:0/181552991 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:36.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7baed9d700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb0150cf0 0x7f7bb0151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7bae59c700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98004b80 0x7f7bb014cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7badd9b700 1 -- 172.21.15.115:0/181552991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb0150cf0 msgr2=0x7f7bb0151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7badd9b700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb0150cf0 0x7f7bb0151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7badd9b700 1 -- 172.21.15.115:0/181552991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98004b80 msgr2=0x7f7bb014cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7badd9b700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98004b80 0x7f7bb014cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.623+0000 7f7badd9b700 1 -- 172.21.15.115:0/181552991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb014d570 con 0x7f7bb0164d30 2023-07-27T14:27:36.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.624+0000 7f7badd9b700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb0164d30 0x7f7bb0156980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f7ba4007740 tx=0x7f7ba4001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:36.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.624+0000 7f7b9e7fc700 1 -- 172.21.15.115:0/181552991 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4011590 con 0x7f7bb0164d30 2023-07-27T14:27:36.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.624+0000 7f7b9e7fc700 1 -- 172.21.15.115:0/181552991 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba40116f0 con 0x7f7bb0164d30 2023-07-27T14:27:36.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.624+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb014d850 con 0x7f7bb0164d30 2023-07-27T14:27:36.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.624+0000 7f7b9e7fc700 1 -- 172.21.15.115:0/181552991 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4011a70 con 0x7f7bb0164d30 2023-07-27T14:27:36.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.624+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb014de10 con 0x7f7bb0164d30 2023-07-27T14:27:36.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.625+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb014e2f0 con 0x7f7bb0164d30 2023-07-27T14:27:36.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.626+0000 7f7b9e7fc700 1 -- 172.21.15.115:0/181552991 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f7ba401b030 con 0x7f7bb0164d30 2023-07-27T14:27:36.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.627+0000 7f7b9e7fc700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b9005ed60 0x7f7b90061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:36.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.627+0000 7f7b9e7fc700 1 -- 172.21.15.115:0/181552991 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ba4079140 con 0x7f7bb0164d30 2023-07-27T14:27:36.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.627+0000 7f7bae59c700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b9005ed60 0x7f7b90061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:36.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.628+0000 7f7bae59c700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b9005ed60 0x7f7b90061220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f7ba0006d50 tx=0x7f7ba0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:36.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.632+0000 7f7b9e7fc700 1 -- 172.21.15.115:0/181552991 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ba404a790 con 0x7f7bb0164d30 2023-07-27T14:27:36.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.802+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7bb006c470 con 0x7f7bb0164d30 2023-07-27T14:27:36.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.802+0000 7f7b9e7fc700 1 -- 172.21.15.115:0/181552991 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7ba4019020 con 0x7f7bb0164d30 2023-07-27T14:27:36.818 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:27:36.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b9005ed60 msgr2=0x7f7b90061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b9005ed60 0x7f7b90061220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f7ba0006d50 tx=0x7f7ba0008040).stop 2023-07-27T14:27:36.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb0164d30 msgr2=0x7f7bb0156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:36.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb0164d30 0x7f7bb0156980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f7ba4007740 tx=0x7f7ba4001e10).stop 2023-07-27T14:27:36.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 shutdown_connections 2023-07-27T14:27:36.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b9005ed60 0x7f7b90061220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bb0150cf0 0x7f7bb0151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b98004b80 0x7f7bb014cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 --2- 172.21.15.115:0/181552991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bb0164d30 0x7f7bb0156980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:36.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.804+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 >> 172.21.15.115:0/181552991 conn(0x7f7bb005e940 msgr2=0x7f7bb0152840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:36.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.805+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 shutdown_connections 2023-07-27T14:27:36.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:36.805+0000 7f7bb4bff700 1 -- 172.21.15.115:0/181552991 wait complete. 2023-07-27T14:27:36.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:27:37.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.012+0000 7f42f29ff700 1 Processor -- start 2023-07-27T14:27:37.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.012+0000 7f42f29ff700 1 -- start start 2023-07-27T14:27:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.013+0000 7f42f29ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14ae00 0x7f42ec154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f29ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42ec063260 0x7f42ec0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f29ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec1553f0 con 0x7f42ec14b1e0 2023-07-27T14:27:37.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f29ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec157a50 con 0x7f42ec063260 2023-07-27T14:27:37.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f29ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec157d10 con 0x7f42ec14ae00 2023-07-27T14:27:37.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42eb7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f42ec14b1e0 0x7f42ec062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34424/0 (socket says 172.21.15.115:34424) 2023-07-27T14:27:37.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42eb7fe700 1 -- 172.21.15.115:0/1251410 learned_addr learned my addr 172.21.15.115:0/1251410 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:37.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f0f9c700 1 --2- 172.21.15.115:0/1251410 >> v2:172.21.15.115:3300/0 conn(0x7f42ec063260 0x7f42ec0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42ebfff700 1 --2- 172.21.15.115:0/1251410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14ae00 0x7f42ec154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42eaffd700 1 -- 172.21.15.115:0/1251410 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068590058 0 0) 0x7f42ec1553f0 con 0x7f42ec14b1e0 2023-07-27T14:27:37.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42eaffd700 1 -- 172.21.15.115:0/1251410 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d40033f0 con 0x7f42ec14b1e0 2023-07-27T14:27:37.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f0f9c700 1 -- 172.21.15.115:0/1251410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14ae00 msgr2=0x7f42ec154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:37.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f0f9c700 1 --2- 172.21.15.115:0/1251410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14ae00 0x7f42ec154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f0f9c700 1 -- 172.21.15.115:0/1251410 >> v1:172.21.15.115:6789/0 conn(0x7f42ec14b1e0 legacy=0x7f42ec062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.014+0000 7f42f0f9c700 1 -- 172.21.15.115:0/1251410 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec157ff0 con 0x7f42ec063260 2023-07-27T14:27:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42f0f9c700 1 --2- 172.21.15.115:0/1251410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0a98c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f42e4009e60 tx=0x7f42e4009780).ready entity=mon.0 client_cookie=b6980bb095f17b01 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42eaffd700 1 -- 172.21.15.115:0/1251410 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400e070 con 0x7f42ec063260 2023-07-27T14:27:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42eaffd700 1 -- 172.21.15.115:0/1251410 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e400bab0 con 0x7f42ec063260 2023-07-27T14:27:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42eaffd700 1 -- 172.21.15.115:0/1251410 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400be30 con 0x7f42ec063260 2023-07-27T14:27:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42f29ff700 1 -- 172.21.15.115:0/1251410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 msgr2=0x7f42ec0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42f29ff700 1 --2- 172.21.15.115:0/1251410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0a98c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f42e4009e60 tx=0x7f42e4009780).stop 2023-07-27T14:27:37.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42f29ff700 1 -- 172.21.15.115:0/1251410 shutdown_connections 2023-07-27T14:27:37.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42f29ff700 1 --2- 172.21.15.115:0/1251410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14ae00 0x7f42ec154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42f29ff700 1 --2- 172.21.15.115:0/1251410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0a98c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.015+0000 7f42f29ff700 1 -- 172.21.15.115:0/1251410 >> 172.21.15.115:0/1251410 conn(0x7f42ec05e940 msgr2=0x7f42ec0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:37.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.016+0000 7f42f29ff700 1 -- 172.21.15.115:0/1251410 shutdown_connections 2023-07-27T14:27:37.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.016+0000 7f42f29ff700 1 -- 172.21.15.115:0/1251410 wait complete. 2023-07-27T14:27:37.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.017+0000 7f42f29ff700 1 Processor -- start 2023-07-27T14:27:37.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.017+0000 7f42f29ff700 1 -- start start 2023-07-27T14:27:37.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42f29ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42f29ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42ec14ae00 0x7f42ec0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42f29ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14b1e0 0x7f42ec13f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42f29ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c4780 con 0x7f42ec063260 2023-07-27T14:27:37.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42f29ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0ae050 con 0x7f42ec14ae00 2023-07-27T14:27:37.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42f29ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c4450 con 0x7f42ec14b1e0 2023-07-27T14:27:37.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34774/0 (socket says 172.21.15.115:34774) 2023-07-27T14:27:37.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.018+0000 7f42ebfff700 1 -- 172.21.15.115:0/3269793293 learned_addr learned my addr 172.21.15.115:0/3269793293 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:37.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42eb7fe700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42ec14ae00 0x7f42ec0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42f0f9c700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14b1e0 0x7f42ec13f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42ebfff700 1 -- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14b1e0 msgr2=0x7f42ec13f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42ebfff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14b1e0 0x7f42ec13f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42ebfff700 1 -- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42ec14ae00 msgr2=0x7f42ec0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42ebfff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42ec14ae00 0x7f42ec0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42ebfff700 1 -- 172.21.15.115:0/3269793293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4009a20 con 0x7f42ec063260 2023-07-27T14:27:37.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42f0f9c700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14b1e0 0x7f42ec13f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:37.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42ebfff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0c1c50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f42dc00e960 tx=0x7f42dc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42d3fff700 1 -- 172.21.15.115:0/3269793293 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00c6a0 con 0x7f42ec063260 2023-07-27T14:27:37.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42d3fff700 1 -- 172.21.15.115:0/3269793293 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc00c800 con 0x7f42ec063260 2023-07-27T14:27:37.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42d3fff700 1 -- 172.21.15.115:0/3269793293 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00cb80 con 0x7f42ec063260 2023-07-27T14:27:37.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec0caa40 con 0x7f42ec063260 2023-07-27T14:27:37.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.019+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec167e70 con 0x7f42ec063260 2023-07-27T14:27:37.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.021+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec06c470 con 0x7f42ec063260 2023-07-27T14:27:37.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.021+0000 7f42d3fff700 1 -- 172.21.15.115:0/3269793293 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f42dc022070 con 0x7f42ec063260 2023-07-27T14:27:37.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.022+0000 7f42d3fff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42d805ed60 0x7f42d8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.022+0000 7f42d3fff700 1 -- 172.21.15.115:0/3269793293 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f42dc079fc0 con 0x7f42ec063260 2023-07-27T14:27:37.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.022+0000 7f42eb7fe700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42d805ed60 0x7f42d8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.022+0000 7f42eb7fe700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42d805ed60 0x7f42d8061220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f42ec153370 tx=0x7f42e0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.026+0000 7f42d3fff700 1 -- 172.21.15.115:0/3269793293 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42dc04b450 con 0x7f42ec063260 2023-07-27T14:27:37.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.193+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42ec0c4aa0 con 0x7f42ec063260 2023-07-27T14:27:37.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.194+0000 7f42d3fff700 1 -- 172.21.15.115:0/3269793293 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f42dc04ea70 con 0x7f42ec063260 2023-07-27T14:27:37.210 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:27:37.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42d805ed60 msgr2=0x7f42d8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42d805ed60 0x7f42d8061220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f42ec153370 tx=0x7f42e0009040).stop 2023-07-27T14:27:37.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 msgr2=0x7f42ec0c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0c1c50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f42dc00e960 tx=0x7f42dc009060).stop 2023-07-27T14:27:37.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 shutdown_connections 2023-07-27T14:27:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42d805ed60 0x7f42d8061220 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42ec14b1e0 0x7f42ec13f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42ec063260 0x7f42ec0c1c50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 --2- 172.21.15.115:0/3269793293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42ec14ae00 0x7f42ec0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 >> 172.21.15.115:0/3269793293 conn(0x7f42ec05e940 msgr2=0x7f42ec0a9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 shutdown_connections 2023-07-27T14:27:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.196+0000 7f42f29ff700 1 -- 172.21.15.115:0/3269793293 wait complete. 2023-07-27T14:27:37.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:27:37.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.404+0000 7f49325ff700 1 Processor -- start 2023-07-27T14:27:37.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.404+0000 7f49325ff700 1 -- start start 2023-07-27T14:27:37.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.405+0000 7f49325ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14ae00 0x7f492c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.405+0000 7f49325ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f492c14b1e0 0x7f492c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.405+0000 7f49325ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c1553f0 con 0x7f492c0c5c50 2023-07-27T14:27:37.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.405+0000 7f49325ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c157a50 con 0x7f492c14b1e0 2023-07-27T14:27:37.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.405+0000 7f49325ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c157d10 con 0x7f492c14ae00 2023-07-27T14:27:37.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f492c14b1e0 0x7f492c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f4930b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f492c0c5c50 0x7f492c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34430/0 (socket says 172.21.15.115:34430) 2023-07-27T14:27:37.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f4930b9c700 1 -- 172.21.15.115:0/1005030941 learned_addr learned my addr 172.21.15.115:0/1005030941 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:37.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492b7fe700 1 -- 172.21.15.115:0/1005030941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14ae00 msgr2=0x7f492c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:37.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492bfff700 1 --2- 172.21.15.115:0/1005030941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14ae00 0x7f492c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492b7fe700 1 --2- 172.21.15.115:0/1005030941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14ae00 0x7f492c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492b7fe700 1 -- 172.21.15.115:0/1005030941 >> v1:172.21.15.115:6789/0 conn(0x7f492c0c5c50 legacy=0x7f492c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492b7fe700 1 -- 172.21.15.115:0/1005030941 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c157ff0 con 0x7f492c14b1e0 2023-07-27T14:27:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492affd700 1 -- 172.21.15.115:0/1005030941 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105388310 0 0) 0x7f492c1553f0 con 0x7f492c0c5c50 2023-07-27T14:27:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492bfff700 1 --2- 172.21.15.115:0/1005030941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14ae00 0x7f492c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.406+0000 7f492b7fe700 1 --2- 172.21.15.115:0/1005030941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14b1e0 0x7f492c062b50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f4920009760 tx=0x7f4920009060).ready entity=mon.0 client_cookie=7446b9224d2feafd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f492affd700 1 -- 172.21.15.115:0/1005030941 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000b580 con 0x7f492c14b1e0 2023-07-27T14:27:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f492affd700 1 -- 172.21.15.115:0/1005030941 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492000b6e0 con 0x7f492c14b1e0 2023-07-27T14:27:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f492affd700 1 -- 172.21.15.115:0/1005030941 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000ba60 con 0x7f492c14b1e0 2023-07-27T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f49325ff700 1 -- 172.21.15.115:0/1005030941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14b1e0 msgr2=0x7f492c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f49325ff700 1 --2- 172.21.15.115:0/1005030941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14b1e0 0x7f492c062b50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f4920009760 tx=0x7f4920009060).stop 2023-07-27T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f49325ff700 1 -- 172.21.15.115:0/1005030941 shutdown_connections 2023-07-27T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f49325ff700 1 --2- 172.21.15.115:0/1005030941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14ae00 0x7f492c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f49325ff700 1 --2- 172.21.15.115:0/1005030941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14b1e0 0x7f492c062b50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f49325ff700 1 -- 172.21.15.115:0/1005030941 >> 172.21.15.115:0/1005030941 conn(0x7f492c05e940 msgr2=0x7f492c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f49325ff700 1 -- 172.21.15.115:0/1005030941 shutdown_connections 2023-07-27T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.407+0000 7f49325ff700 1 -- 172.21.15.115:0/1005030941 wait complete. 2023-07-27T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.409+0000 7f49325ff700 1 Processor -- start 2023-07-27T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.409+0000 7f49325ff700 1 -- start start 2023-07-27T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f49325ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f492c0c5c50 0x7f492c0c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f49325ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14ae00 0x7f492c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f49325ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14b1e0 0x7f492c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f49325ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0add00 con 0x7f492c14ae00 2023-07-27T14:27:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f49325ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0c2b50 con 0x7f492c0c5c50 2023-07-27T14:27:37.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f49325ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0c2e00 con 0x7f492c14b1e0 2023-07-27T14:27:37.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14ae00 0x7f492c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14ae00 0x7f492c14a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34806/0 (socket says 172.21.15.115:34806) 2023-07-27T14:27:37.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492b7fe700 1 -- 172.21.15.115:0/503965265 learned_addr learned my addr 172.21.15.115:0/503965265 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:37.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492b7fe700 1 -- 172.21.15.115:0/503965265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14b1e0 msgr2=0x7f492c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492b7fe700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14b1e0 0x7f492c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:37.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492b7fe700 1 -- 172.21.15.115:0/503965265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f492c0c5c50 msgr2=0x7f492c0c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492bfff700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f492c0c5c50 0x7f492c0c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492b7fe700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f492c0c5c50 0x7f492c0c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492b7fe700 1 -- 172.21.15.115:0/503965265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200092a0 con 0x7f492c14ae00 2023-07-27T14:27:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.410+0000 7f492bfff700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f492c0c5c50 0x7f492c0c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.411+0000 7f492b7fe700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14ae00 0x7f492c14a390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f492c0c53b0 tx=0x7f4920017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.411+0000 7f4913fff700 1 -- 172.21.15.115:0/503965265 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000ba60 con 0x7f492c14ae00 2023-07-27T14:27:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.411+0000 7f4913fff700 1 -- 172.21.15.115:0/503965265 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920000c90 con 0x7f492c14ae00 2023-07-27T14:27:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.411+0000 7f4913fff700 1 -- 172.21.15.115:0/503965265 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492001c650 con 0x7f492c14ae00 2023-07-27T14:27:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.411+0000 7f49325ff700 1 -- 172.21.15.115:0/503965265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c0c30e0 con 0x7f492c14ae00 2023-07-27T14:27:37.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.411+0000 7f49325ff700 1 -- 172.21.15.115:0/503965265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c0c36a0 con 0x7f492c14ae00 2023-07-27T14:27:37.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.412+0000 7f4911ffb700 1 -- 172.21.15.115:0/503965265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4904005120 con 0x7f492c14ae00 2023-07-27T14:27:37.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.413+0000 7f4913fff700 1 -- 172.21.15.115:0/503965265 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f492000f070 con 0x7f492c14ae00 2023-07-27T14:27:37.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.414+0000 7f4913fff700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f491805ed90 0x7f4918061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.414+0000 7f4913fff700 1 -- 172.21.15.115:0/503965265 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f492007b4a0 con 0x7f492c14ae00 2023-07-27T14:27:37.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.414+0000 7f492bfff700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f491805ed90 0x7f4918061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.415+0000 7f492bfff700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f491805ed90 0x7f4918061250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f491c008990 tx=0x7f491c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.418+0000 7f4913fff700 1 -- 172.21.15.115:0/503965265 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f492004c9e0 con 0x7f492c14ae00 2023-07-27T14:27:37.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.588+0000 7f4911ffb700 1 -- 172.21.15.115:0/503965265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4904005d70 con 0x7f492c14ae00 2023-07-27T14:27:37.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.588+0000 7f4913fff700 1 -- 172.21.15.115:0/503965265 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49200200a0 con 0x7f492c14ae00 2023-07-27T14:27:37.605 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:37.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 -- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f491805ed90 msgr2=0x7f4918061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f491805ed90 0x7f4918061250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f491c008990 tx=0x7f491c008040).stop 2023-07-27T14:27:37.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 -- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14ae00 msgr2=0x7f492c14a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14ae00 0x7f492c14a390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f492c0c53b0 tx=0x7f4920017000).stop 2023-07-27T14:27:37.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 -- 172.21.15.115:0/503965265 shutdown_connections 2023-07-27T14:27:37.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f491805ed90 0x7f4918061250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f492c14b1e0 0x7f492c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:37.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f492c0c5c50 0x7f492c0c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 --2- 172.21.15.115:0/503965265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f492c14ae00 0x7f492c14a390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.590+0000 7f4911ffb700 1 -- 172.21.15.115:0/503965265 >> 172.21.15.115:0/503965265 conn(0x7f492c05e940 msgr2=0x7f492c0abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:37.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.591+0000 7f4911ffb700 1 -- 172.21.15.115:0/503965265 shutdown_connections 2023-07-27T14:27:37.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.591+0000 7f4911ffb700 1 -- 172.21.15.115:0/503965265 wait complete. 2023-07-27T14:27:37.624 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:27:37.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.799+0000 7f99855ff700 1 Processor -- start 2023-07-27T14:27:37.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.799+0000 7f99855ff700 1 -- start start 2023-07-27T14:27:37.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.800+0000 7f99855ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f998014ae00 0x7f9980154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.800+0000 7f99855ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 0x7f99800a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.800+0000 7f99855ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99801553f0 con 0x7f998014b1e0 2023-07-27T14:27:37.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.800+0000 7f99855ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9980157a50 con 0x7f998014ae00 2023-07-27T14:27:37.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.800+0000 7f99855ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9980157d10 con 0x7f9980063260 2023-07-27T14:27:37.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f998014ae00 0x7f9980154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f998014ae00 0x7f9980154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34818/0 (socket says 172.21.15.115:34818) 2023-07-27T14:27:37.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997effd700 1 -- 172.21.15.115:0/2946727682 learned_addr learned my addr 172.21.15.115:0/2946727682 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:37.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997effd700 1 -- 172.21.15.115:0/2946727682 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 msgr2=0x7f99800a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:37.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997f7fe700 1 --2- 172.21.15.115:0/2946727682 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 0x7f99800a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997effd700 1 --2- 172.21.15.115:0/2946727682 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 0x7f99800a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997effd700 1 -- 172.21.15.115:0/2946727682 >> v1:172.21.15.159:6789/0 conn(0x7f998014b1e0 legacy=0x7f9980062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:37.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997effd700 1 -- 172.21.15.115:0/2946727682 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980157ff0 con 0x7f998014ae00 2023-07-27T14:27:37.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997f7fe700 1 --2- 172.21.15.115:0/2946727682 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 0x7f99800a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:37.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997effd700 1 --2- 172.21.15.115:0/2946727682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f9980154f00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f9970006fd0 tx=0x7f99700090f0).ready entity=mon.0 client_cookie=a9b84459da408b4c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.801+0000 7f997dffb700 1 -- 172.21.15.115:0/2946727682 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000b600 con 0x7f998014ae00 2023-07-27T14:27:37.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f997dffb700 1 -- 172.21.15.115:0/2946727682 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000b760 con 0x7f998014ae00 2023-07-27T14:27:37.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f997dffb700 1 -- 172.21.15.115:0/2946727682 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000bae0 con 0x7f998014ae00 2023-07-27T14:27:37.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f99855ff700 1 -- 172.21.15.115:0/2946727682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 msgr2=0x7f9980154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f99855ff700 1 --2- 172.21.15.115:0/2946727682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f9980154f00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f9970006fd0 tx=0x7f99700090f0).stop 2023-07-27T14:27:37.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f99855ff700 1 -- 172.21.15.115:0/2946727682 shutdown_connections 2023-07-27T14:27:37.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f99855ff700 1 --2- 172.21.15.115:0/2946727682 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 0x7f99800a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f99855ff700 1 --2- 172.21.15.115:0/2946727682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f9980154f00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:37.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f99855ff700 1 -- 172.21.15.115:0/2946727682 >> 172.21.15.115:0/2946727682 conn(0x7f998005e940 msgr2=0x7f99800cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:37.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f99855ff700 1 -- 172.21.15.115:0/2946727682 shutdown_connections 2023-07-27T14:27:37.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.802+0000 7f99855ff700 1 -- 172.21.15.115:0/2946727682 wait complete. 2023-07-27T14:27:37.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.804+0000 7f99855ff700 1 Processor -- start 2023-07-27T14:27:37.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.804+0000 7f99855ff700 1 -- start start 2023-07-27T14:27:37.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f99855ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 0x7f99800c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f99855ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f998014a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f99855ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998014b1e0 0x7f9980164990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f99855ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9980151a70 con 0x7f998014ae00 2023-07-27T14:27:37.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f99855ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99800c2af0 con 0x7f998014b1e0 2023-07-27T14:27:37.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f99855ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9980164230 con 0x7f9980063260 2023-07-27T14:27:37.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f998014a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f998014a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34828/0 (socket says 172.21.15.115:34828) 2023-07-27T14:27:37.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f997e7fc700 1 -- 172.21.15.115:0/2147824891 learned_addr learned my addr 172.21.15.115:0/2147824891 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:37.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f997e7fc700 1 -- 172.21.15.115:0/2147824891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 msgr2=0x7f99800c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f997e7fc700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 0x7f99800c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:37.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f997e7fc700 1 -- 172.21.15.115:0/2147824891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998014b1e0 msgr2=0x7f9980164990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:37.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f997e7fc700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998014b1e0 0x7f9980164990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:37.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.805+0000 7f997e7fc700 1 -- 172.21.15.115:0/2147824891 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970009370 con 0x7f998014ae00 2023-07-27T14:27:37.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.806+0000 7f997e7fc700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f998014a380 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f997400c490 tx=0x7f9974007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.806+0000 7f9966ffd700 1 -- 172.21.15.115:0/2147824891 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997400f470 con 0x7f998014ae00 2023-07-27T14:27:37.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.806+0000 7f9966ffd700 1 -- 172.21.15.115:0/2147824891 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997400f5d0 con 0x7f998014ae00 2023-07-27T14:27:37.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.806+0000 7f9966ffd700 1 -- 172.21.15.115:0/2147824891 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997400f990 con 0x7f998014ae00 2023-07-27T14:27:37.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.806+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9980151260 con 0x7f998014ae00 2023-07-27T14:27:37.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.806+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99801514b0 con 0x7f998014ae00 2023-07-27T14:27:37.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.807+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998006a600 con 0x7f998014ae00 2023-07-27T14:27:37.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.808+0000 7f9966ffd700 1 -- 172.21.15.115:0/2147824891 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f9974019030 con 0x7f998014ae00 2023-07-27T14:27:37.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.808+0000 7f9966ffd700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f996c05ed90 0x7f996c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:37.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.809+0000 7f9966ffd700 1 -- 172.21.15.115:0/2147824891 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9974078fc0 con 0x7f998014ae00 2023-07-27T14:27:37.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.809+0000 7f997effd700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f996c05ed90 0x7f996c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:37.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.809+0000 7f997effd700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f996c05ed90 0x7f996c061250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9970009130 tx=0x7f9970017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:37.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.812+0000 7f9966ffd700 1 -- 172.21.15.115:0/2147824891 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99740488f0 con 0x7f998014ae00 2023-07-27T14:27:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.981+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99801585a0 con 0x7f998014ae00 2023-07-27T14:27:37.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.982+0000 7f9966ffd700 1 -- 172.21.15.115:0/2147824891 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9974017030 con 0x7f998014ae00 2023-07-27T14:27:37.998 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f996c05ed90 msgr2=0x7f996c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f996c05ed90 0x7f996c061250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9970009130 tx=0x7f9970017000).stop 2023-07-27T14:27:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 msgr2=0x7f998014a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f998014a380 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f997400c490 tx=0x7f9974007db0).stop 2023-07-27T14:27:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 shutdown_connections 2023-07-27T14:27:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f996c05ed90 0x7f996c061250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f998014b1e0 0x7f9980164990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9980063260 0x7f99800c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 --2- 172.21.15.115:0/2147824891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f998014ae00 0x7f998014a380 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 >> 172.21.15.115:0/2147824891 conn(0x7f998005e940 msgr2=0x7f99800a9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 shutdown_connections 2023-07-27T14:27:38.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:37.984+0000 7f99855ff700 1 -- 172.21.15.115:0/2147824891 wait complete. 2023-07-27T14:27:38.017 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:38.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.188+0000 7f6bd0bff700 1 Processor -- start 2023-07-27T14:27:38.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.188+0000 7f6bd0bff700 1 -- start start 2023-07-27T14:27:38.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bd0bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bcc150af0 0x7f6bcc150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bd0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bd0bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6bcc0696f0 0x7f6bcc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bd0bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc06a440 con 0x7f6bcc150af0 2023-07-27T14:27:38.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bd0bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc0bbc80 con 0x7f6bcc0696f0 2023-07-27T14:27:38.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bd0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc069e80 con 0x7f6bcc0c0e80 2023-07-27T14:27:38.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bca59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bcc150af0 0x7f6bcc150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bca59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bcc150af0 0x7f6bcc150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34830/0 (socket says 172.21.15.115:34830) 2023-07-27T14:27:38.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bca59c700 1 -- 172.21.15.115:0/879373563 learned_addr learned my addr 172.21.15.115:0/879373563 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:38.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bcad9d700 1 --2- 172.21.15.115:0/879373563 >> v2:172.21.15.159:3300/0 conn(0x7f6bcc0696f0 0x7f6bcc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bc9d9b700 1 --2- 172.21.15.115:0/879373563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.190+0000 7f6bca59c700 1 -- 172.21.15.115:0/879373563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 msgr2=0x7f6bcc0c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:38.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bca59c700 1 --2- 172.21.15.115:0/879373563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bca59c700 1 -- 172.21.15.115:0/879373563 >> v2:172.21.15.159:3300/0 conn(0x7f6bcc0696f0 msgr2=0x7f6bcc0a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:38.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bca59c700 1 --2- 172.21.15.115:0/879373563 >> v2:172.21.15.159:3300/0 conn(0x7f6bcc0696f0 0x7f6bcc0a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bca59c700 1 -- 172.21.15.115:0/879373563 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc06a160 con 0x7f6bcc150af0 2023-07-27T14:27:38.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bcad9d700 1 --2- 172.21.15.115:0/879373563 >> v2:172.21.15.159:3300/0 conn(0x7f6bcc0696f0 0x7f6bcc0a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:38.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bca59c700 1 --2- 172.21.15.115:0/879373563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc150ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6bcc0c34b0 tx=0x7f6bbc0090f0).ready entity=mon.0 client_cookie=ec45b490778fe7c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:38.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bc959a700 1 -- 172.21.15.115:0/879373563 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00b600 con 0x7f6bcc150af0 2023-07-27T14:27:38.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bc959a700 1 -- 172.21.15.115:0/879373563 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00b760 con 0x7f6bcc150af0 2023-07-27T14:27:38.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bc959a700 1 -- 172.21.15.115:0/879373563 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00bae0 con 0x7f6bcc150af0 2023-07-27T14:27:38.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bd0bff700 1 -- 172.21.15.115:0/879373563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 msgr2=0x7f6bcc150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.191+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/879373563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc150ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6bcc0c34b0 tx=0x7f6bbc0090f0).stop 2023-07-27T14:27:38.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.192+0000 7f6bd0bff700 1 -- 172.21.15.115:0/879373563 shutdown_connections 2023-07-27T14:27:38.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.192+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/879373563 >> v2:172.21.15.159:3300/0 conn(0x7f6bcc0696f0 0x7f6bcc0a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.192+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/879373563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc150ed0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.192+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/879373563 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.192+0000 7f6bd0bff700 1 -- 172.21.15.115:0/879373563 >> 172.21.15.115:0/879373563 conn(0x7f6bcc062320 msgr2=0x7f6bcc062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:38.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.192+0000 7f6bd0bff700 1 -- 172.21.15.115:0/879373563 shutdown_connections 2023-07-27T14:27:38.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.192+0000 7f6bd0bff700 1 -- 172.21.15.115:0/879373563 wait complete. 2023-07-27T14:27:38.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.193+0000 7f6bd0bff700 1 Processor -- start 2023-07-27T14:27:38.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.193+0000 7f6bd0bff700 1 -- start start 2023-07-27T14:27:38.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bd0bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc0696f0 0x7f6bcc0a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bd0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bd0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bd0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc164850 con 0x7f6bcc150af0 2023-07-27T14:27:38.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bd0bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc164b30 con 0x7f6bcc0696f0 2023-07-27T14:27:38.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bd0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc164e10 con 0x7f6bcc0c0e80 2023-07-27T14:27:38.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bcad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bcad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc14f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34834/0 (socket says 172.21.15.115:34834) 2023-07-27T14:27:38.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.194+0000 7f6bcad9d700 1 -- 172.21.15.115:0/3912575277 learned_addr learned my addr 172.21.15.115:0/3912575277 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:38.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bc9d9b700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bca59c700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc0696f0 0x7f6bcc0a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bcad9d700 1 -- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 msgr2=0x7f6bcc0a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bcad9d700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bcad9d700 1 -- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc0696f0 msgr2=0x7f6bcc0a67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bcad9d700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc0696f0 0x7f6bcc0a67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bcad9d700 1 -- 172.21.15.115:0/3912575277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009370 con 0x7f6bcc150af0 2023-07-27T14:27:38.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bc9d9b700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:38.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bca59c700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc0696f0 0x7f6bcc0a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:38.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bcad9d700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc14f4b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f6bc4009fc0 tx=0x7f6bc40099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:38.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bba7fc700 1 -- 172.21.15.115:0/3912575277 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400dd40 con 0x7f6bcc150af0 2023-07-27T14:27:38.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bba7fc700 1 -- 172.21.15.115:0/3912575277 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400f040 con 0x7f6bcc150af0 2023-07-27T14:27:38.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bba7fc700 1 -- 172.21.15.115:0/3912575277 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400dea0 con 0x7f6bcc150af0 2023-07-27T14:27:38.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc1650f0 con 0x7f6bcc150af0 2023-07-27T14:27:38.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.195+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc0a8a60 con 0x7f6bcc150af0 2023-07-27T14:27:38.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.196+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc06c470 con 0x7f6bcc150af0 2023-07-27T14:27:38.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.197+0000 7f6bba7fc700 1 -- 172.21.15.115:0/3912575277 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f6bc4013890 con 0x7f6bcc150af0 2023-07-27T14:27:38.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.198+0000 7f6bba7fc700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bac05ed90 0x7f6bac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.198+0000 7f6bba7fc700 1 -- 172.21.15.115:0/3912575277 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6bc407a440 con 0x7f6bcc150af0 2023-07-27T14:27:38.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.198+0000 7f6bca59c700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bac05ed90 0x7f6bac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.199+0000 7f6bca59c700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bac05ed90 0x7f6bac061250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f6bbc009130 tx=0x7f6bbc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:38.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.202+0000 7f6bba7fc700 1 -- 172.21.15.115:0/3912575277 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bc404b980 con 0x7f6bcc150af0 2023-07-27T14:27:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.373+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bcc063880 con 0x7f6bcc150af0 2023-07-27T14:27:38.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.374+0000 7f6bba7fc700 1 -- 172.21.15.115:0/3912575277 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f6bc404efa0 con 0x7f6bcc150af0 2023-07-27T14:27:38.390 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:38.390 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bac05ed90 msgr2=0x7f6bac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bac05ed90 0x7f6bac061250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f6bbc009130 tx=0x7f6bbc017000).stop 2023-07-27T14:27:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 msgr2=0x7f6bcc14f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc14f4b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f6bc4009fc0 tx=0x7f6bc40099b0).stop 2023-07-27T14:27:38.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 shutdown_connections 2023-07-27T14:27:38.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bac05ed90 0x7f6bac061250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bcc150af0 0x7f6bcc14f4b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc0696f0 0x7f6bcc0a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 --2- 172.21.15.115:0/3912575277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bcc0c0e80 0x7f6bcc0a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 >> 172.21.15.115:0/3912575277 conn(0x7f6bcc062320 msgr2=0x7f6bcc153460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:38.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 shutdown_connections 2023-07-27T14:27:38.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.376+0000 7f6bd0bff700 1 -- 172.21.15.115:0/3912575277 wait complete. 2023-07-27T14:27:38.410 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:26:59.286583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:27:00.228329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:27:38.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:27:38.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.587+0000 7fdd813ff700 1 Processor -- start 2023-07-27T14:27:38.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.587+0000 7fdd813ff700 1 -- start start 2023-07-27T14:27:38.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.588+0000 7fdd813ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd7c063260 0x7fdd7c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.588+0000 7fdd813ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 0x7fdd7c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.588+0000 7fdd813ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7c1553f0 con 0x7fdd7c14ae00 2023-07-27T14:27:38.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.588+0000 7fdd813ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7c157a50 con 0x7fdd7c063260 2023-07-27T14:27:38.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.588+0000 7fdd813ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c157d10 con 0x7fdd7c14b1e0 2023-07-27T14:27:38.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd7c063260 0x7fdd7c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd7c063260 0x7fdd7c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34850/0 (socket says 172.21.15.115:34850) 2023-07-27T14:27:38.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7a7fc700 1 -- 172.21.15.115:0/509501235 learned_addr learned my addr 172.21.15.115:0/509501235 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:38.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7b7fe700 1 --2- 172.21.15.115:0/509501235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 0x7fdd7c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7a7fc700 1 -- 172.21.15.115:0/509501235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 msgr2=0x7fdd7c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:38.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7a7fc700 1 --2- 172.21.15.115:0/509501235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 0x7fdd7c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7a7fc700 1 -- 172.21.15.115:0/509501235 >> v1:172.21.15.159:6789/0 conn(0x7fdd7c14ae00 legacy=0x7fdd7c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7a7fc700 1 -- 172.21.15.115:0/509501235 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c157ff0 con 0x7fdd7c063260 2023-07-27T14:27:38.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd7a7fc700 1 --2- 172.21.15.115:0/509501235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c063260 0x7fdd7c154f00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fdd70006fd0 tx=0x7fdd700090f0).ready entity=mon.0 client_cookie=ae73e3653adf2a54 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:38.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.589+0000 7fdd79ffb700 1 -- 172.21.15.115:0/509501235 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000b580 con 0x7fdd7c063260 2023-07-27T14:27:38.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd79ffb700 1 -- 172.21.15.115:0/509501235 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7000b6e0 con 0x7fdd7c063260 2023-07-27T14:27:38.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd79ffb700 1 -- 172.21.15.115:0/509501235 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000ba60 con 0x7fdd7c063260 2023-07-27T14:27:38.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd813ff700 1 -- 172.21.15.115:0/509501235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c063260 msgr2=0x7fdd7c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd813ff700 1 --2- 172.21.15.115:0/509501235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c063260 0x7fdd7c154f00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fdd70006fd0 tx=0x7fdd700090f0).stop 2023-07-27T14:27:38.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd813ff700 1 -- 172.21.15.115:0/509501235 shutdown_connections 2023-07-27T14:27:38.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd813ff700 1 --2- 172.21.15.115:0/509501235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 0x7fdd7c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd813ff700 1 --2- 172.21.15.115:0/509501235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c063260 0x7fdd7c154f00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd813ff700 1 -- 172.21.15.115:0/509501235 >> 172.21.15.115:0/509501235 conn(0x7fdd7c05e940 msgr2=0x7fdd7c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:38.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd813ff700 1 -- 172.21.15.115:0/509501235 shutdown_connections 2023-07-27T14:27:38.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.590+0000 7fdd813ff700 1 -- 172.21.15.115:0/509501235 wait complete. 2023-07-27T14:27:38.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.592+0000 7fdd813ff700 1 Processor -- start 2023-07-27T14:27:38.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.592+0000 7fdd813ff700 1 -- start start 2023-07-27T14:27:38.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd813ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd7c063260 0x7fdd7c149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd813ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c14ae00 0x7fdd7c164920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd813ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 0x7fdd7c0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd813ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c0ae4f0 con 0x7fdd7c14ae00 2023-07-27T14:27:38.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd813ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c0adc00 con 0x7fdd7c063260 2023-07-27T14:27:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd813ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c0b0a20 con 0x7fdd7c14b1e0 2023-07-27T14:27:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c14ae00 0x7fdd7c164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c14ae00 0x7fdd7c164920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34856/0 (socket says 172.21.15.115:34856) 2023-07-27T14:27:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 -- 172.21.15.115:0/2785952890 learned_addr learned my addr 172.21.15.115:0/2785952890 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 -- 172.21.15.115:0/2785952890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 msgr2=0x7fdd7c0c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 0x7fdd7c0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 -- 172.21.15.115:0/2785952890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd7c063260 msgr2=0x7fdd7c149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd7c063260 0x7fdd7c149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 -- 172.21.15.115:0/2785952890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd70009370 con 0x7fdd7c14ae00 2023-07-27T14:27:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.593+0000 7fdd7a7fc700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c14ae00 0x7fdd7c164920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdd70009130 tx=0x7fdd70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.594+0000 7fdd62ffd700 1 -- 172.21.15.115:0/2785952890 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000b850 con 0x7fdd7c14ae00 2023-07-27T14:27:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.594+0000 7fdd62ffd700 1 -- 172.21.15.115:0/2785952890 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7000b9b0 con 0x7fdd7c14ae00 2023-07-27T14:27:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.594+0000 7fdd62ffd700 1 -- 172.21.15.115:0/2785952890 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7001b660 con 0x7fdd7c14ae00 2023-07-27T14:27:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.594+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7c0adea0 con 0x7fdd7c14ae00 2023-07-27T14:27:38.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.594+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c0c31d0 con 0x7fdd7c14ae00 2023-07-27T14:27:38.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.595+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7c06c470 con 0x7fdd7c14ae00 2023-07-27T14:27:38.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.596+0000 7fdd62ffd700 1 -- 172.21.15.115:0/2785952890 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdd7002b070 con 0x7fdd7c14ae00 2023-07-27T14:27:38.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.596+0000 7fdd62ffd700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6805ed90 0x7fdd68061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.596+0000 7fdd62ffd700 1 -- 172.21.15.115:0/2785952890 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdd7007b3a0 con 0x7fdd7c14ae00 2023-07-27T14:27:38.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.597+0000 7fdd7affd700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6805ed90 0x7fdd68061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.597+0000 7fdd7affd700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6805ed90 0x7fdd68061250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdd6c001510 tx=0x7fdd6c0079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:38.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.600+0000 7fdd62ffd700 1 -- 172.21.15.115:0/2785952890 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd7004c940 con 0x7fdd7c14ae00 2023-07-27T14:27:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.770+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdd7c0c2f30 con 0x7fdd7c14ae00 2023-07-27T14:27:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.770+0000 7fdd62ffd700 1 -- 172.21.15.115:0/2785952890 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdd70029020 con 0x7fdd7c14ae00 2023-07-27T14:27:38.786 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:27:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6805ed90 msgr2=0x7fdd68061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6805ed90 0x7fdd68061250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdd6c001510 tx=0x7fdd6c0079c0).stop 2023-07-27T14:27:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c14ae00 msgr2=0x7fdd7c164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c14ae00 0x7fdd7c164920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdd70009130 tx=0x7fdd70017000).stop 2023-07-27T14:27:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 shutdown_connections 2023-07-27T14:27:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6805ed90 0x7fdd68061250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd7c14b1e0 0x7fdd7c0c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd7c063260 0x7fdd7c149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 --2- 172.21.15.115:0/2785952890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd7c14ae00 0x7fdd7c164920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.772+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 >> 172.21.15.115:0/2785952890 conn(0x7fdd7c05e940 msgr2=0x7fdd7c0c0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.773+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 shutdown_connections 2023-07-27T14:27:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.773+0000 7fdd813ff700 1 -- 172.21.15.115:0/2785952890 wait complete. 2023-07-27T14:27:38.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:27:38.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.978+0000 7f58be9ff700 1 Processor -- start 2023-07-27T14:27:38.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.978+0000 7f58be9ff700 1 -- start start 2023-07-27T14:27:38.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.980+0000 7f58be9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b814ae00 0x7f58b8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.980+0000 7f58be9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f58b814b1e0 0x7f58b8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:38.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.980+0000 7f58be9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b81553f0 con 0x7f58b80c5c50 2023-07-27T14:27:38.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.980+0000 7f58be9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b8157a50 con 0x7f58b814b1e0 2023-07-27T14:27:38.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.980+0000 7f58be9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8157d10 con 0x7f58b814ae00 2023-07-27T14:27:38.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.980+0000 7f58bcf9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f58b80c5c50 0x7f58b80a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34436/0 (socket says 172.21.15.115:34436) 2023-07-27T14:27:38.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.980+0000 7f58b77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f58b814b1e0 0x7f58b8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.980+0000 7f58bcf9c700 1 -- 172.21.15.115:0/138147237 learned_addr learned my addr 172.21.15.115:0/138147237 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b7fff700 1 --2- 172.21.15.115:0/138147237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b814ae00 0x7f58b8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b6ffd700 1 -- 172.21.15.115:0/138147237 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977580550 0 0) 0x7f58b81553f0 con 0x7f58b80c5c50 2023-07-27T14:27:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b6ffd700 1 -- 172.21.15.115:0/138147237 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a00033f0 con 0x7f58b80c5c50 2023-07-27T14:27:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b77fe700 1 -- 172.21.15.115:0/138147237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b814ae00 msgr2=0x7f58b8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b77fe700 1 --2- 172.21.15.115:0/138147237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b814ae00 0x7f58b8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b77fe700 1 -- 172.21.15.115:0/138147237 >> v1:172.21.15.115:6789/0 conn(0x7f58b80c5c50 legacy=0x7f58b80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b77fe700 1 -- 172.21.15.115:0/138147237 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8157ff0 con 0x7f58b814b1e0 2023-07-27T14:27:39.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b77fe700 1 --2- 172.21.15.115:0/138147237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b8062b50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f58ac009760 tx=0x7f58ac009060).ready entity=mon.0 client_cookie=3d0238f445ca560e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b6ffd700 1 -- 172.21.15.115:0/138147237 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac00d4a0 con 0x7f58b814b1e0 2023-07-27T14:27:39.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b6ffd700 1 -- 172.21.15.115:0/138147237 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac00d600 con 0x7f58b814b1e0 2023-07-27T14:27:39.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.981+0000 7f58b6ffd700 1 -- 172.21.15.115:0/138147237 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac00d980 con 0x7f58b814b1e0 2023-07-27T14:27:39.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.982+0000 7f58be9ff700 1 -- 172.21.15.115:0/138147237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 msgr2=0x7f58b8062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.982+0000 7f58be9ff700 1 --2- 172.21.15.115:0/138147237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b8062b50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f58ac009760 tx=0x7f58ac009060).stop 2023-07-27T14:27:39.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.982+0000 7f58be9ff700 1 -- 172.21.15.115:0/138147237 shutdown_connections 2023-07-27T14:27:39.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.982+0000 7f58be9ff700 1 --2- 172.21.15.115:0/138147237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b814ae00 0x7f58b8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.982+0000 7f58be9ff700 1 --2- 172.21.15.115:0/138147237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b8062b50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.982+0000 7f58be9ff700 1 -- 172.21.15.115:0/138147237 >> 172.21.15.115:0/138147237 conn(0x7f58b805e940 msgr2=0x7f58b80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:39.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.982+0000 7f58be9ff700 1 -- 172.21.15.115:0/138147237 shutdown_connections 2023-07-27T14:27:39.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.982+0000 7f58be9ff700 1 -- 172.21.15.115:0/138147237 wait complete. 2023-07-27T14:27:39.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.983+0000 7f58be9ff700 1 Processor -- start 2023-07-27T14:27:39.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.984+0000 7f58be9ff700 1 -- start start 2023-07-27T14:27:39.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.984+0000 7f58be9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b80c5c50 0x7f58b80af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58be9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b814ae00 0x7f58b8145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58be9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58be9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80aeb30 con 0x7f58b814b1e0 2023-07-27T14:27:39.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58be9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80af0f0 con 0x7f58b814ae00 2023-07-27T14:27:39.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58be9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80b0640 con 0x7f58b80c5c50 2023-07-27T14:27:39.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b80afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34866/0 (socket says 172.21.15.115:34866) 2023-07-27T14:27:39.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 -- 172.21.15.115:0/3188888320 learned_addr learned my addr 172.21.15.115:0/3188888320 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:39.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58b7fff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b80c5c50 0x7f58b80af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58b77fe700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b814ae00 0x7f58b8145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 -- 172.21.15.115:0/3188888320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b80c5c50 msgr2=0x7f58b80af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b80c5c50 0x7f58b80af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 -- 172.21.15.115:0/3188888320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b814ae00 msgr2=0x7f58b8145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b814ae00 0x7f58b8145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 -- 172.21.15.115:0/3188888320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0092a0 con 0x7f58b814b1e0 2023-07-27T14:27:39.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.985+0000 7f58bcf9c700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b80afc60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f58b0001460 tx=0x7f58b00015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.986+0000 7f589ffff700 1 -- 172.21.15.115:0/3188888320 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0005d30 con 0x7f58b814b1e0 2023-07-27T14:27:39.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.986+0000 7f589ffff700 1 -- 172.21.15.115:0/3188888320 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0005e90 con 0x7f58b814b1e0 2023-07-27T14:27:39.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.986+0000 7f589ffff700 1 -- 172.21.15.115:0/3188888320 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0007320 con 0x7f58b814b1e0 2023-07-27T14:27:39.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.986+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b80b0920 con 0x7f58b814b1e0 2023-07-27T14:27:39.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.986+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b8146280 con 0x7f58b814b1e0 2023-07-27T14:27:39.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.987+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b80af280 con 0x7f58b814b1e0 2023-07-27T14:27:39.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.987+0000 7f589ffff700 1 -- 172.21.15.115:0/3188888320 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f58b0010030 con 0x7f58b814b1e0 2023-07-27T14:27:39.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.989+0000 7f589ffff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f58a405ed90 0x7f58a4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.989+0000 7f589ffff700 1 -- 172.21.15.115:0/3188888320 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f58b0079ae0 con 0x7f58b814b1e0 2023-07-27T14:27:39.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.989+0000 7f58b7fff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f58a405ed90 0x7f58a4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.989+0000 7f58b7fff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f58a405ed90 0x7f58a4061250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f58a8009bc0 tx=0x7f58a8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:38.993+0000 7f589ffff700 1 -- 172.21.15.115:0/3188888320 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f58b004afc0 con 0x7f58b814b1e0 2023-07-27T14:27:39.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.159+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f58b806c470 con 0x7f58b814b1e0 2023-07-27T14:27:39.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.160+0000 7f589ffff700 1 -- 172.21.15.115:0/3188888320 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f58b004e5e0 con 0x7f58b814b1e0 2023-07-27T14:27:39.176 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:27:39.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f58a405ed90 msgr2=0x7f58a4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f58a405ed90 0x7f58a4061250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f58a8009bc0 tx=0x7f58a8008040).stop 2023-07-27T14:27:39.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 msgr2=0x7f58b80afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b80afc60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f58b0001460 tx=0x7f58b00015b0).stop 2023-07-27T14:27:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 shutdown_connections 2023-07-27T14:27:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f58a405ed90 0x7f58a4061250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b814b1e0 0x7f58b80afc60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58b80c5c50 0x7f58b80af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 --2- 172.21.15.115:0/3188888320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b814ae00 0x7f58b8145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 >> 172.21.15.115:0/3188888320 conn(0x7f58b805e940 msgr2=0x7f58b80c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 shutdown_connections 2023-07-27T14:27:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.162+0000 7f58be9ff700 1 -- 172.21.15.115:0/3188888320 wait complete. 2023-07-27T14:27:39.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:27:39.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.369+0000 7f345bbff700 1 Processor -- start 2023-07-27T14:27:39.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.369+0000 7f345bbff700 1 -- start start 2023-07-27T14:27:39.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.370+0000 7f345bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.370+0000 7f345bbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3454063260 0x7f34540a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.370+0000 7f345bbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34541553f0 con 0x7f345414b1e0 2023-07-27T14:27:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.370+0000 7f345bbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3454157a50 con 0x7f3454063260 2023-07-27T14:27:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.370+0000 7f345bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3454157d10 con 0x7f345414ae00 2023-07-27T14:27:39.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345919a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f345414b1e0 0x7f3454062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34452/0 (socket says 172.21.15.115:34452) 2023-07-27T14:27:39.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345a19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3454063260 0x7f34540a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345919a700 1 -- 172.21.15.115:0/1177272181 learned_addr learned my addr 172.21.15.115:0/1177272181 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:39.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345999b700 1 --2- 172.21.15.115:0/1177272181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345999b700 1 -- 172.21.15.115:0/1177272181 >> v2:172.21.15.115:3300/0 conn(0x7f3454063260 msgr2=0x7f34540a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:39.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345999b700 1 --2- 172.21.15.115:0/1177272181 >> v2:172.21.15.115:3300/0 conn(0x7f3454063260 0x7f34540a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345999b700 1 -- 172.21.15.115:0/1177272181 >> v1:172.21.15.115:6789/0 conn(0x7f345414b1e0 legacy=0x7f3454062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345999b700 1 -- 172.21.15.115:0/1177272181 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454157ff0 con 0x7f345414ae00 2023-07-27T14:27:39.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f3458999700 1 -- 172.21.15.115:0/1177272181 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094695320 0 0) 0x7f34541553f0 con 0x7f345414b1e0 2023-07-27T14:27:39.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345a19c700 1 --2- 172.21.15.115:0/1177272181 >> v2:172.21.15.115:3300/0 conn(0x7f3454063260 0x7f34540a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:39.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.371+0000 7f345999b700 1 --2- 172.21.15.115:0/1177272181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454154f00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3450009760 tx=0x7f3450009060).ready entity=mon.2 client_cookie=d0e64add3ae421a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f3458999700 1 -- 172.21.15.115:0/1177272181 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345000f510 con 0x7f345414ae00 2023-07-27T14:27:39.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f3458999700 1 -- 172.21.15.115:0/1177272181 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345000f670 con 0x7f345414ae00 2023-07-27T14:27:39.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f3458999700 1 -- 172.21.15.115:0/1177272181 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345000f9f0 con 0x7f345414ae00 2023-07-27T14:27:39.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f345bbff700 1 -- 172.21.15.115:0/1177272181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 msgr2=0x7f3454154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f345bbff700 1 --2- 172.21.15.115:0/1177272181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454154f00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3450009760 tx=0x7f3450009060).stop 2023-07-27T14:27:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f345bbff700 1 -- 172.21.15.115:0/1177272181 shutdown_connections 2023-07-27T14:27:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f345bbff700 1 --2- 172.21.15.115:0/1177272181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454154f00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f345bbff700 1 --2- 172.21.15.115:0/1177272181 >> v2:172.21.15.115:3300/0 conn(0x7f3454063260 0x7f34540a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f345bbff700 1 -- 172.21.15.115:0/1177272181 >> 172.21.15.115:0/1177272181 conn(0x7f345405e940 msgr2=0x7f34540cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f345bbff700 1 -- 172.21.15.115:0/1177272181 shutdown_connections 2023-07-27T14:27:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.372+0000 7f345bbff700 1 -- 172.21.15.115:0/1177272181 wait complete. 2023-07-27T14:27:39.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.374+0000 7f345bbff700 1 Processor -- start 2023-07-27T14:27:39.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.374+0000 7f345bbff700 1 -- start start 2023-07-27T14:27:39.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345bbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3454063260 0x7f34541571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345bbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f345414b1e0 0x7f34541490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345bbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34541495d0 con 0x7f3454063260 2023-07-27T14:27:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345bbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3454156d60 con 0x7f345414b1e0 2023-07-27T14:27:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3454156150 con 0x7f345414ae00 2023-07-27T14:27:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3454063260 0x7f34541571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3454063260 0x7f34541571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34886/0 (socket says 172.21.15.115:34886) 2023-07-27T14:27:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345999b700 1 -- 172.21.15.115:0/3893141509 learned_addr learned my addr 172.21.15.115:0/3893141509 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345919a700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345a19c700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f345414b1e0 0x7f34541490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345999b700 1 -- 172.21.15.115:0/3893141509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 msgr2=0x7f3454155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.375+0000 7f345999b700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f345999b700 1 -- 172.21.15.115:0/3893141509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f345414b1e0 msgr2=0x7f34541490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f345999b700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f345414b1e0 0x7f34541490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f345999b700 1 -- 172.21.15.115:0/3893141509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c009a20 con 0x7f3454063260 2023-07-27T14:27:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f345999b700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3454063260 0x7f34541571f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f345000f610 tx=0x7f3450017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f3449ffb700 1 -- 172.21.15.115:0/3893141509 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345000f7e0 con 0x7f3454063260 2023-07-27T14:27:39.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f3449ffb700 1 -- 172.21.15.115:0/3893141509 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345000f940 con 0x7f3454063260 2023-07-27T14:27:39.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34500092a0 con 0x7f3454063260 2023-07-27T14:27:39.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f3449ffb700 1 -- 172.21.15.115:0/3893141509 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345001b660 con 0x7f3454063260 2023-07-27T14:27:39.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.376+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3454156710 con 0x7f3454063260 2023-07-27T14:27:39.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.377+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345406a600 con 0x7f3454063260 2023-07-27T14:27:39.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.378+0000 7f3449ffb700 1 -- 172.21.15.115:0/3893141509 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f345002b070 con 0x7f3454063260 2023-07-27T14:27:39.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.379+0000 7f3449ffb700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f343805ed90 0x7f3438061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.379+0000 7f3449ffb700 1 -- 172.21.15.115:0/3893141509 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f345007b3e0 con 0x7f3454063260 2023-07-27T14:27:39.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.379+0000 7f345919a700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f343805ed90 0x7f3438061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.379+0000 7f345919a700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f343805ed90 0x7f3438061250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f34540c4220 tx=0x7f3444009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.383+0000 7f3449ffb700 1 -- 172.21.15.115:0/3893141509 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f345004c870 con 0x7f3454063260 2023-07-27T14:27:39.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.552+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3454157040 con 0x7f3454063260 2023-07-27T14:27:39.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.552+0000 7f3449ffb700 1 -- 172.21.15.115:0/3893141509 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f345001f020 con 0x7f3454063260 2023-07-27T14:27:39.569 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:39.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f343805ed90 msgr2=0x7f3438061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f343805ed90 0x7f3438061250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f34540c4220 tx=0x7f3444009040).stop 2023-07-27T14:27:39.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3454063260 msgr2=0x7f34541571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3454063260 0x7f34541571f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f345000f610 tx=0x7f3450017000).stop 2023-07-27T14:27:39.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 shutdown_connections 2023-07-27T14:27:39.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f343805ed90 0x7f3438061250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f345414b1e0 0x7f34541490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3454063260 0x7f34541571f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 --2- 172.21.15.115:0/3893141509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f345414ae00 0x7f3454155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 >> 172.21.15.115:0/3893141509 conn(0x7f345405e940 msgr2=0x7f34540ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:39.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.554+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 shutdown_connections 2023-07-27T14:27:39.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.555+0000 7f345bbff700 1 -- 172.21.15.115:0/3893141509 wait complete. 2023-07-27T14:27:39.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:27:39.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.763+0000 7fb2b63ff700 1 Processor -- start 2023-07-27T14:27:39.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.763+0000 7fb2b63ff700 1 -- start start 2023-07-27T14:27:39.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2b63ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2b0063260 0x7fb2b0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2b63ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb2b014b1e0 0x7fb2b00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2b63ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b01553f0 con 0x7fb2b014ae00 2023-07-27T14:27:39.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2b63ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b0157a50 con 0x7fb2b0063260 2023-07-27T14:27:39.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2b63ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b0157d10 con 0x7fb2b014b1e0 2023-07-27T14:27:39.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2af7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2b0063260 0x7fb2b0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2affff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb2b014ae00 0x7fb2b0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34454/0 (socket says 172.21.15.115:34454) 2023-07-27T14:27:39.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2affff700 1 -- 172.21.15.115:0/93048767 learned_addr learned my addr 172.21.15.115:0/93048767 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:39.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2b499c700 1 --2- 172.21.15.115:0/93048767 >> v2:172.21.15.159:3300/0 conn(0x7fb2b014b1e0 0x7fb2b00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2af7fe700 1 -- 172.21.15.115:0/93048767 >> v2:172.21.15.159:3300/0 conn(0x7fb2b014b1e0 msgr2=0x7fb2b00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:39.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2af7fe700 1 --2- 172.21.15.115:0/93048767 >> v2:172.21.15.159:3300/0 conn(0x7fb2b014b1e0 0x7fb2b00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2af7fe700 1 -- 172.21.15.115:0/93048767 >> v1:172.21.15.115:6789/0 conn(0x7fb2b014ae00 legacy=0x7fb2b0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.765+0000 7fb2af7fe700 1 -- 172.21.15.115:0/93048767 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b0157ff0 con 0x7fb2b0063260 2023-07-27T14:27:39.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2af7fe700 1 --2- 172.21.15.115:0/93048767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b0063260 0x7fb2b0154f00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fb2b0083430 tx=0x7fb2a4009060).ready entity=mon.0 client_cookie=52ced730c7e9a2b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2aeffd700 1 -- 172.21.15.115:0/93048767 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400b580 con 0x7fb2b0063260 2023-07-27T14:27:39.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2aeffd700 1 -- 172.21.15.115:0/93048767 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a400b6e0 con 0x7fb2b0063260 2023-07-27T14:27:39.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2aeffd700 1 -- 172.21.15.115:0/93048767 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400ba60 con 0x7fb2b0063260 2023-07-27T14:27:39.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2b63ff700 1 -- 172.21.15.115:0/93048767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b0063260 msgr2=0x7fb2b0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/93048767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b0063260 0x7fb2b0154f00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fb2b0083430 tx=0x7fb2a4009060).stop 2023-07-27T14:27:39.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2b63ff700 1 -- 172.21.15.115:0/93048767 shutdown_connections 2023-07-27T14:27:39.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/93048767 >> v2:172.21.15.159:3300/0 conn(0x7fb2b014b1e0 0x7fb2b00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/93048767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b0063260 0x7fb2b0154f00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.766+0000 7fb2b63ff700 1 -- 172.21.15.115:0/93048767 >> 172.21.15.115:0/93048767 conn(0x7fb2b005e940 msgr2=0x7fb2b00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:39.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.767+0000 7fb2b63ff700 1 -- 172.21.15.115:0/93048767 shutdown_connections 2023-07-27T14:27:39.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.767+0000 7fb2b63ff700 1 -- 172.21.15.115:0/93048767 wait complete. 2023-07-27T14:27:39.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.768+0000 7fb2b63ff700 1 Processor -- start 2023-07-27T14:27:39.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.768+0000 7fb2b63ff700 1 -- start start 2023-07-27T14:27:39.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2b63ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2b0063260 0x7fb2b0152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2b63ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b014ae00 0x7fb2b00afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2b63ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2b014b1e0 0x7fb2b0149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2b63ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00b07c0 con 0x7fb2b014ae00 2023-07-27T14:27:39.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2b63ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00c1c50 con 0x7fb2b0063260 2023-07-27T14:27:39.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2b63ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00c24f0 con 0x7fb2b014b1e0 2023-07-27T14:27:39.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b014ae00 0x7fb2b00afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b014ae00 0x7fb2b00afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34898/0 (socket says 172.21.15.115:34898) 2023-07-27T14:27:39.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.769+0000 7fb2af7fe700 1 -- 172.21.15.115:0/2175040927 learned_addr learned my addr 172.21.15.115:0/2175040927 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:39.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2affff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2b0063260 0x7fb2b0152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2b499c700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2b014b1e0 0x7fb2b0149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2af7fe700 1 -- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2b014b1e0 msgr2=0x7fb2b0149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2af7fe700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2b014b1e0 0x7fb2b0149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2af7fe700 1 -- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2b0063260 msgr2=0x7fb2b0152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2af7fe700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2b0063260 0x7fb2b0152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2af7fe700 1 -- 172.21.15.115:0/2175040927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40092a0 con 0x7fb2b014ae00 2023-07-27T14:27:39.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2affff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2b0063260 0x7fb2b0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:39.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2af7fe700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b014ae00 0x7fb2b00afe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb2a4011000 tx=0x7fb2a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb297fff700 1 -- 172.21.15.115:0/2175040927 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400b850 con 0x7fb2b014ae00 2023-07-27T14:27:39.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb297fff700 1 -- 172.21.15.115:0/2175040927 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a400b9b0 con 0x7fb2b014ae00 2023-07-27T14:27:39.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b0153330 con 0x7fb2b014ae00 2023-07-27T14:27:39.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb297fff700 1 -- 172.21.15.115:0/2175040927 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a401b660 con 0x7fb2b014ae00 2023-07-27T14:27:39.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.770+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b00c2180 con 0x7fb2b014ae00 2023-07-27T14:27:39.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.771+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b006c470 con 0x7fb2b014ae00 2023-07-27T14:27:39.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.772+0000 7fb297fff700 1 -- 172.21.15.115:0/2175040927 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb2a402b070 con 0x7fb2b014ae00 2023-07-27T14:27:39.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.773+0000 7fb297fff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29c05ed90 0x7fb29c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:39.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.773+0000 7fb297fff700 1 -- 172.21.15.115:0/2175040927 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb2a407b550 con 0x7fb2b014ae00 2023-07-27T14:27:39.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.773+0000 7fb2affff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29c05ed90 0x7fb29c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:39.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.774+0000 7fb2affff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29c05ed90 0x7fb29c061250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb2a0001740 tx=0x7fb2a0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:39.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.777+0000 7fb297fff700 1 -- 172.21.15.115:0/2175040927 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2a404c9e0 con 0x7fb2b014ae00 2023-07-27T14:27:39.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.945+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2b00c2630 con 0x7fb2b014ae00 2023-07-27T14:27:39.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.946+0000 7fb297fff700 1 -- 172.21.15.115:0/2175040927 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2a401f0a0 con 0x7fb2b014ae00 2023-07-27T14:27:39.962 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:39.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29c05ed90 msgr2=0x7fb29c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29c05ed90 0x7fb29c061250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb2a0001740 tx=0x7fb2a0009040).stop 2023-07-27T14:27:39.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b014ae00 msgr2=0x7fb2b00afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:39.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b014ae00 0x7fb2b00afe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb2a4011000 tx=0x7fb2a4017000).stop 2023-07-27T14:27:39.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 shutdown_connections 2023-07-27T14:27:39.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29c05ed90 0x7fb29c061250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2b014b1e0 0x7fb2b0149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2b0063260 0x7fb2b0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 --2- 172.21.15.115:0/2175040927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2b014ae00 0x7fb2b00afe60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:39.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 >> 172.21.15.115:0/2175040927 conn(0x7fb2b005e940 msgr2=0x7fb2b01544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:39.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 shutdown_connections 2023-07-27T14:27:39.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:39.948+0000 7fb2b63ff700 1 -- 172.21.15.115:0/2175040927 wait complete. 2023-07-27T14:27:40.048 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:27:40.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2023-07-27T14:27:40.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.221+0000 7fe5325ff700 1 Processor -- start 2023-07-27T14:27:40.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.221+0000 7fe5325ff700 1 -- start start 2023-07-27T14:27:40.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe5325ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe52c0aaa40 0x7fe52c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe5325ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe52c1542a0 0x7fe52c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe5325ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c0aa4d0 con 0x7fe52c153ec0 2023-07-27T14:27:40.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe5325ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c064ad0 con 0x7fe52c0aaa40 2023-07-27T14:27:40.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe5325ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0c05c0 con 0x7fe52c1542a0 2023-07-27T14:27:40.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe52b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe52c0aaa40 0x7fe52c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe52bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe52c153ec0 0x7fe52c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34466/0 (socket says 172.21.15.115:34466) 2023-07-27T14:27:40.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe52bfff700 1 -- 172.21.15.115:0/3172374475 learned_addr learned my addr 172.21.15.115:0/3172374475 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:40.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe530b9c700 1 --2- 172.21.15.115:0/3172374475 >> v2:172.21.15.159:3300/0 conn(0x7fe52c1542a0 0x7fe52c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe52b7fe700 1 -- 172.21.15.115:0/3172374475 >> v2:172.21.15.159:3300/0 conn(0x7fe52c1542a0 msgr2=0x7fe52c0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:40.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe52b7fe700 1 --2- 172.21.15.115:0/3172374475 >> v2:172.21.15.159:3300/0 conn(0x7fe52c1542a0 0x7fe52c0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe52b7fe700 1 -- 172.21.15.115:0/3172374475 >> v1:172.21.15.115:6789/0 conn(0x7fe52c153ec0 legacy=0x7fe52c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe52b7fe700 1 -- 172.21.15.115:0/3172374475 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c0c1a60 con 0x7fe52c0aaa40 2023-07-27T14:27:40.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.223+0000 7fe52affd700 1 -- 172.21.15.115:0/3172374475 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038255395 0 0) 0x7fe51c001110 con 0x7fe52c153ec0 2023-07-27T14:27:40.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe52b7fe700 1 --2- 172.21.15.115:0/3172374475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c0aaa40 0x7fe52c0640f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe52c0c5470 tx=0x7fe520009060).ready entity=mon.0 client_cookie=77841d86274e1f38 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:40.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe52affd700 1 -- 172.21.15.115:0/3172374475 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52000f510 con 0x7fe52c0aaa40 2023-07-27T14:27:40.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe52affd700 1 -- 172.21.15.115:0/3172374475 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52000f670 con 0x7fe52c0aaa40 2023-07-27T14:27:40.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe52affd700 1 -- 172.21.15.115:0/3172374475 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52000f9f0 con 0x7fe52c0aaa40 2023-07-27T14:27:40.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe5325ff700 1 -- 172.21.15.115:0/3172374475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c0aaa40 msgr2=0x7fe52c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3172374475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c0aaa40 0x7fe52c0640f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe52c0c5470 tx=0x7fe520009060).stop 2023-07-27T14:27:40.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe5325ff700 1 -- 172.21.15.115:0/3172374475 shutdown_connections 2023-07-27T14:27:40.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3172374475 >> v2:172.21.15.159:3300/0 conn(0x7fe52c1542a0 0x7fe52c0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3172374475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c0aaa40 0x7fe52c0640f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe5325ff700 1 -- 172.21.15.115:0/3172374475 >> 172.21.15.115:0/3172374475 conn(0x7fe52c0cb610 msgr2=0x7fe52c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:40.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.224+0000 7fe5325ff700 1 -- 172.21.15.115:0/3172374475 shutdown_connections 2023-07-27T14:27:40.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.225+0000 7fe5325ff700 1 -- 172.21.15.115:0/3172374475 wait complete. 2023-07-27T14:27:40.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.226+0000 7fe5325ff700 1 Processor -- start 2023-07-27T14:27:40.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.226+0000 7fe5325ff700 1 -- start start 2023-07-27T14:27:40.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe5325ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe52c0aaa40 0x7fe52c168340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe5325ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe52c153ec0 0x7fe52c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe5325ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c1542a0 0x7fe52c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe5325ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c168830 con 0x7fe52c1542a0 2023-07-27T14:27:40.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe5325ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c157f10 con 0x7fe52c153ec0 2023-07-27T14:27:40.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe5325ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c1581f0 con 0x7fe52c0aaa40 2023-07-27T14:27:40.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe530b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c1542a0 0x7fe52c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe530b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c1542a0 0x7fe52c13f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34904/0 (socket says 172.21.15.115:34904) 2023-07-27T14:27:40.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe530b9c700 1 -- 172.21.15.115:0/3853581542 learned_addr learned my addr 172.21.15.115:0/3853581542 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:40.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe52b7fe700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe52c153ec0 0x7fe52c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.227+0000 7fe52bfff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe52c0aaa40 0x7fe52c168340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe530b9c700 1 -- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe52c0aaa40 msgr2=0x7fe52c168340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe530b9c700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe52c0aaa40 0x7fe52c168340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe530b9c700 1 -- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe52c153ec0 msgr2=0x7fe52c156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe530b9c700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe52c153ec0 0x7fe52c156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe530b9c700 1 -- 172.21.15.115:0/3853581542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200092a0 con 0x7fe52c1542a0 2023-07-27T14:27:40.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe52bfff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe52c0aaa40 0x7fe52c168340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:40.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe530b9c700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c1542a0 0x7fe52c13f3f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe524009d70 tx=0x7fe52400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:40.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe513fff700 1 -- 172.21.15.115:0/3853581542 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52400cb50 con 0x7fe52c1542a0 2023-07-27T14:27:40.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe513fff700 1 -- 172.21.15.115:0/3853581542 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52400f040 con 0x7fe52c1542a0 2023-07-27T14:27:40.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c1584d0 con 0x7fe52c1542a0 2023-07-27T14:27:40.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe513fff700 1 -- 172.21.15.115:0/3853581542 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524013400 con 0x7fe52c1542a0 2023-07-27T14:27:40.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.228+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c158a90 con 0x7fe52c1542a0 2023-07-27T14:27:40.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.229+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c06c470 con 0x7fe52c1542a0 2023-07-27T14:27:40.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.230+0000 7fe513fff700 1 -- 172.21.15.115:0/3853581542 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe5240137b0 con 0x7fe52c1542a0 2023-07-27T14:27:40.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.231+0000 7fe513fff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe51805ed90 0x7fe518061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.231+0000 7fe513fff700 1 -- 172.21.15.115:0/3853581542 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe52407a540 con 0x7fe52c1542a0 2023-07-27T14:27:40.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.231+0000 7fe52bfff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe51805ed90 0x7fe518061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.231+0000 7fe52bfff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe51805ed90 0x7fe518061250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe51c001720 tx=0x7fe51c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:40.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.235+0000 7fe513fff700 1 -- 172.21.15.115:0/3853581542 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe52404b9d0 con 0x7fe52c1542a0 2023-07-27T14:27:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.466+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) v1 -- 0x7fe52c062540 con 0x7fe52c1542a0 2023-07-27T14:27:40.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.652+0000 7fe513fff700 1 -- 172.21.15.115:0/3853581542 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v54) v1 ==== 168+0+0 (secure 0 0 0) 0x7fe52404eff0 con 0x7fe52c1542a0 2023-07-27T14:27:40.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe51805ed90 msgr2=0x7fe518061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe51805ed90 0x7fe518061250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe51c001720 tx=0x7fe51c009040).stop 2023-07-27T14:27:40.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c1542a0 msgr2=0x7fe52c13f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c1542a0 0x7fe52c13f3f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe524009d70 tx=0x7fe52400b040).stop 2023-07-27T14:27:40.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 shutdown_connections 2023-07-27T14:27:40.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe51805ed90 0x7fe518061250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe52c1542a0 0x7fe52c13f3f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe52c0aaa40 0x7fe52c168340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 --2- 172.21.15.115:0/3853581542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe52c153ec0 0x7fe52c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 >> 172.21.15.115:0/3853581542 conn(0x7fe52c0cb610 msgr2=0x7fe52c0ab510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:40.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 shutdown_connections 2023-07-27T14:27:40.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.654+0000 7fe5325ff700 1 -- 172.21.15.115:0/3853581542 wait complete. 2023-07-27T14:27:40.688 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:27:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.866+0000 7f72ef5ff700 1 Processor -- start 2023-07-27T14:27:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.866+0000 7f72ef5ff700 1 -- start start 2023-07-27T14:27:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.867+0000 7f72ef5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e814ae00 0x7f72e8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.867+0000 7f72ef5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f72e8063260 0x7f72e80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.867+0000 7f72ef5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e81553f0 con 0x7f72e814b1e0 2023-07-27T14:27:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.867+0000 7f72ef5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e8157a50 con 0x7f72e8063260 2023-07-27T14:27:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.867+0000 7f72ef5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8157d10 con 0x7f72e814ae00 2023-07-27T14:27:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72ed39b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e814ae00 0x7f72e8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72edb9c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f72e8063260 0x7f72e80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72ed39b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e814ae00 0x7f72e8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:44248/0 (socket says 172.21.15.115:44248) 2023-07-27T14:27:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72ed39b700 1 -- 172.21.15.115:0/1834404105 learned_addr learned my addr 172.21.15.115:0/1834404105 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72edb9c700 1 -- 172.21.15.115:0/1834404105 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e814ae00 msgr2=0x7f72e8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72edb9c700 1 --2- 172.21.15.115:0/1834404105 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e814ae00 0x7f72e8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72edb9c700 1 -- 172.21.15.115:0/1834404105 >> v1:172.21.15.159:6789/0 conn(0x7f72e814b1e0 legacy=0x7f72e8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72edb9c700 1 -- 172.21.15.115:0/1834404105 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8157ff0 con 0x7f72e8063260 2023-07-27T14:27:40.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72ed39b700 1 --2- 172.21.15.115:0/1834404105 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e814ae00 0x7f72e8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:40.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.868+0000 7f72edb9c700 1 --2- 172.21.15.115:0/1834404105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e8063260 0x7f72e80a98c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f72e0009e60 tx=0x7f72e0009780).ready entity=mon.1 client_cookie=233196db0c8853b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:40.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72dffff700 1 -- 172.21.15.115:0/1834404105 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000e070 con 0x7f72e8063260 2023-07-27T14:27:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72dffff700 1 -- 172.21.15.115:0/1834404105 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e000bb60 con 0x7f72e8063260 2023-07-27T14:27:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72dffff700 1 -- 172.21.15.115:0/1834404105 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0012410 con 0x7f72e8063260 2023-07-27T14:27:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72ef5ff700 1 -- 172.21.15.115:0/1834404105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e8063260 msgr2=0x7f72e80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/1834404105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e8063260 0x7f72e80a98c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f72e0009e60 tx=0x7f72e0009780).stop 2023-07-27T14:27:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72ef5ff700 1 -- 172.21.15.115:0/1834404105 shutdown_connections 2023-07-27T14:27:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/1834404105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e8063260 0x7f72e80a98c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/1834404105 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e814ae00 0x7f72e8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72ef5ff700 1 -- 172.21.15.115:0/1834404105 >> 172.21.15.115:0/1834404105 conn(0x7f72e805e940 msgr2=0x7f72e80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72ef5ff700 1 -- 172.21.15.115:0/1834404105 shutdown_connections 2023-07-27T14:27:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.869+0000 7f72ef5ff700 1 -- 172.21.15.115:0/1834404105 wait complete. 2023-07-27T14:27:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.871+0000 7f72ef5ff700 1 Processor -- start 2023-07-27T14:27:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.871+0000 7f72ef5ff700 1 -- start start 2023-07-27T14:27:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72ef5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e8063260 0x7f72e8164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72ef5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e814ae00 0x7f72e8149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72ef5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e814b1e0 0x7f72e81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72ef5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8159210 con 0x7f72e814b1e0 2023-07-27T14:27:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72ef5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8164e60 con 0x7f72e814ae00 2023-07-27T14:27:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72ef5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80c2280 con 0x7f72e8063260 2023-07-27T14:27:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72edb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e814b1e0 0x7f72e81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72edb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e814b1e0 0x7f72e81555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34910/0 (socket says 172.21.15.115:34910) 2023-07-27T14:27:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72edb9c700 1 -- 172.21.15.115:0/463732038 learned_addr learned my addr 172.21.15.115:0/463732038 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72ecb9a700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e814ae00 0x7f72e8149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.872+0000 7f72ed39b700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e8063260 0x7f72e8164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72edb9c700 1 -- 172.21.15.115:0/463732038 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e8063260 msgr2=0x7f72e8164970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72edb9c700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e8063260 0x7f72e8164970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72edb9c700 1 -- 172.21.15.115:0/463732038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e814ae00 msgr2=0x7f72e8149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:40.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72edb9c700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e814ae00 0x7f72e8149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:40.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72edb9c700 1 -- 172.21.15.115:0/463732038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4009370 con 0x7f72e814b1e0 2023-07-27T14:27:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72edb9c700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e814b1e0 0x7f72e81555b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f72e000b6c0 tx=0x7f72e0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72dd7fa700 1 -- 172.21.15.115:0/463732038 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0012410 con 0x7f72e814b1e0 2023-07-27T14:27:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72dd7fa700 1 -- 172.21.15.115:0/463732038 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e001d630 con 0x7f72e814b1e0 2023-07-27T14:27:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72dd7fa700 1 -- 172.21.15.115:0/463732038 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e001d9f0 con 0x7f72e814b1e0 2023-07-27T14:27:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e0009a20 con 0x7f72e814b1e0 2023-07-27T14:27:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.873+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e8158bc0 con 0x7f72e814b1e0 2023-07-27T14:27:40.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.874+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e8159380 con 0x7f72e814b1e0 2023-07-27T14:27:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.875+0000 7f72dd7fa700 1 -- 172.21.15.115:0/463732038 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f72e001dd60 con 0x7f72e814b1e0 2023-07-27T14:27:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.876+0000 7f72dd7fa700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72cc05ed90 0x7f72cc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.876+0000 7f72dd7fa700 1 -- 172.21.15.115:0/463732038 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f72e007bcf0 con 0x7f72e814b1e0 2023-07-27T14:27:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.876+0000 7f72ed39b700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72cc05ed90 0x7f72cc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:40.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.877+0000 7f72ed39b700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72cc05ed90 0x7f72cc061250 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f72e4006fd0 tx=0x7f72e40090f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:40.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:40.880+0000 7f72dd7fa700 1 -- 172.21.15.115:0/463732038 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72e004d290 con 0x7f72e814b1e0 2023-07-27T14:27:41.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.050+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f72e806c470 con 0x7f72e814b1e0 2023-07-27T14:27:41.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.056+0000 7f72dd7fa700 1 -- 172.21.15.115:0/463732038 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72e00508b0 con 0x7f72e814b1e0 2023-07-27T14:27:41.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72cc05ed90 msgr2=0x7f72cc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72cc05ed90 0x7f72cc061250 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f72e4006fd0 tx=0x7f72e40090f0).stop 2023-07-27T14:27:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e814b1e0 msgr2=0x7f72e81555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e814b1e0 0x7f72e81555b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f72e000b6c0 tx=0x7f72e0009780).stop 2023-07-27T14:27:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 shutdown_connections 2023-07-27T14:27:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72cc05ed90 0x7f72cc061250 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e814b1e0 0x7f72e81555b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e8063260 0x7f72e8164970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:41.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 --2- 172.21.15.115:0/463732038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e814ae00 0x7f72e8149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:41.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 >> 172.21.15.115:0/463732038 conn(0x7f72e805e940 msgr2=0x7f72e8152030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:41.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 shutdown_connections 2023-07-27T14:27:41.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:41.058+0000 7f72ef5ff700 1 -- 172.21.15.115:0/463732038 wait complete. 2023-07-27T14:27:41.091 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:27:41.091 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:27:41.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:27:41.313 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:27:41.313 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:27:41.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:27:41.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-27T14:27:41.399 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:27:41.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:41.400 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:27:41.457 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:27:41.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:27:41.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-27T14:27:41.545 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:27:41.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:41.545 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:27:41.663 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-27T14:27:41.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:27:41.664 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-27T14:27:41.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:27:41.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:41.756 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-27T14:27:41.803 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-27T14:27:41.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:27:41.804 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-27T14:27:41.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:27:41.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:27:41.891 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-27T14:27:41.938 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:27:41.938 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:27:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.110+0000 7fdfc53ff700 1 Processor -- start 2023-07-27T14:27:42.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.110+0000 7fdfc53ff700 1 -- start start 2023-07-27T14:27:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.111+0000 7fdfc53ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdfc0151bd0 0x7fdfc0062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.111+0000 7fdfc53ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0062810 0x7fdfc00a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfc53ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00639d0 con 0x7fdfc00a4d30 2023-07-27T14:27:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfc53ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc0137610 con 0x7fdfc0151bd0 2023-07-27T14:27:42.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfc53ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00a51c0 con 0x7fdfc0062810 2023-07-27T14:27:42.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbeffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdfc0151bd0 0x7fdfc0062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbeffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdfc0151bd0 0x7fdfc0062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34914/0 (socket says 172.21.15.115:34914) 2023-07-27T14:27:42.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbeffd700 1 -- 172.21.15.115:0/3664710609 learned_addr learned my addr 172.21.15.115:0/3664710609 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:42.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbe7fc700 1 --2- 172.21.15.115:0/3664710609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0062810 0x7fdfc00a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbeffd700 1 -- 172.21.15.115:0/3664710609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0062810 msgr2=0x7fdfc00a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:42.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbeffd700 1 --2- 172.21.15.115:0/3664710609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0062810 0x7fdfc00a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbeffd700 1 -- 172.21.15.115:0/3664710609 >> v1:172.21.15.159:6789/0 conn(0x7fdfc00a4d30 legacy=0x7fdfc0157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbeffd700 1 -- 172.21.15.115:0/3664710609 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0062dc0 con 0x7fdfc0151bd0 2023-07-27T14:27:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.112+0000 7fdfbeffd700 1 --2- 172.21.15.115:0/3664710609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0151bd0 0x7fdfc0062320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fdfb0006fd0 tx=0x7fdfb00090f0).ready entity=mon.0 client_cookie=9a07f3ae1801257c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfbdffb700 1 -- 172.21.15.115:0/3664710609 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000b580 con 0x7fdfc0151bd0 2023-07-27T14:27:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfbdffb700 1 -- 172.21.15.115:0/3664710609 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000b6e0 con 0x7fdfc0151bd0 2023-07-27T14:27:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfbdffb700 1 -- 172.21.15.115:0/3664710609 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000ba60 con 0x7fdfc0151bd0 2023-07-27T14:27:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfc53ff700 1 -- 172.21.15.115:0/3664710609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0151bd0 msgr2=0x7fdfc0062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/3664710609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0151bd0 0x7fdfc0062320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fdfb0006fd0 tx=0x7fdfb00090f0).stop 2023-07-27T14:27:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfc53ff700 1 -- 172.21.15.115:0/3664710609 shutdown_connections 2023-07-27T14:27:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/3664710609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0151bd0 0x7fdfc0062320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/3664710609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0062810 0x7fdfc00a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfc53ff700 1 -- 172.21.15.115:0/3664710609 >> 172.21.15.115:0/3664710609 conn(0x7fdfc0064700 msgr2=0x7fdfc0064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfc53ff700 1 -- 172.21.15.115:0/3664710609 shutdown_connections 2023-07-27T14:27:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.113+0000 7fdfc53ff700 1 -- 172.21.15.115:0/3664710609 wait complete. 2023-07-27T14:27:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.115+0000 7fdfc53ff700 1 Processor -- start 2023-07-27T14:27:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.115+0000 7fdfc53ff700 1 -- start start 2023-07-27T14:27:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfc53ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0062810 0x7fdfc0154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfc53ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc00a4d30 0x7fdfc0153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfc53ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151bd0 0x7fdfc01353e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfc53ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00ab270 con 0x7fdfc0062810 2023-07-27T14:27:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfc53ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0154440 con 0x7fdfc00a4d30 2023-07-27T14:27:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfc53ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00ab450 con 0x7fdfc0151bd0 2023-07-27T14:27:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfbeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0062810 0x7fdfc0154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfbeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0062810 0x7fdfc0154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34924/0 (socket says 172.21.15.115:34924) 2023-07-27T14:27:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfbeffd700 1 -- 172.21.15.115:0/854134938 learned_addr learned my addr 172.21.15.115:0/854134938 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfbe7fc700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc00a4d30 0x7fdfc0153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.116+0000 7fdfbf7fe700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151bd0 0x7fdfc01353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfbeffd700 1 -- 172.21.15.115:0/854134938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151bd0 msgr2=0x7fdfc01353e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfbeffd700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151bd0 0x7fdfc01353e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfbeffd700 1 -- 172.21.15.115:0/854134938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc00a4d30 msgr2=0x7fdfc0153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfbeffd700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc00a4d30 0x7fdfc0153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfbeffd700 1 -- 172.21.15.115:0/854134938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009370 con 0x7fdfc0062810 2023-07-27T14:27:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfbeffd700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0062810 0x7fdfc0154b40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fdfb0009130 tx=0x7fdfb0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfa6ffd700 1 -- 172.21.15.115:0/854134938 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000b850 con 0x7fdfc0062810 2023-07-27T14:27:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfa6ffd700 1 -- 172.21.15.115:0/854134938 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000b9d0 con 0x7fdfc0062810 2023-07-27T14:27:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc00ab730 con 0x7fdfc0062810 2023-07-27T14:27:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfa6ffd700 1 -- 172.21.15.115:0/854134938 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb001c670 con 0x7fdfc0062810 2023-07-27T14:27:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.117+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc00abcf0 con 0x7fdfc0062810 2023-07-27T14:27:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.118+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc00ac060 con 0x7fdfc0062810 2023-07-27T14:27:42.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.119+0000 7fdfa6ffd700 1 -- 172.21.15.115:0/854134938 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdfb002c070 con 0x7fdfc0062810 2023-07-27T14:27:42.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.120+0000 7fdfa6ffd700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfac05ed90 0x7fdfac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.120+0000 7fdfa6ffd700 1 -- 172.21.15.115:0/854134938 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdfb007b690 con 0x7fdfc0062810 2023-07-27T14:27:42.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.120+0000 7fdfbe7fc700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfac05ed90 0x7fdfac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.120+0000 7fdfbe7fc700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfac05ed90 0x7fdfac061250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fdfc006aa20 tx=0x7fdfb4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.124+0000 7fdfa6ffd700 1 -- 172.21.15.115:0/854134938 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdfb004cb20 con 0x7fdfc0062810 2023-07-27T14:27:42.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.332+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfc006c470 con 0x7fdfc0062810 2023-07-27T14:27:42.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.332+0000 7fdfa6ffd700 1 -- 172.21.15.115:0/854134938 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4492 (secure 0 0 0) 0x7fdfb002a020 con 0x7fdfc0062810 2023-07-27T14:27:42.349 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:42.349 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:27:01.252698+0000","modified":"2023-07-27T14:27:04.264437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-07-27T14:27:42.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.334+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfac05ed90 msgr2=0x7fdfac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.334+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfac05ed90 0x7fdfac061250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fdfc006aa20 tx=0x7fdfb4009060).stop 2023-07-27T14:27:42.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.334+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0062810 msgr2=0x7fdfc0154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.334+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0062810 0x7fdfc0154b40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fdfb0009130 tx=0x7fdfb0017000).stop 2023-07-27T14:27:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.335+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 shutdown_connections 2023-07-27T14:27:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.335+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfac05ed90 0x7fdfac061250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.335+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151bd0 0x7fdfc01353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.335+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0062810 0x7fdfc0154b40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.335+0000 7fdfc53ff700 1 --2- 172.21.15.115:0/854134938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc00a4d30 0x7fdfc0153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.335+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 >> 172.21.15.115:0/854134938 conn(0x7fdfc0064700 msgr2=0x7fdfc00c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.335+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 shutdown_connections 2023-07-27T14:27:42.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.335+0000 7fdfc53ff700 1 -- 172.21.15.115:0/854134938 wait complete. 2023-07-27T14:27:42.353 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 7 2023-07-27T14:27:42.369 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:42.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.539+0000 7ffa04bff700 1 Processor -- start 2023-07-27T14:27:42.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.539+0000 7ffa04bff700 1 -- start start 2023-07-27T14:27:42.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ffa04bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffa00153ec0 0x7ffa000a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ffa04bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa000aa4d0 con 0x7ffa000aa050 2023-07-27T14:27:42.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ffa04bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa000c05c0 con 0x7ffa000aaa40 2023-07-27T14:27:42.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ffa04bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa000bfc90 con 0x7ffa00153ec0 2023-07-27T14:27:42.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ff9fdd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ffa000aa050 0x7ffa000640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34470/0 (socket says 172.21.15.115:34470) 2023-07-27T14:27:42.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ff9fdd9b700 1 -- 172.21.15.115:0/2924472703 learned_addr learned my addr 172.21.15.115:0/2924472703 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:42.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ff9fe59c700 1 --2- 172.21.15.115:0/2924472703 >> v2:172.21.15.159:3300/0 conn(0x7ffa00153ec0 0x7ffa000a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ff9fd59a700 1 -- 172.21.15.115:0/2924472703 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737491907 0 0) 0x7ff9f4001110 con 0x7ffa000aa050 2023-07-27T14:27:42.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ff9fd59a700 1 -- 172.21.15.115:0/2924472703 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9e80033f0 con 0x7ffa000aa050 2023-07-27T14:27:42.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.541+0000 7ff9fe59c700 1 -- 172.21.15.115:0/2924472703 >> v1:172.21.15.159:6789/0 conn(0x7ffa000aaa40 legacy=0x7ffa000c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ff9fe59c700 1 -- 172.21.15.115:0/2924472703 >> v1:172.21.15.115:6789/0 conn(0x7ffa000aa050 legacy=0x7ffa000640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ff9fe59c700 1 -- 172.21.15.115:0/2924472703 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa000bff70 con 0x7ffa00153ec0 2023-07-27T14:27:42.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ff9fe59c700 1 --2- 172.21.15.115:0/2924472703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa00153ec0 0x7ffa000a9b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff9f0009760 tx=0x7ff9f0009060).ready entity=mon.1 client_cookie=f0f8eee60a3889cc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ff9fd59a700 1 -- 172.21.15.115:0/2924472703 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000f510 con 0x7ffa00153ec0 2023-07-27T14:27:42.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ff9fd59a700 1 -- 172.21.15.115:0/2924472703 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000f670 con 0x7ffa00153ec0 2023-07-27T14:27:42.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ff9fd59a700 1 -- 172.21.15.115:0/2924472703 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000f9f0 con 0x7ffa00153ec0 2023-07-27T14:27:42.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ffa04bff700 1 -- 172.21.15.115:0/2924472703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa00153ec0 msgr2=0x7ffa000a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ffa04bff700 1 --2- 172.21.15.115:0/2924472703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa00153ec0 0x7ffa000a9b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff9f0009760 tx=0x7ff9f0009060).stop 2023-07-27T14:27:42.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ffa04bff700 1 -- 172.21.15.115:0/2924472703 shutdown_connections 2023-07-27T14:27:42.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.542+0000 7ffa04bff700 1 --2- 172.21.15.115:0/2924472703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa00153ec0 0x7ffa000a9b60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.543+0000 7ffa04bff700 1 -- 172.21.15.115:0/2924472703 >> 172.21.15.115:0/2924472703 conn(0x7ffa000cb610 msgr2=0x7ffa000c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:42.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.543+0000 7ffa04bff700 1 -- 172.21.15.115:0/2924472703 shutdown_connections 2023-07-27T14:27:42.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.543+0000 7ffa04bff700 1 -- 172.21.15.115:0/2924472703 wait complete. 2023-07-27T14:27:42.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.544+0000 7ffa04bff700 1 Processor -- start 2023-07-27T14:27:42.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.544+0000 7ffa04bff700 1 -- start start 2023-07-27T14:27:42.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ffa04bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa000aa050 0x7ffa0014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ffa04bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa000aaa40 0x7ffa00152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ffa04bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa00153ec0 0x7ffa00151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ffa04bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00153360 con 0x7ffa00153ec0 2023-07-27T14:27:42.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ffa04bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0014f270 con 0x7ffa000aa050 2023-07-27T14:27:42.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ffa04bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa001519a0 con 0x7ffa000aaa40 2023-07-27T14:27:42.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ff9fed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa00153ec0 0x7ffa00151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ff9fe59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa000aa050 0x7ffa0014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ff9fdd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa000aaa40 0x7ffa00152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ff9fed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa00153ec0 0x7ffa00151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34934/0 (socket says 172.21.15.115:34934) 2023-07-27T14:27:42.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.545+0000 7ff9fed9d700 1 -- 172.21.15.115:0/1013461341 learned_addr learned my addr 172.21.15.115:0/1013461341 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:42.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9fe59c700 1 -- 172.21.15.115:0/1013461341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa000aaa40 msgr2=0x7ffa00152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9fe59c700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa000aaa40 0x7ffa00152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9fe59c700 1 -- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa00153ec0 msgr2=0x7ffa00151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9fe59c700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa00153ec0 0x7ffa00151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9fe59c700 1 -- 172.21.15.115:0/1013461341 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00092a0 con 0x7ffa000aa050 2023-07-27T14:27:42.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9fe59c700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa000aa050 0x7ffa0014e960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff9f0014000 tx=0x7ff9f0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9ee7fc700 1 -- 172.21.15.115:0/1013461341 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000f7e0 con 0x7ffa000aa050 2023-07-27T14:27:42.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa00154340 con 0x7ffa000aa050 2023-07-27T14:27:42.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9ee7fc700 1 -- 172.21.15.115:0/1013461341 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000f940 con 0x7ffa000aa050 2023-07-27T14:27:42.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ff9ee7fc700 1 -- 172.21.15.115:0/1013461341 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f001b690 con 0x7ffa000aa050 2023-07-27T14:27:42.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.546+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa001548c0 con 0x7ffa000aa050 2023-07-27T14:27:42.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.547+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa00151c80 con 0x7ffa000aa050 2023-07-27T14:27:42.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.548+0000 7ff9ee7fc700 1 -- 172.21.15.115:0/1013461341 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7ff9f002a070 con 0x7ffa000aa050 2023-07-27T14:27:42.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.549+0000 7ff9ee7fc700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9e005ed60 0x7ff9e0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.549+0000 7ff9ee7fc700 1 -- 172.21.15.115:0/1013461341 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff9f007b140 con 0x7ffa000aa050 2023-07-27T14:27:42.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.550+0000 7ff9fdd9b700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9e005ed60 0x7ff9e0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.550+0000 7ff9fdd9b700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9e005ed60 0x7ff9e0061220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ffa000c4720 tx=0x7ff9f4007a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.554+0000 7ff9ee7fc700 1 -- 172.21.15.115:0/1013461341 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9f004c610 con 0x7ffa000aa050 2023-07-27T14:27:42.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.725+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa00154ab0 con 0x7ffa000aa050 2023-07-27T14:27:42.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.726+0000 7ff9ee7fc700 1 -- 172.21.15.115:0/1013461341 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7ff9f0028090 con 0x7ffa000aa050 2023-07-27T14:27:42.743 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:42.743 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:42.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9e005ed60 msgr2=0x7ff9e0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9e005ed60 0x7ff9e0061220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ffa000c4720 tx=0x7ff9f4007a70).stop 2023-07-27T14:27:42.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa000aa050 msgr2=0x7ffa0014e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa000aa050 0x7ffa0014e960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff9f0014000 tx=0x7ff9f0017000).stop 2023-07-27T14:27:42.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 shutdown_connections 2023-07-27T14:27:42.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9e005ed60 0x7ff9e0061220 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa00153ec0 0x7ffa00151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa000aa050 0x7ffa0014e960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 --2- 172.21.15.115:0/1013461341 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa000aaa40 0x7ffa00152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.728+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 >> 172.21.15.115:0/1013461341 conn(0x7ffa000cb610 msgr2=0x7ffa000640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:42.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.729+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 shutdown_connections 2023-07-27T14:27:42.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.729+0000 7ffa04bff700 1 -- 172.21.15.115:0/1013461341 wait complete. 2023-07-27T14:27:42.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:26:59.286583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:27:00.228329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:27:42.764 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:27:42.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.938+0000 7fa1319ff700 1 Processor -- start 2023-07-27T14:27:42.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.938+0000 7fa1319ff700 1 -- start start 2023-07-27T14:27:42.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.939+0000 7fa1319ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa12c063260 0x7fa12c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.939+0000 7fa1319ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c14b1e0 0x7fa12c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.939+0000 7fa1319ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c1553f0 con 0x7fa12c14ae00 2023-07-27T14:27:42.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.939+0000 7fa1319ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c157a50 con 0x7fa12c063260 2023-07-27T14:27:42.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.939+0000 7fa1319ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c157d10 con 0x7fa12c14b1e0 2023-07-27T14:27:42.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.939+0000 7fa12affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa12c14ae00 0x7fa12c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34472/0 (socket says 172.21.15.115:34472) 2023-07-27T14:27:42.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.939+0000 7fa12affd700 1 -- 172.21.15.115:0/2405166895 learned_addr learned my addr 172.21.15.115:0/2405166895 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:42.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa12b7fe700 1 --2- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c14b1e0 0x7fa12c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa12a7fc700 1 --2- 172.21.15.115:0/2405166895 >> v2:172.21.15.159:3300/0 conn(0x7fa12c063260 0x7fa12c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa129ffb700 1 -- 172.21.15.115:0/2405166895 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059182265 0 0) 0x7fa12c1553f0 con 0x7fa12c14ae00 2023-07-27T14:27:42.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa129ffb700 1 -- 172.21.15.115:0/2405166895 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1140033f0 con 0x7fa12c14ae00 2023-07-27T14:27:42.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa12a7fc700 1 -- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c14b1e0 msgr2=0x7fa12c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:42.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa12a7fc700 1 --2- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c14b1e0 0x7fa12c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa12a7fc700 1 -- 172.21.15.115:0/2405166895 >> v1:172.21.15.115:6789/0 conn(0x7fa12c14ae00 legacy=0x7fa12c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa129ffb700 1 -- 172.21.15.115:0/2405166895 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362284094 0 0) 0x7fa1140033f0 con 0x7fa12c14ae00 2023-07-27T14:27:42.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa12a7fc700 1 -- 172.21.15.115:0/2405166895 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c157ff0 con 0x7fa12c063260 2023-07-27T14:27:42.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa12b7fe700 1 --2- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c14b1e0 0x7fa12c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:42.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa12a7fc700 1 --2- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c063260 0x7fa12c154f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa120009760 tx=0x7fa120009060).ready entity=mon.1 client_cookie=597bdb343efb621 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.940+0000 7fa129ffb700 1 -- 172.21.15.115:0/2405166895 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c001470 con 0x7fa12c063260 2023-07-27T14:27:42.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa129ffb700 1 -- 172.21.15.115:0/2405166895 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa120011400 con 0x7fa12c063260 2023-07-27T14:27:42.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa129ffb700 1 -- 172.21.15.115:0/2405166895 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011780 con 0x7fa12c063260 2023-07-27T14:27:42.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa1319ff700 1 -- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c063260 msgr2=0x7fa12c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c063260 0x7fa12c154f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa120009760 tx=0x7fa120009060).stop 2023-07-27T14:27:42.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa1319ff700 1 -- 172.21.15.115:0/2405166895 shutdown_connections 2023-07-27T14:27:42.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c14b1e0 0x7fa12c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2405166895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c063260 0x7fa12c154f00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa1319ff700 1 -- 172.21.15.115:0/2405166895 >> 172.21.15.115:0/2405166895 conn(0x7fa12c05e940 msgr2=0x7fa12c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:42.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa1319ff700 1 -- 172.21.15.115:0/2405166895 shutdown_connections 2023-07-27T14:27:42.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.941+0000 7fa1319ff700 1 -- 172.21.15.115:0/2405166895 wait complete. 2023-07-27T14:27:42.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.943+0000 7fa1319ff700 1 Processor -- start 2023-07-27T14:27:42.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.943+0000 7fa1319ff700 1 -- start start 2023-07-27T14:27:42.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa1319ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c063260 0x7fa12c13d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa1319ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa12c14ae00 0x7fa12c0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa1319ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c14b1e0 0x7fa12c0abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa1319ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0aea30 con 0x7fa12c14ae00 2023-07-27T14:27:42.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa1319ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0adb60 con 0x7fa12c14b1e0 2023-07-27T14:27:42.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa1319ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c13dcd0 con 0x7fa12c063260 2023-07-27T14:27:42.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa12a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa12c14ae00 0x7fa12c0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa12a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa12c14ae00 0x7fa12c0c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34936/0 (socket says 172.21.15.115:34936) 2023-07-27T14:27:42.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa12a7fc700 1 -- 172.21.15.115:0/2925917878 learned_addr learned my addr 172.21.15.115:0/2925917878 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:42.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa12affd700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c063260 0x7fa12c13d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.944+0000 7fa12b7fe700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c14b1e0 0x7fa12c0abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa12a7fc700 1 -- 172.21.15.115:0/2925917878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c063260 msgr2=0x7fa12c13d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa12a7fc700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c063260 0x7fa12c13d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa12a7fc700 1 -- 172.21.15.115:0/2925917878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c14b1e0 msgr2=0x7fa12c0abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:42.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa12a7fc700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c14b1e0 0x7fa12c0abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:42.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa12a7fc700 1 -- 172.21.15.115:0/2925917878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124009a20 con 0x7fa12c14ae00 2023-07-27T14:27:42.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa12a7fc700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa12c14ae00 0x7fa12c0c1c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fa12c0c53b0 tx=0x7fa120016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa112ffd700 1 -- 172.21.15.115:0/2925917878 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120010740 con 0x7fa12c14ae00 2023-07-27T14:27:42.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa112ffd700 1 -- 172.21.15.115:0/2925917878 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1200108a0 con 0x7fa12c14ae00 2023-07-27T14:27:42.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1200092a0 con 0x7fa12c14ae00 2023-07-27T14:27:42.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa112ffd700 1 -- 172.21.15.115:0/2925917878 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120010c60 con 0x7fa12c14ae00 2023-07-27T14:27:42.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.945+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c0ae090 con 0x7fa12c14ae00 2023-07-27T14:27:42.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.946+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c0aeb70 con 0x7fa12c14ae00 2023-07-27T14:27:42.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.947+0000 7fa112ffd700 1 -- 172.21.15.115:0/2925917878 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa120024030 con 0x7fa12c14ae00 2023-07-27T14:27:42.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.948+0000 7fa112ffd700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa11805ed90 0x7fa118061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:42.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.948+0000 7fa112ffd700 1 -- 172.21.15.115:0/2925917878 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa12007a570 con 0x7fa12c14ae00 2023-07-27T14:27:42.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.948+0000 7fa12affd700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa11805ed90 0x7fa118061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:42.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.948+0000 7fa12affd700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa11805ed90 0x7fa118061250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa11c0011e0 tx=0x7fa11c001aa0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:42.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:42.952+0000 7fa112ffd700 1 -- 172.21.15.115:0/2925917878 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa12c0aeb70 con 0x7fa12c14ae00 2023-07-27T14:27:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.119+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa12c0aeb70 con 0x7fa12c14ae00 2023-07-27T14:27:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.119+0000 7fa112ffd700 1 -- 172.21.15.115:0/2925917878 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa12c0aeb70 con 0x7fa12c14ae00 2023-07-27T14:27:43.137 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:27:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa11805ed90 msgr2=0x7fa118061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa11805ed90 0x7fa118061250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa11c0011e0 tx=0x7fa11c001aa0).stop 2023-07-27T14:27:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa12c14ae00 msgr2=0x7fa12c0c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa12c14ae00 0x7fa12c0c1c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fa12c0c53b0 tx=0x7fa120016000).stop 2023-07-27T14:27:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 shutdown_connections 2023-07-27T14:27:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa11805ed90 0x7fa118061250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c14b1e0 0x7fa12c0abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa12c063260 0x7fa12c13d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 --2- 172.21.15.115:0/2925917878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa12c14ae00 0x7fa12c0c1c50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.121+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 >> 172.21.15.115:0/2925917878 conn(0x7fa12c05e940 msgr2=0x7fa12c0649e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.122+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 shutdown_connections 2023-07-27T14:27:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.122+0000 7fa1319ff700 1 -- 172.21.15.115:0/2925917878 wait complete. 2023-07-27T14:27:43.156 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:27:43.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.330+0000 7effb8bff700 1 Processor -- start 2023-07-27T14:27:43.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.330+0000 7effb8bff700 1 -- start start 2023-07-27T14:27:43.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb8bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effb414ae00 0x7effb4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb8bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414b1e0 0x7effb4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb8bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb41553f0 con 0x7effb40c5c50 2023-07-27T14:27:43.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb8bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb4157a50 con 0x7effb414ae00 2023-07-27T14:27:43.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb8bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb4157d10 con 0x7effb414b1e0 2023-07-27T14:27:43.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effb414ae00 0x7effb4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effb414ae00 0x7effb4154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34944/0 (socket says 172.21.15.115:34944) 2023-07-27T14:27:43.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb259c700 1 -- 172.21.15.115:0/2131811447 learned_addr learned my addr 172.21.15.115:0/2131811447 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:43.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.331+0000 7effb1d9b700 1 --2- 172.21.15.115:0/2131811447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414b1e0 0x7effb4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb259c700 1 -- 172.21.15.115:0/2131811447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414b1e0 msgr2=0x7effb4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:43.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb259c700 1 --2- 172.21.15.115:0/2131811447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414b1e0 0x7effb4062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb259c700 1 -- 172.21.15.115:0/2131811447 >> v1:172.21.15.159:6789/0 conn(0x7effb40c5c50 legacy=0x7effb40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb259c700 1 -- 172.21.15.115:0/2131811447 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4157ff0 con 0x7effb414ae00 2023-07-27T14:27:43.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb159a700 1 -- 172.21.15.115:0/2131811447 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796280304 0 0) 0x7effb41553f0 con 0x7effb40c5c50 2023-07-27T14:27:43.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb259c700 1 --2- 172.21.15.115:0/2131811447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414ae00 0x7effb4154f00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7effa4006fd0 tx=0x7effa40090f0).ready entity=mon.0 client_cookie=cf67876b6e3c8ccf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:43.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb159a700 1 -- 172.21.15.115:0/2131811447 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400b580 con 0x7effb414ae00 2023-07-27T14:27:43.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb159a700 1 -- 172.21.15.115:0/2131811447 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400b6e0 con 0x7effb414ae00 2023-07-27T14:27:43.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.332+0000 7effb159a700 1 -- 172.21.15.115:0/2131811447 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400ba60 con 0x7effb414ae00 2023-07-27T14:27:43.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.333+0000 7effb8bff700 1 -- 172.21.15.115:0/2131811447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414ae00 msgr2=0x7effb4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.333+0000 7effb8bff700 1 --2- 172.21.15.115:0/2131811447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414ae00 0x7effb4154f00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7effa4006fd0 tx=0x7effa40090f0).stop 2023-07-27T14:27:43.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.333+0000 7effb8bff700 1 -- 172.21.15.115:0/2131811447 shutdown_connections 2023-07-27T14:27:43.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.333+0000 7effb8bff700 1 --2- 172.21.15.115:0/2131811447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414ae00 0x7effb4154f00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.333+0000 7effb8bff700 1 --2- 172.21.15.115:0/2131811447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414b1e0 0x7effb4062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.333+0000 7effb8bff700 1 -- 172.21.15.115:0/2131811447 >> 172.21.15.115:0/2131811447 conn(0x7effb405e940 msgr2=0x7effb40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:43.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.333+0000 7effb8bff700 1 -- 172.21.15.115:0/2131811447 shutdown_connections 2023-07-27T14:27:43.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.333+0000 7effb8bff700 1 -- 172.21.15.115:0/2131811447 wait complete. 2023-07-27T14:27:43.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.334+0000 7effb8bff700 1 Processor -- start 2023-07-27T14:27:43.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.334+0000 7effb8bff700 1 -- start start 2023-07-27T14:27:43.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.335+0000 7effb8bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb40c5c50 0x7effb414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.335+0000 7effb8bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414ae00 0x7effb41587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.335+0000 7effb8bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414b1e0 0x7effb4158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.335+0000 7effb8bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb41591d0 con 0x7effb414b1e0 2023-07-27T14:27:43.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.335+0000 7effb8bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb4168570 con 0x7effb40c5c50 2023-07-27T14:27:43.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.335+0000 7effb8bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c23d0 con 0x7effb414ae00 2023-07-27T14:27:43.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414b1e0 0x7effb4158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414b1e0 0x7effb4158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34960/0 (socket says 172.21.15.115:34960) 2023-07-27T14:27:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 -- 172.21.15.115:0/2056938140 learned_addr learned my addr 172.21.15.115:0/2056938140 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb259c700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb40c5c50 0x7effb414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb1d9b700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414ae00 0x7effb41587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 -- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414ae00 msgr2=0x7effb41587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414ae00 0x7effb41587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 -- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb40c5c50 msgr2=0x7effb414a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb40c5c50 0x7effb414a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 -- 172.21.15.115:0/2056938140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4009370 con 0x7effb414b1e0 2023-07-27T14:27:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb1d9b700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414ae00 0x7effb41587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.336+0000 7effb2d9d700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414b1e0 0x7effb4158ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7effac00c7e0 tx=0x7effac007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.337+0000 7effaa7fc700 1 -- 172.21.15.115:0/2056938140 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac010510 con 0x7effb414b1e0 2023-07-27T14:27:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.337+0000 7effaa7fc700 1 -- 172.21.15.115:0/2056938140 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac010690 con 0x7effb414b1e0 2023-07-27T14:27:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.337+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4168290 con 0x7effb414b1e0 2023-07-27T14:27:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.337+0000 7effaa7fc700 1 -- 172.21.15.115:0/2056938140 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac010a50 con 0x7effb414b1e0 2023-07-27T14:27:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.337+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40c2060 con 0x7effb414b1e0 2023-07-27T14:27:43.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.338+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb406c470 con 0x7effb414b1e0 2023-07-27T14:27:43.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.339+0000 7effaa7fc700 1 -- 172.21.15.115:0/2056938140 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7effac010070 con 0x7effb414b1e0 2023-07-27T14:27:43.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.339+0000 7effaa7fc700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff9405ed60 0x7eff94061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.339+0000 7effaa7fc700 1 -- 172.21.15.115:0/2056938140 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7effac0798f0 con 0x7effb414b1e0 2023-07-27T14:27:43.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.340+0000 7effb259c700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff9405ed60 0x7eff94061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.340+0000 7effb259c700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff9405ed60 0x7eff94061220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7effa4009130 tx=0x7effa4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:43.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.343+0000 7effaa7fc700 1 -- 172.21.15.115:0/2056938140 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7effac04ad80 con 0x7effb414b1e0 2023-07-27T14:27:43.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.511+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7effb40c2510 con 0x7effb414b1e0 2023-07-27T14:27:43.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.512+0000 7effaa7fc700 1 -- 172.21.15.115:0/2056938140 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7effac04e3a0 con 0x7effb414b1e0 2023-07-27T14:27:43.529 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:27:43.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff9405ed60 msgr2=0x7eff94061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff9405ed60 0x7eff94061220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7effa4009130 tx=0x7effa4017000).stop 2023-07-27T14:27:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414b1e0 msgr2=0x7effb4158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414b1e0 0x7effb4158ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7effac00c7e0 tx=0x7effac007f70).stop 2023-07-27T14:27:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 shutdown_connections 2023-07-27T14:27:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff9405ed60 0x7eff94061220 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effb414b1e0 0x7effb4158ce0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb40c5c50 0x7effb414a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 --2- 172.21.15.115:0/2056938140 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effb414ae00 0x7effb41587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 >> 172.21.15.115:0/2056938140 conn(0x7effb405e940 msgr2=0x7effb40c0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 shutdown_connections 2023-07-27T14:27:43.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.514+0000 7effb8bff700 1 -- 172.21.15.115:0/2056938140 wait complete. 2023-07-27T14:27:43.548 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:27:43.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.724+0000 7f5748dff700 1 Processor -- start 2023-07-27T14:27:43.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.724+0000 7f5748dff700 1 -- start start 2023-07-27T14:27:43.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f5748dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f574414ae00 0x7f5744154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f5748dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5744063260 0x7f57440a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f5748dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57441553f0 con 0x7f574414b1e0 2023-07-27T14:27:43.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f5748dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5744157a50 con 0x7f574414ae00 2023-07-27T14:27:43.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f5748dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5744157d10 con 0x7f5744063260 2023-07-27T14:27:43.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f574259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f574414ae00 0x7f5744154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f574259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f574414ae00 0x7f5744154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46932/0 (socket says 172.21.15.115:46932) 2023-07-27T14:27:43.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f574259c700 1 -- 172.21.15.115:0/1445505280 learned_addr learned my addr 172.21.15.115:0/1445505280 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:43.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f574259c700 1 -- 172.21.15.115:0/1445505280 >> v2:172.21.15.159:3300/0 conn(0x7f5744063260 msgr2=0x7f57440a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:43.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f5742d9d700 1 --2- 172.21.15.115:0/1445505280 >> v2:172.21.15.159:3300/0 conn(0x7f5744063260 0x7f57440a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f574259c700 1 --2- 172.21.15.115:0/1445505280 >> v2:172.21.15.159:3300/0 conn(0x7f5744063260 0x7f57440a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f574259c700 1 -- 172.21.15.115:0/1445505280 >> v1:172.21.15.159:6789/0 conn(0x7f574414b1e0 legacy=0x7f5744062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:43.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f574259c700 1 -- 172.21.15.115:0/1445505280 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744157ff0 con 0x7f574414ae00 2023-07-27T14:27:43.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.726+0000 7f5742d9d700 1 --2- 172.21.15.115:0/1445505280 >> v2:172.21.15.159:3300/0 conn(0x7f5744063260 0x7f57440a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:43.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f574259c700 1 --2- 172.21.15.115:0/1445505280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f574414ae00 0x7f5744154f00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f5744083430 tx=0x7f57340090f0).ready entity=mon.0 client_cookie=1b56861d2da43ab9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:43.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f574159a700 1 -- 172.21.15.115:0/1445505280 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400b5a0 con 0x7f574414ae00 2023-07-27T14:27:43.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f574159a700 1 -- 172.21.15.115:0/1445505280 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400b700 con 0x7f574414ae00 2023-07-27T14:27:43.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f574159a700 1 -- 172.21.15.115:0/1445505280 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400ba80 con 0x7f574414ae00 2023-07-27T14:27:43.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f5748dff700 1 -- 172.21.15.115:0/1445505280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f574414ae00 msgr2=0x7f5744154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f5748dff700 1 --2- 172.21.15.115:0/1445505280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f574414ae00 0x7f5744154f00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f5744083430 tx=0x7f57340090f0).stop 2023-07-27T14:27:43.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f5748dff700 1 -- 172.21.15.115:0/1445505280 shutdown_connections 2023-07-27T14:27:43.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f5748dff700 1 --2- 172.21.15.115:0/1445505280 >> v2:172.21.15.159:3300/0 conn(0x7f5744063260 0x7f57440a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f5748dff700 1 --2- 172.21.15.115:0/1445505280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f574414ae00 0x7f5744154f00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.727+0000 7f5748dff700 1 -- 172.21.15.115:0/1445505280 >> 172.21.15.115:0/1445505280 conn(0x7f574405e940 msgr2=0x7f57440cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:43.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.728+0000 7f5748dff700 1 -- 172.21.15.115:0/1445505280 shutdown_connections 2023-07-27T14:27:43.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.728+0000 7f5748dff700 1 -- 172.21.15.115:0/1445505280 wait complete. 2023-07-27T14:27:43.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.729+0000 7f5748dff700 1 Processor -- start 2023-07-27T14:27:43.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.729+0000 7f5748dff700 1 -- start start 2023-07-27T14:27:43.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f5748dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063260 0x7f5744138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f5748dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f574414ae00 0x7f57440afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f5748dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f574414b1e0 0x7f57440b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f5748dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440c2340 con 0x7f5744063260 2023-07-27T14:27:43.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f5748dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744139390 con 0x7f574414b1e0 2023-07-27T14:27:43.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f5748dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440b0730 con 0x7f574414ae00 2023-07-27T14:27:43.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f574259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063260 0x7f5744138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f574259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063260 0x7f5744138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46942/0 (socket says 172.21.15.115:46942) 2023-07-27T14:27:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.730+0000 7f574259c700 1 -- 172.21.15.115:0/4070338390 learned_addr learned my addr 172.21.15.115:0/4070338390 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f5742d9d700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f574414b1e0 0x7f57440b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f5741d9b700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f574414ae00 0x7f57440afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f574259c700 1 -- 172.21.15.115:0/4070338390 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f574414ae00 msgr2=0x7f57440afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f574259c700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f574414ae00 0x7f57440afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f574259c700 1 -- 172.21.15.115:0/4070338390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f574414b1e0 msgr2=0x7f57440b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f574259c700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f574414b1e0 0x7f57440b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f574259c700 1 -- 172.21.15.115:0/4070338390 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5734009370 con 0x7f5744063260 2023-07-27T14:27:43.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f574259c700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063260 0x7f5744138ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5744155580 tx=0x7f5734015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:43.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f57327fc700 1 -- 172.21.15.115:0/4070338390 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400b870 con 0x7f5744063260 2023-07-27T14:27:43.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f57327fc700 1 -- 172.21.15.115:0/4070338390 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400b9d0 con 0x7f5744063260 2023-07-27T14:27:43.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57440b0a10 con 0x7f5744063260 2023-07-27T14:27:43.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f57327fc700 1 -- 172.21.15.115:0/4070338390 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573401a430 con 0x7f5744063260 2023-07-27T14:27:43.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.731+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57440c1fd0 con 0x7f5744063260 2023-07-27T14:27:43.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.732+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574406c470 con 0x7f5744063260 2023-07-27T14:27:43.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.733+0000 7f57327fc700 1 -- 172.21.15.115:0/4070338390 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f573402b070 con 0x7f5744063260 2023-07-27T14:27:43.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.734+0000 7f57327fc700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f572405ed90 0x7f5724061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:43.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.734+0000 7f57327fc700 1 -- 172.21.15.115:0/4070338390 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f573407b390 con 0x7f5744063260 2023-07-27T14:27:43.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.734+0000 7f5741d9b700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f572405ed90 0x7f5724061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:43.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.735+0000 7f5741d9b700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f572405ed90 0x7f5724061250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f574413c740 tx=0x7f5738008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:43.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.738+0000 7f57327fc700 1 -- 172.21.15.115:0/4070338390 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f573404c820 con 0x7f5744063260 2023-07-27T14:27:43.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.908+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57440c1810 con 0x7f5744063260 2023-07-27T14:27:43.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.908+0000 7f57327fc700 1 -- 172.21.15.115:0/4070338390 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57340290a0 con 0x7f5744063260 2023-07-27T14:27:43.925 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:43.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f572405ed90 msgr2=0x7f5724061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f572405ed90 0x7f5724061250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f574413c740 tx=0x7f5738008040).stop 2023-07-27T14:27:43.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063260 msgr2=0x7f5744138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:43.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063260 0x7f5744138ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5744155580 tx=0x7f5734015000).stop 2023-07-27T14:27:43.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 shutdown_connections 2023-07-27T14:27:43.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f572405ed90 0x7f5724061250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f574414b1e0 0x7f57440b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5744063260 0x7f5744138ea0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 --2- 172.21.15.115:0/4070338390 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f574414ae00 0x7f57440afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:43.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 >> 172.21.15.115:0/4070338390 conn(0x7f574405e940 msgr2=0x7f57440c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:43.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 shutdown_connections 2023-07-27T14:27:43.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:43.910+0000 7f5748dff700 1 -- 172.21.15.115:0/4070338390 wait complete. 2023-07-27T14:27:43.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:27:44.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.117+0000 7f8f51bff700 1 Processor -- start 2023-07-27T14:27:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.117+0000 7f8f51bff700 1 -- start start 2023-07-27T14:27:44.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.118+0000 7f8f51bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8f4c063260 0x7f8f4c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.118+0000 7f8f51bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c1553f0 con 0x7f8f4c14b1e0 2023-07-27T14:27:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.118+0000 7f8f51bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c157a50 con 0x7f8f4c14ae00 2023-07-27T14:27:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.118+0000 7f8f51bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c157d10 con 0x7f8f4c063260 2023-07-27T14:27:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.118+0000 7f8f4bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8f4c14b1e0 0x7f8f4c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42376/0 (socket says 172.21.15.115:42376) 2023-07-27T14:27:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.118+0000 7f8f4bfff700 1 -- 172.21.15.115:0/1701434944 learned_addr learned my addr 172.21.15.115:0/1701434944 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4affd700 1 --2- 172.21.15.115:0/1701434944 >> v2:172.21.15.159:3300/0 conn(0x7f8f4c063260 0x7f8f4c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973847321 0 0) 0x7f8f4c1553f0 con 0x7f8f4c14b1e0 2023-07-27T14:27:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f340033f0 con 0x7f8f4c14b1e0 2023-07-27T14:27:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563961746 0 0) 0x7f8f4c157a50 con 0x7f8f4c14ae00 2023-07-27T14:27:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f4c1553f0 con 0x7f8f4c14ae00 2023-07-27T14:27:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1723124157 0 0) 0x7f8f340033f0 con 0x7f8f4c14b1e0 2023-07-27T14:27:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 >> v2:172.21.15.159:3300/0 conn(0x7f8f4c063260 msgr2=0x7f8f4c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 --2- 172.21.15.115:0/1701434944 >> v2:172.21.15.159:3300/0 conn(0x7f8f4c063260 0x7f8f4c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 >> v1:172.21.15.159:6789/0 conn(0x7f8f4c14ae00 legacy=0x7f8f4c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c157ff0 con 0x7f8f4c14b1e0 2023-07-27T14:27:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f8f440017f0 con 0x7f8f4c14b1e0 2023-07-27T14:27:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 >> v1:172.21.15.115:6789/0 conn(0x7f8f4c14b1e0 legacy=0x7f8f4c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f34003a70 0x7f8f34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f34004690 0x7f8f34004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34005000 0x7f8f3400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c157d10 con 0x7f8f34003a70 2023-07-27T14:27:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3400bf60 con 0x7f8f34004690 2023-07-27T14:27:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.119+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3400c0d0 con 0x7f8f34005000 2023-07-27T14:27:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4b7fe700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f34003a70 0x7f8f34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4affd700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f34004690 0x7f8f34004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4bfff700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34005000 0x7f8f3400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4b7fe700 1 -- 172.21.15.115:0/1701434944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34005000 msgr2=0x7f8f3400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4b7fe700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34005000 0x7f8f3400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4b7fe700 1 -- 172.21.15.115:0/1701434944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f34004690 msgr2=0x7f8f34004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4b7fe700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f34004690 0x7f8f34004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4b7fe700 1 -- 172.21.15.115:0/1701434944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340033f0 con 0x7f8f34003a70 2023-07-27T14:27:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4bfff700 1 -- 172.21.15.115:0/1701434944 reap_dead start 2023-07-27T14:27:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4b7fe700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f34003a70 0x7f8f34003e70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f8f3c001890 tx=0x7f8f3c007bb0).ready entity=mon.0 client_cookie=d692d24b2810d8ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c007020 con 0x7f8f34003a70 2023-07-27T14:27:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c007180 con 0x7f8f34003a70 2023-07-27T14:27:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.120+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1701434944 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c007500 con 0x7f8f34003a70 2023-07-27T14:27:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.121+0000 7f8f51bff700 1 -- 172.21.15.115:0/1701434944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f34003a70 msgr2=0x7f8f34003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.121+0000 7f8f51bff700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f34003a70 0x7f8f34003e70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f8f3c001890 tx=0x7f8f3c007bb0).stop 2023-07-27T14:27:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.121+0000 7f8f51bff700 1 -- 172.21.15.115:0/1701434944 shutdown_connections 2023-07-27T14:27:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.121+0000 7f8f51bff700 1 --2- 172.21.15.115:0/1701434944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f34003a70 0x7f8f34003e70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.121+0000 7f8f51bff700 1 -- 172.21.15.115:0/1701434944 >> 172.21.15.115:0/1701434944 conn(0x7f8f4c05e940 msgr2=0x7f8f4c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.121+0000 7f8f51bff700 1 -- 172.21.15.115:0/1701434944 shutdown_connections 2023-07-27T14:27:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.121+0000 7f8f51bff700 1 -- 172.21.15.115:0/1701434944 wait complete. 2023-07-27T14:27:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.122+0000 7f8f51bff700 1 Processor -- start 2023-07-27T14:27:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.123+0000 7f8f51bff700 1 -- start start 2023-07-27T14:27:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.123+0000 7f8f51bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34003a70 0x7f8f4c14a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.123+0000 7f8f51bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f4c0accc0 0x7f8f4c156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.123+0000 7f8f51bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f4c156a40 0x7f8f4c14c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f51bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c14d710 con 0x7f8f4c0accc0 2023-07-27T14:27:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f51bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0ac830 con 0x7f8f4c156a40 2023-07-27T14:27:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f51bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c156ec0 con 0x7f8f34003a70 2023-07-27T14:27:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f4c0accc0 0x7f8f4c156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f4c0accc0 0x7f8f4c156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46972/0 (socket says 172.21.15.115:46972) 2023-07-27T14:27:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 -- 172.21.15.115:0/1644480840 learned_addr learned my addr 172.21.15.115:0/1644480840 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4b7fe700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34003a70 0x7f8f4c14a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4bfff700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f4c156a40 0x7f8f4c14c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 -- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34003a70 msgr2=0x7f8f4c14a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34003a70 0x7f8f4c14a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 -- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f4c156a40 msgr2=0x7f8f4c14c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f4c156a40 0x7f8f4c14c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 -- 172.21.15.115:0/1644480840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c0abf00 con 0x7f8f4c0accc0 2023-07-27T14:27:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4bfff700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f4c156a40 0x7f8f4c14c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.124+0000 7f8f4affd700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f4c0accc0 0x7f8f4c156550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f8f400119d0 tx=0x7f8f40009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.125+0000 7f8f337fe700 1 -- 172.21.15.115:0/1644480840 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000f730 con 0x7f8f4c0accc0 2023-07-27T14:27:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.125+0000 7f8f337fe700 1 -- 172.21.15.115:0/1644480840 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4000f890 con 0x7f8f4c0accc0 2023-07-27T14:27:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.125+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c0ac1e0 con 0x7f8f4c0accc0 2023-07-27T14:27:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.125+0000 7f8f337fe700 1 -- 172.21.15.115:0/1644480840 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000fc10 con 0x7f8f4c0accc0 2023-07-27T14:27:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.125+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c14ab10 con 0x7f8f4c0accc0 2023-07-27T14:27:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.126+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c06c470 con 0x7f8f4c0accc0 2023-07-27T14:27:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.127+0000 7f8f337fe700 1 -- 172.21.15.115:0/1644480840 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f8f40024070 con 0x7f8f4c0accc0 2023-07-27T14:27:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.128+0000 7f8f337fe700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3805edc0 0x7f8f38061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.128+0000 7f8f337fe700 1 -- 172.21.15.115:0/1644480840 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8f4007a3e0 con 0x7f8f4c0accc0 2023-07-27T14:27:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.128+0000 7f8f4b7fe700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3805edc0 0x7f8f38061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.129+0000 7f8f4b7fe700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3805edc0 0x7f8f38061280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8f3c000c00 tx=0x7f8f3c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.132+0000 7f8f337fe700 1 -- 172.21.15.115:0/1644480840 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f4004b980 con 0x7f8f4c0accc0 2023-07-27T14:27:44.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.299+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f4c064470 con 0x7f8f4c0accc0 2023-07-27T14:27:44.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.299+0000 7f8f337fe700 1 -- 172.21.15.115:0/1644480840 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f4004efa0 con 0x7f8f4c0accc0 2023-07-27T14:27:44.316 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:27:44.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.301+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3805edc0 msgr2=0x7f8f38061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.301+0000 7f8f51bff700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3805edc0 0x7f8f38061280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8f3c000c00 tx=0x7f8f3c015000).stop 2023-07-27T14:27:44.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.301+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f4c0accc0 msgr2=0x7f8f4c156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.301+0000 7f8f51bff700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f4c0accc0 0x7f8f4c156550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f8f400119d0 tx=0x7f8f40009060).stop 2023-07-27T14:27:44.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.302+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 shutdown_connections 2023-07-27T14:27:44.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.302+0000 7f8f51bff700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3805edc0 0x7f8f38061280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.302+0000 7f8f51bff700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f4c156a40 0x7f8f4c14c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.302+0000 7f8f51bff700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f34003a70 0x7f8f4c14a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.302+0000 7f8f51bff700 1 --2- 172.21.15.115:0/1644480840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f4c0accc0 0x7f8f4c156550 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.302+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 >> 172.21.15.115:0/1644480840 conn(0x7f8f4c05e940 msgr2=0x7f8f4c1534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:44.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.302+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 shutdown_connections 2023-07-27T14:27:44.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.302+0000 7f8f51bff700 1 -- 172.21.15.115:0/1644480840 wait complete. 2023-07-27T14:27:44.335 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:27:44.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.506+0000 7fbce8fff700 1 Processor -- start 2023-07-27T14:27:44.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.506+0000 7fbce8fff700 1 -- start start 2023-07-27T14:27:44.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.507+0000 7fbce8fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbce4151bd0 0x7fbce4062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.507+0000 7fbce8fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.507+0000 7fbce8fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40639d0 con 0x7fbce4062810 2023-07-27T14:27:44.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.507+0000 7fbce8fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce4137610 con 0x7fbce4151bd0 2023-07-27T14:27:44.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.507+0000 7fbce8fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4062dc0 con 0x7fbce40a4f50 2023-07-27T14:27:44.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce2d9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce1d9b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fbce4062810 0x7fbce40a4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:47888/0 (socket says 172.21.15.115:47888) 2023-07-27T14:27:44.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce1d9b700 1 -- 172.21.15.115:0/1733129560 learned_addr learned my addr 172.21.15.115:0/1733129560 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:44.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce259c700 1 --2- 172.21.15.115:0/1733129560 >> v2:172.21.15.159:3300/0 conn(0x7fbce4151bd0 0x7fbce4062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce159a700 1 -- 172.21.15.115:0/1733129560 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035555417 0 0) 0x7fbce40639d0 con 0x7fbce4062810 2023-07-27T14:27:44.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce2d9d700 1 -- 172.21.15.115:0/1733129560 >> v2:172.21.15.159:3300/0 conn(0x7fbce4151bd0 msgr2=0x7fbce4062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:44.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce2d9d700 1 --2- 172.21.15.115:0/1733129560 >> v2:172.21.15.159:3300/0 conn(0x7fbce4151bd0 0x7fbce4062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce2d9d700 1 -- 172.21.15.115:0/1733129560 >> v1:172.21.15.159:6789/0 conn(0x7fbce4062810 legacy=0x7fbce40a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.508+0000 7fbce2d9d700 1 -- 172.21.15.115:0/1733129560 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40630a0 con 0x7fbce40a4f50 2023-07-27T14:27:44.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce2d9d700 1 --2- 172.21.15.115:0/1733129560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40bc050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbcdc009e60 tx=0x7fbcdc009780).ready entity=mon.2 client_cookie=24bbe342c39b61b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce159a700 1 -- 172.21.15.115:0/1733129560 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00e070 con 0x7fbce40a4f50 2023-07-27T14:27:44.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce159a700 1 -- 172.21.15.115:0/1733129560 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00bb60 con 0x7fbce40a4f50 2023-07-27T14:27:44.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce159a700 1 -- 172.21.15.115:0/1733129560 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc012410 con 0x7fbce40a4f50 2023-07-27T14:27:44.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce8fff700 1 -- 172.21.15.115:0/1733129560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 msgr2=0x7fbce40bc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce8fff700 1 --2- 172.21.15.115:0/1733129560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40bc050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbcdc009e60 tx=0x7fbcdc009780).stop 2023-07-27T14:27:44.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce8fff700 1 -- 172.21.15.115:0/1733129560 shutdown_connections 2023-07-27T14:27:44.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce8fff700 1 --2- 172.21.15.115:0/1733129560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40bc050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.509+0000 7fbce8fff700 1 --2- 172.21.15.115:0/1733129560 >> v2:172.21.15.159:3300/0 conn(0x7fbce4151bd0 0x7fbce4062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.510+0000 7fbce8fff700 1 -- 172.21.15.115:0/1733129560 >> 172.21.15.115:0/1733129560 conn(0x7fbce4064700 msgr2=0x7fbce4064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:44.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.510+0000 7fbce8fff700 1 -- 172.21.15.115:0/1733129560 shutdown_connections 2023-07-27T14:27:44.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.510+0000 7fbce8fff700 1 -- 172.21.15.115:0/1733129560 wait complete. 2023-07-27T14:27:44.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.511+0000 7fbce8fff700 1 Processor -- start 2023-07-27T14:27:44.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.511+0000 7fbce8fff700 1 -- start start 2023-07-27T14:27:44.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce8fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce4062810 0x7fbce4133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce8fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce8fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce4151bd0 0x7fbce40c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce8fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40c5610 con 0x7fbce4151bd0 2023-07-27T14:27:44.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce8fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40be880 con 0x7fbce4062810 2023-07-27T14:27:44.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce8fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4152ea0 con 0x7fbce40a4f50 2023-07-27T14:27:44.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce4151bd0 0x7fbce40c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce4151bd0 0x7fbce40c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46976/0 (socket says 172.21.15.115:46976) 2023-07-27T14:27:44.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce2d9d700 1 -- 172.21.15.115:0/23754736 learned_addr learned my addr 172.21.15.115:0/23754736 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:44.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce259c700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce4062810 0x7fbce4133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.512+0000 7fbce1d9b700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce2d9d700 1 -- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 msgr2=0x7fbce40c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce2d9d700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce2d9d700 1 -- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce4062810 msgr2=0x7fbce4133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce2d9d700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce4062810 0x7fbce4133cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce2d9d700 1 -- 172.21.15.115:0/23754736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009a20 con 0x7fbce4151bd0 2023-07-27T14:27:44.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce259c700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce4062810 0x7fbce4133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:44.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce2d9d700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce4151bd0 0x7fbce40c5120 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fbce4062f00 tx=0x7fbcdc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbcd27fc700 1 -- 172.21.15.115:0/23754736 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00b6f0 con 0x7fbce4151bd0 2023-07-27T14:27:44.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbcd27fc700 1 -- 172.21.15.115:0/23754736 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc01d630 con 0x7fbce4151bd0 2023-07-27T14:27:44.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce4153180 con 0x7fbce4151bd0 2023-07-27T14:27:44.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbcd27fc700 1 -- 172.21.15.115:0/23754736 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc01d9d0 con 0x7fbce4151bd0 2023-07-27T14:27:44.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.513+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce40be510 con 0x7fbce4151bd0 2023-07-27T14:27:44.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.514+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce40bea10 con 0x7fbce4151bd0 2023-07-27T14:27:44.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.515+0000 7fbcd27fc700 1 -- 172.21.15.115:0/23754736 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fbcdc026410 con 0x7fbce4151bd0 2023-07-27T14:27:44.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.516+0000 7fbcd27fc700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbcc405edc0 0x7fbcc4061280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.516+0000 7fbcd27fc700 1 -- 172.21.15.115:0/23754736 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbcdc07bf40 con 0x7fbce4151bd0 2023-07-27T14:27:44.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.516+0000 7fbce259c700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbcc405edc0 0x7fbcc4061280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.517+0000 7fbce259c700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbcc405edc0 0x7fbcc4061280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fbce4135dc0 tx=0x7fbcd4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.520+0000 7fbcd27fc700 1 -- 172.21.15.115:0/23754736 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbcdc04d370 con 0x7fbce4151bd0 2023-07-27T14:27:44.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.732+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbce40c6c30 con 0x7fbce4151bd0 2023-07-27T14:27:44.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.732+0000 7fbcd27fc700 1 -- 172.21.15.115:0/23754736 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4492 (secure 0 0 0) 0x7fbcdc050990 con 0x7fbce4151bd0 2023-07-27T14:27:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:44.750 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:27:01.252698+0000","modified":"2023-07-27T14:27:04.264437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-07-27T14:27:44.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbcc405edc0 msgr2=0x7fbcc4061280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbcc405edc0 0x7fbcc4061280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fbce4135dc0 tx=0x7fbcd4009060).stop 2023-07-27T14:27:44.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce4151bd0 msgr2=0x7fbce40c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce4151bd0 0x7fbce40c5120 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fbce4062f00 tx=0x7fbcdc009780).stop 2023-07-27T14:27:44.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 shutdown_connections 2023-07-27T14:27:44.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbcc405edc0 0x7fbcc4061280 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbce4151bd0 0x7fbce40c5120 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce4062810 0x7fbce4133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 --2- 172.21.15.115:0/23754736 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbce40a4f50 0x7fbce40c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 >> 172.21.15.115:0/23754736 conn(0x7fbce4064700 msgr2=0x7fbce40bc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:44.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 shutdown_connections 2023-07-27T14:27:44.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.735+0000 7fbce8fff700 1 -- 172.21.15.115:0/23754736 wait complete. 2023-07-27T14:27:44.753 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 7 2023-07-27T14:27:44.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:44.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.940+0000 7f10ba9ff700 1 Processor -- start 2023-07-27T14:27:44.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.940+0000 7f10ba9ff700 1 -- start start 2023-07-27T14:27:44.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10ba9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10b4153ec0 0x7f10b40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10ba9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f10b40aaa40 0x7f10b40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10ba9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b40aa4d0 con 0x7f10b40aa050 2023-07-27T14:27:44.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10ba9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b40c05c0 con 0x7f10b4153ec0 2023-07-27T14:27:44.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10ba9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b40bfc90 con 0x7f10b40aaa40 2023-07-27T14:27:44.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10b4153ec0 0x7f10b40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10b4153ec0 0x7f10b40a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46984/0 (socket says 172.21.15.115:46984) 2023-07-27T14:27:44.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b3fff700 1 -- 172.21.15.115:0/3346158569 learned_addr learned my addr 172.21.15.115:0/3346158569 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:44.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b8f9c700 1 --2- 172.21.15.115:0/3346158569 >> v2:172.21.15.159:3300/0 conn(0x7f10b40aaa40 0x7f10b40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b3fff700 1 -- 172.21.15.115:0/3346158569 >> v2:172.21.15.159:3300/0 conn(0x7f10b40aaa40 msgr2=0x7f10b40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:44.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b3fff700 1 --2- 172.21.15.115:0/3346158569 >> v2:172.21.15.159:3300/0 conn(0x7f10b40aaa40 0x7f10b40c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b3fff700 1 -- 172.21.15.115:0/3346158569 >> v1:172.21.15.159:6789/0 conn(0x7f10b40aa050 legacy=0x7f10b40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:44.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b3fff700 1 -- 172.21.15.115:0/3346158569 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40bff70 con 0x7f10b4153ec0 2023-07-27T14:27:44.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.942+0000 7f10b8f9c700 1 --2- 172.21.15.115:0/3346158569 >> v2:172.21.15.159:3300/0 conn(0x7f10b40aaa40 0x7f10b40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:44.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10b3fff700 1 --2- 172.21.15.115:0/3346158569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b4153ec0 0x7f10b40a9b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f10b40c5470 tx=0x7f10a40090f0).ready entity=mon.0 client_cookie=aa1a555225485b60 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10b2ffd700 1 -- 172.21.15.115:0/3346158569 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a400b5a0 con 0x7f10b4153ec0 2023-07-27T14:27:44.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10b2ffd700 1 -- 172.21.15.115:0/3346158569 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a400b700 con 0x7f10b4153ec0 2023-07-27T14:27:44.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10b2ffd700 1 -- 172.21.15.115:0/3346158569 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a400ba80 con 0x7f10b4153ec0 2023-07-27T14:27:44.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10ba9ff700 1 -- 172.21.15.115:0/3346158569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b4153ec0 msgr2=0x7f10b40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/3346158569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b4153ec0 0x7f10b40a9b60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f10b40c5470 tx=0x7f10a40090f0).stop 2023-07-27T14:27:44.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10ba9ff700 1 -- 172.21.15.115:0/3346158569 shutdown_connections 2023-07-27T14:27:44.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/3346158569 >> v2:172.21.15.159:3300/0 conn(0x7f10b40aaa40 0x7f10b40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/3346158569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b4153ec0 0x7f10b40a9b60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.943+0000 7f10ba9ff700 1 -- 172.21.15.115:0/3346158569 >> 172.21.15.115:0/3346158569 conn(0x7f10b40cb610 msgr2=0x7f10b40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:44.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.944+0000 7f10ba9ff700 1 -- 172.21.15.115:0/3346158569 shutdown_connections 2023-07-27T14:27:44.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.944+0000 7f10ba9ff700 1 -- 172.21.15.115:0/3346158569 wait complete. 2023-07-27T14:27:44.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.945+0000 7f10ba9ff700 1 Processor -- start 2023-07-27T14:27:44.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.945+0000 7f10ba9ff700 1 -- start start 2023-07-27T14:27:44.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10ba9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b40aa050 0x7f10b414ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10ba9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10b40aaa40 0x7f10b4165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10ba9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10b4153ec0 0x7f10b40ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10ba9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b414f180 con 0x7f10b40aa050 2023-07-27T14:27:44.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10ba9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4150140 con 0x7f10b40aaa40 2023-07-27T14:27:44.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10ba9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b41509e0 con 0x7f10b4153ec0 2023-07-27T14:27:44.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10b3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b40aa050 0x7f10b414ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10b3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b40aa050 0x7f10b414ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46992/0 (socket says 172.21.15.115:46992) 2023-07-27T14:27:44.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10b3fff700 1 -- 172.21.15.115:0/715665642 learned_addr learned my addr 172.21.15.115:0/715665642 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:44.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10b37fe700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10b40aaa40 0x7f10b4165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.946+0000 7f10b8f9c700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10b4153ec0 0x7f10b40ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f10b3fff700 1 -- 172.21.15.115:0/715665642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10b4153ec0 msgr2=0x7f10b40ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f10b3fff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10b4153ec0 0x7f10b40ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f10b3fff700 1 -- 172.21.15.115:0/715665642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10b40aaa40 msgr2=0x7f10b4165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:44.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f10b3fff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10b40aaa40 0x7f10b4165240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:44.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f10b3fff700 1 -- 172.21.15.115:0/715665642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a4009370 con 0x7f10b40aa050 2023-07-27T14:27:44.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f10b3fff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b40aa050 0x7f10b414ec90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f10b4060760 tx=0x7f10a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f109bfff700 1 -- 172.21.15.115:0/715665642 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a400b870 con 0x7f10b40aa050 2023-07-27T14:27:44.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f109bfff700 1 -- 172.21.15.115:0/715665642 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a400b9d0 con 0x7f10b40aa050 2023-07-27T14:27:44.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b4164ec0 con 0x7f10b40aa050 2023-07-27T14:27:44.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f109bfff700 1 -- 172.21.15.115:0/715665642 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a401b660 con 0x7f10b40aa050 2023-07-27T14:27:44.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.947+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b4150670 con 0x7f10b40aa050 2023-07-27T14:27:44.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.948+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b406c470 con 0x7f10b40aa050 2023-07-27T14:27:44.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.949+0000 7f109bfff700 1 -- 172.21.15.115:0/715665642 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f10a402b070 con 0x7f10b40aa050 2023-07-27T14:27:44.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.950+0000 7f109bfff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a005ed60 0x7f10a0061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:44.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.950+0000 7f109bfff700 1 -- 172.21.15.115:0/715665642 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f10a407b420 con 0x7f10b40aa050 2023-07-27T14:27:44.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.950+0000 7f10b37fe700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a005ed60 0x7f10a0061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:44.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.951+0000 7f10b37fe700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a005ed60 0x7f10a0061220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f10b4161c90 tx=0x7f10a8007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:44.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:44.954+0000 7f109bfff700 1 -- 172.21.15.115:0/715665642 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10a404c960 con 0x7f10b40aa050 2023-07-27T14:27:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.123+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10b40aa4d0 con 0x7f10b40aa050 2023-07-27T14:27:45.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.124+0000 7f109bfff700 1 -- 172.21.15.115:0/715665642 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f10b40aa4d0 con 0x7f10b40aa050 2023-07-27T14:27:45.141 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:45.141 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:45.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a005ed60 msgr2=0x7f10a0061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a005ed60 0x7f10a0061220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f10b4161c90 tx=0x7f10a8007d20).stop 2023-07-27T14:27:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b40aa050 msgr2=0x7f10b414ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b40aa050 0x7f10b414ec90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f10b4060760 tx=0x7f10a4015000).stop 2023-07-27T14:27:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 shutdown_connections 2023-07-27T14:27:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a005ed60 0x7f10a0061220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10b4153ec0 0x7f10b40ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10b40aa050 0x7f10b414ec90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 --2- 172.21.15.115:0/715665642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10b40aaa40 0x7f10b4165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 >> 172.21.15.115:0/715665642 conn(0x7f10b40cb610 msgr2=0x7f10b40ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 shutdown_connections 2023-07-27T14:27:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.126+0000 7f10ba9ff700 1 -- 172.21.15.115:0/715665642 wait complete. 2023-07-27T14:27:45.160 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:27:45.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:27:45.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.330+0000 7fe30dbff700 1 Processor -- start 2023-07-27T14:27:45.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.330+0000 7fe30dbff700 1 -- start start 2023-07-27T14:27:45.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.331+0000 7fe30dbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3080aaa40 0x7fe3080640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.331+0000 7fe30dbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe3081542a0 0x7fe3080645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.331+0000 7fe30dbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3080aa4d0 con 0x7fe308153ec0 2023-07-27T14:27:45.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.331+0000 7fe30dbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe308064ad0 con 0x7fe3080aaa40 2023-07-27T14:27:45.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.331+0000 7fe30dbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3080c05c0 con 0x7fe3081542a0 2023-07-27T14:27:45.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.332+0000 7fe306ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3080aaa40 0x7fe3080640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.332+0000 7fe306ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3080aaa40 0x7fe3080640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47006/0 (socket says 172.21.15.115:47006) 2023-07-27T14:27:45.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.332+0000 7fe306ffd700 1 -- 172.21.15.115:0/632465650 learned_addr learned my addr 172.21.15.115:0/632465650 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:45.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.332+0000 7fe306ffd700 1 -- 172.21.15.115:0/632465650 >> v2:172.21.15.159:3300/0 conn(0x7fe3081542a0 msgr2=0x7fe3080645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:45.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.332+0000 7fe306ffd700 1 --2- 172.21.15.115:0/632465650 >> v2:172.21.15.159:3300/0 conn(0x7fe3081542a0 0x7fe3080645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:45.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.332+0000 7fe306ffd700 1 -- 172.21.15.115:0/632465650 >> v1:172.21.15.159:6789/0 conn(0x7fe308153ec0 legacy=0x7fe3080a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:45.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.332+0000 7fe306ffd700 1 -- 172.21.15.115:0/632465650 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080c1a60 con 0x7fe3080aaa40 2023-07-27T14:27:45.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.332+0000 7fe306ffd700 1 --2- 172.21.15.115:0/632465650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe3080640f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fe3080c5470 tx=0x7fe2fc0090f0).ready entity=mon.0 client_cookie=fec9b24edc8fcf52 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:45.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe3067fc700 1 -- 172.21.15.115:0/632465650 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00b5a0 con 0x7fe3080aaa40 2023-07-27T14:27:45.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe3067fc700 1 -- 172.21.15.115:0/632465650 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00b700 con 0x7fe3080aaa40 2023-07-27T14:27:45.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe3067fc700 1 -- 172.21.15.115:0/632465650 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00ba80 con 0x7fe3080aaa40 2023-07-27T14:27:45.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe30dbff700 1 -- 172.21.15.115:0/632465650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 msgr2=0x7fe3080640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe30dbff700 1 --2- 172.21.15.115:0/632465650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe3080640f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fe3080c5470 tx=0x7fe2fc0090f0).stop 2023-07-27T14:27:45.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe30dbff700 1 -- 172.21.15.115:0/632465650 shutdown_connections 2023-07-27T14:27:45.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe30dbff700 1 --2- 172.21.15.115:0/632465650 >> v2:172.21.15.159:3300/0 conn(0x7fe3081542a0 0x7fe3080645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:45.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe30dbff700 1 --2- 172.21.15.115:0/632465650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe3080640f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe30dbff700 1 -- 172.21.15.115:0/632465650 >> 172.21.15.115:0/632465650 conn(0x7fe3080cb610 msgr2=0x7fe3080c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:45.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe30dbff700 1 -- 172.21.15.115:0/632465650 shutdown_connections 2023-07-27T14:27:45.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.333+0000 7fe30dbff700 1 -- 172.21.15.115:0/632465650 wait complete. 2023-07-27T14:27:45.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.335+0000 7fe30dbff700 1 Processor -- start 2023-07-27T14:27:45.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.335+0000 7fe30dbff700 1 -- start start 2023-07-27T14:27:45.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe30dbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe30814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe30dbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe308153ec0 0x7fe3080c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe30dbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3081542a0 0x7fe3080ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe30dbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080ca0f0 con 0x7fe3080aaa40 2023-07-27T14:27:45.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe30dbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080c9660 con 0x7fe308153ec0 2023-07-27T14:27:45.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe30dbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080b0be0 con 0x7fe3081542a0 2023-07-27T14:27:45.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe3077fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe30814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe3077fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe30814d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47018/0 (socket says 172.21.15.115:47018) 2023-07-27T14:27:45.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe3077fe700 1 -- 172.21.15.115:0/4152981208 learned_addr learned my addr 172.21.15.115:0/4152981208 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:45.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe306ffd700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe308153ec0 0x7fe3080c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe307fff700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3081542a0 0x7fe3080ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe3077fe700 1 -- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3081542a0 msgr2=0x7fe3080ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe3077fe700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3081542a0 0x7fe3080ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe3077fe700 1 -- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe308153ec0 msgr2=0x7fe3080c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe3077fe700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe308153ec0 0x7fe3080c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe3077fe700 1 -- 172.21.15.115:0/4152981208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc009370 con 0x7fe3080aaa40 2023-07-27T14:27:45.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe307fff700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3081542a0 0x7fe3080ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:45.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.336+0000 7fe306ffd700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe308153ec0 0x7fe3080c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:45.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.337+0000 7fe3077fe700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe30814d310 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fe2f800b490 tx=0x7fe2f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:45.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.337+0000 7fe2ef7fe700 1 -- 172.21.15.115:0/4152981208 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8012410 con 0x7fe3080aaa40 2023-07-27T14:27:45.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.337+0000 7fe2ef7fe700 1 -- 172.21.15.115:0/4152981208 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f80125b0 con 0x7fe3080aaa40 2023-07-27T14:27:45.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.337+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe308154eb0 con 0x7fe3080aaa40 2023-07-27T14:27:45.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.337+0000 7fe2ef7fe700 1 -- 172.21.15.115:0/4152981208 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8012970 con 0x7fe3080aaa40 2023-07-27T14:27:45.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.337+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3080c9b30 con 0x7fe3080aaa40 2023-07-27T14:27:45.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.338+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30806c470 con 0x7fe3080aaa40 2023-07-27T14:27:45.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.339+0000 7fe2ef7fe700 1 -- 172.21.15.115:0/4152981208 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe2f800f030 con 0x7fe3080aaa40 2023-07-27T14:27:45.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.339+0000 7fe2ef7fe700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2f405ed90 0x7fe2f4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.339+0000 7fe2ef7fe700 1 -- 172.21.15.115:0/4152981208 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe2f80797a0 con 0x7fe3080aaa40 2023-07-27T14:27:45.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.340+0000 7fe306ffd700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2f405ed90 0x7fe2f4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.340+0000 7fe306ffd700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2f405ed90 0x7fe2f4061250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe3080aae20 tx=0x7fe2fc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:45.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.343+0000 7fe2ef7fe700 1 -- 172.21.15.115:0/4152981208 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe2f804ad40 con 0x7fe3080aaa40 2023-07-27T14:27:45.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.551+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3080c8230 con 0x7fe3080aaa40 2023-07-27T14:27:45.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.552+0000 7fe2ef7fe700 1 -- 172.21.15.115:0/4152981208 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4492 (secure 0 0 0) 0x7fe2f804e360 con 0x7fe3080aaa40 2023-07-27T14:27:45.569 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:45.569 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:27:01.252698+0000","modified":"2023-07-27T14:27:04.264437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-07-27T14:27:45.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.553+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2f405ed90 msgr2=0x7fe2f4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.553+0000 7fe30dbff700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2f405ed90 0x7fe2f4061250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe3080aae20 tx=0x7fe2fc015000).stop 2023-07-27T14:27:45.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 msgr2=0x7fe30814d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe30814d310 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fe2f800b490 tx=0x7fe2f8009060).stop 2023-07-27T14:27:45.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 shutdown_connections 2023-07-27T14:27:45.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2f405ed90 0x7fe2f4061250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3081542a0 0x7fe3080ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3080aaa40 0x7fe30814d310 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 --2- 172.21.15.115:0/4152981208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe308153ec0 0x7fe3080c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 >> 172.21.15.115:0/4152981208 conn(0x7fe3080cb610 msgr2=0x7fe3080ab990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:45.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 shutdown_connections 2023-07-27T14:27:45.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.554+0000 7fe30dbff700 1 -- 172.21.15.115:0/4152981208 wait complete. 2023-07-27T14:27:45.574 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 7 2023-07-27T14:27:45.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:27:45.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.760+0000 7fb2ce9ff700 1 Processor -- start 2023-07-27T14:27:45.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.760+0000 7fb2ce9ff700 1 -- start start 2023-07-27T14:27:45.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.761+0000 7fb2ce9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c8153ec0 0x7fb2c80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.761+0000 7fb2ce9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb2c80aa050 0x7fb2c80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.761+0000 7fb2ce9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2c80aaa40 0x7fb2c80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.761+0000 7fb2ce9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c8064ad0 con 0x7fb2c80aaa40 2023-07-27T14:27:45.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.761+0000 7fb2ce9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c80aa4d0 con 0x7fb2c80aa050 2023-07-27T14:27:45.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.761+0000 7fb2ce9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80c05c0 con 0x7fb2c8153ec0 2023-07-27T14:27:45.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2c80aaa40 0x7fb2c80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb2c80aaa40 0x7fb2c80645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47026/0 (socket says 172.21.15.115:47026) 2023-07-27T14:27:45.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 -- 172.21.15.115:0/2606573171 learned_addr learned my addr 172.21.15.115:0/2606573171 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:45.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2c7fff700 1 --2- 172.21.15.115:0/2606573171 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c8153ec0 0x7fb2c80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2c77fe700 1 --2- 172.21.15.115:0/2606573171 >> v2:172.21.15.159:3300/0 conn(0x7fb2c80aa050 0x7fb2c80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 -- 172.21.15.115:0/2606573171 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c8153ec0 msgr2=0x7fb2c80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:45.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 --2- 172.21.15.115:0/2606573171 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c8153ec0 0x7fb2c80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 -- 172.21.15.115:0/2606573171 >> v2:172.21.15.159:3300/0 conn(0x7fb2c80aa050 msgr2=0x7fb2c80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:45.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 --2- 172.21.15.115:0/2606573171 >> v2:172.21.15.159:3300/0 conn(0x7fb2c80aa050 0x7fb2c80640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 -- 172.21.15.115:0/2606573171 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c80bfc90 con 0x7fb2c80aaa40 2023-07-27T14:27:45.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2ccf9c700 1 --2- 172.21.15.115:0/2606573171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c80aaa40 0x7fb2c80645e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fb2c805f080 tx=0x7fb2c0009840).ready entity=mon.0 client_cookie=8492927553528859 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:45.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2c6ffd700 1 -- 172.21.15.115:0/2606573171 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000e070 con 0x7fb2c80aaa40 2023-07-27T14:27:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2c6ffd700 1 -- 172.21.15.115:0/2606573171 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c000ba50 con 0x7fb2c80aaa40 2023-07-27T14:27:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.762+0000 7fb2c6ffd700 1 -- 172.21.15.115:0/2606573171 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000bdd0 con 0x7fb2c80aaa40 2023-07-27T14:27:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2606573171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c80aaa40 msgr2=0x7fb2c80645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2606573171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c80aaa40 0x7fb2c80645e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fb2c805f080 tx=0x7fb2c0009840).stop 2023-07-27T14:27:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2606573171 shutdown_connections 2023-07-27T14:27:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2606573171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c80aaa40 0x7fb2c80645e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2606573171 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c8153ec0 0x7fb2c80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2606573171 >> v2:172.21.15.159:3300/0 conn(0x7fb2c80aa050 0x7fb2c80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2606573171 >> 172.21.15.115:0/2606573171 conn(0x7fb2c80cb610 msgr2=0x7fb2c80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:45.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2606573171 shutdown_connections 2023-07-27T14:27:45.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.763+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2606573171 wait complete. 2023-07-27T14:27:45.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.764+0000 7fb2ce9ff700 1 Processor -- start 2023-07-27T14:27:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.765+0000 7fb2ce9ff700 1 -- start start 2023-07-27T14:27:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.765+0000 7fb2ce9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c80aa050 0x7fb2c814e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ce9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c80aaa40 0x7fb2c8150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ce9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c8153ec0 0x7fb2c8151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ce9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c81508a0 con 0x7fb2c8153ec0 2023-07-27T14:27:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ce9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c80afc40 con 0x7fb2c80aa050 2023-07-27T14:27:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ce9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c8150570 con 0x7fb2c80aaa40 2023-07-27T14:27:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c8153ec0 0x7fb2c8151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c8153ec0 0x7fb2c8151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47036/0 (socket says 172.21.15.115:47036) 2023-07-27T14:27:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 -- 172.21.15.115:0/2549436326 learned_addr learned my addr 172.21.15.115:0/2549436326 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2c77fe700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c80aaa40 0x7fb2c8150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 -- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c80aaa40 msgr2=0x7fb2c8150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2c7fff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c80aa050 0x7fb2c814e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c80aaa40 0x7fb2c8150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 -- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c80aa050 msgr2=0x7fb2c814e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c80aa050 0x7fb2c814e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 -- 172.21.15.115:0/2549436326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0009ae0 con 0x7fb2c8153ec0 2023-07-27T14:27:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2c77fe700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c80aaa40 0x7fb2c8150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2c7fff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c80aa050 0x7fb2c814e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:27:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.766+0000 7fb2ccf9c700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c8153ec0 0x7fb2c8151220 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fb2c8060760 tx=0x7fb2c0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.767+0000 7fb2affff700 1 -- 172.21.15.115:0/2549436326 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0013e60 con 0x7fb2c8153ec0 2023-07-27T14:27:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.767+0000 7fb2affff700 1 -- 172.21.15.115:0/2549436326 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c0009500 con 0x7fb2c8153ec0 2023-07-27T14:27:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.767+0000 7fb2affff700 1 -- 172.21.15.115:0/2549436326 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c001e6c0 con 0x7fb2c8153ec0 2023-07-27T14:27:45.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.767+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c80b0a10 con 0x7fb2c8153ec0 2023-07-27T14:27:45.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.767+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c80af960 con 0x7fb2c8153ec0 2023-07-27T14:27:45.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.768+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c806c470 con 0x7fb2c8153ec0 2023-07-27T14:27:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.769+0000 7fb2affff700 1 -- 172.21.15.115:0/2549436326 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb2c0025030 con 0x7fb2c8153ec0 2023-07-27T14:27:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.769+0000 7fb2affff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2b405ed90 0x7fb2b4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.770+0000 7fb2affff700 1 -- 172.21.15.115:0/2549436326 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb2c007b1b0 con 0x7fb2c8153ec0 2023-07-27T14:27:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.770+0000 7fb2c7fff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2b405ed90 0x7fb2b4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.770+0000 7fb2c7fff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2b405ed90 0x7fb2b4061250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb2b8009810 tx=0x7fb2b8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.774+0000 7fb2affff700 1 -- 172.21.15.115:0/2549436326 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2c004c800 con 0x7fb2c8153ec0 2023-07-27T14:27:45.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.982+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2c81509e0 con 0x7fb2c8153ec0 2023-07-27T14:27:45.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.982+0000 7fb2affff700 1 -- 172.21.15.115:0/2549436326 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4492 (secure 0 0 0) 0x7fb2c0023070 con 0x7fb2c8153ec0 2023-07-27T14:27:45.999 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:45.999 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/552493815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":552493815},{"type":"v1","addr":"172.21.15.115:6835","nonce":552493815}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3769525623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3769525623},{"type":"v1","addr":"172.21.15.115:6837","nonce":3769525623}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1221875948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1221875948},{"type":"v1","addr":"172.21.15.159:6834","nonce":1221875948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:27:01.252698+0000","modified":"2023-07-27T14:27:04.264437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6835/3004855447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3004855447},{"type":"v1","addr":"172.21.15.159:6835","nonce":3004855447}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-07-27T14:27:46.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2b405ed90 msgr2=0x7fb2b4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2b405ed90 0x7fb2b4061250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fb2b8009810 tx=0x7fb2b8008040).stop 2023-07-27T14:27:46.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c8153ec0 msgr2=0x7fb2c8151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c8153ec0 0x7fb2c8151220 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fb2c8060760 tx=0x7fb2c0009840).stop 2023-07-27T14:27:46.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 shutdown_connections 2023-07-27T14:27:46.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2b405ed90 0x7fb2b4061250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c8153ec0 0x7fb2c8151220 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c80aa050 0x7fb2c814e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 --2- 172.21.15.115:0/2549436326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2c80aaa40 0x7fb2c8150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 >> 172.21.15.115:0/2549436326 conn(0x7fb2c80cb610 msgr2=0x7fb2c80c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:46.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 shutdown_connections 2023-07-27T14:27:46.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:45.985+0000 7fb2ce9ff700 1 -- 172.21.15.115:0/2549436326 wait complete. 2023-07-27T14:27:46.003 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 7 2023-07-27T14:27:46.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:27:46.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.189+0000 7fe6bf7ff700 1 Processor -- start 2023-07-27T14:27:46.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.189+0000 7fe6bf7ff700 1 -- start start 2023-07-27T14:27:46.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.190+0000 7fe6bf7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe6b8065ff0 0x7fe6b8066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.190+0000 7fe6bf7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8066960 0x7fe6b8067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.190+0000 7fe6bf7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b8067080 con 0x7fe6b8151d70 2023-07-27T14:27:46.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.190+0000 7fe6bf7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b8063a90 con 0x7fe6b8065ff0 2023-07-27T14:27:46.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.190+0000 7fe6bf7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8066df0 con 0x7fe6b8066960 2023-07-27T14:27:46.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bdd9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8066960 0x7fe6b8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bdd9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8066960 0x7fe6b8067560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:49280/0 (socket says 172.21.15.115:49280) 2023-07-27T14:27:46.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bdd9c700 1 -- 172.21.15.115:0/1555545653 learned_addr learned my addr 172.21.15.115:0/1555545653 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:46.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bcd9a700 1 --2- 172.21.15.115:0/1555545653 >> v2:172.21.15.159:3300/0 conn(0x7fe6b8065ff0 0x7fe6b8066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bcd9a700 1 -- 172.21.15.115:0/1555545653 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8066960 msgr2=0x7fe6b8067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:46.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bcd9a700 1 --2- 172.21.15.115:0/1555545653 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8066960 0x7fe6b8067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bcd9a700 1 -- 172.21.15.115:0/1555545653 >> v1:172.21.15.159:6789/0 conn(0x7fe6b8151d70 legacy=0x7fe6b8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bcd9a700 1 -- 172.21.15.115:0/1555545653 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b80634d0 con 0x7fe6b8065ff0 2023-07-27T14:27:46.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6affff700 1 -- 172.21.15.115:0/1555545653 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165820529 0 0) 0x7fe6b8067080 con 0x7fe6b8151d70 2023-07-27T14:27:46.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.191+0000 7fe6bdd9c700 1 --2- 172.21.15.115:0/1555545653 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8066960 0x7fe6b8067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:46.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6bcd9a700 1 --2- 172.21.15.115:0/1555545653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8065ff0 0x7fe6b8066470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe6a8009760 tx=0x7fe6a8009060).ready entity=mon.1 client_cookie=39e230b6fa507892 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:46.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6affff700 1 -- 172.21.15.115:0/1555545653 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800f510 con 0x7fe6b8065ff0 2023-07-27T14:27:46.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6affff700 1 -- 172.21.15.115:0/1555545653 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a800f670 con 0x7fe6b8065ff0 2023-07-27T14:27:46.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6affff700 1 -- 172.21.15.115:0/1555545653 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800f9f0 con 0x7fe6b8065ff0 2023-07-27T14:27:46.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/1555545653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8065ff0 msgr2=0x7fe6b8066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/1555545653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8065ff0 0x7fe6b8066470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fe6a8009760 tx=0x7fe6a8009060).stop 2023-07-27T14:27:46.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/1555545653 shutdown_connections 2023-07-27T14:27:46.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/1555545653 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8066960 0x7fe6b8067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/1555545653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8065ff0 0x7fe6b8066470 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.192+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/1555545653 >> 172.21.15.115:0/1555545653 conn(0x7fe6b80c89a0 msgr2=0x7fe6b80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:46.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.193+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/1555545653 shutdown_connections 2023-07-27T14:27:46.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.193+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/1555545653 wait complete. 2023-07-27T14:27:46.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.194+0000 7fe6bf7ff700 1 Processor -- start 2023-07-27T14:27:46.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.194+0000 7fe6bf7ff700 1 -- start start 2023-07-27T14:27:46.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bf7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8065ff0 0x7fe6b80a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bf7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8066960 0x7fe6b80a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bf7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b8151d70 0x7fe6b80a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bf7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80a89c0 con 0x7fe6b8151d70 2023-07-27T14:27:46.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bf7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80a53b0 con 0x7fe6b8066960 2023-07-27T14:27:46.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bf7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80a61e0 con 0x7fe6b8065ff0 2023-07-27T14:27:46.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bdd9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b8151d70 0x7fe6b80a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bd59b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8065ff0 0x7fe6b80a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bdd9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b8151d70 0x7fe6b80a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47040/0 (socket says 172.21.15.115:47040) 2023-07-27T14:27:46.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bdd9c700 1 -- 172.21.15.115:0/2222454668 learned_addr learned my addr 172.21.15.115:0/2222454668 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:46.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.195+0000 7fe6bcd9a700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8066960 0x7fe6b80a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6bdd9c700 1 -- 172.21.15.115:0/2222454668 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8065ff0 msgr2=0x7fe6b80a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6bdd9c700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8065ff0 0x7fe6b80a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6bdd9c700 1 -- 172.21.15.115:0/2222454668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8066960 msgr2=0x7fe6b80a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6bdd9c700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8066960 0x7fe6b80a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6bdd9c700 1 -- 172.21.15.115:0/2222454668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b0009ae0 con 0x7fe6b8151d70 2023-07-27T14:27:46.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6bdd9c700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b8151d70 0x7fe6b80a84d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fe6b000c0c0 tx=0x7fe6b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:46.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6ad7fa700 1 -- 172.21.15.115:0/2222454668 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00092e0 con 0x7fe6b8151d70 2023-07-27T14:27:46.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6ad7fa700 1 -- 172.21.15.115:0/2222454668 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b000f040 con 0x7fe6b8151d70 2023-07-27T14:27:46.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a80092a0 con 0x7fe6b8151d70 2023-07-27T14:27:46.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.196+0000 7fe6ad7fa700 1 -- 172.21.15.115:0/2222454668 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b000cc00 con 0x7fe6b8151d70 2023-07-27T14:27:46.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.197+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b80a5680 con 0x7fe6b8151d70 2023-07-27T14:27:46.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.198+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b806c470 con 0x7fe6b8151d70 2023-07-27T14:27:46.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.198+0000 7fe6ad7fa700 1 -- 172.21.15.115:0/2222454668 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe6b001b030 con 0x7fe6b8151d70 2023-07-27T14:27:46.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.199+0000 7fe6ad7fa700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe69c05ed90 0x7fe69c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.199+0000 7fe6ad7fa700 1 -- 172.21.15.115:0/2222454668 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe6b0079af0 con 0x7fe6b8151d70 2023-07-27T14:27:46.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.200+0000 7fe6bd59b700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe69c05ed90 0x7fe69c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.200+0000 7fe6bd59b700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe69c05ed90 0x7fe69c061250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe6b4003830 tx=0x7fe6b4007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.203+0000 7fe6ad7fa700 1 -- 172.21.15.115:0/2222454668 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe6b004b030 con 0x7fe6b8151d70 2023-07-27T14:27:46.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.374+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6b80a6320 con 0x7fe6b8151d70 2023-07-27T14:27:46.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.375+0000 7fe6ad7fa700 1 -- 172.21.15.115:0/2222454668 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17072 (secure 0 0 0) 0x7fe6b004e650 con 0x7fe6b8151d70 2023-07-27T14:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:02.254762+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:26:59.286583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-27T14:27:00.228329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:27:46.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe69c05ed90 msgr2=0x7fe69c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe69c05ed90 0x7fe69c061250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe6b4003830 tx=0x7fe6b4007d40).stop 2023-07-27T14:27:46.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b8151d70 msgr2=0x7fe6b80a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b8151d70 0x7fe6b80a84d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fe6b000c0c0 tx=0x7fe6b000b040).stop 2023-07-27T14:27:46.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 shutdown_connections 2023-07-27T14:27:46.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe69c05ed90 0x7fe69c061250 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6b8151d70 0x7fe6b80a84d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6b8065ff0 0x7fe6b80a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 --2- 172.21.15.115:0/2222454668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6b8066960 0x7fe6b80a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 >> 172.21.15.115:0/2222454668 conn(0x7fe6b80c89a0 msgr2=0x7fe6b8067f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:46.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 shutdown_connections 2023-07-27T14:27:46.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.377+0000 7fe6bf7ff700 1 -- 172.21.15.115:0/2222454668 wait complete. 2023-07-27T14:27:46.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:27:46.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.586+0000 7f3b3edff700 1 Processor -- start 2023-07-27T14:27:46.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.586+0000 7f3b3edff700 1 -- start start 2023-07-27T14:27:46.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.587+0000 7f3b3edff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b380c0e80 0x7f3b38150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.587+0000 7f3b3edff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3b380a5e40 0x7f3b380c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.587+0000 7f3b3edff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3806a440 con 0x7f3b38150af0 2023-07-27T14:27:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.587+0000 7f3b3edff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b380bbc80 con 0x7f3b380c0e80 2023-07-27T14:27:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.587+0000 7f3b3edff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b38069e80 con 0x7f3b380a5e40 2023-07-27T14:27:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.588+0000 7f3b37fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b380c0e80 0x7f3b38150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.588+0000 7f3b37fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b380c0e80 0x7f3b38150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47054/0 (socket says 172.21.15.115:47054) 2023-07-27T14:27:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.588+0000 7f3b37fff700 1 -- 172.21.15.115:0/206123239 learned_addr learned my addr 172.21.15.115:0/206123239 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:46.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.588+0000 7f3b37fff700 1 -- 172.21.15.115:0/206123239 >> v2:172.21.15.159:3300/0 conn(0x7f3b380a5e40 msgr2=0x7f3b380c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.588+0000 7f3b37fff700 1 --2- 172.21.15.115:0/206123239 >> v2:172.21.15.159:3300/0 conn(0x7f3b380a5e40 0x7f3b380c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.588+0000 7f3b37fff700 1 -- 172.21.15.115:0/206123239 >> v1:172.21.15.159:6789/0 conn(0x7f3b38150af0 legacy=0x7f3b380a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.588+0000 7f3b37fff700 1 -- 172.21.15.115:0/206123239 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3806a160 con 0x7f3b380c0e80 2023-07-27T14:27:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.588+0000 7f3b37fff700 1 --2- 172.21.15.115:0/206123239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b380c0e80 0x7f3b38150ed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f3b38065210 tx=0x7f3b240090f0).ready entity=mon.0 client_cookie=7228992e4620d049 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b377fe700 1 -- 172.21.15.115:0/206123239 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400b5a0 con 0x7f3b380c0e80 2023-07-27T14:27:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b377fe700 1 -- 172.21.15.115:0/206123239 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400b700 con 0x7f3b380c0e80 2023-07-27T14:27:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b377fe700 1 -- 172.21.15.115:0/206123239 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400ba80 con 0x7f3b380c0e80 2023-07-27T14:27:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b3edff700 1 -- 172.21.15.115:0/206123239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b380c0e80 msgr2=0x7f3b38150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b3edff700 1 --2- 172.21.15.115:0/206123239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b380c0e80 0x7f3b38150ed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f3b38065210 tx=0x7f3b240090f0).stop 2023-07-27T14:27:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b3edff700 1 -- 172.21.15.115:0/206123239 shutdown_connections 2023-07-27T14:27:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b3edff700 1 --2- 172.21.15.115:0/206123239 >> v2:172.21.15.159:3300/0 conn(0x7f3b380a5e40 0x7f3b380c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b3edff700 1 --2- 172.21.15.115:0/206123239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b380c0e80 0x7f3b38150ed0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b3edff700 1 -- 172.21.15.115:0/206123239 >> 172.21.15.115:0/206123239 conn(0x7f3b38062320 msgr2=0x7f3b38062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b3edff700 1 -- 172.21.15.115:0/206123239 shutdown_connections 2023-07-27T14:27:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.589+0000 7f3b3edff700 1 -- 172.21.15.115:0/206123239 wait complete. 2023-07-27T14:27:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.591+0000 7f3b3edff700 1 Processor -- start 2023-07-27T14:27:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.591+0000 7f3b3edff700 1 -- start start 2023-07-27T14:27:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b380a5e40 0x7f3b381653f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3edff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b380c0e80 0x7f3b380bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3edff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b38150af0 0x7f3b380a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3edff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380bf130 con 0x7f3b38150af0 2023-07-27T14:27:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3edff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38164f60 con 0x7f3b380c0e80 2023-07-27T14:27:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380c00d0 con 0x7f3b380a5e40 2023-07-27T14:27:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b38150af0 0x7f3b380a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b38150af0 0x7f3b380a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47070/0 (socket says 172.21.15.115:47070) 2023-07-27T14:27:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3d39c700 1 -- 172.21.15.115:0/3613150287 learned_addr learned my addr 172.21.15.115:0/3613150287 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b37fff700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b380c0e80 0x7f3b380bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3cb9b700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b380a5e40 0x7f3b381653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3d39c700 1 -- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b380a5e40 msgr2=0x7f3b381653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3d39c700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b380a5e40 0x7f3b381653f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3d39c700 1 -- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b380c0e80 msgr2=0x7f3b380bfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3d39c700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b380c0e80 0x7f3b380bfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3d39c700 1 -- 172.21.15.115:0/3613150287 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009370 con 0x7f3b38150af0 2023-07-27T14:27:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.592+0000 7f3b3cb9b700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b380a5e40 0x7f3b381653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.593+0000 7f3b3d39c700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b38150af0 0x7f3b380a4840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f3b3000bb90 tx=0x7f3b30009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.593+0000 7f3b34ff9700 1 -- 172.21.15.115:0/3613150287 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000c8c0 con 0x7f3b38150af0 2023-07-27T14:27:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.593+0000 7f3b34ff9700 1 -- 172.21.15.115:0/3613150287 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3000ca40 con 0x7f3b38150af0 2023-07-27T14:27:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.593+0000 7f3b34ff9700 1 -- 172.21.15.115:0/3613150287 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000cbf0 con 0x7f3b38150af0 2023-07-27T14:27:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.593+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b380c0360 con 0x7f3b38150af0 2023-07-27T14:27:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.593+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b38164910 con 0x7f3b38150af0 2023-07-27T14:27:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.594+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b381650f0 con 0x7f3b38150af0 2023-07-27T14:27:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.595+0000 7f3b34ff9700 1 -- 172.21.15.115:0/3613150287 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f3b30015420 con 0x7f3b38150af0 2023-07-27T14:27:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.596+0000 7f3b34ff9700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b1c05ed90 0x7f3b1c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.596+0000 7f3b34ff9700 1 -- 172.21.15.115:0/3613150287 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3b30079f80 con 0x7f3b38150af0 2023-07-27T14:27:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.596+0000 7f3b3cb9b700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b1c05ed90 0x7f3b1c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.596+0000 7f3b3cb9b700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b1c05ed90 0x7f3b1c061250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3b2c00b8b0 tx=0x7f3b2c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.600+0000 7f3b34ff9700 1 -- 172.21.15.115:0/3613150287 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b3004b3b0 con 0x7f3b38150af0 2023-07-27T14:27:46.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:46.811+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3b381511a0 con 0x7f3b38150af0 2023-07-27T14:27:47.688 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:27:47.671+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:27:47.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.678+0000 7f3b34ff9700 1 -- 172.21.15.115:0/3613150287 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3b30009910 con 0x7f3b38150af0 2023-07-27T14:27:47.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b1c05ed90 msgr2=0x7f3b1c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:47.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b1c05ed90 0x7f3b1c061250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3b2c00b8b0 tx=0x7f3b2c008040).stop 2023-07-27T14:27:47.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b38150af0 msgr2=0x7f3b380a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:47.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b38150af0 0x7f3b380a4840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f3b3000bb90 tx=0x7f3b30009810).stop 2023-07-27T14:27:47.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 shutdown_connections 2023-07-27T14:27:47.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3b1c05ed90 0x7f3b1c061250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b38150af0 0x7f3b380a4840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b380a5e40 0x7f3b381653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 --2- 172.21.15.115:0/3613150287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b380c0e80 0x7f3b380bfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 >> 172.21.15.115:0/3613150287 conn(0x7f3b38062320 msgr2=0x7f3b380c1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:47.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 shutdown_connections 2023-07-27T14:27:47.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.681+0000 7f3b3edff700 1 -- 172.21.15.115:0/3613150287 wait complete. 2023-07-27T14:27:47.700 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:27:47.701 INFO:tasks.ceph.mds.b.smithi159.stderr: -2222> 2023-07-27T14:27:01.771+0000 7f0412ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:27:47.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:27:47.744 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:27:47.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.901+0000 7fcb2519d700 1 Processor -- start 2023-07-27T14:27:47.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.901+0000 7fcb2519d700 1 -- start start 2023-07-27T14:27:47.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.902+0000 7fcb2519d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200644d0 0x7fcb2014df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:47.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.902+0000 7fcb2519d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb2014e3f0 0x7fcb2015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:47.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.902+0000 7fcb2519d700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb20154500 con 0x7fcb200640f0 2023-07-27T14:27:47.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.902+0000 7fcb2519d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb201547e0 con 0x7fcb2014e3f0 2023-07-27T14:27:47.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.902+0000 7fcb2519d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20154ac0 con 0x7fcb200644d0 2023-07-27T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.902+0000 7fcb2499c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb2014e3f0 0x7fcb2015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb2499c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb2014e3f0 0x7fcb2015dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47078/0 (socket says 172.21.15.115:47078) 2023-07-27T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb2499c700 1 -- 172.21.15.115:0/3694839313 learned_addr learned my addr 172.21.15.115:0/3694839313 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb1f7fe700 1 --2- 172.21.15.115:0/3694839313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200644d0 0x7fcb2014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb2499c700 1 -- 172.21.15.115:0/3694839313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200644d0 msgr2=0x7fcb2014df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb2499c700 1 --2- 172.21.15.115:0/3694839313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200644d0 0x7fcb2014df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb2499c700 1 -- 172.21.15.115:0/3694839313 >> v1:172.21.15.159:6789/0 conn(0x7fcb200640f0 legacy=0x7fcb200c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb2499c700 1 -- 172.21.15.115:0/3694839313 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20154da0 con 0x7fcb2014e3f0 2023-07-27T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb2499c700 1 --2- 172.21.15.115:0/3694839313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb2014e3f0 0x7fcb2015dd60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fcb18009f20 tx=0x7fcb18009840).ready entity=mon.0 client_cookie=9624030653f798ee server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb1effd700 1 -- 172.21.15.115:0/3694839313 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800e070 con 0x7fcb2014e3f0 2023-07-27T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb1effd700 1 -- 172.21.15.115:0/3694839313 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800ba80 con 0x7fcb2014e3f0 2023-07-27T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.903+0000 7fcb1effd700 1 -- 172.21.15.115:0/3694839313 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800be00 con 0x7fcb2014e3f0 2023-07-27T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.904+0000 7fcb2519d700 1 -- 172.21.15.115:0/3694839313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb2014e3f0 msgr2=0x7fcb2015dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.904+0000 7fcb2519d700 1 --2- 172.21.15.115:0/3694839313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb2014e3f0 0x7fcb2015dd60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fcb18009f20 tx=0x7fcb18009840).stop 2023-07-27T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.904+0000 7fcb2519d700 1 -- 172.21.15.115:0/3694839313 shutdown_connections 2023-07-27T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.904+0000 7fcb2519d700 1 --2- 172.21.15.115:0/3694839313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb2014e3f0 0x7fcb2015dd60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.904+0000 7fcb2519d700 1 --2- 172.21.15.115:0/3694839313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200644d0 0x7fcb2014df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.904+0000 7fcb2519d700 1 -- 172.21.15.115:0/3694839313 >> 172.21.15.115:0/3694839313 conn(0x7fcb200cb480 msgr2=0x7fcb200c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:47.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.904+0000 7fcb2519d700 1 -- 172.21.15.115:0/3694839313 shutdown_connections 2023-07-27T14:27:47.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.904+0000 7fcb2519d700 1 -- 172.21.15.115:0/3694839313 wait complete. 2023-07-27T14:27:47.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.905+0000 7fcb2519d700 1 Processor -- start 2023-07-27T14:27:47.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.906+0000 7fcb2519d700 1 -- start start 2023-07-27T14:27:47.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.906+0000 7fcb2519d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200640f0 0x7fcb2014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:47.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.906+0000 7fcb2519d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb200644d0 0x7fcb20155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:47.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.906+0000 7fcb2519d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2014e3f0 0x7fcb20156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:47.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.906+0000 7fcb2519d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20156b30 con 0x7fcb200644d0 2023-07-27T14:27:47.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb2519d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20155f20 con 0x7fcb2014e3f0 2023-07-27T14:27:47.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb2519d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20156200 con 0x7fcb200640f0 2023-07-27T14:27:47.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb200644d0 0x7fcb20155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:47.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200640f0 0x7fcb2014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:47.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200640f0 0x7fcb2014b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:49322/0 (socket says 172.21.15.115:49322) 2023-07-27T14:27:47.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1ffff700 1 -- 172.21.15.115:0/2104030843 learned_addr learned my addr 172.21.15.115:0/2104030843 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:47.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb2499c700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2014e3f0 0x7fcb20156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:47.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1f7fe700 1 -- 172.21.15.115:0/2104030843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200640f0 msgr2=0x7fcb2014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:47.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1f7fe700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200640f0 0x7fcb2014b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1f7fe700 1 -- 172.21.15.115:0/2104030843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2014e3f0 msgr2=0x7fcb20156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:47.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1f7fe700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2014e3f0 0x7fcb20156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:47.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.907+0000 7fcb1f7fe700 1 -- 172.21.15.115:0/2104030843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18009ae0 con 0x7fcb200644d0 2023-07-27T14:27:47.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.908+0000 7fcb1f7fe700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb200644d0 0x7fcb20155920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fcb1400d680 tx=0x7fcb14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:47.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.908+0000 7fcb07fff700 1 -- 172.21.15.115:0/2104030843 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14011590 con 0x7fcb200644d0 2023-07-27T14:27:47.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.908+0000 7fcb07fff700 1 -- 172.21.15.115:0/2104030843 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb140116f0 con 0x7fcb200644d0 2023-07-27T14:27:47.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.908+0000 7fcb07fff700 1 -- 172.21.15.115:0/2104030843 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14011a70 con 0x7fcb200644d0 2023-07-27T14:27:47.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.908+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb201564e0 con 0x7fcb200644d0 2023-07-27T14:27:47.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.908+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb200af0a0 con 0x7fcb200644d0 2023-07-27T14:27:47.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.909+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb200831c0 con 0x7fcb200644d0 2023-07-27T14:27:47.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.910+0000 7fcb07fff700 1 -- 172.21.15.115:0/2104030843 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fcb14012420 con 0x7fcb200644d0 2023-07-27T14:27:47.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.911+0000 7fcb07fff700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb0c05ed90 0x7fcb0c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:47.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.911+0000 7fcb07fff700 1 -- 172.21.15.115:0/2104030843 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6381+0+0 (secure 0 0 0) 0x7fcb140796a0 con 0x7fcb200644d0 2023-07-27T14:27:47.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.911+0000 7fcb1ffff700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb0c05ed90 0x7fcb0c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:47.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.912+0000 7fcb1ffff700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb0c05ed90 0x7fcb0c061250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fcb200c1440 tx=0x7fcb10007e00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:47.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:47.915+0000 7fcb07fff700 1 -- 172.21.15.115:0/2104030843 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb1404aae0 con 0x7fcb200644d0 2023-07-27T14:27:48.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.122+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb20047270 con 0x7fcb200644d0 2023-07-27T14:27:48.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.683+0000 7fcb07fff700 1 -- 172.21.15.115:0/2104030843 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb1404e100 con 0x7fcb200644d0 2023-07-27T14:27:48.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb0c05ed90 msgr2=0x7fcb0c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:48.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb0c05ed90 0x7fcb0c061250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fcb200c1440 tx=0x7fcb10007e00).stop 2023-07-27T14:27:48.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb200644d0 msgr2=0x7fcb20155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:48.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb200644d0 0x7fcb20155920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fcb1400d680 tx=0x7fcb14008040).stop 2023-07-27T14:27:48.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 shutdown_connections 2023-07-27T14:27:48.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcb0c05ed90 0x7fcb0c061250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb2014e3f0 0x7fcb20156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb200640f0 0x7fcb2014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 --2- 172.21.15.115:0/2104030843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb200644d0 0x7fcb20155920 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.685+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 >> 172.21.15.115:0/2104030843 conn(0x7fcb200cb480 msgr2=0x7fcb2014c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:48.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.686+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 shutdown_connections 2023-07-27T14:27:48.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.686+0000 7fcb2519d700 1 -- 172.21.15.115:0/2104030843 wait complete. 2023-07-27T14:27:48.722 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:27:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.904+0000 7f0ecbbff700 1 Processor -- start 2023-07-27T14:27:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.904+0000 7f0ecbbff700 1 -- start start 2023-07-27T14:27:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0ecbbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0ec414ae00 0x7f0ec4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0ecbbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414b1e0 0x7f0ec4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0ecbbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec41553f0 con 0x7f0ec40c5c50 2023-07-27T14:27:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0ecbbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec4157a50 con 0x7f0ec414ae00 2023-07-27T14:27:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0ecbbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec4157d10 con 0x7f0ec414b1e0 2023-07-27T14:27:48.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0ec999b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0ec414ae00 0x7f0ec4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:48.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0ec919a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414b1e0 0x7f0ec4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:48.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0eca19c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f0ec40c5c50 0x7f0ec40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:47962/0 (socket says 172.21.15.115:47962) 2023-07-27T14:27:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.906+0000 7f0eca19c700 1 -- 172.21.15.115:0/4097113434 learned_addr learned my addr 172.21.15.115:0/4097113434 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec8999700 1 -- 172.21.15.115:0/4097113434 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840939374 0 0) 0x7f0ec41553f0 con 0x7f0ec40c5c50 2023-07-27T14:27:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec8999700 1 -- 172.21.15.115:0/4097113434 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb00033f0 con 0x7f0ec40c5c50 2023-07-27T14:27:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec999b700 1 -- 172.21.15.115:0/4097113434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414b1e0 msgr2=0x7f0ec4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec999b700 1 --2- 172.21.15.115:0/4097113434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414b1e0 0x7f0ec4062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec999b700 1 -- 172.21.15.115:0/4097113434 >> v1:172.21.15.159:6789/0 conn(0x7f0ec40c5c50 legacy=0x7f0ec40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec999b700 1 -- 172.21.15.115:0/4097113434 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4157ff0 con 0x7f0ec414ae00 2023-07-27T14:27:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec999b700 1 --2- 172.21.15.115:0/4097113434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414ae00 0x7f0ec4154f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0ec0009760 tx=0x7f0ec0009060).ready entity=mon.1 client_cookie=977f556c73879dce server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec8999700 1 -- 172.21.15.115:0/4097113434 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000d4a0 con 0x7f0ec414ae00 2023-07-27T14:27:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec8999700 1 -- 172.21.15.115:0/4097113434 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec000d600 con 0x7f0ec414ae00 2023-07-27T14:27:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.907+0000 7f0ec8999700 1 -- 172.21.15.115:0/4097113434 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000d980 con 0x7f0ec414ae00 2023-07-27T14:27:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.908+0000 7f0ecbbff700 1 -- 172.21.15.115:0/4097113434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414ae00 msgr2=0x7f0ec4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.908+0000 7f0ecbbff700 1 --2- 172.21.15.115:0/4097113434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414ae00 0x7f0ec4154f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0ec0009760 tx=0x7f0ec0009060).stop 2023-07-27T14:27:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.908+0000 7f0ecbbff700 1 -- 172.21.15.115:0/4097113434 shutdown_connections 2023-07-27T14:27:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.908+0000 7f0ecbbff700 1 --2- 172.21.15.115:0/4097113434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414ae00 0x7f0ec4154f00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.908+0000 7f0ecbbff700 1 --2- 172.21.15.115:0/4097113434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414b1e0 0x7f0ec4062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.908+0000 7f0ecbbff700 1 -- 172.21.15.115:0/4097113434 >> 172.21.15.115:0/4097113434 conn(0x7f0ec405e940 msgr2=0x7f0ec40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.908+0000 7f0ecbbff700 1 -- 172.21.15.115:0/4097113434 shutdown_connections 2023-07-27T14:27:48.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.908+0000 7f0ecbbff700 1 -- 172.21.15.115:0/4097113434 wait complete. 2023-07-27T14:27:48.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.909+0000 7f0ecbbff700 1 Processor -- start 2023-07-27T14:27:48.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.909+0000 7f0ecbbff700 1 -- start start 2023-07-27T14:27:48.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.910+0000 7f0ecbbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec40c5c50 0x7f0ec40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:48.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.910+0000 7f0ecbbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414ae00 0x7f0ec40c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:48.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.910+0000 7f0ecbbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414b1e0 0x7f0ec4166bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:48.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.910+0000 7f0ecbbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec41670b0 con 0x7f0ec40c5c50 2023-07-27T14:27:48.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.910+0000 7f0ecbbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec414a010 con 0x7f0ec414b1e0 2023-07-27T14:27:48.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.910+0000 7f0ecbbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec414aa50 con 0x7f0ec414ae00 2023-07-27T14:27:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec40c5c50 0x7f0ec40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec40c5c50 0x7f0ec40b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47104/0 (socket says 172.21.15.115:47104) 2023-07-27T14:27:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 -- 172.21.15.115:0/71058465 learned_addr learned my addr 172.21.15.115:0/71058465 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:48.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec919a700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414ae00 0x7f0ec40c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:48.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0eca19c700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414b1e0 0x7f0ec4166bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:48.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 -- 172.21.15.115:0/71058465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414ae00 msgr2=0x7f0ec40c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:48.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414ae00 0x7f0ec40c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 -- 172.21.15.115:0/71058465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414b1e0 msgr2=0x7f0ec4166bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414b1e0 0x7f0ec4166bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 -- 172.21.15.115:0/71058465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00092a0 con 0x7f0ec40c5c50 2023-07-27T14:27:48.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0ec999b700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec40c5c50 0x7f0ec40b07a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f0ec0011fb0 tx=0x7f0ec0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:48.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.911+0000 7f0eb9ffb700 1 -- 172.21.15.115:0/71058465 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000dd30 con 0x7f0ec40c5c50 2023-07-27T14:27:48.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.912+0000 7f0eb9ffb700 1 -- 172.21.15.115:0/71058465 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec000de90 con 0x7f0ec40c5c50 2023-07-27T14:27:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.912+0000 7f0ecbbff700 1 -- 172.21.15.115:0/71058465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec4165a40 con 0x7f0ec40c5c50 2023-07-27T14:27:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.912+0000 7f0eb9ffb700 1 -- 172.21.15.115:0/71058465 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000d980 con 0x7f0ec40c5c50 2023-07-27T14:27:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.912+0000 7f0ecbbff700 1 -- 172.21.15.115:0/71058465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec4165110 con 0x7f0ec40c5c50 2023-07-27T14:27:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.913+0000 7f0eaf7fe700 1 -- 172.21.15.115:0/71058465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec406c470 con 0x7f0ec40c5c50 2023-07-27T14:27:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.913+0000 7f0eb9ffb700 1 -- 172.21.15.115:0/71058465 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0ec000f070 con 0x7f0ec40c5c50 2023-07-27T14:27:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.914+0000 7f0eb9ffb700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ea805ed60 0x7f0ea8061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.914+0000 7f0eb9ffb700 1 -- 172.21.15.115:0/71058465 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f0ec007b170 con 0x7f0ec40c5c50 2023-07-27T14:27:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.914+0000 7f0ec919a700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ea805ed60 0x7f0ea8061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.915+0000 7f0ec919a700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ea805ed60 0x7f0ea8061220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0ec40b02f0 tx=0x7f0eb4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:48.918+0000 7f0eb9ffb700 1 -- 172.21.15.115:0/71058465 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ec004c500 con 0x7f0ec40c5c50 2023-07-27T14:27:49.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.088+0000 7f0eaf7fe700 1 -- 172.21.15.115:0/71058465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ec40c1690 con 0x7f0ec40c5c50 2023-07-27T14:27:49.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.829+0000 7f0eb9ffb700 1 -- 172.21.15.115:0/71058465 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0ec004fb20 con 0x7f0ec40c5c50 2023-07-27T14:27:49.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.831+0000 7f0eaf7fe700 1 -- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ea805ed60 msgr2=0x7f0ea8061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:49.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.831+0000 7f0eaf7fe700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ea805ed60 0x7f0ea8061220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0ec40b02f0 tx=0x7f0eb4009060).stop 2023-07-27T14:27:49.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.831+0000 7f0eaf7fe700 1 -- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec40c5c50 msgr2=0x7f0ec40b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:49.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.831+0000 7f0eaf7fe700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec40c5c50 0x7f0ec40b07a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f0ec0011fb0 tx=0x7f0ec0016000).stop 2023-07-27T14:27:49.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.832+0000 7f0eaf7fe700 1 -- 172.21.15.115:0/71058465 shutdown_connections 2023-07-27T14:27:49.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.832+0000 7f0eaf7fe700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ea805ed60 0x7f0ea8061220 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:49.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.832+0000 7f0eaf7fe700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ec414b1e0 0x7f0ec4166bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:49.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.832+0000 7f0eaf7fe700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec40c5c50 0x7f0ec40b07a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:49.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.832+0000 7f0eaf7fe700 1 --2- 172.21.15.115:0/71058465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ec414ae00 0x7f0ec40c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:49.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.832+0000 7f0eaf7fe700 1 -- 172.21.15.115:0/71058465 >> 172.21.15.115:0/71058465 conn(0x7f0ec405e940 msgr2=0x7f0ec4159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:49.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.832+0000 7f0eaf7fe700 1 -- 172.21.15.115:0/71058465 shutdown_connections 2023-07-27T14:27:49.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:49.832+0000 7f0eaf7fe700 1 -- 172.21.15.115:0/71058465 wait complete. 2023-07-27T14:27:49.851 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:27:49.867 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:27:50.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.051+0000 7f22105ff700 1 Processor -- start 2023-07-27T14:27:50.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.051+0000 7f22105ff700 1 -- start start 2023-07-27T14:27:50.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.052+0000 7f22105ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f220814ae00 0x7f2208154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:50.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.052+0000 7f22105ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22081553f0 con 0x7f220814b1e0 2023-07-27T14:27:50.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.052+0000 7f22105ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2208157a50 con 0x7f2208063260 2023-07-27T14:27:50.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.052+0000 7f22105ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2208157d10 con 0x7f220814ae00 2023-07-27T14:27:50.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220db9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f220814b1e0 0x7f2208062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42388/0 (socket says 172.21.15.115:42388) 2023-07-27T14:27:50.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220db9a700 1 -- 172.21.15.115:0/1710522315 learned_addr learned my addr 172.21.15.115:0/1710522315 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:50.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816014655 0 0) 0x7f22081553f0 con 0x7f220814b1e0 2023-07-27T14:27:50.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220e39b700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f220814ae00 0x7f2208154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:50.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f40033f0 con 0x7f220814b1e0 2023-07-27T14:27:50.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1551781256 0 0) 0x7f21f40033f0 con 0x7f220814b1e0 2023-07-27T14:27:50.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f220814ae00 msgr2=0x7f2208154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:50.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f220814ae00 0x7f2208154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:50.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 >> v1:172.21.15.159:6789/0 conn(0x7f2208063260 legacy=0x7f22080a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:50.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208157ff0 con 0x7f220814b1e0 2023-07-27T14:27:50.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f21f8001470 con 0x7f220814b1e0 2023-07-27T14:27:50.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 >> v1:172.21.15.115:6789/0 conn(0x7f220814b1e0 legacy=0x7f2208062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:50.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f220814ae00 0x7f21f4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:50.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.053+0000 7f220d399700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4003e40 0x7f21f4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:50.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220d399700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f4004b80 0x7f21f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:50.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2208157d10 con 0x7f21f4004b80 2023-07-27T14:27:50.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f400b990 con 0x7f21f4003e40 2023-07-27T14:27:50.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f400bb50 con 0x7f220814ae00 2023-07-27T14:27:50.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220db9a700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4003e40 0x7f21f4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:50.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220e39b700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f220814ae00 0x7f21f4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:50.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220eb9c700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f4004b80 0x7f21f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:50.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220eb9c700 1 -- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f220814ae00 msgr2=0x7f21f4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:50.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220eb9c700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f220814ae00 0x7f21f4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:50.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220eb9c700 1 -- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4003e40 msgr2=0x7f21f4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:50.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220eb9c700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f4003e40 0x7f21f4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:50.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220eb9c700 1 -- 172.21.15.115:0/1710522315 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40033f0 con 0x7f21f4004b80 2023-07-27T14:27:50.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.054+0000 7f220eb9c700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f4004b80 0x7f21f4005000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f2200001e30 tx=0x7f2200007f30).ready entity=mon.0 client_cookie=c5b72acbe1dbdc9e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:50.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200006a20 con 0x7f21f4004b80 2023-07-27T14:27:50.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2200006b80 con 0x7f21f4004b80 2023-07-27T14:27:50.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f220d399700 1 -- 172.21.15.115:0/1710522315 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000c5d0 con 0x7f21f4004b80 2023-07-27T14:27:50.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f22105ff700 1 -- 172.21.15.115:0/1710522315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f4004b80 msgr2=0x7f21f4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:50.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f22105ff700 1 --2- 172.21.15.115:0/1710522315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f4004b80 0x7f21f4005000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f2200001e30 tx=0x7f2200007f30).stop 2023-07-27T14:27:50.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f220eb9c700 1 -- 172.21.15.115:0/1710522315 reap_dead start 2023-07-27T14:27:50.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f22105ff700 1 -- 172.21.15.115:0/1710522315 shutdown_connections 2023-07-27T14:27:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f22105ff700 1 -- 172.21.15.115:0/1710522315 >> 172.21.15.115:0/1710522315 conn(0x7f220805e940 msgr2=0x7f22080cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f22105ff700 1 -- 172.21.15.115:0/1710522315 shutdown_connections 2023-07-27T14:27:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.055+0000 7f22105ff700 1 -- 172.21.15.115:0/1710522315 wait complete. 2023-07-27T14:27:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.057+0000 7f22105ff700 1 Processor -- start 2023-07-27T14:27:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.057+0000 7f22105ff700 1 -- start start 2023-07-27T14:27:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f22105ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f4004b80 0x7f2208152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f22105ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22080afa30 0x7f22080adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f22105ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2208156600 0x7f2208156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f22105ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220814b610 con 0x7f22080afa30 2023-07-27T14:27:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f22105ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2208156f70 con 0x7f2208156600 2023-07-27T14:27:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f22105ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080b0280 con 0x7f21f4004b80 2023-07-27T14:27:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22080afa30 0x7f22080adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22080afa30 0x7f22080adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47122/0 (socket says 172.21.15.115:47122) 2023-07-27T14:27:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 -- 172.21.15.115:0/3560811068 learned_addr learned my addr 172.21.15.115:0/3560811068 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 -- 172.21.15.115:0/3560811068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f4004b80 msgr2=0x7f2208152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f4004b80 0x7f2208152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:50.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 -- 172.21.15.115:0/3560811068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2208156600 msgr2=0x7f2208156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:50.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2208156600 0x7f2208156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:50.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 -- 172.21.15.115:0/3560811068 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080b0560 con 0x7f22080afa30 2023-07-27T14:27:50.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.058+0000 7f220db9a700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22080afa30 0x7f22080adf50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f21f80010e0 tx=0x7f21f8001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:50.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.059+0000 7f21fe7fc700 1 -- 172.21.15.115:0/3560811068 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8004e20 con 0x7f22080afa30 2023-07-27T14:27:50.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.059+0000 7f21fe7fc700 1 -- 172.21.15.115:0/3560811068 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f8000c40 con 0x7f22080afa30 2023-07-27T14:27:50.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.059+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22080b0840 con 0x7f22080afa30 2023-07-27T14:27:50.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.059+0000 7f21fe7fc700 1 -- 172.21.15.115:0/3560811068 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f800fb00 con 0x7f22080afa30 2023-07-27T14:27:50.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.059+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22080afeb0 con 0x7f22080afa30 2023-07-27T14:27:50.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.060+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220806c470 con 0x7f22080afa30 2023-07-27T14:27:50.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.061+0000 7f21fe7fc700 1 -- 172.21.15.115:0/3560811068 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f21f801c360 con 0x7f22080afa30 2023-07-27T14:27:50.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.061+0000 7f21fe7fc700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21ec05ed90 0x7f21ec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:50.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.062+0000 7f21fe7fc700 1 -- 172.21.15.115:0/3560811068 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5827+0+0 (secure 0 0 0) 0x7f21f8079260 con 0x7f22080afa30 2023-07-27T14:27:50.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.062+0000 7f220e39b700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21ec05ed90 0x7f21ec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:50.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.062+0000 7f220e39b700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21ec05ed90 0x7f21ec061250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2204006d30 tx=0x7f2204009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:50.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.065+0000 7f21fe7fc700 1 -- 172.21.15.115:0/3560811068 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21f804a7b0 con 0x7f22080afa30 2023-07-27T14:27:50.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.234+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f220814b8f0 con 0x7f22080afa30 2023-07-27T14:27:50.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.832+0000 7f21fe7fc700 1 -- 172.21.15.115:0/3560811068 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f21f8019020 con 0x7f22080afa30 2023-07-27T14:27:50.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21ec05ed90 msgr2=0x7f21ec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:50.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21ec05ed90 0x7f21ec061250 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2204006d30 tx=0x7f2204009060).stop 2023-07-27T14:27:50.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22080afa30 msgr2=0x7f22080adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:50.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22080afa30 0x7f22080adf50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f21f80010e0 tx=0x7f21f8001e70).stop 2023-07-27T14:27:50.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 shutdown_connections 2023-07-27T14:27:50.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21ec05ed90 0x7f21ec061250 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:50.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2208156600 0x7f2208156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:50.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f4004b80 0x7f2208152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:50.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 --2- 172.21.15.115:0/3560811068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22080afa30 0x7f22080adf50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:50.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.836+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 >> 172.21.15.115:0/3560811068 conn(0x7f220805e940 msgr2=0x7f22080c13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:50.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.837+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 shutdown_connections 2023-07-27T14:27:50.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:50.837+0000 7f22105ff700 1 -- 172.21.15.115:0/3560811068 wait complete. 2023-07-27T14:27:50.856 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:27:50.874 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:27:50.875 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:27:50.875 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:27:50.875 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:27:50.876 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:27:50.876 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:27:50.876 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:27:50.876 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:27:50.877 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:27:50.877 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:27:50.877 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:27:50.877 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:27:50.878 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:27:50.878 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:27:50.878 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:27:50.878 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:27:50.895 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:27:50.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:27:50.896 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:27:50.896 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:27:50.898 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:27:50.898 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:27:50.940 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:27:50.940 DEBUG:teuthology.parallel:result is None 2023-07-27T14:27:50.942 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:27:50.942 DEBUG:teuthology.parallel:result is None 2023-07-27T14:27:50.943 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:27:50.943 DEBUG:teuthology.parallel:result is None 2023-07-27T14:27:51.080 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:27:51.080 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:27:51.081 INFO:tasks.ceph.mds.c.smithi115.stderr:2023-07-27T14:27:51.064+0000 7f6b0a5fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-07-27T14:27:51.082 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:27:54.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-27T14:27:56.898 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:27:56.898 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:27:56.903 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:27:56.904 DEBUG:teuthology.parallel:result is None 2023-07-27T14:27:56.904 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:27:57.050 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:27:57.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.088+0000 7fdf8f1ff700 1 Processor -- start 2023-07-27T14:27:57.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.088+0000 7fdf8f1ff700 1 -- start start 2023-07-27T14:27:57.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.090+0000 7fdf8f1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88064b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:57.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.090+0000 7fdf8f1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf881532a0 con 0x7fdf880c3470 2023-07-27T14:27:57.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.090+0000 7fdf8f1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf88064060 con 0x7fdf880c3850 2023-07-27T14:27:57.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.090+0000 7fdf8f1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88064340 con 0x7fdf8814fbd0 2023-07-27T14:27:57.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.090+0000 7fdf8cf9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdf880c3470 0x7fdf8814f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50006/0 (socket says 172.21.15.115:50006) 2023-07-27T14:27:57.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.090+0000 7fdf8cf9b700 1 -- 172.21.15.115:0/2018867693 learned_addr learned my addr 172.21.15.115:0/2018867693 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.090+0000 7fdf87fff700 1 --2- 172.21.15.115:0/2018867693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf877fe700 1 -- 172.21.15.115:0/2018867693 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659688707 0 0) 0x7fdf881532a0 con 0x7fdf880c3470 2023-07-27T14:27:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf877fe700 1 -- 172.21.15.115:0/2018867693 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf780033f0 con 0x7fdf880c3470 2023-07-27T14:27:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf877fe700 1 -- 172.21.15.115:0/2018867693 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355478625 0 0) 0x7fdf88064060 con 0x7fdf880c3850 2023-07-27T14:27:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf877fe700 1 -- 172.21.15.115:0/2018867693 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf881532a0 con 0x7fdf880c3850 2023-07-27T14:27:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf87fff700 1 -- 172.21.15.115:0/2018867693 >> v1:172.21.15.159:6789/0 conn(0x7fdf880c3850 legacy=0x7fdf88152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf87fff700 1 -- 172.21.15.115:0/2018867693 >> v1:172.21.15.115:6789/0 conn(0x7fdf880c3470 legacy=0x7fdf8814f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf87fff700 1 -- 172.21.15.115:0/2018867693 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88064620 con 0x7fdf8814fbd0 2023-07-27T14:27:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf87fff700 1 --2- 172.21.15.115:0/2018867693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88064b40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdf74009790 tx=0x7fdf74009060).ready entity=mon.2 client_cookie=c709aa1f7adca842 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf877fe700 1 -- 172.21.15.115:0/2018867693 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400f510 con 0x7fdf8814fbd0 2023-07-27T14:27:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf877fe700 1 -- 172.21.15.115:0/2018867693 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7400f670 con 0x7fdf8814fbd0 2023-07-27T14:27:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.091+0000 7fdf877fe700 1 -- 172.21.15.115:0/2018867693 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400f9f0 con 0x7fdf8814fbd0 2023-07-27T14:27:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.092+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/2018867693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 msgr2=0x7fdf88064b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.092+0000 7fdf8f1ff700 1 --2- 172.21.15.115:0/2018867693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88064b40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdf74009790 tx=0x7fdf74009060).stop 2023-07-27T14:27:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.092+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/2018867693 shutdown_connections 2023-07-27T14:27:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.092+0000 7fdf8f1ff700 1 --2- 172.21.15.115:0/2018867693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88064b40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.092+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/2018867693 >> 172.21.15.115:0/2018867693 conn(0x7fdf88062320 msgr2=0x7fdf88062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.092+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/2018867693 shutdown_connections 2023-07-27T14:27:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.092+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/2018867693 wait complete. 2023-07-27T14:27:57.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.093+0000 7fdf8f1ff700 1 Processor -- start 2023-07-27T14:27:57.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.093+0000 7fdf8f1ff700 1 -- start start 2023-07-27T14:27:57.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.094+0000 7fdf8f1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf880c3470 0x7fdf880bf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:57.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.094+0000 7fdf8f1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880c3850 0x7fdf880c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:57.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.094+0000 7fdf8f1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:57.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.094+0000 7fdf8f1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8814f1c0 con 0x7fdf880c3850 2023-07-27T14:27:57.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.094+0000 7fdf8f1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880c07a0 con 0x7fdf880c3470 2023-07-27T14:27:57.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.094+0000 7fdf8f1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880a4a00 con 0x7fdf8814fbd0 2023-07-27T14:27:57.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880c3850 0x7fdf880c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:57.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf8cf9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf880c3470 0x7fdf880bf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:57.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880c3850 0x7fdf880c0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54000/0 (socket says 172.21.15.115:54000) 2023-07-27T14:27:57.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 -- 172.21.15.115:0/653540681 learned_addr learned my addr 172.21.15.115:0/653540681 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:57.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf8d79c700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:57.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 -- 172.21.15.115:0/653540681 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 msgr2=0x7fdf88154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 -- 172.21.15.115:0/653540681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf880c3470 msgr2=0x7fdf880bf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf880c3470 0x7fdf880bf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 -- 172.21.15.115:0/653540681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740092a0 con 0x7fdf880c3850 2023-07-27T14:27:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf8cf9b700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf880c3470 0x7fdf880bf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:27:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf87fff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880c3850 0x7fdf880c0e80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fdf74009d80 tx=0x7fdf74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf84ff9700 1 -- 172.21.15.115:0/653540681 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400fe80 con 0x7fdf880c3850 2023-07-27T14:27:57.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.095+0000 7fdf84ff9700 1 -- 172.21.15.115:0/653540681 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7400f7e0 con 0x7fdf880c3850 2023-07-27T14:27:57.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.096+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf880bff00 con 0x7fdf880c3850 2023-07-27T14:27:57.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.096+0000 7fdf84ff9700 1 -- 172.21.15.115:0/653540681 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7401b640 con 0x7fdf880c3850 2023-07-27T14:27:57.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.096+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf880c04c0 con 0x7fdf880c3850 2023-07-27T14:27:57.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.097+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8806c470 con 0x7fdf880c3850 2023-07-27T14:27:57.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.097+0000 7fdf84ff9700 1 -- 172.21.15.115:0/653540681 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdf7400f070 con 0x7fdf880c3850 2023-07-27T14:27:57.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.098+0000 7fdf84ff9700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf6c05ed60 0x7fdf6c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:57.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.098+0000 7fdf84ff9700 1 -- 172.21.15.115:0/653540681 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fdf7407aad0 con 0x7fdf880c3850 2023-07-27T14:27:57.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.099+0000 7fdf8cf9b700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf6c05ed60 0x7fdf6c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.099+0000 7fdf8cf9b700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf6c05ed60 0x7fdf6c061220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fdf7c005750 tx=0x7fdf7c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:57.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.103+0000 7fdf84ff9700 1 -- 172.21.15.115:0/653540681 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf7404c260 con 0x7fdf880c3850 2023-07-27T14:27:57.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:57.289+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdf88065130 con 0x7fdf880c3850 2023-07-27T14:27:58.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.051+0000 7fdf84ff9700 1 -- 172.21.15.115:0/653540681 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdf7401f020 con 0x7fdf880c3850 2023-07-27T14:27:58.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf6c05ed60 msgr2=0x7fdf6c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf6c05ed60 0x7fdf6c061220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fdf7c005750 tx=0x7fdf7c009040).stop 2023-07-27T14:27:58.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880c3850 msgr2=0x7fdf880c0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880c3850 0x7fdf880c0e80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fdf74009d80 tx=0x7fdf74017000).stop 2023-07-27T14:27:58.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 shutdown_connections 2023-07-27T14:27:58.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf6c05ed60 0x7fdf6c061220 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf8814fbd0 0x7fdf88154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf880c3470 0x7fdf880bf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 --2- 172.21.15.115:0/653540681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880c3850 0x7fdf880c0e80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.053+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 >> 172.21.15.115:0/653540681 conn(0x7fdf88062320 msgr2=0x7fdf880c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:58.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.054+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 shutdown_connections 2023-07-27T14:27:58.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.054+0000 7fdf8f1ff700 1 -- 172.21.15.115:0/653540681 wait complete. 2023-07-27T14:27:58.073 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:27:58.089 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:27:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.260+0000 7f09c3bff700 1 Processor -- start 2023-07-27T14:27:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.260+0000 7f09c3bff700 1 -- start start 2023-07-27T14:27:58.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c3bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc153ec0 0x7f09bc0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c3bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f09bc0aa050 0x7f09bc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c3bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09bc0aaa40 0x7f09bc0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c3bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc064ad0 con 0x7f09bc0aaa40 2023-07-27T14:27:58.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c3bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0aa4d0 con 0x7f09bc0aa050 2023-07-27T14:27:58.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c3bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c05c0 con 0x7f09bc153ec0 2023-07-27T14:27:58.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c219c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09bc0aaa40 0x7f09bc0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c219c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09bc0aaa40 0x7f09bc0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54016/0 (socket says 172.21.15.115:54016) 2023-07-27T14:27:58.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c219c700 1 -- 172.21.15.115:0/4098406839 learned_addr learned my addr 172.21.15.115:0/4098406839 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:58.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c119a700 1 --2- 172.21.15.115:0/4098406839 >> v2:172.21.15.159:3300/0 conn(0x7f09bc0aa050 0x7f09bc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.262+0000 7f09c199b700 1 --2- 172.21.15.115:0/4098406839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc153ec0 0x7f09bc0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c219c700 1 -- 172.21.15.115:0/4098406839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc153ec0 msgr2=0x7f09bc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:58.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c219c700 1 --2- 172.21.15.115:0/4098406839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc153ec0 0x7f09bc0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c219c700 1 -- 172.21.15.115:0/4098406839 >> v2:172.21.15.159:3300/0 conn(0x7f09bc0aa050 msgr2=0x7f09bc0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:58.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c219c700 1 --2- 172.21.15.115:0/4098406839 >> v2:172.21.15.159:3300/0 conn(0x7f09bc0aa050 0x7f09bc0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c219c700 1 -- 172.21.15.115:0/4098406839 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc0bfc90 con 0x7f09bc0aaa40 2023-07-27T14:27:58.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c119a700 1 --2- 172.21.15.115:0/4098406839 >> v2:172.21.15.159:3300/0 conn(0x7f09bc0aa050 0x7f09bc0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:58.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c219c700 1 --2- 172.21.15.115:0/4098406839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc0aaa40 0x7f09bc0645e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f09bc05f080 tx=0x7f09b4009840).ready entity=mon.0 client_cookie=a4720728e2a28113 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:58.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c0999700 1 -- 172.21.15.115:0/4098406839 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400e070 con 0x7f09bc0aaa40 2023-07-27T14:27:58.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c0999700 1 -- 172.21.15.115:0/4098406839 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b400ba50 con 0x7f09bc0aaa40 2023-07-27T14:27:58.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c0999700 1 -- 172.21.15.115:0/4098406839 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400bdd0 con 0x7f09bc0aaa40 2023-07-27T14:27:58.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c3bff700 1 -- 172.21.15.115:0/4098406839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc0aaa40 msgr2=0x7f09bc0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.263+0000 7f09c3bff700 1 --2- 172.21.15.115:0/4098406839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc0aaa40 0x7f09bc0645e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f09bc05f080 tx=0x7f09b4009840).stop 2023-07-27T14:27:58.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.264+0000 7f09c3bff700 1 -- 172.21.15.115:0/4098406839 shutdown_connections 2023-07-27T14:27:58.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.264+0000 7f09c3bff700 1 --2- 172.21.15.115:0/4098406839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc0aaa40 0x7f09bc0645e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.264+0000 7f09c3bff700 1 --2- 172.21.15.115:0/4098406839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc153ec0 0x7f09bc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.264+0000 7f09c3bff700 1 --2- 172.21.15.115:0/4098406839 >> v2:172.21.15.159:3300/0 conn(0x7f09bc0aa050 0x7f09bc0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.264+0000 7f09c3bff700 1 -- 172.21.15.115:0/4098406839 >> 172.21.15.115:0/4098406839 conn(0x7f09bc0cb610 msgr2=0x7f09bc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:58.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.264+0000 7f09c3bff700 1 -- 172.21.15.115:0/4098406839 shutdown_connections 2023-07-27T14:27:58.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.264+0000 7f09c3bff700 1 -- 172.21.15.115:0/4098406839 wait complete. 2023-07-27T14:27:58.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.265+0000 7f09c3bff700 1 Processor -- start 2023-07-27T14:27:58.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.265+0000 7f09c3bff700 1 -- start start 2023-07-27T14:27:58.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c3bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc0aa050 0x7f09bc164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c3bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09bc0aaa40 0x7f09bc152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c3bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc153ec0 0x7f09bc153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c3bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc153570 con 0x7f09bc153ec0 2023-07-27T14:27:58.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c3bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c44d0 con 0x7f09bc0aaa40 2023-07-27T14:27:58.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c3bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c38c0 con 0x7f09bc0aa050 2023-07-27T14:27:58.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c219c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc153ec0 0x7f09bc153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c199b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc0aa050 0x7f09bc164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c119a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09bc0aaa40 0x7f09bc152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c199b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc0aa050 0x7f09bc164ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:40006/0 (socket says 172.21.15.115:40006) 2023-07-27T14:27:58.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.266+0000 7f09c199b700 1 -- 172.21.15.115:0/51711607 learned_addr learned my addr 172.21.15.115:0/51711607 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:58.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09c219c700 1 -- 172.21.15.115:0/51711607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc0aa050 msgr2=0x7f09bc164ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09c219c700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc0aa050 0x7f09bc164ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09c219c700 1 -- 172.21.15.115:0/51711607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09bc0aaa40 msgr2=0x7f09bc152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09c219c700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09bc0aaa40 0x7f09bc152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09c219c700 1 -- 172.21.15.115:0/51711607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4009ae0 con 0x7f09bc153ec0 2023-07-27T14:27:58.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09c219c700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc153ec0 0x7f09bc153080 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f09b4013000 tx=0x7f09b4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:58.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09b1ffb700 1 -- 172.21.15.115:0/51711607 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400b6c0 con 0x7f09bc153ec0 2023-07-27T14:27:58.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09b1ffb700 1 -- 172.21.15.115:0/51711607 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40032f0 con 0x7f09bc153ec0 2023-07-27T14:27:58.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09b1ffb700 1 -- 172.21.15.115:0/51711607 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b401e6a0 con 0x7f09bc153ec0 2023-07-27T14:27:58.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc0c3ba0 con 0x7f09bc153ec0 2023-07-27T14:27:58.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.267+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc0c4160 con 0x7f09bc153ec0 2023-07-27T14:27:58.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.268+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc06c470 con 0x7f09bc153ec0 2023-07-27T14:27:58.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.269+0000 7f09b1ffb700 1 -- 172.21.15.115:0/51711607 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f09b401b040 con 0x7f09bc153ec0 2023-07-27T14:27:58.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.270+0000 7f09b1ffb700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09a005ed90 0x7f09a0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.270+0000 7f09b1ffb700 1 -- 172.21.15.115:0/51711607 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f09b407ab50 con 0x7f09bc153ec0 2023-07-27T14:27:58.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.270+0000 7f09c199b700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09a005ed90 0x7f09a0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.271+0000 7f09c199b700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09a005ed90 0x7f09a0061250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f09bc0a2a50 tx=0x7f09b8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:58.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.274+0000 7f09b1ffb700 1 -- 172.21.15.115:0/51711607 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09b404c330 con 0x7f09bc153ec0 2023-07-27T14:27:58.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:27:58.336 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:27:58.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.513+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f09bc0bff70 con 0x7f09bc153ec0 2023-07-27T14:27:58.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.513+0000 7f09b1ffb700 1 -- 172.21.15.115:0/51711607 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f09b4023030 con 0x7f09bc153ec0 2023-07-27T14:27:58.532 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:27:58.532 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:27:58.532 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:27:58.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.533 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:27:58.533 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:27:58.533 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.534 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:27:58.534 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:27:58.534 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:27:58.534 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.535 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.535 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:27:58.536 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:27:58.536 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.536 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:27:58.537 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:27:58.537 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:27:58.537 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.537 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.538 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:27:58.538 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:27:58.539 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.539 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:27:58.539 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:27:58.539 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:27:58.540 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.541 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:27:58.541 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:27:58.541 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.541 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:27:58.541 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:27:58.542 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:27:58.542 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.542 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.542 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:27:58.542 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:27:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:27:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:27:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:27:58.544 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:27:58.544 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.544 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:27:58.544 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:27:58.544 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.544 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.545 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:27:58.545 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:27:58.545 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.545 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:27:58.545 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:27:58.545 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.546 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:27:58.546 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:27:58.546 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.546 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:27:58.546 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:27:58.547 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.547 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:27:58.547 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:27:58.547 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.547 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:27:58.548 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:27:58.548 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.548 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.548 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:27:58.548 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:27:58.549 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.549 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:27:58.549 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:27:58.549 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.549 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.549 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:27:58.550 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:27:58.550 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.550 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:27:58.550 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:27:58.550 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.551 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:27:58.551 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:27:58.551 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.551 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:27:58.551 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:27:58.551 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.552 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.552 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:27:58.552 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:27:58.552 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.552 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:27:58.552 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:27:58.553 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:27:58.553 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:27:58.553 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.553 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:27:58.553 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:27:58.553 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.554 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:27:58.554 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:27:58.554 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:27:58.554 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:27:58.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.555 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:27:58.555 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:27:58.555 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.555 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:27:58.555 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:27:58.555 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:27:58.555 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:27:58.555 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.556 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:27:58.556 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:27:58.556 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.556 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:27:58.556 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:27:58.557 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:27:58.557 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:27:58.557 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.557 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:27:58.557 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:27:58.557 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.558 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:27:58.558 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:27:58.558 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:27:58.558 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.558 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.559 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.bootstrap-mds", 2023-07-27T14:27:58.559 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQChfsJkkV0kLRAAdoIHUqoyG5GwusC5ykv5rQ==", 2023-07-27T14:27:58.559 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.559 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile bootstrap-mds" 2023-07-27T14:27:58.559 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.559 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.bootstrap-mgr", 2023-07-27T14:27:58.560 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQChfsJkH2gkLRAA+Hs7g2QBVZCPFrm9USCe3Q==", 2023-07-27T14:27:58.560 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.560 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-27T14:27:58.560 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.560 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.bootstrap-osd", 2023-07-27T14:27:58.560 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQChfsJk23IkLRAAzQS79a98WXe+vEfSQANo9A==", 2023-07-27T14:27:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile bootstrap-osd" 2023-07-27T14:27:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.bootstrap-rbd", 2023-07-27T14:27:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQChfsJkiXskLRAAGSKyVkDqF7f3K/3lg/WAew==", 2023-07-27T14:27:58.561 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.562 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-27T14:27:58.562 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.562 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-27T14:27:58.562 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQChfsJkF4QkLRAA3x2i0tIqFKgF5Xsf8wCV8w==", 2023-07-27T14:27:58.562 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-27T14:27:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.bootstrap-rgw", 2023-07-27T14:27:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQChfsJkrYwkLRAAes8fOq7NUQi4p2R4DdbvLw==", 2023-07-27T14:27:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-27T14:27:58.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.564 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:27:58.564 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:27:58.564 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.564 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:27:58.565 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:27:58.565 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.565 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:27:58.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:27:58.565 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:27:58.565 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:27:58.565 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:27:58.566 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:27:58.566 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:27:58.566 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:27:58.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:27:58.566 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:27:58.566 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:27:58.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09a005ed90 msgr2=0x7f09a0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09a005ed90 0x7f09a0061250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f09bc0a2a50 tx=0x7f09b8008040).stop 2023-07-27T14:27:58.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc153ec0 msgr2=0x7f09bc153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc153ec0 0x7f09bc153080 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f09b4013000 tx=0x7f09b4009840).stop 2023-07-27T14:27:58.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 shutdown_connections 2023-07-27T14:27:58.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09a005ed90 0x7f09a0061250 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09bc153ec0 0x7f09bc153080 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09bc0aa050 0x7f09bc164ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 --2- 172.21.15.115:0/51711607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09bc0aaa40 0x7f09bc152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 >> 172.21.15.115:0/51711607 conn(0x7f09bc0cb610 msgr2=0x7f09bc0c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:58.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 shutdown_connections 2023-07-27T14:27:58.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.515+0000 7f09c3bff700 1 -- 172.21.15.115:0/51711607 wait complete. 2023-07-27T14:27:58.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-27T14:27:58.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.744+0000 7fd742fff700 1 Processor -- start 2023-07-27T14:27:58.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.744+0000 7fd742fff700 1 -- start start 2023-07-27T14:27:58.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd742fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd73c153ec0 0x7fd73c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd742fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c0aa050 0x7fd73c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd742fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd73c0aaa40 0x7fd73c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd742fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c064ad0 con 0x7fd73c0aaa40 2023-07-27T14:27:58.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd742fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0aa4d0 con 0x7fd73c153ec0 2023-07-27T14:27:58.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd742fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0c05c0 con 0x7fd73c0aa050 2023-07-27T14:27:58.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd74159c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd73c0aaa40 0x7fd73c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd74159c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd73c0aaa40 0x7fd73c0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54026/0 (socket says 172.21.15.115:54026) 2023-07-27T14:27:58.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.746+0000 7fd74159c700 1 -- 172.21.15.115:0/315729728 learned_addr learned my addr 172.21.15.115:0/315729728 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:58.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd73bfff700 1 --2- 172.21.15.115:0/315729728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c0aa050 0x7fd73c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd740d9b700 1 --2- 172.21.15.115:0/315729728 >> v2:172.21.15.159:3300/0 conn(0x7fd73c153ec0 0x7fd73c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd74159c700 1 -- 172.21.15.115:0/315729728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c0aa050 msgr2=0x7fd73c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:58.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd74159c700 1 --2- 172.21.15.115:0/315729728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c0aa050 0x7fd73c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd74159c700 1 -- 172.21.15.115:0/315729728 >> v2:172.21.15.159:3300/0 conn(0x7fd73c153ec0 msgr2=0x7fd73c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:58.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd74159c700 1 --2- 172.21.15.115:0/315729728 >> v2:172.21.15.159:3300/0 conn(0x7fd73c153ec0 0x7fd73c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd74159c700 1 -- 172.21.15.115:0/315729728 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c0bfc90 con 0x7fd73c0aaa40 2023-07-27T14:27:58.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd74159c700 1 --2- 172.21.15.115:0/315729728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0645e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fd73c083e30 tx=0x7fd734009840).ready entity=mon.0 client_cookie=fce46d357dedc781 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:58.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd73b7fe700 1 -- 172.21.15.115:0/315729728 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400e070 con 0x7fd73c0aaa40 2023-07-27T14:27:58.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd73b7fe700 1 -- 172.21.15.115:0/315729728 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400b970 con 0x7fd73c0aaa40 2023-07-27T14:27:58.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.747+0000 7fd73b7fe700 1 -- 172.21.15.115:0/315729728 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400bcf0 con 0x7fd73c0aaa40 2023-07-27T14:27:58.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 -- 172.21.15.115:0/315729728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 msgr2=0x7fd73c0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 --2- 172.21.15.115:0/315729728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0645e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fd73c083e30 tx=0x7fd734009840).stop 2023-07-27T14:27:58.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 -- 172.21.15.115:0/315729728 shutdown_connections 2023-07-27T14:27:58.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 --2- 172.21.15.115:0/315729728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0645e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 --2- 172.21.15.115:0/315729728 >> v2:172.21.15.159:3300/0 conn(0x7fd73c153ec0 0x7fd73c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 --2- 172.21.15.115:0/315729728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c0aa050 0x7fd73c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 -- 172.21.15.115:0/315729728 >> 172.21.15.115:0/315729728 conn(0x7fd73c0cb610 msgr2=0x7fd73c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:58.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 -- 172.21.15.115:0/315729728 shutdown_connections 2023-07-27T14:27:58.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.748+0000 7fd742fff700 1 -- 172.21.15.115:0/315729728 wait complete. 2023-07-27T14:27:58.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.749+0000 7fd742fff700 1 Processor -- start 2023-07-27T14:27:58.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.750+0000 7fd742fff700 1 -- start start 2023-07-27T14:27:58.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.750+0000 7fd742fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd73c0aa050 0x7fd73c14e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.750+0000 7fd742fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.750+0000 7fd742fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c153ec0 0x7fd73c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.750+0000 7fd742fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0ca510 con 0x7fd73c0aaa40 2023-07-27T14:27:58.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.750+0000 7fd742fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c164160 con 0x7fd73c0aa050 2023-07-27T14:27:58.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.750+0000 7fd742fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c150c20 con 0x7fd73c153ec0 2023-07-27T14:27:58.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54032/0 (socket says 172.21.15.115:54032) 2023-07-27T14:27:58.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 -- 172.21.15.115:0/3214169468 learned_addr learned my addr 172.21.15.115:0/3214169468 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:58.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd740d9b700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd73c0aa050 0x7fd73c14e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd74159c700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c153ec0 0x7fd73c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 -- 172.21.15.115:0/3214169468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c153ec0 msgr2=0x7fd73c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c153ec0 0x7fd73c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 -- 172.21.15.115:0/3214169468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd73c0aa050 msgr2=0x7fd73c14e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd73c0aa050 0x7fd73c14e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 -- 172.21.15.115:0/3214169468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd734009ae0 con 0x7fd73c0aaa40 2023-07-27T14:27:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd73bfff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0c9b30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fd72800e930 tx=0x7fd728009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.751+0000 7fd738ff9700 1 -- 172.21.15.115:0/3214169468 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72800eed0 con 0x7fd73c0aaa40 2023-07-27T14:27:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.752+0000 7fd738ff9700 1 -- 172.21.15.115:0/3214169468 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72800c850 con 0x7fd73c0aaa40 2023-07-27T14:27:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.752+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c150f00 con 0x7fd73c0aaa40 2023-07-27T14:27:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.752+0000 7fd738ff9700 1 -- 172.21.15.115:0/3214169468 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72800cbd0 con 0x7fd73c0aaa40 2023-07-27T14:27:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.752+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c14ee50 con 0x7fd73c0aaa40 2023-07-27T14:27:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.753+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c1642d0 con 0x7fd73c0aaa40 2023-07-27T14:27:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.753+0000 7fd738ff9700 1 -- 172.21.15.115:0/3214169468 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd728022070 con 0x7fd73c0aaa40 2023-07-27T14:27:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.754+0000 7fd738ff9700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd72005ed90 0x7fd720061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.754+0000 7fd738ff9700 1 -- 172.21.15.115:0/3214169468 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd728079d50 con 0x7fd73c0aaa40 2023-07-27T14:27:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.755+0000 7fd740d9b700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd72005ed90 0x7fd720061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:58.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.755+0000 7fd740d9b700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd72005ed90 0x7fd720061250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd730009b20 tx=0x7fd730008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:58.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.758+0000 7fd738ff9700 1 -- 172.21.15.115:0/3214169468 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd73c1642d0 con 0x7fd73c0aaa40 2023-07-27T14:27:59.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.990+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd73c1642d0 con 0x7fd73c0aaa40 2023-07-27T14:27:59.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.994+0000 7fd738ff9700 1 -- 172.21.15.115:0/3214169468 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd73c1642d0 con 0x7fd73c0aaa40 2023-07-27T14:27:59.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd72005ed90 msgr2=0x7fd720061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd72005ed90 0x7fd720061250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd730009b20 tx=0x7fd730008040).stop 2023-07-27T14:27:59.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 msgr2=0x7fd73c0c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0c9b30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fd72800e930 tx=0x7fd728009060).stop 2023-07-27T14:27:59.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 shutdown_connections 2023-07-27T14:27:59.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd72005ed90 0x7fd720061250 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd73c153ec0 0x7fd73c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd73c0aa050 0x7fd73c14e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 --2- 172.21.15.115:0/3214169468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0aaa40 0x7fd73c0c9b30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 >> 172.21.15.115:0/3214169468 conn(0x7fd73c0cb610 msgr2=0x7fd73c0afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:59.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 shutdown_connections 2023-07-27T14:27:59.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:58.996+0000 7fd742fff700 1 -- 172.21.15.115:0/3214169468 wait complete. 2023-07-27T14:27:59.016 INFO:teuthology.orchestra.run.smithi115.stderr:updated 2023-07-27T14:27:59.031 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-27T14:27:59.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.202+0000 7f25077ff700 1 Processor -- start 2023-07-27T14:27:59.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.203+0000 7f25077ff700 1 -- start start 2023-07-27T14:27:59.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f25077ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2500153ec0 0x7f25000a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f25077ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25000aaa40 0x7f25000c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f25077ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000aa4d0 con 0x7f25000aa050 2023-07-27T14:27:59.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f25077ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25000c05c0 con 0x7f2500153ec0 2023-07-27T14:27:59.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f25077ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000bfc90 con 0x7f25000aaa40 2023-07-27T14:27:59.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f2504d9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f25000aa050 0x7f25000640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50020/0 (socket says 172.21.15.115:50020) 2023-07-27T14:27:59.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f2504d9a700 1 -- 172.21.15.115:0/3432729215 learned_addr learned my addr 172.21.15.115:0/3432729215 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:27:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f2505d9c700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25000aaa40 0x7f25000c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.204+0000 7f250559b700 1 --2- 172.21.15.115:0/3432729215 >> v2:172.21.15.159:3300/0 conn(0x7f2500153ec0 0x7f25000a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104645046 0 0) 0x7f24f0001110 con 0x7f25000aa050 2023-07-27T14:27:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ec0033f0 con 0x7f25000aa050 2023-07-27T14:27:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2278857775 0 0) 0x7f24ec0033f0 con 0x7f25000aa050 2023-07-27T14:27:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25000aaa40 msgr2=0x7f25000c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25000aaa40 0x7f25000c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 >> v2:172.21.15.159:3300/0 conn(0x7f2500153ec0 msgr2=0x7f25000a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 --2- 172.21.15.115:0/3432729215 >> v2:172.21.15.159:3300/0 conn(0x7f2500153ec0 0x7f25000a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000bff70 con 0x7f25000aa050 2023-07-27T14:27:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f24f0001600 con 0x7f25000aa050 2023-07-27T14:27:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 >> v1:172.21.15.115:6789/0 conn(0x7f25000aa050 legacy=0x7f25000640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24ec0038e0 0x7f24ec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25000aaa40 0x7f24ec004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24ec004b80 0x7f24ec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c05c0 con 0x7f24ec0038e0 2023-07-27T14:27:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000bfc90 con 0x7f24ec004b80 2023-07-27T14:27:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec00b8e0 con 0x7f25000aaa40 2023-07-27T14:27:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.205+0000 7f250559b700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24ec0038e0 0x7f24ec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f250559b700 1 -- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25000aaa40 msgr2=0x7f24ec004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f250559b700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25000aaa40 0x7f24ec004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f250559b700 1 -- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24ec004b80 msgr2=0x7f24ec005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f250559b700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24ec004b80 0x7f24ec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:27:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f250559b700 1 -- 172.21.15.115:0/3432729215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0033f0 con 0x7f24ec0038e0 2023-07-27T14:27:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f250559b700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24ec0038e0 0x7f24ec003d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f24fc009a80 tx=0x7f24fc009060).ready entity=mon.0 client_cookie=dac8530bc06a132 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc009430 con 0x7f24ec0038e0 2023-07-27T14:27:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc00e640 con 0x7f24ec0038e0 2023-07-27T14:27:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f24f7fff700 1 -- 172.21.15.115:0/3432729215 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00e9c0 con 0x7f24ec0038e0 2023-07-27T14:27:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.206+0000 7f25077ff700 1 -- 172.21.15.115:0/3432729215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24ec0038e0 msgr2=0x7f24ec003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.207+0000 7f25077ff700 1 --2- 172.21.15.115:0/3432729215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24ec0038e0 0x7f24ec003d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f24fc009a80 tx=0x7f24fc009060).stop 2023-07-27T14:27:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.207+0000 7f2505d9c700 1 -- 172.21.15.115:0/3432729215 reap_dead start 2023-07-27T14:27:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.207+0000 7f25077ff700 1 -- 172.21.15.115:0/3432729215 shutdown_connections 2023-07-27T14:27:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.207+0000 7f25077ff700 1 -- 172.21.15.115:0/3432729215 >> 172.21.15.115:0/3432729215 conn(0x7f25000cb610 msgr2=0x7f25000c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.207+0000 7f25077ff700 1 -- 172.21.15.115:0/3432729215 shutdown_connections 2023-07-27T14:27:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.207+0000 7f25077ff700 1 -- 172.21.15.115:0/3432729215 wait complete. 2023-07-27T14:27:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.208+0000 7f25077ff700 1 Processor -- start 2023-07-27T14:27:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.208+0000 7f25077ff700 1 -- start start 2023-07-27T14:27:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.209+0000 7f25077ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24ec0038e0 0x7f25001508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.209+0000 7f25077ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f250014c280 0x7f250014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.209+0000 7f25077ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250014e920 0x7f25000c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.209+0000 7f25077ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c3470 con 0x7f250014e920 2023-07-27T14:27:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.209+0000 7f25077ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25001510f0 con 0x7f24ec0038e0 2023-07-27T14:27:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.209+0000 7f25077ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25001513d0 con 0x7f250014c280 2023-07-27T14:27:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250014e920 0x7f25000c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250014e920 0x7f25000c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54040/0 (socket says 172.21.15.115:54040) 2023-07-27T14:27:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 -- 172.21.15.115:0/2618085868 learned_addr learned my addr 172.21.15.115:0/2618085868 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f250559b700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24ec0038e0 0x7f25001508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2504d9a700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f250014c280 0x7f250014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 -- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f250014c280 msgr2=0x7f250014e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f250014c280 0x7f250014e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 -- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24ec0038e0 msgr2=0x7f25001508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24ec0038e0 0x7f25001508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 -- 172.21.15.115:0/2618085868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000c3100 con 0x7f250014e920 2023-07-27T14:27:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2504d9a700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f250014c280 0x7f250014e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:27:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f2505d9c700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250014e920 0x7f25000c1c30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f25000c5490 tx=0x7f24f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f24f57fa700 1 -- 172.21.15.115:0/2618085868 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800c840 con 0x7f250014e920 2023-07-27T14:27:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f24f57fa700 1 -- 172.21.15.115:0/2618085868 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f800f040 con 0x7f250014e920 2023-07-27T14:27:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25001516b0 con 0x7f250014e920 2023-07-27T14:27:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.210+0000 7f24f57fa700 1 -- 172.21.15.115:0/2618085868 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800cbf0 con 0x7f250014e920 2023-07-27T14:27:59.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.211+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25000c2120 con 0x7f250014e920 2023-07-27T14:27:59.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.212+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25000c3620 con 0x7f250014e920 2023-07-27T14:27:59.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.212+0000 7f24f57fa700 1 -- 172.21.15.115:0/2618085868 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f24f801d460 con 0x7f250014e920 2023-07-27T14:27:59.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.213+0000 7f24f57fa700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24e405ed90 0x7f24e4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.213+0000 7f24f57fa700 1 -- 172.21.15.115:0/2618085868 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f24f8079db0 con 0x7f250014e920 2023-07-27T14:27:59.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.213+0000 7f250559b700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24e405ed90 0x7f24e4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.214+0000 7f250559b700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24e405ed90 0x7f24e4061250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f24fc006d50 tx=0x7f24fc01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:59.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.217+0000 7f24f57fa700 1 -- 172.21.15.115:0/2618085868 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f25000c3620 con 0x7f250014e920 2023-07-27T14:27:59.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.450+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f25000c3620 con 0x7f250014e920 2023-07-27T14:27:59.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.454+0000 7f24f57fa700 1 -- 172.21.15.115:0/2618085868 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f25000c3620 con 0x7f250014e920 2023-07-27T14:27:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24e405ed90 msgr2=0x7f24e4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24e405ed90 0x7f24e4061250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f24fc006d50 tx=0x7f24fc01a000).stop 2023-07-27T14:27:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250014e920 msgr2=0x7f25000c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250014e920 0x7f25000c1c30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f25000c5490 tx=0x7f24f800b040).stop 2023-07-27T14:27:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 shutdown_connections 2023-07-27T14:27:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24e405ed90 0x7f24e4061250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f250014e920 0x7f25000c1c30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24ec0038e0 0x7f25001508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 --2- 172.21.15.115:0/2618085868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f250014c280 0x7f250014e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 >> 172.21.15.115:0/2618085868 conn(0x7f25000cb610 msgr2=0x7f25000ad060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 shutdown_connections 2023-07-27T14:27:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.456+0000 7f25077ff700 1 -- 172.21.15.115:0/2618085868 wait complete. 2023-07-27T14:27:59.476 INFO:teuthology.orchestra.run.smithi115.stderr:updated 2023-07-27T14:27:59.491 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-27T14:27:59.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.663+0000 7f1c8fdff700 1 Processor -- start 2023-07-27T14:27:59.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.663+0000 7f1c8fdff700 1 -- start start 2023-07-27T14:27:59.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.664+0000 7f1c8fdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1c88153ec0 0x7f1c880a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.664+0000 7f1c8fdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c880aa050 0x7f1c880640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.664+0000 7f1c8fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 0x7f1c880645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.664+0000 7f1c8fdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c88064ad0 con 0x7f1c880aa050 2023-07-27T14:27:59.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.664+0000 7f1c8fdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c880aa4d0 con 0x7f1c88153ec0 2023-07-27T14:27:59.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.664+0000 7f1c8fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c05c0 con 0x7f1c880aaa40 2023-07-27T14:27:59.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c880aa050 0x7f1c880640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c880aa050 0x7f1c880640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54048/0 (socket says 172.21.15.115:54048) 2023-07-27T14:27:59.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 -- 172.21.15.115:0/2622810803 learned_addr learned my addr 172.21.15.115:0/2622810803 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:59.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8db9b700 1 --2- 172.21.15.115:0/2622810803 >> v2:172.21.15.159:3300/0 conn(0x7f1c88153ec0 0x7f1c880a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8e39c700 1 --2- 172.21.15.115:0/2622810803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 0x7f1c880645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 -- 172.21.15.115:0/2622810803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 msgr2=0x7f1c880645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:59.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 --2- 172.21.15.115:0/2622810803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 0x7f1c880645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 -- 172.21.15.115:0/2622810803 >> v2:172.21.15.159:3300/0 conn(0x7f1c88153ec0 msgr2=0x7f1c880a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:27:59.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 --2- 172.21.15.115:0/2622810803 >> v2:172.21.15.159:3300/0 conn(0x7f1c88153ec0 0x7f1c880a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 -- 172.21.15.115:0/2622810803 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880bfc90 con 0x7f1c880aa050 2023-07-27T14:27:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8d39a700 1 --2- 172.21.15.115:0/2622810803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c880aa050 0x7f1c880640f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f1c88083e30 tx=0x7f1c780090f0).ready entity=mon.0 client_cookie=f07e4b17a4f2841d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.665+0000 7f1c8cb99700 1 -- 172.21.15.115:0/2622810803 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800b600 con 0x7f1c880aa050 2023-07-27T14:27:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8cb99700 1 -- 172.21.15.115:0/2622810803 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7800b760 con 0x7f1c880aa050 2023-07-27T14:27:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8cb99700 1 -- 172.21.15.115:0/2622810803 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800bae0 con 0x7f1c880aa050 2023-07-27T14:27:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 -- 172.21.15.115:0/2622810803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c880aa050 msgr2=0x7f1c880640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/2622810803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c880aa050 0x7f1c880640f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f1c88083e30 tx=0x7f1c780090f0).stop 2023-07-27T14:27:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 -- 172.21.15.115:0/2622810803 shutdown_connections 2023-07-27T14:27:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/2622810803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 0x7f1c880645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/2622810803 >> v2:172.21.15.159:3300/0 conn(0x7f1c88153ec0 0x7f1c880a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/2622810803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c880aa050 0x7f1c880640f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 -- 172.21.15.115:0/2622810803 >> 172.21.15.115:0/2622810803 conn(0x7f1c880cb610 msgr2=0x7f1c880c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 -- 172.21.15.115:0/2622810803 shutdown_connections 2023-07-27T14:27:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.666+0000 7f1c8fdff700 1 -- 172.21.15.115:0/2622810803 wait complete. 2023-07-27T14:27:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.668+0000 7f1c8fdff700 1 Processor -- start 2023-07-27T14:27:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.668+0000 7f1c8fdff700 1 -- start start 2023-07-27T14:27:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8fdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c880aa050 0x7f1c88150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 0x7f1c88152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c88153ec0 0x7f1c881657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c3960 con 0x7f1c88153ec0 2023-07-27T14:27:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8fdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c2db0 con 0x7f1c880aa050 2023-07-27T14:27:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c2fc0 con 0x7f1c880aaa40 2023-07-27T14:27:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8e39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c88153ec0 0x7f1c881657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8db9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c880aa050 0x7f1c88150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8e39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c88153ec0 0x7f1c881657d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54052/0 (socket says 172.21.15.115:54052) 2023-07-27T14:27:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8e39c700 1 -- 172.21.15.115:0/3271367053 learned_addr learned my addr 172.21.15.115:0/3271367053 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:27:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8d39a700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 0x7f1c88152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8e39c700 1 -- 172.21.15.115:0/3271367053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 msgr2=0x7f1c88152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8e39c700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 0x7f1c88152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8e39c700 1 -- 172.21.15.115:0/3271367053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c880aa050 msgr2=0x7f1c88150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8e39c700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c880aa050 0x7f1c88150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.669+0000 7f1c8e39c700 1 -- 172.21.15.115:0/3271367053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78009370 con 0x7f1c88153ec0 2023-07-27T14:27:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.670+0000 7f1c8e39c700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c88153ec0 0x7f1c881657d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f1c80007f20 tx=0x7f1c800098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.670+0000 7f1c7dffb700 1 -- 172.21.15.115:0/3271367053 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8000eb90 con 0x7f1c88153ec0 2023-07-27T14:27:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.670+0000 7f1c7dffb700 1 -- 172.21.15.115:0/3271367053 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8000ecf0 con 0x7f1c88153ec0 2023-07-27T14:27:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.670+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c880c32a0 con 0x7f1c88153ec0 2023-07-27T14:27:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.670+0000 7f1c7dffb700 1 -- 172.21.15.115:0/3271367053 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80014610 con 0x7f1c88153ec0 2023-07-27T14:27:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.670+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8813cbb0 con 0x7f1c88153ec0 2023-07-27T14:27:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.671+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c880c3aa0 con 0x7f1c88153ec0 2023-07-27T14:27:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.672+0000 7f1c7dffb700 1 -- 172.21.15.115:0/3271367053 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1c8001b030 con 0x7f1c88153ec0 2023-07-27T14:27:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.672+0000 7f1c7dffb700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c6c05ed90 0x7f1c6c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:27:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.672+0000 7f1c7dffb700 1 -- 172.21.15.115:0/3271367053 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1c80079af0 con 0x7f1c88153ec0 2023-07-27T14:27:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.673+0000 7f1c8db9b700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c6c05ed90 0x7f1c6c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:27:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.673+0000 7f1c8db9b700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c6c05ed90 0x7f1c6c061250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f1c8400bb10 tx=0x7f1c84008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:27:59.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.677+0000 7f1c7dffb700 1 -- 172.21.15.115:0/3271367053 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c880c3aa0 con 0x7f1c88153ec0 2023-07-27T14:27:59.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.908+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1c880c3aa0 con 0x7f1c88153ec0 2023-07-27T14:27:59.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.912+0000 7f1c7dffb700 1 -- 172.21.15.115:0/3271367053 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1c880c3aa0 con 0x7f1c88153ec0 2023-07-27T14:27:59.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.914+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c6c05ed90 msgr2=0x7f1c6c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.914+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c6c05ed90 0x7f1c6c061250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f1c8400bb10 tx=0x7f1c84008040).stop 2023-07-27T14:27:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.914+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c88153ec0 msgr2=0x7f1c881657d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:27:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.914+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c88153ec0 0x7f1c881657d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f1c80007f20 tx=0x7f1c800098a0).stop 2023-07-27T14:27:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.915+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 shutdown_connections 2023-07-27T14:27:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.915+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c6c05ed90 0x7f1c6c061250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.915+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c88153ec0 0x7f1c881657d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.915+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c880aa050 0x7f1c88150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.915+0000 7f1c8fdff700 1 --2- 172.21.15.115:0/3271367053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c880aaa40 0x7f1c88152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:27:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.915+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 >> 172.21.15.115:0/3271367053 conn(0x7f1c880cb610 msgr2=0x7f1c880abc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:27:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.915+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 shutdown_connections 2023-07-27T14:27:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:27:59.915+0000 7f1c8fdff700 1 -- 172.21.15.115:0/3271367053 wait complete. 2023-07-27T14:27:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:updated 2023-07-27T14:27:59.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-27T14:28:00.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.121+0000 7fa01d7ff700 1 Processor -- start 2023-07-27T14:28:00.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.121+0000 7fa01d7ff700 1 -- start start 2023-07-27T14:28:00.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.122+0000 7fa01d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0180aaa40 0x7fa0180640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.122+0000 7fa01d7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa0181542a0 0x7fa0180645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.122+0000 7fa01d7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0180aa4d0 con 0x7fa018153ec0 2023-07-27T14:28:00.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.122+0000 7fa01d7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa018064ad0 con 0x7fa0181542a0 2023-07-27T14:28:00.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.122+0000 7fa01d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180c05c0 con 0x7fa0180aaa40 2023-07-27T14:28:00.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.122+0000 7fa0177fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa0181542a0 0x7fa0180645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.122+0000 7fa0167fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0180aaa40 0x7fa0180640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa0177fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa0181542a0 0x7fa0180645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:56714/0 (socket says 172.21.15.115:56714) 2023-07-27T14:28:00.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa0177fe700 1 -- 172.21.15.115:0/2071769252 learned_addr learned my addr 172.21.15.115:0/2071769252 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:00.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa016ffd700 1 --1- 172.21.15.115:0/2071769252 >> v1:172.21.15.159:6789/0 conn(0x7fa018153ec0 0x7fa0180a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:37750/0 (socket says 172.21.15.115:37750) 2023-07-27T14:28:00.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa0167fc700 1 -- 172.21.15.115:0/2071769252 >> v2:172.21.15.159:3300/0 conn(0x7fa0181542a0 msgr2=0x7fa0180645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:00.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa0167fc700 1 --2- 172.21.15.115:0/2071769252 >> v2:172.21.15.159:3300/0 conn(0x7fa0181542a0 0x7fa0180645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa0167fc700 1 -- 172.21.15.115:0/2071769252 >> v1:172.21.15.159:6789/0 conn(0x7fa018153ec0 legacy=0x7fa0180a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa0167fc700 1 -- 172.21.15.115:0/2071769252 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180c1a60 con 0x7fa0180aaa40 2023-07-27T14:28:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa015ffb700 1 -- 172.21.15.115:0/2071769252 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434741171 0 0) 0x7fa008001110 con 0x7fa018153ec0 2023-07-27T14:28:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa0177fe700 1 --2- 172.21.15.115:0/2071769252 >> v2:172.21.15.159:3300/0 conn(0x7fa0181542a0 0x7fa0180645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:28:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.123+0000 7fa0167fc700 1 --2- 172.21.15.115:0/2071769252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0180aaa40 0x7fa0180640f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa00c009760 tx=0x7fa00c009060).ready entity=mon.2 client_cookie=e0647b39481d81c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa015ffb700 1 -- 172.21.15.115:0/2071769252 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c00f510 con 0x7fa0180aaa40 2023-07-27T14:28:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa015ffb700 1 -- 172.21.15.115:0/2071769252 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c00f670 con 0x7fa0180aaa40 2023-07-27T14:28:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa015ffb700 1 -- 172.21.15.115:0/2071769252 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c00f9f0 con 0x7fa0180aaa40 2023-07-27T14:28:00.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa01d7ff700 1 -- 172.21.15.115:0/2071769252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0180aaa40 msgr2=0x7fa0180640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/2071769252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0180aaa40 0x7fa0180640f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa00c009760 tx=0x7fa00c009060).stop 2023-07-27T14:28:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa01d7ff700 1 -- 172.21.15.115:0/2071769252 shutdown_connections 2023-07-27T14:28:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/2071769252 >> v2:172.21.15.159:3300/0 conn(0x7fa0181542a0 0x7fa0180645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/2071769252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0180aaa40 0x7fa0180640f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa01d7ff700 1 -- 172.21.15.115:0/2071769252 >> 172.21.15.115:0/2071769252 conn(0x7fa0180cb610 msgr2=0x7fa0180c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa01d7ff700 1 -- 172.21.15.115:0/2071769252 shutdown_connections 2023-07-27T14:28:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.124+0000 7fa01d7ff700 1 -- 172.21.15.115:0/2071769252 wait complete. 2023-07-27T14:28:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.126+0000 7fa01d7ff700 1 Processor -- start 2023-07-27T14:28:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.126+0000 7fa01d7ff700 1 -- start start 2023-07-27T14:28:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa01d7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa0180b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa01d7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa018165910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa01d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0181542a0 0x7fa0181623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa01d7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0181425e0 con 0x7fa018153ec0 2023-07-27T14:28:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa01d7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018166c90 con 0x7fa0180aaa40 2023-07-27T14:28:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa01d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa018165e00 con 0x7fa0181542a0 2023-07-27T14:28:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa0167fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa018165910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa0167fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa018165910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54054/0 (socket says 172.21.15.115:54054) 2023-07-27T14:28:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa0167fc700 1 -- 172.21.15.115:0/3945234892 learned_addr learned my addr 172.21.15.115:0/3945234892 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa0177fe700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0181542a0 0x7fa0181623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.127+0000 7fa016ffd700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa0180b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7fa0167fc700 1 -- 172.21.15.115:0/3945234892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0181542a0 msgr2=0x7fa0181623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7fa0167fc700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0181542a0 0x7fa0181623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7fa0167fc700 1 -- 172.21.15.115:0/3945234892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 msgr2=0x7fa0180b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7fa0167fc700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa0180b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7fa0167fc700 1 -- 172.21.15.115:0/3945234892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010009ae0 con 0x7fa018153ec0 2023-07-27T14:28:00.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7fa0167fc700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa018165910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fa00c011000 tx=0x7fa00c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:00.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7f9ffeffd700 1 -- 172.21.15.115:0/3945234892 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c00f7e0 con 0x7fa018153ec0 2023-07-27T14:28:00.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7f9ffeffd700 1 -- 172.21.15.115:0/3945234892 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c00f960 con 0x7fa018153ec0 2023-07-27T14:28:00.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7f9ffeffd700 1 -- 172.21.15.115:0/3945234892 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c01b660 con 0x7fa018153ec0 2023-07-27T14:28:00.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c0092a0 con 0x7fa018153ec0 2023-07-27T14:28:00.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.128+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa018166360 con 0x7fa018153ec0 2023-07-27T14:28:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.129+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa018166e00 con 0x7fa018153ec0 2023-07-27T14:28:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.130+0000 7f9ffeffd700 1 -- 172.21.15.115:0/3945234892 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fa00c00f070 con 0x7fa018153ec0 2023-07-27T14:28:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.131+0000 7f9ffeffd700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa00405ed90 0x7fa004061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.131+0000 7f9ffeffd700 1 -- 172.21.15.115:0/3945234892 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa00c07b100 con 0x7fa018153ec0 2023-07-27T14:28:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.131+0000 7fa016ffd700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa00405ed90 0x7fa004061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.131+0000 7fa016ffd700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa00405ed90 0x7fa004061250 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa0180b0810 tx=0x7fa008007a10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.135+0000 7f9ffeffd700 1 -- 172.21.15.115:0/3945234892 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa00c04c990 con 0x7fa018153ec0 2023-07-27T14:28:00.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.365+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa01806c470 con 0x7fa018153ec0 2023-07-27T14:28:00.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.369+0000 7f9ffeffd700 1 -- 172.21.15.115:0/3945234892 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa00c028070 con 0x7fa018153ec0 2023-07-27T14:28:00.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa00405ed90 msgr2=0x7fa004061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa00405ed90 0x7fa004061250 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa0180b0810 tx=0x7fa008007a10).stop 2023-07-27T14:28:00.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 msgr2=0x7fa018165910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa018165910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fa00c011000 tx=0x7fa00c017000).stop 2023-07-27T14:28:00.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 shutdown_connections 2023-07-27T14:28:00.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa00405ed90 0x7fa004061250 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0181542a0 0x7fa0181623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa0180b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 --2- 172.21.15.115:0/3945234892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa018165910 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 >> 172.21.15.115:0/3945234892 conn(0x7fa0180cb610 msgr2=0x7fa0180ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:00.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 shutdown_connections 2023-07-27T14:28:00.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.371+0000 7fa01d7ff700 1 -- 172.21.15.115:0/3945234892 wait complete. 2023-07-27T14:28:00.391 INFO:teuthology.orchestra.run.smithi115.stderr:updated 2023-07-27T14:28:00.406 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-27T14:28:00.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.578+0000 7fdabc1ff700 1 Processor -- start 2023-07-27T14:28:00.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.578+0000 7fdabc1ff700 1 -- start start 2023-07-27T14:28:00.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdabc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdabc1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdab40aa050 0x7fdab40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdabc1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab40aa4d0 con 0x7fdab40aaa40 2023-07-27T14:28:00.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdabc1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab40c05c0 con 0x7fdab40aa050 2023-07-27T14:28:00.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdabc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c1a60 con 0x7fdab4153ec0 2023-07-27T14:28:00.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdaba79c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdab40aaa40 0x7fdab4157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50022/0 (socket says 172.21.15.115:50022) 2023-07-27T14:28:00.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdaba79c700 1 -- 172.21.15.115:0/1156092786 learned_addr learned my addr 172.21.15.115:0/1156092786 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdab979a700 1 --2- 172.21.15.115:0/1156092786 >> v2:172.21.15.159:3300/0 conn(0x7fdab40aa050 0x7fdab40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.579+0000 7fdab9f9b700 1 --2- 172.21.15.115:0/1156092786 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab8f99700 1 -- 172.21.15.115:0/1156092786 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970955344 0 0) 0x7fdaac001490 con 0x7fdab40aaa40 2023-07-27T14:28:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab8f99700 1 -- 172.21.15.115:0/1156092786 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa00033f0 con 0x7fdab40aaa40 2023-07-27T14:28:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab8f99700 1 -- 172.21.15.115:0/1156092786 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1674269501 0 0) 0x7fdaa00033f0 con 0x7fdab40aaa40 2023-07-27T14:28:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab9f9b700 1 -- 172.21.15.115:0/1156092786 >> v2:172.21.15.159:3300/0 conn(0x7fdab40aa050 msgr2=0x7fdab40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab9f9b700 1 --2- 172.21.15.115:0/1156092786 >> v2:172.21.15.159:3300/0 conn(0x7fdab40aa050 0x7fdab40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab9f9b700 1 -- 172.21.15.115:0/1156092786 >> v1:172.21.15.115:6789/0 conn(0x7fdab40aaa40 legacy=0x7fdab4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab9f9b700 1 -- 172.21.15.115:0/1156092786 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40bfc90 con 0x7fdab4153ec0 2023-07-27T14:28:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab979a700 1 --2- 172.21.15.115:0/1156092786 >> v2:172.21.15.159:3300/0 conn(0x7fdab40aa050 0x7fdab40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:28:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab9f9b700 1 --2- 172.21.15.115:0/1156092786 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a9b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdab0009760 tx=0x7fdab0009060).ready entity=mon.2 client_cookie=12510c2b44a81b84 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.580+0000 7fdab8f99700 1 -- 172.21.15.115:0/1156092786 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac001980 con 0x7fdab4153ec0 2023-07-27T14:28:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdab8f99700 1 -- 172.21.15.115:0/1156092786 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab0011400 con 0x7fdab4153ec0 2023-07-27T14:28:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdab8f99700 1 -- 172.21.15.115:0/1156092786 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0011780 con 0x7fdab4153ec0 2023-07-27T14:28:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdabc1ff700 1 -- 172.21.15.115:0/1156092786 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 msgr2=0x7fdab40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/1156092786 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a9b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdab0009760 tx=0x7fdab0009060).stop 2023-07-27T14:28:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdabc1ff700 1 -- 172.21.15.115:0/1156092786 shutdown_connections 2023-07-27T14:28:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/1156092786 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a9b60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/1156092786 >> v2:172.21.15.159:3300/0 conn(0x7fdab40aa050 0x7fdab40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdabc1ff700 1 -- 172.21.15.115:0/1156092786 >> 172.21.15.115:0/1156092786 conn(0x7fdab40cb610 msgr2=0x7fdab40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:00.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdabc1ff700 1 -- 172.21.15.115:0/1156092786 shutdown_connections 2023-07-27T14:28:00.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.581+0000 7fdabc1ff700 1 -- 172.21.15.115:0/1156092786 wait complete. 2023-07-27T14:28:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.583+0000 7fdabc1ff700 1 Processor -- start 2023-07-27T14:28:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.583+0000 7fdabc1ff700 1 -- start start 2023-07-27T14:28:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdabc1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab40aa050 0x7fdab41456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdabc1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdab40aaa40 0x7fdab40a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdabc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdabc1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40a22b0 con 0x7fdab40aa050 2023-07-27T14:28:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdabc1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c3c80 con 0x7fdab40aaa40 2023-07-27T14:28:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdabc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c3f60 con 0x7fdab4153ec0 2023-07-27T14:28:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab40aa050 0x7fdab41456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab40aa050 0x7fdab41456d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54064/0 (socket says 172.21.15.115:54064) 2023-07-27T14:28:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 -- 172.21.15.115:0/4283055223 learned_addr learned my addr 172.21.15.115:0/4283055223 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdaba79c700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab979a700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdab40aaa40 0x7fdab40a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 -- 172.21.15.115:0/4283055223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 msgr2=0x7fdab40a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 -- 172.21.15.115:0/4283055223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdab40aaa40 msgr2=0x7fdab40a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdab40aaa40 0x7fdab40a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 -- 172.21.15.115:0/4283055223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40092a0 con 0x7fdab40aa050 2023-07-27T14:28:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.584+0000 7fdab9f9b700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab40aa050 0x7fdab41456d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fdab0009d50 tx=0x7fdab0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.585+0000 7fdaa9ffb700 1 -- 172.21.15.115:0/4283055223 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0021070 con 0x7fdab40aa050 2023-07-27T14:28:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.585+0000 7fdaa9ffb700 1 -- 172.21.15.115:0/4283055223 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab00108b0 con 0x7fdab40aa050 2023-07-27T14:28:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.585+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab00092a0 con 0x7fdab40aa050 2023-07-27T14:28:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.585+0000 7fdaa9ffb700 1 -- 172.21.15.115:0/4283055223 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0010c30 con 0x7fdab40aa050 2023-07-27T14:28:00.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.585+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab40c4520 con 0x7fdab40aa050 2023-07-27T14:28:00.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.586+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab406c470 con 0x7fdab40aa050 2023-07-27T14:28:00.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.587+0000 7fdaa9ffb700 1 -- 172.21.15.115:0/4283055223 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdab000f070 con 0x7fdab40aa050 2023-07-27T14:28:00.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.587+0000 7fdaa9ffb700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda9805ed60 0x7fda98061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:00.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.587+0000 7fdaa9ffb700 1 -- 172.21.15.115:0/4283055223 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdab007a8a0 con 0x7fdab40aa050 2023-07-27T14:28:00.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.588+0000 7fdab979a700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda9805ed60 0x7fda98061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:00.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.588+0000 7fdab979a700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda9805ed60 0x7fda98061220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdaa4009270 tx=0x7fdaa4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:00.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.592+0000 7fdaa9ffb700 1 -- 172.21.15.115:0/4283055223 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdab004c190 con 0x7fdab40aa050 2023-07-27T14:28:00.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.822+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fdab40c8230 con 0x7fdab40aa050 2023-07-27T14:28:00.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.828+0000 7fdaa9ffb700 1 -- 172.21.15.115:0/4283055223 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdab004f7b0 con 0x7fdab40aa050 2023-07-27T14:28:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda9805ed60 msgr2=0x7fda98061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda9805ed60 0x7fda98061220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdaa4009270 tx=0x7fdaa4008040).stop 2023-07-27T14:28:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab40aa050 msgr2=0x7fdab41456d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab40aa050 0x7fdab41456d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fdab0009d50 tx=0x7fdab0016000).stop 2023-07-27T14:28:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 shutdown_connections 2023-07-27T14:28:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda9805ed60 0x7fda98061220 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdab4153ec0 0x7fdab40a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdab40aa050 0x7fdab41456d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 --2- 172.21.15.115:0/4283055223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdab40aaa40 0x7fdab40a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.830+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 >> 172.21.15.115:0/4283055223 conn(0x7fdab40cb610 msgr2=0x7fdab40ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.831+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 shutdown_connections 2023-07-27T14:28:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:00.831+0000 7fdabc1ff700 1 -- 172.21.15.115:0/4283055223 wait complete. 2023-07-27T14:28:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:updated 2023-07-27T14:28:00.865 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-27T14:28:01.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.034+0000 7f71a1fff700 1 Processor -- start 2023-07-27T14:28:01.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.035+0000 7f71a1fff700 1 -- start start 2023-07-27T14:28:01.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.036+0000 7f71a1fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f719c0a4840 0x7f719c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.036+0000 7f71a1fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f719c0bc050 0x7f719c0bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.036+0000 7f71a1fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0639d0 con 0x7f719c151bd0 2023-07-27T14:28:01.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.036+0000 7f71a1fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c137610 con 0x7f719c0a4840 2023-07-27T14:28:01.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.036+0000 7f71a1fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0a51b0 con 0x7f719c0bc050 2023-07-27T14:28:01.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.036+0000 7f719affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f719c0a4840 0x7f719c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.036+0000 7f719affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f719c0a4840 0x7f719c0a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54078/0 (socket says 172.21.15.115:54078) 2023-07-27T14:28:01.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.036+0000 7f719affd700 1 -- 172.21.15.115:0/3931888099 learned_addr learned my addr 172.21.15.115:0/3931888099 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:01.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719bfff700 1 --2- 172.21.15.115:0/3931888099 >> v2:172.21.15.159:3300/0 conn(0x7f719c0bc050 0x7f719c0bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719affd700 1 -- 172.21.15.115:0/3931888099 >> v2:172.21.15.159:3300/0 conn(0x7f719c0bc050 msgr2=0x7f719c0bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719affd700 1 --2- 172.21.15.115:0/3931888099 >> v2:172.21.15.159:3300/0 conn(0x7f719c0bc050 0x7f719c0bc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719affd700 1 -- 172.21.15.115:0/3931888099 >> v1:172.21.15.159:6789/0 conn(0x7f719c151bd0 legacy=0x7f719c062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719affd700 1 -- 172.21.15.115:0/3931888099 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c062dc0 con 0x7f719c0a4840 2023-07-27T14:28:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719affd700 1 --2- 172.21.15.115:0/3931888099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c0a4840 0x7f719c0a4cc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f719c065780 tx=0x7f71900090f0).ready entity=mon.0 client_cookie=d36469967d11f254 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719a7fc700 1 -- 172.21.15.115:0/3931888099 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000b5a0 con 0x7f719c0a4840 2023-07-27T14:28:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719a7fc700 1 -- 172.21.15.115:0/3931888099 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719000b700 con 0x7f719c0a4840 2023-07-27T14:28:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.037+0000 7f719a7fc700 1 -- 172.21.15.115:0/3931888099 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000ba80 con 0x7f719c0a4840 2023-07-27T14:28:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.038+0000 7f71a1fff700 1 -- 172.21.15.115:0/3931888099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c0a4840 msgr2=0x7f719c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.038+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3931888099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c0a4840 0x7f719c0a4cc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f719c065780 tx=0x7f71900090f0).stop 2023-07-27T14:28:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.038+0000 7f71a1fff700 1 -- 172.21.15.115:0/3931888099 shutdown_connections 2023-07-27T14:28:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.038+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3931888099 >> v2:172.21.15.159:3300/0 conn(0x7f719c0bc050 0x7f719c0bc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.038+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3931888099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c0a4840 0x7f719c0a4cc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.038+0000 7f71a1fff700 1 -- 172.21.15.115:0/3931888099 >> 172.21.15.115:0/3931888099 conn(0x7f719c064700 msgr2=0x7f719c064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.038+0000 7f71a1fff700 1 -- 172.21.15.115:0/3931888099 shutdown_connections 2023-07-27T14:28:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.038+0000 7f71a1fff700 1 -- 172.21.15.115:0/3931888099 wait complete. 2023-07-27T14:28:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.039+0000 7f71a1fff700 1 Processor -- start 2023-07-27T14:28:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.039+0000 7f71a1fff700 1 -- start start 2023-07-27T14:28:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.040+0000 7f71a1fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c0a4840 0x7f719c1680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.040+0000 7f71a1fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c0bc050 0x7f719c13c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.040+0000 7f71a1fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151bd0 0x7f719c13b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.040+0000 7f71a1fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c13afe0 con 0x7f719c151bd0 2023-07-27T14:28:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.040+0000 7f71a1fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c168910 con 0x7f719c0bc050 2023-07-27T14:28:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.040+0000 7f71a1fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c168bf0 con 0x7f719c0a4840 2023-07-27T14:28:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151bd0 0x7f719c13b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151bd0 0x7f719c13b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54086/0 (socket says 172.21.15.115:54086) 2023-07-27T14:28:01.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 -- 172.21.15.115:0/3988500807 learned_addr learned my addr 172.21.15.115:0/3988500807 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:01.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719affd700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c0bc050 0x7f719c13c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719b7fe700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c0a4840 0x7f719c1680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 -- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c0a4840 msgr2=0x7f719c1680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c0a4840 0x7f719c1680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 -- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c0bc050 msgr2=0x7f719c13c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c0bc050 0x7f719c13c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 -- 172.21.15.115:0/3988500807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7190009370 con 0x7f719c151bd0 2023-07-27T14:28:01.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719b7fe700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c0a4840 0x7f719c1680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:01.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f719bfff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151bd0 0x7f719c13b470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f7194009fa0 tx=0x7f7194009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f71837fe700 1 -- 172.21.15.115:0/3988500807 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400ed20 con 0x7f719c151bd0 2023-07-27T14:28:01.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f71837fe700 1 -- 172.21.15.115:0/3988500807 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719400ee80 con 0x7f719c151bd0 2023-07-27T14:28:01.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f71837fe700 1 -- 172.21.15.115:0/3988500807 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194014610 con 0x7f719c151bd0 2023-07-27T14:28:01.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.041+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c13ac70 con 0x7f719c151bd0 2023-07-27T14:28:01.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.042+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c13cd20 con 0x7f719c151bd0 2023-07-27T14:28:01.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.043+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c06c470 con 0x7f719c151bd0 2023-07-27T14:28:01.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.043+0000 7f71837fe700 1 -- 172.21.15.115:0/3988500807 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f719401b030 con 0x7f719c151bd0 2023-07-27T14:28:01.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.044+0000 7f71837fe700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805ed90 0x7f7188061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.044+0000 7f71837fe700 1 -- 172.21.15.115:0/3988500807 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7194079d90 con 0x7f719c151bd0 2023-07-27T14:28:01.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.044+0000 7f719b7fe700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805ed90 0x7f7188061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.045+0000 7f719b7fe700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805ed90 0x7f7188061250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f718c0026f0 tx=0x7f718c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.048+0000 7f71837fe700 1 -- 172.21.15.115:0/3988500807 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f719404b570 con 0x7f719c151bd0 2023-07-27T14:28:01.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-27T14:28:01.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.283+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f719c13b120 con 0x7f719c151bd0 2023-07-27T14:28:01.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.290+0000 7f71837fe700 1 -- 172.21.15.115:0/3988500807 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f719404eb90 con 0x7f719c151bd0 2023-07-27T14:28:01.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805ed90 msgr2=0x7f7188061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805ed90 0x7f7188061250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f718c0026f0 tx=0x7f718c009040).stop 2023-07-27T14:28:01.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151bd0 msgr2=0x7f719c13b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151bd0 0x7f719c13b470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f7194009fa0 tx=0x7f7194009900).stop 2023-07-27T14:28:01.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 shutdown_connections 2023-07-27T14:28:01.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805ed90 0x7f7188061250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151bd0 0x7f719c13b470 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c0a4840 0x7f719c1680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 --2- 172.21.15.115:0/3988500807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c0bc050 0x7f719c13c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 >> 172.21.15.115:0/3988500807 conn(0x7f719c064700 msgr2=0x7f719c152480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:01.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 shutdown_connections 2023-07-27T14:28:01.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.292+0000 7f71a1fff700 1 -- 172.21.15.115:0/3988500807 wait complete. 2023-07-27T14:28:01.312 INFO:teuthology.orchestra.run.smithi115.stderr:updated 2023-07-27T14:28:01.327 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:28:01.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.498+0000 7f10c919d700 1 Processor -- start 2023-07-27T14:28:01.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.498+0000 7f10c919d700 1 -- start start 2023-07-27T14:28:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.499+0000 7f10c919d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f10c4153bb0 0x7f10c40c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.499+0000 7f10c919d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153f90 0x7f10c4062c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.499+0000 7f10c919d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c40c0bd0 con 0x7f10c40c60d0 2023-07-27T14:28:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.499+0000 7f10c919d700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c40bffc0 con 0x7f10c4153bb0 2023-07-27T14:28:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.499+0000 7f10c919d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40c02a0 con 0x7f10c4153f90 2023-07-27T14:28:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f10c40c60d0 0x7f10c40c1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50034/0 (socket says 172.21.15.115:50034) 2023-07-27T14:28:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c37fe700 1 -- 172.21.15.115:0/1399919295 learned_addr learned my addr 172.21.15.115:0/1399919295 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c899c700 1 --2- 172.21.15.115:0/1399919295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153f90 0x7f10c4062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c3fff700 1 --2- 172.21.15.115:0/1399919295 >> v2:172.21.15.159:3300/0 conn(0x7f10c4153bb0 0x7f10c40c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c2ffd700 1 -- 172.21.15.115:0/1399919295 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862528576 0 0) 0x7f10c40c0bd0 con 0x7f10c40c60d0 2023-07-27T14:28:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c2ffd700 1 -- 172.21.15.115:0/1399919295 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ac0033f0 con 0x7f10c40c60d0 2023-07-27T14:28:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c899c700 1 -- 172.21.15.115:0/1399919295 >> v2:172.21.15.159:3300/0 conn(0x7f10c4153bb0 msgr2=0x7f10c40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c899c700 1 --2- 172.21.15.115:0/1399919295 >> v2:172.21.15.159:3300/0 conn(0x7f10c4153bb0 0x7f10c40c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c2ffd700 1 -- 172.21.15.115:0/1399919295 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2076843595 0 0) 0x7f10ac0033f0 con 0x7f10c40c60d0 2023-07-27T14:28:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c899c700 1 -- 172.21.15.115:0/1399919295 >> v1:172.21.15.115:6789/0 conn(0x7f10c40c60d0 legacy=0x7f10c40c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c899c700 1 -- 172.21.15.115:0/1399919295 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c40c0580 con 0x7f10c4153f90 2023-07-27T14:28:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.500+0000 7f10c3fff700 1 --2- 172.21.15.115:0/1399919295 >> v2:172.21.15.159:3300/0 conn(0x7f10c4153bb0 0x7f10c40c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:28:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c899c700 1 --2- 172.21.15.115:0/1399919295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153f90 0x7f10c4062c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f10bc009e60 tx=0x7f10bc009780).ready entity=mon.2 client_cookie=36e809919bf8f42d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c2ffd700 1 -- 172.21.15.115:0/1399919295 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00e070 con 0x7f10c4153f90 2023-07-27T14:28:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c2ffd700 1 -- 172.21.15.115:0/1399919295 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc00b7a0 con 0x7f10c4153f90 2023-07-27T14:28:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c2ffd700 1 -- 172.21.15.115:0/1399919295 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8001470 con 0x7f10c4153f90 2023-07-27T14:28:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c919d700 1 -- 172.21.15.115:0/1399919295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153f90 msgr2=0x7f10c4062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c919d700 1 --2- 172.21.15.115:0/1399919295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153f90 0x7f10c4062c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f10bc009e60 tx=0x7f10bc009780).stop 2023-07-27T14:28:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c919d700 1 -- 172.21.15.115:0/1399919295 shutdown_connections 2023-07-27T14:28:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c919d700 1 --2- 172.21.15.115:0/1399919295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153f90 0x7f10c4062c00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c919d700 1 --2- 172.21.15.115:0/1399919295 >> v2:172.21.15.159:3300/0 conn(0x7f10c4153bb0 0x7f10c40c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c919d700 1 -- 172.21.15.115:0/1399919295 >> 172.21.15.115:0/1399919295 conn(0x7f10c405e940 msgr2=0x7f10c40cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.501+0000 7f10c919d700 1 -- 172.21.15.115:0/1399919295 shutdown_connections 2023-07-27T14:28:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.502+0000 7f10c919d700 1 -- 172.21.15.115:0/1399919295 wait complete. 2023-07-27T14:28:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.503+0000 7f10c919d700 1 Processor -- start 2023-07-27T14:28:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.503+0000 7f10c919d700 1 -- start start 2023-07-27T14:28:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c919d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c40c60d0 0x7f10c414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c919d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153bb0 0x7f10c4155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c919d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c4153f90 0x7f10c40ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c919d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40c2df0 con 0x7f10c4153f90 2023-07-27T14:28:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c919d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c4155e90 con 0x7f10c40c60d0 2023-07-27T14:28:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c919d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c4156170 con 0x7f10c4153bb0 2023-07-27T14:28:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c899c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c4153f90 0x7f10c40ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c899c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c4153f90 0x7f10c40ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54100/0 (socket says 172.21.15.115:54100) 2023-07-27T14:28:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c899c700 1 -- 172.21.15.115:0/2555319672 learned_addr learned my addr 172.21.15.115:0/2555319672 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c3fff700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c40c60d0 0x7f10c414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.504+0000 7f10c37fe700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153bb0 0x7f10c4155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c899c700 1 -- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153bb0 msgr2=0x7f10c4155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c899c700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153bb0 0x7f10c4155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c899c700 1 -- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c40c60d0 msgr2=0x7f10c414d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c899c700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c40c60d0 0x7f10c414d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c899c700 1 -- 172.21.15.115:0/2555319672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40092a0 con 0x7f10c4153f90 2023-07-27T14:28:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c3fff700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c40c60d0 0x7f10c414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c899c700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c4153f90 0x7f10c40ade90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f10c40c03e0 tx=0x7f10bc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10abfff700 1 -- 172.21.15.115:0/2555319672 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc01d420 con 0x7f10c4153f90 2023-07-27T14:28:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10abfff700 1 -- 172.21.15.115:0/2555319672 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc01d580 con 0x7f10c4153f90 2023-07-27T14:28:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc009a20 con 0x7f10c4153f90 2023-07-27T14:28:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10abfff700 1 -- 172.21.15.115:0/2555319672 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc01d920 con 0x7f10c4153f90 2023-07-27T14:28:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.505+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c4156730 con 0x7f10c4153f90 2023-07-27T14:28:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.506+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c40c2f60 con 0x7f10c4153f90 2023-07-27T14:28:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.507+0000 7f10abfff700 1 -- 172.21.15.115:0/2555319672 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f10bc01dd10 con 0x7f10c4153f90 2023-07-27T14:28:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.508+0000 7f10abfff700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10b005ed90 0x7f10b0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.508+0000 7f10abfff700 1 -- 172.21.15.115:0/2555319672 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f10bc07b860 con 0x7f10c4153f90 2023-07-27T14:28:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.508+0000 7f10c3fff700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10b005ed90 0x7f10b0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.509+0000 7f10c3fff700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10b005ed90 0x7f10b0061250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f10b4009270 tx=0x7f10b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.513+0000 7f10abfff700 1 -- 172.21.15.115:0/2555319672 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10bc04d040 con 0x7f10c4153f90 2023-07-27T14:28:01.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.689+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10c40c0860 con 0x7f10c4153f90 2023-07-27T14:28:01.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.690+0000 7f10abfff700 1 -- 172.21.15.115:0/2555319672 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f10bc050660 con 0x7f10c4153f90 2023-07-27T14:28:01.708 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:01.708 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":32,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:27:58.046345+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:28:01.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10b005ed90 msgr2=0x7f10b0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10b005ed90 0x7f10b0061250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f10b4009270 tx=0x7f10b4008040).stop 2023-07-27T14:28:01.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c4153f90 msgr2=0x7f10c40ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c4153f90 0x7f10c40ade90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f10c40c03e0 tx=0x7f10bc009780).stop 2023-07-27T14:28:01.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 shutdown_connections 2023-07-27T14:28:01.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10b005ed90 0x7f10b0061250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c4153f90 0x7f10c40ade90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c40c60d0 0x7f10c414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 --2- 172.21.15.115:0/2555319672 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4153bb0 0x7f10c4155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 >> 172.21.15.115:0/2555319672 conn(0x7f10c405e940 msgr2=0x7f10c40acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:01.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 shutdown_connections 2023-07-27T14:28:01.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.692+0000 7f10c919d700 1 -- 172.21.15.115:0/2555319672 wait complete. 2023-07-27T14:28:01.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:28:01.728 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:28:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.900+0000 7feff7fff700 1 Processor -- start 2023-07-27T14:28:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.900+0000 7feff7fff700 1 -- start start 2023-07-27T14:28:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.901+0000 7feff7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.901+0000 7feff7fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff01553f0 con 0x7feff014b1e0 2023-07-27T14:28:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff7fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff0157a50 con 0x7feff014ae00 2023-07-27T14:28:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff0157d10 con 0x7feff0063260 2023-07-27T14:28:01.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7feff014b1e0 0x7feff00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50036/0 (socket says 172.21.15.115:50036) 2023-07-27T14:28:01.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff659c700 1 -- 172.21.15.115:0/3514854118 learned_addr learned my addr 172.21.15.115:0/3514854118 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:01.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff559a700 1 --2- 172.21.15.115:0/3514854118 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff4d99700 1 -- 172.21.15.115:0/3514854118 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615786415 0 0) 0x7feff01553f0 con 0x7feff014b1e0 2023-07-27T14:28:01.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff4d99700 1 -- 172.21.15.115:0/3514854118 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefdc0033f0 con 0x7feff014b1e0 2023-07-27T14:28:01.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff4d99700 1 -- 172.21.15.115:0/3514854118 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583660950 0 0) 0x7feff0157a50 con 0x7feff014ae00 2023-07-27T14:28:01.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff4d99700 1 -- 172.21.15.115:0/3514854118 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff01553f0 con 0x7feff014ae00 2023-07-27T14:28:01.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff559a700 1 -- 172.21.15.115:0/3514854118 >> v1:172.21.15.159:6789/0 conn(0x7feff014ae00 legacy=0x7feff0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff4d99700 1 -- 172.21.15.115:0/3514854118 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 786123709 0 0) 0x7fefdc0033f0 con 0x7feff014b1e0 2023-07-27T14:28:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.902+0000 7feff559a700 1 -- 172.21.15.115:0/3514854118 >> v1:172.21.15.115:6789/0 conn(0x7feff014b1e0 legacy=0x7feff00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.903+0000 7feff559a700 1 -- 172.21.15.115:0/3514854118 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0157ff0 con 0x7feff0063260 2023-07-27T14:28:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.903+0000 7feff559a700 1 --2- 172.21.15.115:0/3514854118 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff0154f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fefe0009790 tx=0x7fefe0009060).ready entity=mon.2 client_cookie=8d87a75153d76ec7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.903+0000 7feff4d99700 1 -- 172.21.15.115:0/3514854118 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80017f0 con 0x7feff0063260 2023-07-27T14:28:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.903+0000 7feff4d99700 1 -- 172.21.15.115:0/3514854118 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0011400 con 0x7feff0063260 2023-07-27T14:28:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.903+0000 7feff4d99700 1 -- 172.21.15.115:0/3514854118 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0011780 con 0x7feff0063260 2023-07-27T14:28:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.903+0000 7feff7fff700 1 -- 172.21.15.115:0/3514854118 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 msgr2=0x7feff0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.903+0000 7feff7fff700 1 --2- 172.21.15.115:0/3514854118 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff0154f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fefe0009790 tx=0x7fefe0009060).stop 2023-07-27T14:28:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.904+0000 7feff7fff700 1 -- 172.21.15.115:0/3514854118 shutdown_connections 2023-07-27T14:28:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.904+0000 7feff7fff700 1 --2- 172.21.15.115:0/3514854118 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff0154f00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.904+0000 7feff7fff700 1 -- 172.21.15.115:0/3514854118 >> 172.21.15.115:0/3514854118 conn(0x7feff005e940 msgr2=0x7feff00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.904+0000 7feff7fff700 1 -- 172.21.15.115:0/3514854118 shutdown_connections 2023-07-27T14:28:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.904+0000 7feff7fff700 1 -- 172.21.15.115:0/3514854118 wait complete. 2023-07-27T14:28:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.905+0000 7feff7fff700 1 Processor -- start 2023-07-27T14:28:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.905+0000 7feff7fff700 1 -- start start 2023-07-27T14:28:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff00adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feff014ae00 0x7feff0148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feff014b1e0 0x7feff00a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00ae9a0 con 0x7feff014b1e0 2023-07-27T14:28:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00ae100 con 0x7feff014ae00 2023-07-27T14:28:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff00ae3e0 con 0x7feff0063260 2023-07-27T14:28:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feff014b1e0 0x7feff00a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feff014b1e0 0x7feff00a8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54102/0 (socket says 172.21.15.115:54102) 2023-07-27T14:28:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.906+0000 7feff659c700 1 -- 172.21.15.115:0/22961074 learned_addr learned my addr 172.21.15.115:0/22961074 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:01.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff5d9b700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff00adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff559a700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feff014ae00 0x7feff0148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff659c700 1 -- 172.21.15.115:0/22961074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 msgr2=0x7feff00adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff659c700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff00adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff659c700 1 -- 172.21.15.115:0/22961074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feff014ae00 msgr2=0x7feff0148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:01.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff659c700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feff014ae00 0x7feff0148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:01.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff659c700 1 -- 172.21.15.115:0/22961074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe00092a0 con 0x7feff014b1e0 2023-07-27T14:28:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff659c700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feff014b1e0 0x7feff00a8ca0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fefe800cb70 tx=0x7fefe8007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7fefe5ffb700 1 -- 172.21.15.115:0/22961074 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8004c40 con 0x7feff014b1e0 2023-07-27T14:28:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7fefe5ffb700 1 -- 172.21.15.115:0/22961074 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe8004da0 con 0x7feff014b1e0 2023-07-27T14:28:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7fefe5ffb700 1 -- 172.21.15.115:0/22961074 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8007380 con 0x7feff014b1e0 2023-07-27T14:28:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff00ae6c0 con 0x7feff014b1e0 2023-07-27T14:28:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.907+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff00b0b00 con 0x7feff014b1e0 2023-07-27T14:28:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.908+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff00c2030 con 0x7feff014b1e0 2023-07-27T14:28:01.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.909+0000 7fefe5ffb700 1 -- 172.21.15.115:0/22961074 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fefe8010070 con 0x7feff014b1e0 2023-07-27T14:28:01.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.910+0000 7fefe5ffb700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefd405ed90 0x7fefd4061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:01.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.911+0000 7fefe5ffb700 1 -- 172.21.15.115:0/22961074 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fefe8079590 con 0x7feff014b1e0 2023-07-27T14:28:01.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.911+0000 7feff5d9b700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefd405ed90 0x7fefd4061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:01.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.911+0000 7feff5d9b700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefd405ed90 0x7fefd4061250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fefec003700 tx=0x7fefec009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:01.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:01.915+0000 7fefe5ffb700 1 -- 172.21.15.115:0/22961074 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feff00c2030 con 0x7feff014b1e0 2023-07-27T14:28:02.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.083+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feff00c2030 con 0x7feff014b1e0 2023-07-27T14:28:02.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.083+0000 7fefe5ffb700 1 -- 172.21.15.115:0/22961074 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v32) v1 ==== 110+0+10 (secure 0 0 0) 0x7feff00c2030 con 0x7feff014b1e0 2023-07-27T14:28:02.101 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:28:02.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefd405ed90 msgr2=0x7fefd4061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefd405ed90 0x7fefd4061250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fefec003700 tx=0x7fefec009040).stop 2023-07-27T14:28:02.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feff014b1e0 msgr2=0x7feff00a8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feff014b1e0 0x7feff00a8ca0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fefe800cb70 tx=0x7fefe8007bd0).stop 2023-07-27T14:28:02.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 shutdown_connections 2023-07-27T14:28:02.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefd405ed90 0x7fefd4061250 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feff014b1e0 0x7feff00a8ca0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feff0063260 0x7feff00adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 --2- 172.21.15.115:0/22961074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feff014ae00 0x7feff0148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 >> 172.21.15.115:0/22961074 conn(0x7feff005e940 msgr2=0x7feff0149820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:02.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 shutdown_connections 2023-07-27T14:28:02.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.085+0000 7feff7fff700 1 -- 172.21.15.115:0/22961074 wait complete. 2023-07-27T14:28:02.120 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:28:02.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.291+0000 7f71661ff700 1 Processor -- start 2023-07-27T14:28:02.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.291+0000 7f71661ff700 1 -- start start 2023-07-27T14:28:02.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.292+0000 7f71661ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7160063260 0x7f7160154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.292+0000 7f71661ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014b1e0 0x7f71600a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.292+0000 7f71661ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71601553f0 con 0x7f716014ae00 2023-07-27T14:28:02.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.292+0000 7f71661ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7160157a50 con 0x7f7160063260 2023-07-27T14:28:02.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.292+0000 7f71661ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7160157d10 con 0x7f716014b1e0 2023-07-27T14:28:02.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715effd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7160063260 0x7f7160154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715f7fe700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f716014ae00 0x7f7160062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:37768/0 (socket says 172.21.15.115:37768) 2023-07-27T14:28:02.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715f7fe700 1 -- 172.21.15.115:0/132316676 learned_addr learned my addr 172.21.15.115:0/132316676 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:02.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715effd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7160063260 0x7f7160154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:56806/0 (socket says 172.21.15.115:56806) 2023-07-27T14:28:02.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715ffff700 1 --2- 172.21.15.115:0/132316676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014b1e0 0x7f71600a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715effd700 1 -- 172.21.15.115:0/132316676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014b1e0 msgr2=0x7f71600a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:02.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715effd700 1 --2- 172.21.15.115:0/132316676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014b1e0 0x7f71600a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715effd700 1 -- 172.21.15.115:0/132316676 >> v1:172.21.15.159:6789/0 conn(0x7f716014ae00 legacy=0x7f7160062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.293+0000 7f715effd700 1 -- 172.21.15.115:0/132316676 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160157ff0 con 0x7f7160063260 2023-07-27T14:28:02.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f715effd700 1 --2- 172.21.15.115:0/132316676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7160063260 0x7f7160154f00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f7154009760 tx=0x7f7154009060).ready entity=mon.1 client_cookie=8715fd25cce7b372 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:02.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f715e7fc700 1 -- 172.21.15.115:0/132316676 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715400f510 con 0x7f7160063260 2023-07-27T14:28:02.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f715e7fc700 1 -- 172.21.15.115:0/132316676 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715400f670 con 0x7f7160063260 2023-07-27T14:28:02.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f715e7fc700 1 -- 172.21.15.115:0/132316676 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715400f9f0 con 0x7f7160063260 2023-07-27T14:28:02.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f71661ff700 1 -- 172.21.15.115:0/132316676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7160063260 msgr2=0x7f7160154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f71661ff700 1 --2- 172.21.15.115:0/132316676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7160063260 0x7f7160154f00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f7154009760 tx=0x7f7154009060).stop 2023-07-27T14:28:02.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f71661ff700 1 -- 172.21.15.115:0/132316676 shutdown_connections 2023-07-27T14:28:02.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f71661ff700 1 --2- 172.21.15.115:0/132316676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014b1e0 0x7f71600a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f71661ff700 1 --2- 172.21.15.115:0/132316676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7160063260 0x7f7160154f00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.294+0000 7f71661ff700 1 -- 172.21.15.115:0/132316676 >> 172.21.15.115:0/132316676 conn(0x7f716005e940 msgr2=0x7f71600cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:02.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.295+0000 7f71661ff700 1 -- 172.21.15.115:0/132316676 shutdown_connections 2023-07-27T14:28:02.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.295+0000 7f71661ff700 1 -- 172.21.15.115:0/132316676 wait complete. 2023-07-27T14:28:02.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.296+0000 7f71661ff700 1 Processor -- start 2023-07-27T14:28:02.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.296+0000 7f71661ff700 1 -- start start 2023-07-27T14:28:02.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f71661ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7160063260 0x7f7160149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f71661ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014ae00 0x7f7160164920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f71661ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716014b1e0 0x7f71600c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f71661ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600ae4f0 con 0x7f7160063260 2023-07-27T14:28:02.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f71661ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600adc00 con 0x7f716014b1e0 2023-07-27T14:28:02.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f71661ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600b0a20 con 0x7f716014ae00 2023-07-27T14:28:02.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f715f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7160063260 0x7f7160149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f715f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7160063260 0x7f7160149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54104/0 (socket says 172.21.15.115:54104) 2023-07-27T14:28:02.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.297+0000 7f715f7fe700 1 -- 172.21.15.115:0/717130389 learned_addr learned my addr 172.21.15.115:0/717130389 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:02.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715effd700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014ae00 0x7f7160164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715f7fe700 1 -- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014ae00 msgr2=0x7f7160164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715f7fe700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014ae00 0x7f7160164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715f7fe700 1 -- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716014b1e0 msgr2=0x7f71600c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715ffff700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716014b1e0 0x7f71600c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715f7fe700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716014b1e0 0x7f71600c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715f7fe700 1 -- 172.21.15.115:0/717130389 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71540092a0 con 0x7f7160063260 2023-07-27T14:28:02.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715effd700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014ae00 0x7f7160164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:02.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715ffff700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716014b1e0 0x7f71600c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:02.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f715f7fe700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7160063260 0x7f7160149700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f7150007fd0 tx=0x7f7150007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:02.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f71477fe700 1 -- 172.21.15.115:0/717130389 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71500072e0 con 0x7f7160063260 2023-07-27T14:28:02.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f71477fe700 1 -- 172.21.15.115:0/717130389 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7150007440 con 0x7f7160063260 2023-07-27T14:28:02.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71600adea0 con 0x7f7160063260 2023-07-27T14:28:02.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f71477fe700 1 -- 172.21.15.115:0/717130389 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71500057a0 con 0x7f7160063260 2023-07-27T14:28:02.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.298+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71600c31d0 con 0x7f7160063260 2023-07-27T14:28:02.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.299+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716006c470 con 0x7f7160063260 2023-07-27T14:28:02.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.300+0000 7f71477fe700 1 -- 172.21.15.115:0/717130389 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f715001a060 con 0x7f7160063260 2023-07-27T14:28:02.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.301+0000 7f71477fe700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f714c05ed90 0x7f714c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.301+0000 7f71477fe700 1 -- 172.21.15.115:0/717130389 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7150078fe0 con 0x7f7160063260 2023-07-27T14:28:02.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.301+0000 7f715effd700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f714c05ed90 0x7f714c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.301+0000 7f715effd700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f714c05ed90 0x7f714c061250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f7160063660 tx=0x7f7154017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:02.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.304+0000 7f71477fe700 1 -- 172.21.15.115:0/717130389 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f715004a820 con 0x7f7160063260 2023-07-27T14:28:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.470+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71600c2f30 con 0x7f7160063260 2023-07-27T14:28:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.470+0000 7f71477fe700 1 -- 172.21.15.115:0/717130389 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f715004de40 con 0x7f7160063260 2023-07-27T14:28:02.489 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:28:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f714c05ed90 msgr2=0x7f714c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f714c05ed90 0x7f714c061250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f7160063660 tx=0x7f7154017000).stop 2023-07-27T14:28:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7160063260 msgr2=0x7f7160149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7160063260 0x7f7160149700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f7150007fd0 tx=0x7f7150007df0).stop 2023-07-27T14:28:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 shutdown_connections 2023-07-27T14:28:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f714c05ed90 0x7f714c061250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716014b1e0 0x7f71600c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7160063260 0x7f7160149700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 --2- 172.21.15.115:0/717130389 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f716014ae00 0x7f7160164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 >> 172.21.15.115:0/717130389 conn(0x7f716005e940 msgr2=0x7f71600c0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.472+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 shutdown_connections 2023-07-27T14:28:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.473+0000 7f71661ff700 1 -- 172.21.15.115:0/717130389 wait complete. 2023-07-27T14:28:02.507 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:28:02.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.677+0000 7f38fe7ff700 1 Processor -- start 2023-07-27T14:28:02.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.678+0000 7f38fe7ff700 1 -- start start 2023-07-27T14:28:02.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38fe7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f38f80a4cc0 0x7f38f80bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38fe7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f80639d0 con 0x7f38f8151bd0 2023-07-27T14:28:02.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38fe7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f80a5150 con 0x7f38f80a4840 2023-07-27T14:28:02.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38fe7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f8137610 con 0x7f38f80a4cc0 2023-07-27T14:28:02.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38f7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f38f8151bd0 0x7f38f8062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50042/0 (socket says 172.21.15.115:50042) 2023-07-27T14:28:02.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38f7fff700 1 -- 172.21.15.115:0/959672741 learned_addr learned my addr 172.21.15.115:0/959672741 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:02.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38fcd9c700 1 --2- 172.21.15.115:0/959672741 >> v2:172.21.15.115:3300/0 conn(0x7f38f80a4cc0 0x7f38f80bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38f6ffd700 1 -- 172.21.15.115:0/959672741 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319442796 0 0) 0x7f38f80639d0 con 0x7f38f8151bd0 2023-07-27T14:28:02.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.680+0000 7f38f6ffd700 1 -- 172.21.15.115:0/959672741 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38e00033f0 con 0x7f38f8151bd0 2023-07-27T14:28:02.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38fcd9c700 1 -- 172.21.15.115:0/959672741 >> v1:172.21.15.159:6789/0 conn(0x7f38f80a4840 legacy=0x7f38f80bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38fcd9c700 1 -- 172.21.15.115:0/959672741 >> v1:172.21.15.115:6789/0 conn(0x7f38f8151bd0 legacy=0x7f38f8062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38fcd9c700 1 -- 172.21.15.115:0/959672741 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8062dc0 con 0x7f38f80a4cc0 2023-07-27T14:28:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38fcd9c700 1 --2- 172.21.15.115:0/959672741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f80bc760 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f38f0009e60 tx=0x7f38f0009780).ready entity=mon.0 client_cookie=381a93355103aad0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38f6ffd700 1 -- 172.21.15.115:0/959672741 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f000e070 con 0x7f38f80a4cc0 2023-07-27T14:28:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38f6ffd700 1 -- 172.21.15.115:0/959672741 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f000bb60 con 0x7f38f80a4cc0 2023-07-27T14:28:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38f6ffd700 1 -- 172.21.15.115:0/959672741 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0012410 con 0x7f38f80a4cc0 2023-07-27T14:28:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38fe7ff700 1 -- 172.21.15.115:0/959672741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 msgr2=0x7f38f80bc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.681+0000 7f38fe7ff700 1 --2- 172.21.15.115:0/959672741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f80bc760 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f38f0009e60 tx=0x7f38f0009780).stop 2023-07-27T14:28:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.682+0000 7f38fe7ff700 1 -- 172.21.15.115:0/959672741 shutdown_connections 2023-07-27T14:28:02.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.682+0000 7f38fe7ff700 1 --2- 172.21.15.115:0/959672741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f80bc760 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.682+0000 7f38fe7ff700 1 -- 172.21.15.115:0/959672741 >> 172.21.15.115:0/959672741 conn(0x7f38f8064700 msgr2=0x7f38f8064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:02.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.682+0000 7f38fe7ff700 1 -- 172.21.15.115:0/959672741 shutdown_connections 2023-07-27T14:28:02.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.682+0000 7f38fe7ff700 1 -- 172.21.15.115:0/959672741 wait complete. 2023-07-27T14:28:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.683+0000 7f38fe7ff700 1 Processor -- start 2023-07-27T14:28:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.683+0000 7f38fe7ff700 1 -- start start 2023-07-27T14:28:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38fe7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38f80a4840 0x7f38f81507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38fe7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f81394c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38fe7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38f8151bd0 0x7f38f8137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38fe7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f813a180 con 0x7f38f80a4cc0 2023-07-27T14:28:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38fe7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8139ea0 con 0x7f38f8151bd0 2023-07-27T14:28:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38fe7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f813ad70 con 0x7f38f80a4840 2023-07-27T14:28:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38f77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f81394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38f77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f81394c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54126/0 (socket says 172.21.15.115:54126) 2023-07-27T14:28:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38f77fe700 1 -- 172.21.15.115:0/234166892 learned_addr learned my addr 172.21.15.115:0/234166892 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.684+0000 7f38f7fff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38f80a4840 0x7f38f81507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38fcd9c700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38f8151bd0 0x7f38f8137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38f77fe700 1 -- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38f80a4840 msgr2=0x7f38f81507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38f77fe700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38f80a4840 0x7f38f81507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38f77fe700 1 -- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38f8151bd0 msgr2=0x7f38f8137760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38f77fe700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38f8151bd0 0x7f38f8137760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38f77fe700 1 -- 172.21.15.115:0/234166892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0009a20 con 0x7f38f80a4cc0 2023-07-27T14:28:02.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38fcd9c700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38f8151bd0 0x7f38f8137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:02.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38f77fe700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f81394c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f38ec00c440 tx=0x7f38ec007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:02.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38dffff700 1 -- 172.21.15.115:0/234166892 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec00ce40 con 0x7f38f80a4cc0 2023-07-27T14:28:02.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38dffff700 1 -- 172.21.15.115:0/234166892 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec007020 con 0x7f38f80a4cc0 2023-07-27T14:28:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38dffff700 1 -- 172.21.15.115:0/234166892 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0073c0 con 0x7f38f80a4cc0 2023-07-27T14:28:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f813b050 con 0x7f38f80a4cc0 2023-07-27T14:28:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.685+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f8150ce0 con 0x7f38f80a4cc0 2023-07-27T14:28:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.686+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f813abd0 con 0x7f38f80a4cc0 2023-07-27T14:28:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.687+0000 7f38dffff700 1 -- 172.21.15.115:0/234166892 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f38ec010070 con 0x7f38f80a4cc0 2023-07-27T14:28:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.688+0000 7f38dffff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f38e405ed60 0x7f38e4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.688+0000 7f38dffff700 1 -- 172.21.15.115:0/234166892 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f38ec078a80 con 0x7f38f80a4cc0 2023-07-27T14:28:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.688+0000 7f38f7fff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f38e405ed60 0x7f38e4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.689+0000 7f38f7fff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f38e405ed60 0x7f38e4061220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f38e8005750 tx=0x7f38e8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:02.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.692+0000 7f38dffff700 1 -- 172.21.15.115:0/234166892 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f38ec0478f0 con 0x7f38f80a4cc0 2023-07-27T14:28:02.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.864+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f38f806c470 con 0x7f38f80a4cc0 2023-07-27T14:28:02.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.864+0000 7f38dffff700 1 -- 172.21.15.115:0/234166892 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+143 (secure 0 0 0) 0x7f38f813abd0 con 0x7f38f80a4cc0 2023-07-27T14:28:02.883 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:02.883 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:28:02.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:28:02.884 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:28:02.884 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:28:02.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:28:02.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:28:02.885 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:28:02.885 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:28:02.885 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:02.886 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:28:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f38e405ed60 msgr2=0x7f38e4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f38e405ed60 0x7f38e4061220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f38e8005750 tx=0x7f38e8009040).stop 2023-07-27T14:28:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 msgr2=0x7f38f81394c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f81394c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f38ec00c440 tx=0x7f38ec007e00).stop 2023-07-27T14:28:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 shutdown_connections 2023-07-27T14:28:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f38e405ed60 0x7f38e4061220 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38f8151bd0 0x7f38f8137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38f80a4840 0x7f38f81507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 --2- 172.21.15.115:0/234166892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38f80a4cc0 0x7f38f81394c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 >> 172.21.15.115:0/234166892 conn(0x7f38f8064700 msgr2=0x7f38f80bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 shutdown_connections 2023-07-27T14:28:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:02.866+0000 7f38fe7ff700 1 -- 172.21.15.115:0/234166892 wait complete. 2023-07-27T14:28:02.901 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:28:02.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:28:03.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.075+0000 7f4cf95ff700 1 Processor -- start 2023-07-27T14:28:03.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.075+0000 7f4cf95ff700 1 -- start start 2023-07-27T14:28:03.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.076+0000 7f4cf95ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf40c7250 0x7f4cf4062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.076+0000 7f4cf95ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4cf4069c60 0x7f4cf4062810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.076+0000 7f4cf95ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf40697d0 con 0x7f4cf41547d0 2023-07-27T14:28:03.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.076+0000 7f4cf95ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf4062d00 con 0x7f4cf4069c60 2023-07-27T14:28:03.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.076+0000 7f4cf95ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4155320 con 0x7f4cf40c7250 2023-07-27T14:28:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf27fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4cf4069c60 0x7f4cf4062810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf27fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4cf4069c60 0x7f4cf4062810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54134/0 (socket says 172.21.15.115:54134) 2023-07-27T14:28:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf27fc700 1 -- 172.21.15.115:0/1289870079 learned_addr learned my addr 172.21.15.115:0/1289870079 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/1289870079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf40c7250 0x7f4cf4062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf27fc700 1 -- 172.21.15.115:0/1289870079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf40c7250 msgr2=0x7f4cf4062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/1289870079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf40c7250 0x7f4cf4062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf27fc700 1 -- 172.21.15.115:0/1289870079 >> v1:172.21.15.159:6789/0 conn(0x7f4cf41547d0 legacy=0x7f4cf4154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf27fc700 1 -- 172.21.15.115:0/1289870079 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4155520 con 0x7f4cf4069c60 2023-07-27T14:28:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/1289870079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf40c7250 0x7f4cf4062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.077+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/1289870079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4069c60 0x7f4cf4062810 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f4ce8006fd0 tx=0x7f4ce80090f0).ready entity=mon.0 client_cookie=2380fa86c37be618 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf1ffb700 1 -- 172.21.15.115:0/1289870079 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800b690 con 0x7f4cf4069c60 2023-07-27T14:28:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf1ffb700 1 -- 172.21.15.115:0/1289870079 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce800b7f0 con 0x7f4cf4069c60 2023-07-27T14:28:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf1ffb700 1 -- 172.21.15.115:0/1289870079 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800bb70 con 0x7f4cf4069c60 2023-07-27T14:28:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf95ff700 1 -- 172.21.15.115:0/1289870079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4069c60 msgr2=0x7f4cf4062810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/1289870079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4069c60 0x7f4cf4062810 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f4ce8006fd0 tx=0x7f4ce80090f0).stop 2023-07-27T14:28:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf95ff700 1 -- 172.21.15.115:0/1289870079 shutdown_connections 2023-07-27T14:28:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/1289870079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf40c7250 0x7f4cf4062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/1289870079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4069c60 0x7f4cf4062810 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf95ff700 1 -- 172.21.15.115:0/1289870079 >> 172.21.15.115:0/1289870079 conn(0x7f4cf40c79a0 msgr2=0x7f4cf40c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf95ff700 1 -- 172.21.15.115:0/1289870079 shutdown_connections 2023-07-27T14:28:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.078+0000 7f4cf95ff700 1 -- 172.21.15.115:0/1289870079 wait complete. 2023-07-27T14:28:03.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.080+0000 7f4cf95ff700 1 Processor -- start 2023-07-27T14:28:03.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.080+0000 7f4cf95ff700 1 -- start start 2023-07-27T14:28:03.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf95ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4069c60 0x7f4cf414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf95ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf40c7250 0x7f4cf4066210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf95ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf41547d0 0x7f4cf4156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf95ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4065a00 con 0x7f4cf40c7250 2023-07-27T14:28:03.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf95ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40650d0 con 0x7f4cf4069c60 2023-07-27T14:28:03.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf95ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40653b0 con 0x7f4cf41547d0 2023-07-27T14:28:03.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf40c7250 0x7f4cf4066210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf40c7250 0x7f4cf4066210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54146/0 (socket says 172.21.15.115:54146) 2023-07-27T14:28:03.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf27fc700 1 -- 172.21.15.115:0/260526965 learned_addr learned my addr 172.21.15.115:0/260526965 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf27fc700 1 -- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf41547d0 msgr2=0x7f4cf4156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf37fe700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf41547d0 0x7f4cf4156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4069c60 0x7f4cf414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf41547d0 0x7f4cf4156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf27fc700 1 -- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4069c60 msgr2=0x7f4cf414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4069c60 0x7f4cf414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.081+0000 7f4cf27fc700 1 -- 172.21.15.115:0/260526965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce8009370 con 0x7f4cf40c7250 2023-07-27T14:28:03.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.082+0000 7f4cf37fe700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf41547d0 0x7f4cf4156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:03.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.082+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4069c60 0x7f4cf414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:03.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.082+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf40c7250 0x7f4cf4066210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f4ce8011000 tx=0x7f4ce8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:03.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.082+0000 7f4cdaffd700 1 -- 172.21.15.115:0/260526965 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800bb70 con 0x7f4cf40c7250 2023-07-27T14:28:03.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.082+0000 7f4cdaffd700 1 -- 172.21.15.115:0/260526965 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8000c90 con 0x7f4cf40c7250 2023-07-27T14:28:03.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.082+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf4065690 con 0x7f4cf40c7250 2023-07-27T14:28:03.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.082+0000 7f4cdaffd700 1 -- 172.21.15.115:0/260526965 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce801b660 con 0x7f4cf40c7250 2023-07-27T14:28:03.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.082+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf4066c60 con 0x7f4cf40c7250 2023-07-27T14:28:03.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.083+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf406c470 con 0x7f4cf40c7250 2023-07-27T14:28:03.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.084+0000 7f4cdaffd700 1 -- 172.21.15.115:0/260526965 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4ce802b070 con 0x7f4cf40c7250 2023-07-27T14:28:03.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.085+0000 7f4cdaffd700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005ed90 0x7f4ce0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.085+0000 7f4cdaffd700 1 -- 172.21.15.115:0/260526965 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4ce807b2e0 con 0x7f4cf40c7250 2023-07-27T14:28:03.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.085+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005ed90 0x7f4ce0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.085+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005ed90 0x7f4ce0061250 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f4ce4006d20 tx=0x7f4ce4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:03.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.089+0000 7f4cdaffd700 1 -- 172.21.15.115:0/260526965 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ce804cac0 con 0x7f4cf40c7250 2023-07-27T14:28:03.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.259+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f4cf4068ea0 con 0x7f4cf40c7250 2023-07-27T14:28:03.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.576+0000 7f4cdaffd700 1 -- 172.21.15.115:0/260526965 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4ce801f020 con 0x7f4cf40c7250 2023-07-27T14:28:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005ed90 msgr2=0x7f4ce0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005ed90 0x7f4ce0061250 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f4ce4006d20 tx=0x7f4ce4008040).stop 2023-07-27T14:28:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf40c7250 msgr2=0x7f4cf4066210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf40c7250 0x7f4cf4066210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f4ce8011000 tx=0x7f4ce8017000).stop 2023-07-27T14:28:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 shutdown_connections 2023-07-27T14:28:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005ed90 0x7f4ce0061250 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cf41547d0 0x7f4cf4156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4069c60 0x7f4cf414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 --2- 172.21.15.115:0/260526965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf40c7250 0x7f4cf4066210 secure :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0x7f4ce8011000 tx=0x7f4ce8017000).stop 2023-07-27T14:28:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 >> 172.21.15.115:0/260526965 conn(0x7f4cf40c79a0 msgr2=0x7f4cf40bc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 shutdown_connections 2023-07-27T14:28:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.580+0000 7f4cf95ff700 1 -- 172.21.15.115:0/260526965 wait complete. 2023-07-27T14:28:03.604 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:28:03.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:28:03.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.797+0000 7f4f261ff700 1 Processor -- start 2023-07-27T14:28:03.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.797+0000 7f4f261ff700 1 -- start start 2023-07-27T14:28:03.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f261ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f20157400 0x7f4f200c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f261ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4f200c7550 0x7f4f200c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f261ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f200c7ad0 con 0x7f4f200a7940 2023-07-27T14:28:03.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f261ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f200c5590 con 0x7f4f20157400 2023-07-27T14:28:03.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f261ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f200c0fb0 con 0x7f4f200c7550 2023-07-27T14:28:03.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f1f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f20157400 0x7f4f200c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f1f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f20157400 0x7f4f200c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59134/0 (socket says 172.21.15.115:59134) 2023-07-27T14:28:03.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f1f7fe700 1 -- 172.21.15.115:0/3562037791 learned_addr learned my addr 172.21.15.115:0/3562037791 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:03.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f1f7fe700 1 -- 172.21.15.115:0/3562037791 >> v2:172.21.15.159:3300/0 conn(0x7f4f200c7550 msgr2=0x7f4f200c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:03.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f1f7fe700 1 --2- 172.21.15.115:0/3562037791 >> v2:172.21.15.159:3300/0 conn(0x7f4f200c7550 0x7f4f200c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:03.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f1f7fe700 1 -- 172.21.15.115:0/3562037791 >> v1:172.21.15.159:6789/0 conn(0x7f4f200a7940 legacy=0x7f4f200c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.799+0000 7f4f1f7fe700 1 -- 172.21.15.115:0/3562037791 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200c7db0 con 0x7f4f20157400 2023-07-27T14:28:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f1f7fe700 1 --2- 172.21.15.115:0/3562037791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f20157400 0x7f4f200c05d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f4f200c79e0 tx=0x7f4f100090f0).ready entity=mon.0 client_cookie=7126b9f10659cef9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f1e7fc700 1 -- 172.21.15.115:0/3562037791 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000b5a0 con 0x7f4f20157400 2023-07-27T14:28:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f1e7fc700 1 -- 172.21.15.115:0/3562037791 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000b700 con 0x7f4f20157400 2023-07-27T14:28:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f1e7fc700 1 -- 172.21.15.115:0/3562037791 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000ba80 con 0x7f4f20157400 2023-07-27T14:28:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f261ff700 1 -- 172.21.15.115:0/3562037791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f20157400 msgr2=0x7f4f200c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3562037791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f20157400 0x7f4f200c05d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f4f200c79e0 tx=0x7f4f100090f0).stop 2023-07-27T14:28:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f261ff700 1 -- 172.21.15.115:0/3562037791 shutdown_connections 2023-07-27T14:28:03.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3562037791 >> v2:172.21.15.159:3300/0 conn(0x7f4f200c7550 0x7f4f200c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:03.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3562037791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f20157400 0x7f4f200c05d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f261ff700 1 -- 172.21.15.115:0/3562037791 >> 172.21.15.115:0/3562037791 conn(0x7f4f20094280 msgr2=0x7f4f2005e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:03.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.800+0000 7f4f261ff700 1 -- 172.21.15.115:0/3562037791 shutdown_connections 2023-07-27T14:28:03.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.801+0000 7f4f261ff700 1 -- 172.21.15.115:0/3562037791 wait complete. 2023-07-27T14:28:03.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.802+0000 7f4f261ff700 1 Processor -- start 2023-07-27T14:28:03.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.802+0000 7f4f261ff700 1 -- start start 2023-07-27T14:28:03.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f261ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f200a7940 0x7f4f20168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f261ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f200c7550 0x7f4f201645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f261ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f20157400 0x7f4f200cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f261ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f20168a80 con 0x7f4f200c7550 2023-07-27T14:28:03.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f261ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200aa6d0 con 0x7f4f200a7940 2023-07-27T14:28:03.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f261ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200aa990 con 0x7f4f20157400 2023-07-27T14:28:03.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f1effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f200c7550 0x7f4f201645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f1effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f200c7550 0x7f4f201645b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59148/0 (socket says 172.21.15.115:59148) 2023-07-27T14:28:03.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f1effd700 1 -- 172.21.15.115:0/3114285453 learned_addr learned my addr 172.21.15.115:0/3114285453 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:03.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f1f7fe700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f200a7940 0x7f4f20168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.803+0000 7f4f1ffff700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f20157400 0x7f4f200cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f1effd700 1 -- 172.21.15.115:0/3114285453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f20157400 msgr2=0x7f4f200cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f1effd700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f20157400 0x7f4f200cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f1effd700 1 -- 172.21.15.115:0/3114285453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f200a7940 msgr2=0x7f4f20168590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:03.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f1effd700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f200a7940 0x7f4f20168590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:03.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f1effd700 1 -- 172.21.15.115:0/3114285453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10009370 con 0x7f4f200c7550 2023-07-27T14:28:03.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f1effd700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f200c7550 0x7f4f201645b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f4f1400b490 tx=0x7f4f14009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:03.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f077fe700 1 -- 172.21.15.115:0/3114285453 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400be40 con 0x7f4f200c7550 2023-07-27T14:28:03.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f077fe700 1 -- 172.21.15.115:0/3114285453 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f14012410 con 0x7f4f200c7550 2023-07-27T14:28:03.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f077fe700 1 -- 172.21.15.115:0/3114285453 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f140127b0 con 0x7f4f200c7550 2023-07-27T14:28:03.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f200aac70 con 0x7f4f200c7550 2023-07-27T14:28:03.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.804+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f200ab230 con 0x7f4f200c7550 2023-07-27T14:28:03.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.805+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2006c470 con 0x7f4f200c7550 2023-07-27T14:28:03.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.806+0000 7f4f077fe700 1 -- 172.21.15.115:0/3114285453 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4f1400f030 con 0x7f4f200c7550 2023-07-27T14:28:03.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.807+0000 7f4f077fe700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f0c05ed90 0x7f4f0c061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:03.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.807+0000 7f4f077fe700 1 -- 172.21.15.115:0/3114285453 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f4f14079590 con 0x7f4f200c7550 2023-07-27T14:28:03.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.807+0000 7f4f1f7fe700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f0c05ed90 0x7f4f0c061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:03.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.808+0000 7f4f1f7fe700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f0c05ed90 0x7f4f0c061250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f4f10009130 tx=0x7f4f10015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:03.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.812+0000 7f4f077fe700 1 -- 172.21.15.115:0/3114285453 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f1404ac00 con 0x7f4f200c7550 2023-07-27T14:28:04.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:03.982+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4f20098a20 con 0x7f4f200c7550 2023-07-27T14:28:04.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.581+0000 7f4f077fe700 1 -- 172.21.15.115:0/3114285453 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4f1404e220 con 0x7f4f200c7550 2023-07-27T14:28:04.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.587+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f0c05ed90 msgr2=0x7f4f0c061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:04.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.587+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f0c05ed90 0x7f4f0c061250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f4f10009130 tx=0x7f4f10015000).stop 2023-07-27T14:28:04.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.587+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f200c7550 msgr2=0x7f4f201645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:04.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.587+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f200c7550 0x7f4f201645b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f4f1400b490 tx=0x7f4f14009060).stop 2023-07-27T14:28:04.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.590+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 shutdown_connections 2023-07-27T14:28:04.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.590+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f0c05ed90 0x7f4f0c061250 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0x7f4f10009130 tx=0x7f4f10015000).stop 2023-07-27T14:28:04.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.590+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f20157400 0x7f4f200cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:04.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.590+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f200a7940 0x7f4f20168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:04.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.590+0000 7f4f261ff700 1 --2- 172.21.15.115:0/3114285453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f200c7550 0x7f4f201645b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:04.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.590+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 >> 172.21.15.115:0/3114285453 conn(0x7f4f20094280 msgr2=0x7f4f200c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:04.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.594+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 shutdown_connections 2023-07-27T14:28:04.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.594+0000 7f4f261ff700 1 -- 172.21.15.115:0/3114285453 wait complete. 2023-07-27T14:28:04.624 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:28:04.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:28:04.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.815+0000 7f5be53ff700 1 Processor -- start 2023-07-27T14:28:04.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.815+0000 7f5be53ff700 1 -- start start 2023-07-27T14:28:04.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.816+0000 7f5be53ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5be014ae00 0x7f5be0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:04.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5be53ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be0063260 0x7f5be00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:04.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5be53ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be01553f0 con 0x7f5be014b1e0 2023-07-27T14:28:04.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5be53ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be0157a50 con 0x7f5be014ae00 2023-07-27T14:28:04.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5be53ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0157d10 con 0x7f5be0063260 2023-07-27T14:28:04.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdeffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5be014ae00 0x7f5be0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:04.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdeffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5be014ae00 0x7f5be0154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59152/0 (socket says 172.21.15.115:59152) 2023-07-27T14:28:04.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdeffd700 1 -- 172.21.15.115:0/2818821316 learned_addr learned my addr 172.21.15.115:0/2818821316 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:04.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdf7fe700 1 --2- 172.21.15.115:0/2818821316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be0063260 0x7f5be00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:04.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdeffd700 1 -- 172.21.15.115:0/2818821316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be0063260 msgr2=0x7f5be00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:04.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdeffd700 1 --2- 172.21.15.115:0/2818821316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be0063260 0x7f5be00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:04.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdeffd700 1 -- 172.21.15.115:0/2818821316 >> v1:172.21.15.159:6789/0 conn(0x7f5be014b1e0 legacy=0x7f5be0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:04.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdeffd700 1 -- 172.21.15.115:0/2818821316 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be0157ff0 con 0x7f5be014ae00 2023-07-27T14:28:04.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.817+0000 7f5bdf7fe700 1 --2- 172.21.15.115:0/2818821316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be0063260 0x7f5be00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:04.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5bdeffd700 1 --2- 172.21.15.115:0/2818821316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014ae00 0x7f5be0154f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5bd0006fd0 tx=0x7f5bd00090f0).ready entity=mon.0 client_cookie=6436cff60444ae26 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:04.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5bddffb700 1 -- 172.21.15.115:0/2818821316 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000b600 con 0x7f5be014ae00 2023-07-27T14:28:04.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5bddffb700 1 -- 172.21.15.115:0/2818821316 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd000b760 con 0x7f5be014ae00 2023-07-27T14:28:04.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5bddffb700 1 -- 172.21.15.115:0/2818821316 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000bae0 con 0x7f5be014ae00 2023-07-27T14:28:04.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5be53ff700 1 -- 172.21.15.115:0/2818821316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014ae00 msgr2=0x7f5be0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:04.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5be53ff700 1 --2- 172.21.15.115:0/2818821316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014ae00 0x7f5be0154f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5bd0006fd0 tx=0x7f5bd00090f0).stop 2023-07-27T14:28:04.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5be53ff700 1 -- 172.21.15.115:0/2818821316 shutdown_connections 2023-07-27T14:28:04.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5be53ff700 1 --2- 172.21.15.115:0/2818821316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be0063260 0x7f5be00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:04.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5be53ff700 1 --2- 172.21.15.115:0/2818821316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014ae00 0x7f5be0154f00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:04.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5be53ff700 1 -- 172.21.15.115:0/2818821316 >> 172.21.15.115:0/2818821316 conn(0x7f5be005e940 msgr2=0x7f5be00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:04.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.818+0000 7f5be53ff700 1 -- 172.21.15.115:0/2818821316 shutdown_connections 2023-07-27T14:28:04.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.819+0000 7f5be53ff700 1 -- 172.21.15.115:0/2818821316 wait complete. 2023-07-27T14:28:04.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.820+0000 7f5be53ff700 1 Processor -- start 2023-07-27T14:28:04.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.821+0000 7f5be53ff700 1 -- start start 2023-07-27T14:28:04.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5be53ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be0063260 0x7f5be0149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:04.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5be53ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be014ae00 0x7f5be00aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:04.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5be53ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014b1e0 0x7f5be00aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:04.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5be53ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00c8af0 con 0x7f5be014b1e0 2023-07-27T14:28:04.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5be53ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00c8dd0 con 0x7f5be0063260 2023-07-27T14:28:04.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5be53ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00c90b0 con 0x7f5be014ae00 2023-07-27T14:28:04.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5bdf7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014b1e0 0x7f5be00aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:04.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5bdf7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014b1e0 0x7f5be00aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59164/0 (socket says 172.21.15.115:59164) 2023-07-27T14:28:04.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.822+0000 7f5bdf7fe700 1 -- 172.21.15.115:0/901066117 learned_addr learned my addr 172.21.15.115:0/901066117 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:04.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bdeffd700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be0063260 0x7f5be0149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:04.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bdf7fe700 1 -- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be014ae00 msgr2=0x7f5be00aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:04.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bde7fc700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be014ae00 0x7f5be00aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:04.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bdf7fe700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be014ae00 0x7f5be00aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:04.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bdf7fe700 1 -- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be0063260 msgr2=0x7f5be0149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:04.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bdf7fe700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be0063260 0x7f5be0149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:04.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bdf7fe700 1 -- 172.21.15.115:0/901066117 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0009370 con 0x7f5be014b1e0 2023-07-27T14:28:04.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bdeffd700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be0063260 0x7f5be0149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:04.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bde7fc700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be014ae00 0x7f5be00aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:04.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bdf7fe700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014b1e0 0x7f5be00aef60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f5bd8009f90 tx=0x7f5bd80099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:04.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bc6ffd700 1 -- 172.21.15.115:0/901066117 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800dd40 con 0x7f5be014b1e0 2023-07-27T14:28:04.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bc6ffd700 1 -- 172.21.15.115:0/901066117 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800f040 con 0x7f5be014b1e0 2023-07-27T14:28:04.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5bc6ffd700 1 -- 172.21.15.115:0/901066117 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800dea0 con 0x7f5be014b1e0 2023-07-27T14:28:04.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be00c9390 con 0x7f5be014b1e0 2023-07-27T14:28:04.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.823+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be014a0b0 con 0x7f5be014b1e0 2023-07-27T14:28:04.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.824+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be006c470 con 0x7f5be014b1e0 2023-07-27T14:28:04.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.826+0000 7f5bc6ffd700 1 -- 172.21.15.115:0/901066117 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f5bd8013850 con 0x7f5be014b1e0 2023-07-27T14:28:04.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.826+0000 7f5bc6ffd700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bcc05ed90 0x7f5bcc061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:04.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.826+0000 7f5bc6ffd700 1 -- 172.21.15.115:0/901066117 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f5bd807a2c0 con 0x7f5be014b1e0 2023-07-27T14:28:04.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.827+0000 7f5bdeffd700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bcc05ed90 0x7f5bcc061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:04.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.827+0000 7f5bdeffd700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bcc05ed90 0x7f5bcc061250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5bd0009130 tx=0x7f5bd0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:04.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:04.831+0000 7f5bc6ffd700 1 -- 172.21.15.115:0/901066117 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5bd804b860 con 0x7f5be014b1e0 2023-07-27T14:28:05.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.040+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5be0152440 con 0x7f5be014b1e0 2023-07-27T14:28:05.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.050+0000 7f5bc6ffd700 1 -- 172.21.15.115:0/901066117 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5bd804ee80 con 0x7f5be014b1e0 2023-07-27T14:28:05.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bcc05ed90 msgr2=0x7f5bcc061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bcc05ed90 0x7f5bcc061250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5bd0009130 tx=0x7f5bd0017000).stop 2023-07-27T14:28:05.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014b1e0 msgr2=0x7f5be00aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014b1e0 0x7f5be00aef60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f5bd8009f90 tx=0x7f5bd80099b0).stop 2023-07-27T14:28:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 shutdown_connections 2023-07-27T14:28:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bcc05ed90 0x7f5bcc061250 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be014b1e0 0x7f5be00aef60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be0063260 0x7f5be0149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 --2- 172.21.15.115:0/901066117 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be014ae00 0x7f5be00aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.056+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 >> 172.21.15.115:0/901066117 conn(0x7f5be005e940 msgr2=0x7f5be014a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:05.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.061+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 shutdown_connections 2023-07-27T14:28:05.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.062+0000 7f5be53ff700 1 -- 172.21.15.115:0/901066117 wait complete. 2023-07-27T14:28:05.092 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 5 and data pool 6 2023-07-27T14:28:05.110 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:28:05.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.281+0000 7fdde7bff700 1 Processor -- start 2023-07-27T14:28:05.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.281+0000 7fdde7bff700 1 -- start start 2023-07-27T14:28:05.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.282+0000 7fdde7bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdde00aaa40 0x7fdde00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde7bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde00aa4d0 con 0x7fdde01542a0 2023-07-27T14:28:05.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde7bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde00c05c0 con 0x7fdde0153ec0 2023-07-27T14:28:05.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde7bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde00aa270 con 0x7fdde00aaa40 2023-07-27T14:28:05.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde519a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdde00aaa40 0x7fdde00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde619c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdde01542a0 0x7fdde00c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46172/0 (socket says 172.21.15.115:46172) 2023-07-27T14:28:05.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde619c700 1 -- 172.21.15.115:0/736174191 learned_addr learned my addr 172.21.15.115:0/736174191 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:05.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde519a700 1 -- 172.21.15.115:0/736174191 >> v1:172.21.15.159:6789/0 conn(0x7fdde0153ec0 legacy=0x7fdde00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:05.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde519a700 1 -- 172.21.15.115:0/736174191 >> v1:172.21.15.115:6789/0 conn(0x7fdde01542a0 legacy=0x7fdde00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde4999700 1 -- 172.21.15.115:0/736174191 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72916401 0 0) 0x7fddd8001490 con 0x7fdde01542a0 2023-07-27T14:28:05.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde519a700 1 -- 172.21.15.115:0/736174191 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde00bfc90 con 0x7fdde00aaa40 2023-07-27T14:28:05.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.283+0000 7fdde519a700 1 --2- 172.21.15.115:0/736174191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde00aaa40 0x7fdde00640f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fddd0009760 tx=0x7fddd0009060).ready entity=mon.0 client_cookie=4d61ee5afb48cd47 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:05.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde4999700 1 -- 172.21.15.115:0/736174191 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000b520 con 0x7fdde00aaa40 2023-07-27T14:28:05.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde4999700 1 -- 172.21.15.115:0/736174191 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000b680 con 0x7fdde00aaa40 2023-07-27T14:28:05.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde4999700 1 -- 172.21.15.115:0/736174191 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000ba00 con 0x7fdde00aaa40 2023-07-27T14:28:05.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde7bff700 1 -- 172.21.15.115:0/736174191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde00aaa40 msgr2=0x7fdde00640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde7bff700 1 --2- 172.21.15.115:0/736174191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde00aaa40 0x7fdde00640f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fddd0009760 tx=0x7fddd0009060).stop 2023-07-27T14:28:05.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde7bff700 1 -- 172.21.15.115:0/736174191 shutdown_connections 2023-07-27T14:28:05.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde7bff700 1 --2- 172.21.15.115:0/736174191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde00aaa40 0x7fdde00640f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde7bff700 1 -- 172.21.15.115:0/736174191 >> 172.21.15.115:0/736174191 conn(0x7fdde00cb610 msgr2=0x7fdde00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:05.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde7bff700 1 -- 172.21.15.115:0/736174191 shutdown_connections 2023-07-27T14:28:05.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.284+0000 7fdde7bff700 1 -- 172.21.15.115:0/736174191 wait complete. 2023-07-27T14:28:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.286+0000 7fdde7bff700 1 Processor -- start 2023-07-27T14:28:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.286+0000 7fdde7bff700 1 -- start start 2023-07-27T14:28:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde7bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde00aaa40 0x7fdde0164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde7bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde0153ec0 0x7fdde00c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde7bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde01542a0 0x7fdde00c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde7bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00c2610 con 0x7fdde0153ec0 2023-07-27T14:28:05.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde7bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00ae9e0 con 0x7fdde00aaa40 2023-07-27T14:28:05.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde7bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00ae0b0 con 0x7fdde01542a0 2023-07-27T14:28:05.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde519a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde0153ec0 0x7fdde00c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde519a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde0153ec0 0x7fdde00c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59172/0 (socket says 172.21.15.115:59172) 2023-07-27T14:28:05.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde519a700 1 -- 172.21.15.115:0/1010529334 learned_addr learned my addr 172.21.15.115:0/1010529334 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:05.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde619c700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde01542a0 0x7fdde00c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde599b700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde00aaa40 0x7fdde0164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde519a700 1 -- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde01542a0 msgr2=0x7fdde00c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.287+0000 7fdde519a700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde01542a0 0x7fdde00c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fdde519a700 1 -- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde00aaa40 msgr2=0x7fdde0164570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fdde519a700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde00aaa40 0x7fdde0164570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fdde519a700 1 -- 172.21.15.115:0/1010529334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00092a0 con 0x7fdde0153ec0 2023-07-27T14:28:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fdde599b700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde00aaa40 0x7fdde0164570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fdde519a700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde0153ec0 0x7fdde00c1c30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fdde005fc60 tx=0x7fddd0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fddd5ffb700 1 -- 172.21.15.115:0/1010529334 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000b7f0 con 0x7fdde0153ec0 2023-07-27T14:28:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fddd5ffb700 1 -- 172.21.15.115:0/1010529334 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000b950 con 0x7fdde0153ec0 2023-07-27T14:28:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde00ae390 con 0x7fdde0153ec0 2023-07-27T14:28:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fddd5ffb700 1 -- 172.21.15.115:0/1010529334 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd001b620 con 0x7fdde0153ec0 2023-07-27T14:28:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.288+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde0164a60 con 0x7fdde0153ec0 2023-07-27T14:28:05.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.289+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde00ae830 con 0x7fdde0153ec0 2023-07-27T14:28:05.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.290+0000 7fddd5ffb700 1 -- 172.21.15.115:0/1010529334 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fddd000f070 con 0x7fdde0153ec0 2023-07-27T14:28:05.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.291+0000 7fddd5ffb700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddc405ed60 0x7fddc4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.291+0000 7fddd5ffb700 1 -- 172.21.15.115:0/1010529334 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fddd007b650 con 0x7fdde0153ec0 2023-07-27T14:28:05.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.291+0000 7fdde599b700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddc405ed60 0x7fddc4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.291+0000 7fdde599b700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddc405ed60 0x7fddc4061220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fdddc0026f0 tx=0x7fdddc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:05.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.295+0000 7fddd5ffb700 1 -- 172.21.15.115:0/1010529334 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fddd004cbf0 con 0x7fdde0153ec0 2023-07-27T14:28:05.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.465+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdde00bff70 con 0x7fdde0153ec0 2023-07-27T14:28:05.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.466+0000 7fddd5ffb700 1 -- 172.21.15.115:0/1010529334 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+17085 (secure 0 0 0) 0x7fddd0050210 con 0x7fdde0153ec0 2023-07-27T14:28:05.484 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:05.484 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":35,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:28:05.041214+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:28:03.303433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-27T14:28:04.025837+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:28:05.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.468+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddc405ed60 msgr2=0x7fddc4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.468+0000 7fdde7bff700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddc405ed60 0x7fddc4061220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fdddc0026f0 tx=0x7fdddc009040).stop 2023-07-27T14:28:05.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde0153ec0 msgr2=0x7fdde00c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde0153ec0 0x7fdde00c1c30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fdde005fc60 tx=0x7fddd0017000).stop 2023-07-27T14:28:05.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 shutdown_connections 2023-07-27T14:28:05.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddc405ed60 0x7fddc4061220 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdde01542a0 0x7fdde00c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdde00aaa40 0x7fdde0164570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 --2- 172.21.15.115:0/1010529334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdde0153ec0 0x7fdde00c1c30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 >> 172.21.15.115:0/1010529334 conn(0x7fdde00cb610 msgr2=0x7fdde00abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:05.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 shutdown_connections 2023-07-27T14:28:05.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.469+0000 7fdde7bff700 1 -- 172.21.15.115:0/1010529334 wait complete. 2023-07-27T14:28:05.503 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:28:05.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.674+0000 7f0ad25ff700 1 Processor -- start 2023-07-27T14:28:05.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.675+0000 7f0ad25ff700 1 -- start start 2023-07-27T14:28:05.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.676+0000 7f0ad25ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0acc151bd0 0x7f0acc062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.676+0000 7f0ad25ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc062810 0x7f0acc0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.676+0000 7f0ad25ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc0639d0 con 0x7f0acc0a4d30 2023-07-27T14:28:05.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.676+0000 7f0ad25ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc137610 con 0x7f0acc151bd0 2023-07-27T14:28:05.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.676+0000 7f0ad25ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0a51c0 con 0x7f0acc062810 2023-07-27T14:28:05.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acbfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0acc151bd0 0x7f0acc062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acb7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc062810 0x7f0acc0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acbfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0acc151bd0 0x7f0acc062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:33878/0 (socket says 172.21.15.115:33878) 2023-07-27T14:28:05.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acbfff700 1 -- 172.21.15.115:0/1013832434 learned_addr learned my addr 172.21.15.115:0/1013832434 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:05.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0ad0b9c700 1 --1- 172.21.15.115:0/1013832434 >> v1:172.21.15.159:6789/0 conn(0x7f0acc0a4d30 0x7f0acc157ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:38742/0 (socket says 172.21.15.115:38742) 2023-07-27T14:28:05.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acbfff700 1 -- 172.21.15.115:0/1013832434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc062810 msgr2=0x7f0acc0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:05.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acbfff700 1 --2- 172.21.15.115:0/1013832434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc062810 0x7f0acc0a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acbfff700 1 -- 172.21.15.115:0/1013832434 >> v1:172.21.15.159:6789/0 conn(0x7f0acc0a4d30 legacy=0x7f0acc157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acbfff700 1 -- 172.21.15.115:0/1013832434 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc062dc0 con 0x7f0acc151bd0 2023-07-27T14:28:05.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.677+0000 7f0acb7fe700 1 --2- 172.21.15.115:0/1013832434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc062810 0x7f0acc0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:28:05.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0acbfff700 1 --2- 172.21.15.115:0/1013832434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc151bd0 0x7f0acc062320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0abc006fd0 tx=0x7f0abc0090f0).ready entity=mon.1 client_cookie=bb6bf6c06c7ca295 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:05.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0acaffd700 1 -- 172.21.15.115:0/1013832434 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00b580 con 0x7f0acc151bd0 2023-07-27T14:28:05.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0acaffd700 1 -- 172.21.15.115:0/1013832434 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc00b6e0 con 0x7f0acc151bd0 2023-07-27T14:28:05.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0acaffd700 1 -- 172.21.15.115:0/1013832434 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00ba60 con 0x7f0acc151bd0 2023-07-27T14:28:05.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0ad25ff700 1 -- 172.21.15.115:0/1013832434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc151bd0 msgr2=0x7f0acc062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/1013832434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc151bd0 0x7f0acc062320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0abc006fd0 tx=0x7f0abc0090f0).stop 2023-07-27T14:28:05.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0ad25ff700 1 -- 172.21.15.115:0/1013832434 shutdown_connections 2023-07-27T14:28:05.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/1013832434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc151bd0 0x7f0acc062320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/1013832434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc062810 0x7f0acc0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.678+0000 7f0ad25ff700 1 -- 172.21.15.115:0/1013832434 >> 172.21.15.115:0/1013832434 conn(0x7f0acc064700 msgr2=0x7f0acc064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:05.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.679+0000 7f0ad25ff700 1 -- 172.21.15.115:0/1013832434 shutdown_connections 2023-07-27T14:28:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.679+0000 7f0ad25ff700 1 -- 172.21.15.115:0/1013832434 wait complete. 2023-07-27T14:28:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.680+0000 7f0ad25ff700 1 Processor -- start 2023-07-27T14:28:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.680+0000 7f0ad25ff700 1 -- start start 2023-07-27T14:28:05.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0ad25ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc062810 0x7f0acc154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0ad25ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc0a4d30 0x7f0acc153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0ad25ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc151bd0 0x7f0acc1353e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0ad25ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0ab270 con 0x7f0acc0a4d30 2023-07-27T14:28:05.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0ad25ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc154440 con 0x7f0acc062810 2023-07-27T14:28:05.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0ad25ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0ab450 con 0x7f0acc151bd0 2023-07-27T14:28:05.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0acb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc0a4d30 0x7f0acc153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0acb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc0a4d30 0x7f0acc153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59176/0 (socket says 172.21.15.115:59176) 2023-07-27T14:28:05.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0acb7fe700 1 -- 172.21.15.115:0/2408350463 learned_addr learned my addr 172.21.15.115:0/2408350463 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:05.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0ad0b9c700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc151bd0 0x7f0acc1353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.681+0000 7f0acbfff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc062810 0x7f0acc154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0acb7fe700 1 -- 172.21.15.115:0/2408350463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc151bd0 msgr2=0x7f0acc1353e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0acb7fe700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc151bd0 0x7f0acc1353e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0acb7fe700 1 -- 172.21.15.115:0/2408350463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc062810 msgr2=0x7f0acc154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0acb7fe700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc062810 0x7f0acc154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0acb7fe700 1 -- 172.21.15.115:0/2408350463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00092a0 con 0x7f0acc0a4d30 2023-07-27T14:28:05.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0acb7fe700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc0a4d30 0x7f0acc153f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f0ac000e980 tx=0x7f0ac0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:05.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0ab3fff700 1 -- 172.21.15.115:0/2408350463 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0012600 con 0x7f0acc0a4d30 2023-07-27T14:28:05.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0ab3fff700 1 -- 172.21.15.115:0/2408350463 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac0012760 con 0x7f0acc0a4d30 2023-07-27T14:28:05.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc009370 con 0x7f0acc0a4d30 2023-07-27T14:28:05.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0ab3fff700 1 -- 172.21.15.115:0/2408350463 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0012ae0 con 0x7f0acc0a4d30 2023-07-27T14:28:05.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.682+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc0aba10 con 0x7f0acc0a4d30 2023-07-27T14:28:05.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.683+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc06c470 con 0x7f0acc0a4d30 2023-07-27T14:28:05.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.684+0000 7f0ab3fff700 1 -- 172.21.15.115:0/2408350463 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0ac0022070 con 0x7f0acc0a4d30 2023-07-27T14:28:05.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.685+0000 7f0ab3fff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ab805ed90 0x7f0ab8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:05.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.685+0000 7f0ab3fff700 1 -- 172.21.15.115:0/2408350463 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ac0079fe0 con 0x7f0acc0a4d30 2023-07-27T14:28:05.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.685+0000 7f0acbfff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ab805ed90 0x7f0ab8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:05.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.686+0000 7f0acbfff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ab805ed90 0x7f0ab8061250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f0abc009130 tx=0x7f0abc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:05.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.689+0000 7f0ab3fff700 1 -- 172.21.15.115:0/2408350463 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ac00a88f0 con 0x7f0acc0a4d30 2023-07-27T14:28:05.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.860+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0acc1358d0 con 0x7f0acc0a4d30 2023-07-27T14:28:05.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.861+0000 7f0ab3fff700 1 -- 172.21.15.115:0/2408350463 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+17085 (secure 0 0 0) 0x7f0ac004b4d0 con 0x7f0acc0a4d30 2023-07-27T14:28:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:05.879 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":35,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:28:05.041214+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:28:03.303433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-27T14:28:04.025837+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:28:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ab805ed90 msgr2=0x7f0ab8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ab805ed90 0x7f0ab8061250 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f0abc009130 tx=0x7f0abc017000).stop 2023-07-27T14:28:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc0a4d30 msgr2=0x7f0acc153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc0a4d30 0x7f0acc153f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f0ac000e980 tx=0x7f0ac0009060).stop 2023-07-27T14:28:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 shutdown_connections 2023-07-27T14:28:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ab805ed90 0x7f0ab8061250 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0acc151bd0 0x7f0acc1353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0acc062810 0x7f0acc154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 --2- 172.21.15.115:0/2408350463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0acc0a4d30 0x7f0acc153f50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 >> 172.21.15.115:0/2408350463 conn(0x7f0acc064700 msgr2=0x7f0acc0c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 shutdown_connections 2023-07-27T14:28:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:05.863+0000 7f0ad25ff700 1 -- 172.21.15.115:0/2408350463 wait complete. 2023-07-27T14:28:05.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:28:06.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.072+0000 7f1fcf9ff700 1 Processor -- start 2023-07-27T14:28:06.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.073+0000 7f1fcf9ff700 1 -- start start 2023-07-27T14:28:06.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.074+0000 7f1fcf9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc813a350 0x7f1fc8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:06.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.074+0000 7f1fcf9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc80bd9a0 con 0x7f1fc80c36b0 2023-07-27T14:28:06.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.074+0000 7f1fcf9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc8066610 con 0x7f1fc813a730 2023-07-27T14:28:06.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.074+0000 7f1fcf9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8066400 con 0x7f1fc813a350 2023-07-27T14:28:06.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.074+0000 7f1fcdf9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1fc80c36b0 0x7f1fc80be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46186/0 (socket says 172.21.15.115:46186) 2023-07-27T14:28:06.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.074+0000 7f1fcdf9c700 1 -- 172.21.15.115:0/4092300914 learned_addr learned my addr 172.21.15.115:0/4092300914 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:06.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.074+0000 7f1fcd79b700 1 --2- 172.21.15.115:0/4092300914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc813a350 0x7f1fc8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fbffff700 1 -- 172.21.15.115:0/4092300914 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586053968 0 0) 0x7f1fc80bd9a0 con 0x7f1fc80c36b0 2023-07-27T14:28:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fbffff700 1 -- 172.21.15.115:0/4092300914 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb40033f0 con 0x7f1fc80c36b0 2023-07-27T14:28:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fbffff700 1 -- 172.21.15.115:0/4092300914 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290460297 0 0) 0x7f1fc8066610 con 0x7f1fc813a730 2023-07-27T14:28:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fbffff700 1 -- 172.21.15.115:0/4092300914 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc80bd9a0 con 0x7f1fc813a730 2023-07-27T14:28:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fcd79b700 1 -- 172.21.15.115:0/4092300914 >> v1:172.21.15.159:6789/0 conn(0x7f1fc813a730 legacy=0x7f1fc80c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fcd79b700 1 -- 172.21.15.115:0/4092300914 >> v1:172.21.15.115:6789/0 conn(0x7f1fc80c36b0 legacy=0x7f1fc80be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fcd79b700 1 -- 172.21.15.115:0/4092300914 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc80bdc10 con 0x7f1fc813a350 2023-07-27T14:28:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fcd79b700 1 --2- 172.21.15.115:0/4092300914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc813a350 0x7f1fc8065f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1fc4009790 tx=0x7f1fc4009060).ready entity=mon.2 client_cookie=427a4e404d66a949 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fbffff700 1 -- 172.21.15.115:0/4092300914 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400f510 con 0x7f1fc813a350 2023-07-27T14:28:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fbffff700 1 -- 172.21.15.115:0/4092300914 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc400f670 con 0x7f1fc813a350 2023-07-27T14:28:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.075+0000 7f1fbffff700 1 -- 172.21.15.115:0/4092300914 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400f9f0 con 0x7f1fc813a350 2023-07-27T14:28:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.076+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/4092300914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc813a350 msgr2=0x7f1fc8065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.076+0000 7f1fcf9ff700 1 --2- 172.21.15.115:0/4092300914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc813a350 0x7f1fc8065f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1fc4009790 tx=0x7f1fc4009060).stop 2023-07-27T14:28:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.076+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/4092300914 shutdown_connections 2023-07-27T14:28:06.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.076+0000 7f1fcf9ff700 1 --2- 172.21.15.115:0/4092300914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc813a350 0x7f1fc8065f10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:06.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.076+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/4092300914 >> 172.21.15.115:0/4092300914 conn(0x7f1fc805e8f0 msgr2=0x7f1fc80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:06.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.076+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/4092300914 shutdown_connections 2023-07-27T14:28:06.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.076+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/4092300914 wait complete. 2023-07-27T14:28:06.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.077+0000 7f1fcf9ff700 1 Processor -- start 2023-07-27T14:28:06.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.078+0000 7f1fcf9ff700 1 -- start start 2023-07-27T14:28:06.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcf9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc80c36b0 0x7f1fc81685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:06.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcf9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fc813a350 0x7f1fc8139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:06.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcf9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc813a730 0x7f1fc80c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:06.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcf9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8139a20 con 0x7f1fc813a730 2023-07-27T14:28:06.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcf9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80c2cc0 con 0x7f1fc813a350 2023-07-27T14:28:06.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcf9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80c20b0 con 0x7f1fc80c36b0 2023-07-27T14:28:06.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc813a730 0x7f1fc80c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:06.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc813a730 0x7f1fc80c1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59188/0 (socket says 172.21.15.115:59188) 2023-07-27T14:28:06.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 -- 172.21.15.115:0/1030805359 learned_addr learned my addr 172.21.15.115:0/1030805359 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:06.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fccf9a700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fc813a350 0x7f1fc8139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:06.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcd79b700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc80c36b0 0x7f1fc81685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:06.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 -- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc80c36b0 msgr2=0x7f1fc81685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:06.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc80c36b0 0x7f1fc81685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:06.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 -- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fc813a350 msgr2=0x7f1fc8139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:06.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fc813a350 0x7f1fc8139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:06.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 -- 172.21.15.115:0/1030805359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc40092a0 con 0x7f1fc813a730 2023-07-27T14:28:06.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcd79b700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc80c36b0 0x7f1fc81685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:06.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.079+0000 7f1fcdf9c700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc813a730 0x7f1fc80c1860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f1fc000c790 tx=0x7f1fc0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:06.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.080+0000 7f1fbd7fa700 1 -- 172.21.15.115:0/1030805359 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0005d30 con 0x7f1fc813a730 2023-07-27T14:28:06.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.080+0000 7f1fbd7fa700 1 -- 172.21.15.115:0/1030805359 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc0005e90 con 0x7f1fc813a730 2023-07-27T14:28:06.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.080+0000 7f1fbd7fa700 1 -- 172.21.15.115:0/1030805359 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0007320 con 0x7f1fc813a730 2023-07-27T14:28:06.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.080+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc80c2390 con 0x7f1fc813a730 2023-07-27T14:28:06.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.080+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc80c2950 con 0x7f1fc813a730 2023-07-27T14:28:06.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.081+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc80a8440 con 0x7f1fc813a730 2023-07-27T14:28:06.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.082+0000 7f1fbd7fa700 1 -- 172.21.15.115:0/1030805359 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1fc0010030 con 0x7f1fc813a730 2023-07-27T14:28:06.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.082+0000 7f1fbd7fa700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fac05ed90 0x7f1fac061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:06.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.083+0000 7f1fbd7fa700 1 -- 172.21.15.115:0/1030805359 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1fc0079ab0 con 0x7f1fc813a730 2023-07-27T14:28:06.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.083+0000 7f1fcd79b700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fac05ed90 0x7f1fac061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:06.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.083+0000 7f1fcd79b700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fac05ed90 0x7f1fac061250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f1fc4009fd0 tx=0x7f1fc4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:06.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.086+0000 7f1fbd7fa700 1 -- 172.21.15.115:0/1030805359 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1fc80a8440 con 0x7f1fc813a730 2023-07-27T14:28:06.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:06.298+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1fc80a8440 con 0x7f1fc813a730 2023-07-27T14:28:06.861 INFO:tasks.ceph.mds.a.smithi115.stderr:2023-07-27T14:28:06.843+0000 7f1b663f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:28:07.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.055+0000 7f1fbd7fa700 1 -- 172.21.15.115:0/1030805359 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1fc80a8440 con 0x7f1fc813a730 2023-07-27T14:28:07.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fac05ed90 msgr2=0x7f1fac061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:07.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fac05ed90 0x7f1fac061250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f1fc4009fd0 tx=0x7f1fc4017000).stop 2023-07-27T14:28:07.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc813a730 msgr2=0x7f1fc80c1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:07.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc813a730 0x7f1fc80c1860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f1fc000c790 tx=0x7f1fc0007f70).stop 2023-07-27T14:28:07.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 shutdown_connections 2023-07-27T14:28:07.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fac05ed90 0x7f1fac061250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fc813a730 0x7f1fc80c1860 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fc80c36b0 0x7f1fc81685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 --2- 172.21.15.115:0/1030805359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fc813a350 0x7f1fc8139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 >> 172.21.15.115:0/1030805359 conn(0x7f1fc805e8f0 msgr2=0x7f1fc8153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:07.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.058+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 shutdown_connections 2023-07-27T14:28:07.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.059+0000 7f1fcf9ff700 1 -- 172.21.15.115:0/1030805359 wait complete. 2023-07-27T14:28:07.095 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:28:07.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:28:07.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.270+0000 7f996abff700 1 Processor -- start 2023-07-27T14:28:07.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.270+0000 7f996abff700 1 -- start start 2023-07-27T14:28:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.271+0000 7f996abff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f996414ae00 0x7f9964154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.271+0000 7f996abff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f996414b1e0 0x7f9964062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.271+0000 7f996abff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99640c5c50 0x7f9964063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:07.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.271+0000 7f996abff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9964063530 con 0x7f996414ae00 2023-07-27T14:28:07.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.271+0000 7f996abff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99641553f0 con 0x7f996414b1e0 2023-07-27T14:28:07.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.271+0000 7f996abff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9964157a50 con 0x7f99640c5c50 2023-07-27T14:28:07.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f996414ae00 0x7f9964154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:07.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f996414ae00 0x7f9964154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59204/0 (socket says 172.21.15.115:59204) 2023-07-27T14:28:07.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 -- 172.21.15.115:0/3116565243 learned_addr learned my addr 172.21.15.115:0/3116565243 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:07.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f9963fff700 1 --2- 172.21.15.115:0/3116565243 >> v2:172.21.15.159:3300/0 conn(0x7f996414b1e0 0x7f9964062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:07.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996919c700 1 --2- 172.21.15.115:0/3116565243 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99640c5c50 0x7f9964063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:07.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 -- 172.21.15.115:0/3116565243 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99640c5c50 msgr2=0x7f9964063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:07.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 --2- 172.21.15.115:0/3116565243 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99640c5c50 0x7f9964063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 -- 172.21.15.115:0/3116565243 >> v2:172.21.15.159:3300/0 conn(0x7f996414b1e0 msgr2=0x7f9964062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:07.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 --2- 172.21.15.115:0/3116565243 >> v2:172.21.15.159:3300/0 conn(0x7f996414b1e0 0x7f9964062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 -- 172.21.15.115:0/3116565243 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9964157d10 con 0x7f996414ae00 2023-07-27T14:28:07.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f996899b700 1 --2- 172.21.15.115:0/3116565243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f996414ae00 0x7f9964154f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f99640cbc00 tx=0x7f99580090f0).ready entity=mon.0 client_cookie=7be28b06bca28c58 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:07.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.272+0000 7f99637fe700 1 -- 172.21.15.115:0/3116565243 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995800b600 con 0x7f996414ae00 2023-07-27T14:28:07.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f99637fe700 1 -- 172.21.15.115:0/3116565243 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995800b760 con 0x7f996414ae00 2023-07-27T14:28:07.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f99637fe700 1 -- 172.21.15.115:0/3116565243 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995800bae0 con 0x7f996414ae00 2023-07-27T14:28:07.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 -- 172.21.15.115:0/3116565243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f996414ae00 msgr2=0x7f9964154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:07.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 --2- 172.21.15.115:0/3116565243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f996414ae00 0x7f9964154f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f99640cbc00 tx=0x7f99580090f0).stop 2023-07-27T14:28:07.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 -- 172.21.15.115:0/3116565243 shutdown_connections 2023-07-27T14:28:07.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 --2- 172.21.15.115:0/3116565243 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99640c5c50 0x7f9964063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 --2- 172.21.15.115:0/3116565243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f996414ae00 0x7f9964154f00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 --2- 172.21.15.115:0/3116565243 >> v2:172.21.15.159:3300/0 conn(0x7f996414b1e0 0x7f9964062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 -- 172.21.15.115:0/3116565243 >> 172.21.15.115:0/3116565243 conn(0x7f996405e940 msgr2=0x7f99640cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:07.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 -- 172.21.15.115:0/3116565243 shutdown_connections 2023-07-27T14:28:07.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.273+0000 7f996abff700 1 -- 172.21.15.115:0/3116565243 wait complete. 2023-07-27T14:28:07.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.275+0000 7f996abff700 1 Processor -- start 2023-07-27T14:28:07.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.275+0000 7f996abff700 1 -- start start 2023-07-27T14:28:07.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996abff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99640c5c50 0x7f996414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:07.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996abff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f996414ae00 0x7f99641647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:07.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996abff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f996414b1e0 0x7f99640ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:07.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996abff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9964151de0 con 0x7f99640c5c50 2023-07-27T14:28:07.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996abff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99640b0cd0 con 0x7f996414ae00 2023-07-27T14:28:07.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996abff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9964164310 con 0x7f996414b1e0 2023-07-27T14:28:07.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996899b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99640c5c50 0x7f996414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:07.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996899b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99640c5c50 0x7f996414a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59206/0 (socket says 172.21.15.115:59206) 2023-07-27T14:28:07.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996899b700 1 -- 172.21.15.115:0/2817586728 learned_addr learned my addr 172.21.15.115:0/2817586728 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:07.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f9963fff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f996414ae00 0x7f99641647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:07.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.276+0000 7f996919c700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f996414b1e0 0x7f99640ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:07.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f996899b700 1 -- 172.21.15.115:0/2817586728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f996414b1e0 msgr2=0x7f99640ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f996899b700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f996414b1e0 0x7f99640ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f996899b700 1 -- 172.21.15.115:0/2817586728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f996414ae00 msgr2=0x7f99641647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f996899b700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f996414ae00 0x7f99641647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f996899b700 1 -- 172.21.15.115:0/2817586728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009370 con 0x7f99640c5c50 2023-07-27T14:28:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f996899b700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99640c5c50 0x7f996414a1e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f99640caac0 tx=0x7f9958017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f9960ff9700 1 -- 172.21.15.115:0/2817586728 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995800bea0 con 0x7f99640c5c50 2023-07-27T14:28:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f9960ff9700 1 -- 172.21.15.115:0/2817586728 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995800b8d0 con 0x7f99640c5c50 2023-07-27T14:28:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f9960ff9700 1 -- 172.21.15.115:0/2817586728 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995801c650 con 0x7f99640c5c50 2023-07-27T14:28:07.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996414a6d0 con 0x7f99640c5c50 2023-07-27T14:28:07.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.277+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99640b09f0 con 0x7f99640c5c50 2023-07-27T14:28:07.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.278+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99641645f0 con 0x7f99640c5c50 2023-07-27T14:28:07.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.279+0000 7f9960ff9700 1 -- 172.21.15.115:0/2817586728 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f995802c070 con 0x7f99640c5c50 2023-07-27T14:28:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.280+0000 7f9960ff9700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994805ed90 0x7f9948061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.280+0000 7f9960ff9700 1 -- 172.21.15.115:0/2817586728 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f995807b740 con 0x7f99640c5c50 2023-07-27T14:28:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.280+0000 7f9963fff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994805ed90 0x7f9948061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.280+0000 7f9963fff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994805ed90 0x7f9948061250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9964157200 tx=0x7f9950008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.284+0000 7f9960ff9700 1 -- 172.21.15.115:0/2817586728 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9958050600 con 0x7f99640c5c50 2023-07-27T14:28:07.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:07.497+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f996406c470 con 0x7f99640c5c50 2023-07-27T14:28:08.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.061+0000 7f9960ff9700 1 -- 172.21.15.115:0/2817586728 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f99580200c0 con 0x7f99640c5c50 2023-07-27T14:28:08.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.063+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994805ed90 msgr2=0x7f9948061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.063+0000 7f996abff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994805ed90 0x7f9948061250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9964157200 tx=0x7f9950008040).stop 2023-07-27T14:28:08.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.063+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99640c5c50 msgr2=0x7f996414a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.063+0000 7f996abff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99640c5c50 0x7f996414a1e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f99640caac0 tx=0x7f9958017000).stop 2023-07-27T14:28:08.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.064+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 shutdown_connections 2023-07-27T14:28:08.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.064+0000 7f996abff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994805ed90 0x7f9948061250 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.064+0000 7f996abff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f996414b1e0 0x7f99640ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.064+0000 7f996abff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99640c5c50 0x7f996414a1e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.064+0000 7f996abff700 1 --2- 172.21.15.115:0/2817586728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f996414ae00 0x7f99641647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.064+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 >> 172.21.15.115:0/2817586728 conn(0x7f996405e940 msgr2=0x7f99640a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:08.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.064+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 shutdown_connections 2023-07-27T14:28:08.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.064+0000 7f996abff700 1 -- 172.21.15.115:0/2817586728 wait complete. 2023-07-27T14:28:08.099 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:28:08.099 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:28:08.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.269+0000 7fc63b7ff700 1 Processor -- start 2023-07-27T14:28:08.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.269+0000 7fc63b7ff700 1 -- start start 2023-07-27T14:28:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.270+0000 7fc63b7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc634150af0 0x7fc634150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.270+0000 7fc63b7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc6340a5e40 0x7fc6340c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.270+0000 7fc63b7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63406a440 con 0x7fc6340c0e80 2023-07-27T14:28:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.270+0000 7fc63b7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6340bbc80 con 0x7fc6340a5e40 2023-07-27T14:28:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.270+0000 7fc63b7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc634069e80 con 0x7fc634150af0 2023-07-27T14:28:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.270+0000 7fc638d9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc6340c0e80 0x7fc6340a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46198/0 (socket says 172.21.15.115:46198) 2023-07-27T14:28:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.270+0000 7fc638d9a700 1 -- 172.21.15.115:0/4266937138 learned_addr learned my addr 172.21.15.115:0/4266937138 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:08.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc63959b700 1 --2- 172.21.15.115:0/4266937138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc634150af0 0x7fc634150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc639d9c700 1 --2- 172.21.15.115:0/4266937138 >> v2:172.21.15.159:3300/0 conn(0x7fc6340a5e40 0x7fc6340c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc62bfff700 1 -- 172.21.15.115:0/4266937138 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810362532 0 0) 0x7fc63406a440 con 0x7fc6340c0e80 2023-07-27T14:28:08.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc62bfff700 1 -- 172.21.15.115:0/4266937138 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6200033f0 con 0x7fc6340c0e80 2023-07-27T14:28:08.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc63959b700 1 -- 172.21.15.115:0/4266937138 >> v2:172.21.15.159:3300/0 conn(0x7fc6340a5e40 msgr2=0x7fc6340c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:08.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc63959b700 1 --2- 172.21.15.115:0/4266937138 >> v2:172.21.15.159:3300/0 conn(0x7fc6340a5e40 0x7fc6340c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc63959b700 1 -- 172.21.15.115:0/4266937138 >> v1:172.21.15.115:6789/0 conn(0x7fc6340c0e80 legacy=0x7fc6340a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc62bfff700 1 -- 172.21.15.115:0/4266937138 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317546467 0 0) 0x7fc6200033f0 con 0x7fc6340c0e80 2023-07-27T14:28:08.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc63959b700 1 -- 172.21.15.115:0/4266937138 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63406a160 con 0x7fc634150af0 2023-07-27T14:28:08.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc63959b700 1 --2- 172.21.15.115:0/4266937138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc634150af0 0x7fc634150ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc630009760 tx=0x7fc630009060).ready entity=mon.2 client_cookie=63dd1b3b02dabebc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:08.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.271+0000 7fc62bfff700 1 -- 172.21.15.115:0/4266937138 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624001470 con 0x7fc634150af0 2023-07-27T14:28:08.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc62bfff700 1 -- 172.21.15.115:0/4266937138 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000f4a0 con 0x7fc634150af0 2023-07-27T14:28:08.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc62bfff700 1 -- 172.21.15.115:0/4266937138 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000f820 con 0x7fc634150af0 2023-07-27T14:28:08.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc63b7ff700 1 -- 172.21.15.115:0/4266937138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc634150af0 msgr2=0x7fc634150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/4266937138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc634150af0 0x7fc634150ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc630009760 tx=0x7fc630009060).stop 2023-07-27T14:28:08.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc63b7ff700 1 -- 172.21.15.115:0/4266937138 shutdown_connections 2023-07-27T14:28:08.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/4266937138 >> v2:172.21.15.159:3300/0 conn(0x7fc6340a5e40 0x7fc6340c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/4266937138 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc634150af0 0x7fc634150ed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc63b7ff700 1 -- 172.21.15.115:0/4266937138 >> 172.21.15.115:0/4266937138 conn(0x7fc634062320 msgr2=0x7fc634062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:08.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc63b7ff700 1 -- 172.21.15.115:0/4266937138 shutdown_connections 2023-07-27T14:28:08.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.272+0000 7fc63b7ff700 1 -- 172.21.15.115:0/4266937138 wait complete. 2023-07-27T14:28:08.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.274+0000 7fc63b7ff700 1 Processor -- start 2023-07-27T14:28:08.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.274+0000 7fc63b7ff700 1 -- start start 2023-07-27T14:28:08.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc63b7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6340a5e40 0x7fc634164a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc63b7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c0e80 0x7fc63414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc63b7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc634150af0 0x7fc6340a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc63b7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340aa750 con 0x7fc634150af0 2023-07-27T14:28:08.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc63b7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340aa190 con 0x7fc6340c0e80 2023-07-27T14:28:08.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc63b7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340aa470 con 0x7fc6340a5e40 2023-07-27T14:28:08.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc639d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc634150af0 0x7fc6340a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc639d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc634150af0 0x7fc6340a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59214/0 (socket says 172.21.15.115:59214) 2023-07-27T14:28:08.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc639d9c700 1 -- 172.21.15.115:0/3506377831 learned_addr learned my addr 172.21.15.115:0/3506377831 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:08.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc63959b700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6340a5e40 0x7fc634164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc638d9a700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c0e80 0x7fc63414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc639d9c700 1 -- 172.21.15.115:0/3506377831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6340a5e40 msgr2=0x7fc634164a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc639d9c700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6340a5e40 0x7fc634164a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc639d9c700 1 -- 172.21.15.115:0/3506377831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c0e80 msgr2=0x7fc63414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc639d9c700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c0e80 0x7fc63414a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.275+0000 7fc639d9c700 1 -- 172.21.15.115:0/3506377831 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300092a0 con 0x7fc634150af0 2023-07-27T14:28:08.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.276+0000 7fc639d9c700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc634150af0 0x7fc6340a9890 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fc62c009df0 tx=0x7fc62c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:08.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.276+0000 7fc6297fa700 1 -- 172.21.15.115:0/3506377831 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00caa0 con 0x7fc634150af0 2023-07-27T14:28:08.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.276+0000 7fc6297fa700 1 -- 172.21.15.115:0/3506377831 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c00f040 con 0x7fc634150af0 2023-07-27T14:28:08.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.276+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc634164260 con 0x7fc634150af0 2023-07-27T14:28:08.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.276+0000 7fc6297fa700 1 -- 172.21.15.115:0/3506377831 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00ce10 con 0x7fc634150af0 2023-07-27T14:28:08.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.276+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc634164f50 con 0x7fc634150af0 2023-07-27T14:28:08.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.277+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6341640c0 con 0x7fc634150af0 2023-07-27T14:28:08.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.278+0000 7fc6297fa700 1 -- 172.21.15.115:0/3506377831 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc62c013610 con 0x7fc634150af0 2023-07-27T14:28:08.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.279+0000 7fc6297fa700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc61805ed90 0x7fc618061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.279+0000 7fc6297fa700 1 -- 172.21.15.115:0/3506377831 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc62c07a480 con 0x7fc634150af0 2023-07-27T14:28:08.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.279+0000 7fc63959b700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc61805ed90 0x7fc618061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.280+0000 7fc63959b700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc61805ed90 0x7fc618061250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc6340c1b90 tx=0x7fc630018000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:08.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.282+0000 7fc6297fa700 1 -- 172.21.15.115:0/3506377831 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6341640c0 con 0x7fc634150af0 2023-07-27T14:28:08.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.493+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6341640c0 con 0x7fc634150af0 2023-07-27T14:28:08.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.494+0000 7fc6297fa700 1 -- 172.21.15.115:0/3506377831 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4498 (secure 0 0 0) 0x7fc6341640c0 con 0x7fc634150af0 2023-07-27T14:28:08.512 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:08.512 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/2250060018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2250060018},{"type":"v1","addr":"172.21.15.159:6833","nonce":2250060018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2756493852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2756493852},{"type":"v1","addr":"172.21.15.159:6835","nonce":2756493852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4777,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1646103579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1646103579},{"type":"v1","addr":"172.21.15.115:6836","nonce":1646103579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:28:05.041620+0000","modified":"2023-07-27T14:28:08.054910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4780":{"gid":4780,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6837/770984486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":770984486},{"type":"v1","addr":"172.21.15.115:6837","nonce":770984486}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-07-27T14:28:08.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc61805ed90 msgr2=0x7fc618061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc61805ed90 0x7fc618061250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc6340c1b90 tx=0x7fc630018000).stop 2023-07-27T14:28:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc634150af0 msgr2=0x7fc6340a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc634150af0 0x7fc6340a9890 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fc62c009df0 tx=0x7fc62c00b040).stop 2023-07-27T14:28:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 shutdown_connections 2023-07-27T14:28:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc61805ed90 0x7fc618061250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc634150af0 0x7fc6340a9890 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6340a5e40 0x7fc634164a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 --2- 172.21.15.115:0/3506377831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c0e80 0x7fc63414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 >> 172.21.15.115:0/3506377831 conn(0x7fc634062320 msgr2=0x7fc6340c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 shutdown_connections 2023-07-27T14:28:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.496+0000 7fc63b7ff700 1 -- 172.21.15.115:0/3506377831 wait complete. 2023-07-27T14:28:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 16 2023-07-27T14:28:08.531 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:28:08.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.702+0000 7f1b285ff700 1 Processor -- start 2023-07-27T14:28:08.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.702+0000 7f1b285ff700 1 -- start start 2023-07-27T14:28:08.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.703+0000 7f1b285ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b20153ec0 0x7f1b200a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b285ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b200aa4d0 con 0x7f1b200aaa40 2023-07-27T14:28:08.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b285ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b200c05c0 con 0x7f1b200aa050 2023-07-27T14:28:08.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b285ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200bfc90 con 0x7f1b20153ec0 2023-07-27T14:28:08.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b26b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1b200aaa40 0x7f1b200c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46206/0 (socket says 172.21.15.115:46206) 2023-07-27T14:28:08.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b26b9c700 1 -- 172.21.15.115:0/2818063090 learned_addr learned my addr 172.21.15.115:0/2818063090 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:08.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b2639b700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b20153ec0 0x7f1b200a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233707625 0 0) 0x7f1b18001490 con 0x7f1b200aaa40 2023-07-27T14:28:08.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b0c0033f0 con 0x7f1b200aaa40 2023-07-27T14:28:08.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 404186246 0 0) 0x7f1b0c0033f0 con 0x7f1b200aaa40 2023-07-27T14:28:08.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.704+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b20153ec0 msgr2=0x7f1b200a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:08.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b20153ec0 0x7f1b200a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 >> v1:172.21.15.159:6789/0 conn(0x7f1b200aa050 legacy=0x7f1b200640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200bff70 con 0x7f1b200aaa40 2023-07-27T14:28:08.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1b18001980 con 0x7f1b200aaa40 2023-07-27T14:28:08.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 >> v1:172.21.15.115:6789/0 conn(0x7f1b200aaa40 legacy=0x7f1b200c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c003910 0x7f1b0c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0c004690 0x7f1b0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b20153ec0 0x7f1b0c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200bfc90 con 0x7f1b0c004690 2023-07-27T14:28:08.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c00b8e0 con 0x7f1b0c003910 2023-07-27T14:28:08.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c00ba50 con 0x7f1b20153ec0 2023-07-27T14:28:08.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25b9a700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0c004690 0x7f1b0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b2639b700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c003910 0x7f1b0c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b26b9c700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b20153ec0 0x7f1b0c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25b9a700 1 -- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b20153ec0 msgr2=0x7f1b0c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:08.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25b9a700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b20153ec0 0x7f1b0c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25b9a700 1 -- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c003910 msgr2=0x7f1b0c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:08.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25b9a700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c003910 0x7f1b0c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.705+0000 7f1b25b9a700 1 -- 172.21.15.115:0/2818063090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c0033f0 con 0x7f1b0c004690 2023-07-27T14:28:08.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b25b9a700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0c004690 0x7f1b0c004b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f1b200c8200 tx=0x7f1b10007b90).ready entity=mon.0 client_cookie=e4925bd6f7514dbe server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:08.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10007ea0 con 0x7f1b0c004690 2023-07-27T14:28:08.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10013410 con 0x7f1b0c004690 2023-07-27T14:28:08.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b25399700 1 -- 172.21.15.115:0/2818063090 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10013790 con 0x7f1b0c004690 2023-07-27T14:28:08.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b285ff700 1 -- 172.21.15.115:0/2818063090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0c004690 msgr2=0x7f1b0c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b285ff700 1 --2- 172.21.15.115:0/2818063090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b0c004690 0x7f1b0c004b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f1b200c8200 tx=0x7f1b10007b90).stop 2023-07-27T14:28:08.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b26b9c700 1 -- 172.21.15.115:0/2818063090 reap_dead start 2023-07-27T14:28:08.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b285ff700 1 -- 172.21.15.115:0/2818063090 shutdown_connections 2023-07-27T14:28:08.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b285ff700 1 -- 172.21.15.115:0/2818063090 >> 172.21.15.115:0/2818063090 conn(0x7f1b200cb610 msgr2=0x7f1b200c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:08.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b285ff700 1 -- 172.21.15.115:0/2818063090 shutdown_connections 2023-07-27T14:28:08.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.706+0000 7f1b285ff700 1 -- 172.21.15.115:0/2818063090 wait complete. 2023-07-27T14:28:08.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.708+0000 7f1b285ff700 1 Processor -- start 2023-07-27T14:28:08.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.708+0000 7f1b285ff700 1 -- start start 2023-07-27T14:28:08.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b285ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c004690 0x7f1b200c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b285ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b200c4430 0x7f1b20151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b285ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b201525a0 0x7f1b20152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b285ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c3fa0 con 0x7f1b201525a0 2023-07-27T14:28:08.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b285ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c3390 con 0x7f1b0c004690 2023-07-27T14:28:08.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b285ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c3670 con 0x7f1b200c4430 2023-07-27T14:28:08.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b26b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b201525a0 0x7f1b20152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b26b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b201525a0 0x7f1b20152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59236/0 (socket says 172.21.15.115:59236) 2023-07-27T14:28:08.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b26b9c700 1 -- 172.21.15.115:0/1613406811 learned_addr learned my addr 172.21.15.115:0/1613406811 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:08.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b2639b700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c004690 0x7f1b200c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b25b9a700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b200c4430 0x7f1b20151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b26b9c700 1 -- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b200c4430 msgr2=0x7f1b20151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b26b9c700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b200c4430 0x7f1b20151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b26b9c700 1 -- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c004690 msgr2=0x7f1b200c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.709+0000 7f1b26b9c700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c004690 0x7f1b200c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b26b9c700 1 -- 172.21.15.115:0/1613406811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200c3950 con 0x7f1b201525a0 2023-07-27T14:28:08.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b2639b700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c004690 0x7f1b200c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:08.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b25b9a700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b200c4430 0x7f1b20151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:08.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b26b9c700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b201525a0 0x7f1b20152a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1b18000f80 tx=0x7f1b200c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:08.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b167fc700 1 -- 172.21.15.115:0/1613406811 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1800fa20 con 0x7f1b201525a0 2023-07-27T14:28:08.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b167fc700 1 -- 172.21.15.115:0/1613406811 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1800fb80 con 0x7f1b201525a0 2023-07-27T14:28:08.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200c3c30 con 0x7f1b201525a0 2023-07-27T14:28:08.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b167fc700 1 -- 172.21.15.115:0/1613406811 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18012350 con 0x7f1b201525a0 2023-07-27T14:28:08.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.710+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2014ef10 con 0x7f1b201525a0 2023-07-27T14:28:08.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.711+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b200c3dc0 con 0x7f1b201525a0 2023-07-27T14:28:08.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.712+0000 7f1b167fc700 1 -- 172.21.15.115:0/1613406811 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1b1801b030 con 0x7f1b201525a0 2023-07-27T14:28:08.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.712+0000 7f1b167fc700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0405ed60 0x7f1b04061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:08.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.713+0000 7f1b167fc700 1 -- 172.21.15.115:0/1613406811 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b18079710 con 0x7f1b201525a0 2023-07-27T14:28:08.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.713+0000 7f1b2639b700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0405ed60 0x7f1b04061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:08.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.713+0000 7f1b2639b700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0405ed60 0x7f1b04061220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f1b1c009270 tx=0x7f1b1c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:08.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.717+0000 7f1b167fc700 1 -- 172.21.15.115:0/1613406811 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b1804aba0 con 0x7f1b201525a0 2023-07-27T14:28:08.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.887+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b200aa4d0 con 0x7f1b201525a0 2023-07-27T14:28:08.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.888+0000 7f1b167fc700 1 -- 172.21.15.115:0/1613406811 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f1b200aa4d0 con 0x7f1b201525a0 2023-07-27T14:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":36,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:28:06.044015+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:28:03.303433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-27T14:28:04.025837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:28:08.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0405ed60 msgr2=0x7f1b04061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0405ed60 0x7f1b04061220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f1b1c009270 tx=0x7f1b1c008040).stop 2023-07-27T14:28:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b201525a0 msgr2=0x7f1b20152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b201525a0 0x7f1b20152a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1b18000f80 tx=0x7f1b200c0530).stop 2023-07-27T14:28:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 shutdown_connections 2023-07-27T14:28:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0405ed60 0x7f1b04061220 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b201525a0 0x7f1b20152a20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b0c004690 0x7f1b200c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 --2- 172.21.15.115:0/1613406811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b200c4430 0x7f1b20151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 >> 172.21.15.115:0/1613406811 conn(0x7f1b200cb610 msgr2=0x7f1b200c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 shutdown_connections 2023-07-27T14:28:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:08.890+0000 7f1b285ff700 1 -- 172.21.15.115:0/1613406811 wait complete. 2023-07-27T14:28:08.925 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:28:08.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:28:09.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.099+0000 7fdb10dff700 1 Processor -- start 2023-07-27T14:28:09.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.099+0000 7fdb10dff700 1 -- start start 2023-07-27T14:28:09.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.100+0000 7fdb10dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdb0c0aaa40 0x7fdb0c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.100+0000 7fdb10dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb0c1542a0 0x7fdb0c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.100+0000 7fdb10dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c0aa4d0 con 0x7fdb0c153ec0 2023-07-27T14:28:09.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.100+0000 7fdb10dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c064ad0 con 0x7fdb0c1542a0 2023-07-27T14:28:09.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.100+0000 7fdb10dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c05c0 con 0x7fdb0c0aaa40 2023-07-27T14:28:09.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0ad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb0c1542a0 0x7fdb0c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdb0c153ec0 0x7fdb0c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46210/0 (socket says 172.21.15.115:46210) 2023-07-27T14:28:09.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0a59c700 1 -- 172.21.15.115:0/4035790703 learned_addr learned my addr 172.21.15.115:0/4035790703 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:09.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb09d9b700 1 --2- 172.21.15.115:0/4035790703 >> v2:172.21.15.159:3300/0 conn(0x7fdb0c0aaa40 0x7fdb0c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0ad9d700 1 -- 172.21.15.115:0/4035790703 >> v2:172.21.15.159:3300/0 conn(0x7fdb0c0aaa40 msgr2=0x7fdb0c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:09.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0ad9d700 1 --2- 172.21.15.115:0/4035790703 >> v2:172.21.15.159:3300/0 conn(0x7fdb0c0aaa40 0x7fdb0c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0ad9d700 1 -- 172.21.15.115:0/4035790703 >> v1:172.21.15.115:6789/0 conn(0x7fdb0c153ec0 legacy=0x7fdb0c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0ad9d700 1 -- 172.21.15.115:0/4035790703 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0c1a60 con 0x7fdb0c1542a0 2023-07-27T14:28:09.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0959a700 1 -- 172.21.15.115:0/4035790703 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463045734 0 0) 0x7fdafc001110 con 0x7fdb0c153ec0 2023-07-27T14:28:09.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb09d9b700 1 --2- 172.21.15.115:0/4035790703 >> v2:172.21.15.159:3300/0 conn(0x7fdb0c0aaa40 0x7fdb0c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:09.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.101+0000 7fdb0ad9d700 1 --2- 172.21.15.115:0/4035790703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c0645e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fdb0c06c0d0 tx=0x7fdb04009780).ready entity=mon.0 client_cookie=c23e3aed7e27e8e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:09.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb0959a700 1 -- 172.21.15.115:0/4035790703 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400e070 con 0x7fdb0c1542a0 2023-07-27T14:28:09.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb0959a700 1 -- 172.21.15.115:0/4035790703 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400bc30 con 0x7fdb0c1542a0 2023-07-27T14:28:09.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb0959a700 1 -- 172.21.15.115:0/4035790703 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04012410 con 0x7fdb0c1542a0 2023-07-27T14:28:09.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb10dff700 1 -- 172.21.15.115:0/4035790703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 msgr2=0x7fdb0c0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb10dff700 1 --2- 172.21.15.115:0/4035790703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c0645e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fdb0c06c0d0 tx=0x7fdb04009780).stop 2023-07-27T14:28:09.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb10dff700 1 -- 172.21.15.115:0/4035790703 shutdown_connections 2023-07-27T14:28:09.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb10dff700 1 --2- 172.21.15.115:0/4035790703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c0645e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb10dff700 1 --2- 172.21.15.115:0/4035790703 >> v2:172.21.15.159:3300/0 conn(0x7fdb0c0aaa40 0x7fdb0c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb10dff700 1 -- 172.21.15.115:0/4035790703 >> 172.21.15.115:0/4035790703 conn(0x7fdb0c0cb610 msgr2=0x7fdb0c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:09.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb10dff700 1 -- 172.21.15.115:0/4035790703 shutdown_connections 2023-07-27T14:28:09.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.102+0000 7fdb10dff700 1 -- 172.21.15.115:0/4035790703 wait complete. 2023-07-27T14:28:09.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.104+0000 7fdb10dff700 1 Processor -- start 2023-07-27T14:28:09.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.104+0000 7fdb10dff700 1 -- start start 2023-07-27T14:28:09.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb10dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb0c0aaa40 0x7fdb0c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb10dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb0c153ec0 0x7fdb0c140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb10dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c14fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb10dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c14f750 con 0x7fdb0c1542a0 2023-07-27T14:28:09.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb10dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c14eb40 con 0x7fdb0c153ec0 2023-07-27T14:28:09.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb10dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c14ee20 con 0x7fdb0c0aaa40 2023-07-27T14:28:09.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c14fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c14fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59250/0 (socket says 172.21.15.115:59250) 2023-07-27T14:28:09.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0ad9d700 1 -- 172.21.15.115:0/2545237745 learned_addr learned my addr 172.21.15.115:0/2545237745 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:09.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb09d9b700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb0c153ec0 0x7fdb0c140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0a59c700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb0c0aaa40 0x7fdb0c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0ad9d700 1 -- 172.21.15.115:0/2545237745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb0c0aaa40 msgr2=0x7fdb0c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0ad9d700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb0c0aaa40 0x7fdb0c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0ad9d700 1 -- 172.21.15.115:0/2545237745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb0c153ec0 msgr2=0x7fdb0c140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0ad9d700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb0c153ec0 0x7fdb0c140690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.105+0000 7fdb0ad9d700 1 -- 172.21.15.115:0/2545237745 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb04009a20 con 0x7fdb0c1542a0 2023-07-27T14:28:09.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.106+0000 7fdb0ad9d700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c14fbe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fdb04011000 tx=0x7fdb0c0c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:09.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.106+0000 7fdafa7fc700 1 -- 172.21.15.115:0/2545237745 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400b6f0 con 0x7fdb0c1542a0 2023-07-27T14:28:09.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.106+0000 7fdafa7fc700 1 -- 172.21.15.115:0/2545237745 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb040032f0 con 0x7fdb0c1542a0 2023-07-27T14:28:09.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.106+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c14f100 con 0x7fdb0c1542a0 2023-07-27T14:28:09.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.106+0000 7fdafa7fc700 1 -- 172.21.15.115:0/2545237745 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011d10 con 0x7fdb0c1542a0 2023-07-27T14:28:09.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.106+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c14e030 con 0x7fdb0c1542a0 2023-07-27T14:28:09.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.107+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c06c470 con 0x7fdb0c1542a0 2023-07-27T14:28:09.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.108+0000 7fdafa7fc700 1 -- 172.21.15.115:0/2545237745 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fdb0401d630 con 0x7fdb0c1542a0 2023-07-27T14:28:09.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.109+0000 7fdafa7fc700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdaec05ed90 0x7fdaec061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.109+0000 7fdafa7fc700 1 -- 172.21.15.115:0/2545237745 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb0407bea0 con 0x7fdb0c1542a0 2023-07-27T14:28:09.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.109+0000 7fdb0a59c700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdaec05ed90 0x7fdaec061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.110+0000 7fdb0a59c700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdaec05ed90 0x7fdaec061250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fdafc001720 tx=0x7fdafc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:09.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.113+0000 7fdafa7fc700 1 -- 172.21.15.115:0/2545237745 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb0404d330 con 0x7fdb0c1542a0 2023-07-27T14:28:09.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.278+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb0c062540 con 0x7fdaec05ed90 2023-07-27T14:28:09.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.289+0000 7fdafa7fc700 1 -- 172.21.15.115:0/2545237745 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350049 (secure 0 0 0) 0x7fdb0c062540 con 0x7fdaec05ed90 2023-07-27T14:28:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:09.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdaec05ed90 msgr2=0x7fdaec061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdaec05ed90 0x7fdaec061250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fdafc001720 tx=0x7fdafc009040).stop 2023-07-27T14:28:09.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 msgr2=0x7fdb0c14fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c14fbe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fdb04011000 tx=0x7fdb0c0c0530).stop 2023-07-27T14:28:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 shutdown_connections 2023-07-27T14:28:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdaec05ed90 0x7fdaec061250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c1542a0 0x7fdb0c14fbe0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb0c0aaa40 0x7fdb0c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 --2- 172.21.15.115:0/2545237745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb0c153ec0 0x7fdb0c140690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 >> 172.21.15.115:0/2545237745 conn(0x7fdb0c0cb610 msgr2=0x7fdb0c0ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:09.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 shutdown_connections 2023-07-27T14:28:09.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.293+0000 7fdb10dff700 1 -- 172.21.15.115:0/2545237745 wait complete. 2023-07-27T14:28:09.314 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:28:09.328 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-07-27T14:28:07.450253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":43968,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":41088,"kb_avail":754930752,"statfs":{"total":773094113280,"available":773049090048,"internally_reserved":0,"allocated":2883584,"data_stored":1166288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42074112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4861,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.383607"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.414176+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:27:57.414176+0000","last_peered":"2023-07-27T14:27:57.414176+0000","last_clean":"2023-07-27T14:27:57.414176+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:27:57.414176+0000","last_undegraded":"2023-07-27T14:27:57.414176+0000","last_fullsized":"2023-07-27T14:27:57.414176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.212453+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:27:57.212453+0000","last_peered":"2023-07-27T14:27:57.212453+0000","last_clean":"2023-07-27T14:27:57.212453+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:27:57.212453+0000","last_undegraded":"2023-07-27T14:27:57.212453+0000","last_fullsized":"2023-07-27T14:27:57.212453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.045037+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:27:57.045037+0000","last_peered":"2023-07-27T14:27:57.045037+0000","last_clean":"2023-07-27T14:27:57.045037+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:27:57.045037+0000","last_undegraded":"2023-07-27T14:27:57.045037+0000","last_fullsized":"2023-07-27T14:27:57.045037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.212464+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:27:57.212464+0000","last_peered":"2023-07-27T14:27:57.212464+0000","last_clean":"2023-07-27T14:27:57.212464+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:27:57.212464+0000","last_undegraded":"2023-07-27T14:27:57.212464+0000","last_fullsized":"2023-07-27T14:27:57.212464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.414223+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:27:57.414223+0000","last_peered":"2023-07-27T14:27:57.414223+0000","last_clean":"2023-07-27T14:27:57.414223+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:27:57.414223+0000","last_undegraded":"2023-07-27T14:27:57.414223+0000","last_fullsized":"2023-07-27T14:27:57.414223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.414229+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:27:57.414229+0000","last_peered":"2023-07-27T14:27:57.414229+0000","last_clean":"2023-07-27T14:27:57.414229+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:27:57.414229+0000","last_undegraded":"2023-07-27T14:27:57.414229+0000","last_fullsized":"2023-07-27T14:27:57.414229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.414224+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:27:57.414224+0000","last_peered":"2023-07-27T14:27:57.414224+0000","last_clean":"2023-07-27T14:27:57.414224+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:27:57.414224+0000","last_undegraded":"2023-07-27T14:27:57.414224+0000","last_fullsized":"2023-07-27T14:27:57.414224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.414176+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:27:57.414176+0000","last_peered":"2023-07-27T14:27:57.414176+0000","last_clean":"2023-07-27T14:27:57.414176+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:27:57.414176+0000","last_undegraded":"2023-07-27T14:27:57.414176+0000","last_fullsized":"2023-07-27T14:27:57.414176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:04.573621+0000","last_change":"2023-07-27T14:28:04.573621+0000","last_active":"2023-07-27T14:28:04.573621+0000","last_peered":"2023-07-27T14:28:04.573621+0000","last_clean":"2023-07-27T14:28:04.573621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:04.573621+0000","last_undegraded":"2023-07-27T14:28:04.573621+0000","last_fullsized":"2023-07-27T14:28:04.573621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:28:03.567460+0000","last_change":"2023-07-27T14:28:03.567460+0000","last_active":"2023-07-27T14:28:03.567460+0000","last_peered":"2023-07-27T14:28:03.567460+0000","last_clean":"2023-07-27T14:28:03.567460+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:28:03.567460+0000","last_undegraded":"2023-07-27T14:28:03.567460+0000","last_fullsized":"2023-07-27T14:28:03.567460+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-27T14:27:57.414305+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:27:57.414305+0000","last_peered":"2023-07-27T14:27:57.414305+0000","last_clean":"2023-07-27T14:27:57.414305+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:27:57.414305+0000","last_undegraded":"2023-07-27T14:27:57.414305+0000","last_fullsized":"2023-07-27T14:27:57.414305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5544,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366296,"statfs":{"total":96636764160,"available":96631087104,"internally_reserved":0,"allocated":360448,"data_stored":145786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.497},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.879},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.97899999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.028}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":145786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.82599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":145786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":4.75,"5min":4.75,"15min":4.75},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":9.3100000000000005,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.7210000000000001,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.44},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.7440000000000002,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":6.1980000000000004,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":145786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.371}]},{"osd":4,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.63},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.84099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5416,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":94366424,"statfs":{"total":96636764160,"available":96631218176,"internally_reserved":0,"allocated":360448,"data_stored":145786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.438}]},{"osd":3,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.372},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5544,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366296,"statfs":{"total":96636764160,"available":96631087104,"internally_reserved":0,"allocated":360448,"data_stored":145786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.495},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.435}]},{"osd":4,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.751},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.876}]},{"osd":6,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.88600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5544,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366296,"statfs":{"total":96636764160,"available":96631087104,"internally_reserved":0,"allocated":360448,"data_stored":145786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.745}]},{"osd":1,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5480,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":94366360,"statfs":{"total":96636764160,"available":96631152640,"internally_reserved":0,"allocated":360448,"data_stored":145786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.626}]},{"osd":1,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.749},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:28:09.336 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:28:09.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.539+0000 7fe73d9ff700 1 Processor -- start 2023-07-27T14:28:09.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.539+0000 7fe73d9ff700 1 -- start start 2023-07-27T14:28:09.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe73d9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe738151d70 0x7fe738155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe73d9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe738066b80 0x7fe738067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe73d9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe738067080 con 0x7fe738065ff0 2023-07-27T14:28:09.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe73d9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe738063a90 con 0x7fe738151d70 2023-07-27T14:28:09.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe73d9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7380634d0 con 0x7fe738066b80 2023-07-27T14:28:09.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe736ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe738151d70 0x7fe738155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe736ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe738151d70 0x7fe738155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59258/0 (socket says 172.21.15.115:59258) 2023-07-27T14:28:09.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe736ffd700 1 -- 172.21.15.115:0/3553262680 learned_addr learned my addr 172.21.15.115:0/3553262680 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:09.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.541+0000 7fe7377fe700 1 --2- 172.21.15.115:0/3553262680 >> v2:172.21.15.159:3300/0 conn(0x7fe738066b80 0x7fe738067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.542+0000 7fe736ffd700 1 -- 172.21.15.115:0/3553262680 >> v2:172.21.15.159:3300/0 conn(0x7fe738066b80 msgr2=0x7fe738067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:09.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.542+0000 7fe736ffd700 1 --2- 172.21.15.115:0/3553262680 >> v2:172.21.15.159:3300/0 conn(0x7fe738066b80 0x7fe738067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.542+0000 7fe736ffd700 1 -- 172.21.15.115:0/3553262680 >> v1:172.21.15.159:6789/0 conn(0x7fe738065ff0 legacy=0x7fe738066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:09.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.542+0000 7fe736ffd700 1 -- 172.21.15.115:0/3553262680 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380637b0 con 0x7fe738151d70 2023-07-27T14:28:09.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.542+0000 7fe736ffd700 1 --2- 172.21.15.115:0/3553262680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe738155060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fe738069ae0 tx=0x7fe7280090f0).ready entity=mon.0 client_cookie=f5ca7b9129c6fad1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:09.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.542+0000 7fe735ffb700 1 -- 172.21.15.115:0/3553262680 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800b5a0 con 0x7fe738151d70 2023-07-27T14:28:09.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.542+0000 7fe735ffb700 1 -- 172.21.15.115:0/3553262680 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72800b700 con 0x7fe738151d70 2023-07-27T14:28:09.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.542+0000 7fe735ffb700 1 -- 172.21.15.115:0/3553262680 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800ba80 con 0x7fe738151d70 2023-07-27T14:28:09.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.543+0000 7fe73d9ff700 1 -- 172.21.15.115:0/3553262680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 msgr2=0x7fe738155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.543+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/3553262680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe738155060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fe738069ae0 tx=0x7fe7280090f0).stop 2023-07-27T14:28:09.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.543+0000 7fe73d9ff700 1 -- 172.21.15.115:0/3553262680 shutdown_connections 2023-07-27T14:28:09.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.543+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/3553262680 >> v2:172.21.15.159:3300/0 conn(0x7fe738066b80 0x7fe738067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.543+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/3553262680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe738155060 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.543+0000 7fe73d9ff700 1 -- 172.21.15.115:0/3553262680 >> 172.21.15.115:0/3553262680 conn(0x7fe7380c89a0 msgr2=0x7fe7380c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:09.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.543+0000 7fe73d9ff700 1 -- 172.21.15.115:0/3553262680 shutdown_connections 2023-07-27T14:28:09.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.543+0000 7fe73d9ff700 1 -- 172.21.15.115:0/3553262680 wait complete. 2023-07-27T14:28:09.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.544+0000 7fe73d9ff700 1 Processor -- start 2023-07-27T14:28:09.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.544+0000 7fe73d9ff700 1 -- start start 2023-07-27T14:28:09.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.545+0000 7fe73d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe738065ff0 0x7fe73814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.545+0000 7fe73d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe738066b80 0x7fe73814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.545+0000 7fe73d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe73814f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.545+0000 7fe73d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73814f960 con 0x7fe738151d70 2023-07-27T14:28:09.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.545+0000 7fe73d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380a52a0 con 0x7fe738066b80 2023-07-27T14:28:09.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.545+0000 7fe73d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380a4970 con 0x7fe738065ff0 2023-07-27T14:28:09.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe73814f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe73814f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59264/0 (socket says 172.21.15.115:59264) 2023-07-27T14:28:09.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 -- 172.21.15.115:0/2067857228 learned_addr learned my addr 172.21.15.115:0/2067857228 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:09.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe736ffd700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe738065ff0 0x7fe73814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7367fc700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe738066b80 0x7fe73814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 -- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe738065ff0 msgr2=0x7fe73814ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe738065ff0 0x7fe73814ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 -- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe738066b80 msgr2=0x7fe73814eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe738066b80 0x7fe73814eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 -- 172.21.15.115:0/2067857228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728009370 con 0x7fe738151d70 2023-07-27T14:28:09.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7367fc700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe738066b80 0x7fe73814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:09.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe7377fe700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe73814f390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fe730007f50 tx=0x7fe7300098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:09.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe71effd700 1 -- 172.21.15.115:0/2067857228 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73000ec20 con 0x7fe738151d70 2023-07-27T14:28:09.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe71effd700 1 -- 172.21.15.115:0/2067857228 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73000ed80 con 0x7fe738151d70 2023-07-27T14:28:09.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7380a4c50 con 0x7fe738151d70 2023-07-27T14:28:09.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.546+0000 7fe71effd700 1 -- 172.21.15.115:0/2067857228 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730014610 con 0x7fe738151d70 2023-07-27T14:28:09.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.547+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7380a5730 con 0x7fe738151d70 2023-07-27T14:28:09.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.547+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe738151240 con 0x7fe738151d70 2023-07-27T14:28:09.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.549+0000 7fe71effd700 1 -- 172.21.15.115:0/2067857228 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fe73001b030 con 0x7fe738151d70 2023-07-27T14:28:09.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.549+0000 7fe71effd700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe72405ed90 0x7fe724061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:09.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.549+0000 7fe71effd700 1 -- 172.21.15.115:0/2067857228 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe730079fd0 con 0x7fe738151d70 2023-07-27T14:28:09.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.550+0000 7fe736ffd700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe72405ed90 0x7fe724061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:09.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.550+0000 7fe736ffd700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe72405ed90 0x7fe724061250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe728009130 tx=0x7fe728015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:09.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.553+0000 7fe71effd700 1 -- 172.21.15.115:0/2067857228 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe73004b460 con 0x7fe738151d70 2023-07-27T14:28:09.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.718+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe73806c470 con 0x7fe72405ed90 2023-07-27T14:28:09.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.728+0000 7fe71effd700 1 -- 172.21.15.115:0/2067857228 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361283 (secure 0 0 0) 0x7fe73806c470 con 0x7fe72405ed90 2023-07-27T14:28:09.749 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:09.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.732+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe72405ed90 msgr2=0x7fe724061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.732+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe72405ed90 0x7fe724061250 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe728009130 tx=0x7fe728015000).stop 2023-07-27T14:28:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.732+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 msgr2=0x7fe73814f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.732+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe73814f390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fe730007f50 tx=0x7fe7300098a0).stop 2023-07-27T14:28:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.733+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 shutdown_connections 2023-07-27T14:28:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.733+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe72405ed90 0x7fe724061250 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.733+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe738151d70 0x7fe73814f390 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.733+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe738065ff0 0x7fe73814ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.733+0000 7fe73d9ff700 1 --2- 172.21.15.115:0/2067857228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe738066b80 0x7fe73814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.733+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 >> 172.21.15.115:0/2067857228 conn(0x7fe7380c89a0 msgr2=0x7fe7380c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.733+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 shutdown_connections 2023-07-27T14:28:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.733+0000 7fe73d9ff700 1 -- 172.21.15.115:0/2067857228 wait complete. 2023-07-27T14:28:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:28:09.767 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-07-27T14:28:09.450633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":45812,"kb_used_data":3252,"kb_used_omap":0,"kb_used_meta":42496,"kb_avail":754928908,"statfs":{"total":773094113280,"available":773047201792,"internally_reserved":0,"allocated":3330048,"data_stored":1378460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43515904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4861,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.383607"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.076857+0000","last_change":"2023-07-27T14:28:05.066812+0000","last_active":"2023-07-27T14:28:05.076857+0000","last_peered":"2023-07-27T14:28:05.076857+0000","last_clean":"2023-07-27T14:28:05.076857+0000","last_became_active":"2023-07-27T14:28:05.066351+0000","last_became_peered":"2023-07-27T14:28:05.066351+0000","last_unstale":"2023-07-27T14:28:05.076857+0000","last_undegraded":"2023-07-27T14:28:05.076857+0000","last_fullsized":"2023-07-27T14:28:05.076857+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"35'3","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.079013+0000","last_change":"2023-07-27T14:28:04.604888+0000","last_active":"2023-07-27T14:28:05.079013+0000","last_peered":"2023-07-27T14:28:05.079013+0000","last_clean":"2023-07-27T14:28:05.079013+0000","last_became_active":"2023-07-27T14:28:04.604524+0000","last_became_peered":"2023-07-27T14:28:04.604524+0000","last_unstale":"2023-07-27T14:28:05.079013+0000","last_undegraded":"2023-07-27T14:28:05.079013+0000","last_fullsized":"2023-07-27T14:28:05.079013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.078806+0000","last_change":"2023-07-27T14:28:05.077664+0000","last_active":"2023-07-27T14:28:05.078806+0000","last_peered":"2023-07-27T14:28:05.078806+0000","last_clean":"2023-07-27T14:28:05.078806+0000","last_became_active":"2023-07-27T14:28:05.077338+0000","last_became_peered":"2023-07-27T14:28:05.077338+0000","last_unstale":"2023-07-27T14:28:05.078806+0000","last_undegraded":"2023-07-27T14:28:05.078806+0000","last_fullsized":"2023-07-27T14:28:05.078806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.049717+0000","last_change":"2023-07-27T14:28:04.605016+0000","last_active":"2023-07-27T14:28:05.049717+0000","last_peered":"2023-07-27T14:28:05.049717+0000","last_clean":"2023-07-27T14:28:05.049717+0000","last_became_active":"2023-07-27T14:28:04.604767+0000","last_became_peered":"2023-07-27T14:28:04.604767+0000","last_unstale":"2023-07-27T14:28:05.049717+0000","last_undegraded":"2023-07-27T14:28:05.049717+0000","last_fullsized":"2023-07-27T14:28:05.049717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.072447+0000","last_change":"2023-07-27T14:28:05.069127+0000","last_active":"2023-07-27T14:28:05.072447+0000","last_peered":"2023-07-27T14:28:05.072447+0000","last_clean":"2023-07-27T14:28:05.072447+0000","last_became_active":"2023-07-27T14:28:05.068863+0000","last_became_peered":"2023-07-27T14:28:05.068863+0000","last_unstale":"2023-07-27T14:28:05.072447+0000","last_undegraded":"2023-07-27T14:28:05.072447+0000","last_fullsized":"2023-07-27T14:28:05.072447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.064129+0000","last_change":"2023-07-27T14:28:04.603475+0000","last_active":"2023-07-27T14:28:05.064129+0000","last_peered":"2023-07-27T14:28:05.064129+0000","last_clean":"2023-07-27T14:28:05.064129+0000","last_became_active":"2023-07-27T14:28:04.603010+0000","last_became_peered":"2023-07-27T14:28:04.603010+0000","last_unstale":"2023-07-27T14:28:05.064129+0000","last_undegraded":"2023-07-27T14:28:05.064129+0000","last_fullsized":"2023-07-27T14:28:05.064129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.072589+0000","last_change":"2023-07-27T14:28:05.066438+0000","last_active":"2023-07-27T14:28:05.072589+0000","last_peered":"2023-07-27T14:28:05.072589+0000","last_clean":"2023-07-27T14:28:05.072589+0000","last_became_active":"2023-07-27T14:28:05.066151+0000","last_became_peered":"2023-07-27T14:28:05.066151+0000","last_unstale":"2023-07-27T14:28:05.072589+0000","last_undegraded":"2023-07-27T14:28:05.072589+0000","last_fullsized":"2023-07-27T14:28:05.072589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.070183+0000","last_change":"2023-07-27T14:28:04.612142+0000","last_active":"2023-07-27T14:28:05.070183+0000","last_peered":"2023-07-27T14:28:05.070183+0000","last_clean":"2023-07-27T14:28:05.070183+0000","last_became_active":"2023-07-27T14:28:04.612004+0000","last_became_peered":"2023-07-27T14:28:04.612004+0000","last_unstale":"2023-07-27T14:28:05.070183+0000","last_undegraded":"2023-07-27T14:28:05.070183+0000","last_fullsized":"2023-07-27T14:28:05.070183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.072698+0000","last_change":"2023-07-27T14:28:05.062826+0000","last_active":"2023-07-27T14:28:05.072698+0000","last_peered":"2023-07-27T14:28:05.072698+0000","last_clean":"2023-07-27T14:28:05.072698+0000","last_became_active":"2023-07-27T14:28:05.062506+0000","last_became_peered":"2023-07-27T14:28:05.062506+0000","last_unstale":"2023-07-27T14:28:05.072698+0000","last_undegraded":"2023-07-27T14:28:05.072698+0000","last_fullsized":"2023-07-27T14:28:05.072698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.069530+0000","last_change":"2023-07-27T14:28:04.610062+0000","last_active":"2023-07-27T14:28:05.069530+0000","last_peered":"2023-07-27T14:28:05.069530+0000","last_clean":"2023-07-27T14:28:05.069530+0000","last_became_active":"2023-07-27T14:28:04.609445+0000","last_became_peered":"2023-07-27T14:28:04.609445+0000","last_unstale":"2023-07-27T14:28:05.069530+0000","last_undegraded":"2023-07-27T14:28:05.069530+0000","last_fullsized":"2023-07-27T14:28:05.069530+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080805+0000","last_change":"2023-07-27T14:28:05.076118+0000","last_active":"2023-07-27T14:28:05.080805+0000","last_peered":"2023-07-27T14:28:05.080805+0000","last_clean":"2023-07-27T14:28:05.080805+0000","last_became_active":"2023-07-27T14:28:05.074704+0000","last_became_peered":"2023-07-27T14:28:05.074704+0000","last_unstale":"2023-07-27T14:28:05.080805+0000","last_undegraded":"2023-07-27T14:28:05.080805+0000","last_fullsized":"2023-07-27T14:28:05.080805+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080369+0000","last_change":"2023-07-27T14:28:04.602586+0000","last_active":"2023-07-27T14:28:05.080369+0000","last_peered":"2023-07-27T14:28:05.080369+0000","last_clean":"2023-07-27T14:28:05.080369+0000","last_became_active":"2023-07-27T14:28:04.602075+0000","last_became_peered":"2023-07-27T14:28:04.602075+0000","last_unstale":"2023-07-27T14:28:05.080369+0000","last_undegraded":"2023-07-27T14:28:05.080369+0000","last_fullsized":"2023-07-27T14:28:05.080369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.071483+0000","last_change":"2023-07-27T14:28:05.069213+0000","last_active":"2023-07-27T14:28:05.071483+0000","last_peered":"2023-07-27T14:28:05.071483+0000","last_clean":"2023-07-27T14:28:05.071483+0000","last_became_active":"2023-07-27T14:28:05.068923+0000","last_became_peered":"2023-07-27T14:28:05.068923+0000","last_unstale":"2023-07-27T14:28:05.071483+0000","last_undegraded":"2023-07-27T14:28:05.071483+0000","last_fullsized":"2023-07-27T14:28:05.071483+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048981+0000","last_change":"2023-07-27T14:28:04.603992+0000","last_active":"2023-07-27T14:28:05.048981+0000","last_peered":"2023-07-27T14:28:05.048981+0000","last_clean":"2023-07-27T14:28:05.048981+0000","last_became_active":"2023-07-27T14:28:04.603693+0000","last_became_peered":"2023-07-27T14:28:04.603693+0000","last_unstale":"2023-07-27T14:28:05.048981+0000","last_undegraded":"2023-07-27T14:28:05.048981+0000","last_fullsized":"2023-07-27T14:28:05.048981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.076770+0000","last_change":"2023-07-27T14:28:05.067391+0000","last_active":"2023-07-27T14:28:05.076770+0000","last_peered":"2023-07-27T14:28:05.076770+0000","last_clean":"2023-07-27T14:28:05.076770+0000","last_became_active":"2023-07-27T14:28:05.067126+0000","last_became_peered":"2023-07-27T14:28:05.067126+0000","last_unstale":"2023-07-27T14:28:05.076770+0000","last_undegraded":"2023-07-27T14:28:05.076770+0000","last_fullsized":"2023-07-27T14:28:05.076770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048868+0000","last_change":"2023-07-27T14:28:04.603795+0000","last_active":"2023-07-27T14:28:05.048868+0000","last_peered":"2023-07-27T14:28:05.048868+0000","last_clean":"2023-07-27T14:28:05.048868+0000","last_became_active":"2023-07-27T14:28:04.603415+0000","last_became_peered":"2023-07-27T14:28:04.603415+0000","last_unstale":"2023-07-27T14:28:05.048868+0000","last_undegraded":"2023-07-27T14:28:05.048868+0000","last_fullsized":"2023-07-27T14:28:05.048868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.069388+0000","last_change":"2023-07-27T14:28:05.067835+0000","last_active":"2023-07-27T14:28:05.069388+0000","last_peered":"2023-07-27T14:28:05.069388+0000","last_clean":"2023-07-27T14:28:05.069388+0000","last_became_active":"2023-07-27T14:28:05.067553+0000","last_became_peered":"2023-07-27T14:28:05.067553+0000","last_unstale":"2023-07-27T14:28:05.069388+0000","last_undegraded":"2023-07-27T14:28:05.069388+0000","last_fullsized":"2023-07-27T14:28:05.069388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.053591+0000","last_change":"2023-07-27T14:28:04.614414+0000","last_active":"2023-07-27T14:28:05.053591+0000","last_peered":"2023-07-27T14:28:05.053591+0000","last_clean":"2023-07-27T14:28:05.053591+0000","last_became_active":"2023-07-27T14:28:04.614045+0000","last_became_peered":"2023-07-27T14:28:04.614045+0000","last_unstale":"2023-07-27T14:28:05.053591+0000","last_undegraded":"2023-07-27T14:28:05.053591+0000","last_fullsized":"2023-07-27T14:28:05.053591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.081819+0000","last_change":"2023-07-27T14:28:05.076620+0000","last_active":"2023-07-27T14:28:05.081819+0000","last_peered":"2023-07-27T14:28:05.081819+0000","last_clean":"2023-07-27T14:28:05.081819+0000","last_became_active":"2023-07-27T14:28:05.076218+0000","last_became_peered":"2023-07-27T14:28:05.076218+0000","last_unstale":"2023-07-27T14:28:05.081819+0000","last_undegraded":"2023-07-27T14:28:05.081819+0000","last_fullsized":"2023-07-27T14:28:05.081819+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.061864+0000","last_change":"2023-07-27T14:28:04.600221+0000","last_active":"2023-07-27T14:28:05.061864+0000","last_peered":"2023-07-27T14:28:05.061864+0000","last_clean":"2023-07-27T14:28:05.061864+0000","last_became_active":"2023-07-27T14:28:04.599938+0000","last_became_peered":"2023-07-27T14:28:04.599938+0000","last_unstale":"2023-07-27T14:28:05.061864+0000","last_undegraded":"2023-07-27T14:28:05.061864+0000","last_fullsized":"2023-07-27T14:28:05.061864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080882+0000","last_change":"2023-07-27T14:28:05.075530+0000","last_active":"2023-07-27T14:28:05.080882+0000","last_peered":"2023-07-27T14:28:05.080882+0000","last_clean":"2023-07-27T14:28:05.080882+0000","last_became_active":"2023-07-27T14:28:05.075165+0000","last_became_peered":"2023-07-27T14:28:05.075165+0000","last_unstale":"2023-07-27T14:28:05.080882+0000","last_undegraded":"2023-07-27T14:28:05.080882+0000","last_fullsized":"2023-07-27T14:28:05.080882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048891+0000","last_change":"2023-07-27T14:28:04.613516+0000","last_active":"2023-07-27T14:28:05.048891+0000","last_peered":"2023-07-27T14:28:05.048891+0000","last_clean":"2023-07-27T14:28:05.048891+0000","last_became_active":"2023-07-27T14:28:04.613180+0000","last_became_peered":"2023-07-27T14:28:04.613180+0000","last_unstale":"2023-07-27T14:28:05.048891+0000","last_undegraded":"2023-07-27T14:28:05.048891+0000","last_fullsized":"2023-07-27T14:28:05.048891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.077158+0000","last_change":"2023-07-27T14:28:05.075169+0000","last_active":"2023-07-27T14:28:05.077158+0000","last_peered":"2023-07-27T14:28:05.077158+0000","last_clean":"2023-07-27T14:28:05.077158+0000","last_became_active":"2023-07-27T14:28:05.074884+0000","last_became_peered":"2023-07-27T14:28:05.074884+0000","last_unstale":"2023-07-27T14:28:05.077158+0000","last_undegraded":"2023-07-27T14:28:05.077158+0000","last_fullsized":"2023-07-27T14:28:05.077158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"35'4","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.082415+0000","last_change":"2023-07-27T14:28:04.600372+0000","last_active":"2023-07-27T14:28:05.082415+0000","last_peered":"2023-07-27T14:28:05.082415+0000","last_clean":"2023-07-27T14:28:05.082415+0000","last_became_active":"2023-07-27T14:28:04.599821+0000","last_became_peered":"2023-07-27T14:28:04.599821+0000","last_unstale":"2023-07-27T14:28:05.082415+0000","last_undegraded":"2023-07-27T14:28:05.082415+0000","last_fullsized":"2023-07-27T14:28:05.082415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074760+0000","last_change":"2023-07-27T14:28:05.068604+0000","last_active":"2023-07-27T14:28:05.074760+0000","last_peered":"2023-07-27T14:28:05.074760+0000","last_clean":"2023-07-27T14:28:05.074760+0000","last_became_active":"2023-07-27T14:28:05.068302+0000","last_became_peered":"2023-07-27T14:28:05.068302+0000","last_unstale":"2023-07-27T14:28:05.074760+0000","last_undegraded":"2023-07-27T14:28:05.074760+0000","last_fullsized":"2023-07-27T14:28:05.074760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.073043+0000","last_change":"2023-07-27T14:28:04.608976+0000","last_active":"2023-07-27T14:28:05.073043+0000","last_peered":"2023-07-27T14:28:05.073043+0000","last_clean":"2023-07-27T14:28:05.073043+0000","last_became_active":"2023-07-27T14:28:04.608761+0000","last_became_peered":"2023-07-27T14:28:04.608761+0000","last_unstale":"2023-07-27T14:28:05.073043+0000","last_undegraded":"2023-07-27T14:28:05.073043+0000","last_fullsized":"2023-07-27T14:28:05.073043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080828+0000","last_change":"2023-07-27T14:28:05.076228+0000","last_active":"2023-07-27T14:28:05.080828+0000","last_peered":"2023-07-27T14:28:05.080828+0000","last_clean":"2023-07-27T14:28:05.080828+0000","last_became_active":"2023-07-27T14:28:05.075803+0000","last_became_peered":"2023-07-27T14:28:05.075803+0000","last_unstale":"2023-07-27T14:28:05.080828+0000","last_undegraded":"2023-07-27T14:28:05.080828+0000","last_fullsized":"2023-07-27T14:28:05.080828+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048835+0000","last_change":"2023-07-27T14:28:04.602795+0000","last_active":"2023-07-27T14:28:05.048835+0000","last_peered":"2023-07-27T14:28:05.048835+0000","last_clean":"2023-07-27T14:28:05.048835+0000","last_became_active":"2023-07-27T14:28:04.602469+0000","last_became_peered":"2023-07-27T14:28:04.602469+0000","last_unstale":"2023-07-27T14:28:05.048835+0000","last_undegraded":"2023-07-27T14:28:05.048835+0000","last_fullsized":"2023-07-27T14:28:05.048835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.081389+0000","last_change":"2023-07-27T14:28:05.080000+0000","last_active":"2023-07-27T14:28:05.081389+0000","last_peered":"2023-07-27T14:28:05.081389+0000","last_clean":"2023-07-27T14:28:05.081389+0000","last_became_active":"2023-07-27T14:28:05.079673+0000","last_became_peered":"2023-07-27T14:28:05.079673+0000","last_unstale":"2023-07-27T14:28:05.081389+0000","last_undegraded":"2023-07-27T14:28:05.081389+0000","last_fullsized":"2023-07-27T14:28:05.081389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.063768+0000","last_change":"2023-07-27T14:28:04.600534+0000","last_active":"2023-07-27T14:28:05.063768+0000","last_peered":"2023-07-27T14:28:05.063768+0000","last_clean":"2023-07-27T14:28:05.063768+0000","last_became_active":"2023-07-27T14:28:04.599810+0000","last_became_peered":"2023-07-27T14:28:04.599810+0000","last_unstale":"2023-07-27T14:28:05.063768+0000","last_undegraded":"2023-07-27T14:28:05.063768+0000","last_fullsized":"2023-07-27T14:28:05.063768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080673+0000","last_change":"2023-07-27T14:28:05.075975+0000","last_active":"2023-07-27T14:28:05.080673+0000","last_peered":"2023-07-27T14:28:05.080673+0000","last_clean":"2023-07-27T14:28:05.080673+0000","last_became_active":"2023-07-27T14:28:05.075591+0000","last_became_peered":"2023-07-27T14:28:05.075591+0000","last_unstale":"2023-07-27T14:28:05.080673+0000","last_undegraded":"2023-07-27T14:28:05.080673+0000","last_fullsized":"2023-07-27T14:28:05.080673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"35'4","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080434+0000","last_change":"2023-07-27T14:28:04.604902+0000","last_active":"2023-07-27T14:28:05.080434+0000","last_peered":"2023-07-27T14:28:05.080434+0000","last_clean":"2023-07-27T14:28:05.080434+0000","last_became_active":"2023-07-27T14:28:04.604631+0000","last_became_peered":"2023-07-27T14:28:04.604631+0000","last_unstale":"2023-07-27T14:28:05.080434+0000","last_undegraded":"2023-07-27T14:28:05.080434+0000","last_fullsized":"2023-07-27T14:28:05.080434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.078584+0000","last_change":"2023-07-27T14:28:05.070941+0000","last_active":"2023-07-27T14:28:05.078584+0000","last_peered":"2023-07-27T14:28:05.078584+0000","last_clean":"2023-07-27T14:28:05.078584+0000","last_became_active":"2023-07-27T14:28:05.070605+0000","last_became_peered":"2023-07-27T14:28:05.070605+0000","last_unstale":"2023-07-27T14:28:05.078584+0000","last_undegraded":"2023-07-27T14:28:05.078584+0000","last_fullsized":"2023-07-27T14:28:05.078584+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048480+0000","last_change":"2023-07-27T14:28:04.604539+0000","last_active":"2023-07-27T14:28:05.048480+0000","last_peered":"2023-07-27T14:28:05.048480+0000","last_clean":"2023-07-27T14:28:05.048480+0000","last_became_active":"2023-07-27T14:28:04.604182+0000","last_became_peered":"2023-07-27T14:28:04.604182+0000","last_unstale":"2023-07-27T14:28:05.048480+0000","last_undegraded":"2023-07-27T14:28:05.048480+0000","last_fullsized":"2023-07-27T14:28:05.048480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.077676+0000","last_change":"2023-07-27T14:28:05.073262+0000","last_active":"2023-07-27T14:28:05.077676+0000","last_peered":"2023-07-27T14:28:05.077676+0000","last_clean":"2023-07-27T14:28:05.077676+0000","last_became_active":"2023-07-27T14:28:05.072975+0000","last_became_peered":"2023-07-27T14:28:05.072975+0000","last_unstale":"2023-07-27T14:28:05.077676+0000","last_undegraded":"2023-07-27T14:28:05.077676+0000","last_fullsized":"2023-07-27T14:28:05.077676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.049619+0000","last_change":"2023-07-27T14:28:04.602816+0000","last_active":"2023-07-27T14:28:05.049619+0000","last_peered":"2023-07-27T14:28:05.049619+0000","last_clean":"2023-07-27T14:28:05.049619+0000","last_became_active":"2023-07-27T14:28:04.602353+0000","last_became_peered":"2023-07-27T14:28:04.602353+0000","last_unstale":"2023-07-27T14:28:05.049619+0000","last_undegraded":"2023-07-27T14:28:05.049619+0000","last_fullsized":"2023-07-27T14:28:05.049619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.078358+0000","last_change":"2023-07-27T14:28:05.070919+0000","last_active":"2023-07-27T14:28:05.078358+0000","last_peered":"2023-07-27T14:28:05.078358+0000","last_clean":"2023-07-27T14:28:05.078358+0000","last_became_active":"2023-07-27T14:28:05.070554+0000","last_became_peered":"2023-07-27T14:28:05.070554+0000","last_unstale":"2023-07-27T14:28:05.078358+0000","last_undegraded":"2023-07-27T14:28:05.078358+0000","last_fullsized":"2023-07-27T14:28:05.078358+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.075824+0000","last_change":"2023-07-27T14:28:04.597867+0000","last_active":"2023-07-27T14:28:05.075824+0000","last_peered":"2023-07-27T14:28:05.075824+0000","last_clean":"2023-07-27T14:28:05.075824+0000","last_became_active":"2023-07-27T14:28:04.597585+0000","last_became_peered":"2023-07-27T14:28:04.597585+0000","last_unstale":"2023-07-27T14:28:05.075824+0000","last_undegraded":"2023-07-27T14:28:05.075824+0000","last_fullsized":"2023-07-27T14:28:05.075824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.079131+0000","last_change":"2023-07-27T14:28:05.077037+0000","last_active":"2023-07-27T14:28:05.079131+0000","last_peered":"2023-07-27T14:28:05.079131+0000","last_clean":"2023-07-27T14:28:05.079131+0000","last_became_active":"2023-07-27T14:28:05.076757+0000","last_became_peered":"2023-07-27T14:28:05.076757+0000","last_unstale":"2023-07-27T14:28:05.079131+0000","last_undegraded":"2023-07-27T14:28:05.079131+0000","last_fullsized":"2023-07-27T14:28:05.079131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.057802+0000","last_change":"2023-07-27T14:28:04.607404+0000","last_active":"2023-07-27T14:28:05.057802+0000","last_peered":"2023-07-27T14:28:05.057802+0000","last_clean":"2023-07-27T14:28:05.057802+0000","last_became_active":"2023-07-27T14:28:04.607128+0000","last_became_peered":"2023-07-27T14:28:04.607128+0000","last_unstale":"2023-07-27T14:28:05.057802+0000","last_undegraded":"2023-07-27T14:28:05.057802+0000","last_fullsized":"2023-07-27T14:28:05.057802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.066882+0000","last_change":"2023-07-27T14:28:05.064740+0000","last_active":"2023-07-27T14:28:05.066882+0000","last_peered":"2023-07-27T14:28:05.066882+0000","last_clean":"2023-07-27T14:28:05.066882+0000","last_became_active":"2023-07-27T14:28:05.064471+0000","last_became_peered":"2023-07-27T14:28:05.064471+0000","last_unstale":"2023-07-27T14:28:05.066882+0000","last_undegraded":"2023-07-27T14:28:05.066882+0000","last_fullsized":"2023-07-27T14:28:05.066882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.073034+0000","last_change":"2023-07-27T14:28:04.606071+0000","last_active":"2023-07-27T14:28:05.073034+0000","last_peered":"2023-07-27T14:28:05.073034+0000","last_clean":"2023-07-27T14:28:05.073034+0000","last_became_active":"2023-07-27T14:28:04.605805+0000","last_became_peered":"2023-07-27T14:28:04.605805+0000","last_unstale":"2023-07-27T14:28:05.073034+0000","last_undegraded":"2023-07-27T14:28:05.073034+0000","last_fullsized":"2023-07-27T14:28:05.073034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074701+0000","last_change":"2023-07-27T14:28:05.069221+0000","last_active":"2023-07-27T14:28:05.074701+0000","last_peered":"2023-07-27T14:28:05.074701+0000","last_clean":"2023-07-27T14:28:05.074701+0000","last_became_active":"2023-07-27T14:28:05.068944+0000","last_became_peered":"2023-07-27T14:28:05.068944+0000","last_unstale":"2023-07-27T14:28:05.074701+0000","last_undegraded":"2023-07-27T14:28:05.074701+0000","last_fullsized":"2023-07-27T14:28:05.074701+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.056099+0000","last_change":"2023-07-27T14:28:04.605057+0000","last_active":"2023-07-27T14:28:05.056099+0000","last_peered":"2023-07-27T14:28:05.056099+0000","last_clean":"2023-07-27T14:28:05.056099+0000","last_became_active":"2023-07-27T14:28:04.604713+0000","last_became_peered":"2023-07-27T14:28:04.604713+0000","last_unstale":"2023-07-27T14:28:05.056099+0000","last_undegraded":"2023-07-27T14:28:05.056099+0000","last_fullsized":"2023-07-27T14:28:05.056099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.073026+0000","last_change":"2023-07-27T14:28:05.067885+0000","last_active":"2023-07-27T14:28:05.073026+0000","last_peered":"2023-07-27T14:28:05.073026+0000","last_clean":"2023-07-27T14:28:05.073026+0000","last_became_active":"2023-07-27T14:28:05.067552+0000","last_became_peered":"2023-07-27T14:28:05.067552+0000","last_unstale":"2023-07-27T14:28:05.073026+0000","last_undegraded":"2023-07-27T14:28:05.073026+0000","last_fullsized":"2023-07-27T14:28:05.073026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.055403+0000","last_change":"2023-07-27T14:28:04.598119+0000","last_active":"2023-07-27T14:28:05.055403+0000","last_peered":"2023-07-27T14:28:05.055403+0000","last_clean":"2023-07-27T14:28:05.055403+0000","last_became_active":"2023-07-27T14:28:04.597540+0000","last_became_peered":"2023-07-27T14:28:04.597540+0000","last_unstale":"2023-07-27T14:28:05.055403+0000","last_undegraded":"2023-07-27T14:28:05.055403+0000","last_fullsized":"2023-07-27T14:28:05.055403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080476+0000","last_change":"2023-07-27T14:28:05.074886+0000","last_active":"2023-07-27T14:28:05.080476+0000","last_peered":"2023-07-27T14:28:05.080476+0000","last_clean":"2023-07-27T14:28:05.080476+0000","last_became_active":"2023-07-27T14:28:05.074559+0000","last_became_peered":"2023-07-27T14:28:05.074559+0000","last_unstale":"2023-07-27T14:28:05.080476+0000","last_undegraded":"2023-07-27T14:28:05.080476+0000","last_fullsized":"2023-07-27T14:28:05.080476+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.064009+0000","last_change":"2023-07-27T14:28:04.602265+0000","last_active":"2023-07-27T14:28:05.064009+0000","last_peered":"2023-07-27T14:28:05.064009+0000","last_clean":"2023-07-27T14:28:05.064009+0000","last_became_active":"2023-07-27T14:28:04.601970+0000","last_became_peered":"2023-07-27T14:28:04.601970+0000","last_unstale":"2023-07-27T14:28:05.064009+0000","last_undegraded":"2023-07-27T14:28:05.064009+0000","last_fullsized":"2023-07-27T14:28:05.064009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080091+0000","last_change":"2023-07-27T14:28:05.074697+0000","last_active":"2023-07-27T14:28:05.080091+0000","last_peered":"2023-07-27T14:28:05.080091+0000","last_clean":"2023-07-27T14:28:05.080091+0000","last_became_active":"2023-07-27T14:28:05.074388+0000","last_became_peered":"2023-07-27T14:28:05.074388+0000","last_unstale":"2023-07-27T14:28:05.080091+0000","last_undegraded":"2023-07-27T14:28:05.080091+0000","last_fullsized":"2023-07-27T14:28:05.080091+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.061085+0000","last_change":"2023-07-27T14:28:04.599585+0000","last_active":"2023-07-27T14:28:05.061085+0000","last_peered":"2023-07-27T14:28:05.061085+0000","last_clean":"2023-07-27T14:28:05.061085+0000","last_became_active":"2023-07-27T14:28:04.599287+0000","last_became_peered":"2023-07-27T14:28:04.599287+0000","last_unstale":"2023-07-27T14:28:05.061085+0000","last_undegraded":"2023-07-27T14:28:05.061085+0000","last_fullsized":"2023-07-27T14:28:05.061085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.073272+0000","last_change":"2023-07-27T14:28:05.069580+0000","last_active":"2023-07-27T14:28:05.073272+0000","last_peered":"2023-07-27T14:28:05.073272+0000","last_clean":"2023-07-27T14:28:05.073272+0000","last_became_active":"2023-07-27T14:28:05.069177+0000","last_became_peered":"2023-07-27T14:28:05.069177+0000","last_unstale":"2023-07-27T14:28:05.073272+0000","last_undegraded":"2023-07-27T14:28:05.073272+0000","last_fullsized":"2023-07-27T14:28:05.073272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"36'1","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-27T14:28:06.051560+0000","last_change":"2023-07-27T14:28:04.599648+0000","last_active":"2023-07-27T14:28:06.051560+0000","last_peered":"2023-07-27T14:28:06.051560+0000","last_clean":"2023-07-27T14:28:06.051560+0000","last_became_active":"2023-07-27T14:28:04.599361+0000","last_became_peered":"2023-07-27T14:28:04.599361+0000","last_unstale":"2023-07-27T14:28:06.051560+0000","last_undegraded":"2023-07-27T14:28:06.051560+0000","last_fullsized":"2023-07-27T14:28:06.051560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.069000+0000","last_change":"2023-07-27T14:28:05.067656+0000","last_active":"2023-07-27T14:28:05.069000+0000","last_peered":"2023-07-27T14:28:05.069000+0000","last_clean":"2023-07-27T14:28:05.069000+0000","last_became_active":"2023-07-27T14:28:05.067359+0000","last_became_peered":"2023-07-27T14:28:05.067359+0000","last_unstale":"2023-07-27T14:28:05.069000+0000","last_undegraded":"2023-07-27T14:28:05.069000+0000","last_fullsized":"2023-07-27T14:28:05.069000+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.060280+0000","last_change":"2023-07-27T14:28:04.610297+0000","last_active":"2023-07-27T14:28:05.060280+0000","last_peered":"2023-07-27T14:28:05.060280+0000","last_clean":"2023-07-27T14:28:05.060280+0000","last_became_active":"2023-07-27T14:28:04.610081+0000","last_became_peered":"2023-07-27T14:28:04.610081+0000","last_unstale":"2023-07-27T14:28:05.060280+0000","last_undegraded":"2023-07-27T14:28:05.060280+0000","last_fullsized":"2023-07-27T14:28:05.060280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.073433+0000","last_change":"2023-07-27T14:28:05.069248+0000","last_active":"2023-07-27T14:28:05.073433+0000","last_peered":"2023-07-27T14:28:05.073433+0000","last_clean":"2023-07-27T14:28:05.073433+0000","last_became_active":"2023-07-27T14:28:05.068854+0000","last_became_peered":"2023-07-27T14:28:05.068854+0000","last_unstale":"2023-07-27T14:28:05.073433+0000","last_undegraded":"2023-07-27T14:28:05.073433+0000","last_fullsized":"2023-07-27T14:28:05.073433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.064638+0000","last_change":"2023-07-27T14:28:04.600194+0000","last_active":"2023-07-27T14:28:05.064638+0000","last_peered":"2023-07-27T14:28:05.064638+0000","last_clean":"2023-07-27T14:28:05.064638+0000","last_became_active":"2023-07-27T14:28:04.599465+0000","last_became_peered":"2023-07-27T14:28:04.599465+0000","last_unstale":"2023-07-27T14:28:05.064638+0000","last_undegraded":"2023-07-27T14:28:05.064638+0000","last_fullsized":"2023-07-27T14:28:05.064638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.071508+0000","last_change":"2023-07-27T14:28:05.069919+0000","last_active":"2023-07-27T14:28:05.071508+0000","last_peered":"2023-07-27T14:28:05.071508+0000","last_clean":"2023-07-27T14:28:05.071508+0000","last_became_active":"2023-07-27T14:28:05.069638+0000","last_became_peered":"2023-07-27T14:28:05.069638+0000","last_unstale":"2023-07-27T14:28:05.071508+0000","last_undegraded":"2023-07-27T14:28:05.071508+0000","last_fullsized":"2023-07-27T14:28:05.071508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.053623+0000","last_change":"2023-07-27T14:28:04.610302+0000","last_active":"2023-07-27T14:28:05.053623+0000","last_peered":"2023-07-27T14:28:05.053623+0000","last_clean":"2023-07-27T14:28:05.053623+0000","last_became_active":"2023-07-27T14:28:04.609925+0000","last_became_peered":"2023-07-27T14:28:04.609925+0000","last_unstale":"2023-07-27T14:28:05.053623+0000","last_undegraded":"2023-07-27T14:28:05.053623+0000","last_fullsized":"2023-07-27T14:28:05.053623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074683+0000","last_change":"2023-07-27T14:28:05.068720+0000","last_active":"2023-07-27T14:28:05.074683+0000","last_peered":"2023-07-27T14:28:05.074683+0000","last_clean":"2023-07-27T14:28:05.074683+0000","last_became_active":"2023-07-27T14:28:05.066874+0000","last_became_peered":"2023-07-27T14:28:05.066874+0000","last_unstale":"2023-07-27T14:28:05.074683+0000","last_undegraded":"2023-07-27T14:28:05.074683+0000","last_fullsized":"2023-07-27T14:28:05.074683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.050104+0000","last_change":"2023-07-27T14:28:04.603725+0000","last_active":"2023-07-27T14:28:05.050104+0000","last_peered":"2023-07-27T14:28:05.050104+0000","last_clean":"2023-07-27T14:28:05.050104+0000","last_became_active":"2023-07-27T14:28:04.603381+0000","last_became_peered":"2023-07-27T14:28:04.603381+0000","last_unstale":"2023-07-27T14:28:05.050104+0000","last_undegraded":"2023-07-27T14:28:05.050104+0000","last_fullsized":"2023-07-27T14:28:05.050104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.071214+0000","last_change":"2023-07-27T14:28:05.061239+0000","last_active":"2023-07-27T14:28:05.071214+0000","last_peered":"2023-07-27T14:28:05.071214+0000","last_clean":"2023-07-27T14:28:05.071214+0000","last_became_active":"2023-07-27T14:28:05.060912+0000","last_became_peered":"2023-07-27T14:28:05.060912+0000","last_unstale":"2023-07-27T14:28:05.071214+0000","last_undegraded":"2023-07-27T14:28:05.071214+0000","last_fullsized":"2023-07-27T14:28:05.071214+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.052271+0000","last_change":"2023-07-27T14:28:04.608833+0000","last_active":"2023-07-27T14:28:05.052271+0000","last_peered":"2023-07-27T14:28:05.052271+0000","last_clean":"2023-07-27T14:28:05.052271+0000","last_became_active":"2023-07-27T14:28:04.604598+0000","last_became_peered":"2023-07-27T14:28:04.604598+0000","last_unstale":"2023-07-27T14:28:05.052271+0000","last_undegraded":"2023-07-27T14:28:05.052271+0000","last_fullsized":"2023-07-27T14:28:05.052271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.078800+0000","last_change":"2023-07-27T14:28:05.072201+0000","last_active":"2023-07-27T14:28:05.078800+0000","last_peered":"2023-07-27T14:28:05.078800+0000","last_clean":"2023-07-27T14:28:05.078800+0000","last_became_active":"2023-07-27T14:28:05.071926+0000","last_became_peered":"2023-07-27T14:28:05.071926+0000","last_unstale":"2023-07-27T14:28:05.078800+0000","last_undegraded":"2023-07-27T14:28:05.078800+0000","last_fullsized":"2023-07-27T14:28:05.078800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048580+0000","last_change":"2023-07-27T14:28:04.607948+0000","last_active":"2023-07-27T14:28:05.048580+0000","last_peered":"2023-07-27T14:28:05.048580+0000","last_clean":"2023-07-27T14:28:05.048580+0000","last_became_active":"2023-07-27T14:28:04.607525+0000","last_became_peered":"2023-07-27T14:28:04.607525+0000","last_unstale":"2023-07-27T14:28:05.048580+0000","last_undegraded":"2023-07-27T14:28:05.048580+0000","last_fullsized":"2023-07-27T14:28:05.048580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074433+0000","last_change":"2023-07-27T14:28:05.068720+0000","last_active":"2023-07-27T14:28:05.074433+0000","last_peered":"2023-07-27T14:28:05.074433+0000","last_clean":"2023-07-27T14:28:05.074433+0000","last_became_active":"2023-07-27T14:28:05.068387+0000","last_became_peered":"2023-07-27T14:28:05.068387+0000","last_unstale":"2023-07-27T14:28:05.074433+0000","last_undegraded":"2023-07-27T14:28:05.074433+0000","last_fullsized":"2023-07-27T14:28:05.074433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.070949+0000","last_change":"2023-07-27T14:28:04.608630+0000","last_active":"2023-07-27T14:28:05.070949+0000","last_peered":"2023-07-27T14:28:05.070949+0000","last_clean":"2023-07-27T14:28:05.070949+0000","last_became_active":"2023-07-27T14:28:04.608323+0000","last_became_peered":"2023-07-27T14:28:04.608323+0000","last_unstale":"2023-07-27T14:28:05.070949+0000","last_undegraded":"2023-07-27T14:28:05.070949+0000","last_fullsized":"2023-07-27T14:28:05.070949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.082211+0000","last_change":"2023-07-27T14:28:05.081264+0000","last_active":"2023-07-27T14:28:05.082211+0000","last_peered":"2023-07-27T14:28:05.082211+0000","last_clean":"2023-07-27T14:28:05.082211+0000","last_became_active":"2023-07-27T14:28:05.080984+0000","last_became_peered":"2023-07-27T14:28:05.080984+0000","last_unstale":"2023-07-27T14:28:05.082211+0000","last_undegraded":"2023-07-27T14:28:05.082211+0000","last_fullsized":"2023-07-27T14:28:05.082211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.075980+0000","last_change":"2023-07-27T14:28:04.597789+0000","last_active":"2023-07-27T14:28:05.075980+0000","last_peered":"2023-07-27T14:28:05.075980+0000","last_clean":"2023-07-27T14:28:05.075980+0000","last_became_active":"2023-07-27T14:28:04.597230+0000","last_became_peered":"2023-07-27T14:28:04.597230+0000","last_unstale":"2023-07-27T14:28:05.075980+0000","last_undegraded":"2023-07-27T14:28:05.075980+0000","last_fullsized":"2023-07-27T14:28:05.075980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.077587+0000","last_change":"2023-07-27T14:28:05.072233+0000","last_active":"2023-07-27T14:28:05.077587+0000","last_peered":"2023-07-27T14:28:05.077587+0000","last_clean":"2023-07-27T14:28:05.077587+0000","last_became_active":"2023-07-27T14:28:05.071957+0000","last_became_peered":"2023-07-27T14:28:05.071957+0000","last_unstale":"2023-07-27T14:28:05.077587+0000","last_undegraded":"2023-07-27T14:28:05.077587+0000","last_fullsized":"2023-07-27T14:28:05.077587+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.069491+0000","last_change":"2023-07-27T14:28:04.611093+0000","last_active":"2023-07-27T14:28:05.069491+0000","last_peered":"2023-07-27T14:28:05.069491+0000","last_clean":"2023-07-27T14:28:05.069491+0000","last_became_active":"2023-07-27T14:28:04.610918+0000","last_became_peered":"2023-07-27T14:28:04.610918+0000","last_unstale":"2023-07-27T14:28:05.069491+0000","last_undegraded":"2023-07-27T14:28:05.069491+0000","last_fullsized":"2023-07-27T14:28:05.069491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.077958+0000","last_change":"2023-07-27T14:28:05.072449+0000","last_active":"2023-07-27T14:28:05.077958+0000","last_peered":"2023-07-27T14:28:05.077958+0000","last_clean":"2023-07-27T14:28:05.077958+0000","last_became_active":"2023-07-27T14:28:05.072239+0000","last_became_peered":"2023-07-27T14:28:05.072239+0000","last_unstale":"2023-07-27T14:28:05.077958+0000","last_undegraded":"2023-07-27T14:28:05.077958+0000","last_fullsized":"2023-07-27T14:28:05.077958+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.053688+0000","last_change":"2023-07-27T14:28:04.608478+0000","last_active":"2023-07-27T14:28:05.053688+0000","last_peered":"2023-07-27T14:28:05.053688+0000","last_clean":"2023-07-27T14:28:05.053688+0000","last_became_active":"2023-07-27T14:28:04.608213+0000","last_became_peered":"2023-07-27T14:28:04.608213+0000","last_unstale":"2023-07-27T14:28:05.053688+0000","last_undegraded":"2023-07-27T14:28:05.053688+0000","last_fullsized":"2023-07-27T14:28:05.053688+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074482+0000","last_change":"2023-07-27T14:28:05.071430+0000","last_active":"2023-07-27T14:28:05.074482+0000","last_peered":"2023-07-27T14:28:05.074482+0000","last_clean":"2023-07-27T14:28:05.074482+0000","last_became_active":"2023-07-27T14:28:05.071113+0000","last_became_peered":"2023-07-27T14:28:05.071113+0000","last_unstale":"2023-07-27T14:28:05.074482+0000","last_undegraded":"2023-07-27T14:28:05.074482+0000","last_fullsized":"2023-07-27T14:28:05.074482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.064148+0000","last_change":"2023-07-27T14:28:04.598944+0000","last_active":"2023-07-27T14:28:05.064148+0000","last_peered":"2023-07-27T14:28:05.064148+0000","last_clean":"2023-07-27T14:28:05.064148+0000","last_became_active":"2023-07-27T14:28:04.598578+0000","last_became_peered":"2023-07-27T14:28:04.598578+0000","last_unstale":"2023-07-27T14:28:05.064148+0000","last_undegraded":"2023-07-27T14:28:05.064148+0000","last_fullsized":"2023-07-27T14:28:05.064148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080848+0000","last_change":"2023-07-27T14:28:05.076345+0000","last_active":"2023-07-27T14:28:05.080848+0000","last_peered":"2023-07-27T14:28:05.080848+0000","last_clean":"2023-07-27T14:28:05.080848+0000","last_became_active":"2023-07-27T14:28:05.075953+0000","last_became_peered":"2023-07-27T14:28:05.075953+0000","last_unstale":"2023-07-27T14:28:05.080848+0000","last_undegraded":"2023-07-27T14:28:05.080848+0000","last_fullsized":"2023-07-27T14:28:05.080848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.050000+0000","last_change":"2023-07-27T14:28:04.612024+0000","last_active":"2023-07-27T14:28:05.050000+0000","last_peered":"2023-07-27T14:28:05.050000+0000","last_clean":"2023-07-27T14:28:05.050000+0000","last_became_active":"2023-07-27T14:28:04.611716+0000","last_became_peered":"2023-07-27T14:28:04.611716+0000","last_unstale":"2023-07-27T14:28:05.050000+0000","last_undegraded":"2023-07-27T14:28:05.050000+0000","last_fullsized":"2023-07-27T14:28:05.050000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.069997+0000","last_change":"2023-07-27T14:28:05.064924+0000","last_active":"2023-07-27T14:28:05.069997+0000","last_peered":"2023-07-27T14:28:05.069997+0000","last_clean":"2023-07-27T14:28:05.069997+0000","last_became_active":"2023-07-27T14:28:05.064482+0000","last_became_peered":"2023-07-27T14:28:05.064482+0000","last_unstale":"2023-07-27T14:28:05.069997+0000","last_undegraded":"2023-07-27T14:28:05.069997+0000","last_fullsized":"2023-07-27T14:28:05.069997+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.059488+0000","last_change":"2023-07-27T14:28:04.601416+0000","last_active":"2023-07-27T14:28:05.059488+0000","last_peered":"2023-07-27T14:28:05.059488+0000","last_clean":"2023-07-27T14:28:05.059488+0000","last_became_active":"2023-07-27T14:28:04.601136+0000","last_became_peered":"2023-07-27T14:28:04.601136+0000","last_unstale":"2023-07-27T14:28:05.059488+0000","last_undegraded":"2023-07-27T14:28:05.059488+0000","last_fullsized":"2023-07-27T14:28:05.059488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.072028+0000","last_change":"2023-07-27T14:28:05.062928+0000","last_active":"2023-07-27T14:28:05.072028+0000","last_peered":"2023-07-27T14:28:05.072028+0000","last_clean":"2023-07-27T14:28:05.072028+0000","last_became_active":"2023-07-27T14:28:05.062641+0000","last_became_peered":"2023-07-27T14:28:05.062641+0000","last_unstale":"2023-07-27T14:28:05.072028+0000","last_undegraded":"2023-07-27T14:28:05.072028+0000","last_fullsized":"2023-07-27T14:28:05.072028+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.054109+0000","last_change":"2023-07-27T14:28:04.614405+0000","last_active":"2023-07-27T14:28:05.054109+0000","last_peered":"2023-07-27T14:28:05.054109+0000","last_clean":"2023-07-27T14:28:05.054109+0000","last_became_active":"2023-07-27T14:28:04.614080+0000","last_became_peered":"2023-07-27T14:28:04.614080+0000","last_unstale":"2023-07-27T14:28:05.054109+0000","last_undegraded":"2023-07-27T14:28:05.054109+0000","last_fullsized":"2023-07-27T14:28:05.054109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.066940+0000","last_change":"2023-07-27T14:28:05.063561+0000","last_active":"2023-07-27T14:28:05.066940+0000","last_peered":"2023-07-27T14:28:05.066940+0000","last_clean":"2023-07-27T14:28:05.066940+0000","last_became_active":"2023-07-27T14:28:05.063293+0000","last_became_peered":"2023-07-27T14:28:05.063293+0000","last_unstale":"2023-07-27T14:28:05.066940+0000","last_undegraded":"2023-07-27T14:28:05.066940+0000","last_fullsized":"2023-07-27T14:28:05.066940+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.049169+0000","last_change":"2023-07-27T14:28:04.602844+0000","last_active":"2023-07-27T14:28:05.049169+0000","last_peered":"2023-07-27T14:28:05.049169+0000","last_clean":"2023-07-27T14:28:05.049169+0000","last_became_active":"2023-07-27T14:28:04.602577+0000","last_became_peered":"2023-07-27T14:28:04.602577+0000","last_unstale":"2023-07-27T14:28:05.049169+0000","last_undegraded":"2023-07-27T14:28:05.049169+0000","last_fullsized":"2023-07-27T14:28:05.049169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.075213+0000","last_change":"2023-07-27T14:28:05.073092+0000","last_active":"2023-07-27T14:28:05.075213+0000","last_peered":"2023-07-27T14:28:05.075213+0000","last_clean":"2023-07-27T14:28:05.075213+0000","last_became_active":"2023-07-27T14:28:05.072639+0000","last_became_peered":"2023-07-27T14:28:05.072639+0000","last_unstale":"2023-07-27T14:28:05.075213+0000","last_undegraded":"2023-07-27T14:28:05.075213+0000","last_fullsized":"2023-07-27T14:28:05.075213+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.064610+0000","last_change":"2023-07-27T14:28:04.599598+0000","last_active":"2023-07-27T14:28:05.064610+0000","last_peered":"2023-07-27T14:28:05.064610+0000","last_clean":"2023-07-27T14:28:05.064610+0000","last_became_active":"2023-07-27T14:28:04.598766+0000","last_became_peered":"2023-07-27T14:28:04.598766+0000","last_unstale":"2023-07-27T14:28:05.064610+0000","last_undegraded":"2023-07-27T14:28:05.064610+0000","last_fullsized":"2023-07-27T14:28:05.064610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.065020+0000","last_change":"2023-07-27T14:28:05.061439+0000","last_active":"2023-07-27T14:28:05.065020+0000","last_peered":"2023-07-27T14:28:05.065020+0000","last_clean":"2023-07-27T14:28:05.065020+0000","last_became_active":"2023-07-27T14:28:05.061106+0000","last_became_peered":"2023-07-27T14:28:05.061106+0000","last_unstale":"2023-07-27T14:28:05.065020+0000","last_undegraded":"2023-07-27T14:28:05.065020+0000","last_fullsized":"2023-07-27T14:28:05.065020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080524+0000","last_change":"2023-07-27T14:28:04.603291+0000","last_active":"2023-07-27T14:28:05.080524+0000","last_peered":"2023-07-27T14:28:05.080524+0000","last_clean":"2023-07-27T14:28:05.080524+0000","last_became_active":"2023-07-27T14:28:04.602319+0000","last_became_peered":"2023-07-27T14:28:04.602319+0000","last_unstale":"2023-07-27T14:28:05.080524+0000","last_undegraded":"2023-07-27T14:28:05.080524+0000","last_fullsized":"2023-07-27T14:28:05.080524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.073813+0000","last_change":"2023-07-27T14:28:05.067441+0000","last_active":"2023-07-27T14:28:05.073813+0000","last_peered":"2023-07-27T14:28:05.073813+0000","last_clean":"2023-07-27T14:28:05.073813+0000","last_became_active":"2023-07-27T14:28:05.067150+0000","last_became_peered":"2023-07-27T14:28:05.067150+0000","last_unstale":"2023-07-27T14:28:05.073813+0000","last_undegraded":"2023-07-27T14:28:05.073813+0000","last_fullsized":"2023-07-27T14:28:05.073813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.081205+0000","last_change":"2023-07-27T14:28:04.599537+0000","last_active":"2023-07-27T14:28:05.081205+0000","last_peered":"2023-07-27T14:28:05.081205+0000","last_clean":"2023-07-27T14:28:05.081205+0000","last_became_active":"2023-07-27T14:28:04.599276+0000","last_became_peered":"2023-07-27T14:28:04.599276+0000","last_unstale":"2023-07-27T14:28:05.081205+0000","last_undegraded":"2023-07-27T14:28:05.081205+0000","last_fullsized":"2023-07-27T14:28:05.081205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.064859+0000","last_change":"2023-07-27T14:28:05.061245+0000","last_active":"2023-07-27T14:28:05.064859+0000","last_peered":"2023-07-27T14:28:05.064859+0000","last_clean":"2023-07-27T14:28:05.064859+0000","last_became_active":"2023-07-27T14:28:05.060946+0000","last_became_peered":"2023-07-27T14:28:05.060946+0000","last_unstale":"2023-07-27T14:28:05.064859+0000","last_undegraded":"2023-07-27T14:28:05.064859+0000","last_fullsized":"2023-07-27T14:28:05.064859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.072252+0000","last_change":"2023-07-27T14:28:04.604497+0000","last_active":"2023-07-27T14:28:05.072252+0000","last_peered":"2023-07-27T14:28:05.072252+0000","last_clean":"2023-07-27T14:28:05.072252+0000","last_became_active":"2023-07-27T14:28:04.604221+0000","last_became_peered":"2023-07-27T14:28:04.604221+0000","last_unstale":"2023-07-27T14:28:05.072252+0000","last_undegraded":"2023-07-27T14:28:05.072252+0000","last_fullsized":"2023-07-27T14:28:05.072252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.072162+0000","last_change":"2023-07-27T14:28:05.063441+0000","last_active":"2023-07-27T14:28:05.072162+0000","last_peered":"2023-07-27T14:28:05.072162+0000","last_clean":"2023-07-27T14:28:05.072162+0000","last_became_active":"2023-07-27T14:28:05.062330+0000","last_became_peered":"2023-07-27T14:28:05.062330+0000","last_unstale":"2023-07-27T14:28:05.072162+0000","last_undegraded":"2023-07-27T14:28:05.072162+0000","last_fullsized":"2023-07-27T14:28:05.072162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.059572+0000","last_change":"2023-07-27T14:28:04.601143+0000","last_active":"2023-07-27T14:28:05.059572+0000","last_peered":"2023-07-27T14:28:05.059572+0000","last_clean":"2023-07-27T14:28:05.059572+0000","last_became_active":"2023-07-27T14:28:04.600823+0000","last_became_peered":"2023-07-27T14:28:04.600823+0000","last_unstale":"2023-07-27T14:28:05.059572+0000","last_undegraded":"2023-07-27T14:28:05.059572+0000","last_fullsized":"2023-07-27T14:28:05.059572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074522+0000","last_change":"2023-07-27T14:28:05.068754+0000","last_active":"2023-07-27T14:28:05.074522+0000","last_peered":"2023-07-27T14:28:05.074522+0000","last_clean":"2023-07-27T14:28:05.074522+0000","last_became_active":"2023-07-27T14:28:05.066971+0000","last_became_peered":"2023-07-27T14:28:05.066971+0000","last_unstale":"2023-07-27T14:28:05.074522+0000","last_undegraded":"2023-07-27T14:28:05.074522+0000","last_fullsized":"2023-07-27T14:28:05.074522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.052138+0000","last_change":"2023-07-27T14:28:04.609913+0000","last_active":"2023-07-27T14:28:05.052138+0000","last_peered":"2023-07-27T14:28:05.052138+0000","last_clean":"2023-07-27T14:28:05.052138+0000","last_became_active":"2023-07-27T14:28:04.609614+0000","last_became_peered":"2023-07-27T14:28:04.609614+0000","last_unstale":"2023-07-27T14:28:05.052138+0000","last_undegraded":"2023-07-27T14:28:05.052138+0000","last_fullsized":"2023-07-27T14:28:05.052138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.069242+0000","last_change":"2023-07-27T14:28:05.062023+0000","last_active":"2023-07-27T14:28:05.069242+0000","last_peered":"2023-07-27T14:28:05.069242+0000","last_clean":"2023-07-27T14:28:05.069242+0000","last_became_active":"2023-07-27T14:28:05.061689+0000","last_became_peered":"2023-07-27T14:28:05.061689+0000","last_unstale":"2023-07-27T14:28:05.069242+0000","last_undegraded":"2023-07-27T14:28:05.069242+0000","last_fullsized":"2023-07-27T14:28:05.069242+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'4","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.075698+0000","last_change":"2023-07-27T14:28:04.608242+0000","last_active":"2023-07-27T14:28:05.075698+0000","last_peered":"2023-07-27T14:28:05.075698+0000","last_clean":"2023-07-27T14:28:05.075698+0000","last_became_active":"2023-07-27T14:28:04.607968+0000","last_became_peered":"2023-07-27T14:28:04.607968+0000","last_unstale":"2023-07-27T14:28:05.075698+0000","last_undegraded":"2023-07-27T14:28:05.075698+0000","last_fullsized":"2023-07-27T14:28:05.075698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.078231+0000","last_change":"2023-07-27T14:28:05.073453+0000","last_active":"2023-07-27T14:28:05.078231+0000","last_peered":"2023-07-27T14:28:05.078231+0000","last_clean":"2023-07-27T14:28:05.078231+0000","last_became_active":"2023-07-27T14:28:05.073174+0000","last_became_peered":"2023-07-27T14:28:05.073174+0000","last_unstale":"2023-07-27T14:28:05.078231+0000","last_undegraded":"2023-07-27T14:28:05.078231+0000","last_fullsized":"2023-07-27T14:28:05.078231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.081113+0000","last_change":"2023-07-27T14:28:04.608064+0000","last_active":"2023-07-27T14:28:05.081113+0000","last_peered":"2023-07-27T14:28:05.081113+0000","last_clean":"2023-07-27T14:28:05.081113+0000","last_became_active":"2023-07-27T14:28:04.607583+0000","last_became_peered":"2023-07-27T14:28:04.607583+0000","last_unstale":"2023-07-27T14:28:05.081113+0000","last_undegraded":"2023-07-27T14:28:05.081113+0000","last_fullsized":"2023-07-27T14:28:05.081113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.082357+0000","last_change":"2023-07-27T14:28:05.080775+0000","last_active":"2023-07-27T14:28:05.082357+0000","last_peered":"2023-07-27T14:28:05.082357+0000","last_clean":"2023-07-27T14:28:05.082357+0000","last_became_active":"2023-07-27T14:28:05.080394+0000","last_became_peered":"2023-07-27T14:28:05.080394+0000","last_unstale":"2023-07-27T14:28:05.082357+0000","last_undegraded":"2023-07-27T14:28:05.082357+0000","last_fullsized":"2023-07-27T14:28:05.082357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080823+0000","last_change":"2023-07-27T14:28:04.609135+0000","last_active":"2023-07-27T14:28:05.080823+0000","last_peered":"2023-07-27T14:28:05.080823+0000","last_clean":"2023-07-27T14:28:05.080823+0000","last_became_active":"2023-07-27T14:28:04.608819+0000","last_became_peered":"2023-07-27T14:28:04.608819+0000","last_unstale":"2023-07-27T14:28:05.080823+0000","last_undegraded":"2023-07-27T14:28:05.080823+0000","last_fullsized":"2023-07-27T14:28:05.080823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.073066+0000","last_change":"2023-07-27T14:28:05.069818+0000","last_active":"2023-07-27T14:28:05.073066+0000","last_peered":"2023-07-27T14:28:05.073066+0000","last_clean":"2023-07-27T14:28:05.073066+0000","last_became_active":"2023-07-27T14:28:05.069483+0000","last_became_peered":"2023-07-27T14:28:05.069483+0000","last_unstale":"2023-07-27T14:28:05.073066+0000","last_undegraded":"2023-07-27T14:28:05.073066+0000","last_fullsized":"2023-07-27T14:28:05.073066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.057957+0000","last_change":"2023-07-27T14:28:04.602209+0000","last_active":"2023-07-27T14:28:05.057957+0000","last_peered":"2023-07-27T14:28:05.057957+0000","last_clean":"2023-07-27T14:28:05.057957+0000","last_became_active":"2023-07-27T14:28:04.601917+0000","last_became_peered":"2023-07-27T14:28:04.601917+0000","last_unstale":"2023-07-27T14:28:05.057957+0000","last_undegraded":"2023-07-27T14:28:05.057957+0000","last_fullsized":"2023-07-27T14:28:05.057957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074134+0000","last_change":"2023-07-27T14:28:05.066285+0000","last_active":"2023-07-27T14:28:05.074134+0000","last_peered":"2023-07-27T14:28:05.074134+0000","last_clean":"2023-07-27T14:28:05.074134+0000","last_became_active":"2023-07-27T14:28:05.065795+0000","last_became_peered":"2023-07-27T14:28:05.065795+0000","last_unstale":"2023-07-27T14:28:05.074134+0000","last_undegraded":"2023-07-27T14:28:05.074134+0000","last_fullsized":"2023-07-27T14:28:05.074134+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.059802+0000","last_change":"2023-07-27T14:28:04.609822+0000","last_active":"2023-07-27T14:28:05.059802+0000","last_peered":"2023-07-27T14:28:05.059802+0000","last_clean":"2023-07-27T14:28:05.059802+0000","last_became_active":"2023-07-27T14:28:04.609544+0000","last_became_peered":"2023-07-27T14:28:04.609544+0000","last_unstale":"2023-07-27T14:28:05.059802+0000","last_undegraded":"2023-07-27T14:28:05.059802+0000","last_fullsized":"2023-07-27T14:28:05.059802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074732+0000","last_change":"2023-07-27T14:28:05.067955+0000","last_active":"2023-07-27T14:28:05.074732+0000","last_peered":"2023-07-27T14:28:05.074732+0000","last_clean":"2023-07-27T14:28:05.074732+0000","last_became_active":"2023-07-27T14:28:05.067537+0000","last_became_peered":"2023-07-27T14:28:05.067537+0000","last_unstale":"2023-07-27T14:28:05.074732+0000","last_undegraded":"2023-07-27T14:28:05.074732+0000","last_fullsized":"2023-07-27T14:28:05.074732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.066959+0000","last_change":"2023-07-27T14:28:04.606286+0000","last_active":"2023-07-27T14:28:05.066959+0000","last_peered":"2023-07-27T14:28:05.066959+0000","last_clean":"2023-07-27T14:28:05.066959+0000","last_became_active":"2023-07-27T14:28:04.606029+0000","last_became_peered":"2023-07-27T14:28:04.606029+0000","last_unstale":"2023-07-27T14:28:05.066959+0000","last_undegraded":"2023-07-27T14:28:05.066959+0000","last_fullsized":"2023-07-27T14:28:05.066959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.068576+0000","last_change":"2023-07-27T14:28:05.061755+0000","last_active":"2023-07-27T14:28:05.068576+0000","last_peered":"2023-07-27T14:28:05.068576+0000","last_clean":"2023-07-27T14:28:05.068576+0000","last_became_active":"2023-07-27T14:28:05.061506+0000","last_became_peered":"2023-07-27T14:28:05.061506+0000","last_unstale":"2023-07-27T14:28:05.068576+0000","last_undegraded":"2023-07-27T14:28:05.068576+0000","last_fullsized":"2023-07-27T14:28:05.068576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.054382+0000","last_change":"2023-07-27T14:28:04.612332+0000","last_active":"2023-07-27T14:28:05.054382+0000","last_peered":"2023-07-27T14:28:05.054382+0000","last_clean":"2023-07-27T14:28:05.054382+0000","last_became_active":"2023-07-27T14:28:04.611966+0000","last_became_peered":"2023-07-27T14:28:04.611966+0000","last_unstale":"2023-07-27T14:28:05.054382+0000","last_undegraded":"2023-07-27T14:28:05.054382+0000","last_fullsized":"2023-07-27T14:28:05.054382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.080478+0000","last_change":"2023-07-27T14:28:05.075574+0000","last_active":"2023-07-27T14:28:05.080478+0000","last_peered":"2023-07-27T14:28:05.080478+0000","last_clean":"2023-07-27T14:28:05.080478+0000","last_became_active":"2023-07-27T14:28:05.075256+0000","last_became_peered":"2023-07-27T14:28:05.075256+0000","last_unstale":"2023-07-27T14:28:05.080478+0000","last_undegraded":"2023-07-27T14:28:05.080478+0000","last_fullsized":"2023-07-27T14:28:05.080478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.049497+0000","last_change":"2023-07-27T14:28:04.604302+0000","last_active":"2023-07-27T14:28:05.049497+0000","last_peered":"2023-07-27T14:28:05.049497+0000","last_clean":"2023-07-27T14:28:05.049497+0000","last_became_active":"2023-07-27T14:28:04.603950+0000","last_became_peered":"2023-07-27T14:28:04.603950+0000","last_unstale":"2023-07-27T14:28:05.049497+0000","last_undegraded":"2023-07-27T14:28:05.049497+0000","last_fullsized":"2023-07-27T14:28:05.049497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.072103+0000","last_change":"2023-07-27T14:28:05.064015+0000","last_active":"2023-07-27T14:28:05.072103+0000","last_peered":"2023-07-27T14:28:05.072103+0000","last_clean":"2023-07-27T14:28:05.072103+0000","last_became_active":"2023-07-27T14:28:05.062988+0000","last_became_peered":"2023-07-27T14:28:05.062988+0000","last_unstale":"2023-07-27T14:28:05.072103+0000","last_undegraded":"2023-07-27T14:28:05.072103+0000","last_fullsized":"2023-07-27T14:28:05.072103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.054204+0000","last_change":"2023-07-27T14:28:04.608157+0000","last_active":"2023-07-27T14:28:05.054204+0000","last_peered":"2023-07-27T14:28:05.054204+0000","last_clean":"2023-07-27T14:28:05.054204+0000","last_became_active":"2023-07-27T14:28:04.607895+0000","last_became_peered":"2023-07-27T14:28:04.607895+0000","last_unstale":"2023-07-27T14:28:05.054204+0000","last_undegraded":"2023-07-27T14:28:05.054204+0000","last_fullsized":"2023-07-27T14:28:05.054204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.076485+0000","last_change":"2023-07-27T14:28:05.074116+0000","last_active":"2023-07-27T14:28:05.076485+0000","last_peered":"2023-07-27T14:28:05.076485+0000","last_clean":"2023-07-27T14:28:05.076485+0000","last_became_active":"2023-07-27T14:28:05.073838+0000","last_became_peered":"2023-07-27T14:28:05.073838+0000","last_unstale":"2023-07-27T14:28:05.076485+0000","last_undegraded":"2023-07-27T14:28:05.076485+0000","last_fullsized":"2023-07-27T14:28:05.076485+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.054927+0000","last_change":"2023-07-27T14:28:04.592933+0000","last_active":"2023-07-27T14:28:05.054927+0000","last_peered":"2023-07-27T14:28:05.054927+0000","last_clean":"2023-07-27T14:28:05.054927+0000","last_became_active":"2023-07-27T14:28:04.592660+0000","last_became_peered":"2023-07-27T14:28:04.592660+0000","last_unstale":"2023-07-27T14:28:05.054927+0000","last_undegraded":"2023-07-27T14:28:05.054927+0000","last_fullsized":"2023-07-27T14:28:05.054927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.059875+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:28:05.059875+0000","last_peered":"2023-07-27T14:28:05.059875+0000","last_clean":"2023-07-27T14:28:05.059875+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:28:05.059875+0000","last_undegraded":"2023-07-27T14:28:05.059875+0000","last_fullsized":"2023-07-27T14:28:05.059875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.069044+0000","last_change":"2023-07-27T14:28:05.062182+0000","last_active":"2023-07-27T14:28:05.069044+0000","last_peered":"2023-07-27T14:28:05.069044+0000","last_clean":"2023-07-27T14:28:05.069044+0000","last_became_active":"2023-07-27T14:28:05.061884+0000","last_became_peered":"2023-07-27T14:28:05.061884+0000","last_unstale":"2023-07-27T14:28:05.069044+0000","last_undegraded":"2023-07-27T14:28:05.069044+0000","last_fullsized":"2023-07-27T14:28:05.069044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.055379+0000","last_change":"2023-07-27T14:28:04.596630+0000","last_active":"2023-07-27T14:28:05.055379+0000","last_peered":"2023-07-27T14:28:05.055379+0000","last_clean":"2023-07-27T14:28:05.055379+0000","last_became_active":"2023-07-27T14:28:04.596298+0000","last_became_peered":"2023-07-27T14:28:04.596298+0000","last_unstale":"2023-07-27T14:28:05.055379+0000","last_undegraded":"2023-07-27T14:28:05.055379+0000","last_fullsized":"2023-07-27T14:28:05.055379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.066171+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:28:05.066171+0000","last_peered":"2023-07-27T14:28:05.066171+0000","last_clean":"2023-07-27T14:28:05.066171+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:28:05.066171+0000","last_undegraded":"2023-07-27T14:28:05.066171+0000","last_fullsized":"2023-07-27T14:28:05.066171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.075186+0000","last_change":"2023-07-27T14:28:05.072916+0000","last_active":"2023-07-27T14:28:05.075186+0000","last_peered":"2023-07-27T14:28:05.075186+0000","last_clean":"2023-07-27T14:28:05.075186+0000","last_became_active":"2023-07-27T14:28:05.072251+0000","last_became_peered":"2023-07-27T14:28:05.072251+0000","last_unstale":"2023-07-27T14:28:05.075186+0000","last_undegraded":"2023-07-27T14:28:05.075186+0000","last_fullsized":"2023-07-27T14:28:05.075186+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.057819+0000","last_change":"2023-07-27T14:28:04.606955+0000","last_active":"2023-07-27T14:28:05.057819+0000","last_peered":"2023-07-27T14:28:05.057819+0000","last_clean":"2023-07-27T14:28:05.057819+0000","last_became_active":"2023-07-27T14:28:04.606695+0000","last_became_peered":"2023-07-27T14:28:04.606695+0000","last_unstale":"2023-07-27T14:28:05.057819+0000","last_undegraded":"2023-07-27T14:28:05.057819+0000","last_fullsized":"2023-07-27T14:28:05.057819+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.054358+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:28:05.054358+0000","last_peered":"2023-07-27T14:28:05.054358+0000","last_clean":"2023-07-27T14:28:05.054358+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:28:05.054358+0000","last_undegraded":"2023-07-27T14:28:05.054358+0000","last_fullsized":"2023-07-27T14:28:05.054358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.081055+0000","last_change":"2023-07-27T14:28:05.074308+0000","last_active":"2023-07-27T14:28:05.081055+0000","last_peered":"2023-07-27T14:28:05.081055+0000","last_clean":"2023-07-27T14:28:05.081055+0000","last_became_active":"2023-07-27T14:28:05.074001+0000","last_became_peered":"2023-07-27T14:28:05.074001+0000","last_unstale":"2023-07-27T14:28:05.081055+0000","last_undegraded":"2023-07-27T14:28:05.081055+0000","last_fullsized":"2023-07-27T14:28:05.081055+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048283+0000","last_change":"2023-07-27T14:28:04.605480+0000","last_active":"2023-07-27T14:28:05.048283+0000","last_peered":"2023-07-27T14:28:05.048283+0000","last_clean":"2023-07-27T14:28:05.048283+0000","last_became_active":"2023-07-27T14:28:04.605145+0000","last_became_peered":"2023-07-27T14:28:04.605145+0000","last_unstale":"2023-07-27T14:28:05.048283+0000","last_undegraded":"2023-07-27T14:28:05.048283+0000","last_fullsized":"2023-07-27T14:28:05.048283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.064084+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:28:05.064084+0000","last_peered":"2023-07-27T14:28:05.064084+0000","last_clean":"2023-07-27T14:28:05.064084+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:28:05.064084+0000","last_undegraded":"2023-07-27T14:28:05.064084+0000","last_fullsized":"2023-07-27T14:28:05.064084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048443+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:28:05.048443+0000","last_peered":"2023-07-27T14:28:05.048443+0000","last_clean":"2023-07-27T14:28:05.048443+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:28:05.048443+0000","last_undegraded":"2023-07-27T14:28:05.048443+0000","last_fullsized":"2023-07-27T14:28:05.048443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.078543+0000","last_change":"2023-07-27T14:28:05.077714+0000","last_active":"2023-07-27T14:28:05.078543+0000","last_peered":"2023-07-27T14:28:05.078543+0000","last_clean":"2023-07-27T14:28:05.078543+0000","last_became_active":"2023-07-27T14:28:05.077403+0000","last_became_peered":"2023-07-27T14:28:05.077403+0000","last_unstale":"2023-07-27T14:28:05.078543+0000","last_undegraded":"2023-07-27T14:28:05.078543+0000","last_fullsized":"2023-07-27T14:28:05.078543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.081001+0000","last_change":"2023-07-27T14:28:04.601640+0000","last_active":"2023-07-27T14:28:05.081001+0000","last_peered":"2023-07-27T14:28:05.081001+0000","last_clean":"2023-07-27T14:28:05.081001+0000","last_became_active":"2023-07-27T14:28:04.601351+0000","last_became_peered":"2023-07-27T14:28:04.601351+0000","last_unstale":"2023-07-27T14:28:05.081001+0000","last_undegraded":"2023-07-27T14:28:05.081001+0000","last_fullsized":"2023-07-27T14:28:05.081001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048710+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:28:05.048710+0000","last_peered":"2023-07-27T14:28:05.048710+0000","last_clean":"2023-07-27T14:28:05.048710+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:28:05.048710+0000","last_undegraded":"2023-07-27T14:28:05.048710+0000","last_fullsized":"2023-07-27T14:28:05.048710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.076762+0000","last_change":"2023-07-27T14:28:05.071939+0000","last_active":"2023-07-27T14:28:05.076762+0000","last_peered":"2023-07-27T14:28:05.076762+0000","last_clean":"2023-07-27T14:28:05.076762+0000","last_became_active":"2023-07-27T14:28:05.071648+0000","last_became_peered":"2023-07-27T14:28:05.071648+0000","last_unstale":"2023-07-27T14:28:05.076762+0000","last_undegraded":"2023-07-27T14:28:05.076762+0000","last_fullsized":"2023-07-27T14:28:05.076762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.052431+0000","last_change":"2023-07-27T14:28:04.598079+0000","last_active":"2023-07-27T14:28:05.052431+0000","last_peered":"2023-07-27T14:28:05.052431+0000","last_clean":"2023-07-27T14:28:05.052431+0000","last_became_active":"2023-07-27T14:28:04.597786+0000","last_became_peered":"2023-07-27T14:28:04.597786+0000","last_unstale":"2023-07-27T14:28:05.052431+0000","last_undegraded":"2023-07-27T14:28:05.052431+0000","last_fullsized":"2023-07-27T14:28:05.052431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.049047+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:28:05.049047+0000","last_peered":"2023-07-27T14:28:05.049047+0000","last_clean":"2023-07-27T14:28:05.049047+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:28:05.049047+0000","last_undegraded":"2023-07-27T14:28:05.049047+0000","last_fullsized":"2023-07-27T14:28:05.049047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.069977+0000","last_change":"2023-07-27T14:28:05.062518+0000","last_active":"2023-07-27T14:28:05.069977+0000","last_peered":"2023-07-27T14:28:05.069977+0000","last_clean":"2023-07-27T14:28:05.069977+0000","last_became_active":"2023-07-27T14:28:05.062207+0000","last_became_peered":"2023-07-27T14:28:05.062207+0000","last_unstale":"2023-07-27T14:28:05.069977+0000","last_undegraded":"2023-07-27T14:28:05.069977+0000","last_fullsized":"2023-07-27T14:28:05.069977+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.053136+0000","last_change":"2023-07-27T14:28:04.607664+0000","last_active":"2023-07-27T14:28:05.053136+0000","last_peered":"2023-07-27T14:28:05.053136+0000","last_clean":"2023-07-27T14:28:05.053136+0000","last_became_active":"2023-07-27T14:28:04.607393+0000","last_became_peered":"2023-07-27T14:28:04.607393+0000","last_unstale":"2023-07-27T14:28:05.053136+0000","last_undegraded":"2023-07-27T14:28:05.053136+0000","last_fullsized":"2023-07-27T14:28:05.053136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.061951+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:28:05.061951+0000","last_peered":"2023-07-27T14:28:05.061951+0000","last_clean":"2023-07-27T14:28:05.061951+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:28:05.061951+0000","last_undegraded":"2023-07-27T14:28:05.061951+0000","last_fullsized":"2023-07-27T14:28:05.061951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.074565+0000","last_change":"2023-07-27T14:28:05.066823+0000","last_active":"2023-07-27T14:28:05.074565+0000","last_peered":"2023-07-27T14:28:05.074565+0000","last_clean":"2023-07-27T14:28:05.074565+0000","last_became_active":"2023-07-27T14:28:05.066470+0000","last_became_peered":"2023-07-27T14:28:05.066470+0000","last_unstale":"2023-07-27T14:28:05.074565+0000","last_undegraded":"2023-07-27T14:28:05.074565+0000","last_fullsized":"2023-07-27T14:28:05.074565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:04.573621+0000","last_clean_scrub_stamp":"2023-07-27T14:28:04.573621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.048127+0000","last_change":"2023-07-27T14:28:04.593041+0000","last_active":"2023-07-27T14:28:05.048127+0000","last_peered":"2023-07-27T14:28:05.048127+0000","last_clean":"2023-07-27T14:28:05.048127+0000","last_became_active":"2023-07-27T14:28:04.592764+0000","last_became_peered":"2023-07-27T14:28:04.592764+0000","last_unstale":"2023-07-27T14:28:05.048127+0000","last_undegraded":"2023-07-27T14:28:05.048127+0000","last_fullsized":"2023-07-27T14:28:05.048127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:28:03.567460+0000","last_clean_scrub_stamp":"2023-07-27T14:28:03.567460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-27T14:28:05.055199+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:28:05.055199+0000","last_peered":"2023-07-27T14:28:05.055199+0000","last_clean":"2023-07-27T14:28:05.055199+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:28:05.055199+0000","last_undegraded":"2023-07-27T14:28:05.055199+0000","last_fullsized":"2023-07-27T14:28:05.055199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5792,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366048,"statfs":{"total":96636764160,"available":96630833152,"internally_reserved":0,"allocated":417792,"data_stored":173213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.625},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.438}]},{"osd":5,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.55400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5660,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366180,"statfs":{"total":96636764160,"available":96630968320,"internally_reserved":0,"allocated":413696,"data_stored":173123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.622}]},{"osd":2,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.432},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jul 27 14:27:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5728,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366112,"statfs":{"total":96636764160,"available":96630898688,"internally_reserved":0,"allocated":417792,"data_stored":172729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":4.75,"5min":4.75,"15min":4.75},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":9.3100000000000005,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.7210000000000001,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.439}]},{"osd":3,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.7440000000000002,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":6.1980000000000004,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.0309999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5660,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366180,"statfs":{"total":96636764160,"available":96630968320,"internally_reserved":0,"allocated":413696,"data_stored":172603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.503}]},{"osd":3,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.374},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.63700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5656,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94366184,"statfs":{"total":96636764160,"available":96630972416,"internally_reserved":0,"allocated":409600,"data_stored":172569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.379}]},{"osd":1,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.623}]},{"osd":5,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.63}]},{"osd":6,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5804,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366036,"statfs":{"total":96636764160,"available":96630820864,"internally_reserved":0,"allocated":430080,"data_stored":174209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.313},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.377},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.626}]},{"osd":6,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.67200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5788,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366052,"statfs":{"total":96636764160,"available":96630837248,"internally_reserved":0,"allocated":413696,"data_stored":172591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.745}]},{"osd":1,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:27:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5724,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94366116,"statfs":{"total":96636764160,"available":96630902784,"internally_reserved":0,"allocated":413696,"data_stored":167423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.502},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.623}]},{"osd":4,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:28:09.777 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:28:09.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:28:10.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.984+0000 7fc68a1ff700 1 Processor -- start 2023-07-27T14:28:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.984+0000 7fc68a1ff700 1 -- start start 2023-07-27T14:28:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.985+0000 7fc68a1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc684150970 0x7fc684068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.985+0000 7fc68a1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc684064c90 con 0x7fc684150d50 2023-07-27T14:28:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.985+0000 7fc68a1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc684064f70 con 0x7fc6840c2850 2023-07-27T14:28:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.985+0000 7fc68a1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc684063b50 con 0x7fc684150970 2023-07-27T14:28:10.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.985+0000 7fc6837fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc684150970 0x7fc684068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6837fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc684150970 0x7fc684068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59280/0 (socket says 172.21.15.115:59280) 2023-07-27T14:28:10.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6837fe700 1 -- 172.21.15.115:0/3110107624 learned_addr learned my addr 172.21.15.115:0/3110107624 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6837fe700 1 -- 172.21.15.115:0/3110107624 >> v1:172.21.15.159:6789/0 conn(0x7fc6840c2850 legacy=0x7fc684159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6837fe700 1 -- 172.21.15.115:0/3110107624 >> v1:172.21.15.115:6789/0 conn(0x7fc684150d50 legacy=0x7fc6841511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6837fe700 1 -- 172.21.15.115:0/3110107624 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684065250 con 0x7fc684150970 2023-07-27T14:28:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6837fe700 1 --2- 172.21.15.115:0/3110107624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150970 0x7fc684068880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fc674006fd0 tx=0x7fc6740090f0).ready entity=mon.0 client_cookie=2812a0849d86e034 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6827fc700 1 -- 172.21.15.115:0/3110107624 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674010620 con 0x7fc684150970 2023-07-27T14:28:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6827fc700 1 -- 172.21.15.115:0/3110107624 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc674010780 con 0x7fc684150970 2023-07-27T14:28:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.986+0000 7fc6827fc700 1 -- 172.21.15.115:0/3110107624 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674010b00 con 0x7fc684150970 2023-07-27T14:28:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.987+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3110107624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150970 msgr2=0x7fc684068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.987+0000 7fc68a1ff700 1 --2- 172.21.15.115:0/3110107624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150970 0x7fc684068880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fc674006fd0 tx=0x7fc6740090f0).stop 2023-07-27T14:28:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.987+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3110107624 shutdown_connections 2023-07-27T14:28:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.987+0000 7fc68a1ff700 1 --2- 172.21.15.115:0/3110107624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150970 0x7fc684068880 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.987+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3110107624 >> 172.21.15.115:0/3110107624 conn(0x7fc684062df0 msgr2=0x7fc6840c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.987+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3110107624 shutdown_connections 2023-07-27T14:28:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.987+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3110107624 wait complete. 2023-07-27T14:28:10.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.988+0000 7fc68a1ff700 1 Processor -- start 2023-07-27T14:28:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.989+0000 7fc68a1ff700 1 -- start start 2023-07-27T14:28:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.989+0000 7fc68a1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840c2850 0x7fc684142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.989+0000 7fc68a1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc684150970 0x7fc684147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.989+0000 7fc68a1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150d50 0x7fc6840bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.989+0000 7fc68a1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840ab700 con 0x7fc684150d50 2023-07-27T14:28:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.989+0000 7fc68a1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840aaaf0 con 0x7fc6840c2850 2023-07-27T14:28:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.989+0000 7fc68a1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840aadd0 con 0x7fc684150970 2023-07-27T14:28:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150d50 0x7fc6840bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150d50 0x7fc6840bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59282/0 (socket says 172.21.15.115:59282) 2023-07-27T14:28:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 -- 172.21.15.115:0/3779823172 learned_addr learned my addr 172.21.15.115:0/3779823172 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc6837fe700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840c2850 0x7fc684142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc682ffd700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc684150970 0x7fc684147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 -- 172.21.15.115:0/3779823172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc684150970 msgr2=0x7fc684147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc684150970 0x7fc684147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 -- 172.21.15.115:0/3779823172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840c2850 msgr2=0x7fc684142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840c2850 0x7fc684142c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 -- 172.21.15.115:0/3779823172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674009370 con 0x7fc684150d50 2023-07-27T14:28:10.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.990+0000 7fc683fff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150d50 0x7fc6840bfcd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fc67c00c810 tx=0x7fc67c002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:10.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.991+0000 7fc66b7fe700 1 -- 172.21.15.115:0/3779823172 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c010510 con 0x7fc684150d50 2023-07-27T14:28:10.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.991+0000 7fc66b7fe700 1 -- 172.21.15.115:0/3779823172 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c0106b0 con 0x7fc684150d50 2023-07-27T14:28:10.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.991+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6840ab0b0 con 0x7fc684150d50 2023-07-27T14:28:10.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.991+0000 7fc66b7fe700 1 -- 172.21.15.115:0/3779823172 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c010a70 con 0x7fc684150d50 2023-07-27T14:28:10.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.991+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6840c01c0 con 0x7fc684150d50 2023-07-27T14:28:10.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.992+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68406c470 con 0x7fc684150d50 2023-07-27T14:28:10.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.992+0000 7fc66b7fe700 1 -- 172.21.15.115:0/3779823172 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fc67c019030 con 0x7fc684150d50 2023-07-27T14:28:10.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.994+0000 7fc66b7fe700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc67005ed90 0x7fc670061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.994+0000 7fc66b7fe700 1 -- 172.21.15.115:0/3779823172 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc67c0793c0 con 0x7fc684150d50 2023-07-27T14:28:10.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.994+0000 7fc6837fe700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc67005ed90 0x7fc670061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.994+0000 7fc6837fe700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc67005ed90 0x7fc670061250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc674009130 tx=0x7fc674018000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:10.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:09.998+0000 7fc66b7fe700 1 -- 172.21.15.115:0/3779823172 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc67c0488f0 con 0x7fc684150d50 2023-07-27T14:28:10.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.231+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc6840ab840 con 0x7fc684150d50 2023-07-27T14:28:10.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.237+0000 7fc66b7fe700 1 -- 172.21.15.115:0/3779823172 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc67c04e330 con 0x7fc684150d50 2023-07-27T14:28:10.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc67005ed90 msgr2=0x7fc670061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc67005ed90 0x7fc670061250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc674009130 tx=0x7fc674018000).stop 2023-07-27T14:28:10.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150d50 msgr2=0x7fc6840bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150d50 0x7fc6840bfcd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fc67c00c810 tx=0x7fc67c002560).stop 2023-07-27T14:28:10.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 shutdown_connections 2023-07-27T14:28:10.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc67005ed90 0x7fc670061250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc684150d50 0x7fc6840bfcd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6840c2850 0x7fc684142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 --2- 172.21.15.115:0/3779823172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc684150970 0x7fc684147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.239+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 >> 172.21.15.115:0/3779823172 conn(0x7fc684062df0 msgr2=0x7fc6840a8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:10.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.240+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 shutdown_connections 2023-07-27T14:28:10.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.240+0000 7fc68a1ff700 1 -- 172.21.15.115:0/3779823172 wait complete. 2023-07-27T14:28:10.259 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:28:10.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:28:10.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.443+0000 7f78bddff700 1 Processor -- start 2023-07-27T14:28:10.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.444+0000 7f78bddff700 1 -- start start 2023-07-27T14:28:10.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.445+0000 7f78bddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b80aaa40 0x7f78b80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.445+0000 7f78bddff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78b81542a0 0x7f78b80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.445+0000 7f78bddff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80aa4d0 con 0x7f78b8153ec0 2023-07-27T14:28:10.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.445+0000 7f78bddff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b8064ad0 con 0x7f78b81542a0 2023-07-27T14:28:10.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.445+0000 7f78bddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80c05c0 con 0x7f78b80aaa40 2023-07-27T14:28:10.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.445+0000 7f78b7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78b81542a0 0x7f78b80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.445+0000 7f78b77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f78b8153ec0 0x7f78b80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46216/0 (socket says 172.21.15.115:46216) 2023-07-27T14:28:10.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.445+0000 7f78b77fe700 1 -- 172.21.15.115:0/69090574 learned_addr learned my addr 172.21.15.115:0/69090574 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:10.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b7fff700 1 -- 172.21.15.115:0/69090574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b80aaa40 msgr2=0x7f78b80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:10.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b6ffd700 1 --2- 172.21.15.115:0/69090574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b80aaa40 0x7f78b80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b67fc700 1 -- 172.21.15.115:0/69090574 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189349555 0 0) 0x7f78a8001110 con 0x7f78b8153ec0 2023-07-27T14:28:10.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b7fff700 1 --2- 172.21.15.115:0/69090574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b80aaa40 0x7f78b80640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b7fff700 1 -- 172.21.15.115:0/69090574 >> v1:172.21.15.115:6789/0 conn(0x7f78b8153ec0 legacy=0x7f78b80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b7fff700 1 -- 172.21.15.115:0/69090574 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80c1a60 con 0x7f78b81542a0 2023-07-27T14:28:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b6ffd700 1 --2- 172.21.15.115:0/69090574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b80aaa40 0x7f78b80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b7fff700 1 --2- 172.21.15.115:0/69090574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b81542a0 0x7f78b80645e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f78b0009e60 tx=0x7f78b0009780).ready entity=mon.0 client_cookie=72d96c16752e173 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b67fc700 1 -- 172.21.15.115:0/69090574 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b000e070 con 0x7f78b81542a0 2023-07-27T14:28:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b67fc700 1 -- 172.21.15.115:0/69090574 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b000bc30 con 0x7f78b81542a0 2023-07-27T14:28:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.446+0000 7f78b67fc700 1 -- 172.21.15.115:0/69090574 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0012410 con 0x7f78b81542a0 2023-07-27T14:28:10.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.447+0000 7f78bddff700 1 -- 172.21.15.115:0/69090574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b81542a0 msgr2=0x7f78b80645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.447+0000 7f78bddff700 1 --2- 172.21.15.115:0/69090574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b81542a0 0x7f78b80645e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f78b0009e60 tx=0x7f78b0009780).stop 2023-07-27T14:28:10.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.447+0000 7f78bddff700 1 -- 172.21.15.115:0/69090574 shutdown_connections 2023-07-27T14:28:10.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.447+0000 7f78bddff700 1 --2- 172.21.15.115:0/69090574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b81542a0 0x7f78b80645e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.447+0000 7f78bddff700 1 --2- 172.21.15.115:0/69090574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b80aaa40 0x7f78b80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.447+0000 7f78bddff700 1 -- 172.21.15.115:0/69090574 >> 172.21.15.115:0/69090574 conn(0x7f78b80cb610 msgr2=0x7f78b80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:10.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.447+0000 7f78bddff700 1 -- 172.21.15.115:0/69090574 shutdown_connections 2023-07-27T14:28:10.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.447+0000 7f78bddff700 1 -- 172.21.15.115:0/69090574 wait complete. 2023-07-27T14:28:10.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.448+0000 7f78bddff700 1 Processor -- start 2023-07-27T14:28:10.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.448+0000 7f78bddff700 1 -- start start 2023-07-27T14:28:10.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.449+0000 7f78bddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b80aaa40 0x7f78b8151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.449+0000 7f78bddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b8153ec0 0x7f78b814e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.449+0000 7f78bddff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78b81542a0 0x7f78b8152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.449+0000 7f78bddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8152800 con 0x7f78b80aaa40 2023-07-27T14:28:10.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.449+0000 7f78bddff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8151860 con 0x7f78b81542a0 2023-07-27T14:28:10.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.449+0000 7f78bddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b814f170 con 0x7f78b8153ec0 2023-07-27T14:28:10.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.449+0000 7f78b77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b80aaa40 0x7f78b8151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b80aaa40 0x7f78b8151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59306/0 (socket says 172.21.15.115:59306) 2023-07-27T14:28:10.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b77fe700 1 -- 172.21.15.115:0/3971632012 learned_addr learned my addr 172.21.15.115:0/3971632012 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:10.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b6ffd700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b8153ec0 0x7f78b814e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b7fff700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78b81542a0 0x7f78b8152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b77fe700 1 -- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b8153ec0 msgr2=0x7f78b814e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b77fe700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b8153ec0 0x7f78b814e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b77fe700 1 -- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78b81542a0 msgr2=0x7f78b8152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b77fe700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78b81542a0 0x7f78b8152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b77fe700 1 -- 172.21.15.115:0/3971632012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0009a20 con 0x7f78b80aaa40 2023-07-27T14:28:10.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b7fff700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78b81542a0 0x7f78b8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:10.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78b77fe700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b80aaa40 0x7f78b8151370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f78a800c4f0 tx=0x7f78a8007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:10.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f789f7fe700 1 -- 172.21.15.115:0/3971632012 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80072e0 con 0x7f78b80aaa40 2023-07-27T14:28:10.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f789f7fe700 1 -- 172.21.15.115:0/3971632012 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a8007440 con 0x7f78b80aaa40 2023-07-27T14:28:10.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b80afc40 con 0x7f78b80aaa40 2023-07-27T14:28:10.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.450+0000 7f789f7fe700 1 -- 172.21.15.115:0/3971632012 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80057a0 con 0x7f78b80aaa40 2023-07-27T14:28:10.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.451+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b80af5f0 con 0x7f78b80aaa40 2023-07-27T14:28:10.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.452+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b806c470 con 0x7f78b80aaa40 2023-07-27T14:28:10.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.452+0000 7f789f7fe700 1 -- 172.21.15.115:0/3971632012 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f78a8010070 con 0x7f78b80aaa40 2023-07-27T14:28:10.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.453+0000 7f789f7fe700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78a405ed60 0x7f78a4061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:10.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.453+0000 7f789f7fe700 1 -- 172.21.15.115:0/3971632012 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f78a8078ff0 con 0x7f78b80aaa40 2023-07-27T14:28:10.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.453+0000 7f78b6ffd700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78a405ed60 0x7f78a4061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:10.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.454+0000 7f78b6ffd700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78a405ed60 0x7f78a4061220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f78b80c9880 tx=0x7f78ac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:10.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.457+0000 7f789f7fe700 1 -- 172.21.15.115:0/3971632012 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78a804a500 con 0x7f78b80aaa40 2023-07-27T14:28:10.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.668+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78b80aa4d0 con 0x7f78b80aaa40 2023-07-27T14:28:10.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.668+0000 7f789f7fe700 1 -- 172.21.15.115:0/3971632012 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f78b80aa4d0 con 0x7f78b80aaa40 2023-07-27T14:28:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:10.686 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/2250060018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2250060018},{"type":"v1","addr":"172.21.15.159:6833","nonce":2250060018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2756493852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2756493852},{"type":"v1","addr":"172.21.15.159:6835","nonce":2756493852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4777,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1646103579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1646103579},{"type":"v1","addr":"172.21.15.115:6836","nonce":1646103579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:28:05.041620+0000","modified":"2023-07-27T14:28:08.054910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4780":{"gid":4780,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6837/770984486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":770984486},{"type":"v1","addr":"172.21.15.115:6837","nonce":770984486}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-07-27T14:28:10.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78a405ed60 msgr2=0x7f78a4061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78a405ed60 0x7f78a4061220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f78b80c9880 tx=0x7f78ac008040).stop 2023-07-27T14:28:10.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b80aaa40 msgr2=0x7f78b8151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:10.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b80aaa40 0x7f78b8151370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f78a800c4f0 tx=0x7f78a8007a90).stop 2023-07-27T14:28:10.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 shutdown_connections 2023-07-27T14:28:10.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78a405ed60 0x7f78a4061220 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78b81542a0 0x7f78b8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78b80aaa40 0x7f78b8151370 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 --2- 172.21.15.115:0/3971632012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78b8153ec0 0x7f78b814e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:10.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.670+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 >> 172.21.15.115:0/3971632012 conn(0x7f78b80cb610 msgr2=0x7f78b8062ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:10.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.671+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 shutdown_connections 2023-07-27T14:28:10.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:10.671+0000 7f78bddff700 1 -- 172.21.15.115:0/3971632012 wait complete. 2023-07-27T14:28:10.690 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 16 2023-07-27T14:28:11.107 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:28:05.041620+0000', 'modified': '2023-07-27T14:28:08.054910+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4780}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4780': {'gid': 4780, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.115:6837/770984486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 770984486}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 770984486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:28:11.108 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:28:11.108 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-27T14:28:11.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.280+0000 7fae6bbff700 1 Processor -- start 2023-07-27T14:28:11.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.280+0000 7fae6bbff700 1 -- start start 2023-07-27T14:28:11.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.281+0000 7fae6bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae64153ec0 0x7fae640a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.281+0000 7fae6bbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fae640aa050 0x7fae640640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.282+0000 7fae6bbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae640aa4d0 con 0x7fae640aaa40 2023-07-27T14:28:11.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.282+0000 7fae6bbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae640c05c0 con 0x7fae640aa050 2023-07-27T14:28:11.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.282+0000 7fae6bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae640c1a60 con 0x7fae64153ec0 2023-07-27T14:28:11.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.282+0000 7fae6999b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae64153ec0 0x7fae640a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.282+0000 7fae6919a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fae640aa050 0x7fae640640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.282+0000 7fae6999b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae64153ec0 0x7fae640a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:59172/0 (socket says 172.21.15.115:59172) 2023-07-27T14:28:11.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.282+0000 7fae6919a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fae640aa050 0x7fae640640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:34024/0 (socket says 172.21.15.115:34024) 2023-07-27T14:28:11.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.282+0000 7fae6999b700 1 -- 172.21.15.115:0/1669840753 learned_addr learned my addr 172.21.15.115:0/1669840753 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:11.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae6999b700 1 -- 172.21.15.115:0/1669840753 >> v2:172.21.15.159:3300/0 conn(0x7fae640aa050 msgr2=0x7fae640640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae6999b700 1 --2- 172.21.15.115:0/1669840753 >> v2:172.21.15.159:3300/0 conn(0x7fae640aa050 0x7fae640640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae6999b700 1 -- 172.21.15.115:0/1669840753 >> v1:172.21.15.159:6789/0 conn(0x7fae640aaa40 legacy=0x7fae64157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae6999b700 1 -- 172.21.15.115:0/1669840753 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae640bfc90 con 0x7fae64153ec0 2023-07-27T14:28:11.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae68999700 1 -- 172.21.15.115:0/1669840753 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295101507 0 0) 0x7fae5c001490 con 0x7fae640aaa40 2023-07-27T14:28:11.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae6919a700 1 --2- 172.21.15.115:0/1669840753 >> v2:172.21.15.159:3300/0 conn(0x7fae640aa050 0x7fae640640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:28:11.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae6999b700 1 --2- 172.21.15.115:0/1669840753 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae64153ec0 0x7fae640a9b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fae60006fd0 tx=0x7fae600090f0).ready entity=mon.2 client_cookie=b43c814e0fab109d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae68999700 1 -- 172.21.15.115:0/1669840753 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000b580 con 0x7fae64153ec0 2023-07-27T14:28:11.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae68999700 1 -- 172.21.15.115:0/1669840753 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6000b6e0 con 0x7fae64153ec0 2023-07-27T14:28:11.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.283+0000 7fae68999700 1 -- 172.21.15.115:0/1669840753 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000ba60 con 0x7fae64153ec0 2023-07-27T14:28:11.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.284+0000 7fae6bbff700 1 -- 172.21.15.115:0/1669840753 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae64153ec0 msgr2=0x7fae640a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.284+0000 7fae6bbff700 1 --2- 172.21.15.115:0/1669840753 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae64153ec0 0x7fae640a9b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fae60006fd0 tx=0x7fae600090f0).stop 2023-07-27T14:28:11.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.284+0000 7fae6bbff700 1 -- 172.21.15.115:0/1669840753 shutdown_connections 2023-07-27T14:28:11.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.284+0000 7fae6bbff700 1 --2- 172.21.15.115:0/1669840753 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae64153ec0 0x7fae640a9b60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.284+0000 7fae6bbff700 1 --2- 172.21.15.115:0/1669840753 >> v2:172.21.15.159:3300/0 conn(0x7fae640aa050 0x7fae640640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.284+0000 7fae6bbff700 1 -- 172.21.15.115:0/1669840753 >> 172.21.15.115:0/1669840753 conn(0x7fae640cb610 msgr2=0x7fae640c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:11.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.284+0000 7fae6bbff700 1 -- 172.21.15.115:0/1669840753 shutdown_connections 2023-07-27T14:28:11.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.284+0000 7fae6bbff700 1 -- 172.21.15.115:0/1669840753 wait complete. 2023-07-27T14:28:11.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.286+0000 7fae6bbff700 1 Processor -- start 2023-07-27T14:28:11.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.286+0000 7fae6bbff700 1 -- start start 2023-07-27T14:28:11.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae640aa050 0x7fae64168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6bbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640aaa40 0x7fae641508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6bbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae64153ec0 0x7fae6414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6bbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64150db0 con 0x7fae640aaa40 2023-07-27T14:28:11.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6bbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64151030 con 0x7fae64153ec0 2023-07-27T14:28:11.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae64151310 con 0x7fae640aa050 2023-07-27T14:28:11.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640aaa40 0x7fae641508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640aaa40 0x7fae641508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59320/0 (socket says 172.21.15.115:59320) 2023-07-27T14:28:11.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 -- 172.21.15.115:0/3974738975 learned_addr learned my addr 172.21.15.115:0/3974738975 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:11.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6999b700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae640aa050 0x7fae64168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6a19c700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae64153ec0 0x7fae6414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 -- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae640aa050 msgr2=0x7fae64168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae640aa050 0x7fae64168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 -- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae64153ec0 msgr2=0x7fae6414c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae64153ec0 0x7fae6414c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 -- 172.21.15.115:0/3974738975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae540092a0 con 0x7fae640aaa40 2023-07-27T14:28:11.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6999b700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae640aa050 0x7fae64168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:11.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.288+0000 7fae6919a700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640aaa40 0x7fae641508c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fae5400e980 tx=0x7fae54009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.289+0000 7fae59ffb700 1 -- 172.21.15.115:0/3974738975 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400c7f0 con 0x7fae640aaa40 2023-07-27T14:28:11.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.289+0000 7fae59ffb700 1 -- 172.21.15.115:0/3974738975 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5400c950 con 0x7fae640aaa40 2023-07-27T14:28:11.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.289+0000 7fae6bbff700 1 -- 172.21.15.115:0/3974738975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae60009370 con 0x7fae640aaa40 2023-07-27T14:28:11.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.289+0000 7fae59ffb700 1 -- 172.21.15.115:0/3974738975 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400ccd0 con 0x7fae640aaa40 2023-07-27T14:28:11.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.289+0000 7fae6bbff700 1 -- 172.21.15.115:0/3974738975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae641518d0 con 0x7fae640aaa40 2023-07-27T14:28:11.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.291+0000 7fae59ffb700 1 -- 172.21.15.115:0/3974738975 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fae54022070 con 0x7fae640aaa40 2023-07-27T14:28:11.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.292+0000 7fae59ffb700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae4805ed60 0x7fae48061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.292+0000 7fae59ffb700 1 -- 172.21.15.115:0/3974738975 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fae54079f80 con 0x7fae640aaa40 2023-07-27T14:28:11.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.292+0000 7fae6999b700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae4805ed60 0x7fae48061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.293+0000 7fae6999b700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae4805ed60 0x7fae48061220 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fae60009130 tx=0x7fae60017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.294+0000 7fae82f1fb80 1 Processor -- start 2023-07-27T14:28:11.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.294+0000 7fae82f1fb80 1 -- start start 2023-07-27T14:28:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fd099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd31830 0x56478fd57cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478fc469c0 con 0x56478fd31830 2023-07-27T14:28:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478fc5bcc0 con 0x56478fd0bf60 2023-07-27T14:28:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x56478fc22e10 con 0x56478fd095c0 2023-07-27T14:28:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae6919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd31830 0x56478fd57cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae6919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd31830 0x56478fd57cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59322/0 (socket says 172.21.15.115:59322) 2023-07-27T14:28:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae6919a700 1 -- 172.21.15.115:0/3662692091 learned_addr learned my addr 172.21.15.115:0/3662692091 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae6999b700 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fd099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.295+0000 7fae6a19c700 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae6919a700 1 -- 172.21.15.115:0/3662692091 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 msgr2=0x56478fd099a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae6919a700 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fd099a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae6919a700 1 -- 172.21.15.115:0/3662692091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 msgr2=0x56478fd581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae6919a700 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae6919a700 1 -- 172.21.15.115:0/3662692091 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56478fc549a0 con 0x56478fd31830 2023-07-27T14:28:11.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae6919a700 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd31830 0x56478fd57cc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fae5404ee00 tx=0x7fae54011000).ready entity=mon.0 client_cookie=4c51982550728039 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae4e9fe700 1 -- 172.21.15.115:0/3662692091 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54019dc0 con 0x56478fd31830 2023-07-27T14:28:11.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae4e9fe700 1 -- 172.21.15.115:0/3662692091 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5404d580 con 0x56478fd31830 2023-07-27T14:28:11.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.296+0000 7fae4e9fe700 1 -- 172.21.15.115:0/3662692091 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5404b8f0 con 0x56478fd31830 2023-07-27T14:28:11.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3662692091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd31830 msgr2=0x56478fd57cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd31830 0x56478fd57cc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fae5404ee00 tx=0x7fae54011000).stop 2023-07-27T14:28:11.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3662692091 shutdown_connections 2023-07-27T14:28:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fd099a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3662692091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd31830 0x56478fd57cc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3662692091 >> 172.21.15.115:0/3662692091 conn(0x56478fb74940 msgr2=0x56478fd526f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3662692091 shutdown_connections 2023-07-27T14:28:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.297+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3662692091 wait complete. 2023-07-27T14:28:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.298+0000 7fae82f1fb80 1 -- start start 2023-07-27T14:28:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.298+0000 7fae82f1fb80 1 Processor -- start 2023-07-27T14:28:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd38030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd5e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd289f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478fd37230 con 0x56478fd095c0 2023-07-27T14:28:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478fd38630 con 0x56478fd0bf60 2023-07-27T14:28:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x56478fd5ec60 con 0x56478fd28570 2023-07-27T14:28:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae82f1fb80 10 client.0 ll_register_callbacks cb 0x56478fc0e4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:28:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd38030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd38030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59336/0 (socket says 172.21.15.115:59336) 2023-07-27T14:28:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6999b700 1 -- 172.21.15.115:0/3074272750 learned_addr learned my addr 172.21.15.115:0/3074272750 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6919a700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd5e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6999b700 1 -- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 msgr2=0x56478fd289f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6a19c700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd289f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6999b700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd289f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6999b700 1 -- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 msgr2=0x56478fd5e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6999b700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd5e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6999b700 1 -- 172.21.15.115:0/3074272750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae641518d0 con 0x56478fd095c0 2023-07-27T14:28:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6919a700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd5e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.300+0000 7fae6a19c700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd289f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae6999b700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd38030 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fae60009ea0 tx=0x7fae6001f070).ready entity=mon.0 client_cookie=2bbc4a78fe8a2223 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae43fff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:28:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae43fff700 1 -- 172.21.15.115:0/3074272750 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600069b0 con 0x56478fd095c0 2023-07-27T14:28:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae43fff700 1 -- 172.21.15.115:0/3074272750 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fae60028620 con 0x56478fd095c0 2023-07-27T14:28:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3074272750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56478fd03d50 con 0x56478fd095c0 2023-07-27T14:28:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae43fff700 1 -- 172.21.15.115:0/3074272750 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae600287e0 con 0x56478fd095c0 2023-07-27T14:28:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae82f1fb80 10 client.5178 fetch_fsmap learned FSMap version 16 2023-07-27T14:28:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3074272750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56478fc50190 con 0x56478fd095c0 2023-07-27T14:28:11.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae43fff700 1 -- 172.21.15.115:0/3074272750 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56478fd03d50 con 0x56478fd095c0 2023-07-27T14:28:11.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae43fff700 1 -- 172.21.15.115:0/3074272750 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fae60028940 con 0x56478fd095c0 2023-07-27T14:28:11.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae82f1fb80 10 client.5178 fetch_fsmap finished waiting for FSMap version 16 2023-07-27T14:28:11.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae82f1fb80 10 client.5178 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:28:11.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.301+0000 7fae82f1fb80 20 client.5178 populate_metadata read hostname 'smithi115' 2023-07-27T14:28:11.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.302+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] conn(0x56478fd361b0 0x56478fd36590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.302+0000 7fae82f1fb80 4 client.5178 mds_command: new command op to 4780 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:28:11.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.302+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3074272750 --> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56478fac4ef0 con 0x56478fd361b0 2023-07-27T14:28:11.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.302+0000 7fae6919a700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] conn(0x56478fd361b0 0x56478fd36590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.302+0000 7fae43fff700 10 client.5178 ms_handle_connect on v2:172.21.15.115:6834/770984486 2023-07-27T14:28:11.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.302+0000 7fae6919a700 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] conn(0x56478fd361b0 0x56478fd36590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=114bb94f3fb792e0 server_cookie=cd9b254e52f35795 in_seq=0 out_seq=0 2023-07-27T14:28:11.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae43fff700 1 -- 172.21.15.115:0/3074272750 <== mds.0 v2:172.21.15.115:6834/770984486 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x56478fac4ef0 con 0x56478fd361b0 2023-07-27T14:28:11.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae43fff700 10 client.5178 handle_command_reply: tid=0 2023-07-27T14:28:11.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 client.5178 shutdown 2023-07-27T14:28:11.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3074272750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 msgr2=0x56478fd38030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd38030 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fae60009ea0 tx=0x7fae6001f070).stop 2023-07-27T14:28:11.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3074272750 shutdown_connections 2023-07-27T14:28:11.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] conn(0x56478fd361b0 0x56478fd36590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd289f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd38030 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae43fff700 0 client.5178 ms_handle_reset on v2:172.21.15.115:6834/770984486 2023-07-27T14:28:11.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3074272750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd5e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3074272750 >> 172.21.15.115:0/3074272750 conn(0x56478fb74940 msgr2=0x56478fd04890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:11.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3074272750 shutdown_connections 2023-07-27T14:28:11.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.303+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3074272750 wait complete. 2023-07-27T14:28:11.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.304+0000 7fae82f1fb80 20 client.5178 trim_cache size 0 max 16384 2023-07-27T14:28:11.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.320+0000 7fae82f1fb80 1 Processor -- start 2023-07-27T14:28:11.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.320+0000 7fae82f1fb80 1 -- start start 2023-07-27T14:28:11.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd05820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd36590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478fd2d630 con 0x56478fd095c0 2023-07-27T14:28:11.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478fd35890 con 0x56478fd0bf60 2023-07-27T14:28:11.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x56478fd61270 con 0x56478fd28570 2023-07-27T14:28:11.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae6999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd05820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae6999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd05820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59342/0 (socket says 172.21.15.115:59342) 2023-07-27T14:28:11.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae6999b700 1 -- 172.21.15.115:0/3247735890 learned_addr learned my addr 172.21.15.115:0/3247735890 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:11.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae6a19c700 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd36590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.321+0000 7fae6919a700 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae6999b700 1 -- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 msgr2=0x56478fd36590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae6999b700 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd36590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae6999b700 1 -- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 msgr2=0x56478fd514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae6999b700 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae6999b700 1 -- 172.21.15.115:0/3247735890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56478fc4fee0 con 0x56478fd095c0 2023-07-27T14:28:11.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae6919a700 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:11.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae6999b700 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd05820 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fae60000c40 tx=0x7fae6002a070).ready entity=mon.0 client_cookie=fc42f355ade32dc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae4f1ff700 1 -- 172.21.15.115:0/3247735890 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000bb60 con 0x56478fd095c0 2023-07-27T14:28:11.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae4f1ff700 1 -- 172.21.15.115:0/3247735890 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae60028620 con 0x56478fd095c0 2023-07-27T14:28:11.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.322+0000 7fae4f1ff700 1 -- 172.21.15.115:0/3247735890 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000bcc0 con 0x56478fd095c0 2023-07-27T14:28:11.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3247735890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 msgr2=0x56478fd05820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd05820 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fae60000c40 tx=0x7fae6002a070).stop 2023-07-27T14:28:11.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3247735890 shutdown_connections 2023-07-27T14:28:11.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd28570 0x56478fd36590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd095c0 0x56478fd05820 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/3247735890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3247735890 >> 172.21.15.115:0/3247735890 conn(0x56478fb74940 msgr2=0x56478fd5d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:11.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3247735890 shutdown_connections 2023-07-27T14:28:11.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 -- 172.21.15.115:0/3247735890 wait complete. 2023-07-27T14:28:11.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.323+0000 7fae82f1fb80 1 -- start start 2023-07-27T14:28:11.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.324+0000 7fae82f1fb80 1 Processor -- start 2023-07-27T14:28:11.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.325+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fdb3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.325+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.325+0000 7fae82f1fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd28570 0x56478fdb8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.325+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478fd692e0 con 0x56478fd28570 2023-07-27T14:28:11.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.325+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x56478fdb7bf0 con 0x56478fd0bf60 2023-07-27T14:28:11.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.325+0000 7fae82f1fb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x56478fd30160 con 0x56478fd095c0 2023-07-27T14:28:11.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae82f1fb80 10 client.0 ll_register_callbacks cb 0x56478fc0e4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:28:11.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd28570 0x56478fdb8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd28570 0x56478fdb8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59350/0 (socket says 172.21.15.115:59350) 2023-07-27T14:28:11.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 -- 172.21.15.115:0/501959613 learned_addr learned my addr 172.21.15.115:0/501959613 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:11.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6919a700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6999b700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fdb3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 -- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 msgr2=0x56478fdb3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fdb3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 -- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 msgr2=0x56478fd687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 -- 172.21.15.115:0/501959613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56478fc50190 con 0x56478fd28570 2023-07-27T14:28:11.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6919a700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:11.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6999b700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fdb3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:11.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae6a19c700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd28570 0x56478fdb8080 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fae64064d00 tx=0x7fae5c003040).ready entity=mon.0 client_cookie=223ba5e9eb251868 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae43fff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:28:11.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae43fff700 1 -- 172.21.15.115:0/501959613 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0019d0 con 0x56478fd28570 2023-07-27T14:28:11.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.326+0000 7fae82f1fb80 1 -- 172.21.15.115:0/501959613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae5404d580 con 0x56478fd28570 2023-07-27T14:28:11.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae43fff700 1 -- 172.21.15.115:0/501959613 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fae5c001b30 con 0x56478fd28570 2023-07-27T14:28:11.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae43fff700 1 -- 172.21.15.115:0/501959613 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae5c002030 con 0x56478fd28570 2023-07-27T14:28:11.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae82f1fb80 10 client.5184 fetch_fsmap learned FSMap version 16 2023-07-27T14:28:11.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae82f1fb80 1 -- 172.21.15.115:0/501959613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56478faca1d0 con 0x56478fd28570 2023-07-27T14:28:11.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae43fff700 1 -- 172.21.15.115:0/501959613 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5404d580 con 0x56478fd28570 2023-07-27T14:28:11.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae43fff700 1 -- 172.21.15.115:0/501959613 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fae5c002190 con 0x56478fd28570 2023-07-27T14:28:11.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae82f1fb80 10 client.5184 fetch_fsmap finished waiting for FSMap version 16 2023-07-27T14:28:11.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae82f1fb80 10 client.5184 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:28:11.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae82f1fb80 20 client.5184 populate_metadata read hostname 'smithi115' 2023-07-27T14:28:11.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] conn(0x56478fd36590 0x56478fd36970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae82f1fb80 4 client.5184 mds_command: new command op to 4780 tid=0[{"prefix": "status"}] 2023-07-27T14:28:11.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae82f1fb80 1 -- 172.21.15.115:0/501959613 --> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56478fafa040 con 0x56478fd36590 2023-07-27T14:28:11.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.327+0000 7fae6999b700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] conn(0x56478fd36590 0x56478fd36970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae6999b700 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] conn(0x56478fd36590 0x56478fd36970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d546756c3477e21f server_cookie=d0fd6cde97fabaad in_seq=0 out_seq=0 2023-07-27T14:28:11.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae43fff700 10 client.5184 ms_handle_connect on v2:172.21.15.115:6834/770984486 2023-07-27T14:28:11.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae43fff700 1 -- 172.21.15.115:0/501959613 <== mds.0 v2:172.21.15.115:6834/770984486 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56478fafa040 con 0x56478fd36590 2023-07-27T14:28:11.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae43fff700 10 client.5184 handle_command_reply: tid=0 2023-07-27T14:28:11.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 client.5184 shutdown 2023-07-27T14:28:11.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 -- 172.21.15.115:0/501959613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd28570 msgr2=0x56478fdb8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd28570 0x56478fdb8080 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fae64064d00 tx=0x7fae5c003040).stop 2023-07-27T14:28:11.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 -- 172.21.15.115:0/501959613 shutdown_connections 2023-07-27T14:28:11.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.115:6834/770984486,v1:172.21.15.115:6837/770984486] conn(0x56478fd36590 0x56478fd36970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56478fd28570 0x56478fdb8080 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56478fd095c0 0x56478fdb3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 --2- 172.21.15.115:0/501959613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56478fd0bf60 0x56478fd687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae43fff700 0 client.5184 ms_handle_reset on v2:172.21.15.115:6834/770984486 2023-07-27T14:28:11.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 -- 172.21.15.115:0/501959613 >> 172.21.15.115:0/501959613 conn(0x56478fb74940 msgr2=0x56478fd075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:11.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 -- 172.21.15.115:0/501959613 shutdown_connections 2023-07-27T14:28:11.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 1 -- 172.21.15.115:0/501959613 wait complete. 2023-07-27T14:28:11.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.328+0000 7fae82f1fb80 20 client.5184 trim_cache size 0 max 16384 2023-07-27T14:28:11.356 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:28:11.356 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:28:11.356 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:28:11.356 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 4780, 2023-07-27T14:28:11.356 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:28:11.356 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:28:11.356 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:28:11.357 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2833337780000003, 2023-07-27T14:28:11.357 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 16, 2023-07-27T14:28:11.357 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 36, 2023-07-27T14:28:11.357 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 36, 2023-07-27T14:28:11.357 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 20.260563491999999 2023-07-27T14:28:11.357 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:28:11.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 -- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae4805ed60 msgr2=0x7fae48061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae4805ed60 0x7fae48061220 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fae60009130 tx=0x7fae60017000).stop 2023-07-27T14:28:11.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 -- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640aaa40 msgr2=0x7fae641508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640aaa40 0x7fae641508c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fae5400e980 tx=0x7fae54009060).stop 2023-07-27T14:28:11.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 -- 172.21.15.115:0/3974738975 shutdown_connections 2023-07-27T14:28:11.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae4805ed60 0x7fae48061220 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae64153ec0 0x7fae6414c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae640aa050 0x7fae64168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 --2- 172.21.15.115:0/3974738975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640aaa40 0x7fae641508c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 -- 172.21.15.115:0/3974738975 >> 172.21.15.115:0/3974738975 conn(0x7fae640cb610 msgr2=0x7fae640acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:11.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 -- 172.21.15.115:0/3974738975 shutdown_connections 2023-07-27T14:28:11.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.329+0000 7fae6bbff700 1 -- 172.21.15.115:0/3974738975 wait complete. 2023-07-27T14:28:11.363 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:28:11.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.503+0000 7f30759ff700 1 Processor -- start 2023-07-27T14:28:11.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.503+0000 7f30759ff700 1 -- start start 2023-07-27T14:28:11.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.504+0000 7f30759ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3070154f20 0x7f30700c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.504+0000 7f30759ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30700a48a0 0x7f30700a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.504+0000 7f30759ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700c12e0 con 0x7f3070065b30 2023-07-27T14:28:11.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.504+0000 7f30759ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30700c2e10 con 0x7f30700a48a0 2023-07-27T14:28:11.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.504+0000 7f30759ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30700a51c0 con 0x7f3070154f20 2023-07-27T14:28:11.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30700a48a0 0x7f30700a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30700a48a0 0x7f30700a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59360/0 (socket says 172.21.15.115:59360) 2023-07-27T14:28:11.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306f7fe700 1 -- 172.21.15.115:0/2395225844 learned_addr learned my addr 172.21.15.115:0/2395225844 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:11.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306e7fc700 1 --2- 172.21.15.115:0/2395225844 >> v2:172.21.15.159:3300/0 conn(0x7f3070154f20 0x7f30700c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306f7fe700 1 -- 172.21.15.115:0/2395225844 >> v2:172.21.15.159:3300/0 conn(0x7f3070154f20 msgr2=0x7f30700c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306f7fe700 1 --2- 172.21.15.115:0/2395225844 >> v2:172.21.15.159:3300/0 conn(0x7f3070154f20 0x7f30700c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306f7fe700 1 -- 172.21.15.115:0/2395225844 >> v1:172.21.15.159:6789/0 conn(0x7f3070065b30 legacy=0x7f30700c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:11.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306f7fe700 1 -- 172.21.15.115:0/2395225844 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30701553a0 con 0x7f30700a48a0 2023-07-27T14:28:11.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306f7fe700 1 --2- 172.21.15.115:0/2395225844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30700a48a0 0x7f30700a4cd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f307006a7f0 tx=0x7f3068009840).ready entity=mon.0 client_cookie=d5b6ed766267b376 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306dffb700 1 -- 172.21.15.115:0/2395225844 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800e070 con 0x7f30700a48a0 2023-07-27T14:28:11.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306dffb700 1 -- 172.21.15.115:0/2395225844 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800ba10 con 0x7f30700a48a0 2023-07-27T14:28:11.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.505+0000 7f306dffb700 1 -- 172.21.15.115:0/2395225844 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800bd90 con 0x7f30700a48a0 2023-07-27T14:28:11.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.506+0000 7f30759ff700 1 -- 172.21.15.115:0/2395225844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30700a48a0 msgr2=0x7f30700a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.506+0000 7f30759ff700 1 --2- 172.21.15.115:0/2395225844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30700a48a0 0x7f30700a4cd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f307006a7f0 tx=0x7f3068009840).stop 2023-07-27T14:28:11.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.506+0000 7f30759ff700 1 -- 172.21.15.115:0/2395225844 shutdown_connections 2023-07-27T14:28:11.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.506+0000 7f30759ff700 1 --2- 172.21.15.115:0/2395225844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30700a48a0 0x7f30700a4cd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.506+0000 7f30759ff700 1 --2- 172.21.15.115:0/2395225844 >> v2:172.21.15.159:3300/0 conn(0x7f3070154f20 0x7f30700c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.506+0000 7f30759ff700 1 -- 172.21.15.115:0/2395225844 >> 172.21.15.115:0/2395225844 conn(0x7f3070062ec0 msgr2=0x7f30700c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:11.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.506+0000 7f30759ff700 1 -- 172.21.15.115:0/2395225844 shutdown_connections 2023-07-27T14:28:11.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.506+0000 7f30759ff700 1 -- 172.21.15.115:0/2395225844 wait complete. 2023-07-27T14:28:11.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.508+0000 7f30759ff700 1 Processor -- start 2023-07-27T14:28:11.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.508+0000 7f30759ff700 1 -- start start 2023-07-27T14:28:11.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f30759ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3070065b30 0x7f3070159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f30759ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30700a48a0 0x7f30701569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f30759ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3070154f20 0x7f30700bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f30759ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700c4ba0 con 0x7f3070065b30 2023-07-27T14:28:11.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f30759ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070156ec0 con 0x7f30700a48a0 2023-07-27T14:28:11.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f30759ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30700be890 con 0x7f3070154f20 2023-07-27T14:28:11.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3070065b30 0x7f3070159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3070065b30 0x7f3070159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59372/0 (socket says 172.21.15.115:59372) 2023-07-27T14:28:11.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306effd700 1 -- 172.21.15.115:0/636198781 learned_addr learned my addr 172.21.15.115:0/636198781 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:11.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306e7fc700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30700a48a0 0x7f30701569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306f7fe700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3070154f20 0x7f30700bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306effd700 1 -- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3070154f20 msgr2=0x7f30700bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306effd700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3070154f20 0x7f30700bff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306effd700 1 -- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30700a48a0 msgr2=0x7f30701569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306effd700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30700a48a0 0x7f30701569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306effd700 1 -- 172.21.15.115:0/636198781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009ae0 con 0x7f3070065b30 2023-07-27T14:28:11.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306e7fc700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30700a48a0 0x7f30701569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:11.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.509+0000 7f306f7fe700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3070154f20 0x7f30700bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:11.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.510+0000 7f306effd700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3070065b30 0x7f3070159630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f306000b490 tx=0x7f3060006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.510+0000 7f3056ffd700 1 -- 172.21.15.115:0/636198781 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060012410 con 0x7f3070065b30 2023-07-27T14:28:11.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.510+0000 7f3056ffd700 1 -- 172.21.15.115:0/636198781 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060012590 con 0x7f3070065b30 2023-07-27T14:28:11.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.510+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3070157120 con 0x7f3070065b30 2023-07-27T14:28:11.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.510+0000 7f3056ffd700 1 -- 172.21.15.115:0/636198781 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060012950 con 0x7f3070065b30 2023-07-27T14:28:11.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.510+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30701576e0 con 0x7f3070065b30 2023-07-27T14:28:11.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.511+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307005f0c0 con 0x7f3070065b30 2023-07-27T14:28:11.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.512+0000 7f3056ffd700 1 -- 172.21.15.115:0/636198781 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f306000f030 con 0x7f3070065b30 2023-07-27T14:28:11.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.513+0000 7f3056ffd700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f305c05ed60 0x7f305c061220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:11.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.513+0000 7f3056ffd700 1 -- 172.21.15.115:0/636198781 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f30600798c0 con 0x7f3070065b30 2023-07-27T14:28:11.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.513+0000 7f306e7fc700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f305c05ed60 0x7f305c061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:11.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.513+0000 7f306e7fc700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f305c05ed60 0x7f305c061220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f30700c0870 tx=0x7f3064008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:11.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.517+0000 7f3056ffd700 1 -- 172.21.15.115:0/636198781 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f306004ad50 con 0x7f3070065b30 2023-07-27T14:28:11.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.727+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3070063400 con 0x7f3070065b30 2023-07-27T14:28:11.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.728+0000 7f3056ffd700 1 -- 172.21.15.115:0/636198781 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f306004e370 con 0x7f3070065b30 2023-07-27T14:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:28:11.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f305c05ed60 msgr2=0x7f305c061220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f305c05ed60 0x7f305c061220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f30700c0870 tx=0x7f3064008040).stop 2023-07-27T14:28:11.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3070065b30 msgr2=0x7f3070159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:11.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3070065b30 0x7f3070159630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f306000b490 tx=0x7f3060006f20).stop 2023-07-27T14:28:11.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 shutdown_connections 2023-07-27T14:28:11.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f305c05ed60 0x7f305c061220 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3070154f20 0x7f30700bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3070065b30 0x7f3070159630 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 --2- 172.21.15.115:0/636198781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30700a48a0 0x7f30701569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:11.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 >> 172.21.15.115:0/636198781 conn(0x7f3070062ec0 msgr2=0x7f3070154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:11.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 shutdown_connections 2023-07-27T14:28:11.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:11.730+0000 7f30759ff700 1 -- 172.21.15.115:0/636198781 wait complete. 2023-07-27T14:28:11.762 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:28:11.763 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:28:11.763 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:28:11.763 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:28:11.764 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:28:11.764 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:28:11.764 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:28:11.765 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:28:11.765 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:28:11.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:11.765 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:28:11.814 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:28:11.814 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:11.814 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:28:11.814 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:11.814 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:28:11.815 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41910sec preferred_lft 41910sec 2023-07-27T14:28:11.815 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:28:11.815 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:11.816 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:28:11.816 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:11.816 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:28:11.816 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:11.816 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:28:11.816 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:11.817 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:28:11.817 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:28:11.817 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:28:11.817 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:11.817 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:28:11.818 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:28:11.818 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:28:11.818 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:11.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:11.819 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:28:11.886 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:28:11.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:11.889 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:28:11.937 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:28:11.937 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:28:11.938 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:28:11.938 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:28:11.938 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:28:11.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:11.939 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:28:11.939 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:28:11.939 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:28:11.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:28:11.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:28:11.940 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:28:12.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:12.109 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:28:12.155 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:28:12.156 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:28:12.157 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:28:12.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:12.157 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:28:12.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:12.227 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:28:12.273 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:28:12.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:28:12.409 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:28:12.409 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:28:12.436 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:28:12.436 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:28:12.442 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:28:12.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:12.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:28:12.514 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:28:12.687 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.669+0000 7f31c19ff700 1 Processor -- start 2023-07-27T14:28:12.687 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.669+0000 7f31c19ff700 1 -- start start 2023-07-27T14:28:12.688 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31c19ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f31bc154190 0x7f31bc0a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:12.689 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31c19ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0648e0 0x7f31bc154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:12.689 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31c19ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc158e00 con 0x7f31bc0c64b0 2023-07-27T14:28:12.689 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31c19ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc0aa640 con 0x7f31bc154190 2023-07-27T14:28:12.689 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31c19ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc158040 con 0x7f31bc0648e0 2023-07-27T14:28:12.689 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31ba7fc700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f31bc0c64b0 0x7f31bc0641d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:58718/0 (socket says 172.21.15.159:58718) 2023-07-27T14:28:12.689 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31ba7fc700 1 -- 172.21.15.159:0/1189035152 learned_addr learned my addr 172.21.15.159:0/1189035152 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:28:12.689 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31bb7fe700 1 --2- 172.21.15.159:0/1189035152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0648e0 0x7f31bc154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:12.690 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.670+0000 7f31baffd700 1 --2- 172.21.15.159:0/1189035152 >> v2:172.21.15.115:3300/0 conn(0x7f31bc154190 0x7f31bc0a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:12.691 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31b9ffb700 1 -- 172.21.15.159:0/1189035152 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163894816 0 0) 0x7f31bc158e00 con 0x7f31bc0c64b0 2023-07-27T14:28:12.691 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31b9ffb700 1 -- 172.21.15.159:0/1189035152 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a40033f0 con 0x7f31bc0c64b0 2023-07-27T14:28:12.691 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31bb7fe700 1 -- 172.21.15.159:0/1189035152 >> v2:172.21.15.115:3300/0 conn(0x7f31bc154190 msgr2=0x7f31bc0a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:12.691 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31bb7fe700 1 --2- 172.21.15.159:0/1189035152 >> v2:172.21.15.115:3300/0 conn(0x7f31bc154190 0x7f31bc0a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.691 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31bb7fe700 1 -- 172.21.15.159:0/1189035152 >> v1:172.21.15.159:6789/0 conn(0x7f31bc0c64b0 legacy=0x7f31bc0641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:12.692 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31bb7fe700 1 -- 172.21.15.159:0/1189035152 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc158320 con 0x7f31bc0648e0 2023-07-27T14:28:12.692 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31bb7fe700 1 --2- 172.21.15.159:0/1189035152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0648e0 0x7f31bc154570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f31b4009e60 tx=0x7f31b4009780).ready entity=mon.2 client_cookie=6a4fafbb81f773fe server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:12.692 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31b9ffb700 1 -- 172.21.15.159:0/1189035152 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400e070 con 0x7f31bc0648e0 2023-07-27T14:28:12.692 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31b9ffb700 1 -- 172.21.15.159:0/1189035152 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b400bab0 con 0x7f31bc0648e0 2023-07-27T14:28:12.692 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.671+0000 7f31b9ffb700 1 -- 172.21.15.159:0/1189035152 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400be30 con 0x7f31bc0648e0 2023-07-27T14:28:12.692 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.672+0000 7f31c19ff700 1 -- 172.21.15.159:0/1189035152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0648e0 msgr2=0x7f31bc154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:12.692 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.672+0000 7f31c19ff700 1 --2- 172.21.15.159:0/1189035152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0648e0 0x7f31bc154570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f31b4009e60 tx=0x7f31b4009780).stop 2023-07-27T14:28:12.693 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.672+0000 7f31c19ff700 1 -- 172.21.15.159:0/1189035152 shutdown_connections 2023-07-27T14:28:12.693 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.672+0000 7f31c19ff700 1 --2- 172.21.15.159:0/1189035152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0648e0 0x7f31bc154570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.693 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.672+0000 7f31c19ff700 1 --2- 172.21.15.159:0/1189035152 >> v2:172.21.15.115:3300/0 conn(0x7f31bc154190 0x7f31bc0a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.693 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.672+0000 7f31c19ff700 1 -- 172.21.15.159:0/1189035152 >> 172.21.15.159:0/1189035152 conn(0x7f31bc0cb730 msgr2=0x7f31bc0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:12.693 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.672+0000 7f31c19ff700 1 -- 172.21.15.159:0/1189035152 shutdown_connections 2023-07-27T14:28:12.693 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.672+0000 7f31c19ff700 1 -- 172.21.15.159:0/1189035152 wait complete. 2023-07-27T14:28:12.695 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.673+0000 7f31c19ff700 1 Processor -- start 2023-07-27T14:28:12.695 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.674+0000 7f31c19ff700 1 -- start start 2023-07-27T14:28:12.695 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.674+0000 7f31c19ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31bc0648e0 0x7f31bc0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:12.695 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.674+0000 7f31c19ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0c64b0 0x7f31bc163950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:12.695 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.674+0000 7f31c19ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc154190 0x7f31bc159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.674+0000 7f31c19ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0af100 con 0x7f31bc0648e0 2023-07-27T14:28:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.674+0000 7f31c19ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0abe60 con 0x7f31bc154190 2023-07-27T14:28:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.674+0000 7f31c19ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0afc60 con 0x7f31bc0c64b0 2023-07-27T14:28:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc154190 0x7f31bc159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31ba7fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0c64b0 0x7f31bc163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc154190 0x7f31bc159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:32778/0 (socket says 172.21.15.159:32778) 2023-07-27T14:28:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 -- 172.21.15.159:0/4124017492 learned_addr learned my addr 172.21.15.159:0/4124017492 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:28:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31baffd700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31bc0648e0 0x7f31bc0b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 -- 172.21.15.159:0/4124017492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0c64b0 msgr2=0x7f31bc163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0c64b0 0x7f31bc163950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 -- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31bc0648e0 msgr2=0x7f31bc0b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31bc0648e0 0x7f31bc0b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 -- 172.21.15.159:0/4124017492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4009a20 con 0x7f31bc154190 2023-07-27T14:28:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31baffd700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31bc0648e0 0x7f31bc0b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:12.698 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31bb7fe700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc154190 0x7f31bc159fb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f31b400b610 tx=0x7f31b4009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:12.698 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.675+0000 7f31a2ffd700 1 -- 172.21.15.159:0/4124017492 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4007080 con 0x7f31bc154190 2023-07-27T14:28:12.698 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.676+0000 7f31a2ffd700 1 -- 172.21.15.159:0/4124017492 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b401d630 con 0x7f31bc154190 2023-07-27T14:28:12.698 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.676+0000 7f31a2ffd700 1 -- 172.21.15.159:0/4124017492 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b401d9d0 con 0x7f31bc154190 2023-07-27T14:28:12.698 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.676+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc0af330 con 0x7f31bc154190 2023-07-27T14:28:12.698 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.676+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc0af8f0 con 0x7f31bc154190 2023-07-27T14:28:12.698 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.677+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc05f0c0 con 0x7f31bc154190 2023-07-27T14:28:12.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.678+0000 7f31a2ffd700 1 -- 172.21.15.159:0/4124017492 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f31b401dd40 con 0x7f31bc154190 2023-07-27T14:28:12.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.679+0000 7f31a2ffd700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31a805ed90 0x7f31a8061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:12.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.679+0000 7f31a2ffd700 1 -- 172.21.15.159:0/4124017492 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f31b407bb60 con 0x7f31bc154190 2023-07-27T14:28:12.699 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.679+0000 7f31baffd700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31a805ed90 0x7f31a8061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:12.700 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.680+0000 7f31baffd700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31a805ed90 0x7f31a8061250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f31ac006d80 tx=0x7f31ac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.684+0000 7f31a2ffd700 1 -- 172.21.15.159:0/4124017492 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31b404d100 con 0x7f31bc154190 2023-07-27T14:28:12.911 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.893+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31bc0afda0 con 0x7f31bc154190 2023-07-27T14:28:12.912 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.894+0000 7f31a2ffd700 1 -- 172.21.15.159:0/4124017492 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31b4050720 con 0x7f31bc154190 2023-07-27T14:28:12.912 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:28:12.914 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31a805ed90 msgr2=0x7f31a8061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:12.914 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31a805ed90 0x7f31a8061250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f31ac006d80 tx=0x7f31ac008040).stop 2023-07-27T14:28:12.914 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc154190 msgr2=0x7f31bc159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc154190 0x7f31bc159fb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f31b400b610 tx=0x7f31b4009780).stop 2023-07-27T14:28:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 shutdown_connections 2023-07-27T14:28:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31a805ed90 0x7f31a8061250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc154190 0x7f31bc159fb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31bc0648e0 0x7f31bc0b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 --2- 172.21.15.159:0/4124017492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31bc0c64b0 0x7f31bc163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 >> 172.21.15.159:0/4124017492 conn(0x7f31bc0cb730 msgr2=0x7f31bc0c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 shutdown_connections 2023-07-27T14:28:12.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:28:12.896+0000 7f31c19ff700 1 -- 172.21.15.159:0/4124017492 wait complete. 2023-07-27T14:28:12.928 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:28:12.929 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:28:12.929 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:28:12.929 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:28:12.930 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:28:12.930 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:28:12.930 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:28:12.931 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:28:12.931 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:28:12.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:12.932 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:28:12.978 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:28:12.979 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:28:12.979 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:28:12.979 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:12.979 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:28:12.979 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:12.980 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:28:12.980 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:12.980 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:28:12.980 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:28:12.980 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:12.980 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:28:12.981 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:28:12.981 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:12.981 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:28:12.981 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:12.981 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:28:12.982 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41904sec preferred_lft 41904sec 2023-07-27T14:28:12.982 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:28:12.982 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:12.982 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:28:12.982 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:28:12.982 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:28:12.982 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:12.982 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:28:12.983 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:12.983 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:28:12.983 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:28:12.983 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:28:12.983 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:12.983 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:28:12.983 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:28:12.984 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:28:12.984 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:28:12.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:12.985 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:28:13.053 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:28:13.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:13.057 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:28:13.107 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:28:13.107 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:28:13.107 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:28:13.107 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:28:13.107 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:28:13.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:13.109 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:28:13.109 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:28:13.110 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:28:13.110 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:28:13.110 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:28:13.111 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:28:13.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:13.282 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:28:13.329 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:28:13.329 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:28:13.330 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:28:13.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:13.331 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:28:13.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:13.401 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:28:13.447 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:28:13.448 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:28:13.546 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:28:13.547 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:28:13.577 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:28:13.577 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:28:13.582 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:28:13.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:13.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:28:13.653 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:28:13.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.836+0000 7f4cca9ff700 1 Processor -- start 2023-07-27T14:28:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.837+0000 7f4cca9ff700 1 -- start start 2023-07-27T14:28:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.838+0000 7f4cca9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.838+0000 7f4cca9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc4064a80 con 0x7f4cc4065de0 2023-07-27T14:28:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.838+0000 7f4cca9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc4064d60 con 0x7f4cc4064230 2023-07-27T14:28:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.838+0000 7f4cca9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4062320 con 0x7f4cc4153e00 2023-07-27T14:28:13.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.838+0000 7f4cc8f9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4cc4065de0 0x7f4cc4062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57686/0 (socket says 172.21.15.115:57686) 2023-07-27T14:28:13.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.838+0000 7f4cc8f9c700 1 -- 172.21.15.115:0/2250227869 learned_addr learned my addr 172.21.15.115:0/2250227869 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:13.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.838+0000 7f4cc3fff700 1 --2- 172.21.15.115:0/2250227869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc2ffd700 1 -- 172.21.15.115:0/2250227869 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314026227 0 0) 0x7f4cc4064a80 con 0x7f4cc4065de0 2023-07-27T14:28:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc2ffd700 1 -- 172.21.15.115:0/2250227869 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cac0033f0 con 0x7f4cc4065de0 2023-07-27T14:28:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc2ffd700 1 -- 172.21.15.115:0/2250227869 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954838641 0 0) 0x7f4cc4064d60 con 0x7f4cc4064230 2023-07-27T14:28:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc2ffd700 1 -- 172.21.15.115:0/2250227869 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc4064a80 con 0x7f4cc4064230 2023-07-27T14:28:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc3fff700 1 -- 172.21.15.115:0/2250227869 >> v1:172.21.15.159:6789/0 conn(0x7f4cc4064230 legacy=0x7f4cc40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc3fff700 1 -- 172.21.15.115:0/2250227869 >> v1:172.21.15.115:6789/0 conn(0x7f4cc4065de0 legacy=0x7f4cc4062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc3fff700 1 -- 172.21.15.115:0/2250227869 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc4065040 con 0x7f4cc4153e00 2023-07-27T14:28:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc3fff700 1 --2- 172.21.15.115:0/2250227869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c6b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4cb4009790 tx=0x7f4cb4009060).ready entity=mon.2 client_cookie=59d9d4a070c6faa8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc2ffd700 1 -- 172.21.15.115:0/2250227869 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400f510 con 0x7f4cc4153e00 2023-07-27T14:28:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc2ffd700 1 -- 172.21.15.115:0/2250227869 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb400f670 con 0x7f4cc4153e00 2023-07-27T14:28:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.839+0000 7f4cc2ffd700 1 -- 172.21.15.115:0/2250227869 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400f9f0 con 0x7f4cc4153e00 2023-07-27T14:28:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.840+0000 7f4cca9ff700 1 -- 172.21.15.115:0/2250227869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 msgr2=0x7f4cc40c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.840+0000 7f4cca9ff700 1 --2- 172.21.15.115:0/2250227869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c6b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4cb4009790 tx=0x7f4cb4009060).stop 2023-07-27T14:28:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.840+0000 7f4cca9ff700 1 -- 172.21.15.115:0/2250227869 shutdown_connections 2023-07-27T14:28:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.840+0000 7f4cca9ff700 1 --2- 172.21.15.115:0/2250227869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c6b70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.840+0000 7f4cca9ff700 1 -- 172.21.15.115:0/2250227869 >> 172.21.15.115:0/2250227869 conn(0x7f4cc40c7b90 msgr2=0x7f4cc40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.840+0000 7f4cca9ff700 1 -- 172.21.15.115:0/2250227869 shutdown_connections 2023-07-27T14:28:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.840+0000 7f4cca9ff700 1 -- 172.21.15.115:0/2250227869 wait complete. 2023-07-27T14:28:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.841+0000 7f4cca9ff700 1 Processor -- start 2023-07-27T14:28:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.842+0000 7f4cca9ff700 1 -- start start 2023-07-27T14:28:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.842+0000 7f4cca9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc4064230 0x7f4cc4151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.842+0000 7f4cca9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc4065de0 0x7f4cc40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cca9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cca9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4151a20 con 0x7f4cc4065de0 2023-07-27T14:28:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cca9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4092810 con 0x7f4cc4064230 2023-07-27T14:28:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cca9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4092af0 con 0x7f4cc4153e00 2023-07-27T14:28:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc4065de0 0x7f4cc40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc4065de0 0x7f4cc40c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56848/0 (socket says 172.21.15.115:56848) 2023-07-27T14:28:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 -- 172.21.15.115:0/1457606173 learned_addr learned my addr 172.21.15.115:0/1457606173 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc3fff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc4064230 0x7f4cc4151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc8f9c700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 -- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 msgr2=0x7f4cc40c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 -- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc4064230 msgr2=0x7f4cc4151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc4064230 0x7f4cc4151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 -- 172.21.15.115:0/1457606173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb40092a0 con 0x7f4cc4065de0 2023-07-27T14:28:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc3fff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc4064230 0x7f4cc4151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.843+0000 7f4cc37fe700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc4065de0 0x7f4cc40c0a50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f4cb800c490 tx=0x7f4cb8007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.844+0000 7f4cabfff700 1 -- 172.21.15.115:0/1457606173 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800f470 con 0x7f4cc4065de0 2023-07-27T14:28:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.844+0000 7f4cabfff700 1 -- 172.21.15.115:0/1457606173 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb800f5d0 con 0x7f4cc4065de0 2023-07-27T14:28:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.844+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc4092dd0 con 0x7f4cc4065de0 2023-07-27T14:28:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.844+0000 7f4cabfff700 1 -- 172.21.15.115:0/1457606173 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800f990 con 0x7f4cc4065de0 2023-07-27T14:28:13.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.844+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc4093390 con 0x7f4cc4065de0 2023-07-27T14:28:13.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.845+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc40935b0 con 0x7f4cc4065de0 2023-07-27T14:28:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.846+0000 7f4cabfff700 1 -- 172.21.15.115:0/1457606173 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f4cb8019030 con 0x7f4cc4065de0 2023-07-27T14:28:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.846+0000 7f4cabfff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4cb005ed90 0x7f4cb0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.846+0000 7f4cabfff700 1 -- 172.21.15.115:0/1457606173 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4cb8079140 con 0x7f4cc4065de0 2023-07-27T14:28:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.847+0000 7f4cc3fff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4cb005ed90 0x7f4cb0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:13.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.847+0000 7f4cc3fff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4cb005ed90 0x7f4cb0061250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f4cb4009fd0 tx=0x7f4cb4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:13.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:13.850+0000 7f4cabfff700 1 -- 172.21.15.115:0/1457606173 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4cb804a5d0 con 0x7f4cc4065de0 2023-07-27T14:28:14.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.061+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4cc406c470 con 0x7f4cc4065de0 2023-07-27T14:28:14.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.563+0000 7f4cabfff700 1 -- 172.21.15.115:0/1457606173 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4cb804dbf0 con 0x7f4cc4065de0 2023-07-27T14:28:14.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4cb005ed90 msgr2=0x7f4cb0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:14.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4cb005ed90 0x7f4cb0061250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f4cb4009fd0 tx=0x7f4cb4017000).stop 2023-07-27T14:28:14.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc4065de0 msgr2=0x7f4cc40c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:14.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc4065de0 0x7f4cc40c0a50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f4cb800c490 tx=0x7f4cb8007c60).stop 2023-07-27T14:28:14.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 shutdown_connections 2023-07-27T14:28:14.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4cb005ed90 0x7f4cb0061250 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc4153e00 0x7f4cc40c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc4064230 0x7f4cc4151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 --2- 172.21.15.115:0/1457606173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc4065de0 0x7f4cc40c0a50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 >> 172.21.15.115:0/1457606173 conn(0x7f4cc40c7b90 msgr2=0x7f4cc4152220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:14.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 shutdown_connections 2023-07-27T14:28:14.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.566+0000 7f4cca9ff700 1 -- 172.21.15.115:0/1457606173 wait complete. 2023-07-27T14:28:14.604 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:28:14.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.775+0000 7fd6135ff700 1 Processor -- start 2023-07-27T14:28:14.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.775+0000 7fd6135ff700 1 -- start start 2023-07-27T14:28:14.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd6135ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd60c0aaa40 0x7fd60c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:14.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd6135ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd60c1542a0 0x7fd60c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:14.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd6135ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0aa4d0 con 0x7fd60c153ec0 2023-07-27T14:28:14.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd6135ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c064ad0 con 0x7fd60c1542a0 2023-07-27T14:28:14.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd6135ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0c05c0 con 0x7fd60c0aaa40 2023-07-27T14:28:14.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd61139b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd60c153ec0 0x7fd60c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57700/0 (socket says 172.21.15.115:57700) 2023-07-27T14:28:14.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd61139b700 1 -- 172.21.15.115:0/1177831731 learned_addr learned my addr 172.21.15.115:0/1177831731 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:14.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd611b9c700 1 --2- 172.21.15.115:0/1177831731 >> v2:172.21.15.115:3300/0 conn(0x7fd60c1542a0 0x7fd60c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:14.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd610b9a700 1 --2- 172.21.15.115:0/1177831731 >> v2:172.21.15.159:3300/0 conn(0x7fd60c0aaa40 0x7fd60c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:14.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd603fff700 1 -- 172.21.15.115:0/1177831731 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477185566 0 0) 0x7fd608001110 con 0x7fd60c153ec0 2023-07-27T14:28:14.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.777+0000 7fd603fff700 1 -- 172.21.15.115:0/1177831731 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f80033f0 con 0x7fd60c153ec0 2023-07-27T14:28:14.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd611b9c700 1 -- 172.21.15.115:0/1177831731 >> v2:172.21.15.159:3300/0 conn(0x7fd60c0aaa40 msgr2=0x7fd60c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:14.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd611b9c700 1 --2- 172.21.15.115:0/1177831731 >> v2:172.21.15.159:3300/0 conn(0x7fd60c0aaa40 0x7fd60c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd611b9c700 1 -- 172.21.15.115:0/1177831731 >> v1:172.21.15.115:6789/0 conn(0x7fd60c153ec0 legacy=0x7fd60c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:14.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd611b9c700 1 -- 172.21.15.115:0/1177831731 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0c1a60 con 0x7fd60c1542a0 2023-07-27T14:28:14.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd611b9c700 1 --2- 172.21.15.115:0/1177831731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0645e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fd60c06c0d0 tx=0x7fd604009780).ready entity=mon.0 client_cookie=ad7d7b545c64a313 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:14.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd603fff700 1 -- 172.21.15.115:0/1177831731 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400e070 con 0x7fd60c1542a0 2023-07-27T14:28:14.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd603fff700 1 -- 172.21.15.115:0/1177831731 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60400bab0 con 0x7fd60c1542a0 2023-07-27T14:28:14.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd603fff700 1 -- 172.21.15.115:0/1177831731 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400be30 con 0x7fd60c1542a0 2023-07-27T14:28:14.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd6135ff700 1 -- 172.21.15.115:0/1177831731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 msgr2=0x7fd60c0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:14.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1177831731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0645e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fd60c06c0d0 tx=0x7fd604009780).stop 2023-07-27T14:28:14.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd6135ff700 1 -- 172.21.15.115:0/1177831731 shutdown_connections 2023-07-27T14:28:14.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.778+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1177831731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0645e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.779+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1177831731 >> v2:172.21.15.159:3300/0 conn(0x7fd60c0aaa40 0x7fd60c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.779+0000 7fd6135ff700 1 -- 172.21.15.115:0/1177831731 >> 172.21.15.115:0/1177831731 conn(0x7fd60c0cb610 msgr2=0x7fd60c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:14.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.779+0000 7fd6135ff700 1 -- 172.21.15.115:0/1177831731 shutdown_connections 2023-07-27T14:28:14.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.779+0000 7fd6135ff700 1 -- 172.21.15.115:0/1177831731 wait complete. 2023-07-27T14:28:14.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.781+0000 7fd6135ff700 1 Processor -- start 2023-07-27T14:28:14.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.781+0000 7fd6135ff700 1 -- start start 2023-07-27T14:28:14.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd6135ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd60c0aaa40 0x7fd60c142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:14.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd6135ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c153ec0 0x7fd60c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:14.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd6135ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:14.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd6135ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0c48a0 con 0x7fd60c1542a0 2023-07-27T14:28:14.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd6135ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c164060 con 0x7fd60c153ec0 2023-07-27T14:28:14.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd6135ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c152110 con 0x7fd60c0aaa40 2023-07-27T14:28:14.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd611b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:14.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd611b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56876/0 (socket says 172.21.15.115:56876) 2023-07-27T14:28:14.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd611b9c700 1 -- 172.21.15.115:0/1509883400 learned_addr learned my addr 172.21.15.115:0/1509883400 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:14.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd61139b700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd60c0aaa40 0x7fd60c142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:14.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.782+0000 7fd610b9a700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c153ec0 0x7fd60c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:14.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd611b9c700 1 -- 172.21.15.115:0/1509883400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd60c0aaa40 msgr2=0x7fd60c142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:14.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd611b9c700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd60c0aaa40 0x7fd60c142a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd611b9c700 1 -- 172.21.15.115:0/1509883400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c153ec0 msgr2=0x7fd60c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd611b9c700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c153ec0 0x7fd60c152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd611b9c700 1 -- 172.21.15.115:0/1509883400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604009a20 con 0x7fd60c1542a0 2023-07-27T14:28:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd611b9c700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0c5790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fd604011000 tx=0x7fd60c0c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd6017fa700 1 -- 172.21.15.115:0/1509883400 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604012e70 con 0x7fd60c1542a0 2023-07-27T14:28:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd6017fa700 1 -- 172.21.15.115:0/1509883400 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60401d630 con 0x7fd60c1542a0 2023-07-27T14:28:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd6017fa700 1 -- 172.21.15.115:0/1509883400 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60401d9d0 con 0x7fd60c1542a0 2023-07-27T14:28:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c151500 con 0x7fd60c1542a0 2023-07-27T14:28:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.783+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c151ac0 con 0x7fd60c1542a0 2023-07-27T14:28:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.784+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c06c470 con 0x7fd60c1542a0 2023-07-27T14:28:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.785+0000 7fd6017fa700 1 -- 172.21.15.115:0/1509883400 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fd604026410 con 0x7fd60c1542a0 2023-07-27T14:28:14.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.786+0000 7fd6017fa700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd5f005ed90 0x7fd5f0061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:14.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.786+0000 7fd6017fa700 1 -- 172.21.15.115:0/1509883400 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd60407ba60 con 0x7fd60c1542a0 2023-07-27T14:28:14.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.786+0000 7fd61139b700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd5f005ed90 0x7fd5f0061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:14.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.787+0000 7fd61139b700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd5f005ed90 0x7fd5f0061250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fd60c14f7d0 tx=0x7fd608007a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:14.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.790+0000 7fd6017fa700 1 -- 172.21.15.115:0/1509883400 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd60404ce90 con 0x7fd60c1542a0 2023-07-27T14:28:15.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.984+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd60c062540 con 0x7fd5f005ed90 2023-07-27T14:28:15.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.985+0000 7fd6017fa700 1 -- 172.21.15.115:0/1509883400 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd60c062540 con 0x7fd5f005ed90 2023-07-27T14:28:15.004 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:28:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:28:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:28:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:15.005 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:28:15.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.987+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd5f005ed90 msgr2=0x7fd5f0061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.987+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd5f005ed90 0x7fd5f0061250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fd60c14f7d0 tx=0x7fd608007a70).stop 2023-07-27T14:28:15.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.987+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 msgr2=0x7fd60c0c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.987+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0c5790 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fd604011000 tx=0x7fd60c0c0530).stop 2023-07-27T14:28:15.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.988+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 shutdown_connections 2023-07-27T14:28:15.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.988+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd5f005ed90 0x7fd5f0061250 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.988+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd60c1542a0 0x7fd60c0c5790 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.988+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd60c0aaa40 0x7fd60c142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.988+0000 7fd6135ff700 1 --2- 172.21.15.115:0/1509883400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c153ec0 0x7fd60c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.988+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 >> 172.21.15.115:0/1509883400 conn(0x7fd60c0cb610 msgr2=0x7fd60c0ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:15.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.988+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 shutdown_connections 2023-07-27T14:28:15.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:14.988+0000 7fd6135ff700 1 -- 172.21.15.115:0/1509883400 wait complete. 2023-07-27T14:28:15.024 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:28:15.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.195+0000 7fb0695ff700 1 Processor -- start 2023-07-27T14:28:15.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.195+0000 7fb0695ff700 1 -- start start 2023-07-27T14:28:15.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.196+0000 7fb0695ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb06414ae00 0x7fb064154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.196+0000 7fb0695ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb064063260 0x7fb0640a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.196+0000 7fb0695ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0641553f0 con 0x7fb06414b1e0 2023-07-27T14:28:15.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.196+0000 7fb0695ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb064157a50 con 0x7fb064063260 2023-07-27T14:28:15.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.196+0000 7fb0695ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb064157d10 con 0x7fb06414ae00 2023-07-27T14:28:15.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb0627fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb06414b1e0 0x7fb064062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57704/0 (socket says 172.21.15.115:57704) 2023-07-27T14:28:15.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb0627fc700 1 -- 172.21.15.115:0/4137128483 learned_addr learned my addr 172.21.15.115:0/4137128483 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:15.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb0637fe700 1 --2- 172.21.15.115:0/4137128483 >> v2:172.21.15.115:3300/0 conn(0x7fb064063260 0x7fb0640a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb062ffd700 1 --2- 172.21.15.115:0/4137128483 >> v2:172.21.15.159:3300/0 conn(0x7fb06414ae00 0x7fb064154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb061ffb700 1 -- 172.21.15.115:0/4137128483 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068475479 0 0) 0x7fb0641553f0 con 0x7fb06414b1e0 2023-07-27T14:28:15.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb061ffb700 1 -- 172.21.15.115:0/4137128483 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb04c0033f0 con 0x7fb06414b1e0 2023-07-27T14:28:15.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb0637fe700 1 -- 172.21.15.115:0/4137128483 >> v2:172.21.15.159:3300/0 conn(0x7fb06414ae00 msgr2=0x7fb064154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:15.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb0637fe700 1 --2- 172.21.15.115:0/4137128483 >> v2:172.21.15.159:3300/0 conn(0x7fb06414ae00 0x7fb064154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb0637fe700 1 -- 172.21.15.115:0/4137128483 >> v1:172.21.15.115:6789/0 conn(0x7fb06414b1e0 legacy=0x7fb064062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb0637fe700 1 -- 172.21.15.115:0/4137128483 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064157ff0 con 0x7fb064063260 2023-07-27T14:28:15.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.197+0000 7fb0637fe700 1 --2- 172.21.15.115:0/4137128483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640a98c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fb0640caaf0 tx=0x7fb05c009780).ready entity=mon.0 client_cookie=e4a8dcac81bfcc0c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:15.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb061ffb700 1 -- 172.21.15.115:0/4137128483 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00e070 con 0x7fb064063260 2023-07-27T14:28:15.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb061ffb700 1 -- 172.21.15.115:0/4137128483 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c00bb60 con 0x7fb064063260 2023-07-27T14:28:15.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb061ffb700 1 -- 172.21.15.115:0/4137128483 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c012410 con 0x7fb064063260 2023-07-27T14:28:15.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb0695ff700 1 -- 172.21.15.115:0/4137128483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 msgr2=0x7fb0640a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb0695ff700 1 --2- 172.21.15.115:0/4137128483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640a98c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fb0640caaf0 tx=0x7fb05c009780).stop 2023-07-27T14:28:15.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb0695ff700 1 -- 172.21.15.115:0/4137128483 shutdown_connections 2023-07-27T14:28:15.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb0695ff700 1 --2- 172.21.15.115:0/4137128483 >> v2:172.21.15.159:3300/0 conn(0x7fb06414ae00 0x7fb064154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb0695ff700 1 --2- 172.21.15.115:0/4137128483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640a98c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb0695ff700 1 -- 172.21.15.115:0/4137128483 >> 172.21.15.115:0/4137128483 conn(0x7fb06405e940 msgr2=0x7fb0640cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:15.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb0695ff700 1 -- 172.21.15.115:0/4137128483 shutdown_connections 2023-07-27T14:28:15.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.198+0000 7fb0695ff700 1 -- 172.21.15.115:0/4137128483 wait complete. 2023-07-27T14:28:15.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.200+0000 7fb0695ff700 1 Processor -- start 2023-07-27T14:28:15.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.200+0000 7fb0695ff700 1 -- start start 2023-07-27T14:28:15.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb0695ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb0695ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb06414ae00 0x7fb06414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb0695ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb06414b1e0 0x7fb0640c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb0695ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640aea60 con 0x7fb064063260 2023-07-27T14:28:15.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb0695ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640aff40 con 0x7fb06414ae00 2023-07-27T14:28:15.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb0695ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640b0aa0 con 0x7fb06414b1e0 2023-07-27T14:28:15.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb062ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb062ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56904/0 (socket says 172.21.15.115:56904) 2023-07-27T14:28:15.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb062ffd700 1 -- 172.21.15.115:0/675644463 learned_addr learned my addr 172.21.15.115:0/675644463 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:15.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb0627fc700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb06414ae00 0x7fb06414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.201+0000 7fb0637fe700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb06414b1e0 0x7fb0640c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb062ffd700 1 -- 172.21.15.115:0/675644463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb06414b1e0 msgr2=0x7fb0640c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb062ffd700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb06414b1e0 0x7fb0640c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb062ffd700 1 -- 172.21.15.115:0/675644463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb06414ae00 msgr2=0x7fb06414a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb062ffd700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb06414ae00 0x7fb06414a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb062ffd700 1 -- 172.21.15.115:0/675644463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c009a20 con 0x7fb064063260 2023-07-27T14:28:15.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb062ffd700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640ae3d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fb05400d8c0 tx=0x7fb054008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:15.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb04affd700 1 -- 172.21.15.115:0/675644463 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0540095b0 con 0x7fb064063260 2023-07-27T14:28:15.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb04affd700 1 -- 172.21.15.115:0/675644463 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb054009710 con 0x7fb064063260 2023-07-27T14:28:15.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb04affd700 1 -- 172.21.15.115:0/675644463 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054009a90 con 0x7fb064063260 2023-07-27T14:28:15.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0640c7fa0 con 0x7fb064063260 2023-07-27T14:28:15.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.202+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0640b0450 con 0x7fb064063260 2023-07-27T14:28:15.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.203+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06406c470 con 0x7fb064063260 2023-07-27T14:28:15.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.204+0000 7fb04affd700 1 -- 172.21.15.115:0/675644463 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7fb054013480 con 0x7fb064063260 2023-07-27T14:28:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.205+0000 7fb04affd700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05005ed90 0x7fb050061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.205+0000 7fb04affd700 1 -- 172.21.15.115:0/675644463 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb054079e70 con 0x7fb064063260 2023-07-27T14:28:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.205+0000 7fb0627fc700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05005ed90 0x7fb050061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.206+0000 7fb0627fc700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05005ed90 0x7fb050061250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb0640c7cc0 tx=0x7fb058009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.209+0000 7fb04affd700 1 -- 172.21.15.115:0/675644463 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb05404b330 con 0x7fb064063260 2023-07-27T14:28:15.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.378+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb0641575d0 con 0x7fb064063260 2023-07-27T14:28:15.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.378+0000 7fb04affd700 1 -- 172.21.15.115:0/675644463 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb05404e950 con 0x7fb064063260 2023-07-27T14:28:15.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.380+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05005ed90 msgr2=0x7fb050061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.380+0000 7fb0695ff700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05005ed90 0x7fb050061250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb0640c7cc0 tx=0x7fb058009040).stop 2023-07-27T14:28:15.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.380+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 msgr2=0x7fb0640ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.380+0000 7fb0695ff700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640ae3d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fb05400d8c0 tx=0x7fb054008040).stop 2023-07-27T14:28:15.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.381+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 shutdown_connections 2023-07-27T14:28:15.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.381+0000 7fb0695ff700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05005ed90 0x7fb050061250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.381+0000 7fb0695ff700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb06414b1e0 0x7fb0640c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.381+0000 7fb0695ff700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064063260 0x7fb0640ae3d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.381+0000 7fb0695ff700 1 --2- 172.21.15.115:0/675644463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb06414ae00 0x7fb06414a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.381+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 >> 172.21.15.115:0/675644463 conn(0x7fb06405e940 msgr2=0x7fb0640a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:15.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.381+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 shutdown_connections 2023-07-27T14:28:15.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.381+0000 7fb0695ff700 1 -- 172.21.15.115:0/675644463 wait complete. 2023-07-27T14:28:15.417 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000967963 --mode=777 2023-07-27T14:28:15.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.590+0000 7f1d413ff700 1 Processor -- start 2023-07-27T14:28:15.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.590+0000 7f1d413ff700 1 -- start start 2023-07-27T14:28:15.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d413ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1d3c14ae00 0x7f1d3c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d413ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1d3c063260 0x7f1d3c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d413ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c1553f0 con 0x7f1d3c14b1e0 2023-07-27T14:28:15.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d413ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c157a50 con 0x7f1d3c063260 2023-07-27T14:28:15.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d413ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c157d10 con 0x7f1d3c14ae00 2023-07-27T14:28:15.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d3a7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1d3c14b1e0 0x7f1d3c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57720/0 (socket says 172.21.15.115:57720) 2023-07-27T14:28:15.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d3a7fc700 1 -- 172.21.15.115:0/662142040 learned_addr learned my addr 172.21.15.115:0/662142040 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:15.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d3b7fe700 1 --2- 172.21.15.115:0/662142040 >> v2:172.21.15.115:3300/0 conn(0x7f1d3c063260 0x7f1d3c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d3affd700 1 --2- 172.21.15.115:0/662142040 >> v2:172.21.15.159:3300/0 conn(0x7f1d3c14ae00 0x7f1d3c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d39ffb700 1 -- 172.21.15.115:0/662142040 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406301634 0 0) 0x7f1d3c1553f0 con 0x7f1d3c14b1e0 2023-07-27T14:28:15.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d3b7fe700 1 -- 172.21.15.115:0/662142040 >> v2:172.21.15.159:3300/0 conn(0x7f1d3c14ae00 msgr2=0x7f1d3c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:15.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d3b7fe700 1 --2- 172.21.15.115:0/662142040 >> v2:172.21.15.159:3300/0 conn(0x7f1d3c14ae00 0x7f1d3c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d3b7fe700 1 -- 172.21.15.115:0/662142040 >> v1:172.21.15.115:6789/0 conn(0x7f1d3c14b1e0 legacy=0x7f1d3c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.592+0000 7f1d3b7fe700 1 -- 172.21.15.115:0/662142040 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c157ff0 con 0x7f1d3c063260 2023-07-27T14:28:15.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d3b7fe700 1 --2- 172.21.15.115:0/662142040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c0a98c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f1d3c0caaf0 tx=0x7f1d34009780).ready entity=mon.0 client_cookie=2bfccc44139a8813 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:15.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d39ffb700 1 -- 172.21.15.115:0/662142040 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400e070 con 0x7f1d3c063260 2023-07-27T14:28:15.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d39ffb700 1 -- 172.21.15.115:0/662142040 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3400bb60 con 0x7f1d3c063260 2023-07-27T14:28:15.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d39ffb700 1 -- 172.21.15.115:0/662142040 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34012410 con 0x7f1d3c063260 2023-07-27T14:28:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d413ff700 1 -- 172.21.15.115:0/662142040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 msgr2=0x7f1d3c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d413ff700 1 --2- 172.21.15.115:0/662142040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c0a98c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f1d3c0caaf0 tx=0x7f1d34009780).stop 2023-07-27T14:28:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d413ff700 1 -- 172.21.15.115:0/662142040 shutdown_connections 2023-07-27T14:28:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d413ff700 1 --2- 172.21.15.115:0/662142040 >> v2:172.21.15.159:3300/0 conn(0x7f1d3c14ae00 0x7f1d3c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d413ff700 1 --2- 172.21.15.115:0/662142040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c0a98c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.593+0000 7f1d413ff700 1 -- 172.21.15.115:0/662142040 >> 172.21.15.115:0/662142040 conn(0x7f1d3c05e940 msgr2=0x7f1d3c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.594+0000 7f1d413ff700 1 -- 172.21.15.115:0/662142040 shutdown_connections 2023-07-27T14:28:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.594+0000 7f1d413ff700 1 -- 172.21.15.115:0/662142040 wait complete. 2023-07-27T14:28:15.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.595+0000 7f1d413ff700 1 Processor -- start 2023-07-27T14:28:15.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.595+0000 7f1d413ff700 1 -- start start 2023-07-27T14:28:15.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d413ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d413ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d3c14ae00 0x7f1d3c166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d413ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d3c14b1e0 0x7f1d3c0abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d413ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c1508a0 con 0x7f1d3c063260 2023-07-27T14:28:15.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d413ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c150270 con 0x7f1d3c14b1e0 2023-07-27T14:28:15.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d413ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0af200 con 0x7f1d3c14ae00 2023-07-27T14:28:15.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d3affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d3affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c164300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56918/0 (socket says 172.21.15.115:56918) 2023-07-27T14:28:15.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d3affd700 1 -- 172.21.15.115:0/1396309752 learned_addr learned my addr 172.21.15.115:0/1396309752 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:15.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d3a7fc700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d3c14ae00 0x7f1d3c166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.596+0000 7f1d3b7fe700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d3c14b1e0 0x7f1d3c0abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d3affd700 1 -- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d3c14ae00 msgr2=0x7f1d3c166f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d3affd700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d3c14ae00 0x7f1d3c166f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d3affd700 1 -- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d3c14b1e0 msgr2=0x7f1d3c0abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d3affd700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d3c14b1e0 0x7f1d3c0abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d3affd700 1 -- 172.21.15.115:0/1396309752 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34009a20 con 0x7f1d3c063260 2023-07-27T14:28:15.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d3b7fe700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d3c14b1e0 0x7f1d3c0abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:15.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d3affd700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c164300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f1d2c00e930 tx=0x7f1d2c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:15.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d22ffd700 1 -- 172.21.15.115:0/1396309752 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00c670 con 0x7f1d3c063260 2023-07-27T14:28:15.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d22ffd700 1 -- 172.21.15.115:0/1396309752 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00c7d0 con 0x7f1d3c063260 2023-07-27T14:28:15.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c0af4e0 con 0x7f1d3c063260 2023-07-27T14:28:15.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d22ffd700 1 -- 172.21.15.115:0/1396309752 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00cb50 con 0x7f1d3c063260 2023-07-27T14:28:15.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.597+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c1647f0 con 0x7f1d3c063260 2023-07-27T14:28:15.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.598+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c06c470 con 0x7f1d3c063260 2023-07-27T14:28:15.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.599+0000 7f1d22ffd700 1 -- 172.21.15.115:0/1396309752 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f1d2c022070 con 0x7f1d3c063260 2023-07-27T14:28:15.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.600+0000 7f1d22ffd700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d2805ed90 0x7f1d28061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:15.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.600+0000 7f1d22ffd700 1 -- 172.21.15.115:0/1396309752 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1d2c079fa0 con 0x7f1d3c063260 2023-07-27T14:28:15.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.600+0000 7f1d3a7fc700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d2805ed90 0x7f1d28061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:15.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.600+0000 7f1d3a7fc700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d2805ed90 0x7f1d28061250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1d3c0c8050 tx=0x7f1d30007dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:15.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.604+0000 7f1d22ffd700 1 -- 172.21.15.115:0/1396309752 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d2c04b430 con 0x7f1d3c063260 2023-07-27T14:28:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.803+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000967963", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d3c1509e0 con 0x7f1d2805ed90 2023-07-27T14:28:15.828 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:15.809+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:15.829 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:15.809+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:15.829 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:15.809+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:15.829 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:15.809+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:15.829 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:15.809+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:15.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.850+0000 7f1d22ffd700 1 -- 172.21.15.115:0/1396309752 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1d300074f0 con 0x7f1d2805ed90 2023-07-27T14:28:15.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d2805ed90 msgr2=0x7f1d28061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d2805ed90 0x7f1d28061250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1d3c0c8050 tx=0x7f1d30007dd0).stop 2023-07-27T14:28:15.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 msgr2=0x7f1d3c164300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:15.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c164300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f1d2c00e930 tx=0x7f1d2c009060).stop 2023-07-27T14:28:15.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 shutdown_connections 2023-07-27T14:28:15.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d2805ed90 0x7f1d28061250 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d3c14b1e0 0x7f1d3c0abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d3c063260 0x7f1d3c164300 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 --2- 172.21.15.115:0/1396309752 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d3c14ae00 0x7f1d3c166f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:15.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.852+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 >> 172.21.15.115:0/1396309752 conn(0x7f1d3c05e940 msgr2=0x7f1d3c0ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:15.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.853+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 shutdown_connections 2023-07-27T14:28:15.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:15.853+0000 7f1d413ff700 1 -- 172.21.15.115:0/1396309752 wait complete. 2023-07-27T14:28:15.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000967963 2023-07-27T14:28:16.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.061+0000 7f01a4fff700 1 Processor -- start 2023-07-27T14:28:16.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.061+0000 7f01a4fff700 1 -- start start 2023-07-27T14:28:16.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.062+0000 7f01a4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a0063260 0x7f01a0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:16.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.062+0000 7f01a4fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f01a014b1e0 0x7f01a00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:16.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.062+0000 7f01a4fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a01553f0 con 0x7f01a014ae00 2023-07-27T14:28:16.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.062+0000 7f01a4fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a0157a50 con 0x7f01a014b1e0 2023-07-27T14:28:16.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.062+0000 7f01a4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a0157d10 con 0x7f01a0063260 2023-07-27T14:28:16.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019ed9d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f01a014b1e0 0x7f01a00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:16.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019dd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a0063260 0x7f01a0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:16.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019e59c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f01a014ae00 0x7f01a0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:34516/0 (socket says 172.21.15.115:34516) 2023-07-27T14:28:16.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019e59c700 1 -- 172.21.15.115:0/579736804 learned_addr learned my addr 172.21.15.115:0/579736804 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:16.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019d59a700 1 -- 172.21.15.115:0/579736804 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759981251 0 0) 0x7f01a01553f0 con 0x7f01a014ae00 2023-07-27T14:28:16.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019d59a700 1 -- 172.21.15.115:0/579736804 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01880033f0 con 0x7f01a014ae00 2023-07-27T14:28:16.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019ed9d700 1 -- 172.21.15.115:0/579736804 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a0063260 msgr2=0x7f01a0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:16.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019ed9d700 1 --2- 172.21.15.115:0/579736804 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a0063260 0x7f01a0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019ed9d700 1 -- 172.21.15.115:0/579736804 >> v1:172.21.15.159:6789/0 conn(0x7f01a014ae00 legacy=0x7f01a0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:16.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.063+0000 7f019ed9d700 1 -- 172.21.15.115:0/579736804 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0157ff0 con 0x7f01a014b1e0 2023-07-27T14:28:16.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f019ed9d700 1 --2- 172.21.15.115:0/579736804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 0x7f01a00a98c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0198009e60 tx=0x7f0198009780).ready entity=mon.1 client_cookie=c657bb163a1bb24c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:16.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f019d59a700 1 -- 172.21.15.115:0/579736804 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800e070 con 0x7f01a014b1e0 2023-07-27T14:28:16.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f019d59a700 1 -- 172.21.15.115:0/579736804 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800bab0 con 0x7f01a014b1e0 2023-07-27T14:28:16.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f019d59a700 1 -- 172.21.15.115:0/579736804 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800be30 con 0x7f01a014b1e0 2023-07-27T14:28:16.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f01a4fff700 1 -- 172.21.15.115:0/579736804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 msgr2=0x7f01a00a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:16.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f01a4fff700 1 --2- 172.21.15.115:0/579736804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 0x7f01a00a98c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0198009e60 tx=0x7f0198009780).stop 2023-07-27T14:28:16.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f01a4fff700 1 -- 172.21.15.115:0/579736804 shutdown_connections 2023-07-27T14:28:16.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f01a4fff700 1 --2- 172.21.15.115:0/579736804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 0x7f01a00a98c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f01a4fff700 1 --2- 172.21.15.115:0/579736804 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a0063260 0x7f01a0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f01a4fff700 1 -- 172.21.15.115:0/579736804 >> 172.21.15.115:0/579736804 conn(0x7f01a005e940 msgr2=0x7f01a00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:16.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.064+0000 7f01a4fff700 1 -- 172.21.15.115:0/579736804 shutdown_connections 2023-07-27T14:28:16.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.065+0000 7f01a4fff700 1 -- 172.21.15.115:0/579736804 wait complete. 2023-07-27T14:28:16.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.066+0000 7f01a4fff700 1 Processor -- start 2023-07-27T14:28:16.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.067+0000 7f01a4fff700 1 -- start start 2023-07-27T14:28:16.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f01a4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01a0063260 0x7f01a0149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:16.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f01a4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a014ae00 0x7f01a00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:16.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f01a4fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 0x7f01a0148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:16.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f01a4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c1d90 con 0x7f01a0063260 2023-07-27T14:28:16.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f01a4fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c2c50 con 0x7f01a014b1e0 2023-07-27T14:28:16.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f01a4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c3150 con 0x7f01a014ae00 2023-07-27T14:28:16.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f019e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01a0063260 0x7f01a0149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:16.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f019e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01a0063260 0x7f01a0149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56956/0 (socket says 172.21.15.115:56956) 2023-07-27T14:28:16.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f019e59c700 1 -- 172.21.15.115:0/88276397 learned_addr learned my addr 172.21.15.115:0/88276397 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:16.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.068+0000 7f019dd9b700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a014ae00 0x7f01a00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:16.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f019ed9d700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 0x7f01a0148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:16.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f019e59c700 1 -- 172.21.15.115:0/88276397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a014ae00 msgr2=0x7f01a00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:16.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f019e59c700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a014ae00 0x7f01a00c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f019e59c700 1 -- 172.21.15.115:0/88276397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 msgr2=0x7f01a0148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:16.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f019e59c700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 0x7f01a0148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f019e59c700 1 -- 172.21.15.115:0/88276397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009a20 con 0x7f01a0063260 2023-07-27T14:28:16.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f019e59c700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01a0063260 0x7f01a0149690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f0190001ed0 tx=0x7f0190007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:16.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f018e7fc700 1 -- 172.21.15.115:0/88276397 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900072e0 con 0x7f01a0063260 2023-07-27T14:28:16.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f018e7fc700 1 -- 172.21.15.115:0/88276397 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0190007440 con 0x7f01a0063260 2023-07-27T14:28:16.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a00c3c90 con 0x7f01a0063260 2023-07-27T14:28:16.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f018e7fc700 1 -- 172.21.15.115:0/88276397 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900057a0 con 0x7f01a0063260 2023-07-27T14:28:16.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.069+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a00c3640 con 0x7f01a0063260 2023-07-27T14:28:16.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.071+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a006c470 con 0x7f01a0063260 2023-07-27T14:28:16.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.071+0000 7f018e7fc700 1 -- 172.21.15.115:0/88276397 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 75242+0+0 (secure 0 0 0) 0x7f0190010070 con 0x7f01a0063260 2023-07-27T14:28:16.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.072+0000 7f018e7fc700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f018005ed90 0x7f0180061250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:16.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.073+0000 7f018e7fc700 1 -- 172.21.15.115:0/88276397 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0190079180 con 0x7f01a0063260 2023-07-27T14:28:16.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.073+0000 7f019dd9b700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f018005ed90 0x7f0180061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:16.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.073+0000 7f019dd9b700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f018005ed90 0x7f0180061250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f01a0065200 tx=0x7f0194009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:16.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.077+0000 7f018e7fc700 1 -- 172.21.15.115:0/88276397 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f019004a610 con 0x7f01a0063260 2023-07-27T14:28:16.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.275+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000967963", "target": ["mon-mgr", ""]}) v1 -- 0x7f01a0154c50 con 0x7f018005ed90 2023-07-27T14:28:16.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.280+0000 7f018e7fc700 1 -- 172.21.15.115:0/88276397 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f01a0154c50 con 0x7f018005ed90 2023-07-27T14:28:16.300 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa 2023-07-27T14:28:16.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f018005ed90 msgr2=0x7f0180061250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:16.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f018005ed90 0x7f0180061250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f01a0065200 tx=0x7f0194009060).stop 2023-07-27T14:28:16.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01a0063260 msgr2=0x7f01a0149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:16.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01a0063260 0x7f01a0149690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f0190001ed0 tx=0x7f0190007c70).stop 2023-07-27T14:28:16.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 shutdown_connections 2023-07-27T14:28:16.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f018005ed90 0x7f0180061250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01a014b1e0 0x7f01a0148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01a0063260 0x7f01a0149690 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 --2- 172.21.15.115:0/88276397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f01a014ae00 0x7f01a00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:16.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.282+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 >> 172.21.15.115:0/88276397 conn(0x7f01a005e940 msgr2=0x7f01a014a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:16.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.283+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 shutdown_connections 2023-07-27T14:28:16.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:16.283+0000 7f01a4fff700 1 -- 172.21.15.115:0/88276397 wait complete. 2023-07-27T14:28:16.319 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000967963 with 200 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa 2023-07-27T14:28:16.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.319 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.394 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.394 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.395 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211605 s, 49.6 MB/s 2023-07-27T14:28:16.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.396 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.462 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.462 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.463 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188901 s, 55.5 MB/s 2023-07-27T14:28:16.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.465 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.530 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.530 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.531 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196226 s, 53.4 MB/s 2023-07-27T14:28:16.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.532 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.595 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.596 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.596 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167741 s, 62.5 MB/s 2023-07-27T14:28:16.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.597 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.660 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155199 s, 67.6 MB/s 2023-07-27T14:28:16.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.661 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.722 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.722 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014515 s, 72.2 MB/s 2023-07-27T14:28:16.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.723 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.785 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.786 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.786 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165646 s, 63.3 MB/s 2023-07-27T14:28:16.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.787 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.850 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.850 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.851 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168241 s, 62.3 MB/s 2023-07-27T14:28:16.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.852 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.923 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247831 s, 42.3 MB/s 2023-07-27T14:28:16.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.925 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:16.988 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:16.989 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:16.989 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167738 s, 62.5 MB/s 2023-07-27T14:28:16.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:16.990 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.053 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.054 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170673 s, 61.4 MB/s 2023-07-27T14:28:17.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.055 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.117 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152562 s, 68.7 MB/s 2023-07-27T14:28:17.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.118 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.180 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.180 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.180 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147127 s, 71.3 MB/s 2023-07-27T14:28:17.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.182 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.243 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.243 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.243 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146711 s, 71.5 MB/s 2023-07-27T14:28:17.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.244 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.315 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251399 s, 41.7 MB/s 2023-07-27T14:28:17.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.317 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.389 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.389 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.390 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252261 s, 41.6 MB/s 2023-07-27T14:28:17.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.391 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.454 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.454 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.454 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165006 s, 63.5 MB/s 2023-07-27T14:28:17.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.456 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.518 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.519 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.519 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159426 s, 65.8 MB/s 2023-07-27T14:28:17.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.521 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.584 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.584 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.585 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167216 s, 62.7 MB/s 2023-07-27T14:28:17.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.586 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.649 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.650 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.650 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152977 s, 68.5 MB/s 2023-07-27T14:28:17.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.651 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.718 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.718 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.718 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206757 s, 50.7 MB/s 2023-07-27T14:28:17.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.720 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.785 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.785 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.785 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018675 s, 56.1 MB/s 2023-07-27T14:28:17.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.787 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156889 s, 66.8 MB/s 2023-07-27T14:28:17.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.851 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.913 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.913 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.913 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149175 s, 70.3 MB/s 2023-07-27T14:28:17.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.914 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:17.978 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:17.978 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:17.978 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161295 s, 65.0 MB/s 2023-07-27T14:28:17.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:17.979 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.043 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.044 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.044 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179426 s, 58.4 MB/s 2023-07-27T14:28:18.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.045 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.108 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.108 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.108 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155 s, 67.7 MB/s 2023-07-27T14:28:18.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.110 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.173 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.173 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.173 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164217 s, 63.9 MB/s 2023-07-27T14:28:18.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.175 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.235 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.236 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.236 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149375 s, 70.2 MB/s 2023-07-27T14:28:18.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.237 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.301 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.301 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.301 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175802 s, 59.6 MB/s 2023-07-27T14:28:18.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.303 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.364 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.364 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.364 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155326 s, 67.5 MB/s 2023-07-27T14:28:18.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.365 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.433 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.434 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.434 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216113 s, 48.5 MB/s 2023-07-27T14:28:18.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.435 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.498 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.499 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.499 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168924 s, 62.1 MB/s 2023-07-27T14:28:18.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.500 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.562 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.563 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.563 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152928 s, 68.6 MB/s 2023-07-27T14:28:18.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.565 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.633 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.634 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.634 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209756 s, 50.0 MB/s 2023-07-27T14:28:18.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.635 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.702 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.703 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.703 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209267 s, 50.1 MB/s 2023-07-27T14:28:18.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.704 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.770 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.771 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.771 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201057 s, 52.2 MB/s 2023-07-27T14:28:18.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.772 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.831 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.831 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.832 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126283 s, 83.0 MB/s 2023-07-27T14:28:18.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.833 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.895 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.895 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.895 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156841 s, 66.9 MB/s 2023-07-27T14:28:18.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.897 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:18.962 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:18.962 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:18.962 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178121 s, 58.9 MB/s 2023-07-27T14:28:18.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:18.964 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.033 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.034 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.034 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233197 s, 45.0 MB/s 2023-07-27T14:28:19.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.035 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.099 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.100 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.100 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180724 s, 58.0 MB/s 2023-07-27T14:28:19.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.101 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.165 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.166 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.166 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168428 s, 62.3 MB/s 2023-07-27T14:28:19.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.167 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.229 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.229 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.229 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157173 s, 66.7 MB/s 2023-07-27T14:28:19.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.231 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.294 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.294 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168004 s, 62.4 MB/s 2023-07-27T14:28:19.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.296 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.357 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.358 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.358 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140807 s, 74.5 MB/s 2023-07-27T14:28:19.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.359 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.425 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.425 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.425 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191247 s, 54.8 MB/s 2023-07-27T14:28:19.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.426 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178717 s, 58.7 MB/s 2023-07-27T14:28:19.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.493 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.555 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.555 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.556 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167258 s, 62.7 MB/s 2023-07-27T14:28:19.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.557 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.618 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.619 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.619 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153786 s, 68.2 MB/s 2023-07-27T14:28:19.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.620 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.680 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.680 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.680 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135499 s, 77.4 MB/s 2023-07-27T14:28:19.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.682 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.744 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.745 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.745 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165443 s, 63.4 MB/s 2023-07-27T14:28:19.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.748 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.810 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.811 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.811 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160454 s, 65.4 MB/s 2023-07-27T14:28:19.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.812 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.875 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.875 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015779 s, 66.5 MB/s 2023-07-27T14:28:19.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.876 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185504 s, 56.5 MB/s 2023-07-27T14:28:19.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:19.943 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.007 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.008 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.008 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018381 s, 57.0 MB/s 2023-07-27T14:28:20.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.009 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.075 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.076 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.076 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194771 s, 53.8 MB/s 2023-07-27T14:28:20.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.077 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.138 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.138 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.138 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146348 s, 71.6 MB/s 2023-07-27T14:28:20.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.139 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.203 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.203 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.203 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172782 s, 60.7 MB/s 2023-07-27T14:28:20.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.204 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.264 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.265 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.265 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131691 s, 79.6 MB/s 2023-07-27T14:28:20.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.266 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.330 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.330 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.330 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016929 s, 61.9 MB/s 2023-07-27T14:28:20.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.332 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.392 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.393 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146138 s, 71.8 MB/s 2023-07-27T14:28:20.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.394 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.454 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.455 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.455 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141581 s, 74.1 MB/s 2023-07-27T14:28:20.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.456 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.519 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.519 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.519 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162001 s, 64.7 MB/s 2023-07-27T14:28:20.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.520 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.584 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177291 s, 59.1 MB/s 2023-07-27T14:28:20.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.588 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.652 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.652 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.652 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01493 s, 70.2 MB/s 2023-07-27T14:28:20.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.654 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169643 s, 61.8 MB/s 2023-07-27T14:28:20.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.718 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.789 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.790 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.790 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240387 s, 43.6 MB/s 2023-07-27T14:28:20.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.791 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147111 s, 71.3 MB/s 2023-07-27T14:28:20.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.854 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.918 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.918 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.919 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018571 s, 56.5 MB/s 2023-07-27T14:28:20.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.920 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:20.982 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:20.982 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:20.982 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150181 s, 69.8 MB/s 2023-07-27T14:28:20.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:20.983 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.046 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.047 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.047 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174249 s, 60.2 MB/s 2023-07-27T14:28:21.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.048 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.115 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.116 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.116 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180507 s, 58.1 MB/s 2023-07-27T14:28:21.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.117 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.183 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.183 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.183 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190255 s, 55.1 MB/s 2023-07-27T14:28:21.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.185 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.246 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147779 s, 71.0 MB/s 2023-07-27T14:28:21.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.248 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.310 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.311 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.311 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159593 s, 65.7 MB/s 2023-07-27T14:28:21.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.313 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.376 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.376 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.377 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164731 s, 63.7 MB/s 2023-07-27T14:28:21.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.379 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.441 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147607 s, 71.0 MB/s 2023-07-27T14:28:21.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.443 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.507 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.507 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.508 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172073 s, 60.9 MB/s 2023-07-27T14:28:21.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.509 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.573 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.573 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.573 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166843 s, 62.8 MB/s 2023-07-27T14:28:21.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.575 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.639 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.639 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.639 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017524 s, 59.8 MB/s 2023-07-27T14:28:21.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.641 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.703 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.703 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.703 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153999 s, 68.1 MB/s 2023-07-27T14:28:21.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.705 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.765 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.765 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.766 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142256 s, 73.7 MB/s 2023-07-27T14:28:21.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.767 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.826 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.827 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.827 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131928 s, 79.5 MB/s 2023-07-27T14:28:21.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.828 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.891 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.891 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.891 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157116 s, 66.7 MB/s 2023-07-27T14:28:21.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.892 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:21.953 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:21.954 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:21.954 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146999 s, 71.3 MB/s 2023-07-27T14:28:21.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:21.955 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.018 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.018 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.019 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162655 s, 64.5 MB/s 2023-07-27T14:28:22.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.020 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.086 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189817 s, 55.2 MB/s 2023-07-27T14:28:22.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.088 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.150 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.151 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.151 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167808 s, 62.5 MB/s 2023-07-27T14:28:22.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.152 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.214 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.215 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.215 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162028 s, 64.7 MB/s 2023-07-27T14:28:22.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.216 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.279 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.280 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.280 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168989 s, 62.1 MB/s 2023-07-27T14:28:22.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.281 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.343 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.343 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.343 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148805 s, 70.5 MB/s 2023-07-27T14:28:22.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.345 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.407 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.407 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.407 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161575 s, 64.9 MB/s 2023-07-27T14:28:22.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.409 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.471 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.471 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.471 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162734 s, 64.4 MB/s 2023-07-27T14:28:22.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.473 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156548 s, 67.0 MB/s 2023-07-27T14:28:22.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.537 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.596 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.597 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.597 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139108 s, 75.4 MB/s 2023-07-27T14:28:22.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.598 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.663 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.664 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176994 s, 59.2 MB/s 2023-07-27T14:28:22.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.665 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.725 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.725 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.726 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136591 s, 76.8 MB/s 2023-07-27T14:28:22.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.728 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.793 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.794 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.794 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163208 s, 64.2 MB/s 2023-07-27T14:28:22.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.795 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.859 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.859 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.859 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173978 s, 60.3 MB/s 2023-07-27T14:28:22.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.860 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.923 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.923 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.923 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164829 s, 63.6 MB/s 2023-07-27T14:28:22.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.925 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:22.990 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:22.991 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:22.991 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198736 s, 52.8 MB/s 2023-07-27T14:28:22.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:22.992 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.053 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.054 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.054 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154123 s, 68.0 MB/s 2023-07-27T14:28:23.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.055 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.117 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149947 s, 69.9 MB/s 2023-07-27T14:28:23.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.119 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.181 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.181 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.181 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156712 s, 66.9 MB/s 2023-07-27T14:28:23.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.182 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.248 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.248 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.248 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183908 s, 57.0 MB/s 2023-07-27T14:28:23.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.249 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.313 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.313 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.313 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169776 s, 61.8 MB/s 2023-07-27T14:28:23.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.315 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.377 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.378 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.378 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161424 s, 65.0 MB/s 2023-07-27T14:28:23.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.379 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.441 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.441 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.442 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155228 s, 67.6 MB/s 2023-07-27T14:28:23.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.443 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.508 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.508 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.508 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018231 s, 57.5 MB/s 2023-07-27T14:28:23.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.510 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.574 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177867 s, 59.0 MB/s 2023-07-27T14:28:23.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.576 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.640 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.640 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.640 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161573 s, 64.9 MB/s 2023-07-27T14:28:23.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.641 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.702 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.702 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.703 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140758 s, 74.5 MB/s 2023-07-27T14:28:23.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.704 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.767 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.768 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.768 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166273 s, 63.1 MB/s 2023-07-27T14:28:23.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.769 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.830 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.831 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.831 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149508 s, 70.1 MB/s 2023-07-27T14:28:23.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.832 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.896 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.896 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.897 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161295 s, 65.0 MB/s 2023-07-27T14:28:23.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.898 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:23.959 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:23.960 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142437 s, 73.6 MB/s 2023-07-27T14:28:23.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:23.961 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158277 s, 66.2 MB/s 2023-07-27T14:28:24.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.025 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.087 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.087 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.088 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157034 s, 66.8 MB/s 2023-07-27T14:28:24.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.089 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.148 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.149 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.149 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139106 s, 75.4 MB/s 2023-07-27T14:28:24.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.150 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.210 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138079 s, 75.9 MB/s 2023-07-27T14:28:24.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.212 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.273 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.274 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.274 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01493 s, 70.2 MB/s 2023-07-27T14:28:24.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.275 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.339 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.340 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.340 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180904 s, 58.0 MB/s 2023-07-27T14:28:24.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.341 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.406 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.406 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.406 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177657 s, 59.0 MB/s 2023-07-27T14:28:24.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.407 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.470 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.470 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.470 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158244 s, 66.3 MB/s 2023-07-27T14:28:24.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.472 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.539 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.539 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208568 s, 50.3 MB/s 2023-07-27T14:28:24.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.541 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.600 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.600 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.600 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012929 s, 81.1 MB/s 2023-07-27T14:28:24.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.602 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.664 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015027 s, 69.8 MB/s 2023-07-27T14:28:24.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.665 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.728 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.728 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.728 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162428 s, 64.6 MB/s 2023-07-27T14:28:24.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.730 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.792 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.792 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.792 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163456 s, 64.2 MB/s 2023-07-27T14:28:24.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.794 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.855 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.856 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.856 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147664 s, 71.0 MB/s 2023-07-27T14:28:24.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.857 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.922 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.922 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.922 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176446 s, 59.4 MB/s 2023-07-27T14:28:24.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.924 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:24.988 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:24.988 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:24.988 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164268 s, 63.8 MB/s 2023-07-27T14:28:24.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:24.990 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.053 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.053 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.054 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167937 s, 62.4 MB/s 2023-07-27T14:28:25.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.055 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.117 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153564 s, 68.3 MB/s 2023-07-27T14:28:25.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.118 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.181 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.181 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.181 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159215 s, 65.9 MB/s 2023-07-27T14:28:25.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.183 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.245 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.245 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.246 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159215 s, 65.9 MB/s 2023-07-27T14:28:25.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.247 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.310 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.310 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.310 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016121 s, 65.0 MB/s 2023-07-27T14:28:25.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.311 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.376 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.376 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.376 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171544 s, 61.1 MB/s 2023-07-27T14:28:25.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.379 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.441 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.441 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.441 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142343 s, 73.7 MB/s 2023-07-27T14:28:25.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.442 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.503 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.503 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.503 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135058 s, 77.6 MB/s 2023-07-27T14:28:25.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.504 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125861 s, 83.3 MB/s 2023-07-27T14:28:25.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.566 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189858 s, 55.2 MB/s 2023-07-27T14:28:25.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.634 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.696 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.696 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.696 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146299 s, 71.7 MB/s 2023-07-27T14:28:25.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.698 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.761 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.761 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.762 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171203 s, 61.2 MB/s 2023-07-27T14:28:25.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.763 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.822 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.822 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.823 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129128 s, 81.2 MB/s 2023-07-27T14:28:25.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.824 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.883 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.883 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.883 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127486 s, 82.3 MB/s 2023-07-27T14:28:25.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.884 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:25.949 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:25.949 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:25.949 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177014 s, 59.2 MB/s 2023-07-27T14:28:25.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:25.950 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.014 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.015 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.015 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175634 s, 59.7 MB/s 2023-07-27T14:28:26.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.016 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.077 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.077 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.078 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141558 s, 74.1 MB/s 2023-07-27T14:28:26.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.079 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160304 s, 65.4 MB/s 2023-07-27T14:28:26.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.143 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.203 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.204 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.204 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142479 s, 73.6 MB/s 2023-07-27T14:28:26.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.205 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.267 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.267 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.267 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154767 s, 67.8 MB/s 2023-07-27T14:28:26.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.268 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.330 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.330 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.330 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155976 s, 67.2 MB/s 2023-07-27T14:28:26.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.332 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.391 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.391 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.391 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131881 s, 79.5 MB/s 2023-07-27T14:28:26.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.393 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.454 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.454 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.454 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152875 s, 68.6 MB/s 2023-07-27T14:28:26.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.456 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.521 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187535 s, 55.9 MB/s 2023-07-27T14:28:26.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.522 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.585 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.585 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.585 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165148 s, 63.5 MB/s 2023-07-27T14:28:26.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.587 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.649 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.650 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.650 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164682 s, 63.7 MB/s 2023-07-27T14:28:26.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.651 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.713 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.713 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.713 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150202 s, 69.8 MB/s 2023-07-27T14:28:26.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.715 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.776 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.776 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.776 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146788 s, 71.4 MB/s 2023-07-27T14:28:26.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.778 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.841 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.841 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.841 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163344 s, 64.2 MB/s 2023-07-27T14:28:26.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.842 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.908 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.909 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.909 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190543 s, 55.0 MB/s 2023-07-27T14:28:26.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.910 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:26.978 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:26.978 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:26.978 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218152 s, 48.1 MB/s 2023-07-27T14:28:26.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:26.980 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.042 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.042 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.042 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161532 s, 64.9 MB/s 2023-07-27T14:28:27.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.044 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.107 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.107 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.107 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162802 s, 64.4 MB/s 2023-07-27T14:28:27.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.109 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.173 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.173 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.173 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184686 s, 56.8 MB/s 2023-07-27T14:28:27.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.175 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.234 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.235 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.235 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014358 s, 73.0 MB/s 2023-07-27T14:28:27.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.236 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.298 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.298 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.298 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148843 s, 70.4 MB/s 2023-07-27T14:28:27.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.300 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.360 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.360 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.360 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140621 s, 74.6 MB/s 2023-07-27T14:28:27.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.362 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.423 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.424 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.424 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015328 s, 68.4 MB/s 2023-07-27T14:28:27.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.425 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.485 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.485 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.485 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135554 s, 77.4 MB/s 2023-07-27T14:28:27.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.487 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.551 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.551 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.552 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175758 s, 59.7 MB/s 2023-07-27T14:28:27.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.553 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.615 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.615 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.615 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158132 s, 66.3 MB/s 2023-07-27T14:28:27.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.617 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.679 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.679 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.679 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155499 s, 67.4 MB/s 2023-07-27T14:28:27.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.681 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149361 s, 70.2 MB/s 2023-07-27T14:28:27.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.743 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021711 s, 48.3 MB/s 2023-07-27T14:28:27.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.813 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.879 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.879 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.879 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197352 s, 53.1 MB/s 2023-07-27T14:28:27.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.881 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:27.943 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150943 s, 69.5 MB/s 2023-07-27T14:28:27.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:27.945 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.006 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.007 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.007 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148464 s, 70.6 MB/s 2023-07-27T14:28:28.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.008 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.071 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.071 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.072 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016531 s, 63.4 MB/s 2023-07-27T14:28:28.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.073 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.134 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.135 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.135 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152649 s, 68.7 MB/s 2023-07-27T14:28:28.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.136 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.199 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.200 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.200 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161689 s, 64.9 MB/s 2023-07-27T14:28:28.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.202 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.264 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.264 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.264 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016421 s, 63.9 MB/s 2023-07-27T14:28:28.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.266 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.333 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.334 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.334 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211475 s, 49.6 MB/s 2023-07-27T14:28:28.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.335 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.397 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.397 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.397 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151133 s, 69.4 MB/s 2023-07-27T14:28:28.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.399 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.457 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:28:28.461 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:28:28.465 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.465 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.465 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196907 s, 53.3 MB/s 2023-07-27T14:28:28.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.466 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.566 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.567 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.567 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138729 s, 75.6 MB/s 2023-07-27T14:28:28.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.568 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.677 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.677 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.677 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202825 s, 51.7 MB/s 2023-07-27T14:28:28.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.679 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.740 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.741 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155327 s, 67.5 MB/s 2023-07-27T14:28:28.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.742 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.801 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.802 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.802 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013102 s, 80.0 MB/s 2023-07-27T14:28:28.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.803 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.865 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.866 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.866 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016282 s, 64.4 MB/s 2023-07-27T14:28:28.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.867 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183329 s, 57.2 MB/s 2023-07-27T14:28:28.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.933 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:28.996 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:28.996 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:28.996 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016872 s, 62.1 MB/s 2023-07-27T14:28:28.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:28.998 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:29.060 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:29.060 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:29.060 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155245 s, 67.5 MB/s 2023-07-27T14:28:29.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:29.062 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:29.126 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:29.127 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:29.127 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167887 s, 62.5 MB/s 2023-07-27T14:28:29.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:29.128 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:29.189 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:29.189 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:29.189 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146601 s, 71.5 MB/s 2023-07-27T14:28:29.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:29.191 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:29.252 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:29.252 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:29.252 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150041 s, 69.9 MB/s 2023-07-27T14:28:29.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:29.254 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:29.315 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:29.316 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:29.316 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152774 s, 68.6 MB/s 2023-07-27T14:28:29.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:29.317 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000967963/f5f79ee1-9e2b-40c6-b63a-e19ce027a8aa/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:28:29.380 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:28:29.381 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:28:29.381 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169928 s, 61.7 MB/s 2023-07-27T14:28:29.382 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000967963 snapshot_0000000000226505 2023-07-27T14:28:29.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.555+0000 7fe4531ff700 1 Processor -- start 2023-07-27T14:28:29.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.555+0000 7fe4531ff700 1 -- start start 2023-07-27T14:28:29.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.556+0000 7fe4531ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe44c063260 0x7fe44c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:29.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.556+0000 7fe4531ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c1553f0 con 0x7fe44c14b1e0 2023-07-27T14:28:29.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.556+0000 7fe4531ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c157a50 con 0x7fe44c14ae00 2023-07-27T14:28:29.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.556+0000 7fe4531ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c157d10 con 0x7fe44c063260 2023-07-27T14:28:29.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe45179c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe44c14b1e0 0x7fe44c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56584/0 (socket says 172.21.15.115:56584) 2023-07-27T14:28:29.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe45179c700 1 -- 172.21.15.115:0/1414435607 learned_addr learned my addr 172.21.15.115:0/1414435607 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:29.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44bfff700 1 --2- 172.21.15.115:0/1414435607 >> v2:172.21.15.159:3300/0 conn(0x7fe44c063260 0x7fe44c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:29.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44b7fe700 1 -- 172.21.15.115:0/1414435607 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441347466 0 0) 0x7fe44c1553f0 con 0x7fe44c14b1e0 2023-07-27T14:28:29.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44b7fe700 1 -- 172.21.15.115:0/1414435607 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe43c0033f0 con 0x7fe44c14b1e0 2023-07-27T14:28:29.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44b7fe700 1 -- 172.21.15.115:0/1414435607 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264730356 0 0) 0x7fe44c157a50 con 0x7fe44c14ae00 2023-07-27T14:28:29.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44b7fe700 1 -- 172.21.15.115:0/1414435607 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe44c1553f0 con 0x7fe44c14ae00 2023-07-27T14:28:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44b7fe700 1 -- 172.21.15.115:0/1414435607 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 111844642 0 0) 0x7fe43c0033f0 con 0x7fe44c14b1e0 2023-07-27T14:28:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44bfff700 1 -- 172.21.15.115:0/1414435607 >> v1:172.21.15.159:6789/0 conn(0x7fe44c14ae00 legacy=0x7fe44c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44bfff700 1 -- 172.21.15.115:0/1414435607 >> v1:172.21.15.115:6789/0 conn(0x7fe44c14b1e0 legacy=0x7fe44c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44bfff700 1 -- 172.21.15.115:0/1414435607 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c157ff0 con 0x7fe44c063260 2023-07-27T14:28:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.557+0000 7fe44bfff700 1 --2- 172.21.15.115:0/1414435607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c063260 0x7fe44c154f00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe438009760 tx=0x7fe438009060).ready entity=mon.1 client_cookie=ab9c7c92aefdb711 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.558+0000 7fe44b7fe700 1 -- 172.21.15.115:0/1414435607 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440017f0 con 0x7fe44c063260 2023-07-27T14:28:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.558+0000 7fe44b7fe700 1 -- 172.21.15.115:0/1414435607 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe438011400 con 0x7fe44c063260 2023-07-27T14:28:29.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.558+0000 7fe44b7fe700 1 -- 172.21.15.115:0/1414435607 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438011780 con 0x7fe44c063260 2023-07-27T14:28:29.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.558+0000 7fe4531ff700 1 -- 172.21.15.115:0/1414435607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c063260 msgr2=0x7fe44c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:29.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.558+0000 7fe4531ff700 1 --2- 172.21.15.115:0/1414435607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c063260 0x7fe44c154f00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe438009760 tx=0x7fe438009060).stop 2023-07-27T14:28:29.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.559+0000 7fe4531ff700 1 -- 172.21.15.115:0/1414435607 shutdown_connections 2023-07-27T14:28:29.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.559+0000 7fe4531ff700 1 --2- 172.21.15.115:0/1414435607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c063260 0x7fe44c154f00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:29.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.559+0000 7fe4531ff700 1 -- 172.21.15.115:0/1414435607 >> 172.21.15.115:0/1414435607 conn(0x7fe44c05e940 msgr2=0x7fe44c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:29.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.559+0000 7fe4531ff700 1 -- 172.21.15.115:0/1414435607 shutdown_connections 2023-07-27T14:28:29.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.559+0000 7fe4531ff700 1 -- 172.21.15.115:0/1414435607 wait complete. 2023-07-27T14:28:29.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.560+0000 7fe4531ff700 1 Processor -- start 2023-07-27T14:28:29.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.560+0000 7fe4531ff700 1 -- start start 2023-07-27T14:28:29.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe4531ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44c063260 0x7fe44c14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:29.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe4531ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe44c14ae00 0x7fe44c148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:29.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe4531ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c14b1e0 0x7fe44c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:29.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe4531ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c14dc70 con 0x7fe44c063260 2023-07-27T14:28:29.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe4531ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1490a0 con 0x7fe44c14b1e0 2023-07-27T14:28:29.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe4531ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1680c0 con 0x7fe44c14ae00 2023-07-27T14:28:29.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe450f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44c063260 0x7fe44c14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:29.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe450f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44c063260 0x7fe44c14e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41836/0 (socket says 172.21.15.115:41836) 2023-07-27T14:28:29.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.561+0000 7fe450f9b700 1 -- 172.21.15.115:0/2137410184 learned_addr learned my addr 172.21.15.115:0/2137410184 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:29.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe45179c700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c14b1e0 0x7fe44c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:29.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe44bfff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe44c14ae00 0x7fe44c148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:29.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe450f9b700 1 -- 172.21.15.115:0/2137410184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe44c14ae00 msgr2=0x7fe44c148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:29.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe450f9b700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe44c14ae00 0x7fe44c148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:29.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe450f9b700 1 -- 172.21.15.115:0/2137410184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c14b1e0 msgr2=0x7fe44c14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:29.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe450f9b700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c14b1e0 0x7fe44c14d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:29.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe450f9b700 1 -- 172.21.15.115:0/2137410184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4380092a0 con 0x7fe44c063260 2023-07-27T14:28:29.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe450f9b700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44c063260 0x7fe44c14e090 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fe44000c490 tx=0x7fe440007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:29.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe448ff9700 1 -- 172.21.15.115:0/2137410184 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000ce40 con 0x7fe44c063260 2023-07-27T14:28:29.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe448ff9700 1 -- 172.21.15.115:0/2137410184 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44000f470 con 0x7fe44c063260 2023-07-27T14:28:29.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c0c21d0 con 0x7fe44c063260 2023-07-27T14:28:29.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe448ff9700 1 -- 172.21.15.115:0/2137410184 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000f810 con 0x7fe44c063260 2023-07-27T14:28:29.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.562+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c167a70 con 0x7fe44c063260 2023-07-27T14:28:29.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.563+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44c1683a0 con 0x7fe44c063260 2023-07-27T14:28:29.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.564+0000 7fe448ff9700 1 -- 172.21.15.115:0/2137410184 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 75282+0+0 (secure 0 0 0) 0x7fe440019030 con 0x7fe44c063260 2023-07-27T14:28:29.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.565+0000 7fe448ff9700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe43005edd0 0x7fe430061290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:29.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.565+0000 7fe448ff9700 1 -- 172.21.15.115:0/2137410184 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe440079090 con 0x7fe44c063260 2023-07-27T14:28:29.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.565+0000 7fe44bfff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe43005edd0 0x7fe430061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:29.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.566+0000 7fe44bfff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe43005edd0 0x7fe430061290 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe44c063660 tx=0x7fe438016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:29.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.569+0000 7fe448ff9700 1 -- 172.21.15.115:0/2137410184 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe44004a4e0 con 0x7fe44c063260 2023-07-27T14:28:29.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.773+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000967963", "snap_name": "snapshot_0000000000226505", "target": ["mon-mgr", ""]}) v1 -- 0x7fe44c168200 con 0x7fe43005edd0 2023-07-27T14:28:29.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.805+0000 7fe448ff9700 1 -- 172.21.15.115:0/2137410184 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe438011570 con 0x7fe43005edd0 2023-07-27T14:28:29.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe43005edd0 msgr2=0x7fe430061290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:29.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe43005edd0 0x7fe430061290 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe44c063660 tx=0x7fe438016000).stop 2023-07-27T14:28:29.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44c063260 msgr2=0x7fe44c14e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:29.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44c063260 0x7fe44c14e090 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fe44000c490 tx=0x7fe440007c90).stop 2023-07-27T14:28:29.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 shutdown_connections 2023-07-27T14:28:29.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe43005edd0 0x7fe430061290 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:29.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe44c14b1e0 0x7fe44c14d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:29.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe44c063260 0x7fe44c14e090 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:29.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 --2- 172.21.15.115:0/2137410184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe44c14ae00 0x7fe44c148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:29.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.807+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 >> 172.21.15.115:0/2137410184 conn(0x7fe44c05e940 msgr2=0x7fe44c149840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:29.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.808+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 shutdown_connections 2023-07-27T14:28:29.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:29.808+0000 7fe4531ff700 1 -- 172.21.15.115:0/2137410184 wait complete. 2023-07-27T14:28:29.853 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-07-27T14:28:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.027+0000 7f40bd9ff700 1 Processor -- start 2023-07-27T14:28:30.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.027+0000 7f40bd9ff700 1 -- start start 2023-07-27T14:28:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.028+0000 7f40bd9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f40b8065de0 0x7f40b815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.028+0000 7f40bd9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b8064a80 con 0x7f40b8153e00 2023-07-27T14:28:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.028+0000 7f40bd9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b8064d60 con 0x7f40b80c6b70 2023-07-27T14:28:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.028+0000 7f40bd9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b8062320 con 0x7f40b8065de0 2023-07-27T14:28:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f40b8153e00 0x7f40b8064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56592/0 (socket says 172.21.15.115:56592) 2023-07-27T14:28:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b6ffd700 1 -- 172.21.15.115:0/2628419464 learned_addr learned my addr 172.21.15.115:0/2628419464 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:30.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b77fe700 1 --2- 172.21.15.115:0/2628419464 >> v2:172.21.15.115:3300/0 conn(0x7f40b8065de0 0x7f40b815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b5ffb700 1 -- 172.21.15.115:0/2628419464 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156957474 0 0) 0x7f40b8064a80 con 0x7f40b8153e00 2023-07-27T14:28:30.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b5ffb700 1 -- 172.21.15.115:0/2628419464 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40a00033f0 con 0x7f40b8153e00 2023-07-27T14:28:30.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b77fe700 1 -- 172.21.15.115:0/2628419464 >> v1:172.21.15.159:6789/0 conn(0x7f40b80c6b70 legacy=0x7f40b80656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b77fe700 1 -- 172.21.15.115:0/2628419464 >> v1:172.21.15.115:6789/0 conn(0x7f40b8153e00 legacy=0x7f40b8064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b77fe700 1 -- 172.21.15.115:0/2628419464 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8065040 con 0x7f40b8065de0 2023-07-27T14:28:30.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.029+0000 7f40b77fe700 1 --2- 172.21.15.115:0/2628419464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8065de0 0x7f40b815edc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f40b0009e60 tx=0x7f40b0009780).ready entity=mon.0 client_cookie=7c8487bd4fc6fd3f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:30.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40b5ffb700 1 -- 172.21.15.115:0/2628419464 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b000e070 con 0x7f40b8065de0 2023-07-27T14:28:30.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40b5ffb700 1 -- 172.21.15.115:0/2628419464 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b000bb60 con 0x7f40b8065de0 2023-07-27T14:28:30.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40b5ffb700 1 -- 172.21.15.115:0/2628419464 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0012410 con 0x7f40b8065de0 2023-07-27T14:28:30.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40bd9ff700 1 -- 172.21.15.115:0/2628419464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8065de0 msgr2=0x7f40b815edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40bd9ff700 1 --2- 172.21.15.115:0/2628419464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8065de0 0x7f40b815edc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f40b0009e60 tx=0x7f40b0009780).stop 2023-07-27T14:28:30.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40bd9ff700 1 -- 172.21.15.115:0/2628419464 shutdown_connections 2023-07-27T14:28:30.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40bd9ff700 1 --2- 172.21.15.115:0/2628419464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8065de0 0x7f40b815edc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40bd9ff700 1 -- 172.21.15.115:0/2628419464 >> 172.21.15.115:0/2628419464 conn(0x7f40b80c7b90 msgr2=0x7f40b80c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:30.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40bd9ff700 1 -- 172.21.15.115:0/2628419464 shutdown_connections 2023-07-27T14:28:30.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.030+0000 7f40bd9ff700 1 -- 172.21.15.115:0/2628419464 wait complete. 2023-07-27T14:28:30.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.032+0000 7f40bd9ff700 1 Processor -- start 2023-07-27T14:28:30.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.032+0000 7f40bd9ff700 1 -- start start 2023-07-27T14:28:30.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40bd9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40b8065de0 0x7f40b814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40bd9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b80c6b70 0x7f40b80a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40bd9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8153e00 0x7f40b80a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40bd9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b80a8ad0 con 0x7f40b8153e00 2023-07-27T14:28:30.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40bd9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b80a98c0 con 0x7f40b80c6b70 2023-07-27T14:28:30.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40bd9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b80a8cb0 con 0x7f40b8065de0 2023-07-27T14:28:30.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8153e00 0x7f40b80a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8153e00 0x7f40b80a85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41856/0 (socket says 172.21.15.115:41856) 2023-07-27T14:28:30.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b77fe700 1 -- 172.21.15.115:0/4289282603 learned_addr learned my addr 172.21.15.115:0/4289282603 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:30.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b67fc700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b80c6b70 0x7f40b80a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b77fe700 1 -- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40b8065de0 msgr2=0x7f40b814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b6ffd700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40b8065de0 0x7f40b814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b77fe700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40b8065de0 0x7f40b814b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b77fe700 1 -- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b80c6b70 msgr2=0x7f40b80a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b77fe700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b80c6b70 0x7f40b80a80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b77fe700 1 -- 172.21.15.115:0/4289282603 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0009a20 con 0x7f40b8153e00 2023-07-27T14:28:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b67fc700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b80c6b70 0x7f40b80a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.033+0000 7f40b6ffd700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40b8065de0 0x7f40b814b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.034+0000 7f40b77fe700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8153e00 0x7f40b80a85e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f40b80680d0 tx=0x7f40b0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:30.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.034+0000 7f409effd700 1 -- 172.21.15.115:0/4289282603 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b001d630 con 0x7f40b8153e00 2023-07-27T14:28:30.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.034+0000 7f409effd700 1 -- 172.21.15.115:0/4289282603 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b001d790 con 0x7f40b8153e00 2023-07-27T14:28:30.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.034+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b80a8f90 con 0x7f40b8153e00 2023-07-27T14:28:30.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.034+0000 7f409effd700 1 -- 172.21.15.115:0/4289282603 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b001db30 con 0x7f40b8153e00 2023-07-27T14:28:30.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.034+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b80a9550 con 0x7f40b8153e00 2023-07-27T14:28:30.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.035+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b806c470 con 0x7f40b8153e00 2023-07-27T14:28:30.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.036+0000 7f409effd700 1 -- 172.21.15.115:0/4289282603 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 75282+0+0 (secure 0 0 0) 0x7f40b0026410 con 0x7f40b8153e00 2023-07-27T14:28:30.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.037+0000 7f409effd700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40a405edd0 0x7f40a4061290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.037+0000 7f409effd700 1 -- 172.21.15.115:0/4289282603 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f40b007bd80 con 0x7f40b8153e00 2023-07-27T14:28:30.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.037+0000 7f40b6ffd700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40a405edd0 0x7f40a4061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.037+0000 7f40b6ffd700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40a405edd0 0x7f40a4061290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f40a8005750 tx=0x7f40a8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:30.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.041+0000 7f409effd700 1 -- 172.21.15.115:0/4289282603 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40b004d1f0 con 0x7f40b8153e00 2023-07-27T14:28:30.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.210+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f40b8065320 con 0x7f40b8153e00 2023-07-27T14:28:30.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.214+0000 7f409effd700 1 -- 172.21.15.115:0/4289282603 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v3)=0 v3) v1 ==== 130+0+0 (secure 0 0 0) 0x7f40b0050810 con 0x7f40b8153e00 2023-07-27T14:28:30.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40a405edd0 msgr2=0x7f40a4061290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40a405edd0 0x7f40a4061290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f40a8005750 tx=0x7f40a8009040).stop 2023-07-27T14:28:30.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8153e00 msgr2=0x7f40b80a85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8153e00 0x7f40b80a85e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f40b80680d0 tx=0x7f40b0009780).stop 2023-07-27T14:28:30.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 shutdown_connections 2023-07-27T14:28:30.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40a405edd0 0x7f40a4061290 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40b8153e00 0x7f40b80a85e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40b8065de0 0x7f40b814b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 --2- 172.21.15.115:0/4289282603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40b80c6b70 0x7f40b80a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 >> 172.21.15.115:0/4289282603 conn(0x7f40b80c7b90 msgr2=0x7f40b80a4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:30.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 shutdown_connections 2023-07-27T14:28:30.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.217+0000 7f40bd9ff700 1 -- 172.21.15.115:0/4289282603 wait complete. 2023-07-27T14:28:30.254 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000967963 snapshot_0000000000226505 clone_0000000000959786 2023-07-27T14:28:30.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.428+0000 7f61161ff700 1 Processor -- start 2023-07-27T14:28:30.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.428+0000 7f61161ff700 1 -- start start 2023-07-27T14:28:30.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.429+0000 7f61161ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f6110154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.429+0000 7f61161ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f611014b1e0 0x7f61100a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.429+0000 7f61161ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61101553f0 con 0x7f611014ae00 2023-07-27T14:28:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.429+0000 7f61161ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6110157a50 con 0x7f611014b1e0 2023-07-27T14:28:30.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.429+0000 7f61161ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6110157d10 con 0x7f6110063260 2023-07-27T14:28:30.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.430+0000 7f610effd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f6110154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.430+0000 7f610ffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f611014b1e0 0x7f61100a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.430+0000 7f610effd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f6110154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:58538/0 (socket says 172.21.15.115:58538) 2023-07-27T14:28:30.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.430+0000 7f610ffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f611014b1e0 0x7f61100a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:52120/0 (socket says 172.21.15.115:52120) 2023-07-27T14:28:30.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.430+0000 7f610effd700 1 -- 172.21.15.115:0/1571142433 learned_addr learned my addr 172.21.15.115:0/1571142433 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:30.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.430+0000 7f610e7fc700 1 -- 172.21.15.115:0/1571142433 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211659248 0 0) 0x7f61101553f0 con 0x7f611014ae00 2023-07-27T14:28:30.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610e7fc700 1 -- 172.21.15.115:0/1571142433 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f80033f0 con 0x7f611014ae00 2023-07-27T14:28:30.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610ffff700 1 -- 172.21.15.115:0/1571142433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 msgr2=0x7f6110154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:30.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610ffff700 1 --2- 172.21.15.115:0/1571142433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f6110154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610ffff700 1 -- 172.21.15.115:0/1571142433 >> v1:172.21.15.159:6789/0 conn(0x7f611014ae00 legacy=0x7f6110062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610ffff700 1 -- 172.21.15.115:0/1571142433 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110157ff0 con 0x7f611014b1e0 2023-07-27T14:28:30.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610effd700 1 --2- 172.21.15.115:0/1571142433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f6110154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:28:30.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610ffff700 1 --2- 172.21.15.115:0/1571142433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 0x7f61100a98c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6108009e60 tx=0x7f6108009780).ready entity=mon.1 client_cookie=413f385d361f2b68 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:30.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610e7fc700 1 -- 172.21.15.115:0/1571142433 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800e070 con 0x7f611014b1e0 2023-07-27T14:28:30.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610e7fc700 1 -- 172.21.15.115:0/1571142433 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610800bab0 con 0x7f611014b1e0 2023-07-27T14:28:30.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f610e7fc700 1 -- 172.21.15.115:0/1571142433 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800be30 con 0x7f611014b1e0 2023-07-27T14:28:30.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f61161ff700 1 -- 172.21.15.115:0/1571142433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 msgr2=0x7f61100a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.431+0000 7f61161ff700 1 --2- 172.21.15.115:0/1571142433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 0x7f61100a98c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6108009e60 tx=0x7f6108009780).stop 2023-07-27T14:28:30.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.432+0000 7f61161ff700 1 -- 172.21.15.115:0/1571142433 shutdown_connections 2023-07-27T14:28:30.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.432+0000 7f61161ff700 1 --2- 172.21.15.115:0/1571142433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 0x7f61100a98c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.432+0000 7f61161ff700 1 --2- 172.21.15.115:0/1571142433 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f6110154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.432+0000 7f61161ff700 1 -- 172.21.15.115:0/1571142433 >> 172.21.15.115:0/1571142433 conn(0x7f611005e940 msgr2=0x7f61100cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:30.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.432+0000 7f61161ff700 1 -- 172.21.15.115:0/1571142433 shutdown_connections 2023-07-27T14:28:30.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.432+0000 7f61161ff700 1 -- 172.21.15.115:0/1571142433 wait complete. 2023-07-27T14:28:30.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.433+0000 7f61161ff700 1 Processor -- start 2023-07-27T14:28:30.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.433+0000 7f61161ff700 1 -- start start 2023-07-27T14:28:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f61161ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f61101555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f61161ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f611014ae00 0x7f61100c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f61161ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 0x7f61100c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f61161ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110155e00 con 0x7f611014ae00 2023-07-27T14:28:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f61161ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61101560e0 con 0x7f611014b1e0 2023-07-27T14:28:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f61161ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61101563c0 con 0x7f6110063260 2023-07-27T14:28:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f610effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f611014ae00 0x7f61100c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f610effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f611014ae00 0x7f61100c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41862/0 (socket says 172.21.15.115:41862) 2023-07-27T14:28:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.434+0000 7f610effd700 1 -- 172.21.15.115:0/1600305209 learned_addr learned my addr 172.21.15.115:0/1600305209 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f610ffff700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 0x7f61100c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f610f7fe700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f61101555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f610effd700 1 -- 172.21.15.115:0/1600305209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 msgr2=0x7f61101555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f610effd700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f61101555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f610effd700 1 -- 172.21.15.115:0/1600305209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 msgr2=0x7f61100c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f610effd700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 0x7f61100c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f610effd700 1 -- 172.21.15.115:0/1600305209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104009370 con 0x7f611014ae00 2023-07-27T14:28:30.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f610effd700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f611014ae00 0x7f61100c3620 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f610400ec80 tx=0x7f61040090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:30.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f60f77fe700 1 -- 172.21.15.115:0/1600305209 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400c850 con 0x7f611014ae00 2023-07-27T14:28:30.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f60f77fe700 1 -- 172.21.15.115:0/1600305209 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400c9b0 con 0x7f611014ae00 2023-07-27T14:28:30.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6108009a20 con 0x7f611014ae00 2023-07-27T14:28:30.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f60f77fe700 1 -- 172.21.15.115:0/1600305209 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400cd30 con 0x7f611014ae00 2023-07-27T14:28:30.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.435+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6110156980 con 0x7f611014ae00 2023-07-27T14:28:30.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.436+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6110156cf0 con 0x7f611014ae00 2023-07-27T14:28:30.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.437+0000 7f60f77fe700 1 -- 172.21.15.115:0/1600305209 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 75282+0+0 (secure 0 0 0) 0x7f6104022070 con 0x7f611014ae00 2023-07-27T14:28:30.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.438+0000 7f60f77fe700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f60fc05edd0 0x7f60fc061290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:30.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.438+0000 7f60f77fe700 1 -- 172.21.15.115:0/1600305209 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6104079fc0 con 0x7f611014ae00 2023-07-27T14:28:30.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.438+0000 7f610f7fe700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f60fc05edd0 0x7f60fc061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:30.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.439+0000 7f610f7fe700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f60fc05edd0 0x7f60fc061290 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f6100000c00 tx=0x7f6100007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:30.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.442+0000 7f60f77fe700 1 -- 172.21.15.115:0/1600305209 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f610404b520 con 0x7f611014ae00 2023-07-27T14:28:30.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.652+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000967963", "snap_name": "snapshot_0000000000226505", "target_sub_name": "clone_0000000000959786", "target": ["mon-mgr", ""]}) v1 -- 0x7f611006c470 con 0x7f60fc05edd0 2023-07-27T14:28:30.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.754+0000 7f60f77fe700 1 -- 172.21.15.115:0/1600305209 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f611006c470 con 0x7f60fc05edd0 2023-07-27T14:28:30.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.756+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f60fc05edd0 msgr2=0x7f60fc061290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.756+0000 7f61161ff700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f60fc05edd0 0x7f60fc061290 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f6100000c00 tx=0x7f6100007bb0).stop 2023-07-27T14:28:30.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.756+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f611014ae00 msgr2=0x7f61100c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:30.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.756+0000 7f61161ff700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f611014ae00 0x7f61100c3620 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f610400ec80 tx=0x7f61040090f0).stop 2023-07-27T14:28:30.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.757+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 shutdown_connections 2023-07-27T14:28:30.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.757+0000 7f61161ff700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f60fc05edd0 0x7f60fc061290 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.757+0000 7f61161ff700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f611014b1e0 0x7f61100c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.757+0000 7f61161ff700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6110063260 0x7f61101555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.757+0000 7f61161ff700 1 --2- 172.21.15.115:0/1600305209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f611014ae00 0x7f61100c3620 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:30.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.757+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 >> 172.21.15.115:0/1600305209 conn(0x7f611005e940 msgr2=0x7f61101544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:30.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.757+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 shutdown_connections 2023-07-27T14:28:30.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:30.757+0000 7f61161ff700 1 -- 172.21.15.115:0/1600305209 wait complete. 2023-07-27T14:28:30.787 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.767+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.787 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.767+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.787 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.767+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.787 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.767+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.788 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.767+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:30.795 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir ./volumes/_nogroup/subvolume_0000000000967963/.snap/snapshot_0000000000226505) 2023-07-27T14:28:30.805 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.785+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.805 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.785+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.805 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.785+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.806 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.785+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.806 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:30.785+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:30.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000959786 2023-07-27T14:28:31.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.089+0000 7f31d07ff700 1 Processor -- start 2023-07-27T14:28:31.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.089+0000 7f31d07ff700 1 -- start start 2023-07-27T14:28:31.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31d07ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f31c80bc350 0x7f31c80657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:31.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31d07ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f31c81542b0 0x7f31c8157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:31.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31d07ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8065360 con 0x7f31c8153ed0 2023-07-27T14:28:31.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31d07ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80bcbd0 con 0x7f31c80bc350 2023-07-27T14:28:31.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31d07ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c81546d0 con 0x7f31c81542b0 2023-07-27T14:28:31.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31cdd9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f31c80bc350 0x7f31c80657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:31.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31cdd9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f31c80bc350 0x7f31c80657f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41888/0 (socket says 172.21.15.115:41888) 2023-07-27T14:28:31.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31cdd9a700 1 -- 172.21.15.115:0/2331371775 learned_addr learned my addr 172.21.15.115:0/2331371775 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:31.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31ced9c700 1 --2- 172.21.15.115:0/2331371775 >> v2:172.21.15.159:3300/0 conn(0x7f31c81542b0 0x7f31c8157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:31.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31cdd9a700 1 -- 172.21.15.115:0/2331371775 >> v2:172.21.15.159:3300/0 conn(0x7f31c81542b0 msgr2=0x7f31c8157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:31.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31cdd9a700 1 --2- 172.21.15.115:0/2331371775 >> v2:172.21.15.159:3300/0 conn(0x7f31c81542b0 0x7f31c8157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31cdd9a700 1 -- 172.21.15.115:0/2331371775 >> v1:172.21.15.159:6789/0 conn(0x7f31c8153ed0 legacy=0x7f31c80c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:31.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31cdd9a700 1 -- 172.21.15.115:0/2331371775 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8064d30 con 0x7f31c80bc350 2023-07-27T14:28:31.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.091+0000 7f31ced9c700 1 --2- 172.21.15.115:0/2331371775 >> v2:172.21.15.159:3300/0 conn(0x7f31c81542b0 0x7f31c8157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:31.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.092+0000 7f31cdd9a700 1 --2- 172.21.15.115:0/2331371775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80bc350 0x7f31c80657f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f31c80a98d0 tx=0x7f31b80090f0).ready entity=mon.0 client_cookie=d03f73c62a992f55 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:31.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.092+0000 7f31cd599700 1 -- 172.21.15.115:0/2331371775 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b800b5a0 con 0x7f31c80bc350 2023-07-27T14:28:31.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.092+0000 7f31cd599700 1 -- 172.21.15.115:0/2331371775 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b800b700 con 0x7f31c80bc350 2023-07-27T14:28:31.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.092+0000 7f31cd599700 1 -- 172.21.15.115:0/2331371775 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b800ba80 con 0x7f31c80bc350 2023-07-27T14:28:31.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.092+0000 7f31d07ff700 1 -- 172.21.15.115:0/2331371775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80bc350 msgr2=0x7f31c80657f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:31.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.092+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2331371775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80bc350 0x7f31c80657f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f31c80a98d0 tx=0x7f31b80090f0).stop 2023-07-27T14:28:31.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.093+0000 7f31d07ff700 1 -- 172.21.15.115:0/2331371775 shutdown_connections 2023-07-27T14:28:31.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.093+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2331371775 >> v2:172.21.15.159:3300/0 conn(0x7f31c81542b0 0x7f31c8157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.093+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2331371775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80bc350 0x7f31c80657f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.093+0000 7f31d07ff700 1 -- 172.21.15.115:0/2331371775 >> 172.21.15.115:0/2331371775 conn(0x7f31c8062df0 msgr2=0x7f31c80c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:31.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.093+0000 7f31d07ff700 1 -- 172.21.15.115:0/2331371775 shutdown_connections 2023-07-27T14:28:31.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.093+0000 7f31d07ff700 1 -- 172.21.15.115:0/2331371775 wait complete. 2023-07-27T14:28:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.095+0000 7f31d07ff700 1 Processor -- start 2023-07-27T14:28:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.095+0000 7f31d07ff700 1 -- start start 2023-07-27T14:28:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31d07ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c80bc350 0x7f31c8140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31d07ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c8153ed0 0x7f31c80ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31d07ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c81542b0 0x7f31c80ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31d07ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80accf0 con 0x7f31c81542b0 2023-07-27T14:28:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31d07ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8140670 con 0x7f31c80bc350 2023-07-27T14:28:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31d07ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80a9e60 con 0x7f31c8153ed0 2023-07-27T14:28:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31ced9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c81542b0 0x7f31c80ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31ced9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c81542b0 0x7f31c80ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41892/0 (socket says 172.21.15.115:41892) 2023-07-27T14:28:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.096+0000 7f31ced9c700 1 -- 172.21.15.115:0/2015339412 learned_addr learned my addr 172.21.15.115:0/2015339412 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31ce59b700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c80bc350 0x7f31c8140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31cdd9a700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c8153ed0 0x7f31c80ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31ced9c700 1 -- 172.21.15.115:0/2015339412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c8153ed0 msgr2=0x7f31c80ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31ced9c700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c8153ed0 0x7f31c80ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31ced9c700 1 -- 172.21.15.115:0/2015339412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c80bc350 msgr2=0x7f31c8140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31ced9c700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c80bc350 0x7f31c8140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31ced9c700 1 -- 172.21.15.115:0/2015339412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8009370 con 0x7f31c81542b0 2023-07-27T14:28:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31ced9c700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c81542b0 0x7f31c80ac800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f31c000a380 tx=0x7f31c0007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31be7fc700 1 -- 172.21.15.115:0/2015339412 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0016470 con 0x7f31c81542b0 2023-07-27T14:28:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31be7fc700 1 -- 172.21.15.115:0/2015339412 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00165d0 con 0x7f31c81542b0 2023-07-27T14:28:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31be7fc700 1 -- 172.21.15.115:0/2015339412 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0016950 con 0x7f31c81542b0 2023-07-27T14:28:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c80a7930 con 0x7f31c81542b0 2023-07-27T14:28:31.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.097+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c80a7000 con 0x7f31c81542b0 2023-07-27T14:28:31.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.098+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c80a7ac0 con 0x7f31c81542b0 2023-07-27T14:28:31.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.099+0000 7f31be7fc700 1 -- 172.21.15.115:0/2015339412 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 75282+0+0 (secure 0 0 0) 0x7f31c000d440 con 0x7f31c81542b0 2023-07-27T14:28:31.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.100+0000 7f31be7fc700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31ac05edd0 0x7f31ac061290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:31.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.100+0000 7f31be7fc700 1 -- 172.21.15.115:0/2015339412 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f31c007acf0 con 0x7f31c81542b0 2023-07-27T14:28:31.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.101+0000 7f31ce59b700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31ac05edd0 0x7f31ac061290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:31.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.101+0000 7f31ce59b700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31ac05edd0 0x7f31ac061290 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f31c40038b0 tx=0x7f31c4007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:31.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.104+0000 7f31be7fc700 1 -- 172.21.15.115:0/2015339412 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31c004c120 con 0x7f31c81542b0 2023-07-27T14:28:31.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.314+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000959786", "target": ["mon-mgr", ""]}) v1 -- 0x7f31c80c7780 con 0x7f31ac05edd0 2023-07-27T14:28:31.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.321+0000 7f31be7fc700 1 -- 172.21.15.115:0/2015339412 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f31c80c7780 con 0x7f31ac05edd0 2023-07-27T14:28:31.343 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:28:31.343 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:28:31.343 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:28:31.343 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:28:31.344 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:28:31.344 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000967963", 2023-07-27T14:28:31.344 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000226505" 2023-07-27T14:28:31.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:31.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:31.344 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:28:31.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31ac05edd0 msgr2=0x7f31ac061290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:31.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31ac05edd0 0x7f31ac061290 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f31c40038b0 tx=0x7f31c4007d20).stop 2023-07-27T14:28:31.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c81542b0 msgr2=0x7f31c80ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:31.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c81542b0 0x7f31c80ac800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f31c000a380 tx=0x7f31c0007900).stop 2023-07-27T14:28:31.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 shutdown_connections 2023-07-27T14:28:31.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31ac05edd0 0x7f31ac061290 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c81542b0 0x7f31c80ac800 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c80bc350 0x7f31c8140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 --2- 172.21.15.115:0/2015339412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c8153ed0 0x7f31c80ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:31.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 >> 172.21.15.115:0/2015339412 conn(0x7f31c8062df0 msgr2=0x7f31c80c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:31.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 shutdown_connections 2023-07-27T14:28:31.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:31.323+0000 7f31d07ff700 1 -- 172.21.15.115:0/2015339412 wait complete. 2023-07-27T14:28:32.361 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000959786 2023-07-27T14:28:32.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.541+0000 7fe989fff700 1 Processor -- start 2023-07-27T14:28:32.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.542+0000 7fe989fff700 1 -- start start 2023-07-27T14:28:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.543+0000 7fe989fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe984063260 0x7fe984154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.543+0000 7fe989fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9841553f0 con 0x7fe98414ae00 2023-07-27T14:28:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.543+0000 7fe989fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe984157a50 con 0x7fe98414b1e0 2023-07-27T14:28:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.543+0000 7fe989fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe984157d10 con 0x7fe984063260 2023-07-27T14:28:32.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.543+0000 7fe9837fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe98414ae00 0x7fe984062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56604/0 (socket says 172.21.15.115:56604) 2023-07-27T14:28:32.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.543+0000 7fe9837fe700 1 -- 172.21.15.115:0/3302844698 learned_addr learned my addr 172.21.15.115:0/3302844698 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:32.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.543+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054423007 0 0) 0x7fe9841553f0 con 0x7fe98414ae00 2023-07-27T14:28:32.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.543+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe96c0033f0 con 0x7fe98414ae00 2023-07-27T14:28:32.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe982ffd700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe984063260 0x7fe984154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:32.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776742460 0 0) 0x7fe96c0033f0 con 0x7fe98414ae00 2023-07-27T14:28:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe984063260 msgr2=0x7fe984154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe984063260 0x7fe984154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 >> v1:172.21.15.159:6789/0 conn(0x7fe98414b1e0 legacy=0x7fe9840a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984157ff0 con 0x7fe98414ae00 2023-07-27T14:28:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fe974001470 con 0x7fe98414ae00 2023-07-27T14:28:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 >> v1:172.21.15.115:6789/0 conn(0x7fe98414ae00 legacy=0x7fe984062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe96c003910 0x7fe96c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe96c004690 0x7fe96c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c005000 0x7fe96c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe984157d10 con 0x7fe96c003910 2023-07-27T14:28:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c00bf60 con 0x7fe96c005000 2023-07-27T14:28:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c00c0a0 con 0x7fe96c004690 2023-07-27T14:28:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe9837fe700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe96c003910 0x7fe96c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe983fff700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c005000 0x7fe96c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.544+0000 7fe982ffd700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe96c004690 0x7fe96c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9837fe700 1 -- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe96c004690 msgr2=0x7fe96c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9837fe700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe96c004690 0x7fe96c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9837fe700 1 -- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c005000 msgr2=0x7fe96c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9837fe700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c005000 0x7fe96c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9837fe700 1 -- 172.21.15.115:0/3302844698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0033f0 con 0x7fe96c003910 2023-07-27T14:28:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe982ffd700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe96c004690 0x7fe96c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe983fff700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c005000 0x7fe96c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9837fe700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe96c003910 0x7fe96c003d10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fe97400c190 tx=0x7fe98414eb20).ready entity=mon.0 client_cookie=27c53c476cdcaf43 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400ca40 con 0x7fe96c003910 2023-07-27T14:28:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97400cba0 con 0x7fe96c003910 2023-07-27T14:28:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe9827fc700 1 -- 172.21.15.115:0/3302844698 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9740070d0 con 0x7fe96c003910 2023-07-27T14:28:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe989fff700 1 -- 172.21.15.115:0/3302844698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe96c003910 msgr2=0x7fe96c003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe989fff700 1 --2- 172.21.15.115:0/3302844698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe96c003910 0x7fe96c003d10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fe97400c190 tx=0x7fe98414eb20).stop 2023-07-27T14:28:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe983fff700 1 -- 172.21.15.115:0/3302844698 reap_dead start 2023-07-27T14:28:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe989fff700 1 -- 172.21.15.115:0/3302844698 shutdown_connections 2023-07-27T14:28:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.545+0000 7fe989fff700 1 -- 172.21.15.115:0/3302844698 >> 172.21.15.115:0/3302844698 conn(0x7fe98405e940 msgr2=0x7fe9840cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:32.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.546+0000 7fe989fff700 1 -- 172.21.15.115:0/3302844698 shutdown_connections 2023-07-27T14:28:32.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.546+0000 7fe989fff700 1 -- 172.21.15.115:0/3302844698 wait complete. 2023-07-27T14:28:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.547+0000 7fe989fff700 1 Processor -- start 2023-07-27T14:28:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.547+0000 7fe989fff700 1 -- start start 2023-07-27T14:28:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe989fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c003910 0x7fe9840aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe989fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9840af4a0 0x7fe9840adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe989fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9840ae050 0x7fe9840ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe989fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840ae9c0 con 0x7fe9840af4a0 2023-07-27T14:28:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe989fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840afca0 con 0x7fe96c003910 2023-07-27T14:28:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe989fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840aff80 con 0x7fe9840ae050 2023-07-27T14:28:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe982ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9840af4a0 0x7fe9840adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe982ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9840af4a0 0x7fe9840adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41922/0 (socket says 172.21.15.115:41922) 2023-07-27T14:28:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.548+0000 7fe982ffd700 1 -- 172.21.15.115:0/1987777983 learned_addr learned my addr 172.21.15.115:0/1987777983 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe982ffd700 1 -- 172.21.15.115:0/1987777983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9840ae050 msgr2=0x7fe9840ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe982ffd700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9840ae050 0x7fe9840ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe982ffd700 1 -- 172.21.15.115:0/1987777983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c003910 msgr2=0x7fe9840aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe982ffd700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c003910 0x7fe9840aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe982ffd700 1 -- 172.21.15.115:0/1987777983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9840b0260 con 0x7fe9840af4a0 2023-07-27T14:28:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe982ffd700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9840af4a0 0x7fe9840adb60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fe97800f5c0 tx=0x7fe978008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe96b7fe700 1 -- 172.21.15.115:0/1987777983 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978013610 con 0x7fe9840af4a0 2023-07-27T14:28:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe96b7fe700 1 -- 172.21.15.115:0/1987777983 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe978013770 con 0x7fe9840af4a0 2023-07-27T14:28:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe984155750 con 0x7fe9840af4a0 2023-07-27T14:28:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe96b7fe700 1 -- 172.21.15.115:0/1987777983 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978013af0 con 0x7fe9840af4a0 2023-07-27T14:28:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.549+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9840af920 con 0x7fe9840af4a0 2023-07-27T14:28:32.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.550+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe984155bf0 con 0x7fe9840af4a0 2023-07-27T14:28:32.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.551+0000 7fe96b7fe700 1 -- 172.21.15.115:0/1987777983 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 6) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fe978023070 con 0x7fe9840af4a0 2023-07-27T14:28:32.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.552+0000 7fe96b7fe700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe97005ede0 0x7fe9700612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:32.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.552+0000 7fe96b7fe700 1 -- 172.21.15.115:0/1987777983 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe978079de0 con 0x7fe9840af4a0 2023-07-27T14:28:32.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.552+0000 7fe9837fe700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe97005ede0 0x7fe9700612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:32.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.553+0000 7fe9837fe700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe97005ede0 0x7fe9700612a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fe97400c190 tx=0x7fe974015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:32.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.557+0000 7fe96b7fe700 1 -- 172.21.15.115:0/1987777983 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe97804b250 con 0x7fe9840af4a0 2023-07-27T14:28:32.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.767+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000959786", "target": ["mon-mgr", ""]}) v1 -- 0x7fe984155da0 con 0x7fe97005ede0 2023-07-27T14:28:32.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.773+0000 7fe96b7fe700 1 -- 172.21.15.115:0/1987777983 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7fe984155da0 con 0x7fe97005ede0 2023-07-27T14:28:32.794 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:28:32.794 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:28:32.794 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:28:32.794 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:28:32.794 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:28:32.794 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000967963", 2023-07-27T14:28:32.794 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000226505" 2023-07-27T14:28:32.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:32.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:32.795 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:28:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe97005ede0 msgr2=0x7fe9700612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe97005ede0 0x7fe9700612a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fe97400c190 tx=0x7fe974015000).stop 2023-07-27T14:28:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9840af4a0 msgr2=0x7fe9840adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9840af4a0 0x7fe9840adb60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fe97800f5c0 tx=0x7fe978008040).stop 2023-07-27T14:28:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 shutdown_connections 2023-07-27T14:28:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe97005ede0 0x7fe9700612a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9840ae050 0x7fe9840ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe96c003910 0x7fe9840aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 --2- 172.21.15.115:0/1987777983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9840af4a0 0x7fe9840adb60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.775+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 >> 172.21.15.115:0/1987777983 conn(0x7fe98405e940 msgr2=0x7fe9840c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.776+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 shutdown_connections 2023-07-27T14:28:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:32.776+0000 7fe989fff700 1 -- 172.21.15.115:0/1987777983 wait complete. 2023-07-27T14:28:33.813 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000959786 2023-07-27T14:28:34.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.993+0000 7f7be47ff700 1 Processor -- start 2023-07-27T14:28:34.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.993+0000 7f7be47ff700 1 -- start start 2023-07-27T14:28:34.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.994+0000 7f7be47ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7bdc14ae00 0x7f7bdc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.994+0000 7f7be47ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.994+0000 7f7be47ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc1553f0 con 0x7f7bdc0c5c50 2023-07-27T14:28:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.994+0000 7f7be47ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc157a50 con 0x7f7bdc14ae00 2023-07-27T14:28:34.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.994+0000 7f7be47ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc157d10 con 0x7f7bdc14b1e0 2023-07-27T14:28:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.994+0000 7f7be2d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7bdc0c5c50 0x7f7bdc0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46610/0 (socket says 172.21.15.115:46610) 2023-07-27T14:28:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.994+0000 7f7be2d9c700 1 -- 172.21.15.115:0/3462297398 learned_addr learned my addr 172.21.15.115:0/3462297398 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be259b700 1 --2- 172.21.15.115:0/3462297398 >> v2:172.21.15.159:3300/0 conn(0x7f7bdc14ae00 0x7f7bdc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be1d9a700 1 --2- 172.21.15.115:0/3462297398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be1599700 1 -- 172.21.15.115:0/3462297398 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312600659 0 0) 0x7f7bdc1553f0 con 0x7f7bdc0c5c50 2023-07-27T14:28:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be1599700 1 -- 172.21.15.115:0/3462297398 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc80033f0 con 0x7f7bdc0c5c50 2023-07-27T14:28:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be259b700 1 -- 172.21.15.115:0/3462297398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 msgr2=0x7f7bdc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be259b700 1 --2- 172.21.15.115:0/3462297398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be259b700 1 -- 172.21.15.115:0/3462297398 >> v1:172.21.15.115:6789/0 conn(0x7f7bdc0c5c50 legacy=0x7f7bdc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be259b700 1 -- 172.21.15.115:0/3462297398 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc157ff0 con 0x7f7bdc14ae00 2023-07-27T14:28:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.995+0000 7f7be259b700 1 --2- 172.21.15.115:0/3462297398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc154f00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7bd8009760 tx=0x7f7bd8009060).ready entity=mon.1 client_cookie=ea69bb955d917c4d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be1599700 1 -- 172.21.15.115:0/3462297398 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800d4a0 con 0x7f7bdc14ae00 2023-07-27T14:28:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be1599700 1 -- 172.21.15.115:0/3462297398 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800d600 con 0x7f7bdc14ae00 2023-07-27T14:28:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be1599700 1 -- 172.21.15.115:0/3462297398 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800d980 con 0x7f7bdc14ae00 2023-07-27T14:28:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be47ff700 1 -- 172.21.15.115:0/3462297398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc14ae00 msgr2=0x7f7bdc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be47ff700 1 --2- 172.21.15.115:0/3462297398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc154f00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7bd8009760 tx=0x7f7bd8009060).stop 2023-07-27T14:28:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be47ff700 1 -- 172.21.15.115:0/3462297398 shutdown_connections 2023-07-27T14:28:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be47ff700 1 --2- 172.21.15.115:0/3462297398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc154f00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be47ff700 1 --2- 172.21.15.115:0/3462297398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be47ff700 1 -- 172.21.15.115:0/3462297398 >> 172.21.15.115:0/3462297398 conn(0x7f7bdc05e940 msgr2=0x7f7bdc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be47ff700 1 -- 172.21.15.115:0/3462297398 shutdown_connections 2023-07-27T14:28:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.996+0000 7f7be47ff700 1 -- 172.21.15.115:0/3462297398 wait complete. 2023-07-27T14:28:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.998+0000 7f7be47ff700 1 Processor -- start 2023-07-27T14:28:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.998+0000 7f7be47ff700 1 -- start start 2023-07-27T14:28:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be47ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc0c5c50 0x7f7bdc14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be47ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc062a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be47ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be47ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc063440 con 0x7f7bdc14ae00 2023-07-27T14:28:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be47ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0c1c50 con 0x7f7bdc0c5c50 2023-07-27T14:28:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be47ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc157320 con 0x7f7bdc14b1e0 2023-07-27T14:28:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc062a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57382/0 (socket says 172.21.15.115:57382) 2023-07-27T14:28:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 -- 172.21.15.115:0/895894238 learned_addr learned my addr 172.21.15.115:0/895894238 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be259b700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc0c5c50 0x7f7bdc14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be2d9c700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 -- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 msgr2=0x7f7bdc062f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 -- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc0c5c50 msgr2=0x7f7bdc14a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc0c5c50 0x7f7bdc14a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 -- 172.21.15.115:0/895894238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd80092a0 con 0x7f7bdc14ae00 2023-07-27T14:28:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be259b700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc0c5c50 0x7f7bdc14a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be2d9c700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:33.999+0000 7f7be1d9a700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc062a60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f7bcc00e8d0 tx=0x7f7bcc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.000+0000 7f7bd27fc700 1 -- 172.21.15.115:0/895894238 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00c640 con 0x7f7bdc14ae00 2023-07-27T14:28:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.000+0000 7f7bd27fc700 1 -- 172.21.15.115:0/895894238 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc00c7a0 con 0x7f7bdc14ae00 2023-07-27T14:28:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.000+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc157600 con 0x7f7bdc14ae00 2023-07-27T14:28:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.000+0000 7f7bd27fc700 1 -- 172.21.15.115:0/895894238 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00cb20 con 0x7f7bdc14ae00 2023-07-27T14:28:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.000+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc0c2200 con 0x7f7bdc14ae00 2023-07-27T14:28:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.001+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc0c2390 con 0x7f7bdc14ae00 2023-07-27T14:28:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.002+0000 7f7bd27fc700 1 -- 172.21.15.115:0/895894238 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 6) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f7bcc022070 con 0x7f7bdc14ae00 2023-07-27T14:28:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.002+0000 7f7bd27fc700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7bc005ede0 0x7f7bc00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.002+0000 7f7bd27fc700 1 -- 172.21.15.115:0/895894238 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7bcc07a0c0 con 0x7f7bdc14ae00 2023-07-27T14:28:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.003+0000 7f7be259b700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7bc005ede0 0x7f7bc00612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:34.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.003+0000 7f7be259b700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7bc005ede0 0x7f7bc00612a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7bd800d260 tx=0x7f7bd8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:34.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.007+0000 7f7bd27fc700 1 -- 172.21.15.115:0/895894238 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7bcc04b480 con 0x7f7bdc14ae00 2023-07-27T14:28:34.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.217+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000959786", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bdc06c470 con 0x7f7bc005ede0 2023-07-27T14:28:34.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.223+0000 7f7bd27fc700 1 -- 172.21.15.115:0/895894238 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f7bdc06c470 con 0x7f7bc005ede0 2023-07-27T14:28:34.243 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:28:34.244 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:28:34.244 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:28:34.244 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:28:34.244 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:28:34.244 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000967963", 2023-07-27T14:28:34.244 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000226505" 2023-07-27T14:28:34.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:34.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:34.245 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:28:34.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7bc005ede0 msgr2=0x7f7bc00612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:34.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7bc005ede0 0x7f7bc00612a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7bd800d260 tx=0x7f7bd8016000).stop 2023-07-27T14:28:34.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bdc14ae00 msgr2=0x7f7bdc062a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:34.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc062a60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f7bcc00e8d0 tx=0x7f7bcc009060).stop 2023-07-27T14:28:34.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 shutdown_connections 2023-07-27T14:28:34.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7bc005ede0 0x7f7bc00612a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7bdc14b1e0 0x7f7bdc062f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bdc0c5c50 0x7f7bdc14a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 --2- 172.21.15.115:0/895894238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bdc14ae00 0x7f7bdc062a60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 >> 172.21.15.115:0/895894238 conn(0x7f7bdc05e940 msgr2=0x7f7bdc1528b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 shutdown_connections 2023-07-27T14:28:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:34.225+0000 7f7be47ff700 1 -- 172.21.15.115:0/895894238 wait complete. 2023-07-27T14:28:35.263 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000959786 2023-07-27T14:28:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.442+0000 7f6bd73ff700 1 Processor -- start 2023-07-27T14:28:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.443+0000 7f6bd73ff700 1 -- start start 2023-07-27T14:28:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 0x7f6bd0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd73ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bd014b1e0 0x7f6bd0062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd73ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd01553f0 con 0x7f6bd00c5c50 2023-07-27T14:28:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd73ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd0157a50 con 0x7f6bd014b1e0 2023-07-27T14:28:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0157d10 con 0x7f6bd014ae00 2023-07-27T14:28:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd499a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bd014b1e0 0x7f6bd0062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:35.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd499a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bd014b1e0 0x7f6bd0062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57386/0 (socket says 172.21.15.115:57386) 2023-07-27T14:28:35.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd499a700 1 -- 172.21.15.115:0/1198627661 learned_addr learned my addr 172.21.15.115:0/1198627661 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:35.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd599c700 1 --1- 172.21.15.115:0/1198627661 >> v1:172.21.15.115:6789/0 conn(0x7f6bd00c5c50 0x7f6bd00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46616/0 (socket says 172.21.15.115:46616) 2023-07-27T14:28:35.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.444+0000 7f6bd519b700 1 --2- 172.21.15.115:0/1198627661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 0x7f6bd0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:35.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bd499a700 1 -- 172.21.15.115:0/1198627661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 msgr2=0x7f6bd0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:35.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bd499a700 1 --2- 172.21.15.115:0/1198627661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 0x7f6bd0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bd499a700 1 -- 172.21.15.115:0/1198627661 >> v1:172.21.15.115:6789/0 conn(0x7f6bd00c5c50 legacy=0x7f6bd00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:35.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bc7fff700 1 -- 172.21.15.115:0/1198627661 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728207868 0 0) 0x7f6bd01553f0 con 0x7f6bd00c5c50 2023-07-27T14:28:35.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bd499a700 1 -- 172.21.15.115:0/1198627661 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0157ff0 con 0x7f6bd014b1e0 2023-07-27T14:28:35.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bd499a700 1 --2- 172.21.15.115:0/1198627661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd014b1e0 0x7f6bd0062b50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f6bc0006fd0 tx=0x7f6bc00090f0).ready entity=mon.0 client_cookie=e986e0a305f419cb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:35.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bc7fff700 1 -- 172.21.15.115:0/1198627661 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000b600 con 0x7f6bd014b1e0 2023-07-27T14:28:35.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bc7fff700 1 -- 172.21.15.115:0/1198627661 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000b760 con 0x7f6bd014b1e0 2023-07-27T14:28:35.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.445+0000 7f6bc7fff700 1 -- 172.21.15.115:0/1198627661 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000bae0 con 0x7f6bd014b1e0 2023-07-27T14:28:35.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.446+0000 7f6bd73ff700 1 -- 172.21.15.115:0/1198627661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd014b1e0 msgr2=0x7f6bd0062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:35.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.446+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/1198627661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd014b1e0 0x7f6bd0062b50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f6bc0006fd0 tx=0x7f6bc00090f0).stop 2023-07-27T14:28:35.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.446+0000 7f6bd73ff700 1 -- 172.21.15.115:0/1198627661 shutdown_connections 2023-07-27T14:28:35.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.446+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/1198627661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 0x7f6bd0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.446+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/1198627661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd014b1e0 0x7f6bd0062b50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.446+0000 7f6bd73ff700 1 -- 172.21.15.115:0/1198627661 >> 172.21.15.115:0/1198627661 conn(0x7f6bd005e940 msgr2=0x7f6bd00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:35.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.446+0000 7f6bd73ff700 1 -- 172.21.15.115:0/1198627661 shutdown_connections 2023-07-27T14:28:35.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.446+0000 7f6bd73ff700 1 -- 172.21.15.115:0/1198627661 wait complete. 2023-07-27T14:28:35.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.447+0000 7f6bd73ff700 1 Processor -- start 2023-07-27T14:28:35.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.447+0000 7f6bd73ff700 1 -- start start 2023-07-27T14:28:35.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd73ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd00c5c50 0x7f6bd014a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:35.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 0x7f6bd0149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:35.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd73ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd014b1e0 0x7f6bd0155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:35.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd73ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd014abe0 con 0x7f6bd00c5c50 2023-07-27T14:28:35.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd73ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00c1c50 con 0x7f6bd014b1e0 2023-07-27T14:28:35.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00c1f30 con 0x7f6bd014ae00 2023-07-27T14:28:35.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd519b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd00c5c50 0x7f6bd014a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:35.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd519b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd00c5c50 0x7f6bd014a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57394/0 (socket says 172.21.15.115:57394) 2023-07-27T14:28:35.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.448+0000 7f6bd519b700 1 -- 172.21.15.115:0/962399383 learned_addr learned my addr 172.21.15.115:0/962399383 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:35.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd499a700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 0x7f6bd0149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd599c700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd014b1e0 0x7f6bd0155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd519b700 1 -- 172.21.15.115:0/962399383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 msgr2=0x7f6bd0149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd519b700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 0x7f6bd0149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd519b700 1 -- 172.21.15.115:0/962399383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd014b1e0 msgr2=0x7f6bd0155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd519b700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd014b1e0 0x7f6bd0155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd519b700 1 -- 172.21.15.115:0/962399383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009370 con 0x7f6bd00c5c50 2023-07-27T14:28:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd519b700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd00c5c50 0x7f6bd014a6f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f6bcc00d890 tx=0x7f6bcc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:35.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bc57fa700 1 -- 172.21.15.115:0/962399383 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc0125f0 con 0x7f6bd00c5c50 2023-07-27T14:28:35.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bc57fa700 1 -- 172.21.15.115:0/962399383 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc012750 con 0x7f6bd00c5c50 2023-07-27T14:28:35.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd00c2210 con 0x7f6bd00c5c50 2023-07-27T14:28:35.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bc57fa700 1 -- 172.21.15.115:0/962399383 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc012ad0 con 0x7f6bd00c5c50 2023-07-27T14:28:35.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.449+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd00c27d0 con 0x7f6bd00c5c50 2023-07-27T14:28:35.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.450+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd006c470 con 0x7f6bd00c5c50 2023-07-27T14:28:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.451+0000 7f6bc57fa700 1 -- 172.21.15.115:0/962399383 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 6) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f6bcc013480 con 0x7f6bd00c5c50 2023-07-27T14:28:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.452+0000 7f6bc57fa700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bb405ede0 0x7f6bb40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.452+0000 7f6bc57fa700 1 -- 172.21.15.115:0/962399383 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6bcc079b20 con 0x7f6bd00c5c50 2023-07-27T14:28:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.452+0000 7f6bd499a700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bb405ede0 0x7f6bb40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:35.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.453+0000 7f6bd499a700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bb405ede0 0x7f6bb40612a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6bd00c1c00 tx=0x7f6bc0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:35.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.456+0000 7f6bc57fa700 1 -- 172.21.15.115:0/962399383 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bcc04af90 con 0x7f6bd00c5c50 2023-07-27T14:28:35.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.665+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000959786", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bd0153eb0 con 0x7f6bb405ede0 2023-07-27T14:28:35.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.671+0000 7f6bc57fa700 1 -- 172.21.15.115:0/962399383 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f6bd0153eb0 con 0x7f6bb405ede0 2023-07-27T14:28:35.692 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:28:35.692 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:28:35.692 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:28:35.692 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:28:35.692 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:28:35.692 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000967963", 2023-07-27T14:28:35.692 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000226505" 2023-07-27T14:28:35.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:35.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:35.693 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:28:35.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bb405ede0 msgr2=0x7f6bb40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:35.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bb405ede0 0x7f6bb40612a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6bd00c1c00 tx=0x7f6bc0017000).stop 2023-07-27T14:28:35.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd00c5c50 msgr2=0x7f6bd014a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:35.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd00c5c50 0x7f6bd014a6f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f6bcc00d890 tx=0x7f6bcc008040).stop 2023-07-27T14:28:35.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 shutdown_connections 2023-07-27T14:28:35.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bb405ede0 0x7f6bb40612a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bd014b1e0 0x7f6bd0155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bd00c5c50 0x7f6bd014a6f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 --2- 172.21.15.115:0/962399383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bd014ae00 0x7f6bd0149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:35.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 >> 172.21.15.115:0/962399383 conn(0x7f6bd005e940 msgr2=0x7f6bd00aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:35.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 shutdown_connections 2023-07-27T14:28:35.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:35.673+0000 7f6bd73ff700 1 -- 172.21.15.115:0/962399383 wait complete. 2023-07-27T14:28:36.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000959786 2023-07-27T14:28:36.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.890+0000 7fd7857ff700 1 Processor -- start 2023-07-27T14:28:36.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.890+0000 7fd7857ff700 1 -- start start 2023-07-27T14:28:36.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.891+0000 7fd7857ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd78014ae00 0x7fd780154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:36.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.891+0000 7fd7857ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd780063260 0x7fd7800a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:36.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.891+0000 7fd7857ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7801553f0 con 0x7fd78014b1e0 2023-07-27T14:28:36.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.891+0000 7fd7857ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd780157a50 con 0x7fd78014ae00 2023-07-27T14:28:36.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.891+0000 7fd7857ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd780157d10 con 0x7fd780063260 2023-07-27T14:28:36.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.891+0000 7fd77effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd78014ae00 0x7fd780154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:36.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.891+0000 7fd77effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd78014ae00 0x7fd780154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57396/0 (socket says 172.21.15.115:57396) 2023-07-27T14:28:36.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77effd700 1 -- 172.21.15.115:0/4187473046 learned_addr learned my addr 172.21.15.115:0/4187473046 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:36.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77e7fc700 1 --1- 172.21.15.115:0/4187473046 >> v1:172.21.15.115:6789/0 conn(0x7fd78014b1e0 0x7fd780062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46630/0 (socket says 172.21.15.115:46630) 2023-07-27T14:28:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77effd700 1 -- 172.21.15.115:0/4187473046 >> v2:172.21.15.159:3300/0 conn(0x7fd780063260 msgr2=0x7fd7800a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77effd700 1 --2- 172.21.15.115:0/4187473046 >> v2:172.21.15.159:3300/0 conn(0x7fd780063260 0x7fd7800a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77effd700 1 -- 172.21.15.115:0/4187473046 >> v1:172.21.15.115:6789/0 conn(0x7fd78014b1e0 legacy=0x7fd780062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77effd700 1 -- 172.21.15.115:0/4187473046 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780157ff0 con 0x7fd78014ae00 2023-07-27T14:28:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77dffb700 1 -- 172.21.15.115:0/4187473046 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107055707 0 0) 0x7fd7801553f0 con 0x7fd78014b1e0 2023-07-27T14:28:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77effd700 1 --2- 172.21.15.115:0/4187473046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014ae00 0x7fd780154f00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fd780083430 tx=0x7fd7700090f0).ready entity=mon.0 client_cookie=91923de269f32bd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:36.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77dffb700 1 -- 172.21.15.115:0/4187473046 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000b600 con 0x7fd78014ae00 2023-07-27T14:28:36.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77dffb700 1 -- 172.21.15.115:0/4187473046 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000b760 con 0x7fd78014ae00 2023-07-27T14:28:36.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.892+0000 7fd77dffb700 1 -- 172.21.15.115:0/4187473046 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000bae0 con 0x7fd78014ae00 2023-07-27T14:28:36.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.893+0000 7fd7857ff700 1 -- 172.21.15.115:0/4187473046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014ae00 msgr2=0x7fd780154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:36.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.893+0000 7fd7857ff700 1 --2- 172.21.15.115:0/4187473046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014ae00 0x7fd780154f00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fd780083430 tx=0x7fd7700090f0).stop 2023-07-27T14:28:36.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.893+0000 7fd7857ff700 1 -- 172.21.15.115:0/4187473046 shutdown_connections 2023-07-27T14:28:36.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.893+0000 7fd7857ff700 1 --2- 172.21.15.115:0/4187473046 >> v2:172.21.15.159:3300/0 conn(0x7fd780063260 0x7fd7800a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:36.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.893+0000 7fd7857ff700 1 --2- 172.21.15.115:0/4187473046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014ae00 0x7fd780154f00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:36.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.893+0000 7fd7857ff700 1 -- 172.21.15.115:0/4187473046 >> 172.21.15.115:0/4187473046 conn(0x7fd78005e940 msgr2=0x7fd7800cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:36.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.893+0000 7fd7857ff700 1 -- 172.21.15.115:0/4187473046 shutdown_connections 2023-07-27T14:28:36.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.893+0000 7fd7857ff700 1 -- 172.21.15.115:0/4187473046 wait complete. 2023-07-27T14:28:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.895+0000 7fd7857ff700 1 Processor -- start 2023-07-27T14:28:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.895+0000 7fd7857ff700 1 -- start start 2023-07-27T14:28:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.896+0000 7fd7857ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd780063260 0x7fd7800c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.896+0000 7fd7857ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd78014ae00 0x7fd780163f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd7857ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014b1e0 0x7fd7800b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:36.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd7857ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7801678d0 con 0x7fd78014b1e0 2023-07-27T14:28:36.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd7857ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7801675d0 con 0x7fd780063260 2023-07-27T14:28:36.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd7857ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd780164800 con 0x7fd78014ae00 2023-07-27T14:28:36.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014b1e0 0x7fd7800b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:36.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014b1e0 0x7fd7800b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57410/0 (socket says 172.21.15.115:57410) 2023-07-27T14:28:36.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 -- 172.21.15.115:0/3949289490 learned_addr learned my addr 172.21.15.115:0/3949289490 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:36.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77effd700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd780063260 0x7fd7800c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:36.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77e7fc700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd78014ae00 0x7fd780163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:36.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 -- 172.21.15.115:0/3949289490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd78014ae00 msgr2=0x7fd780163f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:36.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd78014ae00 0x7fd780163f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:36.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 -- 172.21.15.115:0/3949289490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd780063260 msgr2=0x7fd7800c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:36.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd780063260 0x7fd7800c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:36.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 -- 172.21.15.115:0/3949289490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770009370 con 0x7fd78014b1e0 2023-07-27T14:28:36.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.897+0000 7fd77f7fe700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014b1e0 0x7fd7800b0590 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fd77800bb60 tx=0x7fd778009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:36.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.898+0000 7fd766ffd700 1 -- 172.21.15.115:0/3949289490 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800c8c0 con 0x7fd78014b1e0 2023-07-27T14:28:36.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.898+0000 7fd766ffd700 1 -- 172.21.15.115:0/3949289490 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77800ca40 con 0x7fd78014b1e0 2023-07-27T14:28:36.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.898+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd780164ae0 con 0x7fd78014b1e0 2023-07-27T14:28:36.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.898+0000 7fd766ffd700 1 -- 172.21.15.115:0/3949289490 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800cbf0 con 0x7fd78014b1e0 2023-07-27T14:28:36.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.898+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7801643f0 con 0x7fd78014b1e0 2023-07-27T14:28:36.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.899+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd780167a80 con 0x7fd78014b1e0 2023-07-27T14:28:36.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.900+0000 7fd766ffd700 1 -- 172.21.15.115:0/3949289490 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 6) v1 ==== 75362+0+0 (secure 0 0 0) 0x7fd778015420 con 0x7fd78014b1e0 2023-07-27T14:28:36.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.901+0000 7fd766ffd700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd76c05ede0 0x7fd76c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:36.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.901+0000 7fd766ffd700 1 -- 172.21.15.115:0/3949289490 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd77807a110 con 0x7fd78014b1e0 2023-07-27T14:28:36.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.901+0000 7fd77effd700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd76c05ede0 0x7fd76c0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:36.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.901+0000 7fd77effd700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd76c05ede0 0x7fd76c0612a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fd770009fd0 tx=0x7fd770017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:36.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:36.906+0000 7fd766ffd700 1 -- 172.21.15.115:0/3949289490 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd780167a80 con 0x7fd78014b1e0 2023-07-27T14:28:37.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:37.119+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000959786", "target": ["mon-mgr", ""]}) v1 -- 0x7fd78006c470 con 0x7fd76c05ede0 2023-07-27T14:28:41.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.080+0000 7fd766ffd700 1 -- 172.21.15.115:0/3949289490 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+305 (secure 0 0 0) 0x7fd78006c470 con 0x7fd76c05ede0 2023-07-27T14:28:41.102 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:28:41.102 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:28:41.102 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "failed", 2023-07-27T14:28:41.102 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:28:41.102 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:28:41.103 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000967963", 2023-07-27T14:28:41.103 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000226505" 2023-07-27T14:28:41.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:28:41.103 INFO:teuthology.orchestra.run.smithi115.stdout: "failure": { 2023-07-27T14:28:41.103 INFO:teuthology.orchestra.run.smithi115.stdout: "errno": "2", 2023-07-27T14:28:41.103 INFO:teuthology.orchestra.run.smithi115.stdout: "error_msg": "snapshot 'snapshot_0000000000226505' does not exist" 2023-07-27T14:28:41.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:41.104 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:41.104 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:28:41.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd76c05ede0 msgr2=0x7fd76c0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd76c05ede0 0x7fd76c0612a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fd770009fd0 tx=0x7fd770017000).stop 2023-07-27T14:28:41.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014b1e0 msgr2=0x7fd7800b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014b1e0 0x7fd7800b0590 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fd77800bb60 tx=0x7fd778009810).stop 2023-07-27T14:28:41.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 shutdown_connections 2023-07-27T14:28:41.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd76c05ede0 0x7fd76c0612a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd78014b1e0 0x7fd7800b0590 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd780063260 0x7fd7800c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 --2- 172.21.15.115:0/3949289490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd78014ae00 0x7fd780163f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 >> 172.21.15.115:0/3949289490 conn(0x7fd78005e940 msgr2=0x7fd78014a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:41.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 shutdown_connections 2023-07-27T14:28:41.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.083+0000 7fd7857ff700 1 -- 172.21.15.115:0/3949289490 wait complete. 2023-07-27T14:28:41.125 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000959786 2023-07-27T14:28:41.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.297+0000 7f40ed7ff700 1 Processor -- start 2023-07-27T14:28:41.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.297+0000 7f40ed7ff700 1 -- start start 2023-07-27T14:28:41.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.298+0000 7f40ed7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f40e8153e00 0x7f40e80c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.298+0000 7f40ed7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8065de0 0x7f40e8062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.298+0000 7f40ed7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e8064a80 con 0x7f40e8064230 2023-07-27T14:28:41.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.298+0000 7f40ed7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e8062320 con 0x7f40e8153e00 2023-07-27T14:28:41.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.298+0000 7f40ed7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8064d60 con 0x7f40e8065de0 2023-07-27T14:28:41.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f40e8153e00 0x7f40e80c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f40e8153e00 0x7f40e80c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57412/0 (socket says 172.21.15.115:57412) 2023-07-27T14:28:41.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e6ffd700 1 -- 172.21.15.115:0/1879651136 learned_addr learned my addr 172.21.15.115:0/1879651136 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:41.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e77fe700 1 --2- 172.21.15.115:0/1879651136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8065de0 0x7f40e8062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e6ffd700 1 -- 172.21.15.115:0/1879651136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8065de0 msgr2=0x7f40e8062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:41.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e6ffd700 1 --2- 172.21.15.115:0/1879651136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8065de0 0x7f40e8062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e6ffd700 1 -- 172.21.15.115:0/1879651136 >> v1:172.21.15.159:6789/0 conn(0x7f40e8064230 legacy=0x7f40e80656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e6ffd700 1 -- 172.21.15.115:0/1879651136 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8065040 con 0x7f40e8153e00 2023-07-27T14:28:41.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e77fe700 1 --2- 172.21.15.115:0/1879651136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8065de0 0x7f40e8062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:41.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e6ffd700 1 --2- 172.21.15.115:0/1879651136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8153e00 0x7f40e80c6b70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f40d8006fd0 tx=0x7f40d80090f0).ready entity=mon.0 client_cookie=a386fbb3d7d45150 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:41.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.299+0000 7f40e5ffb700 1 -- 172.21.15.115:0/1879651136 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800b600 con 0x7f40e8153e00 2023-07-27T14:28:41.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40e5ffb700 1 -- 172.21.15.115:0/1879651136 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d800b760 con 0x7f40e8153e00 2023-07-27T14:28:41.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40e5ffb700 1 -- 172.21.15.115:0/1879651136 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800bae0 con 0x7f40e8153e00 2023-07-27T14:28:41.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40ed7ff700 1 -- 172.21.15.115:0/1879651136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8153e00 msgr2=0x7f40e80c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/1879651136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8153e00 0x7f40e80c6b70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f40d8006fd0 tx=0x7f40d80090f0).stop 2023-07-27T14:28:41.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40ed7ff700 1 -- 172.21.15.115:0/1879651136 shutdown_connections 2023-07-27T14:28:41.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/1879651136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8065de0 0x7f40e8062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/1879651136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8153e00 0x7f40e80c6b70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40ed7ff700 1 -- 172.21.15.115:0/1879651136 >> 172.21.15.115:0/1879651136 conn(0x7f40e80c7b90 msgr2=0x7f40e80c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:41.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40ed7ff700 1 -- 172.21.15.115:0/1879651136 shutdown_connections 2023-07-27T14:28:41.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.300+0000 7f40ed7ff700 1 -- 172.21.15.115:0/1879651136 wait complete. 2023-07-27T14:28:41.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.302+0000 7f40ed7ff700 1 Processor -- start 2023-07-27T14:28:41.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.302+0000 7f40ed7ff700 1 -- start start 2023-07-27T14:28:41.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40ed7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e8064230 0x7f40e80919d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40ed7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8065de0 0x7f40e80bc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40ed7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8153e00 0x7f40e8142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40ed7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8091ec0 con 0x7f40e8065de0 2023-07-27T14:28:41.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40ed7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80a9c20 con 0x7f40e8064230 2023-07-27T14:28:41.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40ed7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80941f0 con 0x7f40e8153e00 2023-07-27T14:28:41.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8065de0 0x7f40e80bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8065de0 0x7f40e80bc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57418/0 (socket says 172.21.15.115:57418) 2023-07-27T14:28:41.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 -- 172.21.15.115:0/2023580212 learned_addr learned my addr 172.21.15.115:0/2023580212 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:41.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e77fe700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8153e00 0x7f40e8142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e6ffd700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e8064230 0x7f40e80919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 -- 172.21.15.115:0/2023580212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8153e00 msgr2=0x7f40e8142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8153e00 0x7f40e8142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 -- 172.21.15.115:0/2023580212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e8064230 msgr2=0x7f40e80919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e8064230 0x7f40e80919d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 -- 172.21.15.115:0/2023580212 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8009370 con 0x7f40e8065de0 2023-07-27T14:28:41.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.304+0000 7f40e67fc700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8065de0 0x7f40e80bc230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f40dc00c4c0 tx=0x7f40dc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:41.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.305+0000 7f40ceffd700 1 -- 172.21.15.115:0/2023580212 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc007020 con 0x7f40e8065de0 2023-07-27T14:28:41.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.305+0000 7f40ceffd700 1 -- 172.21.15.115:0/2023580212 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc001e90 con 0x7f40e8065de0 2023-07-27T14:28:41.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.305+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e80944d0 con 0x7f40e8065de0 2023-07-27T14:28:41.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.305+0000 7f40ceffd700 1 -- 172.21.15.115:0/2023580212 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0073b0 con 0x7f40e8065de0 2023-07-27T14:28:41.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.305+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e80920d0 con 0x7f40e8065de0 2023-07-27T14:28:41.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.306+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e80949f0 con 0x7f40e8065de0 2023-07-27T14:28:41.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.307+0000 7f40ceffd700 1 -- 172.21.15.115:0/2023580212 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 6) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f40dc010070 con 0x7f40e8065de0 2023-07-27T14:28:41.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.307+0000 7f40ceffd700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40d405ede0 0x7f40d40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.308+0000 7f40ceffd700 1 -- 172.21.15.115:0/2023580212 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f40dc079600 con 0x7f40e8065de0 2023-07-27T14:28:41.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.308+0000 7f40e6ffd700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40d405ede0 0x7f40d40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.308+0000 7f40e6ffd700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40d405ede0 0x7f40d40612a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f40d8009130 tx=0x7f40d8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:41.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.312+0000 7f40ceffd700 1 -- 172.21.15.115:0/2023580212 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40e80949f0 con 0x7f40e8065de0 2023-07-27T14:28:41.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.520+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000959786", "target": ["mon-mgr", ""]}) v1 -- 0x7f40e80949f0 con 0x7f40d405ede0 2023-07-27T14:28:41.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.526+0000 7f40ceffd700 1 -- 172.21.15.115:0/2023580212 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+305 (secure 0 0 0) 0x7f40e80949f0 con 0x7f40d405ede0 2023-07-27T14:28:41.547 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:28:41.548 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:28:41.548 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "failed", 2023-07-27T14:28:41.548 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:28:41.548 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:28:41.548 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000967963", 2023-07-27T14:28:41.548 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000226505" 2023-07-27T14:28:41.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:28:41.549 INFO:teuthology.orchestra.run.smithi115.stdout: "failure": { 2023-07-27T14:28:41.549 INFO:teuthology.orchestra.run.smithi115.stdout: "errno": "2", 2023-07-27T14:28:41.549 INFO:teuthology.orchestra.run.smithi115.stdout: "error_msg": "snapshot 'snapshot_0000000000226505' does not exist" 2023-07-27T14:28:41.549 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:41.549 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:28:41.549 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:28:41.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40d405ede0 msgr2=0x7f40d40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40d405ede0 0x7f40d40612a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f40d8009130 tx=0x7f40d8017000).stop 2023-07-27T14:28:41.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8065de0 msgr2=0x7f40e80bc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8065de0 0x7f40e80bc230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f40dc00c4c0 tx=0x7f40dc007e00).stop 2023-07-27T14:28:41.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 shutdown_connections 2023-07-27T14:28:41.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40d405ede0 0x7f40d40612a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e8153e00 0x7f40e8142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e8064230 0x7f40e80919d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 --2- 172.21.15.115:0/2023580212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e8065de0 0x7f40e80bc230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 >> 172.21.15.115:0/2023580212 conn(0x7f40e80c7b90 msgr2=0x7f40e80bccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:41.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 shutdown_connections 2023-07-27T14:28:41.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.528+0000 7f40ed7ff700 1 -- 172.21.15.115:0/2023580212 wait complete. 2023-07-27T14:28:41.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000959786 --force 2023-07-27T14:28:41.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.739+0000 7f174dfff700 1 Processor -- start 2023-07-27T14:28:41.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.739+0000 7f174dfff700 1 -- start start 2023-07-27T14:28:41.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f174dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f174dfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17480c3100 0x7f17480c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f174dfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17480c0ea0 con 0x7f1748150d90 2023-07-27T14:28:41.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f174dfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748068e10 con 0x7f17480c3100 2023-07-27T14:28:41.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f174dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1748155190 con 0x7f17481509b0 2023-07-27T14:28:41.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f1747fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17480c3100 0x7f17480c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f1747fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17480c3100 0x7f17480c35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57424/0 (socket says 172.21.15.115:57424) 2023-07-27T14:28:41.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f1747fff700 1 -- 172.21.15.115:0/2932285774 learned_addr learned my addr 172.21.15.115:0/2932285774 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:41.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f17477fe700 1 --2- 172.21.15.115:0/2932285774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f1747fff700 1 -- 172.21.15.115:0/2932285774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 msgr2=0x7f17480c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:41.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f1747fff700 1 --2- 172.21.15.115:0/2932285774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.741+0000 7f1747fff700 1 -- 172.21.15.115:0/2932285774 >> v1:172.21.15.159:6789/0 conn(0x7f1748150d90 legacy=0x7f1748154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:41.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f1747fff700 1 -- 172.21.15.115:0/2932285774 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748155470 con 0x7f17480c3100 2023-07-27T14:28:41.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f17477fe700 1 --2- 172.21.15.115:0/2932285774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:41.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f1747fff700 1 --2- 172.21.15.115:0/2932285774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480c35b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f174000d1a0 tx=0x7f174000ba50).ready entity=mon.0 client_cookie=86374c4c1809472f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:41.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f17467fc700 1 -- 172.21.15.115:0/2932285774 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740010070 con 0x7f17480c3100 2023-07-27T14:28:41.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f17467fc700 1 -- 172.21.15.115:0/2932285774 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174000de80 con 0x7f17480c3100 2023-07-27T14:28:41.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f17467fc700 1 -- 172.21.15.115:0/2932285774 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000b2e0 con 0x7f17480c3100 2023-07-27T14:28:41.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f174dfff700 1 -- 172.21.15.115:0/2932285774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 msgr2=0x7f17480c35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f174dfff700 1 --2- 172.21.15.115:0/2932285774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480c35b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f174000d1a0 tx=0x7f174000ba50).stop 2023-07-27T14:28:41.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f174dfff700 1 -- 172.21.15.115:0/2932285774 shutdown_connections 2023-07-27T14:28:41.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f174dfff700 1 --2- 172.21.15.115:0/2932285774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f174dfff700 1 --2- 172.21.15.115:0/2932285774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480c35b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.742+0000 7f174dfff700 1 -- 172.21.15.115:0/2932285774 >> 172.21.15.115:0/2932285774 conn(0x7f1748062320 msgr2=0x7f1748062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:41.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.743+0000 7f174dfff700 1 -- 172.21.15.115:0/2932285774 shutdown_connections 2023-07-27T14:28:41.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.743+0000 7f174dfff700 1 -- 172.21.15.115:0/2932285774 wait complete. 2023-07-27T14:28:41.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.744+0000 7f174dfff700 1 Processor -- start 2023-07-27T14:28:41.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.744+0000 7f174dfff700 1 -- start start 2023-07-27T14:28:41.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f174dfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f174dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f174dfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748150d90 0x7f17480a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f174dfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480bd940 con 0x7f17480c3100 2023-07-27T14:28:41.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f174dfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480a7df0 con 0x7f1748150d90 2023-07-27T14:28:41.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f174dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480aa500 con 0x7f17481509b0 2023-07-27T14:28:41.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f17477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f17477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480aa010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57428/0 (socket says 172.21.15.115:57428) 2023-07-27T14:28:41.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f17477fe700 1 -- 172.21.15.115:0/3264114462 learned_addr learned my addr 172.21.15.115:0/3264114462 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:41.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f1746ffd700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.745+0000 7f1747fff700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748150d90 0x7f17480a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f17477fe700 1 -- 172.21.15.115:0/3264114462 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 msgr2=0x7f17480ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f17477fe700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480ac360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f17477fe700 1 -- 172.21.15.115:0/3264114462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748150d90 msgr2=0x7f17480a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f17477fe700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748150d90 0x7f17480a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f17477fe700 1 -- 172.21.15.115:0/3264114462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174000bcf0 con 0x7f17480c3100 2023-07-27T14:28:41.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f17477fe700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480aa010 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f173800c880 tx=0x7f1738008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:41.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f172f7fe700 1 -- 172.21.15.115:0/3264114462 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738010580 con 0x7f17480c3100 2023-07-27T14:28:41.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f172f7fe700 1 -- 172.21.15.115:0/3264114462 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17380106e0 con 0x7f17480c3100 2023-07-27T14:28:41.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f172f7fe700 1 -- 172.21.15.115:0/3264114462 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738010a60 con 0x7f17480c3100 2023-07-27T14:28:41.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17480a71e0 con 0x7f17480c3100 2023-07-27T14:28:41.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.746+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17480a77a0 con 0x7f17480c3100 2023-07-27T14:28:41.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.747+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174806c470 con 0x7f17480c3100 2023-07-27T14:28:41.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.748+0000 7f172f7fe700 1 -- 172.21.15.115:0/3264114462 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 6) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f173801b460 con 0x7f17480c3100 2023-07-27T14:28:41.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.749+0000 7f172f7fe700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f173405ede0 0x7f17340612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:41.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.749+0000 7f172f7fe700 1 -- 172.21.15.115:0/3264114462 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f1738079de0 con 0x7f17480c3100 2023-07-27T14:28:41.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.749+0000 7f1746ffd700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f173405ede0 0x7f17340612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:41.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.750+0000 7f1746ffd700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f173405ede0 0x7f17340612a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1748167510 tx=0x7f173c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:41.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.754+0000 7f172f7fe700 1 -- 172.21.15.115:0/3264114462 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f173804b120 con 0x7f17480c3100 2023-07-27T14:28:41.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.955+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000959786", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f17480655d0 con 0x7f173405ede0 2023-07-27T14:28:41.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.970+0000 7f172f7fe700 1 -- 172.21.15.115:0/3264114462 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f17480655d0 con 0x7f173405ede0 2023-07-27T14:28:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.972+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f173405ede0 msgr2=0x7f17340612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.972+0000 7f174dfff700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f173405ede0 0x7f17340612a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1748167510 tx=0x7f173c008040).stop 2023-07-27T14:28:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.972+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 msgr2=0x7f17480aa010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.972+0000 7f174dfff700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480aa010 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f173800c880 tx=0x7f1738008040).stop 2023-07-27T14:28:41.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.973+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 shutdown_connections 2023-07-27T14:28:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.973+0000 7f174dfff700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f173405ede0 0x7f17340612a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.973+0000 7f174dfff700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748150d90 0x7f17480a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.973+0000 7f174dfff700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17480c3100 0x7f17480aa010 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.973+0000 7f174dfff700 1 --2- 172.21.15.115:0/3264114462 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17481509b0 0x7f17480ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.973+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 >> 172.21.15.115:0/3264114462 conn(0x7f1748062320 msgr2=0x7f1748154480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.973+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 shutdown_connections 2023-07-27T14:28:41.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:41.973+0000 7f174dfff700 1 -- 172.21.15.115:0/3264114462 wait complete. 2023-07-27T14:28:41.996 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.974+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:41.996 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.974+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:41.996 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.974+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:41.996 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.974+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:41.997 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.974+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:42.014 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.993+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:42.014 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.993+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:42.014 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.993+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:42.014 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.993+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:42.015 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:28:41.993+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:28:42.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000967963 2023-07-27T14:28:42.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.190+0000 7f4f073ff700 1 Processor -- start 2023-07-27T14:28:42.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.190+0000 7f4f073ff700 1 -- start start 2023-07-27T14:28:42.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.191+0000 7f4f073ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4f0013a730 0x7f4f00065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:42.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.191+0000 7f4f073ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f000c36b0 0x7f4f001585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.191+0000 7f4f073ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f000bd9a0 con 0x7f4f0013a350 2023-07-27T14:28:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.191+0000 7f4f073ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f00066400 con 0x7f4f000c36b0 2023-07-27T14:28:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.191+0000 7f4f073ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f00158ae0 con 0x7f4f0013a730 2023-07-27T14:28:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.191+0000 7f4f0599c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f000c36b0 0x7f4f001585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.191+0000 7f4f0519b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4f0013a350 0x7f4f000c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46634/0 (socket says 172.21.15.115:46634) 2023-07-27T14:28:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.191+0000 7f4f0519b700 1 -- 172.21.15.115:0/2371495077 learned_addr learned my addr 172.21.15.115:0/2371495077 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:42.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4f0499a700 1 --2- 172.21.15.115:0/2371495077 >> v2:172.21.15.159:3300/0 conn(0x7f4f0013a730 0x7f4f00065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:42.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4f0599c700 1 -- 172.21.15.115:0/2371495077 >> v2:172.21.15.159:3300/0 conn(0x7f4f0013a730 msgr2=0x7f4f00065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:42.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4f0599c700 1 --2- 172.21.15.115:0/2371495077 >> v2:172.21.15.159:3300/0 conn(0x7f4f0013a730 0x7f4f00065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:42.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4f0599c700 1 -- 172.21.15.115:0/2371495077 >> v1:172.21.15.115:6789/0 conn(0x7f4f0013a350 legacy=0x7f4f000c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:42.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4f0599c700 1 -- 172.21.15.115:0/2371495077 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00066610 con 0x7f4f000c36b0 2023-07-27T14:28:42.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4ef7fff700 1 -- 172.21.15.115:0/2371495077 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041304120 0 0) 0x7f4f000bd9a0 con 0x7f4f0013a350 2023-07-27T14:28:42.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4f0599c700 1 --2- 172.21.15.115:0/2371495077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f000c36b0 0x7f4f001585f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f4f00069070 tx=0x7f4ef8009780).ready entity=mon.0 client_cookie=f3e480006d910df4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:42.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4ef7fff700 1 -- 172.21.15.115:0/2371495077 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800e070 con 0x7f4f000c36b0 2023-07-27T14:28:42.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4ef7fff700 1 -- 172.21.15.115:0/2371495077 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800bb60 con 0x7f4f000c36b0 2023-07-27T14:28:42.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.192+0000 7f4ef7fff700 1 -- 172.21.15.115:0/2371495077 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8012410 con 0x7f4f000c36b0 2023-07-27T14:28:42.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.193+0000 7f4f073ff700 1 -- 172.21.15.115:0/2371495077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f000c36b0 msgr2=0x7f4f001585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:42.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.193+0000 7f4f073ff700 1 --2- 172.21.15.115:0/2371495077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f000c36b0 0x7f4f001585f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f4f00069070 tx=0x7f4ef8009780).stop 2023-07-27T14:28:42.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.193+0000 7f4f073ff700 1 -- 172.21.15.115:0/2371495077 shutdown_connections 2023-07-27T14:28:42.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.193+0000 7f4f073ff700 1 --2- 172.21.15.115:0/2371495077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f000c36b0 0x7f4f001585f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:42.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.193+0000 7f4f073ff700 1 --2- 172.21.15.115:0/2371495077 >> v2:172.21.15.159:3300/0 conn(0x7f4f0013a730 0x7f4f00065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:42.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.193+0000 7f4f073ff700 1 -- 172.21.15.115:0/2371495077 >> 172.21.15.115:0/2371495077 conn(0x7f4f0005e8f0 msgr2=0x7f4f000c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:42.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.193+0000 7f4f073ff700 1 -- 172.21.15.115:0/2371495077 shutdown_connections 2023-07-27T14:28:42.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.193+0000 7f4f073ff700 1 -- 172.21.15.115:0/2371495077 wait complete. 2023-07-27T14:28:42.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.194+0000 7f4f073ff700 1 Processor -- start 2023-07-27T14:28:42.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.195+0000 7f4f073ff700 1 -- start start 2023-07-27T14:28:42.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.195+0000 7f4f073ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f000c36b0 0x7f4f00164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:42.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.195+0000 7f4f073ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f0013a350 0x7f4f00154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:42.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f073ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f0013a730 0x7f4f001668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:42.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f073ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f00164b10 con 0x7f4f0013a730 2023-07-27T14:28:42.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f073ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000c74a0 con 0x7f4f0013a350 2023-07-27T14:28:42.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f073ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000c6920 con 0x7f4f000c36b0 2023-07-27T14:28:42.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f0013a730 0x7f4f001668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:42.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f0013a730 0x7f4f001668d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57480/0 (socket says 172.21.15.115:57480) 2023-07-27T14:28:42.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 -- 172.21.15.115:0/239547112 learned_addr learned my addr 172.21.15.115:0/239547112 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:42.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0519b700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f000c36b0 0x7f4f00164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:42.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0499a700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f0013a350 0x7f4f00154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:42.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 -- 172.21.15.115:0/239547112 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f000c36b0 msgr2=0x7f4f00164620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:42.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f000c36b0 0x7f4f00164620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:42.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 -- 172.21.15.115:0/239547112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f0013a350 msgr2=0x7f4f00154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:42.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f0013a350 0x7f4f00154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:42.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 -- 172.21.15.115:0/239547112 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8009a20 con 0x7f4f0013a730 2023-07-27T14:28:42.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.196+0000 7f4f0599c700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f0013a730 0x7f4f001668d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f4f00067240 tx=0x7f4ef8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:42.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.197+0000 7f4ef57fa700 1 -- 172.21.15.115:0/239547112 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef801d630 con 0x7f4f0013a730 2023-07-27T14:28:42.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.197+0000 7f4ef57fa700 1 -- 172.21.15.115:0/239547112 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef801d790 con 0x7f4f0013a730 2023-07-27T14:28:42.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.197+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f000c6b70 con 0x7f4f0013a730 2023-07-27T14:28:42.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.197+0000 7f4ef57fa700 1 -- 172.21.15.115:0/239547112 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef801db10 con 0x7f4f0013a730 2023-07-27T14:28:42.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.197+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f000c7130 con 0x7f4f0013a730 2023-07-27T14:28:42.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.198+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f000c7650 con 0x7f4f0013a730 2023-07-27T14:28:42.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.198+0000 7f4ef57fa700 1 -- 172.21.15.115:0/239547112 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 6) v1 ==== 75362+0+0 (secure 0 0 0) 0x7f4ef8026410 con 0x7f4f0013a730 2023-07-27T14:28:42.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.200+0000 7f4ef57fa700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:42.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.200+0000 7f4ef57fa700 1 -- 172.21.15.115:0/239547112 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4ef807bdd0 con 0x7f4f0013a730 2023-07-27T14:28:42.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.200+0000 7f4f0519b700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:42.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.201+0000 7f4f0519b700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ee405ede0 0x7f4ee40612a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f4f000ab690 tx=0x7f4efc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:42.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.204+0000 7f4ef57fa700 1 -- 172.21.15.115:0/239547112 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f000c7650 con 0x7f4f0013a730 2023-07-27T14:28:42.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:42.399+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000967963", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f000c7650 con 0x7f4ee405ede0 2023-07-27T14:28:43.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:43.569+0000 7f4ef57fa700 1 -- 172.21.15.115:0/239547112 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f4ef8079ad0 con 0x7f4f0013a730 2023-07-27T14:28:51.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.091+0000 7f4ef57fa700 1 -- 172.21.15.115:0/239547112 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4f000c7650 con 0x7f4ee405ede0 2023-07-27T14:28:51.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.094+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ee405ede0 msgr2=0x7f4ee40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:51.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.094+0000 7f4f073ff700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ee405ede0 0x7f4ee40612a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f4f000ab690 tx=0x7f4efc009040).stop 2023-07-27T14:28:51.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.094+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f0013a730 msgr2=0x7f4f001668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:51.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.095+0000 7f4f073ff700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f0013a730 0x7f4f001668d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f4f00067240 tx=0x7f4ef8009780).stop 2023-07-27T14:28:51.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.095+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 shutdown_connections 2023-07-27T14:28:51.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.095+0000 7f4f073ff700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ee405ede0 0x7f4ee40612a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:51.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.095+0000 7f4f073ff700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f0013a730 0x7f4f001668d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:51.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.095+0000 7f4f073ff700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f000c36b0 0x7f4f00164620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:51.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.095+0000 7f4f073ff700 1 --2- 172.21.15.115:0/239547112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f0013a350 0x7f4f00154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:51.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.095+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 >> 172.21.15.115:0/239547112 conn(0x7f4f0005e8f0 msgr2=0x7f4f000633b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:51.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.095+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 shutdown_connections 2023-07-27T14:28:51.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:51.096+0000 7f4f073ff700 1 -- 172.21.15.115:0/239547112 wait complete. 2023-07-27T14:28:51.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:51.140 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:28:51.237 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-07-27T14:28:56.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:56.239 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:28:56.334 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:28:56.336 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:28:56.337 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:28:56.441 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:28:56.546 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:28:56.547 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:28:56.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:56.548 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:28:56.662 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:28:56.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:56.663 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:28:56.711 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:28:56.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:28:56.712 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:28:56.802 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:28:56.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:28:56.803 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:28:56.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:28:57.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.017+0000 7f5f3ffff700 1 Processor -- start 2023-07-27T14:28:57.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.017+0000 7f5f3ffff700 1 -- start start 2023-07-27T14:28:57.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3ffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5f38151d70 0x7f5f38155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 0x7f5f38067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3ffff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f38067080 con 0x7f5f38065ff0 2023-07-27T14:28:57.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3ffff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f38063a90 con 0x7f5f38151d70 2023-07-27T14:28:57.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3ffff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380634d0 con 0x7f5f38066b80 2023-07-27T14:28:57.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3d59a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5f38065ff0 0x7f5f38066470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53310/0 (socket says 172.21.15.115:53310) 2023-07-27T14:28:57.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3d59a700 1 -- 172.21.15.115:0/3089251527 learned_addr learned my addr 172.21.15.115:0/3089251527 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:57.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3dd9b700 1 --2- 172.21.15.115:0/3089251527 >> v2:172.21.15.159:3300/0 conn(0x7f5f38151d70 0x7f5f38155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.018+0000 7f5f3e59c700 1 --2- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 0x7f5f38067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3cd99700 1 -- 172.21.15.115:0/3089251527 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861788518 0 0) 0x7f5f38067080 con 0x7f5f38065ff0 2023-07-27T14:28:57.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3cd99700 1 -- 172.21.15.115:0/3089251527 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f240033f0 con 0x7f5f38065ff0 2023-07-27T14:28:57.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3dd9b700 1 -- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 msgr2=0x7f5f38067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:57.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3dd9b700 1 --2- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 0x7f5f38067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3dd9b700 1 -- 172.21.15.115:0/3089251527 >> v1:172.21.15.115:6789/0 conn(0x7f5f38065ff0 legacy=0x7f5f38066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3dd9b700 1 -- 172.21.15.115:0/3089251527 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380637b0 con 0x7f5f38151d70 2023-07-27T14:28:57.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3e59c700 1 --2- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 0x7f5f38067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:28:57.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3dd9b700 1 --2- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 0x7f5f38155060 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f5f34009760 tx=0x7f5f34009060).ready entity=mon.1 client_cookie=d3ceaf5ffd803b80 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3cd99700 1 -- 172.21.15.115:0/3089251527 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400d4a0 con 0x7f5f38151d70 2023-07-27T14:28:57.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3cd99700 1 -- 172.21.15.115:0/3089251527 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400d600 con 0x7f5f38151d70 2023-07-27T14:28:57.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.019+0000 7f5f3cd99700 1 -- 172.21.15.115:0/3089251527 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400d980 con 0x7f5f38151d70 2023-07-27T14:28:57.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.020+0000 7f5f3ffff700 1 -- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 msgr2=0x7f5f38155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.020+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 0x7f5f38155060 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f5f34009760 tx=0x7f5f34009060).stop 2023-07-27T14:28:57.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.020+0000 7f5f3ffff700 1 -- 172.21.15.115:0/3089251527 shutdown_connections 2023-07-27T14:28:57.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.020+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 0x7f5f38067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.020+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/3089251527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 0x7f5f38155060 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.020+0000 7f5f3ffff700 1 -- 172.21.15.115:0/3089251527 >> 172.21.15.115:0/3089251527 conn(0x7f5f380c89a0 msgr2=0x7f5f380c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:57.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.020+0000 7f5f3ffff700 1 -- 172.21.15.115:0/3089251527 shutdown_connections 2023-07-27T14:28:57.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.020+0000 7f5f3ffff700 1 -- 172.21.15.115:0/3089251527 wait complete. 2023-07-27T14:28:57.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.022+0000 7f5f3ffff700 1 Processor -- start 2023-07-27T14:28:57.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.022+0000 7f5f3ffff700 1 -- start start 2023-07-27T14:28:57.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f38065ff0 0x7f5f380ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 0x7f5f380c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 0x7f5f380ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380acac0 con 0x7f5f38065ff0 2023-07-27T14:28:57.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3ffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380c1bc0 con 0x7f5f38151d70 2023-07-27T14:28:57.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3ffff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380c1ea0 con 0x7f5f38066b80 2023-07-27T14:28:57.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f38065ff0 0x7f5f380ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f38065ff0 0x7f5f380ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36238/0 (socket says 172.21.15.115:36238) 2023-07-27T14:28:57.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3dd9b700 1 -- 172.21.15.115:0/2289762086 learned_addr learned my addr 172.21.15.115:0/2289762086 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:57.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3dd9b700 1 -- 172.21.15.115:0/2289762086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 msgr2=0x7f5f380c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3dd9b700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 0x7f5f380c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:57.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3dd9b700 1 -- 172.21.15.115:0/2289762086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 msgr2=0x7f5f380ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3e59c700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 0x7f5f380ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3dd9b700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 0x7f5f380ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3dd9b700 1 -- 172.21.15.115:0/2289762086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009a20 con 0x7f5f38065ff0 2023-07-27T14:28:57.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.023+0000 7f5f3e59c700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 0x7f5f380ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:57.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.024+0000 7f5f3dd9b700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f38065ff0 0x7f5f380ac5d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f5f38060790 tx=0x7f5f34016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.024+0000 7f5f2dffb700 1 -- 172.21.15.115:0/2289762086 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34000c90 con 0x7f5f38065ff0 2023-07-27T14:28:57.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.024+0000 7f5f2dffb700 1 -- 172.21.15.115:0/2289762086 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400d770 con 0x7f5f38065ff0 2023-07-27T14:28:57.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.024+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f340092a0 con 0x7f5f38065ff0 2023-07-27T14:28:57.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.024+0000 7f5f2dffb700 1 -- 172.21.15.115:0/2289762086 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3401d430 con 0x7f5f38065ff0 2023-07-27T14:28:57.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.024+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f380a5590 con 0x7f5f38065ff0 2023-07-27T14:28:57.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.025+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f380c23c0 con 0x7f5f38065ff0 2023-07-27T14:28:57.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.026+0000 7f5f2dffb700 1 -- 172.21.15.115:0/2289762086 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f5f3400f070 con 0x7f5f38065ff0 2023-07-27T14:28:57.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.026+0000 7f5f2dffb700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f1c05eef0 0x7f5f1c0613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.027+0000 7f5f2dffb700 1 -- 172.21.15.115:0/2289762086 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f5f3407b6d0 con 0x7f5f38065ff0 2023-07-27T14:28:57.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.027+0000 7f5f3d59a700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f1c05eef0 0x7f5f1c0613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.027+0000 7f5f3d59a700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f1c05eef0 0x7f5f1c0613b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5f28005750 tx=0x7f5f28007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.031+0000 7f5f2dffb700 1 -- 172.21.15.115:0/2289762086 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f380c23c0 con 0x7f5f38065ff0 2023-07-27T14:28:57.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.244+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f380a53f0 con 0x7f5f38065ff0 2023-07-27T14:28:57.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.244+0000 7f5f2dffb700 1 -- 172.21.15.115:0/2289762086 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f5f380a53f0 con 0x7f5f38065ff0 2023-07-27T14:28:57.266 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:57.266 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/2250060018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2250060018},{"type":"v1","addr":"172.21.15.159:6833","nonce":2250060018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2756493852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2756493852},{"type":"v1","addr":"172.21.15.159:6835","nonce":2756493852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4777,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1646103579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1646103579},{"type":"v1","addr":"172.21.15.115:6836","nonce":1646103579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:28:05.041620+0000","modified":"2023-07-27T14:28:08.054910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4780":{"gid":4780,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6837/770984486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":770984486},{"type":"v1","addr":"172.21.15.115:6837","nonce":770984486}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-07-27T14:28:57.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f1c05eef0 msgr2=0x7f5f1c0613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f1c05eef0 0x7f5f1c0613b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5f28005750 tx=0x7f5f28007850).stop 2023-07-27T14:28:57.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f38065ff0 msgr2=0x7f5f380ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f38065ff0 0x7f5f380ac5d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f5f38060790 tx=0x7f5f34016000).stop 2023-07-27T14:28:57.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 shutdown_connections 2023-07-27T14:28:57.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f1c05eef0 0x7f5f1c0613b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f38151d70 0x7f5f380ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f38065ff0 0x7f5f380ac5d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 --2- 172.21.15.115:0/2289762086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f38066b80 0x7f5f380c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:57.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 >> 172.21.15.115:0/2289762086 conn(0x7f5f380c89a0 msgr2=0x7f5f380bf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:57.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 shutdown_connections 2023-07-27T14:28:57.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.246+0000 7f5f3ffff700 1 -- 172.21.15.115:0/2289762086 wait complete. 2023-07-27T14:28:57.269 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 17 2023-07-27T14:28:57.285 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:28:57.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.451+0000 7fe331fff700 1 Processor -- start 2023-07-27T14:28:57.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.451+0000 7fe331fff700 1 -- start start 2023-07-27T14:28:57.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.452+0000 7fe331fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe32c0aaa40 0x7fe32c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.452+0000 7fe331fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe32c1542a0 0x7fe32c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.452+0000 7fe331fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c0aa4d0 con 0x7fe32c153ec0 2023-07-27T14:28:57.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.452+0000 7fe331fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c064ad0 con 0x7fe32c0aaa40 2023-07-27T14:28:57.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.452+0000 7fe331fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0c05c0 con 0x7fe32c1542a0 2023-07-27T14:28:57.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.452+0000 7fe32affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe32c0aaa40 0x7fe32c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe32c0aaa40 0x7fe32c0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36250/0 (socket says 172.21.15.115:36250) 2023-07-27T14:28:57.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32affd700 1 -- 172.21.15.115:0/1190112445 learned_addr learned my addr 172.21.15.115:0/1190112445 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:57.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32affd700 1 -- 172.21.15.115:0/1190112445 >> v2:172.21.15.159:3300/0 conn(0x7fe32c1542a0 msgr2=0x7fe32c0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:57.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32bfff700 1 --2- 172.21.15.115:0/1190112445 >> v2:172.21.15.159:3300/0 conn(0x7fe32c1542a0 0x7fe32c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32affd700 1 --2- 172.21.15.115:0/1190112445 >> v2:172.21.15.159:3300/0 conn(0x7fe32c1542a0 0x7fe32c0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32affd700 1 -- 172.21.15.115:0/1190112445 >> v1:172.21.15.159:6789/0 conn(0x7fe32c153ec0 legacy=0x7fe32c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:57.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32affd700 1 -- 172.21.15.115:0/1190112445 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0c1a60 con 0x7fe32c0aaa40 2023-07-27T14:28:57.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32bfff700 1 --2- 172.21.15.115:0/1190112445 >> v2:172.21.15.159:3300/0 conn(0x7fe32c1542a0 0x7fe32c0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:57.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32affd700 1 --2- 172.21.15.115:0/1190112445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c0aaa40 0x7fe32c0640f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fe32c0c5470 tx=0x7fe3200090f0).ready entity=mon.0 client_cookie=a1771ba21f9495a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32a7fc700 1 -- 172.21.15.115:0/1190112445 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000b5a0 con 0x7fe32c0aaa40 2023-07-27T14:28:57.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32a7fc700 1 -- 172.21.15.115:0/1190112445 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32000b700 con 0x7fe32c0aaa40 2023-07-27T14:28:57.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.453+0000 7fe32a7fc700 1 -- 172.21.15.115:0/1190112445 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000ba80 con 0x7fe32c0aaa40 2023-07-27T14:28:57.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.454+0000 7fe331fff700 1 -- 172.21.15.115:0/1190112445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c0aaa40 msgr2=0x7fe32c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.454+0000 7fe331fff700 1 --2- 172.21.15.115:0/1190112445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c0aaa40 0x7fe32c0640f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fe32c0c5470 tx=0x7fe3200090f0).stop 2023-07-27T14:28:57.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.454+0000 7fe331fff700 1 -- 172.21.15.115:0/1190112445 shutdown_connections 2023-07-27T14:28:57.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.454+0000 7fe331fff700 1 --2- 172.21.15.115:0/1190112445 >> v2:172.21.15.159:3300/0 conn(0x7fe32c1542a0 0x7fe32c0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.454+0000 7fe331fff700 1 --2- 172.21.15.115:0/1190112445 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c0aaa40 0x7fe32c0640f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.454+0000 7fe331fff700 1 -- 172.21.15.115:0/1190112445 >> 172.21.15.115:0/1190112445 conn(0x7fe32c0cb610 msgr2=0x7fe32c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:57.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.454+0000 7fe331fff700 1 -- 172.21.15.115:0/1190112445 shutdown_connections 2023-07-27T14:28:57.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.454+0000 7fe331fff700 1 -- 172.21.15.115:0/1190112445 wait complete. 2023-07-27T14:28:57.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.456+0000 7fe331fff700 1 Processor -- start 2023-07-27T14:28:57.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.456+0000 7fe331fff700 1 -- start start 2023-07-27T14:28:57.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe331fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0aaa40 0x7fe32c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe331fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c153ec0 0x7fe32c138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe331fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c1542a0 0x7fe32c14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe331fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c14cec0 con 0x7fe32c153ec0 2023-07-27T14:28:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe331fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1687a0 con 0x7fe32c1542a0 2023-07-27T14:28:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe331fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c159440 con 0x7fe32c0aaa40 2023-07-27T14:28:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c153ec0 0x7fe32c138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c153ec0 0x7fe32c138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36262/0 (socket says 172.21.15.115:36262) 2023-07-27T14:28:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32affd700 1 -- 172.21.15.115:0/4024533083 learned_addr learned my addr 172.21.15.115:0/4024533083 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32bfff700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c1542a0 0x7fe32c14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32b7fe700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0aaa40 0x7fe32c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32affd700 1 -- 172.21.15.115:0/4024533083 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0aaa40 msgr2=0x7fe32c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32affd700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0aaa40 0x7fe32c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32affd700 1 -- 172.21.15.115:0/4024533083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c1542a0 msgr2=0x7fe32c14d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32affd700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c1542a0 0x7fe32c14d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.457+0000 7fe32affd700 1 -- 172.21.15.115:0/4024533083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe320009370 con 0x7fe32c153ec0 2023-07-27T14:28:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.458+0000 7fe32affd700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c153ec0 0x7fe32c138ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fe320009130 tx=0x7fe320015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.458+0000 7fe3137fe700 1 -- 172.21.15.115:0/4024533083 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000ba80 con 0x7fe32c153ec0 2023-07-27T14:28:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.458+0000 7fe3137fe700 1 -- 172.21.15.115:0/4024533083 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320000c90 con 0x7fe32c153ec0 2023-07-27T14:28:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.458+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c1684c0 con 0x7fe32c153ec0 2023-07-27T14:28:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.458+0000 7fe3137fe700 1 -- 172.21.15.115:0/4024533083 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32001c670 con 0x7fe32c153ec0 2023-07-27T14:28:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.458+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c1590d0 con 0x7fe32c153ec0 2023-07-27T14:28:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.459+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c158c50 con 0x7fe32c153ec0 2023-07-27T14:28:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.460+0000 7fe3137fe700 1 -- 172.21.15.115:0/4024533083 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fe32002c070 con 0x7fe32c153ec0 2023-07-27T14:28:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.461+0000 7fe3137fe700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe31805eef0 0x7fe3180613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.461+0000 7fe3137fe700 1 -- 172.21.15.115:0/4024533083 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fe32007b990 con 0x7fe32c153ec0 2023-07-27T14:28:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.461+0000 7fe32b7fe700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe31805eef0 0x7fe3180613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.461+0000 7fe32b7fe700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe31805eef0 0x7fe3180613b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe31c003650 tx=0x7fe31c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.465+0000 7fe3137fe700 1 -- 172.21.15.115:0/4024533083 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe32c158c50 con 0x7fe32c153ec0 2023-07-27T14:28:57.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.638+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe32c0aa4d0 con 0x7fe32c153ec0 2023-07-27T14:28:57.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.639+0000 7fe3137fe700 1 -- 172.21.15.115:0/4024533083 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17142 (secure 0 0 0) 0x7fe32c0aa4d0 con 0x7fe32c153ec0 2023-07-27T14:28:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:57.661 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":40,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:28:49.583377+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:28:03.303433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-27T14:28:04.025837+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:28:57.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.641+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe31805eef0 msgr2=0x7fe3180613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.641+0000 7fe331fff700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe31805eef0 0x7fe3180613b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe31c003650 tx=0x7fe31c009040).stop 2023-07-27T14:28:57.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c153ec0 msgr2=0x7fe32c138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c153ec0 0x7fe32c138ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fe320009130 tx=0x7fe320015000).stop 2023-07-27T14:28:57.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 shutdown_connections 2023-07-27T14:28:57.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe31805eef0 0x7fe3180613b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c1542a0 0x7fe32c14d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0aaa40 0x7fe32c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 --2- 172.21.15.115:0/4024533083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe32c153ec0 0x7fe32c138ed0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 >> 172.21.15.115:0/4024533083 conn(0x7fe32c0cb610 msgr2=0x7fe32c14fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:57.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 shutdown_connections 2023-07-27T14:28:57.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.642+0000 7fe331fff700 1 -- 172.21.15.115:0/4024533083 wait complete. 2023-07-27T14:28:57.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:28:03.303433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:28:04.025837+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:28:57.681 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:28:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.851+0000 7fb4cb1ff700 1 Processor -- start 2023-07-27T14:28:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.851+0000 7fb4cb1ff700 1 -- start start 2023-07-27T14:28:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.852+0000 7fb4cb1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb4c414ae00 0x7fb4c4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.852+0000 7fb4cb1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c41553f0 con 0x7fb4c4063260 2023-07-27T14:28:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.852+0000 7fb4cb1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c4157a50 con 0x7fb4c414b1e0 2023-07-27T14:28:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.852+0000 7fb4cb1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c4157d10 con 0x7fb4c414ae00 2023-07-27T14:28:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c979c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb4c4063260 0x7fb4c40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53326/0 (socket says 172.21.15.115:53326) 2023-07-27T14:28:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c979c700 1 -- 172.21.15.115:0/355654036 learned_addr learned my addr 172.21.15.115:0/355654036 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c8f9b700 1 --2- 172.21.15.115:0/355654036 >> v2:172.21.15.159:3300/0 conn(0x7fb4c414ae00 0x7fb4c4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415348839 0 0) 0x7fb4c41553f0 con 0x7fb4c4063260 2023-07-27T14:28:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b40033f0 con 0x7fb4c4063260 2023-07-27T14:28:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242964613 0 0) 0x7fb4b40033f0 con 0x7fb4c4063260 2023-07-27T14:28:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 >> v2:172.21.15.159:3300/0 conn(0x7fb4c414ae00 msgr2=0x7fb4c4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c37fe700 1 --2- 172.21.15.115:0/355654036 >> v2:172.21.15.159:3300/0 conn(0x7fb4c414ae00 0x7fb4c4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 >> v1:172.21.15.159:6789/0 conn(0x7fb4c414b1e0 legacy=0x7fb4c4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.853+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c4157ff0 con 0x7fb4c4063260 2023-07-27T14:28:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb4bc0017f0 con 0x7fb4c4063260 2023-07-27T14:28:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 >> v1:172.21.15.115:6789/0 conn(0x7fb4c4063260 legacy=0x7fb4c40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c37fe700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4b40038e0 0x7fb4b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c37fe700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4004690 0x7fb4b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c37fe700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4005000 0x7fb4b400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4157d10 con 0x7fb4b4005000 2023-07-27T14:28:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b400bf60 con 0x7fb4b4004690 2023-07-27T14:28:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b400c0f0 con 0x7fb4b40038e0 2023-07-27T14:28:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c979c700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4005000 0x7fb4b400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c8f9b700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4b40038e0 0x7fb4b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c3fff700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4004690 0x7fb4b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c979c700 1 -- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4b40038e0 msgr2=0x7fb4b4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c979c700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4b40038e0 0x7fb4b4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c979c700 1 -- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4004690 msgr2=0x7fb4b4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c979c700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4004690 0x7fb4b4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c979c700 1 -- 172.21.15.115:0/355654036 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b40033f0 con 0x7fb4b4005000 2023-07-27T14:28:57.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c3fff700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4004690 0x7fb4b4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:57.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c979c700 1 -- 172.21.15.115:0/355654036 reap_dead start 2023-07-27T14:28:57.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.854+0000 7fb4c979c700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4005000 0x7fb4b400b8e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fb4bc00c450 tx=0x7fb4bc00c760).ready entity=mon.0 client_cookie=952ba6c5f4f7ebca server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc002030 con 0x7fb4b4005000 2023-07-27T14:28:57.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc00cdf0 con 0x7fb4b4005000 2023-07-27T14:28:57.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4c37fe700 1 -- 172.21.15.115:0/355654036 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc005d30 con 0x7fb4b4005000 2023-07-27T14:28:57.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/355654036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4005000 msgr2=0x7fb4b400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4cb1ff700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4005000 0x7fb4b400b8e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fb4bc00c450 tx=0x7fb4bc00c760).stop 2023-07-27T14:28:57.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/355654036 shutdown_connections 2023-07-27T14:28:57.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4cb1ff700 1 --2- 172.21.15.115:0/355654036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4b4005000 0x7fb4b400b8e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/355654036 >> 172.21.15.115:0/355654036 conn(0x7fb4c405e940 msgr2=0x7fb4c40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:57.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/355654036 shutdown_connections 2023-07-27T14:28:57.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.855+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/355654036 wait complete. 2023-07-27T14:28:57.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.857+0000 7fb4cb1ff700 1 Processor -- start 2023-07-27T14:28:57.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.857+0000 7fb4cb1ff700 1 -- start start 2023-07-27T14:28:57.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4cb1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4005000 0x7fb4c40b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4cb1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4164990 0x7fb4c4156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4cb1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c414eb60 0x7fb4c414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4cb1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4151a70 con 0x7fb4c414eb60 2023-07-27T14:28:57.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4cb1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c414f4d0 con 0x7fb4b4005000 2023-07-27T14:28:57.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4cb1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4151140 con 0x7fb4c4164990 2023-07-27T14:28:57.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4c979c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c414eb60 0x7fb4c414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4c979c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c414eb60 0x7fb4c414efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36290/0 (socket says 172.21.15.115:36290) 2023-07-27T14:28:57.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4c979c700 1 -- 172.21.15.115:0/3567606103 learned_addr learned my addr 172.21.15.115:0/3567606103 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:57.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4c8f9b700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4005000 0x7fb4c40b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.858+0000 7fb4c3fff700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4164990 0x7fb4c4156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c979c700 1 -- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4164990 msgr2=0x7fb4c4156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c979c700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4164990 0x7fb4c4156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c979c700 1 -- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4005000 msgr2=0x7fb4c40b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:57.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c979c700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4005000 0x7fb4c40b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:57.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c979c700 1 -- 172.21.15.115:0/3567606103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c4151420 con 0x7fb4c414eb60 2023-07-27T14:28:57.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c8f9b700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4005000 0x7fb4c40b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:28:57.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c979c700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c414eb60 0x7fb4c414efe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fb4bc000f80 tx=0x7fb4bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c0ff9700 1 -- 172.21.15.115:0/3567606103 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc002030 con 0x7fb4c414eb60 2023-07-27T14:28:57.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c0ff9700 1 -- 172.21.15.115:0/3567606103 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc005e60 con 0x7fb4c414eb60 2023-07-27T14:28:57.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c4151700 con 0x7fb4c414eb60 2023-07-27T14:28:57.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4c0ff9700 1 -- 172.21.15.115:0/3567606103 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0138b0 con 0x7fb4c414eb60 2023-07-27T14:28:57.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.859+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c4164e10 con 0x7fb4c414eb60 2023-07-27T14:28:57.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.860+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c406b470 con 0x7fb4c414eb60 2023-07-27T14:28:57.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.861+0000 7fb4c0ff9700 1 -- 172.21.15.115:0/3567606103 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fb4bc01d070 con 0x7fb4c414eb60 2023-07-27T14:28:57.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.862+0000 7fb4c0ff9700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4a805eef0 0x7fb4a80613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:57.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.862+0000 7fb4c0ff9700 1 -- 172.21.15.115:0/3567606103 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fb4bc07b1c0 con 0x7fb4c414eb60 2023-07-27T14:28:57.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.862+0000 7fb4c8f9b700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4a805eef0 0x7fb4a80613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:57.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.863+0000 7fb4c8f9b700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4a805eef0 0x7fb4a80613b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fb4b8006f70 tx=0x7fb4b8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:57.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:57.866+0000 7fb4c0ff9700 1 -- 172.21.15.115:0/3567606103 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4bc04c550 con 0x7fb4c414eb60 2023-07-27T14:28:58.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.034+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb4c406c470 con 0x7fb4c414eb60 2023-07-27T14:28:58.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.035+0000 7fb4c0ff9700 1 -- 172.21.15.115:0/3567606103 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v40) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb4bc01a070 con 0x7fb4c414eb60 2023-07-27T14:28:58.056 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:28:58.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4a805eef0 msgr2=0x7fb4a80613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4a805eef0 0x7fb4a80613b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fb4b8006f70 tx=0x7fb4b8008040).stop 2023-07-27T14:28:58.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c414eb60 msgr2=0x7fb4c414efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c414eb60 0x7fb4c414efe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fb4bc000f80 tx=0x7fb4bc015000).stop 2023-07-27T14:28:58.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 shutdown_connections 2023-07-27T14:28:58.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4a805eef0 0x7fb4a80613b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c414eb60 0x7fb4c414efe0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4b4005000 0x7fb4c40b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 --2- 172.21.15.115:0/3567606103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4164990 0x7fb4c4156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 >> 172.21.15.115:0/3567606103 conn(0x7fb4c405e940 msgr2=0x7fb4c414a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:58.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 shutdown_connections 2023-07-27T14:28:58.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.037+0000 7fb4cb1ff700 1 -- 172.21.15.115:0/3567606103 wait complete. 2023-07-27T14:28:58.075 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:28:58.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.245+0000 7f52f59ff700 1 Processor -- start 2023-07-27T14:28:58.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.245+0000 7f52f59ff700 1 -- start start 2023-07-27T14:28:58.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.246+0000 7f52f59ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f52f0063260 0x7f52f0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.246+0000 7f52f59ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f52f014b1e0 0x7f52f00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.246+0000 7f52f59ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f01553f0 con 0x7f52f014ae00 2023-07-27T14:28:58.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.246+0000 7f52f59ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f0157a50 con 0x7f52f0063260 2023-07-27T14:28:58.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.246+0000 7f52f59ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f0157d10 con 0x7f52f014b1e0 2023-07-27T14:28:58.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.246+0000 7f52ee7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f52f0063260 0x7f52f0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.246+0000 7f52eeffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f52f014ae00 0x7f52f0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53336/0 (socket says 172.21.15.115:53336) 2023-07-27T14:28:58.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.246+0000 7f52eeffd700 1 -- 172.21.15.115:0/628159363 learned_addr learned my addr 172.21.15.115:0/628159363 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:58.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52ef7fe700 1 --2- 172.21.15.115:0/628159363 >> v2:172.21.15.159:3300/0 conn(0x7f52f014b1e0 0x7f52f00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52ee7fc700 1 -- 172.21.15.115:0/628159363 >> v2:172.21.15.159:3300/0 conn(0x7f52f014b1e0 msgr2=0x7f52f00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52ee7fc700 1 --2- 172.21.15.115:0/628159363 >> v2:172.21.15.159:3300/0 conn(0x7f52f014b1e0 0x7f52f00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52ee7fc700 1 -- 172.21.15.115:0/628159363 >> v1:172.21.15.115:6789/0 conn(0x7f52f014ae00 legacy=0x7f52f0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52ee7fc700 1 -- 172.21.15.115:0/628159363 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0157ff0 con 0x7f52f0063260 2023-07-27T14:28:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52edffb700 1 -- 172.21.15.115:0/628159363 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149430818 0 0) 0x7f52f01553f0 con 0x7f52f014ae00 2023-07-27T14:28:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52ee7fc700 1 --2- 172.21.15.115:0/628159363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f0063260 0x7f52f0154f00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f52f0083430 tx=0x7f52e4009060).ready entity=mon.0 client_cookie=767bc2e59483889e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52edffb700 1 -- 172.21.15.115:0/628159363 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400f510 con 0x7f52f0063260 2023-07-27T14:28:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52edffb700 1 -- 172.21.15.115:0/628159363 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400f670 con 0x7f52f0063260 2023-07-27T14:28:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.247+0000 7f52edffb700 1 -- 172.21.15.115:0/628159363 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400f9f0 con 0x7f52f0063260 2023-07-27T14:28:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.248+0000 7f52f59ff700 1 -- 172.21.15.115:0/628159363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f0063260 msgr2=0x7f52f0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.248+0000 7f52f59ff700 1 --2- 172.21.15.115:0/628159363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f0063260 0x7f52f0154f00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f52f0083430 tx=0x7f52e4009060).stop 2023-07-27T14:28:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.248+0000 7f52f59ff700 1 -- 172.21.15.115:0/628159363 shutdown_connections 2023-07-27T14:28:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.248+0000 7f52f59ff700 1 --2- 172.21.15.115:0/628159363 >> v2:172.21.15.159:3300/0 conn(0x7f52f014b1e0 0x7f52f00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.248+0000 7f52f59ff700 1 --2- 172.21.15.115:0/628159363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f0063260 0x7f52f0154f00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.248+0000 7f52f59ff700 1 -- 172.21.15.115:0/628159363 >> 172.21.15.115:0/628159363 conn(0x7f52f005e940 msgr2=0x7f52f00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.248+0000 7f52f59ff700 1 -- 172.21.15.115:0/628159363 shutdown_connections 2023-07-27T14:28:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.248+0000 7f52f59ff700 1 -- 172.21.15.115:0/628159363 wait complete. 2023-07-27T14:28:58.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.249+0000 7f52f59ff700 1 Processor -- start 2023-07-27T14:28:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.250+0000 7f52f59ff700 1 -- start start 2023-07-27T14:28:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52f59ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52f0063260 0x7f52f013d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52f59ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f014ae00 0x7f52f00c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52f59ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52f014b1e0 0x7f52f00c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52f59ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00c1fa0 con 0x7f52f014ae00 2023-07-27T14:28:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52f59ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00ae810 con 0x7f52f0063260 2023-07-27T14:28:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52f59ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00c51a0 con 0x7f52f014b1e0 2023-07-27T14:28:58.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f014ae00 0x7f52f00c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f014ae00 0x7f52f00c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36300/0 (socket says 172.21.15.115:36300) 2023-07-27T14:28:58.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 -- 172.21.15.115:0/2756283584 learned_addr learned my addr 172.21.15.115:0/2756283584 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:58.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52eeffd700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52f0063260 0x7f52f013d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 -- 172.21.15.115:0/2756283584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52f014b1e0 msgr2=0x7f52f00c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52f014b1e0 0x7f52f00c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:58.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 -- 172.21.15.115:0/2756283584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52f0063260 msgr2=0x7f52f013d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52f0063260 0x7f52f013d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 -- 172.21.15.115:0/2756283584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40092a0 con 0x7f52f014ae00 2023-07-27T14:28:58.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52eeffd700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52f0063260 0x7f52f013d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:28:58.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.251+0000 7f52ee7fc700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f014ae00 0x7f52f00c4340 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f52f0155580 tx=0x7f52e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:58.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.252+0000 7f52d6ffd700 1 -- 172.21.15.115:0/2756283584 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400f7e0 con 0x7f52f014ae00 2023-07-27T14:28:58.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.252+0000 7f52d6ffd700 1 -- 172.21.15.115:0/2756283584 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400f940 con 0x7f52f014ae00 2023-07-27T14:28:58.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.252+0000 7f52d6ffd700 1 -- 172.21.15.115:0/2756283584 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e401b660 con 0x7f52f014ae00 2023-07-27T14:28:58.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.252+0000 7f52f59ff700 1 -- 172.21.15.115:0/2756283584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f00c4ec0 con 0x7f52f014ae00 2023-07-27T14:28:58.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.252+0000 7f52f59ff700 1 -- 172.21.15.115:0/2756283584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f00ae4a0 con 0x7f52f014ae00 2023-07-27T14:28:58.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.253+0000 7f52d4ff9700 1 -- 172.21.15.115:0/2756283584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c8005120 con 0x7f52f014ae00 2023-07-27T14:28:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.253+0000 7f52d6ffd700 1 -- 172.21.15.115:0/2756283584 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f52e402b070 con 0x7f52f014ae00 2023-07-27T14:28:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.254+0000 7f52d6ffd700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52dc05eef0 0x7f52dc0613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.254+0000 7f52d6ffd700 1 -- 172.21.15.115:0/2756283584 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f52e407b550 con 0x7f52f014ae00 2023-07-27T14:28:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.255+0000 7f52eeffd700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52dc05eef0 0x7f52dc0613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.255+0000 7f52eeffd700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52dc05eef0 0x7f52dc0613b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f52e0001750 tx=0x7f52e0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:58.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.259+0000 7f52d6ffd700 1 -- 172.21.15.115:0/2756283584 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f52e404c970 con 0x7f52f014ae00 2023-07-27T14:28:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.428+0000 7f52d4ff9700 1 -- 172.21.15.115:0/2756283584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52c8005d70 con 0x7f52f014ae00 2023-07-27T14:28:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.428+0000 7f52d6ffd700 1 -- 172.21.15.115:0/2756283584 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f52e40290a0 con 0x7f52f014ae00 2023-07-27T14:28:58.450 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:28:58.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 -- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52dc05eef0 msgr2=0x7f52dc0613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52dc05eef0 0x7f52dc0613b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f52e0001750 tx=0x7f52e0009040).stop 2023-07-27T14:28:58.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 -- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f014ae00 msgr2=0x7f52f00c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f014ae00 0x7f52f00c4340 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f52f0155580 tx=0x7f52e4017000).stop 2023-07-27T14:28:58.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 -- 172.21.15.115:0/2756283584 shutdown_connections 2023-07-27T14:28:58.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f52dc05eef0 0x7f52dc0613b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52f014b1e0 0x7f52f00c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:58.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52f0063260 0x7f52f013d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 --2- 172.21.15.115:0/2756283584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f014ae00 0x7f52f00c4340 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 -- 172.21.15.115:0/2756283584 >> 172.21.15.115:0/2756283584 conn(0x7f52f005e940 msgr2=0x7f52f01497d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:58.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 -- 172.21.15.115:0/2756283584 shutdown_connections 2023-07-27T14:28:58.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.430+0000 7f52d4ff9700 1 -- 172.21.15.115:0/2756283584 wait complete. 2023-07-27T14:28:58.469 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:28:58.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:28:58.580 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:28:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.642+0000 7fcbce9ff700 1 Processor -- start 2023-07-27T14:28:58.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.642+0000 7fcbce9ff700 1 -- start start 2023-07-27T14:28:58.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbce9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbc8063260 0x7fcbc8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbce9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcbc814b1e0 0x7fcbc80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbce9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc81553f0 con 0x7fcbc814ae00 2023-07-27T14:28:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbce9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc8157a50 con 0x7fcbc8063260 2023-07-27T14:28:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbce9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc8157d10 con 0x7fcbc814b1e0 2023-07-27T14:28:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbc77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbc8063260 0x7fcbc8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbc77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbc8063260 0x7fcbc8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36314/0 (socket says 172.21.15.115:36314) 2023-07-27T14:28:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbc77fe700 1 -- 172.21.15.115:0/1356136546 learned_addr learned my addr 172.21.15.115:0/1356136546 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbccf9c700 1 --2- 172.21.15.115:0/1356136546 >> v2:172.21.15.159:3300/0 conn(0x7fcbc814b1e0 0x7fcbc80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbc77fe700 1 -- 172.21.15.115:0/1356136546 >> v2:172.21.15.159:3300/0 conn(0x7fcbc814b1e0 msgr2=0x7fcbc80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbc77fe700 1 --2- 172.21.15.115:0/1356136546 >> v2:172.21.15.159:3300/0 conn(0x7fcbc814b1e0 0x7fcbc80a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbc77fe700 1 -- 172.21.15.115:0/1356136546 >> v1:172.21.15.159:6789/0 conn(0x7fcbc814ae00 legacy=0x7fcbc8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.644+0000 7fcbc77fe700 1 -- 172.21.15.115:0/1356136546 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8157ff0 con 0x7fcbc8063260 2023-07-27T14:28:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbc77fe700 1 --2- 172.21.15.115:0/1356136546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc8063260 0x7fcbc8154f00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fcbc8083430 tx=0x7fcbbc0090f0).ready entity=mon.0 client_cookie=a4a5b7f3650b3b51 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbc6ffd700 1 -- 172.21.15.115:0/1356136546 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc00b600 con 0x7fcbc8063260 2023-07-27T14:28:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbc6ffd700 1 -- 172.21.15.115:0/1356136546 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc00b760 con 0x7fcbc8063260 2023-07-27T14:28:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbc6ffd700 1 -- 172.21.15.115:0/1356136546 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc00bae0 con 0x7fcbc8063260 2023-07-27T14:28:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1356136546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc8063260 msgr2=0x7fcbc8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1356136546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc8063260 0x7fcbc8154f00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fcbc8083430 tx=0x7fcbbc0090f0).stop 2023-07-27T14:28:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1356136546 shutdown_connections 2023-07-27T14:28:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1356136546 >> v2:172.21.15.159:3300/0 conn(0x7fcbc814b1e0 0x7fcbc80a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1356136546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc8063260 0x7fcbc8154f00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1356136546 >> 172.21.15.115:0/1356136546 conn(0x7fcbc805e940 msgr2=0x7fcbc80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.645+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1356136546 shutdown_connections 2023-07-27T14:28:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.646+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1356136546 wait complete. 2023-07-27T14:28:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.647+0000 7fcbce9ff700 1 Processor -- start 2023-07-27T14:28:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.647+0000 7fcbce9ff700 1 -- start start 2023-07-27T14:28:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbce9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc8063260 0x7fcbc80c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbce9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc814ae00 0x7fcbc8149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbce9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbc814b1e0 0x7fcbc80c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbce9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80c5610 con 0x7fcbc814ae00 2023-07-27T14:28:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbce9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80c2140 con 0x7fcbc8063260 2023-07-27T14:28:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbce9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80c23a0 con 0x7fcbc814b1e0 2023-07-27T14:28:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbc77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc814ae00 0x7fcbc8149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbc77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc814ae00 0x7fcbc8149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36324/0 (socket says 172.21.15.115:36324) 2023-07-27T14:28:58.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbc77fe700 1 -- 172.21.15.115:0/1055600411 learned_addr learned my addr 172.21.15.115:0/1055600411 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:58.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbc7fff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc8063260 0x7fcbc80c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.648+0000 7fcbccf9c700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbc814b1e0 0x7fcbc80c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbc77fe700 1 -- 172.21.15.115:0/1055600411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbc814b1e0 msgr2=0x7fcbc80c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbc77fe700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbc814b1e0 0x7fcbc80c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbc77fe700 1 -- 172.21.15.115:0/1055600411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc8063260 msgr2=0x7fcbc80c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbc77fe700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc8063260 0x7fcbc80c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbc77fe700 1 -- 172.21.15.115:0/1055600411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc009370 con 0x7fcbc814ae00 2023-07-27T14:28:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbc77fe700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc814ae00 0x7fcbc8149700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fcbbc011000 tx=0x7fcbbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbaffff700 1 -- 172.21.15.115:0/1055600411 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc00b8d0 con 0x7fcbc814ae00 2023-07-27T14:28:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbaffff700 1 -- 172.21.15.115:0/1055600411 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc00ba30 con 0x7fcbc814ae00 2023-07-27T14:28:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbaffff700 1 -- 172.21.15.115:0/1055600411 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc01c630 con 0x7fcbc814ae00 2023-07-27T14:28:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc80c2680 con 0x7fcbc814ae00 2023-07-27T14:28:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.649+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc80c2c40 con 0x7fcbc814ae00 2023-07-27T14:28:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.650+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc806c470 con 0x7fcbc814ae00 2023-07-27T14:28:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.651+0000 7fcbaffff700 1 -- 172.21.15.115:0/1055600411 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fcbbc00f070 con 0x7fcbc814ae00 2023-07-27T14:28:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.652+0000 7fcbaffff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbb405eef0 0x7fcbb40613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.652+0000 7fcbaffff700 1 -- 172.21.15.115:0/1055600411 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fcbbc07b470 con 0x7fcbc814ae00 2023-07-27T14:28:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.652+0000 7fcbc7fff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbb405eef0 0x7fcbb40613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.653+0000 7fcbc7fff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbb405eef0 0x7fcbb40613b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fcbb8003900 tx=0x7fcbb8007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.657+0000 7fcbaffff700 1 -- 172.21.15.115:0/1055600411 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbbc04c780 con 0x7fcbc814ae00 2023-07-27T14:28:58.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.828+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcbc80c04d0 con 0x7fcbc814ae00 2023-07-27T14:28:58.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.828+0000 7fcbaffff700 1 -- 172.21.15.115:0/1055600411 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcbbc04fda0 con 0x7fcbc814ae00 2023-07-27T14:28:58.850 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:28:58.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.830+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbb405eef0 msgr2=0x7fcbb40613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbb405eef0 0x7fcbb40613b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fcbb8003900 tx=0x7fcbb8007d40).stop 2023-07-27T14:28:58.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc814ae00 msgr2=0x7fcbc8149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:58.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc814ae00 0x7fcbc8149700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fcbbc011000 tx=0x7fcbbc017000).stop 2023-07-27T14:28:58.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 shutdown_connections 2023-07-27T14:28:58.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbb405eef0 0x7fcbb40613b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbc814b1e0 0x7fcbc80c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc8063260 0x7fcbc80c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 --2- 172.21.15.115:0/1055600411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbc814ae00 0x7fcbc8149700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:58.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 >> 172.21.15.115:0/1055600411 conn(0x7fcbc805e940 msgr2=0x7fcbc80ab460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:58.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 shutdown_connections 2023-07-27T14:28:58.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:58.831+0000 7fcbce9ff700 1 -- 172.21.15.115:0/1055600411 wait complete. 2023-07-27T14:28:58.869 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:28:59.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.078+0000 7ff9e19ff700 1 Processor -- start 2023-07-27T14:28:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.078+0000 7ff9e19ff700 1 -- start start 2023-07-27T14:28:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.079+0000 7ff9e19ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 0x7ff9dc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.079+0000 7ff9e19ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc1553f0 con 0x7ff9dc14b1e0 2023-07-27T14:28:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.079+0000 7ff9e19ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc157a50 con 0x7ff9dc14ae00 2023-07-27T14:28:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.079+0000 7ff9e19ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc157d10 con 0x7ff9dc063260 2023-07-27T14:28:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9db7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff9dc14b1e0 0x7ff9dc0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53350/0 (socket says 172.21.15.115:53350) 2023-07-27T14:28:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9db7fe700 1 -- 172.21.15.115:0/2026670952 learned_addr learned my addr 172.21.15.115:0/2026670952 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:59.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9da7fc700 1 --2- 172.21.15.115:0/2026670952 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 0x7ff9dc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9d9ffb700 1 -- 172.21.15.115:0/2026670952 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846956682 0 0) 0x7ff9dc1553f0 con 0x7ff9dc14b1e0 2023-07-27T14:28:59.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9d9ffb700 1 -- 172.21.15.115:0/2026670952 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c40033f0 con 0x7ff9dc14b1e0 2023-07-27T14:28:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9d9ffb700 1 -- 172.21.15.115:0/2026670952 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141640631 0 0) 0x7ff9dc157a50 con 0x7ff9dc14ae00 2023-07-27T14:28:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9d9ffb700 1 -- 172.21.15.115:0/2026670952 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9dc1553f0 con 0x7ff9dc14ae00 2023-07-27T14:28:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9da7fc700 1 -- 172.21.15.115:0/2026670952 >> v1:172.21.15.159:6789/0 conn(0x7ff9dc14ae00 legacy=0x7ff9dc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9da7fc700 1 -- 172.21.15.115:0/2026670952 >> v1:172.21.15.115:6789/0 conn(0x7ff9dc14b1e0 legacy=0x7ff9dc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9da7fc700 1 -- 172.21.15.115:0/2026670952 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc157ff0 con 0x7ff9dc063260 2023-07-27T14:28:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.080+0000 7ff9da7fc700 1 --2- 172.21.15.115:0/2026670952 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 0x7ff9dc154f00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff9d0009790 tx=0x7ff9d0009060).ready entity=mon.2 client_cookie=28acfa0bc5f4d6d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9d9ffb700 1 -- 172.21.15.115:0/2026670952 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000f510 con 0x7ff9dc063260 2023-07-27T14:28:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9d9ffb700 1 -- 172.21.15.115:0/2026670952 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000f670 con 0x7ff9dc063260 2023-07-27T14:28:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9d9ffb700 1 -- 172.21.15.115:0/2026670952 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000f9f0 con 0x7ff9dc063260 2023-07-27T14:28:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9e19ff700 1 -- 172.21.15.115:0/2026670952 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 msgr2=0x7ff9dc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9e19ff700 1 --2- 172.21.15.115:0/2026670952 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 0x7ff9dc154f00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff9d0009790 tx=0x7ff9d0009060).stop 2023-07-27T14:28:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9e19ff700 1 -- 172.21.15.115:0/2026670952 shutdown_connections 2023-07-27T14:28:59.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9e19ff700 1 --2- 172.21.15.115:0/2026670952 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 0x7ff9dc154f00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9e19ff700 1 -- 172.21.15.115:0/2026670952 >> 172.21.15.115:0/2026670952 conn(0x7ff9dc05e940 msgr2=0x7ff9dc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:59.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9e19ff700 1 -- 172.21.15.115:0/2026670952 shutdown_connections 2023-07-27T14:28:59.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.081+0000 7ff9e19ff700 1 -- 172.21.15.115:0/2026670952 wait complete. 2023-07-27T14:28:59.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.083+0000 7ff9e19ff700 1 Processor -- start 2023-07-27T14:28:59.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.083+0000 7ff9e19ff700 1 -- start start 2023-07-27T14:28:59.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9e19ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 0x7ff9dc0c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9e19ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9dc14ae00 0x7ff9dc0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9e19ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9dc14b1e0 0x7ff9dc0a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9e19ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0c2db0 con 0x7ff9dc14ae00 2023-07-27T14:28:59.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9e19ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0ae050 con 0x7ff9dc14b1e0 2023-07-27T14:28:59.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9e19ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0aeea0 con 0x7ff9dc063260 2023-07-27T14:28:59.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9da7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9dc14ae00 0x7ff9dc0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9da7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9dc14ae00 0x7ff9dc0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36326/0 (socket says 172.21.15.115:36326) 2023-07-27T14:28:59.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9da7fc700 1 -- 172.21.15.115:0/3011757253 learned_addr learned my addr 172.21.15.115:0/3011757253 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:59.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9da7fc700 1 -- 172.21.15.115:0/3011757253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 msgr2=0x7ff9dc0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9da7fc700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 0x7ff9dc0c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:59.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9da7fc700 1 -- 172.21.15.115:0/3011757253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9dc14b1e0 msgr2=0x7ff9dc0a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9da7fc700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9dc14b1e0 0x7ff9dc0a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:59.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.084+0000 7ff9da7fc700 1 -- 172.21.15.115:0/3011757253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00092a0 con 0x7ff9dc14ae00 2023-07-27T14:28:59.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.085+0000 7ff9da7fc700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9dc14ae00 0x7ff9dc0adb60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7ff9d0011000 tx=0x7ff9d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.085+0000 7ff9c2ffd700 1 -- 172.21.15.115:0/3011757253 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000f7e0 con 0x7ff9dc14ae00 2023-07-27T14:28:59.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.085+0000 7ff9c2ffd700 1 -- 172.21.15.115:0/3011757253 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000f940 con 0x7ff9dc14ae00 2023-07-27T14:28:59.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.085+0000 7ff9c2ffd700 1 -- 172.21.15.115:0/3011757253 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d001b660 con 0x7ff9dc14ae00 2023-07-27T14:28:59.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.085+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc0ae290 con 0x7ff9dc14ae00 2023-07-27T14:28:59.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.085+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc0ae850 con 0x7ff9dc14ae00 2023-07-27T14:28:59.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.086+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9dc06c470 con 0x7ff9dc14ae00 2023-07-27T14:28:59.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.087+0000 7ff9c2ffd700 1 -- 172.21.15.115:0/3011757253 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7ff9d0021030 con 0x7ff9dc14ae00 2023-07-27T14:28:59.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.088+0000 7ff9c2ffd700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9c805eef0 0x7ff9c80613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.088+0000 7ff9c2ffd700 1 -- 172.21.15.115:0/3011757253 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7ff9d007b770 con 0x7ff9dc14ae00 2023-07-27T14:28:59.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.088+0000 7ff9daffd700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9c805eef0 0x7ff9c80613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.088+0000 7ff9daffd700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9c805eef0 0x7ff9c80613b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff9cc000c00 tx=0x7ff9cc007830).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.093+0000 7ff9c2ffd700 1 -- 172.21.15.115:0/3011757253 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9d004cb50 con 0x7ff9dc14ae00 2023-07-27T14:28:59.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.259+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9dc0c0720 con 0x7ff9dc14ae00 2023-07-27T14:28:59.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.260+0000 7ff9c2ffd700 1 -- 172.21.15.115:0/3011757253 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9d001f0a0 con 0x7ff9dc14ae00 2023-07-27T14:28:59.281 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:28:59.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9c805eef0 msgr2=0x7ff9c80613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9c805eef0 0x7ff9c80613b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff9cc000c00 tx=0x7ff9cc007830).stop 2023-07-27T14:28:59.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9dc14ae00 msgr2=0x7ff9dc0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9dc14ae00 0x7ff9dc0adb60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7ff9d0011000 tx=0x7ff9d0017000).stop 2023-07-27T14:28:59.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 shutdown_connections 2023-07-27T14:28:59.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff9c805eef0 0x7ff9c80613b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9dc14b1e0 0x7ff9dc0a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:59.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9dc063260 0x7ff9dc0c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:59.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 --2- 172.21.15.115:0/3011757253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9dc14ae00 0x7ff9dc0adb60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 >> 172.21.15.115:0/3011757253 conn(0x7ff9dc05e940 msgr2=0x7ff9dc0c0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:59.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 shutdown_connections 2023-07-27T14:28:59.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.262+0000 7ff9e19ff700 1 -- 172.21.15.115:0/3011757253 wait complete. 2023-07-27T14:28:59.301 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:28:59.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.468+0000 7fd1bc1ff700 1 Processor -- start 2023-07-27T14:28:59.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.468+0000 7fd1bc1ff700 1 -- start start 2023-07-27T14:28:59.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.469+0000 7fd1bc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4153ec0 0x7fd1b40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.469+0000 7fd1bc1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40aa4d0 con 0x7fd1b40aaa40 2023-07-27T14:28:59.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.469+0000 7fd1bc1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40c05c0 con 0x7fd1b40aa050 2023-07-27T14:28:59.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.469+0000 7fd1bc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40bfc90 con 0x7fd1b4153ec0 2023-07-27T14:28:59.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1ba79c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd1b40aaa40 0x7fd1b40c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53366/0 (socket says 172.21.15.115:53366) 2023-07-27T14:28:59.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1ba79c700 1 -- 172.21.15.115:0/563326139 learned_addr learned my addr 172.21.15.115:0/563326139 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:28:59.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b9f9b700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4153ec0 0x7fd1b40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006305312 0 0) 0x7fd1ac001490 con 0x7fd1b40aaa40 2023-07-27T14:28:59.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a00033f0 con 0x7fd1b40aaa40 2023-07-27T14:28:59.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241187971 0 0) 0x7fd1a00033f0 con 0x7fd1b40aaa40 2023-07-27T14:28:59.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4153ec0 msgr2=0x7fd1b40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:59.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4153ec0 0x7fd1b40a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 >> v1:172.21.15.159:6789/0 conn(0x7fd1b40aa050 legacy=0x7fd1b40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40bff70 con 0x7fd1b40aaa40 2023-07-27T14:28:59.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fd1ac001980 con 0x7fd1b40aaa40 2023-07-27T14:28:59.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 >> v1:172.21.15.115:6789/0 conn(0x7fd1b40aaa40 legacy=0x7fd1b40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.470+0000 7fd1b8f99700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4153ec0 0x7fd1a0003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b8f99700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1a0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b8f99700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a0004b80 0x7fd1a0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40bfc90 con 0x7fd1a0003e40 2023-07-27T14:28:59.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a000b990 con 0x7fd1a0004b80 2023-07-27T14:28:59.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a000bb50 con 0x7fd1b4153ec0 2023-07-27T14:28:59.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b979a700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1a0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1ba79c700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a0004b80 0x7fd1a0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b9f9b700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4153ec0 0x7fd1a0003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b979a700 1 -- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4153ec0 msgr2=0x7fd1a0003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:59.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b979a700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4153ec0 0x7fd1a0003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b979a700 1 -- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a0004b80 msgr2=0x7fd1a0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:59.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b979a700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1a0004b80 0x7fd1a0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b979a700 1 -- 172.21.15.115:0/563326139 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a00033f0 con 0x7fd1a0003e40 2023-07-27T14:28:59.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.471+0000 7fd1b979a700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1a0004690 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fd1b40c8200 tx=0x7fd1a4007bb0).ready entity=mon.0 client_cookie=6ee2633ee63ba732 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4007020 con 0x7fd1a0003e40 2023-07-27T14:28:59.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a4007180 con 0x7fd1a0003e40 2023-07-27T14:28:59.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1b8f99700 1 -- 172.21.15.115:0/563326139 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4007500 con 0x7fd1a0003e40 2023-07-27T14:28:59.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/563326139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 msgr2=0x7fd1a0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1bc1ff700 1 --2- 172.21.15.115:0/563326139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1a0004690 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fd1b40c8200 tx=0x7fd1a4007bb0).stop 2023-07-27T14:28:59.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1ba79c700 1 -- 172.21.15.115:0/563326139 reap_dead start 2023-07-27T14:28:59.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/563326139 shutdown_connections 2023-07-27T14:28:59.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/563326139 >> 172.21.15.115:0/563326139 conn(0x7fd1b40cb610 msgr2=0x7fd1b40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:59.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/563326139 shutdown_connections 2023-07-27T14:28:59.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.472+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/563326139 wait complete. 2023-07-27T14:28:59.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.474+0000 7fd1bc1ff700 1 Processor -- start 2023-07-27T14:28:59.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.474+0000 7fd1bc1ff700 1 -- start start 2023-07-27T14:28:59.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1bc1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1b4167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1bc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4163ff0 0x7fd1b415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1bc1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b40c3430 0x7fd1b40aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1bc1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4153280 con 0x7fd1a0003e40 2023-07-27T14:28:59.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1bc1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41644f0 con 0x7fd1b40c3430 2023-07-27T14:28:59.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1bc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41647d0 con 0x7fd1b4163ff0 2023-07-27T14:28:59.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1b9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1b4167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1b9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1b4167f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36348/0 (socket says 172.21.15.115:36348) 2023-07-27T14:28:59.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1b9f9b700 1 -- 172.21.15.115:0/534226133 learned_addr learned my addr 172.21.15.115:0/534226133 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:59.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1b9f9b700 1 -- 172.21.15.115:0/534226133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4163ff0 msgr2=0x7fd1b415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1b9f9b700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4163ff0 0x7fd1b415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:59.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1b9f9b700 1 -- 172.21.15.115:0/534226133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b40c3430 msgr2=0x7fd1b40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1b9f9b700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b40c3430 0x7fd1b40aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:59.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.475+0000 7fd1b9f9b700 1 -- 172.21.15.115:0/534226133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4164ab0 con 0x7fd1a0003e40 2023-07-27T14:28:59.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.476+0000 7fd1b9f9b700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1b4167f90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fd1b00119f0 tx=0x7fd1b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.476+0000 7fd1a9ffb700 1 -- 172.21.15.115:0/534226133 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000f940 con 0x7fd1a0003e40 2023-07-27T14:28:59.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.476+0000 7fd1a9ffb700 1 -- 172.21.15.115:0/534226133 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b000faa0 con 0x7fd1a0003e40 2023-07-27T14:28:59.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.476+0000 7fd1a9ffb700 1 -- 172.21.15.115:0/534226133 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000fe20 con 0x7fd1a0003e40 2023-07-27T14:28:59.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.476+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b4164d90 con 0x7fd1a0003e40 2023-07-27T14:28:59.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.476+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b415ac80 con 0x7fd1a0003e40 2023-07-27T14:28:59.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.477+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b406c470 con 0x7fd1a0003e40 2023-07-27T14:28:59.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.478+0000 7fd1a9ffb700 1 -- 172.21.15.115:0/534226133 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fd1b0024070 con 0x7fd1a0003e40 2023-07-27T14:28:59.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.479+0000 7fd1a9ffb700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd19805eec0 0x7fd198061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.479+0000 7fd1a9ffb700 1 -- 172.21.15.115:0/534226133 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fd1b007a8a0 con 0x7fd1a0003e40 2023-07-27T14:28:59.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.479+0000 7fd1b979a700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd19805eec0 0x7fd198061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.480+0000 7fd1b979a700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd19805eec0 0x7fd198061380 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fd1b40c8200 tx=0x7fd1a4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.483+0000 7fd1a9ffb700 1 -- 172.21.15.115:0/534226133 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd1b004bcc0 con 0x7fd1a0003e40 2023-07-27T14:28:59.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.693+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1b4150760 con 0x7fd1a0003e40 2023-07-27T14:28:59.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.694+0000 7fd1a9ffb700 1 -- 172.21.15.115:0/534226133 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4498 (secure 0 0 0) 0x7fd1b004f2e0 con 0x7fd1a0003e40 2023-07-27T14:28:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:28:59.716 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/2250060018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2250060018},{"type":"v1","addr":"172.21.15.159:6833","nonce":2250060018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2756493852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2756493852},{"type":"v1","addr":"172.21.15.159:6835","nonce":2756493852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4777,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1646103579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1646103579},{"type":"v1","addr":"172.21.15.115:6836","nonce":1646103579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:28:05.041620+0000","modified":"2023-07-27T14:28:08.054910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4780":{"gid":4780,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6837/770984486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":770984486},{"type":"v1","addr":"172.21.15.115:6837","nonce":770984486}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-07-27T14:28:59.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd19805eec0 msgr2=0x7fd198061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd19805eec0 0x7fd198061380 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fd1b40c8200 tx=0x7fd1a4015000).stop 2023-07-27T14:28:59.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 msgr2=0x7fd1b4167f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1b4167f90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fd1b00119f0 tx=0x7fd1b0009060).stop 2023-07-27T14:28:59.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 shutdown_connections 2023-07-27T14:28:59.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd19805eec0 0x7fd198061380 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b40c3430 0x7fd1b40aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:59.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a0003e40 0x7fd1b4167f90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 --2- 172.21.15.115:0/534226133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b4163ff0 0x7fd1b415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:28:59.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 >> 172.21.15.115:0/534226133 conn(0x7fd1b40cb610 msgr2=0x7fd1b40ac8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:59.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 shutdown_connections 2023-07-27T14:28:59.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.696+0000 7fd1bc1ff700 1 -- 172.21.15.115:0/534226133 wait complete. 2023-07-27T14:28:59.720 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 17 2023-07-27T14:28:59.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:28:59.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.902+0000 7fd6f49ff700 1 Processor -- start 2023-07-27T14:28:59.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.902+0000 7fd6f49ff700 1 -- start start 2023-07-27T14:28:59.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6f49ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd6f00c1f70 0x7fd6f0150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6f49ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f0069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6f49ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f0068380 con 0x7fd6f0150320 2023-07-27T14:28:59.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6f49ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f0065790 con 0x7fd6f00c1f70 2023-07-27T14:28:59.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6f49ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0068ee0 con 0x7fd6f00c0e80 2023-07-27T14:28:59.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6edd9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd6f00c1f70 0x7fd6f0150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6eed9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f0069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6edd9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd6f00c1f70 0x7fd6f0150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:55740/0 (socket says 172.21.15.115:55740) 2023-07-27T14:28:59.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.904+0000 7fd6edd9b700 1 -- 172.21.15.115:0/1919183302 learned_addr learned my addr 172.21.15.115:0/1919183302 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:59.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6ed59a700 1 -- 172.21.15.115:0/1919183302 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871933693 0 0) 0x7fd6f0068380 con 0x7fd6f0150320 2023-07-27T14:28:59.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6ed59a700 1 -- 172.21.15.115:0/1919183302 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d80033f0 con 0x7fd6f0150320 2023-07-27T14:28:59.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6eed9d700 1 -- 172.21.15.115:0/1919183302 >> v2:172.21.15.159:3300/0 conn(0x7fd6f00c1f70 msgr2=0x7fd6f0150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:28:59.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6eed9d700 1 --2- 172.21.15.115:0/1919183302 >> v2:172.21.15.159:3300/0 conn(0x7fd6f00c1f70 0x7fd6f0150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6eed9d700 1 -- 172.21.15.115:0/1919183302 >> v1:172.21.15.159:6789/0 conn(0x7fd6f0150320 legacy=0x7fd6f00c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6eed9d700 1 -- 172.21.15.115:0/1919183302 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00685b0 con 0x7fd6f00c0e80 2023-07-27T14:28:59.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6eed9d700 1 --2- 172.21.15.115:0/1919183302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f0069370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd6e800d0d0 tx=0x7fd6e800b990).ready entity=mon.2 client_cookie=f5e12c1c4cad2416 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6ed59a700 1 -- 172.21.15.115:0/1919183302 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8010070 con 0x7fd6f00c0e80 2023-07-27T14:28:59.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6ed59a700 1 -- 172.21.15.115:0/1919183302 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800b2e0 con 0x7fd6f00c0e80 2023-07-27T14:28:59.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.905+0000 7fd6ed59a700 1 -- 172.21.15.115:0/1919183302 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800dc90 con 0x7fd6f00c0e80 2023-07-27T14:28:59.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.906+0000 7fd6f49ff700 1 -- 172.21.15.115:0/1919183302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 msgr2=0x7fd6f0069370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.906+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/1919183302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f0069370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd6e800d0d0 tx=0x7fd6e800b990).stop 2023-07-27T14:28:59.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.906+0000 7fd6f49ff700 1 -- 172.21.15.115:0/1919183302 shutdown_connections 2023-07-27T14:28:59.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.906+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/1919183302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f0069370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.906+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/1919183302 >> v2:172.21.15.159:3300/0 conn(0x7fd6f00c1f70 0x7fd6f0150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.906+0000 7fd6f49ff700 1 -- 172.21.15.115:0/1919183302 >> 172.21.15.115:0/1919183302 conn(0x7fd6f0062320 msgr2=0x7fd6f0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:28:59.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.906+0000 7fd6f49ff700 1 -- 172.21.15.115:0/1919183302 shutdown_connections 2023-07-27T14:28:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.906+0000 7fd6f49ff700 1 -- 172.21.15.115:0/1919183302 wait complete. 2023-07-27T14:28:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.907+0000 7fd6f49ff700 1 Processor -- start 2023-07-27T14:28:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.907+0000 7fd6f49ff700 1 -- start start 2023-07-27T14:28:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.908+0000 7fd6f49ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.908+0000 7fd6f49ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f00c1f70 0x7fd6f0153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.908+0000 7fd6f49ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f0150320 0x7fd6f00bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.908+0000 7fd6f49ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00a8580 con 0x7fd6f00c1f70 2023-07-27T14:28:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.908+0000 7fd6f49ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0152590 con 0x7fd6f0150320 2023-07-27T14:28:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.908+0000 7fd6f49ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00a4b90 con 0x7fd6f00c0e80 2023-07-27T14:28:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f00c1f70 0x7fd6f0153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f00c1f70 0x7fd6f0153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36362/0 (socket says 172.21.15.115:36362) 2023-07-27T14:28:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 -- 172.21.15.115:0/3705280806 learned_addr learned my addr 172.21.15.115:0/3705280806 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:28:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6ee59c700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6eed9d700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f0150320 0x7fd6f00bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 -- 172.21.15.115:0/3705280806 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 msgr2=0x7fd6f014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 -- 172.21.15.115:0/3705280806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f0150320 msgr2=0x7fd6f00bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:28:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f0150320 0x7fd6f00bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:28:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 -- 172.21.15.115:0/3705280806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e800bc30 con 0x7fd6f00c1f70 2023-07-27T14:28:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.909+0000 7fd6edd9b700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f00c1f70 0x7fd6f0153800 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fd6e400e820 tx=0x7fd6e40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.910+0000 7fd6de7fc700 1 -- 172.21.15.115:0/3705280806 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e400c610 con 0x7fd6f00c1f70 2023-07-27T14:28:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.910+0000 7fd6de7fc700 1 -- 172.21.15.115:0/3705280806 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e400c770 con 0x7fd6f00c1f70 2023-07-27T14:28:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.910+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f0152830 con 0x7fd6f00c1f70 2023-07-27T14:28:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.910+0000 7fd6de7fc700 1 -- 172.21.15.115:0/3705280806 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e400cb10 con 0x7fd6f00c1f70 2023-07-27T14:28:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.910+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f00a4840 con 0x7fd6f00c1f70 2023-07-27T14:28:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.911+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f0152ba0 con 0x7fd6f00c1f70 2023-07-27T14:28:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.911+0000 7fd6de7fc700 1 -- 172.21.15.115:0/3705280806 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fd6e4022070 con 0x7fd6f00c1f70 2023-07-27T14:28:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.912+0000 7fd6de7fc700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6d005eef0 0x7fd6d00613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:28:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.912+0000 7fd6de7fc700 1 -- 172.21.15.115:0/3705280806 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fd6e407a1f0 con 0x7fd6f00c1f70 2023-07-27T14:28:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.912+0000 7fd6ee59c700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6d005eef0 0x7fd6d00613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:28:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.913+0000 7fd6ee59c700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6d005eef0 0x7fd6d00613b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fd6e0000c00 tx=0x7fd6e0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:28:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:28:59.916+0000 7fd6de7fc700 1 -- 172.21.15.115:0/3705280806 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd6e404b500 con 0x7fd6f00c1f70 2023-07-27T14:29:00.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.084+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6f006c470 con 0x7fd6f00c1f70 2023-07-27T14:29:00.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.085+0000 7fd6de7fc700 1 -- 172.21.15.115:0/3705280806 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17142 (secure 0 0 0) 0x7fd6e404eb20 con 0x7fd6f00c1f70 2023-07-27T14:29:00.108 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:00.108 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":40,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:28:49.583377+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:28:03.303433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-27T14:28:04.025837+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:29:00.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.087+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6d005eef0 msgr2=0x7fd6d00613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.087+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6d005eef0 0x7fd6d00613b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fd6e0000c00 tx=0x7fd6e0009040).stop 2023-07-27T14:29:00.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.087+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f00c1f70 msgr2=0x7fd6f0153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.087+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f00c1f70 0x7fd6f0153800 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fd6e400e820 tx=0x7fd6e40090f0).stop 2023-07-27T14:29:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.088+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 shutdown_connections 2023-07-27T14:29:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.088+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6d005eef0 0x7fd6d00613b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.088+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f0150320 0x7fd6f00bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.088+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6f00c0e80 0x7fd6f014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.088+0000 7fd6f49ff700 1 --2- 172.21.15.115:0/3705280806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6f00c1f70 0x7fd6f0153800 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.088+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 >> 172.21.15.115:0/3705280806 conn(0x7fd6f0062320 msgr2=0x7fd6f0063df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:00.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.088+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 shutdown_connections 2023-07-27T14:29:00.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.088+0000 7fd6f49ff700 1 -- 172.21.15.115:0/3705280806 wait complete. 2023-07-27T14:29:00.128 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:29:00.129 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:29:00.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.296+0000 7faeae9ff700 1 Processor -- start 2023-07-27T14:29:00.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.296+0000 7faeae9ff700 1 -- start start 2023-07-27T14:29:00.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.297+0000 7faeae9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea8153ec0 0x7faea80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.297+0000 7faeae9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faea80aa050 0x7faea80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.297+0000 7faeae9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faea80aaa40 0x7faea80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.297+0000 7faeae9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea8064ad0 con 0x7faea80aaa40 2023-07-27T14:29:00.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.297+0000 7faeae9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea80aa4d0 con 0x7faea80aa050 2023-07-27T14:29:00.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.297+0000 7faeae9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea80c05c0 con 0x7faea8153ec0 2023-07-27T14:29:00.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faea80aaa40 0x7faea80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faea80aaa40 0x7faea80645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36376/0 (socket says 172.21.15.115:36376) 2023-07-27T14:29:00.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 -- 172.21.15.115:0/2593495245 learned_addr learned my addr 172.21.15.115:0/2593495245 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:00.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faea7fff700 1 --2- 172.21.15.115:0/2593495245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea8153ec0 0x7faea80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faea77fe700 1 --2- 172.21.15.115:0/2593495245 >> v2:172.21.15.159:3300/0 conn(0x7faea80aa050 0x7faea80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 -- 172.21.15.115:0/2593495245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea8153ec0 msgr2=0x7faea80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:00.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 --2- 172.21.15.115:0/2593495245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea8153ec0 0x7faea80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 -- 172.21.15.115:0/2593495245 >> v2:172.21.15.159:3300/0 conn(0x7faea80aa050 msgr2=0x7faea80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 --2- 172.21.15.115:0/2593495245 >> v2:172.21.15.159:3300/0 conn(0x7faea80aa050 0x7faea80640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 -- 172.21.15.115:0/2593495245 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80bfc90 con 0x7faea80aaa40 2023-07-27T14:29:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faea7fff700 1 --2- 172.21.15.115:0/2593495245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea8153ec0 0x7faea80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faea77fe700 1 --2- 172.21.15.115:0/2593495245 >> v2:172.21.15.159:3300/0 conn(0x7faea80aa050 0x7faea80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.298+0000 7faeacf9c700 1 --2- 172.21.15.115:0/2593495245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea80645e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7faea805f080 tx=0x7faea0009840).ready entity=mon.0 client_cookie=d0b60ba67c98f834 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faea6ffd700 1 -- 172.21.15.115:0/2593495245 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea000e070 con 0x7faea80aaa40 2023-07-27T14:29:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faea6ffd700 1 -- 172.21.15.115:0/2593495245 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea000ba50 con 0x7faea80aaa40 2023-07-27T14:29:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faea6ffd700 1 -- 172.21.15.115:0/2593495245 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea000bdd0 con 0x7faea80aaa40 2023-07-27T14:29:00.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 -- 172.21.15.115:0/2593495245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 msgr2=0x7faea80645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 --2- 172.21.15.115:0/2593495245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea80645e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7faea805f080 tx=0x7faea0009840).stop 2023-07-27T14:29:00.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 -- 172.21.15.115:0/2593495245 shutdown_connections 2023-07-27T14:29:00.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 --2- 172.21.15.115:0/2593495245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea80645e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 --2- 172.21.15.115:0/2593495245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea8153ec0 0x7faea80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 --2- 172.21.15.115:0/2593495245 >> v2:172.21.15.159:3300/0 conn(0x7faea80aa050 0x7faea80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 -- 172.21.15.115:0/2593495245 >> 172.21.15.115:0/2593495245 conn(0x7faea80cb610 msgr2=0x7faea80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:00.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 -- 172.21.15.115:0/2593495245 shutdown_connections 2023-07-27T14:29:00.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.299+0000 7faeae9ff700 1 -- 172.21.15.115:0/2593495245 wait complete. 2023-07-27T14:29:00.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.301+0000 7faeae9ff700 1 Processor -- start 2023-07-27T14:29:00.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.301+0000 7faeae9ff700 1 -- start start 2023-07-27T14:29:00.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faeae9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea80aa050 0x7faea8164800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faeae9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea8163480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faeae9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea8153ec0 0x7faea80c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faeae9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8152af0 con 0x7faea80aaa40 2023-07-27T14:29:00.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faeae9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8164cf0 con 0x7faea8153ec0 2023-07-27T14:29:00.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faeae9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea81678e0 con 0x7faea80aa050 2023-07-27T14:29:00.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea8163480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea8163480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36386/0 (socket says 172.21.15.115:36386) 2023-07-27T14:29:00.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea77fe700 1 -- 172.21.15.115:0/4171907196 learned_addr learned my addr 172.21.15.115:0/4171907196 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:00.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faeacf9c700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea8153ec0 0x7faea80c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea7fff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea80aa050 0x7faea8164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea77fe700 1 -- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea80aa050 msgr2=0x7faea8164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea77fe700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea80aa050 0x7faea8164800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea77fe700 1 -- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea8153ec0 msgr2=0x7faea80c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea77fe700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea8153ec0 0x7faea80c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faea77fe700 1 -- 172.21.15.115:0/4171907196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0009ae0 con 0x7faea80aaa40 2023-07-27T14:29:00.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.302+0000 7faeacf9c700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea8153ec0 0x7faea80c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:00.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.303+0000 7faea77fe700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea8163480 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fae9c006fd0 tx=0x7fae9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:00.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.303+0000 7fae8ffff700 1 -- 172.21.15.115:0/4171907196 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0125f0 con 0x7faea80aaa40 2023-07-27T14:29:00.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.303+0000 7fae8ffff700 1 -- 172.21.15.115:0/4171907196 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c012750 con 0x7faea80aaa40 2023-07-27T14:29:00.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.303+0000 7fae8ffff700 1 -- 172.21.15.115:0/4171907196 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c012ad0 con 0x7faea80aaa40 2023-07-27T14:29:00.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.303+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea8167bc0 con 0x7faea80aaa40 2023-07-27T14:29:00.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.303+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea8168180 con 0x7faea80aaa40 2023-07-27T14:29:00.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.304+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea806c470 con 0x7faea80aaa40 2023-07-27T14:29:00.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.305+0000 7fae8ffff700 1 -- 172.21.15.115:0/4171907196 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fae9c013480 con 0x7faea80aaa40 2023-07-27T14:29:00.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.306+0000 7fae8ffff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae9405eef0 0x7fae940613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.306+0000 7fae8ffff700 1 -- 172.21.15.115:0/4171907196 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fae9c07a010 con 0x7faea80aaa40 2023-07-27T14:29:00.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.306+0000 7faea7fff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae9405eef0 0x7fae940613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.306+0000 7faea7fff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae9405eef0 0x7fae940613b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fae98006fd0 tx=0x7fae98008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:00.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.310+0000 7fae8ffff700 1 -- 172.21.15.115:0/4171907196 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae9c04b3d0 con 0x7faea80aaa40 2023-07-27T14:29:00.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.519+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faea80bff70 con 0x7faea80aaa40 2023-07-27T14:29:00.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.520+0000 7fae8ffff700 1 -- 172.21.15.115:0/4171907196 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4498 (secure 0 0 0) 0x7fae9c04e9f0 con 0x7faea80aaa40 2023-07-27T14:29:00.542 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:00.542 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/2250060018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2250060018},{"type":"v1","addr":"172.21.15.159:6833","nonce":2250060018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2756493852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2756493852},{"type":"v1","addr":"172.21.15.159:6835","nonce":2756493852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4777,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1646103579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1646103579},{"type":"v1","addr":"172.21.15.115:6836","nonce":1646103579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:28:05.041620+0000","modified":"2023-07-27T14:28:08.054910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4780":{"gid":4780,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6837/770984486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":770984486},{"type":"v1","addr":"172.21.15.115:6837","nonce":770984486}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-07-27T14:29:00.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae9405eef0 msgr2=0x7fae940613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae9405eef0 0x7fae940613b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fae98006fd0 tx=0x7fae98008040).stop 2023-07-27T14:29:00.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 msgr2=0x7faea8163480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea8163480 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fae9c006fd0 tx=0x7fae9c008040).stop 2023-07-27T14:29:00.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 shutdown_connections 2023-07-27T14:29:00.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae9405eef0 0x7fae940613b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea8153ec0 0x7faea80c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faea80aa050 0x7faea8164800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 --2- 172.21.15.115:0/4171907196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea80aaa40 0x7faea8163480 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 >> 172.21.15.115:0/4171907196 conn(0x7faea80cb610 msgr2=0x7faea80ab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:00.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 shutdown_connections 2023-07-27T14:29:00.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.522+0000 7faeae9ff700 1 -- 172.21.15.115:0/4171907196 wait complete. 2023-07-27T14:29:00.546 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 17 2023-07-27T14:29:00.561 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:29:00.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.730+0000 7f9aaedff700 1 Processor -- start 2023-07-27T14:29:00.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.730+0000 7f9aaedff700 1 -- start start 2023-07-27T14:29:00.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.731+0000 7f9aaedff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa8153ec0 0x7f9aa80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.731+0000 7f9aaedff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9aa80aaa40 0x7f9aa80c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.731+0000 7f9aaedff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa80aa4d0 con 0x7f9aa80aa050 2023-07-27T14:29:00.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.731+0000 7f9aaedff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80c05c0 con 0x7f9aa80aaa40 2023-07-27T14:29:00.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.731+0000 7f9aaedff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80bfc90 con 0x7f9aa8153ec0 2023-07-27T14:29:00.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aad39c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9aa80aaa40 0x7f9aa80c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aa7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9aa80aa050 0x7f9aa80640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53382/0 (socket says 172.21.15.115:53382) 2023-07-27T14:29:00.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aa7fff700 1 -- 172.21.15.115:0/2234199294 learned_addr learned my addr 172.21.15.115:0/2234199294 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:00.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aacb9b700 1 --2- 172.21.15.115:0/2234199294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa8153ec0 0x7f9aa80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aad39c700 1 -- 172.21.15.115:0/2234199294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa8153ec0 msgr2=0x7f9aa80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:00.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aad39c700 1 --2- 172.21.15.115:0/2234199294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa8153ec0 0x7f9aa80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aad39c700 1 -- 172.21.15.115:0/2234199294 >> v1:172.21.15.115:6789/0 conn(0x7f9aa80aa050 legacy=0x7f9aa80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aad39c700 1 -- 172.21.15.115:0/2234199294 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80bff70 con 0x7f9aa80aaa40 2023-07-27T14:29:00.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aa77fe700 1 -- 172.21.15.115:0/2234199294 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8840263 0 0) 0x7f9a94001110 con 0x7f9aa80aa050 2023-07-27T14:29:00.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aad39c700 1 --2- 172.21.15.115:0/2234199294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80aaa40 0x7f9aa80c0a50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f9aa0009e60 tx=0x7f9aa0009780).ready entity=mon.0 client_cookie=423d956d2945430d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:00.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aa77fe700 1 -- 172.21.15.115:0/2234199294 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000e070 con 0x7f9aa80aaa40 2023-07-27T14:29:00.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aa77fe700 1 -- 172.21.15.115:0/2234199294 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa000bb60 con 0x7f9aa80aaa40 2023-07-27T14:29:00.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.732+0000 7f9aa77fe700 1 -- 172.21.15.115:0/2234199294 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0012410 con 0x7f9aa80aaa40 2023-07-27T14:29:00.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.733+0000 7f9aaedff700 1 -- 172.21.15.115:0/2234199294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80aaa40 msgr2=0x7f9aa80c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.733+0000 7f9aaedff700 1 --2- 172.21.15.115:0/2234199294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80aaa40 0x7f9aa80c0a50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f9aa0009e60 tx=0x7f9aa0009780).stop 2023-07-27T14:29:00.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.733+0000 7f9aaedff700 1 -- 172.21.15.115:0/2234199294 shutdown_connections 2023-07-27T14:29:00.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.733+0000 7f9aaedff700 1 --2- 172.21.15.115:0/2234199294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa8153ec0 0x7f9aa80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.733+0000 7f9aaedff700 1 --2- 172.21.15.115:0/2234199294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa80aaa40 0x7f9aa80c0a50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.733+0000 7f9aaedff700 1 -- 172.21.15.115:0/2234199294 >> 172.21.15.115:0/2234199294 conn(0x7f9aa80cb610 msgr2=0x7f9aa80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:00.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.733+0000 7f9aaedff700 1 -- 172.21.15.115:0/2234199294 shutdown_connections 2023-07-27T14:29:00.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.733+0000 7f9aaedff700 1 -- 172.21.15.115:0/2234199294 wait complete. 2023-07-27T14:29:00.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.735+0000 7f9aaedff700 1 Processor -- start 2023-07-27T14:29:00.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.735+0000 7f9aaedff700 1 -- start start 2023-07-27T14:29:00.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aaedff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa80aa050 0x7f9aa8150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aaedff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa80aaa40 0x7f9aa8150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aaedff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa8153ec0 0x7f9aa80aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aaedff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8151ce0 con 0x7f9aa8153ec0 2023-07-27T14:29:00.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aaedff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa81510d0 con 0x7f9aa80aa050 2023-07-27T14:29:00.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aaedff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa81513b0 con 0x7f9aa80aaa40 2023-07-27T14:29:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa8153ec0 0x7f9aa80aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa8153ec0 0x7f9aa80aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36400/0 (socket says 172.21.15.115:36400) 2023-07-27T14:29:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 -- 172.21.15.115:0/121775074 learned_addr learned my addr 172.21.15.115:0/121775074 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:00.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aa7fff700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa80aaa40 0x7f9aa8150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aacb9b700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa80aa050 0x7f9aa8150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 -- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa80aaa40 msgr2=0x7f9aa8150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa80aaa40 0x7f9aa8150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 -- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa80aa050 msgr2=0x7f9aa8150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa80aa050 0x7f9aa8150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 -- 172.21.15.115:0/121775074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0009a20 con 0x7f9aa8153ec0 2023-07-27T14:29:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aa7fff700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa80aaa40 0x7f9aa8150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.736+0000 7f9aad39c700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa8153ec0 0x7f9aa80aeb10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f9aa0009480 tx=0x7f9aa0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.737+0000 7f9aa4ff9700 1 -- 172.21.15.115:0/121775074 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa001c660 con 0x7f9aa8153ec0 2023-07-27T14:29:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.737+0000 7f9aa4ff9700 1 -- 172.21.15.115:0/121775074 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa001c7c0 con 0x7f9aa8153ec0 2023-07-27T14:29:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.737+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa8151690 con 0x7f9aa8153ec0 2023-07-27T14:29:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.737+0000 7f9aa4ff9700 1 -- 172.21.15.115:0/121775074 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa001cb60 con 0x7f9aa8153ec0 2023-07-27T14:29:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.737+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa81530a0 con 0x7f9aa8153ec0 2023-07-27T14:29:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.738+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa806c470 con 0x7f9aa8153ec0 2023-07-27T14:29:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.739+0000 7f9aa4ff9700 1 -- 172.21.15.115:0/121775074 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f9aa001d420 con 0x7f9aa8153ec0 2023-07-27T14:29:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.739+0000 7f9aa4ff9700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a8c05eec0 0x7f9a8c061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.740+0000 7f9aa4ff9700 1 -- 172.21.15.115:0/121775074 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f9aa007c170 con 0x7f9aa8153ec0 2023-07-27T14:29:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.740+0000 7f9aacb9b700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a8c05eec0 0x7f9a8c061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.740+0000 7f9aacb9b700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a8c05eec0 0x7f9a8c061380 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f9a9c009b20 tx=0x7f9a9c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.743+0000 7f9aa4ff9700 1 -- 172.21.15.115:0/121775074 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9aa004d510 con 0x7f9aa8153ec0 2023-07-27T14:29:00.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.954+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9aa8151e20 con 0x7f9aa8153ec0 2023-07-27T14:29:00.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.954+0000 7f9aa4ff9700 1 -- 172.21.15.115:0/121775074 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f9aa0050b30 con 0x7f9aa8153ec0 2023-07-27T14:29:00.976 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/2250060018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2250060018},{"type":"v1","addr":"172.21.15.159:6833","nonce":2250060018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2756493852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2756493852},{"type":"v1","addr":"172.21.15.159:6835","nonce":2756493852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4777,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1646103579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1646103579},{"type":"v1","addr":"172.21.15.115:6836","nonce":1646103579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:28:05.041620+0000","modified":"2023-07-27T14:28:08.054910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4780":{"gid":4780,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.115:6837/770984486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":770984486},{"type":"v1","addr":"172.21.15.115:6837","nonce":770984486}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-07-27T14:29:00.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a8c05eec0 msgr2=0x7f9a8c061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a8c05eec0 0x7f9a8c061380 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f9a9c009b20 tx=0x7f9a9c008040).stop 2023-07-27T14:29:00.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa8153ec0 msgr2=0x7f9aa80aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:00.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa8153ec0 0x7f9aa80aeb10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f9aa0009480 tx=0x7f9aa0009780).stop 2023-07-27T14:29:00.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 shutdown_connections 2023-07-27T14:29:00.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a8c05eec0 0x7f9a8c061380 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa8153ec0 0x7f9aa80aeb10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9aa80aa050 0x7f9aa8150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 --2- 172.21.15.115:0/121775074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9aa80aaa40 0x7f9aa8150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.956+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 >> 172.21.15.115:0/121775074 conn(0x7f9aa80cb610 msgr2=0x7f9aa80640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.957+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 shutdown_connections 2023-07-27T14:29:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:00.957+0000 7f9aaedff700 1 -- 172.21.15.115:0/121775074 wait complete. 2023-07-27T14:29:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 17 2023-07-27T14:29:00.995 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:29:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.166+0000 7fdd06dff700 1 Processor -- start 2023-07-27T14:29:01.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.166+0000 7fdd06dff700 1 -- start start 2023-07-27T14:29:01.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.167+0000 7fdd06dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdd000a4cc0 0x7fdd000bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.167+0000 7fdd06dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000639d0 con 0x7fdd00151bd0 2023-07-27T14:29:01.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.167+0000 7fdd06dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000a5150 con 0x7fdd000a4840 2023-07-27T14:29:01.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.167+0000 7fdd06dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd00137610 con 0x7fdd000a4cc0 2023-07-27T14:29:01.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.167+0000 7fdd04b9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdd00151bd0 0x7fdd00062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53392/0 (socket says 172.21.15.115:53392) 2023-07-27T14:29:01.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.167+0000 7fdd04b9b700 1 -- 172.21.15.115:0/213772058 learned_addr learned my addr 172.21.15.115:0/213772058 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:01.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdd0539c700 1 --2- 172.21.15.115:0/213772058 >> v2:172.21.15.159:3300/0 conn(0x7fdd000a4cc0 0x7fdd000bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706315631 0 0) 0x7fdd000639d0 con 0x7fdd00151bd0 2023-07-27T14:29:01.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf00033f0 con 0x7fdd00151bd0 2023-07-27T14:29:01.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 792842452 0 0) 0x7fdcf00033f0 con 0x7fdd00151bd0 2023-07-27T14:29:01.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 >> v2:172.21.15.159:3300/0 conn(0x7fdd000a4cc0 msgr2=0x7fdd000bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:01.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 --2- 172.21.15.115:0/213772058 >> v2:172.21.15.159:3300/0 conn(0x7fdd000a4cc0 0x7fdd000bc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 >> v1:172.21.15.159:6789/0 conn(0x7fdd000a4840 legacy=0x7fdd000bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00062dc0 con 0x7fdd00151bd0 2023-07-27T14:29:01.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fdcf4001470 con 0x7fdd00151bd0 2023-07-27T14:29:01.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 >> v1:172.21.15.115:6789/0 conn(0x7fdd00151bd0 legacy=0x7fdd00062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdcf00038e0 0x7fdcf0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdcf0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf0005000 0x7fdcf000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf000be80 con 0x7fdcf0004690 2023-07-27T14:29:01.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf000bff0 con 0x7fdcf0005000 2023-07-27T14:29:01.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf000c1b0 con 0x7fdcf00038e0 2023-07-27T14:29:01.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.168+0000 7fdcfffff700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdcf0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdd04b9b700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdcf00038e0 0x7fdcf0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdd0539c700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf0005000 0x7fdcf000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcfffff700 1 -- 172.21.15.115:0/213772058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdcf00038e0 msgr2=0x7fdcf0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:01.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcfffff700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdcf00038e0 0x7fdcf0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcfffff700 1 -- 172.21.15.115:0/213772058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf0005000 msgr2=0x7fdcf000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:01.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcfffff700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf0005000 0x7fdcf000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcfffff700 1 -- 172.21.15.115:0/213772058 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf00033f0 con 0x7fdcf0004690 2023-07-27T14:29:01.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdd0539c700 1 -- 172.21.15.115:0/213772058 reap_dead start 2023-07-27T14:29:01.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcfffff700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdcf0004b10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fdcec001730 tx=0x7fdcec007bb0).ready entity=mon.0 client_cookie=295e10f317ddecf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:01.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec007020 con 0x7fdcf0004690 2023-07-27T14:29:01.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec007180 con 0x7fdcf0004690 2023-07-27T14:29:01.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.169+0000 7fdcff7fe700 1 -- 172.21.15.115:0/213772058 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec007520 con 0x7fdcf0004690 2023-07-27T14:29:01.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.170+0000 7fdd06dff700 1 -- 172.21.15.115:0/213772058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 msgr2=0x7fdcf0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.170+0000 7fdd06dff700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdcf0004b10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fdcec001730 tx=0x7fdcec007bb0).stop 2023-07-27T14:29:01.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.170+0000 7fdd06dff700 1 -- 172.21.15.115:0/213772058 shutdown_connections 2023-07-27T14:29:01.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.170+0000 7fdd06dff700 1 --2- 172.21.15.115:0/213772058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdcf0004b10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.170+0000 7fdd06dff700 1 -- 172.21.15.115:0/213772058 >> 172.21.15.115:0/213772058 conn(0x7fdd00064700 msgr2=0x7fdd00064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:01.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.170+0000 7fdd06dff700 1 -- 172.21.15.115:0/213772058 shutdown_connections 2023-07-27T14:29:01.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.170+0000 7fdd06dff700 1 -- 172.21.15.115:0/213772058 wait complete. 2023-07-27T14:29:01.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.171+0000 7fdd06dff700 1 Processor -- start 2023-07-27T14:29:01.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.171+0000 7fdd06dff700 1 -- start start 2023-07-27T14:29:01.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.172+0000 7fdd06dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdd00135be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.172+0000 7fdd06dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd000bfe90 0x7fdd001391c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.172+0000 7fdd06dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd00069840 0x7fdd00069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.172+0000 7fdd06dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd001360d0 con 0x7fdcf0004690 2023-07-27T14:29:01.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.172+0000 7fdd06dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000bfa00 con 0x7fdd00069840 2023-07-27T14:29:01.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.172+0000 7fdd06dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000beb60 con 0x7fdd000bfe90 2023-07-27T14:29:01.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdd00135be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdd00135be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36406/0 (socket says 172.21.15.115:36406) 2023-07-27T14:29:01.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 -- 172.21.15.115:0/440947360 learned_addr learned my addr 172.21.15.115:0/440947360 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:01.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdcfffff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd000bfe90 0x7fdd001391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd0539c700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd00069840 0x7fdd00069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 -- 172.21.15.115:0/440947360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd000bfe90 msgr2=0x7fdd001391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd000bfe90 0x7fdd001391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 -- 172.21.15.115:0/440947360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd00069840 msgr2=0x7fdd00069cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd00069840 0x7fdd00069cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 -- 172.21.15.115:0/440947360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0006a1b0 con 0x7fdcf0004690 2023-07-27T14:29:01.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd04b9b700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdd00135be0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fdcf4004760 tx=0x7fdcf4001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:01.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdcfcff9700 1 -- 172.21.15.115:0/440947360 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4011590 con 0x7fdcf0004690 2023-07-27T14:29:01.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdcfcff9700 1 -- 172.21.15.115:0/440947360 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40116f0 con 0x7fdcf0004690 2023-07-27T14:29:01.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000bedf0 con 0x7fdcf0004690 2023-07-27T14:29:01.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.173+0000 7fdcfcff9700 1 -- 172.21.15.115:0/440947360 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4011a70 con 0x7fdcf0004690 2023-07-27T14:29:01.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.174+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd000bf3b0 con 0x7fdcf0004690 2023-07-27T14:29:01.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.174+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0006c470 con 0x7fdcf0004690 2023-07-27T14:29:01.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.175+0000 7fdcfcff9700 1 -- 172.21.15.115:0/440947360 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fdcf401b030 con 0x7fdcf0004690 2023-07-27T14:29:01.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.176+0000 7fdcfcff9700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdce405ef20 0x7fdce40613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.176+0000 7fdcfcff9700 1 -- 172.21.15.115:0/440947360 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fdcf40795e0 con 0x7fdcf0004690 2023-07-27T14:29:01.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.176+0000 7fdcfffff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdce405ef20 0x7fdce40613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.177+0000 7fdcfffff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdce405ef20 0x7fdce40613e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fdd000c02d0 tx=0x7fdcec015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:01.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.180+0000 7fdcfcff9700 1 -- 172.21.15.115:0/440947360 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdcf404a940 con 0x7fdcf0004690 2023-07-27T14:29:01.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.348+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd000a9cb0 con 0x7fdcf0004690 2023-07-27T14:29:01.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.349+0000 7fdcfcff9700 1 -- 172.21.15.115:0/440947360 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17142 (secure 0 0 0) 0x7fdd000a9cb0 con 0x7fdcf0004690 2023-07-27T14:29:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:01.371 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":40,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:28:49.583377+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:28:03.303433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-27T14:28:04.025837+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:29:01.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdce405ef20 msgr2=0x7fdce40613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdce405ef20 0x7fdce40613e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fdd000c02d0 tx=0x7fdcec015000).stop 2023-07-27T14:29:01.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 msgr2=0x7fdd00135be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdd00135be0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fdcf4004760 tx=0x7fdcf4001e50).stop 2023-07-27T14:29:01.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 shutdown_connections 2023-07-27T14:29:01.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdce405ef20 0x7fdce40613e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd00069840 0x7fdd00069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcf0004690 0x7fdd00135be0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 --2- 172.21.15.115:0/440947360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd000bfe90 0x7fdd001391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 >> 172.21.15.115:0/440947360 conn(0x7fdd00064700 msgr2=0x7fdd000c16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:01.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 shutdown_connections 2023-07-27T14:29:01.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.351+0000 7fdd06dff700 1 -- 172.21.15.115:0/440947360 wait complete. 2023-07-27T14:29:01.391 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:29:01.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.558+0000 7f944d5ff700 1 Processor -- start 2023-07-27T14:29:01.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.558+0000 7f944d5ff700 1 -- start start 2023-07-27T14:29:01.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.559+0000 7f944d5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f94481542a0 0x7f944815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.559+0000 7f944d5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480aa4d0 con 0x7f94480aaa40 2023-07-27T14:29:01.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.559+0000 7f944d5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480c05c0 con 0x7f9448153ec0 2023-07-27T14:29:01.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.559+0000 7f944d5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94480c1a60 con 0x7f94481542a0 2023-07-27T14:29:01.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f94467fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f94480aaa40 0x7f94480640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53394/0 (socket says 172.21.15.115:53394) 2023-07-27T14:29:01.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f94467fc700 1 -- 172.21.15.115:0/2166554635 learned_addr learned my addr 172.21.15.115:0/2166554635 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:01.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f94477fe700 1 --2- 172.21.15.115:0/2166554635 >> v2:172.21.15.159:3300/0 conn(0x7f94481542a0 0x7f944815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056887582 0 0) 0x7f943c001110 con 0x7f94480aaa40 2023-07-27T14:29:01.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94300033f0 con 0x7f94480aaa40 2023-07-27T14:29:01.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2095395485 0 0) 0x7f94300033f0 con 0x7f94480aaa40 2023-07-27T14:29:01.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 >> v2:172.21.15.159:3300/0 conn(0x7f94481542a0 msgr2=0x7f944815efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:01.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f9445ffb700 1 --2- 172.21.15.115:0/2166554635 >> v2:172.21.15.159:3300/0 conn(0x7f94481542a0 0x7f944815efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 >> v1:172.21.15.159:6789/0 conn(0x7f9448153ec0 legacy=0x7f94480a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480aa270 con 0x7f94480aaa40 2023-07-27T14:29:01.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.560+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f943c001600 con 0x7f94480aaa40 2023-07-27T14:29:01.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 >> v1:172.21.15.115:6789/0 conn(0x7f94480aaa40 legacy=0x7f94480640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f9445ffb700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94300038e0 0x7f9430003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f9445ffb700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430004690 0x7f9430004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f9445ffb700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9430005000 0x7f943000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480c1a60 con 0x7f9430005000 2023-07-27T14:29:01.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943000bf60 con 0x7f94300038e0 2023-07-27T14:29:01.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943000c0f0 con 0x7f9430004690 2023-07-27T14:29:01.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f94477fe700 1 --2- 172.21.15.115:0/2166554635 >> v2:172.21.15.159:3300/0 conn(0x7f94481542a0 0x7f944815efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:01.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f94467fc700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430004690 0x7f9430004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f94477fe700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9430005000 0x7f943000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f9446ffd700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94300038e0 0x7f9430003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f94477fe700 1 -- 172.21.15.115:0/2166554635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430004690 msgr2=0x7f9430004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:01.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f94477fe700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430004690 0x7f9430004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f94477fe700 1 -- 172.21.15.115:0/2166554635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94300038e0 msgr2=0x7f9430003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:01.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f94477fe700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94300038e0 0x7f9430003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.561+0000 7f94477fe700 1 -- 172.21.15.115:0/2166554635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94300033f0 con 0x7f9430005000 2023-07-27T14:29:01.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.562+0000 7f94477fe700 1 -- 172.21.15.115:0/2166554635 reap_dead start 2023-07-27T14:29:01.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.562+0000 7f94477fe700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9430005000 0x7f943000b8e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f9448064d00 tx=0x7f944000b040).ready entity=mon.0 client_cookie=1b58cd2258a4512d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:01.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440009c50 con 0x7f9430005000 2023-07-27T14:29:01.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944000f040 con 0x7f9430005000 2023-07-27T14:29:01.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f9445ffb700 1 -- 172.21.15.115:0/2166554635 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000ee90 con 0x7f9430005000 2023-07-27T14:29:01.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f944d5ff700 1 -- 172.21.15.115:0/2166554635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9430005000 msgr2=0x7f943000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f944d5ff700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9430005000 0x7f943000b8e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f9448064d00 tx=0x7f944000b040).stop 2023-07-27T14:29:01.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f944d5ff700 1 -- 172.21.15.115:0/2166554635 shutdown_connections 2023-07-27T14:29:01.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f944d5ff700 1 --2- 172.21.15.115:0/2166554635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9430005000 0x7f943000b8e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f944d5ff700 1 -- 172.21.15.115:0/2166554635 >> 172.21.15.115:0/2166554635 conn(0x7f94480cb610 msgr2=0x7f94480c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:01.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f944d5ff700 1 -- 172.21.15.115:0/2166554635 shutdown_connections 2023-07-27T14:29:01.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.563+0000 7f944d5ff700 1 -- 172.21.15.115:0/2166554635 wait complete. 2023-07-27T14:29:01.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.565+0000 7f944d5ff700 1 Processor -- start 2023-07-27T14:29:01.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.565+0000 7f944d5ff700 1 -- start start 2023-07-27T14:29:01.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f944d5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430005000 0x7f944814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f944d5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94480afcb0 0x7f94480c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f944d5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94481503a0 0x7f94480c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f944d5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480c3830 con 0x7f94480afcb0 2023-07-27T14:29:01.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f944d5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480aee90 con 0x7f94481503a0 2023-07-27T14:29:01.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f944d5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94480ae5f0 con 0x7f9430005000 2023-07-27T14:29:01.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f94467fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94480afcb0 0x7f94480c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f94467fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94480afcb0 0x7f94480c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36420/0 (socket says 172.21.15.115:36420) 2023-07-27T14:29:01.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f94467fc700 1 -- 172.21.15.115:0/1547603571 learned_addr learned my addr 172.21.15.115:0/1547603571 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:01.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f9446ffd700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430005000 0x7f944814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.566+0000 7f94477fe700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94481503a0 0x7f94480c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f94467fc700 1 -- 172.21.15.115:0/1547603571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430005000 msgr2=0x7f944814fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f94467fc700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430005000 0x7f944814fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f94467fc700 1 -- 172.21.15.115:0/1547603571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94481503a0 msgr2=0x7f94480c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:01.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f94467fc700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94481503a0 0x7f94480c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:01.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f94467fc700 1 -- 172.21.15.115:0/1547603571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480ae8d0 con 0x7f94480afcb0 2023-07-27T14:29:01.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f94467fc700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94480afcb0 0x7f94480c1c30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f943c004790 tx=0x7f94480c1ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:01.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f942effd700 1 -- 172.21.15.115:0/1547603571 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c011590 con 0x7f94480afcb0 2023-07-27T14:29:01.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f942effd700 1 -- 172.21.15.115:0/1547603571 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c0116f0 con 0x7f94480afcb0 2023-07-27T14:29:01.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94480aebb0 con 0x7f94480afcb0 2023-07-27T14:29:01.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f942effd700 1 -- 172.21.15.115:0/1547603571 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c011a70 con 0x7f94480afcb0 2023-07-27T14:29:01.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.567+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94480c2120 con 0x7f94480afcb0 2023-07-27T14:29:01.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.568+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944806c470 con 0x7f94480afcb0 2023-07-27T14:29:01.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.569+0000 7f942effd700 1 -- 172.21.15.115:0/1547603571 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f943c01c360 con 0x7f94480afcb0 2023-07-27T14:29:01.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.570+0000 7f942effd700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405eef0 0x7f94340613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:01.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.570+0000 7f942effd700 1 -- 172.21.15.115:0/1547603571 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f943c0792f0 con 0x7f94480afcb0 2023-07-27T14:29:01.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.570+0000 7f9446ffd700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405eef0 0x7f94340613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:01.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.571+0000 7f9446ffd700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405eef0 0x7f94340613b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9438007fd0 tx=0x7f9438007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:01.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.574+0000 7f942effd700 1 -- 172.21.15.115:0/1547603571 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f943c0498f0 con 0x7f94480afcb0 2023-07-27T14:29:01.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:01.787+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f94480aa4d0 con 0x7f94480afcb0 2023-07-27T14:29:02.651 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:29:02.630+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:29:02.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.638+0000 7f942effd700 1 -- 172.21.15.115:0/1547603571 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f94480aa4d0 con 0x7f94480afcb0 2023-07-27T14:29:02.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.640+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405eef0 msgr2=0x7f94340613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:02.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.640+0000 7f944d5ff700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405eef0 0x7f94340613b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9438007fd0 tx=0x7f9438007bb0).stop 2023-07-27T14:29:02.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.640+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94480afcb0 msgr2=0x7f94480c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:02.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.640+0000 7f944d5ff700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94480afcb0 0x7f94480c1c30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f943c004790 tx=0x7f94480c1ba0).stop 2023-07-27T14:29:02.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.641+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 shutdown_connections 2023-07-27T14:29:02.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.641+0000 7f944d5ff700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f943405eef0 0x7f94340613b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.641+0000 7f944d5ff700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94481503a0 0x7f94480c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.641+0000 7f944d5ff700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9430005000 0x7f944814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.641+0000 7f944d5ff700 1 --2- 172.21.15.115:0/1547603571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94480afcb0 0x7f94480c1c30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.641+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 >> 172.21.15.115:0/1547603571 conn(0x7f94480cb610 msgr2=0x7f94480ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:02.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.641+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 shutdown_connections 2023-07-27T14:29:02.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.641+0000 7f944d5ff700 1 -- 172.21.15.115:0/1547603571 wait complete. 2023-07-27T14:29:02.664 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:29:02.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:29:02.730 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:29:02.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.857+0000 7f75271ff700 1 Processor -- start 2023-07-27T14:29:02.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.857+0000 7f75271ff700 1 -- start start 2023-07-27T14:29:02.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.858+0000 7f75271ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f75200c0ea0 0x7f7520150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:02.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.858+0000 7f75271ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520065220 0x7f75200c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:02.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.858+0000 7f75271ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7520068bb0 con 0x7f7520150220 2023-07-27T14:29:02.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.858+0000 7f75271ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75200656b0 con 0x7f75200c0ea0 2023-07-27T14:29:02.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.858+0000 7f75271ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752006a250 con 0x7f7520065220 2023-07-27T14:29:02.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f7524f9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7520150220 0x7f7520069040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53408/0 (socket says 172.21.15.115:53408) 2023-07-27T14:29:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f7524f9b700 1 -- 172.21.15.115:0/3924387940 learned_addr learned my addr 172.21.15.115:0/3924387940 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f751ffff700 1 --2- 172.21.15.115:0/3924387940 >> v2:172.21.15.159:3300/0 conn(0x7f75200c0ea0 0x7f7520150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f752579c700 1 --2- 172.21.15.115:0/3924387940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520065220 0x7f75200c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f751f7fe700 1 -- 172.21.15.115:0/3924387940 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050162665 0 0) 0x7f7520068bb0 con 0x7f7520150220 2023-07-27T14:29:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f751f7fe700 1 -- 172.21.15.115:0/3924387940 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75100033f0 con 0x7f7520150220 2023-07-27T14:29:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f751ffff700 1 -- 172.21.15.115:0/3924387940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520065220 msgr2=0x7f75200c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f751ffff700 1 --2- 172.21.15.115:0/3924387940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520065220 0x7f75200c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f751ffff700 1 -- 172.21.15.115:0/3924387940 >> v1:172.21.15.115:6789/0 conn(0x7f7520150220 legacy=0x7f7520069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.859+0000 7f751ffff700 1 -- 172.21.15.115:0/3924387940 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75200c1380 con 0x7f75200c0ea0 2023-07-27T14:29:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f751ffff700 1 --2- 172.21.15.115:0/3924387940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75200c0ea0 0x7f7520150600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f750c009760 tx=0x7f750c009060).ready entity=mon.1 client_cookie=15236f4f3e3432e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f751f7fe700 1 -- 172.21.15.115:0/3924387940 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00f6b0 con 0x7f75200c0ea0 2023-07-27T14:29:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f751f7fe700 1 -- 172.21.15.115:0/3924387940 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00f810 con 0x7f75200c0ea0 2023-07-27T14:29:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f751f7fe700 1 -- 172.21.15.115:0/3924387940 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00fb90 con 0x7f75200c0ea0 2023-07-27T14:29:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f75271ff700 1 -- 172.21.15.115:0/3924387940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75200c0ea0 msgr2=0x7f7520150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f75271ff700 1 --2- 172.21.15.115:0/3924387940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75200c0ea0 0x7f7520150600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f750c009760 tx=0x7f750c009060).stop 2023-07-27T14:29:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f75271ff700 1 -- 172.21.15.115:0/3924387940 shutdown_connections 2023-07-27T14:29:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f75271ff700 1 --2- 172.21.15.115:0/3924387940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520065220 0x7f75200c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f75271ff700 1 --2- 172.21.15.115:0/3924387940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75200c0ea0 0x7f7520150600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.860+0000 7f75271ff700 1 -- 172.21.15.115:0/3924387940 >> 172.21.15.115:0/3924387940 conn(0x7f7520062320 msgr2=0x7f7520062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:02.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.861+0000 7f75271ff700 1 -- 172.21.15.115:0/3924387940 shutdown_connections 2023-07-27T14:29:02.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.861+0000 7f75271ff700 1 -- 172.21.15.115:0/3924387940 wait complete. 2023-07-27T14:29:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.862+0000 7f75271ff700 1 Processor -- start 2023-07-27T14:29:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.862+0000 7f75271ff700 1 -- start start 2023-07-27T14:29:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f75271ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7520065220 0x7f75200a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f75271ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75200c0ea0 0x7f75201393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f75271ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520150220 0x7f75200aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f75271ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75200a7b30 con 0x7f75200c0ea0 2023-07-27T14:29:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f75271ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75200aa580 con 0x7f7520065220 2023-07-27T14:29:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f75271ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75200a8930 con 0x7f7520150220 2023-07-27T14:29:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f751ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75200c0ea0 0x7f75201393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f751ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75200c0ea0 0x7f75201393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36440/0 (socket says 172.21.15.115:36440) 2023-07-27T14:29:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.863+0000 7f751ffff700 1 -- 172.21.15.115:0/3195290089 learned_addr learned my addr 172.21.15.115:0/3195290089 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f7524f9b700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7520065220 0x7f75200a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f752579c700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520150220 0x7f75200aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751ffff700 1 -- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520150220 msgr2=0x7f75200aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751ffff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520150220 0x7f75200aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751ffff700 1 -- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7520065220 msgr2=0x7f75200a7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751ffff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7520065220 0x7f75200a7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751ffff700 1 -- 172.21.15.115:0/3195290089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0092a0 con 0x7f75200c0ea0 2023-07-27T14:29:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f752579c700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520150220 0x7f75200aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f7524f9b700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7520065220 0x7f75200a7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751ffff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75200c0ea0 0x7f75201393e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f75200bd810 tx=0x7f750c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751cff9700 1 -- 172.21.15.115:0/3195290089 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00f980 con 0x7f75200c0ea0 2023-07-27T14:29:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751cff9700 1 -- 172.21.15.115:0/3195290089 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00fae0 con 0x7f75200c0ea0 2023-07-27T14:29:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f751cff9700 1 -- 172.21.15.115:0/3195290089 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c019680 con 0x7f75200c0ea0 2023-07-27T14:29:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75200a7d20 con 0x7f75200c0ea0 2023-07-27T14:29:02.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.864+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75200a82e0 con 0x7f75200c0ea0 2023-07-27T14:29:02.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.865+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752006c470 con 0x7f75200c0ea0 2023-07-27T14:29:02.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.866+0000 7f751cff9700 1 -- 172.21.15.115:0/3195290089 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f750c019a70 con 0x7f75200c0ea0 2023-07-27T14:29:02.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.867+0000 7f751cff9700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f750405eef0 0x7f75040613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:02.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.867+0000 7f751cff9700 1 -- 172.21.15.115:0/3195290089 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6236+0+0 (secure 0 0 0) 0x7f750c07b900 con 0x7f75200c0ea0 2023-07-27T14:29:02.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.867+0000 7f7524f9b700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f750405eef0 0x7f75040613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:02.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.868+0000 7f7524f9b700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f750405eef0 0x7f75040613b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7514005750 tx=0x7f7514009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:02.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:02.871+0000 7f751cff9700 1 -- 172.21.15.115:0/3195290089 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f750c04cc40 con 0x7f75200c0ea0 2023-07-27T14:29:03.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.083+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7520064d50 con 0x7f75200c0ea0 2023-07-27T14:29:03.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.645+0000 7f751cff9700 1 -- 172.21.15.115:0/3195290089 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f750c0140a0 con 0x7f75200c0ea0 2023-07-27T14:29:03.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f750405eef0 msgr2=0x7f75040613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:03.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f750405eef0 0x7f75040613b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7514005750 tx=0x7f7514009040).stop 2023-07-27T14:29:03.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75200c0ea0 msgr2=0x7f75201393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:03.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75200c0ea0 0x7f75201393e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f75200bd810 tx=0x7f750c018000).stop 2023-07-27T14:29:03.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 shutdown_connections 2023-07-27T14:29:03.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f750405eef0 0x7f75040613b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:03.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7520150220 0x7f75200aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:03.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7520065220 0x7f75200a7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:03.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 --2- 172.21.15.115:0/3195290089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75200c0ea0 0x7f75201393e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:03.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 >> 172.21.15.115:0/3195290089 conn(0x7f7520062320 msgr2=0x7f7520069350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:03.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 shutdown_connections 2023-07-27T14:29:03.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.648+0000 7f75271ff700 1 -- 172.21.15.115:0/3195290089 wait complete. 2023-07-27T14:29:03.688 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:29:03.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.859+0000 7f42371ff700 1 Processor -- start 2023-07-27T14:29:03.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.859+0000 7f42371ff700 1 -- start start 2023-07-27T14:29:03.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.860+0000 7f42371ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4230063260 0x7f4230154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:03.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.860+0000 7f42371ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42301553f0 con 0x7f423014ae00 2023-07-27T14:29:03.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.860+0000 7f42371ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4230157a50 con 0x7f423014b1e0 2023-07-27T14:29:03.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.860+0000 7f42371ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4230157d10 con 0x7f4230063260 2023-07-27T14:29:03.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.860+0000 7f422ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4230063260 0x7f4230154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:03.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.860+0000 7f422ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4230063260 0x7f4230154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47862/0 (socket says 172.21.15.115:47862) 2023-07-27T14:29:03.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.860+0000 7f422ffff700 1 -- 172.21.15.115:0/3779089510 learned_addr learned my addr 172.21.15.115:0/3779089510 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:03.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.860+0000 7f4234f9b700 1 --1- 172.21.15.115:0/3779089510 >> v1:172.21.15.115:6789/0 conn(0x7f423014ae00 0x7f4230062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56182/0 (socket says 172.21.15.115:56182) 2023-07-27T14:29:03.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.861+0000 7f422ffff700 1 -- 172.21.15.115:0/3779089510 >> v1:172.21.15.159:6789/0 conn(0x7f423014b1e0 legacy=0x7f42300a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:03.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.861+0000 7f422ffff700 1 -- 172.21.15.115:0/3779089510 >> v1:172.21.15.115:6789/0 conn(0x7f423014ae00 legacy=0x7f4230062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:03.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.861+0000 7f422f7fe700 1 -- 172.21.15.115:0/3779089510 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953834111 0 0) 0x7f42301553f0 con 0x7f423014ae00 2023-07-27T14:29:03.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.861+0000 7f422ffff700 1 -- 172.21.15.115:0/3779089510 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230157ff0 con 0x7f4230063260 2023-07-27T14:29:03.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.861+0000 7f422ffff700 1 --2- 172.21.15.115:0/3779089510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230063260 0x7f4230154f00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f421c006fd0 tx=0x7f421c0090f0).ready entity=mon.0 client_cookie=98ff5055dfeba357 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:03.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.861+0000 7f422f7fe700 1 -- 172.21.15.115:0/3779089510 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00b600 con 0x7f4230063260 2023-07-27T14:29:03.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.861+0000 7f422f7fe700 1 -- 172.21.15.115:0/3779089510 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c00b760 con 0x7f4230063260 2023-07-27T14:29:03.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.861+0000 7f422f7fe700 1 -- 172.21.15.115:0/3779089510 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00bae0 con 0x7f4230063260 2023-07-27T14:29:03.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.862+0000 7f42371ff700 1 -- 172.21.15.115:0/3779089510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230063260 msgr2=0x7f4230154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:03.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.862+0000 7f42371ff700 1 --2- 172.21.15.115:0/3779089510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230063260 0x7f4230154f00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f421c006fd0 tx=0x7f421c0090f0).stop 2023-07-27T14:29:03.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.862+0000 7f42371ff700 1 -- 172.21.15.115:0/3779089510 shutdown_connections 2023-07-27T14:29:03.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.862+0000 7f42371ff700 1 --2- 172.21.15.115:0/3779089510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230063260 0x7f4230154f00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:03.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.862+0000 7f42371ff700 1 -- 172.21.15.115:0/3779089510 >> 172.21.15.115:0/3779089510 conn(0x7f423005e940 msgr2=0x7f42300cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:03.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.862+0000 7f42371ff700 1 -- 172.21.15.115:0/3779089510 shutdown_connections 2023-07-27T14:29:03.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.862+0000 7f42371ff700 1 -- 172.21.15.115:0/3779089510 wait complete. 2023-07-27T14:29:03.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.863+0000 7f42371ff700 1 Processor -- start 2023-07-27T14:29:03.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.863+0000 7f42371ff700 1 -- start start 2023-07-27T14:29:03.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.864+0000 7f42371ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4230063260 0x7f4230149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:03.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.864+0000 7f42371ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f423014ae00 0x7f42300c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:03.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.864+0000 7f42371ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f423014b1e0 0x7f42300c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:03.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.864+0000 7f42371ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300c1950 con 0x7f423014ae00 2023-07-27T14:29:03.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.864+0000 7f42371ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42301680d0 con 0x7f4230063260 2023-07-27T14:29:03.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.864+0000 7f42371ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42301674c0 con 0x7f423014b1e0 2023-07-27T14:29:03.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f423014ae00 0x7f42300c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:03.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f423014ae00 0x7f42300c0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47872/0 (socket says 172.21.15.115:47872) 2023-07-27T14:29:03.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 -- 172.21.15.115:0/2825162136 learned_addr learned my addr 172.21.15.115:0/2825162136 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:03.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f4234f9b700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4230063260 0x7f4230149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:03.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 -- 172.21.15.115:0/2825162136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f423014b1e0 msgr2=0x7f42300c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:03.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f423014b1e0 0x7f42300c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:03.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 -- 172.21.15.115:0/2825162136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4230063260 msgr2=0x7f4230149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:03.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4230063260 0x7f4230149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:03.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 -- 172.21.15.115:0/2825162136 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c009370 con 0x7f423014ae00 2023-07-27T14:29:03.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f4234f9b700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4230063260 0x7f4230149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:03.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422ffff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f423014ae00 0x7f42300c0f70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f421c011000 tx=0x7f421c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:03.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422cff9700 1 -- 172.21.15.115:0/2825162136 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00bae0 con 0x7f423014ae00 2023-07-27T14:29:03.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.865+0000 7f422cff9700 1 -- 172.21.15.115:0/2825162136 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c000c90 con 0x7f423014ae00 2023-07-27T14:29:03.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.866+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42301677a0 con 0x7f423014ae00 2023-07-27T14:29:03.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.866+0000 7f422cff9700 1 -- 172.21.15.115:0/2825162136 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c0246a0 con 0x7f423014ae00 2023-07-27T14:29:03.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.866+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4230167d60 con 0x7f423014ae00 2023-07-27T14:29:03.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.867+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4230168260 con 0x7f423014ae00 2023-07-27T14:29:03.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.867+0000 7f422cff9700 1 -- 172.21.15.115:0/2825162136 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f421c00f070 con 0x7f423014ae00 2023-07-27T14:29:03.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.868+0000 7f422cff9700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421405eef0 0x7f42140613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:03.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.869+0000 7f422cff9700 1 -- 172.21.15.115:0/2825162136 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6236+0+0 (secure 0 0 0) 0x7f421c07bc00 con 0x7f423014ae00 2023-07-27T14:29:03.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.869+0000 7f4234f9b700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421405eef0 0x7f42140613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:03.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.869+0000 7f4234f9b700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421405eef0 0x7f42140613b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f4224001750 tx=0x7f4224009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:03.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:03.872+0000 7f422cff9700 1 -- 172.21.15.115:0/2825162136 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f421c081020 con 0x7f423014ae00 2023-07-27T14:29:04.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.043+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f423006c470 con 0x7f423014ae00 2023-07-27T14:29:04.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.653+0000 7f422cff9700 1 -- 172.21.15.115:0/2825162136 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7f421c04d080 con 0x7f423014ae00 2023-07-27T14:29:04.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421405eef0 msgr2=0x7f42140613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:04.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421405eef0 0x7f42140613b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f4224001750 tx=0x7f4224009040).stop 2023-07-27T14:29:04.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f423014ae00 msgr2=0x7f42300c0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f423014ae00 0x7f42300c0f70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f421c011000 tx=0x7f421c017000).stop 2023-07-27T14:29:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 shutdown_connections 2023-07-27T14:29:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421405eef0 0x7f42140613b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f423014b1e0 0x7f42300c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4230063260 0x7f4230149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 --2- 172.21.15.115:0/2825162136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f423014ae00 0x7f42300c0f70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 >> 172.21.15.115:0/2825162136 conn(0x7f423005e940 msgr2=0x7f423014a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:04.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 shutdown_connections 2023-07-27T14:29:04.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.656+0000 7f42371ff700 1 -- 172.21.15.115:0/2825162136 wait complete. 2023-07-27T14:29:04.680 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:29:04.697 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:29:04.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.867+0000 7f1949bff700 1 Processor -- start 2023-07-27T14:29:04.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.867+0000 7f1949bff700 1 -- start start 2023-07-27T14:29:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.868+0000 7f1949bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f19440bc350 0x7f19440657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.868+0000 7f1949bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1944065360 con 0x7f1944153ed0 2023-07-27T14:29:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.868+0000 7f1949bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19440bcbd0 con 0x7f19441542b0 2023-07-27T14:29:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.868+0000 7f1949bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19441546d0 con 0x7f19440bc350 2023-07-27T14:29:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19437fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1944153ed0 0x7f19440c2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56192/0 (socket says 172.21.15.115:56192) 2023-07-27T14:29:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19437fe700 1 -- 172.21.15.115:0/639769541 learned_addr learned my addr 172.21.15.115:0/639769541 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f1942ffd700 1 --2- 172.21.15.115:0/639769541 >> v2:172.21.15.159:3300/0 conn(0x7f19440bc350 0x7f19440657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198467107 0 0) 0x7f1944065360 con 0x7f1944153ed0 2023-07-27T14:29:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f192c0033f0 con 0x7f1944153ed0 2023-07-27T14:29:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2467384508 0 0) 0x7f192c0033f0 con 0x7f1944153ed0 2023-07-27T14:29:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 >> v2:172.21.15.159:3300/0 conn(0x7f19440bc350 msgr2=0x7f19440657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 --2- 172.21.15.115:0/639769541 >> v2:172.21.15.159:3300/0 conn(0x7f19440bc350 0x7f19440657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 >> v1:172.21.15.159:6789/0 conn(0x7f19441542b0 legacy=0x7f1944157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1944064d30 con 0x7f1944153ed0 2023-07-27T14:29:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1934001470 con 0x7f1944153ed0 2023-07-27T14:29:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 >> v1:172.21.15.115:6789/0 conn(0x7f1944153ed0 legacy=0x7f19440c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.869+0000 7f19427fc700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f192c0038e0 0x7f192c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f19427fc700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f192c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f19427fc700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f192c005000 0x7f192c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19441546d0 con 0x7f192c004690 2023-07-27T14:29:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c00beb0 con 0x7f192c005000 2023-07-27T14:29:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c00c070 con 0x7f192c0038e0 2023-07-27T14:29:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1942ffd700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f192c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f19437fe700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f192c0038e0 0x7f192c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1943fff700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f192c005000 0x7f192c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1942ffd700 1 -- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f192c0038e0 msgr2=0x7f192c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1942ffd700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f192c0038e0 0x7f192c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1942ffd700 1 -- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f192c005000 msgr2=0x7f192c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1942ffd700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f192c005000 0x7f192c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1942ffd700 1 -- 172.21.15.115:0/639769541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0033f0 con 0x7f192c004690 2023-07-27T14:29:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1943fff700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f192c005000 0x7f192c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1943fff700 1 -- 172.21.15.115:0/639769541 reap_dead start 2023-07-27T14:29:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.870+0000 7f1942ffd700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f192c004b10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f1938009a80 tx=0x7f1938009060).ready entity=mon.0 client_cookie=4081759ae49b56ec server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:04.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938009430 con 0x7f192c004690 2023-07-27T14:29:04.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193800e640 con 0x7f192c004690 2023-07-27T14:29:04.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f19427fc700 1 -- 172.21.15.115:0/639769541 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800e9c0 con 0x7f192c004690 2023-07-27T14:29:04.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f1949bff700 1 -- 172.21.15.115:0/639769541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 msgr2=0x7f192c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:04.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f1949bff700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f192c004b10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f1938009a80 tx=0x7f1938009060).stop 2023-07-27T14:29:04.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f1949bff700 1 -- 172.21.15.115:0/639769541 shutdown_connections 2023-07-27T14:29:04.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f1949bff700 1 --2- 172.21.15.115:0/639769541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f192c004b10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:04.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f1949bff700 1 -- 172.21.15.115:0/639769541 >> 172.21.15.115:0/639769541 conn(0x7f1944062df0 msgr2=0x7f19440c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:04.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f1949bff700 1 -- 172.21.15.115:0/639769541 shutdown_connections 2023-07-27T14:29:04.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.871+0000 7f1949bff700 1 -- 172.21.15.115:0/639769541 wait complete. 2023-07-27T14:29:04.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.873+0000 7f1949bff700 1 Processor -- start 2023-07-27T14:29:04.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.874+0000 7f1949bff700 1 -- start start 2023-07-27T14:29:04.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f1949bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f1944143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:04.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f1949bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19440a8ea0 0x7f19440c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:04.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f1949bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19440a6670 0x7f19440a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:04.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f1949bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19440a6fe0 con 0x7f192c004690 2023-07-27T14:29:04.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f1949bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19440c2a50 con 0x7f19440a8ea0 2023-07-27T14:29:04.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f1949bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19440c2d30 con 0x7f19440a6670 2023-07-27T14:29:04.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f19437fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f1944143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:04.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f19437fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f1944143880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47890/0 (socket says 172.21.15.115:47890) 2023-07-27T14:29:04.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f19437fe700 1 -- 172.21.15.115:0/3488032254 learned_addr learned my addr 172.21.15.115:0/3488032254 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:04.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f19437fe700 1 -- 172.21.15.115:0/3488032254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19440a6670 msgr2=0x7f19440a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:04.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f19437fe700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19440a6670 0x7f19440a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:04.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f1942ffd700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19440a8ea0 0x7f19440c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:04.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f19437fe700 1 -- 172.21.15.115:0/3488032254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19440a8ea0 msgr2=0x7f19440c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:04.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f19437fe700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19440a8ea0 0x7f19440c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:04.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.875+0000 7f19437fe700 1 -- 172.21.15.115:0/3488032254 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440c3010 con 0x7f192c004690 2023-07-27T14:29:04.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.876+0000 7f19437fe700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f1944143880 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f193400e840 tx=0x7f1934000d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:04.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.876+0000 7f192b7fe700 1 -- 172.21.15.115:0/3488032254 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400c600 con 0x7f192c004690 2023-07-27T14:29:04.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.876+0000 7f192b7fe700 1 -- 172.21.15.115:0/3488032254 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400c760 con 0x7f192c004690 2023-07-27T14:29:04.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.876+0000 7f192b7fe700 1 -- 172.21.15.115:0/3488032254 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400cb00 con 0x7f192c004690 2023-07-27T14:29:04.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.876+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19440c32f0 con 0x7f192c004690 2023-07-27T14:29:04.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.876+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1944143d70 con 0x7f192c004690 2023-07-27T14:29:04.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.877+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19440c3790 con 0x7f192c004690 2023-07-27T14:29:04.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.878+0000 7f192b7fe700 1 -- 172.21.15.115:0/3488032254 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f1934014430 con 0x7f192c004690 2023-07-27T14:29:04.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.879+0000 7f192b7fe700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f193005eef0 0x7f19300613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:04.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.879+0000 7f192b7fe700 1 -- 172.21.15.115:0/3488032254 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5798+0+0 (secure 0 0 0) 0x7f1934079a70 con 0x7f192c004690 2023-07-27T14:29:04.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.879+0000 7f1942ffd700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f193005eef0 0x7f19300613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:04.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.879+0000 7f1942ffd700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f193005eef0 0x7f19300613b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f19440a9710 tx=0x7f193801a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:04.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:04.882+0000 7f192b7fe700 1 -- 172.21.15.115:0/3488032254 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19340498f0 con 0x7f192c004690 2023-07-27T14:29:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.052+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f19440c3940 con 0x7f192c004690 2023-07-27T14:29:05.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.654+0000 7f192b7fe700 1 -- 172.21.15.115:0/3488032254 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f193404ae80 con 0x7f192c004690 2023-07-27T14:29:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.658+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f193005eef0 msgr2=0x7f19300613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.658+0000 7f1949bff700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f193005eef0 0x7f19300613b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f19440a9710 tx=0x7f193801a000).stop 2023-07-27T14:29:05.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.658+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 msgr2=0x7f1944143880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:05.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.658+0000 7f1949bff700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f1944143880 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f193400e840 tx=0x7f1934000d90).stop 2023-07-27T14:29:05.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.659+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 shutdown_connections 2023-07-27T14:29:05.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.659+0000 7f1949bff700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f193005eef0 0x7f19300613b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:05.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.659+0000 7f1949bff700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19440a6670 0x7f19440a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:05.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.659+0000 7f1949bff700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f192c004690 0x7f1944143880 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:05.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.659+0000 7f1949bff700 1 --2- 172.21.15.115:0/3488032254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19440a8ea0 0x7f19440c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:05.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.659+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 >> 172.21.15.115:0/3488032254 conn(0x7f1944062df0 msgr2=0x7f19440a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:05.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.661+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 shutdown_connections 2023-07-27T14:29:05.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.661+0000 7f1949bff700 1 -- 172.21.15.115:0/3488032254 wait complete. 2023-07-27T14:29:05.687 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:29:05.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-07-27T14:29:05.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.876+0000 7fefc2dff700 1 Processor -- start 2023-07-27T14:29:05.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.876+0000 7fefc2dff700 1 -- start start 2023-07-27T14:29:05.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.877+0000 7fefc2dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fefbc14ae00 0x7fefbc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:05.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.878+0000 7fefc2dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc1553f0 con 0x7fefbc063260 2023-07-27T14:29:05.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.878+0000 7fefc2dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc157a50 con 0x7fefbc14b1e0 2023-07-27T14:29:05.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.878+0000 7fefc2dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefbc157d10 con 0x7fefbc14ae00 2023-07-27T14:29:05.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.878+0000 7fefc139c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fefbc063260 0x7fefbc0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56200/0 (socket says 172.21.15.115:56200) 2023-07-27T14:29:05.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.878+0000 7fefc139c700 1 -- 172.21.15.115:0/1565822954 learned_addr learned my addr 172.21.15.115:0/1565822954 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:05.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.878+0000 7fefc0b9b700 1 --2- 172.21.15.115:0/1565822954 >> v2:172.21.15.159:3300/0 conn(0x7fefbc14ae00 0x7fefbc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:05.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.878+0000 7fefbb7fe700 1 -- 172.21.15.115:0/1565822954 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856947229 0 0) 0x7fefbc1553f0 con 0x7fefbc063260 2023-07-27T14:29:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.878+0000 7fefbb7fe700 1 -- 172.21.15.115:0/1565822954 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefac0033f0 con 0x7fefbc063260 2023-07-27T14:29:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefc0b9b700 1 -- 172.21.15.115:0/1565822954 >> v1:172.21.15.159:6789/0 conn(0x7fefbc14b1e0 legacy=0x7fefbc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefc0b9b700 1 -- 172.21.15.115:0/1565822954 >> v1:172.21.15.115:6789/0 conn(0x7fefbc063260 legacy=0x7fefbc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefbb7fe700 1 -- 172.21.15.115:0/1565822954 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609166725 0 0) 0x7fefac0033f0 con 0x7fefbc063260 2023-07-27T14:29:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefc0b9b700 1 -- 172.21.15.115:0/1565822954 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc157ff0 con 0x7fefbc14ae00 2023-07-27T14:29:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefc0b9b700 1 --2- 172.21.15.115:0/1565822954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc14ae00 0x7fefbc154f00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fefb0009e60 tx=0x7fefb0009780).ready entity=mon.1 client_cookie=36534258cf0573c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:05.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefbb7fe700 1 -- 172.21.15.115:0/1565822954 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000e070 con 0x7fefbc14ae00 2023-07-27T14:29:05.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefbb7fe700 1 -- 172.21.15.115:0/1565822954 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb000b850 con 0x7fefbc14ae00 2023-07-27T14:29:05.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefbb7fe700 1 -- 172.21.15.115:0/1565822954 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb4001470 con 0x7fefbc14ae00 2023-07-27T14:29:05.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefc2dff700 1 -- 172.21.15.115:0/1565822954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc14ae00 msgr2=0x7fefbc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:05.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.879+0000 7fefc2dff700 1 --2- 172.21.15.115:0/1565822954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc14ae00 0x7fefbc154f00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fefb0009e60 tx=0x7fefb0009780).stop 2023-07-27T14:29:05.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.880+0000 7fefc2dff700 1 -- 172.21.15.115:0/1565822954 shutdown_connections 2023-07-27T14:29:05.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.880+0000 7fefc2dff700 1 --2- 172.21.15.115:0/1565822954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc14ae00 0x7fefbc154f00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:05.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.880+0000 7fefc2dff700 1 -- 172.21.15.115:0/1565822954 >> 172.21.15.115:0/1565822954 conn(0x7fefbc05e940 msgr2=0x7fefbc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:05.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.880+0000 7fefc2dff700 1 -- 172.21.15.115:0/1565822954 shutdown_connections 2023-07-27T14:29:05.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.880+0000 7fefc2dff700 1 -- 172.21.15.115:0/1565822954 wait complete. 2023-07-27T14:29:05.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.881+0000 7fefc2dff700 1 Processor -- start 2023-07-27T14:29:05.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.881+0000 7fefc2dff700 1 -- start start 2023-07-27T14:29:05.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefc2dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc063260 0x7fefbc0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:05.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefc2dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefbc14ae00 0x7fefbc14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:05.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefc2dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fefbc14b1e0 0x7fefbc0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:05.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefc2dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c1c50 con 0x7fefbc14ae00 2023-07-27T14:29:05.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefc2dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c1f30 con 0x7fefbc063260 2023-07-27T14:29:05.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefc2dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc14ac00 con 0x7fefbc14b1e0 2023-07-27T14:29:05.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefbbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefbc14ae00 0x7fefbc14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:05.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefbbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefbc14ae00 0x7fefbc14a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47902/0 (socket says 172.21.15.115:47902) 2023-07-27T14:29:05.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.882+0000 7fefbbfff700 1 -- 172.21.15.115:0/314258574 learned_addr learned my addr 172.21.15.115:0/314258574 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:05.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefc0b9b700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc063260 0x7fefbc0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:05.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefc139c700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fefbc14b1e0 0x7fefbc0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:05.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefbbfff700 1 -- 172.21.15.115:0/314258574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fefbc14b1e0 msgr2=0x7fefbc0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:05.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefbbfff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fefbc14b1e0 0x7fefbc0aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:05.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefbbfff700 1 -- 172.21.15.115:0/314258574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc063260 msgr2=0x7fefbc0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:05.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefbbfff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc063260 0x7fefbc0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:05.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefbbfff700 1 -- 172.21.15.115:0/314258574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0009a20 con 0x7fefbc14ae00 2023-07-27T14:29:05.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefbbfff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefbc14ae00 0x7fefbc14a710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fefa800c4c0 tx=0x7fefa8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:05.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefb8ff9700 1 -- 172.21.15.115:0/314258574 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8007020 con 0x7fefbc14ae00 2023-07-27T14:29:05.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefb8ff9700 1 -- 172.21.15.115:0/314258574 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa8007180 con 0x7fefbc14ae00 2023-07-27T14:29:05.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc0ae120 con 0x7fefbc14ae00 2023-07-27T14:29:05.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefb8ff9700 1 -- 172.21.15.115:0/314258574 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8007520 con 0x7fefbc14ae00 2023-07-27T14:29:05.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.883+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc0ae6e0 con 0x7fefbc14ae00 2023-07-27T14:29:05.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.884+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc0c20a0 con 0x7fefbc14ae00 2023-07-27T14:29:05.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.885+0000 7fefb8ff9700 1 -- 172.21.15.115:0/314258574 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fefa8010070 con 0x7fefbc14ae00 2023-07-27T14:29:05.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.887+0000 7fefb8ff9700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefa005eef0 0x7fefa00613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:05.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.887+0000 7fefb8ff9700 1 -- 172.21.15.115:0/314258574 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fefa8078d40 con 0x7fefbc14ae00 2023-07-27T14:29:05.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.887+0000 7fefc0b9b700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefa005eef0 0x7fefa00613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:05.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.887+0000 7fefc0b9b700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefa005eef0 0x7fefa00613b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fefb000c010 tx=0x7fefb0009780).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:05.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:05.890+0000 7fefb8ff9700 1 -- 172.21.15.115:0/314258574 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fefa80478f0 con 0x7fefbc14ae00 2023-07-27T14:29:06.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.065+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7fefbc06c470 con 0x7fefbc14ae00 2023-07-27T14:29:06.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.069+0000 7fefb8ff9700 1 -- 172.21.15.115:0/314258574 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v4) v1 ==== 115+0+0 (secure 0 0 0) 0x7fefa804a370 con 0x7fefbc14ae00 2023-07-27T14:29:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefa005eef0 msgr2=0x7fefa00613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefa005eef0 0x7fefa00613b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fefb000c010 tx=0x7fefb0009780).stop 2023-07-27T14:29:06.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefbc14ae00 msgr2=0x7fefbc14a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefbc14ae00 0x7fefbc14a710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fefa800c4c0 tx=0x7fefa8007dd0).stop 2023-07-27T14:29:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 shutdown_connections 2023-07-27T14:29:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fefa005eef0 0x7fefa00613b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fefbc14b1e0 0x7fefbc0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefbc063260 0x7fefbc0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 --2- 172.21.15.115:0/314258574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefbc14ae00 0x7fefbc14a710 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 >> 172.21.15.115:0/314258574 conn(0x7fefbc05e940 msgr2=0x7fefbc153150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:06.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 shutdown_connections 2023-07-27T14:29:06.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.071+0000 7fefc2dff700 1 -- 172.21.15.115:0/314258574 wait complete. 2023-07-27T14:29:06.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:29:06.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.280+0000 7f1cb11ff700 1 Processor -- start 2023-07-27T14:29:06.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.280+0000 7f1cb11ff700 1 -- start start 2023-07-27T14:29:06.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.281+0000 7f1cb11ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1cac14ae00 0x7f1cac154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.281+0000 7f1cb11ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1cac14b1e0 0x7f1cac062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.281+0000 7f1cb11ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac1553f0 con 0x7f1cac0c5c50 2023-07-27T14:29:06.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.281+0000 7f1cb11ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac157a50 con 0x7f1cac14ae00 2023-07-27T14:29:06.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.281+0000 7f1cb11ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac157d10 con 0x7f1cac14b1e0 2023-07-27T14:29:06.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.281+0000 7f1caad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1cac14ae00 0x7f1cac154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.281+0000 7f1caad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1cac14ae00 0x7f1cac154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47916/0 (socket says 172.21.15.115:47916) 2023-07-27T14:29:06.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.281+0000 7f1caad9d700 1 -- 172.21.15.115:0/924415657 learned_addr learned my addr 172.21.15.115:0/924415657 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:06.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1caad9d700 1 -- 172.21.15.115:0/924415657 >> v2:172.21.15.159:3300/0 conn(0x7f1cac14b1e0 msgr2=0x7f1cac062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:06.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1caa59c700 1 --2- 172.21.15.115:0/924415657 >> v2:172.21.15.159:3300/0 conn(0x7f1cac14b1e0 0x7f1cac062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1caad9d700 1 --2- 172.21.15.115:0/924415657 >> v2:172.21.15.159:3300/0 conn(0x7f1cac14b1e0 0x7f1cac062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1caad9d700 1 -- 172.21.15.115:0/924415657 >> v1:172.21.15.159:6789/0 conn(0x7f1cac0c5c50 legacy=0x7f1cac0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:06.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1caad9d700 1 -- 172.21.15.115:0/924415657 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac157ff0 con 0x7f1cac14ae00 2023-07-27T14:29:06.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1caa59c700 1 --2- 172.21.15.115:0/924415657 >> v2:172.21.15.159:3300/0 conn(0x7f1cac14b1e0 0x7f1cac062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:06.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1caad9d700 1 --2- 172.21.15.115:0/924415657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14ae00 0x7f1cac154f00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f1cac155580 tx=0x7f1c9c0090f0).ready entity=mon.0 client_cookie=226ef5093b771638 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:06.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1ca9d9b700 1 -- 172.21.15.115:0/924415657 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00b5a0 con 0x7f1cac14ae00 2023-07-27T14:29:06.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1ca9d9b700 1 -- 172.21.15.115:0/924415657 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00b700 con 0x7f1cac14ae00 2023-07-27T14:29:06.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.282+0000 7f1ca9d9b700 1 -- 172.21.15.115:0/924415657 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00ba80 con 0x7f1cac14ae00 2023-07-27T14:29:06.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.283+0000 7f1cb11ff700 1 -- 172.21.15.115:0/924415657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14ae00 msgr2=0x7f1cac154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.283+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/924415657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14ae00 0x7f1cac154f00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f1cac155580 tx=0x7f1c9c0090f0).stop 2023-07-27T14:29:06.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.283+0000 7f1cb11ff700 1 -- 172.21.15.115:0/924415657 shutdown_connections 2023-07-27T14:29:06.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.283+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/924415657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14ae00 0x7f1cac154f00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.283+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/924415657 >> v2:172.21.15.159:3300/0 conn(0x7f1cac14b1e0 0x7f1cac062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.283+0000 7f1cb11ff700 1 -- 172.21.15.115:0/924415657 >> 172.21.15.115:0/924415657 conn(0x7f1cac05e940 msgr2=0x7f1cac0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:06.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.283+0000 7f1cb11ff700 1 -- 172.21.15.115:0/924415657 shutdown_connections 2023-07-27T14:29:06.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.283+0000 7f1cb11ff700 1 -- 172.21.15.115:0/924415657 wait complete. 2023-07-27T14:29:06.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.284+0000 7f1cb11ff700 1 Processor -- start 2023-07-27T14:29:06.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.285+0000 7f1cb11ff700 1 -- start start 2023-07-27T14:29:06.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.285+0000 7f1cb11ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0c5c50 0x7f1cac166be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cb11ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cac14ae00 0x7f1cac163c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cb11ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14b1e0 0x7f1cac0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cb11ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac164180 con 0x7f1cac14b1e0 2023-07-27T14:29:06.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cb11ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0ae500 con 0x7f1cac0c5c50 2023-07-27T14:29:06.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cb11ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0ae7e0 con 0x7f1cac14ae00 2023-07-27T14:29:06.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14b1e0 0x7f1cac0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14b1e0 0x7f1cac0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47924/0 (socket says 172.21.15.115:47924) 2023-07-27T14:29:06.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 -- 172.21.15.115:0/2325300355 learned_addr learned my addr 172.21.15.115:0/2325300355 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:06.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1caad9d700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0c5c50 0x7f1cac166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1caa59c700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cac14ae00 0x7f1cac163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 -- 172.21.15.115:0/2325300355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cac14ae00 msgr2=0x7f1cac163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cac14ae00 0x7f1cac163c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 -- 172.21.15.115:0/2325300355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0c5c50 msgr2=0x7f1cac166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0c5c50 0x7f1cac166be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 -- 172.21.15.115:0/2325300355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c009370 con 0x7f1cac14b1e0 2023-07-27T14:29:06.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.286+0000 7f1cab59e700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14b1e0 0x7f1cac0adb60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f1ca400c810 tx=0x7f1ca4002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:06.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.287+0000 7f1ca2ffd700 1 -- 172.21.15.115:0/2325300355 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4010510 con 0x7f1cac14b1e0 2023-07-27T14:29:06.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.287+0000 7f1ca2ffd700 1 -- 172.21.15.115:0/2325300355 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4010670 con 0x7f1cac14b1e0 2023-07-27T14:29:06.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.287+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac0aeac0 con 0x7f1cac14b1e0 2023-07-27T14:29:06.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.287+0000 7f1ca2ffd700 1 -- 172.21.15.115:0/2325300355 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4010a30 con 0x7f1cac14b1e0 2023-07-27T14:29:06.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.287+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac0af080 con 0x7f1cac14b1e0 2023-07-27T14:29:06.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.288+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac0af2a0 con 0x7f1cac14b1e0 2023-07-27T14:29:06.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.288+0000 7f1ca2ffd700 1 -- 172.21.15.115:0/2325300355 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f1ca4010070 con 0x7f1cac14b1e0 2023-07-27T14:29:06.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.289+0000 7f1ca2ffd700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c9405eef0 0x7f1c940613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.289+0000 7f1ca2ffd700 1 -- 172.21.15.115:0/2325300355 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f1ca4079810 con 0x7f1cac14b1e0 2023-07-27T14:29:06.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.289+0000 7f1caad9d700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c9405eef0 0x7f1c940613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.290+0000 7f1caad9d700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c9405eef0 0x7f1c940613b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f1cac155580 tx=0x7f1c9c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:06.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.294+0000 7f1ca2ffd700 1 -- 172.21.15.115:0/2325300355 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ca404ae40 con 0x7f1cac14b1e0 2023-07-27T14:29:06.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.468+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1cac06c470 con 0x7f1cac14b1e0 2023-07-27T14:29:06.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.472+0000 7f1ca2ffd700 1 -- 172.21.15.115:0/2325300355 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1ca404e460 con 0x7f1cac14b1e0 2023-07-27T14:29:06.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c9405eef0 msgr2=0x7f1c940613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c9405eef0 0x7f1c940613b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f1cac155580 tx=0x7f1c9c015000).stop 2023-07-27T14:29:06.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14b1e0 msgr2=0x7f1cac0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14b1e0 0x7f1cac0adb60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f1ca400c810 tx=0x7f1ca4002530).stop 2023-07-27T14:29:06.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 shutdown_connections 2023-07-27T14:29:06.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c9405eef0 0x7f1c940613b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1cac14b1e0 0x7f1cac0adb60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cac0c5c50 0x7f1cac166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 --2- 172.21.15.115:0/2325300355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cac14ae00 0x7f1cac163c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 >> 172.21.15.115:0/2325300355 conn(0x7f1cac05e940 msgr2=0x7f1cac152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:06.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 shutdown_connections 2023-07-27T14:29:06.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.474+0000 7f1cb11ff700 1 -- 172.21.15.115:0/2325300355 wait complete. 2023-07-27T14:29:06.514 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2023-07-27T14:29:06.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.680+0000 7fd89dbff700 1 Processor -- start 2023-07-27T14:29:06.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.680+0000 7fd89dbff700 1 -- start start 2023-07-27T14:29:06.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.681+0000 7fd89dbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd898151bd0 0x7fd898062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.681+0000 7fd89dbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd898062810 0x7fd8980a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.681+0000 7fd89dbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8980639d0 con 0x7fd8980a4d30 2023-07-27T14:29:06.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.681+0000 7fd89dbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd898137610 con 0x7fd898151bd0 2023-07-27T14:29:06.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.681+0000 7fd89dbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980a51c0 con 0x7fd898062810 2023-07-27T14:29:06.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8977fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd898151bd0 0x7fd898062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8977fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd898151bd0 0x7fd898062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47926/0 (socket says 172.21.15.115:47926) 2023-07-27T14:29:06.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8977fe700 1 -- 172.21.15.115:0/1318041787 learned_addr learned my addr 172.21.15.115:0/1318041787 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:06.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd896ffd700 1 --2- 172.21.15.115:0/1318041787 >> v2:172.21.15.159:3300/0 conn(0x7fd898062810 0x7fd8980a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8977fe700 1 -- 172.21.15.115:0/1318041787 >> v2:172.21.15.159:3300/0 conn(0x7fd898062810 msgr2=0x7fd8980a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:06.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8977fe700 1 --2- 172.21.15.115:0/1318041787 >> v2:172.21.15.159:3300/0 conn(0x7fd898062810 0x7fd8980a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8977fe700 1 -- 172.21.15.115:0/1318041787 >> v1:172.21.15.159:6789/0 conn(0x7fd8980a4d30 legacy=0x7fd898157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:06.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8977fe700 1 -- 172.21.15.115:0/1318041787 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd898062dc0 con 0x7fd898151bd0 2023-07-27T14:29:06.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8977fe700 1 --2- 172.21.15.115:0/1318041787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898151bd0 0x7fd898062320 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd8980be140 tx=0x7fd8880090f0).ready entity=mon.0 client_cookie=28e38092bc8ecf16 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:06.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.682+0000 7fd8967fc700 1 -- 172.21.15.115:0/1318041787 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800b5a0 con 0x7fd898151bd0 2023-07-27T14:29:06.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd8967fc700 1 -- 172.21.15.115:0/1318041787 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88800b700 con 0x7fd898151bd0 2023-07-27T14:29:06.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd8967fc700 1 -- 172.21.15.115:0/1318041787 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800ba80 con 0x7fd898151bd0 2023-07-27T14:29:06.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd89dbff700 1 -- 172.21.15.115:0/1318041787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898151bd0 msgr2=0x7fd898062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1318041787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898151bd0 0x7fd898062320 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd8980be140 tx=0x7fd8880090f0).stop 2023-07-27T14:29:06.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd89dbff700 1 -- 172.21.15.115:0/1318041787 shutdown_connections 2023-07-27T14:29:06.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1318041787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898151bd0 0x7fd898062320 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1318041787 >> v2:172.21.15.159:3300/0 conn(0x7fd898062810 0x7fd8980a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd89dbff700 1 -- 172.21.15.115:0/1318041787 >> 172.21.15.115:0/1318041787 conn(0x7fd898064700 msgr2=0x7fd898064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:06.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd89dbff700 1 -- 172.21.15.115:0/1318041787 shutdown_connections 2023-07-27T14:29:06.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.683+0000 7fd89dbff700 1 -- 172.21.15.115:0/1318041787 wait complete. 2023-07-27T14:29:06.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.685+0000 7fd89dbff700 1 Processor -- start 2023-07-27T14:29:06.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.685+0000 7fd89dbff700 1 -- start start 2023-07-27T14:29:06.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd89dbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898062810 0x7fd8980a7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd89dbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8980a4d30 0x7fd898135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd89dbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd898151bd0 0x7fd898139b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd89dbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980ab680 con 0x7fd898062810 2023-07-27T14:29:06.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd89dbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980a7dc0 con 0x7fd898151bd0 2023-07-27T14:29:06.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd89dbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980a80a0 con 0x7fd8980a4d30 2023-07-27T14:29:06.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898062810 0x7fd8980a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898062810 0x7fd8980a7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47934/0 (socket says 172.21.15.115:47934) 2023-07-27T14:29:06.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 -- 172.21.15.115:0/1263266505 learned_addr learned my addr 172.21.15.115:0/1263266505 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:06.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd897fff700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd898151bd0 0x7fd898139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd896ffd700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8980a4d30 0x7fd898135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 -- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8980a4d30 msgr2=0x7fd898135b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8980a4d30 0x7fd898135b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 -- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd898151bd0 msgr2=0x7fd898139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:06.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd898151bd0 0x7fd898139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:06.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 -- 172.21.15.115:0/1263266505 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009370 con 0x7fd898062810 2023-07-27T14:29:06.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd897fff700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd898151bd0 0x7fd898139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:06.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd896ffd700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8980a4d30 0x7fd898135b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:06.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.686+0000 7fd8977fe700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898062810 0x7fd8980a7470 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fd898067f10 tx=0x7fd888015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:06.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.687+0000 7fd87f7fe700 1 -- 172.21.15.115:0/1263266505 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800b870 con 0x7fd898062810 2023-07-27T14:29:06.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.687+0000 7fd87f7fe700 1 -- 172.21.15.115:0/1263266505 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88800b9d0 con 0x7fd898062810 2023-07-27T14:29:06.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.687+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8980ab920 con 0x7fd898062810 2023-07-27T14:29:06.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.687+0000 7fd87f7fe700 1 -- 172.21.15.115:0/1263266505 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88801a430 con 0x7fd898062810 2023-07-27T14:29:06.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.687+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8980a7960 con 0x7fd898062810 2023-07-27T14:29:06.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.688+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8980ab4e0 con 0x7fd898062810 2023-07-27T14:29:06.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.688+0000 7fd87f7fe700 1 -- 172.21.15.115:0/1263266505 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fd88802b070 con 0x7fd898062810 2023-07-27T14:29:06.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.689+0000 7fd87f7fe700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88405eec0 0x7fd884061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:06.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.689+0000 7fd87f7fe700 1 -- 172.21.15.115:0/1263266505 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd88807b240 con 0x7fd898062810 2023-07-27T14:29:06.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.689+0000 7fd896ffd700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88405eec0 0x7fd884061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:06.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.690+0000 7fd896ffd700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88405eec0 0x7fd884061380 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fd8980a8760 tx=0x7fd88c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:06.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.693+0000 7fd87f7fe700 1 -- 172.21.15.115:0/1263266505 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd8980ab4e0 con 0x7fd898062810 2023-07-27T14:29:06.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:06.928+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) v1 -- 0x7fd8980ab4e0 con 0x7fd898062810 2023-07-27T14:29:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.665+0000 7fd87f7fe700 1 -- 172.21.15.115:0/1263266505 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v125) v1 ==== 165+0+0 (secure 0 0 0) 0x7fd8980ab4e0 con 0x7fd898062810 2023-07-27T14:29:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88405eec0 msgr2=0x7fd884061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88405eec0 0x7fd884061380 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fd8980a8760 tx=0x7fd88c008040).stop 2023-07-27T14:29:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898062810 msgr2=0x7fd8980a7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898062810 0x7fd8980a7470 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fd898067f10 tx=0x7fd888015000).stop 2023-07-27T14:29:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 shutdown_connections 2023-07-27T14:29:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88405eec0 0x7fd884061380 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd898151bd0 0x7fd898139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd898062810 0x7fd8980a7470 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 --2- 172.21.15.115:0/1263266505 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8980a4d30 0x7fd898135b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.668+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 >> 172.21.15.115:0/1263266505 conn(0x7fd898064700 msgr2=0x7fd8980c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.669+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 shutdown_connections 2023-07-27T14:29:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.669+0000 7fd89dbff700 1 -- 172.21.15.115:0/1263266505 wait complete. 2023-07-27T14:29:07.712 INFO:tasks.cephfs_test_runner:test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:29:07.712 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:29:07.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2023-07-27T14:29:07.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.881+0000 7f496e5ff700 1 Processor -- start 2023-07-27T14:29:07.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.881+0000 7f496e5ff700 1 -- start start 2023-07-27T14:29:07.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f496e5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4968153ec0 0x7f49680a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:07.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f496e5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49680aa050 0x7f49680640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f496e5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f49680aaa40 0x7f49680645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f496e5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4968064ad0 con 0x7f49680aa050 2023-07-27T14:29:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f496e5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680aa4d0 con 0x7f49680aaa40 2023-07-27T14:29:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f496e5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c05c0 con 0x7f4968153ec0 2023-07-27T14:29:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f49677fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49680aa050 0x7f49680640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f49677fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49680aa050 0x7f49680640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47938/0 (socket says 172.21.15.115:47938) 2023-07-27T14:29:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.883+0000 7f49677fe700 1 -- 172.21.15.115:0/780186142 learned_addr learned my addr 172.21.15.115:0/780186142 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:07.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f496cb9c700 1 --2- 172.21.15.115:0/780186142 >> v2:172.21.15.159:3300/0 conn(0x7f49680aaa40 0x7f49680645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:07.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f4967fff700 1 --2- 172.21.15.115:0/780186142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4968153ec0 0x7f49680a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f49677fe700 1 -- 172.21.15.115:0/780186142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4968153ec0 msgr2=0x7f49680a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f49677fe700 1 --2- 172.21.15.115:0/780186142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4968153ec0 0x7f49680a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f49677fe700 1 -- 172.21.15.115:0/780186142 >> v2:172.21.15.159:3300/0 conn(0x7f49680aaa40 msgr2=0x7f49680645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f49677fe700 1 --2- 172.21.15.115:0/780186142 >> v2:172.21.15.159:3300/0 conn(0x7f49680aaa40 0x7f49680645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f49677fe700 1 -- 172.21.15.115:0/780186142 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680bfc90 con 0x7f49680aa050 2023-07-27T14:29:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f4967fff700 1 --2- 172.21.15.115:0/780186142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4968153ec0 0x7f49680a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f49677fe700 1 --2- 172.21.15.115:0/780186142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49680aa050 0x7f49680640f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f49680843b0 tx=0x7f495c0090f0).ready entity=mon.0 client_cookie=60f61993f63b8ad6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f4966ffd700 1 -- 172.21.15.115:0/780186142 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00b600 con 0x7f49680aa050 2023-07-27T14:29:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f4966ffd700 1 -- 172.21.15.115:0/780186142 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00b760 con 0x7f49680aa050 2023-07-27T14:29:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.884+0000 7f4966ffd700 1 -- 172.21.15.115:0/780186142 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00bae0 con 0x7f49680aa050 2023-07-27T14:29:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 -- 172.21.15.115:0/780186142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49680aa050 msgr2=0x7f49680640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 --2- 172.21.15.115:0/780186142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49680aa050 0x7f49680640f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f49680843b0 tx=0x7f495c0090f0).stop 2023-07-27T14:29:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 -- 172.21.15.115:0/780186142 shutdown_connections 2023-07-27T14:29:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 --2- 172.21.15.115:0/780186142 >> v2:172.21.15.159:3300/0 conn(0x7f49680aaa40 0x7f49680645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 --2- 172.21.15.115:0/780186142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4968153ec0 0x7f49680a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 --2- 172.21.15.115:0/780186142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49680aa050 0x7f49680640f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 -- 172.21.15.115:0/780186142 >> 172.21.15.115:0/780186142 conn(0x7f49680cb610 msgr2=0x7f49680c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 -- 172.21.15.115:0/780186142 shutdown_connections 2023-07-27T14:29:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.885+0000 7f496e5ff700 1 -- 172.21.15.115:0/780186142 wait complete. 2023-07-27T14:29:07.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.887+0000 7f496e5ff700 1 Processor -- start 2023-07-27T14:29:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.887+0000 7f496e5ff700 1 -- start start 2023-07-27T14:29:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.888+0000 7f496e5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49680aa050 0x7f496814ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:07.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.888+0000 7f496e5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49680aaa40 0x7f49680c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:07.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.888+0000 7f496e5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4968153ec0 0x7f49680c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:07.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.888+0000 7f496e5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4968150b20 con 0x7f4968153ec0 2023-07-27T14:29:07.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.888+0000 7f496e5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4968150e00 con 0x7f49680aa050 2023-07-27T14:29:07.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.888+0000 7f496e5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49681510e0 con 0x7f49680aaa40 2023-07-27T14:29:07.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4968153ec0 0x7f49680c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:07.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4968153ec0 0x7f49680c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47944/0 (socket says 172.21.15.115:47944) 2023-07-27T14:29:07.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 -- 172.21.15.115:0/4050908789 learned_addr learned my addr 172.21.15.115:0/4050908789 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:07.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f49677fe700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49680aaa40 0x7f49680c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:07.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f4967fff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49680aa050 0x7f496814ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:07.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 -- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49680aaa40 msgr2=0x7f49680c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:07.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49680aaa40 0x7f49680c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 -- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49680aa050 msgr2=0x7f496814ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:07.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49680aa050 0x7f496814ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:07.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 -- 172.21.15.115:0/4050908789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c009370 con 0x7f4968153ec0 2023-07-27T14:29:07.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f4967fff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49680aa050 0x7f496814ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:07.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f496cb9c700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4968153ec0 0x7f49680c30f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f4960007f20 tx=0x7f49600098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:07.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.889+0000 7f494ffff700 1 -- 172.21.15.115:0/4050908789 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000ebf0 con 0x7f4968153ec0 2023-07-27T14:29:07.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.890+0000 7f494ffff700 1 -- 172.21.15.115:0/4050908789 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496000ed50 con 0x7f4968153ec0 2023-07-27T14:29:07.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.890+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49681513c0 con 0x7f4968153ec0 2023-07-27T14:29:07.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.890+0000 7f494ffff700 1 -- 172.21.15.115:0/4050908789 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960014610 con 0x7f4968153ec0 2023-07-27T14:29:07.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.890+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49681427b0 con 0x7f4968153ec0 2023-07-27T14:29:07.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.891+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49681518e0 con 0x7f4968153ec0 2023-07-27T14:29:07.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.891+0000 7f494ffff700 1 -- 172.21.15.115:0/4050908789 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f496001b030 con 0x7f4968153ec0 2023-07-27T14:29:07.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.892+0000 7f494ffff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f495405eef0 0x7f49540613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:07.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.892+0000 7f494ffff700 1 -- 172.21.15.115:0/4050908789 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4960079e00 con 0x7f4968153ec0 2023-07-27T14:29:07.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.892+0000 7f4967fff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f495405eef0 0x7f49540613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:07.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.893+0000 7f4967fff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f495405eef0 0x7f49540613b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f4958006fd0 tx=0x7f4958008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:07.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:07.896+0000 7f494ffff700 1 -- 172.21.15.115:0/4050908789 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49681518e0 con 0x7f4968153ec0 2023-07-27T14:29:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.125+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) v1 -- 0x7f49681518e0 con 0x7f4968153ec0 2023-07-27T14:29:08.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.667+0000 7f494ffff700 1 -- 172.21.15.115:0/4050908789 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v126) v1 ==== 183+0+0 (secure 0 0 0) 0x7f49681518e0 con 0x7f4968153ec0 2023-07-27T14:29:08.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f495405eef0 msgr2=0x7f49540613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:08.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f495405eef0 0x7f49540613b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f4958006fd0 tx=0x7f4958008040).stop 2023-07-27T14:29:08.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4968153ec0 msgr2=0x7f49680c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:08.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4968153ec0 0x7f49680c30f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f4960007f20 tx=0x7f49600098a0).stop 2023-07-27T14:29:08.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 shutdown_connections 2023-07-27T14:29:08.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f495405eef0 0x7f49540613b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:08.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4968153ec0 0x7f49680c30f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:08.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49680aa050 0x7f496814ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:08.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 --2- 172.21.15.115:0/4050908789 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49680aaa40 0x7f49680c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:08.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 >> 172.21.15.115:0/4050908789 conn(0x7f49680cb610 msgr2=0x7f49680ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:08.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 shutdown_connections 2023-07-27T14:29:08.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.669+0000 7f496e5ff700 1 -- 172.21.15.115:0/4050908789 wait complete. 2023-07-27T14:29:08.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:29:08.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.881+0000 7f874e1ff700 1 Processor -- start 2023-07-27T14:29:08.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.881+0000 7f874e1ff700 1 -- start start 2023-07-27T14:29:08.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.882+0000 7f874e1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8748063260 0x7f8748154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:08.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.882+0000 7f874e1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f874814b1e0 0x7f87480a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:08.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.882+0000 7f874e1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87481553f0 con 0x7f874814ae00 2023-07-27T14:29:08.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.882+0000 7f874e1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8748157a50 con 0x7f8748063260 2023-07-27T14:29:08.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.882+0000 7f874e1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8748157d10 con 0x7f874814b1e0 2023-07-27T14:29:08.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.882+0000 7f8746ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8748063260 0x7f8748154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:08.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f8746ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8748063260 0x7f8748154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47960/0 (socket says 172.21.15.115:47960) 2023-07-27T14:29:08.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f8746ffd700 1 -- 172.21.15.115:0/2602510854 learned_addr learned my addr 172.21.15.115:0/2602510854 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f8747fff700 1 --2- 172.21.15.115:0/2602510854 >> v2:172.21.15.159:3300/0 conn(0x7f874814b1e0 0x7f87480a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f8746ffd700 1 -- 172.21.15.115:0/2602510854 >> v2:172.21.15.159:3300/0 conn(0x7f874814b1e0 msgr2=0x7f87480a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f8746ffd700 1 --2- 172.21.15.115:0/2602510854 >> v2:172.21.15.159:3300/0 conn(0x7f874814b1e0 0x7f87480a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f8746ffd700 1 -- 172.21.15.115:0/2602510854 >> v1:172.21.15.159:6789/0 conn(0x7f874814ae00 legacy=0x7f8748062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:08.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f8746ffd700 1 -- 172.21.15.115:0/2602510854 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748157ff0 con 0x7f8748063260 2023-07-27T14:29:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f8746ffd700 1 --2- 172.21.15.115:0/2602510854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f8748154f00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f8748083430 tx=0x7f873c0090f0).ready entity=mon.0 client_cookie=5cd93509fceed8ba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.883+0000 7f87467fc700 1 -- 172.21.15.115:0/2602510854 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00b5a0 con 0x7f8748063260 2023-07-27T14:29:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f87467fc700 1 -- 172.21.15.115:0/2602510854 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b700 con 0x7f8748063260 2023-07-27T14:29:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f87467fc700 1 -- 172.21.15.115:0/2602510854 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00ba80 con 0x7f8748063260 2023-07-27T14:29:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f874e1ff700 1 -- 172.21.15.115:0/2602510854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 msgr2=0x7f8748154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f874e1ff700 1 --2- 172.21.15.115:0/2602510854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f8748154f00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f8748083430 tx=0x7f873c0090f0).stop 2023-07-27T14:29:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f874e1ff700 1 -- 172.21.15.115:0/2602510854 shutdown_connections 2023-07-27T14:29:08.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f874e1ff700 1 --2- 172.21.15.115:0/2602510854 >> v2:172.21.15.159:3300/0 conn(0x7f874814b1e0 0x7f87480a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:08.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f874e1ff700 1 --2- 172.21.15.115:0/2602510854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f8748154f00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:08.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f874e1ff700 1 -- 172.21.15.115:0/2602510854 >> 172.21.15.115:0/2602510854 conn(0x7f874805e940 msgr2=0x7f87480cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:08.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f874e1ff700 1 -- 172.21.15.115:0/2602510854 shutdown_connections 2023-07-27T14:29:08.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.884+0000 7f874e1ff700 1 -- 172.21.15.115:0/2602510854 wait complete. 2023-07-27T14:29:08.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.886+0000 7f874e1ff700 1 Processor -- start 2023-07-27T14:29:08.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.886+0000 7f874e1ff700 1 -- start start 2023-07-27T14:29:08.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f874e1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f87480aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:08.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f874e1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f874814ae00 0x7f87480aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:08.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f874e1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f874814b1e0 0x7f87481495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:08.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f874e1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87480c1c50 con 0x7f8748063260 2023-07-27T14:29:08.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f874e1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87480af110 con 0x7f874814b1e0 2023-07-27T14:29:08.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f874e1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87480af3f0 con 0x7f874814ae00 2023-07-27T14:29:08.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f87477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f87480aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:08.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f87477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f87480aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47968/0 (socket says 172.21.15.115:47968) 2023-07-27T14:29:08.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f87477fe700 1 -- 172.21.15.115:0/1759023506 learned_addr learned my addr 172.21.15.115:0/1759023506 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:08.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f8747fff700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f874814b1e0 0x7f87481495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:08.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f87477fe700 1 -- 172.21.15.115:0/1759023506 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f874814ae00 msgr2=0x7f87480aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:08.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f87477fe700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f874814ae00 0x7f87480aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:08.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f87477fe700 1 -- 172.21.15.115:0/1759023506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f874814b1e0 msgr2=0x7f87481495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:08.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f87477fe700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f874814b1e0 0x7f87481495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:08.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.887+0000 7f87477fe700 1 -- 172.21.15.115:0/1759023506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c009370 con 0x7f8748063260 2023-07-27T14:29:08.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.888+0000 7f87477fe700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f87480aeb30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f873800c440 tx=0x7f8738007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:08.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.888+0000 7f872f7fe700 1 -- 172.21.15.115:0/1759023506 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873800f470 con 0x7f8748063260 2023-07-27T14:29:08.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.888+0000 7f872f7fe700 1 -- 172.21.15.115:0/1759023506 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873800f5f0 con 0x7f8748063260 2023-07-27T14:29:08.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.888+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87480af6d0 con 0x7f8748063260 2023-07-27T14:29:08.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.888+0000 7f872f7fe700 1 -- 172.21.15.115:0/1759023506 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873800f9b0 con 0x7f8748063260 2023-07-27T14:29:08.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.888+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87480b0480 con 0x7f8748063260 2023-07-27T14:29:08.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.889+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874806c470 con 0x7f8748063260 2023-07-27T14:29:08.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.890+0000 7f872f7fe700 1 -- 172.21.15.115:0/1759023506 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f8738019030 con 0x7f8748063260 2023-07-27T14:29:08.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.890+0000 7f872f7fe700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f873405eef0 0x7f87340613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:08.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.890+0000 7f872f7fe700 1 -- 172.21.15.115:0/1759023506 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f8738078e70 con 0x7f8748063260 2023-07-27T14:29:08.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.891+0000 7f8746ffd700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f873405eef0 0x7f87340613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:08.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.891+0000 7f8746ffd700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f873405eef0 0x7f87340613b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8748063660 tx=0x7f873c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:08.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:08.895+0000 7f872f7fe700 1 -- 172.21.15.115:0/1759023506 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87380488f0 con 0x7f8748063260 2023-07-27T14:29:09.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.066+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f87480ab170 con 0x7f8748063260 2023-07-27T14:29:09.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.069+0000 7f872f7fe700 1 -- 172.21.15.115:0/1759023506 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f873804a660 con 0x7f8748063260 2023-07-27T14:29:09.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f873405eef0 msgr2=0x7f87340613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:09.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f873405eef0 0x7f87340613b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f8748063660 tx=0x7f873c015000).stop 2023-07-27T14:29:09.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 msgr2=0x7f87480aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:09.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f87480aeb30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f873800c440 tx=0x7f8738007de0).stop 2023-07-27T14:29:09.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 shutdown_connections 2023-07-27T14:29:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f873405eef0 0x7f87340613b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f874814b1e0 0x7f87481495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8748063260 0x7f87480aeb30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 --2- 172.21.15.115:0/1759023506 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f874814ae00 0x7f87480aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 >> 172.21.15.115:0/1759023506 conn(0x7f874805e940 msgr2=0x7f874814a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 shutdown_connections 2023-07-27T14:29:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.072+0000 7f874e1ff700 1 -- 172.21.15.115:0/1759023506 wait complete. 2023-07-27T14:29:09.112 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:29:09.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:29:09.207 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:29:09.320 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:29:09.320 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:29:09.320 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:29:09.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.485+0000 7fe1edfff700 1 Processor -- start 2023-07-27T14:29:09.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.485+0000 7fe1edfff700 1 -- start start 2023-07-27T14:29:09.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.486+0000 7fe1edfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1e8151d70 0x7fe1e8155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:09.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.486+0000 7fe1edfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 0x7fe1e8067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:09.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.486+0000 7fe1edfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e8067080 con 0x7fe1e8065ff0 2023-07-27T14:29:09.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.486+0000 7fe1edfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e8063a90 con 0x7fe1e8151d70 2023-07-27T14:29:09.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.486+0000 7fe1edfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80634d0 con 0x7fe1e8066b80 2023-07-27T14:29:09.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1e8151d70 0x7fe1e8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:09.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1e8151d70 0x7fe1e8155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47974/0 (socket says 172.21.15.115:47974) 2023-07-27T14:29:09.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e77fe700 1 -- 172.21.15.115:0/4283677455 learned_addr learned my addr 172.21.15.115:0/4283677455 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:09.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e6ffd700 1 --1- 172.21.15.115:0/4283677455 >> v1:172.21.15.115:6789/0 conn(0x7fe1e8065ff0 0x7fe1e8066470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56216/0 (socket says 172.21.15.115:56216) 2023-07-27T14:29:09.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e7fff700 1 --2- 172.21.15.115:0/4283677455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 0x7fe1e8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:09.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e77fe700 1 -- 172.21.15.115:0/4283677455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 msgr2=0x7fe1e8067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:09.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e77fe700 1 --2- 172.21.15.115:0/4283677455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 0x7fe1e8067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:09.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e77fe700 1 -- 172.21.15.115:0/4283677455 >> v1:172.21.15.115:6789/0 conn(0x7fe1e8065ff0 legacy=0x7fe1e8066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:09.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e77fe700 1 -- 172.21.15.115:0/4283677455 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80637b0 con 0x7fe1e8151d70 2023-07-27T14:29:09.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e77fe700 1 --2- 172.21.15.115:0/4283677455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8151d70 0x7fe1e8155060 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fe1d8006fd0 tx=0x7fe1d80090f0).ready entity=mon.0 client_cookie=70b89a838c6fb061 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:09.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.487+0000 7fe1e67fc700 1 -- 172.21.15.115:0/4283677455 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800b600 con 0x7fe1e8151d70 2023-07-27T14:29:09.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1e67fc700 1 -- 172.21.15.115:0/4283677455 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d800b760 con 0x7fe1e8151d70 2023-07-27T14:29:09.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1e67fc700 1 -- 172.21.15.115:0/4283677455 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800bae0 con 0x7fe1e8151d70 2023-07-27T14:29:09.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1edfff700 1 -- 172.21.15.115:0/4283677455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8151d70 msgr2=0x7fe1e8155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:09.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1edfff700 1 --2- 172.21.15.115:0/4283677455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8151d70 0x7fe1e8155060 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fe1d8006fd0 tx=0x7fe1d80090f0).stop 2023-07-27T14:29:09.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1edfff700 1 -- 172.21.15.115:0/4283677455 shutdown_connections 2023-07-27T14:29:09.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1edfff700 1 --2- 172.21.15.115:0/4283677455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 0x7fe1e8067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:09.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1edfff700 1 --2- 172.21.15.115:0/4283677455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8151d70 0x7fe1e8155060 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:09.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1edfff700 1 -- 172.21.15.115:0/4283677455 >> 172.21.15.115:0/4283677455 conn(0x7fe1e80c89a0 msgr2=0x7fe1e80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:09.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1edfff700 1 -- 172.21.15.115:0/4283677455 shutdown_connections 2023-07-27T14:29:09.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.488+0000 7fe1edfff700 1 -- 172.21.15.115:0/4283677455 wait complete. 2023-07-27T14:29:09.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.490+0000 7fe1edfff700 1 Processor -- start 2023-07-27T14:29:09.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.490+0000 7fe1edfff700 1 -- start start 2023-07-27T14:29:09.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1edfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8065ff0 0x7fe1e8155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:09.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1edfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 0x7fe1e80bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:09.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1edfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e8151d70 0x7fe1e8146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:09.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1edfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c0db0 con 0x7fe1e8065ff0 2023-07-27T14:29:09.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1edfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c1090 con 0x7fe1e8151d70 2023-07-27T14:29:09.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1edfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c0220 con 0x7fe1e8066b80 2023-07-27T14:29:09.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8065ff0 0x7fe1e8155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:09.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8065ff0 0x7fe1e8155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47978/0 (socket says 172.21.15.115:47978) 2023-07-27T14:29:09.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 -- 172.21.15.115:0/2291021724 learned_addr learned my addr 172.21.15.115:0/2291021724 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:09.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 -- 172.21.15.115:0/2291021724 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 msgr2=0x7fe1e80bfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:09.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 0x7fe1e80bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:09.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 -- 172.21.15.115:0/2291021724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e8151d70 msgr2=0x7fe1e8146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:09.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e8151d70 0x7fe1e8146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:09.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 -- 172.21.15.115:0/2291021724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d8009370 con 0x7fe1e8065ff0 2023-07-27T14:29:09.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.491+0000 7fe1e77fe700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8065ff0 0x7fe1e8155ff0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fe1e8060790 tx=0x7fe1d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:09.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.492+0000 7fe1cf7fe700 1 -- 172.21.15.115:0/2291021724 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800b8d0 con 0x7fe1e8065ff0 2023-07-27T14:29:09.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.492+0000 7fe1cf7fe700 1 -- 172.21.15.115:0/2291021724 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d800ba30 con 0x7fe1e8065ff0 2023-07-27T14:29:09.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.492+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e80c0500 con 0x7fe1e8065ff0 2023-07-27T14:29:09.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.492+0000 7fe1cf7fe700 1 -- 172.21.15.115:0/2291021724 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d801c670 con 0x7fe1e8065ff0 2023-07-27T14:29:09.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.492+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e80bff30 con 0x7fe1e8065ff0 2023-07-27T14:29:09.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.493+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e806c470 con 0x7fe1e8065ff0 2023-07-27T14:29:09.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.494+0000 7fe1cf7fe700 1 -- 172.21.15.115:0/2291021724 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fe1d802c070 con 0x7fe1e8065ff0 2023-07-27T14:29:09.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.494+0000 7fe1cf7fe700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d405eef0 0x7fe1d40613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:09.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.495+0000 7fe1cf7fe700 1 -- 172.21.15.115:0/2291021724 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe1d807b6b0 con 0x7fe1e8065ff0 2023-07-27T14:29:09.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.495+0000 7fe1e6ffd700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d405eef0 0x7fe1d40613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:09.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.495+0000 7fe1e6ffd700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d405eef0 0x7fe1d40613b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fe1e81472a0 tx=0x7fe1dc0079b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:09.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.499+0000 7fe1cf7fe700 1 -- 172.21.15.115:0/2291021724 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1d804cd70 con 0x7fe1e8065ff0 2023-07-27T14:29:09.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.708+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1e8068720 con 0x7fe1e8065ff0 2023-07-27T14:29:09.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.709+0000 7fe1cf7fe700 1 -- 172.21.15.115:0/2291021724 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fe1d802a070 con 0x7fe1e8065ff0 2023-07-27T14:29:09.732 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:09.733 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/2250060018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2250060018},{"type":"v1","addr":"172.21.15.159:6833","nonce":2250060018}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2756493852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2756493852},{"type":"v1","addr":"172.21.15.159:6835","nonce":2756493852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4777,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1646103579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1646103579},{"type":"v1","addr":"172.21.15.115:6836","nonce":1646103579}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2935726894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2935726894},{"type":"v1","addr":"172.21.15.115:6837","nonce":2935726894}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-07-27T14:29:09.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d405eef0 msgr2=0x7fe1d40613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:09.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d405eef0 0x7fe1d40613b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fe1e81472a0 tx=0x7fe1dc0079b0).stop 2023-07-27T14:29:09.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8065ff0 msgr2=0x7fe1e8155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:09.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8065ff0 0x7fe1e8155ff0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fe1e8060790 tx=0x7fe1d8017000).stop 2023-07-27T14:29:09.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 shutdown_connections 2023-07-27T14:29:09.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d405eef0 0x7fe1d40613b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:09.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e8151d70 0x7fe1e8146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:09.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e8065ff0 0x7fe1e8155ff0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:09.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 --2- 172.21.15.115:0/2291021724 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1e8066b80 0x7fe1e80bfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:09.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 >> 172.21.15.115:0/2291021724 conn(0x7fe1e80c89a0 msgr2=0x7fe1e8152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:09.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 shutdown_connections 2023-07-27T14:29:09.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:09.711+0000 7fe1edfff700 1 -- 172.21.15.115:0/2291021724 wait complete. 2023-07-27T14:29:09.736 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2023-07-27T14:29:09.751 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:29:09.752 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:29:09.752 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:29:09.752 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:29:09.753 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:29:09.753 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:29:09.753 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:29:09.753 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:29:09.753 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:29:09.754 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:29:09.754 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:29:09.754 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:29:09.755 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:29:09.755 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:29:09.755 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:29:09.755 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:29:09.766 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:29:09.766 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:29:09.767 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:29:09.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:29:09.769 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:29:09.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:29:09.770 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:29:09.771 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:29:09.811 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:29:09.811 DEBUG:teuthology.parallel:result is None 2023-07-27T14:29:09.814 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:29:09.814 DEBUG:teuthology.parallel:result is None 2023-07-27T14:29:09.815 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:29:09.815 DEBUG:teuthology.parallel:result is None 2023-07-27T14:29:09.817 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:29:09.817 DEBUG:teuthology.parallel:result is None 2023-07-27T14:29:09.817 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:29:09.952 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:29:09.953 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:29:09.966 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:29:09.966 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:29:10.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.003+0000 7ff22c9ff700 1 Processor -- start 2023-07-27T14:29:10.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.003+0000 7ff22c9ff700 1 -- start start 2023-07-27T14:29:10.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.004+0000 7ff22c9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff228150af0 0x7ff228150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:10.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.004+0000 7ff22c9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22806a440 con 0x7ff2280c0e80 2023-07-27T14:29:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.004+0000 7ff22c9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2280bbc80 con 0x7ff2280a5e40 2023-07-27T14:29:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.004+0000 7ff22c9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff228069e80 con 0x7ff228150af0 2023-07-27T14:29:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.004+0000 7ff225d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff2280c0e80 0x7ff2280a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56240/0 (socket says 172.21.15.115:56240) 2023-07-27T14:29:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.004+0000 7ff225d9b700 1 -- 172.21.15.115:0/1137137266 learned_addr learned my addr 172.21.15.115:0/1137137266 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:10.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22659c700 1 --2- 172.21.15.115:0/1137137266 >> v2:172.21.15.159:3300/0 conn(0x7ff228150af0 0x7ff228150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:10.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188029233 0 0) 0x7ff22806a440 con 0x7ff2280c0e80 2023-07-27T14:29:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2100033f0 con 0x7ff2280c0e80 2023-07-27T14:29:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1281355159 0 0) 0x7ff2100033f0 con 0x7ff2280c0e80 2023-07-27T14:29:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 >> v2:172.21.15.159:3300/0 conn(0x7ff228150af0 msgr2=0x7ff228150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 --2- 172.21.15.115:0/1137137266 >> v2:172.21.15.159:3300/0 conn(0x7ff228150af0 0x7ff228150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 >> v1:172.21.15.159:6789/0 conn(0x7ff2280a5e40 legacy=0x7ff2280bc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22806a160 con 0x7ff2280c0e80 2023-07-27T14:29:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7ff21c001470 con 0x7ff2280c0e80 2023-07-27T14:29:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22659c700 1 --2- 172.21.15.115:0/1137137266 >> v2:172.21.15.159:3300/0 conn(0x7ff228150af0 0x7ff228150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 >> v1:172.21.15.115:6789/0 conn(0x7ff2280c0e80 legacy=0x7ff2280a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff210003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff210004690 0x7ff210004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff210005000 0x7ff21000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff228069e80 con 0x7ff2100038e0 2023-07-27T14:29:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21000beb0 con 0x7ff210004690 2023-07-27T14:29:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.005+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21000c070 con 0x7ff210005000 2023-07-27T14:29:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff22659c700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff210003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff225d9b700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff210004690 0x7ff210004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff226d9d700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff210005000 0x7ff21000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff22659c700 1 -- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff210005000 msgr2=0x7ff21000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff22659c700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff210005000 0x7ff21000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff22659c700 1 -- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff210004690 msgr2=0x7ff210004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff22659c700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff210004690 0x7ff210004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff22659c700 1 -- 172.21.15.115:0/1137137266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100033f0 con 0x7ff2100038e0 2023-07-27T14:29:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff225d9b700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff210004690 0x7ff210004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff226d9d700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff210005000 0x7ff21000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff226d9d700 1 -- 172.21.15.115:0/1137137266 reap_dead start 2023-07-27T14:29:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.006+0000 7ff22659c700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff210003cc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7ff218009c70 tx=0x7ff218009060).ready entity=mon.0 client_cookie=43e03956dc2922b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180095c0 con 0x7ff2100038e0 2023-07-27T14:29:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21800e6f0 con 0x7ff2100038e0 2023-07-27T14:29:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22559a700 1 -- 172.21.15.115:0/1137137266 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800ea70 con 0x7ff2100038e0 2023-07-27T14:29:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22c9ff700 1 -- 172.21.15.115:0/1137137266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 msgr2=0x7ff210003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22c9ff700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff210003cc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7ff218009c70 tx=0x7ff218009060).stop 2023-07-27T14:29:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22c9ff700 1 -- 172.21.15.115:0/1137137266 shutdown_connections 2023-07-27T14:29:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22c9ff700 1 --2- 172.21.15.115:0/1137137266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff210003cc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22c9ff700 1 -- 172.21.15.115:0/1137137266 >> 172.21.15.115:0/1137137266 conn(0x7ff228062320 msgr2=0x7ff228062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22c9ff700 1 -- 172.21.15.115:0/1137137266 shutdown_connections 2023-07-27T14:29:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.007+0000 7ff22c9ff700 1 -- 172.21.15.115:0/1137137266 wait complete. 2023-07-27T14:29:10.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.009+0000 7ff22c9ff700 1 Processor -- start 2023-07-27T14:29:10.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.009+0000 7ff22c9ff700 1 -- start start 2023-07-27T14:29:10.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22c9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff228159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:10.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22c9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2280bf340 0x7ff2280be250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:10.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22c9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2280c1660 0x7ff2280c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:10.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22c9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280bffe0 con 0x7ff2100038e0 2023-07-27T14:29:10.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22c9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280bddc0 con 0x7ff2280bf340 2023-07-27T14:29:10.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22c9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280bf7c0 con 0x7ff2280c1660 2023-07-27T14:29:10.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff228159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:10.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff228159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48048/0 (socket says 172.21.15.115:48048) 2023-07-27T14:29:10.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22659c700 1 -- 172.21.15.115:0/3173728705 learned_addr learned my addr 172.21.15.115:0/3173728705 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:10.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff225d9b700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2280bf340 0x7ff2280be250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:10.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff226d9d700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2280c1660 0x7ff2280c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:10.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22659c700 1 -- 172.21.15.115:0/3173728705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2280c1660 msgr2=0x7ff2280c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:10.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22659c700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2280c1660 0x7ff2280c1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:10.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22659c700 1 -- 172.21.15.115:0/3173728705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2280bf340 msgr2=0x7ff2280be250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:10.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22659c700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2280bf340 0x7ff2280be250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:10.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.010+0000 7ff22659c700 1 -- 172.21.15.115:0/3173728705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2280bfa20 con 0x7ff2100038e0 2023-07-27T14:29:10.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.011+0000 7ff22659c700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff228159620 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7ff21801cfb0 tx=0x7ff21801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:10.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.011+0000 7ff2167fc700 1 -- 172.21.15.115:0/3173728705 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800eeb0 con 0x7ff2100038e0 2023-07-27T14:29:10.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.011+0000 7ff2167fc700 1 -- 172.21.15.115:0/3173728705 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21800e860 con 0x7ff2100038e0 2023-07-27T14:29:10.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.011+0000 7ff2167fc700 1 -- 172.21.15.115:0/3173728705 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218025650 con 0x7ff2100038e0 2023-07-27T14:29:10.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.011+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2280bfd00 con 0x7ff2100038e0 2023-07-27T14:29:10.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.011+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2280be740 con 0x7ff2100038e0 2023-07-27T14:29:10.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.012+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2280be0a0 con 0x7ff2100038e0 2023-07-27T14:29:10.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.013+0000 7ff2167fc700 1 -- 172.21.15.115:0/3173728705 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7ff21802b020 con 0x7ff2100038e0 2023-07-27T14:29:10.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.014+0000 7ff2167fc700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20805ef20 0x7ff2080613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:10.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.014+0000 7ff2167fc700 1 -- 172.21.15.115:0/3173728705 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff21807b300 con 0x7ff2100038e0 2023-07-27T14:29:10.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.014+0000 7ff225d9b700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20805ef20 0x7ff2080613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:10.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.015+0000 7ff225d9b700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20805ef20 0x7ff2080613e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7ff21c007b70 tx=0x7ff21c001e70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:10.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.018+0000 7ff2167fc700 1 -- 172.21.15.115:0/3173728705 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff21804caf0 con 0x7ff2100038e0 2023-07-27T14:29:10.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:10.205+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff22806c470 con 0x7ff2100038e0 2023-07-27T14:29:11.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.075+0000 7ff2167fc700 1 -- 172.21.15.115:0/3173728705 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff218016080 con 0x7ff2100038e0 2023-07-27T14:29:11.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.077+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20805ef20 msgr2=0x7ff2080613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.077+0000 7ff22c9ff700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20805ef20 0x7ff2080613e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7ff21c007b70 tx=0x7ff21c001e70).stop 2023-07-27T14:29:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.077+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 msgr2=0x7ff228159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.077+0000 7ff22c9ff700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff228159620 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7ff21801cfb0 tx=0x7ff21801a000).stop 2023-07-27T14:29:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.078+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 shutdown_connections 2023-07-27T14:29:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.078+0000 7ff22c9ff700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20805ef20 0x7ff2080613e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.078+0000 7ff22c9ff700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2280c1660 0x7ff2280c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.078+0000 7ff22c9ff700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2100038e0 0x7ff228159620 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.078+0000 7ff22c9ff700 1 --2- 172.21.15.115:0/3173728705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2280bf340 0x7ff2280be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.078+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 >> 172.21.15.115:0/3173728705 conn(0x7ff228062320 msgr2=0x7ff2280c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.078+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 shutdown_connections 2023-07-27T14:29:11.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.078+0000 7ff22c9ff700 1 -- 172.21.15.115:0/3173728705 wait complete. 2023-07-27T14:29:11.104 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:29:11.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:29:11.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.287+0000 7fb37cfff700 1 Processor -- start 2023-07-27T14:29:11.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.287+0000 7fb37cfff700 1 -- start start 2023-07-27T14:29:11.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.289+0000 7fb37cfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3780aaa40 0x7fb3780640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.289+0000 7fb37cfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3780aa4d0 con 0x7fb378153ec0 2023-07-27T14:29:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.289+0000 7fb37cfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3780c05c0 con 0x7fb3781542a0 2023-07-27T14:29:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.289+0000 7fb37cfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3780aa270 con 0x7fb3780aaa40 2023-07-27T14:29:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.289+0000 7fb37659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb378153ec0 0x7fb3780a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56256/0 (socket says 172.21.15.115:56256) 2023-07-27T14:29:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.289+0000 7fb37659c700 1 -- 172.21.15.115:0/741401093 learned_addr learned my addr 172.21.15.115:0/741401093 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:11.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.289+0000 7fb375d9b700 1 --2- 172.21.15.115:0/741401093 >> v2:172.21.15.115:3300/0 conn(0x7fb3780aaa40 0x7fb3780640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb37559a700 1 -- 172.21.15.115:0/741401093 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034280610 0 0) 0x7fb368001110 con 0x7fb378153ec0 2023-07-27T14:29:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb37559a700 1 -- 172.21.15.115:0/741401093 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3600033f0 con 0x7fb378153ec0 2023-07-27T14:29:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb375d9b700 1 -- 172.21.15.115:0/741401093 >> v1:172.21.15.159:6789/0 conn(0x7fb3781542a0 legacy=0x7fb3780c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb375d9b700 1 -- 172.21.15.115:0/741401093 >> v1:172.21.15.115:6789/0 conn(0x7fb378153ec0 legacy=0x7fb3780a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb375d9b700 1 -- 172.21.15.115:0/741401093 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3780bfc90 con 0x7fb3780aaa40 2023-07-27T14:29:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb375d9b700 1 --2- 172.21.15.115:0/741401093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3780aaa40 0x7fb3780640f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fb36c009760 tx=0x7fb36c009060).ready entity=mon.0 client_cookie=646863817119b72c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:11.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb37559a700 1 -- 172.21.15.115:0/741401093 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0090d0 con 0x7fb3780aaa40 2023-07-27T14:29:11.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb37559a700 1 -- 172.21.15.115:0/741401093 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c00f510 con 0x7fb3780aaa40 2023-07-27T14:29:11.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.290+0000 7fb37559a700 1 -- 172.21.15.115:0/741401093 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00f890 con 0x7fb3780aaa40 2023-07-27T14:29:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.291+0000 7fb37cfff700 1 -- 172.21.15.115:0/741401093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3780aaa40 msgr2=0x7fb3780640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.291+0000 7fb37cfff700 1 --2- 172.21.15.115:0/741401093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3780aaa40 0x7fb3780640f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fb36c009760 tx=0x7fb36c009060).stop 2023-07-27T14:29:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.291+0000 7fb37cfff700 1 -- 172.21.15.115:0/741401093 shutdown_connections 2023-07-27T14:29:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.291+0000 7fb37cfff700 1 --2- 172.21.15.115:0/741401093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3780aaa40 0x7fb3780640f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.291+0000 7fb37cfff700 1 -- 172.21.15.115:0/741401093 >> 172.21.15.115:0/741401093 conn(0x7fb3780cb610 msgr2=0x7fb3780c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.291+0000 7fb37cfff700 1 -- 172.21.15.115:0/741401093 shutdown_connections 2023-07-27T14:29:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.291+0000 7fb37cfff700 1 -- 172.21.15.115:0/741401093 wait complete. 2023-07-27T14:29:11.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.293+0000 7fb37cfff700 1 Processor -- start 2023-07-27T14:29:11.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.293+0000 7fb37cfff700 1 -- start start 2023-07-27T14:29:11.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.294+0000 7fb37cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3780aaa40 0x7fb378168f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.294+0000 7fb37cfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb378153ec0 0x7fb3780adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.294+0000 7fb37cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3781542a0 0x7fb378151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.294+0000 7fb37cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb378169430 con 0x7fb3781542a0 2023-07-27T14:29:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.294+0000 7fb37cfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780ae030 con 0x7fb378153ec0 2023-07-27T14:29:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.294+0000 7fb37cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780aee50 con 0x7fb3780aaa40 2023-07-27T14:29:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3781542a0 0x7fb378151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3781542a0 0x7fb378151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48056/0 (socket says 172.21.15.115:48056) 2023-07-27T14:29:11.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 -- 172.21.15.115:0/2616457271 learned_addr learned my addr 172.21.15.115:0/2616457271 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb37659c700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3780aaa40 0x7fb378168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb375d9b700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb378153ec0 0x7fb3780adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 -- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3780aaa40 msgr2=0x7fb378168f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3780aaa40 0x7fb378168f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 -- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb378153ec0 msgr2=0x7fb3780adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb378153ec0 0x7fb3780adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 -- 172.21.15.115:0/2616457271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c0092a0 con 0x7fb3781542a0 2023-07-27T14:29:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb37659c700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3780aaa40 0x7fb378168f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb375d9b700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb378153ec0 0x7fb3780adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.295+0000 7fb376d9d700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3781542a0 0x7fb378151750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb37000b810 tx=0x7fb370009250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.296+0000 7fb3667fc700 1 -- 172.21.15.115:0/2616457271 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000d580 con 0x7fb3781542a0 2023-07-27T14:29:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.296+0000 7fb3667fc700 1 -- 172.21.15.115:0/2616457271 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37000d720 con 0x7fb3781542a0 2023-07-27T14:29:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.296+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3780ae240 con 0x7fb3781542a0 2023-07-27T14:29:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.296+0000 7fb3667fc700 1 -- 172.21.15.115:0/2616457271 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000dae0 con 0x7fb3781542a0 2023-07-27T14:29:11.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.296+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3780ae800 con 0x7fb3781542a0 2023-07-27T14:29:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.297+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37806c470 con 0x7fb3781542a0 2023-07-27T14:29:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.298+0000 7fb3667fc700 1 -- 172.21.15.115:0/2616457271 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fb370010440 con 0x7fb3781542a0 2023-07-27T14:29:11.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.299+0000 7fb3667fc700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb35805eef0 0x7fb3580613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.299+0000 7fb3667fc700 1 -- 172.21.15.115:0/2616457271 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb370079ba0 con 0x7fb3781542a0 2023-07-27T14:29:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.299+0000 7fb37659c700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb35805eef0 0x7fb3580613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.300+0000 7fb37659c700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb35805eef0 0x7fb3580613b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb368007fd0 tx=0x7fb368009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:11.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.303+0000 7fb3667fc700 1 -- 172.21.15.115:0/2616457271 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb37004b250 con 0x7fb3781542a0 2023-07-27T14:29:11.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.534+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb378062540 con 0x7fb3781542a0 2023-07-27T14:29:11.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.535+0000 7fb3667fc700 1 -- 172.21.15.115:0/2616457271 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb370009350 con 0x7fb3781542a0 2023-07-27T14:29:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:11.559 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:29:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:29:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:29:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:29:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:29:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:29:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:29:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:29:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:29:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:29:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:29:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:29:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:29:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:29:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:29:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:29:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:29:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:29:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:29:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:29:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:29:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:29:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:29:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:29:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:29:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:29:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:29:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:29:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:29:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:29:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:29:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:29:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:29:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:29:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:29:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:29:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:29:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:29:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:29:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:29:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:29:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:29:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:29:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:29:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:29:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:29:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:29:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:29:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:29:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:29:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:29:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:29:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:29:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:29:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:29:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:29:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:29:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:29:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:29:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:29:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:29:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:29:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:29:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:29:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:29:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:29:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:29:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:29:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:29:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:29:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:29:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:29:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:29:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:29:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:29:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:29:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:29:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:29:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:29:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:29:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:29:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:29:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:29:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:29:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:29:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:29:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:29:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:29:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:29:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:29:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:29:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:29:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:29:11.583 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:29:11.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb35805eef0 msgr2=0x7fb3580613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb35805eef0 0x7fb3580613b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb368007fd0 tx=0x7fb368009040).stop 2023-07-27T14:29:11.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3781542a0 msgr2=0x7fb378151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3781542a0 0x7fb378151750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb37000b810 tx=0x7fb370009250).stop 2023-07-27T14:29:11.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 shutdown_connections 2023-07-27T14:29:11.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb35805eef0 0x7fb3580613b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3781542a0 0x7fb378151750 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3780aaa40 0x7fb378168f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 --2- 172.21.15.115:0/2616457271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb378153ec0 0x7fb3780adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.537+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 >> 172.21.15.115:0/2616457271 conn(0x7fb3780cb610 msgr2=0x7fb3780aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:11.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.538+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 shutdown_connections 2023-07-27T14:29:11.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.538+0000 7fb37cfff700 1 -- 172.21.15.115:0/2616457271 wait complete. 2023-07-27T14:29:11.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:29:11.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.751+0000 7fedb91ff700 1 Processor -- start 2023-07-27T14:29:11.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.751+0000 7fedb91ff700 1 -- start start 2023-07-27T14:29:11.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.752+0000 7fedb91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb4153ec0 0x7fedb40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.753+0000 7fedb91ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fedb40aaa40 0x7fedb40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.753+0000 7fedb91ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb40aa4d0 con 0x7fedb40aa050 2023-07-27T14:29:11.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.753+0000 7fedb91ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb40c05c0 con 0x7fedb40aaa40 2023-07-27T14:29:11.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.753+0000 7fedb91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40bfc90 con 0x7fedb4153ec0 2023-07-27T14:29:11.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.753+0000 7fedb359e700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fedb40aaa40 0x7fedb40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.753+0000 7fedb2d9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb4153ec0 0x7fedb40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.753+0000 7fedb259c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fedb40aa050 0x7fedb40640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:37686/0 (socket says 172.21.15.115:37686) 2023-07-27T14:29:11.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.753+0000 7fedb259c700 1 -- 172.21.15.115:0/4046519385 learned_addr learned my addr 172.21.15.115:0/4046519385 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:11.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.754+0000 7fedb359e700 1 -- 172.21.15.115:0/4046519385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb4153ec0 msgr2=0x7fedb40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:11.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.754+0000 7fedb359e700 1 --2- 172.21.15.115:0/4046519385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb4153ec0 0x7fedb40a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.754+0000 7fedb359e700 1 -- 172.21.15.115:0/4046519385 >> v1:172.21.15.159:6789/0 conn(0x7fedb40aa050 legacy=0x7fedb40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.754+0000 7fedb359e700 1 -- 172.21.15.115:0/4046519385 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40bff70 con 0x7fedb40aaa40 2023-07-27T14:29:11.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.754+0000 7fedb2d9d700 1 --2- 172.21.15.115:0/4046519385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb4153ec0 0x7fedb40a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:11.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.754+0000 7fedb1d9b700 1 -- 172.21.15.115:0/4046519385 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015287310 0 0) 0x7feda8001110 con 0x7fedb40aa050 2023-07-27T14:29:11.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.754+0000 7fedb359e700 1 --2- 172.21.15.115:0/4046519385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb40aaa40 0x7fedb40c0a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fedac009e60 tx=0x7fedac009780).ready entity=mon.1 client_cookie=4673455cd9d1b119 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:11.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.754+0000 7fedb1d9b700 1 -- 172.21.15.115:0/4046519385 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00e070 con 0x7fedb40aaa40 2023-07-27T14:29:11.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb1d9b700 1 -- 172.21.15.115:0/4046519385 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00bb60 con 0x7fedb40aaa40 2023-07-27T14:29:11.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb1d9b700 1 -- 172.21.15.115:0/4046519385 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac012410 con 0x7fedb40aaa40 2023-07-27T14:29:11.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb91ff700 1 -- 172.21.15.115:0/4046519385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb40aaa40 msgr2=0x7fedb40c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb91ff700 1 --2- 172.21.15.115:0/4046519385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb40aaa40 0x7fedb40c0a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fedac009e60 tx=0x7fedac009780).stop 2023-07-27T14:29:11.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb91ff700 1 -- 172.21.15.115:0/4046519385 shutdown_connections 2023-07-27T14:29:11.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb91ff700 1 --2- 172.21.15.115:0/4046519385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb40aaa40 0x7fedb40c0a50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb91ff700 1 --2- 172.21.15.115:0/4046519385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb4153ec0 0x7fedb40a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb91ff700 1 -- 172.21.15.115:0/4046519385 >> 172.21.15.115:0/4046519385 conn(0x7fedb40cb610 msgr2=0x7fedb40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:11.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb91ff700 1 -- 172.21.15.115:0/4046519385 shutdown_connections 2023-07-27T14:29:11.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.755+0000 7fedb91ff700 1 -- 172.21.15.115:0/4046519385 wait complete. 2023-07-27T14:29:11.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.757+0000 7fedb91ff700 1 Processor -- start 2023-07-27T14:29:11.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.757+0000 7fedb91ff700 1 -- start start 2023-07-27T14:29:11.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb91ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb40aa050 0x7fedb414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb40aaa40 0x7fedb40aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb91ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb4153ec0 0x7fedb4150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb91ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb41520c0 con 0x7fedb40aa050 2023-07-27T14:29:11.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb91ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb414f0c0 con 0x7fedb4153ec0 2023-07-27T14:29:11.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40adc70 con 0x7fedb40aaa40 2023-07-27T14:29:11.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb40aa050 0x7fedb414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb40aa050 0x7fedb414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48068/0 (socket says 172.21.15.115:48068) 2023-07-27T14:29:11.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb2d9d700 1 -- 172.21.15.115:0/2968113286 learned_addr learned my addr 172.21.15.115:0/2968113286 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:11.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb259c700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb40aaa40 0x7fedb40aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb2d9d700 1 -- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb40aaa40 msgr2=0x7fedb40aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb359e700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb4153ec0 0x7fedb4150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb2d9d700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb40aaa40 0x7fedb40aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb2d9d700 1 -- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb4153ec0 msgr2=0x7fedb4150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb2d9d700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb4153ec0 0x7fedb4150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb2d9d700 1 -- 172.21.15.115:0/2968113286 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40092a0 con 0x7fedb40aa050 2023-07-27T14:29:11.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb359e700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb4153ec0 0x7fedb4150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:11.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.758+0000 7fedb259c700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb40aaa40 0x7fedb40aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:11.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.759+0000 7fedb2d9d700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb40aa050 0x7fedb414ebd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7feda400e980 tx=0x7feda4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:11.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.759+0000 7fed9affd700 1 -- 172.21.15.115:0/2968113286 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda400c850 con 0x7fedb40aa050 2023-07-27T14:29:11.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.759+0000 7fed9affd700 1 -- 172.21.15.115:0/2968113286 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda400c9b0 con 0x7fedb40aa050 2023-07-27T14:29:11.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.759+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac009a20 con 0x7fedb40aa050 2023-07-27T14:29:11.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.759+0000 7fed9affd700 1 -- 172.21.15.115:0/2968113286 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda400cd30 con 0x7fedb40aa050 2023-07-27T14:29:11.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.759+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb40ae230 con 0x7fedb40aa050 2023-07-27T14:29:11.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.760+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb40a9e90 con 0x7fedb40aa050 2023-07-27T14:29:11.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.761+0000 7fed9affd700 1 -- 172.21.15.115:0/2968113286 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7feda4022070 con 0x7fedb40aa050 2023-07-27T14:29:11.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.762+0000 7fed9affd700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feda005eec0 0x7feda0061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:11.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.762+0000 7fed9affd700 1 -- 172.21.15.115:0/2968113286 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7feda4079f90 con 0x7fedb40aa050 2023-07-27T14:29:11.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.762+0000 7fedb259c700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feda005eec0 0x7feda0061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:11.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.762+0000 7fedb259c700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feda005eec0 0x7feda0061380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fedb40af890 tx=0x7feda8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:11.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.766+0000 7fed9affd700 1 -- 172.21.15.115:0/2968113286 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feda404b610 con 0x7fedb40aa050 2023-07-27T14:29:11.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.934+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedb40aeb60 con 0x7fedb40aa050 2023-07-27T14:29:11.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.935+0000 7fed9affd700 1 -- 172.21.15.115:0/2968113286 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+13856 (secure 0 0 0) 0x7feda404ec30 con 0x7fedb40aa050 2023-07-27T14:29:11.959 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:11.959 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":48,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:29:11.070508+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:29:11.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feda005eec0 msgr2=0x7feda0061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feda005eec0 0x7feda0061380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fedb40af890 tx=0x7feda8009040).stop 2023-07-27T14:29:11.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb40aa050 msgr2=0x7fedb414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:11.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb40aa050 0x7fedb414ebd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7feda400e980 tx=0x7feda4009060).stop 2023-07-27T14:29:11.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 shutdown_connections 2023-07-27T14:29:11.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feda005eec0 0x7feda0061380 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb4153ec0 0x7fedb4150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb40aa050 0x7fedb414ebd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 --2- 172.21.15.115:0/2968113286 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb40aaa40 0x7fedb40aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:11.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 >> 172.21.15.115:0/2968113286 conn(0x7fedb40cb610 msgr2=0x7fedb40ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:11.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 shutdown_connections 2023-07-27T14:29:11.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:11.937+0000 7fedb91ff700 1 -- 172.21.15.115:0/2968113286 wait complete. 2023-07-27T14:29:11.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:29:11.978 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:29:12.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.145+0000 7f5c521ff700 1 Processor -- start 2023-07-27T14:29:12.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.146+0000 7f5c521ff700 1 -- start start 2023-07-27T14:29:12.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c521ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c063260 0x7f5c4c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c521ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5c4c14b1e0 0x7f5c4c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c521ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c1553f0 con 0x7f5c4c14ae00 2023-07-27T14:29:12.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c521ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c157a50 con 0x7f5c4c14b1e0 2023-07-27T14:29:12.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c521ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c157d10 con 0x7f5c4c063260 2023-07-27T14:29:12.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c4b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5c4c14ae00 0x7f5c4c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56272/0 (socket says 172.21.15.115:56272) 2023-07-27T14:29:12.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c4b7fe700 1 -- 172.21.15.115:0/3909636483 learned_addr learned my addr 172.21.15.115:0/3909636483 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:12.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c4bfff700 1 --2- 172.21.15.115:0/3909636483 >> v2:172.21.15.115:3300/0 conn(0x7f5c4c14b1e0 0x7f5c4c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c4affd700 1 --2- 172.21.15.115:0/3909636483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c063260 0x7f5c4c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.147+0000 7f5c4a7fc700 1 -- 172.21.15.115:0/3909636483 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760789025 0 0) 0x7f5c4c1553f0 con 0x7f5c4c14ae00 2023-07-27T14:29:12.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4a7fc700 1 -- 172.21.15.115:0/3909636483 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c340033f0 con 0x7f5c4c14ae00 2023-07-27T14:29:12.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4bfff700 1 -- 172.21.15.115:0/3909636483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c063260 msgr2=0x7f5c4c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:12.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4bfff700 1 --2- 172.21.15.115:0/3909636483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c063260 0x7f5c4c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4bfff700 1 -- 172.21.15.115:0/3909636483 >> v1:172.21.15.115:6789/0 conn(0x7f5c4c14ae00 legacy=0x7f5c4c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4bfff700 1 -- 172.21.15.115:0/3909636483 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c157ff0 con 0x7f5c4c14b1e0 2023-07-27T14:29:12.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4bfff700 1 --2- 172.21.15.115:0/3909636483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c14b1e0 0x7f5c4c0a98c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f5c44009e60 tx=0x7f5c44009780).ready entity=mon.0 client_cookie=f397f27d2b05db22 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:12.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4a7fc700 1 -- 172.21.15.115:0/3909636483 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400e070 con 0x7f5c4c14b1e0 2023-07-27T14:29:12.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4a7fc700 1 -- 172.21.15.115:0/3909636483 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400bab0 con 0x7f5c4c14b1e0 2023-07-27T14:29:12.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.148+0000 7f5c4a7fc700 1 -- 172.21.15.115:0/3909636483 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400be30 con 0x7f5c4c14b1e0 2023-07-27T14:29:12.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.149+0000 7f5c521ff700 1 -- 172.21.15.115:0/3909636483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c14b1e0 msgr2=0x7f5c4c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.149+0000 7f5c521ff700 1 --2- 172.21.15.115:0/3909636483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c14b1e0 0x7f5c4c0a98c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f5c44009e60 tx=0x7f5c44009780).stop 2023-07-27T14:29:12.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.149+0000 7f5c521ff700 1 -- 172.21.15.115:0/3909636483 shutdown_connections 2023-07-27T14:29:12.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.149+0000 7f5c521ff700 1 --2- 172.21.15.115:0/3909636483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c14b1e0 0x7f5c4c0a98c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.149+0000 7f5c521ff700 1 --2- 172.21.15.115:0/3909636483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c063260 0x7f5c4c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.149+0000 7f5c521ff700 1 -- 172.21.15.115:0/3909636483 >> 172.21.15.115:0/3909636483 conn(0x7f5c4c05e940 msgr2=0x7f5c4c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:12.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.149+0000 7f5c521ff700 1 -- 172.21.15.115:0/3909636483 shutdown_connections 2023-07-27T14:29:12.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.149+0000 7f5c521ff700 1 -- 172.21.15.115:0/3909636483 wait complete. 2023-07-27T14:29:12.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.150+0000 7f5c521ff700 1 Processor -- start 2023-07-27T14:29:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.150+0000 7f5c521ff700 1 -- start start 2023-07-27T14:29:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.151+0000 7f5c521ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c063260 0x7f5c4c14a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.151+0000 7f5c521ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c14ae00 0x7f5c4c0ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.151+0000 7f5c521ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c4c14b1e0 0x7f5c4c0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.151+0000 7f5c521ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c2890 con 0x7f5c4c063260 2023-07-27T14:29:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.151+0000 7f5c521ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0b0320 con 0x7f5c4c14b1e0 2023-07-27T14:29:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.151+0000 7f5c521ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0b0600 con 0x7f5c4c14ae00 2023-07-27T14:29:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.151+0000 7f5c4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c063260 0x7f5c4c14a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.151+0000 7f5c4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c063260 0x7f5c4c14a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48088/0 (socket says 172.21.15.115:48088) 2023-07-27T14:29:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4b7fe700 1 -- 172.21.15.115:0/768431869 learned_addr learned my addr 172.21.15.115:0/768431869 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4affd700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c14ae00 0x7f5c4c0ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4bfff700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c4c14b1e0 0x7f5c4c0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4b7fe700 1 -- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c14ae00 msgr2=0x7f5c4c0ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4b7fe700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c14ae00 0x7f5c4c0ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4b7fe700 1 -- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c4c14b1e0 msgr2=0x7f5c4c0af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4b7fe700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c4c14b1e0 0x7f5c4c0af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4b7fe700 1 -- 172.21.15.115:0/768431869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009a20 con 0x7f5c4c063260 2023-07-27T14:29:12.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4affd700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c14ae00 0x7f5c4c0ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:12.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4bfff700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c4c14b1e0 0x7f5c4c0af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:12.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c4b7fe700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c063260 0x7f5c4c14a890 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f5c3c00c590 tx=0x7f5c3c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:12.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c337fe700 1 -- 172.21.15.115:0/768431869 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c007e40 con 0x7f5c4c063260 2023-07-27T14:29:12.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c337fe700 1 -- 172.21.15.115:0/768431869 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c0072e0 con 0x7f5c4c063260 2023-07-27T14:29:12.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0b08e0 con 0x7f5c4c063260 2023-07-27T14:29:12.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c337fe700 1 -- 172.21.15.115:0/768431869 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0057a0 con 0x7f5c4c063260 2023-07-27T14:29:12.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.152+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c0b0bc0 con 0x7f5c4c063260 2023-07-27T14:29:12.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.153+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c0ad3f0 con 0x7f5c4c063260 2023-07-27T14:29:12.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.154+0000 7f5c337fe700 1 -- 172.21.15.115:0/768431869 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f5c3c01a060 con 0x7f5c4c063260 2023-07-27T14:29:12.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.155+0000 7f5c337fe700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5c3805eef0 0x7f5c380613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.155+0000 7f5c337fe700 1 -- 172.21.15.115:0/768431869 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5c3c078e80 con 0x7f5c4c063260 2023-07-27T14:29:12.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.155+0000 7f5c4affd700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5c3805eef0 0x7f5c380613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.156+0000 7f5c4affd700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5c3805eef0 0x7f5c380613b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f5c40006d80 tx=0x7f5c40008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:12.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.159+0000 7f5c337fe700 1 -- 172.21.15.115:0/768431869 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c3c04a610 con 0x7f5c4c063260 2023-07-27T14:29:12.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.327+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5c4c06c470 con 0x7f5c4c063260 2023-07-27T14:29:12.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.328+0000 7f5c337fe700 1 -- 172.21.15.115:0/768431869 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v48) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5c3c018070 con 0x7f5c4c063260 2023-07-27T14:29:12.351 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:29:12.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.329+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5c3805eef0 msgr2=0x7f5c380613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.329+0000 7f5c521ff700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5c3805eef0 0x7f5c380613b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f5c40006d80 tx=0x7f5c40008040).stop 2023-07-27T14:29:12.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c063260 msgr2=0x7f5c4c14a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c063260 0x7f5c4c14a890 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f5c3c00c590 tx=0x7f5c3c007c80).stop 2023-07-27T14:29:12.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 shutdown_connections 2023-07-27T14:29:12.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5c3805eef0 0x7f5c380613b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c4c14b1e0 0x7f5c4c0af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c4c063260 0x7f5c4c14a890 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 --2- 172.21.15.115:0/768431869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5c4c14ae00 0x7f5c4c0ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 >> 172.21.15.115:0/768431869 conn(0x7f5c4c05e940 msgr2=0x7f5c4c0c7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:12.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 shutdown_connections 2023-07-27T14:29:12.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.330+0000 7f5c521ff700 1 -- 172.21.15.115:0/768431869 wait complete. 2023-07-27T14:29:12.370 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:29:12.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.537+0000 7f55481ff700 1 Processor -- start 2023-07-27T14:29:12.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.537+0000 7f55481ff700 1 -- start start 2023-07-27T14:29:12.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.538+0000 7f55481ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5540153f30 0x7f55400a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.538+0000 7f55481ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400c0610 0x7f55400c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.538+0000 7f55481ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55400c60a0 con 0x7f55400bfb50 2023-07-27T14:29:12.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.538+0000 7f55481ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55400c0f90 con 0x7f5540153f30 2023-07-27T14:29:12.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.538+0000 7f55481ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55400c5d70 con 0x7f55400c0610 2023-07-27T14:29:12.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.538+0000 7f5545f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5540153f30 0x7f55400a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.538+0000 7f5545f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5540153f30 0x7f55400a7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48096/0 (socket says 172.21.15.115:48096) 2023-07-27T14:29:12.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.538+0000 7f5545f9b700 1 -- 172.21.15.115:0/4112807406 learned_addr learned my addr 172.21.15.115:0/4112807406 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f554679c700 1 --2- 172.21.15.115:0/4112807406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400c0610 0x7f55400c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5545f9b700 1 -- 172.21.15.115:0/4112807406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400c0610 msgr2=0x7f55400c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5545f9b700 1 --2- 172.21.15.115:0/4112807406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400c0610 0x7f55400c0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5545f9b700 1 -- 172.21.15.115:0/4112807406 >> v1:172.21.15.115:6789/0 conn(0x7f55400bfb50 legacy=0x7f55400c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5544f99700 1 -- 172.21.15.115:0/4112807406 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676229187 0 0) 0x7f55400c60a0 con 0x7f55400bfb50 2023-07-27T14:29:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5545f9b700 1 -- 172.21.15.115:0/4112807406 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55400a7e30 con 0x7f5540153f30 2023-07-27T14:29:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5545f9b700 1 --2- 172.21.15.115:0/4112807406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400a7940 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f553c006fd0 tx=0x7f553c0090f0).ready entity=mon.0 client_cookie=84511c4e40f06bd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5544f99700 1 -- 172.21.15.115:0/4112807406 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00b600 con 0x7f5540153f30 2023-07-27T14:29:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5544f99700 1 -- 172.21.15.115:0/4112807406 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c00b760 con 0x7f5540153f30 2023-07-27T14:29:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.539+0000 7f5544f99700 1 -- 172.21.15.115:0/4112807406 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00bae0 con 0x7f5540153f30 2023-07-27T14:29:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.540+0000 7f55481ff700 1 -- 172.21.15.115:0/4112807406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 msgr2=0x7f55400a7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.540+0000 7f55481ff700 1 --2- 172.21.15.115:0/4112807406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400a7940 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f553c006fd0 tx=0x7f553c0090f0).stop 2023-07-27T14:29:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.540+0000 7f55481ff700 1 -- 172.21.15.115:0/4112807406 shutdown_connections 2023-07-27T14:29:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.540+0000 7f55481ff700 1 --2- 172.21.15.115:0/4112807406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400c0610 0x7f55400c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.540+0000 7f55481ff700 1 --2- 172.21.15.115:0/4112807406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400a7940 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.540+0000 7f55481ff700 1 -- 172.21.15.115:0/4112807406 >> 172.21.15.115:0/4112807406 conn(0x7f5540094280 msgr2=0x7f554005e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.540+0000 7f55481ff700 1 -- 172.21.15.115:0/4112807406 shutdown_connections 2023-07-27T14:29:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.540+0000 7f55481ff700 1 -- 172.21.15.115:0/4112807406 wait complete. 2023-07-27T14:29:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.541+0000 7f55481ff700 1 Processor -- start 2023-07-27T14:29:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.541+0000 7f55481ff700 1 -- start start 2023-07-27T14:29:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.542+0000 7f55481ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400bfb50 0x7f554014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.542+0000 7f55481ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55400c0610 0x7f55400af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.542+0000 7f55481ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.542+0000 7f55481ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55400affd0 con 0x7f5540153f30 2023-07-27T14:29:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.542+0000 7f55481ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554015a0d0 con 0x7f55400c0610 2023-07-27T14:29:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.542+0000 7f55481ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55400b01b0 con 0x7f55400bfb50 2023-07-27T14:29:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48106/0 (socket says 172.21.15.115:48106) 2023-07-27T14:29:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 -- 172.21.15.115:0/4015650267 learned_addr learned my addr 172.21.15.115:0/4015650267 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f5545f9b700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400bfb50 0x7f554014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554579a700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55400c0610 0x7f55400af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 -- 172.21.15.115:0/4015650267 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400bfb50 msgr2=0x7f554014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400bfb50 0x7f554014fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 -- 172.21.15.115:0/4015650267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55400c0610 msgr2=0x7f55400af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55400c0610 0x7f55400af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 -- 172.21.15.115:0/4015650267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c009370 con 0x7f5540153f30 2023-07-27T14:29:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f554679c700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400afae0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f5538009fa0 tx=0x7f5538009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.543+0000 7f5535ffb700 1 -- 172.21.15.115:0/4015650267 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553800ebc0 con 0x7f5540153f30 2023-07-27T14:29:12.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.544+0000 7f5535ffb700 1 -- 172.21.15.115:0/4015650267 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553800ed20 con 0x7f5540153f30 2023-07-27T14:29:12.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.544+0000 7f5535ffb700 1 -- 172.21.15.115:0/4015650267 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538014610 con 0x7f5540153f30 2023-07-27T14:29:12.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.544+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55400b0490 con 0x7f5540153f30 2023-07-27T14:29:12.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.544+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55400b0a50 con 0x7f5540153f30 2023-07-27T14:29:12.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.545+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55400aa790 con 0x7f5540153f30 2023-07-27T14:29:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.546+0000 7f5535ffb700 1 -- 172.21.15.115:0/4015650267 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f553801b030 con 0x7f5540153f30 2023-07-27T14:29:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.546+0000 7f5535ffb700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405eef0 0x7f55240613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.547+0000 7f5535ffb700 1 -- 172.21.15.115:0/4015650267 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5538079e60 con 0x7f5540153f30 2023-07-27T14:29:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.547+0000 7f5545f9b700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405eef0 0x7f55240613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.547+0000 7f5545f9b700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405eef0 0x7f55240613b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f553c009130 tx=0x7f553c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:12.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.550+0000 7f5535ffb700 1 -- 172.21.15.115:0/4015650267 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f553804b480 con 0x7f5540153f30 2023-07-27T14:29:12.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.720+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f554006c470 con 0x7f5540153f30 2023-07-27T14:29:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.720+0000 7f5535ffb700 1 -- 172.21.15.115:0/4015650267 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7f553804eaa0 con 0x7f5540153f30 2023-07-27T14:29:12.744 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:29:12.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405eef0 msgr2=0x7f55240613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405eef0 0x7f55240613b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f553c009130 tx=0x7f553c017000).stop 2023-07-27T14:29:12.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 msgr2=0x7f55400afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400afae0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f5538009fa0 tx=0x7f5538009900).stop 2023-07-27T14:29:12.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 shutdown_connections 2023-07-27T14:29:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405eef0 0x7f55240613b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5540153f30 0x7f55400afae0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55400bfb50 0x7f554014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 --2- 172.21.15.115:0/4015650267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55400c0610 0x7f55400af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.722+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 >> 172.21.15.115:0/4015650267 conn(0x7f5540094280 msgr2=0x7f55400c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.723+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 shutdown_connections 2023-07-27T14:29:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.723+0000 7f55481ff700 1 -- 172.21.15.115:0/4015650267 wait complete. 2023-07-27T14:29:12.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:29:12.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.927+0000 7f2f58bff700 1 Processor -- start 2023-07-27T14:29:12.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.927+0000 7f2f58bff700 1 -- start start 2023-07-27T14:29:12.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.928+0000 7f2f58bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2f54150af0 0x7f2f54150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.928+0000 7f2f58bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2f540c0e80 0x7f2f540c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:12.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.928+0000 7f2f58bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5406a440 con 0x7f2f540696f0 2023-07-27T14:29:12.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.928+0000 7f2f58bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f540bbc80 con 0x7f2f540c0e80 2023-07-27T14:29:12.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.928+0000 7f2f58bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f54069e80 con 0x7f2f54150af0 2023-07-27T14:29:12.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.928+0000 7f2f51d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2f540c0e80 0x7f2f540c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f51d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2f540c0e80 0x7f2f540c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48114/0 (socket says 172.21.15.115:48114) 2023-07-27T14:29:12.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f51d9b700 1 -- 172.21.15.115:0/3540997154 learned_addr learned my addr 172.21.15.115:0/3540997154 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:12.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f5259c700 1 --2- 172.21.15.115:0/3540997154 >> v2:172.21.15.159:3300/0 conn(0x7f2f54150af0 0x7f2f54150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:12.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f51d9b700 1 -- 172.21.15.115:0/3540997154 >> v2:172.21.15.159:3300/0 conn(0x7f2f54150af0 msgr2=0x7f2f54150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:12.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f51d9b700 1 --2- 172.21.15.115:0/3540997154 >> v2:172.21.15.159:3300/0 conn(0x7f2f54150af0 0x7f2f54150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f51d9b700 1 -- 172.21.15.115:0/3540997154 >> v1:172.21.15.115:6789/0 conn(0x7f2f540696f0 legacy=0x7f2f540a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f51d9b700 1 -- 172.21.15.115:0/3540997154 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5406a160 con 0x7f2f540c0e80 2023-07-27T14:29:12.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f51d9b700 1 --2- 172.21.15.115:0/3540997154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540c0e80 0x7f2f540c3960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f2f540a95d0 tx=0x7f2f480090f0).ready entity=mon.0 client_cookie=91dfdd1fb8dfac6d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:12.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f5159a700 1 -- 172.21.15.115:0/3540997154 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800f6b0 con 0x7f2f540c0e80 2023-07-27T14:29:12.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f5159a700 1 -- 172.21.15.115:0/3540997154 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4800f810 con 0x7f2f540c0e80 2023-07-27T14:29:12.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.929+0000 7f2f5159a700 1 -- 172.21.15.115:0/3540997154 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800fb90 con 0x7f2f540c0e80 2023-07-27T14:29:12.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.930+0000 7f2f58bff700 1 -- 172.21.15.115:0/3540997154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540c0e80 msgr2=0x7f2f540c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:12.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.930+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3540997154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540c0e80 0x7f2f540c3960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f2f540a95d0 tx=0x7f2f480090f0).stop 2023-07-27T14:29:12.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.930+0000 7f2f58bff700 1 -- 172.21.15.115:0/3540997154 shutdown_connections 2023-07-27T14:29:12.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.930+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3540997154 >> v2:172.21.15.159:3300/0 conn(0x7f2f54150af0 0x7f2f54150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.930+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3540997154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540c0e80 0x7f2f540c3960 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.930+0000 7f2f58bff700 1 -- 172.21.15.115:0/3540997154 >> 172.21.15.115:0/3540997154 conn(0x7f2f54062320 msgr2=0x7f2f54062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.930+0000 7f2f58bff700 1 -- 172.21.15.115:0/3540997154 shutdown_connections 2023-07-27T14:29:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.930+0000 7f2f58bff700 1 -- 172.21.15.115:0/3540997154 wait complete. 2023-07-27T14:29:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.931+0000 7f2f58bff700 1 Processor -- start 2023-07-27T14:29:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.932+0000 7f2f58bff700 1 -- start start 2023-07-27T14:29:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.932+0000 7f2f58bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540696f0 0x7f2f540a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f58bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f540c0e80 0x7f2f54151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f58bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2f54150af0 0x7f2f54152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f58bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5414dbb0 con 0x7f2f540696f0 2023-07-27T14:29:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f58bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f540a9420 con 0x7f2f540c0e80 2023-07-27T14:29:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f58bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5414cfe0 con 0x7f2f54150af0 2023-07-27T14:29:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540696f0 0x7f2f540a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540696f0 0x7f2f540a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48128/0 (socket says 172.21.15.115:48128) 2023-07-27T14:29:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 -- 172.21.15.115:0/3632603622 learned_addr learned my addr 172.21.15.115:0/3632603622 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f51d9b700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f540c0e80 0x7f2f54151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f52d9d700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2f54150af0 0x7f2f54152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 -- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2f54150af0 msgr2=0x7f2f54152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2f54150af0 0x7f2f54152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 -- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f540c0e80 msgr2=0x7f2f54151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f540c0e80 0x7f2f54151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 -- 172.21.15.115:0/3632603622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f48009370 con 0x7f2f540696f0 2023-07-27T14:29:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f52d9d700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2f54150af0 0x7f2f54152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.933+0000 7f2f5259c700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540696f0 0x7f2f540a8f30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f2f4400d890 tx=0x7f2f44008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.934+0000 7f2f427fc700 1 -- 172.21.15.115:0/3632603622 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44011590 con 0x7f2f540696f0 2023-07-27T14:29:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.934+0000 7f2f427fc700 1 -- 172.21.15.115:0/3632603622 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f440116f0 con 0x7f2f540696f0 2023-07-27T14:29:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.934+0000 7f2f427fc700 1 -- 172.21.15.115:0/3632603622 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44011a70 con 0x7f2f540696f0 2023-07-27T14:29:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.934+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5414d280 con 0x7f2f540696f0 2023-07-27T14:29:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.934+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5414d840 con 0x7f2f540696f0 2023-07-27T14:29:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.935+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5414de90 con 0x7f2f540696f0 2023-07-27T14:29:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.936+0000 7f2f427fc700 1 -- 172.21.15.115:0/3632603622 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f2f44012420 con 0x7f2f540696f0 2023-07-27T14:29:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.937+0000 7f2f427fc700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f3405eef0 0x7f2f340613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.937+0000 7f2f427fc700 1 -- 172.21.15.115:0/3632603622 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2f440795f0 con 0x7f2f540696f0 2023-07-27T14:29:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.937+0000 7f2f51d9b700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f3405eef0 0x7f2f340613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.937+0000 7f2f51d9b700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f3405eef0 0x7f2f340613b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2f540c1260 tx=0x7f2f48019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:12.940+0000 7f2f427fc700 1 -- 172.21.15.115:0/3632603622 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f4404ac10 con 0x7f2f540696f0 2023-07-27T14:29:13.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.108+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2f54063880 con 0x7f2f540696f0 2023-07-27T14:29:13.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.109+0000 7f2f427fc700 1 -- 172.21.15.115:0/3632603622 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2f44011e60 con 0x7f2f540696f0 2023-07-27T14:29:13.133 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:13.134 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:29:13.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:13.134 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:29:13.134 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:29:13.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:13.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:13.135 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:29:13.135 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:29:13.135 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:13.136 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:29:13.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f3405eef0 msgr2=0x7f2f340613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f3405eef0 0x7f2f340613b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2f540c1260 tx=0x7f2f48019000).stop 2023-07-27T14:29:13.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540696f0 msgr2=0x7f2f540a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540696f0 0x7f2f540a8f30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f2f4400d890 tx=0x7f2f44008040).stop 2023-07-27T14:29:13.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 shutdown_connections 2023-07-27T14:29:13.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f3405eef0 0x7f2f340613b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2f54150af0 0x7f2f54152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f540696f0 0x7f2f540a8f30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 --2- 172.21.15.115:0/3632603622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f540c0e80 0x7f2f54151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 >> 172.21.15.115:0/3632603622 conn(0x7f2f54062320 msgr2=0x7f2f540a4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:13.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 shutdown_connections 2023-07-27T14:29:13.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.111+0000 7f2f58bff700 1 -- 172.21.15.115:0/3632603622 wait complete. 2023-07-27T14:29:13.152 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:29:13.153 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:29:13.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.321+0000 7f0779bff700 1 Processor -- start 2023-07-27T14:29:13.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.322+0000 7f0779bff700 1 -- start start 2023-07-27T14:29:13.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.323+0000 7f0779bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f077414ae00 0x7f0774154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.323+0000 7f0779bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07741553f0 con 0x7f0774063260 2023-07-27T14:29:13.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.323+0000 7f0779bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0774157a50 con 0x7f077414b1e0 2023-07-27T14:29:13.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.323+0000 7f0779bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0774157d10 con 0x7f077414ae00 2023-07-27T14:29:13.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.323+0000 7f0773fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0774063260 0x7f07740a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56308/0 (socket says 172.21.15.115:56308) 2023-07-27T14:29:13.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.323+0000 7f0773fff700 1 -- 172.21.15.115:0/3241678452 learned_addr learned my addr 172.21.15.115:0/3241678452 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:13.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.323+0000 7f07737fe700 1 --2- 172.21.15.115:0/3241678452 >> v2:172.21.15.159:3300/0 conn(0x7f077414ae00 0x7f0774154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.323+0000 7f07727fc700 1 -- 172.21.15.115:0/3241678452 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222441220 0 0) 0x7f07741553f0 con 0x7f0774063260 2023-07-27T14:29:13.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07727fc700 1 -- 172.21.15.115:0/3241678452 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f075c0033f0 con 0x7f0774063260 2023-07-27T14:29:13.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07727fc700 1 -- 172.21.15.115:0/3241678452 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952857841 0 0) 0x7f0774157a50 con 0x7f077414b1e0 2023-07-27T14:29:13.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07727fc700 1 -- 172.21.15.115:0/3241678452 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07741553f0 con 0x7f077414b1e0 2023-07-27T14:29:13.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07737fe700 1 -- 172.21.15.115:0/3241678452 >> v1:172.21.15.159:6789/0 conn(0x7f077414b1e0 legacy=0x7f0774062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07737fe700 1 -- 172.21.15.115:0/3241678452 >> v1:172.21.15.115:6789/0 conn(0x7f0774063260 legacy=0x7f07740a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07737fe700 1 -- 172.21.15.115:0/3241678452 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774157ff0 con 0x7f077414ae00 2023-07-27T14:29:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07737fe700 1 --2- 172.21.15.115:0/3241678452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414ae00 0x7f0774154f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f0764009760 tx=0x7f0764009060).ready entity=mon.1 client_cookie=27e277d16ac78345 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07727fc700 1 -- 172.21.15.115:0/3241678452 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400d4a0 con 0x7f077414ae00 2023-07-27T14:29:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07727fc700 1 -- 172.21.15.115:0/3241678452 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400d600 con 0x7f077414ae00 2023-07-27T14:29:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.324+0000 7f07727fc700 1 -- 172.21.15.115:0/3241678452 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400d980 con 0x7f077414ae00 2023-07-27T14:29:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.325+0000 7f0779bff700 1 -- 172.21.15.115:0/3241678452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414ae00 msgr2=0x7f0774154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.325+0000 7f0779bff700 1 --2- 172.21.15.115:0/3241678452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414ae00 0x7f0774154f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f0764009760 tx=0x7f0764009060).stop 2023-07-27T14:29:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.325+0000 7f0779bff700 1 -- 172.21.15.115:0/3241678452 shutdown_connections 2023-07-27T14:29:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.325+0000 7f0779bff700 1 --2- 172.21.15.115:0/3241678452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414ae00 0x7f0774154f00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.325+0000 7f0779bff700 1 -- 172.21.15.115:0/3241678452 >> 172.21.15.115:0/3241678452 conn(0x7f077405e940 msgr2=0x7f07740cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.325+0000 7f0779bff700 1 -- 172.21.15.115:0/3241678452 shutdown_connections 2023-07-27T14:29:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.325+0000 7f0779bff700 1 -- 172.21.15.115:0/3241678452 wait complete. 2023-07-27T14:29:13.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.326+0000 7f0779bff700 1 Processor -- start 2023-07-27T14:29:13.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.327+0000 7f0779bff700 1 -- start start 2023-07-27T14:29:13.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.327+0000 7f0779bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0774063260 0x7f07740aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.327+0000 7f0779bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077414ae00 0x7f0774150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.327+0000 7f0779bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414b1e0 0x7f077414c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.327+0000 7f0779bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07741651d0 con 0x7f077414ae00 2023-07-27T14:29:13.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.327+0000 7f0779bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0774164650 con 0x7f077414b1e0 2023-07-27T14:29:13.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.327+0000 7f0779bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0774164930 con 0x7f0774063260 2023-07-27T14:29:13.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077414ae00 0x7f0774150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077414ae00 0x7f0774150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48132/0 (socket says 172.21.15.115:48132) 2023-07-27T14:29:13.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 -- 172.21.15.115:0/1904644693 learned_addr learned my addr 172.21.15.115:0/1904644693 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:13.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f07737fe700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0774063260 0x7f07740aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0773fff700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414b1e0 0x7f077414c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 -- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0774063260 msgr2=0x7f07740aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0774063260 0x7f07740aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 -- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414b1e0 msgr2=0x7f077414c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414b1e0 0x7f077414c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 -- 172.21.15.115:0/1904644693 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640092a0 con 0x7f077414ae00 2023-07-27T14:29:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0773fff700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414b1e0 0x7f077414c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0772ffd700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077414ae00 0x7f0774150d70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f076800c490 tx=0x7f0768007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f075b7fe700 1 -- 172.21.15.115:0/1904644693 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800f470 con 0x7f077414ae00 2023-07-27T14:29:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f075b7fe700 1 -- 172.21.15.115:0/1904644693 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076800f5d0 con 0x7f077414ae00 2023-07-27T14:29:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f075b7fe700 1 -- 172.21.15.115:0/1904644693 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800f990 con 0x7f077414ae00 2023-07-27T14:29:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.328+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0774164c10 con 0x7f077414ae00 2023-07-27T14:29:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.329+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07740af180 con 0x7f077414ae00 2023-07-27T14:29:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.330+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077406c470 con 0x7f077414ae00 2023-07-27T14:29:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.331+0000 7f075b7fe700 1 -- 172.21.15.115:0/1904644693 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f0768019030 con 0x7f077414ae00 2023-07-27T14:29:13.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.331+0000 7f075b7fe700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076005eef0 0x7f07600613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.331+0000 7f075b7fe700 1 -- 172.21.15.115:0/1904644693 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0768078f50 con 0x7f077414ae00 2023-07-27T14:29:13.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.332+0000 7f07737fe700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076005eef0 0x7f07600613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.332+0000 7f07737fe700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076005eef0 0x7f07600613b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f0764006d60 tx=0x7f0764016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:13.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.335+0000 7f075b7fe700 1 -- 172.21.15.115:0/1904644693 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f076804a6e0 con 0x7f077414ae00 2023-07-27T14:29:13.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.507+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f0774151de0 con 0x7f077414ae00 2023-07-27T14:29:13.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.685+0000 7f075b7fe700 1 -- 172.21.15.115:0/1904644693 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 152+0+0 (secure 0 0 0) 0x7f0768007d80 con 0x7f077414ae00 2023-07-27T14:29:13.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076005eef0 msgr2=0x7f07600613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076005eef0 0x7f07600613b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f0764006d60 tx=0x7f0764016000).stop 2023-07-27T14:29:13.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077414ae00 msgr2=0x7f0774150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077414ae00 0x7f0774150d70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f076800c490 tx=0x7f0768007c60).stop 2023-07-27T14:29:13.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 shutdown_connections 2023-07-27T14:29:13.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f076005eef0 0x7f07600613b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f077414b1e0 0x7f077414c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0774063260 0x7f07740aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 --2- 172.21.15.115:0/1904644693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f077414ae00 0x7f0774150d70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 >> 172.21.15.115:0/1904644693 conn(0x7f077405e940 msgr2=0x7f07740ac540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:13.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 shutdown_connections 2023-07-27T14:29:13.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.689+0000 7f0779bff700 1 -- 172.21.15.115:0/1904644693 wait complete. 2023-07-27T14:29:13.719 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:29:13.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:29:13.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.905+0000 7f442cbff700 1 Processor -- start 2023-07-27T14:29:13.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.905+0000 7f442cbff700 1 -- start start 2023-07-27T14:29:13.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f442cbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f442814ae00 0x7f4428154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f442cbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44281553f0 con 0x7f442814b1e0 2023-07-27T14:29:13.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f442cbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4428157a50 con 0x7f4428063260 2023-07-27T14:29:13.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f442cbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4428157d10 con 0x7f442814ae00 2023-07-27T14:29:13.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f4425d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f442814b1e0 0x7f4428062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54542/0 (socket says 172.21.15.115:54542) 2023-07-27T14:29:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f4425d9b700 1 -- 172.21.15.115:0/3011430208 learned_addr learned my addr 172.21.15.115:0/3011430208 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f442659c700 1 --2- 172.21.15.115:0/3011430208 >> v2:172.21.15.159:3300/0 conn(0x7f442814ae00 0x7f4428154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008844080 0 0) 0x7f44281553f0 con 0x7f442814b1e0 2023-07-27T14:29:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.907+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44100033f0 con 0x7f442814b1e0 2023-07-27T14:29:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090720255 0 0) 0x7f4428157a50 con 0x7f4428063260 2023-07-27T14:29:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44281553f0 con 0x7f4428063260 2023-07-27T14:29:13.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128752652 0 0) 0x7f44100033f0 con 0x7f442814b1e0 2023-07-27T14:29:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 >> v2:172.21.15.159:3300/0 conn(0x7f442814ae00 msgr2=0x7f4428154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 --2- 172.21.15.115:0/3011430208 >> v2:172.21.15.159:3300/0 conn(0x7f442814ae00 0x7f4428154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 >> v1:172.21.15.159:6789/0 conn(0x7f4428063260 legacy=0x7f44280a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428157ff0 con 0x7f442814b1e0 2023-07-27T14:29:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f441c001470 con 0x7f442814b1e0 2023-07-27T14:29:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 >> v1:172.21.15.115:6789/0 conn(0x7f442814b1e0 legacy=0x7f4428062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410003a70 0x7f4410003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4410004690 0x7f4410004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410005000 0x7f441000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4428157d10 con 0x7f4410005000 2023-07-27T14:29:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441000bf60 con 0x7f4410003a70 2023-07-27T14:29:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441000c0d0 con 0x7f4410004690 2023-07-27T14:29:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f442659c700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410003a70 0x7f4410003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f4426d9d700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410005000 0x7f441000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.908+0000 7f4425d9b700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4410004690 0x7f4410004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442659c700 1 -- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4410004690 msgr2=0x7f4410004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442659c700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4410004690 0x7f4410004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442659c700 1 -- 172.21.15.115:0/3011430208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410005000 msgr2=0x7f441000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442659c700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410005000 0x7f441000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442659c700 1 -- 172.21.15.115:0/3011430208 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100033f0 con 0x7f4410003a70 2023-07-27T14:29:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f4426d9d700 1 -- 172.21.15.115:0/3011430208 reap_dead start 2023-07-27T14:29:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442659c700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410003a70 0x7f4410003e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f4418009a80 tx=0x7f4418009060).ready entity=mon.1 client_cookie=b437fbf0be1decb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:13.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418009430 con 0x7f4410003a70 2023-07-27T14:29:13.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441800e640 con 0x7f4410003a70 2023-07-27T14:29:13.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.909+0000 7f442559a700 1 -- 172.21.15.115:0/3011430208 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800e9c0 con 0x7f4410003a70 2023-07-27T14:29:13.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.910+0000 7f442cbff700 1 -- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410003a70 msgr2=0x7f4410003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.910+0000 7f442cbff700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410003a70 0x7f4410003e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f4418009a80 tx=0x7f4418009060).stop 2023-07-27T14:29:13.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.910+0000 7f442cbff700 1 -- 172.21.15.115:0/3011430208 shutdown_connections 2023-07-27T14:29:13.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.910+0000 7f442cbff700 1 --2- 172.21.15.115:0/3011430208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410003a70 0x7f4410003e70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.910+0000 7f442cbff700 1 -- 172.21.15.115:0/3011430208 >> 172.21.15.115:0/3011430208 conn(0x7f442805e940 msgr2=0x7f44280cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:13.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.910+0000 7f442cbff700 1 -- 172.21.15.115:0/3011430208 shutdown_connections 2023-07-27T14:29:13.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.910+0000 7f442cbff700 1 -- 172.21.15.115:0/3011430208 wait complete. 2023-07-27T14:29:13.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.911+0000 7f442cbff700 1 Processor -- start 2023-07-27T14:29:13.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.911+0000 7f442cbff700 1 -- start start 2023-07-27T14:29:13.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442cbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410003a70 0x7f44280c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442cbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442814ba70 0x7f44281491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442cbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44280c9b40 0x7f44280c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442cbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c3a50 con 0x7f4410003a70 2023-07-27T14:29:13.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442cbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c2140 con 0x7f44280c9b40 2023-07-27T14:29:13.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442cbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4428164630 con 0x7f442814ba70 2023-07-27T14:29:13.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410003a70 0x7f44280c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410003a70 0x7f44280c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57878/0 (socket says 172.21.15.115:57878) 2023-07-27T14:29:13.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.912+0000 7f442659c700 1 -- 172.21.15.115:0/2539415076 learned_addr learned my addr 172.21.15.115:0/2539415076 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:13.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f4425d9b700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442814ba70 0x7f44281491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f4426d9d700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44280c9b40 0x7f44280c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f442659c700 1 -- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442814ba70 msgr2=0x7f44281491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f442659c700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442814ba70 0x7f44281491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f442659c700 1 -- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44280c9b40 msgr2=0x7f44280c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:13.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f442659c700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44280c9b40 0x7f44280c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:13.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f442659c700 1 -- 172.21.15.115:0/2539415076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280c2610 con 0x7f4410003a70 2023-07-27T14:29:13.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f4426d9d700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44280c9b40 0x7f44280c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:13.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f442659c700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410003a70 0x7f44280c1c50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f44180030b0 tx=0x7f441801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:13.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f44167fc700 1 -- 172.21.15.115:0/2539415076 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800ed30 con 0x7f4410003a70 2023-07-27T14:29:13.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f44167fc700 1 -- 172.21.15.115:0/2539415076 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441800eeb0 con 0x7f4410003a70 2023-07-27T14:29:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4428163d70 con 0x7f4410003a70 2023-07-27T14:29:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f44167fc700 1 -- 172.21.15.115:0/2539415076 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44180243f0 con 0x7f4410003a70 2023-07-27T14:29:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.913+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44280c2330 con 0x7f4410003a70 2023-07-27T14:29:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.914+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4428164910 con 0x7f4410003a70 2023-07-27T14:29:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.915+0000 7f44167fc700 1 -- 172.21.15.115:0/2539415076 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f441802b030 con 0x7f4410003a70 2023-07-27T14:29:13.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.916+0000 7f44167fc700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f440805eef0 0x7f44080613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:13.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.916+0000 7f44167fc700 1 -- 172.21.15.115:0/2539415076 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f441807b120 con 0x7f4410003a70 2023-07-27T14:29:13.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.917+0000 7f4425d9b700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f440805eef0 0x7f44080613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:13.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.917+0000 7f4425d9b700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f440805eef0 0x7f44080613b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f441c001200 tx=0x7f441c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:13.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:13.921+0000 7f44167fc700 1 -- 172.21.15.115:0/2539415076 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f441804c630 con 0x7f4410003a70 2023-07-27T14:29:14.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.093+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f442806c470 con 0x7f4410003a70 2023-07-27T14:29:14.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.694+0000 7f44167fc700 1 -- 172.21.15.115:0/2539415076 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7f44180290d0 con 0x7f4410003a70 2023-07-27T14:29:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f440805eef0 msgr2=0x7f44080613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f440805eef0 0x7f44080613b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f441c001200 tx=0x7f441c009040).stop 2023-07-27T14:29:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410003a70 msgr2=0x7f44280c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410003a70 0x7f44280c1c50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f44180030b0 tx=0x7f441801a000).stop 2023-07-27T14:29:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 shutdown_connections 2023-07-27T14:29:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f440805eef0 0x7f44080613b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44280c9b40 0x7f44280c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4410003a70 0x7f44280c1c50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 --2- 172.21.15.115:0/2539415076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442814ba70 0x7f44281491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.700+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 >> 172.21.15.115:0/2539415076 conn(0x7f442805e940 msgr2=0x7f4428152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:14.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.701+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 shutdown_connections 2023-07-27T14:29:14.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.706+0000 7f442cbff700 1 -- 172.21.15.115:0/2539415076 wait complete. 2023-07-27T14:29:14.737 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:29:14.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:29:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.927+0000 7f63c9fff700 1 Processor -- start 2023-07-27T14:29:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.927+0000 7f63c9fff700 1 -- start start 2023-07-27T14:29:14.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.929+0000 7f63c9fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f63c414ae00 0x7f63c4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.929+0000 7f63c9fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c41553f0 con 0x7f63c414b1e0 2023-07-27T14:29:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.929+0000 7f63c9fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c4157a50 con 0x7f63c4063260 2023-07-27T14:29:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.929+0000 7f63c9fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c4157d10 con 0x7f63c414ae00 2023-07-27T14:29:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.929+0000 7f63c2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f63c414b1e0 0x7f63c4062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54544/0 (socket says 172.21.15.115:54544) 2023-07-27T14:29:14.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.929+0000 7f63c2ffd700 1 -- 172.21.15.115:0/3861097082 learned_addr learned my addr 172.21.15.115:0/3861097082 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:14.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.929+0000 7f63c37fe700 1 --2- 172.21.15.115:0/3861097082 >> v2:172.21.15.159:3300/0 conn(0x7f63c414ae00 0x7f63c4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:14.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.929+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741160189 0 0) 0x7f63c41553f0 con 0x7f63c414b1e0 2023-07-27T14:29:14.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63ac0033f0 con 0x7f63c414b1e0 2023-07-27T14:29:14.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833440083 0 0) 0x7f63c4157a50 con 0x7f63c4063260 2023-07-27T14:29:14.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c41553f0 con 0x7f63c4063260 2023-07-27T14:29:14.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2953908413 0 0) 0x7f63ac0033f0 con 0x7f63c414b1e0 2023-07-27T14:29:14.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 >> v2:172.21.15.159:3300/0 conn(0x7f63c414ae00 msgr2=0x7f63c4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:14.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 --2- 172.21.15.115:0/3861097082 >> v2:172.21.15.159:3300/0 conn(0x7f63c414ae00 0x7f63c4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 >> v1:172.21.15.159:6789/0 conn(0x7f63c4063260 legacy=0x7f63c40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:14.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c4157ff0 con 0x7f63c414b1e0 2023-07-27T14:29:14.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f63b8001470 con 0x7f63c414b1e0 2023-07-27T14:29:14.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c37fe700 1 --2- 172.21.15.115:0/3861097082 >> v2:172.21.15.159:3300/0 conn(0x7f63c414ae00 0x7f63c4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:14.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 >> v1:172.21.15.115:6789/0 conn(0x7f63c414b1e0 legacy=0x7f63c4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:14.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:14.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63ac004690 0x7f63ac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:14.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ac005000 0x7f63ac00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:14.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4157d10 con 0x7f63ac005000 2023-07-27T14:29:14.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac00bf60 con 0x7f63ac004690 2023-07-27T14:29:14.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac00c0d0 con 0x7f63ac003a70 2023-07-27T14:29:14.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c37fe700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:14.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c3fff700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ac005000 0x7f63ac00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:14.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.930+0000 7f63c2ffd700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63ac004690 0x7f63ac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:14.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c37fe700 1 -- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63ac004690 msgr2=0x7f63ac004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:14.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c37fe700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63ac004690 0x7f63ac004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c37fe700 1 -- 172.21.15.115:0/3861097082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ac005000 msgr2=0x7f63ac00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:14.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c37fe700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ac005000 0x7f63ac00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c37fe700 1 -- 172.21.15.115:0/3861097082 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0033f0 con 0x7f63ac003a70 2023-07-27T14:29:14.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c3fff700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ac005000 0x7f63ac00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:14.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c3fff700 1 -- 172.21.15.115:0/3861097082 reap_dead start 2023-07-27T14:29:14.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c37fe700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63ac003e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f63b4009c70 tx=0x7f63b4009060).ready entity=mon.2 client_cookie=6a4ac124fa7378f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:14.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b40095c0 con 0x7f63ac003a70 2023-07-27T14:29:14.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b400e6f0 con 0x7f63ac003a70 2023-07-27T14:29:14.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.931+0000 7f63c27fc700 1 -- 172.21.15.115:0/3861097082 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b400ea70 con 0x7f63ac003a70 2023-07-27T14:29:14.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.932+0000 7f63c9fff700 1 -- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 msgr2=0x7f63ac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:14.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.932+0000 7f63c9fff700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63ac003e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f63b4009c70 tx=0x7f63b4009060).stop 2023-07-27T14:29:14.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.932+0000 7f63c9fff700 1 -- 172.21.15.115:0/3861097082 shutdown_connections 2023-07-27T14:29:14.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.932+0000 7f63c9fff700 1 --2- 172.21.15.115:0/3861097082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63ac003e70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.932+0000 7f63c9fff700 1 -- 172.21.15.115:0/3861097082 >> 172.21.15.115:0/3861097082 conn(0x7f63c405e940 msgr2=0x7f63c40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:14.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.932+0000 7f63c9fff700 1 -- 172.21.15.115:0/3861097082 shutdown_connections 2023-07-27T14:29:14.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.932+0000 7f63c9fff700 1 -- 172.21.15.115:0/3861097082 wait complete. 2023-07-27T14:29:14.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.933+0000 7f63c9fff700 1 Processor -- start 2023-07-27T14:29:14.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.934+0000 7f63c9fff700 1 -- start start 2023-07-27T14:29:14.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.934+0000 7f63c9fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63c4148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:14.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.934+0000 7f63c9fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63c40c0ce0 0x7f63c4152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:14.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.934+0000 7f63c9fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63c4148f80 0x7f63c4152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:14.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.934+0000 7f63c9fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4148e10 con 0x7f63c40c0ce0 2023-07-27T14:29:14.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.934+0000 7f63c9fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4152c20 con 0x7f63c4148f80 2023-07-27T14:29:14.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.934+0000 7f63c9fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c414d4d0 con 0x7f63ac003a70 2023-07-27T14:29:14.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63c40c0ce0 0x7f63c4152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:14.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63c40c0ce0 0x7f63c4152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57904/0 (socket says 172.21.15.115:57904) 2023-07-27T14:29:14.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 -- 172.21.15.115:0/341505944 learned_addr learned my addr 172.21.15.115:0/341505944 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:14.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c37fe700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63c4148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:14.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c3fff700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63c4148f80 0x7f63c4152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:14.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 -- 172.21.15.115:0/341505944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 msgr2=0x7f63c4148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:14.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63c4148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 -- 172.21.15.115:0/341505944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63c4148f80 msgr2=0x7f63c4152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:14.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63c4148f80 0x7f63c4152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:14.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 -- 172.21.15.115:0/341505944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40c21c0 con 0x7f63c40c0ce0 2023-07-27T14:29:14.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c2ffd700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63c40c0ce0 0x7f63c4152240 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f63b8007710 tx=0x7f63b8001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:14.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63ab7fe700 1 -- 172.21.15.115:0/341505944 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80114c0 con 0x7f63c40c0ce0 2023-07-27T14:29:14.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63ab7fe700 1 -- 172.21.15.115:0/341505944 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8011620 con 0x7f63c40c0ce0 2023-07-27T14:29:14.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.935+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c414d720 con 0x7f63c40c0ce0 2023-07-27T14:29:14.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.936+0000 7f63ab7fe700 1 -- 172.21.15.115:0/341505944 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80119a0 con 0x7f63c40c0ce0 2023-07-27T14:29:14.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.936+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c414dce0 con 0x7f63c40c0ce0 2023-07-27T14:29:14.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.937+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c40c2350 con 0x7f63c40c0ce0 2023-07-27T14:29:14.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.938+0000 7f63ab7fe700 1 -- 172.21.15.115:0/341505944 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f63b801b030 con 0x7f63c40c0ce0 2023-07-27T14:29:14.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.938+0000 7f63ab7fe700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63b005eec0 0x7f63b0061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:14.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.939+0000 7f63ab7fe700 1 -- 172.21.15.115:0/341505944 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f63b8079340 con 0x7f63c40c0ce0 2023-07-27T14:29:14.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.939+0000 7f63c37fe700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63b005eec0 0x7f63b0061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:14.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.939+0000 7f63c37fe700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63b005eec0 0x7f63b0061380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f63b4006d50 tx=0x7f63b401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:14.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:14.943+0000 7f63ab7fe700 1 -- 172.21.15.115:0/341505944 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63b804a780 con 0x7f63c40c0ce0 2023-07-27T14:29:15.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.152+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f63c406c470 con 0x7f63c40c0ce0 2023-07-27T14:29:15.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.160+0000 7f63ab7fe700 1 -- 172.21.15.115:0/341505944 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f63b8019030 con 0x7f63c40c0ce0 2023-07-27T14:29:15.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.167+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63b005eec0 msgr2=0x7f63b0061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.167+0000 7f63c9fff700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63b005eec0 0x7f63b0061380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f63b4006d50 tx=0x7f63b401a000).stop 2023-07-27T14:29:15.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.167+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63c40c0ce0 msgr2=0x7f63c4152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.167+0000 7f63c9fff700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63c40c0ce0 0x7f63c4152240 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f63b8007710 tx=0x7f63b8001df0).stop 2023-07-27T14:29:15.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.174+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 shutdown_connections 2023-07-27T14:29:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.174+0000 7f63c9fff700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63b005eec0 0x7f63b0061380 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.174+0000 7f63c9fff700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63c4148f80 0x7f63c4152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.174+0000 7f63c9fff700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ac003a70 0x7f63c4148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.174+0000 7f63c9fff700 1 --2- 172.21.15.115:0/341505944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63c40c0ce0 0x7f63c4152240 secure :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0x7f63b8007710 tx=0x7f63b8001df0).stop 2023-07-27T14:29:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.174+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 >> 172.21.15.115:0/341505944 conn(0x7f63c405e940 msgr2=0x7f63c40c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:15.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.178+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 shutdown_connections 2023-07-27T14:29:15.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.179+0000 7f63c9fff700 1 -- 172.21.15.115:0/341505944 wait complete. 2023-07-27T14:29:15.212 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 7 and data pool 8 2023-07-27T14:29:15.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:29:15.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.394+0000 7f93eddff700 1 Processor -- start 2023-07-27T14:29:15.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.394+0000 7f93eddff700 1 -- start start 2023-07-27T14:29:15.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.395+0000 7f93eddff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93e80aaa40 0x7f93e80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.395+0000 7f93eddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e81542a0 0x7f93e80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.395+0000 7f93eddff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e80aa4d0 con 0x7f93e8153ec0 2023-07-27T14:29:15.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.395+0000 7f93eddff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e8064ad0 con 0x7f93e80aaa40 2023-07-27T14:29:15.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.395+0000 7f93eddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80c05c0 con 0x7f93e81542a0 2023-07-27T14:29:15.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.395+0000 7f93e6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93e80aaa40 0x7f93e80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.395+0000 7f93e77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f93e8153ec0 0x7f93e80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54552/0 (socket says 172.21.15.115:54552) 2023-07-27T14:29:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e77fe700 1 -- 172.21.15.115:0/3038197085 learned_addr learned my addr 172.21.15.115:0/3038197085 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e6ffd700 1 -- 172.21.15.115:0/3038197085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e81542a0 msgr2=0x7f93e80645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e7fff700 1 --2- 172.21.15.115:0/3038197085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e81542a0 0x7f93e80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e67fc700 1 -- 172.21.15.115:0/3038197085 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211380121 0 0) 0x7f93d8001110 con 0x7f93e8153ec0 2023-07-27T14:29:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e6ffd700 1 --2- 172.21.15.115:0/3038197085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e81542a0 0x7f93e80645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e6ffd700 1 -- 172.21.15.115:0/3038197085 >> v1:172.21.15.115:6789/0 conn(0x7f93e8153ec0 legacy=0x7f93e80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e6ffd700 1 -- 172.21.15.115:0/3038197085 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80c1a60 con 0x7f93e80aaa40 2023-07-27T14:29:15.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e7fff700 1 --2- 172.21.15.115:0/3038197085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e81542a0 0x7f93e80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:15.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e6ffd700 1 --2- 172.21.15.115:0/3038197085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80640f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f93dc009760 tx=0x7f93dc009060).ready entity=mon.0 client_cookie=6115f0154a33d0e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:15.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e67fc700 1 -- 172.21.15.115:0/3038197085 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00b580 con 0x7f93e80aaa40 2023-07-27T14:29:15.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e67fc700 1 -- 172.21.15.115:0/3038197085 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc00b6e0 con 0x7f93e80aaa40 2023-07-27T14:29:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.396+0000 7f93e67fc700 1 -- 172.21.15.115:0/3038197085 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00ba60 con 0x7f93e80aaa40 2023-07-27T14:29:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.397+0000 7f93eddff700 1 -- 172.21.15.115:0/3038197085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 msgr2=0x7f93e80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.397+0000 7f93eddff700 1 --2- 172.21.15.115:0/3038197085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80640f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f93dc009760 tx=0x7f93dc009060).stop 2023-07-27T14:29:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.397+0000 7f93eddff700 1 -- 172.21.15.115:0/3038197085 shutdown_connections 2023-07-27T14:29:15.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.397+0000 7f93eddff700 1 --2- 172.21.15.115:0/3038197085 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e81542a0 0x7f93e80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.397+0000 7f93eddff700 1 --2- 172.21.15.115:0/3038197085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80640f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.397+0000 7f93eddff700 1 -- 172.21.15.115:0/3038197085 >> 172.21.15.115:0/3038197085 conn(0x7f93e80cb610 msgr2=0x7f93e80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:15.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.397+0000 7f93eddff700 1 -- 172.21.15.115:0/3038197085 shutdown_connections 2023-07-27T14:29:15.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.397+0000 7f93eddff700 1 -- 172.21.15.115:0/3038197085 wait complete. 2023-07-27T14:29:15.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.398+0000 7f93eddff700 1 Processor -- start 2023-07-27T14:29:15.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.399+0000 7f93eddff700 1 -- start start 2023-07-27T14:29:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93eddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93eddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e8153ec0 0x7f93e814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93eddff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e81542a0 0x7f93e80c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93eddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80ae4b0 con 0x7f93e80aaa40 2023-07-27T14:29:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93eddff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8152e10 con 0x7f93e81542a0 2023-07-27T14:29:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93eddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e81530f0 con 0x7f93e8153ec0 2023-07-27T14:29:15.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57928/0 (socket says 172.21.15.115:57928) 2023-07-27T14:29:15.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 -- 172.21.15.115:0/4229159636 learned_addr learned my addr 172.21.15.115:0/4229159636 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:15.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e6ffd700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e8153ec0 0x7f93e814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e7fff700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e81542a0 0x7f93e80c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 -- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e8153ec0 msgr2=0x7f93e814bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e8153ec0 0x7f93e814bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 -- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e81542a0 msgr2=0x7f93e80c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e81542a0 0x7f93e80c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 -- 172.21.15.115:0/4229159636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc0092a0 con 0x7f93e80aaa40 2023-07-27T14:29:15.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e7fff700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e81542a0 0x7f93e80c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:15.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.400+0000 7f93e77fe700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80adfc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f93d800c510 tx=0x7f93d8007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:15.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.401+0000 7f93cf7fe700 1 -- 172.21.15.115:0/4229159636 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80072e0 con 0x7f93e80aaa40 2023-07-27T14:29:15.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.401+0000 7f93cf7fe700 1 -- 172.21.15.115:0/4229159636 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d8007440 con 0x7f93e80aaa40 2023-07-27T14:29:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.401+0000 7f93cf7fe700 1 -- 172.21.15.115:0/4229159636 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80057a0 con 0x7f93e80aaa40 2023-07-27T14:29:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.401+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e81501e0 con 0x7f93e80aaa40 2023-07-27T14:29:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.401+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e814c160 con 0x7f93e80aaa40 2023-07-27T14:29:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.402+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e8153310 con 0x7f93e80aaa40 2023-07-27T14:29:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.402+0000 7f93cf7fe700 1 -- 172.21.15.115:0/4229159636 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f93d8010070 con 0x7f93e80aaa40 2023-07-27T14:29:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.403+0000 7f93cf7fe700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f93d405eef0 0x7f93d40613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.403+0000 7f93cf7fe700 1 -- 172.21.15.115:0/4229159636 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f93d80793e0 con 0x7f93e80aaa40 2023-07-27T14:29:15.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.403+0000 7f93e6ffd700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f93d405eef0 0x7f93d40613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.404+0000 7f93e6ffd700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f93d405eef0 0x7f93d40613b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f93e80aae20 tx=0x7f93dc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:15.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.407+0000 7f93cf7fe700 1 -- 172.21.15.115:0/4229159636 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93d804a710 con 0x7f93e80aaa40 2023-07-27T14:29:15.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.581+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e80aa4d0 con 0x7f93e80aaa40 2023-07-27T14:29:15.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.582+0000 7f93cf7fe700 1 -- 172.21.15.115:0/4229159636 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+17085 (secure 0 0 0) 0x7f93e80aa4d0 con 0x7f93e80aaa40 2023-07-27T14:29:15.606 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:15.606 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":51,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:29:15.154062+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:29:13.551102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-27T14:29:14.136450+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:29:15.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f93d405eef0 msgr2=0x7f93d40613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f93d405eef0 0x7f93d40613b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f93e80aae20 tx=0x7f93dc017000).stop 2023-07-27T14:29:15.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 msgr2=0x7f93e80adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80adfc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f93d800c510 tx=0x7f93d8007ad0).stop 2023-07-27T14:29:15.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 shutdown_connections 2023-07-27T14:29:15.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f93d405eef0 0x7f93d40613b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93e81542a0 0x7f93e80c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93e80aaa40 0x7f93e80adfc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 --2- 172.21.15.115:0/4229159636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f93e8153ec0 0x7f93e814bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 >> 172.21.15.115:0/4229159636 conn(0x7f93e80cb610 msgr2=0x7f93e8062ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:15.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 shutdown_connections 2023-07-27T14:29:15.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.584+0000 7f93eddff700 1 -- 172.21.15.115:0/4229159636 wait complete. 2023-07-27T14:29:15.625 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:29:15.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.790+0000 7f7f893ff700 1 Processor -- start 2023-07-27T14:29:15.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.790+0000 7f7f893ff700 1 -- start start 2023-07-27T14:29:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f893ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f840aaa40 0x7f7f840640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f893ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7f841542a0 0x7f7f840645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f893ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f840aa4d0 con 0x7f7f84153ec0 2023-07-27T14:29:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f893ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f84064ad0 con 0x7f7f841542a0 2023-07-27T14:29:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f893ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c05c0 con 0x7f7f840aaa40 2023-07-27T14:29:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f82ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7f84153ec0 0x7f7f840a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54560/0 (socket says 172.21.15.115:54560) 2023-07-27T14:29:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f82ffd700 1 -- 172.21.15.115:0/630970124 learned_addr learned my addr 172.21.15.115:0/630970124 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f827fc700 1 --2- 172.21.15.115:0/630970124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f840aaa40 0x7f7f840640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f837fe700 1 --2- 172.21.15.115:0/630970124 >> v2:172.21.15.159:3300/0 conn(0x7f7f841542a0 0x7f7f840645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f81ffb700 1 -- 172.21.15.115:0/630970124 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194943275 0 0) 0x7f7f74001110 con 0x7f7f84153ec0 2023-07-27T14:29:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.792+0000 7f7f81ffb700 1 -- 172.21.15.115:0/630970124 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f6c0033f0 con 0x7f7f84153ec0 2023-07-27T14:29:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f827fc700 1 -- 172.21.15.115:0/630970124 >> v2:172.21.15.159:3300/0 conn(0x7f7f841542a0 msgr2=0x7f7f840645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f827fc700 1 --2- 172.21.15.115:0/630970124 >> v2:172.21.15.159:3300/0 conn(0x7f7f841542a0 0x7f7f840645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f827fc700 1 -- 172.21.15.115:0/630970124 >> v1:172.21.15.115:6789/0 conn(0x7f7f84153ec0 legacy=0x7f7f840a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f827fc700 1 -- 172.21.15.115:0/630970124 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840c1a60 con 0x7f7f840aaa40 2023-07-27T14:29:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f837fe700 1 --2- 172.21.15.115:0/630970124 >> v2:172.21.15.159:3300/0 conn(0x7f7f841542a0 0x7f7f840645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f827fc700 1 --2- 172.21.15.115:0/630970124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f840aaa40 0x7f7f840640f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7f78009760 tx=0x7f7f78009060).ready entity=mon.2 client_cookie=9f6915b85a801fe4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f81ffb700 1 -- 172.21.15.115:0/630970124 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800d4a0 con 0x7f7f840aaa40 2023-07-27T14:29:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f81ffb700 1 -- 172.21.15.115:0/630970124 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7800d600 con 0x7f7f840aaa40 2023-07-27T14:29:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.793+0000 7f7f81ffb700 1 -- 172.21.15.115:0/630970124 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800d980 con 0x7f7f840aaa40 2023-07-27T14:29:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.794+0000 7f7f893ff700 1 -- 172.21.15.115:0/630970124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f840aaa40 msgr2=0x7f7f840640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.794+0000 7f7f893ff700 1 --2- 172.21.15.115:0/630970124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f840aaa40 0x7f7f840640f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7f78009760 tx=0x7f7f78009060).stop 2023-07-27T14:29:15.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.794+0000 7f7f893ff700 1 -- 172.21.15.115:0/630970124 shutdown_connections 2023-07-27T14:29:15.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.794+0000 7f7f893ff700 1 --2- 172.21.15.115:0/630970124 >> v2:172.21.15.159:3300/0 conn(0x7f7f841542a0 0x7f7f840645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.794+0000 7f7f893ff700 1 --2- 172.21.15.115:0/630970124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f840aaa40 0x7f7f840640f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.794+0000 7f7f893ff700 1 -- 172.21.15.115:0/630970124 >> 172.21.15.115:0/630970124 conn(0x7f7f840cb610 msgr2=0x7f7f840c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:15.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.794+0000 7f7f893ff700 1 -- 172.21.15.115:0/630970124 shutdown_connections 2023-07-27T14:29:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.794+0000 7f7f893ff700 1 -- 172.21.15.115:0/630970124 wait complete. 2023-07-27T14:29:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.795+0000 7f7f893ff700 1 Processor -- start 2023-07-27T14:29:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.795+0000 7f7f893ff700 1 -- start start 2023-07-27T14:29:15.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.796+0000 7f7f893ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f840aaa40 0x7f7f840c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.796+0000 7f7f893ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f84153ec0 0x7f7f84159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.796+0000 7f7f893ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f841542a0 0x7f7f84157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.796+0000 7f7f893ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84163c20 con 0x7f7f840aaa40 2023-07-27T14:29:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.796+0000 7f7f893ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c36d0 con 0x7f7f84153ec0 2023-07-27T14:29:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.796+0000 7f7f893ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c39b0 con 0x7f7f841542a0 2023-07-27T14:29:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f840aaa40 0x7f7f840c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f840aaa40 0x7f7f840c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57944/0 (socket says 172.21.15.115:57944) 2023-07-27T14:29:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 -- 172.21.15.115:0/1691270890 learned_addr learned my addr 172.21.15.115:0/1691270890 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f837fe700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f841542a0 0x7f7f84157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f827fc700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f84153ec0 0x7f7f84159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 -- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f841542a0 msgr2=0x7f7f84157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f841542a0 0x7f7f84157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 -- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f84153ec0 msgr2=0x7f7f84159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f84153ec0 0x7f7f84159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 -- 172.21.15.115:0/1691270890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009a20 con 0x7f7f840aaa40 2023-07-27T14:29:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f837fe700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f841542a0 0x7f7f84157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f827fc700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f84153ec0 0x7f7f84159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f82ffd700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f840aaa40 0x7f7f840c4770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f7f7400c4a0 tx=0x7f7f74007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f6affd700 1 -- 172.21.15.115:0/1691270890 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f740072e0 con 0x7f7f840aaa40 2023-07-27T14:29:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f6affd700 1 -- 172.21.15.115:0/1691270890 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f74007440 con 0x7f7f840aaa40 2023-07-27T14:29:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f780092a0 con 0x7f7f840aaa40 2023-07-27T14:29:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.797+0000 7f7f6affd700 1 -- 172.21.15.115:0/1691270890 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f740057a0 con 0x7f7f840aaa40 2023-07-27T14:29:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.798+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f840c3f70 con 0x7f7f840aaa40 2023-07-27T14:29:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.799+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f840c45c0 con 0x7f7f840aaa40 2023-07-27T14:29:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.799+0000 7f7f6affd700 1 -- 172.21.15.115:0/1691270890 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f7f74010070 con 0x7f7f840aaa40 2023-07-27T14:29:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.801+0000 7f7f6affd700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f7005eec0 0x7f7f70061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:15.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.801+0000 7f7f6affd700 1 -- 172.21.15.115:0/1691270890 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7f74079290 con 0x7f7f840aaa40 2023-07-27T14:29:15.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.801+0000 7f7f827fc700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f7005eec0 0x7f7f70061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:15.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.801+0000 7f7f827fc700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f7005eec0 0x7f7f70061380 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7f840aae20 tx=0x7f7f78016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:15.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.805+0000 7f7f6affd700 1 -- 172.21.15.115:0/1691270890 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f7404a600 con 0x7f7f840aaa40 2023-07-27T14:29:15.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.975+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f840aa4d0 con 0x7f7f840aaa40 2023-07-27T14:29:15.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.976+0000 7f7f6affd700 1 -- 172.21.15.115:0/1691270890 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+17085 (secure 0 0 0) 0x7f7f840aa4d0 con 0x7f7f840aaa40 2023-07-27T14:29:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:16.000 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":51,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:29:15.154062+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:29:13.551102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-27T14:29:14.136450+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:29:16.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f7005eec0 msgr2=0x7f7f70061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:16.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f7005eec0 0x7f7f70061380 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7f840aae20 tx=0x7f7f78016000).stop 2023-07-27T14:29:16.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f840aaa40 msgr2=0x7f7f840c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:16.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f840aaa40 0x7f7f840c4770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f7f7400c4a0 tx=0x7f7f74007ab0).stop 2023-07-27T14:29:16.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 shutdown_connections 2023-07-27T14:29:16.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f7005eec0 0x7f7f70061380 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f841542a0 0x7f7f84157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f840aaa40 0x7f7f840c4770 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 --2- 172.21.15.115:0/1691270890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f84153ec0 0x7f7f84159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.978+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 >> 172.21.15.115:0/1691270890 conn(0x7f7f840cb610 msgr2=0x7f7f840ac5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:16.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.979+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 shutdown_connections 2023-07-27T14:29:16.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:15.979+0000 7f7f893ff700 1 -- 172.21.15.115:0/1691270890 wait complete. 2023-07-27T14:29:16.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:29:16.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.190+0000 7f3cdb3ff700 1 Processor -- start 2023-07-27T14:29:16.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.190+0000 7f3cdb3ff700 1 -- start start 2023-07-27T14:29:16.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cdb3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4150220 0x7f3cd4150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:16.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cdb3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3cd40c0ea0 0x7f3cd4065220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:16.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cdb3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd4068bb0 con 0x7f3cd4069040 2023-07-27T14:29:16.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cdb3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd406a250 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cdb3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd40c1380 con 0x7f3cd4150220 2023-07-27T14:29:16.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cd999c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3cd4069040 0x7f3cd40c1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54576/0 (socket says 172.21.15.115:54576) 2023-07-27T14:29:16.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cd999c700 1 -- 172.21.15.115:0/3317830456 learned_addr learned my addr 172.21.15.115:0/3317830456 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:16.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cd899a700 1 --2- 172.21.15.115:0/3317830456 >> v2:172.21.15.159:3300/0 conn(0x7f3cd40c0ea0 0x7f3cd4065220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:16.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.191+0000 7f3cd919b700 1 --2- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4150220 0x7f3cd4150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:16.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3ccbfff700 1 -- 172.21.15.115:0/3317830456 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783781211 0 0) 0x7f3cd4068bb0 con 0x7f3cd4069040 2023-07-27T14:29:16.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3ccbfff700 1 -- 172.21.15.115:0/3317830456 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc00033f0 con 0x7f3cd4069040 2023-07-27T14:29:16.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3ccbfff700 1 -- 172.21.15.115:0/3317830456 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3678090310 0 0) 0x7f3cc00033f0 con 0x7f3cd4069040 2023-07-27T14:29:16.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3cd899a700 1 -- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4150220 msgr2=0x7f3cd4150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:16.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3cd899a700 1 --2- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4150220 0x7f3cd4150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3cd899a700 1 -- 172.21.15.115:0/3317830456 >> v1:172.21.15.115:6789/0 conn(0x7f3cd4069040 legacy=0x7f3cd40c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:16.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3cd899a700 1 -- 172.21.15.115:0/3317830456 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4068560 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3cd919b700 1 --2- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4150220 0x7f3cd4150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:16.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3cd899a700 1 --2- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd4065220 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f3cc4009790 tx=0x7f3cc4009060).ready entity=mon.1 client_cookie=2ae71e05ab2c2d65 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:16.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3ccbfff700 1 -- 172.21.15.115:0/3317830456 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0017f0 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3ccbfff700 1 -- 172.21.15.115:0/3317830456 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4011400 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.192+0000 7f3ccbfff700 1 -- 172.21.15.115:0/3317830456 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4011780 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.193+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd40c0ea0 msgr2=0x7f3cd4065220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:16.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.193+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd4065220 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f3cc4009790 tx=0x7f3cc4009060).stop 2023-07-27T14:29:16.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.193+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3317830456 shutdown_connections 2023-07-27T14:29:16.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.193+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4150220 0x7f3cd4150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.193+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3317830456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd4065220 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.193+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3317830456 >> 172.21.15.115:0/3317830456 conn(0x7f3cd4062320 msgr2=0x7f3cd4062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:16.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.193+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3317830456 shutdown_connections 2023-07-27T14:29:16.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.193+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3317830456 wait complete. 2023-07-27T14:29:16.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.194+0000 7f3cdb3ff700 1 Processor -- start 2023-07-27T14:29:16.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.195+0000 7f3cdb3ff700 1 -- start start 2023-07-27T14:29:16.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cdb3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4069040 0x7f3cd40bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:16.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cdb3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd413f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:16.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cdb3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4150220 0x7f3cd414c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:16.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cdb3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd40c05f0 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cdb3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd40aa8d0 con 0x7f3cd4150220 2023-07-27T14:29:16.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cdb3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd40a9cc0 con 0x7f3cd4069040 2023-07-27T14:29:16.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd413f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:16.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd413f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57950/0 (socket says 172.21.15.115:57950) 2023-07-27T14:29:16.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 -- 172.21.15.115:0/3446043097 learned_addr learned my addr 172.21.15.115:0/3446043097 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:16.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd919b700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4069040 0x7f3cd40bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:16.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd999c700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4150220 0x7f3cd414c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:16.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 -- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4069040 msgr2=0x7f3cd40bfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:16.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4069040 0x7f3cd40bfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 -- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4150220 msgr2=0x7f3cd414c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:16.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4150220 0x7f3cd414c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:16.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 -- 172.21.15.115:0/3446043097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00092a0 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd919b700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4069040 0x7f3cd40bfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:16.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.196+0000 7f3cd899a700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd413f520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f3cd40bd810 tx=0x7f3cc4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:16.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.197+0000 7f3cc97fa700 1 -- 172.21.15.115:0/3446043097 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4021070 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.197+0000 7f3cc97fa700 1 -- 172.21.15.115:0/3446043097 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4010920 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.197+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc40092a0 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.197+0000 7f3cc97fa700 1 -- 172.21.15.115:0/3446043097 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4010cc0 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.197+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd40aa280 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.198+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd406c470 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.199+0000 7f3cc97fa700 1 -- 172.21.15.115:0/3446043097 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f3cc400f070 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.200+0000 7f3cc97fa700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cb805ef20 0x7f3cb80613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:16.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.200+0000 7f3cc97fa700 1 -- 172.21.15.115:0/3446043097 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3cc407ae90 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.200+0000 7f3cd919b700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cb805ef20 0x7f3cb80613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:16.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.200+0000 7f3cd919b700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cb805ef20 0x7f3cb80613e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3cd0009270 tx=0x7f3cd0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:16.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.203+0000 7f3cc97fa700 1 -- 172.21.15.115:0/3446043097 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3cc404c1c0 con 0x7f3cd40c0ea0 2023-07-27T14:29:16.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:16.411+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3cd4064d50 con 0x7f3cd40c0ea0 2023-07-27T14:29:17.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.169+0000 7f3cc97fa700 1 -- 172.21.15.115:0/3446043097 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3cc404f7e0 con 0x7f3cd40c0ea0 2023-07-27T14:29:17.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cb805ef20 msgr2=0x7f3cb80613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:17.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cb805ef20 0x7f3cb80613e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3cd0009270 tx=0x7f3cd0008040).stop 2023-07-27T14:29:17.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd40c0ea0 msgr2=0x7f3cd413f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:17.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd413f520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f3cd40bd810 tx=0x7f3cc4016000).stop 2023-07-27T14:29:17.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 shutdown_connections 2023-07-27T14:29:17.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cb805ef20 0x7f3cb80613e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4150220 0x7f3cd414c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cd4069040 0x7f3cd40bfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 --2- 172.21.15.115:0/3446043097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd40c0ea0 0x7f3cd413f520 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 >> 172.21.15.115:0/3446043097 conn(0x7f3cd4062320 msgr2=0x7f3cd40bc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:17.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 shutdown_connections 2023-07-27T14:29:17.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.171+0000 7f3cdb3ff700 1 -- 172.21.15.115:0/3446043097 wait complete. 2023-07-27T14:29:17.213 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:29:17.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:29:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.382+0000 7f90a69ff700 1 Processor -- start 2023-07-27T14:29:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.382+0000 7f90a69ff700 1 -- start start 2023-07-27T14:29:17.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f90a69ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:17.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f90a69ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f90a014b1e0 0x7f90a00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:17.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f90a69ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a01553f0 con 0x7f90a014ae00 2023-07-27T14:29:17.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f90a69ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a0157a50 con 0x7f90a014b1e0 2023-07-27T14:29:17.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f90a69ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0157d10 con 0x7f90a0063260 2023-07-27T14:29:17.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f909f7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:17.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f90a4f9c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f90a014b1e0 0x7f90a00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:17.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f909f7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:53048/0 (socket says 172.21.15.115:53048) 2023-07-27T14:29:17.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.384+0000 7f909f7fe700 1 -- 172.21.15.115:0/3173276373 learned_addr learned my addr 172.21.15.115:0/3173276373 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:17.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f909f7fe700 1 -- 172.21.15.115:0/3173276373 >> v2:172.21.15.159:3300/0 conn(0x7f90a014b1e0 msgr2=0x7f90a00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:17.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f909f7fe700 1 --2- 172.21.15.115:0/3173276373 >> v2:172.21.15.159:3300/0 conn(0x7f90a014b1e0 0x7f90a00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f909f7fe700 1 -- 172.21.15.115:0/3173276373 >> v1:172.21.15.159:6789/0 conn(0x7f90a014ae00 legacy=0x7f90a0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:17.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f909f7fe700 1 -- 172.21.15.115:0/3173276373 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0157ff0 con 0x7f90a0063260 2023-07-27T14:29:17.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f90a4f9c700 1 --2- 172.21.15.115:0/3173276373 >> v2:172.21.15.159:3300/0 conn(0x7f90a014b1e0 0x7f90a00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:17.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f909f7fe700 1 --2- 172.21.15.115:0/3173276373 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0154f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9094006fd0 tx=0x7f90940090f0).ready entity=mon.2 client_cookie=8b551b2ed385430d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:17.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f909effd700 1 -- 172.21.15.115:0/3173276373 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400b580 con 0x7f90a0063260 2023-07-27T14:29:17.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f909effd700 1 -- 172.21.15.115:0/3173276373 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400b6e0 con 0x7f90a0063260 2023-07-27T14:29:17.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.385+0000 7f909effd700 1 -- 172.21.15.115:0/3173276373 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400ba60 con 0x7f90a0063260 2023-07-27T14:29:17.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.386+0000 7f90a69ff700 1 -- 172.21.15.115:0/3173276373 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 msgr2=0x7f90a0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:17.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.386+0000 7f90a69ff700 1 --2- 172.21.15.115:0/3173276373 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0154f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9094006fd0 tx=0x7f90940090f0).stop 2023-07-27T14:29:17.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.386+0000 7f90a69ff700 1 -- 172.21.15.115:0/3173276373 shutdown_connections 2023-07-27T14:29:17.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.386+0000 7f90a69ff700 1 --2- 172.21.15.115:0/3173276373 >> v2:172.21.15.159:3300/0 conn(0x7f90a014b1e0 0x7f90a00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.386+0000 7f90a69ff700 1 --2- 172.21.15.115:0/3173276373 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0154f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.386+0000 7f90a69ff700 1 -- 172.21.15.115:0/3173276373 >> 172.21.15.115:0/3173276373 conn(0x7f90a005e940 msgr2=0x7f90a00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:17.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.386+0000 7f90a69ff700 1 -- 172.21.15.115:0/3173276373 shutdown_connections 2023-07-27T14:29:17.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.386+0000 7f90a69ff700 1 -- 172.21.15.115:0/3173276373 wait complete. 2023-07-27T14:29:17.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.387+0000 7f90a69ff700 1 Processor -- start 2023-07-27T14:29:17.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.387+0000 7f90a69ff700 1 -- start start 2023-07-27T14:29:17.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.388+0000 7f90a69ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:17.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.388+0000 7f90a69ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90a014ae00 0x7f90a01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:17.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.388+0000 7f90a69ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90a014b1e0 0x7f90a0156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:17.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.388+0000 7f90a69ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0156ac0 con 0x7f90a014ae00 2023-07-27T14:29:17.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.388+0000 7f90a69ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0155eb0 con 0x7f90a014b1e0 2023-07-27T14:29:17.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.388+0000 7f90a69ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0156190 con 0x7f90a0063260 2023-07-27T14:29:17.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90a014ae00 0x7f90a01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:17.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90a014ae00 0x7f90a01555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57956/0 (socket says 172.21.15.115:57956) 2023-07-27T14:29:17.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:17.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 -- 172.21.15.115:0/2506730978 learned_addr learned my addr 172.21.15.115:0/2506730978 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:17.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f90a4f9c700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90a014b1e0 0x7f90a0156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:17.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 -- 172.21.15.115:0/2506730978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 msgr2=0x7f90a0148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:17.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 -- 172.21.15.115:0/2506730978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90a014b1e0 msgr2=0x7f90a0156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:17.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90a014b1e0 0x7f90a0156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:17.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 -- 172.21.15.115:0/2506730978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098009a20 con 0x7f90a014ae00 2023-07-27T14:29:17.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.389+0000 7f909f7fe700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90a014ae00 0x7f90a01555b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f9094009fd0 tx=0x7f9094017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:17.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.390+0000 7f9087fff700 1 -- 172.21.15.115:0/2506730978 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094000bc0 con 0x7f90a014ae00 2023-07-27T14:29:17.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.390+0000 7f9087fff700 1 -- 172.21.15.115:0/2506730978 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400b850 con 0x7f90a014ae00 2023-07-27T14:29:17.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.390+0000 7f9087fff700 1 -- 172.21.15.115:0/2506730978 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094000d20 con 0x7f90a014ae00 2023-07-27T14:29:17.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.390+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9094009370 con 0x7f90a014ae00 2023-07-27T14:29:17.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.390+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a0156750 con 0x7f90a014ae00 2023-07-27T14:29:17.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.391+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a01492d0 con 0x7f90a014ae00 2023-07-27T14:29:17.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.391+0000 7f9087fff700 1 -- 172.21.15.115:0/2506730978 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f909402c070 con 0x7f90a014ae00 2023-07-27T14:29:17.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.392+0000 7f9087fff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f908c05eec0 0x7f908c061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:17.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.392+0000 7f9087fff700 1 -- 172.21.15.115:0/2506730978 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f909407b980 con 0x7f90a014ae00 2023-07-27T14:29:17.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.393+0000 7f909ffff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f908c05eec0 0x7f908c061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:17.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.393+0000 7f909ffff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f908c05eec0 0x7f908c061380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f9090003900 tx=0x7f9090007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:17.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.397+0000 7f9087fff700 1 -- 172.21.15.115:0/2506730978 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f909404ccb0 con 0x7f90a014ae00 2023-07-27T14:29:17.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:17.608+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f90a006c470 con 0x7f90a014ae00 2023-07-27T14:29:18.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.177+0000 7f9087fff700 1 -- 172.21.15.115:0/2506730978 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f909402a070 con 0x7f90a014ae00 2023-07-27T14:29:18.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f908c05eec0 msgr2=0x7f908c061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f908c05eec0 0x7f908c061380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f9090003900 tx=0x7f9090007d40).stop 2023-07-27T14:29:18.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90a014ae00 msgr2=0x7f90a01555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90a014ae00 0x7f90a01555b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f9094009fd0 tx=0x7f9094017000).stop 2023-07-27T14:29:18.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 shutdown_connections 2023-07-27T14:29:18.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f908c05eec0 0x7f908c061380 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90a014b1e0 0x7f90a0156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90a0063260 0x7f90a0148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 --2- 172.21.15.115:0/2506730978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90a014ae00 0x7f90a01555b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.179+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 >> 172.21.15.115:0/2506730978 conn(0x7f90a005e940 msgr2=0x7f90a00c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:18.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.180+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 shutdown_connections 2023-07-27T14:29:18.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.180+0000 7f90a69ff700 1 -- 172.21.15.115:0/2506730978 wait complete. 2023-07-27T14:29:18.223 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:29:18.224 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:29:18.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.389+0000 7f7d765ff700 1 Processor -- start 2023-07-27T14:29:18.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.389+0000 7f7d765ff700 1 -- start start 2023-07-27T14:29:18.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d765ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d70153ec0 0x7f7d700a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d765ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7d700aa050 0x7f7d700640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d765ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d700aa4d0 con 0x7f7d700aaa40 2023-07-27T14:29:18.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d765ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d700c05c0 con 0x7f7d70153ec0 2023-07-27T14:29:18.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d765ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d700c1a60 con 0x7f7d700aa050 2023-07-27T14:29:18.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d6ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d70153ec0 0x7f7d700a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d74b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7d700aaa40 0x7f7d70157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54586/0 (socket says 172.21.15.115:54586) 2023-07-27T14:29:18.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d74b9c700 1 -- 172.21.15.115:0/2913820585 learned_addr learned my addr 172.21.15.115:0/2913820585 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:18.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d6f7fe700 1 --2- 172.21.15.115:0/2913820585 >> v2:172.21.15.159:3300/0 conn(0x7f7d700aa050 0x7f7d700640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d6effd700 1 -- 172.21.15.115:0/2913820585 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566034018 0 0) 0x7f7d68001490 con 0x7f7d700aaa40 2023-07-27T14:29:18.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.391+0000 7f7d6effd700 1 -- 172.21.15.115:0/2913820585 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d580033f0 con 0x7f7d700aaa40 2023-07-27T14:29:18.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6ffff700 1 -- 172.21.15.115:0/2913820585 >> v2:172.21.15.159:3300/0 conn(0x7f7d700aa050 msgr2=0x7f7d700640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:18.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6ffff700 1 --2- 172.21.15.115:0/2913820585 >> v2:172.21.15.159:3300/0 conn(0x7f7d700aa050 0x7f7d700640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6ffff700 1 -- 172.21.15.115:0/2913820585 >> v1:172.21.15.115:6789/0 conn(0x7f7d700aaa40 legacy=0x7f7d70157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6ffff700 1 -- 172.21.15.115:0/2913820585 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d700bfc90 con 0x7f7d70153ec0 2023-07-27T14:29:18.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6f7fe700 1 --2- 172.21.15.115:0/2913820585 >> v2:172.21.15.159:3300/0 conn(0x7f7d700aa050 0x7f7d700640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:18.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6ffff700 1 --2- 172.21.15.115:0/2913820585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d70153ec0 0x7f7d700a9b60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f7d7006c0d0 tx=0x7f7d60009060).ready entity=mon.0 client_cookie=9696cddeb2f30579 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:18.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6effd700 1 -- 172.21.15.115:0/2913820585 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000f510 con 0x7f7d70153ec0 2023-07-27T14:29:18.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6effd700 1 -- 172.21.15.115:0/2913820585 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000f670 con 0x7f7d70153ec0 2023-07-27T14:29:18.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d6effd700 1 -- 172.21.15.115:0/2913820585 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000f9f0 con 0x7f7d70153ec0 2023-07-27T14:29:18.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d765ff700 1 -- 172.21.15.115:0/2913820585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d70153ec0 msgr2=0x7f7d700a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.392+0000 7f7d765ff700 1 --2- 172.21.15.115:0/2913820585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d70153ec0 0x7f7d700a9b60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f7d7006c0d0 tx=0x7f7d60009060).stop 2023-07-27T14:29:18.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.393+0000 7f7d765ff700 1 -- 172.21.15.115:0/2913820585 shutdown_connections 2023-07-27T14:29:18.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.393+0000 7f7d765ff700 1 --2- 172.21.15.115:0/2913820585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d70153ec0 0x7f7d700a9b60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.393+0000 7f7d765ff700 1 --2- 172.21.15.115:0/2913820585 >> v2:172.21.15.159:3300/0 conn(0x7f7d700aa050 0x7f7d700640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.393+0000 7f7d765ff700 1 -- 172.21.15.115:0/2913820585 >> 172.21.15.115:0/2913820585 conn(0x7f7d700cb610 msgr2=0x7f7d700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.393+0000 7f7d765ff700 1 -- 172.21.15.115:0/2913820585 shutdown_connections 2023-07-27T14:29:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.393+0000 7f7d765ff700 1 -- 172.21.15.115:0/2913820585 wait complete. 2023-07-27T14:29:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.394+0000 7f7d765ff700 1 Processor -- start 2023-07-27T14:29:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.394+0000 7f7d765ff700 1 -- start start 2023-07-27T14:29:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d765ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d700aa050 0x7f7d701424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d765ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d700aaa40 0x7f7d701505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d765ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d70153ec0 0x7f7d701530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d765ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70142ab0 con 0x7f7d700aa050 2023-07-27T14:29:18.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d765ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70150b60 con 0x7f7d700aaa40 2023-07-27T14:29:18.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d765ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70150e40 con 0x7f7d70153ec0 2023-07-27T14:29:18.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d700aa050 0x7f7d701424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d700aa050 0x7f7d701424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57982/0 (socket says 172.21.15.115:57982) 2023-07-27T14:29:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.395+0000 7f7d6ffff700 1 -- 172.21.15.115:0/936806589 learned_addr learned my addr 172.21.15.115:0/936806589 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d6ffff700 1 -- 172.21.15.115:0/936806589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d70153ec0 msgr2=0x7f7d701530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d6ffff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d70153ec0 0x7f7d701530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d6f7fe700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d700aaa40 0x7f7d701505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d6ffff700 1 -- 172.21.15.115:0/936806589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d700aaa40 msgr2=0x7f7d701505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d6ffff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d700aaa40 0x7f7d701505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d6ffff700 1 -- 172.21.15.115:0/936806589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d600092a0 con 0x7f7d700aa050 2023-07-27T14:29:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d6f7fe700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d700aaa40 0x7f7d701505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d6ffff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d700aa050 0x7f7d701424f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7d60009dd0 tx=0x7f7d60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d57fff700 1 -- 172.21.15.115:0/936806589 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000f7e0 con 0x7f7d700aa050 2023-07-27T14:29:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d57fff700 1 -- 172.21.15.115:0/936806589 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000f940 con 0x7f7d700aa050 2023-07-27T14:29:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d70151120 con 0x7f7d700aa050 2023-07-27T14:29:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d57fff700 1 -- 172.21.15.115:0/936806589 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6001a680 con 0x7f7d700aa050 2023-07-27T14:29:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.396+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d701516e0 con 0x7f7d700aa050 2023-07-27T14:29:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.397+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7006c470 con 0x7f7d700aa050 2023-07-27T14:29:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.398+0000 7f7d57fff700 1 -- 172.21.15.115:0/936806589 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f7d6000f070 con 0x7f7d700aa050 2023-07-27T14:29:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.399+0000 7f7d57fff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d5c05eec0 0x7f7d5c061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.399+0000 7f7d57fff700 1 -- 172.21.15.115:0/936806589 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7d6007aff0 con 0x7f7d700aa050 2023-07-27T14:29:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.399+0000 7f7d6f7fe700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d5c05eec0 0x7f7d5c061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.400+0000 7f7d6f7fe700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d5c05eec0 0x7f7d5c061380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f7d64006d80 tx=0x7f7d64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.403+0000 7f7d57fff700 1 -- 172.21.15.115:0/936806589 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7d600a98f0 con 0x7f7d700aa050 2023-07-27T14:29:18.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.613+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d700bff70 con 0x7f7d700aa050 2023-07-27T14:29:18.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.614+0000 7f7d57fff700 1 -- 172.21.15.115:0/936806589 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f7d6004c360 con 0x7f7d700aa050 2023-07-27T14:29:18.638 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:18.638 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1259074753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1259074753},{"type":"v1","addr":"172.21.15.115:6837","nonce":1259074753}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1004586884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1004586884},{"type":"v1","addr":"172.21.15.159:6834","nonce":1004586884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2086004294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2086004294},{"type":"v1","addr":"172.21.15.159:6835","nonce":2086004294}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:29:15.154553+0000","modified":"2023-07-27T14:29:18.168905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1707534394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1707534394},{"type":"v1","addr":"172.21.15.115:6836","nonce":1707534394}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-07-27T14:29:18.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d5c05eec0 msgr2=0x7f7d5c061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d5c05eec0 0x7f7d5c061380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f7d64006d80 tx=0x7f7d64008040).stop 2023-07-27T14:29:18.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d700aa050 msgr2=0x7f7d701424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d700aa050 0x7f7d701424f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7d60009dd0 tx=0x7f7d60017000).stop 2023-07-27T14:29:18.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 shutdown_connections 2023-07-27T14:29:18.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d5c05eec0 0x7f7d5c061380 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d70153ec0 0x7f7d701530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:18.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d700aa050 0x7f7d701424f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 --2- 172.21.15.115:0/936806589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d700aaa40 0x7f7d701505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 >> 172.21.15.115:0/936806589 conn(0x7f7d700cb610 msgr2=0x7f7d700aae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:18.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 shutdown_connections 2023-07-27T14:29:18.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.616+0000 7f7d765ff700 1 -- 172.21.15.115:0/936806589 wait complete. 2023-07-27T14:29:18.642 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 25 2023-07-27T14:29:18.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:29:18.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.821+0000 7f6424bff700 1 Processor -- start 2023-07-27T14:29:18.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.821+0000 7f6424bff700 1 -- start start 2023-07-27T14:29:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.822+0000 7f6424bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 0x7f64200a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.822+0000 7f6424bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f64200aaa40 0x7f64200c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.822+0000 7f6424bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200aa4d0 con 0x7f64200aa050 2023-07-27T14:29:18.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.822+0000 7f6424bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64200c05c0 con 0x7f64200aaa40 2023-07-27T14:29:18.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.822+0000 7f6424bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64200bfc90 con 0x7f6420153ec0 2023-07-27T14:29:18.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641dd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f64200aa050 0x7f64200640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54598/0 (socket says 172.21.15.115:54598) 2023-07-27T14:29:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641dd9b700 1 -- 172.21.15.115:0/1076928936 learned_addr learned my addr 172.21.15.115:0/1076928936 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641ed9d700 1 --2- 172.21.15.115:0/1076928936 >> v2:172.21.15.159:3300/0 conn(0x7f64200aaa40 0x7f64200c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641e59c700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 0x7f64200a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758766186 0 0) 0x7f6414001110 con 0x7f64200aa050 2023-07-27T14:29:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64080033f0 con 0x7f64200aa050 2023-07-27T14:29:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2514226500 0 0) 0x7f64080033f0 con 0x7f64200aa050 2023-07-27T14:29:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 msgr2=0x7f64200a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.823+0000 7f641d59a700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 0x7f64200a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 >> v2:172.21.15.159:3300/0 conn(0x7f64200aaa40 msgr2=0x7f64200c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 --2- 172.21.15.115:0/1076928936 >> v2:172.21.15.159:3300/0 conn(0x7f64200aaa40 0x7f64200c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64200bff70 con 0x7f64200aa050 2023-07-27T14:29:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f6414001600 con 0x7f64200aa050 2023-07-27T14:29:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641e59c700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 0x7f64200a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 >> v1:172.21.15.115:6789/0 conn(0x7f64200aa050 legacy=0x7f64200640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64080038e0 0x7f6408003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 0x7f6408004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f6408005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64200c05c0 con 0x7f6408004b80 2023-07-27T14:29:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64200bfc90 con 0x7f64080038e0 2023-07-27T14:29:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6408004500 con 0x7f6420153ec0 2023-07-27T14:29:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641ed9d700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f6408005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641dd9b700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 0x7f6408004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641e59c700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64080038e0 0x7f6408003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641ed9d700 1 -- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 msgr2=0x7f6408004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641ed9d700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6420153ec0 0x7f6408004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641ed9d700 1 -- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64080038e0 msgr2=0x7f6408003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641ed9d700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64080038e0 0x7f6408003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.824+0000 7f641ed9d700 1 -- 172.21.15.115:0/1076928936 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100092a0 con 0x7f6408004b80 2023-07-27T14:29:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.825+0000 7f641ed9d700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f6408005000 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f64200c5490 tx=0x7f641800b040).ready entity=mon.0 client_cookie=c4db9afd47cd9e8c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.825+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418009ac0 con 0x7f6408004b80 2023-07-27T14:29:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.825+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641800f040 con 0x7f6408004b80 2023-07-27T14:29:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.825+0000 7f641d59a700 1 -- 172.21.15.115:0/1076928936 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800ec70 con 0x7f6408004b80 2023-07-27T14:29:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.825+0000 7f6424bff700 1 -- 172.21.15.115:0/1076928936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 msgr2=0x7f6408005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.825+0000 7f6424bff700 1 --2- 172.21.15.115:0/1076928936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f6408005000 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f64200c5490 tx=0x7f641800b040).stop 2023-07-27T14:29:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.825+0000 7f641ed9d700 1 -- 172.21.15.115:0/1076928936 reap_dead start 2023-07-27T14:29:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.826+0000 7f6424bff700 1 -- 172.21.15.115:0/1076928936 shutdown_connections 2023-07-27T14:29:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.826+0000 7f6424bff700 1 -- 172.21.15.115:0/1076928936 >> 172.21.15.115:0/1076928936 conn(0x7f64200cb610 msgr2=0x7f64200c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.826+0000 7f6424bff700 1 -- 172.21.15.115:0/1076928936 shutdown_connections 2023-07-27T14:29:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.826+0000 7f6424bff700 1 -- 172.21.15.115:0/1076928936 wait complete. 2023-07-27T14:29:18.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.828+0000 7f6424bff700 1 Processor -- start 2023-07-27T14:29:18.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.828+0000 7f6424bff700 1 -- start start 2023-07-27T14:29:18.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f6424bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f64200c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f6424bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64200c3410 0x7f6420151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f6424bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f642014c940 0x7f642014e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f6424bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64200c3890 con 0x7f6408004b80 2023-07-27T14:29:18.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f6424bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6420153250 con 0x7f642014c940 2023-07-27T14:29:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f6424bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64200c46b0 con 0x7f64200c3410 2023-07-27T14:29:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f641e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f64200c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f641e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f64200c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57988/0 (socket says 172.21.15.115:57988) 2023-07-27T14:29:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.829+0000 7f641e59c700 1 -- 172.21.15.115:0/2863356959 learned_addr learned my addr 172.21.15.115:0/2863356959 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f641dd9b700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64200c3410 0x7f6420151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f641ed9d700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f642014c940 0x7f642014e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f641e59c700 1 -- 172.21.15.115:0/2863356959 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64200c3410 msgr2=0x7f6420151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f641e59c700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64200c3410 0x7f6420151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f641e59c700 1 -- 172.21.15.115:0/2863356959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f642014c940 msgr2=0x7f642014e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f641e59c700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f642014c940 0x7f642014e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f641e59c700 1 -- 172.21.15.115:0/2863356959 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420151980 con 0x7f6408004b80 2023-07-27T14:29:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f641e59c700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f64200c4b40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f6410011b10 tx=0x7f6410009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f640e7fc700 1 -- 172.21.15.115:0/2863356959 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641000f930 con 0x7f6408004b80 2023-07-27T14:29:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f640e7fc700 1 -- 172.21.15.115:0/2863356959 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641000fa90 con 0x7f6408004b80 2023-07-27T14:29:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64200c3aa0 con 0x7f6408004b80 2023-07-27T14:29:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f640e7fc700 1 -- 172.21.15.115:0/2863356959 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641000fe10 con 0x7f6408004b80 2023-07-27T14:29:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.830+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64200c4060 con 0x7f6408004b80 2023-07-27T14:29:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.831+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64200c4990 con 0x7f6408004b80 2023-07-27T14:29:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.832+0000 7f640e7fc700 1 -- 172.21.15.115:0/2863356959 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f6410024070 con 0x7f6408004b80 2023-07-27T14:29:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.833+0000 7f640e7fc700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f640005eef0 0x7f64000613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.834+0000 7f640e7fc700 1 -- 172.21.15.115:0/2863356959 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f641007aa70 con 0x7f6408004b80 2023-07-27T14:29:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.834+0000 7f641dd9b700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f640005eef0 0x7f64000613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.834+0000 7f641dd9b700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f640005eef0 0x7f64000613b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f6414001730 tx=0x7f6414009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:18.838+0000 7f640e7fc700 1 -- 172.21.15.115:0/2863356959 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f641004bda0 con 0x7f6408004b80 2023-07-27T14:29:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.008+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f642006c470 con 0x7f6408004b80 2023-07-27T14:29:19.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.009+0000 7f640e7fc700 1 -- 172.21.15.115:0/2863356959 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f6410018030 con 0x7f6408004b80 2023-07-27T14:29:19.033 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:19.033 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":52,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:29:16.157430+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:29:13.551102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-27T14:29:14.136450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:29:19.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f640005eef0 msgr2=0x7f64000613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f640005eef0 0x7f64000613b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f6414001730 tx=0x7f6414009040).stop 2023-07-27T14:29:19.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 msgr2=0x7f64200c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f64200c4b40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f6410011b10 tx=0x7f6410009060).stop 2023-07-27T14:29:19.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 shutdown_connections 2023-07-27T14:29:19.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f640005eef0 0x7f64000613b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f642014c940 0x7f642014e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6408004b80 0x7f64200c4b40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 --2- 172.21.15.115:0/2863356959 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64200c3410 0x7f6420151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 >> 172.21.15.115:0/2863356959 conn(0x7f64200cb610 msgr2=0x7f64200ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 shutdown_connections 2023-07-27T14:29:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.011+0000 7f6424bff700 1 -- 172.21.15.115:0/2863356959 wait complete. 2023-07-27T14:29:19.052 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:29:19.053 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:29:19.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.216+0000 7f07bc1ff700 1 Processor -- start 2023-07-27T14:29:19.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.216+0000 7f07bc1ff700 1 -- start start 2023-07-27T14:29:19.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07bc1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07b40aaa40 0x7f07b40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07bc1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b40aa4d0 con 0x7f07b4153ec0 2023-07-27T14:29:19.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07bc1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b40c05c0 con 0x7f07b41542a0 2023-07-27T14:29:19.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07bc1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b40aa270 con 0x7f07b40aaa40 2023-07-27T14:29:19.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07b979a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07b40aaa40 0x7f07b40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07b979a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07b40aaa40 0x7f07b40640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58000/0 (socket says 172.21.15.115:58000) 2023-07-27T14:29:19.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07b979a700 1 -- 172.21.15.115:0/2812685560 learned_addr learned my addr 172.21.15.115:0/2812685560 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:19.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07b9f9b700 1 --1- 172.21.15.115:0/2812685560 >> v1:172.21.15.115:6789/0 conn(0x7f07b4153ec0 0x7f07b40a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54600/0 (socket says 172.21.15.115:54600) 2023-07-27T14:29:19.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07b979a700 1 -- 172.21.15.115:0/2812685560 >> v1:172.21.15.159:6789/0 conn(0x7f07b41542a0 legacy=0x7f07b40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:19.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07b979a700 1 -- 172.21.15.115:0/2812685560 >> v1:172.21.15.115:6789/0 conn(0x7f07b4153ec0 legacy=0x7f07b40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07b979a700 1 -- 172.21.15.115:0/2812685560 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40bfc90 con 0x7f07b40aaa40 2023-07-27T14:29:19.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.218+0000 7f07b8f99700 1 -- 172.21.15.115:0/2812685560 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989428034 0 0) 0x7f07b0001110 con 0x7f07b4153ec0 2023-07-27T14:29:19.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07b979a700 1 --2- 172.21.15.115:0/2812685560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b40640f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f07a4006fd0 tx=0x7f07a40090f0).ready entity=mon.0 client_cookie=4828e222c78a5616 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07b8f99700 1 -- 172.21.15.115:0/2812685560 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400b600 con 0x7f07b40aaa40 2023-07-27T14:29:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07b8f99700 1 -- 172.21.15.115:0/2812685560 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400b760 con 0x7f07b40aaa40 2023-07-27T14:29:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07b8f99700 1 -- 172.21.15.115:0/2812685560 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400bae0 con 0x7f07b40aaa40 2023-07-27T14:29:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07bc1ff700 1 -- 172.21.15.115:0/2812685560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 msgr2=0x7f07b40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07bc1ff700 1 --2- 172.21.15.115:0/2812685560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b40640f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f07a4006fd0 tx=0x7f07a40090f0).stop 2023-07-27T14:29:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07bc1ff700 1 -- 172.21.15.115:0/2812685560 shutdown_connections 2023-07-27T14:29:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07bc1ff700 1 --2- 172.21.15.115:0/2812685560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b40640f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07bc1ff700 1 -- 172.21.15.115:0/2812685560 >> 172.21.15.115:0/2812685560 conn(0x7f07b40cb610 msgr2=0x7f07b40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:19.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.219+0000 7f07bc1ff700 1 -- 172.21.15.115:0/2812685560 shutdown_connections 2023-07-27T14:29:19.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.220+0000 7f07bc1ff700 1 -- 172.21.15.115:0/2812685560 wait complete. 2023-07-27T14:29:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.221+0000 7f07bc1ff700 1 Processor -- start 2023-07-27T14:29:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.221+0000 7f07bc1ff700 1 -- start start 2023-07-27T14:29:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07bc1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b413d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07bc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b4153ec0 0x7f07b40c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07bc1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b41542a0 0x7f07b40c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07bc1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c38f0 con 0x7f07b40aaa40 2023-07-27T14:29:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07bc1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c4760 con 0x7f07b41542a0 2023-07-27T14:29:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07bc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c2ce0 con 0x7f07b4153ec0 2023-07-27T14:29:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07b9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b413d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07b9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b413d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58008/0 (socket says 172.21.15.115:58008) 2023-07-27T14:29:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07b9f9b700 1 -- 172.21.15.115:0/613980229 learned_addr learned my addr 172.21.15.115:0/613980229 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07b979a700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b4153ec0 0x7f07b40c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.222+0000 7f07ba79c700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b41542a0 0x7f07b40c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07b9f9b700 1 -- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b4153ec0 msgr2=0x7f07b40c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07b9f9b700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b4153ec0 0x7f07b40c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07b9f9b700 1 -- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b41542a0 msgr2=0x7f07b40c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07b9f9b700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b41542a0 0x7f07b40c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07b9f9b700 1 -- 172.21.15.115:0/613980229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009370 con 0x7f07b40aaa40 2023-07-27T14:29:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07ba79c700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b41542a0 0x7f07b40c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07b9f9b700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b413d2b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f07b000c510 tx=0x7f07b0007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07a9ffb700 1 -- 172.21.15.115:0/613980229 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00072e0 con 0x7f07b40aaa40 2023-07-27T14:29:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07a9ffb700 1 -- 172.21.15.115:0/613980229 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0007440 con 0x7f07b40aaa40 2023-07-27T14:29:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07a9ffb700 1 -- 172.21.15.115:0/613980229 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00058f0 con 0x7f07b40aaa40 2023-07-27T14:29:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b40c2fc0 con 0x7f07b40aaa40 2023-07-27T14:29:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.223+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b40c3580 con 0x7f07b40aaa40 2023-07-27T14:29:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.224+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b406c470 con 0x7f07b40aaa40 2023-07-27T14:29:19.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.225+0000 7f07a9ffb700 1 -- 172.21.15.115:0/613980229 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f07b0010070 con 0x7f07b40aaa40 2023-07-27T14:29:19.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.226+0000 7f07a9ffb700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f079805eef0 0x7f07980613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.226+0000 7f07a9ffb700 1 -- 172.21.15.115:0/613980229 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f07b0079390 con 0x7f07b40aaa40 2023-07-27T14:29:19.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.226+0000 7f07b979a700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f079805eef0 0x7f07980613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.226+0000 7f07b979a700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f079805eef0 0x7f07980613b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f07b40aae20 tx=0x7f07a4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:19.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.230+0000 7f07a9ffb700 1 -- 172.21.15.115:0/613980229 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f07b004a6c0 con 0x7f07b40aaa40 2023-07-27T14:29:19.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.394+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07b40c3a30 con 0x7f079805eef0 2023-07-27T14:29:19.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.405+0000 7f07a9ffb700 1 -- 172.21.15.115:0/613980229 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349970 (secure 0 0 0) 0x7f07a400b8d0 con 0x7f079805eef0 2023-07-27T14:29:19.434 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:19.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f079805eef0 msgr2=0x7f07980613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f079805eef0 0x7f07980613b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f07b40aae20 tx=0x7f07a4017000).stop 2023-07-27T14:29:19.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 msgr2=0x7f07b413d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b413d2b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f07b000c510 tx=0x7f07b0007ad0).stop 2023-07-27T14:29:19.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 shutdown_connections 2023-07-27T14:29:19.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f079805eef0 0x7f07980613b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b41542a0 0x7f07b40c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b40aaa40 0x7f07b413d2b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 --2- 172.21.15.115:0/613980229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b4153ec0 0x7f07b40c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 >> 172.21.15.115:0/613980229 conn(0x7f07b40cb610 msgr2=0x7f07b40ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:19.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 shutdown_connections 2023-07-27T14:29:19.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.410+0000 7f07bc1ff700 1 -- 172.21.15.115:0/613980229 wait complete. 2023-07-27T14:29:19.437 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:29:19.451 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-07-27T14:29:17.466744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":51904,"kb_used_data":4416,"kb_used_omap":0,"kb_used_meta":47424,"kb_avail":754922816,"statfs":{"total":773094113280,"available":773040963584,"internally_reserved":0,"allocated":4521984,"data_stored":1960816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":48562176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2997310,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-13,"num_read_kb":-32,"num_write":-574,"num_write_kb":-207826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3,"num_bytes_recovered":-3145728,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.191336"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:10.125736+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:29:10.125736+0000","last_peered":"2023-07-27T14:29:10.125736+0000","last_clean":"2023-07-27T14:29:10.125736+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:29:10.125736+0000","last_undegraded":"2023-07-27T14:29:10.125736+0000","last_fullsized":"2023-07-27T14:29:10.125736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:10.125148+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:29:10.125148+0000","last_peered":"2023-07-27T14:29:10.125148+0000","last_clean":"2023-07-27T14:29:10.125148+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:29:10.125148+0000","last_undegraded":"2023-07-27T14:29:10.125148+0000","last_fullsized":"2023-07-27T14:29:10.125148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:10.124967+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:29:10.124967+0000","last_peered":"2023-07-27T14:29:10.124967+0000","last_clean":"2023-07-27T14:29:10.124967+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:29:10.124967+0000","last_undegraded":"2023-07-27T14:29:10.124967+0000","last_fullsized":"2023-07-27T14:29:10.124967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:10.125144+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:29:10.125144+0000","last_peered":"2023-07-27T14:29:10.125144+0000","last_clean":"2023-07-27T14:29:10.125144+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:29:10.125144+0000","last_undegraded":"2023-07-27T14:29:10.125144+0000","last_fullsized":"2023-07-27T14:29:10.125144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":38,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:09.973844+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:29:09.973844+0000","last_peered":"2023-07-27T14:29:09.973844+0000","last_clean":"2023-07-27T14:29:09.973844+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:29:09.973844+0000","last_undegraded":"2023-07-27T14:29:09.973844+0000","last_fullsized":"2023-07-27T14:29:09.973844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:09.973854+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:29:09.973854+0000","last_peered":"2023-07-27T14:29:09.973854+0000","last_clean":"2023-07-27T14:29:09.973854+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:29:09.973854+0000","last_undegraded":"2023-07-27T14:29:09.973854+0000","last_fullsized":"2023-07-27T14:29:09.973854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:09.973850+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:29:09.973850+0000","last_peered":"2023-07-27T14:29:09.973850+0000","last_clean":"2023-07-27T14:29:09.973850+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:29:09.973850+0000","last_undegraded":"2023-07-27T14:29:09.973850+0000","last_fullsized":"2023-07-27T14:29:09.973850+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:10.125719+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:29:10.125719+0000","last_peered":"2023-07-27T14:29:10.125719+0000","last_clean":"2023-07-27T14:29:10.125719+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:29:10.125719+0000","last_undegraded":"2023-07-27T14:29:10.125719+0000","last_fullsized":"2023-07-27T14:29:10.125719+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:14.686151+0000","last_change":"2023-07-27T14:29:14.686151+0000","last_active":"2023-07-27T14:29:14.686151+0000","last_peered":"2023-07-27T14:29:14.686151+0000","last_clean":"2023-07-27T14:29:14.686151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:14.686151+0000","last_undegraded":"2023-07-27T14:29:14.686151+0000","last_fullsized":"2023-07-27T14:29:14.686151+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:29:13.679915+0000","last_change":"2023-07-27T14:29:13.679915+0000","last_active":"2023-07-27T14:29:13.679915+0000","last_peered":"2023-07-27T14:29:13.679915+0000","last_clean":"2023-07-27T14:29:13.679915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:29:13.679915+0000","last_undegraded":"2023-07-27T14:29:13.679915+0000","last_fullsized":"2023-07-27T14:29:13.679915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-27T14:29:10.125632+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:29:10.125632+0000","last_peered":"2023-07-27T14:29:10.125632+0000","last_clean":"2023-07-27T14:29:10.125632+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:29:10.125632+0000","last_undegraded":"2023-07-27T14:29:10.125632+0000","last_fullsized":"2023-07-27T14:29:10.125632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6512,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5952,"kb_avail":94365328,"statfs":{"total":96636764160,"available":96630095872,"internally_reserved":0,"allocated":565248,"data_stored":245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6094848},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67400000000000004,"15min":0.68000000000000005},"min":{"1min":0.46500000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.133,"15min":1.133},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93300000000000005,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81000000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.80500000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71299999999999997,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.78000000000000003,"5min":1.119,"15min":1.119},"last":0.628}]},{"osd":3,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.879,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.76900000000000002,"5min":1.165,"15min":1.165},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81999999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97899999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.76400000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86099999999999999,"5min":1.038,"15min":1.038},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.751,"15min":0.75800000000000001},"min":{"1min":0.55800000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89300000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.028,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.72299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6320,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":94365520,"statfs":{"total":96636764160,"available":96630292480,"internally_reserved":0,"allocated":565248,"data_stored":245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60199999999999998,"15min":0.59899999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81200000000000006,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81299999999999994,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.50600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65500000000000003,"15min":0.65000000000000002},"min":{"1min":0.56699999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.82999999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85599999999999998,"5min":0.872,"15min":0.872},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67500000000000004,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.879,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86299999999999999,"5min":1.198,"15min":1.198},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.52600000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88400000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.57499999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.625,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.87}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6320,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":94365520,"statfs":{"total":96636764160,"available":96630292480,"internally_reserved":0,"allocated":565248,"data_stored":245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.499,"5min":4.75,"15min":4.75},"last":0.308},{"interface":"front","average":{"1min":0.434,"5min":0.71399999999999997,"15min":0.76000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69899999999999995,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.58099999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.629,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.441},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66900000000000004,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70399999999999996,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.58699999999999997,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69899999999999995,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2010000000000001,"5min":2.181,"15min":2.181},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.50800000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.127,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95499999999999996,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1040000000000001,"5min":2.149,"15min":2.149},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.495,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.032,"5min":2.052,"15min":2.052},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.88800000000000001,"15min":0.91400000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.23,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.754}]},{"osd":7,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.103,"5min":2.016,"15min":2.016},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.871,"15min":0.88500000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.087,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.91900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6192,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":94365648,"statfs":{"total":96636764160,"available":96630423552,"internally_reserved":0,"allocated":565248,"data_stored":245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.501,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.27400000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56200000000000006,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.59099999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58699999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.52600000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98299999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99199999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.56299999999999994,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99199999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.746},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.046,"5min":1.079,"15min":1.079},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.58099999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6320,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":94365520,"statfs":{"total":96636764160,"available":96630292480,"internally_reserved":0,"allocated":565248,"data_stored":245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58099999999999996,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.501},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.63900000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69399999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.502},{"interface":"front","average":{"1min":0.501,"5min":0.54700000000000004,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71499999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98299999999999998,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.88},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.95099999999999996,"5min":1.014,"15min":1.014},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94299999999999995,"5min":1.26,"15min":1.26},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.57099999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0009999999999999,"5min":1.091,"15min":1.091},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.60299999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0189999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96199999999999997,"5min":1.036,"15min":1.036},"last":0.81599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6960,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":94364880,"statfs":{"total":96636764160,"available":96629637120,"internally_reserved":0,"allocated":565248,"data_stored":245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26500000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48999999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.35199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.53600000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66500000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.436,"15min":0.432},"min":{"1min":0.32600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.496,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.60399999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.499,"15min":0.498},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.70299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":1.149,"15min":1.149},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73999999999999999,"15min":0.73699999999999999},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0449999999999999,"5min":1.298,"15min":1.298},"last":0.872},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.755,"15min":0.749},"min":{"1min":0.55700000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78100000000000003,"15min":0.77800000000000002},"min":{"1min":0.61499999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0169999999999999,"5min":1.085,"15min":1.085},"last":1.117},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0620000000000001,"5min":1.24,"15min":1.24},"last":1.03}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":6320,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":94365520,"statfs":{"total":96636764160,"available":96630292480,"internally_reserved":0,"allocated":565248,"data_stored":245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.45800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.52900000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.872,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92900000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.53000000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97999999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56499999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92800000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0049999999999999,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.86399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6960,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":94364880,"statfs":{"total":96636764160,"available":96629637120,"internally_reserved":0,"allocated":565248,"data_stored":245102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85799999999999998,"5min":1.143,"15min":1.143},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.52000000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.84399999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59499999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90100000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96899999999999997,"5min":1.224,"15min":1.224},"last":0.754},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84999999999999998,"5min":1.056,"15min":1.056},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.006,"5min":1.085,"15min":1.085},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95499999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:29:19.459 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:29:19.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.656+0000 7f4830fff700 1 Processor -- start 2023-07-27T14:29:19.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.656+0000 7f4830fff700 1 -- start start 2023-07-27T14:29:19.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f4830fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f482c0c0e80 0x7f482c150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f4830fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c068380 con 0x7f482c150320 2023-07-27T14:29:19.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f4830fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c068ee0 con 0x7f482c0c1f70 2023-07-27T14:29:19.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f4830fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c065790 con 0x7f482c0c0e80 2023-07-27T14:29:19.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f482a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f482c150320 0x7f482c0c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54612/0 (socket says 172.21.15.115:54612) 2023-07-27T14:29:19.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f482a59c700 1 -- 172.21.15.115:0/1407519010 learned_addr learned my addr 172.21.15.115:0/1407519010 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:19.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f482ad9d700 1 --2- 172.21.15.115:0/1407519010 >> v2:172.21.15.115:3300/0 conn(0x7f482c0c0e80 0x7f482c150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f482ad9d700 1 -- 172.21.15.115:0/1407519010 >> v1:172.21.15.159:6789/0 conn(0x7f482c0c1f70 legacy=0x7f482c0bb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f482ad9d700 1 -- 172.21.15.115:0/1407519010 >> v1:172.21.15.115:6789/0 conn(0x7f482c150320 legacy=0x7f482c0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.658+0000 7f482959a700 1 -- 172.21.15.115:0/1407519010 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835037681 0 0) 0x7f482c068380 con 0x7f482c150320 2023-07-27T14:29:19.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.659+0000 7f482ad9d700 1 -- 172.21.15.115:0/1407519010 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0685b0 con 0x7f482c0c0e80 2023-07-27T14:29:19.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.659+0000 7f482ad9d700 1 --2- 172.21.15.115:0/1407519010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c0e80 0x7f482c150700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f4824009e60 tx=0x7f4824009780).ready entity=mon.0 client_cookie=d3fa973701d444d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:19.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.659+0000 7f482959a700 1 -- 172.21.15.115:0/1407519010 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482400e070 con 0x7f482c0c0e80 2023-07-27T14:29:19.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.659+0000 7f482959a700 1 -- 172.21.15.115:0/1407519010 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482400bc30 con 0x7f482c0c0e80 2023-07-27T14:29:19.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.659+0000 7f482959a700 1 -- 172.21.15.115:0/1407519010 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824012410 con 0x7f482c0c0e80 2023-07-27T14:29:19.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.659+0000 7f4830fff700 1 -- 172.21.15.115:0/1407519010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c0e80 msgr2=0x7f482c150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.659+0000 7f4830fff700 1 --2- 172.21.15.115:0/1407519010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c0e80 0x7f482c150700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f4824009e60 tx=0x7f4824009780).stop 2023-07-27T14:29:19.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.660+0000 7f4830fff700 1 -- 172.21.15.115:0/1407519010 shutdown_connections 2023-07-27T14:29:19.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.660+0000 7f4830fff700 1 --2- 172.21.15.115:0/1407519010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c0e80 0x7f482c150700 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.660+0000 7f4830fff700 1 -- 172.21.15.115:0/1407519010 >> 172.21.15.115:0/1407519010 conn(0x7f482c062320 msgr2=0x7f482c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:19.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.660+0000 7f4830fff700 1 -- 172.21.15.115:0/1407519010 shutdown_connections 2023-07-27T14:29:19.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.660+0000 7f4830fff700 1 -- 172.21.15.115:0/1407519010 wait complete. 2023-07-27T14:29:19.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.661+0000 7f4830fff700 1 Processor -- start 2023-07-27T14:29:19.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.661+0000 7f4830fff700 1 -- start start 2023-07-27T14:29:19.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4830fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f482c0c0e80 0x7f482c0bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4830fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c1f70 0x7f482c0a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4830fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f482c150320 0x7f482c0a8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4830fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0a8d00 con 0x7f482c0c1f70 2023-07-27T14:29:19.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4830fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0be6f0 con 0x7f482c150320 2023-07-27T14:29:19.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4830fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0be9d0 con 0x7f482c0c0e80 2023-07-27T14:29:19.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4829d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c1f70 0x7f482c0a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4829d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c1f70 0x7f482c0a8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58028/0 (socket says 172.21.15.115:58028) 2023-07-27T14:29:19.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.662+0000 7f4829d9b700 1 -- 172.21.15.115:0/3201105653 learned_addr learned my addr 172.21.15.115:0/3201105653 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:19.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f482a59c700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f482c0c0e80 0x7f482c0bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f482ad9d700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f482c150320 0x7f482c0a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f4829d9b700 1 -- 172.21.15.115:0/3201105653 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f482c0c0e80 msgr2=0x7f482c0bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f4829d9b700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f482c0c0e80 0x7f482c0bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f4829d9b700 1 -- 172.21.15.115:0/3201105653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f482c150320 msgr2=0x7f482c0a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f4829d9b700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f482c150320 0x7f482c0a8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f4829d9b700 1 -- 172.21.15.115:0/3201105653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4824009a20 con 0x7f482c0c1f70 2023-07-27T14:29:19.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f4829d9b700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c1f70 0x7f482c0a8320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f482000c4c0 tx=0x7f4820007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:19.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f481a7fc700 1 -- 172.21.15.115:0/3201105653 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820007020 con 0x7f482c0c1f70 2023-07-27T14:29:19.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f481a7fc700 1 -- 172.21.15.115:0/3201105653 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4820007180 con 0x7f482c0c1f70 2023-07-27T14:29:19.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c0becb0 con 0x7f482c0c1f70 2023-07-27T14:29:19.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f481a7fc700 1 -- 172.21.15.115:0/3201105653 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820007520 con 0x7f482c0c1f70 2023-07-27T14:29:19.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.663+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c0bf270 con 0x7f482c0c1f70 2023-07-27T14:29:19.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.664+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c06c470 con 0x7f482c0c1f70 2023-07-27T14:29:19.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.665+0000 7f481a7fc700 1 -- 172.21.15.115:0/3201105653 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f4820010070 con 0x7f482c0c1f70 2023-07-27T14:29:19.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.666+0000 7f481a7fc700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05eef0 0x7f480c0613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:19.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.666+0000 7f481a7fc700 1 -- 172.21.15.115:0/3201105653 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f48200790e0 con 0x7f482c0c1f70 2023-07-27T14:29:19.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.666+0000 7f482a59c700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05eef0 0x7f480c0613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:19.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.667+0000 7f482a59c700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05eef0 0x7f480c0613b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f481c000c00 tx=0x7f481c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:19.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.670+0000 7f481a7fc700 1 -- 172.21.15.115:0/3201105653 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f48200478f0 con 0x7f482c0c1f70 2023-07-27T14:29:19.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.837+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f482c0a8100 con 0x7f480c05eef0 2023-07-27T14:29:19.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.848+0000 7f481a7fc700 1 -- 172.21.15.115:0/3201105653 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361258 (secure 0 0 0) 0x7f482c0a8100 con 0x7f480c05eef0 2023-07-27T14:29:19.878 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:19.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05eef0 msgr2=0x7f480c0613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05eef0 0x7f480c0613b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f481c000c00 tx=0x7f481c009040).stop 2023-07-27T14:29:19.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c1f70 msgr2=0x7f482c0a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:19.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c1f70 0x7f482c0a8320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f482000c4c0 tx=0x7f4820007dd0).stop 2023-07-27T14:29:19.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 shutdown_connections 2023-07-27T14:29:19.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05eef0 0x7f480c0613b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f482c150320 0x7f482c0a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f482c0c0e80 0x7f482c0bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 --2- 172.21.15.115:0/3201105653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f482c0c1f70 0x7f482c0a8320 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:19.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 >> 172.21.15.115:0/3201105653 conn(0x7f482c062320 msgr2=0x7f482c063df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:19.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 shutdown_connections 2023-07-27T14:29:19.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:19.852+0000 7f4830fff700 1 -- 172.21.15.115:0/3201105653 wait complete. 2023-07-27T14:29:19.885 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:29:19.894 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-07-27T14:29:19.467145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":240,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":53952,"kb_used_data":4864,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":754920768,"statfs":{"total":773094113280,"available":773038866432,"internally_reserved":0,"allocated":4980736,"data_stored":2179692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2997310,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-13,"num_read_kb":-32,"num_write":-574,"num_write_kb":-207826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3,"num_bytes_recovered":-3145728,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.191336"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.179976+0000","last_change":"2023-07-27T14:29:15.176411+0000","last_active":"2023-07-27T14:29:15.179976+0000","last_peered":"2023-07-27T14:29:15.179976+0000","last_clean":"2023-07-27T14:29:15.179976+0000","last_became_active":"2023-07-27T14:29:15.176084+0000","last_became_peered":"2023-07-27T14:29:15.176084+0000","last_unstale":"2023-07-27T14:29:15.179976+0000","last_undegraded":"2023-07-27T14:29:15.179976+0000","last_fullsized":"2023-07-27T14:29:15.179976+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"51'3","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.186346+0000","last_change":"2023-07-27T14:29:14.720204+0000","last_active":"2023-07-27T14:29:15.186346+0000","last_peered":"2023-07-27T14:29:15.186346+0000","last_clean":"2023-07-27T14:29:15.186346+0000","last_became_active":"2023-07-27T14:29:14.719930+0000","last_became_peered":"2023-07-27T14:29:14.719930+0000","last_unstale":"2023-07-27T14:29:15.186346+0000","last_undegraded":"2023-07-27T14:29:15.186346+0000","last_fullsized":"2023-07-27T14:29:15.186346+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.188622+0000","last_change":"2023-07-27T14:29:15.183271+0000","last_active":"2023-07-27T14:29:15.188622+0000","last_peered":"2023-07-27T14:29:15.188622+0000","last_clean":"2023-07-27T14:29:15.188622+0000","last_became_active":"2023-07-27T14:29:15.182950+0000","last_became_peered":"2023-07-27T14:29:15.182950+0000","last_unstale":"2023-07-27T14:29:15.188622+0000","last_undegraded":"2023-07-27T14:29:15.188622+0000","last_fullsized":"2023-07-27T14:29:15.188622+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.162661+0000","last_change":"2023-07-27T14:29:14.716779+0000","last_active":"2023-07-27T14:29:15.162661+0000","last_peered":"2023-07-27T14:29:15.162661+0000","last_clean":"2023-07-27T14:29:15.162661+0000","last_became_active":"2023-07-27T14:29:14.716443+0000","last_became_peered":"2023-07-27T14:29:14.716443+0000","last_unstale":"2023-07-27T14:29:15.162661+0000","last_undegraded":"2023-07-27T14:29:15.162661+0000","last_fullsized":"2023-07-27T14:29:15.162661+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194421+0000","last_change":"2023-07-27T14:29:15.187273+0000","last_active":"2023-07-27T14:29:15.194421+0000","last_peered":"2023-07-27T14:29:15.194421+0000","last_clean":"2023-07-27T14:29:15.194421+0000","last_became_active":"2023-07-27T14:29:15.186989+0000","last_became_peered":"2023-07-27T14:29:15.186989+0000","last_unstale":"2023-07-27T14:29:15.194421+0000","last_undegraded":"2023-07-27T14:29:15.194421+0000","last_fullsized":"2023-07-27T14:29:15.194421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.167883+0000","last_change":"2023-07-27T14:29:14.713843+0000","last_active":"2023-07-27T14:29:15.167883+0000","last_peered":"2023-07-27T14:29:15.167883+0000","last_clean":"2023-07-27T14:29:15.167883+0000","last_became_active":"2023-07-27T14:29:14.713430+0000","last_became_peered":"2023-07-27T14:29:14.713430+0000","last_unstale":"2023-07-27T14:29:15.167883+0000","last_undegraded":"2023-07-27T14:29:15.167883+0000","last_fullsized":"2023-07-27T14:29:15.167883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.180067+0000","last_change":"2023-07-27T14:29:15.176514+0000","last_active":"2023-07-27T14:29:15.180067+0000","last_peered":"2023-07-27T14:29:15.180067+0000","last_clean":"2023-07-27T14:29:15.180067+0000","last_became_active":"2023-07-27T14:29:15.176185+0000","last_became_peered":"2023-07-27T14:29:15.176185+0000","last_unstale":"2023-07-27T14:29:15.180067+0000","last_undegraded":"2023-07-27T14:29:15.180067+0000","last_fullsized":"2023-07-27T14:29:15.180067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.193458+0000","last_change":"2023-07-27T14:29:14.711114+0000","last_active":"2023-07-27T14:29:15.193458+0000","last_peered":"2023-07-27T14:29:15.193458+0000","last_clean":"2023-07-27T14:29:15.193458+0000","last_became_active":"2023-07-27T14:29:14.709979+0000","last_became_peered":"2023-07-27T14:29:14.709979+0000","last_unstale":"2023-07-27T14:29:15.193458+0000","last_undegraded":"2023-07-27T14:29:15.193458+0000","last_fullsized":"2023-07-27T14:29:15.193458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.178613+0000","last_change":"2023-07-27T14:29:15.168924+0000","last_active":"2023-07-27T14:29:15.178613+0000","last_peered":"2023-07-27T14:29:15.178613+0000","last_clean":"2023-07-27T14:29:15.178613+0000","last_became_active":"2023-07-27T14:29:15.168635+0000","last_became_peered":"2023-07-27T14:29:15.168635+0000","last_unstale":"2023-07-27T14:29:15.178613+0000","last_undegraded":"2023-07-27T14:29:15.178613+0000","last_fullsized":"2023-07-27T14:29:15.178613+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.193429+0000","last_change":"2023-07-27T14:29:14.715730+0000","last_active":"2023-07-27T14:29:15.193429+0000","last_peered":"2023-07-27T14:29:15.193429+0000","last_clean":"2023-07-27T14:29:15.193429+0000","last_became_active":"2023-07-27T14:29:14.715436+0000","last_became_peered":"2023-07-27T14:29:14.715436+0000","last_unstale":"2023-07-27T14:29:15.193429+0000","last_undegraded":"2023-07-27T14:29:15.193429+0000","last_fullsized":"2023-07-27T14:29:15.193429+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185431+0000","last_change":"2023-07-27T14:29:15.183148+0000","last_active":"2023-07-27T14:29:15.185431+0000","last_peered":"2023-07-27T14:29:15.185431+0000","last_clean":"2023-07-27T14:29:15.185431+0000","last_became_active":"2023-07-27T14:29:15.182889+0000","last_became_peered":"2023-07-27T14:29:15.182889+0000","last_unstale":"2023-07-27T14:29:15.185431+0000","last_undegraded":"2023-07-27T14:29:15.185431+0000","last_fullsized":"2023-07-27T14:29:15.185431+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.182623+0000","last_change":"2023-07-27T14:29:14.716739+0000","last_active":"2023-07-27T14:29:15.182623+0000","last_peered":"2023-07-27T14:29:15.182623+0000","last_clean":"2023-07-27T14:29:15.182623+0000","last_became_active":"2023-07-27T14:29:14.716488+0000","last_became_peered":"2023-07-27T14:29:14.716488+0000","last_unstale":"2023-07-27T14:29:15.182623+0000","last_undegraded":"2023-07-27T14:29:15.182623+0000","last_fullsized":"2023-07-27T14:29:15.182623+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.180541+0000","last_change":"2023-07-27T14:29:15.176999+0000","last_active":"2023-07-27T14:29:15.180541+0000","last_peered":"2023-07-27T14:29:15.180541+0000","last_clean":"2023-07-27T14:29:15.180541+0000","last_became_active":"2023-07-27T14:29:15.176755+0000","last_became_peered":"2023-07-27T14:29:15.176755+0000","last_unstale":"2023-07-27T14:29:15.180541+0000","last_undegraded":"2023-07-27T14:29:15.180541+0000","last_fullsized":"2023-07-27T14:29:15.180541+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.173314+0000","last_change":"2023-07-27T14:29:14.724890+0000","last_active":"2023-07-27T14:29:15.173314+0000","last_peered":"2023-07-27T14:29:15.173314+0000","last_clean":"2023-07-27T14:29:15.173314+0000","last_became_active":"2023-07-27T14:29:14.724496+0000","last_became_peered":"2023-07-27T14:29:14.724496+0000","last_unstale":"2023-07-27T14:29:15.173314+0000","last_undegraded":"2023-07-27T14:29:15.173314+0000","last_fullsized":"2023-07-27T14:29:15.173314+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.195370+0000","last_change":"2023-07-27T14:29:15.190088+0000","last_active":"2023-07-27T14:29:15.195370+0000","last_peered":"2023-07-27T14:29:15.195370+0000","last_clean":"2023-07-27T14:29:15.195370+0000","last_became_active":"2023-07-27T14:29:15.189635+0000","last_became_peered":"2023-07-27T14:29:15.189635+0000","last_unstale":"2023-07-27T14:29:15.195370+0000","last_undegraded":"2023-07-27T14:29:15.195370+0000","last_fullsized":"2023-07-27T14:29:15.195370+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164969+0000","last_change":"2023-07-27T14:29:14.708121+0000","last_active":"2023-07-27T14:29:15.164969+0000","last_peered":"2023-07-27T14:29:15.164969+0000","last_clean":"2023-07-27T14:29:15.164969+0000","last_became_active":"2023-07-27T14:29:14.707523+0000","last_became_peered":"2023-07-27T14:29:14.707523+0000","last_unstale":"2023-07-27T14:29:15.164969+0000","last_undegraded":"2023-07-27T14:29:15.164969+0000","last_fullsized":"2023-07-27T14:29:15.164969+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194088+0000","last_change":"2023-07-27T14:29:15.186893+0000","last_active":"2023-07-27T14:29:15.194088+0000","last_peered":"2023-07-27T14:29:15.194088+0000","last_clean":"2023-07-27T14:29:15.194088+0000","last_became_active":"2023-07-27T14:29:15.186621+0000","last_became_peered":"2023-07-27T14:29:15.186621+0000","last_unstale":"2023-07-27T14:29:15.194088+0000","last_undegraded":"2023-07-27T14:29:15.194088+0000","last_fullsized":"2023-07-27T14:29:15.194088+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.168148+0000","last_change":"2023-07-27T14:29:14.720171+0000","last_active":"2023-07-27T14:29:15.168148+0000","last_peered":"2023-07-27T14:29:15.168148+0000","last_clean":"2023-07-27T14:29:15.168148+0000","last_became_active":"2023-07-27T14:29:14.719806+0000","last_became_peered":"2023-07-27T14:29:14.719806+0000","last_unstale":"2023-07-27T14:29:15.168148+0000","last_undegraded":"2023-07-27T14:29:15.168148+0000","last_fullsized":"2023-07-27T14:29:15.168148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194593+0000","last_change":"2023-07-27T14:29:15.188285+0000","last_active":"2023-07-27T14:29:15.194593+0000","last_peered":"2023-07-27T14:29:15.194593+0000","last_clean":"2023-07-27T14:29:15.194593+0000","last_became_active":"2023-07-27T14:29:15.187673+0000","last_became_peered":"2023-07-27T14:29:15.187673+0000","last_unstale":"2023-07-27T14:29:15.194593+0000","last_undegraded":"2023-07-27T14:29:15.194593+0000","last_fullsized":"2023-07-27T14:29:15.194593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.166054+0000","last_change":"2023-07-27T14:29:14.709207+0000","last_active":"2023-07-27T14:29:15.166054+0000","last_peered":"2023-07-27T14:29:15.166054+0000","last_clean":"2023-07-27T14:29:15.166054+0000","last_became_active":"2023-07-27T14:29:14.708931+0000","last_became_peered":"2023-07-27T14:29:14.708931+0000","last_unstale":"2023-07-27T14:29:15.166054+0000","last_undegraded":"2023-07-27T14:29:15.166054+0000","last_fullsized":"2023-07-27T14:29:15.166054+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.191863+0000","last_change":"2023-07-27T14:29:15.183039+0000","last_active":"2023-07-27T14:29:15.191863+0000","last_peered":"2023-07-27T14:29:15.191863+0000","last_clean":"2023-07-27T14:29:15.191863+0000","last_became_active":"2023-07-27T14:29:15.182644+0000","last_became_peered":"2023-07-27T14:29:15.182644+0000","last_unstale":"2023-07-27T14:29:15.191863+0000","last_undegraded":"2023-07-27T14:29:15.191863+0000","last_fullsized":"2023-07-27T14:29:15.191863+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.170717+0000","last_change":"2023-07-27T14:29:14.726444+0000","last_active":"2023-07-27T14:29:15.170717+0000","last_peered":"2023-07-27T14:29:15.170717+0000","last_clean":"2023-07-27T14:29:15.170717+0000","last_became_active":"2023-07-27T14:29:14.725981+0000","last_became_peered":"2023-07-27T14:29:14.725981+0000","last_unstale":"2023-07-27T14:29:15.170717+0000","last_undegraded":"2023-07-27T14:29:15.170717+0000","last_fullsized":"2023-07-27T14:29:15.170717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.188566+0000","last_change":"2023-07-27T14:29:15.186145+0000","last_active":"2023-07-27T14:29:15.188566+0000","last_peered":"2023-07-27T14:29:15.188566+0000","last_clean":"2023-07-27T14:29:15.188566+0000","last_became_active":"2023-07-27T14:29:15.185240+0000","last_became_peered":"2023-07-27T14:29:15.185240+0000","last_unstale":"2023-07-27T14:29:15.188566+0000","last_undegraded":"2023-07-27T14:29:15.188566+0000","last_fullsized":"2023-07-27T14:29:15.188566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.196760+0000","last_change":"2023-07-27T14:29:14.716340+0000","last_active":"2023-07-27T14:29:15.196760+0000","last_peered":"2023-07-27T14:29:15.196760+0000","last_clean":"2023-07-27T14:29:15.196760+0000","last_became_active":"2023-07-27T14:29:14.715767+0000","last_became_peered":"2023-07-27T14:29:14.715767+0000","last_unstale":"2023-07-27T14:29:15.196760+0000","last_undegraded":"2023-07-27T14:29:15.196760+0000","last_fullsized":"2023-07-27T14:29:15.196760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.188554+0000","last_change":"2023-07-27T14:29:15.183218+0000","last_active":"2023-07-27T14:29:15.188554+0000","last_peered":"2023-07-27T14:29:15.188554+0000","last_clean":"2023-07-27T14:29:15.188554+0000","last_became_active":"2023-07-27T14:29:15.182862+0000","last_became_peered":"2023-07-27T14:29:15.182862+0000","last_unstale":"2023-07-27T14:29:15.188554+0000","last_undegraded":"2023-07-27T14:29:15.188554+0000","last_fullsized":"2023-07-27T14:29:15.188554+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.184337+0000","last_change":"2023-07-27T14:29:14.720556+0000","last_active":"2023-07-27T14:29:15.184337+0000","last_peered":"2023-07-27T14:29:15.184337+0000","last_clean":"2023-07-27T14:29:15.184337+0000","last_became_active":"2023-07-27T14:29:14.720296+0000","last_became_peered":"2023-07-27T14:29:14.720296+0000","last_unstale":"2023-07-27T14:29:15.184337+0000","last_undegraded":"2023-07-27T14:29:15.184337+0000","last_fullsized":"2023-07-27T14:29:15.184337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.195157+0000","last_change":"2023-07-27T14:29:15.189069+0000","last_active":"2023-07-27T14:29:15.195157+0000","last_peered":"2023-07-27T14:29:15.195157+0000","last_clean":"2023-07-27T14:29:15.195157+0000","last_became_active":"2023-07-27T14:29:15.188814+0000","last_became_peered":"2023-07-27T14:29:15.188814+0000","last_unstale":"2023-07-27T14:29:15.195157+0000","last_undegraded":"2023-07-27T14:29:15.195157+0000","last_fullsized":"2023-07-27T14:29:15.195157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.169802+0000","last_change":"2023-07-27T14:29:14.720203+0000","last_active":"2023-07-27T14:29:15.169802+0000","last_peered":"2023-07-27T14:29:15.169802+0000","last_clean":"2023-07-27T14:29:15.169802+0000","last_became_active":"2023-07-27T14:29:14.719302+0000","last_became_peered":"2023-07-27T14:29:14.719302+0000","last_unstale":"2023-07-27T14:29:15.169802+0000","last_undegraded":"2023-07-27T14:29:15.169802+0000","last_fullsized":"2023-07-27T14:29:15.169802+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.188910+0000","last_change":"2023-07-27T14:29:15.186069+0000","last_active":"2023-07-27T14:29:15.188910+0000","last_peered":"2023-07-27T14:29:15.188910+0000","last_clean":"2023-07-27T14:29:15.188910+0000","last_became_active":"2023-07-27T14:29:15.185420+0000","last_became_peered":"2023-07-27T14:29:15.185420+0000","last_unstale":"2023-07-27T14:29:15.188910+0000","last_undegraded":"2023-07-27T14:29:15.188910+0000","last_fullsized":"2023-07-27T14:29:15.188910+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.159316+0000","last_change":"2023-07-27T14:29:14.708613+0000","last_active":"2023-07-27T14:29:15.159316+0000","last_peered":"2023-07-27T14:29:15.159316+0000","last_clean":"2023-07-27T14:29:15.159316+0000","last_became_active":"2023-07-27T14:29:14.707886+0000","last_became_peered":"2023-07-27T14:29:14.707886+0000","last_unstale":"2023-07-27T14:29:15.159316+0000","last_undegraded":"2023-07-27T14:29:15.159316+0000","last_fullsized":"2023-07-27T14:29:15.159316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.173052+0000","last_change":"2023-07-27T14:29:15.170268+0000","last_active":"2023-07-27T14:29:15.173052+0000","last_peered":"2023-07-27T14:29:15.173052+0000","last_clean":"2023-07-27T14:29:15.173052+0000","last_became_active":"2023-07-27T14:29:15.169969+0000","last_became_peered":"2023-07-27T14:29:15.169969+0000","last_unstale":"2023-07-27T14:29:15.173052+0000","last_undegraded":"2023-07-27T14:29:15.173052+0000","last_fullsized":"2023-07-27T14:29:15.173052+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194571+0000","last_change":"2023-07-27T14:29:14.709038+0000","last_active":"2023-07-27T14:29:15.194571+0000","last_peered":"2023-07-27T14:29:15.194571+0000","last_clean":"2023-07-27T14:29:15.194571+0000","last_became_active":"2023-07-27T14:29:14.708768+0000","last_became_peered":"2023-07-27T14:29:14.708768+0000","last_unstale":"2023-07-27T14:29:15.194571+0000","last_undegraded":"2023-07-27T14:29:15.194571+0000","last_fullsized":"2023-07-27T14:29:15.194571+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185281+0000","last_change":"2023-07-27T14:29:15.177509+0000","last_active":"2023-07-27T14:29:15.185281+0000","last_peered":"2023-07-27T14:29:15.185281+0000","last_clean":"2023-07-27T14:29:15.185281+0000","last_became_active":"2023-07-27T14:29:15.177110+0000","last_became_peered":"2023-07-27T14:29:15.177110+0000","last_unstale":"2023-07-27T14:29:15.185281+0000","last_undegraded":"2023-07-27T14:29:15.185281+0000","last_fullsized":"2023-07-27T14:29:15.185281+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.168219+0000","last_change":"2023-07-27T14:29:14.710668+0000","last_active":"2023-07-27T14:29:15.168219+0000","last_peered":"2023-07-27T14:29:15.168219+0000","last_clean":"2023-07-27T14:29:15.168219+0000","last_became_active":"2023-07-27T14:29:14.710382+0000","last_became_peered":"2023-07-27T14:29:14.710382+0000","last_unstale":"2023-07-27T14:29:15.168219+0000","last_undegraded":"2023-07-27T14:29:15.168219+0000","last_fullsized":"2023-07-27T14:29:15.168219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194613+0000","last_change":"2023-07-27T14:29:15.188397+0000","last_active":"2023-07-27T14:29:15.194613+0000","last_peered":"2023-07-27T14:29:15.194613+0000","last_clean":"2023-07-27T14:29:15.194613+0000","last_became_active":"2023-07-27T14:29:15.187978+0000","last_became_peered":"2023-07-27T14:29:15.187978+0000","last_unstale":"2023-07-27T14:29:15.194613+0000","last_undegraded":"2023-07-27T14:29:15.194613+0000","last_fullsized":"2023-07-27T14:29:15.194613+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.168692+0000","last_change":"2023-07-27T14:29:14.708820+0000","last_active":"2023-07-27T14:29:15.168692+0000","last_peered":"2023-07-27T14:29:15.168692+0000","last_clean":"2023-07-27T14:29:15.168692+0000","last_became_active":"2023-07-27T14:29:14.708357+0000","last_became_peered":"2023-07-27T14:29:14.708357+0000","last_unstale":"2023-07-27T14:29:15.168692+0000","last_undegraded":"2023-07-27T14:29:15.168692+0000","last_fullsized":"2023-07-27T14:29:15.168692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.188521+0000","last_change":"2023-07-27T14:29:15.182244+0000","last_active":"2023-07-27T14:29:15.188521+0000","last_peered":"2023-07-27T14:29:15.188521+0000","last_clean":"2023-07-27T14:29:15.188521+0000","last_became_active":"2023-07-27T14:29:15.181964+0000","last_became_peered":"2023-07-27T14:29:15.181964+0000","last_unstale":"2023-07-27T14:29:15.188521+0000","last_undegraded":"2023-07-27T14:29:15.188521+0000","last_fullsized":"2023-07-27T14:29:15.188521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194317+0000","last_change":"2023-07-27T14:29:14.719654+0000","last_active":"2023-07-27T14:29:15.194317+0000","last_peered":"2023-07-27T14:29:15.194317+0000","last_clean":"2023-07-27T14:29:15.194317+0000","last_became_active":"2023-07-27T14:29:14.719348+0000","last_became_peered":"2023-07-27T14:29:14.719348+0000","last_unstale":"2023-07-27T14:29:15.194317+0000","last_undegraded":"2023-07-27T14:29:15.194317+0000","last_fullsized":"2023-07-27T14:29:15.194317+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194737+0000","last_change":"2023-07-27T14:29:15.190299+0000","last_active":"2023-07-27T14:29:15.194737+0000","last_peered":"2023-07-27T14:29:15.194737+0000","last_clean":"2023-07-27T14:29:15.194737+0000","last_became_active":"2023-07-27T14:29:15.189796+0000","last_became_peered":"2023-07-27T14:29:15.189796+0000","last_unstale":"2023-07-27T14:29:15.194737+0000","last_undegraded":"2023-07-27T14:29:15.194737+0000","last_fullsized":"2023-07-27T14:29:15.194737+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164160+0000","last_change":"2023-07-27T14:29:14.721037+0000","last_active":"2023-07-27T14:29:15.164160+0000","last_peered":"2023-07-27T14:29:15.164160+0000","last_clean":"2023-07-27T14:29:15.164160+0000","last_became_active":"2023-07-27T14:29:14.720758+0000","last_became_peered":"2023-07-27T14:29:14.720758+0000","last_unstale":"2023-07-27T14:29:15.164160+0000","last_undegraded":"2023-07-27T14:29:15.164160+0000","last_fullsized":"2023-07-27T14:29:15.164160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185631+0000","last_change":"2023-07-27T14:29:15.180450+0000","last_active":"2023-07-27T14:29:15.185631+0000","last_peered":"2023-07-27T14:29:15.185631+0000","last_clean":"2023-07-27T14:29:15.185631+0000","last_became_active":"2023-07-27T14:29:15.180179+0000","last_became_peered":"2023-07-27T14:29:15.180179+0000","last_unstale":"2023-07-27T14:29:15.185631+0000","last_undegraded":"2023-07-27T14:29:15.185631+0000","last_fullsized":"2023-07-27T14:29:15.185631+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.182566+0000","last_change":"2023-07-27T14:29:14.707922+0000","last_active":"2023-07-27T14:29:15.182566+0000","last_peered":"2023-07-27T14:29:15.182566+0000","last_clean":"2023-07-27T14:29:15.182566+0000","last_became_active":"2023-07-27T14:29:14.707660+0000","last_became_peered":"2023-07-27T14:29:14.707660+0000","last_unstale":"2023-07-27T14:29:15.182566+0000","last_undegraded":"2023-07-27T14:29:15.182566+0000","last_fullsized":"2023-07-27T14:29:15.182566+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.193182+0000","last_change":"2023-07-27T14:29:15.191332+0000","last_active":"2023-07-27T14:29:15.193182+0000","last_peered":"2023-07-27T14:29:15.193182+0000","last_clean":"2023-07-27T14:29:15.193182+0000","last_became_active":"2023-07-27T14:29:15.190895+0000","last_became_peered":"2023-07-27T14:29:15.190895+0000","last_unstale":"2023-07-27T14:29:15.193182+0000","last_undegraded":"2023-07-27T14:29:15.193182+0000","last_fullsized":"2023-07-27T14:29:15.193182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.169538+0000","last_change":"2023-07-27T14:29:14.713529+0000","last_active":"2023-07-27T14:29:15.169538+0000","last_peered":"2023-07-27T14:29:15.169538+0000","last_clean":"2023-07-27T14:29:15.169538+0000","last_became_active":"2023-07-27T14:29:14.711593+0000","last_became_peered":"2023-07-27T14:29:14.711593+0000","last_unstale":"2023-07-27T14:29:15.169538+0000","last_undegraded":"2023-07-27T14:29:15.169538+0000","last_fullsized":"2023-07-27T14:29:15.169538+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.178889+0000","last_change":"2023-07-27T14:29:15.176166+0000","last_active":"2023-07-27T14:29:15.178889+0000","last_peered":"2023-07-27T14:29:15.178889+0000","last_clean":"2023-07-27T14:29:15.178889+0000","last_became_active":"2023-07-27T14:29:15.171779+0000","last_became_peered":"2023-07-27T14:29:15.171779+0000","last_unstale":"2023-07-27T14:29:15.178889+0000","last_undegraded":"2023-07-27T14:29:15.178889+0000","last_fullsized":"2023-07-27T14:29:15.178889+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164537+0000","last_change":"2023-07-27T14:29:14.718288+0000","last_active":"2023-07-27T14:29:15.164537+0000","last_peered":"2023-07-27T14:29:15.164537+0000","last_clean":"2023-07-27T14:29:15.164537+0000","last_became_active":"2023-07-27T14:29:14.718008+0000","last_became_peered":"2023-07-27T14:29:14.718008+0000","last_unstale":"2023-07-27T14:29:15.164537+0000","last_undegraded":"2023-07-27T14:29:15.164537+0000","last_fullsized":"2023-07-27T14:29:15.164537+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194374+0000","last_change":"2023-07-27T14:29:15.187866+0000","last_active":"2023-07-27T14:29:15.194374+0000","last_peered":"2023-07-27T14:29:15.194374+0000","last_clean":"2023-07-27T14:29:15.194374+0000","last_became_active":"2023-07-27T14:29:15.187386+0000","last_became_peered":"2023-07-27T14:29:15.187386+0000","last_unstale":"2023-07-27T14:29:15.194374+0000","last_undegraded":"2023-07-27T14:29:15.194374+0000","last_fullsized":"2023-07-27T14:29:15.194374+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.162917+0000","last_change":"2023-07-27T14:29:14.714534+0000","last_active":"2023-07-27T14:29:15.162917+0000","last_peered":"2023-07-27T14:29:15.162917+0000","last_clean":"2023-07-27T14:29:15.162917+0000","last_became_active":"2023-07-27T14:29:14.714213+0000","last_became_peered":"2023-07-27T14:29:14.714213+0000","last_unstale":"2023-07-27T14:29:15.162917+0000","last_undegraded":"2023-07-27T14:29:15.162917+0000","last_fullsized":"2023-07-27T14:29:15.162917+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194321+0000","last_change":"2023-07-27T14:29:15.186611+0000","last_active":"2023-07-27T14:29:15.194321+0000","last_peered":"2023-07-27T14:29:15.194321+0000","last_clean":"2023-07-27T14:29:15.194321+0000","last_became_active":"2023-07-27T14:29:15.186351+0000","last_became_peered":"2023-07-27T14:29:15.186351+0000","last_unstale":"2023-07-27T14:29:15.194321+0000","last_undegraded":"2023-07-27T14:29:15.194321+0000","last_fullsized":"2023-07-27T14:29:15.194321+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164139+0000","last_change":"2023-07-27T14:29:14.723453+0000","last_active":"2023-07-27T14:29:15.164139+0000","last_peered":"2023-07-27T14:29:15.164139+0000","last_clean":"2023-07-27T14:29:15.164139+0000","last_became_active":"2023-07-27T14:29:14.723164+0000","last_became_peered":"2023-07-27T14:29:14.723164+0000","last_unstale":"2023-07-27T14:29:15.164139+0000","last_undegraded":"2023-07-27T14:29:15.164139+0000","last_fullsized":"2023-07-27T14:29:15.164139+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185405+0000","last_change":"2023-07-27T14:29:15.183262+0000","last_active":"2023-07-27T14:29:15.185405+0000","last_peered":"2023-07-27T14:29:15.185405+0000","last_clean":"2023-07-27T14:29:15.185405+0000","last_became_active":"2023-07-27T14:29:15.182901+0000","last_became_peered":"2023-07-27T14:29:15.182901+0000","last_unstale":"2023-07-27T14:29:15.185405+0000","last_undegraded":"2023-07-27T14:29:15.185405+0000","last_fullsized":"2023-07-27T14:29:15.185405+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.165254+0000","last_change":"2023-07-27T14:29:14.720432+0000","last_active":"2023-07-27T14:29:15.165254+0000","last_peered":"2023-07-27T14:29:15.165254+0000","last_clean":"2023-07-27T14:29:15.165254+0000","last_became_active":"2023-07-27T14:29:14.720149+0000","last_became_peered":"2023-07-27T14:29:14.720149+0000","last_unstale":"2023-07-27T14:29:15.165254+0000","last_undegraded":"2023-07-27T14:29:15.165254+0000","last_fullsized":"2023-07-27T14:29:15.165254+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194783+0000","last_change":"2023-07-27T14:29:15.189805+0000","last_active":"2023-07-27T14:29:15.194783+0000","last_peered":"2023-07-27T14:29:15.194783+0000","last_clean":"2023-07-27T14:29:15.194783+0000","last_became_active":"2023-07-27T14:29:15.189529+0000","last_became_peered":"2023-07-27T14:29:15.189529+0000","last_unstale":"2023-07-27T14:29:15.194783+0000","last_undegraded":"2023-07-27T14:29:15.194783+0000","last_fullsized":"2023-07-27T14:29:15.194783+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.168007+0000","last_change":"2023-07-27T14:29:14.712785+0000","last_active":"2023-07-27T14:29:15.168007+0000","last_peered":"2023-07-27T14:29:15.168007+0000","last_clean":"2023-07-27T14:29:15.168007+0000","last_became_active":"2023-07-27T14:29:14.712488+0000","last_became_peered":"2023-07-27T14:29:14.712488+0000","last_unstale":"2023-07-27T14:29:15.168007+0000","last_undegraded":"2023-07-27T14:29:15.168007+0000","last_fullsized":"2023-07-27T14:29:15.168007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.188144+0000","last_change":"2023-07-27T14:29:15.184567+0000","last_active":"2023-07-27T14:29:15.188144+0000","last_peered":"2023-07-27T14:29:15.188144+0000","last_clean":"2023-07-27T14:29:15.188144+0000","last_became_active":"2023-07-27T14:29:15.184288+0000","last_became_peered":"2023-07-27T14:29:15.184288+0000","last_unstale":"2023-07-27T14:29:15.188144+0000","last_undegraded":"2023-07-27T14:29:15.188144+0000","last_fullsized":"2023-07-27T14:29:15.188144+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.165883+0000","last_change":"2023-07-27T14:29:14.716040+0000","last_active":"2023-07-27T14:29:15.165883+0000","last_peered":"2023-07-27T14:29:15.165883+0000","last_clean":"2023-07-27T14:29:15.165883+0000","last_became_active":"2023-07-27T14:29:14.715047+0000","last_became_peered":"2023-07-27T14:29:14.715047+0000","last_unstale":"2023-07-27T14:29:15.165883+0000","last_undegraded":"2023-07-27T14:29:15.165883+0000","last_fullsized":"2023-07-27T14:29:15.165883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.181777+0000","last_change":"2023-07-27T14:29:15.176174+0000","last_active":"2023-07-27T14:29:15.181777+0000","last_peered":"2023-07-27T14:29:15.181777+0000","last_clean":"2023-07-27T14:29:15.181777+0000","last_became_active":"2023-07-27T14:29:15.175760+0000","last_became_peered":"2023-07-27T14:29:15.175760+0000","last_unstale":"2023-07-27T14:29:15.181777+0000","last_undegraded":"2023-07-27T14:29:15.181777+0000","last_fullsized":"2023-07-27T14:29:15.181777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164104+0000","last_change":"2023-07-27T14:29:14.719900+0000","last_active":"2023-07-27T14:29:15.164104+0000","last_peered":"2023-07-27T14:29:15.164104+0000","last_clean":"2023-07-27T14:29:15.164104+0000","last_became_active":"2023-07-27T14:29:14.719596+0000","last_became_peered":"2023-07-27T14:29:14.719596+0000","last_unstale":"2023-07-27T14:29:15.164104+0000","last_undegraded":"2023-07-27T14:29:15.164104+0000","last_fullsized":"2023-07-27T14:29:15.164104+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194422+0000","last_change":"2023-07-27T14:29:15.188149+0000","last_active":"2023-07-27T14:29:15.194422+0000","last_peered":"2023-07-27T14:29:15.194422+0000","last_clean":"2023-07-27T14:29:15.194422+0000","last_became_active":"2023-07-27T14:29:15.187115+0000","last_became_peered":"2023-07-27T14:29:15.187115+0000","last_unstale":"2023-07-27T14:29:15.194422+0000","last_undegraded":"2023-07-27T14:29:15.194422+0000","last_fullsized":"2023-07-27T14:29:15.194422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.167135+0000","last_change":"2023-07-27T14:29:14.714649+0000","last_active":"2023-07-27T14:29:15.167135+0000","last_peered":"2023-07-27T14:29:15.167135+0000","last_clean":"2023-07-27T14:29:15.167135+0000","last_became_active":"2023-07-27T14:29:14.714328+0000","last_became_peered":"2023-07-27T14:29:14.714328+0000","last_unstale":"2023-07-27T14:29:15.167135+0000","last_undegraded":"2023-07-27T14:29:15.167135+0000","last_fullsized":"2023-07-27T14:29:15.167135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.188930+0000","last_change":"2023-07-27T14:29:15.186258+0000","last_active":"2023-07-27T14:29:15.188930+0000","last_peered":"2023-07-27T14:29:15.188930+0000","last_clean":"2023-07-27T14:29:15.188930+0000","last_became_active":"2023-07-27T14:29:15.185786+0000","last_became_peered":"2023-07-27T14:29:15.185786+0000","last_unstale":"2023-07-27T14:29:15.188930+0000","last_undegraded":"2023-07-27T14:29:15.188930+0000","last_fullsized":"2023-07-27T14:29:15.188930+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.159221+0000","last_change":"2023-07-27T14:29:14.708804+0000","last_active":"2023-07-27T14:29:15.159221+0000","last_peered":"2023-07-27T14:29:15.159221+0000","last_clean":"2023-07-27T14:29:15.159221+0000","last_became_active":"2023-07-27T14:29:14.708315+0000","last_became_peered":"2023-07-27T14:29:14.708315+0000","last_unstale":"2023-07-27T14:29:15.159221+0000","last_undegraded":"2023-07-27T14:29:15.159221+0000","last_fullsized":"2023-07-27T14:29:15.159221+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194280+0000","last_change":"2023-07-27T14:29:15.187154+0000","last_active":"2023-07-27T14:29:15.194280+0000","last_peered":"2023-07-27T14:29:15.194280+0000","last_clean":"2023-07-27T14:29:15.194280+0000","last_became_active":"2023-07-27T14:29:15.186893+0000","last_became_peered":"2023-07-27T14:29:15.186893+0000","last_unstale":"2023-07-27T14:29:15.194280+0000","last_undegraded":"2023-07-27T14:29:15.194280+0000","last_fullsized":"2023-07-27T14:29:15.194280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.163572+0000","last_change":"2023-07-27T14:29:14.724853+0000","last_active":"2023-07-27T14:29:15.163572+0000","last_peered":"2023-07-27T14:29:15.163572+0000","last_clean":"2023-07-27T14:29:15.163572+0000","last_became_active":"2023-07-27T14:29:14.724550+0000","last_became_peered":"2023-07-27T14:29:14.724550+0000","last_unstale":"2023-07-27T14:29:15.163572+0000","last_undegraded":"2023-07-27T14:29:15.163572+0000","last_fullsized":"2023-07-27T14:29:15.163572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.189003+0000","last_change":"2023-07-27T14:29:15.186959+0000","last_active":"2023-07-27T14:29:15.189003+0000","last_peered":"2023-07-27T14:29:15.189003+0000","last_clean":"2023-07-27T14:29:15.189003+0000","last_became_active":"2023-07-27T14:29:15.186648+0000","last_became_peered":"2023-07-27T14:29:15.186648+0000","last_unstale":"2023-07-27T14:29:15.189003+0000","last_undegraded":"2023-07-27T14:29:15.189003+0000","last_fullsized":"2023-07-27T14:29:15.189003+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185794+0000","last_change":"2023-07-27T14:29:14.704992+0000","last_active":"2023-07-27T14:29:15.185794+0000","last_peered":"2023-07-27T14:29:15.185794+0000","last_clean":"2023-07-27T14:29:15.185794+0000","last_became_active":"2023-07-27T14:29:14.704606+0000","last_became_peered":"2023-07-27T14:29:14.704606+0000","last_unstale":"2023-07-27T14:29:15.185794+0000","last_undegraded":"2023-07-27T14:29:15.185794+0000","last_fullsized":"2023-07-27T14:29:15.185794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.187324+0000","last_change":"2023-07-27T14:29:15.183788+0000","last_active":"2023-07-27T14:29:15.187324+0000","last_peered":"2023-07-27T14:29:15.187324+0000","last_clean":"2023-07-27T14:29:15.187324+0000","last_became_active":"2023-07-27T14:29:15.183475+0000","last_became_peered":"2023-07-27T14:29:15.183475+0000","last_unstale":"2023-07-27T14:29:15.187324+0000","last_undegraded":"2023-07-27T14:29:15.187324+0000","last_fullsized":"2023-07-27T14:29:15.187324+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.191093+0000","last_change":"2023-07-27T14:29:14.714467+0000","last_active":"2023-07-27T14:29:15.191093+0000","last_peered":"2023-07-27T14:29:15.191093+0000","last_clean":"2023-07-27T14:29:15.191093+0000","last_became_active":"2023-07-27T14:29:14.714149+0000","last_became_peered":"2023-07-27T14:29:14.714149+0000","last_unstale":"2023-07-27T14:29:15.191093+0000","last_undegraded":"2023-07-27T14:29:15.191093+0000","last_fullsized":"2023-07-27T14:29:15.191093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.186270+0000","last_change":"2023-07-27T14:29:15.183972+0000","last_active":"2023-07-27T14:29:15.186270+0000","last_peered":"2023-07-27T14:29:15.186270+0000","last_clean":"2023-07-27T14:29:15.186270+0000","last_became_active":"2023-07-27T14:29:15.183680+0000","last_became_peered":"2023-07-27T14:29:15.183680+0000","last_unstale":"2023-07-27T14:29:15.186270+0000","last_undegraded":"2023-07-27T14:29:15.186270+0000","last_fullsized":"2023-07-27T14:29:15.186270+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.191618+0000","last_change":"2023-07-27T14:29:14.715179+0000","last_active":"2023-07-27T14:29:15.191618+0000","last_peered":"2023-07-27T14:29:15.191618+0000","last_clean":"2023-07-27T14:29:15.191618+0000","last_became_active":"2023-07-27T14:29:14.714873+0000","last_became_peered":"2023-07-27T14:29:14.714873+0000","last_unstale":"2023-07-27T14:29:15.191618+0000","last_undegraded":"2023-07-27T14:29:15.191618+0000","last_fullsized":"2023-07-27T14:29:15.191618+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.170844+0000","last_change":"2023-07-27T14:29:15.167460+0000","last_active":"2023-07-27T14:29:15.170844+0000","last_peered":"2023-07-27T14:29:15.170844+0000","last_clean":"2023-07-27T14:29:15.170844+0000","last_became_active":"2023-07-27T14:29:15.167204+0000","last_became_peered":"2023-07-27T14:29:15.167204+0000","last_unstale":"2023-07-27T14:29:15.170844+0000","last_undegraded":"2023-07-27T14:29:15.170844+0000","last_fullsized":"2023-07-27T14:29:15.170844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.165975+0000","last_change":"2023-07-27T14:29:14.721827+0000","last_active":"2023-07-27T14:29:15.165975+0000","last_peered":"2023-07-27T14:29:15.165975+0000","last_clean":"2023-07-27T14:29:15.165975+0000","last_became_active":"2023-07-27T14:29:14.721518+0000","last_became_peered":"2023-07-27T14:29:14.721518+0000","last_unstale":"2023-07-27T14:29:15.165975+0000","last_undegraded":"2023-07-27T14:29:15.165975+0000","last_fullsized":"2023-07-27T14:29:15.165975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194059+0000","last_change":"2023-07-27T14:29:15.190779+0000","last_active":"2023-07-27T14:29:15.194059+0000","last_peered":"2023-07-27T14:29:15.194059+0000","last_clean":"2023-07-27T14:29:15.194059+0000","last_became_active":"2023-07-27T14:29:15.190466+0000","last_became_peered":"2023-07-27T14:29:15.190466+0000","last_unstale":"2023-07-27T14:29:15.194059+0000","last_undegraded":"2023-07-27T14:29:15.194059+0000","last_fullsized":"2023-07-27T14:29:15.194059+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.166731+0000","last_change":"2023-07-27T14:29:14.716839+0000","last_active":"2023-07-27T14:29:15.166731+0000","last_peered":"2023-07-27T14:29:15.166731+0000","last_clean":"2023-07-27T14:29:15.166731+0000","last_became_active":"2023-07-27T14:29:14.716225+0000","last_became_peered":"2023-07-27T14:29:14.716225+0000","last_unstale":"2023-07-27T14:29:15.166731+0000","last_undegraded":"2023-07-27T14:29:15.166731+0000","last_fullsized":"2023-07-27T14:29:15.166731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.187809+0000","last_change":"2023-07-27T14:29:15.181802+0000","last_active":"2023-07-27T14:29:15.187809+0000","last_peered":"2023-07-27T14:29:15.187809+0000","last_clean":"2023-07-27T14:29:15.187809+0000","last_became_active":"2023-07-27T14:29:15.181459+0000","last_became_peered":"2023-07-27T14:29:15.181459+0000","last_unstale":"2023-07-27T14:29:15.187809+0000","last_undegraded":"2023-07-27T14:29:15.187809+0000","last_fullsized":"2023-07-27T14:29:15.187809+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.167299+0000","last_change":"2023-07-27T14:29:14.709672+0000","last_active":"2023-07-27T14:29:15.167299+0000","last_peered":"2023-07-27T14:29:15.167299+0000","last_clean":"2023-07-27T14:29:15.167299+0000","last_became_active":"2023-07-27T14:29:14.709397+0000","last_became_peered":"2023-07-27T14:29:14.709397+0000","last_unstale":"2023-07-27T14:29:15.167299+0000","last_undegraded":"2023-07-27T14:29:15.167299+0000","last_fullsized":"2023-07-27T14:29:15.167299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.180176+0000","last_change":"2023-07-27T14:29:15.176665+0000","last_active":"2023-07-27T14:29:15.180176+0000","last_peered":"2023-07-27T14:29:15.180176+0000","last_clean":"2023-07-27T14:29:15.180176+0000","last_became_active":"2023-07-27T14:29:15.176376+0000","last_became_peered":"2023-07-27T14:29:15.176376+0000","last_unstale":"2023-07-27T14:29:15.180176+0000","last_undegraded":"2023-07-27T14:29:15.180176+0000","last_fullsized":"2023-07-27T14:29:15.180176+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164655+0000","last_change":"2023-07-27T14:29:14.717241+0000","last_active":"2023-07-27T14:29:15.164655+0000","last_peered":"2023-07-27T14:29:15.164655+0000","last_clean":"2023-07-27T14:29:15.164655+0000","last_became_active":"2023-07-27T14:29:14.716876+0000","last_became_peered":"2023-07-27T14:29:14.716876+0000","last_unstale":"2023-07-27T14:29:15.164655+0000","last_undegraded":"2023-07-27T14:29:15.164655+0000","last_fullsized":"2023-07-27T14:29:15.164655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.196627+0000","last_change":"2023-07-27T14:29:15.194469+0000","last_active":"2023-07-27T14:29:15.196627+0000","last_peered":"2023-07-27T14:29:15.196627+0000","last_clean":"2023-07-27T14:29:15.196627+0000","last_became_active":"2023-07-27T14:29:15.194157+0000","last_became_peered":"2023-07-27T14:29:15.194157+0000","last_unstale":"2023-07-27T14:29:15.196627+0000","last_undegraded":"2023-07-27T14:29:15.196627+0000","last_fullsized":"2023-07-27T14:29:15.196627+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.165056+0000","last_change":"2023-07-27T14:29:14.708293+0000","last_active":"2023-07-27T14:29:15.165056+0000","last_peered":"2023-07-27T14:29:15.165056+0000","last_clean":"2023-07-27T14:29:15.165056+0000","last_became_active":"2023-07-27T14:29:14.707867+0000","last_became_peered":"2023-07-27T14:29:14.707867+0000","last_unstale":"2023-07-27T14:29:15.165056+0000","last_undegraded":"2023-07-27T14:29:15.165056+0000","last_fullsized":"2023-07-27T14:29:15.165056+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.191235+0000","last_change":"2023-07-27T14:29:15.187630+0000","last_active":"2023-07-27T14:29:15.191235+0000","last_peered":"2023-07-27T14:29:15.191235+0000","last_clean":"2023-07-27T14:29:15.191235+0000","last_became_active":"2023-07-27T14:29:15.187354+0000","last_became_peered":"2023-07-27T14:29:15.187354+0000","last_unstale":"2023-07-27T14:29:15.191235+0000","last_undegraded":"2023-07-27T14:29:15.191235+0000","last_fullsized":"2023-07-27T14:29:15.191235+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.175012+0000","last_change":"2023-07-27T14:29:14.720136+0000","last_active":"2023-07-27T14:29:15.175012+0000","last_peered":"2023-07-27T14:29:15.175012+0000","last_clean":"2023-07-27T14:29:15.175012+0000","last_became_active":"2023-07-27T14:29:14.719601+0000","last_became_peered":"2023-07-27T14:29:14.719601+0000","last_unstale":"2023-07-27T14:29:15.175012+0000","last_undegraded":"2023-07-27T14:29:15.175012+0000","last_fullsized":"2023-07-27T14:29:15.175012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.183669+0000","last_change":"2023-07-27T14:29:15.172330+0000","last_active":"2023-07-27T14:29:15.183669+0000","last_peered":"2023-07-27T14:29:15.183669+0000","last_clean":"2023-07-27T14:29:15.183669+0000","last_became_active":"2023-07-27T14:29:15.172014+0000","last_became_peered":"2023-07-27T14:29:15.172014+0000","last_unstale":"2023-07-27T14:29:15.183669+0000","last_undegraded":"2023-07-27T14:29:15.183669+0000","last_fullsized":"2023-07-27T14:29:15.183669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.168831+0000","last_change":"2023-07-27T14:29:14.708628+0000","last_active":"2023-07-27T14:29:15.168831+0000","last_peered":"2023-07-27T14:29:15.168831+0000","last_clean":"2023-07-27T14:29:15.168831+0000","last_became_active":"2023-07-27T14:29:14.707910+0000","last_became_peered":"2023-07-27T14:29:14.707910+0000","last_unstale":"2023-07-27T14:29:15.168831+0000","last_undegraded":"2023-07-27T14:29:15.168831+0000","last_fullsized":"2023-07-27T14:29:15.168831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194857+0000","last_change":"2023-07-27T14:29:15.189459+0000","last_active":"2023-07-27T14:29:15.194857+0000","last_peered":"2023-07-27T14:29:15.194857+0000","last_clean":"2023-07-27T14:29:15.194857+0000","last_became_active":"2023-07-27T14:29:15.189207+0000","last_became_peered":"2023-07-27T14:29:15.189207+0000","last_unstale":"2023-07-27T14:29:15.194857+0000","last_undegraded":"2023-07-27T14:29:15.194857+0000","last_fullsized":"2023-07-27T14:29:15.194857+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.192679+0000","last_change":"2023-07-27T14:29:14.725183+0000","last_active":"2023-07-27T14:29:15.192679+0000","last_peered":"2023-07-27T14:29:15.192679+0000","last_clean":"2023-07-27T14:29:15.192679+0000","last_became_active":"2023-07-27T14:29:14.724434+0000","last_became_peered":"2023-07-27T14:29:14.724434+0000","last_unstale":"2023-07-27T14:29:15.192679+0000","last_undegraded":"2023-07-27T14:29:15.192679+0000","last_fullsized":"2023-07-27T14:29:15.192679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.184233+0000","last_change":"2023-07-27T14:29:15.180154+0000","last_active":"2023-07-27T14:29:15.184233+0000","last_peered":"2023-07-27T14:29:15.184233+0000","last_clean":"2023-07-27T14:29:15.184233+0000","last_became_active":"2023-07-27T14:29:15.179768+0000","last_became_peered":"2023-07-27T14:29:15.179768+0000","last_unstale":"2023-07-27T14:29:15.184233+0000","last_undegraded":"2023-07-27T14:29:15.184233+0000","last_fullsized":"2023-07-27T14:29:15.184233+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.183485+0000","last_change":"2023-07-27T14:29:14.716136+0000","last_active":"2023-07-27T14:29:15.183485+0000","last_peered":"2023-07-27T14:29:15.183485+0000","last_clean":"2023-07-27T14:29:15.183485+0000","last_became_active":"2023-07-27T14:29:14.715836+0000","last_became_peered":"2023-07-27T14:29:14.715836+0000","last_unstale":"2023-07-27T14:29:15.183485+0000","last_undegraded":"2023-07-27T14:29:15.183485+0000","last_fullsized":"2023-07-27T14:29:15.183485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.187126+0000","last_change":"2023-07-27T14:29:15.183099+0000","last_active":"2023-07-27T14:29:15.187126+0000","last_peered":"2023-07-27T14:29:15.187126+0000","last_clean":"2023-07-27T14:29:15.187126+0000","last_became_active":"2023-07-27T14:29:15.182811+0000","last_became_peered":"2023-07-27T14:29:15.182811+0000","last_unstale":"2023-07-27T14:29:15.187126+0000","last_undegraded":"2023-07-27T14:29:15.187126+0000","last_fullsized":"2023-07-27T14:29:15.187126+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.193332+0000","last_change":"2023-07-27T14:29:14.716993+0000","last_active":"2023-07-27T14:29:15.193332+0000","last_peered":"2023-07-27T14:29:15.193332+0000","last_clean":"2023-07-27T14:29:15.193332+0000","last_became_active":"2023-07-27T14:29:14.716590+0000","last_became_peered":"2023-07-27T14:29:14.716590+0000","last_unstale":"2023-07-27T14:29:15.193332+0000","last_undegraded":"2023-07-27T14:29:15.193332+0000","last_fullsized":"2023-07-27T14:29:15.193332+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194498+0000","last_change":"2023-07-27T14:29:15.188320+0000","last_active":"2023-07-27T14:29:15.194498+0000","last_peered":"2023-07-27T14:29:15.194498+0000","last_clean":"2023-07-27T14:29:15.194498+0000","last_became_active":"2023-07-27T14:29:15.187408+0000","last_became_peered":"2023-07-27T14:29:15.187408+0000","last_unstale":"2023-07-27T14:29:15.194498+0000","last_undegraded":"2023-07-27T14:29:15.194498+0000","last_fullsized":"2023-07-27T14:29:15.194498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.163022+0000","last_change":"2023-07-27T14:29:14.709845+0000","last_active":"2023-07-27T14:29:15.163022+0000","last_peered":"2023-07-27T14:29:15.163022+0000","last_clean":"2023-07-27T14:29:15.163022+0000","last_became_active":"2023-07-27T14:29:14.709543+0000","last_became_peered":"2023-07-27T14:29:14.709543+0000","last_unstale":"2023-07-27T14:29:15.163022+0000","last_undegraded":"2023-07-27T14:29:15.163022+0000","last_fullsized":"2023-07-27T14:29:15.163022+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185967+0000","last_change":"2023-07-27T14:29:15.183142+0000","last_active":"2023-07-27T14:29:15.185967+0000","last_peered":"2023-07-27T14:29:15.185967+0000","last_clean":"2023-07-27T14:29:15.185967+0000","last_became_active":"2023-07-27T14:29:15.182847+0000","last_became_peered":"2023-07-27T14:29:15.182847+0000","last_unstale":"2023-07-27T14:29:15.185967+0000","last_undegraded":"2023-07-27T14:29:15.185967+0000","last_fullsized":"2023-07-27T14:29:15.185967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.172802+0000","last_change":"2023-07-27T14:29:14.720780+0000","last_active":"2023-07-27T14:29:15.172802+0000","last_peered":"2023-07-27T14:29:15.172802+0000","last_clean":"2023-07-27T14:29:15.172802+0000","last_became_active":"2023-07-27T14:29:14.720491+0000","last_became_peered":"2023-07-27T14:29:14.720491+0000","last_unstale":"2023-07-27T14:29:15.172802+0000","last_undegraded":"2023-07-27T14:29:15.172802+0000","last_fullsized":"2023-07-27T14:29:15.172802+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194393+0000","last_change":"2023-07-27T14:29:15.187945+0000","last_active":"2023-07-27T14:29:15.194393+0000","last_peered":"2023-07-27T14:29:15.194393+0000","last_clean":"2023-07-27T14:29:15.194393+0000","last_became_active":"2023-07-27T14:29:15.187694+0000","last_became_peered":"2023-07-27T14:29:15.187694+0000","last_unstale":"2023-07-27T14:29:15.194393+0000","last_undegraded":"2023-07-27T14:29:15.194393+0000","last_fullsized":"2023-07-27T14:29:15.194393+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185818+0000","last_change":"2023-07-27T14:29:14.714234+0000","last_active":"2023-07-27T14:29:15.185818+0000","last_peered":"2023-07-27T14:29:15.185818+0000","last_clean":"2023-07-27T14:29:15.185818+0000","last_became_active":"2023-07-27T14:29:14.713936+0000","last_became_peered":"2023-07-27T14:29:14.713936+0000","last_unstale":"2023-07-27T14:29:15.185818+0000","last_undegraded":"2023-07-27T14:29:15.185818+0000","last_fullsized":"2023-07-27T14:29:15.185818+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185882+0000","last_change":"2023-07-27T14:29:15.177293+0000","last_active":"2023-07-27T14:29:15.185882+0000","last_peered":"2023-07-27T14:29:15.185882+0000","last_clean":"2023-07-27T14:29:15.185882+0000","last_became_active":"2023-07-27T14:29:15.176564+0000","last_became_peered":"2023-07-27T14:29:15.176564+0000","last_unstale":"2023-07-27T14:29:15.185882+0000","last_undegraded":"2023-07-27T14:29:15.185882+0000","last_fullsized":"2023-07-27T14:29:15.185882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.193597+0000","last_change":"2023-07-27T14:29:14.715368+0000","last_active":"2023-07-27T14:29:15.193597+0000","last_peered":"2023-07-27T14:29:15.193597+0000","last_clean":"2023-07-27T14:29:15.193597+0000","last_became_active":"2023-07-27T14:29:14.715063+0000","last_became_peered":"2023-07-27T14:29:14.715063+0000","last_unstale":"2023-07-27T14:29:15.193597+0000","last_undegraded":"2023-07-27T14:29:15.193597+0000","last_fullsized":"2023-07-27T14:29:15.193597+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.192823+0000","last_change":"2023-07-27T14:29:15.191924+0000","last_active":"2023-07-27T14:29:15.192823+0000","last_peered":"2023-07-27T14:29:15.192823+0000","last_clean":"2023-07-27T14:29:15.192823+0000","last_became_active":"2023-07-27T14:29:15.190925+0000","last_became_peered":"2023-07-27T14:29:15.190925+0000","last_unstale":"2023-07-27T14:29:15.192823+0000","last_undegraded":"2023-07-27T14:29:15.192823+0000","last_fullsized":"2023-07-27T14:29:15.192823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.190783+0000","last_change":"2023-07-27T14:29:14.712231+0000","last_active":"2023-07-27T14:29:15.190783+0000","last_peered":"2023-07-27T14:29:15.190783+0000","last_clean":"2023-07-27T14:29:15.190783+0000","last_became_active":"2023-07-27T14:29:14.711940+0000","last_became_peered":"2023-07-27T14:29:14.711940+0000","last_unstale":"2023-07-27T14:29:15.190783+0000","last_undegraded":"2023-07-27T14:29:15.190783+0000","last_fullsized":"2023-07-27T14:29:15.190783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194005+0000","last_change":"2023-07-27T14:29:15.190666+0000","last_active":"2023-07-27T14:29:15.194005+0000","last_peered":"2023-07-27T14:29:15.194005+0000","last_clean":"2023-07-27T14:29:15.194005+0000","last_became_active":"2023-07-27T14:29:15.190383+0000","last_became_peered":"2023-07-27T14:29:15.190383+0000","last_unstale":"2023-07-27T14:29:15.194005+0000","last_undegraded":"2023-07-27T14:29:15.194005+0000","last_fullsized":"2023-07-27T14:29:15.194005+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.163859+0000","last_change":"2023-07-27T14:29:14.719922+0000","last_active":"2023-07-27T14:29:15.163859+0000","last_peered":"2023-07-27T14:29:15.163859+0000","last_clean":"2023-07-27T14:29:15.163859+0000","last_became_active":"2023-07-27T14:29:14.719616+0000","last_became_peered":"2023-07-27T14:29:14.719616+0000","last_unstale":"2023-07-27T14:29:15.163859+0000","last_undegraded":"2023-07-27T14:29:15.163859+0000","last_fullsized":"2023-07-27T14:29:15.163859+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.180048+0000","last_change":"2023-07-27T14:29:15.176453+0000","last_active":"2023-07-27T14:29:15.180048+0000","last_peered":"2023-07-27T14:29:15.180048+0000","last_clean":"2023-07-27T14:29:15.180048+0000","last_became_active":"2023-07-27T14:29:15.175869+0000","last_became_peered":"2023-07-27T14:29:15.175869+0000","last_unstale":"2023-07-27T14:29:15.180048+0000","last_undegraded":"2023-07-27T14:29:15.180048+0000","last_fullsized":"2023-07-27T14:29:15.180048+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164909+0000","last_change":"2023-07-27T14:29:14.710441+0000","last_active":"2023-07-27T14:29:15.164909+0000","last_peered":"2023-07-27T14:29:15.164909+0000","last_clean":"2023-07-27T14:29:15.164909+0000","last_became_active":"2023-07-27T14:29:14.709899+0000","last_became_peered":"2023-07-27T14:29:14.709899+0000","last_unstale":"2023-07-27T14:29:15.164909+0000","last_undegraded":"2023-07-27T14:29:15.164909+0000","last_fullsized":"2023-07-27T14:29:15.164909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.181714+0000","last_change":"2023-07-27T14:29:15.172711+0000","last_active":"2023-07-27T14:29:15.181714+0000","last_peered":"2023-07-27T14:29:15.181714+0000","last_clean":"2023-07-27T14:29:15.181714+0000","last_became_active":"2023-07-27T14:29:15.172415+0000","last_became_peered":"2023-07-27T14:29:15.172415+0000","last_unstale":"2023-07-27T14:29:15.181714+0000","last_undegraded":"2023-07-27T14:29:15.181714+0000","last_fullsized":"2023-07-27T14:29:15.181714+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.188118+0000","last_change":"2023-07-27T14:29:14.715134+0000","last_active":"2023-07-27T14:29:15.188118+0000","last_peered":"2023-07-27T14:29:15.188118+0000","last_clean":"2023-07-27T14:29:15.188118+0000","last_became_active":"2023-07-27T14:29:14.714816+0000","last_became_peered":"2023-07-27T14:29:14.714816+0000","last_unstale":"2023-07-27T14:29:15.188118+0000","last_undegraded":"2023-07-27T14:29:15.188118+0000","last_fullsized":"2023-07-27T14:29:15.188118+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.181786+0000","last_change":"2023-07-27T14:29:15.175776+0000","last_active":"2023-07-27T14:29:15.181786+0000","last_peered":"2023-07-27T14:29:15.181786+0000","last_clean":"2023-07-27T14:29:15.181786+0000","last_became_active":"2023-07-27T14:29:15.175464+0000","last_became_peered":"2023-07-27T14:29:15.175464+0000","last_unstale":"2023-07-27T14:29:15.181786+0000","last_undegraded":"2023-07-27T14:29:15.181786+0000","last_fullsized":"2023-07-27T14:29:15.181786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.160439+0000","last_change":"2023-07-27T14:29:14.713796+0000","last_active":"2023-07-27T14:29:15.160439+0000","last_peered":"2023-07-27T14:29:15.160439+0000","last_clean":"2023-07-27T14:29:15.160439+0000","last_became_active":"2023-07-27T14:29:14.713513+0000","last_became_peered":"2023-07-27T14:29:14.713513+0000","last_unstale":"2023-07-27T14:29:15.160439+0000","last_undegraded":"2023-07-27T14:29:15.160439+0000","last_fullsized":"2023-07-27T14:29:15.160439+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194367+0000","last_change":"2023-07-27T14:29:15.186426+0000","last_active":"2023-07-27T14:29:15.194367+0000","last_peered":"2023-07-27T14:29:15.194367+0000","last_clean":"2023-07-27T14:29:15.194367+0000","last_became_active":"2023-07-27T14:29:15.186210+0000","last_became_peered":"2023-07-27T14:29:15.186210+0000","last_unstale":"2023-07-27T14:29:15.194367+0000","last_undegraded":"2023-07-27T14:29:15.194367+0000","last_fullsized":"2023-07-27T14:29:15.194367+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.171113+0000","last_change":"2023-07-27T14:29:14.720888+0000","last_active":"2023-07-27T14:29:15.171113+0000","last_peered":"2023-07-27T14:29:15.171113+0000","last_clean":"2023-07-27T14:29:15.171113+0000","last_became_active":"2023-07-27T14:29:14.719166+0000","last_became_peered":"2023-07-27T14:29:14.719166+0000","last_unstale":"2023-07-27T14:29:15.171113+0000","last_undegraded":"2023-07-27T14:29:15.171113+0000","last_fullsized":"2023-07-27T14:29:15.171113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.192020+0000","last_change":"2023-07-27T14:29:15.185600+0000","last_active":"2023-07-27T14:29:15.192020+0000","last_peered":"2023-07-27T14:29:15.192020+0000","last_clean":"2023-07-27T14:29:15.192020+0000","last_became_active":"2023-07-27T14:29:15.185335+0000","last_became_peered":"2023-07-27T14:29:15.185335+0000","last_unstale":"2023-07-27T14:29:15.192020+0000","last_undegraded":"2023-07-27T14:29:15.192020+0000","last_fullsized":"2023-07-27T14:29:15.192020+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.163671+0000","last_change":"2023-07-27T14:29:14.719086+0000","last_active":"2023-07-27T14:29:15.163671+0000","last_peered":"2023-07-27T14:29:15.163671+0000","last_clean":"2023-07-27T14:29:15.163671+0000","last_became_active":"2023-07-27T14:29:14.718782+0000","last_became_peered":"2023-07-27T14:29:14.718782+0000","last_unstale":"2023-07-27T14:29:15.163671+0000","last_undegraded":"2023-07-27T14:29:15.163671+0000","last_fullsized":"2023-07-27T14:29:15.163671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194566+0000","last_change":"2023-07-27T14:29:15.188485+0000","last_active":"2023-07-27T14:29:15.194566+0000","last_peered":"2023-07-27T14:29:15.194566+0000","last_clean":"2023-07-27T14:29:15.194566+0000","last_became_active":"2023-07-27T14:29:15.186569+0000","last_became_peered":"2023-07-27T14:29:15.186569+0000","last_unstale":"2023-07-27T14:29:15.194566+0000","last_undegraded":"2023-07-27T14:29:15.194566+0000","last_fullsized":"2023-07-27T14:29:15.194566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.168061+0000","last_change":"2023-07-27T14:29:14.713559+0000","last_active":"2023-07-27T14:29:15.168061+0000","last_peered":"2023-07-27T14:29:15.168061+0000","last_clean":"2023-07-27T14:29:15.168061+0000","last_became_active":"2023-07-27T14:29:14.713268+0000","last_became_peered":"2023-07-27T14:29:14.713268+0000","last_unstale":"2023-07-27T14:29:15.168061+0000","last_undegraded":"2023-07-27T14:29:15.168061+0000","last_fullsized":"2023-07-27T14:29:15.168061+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164868+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:29:15.164868+0000","last_peered":"2023-07-27T14:29:15.164868+0000","last_clean":"2023-07-27T14:29:15.164868+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:29:15.164868+0000","last_undegraded":"2023-07-27T14:29:15.164868+0000","last_fullsized":"2023-07-27T14:29:15.164868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.185260+0000","last_change":"2023-07-27T14:29:15.177153+0000","last_active":"2023-07-27T14:29:15.185260+0000","last_peered":"2023-07-27T14:29:15.185260+0000","last_clean":"2023-07-27T14:29:15.185260+0000","last_became_active":"2023-07-27T14:29:15.176881+0000","last_became_peered":"2023-07-27T14:29:15.176881+0000","last_unstale":"2023-07-27T14:29:15.185260+0000","last_undegraded":"2023-07-27T14:29:15.185260+0000","last_fullsized":"2023-07-27T14:29:15.185260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.194378+0000","last_change":"2023-07-27T14:29:14.719901+0000","last_active":"2023-07-27T14:29:15.194378+0000","last_peered":"2023-07-27T14:29:15.194378+0000","last_clean":"2023-07-27T14:29:15.194378+0000","last_became_active":"2023-07-27T14:29:14.719580+0000","last_became_peered":"2023-07-27T14:29:14.719580+0000","last_unstale":"2023-07-27T14:29:15.194378+0000","last_undegraded":"2023-07-27T14:29:15.194378+0000","last_fullsized":"2023-07-27T14:29:15.194378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.162822+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:29:15.162822+0000","last_peered":"2023-07-27T14:29:15.162822+0000","last_clean":"2023-07-27T14:29:15.162822+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:29:15.162822+0000","last_undegraded":"2023-07-27T14:29:15.162822+0000","last_fullsized":"2023-07-27T14:29:15.162822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.182509+0000","last_change":"2023-07-27T14:29:15.176241+0000","last_active":"2023-07-27T14:29:15.182509+0000","last_peered":"2023-07-27T14:29:15.182509+0000","last_clean":"2023-07-27T14:29:15.182509+0000","last_became_active":"2023-07-27T14:29:15.175955+0000","last_became_peered":"2023-07-27T14:29:15.175955+0000","last_unstale":"2023-07-27T14:29:15.182509+0000","last_undegraded":"2023-07-27T14:29:15.182509+0000","last_fullsized":"2023-07-27T14:29:15.182509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.166250+0000","last_change":"2023-07-27T14:29:14.711307+0000","last_active":"2023-07-27T14:29:15.166250+0000","last_peered":"2023-07-27T14:29:15.166250+0000","last_clean":"2023-07-27T14:29:15.166250+0000","last_became_active":"2023-07-27T14:29:14.710314+0000","last_became_peered":"2023-07-27T14:29:14.710314+0000","last_unstale":"2023-07-27T14:29:15.166250+0000","last_undegraded":"2023-07-27T14:29:15.166250+0000","last_fullsized":"2023-07-27T14:29:15.166250+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.163424+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:29:15.163424+0000","last_peered":"2023-07-27T14:29:15.163424+0000","last_clean":"2023-07-27T14:29:15.163424+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:29:15.163424+0000","last_undegraded":"2023-07-27T14:29:15.163424+0000","last_fullsized":"2023-07-27T14:29:15.163424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.181463+0000","last_change":"2023-07-27T14:29:15.170438+0000","last_active":"2023-07-27T14:29:15.181463+0000","last_peered":"2023-07-27T14:29:15.181463+0000","last_clean":"2023-07-27T14:29:15.181463+0000","last_became_active":"2023-07-27T14:29:15.170141+0000","last_became_peered":"2023-07-27T14:29:15.170141+0000","last_unstale":"2023-07-27T14:29:15.181463+0000","last_undegraded":"2023-07-27T14:29:15.181463+0000","last_fullsized":"2023-07-27T14:29:15.181463+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.165886+0000","last_change":"2023-07-27T14:29:14.717553+0000","last_active":"2023-07-27T14:29:15.165886+0000","last_peered":"2023-07-27T14:29:15.165886+0000","last_clean":"2023-07-27T14:29:15.165886+0000","last_became_active":"2023-07-27T14:29:14.717262+0000","last_became_peered":"2023-07-27T14:29:14.717262+0000","last_unstale":"2023-07-27T14:29:15.165886+0000","last_undegraded":"2023-07-27T14:29:15.165886+0000","last_fullsized":"2023-07-27T14:29:15.165886+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164774+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:29:15.164774+0000","last_peered":"2023-07-27T14:29:15.164774+0000","last_clean":"2023-07-27T14:29:15.164774+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:29:15.164774+0000","last_undegraded":"2023-07-27T14:29:15.164774+0000","last_fullsized":"2023-07-27T14:29:15.164774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.174273+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:29:15.174273+0000","last_peered":"2023-07-27T14:29:15.174273+0000","last_clean":"2023-07-27T14:29:15.174273+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:29:15.174273+0000","last_undegraded":"2023-07-27T14:29:15.174273+0000","last_fullsized":"2023-07-27T14:29:15.174273+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.172316+0000","last_change":"2023-07-27T14:29:15.169638+0000","last_active":"2023-07-27T14:29:15.172316+0000","last_peered":"2023-07-27T14:29:15.172316+0000","last_clean":"2023-07-27T14:29:15.172316+0000","last_became_active":"2023-07-27T14:29:15.169348+0000","last_became_peered":"2023-07-27T14:29:15.169348+0000","last_unstale":"2023-07-27T14:29:15.172316+0000","last_undegraded":"2023-07-27T14:29:15.172316+0000","last_fullsized":"2023-07-27T14:29:15.172316+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.170942+0000","last_change":"2023-07-27T14:29:14.724462+0000","last_active":"2023-07-27T14:29:15.170942+0000","last_peered":"2023-07-27T14:29:15.170942+0000","last_clean":"2023-07-27T14:29:15.170942+0000","last_became_active":"2023-07-27T14:29:14.724212+0000","last_became_peered":"2023-07-27T14:29:14.724212+0000","last_unstale":"2023-07-27T14:29:15.170942+0000","last_undegraded":"2023-07-27T14:29:15.170942+0000","last_fullsized":"2023-07-27T14:29:15.170942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.174357+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:29:15.174357+0000","last_peered":"2023-07-27T14:29:15.174357+0000","last_clean":"2023-07-27T14:29:15.174357+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:29:15.174357+0000","last_undegraded":"2023-07-27T14:29:15.174357+0000","last_fullsized":"2023-07-27T14:29:15.174357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.175153+0000","last_change":"2023-07-27T14:29:15.170571+0000","last_active":"2023-07-27T14:29:15.175153+0000","last_peered":"2023-07-27T14:29:15.175153+0000","last_clean":"2023-07-27T14:29:15.175153+0000","last_became_active":"2023-07-27T14:29:15.169662+0000","last_became_peered":"2023-07-27T14:29:15.169662+0000","last_unstale":"2023-07-27T14:29:15.175153+0000","last_undegraded":"2023-07-27T14:29:15.175153+0000","last_fullsized":"2023-07-27T14:29:15.175153+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.163883+0000","last_change":"2023-07-27T14:29:14.723530+0000","last_active":"2023-07-27T14:29:15.163883+0000","last_peered":"2023-07-27T14:29:15.163883+0000","last_clean":"2023-07-27T14:29:15.163883+0000","last_became_active":"2023-07-27T14:29:14.723204+0000","last_became_peered":"2023-07-27T14:29:14.723204+0000","last_unstale":"2023-07-27T14:29:15.163883+0000","last_undegraded":"2023-07-27T14:29:15.163883+0000","last_fullsized":"2023-07-27T14:29:15.163883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.171024+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:29:15.171024+0000","last_peered":"2023-07-27T14:29:15.171024+0000","last_clean":"2023-07-27T14:29:15.171024+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:29:15.171024+0000","last_undegraded":"2023-07-27T14:29:15.171024+0000","last_fullsized":"2023-07-27T14:29:15.171024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.195183+0000","last_change":"2023-07-27T14:29:15.188749+0000","last_active":"2023-07-27T14:29:15.195183+0000","last_peered":"2023-07-27T14:29:15.195183+0000","last_clean":"2023-07-27T14:29:15.195183+0000","last_became_active":"2023-07-27T14:29:15.188434+0000","last_became_peered":"2023-07-27T14:29:15.188434+0000","last_unstale":"2023-07-27T14:29:15.195183+0000","last_undegraded":"2023-07-27T14:29:15.195183+0000","last_fullsized":"2023-07-27T14:29:15.195183+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.159976+0000","last_change":"2023-07-27T14:29:14.714801+0000","last_active":"2023-07-27T14:29:15.159976+0000","last_peered":"2023-07-27T14:29:15.159976+0000","last_clean":"2023-07-27T14:29:15.159976+0000","last_became_active":"2023-07-27T14:29:14.714504+0000","last_became_peered":"2023-07-27T14:29:14.714504+0000","last_unstale":"2023-07-27T14:29:15.159976+0000","last_undegraded":"2023-07-27T14:29:15.159976+0000","last_fullsized":"2023-07-27T14:29:15.159976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.165492+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:29:15.165492+0000","last_peered":"2023-07-27T14:29:15.165492+0000","last_clean":"2023-07-27T14:29:15.165492+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:29:15.165492+0000","last_undegraded":"2023-07-27T14:29:15.165492+0000","last_fullsized":"2023-07-27T14:29:15.165492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.187091+0000","last_change":"2023-07-27T14:29:15.183285+0000","last_active":"2023-07-27T14:29:15.187091+0000","last_peered":"2023-07-27T14:29:15.187091+0000","last_clean":"2023-07-27T14:29:15.187091+0000","last_became_active":"2023-07-27T14:29:15.182940+0000","last_became_peered":"2023-07-27T14:29:15.182940+0000","last_unstale":"2023-07-27T14:29:15.187091+0000","last_undegraded":"2023-07-27T14:29:15.187091+0000","last_fullsized":"2023-07-27T14:29:15.187091+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:14.686151+0000","last_clean_scrub_stamp":"2023-07-27T14:29:14.686151+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.160625+0000","last_change":"2023-07-27T14:29:14.721523+0000","last_active":"2023-07-27T14:29:15.160625+0000","last_peered":"2023-07-27T14:29:15.160625+0000","last_clean":"2023-07-27T14:29:15.160625+0000","last_became_active":"2023-07-27T14:29:14.721134+0000","last_became_peered":"2023-07-27T14:29:14.721134+0000","last_unstale":"2023-07-27T14:29:15.160625+0000","last_undegraded":"2023-07-27T14:29:15.160625+0000","last_fullsized":"2023-07-27T14:29:15.160625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:29:13.679915+0000","last_clean_scrub_stamp":"2023-07-27T14:29:13.679915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-27T14:29:15.164458+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:29:15.164458+0000","last_peered":"2023-07-27T14:29:15.164458+0000","last_clean":"2023-07-27T14:29:15.164458+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:29:15.164458+0000","last_undegraded":"2023-07-27T14:29:15.164458+0000","last_fullsized":"2023-07-27T14:29:15.164458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6764,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":6144,"kb_avail":94365076,"statfs":{"total":96636764160,"available":96629837824,"internally_reserved":0,"allocated":626688,"data_stored":272563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6291456},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67400000000000004,"15min":0.68000000000000005},"min":{"1min":0.46500000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.133,"15min":1.133},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93300000000000005,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.626},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81000000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.80500000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71299999999999997,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.78000000000000003,"5min":1.119,"15min":1.119},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.879,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.69999999999999996,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.76900000000000002,"5min":1.165,"15min":1.165},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81999999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.438,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97899999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.76400000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.871},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86099999999999999,"5min":1.038,"15min":1.038},"last":0.91400000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.751,"15min":0.75800000000000001},"min":{"1min":0.55800000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89300000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.028,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6564,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5952,"kb_avail":94365276,"statfs":{"total":96636764160,"available":96630042624,"internally_reserved":0,"allocated":618496,"data_stored":271955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6094848},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.745}]},{"osd":1,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60199999999999998,"15min":0.59899999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81200000000000006,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81299999999999994,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.50600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65500000000000003,"15min":0.65000000000000002},"min":{"1min":0.56699999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.82999999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85599999999999998,"5min":0.872,"15min":0.872},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67500000000000004,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.879,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86299999999999999,"5min":1.198,"15min":1.198},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.52600000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88400000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.57499999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.625,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.88900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6564,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5952,"kb_avail":94365276,"statfs":{"total":96636764160,"available":96630042624,"internally_reserved":0,"allocated":618496,"data_stored":271975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6094848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.499,"5min":4.75,"15min":4.75},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.71399999999999997,"15min":0.76000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69899999999999995,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.58099999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.629,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66900000000000004,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70399999999999996,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.58699999999999997,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69899999999999995,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2010000000000001,"5min":2.181,"15min":2.181},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.50800000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.127,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95499999999999996,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1040000000000001,"5min":2.149,"15min":2.149},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.495,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.032,"5min":2.052,"15min":2.052},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.88800000000000001,"15min":0.91400000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.23,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:28:56 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.103,"5min":2.016,"15min":2.016},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.871,"15min":0.88500000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.087,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.86099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6508,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":94365332,"statfs":{"total":96636764160,"available":96630099968,"internally_reserved":0,"allocated":626688,"data_stored":272011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.501,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.27400000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56200000000000006,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.59099999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58699999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.52600000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98299999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0369999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.622}]},{"osd":5,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99199999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.57199999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.56299999999999994,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.99199999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.746},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.046,"5min":1.079,"15min":1.079},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jul 27 14:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.58099999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96899999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6572,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":5952,"kb_avail":94365268,"statfs":{"total":96636764160,"available":96630034432,"internally_reserved":0,"allocated":626688,"data_stored":273421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6094848},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.42899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58099999999999996,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.501},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.372},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.63900000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69399999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.54700000000000004,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71499999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.439}]},{"osd":4,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98299999999999998,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.874},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.95099999999999996,"5min":1.014,"15min":1.014},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94299999999999995,"5min":1.26,"15min":1.26},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.57099999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0009999999999999,"5min":1.091,"15min":1.091},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.60299999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0189999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96199999999999997,"5min":1.036,"15min":1.036},"last":0.83799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7212,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94364628,"statfs":{"total":96636764160,"available":96629379072,"internally_reserved":0,"allocated":626688,"data_stored":272551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26500000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48999999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.35199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.53600000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66500000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.436,"15min":0.432},"min":{"1min":0.32600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.496,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.60399999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.499,"15min":0.498},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70499999999999996,"15min":0.70299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92100000000000004,"5min":1.149,"15min":1.149},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73999999999999999,"15min":0.73699999999999999},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.621}]},{"osd":6,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0449999999999999,"5min":1.298,"15min":1.298},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.755,"15min":0.749},"min":{"1min":0.55700000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78100000000000003,"15min":0.77800000000000002},"min":{"1min":0.61499999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0169999999999999,"5min":1.085,"15min":1.085},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0620000000000001,"5min":1.24,"15min":1.24},"last":0.74399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6564,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5952,"kb_avail":94365276,"statfs":{"total":96636764160,"available":96630042624,"internally_reserved":0,"allocated":618496,"data_stored":272439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6094848},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.45800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.52900000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.872,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92900000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.752}]},{"osd":3,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.53000000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97999999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jul 27 14:28:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56499999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92800000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0049999999999999,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7204,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94364636,"statfs":{"total":96636764160,"available":96629387264,"internally_reserved":0,"allocated":618496,"data_stored":272777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85799999999999998,"5min":1.143,"15min":1.143},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.52000000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.84399999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.753}]},{"osd":3,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59499999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90100000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96899999999999997,"5min":1.224,"15min":1.224},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84999999999999998,"5min":1.056,"15min":1.056},"last":0.875}]},{"osd":6,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.006,"5min":1.085,"15min":1.085},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95499999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.84299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:29:19.905 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:29:19.906 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:29:20.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.103+0000 7f75ef3ff700 1 Processor -- start 2023-07-27T14:29:20.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.103+0000 7f75ef3ff700 1 -- start start 2023-07-27T14:29:20.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ef3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75e814f800 0x7f75e80c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ef3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e813ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ef3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e80a6a50 con 0x7f75e80a65d0 2023-07-27T14:29:20.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ef3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80a95f0 con 0x7f75e814f800 2023-07-27T14:29:20.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ef3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80a8ab0 con 0x7f75e8155fe0 2023-07-27T14:29:20.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75e814f800 0x7f75e80c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75e814f800 0x7f75e80c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58036/0 (socket says 172.21.15.115:58036) 2023-07-27T14:29:20.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed19b700 1 -- 172.21.15.115:0/2861404191 learned_addr learned my addr 172.21.15.115:0/2861404191 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:20.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ec99a700 1 --1- 172.21.15.115:0/2861404191 >> v1:172.21.15.115:6789/0 conn(0x7f75e80a65d0 0x7f75e81558d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54616/0 (socket says 172.21.15.115:54616) 2023-07-27T14:29:20.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed99c700 1 --2- 172.21.15.115:0/2861404191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e813ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed19b700 1 -- 172.21.15.115:0/2861404191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 msgr2=0x7f75e813ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:20.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed19b700 1 --2- 172.21.15.115:0/2861404191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e813ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed19b700 1 -- 172.21.15.115:0/2861404191 >> v1:172.21.15.115:6789/0 conn(0x7f75e80a65d0 legacy=0x7f75e81558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed19b700 1 -- 172.21.15.115:0/2861404191 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80a8d50 con 0x7f75e814f800 2023-07-27T14:29:20.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.105+0000 7f75ed99c700 1 --2- 172.21.15.115:0/2861404191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e813ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:20.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75ed19b700 1 --2- 172.21.15.115:0/2861404191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e80c7330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f75e4006fd0 tx=0x7f75e40090f0).ready entity=mon.0 client_cookie=b745743d849530f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:20.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75dffff700 1 -- 172.21.15.115:0/2861404191 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e400f510 con 0x7f75e814f800 2023-07-27T14:29:20.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75dffff700 1 -- 172.21.15.115:0/2861404191 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e400f670 con 0x7f75e814f800 2023-07-27T14:29:20.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75dffff700 1 -- 172.21.15.115:0/2861404191 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e400f9f0 con 0x7f75e814f800 2023-07-27T14:29:20.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75ef3ff700 1 -- 172.21.15.115:0/2861404191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 msgr2=0x7f75e80c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/2861404191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e80c7330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f75e4006fd0 tx=0x7f75e40090f0).stop 2023-07-27T14:29:20.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75ef3ff700 1 -- 172.21.15.115:0/2861404191 shutdown_connections 2023-07-27T14:29:20.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/2861404191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e813ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/2861404191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e80c7330 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75ef3ff700 1 -- 172.21.15.115:0/2861404191 >> 172.21.15.115:0/2861404191 conn(0x7f75e8062df0 msgr2=0x7f75e80c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:20.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.106+0000 7f75ef3ff700 1 -- 172.21.15.115:0/2861404191 shutdown_connections 2023-07-27T14:29:20.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.107+0000 7f75ef3ff700 1 -- 172.21.15.115:0/2861404191 wait complete. 2023-07-27T14:29:20.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.109+0000 7f75ef3ff700 1 Processor -- start 2023-07-27T14:29:20.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.109+0000 7f75ef3ff700 1 -- start start 2023-07-27T14:29:20.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ef3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75e80a65d0 0x7f75e80c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ef3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e8167de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ef3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e8164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ef3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8164850 con 0x7f75e814f800 2023-07-27T14:29:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ef3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8164b30 con 0x7f75e80a65d0 2023-07-27T14:29:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ef3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8164e10 con 0x7f75e8155fe0 2023-07-27T14:29:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ec99a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e8167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ec99a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e8167de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58050/0 (socket says 172.21.15.115:58050) 2023-07-27T14:29:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.110+0000 7f75ec99a700 1 -- 172.21.15.115:0/3014975622 learned_addr learned my addr 172.21.15.115:0/3014975622 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ed19b700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75e80a65d0 0x7f75e80c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ed99c700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e8164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ec99a700 1 -- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 msgr2=0x7f75e8164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ec99a700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e8164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ec99a700 1 -- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75e80a65d0 msgr2=0x7f75e80c0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ec99a700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75e80a65d0 0x7f75e80c0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ec99a700 1 -- 172.21.15.115:0/3014975622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4009370 con 0x7f75e814f800 2023-07-27T14:29:20.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ed19b700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75e80a65d0 0x7f75e80c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:20.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ec99a700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e8167de0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f75d800c810 tx=0x7f75d8007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:20.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75dd7fa700 1 -- 172.21.15.115:0/3014975622 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d80072e0 con 0x7f75e814f800 2023-07-27T14:29:20.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75dd7fa700 1 -- 172.21.15.115:0/3014975622 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8007440 con 0x7f75e814f800 2023-07-27T14:29:20.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e81675e0 con 0x7f75e814f800 2023-07-27T14:29:20.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75dd7fa700 1 -- 172.21.15.115:0/3014975622 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d80058f0 con 0x7f75e814f800 2023-07-27T14:29:20.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.111+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e81682d0 con 0x7f75e814f800 2023-07-27T14:29:20.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.112+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e806c470 con 0x7f75e814f800 2023-07-27T14:29:20.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.113+0000 7f75dd7fa700 1 -- 172.21.15.115:0/3014975622 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f75d801a060 con 0x7f75e814f800 2023-07-27T14:29:20.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.114+0000 7f75dd7fa700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75cc05eef0 0x7f75cc0613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.114+0000 7f75dd7fa700 1 -- 172.21.15.115:0/3014975622 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f75d80797b0 con 0x7f75e814f800 2023-07-27T14:29:20.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.114+0000 7f75ed19b700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75cc05eef0 0x7f75cc0613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.115+0000 7f75ed19b700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75cc05eef0 0x7f75cc0613b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f75e4009130 tx=0x7f75e4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.118+0000 7f75dd7fa700 1 -- 172.21.15.115:0/3014975622 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75d804aae0 con 0x7f75e814f800 2023-07-27T14:29:20.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.350+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f75e80a9030 con 0x7f75e814f800 2023-07-27T14:29:20.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.354+0000 7f75dd7fa700 1 -- 172.21.15.115:0/3014975622 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f75d8018020 con 0x7f75e814f800 2023-07-27T14:29:20.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.356+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75cc05eef0 msgr2=0x7f75cc0613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.356+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75cc05eef0 0x7f75cc0613b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f75e4009130 tx=0x7f75e4017000).stop 2023-07-27T14:29:20.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.356+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 msgr2=0x7f75e8167de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e8167de0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f75d800c810 tx=0x7f75d8007db0).stop 2023-07-27T14:29:20.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 shutdown_connections 2023-07-27T14:29:20.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75cc05eef0 0x7f75cc0613b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75e8155fe0 0x7f75e8164000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75e80a65d0 0x7f75e80c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 --2- 172.21.15.115:0/3014975622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e814f800 0x7f75e8167de0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 >> 172.21.15.115:0/3014975622 conn(0x7f75e8062df0 msgr2=0x7f75e8064ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:20.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 shutdown_connections 2023-07-27T14:29:20.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.357+0000 7f75ef3ff700 1 -- 172.21.15.115:0/3014975622 wait complete. 2023-07-27T14:29:20.383 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:29:20.398 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:29:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.561+0000 7fee62fff700 1 Processor -- start 2023-07-27T14:29:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.561+0000 7fee62fff700 1 -- start start 2023-07-27T14:29:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.562+0000 7fee62fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee5c154060 0x7fee5c0bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.562+0000 7fee62fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0c2ed0 con 0x7fee5c154440 2023-07-27T14:29:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.562+0000 7fee62fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0a58d0 con 0x7fee5c0a5390 2023-07-27T14:29:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.562+0000 7fee62fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c0a5bb0 con 0x7fee5c154060 2023-07-27T14:29:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.563+0000 7fee60d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee5c154060 0x7fee5c0bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.563+0000 7fee60d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee5c154060 0x7fee5c0bbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58056/0 (socket says 172.21.15.115:58056) 2023-07-27T14:29:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.563+0000 7fee60d9b700 1 -- 172.21.15.115:0/1719215807 learned_addr learned my addr 172.21.15.115:0/1719215807 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:20.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.563+0000 7fee60d9b700 1 -- 172.21.15.115:0/1719215807 >> v1:172.21.15.159:6789/0 conn(0x7fee5c0a5390 legacy=0x7fee5c0c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.563+0000 7fee60d9b700 1 -- 172.21.15.115:0/1719215807 >> v1:172.21.15.115:6789/0 conn(0x7fee5c154440 legacy=0x7fee5c0a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.563+0000 7fee60d9b700 1 -- 172.21.15.115:0/1719215807 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0a5e90 con 0x7fee5c154060 2023-07-27T14:29:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.563+0000 7fee5b7fe700 1 -- 172.21.15.115:0/1719215807 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041815437 0 0) 0x7fee5c0c2ed0 con 0x7fee5c154440 2023-07-27T14:29:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.563+0000 7fee60d9b700 1 --2- 172.21.15.115:0/1719215807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154060 0x7fee5c0bbd40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fee50006fd0 tx=0x7fee500090f0).ready entity=mon.0 client_cookie=6fdbfb30e7226a26 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee5b7fe700 1 -- 172.21.15.115:0/1719215807 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000b600 con 0x7fee5c154060 2023-07-27T14:29:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee5b7fe700 1 -- 172.21.15.115:0/1719215807 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5000b760 con 0x7fee5c154060 2023-07-27T14:29:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee5b7fe700 1 -- 172.21.15.115:0/1719215807 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000bae0 con 0x7fee5c154060 2023-07-27T14:29:20.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee62fff700 1 -- 172.21.15.115:0/1719215807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154060 msgr2=0x7fee5c0bbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee62fff700 1 --2- 172.21.15.115:0/1719215807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154060 0x7fee5c0bbd40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fee50006fd0 tx=0x7fee500090f0).stop 2023-07-27T14:29:20.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee62fff700 1 -- 172.21.15.115:0/1719215807 shutdown_connections 2023-07-27T14:29:20.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee62fff700 1 --2- 172.21.15.115:0/1719215807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154060 0x7fee5c0bbd40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee62fff700 1 -- 172.21.15.115:0/1719215807 >> 172.21.15.115:0/1719215807 conn(0x7fee5c062320 msgr2=0x7fee5c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:20.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee62fff700 1 -- 172.21.15.115:0/1719215807 shutdown_connections 2023-07-27T14:29:20.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.564+0000 7fee62fff700 1 -- 172.21.15.115:0/1719215807 wait complete. 2023-07-27T14:29:20.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.566+0000 7fee62fff700 1 Processor -- start 2023-07-27T14:29:20.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.566+0000 7fee62fff700 1 -- start start 2023-07-27T14:29:20.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee62fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee5c0a5390 0x7fee5c0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee62fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee5c154060 0x7fee5c0aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee62fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154440 0x7fee5c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee62fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c14da80 con 0x7fee5c154440 2023-07-27T14:29:20.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee62fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0a79c0 con 0x7fee5c154060 2023-07-27T14:29:20.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee62fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c58e0 con 0x7fee5c0a5390 2023-07-27T14:29:20.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee6159c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154440 0x7fee5c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee6159c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154440 0x7fee5c0ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58066/0 (socket says 172.21.15.115:58066) 2023-07-27T14:29:20.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee6159c700 1 -- 172.21.15.115:0/986490687 learned_addr learned my addr 172.21.15.115:0/986490687 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:20.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee60d9b700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee5c0a5390 0x7fee5c0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee5bfff700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee5c154060 0x7fee5c0aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee6159c700 1 -- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee5c0a5390 msgr2=0x7fee5c0c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee6159c700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee5c0a5390 0x7fee5c0c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee6159c700 1 -- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee5c154060 msgr2=0x7fee5c0aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee6159c700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee5c154060 0x7fee5c0aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee6159c700 1 -- 172.21.15.115:0/986490687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee50009370 con 0x7fee5c154440 2023-07-27T14:29:20.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee60d9b700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee5c0a5390 0x7fee5c0c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:20.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.567+0000 7fee5bfff700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee5c154060 0x7fee5c0aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:20.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.568+0000 7fee6159c700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154440 0x7fee5c0ab8b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fee5400c740 tx=0x7fee54001540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:20.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.568+0000 7fee58ff9700 1 -- 172.21.15.115:0/986490687 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54010510 con 0x7fee5c154440 2023-07-27T14:29:20.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.568+0000 7fee58ff9700 1 -- 172.21.15.115:0/986490687 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54010670 con 0x7fee5c154440 2023-07-27T14:29:20.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.568+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c0c5bc0 con 0x7fee5c154440 2023-07-27T14:29:20.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.568+0000 7fee58ff9700 1 -- 172.21.15.115:0/986490687 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54010a10 con 0x7fee5c154440 2023-07-27T14:29:20.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.568+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c0a7ef0 con 0x7fee5c154440 2023-07-27T14:29:20.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.569+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c06c470 con 0x7fee5c154440 2023-07-27T14:29:20.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.570+0000 7fee58ff9700 1 -- 172.21.15.115:0/986490687 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fee54010070 con 0x7fee5c154440 2023-07-27T14:29:20.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.571+0000 7fee58ff9700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005eef0 0x7fee400613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:20.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.571+0000 7fee58ff9700 1 -- 172.21.15.115:0/986490687 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fee54079a70 con 0x7fee5c154440 2023-07-27T14:29:20.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.571+0000 7fee60d9b700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005eef0 0x7fee400613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:20.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.572+0000 7fee60d9b700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005eef0 0x7fee400613b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fee5000b3c0 tx=0x7fee50017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:20.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.575+0000 7fee58ff9700 1 -- 172.21.15.115:0/986490687 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fee5404ada0 con 0x7fee5c154440 2023-07-27T14:29:20.703 INFO:tasks.ceph.mds.a.smithi115.stderr:2023-07-27T14:29:20.679+0000 7ffb1eff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:29:20.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.783+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee5c063d80 con 0x7fee5c154440 2023-07-27T14:29:20.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.784+0000 7fee58ff9700 1 -- 172.21.15.115:0/986490687 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fee540015b0 con 0x7fee5c154440 2023-07-27T14:29:20.808 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:20.809 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1259074753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1259074753},{"type":"v1","addr":"172.21.15.115:6837","nonce":1259074753}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1004586884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1004586884},{"type":"v1","addr":"172.21.15.159:6834","nonce":1004586884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2086004294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2086004294},{"type":"v1","addr":"172.21.15.159:6835","nonce":2086004294}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:29:15.154553+0000","modified":"2023-07-27T14:29:18.168905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1707534394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1707534394},{"type":"v1","addr":"172.21.15.115:6836","nonce":1707534394}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-07-27T14:29:20.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005eef0 msgr2=0x7fee400613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005eef0 0x7fee400613b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fee5000b3c0 tx=0x7fee50017000).stop 2023-07-27T14:29:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154440 msgr2=0x7fee5c0ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154440 0x7fee5c0ab8b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fee5400c740 tx=0x7fee54001540).stop 2023-07-27T14:29:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 shutdown_connections 2023-07-27T14:29:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005eef0 0x7fee400613b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee5c154440 0x7fee5c0ab8b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee5c0a5390 0x7fee5c0c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 --2- 172.21.15.115:0/986490687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee5c154060 0x7fee5c0aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 >> 172.21.15.115:0/986490687 conn(0x7fee5c062320 msgr2=0x7fee5c068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 shutdown_connections 2023-07-27T14:29:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:20.786+0000 7fee62fff700 1 -- 172.21.15.115:0/986490687 wait complete. 2023-07-27T14:29:20.812 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 25 2023-07-27T14:29:21.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:29:15.154553+0000', 'modified': '2023-07-27T14:29:18.168905+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5490': {'gid': 5490, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6836/1707534394', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 1707534394}, {'type': 'v1', 'addr': '172.21.15.115:6836', 'nonce': 1707534394}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:29:21.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:29:21.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-27T14:29:21.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.396+0000 7fd952dff700 1 Processor -- start 2023-07-27T14:29:21.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.396+0000 7fd952dff700 1 -- start start 2023-07-27T14:29:21.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.397+0000 7fd952dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd94c153ec0 0x7fd94c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.397+0000 7fd952dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.397+0000 7fd952dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0aa4d0 con 0x7fd94c0aa050 2023-07-27T14:29:21.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.397+0000 7fd952dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0c05c0 con 0x7fd94c153ec0 2023-07-27T14:29:21.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.397+0000 7fd952dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0bfc90 con 0x7fd94c0aaa40 2023-07-27T14:29:21.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.397+0000 7fd950b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd94c153ec0 0x7fd94c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd950b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd94c153ec0 0x7fd94c0a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58076/0 (socket says 172.21.15.115:58076) 2023-07-27T14:29:21.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd950b9b700 1 -- 172.21.15.115:0/1036198546 learned_addr learned my addr 172.21.15.115:0/1036198546 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:21.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd94bfff700 1 --1- 172.21.15.115:0/1036198546 >> v1:172.21.15.115:6789/0 conn(0x7fd94c0aa050 0x7fd94c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54636/0 (socket says 172.21.15.115:54636) 2023-07-27T14:29:21.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd95139c700 1 --2- 172.21.15.115:0/1036198546 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd950b9b700 1 -- 172.21.15.115:0/1036198546 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 msgr2=0x7fd94c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1036198546 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd950b9b700 1 -- 172.21.15.115:0/1036198546 >> v1:172.21.15.115:6789/0 conn(0x7fd94c0aa050 legacy=0x7fd94c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd950b9b700 1 -- 172.21.15.115:0/1036198546 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0bff70 con 0x7fd94c153ec0 2023-07-27T14:29:21.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd94b7fe700 1 -- 172.21.15.115:0/1036198546 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139257437 0 0) 0x7fd938001110 con 0x7fd94c0aa050 2023-07-27T14:29:21.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1036198546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c0a9b60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fd940006fd0 tx=0x7fd9400090f0).ready entity=mon.0 client_cookie=239e4c844cea51fd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd94b7fe700 1 -- 172.21.15.115:0/1036198546 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000b600 con 0x7fd94c153ec0 2023-07-27T14:29:21.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd94b7fe700 1 -- 172.21.15.115:0/1036198546 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94000b760 con 0x7fd94c153ec0 2023-07-27T14:29:21.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.398+0000 7fd94b7fe700 1 -- 172.21.15.115:0/1036198546 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000bae0 con 0x7fd94c153ec0 2023-07-27T14:29:21.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.399+0000 7fd952dff700 1 -- 172.21.15.115:0/1036198546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 msgr2=0x7fd94c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.399+0000 7fd952dff700 1 --2- 172.21.15.115:0/1036198546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c0a9b60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fd940006fd0 tx=0x7fd9400090f0).stop 2023-07-27T14:29:21.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.399+0000 7fd952dff700 1 -- 172.21.15.115:0/1036198546 shutdown_connections 2023-07-27T14:29:21.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.399+0000 7fd952dff700 1 --2- 172.21.15.115:0/1036198546 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.399+0000 7fd952dff700 1 --2- 172.21.15.115:0/1036198546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c0a9b60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.399+0000 7fd952dff700 1 -- 172.21.15.115:0/1036198546 >> 172.21.15.115:0/1036198546 conn(0x7fd94c0cb610 msgr2=0x7fd94c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:21.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.399+0000 7fd952dff700 1 -- 172.21.15.115:0/1036198546 shutdown_connections 2023-07-27T14:29:21.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.399+0000 7fd952dff700 1 -- 172.21.15.115:0/1036198546 wait complete. 2023-07-27T14:29:21.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.400+0000 7fd952dff700 1 Processor -- start 2023-07-27T14:29:21.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.401+0000 7fd952dff700 1 -- start start 2023-07-27T14:29:21.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.401+0000 7fd952dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd94c0aa050 0x7fd94c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.401+0000 7fd952dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.401+0000 7fd952dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.401+0000 7fd952dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c14d1b0 con 0x7fd94c153ec0 2023-07-27T14:29:21.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.401+0000 7fd952dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c2b00 con 0x7fd94c0aa050 2023-07-27T14:29:21.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.401+0000 7fd952dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c2de0 con 0x7fd94c0aaa40 2023-07-27T14:29:21.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58092/0 (socket says 172.21.15.115:58092) 2023-07-27T14:29:21.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 -- 172.21.15.115:0/1973790251 learned_addr learned my addr 172.21.15.115:0/1973790251 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:21.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd94bfff700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd94c0aa050 0x7fd94c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 -- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 msgr2=0x7fd94c0aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 -- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd94c0aa050 msgr2=0x7fd94c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd94c0aa050 0x7fd94c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 -- 172.21.15.115:0/1973790251 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd940009370 con 0x7fd94c153ec0 2023-07-27T14:29:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd94c0aa050 0x7fd94c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd94bfff700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.402+0000 7fd95139c700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c152be0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fd944007f20 tx=0x7fd9440098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.403+0000 7fd948ff9700 1 -- 172.21.15.115:0/1973790251 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94400eca0 con 0x7fd94c153ec0 2023-07-27T14:29:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.403+0000 7fd948ff9700 1 -- 172.21.15.115:0/1973790251 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94400ee00 con 0x7fd94c153ec0 2023-07-27T14:29:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.403+0000 7fd952dff700 1 -- 172.21.15.115:0/1973790251 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c0af4c0 con 0x7fd94c153ec0 2023-07-27T14:29:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.403+0000 7fd948ff9700 1 -- 172.21.15.115:0/1973790251 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944014610 con 0x7fd94c153ec0 2023-07-27T14:29:21.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.403+0000 7fd952dff700 1 -- 172.21.15.115:0/1973790251 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c0afa80 con 0x7fd94c153ec0 2023-07-27T14:29:21.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.404+0000 7fd948ff9700 1 -- 172.21.15.115:0/1973790251 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fd94401b030 con 0x7fd94c153ec0 2023-07-27T14:29:21.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.405+0000 7fd948ff9700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd93005eec0 0x7fd930061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.405+0000 7fd948ff9700 1 -- 172.21.15.115:0/1973790251 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd94407a2a0 con 0x7fd94c153ec0 2023-07-27T14:29:21.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.406+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd93005eec0 0x7fd930061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.406+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd93005eec0 0x7fd930061380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd940009130 tx=0x7fd940017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.407+0000 7fd96a149b80 1 Processor -- start 2023-07-27T14:29:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.408+0000 7fd96a149b80 1 -- start start 2023-07-27T14:29:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.408+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432d5c0 0x55c2e432d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.408+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e4355830 0x55c2e437bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.408+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432ff60 0x55c2e437c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.408+0000 7fd96a149b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e426a9c0 con 0x55c2e4355830 2023-07-27T14:29:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.408+0000 7fd96a149b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e427fcc0 con 0x55c2e432d5c0 2023-07-27T14:29:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd96a149b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e4246e10 con 0x55c2e432ff60 2023-07-27T14:29:21.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e4355830 0x55c2e437bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e4355830 0x55c2e437bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58106/0 (socket says 172.21.15.115:58106) 2023-07-27T14:29:21.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 -- 172.21.15.115:0/353252495 learned_addr learned my addr 172.21.15.115:0/353252495 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:21.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 -- 172.21.15.115:0/353252495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432ff60 msgr2=0x55c2e437c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 --2- 172.21.15.115:0/353252495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432ff60 0x55c2e437c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:21.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 -- 172.21.15.115:0/353252495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432d5c0 msgr2=0x55c2e432d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 --2- 172.21.15.115:0/353252495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432d5c0 0x55c2e432d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:21.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 -- 172.21.15.115:0/353252495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2e42789a0 con 0x55c2e4355830 2023-07-27T14:29:21.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd94bfff700 1 --2- 172.21.15.115:0/353252495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e4355830 0x55c2e437bcc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fd9380072c0 tx=0x7fd938007cc0).ready entity=mon.0 client_cookie=40afd947af05ae1e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd9359fe700 1 -- 172.21.15.115:0/353252495 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938001440 con 0x55c2e4355830 2023-07-27T14:29:21.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd9359fe700 1 -- 172.21.15.115:0/353252495 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9380015a0 con 0x55c2e4355830 2023-07-27T14:29:21.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.409+0000 7fd9359fe700 1 -- 172.21.15.115:0/353252495 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938001940 con 0x55c2e4355830 2023-07-27T14:29:21.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 -- 172.21.15.115:0/353252495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e4355830 msgr2=0x55c2e437bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 --2- 172.21.15.115:0/353252495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e4355830 0x55c2e437bcc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fd9380072c0 tx=0x7fd938007cc0).stop 2023-07-27T14:29:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 -- 172.21.15.115:0/353252495 shutdown_connections 2023-07-27T14:29:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 --2- 172.21.15.115:0/353252495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432ff60 0x55c2e437c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 --2- 172.21.15.115:0/353252495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432d5c0 0x55c2e432d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 --2- 172.21.15.115:0/353252495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e4355830 0x55c2e437bcc0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 -- 172.21.15.115:0/353252495 >> 172.21.15.115:0/353252495 conn(0x55c2e4198940 msgr2=0x55c2e43766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:21.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 -- 172.21.15.115:0/353252495 shutdown_connections 2023-07-27T14:29:21.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.410+0000 7fd96a149b80 1 -- 172.21.15.115:0/353252495 wait complete. 2023-07-27T14:29:21.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.411+0000 7fd96a149b80 1 -- start start 2023-07-27T14:29:21.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.411+0000 7fd96a149b80 1 Processor -- start 2023-07-27T14:29:21.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4370130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4374690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e434f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd96a149b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e43824b0 con 0x55c2e432ff60 2023-07-27T14:29:21.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd96a149b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e4359680 con 0x55c2e4375990 2023-07-27T14:29:21.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd96a149b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e435a4e0 con 0x55c2e432d5c0 2023-07-27T14:29:21.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd96a149b80 10 client.0 ll_register_callbacks cb 0x55c2e42324a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:29:21.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4374690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4374690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58112/0 (socket says 172.21.15.115:58112) 2023-07-27T14:29:21.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd94bfff700 1 -- 172.21.15.115:0/1074228163 learned_addr learned my addr 172.21.15.115:0/1074228163 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:21.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.412+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4370130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd95139c700 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e434f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd94bfff700 1 -- 172.21.15.115:0/1074228163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 msgr2=0x55c2e4370130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd94bfff700 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4370130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd94bfff700 1 -- 172.21.15.115:0/1074228163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 msgr2=0x55c2e434f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd94bfff700 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e434f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd94bfff700 1 -- 172.21.15.115:0/1074228163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93800f040 con 0x55c2e432ff60 2023-07-27T14:29:21.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd94bfff700 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4374690 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fd938000fb0 tx=0x7fd938017000).ready entity=mon.0 client_cookie=784d46bf518c3580 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd92affd700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:29:21.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd92affd700 1 -- 172.21.15.115:0/1074228163 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380017e0 con 0x55c2e432ff60 2023-07-27T14:29:21.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd96a149b80 1 -- 172.21.15.115:0/1074228163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2e4327d50 con 0x55c2e432ff60 2023-07-27T14:29:21.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.413+0000 7fd92affd700 1 -- 172.21.15.115:0/1074228163 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd938014430 con 0x55c2e432ff60 2023-07-27T14:29:21.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd92affd700 1 -- 172.21.15.115:0/1074228163 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd938001940 con 0x55c2e432ff60 2023-07-27T14:29:21.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd96a149b80 10 client.5649 fetch_fsmap learned FSMap version 25 2023-07-27T14:29:21.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd96a149b80 1 -- 172.21.15.115:0/1074228163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55c2e4274190 con 0x55c2e432ff60 2023-07-27T14:29:21.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd92affd700 1 -- 172.21.15.115:0/1074228163 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2e4327d50 con 0x55c2e432ff60 2023-07-27T14:29:21.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd92affd700 1 -- 172.21.15.115:0/1074228163 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd938014800 con 0x55c2e432ff60 2023-07-27T14:29:21.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd96a149b80 10 client.5649 fetch_fsmap finished waiting for FSMap version 25 2023-07-27T14:29:21.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd96a149b80 10 client.5649 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:29:21.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd96a149b80 20 client.5649 populate_metadata read hostname 'smithi115' 2023-07-27T14:29:21.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] conn(0x55c2e43507c0 0x55c2e435a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd96a149b80 4 client.5649 mds_command: new command op to 5490 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:29:21.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd96a149b80 1 -- 172.21.15.115:0/1074228163 --> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2e40e8ef0 con 0x55c2e43507c0 2023-07-27T14:29:21.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.414+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] conn(0x55c2e43507c0 0x55c2e435a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.415+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] conn(0x55c2e43507c0 0x55c2e435a970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3fbf92f075924fb5 server_cookie=3e0727f51784f064 in_seq=0 out_seq=0 2023-07-27T14:29:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.415+0000 7fd92affd700 10 client.5649 ms_handle_connect on v2:172.21.15.115:6834/1707534394 2023-07-27T14:29:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.415+0000 7fd92affd700 1 -- 172.21.15.115:0/1074228163 <== mds.0 v2:172.21.15.115:6834/1707534394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x55c2e40e8ef0 con 0x55c2e43507c0 2023-07-27T14:29:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.415+0000 7fd92affd700 10 client.5649 handle_command_reply: tid=0 2023-07-27T14:29:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.415+0000 7fd96a149b80 1 client.5649 shutdown 2023-07-27T14:29:21.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 -- 172.21.15.115:0/1074228163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 msgr2=0x55c2e4374690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4374690 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fd938000fb0 tx=0x7fd938017000).stop 2023-07-27T14:29:21.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 -- 172.21.15.115:0/1074228163 shutdown_connections 2023-07-27T14:29:21.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] conn(0x55c2e43507c0 0x55c2e435a970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e434f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4370130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd92affd700 0 client.5649 ms_handle_reset on v2:172.21.15.115:6834/1707534394 2023-07-27T14:29:21.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1074228163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4374690 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 -- 172.21.15.115:0/1074228163 >> 172.21.15.115:0/1074228163 conn(0x55c2e4198940 msgr2=0x55c2e4376560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:21.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 -- 172.21.15.115:0/1074228163 shutdown_connections 2023-07-27T14:29:21.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 1 -- 172.21.15.115:0/1074228163 wait complete. 2023-07-27T14:29:21.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.416+0000 7fd96a149b80 20 client.5649 trim_cache size 0 max 16384 2023-07-27T14:29:21.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.432+0000 7fd96a149b80 1 Processor -- start 2023-07-27T14:29:21.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.432+0000 7fd96a149b80 1 -- start start 2023-07-27T14:29:21.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.433+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4374860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.433+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4376490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.433+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e4376980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.433+0000 7fd96a149b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e4321ee0 con 0x55c2e432ff60 2023-07-27T14:29:21.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.433+0000 7fd96a149b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e432dd20 con 0x55c2e4375990 2023-07-27T14:29:21.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.433+0000 7fd96a149b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e4374440 con 0x55c2e432d5c0 2023-07-27T14:29:21.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4376490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4376490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58120/0 (socket says 172.21.15.115:58120) 2023-07-27T14:29:21.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 -- 172.21.15.115:0/1939038431 learned_addr learned my addr 172.21.15.115:0/1939038431 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:21.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4374860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd95139c700 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e4376980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 -- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 msgr2=0x55c2e4374860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4374860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 -- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 msgr2=0x55c2e4376980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e4376980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 -- 172.21.15.115:0/1939038431 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2e435c810 con 0x55c2e432ff60 2023-07-27T14:29:21.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd950b9b700 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4374860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:21.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd95139c700 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e4376980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:21.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd94bfff700 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4376490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fd938014fd0 tx=0x7fd93801f000).ready entity=mon.0 client_cookie=c583d4430dbcff75 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd9361ff700 1 -- 172.21.15.115:0/1939038431 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938014430 con 0x55c2e432ff60 2023-07-27T14:29:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd9361ff700 1 -- 172.21.15.115:0/1939038431 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd938014d10 con 0x55c2e432ff60 2023-07-27T14:29:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.434+0000 7fd9361ff700 1 -- 172.21.15.115:0/1939038431 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380078a0 con 0x55c2e432ff60 2023-07-27T14:29:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 -- 172.21.15.115:0/1939038431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 msgr2=0x55c2e4376490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4376490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fd938014fd0 tx=0x7fd93801f000).stop 2023-07-27T14:29:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 -- 172.21.15.115:0/1939038431 shutdown_connections 2023-07-27T14:29:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e4375990 0x55c2e4376980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e432d5c0 0x55c2e4374860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 --2- 172.21.15.115:0/1939038431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432ff60 0x55c2e4376490 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 -- 172.21.15.115:0/1939038431 >> 172.21.15.115:0/1939038431 conn(0x55c2e4198940 msgr2=0x55c2e432e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 -- 172.21.15.115:0/1939038431 shutdown_connections 2023-07-27T14:29:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.435+0000 7fd96a149b80 1 -- 172.21.15.115:0/1939038431 wait complete. 2023-07-27T14:29:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.436+0000 7fd96a149b80 1 -- start start 2023-07-27T14:29:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.436+0000 7fd96a149b80 1 Processor -- start 2023-07-27T14:29:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432d5c0 0x55c2e43cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432ff60 0x55c2e4328c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd96a149b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e4375990 0x55c2e434e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd96a149b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e438bcc0 con 0x55c2e432d5c0 2023-07-27T14:29:21.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd96a149b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e43292b0 con 0x55c2e432ff60 2023-07-27T14:29:21.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd96a149b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e4354d10 con 0x55c2e4375990 2023-07-27T14:29:21.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd96a149b80 10 client.0 ll_register_callbacks cb 0x55c2e42324a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:29:21.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd950b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432d5c0 0x55c2e43cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd950b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432d5c0 0x55c2e43cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58132/0 (socket says 172.21.15.115:58132) 2023-07-27T14:29:21.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd950b9b700 1 -- 172.21.15.115:0/198960411 learned_addr learned my addr 172.21.15.115:0/198960411 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:21.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd95139c700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e4375990 0x55c2e434e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd94bfff700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432ff60 0x55c2e4328c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd950b9b700 1 -- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e4375990 msgr2=0x55c2e434e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd950b9b700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e4375990 0x55c2e434e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd950b9b700 1 -- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432ff60 msgr2=0x55c2e4328c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd950b9b700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432ff60 0x55c2e4328c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd950b9b700 1 -- 172.21.15.115:0/198960411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2e4274190 con 0x55c2e432d5c0 2023-07-27T14:29:21.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd95139c700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e4375990 0x55c2e434e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:21.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.438+0000 7fd94bfff700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432ff60 0x55c2e4328c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:21.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd950b9b700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432d5c0 0x55c2e43cee80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fd94c060760 tx=0x7fd94002e170).ready entity=mon.0 client_cookie=7a8c918adb1df921 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd92affd700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:29:21.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd92affd700 1 -- 172.21.15.115:0/198960411 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94001ca90 con 0x55c2e432d5c0 2023-07-27T14:29:21.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd96a149b80 1 -- 172.21.15.115:0/198960411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9380015a0 con 0x55c2e432d5c0 2023-07-27T14:29:21.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd92affd700 1 -- 172.21.15.115:0/198960411 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd94001cbf0 con 0x55c2e432d5c0 2023-07-27T14:29:21.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd92affd700 1 -- 172.21.15.115:0/198960411 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd940026400 con 0x55c2e432d5c0 2023-07-27T14:29:21.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd96a149b80 10 client.5655 fetch_fsmap learned FSMap version 25 2023-07-27T14:29:21.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd96a149b80 1 -- 172.21.15.115:0/198960411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55c2e4273ee0 con 0x55c2e432d5c0 2023-07-27T14:29:21.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd92affd700 1 -- 172.21.15.115:0/198960411 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940037030 con 0x55c2e432d5c0 2023-07-27T14:29:21.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd92affd700 1 -- 172.21.15.115:0/198960411 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd940033410 con 0x55c2e432d5c0 2023-07-27T14:29:21.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd96a149b80 10 client.5655 fetch_fsmap finished waiting for FSMap version 25 2023-07-27T14:29:21.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd96a149b80 10 client.5655 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:29:21.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.439+0000 7fd96a149b80 20 client.5655 populate_metadata read hostname 'smithi115' 2023-07-27T14:29:21.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd96a149b80 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] conn(0x55c2e432b190 0x55c2e432b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd96a149b80 4 client.5655 mds_command: new command op to 5490 tid=0[{"prefix": "status"}] 2023-07-27T14:29:21.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd96a149b80 1 -- 172.21.15.115:0/198960411 --> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c2e411e040 con 0x55c2e432b190 2023-07-27T14:29:21.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd94bfff700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] conn(0x55c2e432b190 0x55c2e432b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd94bfff700 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] conn(0x55c2e432b190 0x55c2e432b570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=94159d6bddd028a9 server_cookie=92fe5de52795b584 in_seq=0 out_seq=0 2023-07-27T14:29:21.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd92affd700 10 client.5655 ms_handle_connect on v2:172.21.15.115:6834/1707534394 2023-07-27T14:29:21.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd92affd700 1 -- 172.21.15.115:0/198960411 <== mds.0 v2:172.21.15.115:6834/1707534394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c2e411e040 con 0x55c2e432b190 2023-07-27T14:29:21.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd92affd700 10 client.5655 handle_command_reply: tid=0 2023-07-27T14:29:21.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.440+0000 7fd96a149b80 1 client.5655 shutdown 2023-07-27T14:29:21.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 -- 172.21.15.115:0/198960411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432d5c0 msgr2=0x55c2e43cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432d5c0 0x55c2e43cee80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fd94c060760 tx=0x7fd94002e170).stop 2023-07-27T14:29:21.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 -- 172.21.15.115:0/198960411 shutdown_connections 2023-07-27T14:29:21.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.115:6834/1707534394,v1:172.21.15.115:6836/1707534394] conn(0x55c2e432b190 0x55c2e432b570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c2e4375990 0x55c2e434e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c2e432d5c0 0x55c2e43cee80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd92affd700 0 client.5655 ms_handle_reset on v2:172.21.15.115:6834/1707534394 2023-07-27T14:29:21.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 --2- 172.21.15.115:0/198960411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c2e432ff60 0x55c2e4328c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 -- 172.21.15.115:0/198960411 >> 172.21.15.115:0/198960411 conn(0x55c2e4198940 msgr2=0x55c2e436ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:21.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 -- 172.21.15.115:0/198960411 shutdown_connections 2023-07-27T14:29:21.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 1 -- 172.21.15.115:0/198960411 wait complete. 2023-07-27T14:29:21.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd96a149b80 20 client.5655 trim_cache size 0 max 16384 2023-07-27T14:29:21.474 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:29:21.474 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:29:21.474 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:29:21.475 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 5490, 2023-07-27T14:29:21.475 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:29:21.475 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:29:21.475 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:29:21.476 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2843307389999996, 2023-07-27T14:29:21.476 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 25, 2023-07-27T14:29:21.476 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 52, 2023-07-27T14:29:21.476 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 52, 2023-07-27T14:29:21.476 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.507403966 2023-07-27T14:29:21.476 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:29:21.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.441+0000 7fd952dff700 1 -- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd93005eec0 msgr2=0x7fd930061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd93005eec0 0x7fd930061380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd940009130 tx=0x7fd940017000).stop 2023-07-27T14:29:21.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 -- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 msgr2=0x7fd94c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c152be0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fd944007f20 tx=0x7fd9440098a0).stop 2023-07-27T14:29:21.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 -- 172.21.15.115:0/1973790251 shutdown_connections 2023-07-27T14:29:21.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd93005eec0 0x7fd930061380 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c153ec0 0x7fd94c152be0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd94c0aa050 0x7fd94c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 --2- 172.21.15.115:0/1973790251 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd94c0aaa40 0x7fd94c0aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 -- 172.21.15.115:0/1973790251 >> 172.21.15.115:0/1973790251 conn(0x7fd94c0cb610 msgr2=0x7fd94c0acee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:21.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 -- 172.21.15.115:0/1973790251 shutdown_connections 2023-07-27T14:29:21.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.442+0000 7fd952dff700 1 -- 172.21.15.115:0/1973790251 wait complete. 2023-07-27T14:29:21.482 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:29:21.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.616+0000 7f71ad1ff700 1 Processor -- start 2023-07-27T14:29:21.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.616+0000 7f71ad1ff700 1 -- start start 2023-07-27T14:29:21.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.617+0000 7f71ad1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f71a80bc8e0 0x7f71a81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.617+0000 7f71ad1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a8068c10 0x7f71a8154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.617+0000 7f71ad1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a8154990 con 0x7f71a80bccc0 2023-07-27T14:29:21.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.617+0000 7f71ad1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a81519d0 con 0x7f71a80bc8e0 2023-07-27T14:29:21.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.617+0000 7f71ad1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a8151cb0 con 0x7f71a8068c10 2023-07-27T14:29:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f71a80bccc0 0x7f71a80a5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54646/0 (socket says 172.21.15.115:54646) 2023-07-27T14:29:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a659c700 1 -- 172.21.15.115:0/931501051 learned_addr learned my addr 172.21.15.115:0/931501051 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a6d9d700 1 --2- 172.21.15.115:0/931501051 >> v2:172.21.15.159:3300/0 conn(0x7f71a80bc8e0 0x7f71a81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a759e700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a8068c10 0x7f71a8154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422067425 0 0) 0x7f71a8154990 con 0x7f71a80bccc0 2023-07-27T14:29:21.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71900033f0 con 0x7f71a80bccc0 2023-07-27T14:29:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2405907785 0 0) 0x7f71900033f0 con 0x7f71a80bccc0 2023-07-27T14:29:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a8068c10 msgr2=0x7f71a8154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a8068c10 0x7f71a8154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 >> v2:172.21.15.159:3300/0 conn(0x7f71a80bc8e0 msgr2=0x7f71a81513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 --2- 172.21.15.115:0/931501051 >> v2:172.21.15.159:3300/0 conn(0x7f71a80bc8e0 0x7f71a81513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8151f90 con 0x7f71a80bccc0 2023-07-27T14:29:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f719c001470 con 0x7f71a80bccc0 2023-07-27T14:29:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.618+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 >> v1:172.21.15.115:6789/0 conn(0x7f71a80bccc0 legacy=0x7f71a80a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a5d9b700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71900038e0 0x7f7190003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a5d9b700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7190004690 0x7f7190004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a5d9b700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a8068c10 0x7f7190005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a81519d0 con 0x7f7190004690 2023-07-27T14:29:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a8151cb0 con 0x7f71900038e0 2023-07-27T14:29:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719000daf0 con 0x7f71a8068c10 2023-07-27T14:29:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a659c700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7190004690 0x7f7190004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a6d9d700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71900038e0 0x7f7190003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a759e700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a8068c10 0x7f7190005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a659c700 1 -- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a8068c10 msgr2=0x7f7190005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a659c700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a8068c10 0x7f7190005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a659c700 1 -- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71900038e0 msgr2=0x7f7190003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:21.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a659c700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71900038e0 0x7f7190003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a659c700 1 -- 172.21.15.115:0/931501051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71900033f0 con 0x7f7190004690 2023-07-27T14:29:21.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.619+0000 7f71a659c700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7190004690 0x7f7190004b10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f719c00c210 tx=0x7f719c001e90).ready entity=mon.0 client_cookie=902c4304d3194de0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c007a60 con 0x7f7190004690 2023-07-27T14:29:21.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c00cae0 con 0x7f7190004690 2023-07-27T14:29:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71a5d9b700 1 -- 172.21.15.115:0/931501051 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c00ce60 con 0x7f7190004690 2023-07-27T14:29:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71ad1ff700 1 -- 172.21.15.115:0/931501051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7190004690 msgr2=0x7f7190004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71ad1ff700 1 --2- 172.21.15.115:0/931501051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7190004690 0x7f7190004b10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f719c00c210 tx=0x7f719c001e90).stop 2023-07-27T14:29:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71a759e700 1 -- 172.21.15.115:0/931501051 reap_dead start 2023-07-27T14:29:21.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71ad1ff700 1 -- 172.21.15.115:0/931501051 shutdown_connections 2023-07-27T14:29:21.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71ad1ff700 1 -- 172.21.15.115:0/931501051 >> 172.21.15.115:0/931501051 conn(0x7f71a8062ec0 msgr2=0x7f71a80c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:21.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71ad1ff700 1 -- 172.21.15.115:0/931501051 shutdown_connections 2023-07-27T14:29:21.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.620+0000 7f71ad1ff700 1 -- 172.21.15.115:0/931501051 wait complete. 2023-07-27T14:29:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.622+0000 7f71ad1ff700 1 Processor -- start 2023-07-27T14:29:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.622+0000 7f71ad1ff700 1 -- start start 2023-07-27T14:29:21.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71ad1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190004690 0x7f71a814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71ad1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a80c6110 0x7f71a80c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71ad1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a814ca30 0x7f71a814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71ad1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a814f7b0 con 0x7f71a80c6110 2023-07-27T14:29:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71ad1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80c6a80 con 0x7f7190004690 2023-07-27T14:29:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71ad1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a814b200 con 0x7f71a814ca30 2023-07-27T14:29:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a80c6110 0x7f71a80c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a80c6110 0x7f71a80c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58158/0 (socket says 172.21.15.115:58158) 2023-07-27T14:29:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 -- 172.21.15.115:0/3568748604 learned_addr learned my addr 172.21.15.115:0/3568748604 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 -- 172.21.15.115:0/3568748604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a814ca30 msgr2=0x7f71a814ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a814ca30 0x7f71a814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 -- 172.21.15.115:0/3568748604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190004690 msgr2=0x7f71a814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190004690 0x7f71a814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 -- 172.21.15.115:0/3568748604 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a814e940 con 0x7f71a80c6110 2023-07-27T14:29:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.623+0000 7f71a659c700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a80c6110 0x7f71a80c6590 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f7190004480 tx=0x7f719c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.624+0000 7f718effd700 1 -- 172.21.15.115:0/3568748604 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c0046b0 con 0x7f71a80c6110 2023-07-27T14:29:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.624+0000 7f718effd700 1 -- 172.21.15.115:0/3568748604 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c004810 con 0x7f71a80c6110 2023-07-27T14:29:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.624+0000 7f718effd700 1 -- 172.21.15.115:0/3568748604 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c004bd0 con 0x7f71a80c6110 2023-07-27T14:29:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.624+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a814ebe0 con 0x7f71a80c6110 2023-07-27T14:29:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.624+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a814f160 con 0x7f71a80c6110 2023-07-27T14:29:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.625+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a805f0c0 con 0x7f71a80c6110 2023-07-27T14:29:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.626+0000 7f718effd700 1 -- 172.21.15.115:0/3568748604 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f719c01d070 con 0x7f71a80c6110 2023-07-27T14:29:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.626+0000 7f718effd700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f719405eef0 0x7f71940613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.627+0000 7f718effd700 1 -- 172.21.15.115:0/3568748604 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f719c07a990 con 0x7f71a80c6110 2023-07-27T14:29:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.627+0000 7f71a6d9d700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f719405eef0 0x7f71940613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.627+0000 7f71a6d9d700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f719405eef0 0x7f71940613b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f7198006d80 tx=0x7f7198009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.631+0000 7f718effd700 1 -- 172.21.15.115:0/3568748604 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f719c04bd50 con 0x7f71a80c6110 2023-07-27T14:29:21.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.839+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f71a8064ee0 con 0x7f71a80c6110 2023-07-27T14:29:21.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.840+0000 7f718effd700 1 -- 172.21.15.115:0/3568748604 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f719c025020 con 0x7f71a80c6110 2023-07-27T14:29:21.864 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:29:21.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f719405eef0 msgr2=0x7f71940613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f719405eef0 0x7f71940613b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f7198006d80 tx=0x7f7198009060).stop 2023-07-27T14:29:21.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a80c6110 msgr2=0x7f71a80c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:21.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a80c6110 0x7f71a80c6590 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f7190004480 tx=0x7f719c015000).stop 2023-07-27T14:29:21.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 shutdown_connections 2023-07-27T14:29:21.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f719405eef0 0x7f71940613b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71a814ca30 0x7f71a814ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:21.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7190004690 0x7f71a814ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:21.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 --2- 172.21.15.115:0/3568748604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71a80c6110 0x7f71a80c6590 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:21.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 >> 172.21.15.115:0/3568748604 conn(0x7f71a8062ec0 msgr2=0x7f71a80c3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:21.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 shutdown_connections 2023-07-27T14:29:21.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:21.842+0000 7f71ad1ff700 1 -- 172.21.15.115:0/3568748604 wait complete. 2023-07-27T14:29:21.881 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:29:21.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:29:21.882 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:29:21.882 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:29:21.882 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:29:21.883 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:29:21.883 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:29:21.884 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:29:21.884 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:29:21.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:21.885 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:29:21.932 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:29:21.933 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:29:21.933 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:29:21.933 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:21.933 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:29:21.933 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:21.934 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:29:21.934 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:21.934 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:29:21.934 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:29:21.934 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:21.934 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:29:21.935 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:29:21.935 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:21.935 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:29:21.935 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:21.935 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:29:21.935 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41839sec preferred_lft 41839sec 2023-07-27T14:29:21.935 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:29:21.936 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:21.936 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:29:21.936 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:21.936 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:29:21.936 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:21.937 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:29:21.937 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:21.937 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:29:21.937 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:29:21.938 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:29:21.938 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:21.938 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:29:21.939 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:29:21.939 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:29:21.939 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:21.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:21.940 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:29:22.040 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:29:22.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:22.044 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:29:22.092 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:29:22.093 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:29:22.093 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:29:22.093 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:29:22.093 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:29:22.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:22.095 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:29:22.095 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:29:22.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:29:22.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:29:22.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:29:22.096 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:29:22.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:22.266 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:29:22.313 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:29:22.314 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:29:22.314 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:29:22.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:22.316 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:29:22.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:22.425 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:29:22.470 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:29:22.471 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:29:22.608 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:29:22.609 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:29:22.634 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:29:22.635 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:29:22.640 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:29:22.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:22.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:29:22.711 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:29:22.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.857+0000 7fca459ff700 1 Processor -- start 2023-07-27T14:29:22.882 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.857+0000 7fca459ff700 1 -- start start 2023-07-27T14:29:22.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.858+0000 7fca459ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fca40155580 0x7fca4015f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:22.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.858+0000 7fca459ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca40158e00 con 0x7fca400c64b0 2023-07-27T14:29:22.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.858+0000 7fca459ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca40158040 con 0x7fca40154190 2023-07-27T14:29:22.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.858+0000 7fca459ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400aa640 con 0x7fca40155580 2023-07-27T14:29:22.885 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3effd700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fca40154190 0x7fca400a9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53588/0 (socket says 172.21.15.159:53588) 2023-07-27T14:29:22.885 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3effd700 1 -- 172.21.15.159:0/4058173929 learned_addr learned my addr 172.21.15.159:0/4058173929 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:29:22.885 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3f7fe700 1 --2- 172.21.15.159:0/4058173929 >> v2:172.21.15.115:3300/0 conn(0x7fca40155580 0x7fca4015f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:22.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3dffb700 1 -- 172.21.15.159:0/4058173929 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277642576 0 0) 0x7fca40158040 con 0x7fca40154190 2023-07-27T14:29:22.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3dffb700 1 -- 172.21.15.159:0/4058173929 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca280033f0 con 0x7fca40154190 2023-07-27T14:29:22.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3dffb700 1 -- 172.21.15.159:0/4058173929 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847008714 0 0) 0x7fca40158e00 con 0x7fca400c64b0 2023-07-27T14:29:22.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3dffb700 1 -- 172.21.15.159:0/4058173929 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca40158040 con 0x7fca400c64b0 2023-07-27T14:29:22.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3f7fe700 1 -- 172.21.15.159:0/4058173929 >> v1:172.21.15.159:6789/0 conn(0x7fca40154190 legacy=0x7fca400a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:22.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3f7fe700 1 -- 172.21.15.159:0/4058173929 >> v1:172.21.15.115:6789/0 conn(0x7fca400c64b0 legacy=0x7fca400641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:22.886 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.859+0000 7fca3f7fe700 1 -- 172.21.15.159:0/4058173929 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca40158320 con 0x7fca40155580 2023-07-27T14:29:22.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca3f7fe700 1 --2- 172.21.15.159:0/4058173929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca40155580 0x7fca4015f240 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fca38009e60 tx=0x7fca38009780).ready entity=mon.0 client_cookie=2e63afb86bbce7b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:22.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca3dffb700 1 -- 172.21.15.159:0/4058173929 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800e070 con 0x7fca40155580 2023-07-27T14:29:22.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca3dffb700 1 -- 172.21.15.159:0/4058173929 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3800bab0 con 0x7fca40155580 2023-07-27T14:29:22.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca3dffb700 1 -- 172.21.15.159:0/4058173929 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800be30 con 0x7fca40155580 2023-07-27T14:29:22.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca459ff700 1 -- 172.21.15.159:0/4058173929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca40155580 msgr2=0x7fca4015f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:22.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca459ff700 1 --2- 172.21.15.159:0/4058173929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca40155580 0x7fca4015f240 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fca38009e60 tx=0x7fca38009780).stop 2023-07-27T14:29:22.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca459ff700 1 -- 172.21.15.159:0/4058173929 shutdown_connections 2023-07-27T14:29:22.887 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca459ff700 1 --2- 172.21.15.159:0/4058173929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca40155580 0x7fca4015f240 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:22.888 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca459ff700 1 -- 172.21.15.159:0/4058173929 >> 172.21.15.159:0/4058173929 conn(0x7fca400cb730 msgr2=0x7fca400c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:22.888 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca459ff700 1 -- 172.21.15.159:0/4058173929 shutdown_connections 2023-07-27T14:29:22.888 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.860+0000 7fca459ff700 1 -- 172.21.15.159:0/4058173929 wait complete. 2023-07-27T14:29:22.889 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.862+0000 7fca459ff700 1 Processor -- start 2023-07-27T14:29:22.890 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.862+0000 7fca459ff700 1 -- start start 2023-07-27T14:29:22.890 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca459ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca400c64b0 0x7fca400c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:22.890 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca459ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca40154190 0x7fca400c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:22.890 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca459ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40156c90 0x7fca40150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:22.890 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca459ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca401507b0 con 0x7fca400c64b0 2023-07-27T14:29:22.890 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca459ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4014fba0 con 0x7fca40156c90 2023-07-27T14:29:22.890 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca459ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4014fe80 con 0x7fca40154190 2023-07-27T14:29:22.891 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca3f7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40156c90 0x7fca40150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:22.891 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca3e7fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca40154190 0x7fca400c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:22.891 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca3f7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40156c90 0x7fca40150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36700/0 (socket says 172.21.15.159:36700) 2023-07-27T14:29:22.891 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.863+0000 7fca3f7fe700 1 -- 172.21.15.159:0/3928350316 learned_addr learned my addr 172.21.15.159:0/3928350316 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:29:22.891 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca3effd700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca400c64b0 0x7fca400c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:22.891 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca3e7fc700 1 -- 172.21.15.159:0/3928350316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40156c90 msgr2=0x7fca40150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:22.891 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca3e7fc700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40156c90 0x7fca40150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:22.891 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca3e7fc700 1 -- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca400c64b0 msgr2=0x7fca400c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:22.892 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca3e7fc700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca400c64b0 0x7fca400c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:22.892 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca3e7fc700 1 -- 172.21.15.159:0/3928350316 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38009a20 con 0x7fca40154190 2023-07-27T14:29:22.892 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca3f7fe700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40156c90 0x7fca40150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:22.892 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca3e7fc700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca40154190 0x7fca400c1f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fca3400c420 tx=0x7fca34007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:22.892 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca26ffd700 1 -- 172.21.15.159:0/3928350316 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400ce80 con 0x7fca40154190 2023-07-27T14:29:22.892 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca26ffd700 1 -- 172.21.15.159:0/3928350316 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400f470 con 0x7fca40154190 2023-07-27T14:29:22.893 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca26ffd700 1 -- 172.21.15.159:0/3928350316 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400f7f0 con 0x7fca40154190 2023-07-27T14:29:22.893 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.864+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca40150160 con 0x7fca40154190 2023-07-27T14:29:22.893 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.865+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca400c2440 con 0x7fca40154190 2023-07-27T14:29:22.894 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.865+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4005f0c0 con 0x7fca40154190 2023-07-27T14:29:22.894 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.866+0000 7fca26ffd700 1 -- 172.21.15.159:0/3928350316 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7fca34019030 con 0x7fca40154190 2023-07-27T14:29:22.894 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.867+0000 7fca26ffd700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca2c05eef0 0x7fca2c0613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:22.894 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.867+0000 7fca26ffd700 1 -- 172.21.15.159:0/3928350316 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca340792a0 con 0x7fca40154190 2023-07-27T14:29:22.894 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.868+0000 7fca3effd700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca2c05eef0 0x7fca2c0613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:22.895 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.868+0000 7fca3effd700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca2c05eef0 0x7fca2c0613b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fca30005750 tx=0x7fca30009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:22.896 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:22.872+0000 7fca26ffd700 1 -- 172.21.15.159:0/3928350316 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca3404a5d0 con 0x7fca40154190 2023-07-27T14:29:23.107 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.081+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca4014ffc0 con 0x7fca40154190 2023-07-27T14:29:23.107 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.082+0000 7fca26ffd700 1 -- 172.21.15.159:0/3928350316 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca4014ffc0 con 0x7fca40154190 2023-07-27T14:29:23.108 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:29:23.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca2c05eef0 msgr2=0x7fca2c0613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:23.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca2c05eef0 0x7fca2c0613b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fca30005750 tx=0x7fca30009040).stop 2023-07-27T14:29:23.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca40154190 msgr2=0x7fca400c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:23.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca40154190 0x7fca400c1f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fca3400c420 tx=0x7fca34007bd0).stop 2023-07-27T14:29:23.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 shutdown_connections 2023-07-27T14:29:23.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca2c05eef0 0x7fca2c0613b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:23.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca40156c90 0x7fca40150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:23.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca400c64b0 0x7fca400c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:23.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 --2- 172.21.15.159:0/3928350316 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca40154190 0x7fca400c1f50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:23.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 >> 172.21.15.159:0/3928350316 conn(0x7fca400cb730 msgr2=0x7fca4014bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:23.113 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 shutdown_connections 2023-07-27T14:29:23.113 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:29:23.084+0000 7fca459ff700 1 -- 172.21.15.159:0/3928350316 wait complete. 2023-07-27T14:29:23.123 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:29:23.123 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:29:23.123 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:29:23.124 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:29:23.126 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:29:23.126 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:29:23.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:29:23.128 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:29:23.128 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:29:23.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:23.130 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:29:23.177 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:29:23.177 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:29:23.177 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:29:23.178 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:23.178 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:29:23.178 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:23.178 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:29:23.178 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:23.178 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:29:23.179 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:29:23.179 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:23.179 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:29:23.179 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:29:23.179 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:23.180 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:29:23.180 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:23.180 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:29:23.181 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41834sec preferred_lft 41834sec 2023-07-27T14:29:23.181 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:29:23.181 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:23.181 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:29:23.182 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:29:23.182 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:29:23.182 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:23.182 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:29:23.183 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:23.183 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:29:23.183 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:29:23.183 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:29:23.184 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:23.184 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:29:23.184 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:29:23.185 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:29:23.185 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:29:23.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:23.186 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:29:23.256 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:29:23.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:23.259 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:29:23.307 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:29:23.308 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:29:23.308 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:29:23.308 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:29:23.308 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:29:23.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:23.310 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:29:23.310 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:29:23.310 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:29:23.311 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:29:23.311 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:29:23.311 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:29:23.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:23.482 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:29:23.530 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:29:23.530 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:29:23.531 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:29:23.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:23.532 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:29:23.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:23.605 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:29:23.651 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:29:23.651 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:29:23.750 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:29:23.750 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:29:23.777 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:29:23.777 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:29:23.781 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:29:23.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:23.782 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:29:23.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:29:24.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.030+0000 7f498cfff700 1 Processor -- start 2023-07-27T14:29:24.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.030+0000 7f498cfff700 1 -- start start 2023-07-27T14:29:24.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.031+0000 7f498cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49881509b0 0x7f49880c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.031+0000 7f498cfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49880c0ea0 con 0x7f4988150d90 2023-07-27T14:29:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.031+0000 7f498cfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4988068e10 con 0x7f49880c3100 2023-07-27T14:29:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.031+0000 7f498cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4988155190 con 0x7f49881509b0 2023-07-27T14:29:24.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f4985d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4988150d90 0x7f4988154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55742/0 (socket says 172.21.15.115:55742) 2023-07-27T14:29:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f4985d9b700 1 -- 172.21.15.115:0/1881042549 learned_addr learned my addr 172.21.15.115:0/1881042549 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498659c700 1 --2- 172.21.15.115:0/1881042549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49881509b0 0x7f49880c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498559a700 1 -- 172.21.15.115:0/1881042549 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601183313 0 0) 0x7f49880c0ea0 con 0x7f4988150d90 2023-07-27T14:29:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498559a700 1 -- 172.21.15.115:0/1881042549 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49700033f0 con 0x7f4988150d90 2023-07-27T14:29:24.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498559a700 1 -- 172.21.15.115:0/1881042549 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62885995 0 0) 0x7f4988068e10 con 0x7f49880c3100 2023-07-27T14:29:24.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498559a700 1 -- 172.21.15.115:0/1881042549 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49880c0ea0 con 0x7f49880c3100 2023-07-27T14:29:24.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498659c700 1 -- 172.21.15.115:0/1881042549 >> v1:172.21.15.159:6789/0 conn(0x7f49880c3100 legacy=0x7f49880c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498659c700 1 -- 172.21.15.115:0/1881042549 >> v1:172.21.15.115:6789/0 conn(0x7f4988150d90 legacy=0x7f4988154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498559a700 1 -- 172.21.15.115:0/1881042549 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 848477684 0 0) 0x7f49700033f0 con 0x7f4988150d90 2023-07-27T14:29:24.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.032+0000 7f498659c700 1 -- 172.21.15.115:0/1881042549 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988155470 con 0x7f49881509b0 2023-07-27T14:29:24.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498659c700 1 --2- 172.21.15.115:0/1881042549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49881509b0 0x7f49880c58d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4978009790 tx=0x7f4978009060).ready entity=mon.2 client_cookie=da95cfedd8b85580 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:24.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498559a700 1 -- 172.21.15.115:0/1881042549 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c001470 con 0x7f49881509b0 2023-07-27T14:29:24.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498559a700 1 -- 172.21.15.115:0/1881042549 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978011400 con 0x7f49881509b0 2023-07-27T14:29:24.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498559a700 1 -- 172.21.15.115:0/1881042549 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978011780 con 0x7f49881509b0 2023-07-27T14:29:24.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498cfff700 1 -- 172.21.15.115:0/1881042549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49881509b0 msgr2=0x7f49880c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498cfff700 1 --2- 172.21.15.115:0/1881042549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49881509b0 0x7f49880c58d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4978009790 tx=0x7f4978009060).stop 2023-07-27T14:29:24.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498cfff700 1 -- 172.21.15.115:0/1881042549 shutdown_connections 2023-07-27T14:29:24.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498cfff700 1 --2- 172.21.15.115:0/1881042549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49881509b0 0x7f49880c58d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498cfff700 1 -- 172.21.15.115:0/1881042549 >> 172.21.15.115:0/1881042549 conn(0x7f4988062320 msgr2=0x7f4988062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:24.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498cfff700 1 -- 172.21.15.115:0/1881042549 shutdown_connections 2023-07-27T14:29:24.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.033+0000 7f498cfff700 1 -- 172.21.15.115:0/1881042549 wait complete. 2023-07-27T14:29:24.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.035+0000 7f498cfff700 1 Processor -- start 2023-07-27T14:29:24.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.035+0000 7f498cfff700 1 -- start start 2023-07-27T14:29:24.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f498cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49880c3100 0x7f4988143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f498cfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49881509b0 0x7f4988152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f498cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4988150d90 0x7f4988153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f498cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498814fcb0 con 0x7f4988150d90 2023-07-27T14:29:24.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f498cfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4988153580 con 0x7f49881509b0 2023-07-27T14:29:24.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f498cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49880bd940 con 0x7f49880c3100 2023-07-27T14:29:24.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f4986d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4988150d90 0x7f4988153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f4986d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4988150d90 0x7f4988153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51370/0 (socket says 172.21.15.115:51370) 2023-07-27T14:29:24.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f4986d9d700 1 -- 172.21.15.115:0/1775396963 learned_addr learned my addr 172.21.15.115:0/1775396963 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:24.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.036+0000 7f498659c700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49880c3100 0x7f4988143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f4985d9b700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49881509b0 0x7f4988152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f4986d9d700 1 -- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49880c3100 msgr2=0x7f4988143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f4986d9d700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49880c3100 0x7f4988143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f4986d9d700 1 -- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49881509b0 msgr2=0x7f4988152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f4986d9d700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49881509b0 0x7f4988152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f4986d9d700 1 -- 172.21.15.115:0/1775396963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780092a0 con 0x7f4988150d90 2023-07-27T14:29:24.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f498659c700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49880c3100 0x7f4988143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:24.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f4986d9d700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4988150d90 0x7f4988153090 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f498000c710 tx=0x7f498000cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:24.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f49767fc700 1 -- 172.21.15.115:0/1775396963 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980010510 con 0x7f4988150d90 2023-07-27T14:29:24.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f49767fc700 1 -- 172.21.15.115:0/1775396963 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980010670 con 0x7f4988150d90 2023-07-27T14:29:24.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4988151f50 con 0x7f4988150d90 2023-07-27T14:29:24.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f49767fc700 1 -- 172.21.15.115:0/1775396963 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800109f0 con 0x7f4988150d90 2023-07-27T14:29:24.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.037+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49880bdc10 con 0x7f4988150d90 2023-07-27T14:29:24.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.038+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498806c470 con 0x7f4988150d90 2023-07-27T14:29:24.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.039+0000 7f49767fc700 1 -- 172.21.15.115:0/1775396963 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f4980010070 con 0x7f4988150d90 2023-07-27T14:29:24.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.040+0000 7f49767fc700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f496805eec0 0x7f4968061380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.040+0000 7f49767fc700 1 -- 172.21.15.115:0/1775396963 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4980079c30 con 0x7f4988150d90 2023-07-27T14:29:24.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.040+0000 7f498659c700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f496805eec0 0x7f4968061380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.040+0000 7f498659c700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f496805eec0 0x7f4968061380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f49780096e0 tx=0x7f4978016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:24.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.044+0000 7f49767fc700 1 -- 172.21.15.115:0/1775396963 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f498004af60 con 0x7f4988150d90 2023-07-27T14:29:24.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.255+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4988155750 con 0x7f4988150d90 2023-07-27T14:29:24.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.583+0000 7f49767fc700 1 -- 172.21.15.115:0/1775396963 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 136+0+0 (secure 0 0 0) 0x7f498004e580 con 0x7f4988150d90 2023-07-27T14:29:24.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f496805eec0 msgr2=0x7f4968061380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f496805eec0 0x7f4968061380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f49780096e0 tx=0x7f4978016000).stop 2023-07-27T14:29:24.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4988150d90 msgr2=0x7f4988153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4988150d90 0x7f4988153090 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f498000c710 tx=0x7f498000cad0).stop 2023-07-27T14:29:24.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 shutdown_connections 2023-07-27T14:29:24.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f496805eec0 0x7f4968061380 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4988150d90 0x7f4988153090 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49880c3100 0x7f4988143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 --2- 172.21.15.115:0/1775396963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49881509b0 0x7f4988152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 >> 172.21.15.115:0/1775396963 conn(0x7f4988062320 msgr2=0x7f49880c4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:24.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 shutdown_connections 2023-07-27T14:29:24.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.585+0000 7f498cfff700 1 -- 172.21.15.115:0/1775396963 wait complete. 2023-07-27T14:29:24.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:29:24.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.792+0000 7f27517ff700 1 Processor -- start 2023-07-27T14:29:24.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.792+0000 7f27517ff700 1 -- start start 2023-07-27T14:29:24.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f27517ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f274c0aaa40 0x7f274c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f27517ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c1542a0 0x7f274c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f27517ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0aa4d0 con 0x7f274c153ec0 2023-07-27T14:29:24.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f27517ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c064ad0 con 0x7f274c0aaa40 2023-07-27T14:29:24.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f27517ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0c05c0 con 0x7f274c1542a0 2023-07-27T14:29:24.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f274b7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c1542a0 0x7f274c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f274a7fc700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f274c0aaa40 0x7f274c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f274b7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c1542a0 0x7f274c0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:57446/0 (socket says 172.21.15.115:57446) 2023-07-27T14:29:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f274a7fc700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f274c0aaa40 0x7f274c0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:57536/0 (socket says 172.21.15.115:57536) 2023-07-27T14:29:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f274b7fe700 1 -- 172.21.15.115:0/2334857047 learned_addr learned my addr 172.21.15.115:0/2334857047 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.794+0000 7f274affd700 1 --1- 172.21.15.115:0/2334857047 >> v1:172.21.15.159:6789/0 conn(0x7f274c153ec0 0x7f274c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:34048/0 (socket says 172.21.15.115:34048) 2023-07-27T14:29:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.795+0000 7f274a7fc700 1 -- 172.21.15.115:0/2334857047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c1542a0 msgr2=0x7f274c0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.795+0000 7f274a7fc700 1 --2- 172.21.15.115:0/2334857047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c1542a0 0x7f274c0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.795+0000 7f274a7fc700 1 -- 172.21.15.115:0/2334857047 >> v1:172.21.15.159:6789/0 conn(0x7f274c153ec0 legacy=0x7f274c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.795+0000 7f274a7fc700 1 -- 172.21.15.115:0/2334857047 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0c1a60 con 0x7f274c0aaa40 2023-07-27T14:29:24.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.795+0000 7f274a7fc700 1 --2- 172.21.15.115:0/2334857047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0aaa40 0x7f274c0640f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f2740009760 tx=0x7f2740009060).ready entity=mon.1 client_cookie=ca48c86a379b8c9f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:24.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.795+0000 7f2749ffb700 1 -- 172.21.15.115:0/2334857047 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000f510 con 0x7f274c0aaa40 2023-07-27T14:29:24.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.795+0000 7f2749ffb700 1 -- 172.21.15.115:0/2334857047 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274000f670 con 0x7f274c0aaa40 2023-07-27T14:29:24.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.795+0000 7f2749ffb700 1 -- 172.21.15.115:0/2334857047 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000f9f0 con 0x7f274c0aaa40 2023-07-27T14:29:24.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.796+0000 7f27517ff700 1 -- 172.21.15.115:0/2334857047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0aaa40 msgr2=0x7f274c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.796+0000 7f27517ff700 1 --2- 172.21.15.115:0/2334857047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0aaa40 0x7f274c0640f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f2740009760 tx=0x7f2740009060).stop 2023-07-27T14:29:24.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.796+0000 7f27517ff700 1 -- 172.21.15.115:0/2334857047 shutdown_connections 2023-07-27T14:29:24.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.796+0000 7f27517ff700 1 --2- 172.21.15.115:0/2334857047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c1542a0 0x7f274c0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.796+0000 7f27517ff700 1 --2- 172.21.15.115:0/2334857047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c0aaa40 0x7f274c0640f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.796+0000 7f27517ff700 1 -- 172.21.15.115:0/2334857047 >> 172.21.15.115:0/2334857047 conn(0x7f274c0cb610 msgr2=0x7f274c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:24.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.796+0000 7f27517ff700 1 -- 172.21.15.115:0/2334857047 shutdown_connections 2023-07-27T14:29:24.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.796+0000 7f27517ff700 1 -- 172.21.15.115:0/2334857047 wait complete. 2023-07-27T14:29:24.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.797+0000 7f27517ff700 1 Processor -- start 2023-07-27T14:29:24.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.797+0000 7f27517ff700 1 -- start start 2023-07-27T14:29:24.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.798+0000 7f27517ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c0aaa40 0x7f274c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.798+0000 7f27517ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c153ec0 0x7f274c163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.798+0000 7f27517ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f274c1542a0 0x7f274c151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.798+0000 7f27517ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0aeb10 con 0x7f274c1542a0 2023-07-27T14:29:24.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.798+0000 7f27517ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0aed60 con 0x7f274c153ec0 2023-07-27T14:29:24.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.798+0000 7f27517ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0af040 con 0x7f274c0aaa40 2023-07-27T14:29:24.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f274c1542a0 0x7f274c151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f274c1542a0 0x7f274c151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51380/0 (socket says 172.21.15.115:51380) 2023-07-27T14:29:24.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 -- 172.21.15.115:0/4194367765 learned_addr learned my addr 172.21.15.115:0/4194367765 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:24.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274a7fc700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c153ec0 0x7f274c163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274affd700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c0aaa40 0x7f274c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 -- 172.21.15.115:0/4194367765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c0aaa40 msgr2=0x7f274c14e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c0aaa40 0x7f274c14e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 -- 172.21.15.115:0/4194367765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c153ec0 msgr2=0x7f274c163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:24.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c153ec0 0x7f274c163f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:24.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 -- 172.21.15.115:0/4194367765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400092a0 con 0x7f274c1542a0 2023-07-27T14:29:24.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f274b7fe700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f274c1542a0 0x7f274c151ec0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f2744009d30 tx=0x7f274400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:24.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.799+0000 7f2732ffd700 1 -- 172.21.15.115:0/4194367765 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744009e90 con 0x7f274c1542a0 2023-07-27T14:29:24.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.800+0000 7f2732ffd700 1 -- 172.21.15.115:0/4194367765 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274400f040 con 0x7f274c1542a0 2023-07-27T14:29:24.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.800+0000 7f2732ffd700 1 -- 172.21.15.115:0/4194367765 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274400cac0 con 0x7f274c1542a0 2023-07-27T14:29:24.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.800+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c0af320 con 0x7f274c1542a0 2023-07-27T14:29:24.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.800+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c14eb10 con 0x7f274c1542a0 2023-07-27T14:29:24.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.801+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c14ed00 con 0x7f274c1542a0 2023-07-27T14:29:24.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.802+0000 7f2732ffd700 1 -- 172.21.15.115:0/4194367765 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f2744014410 con 0x7f274c1542a0 2023-07-27T14:29:24.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.802+0000 7f2732ffd700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f273805eef0 0x7f27380613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:24.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.802+0000 7f2732ffd700 1 -- 172.21.15.115:0/4194367765 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2744079d70 con 0x7f274c1542a0 2023-07-27T14:29:24.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.803+0000 7f274affd700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f273805eef0 0x7f27380613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:24.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.803+0000 7f274affd700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f273805eef0 0x7f27380613b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f273c007fd0 tx=0x7f273c007d30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:24.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:24.806+0000 7f2732ffd700 1 -- 172.21.15.115:0/4194367765 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27440498f0 con 0x7f274c1542a0 2023-07-27T14:29:25.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.001+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f274c0af840 con 0x7f273805eef0 2023-07-27T14:29:25.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.003+0000 7f2732ffd700 1 -- 172.21.15.115:0/4194367765 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f274c0af840 con 0x7f273805eef0 2023-07-27T14:29:25.027 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:29:25.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:29:25.027 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:29:25.028 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:25.028 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:29:25.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f273805eef0 msgr2=0x7f27380613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f273805eef0 0x7f27380613b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f273c007fd0 tx=0x7f273c007d30).stop 2023-07-27T14:29:25.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f274c1542a0 msgr2=0x7f274c151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f274c1542a0 0x7f274c151ec0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f2744009d30 tx=0x7f274400b040).stop 2023-07-27T14:29:25.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 shutdown_connections 2023-07-27T14:29:25.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f273805eef0 0x7f27380613b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f274c1542a0 0x7f274c151ec0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f274c0aaa40 0x7f274c14e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 --2- 172.21.15.115:0/4194367765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f274c153ec0 0x7f274c163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 >> 172.21.15.115:0/4194367765 conn(0x7f274c0cb610 msgr2=0x7f274c062ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:25.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 shutdown_connections 2023-07-27T14:29:25.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.005+0000 7f27517ff700 1 -- 172.21.15.115:0/4194367765 wait complete. 2023-07-27T14:29:25.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:29:25.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.212+0000 7f80fe1ff700 1 Processor -- start 2023-07-27T14:29:25.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.212+0000 7f80fe1ff700 1 -- start start 2023-07-27T14:29:25.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.213+0000 7f80fe1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814ae00 0x7f80f8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.213+0000 7f80fe1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80f814b1e0 0x7f80f8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.213+0000 7f80fe1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f81553f0 con 0x7f80f80c5c50 2023-07-27T14:29:25.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.213+0000 7f80fe1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f8157a50 con 0x7f80f814b1e0 2023-07-27T14:29:25.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.213+0000 7f80fe1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8157d10 con 0x7f80f814ae00 2023-07-27T14:29:25.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80f814b1e0 0x7f80f8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80f814b1e0 0x7f80f8062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51396/0 (socket says 172.21.15.115:51396) 2023-07-27T14:29:25.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f6ffd700 1 -- 172.21.15.115:0/1798282678 learned_addr learned my addr 172.21.15.115:0/1798282678 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:25.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f77fe700 1 --2- 172.21.15.115:0/1798282678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814ae00 0x7f80f8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f6ffd700 1 -- 172.21.15.115:0/1798282678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814ae00 msgr2=0x7f80f8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:25.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f6ffd700 1 --2- 172.21.15.115:0/1798282678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814ae00 0x7f80f8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f6ffd700 1 -- 172.21.15.115:0/1798282678 >> v1:172.21.15.159:6789/0 conn(0x7f80f80c5c50 legacy=0x7f80f80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:25.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f6ffd700 1 -- 172.21.15.115:0/1798282678 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f8157ff0 con 0x7f80f814b1e0 2023-07-27T14:29:25.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.214+0000 7f80f6ffd700 1 --2- 172.21.15.115:0/1798282678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f814b1e0 0x7f80f8062b50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f80ec006fd0 tx=0x7f80ec0090f0).ready entity=mon.0 client_cookie=f71ab43a97f5d803 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:25.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80f67fc700 1 -- 172.21.15.115:0/1798282678 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00b600 con 0x7f80f814b1e0 2023-07-27T14:29:25.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80f67fc700 1 -- 172.21.15.115:0/1798282678 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec00b760 con 0x7f80f814b1e0 2023-07-27T14:29:25.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80f67fc700 1 -- 172.21.15.115:0/1798282678 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00bae0 con 0x7f80f814b1e0 2023-07-27T14:29:25.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80fe1ff700 1 -- 172.21.15.115:0/1798282678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f814b1e0 msgr2=0x7f80f8062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/1798282678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f814b1e0 0x7f80f8062b50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f80ec006fd0 tx=0x7f80ec0090f0).stop 2023-07-27T14:29:25.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80fe1ff700 1 -- 172.21.15.115:0/1798282678 shutdown_connections 2023-07-27T14:29:25.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/1798282678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814ae00 0x7f80f8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/1798282678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f814b1e0 0x7f80f8062b50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80fe1ff700 1 -- 172.21.15.115:0/1798282678 >> 172.21.15.115:0/1798282678 conn(0x7f80f805e940 msgr2=0x7f80f80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:25.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80fe1ff700 1 -- 172.21.15.115:0/1798282678 shutdown_connections 2023-07-27T14:29:25.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.215+0000 7f80fe1ff700 1 -- 172.21.15.115:0/1798282678 wait complete. 2023-07-27T14:29:25.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.217+0000 7f80fe1ff700 1 Processor -- start 2023-07-27T14:29:25.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.217+0000 7f80fe1ff700 1 -- start start 2023-07-27T14:29:25.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80fe1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f80c5c50 0x7f80f80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80fe1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80f814ae00 0x7f80f81567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80fe1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814b1e0 0x7f80f8156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80fe1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81571c0 con 0x7f80f80c5c50 2023-07-27T14:29:25.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80fe1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8136ef0 con 0x7f80f814ae00 2023-07-27T14:29:25.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80fe1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80b00b0 con 0x7f80f814b1e0 2023-07-27T14:29:25.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f80c5c50 0x7f80f80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f80c5c50 0x7f80f80af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51400/0 (socket says 172.21.15.115:51400) 2023-07-27T14:29:25.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f77fe700 1 -- 172.21.15.115:0/3762142184 learned_addr learned my addr 172.21.15.115:0/3762142184 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:25.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f6ffd700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80f814ae00 0x7f80f81567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f7fff700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814b1e0 0x7f80f8156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f77fe700 1 -- 172.21.15.115:0/3762142184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814b1e0 msgr2=0x7f80f8156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f77fe700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814b1e0 0x7f80f8156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f77fe700 1 -- 172.21.15.115:0/3762142184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80f814ae00 msgr2=0x7f80f81567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f77fe700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80f814ae00 0x7f80f81567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.218+0000 7f80f77fe700 1 -- 172.21.15.115:0/3762142184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec009370 con 0x7f80f80c5c50 2023-07-27T14:29:25.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.219+0000 7f80f77fe700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f80c5c50 0x7f80f80af7d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f80e800d890 tx=0x7f80e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:25.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.219+0000 7f80df7fe700 1 -- 172.21.15.115:0/3762142184 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80125f0 con 0x7f80f80c5c50 2023-07-27T14:29:25.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.219+0000 7f80df7fe700 1 -- 172.21.15.115:0/3762142184 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8012750 con 0x7f80f80c5c50 2023-07-27T14:29:25.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.219+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f80b0390 con 0x7f80f80c5c50 2023-07-27T14:29:25.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.219+0000 7f80df7fe700 1 -- 172.21.15.115:0/3762142184 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8012ad0 con 0x7f80f80c5c50 2023-07-27T14:29:25.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.219+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f80b0950 con 0x7f80f80c5c50 2023-07-27T14:29:25.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.220+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f806c470 con 0x7f80f80c5c50 2023-07-27T14:29:25.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.221+0000 7f80df7fe700 1 -- 172.21.15.115:0/3762142184 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f80e8013480 con 0x7f80f80c5c50 2023-07-27T14:29:25.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.221+0000 7f80df7fe700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80e405eef0 0x7f80e40613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.222+0000 7f80df7fe700 1 -- 172.21.15.115:0/3762142184 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f80e807a110 con 0x7f80f80c5c50 2023-07-27T14:29:25.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.222+0000 7f80f6ffd700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80e405eef0 0x7f80e40613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.222+0000 7f80f6ffd700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80e405eef0 0x7f80e40613b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f80f80c1c00 tx=0x7f80ec017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:25.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.226+0000 7f80df7fe700 1 -- 172.21.15.115:0/3762142184 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f80e804b3e0 con 0x7f80f80c5c50 2023-07-27T14:29:25.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.395+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f80f813a7f0 con 0x7f80f80c5c50 2023-07-27T14:29:25.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.395+0000 7f80df7fe700 1 -- 172.21.15.115:0/3762142184 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f80e804ea00 con 0x7f80f80c5c50 2023-07-27T14:29:25.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80e405eef0 msgr2=0x7f80e40613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80e405eef0 0x7f80e40613b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f80f80c1c00 tx=0x7f80ec017000).stop 2023-07-27T14:29:25.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f80c5c50 msgr2=0x7f80f80af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f80c5c50 0x7f80f80af7d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f80e800d890 tx=0x7f80e8008040).stop 2023-07-27T14:29:25.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 shutdown_connections 2023-07-27T14:29:25.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80e405eef0 0x7f80e40613b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80f814b1e0 0x7f80f8156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80f80c5c50 0x7f80f80af7d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 --2- 172.21.15.115:0/3762142184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80f814ae00 0x7f80f81567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 >> 172.21.15.115:0/3762142184 conn(0x7f80f805e940 msgr2=0x7f80f8062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:25.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 shutdown_connections 2023-07-27T14:29:25.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.397+0000 7f80fe1ff700 1 -- 172.21.15.115:0/3762142184 wait complete. 2023-07-27T14:29:25.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000242766 --mode=777 2023-07-27T14:29:25.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.607+0000 7f1d5f7ff700 1 Processor -- start 2023-07-27T14:29:25.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.607+0000 7f1d5f7ff700 1 -- start start 2023-07-27T14:29:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.608+0000 7f1d5f7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1d5814ae00 0x7f1d58154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.608+0000 7f1d5f7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d580a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.608+0000 7f1d5f7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d581553f0 con 0x7f1d5814b1e0 2023-07-27T14:29:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.608+0000 7f1d5f7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d58157a50 con 0x7f1d5814ae00 2023-07-27T14:29:25.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.608+0000 7f1d5f7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d58157d10 con 0x7f1d58063260 2023-07-27T14:29:25.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5dd9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d580a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5d59b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1d5814ae00 0x7f1d58154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5dd9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d580a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:57480/0 (socket says 172.21.15.115:57480) 2023-07-27T14:29:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5dd9c700 1 -- 172.21.15.115:0/1810467370 learned_addr learned my addr 172.21.15.115:0/1810467370 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5d59b700 1 -- 172.21.15.115:0/1810467370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 msgr2=0x7f1d580a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5d59b700 1 --2- 172.21.15.115:0/1810467370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d580a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5d59b700 1 -- 172.21.15.115:0/1810467370 >> v1:172.21.15.159:6789/0 conn(0x7f1d5814b1e0 legacy=0x7f1d58062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5d59b700 1 -- 172.21.15.115:0/1810467370 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58157ff0 con 0x7f1d5814ae00 2023-07-27T14:29:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.609+0000 7f1d5dd9c700 1 --2- 172.21.15.115:0/1810467370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d580a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:29:25.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d5d59b700 1 --2- 172.21.15.115:0/1810467370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814ae00 0x7f1d58154f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f1d54009760 tx=0x7f1d54009060).ready entity=mon.1 client_cookie=15c80671a71e494d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:25.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d4ffff700 1 -- 172.21.15.115:0/1810467370 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400f510 con 0x7f1d5814ae00 2023-07-27T14:29:25.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d4ffff700 1 -- 172.21.15.115:0/1810467370 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5400f670 con 0x7f1d5814ae00 2023-07-27T14:29:25.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d4ffff700 1 -- 172.21.15.115:0/1810467370 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400f9f0 con 0x7f1d5814ae00 2023-07-27T14:29:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/1810467370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814ae00 msgr2=0x7f1d58154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/1810467370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814ae00 0x7f1d58154f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f1d54009760 tx=0x7f1d54009060).stop 2023-07-27T14:29:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/1810467370 shutdown_connections 2023-07-27T14:29:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/1810467370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d580a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/1810467370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814ae00 0x7f1d58154f00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.610+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/1810467370 >> 172.21.15.115:0/1810467370 conn(0x7f1d5805e940 msgr2=0x7f1d580cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:25.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.611+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/1810467370 shutdown_connections 2023-07-27T14:29:25.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.611+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/1810467370 wait complete. 2023-07-27T14:29:25.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.612+0000 7f1d5f7ff700 1 Processor -- start 2023-07-27T14:29:25.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.612+0000 7f1d5f7ff700 1 -- start start 2023-07-27T14:29:25.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5f7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d58138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5f7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d5814ae00 0x7f1d58164800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5f7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814b1e0 0x7f1d580c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5f7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580ca9f0 con 0x7f1d5814ae00 2023-07-27T14:29:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5f7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580c36d0 con 0x7f1d5814b1e0 2023-07-27T14:29:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5f7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580c9e70 con 0x7f1d58063260 2023-07-27T14:29:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5cd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d5814ae00 0x7f1d58164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5cd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d5814ae00 0x7f1d58164800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51410/0 (socket says 172.21.15.115:51410) 2023-07-27T14:29:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.613+0000 7f1d5cd9a700 1 -- 172.21.15.115:0/307535088 learned_addr learned my addr 172.21.15.115:0/307535088 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5dd9c700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814b1e0 0x7f1d580c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5d59b700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d58138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5cd9a700 1 -- 172.21.15.115:0/307535088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 msgr2=0x7f1d58138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5cd9a700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d58138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5cd9a700 1 -- 172.21.15.115:0/307535088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814b1e0 msgr2=0x7f1d580c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5cd9a700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814b1e0 0x7f1d580c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5cd9a700 1 -- 172.21.15.115:0/307535088 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d50009ae0 con 0x7f1d5814ae00 2023-07-27T14:29:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5cd9a700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d5814ae00 0x7f1d58164800 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f1d4800c4c0 tx=0x7f1d48007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d4d7fa700 1 -- 172.21.15.115:0/307535088 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48007020 con 0x7f1d5814ae00 2023-07-27T14:29:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d4d7fa700 1 -- 172.21.15.115:0/307535088 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48007180 con 0x7f1d5814ae00 2023-07-27T14:29:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d540092a0 con 0x7f1d5814ae00 2023-07-27T14:29:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d4d7fa700 1 -- 172.21.15.115:0/307535088 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48007520 con 0x7f1d5814ae00 2023-07-27T14:29:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.614+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d580ca430 con 0x7f1d5814ae00 2023-07-27T14:29:25.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.615+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d580c3890 con 0x7f1d5814ae00 2023-07-27T14:29:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.616+0000 7f1d4d7fa700 1 -- 172.21.15.115:0/307535088 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7f1d48010070 con 0x7f1d5814ae00 2023-07-27T14:29:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.617+0000 7f1d4d7fa700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d3c05eef0 0x7f1d3c0613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:25.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.617+0000 7f1d4d7fa700 1 -- 172.21.15.115:0/307535088 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1d480790e0 con 0x7f1d5814ae00 2023-07-27T14:29:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.617+0000 7f1d5d59b700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d3c05eef0 0x7f1d3c0613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:25.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.618+0000 7f1d5d59b700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d3c05eef0 0x7f1d3c0613b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f1d580ac2e0 tx=0x7f1d54017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:25.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.621+0000 7f1d4d7fa700 1 -- 172.21.15.115:0/307535088 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d480478f0 con 0x7f1d5814ae00 2023-07-27T14:29:25.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.823+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000242766", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d5806c470 con 0x7f1d3c05eef0 2023-07-27T14:29:25.853 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:25.829+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:25.854 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:25.829+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:25.854 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:25.829+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:25.854 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:25.829+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:25.854 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:25.829+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:25.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.868+0000 7f1d4d7fa700 1 -- 172.21.15.115:0/307535088 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1d5806c470 con 0x7f1d3c05eef0 2023-07-27T14:29:25.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d3c05eef0 msgr2=0x7f1d3c0613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d3c05eef0 0x7f1d3c0613b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f1d580ac2e0 tx=0x7f1d54017000).stop 2023-07-27T14:29:25.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d5814ae00 msgr2=0x7f1d58164800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:25.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d5814ae00 0x7f1d58164800 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f1d4800c4c0 tx=0x7f1d48007dd0).stop 2023-07-27T14:29:25.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 shutdown_connections 2023-07-27T14:29:25.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d3c05eef0 0x7f1d3c0613b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d5814b1e0 0x7f1d580c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d58063260 0x7f1d58138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 --2- 172.21.15.115:0/307535088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d5814ae00 0x7f1d58164800 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:25.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 >> 172.21.15.115:0/307535088 conn(0x7f1d5805e940 msgr2=0x7f1d580ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:25.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 shutdown_connections 2023-07-27T14:29:25.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:25.870+0000 7f1d5f7ff700 1 -- 172.21.15.115:0/307535088 wait complete. 2023-07-27T14:29:25.912 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000242766 2023-07-27T14:29:26.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.079+0000 7ffa60bff700 1 Processor -- start 2023-07-27T14:29:26.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.080+0000 7ffa60bff700 1 -- start start 2023-07-27T14:29:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.081+0000 7ffa60bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c069c60 0x7ffa5c1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.081+0000 7ffa60bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0697d0 con 0x7ffa5c062a30 2023-07-27T14:29:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.081+0000 7ffa60bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c155520 con 0x7ffa5c0c7250 2023-07-27T14:29:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.081+0000 7ffa60bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c068ea0 con 0x7ffa5c069c60 2023-07-27T14:29:26.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.081+0000 7ffa5ad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ffa5c062a30 0x7ffa5c154cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55752/0 (socket says 172.21.15.115:55752) 2023-07-27T14:29:26.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.081+0000 7ffa5ad9d700 1 -- 172.21.15.115:0/1475323778 learned_addr learned my addr 172.21.15.115:0/1475323778 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:26.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.081+0000 7ffa59d9b700 1 --2- 172.21.15.115:0/1475323778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c069c60 0x7ffa5c1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:26.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa5959a700 1 -- 172.21.15.115:0/1475323778 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537617381 0 0) 0x7ffa5c0697d0 con 0x7ffa5c062a30 2023-07-27T14:29:26.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa5959a700 1 -- 172.21.15.115:0/1475323778 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa440033f0 con 0x7ffa5c062a30 2023-07-27T14:29:26.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa5959a700 1 -- 172.21.15.115:0/1475323778 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188475141 0 0) 0x7ffa5c155520 con 0x7ffa5c0c7250 2023-07-27T14:29:26.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa5959a700 1 -- 172.21.15.115:0/1475323778 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa5c0697d0 con 0x7ffa5c0c7250 2023-07-27T14:29:26.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa59d9b700 1 -- 172.21.15.115:0/1475323778 >> v1:172.21.15.159:6789/0 conn(0x7ffa5c0c7250 legacy=0x7ffa5c062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:26.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa59d9b700 1 -- 172.21.15.115:0/1475323778 >> v1:172.21.15.115:6789/0 conn(0x7ffa5c062a30 legacy=0x7ffa5c154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:26.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa59d9b700 1 -- 172.21.15.115:0/1475323778 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c069180 con 0x7ffa5c069c60 2023-07-27T14:29:26.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa59d9b700 1 --2- 172.21.15.115:0/1475323778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c069c60 0x7ffa5c1547d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ffa50009790 tx=0x7ffa50009060).ready entity=mon.2 client_cookie=1c669d28b815c7a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:26.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa5959a700 1 -- 172.21.15.115:0/1475323778 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000f510 con 0x7ffa5c069c60 2023-07-27T14:29:26.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa5959a700 1 -- 172.21.15.115:0/1475323778 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000f670 con 0x7ffa5c069c60 2023-07-27T14:29:26.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.082+0000 7ffa5959a700 1 -- 172.21.15.115:0/1475323778 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000f9f0 con 0x7ffa5c069c60 2023-07-27T14:29:26.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.083+0000 7ffa60bff700 1 -- 172.21.15.115:0/1475323778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c069c60 msgr2=0x7ffa5c1547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:26.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.083+0000 7ffa60bff700 1 --2- 172.21.15.115:0/1475323778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c069c60 0x7ffa5c1547d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ffa50009790 tx=0x7ffa50009060).stop 2023-07-27T14:29:26.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.083+0000 7ffa60bff700 1 -- 172.21.15.115:0/1475323778 shutdown_connections 2023-07-27T14:29:26.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.083+0000 7ffa60bff700 1 --2- 172.21.15.115:0/1475323778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c069c60 0x7ffa5c1547d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:26.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.083+0000 7ffa60bff700 1 -- 172.21.15.115:0/1475323778 >> 172.21.15.115:0/1475323778 conn(0x7ffa5c0c79a0 msgr2=0x7ffa5c0c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:26.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.083+0000 7ffa60bff700 1 -- 172.21.15.115:0/1475323778 shutdown_connections 2023-07-27T14:29:26.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.083+0000 7ffa60bff700 1 -- 172.21.15.115:0/1475323778 wait complete. 2023-07-27T14:29:26.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.084+0000 7ffa60bff700 1 Processor -- start 2023-07-27T14:29:26.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.084+0000 7ffa60bff700 1 -- start start 2023-07-27T14:29:26.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.085+0000 7ffa60bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5c062a30 0x7ffa5c150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:26.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.085+0000 7ffa60bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa5c069c60 0x7ffa5c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:26.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.085+0000 7ffa60bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0c7250 0x7ffa5c0a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:26.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.085+0000 7ffa60bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0a61f0 con 0x7ffa5c062a30 2023-07-27T14:29:26.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.085+0000 7ffa60bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c165cb0 con 0x7ffa5c069c60 2023-07-27T14:29:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.085+0000 7ffa60bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c165980 con 0x7ffa5c0c7250 2023-07-27T14:29:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5c062a30 0x7ffa5c150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5c062a30 0x7ffa5c150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51416/0 (socket says 172.21.15.115:51416) 2023-07-27T14:29:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 -- 172.21.15.115:0/2279834044 learned_addr learned my addr 172.21.15.115:0/2279834044 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa59d9b700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa5c069c60 0x7ffa5c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5ad9d700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0c7250 0x7ffa5c0a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:26.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 -- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0c7250 msgr2=0x7ffa5c0a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:26.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0c7250 0x7ffa5c0a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:26.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 -- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa5c069c60 msgr2=0x7ffa5c0a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:26.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa5c069c60 0x7ffa5c0a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:26.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 -- 172.21.15.115:0/2279834044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500092a0 con 0x7ffa5c062a30 2023-07-27T14:29:26.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5ad9d700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0c7250 0x7ffa5c0a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa5a59c700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5c062a30 0x7ffa5c150570 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7ffa4c00c440 tx=0x7ffa4c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.086+0000 7ffa4a7fc700 1 -- 172.21.15.115:0/2279834044 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00ce40 con 0x7ffa5c062a30 2023-07-27T14:29:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.087+0000 7ffa4a7fc700 1 -- 172.21.15.115:0/2279834044 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00f470 con 0x7ffa5c062a30 2023-07-27T14:29:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.087+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c0a8860 con 0x7ffa5c062a30 2023-07-27T14:29:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.087+0000 7ffa4a7fc700 1 -- 172.21.15.115:0/2279834044 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00f830 con 0x7ffa5c062a30 2023-07-27T14:29:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.087+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c0a8e20 con 0x7ffa5c062a30 2023-07-27T14:29:26.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.088+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c165f90 con 0x7ffa5c062a30 2023-07-27T14:29:26.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.088+0000 7ffa4a7fc700 1 -- 172.21.15.115:0/2279834044 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 75442+0+0 (secure 0 0 0) 0x7ffa4c019030 con 0x7ffa5c062a30 2023-07-27T14:29:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.089+0000 7ffa4a7fc700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa3c05eef0 0x7ffa3c0613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.089+0000 7ffa4a7fc700 1 -- 172.21.15.115:0/2279834044 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffa4c079070 con 0x7ffa5c062a30 2023-07-27T14:29:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.089+0000 7ffa59d9b700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa3c05eef0 0x7ffa3c0613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.090+0000 7ffa59d9b700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa3c05eef0 0x7ffa3c0613b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7ffa50009fd0 tx=0x7ffa50017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.093+0000 7ffa4a7fc700 1 -- 172.21.15.115:0/2279834044 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa4c04a4b0 con 0x7ffa5c062a30 2023-07-27T14:29:26.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.294+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000242766", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa5c155760 con 0x7ffa3c05eef0 2023-07-27T14:29:26.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.299+0000 7ffa4a7fc700 1 -- 172.21.15.115:0/2279834044 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7ffa5c155760 con 0x7ffa3c05eef0 2023-07-27T14:29:26.323 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d 2023-07-27T14:29:26.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.300+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa3c05eef0 msgr2=0x7ffa3c0613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:26.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.300+0000 7ffa60bff700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa3c05eef0 0x7ffa3c0613b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7ffa50009fd0 tx=0x7ffa50017000).stop 2023-07-27T14:29:26.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.300+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5c062a30 msgr2=0x7ffa5c150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:26.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.300+0000 7ffa60bff700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5c062a30 0x7ffa5c150570 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7ffa4c00c440 tx=0x7ffa4c007c80).stop 2023-07-27T14:29:26.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.301+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 shutdown_connections 2023-07-27T14:29:26.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.301+0000 7ffa60bff700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffa3c05eef0 0x7ffa3c0613b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:26.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.301+0000 7ffa60bff700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffa5c0c7250 0x7ffa5c0a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:26.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.301+0000 7ffa60bff700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa5c062a30 0x7ffa5c150570 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:26.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.301+0000 7ffa60bff700 1 --2- 172.21.15.115:0/2279834044 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa5c069c60 0x7ffa5c0a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:26.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.301+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 >> 172.21.15.115:0/2279834044 conn(0x7ffa5c0c79a0 msgr2=0x7ffa5c0c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:26.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.301+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 shutdown_connections 2023-07-27T14:29:26.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:26.301+0000 7ffa60bff700 1 -- 172.21.15.115:0/2279834044 wait complete. 2023-07-27T14:29:26.343 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000242766 with 200 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d 2023-07-27T14:29:26.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.344 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.416 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.417 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.417 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172783 s, 60.7 MB/s 2023-07-27T14:29:26.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.419 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.486 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.487 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194223 s, 54.0 MB/s 2023-07-27T14:29:26.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.488 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141832 s, 73.9 MB/s 2023-07-27T14:29:26.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.553 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.615 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.616 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.616 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016769 s, 62.5 MB/s 2023-07-27T14:29:26.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.617 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.680 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.681 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.681 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173954 s, 60.3 MB/s 2023-07-27T14:29:26.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.682 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.746 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.746 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.746 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173119 s, 60.6 MB/s 2023-07-27T14:29:26.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.748 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.810 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.810 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.810 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153356 s, 68.4 MB/s 2023-07-27T14:29:26.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.811 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.872 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.873 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.873 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143597 s, 73.0 MB/s 2023-07-27T14:29:26.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.874 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157256 s, 66.7 MB/s 2023-07-27T14:29:26.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:26.938 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.002 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.003 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.003 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175544 s, 59.7 MB/s 2023-07-27T14:29:27.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.005 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.066 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.067 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.067 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142426 s, 73.6 MB/s 2023-07-27T14:29:27.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.068 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.128 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.128 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.128 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130584 s, 80.3 MB/s 2023-07-27T14:29:27.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.129 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.189 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.190 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.190 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141816 s, 73.9 MB/s 2023-07-27T14:29:27.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.191 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.252 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.253 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.253 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014253 s, 73.6 MB/s 2023-07-27T14:29:27.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.254 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.319 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.319 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.319 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183616 s, 57.1 MB/s 2023-07-27T14:29:27.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.320 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.380 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.380 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.381 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133532 s, 78.5 MB/s 2023-07-27T14:29:27.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.382 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.446 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.446 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.446 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175333 s, 59.8 MB/s 2023-07-27T14:29:27.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.448 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.510 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.510 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144197 s, 72.7 MB/s 2023-07-27T14:29:27.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.511 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.572 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149477 s, 70.1 MB/s 2023-07-27T14:29:27.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.574 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.636 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.636 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.636 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158129 s, 66.3 MB/s 2023-07-27T14:29:27.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.638 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.702 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.703 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.703 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186549 s, 56.2 MB/s 2023-07-27T14:29:27.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.704 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.763 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.763 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.764 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126378 s, 83.0 MB/s 2023-07-27T14:29:27.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.765 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.827 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.828 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.828 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160796 s, 65.2 MB/s 2023-07-27T14:29:27.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.829 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.888 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.889 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.889 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129322 s, 81.1 MB/s 2023-07-27T14:29:27.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.890 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159655 s, 65.7 MB/s 2023-07-27T14:29:27.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:27.955 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.018 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.019 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.019 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176942 s, 59.3 MB/s 2023-07-27T14:29:28.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.021 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.087 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.087 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.088 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018618 s, 56.3 MB/s 2023-07-27T14:29:28.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.090 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134226 s, 78.1 MB/s 2023-07-27T14:29:28.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.152 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.213 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.214 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.214 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136304 s, 76.9 MB/s 2023-07-27T14:29:28.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.216 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.278 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.279 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.279 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157004 s, 66.8 MB/s 2023-07-27T14:29:28.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.281 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.342 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.342 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.343 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013566 s, 77.3 MB/s 2023-07-27T14:29:28.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.343 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.407 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.407 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.407 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171734 s, 61.1 MB/s 2023-07-27T14:29:28.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.409 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.471 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.471 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.472 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014736 s, 71.2 MB/s 2023-07-27T14:29:28.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.473 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.534 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.534 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.534 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141291 s, 74.2 MB/s 2023-07-27T14:29:28.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.536 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.597 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013406 s, 78.2 MB/s 2023-07-27T14:29:28.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.598 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.661 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.661 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.661 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152903 s, 68.6 MB/s 2023-07-27T14:29:28.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.663 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.728 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.729 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.729 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184691 s, 56.8 MB/s 2023-07-27T14:29:28.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.730 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.795 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.795 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.795 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186699 s, 56.2 MB/s 2023-07-27T14:29:28.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.796 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:29:28.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:29:28.859 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.859 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.859 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161138 s, 65.1 MB/s 2023-07-27T14:29:28.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.860 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:28.962 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:28.962 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:28.963 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150559 s, 69.6 MB/s 2023-07-27T14:29:28.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:28.965 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.065 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.065 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.065 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140082 s, 74.9 MB/s 2023-07-27T14:29:29.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.066 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.130 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.130 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.131 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017904 s, 58.6 MB/s 2023-07-27T14:29:29.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.132 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.193 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.193 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.193 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140003 s, 74.9 MB/s 2023-07-27T14:29:29.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.194 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.254 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.255 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.255 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133311 s, 78.7 MB/s 2023-07-27T14:29:29.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.256 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.320 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.320 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.320 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180511 s, 58.1 MB/s 2023-07-27T14:29:29.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.322 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.382 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.382 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.382 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136161 s, 77.0 MB/s 2023-07-27T14:29:29.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.384 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.445 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.445 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.445 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144165 s, 72.7 MB/s 2023-07-27T14:29:29.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.447 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.506 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.506 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.506 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130086 s, 80.6 MB/s 2023-07-27T14:29:29.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.508 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.570 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.570 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.570 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015866 s, 66.1 MB/s 2023-07-27T14:29:29.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.571 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.632 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.632 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.632 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145687 s, 72.0 MB/s 2023-07-27T14:29:29.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.634 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.696 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.697 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.697 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167454 s, 62.6 MB/s 2023-07-27T14:29:29.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.698 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.758 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.758 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.758 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132649 s, 79.0 MB/s 2023-07-27T14:29:29.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.760 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.820 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.820 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.820 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135403 s, 77.4 MB/s 2023-07-27T14:29:29.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.821 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.882 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.882 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.882 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014215 s, 73.8 MB/s 2023-07-27T14:29:29.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.884 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:29.946 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:29.947 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:29.947 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157361 s, 66.6 MB/s 2023-07-27T14:29:29.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:29.950 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.012 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.012 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.012 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124259 s, 84.4 MB/s 2023-07-27T14:29:30.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.014 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.076 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.077 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.077 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158698 s, 66.1 MB/s 2023-07-27T14:29:30.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.078 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.141 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.141 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.142 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167718 s, 62.5 MB/s 2023-07-27T14:29:30.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.143 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.208 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.208 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.209 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188649 s, 55.6 MB/s 2023-07-27T14:29:30.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.210 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.270 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.270 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.270 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135294 s, 77.5 MB/s 2023-07-27T14:29:30.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.271 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.333 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.334 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.334 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154359 s, 67.9 MB/s 2023-07-27T14:29:30.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.335 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165155 s, 63.5 MB/s 2023-07-27T14:29:30.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.400 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.464 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.464 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.465 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174442 s, 60.1 MB/s 2023-07-27T14:29:30.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.466 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.526 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.527 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.527 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140585 s, 74.6 MB/s 2023-07-27T14:29:30.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.528 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.590 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.590 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.590 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145223 s, 72.2 MB/s 2023-07-27T14:29:30.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.592 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.653 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.654 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.654 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133845 s, 78.3 MB/s 2023-07-27T14:29:30.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.656 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146447 s, 71.6 MB/s 2023-07-27T14:29:30.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.720 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.784 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.784 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.784 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144006 s, 72.8 MB/s 2023-07-27T14:29:30.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.785 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151819 s, 69.1 MB/s 2023-07-27T14:29:30.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.849 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.914 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.914 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.914 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183751 s, 57.1 MB/s 2023-07-27T14:29:30.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.916 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:30.977 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:30.977 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:30.977 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131144 s, 80.0 MB/s 2023-07-27T14:29:30.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:30.979 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.039 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.039 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.040 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135879 s, 77.2 MB/s 2023-07-27T14:29:31.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.042 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.104 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.104 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.104 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147624 s, 71.0 MB/s 2023-07-27T14:29:31.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.106 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.167 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.167 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.167 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150276 s, 69.8 MB/s 2023-07-27T14:29:31.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.169 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.230 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.231 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.231 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138747 s, 75.6 MB/s 2023-07-27T14:29:31.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.232 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.295 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.295 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.295 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016466 s, 63.7 MB/s 2023-07-27T14:29:31.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.297 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.357 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.357 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.357 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136121 s, 77.0 MB/s 2023-07-27T14:29:31.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.359 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.420 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.420 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.420 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141068 s, 74.3 MB/s 2023-07-27T14:29:31.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.421 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.481 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.481 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.481 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128027 s, 81.9 MB/s 2023-07-27T14:29:31.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.483 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.545 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.545 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.545 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154717 s, 67.8 MB/s 2023-07-27T14:29:31.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.547 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.605 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.606 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.606 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123471 s, 84.9 MB/s 2023-07-27T14:29:31.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.607 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.667 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.667 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.667 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123731 s, 84.7 MB/s 2023-07-27T14:29:31.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.668 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147368 s, 71.2 MB/s 2023-07-27T14:29:31.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.731 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.792 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.792 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.792 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145281 s, 72.2 MB/s 2023-07-27T14:29:31.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.794 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.856 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.856 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.856 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154943 s, 67.7 MB/s 2023-07-27T14:29:31.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.858 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.917 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.918 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.918 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132735 s, 79.0 MB/s 2023-07-27T14:29:31.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.919 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:31.983 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:31.984 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:31.984 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177781 s, 59.0 MB/s 2023-07-27T14:29:31.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:31.986 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.046 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.046 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.047 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140465 s, 74.7 MB/s 2023-07-27T14:29:32.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.048 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.109 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.110 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.110 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147782 s, 71.0 MB/s 2023-07-27T14:29:32.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.112 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.174 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.174 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.174 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146256 s, 71.7 MB/s 2023-07-27T14:29:32.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.176 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174276 s, 60.2 MB/s 2023-07-27T14:29:32.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.242 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.302 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.303 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.303 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131559 s, 79.7 MB/s 2023-07-27T14:29:32.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.304 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.365 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.365 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.365 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014544 s, 72.1 MB/s 2023-07-27T14:29:32.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.367 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.427 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.428 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.428 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130637 s, 80.3 MB/s 2023-07-27T14:29:32.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.429 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.493 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.493 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.493 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171855 s, 61.0 MB/s 2023-07-27T14:29:32.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.495 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.554 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.554 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.555 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130595 s, 80.3 MB/s 2023-07-27T14:29:32.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.556 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.618 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.619 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.619 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159671 s, 65.7 MB/s 2023-07-27T14:29:32.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.620 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131396 s, 79.8 MB/s 2023-07-27T14:29:32.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.682 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022989 s, 45.6 MB/s 2023-07-27T14:29:32.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.753 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.815 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149617 s, 70.1 MB/s 2023-07-27T14:29:32.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.816 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.878 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.879 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.879 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151466 s, 69.2 MB/s 2023-07-27T14:29:32.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.881 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01395 s, 75.2 MB/s 2023-07-27T14:29:32.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:32.942 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.002 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135499 s, 77.4 MB/s 2023-07-27T14:29:33.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.004 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.064 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.064 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.065 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137713 s, 76.1 MB/s 2023-07-27T14:29:33.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.066 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.131 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.131 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.131 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016956 s, 61.8 MB/s 2023-07-27T14:29:33.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.132 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.198 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.198 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185978 s, 56.4 MB/s 2023-07-27T14:29:33.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.199 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.259 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141544 s, 74.1 MB/s 2023-07-27T14:29:33.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.261 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.322 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.322 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.322 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148776 s, 70.5 MB/s 2023-07-27T14:29:33.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.324 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.385 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.385 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.386 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153282 s, 68.4 MB/s 2023-07-27T14:29:33.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.387 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.476 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.476 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175923 s, 59.6 MB/s 2023-07-27T14:29:33.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.478 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.538 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.538 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.538 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134873 s, 77.7 MB/s 2023-07-27T14:29:33.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.540 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.601 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.601 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.601 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147586 s, 71.0 MB/s 2023-07-27T14:29:33.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.603 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.665 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.666 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.666 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156981 s, 66.8 MB/s 2023-07-27T14:29:33.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.668 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.728 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.728 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128863 s, 81.4 MB/s 2023-07-27T14:29:33.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.729 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.790 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.791 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.791 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014556 s, 72.0 MB/s 2023-07-27T14:29:33.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.792 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175501 s, 59.7 MB/s 2023-07-27T14:29:33.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.859 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.921 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.921 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.921 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144475 s, 72.6 MB/s 2023-07-27T14:29:33.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.923 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:33.982 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:33.982 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:33.983 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133338 s, 78.6 MB/s 2023-07-27T14:29:33.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:33.984 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.045 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.045 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.045 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145676 s, 72.0 MB/s 2023-07-27T14:29:34.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.047 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.110 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.110 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.110 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162195 s, 64.6 MB/s 2023-07-27T14:29:34.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.112 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.174 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.175 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.175 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015102 s, 69.4 MB/s 2023-07-27T14:29:34.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.176 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.237 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.238 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.238 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134552 s, 77.9 MB/s 2023-07-27T14:29:34.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.240 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.302 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.302 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.302 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144728 s, 72.5 MB/s 2023-07-27T14:29:34.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.304 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.369 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.369 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179046 s, 58.6 MB/s 2023-07-27T14:29:34.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.370 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.434 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.434 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.434 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168565 s, 62.2 MB/s 2023-07-27T14:29:34.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.436 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.496 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.496 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.496 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135002 s, 77.7 MB/s 2023-07-27T14:29:34.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.498 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.563 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.563 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.564 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191784 s, 54.7 MB/s 2023-07-27T14:29:34.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.565 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.626 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.626 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.626 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144799 s, 72.4 MB/s 2023-07-27T14:29:34.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.628 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.689 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.690 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.690 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142812 s, 73.4 MB/s 2023-07-27T14:29:34.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.691 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.752 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.752 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.753 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014256 s, 73.6 MB/s 2023-07-27T14:29:34.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.754 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.816 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.816 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.817 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154794 s, 67.7 MB/s 2023-07-27T14:29:34.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.818 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.879 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.880 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.880 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151926 s, 69.0 MB/s 2023-07-27T14:29:34.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.881 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131761 s, 79.6 MB/s 2023-07-27T14:29:34.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:34.942 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.008 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.008 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.008 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146848 s, 71.4 MB/s 2023-07-27T14:29:35.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.010 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016749 s, 62.6 MB/s 2023-07-27T14:29:35.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.075 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.136 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.137 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.137 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015071 s, 69.6 MB/s 2023-07-27T14:29:35.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.138 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.199 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.199 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.199 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01425 s, 73.6 MB/s 2023-07-27T14:29:35.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.201 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.261 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.262 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144501 s, 72.6 MB/s 2023-07-27T14:29:35.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.263 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.325 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.326 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.326 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165965 s, 63.2 MB/s 2023-07-27T14:29:35.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.327 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.386 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.386 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.387 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126958 s, 82.6 MB/s 2023-07-27T14:29:35.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.388 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.453 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187142 s, 56.0 MB/s 2023-07-27T14:29:35.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.456 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.521 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.521 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.522 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182538 s, 57.4 MB/s 2023-07-27T14:29:35.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.523 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.583 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.584 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.584 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135768 s, 77.2 MB/s 2023-07-27T14:29:35.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.585 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.646 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.646 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.646 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147562 s, 71.1 MB/s 2023-07-27T14:29:35.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.648 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.708 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.708 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.709 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146941 s, 71.4 MB/s 2023-07-27T14:29:35.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.710 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137372 s, 76.3 MB/s 2023-07-27T14:29:35.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.772 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.833 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.834 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.834 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152027 s, 69.0 MB/s 2023-07-27T14:29:35.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.835 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.894 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.895 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.895 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132428 s, 79.2 MB/s 2023-07-27T14:29:35.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.896 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149657 s, 70.1 MB/s 2023-07-27T14:29:35.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:35.960 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.021 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.021 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.021 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144994 s, 72.3 MB/s 2023-07-27T14:29:36.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.022 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.082 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.083 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.083 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130948 s, 80.1 MB/s 2023-07-27T14:29:36.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.085 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.146 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.146 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.146 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149313 s, 70.2 MB/s 2023-07-27T14:29:36.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.148 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.209 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.209 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.209 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153222 s, 68.4 MB/s 2023-07-27T14:29:36.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.211 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.271 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.271 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.271 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137453 s, 76.3 MB/s 2023-07-27T14:29:36.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.273 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.333 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.333 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.333 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137909 s, 76.0 MB/s 2023-07-27T14:29:36.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.335 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.395 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.395 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.395 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142218 s, 73.7 MB/s 2023-07-27T14:29:36.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.397 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.461 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.462 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.462 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187055 s, 56.1 MB/s 2023-07-27T14:29:36.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.463 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.523 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.523 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.523 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01329 s, 78.9 MB/s 2023-07-27T14:29:36.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.525 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.587 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.587 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.587 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160274 s, 65.4 MB/s 2023-07-27T14:29:36.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.588 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.651 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.652 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.652 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163268 s, 64.2 MB/s 2023-07-27T14:29:36.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.654 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.717 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.718 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.718 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018358 s, 57.1 MB/s 2023-07-27T14:29:36.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.719 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.778 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.778 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123888 s, 84.6 MB/s 2023-07-27T14:29:36.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.779 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.840 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.840 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.840 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138586 s, 75.7 MB/s 2023-07-27T14:29:36.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.842 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.906 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.907 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.907 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179203 s, 58.5 MB/s 2023-07-27T14:29:36.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.908 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:36.970 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:36.970 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:36.970 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149373 s, 70.2 MB/s 2023-07-27T14:29:36.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:36.972 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.033 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014694 s, 71.4 MB/s 2023-07-27T14:29:37.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.035 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.096 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.096 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.096 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152511 s, 68.8 MB/s 2023-07-27T14:29:37.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.097 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.159 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.159 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.159 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153713 s, 68.2 MB/s 2023-07-27T14:29:37.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.160 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.224 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.224 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176844 s, 59.3 MB/s 2023-07-27T14:29:37.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.226 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.285 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.285 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.286 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129664 s, 80.9 MB/s 2023-07-27T14:29:37.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.288 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.351 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.351 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150256 s, 69.8 MB/s 2023-07-27T14:29:37.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.352 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.413 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.413 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.413 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138359 s, 75.8 MB/s 2023-07-27T14:29:37.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.415 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.476 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.477 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.477 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159809 s, 65.6 MB/s 2023-07-27T14:29:37.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.478 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.540 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.541 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161666 s, 64.9 MB/s 2023-07-27T14:29:37.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.542 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.602 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.603 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.603 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013849 s, 75.7 MB/s 2023-07-27T14:29:37.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.604 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.668 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180089 s, 58.2 MB/s 2023-07-27T14:29:37.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.670 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.731 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.731 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.731 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148326 s, 70.7 MB/s 2023-07-27T14:29:37.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.733 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.798 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.798 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.798 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185701 s, 56.5 MB/s 2023-07-27T14:29:37.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.800 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.859 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.860 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.860 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132161 s, 79.3 MB/s 2023-07-27T14:29:37.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.861 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.923 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.923 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.923 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156998 s, 66.8 MB/s 2023-07-27T14:29:37.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.925 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:37.987 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:37.987 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:37.987 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155203 s, 67.6 MB/s 2023-07-27T14:29:37.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:37.988 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.049 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.049 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.050 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141758 s, 74.0 MB/s 2023-07-27T14:29:38.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.051 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.112 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.113 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.113 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015127 s, 69.3 MB/s 2023-07-27T14:29:38.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.114 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.174 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.175 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.175 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141654 s, 74.0 MB/s 2023-07-27T14:29:38.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.176 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.240 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.240 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.240 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176823 s, 59.3 MB/s 2023-07-27T14:29:38.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.242 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.305 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.306 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.306 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173473 s, 60.4 MB/s 2023-07-27T14:29:38.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.308 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.370 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161154 s, 65.1 MB/s 2023-07-27T14:29:38.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.372 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.437 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.438 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.438 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181208 s, 57.9 MB/s 2023-07-27T14:29:38.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.439 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.501 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.502 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.502 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155139 s, 67.6 MB/s 2023-07-27T14:29:38.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.503 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.562 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.563 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.563 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128291 s, 81.7 MB/s 2023-07-27T14:29:38.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.564 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.628 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.629 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.629 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175103 s, 59.9 MB/s 2023-07-27T14:29:38.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.631 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.691 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.692 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.692 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137034 s, 76.5 MB/s 2023-07-27T14:29:38.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.694 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.758 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.758 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.758 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166291 s, 63.1 MB/s 2023-07-27T14:29:38.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.759 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.819 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013332 s, 78.7 MB/s 2023-07-27T14:29:38.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.821 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.886 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.886 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.886 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184198 s, 56.9 MB/s 2023-07-27T14:29:38.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.888 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:38.948 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:38.948 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:38.948 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013273 s, 79.0 MB/s 2023-07-27T14:29:38.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:38.949 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:39.013 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:39.013 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:39.013 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170428 s, 61.5 MB/s 2023-07-27T14:29:39.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:39.015 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:39.076 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:39.076 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:39.076 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148172 s, 70.8 MB/s 2023-07-27T14:29:39.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:39.078 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:39.142 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:39.142 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:39.142 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177136 s, 59.2 MB/s 2023-07-27T14:29:39.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:39.143 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000242766/8d63343d-b71c-42e8-b8ff-b030862f0a1d/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:29:39.206 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:29:39.207 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:29:39.207 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168944 s, 62.1 MB/s 2023-07-27T14:29:39.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000242766 snapshot_0000000000417357 2023-07-27T14:29:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.373+0000 7fdc8efff700 1 Processor -- start 2023-07-27T14:29:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.374+0000 7fdc8efff700 1 -- start start 2023-07-27T14:29:39.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.375+0000 7fdc8efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc8814ae00 0x7fdc88154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.375+0000 7fdc8efff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc881553f0 con 0x7fdc8814b1e0 2023-07-27T14:29:39.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.375+0000 7fdc8efff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc88157a50 con 0x7fdc88063260 2023-07-27T14:29:39.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.375+0000 7fdc8efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc88157d10 con 0x7fdc8814ae00 2023-07-27T14:29:39.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.375+0000 7fdc87fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdc8814b1e0 0x7fdc88062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56758/0 (socket says 172.21.15.115:56758) 2023-07-27T14:29:39.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.375+0000 7fdc87fff700 1 -- 172.21.15.115:0/2868253048 learned_addr learned my addr 172.21.15.115:0/2868253048 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:39.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.375+0000 7fdc8cd9b700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc8814ae00 0x7fdc88154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.375+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992046980 0 0) 0x7fdc881553f0 con 0x7fdc8814b1e0 2023-07-27T14:29:39.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc780033f0 con 0x7fdc8814b1e0 2023-07-27T14:29:39.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2605312688 0 0) 0x7fdc780033f0 con 0x7fdc8814b1e0 2023-07-27T14:29:39.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc8814ae00 msgr2=0x7fdc88154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:39.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc8814ae00 0x7fdc88154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 >> v1:172.21.15.159:6789/0 conn(0x7fdc88063260 legacy=0x7fdc880a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88157ff0 con 0x7fdc8814b1e0 2023-07-27T14:29:39.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fdc74001470 con 0x7fdc8814b1e0 2023-07-27T14:29:39.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 >> v1:172.21.15.115:6789/0 conn(0x7fdc8814b1e0 legacy=0x7fdc88062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc8814ae00 0x7fdc78003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc78003e40 0x7fdc78004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc78005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc88157d10 con 0x7fdc78004b80 2023-07-27T14:29:39.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7800b990 con 0x7fdc78003e40 2023-07-27T14:29:39.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7800bb50 con 0x7fdc8814ae00 2023-07-27T14:29:39.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc8d59c700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc78005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc8cd9b700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc8814ae00 0x7fdc78003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.376+0000 7fdc87fff700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc78003e40 0x7fdc78004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc8d59c700 1 -- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc8814ae00 msgr2=0x7fdc78003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:39.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc8d59c700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc8814ae00 0x7fdc78003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc8d59c700 1 -- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc78003e40 msgr2=0x7fdc78004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:39.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc8d59c700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc78003e40 0x7fdc78004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc8d59c700 1 -- 172.21.15.115:0/2868253048 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc780033f0 con 0x7fdc78004b80 2023-07-27T14:29:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc8d59c700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc78005000 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fdc80001e30 tx=0x7fdc80007f30).ready entity=mon.0 client_cookie=456ccfe2bfd64cc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80006a20 con 0x7fdc78004b80 2023-07-27T14:29:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc80006b80 con 0x7fdc78004b80 2023-07-27T14:29:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.377+0000 7fdc877fe700 1 -- 172.21.15.115:0/2868253048 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8000c5d0 con 0x7fdc78004b80 2023-07-27T14:29:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.378+0000 7fdc8efff700 1 -- 172.21.15.115:0/2868253048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 msgr2=0x7fdc78005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.378+0000 7fdc8efff700 1 --2- 172.21.15.115:0/2868253048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc78005000 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fdc80001e30 tx=0x7fdc80007f30).stop 2023-07-27T14:29:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.378+0000 7fdc8d59c700 1 -- 172.21.15.115:0/2868253048 reap_dead start 2023-07-27T14:29:39.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.378+0000 7fdc8efff700 1 -- 172.21.15.115:0/2868253048 shutdown_connections 2023-07-27T14:29:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.378+0000 7fdc8efff700 1 -- 172.21.15.115:0/2868253048 >> 172.21.15.115:0/2868253048 conn(0x7fdc8805e940 msgr2=0x7fdc880cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.378+0000 7fdc8efff700 1 -- 172.21.15.115:0/2868253048 shutdown_connections 2023-07-27T14:29:39.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.378+0000 7fdc8efff700 1 -- 172.21.15.115:0/2868253048 wait complete. 2023-07-27T14:29:39.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.379+0000 7fdc8efff700 1 Processor -- start 2023-07-27T14:29:39.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.380+0000 7fdc8efff700 1 -- start start 2023-07-27T14:29:39.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.380+0000 7fdc8efff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc880b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.380+0000 7fdc8efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc88156850 0x7fdc88156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.380+0000 7fdc8efff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc880c7650 0x7fdc880c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.380+0000 7fdc8efff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc881571c0 con 0x7fdc78004b80 2023-07-27T14:29:39.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.380+0000 7fdc8efff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc88155480 con 0x7fdc880c7650 2023-07-27T14:29:39.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.380+0000 7fdc8efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880c7fa0 con 0x7fdc88156850 2023-07-27T14:29:39.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc880b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc880b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47192/0 (socket says 172.21.15.115:47192) 2023-07-27T14:29:39.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 -- 172.21.15.115:0/827619963 learned_addr learned my addr 172.21.15.115:0/827619963 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:39.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc87fff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc88156850 0x7fdc88156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8d59c700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc880c7650 0x7fdc880c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 -- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc88156850 msgr2=0x7fdc88156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc88156850 0x7fdc88156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 -- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc880c7650 msgr2=0x7fdc880c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc880c7650 0x7fdc880c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 -- 172.21.15.115:0/827619963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc881556d0 con 0x7fdc78004b80 2023-07-27T14:29:39.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8d59c700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc880c7650 0x7fdc880c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8cd9b700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc880b0500 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fdc7c0119c0 tx=0x7fdc7c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc84ff9700 1 -- 172.21.15.115:0/827619963 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00f8e0 con 0x7fdc78004b80 2023-07-27T14:29:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc84ff9700 1 -- 172.21.15.115:0/827619963 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c00fa40 con 0x7fdc78004b80 2023-07-27T14:29:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc881559b0 con 0x7fdc78004b80 2023-07-27T14:29:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.381+0000 7fdc84ff9700 1 -- 172.21.15.115:0/827619963 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00fdc0 con 0x7fdc78004b80 2023-07-27T14:29:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.382+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc88155f70 con 0x7fdc78004b80 2023-07-27T14:29:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.383+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8806c470 con 0x7fdc78004b80 2023-07-27T14:29:39.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.383+0000 7fdc84ff9700 1 -- 172.21.15.115:0/827619963 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 75482+0+0 (secure 0 0 0) 0x7fdc7c024070 con 0x7fdc78004b80 2023-07-27T14:29:39.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.385+0000 7fdc84ff9700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdc6c05ef40 0x7fdc6c061400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.385+0000 7fdc84ff9700 1 -- 172.21.15.115:0/827619963 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdc7c07a930 con 0x7fdc78004b80 2023-07-27T14:29:39.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.385+0000 7fdc87fff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdc6c05ef40 0x7fdc6c061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.386+0000 7fdc87fff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdc6c05ef40 0x7fdc6c061400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fdc74000e10 tx=0x7fdc74009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:39.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.389+0000 7fdc84ff9700 1 -- 172.21.15.115:0/827619963 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdc7c04bc90 con 0x7fdc78004b80 2023-07-27T14:29:39.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.596+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000242766", "snap_name": "snapshot_0000000000417357", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc880ae5a0 con 0x7fdc6c05ef40 2023-07-27T14:29:39.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.643+0000 7fdc84ff9700 1 -- 172.21.15.115:0/827619963 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdc880ae5a0 con 0x7fdc6c05ef40 2023-07-27T14:29:39.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdc6c05ef40 msgr2=0x7fdc6c061400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdc6c05ef40 0x7fdc6c061400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fdc74000e10 tx=0x7fdc74009040).stop 2023-07-27T14:29:39.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 msgr2=0x7fdc880b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc880b0500 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fdc7c0119c0 tx=0x7fdc7c009060).stop 2023-07-27T14:29:39.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 shutdown_connections 2023-07-27T14:29:39.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdc6c05ef40 0x7fdc6c061400 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc880c7650 0x7fdc880c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc78004b80 0x7fdc880b0500 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 --2- 172.21.15.115:0/827619963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc88156850 0x7fdc88156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 >> 172.21.15.115:0/827619963 conn(0x7fdc8805e940 msgr2=0x7fdc88149650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:39.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 shutdown_connections 2023-07-27T14:29:39.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.647+0000 7fdc8efff700 1 -- 172.21.15.115:0/827619963 wait complete. 2023-07-27T14:29:39.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-07-27T14:29:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.862+0000 7f8b097ff700 1 Processor -- start 2023-07-27T14:29:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.862+0000 7f8b097ff700 1 -- start start 2023-07-27T14:29:39.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.863+0000 7f8b097ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b0414b1e0 0x7f8b04154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.863+0000 7f8b097ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b041553f0 con 0x7f8b04063260 2023-07-27T14:29:39.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.863+0000 7f8b097ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b04157a50 con 0x7f8b0414ae00 2023-07-27T14:29:39.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.863+0000 7f8b097ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04157d10 con 0x7f8b0414b1e0 2023-07-27T14:29:39.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.863+0000 7f8b027fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8b04063260 0x7f8b040a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56770/0 (socket says 172.21.15.115:56770) 2023-07-27T14:29:39.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.863+0000 7f8b027fc700 1 -- 172.21.15.115:0/3094073783 learned_addr learned my addr 172.21.15.115:0/3094073783 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:39.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b037fe700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b0414b1e0 0x7f8b04154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313463679 0 0) 0x7f8b041553f0 con 0x7f8b04063260 2023-07-27T14:29:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aec0033f0 con 0x7f8b04063260 2023-07-27T14:29:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161242359 0 0) 0x7f8b04157a50 con 0x7f8b0414ae00 2023-07-27T14:29:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b041553f0 con 0x7f8b0414ae00 2023-07-27T14:29:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2113815850 0 0) 0x7f8aec0033f0 con 0x7f8b04063260 2023-07-27T14:29:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b0414b1e0 msgr2=0x7f8b04154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b0414b1e0 0x7f8b04154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 >> v1:172.21.15.159:6789/0 conn(0x7f8b0414ae00 legacy=0x7f8b04062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04157ff0 con 0x7f8b04063260 2023-07-27T14:29:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f8af8001470 con 0x7f8b04063260 2023-07-27T14:29:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 >> v1:172.21.15.115:6789/0 conn(0x7f8b04063260 legacy=0x7f8b040a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b0414b1e0 0x7f8aec003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8aec003fb0 0x7f8aec004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec004b80 0x7f8aec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04157d10 con 0x7f8aec003fb0 2023-07-27T14:29:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec00b990 con 0x7f8aec004b80 2023-07-27T14:29:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.864+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec00bb50 con 0x7f8b0414b1e0 2023-07-27T14:29:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b027fc700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8aec003fb0 0x7f8aec004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b02ffd700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b0414b1e0 0x7f8aec003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b037fe700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec004b80 0x7f8aec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b027fc700 1 -- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b0414b1e0 msgr2=0x7f8aec003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b027fc700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b0414b1e0 0x7f8aec003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b027fc700 1 -- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec004b80 msgr2=0x7f8aec005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b027fc700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec004b80 0x7f8aec005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b027fc700 1 -- 172.21.15.115:0/3094073783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0033f0 con 0x7f8aec003fb0 2023-07-27T14:29:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b027fc700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8aec003fb0 0x7f8aec004690 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f8af800c0e0 tx=0x7f8b0414eb20).ready entity=mon.0 client_cookie=13472a5f7d417388 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80079b0 con 0x7f8aec003fb0 2023-07-27T14:29:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af800ca10 con 0x7f8aec003fb0 2023-07-27T14:29:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.865+0000 7f8b01ffb700 1 -- 172.21.15.115:0/3094073783 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800cdb0 con 0x7f8aec003fb0 2023-07-27T14:29:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.866+0000 7f8b097ff700 1 -- 172.21.15.115:0/3094073783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8aec003fb0 msgr2=0x7f8aec004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.866+0000 7f8b097ff700 1 --2- 172.21.15.115:0/3094073783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8aec003fb0 0x7f8aec004690 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f8af800c0e0 tx=0x7f8b0414eb20).stop 2023-07-27T14:29:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.866+0000 7f8b037fe700 1 -- 172.21.15.115:0/3094073783 reap_dead start 2023-07-27T14:29:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.866+0000 7f8b097ff700 1 -- 172.21.15.115:0/3094073783 shutdown_connections 2023-07-27T14:29:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.866+0000 7f8b097ff700 1 -- 172.21.15.115:0/3094073783 >> 172.21.15.115:0/3094073783 conn(0x7f8b0405e940 msgr2=0x7f8b040cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.866+0000 7f8b097ff700 1 -- 172.21.15.115:0/3094073783 shutdown_connections 2023-07-27T14:29:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.866+0000 7f8b097ff700 1 -- 172.21.15.115:0/3094073783 wait complete. 2023-07-27T14:29:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.867+0000 7f8b097ff700 1 Processor -- start 2023-07-27T14:29:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.868+0000 7f8b097ff700 1 -- start start 2023-07-27T14:29:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.868+0000 7f8b097ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec003fb0 0x7f8b040c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.868+0000 7f8b097ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b040af560 0x7f8b04164a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b097ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b040c3660 0x7f8b040c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b097ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040af9e0 con 0x7f8b040af560 2023-07-27T14:29:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b097ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040c2c00 con 0x7f8aec003fb0 2023-07-27T14:29:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b097ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040c3fd0 con 0x7f8b040c3660 2023-07-27T14:29:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b040af560 0x7f8b04164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b040af560 0x7f8b04164a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47212/0 (socket says 172.21.15.115:47212) 2023-07-27T14:29:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 -- 172.21.15.115:0/2979121988 learned_addr learned my addr 172.21.15.115:0/2979121988 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 -- 172.21.15.115:0/2979121988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b040c3660 msgr2=0x7f8b040c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b040c3660 0x7f8b040c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b02ffd700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec003fb0 0x7f8b040c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 -- 172.21.15.115:0/2979121988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec003fb0 msgr2=0x7f8b040c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec003fb0 0x7f8b040c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 -- 172.21.15.115:0/2979121988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04164f30 con 0x7f8b040af560 2023-07-27T14:29:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.869+0000 7f8b027fc700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b040af560 0x7f8b04164a40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8af8007610 tx=0x7f8af8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.870+0000 7f8aeaffd700 1 -- 172.21.15.115:0/2979121988 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8001580 con 0x7f8b040af560 2023-07-27T14:29:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.870+0000 7f8aeaffd700 1 -- 172.21.15.115:0/2979121988 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af80016e0 con 0x7f8b040af560 2023-07-27T14:29:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.870+0000 7f8aeaffd700 1 -- 172.21.15.115:0/2979121988 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8004900 con 0x7f8b040af560 2023-07-27T14:29:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.870+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b040c1ff0 con 0x7f8b040af560 2023-07-27T14:29:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.870+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b040c25b0 con 0x7f8b040af560 2023-07-27T14:29:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.871+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b040c2d90 con 0x7f8b040af560 2023-07-27T14:29:39.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.871+0000 7f8aeaffd700 1 -- 172.21.15.115:0/2979121988 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 75482+0+0 (secure 0 0 0) 0x7f8af8010070 con 0x7f8b040af560 2023-07-27T14:29:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.873+0000 7f8aeaffd700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8af005ef40 0x7f8af0061400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.873+0000 7f8aeaffd700 1 -- 172.21.15.115:0/2979121988 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8af801c040 con 0x7f8b040af560 2023-07-27T14:29:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.873+0000 7f8b02ffd700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8af005ef40 0x7f8af0061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:39.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.873+0000 7f8b02ffd700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8af005ef40 0x7f8af0061400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8af4007fd0 tx=0x7f8af4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:39.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:39.877+0000 7f8aeaffd700 1 -- 172.21.15.115:0/2979121988 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8af804bee0 con 0x7f8b040af560 2023-07-27T14:29:40.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.070+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f8b0406c470 con 0x7f8b040af560 2023-07-27T14:29:40.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.074+0000 7f8aeaffd700 1 -- 172.21.15.115:0/2979121988 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v7)=0 v7) v1 ==== 130+0+0 (secure 0 0 0) 0x7f8af8026070 con 0x7f8b040af560 2023-07-27T14:29:40.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8af005ef40 msgr2=0x7f8af0061400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8af005ef40 0x7f8af0061400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8af4007fd0 tx=0x7f8af4009040).stop 2023-07-27T14:29:40.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b040af560 msgr2=0x7f8b04164a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b040af560 0x7f8b04164a40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8af8007610 tx=0x7f8af8015000).stop 2023-07-27T14:29:40.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 shutdown_connections 2023-07-27T14:29:40.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8af005ef40 0x7f8af0061400 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b040c3660 0x7f8b040c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:40.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aec003fb0 0x7f8b040c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 --2- 172.21.15.115:0/2979121988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b040af560 0x7f8b04164a40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 >> 172.21.15.115:0/2979121988 conn(0x7f8b0405e940 msgr2=0x7f8b040ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:40.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 shutdown_connections 2023-07-27T14:29:40.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.076+0000 7f8b097ff700 1 -- 172.21.15.115:0/2979121988 wait complete. 2023-07-27T14:29:40.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000242766 snapshot_0000000000417357 clone_0000000000716080 2023-07-27T14:29:40.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.286+0000 7fb648fff700 1 Processor -- start 2023-07-27T14:29:40.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.286+0000 7fb648fff700 1 -- start start 2023-07-27T14:29:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb648fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb644063260 0x7fb644154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb648fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6441553f0 con 0x7fb64414ae00 2023-07-27T14:29:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb648fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb644157a50 con 0x7fb64414b1e0 2023-07-27T14:29:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb648fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb644157d10 con 0x7fb644063260 2023-07-27T14:29:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb64259c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb64414ae00 0x7fb644062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56774/0 (socket says 172.21.15.115:56774) 2023-07-27T14:29:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb64259c700 1 -- 172.21.15.115:0/3006579223 learned_addr learned my addr 172.21.15.115:0/3006579223 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb641d9b700 1 --2- 172.21.15.115:0/3006579223 >> v2:172.21.15.159:3300/0 conn(0x7fb644063260 0x7fb644154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858081482 0 0) 0x7fb6441553f0 con 0x7fb64414ae00 2023-07-27T14:29:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.288+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb62c0033f0 con 0x7fb64414ae00 2023-07-27T14:29:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515128457 0 0) 0x7fb644157a50 con 0x7fb64414b1e0 2023-07-27T14:29:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6441553f0 con 0x7fb64414b1e0 2023-07-27T14:29:40.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779759591 0 0) 0x7fb62c0033f0 con 0x7fb64414ae00 2023-07-27T14:29:40.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 >> v2:172.21.15.159:3300/0 conn(0x7fb644063260 msgr2=0x7fb644154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:40.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 --2- 172.21.15.115:0/3006579223 >> v2:172.21.15.159:3300/0 conn(0x7fb644063260 0x7fb644154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 >> v1:172.21.15.159:6789/0 conn(0x7fb64414b1e0 legacy=0x7fb6440a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644157ff0 con 0x7fb64414ae00 2023-07-27T14:29:40.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb634001470 con 0x7fb64414ae00 2023-07-27T14:29:40.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 >> v1:172.21.15.115:6789/0 conn(0x7fb64414ae00 legacy=0x7fb644062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb62c003ac0 0x7fb62c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb62c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c005000 0x7fb62c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644157d10 con 0x7fb62c004690 2023-07-27T14:29:40.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00bf60 con 0x7fb62c005000 2023-07-27T14:29:40.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00c120 con 0x7fb62c003ac0 2023-07-27T14:29:40.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb641d9b700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb62c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb64259c700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb62c003ac0 0x7fb62c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb642d9d700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c005000 0x7fb62c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb641d9b700 1 -- 172.21.15.115:0/3006579223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb62c003ac0 msgr2=0x7fb62c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:40.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb641d9b700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb62c003ac0 0x7fb62c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb641d9b700 1 -- 172.21.15.115:0/3006579223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c005000 msgr2=0x7fb62c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:40.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb641d9b700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c005000 0x7fb62c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb642d9d700 1 -- 172.21.15.115:0/3006579223 reap_dead start 2023-07-27T14:29:40.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.289+0000 7fb641d9b700 1 -- 172.21.15.115:0/3006579223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0033f0 con 0x7fb62c004690 2023-07-27T14:29:40.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb641d9b700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb62c004b10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fb644063660 tx=0x7fb638009060).ready entity=mon.0 client_cookie=96b4c303100d4dff server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:40.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638009e90 con 0x7fb62c004690 2023-07-27T14:29:40.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638009430 con 0x7fb62c004690 2023-07-27T14:29:40.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb64159a700 1 -- 172.21.15.115:0/3006579223 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800e850 con 0x7fb62c004690 2023-07-27T14:29:40.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb648fff700 1 -- 172.21.15.115:0/3006579223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 msgr2=0x7fb62c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb648fff700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb62c004b10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fb644063660 tx=0x7fb638009060).stop 2023-07-27T14:29:40.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb648fff700 1 -- 172.21.15.115:0/3006579223 shutdown_connections 2023-07-27T14:29:40.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb648fff700 1 --2- 172.21.15.115:0/3006579223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb62c004b10 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb648fff700 1 -- 172.21.15.115:0/3006579223 >> 172.21.15.115:0/3006579223 conn(0x7fb64405e940 msgr2=0x7fb6440cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:40.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb648fff700 1 -- 172.21.15.115:0/3006579223 shutdown_connections 2023-07-27T14:29:40.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.290+0000 7fb648fff700 1 -- 172.21.15.115:0/3006579223 wait complete. 2023-07-27T14:29:40.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.292+0000 7fb648fff700 1 Processor -- start 2023-07-27T14:29:40.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.292+0000 7fb648fff700 1 -- start start 2023-07-27T14:29:40.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb648fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb6440b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb648fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440b0890 0x7fb644155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb648fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb644155a70 0x7fb64414d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb648fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440af0a0 con 0x7fb62c004690 2023-07-27T14:29:40.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb648fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440af340 con 0x7fb644155a70 2023-07-27T14:29:40.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb648fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440af5e0 con 0x7fb6440b0890 2023-07-27T14:29:40.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb64259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb6440b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb64259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb6440b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47232/0 (socket says 172.21.15.115:47232) 2023-07-27T14:29:40.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb64259c700 1 -- 172.21.15.115:0/2551530795 learned_addr learned my addr 172.21.15.115:0/2551530795 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:40.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb642d9d700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb644155a70 0x7fb64414d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.293+0000 7fb641d9b700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440b0890 0x7fb644155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb64259c700 1 -- 172.21.15.115:0/2551530795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440b0890 msgr2=0x7fb644155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb64259c700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440b0890 0x7fb644155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb64259c700 1 -- 172.21.15.115:0/2551530795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb644155a70 msgr2=0x7fb64414d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb64259c700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb644155a70 0x7fb64414d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb64259c700 1 -- 172.21.15.115:0/2551530795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440af8c0 con 0x7fb62c004690 2023-07-27T14:29:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb64259c700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb6440b03a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fb63400e600 tx=0x7fb634000f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb6327fc700 1 -- 172.21.15.115:0/2551530795 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634010450 con 0x7fb62c004690 2023-07-27T14:29:40.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb6327fc700 1 -- 172.21.15.115:0/2551530795 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6340105b0 con 0x7fb62c004690 2023-07-27T14:29:40.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6440afba0 con 0x7fb62c004690 2023-07-27T14:29:40.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb6327fc700 1 -- 172.21.15.115:0/2551530795 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634010930 con 0x7fb62c004690 2023-07-27T14:29:40.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.294+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644155ed0 con 0x7fb62c004690 2023-07-27T14:29:40.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.295+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6440b00c0 con 0x7fb62c004690 2023-07-27T14:29:40.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.296+0000 7fb6327fc700 1 -- 172.21.15.115:0/2551530795 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 75482+0+0 (secure 0 0 0) 0x7fb63401a020 con 0x7fb62c004690 2023-07-27T14:29:40.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.297+0000 7fb6327fc700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb62405ef40 0x7fb624061400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.297+0000 7fb6327fc700 1 -- 172.21.15.115:0/2551530795 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb634079790 con 0x7fb62c004690 2023-07-27T14:29:40.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.297+0000 7fb641d9b700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb62405ef40 0x7fb624061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.297+0000 7fb641d9b700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb62405ef40 0x7fb624061400 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb6441576e0 tx=0x7fb63801a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:40.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.301+0000 7fb6327fc700 1 -- 172.21.15.115:0/2551530795 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb6440b00c0 con 0x7fb62c004690 2023-07-27T14:29:40.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.507+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000242766", "snap_name": "snapshot_0000000000417357", "target_sub_name": "clone_0000000000716080", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6440b00c0 con 0x7fb62405ef40 2023-07-27T14:29:40.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.565+0000 7fb6327fc700 1 -- 172.21.15.115:0/2551530795 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb6440b00c0 con 0x7fb62405ef40 2023-07-27T14:29:40.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb62405ef40 msgr2=0x7fb624061400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb62405ef40 0x7fb624061400 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb6441576e0 tx=0x7fb63801a000).stop 2023-07-27T14:29:40.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 msgr2=0x7fb6440b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb6440b03a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fb63400e600 tx=0x7fb634000f60).stop 2023-07-27T14:29:40.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 shutdown_connections 2023-07-27T14:29:40.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb62405ef40 0x7fb624061400 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb644155a70 0x7fb64414d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb62c004690 0x7fb6440b03a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 --2- 172.21.15.115:0/2551530795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440b0890 0x7fb644155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 >> 172.21.15.115:0/2551530795 conn(0x7fb64405e940 msgr2=0x7fb64414a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:40.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 shutdown_connections 2023-07-27T14:29:40.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.568+0000 7fb648fff700 1 -- 172.21.15.115:0/2551530795 wait complete. 2023-07-27T14:29:40.598 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.572+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.598 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.572+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.598 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.572+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.598 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.572+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.599 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.572+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.615 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000716080 2023-07-27T14:29:40.616 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.591+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.617 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.591+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.617 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.591+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.617 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.591+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.617 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:40.591+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:40.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.785+0000 7f0b2a3ff700 1 Processor -- start 2023-07-27T14:29:40.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.785+0000 7f0b2a3ff700 1 -- start start 2023-07-27T14:29:40.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2a3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0b2414ae00 0x7f0b24154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2a3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b24063260 0x7f0b240a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2a3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b241553f0 con 0x7f0b2414b1e0 2023-07-27T14:29:40.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2a3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b24157a50 con 0x7f0b24063260 2023-07-27T14:29:40.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2a3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b24157d10 con 0x7f0b2414ae00 2023-07-27T14:29:40.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2899c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b24063260 0x7f0b240a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2899c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b24063260 0x7f0b240a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47276/0 (socket says 172.21.15.115:47276) 2023-07-27T14:29:40.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2899c700 1 -- 172.21.15.115:0/3042576421 learned_addr learned my addr 172.21.15.115:0/3042576421 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:40.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b23fff700 1 --2- 172.21.15.115:0/3042576421 >> v2:172.21.15.159:3300/0 conn(0x7f0b2414ae00 0x7f0b24154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2899c700 1 -- 172.21.15.115:0/3042576421 >> v2:172.21.15.159:3300/0 conn(0x7f0b2414ae00 msgr2=0x7f0b24154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:40.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2899c700 1 --2- 172.21.15.115:0/3042576421 >> v2:172.21.15.159:3300/0 conn(0x7f0b2414ae00 0x7f0b24154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2899c700 1 -- 172.21.15.115:0/3042576421 >> v1:172.21.15.159:6789/0 conn(0x7f0b2414b1e0 legacy=0x7f0b24062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.787+0000 7f0b2899c700 1 -- 172.21.15.115:0/3042576421 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b24157ff0 con 0x7f0b24063260 2023-07-27T14:29:40.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2899c700 1 --2- 172.21.15.115:0/3042576421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b240a98c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0b240caaf0 tx=0x7f0b1c009840).ready entity=mon.0 client_cookie=1cb310eaed6b8405 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:40.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b22ffd700 1 -- 172.21.15.115:0/3042576421 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00e070 con 0x7f0b24063260 2023-07-27T14:29:40.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b22ffd700 1 -- 172.21.15.115:0/3042576421 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00ba20 con 0x7f0b24063260 2023-07-27T14:29:40.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b22ffd700 1 -- 172.21.15.115:0/3042576421 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00bda0 con 0x7f0b24063260 2023-07-27T14:29:40.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/3042576421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 msgr2=0x7f0b240a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/3042576421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b240a98c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0b240caaf0 tx=0x7f0b1c009840).stop 2023-07-27T14:29:40.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/3042576421 shutdown_connections 2023-07-27T14:29:40.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/3042576421 >> v2:172.21.15.159:3300/0 conn(0x7f0b2414ae00 0x7f0b24154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/3042576421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b240a98c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/3042576421 >> 172.21.15.115:0/3042576421 conn(0x7f0b2405e940 msgr2=0x7f0b240cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:40.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/3042576421 shutdown_connections 2023-07-27T14:29:40.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.788+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/3042576421 wait complete. 2023-07-27T14:29:40.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.790+0000 7f0b2a3ff700 1 Processor -- start 2023-07-27T14:29:40.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.790+0000 7f0b2a3ff700 1 -- start start 2023-07-27T14:29:40.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b2a3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b24164df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b2a3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b2414ae00 0x7f0b24166b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b2a3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b2414b1e0 0x7f0b24163db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b2a3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b240af7f0 con 0x7f0b24063260 2023-07-27T14:29:40.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b2a3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b240af220 con 0x7f0b2414b1e0 2023-07-27T14:29:40.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b2a3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b24164830 con 0x7f0b2414ae00 2023-07-27T14:29:40.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b23fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b24164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b23fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b24164df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47290/0 (socket says 172.21.15.115:47290) 2023-07-27T14:29:40.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b23fff700 1 -- 172.21.15.115:0/1724495747 learned_addr learned my addr 172.21.15.115:0/1724495747 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:40.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b2899c700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b2414b1e0 0x7f0b24163db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b23fff700 1 -- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b2414ae00 msgr2=0x7f0b24166b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b237fe700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b2414ae00 0x7f0b24166b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b23fff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b2414ae00 0x7f0b24166b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b23fff700 1 -- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b2414b1e0 msgr2=0x7f0b24163db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:40.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.791+0000 7f0b23fff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b2414b1e0 0x7f0b24163db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:40.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.792+0000 7f0b23fff700 1 -- 172.21.15.115:0/1724495747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c009ae0 con 0x7f0b24063260 2023-07-27T14:29:40.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.792+0000 7f0b237fe700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b2414ae00 0x7f0b24166b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:40.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.792+0000 7f0b23fff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b24164df0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f0b1400e930 tx=0x7f0b14009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:40.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.792+0000 7f0b0bfff700 1 -- 172.21.15.115:0/1724495747 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400eed0 con 0x7f0b24063260 2023-07-27T14:29:40.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.792+0000 7f0b0bfff700 1 -- 172.21.15.115:0/1724495747 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1400c850 con 0x7f0b24063260 2023-07-27T14:29:40.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.792+0000 7f0b0bfff700 1 -- 172.21.15.115:0/1724495747 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400cbd0 con 0x7f0b24063260 2023-07-27T14:29:40.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.792+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b24164b10 con 0x7f0b24063260 2023-07-27T14:29:40.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.792+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b24167020 con 0x7f0b24063260 2023-07-27T14:29:40.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.793+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2406c470 con 0x7f0b24063260 2023-07-27T14:29:40.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.794+0000 7f0b0bfff700 1 -- 172.21.15.115:0/1724495747 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 75482+0+0 (secure 0 0 0) 0x7f0b14022070 con 0x7f0b24063260 2023-07-27T14:29:40.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.795+0000 7f0b0bfff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b1005ef40 0x7f0b10061400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:40.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.795+0000 7f0b0bfff700 1 -- 172.21.15.115:0/1724495747 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b1407a380 con 0x7f0b24063260 2023-07-27T14:29:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.795+0000 7f0b237fe700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b1005ef40 0x7f0b10061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.795+0000 7f0b237fe700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b1005ef40 0x7f0b10061400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0b24151fd0 tx=0x7f0b18009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:40.799+0000 7f0b0bfff700 1 -- 172.21.15.115:0/1724495747 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b1404b660 con 0x7f0b24063260 2023-07-27T14:29:41.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.008+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000716080", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b240af930 con 0x7f0b1005ef40 2023-07-27T14:29:41.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.016+0000 7f0b0bfff700 1 -- 172.21.15.115:0/1724495747 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f0b180012c0 con 0x7f0b1005ef40 2023-07-27T14:29:41.041 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:29:41.042 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:29:41.042 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:29:41.042 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:29:41.042 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:29:41.042 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000242766", 2023-07-27T14:29:41.042 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000417357" 2023-07-27T14:29:41.042 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:41.043 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:41.043 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:29:41.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b1005ef40 msgr2=0x7f0b10061400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:41.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b1005ef40 0x7f0b10061400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0b24151fd0 tx=0x7f0b18009040).stop 2023-07-27T14:29:41.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 msgr2=0x7f0b24164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:41.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b24164df0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f0b1400e930 tx=0x7f0b14009060).stop 2023-07-27T14:29:41.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 shutdown_connections 2023-07-27T14:29:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b1005ef40 0x7f0b10061400 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b2414b1e0 0x7f0b24163db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b24063260 0x7f0b24164df0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 --2- 172.21.15.115:0/1724495747 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b2414ae00 0x7f0b24166b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 >> 172.21.15.115:0/1724495747 conn(0x7f0b2405e940 msgr2=0x7f0b241547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 shutdown_connections 2023-07-27T14:29:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:41.018+0000 7f0b2a3ff700 1 -- 172.21.15.115:0/1724495747 wait complete. 2023-07-27T14:29:42.062 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000716080 2023-07-27T14:29:42.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.237+0000 7fac9f3ff700 1 Processor -- start 2023-07-27T14:29:42.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.237+0000 7fac9f3ff700 1 -- start start 2023-07-27T14:29:42.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.238+0000 7fac9f3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac980c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:42.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.238+0000 7fac9f3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fac98065de0 0x7fac98062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:42.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.238+0000 7fac9f3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac98064a80 con 0x7fac98064230 2023-07-27T14:29:42.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.238+0000 7fac9f3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac98062320 con 0x7fac98065de0 2023-07-27T14:29:42.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.238+0000 7fac9f3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac98064d60 con 0x7fac98153e00 2023-07-27T14:29:42.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9d99c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fac98065de0 0x7fac98062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:42.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9c99a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fac98064230 0x7fac980656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56790/0 (socket says 172.21.15.115:56790) 2023-07-27T14:29:42.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9c99a700 1 -- 172.21.15.115:0/83110846 learned_addr learned my addr 172.21.15.115:0/83110846 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:42.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9d99c700 1 -- 172.21.15.115:0/83110846 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 msgr2=0x7fac980c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:42.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9d19b700 1 --2- 172.21.15.115:0/83110846 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac980c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:42.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac8ffff700 1 -- 172.21.15.115:0/83110846 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289820517 0 0) 0x7fac98064a80 con 0x7fac98064230 2023-07-27T14:29:42.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9d99c700 1 --2- 172.21.15.115:0/83110846 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac980c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9d99c700 1 -- 172.21.15.115:0/83110846 >> v1:172.21.15.115:6789/0 conn(0x7fac98064230 legacy=0x7fac980656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:42.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9d99c700 1 -- 172.21.15.115:0/83110846 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac98065040 con 0x7fac98065de0 2023-07-27T14:29:42.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9d19b700 1 --2- 172.21.15.115:0/83110846 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac980c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.239+0000 7fac9d99c700 1 --2- 172.21.15.115:0/83110846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98065de0 0x7fac98062770 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fac90009e60 tx=0x7fac90009780).ready entity=mon.0 client_cookie=4e5a25b7475d2483 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac8ffff700 1 -- 172.21.15.115:0/83110846 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000e070 con 0x7fac98065de0 2023-07-27T14:29:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac8ffff700 1 -- 172.21.15.115:0/83110846 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000bc30 con 0x7fac98065de0 2023-07-27T14:29:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac8ffff700 1 -- 172.21.15.115:0/83110846 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90012410 con 0x7fac98065de0 2023-07-27T14:29:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac9f3ff700 1 -- 172.21.15.115:0/83110846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98065de0 msgr2=0x7fac98062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/83110846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98065de0 0x7fac98062770 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fac90009e60 tx=0x7fac90009780).stop 2023-07-27T14:29:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac9f3ff700 1 -- 172.21.15.115:0/83110846 shutdown_connections 2023-07-27T14:29:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/83110846 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac980c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/83110846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98065de0 0x7fac98062770 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac9f3ff700 1 -- 172.21.15.115:0/83110846 >> 172.21.15.115:0/83110846 conn(0x7fac980c7b90 msgr2=0x7fac980c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:42.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac9f3ff700 1 -- 172.21.15.115:0/83110846 shutdown_connections 2023-07-27T14:29:42.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.240+0000 7fac9f3ff700 1 -- 172.21.15.115:0/83110846 wait complete. 2023-07-27T14:29:42.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.242+0000 7fac9f3ff700 1 Processor -- start 2023-07-27T14:29:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.242+0000 7fac9f3ff700 1 -- start start 2023-07-27T14:29:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9f3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98064230 0x7fac98093790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9f3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac98065de0 0x7fac98152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9f3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac98152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9f3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac98091b70 con 0x7fac98064230 2023-07-27T14:29:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9f3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac98091e50 con 0x7fac98065de0 2023-07-27T14:29:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9f3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac98092130 con 0x7fac98153e00 2023-07-27T14:29:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9d19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98064230 0x7fac98093790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9d19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98064230 0x7fac98093790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47302/0 (socket says 172.21.15.115:47302) 2023-07-27T14:29:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9d19b700 1 -- 172.21.15.115:0/1603875229 learned_addr learned my addr 172.21.15.115:0/1603875229 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9d99c700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac98152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.243+0000 7fac9c99a700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac98065de0 0x7fac98152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac9d19b700 1 -- 172.21.15.115:0/1603875229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 msgr2=0x7fac98152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac9d19b700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac98152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac9d19b700 1 -- 172.21.15.115:0/1603875229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac98065de0 msgr2=0x7fac98152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac9d19b700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac98065de0 0x7fac98152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac9d19b700 1 -- 172.21.15.115:0/1603875229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90009a20 con 0x7fac98064230 2023-07-27T14:29:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac9d19b700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98064230 0x7fac98093790 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fac9400c880 tx=0x7fac94008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac8d7fa700 1 -- 172.21.15.115:0/1603875229 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94010580 con 0x7fac98064230 2023-07-27T14:29:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac8d7fa700 1 -- 172.21.15.115:0/1603875229 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac940106e0 con 0x7fac98064230 2023-07-27T14:29:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac98092410 con 0x7fac98064230 2023-07-27T14:29:42.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac8d7fa700 1 -- 172.21.15.115:0/1603875229 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94010a80 con 0x7fac98064230 2023-07-27T14:29:42.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.244+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac98093c80 con 0x7fac98064230 2023-07-27T14:29:42.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.245+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac98092a60 con 0x7fac98064230 2023-07-27T14:29:42.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.246+0000 7fac8d7fa700 1 -- 172.21.15.115:0/1603875229 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7fac9401b460 con 0x7fac98064230 2023-07-27T14:29:42.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.247+0000 7fac8d7fa700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac7c05efd0 0x7fac7c061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:42.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.247+0000 7fac8d7fa700 1 -- 172.21.15.115:0/1603875229 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fac94079e80 con 0x7fac98064230 2023-07-27T14:29:42.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.247+0000 7fac9c99a700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac7c05efd0 0x7fac7c061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:42.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.248+0000 7fac9c99a700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac7c05efd0 0x7fac7c061490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fac980a9de0 tx=0x7fac88009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:42.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.251+0000 7fac8d7fa700 1 -- 172.21.15.115:0/1603875229 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac9404b2e0 con 0x7fac98064230 2023-07-27T14:29:42.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.460+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000716080", "target": ["mon-mgr", ""]}) v1 -- 0x7fac98065320 con 0x7fac7c05efd0 2023-07-27T14:29:42.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.466+0000 7fac8d7fa700 1 -- 172.21.15.115:0/1603875229 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7fac98065320 con 0x7fac7c05efd0 2023-07-27T14:29:42.492 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:29:42.492 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:29:42.492 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:29:42.492 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:29:42.492 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:29:42.493 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000242766", 2023-07-27T14:29:42.493 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000417357" 2023-07-27T14:29:42.493 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:42.493 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:42.493 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:29:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac7c05efd0 msgr2=0x7fac7c061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac7c05efd0 0x7fac7c061490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fac980a9de0 tx=0x7fac88009040).stop 2023-07-27T14:29:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98064230 msgr2=0x7fac98093790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98064230 0x7fac98093790 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fac9400c880 tx=0x7fac94008040).stop 2023-07-27T14:29:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 shutdown_connections 2023-07-27T14:29:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac7c05efd0 0x7fac7c061490 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac98153e00 0x7fac98152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac98064230 0x7fac98093790 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 --2- 172.21.15.115:0/1603875229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac98065de0 0x7fac98152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 >> 172.21.15.115:0/1603875229 conn(0x7fac980c7b90 msgr2=0x7fac980bd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 shutdown_connections 2023-07-27T14:29:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:42.468+0000 7fac9f3ff700 1 -- 172.21.15.115:0/1603875229 wait complete. 2023-07-27T14:29:43.512 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000716080 2023-07-27T14:29:43.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.689+0000 7fcc247ff700 1 Processor -- start 2023-07-27T14:29:43.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.689+0000 7fcc247ff700 1 -- start start 2023-07-27T14:29:43.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc247ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcc1c0c0ea0 0x7fcc1c150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:43.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc247ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c068bb0 con 0x7fcc1c065220 2023-07-27T14:29:43.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc247ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c06a250 con 0x7fcc1c150220 2023-07-27T14:29:43.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc247ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0656b0 con 0x7fcc1c0c0ea0 2023-07-27T14:29:43.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc22d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcc1c065220 0x7fcc1c0c1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59264/0 (socket says 172.21.15.115:59264) 2023-07-27T14:29:43.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc22d9c700 1 -- 172.21.15.115:0/4142136276 learned_addr learned my addr 172.21.15.115:0/4142136276 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:43.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc21d9a700 1 --2- 172.21.15.115:0/4142136276 >> v2:172.21.15.159:3300/0 conn(0x7fcc1c0c0ea0 0x7fcc1c150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:43.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004538928 0 0) 0x7fcc1c068bb0 con 0x7fcc1c065220 2023-07-27T14:29:43.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.691+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc080033f0 con 0x7fcc1c065220 2023-07-27T14:29:43.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3029601669 0 0) 0x7fcc080033f0 con 0x7fcc1c065220 2023-07-27T14:29:43.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 >> v2:172.21.15.159:3300/0 conn(0x7fcc1c0c0ea0 msgr2=0x7fcc1c150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:43.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 --2- 172.21.15.115:0/4142136276 >> v2:172.21.15.159:3300/0 conn(0x7fcc1c0c0ea0 0x7fcc1c150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 >> v1:172.21.15.159:6789/0 conn(0x7fcc1c150220 legacy=0x7fcc1c069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:43.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0c1380 con 0x7fcc1c065220 2023-07-27T14:29:43.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fcc140017f0 con 0x7fcc1c065220 2023-07-27T14:29:43.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 >> v1:172.21.15.115:6789/0 conn(0x7fcc1c065220 legacy=0x7fcc1c0c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:43.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc080038e0 0x7fcc08003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:43.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc08004690 0x7fcc08004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc0800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0656b0 con 0x7fcc08005000 2023-07-27T14:29:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0800be00 con 0x7fcc080038e0 2023-07-27T14:29:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0800e1d0 con 0x7fcc08004690 2023-07-27T14:29:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc22d9c700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc0800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc2259b700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc080038e0 0x7fcc08003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc21d9a700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc08004690 0x7fcc08004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc22d9c700 1 -- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc08004690 msgr2=0x7fcc08004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:43.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.692+0000 7fcc22d9c700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc08004690 0x7fcc08004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc22d9c700 1 -- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc080038e0 msgr2=0x7fcc08003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:43.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc22d9c700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc080038e0 0x7fcc08003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc22d9c700 1 -- 172.21.15.115:0/4142136276 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080033f0 con 0x7fcc08005000 2023-07-27T14:29:43.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc2259b700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc080038e0 0x7fcc08003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:43.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc21d9a700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc08004690 0x7fcc08004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:43.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc22d9c700 1 -- 172.21.15.115:0/4142136276 reap_dead start 2023-07-27T14:29:43.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc22d9c700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc0800b8e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fcc1400c5f0 tx=0x7fcc1c0c2bf0).ready entity=mon.0 client_cookie=c3f37c063cded5c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:43.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400cdf0 con 0x7fcc08005000 2023-07-27T14:29:43.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc14005b20 con 0x7fcc08005000 2023-07-27T14:29:43.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc21599700 1 -- 172.21.15.115:0/4142136276 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140070d0 con 0x7fcc08005000 2023-07-27T14:29:43.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc247ff700 1 -- 172.21.15.115:0/4142136276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 msgr2=0x7fcc0800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:43.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc247ff700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc0800b8e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fcc1400c5f0 tx=0x7fcc1c0c2bf0).stop 2023-07-27T14:29:43.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc247ff700 1 -- 172.21.15.115:0/4142136276 shutdown_connections 2023-07-27T14:29:43.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.693+0000 7fcc247ff700 1 --2- 172.21.15.115:0/4142136276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc0800b8e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.694+0000 7fcc247ff700 1 -- 172.21.15.115:0/4142136276 >> 172.21.15.115:0/4142136276 conn(0x7fcc1c062320 msgr2=0x7fcc1c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:43.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.694+0000 7fcc247ff700 1 -- 172.21.15.115:0/4142136276 shutdown_connections 2023-07-27T14:29:43.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.694+0000 7fcc247ff700 1 -- 172.21.15.115:0/4142136276 wait complete. 2023-07-27T14:29:43.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.695+0000 7fcc247ff700 1 Processor -- start 2023-07-27T14:29:43.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.695+0000 7fcc247ff700 1 -- start start 2023-07-27T14:29:43.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc247ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc1c163900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:43.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc247ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc1c0ac600 0x7fcc1c15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:43.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc247ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc1c14d150 0x7fcc1c0bc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:43.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc247ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0a6210 con 0x7fcc08005000 2023-07-27T14:29:43.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc247ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0a64b0 con 0x7fcc1c0ac600 2023-07-27T14:29:43.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc247ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0a6790 con 0x7fcc1c14d150 2023-07-27T14:29:43.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc2259b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc1c163900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:43.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc2259b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc1c163900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53052/0 (socket says 172.21.15.115:53052) 2023-07-27T14:29:43.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.696+0000 7fcc2259b700 1 -- 172.21.15.115:0/291841120 learned_addr learned my addr 172.21.15.115:0/291841120 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:43.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc21d9a700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc1c0ac600 0x7fcc1c15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:43.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc22d9c700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc1c14d150 0x7fcc1c0bc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:43.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc2259b700 1 -- 172.21.15.115:0/291841120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc1c14d150 msgr2=0x7fcc1c0bc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:43.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc2259b700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc1c14d150 0x7fcc1c0bc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc2259b700 1 -- 172.21.15.115:0/291841120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc1c0ac600 msgr2=0x7fcc1c15f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:43.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc2259b700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc1c0ac600 0x7fcc1c15f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc2259b700 1 -- 172.21.15.115:0/291841120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0a6a70 con 0x7fcc08005000 2023-07-27T14:29:43.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc2259b700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc1c163900 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fcc1800e5f0 tx=0x7fcc18009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:43.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc127fc700 1 -- 172.21.15.115:0/291841120 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18010490 con 0x7fcc08005000 2023-07-27T14:29:43.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc127fc700 1 -- 172.21.15.115:0/291841120 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc18010040 con 0x7fcc08005000 2023-07-27T14:29:43.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc127fc700 1 -- 172.21.15.115:0/291841120 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18010800 con 0x7fcc08005000 2023-07-27T14:29:43.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c0a6d50 con 0x7fcc08005000 2023-07-27T14:29:43.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.697+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c15fe90 con 0x7fcc08005000 2023-07-27T14:29:43.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.698+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c06c470 con 0x7fcc08005000 2023-07-27T14:29:43.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.699+0000 7fcc127fc700 1 -- 172.21.15.115:0/291841120 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7fcc18010bf0 con 0x7fcc08005000 2023-07-27T14:29:43.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.700+0000 7fcc127fc700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc0005efd0 0x7fcc00061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:43.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.700+0000 7fcc127fc700 1 -- 172.21.15.115:0/291841120 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcc18079760 con 0x7fcc08005000 2023-07-27T14:29:43.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.700+0000 7fcc21d9a700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc0005efd0 0x7fcc00061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:43.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.700+0000 7fcc21d9a700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc0005efd0 0x7fcc00061490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fcc0c006b00 tx=0x7fcc0c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:43.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.704+0000 7fcc127fc700 1 -- 172.21.15.115:0/291841120 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc1804abc0 con 0x7fcc08005000 2023-07-27T14:29:43.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.910+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000716080", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc1c068560 con 0x7fcc0005efd0 2023-07-27T14:29:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.916+0000 7fcc127fc700 1 -- 172.21.15.115:0/291841120 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7fcc1c068560 con 0x7fcc0005efd0 2023-07-27T14:29:43.943 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:29:43.943 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:29:43.943 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:29:43.943 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:29:43.944 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:29:43.944 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000242766", 2023-07-27T14:29:43.944 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000417357" 2023-07-27T14:29:43.944 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:43.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:43.945 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:29:43.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.918+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc0005efd0 msgr2=0x7fcc00061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:43.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.918+0000 7fcc247ff700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc0005efd0 0x7fcc00061490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fcc0c006b00 tx=0x7fcc0c008040).stop 2023-07-27T14:29:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.918+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 msgr2=0x7fcc1c163900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.918+0000 7fcc247ff700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc1c163900 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fcc1800e5f0 tx=0x7fcc18009040).stop 2023-07-27T14:29:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.919+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 shutdown_connections 2023-07-27T14:29:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.919+0000 7fcc247ff700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc0005efd0 0x7fcc00061490 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.919+0000 7fcc247ff700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc1c14d150 0x7fcc1c0bc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.919+0000 7fcc247ff700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc08005000 0x7fcc1c163900 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.919+0000 7fcc247ff700 1 --2- 172.21.15.115:0/291841120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc1c0ac600 0x7fcc1c15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.919+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 >> 172.21.15.115:0/291841120 conn(0x7fcc1c062320 msgr2=0x7fcc1c0c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.919+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 shutdown_connections 2023-07-27T14:29:43.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:43.919+0000 7fcc247ff700 1 -- 172.21.15.115:0/291841120 wait complete. 2023-07-27T14:29:44.962 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000716080 2023-07-27T14:29:45.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.137+0000 7f9f813ff700 1 Processor -- start 2023-07-27T14:29:45.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.137+0000 7f9f813ff700 1 -- start start 2023-07-27T14:29:45.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f813ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9f7c14ae00 0x7f9f7c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:45.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f813ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f7c14b1e0 0x7f9f7c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:45.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f813ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7c1553f0 con 0x7f9f7c0c5c50 2023-07-27T14:29:45.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f813ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c157a50 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f813ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c157d10 con 0x7f9f7c14ae00 2023-07-27T14:29:45.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f7a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f7c14b1e0 0x7f9f7c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:45.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f7a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f7c14b1e0 0x7f9f7c062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53054/0 (socket says 172.21.15.115:53054) 2023-07-27T14:29:45.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f7a7fc700 1 -- 172.21.15.115:0/3252507536 learned_addr learned my addr 172.21.15.115:0/3252507536 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:45.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f7a7fc700 1 -- 172.21.15.115:0/3252507536 >> v2:172.21.15.159:3300/0 conn(0x7f9f7c14ae00 msgr2=0x7f9f7c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:45.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f7a7fc700 1 --2- 172.21.15.115:0/3252507536 >> v2:172.21.15.159:3300/0 conn(0x7f9f7c14ae00 0x7f9f7c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:45.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f7a7fc700 1 -- 172.21.15.115:0/3252507536 >> v1:172.21.15.159:6789/0 conn(0x7f9f7c0c5c50 legacy=0x7f9f7c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:45.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f7a7fc700 1 -- 172.21.15.115:0/3252507536 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c157ff0 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.139+0000 7f9f7a7fc700 1 --2- 172.21.15.115:0/3252507536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c062b50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f9f7c155580 tx=0x7f9f700090f0).ready entity=mon.0 client_cookie=fd7552044ce5d8ec server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:45.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f79ffb700 1 -- 172.21.15.115:0/3252507536 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000b5a0 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f79ffb700 1 -- 172.21.15.115:0/3252507536 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7000b700 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f79ffb700 1 -- 172.21.15.115:0/3252507536 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000ba80 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f813ff700 1 -- 172.21.15.115:0/3252507536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 msgr2=0x7f9f7c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:45.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f813ff700 1 --2- 172.21.15.115:0/3252507536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c062b50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f9f7c155580 tx=0x7f9f700090f0).stop 2023-07-27T14:29:45.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f813ff700 1 -- 172.21.15.115:0/3252507536 shutdown_connections 2023-07-27T14:29:45.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f813ff700 1 --2- 172.21.15.115:0/3252507536 >> v2:172.21.15.159:3300/0 conn(0x7f9f7c14ae00 0x7f9f7c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:29:45.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f813ff700 1 --2- 172.21.15.115:0/3252507536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c062b50 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:45.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f813ff700 1 -- 172.21.15.115:0/3252507536 >> 172.21.15.115:0/3252507536 conn(0x7f9f7c05e940 msgr2=0x7f9f7c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:45.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f813ff700 1 -- 172.21.15.115:0/3252507536 shutdown_connections 2023-07-27T14:29:45.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.140+0000 7f9f813ff700 1 -- 172.21.15.115:0/3252507536 wait complete. 2023-07-27T14:29:45.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.142+0000 7f9f813ff700 1 Processor -- start 2023-07-27T14:29:45.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.142+0000 7f9f813ff700 1 -- start start 2023-07-27T14:29:45.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f813ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f7c0c5c50 0x7f9f7c164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:45.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f813ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f7c14ae00 0x7f9f7c151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:45.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f813ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:45.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f813ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c164b10 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f813ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0c33a0 con 0x7f9f7c14ae00 2023-07-27T14:29:45.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f813ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c1644c0 con 0x7f9f7c0c5c50 2023-07-27T14:29:45.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f7b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:45.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f7b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c0af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53064/0 (socket says 172.21.15.115:53064) 2023-07-27T14:29:45.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f7b7fe700 1 -- 172.21.15.115:0/316585692 learned_addr learned my addr 172.21.15.115:0/316585692 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:45.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f7a7fc700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f7c14ae00 0x7f9f7c151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:45.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.143+0000 7f9f7affd700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f7c0c5c50 0x7f9f7c164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:45.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f7b7fe700 1 -- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f7c0c5c50 msgr2=0x7f9f7c164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:45.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f7b7fe700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f7c0c5c50 0x7f9f7c164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:45.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f7b7fe700 1 -- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f7c14ae00 msgr2=0x7f9f7c151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:45.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f7b7fe700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f7c14ae00 0x7f9f7c151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:45.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f7b7fe700 1 -- 172.21.15.115:0/316585692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70009370 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f7a7fc700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f7c14ae00 0x7f9f7c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:45.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f7b7fe700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c0af5c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9f7400b810 tx=0x7f9f740092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:45.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f62ffd700 1 -- 172.21.15.115:0/316585692 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400d600 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f62ffd700 1 -- 172.21.15.115:0/316585692 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7400d7a0 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f62ffd700 1 -- 172.21.15.115:0/316585692 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400db60 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c1647a0 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.144+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c0c2c10 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.145+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c06c470 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.146+0000 7f9f62ffd700 1 -- 172.21.15.115:0/316585692 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7f9f74019460 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.147+0000 7f9f62ffd700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f6805efd0 0x7f9f68061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:45.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.147+0000 7f9f62ffd700 1 -- 172.21.15.115:0/316585692 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9f7407a070 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.148+0000 7f9f7affd700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f6805efd0 0x7f9f68061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:45.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.148+0000 7f9f7affd700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f6805efd0 0x7f9f68061490 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f9f7c0af140 tx=0x7f9f6c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:45.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.152+0000 7f9f62ffd700 1 -- 172.21.15.115:0/316585692 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f7404b470 con 0x7f9f7c14b1e0 2023-07-27T14:29:45.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.361+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000716080", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f7c0ad0a0 con 0x7f9f6805efd0 2023-07-27T14:29:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.366+0000 7f9f62ffd700 1 -- 172.21.15.115:0/316585692 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f9f7c0ad0a0 con 0x7f9f6805efd0 2023-07-27T14:29:45.392 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:29:45.392 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:29:45.393 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:29:45.393 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:29:45.393 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:29:45.393 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000242766", 2023-07-27T14:29:45.393 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000417357" 2023-07-27T14:29:45.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:45.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:45.394 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:29:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f6805efd0 msgr2=0x7f9f68061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f6805efd0 0x7f9f68061490 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f9f7c0af140 tx=0x7f9f6c008040).stop 2023-07-27T14:29:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 msgr2=0x7f9f7c0af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c0af5c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9f7400b810 tx=0x7f9f740092d0).stop 2023-07-27T14:29:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 shutdown_connections 2023-07-27T14:29:45.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f6805efd0 0x7f9f68061490 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:45.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c14b1e0 0x7f9f7c0af5c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:45.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f7c0c5c50 0x7f9f7c164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:45.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 --2- 172.21.15.115:0/316585692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f7c14ae00 0x7f9f7c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:45.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 >> 172.21.15.115:0/316585692 conn(0x7f9f7c05e940 msgr2=0x7f9f7c0ac210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:45.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 shutdown_connections 2023-07-27T14:29:45.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:45.369+0000 7f9f813ff700 1 -- 172.21.15.115:0/316585692 wait complete. 2023-07-27T14:29:46.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000716080 2023-07-27T14:29:46.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.578+0000 7fd59c3ff700 1 Processor -- start 2023-07-27T14:29:46.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.578+0000 7fd59c3ff700 1 -- start start 2023-07-27T14:29:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd59c3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd5940c58d0 0x7fd594150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd59c3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940c0ea0 con 0x7fd5941509b0 2023-07-27T14:29:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd59c3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd594068e10 con 0x7fd5940c3100 2023-07-27T14:29:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd59c3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd594151280 con 0x7fd5940c58d0 2023-07-27T14:29:46.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd59a19b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd5941509b0 0x7fd594154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59278/0 (socket says 172.21.15.115:59278) 2023-07-27T14:29:46.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd59a19b700 1 -- 172.21.15.115:0/3206166673 learned_addr learned my addr 172.21.15.115:0/3206166673 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:46.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd59999a700 1 --2- 172.21.15.115:0/3206166673 >> v2:172.21.15.115:3300/0 conn(0x7fd5940c58d0 0x7fd594150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd599199700 1 -- 172.21.15.115:0/3206166673 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366701731 0 0) 0x7fd5940c0ea0 con 0x7fd5941509b0 2023-07-27T14:29:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd599199700 1 -- 172.21.15.115:0/3206166673 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5800033f0 con 0x7fd5941509b0 2023-07-27T14:29:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.580+0000 7fd59999a700 1 -- 172.21.15.115:0/3206166673 >> v1:172.21.15.159:6789/0 conn(0x7fd5940c3100 legacy=0x7fd5940c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:46.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd59999a700 1 -- 172.21.15.115:0/3206166673 >> v1:172.21.15.115:6789/0 conn(0x7fd5941509b0 legacy=0x7fd594154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd59999a700 1 -- 172.21.15.115:0/3206166673 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd594155190 con 0x7fd5940c58d0 2023-07-27T14:29:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd59999a700 1 --2- 172.21.15.115:0/3206166673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd594150d90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fd584009760 tx=0x7fd584009060).ready entity=mon.0 client_cookie=7b903d8a87317086 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd599199700 1 -- 172.21.15.115:0/3206166673 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400f510 con 0x7fd5940c58d0 2023-07-27T14:29:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd599199700 1 -- 172.21.15.115:0/3206166673 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58400f670 con 0x7fd5940c58d0 2023-07-27T14:29:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd599199700 1 -- 172.21.15.115:0/3206166673 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400f9f0 con 0x7fd5940c58d0 2023-07-27T14:29:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd59c3ff700 1 -- 172.21.15.115:0/3206166673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 msgr2=0x7fd594150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:46.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd59c3ff700 1 --2- 172.21.15.115:0/3206166673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd594150d90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fd584009760 tx=0x7fd584009060).stop 2023-07-27T14:29:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.581+0000 7fd59c3ff700 1 -- 172.21.15.115:0/3206166673 shutdown_connections 2023-07-27T14:29:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.582+0000 7fd59c3ff700 1 --2- 172.21.15.115:0/3206166673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd594150d90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.582+0000 7fd59c3ff700 1 -- 172.21.15.115:0/3206166673 >> 172.21.15.115:0/3206166673 conn(0x7fd594062320 msgr2=0x7fd594062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.582+0000 7fd59c3ff700 1 -- 172.21.15.115:0/3206166673 shutdown_connections 2023-07-27T14:29:46.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.582+0000 7fd59c3ff700 1 -- 172.21.15.115:0/3206166673 wait complete. 2023-07-27T14:29:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.583+0000 7fd59c3ff700 1 Processor -- start 2023-07-27T14:29:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.583+0000 7fd59c3ff700 1 -- start start 2023-07-27T14:29:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59c3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5940c3100 0x7fd5940a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59c3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd59414c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5941509b0 0x7fd5940ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59c3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940a72f0 con 0x7fd5940c58d0 2023-07-27T14:29:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59c3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940a9190 con 0x7fd5940c3100 2023-07-27T14:29:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940a7c00 con 0x7fd5941509b0 2023-07-27T14:29:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd59414c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd59414c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53082/0 (socket says 172.21.15.115:53082) 2023-07-27T14:29:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.584+0000 7fd59999a700 1 -- 172.21.15.115:0/2288502807 learned_addr learned my addr 172.21.15.115:0/2288502807 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59a19b700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5940c3100 0x7fd5940a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59a99c700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5941509b0 0x7fd5940ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59999a700 1 -- 172.21.15.115:0/2288502807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5941509b0 msgr2=0x7fd5940ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59999a700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5941509b0 0x7fd5940ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:46.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59999a700 1 -- 172.21.15.115:0/2288502807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5940c3100 msgr2=0x7fd5940a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59999a700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5940c3100 0x7fd5940a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59999a700 1 -- 172.21.15.115:0/2288502807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840092a0 con 0x7fd5940c58d0 2023-07-27T14:29:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59999a700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd59414c5a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fd584009e00 tx=0x7fd584017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd58a7fc700 1 -- 172.21.15.115:0/2288502807 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400f510 con 0x7fd5940c58d0 2023-07-27T14:29:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd58a7fc700 1 -- 172.21.15.115:0/2288502807 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584000c90 con 0x7fd5940c58d0 2023-07-27T14:29:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd58a7fc700 1 -- 172.21.15.115:0/2288502807 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400f9f0 con 0x7fd5940c58d0 2023-07-27T14:29:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5940a8580 con 0x7fd5940c58d0 2023-07-27T14:29:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.585+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5940a8b40 con 0x7fd5940c58d0 2023-07-27T14:29:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.586+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59406c470 con 0x7fd5940c58d0 2023-07-27T14:29:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.587+0000 7fd58a7fc700 1 -- 172.21.15.115:0/2288502807 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7fd58402b070 con 0x7fd5940c58d0 2023-07-27T14:29:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.588+0000 7fd58a7fc700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd57805f000 0x7fd5780614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.588+0000 7fd58a7fc700 1 -- 172.21.15.115:0/2288502807 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd58407b5f0 con 0x7fd5940c58d0 2023-07-27T14:29:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.588+0000 7fd59a19b700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd57805f000 0x7fd5780614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.589+0000 7fd59a19b700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd57805f000 0x7fd5780614c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd590005750 tx=0x7fd590009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:46.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.592+0000 7fd58a7fc700 1 -- 172.21.15.115:0/2288502807 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd58404c940 con 0x7fd5940c58d0 2023-07-27T14:29:46.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:46.806+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000716080", "target": ["mon-mgr", ""]}) v1 -- 0x7fd594164230 con 0x7fd57805f000 2023-07-27T14:29:49.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.954+0000 7fd58a7fc700 1 -- 172.21.15.115:0/2288502807 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fd594164230 con 0x7fd57805f000 2023-07-27T14:29:49.980 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:29:49.980 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:29:49.980 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:29:49.980 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:29:49.981 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:29:49.981 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000242766", 2023-07-27T14:29:49.981 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000417357" 2023-07-27T14:29:49.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:49.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:49.981 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:29:49.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.957+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd57805f000 msgr2=0x7fd5780614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:49.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.957+0000 7fd59c3ff700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd57805f000 0x7fd5780614c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fd590005750 tx=0x7fd590009040).stop 2023-07-27T14:29:49.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.957+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 msgr2=0x7fd59414c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:49.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.957+0000 7fd59c3ff700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd59414c5a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fd584009e00 tx=0x7fd584017000).stop 2023-07-27T14:29:49.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.958+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 shutdown_connections 2023-07-27T14:29:49.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.958+0000 7fd59c3ff700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd57805f000 0x7fd5780614c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:49.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.958+0000 7fd59c3ff700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd5941509b0 0x7fd5940ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:49.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.958+0000 7fd59c3ff700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5940c3100 0x7fd5940a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:49.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.958+0000 7fd59c3ff700 1 --2- 172.21.15.115:0/2288502807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5940c58d0 0x7fd59414c5a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:49.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.958+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 >> 172.21.15.115:0/2288502807 conn(0x7fd594062320 msgr2=0x7fd594062700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:49.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.958+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 shutdown_connections 2023-07-27T14:29:49.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:49.958+0000 7fd59c3ff700 1 -- 172.21.15.115:0/2288502807 wait complete. 2023-07-27T14:29:50.005 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs clone_0000000000716080 2023-07-27T14:29:50.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.206+0000 7f3bd5fff700 1 Processor -- start 2023-07-27T14:29:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.206+0000 7f3bd5fff700 1 -- start start 2023-07-27T14:29:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bd5fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bd0152930 0x7f3bd00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bd5fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3bd00c4610 0x7f3bd00a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bd5fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 0x7f3bd00c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bd5fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd00a62e0 con 0x7f3bd0152930 2023-07-27T14:29:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bd5fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd0159900 con 0x7f3bd00c4610 2023-07-27T14:29:50.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bd5fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0158a40 con 0x7f3bd0152d10 2023-07-27T14:29:50.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcf7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bd0152930 0x7f3bd00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcf7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bd0152930 0x7f3bd00a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53092/0 (socket says 172.21.15.115:53092) 2023-07-27T14:29:50.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcf7fe700 1 -- 172.21.15.115:0/3684700544 learned_addr learned my addr 172.21.15.115:0/3684700544 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:50.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bceffd700 1 --2- 172.21.15.115:0/3684700544 >> v2:172.21.15.159:3300/0 conn(0x7f3bd00c4610 0x7f3bd00a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcffff700 1 --2- 172.21.15.115:0/3684700544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 0x7f3bd00c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcf7fe700 1 -- 172.21.15.115:0/3684700544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 msgr2=0x7f3bd00c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcf7fe700 1 --2- 172.21.15.115:0/3684700544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 0x7f3bd00c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcf7fe700 1 -- 172.21.15.115:0/3684700544 >> v2:172.21.15.159:3300/0 conn(0x7f3bd00c4610 msgr2=0x7f3bd00a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcf7fe700 1 --2- 172.21.15.115:0/3684700544 >> v2:172.21.15.159:3300/0 conn(0x7f3bd00c4610 0x7f3bd00a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.208+0000 7f3bcf7fe700 1 -- 172.21.15.115:0/3684700544 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd0158cf0 con 0x7f3bd0152930 2023-07-27T14:29:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bcf7fe700 1 --2- 172.21.15.115:0/3684700544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd00a5900 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f3bd00c3e50 tx=0x7f3bc00090f0).ready entity=mon.0 client_cookie=a04660aad7d1e260 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bce7fc700 1 -- 172.21.15.115:0/3684700544 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000b600 con 0x7f3bd0152930 2023-07-27T14:29:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bce7fc700 1 -- 172.21.15.115:0/3684700544 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000b760 con 0x7f3bd0152930 2023-07-27T14:29:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bce7fc700 1 -- 172.21.15.115:0/3684700544 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000bae0 con 0x7f3bd0152930 2023-07-27T14:29:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bd5fff700 1 -- 172.21.15.115:0/3684700544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 msgr2=0x7f3bd00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/3684700544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd00a5900 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f3bd00c3e50 tx=0x7f3bc00090f0).stop 2023-07-27T14:29:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bd5fff700 1 -- 172.21.15.115:0/3684700544 shutdown_connections 2023-07-27T14:29:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/3684700544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 0x7f3bd00c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/3684700544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd00a5900 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/3684700544 >> v2:172.21.15.159:3300/0 conn(0x7f3bd00c4610 0x7f3bd00a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bd5fff700 1 -- 172.21.15.115:0/3684700544 >> 172.21.15.115:0/3684700544 conn(0x7f3bd0062320 msgr2=0x7f3bd0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.209+0000 7f3bd5fff700 1 -- 172.21.15.115:0/3684700544 shutdown_connections 2023-07-27T14:29:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.210+0000 7f3bd5fff700 1 -- 172.21.15.115:0/3684700544 wait complete. 2023-07-27T14:29:50.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.211+0000 7f3bd5fff700 1 Processor -- start 2023-07-27T14:29:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.211+0000 7f3bd5fff700 1 -- start start 2023-07-27T14:29:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bd5fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd00c4610 0x7f3bd00c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bd5fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd0149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bd5fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 0x7f3bd00a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bd5fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd014a360 con 0x7f3bd0152930 2023-07-27T14:29:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bd5fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00c0150 con 0x7f3bd00c4610 2023-07-27T14:29:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bd5fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00bf540 con 0x7f3bd0152d10 2023-07-27T14:29:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bceffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd0149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bceffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd0149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53104/0 (socket says 172.21.15.115:53104) 2023-07-27T14:29:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bceffd700 1 -- 172.21.15.115:0/1412093912 learned_addr learned my addr 172.21.15.115:0/1412093912 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.212+0000 7f3bcf7fe700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd00c4610 0x7f3bd00c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bcffff700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 0x7f3bd00a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bceffd700 1 -- 172.21.15.115:0/1412093912 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 msgr2=0x7f3bd00a8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bceffd700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 0x7f3bd00a8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bceffd700 1 -- 172.21.15.115:0/1412093912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd00c4610 msgr2=0x7f3bd00c05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bceffd700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd00c4610 0x7f3bd00c05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bceffd700 1 -- 172.21.15.115:0/1412093912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0009370 con 0x7f3bd0152930 2023-07-27T14:29:50.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bceffd700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd0149e70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f3bc400d860 tx=0x7f3bc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:50.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bb77fe700 1 -- 172.21.15.115:0/1412093912 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011590 con 0x7f3bd0152930 2023-07-27T14:29:50.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bb77fe700 1 -- 172.21.15.115:0/1412093912 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc40116f0 con 0x7f3bd0152930 2023-07-27T14:29:50.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bb77fe700 1 -- 172.21.15.115:0/1412093912 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011a70 con 0x7f3bd0152930 2023-07-27T14:29:50.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd00bf820 con 0x7f3bd0152930 2023-07-27T14:29:50.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.213+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd00bfde0 con 0x7f3bd0152930 2023-07-27T14:29:50.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.215+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd006c470 con 0x7f3bd0152930 2023-07-27T14:29:50.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.216+0000 7f3bb77fe700 1 -- 172.21.15.115:0/1412093912 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7f3bc401c460 con 0x7f3bd0152930 2023-07-27T14:29:50.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.217+0000 7f3bb77fe700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3bbc05efd0 0x7f3bbc061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.217+0000 7f3bb77fe700 1 -- 172.21.15.115:0/1412093912 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f3bc4079d50 con 0x7f3bd0152930 2023-07-27T14:29:50.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.217+0000 7f3bcf7fe700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3bbc05efd0 0x7f3bbc061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.218+0000 7f3bcf7fe700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3bbc05efd0 0x7f3bbc061490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f3bc0009130 tx=0x7f3bc0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:50.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.221+0000 7f3bb77fe700 1 -- 172.21.15.115:0/1412093912 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3bc404afd0 con 0x7f3bd0152930 2023-07-27T14:29:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.497+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "clone_0000000000716080", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bd00bc300 con 0x7f3bbc05efd0 2023-07-27T14:29:50.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.592+0000 7f3bb77fe700 1 -- 172.21.15.115:0/1412093912 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3bd00bc300 con 0x7f3bbc05efd0 2023-07-27T14:29:50.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3bbc05efd0 msgr2=0x7f3bbc061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3bbc05efd0 0x7f3bbc061490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f3bc0009130 tx=0x7f3bc0017000).stop 2023-07-27T14:29:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 msgr2=0x7f3bd0149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd0149e70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f3bc400d860 tx=0x7f3bc4008040).stop 2023-07-27T14:29:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 shutdown_connections 2023-07-27T14:29:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3bbc05efd0 0x7f3bbc061490 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bd0152d10 0x7f3bd00a8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bd00c4610 0x7f3bd00c05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 --2- 172.21.15.115:0/1412093912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0152930 0x7f3bd0149e70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 >> 172.21.15.115:0/1412093912 conn(0x7f3bd0062320 msgr2=0x7f3bd0069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 shutdown_connections 2023-07-27T14:29:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.594+0000 7f3bd5fff700 1 -- 172.21.15.115:0/1412093912 wait complete. 2023-07-27T14:29:50.636 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000716080 2023-07-27T14:29:50.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.802+0000 7fc01a1ff700 1 Processor -- start 2023-07-27T14:29:50.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.803+0000 7fc01a1ff700 1 -- start start 2023-07-27T14:29:50.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc01a1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc014063260 0x7fc014154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc01a1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc01414b1e0 0x7fc0140a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc01a1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0141553f0 con 0x7fc01414ae00 2023-07-27T14:29:50.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc01a1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc014157a50 con 0x7fc014063260 2023-07-27T14:29:50.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc01a1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc014157d10 con 0x7fc01414b1e0 2023-07-27T14:29:50.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc012ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc014063260 0x7fc014154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc0137fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc01414ae00 0x7fc014062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59290/0 (socket says 172.21.15.115:59290) 2023-07-27T14:29:50.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc0137fe700 1 -- 172.21.15.115:0/2392118900 learned_addr learned my addr 172.21.15.115:0/2392118900 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:50.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc0127fc700 1 -- 172.21.15.115:0/2392118900 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476929524 0 0) 0x7fc0141553f0 con 0x7fc01414ae00 2023-07-27T14:29:50.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.804+0000 7fc013fff700 1 --2- 172.21.15.115:0/2392118900 >> v2:172.21.15.159:3300/0 conn(0x7fc01414b1e0 0x7fc0140a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc0127fc700 1 -- 172.21.15.115:0/2392118900 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbffc0033f0 con 0x7fc01414ae00 2023-07-27T14:29:50.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc012ffd700 1 -- 172.21.15.115:0/2392118900 >> v2:172.21.15.159:3300/0 conn(0x7fc01414b1e0 msgr2=0x7fc0140a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:50.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc012ffd700 1 --2- 172.21.15.115:0/2392118900 >> v2:172.21.15.159:3300/0 conn(0x7fc01414b1e0 0x7fc0140a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc012ffd700 1 -- 172.21.15.115:0/2392118900 >> v1:172.21.15.115:6789/0 conn(0x7fc01414ae00 legacy=0x7fc014062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc012ffd700 1 -- 172.21.15.115:0/2392118900 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014157ff0 con 0x7fc014063260 2023-07-27T14:29:50.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc013fff700 1 --2- 172.21.15.115:0/2392118900 >> v2:172.21.15.159:3300/0 conn(0x7fc01414b1e0 0x7fc0140a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:50.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc012ffd700 1 --2- 172.21.15.115:0/2392118900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc014063260 0x7fc014154f00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fc014083430 tx=0x7fc008009060).ready entity=mon.0 client_cookie=9e805e74017317a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:50.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc0127fc700 1 -- 172.21.15.115:0/2392118900 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800f510 con 0x7fc014063260 2023-07-27T14:29:50.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc0127fc700 1 -- 172.21.15.115:0/2392118900 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00800f670 con 0x7fc014063260 2023-07-27T14:29:50.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc0127fc700 1 -- 172.21.15.115:0/2392118900 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800f9f0 con 0x7fc014063260 2023-07-27T14:29:50.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc01a1ff700 1 -- 172.21.15.115:0/2392118900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc014063260 msgr2=0x7fc014154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.805+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/2392118900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc014063260 0x7fc014154f00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fc014083430 tx=0x7fc008009060).stop 2023-07-27T14:29:50.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.806+0000 7fc01a1ff700 1 -- 172.21.15.115:0/2392118900 shutdown_connections 2023-07-27T14:29:50.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.806+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/2392118900 >> v2:172.21.15.159:3300/0 conn(0x7fc01414b1e0 0x7fc0140a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.806+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/2392118900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc014063260 0x7fc014154f00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.806+0000 7fc01a1ff700 1 -- 172.21.15.115:0/2392118900 >> 172.21.15.115:0/2392118900 conn(0x7fc01405e940 msgr2=0x7fc0140cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:50.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.806+0000 7fc01a1ff700 1 -- 172.21.15.115:0/2392118900 shutdown_connections 2023-07-27T14:29:50.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.806+0000 7fc01a1ff700 1 -- 172.21.15.115:0/2392118900 wait complete. 2023-07-27T14:29:50.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.807+0000 7fc01a1ff700 1 Processor -- start 2023-07-27T14:29:50.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.807+0000 7fc01a1ff700 1 -- start start 2023-07-27T14:29:50.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc01a1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc014063260 0x7fc0140a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc01a1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01414ae00 0x7fc0140c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc01a1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc01414b1e0 0x7fc0140c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc01a1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc014164040 con 0x7fc01414ae00 2023-07-27T14:29:50.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc01a1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140ca370 con 0x7fc01414b1e0 2023-07-27T14:29:50.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc01a1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0141642b0 con 0x7fc014063260 2023-07-27T14:29:50.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc012ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01414ae00 0x7fc0140c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc012ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01414ae00 0x7fc0140c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53126/0 (socket says 172.21.15.115:53126) 2023-07-27T14:29:50.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.808+0000 7fc012ffd700 1 -- 172.21.15.115:0/3499746671 learned_addr learned my addr 172.21.15.115:0/3499746671 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:50.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc013fff700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc01414b1e0 0x7fc0140c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc0137fe700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc014063260 0x7fc0140a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc012ffd700 1 -- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc014063260 msgr2=0x7fc0140a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc012ffd700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc014063260 0x7fc0140a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc012ffd700 1 -- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc01414b1e0 msgr2=0x7fc0140c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:50.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc012ffd700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc01414b1e0 0x7fc0140c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:50.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc012ffd700 1 -- 172.21.15.115:0/3499746671 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080092a0 con 0x7fc01414ae00 2023-07-27T14:29:50.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc013fff700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc01414b1e0 0x7fc0140c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:50.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc012ffd700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01414ae00 0x7fc0140c9990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fc008009dd0 tx=0x7fc008017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:50.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fbffb7fe700 1 -- 172.21.15.115:0/3499746671 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800f9f0 con 0x7fc01414ae00 2023-07-27T14:29:50.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fbffb7fe700 1 -- 172.21.15.115:0/3499746671 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008000c90 con 0x7fc01414ae00 2023-07-27T14:29:50.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140a9770 con 0x7fc01414ae00 2023-07-27T14:29:50.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fbffb7fe700 1 -- 172.21.15.115:0/3499746671 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00801b660 con 0x7fc01414ae00 2023-07-27T14:29:50.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.809+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0140af660 con 0x7fc01414ae00 2023-07-27T14:29:50.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.810+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01406c470 con 0x7fc01414ae00 2023-07-27T14:29:50.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.811+0000 7fbffb7fe700 1 -- 172.21.15.115:0/3499746671 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7fc00802b070 con 0x7fc01414ae00 2023-07-27T14:29:50.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.812+0000 7fbffb7fe700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc00005efa0 0x7fc000061460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:50.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.812+0000 7fbffb7fe700 1 -- 172.21.15.115:0/3499746671 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fc00807b670 con 0x7fc01414ae00 2023-07-27T14:29:50.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.812+0000 7fc0137fe700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc00005efa0 0x7fc000061460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:50.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.812+0000 7fc0137fe700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc00005efa0 0x7fc000061460 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fc004005750 tx=0x7fc004009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:50.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:50.816+0000 7fbffb7fe700 1 -- 172.21.15.115:0/3499746671 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc00804c950 con 0x7fc01414ae00 2023-07-27T14:29:51.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.025+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000716080", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0140afca0 con 0x7fc00005efa0 2023-07-27T14:29:51.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.605+0000 7fbffb7fe700 1 -- 172.21.15.115:0/3499746671 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fc0140afca0 con 0x7fc00005efa0 2023-07-27T14:29:51.631 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:29:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:29:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "canceled", 2023-07-27T14:29:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:29:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:29:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000242766", 2023-07-27T14:29:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000417357" 2023-07-27T14:29:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:29:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "failure": { 2023-07-27T14:29:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "errno": "4", 2023-07-27T14:29:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "error_msg": "user interrupted clone operation" 2023-07-27T14:29:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:29:51.632 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:29:51.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc00005efa0 msgr2=0x7fc000061460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:51.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc00005efa0 0x7fc000061460 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fc004005750 tx=0x7fc004009040).stop 2023-07-27T14:29:51.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01414ae00 msgr2=0x7fc0140c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:51.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01414ae00 0x7fc0140c9990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fc008009dd0 tx=0x7fc008017000).stop 2023-07-27T14:29:51.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 shutdown_connections 2023-07-27T14:29:51.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc00005efa0 0x7fc000061460 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc01414b1e0 0x7fc0140c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc014063260 0x7fc0140a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 --2- 172.21.15.115:0/3499746671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc01414ae00 0x7fc0140c9990 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 >> 172.21.15.115:0/3499746671 conn(0x7fc01405e940 msgr2=0x7fc0140ab210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:51.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 shutdown_connections 2023-07-27T14:29:51.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.607+0000 7fc01a1ff700 1 -- 172.21.15.115:0/3499746671 wait complete. 2023-07-27T14:29:51.651 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000716080 --force 2023-07-27T14:29:51.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.819+0000 7f2d635ff700 1 Processor -- start 2023-07-27T14:29:51.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.819+0000 7f2d635ff700 1 -- start start 2023-07-27T14:29:51.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d635ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d5c063260 0x7f2d5c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:51.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d635ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c14b1e0 0x7f2d5c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:51.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d635ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c1553f0 con 0x7f2d5c14ae00 2023-07-27T14:29:51.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d635ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c157a50 con 0x7f2d5c063260 2023-07-27T14:29:51.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d635ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c157d10 con 0x7f2d5c14b1e0 2023-07-27T14:29:51.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d60b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d5c063260 0x7f2d5c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:51.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d6139b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2d5c14ae00 0x7f2d5c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59292/0 (socket says 172.21.15.115:59292) 2023-07-27T14:29:51.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d60b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d5c063260 0x7f2d5c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53140/0 (socket says 172.21.15.115:53140) 2023-07-27T14:29:51.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d6139b700 1 -- 172.21.15.115:0/2102461338 learned_addr learned my addr 172.21.15.115:0/2102461338 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:51.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d61b9c700 1 --2- 172.21.15.115:0/2102461338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c14b1e0 0x7f2d5c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:51.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d60b9a700 1 -- 172.21.15.115:0/2102461338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c14b1e0 msgr2=0x7f2d5c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:51.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d60b9a700 1 --2- 172.21.15.115:0/2102461338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c14b1e0 0x7f2d5c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d60b9a700 1 -- 172.21.15.115:0/2102461338 >> v1:172.21.15.115:6789/0 conn(0x7f2d5c14ae00 legacy=0x7f2d5c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:51.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d60b9a700 1 -- 172.21.15.115:0/2102461338 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c157ff0 con 0x7f2d5c063260 2023-07-27T14:29:51.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.821+0000 7f2d53fff700 1 -- 172.21.15.115:0/2102461338 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192450628 0 0) 0x7f2d5c1553f0 con 0x7f2d5c14ae00 2023-07-27T14:29:51.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d60b9a700 1 --2- 172.21.15.115:0/2102461338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c063260 0x7f2d5c154f00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f2d4c009760 tx=0x7f2d4c009060).ready entity=mon.0 client_cookie=a3fe51800b3ac468 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:51.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d53fff700 1 -- 172.21.15.115:0/2102461338 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c00b580 con 0x7f2d5c063260 2023-07-27T14:29:51.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d53fff700 1 -- 172.21.15.115:0/2102461338 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c00b6e0 con 0x7f2d5c063260 2023-07-27T14:29:51.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d53fff700 1 -- 172.21.15.115:0/2102461338 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c00ba60 con 0x7f2d5c063260 2023-07-27T14:29:51.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d635ff700 1 -- 172.21.15.115:0/2102461338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c063260 msgr2=0x7f2d5c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:51.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2102461338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c063260 0x7f2d5c154f00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f2d4c009760 tx=0x7f2d4c009060).stop 2023-07-27T14:29:51.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d635ff700 1 -- 172.21.15.115:0/2102461338 shutdown_connections 2023-07-27T14:29:51.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2102461338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c14b1e0 0x7f2d5c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2102461338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c063260 0x7f2d5c154f00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.822+0000 7f2d635ff700 1 -- 172.21.15.115:0/2102461338 >> 172.21.15.115:0/2102461338 conn(0x7f2d5c05e940 msgr2=0x7f2d5c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:51.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.823+0000 7f2d635ff700 1 -- 172.21.15.115:0/2102461338 shutdown_connections 2023-07-27T14:29:51.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.823+0000 7f2d635ff700 1 -- 172.21.15.115:0/2102461338 wait complete. 2023-07-27T14:29:51.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.825+0000 7f2d635ff700 1 Processor -- start 2023-07-27T14:29:51.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.825+0000 7f2d635ff700 1 -- start start 2023-07-27T14:29:51.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d635ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c063260 0x7f2d5c0a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:51.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d635ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c14ae00 0x7f2d5c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:51.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d635ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d5c14b1e0 0x7f2d5c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:51.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d635ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c0b0b90 con 0x7f2d5c14ae00 2023-07-27T14:29:51.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d635ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c0c8010 con 0x7f2d5c14b1e0 2023-07-27T14:29:51.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d635ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c0ae8a0 con 0x7f2d5c063260 2023-07-27T14:29:51.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d60b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c14ae00 0x7f2d5c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:51.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d60b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c14ae00 0x7f2d5c0c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53154/0 (socket says 172.21.15.115:53154) 2023-07-27T14:29:51.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d60b9a700 1 -- 172.21.15.115:0/2557395352 learned_addr learned my addr 172.21.15.115:0/2557395352 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:51.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d6139b700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c063260 0x7f2d5c0a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:51.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.826+0000 7f2d61b9c700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d5c14b1e0 0x7f2d5c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:51.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d60b9a700 1 -- 172.21.15.115:0/2557395352 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c063260 msgr2=0x7f2d5c0a8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:51.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d60b9a700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c063260 0x7f2d5c0a8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d60b9a700 1 -- 172.21.15.115:0/2557395352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d5c14b1e0 msgr2=0x7f2d5c0c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:51.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d60b9a700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d5c14b1e0 0x7f2d5c0c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:51.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d60b9a700 1 -- 172.21.15.115:0/2557395352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0092a0 con 0x7f2d5c14ae00 2023-07-27T14:29:51.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d60b9a700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c14ae00 0x7f2d5c0c7630 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f2d5c0c53b0 tx=0x7f2d4c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:51.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d517fa700 1 -- 172.21.15.115:0/2557395352 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c000bc0 con 0x7f2d5c14ae00 2023-07-27T14:29:51.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d517fa700 1 -- 172.21.15.115:0/2557395352 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c00b850 con 0x7f2d5c14ae00 2023-07-27T14:29:51.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c0adc90 con 0x7f2d5c14ae00 2023-07-27T14:29:51.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d517fa700 1 -- 172.21.15.115:0/2557395352 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c000d20 con 0x7f2d5c14ae00 2023-07-27T14:29:51.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.827+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c0ae250 con 0x7f2d5c14ae00 2023-07-27T14:29:51.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.828+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c0aea10 con 0x7f2d5c14ae00 2023-07-27T14:29:51.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.829+0000 7f2d517fa700 1 -- 172.21.15.115:0/2557395352 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7f2d4c00f070 con 0x7f2d5c14ae00 2023-07-27T14:29:51.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.831+0000 7f2d517fa700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d4005efd0 0x7f2d40061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:51.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.831+0000 7f2d517fa700 1 -- 172.21.15.115:0/2557395352 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f2d4c07b5f0 con 0x7f2d5c14ae00 2023-07-27T14:29:51.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.831+0000 7f2d6139b700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d4005efd0 0x7f2d40061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:51.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.831+0000 7f2d6139b700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d4005efd0 0x7f2d40061490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f2d580011e0 tx=0x7f2d58007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:51.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:51.835+0000 7f2d517fa700 1 -- 172.21.15.115:0/2557395352 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d4c04c9e0 con 0x7f2d5c14ae00 2023-07-27T14:29:52.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.032+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000716080", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f2d5c06c470 con 0x7f2d4005efd0 2023-07-27T14:29:52.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.045+0000 7f2d517fa700 1 -- 172.21.15.115:0/2557395352 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2d5c06c470 con 0x7f2d4005efd0 2023-07-27T14:29:52.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d4005efd0 msgr2=0x7f2d40061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d4005efd0 0x7f2d40061490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f2d580011e0 tx=0x7f2d58007bb0).stop 2023-07-27T14:29:52.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c14ae00 msgr2=0x7f2d5c0c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c14ae00 0x7f2d5c0c7630 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f2d5c0c53b0 tx=0x7f2d4c017000).stop 2023-07-27T14:29:52.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 shutdown_connections 2023-07-27T14:29:52.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d4005efd0 0x7f2d40061490 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d5c14b1e0 0x7f2d5c0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d5c063260 0x7f2d5c0a8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 --2- 172.21.15.115:0/2557395352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5c14ae00 0x7f2d5c0c7630 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.047+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 >> 172.21.15.115:0/2557395352 conn(0x7f2d5c05e940 msgr2=0x7f2d5c0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:52.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.048+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 shutdown_connections 2023-07-27T14:29:52.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.048+0000 7f2d635ff700 1 -- 172.21.15.115:0/2557395352 wait complete. 2023-07-27T14:29:52.077 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.052+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.077 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.052+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.077 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.052+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.077 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.052+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.077 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.052+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000242766 snapshot_0000000000417357 2023-07-27T14:29:52.095 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.069+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.095 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.069+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.095 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.069+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.095 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.069+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.096 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:29:52.069+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:29:52.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.291+0000 7f894e1ff700 1 Processor -- start 2023-07-27T14:29:52.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.292+0000 7f894e1ff700 1 -- start start 2023-07-27T14:29:52.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.293+0000 7f894e1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8948063220 0x7f894815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.293+0000 7f894e1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8948154f60 con 0x7f8948151d20 2023-07-27T14:29:52.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.293+0000 7f894e1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89480cb780 con 0x7f89481553f0 2023-07-27T14:29:52.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.293+0000 7f894e1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480cba60 con 0x7f8948063220 2023-07-27T14:29:52.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.293+0000 7f89477fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8948151d20 0x7f89480c5100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59306/0 (socket says 172.21.15.115:59306) 2023-07-27T14:29:52.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.293+0000 7f8947fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8948063220 0x7f894815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.293+0000 7f89477fe700 1 -- 172.21.15.115:0/3810371164 learned_addr learned my addr 172.21.15.115:0/3810371164 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:52.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.293+0000 7f8947fff700 1 -- 172.21.15.115:0/3810371164 >> v1:172.21.15.159:6789/0 conn(0x7f89481553f0 legacy=0x7f8948062b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f8947fff700 1 -- 172.21.15.115:0/3810371164 >> v1:172.21.15.115:6789/0 conn(0x7f8948151d20 legacy=0x7f89480c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f8947fff700 1 -- 172.21.15.115:0/3810371164 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948154910 con 0x7f8948063220 2023-07-27T14:29:52.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f89467fc700 1 -- 172.21.15.115:0/3810371164 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358994076 0 0) 0x7f8948154f60 con 0x7f8948151d20 2023-07-27T14:29:52.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f8947fff700 1 --2- 172.21.15.115:0/3810371164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f894815ed30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f8940009e60 tx=0x7f8940009780).ready entity=mon.0 client_cookie=577d73f9fc9dd49b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:52.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f89467fc700 1 -- 172.21.15.115:0/3810371164 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894000e070 con 0x7f8948063220 2023-07-27T14:29:52.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f89467fc700 1 -- 172.21.15.115:0/3810371164 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894000bc30 con 0x7f8948063220 2023-07-27T14:29:52.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f89467fc700 1 -- 172.21.15.115:0/3810371164 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940012410 con 0x7f8948063220 2023-07-27T14:29:52.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f894e1ff700 1 -- 172.21.15.115:0/3810371164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 msgr2=0x7f894815ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f894e1ff700 1 --2- 172.21.15.115:0/3810371164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f894815ed30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f8940009e60 tx=0x7f8940009780).stop 2023-07-27T14:29:52.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f894e1ff700 1 -- 172.21.15.115:0/3810371164 shutdown_connections 2023-07-27T14:29:52.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f894e1ff700 1 --2- 172.21.15.115:0/3810371164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f894815ed30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.294+0000 7f894e1ff700 1 -- 172.21.15.115:0/3810371164 >> 172.21.15.115:0/3810371164 conn(0x7f894805e940 msgr2=0x7f89480cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:52.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.295+0000 7f894e1ff700 1 -- 172.21.15.115:0/3810371164 shutdown_connections 2023-07-27T14:29:52.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.295+0000 7f894e1ff700 1 -- 172.21.15.115:0/3810371164 wait complete. 2023-07-27T14:29:52.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.296+0000 7f894e1ff700 1 Processor -- start 2023-07-27T14:29:52.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.296+0000 7f894e1ff700 1 -- start start 2023-07-27T14:29:52.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f894e1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f89481580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f894e1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8948151d20 0x7f8948164380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f894e1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89481553f0 0x7f8948164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f894e1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948159ad0 con 0x7f8948063220 2023-07-27T14:29:52.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f894e1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948158a30 con 0x7f8948151d20 2023-07-27T14:29:52.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f894e1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8948158d10 con 0x7f89481553f0 2023-07-27T14:29:52.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f89477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f89481580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f89477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f89481580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53204/0 (socket says 172.21.15.115:53204) 2023-07-27T14:29:52.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f89477fe700 1 -- 172.21.15.115:0/25858319 learned_addr learned my addr 172.21.15.115:0/25858319 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:52.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f8947fff700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89481553f0 0x7f8948164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.297+0000 7f8946ffd700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8948151d20 0x7f8948164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f89477fe700 1 -- 172.21.15.115:0/25858319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89481553f0 msgr2=0x7f8948164870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f89477fe700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89481553f0 0x7f8948164870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f89477fe700 1 -- 172.21.15.115:0/25858319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8948151d20 msgr2=0x7f8948164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f89477fe700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8948151d20 0x7f8948164380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f89477fe700 1 -- 172.21.15.115:0/25858319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940009a20 con 0x7f8948063220 2023-07-27T14:29:52.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f89477fe700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f89481580c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f893800c4c0 tx=0x7f8938007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:52.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f892f7fe700 1 -- 172.21.15.115:0/25858319 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800ce30 con 0x7f8948063220 2023-07-27T14:29:52.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f892f7fe700 1 -- 172.21.15.115:0/25858319 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89380072e0 con 0x7f8948063220 2023-07-27T14:29:52.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8948158ff0 con 0x7f8948063220 2023-07-27T14:29:52.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f892f7fe700 1 -- 172.21.15.115:0/25858319 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380057a0 con 0x7f8948063220 2023-07-27T14:29:52.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.298+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89481595b0 con 0x7f8948063220 2023-07-27T14:29:52.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.299+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8948060610 con 0x7f8948063220 2023-07-27T14:29:52.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.300+0000 7f892f7fe700 1 -- 172.21.15.115:0/25858319 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7f8938010070 con 0x7f8948063220 2023-07-27T14:29:52.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.301+0000 7f892f7fe700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f893405efd0 0x7f8934061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.301+0000 7f892f7fe700 1 -- 172.21.15.115:0/25858319 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f8938079480 con 0x7f8948063220 2023-07-27T14:29:52.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.301+0000 7f8946ffd700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f893405efd0 0x7f8934061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.302+0000 7f8946ffd700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f893405efd0 0x7f8934061490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f8948155850 tx=0x7f893c007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:52.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.305+0000 7f892f7fe700 1 -- 172.21.15.115:0/25858319 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f893804a770 con 0x7f8948063220 2023-07-27T14:29:52.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.509+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000242766", "snap_name": "snapshot_0000000000417357", "target": ["mon-mgr", ""]}) v1 -- 0x7f89480aa3c0 con 0x7f893405efd0 2023-07-27T14:29:52.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.540+0000 7f892f7fe700 1 -- 172.21.15.115:0/25858319 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f89480aa3c0 con 0x7f893405efd0 2023-07-27T14:29:52.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f893405efd0 msgr2=0x7f8934061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f893405efd0 0x7f8934061490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f8948155850 tx=0x7f893c007d40).stop 2023-07-27T14:29:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 msgr2=0x7f89481580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f89481580c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f893800c4c0 tx=0x7f8938007c10).stop 2023-07-27T14:29:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 shutdown_connections 2023-07-27T14:29:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f893405efd0 0x7f8934061490 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89481553f0 0x7f8948164870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8948063220 0x7f89481580c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 --2- 172.21.15.115:0/25858319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8948151d20 0x7f8948164380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 >> 172.21.15.115:0/25858319 conn(0x7f894805e940 msgr2=0x7f89480c0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:52.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 shutdown_connections 2023-07-27T14:29:52.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.543+0000 7f894e1ff700 1 -- 172.21.15.115:0/25858319 wait complete. 2023-07-27T14:29:52.585 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000242766 2023-07-27T14:29:52.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.753+0000 7f11d31ff700 1 Processor -- start 2023-07-27T14:29:52.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.753+0000 7f11d31ff700 1 -- start start 2023-07-27T14:29:52.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d31ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f11cc14ae00 0x7f11cc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d31ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc063260 0x7f11cc0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d31ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11cc1553f0 con 0x7f11cc14b1e0 2023-07-27T14:29:52.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d31ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11cc157a50 con 0x7f11cc14ae00 2023-07-27T14:29:52.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d31ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc157d10 con 0x7f11cc063260 2023-07-27T14:29:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d0f9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f11cc14ae00 0x7f11cc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d179c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc063260 0x7f11cc0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d0f9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f11cc14ae00 0x7f11cc154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:37802/0 (socket says 172.21.15.115:37802) 2023-07-27T14:29:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d0f9b700 1 -- 172.21.15.115:0/2603186402 learned_addr learned my addr 172.21.15.115:0/2603186402 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.755+0000 7f11d179c700 1 --2- 172.21.15.115:0/2603186402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc063260 0x7f11cc0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:37526/0 (socket says 172.21.15.115:37526) 2023-07-27T14:29:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11d0f9b700 1 -- 172.21.15.115:0/2603186402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc063260 msgr2=0x7f11cc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11cb7fe700 1 -- 172.21.15.115:0/2603186402 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945856887 0 0) 0x7f11cc1553f0 con 0x7f11cc14b1e0 2023-07-27T14:29:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11d0f9b700 1 --2- 172.21.15.115:0/2603186402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc063260 0x7f11cc0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11d0f9b700 1 -- 172.21.15.115:0/2603186402 >> v1:172.21.15.159:6789/0 conn(0x7f11cc14b1e0 legacy=0x7f11cc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11d0f9b700 1 -- 172.21.15.115:0/2603186402 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc157ff0 con 0x7f11cc14ae00 2023-07-27T14:29:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11d0f9b700 1 --2- 172.21.15.115:0/2603186402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc14ae00 0x7f11cc154f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f11c0006fd0 tx=0x7f11c00090f0).ready entity=mon.1 client_cookie=2d0ce1c19d3ff7f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:52.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11cb7fe700 1 -- 172.21.15.115:0/2603186402 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c000b580 con 0x7f11cc14ae00 2023-07-27T14:29:52.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11cb7fe700 1 -- 172.21.15.115:0/2603186402 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c000b6e0 con 0x7f11cc14ae00 2023-07-27T14:29:52.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.756+0000 7f11cb7fe700 1 -- 172.21.15.115:0/2603186402 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c000ba60 con 0x7f11cc14ae00 2023-07-27T14:29:52.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.757+0000 7f11d31ff700 1 -- 172.21.15.115:0/2603186402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc14ae00 msgr2=0x7f11cc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.757+0000 7f11d31ff700 1 --2- 172.21.15.115:0/2603186402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc14ae00 0x7f11cc154f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f11c0006fd0 tx=0x7f11c00090f0).stop 2023-07-27T14:29:52.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.757+0000 7f11d31ff700 1 -- 172.21.15.115:0/2603186402 shutdown_connections 2023-07-27T14:29:52.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.757+0000 7f11d31ff700 1 --2- 172.21.15.115:0/2603186402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc063260 0x7f11cc0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.757+0000 7f11d31ff700 1 --2- 172.21.15.115:0/2603186402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc14ae00 0x7f11cc154f00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.757+0000 7f11d31ff700 1 -- 172.21.15.115:0/2603186402 >> 172.21.15.115:0/2603186402 conn(0x7f11cc05e940 msgr2=0x7f11cc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:52.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.757+0000 7f11d31ff700 1 -- 172.21.15.115:0/2603186402 shutdown_connections 2023-07-27T14:29:52.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.757+0000 7f11d31ff700 1 -- 172.21.15.115:0/2603186402 wait complete. 2023-07-27T14:29:52.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.758+0000 7f11d31ff700 1 Processor -- start 2023-07-27T14:29:52.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.758+0000 7f11d31ff700 1 -- start start 2023-07-27T14:29:52.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.759+0000 7f11d31ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc063260 0x7f11cc1674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.759+0000 7f11d31ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc14ae00 0x7f11cc149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.759+0000 7f11d31ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11cc14b1e0 0x7f11cc164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.759+0000 7f11d31ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc168410 con 0x7f11cc14b1e0 2023-07-27T14:29:52.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.759+0000 7f11d31ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc149760 con 0x7f11cc063260 2023-07-27T14:29:52.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.759+0000 7f11d31ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0afbd0 con 0x7f11cc14ae00 2023-07-27T14:29:52.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11cc14b1e0 0x7f11cc164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11cc14b1e0 0x7f11cc164940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:53210/0 (socket says 172.21.15.115:53210) 2023-07-27T14:29:52.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 -- 172.21.15.115:0/3155206963 learned_addr learned my addr 172.21.15.115:0/3155206963 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:52.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d0f9b700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc063260 0x7f11cc1674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11cbfff700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc14ae00 0x7f11cc149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 -- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc14ae00 msgr2=0x7f11cc149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc14ae00 0x7f11cc149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 -- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc063260 msgr2=0x7f11cc1674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:52.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc063260 0x7f11cc1674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:52.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 -- 172.21.15.115:0/3155206963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0009370 con 0x7f11cc14b1e0 2023-07-27T14:29:52.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11cbfff700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc14ae00 0x7f11cc149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:52.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11d179c700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11cc14b1e0 0x7f11cc164940 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f11c4009d70 tx=0x7f11c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:52.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.760+0000 7f11c8ff9700 1 -- 172.21.15.115:0/3155206963 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c400cb50 con 0x7f11cc14b1e0 2023-07-27T14:29:52.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.761+0000 7f11c8ff9700 1 -- 172.21.15.115:0/3155206963 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c400f040 con 0x7f11cc14b1e0 2023-07-27T14:29:52.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.761+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc164e30 con 0x7f11cc14b1e0 2023-07-27T14:29:52.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.761+0000 7f11c8ff9700 1 -- 172.21.15.115:0/3155206963 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4013400 con 0x7f11cc14b1e0 2023-07-27T14:29:52.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.761+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc167e50 con 0x7f11cc14b1e0 2023-07-27T14:29:52.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.762+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc0af9a0 con 0x7f11cc14b1e0 2023-07-27T14:29:52.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.762+0000 7f11c8ff9700 1 -- 172.21.15.115:0/3155206963 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 75562+0+0 (secure 0 0 0) 0x7f11c40137b0 con 0x7f11cc14b1e0 2023-07-27T14:29:52.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.763+0000 7f11c8ff9700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f11b005efd0 0x7f11b0061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:52.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.764+0000 7f11c8ff9700 1 -- 172.21.15.115:0/3155206963 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f11c407a8b0 con 0x7f11cc14b1e0 2023-07-27T14:29:52.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.764+0000 7f11d0f9b700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f11b005efd0 0x7f11b0061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:52.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.764+0000 7f11d0f9b700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f11b005efd0 0x7f11b0061490 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f11c0009130 tx=0x7f11c0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:52.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.767+0000 7f11c8ff9700 1 -- 172.21.15.115:0/3155206963 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11cc0af9a0 con 0x7f11cc14b1e0 2023-07-27T14:29:52.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.965+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000242766", "target": ["mon-mgr", ""]}) v1 -- 0x7f11cc0af9a0 con 0x7f11b005efd0 2023-07-27T14:29:53.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.981+0000 7f11c8ff9700 1 -- 172.21.15.115:0/3155206963 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f11cc0af9a0 con 0x7f11b005efd0 2023-07-27T14:29:53.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f11b005efd0 msgr2=0x7f11b0061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:53.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f11b005efd0 0x7f11b0061490 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f11c0009130 tx=0x7f11c0017000).stop 2023-07-27T14:29:53.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11cc14b1e0 msgr2=0x7f11cc164940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:53.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11cc14b1e0 0x7f11cc164940 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f11c4009d70 tx=0x7f11c400b040).stop 2023-07-27T14:29:53.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 shutdown_connections 2023-07-27T14:29:53.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f11b005efd0 0x7f11b0061490 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:53.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11cc14b1e0 0x7f11cc164940 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:53.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11cc063260 0x7f11cc1674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:53.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 --2- 172.21.15.115:0/3155206963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11cc14ae00 0x7f11cc149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:53.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 >> 172.21.15.115:0/3155206963 conn(0x7f11cc05e940 msgr2=0x7f11cc0a9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:53.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 shutdown_connections 2023-07-27T14:29:53.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:52.983+0000 7f11d31ff700 1 -- 172.21.15.115:0/3155206963 wait complete. 2023-07-27T14:29:53.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:53.029 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:29:53.128 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-07-27T14:29:58.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:58.130 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:29:58.225 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:29:58.226 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:29:58.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:29:58.323 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:29:58.445 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:29:58.446 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:29:58.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:58.446 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:29:58.567 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:29:58.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:58.568 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:29:58.622 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:29:58.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:29:58.623 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:29:58.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:29:58.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:29:58.716 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:29:58.764 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:29:58.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.926+0000 7fe7ed9ff700 1 Processor -- start 2023-07-27T14:29:58.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.926+0000 7fe7ed9ff700 1 -- start start 2023-07-27T14:29:58.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.927+0000 7fe7ed9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe7e80bc450 0x7fe7e80a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:58.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.927+0000 7fe7ed9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e80c2ed0 con 0x7fe7e8154060 2023-07-27T14:29:58.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.927+0000 7fe7ed9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e80a58d0 con 0x7fe7e8154440 2023-07-27T14:29:58.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.927+0000 7fe7ed9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e80a5bb0 con 0x7fe7e80bc450 2023-07-27T14:29:58.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe7e8154060 0x7fe7e80bbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55004/0 (socket says 172.21.15.115:55004) 2023-07-27T14:29:58.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e6ffd700 1 -- 172.21.15.115:0/37157426 learned_addr learned my addr 172.21.15.115:0/37157426 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:58.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e67fc700 1 --2- 172.21.15.115:0/37157426 >> v2:172.21.15.159:3300/0 conn(0x7fe7e80bc450 0x7fe7e80a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:58.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261993371 0 0) 0x7fe7e80c2ed0 con 0x7fe7e8154060 2023-07-27T14:29:58.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7d00033f0 con 0x7fe7e8154060 2023-07-27T14:29:58.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894837414 0 0) 0x7fe7d00033f0 con 0x7fe7e8154060 2023-07-27T14:29:58.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 >> v2:172.21.15.159:3300/0 conn(0x7fe7e80bc450 msgr2=0x7fe7e80a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:58.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 --2- 172.21.15.115:0/37157426 >> v2:172.21.15.159:3300/0 conn(0x7fe7e80bc450 0x7fe7e80a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:58.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 >> v1:172.21.15.159:6789/0 conn(0x7fe7e8154440 legacy=0x7fe7e80c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:58.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e80a5e90 con 0x7fe7e8154060 2023-07-27T14:29:58.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fe7d8001470 con 0x7fe7e8154060 2023-07-27T14:29:58.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 >> v1:172.21.15.115:6789/0 conn(0x7fe7e8154060 legacy=0x7fe7e80bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:58.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d00038e0 0x7fe7d0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:58.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d0004690 0x7fe7d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:58.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0005000 0x7fe7d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:58.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e80a5bb0 con 0x7fe7d0004690 2023-07-27T14:29:58.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d000bf60 con 0x7fe7d00038e0 2023-07-27T14:29:58.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.928+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d000c0f0 con 0x7fe7d0005000 2023-07-27T14:29:58.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e67fc700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d0004690 0x7fe7d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:58.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e6ffd700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d00038e0 0x7fe7d0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:58.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e77fe700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0005000 0x7fe7d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:58.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e67fc700 1 -- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0005000 msgr2=0x7fe7d000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:58.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e67fc700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0005000 0x7fe7d000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:58.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e67fc700 1 -- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d00038e0 msgr2=0x7fe7d0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:58.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e67fc700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7d00038e0 0x7fe7d0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:58.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e67fc700 1 -- 172.21.15.115:0/37157426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00033f0 con 0x7fe7d0004690 2023-07-27T14:29:58.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e77fe700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0005000 0x7fe7d000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:58.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e77fe700 1 -- 172.21.15.115:0/37157426 reap_dead start 2023-07-27T14:29:58.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e67fc700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d0004690 0x7fe7d0004b10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fe7e80bdb20 tx=0x7fe7dc009060).ready entity=mon.0 client_cookie=35de4ff4552df4bb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:58.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc009e90 con 0x7fe7d0004690 2023-07-27T14:29:58.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc009430 con 0x7fe7d0004690 2023-07-27T14:29:58.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.929+0000 7fe7e5ffb700 1 -- 172.21.15.115:0/37157426 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc00e820 con 0x7fe7d0004690 2023-07-27T14:29:58.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.930+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/37157426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d0004690 msgr2=0x7fe7d0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:58.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.930+0000 7fe7ed9ff700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d0004690 0x7fe7d0004b10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fe7e80bdb20 tx=0x7fe7dc009060).stop 2023-07-27T14:29:58.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.930+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/37157426 shutdown_connections 2023-07-27T14:29:58.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.930+0000 7fe7ed9ff700 1 --2- 172.21.15.115:0/37157426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d0004690 0x7fe7d0004b10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:58.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.930+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/37157426 >> 172.21.15.115:0/37157426 conn(0x7fe7e8062320 msgr2=0x7fe7e8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:58.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.930+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/37157426 shutdown_connections 2023-07-27T14:29:58.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.930+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/37157426 wait complete. 2023-07-27T14:29:58.962 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:29:58.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.932+0000 7fe7ed9ff700 1 Processor -- start 2023-07-27T14:29:58.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.932+0000 7fe7ed9ff700 1 -- start start 2023-07-27T14:29:58.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.933+0000 7fe7ed9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0004690 0x7fe7e80a6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:58.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.933+0000 7fe7ed9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7e81373d0 0x7fe7e8137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:58.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7ed9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7e8145720 0x7fe7e8145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:58.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7ed9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8138100 con 0x7fe7e8145720 2023-07-27T14:29:58.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7ed9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e813a2c0 con 0x7fe7e81373d0 2023-07-27T14:29:58.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7ed9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8152890 con 0x7fe7d0004690 2023-07-27T14:29:58.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7e8145720 0x7fe7e8145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:58.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7e8145720 0x7fe7e8145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52108/0 (socket says 172.21.15.115:52108) 2023-07-27T14:29:58.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 -- 172.21.15.115:0/94962181 learned_addr learned my addr 172.21.15.115:0/94962181 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:58.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e67fc700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7e81373d0 0x7fe7e8137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:58.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e6ffd700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0004690 0x7fe7e80a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:58.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 -- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0004690 msgr2=0x7fe7e80a6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:58.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0004690 0x7fe7e80a6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:58.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 -- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7e81373d0 msgr2=0x7fe7e8137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:58.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7e81373d0 0x7fe7e8137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:58.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 -- 172.21.15.115:0/94962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8151cd0 con 0x7fe7e8145720 2023-07-27T14:29:58.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e67fc700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7e81373d0 0x7fe7e8137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:29:58.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.934+0000 7fe7e77fe700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7e8145720 0x7fe7e8145b80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fe7e8067c30 tx=0x7fe7e0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:58.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.935+0000 7fe7ceffd700 1 -- 172.21.15.115:0/94962181 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0002490 con 0x7fe7e8145720 2023-07-27T14:29:58.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.935+0000 7fe7ceffd700 1 -- 172.21.15.115:0/94962181 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e00025f0 con 0x7fe7e8145720 2023-07-27T14:29:58.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.935+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e8152d20 con 0x7fe7e8145720 2023-07-27T14:29:58.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.935+0000 7fe7ceffd700 1 -- 172.21.15.115:0/94962181 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0002990 con 0x7fe7e8145720 2023-07-27T14:29:58.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.935+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e8152240 con 0x7fe7e8145720 2023-07-27T14:29:58.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.936+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e8152a20 con 0x7fe7e8145720 2023-07-27T14:29:58.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.937+0000 7fe7ceffd700 1 -- 172.21.15.115:0/94962181 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fe7e0014430 con 0x7fe7e8145720 2023-07-27T14:29:58.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.938+0000 7fe7ceffd700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe7d405f030 0x7fe7d40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:58.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.938+0000 7fe7ceffd700 1 -- 172.21.15.115:0/94962181 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe7e0079c70 con 0x7fe7e8145720 2023-07-27T14:29:58.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.938+0000 7fe7e6ffd700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe7d405f030 0x7fe7d40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:58.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.938+0000 7fe7e6ffd700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe7d405f030 0x7fe7d40614f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fe7d8001050 tx=0x7fe7d8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:58.970 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:29:58.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:58.942+0000 7fe7ceffd700 1 -- 172.21.15.115:0/94962181 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7e00498f0 con 0x7fe7e8145720 2023-07-27T14:29:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.165+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7e806c470 con 0x7fe7e8145720 2023-07-27T14:29:59.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.165+0000 7fe7ceffd700 1 -- 172.21.15.115:0/94962181 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fe7e004ae30 con 0x7fe7e8145720 2023-07-27T14:29:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:59.193 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1259074753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1259074753},{"type":"v1","addr":"172.21.15.115:6837","nonce":1259074753}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1004586884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1004586884},{"type":"v1","addr":"172.21.15.159:6834","nonce":1004586884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2086004294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2086004294},{"type":"v1","addr":"172.21.15.159:6835","nonce":2086004294}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:29:15.154553+0000","modified":"2023-07-27T14:29:18.168905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1707534394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1707534394},{"type":"v1","addr":"172.21.15.115:6836","nonce":1707534394}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-07-27T14:29:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe7d405f030 msgr2=0x7fe7d40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe7d405f030 0x7fe7d40614f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fe7d8001050 tx=0x7fe7d8009040).stop 2023-07-27T14:29:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7e8145720 msgr2=0x7fe7e8145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7e8145720 0x7fe7e8145b80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fe7e8067c30 tx=0x7fe7e0009040).stop 2023-07-27T14:29:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 shutdown_connections 2023-07-27T14:29:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe7d405f030 0x7fe7d40614f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7e8145720 0x7fe7e8145b80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7d0004690 0x7fe7e80a6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 --2- 172.21.15.115:0/94962181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7e81373d0 0x7fe7e8137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.167+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 >> 172.21.15.115:0/94962181 conn(0x7fe7e8062320 msgr2=0x7fe7e8146890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:59.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.168+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 shutdown_connections 2023-07-27T14:29:59.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.168+0000 7fe7ed9ff700 1 -- 172.21.15.115:0/94962181 wait complete. 2023-07-27T14:29:59.196 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 26 2023-07-27T14:29:59.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:29:59.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.371+0000 7fbc0f7ff700 1 Processor -- start 2023-07-27T14:29:59.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.371+0000 7fbc0f7ff700 1 -- start start 2023-07-27T14:29:59.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0f7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc08151d70 0x7fbc08155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0f7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbc08065ff0 0x7fbc08066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0f7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 0x7fbc08157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0f7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc08063a90 con 0x7fbc08151d70 2023-07-27T14:29:59.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0f7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc08067080 con 0x7fbc08065ff0 2023-07-27T14:29:59.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0f7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08066df0 con 0x7fbc08066960 2023-07-27T14:29:59.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0d59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc08151d70 0x7fbc08155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0d59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc08151d70 0x7fbc08155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52122/0 (socket says 172.21.15.115:52122) 2023-07-27T14:29:59.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0d59b700 1 -- 172.21.15.115:0/3274432511 learned_addr learned my addr 172.21.15.115:0/3274432511 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:59.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0cd9a700 1 --2- 172.21.15.115:0/3274432511 >> v2:172.21.15.159:3300/0 conn(0x7fbc08065ff0 0x7fbc08066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0dd9c700 1 --2- 172.21.15.115:0/3274432511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 0x7fbc08157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0d59b700 1 -- 172.21.15.115:0/3274432511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 msgr2=0x7fbc08157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:59.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0d59b700 1 --2- 172.21.15.115:0/3274432511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 0x7fbc08157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0d59b700 1 -- 172.21.15.115:0/3274432511 >> v2:172.21.15.159:3300/0 conn(0x7fbc08065ff0 msgr2=0x7fbc08066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:59.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0d59b700 1 --2- 172.21.15.115:0/3274432511 >> v2:172.21.15.159:3300/0 conn(0x7fbc08065ff0 0x7fbc08066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0d59b700 1 -- 172.21.15.115:0/3274432511 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc080634d0 con 0x7fbc08151d70 2023-07-27T14:29:59.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.373+0000 7fbc0cd9a700 1 --2- 172.21.15.115:0/3274432511 >> v2:172.21.15.159:3300/0 conn(0x7fbc08065ff0 0x7fbc08066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:59.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0d59b700 1 --2- 172.21.15.115:0/3274432511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08151d70 0x7fbc08155060 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fbc080c6450 tx=0x7fbc040090f0).ready entity=mon.0 client_cookie=65c49acc060cd39a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:59.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbbfffff700 1 -- 172.21.15.115:0/3274432511 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400b600 con 0x7fbc08151d70 2023-07-27T14:29:59.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbbfffff700 1 -- 172.21.15.115:0/3274432511 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0400b760 con 0x7fbc08151d70 2023-07-27T14:29:59.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbbfffff700 1 -- 172.21.15.115:0/3274432511 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400bae0 con 0x7fbc08151d70 2023-07-27T14:29:59.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/3274432511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08151d70 msgr2=0x7fbc08155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/3274432511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08151d70 0x7fbc08155060 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fbc080c6450 tx=0x7fbc040090f0).stop 2023-07-27T14:29:59.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/3274432511 shutdown_connections 2023-07-27T14:29:59.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/3274432511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 0x7fbc08157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/3274432511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08151d70 0x7fbc08155060 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/3274432511 >> v2:172.21.15.159:3300/0 conn(0x7fbc08065ff0 0x7fbc08066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/3274432511 >> 172.21.15.115:0/3274432511 conn(0x7fbc080c89a0 msgr2=0x7fbc080c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:59.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.374+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/3274432511 shutdown_connections 2023-07-27T14:29:59.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.375+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/3274432511 wait complete. 2023-07-27T14:29:59.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.376+0000 7fbc0f7ff700 1 Processor -- start 2023-07-27T14:29:59.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.376+0000 7fbc0f7ff700 1 -- start start 2023-07-27T14:29:59.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0f7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08065ff0 0x7fbc080a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0f7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 0x7fbc0814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0f7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc08151d70 0x7fbc08167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0f7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc080ad8d0 con 0x7fbc08065ff0 2023-07-27T14:29:59.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0f7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08168420 con 0x7fbc08151d70 2023-07-27T14:29:59.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0f7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08168700 con 0x7fbc08066960 2023-07-27T14:29:59.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0d59b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08065ff0 0x7fbc080a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0d59b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08065ff0 0x7fbc080a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52126/0 (socket says 172.21.15.115:52126) 2023-07-27T14:29:59.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0d59b700 1 -- 172.21.15.115:0/1818904600 learned_addr learned my addr 172.21.15.115:0/1818904600 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:59.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0cd9a700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 0x7fbc0814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.377+0000 7fbc0dd9c700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc08151d70 0x7fbc08167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbc0d59b700 1 -- 172.21.15.115:0/1818904600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 msgr2=0x7fbc0814ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbc0d59b700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 0x7fbc0814ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbc0d59b700 1 -- 172.21.15.115:0/1818904600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc08151d70 msgr2=0x7fbc08167960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbc0d59b700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc08151d70 0x7fbc08167960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbc0d59b700 1 -- 172.21.15.115:0/1818904600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009370 con 0x7fbc08065ff0 2023-07-27T14:29:59.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbc0d59b700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08065ff0 0x7fbc080a4840 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fbc04006fd0 tx=0x7fbc04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:59.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbbfd7fa700 1 -- 172.21.15.115:0/1818904600 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400bea0 con 0x7fbc08065ff0 2023-07-27T14:29:59.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbbfd7fa700 1 -- 172.21.15.115:0/1818904600 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0400b8d0 con 0x7fbc08065ff0 2023-07-27T14:29:59.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc080ad560 con 0x7fbc08065ff0 2023-07-27T14:29:59.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbbfd7fa700 1 -- 172.21.15.115:0/1818904600 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0401b660 con 0x7fbc08065ff0 2023-07-27T14:29:59.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.378+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0814f350 con 0x7fbc08065ff0 2023-07-27T14:29:59.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.379+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc080adbb0 con 0x7fbc08065ff0 2023-07-27T14:29:59.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.380+0000 7fbbfd7fa700 1 -- 172.21.15.115:0/1818904600 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fbc0400f070 con 0x7fbc08065ff0 2023-07-27T14:29:59.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.381+0000 7fbbfd7fa700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbbec05f060 0x7fbbec061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.382+0000 7fbbfd7fa700 1 -- 172.21.15.115:0/1818904600 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fbc0407b500 con 0x7fbc08065ff0 2023-07-27T14:29:59.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.382+0000 7fbc0cd9a700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbbec05f060 0x7fbbec061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.382+0000 7fbc0cd9a700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbbec05f060 0x7fbbec061520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fbc080c4ee0 tx=0x7fbbf8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:59.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.385+0000 7fbbfd7fa700 1 -- 172.21.15.115:0/1818904600 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc0404c900 con 0x7fbc08065ff0 2023-07-27T14:29:59.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.557+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc0806c470 con 0x7fbc08065ff0 2023-07-27T14:29:59.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.558+0000 7fbbfd7fa700 1 -- 172.21.15.115:0/1818904600 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17370 (secure 0 0 0) 0x7fbc0404ff20 con 0x7fbc08065ff0 2023-07-27T14:29:59.585 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:29:59.585 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":55,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:29:55.689341+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:29:13.551102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-27T14:29:14.136450+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:29:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbbec05f060 msgr2=0x7fbbec061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbbec05f060 0x7fbbec061520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fbc080c4ee0 tx=0x7fbbf8008040).stop 2023-07-27T14:29:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08065ff0 msgr2=0x7fbc080a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08065ff0 0x7fbc080a4840 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fbc04006fd0 tx=0x7fbc04017000).stop 2023-07-27T14:29:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 shutdown_connections 2023-07-27T14:29:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbbec05f060 0x7fbbec061520 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc08151d70 0x7fbc08167960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc08065ff0 0x7fbc080a4840 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 --2- 172.21.15.115:0/1818904600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc08066960 0x7fbc0814ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 >> 172.21.15.115:0/1818904600 conn(0x7fbc080c89a0 msgr2=0x7fbc081532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 shutdown_connections 2023-07-27T14:29:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.560+0000 7fbc0f7ff700 1 -- 172.21.15.115:0/1818904600 wait complete. 2023-07-27T14:29:59.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:29:13.551102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:29:14.136450+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 55, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:29:59.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:29:59.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.772+0000 7fb3c91ff700 1 Processor -- start 2023-07-27T14:29:59.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.772+0000 7fb3c91ff700 1 -- start start 2023-07-27T14:29:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c91ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb3c414b1e0 0x7fb3c4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c91ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c41553f0 con 0x7fb3c40c5c50 2023-07-27T14:29:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c91ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c4157a50 con 0x7fb3c414b1e0 2023-07-27T14:29:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4157d10 con 0x7fb3c414ae00 2023-07-27T14:29:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c359e700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb3c40c5c50 0x7fb3c40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55020/0 (socket says 172.21.15.115:55020) 2023-07-27T14:29:59.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c359e700 1 -- 172.21.15.115:0/4273095489 learned_addr learned my addr 172.21.15.115:0/4273095489 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:29:59.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c259c700 1 --2- 172.21.15.115:0/4273095489 >> v2:172.21.15.159:3300/0 conn(0x7fb3c414b1e0 0x7fb3c4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.773+0000 7fb3c2d9d700 1 --2- 172.21.15.115:0/4273095489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c1d9b700 1 -- 172.21.15.115:0/4273095489 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592409234 0 0) 0x7fb3c41553f0 con 0x7fb3c40c5c50 2023-07-27T14:29:59.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c1d9b700 1 -- 172.21.15.115:0/4273095489 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3ac0033f0 con 0x7fb3c40c5c50 2023-07-27T14:29:59.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c259c700 1 -- 172.21.15.115:0/4273095489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 msgr2=0x7fb3c4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:29:59.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c259c700 1 --2- 172.21.15.115:0/4273095489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c259c700 1 -- 172.21.15.115:0/4273095489 >> v1:172.21.15.115:6789/0 conn(0x7fb3c40c5c50 legacy=0x7fb3c40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c259c700 1 -- 172.21.15.115:0/4273095489 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c4157ff0 con 0x7fb3c414b1e0 2023-07-27T14:29:59.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c259c700 1 --2- 172.21.15.115:0/4273095489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 0x7fb3c4062b50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb3b8009760 tx=0x7fb3b8009060).ready entity=mon.1 client_cookie=553c42bd7993a14e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:59.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c1d9b700 1 -- 172.21.15.115:0/4273095489 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800d4a0 con 0x7fb3c414b1e0 2023-07-27T14:29:59.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c1d9b700 1 -- 172.21.15.115:0/4273095489 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b800d600 con 0x7fb3c414b1e0 2023-07-27T14:29:59.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.774+0000 7fb3c1d9b700 1 -- 172.21.15.115:0/4273095489 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800d980 con 0x7fb3c414b1e0 2023-07-27T14:29:59.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.775+0000 7fb3c91ff700 1 -- 172.21.15.115:0/4273095489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 msgr2=0x7fb3c4062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.775+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/4273095489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 0x7fb3c4062b50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb3b8009760 tx=0x7fb3b8009060).stop 2023-07-27T14:29:59.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.775+0000 7fb3c91ff700 1 -- 172.21.15.115:0/4273095489 shutdown_connections 2023-07-27T14:29:59.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.775+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/4273095489 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.775+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/4273095489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 0x7fb3c4062b50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.775+0000 7fb3c91ff700 1 -- 172.21.15.115:0/4273095489 >> 172.21.15.115:0/4273095489 conn(0x7fb3c405e940 msgr2=0x7fb3c40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:59.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.775+0000 7fb3c91ff700 1 -- 172.21.15.115:0/4273095489 shutdown_connections 2023-07-27T14:29:59.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.775+0000 7fb3c91ff700 1 -- 172.21.15.115:0/4273095489 wait complete. 2023-07-27T14:29:59.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.776+0000 7fb3c91ff700 1 Processor -- start 2023-07-27T14:29:59.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.777+0000 7fb3c91ff700 1 -- start start 2023-07-27T14:29:59.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.777+0000 7fb3c91ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c40c5c50 0x7fb3c4149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.777+0000 7fb3c91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.777+0000 7fb3c91ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 0x7fb3c41572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.777+0000 7fb3c91ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c41577e0 con 0x7fb3c40c5c50 2023-07-27T14:29:59.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.777+0000 7fb3c91ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40c1cf0 con 0x7fb3c414b1e0 2023-07-27T14:29:59.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.777+0000 7fb3c91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40c1f90 con 0x7fb3c414ae00 2023-07-27T14:29:59.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c40c5c50 0x7fb3c4149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c40c5c50 0x7fb3c4149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52138/0 (socket says 172.21.15.115:52138) 2023-07-27T14:29:59.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 -- 172.21.15.115:0/1532372978 learned_addr learned my addr 172.21.15.115:0/1532372978 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:29:59.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c359e700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 0x7fb3c41572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c259c700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 -- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 msgr2=0x7fb3c4156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 -- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 msgr2=0x7fb3c41572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 0x7fb3c41572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 -- 172.21.15.115:0/1532372978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b80092a0 con 0x7fb3c40c5c50 2023-07-27T14:29:59.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c359e700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 0x7fb3c41572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:59.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c259c700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:29:59.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.778+0000 7fb3c2d9d700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c40c5c50 0x7fb3c4149bc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fb3b400e930 tx=0x7fb3b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:59.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.779+0000 7fb3aaffd700 1 -- 172.21.15.115:0/1532372978 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400eed0 con 0x7fb3c40c5c50 2023-07-27T14:29:59.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.779+0000 7fb3aaffd700 1 -- 172.21.15.115:0/1532372978 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b400c850 con 0x7fb3c40c5c50 2023-07-27T14:29:59.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.779+0000 7fb3aaffd700 1 -- 172.21.15.115:0/1532372978 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400cbd0 con 0x7fb3c40c5c50 2023-07-27T14:29:59.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.779+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c40c2270 con 0x7fb3c40c5c50 2023-07-27T14:29:59.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.779+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c40c28b0 con 0x7fb3c40c5c50 2023-07-27T14:29:59.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.780+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c40c2a40 con 0x7fb3c40c5c50 2023-07-27T14:29:59.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.780+0000 7fb3aaffd700 1 -- 172.21.15.115:0/1532372978 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fb3b4022070 con 0x7fb3c40c5c50 2023-07-27T14:29:59.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.782+0000 7fb3aaffd700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3b005f090 0x7fb3b0061550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:29:59.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.782+0000 7fb3aaffd700 1 -- 172.21.15.115:0/1532372978 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fb3b407a550 con 0x7fb3c40c5c50 2023-07-27T14:29:59.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.782+0000 7fb3c259c700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3b005f090 0x7fb3b0061550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:29:59.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.782+0000 7fb3c259c700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3b005f090 0x7fb3b0061550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb3c40c1c00 tx=0x7fb3b8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:29:59.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.786+0000 7fb3aaffd700 1 -- 172.21.15.115:0/1532372978 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3b404b660 con 0x7fb3c40c5c50 2023-07-27T14:29:59.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.956+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb3c406c470 con 0x7fb3c40c5c50 2023-07-27T14:29:59.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.957+0000 7fb3aaffd700 1 -- 172.21.15.115:0/1532372978 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v55) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb3b404ec80 con 0x7fb3c40c5c50 2023-07-27T14:29:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:29:59.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3b005f090 msgr2=0x7fb3b0061550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3b005f090 0x7fb3b0061550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb3c40c1c00 tx=0x7fb3b8016000).stop 2023-07-27T14:29:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c40c5c50 msgr2=0x7fb3c4149bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:29:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c40c5c50 0x7fb3c4149bc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fb3b400e930 tx=0x7fb3b4009060).stop 2023-07-27T14:29:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 shutdown_connections 2023-07-27T14:29:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3b005f090 0x7fb3b0061550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3c414b1e0 0x7fb3c41572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c40c5c50 0x7fb3c4149bc0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 --2- 172.21.15.115:0/1532372978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3c414ae00 0x7fb3c4156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:29:59.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 >> 172.21.15.115:0/1532372978 conn(0x7fb3c405e940 msgr2=0x7fb3c40c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:29:59.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 shutdown_connections 2023-07-27T14:29:59.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:29:59.959+0000 7fb3c91ff700 1 -- 172.21.15.115:0/1532372978 wait complete. 2023-07-27T14:30:00.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:30:00.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.173+0000 7f08295ff700 1 Processor -- start 2023-07-27T14:30:00.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.173+0000 7f08295ff700 1 -- start start 2023-07-27T14:30:00.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.174+0000 7f08295ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0824153e00 0x7f08240c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.174+0000 7f08295ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0824064a80 con 0x7f0824065de0 2023-07-27T14:30:00.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.174+0000 7f08295ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0824064d60 con 0x7f0824064230 2023-07-27T14:30:00.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.174+0000 7f08295ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0824062320 con 0x7f0824153e00 2023-07-27T14:30:00.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f08237fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0824065de0 0x7f0824062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55036/0 (socket says 172.21.15.115:55036) 2023-07-27T14:30:00.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f08237fe700 1 -- 172.21.15.115:0/750987064 learned_addr learned my addr 172.21.15.115:0/750987064 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:00.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0822ffd700 1 --2- 172.21.15.115:0/750987064 >> v2:172.21.15.159:3300/0 conn(0x7f0824153e00 0x7f08240c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921729985 0 0) 0x7f0824064a80 con 0x7f0824065de0 2023-07-27T14:30:00.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f080c0033f0 con 0x7f0824065de0 2023-07-27T14:30:00.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2588475323 0 0) 0x7f080c0033f0 con 0x7f0824065de0 2023-07-27T14:30:00.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 >> v2:172.21.15.159:3300/0 conn(0x7f0824153e00 msgr2=0x7f08240c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 --2- 172.21.15.115:0/750987064 >> v2:172.21.15.159:3300/0 conn(0x7f0824153e00 0x7f08240c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 >> v1:172.21.15.159:6789/0 conn(0x7f0824064230 legacy=0x7f08240656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0824065040 con 0x7f0824065de0 2023-07-27T14:30:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f081c0017f0 con 0x7f0824065de0 2023-07-27T14:30:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 >> v1:172.21.15.115:6789/0 conn(0x7f0824065de0 legacy=0x7f0824062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.175+0000 7f0821ffb700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0038e0 0x7f080c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f0821ffb700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f080c004690 0x7f080c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f0821ffb700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f080c005000 0x7f080c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c00be80 con 0x7f080c004690 2023-07-27T14:30:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c00bff0 con 0x7f080c0038e0 2023-07-27T14:30:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c00c1b0 con 0x7f080c005000 2023-07-27T14:30:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08227fc700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f080c004690 0x7f080c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f0822ffd700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0038e0 0x7f080c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08237fe700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f080c005000 0x7f080c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08227fc700 1 -- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f080c005000 msgr2=0x7f080c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08227fc700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f080c005000 0x7f080c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08227fc700 1 -- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0038e0 msgr2=0x7f080c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08227fc700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c0038e0 0x7f080c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08227fc700 1 -- 172.21.15.115:0/750987064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c0033f0 con 0x7f080c004690 2023-07-27T14:30:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08237fe700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f080c005000 0x7f080c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08237fe700 1 -- 172.21.15.115:0/750987064 reap_dead start 2023-07-27T14:30:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.176+0000 7f08227fc700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f080c004690 0x7f080c004b10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f0818001730 tx=0x7f0818007bb0).ready entity=mon.0 client_cookie=b270120b6da3de0c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818007020 con 0x7f080c004690 2023-07-27T14:30:00.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818007180 con 0x7f080c004690 2023-07-27T14:30:00.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f0821ffb700 1 -- 172.21.15.115:0/750987064 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818007520 con 0x7f080c004690 2023-07-27T14:30:00.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f08295ff700 1 -- 172.21.15.115:0/750987064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f080c004690 msgr2=0x7f080c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f08295ff700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f080c004690 0x7f080c004b10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f0818001730 tx=0x7f0818007bb0).stop 2023-07-27T14:30:00.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f08295ff700 1 -- 172.21.15.115:0/750987064 shutdown_connections 2023-07-27T14:30:00.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f08295ff700 1 --2- 172.21.15.115:0/750987064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f080c004690 0x7f080c004b10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f08295ff700 1 -- 172.21.15.115:0/750987064 >> 172.21.15.115:0/750987064 conn(0x7f08240c7b90 msgr2=0x7f08240c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:00.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f08295ff700 1 -- 172.21.15.115:0/750987064 shutdown_connections 2023-07-27T14:30:00.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.177+0000 7f08295ff700 1 -- 172.21.15.115:0/750987064 wait complete. 2023-07-27T14:30:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.179+0000 7f08295ff700 1 Processor -- start 2023-07-27T14:30:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.179+0000 7f08295ff700 1 -- start start 2023-07-27T14:30:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08295ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c004690 0x7f08240919d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08295ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0824093f00 0x7f08240a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08295ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08240bd3d0 0x7f08240bd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08295ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08240a9b70 con 0x7f0824093f00 2023-07-27T14:30:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08295ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824094a00 con 0x7f080c004690 2023-07-27T14:30:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08295ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08240bdd20 con 0x7f08240bd3d0 2023-07-27T14:30:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08227fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0824093f00 0x7f08240a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08227fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0824093f00 0x7f08240a90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52160/0 (socket says 172.21.15.115:52160) 2023-07-27T14:30:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08227fc700 1 -- 172.21.15.115:0/4036297596 learned_addr learned my addr 172.21.15.115:0/4036297596 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08237fe700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08240bd3d0 0x7f08240bd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f0822ffd700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c004690 0x7f08240919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08227fc700 1 -- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08240bd3d0 msgr2=0x7f08240bd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08227fc700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08240bd3d0 0x7f08240bd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08227fc700 1 -- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c004690 msgr2=0x7f08240919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08227fc700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c004690 0x7f08240919d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08227fc700 1 -- 172.21.15.115:0/4036297596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08240a7030 con 0x7f0824093f00 2023-07-27T14:30:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.180+0000 7f08237fe700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08240bd3d0 0x7f08240bd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.181+0000 7f08227fc700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0824093f00 0x7f08240a90b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f080c00bfc0 tx=0x7f0818015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.181+0000 7f080affd700 1 -- 172.21.15.115:0/4036297596 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818006ff0 con 0x7f0824093f00 2023-07-27T14:30:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.181+0000 7f080affd700 1 -- 172.21.15.115:0/4036297596 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818013670 con 0x7f0824093f00 2023-07-27T14:30:00.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.181+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0824091ec0 con 0x7f0824093f00 2023-07-27T14:30:00.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.181+0000 7f080affd700 1 -- 172.21.15.115:0/4036297596 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818013a30 con 0x7f0824093f00 2023-07-27T14:30:00.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.181+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0824094720 con 0x7f0824093f00 2023-07-27T14:30:00.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.182+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08240a7640 con 0x7f0824093f00 2023-07-27T14:30:00.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.183+0000 7f080affd700 1 -- 172.21.15.115:0/4036297596 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f0818010030 con 0x7f0824093f00 2023-07-27T14:30:00.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.183+0000 7f080affd700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081005f060 0x7f0810061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.183+0000 7f080affd700 1 -- 172.21.15.115:0/4036297596 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f081807a970 con 0x7f0824093f00 2023-07-27T14:30:00.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.184+0000 7f0822ffd700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081005f060 0x7f0810061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.184+0000 7f0822ffd700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081005f060 0x7f0810061520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f0814006d80 tx=0x7f0814008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:00.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.187+0000 7f080affd700 1 -- 172.21.15.115:0/4036297596 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f081804bbb0 con 0x7f0824093f00 2023-07-27T14:30:00.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.356+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f082406c470 con 0x7f0824093f00 2023-07-27T14:30:00.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.356+0000 7f080affd700 1 -- 172.21.15.115:0/4036297596 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0818007e60 con 0x7f0824093f00 2023-07-27T14:30:00.384 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:30:00.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081005f060 msgr2=0x7f0810061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081005f060 0x7f0810061520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f0814006d80 tx=0x7f0814008040).stop 2023-07-27T14:30:00.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0824093f00 msgr2=0x7f08240a90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0824093f00 0x7f08240a90b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f080c00bfc0 tx=0x7f0818015000).stop 2023-07-27T14:30:00.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 shutdown_connections 2023-07-27T14:30:00.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081005f060 0x7f0810061520 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08240bd3d0 0x7f08240bd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f080c004690 0x7f08240919d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 --2- 172.21.15.115:0/4036297596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0824093f00 0x7f08240a90b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 >> 172.21.15.115:0/4036297596 conn(0x7f08240c7b90 msgr2=0x7f08240bc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:00.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.358+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 shutdown_connections 2023-07-27T14:30:00.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.359+0000 7f08295ff700 1 -- 172.21.15.115:0/4036297596 wait complete. 2023-07-27T14:30:00.403 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:30:00.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.567+0000 7f12c73ff700 1 Processor -- start 2023-07-27T14:30:00.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.567+0000 7f12c73ff700 1 -- start start 2023-07-27T14:30:00.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.568+0000 7f12c73ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f12c0063260 0x7f12c0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.568+0000 7f12c73ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12c014b1e0 0x7f12c00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.568+0000 7f12c73ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c01553f0 con 0x7f12c014ae00 2023-07-27T14:30:00.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.568+0000 7f12c73ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c0157a50 con 0x7f12c014b1e0 2023-07-27T14:30:00.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.568+0000 7f12c73ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c0157d10 con 0x7f12c0063260 2023-07-27T14:30:00.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12c519b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f12c014ae00 0x7f12c0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55042/0 (socket says 172.21.15.115:55042) 2023-07-27T14:30:00.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12c519b700 1 -- 172.21.15.115:0/2624966687 learned_addr learned my addr 172.21.15.115:0/2624966687 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:00.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12c599c700 1 --2- 172.21.15.115:0/2624966687 >> v2:172.21.15.115:3300/0 conn(0x7f12c014b1e0 0x7f12c00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12c499a700 1 --2- 172.21.15.115:0/2624966687 >> v2:172.21.15.159:3300/0 conn(0x7f12c0063260 0x7f12c0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12b7fff700 1 -- 172.21.15.115:0/2624966687 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215722445 0 0) 0x7f12c01553f0 con 0x7f12c014ae00 2023-07-27T14:30:00.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12b7fff700 1 -- 172.21.15.115:0/2624966687 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ac0033f0 con 0x7f12c014ae00 2023-07-27T14:30:00.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12c599c700 1 -- 172.21.15.115:0/2624966687 >> v2:172.21.15.159:3300/0 conn(0x7f12c0063260 msgr2=0x7f12c0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12c599c700 1 --2- 172.21.15.115:0/2624966687 >> v2:172.21.15.159:3300/0 conn(0x7f12c0063260 0x7f12c0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12c599c700 1 -- 172.21.15.115:0/2624966687 >> v1:172.21.15.115:6789/0 conn(0x7f12c014ae00 legacy=0x7f12c0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.569+0000 7f12c599c700 1 -- 172.21.15.115:0/2624966687 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0157ff0 con 0x7f12c014b1e0 2023-07-27T14:30:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12c599c700 1 --2- 172.21.15.115:0/2624966687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c014b1e0 0x7f12c00a98c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f12c00cbc00 tx=0x7f12b8009780).ready entity=mon.0 client_cookie=33a9385c06c216e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12b7fff700 1 -- 172.21.15.115:0/2624966687 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800e070 con 0x7f12c014b1e0 2023-07-27T14:30:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12b7fff700 1 -- 172.21.15.115:0/2624966687 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b800bab0 con 0x7f12c014b1e0 2023-07-27T14:30:00.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12b7fff700 1 -- 172.21.15.115:0/2624966687 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800be30 con 0x7f12c014b1e0 2023-07-27T14:30:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12c73ff700 1 -- 172.21.15.115:0/2624966687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c014b1e0 msgr2=0x7f12c00a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2624966687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c014b1e0 0x7f12c00a98c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f12c00cbc00 tx=0x7f12b8009780).stop 2023-07-27T14:30:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12c73ff700 1 -- 172.21.15.115:0/2624966687 shutdown_connections 2023-07-27T14:30:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2624966687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c014b1e0 0x7f12c00a98c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2624966687 >> v2:172.21.15.159:3300/0 conn(0x7f12c0063260 0x7f12c0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.570+0000 7f12c73ff700 1 -- 172.21.15.115:0/2624966687 >> 172.21.15.115:0/2624966687 conn(0x7f12c005e940 msgr2=0x7f12c00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:00.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.571+0000 7f12c73ff700 1 -- 172.21.15.115:0/2624966687 shutdown_connections 2023-07-27T14:30:00.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.571+0000 7f12c73ff700 1 -- 172.21.15.115:0/2624966687 wait complete. 2023-07-27T14:30:00.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.572+0000 7f12c73ff700 1 Processor -- start 2023-07-27T14:30:00.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.572+0000 7f12c73ff700 1 -- start start 2023-07-27T14:30:00.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c73ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0063260 0x7f12c0149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c73ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12c014ae00 0x7f12c00c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12c014b1e0 0x7f12c00c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c73ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00c7ed0 con 0x7f12c0063260 2023-07-27T14:30:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c73ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00af600 con 0x7f12c014ae00 2023-07-27T14:30:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c014df00 con 0x7f12c014b1e0 2023-07-27T14:30:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c519b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0063260 0x7f12c0149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c519b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0063260 0x7f12c0149cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52172/0 (socket says 172.21.15.115:52172) 2023-07-27T14:30:00.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c519b700 1 -- 172.21.15.115:0/2131649583 learned_addr learned my addr 172.21.15.115:0/2131649583 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c499a700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12c014ae00 0x7f12c00c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.573+0000 7f12c599c700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12c014b1e0 0x7f12c00c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12c519b700 1 -- 172.21.15.115:0/2131649583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12c014b1e0 msgr2=0x7f12c00c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12c519b700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12c014b1e0 0x7f12c00c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12c519b700 1 -- 172.21.15.115:0/2131649583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12c014ae00 msgr2=0x7f12c00c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12c519b700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12c014ae00 0x7f12c00c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12c519b700 1 -- 172.21.15.115:0/2131649583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8009a20 con 0x7f12c0063260 2023-07-27T14:30:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12c519b700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0063260 0x7f12c0149cd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f12bc00c490 tx=0x7f12bc007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12b57fa700 1 -- 172.21.15.115:0/2131649583 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00ce00 con 0x7f12c0063260 2023-07-27T14:30:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12b57fa700 1 -- 172.21.15.115:0/2131649583 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0072e0 con 0x7f12c0063260 2023-07-27T14:30:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12b57fa700 1 -- 172.21.15.115:0/2131649583 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0057a0 con 0x7f12c0063260 2023-07-27T14:30:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c00aecd0 con 0x7f12c0063260 2023-07-27T14:30:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.574+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c00af290 con 0x7f12c0063260 2023-07-27T14:30:00.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.575+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c006c470 con 0x7f12c0063260 2023-07-27T14:30:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.576+0000 7f12b57fa700 1 -- 172.21.15.115:0/2131649583 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f12bc010070 con 0x7f12c0063260 2023-07-27T14:30:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.577+0000 7f12b57fa700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12a405f060 0x7f12a4061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.577+0000 7f12b57fa700 1 -- 172.21.15.115:0/2131649583 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f12bc079520 con 0x7f12c0063260 2023-07-27T14:30:00.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.577+0000 7f12c499a700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12a405f060 0x7f12a4061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.578+0000 7f12c499a700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12a405f060 0x7f12a4061520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f12c0063660 tx=0x7f12b0009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:00.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.581+0000 7f12b57fa700 1 -- 172.21.15.115:0/2131649583 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12bc04a740 con 0x7f12c0063260 2023-07-27T14:30:00.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.752+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12c00c15c0 con 0x7f12c0063260 2023-07-27T14:30:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.752+0000 7f12b57fa700 1 -- 172.21.15.115:0/2131649583 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12bc018020 con 0x7f12c0063260 2023-07-27T14:30:00.779 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:30:00.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12a405f060 msgr2=0x7f12a4061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12a405f060 0x7f12a4061520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f12c0063660 tx=0x7f12b0009060).stop 2023-07-27T14:30:00.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0063260 msgr2=0x7f12c0149cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0063260 0x7f12c0149cd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f12bc00c490 tx=0x7f12bc007c70).stop 2023-07-27T14:30:00.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 shutdown_connections 2023-07-27T14:30:00.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12a405f060 0x7f12a4061520 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12c014b1e0 0x7f12c00c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0063260 0x7f12c0149cd0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 --2- 172.21.15.115:0/2131649583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12c014ae00 0x7f12c00c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 >> 172.21.15.115:0/2131649583 conn(0x7f12c005e940 msgr2=0x7f12c00aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:00.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 shutdown_connections 2023-07-27T14:30:00.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.754+0000 7f12c73ff700 1 -- 172.21.15.115:0/2131649583 wait complete. 2023-07-27T14:30:00.798 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:30:00.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.962+0000 7eff2d9ff700 1 Processor -- start 2023-07-27T14:30:00.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.962+0000 7eff2d9ff700 1 -- start start 2023-07-27T14:30:00.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff2d9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7eff2814ae00 0x7eff28154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff2d9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff2814b1e0 0x7eff28062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff2d9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff281553f0 con 0x7eff280c5c50 2023-07-27T14:30:00.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff2d9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff28157a50 con 0x7eff2814b1e0 2023-07-27T14:30:00.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff2d9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff28157d10 con 0x7eff2814ae00 2023-07-27T14:30:00.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff267fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff2814b1e0 0x7eff28062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff267fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff2814b1e0 0x7eff28062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52178/0 (socket says 172.21.15.115:52178) 2023-07-27T14:30:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff267fc700 1 -- 172.21.15.115:0/2708840687 learned_addr learned my addr 172.21.15.115:0/2708840687 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:00.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff26ffd700 1 --2- 172.21.15.115:0/2708840687 >> v2:172.21.15.159:3300/0 conn(0x7eff2814ae00 0x7eff28154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff267fc700 1 -- 172.21.15.115:0/2708840687 >> v2:172.21.15.159:3300/0 conn(0x7eff2814ae00 msgr2=0x7eff28154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:00.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff267fc700 1 --2- 172.21.15.115:0/2708840687 >> v2:172.21.15.159:3300/0 conn(0x7eff2814ae00 0x7eff28154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff267fc700 1 -- 172.21.15.115:0/2708840687 >> v1:172.21.15.159:6789/0 conn(0x7eff280c5c50 legacy=0x7eff280a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff267fc700 1 -- 172.21.15.115:0/2708840687 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28157ff0 con 0x7eff2814b1e0 2023-07-27T14:30:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.964+0000 7eff26ffd700 1 --2- 172.21.15.115:0/2708840687 >> v2:172.21.15.159:3300/0 conn(0x7eff2814ae00 0x7eff28154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.965+0000 7eff267fc700 1 --2- 172.21.15.115:0/2708840687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff28062b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7eff28155580 tx=0x7eff1c0090f0).ready entity=mon.0 client_cookie=eaac9394256b27a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.965+0000 7eff25ffb700 1 -- 172.21.15.115:0/2708840687 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00b5a0 con 0x7eff2814b1e0 2023-07-27T14:30:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.965+0000 7eff25ffb700 1 -- 172.21.15.115:0/2708840687 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00b700 con 0x7eff2814b1e0 2023-07-27T14:30:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.965+0000 7eff25ffb700 1 -- 172.21.15.115:0/2708840687 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00ba80 con 0x7eff2814b1e0 2023-07-27T14:30:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.965+0000 7eff2d9ff700 1 -- 172.21.15.115:0/2708840687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 msgr2=0x7eff28062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.965+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/2708840687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff28062b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7eff28155580 tx=0x7eff1c0090f0).stop 2023-07-27T14:30:00.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.965+0000 7eff2d9ff700 1 -- 172.21.15.115:0/2708840687 shutdown_connections 2023-07-27T14:30:00.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.966+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/2708840687 >> v2:172.21.15.159:3300/0 conn(0x7eff2814ae00 0x7eff28154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.966+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/2708840687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff28062b50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:00.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.966+0000 7eff2d9ff700 1 -- 172.21.15.115:0/2708840687 >> 172.21.15.115:0/2708840687 conn(0x7eff2805e940 msgr2=0x7eff280cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:00.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.966+0000 7eff2d9ff700 1 -- 172.21.15.115:0/2708840687 shutdown_connections 2023-07-27T14:30:00.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.966+0000 7eff2d9ff700 1 -- 172.21.15.115:0/2708840687 wait complete. 2023-07-27T14:30:00.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.967+0000 7eff2d9ff700 1 Processor -- start 2023-07-27T14:30:00.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.967+0000 7eff2d9ff700 1 -- start start 2023-07-27T14:30:00.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff2d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280c5c50 0x7eff280ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff2d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2814ae00 0x7eff280c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff2d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff280aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:00.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff2d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280ac600 con 0x7eff2814b1e0 2023-07-27T14:30:00.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff2d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c44a0 con 0x7eff280c5c50 2023-07-27T14:30:00.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff2d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c4720 con 0x7eff2814ae00 2023-07-27T14:30:00.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff280aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff280aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52180/0 (socket says 172.21.15.115:52180) 2023-07-27T14:30:00.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff277fe700 1 -- 172.21.15.115:0/1115825919 learned_addr learned my addr 172.21.15.115:0/1115825919 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:00.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff26ffd700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280c5c50 0x7eff280ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.968+0000 7eff267fc700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2814ae00 0x7eff280c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:00.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff277fe700 1 -- 172.21.15.115:0/1115825919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2814ae00 msgr2=0x7eff280c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:00.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff277fe700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2814ae00 0x7eff280c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff277fe700 1 -- 172.21.15.115:0/1115825919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280c5c50 msgr2=0x7eff280ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff277fe700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280c5c50 0x7eff280ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff277fe700 1 -- 172.21.15.115:0/1115825919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c009370 con 0x7eff2814b1e0 2023-07-27T14:30:01.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff277fe700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff280aac30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7eff2000c810 tx=0x7eff20002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:01.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff0effd700 1 -- 172.21.15.115:0/1115825919 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000e4a0 con 0x7eff2814b1e0 2023-07-27T14:30:01.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff0effd700 1 -- 172.21.15.115:0/1115825919 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000e620 con 0x7eff2814b1e0 2023-07-27T14:30:01.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff280c4a00 con 0x7eff2814b1e0 2023-07-27T14:30:01.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff0effd700 1 -- 172.21.15.115:0/1115825919 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000e9e0 con 0x7eff2814b1e0 2023-07-27T14:30:01.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.969+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff280c4fc0 con 0x7eff2814b1e0 2023-07-27T14:30:01.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.970+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2806c470 con 0x7eff2814b1e0 2023-07-27T14:30:01.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.971+0000 7eff0effd700 1 -- 172.21.15.115:0/1115825919 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7eff20019030 con 0x7eff2814b1e0 2023-07-27T14:30:01.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.972+0000 7eff0effd700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1405f060 0x7eff14061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.972+0000 7eff0effd700 1 -- 172.21.15.115:0/1115825919 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6293+0+0 (secure 0 0 0) 0x7eff200796a0 con 0x7eff2814b1e0 2023-07-27T14:30:01.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.972+0000 7eff26ffd700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1405f060 0x7eff14061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.973+0000 7eff26ffd700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1405f060 0x7eff14061520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7eff1800abd0 tx=0x7eff18008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:01.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:00.976+0000 7eff0effd700 1 -- 172.21.15.115:0/1115825919 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff200488f0 con 0x7eff2814b1e0 2023-07-27T14:30:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.143+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff28063bb0 con 0x7eff2814b1e0 2023-07-27T14:30:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.144+0000 7eff0effd700 1 -- 172.21.15.115:0/1115825919 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff20017070 con 0x7eff2814b1e0 2023-07-27T14:30:01.171 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:30:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1405f060 msgr2=0x7eff14061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1405f060 0x7eff14061520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7eff1800abd0 tx=0x7eff18008040).stop 2023-07-27T14:30:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 msgr2=0x7eff280aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff280aac30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7eff2000c810 tx=0x7eff20002530).stop 2023-07-27T14:30:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 shutdown_connections 2023-07-27T14:30:01.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1405f060 0x7eff14061520 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2814b1e0 0x7eff280aac30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff280c5c50 0x7eff280ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 --2- 172.21.15.115:0/1115825919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2814ae00 0x7eff280c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 >> 172.21.15.115:0/1115825919 conn(0x7eff2805e940 msgr2=0x7eff28152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:01.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 shutdown_connections 2023-07-27T14:30:01.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.146+0000 7eff2d9ff700 1 -- 172.21.15.115:0/1115825919 wait complete. 2023-07-27T14:30:01.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:30:01.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.350+0000 7f85f43ff700 1 Processor -- start 2023-07-27T14:30:01.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.350+0000 7f85f43ff700 1 -- start start 2023-07-27T14:30:01.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.351+0000 7f85f43ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec153ec0 0x7f85ec0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.351+0000 7f85f43ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f85ec0aaa40 0x7f85ec0c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f43ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec0aa4d0 con 0x7f85ec0aa050 2023-07-27T14:30:01.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f43ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec0c05c0 con 0x7f85ec0aaa40 2023-07-27T14:30:01.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f43ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0bfc90 con 0x7f85ec153ec0 2023-07-27T14:30:01.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f199a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f85ec0aa050 0x7f85ec0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55054/0 (socket says 172.21.15.115:55054) 2023-07-27T14:30:01.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f299c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f85ec0aaa40 0x7f85ec0c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f199a700 1 -- 172.21.15.115:0/487698862 learned_addr learned my addr 172.21.15.115:0/487698862 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:01.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f219b700 1 --2- 172.21.15.115:0/487698862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec153ec0 0x7f85ec0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f299c700 1 -- 172.21.15.115:0/487698862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec153ec0 msgr2=0x7f85ec0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:01.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f299c700 1 --2- 172.21.15.115:0/487698862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec153ec0 0x7f85ec0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f299c700 1 -- 172.21.15.115:0/487698862 >> v1:172.21.15.115:6789/0 conn(0x7f85ec0aa050 legacy=0x7f85ec0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f299c700 1 -- 172.21.15.115:0/487698862 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0bff70 con 0x7f85ec0aaa40 2023-07-27T14:30:01.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f1199700 1 -- 172.21.15.115:0/487698862 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363741209 0 0) 0x7f85dc001110 con 0x7f85ec0aa050 2023-07-27T14:30:01.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f219b700 1 --2- 172.21.15.115:0/487698862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec153ec0 0x7f85ec0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:01.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.352+0000 7f85f299c700 1 --2- 172.21.15.115:0/487698862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec0aaa40 0x7f85ec0c0a50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f85e4009e60 tx=0x7f85e4009780).ready entity=mon.0 client_cookie=34c4af3fe68921ed server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:01.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f1199700 1 -- 172.21.15.115:0/487698862 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e400e070 con 0x7f85ec0aaa40 2023-07-27T14:30:01.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f1199700 1 -- 172.21.15.115:0/487698862 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e400bc30 con 0x7f85ec0aaa40 2023-07-27T14:30:01.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f1199700 1 -- 172.21.15.115:0/487698862 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4012410 con 0x7f85ec0aaa40 2023-07-27T14:30:01.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f43ff700 1 -- 172.21.15.115:0/487698862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec0aaa40 msgr2=0x7f85ec0c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f43ff700 1 --2- 172.21.15.115:0/487698862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec0aaa40 0x7f85ec0c0a50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f85e4009e60 tx=0x7f85e4009780).stop 2023-07-27T14:30:01.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f43ff700 1 -- 172.21.15.115:0/487698862 shutdown_connections 2023-07-27T14:30:01.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f43ff700 1 --2- 172.21.15.115:0/487698862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec153ec0 0x7f85ec0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f43ff700 1 --2- 172.21.15.115:0/487698862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec0aaa40 0x7f85ec0c0a50 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f43ff700 1 -- 172.21.15.115:0/487698862 >> 172.21.15.115:0/487698862 conn(0x7f85ec0cb610 msgr2=0x7f85ec0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:01.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f43ff700 1 -- 172.21.15.115:0/487698862 shutdown_connections 2023-07-27T14:30:01.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.353+0000 7f85f43ff700 1 -- 172.21.15.115:0/487698862 wait complete. 2023-07-27T14:30:01.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.355+0000 7f85f43ff700 1 Processor -- start 2023-07-27T14:30:01.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.355+0000 7f85f43ff700 1 -- start start 2023-07-27T14:30:01.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f43ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ec0aa050 0x7f85ec0a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f43ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec0aaa40 0x7f85ec152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f43ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec153ec0 0x7f85ec1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f43ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec1537d0 con 0x7f85ec153ec0 2023-07-27T14:30:01.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f43ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0c4520 con 0x7f85ec0aa050 2023-07-27T14:30:01.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f43ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0c39a0 con 0x7f85ec0aaa40 2023-07-27T14:30:01.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f299c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec153ec0 0x7f85ec1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f299c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec153ec0 0x7f85ec1532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52194/0 (socket says 172.21.15.115:52194) 2023-07-27T14:30:01.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f299c700 1 -- 172.21.15.115:0/119677 learned_addr learned my addr 172.21.15.115:0/119677 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:01.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f199a700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec0aaa40 0x7f85ec152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.356+0000 7f85f219b700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ec0aa050 0x7f85ec0a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f299c700 1 -- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec0aaa40 msgr2=0x7f85ec152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f299c700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec0aaa40 0x7f85ec152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f299c700 1 -- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ec0aa050 msgr2=0x7f85ec0a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f299c700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ec0aa050 0x7f85ec0a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f299c700 1 -- 172.21.15.115:0/119677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e4009a20 con 0x7f85ec153ec0 2023-07-27T14:30:01.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f219b700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ec0aa050 0x7f85ec0a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:01.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f299c700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec153ec0 0x7f85ec1532e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f85e4011000 tx=0x7f85e4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:01.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85e27fc700 1 -- 172.21.15.115:0/119677 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e401c660 con 0x7f85ec153ec0 2023-07-27T14:30:01.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85e27fc700 1 -- 172.21.15.115:0/119677 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e401c7c0 con 0x7f85ec153ec0 2023-07-27T14:30:01.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec0c3c80 con 0x7f85ec153ec0 2023-07-27T14:30:01.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85e27fc700 1 -- 172.21.15.115:0/119677 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e401cb80 con 0x7f85ec153ec0 2023-07-27T14:30:01.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.357+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec0c4240 con 0x7f85ec153ec0 2023-07-27T14:30:01.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.358+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec150440 con 0x7f85ec153ec0 2023-07-27T14:30:01.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.359+0000 7f85e27fc700 1 -- 172.21.15.115:0/119677 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f85e401d420 con 0x7f85ec153ec0 2023-07-27T14:30:01.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.360+0000 7f85e27fc700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85d005f030 0x7f85d00614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.360+0000 7f85e27fc700 1 -- 172.21.15.115:0/119677 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f85e407c2d0 con 0x7f85ec153ec0 2023-07-27T14:30:01.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.360+0000 7f85f219b700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85d005f030 0x7f85d00614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.361+0000 7f85f219b700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85d005f030 0x7f85d00614f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f85e8006d80 tx=0x7f85e8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:01.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.364+0000 7f85e27fc700 1 -- 172.21.15.115:0/119677 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f85ec150440 con 0x7f85ec153ec0 2023-07-27T14:30:01.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.575+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85ec150440 con 0x7f85ec153ec0 2023-07-27T14:30:01.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.575+0000 7f85e27fc700 1 -- 172.21.15.115:0/119677 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f85ec150440 con 0x7f85ec153ec0 2023-07-27T14:30:01.602 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:01.603 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1259074753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1259074753},{"type":"v1","addr":"172.21.15.115:6837","nonce":1259074753}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1004586884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1004586884},{"type":"v1","addr":"172.21.15.159:6834","nonce":1004586884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2086004294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2086004294},{"type":"v1","addr":"172.21.15.159:6835","nonce":2086004294}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:29:15.154553+0000","modified":"2023-07-27T14:29:18.168905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1707534394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1707534394},{"type":"v1","addr":"172.21.15.115:6836","nonce":1707534394}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-07-27T14:30:01.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85d005f030 msgr2=0x7f85d00614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85d005f030 0x7f85d00614f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f85e8006d80 tx=0x7f85e8008040).stop 2023-07-27T14:30:01.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec153ec0 msgr2=0x7f85ec1532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec153ec0 0x7f85ec1532e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f85e4011000 tx=0x7f85e4009780).stop 2023-07-27T14:30:01.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 shutdown_connections 2023-07-27T14:30:01.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85d005f030 0x7f85d00614f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85ec153ec0 0x7f85ec1532e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85ec0aa050 0x7f85ec0a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 --2- 172.21.15.115:0/119677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f85ec0aaa40 0x7f85ec152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.577+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 >> 172.21.15.115:0/119677 conn(0x7f85ec0cb610 msgr2=0x7f85ec0afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:01.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.578+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 shutdown_connections 2023-07-27T14:30:01.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.578+0000 7f85f43ff700 1 -- 172.21.15.115:0/119677 wait complete. 2023-07-27T14:30:01.607 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 26 2023-07-27T14:30:01.623 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:30:01.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.790+0000 7f5fcb7ff700 1 Processor -- start 2023-07-27T14:30:01.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.791+0000 7f5fcb7ff700 1 -- start start 2023-07-27T14:30:01.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.792+0000 7f5fcb7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5fc4151bd0 0x7f5fc4062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.792+0000 7f5fcb7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40639d0 con 0x7f5fc40a4f50 2023-07-27T14:30:01.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.792+0000 7f5fcb7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc4062dc0 con 0x7f5fc4062810 2023-07-27T14:30:01.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.792+0000 7f5fcb7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc4137610 con 0x7f5fc4151bd0 2023-07-27T14:30:01.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.792+0000 7f5fc959b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5fc4151bd0 0x7f5fc4062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.792+0000 7f5fc9d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5fc40a4f50 0x7f5fc40bc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55070/0 (socket says 172.21.15.115:55070) 2023-07-27T14:30:01.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.792+0000 7f5fc9d9c700 1 -- 172.21.15.115:0/881041152 learned_addr learned my addr 172.21.15.115:0/881041152 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:01.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.793+0000 7f5fc959b700 1 -- 172.21.15.115:0/881041152 >> v1:172.21.15.159:6789/0 conn(0x7f5fc4062810 legacy=0x7f5fc40a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.793+0000 7f5fc959b700 1 -- 172.21.15.115:0/881041152 >> v1:172.21.15.115:6789/0 conn(0x7f5fc40a4f50 legacy=0x7f5fc40bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.793+0000 7f5fc959b700 1 -- 172.21.15.115:0/881041152 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40630a0 con 0x7f5fc4151bd0 2023-07-27T14:30:01.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.793+0000 7f5fbbfff700 1 -- 172.21.15.115:0/881041152 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086002875 0 0) 0x7f5fc40639d0 con 0x7f5fc40a4f50 2023-07-27T14:30:01.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.793+0000 7f5fc959b700 1 --2- 172.21.15.115:0/881041152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4151bd0 0x7f5fc4062320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f5fc0009760 tx=0x7f5fc0009060).ready entity=mon.0 client_cookie=e9a2fb656fc55da1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:01.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.793+0000 7f5fbbfff700 1 -- 172.21.15.115:0/881041152 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc000b580 con 0x7f5fc4151bd0 2023-07-27T14:30:01.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.793+0000 7f5fbbfff700 1 -- 172.21.15.115:0/881041152 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc000b6e0 con 0x7f5fc4151bd0 2023-07-27T14:30:01.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.793+0000 7f5fbbfff700 1 -- 172.21.15.115:0/881041152 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc000ba60 con 0x7f5fc4151bd0 2023-07-27T14:30:01.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.794+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/881041152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4151bd0 msgr2=0x7f5fc4062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.794+0000 7f5fcb7ff700 1 --2- 172.21.15.115:0/881041152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4151bd0 0x7f5fc4062320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f5fc0009760 tx=0x7f5fc0009060).stop 2023-07-27T14:30:01.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.794+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/881041152 shutdown_connections 2023-07-27T14:30:01.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.794+0000 7f5fcb7ff700 1 --2- 172.21.15.115:0/881041152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4151bd0 0x7f5fc4062320 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.794+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/881041152 >> 172.21.15.115:0/881041152 conn(0x7f5fc4064700 msgr2=0x7f5fc4064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:01.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.794+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/881041152 shutdown_connections 2023-07-27T14:30:01.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.794+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/881041152 wait complete. 2023-07-27T14:30:01.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.795+0000 7f5fcb7ff700 1 Processor -- start 2023-07-27T14:30:01.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.795+0000 7f5fcb7ff700 1 -- start start 2023-07-27T14:30:01.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.796+0000 7f5fcb7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc4062810 0x7f5fc4135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.796+0000 7f5fcb7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc40a4f50 0x7f5fc4138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.796+0000 7f5fcb7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc4151bd0 0x7f5fc4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.796+0000 7f5fcb7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40a8370 con 0x7f5fc40a4f50 2023-07-27T14:30:01.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.796+0000 7f5fcb7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40a74c0 con 0x7f5fc4062810 2023-07-27T14:30:01.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.796+0000 7f5fcb7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40a7760 con 0x7f5fc4151bd0 2023-07-27T14:30:01.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.796+0000 7f5fc8d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc40a4f50 0x7f5fc4138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc8d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc40a4f50 0x7f5fc4138850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52218/0 (socket says 172.21.15.115:52218) 2023-07-27T14:30:01.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc8d9a700 1 -- 172.21.15.115:0/504242028 learned_addr learned my addr 172.21.15.115:0/504242028 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:01.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc959b700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc4062810 0x7f5fc4135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc9d9c700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc4151bd0 0x7f5fc4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc8d9a700 1 -- 172.21.15.115:0/504242028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc4151bd0 msgr2=0x7f5fc4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc8d9a700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc4151bd0 0x7f5fc4138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc8d9a700 1 -- 172.21.15.115:0/504242028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc4062810 msgr2=0x7f5fc4135dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc8d9a700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc4062810 0x7f5fc4135dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc8d9a700 1 -- 172.21.15.115:0/504242028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00092a0 con 0x7f5fc40a4f50 2023-07-27T14:30:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fc8d9a700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc40a4f50 0x7f5fc4138850 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f5fb400c4c0 tx=0x7f5fb4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fb97fa700 1 -- 172.21.15.115:0/504242028 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400ce70 con 0x7f5fc40a4f50 2023-07-27T14:30:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fb97fa700 1 -- 172.21.15.115:0/504242028 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4001e90 con 0x7f5fc40a4f50 2023-07-27T14:30:01.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fb97fa700 1 -- 172.21.15.115:0/504242028 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4007250 con 0x7f5fc40a4f50 2023-07-27T14:30:01.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.797+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc40a7a40 con 0x7f5fc40a4f50 2023-07-27T14:30:01.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.798+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc40a8000 con 0x7f5fc40a4f50 2023-07-27T14:30:01.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.798+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc40a84e0 con 0x7f5fc40a4f50 2023-07-27T14:30:01.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.799+0000 7f5fb97fa700 1 -- 172.21.15.115:0/504242028 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f5fb4010070 con 0x7f5fc40a4f50 2023-07-27T14:30:01.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.800+0000 7f5fb97fa700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa805f060 0x7f5fa8061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:01.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.801+0000 7f5fb97fa700 1 -- 172.21.15.115:0/504242028 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f5fb4079850 con 0x7f5fc40a4f50 2023-07-27T14:30:01.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.801+0000 7f5fc959b700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa805f060 0x7f5fa8061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:01.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.801+0000 7f5fc959b700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa805f060 0x7f5fa8061520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5fc000b340 tx=0x7f5fc0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:01.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.805+0000 7f5fb97fa700 1 -- 172.21.15.115:0/504242028 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fb404a980 con 0x7f5fc40a4f50 2023-07-27T14:30:02.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.977+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc406c470 con 0x7f5fc40a4f50 2023-07-27T14:30:02.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.978+0000 7f5fb97fa700 1 -- 172.21.15.115:0/504242028 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17327 (secure 0 0 0) 0x7f5fb404dfa0 con 0x7f5fc40a4f50 2023-07-27T14:30:02.005 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:02.006 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":56,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:30:01.572122+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:29:13.551102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-27T14:29:14.136450+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:30:02.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa805f060 msgr2=0x7f5fa8061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa805f060 0x7f5fa8061520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5fc000b340 tx=0x7f5fc0017000).stop 2023-07-27T14:30:02.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc40a4f50 msgr2=0x7f5fc4138850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc40a4f50 0x7f5fc4138850 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f5fb400c4c0 tx=0x7f5fb4007e00).stop 2023-07-27T14:30:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 shutdown_connections 2023-07-27T14:30:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa805f060 0x7f5fa8061520 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc4151bd0 0x7f5fc4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc4062810 0x7f5fc4135dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 --2- 172.21.15.115:0/504242028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc40a4f50 0x7f5fc4138850 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 >> 172.21.15.115:0/504242028 conn(0x7f5fc4064700 msgr2=0x7f5fc4069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 shutdown_connections 2023-07-27T14:30:02.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:01.980+0000 7f5fcb7ff700 1 -- 172.21.15.115:0/504242028 wait complete. 2023-07-27T14:30:02.024 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:30:02.025 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:30:02.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.187+0000 7ff0aa5ff700 1 Processor -- start 2023-07-27T14:30:02.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.187+0000 7ff0aa5ff700 1 -- start start 2023-07-27T14:30:02.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.188+0000 7ff0aa5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4151d70 0x7ff0a4155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.188+0000 7ff0aa5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0a4066b80 0x7ff0a4067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.188+0000 7ff0aa5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a4067080 con 0x7ff0a4065ff0 2023-07-27T14:30:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.188+0000 7ff0aa5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a4063a90 con 0x7ff0a4066b80 2023-07-27T14:30:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.188+0000 7ff0aa5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40634d0 con 0x7ff0a4151d70 2023-07-27T14:30:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a8b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0a4066b80 0x7ff0a4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a8b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0a4066b80 0x7ff0a4067560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52232/0 (socket says 172.21.15.115:52232) 2023-07-27T14:30:02.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a8b9c700 1 -- 172.21.15.115:0/4107655439 learned_addr learned my addr 172.21.15.115:0/4107655439 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:02.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a37fe700 1 --1- 172.21.15.115:0/4107655439 >> v1:172.21.15.115:6789/0 conn(0x7ff0a4065ff0 0x7ff0a4066470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55074/0 (socket says 172.21.15.115:55074) 2023-07-27T14:30:02.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a3fff700 1 --2- 172.21.15.115:0/4107655439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4151d70 0x7ff0a4155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a8b9c700 1 -- 172.21.15.115:0/4107655439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4151d70 msgr2=0x7ff0a4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:02.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a8b9c700 1 --2- 172.21.15.115:0/4107655439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4151d70 0x7ff0a4155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a8b9c700 1 -- 172.21.15.115:0/4107655439 >> v1:172.21.15.115:6789/0 conn(0x7ff0a4065ff0 legacy=0x7ff0a4066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a2ffd700 1 -- 172.21.15.115:0/4107655439 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851998378 0 0) 0x7ff0a4067080 con 0x7ff0a4065ff0 2023-07-27T14:30:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a8b9c700 1 -- 172.21.15.115:0/4107655439 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40637b0 con 0x7ff0a4066b80 2023-07-27T14:30:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.189+0000 7ff0a8b9c700 1 --2- 172.21.15.115:0/4107655439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4066b80 0x7ff0a4067560 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7ff09c009f20 tx=0x7ff09c009840).ready entity=mon.0 client_cookie=7cb74e1c59f6f1e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0a2ffd700 1 -- 172.21.15.115:0/4107655439 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00e070 con 0x7ff0a4066b80 2023-07-27T14:30:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0a2ffd700 1 -- 172.21.15.115:0/4107655439 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c00ba80 con 0x7ff0a4066b80 2023-07-27T14:30:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0a2ffd700 1 -- 172.21.15.115:0/4107655439 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00be00 con 0x7ff0a4066b80 2023-07-27T14:30:02.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/4107655439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4066b80 msgr2=0x7ff0a4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/4107655439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4066b80 0x7ff0a4067560 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7ff09c009f20 tx=0x7ff09c009840).stop 2023-07-27T14:30:02.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/4107655439 shutdown_connections 2023-07-27T14:30:02.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/4107655439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4151d70 0x7ff0a4155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/4107655439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4066b80 0x7ff0a4067560 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/4107655439 >> 172.21.15.115:0/4107655439 conn(0x7ff0a40c89a0 msgr2=0x7ff0a40c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:02.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/4107655439 shutdown_connections 2023-07-27T14:30:02.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.190+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/4107655439 wait complete. 2023-07-27T14:30:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.192+0000 7ff0aa5ff700 1 Processor -- start 2023-07-27T14:30:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.192+0000 7ff0aa5ff700 1 -- start start 2023-07-27T14:30:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0aa5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4065ff0 0x7ff0a40c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0aa5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a4066b80 0x7ff0a4168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0aa5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4151d70 0x7ff0a40c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0aa5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40ad2f0 con 0x7ff0a4151d70 2023-07-27T14:30:02.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0aa5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40c1b50 con 0x7ff0a4066b80 2023-07-27T14:30:02.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0aa5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40c0fd0 con 0x7ff0a4065ff0 2023-07-27T14:30:02.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0a8b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4151d70 0x7ff0a40c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0a8b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4151d70 0x7ff0a40c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52246/0 (socket says 172.21.15.115:52246) 2023-07-27T14:30:02.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0a8b9c700 1 -- 172.21.15.115:0/3069515129 learned_addr learned my addr 172.21.15.115:0/3069515129 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:02.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0a3fff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4065ff0 0x7ff0a40c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.193+0000 7ff0a37fe700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a4066b80 0x7ff0a4168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff0a8b9c700 1 -- 172.21.15.115:0/3069515129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4065ff0 msgr2=0x7ff0a40c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff0a8b9c700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4065ff0 0x7ff0a40c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff0a8b9c700 1 -- 172.21.15.115:0/3069515129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a4066b80 msgr2=0x7ff0a4168590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff0a8b9c700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a4066b80 0x7ff0a4168590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff0a8b9c700 1 -- 172.21.15.115:0/3069515129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c009ae0 con 0x7ff0a4151d70 2023-07-27T14:30:02.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff0a8b9c700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4151d70 0x7ff0a40c7ca0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7ff0a4060790 tx=0x7ff09c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff08bfff700 1 -- 172.21.15.115:0/3069515129 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c0092e0 con 0x7ff0a4151d70 2023-07-27T14:30:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff08bfff700 1 -- 172.21.15.115:0/3069515129 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c01d410 con 0x7ff0a4151d70 2023-07-27T14:30:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff08bfff700 1 -- 172.21.15.115:0/3069515129 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c01d7d0 con 0x7ff0a4151d70 2023-07-27T14:30:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a40c12b0 con 0x7ff0a4151d70 2023-07-27T14:30:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.194+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a40c1870 con 0x7ff0a4151d70 2023-07-27T14:30:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.195+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a406c470 con 0x7ff0a4151d70 2023-07-27T14:30:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.196+0000 7ff08bfff700 1 -- 172.21.15.115:0/3069515129 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7ff09c01b040 con 0x7ff0a4151d70 2023-07-27T14:30:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.197+0000 7ff08bfff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff09005f060 0x7ff090061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.197+0000 7ff08bfff700 1 -- 172.21.15.115:0/3069515129 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6265+0+0 (secure 0 0 0) 0x7ff09c07b980 con 0x7ff0a4151d70 2023-07-27T14:30:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.197+0000 7ff0a3fff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff09005f060 0x7ff090061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.197+0000 7ff0a3fff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff09005f060 0x7ff090061520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ff09400ab30 tx=0x7ff094008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:02.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.201+0000 7ff08bfff700 1 -- 172.21.15.115:0/3069515129 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff09c04ccf0 con 0x7ff0a4151d70 2023-07-27T14:30:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.409+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0a40a5bf0 con 0x7ff0a4151d70 2023-07-27T14:30:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.409+0000 7ff08bfff700 1 -- 172.21.15.115:0/3069515129 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4501 (secure 0 0 0) 0x7ff09c01c370 con 0x7ff0a4151d70 2023-07-27T14:30:02.437 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:02.437 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1259074753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1259074753},{"type":"v1","addr":"172.21.15.115:6837","nonce":1259074753}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1004586884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1004586884},{"type":"v1","addr":"172.21.15.159:6834","nonce":1004586884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2086004294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2086004294},{"type":"v1","addr":"172.21.15.159:6835","nonce":2086004294}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:29:15.154553+0000","modified":"2023-07-27T14:29:18.168905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1707534394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1707534394},{"type":"v1","addr":"172.21.15.115:6836","nonce":1707534394}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-07-27T14:30:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.411+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff09005f060 msgr2=0x7ff090061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.411+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff09005f060 0x7ff090061520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ff09400ab30 tx=0x7ff094008040).stop 2023-07-27T14:30:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.411+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4151d70 msgr2=0x7ff0a40c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.411+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4151d70 0x7ff0a40c7ca0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7ff0a4060790 tx=0x7ff09c009840).stop 2023-07-27T14:30:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.412+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 shutdown_connections 2023-07-27T14:30:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.412+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff09005f060 0x7ff090061520 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.412+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a4151d70 0x7ff0a40c7ca0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.412+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a4065ff0 0x7ff0a40c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.412+0000 7ff0aa5ff700 1 --2- 172.21.15.115:0/3069515129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a4066b80 0x7ff0a4168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.412+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 >> 172.21.15.115:0/3069515129 conn(0x7ff0a40c89a0 msgr2=0x7ff0a40c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.412+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 shutdown_connections 2023-07-27T14:30:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.412+0000 7ff0aa5ff700 1 -- 172.21.15.115:0/3069515129 wait complete. 2023-07-27T14:30:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 26 2023-07-27T14:30:02.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:30:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.617+0000 7f23cc1ff700 1 Processor -- start 2023-07-27T14:30:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.617+0000 7f23cc1ff700 1 -- start start 2023-07-27T14:30:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.618+0000 7f23cc1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23c4153ec0 0x7f23c40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.618+0000 7f23cc1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f23c40aa050 0x7f23c40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.618+0000 7f23cc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.618+0000 7f23cc1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c4064ad0 con 0x7f23c4153ec0 2023-07-27T14:30:02.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.618+0000 7f23cc1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c40aa4d0 con 0x7f23c40aa050 2023-07-27T14:30:02.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.618+0000 7f23cc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c40c05c0 con 0x7f23c40aaa40 2023-07-27T14:30:02.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.618+0000 7f23c9f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23c4153ec0 0x7f23c40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c9f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23c4153ec0 0x7f23c40a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52252/0 (socket says 172.21.15.115:52252) 2023-07-27T14:30:02.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c9f9b700 1 -- 172.21.15.115:0/2683641539 learned_addr learned my addr 172.21.15.115:0/2683641539 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:02.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23ca79c700 1 --2- 172.21.15.115:0/2683641539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c979a700 1 --2- 172.21.15.115:0/2683641539 >> v2:172.21.15.159:3300/0 conn(0x7f23c40aa050 0x7f23c40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c9f9b700 1 -- 172.21.15.115:0/2683641539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 msgr2=0x7f23c40645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c9f9b700 1 --2- 172.21.15.115:0/2683641539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c40645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c9f9b700 1 -- 172.21.15.115:0/2683641539 >> v2:172.21.15.159:3300/0 conn(0x7f23c40aa050 msgr2=0x7f23c40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c9f9b700 1 --2- 172.21.15.115:0/2683641539 >> v2:172.21.15.159:3300/0 conn(0x7f23c40aa050 0x7f23c40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c9f9b700 1 -- 172.21.15.115:0/2683641539 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40bfc90 con 0x7f23c4153ec0 2023-07-27T14:30:02.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23ca79c700 1 --2- 172.21.15.115:0/2683641539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c40645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:02.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c9f9b700 1 --2- 172.21.15.115:0/2683641539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4153ec0 0x7f23c40a9b60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f23c406c0d0 tx=0x7f23c00090f0).ready entity=mon.0 client_cookie=ee198cb06664c2e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:02.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c8f99700 1 -- 172.21.15.115:0/2683641539 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000f510 con 0x7f23c4153ec0 2023-07-27T14:30:02.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c8f99700 1 -- 172.21.15.115:0/2683641539 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000f670 con 0x7f23c4153ec0 2023-07-27T14:30:02.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.619+0000 7f23c8f99700 1 -- 172.21.15.115:0/2683641539 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000fa10 con 0x7f23c4153ec0 2023-07-27T14:30:02.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 -- 172.21.15.115:0/2683641539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4153ec0 msgr2=0x7f23c40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/2683641539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4153ec0 0x7f23c40a9b60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f23c406c0d0 tx=0x7f23c00090f0).stop 2023-07-27T14:30:02.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 -- 172.21.15.115:0/2683641539 shutdown_connections 2023-07-27T14:30:02.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/2683641539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c40645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/2683641539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4153ec0 0x7f23c40a9b60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/2683641539 >> v2:172.21.15.159:3300/0 conn(0x7f23c40aa050 0x7f23c40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 -- 172.21.15.115:0/2683641539 >> 172.21.15.115:0/2683641539 conn(0x7f23c40cb610 msgr2=0x7f23c40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:02.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 -- 172.21.15.115:0/2683641539 shutdown_connections 2023-07-27T14:30:02.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.620+0000 7f23cc1ff700 1 -- 172.21.15.115:0/2683641539 wait complete. 2023-07-27T14:30:02.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.622+0000 7f23cc1ff700 1 Processor -- start 2023-07-27T14:30:02.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.622+0000 7f23cc1ff700 1 -- start start 2023-07-27T14:30:02.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23cc1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c40aa050 0x7f23c40c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23cc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23cc1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4153ec0 0x7f23c4152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23cc1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c414f300 con 0x7f23c40aa050 2023-07-27T14:30:02.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23cc1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c40c3630 con 0x7f23c4153ec0 2023-07-27T14:30:02.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23cc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c40c2d50 con 0x7f23c40aaa40 2023-07-27T14:30:02.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23c9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c40aa050 0x7f23c40c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23c9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c40aa050 0x7f23c40c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52266/0 (socket says 172.21.15.115:52266) 2023-07-27T14:30:02.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.623+0000 7f23c9f9b700 1 -- 172.21.15.115:0/999125065 learned_addr learned my addr 172.21.15.115:0/999125065 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:02.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23ca79c700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4153ec0 0x7f23c4152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23c979a700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23c9f9b700 1 -- 172.21.15.115:0/999125065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 msgr2=0x7f23c413ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23c9f9b700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c413ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23c9f9b700 1 -- 172.21.15.115:0/999125065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4153ec0 msgr2=0x7f23c4152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23c9f9b700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4153ec0 0x7f23c4152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23c9f9b700 1 -- 172.21.15.115:0/999125065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc009a20 con 0x7f23c40aa050 2023-07-27T14:30:02.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23c9f9b700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c40aa050 0x7f23c40c3ac0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f23c0006fd0 tx=0x7f23c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:02.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23b9ffb700 1 -- 172.21.15.115:0/999125065 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0006950 con 0x7f23c40aa050 2023-07-27T14:30:02.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23b9ffb700 1 -- 172.21.15.115:0/999125065 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0000bc0 con 0x7f23c40aa050 2023-07-27T14:30:02.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23b9ffb700 1 -- 172.21.15.115:0/999125065 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0024470 con 0x7f23c40aa050 2023-07-27T14:30:02.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.624+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c0009370 con 0x7f23c40aa050 2023-07-27T14:30:02.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.625+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c40c2fe0 con 0x7f23c40aa050 2023-07-27T14:30:02.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.625+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c406c470 con 0x7f23c40aa050 2023-07-27T14:30:02.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.626+0000 7f23b9ffb700 1 -- 172.21.15.115:0/999125065 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f23c000f070 con 0x7f23c40aa050 2023-07-27T14:30:02.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.627+0000 7f23b9ffb700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23a805f060 0x7f23a8061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:02.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.627+0000 7f23b9ffb700 1 -- 172.21.15.115:0/999125065 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f23c007ba70 con 0x7f23c40aa050 2023-07-27T14:30:02.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.627+0000 7f23c979a700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23a805f060 0x7f23a8061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:02.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.628+0000 7f23c979a700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23a805f060 0x7f23a8061520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f23c414ea80 tx=0x7f23b4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:02.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.631+0000 7f23b9ffb700 1 -- 172.21.15.115:0/999125065 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f23c004ccb0 con 0x7f23c40aa050 2023-07-27T14:30:02.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.844+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23c40c3910 con 0x7f23c40aa050 2023-07-27T14:30:02.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.845+0000 7f23b9ffb700 1 -- 172.21.15.115:0/999125065 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f23c007be60 con 0x7f23c40aa050 2023-07-27T14:30:02.872 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:02.872 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1259074753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1259074753},{"type":"v1","addr":"172.21.15.115:6837","nonce":1259074753}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1004586884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1004586884},{"type":"v1","addr":"172.21.15.159:6834","nonce":1004586884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2086004294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2086004294},{"type":"v1","addr":"172.21.15.159:6835","nonce":2086004294}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:29:15.154553+0000","modified":"2023-07-27T14:29:18.168905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1707534394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1707534394},{"type":"v1","addr":"172.21.15.115:6836","nonce":1707534394}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-07-27T14:30:02.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23a805f060 msgr2=0x7f23a8061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23a805f060 0x7f23a8061520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f23c414ea80 tx=0x7f23b4009060).stop 2023-07-27T14:30:02.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c40aa050 msgr2=0x7f23c40c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:02.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c40aa050 0x7f23c40c3ac0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f23c0006fd0 tx=0x7f23c0017000).stop 2023-07-27T14:30:02.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 shutdown_connections 2023-07-27T14:30:02.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23a805f060 0x7f23a8061520 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4153ec0 0x7f23c4152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c40aa050 0x7f23c40c3ac0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 --2- 172.21.15.115:0/999125065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40aaa40 0x7f23c413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:02.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 >> 172.21.15.115:0/999125065 conn(0x7f23c40cb610 msgr2=0x7f23c40c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:02.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 shutdown_connections 2023-07-27T14:30:02.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:02.847+0000 7f23cc1ff700 1 -- 172.21.15.115:0/999125065 wait complete. 2023-07-27T14:30:02.876 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 26 2023-07-27T14:30:02.892 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:30:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.052+0000 7f0bda7ff700 1 Processor -- start 2023-07-27T14:30:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.052+0000 7f0bda7ff700 1 -- start start 2023-07-27T14:30:03.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.053+0000 7f0bda7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0bd40aaa40 0x7f0bd40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.053+0000 7f0bda7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd41542a0 0x7f0bd40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.053+0000 7f0bda7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd40aa4d0 con 0x7f0bd4153ec0 2023-07-27T14:30:03.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.053+0000 7f0bda7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd4064ad0 con 0x7f0bd40aaa40 2023-07-27T14:30:03.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.053+0000 7f0bda7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40c05c0 con 0x7f0bd41542a0 2023-07-27T14:30:03.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0bd40aaa40 0x7f0bd40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0bd40aaa40 0x7f0bd40640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52272/0 (socket says 172.21.15.115:52272) 2023-07-27T14:30:03.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd37fe700 1 -- 172.21.15.115:0/1977361903 learned_addr learned my addr 172.21.15.115:0/1977361903 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:03.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd8d9c700 1 --2- 172.21.15.115:0/1977361903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd41542a0 0x7f0bd40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd37fe700 1 -- 172.21.15.115:0/1977361903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd41542a0 msgr2=0x7f0bd40645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:03.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd37fe700 1 --2- 172.21.15.115:0/1977361903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd41542a0 0x7f0bd40645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd37fe700 1 -- 172.21.15.115:0/1977361903 >> v1:172.21.15.159:6789/0 conn(0x7f0bd4153ec0 legacy=0x7f0bd40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:03.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd37fe700 1 -- 172.21.15.115:0/1977361903 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd40c1a60 con 0x7f0bd40aaa40 2023-07-27T14:30:03.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd37fe700 1 --2- 172.21.15.115:0/1977361903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd40aaa40 0x7f0bd40640f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f0bc8006fd0 tx=0x7f0bc80090f0).ready entity=mon.0 client_cookie=77f944fbbc5ca827 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.054+0000 7f0bd2ffd700 1 -- 172.21.15.115:0/1977361903 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800b600 con 0x7f0bd40aaa40 2023-07-27T14:30:03.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bd2ffd700 1 -- 172.21.15.115:0/1977361903 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800b760 con 0x7f0bd40aaa40 2023-07-27T14:30:03.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bd2ffd700 1 -- 172.21.15.115:0/1977361903 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800bae0 con 0x7f0bd40aaa40 2023-07-27T14:30:03.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bda7ff700 1 -- 172.21.15.115:0/1977361903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd40aaa40 msgr2=0x7f0bd40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/1977361903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd40aaa40 0x7f0bd40640f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f0bc8006fd0 tx=0x7f0bc80090f0).stop 2023-07-27T14:30:03.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bda7ff700 1 -- 172.21.15.115:0/1977361903 shutdown_connections 2023-07-27T14:30:03.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/1977361903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd41542a0 0x7f0bd40645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/1977361903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd40aaa40 0x7f0bd40640f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bda7ff700 1 -- 172.21.15.115:0/1977361903 >> 172.21.15.115:0/1977361903 conn(0x7f0bd40cb610 msgr2=0x7f0bd40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:03.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bda7ff700 1 -- 172.21.15.115:0/1977361903 shutdown_connections 2023-07-27T14:30:03.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.055+0000 7f0bda7ff700 1 -- 172.21.15.115:0/1977361903 wait complete. 2023-07-27T14:30:03.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.057+0000 7f0bda7ff700 1 Processor -- start 2023-07-27T14:30:03.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.057+0000 7f0bda7ff700 1 -- start start 2023-07-27T14:30:03.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bda7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd40aaa40 0x7f0bd414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bda7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd4153ec0 0x7f0bd40adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bda7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd41542a0 0x7f0bd414f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bda7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd414f000 con 0x7f0bd4153ec0 2023-07-27T14:30:03.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bda7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd414e3f0 con 0x7f0bd41542a0 2023-07-27T14:30:03.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bda7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd414e6d0 con 0x7f0bd40aaa40 2023-07-27T14:30:03.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd4153ec0 0x7f0bd40adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd4153ec0 0x7f0bd40adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52284/0 (socket says 172.21.15.115:52284) 2023-07-27T14:30:03.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd37fe700 1 -- 172.21.15.115:0/3174881079 learned_addr learned my addr 172.21.15.115:0/3174881079 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd8d9c700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd41542a0 0x7f0bd414f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd3fff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd40aaa40 0x7f0bd414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd37fe700 1 -- 172.21.15.115:0/3174881079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd40aaa40 msgr2=0x7f0bd414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd37fe700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd40aaa40 0x7f0bd414dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd37fe700 1 -- 172.21.15.115:0/3174881079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd41542a0 msgr2=0x7f0bd414f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd37fe700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd41542a0 0x7f0bd414f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.058+0000 7f0bd37fe700 1 -- 172.21.15.115:0/3174881079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8009370 con 0x7f0bd4153ec0 2023-07-27T14:30:03.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.059+0000 7f0bd37fe700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd4153ec0 0x7f0bd40adb40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f0bc8011000 tx=0x7f0bc8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.059+0000 7f0bbbfff700 1 -- 172.21.15.115:0/3174881079 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8006a40 con 0x7f0bd4153ec0 2023-07-27T14:30:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.059+0000 7f0bbbfff700 1 -- 172.21.15.115:0/3174881079 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800b8d0 con 0x7f0bd4153ec0 2023-07-27T14:30:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.059+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd414e9b0 con 0x7f0bd4153ec0 2023-07-27T14:30:03.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.059+0000 7f0bbbfff700 1 -- 172.21.15.115:0/3174881079 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc801c670 con 0x7f0bd4153ec0 2023-07-27T14:30:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.059+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd414dfc0 con 0x7f0bd4153ec0 2023-07-27T14:30:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.060+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd40aa190 con 0x7f0bd4153ec0 2023-07-27T14:30:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.061+0000 7f0bbbfff700 1 -- 172.21.15.115:0/3174881079 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f0bc800f070 con 0x7f0bd4153ec0 2023-07-27T14:30:03.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.061+0000 7f0bbbfff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0bc005f060 0x7f0bc0061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.061+0000 7f0bbbfff700 1 -- 172.21.15.115:0/3174881079 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f0bc807b5d0 con 0x7f0bd4153ec0 2023-07-27T14:30:03.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.062+0000 7f0bd3fff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0bc005f060 0x7f0bc0061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.062+0000 7f0bd3fff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0bc005f060 0x7f0bc0061520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0bc40036e0 tx=0x7f0bc4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.066+0000 7f0bbbfff700 1 -- 172.21.15.115:0/3174881079 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0bc804c840 con 0x7f0bd4153ec0 2023-07-27T14:30:03.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.242+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bd40aa4d0 con 0x7f0bd4153ec0 2023-07-27T14:30:03.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.243+0000 7f0bbbfff700 1 -- 172.21.15.115:0/3174881079 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17327 (secure 0 0 0) 0x7f0bd40aa4d0 con 0x7f0bd4153ec0 2023-07-27T14:30:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:03.271 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":56,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:30:01.572122+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:29:13.551102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-27T14:29:14.136450+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:30:03.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0bc005f060 msgr2=0x7f0bc0061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0bc005f060 0x7f0bc0061520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0bc40036e0 tx=0x7f0bc4009040).stop 2023-07-27T14:30:03.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd4153ec0 msgr2=0x7f0bd40adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd4153ec0 0x7f0bd40adb40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f0bc8011000 tx=0x7f0bc8017000).stop 2023-07-27T14:30:03.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 shutdown_connections 2023-07-27T14:30:03.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0bc005f060 0x7f0bc0061520 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bd41542a0 0x7f0bd414f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bd40aaa40 0x7f0bd414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 --2- 172.21.15.115:0/3174881079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bd4153ec0 0x7f0bd40adb40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 >> 172.21.15.115:0/3174881079 conn(0x7f0bd40cb610 msgr2=0x7f0bd4152cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:03.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 shutdown_connections 2023-07-27T14:30:03.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.245+0000 7f0bda7ff700 1 -- 172.21.15.115:0/3174881079 wait complete. 2023-07-27T14:30:03.289 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:30:03.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.451+0000 7fc03d5ff700 1 Processor -- start 2023-07-27T14:30:03.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.451+0000 7fc03d5ff700 1 -- start start 2023-07-27T14:30:03.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc03d5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0381542a0 0x7fc03815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc03d5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380aa4d0 con 0x7fc0380aaa40 2023-07-27T14:30:03.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc03d5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380c05c0 con 0x7fc038153ec0 2023-07-27T14:30:03.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc03d5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0380c1a60 con 0x7fc0381542a0 2023-07-27T14:30:03.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc0367fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc0380aaa40 0x7fc0380640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55078/0 (socket says 172.21.15.115:55078) 2023-07-27T14:30:03.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc0367fc700 1 -- 172.21.15.115:0/1896826498 learned_addr learned my addr 172.21.15.115:0/1896826498 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:03.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc0377fe700 1 --2- 172.21.15.115:0/1896826498 >> v2:172.21.15.115:3300/0 conn(0x7fc0381542a0 0x7fc03815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc035ffb700 1 -- 172.21.15.115:0/1896826498 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126610710 0 0) 0x7fc02c001110 con 0x7fc0380aaa40 2023-07-27T14:30:03.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.453+0000 7fc035ffb700 1 -- 172.21.15.115:0/1896826498 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0200033f0 con 0x7fc0380aaa40 2023-07-27T14:30:03.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc0377fe700 1 -- 172.21.15.115:0/1896826498 >> v1:172.21.15.159:6789/0 conn(0x7fc038153ec0 legacy=0x7fc0380a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc0377fe700 1 -- 172.21.15.115:0/1896826498 >> v1:172.21.15.115:6789/0 conn(0x7fc0380aaa40 legacy=0x7fc0380640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc0377fe700 1 -- 172.21.15.115:0/1896826498 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380aa270 con 0x7fc0381542a0 2023-07-27T14:30:03.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc0377fe700 1 --2- 172.21.15.115:0/1896826498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc03815efc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fc030009e60 tx=0x7fc030009780).ready entity=mon.0 client_cookie=37c91bfb897485b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc035ffb700 1 -- 172.21.15.115:0/1896826498 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000e070 con 0x7fc0381542a0 2023-07-27T14:30:03.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc035ffb700 1 -- 172.21.15.115:0/1896826498 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03000bb60 con 0x7fc0381542a0 2023-07-27T14:30:03.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc035ffb700 1 -- 172.21.15.115:0/1896826498 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030012410 con 0x7fc0381542a0 2023-07-27T14:30:03.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1896826498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 msgr2=0x7fc03815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.454+0000 7fc03d5ff700 1 --2- 172.21.15.115:0/1896826498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc03815efc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fc030009e60 tx=0x7fc030009780).stop 2023-07-27T14:30:03.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.455+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1896826498 shutdown_connections 2023-07-27T14:30:03.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.455+0000 7fc03d5ff700 1 --2- 172.21.15.115:0/1896826498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc03815efc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.455+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1896826498 >> 172.21.15.115:0/1896826498 conn(0x7fc0380cb610 msgr2=0x7fc0380c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:03.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.455+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1896826498 shutdown_connections 2023-07-27T14:30:03.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.455+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1896826498 wait complete. 2023-07-27T14:30:03.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.456+0000 7fc03d5ff700 1 Processor -- start 2023-07-27T14:30:03.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.456+0000 7fc03d5ff700 1 -- start start 2023-07-27T14:30:03.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.457+0000 7fc03d5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0380aaa40 0x7fc0380c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.457+0000 7fc03d5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc038153ec0 0x7fc03814f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.457+0000 7fc03d5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc0380c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.457+0000 7fc03d5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03814f500 con 0x7fc0381542a0 2023-07-27T14:30:03.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.457+0000 7fc03d5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380c4a30 con 0x7fc0380aaa40 2023-07-27T14:30:03.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.457+0000 7fc03d5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380c2210 con 0x7fc038153ec0 2023-07-27T14:30:03.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.457+0000 7fc0377fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc0380c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0377fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc0380c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52306/0 (socket says 172.21.15.115:52306) 2023-07-27T14:30:03.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0377fe700 1 -- 172.21.15.115:0/1413379046 learned_addr learned my addr 172.21.15.115:0/1413379046 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:03.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0367fc700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc038153ec0 0x7fc03814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc036ffd700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0380aaa40 0x7fc0380c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0377fe700 1 -- 172.21.15.115:0/1413379046 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc038153ec0 msgr2=0x7fc03814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0377fe700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc038153ec0 0x7fc03814f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0377fe700 1 -- 172.21.15.115:0/1413379046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0380aaa40 msgr2=0x7fc0380c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0377fe700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0380aaa40 0x7fc0380c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0377fe700 1 -- 172.21.15.115:0/1413379046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030009a20 con 0x7fc0381542a0 2023-07-27T14:30:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc0377fe700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc0380c4540 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fc030011000 tx=0x7fc0380c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc01effd700 1 -- 172.21.15.115:0/1413379046 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030012410 con 0x7fc0381542a0 2023-07-27T14:30:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc01effd700 1 -- 172.21.15.115:0/1413379046 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03001d630 con 0x7fc0381542a0 2023-07-27T14:30:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc01effd700 1 -- 172.21.15.115:0/1413379046 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03001d9d0 con 0x7fc0381542a0 2023-07-27T14:30:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.458+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0380c24f0 con 0x7fc0381542a0 2023-07-27T14:30:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.459+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0380c2ab0 con 0x7fc0381542a0 2023-07-27T14:30:03.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.459+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03806c470 con 0x7fc0381542a0 2023-07-27T14:30:03.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.460+0000 7fc01effd700 1 -- 172.21.15.115:0/1413379046 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fc03001dd40 con 0x7fc0381542a0 2023-07-27T14:30:03.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.461+0000 7fc01effd700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc02405f060 0x7fc024061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.461+0000 7fc01effd700 1 -- 172.21.15.115:0/1413379046 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fc03007bd60 con 0x7fc0381542a0 2023-07-27T14:30:03.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.461+0000 7fc036ffd700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc02405f060 0x7fc024061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.462+0000 7fc036ffd700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc02405f060 0x7fc024061520 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc028003900 tx=0x7fc028007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.465+0000 7fc01effd700 1 -- 172.21.15.115:0/1413379046 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc03004d0d0 con 0x7fc0381542a0 2023-07-27T14:30:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.680+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc0380bfc90 con 0x7fc0381542a0 2023-07-27T14:30:03.742 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:30:03.715+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:30:03.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.724+0000 7fc01effd700 1 -- 172.21.15.115:0/1413379046 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc0300506f0 con 0x7fc0381542a0 2023-07-27T14:30:03.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc02405f060 msgr2=0x7fc024061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc02405f060 0x7fc024061520 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc028003900 tx=0x7fc028007d40).stop 2023-07-27T14:30:03.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 msgr2=0x7fc0380c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc0380c4540 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fc030011000 tx=0x7fc0380c0530).stop 2023-07-27T14:30:03.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 shutdown_connections 2023-07-27T14:30:03.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc02405f060 0x7fc024061520 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0381542a0 0x7fc0380c4540 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0380aaa40 0x7fc0380c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 --2- 172.21.15.115:0/1413379046 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc038153ec0 0x7fc03814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.726+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 >> 172.21.15.115:0/1413379046 conn(0x7fc0380cb610 msgr2=0x7fc0380ac420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:03.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.727+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 shutdown_connections 2023-07-27T14:30:03.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.727+0000 7fc03d5ff700 1 -- 172.21.15.115:0/1413379046 wait complete. 2023-07-27T14:30:03.756 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:30:03.772 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:30:03.817 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:30:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.939+0000 7fe1fb7ff700 1 Processor -- start 2023-07-27T14:30:03.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.940+0000 7fe1fb7ff700 1 -- start start 2023-07-27T14:30:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.941+0000 7fe1fb7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1f414ae00 0x7fe1f4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.941+0000 7fe1fb7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f41553f0 con 0x7fe1f4063260 2023-07-27T14:30:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.941+0000 7fe1fb7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f4157a50 con 0x7fe1f414b1e0 2023-07-27T14:30:03.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.941+0000 7fe1fb7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f4157d10 con 0x7fe1f414ae00 2023-07-27T14:30:03.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.941+0000 7fe1f959b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1f414ae00 0x7fe1f4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.941+0000 7fe1f959b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1f414ae00 0x7fe1f4154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42366/0 (socket says 172.21.15.115:42366) 2023-07-27T14:30:03.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.941+0000 7fe1f959b700 1 -- 172.21.15.115:0/3920526833 learned_addr learned my addr 172.21.15.115:0/3920526833 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:03.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.941+0000 7fe1f9d9c700 1 --1- 172.21.15.115:0/3920526833 >> v1:172.21.15.115:6789/0 conn(0x7fe1f4063260 0x7fe1f40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50128/0 (socket says 172.21.15.115:50128) 2023-07-27T14:30:03.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.942+0000 7fe1f959b700 1 -- 172.21.15.115:0/3920526833 >> v1:172.21.15.159:6789/0 conn(0x7fe1f414b1e0 legacy=0x7fe1f4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.942+0000 7fe1f959b700 1 -- 172.21.15.115:0/3920526833 >> v1:172.21.15.115:6789/0 conn(0x7fe1f4063260 legacy=0x7fe1f40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.942+0000 7fe1f959b700 1 -- 172.21.15.115:0/3920526833 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4157ff0 con 0x7fe1f414ae00 2023-07-27T14:30:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.942+0000 7fe1f959b700 1 --2- 172.21.15.115:0/3920526833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f414ae00 0x7fe1f4154f00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fe1f0006fd0 tx=0x7fe1f00090f0).ready entity=mon.0 client_cookie=84e083654c24fe09 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.942+0000 7fe1ebfff700 1 -- 172.21.15.115:0/3920526833 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000b600 con 0x7fe1f414ae00 2023-07-27T14:30:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.942+0000 7fe1ebfff700 1 -- 172.21.15.115:0/3920526833 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000b760 con 0x7fe1f414ae00 2023-07-27T14:30:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.942+0000 7fe1ebfff700 1 -- 172.21.15.115:0/3920526833 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000bae0 con 0x7fe1f414ae00 2023-07-27T14:30:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.943+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/3920526833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f414ae00 msgr2=0x7fe1f4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.943+0000 7fe1fb7ff700 1 --2- 172.21.15.115:0/3920526833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f414ae00 0x7fe1f4154f00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fe1f0006fd0 tx=0x7fe1f00090f0).stop 2023-07-27T14:30:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.943+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/3920526833 shutdown_connections 2023-07-27T14:30:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.943+0000 7fe1fb7ff700 1 --2- 172.21.15.115:0/3920526833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f414ae00 0x7fe1f4154f00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.943+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/3920526833 >> 172.21.15.115:0/3920526833 conn(0x7fe1f405e940 msgr2=0x7fe1f40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.943+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/3920526833 shutdown_connections 2023-07-27T14:30:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.943+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/3920526833 wait complete. 2023-07-27T14:30:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.944+0000 7fe1fb7ff700 1 Processor -- start 2023-07-27T14:30:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.944+0000 7fe1fb7ff700 1 -- start start 2023-07-27T14:30:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1fb7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f4063260 0x7fe1f413fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1fb7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1f414ae00 0x7fe1f414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1fb7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1f414b1e0 0x7fe1f40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1fb7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f40add00 con 0x7fe1f4063260 2023-07-27T14:30:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1fb7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f40adfa0 con 0x7fe1f414b1e0 2023-07-27T14:30:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1fb7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f40ae280 con 0x7fe1f414ae00 2023-07-27T14:30:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1f959b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f4063260 0x7fe1f413fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1f959b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f4063260 0x7fe1f413fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42374/0 (socket says 172.21.15.115:42374) 2023-07-27T14:30:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.945+0000 7fe1f959b700 1 -- 172.21.15.115:0/573775438 learned_addr learned my addr 172.21.15.115:0/573775438 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1f959b700 1 -- 172.21.15.115:0/573775438 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1f414ae00 msgr2=0x7fe1f414eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1f959b700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1f414ae00 0x7fe1f414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1f959b700 1 -- 172.21.15.115:0/573775438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1f414b1e0 msgr2=0x7fe1f40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1f959b700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1f414b1e0 0x7fe1f40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1f959b700 1 -- 172.21.15.115:0/573775438 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0009370 con 0x7fe1f4063260 2023-07-27T14:30:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1f959b700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f4063260 0x7fe1f413fd50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fe1f4155580 tx=0x7fe1f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1e97fa700 1 -- 172.21.15.115:0/573775438 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000bae0 con 0x7fe1f4063260 2023-07-27T14:30:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1e97fa700 1 -- 172.21.15.115:0/573775438 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f0000c90 con 0x7fe1f4063260 2023-07-27T14:30:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f40ae560 con 0x7fe1f4063260 2023-07-27T14:30:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1e97fa700 1 -- 172.21.15.115:0/573775438 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f001c650 con 0x7fe1f4063260 2023-07-27T14:30:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.946+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f4140240 con 0x7fe1f4063260 2023-07-27T14:30:03.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.947+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f406c470 con 0x7fe1f4063260 2023-07-27T14:30:03.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.948+0000 7fe1e97fa700 1 -- 172.21.15.115:0/573775438 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fe1f000f070 con 0x7fe1f4063260 2023-07-27T14:30:03.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.949+0000 7fe1e97fa700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d805f030 0x7fe1d80614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.949+0000 7fe1e97fa700 1 -- 172.21.15.115:0/573775438 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6323+0+0 (secure 0 0 0) 0x7fe1f007b940 con 0x7fe1f4063260 2023-07-27T14:30:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.949+0000 7fe1f8d9a700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d805f030 0x7fe1d80614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.950+0000 7fe1f8d9a700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d805f030 0x7fe1d80614f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe1f414a310 tx=0x7fe1e40079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:03.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:03.953+0000 7fe1e97fa700 1 -- 172.21.15.115:0/573775438 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1f004ca30 con 0x7fe1f4063260 2023-07-27T14:30:04.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.165+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1f40645f0 con 0x7fe1f4063260 2023-07-27T14:30:04.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.729+0000 7fe1e97fa700 1 -- 172.21.15.115:0/573775438 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1f00200a0 con 0x7fe1f4063260 2023-07-27T14:30:04.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.731+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d805f030 msgr2=0x7fe1d80614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:04.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.731+0000 7fe1fb7ff700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d805f030 0x7fe1d80614f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe1f414a310 tx=0x7fe1e40079c0).stop 2023-07-27T14:30:04.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.731+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f4063260 msgr2=0x7fe1f413fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:04.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.731+0000 7fe1fb7ff700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f4063260 0x7fe1f413fd50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fe1f4155580 tx=0x7fe1f0017000).stop 2023-07-27T14:30:04.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.732+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 shutdown_connections 2023-07-27T14:30:04.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.732+0000 7fe1fb7ff700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1d805f030 0x7fe1d80614f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:04.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.732+0000 7fe1fb7ff700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1f414b1e0 0x7fe1f40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:04.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.732+0000 7fe1fb7ff700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1f4063260 0x7fe1f413fd50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:04.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.732+0000 7fe1fb7ff700 1 --2- 172.21.15.115:0/573775438 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1f414ae00 0x7fe1f414eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:04.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.732+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 >> 172.21.15.115:0/573775438 conn(0x7fe1f405e940 msgr2=0x7fe1f4153270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:04.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.732+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 shutdown_connections 2023-07-27T14:30:04.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.732+0000 7fe1fb7ff700 1 -- 172.21.15.115:0/573775438 wait complete. 2023-07-27T14:30:04.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:30:05.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.984+0000 7feea27ff700 1 Processor -- start 2023-07-27T14:30:05.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.984+0000 7feea27ff700 1 -- start start 2023-07-27T14:30:05.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.985+0000 7feea27ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fee9c13a350 0x7fee9c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.986+0000 7feea27ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0bd9a0 con 0x7fee9c0c36b0 2023-07-27T14:30:05.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.986+0000 7feea27ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c066610 con 0x7fee9c13a730 2023-07-27T14:30:05.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.986+0000 7feea27ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c066400 con 0x7fee9c13a350 2023-07-27T14:30:05.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.986+0000 7feea0d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fee9c0c36b0 0x7fee9c0be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50136/0 (socket says 172.21.15.115:50136) 2023-07-27T14:30:05.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.986+0000 7feea0d9c700 1 -- 172.21.15.115:0/3327588507 learned_addr learned my addr 172.21.15.115:0/3327588507 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:05.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.986+0000 7fee9bfff700 1 --2- 172.21.15.115:0/3327588507 >> v2:172.21.15.159:3300/0 conn(0x7fee9c13a350 0x7fee9c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.986+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652648677 0 0) 0x7fee9c0bd9a0 con 0x7fee9c0c36b0 2023-07-27T14:30:05.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.986+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee840033f0 con 0x7fee9c0c36b0 2023-07-27T14:30:05.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2546502331 0 0) 0x7fee840033f0 con 0x7fee9c0c36b0 2023-07-27T14:30:05.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 >> v2:172.21.15.159:3300/0 conn(0x7fee9c13a350 msgr2=0x7fee9c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:05.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 --2- 172.21.15.115:0/3327588507 >> v2:172.21.15.159:3300/0 conn(0x7fee9c13a350 0x7fee9c065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 >> v1:172.21.15.159:6789/0 conn(0x7fee9c13a730 legacy=0x7fee9c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0bdc10 con 0x7fee9c0c36b0 2023-07-27T14:30:05.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fee940017f0 con 0x7fee9c0c36b0 2023-07-27T14:30:05.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 >> v1:172.21.15.115:6789/0 conn(0x7fee9c0c36b0 legacy=0x7fee9c0be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee840038e0 0x7fee84003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee84004690 0x7fee84004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee84005000 0x7fee8400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c066400 con 0x7fee84004690 2023-07-27T14:30:05.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8400bf60 con 0x7fee840038e0 2023-07-27T14:30:05.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8400c0f0 con 0x7fee84005000 2023-07-27T14:30:05.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9b7fe700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee84004690 0x7fee84004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9bfff700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee840038e0 0x7fee84003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7feea0d9c700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee84005000 0x7fee8400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9b7fe700 1 -- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee84005000 msgr2=0x7fee8400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:05.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9b7fe700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee84005000 0x7fee8400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9b7fe700 1 -- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee840038e0 msgr2=0x7fee84003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:05.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9b7fe700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee840038e0 0x7fee84003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7fee9b7fe700 1 -- 172.21.15.115:0/3327588507 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee840033f0 con 0x7fee84004690 2023-07-27T14:30:05.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7feea0d9c700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee84005000 0x7fee8400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:05.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.987+0000 7feea0d9c700 1 -- 172.21.15.115:0/3327588507 reap_dead start 2023-07-27T14:30:05.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7fee9b7fe700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee84004690 0x7fee84004b10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fee90001730 tx=0x7fee90007bb0).ready entity=mon.0 client_cookie=dfb277517ca8a801 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:05.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90007020 con 0x7fee84004690 2023-07-27T14:30:05.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee90007180 con 0x7fee84004690 2023-07-27T14:30:05.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7fee9affd700 1 -- 172.21.15.115:0/3327588507 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90007520 con 0x7fee84004690 2023-07-27T14:30:05.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7feea27ff700 1 -- 172.21.15.115:0/3327588507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee84004690 msgr2=0x7fee84004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7feea27ff700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee84004690 0x7fee84004b10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fee90001730 tx=0x7fee90007bb0).stop 2023-07-27T14:30:05.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7feea27ff700 1 -- 172.21.15.115:0/3327588507 shutdown_connections 2023-07-27T14:30:05.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7feea27ff700 1 --2- 172.21.15.115:0/3327588507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee84004690 0x7fee84004b10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7feea27ff700 1 -- 172.21.15.115:0/3327588507 >> 172.21.15.115:0/3327588507 conn(0x7fee9c05e8f0 msgr2=0x7fee9c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:05.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7feea27ff700 1 -- 172.21.15.115:0/3327588507 shutdown_connections 2023-07-27T14:30:05.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.988+0000 7feea27ff700 1 -- 172.21.15.115:0/3327588507 wait complete. 2023-07-27T14:30:05.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.990+0000 7feea27ff700 1 Processor -- start 2023-07-27T14:30:05.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.990+0000 7feea27ff700 1 -- start start 2023-07-27T14:30:05.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7feea27ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee84004690 0x7fee9c0a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7feea27ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9c0a72d0 0x7fee9c138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7feea27ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee9c139340 0x7fee9c167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7feea27ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0a6850 con 0x7fee9c0a72d0 2023-07-27T14:30:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7feea27ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0c1c40 con 0x7fee84004690 2023-07-27T14:30:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7feea27ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c1397c0 con 0x7fee9c139340 2023-07-27T14:30:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7fee9b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9c0a72d0 0x7fee9c138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7fee9b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9c0a72d0 0x7fee9c138e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42384/0 (socket says 172.21.15.115:42384) 2023-07-27T14:30:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7fee9b7fe700 1 -- 172.21.15.115:0/3120323678 learned_addr learned my addr 172.21.15.115:0/3120323678 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7fee9bfff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee84004690 0x7fee9c0a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7feea0d9c700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee9c139340 0x7fee9c167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7fee9b7fe700 1 -- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee9c139340 msgr2=0x7fee9c167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.991+0000 7fee9b7fe700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee9c139340 0x7fee9c167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7fee9b7fe700 1 -- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee84004690 msgr2=0x7fee9c0a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7fee9b7fe700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee84004690 0x7fee9c0a6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7fee9b7fe700 1 -- 172.21.15.115:0/3120323678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0c1030 con 0x7fee9c0a72d0 2023-07-27T14:30:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7fee9bfff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee84004690 0x7fee9c0a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7fee9b7fe700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9c0a72d0 0x7fee9c138e50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fee90008fd0 tx=0x7fee90015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7fee83fff700 1 -- 172.21.15.115:0/3120323678 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90013740 con 0x7fee9c0a72d0 2023-07-27T14:30:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7fee83fff700 1 -- 172.21.15.115:0/3120323678 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee900138a0 con 0x7fee9c0a72d0 2023-07-27T14:30:05.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7fee83fff700 1 -- 172.21.15.115:0/3120323678 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90013c60 con 0x7fee9c0a72d0 2023-07-27T14:30:05.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c0c1310 con 0x7fee9c0a72d0 2023-07-27T14:30:05.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.992+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c0c18d0 con 0x7fee9c0a72d0 2023-07-27T14:30:05.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.993+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c0c1dd0 con 0x7fee9c0a72d0 2023-07-27T14:30:05.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.994+0000 7fee83fff700 1 -- 172.21.15.115:0/3120323678 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fee90010030 con 0x7fee9c0a72d0 2023-07-27T14:30:05.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.995+0000 7fee83fff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8805f060 0x7fee88061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.995+0000 7fee83fff700 1 -- 172.21.15.115:0/3120323678 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6323+0+0 (secure 0 0 0) 0x7fee9007afe0 con 0x7fee9c0a72d0 2023-07-27T14:30:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.996+0000 7fee9bfff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8805f060 0x7fee88061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.996+0000 7fee9bfff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8805f060 0x7fee88061520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fee9c066230 tx=0x7fee8c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:04.999+0000 7fee83fff700 1 -- 172.21.15.115:0/3120323678 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fee900a98f0 con 0x7fee9c0a72d0 2023-07-27T14:30:05.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.171+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fee9c06c470 con 0x7fee9c0a72d0 2023-07-27T14:30:05.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.734+0000 7fee83fff700 1 -- 172.21.15.115:0/3120323678 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7fee90025030 con 0x7fee9c0a72d0 2023-07-27T14:30:05.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8805f060 msgr2=0x7fee88061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8805f060 0x7fee88061520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fee9c066230 tx=0x7fee8c008040).stop 2023-07-27T14:30:05.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9c0a72d0 msgr2=0x7fee9c138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9c0a72d0 0x7fee9c138e50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fee90008fd0 tx=0x7fee90015000).stop 2023-07-27T14:30:05.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 shutdown_connections 2023-07-27T14:30:05.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8805f060 0x7fee88061520 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee9c139340 0x7fee9c167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee84004690 0x7fee9c0a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 --2- 172.21.15.115:0/3120323678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee9c0a72d0 0x7fee9c138e50 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 >> 172.21.15.115:0/3120323678 conn(0x7fee9c05e8f0 msgr2=0x7fee9c152590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:05.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.737+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 shutdown_connections 2023-07-27T14:30:05.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.738+0000 7feea27ff700 1 -- 172.21.15.115:0/3120323678 wait complete. 2023-07-27T14:30:05.766 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:30:05.783 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:30:05.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.949+0000 7fba78bff700 1 Processor -- start 2023-07-27T14:30:05.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.949+0000 7fba78bff700 1 -- start start 2023-07-27T14:30:05.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.950+0000 7fba78bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fba7414ae00 0x7fba74154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.950+0000 7fba78bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba741553f0 con 0x7fba7414b1e0 2023-07-27T14:30:05.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.950+0000 7fba78bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba74157a50 con 0x7fba74063260 2023-07-27T14:30:05.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.950+0000 7fba78bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba74157d10 con 0x7fba7414ae00 2023-07-27T14:30:05.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba71d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fba7414b1e0 0x7fba74062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50138/0 (socket says 172.21.15.115:50138) 2023-07-27T14:30:05.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba71d9b700 1 -- 172.21.15.115:0/1667607863 learned_addr learned my addr 172.21.15.115:0/1667607863 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:05.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba7259c700 1 --2- 172.21.15.115:0/1667607863 >> v2:172.21.15.159:3300/0 conn(0x7fba7414ae00 0x7fba74154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba7159a700 1 -- 172.21.15.115:0/1667607863 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273703604 0 0) 0x7fba741553f0 con 0x7fba7414b1e0 2023-07-27T14:30:05.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba7159a700 1 -- 172.21.15.115:0/1667607863 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c0033f0 con 0x7fba7414b1e0 2023-07-27T14:30:05.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba7259c700 1 -- 172.21.15.115:0/1667607863 >> v1:172.21.15.159:6789/0 conn(0x7fba74063260 legacy=0x7fba740a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba7259c700 1 -- 172.21.15.115:0/1667607863 >> v1:172.21.15.115:6789/0 conn(0x7fba7414b1e0 legacy=0x7fba74062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba7159a700 1 -- 172.21.15.115:0/1667607863 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1423760135 0 0) 0x7fba5c0033f0 con 0x7fba7414b1e0 2023-07-27T14:30:05.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.951+0000 7fba7259c700 1 -- 172.21.15.115:0/1667607863 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74157ff0 con 0x7fba7414ae00 2023-07-27T14:30:05.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba7259c700 1 --2- 172.21.15.115:0/1667607863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414ae00 0x7fba74154f00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fba64009760 tx=0x7fba64009060).ready entity=mon.1 client_cookie=3b9be2cb801e71c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:05.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba7159a700 1 -- 172.21.15.115:0/1667607863 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68001470 con 0x7fba7414ae00 2023-07-27T14:30:05.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba7159a700 1 -- 172.21.15.115:0/1667607863 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba64011400 con 0x7fba7414ae00 2023-07-27T14:30:05.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba7159a700 1 -- 172.21.15.115:0/1667607863 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64011780 con 0x7fba7414ae00 2023-07-27T14:30:05.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba78bff700 1 -- 172.21.15.115:0/1667607863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414ae00 msgr2=0x7fba74154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba78bff700 1 --2- 172.21.15.115:0/1667607863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414ae00 0x7fba74154f00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fba64009760 tx=0x7fba64009060).stop 2023-07-27T14:30:05.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba78bff700 1 -- 172.21.15.115:0/1667607863 shutdown_connections 2023-07-27T14:30:05.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba78bff700 1 --2- 172.21.15.115:0/1667607863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414ae00 0x7fba74154f00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.952+0000 7fba78bff700 1 -- 172.21.15.115:0/1667607863 >> 172.21.15.115:0/1667607863 conn(0x7fba7405e940 msgr2=0x7fba740cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:05.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.953+0000 7fba78bff700 1 -- 172.21.15.115:0/1667607863 shutdown_connections 2023-07-27T14:30:05.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.953+0000 7fba78bff700 1 -- 172.21.15.115:0/1667607863 wait complete. 2023-07-27T14:30:05.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.954+0000 7fba78bff700 1 Processor -- start 2023-07-27T14:30:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.954+0000 7fba78bff700 1 -- start start 2023-07-27T14:30:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba78bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba74063260 0x7fba74138720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba78bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba7414ae00 0x7fba740a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba78bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414b1e0 0x7fba740aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba78bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba740aa530 con 0x7fba7414ae00 2023-07-27T14:30:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba78bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba740ade60 con 0x7fba7414b1e0 2023-07-27T14:30:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba78bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba740b01a0 con 0x7fba74063260 2023-07-27T14:30:05.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba71d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba7414ae00 0x7fba740a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba7259c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba74063260 0x7fba74138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba71d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba7414ae00 0x7fba740a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42390/0 (socket says 172.21.15.115:42390) 2023-07-27T14:30:05.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba71d9b700 1 -- 172.21.15.115:0/2374848886 learned_addr learned my addr 172.21.15.115:0/2374848886 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:05.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.955+0000 7fba72d9d700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414b1e0 0x7fba740aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba71d9b700 1 -- 172.21.15.115:0/2374848886 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba74063260 msgr2=0x7fba74138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba71d9b700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba74063260 0x7fba74138720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba71d9b700 1 -- 172.21.15.115:0/2374848886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414b1e0 msgr2=0x7fba740aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba71d9b700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414b1e0 0x7fba740aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba71d9b700 1 -- 172.21.15.115:0/2374848886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640092a0 con 0x7fba7414ae00 2023-07-27T14:30:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba71d9b700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba7414ae00 0x7fba740a9b50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fba6800c7e0 tx=0x7fba68001a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba627fc700 1 -- 172.21.15.115:0/2374848886 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680072e0 con 0x7fba7414ae00 2023-07-27T14:30:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba627fc700 1 -- 172.21.15.115:0/2374848886 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68007460 con 0x7fba7414ae00 2023-07-27T14:30:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba627fc700 1 -- 172.21.15.115:0/2374848886 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680059f0 con 0x7fba7414ae00 2023-07-27T14:30:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba740b0480 con 0x7fba7414ae00 2023-07-27T14:30:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.956+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba740b0a40 con 0x7fba7414ae00 2023-07-27T14:30:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.957+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7406c470 con 0x7fba7414ae00 2023-07-27T14:30:05.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.958+0000 7fba627fc700 1 -- 172.21.15.115:0/2374848886 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fba68010070 con 0x7fba7414ae00 2023-07-27T14:30:05.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.959+0000 7fba627fc700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba5405f030 0x7fba540614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:05.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.959+0000 7fba627fc700 1 -- 172.21.15.115:0/2374848886 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5827+0+0 (secure 0 0 0) 0x7fba680796e0 con 0x7fba7414ae00 2023-07-27T14:30:05.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.959+0000 7fba7259c700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba5405f030 0x7fba540614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:05.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.960+0000 7fba7259c700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba5405f030 0x7fba540614f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fba64009760 tx=0x7fba64014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:05.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:05.963+0000 7fba627fc700 1 -- 172.21.15.115:0/2374848886 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba6804a9c0 con 0x7fba7414ae00 2023-07-27T14:30:06.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.133+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba7414a2c0 con 0x7fba7414ae00 2023-07-27T14:30:06.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.747+0000 7fba627fc700 1 -- 172.21.15.115:0/2374848886 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7fba68018070 con 0x7fba7414ae00 2023-07-27T14:30:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.750+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba5405f030 msgr2=0x7fba540614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.750+0000 7fba78bff700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba5405f030 0x7fba540614f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fba64009760 tx=0x7fba64014000).stop 2023-07-27T14:30:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.750+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba7414ae00 msgr2=0x7fba740a9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.750+0000 7fba78bff700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba7414ae00 0x7fba740a9b50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fba6800c7e0 tx=0x7fba68001a10).stop 2023-07-27T14:30:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.751+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 shutdown_connections 2023-07-27T14:30:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.751+0000 7fba78bff700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fba5405f030 0x7fba540614f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.751+0000 7fba78bff700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba7414b1e0 0x7fba740aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.751+0000 7fba78bff700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba74063260 0x7fba74138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.751+0000 7fba78bff700 1 --2- 172.21.15.115:0/2374848886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba7414ae00 0x7fba740a9b50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.751+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 >> 172.21.15.115:0/2374848886 conn(0x7fba7405e940 msgr2=0x7fba7414a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.751+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 shutdown_connections 2023-07-27T14:30:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.751+0000 7fba78bff700 1 -- 172.21.15.115:0/2374848886 wait complete. 2023-07-27T14:30:06.780 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:30:06.797 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-07-27T14:30:06.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.957+0000 7fd75a1ff700 1 Processor -- start 2023-07-27T14:30:06.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.958+0000 7fd75a1ff700 1 -- start start 2023-07-27T14:30:06.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.959+0000 7fd75a1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd75414b1e0 0x7fd754154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:06.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.959+0000 7fd75a1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7541553f0 con 0x7fd754063260 2023-07-27T14:30:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.959+0000 7fd75a1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd754157a50 con 0x7fd75414ae00 2023-07-27T14:30:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.959+0000 7fd75a1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd754157d10 con 0x7fd75414b1e0 2023-07-27T14:30:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.959+0000 7fd753fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd75414b1e0 0x7fd754154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.959+0000 7fd752ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd754063260 0x7fd7540a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50148/0 (socket says 172.21.15.115:50148) 2023-07-27T14:30:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.959+0000 7fd752ffd700 1 -- 172.21.15.115:0/447762346 learned_addr learned my addr 172.21.15.115:0/447762346 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:06.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd753fff700 1 -- 172.21.15.115:0/447762346 >> v1:172.21.15.159:6789/0 conn(0x7fd75414ae00 legacy=0x7fd754062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:06.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd753fff700 1 -- 172.21.15.115:0/447762346 >> v1:172.21.15.115:6789/0 conn(0x7fd754063260 legacy=0x7fd7540a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:06.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd753fff700 1 -- 172.21.15.115:0/447762346 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754157ff0 con 0x7fd75414b1e0 2023-07-27T14:30:06.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd7527fc700 1 -- 172.21.15.115:0/447762346 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015586967 0 0) 0x7fd7541553f0 con 0x7fd754063260 2023-07-27T14:30:06.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd753fff700 1 --2- 172.21.15.115:0/447762346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414b1e0 0x7fd754154f00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fd74c009e60 tx=0x7fd74c009780).ready entity=mon.0 client_cookie=2583554f0c9ebf9d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:06.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd7527fc700 1 -- 172.21.15.115:0/447762346 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00e070 con 0x7fd75414b1e0 2023-07-27T14:30:06.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd7527fc700 1 -- 172.21.15.115:0/447762346 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c00bc30 con 0x7fd75414b1e0 2023-07-27T14:30:06.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd7527fc700 1 -- 172.21.15.115:0/447762346 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c012410 con 0x7fd75414b1e0 2023-07-27T14:30:06.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd75a1ff700 1 -- 172.21.15.115:0/447762346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414b1e0 msgr2=0x7fd754154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:06.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.960+0000 7fd75a1ff700 1 --2- 172.21.15.115:0/447762346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414b1e0 0x7fd754154f00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fd74c009e60 tx=0x7fd74c009780).stop 2023-07-27T14:30:06.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.961+0000 7fd75a1ff700 1 -- 172.21.15.115:0/447762346 shutdown_connections 2023-07-27T14:30:06.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.961+0000 7fd75a1ff700 1 --2- 172.21.15.115:0/447762346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414b1e0 0x7fd754154f00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:06.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.961+0000 7fd75a1ff700 1 -- 172.21.15.115:0/447762346 >> 172.21.15.115:0/447762346 conn(0x7fd75405e940 msgr2=0x7fd7540cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:06.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.961+0000 7fd75a1ff700 1 -- 172.21.15.115:0/447762346 shutdown_connections 2023-07-27T14:30:06.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.961+0000 7fd75a1ff700 1 -- 172.21.15.115:0/447762346 wait complete. 2023-07-27T14:30:06.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.962+0000 7fd75a1ff700 1 Processor -- start 2023-07-27T14:30:06.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.962+0000 7fd75a1ff700 1 -- start start 2023-07-27T14:30:06.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd75a1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd754063260 0x7fd754149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:06.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd75a1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414ae00 0x7fd75414bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:06.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd75a1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd75414b1e0 0x7fd754164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:06.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd75a1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540c2370 con 0x7fd75414ae00 2023-07-27T14:30:06.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd75a1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75414a4a0 con 0x7fd754063260 2023-07-27T14:30:06.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd75a1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540c3850 con 0x7fd75414b1e0 2023-07-27T14:30:06.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd752ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414ae00 0x7fd75414bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:06.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd752ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414ae00 0x7fd75414bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42410/0 (socket says 172.21.15.115:42410) 2023-07-27T14:30:06.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.963+0000 7fd752ffd700 1 -- 172.21.15.115:0/1930605914 learned_addr learned my addr 172.21.15.115:0/1930605914 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:06.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd753fff700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd75414b1e0 0x7fd754164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:06.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd7537fe700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd754063260 0x7fd754149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:06.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd752ffd700 1 -- 172.21.15.115:0/1930605914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd75414b1e0 msgr2=0x7fd754164830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:06.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd752ffd700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd75414b1e0 0x7fd754164830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:06.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd752ffd700 1 -- 172.21.15.115:0/1930605914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd754063260 msgr2=0x7fd754149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:06.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd752ffd700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd754063260 0x7fd754149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:06.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd752ffd700 1 -- 172.21.15.115:0/1930605914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c009a20 con 0x7fd75414ae00 2023-07-27T14:30:06.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd752ffd700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414ae00 0x7fd75414bce0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fd74800c490 tx=0x7fd748007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:06.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd73b7fe700 1 -- 172.21.15.115:0/1930605914 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7480070d0 con 0x7fd75414ae00 2023-07-27T14:30:06.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd73b7fe700 1 -- 172.21.15.115:0/1930605914 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd748007250 con 0x7fd75414ae00 2023-07-27T14:30:06.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7540c3df0 con 0x7fd75414ae00 2023-07-27T14:30:06.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.964+0000 7fd73b7fe700 1 -- 172.21.15.115:0/1930605914 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748007610 con 0x7fd75414ae00 2023-07-27T14:30:06.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.965+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75414c1d0 con 0x7fd75414ae00 2023-07-27T14:30:06.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.965+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75406c470 con 0x7fd75414ae00 2023-07-27T14:30:06.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.966+0000 7fd73b7fe700 1 -- 172.21.15.115:0/1930605914 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fd748010070 con 0x7fd75414ae00 2023-07-27T14:30:06.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.967+0000 7fd73b7fe700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd74005f060 0x7fd740061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:06.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.967+0000 7fd73b7fe700 1 -- 172.21.15.115:0/1930605914 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd7480791b0 con 0x7fd75414ae00 2023-07-27T14:30:06.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.967+0000 7fd7537fe700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd74005f060 0x7fd740061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:06.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.968+0000 7fd7537fe700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd74005f060 0x7fd740061520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fd7540c3640 tx=0x7fd744009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:06.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:06.971+0000 7fd73b7fe700 1 -- 172.21.15.115:0/1930605914 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd74804a700 con 0x7fd75414ae00 2023-07-27T14:30:07.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.141+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7fd754164d20 con 0x7fd75414ae00 2023-07-27T14:30:07.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.145+0000 7fd73b7fe700 1 -- 172.21.15.115:0/1930605914 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7fd74804dd20 con 0x7fd75414ae00 2023-07-27T14:30:07.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd74005f060 msgr2=0x7fd740061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd74005f060 0x7fd740061520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fd7540c3640 tx=0x7fd744009040).stop 2023-07-27T14:30:07.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414ae00 msgr2=0x7fd75414bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414ae00 0x7fd75414bce0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fd74800c490 tx=0x7fd748007e10).stop 2023-07-27T14:30:07.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 shutdown_connections 2023-07-27T14:30:07.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd74005f060 0x7fd740061520 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd75414b1e0 0x7fd754164830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd754063260 0x7fd754149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 --2- 172.21.15.115:0/1930605914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd75414ae00 0x7fd75414bce0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 >> 172.21.15.115:0/1930605914 conn(0x7fd75405e940 msgr2=0x7fd7540ab430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:07.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 shutdown_connections 2023-07-27T14:30:07.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.147+0000 7fd75a1ff700 1 -- 172.21.15.115:0/1930605914 wait complete. 2023-07-27T14:30:07.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:30:07.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.358+0000 7f69bd3ff700 1 Processor -- start 2023-07-27T14:30:07.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.358+0000 7f69bd3ff700 1 -- start start 2023-07-27T14:30:07.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.359+0000 7f69bd3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69b80c58d0 0x7f69b8150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.359+0000 7f69bd3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b80c3100 0x7f69b80c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.359+0000 7f69bd3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b80c0ea0 con 0x7f69b81509b0 2023-07-27T14:30:07.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.359+0000 7f69bd3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b8068e10 con 0x7f69b80c58d0 2023-07-27T14:30:07.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.359+0000 7f69bd3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8151280 con 0x7f69b80c3100 2023-07-27T14:30:07.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.359+0000 7f69b67fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69b80c58d0 0x7f69b8150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b67fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69b80c58d0 0x7f69b8150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42420/0 (socket says 172.21.15.115:42420) 2023-07-27T14:30:07.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b67fc700 1 -- 172.21.15.115:0/2354931473 learned_addr learned my addr 172.21.15.115:0/2354931473 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:07.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b77fe700 1 --2- 172.21.15.115:0/2354931473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b80c3100 0x7f69b80c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b67fc700 1 -- 172.21.15.115:0/2354931473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b80c3100 msgr2=0x7f69b80c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:07.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b67fc700 1 --2- 172.21.15.115:0/2354931473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b80c3100 0x7f69b80c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b67fc700 1 -- 172.21.15.115:0/2354931473 >> v1:172.21.15.159:6789/0 conn(0x7f69b81509b0 legacy=0x7f69b8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b67fc700 1 -- 172.21.15.115:0/2354931473 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b8155190 con 0x7f69b80c58d0 2023-07-27T14:30:07.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b67fc700 1 --2- 172.21.15.115:0/2354931473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8150d90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f69ac006fd0 tx=0x7f69ac00b3b0).ready entity=mon.0 client_cookie=696af8f8b654d5b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:07.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b5ffb700 1 -- 172.21.15.115:0/2354931473 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00da70 con 0x7f69b80c58d0 2023-07-27T14:30:07.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b5ffb700 1 -- 172.21.15.115:0/2354931473 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac00dbd0 con 0x7f69b80c58d0 2023-07-27T14:30:07.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.360+0000 7f69b5ffb700 1 -- 172.21.15.115:0/2354931473 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac010470 con 0x7f69b80c58d0 2023-07-27T14:30:07.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.361+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2354931473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 msgr2=0x7f69b8150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.361+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2354931473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8150d90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f69ac006fd0 tx=0x7f69ac00b3b0).stop 2023-07-27T14:30:07.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.361+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2354931473 shutdown_connections 2023-07-27T14:30:07.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.361+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2354931473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b80c3100 0x7f69b80c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.361+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2354931473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8150d90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.361+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2354931473 >> 172.21.15.115:0/2354931473 conn(0x7f69b8062320 msgr2=0x7f69b8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:07.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.361+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2354931473 shutdown_connections 2023-07-27T14:30:07.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.361+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2354931473 wait complete. 2023-07-27T14:30:07.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.363+0000 7f69bd3ff700 1 Processor -- start 2023-07-27T14:30:07.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.363+0000 7f69bd3ff700 1 -- start start 2023-07-27T14:30:07.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.364+0000 7f69bd3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b80c3100 0x7f69b8160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.364+0000 7f69bd3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.364+0000 7f69bd3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b81509b0 0x7f69b80bf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.364+0000 7f69bd3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b80a9890 con 0x7f69b80c58d0 2023-07-27T14:30:07.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.364+0000 7f69bd3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b81606c0 con 0x7f69b80c3100 2023-07-27T14:30:07.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.364+0000 7f69bd3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b81609a0 con 0x7f69b81509b0 2023-07-27T14:30:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42422/0 (socket says 172.21.15.115:42422) 2023-07-27T14:30:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 -- 172.21.15.115:0/2344473713 learned_addr learned my addr 172.21.15.115:0/2344473713 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b6ffd700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b80c3100 0x7f69b8160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b77fe700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b81509b0 0x7f69b80bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 -- 172.21.15.115:0/2344473713 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b81509b0 msgr2=0x7f69b80bf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b81509b0 0x7f69b80bf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 -- 172.21.15.115:0/2344473713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b80c3100 msgr2=0x7f69b8160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b80c3100 0x7f69b8160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 -- 172.21.15.115:0/2344473713 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac00b610 con 0x7f69b80c58d0 2023-07-27T14:30:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f69b67fc700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8143510 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f69ac00b3f0 tx=0x7f69b8068d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.365+0000 7f699effd700 1 -- 172.21.15.115:0/2344473713 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac019450 con 0x7f69b80c58d0 2023-07-27T14:30:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.366+0000 7f699effd700 1 -- 172.21.15.115:0/2344473713 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac01f040 con 0x7f69b80c58d0 2023-07-27T14:30:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.366+0000 7f699effd700 1 -- 172.21.15.115:0/2344473713 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0197c0 con 0x7f69b80c58d0 2023-07-27T14:30:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.366+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b8160c80 con 0x7f69b80c58d0 2023-07-27T14:30:07.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.366+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b8143a00 con 0x7f69b80c58d0 2023-07-27T14:30:07.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.367+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b80a9a40 con 0x7f69b80c58d0 2023-07-27T14:30:07.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.367+0000 7f699effd700 1 -- 172.21.15.115:0/2344473713 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f69ac02a020 con 0x7f69b80c58d0 2023-07-27T14:30:07.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.368+0000 7f699effd700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69a405f060 0x7f69a4061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.368+0000 7f699effd700 1 -- 172.21.15.115:0/2344473713 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f69ac07da70 con 0x7f69b80c58d0 2023-07-27T14:30:07.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.368+0000 7f69b6ffd700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69a405f060 0x7f69a4061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.369+0000 7f69b6ffd700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69a405f060 0x7f69a4061520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f69a8007fd0 tx=0x7f69a8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:07.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.372+0000 7f699effd700 1 -- 172.21.15.115:0/2344473713 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f69b80a9a40 con 0x7f69b80c58d0 2023-07-27T14:30:07.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.543+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f69b806c470 con 0x7f69b80c58d0 2023-07-27T14:30:07.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.548+0000 7f699effd700 1 -- 172.21.15.115:0/2344473713 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f69ac04ef30 con 0x7f69b80c58d0 2023-07-27T14:30:07.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69a405f060 msgr2=0x7f69a4061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69a405f060 0x7f69a4061520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f69a8007fd0 tx=0x7f69a8009040).stop 2023-07-27T14:30:07.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 msgr2=0x7f69b8143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8143510 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f69ac00b3f0 tx=0x7f69b8068d80).stop 2023-07-27T14:30:07.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 shutdown_connections 2023-07-27T14:30:07.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69a405f060 0x7f69a4061520 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69b81509b0 0x7f69b80bf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69b80c3100 0x7f69b8160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 --2- 172.21.15.115:0/2344473713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c58d0 0x7f69b8143510 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 >> 172.21.15.115:0/2344473713 conn(0x7f69b8062320 msgr2=0x7f69b814a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:07.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 shutdown_connections 2023-07-27T14:30:07.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.550+0000 7f69bd3ff700 1 -- 172.21.15.115:0/2344473713 wait complete. 2023-07-27T14:30:07.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2023-07-27T14:30:07.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.763+0000 7fd4493ff700 1 Processor -- start 2023-07-27T14:30:07.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.763+0000 7fd4493ff700 1 -- start start 2023-07-27T14:30:07.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd4493ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd444154060 0x7fd4440bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd4493ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154440 0x7fd4440bc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd4493ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd4440a4c80 0x7fd4440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd4493ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440bc720 con 0x7fd444154060 2023-07-27T14:30:07.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd4493ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440c2ed0 con 0x7fd4440a4c80 2023-07-27T14:30:07.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd4493ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440a58d0 con 0x7fd444154440 2023-07-27T14:30:07.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd442ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd444154060 0x7fd4440bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd442ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd444154060 0x7fd4440bbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42434/0 (socket says 172.21.15.115:42434) 2023-07-27T14:30:07.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd442ffd700 1 -- 172.21.15.115:0/1666886175 learned_addr learned my addr 172.21.15.115:0/1666886175 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:07.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd4437fe700 1 --2- 172.21.15.115:0/1666886175 >> v2:172.21.15.159:3300/0 conn(0x7fd4440a4c80 0x7fd4440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd4427fc700 1 --2- 172.21.15.115:0/1666886175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154440 0x7fd4440bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd442ffd700 1 -- 172.21.15.115:0/1666886175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154440 msgr2=0x7fd4440bc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:07.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd442ffd700 1 --2- 172.21.15.115:0/1666886175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154440 0x7fd4440bc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd442ffd700 1 -- 172.21.15.115:0/1666886175 >> v2:172.21.15.159:3300/0 conn(0x7fd4440a4c80 msgr2=0x7fd4440a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:07.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd442ffd700 1 --2- 172.21.15.115:0/1666886175 >> v2:172.21.15.159:3300/0 conn(0x7fd4440a4c80 0x7fd4440a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.765+0000 7fd442ffd700 1 -- 172.21.15.115:0/1666886175 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440a5bb0 con 0x7fd444154060 2023-07-27T14:30:07.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd442ffd700 1 --2- 172.21.15.115:0/1666886175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154060 0x7fd4440bbd40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fd4440632e0 tx=0x7fd4340090f0).ready entity=mon.0 client_cookie=aa054504d7d9fc63 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:07.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd441ffb700 1 -- 172.21.15.115:0/1666886175 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400b600 con 0x7fd444154060 2023-07-27T14:30:07.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd441ffb700 1 -- 172.21.15.115:0/1666886175 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400b760 con 0x7fd444154060 2023-07-27T14:30:07.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd441ffb700 1 -- 172.21.15.115:0/1666886175 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400bae0 con 0x7fd444154060 2023-07-27T14:30:07.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd4493ff700 1 -- 172.21.15.115:0/1666886175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154060 msgr2=0x7fd4440bbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd4493ff700 1 --2- 172.21.15.115:0/1666886175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154060 0x7fd4440bbd40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fd4440632e0 tx=0x7fd4340090f0).stop 2023-07-27T14:30:07.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd4493ff700 1 -- 172.21.15.115:0/1666886175 shutdown_connections 2023-07-27T14:30:07.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd4493ff700 1 --2- 172.21.15.115:0/1666886175 >> v2:172.21.15.159:3300/0 conn(0x7fd4440a4c80 0x7fd4440a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd4493ff700 1 --2- 172.21.15.115:0/1666886175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154060 0x7fd4440bbd40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.766+0000 7fd4493ff700 1 --2- 172.21.15.115:0/1666886175 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154440 0x7fd4440bc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.767+0000 7fd4493ff700 1 -- 172.21.15.115:0/1666886175 >> 172.21.15.115:0/1666886175 conn(0x7fd444062320 msgr2=0x7fd444062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:07.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.767+0000 7fd4493ff700 1 -- 172.21.15.115:0/1666886175 shutdown_connections 2023-07-27T14:30:07.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.767+0000 7fd4493ff700 1 -- 172.21.15.115:0/1666886175 wait complete. 2023-07-27T14:30:07.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.768+0000 7fd4493ff700 1 Processor -- start 2023-07-27T14:30:07.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.768+0000 7fd4493ff700 1 -- start start 2023-07-27T14:30:07.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.769+0000 7fd4493ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4440a4c80 0x7fd4441511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.769+0000 7fd4493ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154060 0x7fd444069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.769+0000 7fd4493ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154440 0x7fd4441429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.769+0000 7fd4493ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd444069e40 con 0x7fd444154440 2023-07-27T14:30:07.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.769+0000 7fd4493ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441517c0 con 0x7fd4440a4c80 2023-07-27T14:30:07.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.769+0000 7fd4493ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd444151aa0 con 0x7fd444154060 2023-07-27T14:30:07.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.769+0000 7fd4437fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154440 0x7fd4441429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd442ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4440a4c80 0x7fd4441511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4437fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154440 0x7fd4441429b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42438/0 (socket says 172.21.15.115:42438) 2023-07-27T14:30:07.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4437fe700 1 -- 172.21.15.115:0/2124380403 learned_addr learned my addr 172.21.15.115:0/2124380403 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:07.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4427fc700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154060 0x7fd444069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4437fe700 1 -- 172.21.15.115:0/2124380403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154060 msgr2=0x7fd444069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4437fe700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154060 0x7fd444069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4437fe700 1 -- 172.21.15.115:0/2124380403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4440a4c80 msgr2=0x7fd4441511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:07.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4437fe700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4440a4c80 0x7fd4441511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:07.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4437fe700 1 -- 172.21.15.115:0/2124380403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434009370 con 0x7fd444154440 2023-07-27T14:30:07.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4437fe700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154440 0x7fd4441429b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fd43c007f20 tx=0x7fd43c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:07.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd42affd700 1 -- 172.21.15.115:0/2124380403 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00eb90 con 0x7fd444154440 2023-07-27T14:30:07.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd42affd700 1 -- 172.21.15.115:0/2124380403 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c00ecf0 con 0x7fd444154440 2023-07-27T14:30:07.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd444151d80 con 0x7fd444154440 2023-07-27T14:30:07.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.770+0000 7fd42affd700 1 -- 172.21.15.115:0/2124380403 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c014610 con 0x7fd444154440 2023-07-27T14:30:07.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.771+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4440be970 con 0x7fd444154440 2023-07-27T14:30:07.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.771+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4440be7d0 con 0x7fd444154440 2023-07-27T14:30:07.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.772+0000 7fd42affd700 1 -- 172.21.15.115:0/2124380403 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fd43c01b030 con 0x7fd444154440 2023-07-27T14:30:07.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.774+0000 7fd42affd700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd43005f060 0x7fd430061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:07.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.774+0000 7fd42affd700 1 -- 172.21.15.115:0/2124380403 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd43c079f40 con 0x7fd444154440 2023-07-27T14:30:07.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.774+0000 7fd442ffd700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd43005f060 0x7fd430061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:07.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.774+0000 7fd442ffd700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd43005f060 0x7fd430061520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd434009130 tx=0x7fd434017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:07.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:07.778+0000 7fd42affd700 1 -- 172.21.15.115:0/2124380403 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4440be7d0 con 0x7fd444154440 2023-07-27T14:30:08.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.015+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) v1 -- 0x7fd4440be7d0 con 0x7fd444154440 2023-07-27T14:30:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.751+0000 7fd42affd700 1 -- 172.21.15.115:0/2124380403 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v176) v1 ==== 180+0+0 (secure 0 0 0) 0x7fd4440be7d0 con 0x7fd444154440 2023-07-27T14:30:08.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd43005f060 msgr2=0x7fd430061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:08.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd43005f060 0x7fd430061520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd434009130 tx=0x7fd434017000).stop 2023-07-27T14:30:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154440 msgr2=0x7fd4441429b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154440 0x7fd4441429b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fd43c007f20 tx=0x7fd43c009860).stop 2023-07-27T14:30:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 shutdown_connections 2023-07-27T14:30:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd43005f060 0x7fd430061520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd444154440 0x7fd4441429b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4440a4c80 0x7fd4441511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 --2- 172.21.15.115:0/2124380403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd444154060 0x7fd444069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 >> 172.21.15.115:0/2124380403 conn(0x7fd444062320 msgr2=0x7fd4441569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 shutdown_connections 2023-07-27T14:30:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.754+0000 7fd4493ff700 1 -- 172.21.15.115:0/2124380403 wait complete. 2023-07-27T14:30:08.800 INFO:tasks.cephfs_test_runner:test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:30:08.801 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:30:08.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2023-07-27T14:30:08.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.962+0000 7f4d849ff700 1 Processor -- start 2023-07-27T14:30:08.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.962+0000 7f4d849ff700 1 -- start start 2023-07-27T14:30:08.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.963+0000 7f4d849ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d80154060 0x7f4d800bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:08.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.963+0000 7f4d849ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d80154440 0x7f4d800bc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:08.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.963+0000 7f4d849ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d800c2ed0 con 0x7f4d800a4c80 2023-07-27T14:30:08.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.963+0000 7f4d849ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800bc720 con 0x7f4d80154440 2023-07-27T14:30:08.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.963+0000 7f4d849ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800a58d0 con 0x7f4d80154060 2023-07-27T14:30:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7e59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d80154060 0x7f4d800bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7dd9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d80154440 0x7f4d800bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7dd9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d80154440 0x7f4d800bc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:51142/0 (socket says 172.21.15.115:51142) 2023-07-27T14:30:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7dd9b700 1 -- 172.21.15.115:0/1137710757 learned_addr learned my addr 172.21.15.115:0/1137710757 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:08.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7e59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d80154060 0x7f4d800bbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:33368/0 (socket says 172.21.15.115:33368) 2023-07-27T14:30:08.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7dd9b700 1 -- 172.21.15.115:0/1137710757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d80154060 msgr2=0x7f4d800bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:08.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7dd9b700 1 --2- 172.21.15.115:0/1137710757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d80154060 0x7f4d800bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:08.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7dd9b700 1 -- 172.21.15.115:0/1137710757 >> v1:172.21.15.159:6789/0 conn(0x7f4d800a4c80 legacy=0x7f4d800a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:08.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7dd9b700 1 -- 172.21.15.115:0/1137710757 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800a5bb0 con 0x7f4d80154440 2023-07-27T14:30:08.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7e59c700 1 --2- 172.21.15.115:0/1137710757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d80154060 0x7f4d800bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:08.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.964+0000 7f4d7dd9b700 1 --2- 172.21.15.115:0/1137710757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 0x7f4d800bc230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4d74006fd0 tx=0x7f4d740090f0).ready entity=mon.1 client_cookie=3b35395859bb9d1d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:08.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d7d59a700 1 -- 172.21.15.115:0/1137710757 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400b580 con 0x7f4d80154440 2023-07-27T14:30:08.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d7d59a700 1 -- 172.21.15.115:0/1137710757 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7400b6e0 con 0x7f4d80154440 2023-07-27T14:30:08.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d7d59a700 1 -- 172.21.15.115:0/1137710757 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400ba60 con 0x7f4d80154440 2023-07-27T14:30:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d849ff700 1 -- 172.21.15.115:0/1137710757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 msgr2=0x7f4d800bc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1137710757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 0x7f4d800bc230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4d74006fd0 tx=0x7f4d740090f0).stop 2023-07-27T14:30:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d849ff700 1 -- 172.21.15.115:0/1137710757 shutdown_connections 2023-07-27T14:30:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1137710757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d80154060 0x7f4d800bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1137710757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 0x7f4d800bc230 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d849ff700 1 -- 172.21.15.115:0/1137710757 >> 172.21.15.115:0/1137710757 conn(0x7f4d80062320 msgr2=0x7f4d80062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.965+0000 7f4d849ff700 1 -- 172.21.15.115:0/1137710757 shutdown_connections 2023-07-27T14:30:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.966+0000 7f4d849ff700 1 -- 172.21.15.115:0/1137710757 wait complete. 2023-07-27T14:30:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.967+0000 7f4d849ff700 1 Processor -- start 2023-07-27T14:30:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.967+0000 7f4d849ff700 1 -- start start 2023-07-27T14:30:08.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d849ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d800a4c80 0x7f4d800a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d849ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80154060 0x7f4d80146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d849ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 0x7f4d800bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d849ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800ace00 con 0x7f4d80154060 2023-07-27T14:30:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d849ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800a7760 con 0x7f4d80154440 2023-07-27T14:30:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d849ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800ac840 con 0x7f4d800a4c80 2023-07-27T14:30:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d7dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80154060 0x7f4d80146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d7dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80154060 0x7f4d80146b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42448/0 (socket says 172.21.15.115:42448) 2023-07-27T14:30:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.968+0000 7f4d7dd9b700 1 -- 172.21.15.115:0/1757721601 learned_addr learned my addr 172.21.15.115:0/1757721601 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7ed9d700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 0x7f4d800bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7e59c700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d800a4c80 0x7f4d800a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7dd9b700 1 -- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d800a4c80 msgr2=0x7f4d800a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7dd9b700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d800a4c80 0x7f4d800a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7dd9b700 1 -- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 msgr2=0x7f4d800bee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7dd9b700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 0x7f4d800bee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7dd9b700 1 -- 172.21.15.115:0/1757721601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700092a0 con 0x7f4d80154060 2023-07-27T14:30:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7ed9d700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 0x7f4d800bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7e59c700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d800a4c80 0x7f4d800a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d7dd9b700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80154060 0x7f4d80146b00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f4d8005e980 tx=0x7f4d74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d6e7fc700 1 -- 172.21.15.115:0/1757721601 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400b850 con 0x7f4d80154060 2023-07-27T14:30:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d6e7fc700 1 -- 172.21.15.115:0/1757721601 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7400b9b0 con 0x7f4d80154060 2023-07-27T14:30:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d6e7fc700 1 -- 172.21.15.115:0/1757721601 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7401d680 con 0x7f4d80154060 2023-07-27T14:30:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d74009370 con 0x7f4d80154060 2023-07-27T14:30:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.969+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d800a73f0 con 0x7f4d80154060 2023-07-27T14:30:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.970+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8006c470 con 0x7f4d80154060 2023-07-27T14:30:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.971+0000 7f4d6e7fc700 1 -- 172.21.15.115:0/1757721601 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f4d74023020 con 0x7f4d80154060 2023-07-27T14:30:09.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.972+0000 7f4d6e7fc700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4d6005f060 0x7f4d60061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:09.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.972+0000 7f4d6e7fc700 1 -- 172.21.15.115:0/1757721601 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4d7407bc10 con 0x7f4d80154060 2023-07-27T14:30:09.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.972+0000 7f4d7e59c700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4d6005f060 0x7f4d60061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:09.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.973+0000 7f4d7e59c700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4d6005f060 0x7f4d60061520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f4d70009270 tx=0x7f4d70008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:09.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:08.976+0000 7f4d6e7fc700 1 -- 172.21.15.115:0/1757721601 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d7404d0b0 con 0x7f4d80154060 2023-07-27T14:30:09.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.206+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) v1 -- 0x7f4d80063d80 con 0x7f4d80154060 2023-07-27T14:30:09.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.756+0000 7f4d6e7fc700 1 -- 172.21.15.115:0/1757721601 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v177) v1 ==== 179+0+0 (secure 0 0 0) 0x7f4d740506d0 con 0x7f4d80154060 2023-07-27T14:30:09.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.758+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4d6005f060 msgr2=0x7f4d60061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:09.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.758+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4d6005f060 0x7f4d60061520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f4d70009270 tx=0x7f4d70008040).stop 2023-07-27T14:30:09.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.758+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80154060 msgr2=0x7f4d80146b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:09.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.758+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80154060 0x7f4d80146b00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f4d8005e980 tx=0x7f4d74017000).stop 2023-07-27T14:30:09.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.759+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 shutdown_connections 2023-07-27T14:30:09.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.759+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4d6005f060 0x7f4d60061520 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:09.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.759+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d80154440 0x7f4d800bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:09.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.759+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d800a4c80 0x7f4d800a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:09.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.759+0000 7f4d849ff700 1 --2- 172.21.15.115:0/1757721601 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d80154060 0x7f4d80146b00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:09.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.759+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 >> 172.21.15.115:0/1757721601 conn(0x7f4d80062320 msgr2=0x7f4d801530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:09.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.759+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 shutdown_connections 2023-07-27T14:30:09.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.759+0000 7f4d849ff700 1 -- 172.21.15.115:0/1757721601 wait complete. 2023-07-27T14:30:09.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:30:09.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.970+0000 7fd447dff700 1 Processor -- start 2023-07-27T14:30:09.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.970+0000 7fd447dff700 1 -- start start 2023-07-27T14:30:09.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.971+0000 7fd447dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd44013a350 0x7fd440065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:09.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.971+0000 7fd447dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd44013a730 0x7fd4401585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:09.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.971+0000 7fd447dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4400bd9a0 con 0x7fd4400c2fa0 2023-07-27T14:30:09.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.971+0000 7fd447dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd440066400 con 0x7fd44013a730 2023-07-27T14:30:09.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.971+0000 7fd447dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd440158ae0 con 0x7fd44013a350 2023-07-27T14:30:10.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.971+0000 7fd44539a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd44013a730 0x7fd4401585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.971+0000 7fd44539a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd44013a730 0x7fd4401585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42458/0 (socket says 172.21.15.115:42458) 2023-07-27T14:30:10.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.971+0000 7fd44539a700 1 -- 172.21.15.115:0/4188987758 learned_addr learned my addr 172.21.15.115:0/4188987758 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:10.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd445b9b700 1 --2- 172.21.15.115:0/4188987758 >> v2:172.21.15.159:3300/0 conn(0x7fd44013a350 0x7fd440065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd44539a700 1 -- 172.21.15.115:0/4188987758 >> v2:172.21.15.159:3300/0 conn(0x7fd44013a350 msgr2=0x7fd440065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:10.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd44539a700 1 --2- 172.21.15.115:0/4188987758 >> v2:172.21.15.159:3300/0 conn(0x7fd44013a350 0x7fd440065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd44539a700 1 -- 172.21.15.115:0/4188987758 >> v1:172.21.15.159:6789/0 conn(0x7fd4400c2fa0 legacy=0x7fd440067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd44539a700 1 -- 172.21.15.115:0/4188987758 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440066610 con 0x7fd44013a730 2023-07-27T14:30:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd44539a700 1 --2- 172.21.15.115:0/4188987758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a730 0x7fd4401585f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fd440066fd0 tx=0x7fd4300090f0).ready entity=mon.0 client_cookie=7b6f345695ef6d02 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd444b99700 1 -- 172.21.15.115:0/4188987758 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000b520 con 0x7fd44013a730 2023-07-27T14:30:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd444b99700 1 -- 172.21.15.115:0/4188987758 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000b680 con 0x7fd44013a730 2023-07-27T14:30:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.972+0000 7fd444b99700 1 -- 172.21.15.115:0/4188987758 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000ba00 con 0x7fd44013a730 2023-07-27T14:30:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.973+0000 7fd447dff700 1 -- 172.21.15.115:0/4188987758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a730 msgr2=0x7fd4401585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.973+0000 7fd447dff700 1 --2- 172.21.15.115:0/4188987758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a730 0x7fd4401585f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fd440066fd0 tx=0x7fd4300090f0).stop 2023-07-27T14:30:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.973+0000 7fd447dff700 1 -- 172.21.15.115:0/4188987758 shutdown_connections 2023-07-27T14:30:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.973+0000 7fd447dff700 1 --2- 172.21.15.115:0/4188987758 >> v2:172.21.15.159:3300/0 conn(0x7fd44013a350 0x7fd440065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.973+0000 7fd447dff700 1 --2- 172.21.15.115:0/4188987758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a730 0x7fd4401585f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.973+0000 7fd447dff700 1 -- 172.21.15.115:0/4188987758 >> 172.21.15.115:0/4188987758 conn(0x7fd44005e8f0 msgr2=0x7fd4400c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.973+0000 7fd447dff700 1 -- 172.21.15.115:0/4188987758 shutdown_connections 2023-07-27T14:30:10.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.973+0000 7fd447dff700 1 -- 172.21.15.115:0/4188987758 wait complete. 2023-07-27T14:30:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.974+0000 7fd447dff700 1 Processor -- start 2023-07-27T14:30:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.975+0000 7fd447dff700 1 -- start start 2023-07-27T14:30:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.975+0000 7fd447dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4400c2fa0 0x7fd4401529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.975+0000 7fd447dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a350 0x7fd4400bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.975+0000 7fd447dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd44013a730 0x7fd4400bff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.975+0000 7fd447dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4400a9880 con 0x7fd44013a350 2023-07-27T14:30:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.975+0000 7fd447dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4400c05b0 con 0x7fd44013a730 2023-07-27T14:30:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.975+0000 7fd447dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4400c0890 con 0x7fd4400c2fa0 2023-07-27T14:30:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a350 0x7fd4400bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a350 0x7fd4400bfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42464/0 (socket says 172.21.15.115:42464) 2023-07-27T14:30:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 -- 172.21.15.115:0/3194115667 learned_addr learned my addr 172.21.15.115:0/3194115667 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 -- 172.21.15.115:0/3194115667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4400c2fa0 msgr2=0x7fd4401529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4400c2fa0 0x7fd4401529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 -- 172.21.15.115:0/3194115667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd44013a730 msgr2=0x7fd4400bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44639c700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd44013a730 0x7fd4400bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd44013a730 0x7fd4400bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 -- 172.21.15.115:0/3194115667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430009370 con 0x7fd44013a350 2023-07-27T14:30:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44639c700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd44013a730 0x7fd4400bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.976+0000 7fd44539a700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a350 0x7fd4400bfa40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fd430009130 tx=0x7fd430017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.977+0000 7fd435ffb700 1 -- 172.21.15.115:0/3194115667 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000be90 con 0x7fd44013a350 2023-07-27T14:30:10.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.977+0000 7fd435ffb700 1 -- 172.21.15.115:0/3194115667 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000b7f0 con 0x7fd44013a350 2023-07-27T14:30:10.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.977+0000 7fd435ffb700 1 -- 172.21.15.115:0/3194115667 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43001b660 con 0x7fd44013a350 2023-07-27T14:30:10.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.977+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4400c0b70 con 0x7fd44013a350 2023-07-27T14:30:10.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.977+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4400c1130 con 0x7fd44013a350 2023-07-27T14:30:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.978+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd440157850 con 0x7fd44013a350 2023-07-27T14:30:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.978+0000 7fd435ffb700 1 -- 172.21.15.115:0/3194115667 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fd43002b070 con 0x7fd44013a350 2023-07-27T14:30:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.979+0000 7fd435ffb700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd42405f060 0x7fd424061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.979+0000 7fd435ffb700 1 -- 172.21.15.115:0/3194115667 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd43007b5e0 con 0x7fd44013a350 2023-07-27T14:30:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.980+0000 7fd445b9b700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd42405f060 0x7fd424061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.980+0000 7fd445b9b700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd42405f060 0x7fd424061520 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fd43c009a30 tx=0x7fd43c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:10.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:09.983+0000 7fd435ffb700 1 -- 172.21.15.115:0/3194115667 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd43004caa0 con 0x7fd44013a350 2023-07-27T14:30:10.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.153+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd4400c5d90 con 0x7fd44013a350 2023-07-27T14:30:10.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.158+0000 7fd435ffb700 1 -- 172.21.15.115:0/3194115667 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd43001f020 con 0x7fd44013a350 2023-07-27T14:30:10.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd42405f060 msgr2=0x7fd424061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd42405f060 0x7fd424061520 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fd43c009a30 tx=0x7fd43c009060).stop 2023-07-27T14:30:10.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a350 msgr2=0x7fd4400bfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a350 0x7fd4400bfa40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fd430009130 tx=0x7fd430017000).stop 2023-07-27T14:30:10.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 shutdown_connections 2023-07-27T14:30:10.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd42405f060 0x7fd424061520 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd44013a730 0x7fd4400bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4400c2fa0 0x7fd4401529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:10.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 --2- 172.21.15.115:0/3194115667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd44013a350 0x7fd4400bfa40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 >> 172.21.15.115:0/3194115667 conn(0x7fd44005e8f0 msgr2=0x7fd440153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:10.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 shutdown_connections 2023-07-27T14:30:10.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.160+0000 7fd447dff700 1 -- 172.21.15.115:0/3194115667 wait complete. 2023-07-27T14:30:10.205 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:30:10.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:30:10.299 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:30:10.408 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:30:10.409 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:30:10.409 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:30:10.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.568+0000 7fadc6fff700 1 Processor -- start 2023-07-27T14:30:10.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.569+0000 7fadc6fff700 1 -- start start 2023-07-27T14:30:10.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.570+0000 7fadc6fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadc0153ec0 0x7fadc00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.570+0000 7fadc6fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fadc00aa050 0x7fadc00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc6fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00aa4d0 con 0x7fadc00aaa40 2023-07-27T14:30:10.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc6fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00c05c0 con 0x7fadc0153ec0 2023-07-27T14:30:10.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc6fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00c1a60 con 0x7fadc00aa050 2023-07-27T14:30:10.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc4d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadc0153ec0 0x7fadc00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc4d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadc0153ec0 0x7fadc00a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42468/0 (socket says 172.21.15.115:42468) 2023-07-27T14:30:10.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc4d9b700 1 -- 172.21.15.115:0/2922206389 learned_addr learned my addr 172.21.15.115:0/2922206389 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:10.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadbffff700 1 --2- 172.21.15.115:0/2922206389 >> v2:172.21.15.159:3300/0 conn(0x7fadc00aa050 0x7fadc00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc4d9b700 1 -- 172.21.15.115:0/2922206389 >> v2:172.21.15.159:3300/0 conn(0x7fadc00aa050 msgr2=0x7fadc00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc4d9b700 1 --2- 172.21.15.115:0/2922206389 >> v2:172.21.15.159:3300/0 conn(0x7fadc00aa050 0x7fadc00640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc4d9b700 1 -- 172.21.15.115:0/2922206389 >> v1:172.21.15.159:6789/0 conn(0x7fadc00aaa40 legacy=0x7fadc0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc4d9b700 1 -- 172.21.15.115:0/2922206389 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00bfc90 con 0x7fadc0153ec0 2023-07-27T14:30:10.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadbffff700 1 --2- 172.21.15.115:0/2922206389 >> v2:172.21.15.159:3300/0 conn(0x7fadc00aa050 0x7fadc00640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:10.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.571+0000 7fadc4d9b700 1 --2- 172.21.15.115:0/2922206389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc0153ec0 0x7fadc00a9b60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fadc006c0d0 tx=0x7fadb40090f0).ready entity=mon.0 client_cookie=45f9daec15415a98 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:10.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadbf7fe700 1 -- 172.21.15.115:0/2922206389 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400b600 con 0x7fadc0153ec0 2023-07-27T14:30:10.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadbf7fe700 1 -- 172.21.15.115:0/2922206389 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb400b760 con 0x7fadc0153ec0 2023-07-27T14:30:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadbf7fe700 1 -- 172.21.15.115:0/2922206389 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400bae0 con 0x7fadc0153ec0 2023-07-27T14:30:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadc6fff700 1 -- 172.21.15.115:0/2922206389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc0153ec0 msgr2=0x7fadc00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadc6fff700 1 --2- 172.21.15.115:0/2922206389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc0153ec0 0x7fadc00a9b60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fadc006c0d0 tx=0x7fadb40090f0).stop 2023-07-27T14:30:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadc6fff700 1 -- 172.21.15.115:0/2922206389 shutdown_connections 2023-07-27T14:30:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadc6fff700 1 --2- 172.21.15.115:0/2922206389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc0153ec0 0x7fadc00a9b60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadc6fff700 1 --2- 172.21.15.115:0/2922206389 >> v2:172.21.15.159:3300/0 conn(0x7fadc00aa050 0x7fadc00640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadc6fff700 1 -- 172.21.15.115:0/2922206389 >> 172.21.15.115:0/2922206389 conn(0x7fadc00cb610 msgr2=0x7fadc00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadc6fff700 1 -- 172.21.15.115:0/2922206389 shutdown_connections 2023-07-27T14:30:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.572+0000 7fadc6fff700 1 -- 172.21.15.115:0/2922206389 wait complete. 2023-07-27T14:30:10.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.574+0000 7fadc6fff700 1 Processor -- start 2023-07-27T14:30:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.575+0000 7fadc6fff700 1 -- start start 2023-07-27T14:30:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadc6fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc00aa050 0x7fadc00b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadc6fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc00aaa40 0x7fadc00ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadc6fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc0153ec0 0x7fadc013d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadc6fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00aed30 con 0x7fadc00aaa40 2023-07-27T14:30:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadc6fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00af010 con 0x7fadc00aa050 2023-07-27T14:30:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadc6fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00af2f0 con 0x7fadc0153ec0 2023-07-27T14:30:10.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadbffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc00aaa40 0x7fadc00ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadbffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc00aaa40 0x7fadc00ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42480/0 (socket says 172.21.15.115:42480) 2023-07-27T14:30:10.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadc4d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc00aa050 0x7fadc00b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadbffff700 1 -- 172.21.15.115:0/1747866230 learned_addr learned my addr 172.21.15.115:0/1747866230 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:10.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.576+0000 7fadc559c700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc0153ec0 0x7fadc013d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbffff700 1 -- 172.21.15.115:0/1747866230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc0153ec0 msgr2=0x7fadc013d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbffff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc0153ec0 0x7fadc013d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbffff700 1 -- 172.21.15.115:0/1747866230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc00aa050 msgr2=0x7fadc00b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbffff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc00aa050 0x7fadc00b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbffff700 1 -- 172.21.15.115:0/1747866230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4009370 con 0x7fadc00aaa40 2023-07-27T14:30:10.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbffff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc00aaa40 0x7fadc00ae510 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fadac00d860 tx=0x7fadac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:10.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbcff9700 1 -- 172.21.15.115:0/1747866230 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00f520 con 0x7fadc00aaa40 2023-07-27T14:30:10.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbcff9700 1 -- 172.21.15.115:0/1747866230 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac00f680 con 0x7fadc00aaa40 2023-07-27T14:30:10.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadbcff9700 1 -- 172.21.15.115:0/1747866230 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00fa00 con 0x7fadc00aaa40 2023-07-27T14:30:10.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00af5d0 con 0x7fadc00aaa40 2023-07-27T14:30:10.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.577+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc0150ae0 con 0x7fadc00aaa40 2023-07-27T14:30:10.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.578+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc0150d60 con 0x7fadc00aaa40 2023-07-27T14:30:10.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.579+0000 7fadbcff9700 1 -- 172.21.15.115:0/1747866230 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fadac01a030 con 0x7fadc00aaa40 2023-07-27T14:30:10.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.580+0000 7fadbcff9700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada405f030 0x7fada40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:10.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.580+0000 7fadbcff9700 1 -- 172.21.15.115:0/1747866230 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fadac079870 con 0x7fadc00aaa40 2023-07-27T14:30:10.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.580+0000 7fadc4d9b700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada405f030 0x7fada40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:10.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.581+0000 7fadc4d9b700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada405f030 0x7fada40614f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fadb4009fd0 tx=0x7fadb4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:10.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.583+0000 7fadbcff9700 1 -- 172.21.15.115:0/1747866230 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fadac04ad30 con 0x7fadc00aaa40 2023-07-27T14:30:10.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.798+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadc006c470 con 0x7fadc00aaa40 2023-07-27T14:30:10.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.798+0000 7fadbcff9700 1 -- 172.21.15.115:0/1747866230 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fadac04e350 con 0x7fadc00aaa40 2023-07-27T14:30:10.827 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:10.827 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1259074753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1259074753},{"type":"v1","addr":"172.21.15.115:6837","nonce":1259074753}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1004586884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1004586884},{"type":"v1","addr":"172.21.15.159:6834","nonce":1004586884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2086004294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2086004294},{"type":"v1","addr":"172.21.15.159:6835","nonce":2086004294}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5913,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4292094527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4292094527},{"type":"v1","addr":"172.21.15.115:6836","nonce":4292094527}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-07-27T14:30:10.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada405f030 msgr2=0x7fada40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada405f030 0x7fada40614f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fadb4009fd0 tx=0x7fadb4017000).stop 2023-07-27T14:30:10.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc00aaa40 msgr2=0x7fadc00ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:10.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc00aaa40 0x7fadc00ae510 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fadac00d860 tx=0x7fadac008040).stop 2023-07-27T14:30:10.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 shutdown_connections 2023-07-27T14:30:10.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada405f030 0x7fada40614f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc0153ec0 0x7fadc013d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc00aa050 0x7fadc00b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 --2- 172.21.15.115:0/1747866230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc00aaa40 0x7fadc00ae510 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:10.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.800+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 >> 172.21.15.115:0/1747866230 conn(0x7fadc00cb610 msgr2=0x7fadc0062ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:10.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.801+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 shutdown_connections 2023-07-27T14:30:10.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:10.801+0000 7fadc6fff700 1 -- 172.21.15.115:0/1747866230 wait complete. 2023-07-27T14:30:10.832 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 28 2023-07-27T14:30:10.845 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:30:10.846 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:30:10.846 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:30:10.846 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:30:10.846 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:30:10.847 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:30:10.847 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:30:10.847 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:30:10.847 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:30:10.848 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:30:10.848 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:30:10.848 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:30:10.849 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:30:10.849 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:30:10.849 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:30:10.850 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:30:10.860 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:30:10.860 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:30:10.861 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:30:10.861 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:30:10.863 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:30:10.864 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:30:10.865 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:30:10.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:30:10.905 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:30:10.906 DEBUG:teuthology.parallel:result is None 2023-07-27T14:30:10.908 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:30:10.908 DEBUG:teuthology.parallel:result is None 2023-07-27T14:30:10.909 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:30:10.909 DEBUG:teuthology.parallel:result is None 2023-07-27T14:30:10.914 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:30:10.914 DEBUG:teuthology.parallel:result is None 2023-07-27T14:30:10.915 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:30:11.046 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:30:11.046 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:30:11.063 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:30:11.063 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:30:11.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.092+0000 7fe9317ff700 1 Processor -- start 2023-07-27T14:30:11.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.092+0000 7fe9317ff700 1 -- start start 2023-07-27T14:30:11.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe9317ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe92c153ec0 0x7fe92c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:11.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe9317ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:11.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe9317ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe92c0aaa40 0x7fe92c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:11.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe9317ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c064ad0 con 0x7fe92c0aaa40 2023-07-27T14:30:11.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe9317ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c0aa4d0 con 0x7fe92c153ec0 2023-07-27T14:30:11.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe9317ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0c05c0 con 0x7fe92c0aa050 2023-07-27T14:30:11.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe92b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe92c0aaa40 0x7fe92c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:11.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe92b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe92c0aaa40 0x7fe92c0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42510/0 (socket says 172.21.15.115:42510) 2023-07-27T14:30:11.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe92b7fe700 1 -- 172.21.15.115:0/3343468460 learned_addr learned my addr 172.21.15.115:0/3343468460 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:11.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.093+0000 7fe92affd700 1 --2- 172.21.15.115:0/3343468460 >> v2:172.21.15.159:3300/0 conn(0x7fe92c153ec0 0x7fe92c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:11.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe92a7fc700 1 --2- 172.21.15.115:0/3343468460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:11.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe92b7fe700 1 -- 172.21.15.115:0/3343468460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 msgr2=0x7fe92c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:11.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe92b7fe700 1 --2- 172.21.15.115:0/3343468460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:11.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe92b7fe700 1 -- 172.21.15.115:0/3343468460 >> v2:172.21.15.159:3300/0 conn(0x7fe92c153ec0 msgr2=0x7fe92c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:11.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe92b7fe700 1 --2- 172.21.15.115:0/3343468460 >> v2:172.21.15.159:3300/0 conn(0x7fe92c153ec0 0x7fe92c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:11.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe92b7fe700 1 -- 172.21.15.115:0/3343468460 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c0bfc90 con 0x7fe92c0aaa40 2023-07-27T14:30:11.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe92a7fc700 1 --2- 172.21.15.115:0/3343468460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:11.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe92b7fe700 1 --2- 172.21.15.115:0/3343468460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c0aaa40 0x7fe92c0645e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe92c083e30 tx=0x7fe924009840).ready entity=mon.0 client_cookie=cbb16b1eab1f42a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:11.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe929ffb700 1 -- 172.21.15.115:0/3343468460 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400e070 con 0x7fe92c0aaa40 2023-07-27T14:30:11.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe929ffb700 1 -- 172.21.15.115:0/3343468460 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92400ba20 con 0x7fe92c0aaa40 2023-07-27T14:30:11.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.094+0000 7fe929ffb700 1 -- 172.21.15.115:0/3343468460 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400bda0 con 0x7fe92c0aaa40 2023-07-27T14:30:11.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 -- 172.21.15.115:0/3343468460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c0aaa40 msgr2=0x7fe92c0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:11.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 --2- 172.21.15.115:0/3343468460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c0aaa40 0x7fe92c0645e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe92c083e30 tx=0x7fe924009840).stop 2023-07-27T14:30:11.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 -- 172.21.15.115:0/3343468460 shutdown_connections 2023-07-27T14:30:11.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 --2- 172.21.15.115:0/3343468460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c0aaa40 0x7fe92c0645e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:11.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 --2- 172.21.15.115:0/3343468460 >> v2:172.21.15.159:3300/0 conn(0x7fe92c153ec0 0x7fe92c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:11.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 --2- 172.21.15.115:0/3343468460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:11.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 -- 172.21.15.115:0/3343468460 >> 172.21.15.115:0/3343468460 conn(0x7fe92c0cb610 msgr2=0x7fe92c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:11.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 -- 172.21.15.115:0/3343468460 shutdown_connections 2023-07-27T14:30:11.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.095+0000 7fe9317ff700 1 -- 172.21.15.115:0/3343468460 wait complete. 2023-07-27T14:30:11.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.096+0000 7fe9317ff700 1 Processor -- start 2023-07-27T14:30:11.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.096+0000 7fe9317ff700 1 -- start start 2023-07-27T14:30:11.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.097+0000 7fe9317ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c167220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:11.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.097+0000 7fe9317ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe92c0aaa40 0x7fe92c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:11.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.097+0000 7fe9317ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c153ec0 0x7fe92c0c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:11.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.097+0000 7fe9317ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0c2c00 con 0x7fe92c153ec0 2023-07-27T14:30:11.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.097+0000 7fe9317ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0c2ee0 con 0x7fe92c0aaa40 2023-07-27T14:30:11.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.097+0000 7fe9317ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c167a00 con 0x7fe92c0aa050 2023-07-27T14:30:11.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c153ec0 0x7fe92c0c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:11.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92a7fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe92c0aaa40 0x7fe92c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:11.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c153ec0 0x7fe92c0c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42514/0 (socket says 172.21.15.115:42514) 2023-07-27T14:30:11.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 -- 172.21.15.115:0/4128298918 learned_addr learned my addr 172.21.15.115:0/4128298918 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:11.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92affd700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c167220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:11.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 -- 172.21.15.115:0/4128298918 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 msgr2=0x7fe92c167220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:11.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c167220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:11.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 -- 172.21.15.115:0/4128298918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe92c0aaa40 msgr2=0x7fe92c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:11.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe92c0aaa40 0x7fe92c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:11.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 -- 172.21.15.115:0/4128298918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924009ae0 con 0x7fe92c153ec0 2023-07-27T14:30:11.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe92b7fe700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c153ec0 0x7fe92c0c3370 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fe92400b6c0 tx=0x7fe924009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:11.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.098+0000 7fe912ffd700 1 -- 172.21.15.115:0/4128298918 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9240032f0 con 0x7fe92c153ec0 2023-07-27T14:30:11.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.099+0000 7fe912ffd700 1 -- 172.21.15.115:0/4128298918 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9240092e0 con 0x7fe92c153ec0 2023-07-27T14:30:11.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.099+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c167ce0 con 0x7fe92c153ec0 2023-07-27T14:30:11.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.099+0000 7fe912ffd700 1 -- 172.21.15.115:0/4128298918 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92401e6a0 con 0x7fe92c153ec0 2023-07-27T14:30:11.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.099+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c167710 con 0x7fe92c153ec0 2023-07-27T14:30:11.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.100+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c0c3070 con 0x7fe92c153ec0 2023-07-27T14:30:11.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.101+0000 7fe912ffd700 1 -- 172.21.15.115:0/4128298918 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fe924025030 con 0x7fe92c153ec0 2023-07-27T14:30:11.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.101+0000 7fe912ffd700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe91805f060 0x7fe918061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:11.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.102+0000 7fe912ffd700 1 -- 172.21.15.115:0/4128298918 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe92407b0b0 con 0x7fe92c153ec0 2023-07-27T14:30:11.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.102+0000 7fe92affd700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe91805f060 0x7fe918061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:11.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.102+0000 7fe92affd700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe91805f060 0x7fe918061520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fe91c009b90 tx=0x7fe91c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:11.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.106+0000 7fe912ffd700 1 -- 172.21.15.115:0/4128298918 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe92404c730 con 0x7fe92c153ec0 2023-07-27T14:30:11.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:11.292+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe92c0bff70 con 0x7fe92c153ec0 2023-07-27T14:30:12.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.068+0000 7fe912ffd700 1 -- 172.21.15.115:0/4128298918 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe924023070 con 0x7fe92c153ec0 2023-07-27T14:30:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.071+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe91805f060 msgr2=0x7fe918061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.071+0000 7fe9317ff700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe91805f060 0x7fe918061520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fe91c009b90 tx=0x7fe91c009060).stop 2023-07-27T14:30:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.071+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c153ec0 msgr2=0x7fe92c0c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.071+0000 7fe9317ff700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c153ec0 0x7fe92c0c3370 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fe92400b6c0 tx=0x7fe924009840).stop 2023-07-27T14:30:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.072+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 shutdown_connections 2023-07-27T14:30:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.072+0000 7fe9317ff700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe91805f060 0x7fe918061520 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.072+0000 7fe9317ff700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe92c153ec0 0x7fe92c0c3370 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.072+0000 7fe9317ff700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe92c0aa050 0x7fe92c167220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.072+0000 7fe9317ff700 1 --2- 172.21.15.115:0/4128298918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe92c0aaa40 0x7fe92c0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.072+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 >> 172.21.15.115:0/4128298918 conn(0x7fe92c0cb610 msgr2=0x7fe92c0ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.072+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 shutdown_connections 2023-07-27T14:30:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.072+0000 7fe9317ff700 1 -- 172.21.15.115:0/4128298918 wait complete. 2023-07-27T14:30:12.101 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:30:12.120 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:30:12.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.283+0000 7f12f93ff700 1 Processor -- start 2023-07-27T14:30:12.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.284+0000 7f12f93ff700 1 -- start start 2023-07-27T14:30:12.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f93ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f40aaa40 0x7f12f40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f93ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f12f41542a0 0x7f12f40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f93ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f40aa4d0 con 0x7f12f4153ec0 2023-07-27T14:30:12.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f93ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f4064ad0 con 0x7f12f41542a0 2023-07-27T14:30:12.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f93ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f40c05c0 con 0x7f12f40aaa40 2023-07-27T14:30:12.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f12f4153ec0 0x7f12f40a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50160/0 (socket says 172.21.15.115:50160) 2023-07-27T14:30:12.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f2ffd700 1 -- 172.21.15.115:0/2199838667 learned_addr learned my addr 172.21.15.115:0/2199838667 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:12.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120943404 0 0) 0x7f12e4001110 con 0x7f12f4153ec0 2023-07-27T14:30:12.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f37fe700 1 --2- 172.21.15.115:0/2199838667 >> v2:172.21.15.159:3300/0 conn(0x7f12f41542a0 0x7f12f40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f27fc700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f40aaa40 0x7f12f40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.285+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12dc0033f0 con 0x7f12f4153ec0 2023-07-27T14:30:12.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097590692 0 0) 0x7f12dc0033f0 con 0x7f12f4153ec0 2023-07-27T14:30:12.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f40aaa40 msgr2=0x7f12f40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:12.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f40aaa40 0x7f12f40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 >> v2:172.21.15.159:3300/0 conn(0x7f12f41542a0 msgr2=0x7f12f40645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:12.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 --2- 172.21.15.115:0/2199838667 >> v2:172.21.15.159:3300/0 conn(0x7f12f41542a0 0x7f12f40645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f40c1a60 con 0x7f12f4153ec0 2023-07-27T14:30:12.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f12e4001600 con 0x7f12f4153ec0 2023-07-27T14:30:12.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 >> v1:172.21.15.115:6789/0 conn(0x7f12f4153ec0 legacy=0x7f12f40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f40aaa40 0x7f12dc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12dc003e10 0x7f12dc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc004b80 0x7f12dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f4064ad0 con 0x7f12dc004b80 2023-07-27T14:30:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f40c05c0 con 0x7f12dc003e10 2023-07-27T14:30:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc00b8e0 con 0x7f12f40aaa40 2023-07-27T14:30:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f37fe700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc004b80 0x7f12dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f2ffd700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f40aaa40 0x7f12dc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f27fc700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12dc003e10 0x7f12dc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.286+0000 7f12f37fe700 1 -- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f40aaa40 msgr2=0x7f12dc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:12.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f37fe700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12f40aaa40 0x7f12dc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f37fe700 1 -- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12dc003e10 msgr2=0x7f12dc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:12.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f37fe700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12dc003e10 0x7f12dc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f37fe700 1 -- 172.21.15.115:0/2199838667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0033f0 con 0x7f12dc004b80 2023-07-27T14:30:12.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f37fe700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc004b80 0x7f12dc005000 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f12f40c75e0 tx=0x7f12ec00b040).ready entity=mon.0 client_cookie=8a2327576b4d7f08 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:12.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec009ac0 con 0x7f12dc004b80 2023-07-27T14:30:12.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec00f040 con 0x7f12dc004b80 2023-07-27T14:30:12.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f1ffb700 1 -- 172.21.15.115:0/2199838667 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec00eca0 con 0x7f12dc004b80 2023-07-27T14:30:12.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f93ff700 1 -- 172.21.15.115:0/2199838667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc004b80 msgr2=0x7f12dc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f93ff700 1 --2- 172.21.15.115:0/2199838667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12dc004b80 0x7f12dc005000 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f12f40c75e0 tx=0x7f12ec00b040).stop 2023-07-27T14:30:12.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.287+0000 7f12f37fe700 1 -- 172.21.15.115:0/2199838667 reap_dead start 2023-07-27T14:30:12.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.288+0000 7f12f93ff700 1 -- 172.21.15.115:0/2199838667 shutdown_connections 2023-07-27T14:30:12.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.288+0000 7f12f93ff700 1 -- 172.21.15.115:0/2199838667 >> 172.21.15.115:0/2199838667 conn(0x7f12f40cb610 msgr2=0x7f12f40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:12.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.288+0000 7f12f93ff700 1 -- 172.21.15.115:0/2199838667 shutdown_connections 2023-07-27T14:30:12.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.288+0000 7f12f93ff700 1 -- 172.21.15.115:0/2199838667 wait complete. 2023-07-27T14:30:12.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.289+0000 7f12f93ff700 1 Processor -- start 2023-07-27T14:30:12.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.289+0000 7f12f93ff700 1 -- start start 2023-07-27T14:30:12.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f93ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12dc004b80 0x7f12f40ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f93ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12f4156f40 0x7f12f414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f93ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f414ee30 0x7f12f41503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f93ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f4158050 con 0x7f12f4156f40 2023-07-27T14:30:12.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f93ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f41573d0 con 0x7f12f414ee30 2023-07-27T14:30:12.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f93ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f41576b0 con 0x7f12dc004b80 2023-07-27T14:30:12.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12f4156f40 0x7f12f414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12f4156f40 0x7f12f414e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42544/0 (socket says 172.21.15.115:42544) 2023-07-27T14:30:12.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.290+0000 7f12f27fc700 1 -- 172.21.15.115:0/3197198236 learned_addr learned my addr 172.21.15.115:0/3197198236 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:12.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f2ffd700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12dc004b80 0x7f12f40ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f37fe700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f414ee30 0x7f12f41503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f27fc700 1 -- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12dc004b80 msgr2=0x7f12f40ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f27fc700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12dc004b80 0x7f12f40ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f27fc700 1 -- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f414ee30 msgr2=0x7f12f41503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f27fc700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f414ee30 0x7f12f41503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f27fc700 1 -- 172.21.15.115:0/3197198236 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4157990 con 0x7f12f4156f40 2023-07-27T14:30:12.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f2ffd700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12dc004b80 0x7f12f40ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:12.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f37fe700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f414ee30 0x7f12f41503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:12.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f27fc700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12f4156f40 0x7f12f414e940 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f12e80119f0 tx=0x7f12e8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:12.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12daffd700 1 -- 172.21.15.115:0/3197198236 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800f940 con 0x7f12f4156f40 2023-07-27T14:30:12.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12daffd700 1 -- 172.21.15.115:0/3197198236 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e800faa0 con 0x7f12f4156f40 2023-07-27T14:30:12.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12daffd700 1 -- 172.21.15.115:0/3197198236 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800fe20 con 0x7f12f4156f40 2023-07-27T14:30:12.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f4157c70 con 0x7f12f4156f40 2023-07-27T14:30:12.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.291+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f41508d0 con 0x7f12f4156f40 2023-07-27T14:30:12.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.292+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f4158190 con 0x7f12f4156f40 2023-07-27T14:30:12.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.293+0000 7f12daffd700 1 -- 172.21.15.115:0/3197198236 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f12e8014650 con 0x7f12f4156f40 2023-07-27T14:30:12.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.294+0000 7f12daffd700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12e005f060 0x7f12e0061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.294+0000 7f12daffd700 1 -- 172.21.15.115:0/3197198236 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f12e807a450 con 0x7f12f4156f40 2023-07-27T14:30:12.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.294+0000 7f12f2ffd700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12e005f060 0x7f12e0061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.295+0000 7f12f2ffd700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12e005f060 0x7f12e0061520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f12e4001730 tx=0x7f12e4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:12.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.298+0000 7f12daffd700 1 -- 172.21.15.115:0/3197198236 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12e804b960 con 0x7f12f4156f40 2023-07-27T14:30:12.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.532+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f12f406c470 con 0x7f12f4156f40 2023-07-27T14:30:12.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.533+0000 7f12daffd700 1 -- 172.21.15.115:0/3197198236 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f12e8018020 con 0x7f12f4156f40 2023-07-27T14:30:12.561 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:12.561 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:30:12.561 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:30:12.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.561 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:30:12.561 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:30:12.562 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.562 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:30:12.562 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:30:12.562 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:30:12.562 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.562 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:30:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:30:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:30:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:30:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:30:12.563 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:30:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:30:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:30:12.564 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:30:12.565 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:30:12.565 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.565 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.565 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:30:12.565 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:30:12.565 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.566 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:30:12.566 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:30:12.566 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:30:12.566 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.566 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:30:12.567 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:30:12.567 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.567 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:30:12.567 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:30:12.567 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.568 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:30:12.568 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:30:12.568 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.568 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:30:12.569 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:30:12.569 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.569 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.569 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:30:12.569 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:30:12.569 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:30:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:30:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:30:12.570 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:30:12.571 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.571 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:30:12.571 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:30:12.571 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.571 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.572 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:30:12.572 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:30:12.572 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.572 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:30:12.572 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:30:12.572 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.572 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.573 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:30:12.573 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:30:12.573 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.573 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:30:12.573 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:30:12.573 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.574 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:30:12.574 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:30:12.574 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.574 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:30:12.574 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:30:12.574 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.575 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.575 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:30:12.575 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:30:12.575 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.575 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:30:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:30:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:30:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:30:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:30:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:30:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:30:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:30:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:30:12.578 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:30:12.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:30:12.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:30:12.578 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:30:12.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.579 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:30:12.579 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:30:12.579 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.579 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:30:12.579 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:30:12.579 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:30:12.579 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:30:12.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.580 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:30:12.580 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:30:12.580 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.580 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:30:12.580 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:30:12.581 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:30:12.581 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:30:12.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.581 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:30:12.581 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:30:12.581 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.582 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:30:12.582 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:30:12.582 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:30:12.582 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.582 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:30:12.583 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:30:12.583 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.583 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:30:12.583 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:30:12.583 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.583 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:12.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:12.584 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:30:12.584 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:30:12.584 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:30:12.584 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:30:12.584 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:30:12.584 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:30:12.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:12.585 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:30:12.585 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:30:12.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12e005f060 msgr2=0x7f12e0061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12e005f060 0x7f12e0061520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f12e4001730 tx=0x7f12e4009040).stop 2023-07-27T14:30:12.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12f4156f40 msgr2=0x7f12f414e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12f4156f40 0x7f12f414e940 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f12e80119f0 tx=0x7f12e8009060).stop 2023-07-27T14:30:12.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 shutdown_connections 2023-07-27T14:30:12.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f12e005f060 0x7f12e0061520 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12f414ee30 0x7f12f41503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12dc004b80 0x7f12f40ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 --2- 172.21.15.115:0/3197198236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12f4156f40 0x7f12f414e940 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 >> 172.21.15.115:0/3197198236 conn(0x7f12f40cb610 msgr2=0x7f12f40ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:12.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 shutdown_connections 2023-07-27T14:30:12.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.535+0000 7f12f93ff700 1 -- 172.21.15.115:0/3197198236 wait complete. 2023-07-27T14:30:12.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:30:12.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.748+0000 7f537c5ff700 1 Processor -- start 2023-07-27T14:30:12.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.748+0000 7f537c5ff700 1 -- start start 2023-07-27T14:30:12.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f537c5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 0x7f53740640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f537c5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f53741542a0 0x7f53740645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f537c5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53740aa4d0 con 0x7f5374153ec0 2023-07-27T14:30:12.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f537c5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5374064ad0 con 0x7f53741542a0 2023-07-27T14:30:12.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f537c5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53740c05c0 con 0x7f53740aaa40 2023-07-27T14:30:12.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f537a39b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5374153ec0 0x7f53740a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50168/0 (socket says 172.21.15.115:50168) 2023-07-27T14:30:12.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f537a39b700 1 -- 172.21.15.115:0/659321762 learned_addr learned my addr 172.21.15.115:0/659321762 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:12.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f537ab9c700 1 --2- 172.21.15.115:0/659321762 >> v2:172.21.15.159:3300/0 conn(0x7f53741542a0 0x7f53740645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f5379b9a700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 0x7f53740640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437162004 0 0) 0x7f5370001110 con 0x7f5374153ec0 2023-07-27T14:30:12.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.750+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53600033f0 con 0x7f5374153ec0 2023-07-27T14:30:12.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4260587641 0 0) 0x7f53600033f0 con 0x7f5374153ec0 2023-07-27T14:30:12.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 msgr2=0x7f53740640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:12.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 0x7f53740640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 >> v2:172.21.15.159:3300/0 conn(0x7f53741542a0 msgr2=0x7f53740645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:12.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 --2- 172.21.15.115:0/659321762 >> v2:172.21.15.159:3300/0 conn(0x7f53741542a0 0x7f53740645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740c1a60 con 0x7f5374153ec0 2023-07-27T14:30:12.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f5370001600 con 0x7f5374153ec0 2023-07-27T14:30:12.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379b9a700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 0x7f53740640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:12.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f537ab9c700 1 --2- 172.21.15.115:0/659321762 >> v2:172.21.15.159:3300/0 conn(0x7f53741542a0 0x7f53740645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:12.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 >> v1:172.21.15.115:6789/0 conn(0x7f5374153ec0 legacy=0x7f53740a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 0x7f53600038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f5360004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360004b80 0x7f5360005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5374064ad0 con 0x7f5360003dd0 2023-07-27T14:30:12.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53740c05c0 con 0x7f5360004b80 2023-07-27T14:30:12.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536000b8e0 con 0x7f53740aaa40 2023-07-27T14:30:12.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379b9a700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f5360004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f537a39b700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 0x7f53600038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f537ab9c700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360004b80 0x7f5360005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379b9a700 1 -- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 msgr2=0x7f53600038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:12.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379b9a700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53740aaa40 0x7f53600038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379b9a700 1 -- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360004b80 msgr2=0x7f5360005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:12.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379b9a700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360004b80 0x7f5360005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.751+0000 7f5379b9a700 1 -- 172.21.15.115:0/659321762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640092a0 con 0x7f5360003dd0 2023-07-27T14:30:12.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f5379b9a700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f5360004690 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f53740aae20 tx=0x7f5364009060).ready entity=mon.0 client_cookie=4c8736c2501cb0d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:12.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640095c0 con 0x7f5360003dd0 2023-07-27T14:30:12.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536400e710 con 0x7f5360003dd0 2023-07-27T14:30:12.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f5379399700 1 -- 172.21.15.115:0/659321762 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536400ea90 con 0x7f5360003dd0 2023-07-27T14:30:12.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f537c5ff700 1 -- 172.21.15.115:0/659321762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 msgr2=0x7f5360004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f537c5ff700 1 --2- 172.21.15.115:0/659321762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f5360004690 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f53740aae20 tx=0x7f5364009060).stop 2023-07-27T14:30:12.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f537ab9c700 1 -- 172.21.15.115:0/659321762 reap_dead start 2023-07-27T14:30:12.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f537c5ff700 1 -- 172.21.15.115:0/659321762 shutdown_connections 2023-07-27T14:30:12.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f537c5ff700 1 -- 172.21.15.115:0/659321762 >> 172.21.15.115:0/659321762 conn(0x7f53740cb610 msgr2=0x7f53740c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:12.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f537c5ff700 1 -- 172.21.15.115:0/659321762 shutdown_connections 2023-07-27T14:30:12.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.752+0000 7f537c5ff700 1 -- 172.21.15.115:0/659321762 wait complete. 2023-07-27T14:30:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.754+0000 7f537c5ff700 1 Processor -- start 2023-07-27T14:30:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.754+0000 7f537c5ff700 1 -- start start 2023-07-27T14:30:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537c5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f537414ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537c5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53740c3b20 0x7f537414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537c5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5374062ac0 0x7f5374062f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537c5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53741514b0 con 0x7f5360003dd0 2023-07-27T14:30:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537c5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5374063410 con 0x7f53740c3b20 2023-07-27T14:30:12.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537c5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53741508a0 con 0x7f5374062ac0 2023-07-27T14:30:12.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537a39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f537414ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537a39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f537414ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42562/0 (socket says 172.21.15.115:42562) 2023-07-27T14:30:12.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537a39b700 1 -- 172.21.15.115:0/1825691382 learned_addr learned my addr 172.21.15.115:0/1825691382 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:12.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f5379b9a700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53740c3b20 0x7f537414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.755+0000 7f537a39b700 1 -- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5374062ac0 msgr2=0x7f5374062f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537ab9c700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5374062ac0 0x7f5374062f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537a39b700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5374062ac0 0x7f5374062f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537a39b700 1 -- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53740c3b20 msgr2=0x7f537414b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537a39b700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53740c3b20 0x7f537414b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537a39b700 1 -- 172.21.15.115:0/1825691382 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5374150b80 con 0x7f5360003dd0 2023-07-27T14:30:12.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f5379b9a700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53740c3b20 0x7f537414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:12.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537ab9c700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5374062ac0 0x7f5374062f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:12.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537a39b700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f537414ffc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f53700046b0 tx=0x7f5370007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:12.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f536a7fc700 1 -- 172.21.15.115:0/1825691382 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370011590 con 0x7f5360003dd0 2023-07-27T14:30:12.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f536a7fc700 1 -- 172.21.15.115:0/1825691382 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53700116f0 con 0x7f5360003dd0 2023-07-27T14:30:12.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5374150e60 con 0x7f5360003dd0 2023-07-27T14:30:12.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f536a7fc700 1 -- 172.21.15.115:0/1825691382 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370011a70 con 0x7f5360003dd0 2023-07-27T14:30:12.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.756+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53741504b0 con 0x7f5360003dd0 2023-07-27T14:30:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.757+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5374064f60 con 0x7f5360003dd0 2023-07-27T14:30:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.758+0000 7f536a7fc700 1 -- 172.21.15.115:0/1825691382 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f537001b030 con 0x7f5360003dd0 2023-07-27T14:30:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.759+0000 7f536a7fc700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f535805f090 0x7f5358061550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.759+0000 7f536a7fc700 1 -- 172.21.15.115:0/1825691382 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f53700792f0 con 0x7f5360003dd0 2023-07-27T14:30:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.759+0000 7f5379b9a700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f535805f090 0x7f5358061550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.760+0000 7f5379b9a700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f535805f090 0x7f5358061550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f5374151f10 tx=0x7f536401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:12.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.763+0000 7f536a7fc700 1 -- 172.21.15.115:0/1825691382 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f537004a8b0 con 0x7f5360003dd0 2023-07-27T14:30:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.932+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53740aa4d0 con 0x7f5360003dd0 2023-07-27T14:30:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.933+0000 7f536a7fc700 1 -- 172.21.15.115:0/1825691382 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f53740aa4d0 con 0x7f5360003dd0 2023-07-27T14:30:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:12.961 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":64,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:30:12.063080+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:30:12.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f535805f090 msgr2=0x7f5358061550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f535805f090 0x7f5358061550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f5374151f10 tx=0x7f536401a000).stop 2023-07-27T14:30:12.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 msgr2=0x7f537414ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f537414ffc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f53700046b0 tx=0x7f5370007900).stop 2023-07-27T14:30:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 shutdown_connections 2023-07-27T14:30:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f535805f090 0x7f5358061550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5374062ac0 0x7f5374062f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5360003dd0 0x7f537414ffc0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 --2- 172.21.15.115:0/1825691382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53740c3b20 0x7f537414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.935+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 >> 172.21.15.115:0/1825691382 conn(0x7f53740cb610 msgr2=0x7f53740afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.936+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 shutdown_connections 2023-07-27T14:30:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:12.936+0000 7f537c5ff700 1 -- 172.21.15.115:0/1825691382 wait complete. 2023-07-27T14:30:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:30:12.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:30:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.145+0000 7f7cb4fff700 1 Processor -- start 2023-07-27T14:30:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.145+0000 7f7cb4fff700 1 -- start start 2023-07-27T14:30:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.146+0000 7f7cb4fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7cb0063260 0x7f7cb0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.146+0000 7f7cb4fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7cb014b1e0 0x7f7cb00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.146+0000 7f7cb4fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb01553f0 con 0x7f7cb014ae00 2023-07-27T14:30:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.146+0000 7f7cb4fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb0157a50 con 0x7f7cb014b1e0 2023-07-27T14:30:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.146+0000 7f7cb4fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb0157d10 con 0x7f7cb0063260 2023-07-27T14:30:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.147+0000 7f7caed9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7cb014b1e0 0x7f7cb00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.147+0000 7f7caed9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7cb014b1e0 0x7f7cb00a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42568/0 (socket says 172.21.15.115:42568) 2023-07-27T14:30:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.147+0000 7f7caed9d700 1 -- 172.21.15.115:0/3712789130 learned_addr learned my addr 172.21.15.115:0/3712789130 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.147+0000 7f7cadd9b700 1 --2- 172.21.15.115:0/3712789130 >> v2:172.21.15.159:3300/0 conn(0x7f7cb0063260 0x7f7cb0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.147+0000 7f7caed9d700 1 -- 172.21.15.115:0/3712789130 >> v2:172.21.15.159:3300/0 conn(0x7f7cb0063260 msgr2=0x7f7cb0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.147+0000 7f7caed9d700 1 --2- 172.21.15.115:0/3712789130 >> v2:172.21.15.159:3300/0 conn(0x7f7cb0063260 0x7f7cb0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.147+0000 7f7caed9d700 1 -- 172.21.15.115:0/3712789130 >> v1:172.21.15.159:6789/0 conn(0x7f7cb014ae00 legacy=0x7f7cb0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.147+0000 7f7caed9d700 1 -- 172.21.15.115:0/3712789130 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0157ff0 con 0x7f7cb014b1e0 2023-07-27T14:30:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7caed9d700 1 --2- 172.21.15.115:0/3712789130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb014b1e0 0x7f7cb00a98c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f7cb00cbc00 tx=0x7f7ca8009840).ready entity=mon.0 client_cookie=1721a0a2e4ec317f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cad59a700 1 -- 172.21.15.115:0/3712789130 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800e070 con 0x7f7cb014b1e0 2023-07-27T14:30:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cad59a700 1 -- 172.21.15.115:0/3712789130 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800ba50 con 0x7f7cb014b1e0 2023-07-27T14:30:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cad59a700 1 -- 172.21.15.115:0/3712789130 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800bdd0 con 0x7f7cb014b1e0 2023-07-27T14:30:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3712789130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb014b1e0 msgr2=0x7f7cb00a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3712789130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb014b1e0 0x7f7cb00a98c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f7cb00cbc00 tx=0x7f7ca8009840).stop 2023-07-27T14:30:13.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3712789130 shutdown_connections 2023-07-27T14:30:13.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3712789130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb014b1e0 0x7f7cb00a98c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3712789130 >> v2:172.21.15.159:3300/0 conn(0x7f7cb0063260 0x7f7cb0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.148+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3712789130 >> 172.21.15.115:0/3712789130 conn(0x7f7cb005e940 msgr2=0x7f7cb00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:13.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.149+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3712789130 shutdown_connections 2023-07-27T14:30:13.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.149+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3712789130 wait complete. 2023-07-27T14:30:13.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.150+0000 7f7cb4fff700 1 Processor -- start 2023-07-27T14:30:13.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.150+0000 7f7cb4fff700 1 -- start start 2023-07-27T14:30:13.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cb4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb0063260 0x7f7cb01672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cb4fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb014ae00 0x7f7cb0167790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cb4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cb014b1e0 0x7f7cb014b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cb4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0167c80 con 0x7f7cb0063260 2023-07-27T14:30:13.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cb4fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb014d030 con 0x7f7cb014ae00 2023-07-27T14:30:13.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cb4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb014c420 con 0x7f7cb014b1e0 2023-07-27T14:30:13.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cae59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb0063260 0x7f7cb01672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cae59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb0063260 0x7f7cb01672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42582/0 (socket says 172.21.15.115:42582) 2023-07-27T14:30:13.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.151+0000 7f7cae59c700 1 -- 172.21.15.115:0/3326562004 learned_addr learned my addr 172.21.15.115:0/3326562004 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:13.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cadd9b700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb014ae00 0x7f7cb0167790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7caed9d700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cb014b1e0 0x7f7cb014b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cae59c700 1 -- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cb014b1e0 msgr2=0x7f7cb014b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cae59c700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cb014b1e0 0x7f7cb014b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cae59c700 1 -- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb014ae00 msgr2=0x7f7cb0167790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cae59c700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb014ae00 0x7f7cb0167790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cae59c700 1 -- 172.21.15.115:0/3326562004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8009ae0 con 0x7f7cb0063260 2023-07-27T14:30:13.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7caed9d700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cb014b1e0 0x7f7cb014b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:13.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cae59c700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb0063260 0x7f7cb01672a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f7ca000c4c0 tx=0x7f7ca0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7c9e7fc700 1 -- 172.21.15.115:0/3326562004 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0007020 con 0x7f7cb0063260 2023-07-27T14:30:13.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7c9e7fc700 1 -- 172.21.15.115:0/3326562004 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca0001e90 con 0x7f7cb0063260 2023-07-27T14:30:13.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7c9e7fc700 1 -- 172.21.15.115:0/3326562004 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00073b0 con 0x7f7cb0063260 2023-07-27T14:30:13.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb014c700 con 0x7f7cb0063260 2023-07-27T14:30:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.152+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb014ccc0 con 0x7f7cb0063260 2023-07-27T14:30:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.153+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb006c470 con 0x7f7cb0063260 2023-07-27T14:30:13.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.154+0000 7f7c9e7fc700 1 -- 172.21.15.115:0/3326562004 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f7ca0010070 con 0x7f7cb0063260 2023-07-27T14:30:13.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.156+0000 7f7c9e7fc700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7c9005f060 0x7f7c90061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.156+0000 7f7c9e7fc700 1 -- 172.21.15.115:0/3326562004 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7ca0079460 con 0x7f7cb0063260 2023-07-27T14:30:13.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.156+0000 7f7cadd9b700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7c9005f060 0x7f7c90061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.156+0000 7f7cadd9b700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7c9005f060 0x7f7c90061520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f7cb006b970 tx=0x7f7ca4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.160+0000 7f7c9e7fc700 1 -- 172.21.15.115:0/3326562004 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ca004aa80 con 0x7f7cb0063260 2023-07-27T14:30:13.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.326+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7cb00a9a60 con 0x7f7cb0063260 2023-07-27T14:30:13.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.326+0000 7f7c9e7fc700 1 -- 172.21.15.115:0/3326562004 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7ca004e0a0 con 0x7f7cb0063260 2023-07-27T14:30:13.355 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:30:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.328+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7c9005f060 msgr2=0x7f7c90061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.328+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7c9005f060 0x7f7c90061520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f7cb006b970 tx=0x7f7ca4008040).stop 2023-07-27T14:30:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.328+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb0063260 msgr2=0x7f7cb01672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.328+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb0063260 0x7f7cb01672a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f7ca000c4c0 tx=0x7f7ca0007e00).stop 2023-07-27T14:30:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.329+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 shutdown_connections 2023-07-27T14:30:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.329+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7c9005f060 0x7f7c90061520 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.329+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7cb014b1e0 0x7f7cb014b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.329+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cb0063260 0x7f7cb01672a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.329+0000 7f7cb4fff700 1 --2- 172.21.15.115:0/3326562004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cb014ae00 0x7f7cb0167790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.329+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 >> 172.21.15.115:0/3326562004 conn(0x7f7cb005e940 msgr2=0x7f7cb00ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:13.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.329+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 shutdown_connections 2023-07-27T14:30:13.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.329+0000 7f7cb4fff700 1 -- 172.21.15.115:0/3326562004 wait complete. 2023-07-27T14:30:13.374 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:30:13.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.537+0000 7f56635ff700 1 Processor -- start 2023-07-27T14:30:13.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.537+0000 7f56635ff700 1 -- start start 2023-07-27T14:30:13.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.539+0000 7f56635ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14ae00 0x7f565c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.539+0000 7f56635ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c1553f0 con 0x7f565c063260 2023-07-27T14:30:13.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.539+0000 7f56635ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c157a50 con 0x7f565c14b1e0 2023-07-27T14:30:13.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.539+0000 7f56635ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c157d10 con 0x7f565c14ae00 2023-07-27T14:30:13.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.539+0000 7f5661b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f565c063260 0x7f565c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33234/0 (socket says 172.21.15.115:33234) 2023-07-27T14:30:13.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.539+0000 7f5661b9c700 1 -- 172.21.15.115:0/217721320 learned_addr learned my addr 172.21.15.115:0/217721320 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:13.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.539+0000 7f566139b700 1 --2- 172.21.15.115:0/217721320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14ae00 0x7f565c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.539+0000 7f5653fff700 1 -- 172.21.15.115:0/217721320 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226235960 0 0) 0x7f565c1553f0 con 0x7f565c063260 2023-07-27T14:30:13.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f5653fff700 1 -- 172.21.15.115:0/217721320 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56480033f0 con 0x7f565c063260 2023-07-27T14:30:13.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f5653fff700 1 -- 172.21.15.115:0/217721320 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995848936 0 0) 0x7f565c157a50 con 0x7f565c14b1e0 2023-07-27T14:30:13.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f5653fff700 1 -- 172.21.15.115:0/217721320 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f565c1553f0 con 0x7f565c14b1e0 2023-07-27T14:30:13.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f566139b700 1 -- 172.21.15.115:0/217721320 >> v1:172.21.15.159:6789/0 conn(0x7f565c14b1e0 legacy=0x7f565c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f566139b700 1 -- 172.21.15.115:0/217721320 >> v1:172.21.15.115:6789/0 conn(0x7f565c063260 legacy=0x7f565c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f566139b700 1 -- 172.21.15.115:0/217721320 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c157ff0 con 0x7f565c14ae00 2023-07-27T14:30:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f566139b700 1 --2- 172.21.15.115:0/217721320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14ae00 0x7f565c154f00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5658009790 tx=0x7f5658009060).ready entity=mon.2 client_cookie=37e5756b136a6e90 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f5653fff700 1 -- 172.21.15.115:0/217721320 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565800f510 con 0x7f565c14ae00 2023-07-27T14:30:13.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f5653fff700 1 -- 172.21.15.115:0/217721320 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565800f670 con 0x7f565c14ae00 2023-07-27T14:30:13.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.540+0000 7f5653fff700 1 -- 172.21.15.115:0/217721320 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565800f9f0 con 0x7f565c14ae00 2023-07-27T14:30:13.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.541+0000 7f56635ff700 1 -- 172.21.15.115:0/217721320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14ae00 msgr2=0x7f565c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.541+0000 7f56635ff700 1 --2- 172.21.15.115:0/217721320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14ae00 0x7f565c154f00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5658009790 tx=0x7f5658009060).stop 2023-07-27T14:30:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.541+0000 7f56635ff700 1 -- 172.21.15.115:0/217721320 shutdown_connections 2023-07-27T14:30:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.541+0000 7f56635ff700 1 --2- 172.21.15.115:0/217721320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14ae00 0x7f565c154f00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.541+0000 7f56635ff700 1 -- 172.21.15.115:0/217721320 >> 172.21.15.115:0/217721320 conn(0x7f565c05e940 msgr2=0x7f565c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.541+0000 7f56635ff700 1 -- 172.21.15.115:0/217721320 shutdown_connections 2023-07-27T14:30:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.541+0000 7f56635ff700 1 -- 172.21.15.115:0/217721320 wait complete. 2023-07-27T14:30:13.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.542+0000 7f56635ff700 1 Processor -- start 2023-07-27T14:30:13.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.542+0000 7f56635ff700 1 -- start start 2023-07-27T14:30:13.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.543+0000 7f56635ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c063260 0x7f565c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.543+0000 7f56635ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c14ae00 0x7f565c164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.543+0000 7f56635ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14b1e0 0x7f565c0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.543+0000 7f56635ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0b0d20 con 0x7f565c063260 2023-07-27T14:30:13.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.543+0000 7f56635ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c163c00 con 0x7f565c14ae00 2023-07-27T14:30:13.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.543+0000 7f56635ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c164170 con 0x7f565c14b1e0 2023-07-27T14:30:13.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c063260 0x7f565c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c063260 0x7f565c14d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59470/0 (socket says 172.21.15.115:59470) 2023-07-27T14:30:13.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 -- 172.21.15.115:0/696769847 learned_addr learned my addr 172.21.15.115:0/696769847 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:13.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f5661b9c700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14b1e0 0x7f565c0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f5660b9a700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c14ae00 0x7f565c164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 -- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14b1e0 msgr2=0x7f565c0afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14b1e0 0x7f565c0afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 -- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c14ae00 msgr2=0x7f565c164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c14ae00 0x7f565c164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 -- 172.21.15.115:0/696769847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580092a0 con 0x7f565c063260 2023-07-27T14:30:13.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f5660b9a700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c14ae00 0x7f565c164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:13.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f566139b700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c063260 0x7f565c14d590 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f565c155580 tx=0x7f5658017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.544+0000 7f56517fa700 1 -- 172.21.15.115:0/696769847 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56580115d0 con 0x7f565c063260 2023-07-27T14:30:13.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.545+0000 7f56517fa700 1 -- 172.21.15.115:0/696769847 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565801e070 con 0x7f565c063260 2023-07-27T14:30:13.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.545+0000 7f56517fa700 1 -- 172.21.15.115:0/696769847 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658011980 con 0x7f565c063260 2023-07-27T14:30:13.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.545+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c14da80 con 0x7f565c063260 2023-07-27T14:30:13.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.545+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c0b0a40 con 0x7f565c063260 2023-07-27T14:30:13.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.546+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c164450 con 0x7f565c063260 2023-07-27T14:30:13.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.547+0000 7f56517fa700 1 -- 172.21.15.115:0/696769847 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f565800f070 con 0x7f565c063260 2023-07-27T14:30:13.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.548+0000 7f56517fa700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564005f060 0x7f5640061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.548+0000 7f56517fa700 1 -- 172.21.15.115:0/696769847 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f565807ae60 con 0x7f565c063260 2023-07-27T14:30:13.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.548+0000 7f5660b9a700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564005f060 0x7f5640061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.548+0000 7f5660b9a700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564005f060 0x7f5640061520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f564c007fd0 tx=0x7f564c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.552+0000 7f56517fa700 1 -- 172.21.15.115:0/696769847 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f565804c370 con 0x7f565c063260 2023-07-27T14:30:13.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.721+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f565c06c470 con 0x7f565c063260 2023-07-27T14:30:13.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.722+0000 7f56517fa700 1 -- 172.21.15.115:0/696769847 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5658028070 con 0x7f565c063260 2023-07-27T14:30:13.750 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:30:13.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564005f060 msgr2=0x7f5640061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564005f060 0x7f5640061520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f564c007fd0 tx=0x7f564c009040).stop 2023-07-27T14:30:13.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c063260 msgr2=0x7f565c14d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c063260 0x7f565c14d590 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f565c155580 tx=0x7f5658017000).stop 2023-07-27T14:30:13.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 shutdown_connections 2023-07-27T14:30:13.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564005f060 0x7f5640061520 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c14b1e0 0x7f565c0afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c063260 0x7f565c14d590 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 --2- 172.21.15.115:0/696769847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c14ae00 0x7f565c164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 >> 172.21.15.115:0/696769847 conn(0x7f565c05e940 msgr2=0x7f565c0c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:13.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 shutdown_connections 2023-07-27T14:30:13.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.724+0000 7f56635ff700 1 -- 172.21.15.115:0/696769847 wait complete. 2023-07-27T14:30:13.770 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:30:13.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.930+0000 7f938ab9d700 1 Processor -- start 2023-07-27T14:30:13.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.930+0000 7f938ab9d700 1 -- start start 2023-07-27T14:30:13.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938ab9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153f90 0x7f93840c1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938ab9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93840c1550 0x7f9384062c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938ab9d700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93840c0bd0 con 0x7f9384153bb0 2023-07-27T14:30:13.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938ab9d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93840bffc0 con 0x7f93840c1550 2023-07-27T14:30:13.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938ab9d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c02a0 con 0x7f9384153f90 2023-07-27T14:30:13.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938a39c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93840c1550 0x7f9384062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938a39c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93840c1550 0x7f9384062c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59486/0 (socket says 172.21.15.115:59486) 2023-07-27T14:30:13.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938a39c700 1 -- 172.21.15.115:0/4284437395 learned_addr learned my addr 172.21.15.115:0/4284437395 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:13.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938939a700 1 --2- 172.21.15.115:0/4284437395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153f90 0x7f93840c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938a39c700 1 -- 172.21.15.115:0/4284437395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153f90 msgr2=0x7f93840c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:13.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938a39c700 1 --2- 172.21.15.115:0/4284437395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153f90 0x7f93840c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938a39c700 1 -- 172.21.15.115:0/4284437395 >> v1:172.21.15.159:6789/0 conn(0x7f9384153bb0 legacy=0x7f93840c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.932+0000 7f938a39c700 1 -- 172.21.15.115:0/4284437395 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840c0580 con 0x7f93840c1550 2023-07-27T14:30:13.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.933+0000 7f938a39c700 1 --2- 172.21.15.115:0/4284437395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93840c1550 0x7f9384062c00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f937c009f20 tx=0x7f937c009840).ready entity=mon.0 client_cookie=2df3c1cb84a1d9c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.933+0000 7f9388b99700 1 -- 172.21.15.115:0/4284437395 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00e070 con 0x7f93840c1550 2023-07-27T14:30:13.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.933+0000 7f9388b99700 1 -- 172.21.15.115:0/4284437395 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00b9d0 con 0x7f93840c1550 2023-07-27T14:30:13.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.933+0000 7f9388b99700 1 -- 172.21.15.115:0/4284437395 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00bd50 con 0x7f93840c1550 2023-07-27T14:30:13.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.933+0000 7f938ab9d700 1 -- 172.21.15.115:0/4284437395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93840c1550 msgr2=0x7f9384062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.933+0000 7f938ab9d700 1 --2- 172.21.15.115:0/4284437395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93840c1550 0x7f9384062c00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f937c009f20 tx=0x7f937c009840).stop 2023-07-27T14:30:13.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.933+0000 7f938ab9d700 1 -- 172.21.15.115:0/4284437395 shutdown_connections 2023-07-27T14:30:13.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.933+0000 7f938ab9d700 1 --2- 172.21.15.115:0/4284437395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93840c1550 0x7f9384062c00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.934+0000 7f938ab9d700 1 --2- 172.21.15.115:0/4284437395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153f90 0x7f93840c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.934+0000 7f938ab9d700 1 -- 172.21.15.115:0/4284437395 >> 172.21.15.115:0/4284437395 conn(0x7f938405e940 msgr2=0x7f93840cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:13.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.934+0000 7f938ab9d700 1 -- 172.21.15.115:0/4284437395 shutdown_connections 2023-07-27T14:30:13.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.934+0000 7f938ab9d700 1 -- 172.21.15.115:0/4284437395 wait complete. 2023-07-27T14:30:13.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.935+0000 7f938ab9d700 1 Processor -- start 2023-07-27T14:30:13.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.935+0000 7f938ab9d700 1 -- start start 2023-07-27T14:30:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938ab9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93840c1550 0x7f93840ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938ab9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153bb0 0x7f9384154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938ab9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9384153f90 0x7f93841526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938ab9d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840aebf0 con 0x7f9384153f90 2023-07-27T14:30:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938ab9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9384154960 con 0x7f93840c1550 2023-07-27T14:30:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938ab9d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9384154c10 con 0x7f9384153bb0 2023-07-27T14:30:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938a39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9384153f90 0x7f93841526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938a39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9384153f90 0x7f93841526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59498/0 (socket says 172.21.15.115:59498) 2023-07-27T14:30:13.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938a39c700 1 -- 172.21.15.115:0/394575839 learned_addr learned my addr 172.21.15.115:0/394575839 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:13.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f938939a700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153bb0 0x7f9384154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.936+0000 7f9389b9b700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93840c1550 0x7f93840ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f938a39c700 1 -- 172.21.15.115:0/394575839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153bb0 msgr2=0x7f9384154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f938a39c700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153bb0 0x7f9384154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f938a39c700 1 -- 172.21.15.115:0/394575839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93840c1550 msgr2=0x7f93840ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:13.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f938a39c700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93840c1550 0x7f93840ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:13.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f938a39c700 1 -- 172.21.15.115:0/394575839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c009ae0 con 0x7f9384153f90 2023-07-27T14:30:13.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f938a39c700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9384153f90 0x7f93841526a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f937c00b610 tx=0x7f937c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f9379ffb700 1 -- 172.21.15.115:0/394575839 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0092e0 con 0x7f9384153f90 2023-07-27T14:30:13.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f9379ffb700 1 -- 172.21.15.115:0/394575839 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c01e470 con 0x7f9384153f90 2023-07-27T14:30:13.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9384154ef0 con 0x7f9384153f90 2023-07-27T14:30:13.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f9379ffb700 1 -- 172.21.15.115:0/394575839 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c01e830 con 0x7f9384153f90 2023-07-27T14:30:13.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.937+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93841554b0 con 0x7f9384153f90 2023-07-27T14:30:13.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.938+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9384047270 con 0x7f9384153f90 2023-07-27T14:30:13.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.939+0000 7f9379ffb700 1 -- 172.21.15.115:0/394575839 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f937c025030 con 0x7f9384153f90 2023-07-27T14:30:13.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.940+0000 7f9379ffb700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936805f060 0x7f9368061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:13.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.940+0000 7f9379ffb700 1 -- 172.21.15.115:0/394575839 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f937c07b2c0 con 0x7f9384153f90 2023-07-27T14:30:13.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.941+0000 7f9389b9b700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936805f060 0x7f9368061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:13.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.941+0000 7f9389b9b700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936805f060 0x7f9368061520 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f9380003900 tx=0x7f9380007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:13.946+0000 7f9379ffb700 1 -- 172.21.15.115:0/394575839 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f937c04c880 con 0x7f9384153f90 2023-07-27T14:30:14.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.119+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f93840bfc00 con 0x7f9384153f90 2023-07-27T14:30:14.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.119+0000 7f9379ffb700 1 -- 172.21.15.115:0/394575839 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+143 (secure 0 0 0) 0x7f937c023070 con 0x7f9384153f90 2023-07-27T14:30:14.148 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:14.148 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:30:14.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:30:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:30:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:30:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:30:14.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:14.150 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:30:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.121+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936805f060 msgr2=0x7f9368061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.121+0000 7f938ab9d700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936805f060 0x7f9368061520 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f9380003900 tx=0x7f9380007d40).stop 2023-07-27T14:30:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.121+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9384153f90 msgr2=0x7f93841526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.121+0000 7f938ab9d700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9384153f90 0x7f93841526a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f937c00b610 tx=0x7f937c009840).stop 2023-07-27T14:30:14.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.122+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 shutdown_connections 2023-07-27T14:30:14.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.122+0000 7f938ab9d700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936805f060 0x7f9368061520 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.122+0000 7f938ab9d700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9384153f90 0x7f93841526a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.122+0000 7f938ab9d700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93840c1550 0x7f93840ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.122+0000 7f938ab9d700 1 --2- 172.21.15.115:0/394575839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9384153bb0 0x7f9384154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.122+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 >> 172.21.15.115:0/394575839 conn(0x7f938405e940 msgr2=0x7f93840acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:14.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.122+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 shutdown_connections 2023-07-27T14:30:14.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.122+0000 7f938ab9d700 1 -- 172.21.15.115:0/394575839 wait complete. 2023-07-27T14:30:14.167 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:30:14.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:30:14.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.334+0000 7ffb645ff700 1 Processor -- start 2023-07-27T14:30:14.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.334+0000 7ffb645ff700 1 -- start start 2023-07-27T14:30:14.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.335+0000 7ffb645ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffb5c0c58d0 0x7ffb5c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:14.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.335+0000 7ffb645ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c0c0ea0 con 0x7ffb5c0c3100 2023-07-27T14:30:14.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.335+0000 7ffb645ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c068e10 con 0x7ffb5c1509b0 2023-07-27T14:30:14.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.335+0000 7ffb645ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5c151280 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb62b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ffb5c0c3100 0x7ffb5c0c3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33240/0 (socket says 172.21.15.115:33240) 2023-07-27T14:30:14.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb62b9c700 1 -- 172.21.15.115:0/3041204574 learned_addr learned my addr 172.21.15.115:0/3041204574 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:14.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61b9a700 1 --2- 172.21.15.115:0/3041204574 >> v2:172.21.15.159:3300/0 conn(0x7ffb5c0c58d0 0x7ffb5c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:14.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61399700 1 -- 172.21.15.115:0/3041204574 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753710404 0 0) 0x7ffb5c0c0ea0 con 0x7ffb5c0c3100 2023-07-27T14:30:14.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61399700 1 -- 172.21.15.115:0/3041204574 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb480033f0 con 0x7ffb5c0c3100 2023-07-27T14:30:14.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61399700 1 -- 172.21.15.115:0/3041204574 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941857724 0 0) 0x7ffb5c068e10 con 0x7ffb5c1509b0 2023-07-27T14:30:14.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61399700 1 -- 172.21.15.115:0/3041204574 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c0c0ea0 con 0x7ffb5c1509b0 2023-07-27T14:30:14.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61399700 1 -- 172.21.15.115:0/3041204574 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148643422 0 0) 0x7ffb480033f0 con 0x7ffb5c0c3100 2023-07-27T14:30:14.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61b9a700 1 -- 172.21.15.115:0/3041204574 >> v1:172.21.15.159:6789/0 conn(0x7ffb5c1509b0 legacy=0x7ffb5c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61b9a700 1 -- 172.21.15.115:0/3041204574 >> v1:172.21.15.115:6789/0 conn(0x7ffb5c0c3100 legacy=0x7ffb5c0c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61b9a700 1 -- 172.21.15.115:0/3041204574 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c155190 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.336+0000 7ffb61b9a700 1 --2- 172.21.15.115:0/3041204574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c150d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7ffb4c009760 tx=0x7ffb4c009060).ready entity=mon.1 client_cookie=dd68cf49a2623cfe server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:14.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb61399700 1 -- 172.21.15.115:0/3041204574 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb540017f0 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb61399700 1 -- 172.21.15.115:0/3041204574 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c011400 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb61399700 1 -- 172.21.15.115:0/3041204574 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c011780 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb645ff700 1 -- 172.21.15.115:0/3041204574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c0c58d0 msgr2=0x7ffb5c150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb645ff700 1 --2- 172.21.15.115:0/3041204574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c150d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7ffb4c009760 tx=0x7ffb4c009060).stop 2023-07-27T14:30:14.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb645ff700 1 -- 172.21.15.115:0/3041204574 shutdown_connections 2023-07-27T14:30:14.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb645ff700 1 --2- 172.21.15.115:0/3041204574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c150d90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb645ff700 1 -- 172.21.15.115:0/3041204574 >> 172.21.15.115:0/3041204574 conn(0x7ffb5c062320 msgr2=0x7ffb5c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:14.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb645ff700 1 -- 172.21.15.115:0/3041204574 shutdown_connections 2023-07-27T14:30:14.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.337+0000 7ffb645ff700 1 -- 172.21.15.115:0/3041204574 wait complete. 2023-07-27T14:30:14.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.339+0000 7ffb645ff700 1 Processor -- start 2023-07-27T14:30:14.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.340+0000 7ffb645ff700 1 -- start start 2023-07-27T14:30:14.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb645ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb5c0c3100 0x7ffb5c166250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:14.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb645ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:14.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb645ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c1509b0 0x7ffb5c0a7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:14.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb645ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c158190 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb645ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0a70d0 con 0x7ffb5c1509b0 2023-07-27T14:30:14.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb645ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c166740 con 0x7ffb5c0c3100 2023-07-27T14:30:14.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb61b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:14.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb61b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c14f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59504/0 (socket says 172.21.15.115:59504) 2023-07-27T14:30:14.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.341+0000 7ffb61b9a700 1 -- 172.21.15.115:0/1496648454 learned_addr learned my addr 172.21.15.115:0/1496648454 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:14.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb6239b700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb5c0c3100 0x7ffb5c166250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:14.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb62b9c700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c1509b0 0x7ffb5c0a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:14.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb61b9a700 1 -- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb5c0c3100 msgr2=0x7ffb5c166250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb61b9a700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb5c0c3100 0x7ffb5c166250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb61b9a700 1 -- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c1509b0 msgr2=0x7ffb5c0a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb61b9a700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c1509b0 0x7ffb5c0a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb61b9a700 1 -- 172.21.15.115:0/1496648454 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c0092a0 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb6239b700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb5c0c3100 0x7ffb5c166250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:14.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb62b9c700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c1509b0 0x7ffb5c0a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:14.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb61b9a700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c14f710 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7ffb4c009d50 tx=0x7ffb4c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:14.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb527fc700 1 -- 172.21.15.115:0/1496648454 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0108e0 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb527fc700 1 -- 172.21.15.115:0/1496648454 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c010a40 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb527fc700 1 -- 172.21.15.115:0/1496648454 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c010dc0 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c0a64c0 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.342+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c0a6a80 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.343+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c0a7240 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.344+0000 7ffb527fc700 1 -- 172.21.15.115:0/1496648454 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7ffb4c00f070 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.345+0000 7ffb527fc700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb4005f060 0x7ffb40061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:14.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.345+0000 7ffb527fc700 1 -- 172.21.15.115:0/1496648454 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ffb4c07af20 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.345+0000 7ffb6239b700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb4005f060 0x7ffb40061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:14.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.346+0000 7ffb6239b700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb4005f060 0x7ffb40061520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7ffb580026b0 tx=0x7ffb58009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:14.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.349+0000 7ffb527fc700 1 -- 172.21.15.115:0/1496648454 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffb4c0a98f0 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.517+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7ffb5c155470 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.779+0000 7ffb527fc700 1 -- 172.21.15.115:0/1496648454 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 152+0+0 (secure 0 0 0) 0x7ffb4c04c670 con 0x7ffb5c0c58d0 2023-07-27T14:30:14.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.783+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb4005f060 msgr2=0x7ffb40061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.783+0000 7ffb645ff700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb4005f060 0x7ffb40061520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7ffb580026b0 tx=0x7ffb58009040).stop 2023-07-27T14:30:14.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.783+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0c58d0 msgr2=0x7ffb5c14f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:14.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.783+0000 7ffb645ff700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c14f710 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7ffb4c009d50 tx=0x7ffb4c016000).stop 2023-07-27T14:30:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.785+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 shutdown_connections 2023-07-27T14:30:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.785+0000 7ffb645ff700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb4005f060 0x7ffb40061520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.785+0000 7ffb645ff700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb5c1509b0 0x7ffb5c0a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.785+0000 7ffb645ff700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb5c0c3100 0x7ffb5c166250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.785+0000 7ffb645ff700 1 --2- 172.21.15.115:0/1496648454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0c58d0 0x7ffb5c14f710 secure :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0x7ffb4c009d50 tx=0x7ffb4c016000).stop 2023-07-27T14:30:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.785+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 >> 172.21.15.115:0/1496648454 conn(0x7ffb5c062320 msgr2=0x7ffb5c069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:14.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.785+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 shutdown_connections 2023-07-27T14:30:14.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:14.786+0000 7ffb645ff700 1 -- 172.21.15.115:0/1496648454 wait complete. 2023-07-27T14:30:14.818 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:30:14.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:30:15.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.001+0000 7f005dfff700 1 Processor -- start 2023-07-27T14:30:15.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.001+0000 7f005dfff700 1 -- start start 2023-07-27T14:30:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f005dfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0058157400 0x7f00580c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f005dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580a7940 0x7f00580c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f005dfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00580c7ad0 con 0x7f00580c7550 2023-07-27T14:30:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f005dfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580c5590 con 0x7f0058157400 2023-07-27T14:30:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f005dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580c0fb0 con 0x7f00580a7940 2023-07-27T14:30:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f00577fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0058157400 0x7f00580c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f00577fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0058157400 0x7f00580c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59512/0 (socket says 172.21.15.115:59512) 2023-07-27T14:30:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f0057fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f00580c7550 0x7f00580c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33244/0 (socket says 172.21.15.115:33244) 2023-07-27T14:30:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.002+0000 7f00577fe700 1 -- 172.21.15.115:0/2411789678 learned_addr learned my addr 172.21.15.115:0/2411789678 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f0056ffd700 1 --2- 172.21.15.115:0/2411789678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580a7940 0x7f00580c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00577fe700 1 -- 172.21.15.115:0/2411789678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580a7940 msgr2=0x7f00580c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00577fe700 1 --2- 172.21.15.115:0/2411789678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580a7940 0x7f00580c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00577fe700 1 -- 172.21.15.115:0/2411789678 >> v1:172.21.15.115:6789/0 conn(0x7f00580c7550 legacy=0x7f00580c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00577fe700 1 -- 172.21.15.115:0/2411789678 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580c7db0 con 0x7f0058157400 2023-07-27T14:30:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00567fc700 1 -- 172.21.15.115:0/2411789678 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539899636 0 0) 0x7f00580c7ad0 con 0x7f00580c7550 2023-07-27T14:30:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00577fe700 1 --2- 172.21.15.115:0/2411789678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580c05d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f0048006fd0 tx=0x7f00480090f0).ready entity=mon.0 client_cookie=32073e922b1d82d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:15.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00567fc700 1 -- 172.21.15.115:0/2411789678 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004800b580 con 0x7f0058157400 2023-07-27T14:30:15.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00567fc700 1 -- 172.21.15.115:0/2411789678 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004800b6e0 con 0x7f0058157400 2023-07-27T14:30:15.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.003+0000 7f00567fc700 1 -- 172.21.15.115:0/2411789678 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004800ba60 con 0x7f0058157400 2023-07-27T14:30:15.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.004+0000 7f005dfff700 1 -- 172.21.15.115:0/2411789678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 msgr2=0x7f00580c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:15.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.004+0000 7f005dfff700 1 --2- 172.21.15.115:0/2411789678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580c05d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f0048006fd0 tx=0x7f00480090f0).stop 2023-07-27T14:30:15.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.004+0000 7f005dfff700 1 -- 172.21.15.115:0/2411789678 shutdown_connections 2023-07-27T14:30:15.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.004+0000 7f005dfff700 1 --2- 172.21.15.115:0/2411789678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580c05d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.004+0000 7f005dfff700 1 --2- 172.21.15.115:0/2411789678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580a7940 0x7f00580c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.004+0000 7f005dfff700 1 -- 172.21.15.115:0/2411789678 >> 172.21.15.115:0/2411789678 conn(0x7f0058094280 msgr2=0x7f005805e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:15.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.004+0000 7f005dfff700 1 -- 172.21.15.115:0/2411789678 shutdown_connections 2023-07-27T14:30:15.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.004+0000 7f005dfff700 1 -- 172.21.15.115:0/2411789678 wait complete. 2023-07-27T14:30:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.005+0000 7f005dfff700 1 Processor -- start 2023-07-27T14:30:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.006+0000 7f005dfff700 1 -- start start 2023-07-27T14:30:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.006+0000 7f005dfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00580a7940 0x7f00580adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.006+0000 7f005dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580c7550 0x7f00580aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.006+0000 7f005dfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.006+0000 7f005dfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580af020 con 0x7f0058157400 2023-07-27T14:30:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.006+0000 7f005dfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580ae410 con 0x7f00580a7940 2023-07-27T14:30:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.006+0000 7f005dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580ae6f0 con 0x7f00580c7550 2023-07-27T14:30:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580aabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59520/0 (socket says 172.21.15.115:59520) 2023-07-27T14:30:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 -- 172.21.15.115:0/859394822 learned_addr learned my addr 172.21.15.115:0/859394822 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f00577fe700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00580a7940 0x7f00580adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0056ffd700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580c7550 0x7f00580aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 -- 172.21.15.115:0/859394822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580c7550 msgr2=0x7f00580aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580c7550 0x7f00580aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 -- 172.21.15.115:0/859394822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00580a7940 msgr2=0x7f00580adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00580a7940 0x7f00580adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 -- 172.21.15.115:0/859394822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048009370 con 0x7f0058157400 2023-07-27T14:30:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.007+0000 7f0057fff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580aabc0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f005000c810 tx=0x7f0050007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.008+0000 7f003f7fe700 1 -- 172.21.15.115:0/859394822 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050005c70 con 0x7f0058157400 2023-07-27T14:30:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.008+0000 7f003f7fe700 1 -- 172.21.15.115:0/859394822 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0050005dd0 con 0x7f0058157400 2023-07-27T14:30:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.008+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00580ae9d0 con 0x7f0058157400 2023-07-27T14:30:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.008+0000 7f003f7fe700 1 -- 172.21.15.115:0/859394822 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050007360 con 0x7f0058157400 2023-07-27T14:30:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.008+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0058095670 con 0x7f0058157400 2023-07-27T14:30:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.009+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00580af190 con 0x7f0058157400 2023-07-27T14:30:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.010+0000 7f003f7fe700 1 -- 172.21.15.115:0/859394822 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f0050010030 con 0x7f0058157400 2023-07-27T14:30:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.011+0000 7f003f7fe700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f004405f060 0x7f0044061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.012+0000 7f003f7fe700 1 -- 172.21.15.115:0/859394822 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f005007a2d0 con 0x7f0058157400 2023-07-27T14:30:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.012+0000 7f00577fe700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f004405f060 0x7f0044061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.012+0000 7f00577fe700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f004405f060 0x7f0044061520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f0048009130 tx=0x7f0048017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.015+0000 7f003f7fe700 1 -- 172.21.15.115:0/859394822 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f005004b670 con 0x7f0058157400 2023-07-27T14:30:15.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.185+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f005806c470 con 0x7f0058157400 2023-07-27T14:30:15.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.783+0000 7f003f7fe700 1 -- 172.21.15.115:0/859394822 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7f005004ec90 con 0x7f0058157400 2023-07-27T14:30:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.791+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f004405f060 msgr2=0x7f0044061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.791+0000 7f005dfff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f004405f060 0x7f0044061520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f0048009130 tx=0x7f0048017000).stop 2023-07-27T14:30:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.791+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 msgr2=0x7f00580aabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.791+0000 7f005dfff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580aabc0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f005000c810 tx=0x7f0050007f10).stop 2023-07-27T14:30:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.794+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 shutdown_connections 2023-07-27T14:30:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.794+0000 7f005dfff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f004405f060 0x7f0044061520 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.794+0000 7f005dfff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0058157400 0x7f00580aabc0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.794+0000 7f005dfff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00580a7940 0x7f00580adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.794+0000 7f005dfff700 1 --2- 172.21.15.115:0/859394822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00580c7550 0x7f00580aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.794+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 >> 172.21.15.115:0/859394822 conn(0x7f0058094280 msgr2=0x7f00580c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.797+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 shutdown_connections 2023-07-27T14:30:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:15.798+0000 7f005dfff700 1 -- 172.21.15.115:0/859394822 wait complete. 2023-07-27T14:30:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:30:15.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:30:16.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.020+0000 7fd027dff700 1 Processor -- start 2023-07-27T14:30:16.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.020+0000 7fd027dff700 1 -- start start 2023-07-27T14:30:16.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd027dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd020062320 0x7fd0200c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd027dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd020062e10 0x7fd020065520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd027dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd020064230 con 0x7fd0200c4c70 2023-07-27T14:30:16.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd027dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd020065090 con 0x7fd020062320 2023-07-27T14:30:16.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd027dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd020063fb0 con 0x7fd020062e10 2023-07-27T14:30:16.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd025b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd020062320 0x7fd0200c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd025b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd020062320 0x7fd0200c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59522/0 (socket says 172.21.15.115:59522) 2023-07-27T14:30:16.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd025b9b700 1 -- 172.21.15.115:0/2891313320 learned_addr learned my addr 172.21.15.115:0/2891313320 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd02639c700 1 --2- 172.21.15.115:0/2891313320 >> v2:172.21.15.159:3300/0 conn(0x7fd020062e10 0x7fd020065520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd025b9b700 1 -- 172.21.15.115:0/2891313320 >> v2:172.21.15.159:3300/0 conn(0x7fd020062e10 msgr2=0x7fd020065520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd025b9b700 1 --2- 172.21.15.115:0/2891313320 >> v2:172.21.15.159:3300/0 conn(0x7fd020062e10 0x7fd020065520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.022+0000 7fd025b9b700 1 -- 172.21.15.115:0/2891313320 >> v1:172.21.15.115:6789/0 conn(0x7fd0200c4c70 legacy=0x7fd020062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.023+0000 7fd025b9b700 1 -- 172.21.15.115:0/2891313320 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200c1c00 con 0x7fd020062320 2023-07-27T14:30:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.023+0000 7fd025b9b700 1 --2- 172.21.15.115:0/2891313320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062320 0x7fd0200c1710 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fd0200a5650 tx=0x7fd01c00b370).ready entity=mon.0 client_cookie=6226fbe3d22be72f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.023+0000 7fd024b99700 1 -- 172.21.15.115:0/2891313320 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00dc40 con 0x7fd020062320 2023-07-27T14:30:16.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.023+0000 7fd024b99700 1 -- 172.21.15.115:0/2891313320 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c00dda0 con 0x7fd020062320 2023-07-27T14:30:16.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.023+0000 7fd024b99700 1 -- 172.21.15.115:0/2891313320 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c015600 con 0x7fd020062320 2023-07-27T14:30:16.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.023+0000 7fd027dff700 1 -- 172.21.15.115:0/2891313320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062320 msgr2=0x7fd0200c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.023+0000 7fd027dff700 1 --2- 172.21.15.115:0/2891313320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062320 0x7fd0200c1710 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fd0200a5650 tx=0x7fd01c00b370).stop 2023-07-27T14:30:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.024+0000 7fd027dff700 1 -- 172.21.15.115:0/2891313320 shutdown_connections 2023-07-27T14:30:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.024+0000 7fd027dff700 1 --2- 172.21.15.115:0/2891313320 >> v2:172.21.15.159:3300/0 conn(0x7fd020062e10 0x7fd020065520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.024+0000 7fd027dff700 1 --2- 172.21.15.115:0/2891313320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062320 0x7fd0200c1710 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.024+0000 7fd027dff700 1 -- 172.21.15.115:0/2891313320 >> 172.21.15.115:0/2891313320 conn(0x7fd0200c7b90 msgr2=0x7fd0200c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.024+0000 7fd027dff700 1 -- 172.21.15.115:0/2891313320 shutdown_connections 2023-07-27T14:30:16.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.024+0000 7fd027dff700 1 -- 172.21.15.115:0/2891313320 wait complete. 2023-07-27T14:30:16.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.026+0000 7fd027dff700 1 Processor -- start 2023-07-27T14:30:16.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.026+0000 7fd027dff700 1 -- start start 2023-07-27T14:30:16.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd027dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd020062320 0x7fd020143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd027dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062e10 0x7fd0200aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd027dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0200c4c70 0x7fd0200ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd027dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200a80a0 con 0x7fd020062e10 2023-07-27T14:30:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd027dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200a8700 con 0x7fd0200c4c70 2023-07-27T14:30:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd027dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd020144120 con 0x7fd020062320 2023-07-27T14:30:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd02539a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062e10 0x7fd0200aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd02539a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062e10 0x7fd0200aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59534/0 (socket says 172.21.15.115:59534) 2023-07-27T14:30:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.027+0000 7fd02539a700 1 -- 172.21.15.115:0/3568548362 learned_addr learned my addr 172.21.15.115:0/3568548362 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd02639c700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0200c4c70 0x7fd0200ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd025b9b700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd020062320 0x7fd020143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd02539a700 1 -- 172.21.15.115:0/3568548362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd020062320 msgr2=0x7fd020143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd02539a700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd020062320 0x7fd020143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd02539a700 1 -- 172.21.15.115:0/3568548362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0200c4c70 msgr2=0x7fd0200ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd02539a700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0200c4c70 0x7fd0200ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd02539a700 1 -- 172.21.15.115:0/3568548362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c00b6a0 con 0x7fd020062e10 2023-07-27T14:30:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd02539a700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062e10 0x7fd0200aaab0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fd01000c4c0 tx=0x7fd010007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd015ffb700 1 -- 172.21.15.115:0/3568548362 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010007020 con 0x7fd020062e10 2023-07-27T14:30:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd015ffb700 1 -- 172.21.15.115:0/3568548362 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd010001e90 con 0x7fd020062e10 2023-07-27T14:30:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0200a7ae0 con 0x7fd020062e10 2023-07-27T14:30:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.028+0000 7fd015ffb700 1 -- 172.21.15.115:0/3568548362 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100073b0 con 0x7fd020062e10 2023-07-27T14:30:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.029+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0200a8390 con 0x7fd020062e10 2023-07-27T14:30:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.029+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0200a8870 con 0x7fd020062e10 2023-07-27T14:30:16.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.030+0000 7fd015ffb700 1 -- 172.21.15.115:0/3568548362 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fd010010070 con 0x7fd020062e10 2023-07-27T14:30:16.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.031+0000 7fd015ffb700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd00405f060 0x7fd004061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.031+0000 7fd015ffb700 1 -- 172.21.15.115:0/3568548362 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fd010079850 con 0x7fd020062e10 2023-07-27T14:30:16.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.031+0000 7fd025b9b700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd00405f060 0x7fd004061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.032+0000 7fd025b9b700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd00405f060 0x7fd004061520 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd0200a5650 tx=0x7fd01c01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.036+0000 7fd015ffb700 1 -- 172.21.15.115:0/3568548362 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd01004aa70 con 0x7fd020062e10 2023-07-27T14:30:16.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.245+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd02006c470 con 0x7fd020062e10 2023-07-27T14:30:16.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.254+0000 7fd015ffb700 1 -- 172.21.15.115:0/3568548362 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v30) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd01004e090 con 0x7fd020062e10 2023-07-27T14:30:16.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.260+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd00405f060 msgr2=0x7fd004061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.260+0000 7fd027dff700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd00405f060 0x7fd004061520 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd0200a5650 tx=0x7fd01c01a000).stop 2023-07-27T14:30:16.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.260+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062e10 msgr2=0x7fd0200aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.260+0000 7fd027dff700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062e10 0x7fd0200aaab0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fd01000c4c0 tx=0x7fd010007e00).stop 2023-07-27T14:30:16.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.263+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 shutdown_connections 2023-07-27T14:30:16.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.263+0000 7fd027dff700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd00405f060 0x7fd004061520 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.263+0000 7fd027dff700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0200c4c70 0x7fd0200ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.263+0000 7fd027dff700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd020062320 0x7fd020143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.263+0000 7fd027dff700 1 --2- 172.21.15.115:0/3568548362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd020062e10 0x7fd0200aaab0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.263+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 >> 172.21.15.115:0/3568548362 conn(0x7fd0200c7b90 msgr2=0x7fd0200bc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:16.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.266+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 shutdown_connections 2023-07-27T14:30:16.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.266+0000 7fd027dff700 1 -- 172.21.15.115:0/3568548362 wait complete. 2023-07-27T14:30:16.302 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 9 and data pool 10 2023-07-27T14:30:16.322 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:30:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.484+0000 7fc737fff700 1 Processor -- start 2023-07-27T14:30:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.484+0000 7fc737fff700 1 -- start start 2023-07-27T14:30:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.485+0000 7fc737fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc730153ec0 0x7fc7300a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.485+0000 7fc737fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7300aa050 0x7fc7300640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.485+0000 7fc737fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300aa4d0 con 0x7fc7300aaa40 2023-07-27T14:30:16.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.485+0000 7fc737fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300c05c0 con 0x7fc7300aa050 2023-07-27T14:30:16.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.485+0000 7fc737fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300c1a60 con 0x7fc730153ec0 2023-07-27T14:30:16.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.485+0000 7fc73559a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7300aa050 0x7fc7300640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.485+0000 7fc73559a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7300aa050 0x7fc7300640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59550/0 (socket says 172.21.15.115:59550) 2023-07-27T14:30:16.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.485+0000 7fc73559a700 1 -- 172.21.15.115:0/1194341450 learned_addr learned my addr 172.21.15.115:0/1194341450 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:16.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc735d9b700 1 --2- 172.21.15.115:0/1194341450 >> v2:172.21.15.159:3300/0 conn(0x7fc730153ec0 0x7fc7300a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc73559a700 1 -- 172.21.15.115:0/1194341450 >> v2:172.21.15.159:3300/0 conn(0x7fc730153ec0 msgr2=0x7fc7300a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:16.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc73559a700 1 --2- 172.21.15.115:0/1194341450 >> v2:172.21.15.159:3300/0 conn(0x7fc730153ec0 0x7fc7300a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc73559a700 1 -- 172.21.15.115:0/1194341450 >> v1:172.21.15.159:6789/0 conn(0x7fc7300aaa40 legacy=0x7fc730157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc73559a700 1 -- 172.21.15.115:0/1194341450 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300bfc90 con 0x7fc7300aa050 2023-07-27T14:30:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc73559a700 1 --2- 172.21.15.115:0/1194341450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aa050 0x7fc7300640f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fc730083e30 tx=0x7fc7200090f0).ready entity=mon.0 client_cookie=86d2336b0914f3c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc734d99700 1 -- 172.21.15.115:0/1194341450 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000b600 con 0x7fc7300aa050 2023-07-27T14:30:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc734d99700 1 -- 172.21.15.115:0/1194341450 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000b760 con 0x7fc7300aa050 2023-07-27T14:30:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.486+0000 7fc734d99700 1 -- 172.21.15.115:0/1194341450 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000bae0 con 0x7fc7300aa050 2023-07-27T14:30:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.487+0000 7fc737fff700 1 -- 172.21.15.115:0/1194341450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aa050 msgr2=0x7fc7300640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.487+0000 7fc737fff700 1 --2- 172.21.15.115:0/1194341450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aa050 0x7fc7300640f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fc730083e30 tx=0x7fc7200090f0).stop 2023-07-27T14:30:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.487+0000 7fc737fff700 1 -- 172.21.15.115:0/1194341450 shutdown_connections 2023-07-27T14:30:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.487+0000 7fc737fff700 1 --2- 172.21.15.115:0/1194341450 >> v2:172.21.15.159:3300/0 conn(0x7fc730153ec0 0x7fc7300a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.487+0000 7fc737fff700 1 --2- 172.21.15.115:0/1194341450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aa050 0x7fc7300640f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.487+0000 7fc737fff700 1 -- 172.21.15.115:0/1194341450 >> 172.21.15.115:0/1194341450 conn(0x7fc7300cb610 msgr2=0x7fc7300c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.487+0000 7fc737fff700 1 -- 172.21.15.115:0/1194341450 shutdown_connections 2023-07-27T14:30:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.487+0000 7fc737fff700 1 -- 172.21.15.115:0/1194341450 wait complete. 2023-07-27T14:30:16.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.488+0000 7fc737fff700 1 Processor -- start 2023-07-27T14:30:16.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.489+0000 7fc737fff700 1 -- start start 2023-07-27T14:30:16.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.489+0000 7fc737fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7300aa050 0x7fc7300c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc737fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aaa40 0x7fc73014c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc737fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730153ec0 0x7fc730152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc737fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300c4060 con 0x7fc7300aaa40 2023-07-27T14:30:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc737fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300c3450 con 0x7fc730153ec0 2023-07-27T14:30:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc737fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300c3730 con 0x7fc7300aa050 2023-07-27T14:30:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aaa40 0x7fc73014c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aaa40 0x7fc73014c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59554/0 (socket says 172.21.15.115:59554) 2023-07-27T14:30:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 -- 172.21.15.115:0/821472295 learned_addr learned my addr 172.21.15.115:0/821472295 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc735d9b700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7300aa050 0x7fc7300c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73659c700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730153ec0 0x7fc730152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 -- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7300aa050 msgr2=0x7fc7300c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7300aa050 0x7fc7300c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 -- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730153ec0 msgr2=0x7fc730152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730153ec0 0x7fc730152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 -- 172.21.15.115:0/821472295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc720009370 con 0x7fc7300aaa40 2023-07-27T14:30:16.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73659c700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730153ec0 0x7fc730152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:16.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.490+0000 7fc73559a700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aaa40 0x7fc73014c8b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fc730060760 tx=0x7fc720017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.491+0000 7fc725ffb700 1 -- 172.21.15.115:0/821472295 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000b8d0 con 0x7fc7300aaa40 2023-07-27T14:30:16.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.491+0000 7fc725ffb700 1 -- 172.21.15.115:0/821472295 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000ba30 con 0x7fc7300aaa40 2023-07-27T14:30:16.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.491+0000 7fc725ffb700 1 -- 172.21.15.115:0/821472295 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72001c630 con 0x7fc7300aaa40 2023-07-27T14:30:16.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.491+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7300c3a10 con 0x7fc7300aaa40 2023-07-27T14:30:16.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.491+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7300c49e0 con 0x7fc7300aaa40 2023-07-27T14:30:16.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.492+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7300c41d0 con 0x7fc7300aaa40 2023-07-27T14:30:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.492+0000 7fc725ffb700 1 -- 172.21.15.115:0/821472295 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fc72000f070 con 0x7fc7300aaa40 2023-07-27T14:30:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.493+0000 7fc725ffb700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc71405f060 0x7fc714061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.493+0000 7fc725ffb700 1 -- 172.21.15.115:0/821472295 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc72007b700 con 0x7fc7300aaa40 2023-07-27T14:30:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.493+0000 7fc735d9b700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc71405f060 0x7fc714061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.494+0000 7fc735d9b700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc71405f060 0x7fc714061520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fc72c006fd0 tx=0x7fc72c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.498+0000 7fc725ffb700 1 -- 172.21.15.115:0/821472295 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc72004c8c0 con 0x7fc7300aaa40 2023-07-27T14:30:16.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.669+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc73006c470 con 0x7fc7300aaa40 2023-07-27T14:30:16.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.670+0000 7fc725ffb700 1 -- 172.21.15.115:0/821472295 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17087 (secure 0 0 0) 0x7fc72004fee0 con 0x7fc7300aaa40 2023-07-27T14:30:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:16.699 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":67,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:30:16.247153+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:30:14.561612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-27T14:30:15.229143+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:30:16.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.672+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc71405f060 msgr2=0x7fc714061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.672+0000 7fc737fff700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc71405f060 0x7fc714061520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fc72c006fd0 tx=0x7fc72c008040).stop 2023-07-27T14:30:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.672+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aaa40 msgr2=0x7fc73014c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.672+0000 7fc737fff700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aaa40 0x7fc73014c8b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fc730060760 tx=0x7fc720017000).stop 2023-07-27T14:30:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.673+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 shutdown_connections 2023-07-27T14:30:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.673+0000 7fc737fff700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc71405f060 0x7fc714061520 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.673+0000 7fc737fff700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730153ec0 0x7fc730152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.673+0000 7fc737fff700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7300aa050 0x7fc7300c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.673+0000 7fc737fff700 1 --2- 172.21.15.115:0/821472295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7300aaa40 0x7fc73014c8b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.673+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 >> 172.21.15.115:0/821472295 conn(0x7fc7300cb610 msgr2=0x7fc7300acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:16.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.673+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 shutdown_connections 2023-07-27T14:30:16.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.673+0000 7fc737fff700 1 -- 172.21.15.115:0/821472295 wait complete. 2023-07-27T14:30:16.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:30:16.794 INFO:tasks.ceph.mds.a.smithi115.stderr:2023-07-27T14:30:16.766+0000 7fea845f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:30:16.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.881+0000 7fe1201ff700 1 Processor -- start 2023-07-27T14:30:16.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.881+0000 7fe1201ff700 1 -- start start 2023-07-27T14:30:16.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.882+0000 7fe1201ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe118153ec0 0x7fe1180a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.883+0000 7fe1201ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aaa40 0x7fe1180c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.883+0000 7fe1201ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1180aa4d0 con 0x7fe1180aa050 2023-07-27T14:30:16.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.883+0000 7fe1201ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1180c05c0 con 0x7fe118153ec0 2023-07-27T14:30:16.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.883+0000 7fe1201ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180bfc90 con 0x7fe1180aaa40 2023-07-27T14:30:16.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.883+0000 7fe11df9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe118153ec0 0x7fe1180a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.883+0000 7fe11e79c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aaa40 0x7fe1180c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.883+0000 7fe11d79a700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fe1180aa050 0x7fe1180640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:40182/0 (socket says 172.21.15.115:40182) 2023-07-27T14:30:16.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.883+0000 7fe11d79a700 1 -- 172.21.15.115:0/1049317730 learned_addr learned my addr 172.21.15.115:0/1049317730 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:16.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11df9b700 1 -- 172.21.15.115:0/1049317730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aaa40 msgr2=0x7fe1180c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:16.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11df9b700 1 --2- 172.21.15.115:0/1049317730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aaa40 0x7fe1180c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11df9b700 1 -- 172.21.15.115:0/1049317730 >> v1:172.21.15.159:6789/0 conn(0x7fe1180aa050 legacy=0x7fe1180640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11df9b700 1 -- 172.21.15.115:0/1049317730 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180bff70 con 0x7fe118153ec0 2023-07-27T14:30:16.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11e79c700 1 --2- 172.21.15.115:0/1049317730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aaa40 0x7fe1180c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:16.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11df9b700 1 --2- 172.21.15.115:0/1049317730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe118153ec0 0x7fe1180a9b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fe114009760 tx=0x7fe114009060).ready entity=mon.1 client_cookie=d5a39aea799432ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11cf99700 1 -- 172.21.15.115:0/1049317730 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400f510 con 0x7fe118153ec0 2023-07-27T14:30:16.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11cf99700 1 -- 172.21.15.115:0/1049317730 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11400f670 con 0x7fe118153ec0 2023-07-27T14:30:16.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.884+0000 7fe11cf99700 1 -- 172.21.15.115:0/1049317730 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400f9f0 con 0x7fe118153ec0 2023-07-27T14:30:16.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.885+0000 7fe1201ff700 1 -- 172.21.15.115:0/1049317730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe118153ec0 msgr2=0x7fe1180a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.885+0000 7fe1201ff700 1 --2- 172.21.15.115:0/1049317730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe118153ec0 0x7fe1180a9b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fe114009760 tx=0x7fe114009060).stop 2023-07-27T14:30:16.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.885+0000 7fe1201ff700 1 -- 172.21.15.115:0/1049317730 shutdown_connections 2023-07-27T14:30:16.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.885+0000 7fe1201ff700 1 --2- 172.21.15.115:0/1049317730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aaa40 0x7fe1180c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.885+0000 7fe1201ff700 1 --2- 172.21.15.115:0/1049317730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe118153ec0 0x7fe1180a9b60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.885+0000 7fe1201ff700 1 -- 172.21.15.115:0/1049317730 >> 172.21.15.115:0/1049317730 conn(0x7fe1180cb610 msgr2=0x7fe1180c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:16.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.885+0000 7fe1201ff700 1 -- 172.21.15.115:0/1049317730 shutdown_connections 2023-07-27T14:30:16.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.885+0000 7fe1201ff700 1 -- 172.21.15.115:0/1049317730 wait complete. 2023-07-27T14:30:16.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.886+0000 7fe1201ff700 1 Processor -- start 2023-07-27T14:30:16.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.886+0000 7fe1201ff700 1 -- start start 2023-07-27T14:30:16.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.887+0000 7fe1201ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aa050 0x7fe118168090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.887+0000 7fe1201ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1180aaa40 0x7fe11814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.887+0000 7fe1201ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe118153ec0 0x7fe1180c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.887+0000 7fe1201ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1181640e0 con 0x7fe118153ec0 2023-07-27T14:30:16.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.887+0000 7fe1201ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe118164940 con 0x7fe1180aaa40 2023-07-27T14:30:16.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.887+0000 7fe1201ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11815b0c0 con 0x7fe1180aa050 2023-07-27T14:30:16.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe118153ec0 0x7fe1180c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe118153ec0 0x7fe1180c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59558/0 (socket says 172.21.15.115:59558) 2023-07-27T14:30:16.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 -- 172.21.15.115:0/4188452625 learned_addr learned my addr 172.21.15.115:0/4188452625 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:16.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11df9b700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aa050 0x7fe118168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11d79a700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1180aaa40 0x7fe11814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 -- 172.21.15.115:0/4188452625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aa050 msgr2=0x7fe118168090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aa050 0x7fe118168090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 -- 172.21.15.115:0/4188452625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1180aaa40 msgr2=0x7fe11814c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1180aaa40 0x7fe11814c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 -- 172.21.15.115:0/4188452625 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009a20 con 0x7fe118153ec0 2023-07-27T14:30:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.888+0000 7fe11e79c700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe118153ec0 0x7fe1180c9410 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fe110009f60 tx=0x7fe11000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.889+0000 7fe10dffb700 1 -- 172.21.15.115:0/4188452625 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000cb70 con 0x7fe118153ec0 2023-07-27T14:30:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.889+0000 7fe10dffb700 1 -- 172.21.15.115:0/4188452625 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11000f040 con 0x7fe118153ec0 2023-07-27T14:30:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.889+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1140092a0 con 0x7fe118153ec0 2023-07-27T14:30:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.889+0000 7fe10dffb700 1 -- 172.21.15.115:0/4188452625 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110013400 con 0x7fe118153ec0 2023-07-27T14:30:16.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.889+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1181645d0 con 0x7fe118153ec0 2023-07-27T14:30:16.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.890+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1181685e0 con 0x7fe118153ec0 2023-07-27T14:30:16.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.891+0000 7fe10dffb700 1 -- 172.21.15.115:0/4188452625 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fe1100137b0 con 0x7fe118153ec0 2023-07-27T14:30:16.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.891+0000 7fe10dffb700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe0fc05f030 0x7fe0fc0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:16.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.891+0000 7fe10dffb700 1 -- 172.21.15.115:0/4188452625 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe11007a8e0 con 0x7fe118153ec0 2023-07-27T14:30:16.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.892+0000 7fe11df9b700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe0fc05f030 0x7fe0fc0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:16.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.892+0000 7fe11df9b700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe0fc05f030 0x7fe0fc0614f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fe114009fd0 tx=0x7fe114017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:16.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:16.896+0000 7fe10dffb700 1 -- 172.21.15.115:0/4188452625 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe11004bbd0 con 0x7fe118153ec0 2023-07-27T14:30:17.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.066+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1180c0250 con 0x7fe118153ec0 2023-07-27T14:30:17.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.067+0000 7fe10dffb700 1 -- 172.21.15.115:0/4188452625 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17087 (secure 0 0 0) 0x7fe11004f1f0 con 0x7fe118153ec0 2023-07-27T14:30:17.095 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:17.096 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":67,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:30:16.247153+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:30:14.561612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-27T14:30:15.229143+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:30:17.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe0fc05f030 msgr2=0x7fe0fc0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:17.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe0fc05f030 0x7fe0fc0614f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fe114009fd0 tx=0x7fe114017000).stop 2023-07-27T14:30:17.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe118153ec0 msgr2=0x7fe1180c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:17.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe118153ec0 0x7fe1180c9410 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fe110009f60 tx=0x7fe11000b040).stop 2023-07-27T14:30:17.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 shutdown_connections 2023-07-27T14:30:17.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe0fc05f030 0x7fe0fc0614f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe118153ec0 0x7fe1180c9410 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1180aa050 0x7fe118168090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 --2- 172.21.15.115:0/4188452625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1180aaa40 0x7fe11814c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 >> 172.21.15.115:0/4188452625 conn(0x7fe1180cb610 msgr2=0x7fe1180c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 shutdown_connections 2023-07-27T14:30:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.069+0000 7fe1201ff700 1 -- 172.21.15.115:0/4188452625 wait complete. 2023-07-27T14:30:17.115 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:30:17.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.278+0000 7f7d20dff700 1 Processor -- start 2023-07-27T14:30:17.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.278+0000 7f7d20dff700 1 -- start start 2023-07-27T14:30:17.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.279+0000 7f7d20dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d1c0bc350 0x7f7d1c0657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:17.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.279+0000 7f7d20dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c065360 con 0x7f7d1c153ed0 2023-07-27T14:30:17.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.279+0000 7f7d20dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c0bcbd0 con 0x7f7d1c1542b0 2023-07-27T14:30:17.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.279+0000 7f7d20dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c154740 con 0x7f7d1c0bc350 2023-07-27T14:30:17.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.279+0000 7f7d1a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7d1c153ed0 0x7f7d1c0c2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33250/0 (socket says 172.21.15.115:33250) 2023-07-27T14:30:17.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.279+0000 7f7d1a59c700 1 -- 172.21.15.115:0/94798288 learned_addr learned my addr 172.21.15.115:0/94798288 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:17.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d19d9b700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d1c0bc350 0x7f7d1c0657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:17.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292191152 0 0) 0x7f7d1c065360 con 0x7f7d1c153ed0 2023-07-27T14:30:17.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d040033f0 con 0x7f7d1c153ed0 2023-07-27T14:30:17.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2949571754 0 0) 0x7f7d040033f0 con 0x7f7d1c153ed0 2023-07-27T14:30:17.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d1c0bc350 msgr2=0x7f7d1c0657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:17.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d1c0bc350 0x7f7d1c0657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 >> v1:172.21.15.159:6789/0 conn(0x7f7d1c1542b0 legacy=0x7f7d1c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:17.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c064d30 con 0x7f7d1c153ed0 2023-07-27T14:30:17.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f7d0c001470 con 0x7f7d1c153ed0 2023-07-27T14:30:17.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 >> v1:172.21.15.115:6789/0 conn(0x7f7d1c153ed0 legacy=0x7f7d1c0c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:17.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d04003910 0x7f7d04003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:17.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d04004690 0x7f7d04004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:17.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d1c0bc350 0x7f7d04005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:17.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c154740 con 0x7f7d04003910 2023-07-27T14:30:17.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0400b8e0 con 0x7f7d04004690 2023-07-27T14:30:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.280+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0400ba50 con 0x7f7d1c0bc350 2023-07-27T14:30:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1a59c700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d04003910 0x7f7d04003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1ad9d700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d1c0bc350 0x7f7d04005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d19d9b700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d04004690 0x7f7d04004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1a59c700 1 -- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d1c0bc350 msgr2=0x7f7d04005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1a59c700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d1c0bc350 0x7f7d04005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1a59c700 1 -- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d04004690 msgr2=0x7f7d04004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:17.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1a59c700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d04004690 0x7f7d04004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1a59c700 1 -- 172.21.15.115:0/94798288 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d040033f0 con 0x7f7d04003910 2023-07-27T14:30:17.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1a59c700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d04003910 0x7f7d04003cf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f7d0c00c190 tx=0x7f7d0c001e70).ready entity=mon.0 client_cookie=ee5ef7c380406fa8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:17.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c007a40 con 0x7f7d04003910 2023-07-27T14:30:17.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c00ca60 con 0x7f7d04003910 2023-07-27T14:30:17.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.281+0000 7f7d1959a700 1 -- 172.21.15.115:0/94798288 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00ce00 con 0x7f7d04003910 2023-07-27T14:30:17.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.282+0000 7f7d20dff700 1 -- 172.21.15.115:0/94798288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d04003910 msgr2=0x7f7d04003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:17.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.282+0000 7f7d20dff700 1 --2- 172.21.15.115:0/94798288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d04003910 0x7f7d04003cf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f7d0c00c190 tx=0x7f7d0c001e70).stop 2023-07-27T14:30:17.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.282+0000 7f7d1ad9d700 1 -- 172.21.15.115:0/94798288 reap_dead start 2023-07-27T14:30:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.282+0000 7f7d20dff700 1 -- 172.21.15.115:0/94798288 shutdown_connections 2023-07-27T14:30:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.282+0000 7f7d20dff700 1 -- 172.21.15.115:0/94798288 >> 172.21.15.115:0/94798288 conn(0x7f7d1c062df0 msgr2=0x7f7d1c0c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.282+0000 7f7d20dff700 1 -- 172.21.15.115:0/94798288 shutdown_connections 2023-07-27T14:30:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.282+0000 7f7d20dff700 1 -- 172.21.15.115:0/94798288 wait complete. 2023-07-27T14:30:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.283+0000 7f7d20dff700 1 Processor -- start 2023-07-27T14:30:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.284+0000 7f7d20dff700 1 -- start start 2023-07-27T14:30:17.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.284+0000 7f7d20dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d04003910 0x7f7d1c151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:17.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.284+0000 7f7d20dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d1c0aa930 0x7f7d1c0bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:17.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.284+0000 7f7d20dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d1c0c0370 0x7f7d1c0c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:17.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.284+0000 7f7d20dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0bfee0 con 0x7f7d1c0c0370 2023-07-27T14:30:17.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.284+0000 7f7d20dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c152380 con 0x7f7d1c0aa930 2023-07-27T14:30:17.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d20dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0aaea0 con 0x7f7d04003910 2023-07-27T14:30:17.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d1c0c0370 0x7f7d1c0c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:17.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d1c0c0370 0x7f7d1c0c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59582/0 (socket says 172.21.15.115:59582) 2023-07-27T14:30:17.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 -- 172.21.15.115:0/2940555899 learned_addr learned my addr 172.21.15.115:0/2940555899 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d19d9b700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d1c0aa930 0x7f7d1c0bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1a59c700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d04003910 0x7f7d1c151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 -- 172.21.15.115:0/2940555899 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d04003910 msgr2=0x7f7d1c151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d04003910 0x7f7d1c151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 -- 172.21.15.115:0/2940555899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d1c0aa930 msgr2=0x7f7d1c0bf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d1c0aa930 0x7f7d1c0bf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 -- 172.21.15.115:0/2940555899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0ab180 con 0x7f7d1c0c0370 2023-07-27T14:30:17.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d1ad9d700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d1c0c0370 0x7f7d1c0c5740 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f7d1c0a98d0 tx=0x7f7d14007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.285+0000 7f7d0a7fc700 1 -- 172.21.15.115:0/2940555899 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14001820 con 0x7f7d1c0c0370 2023-07-27T14:30:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.286+0000 7f7d0a7fc700 1 -- 172.21.15.115:0/2940555899 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d14001980 con 0x7f7d1c0c0370 2023-07-27T14:30:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.286+0000 7f7d0a7fc700 1 -- 172.21.15.115:0/2940555899 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14001d20 con 0x7f7d1c0c0370 2023-07-27T14:30:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.286+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c0ab460 con 0x7f7d1c0c0370 2023-07-27T14:30:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.286+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c0bf6d0 con 0x7f7d1c0c0370 2023-07-27T14:30:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.287+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c0bfd30 con 0x7f7d1c0c0370 2023-07-27T14:30:17.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.287+0000 7f7d0a7fc700 1 -- 172.21.15.115:0/2940555899 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f7d1401b030 con 0x7f7d1c0c0370 2023-07-27T14:30:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.288+0000 7f7d0a7fc700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cfc05f060 0x7f7cfc061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.288+0000 7f7d0a7fc700 1 -- 172.21.15.115:0/2940555899 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7d140796e0 con 0x7f7d1c0c0370 2023-07-27T14:30:17.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.288+0000 7f7d1a59c700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cfc05f060 0x7f7cfc061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.289+0000 7f7d1a59c700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cfc05f060 0x7f7cfc061520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7d0c001ed0 tx=0x7f7d0c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:17.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.292+0000 7f7d0a7fc700 1 -- 172.21.15.115:0/2940555899 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7d1404a8a0 con 0x7f7d1c0c0370 2023-07-27T14:30:17.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:17.505+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7d1c06c470 con 0x7f7d1c0c0370 2023-07-27T14:30:18.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.256+0000 7f7d0a7fc700 1 -- 172.21.15.115:0/2940555899 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7d1404dec0 con 0x7f7d1c0c0370 2023-07-27T14:30:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cfc05f060 msgr2=0x7f7cfc061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cfc05f060 0x7f7cfc061520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7d0c001ed0 tx=0x7f7d0c015000).stop 2023-07-27T14:30:18.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d1c0c0370 msgr2=0x7f7d1c0c5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:18.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d1c0c0370 0x7f7d1c0c5740 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f7d1c0a98d0 tx=0x7f7d14007f10).stop 2023-07-27T14:30:18.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 shutdown_connections 2023-07-27T14:30:18.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cfc05f060 0x7f7cfc061520 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d1c0c0370 0x7f7d1c0c5740 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d04003910 0x7f7d1c151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 --2- 172.21.15.115:0/2940555899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d1c0aa930 0x7f7d1c0bf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 >> 172.21.15.115:0/2940555899 conn(0x7f7d1c062df0 msgr2=0x7f7d1c1536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:18.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 shutdown_connections 2023-07-27T14:30:18.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.259+0000 7f7d20dff700 1 -- 172.21.15.115:0/2940555899 wait complete. 2023-07-27T14:30:18.307 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:30:18.308 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:30:18.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.474+0000 7fd8ba5ff700 1 Processor -- start 2023-07-27T14:30:18.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.474+0000 7fd8ba5ff700 1 -- start start 2023-07-27T14:30:18.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8ba5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:18.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8ba5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8b4063260 0x7fd8b40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:18.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8ba5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b41553f0 con 0x7fd8b414b1e0 2023-07-27T14:30:18.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8ba5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b4157a50 con 0x7fd8b4063260 2023-07-27T14:30:18.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8ba5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4157d10 con 0x7fd8b414ae00 2023-07-27T14:30:18.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8b8b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8b4063260 0x7fd8b40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:18.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8b8b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8b4063260 0x7fd8b40a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59592/0 (socket says 172.21.15.115:59592) 2023-07-27T14:30:18.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8b8b9c700 1 -- 172.21.15.115:0/2023605957 learned_addr learned my addr 172.21.15.115:0/2023605957 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:18.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.475+0000 7fd8b3fff700 1 --2- 172.21.15.115:0/2023605957 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:18.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.476+0000 7fd8b8b9c700 1 -- 172.21.15.115:0/2023605957 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 msgr2=0x7fd8b4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:18.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.476+0000 7fd8b8b9c700 1 --2- 172.21.15.115:0/2023605957 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.476+0000 7fd8b8b9c700 1 -- 172.21.15.115:0/2023605957 >> v1:172.21.15.159:6789/0 conn(0x7fd8b414b1e0 legacy=0x7fd8b4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:18.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.476+0000 7fd8b8b9c700 1 -- 172.21.15.115:0/2023605957 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4157ff0 con 0x7fd8b4063260 2023-07-27T14:30:18.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.476+0000 7fd8b8b9c700 1 --2- 172.21.15.115:0/2023605957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b40a98c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fd8ac009f20 tx=0x7fd8ac009840).ready entity=mon.0 client_cookie=1181366c2e3352d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:18.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.476+0000 7fd8b2ffd700 1 -- 172.21.15.115:0/2023605957 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00e070 con 0x7fd8b4063260 2023-07-27T14:30:18.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.476+0000 7fd8b2ffd700 1 -- 172.21.15.115:0/2023605957 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00b9d0 con 0x7fd8b4063260 2023-07-27T14:30:18.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.476+0000 7fd8b2ffd700 1 -- 172.21.15.115:0/2023605957 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00bd50 con 0x7fd8b4063260 2023-07-27T14:30:18.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.477+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/2023605957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 msgr2=0x7fd8b40a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:18.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.477+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/2023605957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b40a98c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fd8ac009f20 tx=0x7fd8ac009840).stop 2023-07-27T14:30:18.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.477+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/2023605957 shutdown_connections 2023-07-27T14:30:18.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.477+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/2023605957 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.477+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/2023605957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b40a98c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.477+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/2023605957 >> 172.21.15.115:0/2023605957 conn(0x7fd8b405e940 msgr2=0x7fd8b40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:18.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.477+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/2023605957 shutdown_connections 2023-07-27T14:30:18.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.477+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/2023605957 wait complete. 2023-07-27T14:30:18.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.479+0000 7fd8ba5ff700 1 Processor -- start 2023-07-27T14:30:18.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.479+0000 7fd8ba5ff700 1 -- start start 2023-07-27T14:30:18.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.480+0000 7fd8ba5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b4149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:18.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.480+0000 7fd8ba5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b40c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:18.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.480+0000 7fd8ba5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b414b1e0 0x7fd8b40c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:18.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.480+0000 7fd8ba5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40ae8c0 con 0x7fd8b4063260 2023-07-27T14:30:18.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.480+0000 7fd8ba5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40c3a50 con 0x7fd8b414b1e0 2023-07-27T14:30:18.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.480+0000 7fd8ba5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40c3d30 con 0x7fd8b414ae00 2023-07-27T14:30:18.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b4149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:18.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b4149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59594/0 (socket says 172.21.15.115:59594) 2023-07-27T14:30:18.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 -- 172.21.15.115:0/3438425460 learned_addr learned my addr 172.21.15.115:0/3438425460 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:18.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b8b9c700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b414b1e0 0x7fd8b40c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:18.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b37fe700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b40c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:18.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 -- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 msgr2=0x7fd8b40c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:18.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b40c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 -- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b414b1e0 msgr2=0x7fd8b40c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:18.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b414b1e0 0x7fd8b40c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:18.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 -- 172.21.15.115:0/3438425460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac009ae0 con 0x7fd8b4063260 2023-07-27T14:30:18.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b8b9c700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b414b1e0 0x7fd8b40c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:18.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b37fe700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b40c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:18.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd8b3fff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b4149720 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fd8a400e930 tx=0x7fd8a4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:18.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.481+0000 7fd89bfff700 1 -- 172.21.15.115:0/3438425460 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400eed0 con 0x7fd8b4063260 2023-07-27T14:30:18.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.482+0000 7fd89bfff700 1 -- 172.21.15.115:0/3438425460 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a400c850 con 0x7fd8b4063260 2023-07-27T14:30:18.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.482+0000 7fd89bfff700 1 -- 172.21.15.115:0/3438425460 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400cbd0 con 0x7fd8b4063260 2023-07-27T14:30:18.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.482+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b40c4010 con 0x7fd8b4063260 2023-07-27T14:30:18.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.482+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b4149c10 con 0x7fd8b4063260 2023-07-27T14:30:18.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.483+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b40aebf0 con 0x7fd8b4063260 2023-07-27T14:30:18.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.483+0000 7fd89bfff700 1 -- 172.21.15.115:0/3438425460 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fd8a4022070 con 0x7fd8b4063260 2023-07-27T14:30:18.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.484+0000 7fd89bfff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd8a005f060 0x7fd8a0061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:18.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.484+0000 7fd89bfff700 1 -- 172.21.15.115:0/3438425460 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd8a407a3f0 con 0x7fd8b4063260 2023-07-27T14:30:18.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.484+0000 7fd8b37fe700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd8a005f060 0x7fd8a0061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:18.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.485+0000 7fd8b37fe700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd8a005f060 0x7fd8a0061520 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fd8b40aa110 tx=0x7fd8a8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.488+0000 7fd89bfff700 1 -- 172.21.15.115:0/3438425460 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd8a404b6c0 con 0x7fd8b4063260 2023-07-27T14:30:18.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:18.702+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd8b406c470 con 0x7fd8b4063260 2023-07-27T14:30:19.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.261+0000 7fd89bfff700 1 -- 172.21.15.115:0/3438425460 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd8a404ece0 con 0x7fd8b4063260 2023-07-27T14:30:19.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd8a005f060 msgr2=0x7fd8a0061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd8a005f060 0x7fd8a0061520 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fd8b40aa110 tx=0x7fd8a8009040).stop 2023-07-27T14:30:19.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 msgr2=0x7fd8b4149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b4149720 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fd8a400e930 tx=0x7fd8a4009060).stop 2023-07-27T14:30:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 shutdown_connections 2023-07-27T14:30:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd8a005f060 0x7fd8a0061520 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8b414b1e0 0x7fd8b40c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4063260 0x7fd8b4149720 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 --2- 172.21.15.115:0/3438425460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8b414ae00 0x7fd8b40c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 >> 172.21.15.115:0/3438425460 conn(0x7fd8b405e940 msgr2=0x7fd8b414a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 shutdown_connections 2023-07-27T14:30:19.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.264+0000 7fd8ba5ff700 1 -- 172.21.15.115:0/3438425460 wait complete. 2023-07-27T14:30:19.311 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:30:19.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:30:19.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.472+0000 7fca79bff700 1 Processor -- start 2023-07-27T14:30:19.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.472+0000 7fca79bff700 1 -- start start 2023-07-27T14:30:19.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.473+0000 7fca79bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca740aaa40 0x7fca740640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.473+0000 7fca79bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca740aa4d0 con 0x7fca741542a0 2023-07-27T14:30:19.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.473+0000 7fca79bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca740c05c0 con 0x7fca74153ec0 2023-07-27T14:30:19.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.473+0000 7fca79bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca740aa270 con 0x7fca740aaa40 2023-07-27T14:30:19.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca73fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fca741542a0 0x7fca740c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33258/0 (socket says 172.21.15.115:33258) 2023-07-27T14:30:19.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca73fff700 1 -- 172.21.15.115:0/1356967060 learned_addr learned my addr 172.21.15.115:0/1356967060 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:19.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca72ffd700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca740aaa40 0x7fca740640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273236019 0 0) 0x7fca6c001490 con 0x7fca741542a0 2023-07-27T14:30:19.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca5c0033f0 con 0x7fca741542a0 2023-07-27T14:30:19.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863394672 0 0) 0x7fca740c05c0 con 0x7fca74153ec0 2023-07-27T14:30:19.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca6c001490 con 0x7fca74153ec0 2023-07-27T14:30:19.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849576737 0 0) 0x7fca5c0033f0 con 0x7fca741542a0 2023-07-27T14:30:19.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca740aaa40 msgr2=0x7fca740640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:19.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.474+0000 7fca727fc700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca740aaa40 0x7fca740640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 >> v1:172.21.15.159:6789/0 conn(0x7fca74153ec0 legacy=0x7fca740a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740bfc90 con 0x7fca741542a0 2023-07-27T14:30:19.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fca6c001980 con 0x7fca741542a0 2023-07-27T14:30:19.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 >> v1:172.21.15.115:6789/0 conn(0x7fca741542a0 legacy=0x7fca740c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca5c003aa0 0x7fca5c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca5c004690 0x7fca5c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca5c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740aa270 con 0x7fca5c005000 2023-07-27T14:30:19.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c00be80 con 0x7fca5c003aa0 2023-07-27T14:30:19.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c00c040 con 0x7fca5c004690 2023-07-27T14:30:19.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca72ffd700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca740aaa40 0x7fca740640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:19.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca73fff700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca5c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca737fe700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca5c003aa0 0x7fca5c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca72ffd700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca5c004690 0x7fca5c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca73fff700 1 -- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca5c004690 msgr2=0x7fca5c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:19.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca73fff700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca5c004690 0x7fca5c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca73fff700 1 -- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca5c003aa0 msgr2=0x7fca5c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:19.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca73fff700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca5c003aa0 0x7fca5c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca73fff700 1 -- 172.21.15.115:0/1356967060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0033f0 con 0x7fca5c005000 2023-07-27T14:30:19.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.475+0000 7fca73fff700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca5c00b8e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fca740c75e0 tx=0x7fca6c007c00).ready entity=mon.0 client_cookie=4e5c05603d5b04b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:19.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c005b20 con 0x7fca5c005000 2023-07-27T14:30:19.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c005c80 con 0x7fca5c005000 2023-07-27T14:30:19.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca727fc700 1 -- 172.21.15.115:0/1356967060 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0070d0 con 0x7fca5c005000 2023-07-27T14:30:19.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca79bff700 1 -- 172.21.15.115:0/1356967060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 msgr2=0x7fca5c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca79bff700 1 --2- 172.21.15.115:0/1356967060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca5c00b8e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fca740c75e0 tx=0x7fca6c007c00).stop 2023-07-27T14:30:19.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca73fff700 1 -- 172.21.15.115:0/1356967060 reap_dead start 2023-07-27T14:30:19.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca79bff700 1 -- 172.21.15.115:0/1356967060 shutdown_connections 2023-07-27T14:30:19.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca79bff700 1 -- 172.21.15.115:0/1356967060 >> 172.21.15.115:0/1356967060 conn(0x7fca740cb610 msgr2=0x7fca740c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:19.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca79bff700 1 -- 172.21.15.115:0/1356967060 shutdown_connections 2023-07-27T14:30:19.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.476+0000 7fca79bff700 1 -- 172.21.15.115:0/1356967060 wait complete. 2023-07-27T14:30:19.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.478+0000 7fca79bff700 1 Processor -- start 2023-07-27T14:30:19.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.478+0000 7fca79bff700 1 -- start start 2023-07-27T14:30:19.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca79bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca741590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca79bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca7413f680 0x7fca741569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca79bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7413fb00 0x7fca74156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca79bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c4a70 con 0x7fca5c005000 2023-07-27T14:30:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca79bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca741573b0 con 0x7fca7413fb00 2023-07-27T14:30:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca79bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca741595e0 con 0x7fca7413f680 2023-07-27T14:30:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca737fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca741590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca737fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca741590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59604/0 (socket says 172.21.15.115:59604) 2023-07-27T14:30:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca737fe700 1 -- 172.21.15.115:0/3195114013 learned_addr learned my addr 172.21.15.115:0/3195114013 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca73fff700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7413fb00 0x7fca74156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.479+0000 7fca72ffd700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca7413f680 0x7fca741569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca737fe700 1 -- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca7413f680 msgr2=0x7fca741569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca737fe700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca7413f680 0x7fca741569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca737fe700 1 -- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7413fb00 msgr2=0x7fca74156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca737fe700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7413fb00 0x7fca74156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca737fe700 1 -- 172.21.15.115:0/3195114013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740c1fa0 con 0x7fca5c005000 2023-07-27T14:30:19.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca72ffd700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca7413f680 0x7fca741569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:19.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca737fe700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca741590f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fca64000c00 tx=0x7fca64007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:19.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca5b7fe700 1 -- 172.21.15.115:0/3195114013 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400f8d0 con 0x7fca5c005000 2023-07-27T14:30:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca5b7fe700 1 -- 172.21.15.115:0/3195114013 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6400fa30 con 0x7fca5c005000 2023-07-27T14:30:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca740c43b0 con 0x7fca5c005000 2023-07-27T14:30:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca5b7fe700 1 -- 172.21.15.115:0/3195114013 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400fdf0 con 0x7fca5c005000 2023-07-27T14:30:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.480+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca740c1c30 con 0x7fca5c005000 2023-07-27T14:30:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.481+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca740c4210 con 0x7fca5c005000 2023-07-27T14:30:19.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.482+0000 7fca5b7fe700 1 -- 172.21.15.115:0/3195114013 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fca6401b030 con 0x7fca5c005000 2023-07-27T14:30:19.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.484+0000 7fca5b7fe700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca6005f060 0x7fca60061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.484+0000 7fca5b7fe700 1 -- 172.21.15.115:0/3195114013 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca6407a0d0 con 0x7fca5c005000 2023-07-27T14:30:19.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.484+0000 7fca72ffd700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca6005f060 0x7fca60061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.484+0000 7fca72ffd700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca6005f060 0x7fca60061520 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fca68009270 tx=0x7fca68008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:19.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.487+0000 7fca5b7fe700 1 -- 172.21.15.115:0/3195114013 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca6404b2b0 con 0x7fca5c005000 2023-07-27T14:30:19.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.701+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca740c51e0 con 0x7fca5c005000 2023-07-27T14:30:19.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.702+0000 7fca5b7fe700 1 -- 172.21.15.115:0/3195114013 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fca6404e8d0 con 0x7fca5c005000 2023-07-27T14:30:19.730 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:19.731 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1689103707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1689103707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1689103707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/2448381398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2448381398},{"type":"v1","addr":"172.21.15.159:6834","nonce":2448381398}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3512171796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3512171796},{"type":"v1","addr":"172.21.15.159:6835","nonce":3512171796}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:30:16.247520+0000","modified":"2023-07-27T14:30:19.259578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2262768820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2262768820},{"type":"v1","addr":"172.21.15.115:6836","nonce":2262768820}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-07-27T14:30:19.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca6005f060 msgr2=0x7fca60061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca6005f060 0x7fca60061520 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fca68009270 tx=0x7fca68008040).stop 2023-07-27T14:30:19.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 msgr2=0x7fca741590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca741590f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fca64000c00 tx=0x7fca64007b90).stop 2023-07-27T14:30:19.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 shutdown_connections 2023-07-27T14:30:19.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca6005f060 0x7fca60061520 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca7413fb00 0x7fca74156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5c005000 0x7fca741590f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 --2- 172.21.15.115:0/3195114013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca7413f680 0x7fca741569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 >> 172.21.15.115:0/3195114013 conn(0x7fca740cb610 msgr2=0x7fca740ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:19.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 shutdown_connections 2023-07-27T14:30:19.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.704+0000 7fca79bff700 1 -- 172.21.15.115:0/3195114013 wait complete. 2023-07-27T14:30:19.734 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 33 2023-07-27T14:30:19.750 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:30:19.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.909+0000 7f48fe39d700 1 Processor -- start 2023-07-27T14:30:19.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.909+0000 7f48fe39d700 1 -- start start 2023-07-27T14:30:19.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.910+0000 7f48fe39d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f8155050 0x7f48f80c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.910+0000 7f48fe39d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48f80c1f20 0x7f48f80bc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.910+0000 7f48fe39d700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f80a4840 con 0x7f48f80bc610 2023-07-27T14:30:19.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.910+0000 7f48fe39d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f8154830 con 0x7f48f80c1f20 2023-07-27T14:30:19.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.910+0000 7f48fe39d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8155430 con 0x7f48f8155050 2023-07-27T14:30:19.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.910+0000 7f48fcb9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48f80c1f20 0x7f48f80bc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.910+0000 7f48fcb9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48f80c1f20 0x7f48f80bc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59620/0 (socket says 172.21.15.115:59620) 2023-07-27T14:30:19.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.910+0000 7f48fcb9a700 1 -- 172.21.15.115:0/3670815582 learned_addr learned my addr 172.21.15.115:0/3670815582 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:19.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48fd39b700 1 --2- 172.21.15.115:0/3670815582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f8155050 0x7f48f80c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48fcb9a700 1 -- 172.21.15.115:0/3670815582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f8155050 msgr2=0x7f48f80c1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48fcb9a700 1 --2- 172.21.15.115:0/3670815582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f8155050 0x7f48f80c1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48fcb9a700 1 -- 172.21.15.115:0/3670815582 >> v1:172.21.15.159:6789/0 conn(0x7f48f80bc610 legacy=0x7f48f8157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48fcb9a700 1 -- 172.21.15.115:0/3670815582 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80a4b20 con 0x7f48f80c1f20 2023-07-27T14:30:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48fcb9a700 1 --2- 172.21.15.115:0/3670815582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f80c1f20 0x7f48f80bc120 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f48e8006fd0 tx=0x7f48e80090f0).ready entity=mon.0 client_cookie=b0c1ceb544cf6377 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:19.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48effff700 1 -- 172.21.15.115:0/3670815582 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e800b600 con 0x7f48f80c1f20 2023-07-27T14:30:19.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48effff700 1 -- 172.21.15.115:0/3670815582 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e800b760 con 0x7f48f80c1f20 2023-07-27T14:30:19.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.911+0000 7f48effff700 1 -- 172.21.15.115:0/3670815582 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e800bae0 con 0x7f48f80c1f20 2023-07-27T14:30:19.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.912+0000 7f48fe39d700 1 -- 172.21.15.115:0/3670815582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f80c1f20 msgr2=0x7f48f80bc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.912+0000 7f48fe39d700 1 --2- 172.21.15.115:0/3670815582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f80c1f20 0x7f48f80bc120 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f48e8006fd0 tx=0x7f48e80090f0).stop 2023-07-27T14:30:19.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.912+0000 7f48fe39d700 1 -- 172.21.15.115:0/3670815582 shutdown_connections 2023-07-27T14:30:19.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.912+0000 7f48fe39d700 1 --2- 172.21.15.115:0/3670815582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f8155050 0x7f48f80c1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.912+0000 7f48fe39d700 1 --2- 172.21.15.115:0/3670815582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f80c1f20 0x7f48f80bc120 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.912+0000 7f48fe39d700 1 -- 172.21.15.115:0/3670815582 >> 172.21.15.115:0/3670815582 conn(0x7f48f80c69e0 msgr2=0x7f48f80c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:19.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.912+0000 7f48fe39d700 1 -- 172.21.15.115:0/3670815582 shutdown_connections 2023-07-27T14:30:19.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.912+0000 7f48fe39d700 1 -- 172.21.15.115:0/3670815582 wait complete. 2023-07-27T14:30:19.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.913+0000 7f48fe39d700 1 Processor -- start 2023-07-27T14:30:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.914+0000 7f48fe39d700 1 -- start start 2023-07-27T14:30:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.914+0000 7f48fe39d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f80bc610 0x7f48f8149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.914+0000 7f48fe39d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48f80c1f20 0x7f48f80abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fe39d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f8155050 0x7f48f80ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fe39d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8143260 con 0x7f48f8155050 2023-07-27T14:30:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fe39d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80ac950 con 0x7f48f80c1f20 2023-07-27T14:30:19.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fe39d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80a8390 con 0x7f48f80bc610 2023-07-27T14:30:19.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f8155050 0x7f48f80ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f8155050 0x7f48f80ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59630/0 (socket says 172.21.15.115:59630) 2023-07-27T14:30:19.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 -- 172.21.15.115:0/475836379 learned_addr learned my addr 172.21.15.115:0/475836379 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:19.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fd39b700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f80bc610 0x7f48f8149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fcb9a700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48f80c1f20 0x7f48f80abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 -- 172.21.15.115:0/475836379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f80bc610 msgr2=0x7f48f8149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f80bc610 0x7f48f8149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 -- 172.21.15.115:0/475836379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48f80c1f20 msgr2=0x7f48f80abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:19.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48f80c1f20 0x7f48f80abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:19.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 -- 172.21.15.115:0/475836379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009370 con 0x7f48f8155050 2023-07-27T14:30:19.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.915+0000 7f48fdb9c700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f8155050 0x7f48f80ac460 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f48f000c7f0 tx=0x7f48f0001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:19.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.916+0000 7f48ed7fa700 1 -- 172.21.15.115:0/475836379 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f000e4a0 con 0x7f48f8155050 2023-07-27T14:30:19.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.916+0000 7f48ed7fa700 1 -- 172.21.15.115:0/475836379 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f000e600 con 0x7f48f8155050 2023-07-27T14:30:19.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.916+0000 7f48ed7fa700 1 -- 172.21.15.115:0/475836379 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f000e980 con 0x7f48f8155050 2023-07-27T14:30:19.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.916+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f80a91b0 con 0x7f48f8155050 2023-07-27T14:30:19.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.916+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f80a8880 con 0x7f48f8155050 2023-07-27T14:30:19.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.917+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f8047270 con 0x7f48f8155050 2023-07-27T14:30:19.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.918+0000 7f48ed7fa700 1 -- 172.21.15.115:0/475836379 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f48f0010070 con 0x7f48f8155050 2023-07-27T14:30:19.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.919+0000 7f48ed7fa700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f48dc05f060 0x7f48dc061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:19.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.919+0000 7f48ed7fa700 1 -- 172.21.15.115:0/475836379 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f48f0079690 con 0x7f48f8155050 2023-07-27T14:30:19.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.919+0000 7f48fd39b700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f48dc05f060 0x7f48dc061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:19.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.920+0000 7f48fd39b700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f48dc05f060 0x7f48dc061520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f48f80acbf0 tx=0x7f48f4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:19.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:19.923+0000 7f48ed7fa700 1 -- 172.21.15.115:0/475836379 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f48f00478f0 con 0x7f48f8155050 2023-07-27T14:30:20.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.094+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f806a450 con 0x7f48f8155050 2023-07-27T14:30:20.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.095+0000 7f48ed7fa700 1 -- 172.21.15.115:0/475836379 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f48f004a960 con 0x7f48f8155050 2023-07-27T14:30:20.123 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:20.123 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":68,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:30:17.249639+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:30:14.561612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-27T14:30:15.229143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:30:20.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.096+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f48dc05f060 msgr2=0x7f48dc061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.096+0000 7f48fe39d700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f48dc05f060 0x7f48dc061520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f48f80acbf0 tx=0x7f48f4008040).stop 2023-07-27T14:30:20.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.096+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f8155050 msgr2=0x7f48f80ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.096+0000 7f48fe39d700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f8155050 0x7f48f80ac460 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f48f000c7f0 tx=0x7f48f0001510).stop 2023-07-27T14:30:20.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.097+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 shutdown_connections 2023-07-27T14:30:20.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.097+0000 7f48fe39d700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f48dc05f060 0x7f48dc061520 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.097+0000 7f48fe39d700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f8155050 0x7f48f80ac460 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.097+0000 7f48fe39d700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48f80bc610 0x7f48f8149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.097+0000 7f48fe39d700 1 --2- 172.21.15.115:0/475836379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48f80c1f20 0x7f48f80abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.097+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 >> 172.21.15.115:0/475836379 conn(0x7f48f80c69e0 msgr2=0x7f48f80c5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:20.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.097+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 shutdown_connections 2023-07-27T14:30:20.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.097+0000 7f48fe39d700 1 -- 172.21.15.115:0/475836379 wait complete. 2023-07-27T14:30:20.142 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:30:20.143 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:30:20.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.306+0000 7f51d9fff700 1 Processor -- start 2023-07-27T14:30:20.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.306+0000 7f51d9fff700 1 -- start start 2023-07-27T14:30:20.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.307+0000 7f51d9fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f51d40aaa40 0x7f51d40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.307+0000 7f51d9fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d41542a0 0x7f51d40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.307+0000 7f51d9fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d40aa4d0 con 0x7f51d4153ec0 2023-07-27T14:30:20.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.307+0000 7f51d9fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d4064ad0 con 0x7f51d40aaa40 2023-07-27T14:30:20.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.307+0000 7f51d9fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40c05c0 con 0x7f51d41542a0 2023-07-27T14:30:20.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51d37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f51d4153ec0 0x7f51d40a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33266/0 (socket says 172.21.15.115:33266) 2023-07-27T14:30:20.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51d37fe700 1 -- 172.21.15.115:0/569104910 learned_addr learned my addr 172.21.15.115:0/569104910 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:20.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51cbfff700 1 --2- 172.21.15.115:0/569104910 >> v2:172.21.15.115:3300/0 conn(0x7f51d40aaa40 0x7f51d40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51d3fff700 1 --2- 172.21.15.115:0/569104910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d41542a0 0x7f51d40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51d2ffd700 1 -- 172.21.15.115:0/569104910 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237266865 0 0) 0x7f51c4001110 con 0x7f51d4153ec0 2023-07-27T14:30:20.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51d2ffd700 1 -- 172.21.15.115:0/569104910 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c00033f0 con 0x7f51d4153ec0 2023-07-27T14:30:20.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51cbfff700 1 -- 172.21.15.115:0/569104910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d41542a0 msgr2=0x7f51d40645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:20.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51cbfff700 1 --2- 172.21.15.115:0/569104910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d41542a0 0x7f51d40645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51cbfff700 1 -- 172.21.15.115:0/569104910 >> v1:172.21.15.115:6789/0 conn(0x7f51d4153ec0 legacy=0x7f51d40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.308+0000 7f51cbfff700 1 -- 172.21.15.115:0/569104910 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40c1a60 con 0x7f51d40aaa40 2023-07-27T14:30:20.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51cbfff700 1 --2- 172.21.15.115:0/569104910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40640f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f51bc009760 tx=0x7f51bc009060).ready entity=mon.0 client_cookie=52102bd77f1d4d91 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:20.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d2ffd700 1 -- 172.21.15.115:0/569104910 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00d4a0 con 0x7f51d40aaa40 2023-07-27T14:30:20.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d2ffd700 1 -- 172.21.15.115:0/569104910 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc00d600 con 0x7f51d40aaa40 2023-07-27T14:30:20.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d2ffd700 1 -- 172.21.15.115:0/569104910 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00d980 con 0x7f51d40aaa40 2023-07-27T14:30:20.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d9fff700 1 -- 172.21.15.115:0/569104910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 msgr2=0x7f51d40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d9fff700 1 --2- 172.21.15.115:0/569104910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40640f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f51bc009760 tx=0x7f51bc009060).stop 2023-07-27T14:30:20.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d9fff700 1 -- 172.21.15.115:0/569104910 shutdown_connections 2023-07-27T14:30:20.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d9fff700 1 --2- 172.21.15.115:0/569104910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d41542a0 0x7f51d40645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d9fff700 1 --2- 172.21.15.115:0/569104910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40640f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d9fff700 1 -- 172.21.15.115:0/569104910 >> 172.21.15.115:0/569104910 conn(0x7f51d40cb610 msgr2=0x7f51d40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d9fff700 1 -- 172.21.15.115:0/569104910 shutdown_connections 2023-07-27T14:30:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.309+0000 7f51d9fff700 1 -- 172.21.15.115:0/569104910 wait complete. 2023-07-27T14:30:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.311+0000 7f51d9fff700 1 Processor -- start 2023-07-27T14:30:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.311+0000 7f51d9fff700 1 -- start start 2023-07-27T14:30:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d9fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d9fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d4153ec0 0x7f51d4167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d9fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51d41542a0 0x7f51d4167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d9fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d4145130 con 0x7f51d40aaa40 2023-07-27T14:30:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d9fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40af380 con 0x7f51d41542a0 2023-07-27T14:30:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d9fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40ae770 con 0x7f51d4153ec0 2023-07-27T14:30:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59646/0 (socket says 172.21.15.115:59646) 2023-07-27T14:30:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51d37fe700 1 -- 172.21.15.115:0/3375128848 learned_addr learned my addr 172.21.15.115:0/3375128848 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.312+0000 7f51cbfff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d4153ec0 0x7f51d4167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d3fff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51d41542a0 0x7f51d4167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d37fe700 1 -- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d4153ec0 msgr2=0x7f51d4167940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d37fe700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d4153ec0 0x7f51d4167940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d37fe700 1 -- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51d41542a0 msgr2=0x7f51d4167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d37fe700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51d41542a0 0x7f51d4167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d37fe700 1 -- 172.21.15.115:0/3375128848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0092a0 con 0x7f51d40aaa40 2023-07-27T14:30:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51cbfff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d4153ec0 0x7f51d4167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d3fff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51d41542a0 0x7f51d4167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d37fe700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40adf40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f51c400c4a0 tx=0x7f51c4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51cb7fe700 1 -- 172.21.15.115:0/3375128848 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c40072e0 con 0x7f51d40aaa40 2023-07-27T14:30:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51cb7fe700 1 -- 172.21.15.115:0/3375128848 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c4007440 con 0x7f51d40aaa40 2023-07-27T14:30:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d40aea50 con 0x7f51d40aaa40 2023-07-27T14:30:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51cb7fe700 1 -- 172.21.15.115:0/3375128848 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c40057a0 con 0x7f51d40aaa40 2023-07-27T14:30:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.313+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d40af010 con 0x7f51d40aaa40 2023-07-27T14:30:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.314+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d406c470 con 0x7f51d40aaa40 2023-07-27T14:30:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.315+0000 7f51cb7fe700 1 -- 172.21.15.115:0/3375128848 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f51c401a060 con 0x7f51d40aaa40 2023-07-27T14:30:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.316+0000 7f51cb7fe700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f51b405f060 0x7f51b4061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.316+0000 7f51cb7fe700 1 -- 172.21.15.115:0/3375128848 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f51c4079370 con 0x7f51d40aaa40 2023-07-27T14:30:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.316+0000 7f51cbfff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f51b405f060 0x7f51b4061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.317+0000 7f51cbfff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f51b405f060 0x7f51b4061520 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f51d40aae20 tx=0x7f51bc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:20.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.320+0000 7f51cb7fe700 1 -- 172.21.15.115:0/3375128848 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f51c404a530 con 0x7f51d40aaa40 2023-07-27T14:30:20.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.485+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51d40aa4d0 con 0x7f51b405f060 2023-07-27T14:30:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.495+0000 7f51cb7fe700 1 -- 172.21.15.115:0/3375128848 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361308 (secure 0 0 0) 0x7f51d40aa4d0 con 0x7f51b405f060 2023-07-27T14:30:20.527 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f51b405f060 msgr2=0x7f51b4061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f51b405f060 0x7f51b4061520 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f51d40aae20 tx=0x7f51bc016000).stop 2023-07-27T14:30:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 msgr2=0x7f51d40adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40adf40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f51c400c4a0 tx=0x7f51c4007af0).stop 2023-07-27T14:30:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 shutdown_connections 2023-07-27T14:30:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f51b405f060 0x7f51b4061520 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51d41542a0 0x7f51d4167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51d40aaa40 0x7f51d40adf40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 --2- 172.21.15.115:0/3375128848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f51d4153ec0 0x7f51d4167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 >> 172.21.15.115:0/3375128848 conn(0x7f51d40cb610 msgr2=0x7f51d40c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:20.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 shutdown_connections 2023-07-27T14:30:20.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.499+0000 7f51d9fff700 1 -- 172.21.15.115:0/3375128848 wait complete. 2023-07-27T14:30:20.532 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:30:20.545 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2023-07-27T14:30:19.481134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":62660,"kb_used_data":6404,"kb_used_omap":0,"kb_used_meta":56192,"kb_avail":754912060,"statfs":{"total":773094113280,"available":773029949440,"internally_reserved":0,"allocated":6557696,"data_stored":2946108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":57540608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3251050,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-41,"num_read_kb":-24613,"num_write":-670,"num_write_kb":-232650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-6291526,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.269630"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284532+0000","last_change":"2023-07-27T14:30:16.274465+0000","last_active":"2023-07-27T14:30:16.284532+0000","last_peered":"2023-07-27T14:30:16.284532+0000","last_clean":"2023-07-27T14:30:16.284532+0000","last_became_active":"2023-07-27T14:30:16.274022+0000","last_became_peered":"2023-07-27T14:30:16.274022+0000","last_unstale":"2023-07-27T14:30:16.284532+0000","last_undegraded":"2023-07-27T14:30:16.284532+0000","last_fullsized":"2023-07-27T14:30:16.284532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"67'3","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.270471+0000","last_change":"2023-07-27T14:30:15.803538+0000","last_active":"2023-07-27T14:30:16.270471+0000","last_peered":"2023-07-27T14:30:16.270471+0000","last_clean":"2023-07-27T14:30:16.270471+0000","last_became_active":"2023-07-27T14:30:15.803246+0000","last_became_peered":"2023-07-27T14:30:15.803246+0000","last_unstale":"2023-07-27T14:30:16.270471+0000","last_undegraded":"2023-07-27T14:30:16.270471+0000","last_fullsized":"2023-07-27T14:30:16.270471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285624+0000","last_change":"2023-07-27T14:30:16.280805+0000","last_active":"2023-07-27T14:30:16.285624+0000","last_peered":"2023-07-27T14:30:16.285624+0000","last_clean":"2023-07-27T14:30:16.285624+0000","last_became_active":"2023-07-27T14:30:16.278198+0000","last_became_peered":"2023-07-27T14:30:16.278198+0000","last_unstale":"2023-07-27T14:30:16.285624+0000","last_undegraded":"2023-07-27T14:30:16.285624+0000","last_fullsized":"2023-07-27T14:30:16.285624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.252537+0000","last_change":"2023-07-27T14:30:15.801009+0000","last_active":"2023-07-27T14:30:16.252537+0000","last_peered":"2023-07-27T14:30:16.252537+0000","last_clean":"2023-07-27T14:30:16.252537+0000","last_became_active":"2023-07-27T14:30:15.800691+0000","last_became_peered":"2023-07-27T14:30:15.800691+0000","last_unstale":"2023-07-27T14:30:16.252537+0000","last_undegraded":"2023-07-27T14:30:16.252537+0000","last_fullsized":"2023-07-27T14:30:16.252537+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.269134+0000","last_change":"2023-07-27T14:30:16.269134+0000","last_active":"2023-07-27T14:30:16.269134+0000","last_peered":"2023-07-27T14:30:16.269134+0000","last_clean":"2023-07-27T14:30:16.269134+0000","last_became_active":"2023-07-27T14:30:16.268750+0000","last_became_peered":"2023-07-27T14:30:16.268750+0000","last_unstale":"2023-07-27T14:30:16.269134+0000","last_undegraded":"2023-07-27T14:30:16.269134+0000","last_fullsized":"2023-07-27T14:30:16.269134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.264200+0000","last_change":"2023-07-27T14:30:15.814614+0000","last_active":"2023-07-27T14:30:16.264200+0000","last_peered":"2023-07-27T14:30:16.264200+0000","last_clean":"2023-07-27T14:30:16.264200+0000","last_became_active":"2023-07-27T14:30:15.814333+0000","last_became_peered":"2023-07-27T14:30:15.814333+0000","last_unstale":"2023-07-27T14:30:16.264200+0000","last_undegraded":"2023-07-27T14:30:16.264200+0000","last_fullsized":"2023-07-27T14:30:16.264200+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.277542+0000","last_change":"2023-07-27T14:30:16.277542+0000","last_active":"2023-07-27T14:30:16.277542+0000","last_peered":"2023-07-27T14:30:16.277542+0000","last_clean":"2023-07-27T14:30:16.277542+0000","last_became_active":"2023-07-27T14:30:16.277268+0000","last_became_peered":"2023-07-27T14:30:16.277268+0000","last_unstale":"2023-07-27T14:30:16.277542+0000","last_undegraded":"2023-07-27T14:30:16.277542+0000","last_fullsized":"2023-07-27T14:30:16.277542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278330+0000","last_change":"2023-07-27T14:30:15.805876+0000","last_active":"2023-07-27T14:30:16.278330+0000","last_peered":"2023-07-27T14:30:16.278330+0000","last_clean":"2023-07-27T14:30:16.278330+0000","last_became_active":"2023-07-27T14:30:15.805586+0000","last_became_peered":"2023-07-27T14:30:15.805586+0000","last_unstale":"2023-07-27T14:30:16.278330+0000","last_undegraded":"2023-07-27T14:30:16.278330+0000","last_fullsized":"2023-07-27T14:30:16.278330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281767+0000","last_change":"2023-07-27T14:30:16.276620+0000","last_active":"2023-07-27T14:30:16.281767+0000","last_peered":"2023-07-27T14:30:16.281767+0000","last_clean":"2023-07-27T14:30:16.281767+0000","last_became_active":"2023-07-27T14:30:16.276109+0000","last_became_peered":"2023-07-27T14:30:16.276109+0000","last_unstale":"2023-07-27T14:30:16.281767+0000","last_undegraded":"2023-07-27T14:30:16.281767+0000","last_fullsized":"2023-07-27T14:30:16.281767+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.255152+0000","last_change":"2023-07-27T14:30:15.808607+0000","last_active":"2023-07-27T14:30:16.255152+0000","last_peered":"2023-07-27T14:30:16.255152+0000","last_clean":"2023-07-27T14:30:16.255152+0000","last_became_active":"2023-07-27T14:30:15.808356+0000","last_became_peered":"2023-07-27T14:30:15.808356+0000","last_unstale":"2023-07-27T14:30:16.255152+0000","last_undegraded":"2023-07-27T14:30:16.255152+0000","last_fullsized":"2023-07-27T14:30:16.255152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281865+0000","last_change":"2023-07-27T14:30:16.281865+0000","last_active":"2023-07-27T14:30:16.281865+0000","last_peered":"2023-07-27T14:30:16.281865+0000","last_clean":"2023-07-27T14:30:16.281865+0000","last_became_active":"2023-07-27T14:30:16.281510+0000","last_became_peered":"2023-07-27T14:30:16.281510+0000","last_unstale":"2023-07-27T14:30:16.281865+0000","last_undegraded":"2023-07-27T14:30:16.281865+0000","last_fullsized":"2023-07-27T14:30:16.281865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.260430+0000","last_change":"2023-07-27T14:30:15.804145+0000","last_active":"2023-07-27T14:30:16.260430+0000","last_peered":"2023-07-27T14:30:16.260430+0000","last_clean":"2023-07-27T14:30:16.260430+0000","last_became_active":"2023-07-27T14:30:15.803889+0000","last_became_peered":"2023-07-27T14:30:15.803889+0000","last_unstale":"2023-07-27T14:30:16.260430+0000","last_undegraded":"2023-07-27T14:30:16.260430+0000","last_fullsized":"2023-07-27T14:30:16.260430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281207+0000","last_change":"2023-07-27T14:30:16.281207+0000","last_active":"2023-07-27T14:30:16.281207+0000","last_peered":"2023-07-27T14:30:16.281207+0000","last_clean":"2023-07-27T14:30:16.281207+0000","last_became_active":"2023-07-27T14:30:16.280842+0000","last_became_peered":"2023-07-27T14:30:16.280842+0000","last_unstale":"2023-07-27T14:30:16.281207+0000","last_undegraded":"2023-07-27T14:30:16.281207+0000","last_fullsized":"2023-07-27T14:30:16.281207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265867+0000","last_change":"2023-07-27T14:30:15.805734+0000","last_active":"2023-07-27T14:30:16.265867+0000","last_peered":"2023-07-27T14:30:16.265867+0000","last_clean":"2023-07-27T14:30:16.265867+0000","last_became_active":"2023-07-27T14:30:15.805416+0000","last_became_peered":"2023-07-27T14:30:15.805416+0000","last_unstale":"2023-07-27T14:30:16.265867+0000","last_undegraded":"2023-07-27T14:30:16.265867+0000","last_fullsized":"2023-07-27T14:30:16.265867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.272948+0000","last_change":"2023-07-27T14:30:16.272948+0000","last_active":"2023-07-27T14:30:16.272948+0000","last_peered":"2023-07-27T14:30:16.272948+0000","last_clean":"2023-07-27T14:30:16.272948+0000","last_became_active":"2023-07-27T14:30:16.268795+0000","last_became_peered":"2023-07-27T14:30:16.268795+0000","last_unstale":"2023-07-27T14:30:16.272948+0000","last_undegraded":"2023-07-27T14:30:16.272948+0000","last_fullsized":"2023-07-27T14:30:16.272948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.252415+0000","last_change":"2023-07-27T14:30:15.814539+0000","last_active":"2023-07-27T14:30:16.252415+0000","last_peered":"2023-07-27T14:30:16.252415+0000","last_clean":"2023-07-27T14:30:16.252415+0000","last_became_active":"2023-07-27T14:30:15.814146+0000","last_became_peered":"2023-07-27T14:30:15.814146+0000","last_unstale":"2023-07-27T14:30:16.252415+0000","last_undegraded":"2023-07-27T14:30:16.252415+0000","last_fullsized":"2023-07-27T14:30:16.252415+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284448+0000","last_change":"2023-07-27T14:30:16.278137+0000","last_active":"2023-07-27T14:30:16.284448+0000","last_peered":"2023-07-27T14:30:16.284448+0000","last_clean":"2023-07-27T14:30:16.284448+0000","last_became_active":"2023-07-27T14:30:16.277840+0000","last_became_peered":"2023-07-27T14:30:16.277840+0000","last_unstale":"2023-07-27T14:30:16.284448+0000","last_undegraded":"2023-07-27T14:30:16.284448+0000","last_fullsized":"2023-07-27T14:30:16.284448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.271279+0000","last_change":"2023-07-27T14:30:15.804954+0000","last_active":"2023-07-27T14:30:16.271279+0000","last_peered":"2023-07-27T14:30:16.271279+0000","last_clean":"2023-07-27T14:30:16.271279+0000","last_became_active":"2023-07-27T14:30:15.804650+0000","last_became_peered":"2023-07-27T14:30:15.804650+0000","last_unstale":"2023-07-27T14:30:16.271279+0000","last_undegraded":"2023-07-27T14:30:16.271279+0000","last_fullsized":"2023-07-27T14:30:16.271279+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284464+0000","last_change":"2023-07-27T14:30:16.274313+0000","last_active":"2023-07-27T14:30:16.284464+0000","last_peered":"2023-07-27T14:30:16.284464+0000","last_clean":"2023-07-27T14:30:16.284464+0000","last_became_active":"2023-07-27T14:30:16.273569+0000","last_became_peered":"2023-07-27T14:30:16.273569+0000","last_unstale":"2023-07-27T14:30:16.284464+0000","last_undegraded":"2023-07-27T14:30:16.284464+0000","last_fullsized":"2023-07-27T14:30:16.284464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.806339+0000","last_change":"2023-07-27T14:30:15.803160+0000","last_active":"2023-07-27T14:30:15.806339+0000","last_peered":"2023-07-27T14:30:15.806339+0000","last_clean":"2023-07-27T14:30:15.806339+0000","last_became_active":"2023-07-27T14:30:15.802540+0000","last_became_peered":"2023-07-27T14:30:15.802540+0000","last_unstale":"2023-07-27T14:30:15.806339+0000","last_undegraded":"2023-07-27T14:30:15.806339+0000","last_fullsized":"2023-07-27T14:30:15.806339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285370+0000","last_change":"2023-07-27T14:30:16.280410+0000","last_active":"2023-07-27T14:30:16.285370+0000","last_peered":"2023-07-27T14:30:16.285370+0000","last_clean":"2023-07-27T14:30:16.285370+0000","last_became_active":"2023-07-27T14:30:16.280078+0000","last_became_peered":"2023-07-27T14:30:16.280078+0000","last_unstale":"2023-07-27T14:30:16.285370+0000","last_undegraded":"2023-07-27T14:30:16.285370+0000","last_fullsized":"2023-07-27T14:30:16.285370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.799950+0000","last_change":"2023-07-27T14:30:15.798857+0000","last_active":"2023-07-27T14:30:15.799950+0000","last_peered":"2023-07-27T14:30:15.799950+0000","last_clean":"2023-07-27T14:30:15.799950+0000","last_became_active":"2023-07-27T14:30:15.798550+0000","last_became_peered":"2023-07-27T14:30:15.798550+0000","last_unstale":"2023-07-27T14:30:15.799950+0000","last_undegraded":"2023-07-27T14:30:15.799950+0000","last_fullsized":"2023-07-27T14:30:15.799950+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285973+0000","last_change":"2023-07-27T14:30:16.282948+0000","last_active":"2023-07-27T14:30:16.285973+0000","last_peered":"2023-07-27T14:30:16.285973+0000","last_clean":"2023-07-27T14:30:16.285973+0000","last_became_active":"2023-07-27T14:30:16.282161+0000","last_became_peered":"2023-07-27T14:30:16.282161+0000","last_unstale":"2023-07-27T14:30:16.285973+0000","last_undegraded":"2023-07-27T14:30:16.285973+0000","last_fullsized":"2023-07-27T14:30:16.285973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.287306+0000","last_change":"2023-07-27T14:30:15.808668+0000","last_active":"2023-07-27T14:30:16.287306+0000","last_peered":"2023-07-27T14:30:16.287306+0000","last_clean":"2023-07-27T14:30:16.287306+0000","last_became_active":"2023-07-27T14:30:15.808361+0000","last_became_peered":"2023-07-27T14:30:15.808361+0000","last_unstale":"2023-07-27T14:30:16.287306+0000","last_undegraded":"2023-07-27T14:30:16.287306+0000","last_fullsized":"2023-07-27T14:30:16.287306+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.267845+0000","last_change":"2023-07-27T14:30:16.267845+0000","last_active":"2023-07-27T14:30:16.267845+0000","last_peered":"2023-07-27T14:30:16.267845+0000","last_clean":"2023-07-27T14:30:16.267845+0000","last_became_active":"2023-07-27T14:30:16.267604+0000","last_became_peered":"2023-07-27T14:30:16.267604+0000","last_unstale":"2023-07-27T14:30:16.267845+0000","last_undegraded":"2023-07-27T14:30:16.267845+0000","last_fullsized":"2023-07-27T14:30:16.267845+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.258387+0000","last_change":"2023-07-27T14:30:15.804089+0000","last_active":"2023-07-27T14:30:16.258387+0000","last_peered":"2023-07-27T14:30:16.258387+0000","last_clean":"2023-07-27T14:30:16.258387+0000","last_became_active":"2023-07-27T14:30:15.803504+0000","last_became_peered":"2023-07-27T14:30:15.803504+0000","last_unstale":"2023-07-27T14:30:16.258387+0000","last_undegraded":"2023-07-27T14:30:16.258387+0000","last_fullsized":"2023-07-27T14:30:16.258387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285386+0000","last_change":"2023-07-27T14:30:16.278312+0000","last_active":"2023-07-27T14:30:16.285386+0000","last_peered":"2023-07-27T14:30:16.285386+0000","last_clean":"2023-07-27T14:30:16.285386+0000","last_became_active":"2023-07-27T14:30:16.277979+0000","last_became_peered":"2023-07-27T14:30:16.277979+0000","last_unstale":"2023-07-27T14:30:16.285386+0000","last_undegraded":"2023-07-27T14:30:16.285386+0000","last_fullsized":"2023-07-27T14:30:16.285386+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266251+0000","last_change":"2023-07-27T14:30:15.799924+0000","last_active":"2023-07-27T14:30:16.266251+0000","last_peered":"2023-07-27T14:30:16.266251+0000","last_clean":"2023-07-27T14:30:16.266251+0000","last_became_active":"2023-07-27T14:30:15.799631+0000","last_became_peered":"2023-07-27T14:30:15.799631+0000","last_unstale":"2023-07-27T14:30:16.266251+0000","last_undegraded":"2023-07-27T14:30:16.266251+0000","last_fullsized":"2023-07-27T14:30:16.266251+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285631+0000","last_change":"2023-07-27T14:30:16.278640+0000","last_active":"2023-07-27T14:30:16.285631+0000","last_peered":"2023-07-27T14:30:16.285631+0000","last_clean":"2023-07-27T14:30:16.285631+0000","last_became_active":"2023-07-27T14:30:16.278237+0000","last_became_peered":"2023-07-27T14:30:16.278237+0000","last_unstale":"2023-07-27T14:30:16.285631+0000","last_undegraded":"2023-07-27T14:30:16.285631+0000","last_fullsized":"2023-07-27T14:30:16.285631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266730+0000","last_change":"2023-07-27T14:30:15.794351+0000","last_active":"2023-07-27T14:30:16.266730+0000","last_peered":"2023-07-27T14:30:16.266730+0000","last_clean":"2023-07-27T14:30:16.266730+0000","last_became_active":"2023-07-27T14:30:15.793946+0000","last_became_peered":"2023-07-27T14:30:15.793946+0000","last_unstale":"2023-07-27T14:30:16.266730+0000","last_undegraded":"2023-07-27T14:30:16.266730+0000","last_fullsized":"2023-07-27T14:30:16.266730+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278483+0000","last_change":"2023-07-27T14:30:16.271341+0000","last_active":"2023-07-27T14:30:16.278483+0000","last_peered":"2023-07-27T14:30:16.278483+0000","last_clean":"2023-07-27T14:30:16.278483+0000","last_became_active":"2023-07-27T14:30:16.270753+0000","last_became_peered":"2023-07-27T14:30:16.270753+0000","last_unstale":"2023-07-27T14:30:16.278483+0000","last_undegraded":"2023-07-27T14:30:16.278483+0000","last_fullsized":"2023-07-27T14:30:16.278483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"67'4","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.282926+0000","last_change":"2023-07-27T14:30:15.801505+0000","last_active":"2023-07-27T14:30:16.282926+0000","last_peered":"2023-07-27T14:30:16.282926+0000","last_clean":"2023-07-27T14:30:16.282926+0000","last_became_active":"2023-07-27T14:30:15.801217+0000","last_became_peered":"2023-07-27T14:30:15.801217+0000","last_unstale":"2023-07-27T14:30:16.282926+0000","last_undegraded":"2023-07-27T14:30:16.282926+0000","last_fullsized":"2023-07-27T14:30:16.282926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266878+0000","last_change":"2023-07-27T14:30:16.263983+0000","last_active":"2023-07-27T14:30:16.266878+0000","last_peered":"2023-07-27T14:30:16.266878+0000","last_clean":"2023-07-27T14:30:16.266878+0000","last_became_active":"2023-07-27T14:30:16.263649+0000","last_became_peered":"2023-07-27T14:30:16.263649+0000","last_unstale":"2023-07-27T14:30:16.266878+0000","last_undegraded":"2023-07-27T14:30:16.266878+0000","last_fullsized":"2023-07-27T14:30:16.266878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253736+0000","last_change":"2023-07-27T14:30:15.806001+0000","last_active":"2023-07-27T14:30:16.253736+0000","last_peered":"2023-07-27T14:30:16.253736+0000","last_clean":"2023-07-27T14:30:16.253736+0000","last_became_active":"2023-07-27T14:30:15.805749+0000","last_became_peered":"2023-07-27T14:30:15.805749+0000","last_unstale":"2023-07-27T14:30:16.253736+0000","last_undegraded":"2023-07-27T14:30:16.253736+0000","last_fullsized":"2023-07-27T14:30:16.253736+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.268666+0000","last_change":"2023-07-27T14:30:16.268666+0000","last_active":"2023-07-27T14:30:16.268666+0000","last_peered":"2023-07-27T14:30:16.268666+0000","last_clean":"2023-07-27T14:30:16.268666+0000","last_became_active":"2023-07-27T14:30:16.268350+0000","last_became_peered":"2023-07-27T14:30:16.268350+0000","last_unstale":"2023-07-27T14:30:16.268666+0000","last_undegraded":"2023-07-27T14:30:16.268666+0000","last_fullsized":"2023-07-27T14:30:16.268666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.262886+0000","last_change":"2023-07-27T14:30:15.809365+0000","last_active":"2023-07-27T14:30:16.262886+0000","last_peered":"2023-07-27T14:30:16.262886+0000","last_clean":"2023-07-27T14:30:16.262886+0000","last_became_active":"2023-07-27T14:30:15.809082+0000","last_became_peered":"2023-07-27T14:30:15.809082+0000","last_unstale":"2023-07-27T14:30:16.262886+0000","last_undegraded":"2023-07-27T14:30:16.262886+0000","last_fullsized":"2023-07-27T14:30:16.262886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.280254+0000","last_change":"2023-07-27T14:30:16.273966+0000","last_active":"2023-07-27T14:30:16.280254+0000","last_peered":"2023-07-27T14:30:16.280254+0000","last_clean":"2023-07-27T14:30:16.280254+0000","last_became_active":"2023-07-27T14:30:16.273661+0000","last_became_peered":"2023-07-27T14:30:16.273661+0000","last_unstale":"2023-07-27T14:30:16.280254+0000","last_undegraded":"2023-07-27T14:30:16.280254+0000","last_fullsized":"2023-07-27T14:30:16.280254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.255652+0000","last_change":"2023-07-27T14:30:15.800917+0000","last_active":"2023-07-27T14:30:16.255652+0000","last_peered":"2023-07-27T14:30:16.255652+0000","last_clean":"2023-07-27T14:30:16.255652+0000","last_became_active":"2023-07-27T14:30:15.800624+0000","last_became_peered":"2023-07-27T14:30:15.800624+0000","last_unstale":"2023-07-27T14:30:16.255652+0000","last_undegraded":"2023-07-27T14:30:16.255652+0000","last_fullsized":"2023-07-27T14:30:16.255652+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.275984+0000","last_change":"2023-07-27T14:30:16.275984+0000","last_active":"2023-07-27T14:30:16.275984+0000","last_peered":"2023-07-27T14:30:16.275984+0000","last_clean":"2023-07-27T14:30:16.275984+0000","last_became_active":"2023-07-27T14:30:16.275718+0000","last_became_peered":"2023-07-27T14:30:16.275718+0000","last_unstale":"2023-07-27T14:30:16.275984+0000","last_undegraded":"2023-07-27T14:30:16.275984+0000","last_fullsized":"2023-07-27T14:30:16.275984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253469+0000","last_change":"2023-07-27T14:30:15.812395+0000","last_active":"2023-07-27T14:30:16.253469+0000","last_peered":"2023-07-27T14:30:16.253469+0000","last_clean":"2023-07-27T14:30:16.253469+0000","last_became_active":"2023-07-27T14:30:15.811881+0000","last_became_peered":"2023-07-27T14:30:15.811881+0000","last_unstale":"2023-07-27T14:30:16.253469+0000","last_undegraded":"2023-07-27T14:30:16.253469+0000","last_fullsized":"2023-07-27T14:30:16.253469+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285308+0000","last_change":"2023-07-27T14:30:16.277625+0000","last_active":"2023-07-27T14:30:16.285308+0000","last_peered":"2023-07-27T14:30:16.285308+0000","last_clean":"2023-07-27T14:30:16.285308+0000","last_became_active":"2023-07-27T14:30:16.277289+0000","last_became_peered":"2023-07-27T14:30:16.277289+0000","last_unstale":"2023-07-27T14:30:16.285308+0000","last_undegraded":"2023-07-27T14:30:16.285308+0000","last_fullsized":"2023-07-27T14:30:16.285308+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.283954+0000","last_change":"2023-07-27T14:30:15.805990+0000","last_active":"2023-07-27T14:30:16.283954+0000","last_peered":"2023-07-27T14:30:16.283954+0000","last_clean":"2023-07-27T14:30:16.283954+0000","last_became_active":"2023-07-27T14:30:15.805370+0000","last_became_peered":"2023-07-27T14:30:15.805370+0000","last_unstale":"2023-07-27T14:30:16.283954+0000","last_undegraded":"2023-07-27T14:30:16.283954+0000","last_fullsized":"2023-07-27T14:30:16.283954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281892+0000","last_change":"2023-07-27T14:30:16.280894+0000","last_active":"2023-07-27T14:30:16.281892+0000","last_peered":"2023-07-27T14:30:16.281892+0000","last_clean":"2023-07-27T14:30:16.281892+0000","last_became_active":"2023-07-27T14:30:16.280614+0000","last_became_peered":"2023-07-27T14:30:16.280614+0000","last_unstale":"2023-07-27T14:30:16.281892+0000","last_undegraded":"2023-07-27T14:30:16.281892+0000","last_fullsized":"2023-07-27T14:30:16.281892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253179+0000","last_change":"2023-07-27T14:30:15.805138+0000","last_active":"2023-07-27T14:30:16.253179+0000","last_peered":"2023-07-27T14:30:16.253179+0000","last_clean":"2023-07-27T14:30:16.253179+0000","last_became_active":"2023-07-27T14:30:15.804482+0000","last_became_peered":"2023-07-27T14:30:15.804482+0000","last_unstale":"2023-07-27T14:30:16.253179+0000","last_undegraded":"2023-07-27T14:30:16.253179+0000","last_fullsized":"2023-07-27T14:30:16.253179+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281939+0000","last_change":"2023-07-27T14:30:16.280915+0000","last_active":"2023-07-27T14:30:16.281939+0000","last_peered":"2023-07-27T14:30:16.281939+0000","last_clean":"2023-07-27T14:30:16.281939+0000","last_became_active":"2023-07-27T14:30:16.280656+0000","last_became_peered":"2023-07-27T14:30:16.280656+0000","last_unstale":"2023-07-27T14:30:16.281939+0000","last_undegraded":"2023-07-27T14:30:16.281939+0000","last_fullsized":"2023-07-27T14:30:16.281939+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.263700+0000","last_change":"2023-07-27T14:30:15.808351+0000","last_active":"2023-07-27T14:30:16.263700+0000","last_peered":"2023-07-27T14:30:16.263700+0000","last_clean":"2023-07-27T14:30:16.263700+0000","last_became_active":"2023-07-27T14:30:15.808073+0000","last_became_peered":"2023-07-27T14:30:15.808073+0000","last_unstale":"2023-07-27T14:30:16.263700+0000","last_undegraded":"2023-07-27T14:30:16.263700+0000","last_fullsized":"2023-07-27T14:30:16.263700+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276451+0000","last_change":"2023-07-27T14:30:16.265450+0000","last_active":"2023-07-27T14:30:16.276451+0000","last_peered":"2023-07-27T14:30:16.276451+0000","last_clean":"2023-07-27T14:30:16.276451+0000","last_became_active":"2023-07-27T14:30:16.265044+0000","last_became_peered":"2023-07-27T14:30:16.265044+0000","last_unstale":"2023-07-27T14:30:16.276451+0000","last_undegraded":"2023-07-27T14:30:16.276451+0000","last_fullsized":"2023-07-27T14:30:16.276451+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807008+0000","last_change":"2023-07-27T14:30:15.803590+0000","last_active":"2023-07-27T14:30:15.807008+0000","last_peered":"2023-07-27T14:30:15.807008+0000","last_clean":"2023-07-27T14:30:15.807008+0000","last_became_active":"2023-07-27T14:30:15.803139+0000","last_became_peered":"2023-07-27T14:30:15.803139+0000","last_unstale":"2023-07-27T14:30:15.807008+0000","last_undegraded":"2023-07-27T14:30:15.807008+0000","last_fullsized":"2023-07-27T14:30:15.807008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265617+0000","last_change":"2023-07-27T14:30:16.265617+0000","last_active":"2023-07-27T14:30:16.265617+0000","last_peered":"2023-07-27T14:30:16.265617+0000","last_clean":"2023-07-27T14:30:16.265617+0000","last_became_active":"2023-07-27T14:30:16.265366+0000","last_became_peered":"2023-07-27T14:30:16.265366+0000","last_unstale":"2023-07-27T14:30:16.265617+0000","last_undegraded":"2023-07-27T14:30:16.265617+0000","last_fullsized":"2023-07-27T14:30:16.265617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.800970+0000","last_change":"2023-07-27T14:30:15.793199+0000","last_active":"2023-07-27T14:30:15.800970+0000","last_peered":"2023-07-27T14:30:15.800970+0000","last_clean":"2023-07-27T14:30:15.800970+0000","last_became_active":"2023-07-27T14:30:15.792901+0000","last_became_peered":"2023-07-27T14:30:15.792901+0000","last_unstale":"2023-07-27T14:30:15.800970+0000","last_undegraded":"2023-07-27T14:30:15.800970+0000","last_fullsized":"2023-07-27T14:30:15.800970+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284485+0000","last_change":"2023-07-27T14:30:16.274503+0000","last_active":"2023-07-27T14:30:16.284485+0000","last_peered":"2023-07-27T14:30:16.284485+0000","last_clean":"2023-07-27T14:30:16.284485+0000","last_became_active":"2023-07-27T14:30:16.273989+0000","last_became_peered":"2023-07-27T14:30:16.273989+0000","last_unstale":"2023-07-27T14:30:16.284485+0000","last_undegraded":"2023-07-27T14:30:16.284485+0000","last_fullsized":"2023-07-27T14:30:16.284485+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.256828+0000","last_change":"2023-07-27T14:30:15.811604+0000","last_active":"2023-07-27T14:30:16.256828+0000","last_peered":"2023-07-27T14:30:16.256828+0000","last_clean":"2023-07-27T14:30:16.256828+0000","last_became_active":"2023-07-27T14:30:15.811292+0000","last_became_peered":"2023-07-27T14:30:15.811292+0000","last_unstale":"2023-07-27T14:30:16.256828+0000","last_undegraded":"2023-07-27T14:30:16.256828+0000","last_fullsized":"2023-07-27T14:30:16.256828+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278437+0000","last_change":"2023-07-27T14:30:16.275351+0000","last_active":"2023-07-27T14:30:16.278437+0000","last_peered":"2023-07-27T14:30:16.278437+0000","last_clean":"2023-07-27T14:30:16.278437+0000","last_became_active":"2023-07-27T14:30:16.274934+0000","last_became_peered":"2023-07-27T14:30:16.274934+0000","last_unstale":"2023-07-27T14:30:16.278437+0000","last_undegraded":"2023-07-27T14:30:16.278437+0000","last_fullsized":"2023-07-27T14:30:16.278437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807953+0000","last_change":"2023-07-27T14:30:15.802126+0000","last_active":"2023-07-27T14:30:15.807953+0000","last_peered":"2023-07-27T14:30:15.807953+0000","last_clean":"2023-07-27T14:30:15.807953+0000","last_became_active":"2023-07-27T14:30:15.801877+0000","last_became_peered":"2023-07-27T14:30:15.801877+0000","last_unstale":"2023-07-27T14:30:15.807953+0000","last_undegraded":"2023-07-27T14:30:15.807953+0000","last_fullsized":"2023-07-27T14:30:15.807953+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276508+0000","last_change":"2023-07-27T14:30:16.267254+0000","last_active":"2023-07-27T14:30:16.276508+0000","last_peered":"2023-07-27T14:30:16.276508+0000","last_clean":"2023-07-27T14:30:16.276508+0000","last_became_active":"2023-07-27T14:30:16.266972+0000","last_became_peered":"2023-07-27T14:30:16.266972+0000","last_unstale":"2023-07-27T14:30:16.276508+0000","last_undegraded":"2023-07-27T14:30:16.276508+0000","last_fullsized":"2023-07-27T14:30:16.276508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.811228+0000","last_change":"2023-07-27T14:30:15.809221+0000","last_active":"2023-07-27T14:30:15.811228+0000","last_peered":"2023-07-27T14:30:15.811228+0000","last_clean":"2023-07-27T14:30:15.811228+0000","last_became_active":"2023-07-27T14:30:15.808866+0000","last_became_peered":"2023-07-27T14:30:15.808866+0000","last_unstale":"2023-07-27T14:30:15.811228+0000","last_undegraded":"2023-07-27T14:30:15.811228+0000","last_fullsized":"2023-07-27T14:30:15.811228+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.268546+0000","last_change":"2023-07-27T14:30:16.268546+0000","last_active":"2023-07-27T14:30:16.268546+0000","last_peered":"2023-07-27T14:30:16.268546+0000","last_clean":"2023-07-27T14:30:16.268546+0000","last_became_active":"2023-07-27T14:30:16.268094+0000","last_became_peered":"2023-07-27T14:30:16.268094+0000","last_unstale":"2023-07-27T14:30:16.268546+0000","last_undegraded":"2023-07-27T14:30:16.268546+0000","last_fullsized":"2023-07-27T14:30:16.268546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253154+0000","last_change":"2023-07-27T14:30:15.806723+0000","last_active":"2023-07-27T14:30:16.253154+0000","last_peered":"2023-07-27T14:30:16.253154+0000","last_clean":"2023-07-27T14:30:16.253154+0000","last_became_active":"2023-07-27T14:30:15.806472+0000","last_became_peered":"2023-07-27T14:30:15.806472+0000","last_unstale":"2023-07-27T14:30:16.253154+0000","last_undegraded":"2023-07-27T14:30:16.253154+0000","last_fullsized":"2023-07-27T14:30:16.253154+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284634+0000","last_change":"2023-07-27T14:30:16.275183+0000","last_active":"2023-07-27T14:30:16.284634+0000","last_peered":"2023-07-27T14:30:16.284634+0000","last_clean":"2023-07-27T14:30:16.284634+0000","last_became_active":"2023-07-27T14:30:16.274930+0000","last_became_peered":"2023-07-27T14:30:16.274930+0000","last_unstale":"2023-07-27T14:30:16.284634+0000","last_undegraded":"2023-07-27T14:30:16.284634+0000","last_fullsized":"2023-07-27T14:30:16.284634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.263637+0000","last_change":"2023-07-27T14:30:15.810910+0000","last_active":"2023-07-27T14:30:16.263637+0000","last_peered":"2023-07-27T14:30:16.263637+0000","last_clean":"2023-07-27T14:30:16.263637+0000","last_became_active":"2023-07-27T14:30:15.810635+0000","last_became_peered":"2023-07-27T14:30:15.810635+0000","last_unstale":"2023-07-27T14:30:16.263637+0000","last_undegraded":"2023-07-27T14:30:16.263637+0000","last_fullsized":"2023-07-27T14:30:16.263637+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284537+0000","last_change":"2023-07-27T14:30:16.280338+0000","last_active":"2023-07-27T14:30:16.284537+0000","last_peered":"2023-07-27T14:30:16.284537+0000","last_clean":"2023-07-27T14:30:16.284537+0000","last_became_active":"2023-07-27T14:30:16.280071+0000","last_became_peered":"2023-07-27T14:30:16.280071+0000","last_unstale":"2023-07-27T14:30:16.284537+0000","last_undegraded":"2023-07-27T14:30:16.284537+0000","last_fullsized":"2023-07-27T14:30:16.284537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.802932+0000","last_change":"2023-07-27T14:30:15.799787+0000","last_active":"2023-07-27T14:30:15.802932+0000","last_peered":"2023-07-27T14:30:15.802932+0000","last_clean":"2023-07-27T14:30:15.802932+0000","last_became_active":"2023-07-27T14:30:15.799491+0000","last_became_peered":"2023-07-27T14:30:15.799491+0000","last_unstale":"2023-07-27T14:30:15.802932+0000","last_undegraded":"2023-07-27T14:30:15.802932+0000","last_fullsized":"2023-07-27T14:30:15.802932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285994+0000","last_change":"2023-07-27T14:30:16.283131+0000","last_active":"2023-07-27T14:30:16.285994+0000","last_peered":"2023-07-27T14:30:16.285994+0000","last_clean":"2023-07-27T14:30:16.285994+0000","last_became_active":"2023-07-27T14:30:16.282115+0000","last_became_peered":"2023-07-27T14:30:16.282115+0000","last_unstale":"2023-07-27T14:30:16.285994+0000","last_undegraded":"2023-07-27T14:30:16.285994+0000","last_fullsized":"2023-07-27T14:30:16.285994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807994+0000","last_change":"2023-07-27T14:30:15.803063+0000","last_active":"2023-07-27T14:30:15.807994+0000","last_peered":"2023-07-27T14:30:15.807994+0000","last_clean":"2023-07-27T14:30:15.807994+0000","last_became_active":"2023-07-27T14:30:15.802792+0000","last_became_peered":"2023-07-27T14:30:15.802792+0000","last_unstale":"2023-07-27T14:30:15.807994+0000","last_undegraded":"2023-07-27T14:30:15.807994+0000","last_fullsized":"2023-07-27T14:30:15.807994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265558+0000","last_change":"2023-07-27T14:30:16.265558+0000","last_active":"2023-07-27T14:30:16.265558+0000","last_peered":"2023-07-27T14:30:16.265558+0000","last_clean":"2023-07-27T14:30:16.265558+0000","last_became_active":"2023-07-27T14:30:16.265244+0000","last_became_peered":"2023-07-27T14:30:16.265244+0000","last_unstale":"2023-07-27T14:30:16.265558+0000","last_undegraded":"2023-07-27T14:30:16.265558+0000","last_fullsized":"2023-07-27T14:30:16.265558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.262698+0000","last_change":"2023-07-27T14:30:15.806268+0000","last_active":"2023-07-27T14:30:16.262698+0000","last_peered":"2023-07-27T14:30:16.262698+0000","last_clean":"2023-07-27T14:30:16.262698+0000","last_became_active":"2023-07-27T14:30:15.805929+0000","last_became_peered":"2023-07-27T14:30:15.805929+0000","last_unstale":"2023-07-27T14:30:16.262698+0000","last_undegraded":"2023-07-27T14:30:16.262698+0000","last_fullsized":"2023-07-27T14:30:16.262698+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284502+0000","last_change":"2023-07-27T14:30:16.281285+0000","last_active":"2023-07-27T14:30:16.284502+0000","last_peered":"2023-07-27T14:30:16.284502+0000","last_clean":"2023-07-27T14:30:16.284502+0000","last_became_active":"2023-07-27T14:30:16.281004+0000","last_became_peered":"2023-07-27T14:30:16.281004+0000","last_unstale":"2023-07-27T14:30:16.284502+0000","last_undegraded":"2023-07-27T14:30:16.284502+0000","last_fullsized":"2023-07-27T14:30:16.284502+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.258623+0000","last_change":"2023-07-27T14:30:15.811009+0000","last_active":"2023-07-27T14:30:16.258623+0000","last_peered":"2023-07-27T14:30:16.258623+0000","last_clean":"2023-07-27T14:30:16.258623+0000","last_became_active":"2023-07-27T14:30:15.810660+0000","last_became_peered":"2023-07-27T14:30:15.810660+0000","last_unstale":"2023-07-27T14:30:16.258623+0000","last_undegraded":"2023-07-27T14:30:16.258623+0000","last_fullsized":"2023-07-27T14:30:16.258623+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.268484+0000","last_change":"2023-07-27T14:30:16.268484+0000","last_active":"2023-07-27T14:30:16.268484+0000","last_peered":"2023-07-27T14:30:16.268484+0000","last_clean":"2023-07-27T14:30:16.268484+0000","last_became_active":"2023-07-27T14:30:16.268214+0000","last_became_peered":"2023-07-27T14:30:16.268214+0000","last_unstale":"2023-07-27T14:30:16.268484+0000","last_undegraded":"2023-07-27T14:30:16.268484+0000","last_fullsized":"2023-07-27T14:30:16.268484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"67'2","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278354+0000","last_change":"2023-07-27T14:30:15.808614+0000","last_active":"2023-07-27T14:30:16.278354+0000","last_peered":"2023-07-27T14:30:16.278354+0000","last_clean":"2023-07-27T14:30:16.278354+0000","last_became_active":"2023-07-27T14:30:15.808143+0000","last_became_peered":"2023-07-27T14:30:15.808143+0000","last_unstale":"2023-07-27T14:30:16.278354+0000","last_undegraded":"2023-07-27T14:30:16.278354+0000","last_fullsized":"2023-07-27T14:30:16.278354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285274+0000","last_change":"2023-07-27T14:30:16.278917+0000","last_active":"2023-07-27T14:30:16.285274+0000","last_peered":"2023-07-27T14:30:16.285274+0000","last_clean":"2023-07-27T14:30:16.285274+0000","last_became_active":"2023-07-27T14:30:16.278601+0000","last_became_peered":"2023-07-27T14:30:16.278601+0000","last_unstale":"2023-07-27T14:30:16.285274+0000","last_undegraded":"2023-07-27T14:30:16.285274+0000","last_fullsized":"2023-07-27T14:30:16.285274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807831+0000","last_change":"2023-07-27T14:30:15.800100+0000","last_active":"2023-07-27T14:30:15.807831+0000","last_peered":"2023-07-27T14:30:15.807831+0000","last_clean":"2023-07-27T14:30:15.807831+0000","last_became_active":"2023-07-27T14:30:15.799833+0000","last_became_peered":"2023-07-27T14:30:15.799833+0000","last_unstale":"2023-07-27T14:30:15.807831+0000","last_undegraded":"2023-07-27T14:30:15.807831+0000","last_fullsized":"2023-07-27T14:30:15.807831+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.264647+0000","last_change":"2023-07-27T14:30:16.264647+0000","last_active":"2023-07-27T14:30:16.264647+0000","last_peered":"2023-07-27T14:30:16.264647+0000","last_clean":"2023-07-27T14:30:16.264647+0000","last_became_active":"2023-07-27T14:30:16.264390+0000","last_became_peered":"2023-07-27T14:30:16.264390+0000","last_unstale":"2023-07-27T14:30:16.264647+0000","last_undegraded":"2023-07-27T14:30:16.264647+0000","last_fullsized":"2023-07-27T14:30:16.264647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253257+0000","last_change":"2023-07-27T14:30:15.808336+0000","last_active":"2023-07-27T14:30:16.253257+0000","last_peered":"2023-07-27T14:30:16.253257+0000","last_clean":"2023-07-27T14:30:16.253257+0000","last_became_active":"2023-07-27T14:30:15.808037+0000","last_became_peered":"2023-07-27T14:30:15.808037+0000","last_unstale":"2023-07-27T14:30:16.253257+0000","last_undegraded":"2023-07-27T14:30:16.253257+0000","last_fullsized":"2023-07-27T14:30:16.253257+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276387+0000","last_change":"2023-07-27T14:30:16.276387+0000","last_active":"2023-07-27T14:30:16.276387+0000","last_peered":"2023-07-27T14:30:16.276387+0000","last_clean":"2023-07-27T14:30:16.276387+0000","last_became_active":"2023-07-27T14:30:16.275981+0000","last_became_peered":"2023-07-27T14:30:16.275981+0000","last_unstale":"2023-07-27T14:30:16.276387+0000","last_undegraded":"2023-07-27T14:30:16.276387+0000","last_fullsized":"2023-07-27T14:30:16.276387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253276+0000","last_change":"2023-07-27T14:30:15.805181+0000","last_active":"2023-07-27T14:30:16.253276+0000","last_peered":"2023-07-27T14:30:16.253276+0000","last_clean":"2023-07-27T14:30:16.253276+0000","last_became_active":"2023-07-27T14:30:15.804841+0000","last_became_peered":"2023-07-27T14:30:15.804841+0000","last_unstale":"2023-07-27T14:30:16.253276+0000","last_undegraded":"2023-07-27T14:30:16.253276+0000","last_fullsized":"2023-07-27T14:30:16.253276+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.277304+0000","last_change":"2023-07-27T14:30:16.277304+0000","last_active":"2023-07-27T14:30:16.277304+0000","last_peered":"2023-07-27T14:30:16.277304+0000","last_clean":"2023-07-27T14:30:16.277304+0000","last_became_active":"2023-07-27T14:30:16.276971+0000","last_became_peered":"2023-07-27T14:30:16.276971+0000","last_unstale":"2023-07-27T14:30:16.277304+0000","last_undegraded":"2023-07-27T14:30:16.277304+0000","last_fullsized":"2023-07-27T14:30:16.277304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.252990+0000","last_change":"2023-07-27T14:30:15.808086+0000","last_active":"2023-07-27T14:30:16.252990+0000","last_peered":"2023-07-27T14:30:16.252990+0000","last_clean":"2023-07-27T14:30:16.252990+0000","last_became_active":"2023-07-27T14:30:15.807772+0000","last_became_peered":"2023-07-27T14:30:15.807772+0000","last_unstale":"2023-07-27T14:30:16.252990+0000","last_undegraded":"2023-07-27T14:30:16.252990+0000","last_fullsized":"2023-07-27T14:30:16.252990+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.275149+0000","last_change":"2023-07-27T14:30:16.273281+0000","last_active":"2023-07-27T14:30:16.275149+0000","last_peered":"2023-07-27T14:30:16.275149+0000","last_clean":"2023-07-27T14:30:16.275149+0000","last_became_active":"2023-07-27T14:30:16.272996+0000","last_became_peered":"2023-07-27T14:30:16.272996+0000","last_unstale":"2023-07-27T14:30:16.275149+0000","last_undegraded":"2023-07-27T14:30:16.275149+0000","last_fullsized":"2023-07-27T14:30:16.275149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807027+0000","last_change":"2023-07-27T14:30:15.805027+0000","last_active":"2023-07-27T14:30:15.807027+0000","last_peered":"2023-07-27T14:30:15.807027+0000","last_clean":"2023-07-27T14:30:15.807027+0000","last_became_active":"2023-07-27T14:30:15.804571+0000","last_became_peered":"2023-07-27T14:30:15.804571+0000","last_unstale":"2023-07-27T14:30:15.807027+0000","last_undegraded":"2023-07-27T14:30:15.807027+0000","last_fullsized":"2023-07-27T14:30:15.807027+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266522+0000","last_change":"2023-07-27T14:30:16.266522+0000","last_active":"2023-07-27T14:30:16.266522+0000","last_peered":"2023-07-27T14:30:16.266522+0000","last_clean":"2023-07-27T14:30:16.266522+0000","last_became_active":"2023-07-27T14:30:16.266273+0000","last_became_peered":"2023-07-27T14:30:16.266273+0000","last_unstale":"2023-07-27T14:30:16.266522+0000","last_undegraded":"2023-07-27T14:30:16.266522+0000","last_fullsized":"2023-07-27T14:30:16.266522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265353+0000","last_change":"2023-07-27T14:30:15.807466+0000","last_active":"2023-07-27T14:30:16.265353+0000","last_peered":"2023-07-27T14:30:16.265353+0000","last_clean":"2023-07-27T14:30:16.265353+0000","last_became_active":"2023-07-27T14:30:15.807150+0000","last_became_peered":"2023-07-27T14:30:15.807150+0000","last_unstale":"2023-07-27T14:30:16.265353+0000","last_undegraded":"2023-07-27T14:30:16.265353+0000","last_fullsized":"2023-07-27T14:30:16.265353+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.271217+0000","last_change":"2023-07-27T14:30:16.267355+0000","last_active":"2023-07-27T14:30:16.271217+0000","last_peered":"2023-07-27T14:30:16.271217+0000","last_clean":"2023-07-27T14:30:16.271217+0000","last_became_active":"2023-07-27T14:30:16.266958+0000","last_became_peered":"2023-07-27T14:30:16.266958+0000","last_unstale":"2023-07-27T14:30:16.271217+0000","last_undegraded":"2023-07-27T14:30:16.271217+0000","last_fullsized":"2023-07-27T14:30:16.271217+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.270252+0000","last_change":"2023-07-27T14:30:15.797334+0000","last_active":"2023-07-27T14:30:16.270252+0000","last_peered":"2023-07-27T14:30:16.270252+0000","last_clean":"2023-07-27T14:30:16.270252+0000","last_became_active":"2023-07-27T14:30:15.796991+0000","last_became_peered":"2023-07-27T14:30:15.796991+0000","last_unstale":"2023-07-27T14:30:16.270252+0000","last_undegraded":"2023-07-27T14:30:16.270252+0000","last_fullsized":"2023-07-27T14:30:16.270252+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.269927+0000","last_change":"2023-07-27T14:30:16.269927+0000","last_active":"2023-07-27T14:30:16.269927+0000","last_peered":"2023-07-27T14:30:16.269927+0000","last_clean":"2023-07-27T14:30:16.269927+0000","last_became_active":"2023-07-27T14:30:16.269562+0000","last_became_peered":"2023-07-27T14:30:16.269562+0000","last_unstale":"2023-07-27T14:30:16.269927+0000","last_undegraded":"2023-07-27T14:30:16.269927+0000","last_fullsized":"2023-07-27T14:30:16.269927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"67'3","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285176+0000","last_change":"2023-07-27T14:30:15.812924+0000","last_active":"2023-07-27T14:30:16.285176+0000","last_peered":"2023-07-27T14:30:16.285176+0000","last_clean":"2023-07-27T14:30:16.285176+0000","last_became_active":"2023-07-27T14:30:15.812395+0000","last_became_peered":"2023-07-27T14:30:15.812395+0000","last_unstale":"2023-07-27T14:30:16.285176+0000","last_undegraded":"2023-07-27T14:30:16.285176+0000","last_fullsized":"2023-07-27T14:30:16.285176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.280136+0000","last_change":"2023-07-27T14:30:16.273159+0000","last_active":"2023-07-27T14:30:16.280136+0000","last_peered":"2023-07-27T14:30:16.280136+0000","last_clean":"2023-07-27T14:30:16.280136+0000","last_became_active":"2023-07-27T14:30:16.272889+0000","last_became_peered":"2023-07-27T14:30:16.272889+0000","last_unstale":"2023-07-27T14:30:16.280136+0000","last_undegraded":"2023-07-27T14:30:16.280136+0000","last_fullsized":"2023-07-27T14:30:16.280136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"67'2","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284875+0000","last_change":"2023-07-27T14:30:15.809095+0000","last_active":"2023-07-27T14:30:16.284875+0000","last_peered":"2023-07-27T14:30:16.284875+0000","last_clean":"2023-07-27T14:30:16.284875+0000","last_became_active":"2023-07-27T14:30:15.808421+0000","last_became_peered":"2023-07-27T14:30:15.808421+0000","last_unstale":"2023-07-27T14:30:16.284875+0000","last_undegraded":"2023-07-27T14:30:16.284875+0000","last_fullsized":"2023-07-27T14:30:16.284875+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284880+0000","last_change":"2023-07-27T14:30:16.282046+0000","last_active":"2023-07-27T14:30:16.284880+0000","last_peered":"2023-07-27T14:30:16.284880+0000","last_clean":"2023-07-27T14:30:16.284880+0000","last_became_active":"2023-07-27T14:30:16.281477+0000","last_became_peered":"2023-07-27T14:30:16.281477+0000","last_unstale":"2023-07-27T14:30:16.284880+0000","last_undegraded":"2023-07-27T14:30:16.284880+0000","last_fullsized":"2023-07-27T14:30:16.284880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284966+0000","last_change":"2023-07-27T14:30:15.806163+0000","last_active":"2023-07-27T14:30:16.284966+0000","last_peered":"2023-07-27T14:30:16.284966+0000","last_clean":"2023-07-27T14:30:16.284966+0000","last_became_active":"2023-07-27T14:30:15.805714+0000","last_became_peered":"2023-07-27T14:30:15.805714+0000","last_unstale":"2023-07-27T14:30:16.284966+0000","last_undegraded":"2023-07-27T14:30:16.284966+0000","last_fullsized":"2023-07-27T14:30:16.284966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278401+0000","last_change":"2023-07-27T14:30:16.271894+0000","last_active":"2023-07-27T14:30:16.278401+0000","last_peered":"2023-07-27T14:30:16.278401+0000","last_clean":"2023-07-27T14:30:16.278401+0000","last_became_active":"2023-07-27T14:30:16.271557+0000","last_became_peered":"2023-07-27T14:30:16.271557+0000","last_unstale":"2023-07-27T14:30:16.278401+0000","last_undegraded":"2023-07-27T14:30:16.278401+0000","last_fullsized":"2023-07-27T14:30:16.278401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.257404+0000","last_change":"2023-07-27T14:30:15.809142+0000","last_active":"2023-07-27T14:30:16.257404+0000","last_peered":"2023-07-27T14:30:16.257404+0000","last_clean":"2023-07-27T14:30:16.257404+0000","last_became_active":"2023-07-27T14:30:15.808493+0000","last_became_peered":"2023-07-27T14:30:15.808493+0000","last_unstale":"2023-07-27T14:30:16.257404+0000","last_undegraded":"2023-07-27T14:30:16.257404+0000","last_fullsized":"2023-07-27T14:30:16.257404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.269819+0000","last_change":"2023-07-27T14:30:16.269819+0000","last_active":"2023-07-27T14:30:16.269819+0000","last_peered":"2023-07-27T14:30:16.269819+0000","last_clean":"2023-07-27T14:30:16.269819+0000","last_became_active":"2023-07-27T14:30:16.269459+0000","last_became_peered":"2023-07-27T14:30:16.269459+0000","last_unstale":"2023-07-27T14:30:16.269819+0000","last_undegraded":"2023-07-27T14:30:16.269819+0000","last_fullsized":"2023-07-27T14:30:16.269819+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.263864+0000","last_change":"2023-07-27T14:30:15.808433+0000","last_active":"2023-07-27T14:30:16.263864+0000","last_peered":"2023-07-27T14:30:16.263864+0000","last_clean":"2023-07-27T14:30:16.263864+0000","last_became_active":"2023-07-27T14:30:15.808120+0000","last_became_peered":"2023-07-27T14:30:15.808120+0000","last_unstale":"2023-07-27T14:30:16.263864+0000","last_undegraded":"2023-07-27T14:30:16.263864+0000","last_fullsized":"2023-07-27T14:30:16.263864+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278085+0000","last_change":"2023-07-27T14:30:16.278085+0000","last_active":"2023-07-27T14:30:16.278085+0000","last_peered":"2023-07-27T14:30:16.278085+0000","last_clean":"2023-07-27T14:30:16.278085+0000","last_became_active":"2023-07-27T14:30:16.277819+0000","last_became_peered":"2023-07-27T14:30:16.277819+0000","last_unstale":"2023-07-27T14:30:16.278085+0000","last_undegraded":"2023-07-27T14:30:16.278085+0000","last_fullsized":"2023-07-27T14:30:16.278085+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285623+0000","last_change":"2023-07-27T14:30:15.807106+0000","last_active":"2023-07-27T14:30:16.285623+0000","last_peered":"2023-07-27T14:30:16.285623+0000","last_clean":"2023-07-27T14:30:16.285623+0000","last_became_active":"2023-07-27T14:30:15.806854+0000","last_became_peered":"2023-07-27T14:30:15.806854+0000","last_unstale":"2023-07-27T14:30:16.285623+0000","last_undegraded":"2023-07-27T14:30:16.285623+0000","last_fullsized":"2023-07-27T14:30:16.285623+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.273224+0000","last_change":"2023-07-27T14:30:16.273224+0000","last_active":"2023-07-27T14:30:16.273224+0000","last_peered":"2023-07-27T14:30:16.273224+0000","last_clean":"2023-07-27T14:30:16.273224+0000","last_became_active":"2023-07-27T14:30:16.272895+0000","last_became_peered":"2023-07-27T14:30:16.272895+0000","last_unstale":"2023-07-27T14:30:16.273224+0000","last_undegraded":"2023-07-27T14:30:16.273224+0000","last_fullsized":"2023-07-27T14:30:16.273224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.283789+0000","last_change":"2023-07-27T14:30:15.808663+0000","last_active":"2023-07-27T14:30:16.283789+0000","last_peered":"2023-07-27T14:30:16.283789+0000","last_clean":"2023-07-27T14:30:16.283789+0000","last_became_active":"2023-07-27T14:30:15.808376+0000","last_became_peered":"2023-07-27T14:30:15.808376+0000","last_unstale":"2023-07-27T14:30:16.283789+0000","last_undegraded":"2023-07-27T14:30:16.283789+0000","last_fullsized":"2023-07-27T14:30:16.283789+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.271888+0000","last_change":"2023-07-27T14:30:16.271888+0000","last_active":"2023-07-27T14:30:16.271888+0000","last_peered":"2023-07-27T14:30:16.271888+0000","last_clean":"2023-07-27T14:30:16.271888+0000","last_became_active":"2023-07-27T14:30:16.271614+0000","last_became_peered":"2023-07-27T14:30:16.271614+0000","last_unstale":"2023-07-27T14:30:16.271888+0000","last_undegraded":"2023-07-27T14:30:16.271888+0000","last_fullsized":"2023-07-27T14:30:16.271888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.256954+0000","last_change":"2023-07-27T14:30:15.805028+0000","last_active":"2023-07-27T14:30:16.256954+0000","last_peered":"2023-07-27T14:30:16.256954+0000","last_clean":"2023-07-27T14:30:16.256954+0000","last_became_active":"2023-07-27T14:30:15.804677+0000","last_became_peered":"2023-07-27T14:30:15.804677+0000","last_unstale":"2023-07-27T14:30:16.256954+0000","last_undegraded":"2023-07-27T14:30:16.256954+0000","last_fullsized":"2023-07-27T14:30:16.256954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278456+0000","last_change":"2023-07-27T14:30:16.275388+0000","last_active":"2023-07-27T14:30:16.278456+0000","last_peered":"2023-07-27T14:30:16.278456+0000","last_clean":"2023-07-27T14:30:16.278456+0000","last_became_active":"2023-07-27T14:30:16.275094+0000","last_became_peered":"2023-07-27T14:30:16.275094+0000","last_unstale":"2023-07-27T14:30:16.278456+0000","last_undegraded":"2023-07-27T14:30:16.278456+0000","last_fullsized":"2023-07-27T14:30:16.278456+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.811417+0000","last_change":"2023-07-27T14:30:15.808210+0000","last_active":"2023-07-27T14:30:15.811417+0000","last_peered":"2023-07-27T14:30:15.811417+0000","last_clean":"2023-07-27T14:30:15.811417+0000","last_became_active":"2023-07-27T14:30:15.807753+0000","last_became_peered":"2023-07-27T14:30:15.807753+0000","last_unstale":"2023-07-27T14:30:15.811417+0000","last_undegraded":"2023-07-27T14:30:15.811417+0000","last_fullsized":"2023-07-27T14:30:15.811417+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276523+0000","last_change":"2023-07-27T14:30:16.276523+0000","last_active":"2023-07-27T14:30:16.276523+0000","last_peered":"2023-07-27T14:30:16.276523+0000","last_clean":"2023-07-27T14:30:16.276523+0000","last_became_active":"2023-07-27T14:30:16.274971+0000","last_became_peered":"2023-07-27T14:30:16.274971+0000","last_unstale":"2023-07-27T14:30:16.276523+0000","last_undegraded":"2023-07-27T14:30:16.276523+0000","last_fullsized":"2023-07-27T14:30:16.276523+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.811355+0000","last_change":"2023-07-27T14:30:15.809265+0000","last_active":"2023-07-27T14:30:15.811355+0000","last_peered":"2023-07-27T14:30:15.811355+0000","last_clean":"2023-07-27T14:30:15.811355+0000","last_became_active":"2023-07-27T14:30:15.808757+0000","last_became_peered":"2023-07-27T14:30:15.808757+0000","last_unstale":"2023-07-27T14:30:15.811355+0000","last_undegraded":"2023-07-27T14:30:15.811355+0000","last_fullsized":"2023-07-27T14:30:15.811355+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265535+0000","last_change":"2023-07-27T14:30:16.265535+0000","last_active":"2023-07-27T14:30:16.265535+0000","last_peered":"2023-07-27T14:30:16.265535+0000","last_clean":"2023-07-27T14:30:16.265535+0000","last_became_active":"2023-07-27T14:30:16.265201+0000","last_became_peered":"2023-07-27T14:30:16.265201+0000","last_unstale":"2023-07-27T14:30:16.265535+0000","last_undegraded":"2023-07-27T14:30:16.265535+0000","last_fullsized":"2023-07-27T14:30:16.265535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.263602+0000","last_change":"2023-07-27T14:30:15.813827+0000","last_active":"2023-07-27T14:30:16.263602+0000","last_peered":"2023-07-27T14:30:16.263602+0000","last_clean":"2023-07-27T14:30:16.263602+0000","last_became_active":"2023-07-27T14:30:15.813485+0000","last_became_peered":"2023-07-27T14:30:15.813485+0000","last_unstale":"2023-07-27T14:30:16.263602+0000","last_undegraded":"2023-07-27T14:30:16.263602+0000","last_fullsized":"2023-07-27T14:30:16.263602+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.286677+0000","last_change":"2023-07-27T14:30:16.283780+0000","last_active":"2023-07-27T14:30:16.286677+0000","last_peered":"2023-07-27T14:30:16.286677+0000","last_clean":"2023-07-27T14:30:16.286677+0000","last_became_active":"2023-07-27T14:30:16.283426+0000","last_became_peered":"2023-07-27T14:30:16.283426+0000","last_unstale":"2023-07-27T14:30:16.286677+0000","last_undegraded":"2023-07-27T14:30:16.286677+0000","last_fullsized":"2023-07-27T14:30:16.286677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253361+0000","last_change":"2023-07-27T14:30:15.805414+0000","last_active":"2023-07-27T14:30:16.253361+0000","last_peered":"2023-07-27T14:30:16.253361+0000","last_clean":"2023-07-27T14:30:16.253361+0000","last_became_active":"2023-07-27T14:30:15.804536+0000","last_became_peered":"2023-07-27T14:30:15.804536+0000","last_unstale":"2023-07-27T14:30:16.253361+0000","last_undegraded":"2023-07-27T14:30:16.253361+0000","last_fullsized":"2023-07-27T14:30:16.253361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276317+0000","last_change":"2023-07-27T14:30:16.276317+0000","last_active":"2023-07-27T14:30:16.276317+0000","last_peered":"2023-07-27T14:30:16.276317+0000","last_clean":"2023-07-27T14:30:16.276317+0000","last_became_active":"2023-07-27T14:30:16.276032+0000","last_became_peered":"2023-07-27T14:30:16.276032+0000","last_unstale":"2023-07-27T14:30:16.276317+0000","last_undegraded":"2023-07-27T14:30:16.276317+0000","last_fullsized":"2023-07-27T14:30:16.276317+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253082+0000","last_change":"2023-07-27T14:30:15.807506+0000","last_active":"2023-07-27T14:30:16.253082+0000","last_peered":"2023-07-27T14:30:16.253082+0000","last_clean":"2023-07-27T14:30:16.253082+0000","last_became_active":"2023-07-27T14:30:15.807263+0000","last_became_peered":"2023-07-27T14:30:15.807263+0000","last_unstale":"2023-07-27T14:30:16.253082+0000","last_undegraded":"2023-07-27T14:30:16.253082+0000","last_fullsized":"2023-07-27T14:30:16.253082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.267347+0000","last_change":"2023-07-27T14:30:16.267347+0000","last_active":"2023-07-27T14:30:16.267347+0000","last_peered":"2023-07-27T14:30:16.267347+0000","last_clean":"2023-07-27T14:30:16.267347+0000","last_became_active":"2023-07-27T14:30:16.267102+0000","last_became_peered":"2023-07-27T14:30:16.267102+0000","last_unstale":"2023-07-27T14:30:16.267347+0000","last_undegraded":"2023-07-27T14:30:16.267347+0000","last_fullsized":"2023-07-27T14:30:16.267347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.806377+0000","last_change":"2023-07-27T14:30:15.802629+0000","last_active":"2023-07-27T14:30:15.806377+0000","last_peered":"2023-07-27T14:30:15.806377+0000","last_clean":"2023-07-27T14:30:15.806377+0000","last_became_active":"2023-07-27T14:30:15.802343+0000","last_became_peered":"2023-07-27T14:30:15.802343+0000","last_unstale":"2023-07-27T14:30:15.806377+0000","last_undegraded":"2023-07-27T14:30:15.806377+0000","last_fullsized":"2023-07-27T14:30:15.806377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285575+0000","last_change":"2023-07-27T14:30:16.281368+0000","last_active":"2023-07-27T14:30:16.285575+0000","last_peered":"2023-07-27T14:30:16.285575+0000","last_clean":"2023-07-27T14:30:16.285575+0000","last_became_active":"2023-07-27T14:30:16.280950+0000","last_became_peered":"2023-07-27T14:30:16.280950+0000","last_unstale":"2023-07-27T14:30:16.285575+0000","last_undegraded":"2023-07-27T14:30:16.285575+0000","last_fullsized":"2023-07-27T14:30:16.285575+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278839+0000","last_change":"2023-07-27T14:30:15.804001+0000","last_active":"2023-07-27T14:30:16.278839+0000","last_peered":"2023-07-27T14:30:16.278839+0000","last_clean":"2023-07-27T14:30:16.278839+0000","last_became_active":"2023-07-27T14:30:15.803666+0000","last_became_peered":"2023-07-27T14:30:15.803666+0000","last_unstale":"2023-07-27T14:30:16.278839+0000","last_undegraded":"2023-07-27T14:30:16.278839+0000","last_fullsized":"2023-07-27T14:30:16.278839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.783108+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:30:15.783108+0000","last_peered":"2023-07-27T14:30:15.783108+0000","last_clean":"2023-07-27T14:30:15.783108+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:30:15.783108+0000","last_undegraded":"2023-07-27T14:30:15.783108+0000","last_fullsized":"2023-07-27T14:30:15.783108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.275244+0000","last_change":"2023-07-27T14:30:16.275244+0000","last_active":"2023-07-27T14:30:16.275244+0000","last_peered":"2023-07-27T14:30:16.275244+0000","last_clean":"2023-07-27T14:30:16.275244+0000","last_became_active":"2023-07-27T14:30:16.274830+0000","last_became_peered":"2023-07-27T14:30:16.274830+0000","last_unstale":"2023-07-27T14:30:16.275244+0000","last_undegraded":"2023-07-27T14:30:16.275244+0000","last_fullsized":"2023-07-27T14:30:16.275244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.812272+0000","last_change":"2023-07-27T14:30:15.809541+0000","last_active":"2023-07-27T14:30:15.812272+0000","last_peered":"2023-07-27T14:30:15.812272+0000","last_clean":"2023-07-27T14:30:15.812272+0000","last_became_active":"2023-07-27T14:30:15.809282+0000","last_became_peered":"2023-07-27T14:30:15.809282+0000","last_unstale":"2023-07-27T14:30:15.812272+0000","last_undegraded":"2023-07-27T14:30:15.812272+0000","last_fullsized":"2023-07-27T14:30:15.812272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.257636+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:30:16.257636+0000","last_peered":"2023-07-27T14:30:16.257636+0000","last_clean":"2023-07-27T14:30:16.257636+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:30:16.257636+0000","last_undegraded":"2023-07-27T14:30:16.257636+0000","last_fullsized":"2023-07-27T14:30:16.257636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276387+0000","last_change":"2023-07-27T14:30:16.268663+0000","last_active":"2023-07-27T14:30:16.276387+0000","last_peered":"2023-07-27T14:30:16.276387+0000","last_clean":"2023-07-27T14:30:16.276387+0000","last_became_active":"2023-07-27T14:30:16.268371+0000","last_became_peered":"2023-07-27T14:30:16.268371+0000","last_unstale":"2023-07-27T14:30:16.276387+0000","last_undegraded":"2023-07-27T14:30:16.276387+0000","last_fullsized":"2023-07-27T14:30:16.276387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.257531+0000","last_change":"2023-07-27T14:30:15.808886+0000","last_active":"2023-07-27T14:30:16.257531+0000","last_peered":"2023-07-27T14:30:16.257531+0000","last_clean":"2023-07-27T14:30:16.257531+0000","last_became_active":"2023-07-27T14:30:15.808143+0000","last_became_peered":"2023-07-27T14:30:15.808143+0000","last_unstale":"2023-07-27T14:30:16.257531+0000","last_undegraded":"2023-07-27T14:30:16.257531+0000","last_fullsized":"2023-07-27T14:30:16.257531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.790774+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:30:15.790774+0000","last_peered":"2023-07-27T14:30:15.790774+0000","last_clean":"2023-07-27T14:30:15.790774+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:30:15.790774+0000","last_undegraded":"2023-07-27T14:30:15.790774+0000","last_fullsized":"2023-07-27T14:30:15.790774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266155+0000","last_change":"2023-07-27T14:30:16.266155+0000","last_active":"2023-07-27T14:30:16.266155+0000","last_peered":"2023-07-27T14:30:16.266155+0000","last_clean":"2023-07-27T14:30:16.266155+0000","last_became_active":"2023-07-27T14:30:16.265881+0000","last_became_peered":"2023-07-27T14:30:16.265881+0000","last_unstale":"2023-07-27T14:30:16.266155+0000","last_undegraded":"2023-07-27T14:30:16.266155+0000","last_fullsized":"2023-07-27T14:30:16.266155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.252447+0000","last_change":"2023-07-27T14:30:15.812293+0000","last_active":"2023-07-27T14:30:16.252447+0000","last_peered":"2023-07-27T14:30:16.252447+0000","last_clean":"2023-07-27T14:30:16.252447+0000","last_became_active":"2023-07-27T14:30:15.812019+0000","last_became_peered":"2023-07-27T14:30:15.812019+0000","last_unstale":"2023-07-27T14:30:16.252447+0000","last_undegraded":"2023-07-27T14:30:16.252447+0000","last_fullsized":"2023-07-27T14:30:16.252447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.257861+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:30:16.257861+0000","last_peered":"2023-07-27T14:30:16.257861+0000","last_clean":"2023-07-27T14:30:16.257861+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:30:16.257861+0000","last_undegraded":"2023-07-27T14:30:16.257861+0000","last_fullsized":"2023-07-27T14:30:16.257861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.262370+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:30:16.262370+0000","last_peered":"2023-07-27T14:30:16.262370+0000","last_clean":"2023-07-27T14:30:16.262370+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:30:16.262370+0000","last_undegraded":"2023-07-27T14:30:16.262370+0000","last_fullsized":"2023-07-27T14:30:16.262370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.268374+0000","last_change":"2023-07-27T14:30:16.268374+0000","last_active":"2023-07-27T14:30:16.268374+0000","last_peered":"2023-07-27T14:30:16.268374+0000","last_clean":"2023-07-27T14:30:16.268374+0000","last_became_active":"2023-07-27T14:30:16.267835+0000","last_became_peered":"2023-07-27T14:30:16.267835+0000","last_unstale":"2023-07-27T14:30:16.268374+0000","last_undegraded":"2023-07-27T14:30:16.268374+0000","last_fullsized":"2023-07-27T14:30:16.268374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.258081+0000","last_change":"2023-07-27T14:30:15.801609+0000","last_active":"2023-07-27T14:30:16.258081+0000","last_peered":"2023-07-27T14:30:16.258081+0000","last_clean":"2023-07-27T14:30:16.258081+0000","last_became_active":"2023-07-27T14:30:15.801326+0000","last_became_peered":"2023-07-27T14:30:15.801326+0000","last_unstale":"2023-07-27T14:30:16.258081+0000","last_undegraded":"2023-07-27T14:30:16.258081+0000","last_fullsized":"2023-07-27T14:30:16.258081+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.262453+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:30:16.262453+0000","last_peered":"2023-07-27T14:30:16.262453+0000","last_clean":"2023-07-27T14:30:16.262453+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:30:16.262453+0000","last_undegraded":"2023-07-27T14:30:16.262453+0000","last_fullsized":"2023-07-27T14:30:16.262453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.279321+0000","last_change":"2023-07-27T14:30:16.279321+0000","last_active":"2023-07-27T14:30:16.279321+0000","last_peered":"2023-07-27T14:30:16.279321+0000","last_clean":"2023-07-27T14:30:16.279321+0000","last_became_active":"2023-07-27T14:30:16.278885+0000","last_became_peered":"2023-07-27T14:30:16.278885+0000","last_unstale":"2023-07-27T14:30:16.279321+0000","last_undegraded":"2023-07-27T14:30:16.279321+0000","last_fullsized":"2023-07-27T14:30:16.279321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.282157+0000","last_change":"2023-07-27T14:30:15.814836+0000","last_active":"2023-07-27T14:30:16.282157+0000","last_peered":"2023-07-27T14:30:16.282157+0000","last_clean":"2023-07-27T14:30:16.282157+0000","last_became_active":"2023-07-27T14:30:15.814461+0000","last_became_peered":"2023-07-27T14:30:15.814461+0000","last_unstale":"2023-07-27T14:30:16.282157+0000","last_undegraded":"2023-07-27T14:30:16.282157+0000","last_fullsized":"2023-07-27T14:30:16.282157+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.264551+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:30:16.264551+0000","last_peered":"2023-07-27T14:30:16.264551+0000","last_clean":"2023-07-27T14:30:16.264551+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:30:16.264551+0000","last_undegraded":"2023-07-27T14:30:16.264551+0000","last_fullsized":"2023-07-27T14:30:16.264551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284975+0000","last_change":"2023-07-27T14:30:16.279322+0000","last_active":"2023-07-27T14:30:16.284975+0000","last_peered":"2023-07-27T14:30:16.284975+0000","last_clean":"2023-07-27T14:30:16.284975+0000","last_became_active":"2023-07-27T14:30:16.279028+0000","last_became_peered":"2023-07-27T14:30:16.279028+0000","last_unstale":"2023-07-27T14:30:16.284975+0000","last_undegraded":"2023-07-27T14:30:16.284975+0000","last_fullsized":"2023-07-27T14:30:16.284975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.264321+0000","last_change":"2023-07-27T14:30:15.812700+0000","last_active":"2023-07-27T14:30:16.264321+0000","last_peered":"2023-07-27T14:30:16.264321+0000","last_clean":"2023-07-27T14:30:16.264321+0000","last_became_active":"2023-07-27T14:30:15.812062+0000","last_became_peered":"2023-07-27T14:30:15.812062+0000","last_unstale":"2023-07-27T14:30:16.264321+0000","last_undegraded":"2023-07-27T14:30:16.264321+0000","last_fullsized":"2023-07-27T14:30:16.264321+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.782812+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:30:15.782812+0000","last_peered":"2023-07-27T14:30:15.782812+0000","last_clean":"2023-07-27T14:30:15.782812+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:30:15.782812+0000","last_undegraded":"2023-07-27T14:30:15.782812+0000","last_fullsized":"2023-07-27T14:30:15.782812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.272550+0000","last_change":"2023-07-27T14:30:16.272550+0000","last_active":"2023-07-27T14:30:16.272550+0000","last_peered":"2023-07-27T14:30:16.272550+0000","last_clean":"2023-07-27T14:30:16.272550+0000","last_became_active":"2023-07-27T14:30:16.272286+0000","last_became_peered":"2023-07-27T14:30:16.272286+0000","last_unstale":"2023-07-27T14:30:16.272550+0000","last_undegraded":"2023-07-27T14:30:16.272550+0000","last_fullsized":"2023-07-27T14:30:16.272550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253568+0000","last_change":"2023-07-27T14:30:15.810324+0000","last_active":"2023-07-27T14:30:16.253568+0000","last_peered":"2023-07-27T14:30:16.253568+0000","last_clean":"2023-07-27T14:30:16.253568+0000","last_became_active":"2023-07-27T14:30:15.809991+0000","last_became_peered":"2023-07-27T14:30:15.809991+0000","last_unstale":"2023-07-27T14:30:16.253568+0000","last_undegraded":"2023-07-27T14:30:16.253568+0000","last_fullsized":"2023-07-27T14:30:16.253568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.795326+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:30:15.795326+0000","last_peered":"2023-07-27T14:30:15.795326+0000","last_clean":"2023-07-27T14:30:15.795326+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:30:15.795326+0000","last_undegraded":"2023-07-27T14:30:15.795326+0000","last_fullsized":"2023-07-27T14:30:15.795326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7732,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":6912,"kb_avail":94364108,"statfs":{"total":96636764160,"available":96628846592,"internally_reserved":0,"allocated":831488,"data_stored":372893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7077888},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96599999999999997,"5min":1.133,"15min":1.133},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.68400000000000005},"min":{"1min":0.45900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0589999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.496,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84899999999999998,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86699999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.623},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.96299999999999997,"5min":1.119,"15min":1.119},"last":0.746}]},{"osd":3,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.70999999999999996},"min":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.70999999999999996},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79200000000000004,"5min":1.165,"15min":1.165},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86199999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.53700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85699999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.50600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.871,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.54400000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0029999999999999,"5min":1.038,"15min":1.038},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.57399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85199999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7392,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94364448,"statfs":{"total":96636764160,"available":96629194752,"internally_reserved":0,"allocated":811008,"data_stored":365207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60499999999999998,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.47099999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.872,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.46700000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.879,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64400000000000002,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.53200000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.48699999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93999999999999995,"5min":1.2,"15min":1.2},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.58099999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86699999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.57199999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.198,"15min":1.198},"last":0.87},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.59299999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0309999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7404,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94364436,"statfs":{"total":96636764160,"available":96629182464,"internally_reserved":0,"allocated":823296,"data_stored":365929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.5,"15min":0.55000000000000004},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65500000000000003,"5min":4.75,"15min":4.75},"last":0.433},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.63600000000000001,"15min":0.73399999999999999},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56499999999999995,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.55000000000000004,"15min":0.58799999999999997},"min":{"1min":0.35399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.59399999999999997,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52800000000000002,"15min":0.55300000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.57299999999999995,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.55300000000000005,"15min":0.59699999999999998},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64300000000000002,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.505}]},{"osd":4,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.71499999999999997,"15min":0.72799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83799999999999997,"5min":2.181,"15min":2.181},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.51700000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.88800000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.79900000000000004},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84299999999999997,"5min":2.149,"15min":2.149},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":2.052,"15min":2.052},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.83599999999999997,"15min":0.89700000000000002},"min":{"1min":0.503,"5min":0.502,"15min":0.502},"max":{"1min":0.88500000000000001,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90100000000000002,"5min":2.016,"15min":2.016},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84699999999999998,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98399999999999999,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.748}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7516,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":6720,"kb_avail":94364324,"statfs":{"total":96636764160,"available":96629067776,"internally_reserved":0,"allocated":806912,"data_stored":365173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6881280},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42599999999999999},"min":{"1min":0.28399999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.435}]},{"osd":2,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42599999999999999,"15min":0.432},"min":{"1min":0.30399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55100000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60299999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47899999999999998,"15min":0.48599999999999999},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98799999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0569999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.745,"15min":0.745},"min":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.079,"15min":1.079},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.018,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.749,"15min":0.755},"min":{"1min":0.54300000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.49099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":7360,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":815104,"data_stored":365797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7536640},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41299999999999998,"15min":0.42499999999999999},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53700000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60699999999999998,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.373}]},{"osd":1,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47799999999999998,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53600000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.38300000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.55400000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64300000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.60499999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89300000000000002,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98299999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93799999999999994,"5min":1.014,"15min":1.014},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94399999999999995,"5min":1.26,"15min":1.26},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.624},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94399999999999995,"5min":1.091,"15min":1.091},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98599999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.80000000000000004},"min":{"1min":0.61499999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95899999999999996,"5min":1.036,"15min":1.036},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8240,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":7424,"kb_avail":94363600,"statfs":{"total":96636764160,"available":96628326400,"internally_reserved":0,"allocated":827392,"data_stored":372501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7602176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48499999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.433},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44900000000000001},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44900000000000001,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59599999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.379},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49199999999999999,"15min":0.497},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.499}]},{"osd":4,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.53600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0449999999999999,"5min":1.149,"15min":1.149},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.53100000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94599999999999995,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98599999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.01,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73799999999999999,"15min":0.72999999999999998},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.298,"15min":1.298},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75700000000000001,"15min":0.75},"min":{"1min":0.56200000000000006,"5min":0.44,"15min":0.44},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.60999999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78600000000000003,"15min":0.77400000000000002},"min":{"1min":0.63100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.03,"5min":1.24,"15min":1.24},"last":0.91200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7332,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":94364508,"statfs":{"total":96636764160,"available":96629256192,"internally_reserved":0,"allocated":815104,"data_stored":365817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92700000000000005,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94999999999999996,"5min":2.419,"15min":2.419},"last":0.79900000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80500000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.752},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.47399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.876}]},{"osd":2,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.46500000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66600000000000004,"15min":0.67100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69899999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92900000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.72499999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63,"15min":0.627},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83699999999999997,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.98299999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.58999999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.048,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.57199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91800000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.046,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8880,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94362960,"statfs":{"total":96636764160,"available":96627671040,"internally_reserved":0,"allocated":827392,"data_stored":372791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88200000000000001,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.123,"5min":1.143,"15min":1.143},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.54500000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89300000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.496}]},{"osd":3,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84299999999999997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.89800000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.57899999999999996,"5min":0.379,"15min":0.379},"max":{"1min":0.89100000000000001,"5min":1.224,"15min":1.224},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.875,"5min":1.056,"15min":1.056},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.55400000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.94499999999999995,"5min":1.085,"15min":1.085},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.51300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.628},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84799999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:30:20.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:30:20.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.745+0000 7f243c7ff700 1 Processor -- start 2023-07-27T14:30:20.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.745+0000 7f243c7ff700 1 -- start start 2023-07-27T14:30:20.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.746+0000 7f243c7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2434153ec0 0x7f24340a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.746+0000 7f243c7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f24340aa050 0x7f24340640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.746+0000 7f243c7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24340aa4d0 con 0x7f24340aaa40 2023-07-27T14:30:20.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.746+0000 7f243c7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24340c05c0 con 0x7f2434153ec0 2023-07-27T14:30:20.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.746+0000 7f243c7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24340c1a60 con 0x7f24340aa050 2023-07-27T14:30:20.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243a59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2434153ec0 0x7f24340a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243a59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2434153ec0 0x7f24340a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59648/0 (socket says 172.21.15.115:59648) 2023-07-27T14:30:20.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243a59b700 1 -- 172.21.15.115:0/434486864 learned_addr learned my addr 172.21.15.115:0/434486864 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:20.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243ad9c700 1 --1- 172.21.15.115:0/434486864 >> v1:172.21.15.115:6789/0 conn(0x7f24340aaa40 0x7f2434157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33274/0 (socket says 172.21.15.115:33274) 2023-07-27T14:30:20.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243a59b700 1 -- 172.21.15.115:0/434486864 >> v2:172.21.15.159:3300/0 conn(0x7f24340aa050 msgr2=0x7f24340640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:20.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f2439d9a700 1 --2- 172.21.15.115:0/434486864 >> v2:172.21.15.159:3300/0 conn(0x7f24340aa050 0x7f24340640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243a59b700 1 --2- 172.21.15.115:0/434486864 >> v2:172.21.15.159:3300/0 conn(0x7f24340aa050 0x7f24340640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243a59b700 1 -- 172.21.15.115:0/434486864 >> v1:172.21.15.115:6789/0 conn(0x7f24340aaa40 legacy=0x7f2434157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f2439599700 1 -- 172.21.15.115:0/434486864 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879623743 0 0) 0x7f242c001490 con 0x7f24340aaa40 2023-07-27T14:30:20.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243a59b700 1 -- 172.21.15.115:0/434486864 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340bfc90 con 0x7f2434153ec0 2023-07-27T14:30:20.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f2439d9a700 1 --2- 172.21.15.115:0/434486864 >> v2:172.21.15.159:3300/0 conn(0x7f24340aa050 0x7f24340640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:20.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f243a59b700 1 --2- 172.21.15.115:0/434486864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f24340a9b60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f243406c0d0 tx=0x7f24300090f0).ready entity=mon.0 client_cookie=bdc3eeec9de9275a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:20.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f2439599700 1 -- 172.21.15.115:0/434486864 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000b600 con 0x7f2434153ec0 2023-07-27T14:30:20.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.747+0000 7f2439599700 1 -- 172.21.15.115:0/434486864 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243000b760 con 0x7f2434153ec0 2023-07-27T14:30:20.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f2439599700 1 -- 172.21.15.115:0/434486864 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000bae0 con 0x7f2434153ec0 2023-07-27T14:30:20.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f243c7ff700 1 -- 172.21.15.115:0/434486864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 msgr2=0x7f24340a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f243c7ff700 1 --2- 172.21.15.115:0/434486864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f24340a9b60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f243406c0d0 tx=0x7f24300090f0).stop 2023-07-27T14:30:20.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f243c7ff700 1 -- 172.21.15.115:0/434486864 shutdown_connections 2023-07-27T14:30:20.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f243c7ff700 1 --2- 172.21.15.115:0/434486864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f24340a9b60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f243c7ff700 1 --2- 172.21.15.115:0/434486864 >> v2:172.21.15.159:3300/0 conn(0x7f24340aa050 0x7f24340640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f243c7ff700 1 -- 172.21.15.115:0/434486864 >> 172.21.15.115:0/434486864 conn(0x7f24340cb610 msgr2=0x7f24340c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:20.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f243c7ff700 1 -- 172.21.15.115:0/434486864 shutdown_connections 2023-07-27T14:30:20.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.748+0000 7f243c7ff700 1 -- 172.21.15.115:0/434486864 wait complete. 2023-07-27T14:30:20.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.750+0000 7f243c7ff700 1 Processor -- start 2023-07-27T14:30:20.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.750+0000 7f243c7ff700 1 -- start start 2023-07-27T14:30:20.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243c7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24340aa050 0x7f24340af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243c7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24340aaa40 0x7f24341510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243c7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f2434152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243c7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340aee10 con 0x7f2434153ec0 2023-07-27T14:30:20.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243c7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340c2cd0 con 0x7f24340aa050 2023-07-27T14:30:20.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243c7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340af580 con 0x7f24340aaa40 2023-07-27T14:30:20.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f2434152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f2434152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59658/0 (socket says 172.21.15.115:59658) 2023-07-27T14:30:20.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 -- 172.21.15.115:0/2756843028 learned_addr learned my addr 172.21.15.115:0/2756843028 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:20.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243a59b700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24340aa050 0x7f24340af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f2439d9a700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24340aaa40 0x7f24341510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 -- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24340aaa40 msgr2=0x7f24341510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24340aaa40 0x7f24341510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 -- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24340aa050 msgr2=0x7f24340af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24340aa050 0x7f24340af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 -- 172.21.15.115:0/2756843028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430009370 con 0x7f2434153ec0 2023-07-27T14:30:20.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f2439d9a700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24340aaa40 0x7f24341510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:20.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.751+0000 7f243ad9c700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f2434152be0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f242c002230 tx=0x7f242c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:20.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.752+0000 7f242a7fc700 1 -- 172.21.15.115:0/2756843028 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c005c70 con 0x7f2434153ec0 2023-07-27T14:30:20.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.752+0000 7f242a7fc700 1 -- 172.21.15.115:0/2756843028 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c005dd0 con 0x7f2434153ec0 2023-07-27T14:30:20.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.752+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24340c20c0 con 0x7f2434153ec0 2023-07-27T14:30:20.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.752+0000 7f242a7fc700 1 -- 172.21.15.115:0/2756843028 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c007360 con 0x7f2434153ec0 2023-07-27T14:30:20.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.752+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24340c2680 con 0x7f2434153ec0 2023-07-27T14:30:20.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.753+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24340c3060 con 0x7f2434153ec0 2023-07-27T14:30:20.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.754+0000 7f242a7fc700 1 -- 172.21.15.115:0/2756843028 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f242c010030 con 0x7f2434153ec0 2023-07-27T14:30:20.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.754+0000 7f242a7fc700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241805f030 0x7f24180614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:20.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.754+0000 7f242a7fc700 1 -- 172.21.15.115:0/2756843028 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f242c079cf0 con 0x7f2434153ec0 2023-07-27T14:30:20.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.755+0000 7f243a59b700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241805f030 0x7f24180614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:20.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.755+0000 7f243a59b700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241805f030 0x7f24180614f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f2430009130 tx=0x7f2430017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:20.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.758+0000 7f242a7fc700 1 -- 172.21.15.115:0/2756843028 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f24340c3060 con 0x7f2434153ec0 2023-07-27T14:30:20.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.923+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24340aa4d0 con 0x7f241805f030 2023-07-27T14:30:20.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.933+0000 7f242a7fc700 1 -- 172.21.15.115:0/2756843028 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361308 (secure 0 0 0) 0x7f24340aa4d0 con 0x7f241805f030 2023-07-27T14:30:20.965 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:20.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.937+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241805f030 msgr2=0x7f24180614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.937+0000 7f243c7ff700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241805f030 0x7f24180614f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f2430009130 tx=0x7f2430017000).stop 2023-07-27T14:30:20.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.937+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 msgr2=0x7f2434152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:20.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.937+0000 7f243c7ff700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f2434152be0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f242c002230 tx=0x7f242c007db0).stop 2023-07-27T14:30:20.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.938+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 shutdown_connections 2023-07-27T14:30:20.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.938+0000 7f243c7ff700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241805f030 0x7f24180614f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.938+0000 7f243c7ff700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434153ec0 0x7f2434152be0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.938+0000 7f243c7ff700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24340aa050 0x7f24340af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.938+0000 7f243c7ff700 1 --2- 172.21.15.115:0/2756843028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24340aaa40 0x7f24341510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:20.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.938+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 >> 172.21.15.115:0/2756843028 conn(0x7f24340cb610 msgr2=0x7f24340ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:20.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.938+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 shutdown_connections 2023-07-27T14:30:20.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:20.938+0000 7f243c7ff700 1 -- 172.21.15.115:0/2756843028 wait complete. 2023-07-27T14:30:20.969 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:30:20.984 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2023-07-27T14:30:19.481134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":62660,"kb_used_data":6404,"kb_used_omap":0,"kb_used_meta":56192,"kb_avail":754912060,"statfs":{"total":773094113280,"available":773029949440,"internally_reserved":0,"allocated":6557696,"data_stored":2946108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":57540608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3251050,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-41,"num_read_kb":-24613,"num_write":-670,"num_write_kb":-232650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-6291526,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.269630"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284532+0000","last_change":"2023-07-27T14:30:16.274465+0000","last_active":"2023-07-27T14:30:16.284532+0000","last_peered":"2023-07-27T14:30:16.284532+0000","last_clean":"2023-07-27T14:30:16.284532+0000","last_became_active":"2023-07-27T14:30:16.274022+0000","last_became_peered":"2023-07-27T14:30:16.274022+0000","last_unstale":"2023-07-27T14:30:16.284532+0000","last_undegraded":"2023-07-27T14:30:16.284532+0000","last_fullsized":"2023-07-27T14:30:16.284532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"67'3","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.270471+0000","last_change":"2023-07-27T14:30:15.803538+0000","last_active":"2023-07-27T14:30:16.270471+0000","last_peered":"2023-07-27T14:30:16.270471+0000","last_clean":"2023-07-27T14:30:16.270471+0000","last_became_active":"2023-07-27T14:30:15.803246+0000","last_became_peered":"2023-07-27T14:30:15.803246+0000","last_unstale":"2023-07-27T14:30:16.270471+0000","last_undegraded":"2023-07-27T14:30:16.270471+0000","last_fullsized":"2023-07-27T14:30:16.270471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285624+0000","last_change":"2023-07-27T14:30:16.280805+0000","last_active":"2023-07-27T14:30:16.285624+0000","last_peered":"2023-07-27T14:30:16.285624+0000","last_clean":"2023-07-27T14:30:16.285624+0000","last_became_active":"2023-07-27T14:30:16.278198+0000","last_became_peered":"2023-07-27T14:30:16.278198+0000","last_unstale":"2023-07-27T14:30:16.285624+0000","last_undegraded":"2023-07-27T14:30:16.285624+0000","last_fullsized":"2023-07-27T14:30:16.285624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.252537+0000","last_change":"2023-07-27T14:30:15.801009+0000","last_active":"2023-07-27T14:30:16.252537+0000","last_peered":"2023-07-27T14:30:16.252537+0000","last_clean":"2023-07-27T14:30:16.252537+0000","last_became_active":"2023-07-27T14:30:15.800691+0000","last_became_peered":"2023-07-27T14:30:15.800691+0000","last_unstale":"2023-07-27T14:30:16.252537+0000","last_undegraded":"2023-07-27T14:30:16.252537+0000","last_fullsized":"2023-07-27T14:30:16.252537+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.269134+0000","last_change":"2023-07-27T14:30:16.269134+0000","last_active":"2023-07-27T14:30:16.269134+0000","last_peered":"2023-07-27T14:30:16.269134+0000","last_clean":"2023-07-27T14:30:16.269134+0000","last_became_active":"2023-07-27T14:30:16.268750+0000","last_became_peered":"2023-07-27T14:30:16.268750+0000","last_unstale":"2023-07-27T14:30:16.269134+0000","last_undegraded":"2023-07-27T14:30:16.269134+0000","last_fullsized":"2023-07-27T14:30:16.269134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.264200+0000","last_change":"2023-07-27T14:30:15.814614+0000","last_active":"2023-07-27T14:30:16.264200+0000","last_peered":"2023-07-27T14:30:16.264200+0000","last_clean":"2023-07-27T14:30:16.264200+0000","last_became_active":"2023-07-27T14:30:15.814333+0000","last_became_peered":"2023-07-27T14:30:15.814333+0000","last_unstale":"2023-07-27T14:30:16.264200+0000","last_undegraded":"2023-07-27T14:30:16.264200+0000","last_fullsized":"2023-07-27T14:30:16.264200+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.277542+0000","last_change":"2023-07-27T14:30:16.277542+0000","last_active":"2023-07-27T14:30:16.277542+0000","last_peered":"2023-07-27T14:30:16.277542+0000","last_clean":"2023-07-27T14:30:16.277542+0000","last_became_active":"2023-07-27T14:30:16.277268+0000","last_became_peered":"2023-07-27T14:30:16.277268+0000","last_unstale":"2023-07-27T14:30:16.277542+0000","last_undegraded":"2023-07-27T14:30:16.277542+0000","last_fullsized":"2023-07-27T14:30:16.277542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278330+0000","last_change":"2023-07-27T14:30:15.805876+0000","last_active":"2023-07-27T14:30:16.278330+0000","last_peered":"2023-07-27T14:30:16.278330+0000","last_clean":"2023-07-27T14:30:16.278330+0000","last_became_active":"2023-07-27T14:30:15.805586+0000","last_became_peered":"2023-07-27T14:30:15.805586+0000","last_unstale":"2023-07-27T14:30:16.278330+0000","last_undegraded":"2023-07-27T14:30:16.278330+0000","last_fullsized":"2023-07-27T14:30:16.278330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281767+0000","last_change":"2023-07-27T14:30:16.276620+0000","last_active":"2023-07-27T14:30:16.281767+0000","last_peered":"2023-07-27T14:30:16.281767+0000","last_clean":"2023-07-27T14:30:16.281767+0000","last_became_active":"2023-07-27T14:30:16.276109+0000","last_became_peered":"2023-07-27T14:30:16.276109+0000","last_unstale":"2023-07-27T14:30:16.281767+0000","last_undegraded":"2023-07-27T14:30:16.281767+0000","last_fullsized":"2023-07-27T14:30:16.281767+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.255152+0000","last_change":"2023-07-27T14:30:15.808607+0000","last_active":"2023-07-27T14:30:16.255152+0000","last_peered":"2023-07-27T14:30:16.255152+0000","last_clean":"2023-07-27T14:30:16.255152+0000","last_became_active":"2023-07-27T14:30:15.808356+0000","last_became_peered":"2023-07-27T14:30:15.808356+0000","last_unstale":"2023-07-27T14:30:16.255152+0000","last_undegraded":"2023-07-27T14:30:16.255152+0000","last_fullsized":"2023-07-27T14:30:16.255152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281865+0000","last_change":"2023-07-27T14:30:16.281865+0000","last_active":"2023-07-27T14:30:16.281865+0000","last_peered":"2023-07-27T14:30:16.281865+0000","last_clean":"2023-07-27T14:30:16.281865+0000","last_became_active":"2023-07-27T14:30:16.281510+0000","last_became_peered":"2023-07-27T14:30:16.281510+0000","last_unstale":"2023-07-27T14:30:16.281865+0000","last_undegraded":"2023-07-27T14:30:16.281865+0000","last_fullsized":"2023-07-27T14:30:16.281865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.260430+0000","last_change":"2023-07-27T14:30:15.804145+0000","last_active":"2023-07-27T14:30:16.260430+0000","last_peered":"2023-07-27T14:30:16.260430+0000","last_clean":"2023-07-27T14:30:16.260430+0000","last_became_active":"2023-07-27T14:30:15.803889+0000","last_became_peered":"2023-07-27T14:30:15.803889+0000","last_unstale":"2023-07-27T14:30:16.260430+0000","last_undegraded":"2023-07-27T14:30:16.260430+0000","last_fullsized":"2023-07-27T14:30:16.260430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281207+0000","last_change":"2023-07-27T14:30:16.281207+0000","last_active":"2023-07-27T14:30:16.281207+0000","last_peered":"2023-07-27T14:30:16.281207+0000","last_clean":"2023-07-27T14:30:16.281207+0000","last_became_active":"2023-07-27T14:30:16.280842+0000","last_became_peered":"2023-07-27T14:30:16.280842+0000","last_unstale":"2023-07-27T14:30:16.281207+0000","last_undegraded":"2023-07-27T14:30:16.281207+0000","last_fullsized":"2023-07-27T14:30:16.281207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265867+0000","last_change":"2023-07-27T14:30:15.805734+0000","last_active":"2023-07-27T14:30:16.265867+0000","last_peered":"2023-07-27T14:30:16.265867+0000","last_clean":"2023-07-27T14:30:16.265867+0000","last_became_active":"2023-07-27T14:30:15.805416+0000","last_became_peered":"2023-07-27T14:30:15.805416+0000","last_unstale":"2023-07-27T14:30:16.265867+0000","last_undegraded":"2023-07-27T14:30:16.265867+0000","last_fullsized":"2023-07-27T14:30:16.265867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.272948+0000","last_change":"2023-07-27T14:30:16.272948+0000","last_active":"2023-07-27T14:30:16.272948+0000","last_peered":"2023-07-27T14:30:16.272948+0000","last_clean":"2023-07-27T14:30:16.272948+0000","last_became_active":"2023-07-27T14:30:16.268795+0000","last_became_peered":"2023-07-27T14:30:16.268795+0000","last_unstale":"2023-07-27T14:30:16.272948+0000","last_undegraded":"2023-07-27T14:30:16.272948+0000","last_fullsized":"2023-07-27T14:30:16.272948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.252415+0000","last_change":"2023-07-27T14:30:15.814539+0000","last_active":"2023-07-27T14:30:16.252415+0000","last_peered":"2023-07-27T14:30:16.252415+0000","last_clean":"2023-07-27T14:30:16.252415+0000","last_became_active":"2023-07-27T14:30:15.814146+0000","last_became_peered":"2023-07-27T14:30:15.814146+0000","last_unstale":"2023-07-27T14:30:16.252415+0000","last_undegraded":"2023-07-27T14:30:16.252415+0000","last_fullsized":"2023-07-27T14:30:16.252415+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284448+0000","last_change":"2023-07-27T14:30:16.278137+0000","last_active":"2023-07-27T14:30:16.284448+0000","last_peered":"2023-07-27T14:30:16.284448+0000","last_clean":"2023-07-27T14:30:16.284448+0000","last_became_active":"2023-07-27T14:30:16.277840+0000","last_became_peered":"2023-07-27T14:30:16.277840+0000","last_unstale":"2023-07-27T14:30:16.284448+0000","last_undegraded":"2023-07-27T14:30:16.284448+0000","last_fullsized":"2023-07-27T14:30:16.284448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.271279+0000","last_change":"2023-07-27T14:30:15.804954+0000","last_active":"2023-07-27T14:30:16.271279+0000","last_peered":"2023-07-27T14:30:16.271279+0000","last_clean":"2023-07-27T14:30:16.271279+0000","last_became_active":"2023-07-27T14:30:15.804650+0000","last_became_peered":"2023-07-27T14:30:15.804650+0000","last_unstale":"2023-07-27T14:30:16.271279+0000","last_undegraded":"2023-07-27T14:30:16.271279+0000","last_fullsized":"2023-07-27T14:30:16.271279+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284464+0000","last_change":"2023-07-27T14:30:16.274313+0000","last_active":"2023-07-27T14:30:16.284464+0000","last_peered":"2023-07-27T14:30:16.284464+0000","last_clean":"2023-07-27T14:30:16.284464+0000","last_became_active":"2023-07-27T14:30:16.273569+0000","last_became_peered":"2023-07-27T14:30:16.273569+0000","last_unstale":"2023-07-27T14:30:16.284464+0000","last_undegraded":"2023-07-27T14:30:16.284464+0000","last_fullsized":"2023-07-27T14:30:16.284464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.806339+0000","last_change":"2023-07-27T14:30:15.803160+0000","last_active":"2023-07-27T14:30:15.806339+0000","last_peered":"2023-07-27T14:30:15.806339+0000","last_clean":"2023-07-27T14:30:15.806339+0000","last_became_active":"2023-07-27T14:30:15.802540+0000","last_became_peered":"2023-07-27T14:30:15.802540+0000","last_unstale":"2023-07-27T14:30:15.806339+0000","last_undegraded":"2023-07-27T14:30:15.806339+0000","last_fullsized":"2023-07-27T14:30:15.806339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285370+0000","last_change":"2023-07-27T14:30:16.280410+0000","last_active":"2023-07-27T14:30:16.285370+0000","last_peered":"2023-07-27T14:30:16.285370+0000","last_clean":"2023-07-27T14:30:16.285370+0000","last_became_active":"2023-07-27T14:30:16.280078+0000","last_became_peered":"2023-07-27T14:30:16.280078+0000","last_unstale":"2023-07-27T14:30:16.285370+0000","last_undegraded":"2023-07-27T14:30:16.285370+0000","last_fullsized":"2023-07-27T14:30:16.285370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.799950+0000","last_change":"2023-07-27T14:30:15.798857+0000","last_active":"2023-07-27T14:30:15.799950+0000","last_peered":"2023-07-27T14:30:15.799950+0000","last_clean":"2023-07-27T14:30:15.799950+0000","last_became_active":"2023-07-27T14:30:15.798550+0000","last_became_peered":"2023-07-27T14:30:15.798550+0000","last_unstale":"2023-07-27T14:30:15.799950+0000","last_undegraded":"2023-07-27T14:30:15.799950+0000","last_fullsized":"2023-07-27T14:30:15.799950+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285973+0000","last_change":"2023-07-27T14:30:16.282948+0000","last_active":"2023-07-27T14:30:16.285973+0000","last_peered":"2023-07-27T14:30:16.285973+0000","last_clean":"2023-07-27T14:30:16.285973+0000","last_became_active":"2023-07-27T14:30:16.282161+0000","last_became_peered":"2023-07-27T14:30:16.282161+0000","last_unstale":"2023-07-27T14:30:16.285973+0000","last_undegraded":"2023-07-27T14:30:16.285973+0000","last_fullsized":"2023-07-27T14:30:16.285973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.287306+0000","last_change":"2023-07-27T14:30:15.808668+0000","last_active":"2023-07-27T14:30:16.287306+0000","last_peered":"2023-07-27T14:30:16.287306+0000","last_clean":"2023-07-27T14:30:16.287306+0000","last_became_active":"2023-07-27T14:30:15.808361+0000","last_became_peered":"2023-07-27T14:30:15.808361+0000","last_unstale":"2023-07-27T14:30:16.287306+0000","last_undegraded":"2023-07-27T14:30:16.287306+0000","last_fullsized":"2023-07-27T14:30:16.287306+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.267845+0000","last_change":"2023-07-27T14:30:16.267845+0000","last_active":"2023-07-27T14:30:16.267845+0000","last_peered":"2023-07-27T14:30:16.267845+0000","last_clean":"2023-07-27T14:30:16.267845+0000","last_became_active":"2023-07-27T14:30:16.267604+0000","last_became_peered":"2023-07-27T14:30:16.267604+0000","last_unstale":"2023-07-27T14:30:16.267845+0000","last_undegraded":"2023-07-27T14:30:16.267845+0000","last_fullsized":"2023-07-27T14:30:16.267845+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.258387+0000","last_change":"2023-07-27T14:30:15.804089+0000","last_active":"2023-07-27T14:30:16.258387+0000","last_peered":"2023-07-27T14:30:16.258387+0000","last_clean":"2023-07-27T14:30:16.258387+0000","last_became_active":"2023-07-27T14:30:15.803504+0000","last_became_peered":"2023-07-27T14:30:15.803504+0000","last_unstale":"2023-07-27T14:30:16.258387+0000","last_undegraded":"2023-07-27T14:30:16.258387+0000","last_fullsized":"2023-07-27T14:30:16.258387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285386+0000","last_change":"2023-07-27T14:30:16.278312+0000","last_active":"2023-07-27T14:30:16.285386+0000","last_peered":"2023-07-27T14:30:16.285386+0000","last_clean":"2023-07-27T14:30:16.285386+0000","last_became_active":"2023-07-27T14:30:16.277979+0000","last_became_peered":"2023-07-27T14:30:16.277979+0000","last_unstale":"2023-07-27T14:30:16.285386+0000","last_undegraded":"2023-07-27T14:30:16.285386+0000","last_fullsized":"2023-07-27T14:30:16.285386+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266251+0000","last_change":"2023-07-27T14:30:15.799924+0000","last_active":"2023-07-27T14:30:16.266251+0000","last_peered":"2023-07-27T14:30:16.266251+0000","last_clean":"2023-07-27T14:30:16.266251+0000","last_became_active":"2023-07-27T14:30:15.799631+0000","last_became_peered":"2023-07-27T14:30:15.799631+0000","last_unstale":"2023-07-27T14:30:16.266251+0000","last_undegraded":"2023-07-27T14:30:16.266251+0000","last_fullsized":"2023-07-27T14:30:16.266251+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285631+0000","last_change":"2023-07-27T14:30:16.278640+0000","last_active":"2023-07-27T14:30:16.285631+0000","last_peered":"2023-07-27T14:30:16.285631+0000","last_clean":"2023-07-27T14:30:16.285631+0000","last_became_active":"2023-07-27T14:30:16.278237+0000","last_became_peered":"2023-07-27T14:30:16.278237+0000","last_unstale":"2023-07-27T14:30:16.285631+0000","last_undegraded":"2023-07-27T14:30:16.285631+0000","last_fullsized":"2023-07-27T14:30:16.285631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266730+0000","last_change":"2023-07-27T14:30:15.794351+0000","last_active":"2023-07-27T14:30:16.266730+0000","last_peered":"2023-07-27T14:30:16.266730+0000","last_clean":"2023-07-27T14:30:16.266730+0000","last_became_active":"2023-07-27T14:30:15.793946+0000","last_became_peered":"2023-07-27T14:30:15.793946+0000","last_unstale":"2023-07-27T14:30:16.266730+0000","last_undegraded":"2023-07-27T14:30:16.266730+0000","last_fullsized":"2023-07-27T14:30:16.266730+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278483+0000","last_change":"2023-07-27T14:30:16.271341+0000","last_active":"2023-07-27T14:30:16.278483+0000","last_peered":"2023-07-27T14:30:16.278483+0000","last_clean":"2023-07-27T14:30:16.278483+0000","last_became_active":"2023-07-27T14:30:16.270753+0000","last_became_peered":"2023-07-27T14:30:16.270753+0000","last_unstale":"2023-07-27T14:30:16.278483+0000","last_undegraded":"2023-07-27T14:30:16.278483+0000","last_fullsized":"2023-07-27T14:30:16.278483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"67'4","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.282926+0000","last_change":"2023-07-27T14:30:15.801505+0000","last_active":"2023-07-27T14:30:16.282926+0000","last_peered":"2023-07-27T14:30:16.282926+0000","last_clean":"2023-07-27T14:30:16.282926+0000","last_became_active":"2023-07-27T14:30:15.801217+0000","last_became_peered":"2023-07-27T14:30:15.801217+0000","last_unstale":"2023-07-27T14:30:16.282926+0000","last_undegraded":"2023-07-27T14:30:16.282926+0000","last_fullsized":"2023-07-27T14:30:16.282926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266878+0000","last_change":"2023-07-27T14:30:16.263983+0000","last_active":"2023-07-27T14:30:16.266878+0000","last_peered":"2023-07-27T14:30:16.266878+0000","last_clean":"2023-07-27T14:30:16.266878+0000","last_became_active":"2023-07-27T14:30:16.263649+0000","last_became_peered":"2023-07-27T14:30:16.263649+0000","last_unstale":"2023-07-27T14:30:16.266878+0000","last_undegraded":"2023-07-27T14:30:16.266878+0000","last_fullsized":"2023-07-27T14:30:16.266878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253736+0000","last_change":"2023-07-27T14:30:15.806001+0000","last_active":"2023-07-27T14:30:16.253736+0000","last_peered":"2023-07-27T14:30:16.253736+0000","last_clean":"2023-07-27T14:30:16.253736+0000","last_became_active":"2023-07-27T14:30:15.805749+0000","last_became_peered":"2023-07-27T14:30:15.805749+0000","last_unstale":"2023-07-27T14:30:16.253736+0000","last_undegraded":"2023-07-27T14:30:16.253736+0000","last_fullsized":"2023-07-27T14:30:16.253736+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.268666+0000","last_change":"2023-07-27T14:30:16.268666+0000","last_active":"2023-07-27T14:30:16.268666+0000","last_peered":"2023-07-27T14:30:16.268666+0000","last_clean":"2023-07-27T14:30:16.268666+0000","last_became_active":"2023-07-27T14:30:16.268350+0000","last_became_peered":"2023-07-27T14:30:16.268350+0000","last_unstale":"2023-07-27T14:30:16.268666+0000","last_undegraded":"2023-07-27T14:30:16.268666+0000","last_fullsized":"2023-07-27T14:30:16.268666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.262886+0000","last_change":"2023-07-27T14:30:15.809365+0000","last_active":"2023-07-27T14:30:16.262886+0000","last_peered":"2023-07-27T14:30:16.262886+0000","last_clean":"2023-07-27T14:30:16.262886+0000","last_became_active":"2023-07-27T14:30:15.809082+0000","last_became_peered":"2023-07-27T14:30:15.809082+0000","last_unstale":"2023-07-27T14:30:16.262886+0000","last_undegraded":"2023-07-27T14:30:16.262886+0000","last_fullsized":"2023-07-27T14:30:16.262886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.280254+0000","last_change":"2023-07-27T14:30:16.273966+0000","last_active":"2023-07-27T14:30:16.280254+0000","last_peered":"2023-07-27T14:30:16.280254+0000","last_clean":"2023-07-27T14:30:16.280254+0000","last_became_active":"2023-07-27T14:30:16.273661+0000","last_became_peered":"2023-07-27T14:30:16.273661+0000","last_unstale":"2023-07-27T14:30:16.280254+0000","last_undegraded":"2023-07-27T14:30:16.280254+0000","last_fullsized":"2023-07-27T14:30:16.280254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.255652+0000","last_change":"2023-07-27T14:30:15.800917+0000","last_active":"2023-07-27T14:30:16.255652+0000","last_peered":"2023-07-27T14:30:16.255652+0000","last_clean":"2023-07-27T14:30:16.255652+0000","last_became_active":"2023-07-27T14:30:15.800624+0000","last_became_peered":"2023-07-27T14:30:15.800624+0000","last_unstale":"2023-07-27T14:30:16.255652+0000","last_undegraded":"2023-07-27T14:30:16.255652+0000","last_fullsized":"2023-07-27T14:30:16.255652+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.275984+0000","last_change":"2023-07-27T14:30:16.275984+0000","last_active":"2023-07-27T14:30:16.275984+0000","last_peered":"2023-07-27T14:30:16.275984+0000","last_clean":"2023-07-27T14:30:16.275984+0000","last_became_active":"2023-07-27T14:30:16.275718+0000","last_became_peered":"2023-07-27T14:30:16.275718+0000","last_unstale":"2023-07-27T14:30:16.275984+0000","last_undegraded":"2023-07-27T14:30:16.275984+0000","last_fullsized":"2023-07-27T14:30:16.275984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253469+0000","last_change":"2023-07-27T14:30:15.812395+0000","last_active":"2023-07-27T14:30:16.253469+0000","last_peered":"2023-07-27T14:30:16.253469+0000","last_clean":"2023-07-27T14:30:16.253469+0000","last_became_active":"2023-07-27T14:30:15.811881+0000","last_became_peered":"2023-07-27T14:30:15.811881+0000","last_unstale":"2023-07-27T14:30:16.253469+0000","last_undegraded":"2023-07-27T14:30:16.253469+0000","last_fullsized":"2023-07-27T14:30:16.253469+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285308+0000","last_change":"2023-07-27T14:30:16.277625+0000","last_active":"2023-07-27T14:30:16.285308+0000","last_peered":"2023-07-27T14:30:16.285308+0000","last_clean":"2023-07-27T14:30:16.285308+0000","last_became_active":"2023-07-27T14:30:16.277289+0000","last_became_peered":"2023-07-27T14:30:16.277289+0000","last_unstale":"2023-07-27T14:30:16.285308+0000","last_undegraded":"2023-07-27T14:30:16.285308+0000","last_fullsized":"2023-07-27T14:30:16.285308+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.283954+0000","last_change":"2023-07-27T14:30:15.805990+0000","last_active":"2023-07-27T14:30:16.283954+0000","last_peered":"2023-07-27T14:30:16.283954+0000","last_clean":"2023-07-27T14:30:16.283954+0000","last_became_active":"2023-07-27T14:30:15.805370+0000","last_became_peered":"2023-07-27T14:30:15.805370+0000","last_unstale":"2023-07-27T14:30:16.283954+0000","last_undegraded":"2023-07-27T14:30:16.283954+0000","last_fullsized":"2023-07-27T14:30:16.283954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281892+0000","last_change":"2023-07-27T14:30:16.280894+0000","last_active":"2023-07-27T14:30:16.281892+0000","last_peered":"2023-07-27T14:30:16.281892+0000","last_clean":"2023-07-27T14:30:16.281892+0000","last_became_active":"2023-07-27T14:30:16.280614+0000","last_became_peered":"2023-07-27T14:30:16.280614+0000","last_unstale":"2023-07-27T14:30:16.281892+0000","last_undegraded":"2023-07-27T14:30:16.281892+0000","last_fullsized":"2023-07-27T14:30:16.281892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253179+0000","last_change":"2023-07-27T14:30:15.805138+0000","last_active":"2023-07-27T14:30:16.253179+0000","last_peered":"2023-07-27T14:30:16.253179+0000","last_clean":"2023-07-27T14:30:16.253179+0000","last_became_active":"2023-07-27T14:30:15.804482+0000","last_became_peered":"2023-07-27T14:30:15.804482+0000","last_unstale":"2023-07-27T14:30:16.253179+0000","last_undegraded":"2023-07-27T14:30:16.253179+0000","last_fullsized":"2023-07-27T14:30:16.253179+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.281939+0000","last_change":"2023-07-27T14:30:16.280915+0000","last_active":"2023-07-27T14:30:16.281939+0000","last_peered":"2023-07-27T14:30:16.281939+0000","last_clean":"2023-07-27T14:30:16.281939+0000","last_became_active":"2023-07-27T14:30:16.280656+0000","last_became_peered":"2023-07-27T14:30:16.280656+0000","last_unstale":"2023-07-27T14:30:16.281939+0000","last_undegraded":"2023-07-27T14:30:16.281939+0000","last_fullsized":"2023-07-27T14:30:16.281939+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.263700+0000","last_change":"2023-07-27T14:30:15.808351+0000","last_active":"2023-07-27T14:30:16.263700+0000","last_peered":"2023-07-27T14:30:16.263700+0000","last_clean":"2023-07-27T14:30:16.263700+0000","last_became_active":"2023-07-27T14:30:15.808073+0000","last_became_peered":"2023-07-27T14:30:15.808073+0000","last_unstale":"2023-07-27T14:30:16.263700+0000","last_undegraded":"2023-07-27T14:30:16.263700+0000","last_fullsized":"2023-07-27T14:30:16.263700+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276451+0000","last_change":"2023-07-27T14:30:16.265450+0000","last_active":"2023-07-27T14:30:16.276451+0000","last_peered":"2023-07-27T14:30:16.276451+0000","last_clean":"2023-07-27T14:30:16.276451+0000","last_became_active":"2023-07-27T14:30:16.265044+0000","last_became_peered":"2023-07-27T14:30:16.265044+0000","last_unstale":"2023-07-27T14:30:16.276451+0000","last_undegraded":"2023-07-27T14:30:16.276451+0000","last_fullsized":"2023-07-27T14:30:16.276451+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807008+0000","last_change":"2023-07-27T14:30:15.803590+0000","last_active":"2023-07-27T14:30:15.807008+0000","last_peered":"2023-07-27T14:30:15.807008+0000","last_clean":"2023-07-27T14:30:15.807008+0000","last_became_active":"2023-07-27T14:30:15.803139+0000","last_became_peered":"2023-07-27T14:30:15.803139+0000","last_unstale":"2023-07-27T14:30:15.807008+0000","last_undegraded":"2023-07-27T14:30:15.807008+0000","last_fullsized":"2023-07-27T14:30:15.807008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265617+0000","last_change":"2023-07-27T14:30:16.265617+0000","last_active":"2023-07-27T14:30:16.265617+0000","last_peered":"2023-07-27T14:30:16.265617+0000","last_clean":"2023-07-27T14:30:16.265617+0000","last_became_active":"2023-07-27T14:30:16.265366+0000","last_became_peered":"2023-07-27T14:30:16.265366+0000","last_unstale":"2023-07-27T14:30:16.265617+0000","last_undegraded":"2023-07-27T14:30:16.265617+0000","last_fullsized":"2023-07-27T14:30:16.265617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.800970+0000","last_change":"2023-07-27T14:30:15.793199+0000","last_active":"2023-07-27T14:30:15.800970+0000","last_peered":"2023-07-27T14:30:15.800970+0000","last_clean":"2023-07-27T14:30:15.800970+0000","last_became_active":"2023-07-27T14:30:15.792901+0000","last_became_peered":"2023-07-27T14:30:15.792901+0000","last_unstale":"2023-07-27T14:30:15.800970+0000","last_undegraded":"2023-07-27T14:30:15.800970+0000","last_fullsized":"2023-07-27T14:30:15.800970+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284485+0000","last_change":"2023-07-27T14:30:16.274503+0000","last_active":"2023-07-27T14:30:16.284485+0000","last_peered":"2023-07-27T14:30:16.284485+0000","last_clean":"2023-07-27T14:30:16.284485+0000","last_became_active":"2023-07-27T14:30:16.273989+0000","last_became_peered":"2023-07-27T14:30:16.273989+0000","last_unstale":"2023-07-27T14:30:16.284485+0000","last_undegraded":"2023-07-27T14:30:16.284485+0000","last_fullsized":"2023-07-27T14:30:16.284485+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.256828+0000","last_change":"2023-07-27T14:30:15.811604+0000","last_active":"2023-07-27T14:30:16.256828+0000","last_peered":"2023-07-27T14:30:16.256828+0000","last_clean":"2023-07-27T14:30:16.256828+0000","last_became_active":"2023-07-27T14:30:15.811292+0000","last_became_peered":"2023-07-27T14:30:15.811292+0000","last_unstale":"2023-07-27T14:30:16.256828+0000","last_undegraded":"2023-07-27T14:30:16.256828+0000","last_fullsized":"2023-07-27T14:30:16.256828+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278437+0000","last_change":"2023-07-27T14:30:16.275351+0000","last_active":"2023-07-27T14:30:16.278437+0000","last_peered":"2023-07-27T14:30:16.278437+0000","last_clean":"2023-07-27T14:30:16.278437+0000","last_became_active":"2023-07-27T14:30:16.274934+0000","last_became_peered":"2023-07-27T14:30:16.274934+0000","last_unstale":"2023-07-27T14:30:16.278437+0000","last_undegraded":"2023-07-27T14:30:16.278437+0000","last_fullsized":"2023-07-27T14:30:16.278437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807953+0000","last_change":"2023-07-27T14:30:15.802126+0000","last_active":"2023-07-27T14:30:15.807953+0000","last_peered":"2023-07-27T14:30:15.807953+0000","last_clean":"2023-07-27T14:30:15.807953+0000","last_became_active":"2023-07-27T14:30:15.801877+0000","last_became_peered":"2023-07-27T14:30:15.801877+0000","last_unstale":"2023-07-27T14:30:15.807953+0000","last_undegraded":"2023-07-27T14:30:15.807953+0000","last_fullsized":"2023-07-27T14:30:15.807953+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276508+0000","last_change":"2023-07-27T14:30:16.267254+0000","last_active":"2023-07-27T14:30:16.276508+0000","last_peered":"2023-07-27T14:30:16.276508+0000","last_clean":"2023-07-27T14:30:16.276508+0000","last_became_active":"2023-07-27T14:30:16.266972+0000","last_became_peered":"2023-07-27T14:30:16.266972+0000","last_unstale":"2023-07-27T14:30:16.276508+0000","last_undegraded":"2023-07-27T14:30:16.276508+0000","last_fullsized":"2023-07-27T14:30:16.276508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.811228+0000","last_change":"2023-07-27T14:30:15.809221+0000","last_active":"2023-07-27T14:30:15.811228+0000","last_peered":"2023-07-27T14:30:15.811228+0000","last_clean":"2023-07-27T14:30:15.811228+0000","last_became_active":"2023-07-27T14:30:15.808866+0000","last_became_peered":"2023-07-27T14:30:15.808866+0000","last_unstale":"2023-07-27T14:30:15.811228+0000","last_undegraded":"2023-07-27T14:30:15.811228+0000","last_fullsized":"2023-07-27T14:30:15.811228+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.268546+0000","last_change":"2023-07-27T14:30:16.268546+0000","last_active":"2023-07-27T14:30:16.268546+0000","last_peered":"2023-07-27T14:30:16.268546+0000","last_clean":"2023-07-27T14:30:16.268546+0000","last_became_active":"2023-07-27T14:30:16.268094+0000","last_became_peered":"2023-07-27T14:30:16.268094+0000","last_unstale":"2023-07-27T14:30:16.268546+0000","last_undegraded":"2023-07-27T14:30:16.268546+0000","last_fullsized":"2023-07-27T14:30:16.268546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253154+0000","last_change":"2023-07-27T14:30:15.806723+0000","last_active":"2023-07-27T14:30:16.253154+0000","last_peered":"2023-07-27T14:30:16.253154+0000","last_clean":"2023-07-27T14:30:16.253154+0000","last_became_active":"2023-07-27T14:30:15.806472+0000","last_became_peered":"2023-07-27T14:30:15.806472+0000","last_unstale":"2023-07-27T14:30:16.253154+0000","last_undegraded":"2023-07-27T14:30:16.253154+0000","last_fullsized":"2023-07-27T14:30:16.253154+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284634+0000","last_change":"2023-07-27T14:30:16.275183+0000","last_active":"2023-07-27T14:30:16.284634+0000","last_peered":"2023-07-27T14:30:16.284634+0000","last_clean":"2023-07-27T14:30:16.284634+0000","last_became_active":"2023-07-27T14:30:16.274930+0000","last_became_peered":"2023-07-27T14:30:16.274930+0000","last_unstale":"2023-07-27T14:30:16.284634+0000","last_undegraded":"2023-07-27T14:30:16.284634+0000","last_fullsized":"2023-07-27T14:30:16.284634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.263637+0000","last_change":"2023-07-27T14:30:15.810910+0000","last_active":"2023-07-27T14:30:16.263637+0000","last_peered":"2023-07-27T14:30:16.263637+0000","last_clean":"2023-07-27T14:30:16.263637+0000","last_became_active":"2023-07-27T14:30:15.810635+0000","last_became_peered":"2023-07-27T14:30:15.810635+0000","last_unstale":"2023-07-27T14:30:16.263637+0000","last_undegraded":"2023-07-27T14:30:16.263637+0000","last_fullsized":"2023-07-27T14:30:16.263637+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284537+0000","last_change":"2023-07-27T14:30:16.280338+0000","last_active":"2023-07-27T14:30:16.284537+0000","last_peered":"2023-07-27T14:30:16.284537+0000","last_clean":"2023-07-27T14:30:16.284537+0000","last_became_active":"2023-07-27T14:30:16.280071+0000","last_became_peered":"2023-07-27T14:30:16.280071+0000","last_unstale":"2023-07-27T14:30:16.284537+0000","last_undegraded":"2023-07-27T14:30:16.284537+0000","last_fullsized":"2023-07-27T14:30:16.284537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.802932+0000","last_change":"2023-07-27T14:30:15.799787+0000","last_active":"2023-07-27T14:30:15.802932+0000","last_peered":"2023-07-27T14:30:15.802932+0000","last_clean":"2023-07-27T14:30:15.802932+0000","last_became_active":"2023-07-27T14:30:15.799491+0000","last_became_peered":"2023-07-27T14:30:15.799491+0000","last_unstale":"2023-07-27T14:30:15.802932+0000","last_undegraded":"2023-07-27T14:30:15.802932+0000","last_fullsized":"2023-07-27T14:30:15.802932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285994+0000","last_change":"2023-07-27T14:30:16.283131+0000","last_active":"2023-07-27T14:30:16.285994+0000","last_peered":"2023-07-27T14:30:16.285994+0000","last_clean":"2023-07-27T14:30:16.285994+0000","last_became_active":"2023-07-27T14:30:16.282115+0000","last_became_peered":"2023-07-27T14:30:16.282115+0000","last_unstale":"2023-07-27T14:30:16.285994+0000","last_undegraded":"2023-07-27T14:30:16.285994+0000","last_fullsized":"2023-07-27T14:30:16.285994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807994+0000","last_change":"2023-07-27T14:30:15.803063+0000","last_active":"2023-07-27T14:30:15.807994+0000","last_peered":"2023-07-27T14:30:15.807994+0000","last_clean":"2023-07-27T14:30:15.807994+0000","last_became_active":"2023-07-27T14:30:15.802792+0000","last_became_peered":"2023-07-27T14:30:15.802792+0000","last_unstale":"2023-07-27T14:30:15.807994+0000","last_undegraded":"2023-07-27T14:30:15.807994+0000","last_fullsized":"2023-07-27T14:30:15.807994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265558+0000","last_change":"2023-07-27T14:30:16.265558+0000","last_active":"2023-07-27T14:30:16.265558+0000","last_peered":"2023-07-27T14:30:16.265558+0000","last_clean":"2023-07-27T14:30:16.265558+0000","last_became_active":"2023-07-27T14:30:16.265244+0000","last_became_peered":"2023-07-27T14:30:16.265244+0000","last_unstale":"2023-07-27T14:30:16.265558+0000","last_undegraded":"2023-07-27T14:30:16.265558+0000","last_fullsized":"2023-07-27T14:30:16.265558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.262698+0000","last_change":"2023-07-27T14:30:15.806268+0000","last_active":"2023-07-27T14:30:16.262698+0000","last_peered":"2023-07-27T14:30:16.262698+0000","last_clean":"2023-07-27T14:30:16.262698+0000","last_became_active":"2023-07-27T14:30:15.805929+0000","last_became_peered":"2023-07-27T14:30:15.805929+0000","last_unstale":"2023-07-27T14:30:16.262698+0000","last_undegraded":"2023-07-27T14:30:16.262698+0000","last_fullsized":"2023-07-27T14:30:16.262698+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284502+0000","last_change":"2023-07-27T14:30:16.281285+0000","last_active":"2023-07-27T14:30:16.284502+0000","last_peered":"2023-07-27T14:30:16.284502+0000","last_clean":"2023-07-27T14:30:16.284502+0000","last_became_active":"2023-07-27T14:30:16.281004+0000","last_became_peered":"2023-07-27T14:30:16.281004+0000","last_unstale":"2023-07-27T14:30:16.284502+0000","last_undegraded":"2023-07-27T14:30:16.284502+0000","last_fullsized":"2023-07-27T14:30:16.284502+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.258623+0000","last_change":"2023-07-27T14:30:15.811009+0000","last_active":"2023-07-27T14:30:16.258623+0000","last_peered":"2023-07-27T14:30:16.258623+0000","last_clean":"2023-07-27T14:30:16.258623+0000","last_became_active":"2023-07-27T14:30:15.810660+0000","last_became_peered":"2023-07-27T14:30:15.810660+0000","last_unstale":"2023-07-27T14:30:16.258623+0000","last_undegraded":"2023-07-27T14:30:16.258623+0000","last_fullsized":"2023-07-27T14:30:16.258623+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.268484+0000","last_change":"2023-07-27T14:30:16.268484+0000","last_active":"2023-07-27T14:30:16.268484+0000","last_peered":"2023-07-27T14:30:16.268484+0000","last_clean":"2023-07-27T14:30:16.268484+0000","last_became_active":"2023-07-27T14:30:16.268214+0000","last_became_peered":"2023-07-27T14:30:16.268214+0000","last_unstale":"2023-07-27T14:30:16.268484+0000","last_undegraded":"2023-07-27T14:30:16.268484+0000","last_fullsized":"2023-07-27T14:30:16.268484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"67'2","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278354+0000","last_change":"2023-07-27T14:30:15.808614+0000","last_active":"2023-07-27T14:30:16.278354+0000","last_peered":"2023-07-27T14:30:16.278354+0000","last_clean":"2023-07-27T14:30:16.278354+0000","last_became_active":"2023-07-27T14:30:15.808143+0000","last_became_peered":"2023-07-27T14:30:15.808143+0000","last_unstale":"2023-07-27T14:30:16.278354+0000","last_undegraded":"2023-07-27T14:30:16.278354+0000","last_fullsized":"2023-07-27T14:30:16.278354+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285274+0000","last_change":"2023-07-27T14:30:16.278917+0000","last_active":"2023-07-27T14:30:16.285274+0000","last_peered":"2023-07-27T14:30:16.285274+0000","last_clean":"2023-07-27T14:30:16.285274+0000","last_became_active":"2023-07-27T14:30:16.278601+0000","last_became_peered":"2023-07-27T14:30:16.278601+0000","last_unstale":"2023-07-27T14:30:16.285274+0000","last_undegraded":"2023-07-27T14:30:16.285274+0000","last_fullsized":"2023-07-27T14:30:16.285274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807831+0000","last_change":"2023-07-27T14:30:15.800100+0000","last_active":"2023-07-27T14:30:15.807831+0000","last_peered":"2023-07-27T14:30:15.807831+0000","last_clean":"2023-07-27T14:30:15.807831+0000","last_became_active":"2023-07-27T14:30:15.799833+0000","last_became_peered":"2023-07-27T14:30:15.799833+0000","last_unstale":"2023-07-27T14:30:15.807831+0000","last_undegraded":"2023-07-27T14:30:15.807831+0000","last_fullsized":"2023-07-27T14:30:15.807831+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.264647+0000","last_change":"2023-07-27T14:30:16.264647+0000","last_active":"2023-07-27T14:30:16.264647+0000","last_peered":"2023-07-27T14:30:16.264647+0000","last_clean":"2023-07-27T14:30:16.264647+0000","last_became_active":"2023-07-27T14:30:16.264390+0000","last_became_peered":"2023-07-27T14:30:16.264390+0000","last_unstale":"2023-07-27T14:30:16.264647+0000","last_undegraded":"2023-07-27T14:30:16.264647+0000","last_fullsized":"2023-07-27T14:30:16.264647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253257+0000","last_change":"2023-07-27T14:30:15.808336+0000","last_active":"2023-07-27T14:30:16.253257+0000","last_peered":"2023-07-27T14:30:16.253257+0000","last_clean":"2023-07-27T14:30:16.253257+0000","last_became_active":"2023-07-27T14:30:15.808037+0000","last_became_peered":"2023-07-27T14:30:15.808037+0000","last_unstale":"2023-07-27T14:30:16.253257+0000","last_undegraded":"2023-07-27T14:30:16.253257+0000","last_fullsized":"2023-07-27T14:30:16.253257+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276387+0000","last_change":"2023-07-27T14:30:16.276387+0000","last_active":"2023-07-27T14:30:16.276387+0000","last_peered":"2023-07-27T14:30:16.276387+0000","last_clean":"2023-07-27T14:30:16.276387+0000","last_became_active":"2023-07-27T14:30:16.275981+0000","last_became_peered":"2023-07-27T14:30:16.275981+0000","last_unstale":"2023-07-27T14:30:16.276387+0000","last_undegraded":"2023-07-27T14:30:16.276387+0000","last_fullsized":"2023-07-27T14:30:16.276387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253276+0000","last_change":"2023-07-27T14:30:15.805181+0000","last_active":"2023-07-27T14:30:16.253276+0000","last_peered":"2023-07-27T14:30:16.253276+0000","last_clean":"2023-07-27T14:30:16.253276+0000","last_became_active":"2023-07-27T14:30:15.804841+0000","last_became_peered":"2023-07-27T14:30:15.804841+0000","last_unstale":"2023-07-27T14:30:16.253276+0000","last_undegraded":"2023-07-27T14:30:16.253276+0000","last_fullsized":"2023-07-27T14:30:16.253276+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.277304+0000","last_change":"2023-07-27T14:30:16.277304+0000","last_active":"2023-07-27T14:30:16.277304+0000","last_peered":"2023-07-27T14:30:16.277304+0000","last_clean":"2023-07-27T14:30:16.277304+0000","last_became_active":"2023-07-27T14:30:16.276971+0000","last_became_peered":"2023-07-27T14:30:16.276971+0000","last_unstale":"2023-07-27T14:30:16.277304+0000","last_undegraded":"2023-07-27T14:30:16.277304+0000","last_fullsized":"2023-07-27T14:30:16.277304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.252990+0000","last_change":"2023-07-27T14:30:15.808086+0000","last_active":"2023-07-27T14:30:16.252990+0000","last_peered":"2023-07-27T14:30:16.252990+0000","last_clean":"2023-07-27T14:30:16.252990+0000","last_became_active":"2023-07-27T14:30:15.807772+0000","last_became_peered":"2023-07-27T14:30:15.807772+0000","last_unstale":"2023-07-27T14:30:16.252990+0000","last_undegraded":"2023-07-27T14:30:16.252990+0000","last_fullsized":"2023-07-27T14:30:16.252990+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.275149+0000","last_change":"2023-07-27T14:30:16.273281+0000","last_active":"2023-07-27T14:30:16.275149+0000","last_peered":"2023-07-27T14:30:16.275149+0000","last_clean":"2023-07-27T14:30:16.275149+0000","last_became_active":"2023-07-27T14:30:16.272996+0000","last_became_peered":"2023-07-27T14:30:16.272996+0000","last_unstale":"2023-07-27T14:30:16.275149+0000","last_undegraded":"2023-07-27T14:30:16.275149+0000","last_fullsized":"2023-07-27T14:30:16.275149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.807027+0000","last_change":"2023-07-27T14:30:15.805027+0000","last_active":"2023-07-27T14:30:15.807027+0000","last_peered":"2023-07-27T14:30:15.807027+0000","last_clean":"2023-07-27T14:30:15.807027+0000","last_became_active":"2023-07-27T14:30:15.804571+0000","last_became_peered":"2023-07-27T14:30:15.804571+0000","last_unstale":"2023-07-27T14:30:15.807027+0000","last_undegraded":"2023-07-27T14:30:15.807027+0000","last_fullsized":"2023-07-27T14:30:15.807027+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266522+0000","last_change":"2023-07-27T14:30:16.266522+0000","last_active":"2023-07-27T14:30:16.266522+0000","last_peered":"2023-07-27T14:30:16.266522+0000","last_clean":"2023-07-27T14:30:16.266522+0000","last_became_active":"2023-07-27T14:30:16.266273+0000","last_became_peered":"2023-07-27T14:30:16.266273+0000","last_unstale":"2023-07-27T14:30:16.266522+0000","last_undegraded":"2023-07-27T14:30:16.266522+0000","last_fullsized":"2023-07-27T14:30:16.266522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265353+0000","last_change":"2023-07-27T14:30:15.807466+0000","last_active":"2023-07-27T14:30:16.265353+0000","last_peered":"2023-07-27T14:30:16.265353+0000","last_clean":"2023-07-27T14:30:16.265353+0000","last_became_active":"2023-07-27T14:30:15.807150+0000","last_became_peered":"2023-07-27T14:30:15.807150+0000","last_unstale":"2023-07-27T14:30:16.265353+0000","last_undegraded":"2023-07-27T14:30:16.265353+0000","last_fullsized":"2023-07-27T14:30:16.265353+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.271217+0000","last_change":"2023-07-27T14:30:16.267355+0000","last_active":"2023-07-27T14:30:16.271217+0000","last_peered":"2023-07-27T14:30:16.271217+0000","last_clean":"2023-07-27T14:30:16.271217+0000","last_became_active":"2023-07-27T14:30:16.266958+0000","last_became_peered":"2023-07-27T14:30:16.266958+0000","last_unstale":"2023-07-27T14:30:16.271217+0000","last_undegraded":"2023-07-27T14:30:16.271217+0000","last_fullsized":"2023-07-27T14:30:16.271217+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.270252+0000","last_change":"2023-07-27T14:30:15.797334+0000","last_active":"2023-07-27T14:30:16.270252+0000","last_peered":"2023-07-27T14:30:16.270252+0000","last_clean":"2023-07-27T14:30:16.270252+0000","last_became_active":"2023-07-27T14:30:15.796991+0000","last_became_peered":"2023-07-27T14:30:15.796991+0000","last_unstale":"2023-07-27T14:30:16.270252+0000","last_undegraded":"2023-07-27T14:30:16.270252+0000","last_fullsized":"2023-07-27T14:30:16.270252+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.269927+0000","last_change":"2023-07-27T14:30:16.269927+0000","last_active":"2023-07-27T14:30:16.269927+0000","last_peered":"2023-07-27T14:30:16.269927+0000","last_clean":"2023-07-27T14:30:16.269927+0000","last_became_active":"2023-07-27T14:30:16.269562+0000","last_became_peered":"2023-07-27T14:30:16.269562+0000","last_unstale":"2023-07-27T14:30:16.269927+0000","last_undegraded":"2023-07-27T14:30:16.269927+0000","last_fullsized":"2023-07-27T14:30:16.269927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"67'3","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285176+0000","last_change":"2023-07-27T14:30:15.812924+0000","last_active":"2023-07-27T14:30:16.285176+0000","last_peered":"2023-07-27T14:30:16.285176+0000","last_clean":"2023-07-27T14:30:16.285176+0000","last_became_active":"2023-07-27T14:30:15.812395+0000","last_became_peered":"2023-07-27T14:30:15.812395+0000","last_unstale":"2023-07-27T14:30:16.285176+0000","last_undegraded":"2023-07-27T14:30:16.285176+0000","last_fullsized":"2023-07-27T14:30:16.285176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.280136+0000","last_change":"2023-07-27T14:30:16.273159+0000","last_active":"2023-07-27T14:30:16.280136+0000","last_peered":"2023-07-27T14:30:16.280136+0000","last_clean":"2023-07-27T14:30:16.280136+0000","last_became_active":"2023-07-27T14:30:16.272889+0000","last_became_peered":"2023-07-27T14:30:16.272889+0000","last_unstale":"2023-07-27T14:30:16.280136+0000","last_undegraded":"2023-07-27T14:30:16.280136+0000","last_fullsized":"2023-07-27T14:30:16.280136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"67'2","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284875+0000","last_change":"2023-07-27T14:30:15.809095+0000","last_active":"2023-07-27T14:30:16.284875+0000","last_peered":"2023-07-27T14:30:16.284875+0000","last_clean":"2023-07-27T14:30:16.284875+0000","last_became_active":"2023-07-27T14:30:15.808421+0000","last_became_peered":"2023-07-27T14:30:15.808421+0000","last_unstale":"2023-07-27T14:30:16.284875+0000","last_undegraded":"2023-07-27T14:30:16.284875+0000","last_fullsized":"2023-07-27T14:30:16.284875+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284880+0000","last_change":"2023-07-27T14:30:16.282046+0000","last_active":"2023-07-27T14:30:16.284880+0000","last_peered":"2023-07-27T14:30:16.284880+0000","last_clean":"2023-07-27T14:30:16.284880+0000","last_became_active":"2023-07-27T14:30:16.281477+0000","last_became_peered":"2023-07-27T14:30:16.281477+0000","last_unstale":"2023-07-27T14:30:16.284880+0000","last_undegraded":"2023-07-27T14:30:16.284880+0000","last_fullsized":"2023-07-27T14:30:16.284880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284966+0000","last_change":"2023-07-27T14:30:15.806163+0000","last_active":"2023-07-27T14:30:16.284966+0000","last_peered":"2023-07-27T14:30:16.284966+0000","last_clean":"2023-07-27T14:30:16.284966+0000","last_became_active":"2023-07-27T14:30:15.805714+0000","last_became_peered":"2023-07-27T14:30:15.805714+0000","last_unstale":"2023-07-27T14:30:16.284966+0000","last_undegraded":"2023-07-27T14:30:16.284966+0000","last_fullsized":"2023-07-27T14:30:16.284966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278401+0000","last_change":"2023-07-27T14:30:16.271894+0000","last_active":"2023-07-27T14:30:16.278401+0000","last_peered":"2023-07-27T14:30:16.278401+0000","last_clean":"2023-07-27T14:30:16.278401+0000","last_became_active":"2023-07-27T14:30:16.271557+0000","last_became_peered":"2023-07-27T14:30:16.271557+0000","last_unstale":"2023-07-27T14:30:16.278401+0000","last_undegraded":"2023-07-27T14:30:16.278401+0000","last_fullsized":"2023-07-27T14:30:16.278401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.257404+0000","last_change":"2023-07-27T14:30:15.809142+0000","last_active":"2023-07-27T14:30:16.257404+0000","last_peered":"2023-07-27T14:30:16.257404+0000","last_clean":"2023-07-27T14:30:16.257404+0000","last_became_active":"2023-07-27T14:30:15.808493+0000","last_became_peered":"2023-07-27T14:30:15.808493+0000","last_unstale":"2023-07-27T14:30:16.257404+0000","last_undegraded":"2023-07-27T14:30:16.257404+0000","last_fullsized":"2023-07-27T14:30:16.257404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.269819+0000","last_change":"2023-07-27T14:30:16.269819+0000","last_active":"2023-07-27T14:30:16.269819+0000","last_peered":"2023-07-27T14:30:16.269819+0000","last_clean":"2023-07-27T14:30:16.269819+0000","last_became_active":"2023-07-27T14:30:16.269459+0000","last_became_peered":"2023-07-27T14:30:16.269459+0000","last_unstale":"2023-07-27T14:30:16.269819+0000","last_undegraded":"2023-07-27T14:30:16.269819+0000","last_fullsized":"2023-07-27T14:30:16.269819+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.263864+0000","last_change":"2023-07-27T14:30:15.808433+0000","last_active":"2023-07-27T14:30:16.263864+0000","last_peered":"2023-07-27T14:30:16.263864+0000","last_clean":"2023-07-27T14:30:16.263864+0000","last_became_active":"2023-07-27T14:30:15.808120+0000","last_became_peered":"2023-07-27T14:30:15.808120+0000","last_unstale":"2023-07-27T14:30:16.263864+0000","last_undegraded":"2023-07-27T14:30:16.263864+0000","last_fullsized":"2023-07-27T14:30:16.263864+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278085+0000","last_change":"2023-07-27T14:30:16.278085+0000","last_active":"2023-07-27T14:30:16.278085+0000","last_peered":"2023-07-27T14:30:16.278085+0000","last_clean":"2023-07-27T14:30:16.278085+0000","last_became_active":"2023-07-27T14:30:16.277819+0000","last_became_peered":"2023-07-27T14:30:16.277819+0000","last_unstale":"2023-07-27T14:30:16.278085+0000","last_undegraded":"2023-07-27T14:30:16.278085+0000","last_fullsized":"2023-07-27T14:30:16.278085+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285623+0000","last_change":"2023-07-27T14:30:15.807106+0000","last_active":"2023-07-27T14:30:16.285623+0000","last_peered":"2023-07-27T14:30:16.285623+0000","last_clean":"2023-07-27T14:30:16.285623+0000","last_became_active":"2023-07-27T14:30:15.806854+0000","last_became_peered":"2023-07-27T14:30:15.806854+0000","last_unstale":"2023-07-27T14:30:16.285623+0000","last_undegraded":"2023-07-27T14:30:16.285623+0000","last_fullsized":"2023-07-27T14:30:16.285623+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.273224+0000","last_change":"2023-07-27T14:30:16.273224+0000","last_active":"2023-07-27T14:30:16.273224+0000","last_peered":"2023-07-27T14:30:16.273224+0000","last_clean":"2023-07-27T14:30:16.273224+0000","last_became_active":"2023-07-27T14:30:16.272895+0000","last_became_peered":"2023-07-27T14:30:16.272895+0000","last_unstale":"2023-07-27T14:30:16.273224+0000","last_undegraded":"2023-07-27T14:30:16.273224+0000","last_fullsized":"2023-07-27T14:30:16.273224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.283789+0000","last_change":"2023-07-27T14:30:15.808663+0000","last_active":"2023-07-27T14:30:16.283789+0000","last_peered":"2023-07-27T14:30:16.283789+0000","last_clean":"2023-07-27T14:30:16.283789+0000","last_became_active":"2023-07-27T14:30:15.808376+0000","last_became_peered":"2023-07-27T14:30:15.808376+0000","last_unstale":"2023-07-27T14:30:16.283789+0000","last_undegraded":"2023-07-27T14:30:16.283789+0000","last_fullsized":"2023-07-27T14:30:16.283789+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.271888+0000","last_change":"2023-07-27T14:30:16.271888+0000","last_active":"2023-07-27T14:30:16.271888+0000","last_peered":"2023-07-27T14:30:16.271888+0000","last_clean":"2023-07-27T14:30:16.271888+0000","last_became_active":"2023-07-27T14:30:16.271614+0000","last_became_peered":"2023-07-27T14:30:16.271614+0000","last_unstale":"2023-07-27T14:30:16.271888+0000","last_undegraded":"2023-07-27T14:30:16.271888+0000","last_fullsized":"2023-07-27T14:30:16.271888+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.256954+0000","last_change":"2023-07-27T14:30:15.805028+0000","last_active":"2023-07-27T14:30:16.256954+0000","last_peered":"2023-07-27T14:30:16.256954+0000","last_clean":"2023-07-27T14:30:16.256954+0000","last_became_active":"2023-07-27T14:30:15.804677+0000","last_became_peered":"2023-07-27T14:30:15.804677+0000","last_unstale":"2023-07-27T14:30:16.256954+0000","last_undegraded":"2023-07-27T14:30:16.256954+0000","last_fullsized":"2023-07-27T14:30:16.256954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278456+0000","last_change":"2023-07-27T14:30:16.275388+0000","last_active":"2023-07-27T14:30:16.278456+0000","last_peered":"2023-07-27T14:30:16.278456+0000","last_clean":"2023-07-27T14:30:16.278456+0000","last_became_active":"2023-07-27T14:30:16.275094+0000","last_became_peered":"2023-07-27T14:30:16.275094+0000","last_unstale":"2023-07-27T14:30:16.278456+0000","last_undegraded":"2023-07-27T14:30:16.278456+0000","last_fullsized":"2023-07-27T14:30:16.278456+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.811417+0000","last_change":"2023-07-27T14:30:15.808210+0000","last_active":"2023-07-27T14:30:15.811417+0000","last_peered":"2023-07-27T14:30:15.811417+0000","last_clean":"2023-07-27T14:30:15.811417+0000","last_became_active":"2023-07-27T14:30:15.807753+0000","last_became_peered":"2023-07-27T14:30:15.807753+0000","last_unstale":"2023-07-27T14:30:15.811417+0000","last_undegraded":"2023-07-27T14:30:15.811417+0000","last_fullsized":"2023-07-27T14:30:15.811417+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276523+0000","last_change":"2023-07-27T14:30:16.276523+0000","last_active":"2023-07-27T14:30:16.276523+0000","last_peered":"2023-07-27T14:30:16.276523+0000","last_clean":"2023-07-27T14:30:16.276523+0000","last_became_active":"2023-07-27T14:30:16.274971+0000","last_became_peered":"2023-07-27T14:30:16.274971+0000","last_unstale":"2023-07-27T14:30:16.276523+0000","last_undegraded":"2023-07-27T14:30:16.276523+0000","last_fullsized":"2023-07-27T14:30:16.276523+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.811355+0000","last_change":"2023-07-27T14:30:15.809265+0000","last_active":"2023-07-27T14:30:15.811355+0000","last_peered":"2023-07-27T14:30:15.811355+0000","last_clean":"2023-07-27T14:30:15.811355+0000","last_became_active":"2023-07-27T14:30:15.808757+0000","last_became_peered":"2023-07-27T14:30:15.808757+0000","last_unstale":"2023-07-27T14:30:15.811355+0000","last_undegraded":"2023-07-27T14:30:15.811355+0000","last_fullsized":"2023-07-27T14:30:15.811355+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.265535+0000","last_change":"2023-07-27T14:30:16.265535+0000","last_active":"2023-07-27T14:30:16.265535+0000","last_peered":"2023-07-27T14:30:16.265535+0000","last_clean":"2023-07-27T14:30:16.265535+0000","last_became_active":"2023-07-27T14:30:16.265201+0000","last_became_peered":"2023-07-27T14:30:16.265201+0000","last_unstale":"2023-07-27T14:30:16.265535+0000","last_undegraded":"2023-07-27T14:30:16.265535+0000","last_fullsized":"2023-07-27T14:30:16.265535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.263602+0000","last_change":"2023-07-27T14:30:15.813827+0000","last_active":"2023-07-27T14:30:16.263602+0000","last_peered":"2023-07-27T14:30:16.263602+0000","last_clean":"2023-07-27T14:30:16.263602+0000","last_became_active":"2023-07-27T14:30:15.813485+0000","last_became_peered":"2023-07-27T14:30:15.813485+0000","last_unstale":"2023-07-27T14:30:16.263602+0000","last_undegraded":"2023-07-27T14:30:16.263602+0000","last_fullsized":"2023-07-27T14:30:16.263602+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.286677+0000","last_change":"2023-07-27T14:30:16.283780+0000","last_active":"2023-07-27T14:30:16.286677+0000","last_peered":"2023-07-27T14:30:16.286677+0000","last_clean":"2023-07-27T14:30:16.286677+0000","last_became_active":"2023-07-27T14:30:16.283426+0000","last_became_peered":"2023-07-27T14:30:16.283426+0000","last_unstale":"2023-07-27T14:30:16.286677+0000","last_undegraded":"2023-07-27T14:30:16.286677+0000","last_fullsized":"2023-07-27T14:30:16.286677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253361+0000","last_change":"2023-07-27T14:30:15.805414+0000","last_active":"2023-07-27T14:30:16.253361+0000","last_peered":"2023-07-27T14:30:16.253361+0000","last_clean":"2023-07-27T14:30:16.253361+0000","last_became_active":"2023-07-27T14:30:15.804536+0000","last_became_peered":"2023-07-27T14:30:15.804536+0000","last_unstale":"2023-07-27T14:30:16.253361+0000","last_undegraded":"2023-07-27T14:30:16.253361+0000","last_fullsized":"2023-07-27T14:30:16.253361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276317+0000","last_change":"2023-07-27T14:30:16.276317+0000","last_active":"2023-07-27T14:30:16.276317+0000","last_peered":"2023-07-27T14:30:16.276317+0000","last_clean":"2023-07-27T14:30:16.276317+0000","last_became_active":"2023-07-27T14:30:16.276032+0000","last_became_peered":"2023-07-27T14:30:16.276032+0000","last_unstale":"2023-07-27T14:30:16.276317+0000","last_undegraded":"2023-07-27T14:30:16.276317+0000","last_fullsized":"2023-07-27T14:30:16.276317+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253082+0000","last_change":"2023-07-27T14:30:15.807506+0000","last_active":"2023-07-27T14:30:16.253082+0000","last_peered":"2023-07-27T14:30:16.253082+0000","last_clean":"2023-07-27T14:30:16.253082+0000","last_became_active":"2023-07-27T14:30:15.807263+0000","last_became_peered":"2023-07-27T14:30:15.807263+0000","last_unstale":"2023-07-27T14:30:16.253082+0000","last_undegraded":"2023-07-27T14:30:16.253082+0000","last_fullsized":"2023-07-27T14:30:16.253082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.267347+0000","last_change":"2023-07-27T14:30:16.267347+0000","last_active":"2023-07-27T14:30:16.267347+0000","last_peered":"2023-07-27T14:30:16.267347+0000","last_clean":"2023-07-27T14:30:16.267347+0000","last_became_active":"2023-07-27T14:30:16.267102+0000","last_became_peered":"2023-07-27T14:30:16.267102+0000","last_unstale":"2023-07-27T14:30:16.267347+0000","last_undegraded":"2023-07-27T14:30:16.267347+0000","last_fullsized":"2023-07-27T14:30:16.267347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.806377+0000","last_change":"2023-07-27T14:30:15.802629+0000","last_active":"2023-07-27T14:30:15.806377+0000","last_peered":"2023-07-27T14:30:15.806377+0000","last_clean":"2023-07-27T14:30:15.806377+0000","last_became_active":"2023-07-27T14:30:15.802343+0000","last_became_peered":"2023-07-27T14:30:15.802343+0000","last_unstale":"2023-07-27T14:30:15.806377+0000","last_undegraded":"2023-07-27T14:30:15.806377+0000","last_fullsized":"2023-07-27T14:30:15.806377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.285575+0000","last_change":"2023-07-27T14:30:16.281368+0000","last_active":"2023-07-27T14:30:16.285575+0000","last_peered":"2023-07-27T14:30:16.285575+0000","last_clean":"2023-07-27T14:30:16.285575+0000","last_became_active":"2023-07-27T14:30:16.280950+0000","last_became_peered":"2023-07-27T14:30:16.280950+0000","last_unstale":"2023-07-27T14:30:16.285575+0000","last_undegraded":"2023-07-27T14:30:16.285575+0000","last_fullsized":"2023-07-27T14:30:16.285575+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.278839+0000","last_change":"2023-07-27T14:30:15.804001+0000","last_active":"2023-07-27T14:30:16.278839+0000","last_peered":"2023-07-27T14:30:16.278839+0000","last_clean":"2023-07-27T14:30:16.278839+0000","last_became_active":"2023-07-27T14:30:15.803666+0000","last_became_peered":"2023-07-27T14:30:15.803666+0000","last_unstale":"2023-07-27T14:30:16.278839+0000","last_undegraded":"2023-07-27T14:30:16.278839+0000","last_fullsized":"2023-07-27T14:30:16.278839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.783108+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:30:15.783108+0000","last_peered":"2023-07-27T14:30:15.783108+0000","last_clean":"2023-07-27T14:30:15.783108+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:30:15.783108+0000","last_undegraded":"2023-07-27T14:30:15.783108+0000","last_fullsized":"2023-07-27T14:30:15.783108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.275244+0000","last_change":"2023-07-27T14:30:16.275244+0000","last_active":"2023-07-27T14:30:16.275244+0000","last_peered":"2023-07-27T14:30:16.275244+0000","last_clean":"2023-07-27T14:30:16.275244+0000","last_became_active":"2023-07-27T14:30:16.274830+0000","last_became_peered":"2023-07-27T14:30:16.274830+0000","last_unstale":"2023-07-27T14:30:16.275244+0000","last_undegraded":"2023-07-27T14:30:16.275244+0000","last_fullsized":"2023-07-27T14:30:16.275244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.812272+0000","last_change":"2023-07-27T14:30:15.809541+0000","last_active":"2023-07-27T14:30:15.812272+0000","last_peered":"2023-07-27T14:30:15.812272+0000","last_clean":"2023-07-27T14:30:15.812272+0000","last_became_active":"2023-07-27T14:30:15.809282+0000","last_became_peered":"2023-07-27T14:30:15.809282+0000","last_unstale":"2023-07-27T14:30:15.812272+0000","last_undegraded":"2023-07-27T14:30:15.812272+0000","last_fullsized":"2023-07-27T14:30:15.812272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.257636+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:30:16.257636+0000","last_peered":"2023-07-27T14:30:16.257636+0000","last_clean":"2023-07-27T14:30:16.257636+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:30:16.257636+0000","last_undegraded":"2023-07-27T14:30:16.257636+0000","last_fullsized":"2023-07-27T14:30:16.257636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.276387+0000","last_change":"2023-07-27T14:30:16.268663+0000","last_active":"2023-07-27T14:30:16.276387+0000","last_peered":"2023-07-27T14:30:16.276387+0000","last_clean":"2023-07-27T14:30:16.276387+0000","last_became_active":"2023-07-27T14:30:16.268371+0000","last_became_peered":"2023-07-27T14:30:16.268371+0000","last_unstale":"2023-07-27T14:30:16.276387+0000","last_undegraded":"2023-07-27T14:30:16.276387+0000","last_fullsized":"2023-07-27T14:30:16.276387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.257531+0000","last_change":"2023-07-27T14:30:15.808886+0000","last_active":"2023-07-27T14:30:16.257531+0000","last_peered":"2023-07-27T14:30:16.257531+0000","last_clean":"2023-07-27T14:30:16.257531+0000","last_became_active":"2023-07-27T14:30:15.808143+0000","last_became_peered":"2023-07-27T14:30:15.808143+0000","last_unstale":"2023-07-27T14:30:16.257531+0000","last_undegraded":"2023-07-27T14:30:16.257531+0000","last_fullsized":"2023-07-27T14:30:16.257531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.790774+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:30:15.790774+0000","last_peered":"2023-07-27T14:30:15.790774+0000","last_clean":"2023-07-27T14:30:15.790774+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:30:15.790774+0000","last_undegraded":"2023-07-27T14:30:15.790774+0000","last_fullsized":"2023-07-27T14:30:15.790774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.266155+0000","last_change":"2023-07-27T14:30:16.266155+0000","last_active":"2023-07-27T14:30:16.266155+0000","last_peered":"2023-07-27T14:30:16.266155+0000","last_clean":"2023-07-27T14:30:16.266155+0000","last_became_active":"2023-07-27T14:30:16.265881+0000","last_became_peered":"2023-07-27T14:30:16.265881+0000","last_unstale":"2023-07-27T14:30:16.266155+0000","last_undegraded":"2023-07-27T14:30:16.266155+0000","last_fullsized":"2023-07-27T14:30:16.266155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.252447+0000","last_change":"2023-07-27T14:30:15.812293+0000","last_active":"2023-07-27T14:30:16.252447+0000","last_peered":"2023-07-27T14:30:16.252447+0000","last_clean":"2023-07-27T14:30:16.252447+0000","last_became_active":"2023-07-27T14:30:15.812019+0000","last_became_peered":"2023-07-27T14:30:15.812019+0000","last_unstale":"2023-07-27T14:30:16.252447+0000","last_undegraded":"2023-07-27T14:30:16.252447+0000","last_fullsized":"2023-07-27T14:30:16.252447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.257861+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:30:16.257861+0000","last_peered":"2023-07-27T14:30:16.257861+0000","last_clean":"2023-07-27T14:30:16.257861+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:30:16.257861+0000","last_undegraded":"2023-07-27T14:30:16.257861+0000","last_fullsized":"2023-07-27T14:30:16.257861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.262370+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:30:16.262370+0000","last_peered":"2023-07-27T14:30:16.262370+0000","last_clean":"2023-07-27T14:30:16.262370+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:30:16.262370+0000","last_undegraded":"2023-07-27T14:30:16.262370+0000","last_fullsized":"2023-07-27T14:30:16.262370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.268374+0000","last_change":"2023-07-27T14:30:16.268374+0000","last_active":"2023-07-27T14:30:16.268374+0000","last_peered":"2023-07-27T14:30:16.268374+0000","last_clean":"2023-07-27T14:30:16.268374+0000","last_became_active":"2023-07-27T14:30:16.267835+0000","last_became_peered":"2023-07-27T14:30:16.267835+0000","last_unstale":"2023-07-27T14:30:16.268374+0000","last_undegraded":"2023-07-27T14:30:16.268374+0000","last_fullsized":"2023-07-27T14:30:16.268374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"67'1","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.258081+0000","last_change":"2023-07-27T14:30:15.801609+0000","last_active":"2023-07-27T14:30:16.258081+0000","last_peered":"2023-07-27T14:30:16.258081+0000","last_clean":"2023-07-27T14:30:16.258081+0000","last_became_active":"2023-07-27T14:30:15.801326+0000","last_became_peered":"2023-07-27T14:30:15.801326+0000","last_unstale":"2023-07-27T14:30:16.258081+0000","last_undegraded":"2023-07-27T14:30:16.258081+0000","last_fullsized":"2023-07-27T14:30:16.258081+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.262453+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:30:16.262453+0000","last_peered":"2023-07-27T14:30:16.262453+0000","last_clean":"2023-07-27T14:30:16.262453+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:30:16.262453+0000","last_undegraded":"2023-07-27T14:30:16.262453+0000","last_fullsized":"2023-07-27T14:30:16.262453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.279321+0000","last_change":"2023-07-27T14:30:16.279321+0000","last_active":"2023-07-27T14:30:16.279321+0000","last_peered":"2023-07-27T14:30:16.279321+0000","last_clean":"2023-07-27T14:30:16.279321+0000","last_became_active":"2023-07-27T14:30:16.278885+0000","last_became_peered":"2023-07-27T14:30:16.278885+0000","last_unstale":"2023-07-27T14:30:16.279321+0000","last_undegraded":"2023-07-27T14:30:16.279321+0000","last_fullsized":"2023-07-27T14:30:16.279321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.282157+0000","last_change":"2023-07-27T14:30:15.814836+0000","last_active":"2023-07-27T14:30:16.282157+0000","last_peered":"2023-07-27T14:30:16.282157+0000","last_clean":"2023-07-27T14:30:16.282157+0000","last_became_active":"2023-07-27T14:30:15.814461+0000","last_became_peered":"2023-07-27T14:30:15.814461+0000","last_unstale":"2023-07-27T14:30:16.282157+0000","last_undegraded":"2023-07-27T14:30:16.282157+0000","last_fullsized":"2023-07-27T14:30:16.282157+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.264551+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:30:16.264551+0000","last_peered":"2023-07-27T14:30:16.264551+0000","last_clean":"2023-07-27T14:30:16.264551+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:30:16.264551+0000","last_undegraded":"2023-07-27T14:30:16.264551+0000","last_fullsized":"2023-07-27T14:30:16.264551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.284975+0000","last_change":"2023-07-27T14:30:16.279322+0000","last_active":"2023-07-27T14:30:16.284975+0000","last_peered":"2023-07-27T14:30:16.284975+0000","last_clean":"2023-07-27T14:30:16.284975+0000","last_became_active":"2023-07-27T14:30:16.279028+0000","last_became_peered":"2023-07-27T14:30:16.279028+0000","last_unstale":"2023-07-27T14:30:16.284975+0000","last_undegraded":"2023-07-27T14:30:16.284975+0000","last_fullsized":"2023-07-27T14:30:16.284975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.264321+0000","last_change":"2023-07-27T14:30:15.812700+0000","last_active":"2023-07-27T14:30:16.264321+0000","last_peered":"2023-07-27T14:30:16.264321+0000","last_clean":"2023-07-27T14:30:16.264321+0000","last_became_active":"2023-07-27T14:30:15.812062+0000","last_became_peered":"2023-07-27T14:30:15.812062+0000","last_unstale":"2023-07-27T14:30:16.264321+0000","last_undegraded":"2023-07-27T14:30:16.264321+0000","last_fullsized":"2023-07-27T14:30:16.264321+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.782812+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:30:15.782812+0000","last_peered":"2023-07-27T14:30:15.782812+0000","last_clean":"2023-07-27T14:30:15.782812+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:30:15.782812+0000","last_undegraded":"2023-07-27T14:30:15.782812+0000","last_fullsized":"2023-07-27T14:30:15.782812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.272550+0000","last_change":"2023-07-27T14:30:16.272550+0000","last_active":"2023-07-27T14:30:16.272550+0000","last_peered":"2023-07-27T14:30:16.272550+0000","last_clean":"2023-07-27T14:30:16.272550+0000","last_became_active":"2023-07-27T14:30:16.272286+0000","last_became_peered":"2023-07-27T14:30:16.272286+0000","last_unstale":"2023-07-27T14:30:16.272550+0000","last_undegraded":"2023-07-27T14:30:16.272550+0000","last_fullsized":"2023-07-27T14:30:16.272550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:15.777591+0000","last_clean_scrub_stamp":"2023-07-27T14:30:15.777591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-27T14:30:16.253568+0000","last_change":"2023-07-27T14:30:15.810324+0000","last_active":"2023-07-27T14:30:16.253568+0000","last_peered":"2023-07-27T14:30:16.253568+0000","last_clean":"2023-07-27T14:30:16.253568+0000","last_became_active":"2023-07-27T14:30:15.809991+0000","last_became_peered":"2023-07-27T14:30:15.809991+0000","last_unstale":"2023-07-27T14:30:16.253568+0000","last_undegraded":"2023-07-27T14:30:16.253568+0000","last_fullsized":"2023-07-27T14:30:16.253568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:30:14.774492+0000","last_clean_scrub_stamp":"2023-07-27T14:30:14.774492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-27T14:30:15.795326+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:30:15.795326+0000","last_peered":"2023-07-27T14:30:15.795326+0000","last_clean":"2023-07-27T14:30:15.795326+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:30:15.795326+0000","last_undegraded":"2023-07-27T14:30:15.795326+0000","last_fullsized":"2023-07-27T14:30:15.795326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7732,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":6912,"kb_avail":94364108,"statfs":{"total":96636764160,"available":96628846592,"internally_reserved":0,"allocated":831488,"data_stored":372893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7077888},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96599999999999997,"5min":1.133,"15min":1.133},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.68400000000000005},"min":{"1min":0.45900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0589999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.496,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84899999999999998,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86699999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.623},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.46300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.96299999999999997,"5min":1.119,"15min":1.119},"last":0.746}]},{"osd":3,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.70999999999999996},"min":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.70999999999999996},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79200000000000004,"5min":1.165,"15min":1.165},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86199999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.53700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85699999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.50600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.871,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.54400000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0029999999999999,"5min":1.038,"15min":1.038},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.57399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85199999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7392,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94364448,"statfs":{"total":96636764160,"available":96629194752,"internally_reserved":0,"allocated":811008,"data_stored":365207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60499999999999998,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.47099999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60099999999999998},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.872,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.46700000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.879,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64400000000000002,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.879,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.53200000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.48699999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93999999999999995,"5min":1.2,"15min":1.2},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.58099999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86699999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.61899999999999999},"min":{"1min":0.438,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.57199999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.198,"15min":1.198},"last":0.87},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jul 27 14:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.59299999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.099,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0309999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7404,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94364436,"statfs":{"total":96636764160,"available":96629182464,"internally_reserved":0,"allocated":823296,"data_stored":365929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.5,"15min":0.55000000000000004},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65500000000000003,"5min":4.75,"15min":4.75},"last":0.433},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.63600000000000001,"15min":0.73399999999999999},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56499999999999995,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.55000000000000004,"15min":0.58799999999999997},"min":{"1min":0.35399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.59399999999999997,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.52800000000000002,"15min":0.55300000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.64600000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.57299999999999995,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.55300000000000005,"15min":0.59699999999999998},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64300000000000002,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.505}]},{"osd":4,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.71499999999999997,"15min":0.72799999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83799999999999997,"5min":2.181,"15min":2.181},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72199999999999998,"15min":0.73999999999999999},"min":{"1min":0.51700000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.88800000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.79900000000000004},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84599999999999997,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.84299999999999997,"5min":2.149,"15min":2.149},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.53700000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":2.052,"15min":2.052},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.83599999999999997,"15min":0.89700000000000002},"min":{"1min":0.503,"5min":0.502,"15min":0.502},"max":{"1min":0.88500000000000001,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90100000000000002,"5min":2.016,"15min":2.016},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84699999999999998,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98399999999999999,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.748}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7516,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":6720,"kb_avail":94364324,"statfs":{"total":96636764160,"available":96629067776,"internally_reserved":0,"allocated":806912,"data_stored":365173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6881280},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42599999999999999},"min":{"1min":0.28399999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.435}]},{"osd":2,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42599999999999999,"15min":0.432},"min":{"1min":0.30399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55100000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60299999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.47899999999999998,"15min":0.48599999999999999},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68799999999999994,"15min":0.68100000000000005},"min":{"1min":0.495,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98799999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94299999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0569999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.745,"15min":0.745},"min":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.079,"15min":1.079},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.018,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.749,"15min":0.755},"min":{"1min":0.54300000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.49099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":7360,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":815104,"data_stored":365797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7536640},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41299999999999998,"15min":0.42499999999999999},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53700000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60699999999999998,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.373}]},{"osd":1,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.47799999999999998,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53600000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47499999999999998,"15min":0.48199999999999998},"min":{"1min":0.38300000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.55400000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64300000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.373,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.60499999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89300000000000002,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98299999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93799999999999994,"5min":1.014,"15min":1.014},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94399999999999995,"5min":1.26,"15min":1.26},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.624},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94399999999999995,"5min":1.091,"15min":1.091},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:29:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98599999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.80000000000000004},"min":{"1min":0.61499999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95899999999999996,"5min":1.036,"15min":1.036},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8240,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":7424,"kb_avail":94363600,"statfs":{"total":96636764160,"available":96628326400,"internally_reserved":0,"allocated":827392,"data_stored":372501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7602176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48499999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.433},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44900000000000001},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44900000000000001,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59599999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.379},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.49199999999999999,"15min":0.497},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.499}]},{"osd":4,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.53600000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.0449999999999999,"5min":1.149,"15min":1.149},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.53100000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94599999999999995,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98599999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.01,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73799999999999999,"15min":0.72999999999999998},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.298,"15min":1.298},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75700000000000001,"15min":0.75},"min":{"1min":0.56200000000000006,"5min":0.44,"15min":0.44},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.60999999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78600000000000003,"15min":0.77400000000000002},"min":{"1min":0.63100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.03,"5min":1.24,"15min":1.24},"last":0.91200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7332,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":94364508,"statfs":{"total":96636764160,"available":96629256192,"internally_reserved":0,"allocated":815104,"data_stored":365817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92700000000000005,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71099999999999997,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94999999999999996,"5min":2.419,"15min":2.419},"last":0.79900000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80500000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.752},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.47399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.876}]},{"osd":2,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.46500000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66600000000000004,"15min":0.67100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69899999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81999999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92900000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.72499999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63,"15min":0.627},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83699999999999997,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.98299999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.58999999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.048,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:29:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.57199999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91800000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.046,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8880,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94362960,"statfs":{"total":96636764160,"available":96627671040,"internally_reserved":0,"allocated":827392,"data_stored":372791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88200000000000001,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.123,"5min":1.143,"15min":1.143},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.54500000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89300000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.496}]},{"osd":3,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65800000000000003,"15min":0.66800000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84299999999999997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.89800000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.57899999999999996,"5min":0.379,"15min":0.379},"max":{"1min":0.89100000000000001,"5min":1.224,"15min":1.224},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.875,"5min":1.056,"15min":1.056},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79200000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.55400000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.94499999999999995,"5min":1.085,"15min":1.085},"last":0.42799999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.51300000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.628},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84799999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:30:20.992 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:30:20.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:30:21.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.190+0000 7f05a35ff700 1 Processor -- start 2023-07-27T14:30:21.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.190+0000 7f05a35ff700 1 -- start start 2023-07-27T14:30:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a35ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f059c14ae00 0x7f059c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a35ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 0x7f059c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a35ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f059c0c5c50 0x7f059c063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a35ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c063530 con 0x7f059c14ae00 2023-07-27T14:30:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a35ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c1553f0 con 0x7f059c0c5c50 2023-07-27T14:30:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a35ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c157a50 con 0x7f059c14b1e0 2023-07-27T14:30:21.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a139b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f059c14ae00 0x7f059c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a139b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f059c14ae00 0x7f059c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59664/0 (socket says 172.21.15.115:59664) 2023-07-27T14:30:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.191+0000 7f05a139b700 1 -- 172.21.15.115:0/1073455154 learned_addr learned my addr 172.21.15.115:0/1073455154 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f05a1b9c700 1 --2- 172.21.15.115:0/1073455154 >> v2:172.21.15.159:3300/0 conn(0x7f059c0c5c50 0x7f059c063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f05a0b9a700 1 --2- 172.21.15.115:0/1073455154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 0x7f059c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f05a139b700 1 -- 172.21.15.115:0/1073455154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 msgr2=0x7f059c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f05a139b700 1 --2- 172.21.15.115:0/1073455154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 0x7f059c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f05a139b700 1 -- 172.21.15.115:0/1073455154 >> v2:172.21.15.159:3300/0 conn(0x7f059c0c5c50 msgr2=0x7f059c063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f05a139b700 1 --2- 172.21.15.115:0/1073455154 >> v2:172.21.15.159:3300/0 conn(0x7f059c0c5c50 0x7f059c063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f05a139b700 1 -- 172.21.15.115:0/1073455154 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c157d10 con 0x7f059c14ae00 2023-07-27T14:30:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f05a139b700 1 --2- 172.21.15.115:0/1073455154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c14ae00 0x7f059c154f00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f059c084190 tx=0x7f05980090f0).ready entity=mon.0 client_cookie=27481e5842607907 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f0593fff700 1 -- 172.21.15.115:0/1073455154 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800b600 con 0x7f059c14ae00 2023-07-27T14:30:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f0593fff700 1 -- 172.21.15.115:0/1073455154 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059800b760 con 0x7f059c14ae00 2023-07-27T14:30:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.192+0000 7f0593fff700 1 -- 172.21.15.115:0/1073455154 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800bae0 con 0x7f059c14ae00 2023-07-27T14:30:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 -- 172.21.15.115:0/1073455154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c14ae00 msgr2=0x7f059c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 --2- 172.21.15.115:0/1073455154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c14ae00 0x7f059c154f00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f059c084190 tx=0x7f05980090f0).stop 2023-07-27T14:30:21.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 -- 172.21.15.115:0/1073455154 shutdown_connections 2023-07-27T14:30:21.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 --2- 172.21.15.115:0/1073455154 >> v2:172.21.15.159:3300/0 conn(0x7f059c0c5c50 0x7f059c063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 --2- 172.21.15.115:0/1073455154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c14ae00 0x7f059c154f00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 --2- 172.21.15.115:0/1073455154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 0x7f059c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 -- 172.21.15.115:0/1073455154 >> 172.21.15.115:0/1073455154 conn(0x7f059c05e940 msgr2=0x7f059c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:21.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 -- 172.21.15.115:0/1073455154 shutdown_connections 2023-07-27T14:30:21.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.193+0000 7f05a35ff700 1 -- 172.21.15.115:0/1073455154 wait complete. 2023-07-27T14:30:21.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.194+0000 7f05a35ff700 1 Processor -- start 2023-07-27T14:30:21.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.195+0000 7f05a35ff700 1 -- start start 2023-07-27T14:30:21.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.195+0000 7f05a35ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0c5c50 0x7f059c149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.195+0000 7f05a35ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c14ae00 0x7f059c0abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.195+0000 7f05a35ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 0x7f059c0ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.195+0000 7f05a35ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0ac710 con 0x7f059c0c5c50 2023-07-27T14:30:21.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.195+0000 7f05a35ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0ae8d0 con 0x7f059c14ae00 2023-07-27T14:30:21.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.195+0000 7f05a35ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0add00 con 0x7f059c14b1e0 2023-07-27T14:30:21.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0c5c50 0x7f059c149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0c5c50 0x7f059c149600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59672/0 (socket says 172.21.15.115:59672) 2023-07-27T14:30:21.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 -- 172.21.15.115:0/2600284355 learned_addr learned my addr 172.21.15.115:0/2600284355 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:21.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a1b9c700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 0x7f059c0ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a0b9a700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c14ae00 0x7f059c0abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 -- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 msgr2=0x7f059c0ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 0x7f059c0ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 -- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c14ae00 msgr2=0x7f059c0abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c14ae00 0x7f059c0abd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 -- 172.21.15.115:0/2600284355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598009370 con 0x7f059c0c5c50 2023-07-27T14:30:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a0b9a700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c14ae00 0x7f059c0abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05a139b700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0c5c50 0x7f059c149600 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f0598009130 tx=0x7f0598017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05917fa700 1 -- 172.21.15.115:0/2600284355 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800b8d0 con 0x7f059c0c5c50 2023-07-27T14:30:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05917fa700 1 -- 172.21.15.115:0/2600284355 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059800ba50 con 0x7f059c0c5c50 2023-07-27T14:30:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.196+0000 7f05917fa700 1 -- 172.21.15.115:0/2600284355 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059801c670 con 0x7f059c0c5c50 2023-07-27T14:30:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.197+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c0adfa0 con 0x7f059c0c5c50 2023-07-27T14:30:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.197+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c0ae560 con 0x7f059c0c5c50 2023-07-27T14:30:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.198+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c0aebb0 con 0x7f059c0c5c50 2023-07-27T14:30:21.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.199+0000 7f05917fa700 1 -- 172.21.15.115:0/2600284355 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f059802c070 con 0x7f059c0c5c50 2023-07-27T14:30:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.200+0000 7f05917fa700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005f060 0x7f0580061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.200+0000 7f05917fa700 1 -- 172.21.15.115:0/2600284355 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f059807bc70 con 0x7f059c0c5c50 2023-07-27T14:30:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.200+0000 7f05a0b9a700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005f060 0x7f0580061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.200+0000 7f05a0b9a700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005f060 0x7f0580061520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f058c006fd0 tx=0x7f058c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.203+0000 7f05917fa700 1 -- 172.21.15.115:0/2600284355 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f059804ce30 con 0x7f059c0c5c50 2023-07-27T14:30:21.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.438+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f059c06c470 con 0x7f059c0c5c50 2023-07-27T14:30:21.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.444+0000 7f05917fa700 1 -- 172.21.15.115:0/2600284355 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f059802a020 con 0x7f059c0c5c50 2023-07-27T14:30:21.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005f060 msgr2=0x7f0580061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005f060 0x7f0580061520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f058c006fd0 tx=0x7f058c008040).stop 2023-07-27T14:30:21.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0c5c50 msgr2=0x7f059c149600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0c5c50 0x7f059c149600 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f0598009130 tx=0x7f0598017000).stop 2023-07-27T14:30:21.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 shutdown_connections 2023-07-27T14:30:21.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005f060 0x7f0580061520 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c14b1e0 0x7f059c0ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c0c5c50 0x7f059c149600 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 --2- 172.21.15.115:0/2600284355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f059c14ae00 0x7f059c0abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.446+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 >> 172.21.15.115:0/2600284355 conn(0x7f059c05e940 msgr2=0x7f059c0c13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:21.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.447+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 shutdown_connections 2023-07-27T14:30:21.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.447+0000 7f05a35ff700 1 -- 172.21.15.115:0/2600284355 wait complete. 2023-07-27T14:30:21.477 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:30:21.492 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:30:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.654+0000 7f423c7ff700 1 Processor -- start 2023-07-27T14:30:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.654+0000 7f423c7ff700 1 -- start start 2023-07-27T14:30:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423c7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4234153ec0 0x7f42340a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423c7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 0x7f42340640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423c7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42340aaa40 0x7f42340645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423c7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4234064ad0 con 0x7f42340aaa40 2023-07-27T14:30:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423c7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42340aa4d0 con 0x7f4234153ec0 2023-07-27T14:30:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423c7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42340c05c0 con 0x7f42340aa050 2023-07-27T14:30:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423ad9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42340aaa40 0x7f42340645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423ad9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42340aaa40 0x7f42340645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59676/0 (socket says 172.21.15.115:59676) 2023-07-27T14:30:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423ad9c700 1 -- 172.21.15.115:0/4084595226 learned_addr learned my addr 172.21.15.115:0/4084595226 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f4239d9a700 1 --2- 172.21.15.115:0/4084595226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 0x7f42340640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.656+0000 7f423a59b700 1 --2- 172.21.15.115:0/4084595226 >> v2:172.21.15.159:3300/0 conn(0x7f4234153ec0 0x7f42340a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423ad9c700 1 -- 172.21.15.115:0/4084595226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 msgr2=0x7f42340640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423ad9c700 1 --2- 172.21.15.115:0/4084595226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 0x7f42340640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423ad9c700 1 -- 172.21.15.115:0/4084595226 >> v2:172.21.15.159:3300/0 conn(0x7f4234153ec0 msgr2=0x7f42340a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423ad9c700 1 --2- 172.21.15.115:0/4084595226 >> v2:172.21.15.159:3300/0 conn(0x7f4234153ec0 0x7f42340a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423ad9c700 1 -- 172.21.15.115:0/4084595226 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340bfc90 con 0x7f42340aaa40 2023-07-27T14:30:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423a59b700 1 --2- 172.21.15.115:0/4084595226 >> v2:172.21.15.159:3300/0 conn(0x7f4234153ec0 0x7f42340a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423ad9c700 1 --2- 172.21.15.115:0/4084595226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42340aaa40 0x7f42340645e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f4234083e30 tx=0x7f422c009840).ready entity=mon.0 client_cookie=93ddeaa7cd3c2fc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:21.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f4239599700 1 -- 172.21.15.115:0/4084595226 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00e070 con 0x7f42340aaa40 2023-07-27T14:30:21.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f4239599700 1 -- 172.21.15.115:0/4084595226 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00ba20 con 0x7f42340aaa40 2023-07-27T14:30:21.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f4239599700 1 -- 172.21.15.115:0/4084595226 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00bda0 con 0x7f42340aaa40 2023-07-27T14:30:21.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423c7ff700 1 -- 172.21.15.115:0/4084595226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42340aaa40 msgr2=0x7f42340645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423c7ff700 1 --2- 172.21.15.115:0/4084595226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42340aaa40 0x7f42340645e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f4234083e30 tx=0x7f422c009840).stop 2023-07-27T14:30:21.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423c7ff700 1 -- 172.21.15.115:0/4084595226 shutdown_connections 2023-07-27T14:30:21.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423c7ff700 1 --2- 172.21.15.115:0/4084595226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42340aaa40 0x7f42340645e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423c7ff700 1 --2- 172.21.15.115:0/4084595226 >> v2:172.21.15.159:3300/0 conn(0x7f4234153ec0 0x7f42340a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.657+0000 7f423c7ff700 1 --2- 172.21.15.115:0/4084595226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 0x7f42340640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.658+0000 7f423c7ff700 1 -- 172.21.15.115:0/4084595226 >> 172.21.15.115:0/4084595226 conn(0x7f42340cb610 msgr2=0x7f42340c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:21.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.658+0000 7f423c7ff700 1 -- 172.21.15.115:0/4084595226 shutdown_connections 2023-07-27T14:30:21.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.658+0000 7f423c7ff700 1 -- 172.21.15.115:0/4084595226 wait complete. 2023-07-27T14:30:21.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.659+0000 7f423c7ff700 1 Processor -- start 2023-07-27T14:30:21.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.659+0000 7f423c7ff700 1 -- start start 2023-07-27T14:30:21.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423c7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 0x7f423414fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423c7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42340aaa40 0x7f42340b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423c7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4234153ec0 0x7f42341671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423c7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340c4cb0 con 0x7f4234153ec0 2023-07-27T14:30:21.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423c7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4234150210 con 0x7f42340aaa40 2023-07-27T14:30:21.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423c7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42340c4450 con 0x7f42340aa050 2023-07-27T14:30:21.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423ad9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4234153ec0 0x7f42341671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423ad9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4234153ec0 0x7f42341671c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59692/0 (socket says 172.21.15.115:59692) 2023-07-27T14:30:21.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423ad9c700 1 -- 172.21.15.115:0/953364058 learned_addr learned my addr 172.21.15.115:0/953364058 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:21.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.660+0000 7f423a59b700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 0x7f423414fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f4239d9a700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42340aaa40 0x7f42340b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f423ad9c700 1 -- 172.21.15.115:0/953364058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 msgr2=0x7f423414fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f423ad9c700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 0x7f423414fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f423ad9c700 1 -- 172.21.15.115:0/953364058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42340aaa40 msgr2=0x7f42340b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f423ad9c700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42340aaa40 0x7f42340b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f423ad9c700 1 -- 172.21.15.115:0/953364058 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009ae0 con 0x7f4234153ec0 2023-07-27T14:30:21.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f423ad9c700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4234153ec0 0x7f42341671c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f4234060760 tx=0x7f422c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:21.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f422a7fc700 1 -- 172.21.15.115:0/953364058 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0032f0 con 0x7f4234153ec0 2023-07-27T14:30:21.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f422a7fc700 1 -- 172.21.15.115:0/953364058 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0092e0 con 0x7f4234153ec0 2023-07-27T14:30:21.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f422a7fc700 1 -- 172.21.15.115:0/953364058 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c01e6a0 con 0x7f4234153ec0 2023-07-27T14:30:21.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42340b0b30 con 0x7f4234153ec0 2023-07-27T14:30:21.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.661+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42340c46f0 con 0x7f4234153ec0 2023-07-27T14:30:21.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.662+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423406c470 con 0x7f4234153ec0 2023-07-27T14:30:21.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.663+0000 7f422a7fc700 1 -- 172.21.15.115:0/953364058 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f422c025030 con 0x7f4234153ec0 2023-07-27T14:30:21.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.664+0000 7f422a7fc700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421805f060 0x7f4218061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:21.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.664+0000 7f422a7fc700 1 -- 172.21.15.115:0/953364058 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f422c07b570 con 0x7f4234153ec0 2023-07-27T14:30:21.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.664+0000 7f423a59b700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421805f060 0x7f4218061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:21.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.664+0000 7f423a59b700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421805f060 0x7f4218061520 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f4230006fd0 tx=0x7f4230008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:21.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.668+0000 7f422a7fc700 1 -- 172.21.15.115:0/953364058 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f422c04c730 con 0x7f4234153ec0 2023-07-27T14:30:21.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.880+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42340c4230 con 0x7f4234153ec0 2023-07-27T14:30:21.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.881+0000 7f422a7fc700 1 -- 172.21.15.115:0/953364058 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f422c023070 con 0x7f4234153ec0 2023-07-27T14:30:21.909 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:21.910 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1689103707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1689103707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1689103707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/2448381398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2448381398},{"type":"v1","addr":"172.21.15.159:6834","nonce":2448381398}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3512171796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3512171796},{"type":"v1","addr":"172.21.15.159:6835","nonce":3512171796}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:30:16.247520+0000","modified":"2023-07-27T14:30:19.259578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2262768820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2262768820},{"type":"v1","addr":"172.21.15.115:6836","nonce":2262768820}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-07-27T14:30:21.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421805f060 msgr2=0x7f4218061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421805f060 0x7f4218061520 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f4230006fd0 tx=0x7f4230008040).stop 2023-07-27T14:30:21.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4234153ec0 msgr2=0x7f42341671c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:21.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4234153ec0 0x7f42341671c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f4234060760 tx=0x7f422c009840).stop 2023-07-27T14:30:21.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 shutdown_connections 2023-07-27T14:30:21.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f421805f060 0x7f4218061520 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4234153ec0 0x7f42341671c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42340aa050 0x7f423414fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 --2- 172.21.15.115:0/953364058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42340aaa40 0x7f42340b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:21.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 >> 172.21.15.115:0/953364058 conn(0x7f42340cb610 msgr2=0x7f42340ab580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:21.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 shutdown_connections 2023-07-27T14:30:21.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:21.883+0000 7f423c7ff700 1 -- 172.21.15.115:0/953364058 wait complete. 2023-07-27T14:30:21.913 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 33 2023-07-27T14:30:22.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:30:16.247520+0000', 'modified': '2023-07-27T14:30:19.259578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5979}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5979': {'gid': 5979, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6836/2262768820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 2262768820}, {'type': 'v1', 'addr': '172.21.15.115:6836', 'nonce': 2262768820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:30:22.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:30:22.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-27T14:30:22.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.493+0000 7f27c11ff700 1 Processor -- start 2023-07-27T14:30:22.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.493+0000 7f27c11ff700 1 -- start start 2023-07-27T14:30:22.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.494+0000 7f27c11ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f27bc153ec0 0x7f27bc0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.494+0000 7f27c11ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 0x7f27bc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.494+0000 7f27c11ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f27bc0aaa40 0x7f27bc0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.494+0000 7f27c11ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc064ad0 con 0x7f27bc0aaa40 2023-07-27T14:30:22.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.494+0000 7f27c11ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc0aa4d0 con 0x7f27bc153ec0 2023-07-27T14:30:22.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.494+0000 7f27c11ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0c05c0 con 0x7f27bc0aa050 2023-07-27T14:30:22.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f27bc0aaa40 0x7f27bc0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f27bc0aaa40 0x7f27bc0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59708/0 (socket says 172.21.15.115:59708) 2023-07-27T14:30:22.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 -- 172.21.15.115:0/1806156723 learned_addr learned my addr 172.21.15.115:0/1806156723 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:22.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bad9d700 1 --2- 172.21.15.115:0/1806156723 >> v2:172.21.15.159:3300/0 conn(0x7f27bc153ec0 0x7f27bc0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27ba59c700 1 --2- 172.21.15.115:0/1806156723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 0x7f27bc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 -- 172.21.15.115:0/1806156723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 msgr2=0x7f27bc0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 --2- 172.21.15.115:0/1806156723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 0x7f27bc0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 -- 172.21.15.115:0/1806156723 >> v2:172.21.15.159:3300/0 conn(0x7f27bc153ec0 msgr2=0x7f27bc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 --2- 172.21.15.115:0/1806156723 >> v2:172.21.15.159:3300/0 conn(0x7f27bc153ec0 0x7f27bc0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 -- 172.21.15.115:0/1806156723 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0bfc90 con 0x7f27bc0aaa40 2023-07-27T14:30:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27bb59e700 1 --2- 172.21.15.115:0/1806156723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0645e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f27bc083e30 tx=0x7f27b4009840).ready entity=mon.0 client_cookie=5bf6a368caeb5c48 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.495+0000 7f27b9d9b700 1 -- 172.21.15.115:0/1806156723 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b400e070 con 0x7f27bc0aaa40 2023-07-27T14:30:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27b9d9b700 1 -- 172.21.15.115:0/1806156723 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b400b970 con 0x7f27bc0aaa40 2023-07-27T14:30:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27b9d9b700 1 -- 172.21.15.115:0/1806156723 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b400bcf0 con 0x7f27bc0aaa40 2023-07-27T14:30:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 -- 172.21.15.115:0/1806156723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 msgr2=0x7f27bc0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 --2- 172.21.15.115:0/1806156723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0645e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f27bc083e30 tx=0x7f27b4009840).stop 2023-07-27T14:30:22.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 -- 172.21.15.115:0/1806156723 shutdown_connections 2023-07-27T14:30:22.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 --2- 172.21.15.115:0/1806156723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0645e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 --2- 172.21.15.115:0/1806156723 >> v2:172.21.15.159:3300/0 conn(0x7f27bc153ec0 0x7f27bc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 --2- 172.21.15.115:0/1806156723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 0x7f27bc0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 -- 172.21.15.115:0/1806156723 >> 172.21.15.115:0/1806156723 conn(0x7f27bc0cb610 msgr2=0x7f27bc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:22.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 -- 172.21.15.115:0/1806156723 shutdown_connections 2023-07-27T14:30:22.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.496+0000 7f27c11ff700 1 -- 172.21.15.115:0/1806156723 wait complete. 2023-07-27T14:30:22.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.498+0000 7f27c11ff700 1 Processor -- start 2023-07-27T14:30:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.498+0000 7f27c11ff700 1 -- start start 2023-07-27T14:30:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27c11ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 0x7f27bc14e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27c11ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27c11ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc153ec0 0x7f27bc0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27c11ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0ca510 con 0x7f27bc0aaa40 2023-07-27T14:30:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27c11ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc164160 con 0x7f27bc153ec0 2023-07-27T14:30:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27c11ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc150c20 con 0x7f27bc0aa050 2023-07-27T14:30:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27ba59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27ba59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59716/0 (socket says 172.21.15.115:59716) 2023-07-27T14:30:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27ba59c700 1 -- 172.21.15.115:0/2278667323 learned_addr learned my addr 172.21.15.115:0/2278667323 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27bad9d700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 0x7f27bc14e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27bb59e700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc153ec0 0x7f27bc0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27ba59c700 1 -- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 msgr2=0x7f27bc14e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27ba59c700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 0x7f27bc14e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27ba59c700 1 -- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc153ec0 msgr2=0x7f27bc0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27ba59c700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc153ec0 0x7f27bc0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27ba59c700 1 -- 172.21.15.115:0/2278667323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4009ae0 con 0x7f27bc0aaa40 2023-07-27T14:30:22.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.500+0000 7f27bb59e700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc153ec0 0x7f27bc0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:22.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.501+0000 7f27ba59c700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0c9b30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f27b000e930 tx=0x7f27b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.501+0000 7f27a2ffd700 1 -- 172.21.15.115:0/2278667323 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000c670 con 0x7f27bc0aaa40 2023-07-27T14:30:22.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.501+0000 7f27a2ffd700 1 -- 172.21.15.115:0/2278667323 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b000c7d0 con 0x7f27bc0aaa40 2023-07-27T14:30:22.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.501+0000 7f27a2ffd700 1 -- 172.21.15.115:0/2278667323 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000cb50 con 0x7f27bc0aaa40 2023-07-27T14:30:22.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.501+0000 7f27c11ff700 1 -- 172.21.15.115:0/2278667323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc150f00 con 0x7f27bc0aaa40 2023-07-27T14:30:22.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.501+0000 7f27c11ff700 1 -- 172.21.15.115:0/2278667323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc14ee50 con 0x7f27bc0aaa40 2023-07-27T14:30:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.503+0000 7f27a2ffd700 1 -- 172.21.15.115:0/2278667323 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f27b0022070 con 0x7f27bc0aaa40 2023-07-27T14:30:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.504+0000 7f27a2ffd700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27a805f060 0x7f27a8061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.504+0000 7f27a2ffd700 1 -- 172.21.15.115:0/2278667323 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f27b007a2f0 con 0x7f27bc0aaa40 2023-07-27T14:30:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.504+0000 7f27bad9d700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27a805f060 0x7f27a8061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.504+0000 7f27bad9d700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27a805f060 0x7f27a8061520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f27ac009b90 tx=0x7f27ac009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.506+0000 7f27d860fb80 1 Processor -- start 2023-07-27T14:30:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.506+0000 7f27d860fb80 1 -- start start 2023-07-27T14:30:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b529a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7a830 0x563ee4ba0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4ba11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27d860fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee4a8f9c0 con 0x563ee4b54f60 2023-07-27T14:30:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27d860fb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee4aa4cc0 con 0x563ee4b525c0 2023-07-27T14:30:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27d860fb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ee4a6be10 con 0x563ee4b7a830 2023-07-27T14:30:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bb59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4ba11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bb59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4ba11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59726/0 (socket says 172.21.15.115:59726) 2023-07-27T14:30:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bb59e700 1 -- 172.21.15.115:0/2721133525 learned_addr learned my addr 172.21.15.115:0/2721133525 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27ba59c700 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7a830 0x563ee4ba0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bad9d700 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bb59e700 1 -- 172.21.15.115:0/2721133525 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7a830 msgr2=0x563ee4ba0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bb59e700 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7a830 0x563ee4ba0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bb59e700 1 -- 172.21.15.115:0/2721133525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 msgr2=0x563ee4b529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bb59e700 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.507+0000 7f27bb59e700 1 -- 172.21.15.115:0/2721133525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ee4a9d9a0 con 0x563ee4b54f60 2023-07-27T14:30:22.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.508+0000 7f27bb59e700 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4ba11b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f27b4009a40 tx=0x7f27b4009840).ready entity=mon.0 client_cookie=fc7daa0f4a5cec1c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.508+0000 7f279bfff700 1 -- 172.21.15.115:0/2721133525 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4022070 con 0x563ee4b54f60 2023-07-27T14:30:22.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.508+0000 7f279bfff700 1 -- 172.21.15.115:0/2721133525 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b400bae0 con 0x563ee4b54f60 2023-07-27T14:30:22.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.508+0000 7f279bfff700 1 -- 172.21.15.115:0/2721133525 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b400bc70 con 0x563ee4b54f60 2023-07-27T14:30:22.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.508+0000 7f27d860fb80 1 -- 172.21.15.115:0/2721133525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 msgr2=0x563ee4ba11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.508+0000 7f27d860fb80 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4ba11b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f27b4009a40 tx=0x7f27b4009840).stop 2023-07-27T14:30:22.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 -- 172.21.15.115:0/2721133525 shutdown_connections 2023-07-27T14:30:22.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4ba11b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 --2- 172.21.15.115:0/2721133525 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7a830 0x563ee4ba0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 -- 172.21.15.115:0/2721133525 >> 172.21.15.115:0/2721133525 conn(0x563ee49bd940 msgr2=0x563ee4b9b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:22.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 -- 172.21.15.115:0/2721133525 shutdown_connections 2023-07-27T14:30:22.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 -- 172.21.15.115:0/2721133525 wait complete. 2023-07-27T14:30:22.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 -- start start 2023-07-27T14:30:22.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.509+0000 7f27d860fb80 1 Processor -- start 2023-07-27T14:30:22.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.510+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b525c0 0x563ee4ba7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.510+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b54f60 0x563ee4b75070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.510+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 0x563ee4b7f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.510+0000 7f27d860fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee4ba78d0 con 0x563ee4b525c0 2023-07-27T14:30:22.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.510+0000 7f27d860fb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee4b7f970 con 0x563ee4b54f60 2023-07-27T14:30:22.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.510+0000 7f27d860fb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ee4b807d0 con 0x563ee4b7ee90 2023-07-27T14:30:22.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27d860fb80 10 client.0 ll_register_callbacks cb 0x563ee4a574a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:30:22.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b525c0 0x563ee4ba7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b525c0 0x563ee4ba7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59732/0 (socket says 172.21.15.115:59732) 2023-07-27T14:30:22.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 -- 172.21.15.115:0/3969599742 learned_addr learned my addr 172.21.15.115:0/3969599742 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:22.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 -- 172.21.15.115:0/3969599742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 msgr2=0x563ee4b7f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 0x563ee4b7f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:22.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 -- 172.21.15.115:0/3969599742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b54f60 msgr2=0x563ee4b75070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b54f60 0x563ee4b75070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:22.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 -- 172.21.15.115:0/3969599742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc0bfc90 con 0x563ee4b525c0 2023-07-27T14:30:22.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27bad9d700 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b525c0 0x563ee4ba7080 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f27ac014820 tx=0x7f27ac017000).ready entity=mon.0 client_cookie=296fe45dbc348954 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27997fa700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:30:22.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27997fa700 1 -- 172.21.15.115:0/3969599742 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac020510 con 0x563ee4b525c0 2023-07-27T14:30:22.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27d860fb80 1 -- 172.21.15.115:0/3969599742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ee4b4cd50 con 0x563ee4b525c0 2023-07-27T14:30:22.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.511+0000 7f27997fa700 1 -- 172.21.15.115:0/3969599742 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f27ac020670 con 0x563ee4b525c0 2023-07-27T14:30:22.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27997fa700 1 -- 172.21.15.115:0/3969599742 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27ac020a40 con 0x563ee4b525c0 2023-07-27T14:30:22.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27d860fb80 10 client.6129 fetch_fsmap learned FSMap version 33 2023-07-27T14:30:22.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27d860fb80 1 -- 172.21.15.115:0/3969599742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x563ee4a99190 con 0x563ee4b525c0 2023-07-27T14:30:22.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27997fa700 1 -- 172.21.15.115:0/3969599742 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563ee4b4cd50 con 0x563ee4b525c0 2023-07-27T14:30:22.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27997fa700 1 -- 172.21.15.115:0/3969599742 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27ac020ba0 con 0x563ee4b525c0 2023-07-27T14:30:22.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27d860fb80 10 client.6129 fetch_fsmap finished waiting for FSMap version 33 2023-07-27T14:30:22.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27d860fb80 10 client.6129 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:30:22.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27d860fb80 20 client.6129 populate_metadata read hostname 'smithi115' 2023-07-27T14:30:22.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27d860fb80 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] conn(0x563ee4b77010 0x563ee4b98a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27d860fb80 4 client.6129 mds_command: new command op to 5979 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:30:22.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27d860fb80 1 -- 172.21.15.115:0/3969599742 --> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ee490def0 con 0x563ee4b77010 2023-07-27T14:30:22.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.512+0000 7f27ba59c700 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] conn(0x563ee4b77010 0x563ee4b98a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.513+0000 7f27997fa700 10 client.6129 ms_handle_connect on v2:172.21.15.115:6834/2262768820 2023-07-27T14:30:22.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.513+0000 7f27ba59c700 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] conn(0x563ee4b77010 0x563ee4b98a20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9656d7da65919a6a server_cookie=bf504b2963aec7ed in_seq=0 out_seq=0 2023-07-27T14:30:22.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.513+0000 7f27997fa700 1 -- 172.21.15.115:0/3969599742 <== mds.0 v2:172.21.15.115:6834/2262768820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x563ee490def0 con 0x563ee4b77010 2023-07-27T14:30:22.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.513+0000 7f27997fa700 10 client.6129 handle_command_reply: tid=0 2023-07-27T14:30:22.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.513+0000 7f27d860fb80 1 client.6129 shutdown 2023-07-27T14:30:22.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 -- 172.21.15.115:0/3969599742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b525c0 msgr2=0x563ee4ba7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b525c0 0x563ee4ba7080 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f27ac014820 tx=0x7f27ac017000).stop 2023-07-27T14:30:22.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 -- 172.21.15.115:0/3969599742 shutdown_connections 2023-07-27T14:30:22.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 0x563ee4b7f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:22.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] conn(0x563ee4b77010 0x563ee4b98a20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b525c0 0x563ee4ba7080 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 --2- 172.21.15.115:0/3969599742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b54f60 0x563ee4b75070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:22.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27997fa700 0 client.6129 ms_handle_reset on v2:172.21.15.115:6834/2262768820 2023-07-27T14:30:22.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 -- 172.21.15.115:0/3969599742 >> 172.21.15.115:0/3969599742 conn(0x563ee49bd940 msgr2=0x563ee4b9b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:22.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 -- 172.21.15.115:0/3969599742 shutdown_connections 2023-07-27T14:30:22.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 1 -- 172.21.15.115:0/3969599742 wait complete. 2023-07-27T14:30:22.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.514+0000 7f27d860fb80 20 client.6129 trim_cache size 0 max 16384 2023-07-27T14:30:22.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.530+0000 7f27d860fb80 1 Processor -- start 2023-07-27T14:30:22.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.531+0000 7f27d860fb80 1 -- start start 2023-07-27T14:30:22.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.531+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4bb00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.531+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b54f60 0x563ee4b9b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.531+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b7ee90 0x563ee4b9b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.531+0000 7f27d860fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee4b9c040 con 0x563ee4b7ee90 2023-07-27T14:30:22.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.531+0000 7f27d860fb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee4b9be70 con 0x563ee4b525c0 2023-07-27T14:30:22.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.531+0000 7f27d860fb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ee4b512a0 con 0x563ee4b54f60 2023-07-27T14:30:22.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b7ee90 0x563ee4b9b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b7ee90 0x563ee4b9b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59738/0 (socket says 172.21.15.115:59738) 2023-07-27T14:30:22.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 -- 172.21.15.115:0/1658748169 learned_addr learned my addr 172.21.15.115:0/1658748169 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:22.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27ba59c700 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b54f60 0x563ee4b9b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bad9d700 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4bb00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 -- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b54f60 msgr2=0x563ee4b9b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b54f60 0x563ee4b9b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 -- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 msgr2=0x563ee4bb00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4bb00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 -- 172.21.15.115:0/1658748169 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ee4a98ee0 con 0x563ee4b7ee90 2023-07-27T14:30:22.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bad9d700 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4bb00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:22.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.532+0000 7f27bb59e700 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b7ee90 0x563ee4b9b980 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x563ee4b7e420 tx=0x7f27b401e000).ready entity=mon.0 client_cookie=8ddab8a0edb61e97 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27a09ff700 1 -- 172.21.15.115:0/1658748169 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4022040 con 0x563ee4b7ee90 2023-07-27T14:30:22.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27a09ff700 1 -- 172.21.15.115:0/1658748169 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b400bc50 con 0x563ee4b7ee90 2023-07-27T14:30:22.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27a09ff700 1 -- 172.21.15.115:0/1658748169 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4013840 con 0x563ee4b7ee90 2023-07-27T14:30:22.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 -- 172.21.15.115:0/1658748169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b7ee90 msgr2=0x563ee4b9b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b7ee90 0x563ee4b9b980 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x563ee4b7e420 tx=0x7f27b401e000).stop 2023-07-27T14:30:22.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 -- 172.21.15.115:0/1658748169 shutdown_connections 2023-07-27T14:30:22.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b7ee90 0x563ee4b9b980 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4bb00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1658748169 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b54f60 0x563ee4b9b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 -- 172.21.15.115:0/1658748169 >> 172.21.15.115:0/1658748169 conn(0x563ee49bd940 msgr2=0x563ee4b4f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:22.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 -- 172.21.15.115:0/1658748169 shutdown_connections 2023-07-27T14:30:22.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.533+0000 7f27d860fb80 1 -- 172.21.15.115:0/1658748169 wait complete. 2023-07-27T14:30:22.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.534+0000 7f27d860fb80 1 -- start start 2023-07-27T14:30:22.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.534+0000 7f27d860fb80 1 Processor -- start 2023-07-27T14:30:22.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b7d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4b98900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27d860fb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 0x563ee4b98df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27d860fb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee4be6ce0 con 0x563ee4b54f60 2023-07-27T14:30:22.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27d860fb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee4b99980 con 0x563ee4b525c0 2023-07-27T14:30:22.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27d860fb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ee4c00d00 con 0x563ee4b7ee90 2023-07-27T14:30:22.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27d860fb80 10 client.0 ll_register_callbacks cb 0x563ee4a574a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:30:22.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27ba59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4b98900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27ba59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4b98900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59748/0 (socket says 172.21.15.115:59748) 2023-07-27T14:30:22.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27ba59c700 1 -- 172.21.15.115:0/1925837163 learned_addr learned my addr 172.21.15.115:0/1925837163 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:22.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.535+0000 7f27bb59e700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 0x563ee4b98df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27bad9d700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b7d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27ba59c700 1 -- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 msgr2=0x563ee4b98df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27ba59c700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 0x563ee4b98df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27ba59c700 1 -- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 msgr2=0x563ee4b7d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:22.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27ba59c700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b7d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27ba59c700 1 -- 172.21.15.115:0/1925837163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ee4a9d9a0 con 0x563ee4b54f60 2023-07-27T14:30:22.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27bb59e700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 0x563ee4b98df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:22.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27bad9d700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b7d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:22.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27ba59c700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4b98900 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f27b004ef80 tx=0x7f27b0051040).ready entity=mon.0 client_cookie=1fcabdb0efacca6d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27997fa700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:30:22.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27997fa700 1 -- 172.21.15.115:0/1925837163 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b004d720 con 0x563ee4b54f60 2023-07-27T14:30:22.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27d860fb80 1 -- 172.21.15.115:0/1925837163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27b400bae0 con 0x563ee4b54f60 2023-07-27T14:30:22.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27997fa700 1 -- 172.21.15.115:0/1925837163 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f27b0054040 con 0x563ee4b54f60 2023-07-27T14:30:22.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27997fa700 1 -- 172.21.15.115:0/1925837163 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27b004b990 con 0x563ee4b54f60 2023-07-27T14:30:22.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27d860fb80 10 client.6135 fetch_fsmap learned FSMap version 33 2023-07-27T14:30:22.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27d860fb80 1 -- 172.21.15.115:0/1925837163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x563ee49131d0 con 0x563ee4b54f60 2023-07-27T14:30:22.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.536+0000 7f27997fa700 1 -- 172.21.15.115:0/1925837163 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b400bae0 con 0x563ee4b54f60 2023-07-27T14:30:22.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27997fa700 1 -- 172.21.15.115:0/1925837163 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 33) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27b004e770 con 0x563ee4b54f60 2023-07-27T14:30:22.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27d860fb80 10 client.6135 fetch_fsmap finished waiting for FSMap version 33 2023-07-27T14:30:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27d860fb80 10 client.6135 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:30:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27d860fb80 20 client.6135 populate_metadata read hostname 'smithi115' 2023-07-27T14:30:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] conn(0x563ee4c00f50 0x563ee4c01330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27d860fb80 4 client.6135 mds_command: new command op to 5979 tid=0[{"prefix": "status"}] 2023-07-27T14:30:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27d860fb80 1 -- 172.21.15.115:0/1925837163 --> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563ee4943040 con 0x563ee4c00f50 2023-07-27T14:30:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27bad9d700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] conn(0x563ee4c00f50 0x563ee4c01330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27bad9d700 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] conn(0x563ee4c00f50 0x563ee4c01330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=dc24f3480b2f9d1d server_cookie=7ba78b14fa9bba27 in_seq=0 out_seq=0 2023-07-27T14:30:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.537+0000 7f27997fa700 10 client.6135 ms_handle_connect on v2:172.21.15.115:6834/2262768820 2023-07-27T14:30:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27997fa700 1 -- 172.21.15.115:0/1925837163 <== mds.0 v2:172.21.15.115:6834/2262768820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563ee4943040 con 0x563ee4c00f50 2023-07-27T14:30:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27997fa700 10 client.6135 handle_command_reply: tid=0 2023-07-27T14:30:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 client.6135 shutdown 2023-07-27T14:30:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 -- 172.21.15.115:0/1925837163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 msgr2=0x563ee4b98900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4b98900 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f27b004ef80 tx=0x7f27b0051040).stop 2023-07-27T14:30:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 -- 172.21.15.115:0/1925837163 shutdown_connections 2023-07-27T14:30:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563ee4b7ee90 0x563ee4b98df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563ee4b525c0 0x563ee4b7d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.115:6834/2262768820,v1:172.21.15.115:6836/2262768820] conn(0x563ee4c00f50 0x563ee4c01330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 --2- 172.21.15.115:0/1925837163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563ee4b54f60 0x563ee4b98900 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27997fa700 0 client.6135 ms_handle_reset on v2:172.21.15.115:6834/2262768820 2023-07-27T14:30:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 -- 172.21.15.115:0/1925837163 >> 172.21.15.115:0/1925837163 conn(0x563ee49bd940 msgr2=0x563ee4b79820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 -- 172.21.15.115:0/1925837163 shutdown_connections 2023-07-27T14:30:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 1 -- 172.21.15.115:0/1925837163 wait complete. 2023-07-27T14:30:22.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.538+0000 7f27d860fb80 20 client.6135 trim_cache size 0 max 16384 2023-07-27T14:30:22.576 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:30:22.576 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:30:22.576 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:30:22.576 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 5979, 2023-07-27T14:30:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:30:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:30:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:30:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2886619640000001, 2023-07-27T14:30:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 33, 2023-07-27T14:30:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 68, 2023-07-27T14:30:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 68, 2023-07-27T14:30:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.515703950000001 2023-07-27T14:30:22.578 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:30:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 -- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27a805f060 msgr2=0x7f27a8061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27a805f060 0x7f27a8061520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f27ac009b90 tx=0x7f27ac009060).stop 2023-07-27T14:30:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 -- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 msgr2=0x7f27bc0c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0c9b30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f27b000e930 tx=0x7f27b0009060).stop 2023-07-27T14:30:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 -- 172.21.15.115:0/2278667323 shutdown_connections 2023-07-27T14:30:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27a805f060 0x7f27a8061520 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27bc153ec0 0x7f27bc0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27bc0aa050 0x7f27bc14e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 --2- 172.21.15.115:0/2278667323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27bc0aaa40 0x7f27bc0c9b30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 -- 172.21.15.115:0/2278667323 >> 172.21.15.115:0/2278667323 conn(0x7f27bc0cb610 msgr2=0x7f27bc0afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 -- 172.21.15.115:0/2278667323 shutdown_connections 2023-07-27T14:30:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.539+0000 7f27c11ff700 1 -- 172.21.15.115:0/2278667323 wait complete. 2023-07-27T14:30:22.584 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:30:22.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.713+0000 7f0ed33ff700 1 Processor -- start 2023-07-27T14:30:22.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.713+0000 7f0ed33ff700 1 -- start start 2023-07-27T14:30:22.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.714+0000 7f0ed33ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc153f70 0x7f0ecc154350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.714+0000 7f0ed33ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc0630a0 con 0x7f0ecc0bc070 2023-07-27T14:30:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.714+0000 7f0ed33ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc062490 con 0x7f0ecc063530 2023-07-27T14:30:22.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.714+0000 7f0ed33ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc062770 con 0x7f0ecc153f70 2023-07-27T14:30:22.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.714+0000 7f0ed099a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0ecc0bc070 0x7f0ecc0bcf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33278/0 (socket says 172.21.15.115:33278) 2023-07-27T14:30:22.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.714+0000 7f0ed099a700 1 -- 172.21.15.115:0/2949406855 learned_addr learned my addr 172.21.15.115:0/2949406855 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:22.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ed119b700 1 --2- 172.21.15.115:0/2949406855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc153f70 0x7f0ecc154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ec3fff700 1 -- 172.21.15.115:0/2949406855 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814568475 0 0) 0x7f0ecc0630a0 con 0x7f0ecc0bc070 2023-07-27T14:30:22.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ec3fff700 1 -- 172.21.15.115:0/2949406855 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb80033f0 con 0x7f0ecc0bc070 2023-07-27T14:30:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ec3fff700 1 -- 172.21.15.115:0/2949406855 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669004349 0 0) 0x7f0ecc062490 con 0x7f0ecc063530 2023-07-27T14:30:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ec3fff700 1 -- 172.21.15.115:0/2949406855 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ecc0630a0 con 0x7f0ecc063530 2023-07-27T14:30:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ed119b700 1 -- 172.21.15.115:0/2949406855 >> v1:172.21.15.159:6789/0 conn(0x7f0ecc063530 legacy=0x7f0ecc0c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ed119b700 1 -- 172.21.15.115:0/2949406855 >> v1:172.21.15.115:6789/0 conn(0x7f0ecc0bc070 legacy=0x7f0ecc0bcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ed119b700 1 -- 172.21.15.115:0/2949406855 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc062a50 con 0x7f0ecc153f70 2023-07-27T14:30:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ed119b700 1 --2- 172.21.15.115:0/2949406855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc153f70 0x7f0ecc154350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0ec8009790 tx=0x7f0ec8009060).ready entity=mon.2 client_cookie=4fd4e10d82b44ee3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.715+0000 7f0ec3fff700 1 -- 172.21.15.115:0/2949406855 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800f510 con 0x7f0ecc153f70 2023-07-27T14:30:22.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ec3fff700 1 -- 172.21.15.115:0/2949406855 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec800f670 con 0x7f0ecc153f70 2023-07-27T14:30:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ec3fff700 1 -- 172.21.15.115:0/2949406855 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800f9f0 con 0x7f0ecc153f70 2023-07-27T14:30:22.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ed33ff700 1 -- 172.21.15.115:0/2949406855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc153f70 msgr2=0x7f0ecc154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ed33ff700 1 --2- 172.21.15.115:0/2949406855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc153f70 0x7f0ecc154350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0ec8009790 tx=0x7f0ec8009060).stop 2023-07-27T14:30:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ed33ff700 1 -- 172.21.15.115:0/2949406855 shutdown_connections 2023-07-27T14:30:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ed33ff700 1 --2- 172.21.15.115:0/2949406855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc153f70 0x7f0ecc154350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ed33ff700 1 -- 172.21.15.115:0/2949406855 >> 172.21.15.115:0/2949406855 conn(0x7f0ecc0c3bb0 msgr2=0x7f0ecc0c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ed33ff700 1 -- 172.21.15.115:0/2949406855 shutdown_connections 2023-07-27T14:30:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.716+0000 7f0ed33ff700 1 -- 172.21.15.115:0/2949406855 wait complete. 2023-07-27T14:30:22.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.718+0000 7f0ed33ff700 1 Processor -- start 2023-07-27T14:30:22.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.718+0000 7f0ed33ff700 1 -- start start 2023-07-27T14:30:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed33ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc063530 0x7f0ecc0a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed33ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc0bc070 0x7f0ecc13e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed33ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ecc153f70 0x7f0ecc168490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed33ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc159cf0 con 0x7f0ecc0bc070 2023-07-27T14:30:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed33ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc0a96a0 con 0x7f0ecc153f70 2023-07-27T14:30:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed33ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc0a8810 con 0x7f0ecc063530 2023-07-27T14:30:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc0bc070 0x7f0ecc13e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc0bc070 0x7f0ecc13e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59756/0 (socket says 172.21.15.115:59756) 2023-07-27T14:30:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed099a700 1 -- 172.21.15.115:0/908133722 learned_addr learned my addr 172.21.15.115:0/908133722 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:22.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed119b700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc063530 0x7f0ecc0a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed199c700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ecc153f70 0x7f0ecc168490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed099a700 1 -- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc063530 msgr2=0x7f0ecc0a8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.719+0000 7f0ed099a700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc063530 0x7f0ecc0a8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ed099a700 1 -- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ecc153f70 msgr2=0x7f0ecc168490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ed099a700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ecc153f70 0x7f0ecc168490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ed099a700 1 -- 172.21.15.115:0/908133722 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80092a0 con 0x7f0ecc0bc070 2023-07-27T14:30:22.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ed119b700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc063530 0x7f0ecc0a8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ed199c700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ecc153f70 0x7f0ecc168490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ed099a700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc0bc070 0x7f0ecc13e6a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0ebc00c560 tx=0x7f0ebc007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ec17fa700 1 -- 172.21.15.115:0/908133722 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0072e0 con 0x7f0ecc0bc070 2023-07-27T14:30:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ec17fa700 1 -- 172.21.15.115:0/908133722 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc007440 con 0x7f0ecc0bc070 2023-07-27T14:30:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc13eb90 con 0x7f0ecc0bc070 2023-07-27T14:30:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ec17fa700 1 -- 172.21.15.115:0/908133722 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0057a0 con 0x7f0ecc0bc070 2023-07-27T14:30:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.720+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc0a8a90 con 0x7f0ecc0bc070 2023-07-27T14:30:22.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.721+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc06bb50 con 0x7f0ecc0bc070 2023-07-27T14:30:22.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.722+0000 7f0ec17fa700 1 -- 172.21.15.115:0/908133722 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f0ebc01a060 con 0x7f0ecc0bc070 2023-07-27T14:30:22.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.723+0000 7f0ec17fa700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0eb005f060 0x7f0eb0061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:22.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.723+0000 7f0ec17fa700 1 -- 172.21.15.115:0/908133722 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ebc0798c0 con 0x7f0ecc0bc070 2023-07-27T14:30:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.723+0000 7f0ed119b700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0eb005f060 0x7f0eb0061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:22.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.724+0000 7f0ed119b700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0eb005f060 0x7f0eb0061520 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f0ec80096e0 tx=0x7f0ec8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:22.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.727+0000 7f0ec17fa700 1 -- 172.21.15.115:0/908133722 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ebc04aa80 con 0x7f0ecc0bc070 2023-07-27T14:30:22.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.936+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ecc05e150 con 0x7f0ecc0bc070 2023-07-27T14:30:22.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.936+0000 7f0ec17fa700 1 -- 172.21.15.115:0/908133722 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ebc018020 con 0x7f0ecc0bc070 2023-07-27T14:30:22.965 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:30:22.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0eb005f060 msgr2=0x7f0eb0061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0eb005f060 0x7f0eb0061520 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f0ec80096e0 tx=0x7f0ec8017000).stop 2023-07-27T14:30:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc0bc070 msgr2=0x7f0ecc13e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc0bc070 0x7f0ecc13e6a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0ebc00c560 tx=0x7f0ebc007cc0).stop 2023-07-27T14:30:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 shutdown_connections 2023-07-27T14:30:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0eb005f060 0x7f0eb0061520 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ecc153f70 0x7f0ecc168490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0ecc063530 0x7f0ecc0a8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 --2- 172.21.15.115:0/908133722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ecc0bc070 0x7f0ecc13e6a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:22.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 >> 172.21.15.115:0/908133722 conn(0x7f0ecc0c3bb0 msgr2=0x7f0ecc069660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:22.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 shutdown_connections 2023-07-27T14:30:22.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:22.938+0000 7f0ed33ff700 1 -- 172.21.15.115:0/908133722 wait complete. 2023-07-27T14:30:22.982 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:30:22.982 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:30:22.983 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:30:22.984 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:30:22.984 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:30:22.984 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:30:22.985 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:30:22.985 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:30:22.986 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:30:22.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:22.987 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:30:23.034 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:30:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:30:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:30:23.035 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:23.035 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:30:23.035 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:23.035 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:30:23.035 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:23.035 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:30:23.036 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:30:23.036 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:23.036 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:30:23.036 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:30:23.036 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:23.037 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:30:23.037 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:23.037 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:30:23.037 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41778sec preferred_lft 41778sec 2023-07-27T14:30:23.037 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:30:23.037 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:23.037 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:30:23.038 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:23.038 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:30:23.038 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:23.038 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:30:23.038 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:23.038 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:30:23.038 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:30:23.039 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:30:23.039 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:23.039 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:30:23.039 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:30:23.039 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:30:23.039 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:23.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:23.041 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:30:23.108 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:30:23.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:23.111 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:30:23.158 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:30:23.159 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:30:23.159 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:30:23.159 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:30:23.160 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:30:23.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:23.161 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:30:23.161 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:30:23.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:30:23.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:30:23.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:30:23.163 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:30:23.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:23.331 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:30:23.377 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:30:23.377 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:30:23.378 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:30:23.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:23.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:30:23.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:23.449 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:30:23.495 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:30:23.496 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:30:23.633 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:30:23.633 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:30:23.660 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:30:23.660 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:30:23.667 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:30:23.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:23.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:30:23.737 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:30:23.912 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.883+0000 7f2fc0bff700 1 Processor -- start 2023-07-27T14:30:23.912 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.883+0000 7f2fc0bff700 1 -- start start 2023-07-27T14:30:23.913 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.884+0000 7f2fc0bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2fbc154190 0x7f2fbc0a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:23.913 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.884+0000 7f2fc0bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2fbc0c64b0 0x7f2fbc0641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:23.913 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.884+0000 7f2fc0bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc158e00 con 0x7f2fbc0646c0 2023-07-27T14:30:23.914 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.884+0000 7f2fc0bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0aa640 con 0x7f2fbc154190 2023-07-27T14:30:23.914 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.884+0000 7f2fc0bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc064b30 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb9d9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2fbc0c64b0 0x7f2fbc0641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:23.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb9d9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2fbc0c64b0 0x7f2fbc0641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40006/0 (socket says 172.21.15.159:40006) 2023-07-27T14:30:23.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb9d9b700 1 -- 172.21.15.159:0/4031147025 learned_addr learned my addr 172.21.15.159:0/4031147025 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:30:23.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fbad9d700 1 --1- 172.21.15.159:0/4031147025 >> v1:172.21.15.159:6789/0 conn(0x7f2fbc0646c0 0x7f2fbc0bfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:52132/0 (socket says 172.21.15.159:52132) 2023-07-27T14:30:23.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fba59c700 1 --2- 172.21.15.159:0/4031147025 >> v2:172.21.15.115:3300/0 conn(0x7f2fbc154190 0x7f2fbc0a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:23.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb9d9b700 1 -- 172.21.15.159:0/4031147025 >> v2:172.21.15.115:3300/0 conn(0x7f2fbc154190 msgr2=0x7f2fbc0a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:23.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb9d9b700 1 --2- 172.21.15.159:0/4031147025 >> v2:172.21.15.115:3300/0 conn(0x7f2fbc154190 0x7f2fbc0a9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:23.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb9d9b700 1 -- 172.21.15.159:0/4031147025 >> v1:172.21.15.159:6789/0 conn(0x7f2fbc0646c0 legacy=0x7f2fbc0bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:23.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb9d9b700 1 -- 172.21.15.159:0/4031147025 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc158040 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb9d9b700 1 --2- 172.21.15.159:0/4031147025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 0x7f2fbc0641d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f2fbc0c87b0 tx=0x7f2fb00090f0).ready entity=mon.1 client_cookie=49521114b077bf3b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:23.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.885+0000 7f2fb959a700 1 -- 172.21.15.159:0/4031147025 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000b600 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fb959a700 1 -- 172.21.15.159:0/4031147025 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb000b760 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fb959a700 1 -- 172.21.15.159:0/4031147025 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000bb00 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fc0bff700 1 -- 172.21.15.159:0/4031147025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 msgr2=0x7f2fbc0641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:23.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/4031147025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 0x7f2fbc0641d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f2fbc0c87b0 tx=0x7f2fb00090f0).stop 2023-07-27T14:30:23.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fc0bff700 1 -- 172.21.15.159:0/4031147025 shutdown_connections 2023-07-27T14:30:23.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/4031147025 >> v2:172.21.15.115:3300/0 conn(0x7f2fbc154190 0x7f2fbc0a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:23.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/4031147025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 0x7f2fbc0641d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:23.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fc0bff700 1 -- 172.21.15.159:0/4031147025 >> 172.21.15.159:0/4031147025 conn(0x7f2fbc0cb730 msgr2=0x7f2fbc0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:23.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fc0bff700 1 -- 172.21.15.159:0/4031147025 shutdown_connections 2023-07-27T14:30:23.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.886+0000 7f2fc0bff700 1 -- 172.21.15.159:0/4031147025 wait complete. 2023-07-27T14:30:23.920 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.888+0000 7f2fc0bff700 1 Processor -- start 2023-07-27T14:30:23.920 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.888+0000 7f2fc0bff700 1 -- start start 2023-07-27T14:30:23.920 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fc0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fbc0646c0 0x7f2fbc152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:23.920 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fc0bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 0x7f2fbc0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:23.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fc0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fbc154190 0x7f2fbc0a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:23.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fc0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc153440 con 0x7f2fbc154190 2023-07-27T14:30:23.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fc0bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c2ec0 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fc0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c3840 con 0x7f2fbc0646c0 2023-07-27T14:30:23.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fba59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fbc0646c0 0x7f2fbc152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:23.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fb9d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 0x7f2fbc0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:23.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fba59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fbc0646c0 0x7f2fbc152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:59220/0 (socket says 172.21.15.159:59220) 2023-07-27T14:30:23.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fba59c700 1 -- 172.21.15.159:0/3475172674 learned_addr learned my addr 172.21.15.159:0/3475172674 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:30:23.922 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.889+0000 7f2fbad9d700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fbc154190 0x7f2fbc0a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:23.922 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fb9d9b700 1 -- 172.21.15.159:0/3475172674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fbc0646c0 msgr2=0x7f2fbc152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:23.922 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fb9d9b700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fbc0646c0 0x7f2fbc152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:23.922 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fb9d9b700 1 -- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fbc154190 msgr2=0x7f2fbc0a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:23.922 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fb9d9b700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fbc154190 0x7f2fbc0a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:23.922 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fb9d9b700 1 -- 172.21.15.159:0/3475172674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0009370 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.923 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fbad9d700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fbc154190 0x7f2fbc0a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:23.923 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fb9d9b700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 0x7f2fbc0c3350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f2fbc084510 tx=0x7f2fb0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:23.923 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2faa7fc700 1 -- 172.21.15.159:0/3475172674 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000bec0 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.923 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2faa7fc700 1 -- 172.21.15.159:0/3475172674 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb000b8d0 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.923 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2faa7fc700 1 -- 172.21.15.159:0/3475172674 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0024470 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.924 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc0c22b0 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.924 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.890+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc0c2870 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.924 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.891+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc05f0c0 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.925 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.892+0000 7f2faa7fc700 1 -- 172.21.15.159:0/3475172674 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f2fb000f070 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.925 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.893+0000 7f2faa7fc700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9c05f030 0x7f2f9c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:23.925 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.893+0000 7f2faa7fc700 1 -- 172.21.15.159:0/3475172674 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2fb007bbf0 con 0x7f2fbc0c64b0 2023-07-27T14:30:23.925 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.893+0000 7f2fba59c700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9c05f030 0x7f2f9c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:23.925 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.894+0000 7f2fba59c700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9c05f030 0x7f2f9c0614f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f2fac006fd0 tx=0x7f2fac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:23.926 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:23.898+0000 7f2faa7fc700 1 -- 172.21.15.159:0/3475172674 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2fb004cdb0 con 0x7f2fbc0c64b0 2023-07-27T14:30:24.135 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.106+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2fbc158320 con 0x7f2fbc0c64b0 2023-07-27T14:30:24.136 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.107+0000 7f2faa7fc700 1 -- 172.21.15.159:0/3475172674 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2fb0029070 con 0x7f2fbc0c64b0 2023-07-27T14:30:24.136 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:30:24.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9c05f030 msgr2=0x7f2f9c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:24.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9c05f030 0x7f2f9c0614f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f2fac006fd0 tx=0x7f2fac008040).stop 2023-07-27T14:30:24.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 msgr2=0x7f2fbc0c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:24.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 0x7f2fbc0c3350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f2fbc084510 tx=0x7f2fb0017000).stop 2023-07-27T14:30:24.138 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 shutdown_connections 2023-07-27T14:30:24.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9c05f030 0x7f2f9c0614f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:24.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fbc154190 0x7f2fbc0a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:24.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fbc0646c0 0x7f2fbc152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:24.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 --2- 172.21.15.159:0/3475172674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fbc0c64b0 0x7f2fbc0c3350 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:24.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 >> 172.21.15.159:0/3475172674 conn(0x7f2fbc0cb730 msgr2=0x7f2fbc0a9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:24.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 shutdown_connections 2023-07-27T14:30:24.139 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:30:24.109+0000 7f2fc0bff700 1 -- 172.21.15.159:0/3475172674 wait complete. 2023-07-27T14:30:24.152 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:30:24.153 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:30:24.153 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:30:24.153 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:30:24.153 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:30:24.154 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:30:24.154 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:30:24.154 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:30:24.154 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:30:24.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:24.155 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:30:24.202 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:30:24.203 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:30:24.203 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:30:24.203 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:24.203 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:30:24.203 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:24.204 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:30:24.204 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:24.204 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:30:24.204 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:30:24.204 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:24.204 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:30:24.204 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:30:24.205 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:24.205 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:30:24.205 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:24.205 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:30:24.205 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41773sec preferred_lft 41773sec 2023-07-27T14:30:24.205 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:30:24.205 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:24.206 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:30:24.206 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:30:24.206 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:30:24.206 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:24.206 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:30:24.206 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:24.206 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:30:24.207 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:30:24.207 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:30:24.207 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:24.207 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:30:24.207 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:30:24.207 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:30:24.207 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:30:24.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:24.209 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:30:24.277 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:30:24.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:24.280 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:30:24.332 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:30:24.332 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:30:24.333 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:30:24.333 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:30:24.333 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:30:24.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:24.334 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:30:24.335 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:30:24.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:30:24.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:30:24.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:30:24.336 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:30:24.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:24.507 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:30:24.554 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:30:24.554 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:30:24.555 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:30:24.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:24.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:30:24.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:24.628 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:30:24.674 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:30:24.674 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:30:24.773 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:30:24.773 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:30:24.799 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:30:24.800 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:30:24.806 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:30:24.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:24.806 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:30:24.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:30:25.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.049+0000 7f1fd31ff700 1 Processor -- start 2023-07-27T14:30:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.050+0000 7f1fd31ff700 1 -- start start 2023-07-27T14:30:25.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.051+0000 7f1fd31ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc067760 0x7f1fcc064f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.051+0000 7f1fd31ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1fcc068250 0x7f1fcc0be160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.051+0000 7f1fd31ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc063430 con 0x7f1fcc0a4840 2023-07-27T14:30:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.051+0000 7f1fd31ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc065440 con 0x7f1fcc068250 2023-07-27T14:30:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.051+0000 7f1fd31ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0bdcd0 con 0x7f1fcc067760 2023-07-27T14:30:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd179c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1fcc068250 0x7f1fcc0be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd179c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1fcc068250 0x7f1fcc0be160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36422/0 (socket says 172.21.15.115:36422) 2023-07-27T14:30:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd179c700 1 -- 172.21.15.115:0/3922475093 learned_addr learned my addr 172.21.15.115:0/3922475093 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd0f9b700 1 --2- 172.21.15.115:0/3922475093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc067760 0x7f1fcc064f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd179c700 1 -- 172.21.15.115:0/3922475093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc067760 msgr2=0x7f1fcc064f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd179c700 1 --2- 172.21.15.115:0/3922475093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc067760 0x7f1fcc064f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd179c700 1 -- 172.21.15.115:0/3922475093 >> v1:172.21.15.159:6789/0 conn(0x7f1fcc0a4840 legacy=0x7f1fcc067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd179c700 1 -- 172.21.15.115:0/3922475093 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc066930 con 0x7f1fcc068250 2023-07-27T14:30:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.052+0000 7f1fd179c700 1 --2- 172.21.15.115:0/3922475093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 0x7f1fcc0be160 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f1fc4009f20 tx=0x7f1fc4009840).ready entity=mon.0 client_cookie=b8711c593236c8c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fcb7fe700 1 -- 172.21.15.115:0/3922475093 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400e070 con 0x7f1fcc068250 2023-07-27T14:30:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fcb7fe700 1 -- 172.21.15.115:0/3922475093 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc400b9d0 con 0x7f1fcc068250 2023-07-27T14:30:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fcb7fe700 1 -- 172.21.15.115:0/3922475093 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400bd50 con 0x7f1fcc068250 2023-07-27T14:30:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fd31ff700 1 -- 172.21.15.115:0/3922475093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 msgr2=0x7f1fcc0be160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/3922475093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 0x7f1fcc0be160 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f1fc4009f20 tx=0x7f1fc4009840).stop 2023-07-27T14:30:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fd31ff700 1 -- 172.21.15.115:0/3922475093 shutdown_connections 2023-07-27T14:30:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/3922475093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc067760 0x7f1fcc064f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/3922475093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 0x7f1fcc0be160 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fd31ff700 1 -- 172.21.15.115:0/3922475093 >> 172.21.15.115:0/3922475093 conn(0x7f1fcc05e980 msgr2=0x7f1fcc065f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fd31ff700 1 -- 172.21.15.115:0/3922475093 shutdown_connections 2023-07-27T14:30:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.053+0000 7f1fd31ff700 1 -- 172.21.15.115:0/3922475093 wait complete. 2023-07-27T14:30:25.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.055+0000 7f1fd31ff700 1 Processor -- start 2023-07-27T14:30:25.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.055+0000 7f1fd31ff700 1 -- start start 2023-07-27T14:30:25.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fd31ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fcc067760 0x7f1fcc0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fd31ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 0x7f1fcc0ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fd31ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc0a4840 0x7f1fcc14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fd31ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0c28d0 con 0x7f1fcc068250 2023-07-27T14:30:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fd31ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0adfb0 con 0x7f1fcc067760 2023-07-27T14:30:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fd31ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0c2090 con 0x7f1fcc0a4840 2023-07-27T14:30:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fcbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 0x7f1fcc0ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fcbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 0x7f1fcc0ae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36426/0 (socket says 172.21.15.115:36426) 2023-07-27T14:30:25.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fcbfff700 1 -- 172.21.15.115:0/4111628012 learned_addr learned my addr 172.21.15.115:0/4111628012 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fd0f9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fcc067760 0x7f1fcc0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.056+0000 7f1fd179c700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc0a4840 0x7f1fcc14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fd179c700 1 -- 172.21.15.115:0/4111628012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fcc067760 msgr2=0x7f1fcc0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fd179c700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fcc067760 0x7f1fcc0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fd179c700 1 -- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 msgr2=0x7f1fcc0ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fd179c700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 0x7f1fcc0ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fd179c700 1 -- 172.21.15.115:0/4111628012 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4009ae0 con 0x7f1fcc0a4840 2023-07-27T14:30:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fd179c700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc0a4840 0x7f1fcc14cd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1fc4013000 tx=0x7f1fcc064ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fc8ff9700 1 -- 172.21.15.115:0/4111628012 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40092e0 con 0x7f1fcc0a4840 2023-07-27T14:30:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fc8ff9700 1 -- 172.21.15.115:0/4111628012 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc4013e30 con 0x7f1fcc0a4840 2023-07-27T14:30:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc0c2310 con 0x7f1fcc0a4840 2023-07-27T14:30:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fc8ff9700 1 -- 172.21.15.115:0/4111628012 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc401e6c0 con 0x7f1fcc0a4840 2023-07-27T14:30:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.057+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc0adc40 con 0x7f1fcc0a4840 2023-07-27T14:30:25.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.058+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc06c470 con 0x7f1fcc0a4840 2023-07-27T14:30:25.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.059+0000 7f1fc8ff9700 1 -- 172.21.15.115:0/4111628012 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f1fc401b040 con 0x7f1fcc0a4840 2023-07-27T14:30:25.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.060+0000 7f1fc8ff9700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fb005f060 0x7f1fb0061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.060+0000 7f1fc8ff9700 1 -- 172.21.15.115:0/4111628012 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1fc407b240 con 0x7f1fcc0a4840 2023-07-27T14:30:25.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.060+0000 7f1fd0f9b700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fb005f060 0x7f1fb0061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.061+0000 7f1fd0f9b700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fb005f060 0x7f1fb0061520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f1fc0009b90 tx=0x7f1fc0009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:25.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.065+0000 7f1fc8ff9700 1 -- 172.21.15.115:0/4111628012 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1fc404c4b0 con 0x7f1fcc0a4840 2023-07-27T14:30:25.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.275+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1fcc0670d0 con 0x7f1fcc0a4840 2023-07-27T14:30:25.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.458+0000 7f1fc8ff9700 1 -- 172.21.15.115:0/4111628012 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 136+0+0 (secure 0 0 0) 0x7f1fc4023020 con 0x7f1fcc0a4840 2023-07-27T14:30:25.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fb005f060 msgr2=0x7f1fb0061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fb005f060 0x7f1fb0061520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f1fc0009b90 tx=0x7f1fc0009060).stop 2023-07-27T14:30:25.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc0a4840 msgr2=0x7f1fcc14cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc0a4840 0x7f1fcc14cd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1fc4013000 tx=0x7f1fcc064ac0).stop 2023-07-27T14:30:25.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 shutdown_connections 2023-07-27T14:30:25.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1fb005f060 0x7f1fb0061520 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fcc0a4840 0x7f1fcc14cd80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fcc067760 0x7f1fcc0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 --2- 172.21.15.115:0/4111628012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc068250 0x7f1fcc0ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 >> 172.21.15.115:0/4111628012 conn(0x7f1fcc05e980 msgr2=0x7f1fcc0c8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:25.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 shutdown_connections 2023-07-27T14:30:25.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.460+0000 7f1fd31ff700 1 -- 172.21.15.115:0/4111628012 wait complete. 2023-07-27T14:30:25.506 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:30:25.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.667+0000 7fe2c0bff700 1 Processor -- start 2023-07-27T14:30:25.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.667+0000 7fe2c0bff700 1 -- start start 2023-07-27T14:30:25.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.668+0000 7fe2c0bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2bc0aaa40 0x7fe2bc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.668+0000 7fe2c0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc1542a0 0x7fe2bc0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.668+0000 7fe2c0bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2bc0aa4d0 con 0x7fe2bc153ec0 2023-07-27T14:30:25.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.668+0000 7fe2c0bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2bc064ad0 con 0x7fe2bc0aaa40 2023-07-27T14:30:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.668+0000 7fe2c0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0c05c0 con 0x7fe2bc1542a0 2023-07-27T14:30:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.668+0000 7fe2b9d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2bc0aaa40 0x7fe2bc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.668+0000 7fe2ba59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe2bc153ec0 0x7fe2bc0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51620/0 (socket says 172.21.15.115:51620) 2023-07-27T14:30:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.668+0000 7fe2ba59c700 1 -- 172.21.15.115:0/2104631075 learned_addr learned my addr 172.21.15.115:0/2104631075 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2bad9d700 1 --2- 172.21.15.115:0/2104631075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc1542a0 0x7fe2bc0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b9d9b700 1 -- 172.21.15.115:0/2104631075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc1542a0 msgr2=0x7fe2bc0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b9d9b700 1 --2- 172.21.15.115:0/2104631075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc1542a0 0x7fe2bc0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b9d9b700 1 -- 172.21.15.115:0/2104631075 >> v1:172.21.15.115:6789/0 conn(0x7fe2bc153ec0 legacy=0x7fe2bc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b9d9b700 1 -- 172.21.15.115:0/2104631075 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc0c1a60 con 0x7fe2bc0aaa40 2023-07-27T14:30:25.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b959a700 1 -- 172.21.15.115:0/2104631075 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898348072 0 0) 0x7fe2ac001110 con 0x7fe2bc153ec0 2023-07-27T14:30:25.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2bad9d700 1 --2- 172.21.15.115:0/2104631075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc1542a0 0x7fe2bc0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:25.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b9d9b700 1 --2- 172.21.15.115:0/2104631075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0aaa40 0x7fe2bc0640f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fe2b0009760 tx=0x7fe2b0009060).ready entity=mon.0 client_cookie=444259dd2f2b5d7f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:25.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b959a700 1 -- 172.21.15.115:0/2104631075 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000b580 con 0x7fe2bc0aaa40 2023-07-27T14:30:25.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b959a700 1 -- 172.21.15.115:0/2104631075 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b000b6e0 con 0x7fe2bc0aaa40 2023-07-27T14:30:25.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.669+0000 7fe2b959a700 1 -- 172.21.15.115:0/2104631075 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000ba60 con 0x7fe2bc0aaa40 2023-07-27T14:30:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.670+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2104631075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0aaa40 msgr2=0x7fe2bc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.670+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2104631075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0aaa40 0x7fe2bc0640f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fe2b0009760 tx=0x7fe2b0009060).stop 2023-07-27T14:30:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.670+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2104631075 shutdown_connections 2023-07-27T14:30:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.670+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2104631075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc1542a0 0x7fe2bc0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.670+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2104631075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0aaa40 0x7fe2bc0640f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.670+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2104631075 >> 172.21.15.115:0/2104631075 conn(0x7fe2bc0cb610 msgr2=0x7fe2bc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.670+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2104631075 shutdown_connections 2023-07-27T14:30:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.670+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2104631075 wait complete. 2023-07-27T14:30:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.671+0000 7fe2c0bff700 1 Processor -- start 2023-07-27T14:30:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.672+0000 7fe2c0bff700 1 -- start start 2023-07-27T14:30:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2c0bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aaa40 0x7fe2bc13f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2c0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc153ec0 0x7fe2bc0ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2c0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc1542a0 0x7fe2bc0ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2c0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0abe10 con 0x7fe2bc1542a0 2023-07-27T14:30:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2c0bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0c2d00 con 0x7fe2bc0aaa40 2023-07-27T14:30:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2c0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0c23f0 con 0x7fe2bc153ec0 2023-07-27T14:30:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc1542a0 0x7fe2bc0ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc1542a0 0x7fe2bc0ab920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36454/0 (socket says 172.21.15.115:36454) 2023-07-27T14:30:25.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 -- 172.21.15.115:0/2133357956 learned_addr learned my addr 172.21.15.115:0/2133357956 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:25.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2b9d9b700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc153ec0 0x7fe2bc0ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2ba59c700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aaa40 0x7fe2bc13f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 -- 172.21.15.115:0/2133357956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc153ec0 msgr2=0x7fe2bc0ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc153ec0 0x7fe2bc0ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 -- 172.21.15.115:0/2133357956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aaa40 msgr2=0x7fe2bc13f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aaa40 0x7fe2bc13f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 -- 172.21.15.115:0/2133357956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00092a0 con 0x7fe2bc1542a0 2023-07-27T14:30:25.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.673+0000 7fe2bad9d700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc1542a0 0x7fe2bc0ab920 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe2b4009f70 tx=0x7fe2b40099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:25.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.674+0000 7fe2aa7fc700 1 -- 172.21.15.115:0/2133357956 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400dce0 con 0x7fe2bc1542a0 2023-07-27T14:30:25.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.674+0000 7fe2aa7fc700 1 -- 172.21.15.115:0/2133357956 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b400f040 con 0x7fe2bc1542a0 2023-07-27T14:30:25.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.674+0000 7fe2aa7fc700 1 -- 172.21.15.115:0/2133357956 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4013600 con 0x7fe2bc1542a0 2023-07-27T14:30:25.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.674+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc0b0a60 con 0x7fe2bc1542a0 2023-07-27T14:30:25.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.674+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc0c2990 con 0x7fe2bc1542a0 2023-07-27T14:30:25.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.675+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2bc06c470 con 0x7fe2bc1542a0 2023-07-27T14:30:25.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.676+0000 7fe2aa7fc700 1 -- 172.21.15.115:0/2133357956 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7fe2b40139f0 con 0x7fe2bc1542a0 2023-07-27T14:30:25.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.676+0000 7fe2aa7fc700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe29c05f060 0x7fe29c061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:25.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.676+0000 7fe2aa7fc700 1 -- 172.21.15.115:0/2133357956 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe2b407a7b0 con 0x7fe2bc1542a0 2023-07-27T14:30:25.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.677+0000 7fe2ba59c700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe29c05f060 0x7fe29c061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:25.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.677+0000 7fe2ba59c700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe29c05f060 0x7fe29c061520 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fe2ac001680 tx=0x7fe2ac009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:25.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.680+0000 7fe2aa7fc700 1 -- 172.21.15.115:0/2133357956 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe2b404ba80 con 0x7fe2bc1542a0 2023-07-27T14:30:25.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.872+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2bc062540 con 0x7fe29c05f060 2023-07-27T14:30:25.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.873+0000 7fe2aa7fc700 1 -- 172.21.15.115:0/2133357956 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe2bc062540 con 0x7fe29c05f060 2023-07-27T14:30:25.902 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:30:25.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:30:25.902 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:30:25.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:25.902 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:30:25.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe29c05f060 msgr2=0x7fe29c061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe29c05f060 0x7fe29c061520 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fe2ac001680 tx=0x7fe2ac009040).stop 2023-07-27T14:30:25.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc1542a0 msgr2=0x7fe2bc0ab920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:25.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc1542a0 0x7fe2bc0ab920 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe2b4009f70 tx=0x7fe2b40099b0).stop 2023-07-27T14:30:25.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 shutdown_connections 2023-07-27T14:30:25.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe29c05f060 0x7fe29c061520 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc1542a0 0x7fe2bc0ab920 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2bc0aaa40 0x7fe2bc13f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 --2- 172.21.15.115:0/2133357956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe2bc153ec0 0x7fe2bc0ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:25.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 >> 172.21.15.115:0/2133357956 conn(0x7fe2bc0cb610 msgr2=0x7fe2bc156330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:25.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 shutdown_connections 2023-07-27T14:30:25.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:25.875+0000 7fe2c0bff700 1 -- 172.21.15.115:0/2133357956 wait complete. 2023-07-27T14:30:25.921 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:30:26.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.082+0000 7f60713ff700 1 Processor -- start 2023-07-27T14:30:26.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.082+0000 7f60713ff700 1 -- start start 2023-07-27T14:30:26.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f60713ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c14ae00 0x7f606c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f60713ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f606c14b1e0 0x7f606c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f60713ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c1553f0 con 0x7f606c0c5c50 2023-07-27T14:30:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f60713ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606c157a50 con 0x7f606c14b1e0 2023-07-27T14:30:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f60713ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c157d10 con 0x7f606c14ae00 2023-07-27T14:30:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f606b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f606c0c5c50 0x7f606c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51622/0 (socket says 172.21.15.115:51622) 2023-07-27T14:30:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f606a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f606c14b1e0 0x7f606c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f606b7fe700 1 -- 172.21.15.115:0/150607944 learned_addr learned my addr 172.21.15.115:0/150607944 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:26.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f606affd700 1 --2- 172.21.15.115:0/150607944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c14ae00 0x7f606c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f606a7fc700 1 -- 172.21.15.115:0/150607944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c14ae00 msgr2=0x7f606c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f606a7fc700 1 --2- 172.21.15.115:0/150607944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c14ae00 0x7f606c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f606a7fc700 1 -- 172.21.15.115:0/150607944 >> v1:172.21.15.115:6789/0 conn(0x7f606c0c5c50 legacy=0x7f606c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f606a7fc700 1 -- 172.21.15.115:0/150607944 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c157ff0 con 0x7f606c14b1e0 2023-07-27T14:30:26.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.084+0000 7f6069ffb700 1 -- 172.21.15.115:0/150607944 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841218870 0 0) 0x7f606c1553f0 con 0x7f606c0c5c50 2023-07-27T14:30:26.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f606a7fc700 1 --2- 172.21.15.115:0/150607944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14b1e0 0x7f606c062b50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f6060009760 tx=0x7f6060009060).ready entity=mon.0 client_cookie=acbf993bfacebdbb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f6069ffb700 1 -- 172.21.15.115:0/150607944 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606000f510 con 0x7f606c14b1e0 2023-07-27T14:30:26.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f6069ffb700 1 -- 172.21.15.115:0/150607944 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606000f670 con 0x7f606c14b1e0 2023-07-27T14:30:26.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f6069ffb700 1 -- 172.21.15.115:0/150607944 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606000f9f0 con 0x7f606c14b1e0 2023-07-27T14:30:26.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f60713ff700 1 -- 172.21.15.115:0/150607944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14b1e0 msgr2=0x7f606c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f60713ff700 1 --2- 172.21.15.115:0/150607944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14b1e0 0x7f606c062b50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f6060009760 tx=0x7f6060009060).stop 2023-07-27T14:30:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f60713ff700 1 -- 172.21.15.115:0/150607944 shutdown_connections 2023-07-27T14:30:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f60713ff700 1 --2- 172.21.15.115:0/150607944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c14ae00 0x7f606c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f60713ff700 1 --2- 172.21.15.115:0/150607944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14b1e0 0x7f606c062b50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.085+0000 7f60713ff700 1 -- 172.21.15.115:0/150607944 >> 172.21.15.115:0/150607944 conn(0x7f606c05e940 msgr2=0x7f606c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.086+0000 7f60713ff700 1 -- 172.21.15.115:0/150607944 shutdown_connections 2023-07-27T14:30:26.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.086+0000 7f60713ff700 1 -- 172.21.15.115:0/150607944 wait complete. 2023-07-27T14:30:26.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.087+0000 7f60713ff700 1 Processor -- start 2023-07-27T14:30:26.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.087+0000 7f60713ff700 1 -- start start 2023-07-27T14:30:26.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f60713ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0c5c50 0x7f606c13e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f60713ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14ae00 0x7f606c0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f60713ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c14b1e0 0x7f606c0a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f60713ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c0c4550 con 0x7f606c14ae00 2023-07-27T14:30:26.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f60713ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c0c3940 con 0x7f606c14b1e0 2023-07-27T14:30:26.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f60713ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c0c3c20 con 0x7f606c0c5c50 2023-07-27T14:30:26.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f606a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14ae00 0x7f606c0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f606a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14ae00 0x7f606c0b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36464/0 (socket says 172.21.15.115:36464) 2023-07-27T14:30:26.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.088+0000 7f606a7fc700 1 -- 172.21.15.115:0/3210913908 learned_addr learned my addr 172.21.15.115:0/3210913908 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:26.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f606b7fe700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c14b1e0 0x7f606c0a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f606affd700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0c5c50 0x7f606c13e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f606a7fc700 1 -- 172.21.15.115:0/3210913908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0c5c50 msgr2=0x7f606c13e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f606a7fc700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0c5c50 0x7f606c13e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f606a7fc700 1 -- 172.21.15.115:0/3210913908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c14b1e0 msgr2=0x7f606c0a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f606a7fc700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c14b1e0 0x7f606c0a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f606a7fc700 1 -- 172.21.15.115:0/3210913908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600092a0 con 0x7f606c14ae00 2023-07-27T14:30:26.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f606a7fc700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14ae00 0x7f606c0b0480 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f606c0c53b0 tx=0x7f6060017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f6052ffd700 1 -- 172.21.15.115:0/3210913908 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606000fe80 con 0x7f606c14ae00 2023-07-27T14:30:26.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f6052ffd700 1 -- 172.21.15.115:0/3210913908 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606000f7e0 con 0x7f606c14ae00 2023-07-27T14:30:26.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f6052ffd700 1 -- 172.21.15.115:0/3210913908 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606001c630 con 0x7f606c14ae00 2023-07-27T14:30:26.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c0c3f00 con 0x7f606c14ae00 2023-07-27T14:30:26.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.089+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c13ead0 con 0x7f606c14ae00 2023-07-27T14:30:26.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.090+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c06c470 con 0x7f606c14ae00 2023-07-27T14:30:26.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.091+0000 7f6052ffd700 1 -- 172.21.15.115:0/3210913908 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f606002c070 con 0x7f606c14ae00 2023-07-27T14:30:26.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.092+0000 7f6052ffd700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805f060 0x7f6058061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.092+0000 7f6052ffd700 1 -- 172.21.15.115:0/3210913908 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f606007bca0 con 0x7f606c14ae00 2023-07-27T14:30:26.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.092+0000 7f606affd700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805f060 0x7f6058061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.093+0000 7f606affd700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805f060 0x7f6058061520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f605c009c30 tx=0x7f605c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.096+0000 7f6052ffd700 1 -- 172.21.15.115:0/3210913908 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f606004cf10 con 0x7f606c14ae00 2023-07-27T14:30:26.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.266+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f606c0c4690 con 0x7f606c14ae00 2023-07-27T14:30:26.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.266+0000 7f6052ffd700 1 -- 172.21.15.115:0/3210913908 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6060020020 con 0x7f606c14ae00 2023-07-27T14:30:26.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805f060 msgr2=0x7f6058061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805f060 0x7f6058061520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f605c009c30 tx=0x7f605c009060).stop 2023-07-27T14:30:26.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14ae00 msgr2=0x7f606c0b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14ae00 0x7f606c0b0480 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f606c0c53b0 tx=0x7f6060017000).stop 2023-07-27T14:30:26.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 shutdown_connections 2023-07-27T14:30:26.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805f060 0x7f6058061520 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f606c14b1e0 0x7f606c0a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f606c0c5c50 0x7f606c13e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 --2- 172.21.15.115:0/3210913908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f606c14ae00 0x7f606c0b0480 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 >> 172.21.15.115:0/3210913908 conn(0x7f606c05e940 msgr2=0x7f606c0ac450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:26.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 shutdown_connections 2023-07-27T14:30:26.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.268+0000 7f60713ff700 1 -- 172.21.15.115:0/3210913908 wait complete. 2023-07-27T14:30:26.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000478966 --mode=777 2023-07-27T14:30:26.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.479+0000 7f0c513ff700 1 Processor -- start 2023-07-27T14:30:26.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.480+0000 7f0c513ff700 1 -- start start 2023-07-27T14:30:26.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c513ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0c4c063260 0x7f0c4c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c513ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c4c14b1e0 0x7f0c4c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c513ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c1553f0 con 0x7f0c4c14ae00 2023-07-27T14:30:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c513ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c157a50 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c513ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c157d10 con 0x7f0c4c063260 2023-07-27T14:30:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c4b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c4c14b1e0 0x7f0c4c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c4b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c4c14b1e0 0x7f0c4c0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36470/0 (socket says 172.21.15.115:36470) 2023-07-27T14:30:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c4b7fe700 1 -- 172.21.15.115:0/2327164710 learned_addr learned my addr 172.21.15.115:0/2327164710 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.481+0000 7f0c4a7fc700 1 --2- 172.21.15.115:0/2327164710 >> v2:172.21.15.159:3300/0 conn(0x7f0c4c063260 0x7f0c4c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c4b7fe700 1 -- 172.21.15.115:0/2327164710 >> v2:172.21.15.159:3300/0 conn(0x7f0c4c063260 msgr2=0x7f0c4c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c4b7fe700 1 --2- 172.21.15.115:0/2327164710 >> v2:172.21.15.159:3300/0 conn(0x7f0c4c063260 0x7f0c4c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c4b7fe700 1 -- 172.21.15.115:0/2327164710 >> v1:172.21.15.159:6789/0 conn(0x7f0c4c14ae00 legacy=0x7f0c4c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c4b7fe700 1 -- 172.21.15.115:0/2327164710 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c157ff0 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c4b7fe700 1 --2- 172.21.15.115:0/2327164710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c0a98c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f0c4c0cbc00 tx=0x7f0c44009840).ready entity=mon.0 client_cookie=687dd2fd97586934 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c49ffb700 1 -- 172.21.15.115:0/2327164710 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400e070 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c49ffb700 1 -- 172.21.15.115:0/2327164710 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4400ba20 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c49ffb700 1 -- 172.21.15.115:0/2327164710 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400bda0 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c513ff700 1 -- 172.21.15.115:0/2327164710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 msgr2=0x7f0c4c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2327164710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c0a98c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f0c4c0cbc00 tx=0x7f0c44009840).stop 2023-07-27T14:30:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c513ff700 1 -- 172.21.15.115:0/2327164710 shutdown_connections 2023-07-27T14:30:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2327164710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c0a98c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.482+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2327164710 >> v2:172.21.15.159:3300/0 conn(0x7f0c4c063260 0x7f0c4c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.483+0000 7f0c513ff700 1 -- 172.21.15.115:0/2327164710 >> 172.21.15.115:0/2327164710 conn(0x7f0c4c05e940 msgr2=0x7f0c4c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.483+0000 7f0c513ff700 1 -- 172.21.15.115:0/2327164710 shutdown_connections 2023-07-27T14:30:26.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.483+0000 7f0c513ff700 1 -- 172.21.15.115:0/2327164710 wait complete. 2023-07-27T14:30:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.485+0000 7f0c513ff700 1 Processor -- start 2023-07-27T14:30:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.485+0000 7f0c513ff700 1 -- start start 2023-07-27T14:30:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c513ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4c063260 0x7f0c4c164af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c513ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c4c14ae00 0x7f0c4c14cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c513ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c14d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c513ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14d8e0 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c513ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14c3c0 con 0x7f0c4c063260 2023-07-27T14:30:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c513ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14b7b0 con 0x7f0c4c14ae00 2023-07-27T14:30:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c14d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c14d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36478/0 (socket says 172.21.15.115:36478) 2023-07-27T14:30:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c4b7fe700 1 -- 172.21.15.115:0/2649232675 learned_addr learned my addr 172.21.15.115:0/2649232675 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c4a7fc700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c4c14ae00 0x7f0c4c14cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.486+0000 7f0c4affd700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4c063260 0x7f0c4c164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c4b7fe700 1 -- 172.21.15.115:0/2649232675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c4c14ae00 msgr2=0x7f0c4c14cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c4b7fe700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c4c14ae00 0x7f0c4c14cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c4b7fe700 1 -- 172.21.15.115:0/2649232675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4c063260 msgr2=0x7f0c4c164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c4b7fe700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4c063260 0x7f0c4c164af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c4b7fe700 1 -- 172.21.15.115:0/2649232675 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c44009ae0 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c4b7fe700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c14d3f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f0c44010000 tx=0x7f0c4c14eb20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c32ffd700 1 -- 172.21.15.115:0/2649232675 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400bda0 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c32ffd700 1 -- 172.21.15.115:0/2649232675 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c440092e0 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c32ffd700 1 -- 172.21.15.115:0/2649232675 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4401d6b0 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c14ba90 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.487+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c14c050 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.488+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c14c750 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.489+0000 7f0c32ffd700 1 -- 172.21.15.115:0/2649232675 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7f0c44024030 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.490+0000 7f0c32ffd700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3805f060 0x7f0c38061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.490+0000 7f0c32ffd700 1 -- 172.21.15.115:0/2649232675 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0c4407b1d0 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.490+0000 7f0c4affd700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3805f060 0x7f0c38061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.491+0000 7f0c4affd700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3805f060 0x7f0c38061520 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f0c4c14ce10 tx=0x7f0c3c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.494+0000 7f0c32ffd700 1 -- 172.21.15.115:0/2649232675 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0c4c14c750 con 0x7f0c4c14b1e0 2023-07-27T14:30:26.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.696+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000478966", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c4c14c750 con 0x7f0c3805f060 2023-07-27T14:30:26.730 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:26.702+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:26.731 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:26.702+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:26.731 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:26.702+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:26.731 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:26.702+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:26.731 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:26.702+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:26.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.737+0000 7f0c32ffd700 1 -- 172.21.15.115:0/2649232675 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0c4c14c750 con 0x7f0c3805f060 2023-07-27T14:30:26.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3805f060 msgr2=0x7f0c38061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3805f060 0x7f0c38061520 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f0c4c14ce10 tx=0x7f0c3c009040).stop 2023-07-27T14:30:26.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 msgr2=0x7f0c4c14d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c14d3f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f0c44010000 tx=0x7f0c4c14eb20).stop 2023-07-27T14:30:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 shutdown_connections 2023-07-27T14:30:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3805f060 0x7f0c38061520 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c4c14b1e0 0x7f0c4c14d3f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4c063260 0x7f0c4c164af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 --2- 172.21.15.115:0/2649232675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c4c14ae00 0x7f0c4c14cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 >> 172.21.15.115:0/2649232675 conn(0x7f0c4c05e940 msgr2=0x7f0c4c0a9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:26.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 shutdown_connections 2023-07-27T14:30:26.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.740+0000 7f0c513ff700 1 -- 172.21.15.115:0/2649232675 wait complete. 2023-07-27T14:30:26.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000478966 2023-07-27T14:30:26.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.949+0000 7ff94a1ff700 1 Processor -- start 2023-07-27T14:30:26.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.949+0000 7ff94a1ff700 1 -- start start 2023-07-27T14:30:26.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.950+0000 7ff94a1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff944063260 0x7ff944154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.950+0000 7ff94a1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff94414b1e0 0x7ff9440a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.950+0000 7ff94a1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9441553f0 con 0x7ff94414ae00 2023-07-27T14:30:26.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.950+0000 7ff94a1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff944157a50 con 0x7ff94414b1e0 2023-07-27T14:30:26.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.950+0000 7ff94a1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff944157d10 con 0x7ff944063260 2023-07-27T14:30:26.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff943fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff94414b1e0 0x7ff9440a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff9437fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff94414ae00 0x7ff944062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51626/0 (socket says 172.21.15.115:51626) 2023-07-27T14:30:26.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff9437fe700 1 -- 172.21.15.115:0/3000952959 learned_addr learned my addr 172.21.15.115:0/3000952959 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:26.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff942ffd700 1 --2- 172.21.15.115:0/3000952959 >> v2:172.21.15.159:3300/0 conn(0x7ff944063260 0x7ff944154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff943fff700 1 -- 172.21.15.115:0/3000952959 >> v2:172.21.15.159:3300/0 conn(0x7ff944063260 msgr2=0x7ff944154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff943fff700 1 --2- 172.21.15.115:0/3000952959 >> v2:172.21.15.159:3300/0 conn(0x7ff944063260 0x7ff944154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff943fff700 1 -- 172.21.15.115:0/3000952959 >> v1:172.21.15.115:6789/0 conn(0x7ff94414ae00 legacy=0x7ff944062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff943fff700 1 -- 172.21.15.115:0/3000952959 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944157ff0 con 0x7ff94414b1e0 2023-07-27T14:30:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff9427fc700 1 -- 172.21.15.115:0/3000952959 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413178787 0 0) 0x7ff9441553f0 con 0x7ff94414ae00 2023-07-27T14:30:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff943fff700 1 --2- 172.21.15.115:0/3000952959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414b1e0 0x7ff9440a98c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7ff9440cbc00 tx=0x7ff93c009780).ready entity=mon.0 client_cookie=f8ff6d81aee2ff20 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.951+0000 7ff9427fc700 1 -- 172.21.15.115:0/3000952959 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00e070 con 0x7ff94414b1e0 2023-07-27T14:30:26.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff9427fc700 1 -- 172.21.15.115:0/3000952959 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00bb60 con 0x7ff94414b1e0 2023-07-27T14:30:26.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff9427fc700 1 -- 172.21.15.115:0/3000952959 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c012410 con 0x7ff94414b1e0 2023-07-27T14:30:26.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff94a1ff700 1 -- 172.21.15.115:0/3000952959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414b1e0 msgr2=0x7ff9440a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/3000952959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414b1e0 0x7ff9440a98c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7ff9440cbc00 tx=0x7ff93c009780).stop 2023-07-27T14:30:26.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff94a1ff700 1 -- 172.21.15.115:0/3000952959 shutdown_connections 2023-07-27T14:30:26.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/3000952959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414b1e0 0x7ff9440a98c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/3000952959 >> v2:172.21.15.159:3300/0 conn(0x7ff944063260 0x7ff944154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff94a1ff700 1 -- 172.21.15.115:0/3000952959 >> 172.21.15.115:0/3000952959 conn(0x7ff94405e940 msgr2=0x7ff9440cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:26.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff94a1ff700 1 -- 172.21.15.115:0/3000952959 shutdown_connections 2023-07-27T14:30:26.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.952+0000 7ff94a1ff700 1 -- 172.21.15.115:0/3000952959 wait complete. 2023-07-27T14:30:26.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.954+0000 7ff94a1ff700 1 Processor -- start 2023-07-27T14:30:26.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.954+0000 7ff94a1ff700 1 -- start start 2023-07-27T14:30:26.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff94a1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff944063260 0x7ff944148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff94a1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414ae00 0x7ff9440afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff94a1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94414b1e0 0x7ff9440a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff94a1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440af590 con 0x7ff94414ae00 2023-07-27T14:30:26.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff94a1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff944148e70 con 0x7ff94414b1e0 2023-07-27T14:30:26.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff94a1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944164830 con 0x7ff944063260 2023-07-27T14:30:26.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff942ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414ae00 0x7ff9440afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff942ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414ae00 0x7ff9440afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36522/0 (socket says 172.21.15.115:36522) 2023-07-27T14:30:26.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff942ffd700 1 -- 172.21.15.115:0/2455118211 learned_addr learned my addr 172.21.15.115:0/2455118211 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:26.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff942ffd700 1 -- 172.21.15.115:0/2455118211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff944063260 msgr2=0x7ff944148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff942ffd700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff944063260 0x7ff944148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:26.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff942ffd700 1 -- 172.21.15.115:0/2455118211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94414b1e0 msgr2=0x7ff9440a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:26.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff943fff700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94414b1e0 0x7ff9440a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff942ffd700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94414b1e0 0x7ff9440a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:26.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff942ffd700 1 -- 172.21.15.115:0/2455118211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c009a20 con 0x7ff94414ae00 2023-07-27T14:30:26.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.955+0000 7ff943fff700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94414b1e0 0x7ff9440a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:26.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.956+0000 7ff942ffd700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414ae00 0x7ff9440afa20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7ff93800e900 tx=0x7ff938009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.956+0000 7ff92b7fe700 1 -- 172.21.15.115:0/2455118211 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800eea0 con 0x7ff94414ae00 2023-07-27T14:30:26.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.956+0000 7ff92b7fe700 1 -- 172.21.15.115:0/2455118211 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800c850 con 0x7ff94414ae00 2023-07-27T14:30:26.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.956+0000 7ff92b7fe700 1 -- 172.21.15.115:0/2455118211 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800cbd0 con 0x7ff94414ae00 2023-07-27T14:30:26.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.956+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9440aec60 con 0x7ff94414ae00 2023-07-27T14:30:26.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.956+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9440af220 con 0x7ff94414ae00 2023-07-27T14:30:26.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.957+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9440af870 con 0x7ff94414ae00 2023-07-27T14:30:26.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.958+0000 7ff92b7fe700 1 -- 172.21.15.115:0/2455118211 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 10) v1 ==== 75642+0+0 (secure 0 0 0) 0x7ff938022070 con 0x7ff94414ae00 2023-07-27T14:30:26.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.959+0000 7ff92b7fe700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff93005f060 0x7ff930061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:26.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.959+0000 7ff92b7fe700 1 -- 172.21.15.115:0/2455118211 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff93807a3e0 con 0x7ff94414ae00 2023-07-27T14:30:26.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.959+0000 7ff9437fe700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff93005f060 0x7ff930061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:26.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.960+0000 7ff9437fe700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff93005f060 0x7ff930061520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7ff9340011e0 tx=0x7ff934007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:26.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:26.963+0000 7ff92b7fe700 1 -- 172.21.15.115:0/2455118211 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff93804b6b0 con 0x7ff94414ae00 2023-07-27T14:30:27.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.165+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000478966", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9440af6d0 con 0x7ff93005f060 2023-07-27T14:30:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.170+0000 7ff92b7fe700 1 -- 172.21.15.115:0/2455118211 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7ff9440af6d0 con 0x7ff93005f060 2023-07-27T14:30:27.199 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601 2023-07-27T14:30:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff93005f060 msgr2=0x7ff930061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff93005f060 0x7ff930061520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7ff9340011e0 tx=0x7ff934007850).stop 2023-07-27T14:30:27.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414ae00 msgr2=0x7ff9440afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:27.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414ae00 0x7ff9440afa20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7ff93800e900 tx=0x7ff938009060).stop 2023-07-27T14:30:27.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 shutdown_connections 2023-07-27T14:30:27.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff93005f060 0x7ff930061520 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:27.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff94414b1e0 0x7ff9440a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:27.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff944063260 0x7ff944148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 --2- 172.21.15.115:0/2455118211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff94414ae00 0x7ff9440afa20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 >> 172.21.15.115:0/2455118211 conn(0x7ff94405e940 msgr2=0x7ff94414a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 shutdown_connections 2023-07-27T14:30:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:27.172+0000 7ff94a1ff700 1 -- 172.21.15.115:0/2455118211 wait complete. 2023-07-27T14:30:27.218 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000478966 with 200 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601 2023-07-27T14:30:27.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.219 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.293 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.294 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.294 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194322 s, 54.0 MB/s 2023-07-27T14:30:27.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.295 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.360 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.360 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.360 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179128 s, 58.5 MB/s 2023-07-27T14:30:27.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.362 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.422 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.422 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.423 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142626 s, 73.5 MB/s 2023-07-27T14:30:27.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.424 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.483 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.484 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.484 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136077 s, 77.1 MB/s 2023-07-27T14:30:27.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.485 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.546 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.547 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.547 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01427 s, 73.5 MB/s 2023-07-27T14:30:27.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.548 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.609 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.609 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.610 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147294 s, 71.2 MB/s 2023-07-27T14:30:27.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.611 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.676 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.676 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165891 s, 63.2 MB/s 2023-07-27T14:30:27.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.678 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162185 s, 64.7 MB/s 2023-07-27T14:30:27.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.743 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166416 s, 63.0 MB/s 2023-07-27T14:30:27.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.814 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.875 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.875 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142012 s, 73.8 MB/s 2023-07-27T14:30:27.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.876 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.937 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.937 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.937 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140654 s, 74.5 MB/s 2023-07-27T14:30:27.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:27.939 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:27.999 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:27.999 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:27.999 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141472 s, 74.1 MB/s 2023-07-27T14:30:28.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.001 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.062 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.063 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.063 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154571 s, 67.8 MB/s 2023-07-27T14:30:28.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.064 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.127 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.127 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.127 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156067 s, 67.2 MB/s 2023-07-27T14:30:28.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.128 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.189 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.189 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.189 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143447 s, 73.1 MB/s 2023-07-27T14:30:28.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.191 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.254 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.254 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.254 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165712 s, 63.3 MB/s 2023-07-27T14:30:28.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.255 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.320 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.321 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.321 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188463 s, 55.6 MB/s 2023-07-27T14:30:28.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.322 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.382 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.382 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.382 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132025 s, 79.4 MB/s 2023-07-27T14:30:28.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.384 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.443 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.444 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134559 s, 77.9 MB/s 2023-07-27T14:30:28.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.445 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.507 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.508 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.508 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155894 s, 67.3 MB/s 2023-07-27T14:30:28.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.509 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.570 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.570 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.571 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141935 s, 73.9 MB/s 2023-07-27T14:30:28.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.572 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.632 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.633 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.633 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133111 s, 78.8 MB/s 2023-07-27T14:30:28.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.634 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.694 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.694 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.694 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128219 s, 81.8 MB/s 2023-07-27T14:30:28.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.696 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.759 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.759 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.759 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170208 s, 61.6 MB/s 2023-07-27T14:30:28.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.761 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.821 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.821 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.821 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137029 s, 76.5 MB/s 2023-07-27T14:30:28.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.823 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.884 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.884 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.884 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142701 s, 73.5 MB/s 2023-07-27T14:30:28.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.886 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:28.947 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:28.948 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:28.948 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155199 s, 67.6 MB/s 2023-07-27T14:30:28.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:28.949 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.013 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176569 s, 59.4 MB/s 2023-07-27T14:30:29.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.015 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.075 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.076 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.076 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140959 s, 74.4 MB/s 2023-07-27T14:30:29.077 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:30:29.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.078 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.121 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:30:29.182 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.183 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.183 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152256 s, 68.9 MB/s 2023-07-27T14:30:29.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.184 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.318 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.318 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.319 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130549 s, 80.3 MB/s 2023-07-27T14:30:29.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.320 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.381 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.382 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.382 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149167 s, 70.3 MB/s 2023-07-27T14:30:29.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.383 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.443 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.444 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.444 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014301 s, 73.3 MB/s 2023-07-27T14:30:29.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.445 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.507 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.507 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.507 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151995 s, 69.0 MB/s 2023-07-27T14:30:29.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.509 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.567 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.568 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.568 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126977 s, 82.6 MB/s 2023-07-27T14:30:29.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.569 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.631 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.632 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.632 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158877 s, 66.0 MB/s 2023-07-27T14:30:29.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.633 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.695 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.695 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.695 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014579 s, 71.9 MB/s 2023-07-27T14:30:29.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.697 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.758 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.812 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.812 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156388 s, 67.0 MB/s 2023-07-27T14:30:29.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.814 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.876 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.876 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.877 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155614 s, 67.4 MB/s 2023-07-27T14:30:29.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.878 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:29.939 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:29.940 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:29.940 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154648 s, 67.8 MB/s 2023-07-27T14:30:29.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:29.945 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.009 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.009 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.009 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169492 s, 61.9 MB/s 2023-07-27T14:30:30.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.010 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.071 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.071 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.071 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138199 s, 75.9 MB/s 2023-07-27T14:30:30.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.072 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.133 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.133 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.133 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136932 s, 76.6 MB/s 2023-07-27T14:30:30.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.135 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.196 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.196 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.196 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143256 s, 73.2 MB/s 2023-07-27T14:30:30.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.198 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.259 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145053 s, 72.3 MB/s 2023-07-27T14:30:30.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.262 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.322 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.323 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.323 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143757 s, 72.9 MB/s 2023-07-27T14:30:30.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.324 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167808 s, 62.5 MB/s 2023-07-27T14:30:30.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.390 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.451 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.452 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.452 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154419 s, 67.9 MB/s 2023-07-27T14:30:30.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.453 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177242 s, 59.2 MB/s 2023-07-27T14:30:30.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.520 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.584 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.584 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.585 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170759 s, 61.4 MB/s 2023-07-27T14:30:30.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.586 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.651 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.652 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.652 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189503 s, 55.3 MB/s 2023-07-27T14:30:30.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.653 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.713 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.713 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.713 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134349 s, 78.0 MB/s 2023-07-27T14:30:30.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.714 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.775 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.775 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.775 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140464 s, 74.7 MB/s 2023-07-27T14:30:30.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.776 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.838 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.838 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.838 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148197 s, 70.8 MB/s 2023-07-27T14:30:30.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.839 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.899 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.899 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.899 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012174 s, 86.1 MB/s 2023-07-27T14:30:30.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.901 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:30.960 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:30.960 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:30.961 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128666 s, 81.5 MB/s 2023-07-27T14:30:30.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:30.963 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.023 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.024 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.024 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014358 s, 73.0 MB/s 2023-07-27T14:30:31.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.025 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.090 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.090 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.091 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180465 s, 58.1 MB/s 2023-07-27T14:30:31.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.093 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.156 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.156 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.156 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015761 s, 66.5 MB/s 2023-07-27T14:30:31.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.157 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.219 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.220 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.220 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153742 s, 68.2 MB/s 2023-07-27T14:30:31.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.222 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.288 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.288 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.288 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180891 s, 58.0 MB/s 2023-07-27T14:30:31.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.289 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.350 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.351 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.351 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145201 s, 72.2 MB/s 2023-07-27T14:30:31.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.352 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149993 s, 69.9 MB/s 2023-07-27T14:30:31.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.415 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.475 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.476 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.476 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138174 s, 75.9 MB/s 2023-07-27T14:30:31.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.477 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.538 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.538 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.538 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146186 s, 71.7 MB/s 2023-07-27T14:30:31.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.540 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.601 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.601 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.601 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147593 s, 71.0 MB/s 2023-07-27T14:30:31.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.602 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.663 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.664 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143177 s, 73.2 MB/s 2023-07-27T14:30:31.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.665 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.725 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.725 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.725 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132713 s, 79.0 MB/s 2023-07-27T14:30:31.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.726 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.787 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.787 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.787 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145296 s, 72.2 MB/s 2023-07-27T14:30:31.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.789 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.852 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.852 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.852 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152519 s, 68.8 MB/s 2023-07-27T14:30:31.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.854 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.917 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.918 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.918 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171553 s, 61.1 MB/s 2023-07-27T14:30:31.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.919 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:31.979 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:31.980 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:31.980 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127606 s, 82.2 MB/s 2023-07-27T14:30:31.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:31.981 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.042 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.042 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.042 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145812 s, 71.9 MB/s 2023-07-27T14:30:32.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.044 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.104 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.105 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.105 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147679 s, 71.0 MB/s 2023-07-27T14:30:32.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.106 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.168 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.168 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.168 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145612 s, 72.0 MB/s 2023-07-27T14:30:32.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.170 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.230 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.230 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.230 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136894 s, 76.6 MB/s 2023-07-27T14:30:32.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.231 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139858 s, 75.0 MB/s 2023-07-27T14:30:32.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.294 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.358 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.358 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.359 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172379 s, 60.8 MB/s 2023-07-27T14:30:32.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.360 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.425 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.425 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.425 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177906 s, 58.9 MB/s 2023-07-27T14:30:32.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.426 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.489 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.489 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.489 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160625 s, 65.3 MB/s 2023-07-27T14:30:32.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.491 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.552 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.552 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.553 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148284 s, 70.7 MB/s 2023-07-27T14:30:32.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.554 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.612 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.613 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.613 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125022 s, 83.9 MB/s 2023-07-27T14:30:32.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.614 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.679 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.680 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187851 s, 55.8 MB/s 2023-07-27T14:30:32.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.681 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.747 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.747 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.747 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183078 s, 57.3 MB/s 2023-07-27T14:30:32.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.749 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.812 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.812 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.812 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015273 s, 68.7 MB/s 2023-07-27T14:30:32.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.814 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.875 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013398 s, 78.3 MB/s 2023-07-27T14:30:32.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.877 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:32.939 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:32.939 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:32.939 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145537 s, 72.0 MB/s 2023-07-27T14:30:32.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:32.941 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.002 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.002 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.002 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135339 s, 77.5 MB/s 2023-07-27T14:30:33.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.004 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.065 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.066 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.066 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144565 s, 72.5 MB/s 2023-07-27T14:30:33.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.068 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.131 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.132 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.132 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158355 s, 66.2 MB/s 2023-07-27T14:30:33.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.135 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.197 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142081 s, 73.8 MB/s 2023-07-27T14:30:33.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.199 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.258 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.259 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128269 s, 81.7 MB/s 2023-07-27T14:30:33.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.260 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.322 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.323 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.323 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014066 s, 74.5 MB/s 2023-07-27T14:30:33.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.325 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.387 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.387 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.387 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143471 s, 73.1 MB/s 2023-07-27T14:30:33.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.389 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155476 s, 67.4 MB/s 2023-07-27T14:30:33.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.453 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141675 s, 74.0 MB/s 2023-07-27T14:30:33.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.516 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.578 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.578 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.578 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148002 s, 70.8 MB/s 2023-07-27T14:30:33.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.580 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.640 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.640 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.640 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137705 s, 76.1 MB/s 2023-07-27T14:30:33.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.642 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.701 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.701 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.701 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139528 s, 75.2 MB/s 2023-07-27T14:30:33.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.702 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.762 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.763 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.763 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145547 s, 72.0 MB/s 2023-07-27T14:30:33.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.764 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.825 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.825 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.825 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154392 s, 67.9 MB/s 2023-07-27T14:30:33.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.827 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146492 s, 71.6 MB/s 2023-07-27T14:30:33.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.890 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:33.954 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:33.954 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:33.955 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170731 s, 61.4 MB/s 2023-07-27T14:30:33.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:33.956 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140902 s, 74.4 MB/s 2023-07-27T14:30:34.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.018 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.079 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.079 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.080 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141251 s, 74.2 MB/s 2023-07-27T14:30:34.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.081 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.145 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.146 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.146 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183406 s, 57.2 MB/s 2023-07-27T14:30:34.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.147 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.210 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.211 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.211 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167082 s, 62.8 MB/s 2023-07-27T14:30:34.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.213 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.275 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.275 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.275 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155296 s, 67.5 MB/s 2023-07-27T14:30:34.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.276 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.341 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.341 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.341 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175132 s, 59.9 MB/s 2023-07-27T14:30:34.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.343 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.404 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.404 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.404 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137193 s, 76.4 MB/s 2023-07-27T14:30:34.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.405 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133865 s, 78.3 MB/s 2023-07-27T14:30:34.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.466 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.525 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.525 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.525 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012931 s, 81.1 MB/s 2023-07-27T14:30:34.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.527 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.587 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.587 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.587 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014178 s, 74.0 MB/s 2023-07-27T14:30:34.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.589 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.649 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.650 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.650 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138931 s, 75.5 MB/s 2023-07-27T14:30:34.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.651 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.711 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.712 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.712 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138601 s, 75.7 MB/s 2023-07-27T14:30:34.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.713 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.774 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131998 s, 79.4 MB/s 2023-07-27T14:30:34.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.776 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.838 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.838 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148301 s, 70.7 MB/s 2023-07-27T14:30:34.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.839 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148829 s, 70.5 MB/s 2023-07-27T14:30:34.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.903 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:34.964 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:34.966 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:34.966 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015284 s, 68.6 MB/s 2023-07-27T14:30:34.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:34.968 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.030 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.030 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.030 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143501 s, 73.1 MB/s 2023-07-27T14:30:35.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.031 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.093 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.093 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.093 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148873 s, 70.4 MB/s 2023-07-27T14:30:35.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.095 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.158 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.158 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.159 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166159 s, 63.1 MB/s 2023-07-27T14:30:35.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.160 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.225 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194063 s, 54.0 MB/s 2023-07-27T14:30:35.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.227 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.287 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.287 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.288 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137096 s, 76.5 MB/s 2023-07-27T14:30:35.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.289 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.351 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.351 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.351 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150115 s, 69.9 MB/s 2023-07-27T14:30:35.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.353 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.414 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.414 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.414 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138696 s, 75.6 MB/s 2023-07-27T14:30:35.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.416 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.477 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.478 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.478 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150138 s, 69.8 MB/s 2023-07-27T14:30:35.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.479 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.539 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.539 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.539 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125658 s, 83.4 MB/s 2023-07-27T14:30:35.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.541 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.602 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.602 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.602 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142206 s, 73.7 MB/s 2023-07-27T14:30:35.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.604 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.666 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.667 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.667 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154418 s, 67.9 MB/s 2023-07-27T14:30:35.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.668 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.734 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.735 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.735 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191758 s, 54.7 MB/s 2023-07-27T14:30:35.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.737 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.798 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.798 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.798 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140959 s, 74.4 MB/s 2023-07-27T14:30:35.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.800 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.860 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.860 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.860 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140555 s, 74.6 MB/s 2023-07-27T14:30:35.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.862 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.922 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.922 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.922 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133686 s, 78.4 MB/s 2023-07-27T14:30:35.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.923 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163211 s, 64.2 MB/s 2023-07-27T14:30:35.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:35.988 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.051 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.051 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.051 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160367 s, 65.4 MB/s 2023-07-27T14:30:36.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.053 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.117 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134586 s, 77.9 MB/s 2023-07-27T14:30:36.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.119 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.179 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.179 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.180 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135974 s, 77.1 MB/s 2023-07-27T14:30:36.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.181 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.241 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.241 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.241 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142013 s, 73.8 MB/s 2023-07-27T14:30:36.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.243 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.305 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.305 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.305 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153517 s, 68.3 MB/s 2023-07-27T14:30:36.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.307 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.368 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.368 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.369 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146139 s, 71.8 MB/s 2023-07-27T14:30:36.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.370 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.432 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.432 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.432 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154106 s, 68.0 MB/s 2023-07-27T14:30:36.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.434 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.492 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.493 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.493 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121695 s, 86.2 MB/s 2023-07-27T14:30:36.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.494 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.555 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.555 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.556 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145793 s, 71.9 MB/s 2023-07-27T14:30:36.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.557 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.619 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.619 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.619 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015795 s, 66.4 MB/s 2023-07-27T14:30:36.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.620 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.683 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.683 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.683 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157052 s, 66.8 MB/s 2023-07-27T14:30:36.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.684 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.748 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174083 s, 60.2 MB/s 2023-07-27T14:30:36.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.750 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.810 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.810 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.810 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132337 s, 79.2 MB/s 2023-07-27T14:30:36.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.811 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.875 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168355 s, 62.3 MB/s 2023-07-27T14:30:36.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.876 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.937 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.937 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.937 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144499 s, 72.6 MB/s 2023-07-27T14:30:36.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.938 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:36.997 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:36.997 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:36.998 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122975 s, 85.3 MB/s 2023-07-27T14:30:36.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:36.999 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.058 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.058 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.059 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135669 s, 77.3 MB/s 2023-07-27T14:30:37.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.060 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.122 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.122 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.122 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155353 s, 67.5 MB/s 2023-07-27T14:30:37.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.123 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.184 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.184 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.185 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145179 s, 72.2 MB/s 2023-07-27T14:30:37.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.186 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.245 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.245 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.245 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126604 s, 82.8 MB/s 2023-07-27T14:30:37.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.246 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.309 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.309 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.310 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154809 s, 67.7 MB/s 2023-07-27T14:30:37.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.311 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.368 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.369 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.369 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123067 s, 85.2 MB/s 2023-07-27T14:30:37.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.370 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.431 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.432 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.432 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151699 s, 69.1 MB/s 2023-07-27T14:30:37.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.433 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.495 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.495 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.495 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152889 s, 68.6 MB/s 2023-07-27T14:30:37.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.496 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.557 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.557 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.558 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141533 s, 74.1 MB/s 2023-07-27T14:30:37.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.559 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.619 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.619 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.620 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147186 s, 71.2 MB/s 2023-07-27T14:30:37.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.621 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.681 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.681 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.681 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133128 s, 78.8 MB/s 2023-07-27T14:30:37.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.682 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.744 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.744 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.744 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153284 s, 68.4 MB/s 2023-07-27T14:30:37.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.746 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.806 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.806 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.806 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142531 s, 73.6 MB/s 2023-07-27T14:30:37.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.808 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.869 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.870 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.870 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146416 s, 71.6 MB/s 2023-07-27T14:30:37.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.871 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.933 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.934 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.934 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159171 s, 65.9 MB/s 2023-07-27T14:30:37.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.935 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:37.996 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:37.996 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147038 s, 71.3 MB/s 2023-07-27T14:30:37.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:37.998 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.058 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.058 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.058 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138081 s, 75.9 MB/s 2023-07-27T14:30:38.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.059 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.119 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.119 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.119 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126295 s, 83.0 MB/s 2023-07-27T14:30:38.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.121 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149448 s, 70.2 MB/s 2023-07-27T14:30:38.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.184 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142754 s, 73.5 MB/s 2023-07-27T14:30:38.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.246 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.308 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.308 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.308 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154588 s, 67.8 MB/s 2023-07-27T14:30:38.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.309 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154334 s, 67.9 MB/s 2023-07-27T14:30:38.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.373 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.433 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.433 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.433 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145561 s, 72.0 MB/s 2023-07-27T14:30:38.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.435 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.497 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.497 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.497 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154593 s, 67.8 MB/s 2023-07-27T14:30:38.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.499 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.559 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.559 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.559 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138859 s, 75.5 MB/s 2023-07-27T14:30:38.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.560 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.622 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.622 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.622 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146355 s, 71.6 MB/s 2023-07-27T14:30:38.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.623 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.685 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.685 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147532 s, 71.1 MB/s 2023-07-27T14:30:38.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.687 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.750 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.750 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.750 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015901 s, 65.9 MB/s 2023-07-27T14:30:38.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.751 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.812 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.812 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.813 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146618 s, 71.5 MB/s 2023-07-27T14:30:38.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.814 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.875 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.875 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.876 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140441 s, 74.7 MB/s 2023-07-27T14:30:38.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.878 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:38.940 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:38.941 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:38.941 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158592 s, 66.1 MB/s 2023-07-27T14:30:38.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:38.942 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.002 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.003 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.003 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136493 s, 76.8 MB/s 2023-07-27T14:30:39.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.004 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.068 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.069 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186097 s, 56.3 MB/s 2023-07-27T14:30:39.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.070 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.134 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.134 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.134 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176747 s, 59.3 MB/s 2023-07-27T14:30:39.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.136 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.198 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.198 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.199 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164374 s, 63.8 MB/s 2023-07-27T14:30:39.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.200 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.264 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.265 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.265 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185445 s, 56.5 MB/s 2023-07-27T14:30:39.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.266 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.328 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.329 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.329 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150823 s, 69.5 MB/s 2023-07-27T14:30:39.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.331 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.392 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.393 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.393 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145752 s, 71.9 MB/s 2023-07-27T14:30:39.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.395 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.458 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.458 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.459 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158408 s, 66.2 MB/s 2023-07-27T14:30:39.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.460 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.522 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.523 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.523 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157332 s, 66.6 MB/s 2023-07-27T14:30:39.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.524 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.591 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.591 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.591 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020241 s, 51.8 MB/s 2023-07-27T14:30:39.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.592 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.654 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.655 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.655 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155147 s, 67.6 MB/s 2023-07-27T14:30:39.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.656 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.717 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.718 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.718 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142734 s, 73.5 MB/s 2023-07-27T14:30:39.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.719 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.779 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.779 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.779 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131897 s, 79.5 MB/s 2023-07-27T14:30:39.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.781 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.843 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.844 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.844 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166745 s, 62.9 MB/s 2023-07-27T14:30:39.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.845 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.908 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.908 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.909 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154055 s, 68.1 MB/s 2023-07-27T14:30:39.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.910 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:39.972 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:39.972 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:39.972 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155436 s, 67.5 MB/s 2023-07-27T14:30:39.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:39.974 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140395 s, 74.7 MB/s 2023-07-27T14:30:40.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:40.040 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000478966/3e6c431d-b35c-41f8-b959-7435d157d601/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:30:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:30:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:30:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133564 s, 78.5 MB/s 2023-07-27T14:30:40.106 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000478966 snapshot_0000000000585160 2023-07-27T14:30:40.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.271+0000 7fe6fedff700 1 Processor -- start 2023-07-27T14:30:40.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.272+0000 7fe6fedff700 1 -- start start 2023-07-27T14:30:40.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.273+0000 7fe6fedff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6f80c6b70 0x7fe6f80656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.273+0000 7fe6fedff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe6f8065bc0 0x7fe6f8062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.273+0000 7fe6fedff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f8066050 con 0x7fe6f8153e00 2023-07-27T14:30:40.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.273+0000 7fe6fedff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f8062320 con 0x7fe6f80c6b70 2023-07-27T14:30:40.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.273+0000 7fe6fedff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f8064a80 con 0x7fe6f8065bc0 2023-07-27T14:30:40.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.273+0000 7fe6f7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6f80c6b70 0x7fe6f80656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.273+0000 7fe6f7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6f80c6b70 0x7fe6f80656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47336/0 (socket says 172.21.15.115:47336) 2023-07-27T14:30:40.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f7fff700 1 -- 172.21.15.115:0/2626774408 learned_addr learned my addr 172.21.15.115:0/2626774408 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:40.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6fd39c700 1 --2- 172.21.15.115:0/2626774408 >> v2:172.21.15.159:3300/0 conn(0x7fe6f8065bc0 0x7fe6f8062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f7fff700 1 -- 172.21.15.115:0/2626774408 >> v2:172.21.15.159:3300/0 conn(0x7fe6f8065bc0 msgr2=0x7fe6f8062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:40.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f7fff700 1 --2- 172.21.15.115:0/2626774408 >> v2:172.21.15.159:3300/0 conn(0x7fe6f8065bc0 0x7fe6f8062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f7fff700 1 -- 172.21.15.115:0/2626774408 >> v1:172.21.15.159:6789/0 conn(0x7fe6f8153e00 legacy=0x7fe6f8064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f7fff700 1 -- 172.21.15.115:0/2626774408 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8064d60 con 0x7fe6f80c6b70 2023-07-27T14:30:40.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f7fff700 1 --2- 172.21.15.115:0/2626774408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f80c6b70 0x7fe6f80656d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fe6f805e5b0 tx=0x7fe6e40090f0).ready entity=mon.0 client_cookie=4e5e924e0c358b88 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:40.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f77fe700 1 -- 172.21.15.115:0/2626774408 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400b600 con 0x7fe6f80c6b70 2023-07-27T14:30:40.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f77fe700 1 -- 172.21.15.115:0/2626774408 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e400b760 con 0x7fe6f80c6b70 2023-07-27T14:30:40.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.274+0000 7fe6f77fe700 1 -- 172.21.15.115:0/2626774408 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400bae0 con 0x7fe6f80c6b70 2023-07-27T14:30:40.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.275+0000 7fe6fedff700 1 -- 172.21.15.115:0/2626774408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f80c6b70 msgr2=0x7fe6f80656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.275+0000 7fe6fedff700 1 --2- 172.21.15.115:0/2626774408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f80c6b70 0x7fe6f80656d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fe6f805e5b0 tx=0x7fe6e40090f0).stop 2023-07-27T14:30:40.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.275+0000 7fe6fedff700 1 -- 172.21.15.115:0/2626774408 shutdown_connections 2023-07-27T14:30:40.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.275+0000 7fe6fedff700 1 --2- 172.21.15.115:0/2626774408 >> v2:172.21.15.159:3300/0 conn(0x7fe6f8065bc0 0x7fe6f8062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.275+0000 7fe6fedff700 1 --2- 172.21.15.115:0/2626774408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f80c6b70 0x7fe6f80656d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.275+0000 7fe6fedff700 1 -- 172.21.15.115:0/2626774408 >> 172.21.15.115:0/2626774408 conn(0x7fe6f80c7b90 msgr2=0x7fe6f80c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:40.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.275+0000 7fe6fedff700 1 -- 172.21.15.115:0/2626774408 shutdown_connections 2023-07-27T14:30:40.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.275+0000 7fe6fedff700 1 -- 172.21.15.115:0/2626774408 wait complete. 2023-07-27T14:30:40.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.277+0000 7fe6fedff700 1 Processor -- start 2023-07-27T14:30:40.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.278+0000 7fe6fedff700 1 -- start start 2023-07-27T14:30:40.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fedff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f8065bc0 0x7fe6f81541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fedff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6f80c6b70 0x7fe6f80a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fedff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f8153e00 0x7fe6f80a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fedff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f80a4920 con 0x7fe6f8153e00 2023-07-27T14:30:40.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fedff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f80bf430 con 0x7fe6f8065bc0 2023-07-27T14:30:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fedff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f814f680 con 0x7fe6f80c6b70 2023-07-27T14:30:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fd39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f8153e00 0x7fe6f80a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6f80c6b70 0x7fe6f80a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fd39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f8153e00 0x7fe6f80a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47348/0 (socket says 172.21.15.115:47348) 2023-07-27T14:30:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fd39c700 1 -- 172.21.15.115:0/670086111 learned_addr learned my addr 172.21.15.115:0/670086111 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.279+0000 7fe6fcb9b700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f8065bc0 0x7fe6f81541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6fd39c700 1 -- 172.21.15.115:0/670086111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6f80c6b70 msgr2=0x7fe6f80a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6fd39c700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6f80c6b70 0x7fe6f80a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6fd39c700 1 -- 172.21.15.115:0/670086111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f8065bc0 msgr2=0x7fe6f81541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6fd39c700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f8065bc0 0x7fe6f81541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6fd39c700 1 -- 172.21.15.115:0/670086111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4009370 con 0x7fe6f8153e00 2023-07-27T14:30:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6fd39c700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f8153e00 0x7fe6f80a4430 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fe6f0009fd0 tx=0x7fe6f0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6f4ff9700 1 -- 172.21.15.115:0/670086111 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000eb90 con 0x7fe6f8153e00 2023-07-27T14:30:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6f4ff9700 1 -- 172.21.15.115:0/670086111 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000ecf0 con 0x7fe6f8153e00 2023-07-27T14:30:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f80bf5c0 con 0x7fe6f8153e00 2023-07-27T14:30:40.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6f4ff9700 1 -- 172.21.15.115:0/670086111 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0014610 con 0x7fe6f8153e00 2023-07-27T14:30:40.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.280+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f8155110 con 0x7fe6f8153e00 2023-07-27T14:30:40.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.282+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f80bf750 con 0x7fe6f8153e00 2023-07-27T14:30:40.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.282+0000 7fe6f4ff9700 1 -- 172.21.15.115:0/670086111 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 11) v1 ==== 75682+0+0 (secure 0 0 0) 0x7fe6f001b030 con 0x7fe6f8153e00 2023-07-27T14:30:40.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.283+0000 7fe6f4ff9700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6dc05f0a0 0x7fe6dc061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.283+0000 7fe6f4ff9700 1 -- 172.21.15.115:0/670086111 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe6f007a280 con 0x7fe6f8153e00 2023-07-27T14:30:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.284+0000 7fe6fcb9b700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6dc05f0a0 0x7fe6dc061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.284+0000 7fe6fcb9b700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6dc05f0a0 0x7fe6dc061560 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fe6f80a4b40 tx=0x7fe6ec009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.288+0000 7fe6f4ff9700 1 -- 172.21.15.115:0/670086111 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe6f004b4e0 con 0x7fe6f8153e00 2023-07-27T14:30:40.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.490+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000478966", "snap_name": "snapshot_0000000000585160", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6f8063cd0 con 0x7fe6dc05f0a0 2023-07-27T14:30:40.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.525+0000 7fe6f4ff9700 1 -- 172.21.15.115:0/670086111 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe6f8063cd0 con 0x7fe6dc05f0a0 2023-07-27T14:30:40.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6dc05f0a0 msgr2=0x7fe6dc061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6dc05f0a0 0x7fe6dc061560 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fe6f80a4b40 tx=0x7fe6ec009040).stop 2023-07-27T14:30:40.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f8153e00 msgr2=0x7fe6f80a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f8153e00 0x7fe6f80a4430 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fe6f0009fd0 tx=0x7fe6f0009900).stop 2023-07-27T14:30:40.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 shutdown_connections 2023-07-27T14:30:40.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6dc05f0a0 0x7fe6dc061560 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6f8153e00 0x7fe6f80a4430 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6f8065bc0 0x7fe6f81541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 --2- 172.21.15.115:0/670086111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6f80c6b70 0x7fe6f80a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 >> 172.21.15.115:0/670086111 conn(0x7fe6f80c7b90 msgr2=0x7fe6f80bc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:40.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 shutdown_connections 2023-07-27T14:30:40.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.527+0000 7fe6fedff700 1 -- 172.21.15.115:0/670086111 wait complete. 2023-07-27T14:30:40.573 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-07-27T14:30:40.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.736+0000 7f9a461ff700 1 Processor -- start 2023-07-27T14:30:40.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.736+0000 7f9a461ff700 1 -- start start 2023-07-27T14:30:40.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.737+0000 7f9a461ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9a40063260 0x7f9a40154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.737+0000 7f9a461ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a4014b1e0 0x7f9a400a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.737+0000 7f9a461ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a401553f0 con 0x7f9a4014ae00 2023-07-27T14:30:40.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.737+0000 7f9a461ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a40157a50 con 0x7f9a40063260 2023-07-27T14:30:40.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.737+0000 7f9a461ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40157d10 con 0x7f9a4014b1e0 2023-07-27T14:30:40.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3effd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9a40063260 0x7f9a40154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3effd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9a40063260 0x7f9a40154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:37344/0 (socket says 172.21.15.115:37344) 2023-07-27T14:30:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3effd700 1 -- 172.21.15.115:0/1149809109 learned_addr learned my addr 172.21.15.115:0/1149809109 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3ffff700 1 --2- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a4014b1e0 0x7f9a400a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3effd700 1 -- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a4014b1e0 msgr2=0x7f9a400a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3effd700 1 --2- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a4014b1e0 0x7f9a400a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3effd700 1 -- 172.21.15.115:0/1149809109 >> v1:172.21.15.159:6789/0 conn(0x7f9a4014ae00 legacy=0x7f9a40062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3effd700 1 -- 172.21.15.115:0/1149809109 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40157ff0 con 0x7f9a40063260 2023-07-27T14:30:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3ffff700 1 --2- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a4014b1e0 0x7f9a400a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.738+0000 7f9a3e7fc700 1 -- 172.21.15.115:0/1149809109 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982098585 0 0) 0x7f9a401553f0 con 0x7f9a4014ae00 2023-07-27T14:30:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a3effd700 1 --2- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a40063260 0x7f9a40154f00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f9a34006fd0 tx=0x7f9a340090f0).ready entity=mon.1 client_cookie=2f1b7a4a2d85eb02 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a3e7fc700 1 -- 172.21.15.115:0/1149809109 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400b580 con 0x7f9a40063260 2023-07-27T14:30:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a3e7fc700 1 -- 172.21.15.115:0/1149809109 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3400b6e0 con 0x7f9a40063260 2023-07-27T14:30:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a3e7fc700 1 -- 172.21.15.115:0/1149809109 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400ba60 con 0x7f9a40063260 2023-07-27T14:30:40.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a461ff700 1 -- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a40063260 msgr2=0x7f9a40154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a461ff700 1 --2- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a40063260 0x7f9a40154f00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f9a34006fd0 tx=0x7f9a340090f0).stop 2023-07-27T14:30:40.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a461ff700 1 -- 172.21.15.115:0/1149809109 shutdown_connections 2023-07-27T14:30:40.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a461ff700 1 --2- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a4014b1e0 0x7f9a400a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a461ff700 1 --2- 172.21.15.115:0/1149809109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a40063260 0x7f9a40154f00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a461ff700 1 -- 172.21.15.115:0/1149809109 >> 172.21.15.115:0/1149809109 conn(0x7f9a4005e940 msgr2=0x7f9a400cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.739+0000 7f9a461ff700 1 -- 172.21.15.115:0/1149809109 shutdown_connections 2023-07-27T14:30:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.740+0000 7f9a461ff700 1 -- 172.21.15.115:0/1149809109 wait complete. 2023-07-27T14:30:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.741+0000 7f9a461ff700 1 Processor -- start 2023-07-27T14:30:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.741+0000 7f9a461ff700 1 -- start start 2023-07-27T14:30:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a461ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a40063260 0x7f9a4013b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a461ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a4014ae00 0x7f9a400adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a461ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a4014b1e0 0x7f9a400abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a461ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400c2c20 con 0x7f9a4014ae00 2023-07-27T14:30:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a461ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4013bbb0 con 0x7f9a4014b1e0 2023-07-27T14:30:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a461ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400c1fa0 con 0x7f9a40063260 2023-07-27T14:30:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a3effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a4014ae00 0x7f9a400adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a3ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a4014b1e0 0x7f9a400abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a3effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a4014ae00 0x7f9a400adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47362/0 (socket says 172.21.15.115:47362) 2023-07-27T14:30:40.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a3effd700 1 -- 172.21.15.115:0/3249408531 learned_addr learned my addr 172.21.15.115:0/3249408531 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:40.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.742+0000 7f9a3f7fe700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a40063260 0x7f9a4013b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a3effd700 1 -- 172.21.15.115:0/3249408531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a40063260 msgr2=0x7f9a4013b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a3effd700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a40063260 0x7f9a4013b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a3effd700 1 -- 172.21.15.115:0/3249408531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a4014b1e0 msgr2=0x7f9a400abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a3effd700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a4014b1e0 0x7f9a400abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a3effd700 1 -- 172.21.15.115:0/3249408531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009a20 con 0x7f9a4014ae00 2023-07-27T14:30:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a3ffff700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a4014b1e0 0x7f9a400abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a3effd700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a4014ae00 0x7f9a400adb60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f9a34009130 tx=0x7f9a34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a277fe700 1 -- 172.21.15.115:0/3249408531 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a34000bc0 con 0x7f9a4014ae00 2023-07-27T14:30:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a277fe700 1 -- 172.21.15.115:0/3249408531 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3400b850 con 0x7f9a4014ae00 2023-07-27T14:30:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34009370 con 0x7f9a4014ae00 2023-07-27T14:30:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a277fe700 1 -- 172.21.15.115:0/3249408531 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a34000d20 con 0x7f9a4014ae00 2023-07-27T14:30:40.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.743+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a400c2560 con 0x7f9a4014ae00 2023-07-27T14:30:40.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.744+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4006c470 con 0x7f9a4014ae00 2023-07-27T14:30:40.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.745+0000 7f9a277fe700 1 -- 172.21.15.115:0/3249408531 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 11) v1 ==== 75682+0+0 (secure 0 0 0) 0x7f9a3402b070 con 0x7f9a4014ae00 2023-07-27T14:30:40.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.746+0000 7f9a277fe700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a2c05f0a0 0x7f9a2c061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:40.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.746+0000 7f9a277fe700 1 -- 172.21.15.115:0/3249408531 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9a3407ba50 con 0x7f9a4014ae00 2023-07-27T14:30:40.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.746+0000 7f9a3f7fe700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a2c05f0a0 0x7f9a2c061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:40.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.747+0000 7f9a3f7fe700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a2c05f0a0 0x7f9a2c061560 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f9a30007fd0 tx=0x7f9a30007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:40.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.751+0000 7f9a277fe700 1 -- 172.21.15.115:0/3249408531 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9a3404ce20 con 0x7f9a4014ae00 2023-07-27T14:30:40.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.920+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f9a400c04d0 con 0x7f9a4014ae00 2023-07-27T14:30:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.924+0000 7f9a277fe700 1 -- 172.21.15.115:0/3249408531 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v11)=0 v11) v1 ==== 130+0+0 (secure 0 0 0) 0x7f9a3401f070 con 0x7f9a4014ae00 2023-07-27T14:30:40.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.926+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a2c05f0a0 msgr2=0x7f9a2c061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.926+0000 7f9a461ff700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a2c05f0a0 0x7f9a2c061560 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f9a30007fd0 tx=0x7f9a30007bb0).stop 2023-07-27T14:30:40.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.926+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a4014ae00 msgr2=0x7f9a400adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:40.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.926+0000 7f9a461ff700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a4014ae00 0x7f9a400adb60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f9a34009130 tx=0x7f9a34017000).stop 2023-07-27T14:30:40.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.926+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 shutdown_connections 2023-07-27T14:30:40.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.926+0000 7f9a461ff700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9a2c05f0a0 0x7f9a2c061560 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.926+0000 7f9a461ff700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a4014b1e0 0x7f9a400abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.927+0000 7f9a461ff700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a40063260 0x7f9a4013b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.927+0000 7f9a461ff700 1 --2- 172.21.15.115:0/3249408531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a4014ae00 0x7f9a400adb60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:40.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.927+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 >> 172.21.15.115:0/3249408531 conn(0x7f9a4005e940 msgr2=0x7f9a4014a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:40.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.927+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 shutdown_connections 2023-07-27T14:30:40.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:40.927+0000 7f9a461ff700 1 -- 172.21.15.115:0/3249408531 wait complete. 2023-07-27T14:30:40.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000478966 snapshot_0000000000585160 clone_0000000000049527 2023-07-27T14:30:41.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.140+0000 7fcccddff700 1 Processor -- start 2023-07-27T14:30:41.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.140+0000 7fcccddff700 1 -- start start 2023-07-27T14:30:41.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.141+0000 7fcccddff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fccc81509b0 0x7fccc80c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.141+0000 7fcccddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 0x7fccc8154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.141+0000 7fcccddff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc80c0ea0 con 0x7fccc80c3100 2023-07-27T14:30:41.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.141+0000 7fcccddff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc8068e10 con 0x7fccc81509b0 2023-07-27T14:30:41.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.141+0000 7fcccddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8155190 con 0x7fccc8150d90 2023-07-27T14:30:41.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fccc80c3100 0x7fccc80c3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46160/0 (socket says 172.21.15.115:46160) 2023-07-27T14:30:41.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fccc81509b0 0x7fccc80c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc7fff700 1 -- 172.21.15.115:0/3848966020 learned_addr learned my addr 172.21.15.115:0/3848966020 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:41.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc6ffd700 1 --2- 172.21.15.115:0/3848966020 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 0x7fccc8154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc67fc700 1 -- 172.21.15.115:0/3848966020 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736684299 0 0) 0x7fccc80c0ea0 con 0x7fccc80c3100 2023-07-27T14:30:41.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc67fc700 1 -- 172.21.15.115:0/3848966020 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb00033f0 con 0x7fccc80c3100 2023-07-27T14:30:41.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc77fe700 1 -- 172.21.15.115:0/3848966020 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 msgr2=0x7fccc8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:41.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc77fe700 1 --2- 172.21.15.115:0/3848966020 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 0x7fccc8154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc77fe700 1 -- 172.21.15.115:0/3848966020 >> v1:172.21.15.115:6789/0 conn(0x7fccc80c3100 legacy=0x7fccc80c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc77fe700 1 -- 172.21.15.115:0/3848966020 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8155470 con 0x7fccc81509b0 2023-07-27T14:30:41.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.142+0000 7fccc77fe700 1 --2- 172.21.15.115:0/3848966020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc80c58d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fccb8009760 tx=0x7fccb8009060).ready entity=mon.0 client_cookie=482468067bc2b5fa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:41.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fccc67fc700 1 -- 172.21.15.115:0/3848966020 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800f510 con 0x7fccc81509b0 2023-07-27T14:30:41.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fccc67fc700 1 -- 172.21.15.115:0/3848966020 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb800f670 con 0x7fccc81509b0 2023-07-27T14:30:41.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fccc67fc700 1 -- 172.21.15.115:0/3848966020 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800f9f0 con 0x7fccc81509b0 2023-07-27T14:30:41.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fcccddff700 1 -- 172.21.15.115:0/3848966020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 msgr2=0x7fccc80c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fcccddff700 1 --2- 172.21.15.115:0/3848966020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc80c58d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fccb8009760 tx=0x7fccb8009060).stop 2023-07-27T14:30:41.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fcccddff700 1 -- 172.21.15.115:0/3848966020 shutdown_connections 2023-07-27T14:30:41.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fcccddff700 1 --2- 172.21.15.115:0/3848966020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc80c58d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fcccddff700 1 --2- 172.21.15.115:0/3848966020 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 0x7fccc8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fcccddff700 1 -- 172.21.15.115:0/3848966020 >> 172.21.15.115:0/3848966020 conn(0x7fccc8062320 msgr2=0x7fccc8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:41.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fcccddff700 1 -- 172.21.15.115:0/3848966020 shutdown_connections 2023-07-27T14:30:41.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.143+0000 7fcccddff700 1 -- 172.21.15.115:0/3848966020 wait complete. 2023-07-27T14:30:41.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.145+0000 7fcccddff700 1 Processor -- start 2023-07-27T14:30:41.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.145+0000 7fcccddff700 1 -- start start 2023-07-27T14:30:41.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fcccddff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc80c3100 0x7fccc8140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fcccddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc8152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fcccddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 0x7fccc81531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fcccddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8154490 con 0x7fccc81509b0 2023-07-27T14:30:41.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fcccddff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8153b60 con 0x7fccc80c3100 2023-07-27T14:30:41.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fcccddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8153e40 con 0x7fccc8150d90 2023-07-27T14:30:41.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc8152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc8152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47386/0 (socket says 172.21.15.115:47386) 2023-07-27T14:30:41.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc6ffd700 1 -- 172.21.15.115:0/174719686 learned_addr learned my addr 172.21.15.115:0/174719686 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:41.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc7fff700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 0x7fccc81531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc77fe700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc80c3100 0x7fccc8140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc6ffd700 1 -- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 msgr2=0x7fccc81531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc6ffd700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 0x7fccc81531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc6ffd700 1 -- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc80c3100 msgr2=0x7fccc8140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc6ffd700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc80c3100 0x7fccc8140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc6ffd700 1 -- 172.21.15.115:0/174719686 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb80092a0 con 0x7fccc81509b0 2023-07-27T14:30:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.146+0000 7fccc77fe700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc80c3100 0x7fccc8140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:41.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.147+0000 7fccc6ffd700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc8152cd0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fccbc00d890 tx=0x7fccbc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:41.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.147+0000 7fccaf7fe700 1 -- 172.21.15.115:0/174719686 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc0125f0 con 0x7fccc81509b0 2023-07-27T14:30:41.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.147+0000 7fccaf7fe700 1 -- 172.21.15.115:0/174719686 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc012750 con 0x7fccc81509b0 2023-07-27T14:30:41.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.147+0000 7fccaf7fe700 1 -- 172.21.15.115:0/174719686 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc012ad0 con 0x7fccc81509b0 2023-07-27T14:30:41.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.147+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc8154120 con 0x7fccc81509b0 2023-07-27T14:30:41.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.147+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc8140710 con 0x7fccc81509b0 2023-07-27T14:30:41.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.148+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc81408d0 con 0x7fccc81509b0 2023-07-27T14:30:41.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.149+0000 7fccaf7fe700 1 -- 172.21.15.115:0/174719686 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 11) v1 ==== 75682+0+0 (secure 0 0 0) 0x7fccbc013480 con 0x7fccc81509b0 2023-07-27T14:30:41.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.150+0000 7fccaf7fe700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fccb405f0a0 0x7fccb4061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.150+0000 7fccaf7fe700 1 -- 172.21.15.115:0/174719686 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fccbc079e20 con 0x7fccc81509b0 2023-07-27T14:30:41.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.150+0000 7fccc77fe700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fccb405f0a0 0x7fccb4061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.150+0000 7fccc77fe700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fccb405f0a0 0x7fccb4061560 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fccb8009fd0 tx=0x7fccb8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:41.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.154+0000 7fccaf7fe700 1 -- 172.21.15.115:0/174719686 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fccbc04b080 con 0x7fccc81509b0 2023-07-27T14:30:41.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.360+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000478966", "snap_name": "snapshot_0000000000585160", "target_sub_name": "clone_0000000000049527", "target": ["mon-mgr", ""]}) v1 -- 0x7fccc8155750 con 0x7fccb405f0a0 2023-07-27T14:30:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.421+0000 7fccaf7fe700 1 -- 172.21.15.115:0/174719686 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fccc8155750 con 0x7fccb405f0a0 2023-07-27T14:30:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fccb405f0a0 msgr2=0x7fccb4061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fccb405f0a0 0x7fccb4061560 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fccb8009fd0 tx=0x7fccb8017000).stop 2023-07-27T14:30:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 msgr2=0x7fccc8152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc8152cd0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fccbc00d890 tx=0x7fccbc008040).stop 2023-07-27T14:30:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 shutdown_connections 2023-07-27T14:30:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fccb405f0a0 0x7fccb4061560 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc8150d90 0x7fccc81531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc80c3100 0x7fccc8140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 --2- 172.21.15.115:0/174719686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc81509b0 0x7fccc8152cd0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 >> 172.21.15.115:0/174719686 conn(0x7fccc8062320 msgr2=0x7fccc80bb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 shutdown_connections 2023-07-27T14:30:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.424+0000 7fcccddff700 1 -- 172.21.15.115:0/174719686 wait complete. 2023-07-27T14:30:41.458 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.429+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.458 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.429+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.458 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.429+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.459 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.429+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.459 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.429+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.475 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs clone_0000000000049527 2023-07-27T14:30:41.476 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.447+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.477 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.447+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.477 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.447+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.477 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.447+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.477 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:41.447+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:41.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.642+0000 7f10469ff700 1 Processor -- start 2023-07-27T14:30:41.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.642+0000 7f10469ff700 1 -- start start 2023-07-27T14:30:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.643+0000 7f10469ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f104014ae00 0x7f1040154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.643+0000 7f10469ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10401553f0 con 0x7f104014b1e0 2023-07-27T14:30:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.643+0000 7f10469ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1040157a50 con 0x7f1040063260 2023-07-27T14:30:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.643+0000 7f10469ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1040157d10 con 0x7f104014ae00 2023-07-27T14:30:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f104014b1e0 0x7f1040062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46162/0 (socket says 172.21.15.115:46162) 2023-07-27T14:30:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103f7fe700 1 -- 172.21.15.115:0/178336799 learned_addr learned my addr 172.21.15.115:0/178336799 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103ffff700 1 --2- 172.21.15.115:0/178336799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f104014ae00 0x7f1040154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103effd700 1 -- 172.21.15.115:0/178336799 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93794954 0 0) 0x7f10401553f0 con 0x7f104014b1e0 2023-07-27T14:30:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103effd700 1 -- 172.21.15.115:0/178336799 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10280033f0 con 0x7f104014b1e0 2023-07-27T14:30:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103effd700 1 -- 172.21.15.115:0/178336799 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724865511 0 0) 0x7f1040157a50 con 0x7f1040063260 2023-07-27T14:30:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103effd700 1 -- 172.21.15.115:0/178336799 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10401553f0 con 0x7f1040063260 2023-07-27T14:30:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103effd700 1 -- 172.21.15.115:0/178336799 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3625008918 0 0) 0x7f10280033f0 con 0x7f104014b1e0 2023-07-27T14:30:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103ffff700 1 -- 172.21.15.115:0/178336799 >> v1:172.21.15.159:6789/0 conn(0x7f1040063260 legacy=0x7f10400a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103ffff700 1 -- 172.21.15.115:0/178336799 >> v1:172.21.15.115:6789/0 conn(0x7f104014b1e0 legacy=0x7f1040062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.644+0000 7f103ffff700 1 -- 172.21.15.115:0/178336799 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040157ff0 con 0x7f104014ae00 2023-07-27T14:30:41.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.645+0000 7f103ffff700 1 --2- 172.21.15.115:0/178336799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f104014ae00 0x7f1040154f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1030009790 tx=0x7f1030009060).ready entity=mon.2 client_cookie=efd4bdc8309ffbf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:41.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.645+0000 7f103effd700 1 -- 172.21.15.115:0/178336799 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034001470 con 0x7f104014ae00 2023-07-27T14:30:41.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.645+0000 7f103effd700 1 -- 172.21.15.115:0/178336799 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1030011400 con 0x7f104014ae00 2023-07-27T14:30:41.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.645+0000 7f103effd700 1 -- 172.21.15.115:0/178336799 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030011780 con 0x7f104014ae00 2023-07-27T14:30:41.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.645+0000 7f10469ff700 1 -- 172.21.15.115:0/178336799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f104014ae00 msgr2=0x7f1040154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.645+0000 7f10469ff700 1 --2- 172.21.15.115:0/178336799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f104014ae00 0x7f1040154f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1030009790 tx=0x7f1030009060).stop 2023-07-27T14:30:41.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.646+0000 7f10469ff700 1 -- 172.21.15.115:0/178336799 shutdown_connections 2023-07-27T14:30:41.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.646+0000 7f10469ff700 1 --2- 172.21.15.115:0/178336799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f104014ae00 0x7f1040154f00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.646+0000 7f10469ff700 1 -- 172.21.15.115:0/178336799 >> 172.21.15.115:0/178336799 conn(0x7f104005e940 msgr2=0x7f10400cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:41.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.646+0000 7f10469ff700 1 -- 172.21.15.115:0/178336799 shutdown_connections 2023-07-27T14:30:41.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.646+0000 7f10469ff700 1 -- 172.21.15.115:0/178336799 wait complete. 2023-07-27T14:30:41.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.647+0000 7f10469ff700 1 Processor -- start 2023-07-27T14:30:41.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.647+0000 7f10469ff700 1 -- start start 2023-07-27T14:30:41.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f10469ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1040063260 0x7f1040149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f10469ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f104014ae00 0x7f10400c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f10469ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104014b1e0 0x7f10400c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f10469ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400af7b0 con 0x7f104014ae00 2023-07-27T14:30:41.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f10469ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400afa90 con 0x7f104014b1e0 2023-07-27T14:30:41.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f10469ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400afd70 con 0x7f1040063260 2023-07-27T14:30:41.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f103f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f104014ae00 0x7f10400c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f103f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f104014ae00 0x7f10400c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47434/0 (socket says 172.21.15.115:47434) 2023-07-27T14:30:41.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f103f7fe700 1 -- 172.21.15.115:0/1529052509 learned_addr learned my addr 172.21.15.115:0/1529052509 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:41.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f103ffff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1040063260 0x7f1040149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.648+0000 7f1044f9c700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104014b1e0 0x7f10400c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f103f7fe700 1 -- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1040063260 msgr2=0x7f1040149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f103f7fe700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1040063260 0x7f1040149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f103f7fe700 1 -- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104014b1e0 msgr2=0x7f10400c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:41.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f103f7fe700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104014b1e0 0x7f10400c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:41.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f103f7fe700 1 -- 172.21.15.115:0/1529052509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300092a0 con 0x7f104014ae00 2023-07-27T14:30:41.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f103ffff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1040063260 0x7f1040149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:41.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f103f7fe700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f104014ae00 0x7f10400c2b40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f10400c1c00 tx=0x7f10340019b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:41.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f1027fff700 1 -- 172.21.15.115:0/1529052509 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340072e0 con 0x7f104014ae00 2023-07-27T14:30:41.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f1027fff700 1 -- 172.21.15.115:0/1529052509 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1034007440 con 0x7f104014ae00 2023-07-27T14:30:41.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10400b0050 con 0x7f104014ae00 2023-07-27T14:30:41.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f1027fff700 1 -- 172.21.15.115:0/1529052509 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034005740 con 0x7f104014ae00 2023-07-27T14:30:41.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.649+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1040149e80 con 0x7f104014ae00 2023-07-27T14:30:41.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.650+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104014e8c0 con 0x7f104014ae00 2023-07-27T14:30:41.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.651+0000 7f1027fff700 1 -- 172.21.15.115:0/1529052509 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 11) v1 ==== 75682+0+0 (secure 0 0 0) 0x7f103401a060 con 0x7f104014ae00 2023-07-27T14:30:41.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.652+0000 7f1027fff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f102c05f0a0 0x7f102c061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:41.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.652+0000 7f1027fff700 1 -- 172.21.15.115:0/1529052509 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1034079870 con 0x7f104014ae00 2023-07-27T14:30:41.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.652+0000 7f103ffff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f102c05f0a0 0x7f102c061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:41.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.653+0000 7f103ffff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f102c05f0a0 0x7f102c061560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f10300096e0 tx=0x7f1030016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:41.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.656+0000 7f1027fff700 1 -- 172.21.15.115:0/1529052509 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f103404ab30 con 0x7f104014ae00 2023-07-27T14:30:41.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.866+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "clone_0000000000049527", "target": ["mon-mgr", ""]}) v1 -- 0x7f10400afc00 con 0x7f102c05f0a0 2023-07-27T14:30:41.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:41.933+0000 7f1027fff700 1 -- 172.21.15.115:0/1529052509 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 12) v1 ==== 75762+0+0 (secure 0 0 0) 0x7f1034010070 con 0x7f104014ae00 2023-07-27T14:30:51.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.112+0000 7f1027fff700 1 -- 172.21.15.115:0/1529052509 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f10400afc00 con 0x7f102c05f0a0 2023-07-27T14:30:51.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f102c05f0a0 msgr2=0x7f102c061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:51.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f102c05f0a0 0x7f102c061560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f10300096e0 tx=0x7f1030016000).stop 2023-07-27T14:30:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f104014ae00 msgr2=0x7f10400c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f104014ae00 0x7f10400c2b40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f10400c1c00 tx=0x7f10340019b0).stop 2023-07-27T14:30:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 shutdown_connections 2023-07-27T14:30:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f102c05f0a0 0x7f102c061560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104014b1e0 0x7f10400c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1040063260 0x7f1040149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 --2- 172.21.15.115:0/1529052509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f104014ae00 0x7f10400c2b40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 >> 172.21.15.115:0/1529052509 conn(0x7f104005e940 msgr2=0x7f10400c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:51.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 shutdown_connections 2023-07-27T14:30:51.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.115+0000 7f10469ff700 1 -- 172.21.15.115:0/1529052509 wait complete. 2023-07-27T14:30:51.164 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000049527 2023-07-27T14:30:51.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.328+0000 7fc6ba5ff700 1 Processor -- start 2023-07-27T14:30:51.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.328+0000 7fc6ba5ff700 1 -- start start 2023-07-27T14:30:51.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.329+0000 7fc6ba5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc6b413a350 0x7fc6b4065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.329+0000 7fc6ba5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a730 0x7fc6b41585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.329+0000 7fc6ba5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40bd9a0 con 0x7fc6b40c2fa0 2023-07-27T14:30:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.329+0000 7fc6ba5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b4066400 con 0x7fc6b413a350 2023-07-27T14:30:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.329+0000 7fc6ba5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4158ae0 con 0x7fc6b413a730 2023-07-27T14:30:51.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b8b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc6b40c2fa0 0x7fc6b4067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47294/0 (socket says 172.21.15.115:47294) 2023-07-27T14:30:51.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b8b9c700 1 -- 172.21.15.115:0/1424215026 learned_addr learned my addr 172.21.15.115:0/1424215026 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b37fe700 1 --2- 172.21.15.115:0/1424215026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a730 0x7fc6b41585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b3fff700 1 --2- 172.21.15.115:0/1424215026 >> v2:172.21.15.159:3300/0 conn(0x7fc6b413a350 0x7fc6b4065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b2ffd700 1 -- 172.21.15.115:0/1424215026 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338130904 0 0) 0x7fc6b40bd9a0 con 0x7fc6b40c2fa0 2023-07-27T14:30:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b2ffd700 1 -- 172.21.15.115:0/1424215026 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc69c0033f0 con 0x7fc6b40c2fa0 2023-07-27T14:30:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b37fe700 1 -- 172.21.15.115:0/1424215026 >> v2:172.21.15.159:3300/0 conn(0x7fc6b413a350 msgr2=0x7fc6b4065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b37fe700 1 --2- 172.21.15.115:0/1424215026 >> v2:172.21.15.159:3300/0 conn(0x7fc6b413a350 0x7fc6b4065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b2ffd700 1 -- 172.21.15.115:0/1424215026 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2444972191 0 0) 0x7fc69c0033f0 con 0x7fc6b40c2fa0 2023-07-27T14:30:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b37fe700 1 -- 172.21.15.115:0/1424215026 >> v1:172.21.15.115:6789/0 conn(0x7fc6b40c2fa0 legacy=0x7fc6b4067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.330+0000 7fc6b37fe700 1 -- 172.21.15.115:0/1424215026 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4066610 con 0x7fc6b413a730 2023-07-27T14:30:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.331+0000 7fc6b37fe700 1 --2- 172.21.15.115:0/1424215026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a730 0x7fc6b41585f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc6a8009760 tx=0x7fc6a8009060).ready entity=mon.2 client_cookie=145693d2aeac0a82 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.331+0000 7fc6b2ffd700 1 -- 172.21.15.115:0/1424215026 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0017f0 con 0x7fc6b413a730 2023-07-27T14:30:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.331+0000 7fc6b2ffd700 1 -- 172.21.15.115:0/1424215026 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a8011400 con 0x7fc6b413a730 2023-07-27T14:30:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.331+0000 7fc6b2ffd700 1 -- 172.21.15.115:0/1424215026 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8011780 con 0x7fc6b413a730 2023-07-27T14:30:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.331+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/1424215026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a730 msgr2=0x7fc6b41585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:51.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.331+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/1424215026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a730 0x7fc6b41585f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc6a8009760 tx=0x7fc6a8009060).stop 2023-07-27T14:30:51.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.332+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/1424215026 shutdown_connections 2023-07-27T14:30:51.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.332+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/1424215026 >> v2:172.21.15.159:3300/0 conn(0x7fc6b413a350 0x7fc6b4065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.332+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/1424215026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a730 0x7fc6b41585f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.332+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/1424215026 >> 172.21.15.115:0/1424215026 conn(0x7fc6b405e8f0 msgr2=0x7fc6b40c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:51.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.332+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/1424215026 shutdown_connections 2023-07-27T14:30:51.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.332+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/1424215026 wait complete. 2023-07-27T14:30:51.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.333+0000 7fc6ba5ff700 1 Processor -- start 2023-07-27T14:30:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.333+0000 7fc6ba5ff700 1 -- start start 2023-07-27T14:30:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.334+0000 7fc6ba5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b40c2fa0 0x7fc6b40633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.334+0000 7fc6ba5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a350 0x7fc6b40aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.334+0000 7fc6ba5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b413a730 0x7fc6b40aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.334+0000 7fc6ba5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40649a0 con 0x7fc6b413a730 2023-07-27T14:30:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.334+0000 7fc6ba5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40ab170 con 0x7fc6b40c2fa0 2023-07-27T14:30:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.334+0000 7fc6ba5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4063d90 con 0x7fc6b413a350 2023-07-27T14:30:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.334+0000 7fc6b8b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b413a730 0x7fc6b40aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b8b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b413a730 0x7fc6b40aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41696/0 (socket says 172.21.15.115:41696) 2023-07-27T14:30:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b8b9c700 1 -- 172.21.15.115:0/610055193 learned_addr learned my addr 172.21.15.115:0/610055193 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b3fff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b40c2fa0 0x7fc6b40633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b37fe700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a350 0x7fc6b40aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b8b9c700 1 -- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a350 msgr2=0x7fc6b40aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b8b9c700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a350 0x7fc6b40aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b8b9c700 1 -- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b40c2fa0 msgr2=0x7fc6b40633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b8b9c700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b40c2fa0 0x7fc6b40633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b8b9c700 1 -- 172.21.15.115:0/610055193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80092a0 con 0x7fc6b413a730 2023-07-27T14:30:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b37fe700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a350 0x7fc6b40aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6b8b9c700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b413a730 0x7fc6b40aac80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fc6ac00cb40 tx=0x7fc6ac001e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc69bfff700 1 -- 172.21.15.115:0/610055193 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac004c40 con 0x7fc6b413a730 2023-07-27T14:30:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc69bfff700 1 -- 172.21.15.115:0/610055193 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac004da0 con 0x7fc6b413a730 2023-07-27T14:30:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc69bfff700 1 -- 172.21.15.115:0/610055193 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac007380 con 0x7fc6b413a730 2023-07-27T14:30:51.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.335+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b4064070 con 0x7fc6b413a730 2023-07-27T14:30:51.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.336+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b4064630 con 0x7fc6b413a730 2023-07-27T14:30:51.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.337+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b406c470 con 0x7fc6b413a730 2023-07-27T14:30:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.337+0000 7fc69bfff700 1 -- 172.21.15.115:0/610055193 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 75762+0+0 (secure 0 0 0) 0x7fc6ac010070 con 0x7fc6b413a730 2023-07-27T14:30:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.338+0000 7fc69bfff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a005f130 0x7fc6a00615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.338+0000 7fc69bfff700 1 -- 172.21.15.115:0/610055193 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fc6ac07a0a0 con 0x7fc6b413a730 2023-07-27T14:30:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.338+0000 7fc6b3fff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a005f130 0x7fc6a00615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.339+0000 7fc6b3fff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a005f130 0x7fc6a00615f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fc6a4009bc0 tx=0x7fc6a4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:51.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.342+0000 7fc69bfff700 1 -- 172.21.15.115:0/610055193 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6ac04b120 con 0x7fc6b413a730 2023-07-27T14:30:51.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:51.554+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000049527", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6b40bdc10 con 0x7fc6a005f130 2023-07-27T14:30:52.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.126+0000 7fc69bfff700 1 -- 172.21.15.115:0/610055193 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fc6b40bdc10 con 0x7fc6a005f130 2023-07-27T14:30:52.156 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:30:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:30:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "canceled", 2023-07-27T14:30:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:30:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:30:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000478966", 2023-07-27T14:30:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000585160" 2023-07-27T14:30:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:30:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "failure": { 2023-07-27T14:30:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "errno": "4", 2023-07-27T14:30:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "error_msg": "user interrupted clone operation" 2023-07-27T14:30:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:30:52.158 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:30:52.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a005f130 msgr2=0x7fc6a00615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a005f130 0x7fc6a00615f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fc6a4009bc0 tx=0x7fc6a4008040).stop 2023-07-27T14:30:52.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b413a730 msgr2=0x7fc6b40aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b413a730 0x7fc6b40aac80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fc6ac00cb40 tx=0x7fc6ac001e20).stop 2023-07-27T14:30:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 shutdown_connections 2023-07-27T14:30:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a005f130 0x7fc6a00615f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b413a730 0x7fc6b40aac80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b40c2fa0 0x7fc6b40633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 --2- 172.21.15.115:0/610055193 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b413a350 0x7fc6b40aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 >> 172.21.15.115:0/610055193 conn(0x7fc6b405e8f0 msgr2=0x7fc6b40ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:52.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 shutdown_connections 2023-07-27T14:30:52.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.128+0000 7fc6ba5ff700 1 -- 172.21.15.115:0/610055193 wait complete. 2023-07-27T14:30:52.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000049527 --force 2023-07-27T14:30:52.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.339+0000 7faf1c1ff700 1 Processor -- start 2023-07-27T14:30:52.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.339+0000 7faf1c1ff700 1 -- start start 2023-07-27T14:30:52.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1c1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faf1414ae00 0x7faf14154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1c1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf1414b1e0 0x7faf14062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1c1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf140c5c50 0x7faf14063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1c1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf14063530 con 0x7faf140c5c50 2023-07-27T14:30:52.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1c1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf141553f0 con 0x7faf1414ae00 2023-07-27T14:30:52.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1c1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf14157a50 con 0x7faf1414b1e0 2023-07-27T14:30:52.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1a79c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf140c5c50 0x7faf14063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1a79c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf140c5c50 0x7faf14063040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41708/0 (socket says 172.21.15.115:41708) 2023-07-27T14:30:52.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1a79c700 1 -- 172.21.15.115:0/698027116 learned_addr learned my addr 172.21.15.115:0/698027116 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:52.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1979a700 1 --2- 172.21.15.115:0/698027116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf1414b1e0 0x7faf14062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf19f9b700 1 --2- 172.21.15.115:0/698027116 >> v2:172.21.15.159:3300/0 conn(0x7faf1414ae00 0x7faf14154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1a79c700 1 -- 172.21.15.115:0/698027116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf1414b1e0 msgr2=0x7faf14062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:52.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1a79c700 1 --2- 172.21.15.115:0/698027116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf1414b1e0 0x7faf14062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1a79c700 1 -- 172.21.15.115:0/698027116 >> v2:172.21.15.159:3300/0 conn(0x7faf1414ae00 msgr2=0x7faf14154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:52.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1a79c700 1 --2- 172.21.15.115:0/698027116 >> v2:172.21.15.159:3300/0 conn(0x7faf1414ae00 0x7faf14154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.341+0000 7faf1a79c700 1 -- 172.21.15.115:0/698027116 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14157d10 con 0x7faf140c5c50 2023-07-27T14:30:52.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1a79c700 1 --2- 172.21.15.115:0/698027116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf140c5c50 0x7faf14063040 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7faf140caaf0 tx=0x7faf0c009840).ready entity=mon.0 client_cookie=af2d4896cf41921 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:52.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf18f99700 1 -- 172.21.15.115:0/698027116 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00e070 con 0x7faf140c5c50 2023-07-27T14:30:52.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf18f99700 1 -- 172.21.15.115:0/698027116 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c00ba50 con 0x7faf140c5c50 2023-07-27T14:30:52.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf18f99700 1 -- 172.21.15.115:0/698027116 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00bdd0 con 0x7faf140c5c50 2023-07-27T14:30:52.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 -- 172.21.15.115:0/698027116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf140c5c50 msgr2=0x7faf14063040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/698027116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf140c5c50 0x7faf14063040 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7faf140caaf0 tx=0x7faf0c009840).stop 2023-07-27T14:30:52.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 -- 172.21.15.115:0/698027116 shutdown_connections 2023-07-27T14:30:52.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/698027116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf140c5c50 0x7faf14063040 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/698027116 >> v2:172.21.15.159:3300/0 conn(0x7faf1414ae00 0x7faf14154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/698027116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf1414b1e0 0x7faf14062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 -- 172.21.15.115:0/698027116 >> 172.21.15.115:0/698027116 conn(0x7faf1405e940 msgr2=0x7faf140cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:52.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 -- 172.21.15.115:0/698027116 shutdown_connections 2023-07-27T14:30:52.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.342+0000 7faf1c1ff700 1 -- 172.21.15.115:0/698027116 wait complete. 2023-07-27T14:30:52.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.344+0000 7faf1c1ff700 1 Processor -- start 2023-07-27T14:30:52.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.345+0000 7faf1c1ff700 1 -- start start 2023-07-27T14:30:52.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1c1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf140c5c50 0x7faf140c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1c1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf1414ae00 0x7faf141498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1c1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1414b1e0 0x7faf140c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1c1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140c3240 con 0x7faf1414ae00 2023-07-27T14:30:52.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1c1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140c2630 con 0x7faf1414b1e0 2023-07-27T14:30:52.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1c1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf140c2910 con 0x7faf140c5c50 2023-07-27T14:30:52.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1979a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf1414ae00 0x7faf141498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1979a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf1414ae00 0x7faf141498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41720/0 (socket says 172.21.15.115:41720) 2023-07-27T14:30:52.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1979a700 1 -- 172.21.15.115:0/2331312410 learned_addr learned my addr 172.21.15.115:0/2331312410 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:52.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf1a79c700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1414b1e0 0x7faf140c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.346+0000 7faf19f9b700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf140c5c50 0x7faf140c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf1979a700 1 -- 172.21.15.115:0/2331312410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf140c5c50 msgr2=0x7faf140c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf1979a700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf140c5c50 0x7faf140c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf1979a700 1 -- 172.21.15.115:0/2331312410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1414b1e0 msgr2=0x7faf140c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf1979a700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1414b1e0 0x7faf140c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf1979a700 1 -- 172.21.15.115:0/2331312410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c009ae0 con 0x7faf1414ae00 2023-07-27T14:30:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf1979a700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf1414ae00 0x7faf141498c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7faf0400d860 tx=0x7faf04008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf09ffb700 1 -- 172.21.15.115:0/2331312410 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04011590 con 0x7faf1414ae00 2023-07-27T14:30:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf09ffb700 1 -- 172.21.15.115:0/2331312410 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf040116f0 con 0x7faf1414ae00 2023-07-27T14:30:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf140c2bf0 con 0x7faf1414ae00 2023-07-27T14:30:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf09ffb700 1 -- 172.21.15.115:0/2331312410 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04011a90 con 0x7faf1414ae00 2023-07-27T14:30:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.347+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf140c3bc0 con 0x7faf1414ae00 2023-07-27T14:30:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.348+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf140c33b0 con 0x7faf1414ae00 2023-07-27T14:30:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.349+0000 7faf09ffb700 1 -- 172.21.15.115:0/2331312410 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 75762+0+0 (secure 0 0 0) 0x7faf04012420 con 0x7faf1414ae00 2023-07-27T14:30:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.350+0000 7faf09ffb700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faef805f100 0x7faef80615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.350+0000 7faf09ffb700 1 -- 172.21.15.115:0/2331312410 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6237+0+0 (secure 0 0 0) 0x7faf04079c10 con 0x7faf1414ae00 2023-07-27T14:30:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.350+0000 7faf19f9b700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faef805f100 0x7faef80615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.350+0000 7faf19f9b700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faef805f100 0x7faef80615c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7faf1000bbc0 tx=0x7faf10008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:52.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.354+0000 7faf09ffb700 1 -- 172.21.15.115:0/2331312410 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf0404ac30 con 0x7faf1414ae00 2023-07-27T14:30:52.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.555+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000049527", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7faf1406c470 con 0x7faef805f100 2023-07-27T14:30:52.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.568+0000 7faf09ffb700 1 -- 172.21.15.115:0/2331312410 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faf1406c470 con 0x7faef805f100 2023-07-27T14:30:52.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faef805f100 msgr2=0x7faef80615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faef805f100 0x7faef80615c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7faf1000bbc0 tx=0x7faf10008040).stop 2023-07-27T14:30:52.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf1414ae00 msgr2=0x7faf141498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf1414ae00 0x7faf141498c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7faf0400d860 tx=0x7faf04008040).stop 2023-07-27T14:30:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 shutdown_connections 2023-07-27T14:30:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faef805f100 0x7faef80615c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf1414b1e0 0x7faf140c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faf140c5c50 0x7faf140c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 --2- 172.21.15.115:0/2331312410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf1414ae00 0x7faf141498c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 >> 172.21.15.115:0/2331312410 conn(0x7faf1405e940 msgr2=0x7faf1414a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 shutdown_connections 2023-07-27T14:30:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.571+0000 7faf1c1ff700 1 -- 172.21.15.115:0/2331312410 wait complete. 2023-07-27T14:30:52.606 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.576+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.606 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.576+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.607 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.576+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.607 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.576+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.607 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.576+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000478966 snapshot_0000000000585160 2023-07-27T14:30:52.623 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.593+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.623 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.593+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.623 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.593+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.623 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.593+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.624 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:30:52.593+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:30:52.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.786+0000 7f20835ff700 1 Processor -- start 2023-07-27T14:30:52.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.786+0000 7f20835ff700 1 -- start start 2023-07-27T14:30:52.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.787+0000 7f20835ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f207c14ae00 0x7f207c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.787+0000 7f20835ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f207c14b1e0 0x7f207c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.787+0000 7f20835ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207c1553f0 con 0x7f207c0c5c50 2023-07-27T14:30:52.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.787+0000 7f20835ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207c157a50 con 0x7f207c14ae00 2023-07-27T14:30:52.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.787+0000 7f20835ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207c157d10 con 0x7f207c14b1e0 2023-07-27T14:30:52.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.787+0000 7f208139b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f207c14ae00 0x7f207c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.787+0000 7f2081b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f207c0c5c50 0x7f207c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47300/0 (socket says 172.21.15.115:47300) 2023-07-27T14:30:52.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f2081b9c700 1 -- 172.21.15.115:0/1815485040 learned_addr learned my addr 172.21.15.115:0/1815485040 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:52.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f2080b9a700 1 --2- 172.21.15.115:0/1815485040 >> v2:172.21.15.159:3300/0 conn(0x7f207c14b1e0 0x7f207c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f2073fff700 1 -- 172.21.15.115:0/1815485040 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959635431 0 0) 0x7f207c1553f0 con 0x7f207c0c5c50 2023-07-27T14:30:52.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f2073fff700 1 -- 172.21.15.115:0/1815485040 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20680033f0 con 0x7f207c0c5c50 2023-07-27T14:30:52.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f208139b700 1 -- 172.21.15.115:0/1815485040 >> v2:172.21.15.159:3300/0 conn(0x7f207c14b1e0 msgr2=0x7f207c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:52.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f208139b700 1 --2- 172.21.15.115:0/1815485040 >> v2:172.21.15.159:3300/0 conn(0x7f207c14b1e0 0x7f207c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f208139b700 1 -- 172.21.15.115:0/1815485040 >> v1:172.21.15.115:6789/0 conn(0x7f207c0c5c50 legacy=0x7f207c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f208139b700 1 -- 172.21.15.115:0/1815485040 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c157ff0 con 0x7f207c14ae00 2023-07-27T14:30:52.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f208139b700 1 --2- 172.21.15.115:0/1815485040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c154f00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f207c155580 tx=0x7f2078009060).ready entity=mon.0 client_cookie=54c8a1a42cb702f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:52.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.788+0000 7f2073fff700 1 -- 172.21.15.115:0/1815485040 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800d4a0 con 0x7f207c14ae00 2023-07-27T14:30:52.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f2073fff700 1 -- 172.21.15.115:0/1815485040 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207800d600 con 0x7f207c14ae00 2023-07-27T14:30:52.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f2073fff700 1 -- 172.21.15.115:0/1815485040 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800d980 con 0x7f207c14ae00 2023-07-27T14:30:52.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f20835ff700 1 -- 172.21.15.115:0/1815485040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 msgr2=0x7f207c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f20835ff700 1 --2- 172.21.15.115:0/1815485040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c154f00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f207c155580 tx=0x7f2078009060).stop 2023-07-27T14:30:52.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f20835ff700 1 -- 172.21.15.115:0/1815485040 shutdown_connections 2023-07-27T14:30:52.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f20835ff700 1 --2- 172.21.15.115:0/1815485040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c154f00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f20835ff700 1 --2- 172.21.15.115:0/1815485040 >> v2:172.21.15.159:3300/0 conn(0x7f207c14b1e0 0x7f207c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f20835ff700 1 -- 172.21.15.115:0/1815485040 >> 172.21.15.115:0/1815485040 conn(0x7f207c05e940 msgr2=0x7f207c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:52.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f20835ff700 1 -- 172.21.15.115:0/1815485040 shutdown_connections 2023-07-27T14:30:52.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.789+0000 7f20835ff700 1 -- 172.21.15.115:0/1815485040 wait complete. 2023-07-27T14:30:52.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.791+0000 7f20835ff700 1 Processor -- start 2023-07-27T14:30:52.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.791+0000 7f20835ff700 1 -- start start 2023-07-27T14:30:52.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f20835ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207c0c5c50 0x7f207c148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f20835ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f20835ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c14b1e0 0x7f207c1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f20835ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c1537d0 con 0x7f207c14ae00 2023-07-27T14:30:52.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f20835ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0adc90 con 0x7f207c14b1e0 2023-07-27T14:30:52.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f20835ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0adf70 con 0x7f207c0c5c50 2023-07-27T14:30:52.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2080b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2080b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41764/0 (socket says 172.21.15.115:41764) 2023-07-27T14:30:52.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2080b9a700 1 -- 172.21.15.115:0/995319855 learned_addr learned my addr 172.21.15.115:0/995319855 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:52.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2081b9c700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c14b1e0 0x7f207c1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f208139b700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207c0c5c50 0x7f207c148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2080b9a700 1 -- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207c0c5c50 msgr2=0x7f207c148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2080b9a700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207c0c5c50 0x7f207c148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2080b9a700 1 -- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c14b1e0 msgr2=0x7f207c1532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:52.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2080b9a700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c14b1e0 0x7f207c1532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:52.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2080b9a700 1 -- 172.21.15.115:0/995319855 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780092a0 con 0x7f207c14ae00 2023-07-27T14:30:52.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.792+0000 7f2081b9c700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c14b1e0 0x7f207c1532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:30:52.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.793+0000 7f2080b9a700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c152df0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f206c00e8d0 tx=0x7f206c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:52.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.793+0000 7f20717fa700 1 -- 172.21.15.115:0/995319855 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c00c640 con 0x7f207c14ae00 2023-07-27T14:30:52.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.793+0000 7f20717fa700 1 -- 172.21.15.115:0/995319855 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c00c7a0 con 0x7f207c14ae00 2023-07-27T14:30:52.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.793+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c0ae250 con 0x7f207c14ae00 2023-07-27T14:30:52.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.793+0000 7f20717fa700 1 -- 172.21.15.115:0/995319855 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c00cb20 con 0x7f207c14ae00 2023-07-27T14:30:52.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.793+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207c0ae810 con 0x7f207c14ae00 2023-07-27T14:30:52.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.794+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c06c470 con 0x7f207c14ae00 2023-07-27T14:30:52.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.795+0000 7f20717fa700 1 -- 172.21.15.115:0/995319855 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 75762+0+0 (secure 0 0 0) 0x7f206c022070 con 0x7f207c14ae00 2023-07-27T14:30:52.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.796+0000 7f20717fa700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f206005f130 0x7f20600615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:52.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.796+0000 7f20717fa700 1 -- 172.21.15.115:0/995319855 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f206c07a540 con 0x7f207c14ae00 2023-07-27T14:30:52.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.796+0000 7f208139b700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f206005f130 0x7f20600615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:52.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.796+0000 7f208139b700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f206005f130 0x7f20600615f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f207800d260 tx=0x7f2078016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:52.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:52.800+0000 7f20717fa700 1 -- 172.21.15.115:0/995319855 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f206c04b5c0 con 0x7f207c14ae00 2023-07-27T14:30:53.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.006+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000478966", "snap_name": "snapshot_0000000000585160", "target": ["mon-mgr", ""]}) v1 -- 0x7f207c157760 con 0x7f206005f130 2023-07-27T14:30:53.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.041+0000 7f20717fa700 1 -- 172.21.15.115:0/995319855 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f207c157760 con 0x7f206005f130 2023-07-27T14:30:53.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.043+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f206005f130 msgr2=0x7f20600615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:53.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.043+0000 7f20835ff700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f206005f130 0x7f20600615f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f207800d260 tx=0x7f2078016000).stop 2023-07-27T14:30:53.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.043+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 msgr2=0x7f207c152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:53.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.043+0000 7f20835ff700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c152df0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f206c00e8d0 tx=0x7f206c009060).stop 2023-07-27T14:30:53.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.044+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 shutdown_connections 2023-07-27T14:30:53.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.044+0000 7f20835ff700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f206005f130 0x7f20600615f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.044+0000 7f20835ff700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f207c14b1e0 0x7f207c1532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.044+0000 7f20835ff700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f207c0c5c50 0x7f207c148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.044+0000 7f20835ff700 1 --2- 172.21.15.115:0/995319855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f207c14ae00 0x7f207c152df0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.044+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 >> 172.21.15.115:0/995319855 conn(0x7f207c05e940 msgr2=0x7f207c0c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:53.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.044+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 shutdown_connections 2023-07-27T14:30:53.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.044+0000 7f20835ff700 1 -- 172.21.15.115:0/995319855 wait complete. 2023-07-27T14:30:53.091 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000478966 2023-07-27T14:30:53.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.252+0000 7f63169ff700 1 Processor -- start 2023-07-27T14:30:53.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.253+0000 7f63169ff700 1 -- start start 2023-07-27T14:30:53.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.254+0000 7f63169ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6310063260 0x7f6310154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:53.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.254+0000 7f63169ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f631014b1e0 0x7f63100a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:53.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.254+0000 7f63169ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63101553f0 con 0x7f631014ae00 2023-07-27T14:30:53.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.254+0000 7f63169ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6310157a50 con 0x7f631014b1e0 2023-07-27T14:30:53.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.254+0000 7f63169ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6310157d10 con 0x7f6310063260 2023-07-27T14:30:53.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.254+0000 7f630ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f631014ae00 0x7f6310062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47306/0 (socket says 172.21.15.115:47306) 2023-07-27T14:30:53.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.254+0000 7f630ffff700 1 -- 172.21.15.115:0/939429000 learned_addr learned my addr 172.21.15.115:0/939429000 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:53.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.254+0000 7f6314f9c700 1 --2- 172.21.15.115:0/939429000 >> v2:172.21.15.115:3300/0 conn(0x7f631014b1e0 0x7f63100a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:53.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f630f7fe700 1 --2- 172.21.15.115:0/939429000 >> v2:172.21.15.159:3300/0 conn(0x7f6310063260 0x7f6310154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:53.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f630effd700 1 -- 172.21.15.115:0/939429000 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462758547 0 0) 0x7f63101553f0 con 0x7f631014ae00 2023-07-27T14:30:53.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f630effd700 1 -- 172.21.15.115:0/939429000 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f80033f0 con 0x7f631014ae00 2023-07-27T14:30:53.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f6314f9c700 1 -- 172.21.15.115:0/939429000 >> v2:172.21.15.159:3300/0 conn(0x7f6310063260 msgr2=0x7f6310154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:53.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f6314f9c700 1 --2- 172.21.15.115:0/939429000 >> v2:172.21.15.159:3300/0 conn(0x7f6310063260 0x7f6310154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f6314f9c700 1 -- 172.21.15.115:0/939429000 >> v1:172.21.15.115:6789/0 conn(0x7f631014ae00 legacy=0x7f6310062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:53.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f6314f9c700 1 -- 172.21.15.115:0/939429000 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310157ff0 con 0x7f631014b1e0 2023-07-27T14:30:53.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f6314f9c700 1 --2- 172.21.15.115:0/939429000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014b1e0 0x7f63100a98c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f63100cbc00 tx=0x7f6308009780).ready entity=mon.0 client_cookie=4b977ff46047335 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:53.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f630effd700 1 -- 172.21.15.115:0/939429000 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800e070 con 0x7f631014b1e0 2023-07-27T14:30:53.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f630effd700 1 -- 172.21.15.115:0/939429000 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630800bb60 con 0x7f631014b1e0 2023-07-27T14:30:53.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.255+0000 7f630effd700 1 -- 172.21.15.115:0/939429000 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308012410 con 0x7f631014b1e0 2023-07-27T14:30:53.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.256+0000 7f63169ff700 1 -- 172.21.15.115:0/939429000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014b1e0 msgr2=0x7f63100a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:53.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.256+0000 7f63169ff700 1 --2- 172.21.15.115:0/939429000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014b1e0 0x7f63100a98c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f63100cbc00 tx=0x7f6308009780).stop 2023-07-27T14:30:53.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.256+0000 7f63169ff700 1 -- 172.21.15.115:0/939429000 shutdown_connections 2023-07-27T14:30:53.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.256+0000 7f63169ff700 1 --2- 172.21.15.115:0/939429000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014b1e0 0x7f63100a98c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.256+0000 7f63169ff700 1 --2- 172.21.15.115:0/939429000 >> v2:172.21.15.159:3300/0 conn(0x7f6310063260 0x7f6310154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.256+0000 7f63169ff700 1 -- 172.21.15.115:0/939429000 >> 172.21.15.115:0/939429000 conn(0x7f631005e940 msgr2=0x7f63100cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:53.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.256+0000 7f63169ff700 1 -- 172.21.15.115:0/939429000 shutdown_connections 2023-07-27T14:30:53.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.256+0000 7f63169ff700 1 -- 172.21.15.115:0/939429000 wait complete. 2023-07-27T14:30:53.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.258+0000 7f63169ff700 1 Processor -- start 2023-07-27T14:30:53.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.258+0000 7f63169ff700 1 -- start start 2023-07-27T14:30:53.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f63169ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6310063260 0x7f631014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:53.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f63169ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014ae00 0x7f63100aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:53.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f63169ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f631014b1e0 0x7f63100af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f63169ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631014dc50 con 0x7f631014ae00 2023-07-27T14:30:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f63169ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63100ade00 con 0x7f6310063260 2023-07-27T14:30:53.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f63169ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631014d040 con 0x7f631014b1e0 2023-07-27T14:30:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014ae00 0x7f63100aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014ae00 0x7f63100aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41774/0 (socket says 172.21.15.115:41774) 2023-07-27T14:30:53.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630f7fe700 1 -- 172.21.15.115:0/3009674039 learned_addr learned my addr 172.21.15.115:0/3009674039 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:53.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630ffff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6310063260 0x7f631014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:53.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630f7fe700 1 -- 172.21.15.115:0/3009674039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f631014b1e0 msgr2=0x7f63100af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:53.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630f7fe700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f631014b1e0 0x7f63100af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:53.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630f7fe700 1 -- 172.21.15.115:0/3009674039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6310063260 msgr2=0x7f631014e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:53.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630f7fe700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6310063260 0x7f631014e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630f7fe700 1 -- 172.21.15.115:0/3009674039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308009a20 con 0x7f631014ae00 2023-07-27T14:30:53.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.259+0000 7f630ffff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6310063260 0x7f631014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:30:53.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.260+0000 7f630f7fe700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014ae00 0x7f63100aea80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f630400d860 tx=0x7f6304008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:53.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.260+0000 7f62f7fff700 1 -- 172.21.15.115:0/3009674039 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040125f0 con 0x7f631014ae00 2023-07-27T14:30:53.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.260+0000 7f62f7fff700 1 -- 172.21.15.115:0/3009674039 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6304012750 con 0x7f631014ae00 2023-07-27T14:30:53.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.260+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631014d320 con 0x7f631014ae00 2023-07-27T14:30:53.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.260+0000 7f62f7fff700 1 -- 172.21.15.115:0/3009674039 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304012ad0 con 0x7f631014ae00 2023-07-27T14:30:53.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.260+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631014d8e0 con 0x7f631014ae00 2023-07-27T14:30:53.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.261+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631006c470 con 0x7f631014ae00 2023-07-27T14:30:53.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.262+0000 7f62f7fff700 1 -- 172.21.15.115:0/3009674039 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 75762+0+0 (secure 0 0 0) 0x7f6304013480 con 0x7f631014ae00 2023-07-27T14:30:53.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.263+0000 7f62f7fff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62fc05f160 0x7f62fc061620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:53.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.263+0000 7f62f7fff700 1 -- 172.21.15.115:0/3009674039 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f630407a0e0 con 0x7f631014ae00 2023-07-27T14:30:53.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.263+0000 7f630ffff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62fc05f160 0x7f62fc061620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:53.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.263+0000 7f630ffff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62fc05f160 0x7f62fc061620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6300005750 tx=0x7f6300009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:53.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.267+0000 7f62f7fff700 1 -- 172.21.15.115:0/3009674039 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f630404b100 con 0x7f631014ae00 2023-07-27T14:30:53.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.469+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000478966", "target": ["mon-mgr", ""]}) v1 -- 0x7f631006b9c0 con 0x7f62fc05f160 2023-07-27T14:30:53.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.485+0000 7f62f7fff700 1 -- 172.21.15.115:0/3009674039 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f631006b9c0 con 0x7f62fc05f160 2023-07-27T14:30:53.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62fc05f160 msgr2=0x7f62fc061620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:53.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62fc05f160 0x7f62fc061620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6300005750 tx=0x7f6300009040).stop 2023-07-27T14:30:53.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014ae00 msgr2=0x7f63100aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:53.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014ae00 0x7f63100aea80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f630400d860 tx=0x7f6304008040).stop 2023-07-27T14:30:53.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 shutdown_connections 2023-07-27T14:30:53.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62fc05f160 0x7f62fc061620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f631014b1e0 0x7f63100af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:30:53.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6310063260 0x7f631014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 --2- 172.21.15.115:0/3009674039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631014ae00 0x7f63100aea80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:53.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 >> 172.21.15.115:0/3009674039 conn(0x7f631005e940 msgr2=0x7f63100c0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:53.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 shutdown_connections 2023-07-27T14:30:53.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:53.487+0000 7f63169ff700 1 -- 172.21.15.115:0/3009674039 wait complete. 2023-07-27T14:30:53.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:53.538 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:30:53.637 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-07-27T14:30:58.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:58.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:30:58.735 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:30:58.736 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:30:58.737 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:30:58.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:30:58.943 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:30:58.944 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:30:58.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:58.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:30:59.059 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:30:59.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:59.060 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:30:59.112 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:30:59.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:30:59.113 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:30:59.203 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:30:59.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:30:59.204 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:30:59.235 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:30:59.240 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:30:59.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:30:59.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.440+0000 7fedabfff700 1 Processor -- start 2023-07-27T14:30:59.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.440+0000 7fedabfff700 1 -- start start 2023-07-27T14:30:59.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7fedabfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7feda4151bd0 0x7feda4062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7fedabfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7fedabfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda40639d0 con 0x7feda40a4d30 2023-07-27T14:30:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7fedabfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda4137610 con 0x7feda4151bd0 2023-07-27T14:30:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7fedabfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40a51c0 con 0x7feda4062810 2023-07-27T14:30:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7fedaa59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7feda40a4d30 0x7feda4157ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37758/0 (socket says 172.21.15.115:37758) 2023-07-27T14:30:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7fedaa59c700 1 -- 172.21.15.115:0/2061249357 learned_addr learned my addr 172.21.15.115:0/2061249357 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7feda959a700 1 --2- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7feda9d9b700 1 --2- 172.21.15.115:0/2061249357 >> v2:172.21.15.159:3300/0 conn(0x7feda4151bd0 0x7feda4062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7feda8d99700 1 -- 172.21.15.115:0/2061249357 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265830505 0 0) 0x7feda40639d0 con 0x7feda40a4d30 2023-07-27T14:30:59.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.442+0000 7feda8d99700 1 -- 172.21.15.115:0/2061249357 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed900033f0 con 0x7feda40a4d30 2023-07-27T14:30:59.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda9d9b700 1 -- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 msgr2=0x7feda40a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:59.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda9d9b700 1 --2- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda9d9b700 1 -- 172.21.15.115:0/2061249357 >> v1:172.21.15.115:6789/0 conn(0x7feda40a4d30 legacy=0x7feda4157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda9d9b700 1 -- 172.21.15.115:0/2061249357 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda4062dc0 con 0x7feda4151bd0 2023-07-27T14:30:59.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda959a700 1 --2- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:59.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda9d9b700 1 --2- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 0x7feda4062320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7feda0009760 tx=0x7feda0009060).ready entity=mon.1 client_cookie=8e54e1be140fd876 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:59.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda8d99700 1 -- 172.21.15.115:0/2061249357 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda000d4a0 con 0x7feda4151bd0 2023-07-27T14:30:59.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda8d99700 1 -- 172.21.15.115:0/2061249357 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda000d600 con 0x7feda4151bd0 2023-07-27T14:30:59.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.443+0000 7feda8d99700 1 -- 172.21.15.115:0/2061249357 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda000d980 con 0x7feda4151bd0 2023-07-27T14:30:59.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.444+0000 7fedabfff700 1 -- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 msgr2=0x7feda4062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.444+0000 7fedabfff700 1 --2- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 0x7feda4062320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7feda0009760 tx=0x7feda0009060).stop 2023-07-27T14:30:59.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.444+0000 7fedabfff700 1 -- 172.21.15.115:0/2061249357 shutdown_connections 2023-07-27T14:30:59.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.444+0000 7fedabfff700 1 --2- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 0x7feda4062320 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.444+0000 7fedabfff700 1 --2- 172.21.15.115:0/2061249357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.444+0000 7fedabfff700 1 -- 172.21.15.115:0/2061249357 >> 172.21.15.115:0/2061249357 conn(0x7feda4064700 msgr2=0x7feda4064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:59.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.444+0000 7fedabfff700 1 -- 172.21.15.115:0/2061249357 shutdown_connections 2023-07-27T14:30:59.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.444+0000 7fedabfff700 1 -- 172.21.15.115:0/2061249357 wait complete. 2023-07-27T14:30:59.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.445+0000 7fedabfff700 1 Processor -- start 2023-07-27T14:30:59.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.445+0000 7fedabfff700 1 -- start start 2023-07-27T14:30:59.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.446+0000 7fedabfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40bf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.446+0000 7fedabfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feda40a4d30 0x7feda4154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.446+0000 7fedabfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 0x7feda413cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.446+0000 7fedabfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40c0c00 con 0x7feda40a4d30 2023-07-27T14:30:59.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.446+0000 7fedabfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda4154960 con 0x7feda4151bd0 2023-07-27T14:30:59.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.446+0000 7fedabfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40bfff0 con 0x7feda4062810 2023-07-27T14:30:59.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.446+0000 7feda959a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feda40a4d30 0x7feda4154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda959a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feda40a4d30 0x7feda4154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47704/0 (socket says 172.21.15.115:47704) 2023-07-27T14:30:59.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda959a700 1 -- 172.21.15.115:0/2643665799 learned_addr learned my addr 172.21.15.115:0/2643665799 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:59.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda9d9b700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7fedaa59c700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 0x7feda413cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda959a700 1 -- 172.21.15.115:0/2643665799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 msgr2=0x7feda40bf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda959a700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40bf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda959a700 1 -- 172.21.15.115:0/2643665799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 msgr2=0x7feda413cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda959a700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 0x7feda413cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda959a700 1 -- 172.21.15.115:0/2643665799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed940092a0 con 0x7feda40a4d30 2023-07-27T14:30:59.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7feda959a700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feda40a4d30 0x7feda4154470 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fed9400e9b0 tx=0x7fed94009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:59.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7fed99ffb700 1 -- 172.21.15.115:0/2643665799 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400c850 con 0x7feda40a4d30 2023-07-27T14:30:59.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7fed99ffb700 1 -- 172.21.15.115:0/2643665799 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400c9b0 con 0x7feda40a4d30 2023-07-27T14:30:59.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda00092a0 con 0x7feda40a4d30 2023-07-27T14:30:59.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.447+0000 7fed99ffb700 1 -- 172.21.15.115:0/2643665799 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400cd30 con 0x7feda40a4d30 2023-07-27T14:30:59.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.448+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40c05b0 con 0x7feda40a4d30 2023-07-27T14:30:59.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.448+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda40a6ab0 con 0x7feda40a4d30 2023-07-27T14:30:59.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.449+0000 7fed99ffb700 1 -- 172.21.15.115:0/2643665799 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fed94022070 con 0x7feda40a4d30 2023-07-27T14:30:59.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.450+0000 7fed99ffb700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed8805f1c0 0x7fed88061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.450+0000 7fed99ffb700 1 -- 172.21.15.115:0/2643665799 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fed9407a7b0 con 0x7feda40a4d30 2023-07-27T14:30:59.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.450+0000 7feda9d9b700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed8805f1c0 0x7fed88061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.451+0000 7feda9d9b700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed8805f1c0 0x7fed88061680 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7feda4136a10 tx=0x7feda0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:59.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.454+0000 7fed99ffb700 1 -- 172.21.15.115:0/2643665799 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feda40a6ab0 con 0x7feda40a4d30 2023-07-27T14:30:59.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.663+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feda40a6ab0 con 0x7feda40a4d30 2023-07-27T14:30:59.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.664+0000 7fed99ffb700 1 -- 172.21.15.115:0/2643665799 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4502 (secure 0 0 0) 0x7feda40a6ab0 con 0x7feda40a4d30 2023-07-27T14:30:59.696 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:30:59.696 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1689103707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1689103707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1689103707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/2448381398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2448381398},{"type":"v1","addr":"172.21.15.159:6834","nonce":2448381398}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3512171796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3512171796},{"type":"v1","addr":"172.21.15.159:6835","nonce":3512171796}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:30:16.247520+0000","modified":"2023-07-27T14:30:19.259578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2262768820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2262768820},{"type":"v1","addr":"172.21.15.115:6836","nonce":2262768820}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-07-27T14:30:59.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed8805f1c0 msgr2=0x7fed88061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed8805f1c0 0x7fed88061680 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7feda4136a10 tx=0x7feda0016000).stop 2023-07-27T14:30:59.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feda40a4d30 msgr2=0x7feda4154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feda40a4d30 0x7feda4154470 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fed9400e9b0 tx=0x7fed94009060).stop 2023-07-27T14:30:59.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 shutdown_connections 2023-07-27T14:30:59.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed8805f1c0 0x7fed88061680 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda4151bd0 0x7feda413cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feda4062810 0x7feda40bf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 --2- 172.21.15.115:0/2643665799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feda40a4d30 0x7feda4154470 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.666+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 >> 172.21.15.115:0/2643665799 conn(0x7feda4064700 msgr2=0x7feda4068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:59.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.667+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 shutdown_connections 2023-07-27T14:30:59.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.667+0000 7fedabfff700 1 -- 172.21.15.115:0/2643665799 wait complete. 2023-07-27T14:30:59.701 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 34 2023-07-27T14:30:59.716 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:30:59.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.872+0000 7fd4fabff700 1 Processor -- start 2023-07-27T14:30:59.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.872+0000 7fd4fabff700 1 -- start start 2023-07-27T14:30:59.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.873+0000 7fd4fabff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd4f4151bd0 0x7fd4f4062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.873+0000 7fd4fabff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f4062810 0x7fd4f40a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.873+0000 7fd4fabff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f40639d0 con 0x7fd4f40a4d30 2023-07-27T14:30:59.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.873+0000 7fd4fabff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f4137610 con 0x7fd4f4151bd0 2023-07-27T14:30:59.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.873+0000 7fd4fabff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40a51c0 con 0x7fd4f4062810 2023-07-27T14:30:59.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f3fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f4062810 0x7fd4f40a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f899b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd4f4151bd0 0x7fd4f4062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f919c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fd4f40a4d30 0x7fd4f4157ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:55162/0 (socket says 172.21.15.115:55162) 2023-07-27T14:30:59.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f919c700 1 -- 172.21.15.115:0/950967444 learned_addr learned my addr 172.21.15.115:0/950967444 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:30:59.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f3fff700 1 -- 172.21.15.115:0/950967444 >> v2:172.21.15.159:3300/0 conn(0x7fd4f4151bd0 msgr2=0x7fd4f4062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:30:59.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f3fff700 1 --2- 172.21.15.115:0/950967444 >> v2:172.21.15.159:3300/0 conn(0x7fd4f4151bd0 0x7fd4f4062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f37fe700 1 -- 172.21.15.115:0/950967444 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363002010 0 0) 0x7fd4f40639d0 con 0x7fd4f40a4d30 2023-07-27T14:30:59.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f3fff700 1 -- 172.21.15.115:0/950967444 >> v1:172.21.15.159:6789/0 conn(0x7fd4f40a4d30 legacy=0x7fd4f4157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.874+0000 7fd4f3fff700 1 -- 172.21.15.115:0/950967444 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4062dc0 con 0x7fd4f4062810 2023-07-27T14:30:59.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4f3fff700 1 --2- 172.21.15.115:0/950967444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f4062810 0x7fd4f40a4840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd4e0009760 tx=0x7fd4e0009060).ready entity=mon.2 client_cookie=7da8f0e4c61c9a56 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:59.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4f37fe700 1 -- 172.21.15.115:0/950967444 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000f510 con 0x7fd4f4062810 2023-07-27T14:30:59.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4f37fe700 1 -- 172.21.15.115:0/950967444 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e000f670 con 0x7fd4f4062810 2023-07-27T14:30:59.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4f37fe700 1 -- 172.21.15.115:0/950967444 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000f9f0 con 0x7fd4f4062810 2023-07-27T14:30:59.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4fabff700 1 -- 172.21.15.115:0/950967444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f4062810 msgr2=0x7fd4f40a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4fabff700 1 --2- 172.21.15.115:0/950967444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f4062810 0x7fd4f40a4840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd4e0009760 tx=0x7fd4e0009060).stop 2023-07-27T14:30:59.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4fabff700 1 -- 172.21.15.115:0/950967444 shutdown_connections 2023-07-27T14:30:59.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4fabff700 1 --2- 172.21.15.115:0/950967444 >> v2:172.21.15.159:3300/0 conn(0x7fd4f4151bd0 0x7fd4f4062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4fabff700 1 --2- 172.21.15.115:0/950967444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f4062810 0x7fd4f40a4840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.875+0000 7fd4fabff700 1 -- 172.21.15.115:0/950967444 >> 172.21.15.115:0/950967444 conn(0x7fd4f4064700 msgr2=0x7fd4f4064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:30:59.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.876+0000 7fd4fabff700 1 -- 172.21.15.115:0/950967444 shutdown_connections 2023-07-27T14:30:59.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.876+0000 7fd4fabff700 1 -- 172.21.15.115:0/950967444 wait complete. 2023-07-27T14:30:59.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.877+0000 7fd4fabff700 1 Processor -- start 2023-07-27T14:30:59.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.877+0000 7fd4fabff700 1 -- start start 2023-07-27T14:30:59.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.878+0000 7fd4fabff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f4062810 0x7fd4f413d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.878+0000 7fd4fabff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f40a4d30 0x7fd4f41520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.878+0000 7fd4fabff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4f4151bd0 0x7fd4f4154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.878+0000 7fd4fabff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f413bbd0 con 0x7fd4f4151bd0 2023-07-27T14:30:59.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.878+0000 7fd4fabff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f4167330 con 0x7fd4f4062810 2023-07-27T14:30:59.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.878+0000 7fd4fabff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f413db90 con 0x7fd4f40a4d30 2023-07-27T14:30:59.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f4062810 0x7fd4f413d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f3fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f40a4d30 0x7fd4f41520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f919c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4f4151bd0 0x7fd4f4154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f4062810 0x7fd4f413d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:44960/0 (socket says 172.21.15.115:44960) 2023-07-27T14:30:59.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 -- 172.21.15.115:0/831023105 learned_addr learned my addr 172.21.15.115:0/831023105 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:30:59.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 -- 172.21.15.115:0/831023105 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f40a4d30 msgr2=0x7fd4f41520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f40a4d30 0x7fd4f41520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 -- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4f4151bd0 msgr2=0x7fd4f4154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:30:59.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4f4151bd0 0x7fd4f4154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:30:59.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 -- 172.21.15.115:0/831023105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00092a0 con 0x7fd4f4062810 2023-07-27T14:30:59.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f3fff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f40a4d30 0x7fd4f41520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:30:59.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f899b700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f4062810 0x7fd4f413d6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fd4e800e930 tx=0x7fd4e8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:59.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f0ff9700 1 -- 172.21.15.115:0/831023105 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8012600 con 0x7fd4f4062810 2023-07-27T14:30:59.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f0ff9700 1 -- 172.21.15.115:0/831023105 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e8012760 con 0x7fd4f4062810 2023-07-27T14:30:59.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4f0ff9700 1 -- 172.21.15.115:0/831023105 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8012ae0 con 0x7fd4f4062810 2023-07-27T14:30:59.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.879+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f413b980 con 0x7fd4f4062810 2023-07-27T14:30:59.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.880+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f413b3b0 con 0x7fd4f4062810 2023-07-27T14:30:59.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.881+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f41675d0 con 0x7fd4f4062810 2023-07-27T14:30:59.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.881+0000 7fd4f0ff9700 1 -- 172.21.15.115:0/831023105 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fd4e8022070 con 0x7fd4f4062810 2023-07-27T14:30:59.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.882+0000 7fd4f0ff9700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd4d805f1c0 0x7fd4d8061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:30:59.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.882+0000 7fd4f0ff9700 1 -- 172.21.15.115:0/831023105 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd4e807a6d0 con 0x7fd4f4062810 2023-07-27T14:30:59.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.882+0000 7fd4f3fff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd4d805f1c0 0x7fd4d8061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:30:59.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.883+0000 7fd4f3fff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd4d805f1c0 0x7fd4d8061680 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fd4f40c1300 tx=0x7fd4e0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:30:59.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:30:59.887+0000 7fd4f0ff9700 1 -- 172.21.15.115:0/831023105 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4e804b680 con 0x7fd4f4062810 2023-07-27T14:31:00.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.057+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4f406c470 con 0x7fd4f4062810 2023-07-27T14:31:00.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.058+0000 7fd4f0ff9700 1 -- 172.21.15.115:0/831023105 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+17375 (secure 0 0 0) 0x7fd4e804eca0 con 0x7fd4f4062810 2023-07-27T14:31:00.090 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:00.090 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":71,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:30:56.664424+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:30:14.561612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-27T14:30:15.229143+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":10,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":10,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:31:00.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd4d805f1c0 msgr2=0x7fd4d8061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd4d805f1c0 0x7fd4d8061680 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fd4f40c1300 tx=0x7fd4e0017000).stop 2023-07-27T14:31:00.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f4062810 msgr2=0x7fd4f413d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f4062810 0x7fd4f413d6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fd4e800e930 tx=0x7fd4e8009060).stop 2023-07-27T14:31:00.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 shutdown_connections 2023-07-27T14:31:00.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd4d805f1c0 0x7fd4d8061680 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4f4151bd0 0x7fd4f4154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4f4062810 0x7fd4f413d6a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 --2- 172.21.15.115:0/831023105 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4f40a4d30 0x7fd4f41520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 >> 172.21.15.115:0/831023105 conn(0x7fd4f4064700 msgr2=0x7fd4f40c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:00.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 shutdown_connections 2023-07-27T14:31:00.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.061+0000 7fd4fabff700 1 -- 172.21.15.115:0/831023105 wait complete. 2023-07-27T14:31:00.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:30:14.561612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:30:15.229143+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:31:00.110 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:31:00.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.271+0000 7f35c67ff700 1 Processor -- start 2023-07-27T14:31:00.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.271+0000 7f35c67ff700 1 -- start start 2023-07-27T14:31:00.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.272+0000 7f35c67ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f35c00c58d0 0x7f35c0150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.272+0000 7f35c67ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c00c0ea0 con 0x7f35c00c3100 2023-07-27T14:31:00.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.272+0000 7f35c67ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c0068e10 con 0x7f35c01509b0 2023-07-27T14:31:00.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.272+0000 7f35c67ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c0151280 con 0x7f35c00c58d0 2023-07-27T14:31:00.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.272+0000 7f35bf7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f35c00c58d0 0x7f35c0150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.272+0000 7f35c4d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f35c00c3100 0x7f35c00c3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37772/0 (socket says 172.21.15.115:37772) 2023-07-27T14:31:00.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.272+0000 7f35c4d9c700 1 -- 172.21.15.115:0/2804198335 learned_addr learned my addr 172.21.15.115:0/2804198335 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:00.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.272+0000 7f35bffff700 1 --1- 172.21.15.115:0/2804198335 >> v1:172.21.15.159:6789/0 conn(0x7f35c01509b0 0x7f35c0154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:55174/0 (socket says 172.21.15.115:55174) 2023-07-27T14:31:00.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.273+0000 7f35bf7fe700 1 -- 172.21.15.115:0/2804198335 >> v1:172.21.15.159:6789/0 conn(0x7f35c01509b0 legacy=0x7f35c0154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.273+0000 7f35bf7fe700 1 -- 172.21.15.115:0/2804198335 >> v1:172.21.15.115:6789/0 conn(0x7f35c00c3100 legacy=0x7f35c00c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.273+0000 7f35bf7fe700 1 -- 172.21.15.115:0/2804198335 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0155190 con 0x7f35c00c58d0 2023-07-27T14:31:00.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.273+0000 7f35beffd700 1 -- 172.21.15.115:0/2804198335 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141228246 0 0) 0x7f35c00c0ea0 con 0x7f35c00c3100 2023-07-27T14:31:00.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.273+0000 7f35bf7fe700 1 --2- 172.21.15.115:0/2804198335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c58d0 0x7f35c0150d90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f35b4009760 tx=0x7f35b4009060).ready entity=mon.0 client_cookie=cf2f51f09a9f2607 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:00.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.273+0000 7f35beffd700 1 -- 172.21.15.115:0/2804198335 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400b580 con 0x7f35c00c58d0 2023-07-27T14:31:00.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.273+0000 7f35beffd700 1 -- 172.21.15.115:0/2804198335 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400b6e0 con 0x7f35c00c58d0 2023-07-27T14:31:00.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.273+0000 7f35beffd700 1 -- 172.21.15.115:0/2804198335 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400ba60 con 0x7f35c00c58d0 2023-07-27T14:31:00.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.274+0000 7f35c67ff700 1 -- 172.21.15.115:0/2804198335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c58d0 msgr2=0x7f35c0150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.274+0000 7f35c67ff700 1 --2- 172.21.15.115:0/2804198335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c58d0 0x7f35c0150d90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f35b4009760 tx=0x7f35b4009060).stop 2023-07-27T14:31:00.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.274+0000 7f35c67ff700 1 -- 172.21.15.115:0/2804198335 shutdown_connections 2023-07-27T14:31:00.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.274+0000 7f35c67ff700 1 --2- 172.21.15.115:0/2804198335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c58d0 0x7f35c0150d90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.274+0000 7f35c67ff700 1 -- 172.21.15.115:0/2804198335 >> 172.21.15.115:0/2804198335 conn(0x7f35c0062320 msgr2=0x7f35c0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:00.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.274+0000 7f35c67ff700 1 -- 172.21.15.115:0/2804198335 shutdown_connections 2023-07-27T14:31:00.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.274+0000 7f35c67ff700 1 -- 172.21.15.115:0/2804198335 wait complete. 2023-07-27T14:31:00.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.275+0000 7f35c67ff700 1 Processor -- start 2023-07-27T14:31:00.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.276+0000 7f35c67ff700 1 -- start start 2023-07-27T14:31:00.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.276+0000 7f35c67ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c3100 0x7f35c00a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.276+0000 7f35c67ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35c00c58d0 0x7f35c00a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.276+0000 7f35c67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35c01509b0 0x7f35c014e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.276+0000 7f35c67ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00ac8d0 con 0x7f35c00c3100 2023-07-27T14:31:00.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.276+0000 7f35c67ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00ac440 con 0x7f35c00c58d0 2023-07-27T14:31:00.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.276+0000 7f35c67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00ab830 con 0x7f35c01509b0 2023-07-27T14:31:00.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c3100 0x7f35c00a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c3100 0x7f35c00a5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47728/0 (socket says 172.21.15.115:47728) 2023-07-27T14:31:00.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 -- 172.21.15.115:0/1943988275 learned_addr learned my addr 172.21.15.115:0/1943988275 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:00.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35c4d9c700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35c01509b0 0x7f35c014e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bf7fe700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35c00c58d0 0x7f35c00a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 -- 172.21.15.115:0/1943988275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35c01509b0 msgr2=0x7f35c014e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35c01509b0 0x7f35c014e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 -- 172.21.15.115:0/1943988275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35c00c58d0 msgr2=0x7f35c00a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35c00c58d0 0x7f35c00a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 -- 172.21.15.115:0/1943988275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40092a0 con 0x7f35c00c3100 2023-07-27T14:31:00.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.277+0000 7f35bffff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c3100 0x7f35c00a5bc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f35b0001eb0 tx=0x7f35b0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:00.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.278+0000 7f35a7fff700 1 -- 172.21.15.115:0/1943988275 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00070d0 con 0x7f35c00c3100 2023-07-27T14:31:00.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.278+0000 7f35a7fff700 1 -- 172.21.15.115:0/1943988275 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0007230 con 0x7f35c00c3100 2023-07-27T14:31:00.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.278+0000 7f35a7fff700 1 -- 172.21.15.115:0/1943988275 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00075b0 con 0x7f35c00c3100 2023-07-27T14:31:00.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.278+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c00abb10 con 0x7f35c00c3100 2023-07-27T14:31:00.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.278+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c00ac0d0 con 0x7f35c00c3100 2023-07-27T14:31:00.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.279+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c006c470 con 0x7f35c00c3100 2023-07-27T14:31:00.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.279+0000 7f35a7fff700 1 -- 172.21.15.115:0/1943988275 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f35b0010070 con 0x7f35c00c3100 2023-07-27T14:31:00.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.280+0000 7f35a7fff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f35ac05f1c0 0x7f35ac061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.280+0000 7f35a7fff700 1 -- 172.21.15.115:0/1943988275 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f35b00798a0 con 0x7f35c00c3100 2023-07-27T14:31:00.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.280+0000 7f35bf7fe700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f35ac05f1c0 0x7f35ac061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.281+0000 7f35bf7fe700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f35ac05f1c0 0x7f35ac061680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f35b4006e00 tx=0x7f35b4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:00.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.284+0000 7f35a7fff700 1 -- 172.21.15.115:0/1943988275 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35b004a850 con 0x7f35c00c3100 2023-07-27T14:31:00.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.452+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f35c00655d0 con 0x7f35c00c3100 2023-07-27T14:31:00.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.452+0000 7f35a7fff700 1 -- 172.21.15.115:0/1943988275 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v71) v1 ==== 110+0+10 (secure 0 0 0) 0x7f35b004de70 con 0x7f35c00c3100 2023-07-27T14:31:00.524 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:31:00.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f35ac05f1c0 msgr2=0x7f35ac061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f35ac05f1c0 0x7f35ac061680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f35b4006e00 tx=0x7f35b4017000).stop 2023-07-27T14:31:00.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c3100 msgr2=0x7f35c00a5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c3100 0x7f35c00a5bc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f35b0001eb0 tx=0x7f35b0007df0).stop 2023-07-27T14:31:00.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 shutdown_connections 2023-07-27T14:31:00.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f35ac05f1c0 0x7f35ac061680 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35c01509b0 0x7f35c014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35c00c3100 0x7f35c00a5bc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 --2- 172.21.15.115:0/1943988275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35c00c58d0 0x7f35c00a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 >> 172.21.15.115:0/1943988275 conn(0x7f35c0062320 msgr2=0x7f35c00bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:00.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.454+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 shutdown_connections 2023-07-27T14:31:00.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.455+0000 7f35c67ff700 1 -- 172.21.15.115:0/1943988275 wait complete. 2023-07-27T14:31:00.528 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:31:00.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.688+0000 7f1480fff700 1 Processor -- start 2023-07-27T14:31:00.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.688+0000 7f1480fff700 1 -- start start 2023-07-27T14:31:00.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.689+0000 7f1480fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c063260 0x7f147c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.689+0000 7f1480fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c1553f0 con 0x7f147c14ae00 2023-07-27T14:31:00.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.689+0000 7f1480fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c157a50 con 0x7f147c14b1e0 2023-07-27T14:31:00.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.689+0000 7f1480fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c157d10 con 0x7f147c063260 2023-07-27T14:31:00.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.689+0000 7f147a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f147c14ae00 0x7f147c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37782/0 (socket says 172.21.15.115:37782) 2023-07-27T14:31:00.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.689+0000 7f147a59c700 1 -- 172.21.15.115:0/393171705 learned_addr learned my addr 172.21.15.115:0/393171705 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:00.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f1479d9b700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c063260 0x7f147c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153292912 0 0) 0x7f147c1553f0 con 0x7f147c14ae00 2023-07-27T14:31:00.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14640033f0 con 0x7f147c14ae00 2023-07-27T14:31:00.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4010066521 0 0) 0x7f14640033f0 con 0x7f147c14ae00 2023-07-27T14:31:00.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c063260 msgr2=0x7f147c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:00.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c063260 0x7f147c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 >> v1:172.21.15.159:6789/0 conn(0x7f147c14b1e0 legacy=0x7f147c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c157ff0 con 0x7f147c14ae00 2023-07-27T14:31:00.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f146c001470 con 0x7f147c14ae00 2023-07-27T14:31:00.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 >> v1:172.21.15.115:6789/0 conn(0x7f147c14ae00 legacy=0x7f147c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f1464003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1464004690 0x7f1464004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c063260 0x7f1464005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c157d10 con 0x7f1464003910 2023-07-27T14:31:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146400b8e0 con 0x7f1464004690 2023-07-27T14:31:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146400ba50 con 0x7f147c063260 2023-07-27T14:31:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.690+0000 7f147a59c700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f1464003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f1479d9b700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1464004690 0x7f1464004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147ad9d700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c063260 0x7f1464005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147a59c700 1 -- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c063260 msgr2=0x7f1464005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147a59c700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c063260 0x7f1464005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147a59c700 1 -- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1464004690 msgr2=0x7f1464004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:00.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147a59c700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1464004690 0x7f1464004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147a59c700 1 -- 172.21.15.115:0/393171705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640033f0 con 0x7f1464003910 2023-07-27T14:31:00.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147a59c700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f1464003cf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f146c00c1e0 tx=0x7f147c14eb20).ready entity=mon.0 client_cookie=b1d08c991e3db2cf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:00.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c007a60 con 0x7f1464003910 2023-07-27T14:31:00.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c00ca50 con 0x7f1464003910 2023-07-27T14:31:00.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.691+0000 7f147959a700 1 -- 172.21.15.115:0/393171705 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00ce10 con 0x7f1464003910 2023-07-27T14:31:00.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.692+0000 7f1480fff700 1 -- 172.21.15.115:0/393171705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 msgr2=0x7f1464003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.692+0000 7f1480fff700 1 --2- 172.21.15.115:0/393171705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f1464003cf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f146c00c1e0 tx=0x7f147c14eb20).stop 2023-07-27T14:31:00.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.692+0000 7f147ad9d700 1 -- 172.21.15.115:0/393171705 reap_dead start 2023-07-27T14:31:00.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.692+0000 7f1480fff700 1 -- 172.21.15.115:0/393171705 shutdown_connections 2023-07-27T14:31:00.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.692+0000 7f1480fff700 1 -- 172.21.15.115:0/393171705 >> 172.21.15.115:0/393171705 conn(0x7f147c05e940 msgr2=0x7f147c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:00.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.692+0000 7f1480fff700 1 -- 172.21.15.115:0/393171705 shutdown_connections 2023-07-27T14:31:00.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.692+0000 7f1480fff700 1 -- 172.21.15.115:0/393171705 wait complete. 2023-07-27T14:31:00.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.694+0000 7f1480fff700 1 Processor -- start 2023-07-27T14:31:00.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.694+0000 7f1480fff700 1 -- start start 2023-07-27T14:31:00.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.695+0000 7f1480fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f147c0c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.695+0000 7f1480fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f147c14a150 0x7f147c14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.695+0000 7f1480fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c167110 0x7f147c167570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.695+0000 7f1480fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c15a380 con 0x7f1464003910 2023-07-27T14:31:00.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.695+0000 7f1480fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c4bf0 con 0x7f147c14a150 2023-07-27T14:31:00.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.695+0000 7f1480fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1519f0 con 0x7f147c167110 2023-07-27T14:31:00.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f147c0c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f147c0c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47748/0 (socket says 172.21.15.115:47748) 2023-07-27T14:31:00.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 -- 172.21.15.115:0/694249073 learned_addr learned my addr 172.21.15.115:0/694249073 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:00.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f1479d9b700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f147c14a150 0x7f147c14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147ad9d700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c167110 0x7f147c167570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 -- 172.21.15.115:0/694249073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c167110 msgr2=0x7f147c167570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c167110 0x7f147c167570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 -- 172.21.15.115:0/694249073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f147c14a150 msgr2=0x7f147c14a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f147c14a150 0x7f147c14a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 -- 172.21.15.115:0/694249073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c159770 con 0x7f1464003910 2023-07-27T14:31:00.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.696+0000 7f147a59c700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f147c0c4700 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f14640045b0 tx=0x7f146c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:00.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.697+0000 7f146a7fc700 1 -- 172.21.15.115:0/694249073 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c001370 con 0x7f1464003910 2023-07-27T14:31:00.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.697+0000 7f146a7fc700 1 -- 172.21.15.115:0/694249073 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c0046b0 con 0x7f1464003910 2023-07-27T14:31:00.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.697+0000 7f146a7fc700 1 -- 172.21.15.115:0/694249073 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c004a30 con 0x7f1464003910 2023-07-27T14:31:00.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.697+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c159a50 con 0x7f1464003910 2023-07-27T14:31:00.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.697+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c15a010 con 0x7f1464003910 2023-07-27T14:31:00.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.698+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c06c470 con 0x7f1464003910 2023-07-27T14:31:00.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.699+0000 7f146a7fc700 1 -- 172.21.15.115:0/694249073 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f146c01d070 con 0x7f1464003910 2023-07-27T14:31:00.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.700+0000 7f146a7fc700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f145c05f1c0 0x7f145c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:00.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.700+0000 7f146a7fc700 1 -- 172.21.15.115:0/694249073 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f146c07ad70 con 0x7f1464003910 2023-07-27T14:31:00.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.700+0000 7f1479d9b700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f145c05f1c0 0x7f145c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:00.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.701+0000 7f1479d9b700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f145c05f1c0 0x7f145c061680 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f147c153980 tx=0x7f1470009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:00.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.704+0000 7f146a7fc700 1 -- 172.21.15.115:0/694249073 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f146c04bd20 con 0x7f1464003910 2023-07-27T14:31:00.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.872+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f147c0c1740 con 0x7f1464003910 2023-07-27T14:31:00.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.873+0000 7f146a7fc700 1 -- 172.21.15.115:0/694249073 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v71) v1 ==== 92+0+10 (secure 0 0 0) 0x7f146c01a0a0 con 0x7f1464003910 2023-07-27T14:31:00.904 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:31:00.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f145c05f1c0 msgr2=0x7f145c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f145c05f1c0 0x7f145c061680 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f147c153980 tx=0x7f1470009060).stop 2023-07-27T14:31:00.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 msgr2=0x7f147c0c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:00.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f147c0c4700 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f14640045b0 tx=0x7f146c015000).stop 2023-07-27T14:31:00.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 shutdown_connections 2023-07-27T14:31:00.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f145c05f1c0 0x7f145c061680 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f147c167110 0x7f147c167570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1464003910 0x7f147c0c4700 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 --2- 172.21.15.115:0/694249073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f147c14a150 0x7f147c14a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:00.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 >> 172.21.15.115:0/694249073 conn(0x7f147c05e940 msgr2=0x7f147c152900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:00.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 shutdown_connections 2023-07-27T14:31:00.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:00.875+0000 7f1480fff700 1 -- 172.21.15.115:0/694249073 wait complete. 2023-07-27T14:31:00.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:31:01.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.084+0000 7f26497ff700 1 Processor -- start 2023-07-27T14:31:01.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.085+0000 7f26497ff700 1 -- start start 2023-07-27T14:31:01.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.086+0000 7f26497ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f264414b1e0 0x7f2644154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.086+0000 7f26497ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26441553f0 con 0x7f2644063260 2023-07-27T14:31:01.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.086+0000 7f26497ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2644157a50 con 0x7f264414ae00 2023-07-27T14:31:01.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.086+0000 7f26497ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2644157d10 con 0x7f264414b1e0 2023-07-27T14:31:01.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.086+0000 7f26427fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2644063260 0x7f26440a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37786/0 (socket says 172.21.15.115:37786) 2023-07-27T14:31:01.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.086+0000 7f26427fc700 1 -- 172.21.15.115:0/3323849515 learned_addr learned my addr 172.21.15.115:0/3323849515 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:01.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.086+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236113247 0 0) 0x7f26441553f0 con 0x7f2644063260 2023-07-27T14:31:01.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.086+0000 7f26437fe700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f264414b1e0 0x7f2644154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f262c0033f0 con 0x7f2644063260 2023-07-27T14:31:01.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 715184848 0 0) 0x7f262c0033f0 con 0x7f2644063260 2023-07-27T14:31:01.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f264414b1e0 msgr2=0x7f2644154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:01.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f264414b1e0 0x7f2644154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 >> v1:172.21.15.159:6789/0 conn(0x7f264414ae00 legacy=0x7f2644062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644157ff0 con 0x7f2644063260 2023-07-27T14:31:01.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f2638001470 con 0x7f2644063260 2023-07-27T14:31:01.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 >> v1:172.21.15.115:6789/0 conn(0x7f2644063260 legacy=0x7f26440a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c003910 0x7f262c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262c004690 0x7f262c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f264414b1e0 0x7f262c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2644157d10 con 0x7f262c004690 2023-07-27T14:31:01.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c00b940 con 0x7f262c003910 2023-07-27T14:31:01.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c00bb00 con 0x7f264414b1e0 2023-07-27T14:31:01.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f26427fc700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262c004690 0x7f262c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f26437fe700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f264414b1e0 0x7f262c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.087+0000 7f2642ffd700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c003910 0x7f262c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f26427fc700 1 -- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f264414b1e0 msgr2=0x7f262c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f26427fc700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f264414b1e0 0x7f262c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f26427fc700 1 -- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c003910 msgr2=0x7f262c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f26427fc700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c003910 0x7f262c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f26427fc700 1 -- 172.21.15.115:0/3323849515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0033f0 con 0x7f262c004690 2023-07-27T14:31:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f2642ffd700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c003910 0x7f262c003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:01.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f26427fc700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262c004690 0x7f262c004b10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f2644063660 tx=0x7f264414eb20).ready entity=mon.0 client_cookie=47d01746be111e23 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800ca60 con 0x7f262c004690 2023-07-27T14:31:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800cbc0 con 0x7f262c004690 2023-07-27T14:31:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f2641ffb700 1 -- 172.21.15.115:0/3323849515 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26380070d0 con 0x7f262c004690 2023-07-27T14:31:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.088+0000 7f26497ff700 1 -- 172.21.15.115:0/3323849515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262c004690 msgr2=0x7f262c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.089+0000 7f26497ff700 1 --2- 172.21.15.115:0/3323849515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262c004690 0x7f262c004b10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f2644063660 tx=0x7f264414eb20).stop 2023-07-27T14:31:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.089+0000 7f26437fe700 1 -- 172.21.15.115:0/3323849515 reap_dead start 2023-07-27T14:31:01.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.089+0000 7f26497ff700 1 -- 172.21.15.115:0/3323849515 shutdown_connections 2023-07-27T14:31:01.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.089+0000 7f26497ff700 1 -- 172.21.15.115:0/3323849515 >> 172.21.15.115:0/3323849515 conn(0x7f264405e940 msgr2=0x7f26440cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:01.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.089+0000 7f26497ff700 1 -- 172.21.15.115:0/3323849515 shutdown_connections 2023-07-27T14:31:01.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.089+0000 7f26497ff700 1 -- 172.21.15.115:0/3323849515 wait complete. 2023-07-27T14:31:01.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.090+0000 7f26497ff700 1 Processor -- start 2023-07-27T14:31:01.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.090+0000 7f26497ff700 1 -- start start 2023-07-27T14:31:01.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26497ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c004690 0x7f26441647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26497ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440c1e10 0x7f2644146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26497ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26441544f0 0x7f2644154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26497ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26440afa90 con 0x7f26440c1e10 2023-07-27T14:31:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26497ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26440b08f0 con 0x7f262c004690 2023-07-27T14:31:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26497ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2644154e40 con 0x7f26441544f0 2023-07-27T14:31:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26427fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440c1e10 0x7f2644146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26427fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440c1e10 0x7f2644146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47780/0 (socket says 172.21.15.115:47780) 2023-07-27T14:31:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f26427fc700 1 -- 172.21.15.115:0/3049733176 learned_addr learned my addr 172.21.15.115:0/3049733176 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.091+0000 7f2642ffd700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c004690 0x7f26441647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26437fe700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26441544f0 0x7f2644154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26427fc700 1 -- 172.21.15.115:0/3049733176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26441544f0 msgr2=0x7f2644154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26427fc700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26441544f0 0x7f2644154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26427fc700 1 -- 172.21.15.115:0/3049733176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c004690 msgr2=0x7f26441647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26427fc700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c004690 0x7f26441647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26427fc700 1 -- 172.21.15.115:0/3049733176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644164cc0 con 0x7f26440c1e10 2023-07-27T14:31:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26427fc700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440c1e10 0x7f2644146f80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f2638000fd0 tx=0x7f2638015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f262affd700 1 -- 172.21.15.115:0/3049733176 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638001440 con 0x7f26440c1e10 2023-07-27T14:31:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f262affd700 1 -- 172.21.15.115:0/3049733176 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2638001630 con 0x7f26440c1e10 2023-07-27T14:31:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f262affd700 1 -- 172.21.15.115:0/3049733176 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26380048c0 con 0x7f26440c1e10 2023-07-27T14:31:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2644147470 con 0x7f26440c1e10 2023-07-27T14:31:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.092+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26440affc0 con 0x7f26440c1e10 2023-07-27T14:31:01.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.093+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264406c470 con 0x7f26440c1e10 2023-07-27T14:31:01.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.094+0000 7f262affd700 1 -- 172.21.15.115:0/3049733176 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f2638010070 con 0x7f26440c1e10 2023-07-27T14:31:01.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.095+0000 7f262affd700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f263005f1c0 0x7f2630061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.095+0000 7f262affd700 1 -- 172.21.15.115:0/3049733176 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f263807ace0 con 0x7f26440c1e10 2023-07-27T14:31:01.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.095+0000 7f2642ffd700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f263005f1c0 0x7f2630061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.096+0000 7f2642ffd700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f263005f1c0 0x7f2630061680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f2634007fd0 tx=0x7f2634009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.099+0000 7f262affd700 1 -- 172.21.15.115:0/3049733176 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f263804bda0 con 0x7f26440c1e10 2023-07-27T14:31:01.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.268+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26440b0a30 con 0x7f26440c1e10 2023-07-27T14:31:01.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.269+0000 7f262affd700 1 -- 172.21.15.115:0/3049733176 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f263804f3c0 con 0x7f26440c1e10 2023-07-27T14:31:01.300 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:31:01.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f263005f1c0 msgr2=0x7f2630061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f263005f1c0 0x7f2630061680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f2634007fd0 tx=0x7f2634009040).stop 2023-07-27T14:31:01.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440c1e10 msgr2=0x7f2644146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440c1e10 0x7f2644146f80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f2638000fd0 tx=0x7f2638015000).stop 2023-07-27T14:31:01.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 shutdown_connections 2023-07-27T14:31:01.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f263005f1c0 0x7f2630061680 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26441544f0 0x7f2644154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262c004690 0x7f26441647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 --2- 172.21.15.115:0/3049733176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440c1e10 0x7f2644146f80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 >> 172.21.15.115:0/3049733176 conn(0x7f264405e940 msgr2=0x7f26440ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:01.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 shutdown_connections 2023-07-27T14:31:01.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.271+0000 7f26497ff700 1 -- 172.21.15.115:0/3049733176 wait complete. 2023-07-27T14:31:01.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:31:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.480+0000 7fd46f5ff700 1 Processor -- start 2023-07-27T14:31:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.480+0000 7fd46f5ff700 1 -- start start 2023-07-27T14:31:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.481+0000 7fd46f5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd46813a350 0x7fd468065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.481+0000 7fd46f5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd4680c36b0 0x7fd4681585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.481+0000 7fd46f5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4680bd9a0 con 0x7fd46813a730 2023-07-27T14:31:01.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.481+0000 7fd46f5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd468066400 con 0x7fd4680c36b0 2023-07-27T14:31:01.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.481+0000 7fd46f5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd468158ae0 con 0x7fd46813a350 2023-07-27T14:31:01.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46cb9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd46813a730 0x7fd4680c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37798/0 (socket says 172.21.15.115:37798) 2023-07-27T14:31:01.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46cb9a700 1 -- 172.21.15.115:0/114613537 learned_addr learned my addr 172.21.15.115:0/114613537 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:01.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46db9c700 1 --2- 172.21.15.115:0/114613537 >> v2:172.21.15.115:3300/0 conn(0x7fd4680c36b0 0x7fd4681585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd45ffff700 1 -- 172.21.15.115:0/114613537 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211733832 0 0) 0x7fd4680bd9a0 con 0x7fd46813a730 2023-07-27T14:31:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46d39b700 1 --2- 172.21.15.115:0/114613537 >> v2:172.21.15.159:3300/0 conn(0x7fd46813a350 0x7fd468065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd45ffff700 1 -- 172.21.15.115:0/114613537 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4540033f0 con 0x7fd46813a730 2023-07-27T14:31:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46db9c700 1 -- 172.21.15.115:0/114613537 >> v2:172.21.15.159:3300/0 conn(0x7fd46813a350 msgr2=0x7fd468065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46db9c700 1 --2- 172.21.15.115:0/114613537 >> v2:172.21.15.159:3300/0 conn(0x7fd46813a350 0x7fd468065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46db9c700 1 -- 172.21.15.115:0/114613537 >> v1:172.21.15.115:6789/0 conn(0x7fd46813a730 legacy=0x7fd4680c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46db9c700 1 -- 172.21.15.115:0/114613537 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468066610 con 0x7fd4680c36b0 2023-07-27T14:31:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.482+0000 7fd46d39b700 1 --2- 172.21.15.115:0/114613537 >> v2:172.21.15.159:3300/0 conn(0x7fd46813a350 0x7fd468065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46db9c700 1 --2- 172.21.15.115:0/114613537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680c36b0 0x7fd4681585f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fd468066fd0 tx=0x7fd460009780).ready entity=mon.0 client_cookie=7670a996e35b0c62 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd45ffff700 1 -- 172.21.15.115:0/114613537 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000e070 con 0x7fd4680c36b0 2023-07-27T14:31:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd45ffff700 1 -- 172.21.15.115:0/114613537 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46000bb60 con 0x7fd4680c36b0 2023-07-27T14:31:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd45ffff700 1 -- 172.21.15.115:0/114613537 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460012410 con 0x7fd4680c36b0 2023-07-27T14:31:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46f5ff700 1 -- 172.21.15.115:0/114613537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680c36b0 msgr2=0x7fd4681585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/114613537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680c36b0 0x7fd4681585f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fd468066fd0 tx=0x7fd460009780).stop 2023-07-27T14:31:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46f5ff700 1 -- 172.21.15.115:0/114613537 shutdown_connections 2023-07-27T14:31:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/114613537 >> v2:172.21.15.159:3300/0 conn(0x7fd46813a350 0x7fd468065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/114613537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680c36b0 0x7fd4681585f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46f5ff700 1 -- 172.21.15.115:0/114613537 >> 172.21.15.115:0/114613537 conn(0x7fd46805e8f0 msgr2=0x7fd4680c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46f5ff700 1 -- 172.21.15.115:0/114613537 shutdown_connections 2023-07-27T14:31:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.483+0000 7fd46f5ff700 1 -- 172.21.15.115:0/114613537 wait complete. 2023-07-27T14:31:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.485+0000 7fd46f5ff700 1 Processor -- start 2023-07-27T14:31:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.485+0000 7fd46f5ff700 1 -- start start 2023-07-27T14:31:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46f5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4680c36b0 0x7fd4680a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46f5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd46813a350 0x7fd4680a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46f5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd46813a730 0x7fd4680a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46f5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd468156ef0 con 0x7fd46813a350 2023-07-27T14:31:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46f5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680c6430 con 0x7fd4680c36b0 2023-07-27T14:31:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46f5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680a5220 con 0x7fd46813a730 2023-07-27T14:31:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46cb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd46813a350 0x7fd4680a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46cb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd46813a350 0x7fd4680a4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47810/0 (socket says 172.21.15.115:47810) 2023-07-27T14:31:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46cb9a700 1 -- 172.21.15.115:0/89306809 learned_addr learned my addr 172.21.15.115:0/89306809 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46cb9a700 1 -- 172.21.15.115:0/89306809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd46813a730 msgr2=0x7fd4680a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46cb9a700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd46813a730 0x7fd4680a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46cb9a700 1 -- 172.21.15.115:0/89306809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4680c36b0 msgr2=0x7fd4680a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46cb9a700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4680c36b0 0x7fd4680a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.486+0000 7fd46cb9a700 1 -- 172.21.15.115:0/89306809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460009a20 con 0x7fd46813a350 2023-07-27T14:31:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.487+0000 7fd46cb9a700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd46813a350 0x7fd4680a4d30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fd45800c420 tx=0x7fd458007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.487+0000 7fd45d7fa700 1 -- 172.21.15.115:0/89306809 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580072e0 con 0x7fd46813a350 2023-07-27T14:31:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.487+0000 7fd45d7fa700 1 -- 172.21.15.115:0/89306809 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458007440 con 0x7fd46813a350 2023-07-27T14:31:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.487+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd468156c10 con 0x7fd46813a350 2023-07-27T14:31:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.487+0000 7fd45d7fa700 1 -- 172.21.15.115:0/89306809 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580057a0 con 0x7fd46813a350 2023-07-27T14:31:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.487+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4680c6050 con 0x7fd46813a350 2023-07-27T14:31:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.488+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4680c5bd0 con 0x7fd46813a350 2023-07-27T14:31:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.489+0000 7fd45d7fa700 1 -- 172.21.15.115:0/89306809 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fd45801a060 con 0x7fd46813a350 2023-07-27T14:31:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.490+0000 7fd45d7fa700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd44c05f1c0 0x7fd44c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.490+0000 7fd45d7fa700 1 -- 172.21.15.115:0/89306809 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd4580795f0 con 0x7fd46813a350 2023-07-27T14:31:01.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.490+0000 7fd46d39b700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd44c05f1c0 0x7fd44c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.491+0000 7fd46d39b700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd44c05f1c0 0x7fd44c061680 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd464006fd0 tx=0x7fd464008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.494+0000 7fd45d7fa700 1 -- 172.21.15.115:0/89306809 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4680c5bd0 con 0x7fd46813a350 2023-07-27T14:31:01.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.669+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4680c5bd0 con 0x7fd46813a350 2023-07-27T14:31:01.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.669+0000 7fd45d7fa700 1 -- 172.21.15.115:0/89306809 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4680c5bd0 con 0x7fd46813a350 2023-07-27T14:31:01.701 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:31:01.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd44c05f1c0 msgr2=0x7fd44c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd44c05f1c0 0x7fd44c061680 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd464006fd0 tx=0x7fd464008040).stop 2023-07-27T14:31:01.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd46813a350 msgr2=0x7fd4680a4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd46813a350 0x7fd4680a4d30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fd45800c420 tx=0x7fd458007c80).stop 2023-07-27T14:31:01.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 shutdown_connections 2023-07-27T14:31:01.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd44c05f1c0 0x7fd44c061680 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd46813a730 0x7fd4680a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:01.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4680c36b0 0x7fd4680a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:01.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 --2- 172.21.15.115:0/89306809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd46813a350 0x7fd4680a4d30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 >> 172.21.15.115:0/89306809 conn(0x7fd46805e8f0 msgr2=0x7fd4680ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:01.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 shutdown_connections 2023-07-27T14:31:01.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.671+0000 7fd46f5ff700 1 -- 172.21.15.115:0/89306809 wait complete. 2023-07-27T14:31:01.720 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:31:01.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.882+0000 7f3828bff700 1 Processor -- start 2023-07-27T14:31:01.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.882+0000 7f3828bff700 1 -- start start 2023-07-27T14:31:01.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.883+0000 7f3828bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3824153ec0 0x7f38240a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.883+0000 7f3828bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240aa4d0 con 0x7f38240aa050 2023-07-27T14:31:01.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.883+0000 7f3828bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240c05c0 con 0x7f38240aaa40 2023-07-27T14:31:01.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.883+0000 7f3828bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38240bfc90 con 0x7f3824153ec0 2023-07-27T14:31:01.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.883+0000 7f3821d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f38240aa050 0x7f38240640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37812/0 (socket says 172.21.15.115:37812) 2023-07-27T14:31:01.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.883+0000 7f3821d9b700 1 -- 172.21.15.115:0/1726188318 learned_addr learned my addr 172.21.15.115:0/1726188318 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:01.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382259c700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3824153ec0 0x7f38240a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946438779 0 0) 0x7f3818001110 con 0x7f38240aa050 2023-07-27T14:31:01.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f380c0033f0 con 0x7f38240aa050 2023-07-27T14:31:01.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981463338 0 0) 0x7f380c0033f0 con 0x7f38240aa050 2023-07-27T14:31:01.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3824153ec0 msgr2=0x7f38240a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:01.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3824153ec0 0x7f38240a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 >> v1:172.21.15.159:6789/0 conn(0x7f38240aaa40 legacy=0x7f38240c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240bff70 con 0x7f38240aa050 2023-07-27T14:31:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f3818001600 con 0x7f38240aa050 2023-07-27T14:31:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 >> v1:172.21.15.115:6789/0 conn(0x7f38240aa050 legacy=0x7f38240640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3824153ec0 0x7f380c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f380c003e40 0x7f380c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c004b80 0x7f380c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240bfc90 con 0x7f380c003e40 2023-07-27T14:31:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c00b990 con 0x7f380c004b80 2023-07-27T14:31:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.884+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c00bb50 con 0x7f3824153ec0 2023-07-27T14:31:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f3821d9b700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f380c003e40 0x7f380c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f382259c700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3824153ec0 0x7f380c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f3822d9d700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c004b80 0x7f380c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f3821d9b700 1 -- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3824153ec0 msgr2=0x7f380c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:01.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f3821d9b700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3824153ec0 0x7f380c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f3821d9b700 1 -- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c004b80 msgr2=0x7f380c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f3821d9b700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c004b80 0x7f380c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f3821d9b700 1 -- 172.21.15.115:0/1726188318 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0033f0 con 0x7f380c003e40 2023-07-27T14:31:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f3821d9b700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f380c003e40 0x7f380c004690 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f38240c8200 tx=0x7f38240c0530).ready entity=mon.0 client_cookie=9b6ebab3978e7f03 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818007bc0 con 0x7f380c003e40 2023-07-27T14:31:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800cc00 con 0x7f380c003e40 2023-07-27T14:31:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.885+0000 7f382159a700 1 -- 172.21.15.115:0/1726188318 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180070d0 con 0x7f380c003e40 2023-07-27T14:31:01.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.886+0000 7f3828bff700 1 -- 172.21.15.115:0/1726188318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f380c003e40 msgr2=0x7f380c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.886+0000 7f3828bff700 1 --2- 172.21.15.115:0/1726188318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f380c003e40 0x7f380c004690 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f38240c8200 tx=0x7f38240c0530).stop 2023-07-27T14:31:01.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.886+0000 7f3822d9d700 1 -- 172.21.15.115:0/1726188318 reap_dead start 2023-07-27T14:31:01.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.886+0000 7f3828bff700 1 -- 172.21.15.115:0/1726188318 shutdown_connections 2023-07-27T14:31:01.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.886+0000 7f3828bff700 1 -- 172.21.15.115:0/1726188318 >> 172.21.15.115:0/1726188318 conn(0x7f38240cb610 msgr2=0x7f38240c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:01.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.886+0000 7f3828bff700 1 -- 172.21.15.115:0/1726188318 shutdown_connections 2023-07-27T14:31:01.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.886+0000 7f3828bff700 1 -- 172.21.15.115:0/1726188318 wait complete. 2023-07-27T14:31:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.887+0000 7f3828bff700 1 Processor -- start 2023-07-27T14:31:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.887+0000 7f3828bff700 1 -- start start 2023-07-27T14:31:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.888+0000 7f3828bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c003e40 0x7f38241523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.888+0000 7f3828bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3824150940 0x7f38240acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.888+0000 7f3828bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38240ad050 0x7f382413e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.888+0000 7f3828bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824151f30 con 0x7f3824150940 2023-07-27T14:31:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.888+0000 7f3828bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824151320 con 0x7f380c003e40 2023-07-27T14:31:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.888+0000 7f3828bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3824151600 con 0x7f38240ad050 2023-07-27T14:31:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3824150940 0x7f38240acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3824150940 0x7f38240acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47826/0 (socket says 172.21.15.115:47826) 2023-07-27T14:31:01.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 -- 172.21.15.115:0/3942172991 learned_addr learned my addr 172.21.15.115:0/3942172991 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:01.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f382259c700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c003e40 0x7f38241523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3822d9d700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38240ad050 0x7f382413e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 -- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38240ad050 msgr2=0x7f382413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38240ad050 0x7f382413e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 -- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c003e40 msgr2=0x7f38241523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:01.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c003e40 0x7f38241523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:01.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 -- 172.21.15.115:0/3942172991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38241518e0 con 0x7f3824150940 2023-07-27T14:31:01.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3822d9d700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38240ad050 0x7f382413e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3821d9b700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3824150940 0x7f38240acb60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f38240b0d40 tx=0x7f3818015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f38127fc700 1 -- 172.21.15.115:0/3942172991 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800ce40 con 0x7f3824150940 2023-07-27T14:31:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f38127fc700 1 -- 172.21.15.115:0/3942172991 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38180046b0 con 0x7f3824150940 2023-07-27T14:31:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f38127fc700 1 -- 172.21.15.115:0/3942172991 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818004a50 con 0x7f3824150940 2023-07-27T14:31:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.889+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3824151bc0 con 0x7f3824150940 2023-07-27T14:31:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.890+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3824153020 con 0x7f3824150940 2023-07-27T14:31:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.890+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3824153210 con 0x7f3824150940 2023-07-27T14:31:01.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.891+0000 7f38127fc700 1 -- 172.21.15.115:0/3942172991 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f3818010070 con 0x7f3824150940 2023-07-27T14:31:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.892+0000 7f38127fc700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f380405f1c0 0x7f3804061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.892+0000 7f38127fc700 1 -- 172.21.15.115:0/3942172991 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f381807af10 con 0x7f3824150940 2023-07-27T14:31:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.892+0000 7f382259c700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f380405f1c0 0x7f3804061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.893+0000 7f382259c700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f380405f1c0 0x7f3804061680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f3814006d80 tx=0x7f3814009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:01.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:01.897+0000 7f38127fc700 1 -- 172.21.15.115:0/3942172991 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f381804bee0 con 0x7f3824150940 2023-07-27T14:31:02.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.104+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38240aa4d0 con 0x7f3824150940 2023-07-27T14:31:02.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.104+0000 7f38127fc700 1 -- 172.21.15.115:0/3942172991 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f38240aa4d0 con 0x7f3824150940 2023-07-27T14:31:02.135 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:02.136 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1689103707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1689103707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1689103707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/2448381398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2448381398},{"type":"v1","addr":"172.21.15.159:6834","nonce":2448381398}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3512171796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3512171796},{"type":"v1","addr":"172.21.15.159:6835","nonce":3512171796}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:30:16.247520+0000","modified":"2023-07-27T14:30:19.259578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2262768820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2262768820},{"type":"v1","addr":"172.21.15.115:6836","nonce":2262768820}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-07-27T14:31:02.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f380405f1c0 msgr2=0x7f3804061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f380405f1c0 0x7f3804061680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f3814006d80 tx=0x7f3814009060).stop 2023-07-27T14:31:02.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3824150940 msgr2=0x7f38240acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3824150940 0x7f38240acb60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f38240b0d40 tx=0x7f3818015000).stop 2023-07-27T14:31:02.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 shutdown_connections 2023-07-27T14:31:02.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f380405f1c0 0x7f3804061680 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38240ad050 0x7f382413e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f380c003e40 0x7f38241523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 --2- 172.21.15.115:0/3942172991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3824150940 0x7f38240acb60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 >> 172.21.15.115:0/3942172991 conn(0x7f38240cb610 msgr2=0x7f38240afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:02.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.106+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 shutdown_connections 2023-07-27T14:31:02.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.107+0000 7f3828bff700 1 -- 172.21.15.115:0/3942172991 wait complete. 2023-07-27T14:31:02.139 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 34 2023-07-27T14:31:02.155 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:31:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.312+0000 7fa2267ff700 1 Processor -- start 2023-07-27T14:31:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.312+0000 7fa2267ff700 1 -- start start 2023-07-27T14:31:02.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.313+0000 7fa2267ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2200aaa40 0x7fa2200640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.313+0000 7fa2267ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa2201542a0 0x7fa2200645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.313+0000 7fa2267ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2200aa4d0 con 0x7fa220153ec0 2023-07-27T14:31:02.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.313+0000 7fa2267ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa220064ad0 con 0x7fa2201542a0 2023-07-27T14:31:02.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.313+0000 7fa2267ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200c05c0 con 0x7fa2200aaa40 2023-07-27T14:31:02.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa21f7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2200aaa40 0x7fa2200640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa224d9c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa2201542a0 0x7fa2200645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa21ffff700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fa220153ec0 0x7fa2200a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:55214/0 (socket says 172.21.15.115:55214) 2023-07-27T14:31:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa21ffff700 1 -- 172.21.15.115:0/804782754 learned_addr learned my addr 172.21.15.115:0/804782754 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa21f7fe700 1 -- 172.21.15.115:0/804782754 >> v2:172.21.15.159:3300/0 conn(0x7fa2201542a0 msgr2=0x7fa2200645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa21f7fe700 1 --2- 172.21.15.115:0/804782754 >> v2:172.21.15.159:3300/0 conn(0x7fa2201542a0 0x7fa2200645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa21effd700 1 -- 172.21.15.115:0/804782754 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195899865 0 0) 0x7fa210001110 con 0x7fa220153ec0 2023-07-27T14:31:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa21f7fe700 1 -- 172.21.15.115:0/804782754 >> v1:172.21.15.159:6789/0 conn(0x7fa220153ec0 legacy=0x7fa2200a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa21f7fe700 1 -- 172.21.15.115:0/804782754 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200c1a60 con 0x7fa2200aaa40 2023-07-27T14:31:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.314+0000 7fa224d9c700 1 --2- 172.21.15.115:0/804782754 >> v2:172.21.15.159:3300/0 conn(0x7fa2201542a0 0x7fa2200645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa21f7fe700 1 --2- 172.21.15.115:0/804782754 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2200aaa40 0x7fa2200640f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa214009760 tx=0x7fa214009060).ready entity=mon.2 client_cookie=6a654080914aac9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa21effd700 1 -- 172.21.15.115:0/804782754 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400f510 con 0x7fa2200aaa40 2023-07-27T14:31:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa21effd700 1 -- 172.21.15.115:0/804782754 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21400f670 con 0x7fa2200aaa40 2023-07-27T14:31:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa21effd700 1 -- 172.21.15.115:0/804782754 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400f9f0 con 0x7fa2200aaa40 2023-07-27T14:31:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa2267ff700 1 -- 172.21.15.115:0/804782754 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2200aaa40 msgr2=0x7fa2200640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa2267ff700 1 --2- 172.21.15.115:0/804782754 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2200aaa40 0x7fa2200640f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa214009760 tx=0x7fa214009060).stop 2023-07-27T14:31:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa2267ff700 1 -- 172.21.15.115:0/804782754 shutdown_connections 2023-07-27T14:31:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa2267ff700 1 --2- 172.21.15.115:0/804782754 >> v2:172.21.15.159:3300/0 conn(0x7fa2201542a0 0x7fa2200645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa2267ff700 1 --2- 172.21.15.115:0/804782754 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2200aaa40 0x7fa2200640f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.315+0000 7fa2267ff700 1 -- 172.21.15.115:0/804782754 >> 172.21.15.115:0/804782754 conn(0x7fa2200cb610 msgr2=0x7fa2200c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.316+0000 7fa2267ff700 1 -- 172.21.15.115:0/804782754 shutdown_connections 2023-07-27T14:31:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.316+0000 7fa2267ff700 1 -- 172.21.15.115:0/804782754 wait complete. 2023-07-27T14:31:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.317+0000 7fa2267ff700 1 Processor -- start 2023-07-27T14:31:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.317+0000 7fa2267ff700 1 -- start start 2023-07-27T14:31:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa2267ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2200aaa40 0x7fa22014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa2267ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa220153ec0 0x7fa2200ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa2267ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2201542a0 0x7fa220149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa2267ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22014d6e0 con 0x7fa2200aaa40 2023-07-27T14:31:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa2267ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200b0c40 con 0x7fa2201542a0 2023-07-27T14:31:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa2267ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22014ae10 con 0x7fa220153ec0 2023-07-27T14:31:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa21ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2200aaa40 0x7fa22014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa21ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2200aaa40 0x7fa22014d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47840/0 (socket says 172.21.15.115:47840) 2023-07-27T14:31:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa21ffff700 1 -- 172.21.15.115:0/1287511440 learned_addr learned my addr 172.21.15.115:0/1287511440 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.318+0000 7fa21f7fe700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa220153ec0 0x7fa2200ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa224d9c700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2201542a0 0x7fa220149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa21ffff700 1 -- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa220153ec0 msgr2=0x7fa2200ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa21ffff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa220153ec0 0x7fa2200ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa21ffff700 1 -- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2201542a0 msgr2=0x7fa220149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa21ffff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2201542a0 0x7fa220149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa21ffff700 1 -- 172.21.15.115:0/1287511440 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009a20 con 0x7fa2200aaa40 2023-07-27T14:31:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa224d9c700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2201542a0 0x7fa220149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa21ffff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2200aaa40 0x7fa22014d100 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fa21000c510 tx=0x7fa210007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa207fff700 1 -- 172.21.15.115:0/1287511440 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100072e0 con 0x7fa2200aaa40 2023-07-27T14:31:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa207fff700 1 -- 172.21.15.115:0/1287511440 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210007440 con 0x7fa2200aaa40 2023-07-27T14:31:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2140092a0 con 0x7fa2200aaa40 2023-07-27T14:31:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa207fff700 1 -- 172.21.15.115:0/1287511440 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100057a0 con 0x7fa2200aaa40 2023-07-27T14:31:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.319+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22014a560 con 0x7fa2200aaa40 2023-07-27T14:31:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.320+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22006c470 con 0x7fa2200aaa40 2023-07-27T14:31:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.321+0000 7fa207fff700 1 -- 172.21.15.115:0/1287511440 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fa21001a060 con 0x7fa2200aaa40 2023-07-27T14:31:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.322+0000 7fa207fff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa20c05f1c0 0x7fa20c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.322+0000 7fa207fff700 1 -- 172.21.15.115:0/1287511440 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fa2100797d0 con 0x7fa2200aaa40 2023-07-27T14:31:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.322+0000 7fa21f7fe700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa20c05f1c0 0x7fa20c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.323+0000 7fa21f7fe700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa20c05f1c0 0x7fa20c061680 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fa2200aae20 tx=0x7fa214017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:02.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.326+0000 7fa207fff700 1 -- 172.21.15.115:0/1287511440 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa21004a8b0 con 0x7fa2200aaa40 2023-07-27T14:31:02.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.497+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2200aa4d0 con 0x7fa2200aaa40 2023-07-27T14:31:02.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.498+0000 7fa207fff700 1 -- 172.21.15.115:0/1287511440 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+17331 (secure 0 0 0) 0x7fa2200aa4d0 con 0x7fa2200aaa40 2023-07-27T14:31:02.529 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:02.529 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":72,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:31:01.584543+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:30:14.561612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-27T14:30:15.229143+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":10,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:31:02.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa20c05f1c0 msgr2=0x7fa20c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa20c05f1c0 0x7fa20c061680 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fa2200aae20 tx=0x7fa214017000).stop 2023-07-27T14:31:02.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2200aaa40 msgr2=0x7fa22014d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2200aaa40 0x7fa22014d100 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fa21000c510 tx=0x7fa210007ad0).stop 2023-07-27T14:31:02.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 shutdown_connections 2023-07-27T14:31:02.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa20c05f1c0 0x7fa20c061680 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2201542a0 0x7fa220149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2200aaa40 0x7fa22014d100 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 --2- 172.21.15.115:0/1287511440 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa220153ec0 0x7fa2200ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 >> 172.21.15.115:0/1287511440 conn(0x7fa2200cb610 msgr2=0x7fa220153220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:02.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 shutdown_connections 2023-07-27T14:31:02.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.500+0000 7fa2267ff700 1 -- 172.21.15.115:0/1287511440 wait complete. 2023-07-27T14:31:02.549 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:31:02.549 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:31:02.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.705+0000 7f96f57ff700 1 Processor -- start 2023-07-27T14:31:02.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.706+0000 7f96f57ff700 1 -- start start 2023-07-27T14:31:02.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96f57ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f96f0065ff0 0x7f96f0066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96f57ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 0x7f96f0067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96f57ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f0067080 con 0x7f96f0151d70 2023-07-27T14:31:02.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96f57ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f0063a90 con 0x7f96f0065ff0 2023-07-27T14:31:02.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96f57ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0066df0 con 0x7f96f0066960 2023-07-27T14:31:02.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96ee7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f96f0065ff0 0x7f96f0066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96ee7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f96f0065ff0 0x7f96f0066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47842/0 (socket says 172.21.15.115:47842) 2023-07-27T14:31:02.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96ee7fc700 1 -- 172.21.15.115:0/411605776 learned_addr learned my addr 172.21.15.115:0/411605776 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:02.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.707+0000 7f96ef7fe700 1 --2- 172.21.15.115:0/411605776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 0x7f96f0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.708+0000 7f96ee7fc700 1 -- 172.21.15.115:0/411605776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 msgr2=0x7f96f0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:02.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.708+0000 7f96ee7fc700 1 --2- 172.21.15.115:0/411605776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 0x7f96f0067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.708+0000 7f96ee7fc700 1 -- 172.21.15.115:0/411605776 >> v1:172.21.15.159:6789/0 conn(0x7f96f0151d70 legacy=0x7f96f0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.708+0000 7f96ee7fc700 1 -- 172.21.15.115:0/411605776 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f00634d0 con 0x7f96f0065ff0 2023-07-27T14:31:02.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.708+0000 7f96ee7fc700 1 --2- 172.21.15.115:0/411605776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0065ff0 0x7f96f0066470 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f96e4006fd0 tx=0x7f96e40090f0).ready entity=mon.0 client_cookie=d9a1d14eb6e55d90 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:02.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.708+0000 7f96edffb700 1 -- 172.21.15.115:0/411605776 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400b600 con 0x7f96f0065ff0 2023-07-27T14:31:02.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.708+0000 7f96edffb700 1 -- 172.21.15.115:0/411605776 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400b760 con 0x7f96f0065ff0 2023-07-27T14:31:02.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.708+0000 7f96edffb700 1 -- 172.21.15.115:0/411605776 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400bae0 con 0x7f96f0065ff0 2023-07-27T14:31:02.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.709+0000 7f96f57ff700 1 -- 172.21.15.115:0/411605776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0065ff0 msgr2=0x7f96f0066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.709+0000 7f96f57ff700 1 --2- 172.21.15.115:0/411605776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0065ff0 0x7f96f0066470 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f96e4006fd0 tx=0x7f96e40090f0).stop 2023-07-27T14:31:02.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.709+0000 7f96f57ff700 1 -- 172.21.15.115:0/411605776 shutdown_connections 2023-07-27T14:31:02.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.709+0000 7f96f57ff700 1 --2- 172.21.15.115:0/411605776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 0x7f96f0067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.709+0000 7f96f57ff700 1 --2- 172.21.15.115:0/411605776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0065ff0 0x7f96f0066470 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.709+0000 7f96f57ff700 1 -- 172.21.15.115:0/411605776 >> 172.21.15.115:0/411605776 conn(0x7f96f00c89a0 msgr2=0x7f96f00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:02.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.709+0000 7f96f57ff700 1 -- 172.21.15.115:0/411605776 shutdown_connections 2023-07-27T14:31:02.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.709+0000 7f96f57ff700 1 -- 172.21.15.115:0/411605776 wait complete. 2023-07-27T14:31:02.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.710+0000 7f96f57ff700 1 Processor -- start 2023-07-27T14:31:02.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.710+0000 7f96f57ff700 1 -- start start 2023-07-27T14:31:02.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.711+0000 7f96f57ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96f0065ff0 0x7f96f00c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.711+0000 7f96f57ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 0x7f96f00c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.711+0000 7f96f57ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0151d70 0x7f96f00c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.711+0000 7f96f57ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00c8330 con 0x7f96f0151d70 2023-07-27T14:31:02.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.711+0000 7f96f57ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01507c0 con 0x7f96f0065ff0 2023-07-27T14:31:02.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.711+0000 7f96f57ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0150aa0 con 0x7f96f0066960 2023-07-27T14:31:02.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.711+0000 7f96ef7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0151d70 0x7f96f00c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ef7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0151d70 0x7f96f00c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47854/0 (socket says 172.21.15.115:47854) 2023-07-27T14:31:02.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ef7fe700 1 -- 172.21.15.115:0/459110679 learned_addr learned my addr 172.21.15.115:0/459110679 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:02.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96eeffd700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96f0065ff0 0x7f96f00c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ee7fc700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 0x7f96f00c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ef7fe700 1 -- 172.21.15.115:0/459110679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 msgr2=0x7f96f00c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ef7fe700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 0x7f96f00c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ef7fe700 1 -- 172.21.15.115:0/459110679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96f0065ff0 msgr2=0x7f96f00c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ef7fe700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96f0065ff0 0x7f96f00c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ef7fe700 1 -- 172.21.15.115:0/459110679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4009370 con 0x7f96f0151d70 2023-07-27T14:31:02.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96ef7fe700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0151d70 0x7f96f00c7e40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f96e8009fa0 tx=0x7f96e8009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:02.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96d6ffd700 1 -- 172.21.15.115:0/459110679 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800ebc0 con 0x7f96f0151d70 2023-07-27T14:31:02.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96d6ffd700 1 -- 172.21.15.115:0/459110679 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800ed20 con 0x7f96f0151d70 2023-07-27T14:31:02.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96d6ffd700 1 -- 172.21.15.115:0/459110679 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8014610 con 0x7f96f0151d70 2023-07-27T14:31:02.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.712+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f0150d80 con 0x7f96f0151d70 2023-07-27T14:31:02.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.713+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f01513c0 con 0x7f96f0151d70 2023-07-27T14:31:02.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.714+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f006c470 con 0x7f96f0151d70 2023-07-27T14:31:02.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.715+0000 7f96d6ffd700 1 -- 172.21.15.115:0/459110679 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f96e801b030 con 0x7f96f0151d70 2023-07-27T14:31:02.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.715+0000 7f96d6ffd700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f96dc05f1c0 0x7f96dc061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:02.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.716+0000 7f96d6ffd700 1 -- 172.21.15.115:0/459110679 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f96e807a650 con 0x7f96f0151d70 2023-07-27T14:31:02.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.716+0000 7f96eeffd700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f96dc05f1c0 0x7f96dc061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:02.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.716+0000 7f96eeffd700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f96dc05f1c0 0x7f96dc061680 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f96e0000c00 tx=0x7f96e0007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:02.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.720+0000 7f96d6ffd700 1 -- 172.21.15.115:0/459110679 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96e804b5c0 con 0x7f96f0151d70 2023-07-27T14:31:02.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.931+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96f0068720 con 0x7f96f0151d70 2023-07-27T14:31:02.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.931+0000 7f96d6ffd700 1 -- 172.21.15.115:0/459110679 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f96e804ebe0 con 0x7f96f0151d70 2023-07-27T14:31:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:02.963 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1689103707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1689103707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1689103707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/2448381398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2448381398},{"type":"v1","addr":"172.21.15.159:6834","nonce":2448381398}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3512171796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3512171796},{"type":"v1","addr":"172.21.15.159:6835","nonce":3512171796}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:30:16.247520+0000","modified":"2023-07-27T14:30:19.259578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2262768820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2262768820},{"type":"v1","addr":"172.21.15.115:6836","nonce":2262768820}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-07-27T14:31:02.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f96dc05f1c0 msgr2=0x7f96dc061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f96dc05f1c0 0x7f96dc061680 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f96e0000c00 tx=0x7f96e0007d20).stop 2023-07-27T14:31:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0151d70 msgr2=0x7f96f00c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0151d70 0x7f96f00c7e40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f96e8009fa0 tx=0x7f96e8009900).stop 2023-07-27T14:31:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 shutdown_connections 2023-07-27T14:31:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f96dc05f1c0 0x7f96dc061680 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96f0151d70 0x7f96f00c7e40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96f0065ff0 0x7f96f00c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 --2- 172.21.15.115:0/459110679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96f0066960 0x7f96f00c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 >> 172.21.15.115:0/459110679 conn(0x7f96f00c89a0 msgr2=0x7f96f0154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 shutdown_connections 2023-07-27T14:31:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:02.933+0000 7f96f57ff700 1 -- 172.21.15.115:0/459110679 wait complete. 2023-07-27T14:31:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 34 2023-07-27T14:31:02.982 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:31:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.138+0000 7f24389ff700 1 Processor -- start 2023-07-27T14:31:03.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.138+0000 7f24389ff700 1 -- start start 2023-07-27T14:31:03.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.139+0000 7f24389ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2434151d70 0x7f2434155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.139+0000 7f24389ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434065ff0 0x7f2434066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.139+0000 7f24389ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2434067080 con 0x7f2434066960 2023-07-27T14:31:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.139+0000 7f24389ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2434063a90 con 0x7f2434151d70 2023-07-27T14:31:03.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.139+0000 7f24389ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2434068570 con 0x7f2434065ff0 2023-07-27T14:31:03.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f2431d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434065ff0 0x7f2434066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f2432d9d700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f2434066960 0x7f2434157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:55240/0 (socket says 172.21.15.115:55240) 2023-07-27T14:31:03.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f2432d9d700 1 -- 172.21.15.115:0/2364202966 learned_addr learned my addr 172.21.15.115:0/2364202966 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:03.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f243259c700 1 --2- 172.21.15.115:0/2364202966 >> v2:172.21.15.159:3300/0 conn(0x7f2434151d70 0x7f2434155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f243159a700 1 -- 172.21.15.115:0/2364202966 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467090406 0 0) 0x7f2434067080 con 0x7f2434066960 2023-07-27T14:31:03.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f243159a700 1 -- 172.21.15.115:0/2364202966 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f241c0033f0 con 0x7f2434066960 2023-07-27T14:31:03.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f2431d9b700 1 -- 172.21.15.115:0/2364202966 >> v2:172.21.15.159:3300/0 conn(0x7f2434151d70 msgr2=0x7f2434155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:03.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f2431d9b700 1 --2- 172.21.15.115:0/2364202966 >> v2:172.21.15.159:3300/0 conn(0x7f2434151d70 0x7f2434155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f2431d9b700 1 -- 172.21.15.115:0/2364202966 >> v1:172.21.15.159:6789/0 conn(0x7f2434066960 legacy=0x7f2434157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.140+0000 7f2431d9b700 1 -- 172.21.15.115:0/2364202966 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434066df0 con 0x7f2434065ff0 2023-07-27T14:31:03.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f2431d9b700 1 --2- 172.21.15.115:0/2364202966 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434065ff0 0x7f2434066470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2428009760 tx=0x7f2428009060).ready entity=mon.2 client_cookie=c5102a913c77db8a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:03.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f243159a700 1 -- 172.21.15.115:0/2364202966 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800d4a0 con 0x7f2434065ff0 2023-07-27T14:31:03.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f243159a700 1 -- 172.21.15.115:0/2364202966 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242800d600 con 0x7f2434065ff0 2023-07-27T14:31:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f243159a700 1 -- 172.21.15.115:0/2364202966 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800d980 con 0x7f2434065ff0 2023-07-27T14:31:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f24389ff700 1 -- 172.21.15.115:0/2364202966 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434065ff0 msgr2=0x7f2434066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f24389ff700 1 --2- 172.21.15.115:0/2364202966 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434065ff0 0x7f2434066470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2428009760 tx=0x7f2428009060).stop 2023-07-27T14:31:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f24389ff700 1 -- 172.21.15.115:0/2364202966 shutdown_connections 2023-07-27T14:31:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f24389ff700 1 --2- 172.21.15.115:0/2364202966 >> v2:172.21.15.159:3300/0 conn(0x7f2434151d70 0x7f2434155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f24389ff700 1 --2- 172.21.15.115:0/2364202966 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434065ff0 0x7f2434066470 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.141+0000 7f24389ff700 1 -- 172.21.15.115:0/2364202966 >> 172.21.15.115:0/2364202966 conn(0x7f24340c89a0 msgr2=0x7f24340c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.142+0000 7f24389ff700 1 -- 172.21.15.115:0/2364202966 shutdown_connections 2023-07-27T14:31:03.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.142+0000 7f24389ff700 1 -- 172.21.15.115:0/2364202966 wait complete. 2023-07-27T14:31:03.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.143+0000 7f24389ff700 1 Processor -- start 2023-07-27T14:31:03.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.143+0000 7f24389ff700 1 -- start start 2023-07-27T14:31:03.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.144+0000 7f24389ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2434065ff0 0x7f2434167000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.144+0000 7f24389ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434066960 0x7f24340c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.144+0000 7f24389ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434151d70 0x7f24340c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.144+0000 7f24389ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340c7610 con 0x7f2434151d70 2023-07-27T14:31:03.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.144+0000 7f24389ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340a9d60 con 0x7f2434065ff0 2023-07-27T14:31:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.144+0000 7f24389ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24341674f0 con 0x7f2434066960 2023-07-27T14:31:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434151d70 0x7f24340c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434151d70 0x7f24340c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47862/0 (socket says 172.21.15.115:47862) 2023-07-27T14:31:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 -- 172.21.15.115:0/3973198495 learned_addr learned my addr 172.21.15.115:0/3973198495 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2431d9b700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434066960 0x7f24340c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f243259c700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2434065ff0 0x7f2434167000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 -- 172.21.15.115:0/3973198495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434066960 msgr2=0x7f24340c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434066960 0x7f24340c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 -- 172.21.15.115:0/3973198495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2434065ff0 msgr2=0x7f2434167000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2434065ff0 0x7f2434167000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 -- 172.21.15.115:0/3973198495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280092a0 con 0x7f2434151d70 2023-07-27T14:31:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f2432d9d700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434151d70 0x7f24340c7120 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f242c005ad0 tx=0x7f242c001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f24227fc700 1 -- 172.21.15.115:0/3973198495 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c005d30 con 0x7f2434151d70 2023-07-27T14:31:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f24227fc700 1 -- 172.21.15.115:0/3973198495 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c005e90 con 0x7f2434151d70 2023-07-27T14:31:03.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24340a8f50 con 0x7f2434151d70 2023-07-27T14:31:03.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.145+0000 7f24227fc700 1 -- 172.21.15.115:0/3973198495 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c007320 con 0x7f2434151d70 2023-07-27T14:31:03.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.146+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24340a99f0 con 0x7f2434151d70 2023-07-27T14:31:03.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.146+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24340a9570 con 0x7f2434151d70 2023-07-27T14:31:03.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.147+0000 7f24227fc700 1 -- 172.21.15.115:0/3973198495 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f242c010030 con 0x7f2434151d70 2023-07-27T14:31:03.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.148+0000 7f24227fc700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241405f1c0 0x7f2414061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.149+0000 7f24227fc700 1 -- 172.21.15.115:0/3973198495 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f242c07a120 con 0x7f2434151d70 2023-07-27T14:31:03.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.149+0000 7f243259c700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241405f1c0 0x7f2414061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.149+0000 7f243259c700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241405f1c0 0x7f2414061680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f2424009c30 tx=0x7f2424009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:03.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.152+0000 7f24227fc700 1 -- 172.21.15.115:0/3973198495 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f24340a9570 con 0x7f2434151d70 2023-07-27T14:31:03.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.362+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24340a9570 con 0x7f2434151d70 2023-07-27T14:31:03.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.363+0000 7f24227fc700 1 -- 172.21.15.115:0/3973198495 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f24340a9570 con 0x7f2434151d70 2023-07-27T14:31:03.394 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:03.394 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1689103707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1689103707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1689103707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/2448381398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2448381398},{"type":"v1","addr":"172.21.15.159:6834","nonce":2448381398}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3512171796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3512171796},{"type":"v1","addr":"172.21.15.159:6835","nonce":3512171796}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:30:16.247520+0000","modified":"2023-07-27T14:30:19.259578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2262768820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2262768820},{"type":"v1","addr":"172.21.15.115:6836","nonce":2262768820}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-07-27T14:31:03.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241405f1c0 msgr2=0x7f2414061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241405f1c0 0x7f2414061680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f2424009c30 tx=0x7f2424009060).stop 2023-07-27T14:31:03.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434151d70 msgr2=0x7f24340c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434151d70 0x7f24340c7120 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f242c005ad0 tx=0x7f242c001650).stop 2023-07-27T14:31:03.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 shutdown_connections 2023-07-27T14:31:03.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f241405f1c0 0x7f2414061680 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2434151d70 0x7f24340c7120 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2434065ff0 0x7f2434167000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 --2- 172.21.15.115:0/3973198495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2434066960 0x7f24340c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 >> 172.21.15.115:0/3973198495 conn(0x7f24340c89a0 msgr2=0x7f24340bf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:03.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 shutdown_connections 2023-07-27T14:31:03.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.365+0000 7f24389ff700 1 -- 172.21.15.115:0/3973198495 wait complete. 2023-07-27T14:31:03.398 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 34 2023-07-27T14:31:03.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:31:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.575+0000 7f943a1ff700 1 Processor -- start 2023-07-27T14:31:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.575+0000 7f943a1ff700 1 -- start start 2023-07-27T14:31:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f943a1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94340aaa40 0x7f94340640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f943a1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94341542a0 0x7f94340645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f943a1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94340aa4d0 con 0x7f9434153ec0 2023-07-27T14:31:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f943a1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9434064ad0 con 0x7f94340aaa40 2023-07-27T14:31:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f943a1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94340c05c0 con 0x7f94341542a0 2023-07-27T14:31:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9432ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94340aaa40 0x7f94340640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9432ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94340aaa40 0x7f94340640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51262/0 (socket says 172.21.15.115:51262) 2023-07-27T14:31:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9432ffd700 1 -- 172.21.15.115:0/3977699877 learned_addr learned my addr 172.21.15.115:0/3977699877 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9433fff700 1 --2- 172.21.15.115:0/3977699877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94341542a0 0x7f94340645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9432ffd700 1 -- 172.21.15.115:0/3977699877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94341542a0 msgr2=0x7f94340645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:03.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9432ffd700 1 --2- 172.21.15.115:0/3977699877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94341542a0 0x7f94340645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9432ffd700 1 -- 172.21.15.115:0/3977699877 >> v1:172.21.15.159:6789/0 conn(0x7f9434153ec0 legacy=0x7f94340a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9432ffd700 1 -- 172.21.15.115:0/3977699877 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94340c1a60 con 0x7f94340aaa40 2023-07-27T14:31:03.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9433fff700 1 --2- 172.21.15.115:0/3977699877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94341542a0 0x7f94340645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:03.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.577+0000 7f9432ffd700 1 --2- 172.21.15.115:0/3977699877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94340aaa40 0x7f94340640f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f9428006fd0 tx=0x7f94280090f0).ready entity=mon.0 client_cookie=7f953d723f9725b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:03.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f94327fc700 1 -- 172.21.15.115:0/3977699877 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800b600 con 0x7f94340aaa40 2023-07-27T14:31:03.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f94327fc700 1 -- 172.21.15.115:0/3977699877 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942800b760 con 0x7f94340aaa40 2023-07-27T14:31:03.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f94327fc700 1 -- 172.21.15.115:0/3977699877 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800bae0 con 0x7f94340aaa40 2023-07-27T14:31:03.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f943a1ff700 1 -- 172.21.15.115:0/3977699877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94340aaa40 msgr2=0x7f94340640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f943a1ff700 1 --2- 172.21.15.115:0/3977699877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94340aaa40 0x7f94340640f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f9428006fd0 tx=0x7f94280090f0).stop 2023-07-27T14:31:03.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f943a1ff700 1 -- 172.21.15.115:0/3977699877 shutdown_connections 2023-07-27T14:31:03.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f943a1ff700 1 --2- 172.21.15.115:0/3977699877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f94341542a0 0x7f94340645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f943a1ff700 1 --2- 172.21.15.115:0/3977699877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94340aaa40 0x7f94340640f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f943a1ff700 1 -- 172.21.15.115:0/3977699877 >> 172.21.15.115:0/3977699877 conn(0x7f94340cb610 msgr2=0x7f94340c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:03.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f943a1ff700 1 -- 172.21.15.115:0/3977699877 shutdown_connections 2023-07-27T14:31:03.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.578+0000 7f943a1ff700 1 -- 172.21.15.115:0/3977699877 wait complete. 2023-07-27T14:31:03.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.580+0000 7f943a1ff700 1 Processor -- start 2023-07-27T14:31:03.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.580+0000 7f943a1ff700 1 -- start start 2023-07-27T14:31:03.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f943a1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340aaa40 0x7f94340af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f943a1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9434153ec0 0x7f943414f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f943a1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94341542a0 0x7f9434155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f943a1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94340af430 con 0x7f94341542a0 2023-07-27T14:31:03.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f943a1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94340c4520 con 0x7f94340aaa40 2023-07-27T14:31:03.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f943a1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94340ae860 con 0x7f9434153ec0 2023-07-27T14:31:03.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f9433fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94341542a0 0x7f9434155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f94337fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340aaa40 0x7f94340af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f9433fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94341542a0 0x7f9434155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51264/0 (socket says 172.21.15.115:51264) 2023-07-27T14:31:03.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f9433fff700 1 -- 172.21.15.115:0/4008260587 learned_addr learned my addr 172.21.15.115:0/4008260587 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:03.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.581+0000 7f9432ffd700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9434153ec0 0x7f943414f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f9433fff700 1 -- 172.21.15.115:0/4008260587 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9434153ec0 msgr2=0x7f943414f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f9433fff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9434153ec0 0x7f943414f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f9433fff700 1 -- 172.21.15.115:0/4008260587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340aaa40 msgr2=0x7f94340af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f9433fff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340aaa40 0x7f94340af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f9433fff700 1 -- 172.21.15.115:0/4008260587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9428009370 con 0x7f94341542a0 2023-07-27T14:31:03.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f9433fff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94341542a0 0x7f9434155ca0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f942c009f70 tx=0x7f942c0099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:03.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f941b7fe700 1 -- 172.21.15.115:0/4008260587 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00db80 con 0x7f94341542a0 2023-07-27T14:31:03.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f941b7fe700 1 -- 172.21.15.115:0/4008260587 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c00f040 con 0x7f94341542a0 2023-07-27T14:31:03.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f941b7fe700 1 -- 172.21.15.115:0/4008260587 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0133f0 con 0x7f94341542a0 2023-07-27T14:31:03.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943414f500 con 0x7f94341542a0 2023-07-27T14:31:03.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.582+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94340aede0 con 0x7f94341542a0 2023-07-27T14:31:03.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.583+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943406c470 con 0x7f94341542a0 2023-07-27T14:31:03.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.584+0000 7f941b7fe700 1 -- 172.21.15.115:0/4008260587 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f942c0137e0 con 0x7f94341542a0 2023-07-27T14:31:03.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.585+0000 7f941b7fe700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f942005f1c0 0x7f9420061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:03.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.585+0000 7f941b7fe700 1 -- 172.21.15.115:0/4008260587 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f942c07a790 con 0x7f94341542a0 2023-07-27T14:31:03.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.585+0000 7f94337fe700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f942005f1c0 0x7f9420061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:03.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.585+0000 7f94337fe700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f942005f1c0 0x7f9420061680 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f9424003870 tx=0x7f9424007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:03.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.589+0000 7f941b7fe700 1 -- 172.21.15.115:0/4008260587 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f942c04b810 con 0x7f94341542a0 2023-07-27T14:31:03.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.761+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94340c8230 con 0x7f94341542a0 2023-07-27T14:31:03.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.762+0000 7f941b7fe700 1 -- 172.21.15.115:0/4008260587 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+17331 (secure 0 0 0) 0x7f942c04ee30 con 0x7f94341542a0 2023-07-27T14:31:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:03.794 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":72,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:31:01.584543+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:30:14.561612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-27T14:30:15.229143+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.c","mappings":[{"from":7,"to":3}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":10,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:31:03.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.764+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f942005f1c0 msgr2=0x7f9420061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.764+0000 7f943a1ff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f942005f1c0 0x7f9420061680 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f9424003870 tx=0x7f9424007d40).stop 2023-07-27T14:31:03.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94341542a0 msgr2=0x7f9434155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:03.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94341542a0 0x7f9434155ca0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f942c009f70 tx=0x7f942c0099b0).stop 2023-07-27T14:31:03.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 shutdown_connections 2023-07-27T14:31:03.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f942005f1c0 0x7f9420061680 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94341542a0 0x7f9434155ca0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94340aaa40 0x7f94340af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 --2- 172.21.15.115:0/4008260587 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9434153ec0 0x7f943414f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:03.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 >> 172.21.15.115:0/4008260587 conn(0x7f94340cb610 msgr2=0x7f94340ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:03.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 shutdown_connections 2023-07-27T14:31:03.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.765+0000 7f943a1ff700 1 -- 172.21.15.115:0/4008260587 wait complete. 2023-07-27T14:31:03.814 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:31:04.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.973+0000 7fa2dcdff700 1 Processor -- start 2023-07-27T14:31:04.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.974+0000 7fa2dcdff700 1 -- start start 2023-07-27T14:31:04.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.975+0000 7fa2dcdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa2d8150af0 0x7fa2d8150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.975+0000 7fa2dcdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2d80c0e80 0x7fa2d80c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.975+0000 7fa2dcdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d806a440 con 0x7fa2d80696f0 2023-07-27T14:31:04.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.975+0000 7fa2dcdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d80bbc80 con 0x7fa2d80c0e80 2023-07-27T14:31:04.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.975+0000 7fa2dcdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d8069e80 con 0x7fa2d8150af0 2023-07-27T14:31:04.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.975+0000 7fa2d5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2d80c0e80 0x7fa2d80c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.975+0000 7fa2d6d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa2d80696f0 0x7fa2d80a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43552/0 (socket says 172.21.15.115:43552) 2023-07-27T14:31:04.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.975+0000 7fa2d6d9d700 1 -- 172.21.15.115:0/50382598 learned_addr learned my addr 172.21.15.115:0/50382598 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:04.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d659c700 1 --2- 172.21.15.115:0/50382598 >> v2:172.21.15.159:3300/0 conn(0x7fa2d8150af0 0x7fa2d8150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d5d9b700 1 -- 172.21.15.115:0/50382598 >> v2:172.21.15.159:3300/0 conn(0x7fa2d8150af0 msgr2=0x7fa2d8150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:04.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d5d9b700 1 --2- 172.21.15.115:0/50382598 >> v2:172.21.15.159:3300/0 conn(0x7fa2d8150af0 0x7fa2d8150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d5d9b700 1 -- 172.21.15.115:0/50382598 >> v1:172.21.15.115:6789/0 conn(0x7fa2d80696f0 legacy=0x7fa2d80a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d5d9b700 1 -- 172.21.15.115:0/50382598 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d806a160 con 0x7fa2d80c0e80 2023-07-27T14:31:04.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d559a700 1 -- 172.21.15.115:0/50382598 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974867722 0 0) 0x7fa2d806a440 con 0x7fa2d80696f0 2023-07-27T14:31:04.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d5d9b700 1 --2- 172.21.15.115:0/50382598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d80c3960 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fa2d80a95d0 tx=0x7fa2cc00b300).ready entity=mon.0 client_cookie=dfd9d0dd2adb2ea2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:04.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d559a700 1 -- 172.21.15.115:0/50382598 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00da70 con 0x7fa2d80c0e80 2023-07-27T14:31:04.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d559a700 1 -- 172.21.15.115:0/50382598 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc00dbd0 con 0x7fa2d80c0e80 2023-07-27T14:31:04.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.976+0000 7fa2d559a700 1 -- 172.21.15.115:0/50382598 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc010470 con 0x7fa2d80c0e80 2023-07-27T14:31:04.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.977+0000 7fa2dcdff700 1 -- 172.21.15.115:0/50382598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 msgr2=0x7fa2d80c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.977+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/50382598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d80c3960 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fa2d80a95d0 tx=0x7fa2cc00b300).stop 2023-07-27T14:31:04.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.977+0000 7fa2dcdff700 1 -- 172.21.15.115:0/50382598 shutdown_connections 2023-07-27T14:31:04.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.977+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/50382598 >> v2:172.21.15.159:3300/0 conn(0x7fa2d8150af0 0x7fa2d8150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.977+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/50382598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d80c3960 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.977+0000 7fa2dcdff700 1 -- 172.21.15.115:0/50382598 >> 172.21.15.115:0/50382598 conn(0x7fa2d8062320 msgr2=0x7fa2d8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.977+0000 7fa2dcdff700 1 -- 172.21.15.115:0/50382598 shutdown_connections 2023-07-27T14:31:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.977+0000 7fa2dcdff700 1 -- 172.21.15.115:0/50382598 wait complete. 2023-07-27T14:31:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.978+0000 7fa2dcdff700 1 Processor -- start 2023-07-27T14:31:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.978+0000 7fa2dcdff700 1 -- start start 2023-07-27T14:31:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.979+0000 7fa2dcdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2d80696f0 0x7fa2d8146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.979+0000 7fa2dcdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d8146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.979+0000 7fa2dcdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d8150af0 0x7fa2d8151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.979+0000 7fa2dcdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8148380 con 0x7fa2d80c0e80 2023-07-27T14:31:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.979+0000 7fa2dcdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8147800 con 0x7fa2d8150af0 2023-07-27T14:31:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.979+0000 7fa2dcdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8147ae0 con 0x7fa2d80696f0 2023-07-27T14:31:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d8146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d8146fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51282/0 (socket says 172.21.15.115:51282) 2023-07-27T14:31:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 -- 172.21.15.115:0/3090674617 learned_addr learned my addr 172.21.15.115:0/3090674617 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d6d9d700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d8150af0 0x7fa2d8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d659c700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2d80696f0 0x7fa2d8146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 -- 172.21.15.115:0/3090674617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2d80696f0 msgr2=0x7fa2d8146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2d80696f0 0x7fa2d8146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 -- 172.21.15.115:0/3090674617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d8150af0 msgr2=0x7fa2d8151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d8150af0 0x7fa2d8151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 -- 172.21.15.115:0/3090674617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc00b540 con 0x7fa2d80c0e80 2023-07-27T14:31:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2d5d9b700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d8146fa0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fa2cc00b340 tx=0x7fa2d80bbdc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2c67fc700 1 -- 172.21.15.115:0/3090674617 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc020070 con 0x7fa2d80c0e80 2023-07-27T14:31:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.980+0000 7fa2c67fc700 1 -- 172.21.15.115:0/3090674617 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc00de90 con 0x7fa2d80c0e80 2023-07-27T14:31:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.981+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d8147dc0 con 0x7fa2d80c0e80 2023-07-27T14:31:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.981+0000 7fa2c67fc700 1 -- 172.21.15.115:0/3090674617 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0198b0 con 0x7fa2d80c0e80 2023-07-27T14:31:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.981+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d8154270 con 0x7fa2d80c0e80 2023-07-27T14:31:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.982+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d806c470 con 0x7fa2d80c0e80 2023-07-27T14:31:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.982+0000 7fa2c67fc700 1 -- 172.21.15.115:0/3090674617 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fa2cc02c070 con 0x7fa2d80c0e80 2023-07-27T14:31:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.983+0000 7fa2c67fc700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2b805f1c0 0x7fa2b8061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.983+0000 7fa2c67fc700 1 -- 172.21.15.115:0/3090674617 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fa2cc07da80 con 0x7fa2d80c0e80 2023-07-27T14:31:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.983+0000 7fa2d659c700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2b805f1c0 0x7fa2b8061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.984+0000 7fa2d659c700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2b805f1c0 0x7fa2b8061680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fa2c8006fd0 tx=0x7fa2c8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:03.987+0000 7fa2c67fc700 1 -- 172.21.15.115:0/3090674617 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2cc04eb60 con 0x7fa2d80c0e80 2023-07-27T14:31:04.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.197+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa2d8155690 con 0x7fa2d80c0e80 2023-07-27T14:31:04.731 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:31:04.700+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:31:04.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.707+0000 7fa2c67fc700 1 -- 172.21.15.115:0/3090674617 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa2cc02a070 con 0x7fa2d80c0e80 2023-07-27T14:31:04.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2b805f1c0 msgr2=0x7fa2b8061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2b805f1c0 0x7fa2b8061680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fa2c8006fd0 tx=0x7fa2c8008040).stop 2023-07-27T14:31:04.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 msgr2=0x7fa2d8146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d8146fa0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fa2cc00b340 tx=0x7fa2d80bbdc0).stop 2023-07-27T14:31:04.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 shutdown_connections 2023-07-27T14:31:04.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2b805f1c0 0x7fa2b8061680 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2d8150af0 0x7fa2d8151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2d80696f0 0x7fa2d8146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 --2- 172.21.15.115:0/3090674617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2d80c0e80 0x7fa2d8146fa0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 >> 172.21.15.115:0/3090674617 conn(0x7fa2d8062320 msgr2=0x7fa2d814a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:04.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 shutdown_connections 2023-07-27T14:31:04.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.710+0000 7fa2dcdff700 1 -- 172.21.15.115:0/3090674617 wait complete. 2023-07-27T14:31:04.743 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:31:04.760 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:31:04.803 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:31:04.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.922+0000 7f79f6bff700 1 Processor -- start 2023-07-27T14:31:04.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.922+0000 7f79f6bff700 1 -- start start 2023-07-27T14:31:04.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.923+0000 7f79f6bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79f014ae00 0x7f79f0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.923+0000 7f79f6bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f0062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.923+0000 7f79f6bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f01553f0 con 0x7f79f00c5c50 2023-07-27T14:31:04.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.924+0000 7f79f6bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f0157a50 con 0x7f79f014ae00 2023-07-27T14:31:04.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.924+0000 7f79f6bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0157d10 con 0x7f79f014b1e0 2023-07-27T14:31:04.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.924+0000 7f79f499b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79f014ae00 0x7f79f0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.924+0000 7f79f499b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79f014ae00 0x7f79f0154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51296/0 (socket says 172.21.15.115:51296) 2023-07-27T14:31:04.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.924+0000 7f79f499b700 1 -- 172.21.15.115:0/2519555082 learned_addr learned my addr 172.21.15.115:0/2519555082 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:04.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.924+0000 7f79f519c700 1 --1- 172.21.15.115:0/2519555082 >> v1:172.21.15.115:6789/0 conn(0x7f79f00c5c50 0x7f79f00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43574/0 (socket says 172.21.15.115:43574) 2023-07-27T14:31:04.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79effff700 1 --2- 172.21.15.115:0/2519555082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f0062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79f499b700 1 -- 172.21.15.115:0/2519555082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 msgr2=0x7f79f0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:04.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79f499b700 1 --2- 172.21.15.115:0/2519555082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f0062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79f499b700 1 -- 172.21.15.115:0/2519555082 >> v1:172.21.15.115:6789/0 conn(0x7f79f00c5c50 legacy=0x7f79f00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79f499b700 1 -- 172.21.15.115:0/2519555082 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f0157ff0 con 0x7f79f014ae00 2023-07-27T14:31:04.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79f499b700 1 --2- 172.21.15.115:0/2519555082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0154f00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f79e4006fd0 tx=0x7f79e40090f0).ready entity=mon.0 client_cookie=654c34f1c7209275 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:04.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79ef7fe700 1 -- 172.21.15.115:0/2519555082 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400b600 con 0x7f79f014ae00 2023-07-27T14:31:04.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79ef7fe700 1 -- 172.21.15.115:0/2519555082 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e400b760 con 0x7f79f014ae00 2023-07-27T14:31:04.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.925+0000 7f79ef7fe700 1 -- 172.21.15.115:0/2519555082 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400bae0 con 0x7f79f014ae00 2023-07-27T14:31:04.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.926+0000 7f79f6bff700 1 -- 172.21.15.115:0/2519555082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 msgr2=0x7f79f0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.926+0000 7f79f6bff700 1 --2- 172.21.15.115:0/2519555082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0154f00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f79e4006fd0 tx=0x7f79e40090f0).stop 2023-07-27T14:31:04.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.926+0000 7f79f6bff700 1 -- 172.21.15.115:0/2519555082 shutdown_connections 2023-07-27T14:31:04.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.926+0000 7f79f6bff700 1 --2- 172.21.15.115:0/2519555082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0154f00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.926+0000 7f79f6bff700 1 --2- 172.21.15.115:0/2519555082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f0062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.926+0000 7f79f6bff700 1 -- 172.21.15.115:0/2519555082 >> 172.21.15.115:0/2519555082 conn(0x7f79f005e940 msgr2=0x7f79f00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:04.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.926+0000 7f79f6bff700 1 -- 172.21.15.115:0/2519555082 shutdown_connections 2023-07-27T14:31:04.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.926+0000 7f79f6bff700 1 -- 172.21.15.115:0/2519555082 wait complete. 2023-07-27T14:31:04.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.928+0000 7f79f6bff700 1 Processor -- start 2023-07-27T14:31:04.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.928+0000 7f79f6bff700 1 -- start start 2023-07-27T14:31:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79f6bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79f00c5c50 0x7f79f01491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79f6bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0164a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79f6bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f00af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79f6bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0149ac0 con 0x7f79f014ae00 2023-07-27T14:31:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79f6bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00aca00 con 0x7f79f00c5c50 2023-07-27T14:31:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79f6bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00c2440 con 0x7f79f014b1e0 2023-07-27T14:31:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79effff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79effff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0164a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51300/0 (socket says 172.21.15.115:51300) 2023-07-27T14:31:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79effff700 1 -- 172.21.15.115:0/405151858 learned_addr learned my addr 172.21.15.115:0/405151858 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79f499b700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79f00c5c50 0x7f79f01491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.929+0000 7f79f519c700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f00af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79effff700 1 -- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 msgr2=0x7f79f00af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79effff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f00af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79effff700 1 -- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79f00c5c50 msgr2=0x7f79f01491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79effff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79f00c5c50 0x7f79f01491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79effff700 1 -- 172.21.15.115:0/405151858 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4009370 con 0x7f79f014ae00 2023-07-27T14:31:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79f519c700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f00af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79effff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0164a60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f79dc006980 tx=0x7f79dc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79ecff9700 1 -- 172.21.15.115:0/405151858 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc011590 con 0x7f79f014ae00 2023-07-27T14:31:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79ecff9700 1 -- 172.21.15.115:0/405151858 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc0116f0 con 0x7f79f014ae00 2023-07-27T14:31:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79ecff9700 1 -- 172.21.15.115:0/405151858 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc011a70 con 0x7f79f014ae00 2023-07-27T14:31:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f00c4840 con 0x7f79f014ae00 2023-07-27T14:31:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.930+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f00c20d0 con 0x7f79f014ae00 2023-07-27T14:31:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.931+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f00c25f0 con 0x7f79f014ae00 2023-07-27T14:31:04.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.932+0000 7f79ecff9700 1 -- 172.21.15.115:0/405151858 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f79dc012420 con 0x7f79f014ae00 2023-07-27T14:31:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.933+0000 7f79ecff9700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f79d405f1c0 0x7f79d4061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.933+0000 7f79ecff9700 1 -- 172.21.15.115:0/405151858 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f79dc079cc0 con 0x7f79f014ae00 2023-07-27T14:31:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.933+0000 7f79f499b700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f79d405f1c0 0x7f79d4061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.934+0000 7f79f499b700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f79d405f1c0 0x7f79d4061680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f79e4009130 tx=0x7f79e4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:04.937+0000 7f79ecff9700 1 -- 172.21.15.115:0/405151858 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79f00c25f0 con 0x7f79f014ae00 2023-07-27T14:31:05.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.146+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79f00c1c30 con 0x7f79f014ae00 2023-07-27T14:31:05.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.712+0000 7f79ecff9700 1 -- 172.21.15.115:0/405151858 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79dc04ad00 con 0x7f79f014ae00 2023-07-27T14:31:05.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f79d405f1c0 msgr2=0x7f79d4061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:05.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f79d405f1c0 0x7f79d4061680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f79e4009130 tx=0x7f79e4017000).stop 2023-07-27T14:31:05.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 msgr2=0x7f79f0164a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:05.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0164a60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f79dc006980 tx=0x7f79dc008040).stop 2023-07-27T14:31:05.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 shutdown_connections 2023-07-27T14:31:05.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f79d405f1c0 0x7f79d4061680 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:05.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79f014b1e0 0x7f79f00af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:05.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79f00c5c50 0x7f79f01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:05.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 --2- 172.21.15.115:0/405151858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79f014ae00 0x7f79f0164a60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:05.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 >> 172.21.15.115:0/405151858 conn(0x7f79f005e940 msgr2=0x7f79f01525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:05.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 shutdown_connections 2023-07-27T14:31:05.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.714+0000 7f79f6bff700 1 -- 172.21.15.115:0/405151858 wait complete. 2023-07-27T14:31:05.765 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:31:05.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.966+0000 7f3f9bdff700 1 Processor -- start 2023-07-27T14:31:05.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.966+0000 7f3f9bdff700 1 -- start start 2023-07-27T14:31:05.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.967+0000 7f3f9bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f94063260 0x7f3f94154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:05.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.967+0000 7f3f9bdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f941553f0 con 0x7f3f9414b1e0 2023-07-27T14:31:05.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.967+0000 7f3f9bdff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f94157a50 con 0x7f3f9414ae00 2023-07-27T14:31:05.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.967+0000 7f3f9bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f94157d10 con 0x7f3f94063260 2023-07-27T14:31:06.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f9a39c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3f9414b1e0 0x7f3f940a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43578/0 (socket says 172.21.15.115:43578) 2023-07-27T14:31:06.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f9a39c700 1 -- 172.21.15.115:0/1778069323 learned_addr learned my addr 172.21.15.115:0/1778069323 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:06.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f9939a700 1 --2- 172.21.15.115:0/1778069323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f94063260 0x7f3f94154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f98b99700 1 -- 172.21.15.115:0/1778069323 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215434181 0 0) 0x7f3f941553f0 con 0x7f3f9414b1e0 2023-07-27T14:31:06.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f98b99700 1 -- 172.21.15.115:0/1778069323 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f800033f0 con 0x7f3f9414b1e0 2023-07-27T14:31:06.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f98b99700 1 -- 172.21.15.115:0/1778069323 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440265748 0 0) 0x7f3f94157a50 con 0x7f3f9414ae00 2023-07-27T14:31:06.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f9939a700 1 -- 172.21.15.115:0/1778069323 >> v1:172.21.15.159:6789/0 conn(0x7f3f9414ae00 legacy=0x7f3f94062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f9939a700 1 -- 172.21.15.115:0/1778069323 >> v1:172.21.15.115:6789/0 conn(0x7f3f9414b1e0 legacy=0x7f3f940a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f9939a700 1 -- 172.21.15.115:0/1778069323 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f94157ff0 con 0x7f3f94063260 2023-07-27T14:31:06.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.968+0000 7f3f9939a700 1 --2- 172.21.15.115:0/1778069323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f94063260 0x7f3f94154f00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3f84009790 tx=0x7f3f84009060).ready entity=mon.2 client_cookie=3f365a961611f725 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:06.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f98b99700 1 -- 172.21.15.115:0/1778069323 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400f510 con 0x7f3f94063260 2023-07-27T14:31:06.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f98b99700 1 -- 172.21.15.115:0/1778069323 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400f670 con 0x7f3f94063260 2023-07-27T14:31:06.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f98b99700 1 -- 172.21.15.115:0/1778069323 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400f9f0 con 0x7f3f94063260 2023-07-27T14:31:06.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f9bdff700 1 -- 172.21.15.115:0/1778069323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f94063260 msgr2=0x7f3f94154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f9bdff700 1 --2- 172.21.15.115:0/1778069323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f94063260 0x7f3f94154f00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3f84009790 tx=0x7f3f84009060).stop 2023-07-27T14:31:06.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f9bdff700 1 -- 172.21.15.115:0/1778069323 shutdown_connections 2023-07-27T14:31:06.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f9bdff700 1 --2- 172.21.15.115:0/1778069323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f94063260 0x7f3f94154f00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f9bdff700 1 -- 172.21.15.115:0/1778069323 >> 172.21.15.115:0/1778069323 conn(0x7f3f9405e940 msgr2=0x7f3f940cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:06.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f9bdff700 1 -- 172.21.15.115:0/1778069323 shutdown_connections 2023-07-27T14:31:06.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.969+0000 7f3f9bdff700 1 -- 172.21.15.115:0/1778069323 wait complete. 2023-07-27T14:31:06.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.971+0000 7f3f9bdff700 1 Processor -- start 2023-07-27T14:31:06.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.971+0000 7f3f9bdff700 1 -- start start 2023-07-27T14:31:06.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9bdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f94063260 0x7f3f941563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f9414ae00 0x7f3f940ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9bdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f9414b1e0 0x7f3f940ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9bdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f941641b0 con 0x7f3f9414b1e0 2023-07-27T14:31:06.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9bdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940c1dd0 con 0x7f3f94063260 2023-07-27T14:31:06.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940c2090 con 0x7f3f9414ae00 2023-07-27T14:31:06.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9a39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f9414b1e0 0x7f3f940ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9a39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f9414b1e0 0x7f3f940ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51314/0 (socket says 172.21.15.115:51314) 2023-07-27T14:31:06.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9a39c700 1 -- 172.21.15.115:0/861747283 learned_addr learned my addr 172.21.15.115:0/861747283 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:06.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f9939a700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f9414ae00 0x7f3f940ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.972+0000 7f3f99b9b700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f94063260 0x7f3f941563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f9a39c700 1 -- 172.21.15.115:0/861747283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f9414ae00 msgr2=0x7f3f940ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f9a39c700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f9414ae00 0x7f3f940ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f9a39c700 1 -- 172.21.15.115:0/861747283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f94063260 msgr2=0x7f3f941563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f9a39c700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f94063260 0x7f3f941563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f9a39c700 1 -- 172.21.15.115:0/861747283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840092a0 con 0x7f3f9414b1e0 2023-07-27T14:31:06.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f9a39c700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f9414b1e0 0x7f3f940ae370 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f3f8c00c790 tx=0x7f3f8c007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:06.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f89ffb700 1 -- 172.21.15.115:0/861747283 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c005d30 con 0x7f3f9414b1e0 2023-07-27T14:31:06.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f89ffb700 1 -- 172.21.15.115:0/861747283 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c005e90 con 0x7f3f9414b1e0 2023-07-27T14:31:06.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f89ffb700 1 -- 172.21.15.115:0/861747283 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c007320 con 0x7f3f9414b1e0 2023-07-27T14:31:06.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f940c2370 con 0x7f3f9414b1e0 2023-07-27T14:31:06.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.973+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f940c2930 con 0x7f3f9414b1e0 2023-07-27T14:31:06.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.974+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9406c470 con 0x7f3f9414b1e0 2023-07-27T14:31:06.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.975+0000 7f3f89ffb700 1 -- 172.21.15.115:0/861747283 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f3f8c010070 con 0x7f3f9414b1e0 2023-07-27T14:31:06.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.976+0000 7f3f89ffb700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f1c0 0x7f3f78061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.976+0000 7f3f89ffb700 1 -- 172.21.15.115:0/861747283 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f3f8c079960 con 0x7f3f9414b1e0 2023-07-27T14:31:06.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.976+0000 7f3f99b9b700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f1c0 0x7f3f78061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.977+0000 7f3f99b9b700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f1c0 0x7f3f78061680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f3f94156fc0 tx=0x7f3f90009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:06.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:05.980+0000 7f3f89ffb700 1 -- 172.21.15.115:0/861747283 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f8c04aa00 con 0x7f3f9414b1e0 2023-07-27T14:31:06.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.150+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f940c7bc0 con 0x7f3f9414b1e0 2023-07-27T14:31:06.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.714+0000 7f3f89ffb700 1 -- 172.21.15.115:0/861747283 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3f8c018030 con 0x7f3f9414b1e0 2023-07-27T14:31:06.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f1c0 msgr2=0x7f3f78061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f1c0 0x7f3f78061680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f3f94156fc0 tx=0x7f3f90009040).stop 2023-07-27T14:31:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f9414b1e0 msgr2=0x7f3f940ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f9414b1e0 0x7f3f940ae370 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f3f8c00c790 tx=0x7f3f8c007f50).stop 2023-07-27T14:31:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 shutdown_connections 2023-07-27T14:31:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f1c0 0x7f3f78061680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f9414b1e0 0x7f3f940ae370 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f94063260 0x7f3f941563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 --2- 172.21.15.115:0/861747283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f9414ae00 0x7f3f940ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 >> 172.21.15.115:0/861747283 conn(0x7f3f9405e940 msgr2=0x7f3f940aad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:06.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 shutdown_connections 2023-07-27T14:31:06.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.717+0000 7f3f9bdff700 1 -- 172.21.15.115:0/861747283 wait complete. 2023-07-27T14:31:06.751 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:31:06.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:31:06.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.932+0000 7f67097ff700 1 Processor -- start 2023-07-27T14:31:06.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.932+0000 7f67097ff700 1 -- start start 2023-07-27T14:31:06.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.933+0000 7f67097ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.933+0000 7f67097ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f67040bfb50 0x7f67040c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.933+0000 7f67097ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040c60a0 con 0x7f67040c0610 2023-07-27T14:31:06.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.933+0000 7f67097ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040c5d70 con 0x7f67040bfb50 2023-07-27T14:31:06.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.933+0000 7f67097ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040a7e30 con 0x7f6704153f30 2023-07-27T14:31:06.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f6702ffd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f67037fe700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f67040c0610 0x7f67040c6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:43048/0 (socket says 172.21.15.115:43048) 2023-07-27T14:31:06.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f67037fe700 1 -- 172.21.15.115:0/294232993 learned_addr learned my addr 172.21.15.115:0/294232993 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f67027fc700 1 --2- 172.21.15.115:0/294232993 >> v2:172.21.15.159:3300/0 conn(0x7f67040bfb50 0x7f67040c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f6701ffb700 1 -- 172.21.15.115:0/294232993 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474052333 0 0) 0x7f67040c60a0 con 0x7f67040c0610 2023-07-27T14:31:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f6701ffb700 1 -- 172.21.15.115:0/294232993 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66ec0033f0 con 0x7f67040c0610 2023-07-27T14:31:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f67027fc700 1 -- 172.21.15.115:0/294232993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 msgr2=0x7f67040a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f67027fc700 1 --2- 172.21.15.115:0/294232993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040a7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f67027fc700 1 -- 172.21.15.115:0/294232993 >> v1:172.21.15.159:6789/0 conn(0x7f67040c0610 legacy=0x7f67040c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f67027fc700 1 -- 172.21.15.115:0/294232993 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040c7d80 con 0x7f67040bfb50 2023-07-27T14:31:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.934+0000 7f6702ffd700 1 --2- 172.21.15.115:0/294232993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:06.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.935+0000 7f67027fc700 1 --2- 172.21.15.115:0/294232993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 0x7f67040c7550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f66f8009760 tx=0x7f66f8009060).ready entity=mon.1 client_cookie=2a47f4c58b0e8042 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:06.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.935+0000 7f6701ffb700 1 -- 172.21.15.115:0/294232993 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800d4a0 con 0x7f67040bfb50 2023-07-27T14:31:06.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.935+0000 7f6701ffb700 1 -- 172.21.15.115:0/294232993 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f800d600 con 0x7f67040bfb50 2023-07-27T14:31:06.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.935+0000 7f6701ffb700 1 -- 172.21.15.115:0/294232993 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800d980 con 0x7f67040bfb50 2023-07-27T14:31:06.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.936+0000 7f67097ff700 1 -- 172.21.15.115:0/294232993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 msgr2=0x7f67040c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.936+0000 7f67097ff700 1 --2- 172.21.15.115:0/294232993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 0x7f67040c7550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f66f8009760 tx=0x7f66f8009060).stop 2023-07-27T14:31:06.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.936+0000 7f67097ff700 1 -- 172.21.15.115:0/294232993 shutdown_connections 2023-07-27T14:31:06.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.936+0000 7f67097ff700 1 --2- 172.21.15.115:0/294232993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.936+0000 7f67097ff700 1 --2- 172.21.15.115:0/294232993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 0x7f67040c7550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.936+0000 7f67097ff700 1 -- 172.21.15.115:0/294232993 >> 172.21.15.115:0/294232993 conn(0x7f6704094280 msgr2=0x7f670405e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:06.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.936+0000 7f67097ff700 1 -- 172.21.15.115:0/294232993 shutdown_connections 2023-07-27T14:31:06.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.936+0000 7f67097ff700 1 -- 172.21.15.115:0/294232993 wait complete. 2023-07-27T14:31:06.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.937+0000 7f67097ff700 1 Processor -- start 2023-07-27T14:31:06.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.937+0000 7f67097ff700 1 -- start start 2023-07-27T14:31:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.938+0000 7f67097ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 0x7f670414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.938+0000 7f67097ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67040c0610 0x7f670414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.938+0000 7f67097ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.938+0000 7f67097ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040adeb0 con 0x7f67040c0610 2023-07-27T14:31:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.938+0000 7f67097ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040ae190 con 0x7f67040bfb50 2023-07-27T14:31:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.938+0000 7f67097ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040ae470 con 0x7f6704153f30 2023-07-27T14:31:06.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67040c0610 0x7f670414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67040c0610 0x7f670414ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51328/0 (socket says 172.21.15.115:51328) 2023-07-27T14:31:06.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 -- 172.21.15.115:0/1451110658 learned_addr learned my addr 172.21.15.115:0/1451110658 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:06.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f6702ffd700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 0x7f670414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67037fe700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 -- 172.21.15.115:0/1451110658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 msgr2=0x7f67040b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 -- 172.21.15.115:0/1451110658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 msgr2=0x7f670414fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:06.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 0x7f670414fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:06.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 -- 172.21.15.115:0/1451110658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f40092a0 con 0x7f67040c0610 2023-07-27T14:31:06.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67027fc700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67040c0610 0x7f670414ee70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f66f8010000 tx=0x7f66f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:06.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f66eaffd700 1 -- 172.21.15.115:0/1451110658 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8000c90 con 0x7f67040c0610 2023-07-27T14:31:06.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f66eaffd700 1 -- 172.21.15.115:0/1451110658 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f800d770 con 0x7f67040c0610 2023-07-27T14:31:06.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f66eaffd700 1 -- 172.21.15.115:0/1451110658 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f801d430 con 0x7f67040c0610 2023-07-27T14:31:06.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.939+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f80092a0 con 0x7f67040c0610 2023-07-27T14:31:06.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.940+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67040aea30 con 0x7f67040c0610 2023-07-27T14:31:06.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.940+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67040aec20 con 0x7f67040c0610 2023-07-27T14:31:06.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.941+0000 7f66eaffd700 1 -- 172.21.15.115:0/1451110658 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f66f800f070 con 0x7f67040c0610 2023-07-27T14:31:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.942+0000 7f66eaffd700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66f005f1c0 0x7f66f0061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.942+0000 7f66eaffd700 1 -- 172.21.15.115:0/1451110658 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f66f807b830 con 0x7f67040c0610 2023-07-27T14:31:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.942+0000 7f6702ffd700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66f005f1c0 0x7f66f0061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.943+0000 7f6702ffd700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66f005f1c0 0x7f66f0061680 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f66f4009d20 tx=0x7f66f4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:06.946+0000 7f66eaffd700 1 -- 172.21.15.115:0/1451110658 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66f804c920 con 0x7f67040c0610 2023-07-27T14:31:07.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.123+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f670406c470 con 0x7f67040c0610 2023-07-27T14:31:07.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.720+0000 7f66eaffd700 1 -- 172.21.15.115:0/1451110658 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7f66f804ff40 con 0x7f67040c0610 2023-07-27T14:31:07.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66f005f1c0 msgr2=0x7f66f0061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:07.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66f005f1c0 0x7f66f0061680 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f66f4009d20 tx=0x7f66f4009060).stop 2023-07-27T14:31:07.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67040c0610 msgr2=0x7f670414ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:07.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67040c0610 0x7f670414ee70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f66f8010000 tx=0x7f66f8016000).stop 2023-07-27T14:31:07.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 shutdown_connections 2023-07-27T14:31:07.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66f005f1c0 0x7f66f0061680 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6704153f30 0x7f67040b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67040bfb50 0x7f670414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 --2- 172.21.15.115:0/1451110658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67040c0610 0x7f670414ee70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 >> 172.21.15.115:0/1451110658 conn(0x7f6704094280 msgr2=0x7f67040c0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:07.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 shutdown_connections 2023-07-27T14:31:07.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.722+0000 7f67097ff700 1 -- 172.21.15.115:0/1451110658 wait complete. 2023-07-27T14:31:07.755 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:31:07.773 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-07-27T14:31:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.943+0000 7fc6397ff700 1 Processor -- start 2023-07-27T14:31:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.943+0000 7fc6397ff700 1 -- start start 2023-07-27T14:31:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.944+0000 7fc6397ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc63414ae00 0x7fc634154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.944+0000 7fc6397ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.944+0000 7fc6397ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6341553f0 con 0x7fc6340c5c50 2023-07-27T14:31:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.944+0000 7fc6397ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc634157a50 con 0x7fc63414ae00 2023-07-27T14:31:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.944+0000 7fc6397ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc634157d10 con 0x7fc63414b1e0 2023-07-27T14:31:07.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.945+0000 7fc6327fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:07.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.945+0000 7fc632ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc63414ae00 0x7fc634154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.945+0000 7fc6327fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:32862/0 (socket says 172.21.15.115:32862) 2023-07-27T14:31:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.945+0000 7fc6327fc700 1 -- 172.21.15.115:0/4175359695 learned_addr learned my addr 172.21.15.115:0/4175359695 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.945+0000 7fc6337fe700 1 --1- 172.21.15.115:0/4175359695 >> v1:172.21.15.159:6789/0 conn(0x7fc6340c5c50 0x7fc6340a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:43060/0 (socket says 172.21.15.115:43060) 2023-07-27T14:31:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.945+0000 7fc631ffb700 1 -- 172.21.15.115:0/4175359695 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968433723 0 0) 0x7fc6341553f0 con 0x7fc6340c5c50 2023-07-27T14:31:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.945+0000 7fc631ffb700 1 -- 172.21.15.115:0/4175359695 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc61c0033f0 con 0x7fc6340c5c50 2023-07-27T14:31:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc632ffd700 1 -- 172.21.15.115:0/4175359695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 msgr2=0x7fc634062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc632ffd700 1 --2- 172.21.15.115:0/4175359695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc632ffd700 1 -- 172.21.15.115:0/4175359695 >> v1:172.21.15.159:6789/0 conn(0x7fc6340c5c50 legacy=0x7fc6340a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc632ffd700 1 -- 172.21.15.115:0/4175359695 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634157ff0 con 0x7fc63414ae00 2023-07-27T14:31:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc6327fc700 1 --2- 172.21.15.115:0/4175359695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc632ffd700 1 --2- 172.21.15.115:0/4175359695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc63414ae00 0x7fc634154f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fc624009760 tx=0x7fc624009060).ready entity=mon.1 client_cookie=8d44607ad3253101 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc631ffb700 1 -- 172.21.15.115:0/4175359695 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400d4a0 con 0x7fc63414ae00 2023-07-27T14:31:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc631ffb700 1 -- 172.21.15.115:0/4175359695 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62400d600 con 0x7fc63414ae00 2023-07-27T14:31:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.946+0000 7fc631ffb700 1 -- 172.21.15.115:0/4175359695 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400d980 con 0x7fc63414ae00 2023-07-27T14:31:07.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.947+0000 7fc6397ff700 1 -- 172.21.15.115:0/4175359695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc63414ae00 msgr2=0x7fc634154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:07.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.947+0000 7fc6397ff700 1 --2- 172.21.15.115:0/4175359695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc63414ae00 0x7fc634154f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fc624009760 tx=0x7fc624009060).stop 2023-07-27T14:31:07.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.947+0000 7fc6397ff700 1 -- 172.21.15.115:0/4175359695 shutdown_connections 2023-07-27T14:31:07.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.947+0000 7fc6397ff700 1 --2- 172.21.15.115:0/4175359695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc63414ae00 0x7fc634154f00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.947+0000 7fc6397ff700 1 --2- 172.21.15.115:0/4175359695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.947+0000 7fc6397ff700 1 -- 172.21.15.115:0/4175359695 >> 172.21.15.115:0/4175359695 conn(0x7fc63405e940 msgr2=0x7fc6340cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:07.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.947+0000 7fc6397ff700 1 -- 172.21.15.115:0/4175359695 shutdown_connections 2023-07-27T14:31:07.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.947+0000 7fc6397ff700 1 -- 172.21.15.115:0/4175359695 wait complete. 2023-07-27T14:31:07.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.948+0000 7fc6397ff700 1 Processor -- start 2023-07-27T14:31:07.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.948+0000 7fc6397ff700 1 -- start start 2023-07-27T14:31:07.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.949+0000 7fc6397ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c5c50 0x7fc6340b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:07.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.949+0000 7fc6397ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63414ae00 0x7fc6340c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.949+0000 7fc6397ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634166bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.949+0000 7fc6397ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341670b0 con 0x7fc63414ae00 2023-07-27T14:31:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.949+0000 7fc6397ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63414a010 con 0x7fc6340c5c50 2023-07-27T14:31:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.949+0000 7fc6397ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63414aa50 con 0x7fc63414b1e0 2023-07-27T14:31:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.949+0000 7fc6327fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63414ae00 0x7fc6340c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6327fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63414ae00 0x7fc6340c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51340/0 (socket says 172.21.15.115:51340) 2023-07-27T14:31:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6327fc700 1 -- 172.21.15.115:0/382030488 learned_addr learned my addr 172.21.15.115:0/382030488 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc632ffd700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c5c50 0x7fc6340b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6337fe700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634166bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6327fc700 1 -- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 msgr2=0x7fc634166bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6327fc700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634166bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6327fc700 1 -- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c5c50 msgr2=0x7fc6340b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6327fc700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c5c50 0x7fc6340b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6327fc700 1 -- 172.21.15.115:0/382030488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628009370 con 0x7fc63414ae00 2023-07-27T14:31:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc632ffd700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c5c50 0x7fc6340b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6337fe700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634166bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6327fc700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63414ae00 0x7fc6340c36b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fc62800ea80 tx=0x7fc6280090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc61affd700 1 -- 172.21.15.115:0/382030488 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800c8c0 con 0x7fc63414ae00 2023-07-27T14:31:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc61affd700 1 -- 172.21.15.115:0/382030488 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62800ca20 con 0x7fc63414ae00 2023-07-27T14:31:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6240092a0 con 0x7fc63414ae00 2023-07-27T14:31:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc61affd700 1 -- 172.21.15.115:0/382030488 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800cda0 con 0x7fc63414ae00 2023-07-27T14:31:07.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.950+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc634165a40 con 0x7fc63414ae00 2023-07-27T14:31:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.951+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc634165bd0 con 0x7fc63414ae00 2023-07-27T14:31:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.952+0000 7fc61affd700 1 -- 172.21.15.115:0/382030488 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fc628022070 con 0x7fc63414ae00 2023-07-27T14:31:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.953+0000 7fc61affd700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc62005f190 0x7fc620061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.953+0000 7fc61affd700 1 -- 172.21.15.115:0/382030488 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fc62807a4b0 con 0x7fc63414ae00 2023-07-27T14:31:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.953+0000 7fc632ffd700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc62005f190 0x7fc620061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.954+0000 7fc632ffd700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc62005f190 0x7fc620061650 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fc62400d260 tx=0x7fc624016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:07.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:07.957+0000 7fc61affd700 1 -- 172.21.15.115:0/382030488 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc62804b810 con 0x7fc63414ae00 2023-07-27T14:31:08.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.128+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7fc63406c470 con 0x7fc63414ae00 2023-07-27T14:31:08.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.132+0000 7fc61affd700 1 -- 172.21.15.115:0/382030488 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc6280160b0 con 0x7fc63414ae00 2023-07-27T14:31:08.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc62005f190 msgr2=0x7fc620061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc62005f190 0x7fc620061650 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fc62400d260 tx=0x7fc624016000).stop 2023-07-27T14:31:08.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63414ae00 msgr2=0x7fc6340c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63414ae00 0x7fc6340c36b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fc62800ea80 tx=0x7fc6280090f0).stop 2023-07-27T14:31:08.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 shutdown_connections 2023-07-27T14:31:08.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc62005f190 0x7fc620061650 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc63414b1e0 0x7fc634166bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6340c5c50 0x7fc6340b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 --2- 172.21.15.115:0/382030488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc63414ae00 0x7fc6340c36b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 >> 172.21.15.115:0/382030488 conn(0x7fc63405e940 msgr2=0x7fc634159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:08.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 shutdown_connections 2023-07-27T14:31:08.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.135+0000 7fc6397ff700 1 -- 172.21.15.115:0/382030488 wait complete. 2023-07-27T14:31:08.184 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:31:08.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.343+0000 7f0d179ff700 1 Processor -- start 2023-07-27T14:31:08.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.344+0000 7f0d179ff700 1 -- start start 2023-07-27T14:31:08.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.345+0000 7f0d179ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d101509b0 0x7f0d100c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.345+0000 7f0d179ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d100c3100 0x7f0d100c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.345+0000 7f0d179ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d100c0ea0 con 0x7f0d10150d90 2023-07-27T14:31:08.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.345+0000 7f0d179ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d10068e10 con 0x7f0d101509b0 2023-07-27T14:31:08.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.345+0000 7f0d179ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10155190 con 0x7f0d100c3100 2023-07-27T14:31:08.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.345+0000 7f0d1579b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d101509b0 0x7f0d100c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.345+0000 7f0d1579b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d101509b0 0x7f0d100c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51350/0 (socket says 172.21.15.115:51350) 2023-07-27T14:31:08.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.345+0000 7f0d1579b700 1 -- 172.21.15.115:0/3104365262 learned_addr learned my addr 172.21.15.115:0/3104365262 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:08.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d1579b700 1 -- 172.21.15.115:0/3104365262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d100c3100 msgr2=0x7f0d100c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:08.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d1579b700 1 --2- 172.21.15.115:0/3104365262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d100c3100 0x7f0d100c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:08.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d1579b700 1 -- 172.21.15.115:0/3104365262 >> v1:172.21.15.159:6789/0 conn(0x7f0d10150d90 legacy=0x7f0d10154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:08.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d1579b700 1 -- 172.21.15.115:0/3104365262 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d10155470 con 0x7f0d101509b0 2023-07-27T14:31:08.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d1579b700 1 --2- 172.21.15.115:0/3104365262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100c58d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f0d0c006fd0 tx=0x7f0d0c0090f0).ready entity=mon.0 client_cookie=6453c7395f2b70a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d07fff700 1 -- 172.21.15.115:0/3104365262 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00b600 con 0x7f0d101509b0 2023-07-27T14:31:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d07fff700 1 -- 172.21.15.115:0/3104365262 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c00b760 con 0x7f0d101509b0 2023-07-27T14:31:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d07fff700 1 -- 172.21.15.115:0/3104365262 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00bae0 con 0x7f0d101509b0 2023-07-27T14:31:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d179ff700 1 -- 172.21.15.115:0/3104365262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 msgr2=0x7f0d100c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.346+0000 7f0d179ff700 1 --2- 172.21.15.115:0/3104365262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100c58d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f0d0c006fd0 tx=0x7f0d0c0090f0).stop 2023-07-27T14:31:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.347+0000 7f0d179ff700 1 -- 172.21.15.115:0/3104365262 shutdown_connections 2023-07-27T14:31:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.347+0000 7f0d179ff700 1 --2- 172.21.15.115:0/3104365262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d100c3100 0x7f0d100c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:08.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.347+0000 7f0d179ff700 1 --2- 172.21.15.115:0/3104365262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100c58d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.347+0000 7f0d179ff700 1 -- 172.21.15.115:0/3104365262 >> 172.21.15.115:0/3104365262 conn(0x7f0d10062320 msgr2=0x7f0d10062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:08.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.347+0000 7f0d179ff700 1 -- 172.21.15.115:0/3104365262 shutdown_connections 2023-07-27T14:31:08.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.347+0000 7f0d179ff700 1 -- 172.21.15.115:0/3104365262 wait complete. 2023-07-27T14:31:08.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.348+0000 7f0d179ff700 1 Processor -- start 2023-07-27T14:31:08.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.348+0000 7f0d179ff700 1 -- start start 2023-07-27T14:31:08.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d179ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100c3100 0x7f0d1014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d179ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100a8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d179ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d10150d90 0x7f0d100a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d179ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100a8d60 con 0x7f0d101509b0 2023-07-27T14:31:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d179ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100a9040 con 0x7f0d100c3100 2023-07-27T14:31:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d179ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100a9320 con 0x7f0d10150d90 2023-07-27T14:31:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d14f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d14f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100a8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51358/0 (socket says 172.21.15.115:51358) 2023-07-27T14:31:08.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.349+0000 7f0d14f9a700 1 -- 172.21.15.115:0/2109167070 learned_addr learned my addr 172.21.15.115:0/2109167070 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d1579b700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100c3100 0x7f0d1014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d15f9c700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d10150d90 0x7f0d100a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d14f9a700 1 -- 172.21.15.115:0/2109167070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d10150d90 msgr2=0x7f0d100a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d14f9a700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d10150d90 0x7f0d100a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d14f9a700 1 -- 172.21.15.115:0/2109167070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100c3100 msgr2=0x7f0d1014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d14f9a700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100c3100 0x7f0d1014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d14f9a700 1 -- 172.21.15.115:0/2109167070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c009370 con 0x7f0d101509b0 2023-07-27T14:31:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d14f9a700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100a8360 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f0d0000b460 tx=0x7f0d00006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d057fa700 1 -- 172.21.15.115:0/2109167070 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00012410 con 0x7f0d101509b0 2023-07-27T14:31:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d057fa700 1 -- 172.21.15.115:0/2109167070 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00012590 con 0x7f0d101509b0 2023-07-27T14:31:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d100aa870 con 0x7f0d101509b0 2023-07-27T14:31:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d057fa700 1 -- 172.21.15.115:0/2109167070 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00012950 con 0x7f0d101509b0 2023-07-27T14:31:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.350+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1014bdc0 con 0x7f0d101509b0 2023-07-27T14:31:08.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.352+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1015bb20 con 0x7f0d101509b0 2023-07-27T14:31:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.352+0000 7f0d057fa700 1 -- 172.21.15.115:0/2109167070 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f0d0000f030 con 0x7f0d101509b0 2023-07-27T14:31:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.353+0000 7f0d057fa700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0cf405f190 0x7f0cf4061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.353+0000 7f0d057fa700 1 -- 172.21.15.115:0/2109167070 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0d000799e0 con 0x7f0d101509b0 2023-07-27T14:31:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.353+0000 7f0d1579b700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0cf405f190 0x7f0cf4061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.354+0000 7f0d1579b700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0cf405f190 0x7f0cf4061650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f0d0c009130 tx=0x7f0d0c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:08.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.357+0000 7f0d057fa700 1 -- 172.21.15.115:0/2109167070 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d0004ae50 con 0x7f0d101509b0 2023-07-27T14:31:08.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.527+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0d1006c470 con 0x7f0d101509b0 2023-07-27T14:31:08.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.531+0000 7f0d057fa700 1 -- 172.21.15.115:0/2109167070 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0d0004e470 con 0x7f0d101509b0 2023-07-27T14:31:08.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0cf405f190 msgr2=0x7f0cf4061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0cf405f190 0x7f0cf4061650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f0d0c009130 tx=0x7f0d0c017000).stop 2023-07-27T14:31:08.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 msgr2=0x7f0d100a8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100a8360 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f0d0000b460 tx=0x7f0d00006f20).stop 2023-07-27T14:31:08.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 shutdown_connections 2023-07-27T14:31:08.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0cf405f190 0x7f0cf4061650 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0d10150d90 0x7f0d100a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0d100c3100 0x7f0d1014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 --2- 172.21.15.115:0/2109167070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d101509b0 0x7f0d100a8360 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 >> 172.21.15.115:0/2109167070 conn(0x7f0d10062320 msgr2=0x7f0d100c22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:08.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 shutdown_connections 2023-07-27T14:31:08.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.533+0000 7f0d179ff700 1 -- 172.21.15.115:0/2109167070 wait complete. 2023-07-27T14:31:08.582 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2023-07-27T14:31:08.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.739+0000 7f15f7fff700 1 Processor -- start 2023-07-27T14:31:08.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.739+0000 7f15f7fff700 1 -- start start 2023-07-27T14:31:08.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 0x7f15f01530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15f0067e50 0x7f15f00c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f7fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f15f00a7750 0x7f15f00a7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f0067a30 con 0x7f15f0067e50 2023-07-27T14:31:08.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f7fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f014c960 con 0x7f15f00a7750 2023-07-27T14:31:08.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00a80b0 con 0x7f15f014c580 2023-07-27T14:31:08.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f559a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15f0067e50 0x7f15f00c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f559a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15f0067e50 0x7f15f00c2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51366/0 (socket says 172.21.15.115:51366) 2023-07-27T14:31:08.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f559a700 1 -- 172.21.15.115:0/3936277822 learned_addr learned my addr 172.21.15.115:0/3936277822 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:08.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f5d9b700 1 --2- 172.21.15.115:0/3936277822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 0x7f15f01530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f659c700 1 --2- 172.21.15.115:0/3936277822 >> v2:172.21.15.159:3300/0 conn(0x7f15f00a7750 0x7f15f00a7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f559a700 1 -- 172.21.15.115:0/3936277822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 msgr2=0x7f15f01530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:08.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f559a700 1 --2- 172.21.15.115:0/3936277822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 0x7f15f01530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f559a700 1 -- 172.21.15.115:0/3936277822 >> v2:172.21.15.159:3300/0 conn(0x7f15f00a7750 msgr2=0x7f15f00a7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:08.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f559a700 1 --2- 172.21.15.115:0/3936277822 >> v2:172.21.15.159:3300/0 conn(0x7f15f00a7750 0x7f15f00a7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.741+0000 7f15f559a700 1 -- 172.21.15.115:0/3936277822 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00c4c30 con 0x7f15f0067e50 2023-07-27T14:31:08.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f559a700 1 --2- 172.21.15.115:0/3936277822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067e50 0x7f15f00c2fa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f15f006bf20 tx=0x7f15e00090f0).ready entity=mon.0 client_cookie=bdebb9df8643e91b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:08.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f4d99700 1 -- 172.21.15.115:0/3936277822 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000b600 con 0x7f15f0067e50 2023-07-27T14:31:08.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f4d99700 1 -- 172.21.15.115:0/3936277822 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000b760 con 0x7f15f0067e50 2023-07-27T14:31:08.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f4d99700 1 -- 172.21.15.115:0/3936277822 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000bb00 con 0x7f15f0067e50 2023-07-27T14:31:08.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f7fff700 1 -- 172.21.15.115:0/3936277822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067e50 msgr2=0x7f15f00c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f7fff700 1 --2- 172.21.15.115:0/3936277822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067e50 0x7f15f00c2fa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f15f006bf20 tx=0x7f15e00090f0).stop 2023-07-27T14:31:08.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f7fff700 1 -- 172.21.15.115:0/3936277822 shutdown_connections 2023-07-27T14:31:08.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f7fff700 1 --2- 172.21.15.115:0/3936277822 >> v2:172.21.15.159:3300/0 conn(0x7f15f00a7750 0x7f15f00a7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f7fff700 1 --2- 172.21.15.115:0/3936277822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 0x7f15f01530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f7fff700 1 --2- 172.21.15.115:0/3936277822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067e50 0x7f15f00c2fa0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.742+0000 7f15f7fff700 1 -- 172.21.15.115:0/3936277822 >> 172.21.15.115:0/3936277822 conn(0x7f15f00c89a0 msgr2=0x7f15f00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.743+0000 7f15f7fff700 1 -- 172.21.15.115:0/3936277822 shutdown_connections 2023-07-27T14:31:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.743+0000 7f15f7fff700 1 -- 172.21.15.115:0/3936277822 wait complete. 2023-07-27T14:31:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.744+0000 7f15f7fff700 1 Processor -- start 2023-07-27T14:31:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.744+0000 7f15f7fff700 1 -- start start 2023-07-27T14:31:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.745+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15f0067e50 0x7f15f014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.745+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f00a7750 0x7f15f0164bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.745+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 0x7f15f0150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.745+0000 7f15f7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f014aac0 con 0x7f15f00a7750 2023-07-27T14:31:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.745+0000 7f15f7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00ac320 con 0x7f15f0067e50 2023-07-27T14:31:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.745+0000 7f15f7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00ab9f0 con 0x7f15f014c580 2023-07-27T14:31:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.745+0000 7f15f5d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15f0067e50 0x7f15f014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.745+0000 7f15f559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f00a7750 0x7f15f0164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f5d9b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15f0067e50 0x7f15f014a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:55710/0 (socket says 172.21.15.115:55710) 2023-07-27T14:31:08.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f5d9b700 1 -- 172.21.15.115:0/1925500574 learned_addr learned my addr 172.21.15.115:0/1925500574 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:08.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f659c700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 0x7f15f0150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f559a700 1 -- 172.21.15.115:0/1925500574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 msgr2=0x7f15f0150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f559a700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 0x7f15f0150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f559a700 1 -- 172.21.15.115:0/1925500574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15f0067e50 msgr2=0x7f15f014a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:08.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f559a700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15f0067e50 0x7f15f014a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:08.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f559a700 1 -- 172.21.15.115:0/1925500574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0009370 con 0x7f15f00a7750 2023-07-27T14:31:08.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f5d9b700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15f0067e50 0x7f15f014a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:08.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f559a700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f00a7750 0x7f15f0164bd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f15e0014000 tx=0x7f15e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:08.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15e5ffb700 1 -- 172.21.15.115:0/1925500574 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0006d90 con 0x7f15f00a7750 2023-07-27T14:31:08.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15e5ffb700 1 -- 172.21.15.115:0/1925500574 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000bec0 con 0x7f15f00a7750 2023-07-27T14:31:08.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15e5ffb700 1 -- 172.21.15.115:0/1925500574 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0024470 con 0x7f15f00a7750 2023-07-27T14:31:08.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.746+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f00abcd0 con 0x7f15f00a7750 2023-07-27T14:31:08.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.747+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f01650c0 con 0x7f15f00a7750 2023-07-27T14:31:08.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.747+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f006c470 con 0x7f15f00a7750 2023-07-27T14:31:08.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.748+0000 7f15e5ffb700 1 -- 172.21.15.115:0/1925500574 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f15e000f070 con 0x7f15f00a7750 2023-07-27T14:31:08.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.749+0000 7f15e5ffb700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f15d405f1c0 0x7f15d4061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:08.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.749+0000 7f15e5ffb700 1 -- 172.21.15.115:0/1925500574 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f15e007bc20 con 0x7f15f00a7750 2023-07-27T14:31:08.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.749+0000 7f15f5d9b700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f15d405f1c0 0x7f15d4061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:08.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.750+0000 7f15f5d9b700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f15d405f1c0 0x7f15d4061680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f15ec010250 tx=0x7f15ec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:08.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.753+0000 7f15e5ffb700 1 -- 172.21.15.115:0/1925500574 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15e004cf80 con 0x7f15f00a7750 2023-07-27T14:31:09.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:08.984+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) v1 -- 0x7f15f0068720 con 0x7f15f00a7750 2023-07-27T14:31:09.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.730+0000 7f15e5ffb700 1 -- 172.21.15.115:0/1925500574 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v227) v1 ==== 176+0+0 (secure 0 0 0) 0x7f15e0029070 con 0x7f15f00a7750 2023-07-27T14:31:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f15d405f1c0 msgr2=0x7f15d4061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f15d405f1c0 0x7f15d4061680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f15ec010250 tx=0x7f15ec008040).stop 2023-07-27T14:31:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f00a7750 msgr2=0x7f15f0164bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f00a7750 0x7f15f0164bd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f15e0014000 tx=0x7f15e0017000).stop 2023-07-27T14:31:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 shutdown_connections 2023-07-27T14:31:09.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f15d405f1c0 0x7f15d4061680 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15f014c580 0x7f15f0150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15f0067e50 0x7f15f014a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 --2- 172.21.15.115:0/1925500574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f00a7750 0x7f15f0164bd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 >> 172.21.15.115:0/1925500574 conn(0x7f15f00c89a0 msgr2=0x7f15f0065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:09.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 shutdown_connections 2023-07-27T14:31:09.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.733+0000 7f15f7fff700 1 -- 172.21.15.115:0/1925500574 wait complete. 2023-07-27T14:31:09.785 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:31:09.785 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:31:09.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete' 2023-07-27T14:31:09.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.946+0000 7f92299ff700 1 Processor -- start 2023-07-27T14:31:09.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.946+0000 7f92299ff700 1 -- start start 2023-07-27T14:31:09.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.947+0000 7f92299ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224151d70 0x7f9224155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:09.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.947+0000 7f92299ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9224065ff0 0x7f9224066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:09.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.947+0000 7f92299ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9224067080 con 0x7f9224066960 2023-07-27T14:31:09.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.947+0000 7f92299ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9224063a90 con 0x7f9224065ff0 2023-07-27T14:31:09.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.947+0000 7f92299ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9224068570 con 0x7f9224151d70 2023-07-27T14:31:09.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224151d70 0x7f9224155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:09.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224151d70 0x7f9224155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:32926/0 (socket says 172.21.15.115:32926) 2023-07-27T14:31:09.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9222ffd700 1 -- 172.21.15.115:0/164530836 learned_addr learned my addr 172.21.15.115:0/164530836 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:09.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f92227fc700 1 --2- 172.21.15.115:0/164530836 >> v2:172.21.15.159:3300/0 conn(0x7f9224065ff0 0x7f9224066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:09.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9222ffd700 1 -- 172.21.15.115:0/164530836 >> v2:172.21.15.159:3300/0 conn(0x7f9224065ff0 msgr2=0x7f9224066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:09.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9222ffd700 1 --2- 172.21.15.115:0/164530836 >> v2:172.21.15.159:3300/0 conn(0x7f9224065ff0 0x7f9224066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9222ffd700 1 -- 172.21.15.115:0/164530836 >> v1:172.21.15.159:6789/0 conn(0x7f9224066960 legacy=0x7f9224157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:09.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9221ffb700 1 -- 172.21.15.115:0/164530836 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659950045 0 0) 0x7f9224067080 con 0x7f9224066960 2023-07-27T14:31:09.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9222ffd700 1 -- 172.21.15.115:0/164530836 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9224066e10 con 0x7f9224151d70 2023-07-27T14:31:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.948+0000 7f9222ffd700 1 --2- 172.21.15.115:0/164530836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224151d70 0x7f9224155060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f9214006fd0 tx=0x7f92140090f0).ready entity=mon.2 client_cookie=4398f2544e385437 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:09.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f9221ffb700 1 -- 172.21.15.115:0/164530836 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921400b580 con 0x7f9224151d70 2023-07-27T14:31:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f9221ffb700 1 -- 172.21.15.115:0/164530836 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921400b6e0 con 0x7f9224151d70 2023-07-27T14:31:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f9221ffb700 1 -- 172.21.15.115:0/164530836 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921400ba60 con 0x7f9224151d70 2023-07-27T14:31:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f92299ff700 1 -- 172.21.15.115:0/164530836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224151d70 msgr2=0x7f9224155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:09.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f92299ff700 1 --2- 172.21.15.115:0/164530836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224151d70 0x7f9224155060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f9214006fd0 tx=0x7f92140090f0).stop 2023-07-27T14:31:09.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f92299ff700 1 -- 172.21.15.115:0/164530836 shutdown_connections 2023-07-27T14:31:09.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f92299ff700 1 --2- 172.21.15.115:0/164530836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224151d70 0x7f9224155060 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f92299ff700 1 --2- 172.21.15.115:0/164530836 >> v2:172.21.15.159:3300/0 conn(0x7f9224065ff0 0x7f9224066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f92299ff700 1 -- 172.21.15.115:0/164530836 >> 172.21.15.115:0/164530836 conn(0x7f92240c89a0 msgr2=0x7f92240c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:09.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f92299ff700 1 -- 172.21.15.115:0/164530836 shutdown_connections 2023-07-27T14:31:09.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.949+0000 7f92299ff700 1 -- 172.21.15.115:0/164530836 wait complete. 2023-07-27T14:31:09.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.951+0000 7f92299ff700 1 Processor -- start 2023-07-27T14:31:09.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.951+0000 7f92299ff700 1 -- start start 2023-07-27T14:31:09.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92299ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9224065ff0 0x7f92240aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:09.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92299ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224066960 0x7f92240a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:09.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92299ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9224151d70 0x7f92240c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:09.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92299ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92240c0d60 con 0x7f9224151d70 2023-07-27T14:31:09.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92299ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92240c0a10 con 0x7f9224065ff0 2023-07-27T14:31:09.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92299ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92240a8990 con 0x7f9224066960 2023-07-27T14:31:09.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92237fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9224151d70 0x7f92240c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:09.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92237fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9224151d70 0x7f92240c11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51374/0 (socket says 172.21.15.115:51374) 2023-07-27T14:31:09.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92237fe700 1 -- 172.21.15.115:0/1269576984 learned_addr learned my addr 172.21.15.115:0/1269576984 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:09.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f9222ffd700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9224065ff0 0x7f92240aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:09.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.952+0000 7f92227fc700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224066960 0x7f92240a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:09.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f92237fe700 1 -- 172.21.15.115:0/1269576984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224066960 msgr2=0x7f92240a8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:09.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f92237fe700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224066960 0x7f92240a8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f92237fe700 1 -- 172.21.15.115:0/1269576984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9224065ff0 msgr2=0x7f92240aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:09.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f92237fe700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9224065ff0 0x7f92240aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:09.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f92237fe700 1 -- 172.21.15.115:0/1269576984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214009370 con 0x7f9224151d70 2023-07-27T14:31:09.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f92237fe700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9224151d70 0x7f92240c11f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f921c002230 tx=0x7f921c007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:09.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f920affd700 1 -- 172.21.15.115:0/1269576984 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c010510 con 0x7f9224151d70 2023-07-27T14:31:09.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f920affd700 1 -- 172.21.15.115:0/1269576984 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c010670 con 0x7f9224151d70 2023-07-27T14:31:09.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f920affd700 1 -- 172.21.15.115:0/1269576984 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c010a10 con 0x7f9224151d70 2023-07-27T14:31:09.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92240a8c70 con 0x7f9224151d70 2023-07-27T14:31:09.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.953+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92240a8630 con 0x7f9224151d70 2023-07-27T14:31:09.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.954+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92240c0f10 con 0x7f9224151d70 2023-07-27T14:31:09.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.955+0000 7f920affd700 1 -- 172.21.15.115:0/1269576984 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f921c010070 con 0x7f9224151d70 2023-07-27T14:31:10.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.956+0000 7f920affd700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f921005f1f0 0x7f92100616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:10.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.956+0000 7f920affd700 1 -- 172.21.15.115:0/1269576984 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f921c079bd0 con 0x7f9224151d70 2023-07-27T14:31:10.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.956+0000 7f9222ffd700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f921005f1f0 0x7f92100616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:10.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.957+0000 7f9222ffd700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f921005f1f0 0x7f92100616b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f9214009130 tx=0x7f9214017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:10.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:09.960+0000 7f920affd700 1 -- 172.21.15.115:0/1269576984 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f92240c0f10 con 0x7f9224151d70 2023-07-27T14:31:10.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.194+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]} v 0) v1 -- 0x7f922406c470 con 0x7f9224151d70 2023-07-27T14:31:10.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.733+0000 7f920affd700 1 -- 172.21.15.115:0/1269576984 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]}]=0 v228) v1 ==== 190+0+0 (secure 0 0 0) 0x7f921c04af30 con 0x7f9224151d70 2023-07-27T14:31:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f921005f1f0 msgr2=0x7f92100616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f921005f1f0 0x7f92100616b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f9214009130 tx=0x7f9214017000).stop 2023-07-27T14:31:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9224151d70 msgr2=0x7f92240c11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9224151d70 0x7f92240c11f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f921c002230 tx=0x7f921c007f70).stop 2023-07-27T14:31:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 shutdown_connections 2023-07-27T14:31:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f921005f1f0 0x7f92100616b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9224151d70 0x7f92240c11f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9224065ff0 0x7f92240aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 --2- 172.21.15.115:0/1269576984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9224066960 0x7f92240a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 >> 172.21.15.115:0/1269576984 conn(0x7f92240c89a0 msgr2=0x7f92240c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:10.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.735+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 shutdown_connections 2023-07-27T14:31:10.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.736+0000 7f92299ff700 1 -- 172.21.15.115:0/1269576984 wait complete. 2023-07-27T14:31:10.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:31:10.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.947+0000 7f83265ff700 1 Processor -- start 2023-07-27T14:31:10.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.947+0000 7f83265ff700 1 -- start start 2023-07-27T14:31:10.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.948+0000 7f83265ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8320153e00 0x7f83200c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:10.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.948+0000 7f83265ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320065de0 0x7f8320062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:10.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.948+0000 7f83265ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8320064a80 con 0x7f8320064230 2023-07-27T14:31:10.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.948+0000 7f83265ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8320062320 con 0x7f8320153e00 2023-07-27T14:31:10.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.948+0000 7f83265ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8320064d60 con 0x7f8320065de0 2023-07-27T14:31:10.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8320153e00 0x7f83200c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:10.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8320153e00 0x7f83200c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51386/0 (socket says 172.21.15.115:51386) 2023-07-27T14:31:10.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831ffff700 1 -- 172.21.15.115:0/1352282485 learned_addr learned my addr 172.21.15.115:0/1352282485 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:10.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f8324b9c700 1 --2- 172.21.15.115:0/1352282485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320065de0 0x7f8320062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:10.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831ffff700 1 -- 172.21.15.115:0/1352282485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320065de0 msgr2=0x7f8320062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:10.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831ffff700 1 --2- 172.21.15.115:0/1352282485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320065de0 0x7f8320062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831ffff700 1 -- 172.21.15.115:0/1352282485 >> v1:172.21.15.115:6789/0 conn(0x7f8320064230 legacy=0x7f83200656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:10.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831ffff700 1 -- 172.21.15.115:0/1352282485 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320065040 con 0x7f8320153e00 2023-07-27T14:31:10.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831effd700 1 -- 172.21.15.115:0/1352282485 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534505875 0 0) 0x7f8320064a80 con 0x7f8320064230 2023-07-27T14:31:10.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831ffff700 1 --2- 172.21.15.115:0/1352282485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320153e00 0x7f83200c6b70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f8310006fd0 tx=0x7f83100090f0).ready entity=mon.0 client_cookie=5289ccf7dfb982f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:10.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.949+0000 7f831effd700 1 -- 172.21.15.115:0/1352282485 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000b600 con 0x7f8320153e00 2023-07-27T14:31:10.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f831effd700 1 -- 172.21.15.115:0/1352282485 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000b760 con 0x7f8320153e00 2023-07-27T14:31:10.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f831effd700 1 -- 172.21.15.115:0/1352282485 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000bae0 con 0x7f8320153e00 2023-07-27T14:31:10.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f83265ff700 1 -- 172.21.15.115:0/1352282485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320153e00 msgr2=0x7f83200c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:10.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f83265ff700 1 --2- 172.21.15.115:0/1352282485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320153e00 0x7f83200c6b70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f8310006fd0 tx=0x7f83100090f0).stop 2023-07-27T14:31:10.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f83265ff700 1 -- 172.21.15.115:0/1352282485 shutdown_connections 2023-07-27T14:31:10.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f83265ff700 1 --2- 172.21.15.115:0/1352282485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320065de0 0x7f8320062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f83265ff700 1 --2- 172.21.15.115:0/1352282485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320153e00 0x7f83200c6b70 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f83265ff700 1 -- 172.21.15.115:0/1352282485 >> 172.21.15.115:0/1352282485 conn(0x7f83200c7b90 msgr2=0x7f83200c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:10.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f83265ff700 1 -- 172.21.15.115:0/1352282485 shutdown_connections 2023-07-27T14:31:10.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.950+0000 7f83265ff700 1 -- 172.21.15.115:0/1352282485 wait complete. 2023-07-27T14:31:10.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.952+0000 7f83265ff700 1 Processor -- start 2023-07-27T14:31:10.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.952+0000 7f83265ff700 1 -- start start 2023-07-27T14:31:10.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.952+0000 7f83265ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320064230 0x7f8320069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:10.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f83265ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320065de0 0x7f83200a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:10.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f83265ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320153e00 0x7f83200a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:10.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f83265ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200a9460 con 0x7f8320064230 2023-07-27T14:31:10.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f83265ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200a8850 con 0x7f8320065de0 2023-07-27T14:31:10.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f83265ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200a8b30 con 0x7f8320153e00 2023-07-27T14:31:10.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320064230 0x7f8320069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:10.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320064230 0x7f8320069900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51396/0 (socket says 172.21.15.115:51396) 2023-07-27T14:31:10.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 -- 172.21.15.115:0/4196732815 learned_addr learned my addr 172.21.15.115:0/4196732815 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:10.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 -- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320153e00 msgr2=0x7f83200a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:10.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831f7fe700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320065de0 0x7f83200a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:10.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f8324b9c700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320153e00 0x7f83200a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:10.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320153e00 0x7f83200a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 -- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320065de0 msgr2=0x7f83200a7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:10.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320065de0 0x7f83200a7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:10.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 -- 172.21.15.115:0/4196732815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009370 con 0x7f8320064230 2023-07-27T14:31:10.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831f7fe700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320065de0 0x7f83200a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:10.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f8324b9c700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320153e00 0x7f83200a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:10.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.953+0000 7f831ffff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320064230 0x7f8320069900 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f83200680d0 tx=0x7f8310017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:10.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.954+0000 7f8307fff700 1 -- 172.21.15.115:0/4196732815 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000b8d0 con 0x7f8320064230 2023-07-27T14:31:10.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.954+0000 7f8307fff700 1 -- 172.21.15.115:0/4196732815 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000ba30 con 0x7f8320064230 2023-07-27T14:31:10.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.954+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83200a8e10 con 0x7f8320064230 2023-07-27T14:31:10.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.954+0000 7f8307fff700 1 -- 172.21.15.115:0/4196732815 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831001c670 con 0x7f8320064230 2023-07-27T14:31:10.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.954+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8320094330 con 0x7f8320064230 2023-07-27T14:31:10.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.955+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83200a9740 con 0x7f8320064230 2023-07-27T14:31:10.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.956+0000 7f8307fff700 1 -- 172.21.15.115:0/4196732815 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f831000f070 con 0x7f8320064230 2023-07-27T14:31:10.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.957+0000 7f8307fff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f830c05f1c0 0x7f830c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:10.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.957+0000 7f8307fff700 1 -- 172.21.15.115:0/4196732815 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f831007b630 con 0x7f8320064230 2023-07-27T14:31:10.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.957+0000 7f831f7fe700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f830c05f1c0 0x7f830c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:10.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.958+0000 7f831f7fe700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f830c05f1c0 0x7f830c061680 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f83140011e0 tx=0x7f8314009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:10.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:10.961+0000 7f8307fff700 1 -- 172.21.15.115:0/4196732815 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f831004caa0 con 0x7f8320064230 2023-07-27T14:31:11.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.129+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f83200a92b0 con 0x7f8320064230 2023-07-27T14:31:11.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.135+0000 7f8307fff700 1 -- 172.21.15.115:0/4196732815 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8310020070 con 0x7f8320064230 2023-07-27T14:31:11.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f830c05f1c0 msgr2=0x7f830c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:11.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f830c05f1c0 0x7f830c061680 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f83140011e0 tx=0x7f8314009040).stop 2023-07-27T14:31:11.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320064230 msgr2=0x7f8320069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:11.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320064230 0x7f8320069900 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f83200680d0 tx=0x7f8310017000).stop 2023-07-27T14:31:11.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 shutdown_connections 2023-07-27T14:31:11.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f830c05f1c0 0x7f830c061680 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8320153e00 0x7f83200a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320064230 0x7f8320069900 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 --2- 172.21.15.115:0/4196732815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320065de0 0x7f83200a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 >> 172.21.15.115:0/4196732815 conn(0x7f83200c7b90 msgr2=0x7f83200c6490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:11.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.137+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 shutdown_connections 2023-07-27T14:31:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.138+0000 7f83265ff700 1 -- 172.21.15.115:0/4196732815 wait complete. 2023-07-27T14:31:11.186 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:31:11.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:31:11.296 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:31:11.407 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:31:11.408 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:31:11.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:31:11.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.566+0000 7f9473dff700 1 Processor -- start 2023-07-27T14:31:11.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.566+0000 7f9473dff700 1 -- start start 2023-07-27T14:31:11.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.567+0000 7f9473dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:11.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.567+0000 7f9473dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f946c0aa050 0x7f946c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:11.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.567+0000 7f9473dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946c0aa4d0 con 0x7f946c0aaa40 2023-07-27T14:31:11.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.567+0000 7f9473dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c0c05c0 con 0x7f946c0aa050 2023-07-27T14:31:11.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.567+0000 7f9473dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0c1a60 con 0x7f946c153ec0 2023-07-27T14:31:11.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f9471b9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:11.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f947239c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f946c0aaa40 0x7f946c157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:43080/0 (socket says 172.21.15.115:43080) 2023-07-27T14:31:11.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f947239c700 1 -- 172.21.15.115:0/1686187781 learned_addr learned my addr 172.21.15.115:0/1686187781 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:11.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f947139a700 1 --2- 172.21.15.115:0/1686187781 >> v2:172.21.15.159:3300/0 conn(0x7f946c0aa050 0x7f946c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:11.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f9470b99700 1 -- 172.21.15.115:0/1686187781 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884163408 0 0) 0x7f9464001490 con 0x7f946c0aaa40 2023-07-27T14:31:11.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f9470b99700 1 -- 172.21.15.115:0/1686187781 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94580033f0 con 0x7f946c0aaa40 2023-07-27T14:31:11.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f9471b9b700 1 -- 172.21.15.115:0/1686187781 >> v2:172.21.15.159:3300/0 conn(0x7f946c0aa050 msgr2=0x7f946c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:11.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f9471b9b700 1 --2- 172.21.15.115:0/1686187781 >> v2:172.21.15.159:3300/0 conn(0x7f946c0aa050 0x7f946c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f9471b9b700 1 -- 172.21.15.115:0/1686187781 >> v1:172.21.15.159:6789/0 conn(0x7f946c0aaa40 legacy=0x7f946c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:11.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f9471b9b700 1 -- 172.21.15.115:0/1686187781 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c0bfc90 con 0x7f946c153ec0 2023-07-27T14:31:11.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f947139a700 1 --2- 172.21.15.115:0/1686187781 >> v2:172.21.15.159:3300/0 conn(0x7f946c0aa050 0x7f946c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:11.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.568+0000 7f9471b9b700 1 --2- 172.21.15.115:0/1686187781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c0a9b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9468009760 tx=0x7f9468009060).ready entity=mon.2 client_cookie=7ba82425491b6a6d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:11.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9470b99700 1 -- 172.21.15.115:0/1686187781 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946800d4a0 con 0x7f946c153ec0 2023-07-27T14:31:11.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9470b99700 1 -- 172.21.15.115:0/1686187781 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946800d600 con 0x7f946c153ec0 2023-07-27T14:31:11.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9470b99700 1 -- 172.21.15.115:0/1686187781 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946800d980 con 0x7f946c153ec0 2023-07-27T14:31:11.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9473dff700 1 -- 172.21.15.115:0/1686187781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 msgr2=0x7f946c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:11.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9473dff700 1 --2- 172.21.15.115:0/1686187781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c0a9b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9468009760 tx=0x7f9468009060).stop 2023-07-27T14:31:11.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9473dff700 1 -- 172.21.15.115:0/1686187781 shutdown_connections 2023-07-27T14:31:11.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9473dff700 1 --2- 172.21.15.115:0/1686187781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c0a9b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9473dff700 1 --2- 172.21.15.115:0/1686187781 >> v2:172.21.15.159:3300/0 conn(0x7f946c0aa050 0x7f946c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9473dff700 1 -- 172.21.15.115:0/1686187781 >> 172.21.15.115:0/1686187781 conn(0x7f946c0cb610 msgr2=0x7f946c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:11.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9473dff700 1 -- 172.21.15.115:0/1686187781 shutdown_connections 2023-07-27T14:31:11.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.569+0000 7f9473dff700 1 -- 172.21.15.115:0/1686187781 wait complete. 2023-07-27T14:31:11.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.571+0000 7f9473dff700 1 Processor -- start 2023-07-27T14:31:11.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.571+0000 7f9473dff700 1 -- start start 2023-07-27T14:31:11.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f9473dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0aa050 0x7f946c164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:11.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f9473dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f946c0aaa40 0x7f946c1684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:11.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f9473dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:11.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f9473dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0c3840 con 0x7f946c0aaa40 2023-07-27T14:31:11.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f9473dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c151760 con 0x7f946c0aa050 2023-07-27T14:31:11.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f9473dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0c2f10 con 0x7f946c153ec0 2023-07-27T14:31:11.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f947139a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f946c0aaa40 0x7f946c1684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:11.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f947139a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f946c0aaa40 0x7f946c1684e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51412/0 (socket says 172.21.15.115:51412) 2023-07-27T14:31:11.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f947139a700 1 -- 172.21.15.115:0/2597925418 learned_addr learned my addr 172.21.15.115:0/2597925418 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:11.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f9471b9b700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0aa050 0x7f946c164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:11.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.572+0000 7f947239c700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:11.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f947139a700 1 -- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 msgr2=0x7f946c1689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:11.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f947139a700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c1689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f947139a700 1 -- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0aa050 msgr2=0x7f946c164870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:11.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f947139a700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0aa050 0x7f946c164870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f947139a700 1 -- 172.21.15.115:0/2597925418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0092a0 con 0x7f946c0aaa40 2023-07-27T14:31:11.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f9471b9b700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0aa050 0x7f946c164870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:11.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f947139a700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f946c0aaa40 0x7f946c1684e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f945c00e980 tx=0x7f945c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:11.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f9461ffb700 1 -- 172.21.15.115:0/2597925418 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c012600 con 0x7f946c0aaa40 2023-07-27T14:31:11.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f9461ffb700 1 -- 172.21.15.115:0/2597925418 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c012760 con 0x7f946c0aaa40 2023-07-27T14:31:11.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94680092a0 con 0x7f946c0aaa40 2023-07-27T14:31:11.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f9461ffb700 1 -- 172.21.15.115:0/2597925418 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c012ae0 con 0x7f946c0aaa40 2023-07-27T14:31:11.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.573+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c0c34d0 con 0x7f946c0aaa40 2023-07-27T14:31:11.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.574+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c0c39b0 con 0x7f946c0aaa40 2023-07-27T14:31:11.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.575+0000 7f9461ffb700 1 -- 172.21.15.115:0/2597925418 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f945c022070 con 0x7f946c0aaa40 2023-07-27T14:31:11.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.576+0000 7f9461ffb700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f945005f190 0x7f9450061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:11.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.576+0000 7f9461ffb700 1 -- 172.21.15.115:0/2597925418 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f945c07a150 con 0x7f946c0aaa40 2023-07-27T14:31:11.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.576+0000 7f9471b9b700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f945005f190 0x7f9450061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:11.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.576+0000 7f9471b9b700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f945005f190 0x7f9450061650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f9468009760 tx=0x7f9468016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:11.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.580+0000 7f9461ffb700 1 -- 172.21.15.115:0/2597925418 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f945c04b5c0 con 0x7f946c0aaa40 2023-07-27T14:31:11.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.795+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f946c0bff70 con 0x7f946c0aaa40 2023-07-27T14:31:11.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.796+0000 7f9461ffb700 1 -- 172.21.15.115:0/2597925418 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f945c016090 con 0x7f946c0aaa40 2023-07-27T14:31:11.828 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:11.828 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1689103707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1689103707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1689103707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/2448381398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2448381398},{"type":"v1","addr":"172.21.15.159:6834","nonce":2448381398}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3512171796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3512171796},{"type":"v1","addr":"172.21.15.159:6835","nonce":3512171796}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/4255335952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4255335952},{"type":"v1","addr":"172.21.15.115:6836","nonce":4255335952}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-07-27T14:31:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f945005f190 msgr2=0x7f9450061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f945005f190 0x7f9450061650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f9468009760 tx=0x7f9468016000).stop 2023-07-27T14:31:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f946c0aaa40 msgr2=0x7f946c1684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f946c0aaa40 0x7f946c1684e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f945c00e980 tx=0x7f945c009060).stop 2023-07-27T14:31:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 shutdown_connections 2023-07-27T14:31:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f945005f190 0x7f9450061650 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f946c153ec0 0x7f946c1689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f946c0aa050 0x7f946c164870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 --2- 172.21.15.115:0/2597925418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f946c0aaa40 0x7f946c1684e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.798+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 >> 172.21.15.115:0/2597925418 conn(0x7f946c0cb610 msgr2=0x7f946c0acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.799+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 shutdown_connections 2023-07-27T14:31:11.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:11.799+0000 7f9473dff700 1 -- 172.21.15.115:0/2597925418 wait complete. 2023-07-27T14:31:11.832 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 36 2023-07-27T14:31:11.849 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:31:11.849 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:31:11.850 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:31:11.850 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:31:11.851 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:31:11.851 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:31:11.851 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:31:11.852 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:31:11.852 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:31:11.852 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:31:11.853 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:31:11.853 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:31:11.853 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:31:11.853 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:31:11.854 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:31:11.854 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:31:11.863 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:31:11.864 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:31:11.866 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:31:11.867 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:31:11.869 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:31:11.870 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:31:11.871 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:31:11.871 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:31:11.909 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:31:11.910 DEBUG:teuthology.parallel:result is None 2023-07-27T14:31:11.913 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:31:11.913 DEBUG:teuthology.parallel:result is None 2023-07-27T14:31:11.914 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:31:11.915 DEBUG:teuthology.parallel:result is None 2023-07-27T14:31:11.917 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:31:11.917 DEBUG:teuthology.parallel:result is None 2023-07-27T14:31:11.918 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:31:12.052 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:31:12.054 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:31:12.063 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:31:12.063 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:31:12.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.086+0000 7fb3a5fff700 1 Processor -- start 2023-07-27T14:31:12.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.086+0000 7fb3a5fff700 1 -- start start 2023-07-27T14:31:12.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.087+0000 7fb3a5fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3a0151d70 0x7fb3a0155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:12.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.087+0000 7fb3a5fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb3a0066b80 0x7fb3a0067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:12.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.087+0000 7fb3a5fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a0067080 con 0x7fb3a0065ff0 2023-07-27T14:31:12.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.087+0000 7fb3a5fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a0063a90 con 0x7fb3a0151d70 2023-07-27T14:31:12.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.087+0000 7fb3a5fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a00634d0 con 0x7fb3a0066b80 2023-07-27T14:31:12.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3a0151d70 0x7fb3a0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:12.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3a0151d70 0x7fb3a0155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51472/0 (socket says 172.21.15.115:51472) 2023-07-27T14:31:12.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39f7fe700 1 -- 172.21.15.115:0/976821384 learned_addr learned my addr 172.21.15.115:0/976821384 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:12.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39ffff700 1 --2- 172.21.15.115:0/976821384 >> v2:172.21.15.159:3300/0 conn(0x7fb3a0066b80 0x7fb3a0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:12.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39f7fe700 1 -- 172.21.15.115:0/976821384 >> v2:172.21.15.159:3300/0 conn(0x7fb3a0066b80 msgr2=0x7fb3a0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:12.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39f7fe700 1 --2- 172.21.15.115:0/976821384 >> v2:172.21.15.159:3300/0 conn(0x7fb3a0066b80 0x7fb3a0067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:12.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39f7fe700 1 -- 172.21.15.115:0/976821384 >> v1:172.21.15.159:6789/0 conn(0x7fb3a0065ff0 legacy=0x7fb3a0066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:12.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39f7fe700 1 -- 172.21.15.115:0/976821384 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a00637b0 con 0x7fb3a0151d70 2023-07-27T14:31:12.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39f7fe700 1 --2- 172.21.15.115:0/976821384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a0155060 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fb3a0069ae0 tx=0x7fb3900090f0).ready entity=mon.0 client_cookie=ec1f94a56a356cae server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:12.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.088+0000 7fb39e7fc700 1 -- 172.21.15.115:0/976821384 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39000b600 con 0x7fb3a0151d70 2023-07-27T14:31:12.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb39e7fc700 1 -- 172.21.15.115:0/976821384 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39000b760 con 0x7fb3a0151d70 2023-07-27T14:31:12.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb39e7fc700 1 -- 172.21.15.115:0/976821384 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39000bae0 con 0x7fb3a0151d70 2023-07-27T14:31:12.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb3a5fff700 1 -- 172.21.15.115:0/976821384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 msgr2=0x7fb3a0155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:12.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/976821384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a0155060 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fb3a0069ae0 tx=0x7fb3900090f0).stop 2023-07-27T14:31:12.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb3a5fff700 1 -- 172.21.15.115:0/976821384 shutdown_connections 2023-07-27T14:31:12.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/976821384 >> v2:172.21.15.159:3300/0 conn(0x7fb3a0066b80 0x7fb3a0067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:12.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/976821384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a0155060 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:12.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb3a5fff700 1 -- 172.21.15.115:0/976821384 >> 172.21.15.115:0/976821384 conn(0x7fb3a00c89a0 msgr2=0x7fb3a00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:12.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb3a5fff700 1 -- 172.21.15.115:0/976821384 shutdown_connections 2023-07-27T14:31:12.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.089+0000 7fb3a5fff700 1 -- 172.21.15.115:0/976821384 wait complete. 2023-07-27T14:31:12.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.091+0000 7fb3a5fff700 1 Processor -- start 2023-07-27T14:31:12.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.091+0000 7fb3a5fff700 1 -- start start 2023-07-27T14:31:12.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb3a5fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a0065ff0 0x7fb3a014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:12.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb3a5fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3a0066b80 0x7fb3a00a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:12.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb3a5fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a00ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:12.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb3a5fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a00a6920 con 0x7fb3a0151d70 2023-07-27T14:31:12.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb3a5fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a00a4f30 con 0x7fb3a0065ff0 2023-07-27T14:31:12.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb3a5fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a014d4f0 con 0x7fb3a0066b80 2023-07-27T14:31:12.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a00ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:12.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39f7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a0065ff0 0x7fb3a014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:12.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a00ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51488/0 (socket says 172.21.15.115:51488) 2023-07-27T14:31:12.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39f7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a0065ff0 0x7fb3a014d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:55792/0 (socket says 172.21.15.115:55792) 2023-07-27T14:31:12.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39ffff700 1 -- 172.21.15.115:0/2304481090 learned_addr learned my addr 172.21.15.115:0/2304481090 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:12.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39effd700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3a0066b80 0x7fb3a00a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:12.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39ffff700 1 -- 172.21.15.115:0/2304481090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3a0066b80 msgr2=0x7fb3a00a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:12.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39ffff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3a0066b80 0x7fb3a00a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:12.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39ffff700 1 -- 172.21.15.115:0/2304481090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a0065ff0 msgr2=0x7fb3a014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:12.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39ffff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a0065ff0 0x7fb3a014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:12.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39ffff700 1 -- 172.21.15.115:0/2304481090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390009370 con 0x7fb3a0151d70 2023-07-27T14:31:12.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.093+0000 7fb39f7fe700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a0065ff0 0x7fb3a014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:12.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.094+0000 7fb39ffff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a00ad0c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fb398007f50 tx=0x7fb3980098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:12.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.094+0000 7fb3877fe700 1 -- 172.21.15.115:0/2304481090 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39800eb70 con 0x7fb3a0151d70 2023-07-27T14:31:12.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.094+0000 7fb3877fe700 1 -- 172.21.15.115:0/2304481090 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39800ecd0 con 0x7fb3a0151d70 2023-07-27T14:31:12.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.094+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a00c2490 con 0x7fb3a0151d70 2023-07-27T14:31:12.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.094+0000 7fb3877fe700 1 -- 172.21.15.115:0/2304481090 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398014610 con 0x7fb3a0151d70 2023-07-27T14:31:12.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.094+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a00a4bc0 con 0x7fb3a0151d70 2023-07-27T14:31:12.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.095+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a00a50c0 con 0x7fb3a0151d70 2023-07-27T14:31:12.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.096+0000 7fb3877fe700 1 -- 172.21.15.115:0/2304481090 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fb39801b030 con 0x7fb3a0151d70 2023-07-27T14:31:12.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.097+0000 7fb3877fe700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb38c05f1c0 0x7fb38c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:12.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.097+0000 7fb3877fe700 1 -- 172.21.15.115:0/2304481090 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fb39807a1a0 con 0x7fb3a0151d70 2023-07-27T14:31:12.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.097+0000 7fb39f7fe700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb38c05f1c0 0x7fb38c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:12.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.098+0000 7fb39f7fe700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb38c05f1c0 0x7fb38c061680 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fb390009130 tx=0x7fb390017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:12.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.101+0000 7fb3877fe700 1 -- 172.21.15.115:0/2304481090 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb39804b610 con 0x7fb3a0151d70 2023-07-27T14:31:12.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:12.290+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb3a006c470 con 0x7fb3a0151d70 2023-07-27T14:31:13.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.140+0000 7fb3877fe700 1 -- 172.21.15.115:0/2304481090 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb39804ec30 con 0x7fb3a0151d70 2023-07-27T14:31:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.142+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb38c05f1c0 msgr2=0x7fb38c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.142+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb38c05f1c0 0x7fb38c061680 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fb390009130 tx=0x7fb390017000).stop 2023-07-27T14:31:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.142+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 msgr2=0x7fb3a00ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.142+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a00ad0c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fb398007f50 tx=0x7fb3980098a0).stop 2023-07-27T14:31:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.143+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 shutdown_connections 2023-07-27T14:31:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.143+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb38c05f1c0 0x7fb38c061680 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.143+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3a0151d70 0x7fb3a00ad0c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.143+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a0065ff0 0x7fb3a014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.143+0000 7fb3a5fff700 1 --2- 172.21.15.115:0/2304481090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3a0066b80 0x7fb3a00a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.143+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 >> 172.21.15.115:0/2304481090 conn(0x7fb3a00c89a0 msgr2=0x7fb3a00c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:13.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.143+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 shutdown_connections 2023-07-27T14:31:13.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.143+0000 7fb3a5fff700 1 -- 172.21.15.115:0/2304481090 wait complete. 2023-07-27T14:31:13.176 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:31:13.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:31:13.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.353+0000 7f2fb47ff700 1 Processor -- start 2023-07-27T14:31:13.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.353+0000 7f2fb47ff700 1 -- start start 2023-07-27T14:31:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.354+0000 7f2fb47ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2fac0aaa40 0x7f2fac0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.354+0000 7f2fb47ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac1542a0 0x7f2fac0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.354+0000 7f2fb47ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fac0aa4d0 con 0x7f2fac153ec0 2023-07-27T14:31:13.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.354+0000 7f2fb47ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fac064ad0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.354+0000 7f2fb47ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0c05c0 con 0x7f2fac1542a0 2023-07-27T14:31:13.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1d9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2fac0aaa40 0x7f2fac0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1d9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2fac0aaa40 0x7f2fac0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51496/0 (socket says 172.21.15.115:51496) 2023-07-27T14:31:13.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1d9a700 1 -- 172.21.15.115:0/3270451197 learned_addr learned my addr 172.21.15.115:0/3270451197 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:13.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb259b700 1 --1- 172.21.15.115:0/3270451197 >> v1:172.21.15.115:6789/0 conn(0x7f2fac153ec0 0x7f2fac0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43594/0 (socket says 172.21.15.115:43594) 2023-07-27T14:31:13.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb2d9c700 1 --2- 172.21.15.115:0/3270451197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac1542a0 0x7f2fac0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1d9a700 1 -- 172.21.15.115:0/3270451197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac1542a0 msgr2=0x7f2fac0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:13.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1d9a700 1 --2- 172.21.15.115:0/3270451197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac1542a0 0x7f2fac0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1d9a700 1 -- 172.21.15.115:0/3270451197 >> v1:172.21.15.115:6789/0 conn(0x7f2fac153ec0 legacy=0x7f2fac0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1599700 1 -- 172.21.15.115:0/3270451197 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208815594 0 0) 0x7f2fa8001110 con 0x7f2fac153ec0 2023-07-27T14:31:13.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1d9a700 1 -- 172.21.15.115:0/3270451197 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0c1a60 con 0x7f2fac0aaa40 2023-07-27T14:31:13.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb2d9c700 1 --2- 172.21.15.115:0/3270451197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac1542a0 0x7f2fac0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:13.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1d9a700 1 --2- 172.21.15.115:0/3270451197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac0640f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f2f9c006fd0 tx=0x7f2f9c0090f0).ready entity=mon.0 client_cookie=f5a5c677567e5327 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:13.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.355+0000 7f2fb1599700 1 -- 172.21.15.115:0/3270451197 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00b600 con 0x7f2fac0aaa40 2023-07-27T14:31:13.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb1599700 1 -- 172.21.15.115:0/3270451197 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c00b760 con 0x7f2fac0aaa40 2023-07-27T14:31:13.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb1599700 1 -- 172.21.15.115:0/3270451197 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00bae0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb47ff700 1 -- 172.21.15.115:0/3270451197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 msgr2=0x7f2fac0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/3270451197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac0640f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f2f9c006fd0 tx=0x7f2f9c0090f0).stop 2023-07-27T14:31:13.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb47ff700 1 -- 172.21.15.115:0/3270451197 shutdown_connections 2023-07-27T14:31:13.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/3270451197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac1542a0 0x7f2fac0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/3270451197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac0640f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb47ff700 1 -- 172.21.15.115:0/3270451197 >> 172.21.15.115:0/3270451197 conn(0x7f2fac0cb610 msgr2=0x7f2fac0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:13.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb47ff700 1 -- 172.21.15.115:0/3270451197 shutdown_connections 2023-07-27T14:31:13.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.356+0000 7f2fb47ff700 1 -- 172.21.15.115:0/3270451197 wait complete. 2023-07-27T14:31:13.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.358+0000 7f2fb47ff700 1 Processor -- start 2023-07-27T14:31:13.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.358+0000 7f2fb47ff700 1 -- start start 2023-07-27T14:31:13.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb47ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb47ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac153ec0 0x7f2fac0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb47ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac1542a0 0x7f2fac0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb47ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac14fef0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb47ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac164f30 con 0x7f2fac1542a0 2023-07-27T14:31:13.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb47ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac150140 con 0x7f2fac153ec0 2023-07-27T14:31:13.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac14ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51498/0 (socket says 172.21.15.115:51498) 2023-07-27T14:31:13.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 -- 172.21.15.115:0/2979578823 learned_addr learned my addr 172.21.15.115:0/2979578823 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:13.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 -- 172.21.15.115:0/2979578823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac153ec0 msgr2=0x7f2fac0c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac153ec0 0x7f2fac0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:13.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 -- 172.21.15.115:0/2979578823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac1542a0 msgr2=0x7f2fac0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac1542a0 0x7f2fac0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:13.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 -- 172.21.15.115:0/2979578823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c009370 con 0x7f2fac0aaa40 2023-07-27T14:31:13.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.359+0000 7f2fb259b700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac14ddd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f2fa800c510 tx=0x7f2fa8007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:13.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.360+0000 7f2fa27fc700 1 -- 172.21.15.115:0/2979578823 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80072e0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.360+0000 7f2fa27fc700 1 -- 172.21.15.115:0/2979578823 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa8007440 con 0x7f2fac0aaa40 2023-07-27T14:31:13.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.360+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac150420 con 0x7f2fac0aaa40 2023-07-27T14:31:13.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.360+0000 7f2fa27fc700 1 -- 172.21.15.115:0/2979578823 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80058f0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.360+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac14e2c0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.361+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fac150940 con 0x7f2fac0aaa40 2023-07-27T14:31:13.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.361+0000 7f2fa27fc700 1 -- 172.21.15.115:0/2979578823 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f2fa8010070 con 0x7f2fac0aaa40 2023-07-27T14:31:13.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.362+0000 7f2fa27fc700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9005f1c0 0x7f2f90061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.362+0000 7f2fa27fc700 1 -- 172.21.15.115:0/2979578823 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2fa80794d0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.362+0000 7f2fb1d9a700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9005f1c0 0x7f2f90061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.363+0000 7f2fb1d9a700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9005f1c0 0x7f2f90061680 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f2fac0aae20 tx=0x7f2f9c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:13.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.366+0000 7f2fa27fc700 1 -- 172.21.15.115:0/2979578823 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2fac150940 con 0x7f2fac0aaa40 2023-07-27T14:31:13.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.603+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2fac0aa4d0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.603+0000 7f2fa27fc700 1 -- 172.21.15.115:0/2979578823 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2fac0aa4d0 con 0x7f2fac0aaa40 2023-07-27T14:31:13.635 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:13.636 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:13.636 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:31:13.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.636 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:31:13.636 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:31:13.636 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.636 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:31:13.637 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:31:13.637 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:31:13.637 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.637 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.637 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:31:13.638 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:31:13.638 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.638 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:31:13.638 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:31:13.638 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:31:13.639 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.639 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.640 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:31:13.640 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:31:13.640 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.640 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:31:13.640 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:31:13.640 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:31:13.640 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.641 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:31:13.641 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:31:13.641 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.641 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:31:13.641 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:31:13.642 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:31:13.642 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.642 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.642 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:31:13.642 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:31:13.643 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.643 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:31:13.643 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:31:13.643 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.643 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.643 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:31:13.644 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:31:13.644 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.644 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:31:13.644 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:31:13.644 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.645 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:31:13.645 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:31:13.645 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.645 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:31:13.645 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:31:13.645 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.646 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:31:13.646 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:31:13.646 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.646 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:31:13.646 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:31:13.647 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.647 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:31:13.647 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:31:13.647 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.647 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:31:13.648 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:31:13.648 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.648 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.648 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:31:13.648 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:31:13.649 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.649 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:31:13.650 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:31:13.650 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.650 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.651 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:31:13.651 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:31:13.651 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.651 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:31:13.652 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:31:13.652 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.652 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:31:13.653 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:31:13.653 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.653 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:31:13.653 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:31:13.653 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.653 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.654 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:31:13.654 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:31:13.654 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.654 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:31:13.654 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:31:13.654 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:31:13.655 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.655 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:31:13.655 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:31:13.655 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.655 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:31:13.655 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:31:13.656 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:31:13.656 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:31:13.656 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.656 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:31:13.657 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:31:13.657 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.657 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:31:13.657 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:31:13.657 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:31:13.657 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:31:13.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.658 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:31:13.658 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:31:13.658 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.658 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:31:13.658 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:31:13.659 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:31:13.659 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:31:13.659 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.659 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:31:13.659 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:31:13.659 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:31:13.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:31:13.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:31:13.660 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.660 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.661 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:31:13.661 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:31:13.661 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.661 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:31:13.661 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:31:13.662 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.662 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:13.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:13.662 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:31:13.662 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:31:13.662 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:31:13.663 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:31:13.663 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:31:13.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:31:13.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:13.663 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:31:13.664 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:13.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9005f1c0 msgr2=0x7f2f90061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9005f1c0 0x7f2f90061680 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f2fac0aae20 tx=0x7f2f9c017000).stop 2023-07-27T14:31:13.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 msgr2=0x7f2fac14ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac14ddd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f2fa800c510 tx=0x7f2fa8007ad0).stop 2023-07-27T14:31:13.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 shutdown_connections 2023-07-27T14:31:13.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f9005f1c0 0x7f2f90061680 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fac1542a0 0x7f2fac0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:13.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fac0aaa40 0x7f2fac14ddd0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 --2- 172.21.15.115:0/2979578823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fac153ec0 0x7f2fac0c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:13.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 >> 172.21.15.115:0/2979578823 conn(0x7f2fac0cb610 msgr2=0x7f2fac0ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:13.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 shutdown_connections 2023-07-27T14:31:13.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.606+0000 7f2fb47ff700 1 -- 172.21.15.115:0/2979578823 wait complete. 2023-07-27T14:31:13.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:31:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.824+0000 7f2e58dff700 1 Processor -- start 2023-07-27T14:31:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.824+0000 7f2e58dff700 1 -- start start 2023-07-27T14:31:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.825+0000 7f2e58dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e540aaa40 0x7f2e540640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.825+0000 7f2e58dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e541542a0 0x7f2e540645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.825+0000 7f2e58dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540aa4d0 con 0x7f2e54153ec0 2023-07-27T14:31:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.825+0000 7f2e58dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e54064ad0 con 0x7f2e541542a0 2023-07-27T14:31:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.825+0000 7f2e58dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540c05c0 con 0x7f2e540aaa40 2023-07-27T14:31:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.825+0000 7f2e5259c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2e54153ec0 0x7f2e540a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47006/0 (socket says 172.21.15.115:47006) 2023-07-27T14:31:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.825+0000 7f2e5259c700 1 -- 172.21.15.115:0/503320439 learned_addr learned my addr 172.21.15.115:0/503320439 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.825+0000 7f2e52d9d700 1 --2- 172.21.15.115:0/503320439 >> v2:172.21.15.115:3300/0 conn(0x7f2e541542a0 0x7f2e540645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e51d9b700 1 --2- 172.21.15.115:0/503320439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e540aaa40 0x7f2e540640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e5159a700 1 -- 172.21.15.115:0/503320439 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497438172 0 0) 0x7f2e44001110 con 0x7f2e54153ec0 2023-07-27T14:31:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e5159a700 1 -- 172.21.15.115:0/503320439 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0033f0 con 0x7f2e54153ec0 2023-07-27T14:31:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e52d9d700 1 -- 172.21.15.115:0/503320439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e540aaa40 msgr2=0x7f2e540640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e52d9d700 1 --2- 172.21.15.115:0/503320439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e540aaa40 0x7f2e540640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e52d9d700 1 -- 172.21.15.115:0/503320439 >> v1:172.21.15.115:6789/0 conn(0x7f2e54153ec0 legacy=0x7f2e540a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e52d9d700 1 -- 172.21.15.115:0/503320439 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540c1a60 con 0x7f2e541542a0 2023-07-27T14:31:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e52d9d700 1 --2- 172.21.15.115:0/503320439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e541542a0 0x7f2e540645e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f2e4c009e60 tx=0x7f2e4c009780).ready entity=mon.0 client_cookie=3071ce4c3d773af5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.826+0000 7f2e5159a700 1 -- 172.21.15.115:0/503320439 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00e070 con 0x7f2e541542a0 2023-07-27T14:31:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e5159a700 1 -- 172.21.15.115:0/503320439 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00bab0 con 0x7f2e541542a0 2023-07-27T14:31:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e5159a700 1 -- 172.21.15.115:0/503320439 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00be30 con 0x7f2e541542a0 2023-07-27T14:31:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e58dff700 1 -- 172.21.15.115:0/503320439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e541542a0 msgr2=0x7f2e540645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e58dff700 1 --2- 172.21.15.115:0/503320439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e541542a0 0x7f2e540645e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f2e4c009e60 tx=0x7f2e4c009780).stop 2023-07-27T14:31:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e58dff700 1 -- 172.21.15.115:0/503320439 shutdown_connections 2023-07-27T14:31:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e58dff700 1 --2- 172.21.15.115:0/503320439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e541542a0 0x7f2e540645e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e58dff700 1 --2- 172.21.15.115:0/503320439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e540aaa40 0x7f2e540640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e58dff700 1 -- 172.21.15.115:0/503320439 >> 172.21.15.115:0/503320439 conn(0x7f2e540cb610 msgr2=0x7f2e540c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e58dff700 1 -- 172.21.15.115:0/503320439 shutdown_connections 2023-07-27T14:31:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.827+0000 7f2e58dff700 1 -- 172.21.15.115:0/503320439 wait complete. 2023-07-27T14:31:13.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.829+0000 7f2e58dff700 1 Processor -- start 2023-07-27T14:31:13.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.829+0000 7f2e58dff700 1 -- start start 2023-07-27T14:31:13.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e58dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e58dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 0x7f2e540aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e58dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 0x7f2e540af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e58dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541503d0 con 0x7f2e540aaa40 2023-07-27T14:31:13.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e58dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54150670 con 0x7f2e541542a0 2023-07-27T14:31:13.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e58dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540af9a0 con 0x7f2e54153ec0 2023-07-27T14:31:13.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e5259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e5259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39338/0 (socket says 172.21.15.115:39338) 2023-07-27T14:31:13.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e5259c700 1 -- 172.21.15.115:0/1396806258 learned_addr learned my addr 172.21.15.115:0/1396806258 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:13.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e52d9d700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 0x7f2e540af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e51d9b700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 0x7f2e540aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e5259c700 1 -- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 msgr2=0x7f2e540aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e5259c700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 0x7f2e540aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e5259c700 1 -- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 msgr2=0x7f2e540af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:13.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e5259c700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 0x7f2e540af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:13.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e5259c700 1 -- 172.21.15.115:0/1396806258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009a20 con 0x7f2e540aaa40 2023-07-27T14:31:13.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.830+0000 7f2e51d9b700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 0x7f2e540aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:13.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.831+0000 7f2e5259c700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5414dd90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f2e4400c4a0 tx=0x7f2e44007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:13.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.831+0000 7f2e427fc700 1 -- 172.21.15.115:0/1396806258 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440072e0 con 0x7f2e540aaa40 2023-07-27T14:31:13.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.831+0000 7f2e427fc700 1 -- 172.21.15.115:0/1396806258 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44007440 con 0x7f2e540aaa40 2023-07-27T14:31:13.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.831+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e540afc80 con 0x7f2e540aaa40 2023-07-27T14:31:13.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.831+0000 7f2e427fc700 1 -- 172.21.15.115:0/1396806258 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440057a0 con 0x7f2e540aaa40 2023-07-27T14:31:13.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.831+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e540c9f30 con 0x7f2e540aaa40 2023-07-27T14:31:13.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.832+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5406c470 con 0x7f2e540aaa40 2023-07-27T14:31:13.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.833+0000 7f2e427fc700 1 -- 172.21.15.115:0/1396806258 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f2e44010070 con 0x7f2e540aaa40 2023-07-27T14:31:13.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.834+0000 7f2e427fc700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405f190 0x7f2e34061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:13.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.834+0000 7f2e427fc700 1 -- 172.21.15.115:0/1396806258 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2e44079210 con 0x7f2e540aaa40 2023-07-27T14:31:13.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.834+0000 7f2e51d9b700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405f190 0x7f2e34061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:13.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.835+0000 7f2e51d9b700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405f190 0x7f2e34061650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f2e540c9700 tx=0x7f2e48008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:13.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:13.838+0000 7f2e427fc700 1 -- 172.21.15.115:0/1396806258 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e4404a780 con 0x7f2e540aaa40 2023-07-27T14:31:14.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.006+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e540aa4d0 con 0x7f2e540aaa40 2023-07-27T14:31:14.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.007+0000 7f2e427fc700 1 -- 172.21.15.115:0/1396806258 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+13857 (secure 0 0 0) 0x7f2e540aa4d0 con 0x7f2e540aaa40 2023-07-27T14:31:14.038 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:14.039 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":80,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:31:13.136082+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:31:14.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405f190 msgr2=0x7f2e34061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405f190 0x7f2e34061650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f2e540c9700 tx=0x7f2e48008040).stop 2023-07-27T14:31:14.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 msgr2=0x7f2e5414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5414dd90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f2e4400c4a0 tx=0x7f2e44007ab0).stop 2023-07-27T14:31:14.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 shutdown_connections 2023-07-27T14:31:14.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e3405f190 0x7f2e34061650 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e541542a0 0x7f2e540af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e540aaa40 0x7f2e5414dd90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 --2- 172.21.15.115:0/1396806258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e54153ec0 0x7f2e540aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 >> 172.21.15.115:0/1396806258 conn(0x7f2e540cb610 msgr2=0x7f2e540ab550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:14.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 shutdown_connections 2023-07-27T14:31:14.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.009+0000 7f2e58dff700 1 -- 172.21.15.115:0/1396806258 wait complete. 2023-07-27T14:31:14.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:31:14.059 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:31:14.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.219+0000 7f5ba0bff700 1 Processor -- start 2023-07-27T14:31:14.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.219+0000 7f5ba0bff700 1 -- start start 2023-07-27T14:31:14.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.220+0000 7f5ba0bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5b9c14ae00 0x7f5b9c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.220+0000 7f5ba0bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b9c14b1e0 0x7f5b9c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.220+0000 7f5ba0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c0c5c50 0x7f5b9c063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.220+0000 7f5ba0bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9c063530 con 0x7f5b9c14b1e0 2023-07-27T14:31:14.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.220+0000 7f5ba0bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9c1553f0 con 0x7f5b9c14ae00 2023-07-27T14:31:14.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.220+0000 7f5ba0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c157a50 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.220+0000 7f5b99d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b9c14b1e0 0x7f5b9c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b99d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b9c14b1e0 0x7f5b9c062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39352/0 (socket says 172.21.15.115:39352) 2023-07-27T14:31:14.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b99d9b700 1 -- 172.21.15.115:0/1565305291 learned_addr learned my addr 172.21.15.115:0/1565305291 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:14.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b9ad9d700 1 --2- 172.21.15.115:0/1565305291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c0c5c50 0x7f5b9c063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b9a59c700 1 --2- 172.21.15.115:0/1565305291 >> v2:172.21.15.159:3300/0 conn(0x7f5b9c14ae00 0x7f5b9c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b99d9b700 1 -- 172.21.15.115:0/1565305291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c0c5c50 msgr2=0x7f5b9c063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:14.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b99d9b700 1 --2- 172.21.15.115:0/1565305291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c0c5c50 0x7f5b9c063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b99d9b700 1 -- 172.21.15.115:0/1565305291 >> v2:172.21.15.159:3300/0 conn(0x7f5b9c14ae00 msgr2=0x7f5b9c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:14.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b99d9b700 1 --2- 172.21.15.115:0/1565305291 >> v2:172.21.15.159:3300/0 conn(0x7f5b9c14ae00 0x7f5b9c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b99d9b700 1 -- 172.21.15.115:0/1565305291 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c157d10 con 0x7f5b9c14b1e0 2023-07-27T14:31:14.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b99d9b700 1 --2- 172.21.15.115:0/1565305291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c14b1e0 0x7f5b9c062b50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f5b9c0caaf0 tx=0x7f5b900090f0).ready entity=mon.0 client_cookie=4433702e094743da server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:14.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b9959a700 1 -- 172.21.15.115:0/1565305291 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000b600 con 0x7f5b9c14b1e0 2023-07-27T14:31:14.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b9959a700 1 -- 172.21.15.115:0/1565305291 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9000b760 con 0x7f5b9c14b1e0 2023-07-27T14:31:14.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.221+0000 7f5b9959a700 1 -- 172.21.15.115:0/1565305291 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000bae0 con 0x7f5b9c14b1e0 2023-07-27T14:31:14.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 -- 172.21.15.115:0/1565305291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c14b1e0 msgr2=0x7f5b9c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/1565305291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c14b1e0 0x7f5b9c062b50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f5b9c0caaf0 tx=0x7f5b900090f0).stop 2023-07-27T14:31:14.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 -- 172.21.15.115:0/1565305291 shutdown_connections 2023-07-27T14:31:14.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/1565305291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c0c5c50 0x7f5b9c063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/1565305291 >> v2:172.21.15.159:3300/0 conn(0x7f5b9c14ae00 0x7f5b9c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/1565305291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c14b1e0 0x7f5b9c062b50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 -- 172.21.15.115:0/1565305291 >> 172.21.15.115:0/1565305291 conn(0x7f5b9c05e940 msgr2=0x7f5b9c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:14.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 -- 172.21.15.115:0/1565305291 shutdown_connections 2023-07-27T14:31:14.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.222+0000 7f5ba0bff700 1 -- 172.21.15.115:0/1565305291 wait complete. 2023-07-27T14:31:14.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.224+0000 7f5ba0bff700 1 Processor -- start 2023-07-27T14:31:14.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.224+0000 7f5ba0bff700 1 -- start start 2023-07-27T14:31:14.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5ba0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c0c5c50 0x7f5b9c1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5ba0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c14ae00 0x7f5b9c0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5ba0bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b9c14b1e0 0x7f5b9c0c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5ba0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c149d90 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5ba0bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0aee50 con 0x7f5b9c14b1e0 2023-07-27T14:31:14.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5ba0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0adfa0 con 0x7f5b9c14ae00 2023-07-27T14:31:14.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c0c5c50 0x7f5b9c1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c0c5c50 0x7f5b9c1498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39364/0 (socket says 172.21.15.115:39364) 2023-07-27T14:31:14.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 -- 172.21.15.115:0/4282984160 learned_addr learned my addr 172.21.15.115:0/4282984160 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:14.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b99d9b700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c14ae00 0x7f5b9c0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9ad9d700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b9c14b1e0 0x7f5b9c0c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 -- 172.21.15.115:0/4282984160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c14ae00 msgr2=0x7f5b9c0c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c14ae00 0x7f5b9c0c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 -- 172.21.15.115:0/4282984160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b9c14b1e0 msgr2=0x7f5b9c0c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b9c14b1e0 0x7f5b9c0c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 -- 172.21.15.115:0/4282984160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009370 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.225+0000 7f5b9a59c700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c0c5c50 0x7f5b9c1498a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f5b8c00d890 tx=0x7f5b8c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:14.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.226+0000 7f5b8a7fc700 1 -- 172.21.15.115:0/4282984160 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0125f0 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.226+0000 7f5b8a7fc700 1 -- 172.21.15.115:0/4282984160 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c012750 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.226+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c0ae240 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.226+0000 7f5b8a7fc700 1 -- 172.21.15.115:0/4282984160 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c012ad0 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.226+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c0ae800 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.227+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c06c470 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.228+0000 7f5b8a7fc700 1 -- 172.21.15.115:0/4282984160 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f5b8c013480 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.228+0000 7f5b8a7fc700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b7c05f1c0 0x7f5b7c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.228+0000 7f5b8a7fc700 1 -- 172.21.15.115:0/4282984160 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5b8c079e40 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.229+0000 7f5b99d9b700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b7c05f1c0 0x7f5b7c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.229+0000 7f5b99d9b700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b7c05f1c0 0x7f5b7c061680 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f5b9c14b5e0 tx=0x7f5b90017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:14.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.232+0000 7f5b8a7fc700 1 -- 172.21.15.115:0/4282984160 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b8c04b190 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.401+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5b9c062c00 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.401+0000 7f5b8a7fc700 1 -- 172.21.15.115:0/4282984160 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5b8c04e7b0 con 0x7f5b9c0c5c50 2023-07-27T14:31:14.433 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:31:14.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b7c05f1c0 msgr2=0x7f5b7c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b7c05f1c0 0x7f5b7c061680 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f5b9c14b5e0 tx=0x7f5b90017000).stop 2023-07-27T14:31:14.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c0c5c50 msgr2=0x7f5b9c1498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c0c5c50 0x7f5b9c1498a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f5b8c00d890 tx=0x7f5b8c008040).stop 2023-07-27T14:31:14.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 shutdown_connections 2023-07-27T14:31:14.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b7c05f1c0 0x7f5b7c061680 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b9c14b1e0 0x7f5b9c0c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b9c0c5c50 0x7f5b9c1498a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 --2- 172.21.15.115:0/4282984160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b9c14ae00 0x7f5b9c0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 >> 172.21.15.115:0/4282984160 conn(0x7f5b9c05e940 msgr2=0x7f5b9c14a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:14.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 shutdown_connections 2023-07-27T14:31:14.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.403+0000 7f5ba0bff700 1 -- 172.21.15.115:0/4282984160 wait complete. 2023-07-27T14:31:14.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:31:14.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.611+0000 7f63f2fff700 1 Processor -- start 2023-07-27T14:31:14.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.612+0000 7f63f2fff700 1 -- start start 2023-07-27T14:31:14.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63f2fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec14ae00 0x7f63ec154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63f2fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f63ec063260 0x7f63ec0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63f2fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec1553f0 con 0x7f63ec14b1e0 2023-07-27T14:31:14.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63f2fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec157a50 con 0x7f63ec063260 2023-07-27T14:31:14.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63f2fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec157d10 con 0x7f63ec14ae00 2023-07-27T14:31:14.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63ebfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f63ec14b1e0 0x7f63ec062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47008/0 (socket says 172.21.15.115:47008) 2023-07-27T14:31:14.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63ebfff700 1 -- 172.21.15.115:0/142935409 learned_addr learned my addr 172.21.15.115:0/142935409 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:14.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739796461 0 0) 0x7f63ec1553f0 con 0x7f63ec14b1e0 2023-07-27T14:31:14.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63dc0033f0 con 0x7f63ec14b1e0 2023-07-27T14:31:14.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63f159c700 1 --2- 172.21.15.115:0/142935409 >> v2:172.21.15.159:3300/0 conn(0x7f63ec063260 0x7f63ec0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.613+0000 7f63f0d9b700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec14ae00 0x7f63ec154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3164101452 0 0) 0x7f63dc0033f0 con 0x7f63ec14b1e0 2023-07-27T14:31:14.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec14ae00 msgr2=0x7f63ec154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:14.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec14ae00 0x7f63ec154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 >> v2:172.21.15.159:3300/0 conn(0x7f63ec063260 msgr2=0x7f63ec0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:14.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 --2- 172.21.15.115:0/142935409 >> v2:172.21.15.159:3300/0 conn(0x7f63ec063260 0x7f63ec0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec157ff0 con 0x7f63ec14b1e0 2023-07-27T14:31:14.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f63d8001470 con 0x7f63ec14b1e0 2023-07-27T14:31:14.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 >> v1:172.21.15.115:6789/0 conn(0x7f63ec14b1e0 legacy=0x7f63ec062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc0038e0 0x7f63dc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63dc004690 0x7f63dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec14ae00 0x7f63dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec157a50 con 0x7f63dc004690 2023-07-27T14:31:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec157d10 con 0x7f63dc0038e0 2023-07-27T14:31:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc00b8e0 con 0x7f63ec14ae00 2023-07-27T14:31:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63ebfff700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63dc004690 0x7f63dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63f0d9b700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc0038e0 0x7f63dc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.614+0000 7f63f159c700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec14ae00 0x7f63dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63ebfff700 1 -- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec14ae00 msgr2=0x7f63dc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:14.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63ebfff700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec14ae00 0x7f63dc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63ebfff700 1 -- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc0038e0 msgr2=0x7f63dc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:14.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63ebfff700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc0038e0 0x7f63dc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63ebfff700 1 -- 172.21.15.115:0/142935409 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc0033f0 con 0x7f63dc004690 2023-07-27T14:31:14.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63ebfff700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63dc004690 0x7f63dc004b10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f63ec14b5e0 tx=0x7f63d80077c0).ready entity=mon.0 client_cookie=eafd3e9d0442338f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:14.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800cab0 con 0x7f63dc004690 2023-07-27T14:31:14.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800cc10 con 0x7f63dc004690 2023-07-27T14:31:14.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63eb7fe700 1 -- 172.21.15.115:0/142935409 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80070d0 con 0x7f63dc004690 2023-07-27T14:31:14.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63f2fff700 1 -- 172.21.15.115:0/142935409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63dc004690 msgr2=0x7f63dc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.615+0000 7f63f2fff700 1 --2- 172.21.15.115:0/142935409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63dc004690 0x7f63dc004b10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f63ec14b5e0 tx=0x7f63d80077c0).stop 2023-07-27T14:31:14.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.616+0000 7f63f159c700 1 -- 172.21.15.115:0/142935409 reap_dead start 2023-07-27T14:31:14.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.616+0000 7f63f2fff700 1 -- 172.21.15.115:0/142935409 shutdown_connections 2023-07-27T14:31:14.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.616+0000 7f63f2fff700 1 -- 172.21.15.115:0/142935409 >> 172.21.15.115:0/142935409 conn(0x7f63ec05e940 msgr2=0x7f63ec0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:14.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.616+0000 7f63f2fff700 1 -- 172.21.15.115:0/142935409 shutdown_connections 2023-07-27T14:31:14.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.616+0000 7f63f2fff700 1 -- 172.21.15.115:0/142935409 wait complete. 2023-07-27T14:31:14.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.617+0000 7f63f2fff700 1 Processor -- start 2023-07-27T14:31:14.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.617+0000 7f63f2fff700 1 -- start start 2023-07-27T14:31:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63f2fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc004690 0x7f63ec164e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63f2fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ec154450 0x7f63ec149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63f2fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec0c7630 0x7f63ec0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63f2fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c7fa0 con 0x7f63ec154450 2023-07-27T14:31:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63f2fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec164380 con 0x7f63dc004690 2023-07-27T14:31:14.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63f2fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0b0180 con 0x7f63ec0c7630 2023-07-27T14:31:14.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ec154450 0x7f63ec149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ec154450 0x7f63ec149250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39376/0 (socket says 172.21.15.115:39376) 2023-07-27T14:31:14.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.618+0000 7f63ebfff700 1 -- 172.21.15.115:0/2035072896 learned_addr learned my addr 172.21.15.115:0/2035072896 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:14.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63f0d9b700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc004690 0x7f63ec164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63f159c700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec0c7630 0x7f63ec0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63ebfff700 1 -- 172.21.15.115:0/2035072896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec0c7630 msgr2=0x7f63ec0c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63ebfff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec0c7630 0x7f63ec0c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63ebfff700 1 -- 172.21.15.115:0/2035072896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc004690 msgr2=0x7f63ec164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63ebfff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc004690 0x7f63ec164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63ebfff700 1 -- 172.21.15.115:0/2035072896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec164620 con 0x7f63ec154450 2023-07-27T14:31:14.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63ebfff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ec154450 0x7f63ec149250 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f63ec152000 tx=0x7f63d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:14.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63e8ff9700 1 -- 172.21.15.115:0/2035072896 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8001580 con 0x7f63ec154450 2023-07-27T14:31:14.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63e8ff9700 1 -- 172.21.15.115:0/2035072896 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d80016e0 con 0x7f63ec154450 2023-07-27T14:31:14.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec164900 con 0x7f63ec154450 2023-07-27T14:31:14.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63e8ff9700 1 -- 172.21.15.115:0/2035072896 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80048e0 con 0x7f63ec154450 2023-07-27T14:31:14.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.619+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec1548d0 con 0x7f63ec154450 2023-07-27T14:31:14.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.620+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec06a600 con 0x7f63ec154450 2023-07-27T14:31:14.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.621+0000 7f63e8ff9700 1 -- 172.21.15.115:0/2035072896 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f63d801d070 con 0x7f63ec154450 2023-07-27T14:31:14.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.622+0000 7f63e8ff9700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63d005f1f0 0x7f63d00616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:14.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.622+0000 7f63e8ff9700 1 -- 172.21.15.115:0/2035072896 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f63d807ab50 con 0x7f63ec154450 2023-07-27T14:31:14.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.622+0000 7f63f0d9b700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63d005f1f0 0x7f63d00616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:14.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.623+0000 7f63f0d9b700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63d005f1f0 0x7f63d00616b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f63e0006d80 tx=0x7f63e0009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:14.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.626+0000 7f63e8ff9700 1 -- 172.21.15.115:0/2035072896 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63d804bfb0 con 0x7f63ec154450 2023-07-27T14:31:14.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.796+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63ec154ac0 con 0x7f63ec154450 2023-07-27T14:31:14.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.796+0000 7f63e8ff9700 1 -- 172.21.15.115:0/2035072896 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63d8025070 con 0x7f63ec154450 2023-07-27T14:31:14.828 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:31:14.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63d005f1f0 msgr2=0x7f63d00616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63d005f1f0 0x7f63d00616b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f63e0006d80 tx=0x7f63e0009060).stop 2023-07-27T14:31:14.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ec154450 msgr2=0x7f63ec149250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:14.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ec154450 0x7f63ec149250 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f63ec152000 tx=0x7f63d8015000).stop 2023-07-27T14:31:14.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 shutdown_connections 2023-07-27T14:31:14.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63d005f1f0 0x7f63d00616b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63ec0c7630 0x7f63ec0c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63dc004690 0x7f63ec164e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 --2- 172.21.15.115:0/2035072896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63ec154450 0x7f63ec149250 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:14.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 >> 172.21.15.115:0/2035072896 conn(0x7f63ec05e940 msgr2=0x7f63ec1534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:14.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.798+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 shutdown_connections 2023-07-27T14:31:14.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:14.799+0000 7f63f2fff700 1 -- 172.21.15.115:0/2035072896 wait complete. 2023-07-27T14:31:14.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:31:15.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.003+0000 7f9e95dff700 1 Processor -- start 2023-07-27T14:31:15.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.003+0000 7f9e95dff700 1 -- start start 2023-07-27T14:31:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e95dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e90066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e95dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e90067080 con 0x7f9e90151d70 2023-07-27T14:31:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e95dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e90066df0 con 0x7f9e90066960 2023-07-27T14:31:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e95dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90063a90 con 0x7f9e90065ff0 2023-07-27T14:31:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e8f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9e90151d70 0x7f9e90155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47018/0 (socket says 172.21.15.115:47018) 2023-07-27T14:31:15.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e8f7fe700 1 -- 172.21.15.115:0/3651383148 learned_addr learned my addr 172.21.15.115:0/3651383148 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:15.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e8effd700 1 --2- 172.21.15.115:0/3651383148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e90066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e8e7fc700 1 -- 172.21.15.115:0/3651383148 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316658694 0 0) 0x7f9e90067080 con 0x7f9e90151d70 2023-07-27T14:31:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.005+0000 7f9e8e7fc700 1 -- 172.21.15.115:0/3651383148 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e780033f0 con 0x7f9e90151d70 2023-07-27T14:31:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8e7fc700 1 -- 172.21.15.115:0/3651383148 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517346334 0 0) 0x7f9e90066df0 con 0x7f9e90066960 2023-07-27T14:31:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8e7fc700 1 -- 172.21.15.115:0/3651383148 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e90067080 con 0x7f9e90066960 2023-07-27T14:31:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8effd700 1 -- 172.21.15.115:0/3651383148 >> v1:172.21.15.159:6789/0 conn(0x7f9e90066960 legacy=0x7f9e90067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8effd700 1 -- 172.21.15.115:0/3651383148 >> v1:172.21.15.115:6789/0 conn(0x7f9e90151d70 legacy=0x7f9e90155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8effd700 1 -- 172.21.15.115:0/3651383148 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900634d0 con 0x7f9e90065ff0 2023-07-27T14:31:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8effd700 1 --2- 172.21.15.115:0/3651383148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e90066470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9e84009790 tx=0x7f9e84009060).ready entity=mon.2 client_cookie=215dd62829b70516 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8e7fc700 1 -- 172.21.15.115:0/3651383148 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400f510 con 0x7f9e90065ff0 2023-07-27T14:31:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8e7fc700 1 -- 172.21.15.115:0/3651383148 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400f670 con 0x7f9e90065ff0 2023-07-27T14:31:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.006+0000 7f9e8e7fc700 1 -- 172.21.15.115:0/3651383148 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400f9f0 con 0x7f9e90065ff0 2023-07-27T14:31:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.007+0000 7f9e95dff700 1 -- 172.21.15.115:0/3651383148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 msgr2=0x7f9e90066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.007+0000 7f9e95dff700 1 --2- 172.21.15.115:0/3651383148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e90066470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9e84009790 tx=0x7f9e84009060).stop 2023-07-27T14:31:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.007+0000 7f9e95dff700 1 -- 172.21.15.115:0/3651383148 shutdown_connections 2023-07-27T14:31:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.007+0000 7f9e95dff700 1 --2- 172.21.15.115:0/3651383148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e90066470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.007+0000 7f9e95dff700 1 -- 172.21.15.115:0/3651383148 >> 172.21.15.115:0/3651383148 conn(0x7f9e900c89a0 msgr2=0x7f9e900c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.007+0000 7f9e95dff700 1 -- 172.21.15.115:0/3651383148 shutdown_connections 2023-07-27T14:31:15.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.007+0000 7f9e95dff700 1 -- 172.21.15.115:0/3651383148 wait complete. 2023-07-27T14:31:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.008+0000 7f9e95dff700 1 Processor -- start 2023-07-27T14:31:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.008+0000 7f9e95dff700 1 -- start start 2023-07-27T14:31:15.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.009+0000 7f9e95dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e900ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.009+0000 7f9e95dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e90066960 0x7f9e9014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.009+0000 7f9e95dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90151d70 0x7f9e9014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.009+0000 7f9e95dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e900c2440 con 0x7f9e90151d70 2023-07-27T14:31:15.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.009+0000 7f9e95dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e900c2910 con 0x7f9e90066960 2023-07-27T14:31:15.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.009+0000 7f9e95dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90167b10 con 0x7f9e90065ff0 2023-07-27T14:31:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.009+0000 7f9e8ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90151d70 0x7f9e9014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90151d70 0x7f9e9014d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39380/0 (socket says 172.21.15.115:39380) 2023-07-27T14:31:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8ffff700 1 -- 172.21.15.115:0/4106782317 learned_addr learned my addr 172.21.15.115:0/4106782317 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8f7fe700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e900ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8effd700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e90066960 0x7f9e9014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8ffff700 1 -- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 msgr2=0x7f9e900ac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8ffff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e900ac190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8ffff700 1 -- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e90066960 msgr2=0x7f9e9014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8ffff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e90066960 0x7f9e9014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8ffff700 1 -- 172.21.15.115:0/4106782317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840092a0 con 0x7f9e90151d70 2023-07-27T14:31:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8f7fe700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e900ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e8ffff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90151d70 0x7f9e9014d330 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f9e8800c710 tx=0x7f9e8800ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e777fe700 1 -- 172.21.15.115:0/4106782317 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88010510 con 0x7f9e90151d70 2023-07-27T14:31:15.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e777fe700 1 -- 172.21.15.115:0/4106782317 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88010670 con 0x7f9e90151d70 2023-07-27T14:31:15.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e90167df0 con 0x7f9e90151d70 2023-07-27T14:31:15.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e777fe700 1 -- 172.21.15.115:0/4106782317 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880109f0 con 0x7f9e90151d70 2023-07-27T14:31:15.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.010+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e901683b0 con 0x7f9e90151d70 2023-07-27T14:31:15.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.011+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e90155570 con 0x7f9e90151d70 2023-07-27T14:31:15.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.012+0000 7f9e777fe700 1 -- 172.21.15.115:0/4106782317 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f9e88010070 con 0x7f9e90151d70 2023-07-27T14:31:15.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.013+0000 7f9e777fe700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e7c05f1c0 0x7f9e7c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.013+0000 7f9e777fe700 1 -- 172.21.15.115:0/4106782317 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9e88079ce0 con 0x7f9e90151d70 2023-07-27T14:31:15.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.013+0000 7f9e8f7fe700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e7c05f1c0 0x7f9e7c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.014+0000 7f9e8f7fe700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e7c05f1c0 0x7f9e7c061680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9e80007fd0 tx=0x7f9e80009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:15.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.017+0000 7f9e777fe700 1 -- 172.21.15.115:0/4106782317 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e8804b030 con 0x7f9e90151d70 2023-07-27T14:31:15.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.187+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9e9006c470 con 0x7f9e90151d70 2023-07-27T14:31:15.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.187+0000 7f9e777fe700 1 -- 172.21.15.115:0/4106782317 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+143 (secure 0 0 0) 0x7f9e8804e650 con 0x7f9e90151d70 2023-07-27T14:31:15.219 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:15.219 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:31:15.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:15.220 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:31:15.220 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:31:15.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:31:15.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:15.220 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:31:15.221 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:31:15.221 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:15.221 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:31:15.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e7c05f1c0 msgr2=0x7f9e7c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e7c05f1c0 0x7f9e7c061680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9e80007fd0 tx=0x7f9e80009040).stop 2023-07-27T14:31:15.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90151d70 msgr2=0x7f9e9014d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90151d70 0x7f9e9014d330 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f9e8800c710 tx=0x7f9e8800ca20).stop 2023-07-27T14:31:15.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 shutdown_connections 2023-07-27T14:31:15.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e7c05f1c0 0x7f9e7c061680 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90151d70 0x7f9e9014d330 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90065ff0 0x7f9e900ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 --2- 172.21.15.115:0/4106782317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e90066960 0x7f9e9014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 >> 172.21.15.115:0/4106782317 conn(0x7f9e900c89a0 msgr2=0x7f9e90153270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:15.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 shutdown_connections 2023-07-27T14:31:15.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.189+0000 7f9e95dff700 1 -- 172.21.15.115:0/4106782317 wait complete. 2023-07-27T14:31:15.238 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:31:15.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:31:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.402+0000 7fc4c7fff700 1 Processor -- start 2023-07-27T14:31:15.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.402+0000 7fc4c7fff700 1 -- start start 2023-07-27T14:31:15.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4c014f740 0x7fc4c014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 0x7fc4c00a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c7fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc4c00c31e0 0x7fc4c00c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c0069f70 con 0x7fc4c014f740 2023-07-27T14:31:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c7fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c01530d0 con 0x7fc4c00c31e0 2023-07-27T14:31:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00a61c0 con 0x7fc4c00a5850 2023-07-27T14:31:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4c014f740 0x7fc4c014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4c014f740 0x7fc4c014fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39384/0 (socket says 172.21.15.115:39384) 2023-07-27T14:31:15.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c5d9b700 1 -- 172.21.15.115:0/3185722059 learned_addr learned my addr 172.21.15.115:0/3185722059 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:15.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c559a700 1 --2- 172.21.15.115:0/3185722059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 0x7fc4c00a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.403+0000 7fc4c659c700 1 --2- 172.21.15.115:0/3185722059 >> v2:172.21.15.159:3300/0 conn(0x7fc4c00c31e0 0x7fc4c00c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c5d9b700 1 -- 172.21.15.115:0/3185722059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 msgr2=0x7fc4c00a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:15.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c5d9b700 1 --2- 172.21.15.115:0/3185722059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 0x7fc4c00a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c5d9b700 1 -- 172.21.15.115:0/3185722059 >> v2:172.21.15.159:3300/0 conn(0x7fc4c00c31e0 msgr2=0x7fc4c00c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:15.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c5d9b700 1 --2- 172.21.15.115:0/3185722059 >> v2:172.21.15.159:3300/0 conn(0x7fc4c00c31e0 0x7fc4c00c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c5d9b700 1 -- 172.21.15.115:0/3185722059 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c00c3b60 con 0x7fc4c014f740 2023-07-27T14:31:15.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c659c700 1 --2- 172.21.15.115:0/3185722059 >> v2:172.21.15.159:3300/0 conn(0x7fc4c00c31e0 0x7fc4c00c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:15.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c5d9b700 1 --2- 172.21.15.115:0/3185722059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c014fb20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fc4c00c43b0 tx=0x7fc4bc0090f0).ready entity=mon.0 client_cookie=4d202306bd37c916 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:15.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c4d99700 1 -- 172.21.15.115:0/3185722059 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00b520 con 0x7fc4c014f740 2023-07-27T14:31:15.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c4d99700 1 -- 172.21.15.115:0/3185722059 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00b680 con 0x7fc4c014f740 2023-07-27T14:31:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.404+0000 7fc4c4d99700 1 -- 172.21.15.115:0/3185722059 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00ba20 con 0x7fc4c014f740 2023-07-27T14:31:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 -- 172.21.15.115:0/3185722059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 msgr2=0x7fc4c014fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/3185722059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c014fb20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fc4c00c43b0 tx=0x7fc4bc0090f0).stop 2023-07-27T14:31:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 -- 172.21.15.115:0/3185722059 shutdown_connections 2023-07-27T14:31:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/3185722059 >> v2:172.21.15.159:3300/0 conn(0x7fc4c00c31e0 0x7fc4c00c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/3185722059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c014fb20 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/3185722059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 0x7fc4c00a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 -- 172.21.15.115:0/3185722059 >> 172.21.15.115:0/3185722059 conn(0x7fc4c0062320 msgr2=0x7fc4c0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 -- 172.21.15.115:0/3185722059 shutdown_connections 2023-07-27T14:31:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.405+0000 7fc4c7fff700 1 -- 172.21.15.115:0/3185722059 wait complete. 2023-07-27T14:31:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.406+0000 7fc4c7fff700 1 Processor -- start 2023-07-27T14:31:15.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.406+0000 7fc4c7fff700 1 -- start start 2023-07-27T14:31:15.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.407+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 0x7fc4c0151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.407+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c00c31e0 0x7fc4c00a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.407+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c01569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.407+0000 7fc4c7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00a6b30 con 0x7fc4c014f740 2023-07-27T14:31:15.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.407+0000 7fc4c7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00aa070 con 0x7fc4c00c31e0 2023-07-27T14:31:15.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.407+0000 7fc4c7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00aa350 con 0x7fc4c00a5850 2023-07-27T14:31:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c01569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c01569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39392/0 (socket says 172.21.15.115:39392) 2023-07-27T14:31:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 -- 172.21.15.115:0/1128035359 learned_addr learned my addr 172.21.15.115:0/1128035359 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c5d9b700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 0x7fc4c0151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c559a700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c00c31e0 0x7fc4c00a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 -- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 msgr2=0x7fc4c0151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 0x7fc4c0151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 -- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c00c31e0 msgr2=0x7fc4c00a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c00c31e0 0x7fc4c00a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 -- 172.21.15.115:0/1128035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc009370 con 0x7fc4c014f740 2023-07-27T14:31:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c559a700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c00c31e0 0x7fc4c00a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c659c700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c01569e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fc4b800d180 tx=0x7fc4b8009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4b5ffb700 1 -- 172.21.15.115:0/1128035359 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800de20 con 0x7fc4c014f740 2023-07-27T14:31:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4b5ffb700 1 -- 172.21.15.115:0/1128035359 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b800f040 con 0x7fc4c014f740 2023-07-27T14:31:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4b5ffb700 1 -- 172.21.15.115:0/1128035359 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8013600 con 0x7fc4c014f740 2023-07-27T14:31:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.408+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c00aa630 con 0x7fc4c014f740 2023-07-27T14:31:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.409+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c00aa910 con 0x7fc4c014f740 2023-07-27T14:31:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.409+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c00a6990 con 0x7fc4c014f740 2023-07-27T14:31:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.410+0000 7fc4b5ffb700 1 -- 172.21.15.115:0/1128035359 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fc4b80139f0 con 0x7fc4c014f740 2023-07-27T14:31:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.411+0000 7fc4b5ffb700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4a405f1c0 0x7fc4a4061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.411+0000 7fc4b5ffb700 1 -- 172.21.15.115:0/1128035359 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc4b807a870 con 0x7fc4c014f740 2023-07-27T14:31:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.411+0000 7fc4c5d9b700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4a405f1c0 0x7fc4a4061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:15.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.412+0000 7fc4c5d9b700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4a405f1c0 0x7fc4a4061680 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc4bc00b2e0 tx=0x7fc4bc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:15.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.415+0000 7fc4b5ffb700 1 -- 172.21.15.115:0/1128035359 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4c00a6990 con 0x7fc4c014f740 2023-07-27T14:31:15.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.585+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fc4c00a6d00 con 0x7fc4c014f740 2023-07-27T14:31:15.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.753+0000 7fc4b5ffb700 1 -- 172.21.15.115:0/1128035359 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 152+0+0 (secure 0 0 0) 0x7fc4b804bc20 con 0x7fc4c014f740 2023-07-27T14:31:15.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4a405f1c0 msgr2=0x7fc4a4061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4a405f1c0 0x7fc4a4061680 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc4bc00b2e0 tx=0x7fc4bc017000).stop 2023-07-27T14:31:15.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 msgr2=0x7fc4c01569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:15.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c01569e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fc4b800d180 tx=0x7fc4b8009a50).stop 2023-07-27T14:31:15.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 shutdown_connections 2023-07-27T14:31:15.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4a405f1c0 0x7fc4a4061680 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4c014f740 0x7fc4c01569e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4c00a5850 0x7fc4c0151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 --2- 172.21.15.115:0/1128035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4c00c31e0 0x7fc4c00a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:15.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 >> 172.21.15.115:0/1128035359 conn(0x7fc4c0062320 msgr2=0x7fc4c00a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:15.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 shutdown_connections 2023-07-27T14:31:15.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.757+0000 7fc4c7fff700 1 -- 172.21.15.115:0/1128035359 wait complete. 2023-07-27T14:31:15.792 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:31:15.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:31:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.974+0000 7f23a49ff700 1 Processor -- start 2023-07-27T14:31:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.974+0000 7f23a49ff700 1 -- start start 2023-07-27T14:31:16.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.975+0000 7f23a49ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f23a00a7940 0x7f23a015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:16.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.975+0000 7f23a49ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a00c7ad0 con 0x7f23a00c0ce0 2023-07-27T14:31:16.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.975+0000 7f23a49ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a00c7db0 con 0x7f23a0157400 2023-07-27T14:31:16.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.975+0000 7f23a49ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a00c5590 con 0x7f23a00a7940 2023-07-27T14:31:16.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239dd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f23a00c0ce0 0x7f23a015bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47030/0 (socket says 172.21.15.115:47030) 2023-07-27T14:31:16.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239dd9b700 1 -- 172.21.15.115:0/202615969 learned_addr learned my addr 172.21.15.115:0/202615969 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:16.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239ed9d700 1 --2- 172.21.15.115:0/202615969 >> v2:172.21.15.159:3300/0 conn(0x7f23a00a7940 0x7f23a015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:16.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584553522 0 0) 0x7f23a00c7ad0 con 0x7f23a00c0ce0 2023-07-27T14:31:16.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23880033f0 con 0x7f23a00c0ce0 2023-07-27T14:31:16.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618041372 0 0) 0x7f23a00c7db0 con 0x7f23a0157400 2023-07-27T14:31:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a00c7ad0 con 0x7f23a0157400 2023-07-27T14:31:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3491471647 0 0) 0x7f23880033f0 con 0x7f23a00c0ce0 2023-07-27T14:31:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 >> v2:172.21.15.159:3300/0 conn(0x7f23a00a7940 msgr2=0x7f23a015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 --2- 172.21.15.115:0/202615969 >> v2:172.21.15.159:3300/0 conn(0x7f23a00a7940 0x7f23a015f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 >> v1:172.21.15.159:6789/0 conn(0x7f23a0157400 legacy=0x7f23a00c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00c8090 con 0x7f23a00c0ce0 2023-07-27T14:31:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f2394001470 con 0x7f23a00c0ce0 2023-07-27T14:31:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 >> v1:172.21.15.115:6789/0 conn(0x7f23a00c0ce0 legacy=0x7f23a015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2388003a70 0x7f2388003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388004690 0x7f2388004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2388005000 0x7f238800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.976+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238800bf60 con 0x7f2388003a70 2023-07-27T14:31:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238800c0a0 con 0x7f2388005000 2023-07-27T14:31:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238800c210 con 0x7f2388004690 2023-07-27T14:31:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239e59c700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2388003a70 0x7f2388003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239ed9d700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2388005000 0x7f238800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239dd9b700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388004690 0x7f2388004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239e59c700 1 -- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388004690 msgr2=0x7f2388004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239e59c700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388004690 0x7f2388004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239e59c700 1 -- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2388005000 msgr2=0x7f238800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239e59c700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2388005000 0x7f238800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239e59c700 1 -- 172.21.15.115:0/202615969 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23880033f0 con 0x7f2388003a70 2023-07-27T14:31:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239ed9d700 1 -- 172.21.15.115:0/202615969 reap_dead start 2023-07-27T14:31:16.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239dd9b700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388004690 0x7f2388004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:16.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239e59c700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2388003a70 0x7f2388003e70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f2390001890 tx=0x7f2390007bb0).ready entity=mon.0 client_cookie=17251e58af42aa1f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:16.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.977+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390007020 con 0x7f2388003a70 2023-07-27T14:31:16.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390007180 con 0x7f2388003a70 2023-07-27T14:31:16.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f239d59a700 1 -- 172.21.15.115:0/202615969 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390007500 con 0x7f2388003a70 2023-07-27T14:31:16.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f23a49ff700 1 -- 172.21.15.115:0/202615969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2388003a70 msgr2=0x7f2388003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:16.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f23a49ff700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2388003a70 0x7f2388003e70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f2390001890 tx=0x7f2390007bb0).stop 2023-07-27T14:31:16.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f23a49ff700 1 -- 172.21.15.115:0/202615969 shutdown_connections 2023-07-27T14:31:16.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f23a49ff700 1 --2- 172.21.15.115:0/202615969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2388003a70 0x7f2388003e70 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f23a49ff700 1 -- 172.21.15.115:0/202615969 >> 172.21.15.115:0/202615969 conn(0x7f23a0094280 msgr2=0x7f23a005e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:16.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f23a49ff700 1 -- 172.21.15.115:0/202615969 shutdown_connections 2023-07-27T14:31:16.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.978+0000 7f23a49ff700 1 -- 172.21.15.115:0/202615969 wait complete. 2023-07-27T14:31:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.980+0000 7f23a49ff700 1 Processor -- start 2023-07-27T14:31:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.980+0000 7f23a49ff700 1 -- start start 2023-07-27T14:31:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f23a49ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388003a70 0x7f23a0098040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f23a49ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23a0164c70 0x7f23a0163a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f23a49ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a01650f0 0x7f23a0163f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f23a49ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0164ae0 con 0x7f23a0164c70 2023-07-27T14:31:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f23a49ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00c8e70 con 0x7f23a01650f0 2023-07-27T14:31:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f23a49ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0164520 con 0x7f2388003a70 2023-07-27T14:31:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23a0164c70 0x7f23a0163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23a0164c70 0x7f23a0163a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39418/0 (socket says 172.21.15.115:39418) 2023-07-27T14:31:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239dd9b700 1 -- 172.21.15.115:0/9603404 learned_addr learned my addr 172.21.15.115:0/9603404 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239e59c700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388003a70 0x7f23a0098040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239ed9d700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a01650f0 0x7f23a0163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239dd9b700 1 -- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388003a70 msgr2=0x7f23a0098040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239dd9b700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388003a70 0x7f23a0098040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239dd9b700 1 -- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a01650f0 msgr2=0x7f23a0163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239dd9b700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a01650f0 0x7f23a0163f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239dd9b700 1 -- 172.21.15.115:0/9603404 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0164800 con 0x7f23a0164c70 2023-07-27T14:31:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.981+0000 7f239ed9d700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a01650f0 0x7f23a0163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.982+0000 7f239dd9b700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23a0164c70 0x7f23a0163a40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f239400e840 tx=0x7f2394001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.982+0000 7f238e7fc700 1 -- 172.21.15.115:0/9603404 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394010520 con 0x7f23a0164c70 2023-07-27T14:31:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.982+0000 7f238e7fc700 1 -- 172.21.15.115:0/9603404 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394010680 con 0x7f23a0164c70 2023-07-27T14:31:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.982+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a00c8b00 con 0x7f23a0164c70 2023-07-27T14:31:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.982+0000 7f238e7fc700 1 -- 172.21.15.115:0/9603404 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394010a00 con 0x7f23a0164c70 2023-07-27T14:31:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.982+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a00b0010 con 0x7f23a0164c70 2023-07-27T14:31:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.983+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a00c8960 con 0x7f23a0164c70 2023-07-27T14:31:16.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.984+0000 7f238e7fc700 1 -- 172.21.15.115:0/9603404 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f239401a020 con 0x7f23a0164c70 2023-07-27T14:31:16.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.985+0000 7f238e7fc700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f238005f1c0 0x7f2380061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:16.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.985+0000 7f238e7fc700 1 -- 172.21.15.115:0/9603404 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f2394079a20 con 0x7f23a0164c70 2023-07-27T14:31:16.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.985+0000 7f239e59c700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f238005f1c0 0x7f2380061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:16.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.985+0000 7f239e59c700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f238005f1c0 0x7f2380061680 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f2390000c00 tx=0x7f2390015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:16.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:15.989+0000 7f238e7fc700 1 -- 172.21.15.115:0/9603404 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f23a00c8960 con 0x7f23a0164c70 2023-07-27T14:31:16.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.158+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f23a014f3b0 con 0x7f23a0164c70 2023-07-27T14:31:16.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.756+0000 7f238e7fc700 1 -- 172.21.15.115:0/9603404 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f239404ac60 con 0x7f23a0164c70 2023-07-27T14:31:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.764+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f238005f1c0 msgr2=0x7f2380061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.764+0000 7f23a49ff700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f238005f1c0 0x7f2380061680 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f2390000c00 tx=0x7f2390015000).stop 2023-07-27T14:31:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.764+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23a0164c70 msgr2=0x7f23a0163a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.764+0000 7f23a49ff700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23a0164c70 0x7f23a0163a40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f239400e840 tx=0x7f2394001df0).stop 2023-07-27T14:31:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.765+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 shutdown_connections 2023-07-27T14:31:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.765+0000 7f23a49ff700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f238005f1c0 0x7f2380061680 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.765+0000 7f23a49ff700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a01650f0 0x7f23a0163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.765+0000 7f23a49ff700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2388003a70 0x7f23a0098040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.765+0000 7f23a49ff700 1 --2- 172.21.15.115:0/9603404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23a0164c70 0x7f23a0163a40 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.765+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 >> 172.21.15.115:0/9603404 conn(0x7f23a0094280 msgr2=0x7f23a00c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.766+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 shutdown_connections 2023-07-27T14:31:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.766+0000 7f23a49ff700 1 -- 172.21.15.115:0/9603404 wait complete. 2023-07-27T14:31:16.812 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:31:16.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:31:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.990+0000 7f07bd5ff700 1 Processor -- start 2023-07-27T14:31:17.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.990+0000 7f07bd5ff700 1 -- start start 2023-07-27T14:31:17.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.991+0000 7f07bd5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8153e00 0x7f07b80c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.991+0000 7f07bd5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07b8064230 0x7f07b80656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.991+0000 7f07bd5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b8066070 con 0x7f07b8065bc0 2023-07-27T14:31:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.991+0000 7f07bd5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b8062320 con 0x7f07b8064230 2023-07-27T14:31:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.991+0000 7f07bd5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b8064a80 con 0x7f07b8153e00 2023-07-27T14:31:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b67fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07b8064230 0x7f07b80656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b67fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07b8064230 0x7f07b80656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39430/0 (socket says 172.21.15.115:39430) 2023-07-27T14:31:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b67fc700 1 -- 172.21.15.115:0/2647625910 learned_addr learned my addr 172.21.15.115:0/2647625910 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b6ffd700 1 --2- 172.21.15.115:0/2647625910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8153e00 0x7f07b80c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b67fc700 1 -- 172.21.15.115:0/2647625910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8153e00 msgr2=0x7f07b80c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b67fc700 1 --2- 172.21.15.115:0/2647625910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8153e00 0x7f07b80c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b67fc700 1 -- 172.21.15.115:0/2647625910 >> v1:172.21.15.159:6789/0 conn(0x7f07b8065bc0 legacy=0x7f07b8157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b67fc700 1 -- 172.21.15.115:0/2647625910 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b8064d60 con 0x7f07b8064230 2023-07-27T14:31:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.992+0000 7f07b67fc700 1 --2- 172.21.15.115:0/2647625910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8064230 0x7f07b80656d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f07ac009830 tx=0x7f07ac0090f0).ready entity=mon.0 client_cookie=cd5eafe9d166faca server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07b5ffb700 1 -- 172.21.15.115:0/2647625910 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00b600 con 0x7f07b8064230 2023-07-27T14:31:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07b5ffb700 1 -- 172.21.15.115:0/2647625910 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac00b760 con 0x7f07b8064230 2023-07-27T14:31:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07b5ffb700 1 -- 172.21.15.115:0/2647625910 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00bae0 con 0x7f07b8064230 2023-07-27T14:31:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07bd5ff700 1 -- 172.21.15.115:0/2647625910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8064230 msgr2=0x7f07b80656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/2647625910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8064230 0x7f07b80656d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f07ac009830 tx=0x7f07ac0090f0).stop 2023-07-27T14:31:17.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07bd5ff700 1 -- 172.21.15.115:0/2647625910 shutdown_connections 2023-07-27T14:31:17.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/2647625910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8153e00 0x7f07b80c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/2647625910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8064230 0x7f07b80656d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07bd5ff700 1 -- 172.21.15.115:0/2647625910 >> 172.21.15.115:0/2647625910 conn(0x7f07b80c7b90 msgr2=0x7f07b80c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:17.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07bd5ff700 1 -- 172.21.15.115:0/2647625910 shutdown_connections 2023-07-27T14:31:17.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.993+0000 7f07bd5ff700 1 -- 172.21.15.115:0/2647625910 wait complete. 2023-07-27T14:31:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.995+0000 7f07bd5ff700 1 Processor -- start 2023-07-27T14:31:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.995+0000 7f07bd5ff700 1 -- start start 2023-07-27T14:31:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07bd5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8064230 0x7f07b813fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07bd5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8065bc0 0x7f07b80bc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07bd5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b8153e00 0x7f07b80bc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07bd5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80bca50 con 0x7f07b8065bc0 2023-07-27T14:31:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07bd5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80acc30 con 0x7f07b8153e00 2023-07-27T14:31:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07bd5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80a9c80 con 0x7f07b8064230 2023-07-27T14:31:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8065bc0 0x7f07b80bc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8065bc0 0x7f07b80bc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39446/0 (socket says 172.21.15.115:39446) 2023-07-27T14:31:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b67fc700 1 -- 172.21.15.115:0/475484728 learned_addr learned my addr 172.21.15.115:0/475484728 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b6ffd700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8064230 0x7f07b813fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b77fe700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b8153e00 0x7f07b80bc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b67fc700 1 -- 172.21.15.115:0/475484728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8064230 msgr2=0x7f07b813fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b67fc700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8064230 0x7f07b813fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b67fc700 1 -- 172.21.15.115:0/475484728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b8153e00 msgr2=0x7f07b80bc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b67fc700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b8153e00 0x7f07b80bc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.996+0000 7f07b67fc700 1 -- 172.21.15.115:0/475484728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac009370 con 0x7f07b8065bc0 2023-07-27T14:31:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.997+0000 7f07b67fc700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8065bc0 0x7f07b80bc070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f07ac009130 tx=0x7f07ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.997+0000 7f079effd700 1 -- 172.21.15.115:0/475484728 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00bae0 con 0x7f07b8065bc0 2023-07-27T14:31:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.997+0000 7f079effd700 1 -- 172.21.15.115:0/475484728 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac000c90 con 0x7f07b8065bc0 2023-07-27T14:31:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.997+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b80ac300 con 0x7f07b8065bc0 2023-07-27T14:31:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.997+0000 7f079effd700 1 -- 172.21.15.115:0/475484728 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac01c670 con 0x7f07b8065bc0 2023-07-27T14:31:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.997+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b80ac8c0 con 0x7f07b8065bc0 2023-07-27T14:31:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.998+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b8140040 con 0x7f07b8065bc0 2023-07-27T14:31:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:16.999+0000 7f079effd700 1 -- 172.21.15.115:0/475484728 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f07ac02c070 con 0x7f07b8065bc0 2023-07-27T14:31:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.000+0000 7f079effd700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f07a405f1c0 0x7f07a4061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.000+0000 7f079effd700 1 -- 172.21.15.115:0/475484728 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f07ac07bee0 con 0x7f07b8065bc0 2023-07-27T14:31:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.000+0000 7f07b6ffd700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f07a405f1c0 0x7f07a4061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.001+0000 7f07b6ffd700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f07a405f1c0 0x7f07a4061680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f07a800bb10 tx=0x7f07a8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.005+0000 7f079effd700 1 -- 172.21.15.115:0/475484728 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f07b8140040 con 0x7f07b8065bc0 2023-07-27T14:31:17.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.212+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f07b806c4e0 con 0x7f07b8065bc0 2023-07-27T14:31:17.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.220+0000 7f079effd700 1 -- 172.21.15.115:0/475484728 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v38) v1 ==== 174+0+0 (secure 0 0 0) 0x7f07b806c4e0 con 0x7f07b8065bc0 2023-07-27T14:31:17.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.227+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f07a405f1c0 msgr2=0x7f07a4061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.227+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f07a405f1c0 0x7f07a4061680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f07a800bb10 tx=0x7f07a8008040).stop 2023-07-27T14:31:17.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.227+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8065bc0 msgr2=0x7f07b80bc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.227+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8065bc0 0x7f07b80bc070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f07ac009130 tx=0x7f07ac017000).stop 2023-07-27T14:31:17.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.233+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 shutdown_connections 2023-07-27T14:31:17.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.233+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f07a405f1c0 0x7f07a4061680 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.233+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07b8153e00 0x7f07b80bc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.233+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f07b8064230 0x7f07b813fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.233+0000 7f07bd5ff700 1 --2- 172.21.15.115:0/475484728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07b8065bc0 0x7f07b80bc070 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.233+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 >> 172.21.15.115:0/475484728 conn(0x7f07b80c7b90 msgr2=0x7f07b8152060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:17.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.234+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 shutdown_connections 2023-07-27T14:31:17.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.236+0000 7f07bd5ff700 1 -- 172.21.15.115:0/475484728 wait complete. 2023-07-27T14:31:17.278 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 11 and data pool 12 2023-07-27T14:31:17.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:31:17.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.451+0000 7fb2133ff700 1 Processor -- start 2023-07-27T14:31:17.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.452+0000 7fb2133ff700 1 -- start start 2023-07-27T14:31:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb2133ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb20c1542a0 0x7fb20c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb2133ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0aa4d0 con 0x7fb20c0aaa40 2023-07-27T14:31:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb2133ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0c05c0 con 0x7fb20c153ec0 2023-07-27T14:31:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb2133ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0c1a60 con 0x7fb20c1542a0 2023-07-27T14:31:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb21099a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb20c0aaa40 0x7fb20c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47042/0 (socket says 172.21.15.115:47042) 2023-07-27T14:31:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb21099a700 1 -- 172.21.15.115:0/2106312837 learned_addr learned my addr 172.21.15.115:0/2106312837 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30104064 0 0) 0x7fb1fc001110 con 0x7fb20c0aaa40 2023-07-27T14:31:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1f80033f0 con 0x7fb20c0aaa40 2023-07-27T14:31:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.453+0000 7fb21199c700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb20c1542a0 0x7fb20c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852285669 0 0) 0x7fb1f80033f0 con 0x7fb20c0aaa40 2023-07-27T14:31:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb20c1542a0 msgr2=0x7fb20c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb20c1542a0 0x7fb20c15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 >> v1:172.21.15.159:6789/0 conn(0x7fb20c153ec0 legacy=0x7fb20c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0aa270 con 0x7fb20c0aaa40 2023-07-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb1fc001600 con 0x7fb20c0aaa40 2023-07-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 >> v1:172.21.15.115:6789/0 conn(0x7fb20c0aaa40 legacy=0x7fb20c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1f8003910 0x7fb1f8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8004690 0x7fb1f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb20c1542a0 0x7fb1f8005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0c1a60 con 0x7fb1f8003910 2023-07-27T14:31:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f800b9f0 con 0x7fb1f8004690 2023-07-27T14:31:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f800bbb0 con 0x7fb20c1542a0 2023-07-27T14:31:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb21119b700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1f8003910 0x7fb1f8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb21099a700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8004690 0x7fb1f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.454+0000 7fb21199c700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb20c1542a0 0x7fb1f8005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb21119b700 1 -- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb20c1542a0 msgr2=0x7fb1f8005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb21119b700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb20c1542a0 0x7fb1f8005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb21119b700 1 -- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8004690 msgr2=0x7fb1f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:17.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb21119b700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1f8004690 0x7fb1f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb21119b700 1 -- 172.21.15.115:0/2106312837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80033f0 con 0x7fb1f8003910 2023-07-27T14:31:17.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb21119b700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1f8003910 0x7fb1f8003d30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fb208001730 tx=0x7fb208007bb0).ready entity=mon.0 client_cookie=f4d9c1aa3510082 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208007020 con 0x7fb1f8003910 2023-07-27T14:31:17.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb208007180 con 0x7fb1f8003910 2023-07-27T14:31:17.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb203fff700 1 -- 172.21.15.115:0/2106312837 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208007500 con 0x7fb1f8003910 2023-07-27T14:31:17.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb2133ff700 1 -- 172.21.15.115:0/2106312837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1f8003910 msgr2=0x7fb1f8003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.455+0000 7fb2133ff700 1 --2- 172.21.15.115:0/2106312837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1f8003910 0x7fb1f8003d30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fb208001730 tx=0x7fb208007bb0).stop 2023-07-27T14:31:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.456+0000 7fb21199c700 1 -- 172.21.15.115:0/2106312837 reap_dead start 2023-07-27T14:31:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.456+0000 7fb2133ff700 1 -- 172.21.15.115:0/2106312837 shutdown_connections 2023-07-27T14:31:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.456+0000 7fb2133ff700 1 -- 172.21.15.115:0/2106312837 >> 172.21.15.115:0/2106312837 conn(0x7fb20c0cb610 msgr2=0x7fb20c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.456+0000 7fb2133ff700 1 -- 172.21.15.115:0/2106312837 shutdown_connections 2023-07-27T14:31:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.456+0000 7fb2133ff700 1 -- 172.21.15.115:0/2106312837 wait complete. 2023-07-27T14:31:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.458+0000 7fb2133ff700 1 Processor -- start 2023-07-27T14:31:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.458+0000 7fb2133ff700 1 -- start start 2023-07-27T14:31:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.459+0000 7fb2133ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1f8003910 0x7fb20c13f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.459+0000 7fb2133ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb20c157930 0x7fb20c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.459+0000 7fb2133ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb20c1582a0 0x7fb20c0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.459+0000 7fb2133ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0adb40 con 0x7fb20c1582a0 2023-07-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.459+0000 7fb2133ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0c2010 con 0x7fb20c157930 2023-07-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.459+0000 7fb2133ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0c22f0 con 0x7fb1f8003910 2023-07-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.459+0000 7fb21199c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb20c1582a0 0x7fb20c0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21199c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb20c1582a0 0x7fb20c0ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39466/0 (socket says 172.21.15.115:39466) 2023-07-27T14:31:17.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21199c700 1 -- 172.21.15.115:0/1193318543 learned_addr learned my addr 172.21.15.115:0/1193318543 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:17.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21119b700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1f8003910 0x7fb20c13f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21099a700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb20c157930 0x7fb20c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21199c700 1 -- 172.21.15.115:0/1193318543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1f8003910 msgr2=0x7fb20c13f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21199c700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1f8003910 0x7fb20c13f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21199c700 1 -- 172.21.15.115:0/1193318543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb20c157930 msgr2=0x7fb20c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21199c700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb20c157930 0x7fb20c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21199c700 1 -- 172.21.15.115:0/1193318543 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0ade00 con 0x7fb20c1582a0 2023-07-27T14:31:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb21199c700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb20c1582a0 0x7fb20c0ae600 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fb20c0843d0 tx=0x7fb204009730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb2017fa700 1 -- 172.21.15.115:0/1193318543 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204010b10 con 0x7fb20c1582a0 2023-07-27T14:31:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb2017fa700 1 -- 172.21.15.115:0/1193318543 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204010c70 con 0x7fb20c1582a0 2023-07-27T14:31:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c0ae0e0 con 0x7fb20c1582a0 2023-07-27T14:31:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.460+0000 7fb2017fa700 1 -- 172.21.15.115:0/1193318543 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204015420 con 0x7fb20c1582a0 2023-07-27T14:31:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.461+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c0c1c30 con 0x7fb20c1582a0 2023-07-27T14:31:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.461+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c153760 con 0x7fb20c1582a0 2023-07-27T14:31:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.462+0000 7fb2017fa700 1 -- 172.21.15.115:0/1193318543 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fb204015850 con 0x7fb20c1582a0 2023-07-27T14:31:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.463+0000 7fb2017fa700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb1f005f1c0 0x7fb1f0061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.463+0000 7fb2017fa700 1 -- 172.21.15.115:0/1193318543 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb20407abb0 con 0x7fb20c1582a0 2023-07-27T14:31:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.463+0000 7fb21119b700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb1f005f1c0 0x7fb1f0061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.464+0000 7fb21119b700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb1f005f1c0 0x7fb1f0061680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fb208001010 tx=0x7fb208015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.467+0000 7fb2017fa700 1 -- 172.21.15.115:0/1193318543 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb20404bc10 con 0x7fb20c1582a0 2023-07-27T14:31:17.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.641+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb20c0c24b0 con 0x7fb20c1582a0 2023-07-27T14:31:17.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.642+0000 7fb2017fa700 1 -- 172.21.15.115:0/1193318543 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17088 (secure 0 0 0) 0x7fb20404f230 con 0x7fb20c1582a0 2023-07-27T14:31:17.674 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:17.675 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":83,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:31:17.214710+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:31:15.629735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-27T14:31:16.202513+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:31:17.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb1f005f1c0 msgr2=0x7fb1f0061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb1f005f1c0 0x7fb1f0061680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fb208001010 tx=0x7fb208015000).stop 2023-07-27T14:31:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb20c1582a0 msgr2=0x7fb20c0ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb20c1582a0 0x7fb20c0ae600 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fb20c0843d0 tx=0x7fb204009730).stop 2023-07-27T14:31:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 shutdown_connections 2023-07-27T14:31:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb1f005f1c0 0x7fb1f0061680 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb20c1582a0 0x7fb20c0ae600 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1f8003910 0x7fb20c13f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 --2- 172.21.15.115:0/1193318543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb20c157930 0x7fb20c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.644+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 >> 172.21.15.115:0/1193318543 conn(0x7fb20c0cb610 msgr2=0x7fb20c063110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:17.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.645+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 shutdown_connections 2023-07-27T14:31:17.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.645+0000 7fb2133ff700 1 -- 172.21.15.115:0/1193318543 wait complete. 2023-07-27T14:31:17.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:31:17.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.851+0000 7f5b57dff700 1 Processor -- start 2023-07-27T14:31:17.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.852+0000 7f5b57dff700 1 -- start start 2023-07-27T14:31:17.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b57dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5b50153ec0 0x7f5b500a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b57dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aaa40 0x7f5b500c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b57dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b500aa4d0 con 0x7f5b500aa050 2023-07-27T14:31:17.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b57dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b500c05c0 con 0x7f5b50153ec0 2023-07-27T14:31:17.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b57dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500bfc90 con 0x7f5b500aaa40 2023-07-27T14:31:17.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b5539a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5b500aa050 0x7f5b500640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47044/0 (socket says 172.21.15.115:47044) 2023-07-27T14:31:17.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b5539a700 1 -- 172.21.15.115:0/1145335332 learned_addr learned my addr 172.21.15.115:0/1145335332 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:17.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b5639c700 1 --2- 172.21.15.115:0/1145335332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aaa40 0x7f5b500c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.853+0000 7f5b55b9b700 1 --2- 172.21.15.115:0/1145335332 >> v2:172.21.15.159:3300/0 conn(0x7f5b50153ec0 0x7f5b500a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b54b99700 1 -- 172.21.15.115:0/1145335332 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250166621 0 0) 0x7f5b40001110 con 0x7f5b500aa050 2023-07-27T14:31:17.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b54b99700 1 -- 172.21.15.115:0/1145335332 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b3c0033f0 con 0x7f5b500aa050 2023-07-27T14:31:17.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b5639c700 1 -- 172.21.15.115:0/1145335332 >> v2:172.21.15.159:3300/0 conn(0x7f5b50153ec0 msgr2=0x7f5b500a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:17.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b5639c700 1 --2- 172.21.15.115:0/1145335332 >> v2:172.21.15.159:3300/0 conn(0x7f5b50153ec0 0x7f5b500a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b5639c700 1 -- 172.21.15.115:0/1145335332 >> v1:172.21.15.115:6789/0 conn(0x7f5b500aa050 legacy=0x7f5b500640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b54b99700 1 -- 172.21.15.115:0/1145335332 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 307362132 0 0) 0x7f5b3c0033f0 con 0x7f5b500aa050 2023-07-27T14:31:17.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b5639c700 1 -- 172.21.15.115:0/1145335332 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b500bff70 con 0x7f5b500aaa40 2023-07-27T14:31:17.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b5639c700 1 --2- 172.21.15.115:0/1145335332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aaa40 0x7f5b500c0a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5b48009e60 tx=0x7f5b48009780).ready entity=mon.2 client_cookie=4752705dcd55a348 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b54b99700 1 -- 172.21.15.115:0/1145335332 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800e070 con 0x7f5b500aaa40 2023-07-27T14:31:17.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b54b99700 1 -- 172.21.15.115:0/1145335332 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4800b7a0 con 0x7f5b500aaa40 2023-07-27T14:31:17.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.854+0000 7f5b54b99700 1 -- 172.21.15.115:0/1145335332 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40001600 con 0x7f5b500aaa40 2023-07-27T14:31:17.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.855+0000 7f5b57dff700 1 -- 172.21.15.115:0/1145335332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aaa40 msgr2=0x7f5b500c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.855+0000 7f5b57dff700 1 --2- 172.21.15.115:0/1145335332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aaa40 0x7f5b500c0a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5b48009e60 tx=0x7f5b48009780).stop 2023-07-27T14:31:17.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.855+0000 7f5b57dff700 1 -- 172.21.15.115:0/1145335332 shutdown_connections 2023-07-27T14:31:17.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.855+0000 7f5b57dff700 1 --2- 172.21.15.115:0/1145335332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aaa40 0x7f5b500c0a50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.855+0000 7f5b57dff700 1 --2- 172.21.15.115:0/1145335332 >> v2:172.21.15.159:3300/0 conn(0x7f5b50153ec0 0x7f5b500a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.855+0000 7f5b57dff700 1 -- 172.21.15.115:0/1145335332 >> 172.21.15.115:0/1145335332 conn(0x7f5b500cb610 msgr2=0x7f5b500c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:17.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.855+0000 7f5b57dff700 1 -- 172.21.15.115:0/1145335332 shutdown_connections 2023-07-27T14:31:17.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.855+0000 7f5b57dff700 1 -- 172.21.15.115:0/1145335332 wait complete. 2023-07-27T14:31:17.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.856+0000 7f5b57dff700 1 Processor -- start 2023-07-27T14:31:17.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.857+0000 7f5b57dff700 1 -- start start 2023-07-27T14:31:17.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.857+0000 7f5b57dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aa050 0x7f5b50150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.857+0000 7f5b57dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b500aaa40 0x7f5b50142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.857+0000 7f5b57dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b50153ec0 0x7f5b500adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.857+0000 7f5b57dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50157b40 con 0x7f5b500aaa40 2023-07-27T14:31:17.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.857+0000 7f5b57dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50157840 con 0x7f5b50153ec0 2023-07-27T14:31:17.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.857+0000 7f5b57dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50150860 con 0x7f5b500aa050 2023-07-27T14:31:17.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b500aaa40 0x7f5b50142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b500aaa40 0x7f5b50142740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39482/0 (socket says 172.21.15.115:39482) 2023-07-27T14:31:17.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 -- 172.21.15.115:0/2311451485 learned_addr learned my addr 172.21.15.115:0/2311451485 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:17.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b55b9b700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aa050 0x7f5b50150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 -- 172.21.15.115:0/2311451485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aa050 msgr2=0x7f5b50150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aa050 0x7f5b50150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:17.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 -- 172.21.15.115:0/2311451485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b50153ec0 msgr2=0x7f5b500adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:17.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b50153ec0 0x7f5b500adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:17.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 -- 172.21.15.115:0/2311451485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48009a20 con 0x7f5b500aaa40 2023-07-27T14:31:17.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b5539a700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b500aaa40 0x7f5b50142740 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f5b4000c810 tx=0x7f5b40001e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b45ffb700 1 -- 172.21.15.115:0/2311451485 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40007170 con 0x7f5b500aaa40 2023-07-27T14:31:17.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b45ffb700 1 -- 172.21.15.115:0/2311451485 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b40007310 con 0x7f5b500aaa40 2023-07-27T14:31:17.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b500b01e0 con 0x7f5b500aaa40 2023-07-27T14:31:17.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.858+0000 7f5b45ffb700 1 -- 172.21.15.115:0/2311451485 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400048c0 con 0x7f5b500aaa40 2023-07-27T14:31:17.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.859+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b50153180 con 0x7f5b500aaa40 2023-07-27T14:31:17.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.859+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5006c470 con 0x7f5b500aaa40 2023-07-27T14:31:17.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.860+0000 7f5b45ffb700 1 -- 172.21.15.115:0/2311451485 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f5b4001b060 con 0x7f5b500aaa40 2023-07-27T14:31:17.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.861+0000 7f5b45ffb700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b3405f1c0 0x7f5b34061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:17.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.861+0000 7f5b45ffb700 1 -- 172.21.15.115:0/2311451485 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5b40079c30 con 0x7f5b500aaa40 2023-07-27T14:31:17.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.861+0000 7f5b55b9b700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b3405f1c0 0x7f5b34061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:17.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.862+0000 7f5b55b9b700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b3405f1c0 0x7f5b34061680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f5b4c006d80 tx=0x7f5b4c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:17.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:17.865+0000 7f5b45ffb700 1 -- 172.21.15.115:0/2311451485 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b4004ac90 con 0x7f5b500aaa40 2023-07-27T14:31:18.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.034+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b500aa4d0 con 0x7f5b500aaa40 2023-07-27T14:31:18.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.035+0000 7f5b45ffb700 1 -- 172.21.15.115:0/2311451485 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17088 (secure 0 0 0) 0x7f5b500aa4d0 con 0x7f5b500aaa40 2023-07-27T14:31:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:18.068 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":83,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:31:17.214710+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:31:15.629735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-27T14:31:16.202513+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:31:18.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.037+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b3405f1c0 msgr2=0x7f5b34061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:18.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.037+0000 7f5b57dff700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b3405f1c0 0x7f5b34061680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f5b4c006d80 tx=0x7f5b4c008040).stop 2023-07-27T14:31:18.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.037+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b500aaa40 msgr2=0x7f5b50142740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:18.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b500aaa40 0x7f5b50142740 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f5b4000c810 tx=0x7f5b40001e60).stop 2023-07-27T14:31:18.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 shutdown_connections 2023-07-27T14:31:18.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b3405f1c0 0x7f5b34061680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:18.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b50153ec0 0x7f5b500adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:18.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b500aa050 0x7f5b50150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:18.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 --2- 172.21.15.115:0/2311451485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b500aaa40 0x7f5b50142740 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:18.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 >> 172.21.15.115:0/2311451485 conn(0x7f5b500cb610 msgr2=0x7f5b50159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:18.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 shutdown_connections 2023-07-27T14:31:18.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.038+0000 7f5b57dff700 1 -- 172.21.15.115:0/2311451485 wait complete. 2023-07-27T14:31:18.088 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:31:18.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.250+0000 7f57aa3ff700 1 Processor -- start 2023-07-27T14:31:18.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.250+0000 7f57aa3ff700 1 -- start start 2023-07-27T14:31:18.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.251+0000 7f57aa3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57a414b1e0 0x7f57a4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:18.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.251+0000 7f57aa3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a41553f0 con 0x7f57a4063260 2023-07-27T14:31:18.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.251+0000 7f57aa3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a4157a50 con 0x7f57a414ae00 2023-07-27T14:31:18.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.251+0000 7f57aa3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a4157d10 con 0x7f57a414b1e0 2023-07-27T14:31:18.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.251+0000 7f57a899c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57a414b1e0 0x7f57a4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:18.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.251+0000 7f57a37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f57a4063260 0x7f57a40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47056/0 (socket says 172.21.15.115:47056) 2023-07-27T14:31:18.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a37fe700 1 -- 172.21.15.115:0/598491577 learned_addr learned my addr 172.21.15.115:0/598491577 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:18.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a899c700 1 -- 172.21.15.115:0/598491577 >> v1:172.21.15.159:6789/0 conn(0x7f57a414ae00 legacy=0x7f57a4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:18.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a899c700 1 -- 172.21.15.115:0/598491577 >> v1:172.21.15.115:6789/0 conn(0x7f57a4063260 legacy=0x7f57a40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:18.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a2ffd700 1 -- 172.21.15.115:0/598491577 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835632164 0 0) 0x7f57a4157a50 con 0x7f57a414ae00 2023-07-27T14:31:18.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a899c700 1 -- 172.21.15.115:0/598491577 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4157ff0 con 0x7f57a414b1e0 2023-07-27T14:31:18.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a899c700 1 --2- 172.21.15.115:0/598491577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a414b1e0 0x7f57a4154f00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f579c009e60 tx=0x7f579c009780).ready entity=mon.0 client_cookie=56f9efdc89fe8b0d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:18.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a2ffd700 1 -- 172.21.15.115:0/598491577 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00e070 con 0x7f57a414b1e0 2023-07-27T14:31:18.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a2ffd700 1 -- 172.21.15.115:0/598491577 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c00bb30 con 0x7f57a414b1e0 2023-07-27T14:31:18.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.252+0000 7f57a2ffd700 1 -- 172.21.15.115:0/598491577 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00beb0 con 0x7f57a414b1e0 2023-07-27T14:31:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.253+0000 7f57aa3ff700 1 -- 172.21.15.115:0/598491577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a414b1e0 msgr2=0x7f57a4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.253+0000 7f57aa3ff700 1 --2- 172.21.15.115:0/598491577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a414b1e0 0x7f57a4154f00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f579c009e60 tx=0x7f579c009780).stop 2023-07-27T14:31:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.253+0000 7f57aa3ff700 1 -- 172.21.15.115:0/598491577 shutdown_connections 2023-07-27T14:31:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.253+0000 7f57aa3ff700 1 --2- 172.21.15.115:0/598491577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a414b1e0 0x7f57a4154f00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.253+0000 7f57aa3ff700 1 -- 172.21.15.115:0/598491577 >> 172.21.15.115:0/598491577 conn(0x7f57a405e940 msgr2=0x7f57a40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.253+0000 7f57aa3ff700 1 -- 172.21.15.115:0/598491577 shutdown_connections 2023-07-27T14:31:18.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.253+0000 7f57aa3ff700 1 -- 172.21.15.115:0/598491577 wait complete. 2023-07-27T14:31:18.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.255+0000 7f57aa3ff700 1 Processor -- start 2023-07-27T14:31:18.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.255+0000 7f57aa3ff700 1 -- start start 2023-07-27T14:31:18.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57aa3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a4063260 0x7f57a40afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:18.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57aa3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57a414ae00 0x7f57a4136e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57aa3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57a414b1e0 0x7f57a40c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57aa3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4137370 con 0x7f57a4063260 2023-07-27T14:31:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57aa3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4137610 con 0x7f57a414b1e0 2023-07-27T14:31:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57aa3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4149d10 con 0x7f57a414ae00 2023-07-27T14:31:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a4063260 0x7f57a40afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a4063260 0x7f57a40afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39504/0 (socket says 172.21.15.115:39504) 2023-07-27T14:31:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 -- 172.21.15.115:0/1151091405 learned_addr learned my addr 172.21.15.115:0/1151091405 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:18.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a37fe700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57a414ae00 0x7f57a4136e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:18.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a899c700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57a414b1e0 0x7f57a40c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:18.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 -- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57a414ae00 msgr2=0x7f57a4136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:18.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57a414ae00 0x7f57a4136e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:18.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 -- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57a414b1e0 msgr2=0x7f57a40c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:18.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57a414b1e0 0x7f57a40c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:18.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 -- 172.21.15.115:0/1151091405 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c009a20 con 0x7f57a4063260 2023-07-27T14:31:18.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a37fe700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57a414ae00 0x7f57a4136e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:18.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a899c700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57a414b1e0 0x7f57a40c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:18.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.256+0000 7f57a3fff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a4063260 0x7f57a40afb90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f579400c4c0 tx=0x7f5794007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:18.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.257+0000 7f578bfff700 1 -- 172.21.15.115:0/1151091405 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400f470 con 0x7f57a4063260 2023-07-27T14:31:18.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.257+0000 7f578bfff700 1 -- 172.21.15.115:0/1151091405 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400f5f0 con 0x7f57a4063260 2023-07-27T14:31:18.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.257+0000 7f578bfff700 1 -- 172.21.15.115:0/1151091405 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400f9b0 con 0x7f57a4063260 2023-07-27T14:31:18.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.257+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a40b0230 con 0x7f57a4063260 2023-07-27T14:31:18.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.257+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a40b07f0 con 0x7f57a4063260 2023-07-27T14:31:18.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.258+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a406c470 con 0x7f57a4063260 2023-07-27T14:31:18.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.259+0000 7f578bfff700 1 -- 172.21.15.115:0/1151091405 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f5794019030 con 0x7f57a4063260 2023-07-27T14:31:18.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.259+0000 7f578bfff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f579005f1c0 0x7f5790061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.259+0000 7f578bfff700 1 -- 172.21.15.115:0/1151091405 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f57940797b0 con 0x7f57a4063260 2023-07-27T14:31:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.260+0000 7f57a37fe700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f579005f1c0 0x7f5790061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.260+0000 7f57a37fe700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f579005f1c0 0x7f5790061680 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f57a40cacf0 tx=0x7f5798009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.263+0000 7f578bfff700 1 -- 172.21.15.115:0/1151091405 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f579404a810 con 0x7f57a4063260 2023-07-27T14:31:18.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:18.476+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f57a40cad20 con 0x7f57a4063260 2023-07-27T14:31:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.233+0000 7f578bfff700 1 -- 172.21.15.115:0/1151091405 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f579404de30 con 0x7f57a4063260 2023-07-27T14:31:19.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f579005f1c0 msgr2=0x7f5790061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f579005f1c0 0x7f5790061680 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f57a40cacf0 tx=0x7f5798009040).stop 2023-07-27T14:31:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a4063260 msgr2=0x7f57a40afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a4063260 0x7f57a40afb90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f579400c4c0 tx=0x7f5794007ce0).stop 2023-07-27T14:31:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 shutdown_connections 2023-07-27T14:31:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f579005f1c0 0x7f5790061680 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57a414b1e0 0x7f57a40c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57a4063260 0x7f57a40afb90 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 --2- 172.21.15.115:0/1151091405 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f57a414ae00 0x7f57a4136e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 >> 172.21.15.115:0/1151091405 conn(0x7f57a405e940 msgr2=0x7f57a414a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:19.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 shutdown_connections 2023-07-27T14:31:19.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.235+0000 7f57aa3ff700 1 -- 172.21.15.115:0/1151091405 wait complete. 2023-07-27T14:31:19.287 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:31:19.287 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:31:19.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.449+0000 7feba57ff700 1 Processor -- start 2023-07-27T14:31:19.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.449+0000 7feba57ff700 1 -- start start 2023-07-27T14:31:19.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.450+0000 7feba57ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7feba013a350 0x7feba0065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:19.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.450+0000 7feba57ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00bd9a0 con 0x7feba00c36b0 2023-07-27T14:31:19.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.450+0000 7feba57ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba0066610 con 0x7feba013a730 2023-07-27T14:31:19.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.450+0000 7feba57ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba0066400 con 0x7feba013a350 2023-07-27T14:31:19.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.450+0000 7feb9f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7feba00c36b0 0x7feba00be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47060/0 (socket says 172.21.15.115:47060) 2023-07-27T14:31:19.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.450+0000 7feb9f7fe700 1 -- 172.21.15.115:0/829710240 learned_addr learned my addr 172.21.15.115:0/829710240 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:19.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9effd700 1 --2- 172.21.15.115:0/829710240 >> v2:172.21.15.159:3300/0 conn(0x7feba013a350 0x7feba0065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:19.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227048495 0 0) 0x7feba00bd9a0 con 0x7feba00c36b0 2023-07-27T14:31:19.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb880033f0 con 0x7feba00c36b0 2023-07-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3999366405 0 0) 0x7feb880033f0 con 0x7feba00c36b0 2023-07-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 >> v2:172.21.15.159:3300/0 conn(0x7feba013a350 msgr2=0x7feba0065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 --2- 172.21.15.115:0/829710240 >> v2:172.21.15.159:3300/0 conn(0x7feba013a350 0x7feba0065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 >> v1:172.21.15.159:6789/0 conn(0x7feba013a730 legacy=0x7feba00c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:19.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00bdc10 con 0x7feba00c36b0 2023-07-27T14:31:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7feb980017f0 con 0x7feba00c36b0 2023-07-27T14:31:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 >> v1:172.21.15.115:6789/0 conn(0x7feba00c36b0 legacy=0x7feba00be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb880038e0 0x7feb88003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb88004690 0x7feb88004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb88005000 0x7feb8800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba0066400 con 0x7feb880038e0 2023-07-27T14:31:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8800bf60 con 0x7feb88005000 2023-07-27T14:31:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.451+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8800c0f0 con 0x7feb88004690 2023-07-27T14:31:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9effd700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb880038e0 0x7feb88003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9f7fe700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb88005000 0x7feb8800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9e7fc700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb88004690 0x7feb88004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9effd700 1 -- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb88004690 msgr2=0x7feb88004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9effd700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb88004690 0x7feb88004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9effd700 1 -- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb88005000 msgr2=0x7feb8800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:19.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9effd700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb88005000 0x7feb8800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9effd700 1 -- 172.21.15.115:0/829710240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880033f0 con 0x7feb880038e0 2023-07-27T14:31:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9f7fe700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb88005000 0x7feb8800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9f7fe700 1 -- 172.21.15.115:0/829710240 reap_dead start 2023-07-27T14:31:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9effd700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb880038e0 0x7feb88003d00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7feb90009a80 tx=0x7feb90009060).ready entity=mon.0 client_cookie=326b9711a1685693 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90009430 con 0x7feb880038e0 2023-07-27T14:31:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000e640 con 0x7feb880038e0 2023-07-27T14:31:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.452+0000 7feb9dffb700 1 -- 172.21.15.115:0/829710240 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000e9c0 con 0x7feb880038e0 2023-07-27T14:31:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.453+0000 7feba57ff700 1 -- 172.21.15.115:0/829710240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb880038e0 msgr2=0x7feb88003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:19.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.453+0000 7feba57ff700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb880038e0 0x7feb88003d00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7feb90009a80 tx=0x7feb90009060).stop 2023-07-27T14:31:19.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.453+0000 7feba57ff700 1 -- 172.21.15.115:0/829710240 shutdown_connections 2023-07-27T14:31:19.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.453+0000 7feba57ff700 1 --2- 172.21.15.115:0/829710240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb880038e0 0x7feb88003d00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.453+0000 7feba57ff700 1 -- 172.21.15.115:0/829710240 >> 172.21.15.115:0/829710240 conn(0x7feba005e8f0 msgr2=0x7feba00c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:19.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.453+0000 7feba57ff700 1 -- 172.21.15.115:0/829710240 shutdown_connections 2023-07-27T14:31:19.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.453+0000 7feba57ff700 1 -- 172.21.15.115:0/829710240 wait complete. 2023-07-27T14:31:19.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.454+0000 7feba57ff700 1 Processor -- start 2023-07-27T14:31:19.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.455+0000 7feba57ff700 1 -- start start 2023-07-27T14:31:19.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.455+0000 7feba57ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb880038e0 0x7feba0154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:19.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.455+0000 7feba57ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feba00c2520 0x7feba0167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:19.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feba57ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba0167fd0 0x7feba0163850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:19.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feba57ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c7d60 con 0x7feba0167fd0 2023-07-27T14:31:19.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feba57ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba0154c00 con 0x7feb880038e0 2023-07-27T14:31:19.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feba57ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c29a0 con 0x7feba00c2520 2023-07-27T14:31:19.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba0167fd0 0x7feba0163850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:19.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba0167fd0 0x7feba0163850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39518/0 (socket says 172.21.15.115:39518) 2023-07-27T14:31:19.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 -- 172.21.15.115:0/3629432940 learned_addr learned my addr 172.21.15.115:0/3629432940 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:19.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9e7fc700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feba00c2520 0x7feba0167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:19.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9effd700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb880038e0 0x7feba0154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:19.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 -- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feba00c2520 msgr2=0x7feba0167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:19.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feba00c2520 0x7feba0167ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 -- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb880038e0 msgr2=0x7feba0154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:19.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb880038e0 0x7feba0154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:19.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 -- 172.21.15.115:0/3629432940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00c6fa0 con 0x7feba0167fd0 2023-07-27T14:31:19.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9e7fc700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feba00c2520 0x7feba0167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:19.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9effd700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb880038e0 0x7feba0154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:19.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.456+0000 7feb9f7fe700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba0167fd0 0x7feba0163850 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7feba00a8200 tx=0x7feb98007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:19.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.457+0000 7feb86ffd700 1 -- 172.21.15.115:0/3629432940 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800e830 con 0x7feba0167fd0 2023-07-27T14:31:19.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.457+0000 7feb86ffd700 1 -- 172.21.15.115:0/3629432940 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800e990 con 0x7feba0167fd0 2023-07-27T14:31:19.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.457+0000 7feb86ffd700 1 -- 172.21.15.115:0/3629432940 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800ed50 con 0x7feba0167fd0 2023-07-27T14:31:19.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.457+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00c7280 con 0x7feba0167fd0 2023-07-27T14:31:19.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.457+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba00c7840 con 0x7feba0167fd0 2023-07-27T14:31:19.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.458+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba00c7a00 con 0x7feba0167fd0 2023-07-27T14:31:19.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.459+0000 7feb86ffd700 1 -- 172.21.15.115:0/3629432940 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7feb98014640 con 0x7feba0167fd0 2023-07-27T14:31:19.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.460+0000 7feb86ffd700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb8c05f1c0 0x7feb8c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:19.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.460+0000 7feb86ffd700 1 -- 172.21.15.115:0/3629432940 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feb9807a1d0 con 0x7feba0167fd0 2023-07-27T14:31:19.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.460+0000 7feb9effd700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb8c05f1c0 0x7feb8c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:19.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.460+0000 7feb9effd700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb8c05f1c0 0x7feb8c061680 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7feb90006d50 tx=0x7feb9001a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:19.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.464+0000 7feb86ffd700 1 -- 172.21.15.115:0/3629432940 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb980498f0 con 0x7feba0167fd0 2023-07-27T14:31:19.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:19.677+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feba00c7bb0 con 0x7feba0167fd0 2023-07-27T14:31:20.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.238+0000 7feb86ffd700 1 -- 172.21.15.115:0/3629432940 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7feb9804b2e0 con 0x7feba0167fd0 2023-07-27T14:31:20.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.240+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb8c05f1c0 msgr2=0x7feb8c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.240+0000 7feba57ff700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb8c05f1c0 0x7feb8c061680 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7feb90006d50 tx=0x7feb9001a000).stop 2023-07-27T14:31:20.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba0167fd0 msgr2=0x7feba0163850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba0167fd0 0x7feba0163850 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7feba00a8200 tx=0x7feb98007ec0).stop 2023-07-27T14:31:20.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 shutdown_connections 2023-07-27T14:31:20.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb8c05f1c0 0x7feb8c061680 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba0167fd0 0x7feba0163850 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb880038e0 0x7feba0154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 --2- 172.21.15.115:0/3629432940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feba00c2520 0x7feba0167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 >> 172.21.15.115:0/3629432940 conn(0x7feba005e8f0 msgr2=0x7feba00ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:20.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 shutdown_connections 2023-07-27T14:31:20.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.241+0000 7feba57ff700 1 -- 172.21.15.115:0/3629432940 wait complete. 2023-07-27T14:31:20.292 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:31:20.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:31:20.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.449+0000 7fa6629ff700 1 Processor -- start 2023-07-27T14:31:20.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.450+0000 7fa6629ff700 1 -- start start 2023-07-27T14:31:20.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.451+0000 7fa6629ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c0aaa40 0x7fa65c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.451+0000 7fa6629ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa65c1542a0 0x7fa65c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.451+0000 7fa6629ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c0aa4d0 con 0x7fa65c153ec0 2023-07-27T14:31:20.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.451+0000 7fa6629ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c064ad0 con 0x7fa65c1542a0 2023-07-27T14:31:20.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.451+0000 7fa6629ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0c05c0 con 0x7fa65c0aaa40 2023-07-27T14:31:20.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.451+0000 7fa660f9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa65c1542a0 0x7fa65c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.451+0000 7fa660f9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa65c1542a0 0x7fa65c0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39528/0 (socket says 172.21.15.115:39528) 2023-07-27T14:31:20.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.451+0000 7fa660f9c700 1 -- 172.21.15.115:0/957975580 learned_addr learned my addr 172.21.15.115:0/957975580 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:20.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa65b7fe700 1 --2- 172.21.15.115:0/957975580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c0aaa40 0x7fa65c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa660f9c700 1 -- 172.21.15.115:0/957975580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c0aaa40 msgr2=0x7fa65c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:20.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa660f9c700 1 --2- 172.21.15.115:0/957975580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c0aaa40 0x7fa65c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa660f9c700 1 -- 172.21.15.115:0/957975580 >> v1:172.21.15.159:6789/0 conn(0x7fa65c153ec0 legacy=0x7fa65c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa660f9c700 1 -- 172.21.15.115:0/957975580 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0c1a60 con 0x7fa65c1542a0 2023-07-27T14:31:20.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa660f9c700 1 --2- 172.21.15.115:0/957975580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c1542a0 0x7fa65c0645e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fa654009f20 tx=0x7fa654009840).ready entity=mon.0 client_cookie=4f30d35ae0460122 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:20.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa65affd700 1 -- 172.21.15.115:0/957975580 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400e070 con 0x7fa65c1542a0 2023-07-27T14:31:20.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa65affd700 1 -- 172.21.15.115:0/957975580 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400b9d0 con 0x7fa65c1542a0 2023-07-27T14:31:20.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.452+0000 7fa65affd700 1 -- 172.21.15.115:0/957975580 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400bd50 con 0x7fa65c1542a0 2023-07-27T14:31:20.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.453+0000 7fa6629ff700 1 -- 172.21.15.115:0/957975580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c1542a0 msgr2=0x7fa65c0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.453+0000 7fa6629ff700 1 --2- 172.21.15.115:0/957975580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c1542a0 0x7fa65c0645e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fa654009f20 tx=0x7fa654009840).stop 2023-07-27T14:31:20.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.453+0000 7fa6629ff700 1 -- 172.21.15.115:0/957975580 shutdown_connections 2023-07-27T14:31:20.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.453+0000 7fa6629ff700 1 --2- 172.21.15.115:0/957975580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c1542a0 0x7fa65c0645e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.453+0000 7fa6629ff700 1 --2- 172.21.15.115:0/957975580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c0aaa40 0x7fa65c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.453+0000 7fa6629ff700 1 -- 172.21.15.115:0/957975580 >> 172.21.15.115:0/957975580 conn(0x7fa65c0cb610 msgr2=0x7fa65c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:20.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.453+0000 7fa6629ff700 1 -- 172.21.15.115:0/957975580 shutdown_connections 2023-07-27T14:31:20.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.453+0000 7fa6629ff700 1 -- 172.21.15.115:0/957975580 wait complete. 2023-07-27T14:31:20.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.454+0000 7fa6629ff700 1 Processor -- start 2023-07-27T14:31:20.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.455+0000 7fa6629ff700 1 -- start start 2023-07-27T14:31:20.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.455+0000 7fa6629ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c0aaa40 0x7fa65c141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.455+0000 7fa6629ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c153ec0 0x7fa65c0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.455+0000 7fa6629ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1542a0 0x7fa65c0c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.455+0000 7fa6629ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c1642e0 con 0x7fa65c0aaa40 2023-07-27T14:31:20.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.455+0000 7fa6629ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c141f20 con 0x7fa65c1542a0 2023-07-27T14:31:20.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.455+0000 7fa6629ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0af440 con 0x7fa65c153ec0 2023-07-27T14:31:20.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c0aaa40 0x7fa65c141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c0aaa40 0x7fa65c141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39542/0 (socket says 172.21.15.115:39542) 2023-07-27T14:31:20.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 -- 172.21.15.115:0/2630282234 learned_addr learned my addr 172.21.15.115:0/2630282234 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:20.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 -- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c153ec0 msgr2=0x7fa65c0c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65b7fe700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c153ec0 0x7fa65c0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c153ec0 0x7fa65c0c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 -- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1542a0 msgr2=0x7fa65c0c29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa660f9c700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1542a0 0x7fa65c0c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1542a0 0x7fa65c0c29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 -- 172.21.15.115:0/2630282234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654009ae0 con 0x7fa65c0aaa40 2023-07-27T14:31:20.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa660f9c700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1542a0 0x7fa65c0c29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:20.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa65bfff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c0aaa40 0x7fa65c141a30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fa64c00c4c0 tx=0x7fa64c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:20.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.456+0000 7fa643fff700 1 -- 172.21.15.115:0/2630282234 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c007020 con 0x7fa65c0aaa40 2023-07-27T14:31:20.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.457+0000 7fa643fff700 1 -- 172.21.15.115:0/2630282234 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c001e90 con 0x7fa65c0aaa40 2023-07-27T14:31:20.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.457+0000 7fa643fff700 1 -- 172.21.15.115:0/2630282234 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0073b0 con 0x7fa65c0aaa40 2023-07-27T14:31:20.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.457+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c14e010 con 0x7fa65c0aaa40 2023-07-27T14:31:20.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.457+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c0aeb10 con 0x7fa65c0aaa40 2023-07-27T14:31:20.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.458+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c153ad0 con 0x7fa65c0aaa40 2023-07-27T14:31:20.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.458+0000 7fa643fff700 1 -- 172.21.15.115:0/2630282234 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fa64c010070 con 0x7fa65c0aaa40 2023-07-27T14:31:20.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.459+0000 7fa643fff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa64805f1c0 0x7fa648061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.459+0000 7fa643fff700 1 -- 172.21.15.115:0/2630282234 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa64c0799b0 con 0x7fa65c0aaa40 2023-07-27T14:31:20.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.459+0000 7fa65b7fe700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa64805f1c0 0x7fa648061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.460+0000 7fa65b7fe700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa64805f1c0 0x7fa648061680 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fa650009270 tx=0x7fa650008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.463+0000 7fa643fff700 1 -- 172.21.15.115:0/2630282234 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa64c04aa10 con 0x7fa65c0aaa40 2023-07-27T14:31:20.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.673+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa65c0aa4d0 con 0x7fa65c0aaa40 2023-07-27T14:31:20.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.674+0000 7fa643fff700 1 -- 172.21.15.115:0/2630282234 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fa65c0aa4d0 con 0x7fa65c0aaa40 2023-07-27T14:31:20.706 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:20.706 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4214348897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":4214348897},{"type":"v1","addr":"172.21.15.115:6837","nonce":4214348897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/445956953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":445956953},{"type":"v1","addr":"172.21.15.159:6834","nonce":445956953}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4278535768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":4278535768},{"type":"v1","addr":"172.21.15.159:6835","nonce":4278535768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:31:17.215158+0000","modified":"2023-07-27T14:31:20.233120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3446022806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3446022806},{"type":"v1","addr":"172.21.15.115:6835","nonce":3446022806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-07-27T14:31:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa64805f1c0 msgr2=0x7fa648061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa64805f1c0 0x7fa648061680 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fa650009270 tx=0x7fa650008040).stop 2023-07-27T14:31:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c0aaa40 msgr2=0x7fa65c141a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c0aaa40 0x7fa65c141a30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fa64c00c4c0 tx=0x7fa64c007e00).stop 2023-07-27T14:31:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 shutdown_connections 2023-07-27T14:31:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa64805f1c0 0x7fa648061680 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1542a0 0x7fa65c0c29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa65c0aaa40 0x7fa65c141a30 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 --2- 172.21.15.115:0/2630282234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa65c153ec0 0x7fa65c0c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 >> 172.21.15.115:0/2630282234 conn(0x7fa65c0cb610 msgr2=0x7fa65c14f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 shutdown_connections 2023-07-27T14:31:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.676+0000 7fa6629ff700 1 -- 172.21.15.115:0/2630282234 wait complete. 2023-07-27T14:31:20.710 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 42 2023-07-27T14:31:20.725 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:31:20.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.882+0000 7fbf01dff700 1 Processor -- start 2023-07-27T14:31:20.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.882+0000 7fbf01dff700 1 -- start start 2023-07-27T14:31:20.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.883+0000 7fbf01dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbefc0aaa40 0x7fbefc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.883+0000 7fbf01dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0aa4d0 con 0x7fbefc1542a0 2023-07-27T14:31:20.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.883+0000 7fbf01dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0c05c0 con 0x7fbefc153ec0 2023-07-27T14:31:20.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.883+0000 7fbf01dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc0aa270 con 0x7fbefc0aaa40 2023-07-27T14:31:20.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.884+0000 7fbefaffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbefc0aaa40 0x7fbefc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.884+0000 7fbefaffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbefc0aaa40 0x7fbefc0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39552/0 (socket says 172.21.15.115:39552) 2023-07-27T14:31:20.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.884+0000 7fbefaffd700 1 -- 172.21.15.115:0/3396913976 learned_addr learned my addr 172.21.15.115:0/3396913976 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:20.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.884+0000 7fbefaffd700 1 -- 172.21.15.115:0/3396913976 >> v1:172.21.15.159:6789/0 conn(0x7fbefc153ec0 legacy=0x7fbefc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.884+0000 7fbefaffd700 1 -- 172.21.15.115:0/3396913976 >> v1:172.21.15.115:6789/0 conn(0x7fbefc1542a0 legacy=0x7fbefc0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.884+0000 7fbefaffd700 1 -- 172.21.15.115:0/3396913976 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0bfc90 con 0x7fbefc0aaa40 2023-07-27T14:31:20.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.884+0000 7fbefaffd700 1 --2- 172.21.15.115:0/3396913976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc0aaa40 0x7fbefc0640f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fbef0006fd0 tx=0x7fbef00090f0).ready entity=mon.0 client_cookie=acf94add11617980 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:20.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.884+0000 7fbefa7fc700 1 -- 172.21.15.115:0/3396913976 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000b600 con 0x7fbefc0aaa40 2023-07-27T14:31:20.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbefa7fc700 1 -- 172.21.15.115:0/3396913976 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000b760 con 0x7fbefc0aaa40 2023-07-27T14:31:20.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbefa7fc700 1 -- 172.21.15.115:0/3396913976 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000bae0 con 0x7fbefc0aaa40 2023-07-27T14:31:20.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbf01dff700 1 -- 172.21.15.115:0/3396913976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc0aaa40 msgr2=0x7fbefc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbf01dff700 1 --2- 172.21.15.115:0/3396913976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc0aaa40 0x7fbefc0640f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fbef0006fd0 tx=0x7fbef00090f0).stop 2023-07-27T14:31:20.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbf01dff700 1 -- 172.21.15.115:0/3396913976 shutdown_connections 2023-07-27T14:31:20.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbf01dff700 1 --2- 172.21.15.115:0/3396913976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc0aaa40 0x7fbefc0640f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbf01dff700 1 -- 172.21.15.115:0/3396913976 >> 172.21.15.115:0/3396913976 conn(0x7fbefc0cb610 msgr2=0x7fbefc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:20.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbf01dff700 1 -- 172.21.15.115:0/3396913976 shutdown_connections 2023-07-27T14:31:20.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.885+0000 7fbf01dff700 1 -- 172.21.15.115:0/3396913976 wait complete. 2023-07-27T14:31:20.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.887+0000 7fbf01dff700 1 Processor -- start 2023-07-27T14:31:20.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.887+0000 7fbf01dff700 1 -- start start 2023-07-27T14:31:20.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbf01dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbefc0aaa40 0x7fbefc152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbf01dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbefc153ec0 0x7fbefc14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbf01dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc1542a0 0x7fbefc151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbf01dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc151850 con 0x7fbefc1542a0 2023-07-27T14:31:20.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbf01dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc153070 con 0x7fbefc0aaa40 2023-07-27T14:31:20.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbf01dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc153350 con 0x7fbefc153ec0 2023-07-27T14:31:20.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc1542a0 0x7fbefc151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc1542a0 0x7fbefc151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39558/0 (socket says 172.21.15.115:39558) 2023-07-27T14:31:20.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefbfff700 1 -- 172.21.15.115:0/2656496332 learned_addr learned my addr 172.21.15.115:0/2656496332 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:20.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefaffd700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbefc153ec0 0x7fbefc14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefb7fe700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbefc0aaa40 0x7fbefc152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefbfff700 1 -- 172.21.15.115:0/2656496332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbefc153ec0 msgr2=0x7fbefc14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefbfff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbefc153ec0 0x7fbefc14e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefbfff700 1 -- 172.21.15.115:0/2656496332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbefc0aaa40 msgr2=0x7fbefc152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:20.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefbfff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbefc0aaa40 0x7fbefc152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:20.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.888+0000 7fbefbfff700 1 -- 172.21.15.115:0/2656496332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0009370 con 0x7fbefc1542a0 2023-07-27T14:31:20.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.889+0000 7fbefbfff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc1542a0 0x7fbefc151ce0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fbef400c7c0 tx=0x7fbef40014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:20.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.889+0000 7fbee37fe700 1 -- 172.21.15.115:0/2656496332 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400e4a0 con 0x7fbefc1542a0 2023-07-27T14:31:20.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.889+0000 7fbee37fe700 1 -- 172.21.15.115:0/2656496332 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef400e600 con 0x7fbefc1542a0 2023-07-27T14:31:20.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.889+0000 7fbee37fe700 1 -- 172.21.15.115:0/2656496332 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400e9a0 con 0x7fbefc1542a0 2023-07-27T14:31:20.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.889+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc151200 con 0x7fbefc1542a0 2023-07-27T14:31:20.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.889+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc152d50 con 0x7fbefc1542a0 2023-07-27T14:31:20.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.890+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc1519c0 con 0x7fbefc1542a0 2023-07-27T14:31:20.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.891+0000 7fbee37fe700 1 -- 172.21.15.115:0/2656496332 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fbef4010070 con 0x7fbefc1542a0 2023-07-27T14:31:20.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.892+0000 7fbee37fe700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee805f190 0x7fbee8061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:20.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.892+0000 7fbee37fe700 1 -- 172.21.15.115:0/2656496332 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbef40796e0 con 0x7fbefc1542a0 2023-07-27T14:31:20.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.892+0000 7fbefb7fe700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee805f190 0x7fbee8061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:20.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.892+0000 7fbefb7fe700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee805f190 0x7fbee8061650 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fbeec003900 tx=0x7fbeec007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:20.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:20.896+0000 7fbee37fe700 1 -- 172.21.15.115:0/2656496332 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbef40478f0 con 0x7fbefc1542a0 2023-07-27T14:31:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.066+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbefc0aa4d0 con 0x7fbefc1542a0 2023-07-27T14:31:21.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.067+0000 7fbee37fe700 1 -- 172.21.15.115:0/2656496332 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+17075 (secure 0 0 0) 0x7fbefc0aa4d0 con 0x7fbefc1542a0 2023-07-27T14:31:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:21.100 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":84,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:31:18.217713+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:31:15.629735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-27T14:31:16.202513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:31:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee805f190 msgr2=0x7fbee8061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee805f190 0x7fbee8061650 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fbeec003900 tx=0x7fbeec007d40).stop 2023-07-27T14:31:21.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc1542a0 msgr2=0x7fbefc151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc1542a0 0x7fbefc151ce0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fbef400c7c0 tx=0x7fbef40014e0).stop 2023-07-27T14:31:21.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 shutdown_connections 2023-07-27T14:31:21.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee805f190 0x7fbee8061650 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbefc1542a0 0x7fbefc151ce0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbefc0aaa40 0x7fbefc152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 --2- 172.21.15.115:0/2656496332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbefc153ec0 0x7fbefc14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 >> 172.21.15.115:0/2656496332 conn(0x7fbefc0cb610 msgr2=0x7fbefc0640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:21.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 shutdown_connections 2023-07-27T14:31:21.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.069+0000 7fbf01dff700 1 -- 172.21.15.115:0/2656496332 wait complete. 2023-07-27T14:31:21.119 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:31:21.120 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:31:21.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.275+0000 7fbdb49ff700 1 Processor -- start 2023-07-27T14:31:21.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.275+0000 7fbdb49ff700 1 -- start start 2023-07-27T14:31:21.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.276+0000 7fbdb49ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb0154060 0x7fbdb00bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.276+0000 7fbdb49ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb00c2ed0 con 0x7fbdb0154440 2023-07-27T14:31:21.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.276+0000 7fbdb49ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb00a58d0 con 0x7fbdb00a5390 2023-07-27T14:31:21.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.276+0000 7fbdb49ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00a5bb0 con 0x7fbdb0154060 2023-07-27T14:31:21.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdadd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbdb0154440 0x7fbdb00a4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47074/0 (socket says 172.21.15.115:47074) 2023-07-27T14:31:21.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdadd9b700 1 -- 172.21.15.115:0/2827942515 learned_addr learned my addr 172.21.15.115:0/2827942515 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:21.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52522132 0 0) 0x7fbdb00c2ed0 con 0x7fbdb0154440 2023-07-27T14:31:21.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdae59c700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb0154060 0x7fbdb00bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd980033f0 con 0x7fbdb0154440 2023-07-27T14:31:21.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374414929 0 0) 0x7fbd980033f0 con 0x7fbdb0154440 2023-07-27T14:31:21.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb0154060 msgr2=0x7fbdb00bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:21.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb0154060 0x7fbdb00bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 >> v1:172.21.15.159:6789/0 conn(0x7fbdb00a5390 legacy=0x7fbdb00c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb00a5e90 con 0x7fbdb0154440 2023-07-27T14:31:21.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fbda4001470 con 0x7fbdb0154440 2023-07-27T14:31:21.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.277+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 >> v1:172.21.15.115:6789/0 conn(0x7fbdb0154440 legacy=0x7fbdb00a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdad59a700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98003910 0x7fbd98003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdad59a700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb0154060 0x7fbd98004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdad59a700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd98004b80 0x7fbd98005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00a5bb0 con 0x7fbd98004b80 2023-07-27T14:31:21.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9800b910 con 0x7fbd98003910 2023-07-27T14:31:21.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9800bad0 con 0x7fbdb0154060 2023-07-27T14:31:21.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdaed9d700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd98004b80 0x7fbd98005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdae59c700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98003910 0x7fbd98003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdadd9b700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb0154060 0x7fbd98004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdaed9d700 1 -- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb0154060 msgr2=0x7fbd98004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:21.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdaed9d700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb0154060 0x7fbd98004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdaed9d700 1 -- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98003910 msgr2=0x7fbd98003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:21.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdaed9d700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98003910 0x7fbd98003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdaed9d700 1 -- 172.21.15.115:0/2827942515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd980033f0 con 0x7fbd98004b80 2023-07-27T14:31:21.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.278+0000 7fbdaed9d700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd98004b80 0x7fbd98005000 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7fbda8001e30 tx=0x7fbda8007f30).ready entity=mon.0 client_cookie=791ce382cac79158 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:21.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8006a20 con 0x7fbd98004b80 2023-07-27T14:31:21.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8006b80 con 0x7fbd98004b80 2023-07-27T14:31:21.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdad59a700 1 -- 172.21.15.115:0/2827942515 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda800c5d0 con 0x7fbd98004b80 2023-07-27T14:31:21.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdb49ff700 1 -- 172.21.15.115:0/2827942515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd98004b80 msgr2=0x7fbd98005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdb49ff700 1 --2- 172.21.15.115:0/2827942515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd98004b80 0x7fbd98005000 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7fbda8001e30 tx=0x7fbda8007f30).stop 2023-07-27T14:31:21.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdaed9d700 1 -- 172.21.15.115:0/2827942515 reap_dead start 2023-07-27T14:31:21.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdb49ff700 1 -- 172.21.15.115:0/2827942515 shutdown_connections 2023-07-27T14:31:21.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdb49ff700 1 -- 172.21.15.115:0/2827942515 >> 172.21.15.115:0/2827942515 conn(0x7fbdb0062320 msgr2=0x7fbdb0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:21.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdb49ff700 1 -- 172.21.15.115:0/2827942515 shutdown_connections 2023-07-27T14:31:21.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.279+0000 7fbdb49ff700 1 -- 172.21.15.115:0/2827942515 wait complete. 2023-07-27T14:31:21.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.281+0000 7fbdb49ff700 1 Processor -- start 2023-07-27T14:31:21.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.281+0000 7fbdb49ff700 1 -- start start 2023-07-27T14:31:21.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdb49ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98004b80 0x7fbdb00ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdb49ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdb01642e0 0x7fbdb0168200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdb49ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb014b280 0x7fbdb014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdb49ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00acdf0 con 0x7fbdb01642e0 2023-07-27T14:31:21.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdb49ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0156bb0 con 0x7fbd98004b80 2023-07-27T14:31:21.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdb49ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0164740 con 0x7fbdb014b280 2023-07-27T14:31:21.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdadd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdb01642e0 0x7fbdb0168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdadd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdb01642e0 0x7fbdb0168200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39576/0 (socket says 172.21.15.115:39576) 2023-07-27T14:31:21.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdadd9b700 1 -- 172.21.15.115:0/3041979977 learned_addr learned my addr 172.21.15.115:0/3041979977 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:21.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdaed9d700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb014b280 0x7fbdb014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdae59c700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98004b80 0x7fbdb00ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdadd9b700 1 -- 172.21.15.115:0/3041979977 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb014b280 msgr2=0x7fbdb014b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdadd9b700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb014b280 0x7fbdb014b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdadd9b700 1 -- 172.21.15.115:0/3041979977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98004b80 msgr2=0x7fbdb00ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdadd9b700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98004b80 0x7fbdb00ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.282+0000 7fbdadd9b700 1 -- 172.21.15.115:0/3041979977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb0156e50 con 0x7fbdb01642e0 2023-07-27T14:31:21.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.283+0000 7fbdadd9b700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdb01642e0 0x7fbdb0168200 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fbda4007fd0 tx=0x7fbdb00c2e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:21.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.283+0000 7fbd9e7fc700 1 -- 172.21.15.115:0/3041979977 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4011590 con 0x7fbdb01642e0 2023-07-27T14:31:21.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.283+0000 7fbd9e7fc700 1 -- 172.21.15.115:0/3041979977 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda40116f0 con 0x7fbdb01642e0 2023-07-27T14:31:21.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.283+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb0157130 con 0x7fbdb01642e0 2023-07-27T14:31:21.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.283+0000 7fbd9e7fc700 1 -- 172.21.15.115:0/3041979977 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4011a70 con 0x7fbdb01642e0 2023-07-27T14:31:21.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.283+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb01686f0 con 0x7fbdb01642e0 2023-07-27T14:31:21.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.284+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb0157650 con 0x7fbdb01642e0 2023-07-27T14:31:21.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.285+0000 7fbd9e7fc700 1 -- 172.21.15.115:0/3041979977 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fbda401b030 con 0x7fbdb01642e0 2023-07-27T14:31:21.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.285+0000 7fbd9e7fc700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd9005f1f0 0x7fbd900616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.285+0000 7fbd9e7fc700 1 -- 172.21.15.115:0/3041979977 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbda4079970 con 0x7fbdb01642e0 2023-07-27T14:31:21.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.286+0000 7fbdae59c700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd9005f1f0 0x7fbd900616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.286+0000 7fbdae59c700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd9005f1f0 0x7fbd900616b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fbda0006d50 tx=0x7fbda0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:21.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.289+0000 7fbd9e7fc700 1 -- 172.21.15.115:0/3041979977 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbdb0157650 con 0x7fbdb01642e0 2023-07-27T14:31:21.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.455+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdb0157650 con 0x7fbd9005f1f0 2023-07-27T14:31:21.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.465+0000 7fbd9e7fc700 1 -- 172.21.15.115:0/3041979977 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361292 (secure 0 0 0) 0x7fbdb0157650 con 0x7fbd9005f1f0 2023-07-27T14:31:21.501 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:21.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.469+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd9005f1f0 msgr2=0x7fbd900616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.469+0000 7fbdb49ff700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd9005f1f0 0x7fbd900616b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fbda0006d50 tx=0x7fbda0008040).stop 2023-07-27T14:31:21.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdb01642e0 msgr2=0x7fbdb0168200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdb01642e0 0x7fbdb0168200 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fbda4007fd0 tx=0x7fbdb00c2e40).stop 2023-07-27T14:31:21.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 shutdown_connections 2023-07-27T14:31:21.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd9005f1f0 0x7fbd900616b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdb014b280 0x7fbdb014b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd98004b80 0x7fbdb00ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 --2- 172.21.15.115:0/3041979977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdb01642e0 0x7fbdb0168200 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 >> 172.21.15.115:0/3041979977 conn(0x7fbdb0062320 msgr2=0x7fbdb0151560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:21.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 shutdown_connections 2023-07-27T14:31:21.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.470+0000 7fbdb49ff700 1 -- 172.21.15.115:0/3041979977 wait complete. 2023-07-27T14:31:21.505 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:31:21.519 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2023-07-27T14:31:19.494587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83256,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":75200,"kb_avail":754891464,"statfs":{"total":773094113280,"available":773008859136,"internally_reserved":0,"allocated":8183808,"data_stored":3739740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77004800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2823684,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-12,"num_read_kb":-31,"num_write":-553,"num_write_kb":-207647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-8,"num_bytes_recovered":-7340270,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.131548"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.235505+0000","last_change":"2023-07-27T14:31:17.235505+0000","last_active":"2023-07-27T14:31:17.235505+0000","last_peered":"2023-07-27T14:31:17.235505+0000","last_clean":"2023-07-27T14:31:17.235505+0000","last_became_active":"2023-07-27T14:31:17.235224+0000","last_became_peered":"2023-07-27T14:31:17.235224+0000","last_unstale":"2023-07-27T14:31:17.235505+0000","last_undegraded":"2023-07-27T14:31:17.235505+0000","last_fullsized":"2023-07-27T14:31:17.235505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"83'3","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250649+0000","last_change":"2023-07-27T14:31:16.788326+0000","last_active":"2023-07-27T14:31:17.250649+0000","last_peered":"2023-07-27T14:31:17.250649+0000","last_clean":"2023-07-27T14:31:17.250649+0000","last_became_active":"2023-07-27T14:31:16.788004+0000","last_became_peered":"2023-07-27T14:31:16.788004+0000","last_unstale":"2023-07-27T14:31:17.250649+0000","last_undegraded":"2023-07-27T14:31:17.250649+0000","last_fullsized":"2023-07-27T14:31:17.250649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250952+0000","last_change":"2023-07-27T14:31:17.250952+0000","last_active":"2023-07-27T14:31:17.250952+0000","last_peered":"2023-07-27T14:31:17.250952+0000","last_clean":"2023-07-27T14:31:17.250952+0000","last_became_active":"2023-07-27T14:31:17.250598+0000","last_became_peered":"2023-07-27T14:31:17.250598+0000","last_unstale":"2023-07-27T14:31:17.250952+0000","last_undegraded":"2023-07-27T14:31:17.250952+0000","last_fullsized":"2023-07-27T14:31:17.250952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790003+0000","last_change":"2023-07-27T14:31:16.782281+0000","last_active":"2023-07-27T14:31:16.790003+0000","last_peered":"2023-07-27T14:31:16.790003+0000","last_clean":"2023-07-27T14:31:16.790003+0000","last_became_active":"2023-07-27T14:31:16.782010+0000","last_became_peered":"2023-07-27T14:31:16.782010+0000","last_unstale":"2023-07-27T14:31:16.790003+0000","last_undegraded":"2023-07-27T14:31:16.790003+0000","last_fullsized":"2023-07-27T14:31:16.790003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245572+0000","last_change":"2023-07-27T14:31:17.241047+0000","last_active":"2023-07-27T14:31:17.245572+0000","last_peered":"2023-07-27T14:31:17.245572+0000","last_clean":"2023-07-27T14:31:17.245572+0000","last_became_active":"2023-07-27T14:31:17.240737+0000","last_became_peered":"2023-07-27T14:31:17.240737+0000","last_unstale":"2023-07-27T14:31:17.245572+0000","last_undegraded":"2023-07-27T14:31:17.245572+0000","last_fullsized":"2023-07-27T14:31:17.245572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221238+0000","last_change":"2023-07-27T14:31:16.778699+0000","last_active":"2023-07-27T14:31:17.221238+0000","last_peered":"2023-07-27T14:31:17.221238+0000","last_clean":"2023-07-27T14:31:17.221238+0000","last_became_active":"2023-07-27T14:31:16.778351+0000","last_became_peered":"2023-07-27T14:31:16.778351+0000","last_unstale":"2023-07-27T14:31:17.221238+0000","last_undegraded":"2023-07-27T14:31:17.221238+0000","last_fullsized":"2023-07-27T14:31:17.221238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.241680+0000","last_change":"2023-07-27T14:31:17.241680+0000","last_active":"2023-07-27T14:31:17.241680+0000","last_peered":"2023-07-27T14:31:17.241680+0000","last_clean":"2023-07-27T14:31:17.241680+0000","last_became_active":"2023-07-27T14:31:17.241408+0000","last_became_peered":"2023-07-27T14:31:17.241408+0000","last_unstale":"2023-07-27T14:31:17.241680+0000","last_undegraded":"2023-07-27T14:31:17.241680+0000","last_fullsized":"2023-07-27T14:31:17.241680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245035+0000","last_change":"2023-07-27T14:31:16.780648+0000","last_active":"2023-07-27T14:31:17.245035+0000","last_peered":"2023-07-27T14:31:17.245035+0000","last_clean":"2023-07-27T14:31:17.245035+0000","last_became_active":"2023-07-27T14:31:16.780370+0000","last_became_peered":"2023-07-27T14:31:16.780370+0000","last_unstale":"2023-07-27T14:31:17.245035+0000","last_undegraded":"2023-07-27T14:31:17.245035+0000","last_fullsized":"2023-07-27T14:31:17.245035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246068+0000","last_change":"2023-07-27T14:31:17.246068+0000","last_active":"2023-07-27T14:31:17.246068+0000","last_peered":"2023-07-27T14:31:17.246068+0000","last_clean":"2023-07-27T14:31:17.246068+0000","last_became_active":"2023-07-27T14:31:17.245780+0000","last_became_peered":"2023-07-27T14:31:17.245780+0000","last_unstale":"2023-07-27T14:31:17.246068+0000","last_undegraded":"2023-07-27T14:31:17.246068+0000","last_fullsized":"2023-07-27T14:31:17.246068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.227364+0000","last_change":"2023-07-27T14:31:16.783048+0000","last_active":"2023-07-27T14:31:17.227364+0000","last_peered":"2023-07-27T14:31:17.227364+0000","last_clean":"2023-07-27T14:31:17.227364+0000","last_became_active":"2023-07-27T14:31:16.782803+0000","last_became_peered":"2023-07-27T14:31:16.782803+0000","last_unstale":"2023-07-27T14:31:17.227364+0000","last_undegraded":"2023-07-27T14:31:17.227364+0000","last_fullsized":"2023-07-27T14:31:17.227364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250139+0000","last_change":"2023-07-27T14:31:17.250139+0000","last_active":"2023-07-27T14:31:17.250139+0000","last_peered":"2023-07-27T14:31:17.250139+0000","last_clean":"2023-07-27T14:31:17.250139+0000","last_became_active":"2023-07-27T14:31:17.249855+0000","last_became_peered":"2023-07-27T14:31:17.249855+0000","last_unstale":"2023-07-27T14:31:17.250139+0000","last_undegraded":"2023-07-27T14:31:17.250139+0000","last_fullsized":"2023-07-27T14:31:17.250139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.224536+0000","last_change":"2023-07-27T14:31:16.776222+0000","last_active":"2023-07-27T14:31:17.224536+0000","last_peered":"2023-07-27T14:31:17.224536+0000","last_clean":"2023-07-27T14:31:17.224536+0000","last_became_active":"2023-07-27T14:31:16.775951+0000","last_became_peered":"2023-07-27T14:31:16.775951+0000","last_unstale":"2023-07-27T14:31:17.224536+0000","last_undegraded":"2023-07-27T14:31:17.224536+0000","last_fullsized":"2023-07-27T14:31:17.224536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246049+0000","last_change":"2023-07-27T14:31:17.246049+0000","last_active":"2023-07-27T14:31:17.246049+0000","last_peered":"2023-07-27T14:31:17.246049+0000","last_clean":"2023-07-27T14:31:17.246049+0000","last_became_active":"2023-07-27T14:31:17.245768+0000","last_became_peered":"2023-07-27T14:31:17.245768+0000","last_unstale":"2023-07-27T14:31:17.246049+0000","last_undegraded":"2023-07-27T14:31:17.246049+0000","last_fullsized":"2023-07-27T14:31:17.246049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789175+0000","last_change":"2023-07-27T14:31:16.783160+0000","last_active":"2023-07-27T14:31:16.789175+0000","last_peered":"2023-07-27T14:31:16.789175+0000","last_clean":"2023-07-27T14:31:16.789175+0000","last_became_active":"2023-07-27T14:31:16.782874+0000","last_became_peered":"2023-07-27T14:31:16.782874+0000","last_unstale":"2023-07-27T14:31:16.789175+0000","last_undegraded":"2023-07-27T14:31:16.789175+0000","last_fullsized":"2023-07-27T14:31:16.789175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243883+0000","last_change":"2023-07-27T14:31:17.232184+0000","last_active":"2023-07-27T14:31:17.243883+0000","last_peered":"2023-07-27T14:31:17.243883+0000","last_clean":"2023-07-27T14:31:17.243883+0000","last_became_active":"2023-07-27T14:31:17.231880+0000","last_became_peered":"2023-07-27T14:31:17.231880+0000","last_unstale":"2023-07-27T14:31:17.243883+0000","last_undegraded":"2023-07-27T14:31:17.243883+0000","last_fullsized":"2023-07-27T14:31:17.243883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789311+0000","last_change":"2023-07-27T14:31:16.780819+0000","last_active":"2023-07-27T14:31:16.789311+0000","last_peered":"2023-07-27T14:31:16.789311+0000","last_clean":"2023-07-27T14:31:16.789311+0000","last_became_active":"2023-07-27T14:31:16.780376+0000","last_became_peered":"2023-07-27T14:31:16.780376+0000","last_unstale":"2023-07-27T14:31:16.789311+0000","last_undegraded":"2023-07-27T14:31:16.789311+0000","last_fullsized":"2023-07-27T14:31:16.789311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240599+0000","last_change":"2023-07-27T14:31:17.229878+0000","last_active":"2023-07-27T14:31:17.240599+0000","last_peered":"2023-07-27T14:31:17.240599+0000","last_clean":"2023-07-27T14:31:17.240599+0000","last_became_active":"2023-07-27T14:31:17.229059+0000","last_became_peered":"2023-07-27T14:31:17.229059+0000","last_unstale":"2023-07-27T14:31:17.240599+0000","last_undegraded":"2023-07-27T14:31:17.240599+0000","last_fullsized":"2023-07-27T14:31:17.240599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793436+0000","last_change":"2023-07-27T14:31:16.785109+0000","last_active":"2023-07-27T14:31:16.793436+0000","last_peered":"2023-07-27T14:31:16.793436+0000","last_clean":"2023-07-27T14:31:16.793436+0000","last_became_active":"2023-07-27T14:31:16.784793+0000","last_became_peered":"2023-07-27T14:31:16.784793+0000","last_unstale":"2023-07-27T14:31:16.793436+0000","last_undegraded":"2023-07-27T14:31:16.793436+0000","last_fullsized":"2023-07-27T14:31:16.793436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.242913+0000","last_change":"2023-07-27T14:31:17.242913+0000","last_active":"2023-07-27T14:31:17.242913+0000","last_peered":"2023-07-27T14:31:17.242913+0000","last_clean":"2023-07-27T14:31:17.242913+0000","last_became_active":"2023-07-27T14:31:17.242648+0000","last_became_peered":"2023-07-27T14:31:17.242648+0000","last_unstale":"2023-07-27T14:31:17.242913+0000","last_undegraded":"2023-07-27T14:31:17.242913+0000","last_fullsized":"2023-07-27T14:31:17.242913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790823+0000","last_change":"2023-07-27T14:31:16.787936+0000","last_active":"2023-07-27T14:31:16.790823+0000","last_peered":"2023-07-27T14:31:16.790823+0000","last_clean":"2023-07-27T14:31:16.790823+0000","last_became_active":"2023-07-27T14:31:16.787590+0000","last_became_peered":"2023-07-27T14:31:16.787590+0000","last_unstale":"2023-07-27T14:31:16.790823+0000","last_undegraded":"2023-07-27T14:31:16.790823+0000","last_fullsized":"2023-07-27T14:31:16.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245556+0000","last_change":"2023-07-27T14:31:17.240998+0000","last_active":"2023-07-27T14:31:17.245556+0000","last_peered":"2023-07-27T14:31:17.245556+0000","last_clean":"2023-07-27T14:31:17.245556+0000","last_became_active":"2023-07-27T14:31:17.240412+0000","last_became_peered":"2023-07-27T14:31:17.240412+0000","last_unstale":"2023-07-27T14:31:17.245556+0000","last_undegraded":"2023-07-27T14:31:17.245556+0000","last_fullsized":"2023-07-27T14:31:17.245556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.222174+0000","last_change":"2023-07-27T14:31:16.781936+0000","last_active":"2023-07-27T14:31:17.222174+0000","last_peered":"2023-07-27T14:31:17.222174+0000","last_clean":"2023-07-27T14:31:17.222174+0000","last_became_active":"2023-07-27T14:31:16.781579+0000","last_became_peered":"2023-07-27T14:31:16.781579+0000","last_unstale":"2023-07-27T14:31:17.222174+0000","last_undegraded":"2023-07-27T14:31:17.222174+0000","last_fullsized":"2023-07-27T14:31:17.222174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245255+0000","last_change":"2023-07-27T14:31:17.245255+0000","last_active":"2023-07-27T14:31:17.245255+0000","last_peered":"2023-07-27T14:31:17.245255+0000","last_clean":"2023-07-27T14:31:17.245255+0000","last_became_active":"2023-07-27T14:31:17.244919+0000","last_became_peered":"2023-07-27T14:31:17.244919+0000","last_unstale":"2023-07-27T14:31:17.245255+0000","last_undegraded":"2023-07-27T14:31:17.245255+0000","last_fullsized":"2023-07-27T14:31:17.245255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"83'4","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250562+0000","last_change":"2023-07-27T14:31:16.786211+0000","last_active":"2023-07-27T14:31:17.250562+0000","last_peered":"2023-07-27T14:31:17.250562+0000","last_clean":"2023-07-27T14:31:17.250562+0000","last_became_active":"2023-07-27T14:31:16.785903+0000","last_became_peered":"2023-07-27T14:31:16.785903+0000","last_unstale":"2023-07-27T14:31:17.250562+0000","last_undegraded":"2023-07-27T14:31:17.250562+0000","last_fullsized":"2023-07-27T14:31:17.250562+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.238554+0000","last_change":"2023-07-27T14:31:17.238554+0000","last_active":"2023-07-27T14:31:17.238554+0000","last_peered":"2023-07-27T14:31:17.238554+0000","last_clean":"2023-07-27T14:31:17.238554+0000","last_became_active":"2023-07-27T14:31:17.238252+0000","last_became_peered":"2023-07-27T14:31:17.238252+0000","last_unstale":"2023-07-27T14:31:17.238554+0000","last_undegraded":"2023-07-27T14:31:17.238554+0000","last_fullsized":"2023-07-27T14:31:17.238554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.224752+0000","last_change":"2023-07-27T14:31:16.773601+0000","last_active":"2023-07-27T14:31:17.224752+0000","last_peered":"2023-07-27T14:31:17.224752+0000","last_clean":"2023-07-27T14:31:17.224752+0000","last_became_active":"2023-07-27T14:31:16.773347+0000","last_became_peered":"2023-07-27T14:31:16.773347+0000","last_unstale":"2023-07-27T14:31:17.224752+0000","last_undegraded":"2023-07-27T14:31:17.224752+0000","last_fullsized":"2023-07-27T14:31:17.224752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246101+0000","last_change":"2023-07-27T14:31:17.246101+0000","last_active":"2023-07-27T14:31:17.246101+0000","last_peered":"2023-07-27T14:31:17.246101+0000","last_clean":"2023-07-27T14:31:17.246101+0000","last_became_active":"2023-07-27T14:31:17.245815+0000","last_became_peered":"2023-07-27T14:31:17.245815+0000","last_unstale":"2023-07-27T14:31:17.246101+0000","last_undegraded":"2023-07-27T14:31:17.246101+0000","last_fullsized":"2023-07-27T14:31:17.246101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793470+0000","last_change":"2023-07-27T14:31:16.784439+0000","last_active":"2023-07-27T14:31:16.793470+0000","last_peered":"2023-07-27T14:31:16.793470+0000","last_clean":"2023-07-27T14:31:16.793470+0000","last_became_active":"2023-07-27T14:31:16.784067+0000","last_became_peered":"2023-07-27T14:31:16.784067+0000","last_unstale":"2023-07-27T14:31:16.793470+0000","last_undegraded":"2023-07-27T14:31:16.793470+0000","last_fullsized":"2023-07-27T14:31:16.793470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.238119+0000","last_change":"2023-07-27T14:31:17.238119+0000","last_active":"2023-07-27T14:31:17.238119+0000","last_peered":"2023-07-27T14:31:17.238119+0000","last_clean":"2023-07-27T14:31:17.238119+0000","last_became_active":"2023-07-27T14:31:17.237837+0000","last_became_peered":"2023-07-27T14:31:17.237837+0000","last_unstale":"2023-07-27T14:31:17.238119+0000","last_undegraded":"2023-07-27T14:31:17.238119+0000","last_fullsized":"2023-07-27T14:31:17.238119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789243+0000","last_change":"2023-07-27T14:31:16.786362+0000","last_active":"2023-07-27T14:31:16.789243+0000","last_peered":"2023-07-27T14:31:16.789243+0000","last_clean":"2023-07-27T14:31:16.789243+0000","last_became_active":"2023-07-27T14:31:16.786021+0000","last_became_peered":"2023-07-27T14:31:16.786021+0000","last_unstale":"2023-07-27T14:31:16.789243+0000","last_undegraded":"2023-07-27T14:31:16.789243+0000","last_fullsized":"2023-07-27T14:31:16.789243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.236035+0000","last_change":"2023-07-27T14:31:17.236035+0000","last_active":"2023-07-27T14:31:17.236035+0000","last_peered":"2023-07-27T14:31:17.236035+0000","last_clean":"2023-07-27T14:31:17.236035+0000","last_became_active":"2023-07-27T14:31:17.235634+0000","last_became_peered":"2023-07-27T14:31:17.235634+0000","last_unstale":"2023-07-27T14:31:17.236035+0000","last_undegraded":"2023-07-27T14:31:17.236035+0000","last_fullsized":"2023-07-27T14:31:17.236035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"83'4","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250602+0000","last_change":"2023-07-27T14:31:16.775124+0000","last_active":"2023-07-27T14:31:17.250602+0000","last_peered":"2023-07-27T14:31:17.250602+0000","last_clean":"2023-07-27T14:31:17.250602+0000","last_became_active":"2023-07-27T14:31:16.774804+0000","last_became_peered":"2023-07-27T14:31:16.774804+0000","last_unstale":"2023-07-27T14:31:17.250602+0000","last_undegraded":"2023-07-27T14:31:17.250602+0000","last_fullsized":"2023-07-27T14:31:17.250602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.239521+0000","last_change":"2023-07-27T14:31:17.239521+0000","last_active":"2023-07-27T14:31:17.239521+0000","last_peered":"2023-07-27T14:31:17.239521+0000","last_clean":"2023-07-27T14:31:17.239521+0000","last_became_active":"2023-07-27T14:31:17.239236+0000","last_became_peered":"2023-07-27T14:31:17.239236+0000","last_unstale":"2023-07-27T14:31:17.239521+0000","last_undegraded":"2023-07-27T14:31:17.239521+0000","last_fullsized":"2023-07-27T14:31:17.239521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793458+0000","last_change":"2023-07-27T14:31:16.785635+0000","last_active":"2023-07-27T14:31:16.793458+0000","last_peered":"2023-07-27T14:31:16.793458+0000","last_clean":"2023-07-27T14:31:16.793458+0000","last_became_active":"2023-07-27T14:31:16.785351+0000","last_became_peered":"2023-07-27T14:31:16.785351+0000","last_unstale":"2023-07-27T14:31:16.793458+0000","last_undegraded":"2023-07-27T14:31:16.793458+0000","last_fullsized":"2023-07-27T14:31:16.793458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.233010+0000","last_change":"2023-07-27T14:31:17.233010+0000","last_active":"2023-07-27T14:31:17.233010+0000","last_peered":"2023-07-27T14:31:17.233010+0000","last_clean":"2023-07-27T14:31:17.233010+0000","last_became_active":"2023-07-27T14:31:17.232731+0000","last_became_peered":"2023-07-27T14:31:17.232731+0000","last_unstale":"2023-07-27T14:31:17.233010+0000","last_undegraded":"2023-07-27T14:31:17.233010+0000","last_fullsized":"2023-07-27T14:31:17.233010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790476+0000","last_change":"2023-07-27T14:31:16.786485+0000","last_active":"2023-07-27T14:31:16.790476+0000","last_peered":"2023-07-27T14:31:16.790476+0000","last_clean":"2023-07-27T14:31:16.790476+0000","last_became_active":"2023-07-27T14:31:16.786228+0000","last_became_peered":"2023-07-27T14:31:16.786228+0000","last_unstale":"2023-07-27T14:31:16.790476+0000","last_undegraded":"2023-07-27T14:31:16.790476+0000","last_fullsized":"2023-07-27T14:31:16.790476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.235954+0000","last_change":"2023-07-27T14:31:17.235954+0000","last_active":"2023-07-27T14:31:17.235954+0000","last_peered":"2023-07-27T14:31:17.235954+0000","last_clean":"2023-07-27T14:31:17.235954+0000","last_became_active":"2023-07-27T14:31:17.235624+0000","last_became_peered":"2023-07-27T14:31:17.235624+0000","last_unstale":"2023-07-27T14:31:17.235954+0000","last_undegraded":"2023-07-27T14:31:17.235954+0000","last_fullsized":"2023-07-27T14:31:17.235954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.226540+0000","last_change":"2023-07-27T14:31:16.781796+0000","last_active":"2023-07-27T14:31:17.226540+0000","last_peered":"2023-07-27T14:31:17.226540+0000","last_clean":"2023-07-27T14:31:17.226540+0000","last_became_active":"2023-07-27T14:31:16.781214+0000","last_became_peered":"2023-07-27T14:31:16.781214+0000","last_unstale":"2023-07-27T14:31:17.226540+0000","last_undegraded":"2023-07-27T14:31:17.226540+0000","last_fullsized":"2023-07-27T14:31:17.226540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244153+0000","last_change":"2023-07-27T14:31:17.244153+0000","last_active":"2023-07-27T14:31:17.244153+0000","last_peered":"2023-07-27T14:31:17.244153+0000","last_clean":"2023-07-27T14:31:17.244153+0000","last_became_active":"2023-07-27T14:31:17.243837+0000","last_became_peered":"2023-07-27T14:31:17.243837+0000","last_unstale":"2023-07-27T14:31:17.244153+0000","last_undegraded":"2023-07-27T14:31:17.244153+0000","last_fullsized":"2023-07-27T14:31:17.244153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.780774+0000","last_change":"2023-07-27T14:31:16.776248+0000","last_active":"2023-07-27T14:31:16.780774+0000","last_peered":"2023-07-27T14:31:16.780774+0000","last_clean":"2023-07-27T14:31:16.780774+0000","last_became_active":"2023-07-27T14:31:16.775917+0000","last_became_peered":"2023-07-27T14:31:16.775917+0000","last_unstale":"2023-07-27T14:31:16.780774+0000","last_undegraded":"2023-07-27T14:31:16.780774+0000","last_fullsized":"2023-07-27T14:31:16.780774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.238533+0000","last_change":"2023-07-27T14:31:17.238533+0000","last_active":"2023-07-27T14:31:17.238533+0000","last_peered":"2023-07-27T14:31:17.238533+0000","last_clean":"2023-07-27T14:31:17.238533+0000","last_became_active":"2023-07-27T14:31:17.238249+0000","last_became_peered":"2023-07-27T14:31:17.238249+0000","last_unstale":"2023-07-27T14:31:17.238533+0000","last_undegraded":"2023-07-27T14:31:17.238533+0000","last_fullsized":"2023-07-27T14:31:17.238533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.229319+0000","last_change":"2023-07-27T14:31:16.778960+0000","last_active":"2023-07-27T14:31:17.229319+0000","last_peered":"2023-07-27T14:31:17.229319+0000","last_clean":"2023-07-27T14:31:17.229319+0000","last_became_active":"2023-07-27T14:31:16.778121+0000","last_became_peered":"2023-07-27T14:31:16.778121+0000","last_unstale":"2023-07-27T14:31:17.229319+0000","last_undegraded":"2023-07-27T14:31:17.229319+0000","last_fullsized":"2023-07-27T14:31:17.229319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247004+0000","last_change":"2023-07-27T14:31:17.236501+0000","last_active":"2023-07-27T14:31:17.247004+0000","last_peered":"2023-07-27T14:31:17.247004+0000","last_clean":"2023-07-27T14:31:17.247004+0000","last_became_active":"2023-07-27T14:31:17.236239+0000","last_became_peered":"2023-07-27T14:31:17.236239+0000","last_unstale":"2023-07-27T14:31:17.247004+0000","last_undegraded":"2023-07-27T14:31:17.247004+0000","last_fullsized":"2023-07-27T14:31:17.247004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790484+0000","last_change":"2023-07-27T14:31:16.788123+0000","last_active":"2023-07-27T14:31:16.790484+0000","last_peered":"2023-07-27T14:31:16.790484+0000","last_clean":"2023-07-27T14:31:16.790484+0000","last_became_active":"2023-07-27T14:31:16.787855+0000","last_became_peered":"2023-07-27T14:31:16.787855+0000","last_unstale":"2023-07-27T14:31:16.790484+0000","last_undegraded":"2023-07-27T14:31:16.790484+0000","last_fullsized":"2023-07-27T14:31:16.790484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.248037+0000","last_change":"2023-07-27T14:31:17.248037+0000","last_active":"2023-07-27T14:31:17.248037+0000","last_peered":"2023-07-27T14:31:17.248037+0000","last_clean":"2023-07-27T14:31:17.248037+0000","last_became_active":"2023-07-27T14:31:17.247769+0000","last_became_peered":"2023-07-27T14:31:17.247769+0000","last_unstale":"2023-07-27T14:31:17.248037+0000","last_undegraded":"2023-07-27T14:31:17.248037+0000","last_fullsized":"2023-07-27T14:31:17.248037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221094+0000","last_change":"2023-07-27T14:31:16.783790+0000","last_active":"2023-07-27T14:31:17.221094+0000","last_peered":"2023-07-27T14:31:17.221094+0000","last_clean":"2023-07-27T14:31:17.221094+0000","last_became_active":"2023-07-27T14:31:16.783440+0000","last_became_peered":"2023-07-27T14:31:16.783440+0000","last_unstale":"2023-07-27T14:31:17.221094+0000","last_undegraded":"2023-07-27T14:31:17.221094+0000","last_fullsized":"2023-07-27T14:31:17.221094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244328+0000","last_change":"2023-07-27T14:31:17.244328+0000","last_active":"2023-07-27T14:31:17.244328+0000","last_peered":"2023-07-27T14:31:17.244328+0000","last_clean":"2023-07-27T14:31:17.244328+0000","last_became_active":"2023-07-27T14:31:17.244057+0000","last_became_peered":"2023-07-27T14:31:17.244057+0000","last_unstale":"2023-07-27T14:31:17.244328+0000","last_undegraded":"2023-07-27T14:31:17.244328+0000","last_fullsized":"2023-07-27T14:31:17.244328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221333+0000","last_change":"2023-07-27T14:31:16.791286+0000","last_active":"2023-07-27T14:31:17.221333+0000","last_peered":"2023-07-27T14:31:17.221333+0000","last_clean":"2023-07-27T14:31:17.221333+0000","last_became_active":"2023-07-27T14:31:16.790891+0000","last_became_peered":"2023-07-27T14:31:16.790891+0000","last_unstale":"2023-07-27T14:31:17.221333+0000","last_undegraded":"2023-07-27T14:31:17.221333+0000","last_fullsized":"2023-07-27T14:31:17.221333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245774+0000","last_change":"2023-07-27T14:31:17.243000+0000","last_active":"2023-07-27T14:31:17.245774+0000","last_peered":"2023-07-27T14:31:17.245774+0000","last_clean":"2023-07-27T14:31:17.245774+0000","last_became_active":"2023-07-27T14:31:17.242654+0000","last_became_peered":"2023-07-27T14:31:17.242654+0000","last_unstale":"2023-07-27T14:31:17.245774+0000","last_undegraded":"2023-07-27T14:31:17.245774+0000","last_fullsized":"2023-07-27T14:31:17.245774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.785176+0000","last_change":"2023-07-27T14:31:16.778458+0000","last_active":"2023-07-27T14:31:16.785176+0000","last_peered":"2023-07-27T14:31:16.785176+0000","last_clean":"2023-07-27T14:31:16.785176+0000","last_became_active":"2023-07-27T14:31:16.778157+0000","last_became_peered":"2023-07-27T14:31:16.778157+0000","last_unstale":"2023-07-27T14:31:16.785176+0000","last_undegraded":"2023-07-27T14:31:16.785176+0000","last_fullsized":"2023-07-27T14:31:16.785176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243112+0000","last_change":"2023-07-27T14:31:17.243112+0000","last_active":"2023-07-27T14:31:17.243112+0000","last_peered":"2023-07-27T14:31:17.243112+0000","last_clean":"2023-07-27T14:31:17.243112+0000","last_became_active":"2023-07-27T14:31:17.242784+0000","last_became_peered":"2023-07-27T14:31:17.242784+0000","last_unstale":"2023-07-27T14:31:17.243112+0000","last_undegraded":"2023-07-27T14:31:17.243112+0000","last_fullsized":"2023-07-27T14:31:17.243112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790065+0000","last_change":"2023-07-27T14:31:16.786829+0000","last_active":"2023-07-27T14:31:16.790065+0000","last_peered":"2023-07-27T14:31:16.790065+0000","last_clean":"2023-07-27T14:31:16.790065+0000","last_became_active":"2023-07-27T14:31:16.786566+0000","last_became_peered":"2023-07-27T14:31:16.786566+0000","last_unstale":"2023-07-27T14:31:16.790065+0000","last_undegraded":"2023-07-27T14:31:16.790065+0000","last_fullsized":"2023-07-27T14:31:16.790065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245195+0000","last_change":"2023-07-27T14:31:17.240262+0000","last_active":"2023-07-27T14:31:17.245195+0000","last_peered":"2023-07-27T14:31:17.245195+0000","last_clean":"2023-07-27T14:31:17.245195+0000","last_became_active":"2023-07-27T14:31:17.239944+0000","last_became_peered":"2023-07-27T14:31:17.239944+0000","last_unstale":"2023-07-27T14:31:17.245195+0000","last_undegraded":"2023-07-27T14:31:17.245195+0000","last_fullsized":"2023-07-27T14:31:17.245195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221329+0000","last_change":"2023-07-27T14:31:16.779260+0000","last_active":"2023-07-27T14:31:17.221329+0000","last_peered":"2023-07-27T14:31:17.221329+0000","last_clean":"2023-07-27T14:31:17.221329+0000","last_became_active":"2023-07-27T14:31:16.778996+0000","last_became_peered":"2023-07-27T14:31:16.778996+0000","last_unstale":"2023-07-27T14:31:17.221329+0000","last_undegraded":"2023-07-27T14:31:17.221329+0000","last_fullsized":"2023-07-27T14:31:17.221329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243426+0000","last_change":"2023-07-27T14:31:17.243426+0000","last_active":"2023-07-27T14:31:17.243426+0000","last_peered":"2023-07-27T14:31:17.243426+0000","last_clean":"2023-07-27T14:31:17.243426+0000","last_became_active":"2023-07-27T14:31:17.243159+0000","last_became_peered":"2023-07-27T14:31:17.243159+0000","last_unstale":"2023-07-27T14:31:17.243426+0000","last_undegraded":"2023-07-27T14:31:17.243426+0000","last_fullsized":"2023-07-27T14:31:17.243426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790435+0000","last_change":"2023-07-27T14:31:16.788140+0000","last_active":"2023-07-27T14:31:16.790435+0000","last_peered":"2023-07-27T14:31:16.790435+0000","last_clean":"2023-07-27T14:31:16.790435+0000","last_became_active":"2023-07-27T14:31:16.787722+0000","last_became_peered":"2023-07-27T14:31:16.787722+0000","last_unstale":"2023-07-27T14:31:16.790435+0000","last_undegraded":"2023-07-27T14:31:16.790435+0000","last_fullsized":"2023-07-27T14:31:16.790435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243941+0000","last_change":"2023-07-27T14:31:17.243941+0000","last_active":"2023-07-27T14:31:17.243941+0000","last_peered":"2023-07-27T14:31:17.243941+0000","last_clean":"2023-07-27T14:31:17.243941+0000","last_became_active":"2023-07-27T14:31:17.243679+0000","last_became_peered":"2023-07-27T14:31:17.243679+0000","last_unstale":"2023-07-27T14:31:17.243941+0000","last_undegraded":"2023-07-27T14:31:17.243941+0000","last_fullsized":"2023-07-27T14:31:17.243941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221043+0000","last_change":"2023-07-27T14:31:16.776337+0000","last_active":"2023-07-27T14:31:17.221043+0000","last_peered":"2023-07-27T14:31:17.221043+0000","last_clean":"2023-07-27T14:31:17.221043+0000","last_became_active":"2023-07-27T14:31:16.775264+0000","last_became_peered":"2023-07-27T14:31:16.775264+0000","last_unstale":"2023-07-27T14:31:17.221043+0000","last_undegraded":"2023-07-27T14:31:17.221043+0000","last_fullsized":"2023-07-27T14:31:17.221043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243695+0000","last_change":"2023-07-27T14:31:17.233072+0000","last_active":"2023-07-27T14:31:17.243695+0000","last_peered":"2023-07-27T14:31:17.243695+0000","last_clean":"2023-07-27T14:31:17.243695+0000","last_became_active":"2023-07-27T14:31:17.232793+0000","last_became_peered":"2023-07-27T14:31:17.232793+0000","last_unstale":"2023-07-27T14:31:17.243695+0000","last_undegraded":"2023-07-27T14:31:17.243695+0000","last_fullsized":"2023-07-27T14:31:17.243695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.782525+0000","last_change":"2023-07-27T14:31:16.771506+0000","last_active":"2023-07-27T14:31:16.782525+0000","last_peered":"2023-07-27T14:31:16.782525+0000","last_clean":"2023-07-27T14:31:16.782525+0000","last_became_active":"2023-07-27T14:31:16.771181+0000","last_became_peered":"2023-07-27T14:31:16.771181+0000","last_unstale":"2023-07-27T14:31:16.782525+0000","last_undegraded":"2023-07-27T14:31:16.782525+0000","last_fullsized":"2023-07-27T14:31:16.782525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250279+0000","last_change":"2023-07-27T14:31:17.250279+0000","last_active":"2023-07-27T14:31:17.250279+0000","last_peered":"2023-07-27T14:31:17.250279+0000","last_clean":"2023-07-27T14:31:17.250279+0000","last_became_active":"2023-07-27T14:31:17.249995+0000","last_became_peered":"2023-07-27T14:31:17.249995+0000","last_unstale":"2023-07-27T14:31:17.250279+0000","last_undegraded":"2023-07-27T14:31:17.250279+0000","last_fullsized":"2023-07-27T14:31:17.250279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790192+0000","last_change":"2023-07-27T14:31:16.787300+0000","last_active":"2023-07-27T14:31:16.790192+0000","last_peered":"2023-07-27T14:31:16.790192+0000","last_clean":"2023-07-27T14:31:16.790192+0000","last_became_active":"2023-07-27T14:31:16.786952+0000","last_became_peered":"2023-07-27T14:31:16.786952+0000","last_unstale":"2023-07-27T14:31:16.790192+0000","last_undegraded":"2023-07-27T14:31:16.790192+0000","last_fullsized":"2023-07-27T14:31:16.790192+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.237543+0000","last_change":"2023-07-27T14:31:17.237543+0000","last_active":"2023-07-27T14:31:17.237543+0000","last_peered":"2023-07-27T14:31:17.237543+0000","last_clean":"2023-07-27T14:31:17.237543+0000","last_became_active":"2023-07-27T14:31:17.237271+0000","last_became_peered":"2023-07-27T14:31:17.237271+0000","last_unstale":"2023-07-27T14:31:17.237543+0000","last_undegraded":"2023-07-27T14:31:17.237543+0000","last_fullsized":"2023-07-27T14:31:17.237543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789289+0000","last_change":"2023-07-27T14:31:16.780645+0000","last_active":"2023-07-27T14:31:16.789289+0000","last_peered":"2023-07-27T14:31:16.789289+0000","last_clean":"2023-07-27T14:31:16.789289+0000","last_became_active":"2023-07-27T14:31:16.779998+0000","last_became_peered":"2023-07-27T14:31:16.779998+0000","last_unstale":"2023-07-27T14:31:16.789289+0000","last_undegraded":"2023-07-27T14:31:16.789289+0000","last_fullsized":"2023-07-27T14:31:16.789289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.248251+0000","last_change":"2023-07-27T14:31:17.248251+0000","last_active":"2023-07-27T14:31:17.248251+0000","last_peered":"2023-07-27T14:31:17.248251+0000","last_clean":"2023-07-27T14:31:17.248251+0000","last_became_active":"2023-07-27T14:31:17.247944+0000","last_became_peered":"2023-07-27T14:31:17.247944+0000","last_unstale":"2023-07-27T14:31:17.248251+0000","last_undegraded":"2023-07-27T14:31:17.248251+0000","last_fullsized":"2023-07-27T14:31:17.248251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.231764+0000","last_change":"2023-07-27T14:31:16.783611+0000","last_active":"2023-07-27T14:31:17.231764+0000","last_peered":"2023-07-27T14:31:17.231764+0000","last_clean":"2023-07-27T14:31:17.231764+0000","last_became_active":"2023-07-27T14:31:16.783286+0000","last_became_peered":"2023-07-27T14:31:16.783286+0000","last_unstale":"2023-07-27T14:31:17.231764+0000","last_undegraded":"2023-07-27T14:31:17.231764+0000","last_fullsized":"2023-07-27T14:31:17.231764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.237150+0000","last_change":"2023-07-27T14:31:17.237150+0000","last_active":"2023-07-27T14:31:17.237150+0000","last_peered":"2023-07-27T14:31:17.237150+0000","last_clean":"2023-07-27T14:31:17.237150+0000","last_became_active":"2023-07-27T14:31:17.236872+0000","last_became_peered":"2023-07-27T14:31:17.236872+0000","last_unstale":"2023-07-27T14:31:17.237150+0000","last_undegraded":"2023-07-27T14:31:17.237150+0000","last_fullsized":"2023-07-27T14:31:17.237150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244363+0000","last_change":"2023-07-27T14:31:16.790809+0000","last_active":"2023-07-27T14:31:17.244363+0000","last_peered":"2023-07-27T14:31:17.244363+0000","last_clean":"2023-07-27T14:31:17.244363+0000","last_became_active":"2023-07-27T14:31:16.790483+0000","last_became_peered":"2023-07-27T14:31:16.790483+0000","last_unstale":"2023-07-27T14:31:17.244363+0000","last_undegraded":"2023-07-27T14:31:17.244363+0000","last_fullsized":"2023-07-27T14:31:17.244363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.236611+0000","last_change":"2023-07-27T14:31:17.236611+0000","last_active":"2023-07-27T14:31:17.236611+0000","last_peered":"2023-07-27T14:31:17.236611+0000","last_clean":"2023-07-27T14:31:17.236611+0000","last_became_active":"2023-07-27T14:31:17.236271+0000","last_became_peered":"2023-07-27T14:31:17.236271+0000","last_unstale":"2023-07-27T14:31:17.236611+0000","last_undegraded":"2023-07-27T14:31:17.236611+0000","last_fullsized":"2023-07-27T14:31:17.236611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.249997+0000","last_change":"2023-07-27T14:31:16.782080+0000","last_active":"2023-07-27T14:31:17.249997+0000","last_peered":"2023-07-27T14:31:17.249997+0000","last_clean":"2023-07-27T14:31:17.249997+0000","last_became_active":"2023-07-27T14:31:16.781795+0000","last_became_peered":"2023-07-27T14:31:16.781795+0000","last_unstale":"2023-07-27T14:31:17.249997+0000","last_undegraded":"2023-07-27T14:31:17.249997+0000","last_fullsized":"2023-07-27T14:31:17.249997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.242619+0000","last_change":"2023-07-27T14:31:17.242619+0000","last_active":"2023-07-27T14:31:17.242619+0000","last_peered":"2023-07-27T14:31:17.242619+0000","last_clean":"2023-07-27T14:31:17.242619+0000","last_became_active":"2023-07-27T14:31:17.242350+0000","last_became_peered":"2023-07-27T14:31:17.242350+0000","last_unstale":"2023-07-27T14:31:17.242619+0000","last_undegraded":"2023-07-27T14:31:17.242619+0000","last_fullsized":"2023-07-27T14:31:17.242619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789300+0000","last_change":"2023-07-27T14:31:16.779682+0000","last_active":"2023-07-27T14:31:16.789300+0000","last_peered":"2023-07-27T14:31:16.789300+0000","last_clean":"2023-07-27T14:31:16.789300+0000","last_became_active":"2023-07-27T14:31:16.779411+0000","last_became_peered":"2023-07-27T14:31:16.779411+0000","last_unstale":"2023-07-27T14:31:16.789300+0000","last_undegraded":"2023-07-27T14:31:16.789300+0000","last_fullsized":"2023-07-27T14:31:16.789300+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245887+0000","last_change":"2023-07-27T14:31:17.245887+0000","last_active":"2023-07-27T14:31:17.245887+0000","last_peered":"2023-07-27T14:31:17.245887+0000","last_clean":"2023-07-27T14:31:17.245887+0000","last_became_active":"2023-07-27T14:31:17.245604+0000","last_became_peered":"2023-07-27T14:31:17.245604+0000","last_unstale":"2023-07-27T14:31:17.245887+0000","last_undegraded":"2023-07-27T14:31:17.245887+0000","last_fullsized":"2023-07-27T14:31:17.245887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.785736+0000","last_change":"2023-07-27T14:31:16.781214+0000","last_active":"2023-07-27T14:31:16.785736+0000","last_peered":"2023-07-27T14:31:16.785736+0000","last_clean":"2023-07-27T14:31:16.785736+0000","last_became_active":"2023-07-27T14:31:16.780896+0000","last_became_peered":"2023-07-27T14:31:16.780896+0000","last_unstale":"2023-07-27T14:31:16.785736+0000","last_undegraded":"2023-07-27T14:31:16.785736+0000","last_fullsized":"2023-07-27T14:31:16.785736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246058+0000","last_change":"2023-07-27T14:31:17.246058+0000","last_active":"2023-07-27T14:31:17.246058+0000","last_peered":"2023-07-27T14:31:17.246058+0000","last_clean":"2023-07-27T14:31:17.246058+0000","last_became_active":"2023-07-27T14:31:17.245506+0000","last_became_peered":"2023-07-27T14:31:17.245506+0000","last_unstale":"2023-07-27T14:31:17.246058+0000","last_undegraded":"2023-07-27T14:31:17.246058+0000","last_fullsized":"2023-07-27T14:31:17.246058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.779734+0000","last_change":"2023-07-27T14:31:16.769966+0000","last_active":"2023-07-27T14:31:16.779734+0000","last_peered":"2023-07-27T14:31:16.779734+0000","last_clean":"2023-07-27T14:31:16.779734+0000","last_became_active":"2023-07-27T14:31:16.769655+0000","last_became_peered":"2023-07-27T14:31:16.769655+0000","last_unstale":"2023-07-27T14:31:16.779734+0000","last_undegraded":"2023-07-27T14:31:16.779734+0000","last_fullsized":"2023-07-27T14:31:16.779734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240300+0000","last_change":"2023-07-27T14:31:17.240300+0000","last_active":"2023-07-27T14:31:17.240300+0000","last_peered":"2023-07-27T14:31:17.240300+0000","last_clean":"2023-07-27T14:31:17.240300+0000","last_became_active":"2023-07-27T14:31:17.239936+0000","last_became_peered":"2023-07-27T14:31:17.239936+0000","last_unstale":"2023-07-27T14:31:17.240300+0000","last_undegraded":"2023-07-27T14:31:17.240300+0000","last_fullsized":"2023-07-27T14:31:17.240300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.786474+0000","last_change":"2023-07-27T14:31:16.779372+0000","last_active":"2023-07-27T14:31:16.786474+0000","last_peered":"2023-07-27T14:31:16.786474+0000","last_clean":"2023-07-27T14:31:16.786474+0000","last_became_active":"2023-07-27T14:31:16.778803+0000","last_became_peered":"2023-07-27T14:31:16.778803+0000","last_unstale":"2023-07-27T14:31:16.786474+0000","last_undegraded":"2023-07-27T14:31:16.786474+0000","last_fullsized":"2023-07-27T14:31:16.786474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247629+0000","last_change":"2023-07-27T14:31:17.247629+0000","last_active":"2023-07-27T14:31:17.247629+0000","last_peered":"2023-07-27T14:31:17.247629+0000","last_clean":"2023-07-27T14:31:17.247629+0000","last_became_active":"2023-07-27T14:31:17.247266+0000","last_became_peered":"2023-07-27T14:31:17.247266+0000","last_unstale":"2023-07-27T14:31:17.247629+0000","last_undegraded":"2023-07-27T14:31:17.247629+0000","last_fullsized":"2023-07-27T14:31:17.247629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790992+0000","last_change":"2023-07-27T14:31:16.780133+0000","last_active":"2023-07-27T14:31:16.790992+0000","last_peered":"2023-07-27T14:31:16.790992+0000","last_clean":"2023-07-27T14:31:16.790992+0000","last_became_active":"2023-07-27T14:31:16.779735+0000","last_became_peered":"2023-07-27T14:31:16.779735+0000","last_unstale":"2023-07-27T14:31:16.790992+0000","last_undegraded":"2023-07-27T14:31:16.790992+0000","last_fullsized":"2023-07-27T14:31:16.790992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.242660+0000","last_change":"2023-07-27T14:31:17.242660+0000","last_active":"2023-07-27T14:31:17.242660+0000","last_peered":"2023-07-27T14:31:17.242660+0000","last_clean":"2023-07-27T14:31:17.242660+0000","last_became_active":"2023-07-27T14:31:17.242401+0000","last_became_peered":"2023-07-27T14:31:17.242401+0000","last_unstale":"2023-07-27T14:31:17.242660+0000","last_undegraded":"2023-07-27T14:31:17.242660+0000","last_fullsized":"2023-07-27T14:31:17.242660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.222104+0000","last_change":"2023-07-27T14:31:16.788673+0000","last_active":"2023-07-27T14:31:17.222104+0000","last_peered":"2023-07-27T14:31:17.222104+0000","last_clean":"2023-07-27T14:31:17.222104+0000","last_became_active":"2023-07-27T14:31:16.788223+0000","last_became_peered":"2023-07-27T14:31:16.788223+0000","last_unstale":"2023-07-27T14:31:17.222104+0000","last_undegraded":"2023-07-27T14:31:17.222104+0000","last_fullsized":"2023-07-27T14:31:17.222104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.234453+0000","last_change":"2023-07-27T14:31:17.234453+0000","last_active":"2023-07-27T14:31:17.234453+0000","last_peered":"2023-07-27T14:31:17.234453+0000","last_clean":"2023-07-27T14:31:17.234453+0000","last_became_active":"2023-07-27T14:31:17.233917+0000","last_became_peered":"2023-07-27T14:31:17.233917+0000","last_unstale":"2023-07-27T14:31:17.234453+0000","last_undegraded":"2023-07-27T14:31:17.234453+0000","last_fullsized":"2023-07-27T14:31:17.234453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.782680+0000","last_change":"2023-07-27T14:31:16.777065+0000","last_active":"2023-07-27T14:31:16.782680+0000","last_peered":"2023-07-27T14:31:16.782680+0000","last_clean":"2023-07-27T14:31:16.782680+0000","last_became_active":"2023-07-27T14:31:16.776730+0000","last_became_peered":"2023-07-27T14:31:16.776730+0000","last_unstale":"2023-07-27T14:31:16.782680+0000","last_undegraded":"2023-07-27T14:31:16.782680+0000","last_fullsized":"2023-07-27T14:31:16.782680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245537+0000","last_change":"2023-07-27T14:31:17.239013+0000","last_active":"2023-07-27T14:31:17.245537+0000","last_peered":"2023-07-27T14:31:17.245537+0000","last_clean":"2023-07-27T14:31:17.245537+0000","last_became_active":"2023-07-27T14:31:17.238696+0000","last_became_peered":"2023-07-27T14:31:17.238696+0000","last_unstale":"2023-07-27T14:31:17.245537+0000","last_undegraded":"2023-07-27T14:31:17.245537+0000","last_fullsized":"2023-07-27T14:31:17.245537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244474+0000","last_change":"2023-07-27T14:31:16.784977+0000","last_active":"2023-07-27T14:31:17.244474+0000","last_peered":"2023-07-27T14:31:17.244474+0000","last_clean":"2023-07-27T14:31:17.244474+0000","last_became_active":"2023-07-27T14:31:16.784701+0000","last_became_peered":"2023-07-27T14:31:16.784701+0000","last_unstale":"2023-07-27T14:31:17.244474+0000","last_undegraded":"2023-07-27T14:31:17.244474+0000","last_fullsized":"2023-07-27T14:31:17.244474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250265+0000","last_change":"2023-07-27T14:31:17.250265+0000","last_active":"2023-07-27T14:31:17.250265+0000","last_peered":"2023-07-27T14:31:17.250265+0000","last_clean":"2023-07-27T14:31:17.250265+0000","last_became_active":"2023-07-27T14:31:17.249947+0000","last_became_peered":"2023-07-27T14:31:17.249947+0000","last_unstale":"2023-07-27T14:31:17.250265+0000","last_undegraded":"2023-07-27T14:31:17.250265+0000","last_fullsized":"2023-07-27T14:31:17.250265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250539+0000","last_change":"2023-07-27T14:31:16.776738+0000","last_active":"2023-07-27T14:31:17.250539+0000","last_peered":"2023-07-27T14:31:17.250539+0000","last_clean":"2023-07-27T14:31:17.250539+0000","last_became_active":"2023-07-27T14:31:16.776414+0000","last_became_peered":"2023-07-27T14:31:16.776414+0000","last_unstale":"2023-07-27T14:31:17.250539+0000","last_undegraded":"2023-07-27T14:31:17.250539+0000","last_fullsized":"2023-07-27T14:31:17.250539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.231888+0000","last_change":"2023-07-27T14:31:17.231888+0000","last_active":"2023-07-27T14:31:17.231888+0000","last_peered":"2023-07-27T14:31:17.231888+0000","last_clean":"2023-07-27T14:31:17.231888+0000","last_became_active":"2023-07-27T14:31:17.231583+0000","last_became_peered":"2023-07-27T14:31:17.231583+0000","last_unstale":"2023-07-27T14:31:17.231888+0000","last_undegraded":"2023-07-27T14:31:17.231888+0000","last_fullsized":"2023-07-27T14:31:17.231888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.228505+0000","last_change":"2023-07-27T14:31:16.779918+0000","last_active":"2023-07-27T14:31:17.228505+0000","last_peered":"2023-07-27T14:31:17.228505+0000","last_clean":"2023-07-27T14:31:17.228505+0000","last_became_active":"2023-07-27T14:31:16.779602+0000","last_became_peered":"2023-07-27T14:31:16.779602+0000","last_unstale":"2023-07-27T14:31:17.228505+0000","last_undegraded":"2023-07-27T14:31:17.228505+0000","last_fullsized":"2023-07-27T14:31:17.228505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.241839+0000","last_change":"2023-07-27T14:31:17.241839+0000","last_active":"2023-07-27T14:31:17.241839+0000","last_peered":"2023-07-27T14:31:17.241839+0000","last_clean":"2023-07-27T14:31:17.241839+0000","last_became_active":"2023-07-27T14:31:17.241334+0000","last_became_peered":"2023-07-27T14:31:17.241334+0000","last_unstale":"2023-07-27T14:31:17.241839+0000","last_undegraded":"2023-07-27T14:31:17.241839+0000","last_fullsized":"2023-07-27T14:31:17.241839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221677+0000","last_change":"2023-07-27T14:31:16.788699+0000","last_active":"2023-07-27T14:31:17.221677+0000","last_peered":"2023-07-27T14:31:17.221677+0000","last_clean":"2023-07-27T14:31:17.221677+0000","last_became_active":"2023-07-27T14:31:16.788421+0000","last_became_peered":"2023-07-27T14:31:16.788421+0000","last_unstale":"2023-07-27T14:31:17.221677+0000","last_undegraded":"2023-07-27T14:31:17.221677+0000","last_fullsized":"2023-07-27T14:31:17.221677+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244805+0000","last_change":"2023-07-27T14:31:17.244805+0000","last_active":"2023-07-27T14:31:17.244805+0000","last_peered":"2023-07-27T14:31:17.244805+0000","last_clean":"2023-07-27T14:31:17.244805+0000","last_became_active":"2023-07-27T14:31:17.244488+0000","last_became_peered":"2023-07-27T14:31:17.244488+0000","last_unstale":"2023-07-27T14:31:17.244805+0000","last_undegraded":"2023-07-27T14:31:17.244805+0000","last_fullsized":"2023-07-27T14:31:17.244805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793325+0000","last_change":"2023-07-27T14:31:16.783048+0000","last_active":"2023-07-27T14:31:16.793325+0000","last_peered":"2023-07-27T14:31:16.793325+0000","last_clean":"2023-07-27T14:31:16.793325+0000","last_became_active":"2023-07-27T14:31:16.782759+0000","last_became_peered":"2023-07-27T14:31:16.782759+0000","last_unstale":"2023-07-27T14:31:16.793325+0000","last_undegraded":"2023-07-27T14:31:16.793325+0000","last_fullsized":"2023-07-27T14:31:16.793325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.236513+0000","last_change":"2023-07-27T14:31:17.236513+0000","last_active":"2023-07-27T14:31:17.236513+0000","last_peered":"2023-07-27T14:31:17.236513+0000","last_clean":"2023-07-27T14:31:17.236513+0000","last_became_active":"2023-07-27T14:31:17.236018+0000","last_became_peered":"2023-07-27T14:31:17.236018+0000","last_unstale":"2023-07-27T14:31:17.236513+0000","last_undegraded":"2023-07-27T14:31:17.236513+0000","last_fullsized":"2023-07-27T14:31:17.236513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'4","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.249105+0000","last_change":"2023-07-27T14:31:16.786705+0000","last_active":"2023-07-27T14:31:17.249105+0000","last_peered":"2023-07-27T14:31:17.249105+0000","last_clean":"2023-07-27T14:31:17.249105+0000","last_became_active":"2023-07-27T14:31:16.786398+0000","last_became_peered":"2023-07-27T14:31:16.786398+0000","last_unstale":"2023-07-27T14:31:17.249105+0000","last_undegraded":"2023-07-27T14:31:17.249105+0000","last_fullsized":"2023-07-27T14:31:17.249105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240889+0000","last_change":"2023-07-27T14:31:17.240889+0000","last_active":"2023-07-27T14:31:17.240889+0000","last_peered":"2023-07-27T14:31:17.240889+0000","last_clean":"2023-07-27T14:31:17.240889+0000","last_became_active":"2023-07-27T14:31:17.240547+0000","last_became_peered":"2023-07-27T14:31:17.240547+0000","last_unstale":"2023-07-27T14:31:17.240889+0000","last_undegraded":"2023-07-27T14:31:17.240889+0000","last_fullsized":"2023-07-27T14:31:17.240889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.241843+0000","last_change":"2023-07-27T14:31:16.780511+0000","last_active":"2023-07-27T14:31:17.241843+0000","last_peered":"2023-07-27T14:31:17.241843+0000","last_clean":"2023-07-27T14:31:17.241843+0000","last_became_active":"2023-07-27T14:31:16.780260+0000","last_became_peered":"2023-07-27T14:31:16.780260+0000","last_unstale":"2023-07-27T14:31:17.241843+0000","last_undegraded":"2023-07-27T14:31:17.241843+0000","last_fullsized":"2023-07-27T14:31:17.241843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.241295+0000","last_change":"2023-07-27T14:31:17.241295+0000","last_active":"2023-07-27T14:31:17.241295+0000","last_peered":"2023-07-27T14:31:17.241295+0000","last_clean":"2023-07-27T14:31:17.241295+0000","last_became_active":"2023-07-27T14:31:17.239220+0000","last_became_peered":"2023-07-27T14:31:17.239220+0000","last_unstale":"2023-07-27T14:31:17.241295+0000","last_undegraded":"2023-07-27T14:31:17.241295+0000","last_fullsized":"2023-07-27T14:31:17.241295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.787068+0000","last_change":"2023-07-27T14:31:16.785695+0000","last_active":"2023-07-27T14:31:16.787068+0000","last_peered":"2023-07-27T14:31:16.787068+0000","last_clean":"2023-07-27T14:31:16.787068+0000","last_became_active":"2023-07-27T14:31:16.785400+0000","last_became_peered":"2023-07-27T14:31:16.785400+0000","last_unstale":"2023-07-27T14:31:16.787068+0000","last_undegraded":"2023-07-27T14:31:16.787068+0000","last_fullsized":"2023-07-27T14:31:16.787068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.235106+0000","last_change":"2023-07-27T14:31:17.235106+0000","last_active":"2023-07-27T14:31:17.235106+0000","last_peered":"2023-07-27T14:31:17.235106+0000","last_clean":"2023-07-27T14:31:17.235106+0000","last_became_active":"2023-07-27T14:31:17.234819+0000","last_became_peered":"2023-07-27T14:31:17.234819+0000","last_unstale":"2023-07-27T14:31:17.235106+0000","last_undegraded":"2023-07-27T14:31:17.235106+0000","last_fullsized":"2023-07-27T14:31:17.235106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221933+0000","last_change":"2023-07-27T14:31:16.783387+0000","last_active":"2023-07-27T14:31:17.221933+0000","last_peered":"2023-07-27T14:31:17.221933+0000","last_clean":"2023-07-27T14:31:17.221933+0000","last_became_active":"2023-07-27T14:31:16.783086+0000","last_became_peered":"2023-07-27T14:31:16.783086+0000","last_unstale":"2023-07-27T14:31:17.221933+0000","last_undegraded":"2023-07-27T14:31:17.221933+0000","last_fullsized":"2023-07-27T14:31:17.221933+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.242214+0000","last_change":"2023-07-27T14:31:17.242214+0000","last_active":"2023-07-27T14:31:17.242214+0000","last_peered":"2023-07-27T14:31:17.242214+0000","last_clean":"2023-07-27T14:31:17.242214+0000","last_became_active":"2023-07-27T14:31:17.241932+0000","last_became_peered":"2023-07-27T14:31:17.241932+0000","last_unstale":"2023-07-27T14:31:17.242214+0000","last_undegraded":"2023-07-27T14:31:17.242214+0000","last_fullsized":"2023-07-27T14:31:17.242214+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221568+0000","last_change":"2023-07-27T14:31:16.790409+0000","last_active":"2023-07-27T14:31:17.221568+0000","last_peered":"2023-07-27T14:31:17.221568+0000","last_clean":"2023-07-27T14:31:17.221568+0000","last_became_active":"2023-07-27T14:31:16.790056+0000","last_became_peered":"2023-07-27T14:31:16.790056+0000","last_unstale":"2023-07-27T14:31:17.221568+0000","last_undegraded":"2023-07-27T14:31:17.221568+0000","last_fullsized":"2023-07-27T14:31:17.221568+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240262+0000","last_change":"2023-07-27T14:31:17.240262+0000","last_active":"2023-07-27T14:31:17.240262+0000","last_peered":"2023-07-27T14:31:17.240262+0000","last_clean":"2023-07-27T14:31:17.240262+0000","last_became_active":"2023-07-27T14:31:17.239922+0000","last_became_peered":"2023-07-27T14:31:17.239922+0000","last_unstale":"2023-07-27T14:31:17.240262+0000","last_undegraded":"2023-07-27T14:31:17.240262+0000","last_fullsized":"2023-07-27T14:31:17.240262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789552+0000","last_change":"2023-07-27T14:31:16.783509+0000","last_active":"2023-07-27T14:31:16.789552+0000","last_peered":"2023-07-27T14:31:16.789552+0000","last_clean":"2023-07-27T14:31:16.789552+0000","last_became_active":"2023-07-27T14:31:16.783201+0000","last_became_peered":"2023-07-27T14:31:16.783201+0000","last_unstale":"2023-07-27T14:31:16.789552+0000","last_undegraded":"2023-07-27T14:31:16.789552+0000","last_fullsized":"2023-07-27T14:31:16.789552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247202+0000","last_change":"2023-07-27T14:31:17.247202+0000","last_active":"2023-07-27T14:31:17.247202+0000","last_peered":"2023-07-27T14:31:17.247202+0000","last_clean":"2023-07-27T14:31:17.247202+0000","last_became_active":"2023-07-27T14:31:17.246915+0000","last_became_peered":"2023-07-27T14:31:17.246915+0000","last_unstale":"2023-07-27T14:31:17.247202+0000","last_undegraded":"2023-07-27T14:31:17.247202+0000","last_fullsized":"2023-07-27T14:31:17.247202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790893+0000","last_change":"2023-07-27T14:31:16.778131+0000","last_active":"2023-07-27T14:31:16.790893+0000","last_peered":"2023-07-27T14:31:16.790893+0000","last_clean":"2023-07-27T14:31:16.790893+0000","last_became_active":"2023-07-27T14:31:16.777539+0000","last_became_peered":"2023-07-27T14:31:16.777539+0000","last_unstale":"2023-07-27T14:31:16.790893+0000","last_undegraded":"2023-07-27T14:31:16.790893+0000","last_fullsized":"2023-07-27T14:31:16.790893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250176+0000","last_change":"2023-07-27T14:31:17.250176+0000","last_active":"2023-07-27T14:31:17.250176+0000","last_peered":"2023-07-27T14:31:17.250176+0000","last_clean":"2023-07-27T14:31:17.250176+0000","last_became_active":"2023-07-27T14:31:17.249851+0000","last_became_peered":"2023-07-27T14:31:17.249851+0000","last_unstale":"2023-07-27T14:31:17.250176+0000","last_undegraded":"2023-07-27T14:31:17.250176+0000","last_fullsized":"2023-07-27T14:31:17.250176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.786736+0000","last_change":"2023-07-27T14:31:16.778172+0000","last_active":"2023-07-27T14:31:16.786736+0000","last_peered":"2023-07-27T14:31:16.786736+0000","last_clean":"2023-07-27T14:31:16.786736+0000","last_became_active":"2023-07-27T14:31:16.777903+0000","last_became_peered":"2023-07-27T14:31:16.777903+0000","last_unstale":"2023-07-27T14:31:16.786736+0000","last_undegraded":"2023-07-27T14:31:16.786736+0000","last_fullsized":"2023-07-27T14:31:16.786736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244928+0000","last_change":"2023-07-27T14:31:17.244928+0000","last_active":"2023-07-27T14:31:17.244928+0000","last_peered":"2023-07-27T14:31:17.244928+0000","last_clean":"2023-07-27T14:31:17.244928+0000","last_became_active":"2023-07-27T14:31:17.244639+0000","last_became_peered":"2023-07-27T14:31:17.244639+0000","last_unstale":"2023-07-27T14:31:17.244928+0000","last_undegraded":"2023-07-27T14:31:17.244928+0000","last_fullsized":"2023-07-27T14:31:17.244928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.775612+0000","last_change":"2023-07-27T14:31:16.770354+0000","last_active":"2023-07-27T14:31:16.775612+0000","last_peered":"2023-07-27T14:31:16.775612+0000","last_clean":"2023-07-27T14:31:16.775612+0000","last_became_active":"2023-07-27T14:31:16.770042+0000","last_became_peered":"2023-07-27T14:31:16.770042+0000","last_unstale":"2023-07-27T14:31:16.775612+0000","last_undegraded":"2023-07-27T14:31:16.775612+0000","last_fullsized":"2023-07-27T14:31:16.775612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.239782+0000","last_change":"2023-07-27T14:31:17.239782+0000","last_active":"2023-07-27T14:31:17.239782+0000","last_peered":"2023-07-27T14:31:17.239782+0000","last_clean":"2023-07-27T14:31:17.239782+0000","last_became_active":"2023-07-27T14:31:17.239529+0000","last_became_peered":"2023-07-27T14:31:17.239529+0000","last_unstale":"2023-07-27T14:31:17.239782+0000","last_undegraded":"2023-07-27T14:31:17.239782+0000","last_fullsized":"2023-07-27T14:31:17.239782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793479+0000","last_change":"2023-07-27T14:31:16.786632+0000","last_active":"2023-07-27T14:31:16.793479+0000","last_peered":"2023-07-27T14:31:16.793479+0000","last_clean":"2023-07-27T14:31:16.793479+0000","last_became_active":"2023-07-27T14:31:16.786379+0000","last_became_peered":"2023-07-27T14:31:16.786379+0000","last_unstale":"2023-07-27T14:31:16.793479+0000","last_undegraded":"2023-07-27T14:31:16.793479+0000","last_fullsized":"2023-07-27T14:31:16.793479+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.764853+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:31:16.764853+0000","last_peered":"2023-07-27T14:31:16.764853+0000","last_clean":"2023-07-27T14:31:16.764853+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:31:16.764853+0000","last_undegraded":"2023-07-27T14:31:16.764853+0000","last_fullsized":"2023-07-27T14:31:16.764853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.237011+0000","last_change":"2023-07-27T14:31:17.237011+0000","last_active":"2023-07-27T14:31:17.237011+0000","last_peered":"2023-07-27T14:31:17.237011+0000","last_clean":"2023-07-27T14:31:17.237011+0000","last_became_active":"2023-07-27T14:31:17.236638+0000","last_became_peered":"2023-07-27T14:31:17.236638+0000","last_unstale":"2023-07-27T14:31:17.237011+0000","last_undegraded":"2023-07-27T14:31:17.237011+0000","last_fullsized":"2023-07-27T14:31:17.237011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240853+0000","last_change":"2023-07-27T14:31:16.776166+0000","last_active":"2023-07-27T14:31:17.240853+0000","last_peered":"2023-07-27T14:31:17.240853+0000","last_clean":"2023-07-27T14:31:17.240853+0000","last_became_active":"2023-07-27T14:31:16.775666+0000","last_became_peered":"2023-07-27T14:31:16.775666+0000","last_unstale":"2023-07-27T14:31:17.240853+0000","last_undegraded":"2023-07-27T14:31:17.240853+0000","last_fullsized":"2023-07-27T14:31:17.240853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.761484+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:31:16.761484+0000","last_peered":"2023-07-27T14:31:16.761484+0000","last_clean":"2023-07-27T14:31:16.761484+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:31:16.761484+0000","last_undegraded":"2023-07-27T14:31:16.761484+0000","last_fullsized":"2023-07-27T14:31:16.761484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.236882+0000","last_change":"2023-07-27T14:31:17.236882+0000","last_active":"2023-07-27T14:31:17.236882+0000","last_peered":"2023-07-27T14:31:17.236882+0000","last_clean":"2023-07-27T14:31:17.236882+0000","last_became_active":"2023-07-27T14:31:17.236472+0000","last_became_peered":"2023-07-27T14:31:17.236472+0000","last_unstale":"2023-07-27T14:31:17.236882+0000","last_undegraded":"2023-07-27T14:31:17.236882+0000","last_fullsized":"2023-07-27T14:31:17.236882+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.220316+0000","last_change":"2023-07-27T14:31:16.772242+0000","last_active":"2023-07-27T14:31:17.220316+0000","last_peered":"2023-07-27T14:31:17.220316+0000","last_clean":"2023-07-27T14:31:17.220316+0000","last_became_active":"2023-07-27T14:31:16.771942+0000","last_became_peered":"2023-07-27T14:31:16.771942+0000","last_unstale":"2023-07-27T14:31:17.220316+0000","last_undegraded":"2023-07-27T14:31:17.220316+0000","last_fullsized":"2023-07-27T14:31:17.220316+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.772475+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:31:16.772475+0000","last_peered":"2023-07-27T14:31:16.772475+0000","last_clean":"2023-07-27T14:31:16.772475+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:31:16.772475+0000","last_undegraded":"2023-07-27T14:31:16.772475+0000","last_fullsized":"2023-07-27T14:31:16.772475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243877+0000","last_change":"2023-07-27T14:31:17.238576+0000","last_active":"2023-07-27T14:31:17.243877+0000","last_peered":"2023-07-27T14:31:17.243877+0000","last_clean":"2023-07-27T14:31:17.243877+0000","last_became_active":"2023-07-27T14:31:17.238251+0000","last_became_peered":"2023-07-27T14:31:17.238251+0000","last_unstale":"2023-07-27T14:31:17.243877+0000","last_undegraded":"2023-07-27T14:31:17.243877+0000","last_fullsized":"2023-07-27T14:31:17.243877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.219978+0000","last_change":"2023-07-27T14:31:16.787960+0000","last_active":"2023-07-27T14:31:17.219978+0000","last_peered":"2023-07-27T14:31:17.219978+0000","last_clean":"2023-07-27T14:31:17.219978+0000","last_became_active":"2023-07-27T14:31:16.787650+0000","last_became_peered":"2023-07-27T14:31:16.787650+0000","last_unstale":"2023-07-27T14:31:17.219978+0000","last_undegraded":"2023-07-27T14:31:17.219978+0000","last_fullsized":"2023-07-27T14:31:17.219978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.761889+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:31:16.761889+0000","last_peered":"2023-07-27T14:31:16.761889+0000","last_clean":"2023-07-27T14:31:16.761889+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:31:16.761889+0000","last_undegraded":"2023-07-27T14:31:16.761889+0000","last_fullsized":"2023-07-27T14:31:16.761889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221370+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:31:17.221370+0000","last_peered":"2023-07-27T14:31:17.221370+0000","last_clean":"2023-07-27T14:31:17.221370+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:31:17.221370+0000","last_undegraded":"2023-07-27T14:31:17.221370+0000","last_fullsized":"2023-07-27T14:31:17.221370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246846+0000","last_change":"2023-07-27T14:31:17.246846+0000","last_active":"2023-07-27T14:31:17.246846+0000","last_peered":"2023-07-27T14:31:17.246846+0000","last_clean":"2023-07-27T14:31:17.246846+0000","last_became_active":"2023-07-27T14:31:17.246595+0000","last_became_peered":"2023-07-27T14:31:17.246595+0000","last_unstale":"2023-07-27T14:31:17.246846+0000","last_undegraded":"2023-07-27T14:31:17.246846+0000","last_fullsized":"2023-07-27T14:31:17.246846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221496+0000","last_change":"2023-07-27T14:31:16.772294+0000","last_active":"2023-07-27T14:31:17.221496+0000","last_peered":"2023-07-27T14:31:17.221496+0000","last_clean":"2023-07-27T14:31:17.221496+0000","last_became_active":"2023-07-27T14:31:16.771987+0000","last_became_peered":"2023-07-27T14:31:16.771987+0000","last_unstale":"2023-07-27T14:31:17.221496+0000","last_undegraded":"2023-07-27T14:31:17.221496+0000","last_fullsized":"2023-07-27T14:31:17.221496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221429+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:31:17.221429+0000","last_peered":"2023-07-27T14:31:17.221429+0000","last_clean":"2023-07-27T14:31:17.221429+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:31:17.221429+0000","last_undegraded":"2023-07-27T14:31:17.221429+0000","last_fullsized":"2023-07-27T14:31:17.221429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245154+0000","last_change":"2023-07-27T14:31:17.235779+0000","last_active":"2023-07-27T14:31:17.245154+0000","last_peered":"2023-07-27T14:31:17.245154+0000","last_clean":"2023-07-27T14:31:17.245154+0000","last_became_active":"2023-07-27T14:31:17.235501+0000","last_became_peered":"2023-07-27T14:31:17.235501+0000","last_unstale":"2023-07-27T14:31:17.245154+0000","last_undegraded":"2023-07-27T14:31:17.245154+0000","last_fullsized":"2023-07-27T14:31:17.245154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.787373+0000","last_change":"2023-07-27T14:31:16.783729+0000","last_active":"2023-07-27T14:31:16.787373+0000","last_peered":"2023-07-27T14:31:16.787373+0000","last_clean":"2023-07-27T14:31:16.787373+0000","last_became_active":"2023-07-27T14:31:16.783464+0000","last_became_peered":"2023-07-27T14:31:16.783464+0000","last_unstale":"2023-07-27T14:31:16.787373+0000","last_undegraded":"2023-07-27T14:31:16.787373+0000","last_fullsized":"2023-07-27T14:31:16.787373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221813+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:31:17.221813+0000","last_peered":"2023-07-27T14:31:17.221813+0000","last_clean":"2023-07-27T14:31:17.221813+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:31:17.221813+0000","last_undegraded":"2023-07-27T14:31:17.221813+0000","last_fullsized":"2023-07-27T14:31:17.221813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247047+0000","last_change":"2023-07-27T14:31:17.238218+0000","last_active":"2023-07-27T14:31:17.247047+0000","last_peered":"2023-07-27T14:31:17.247047+0000","last_clean":"2023-07-27T14:31:17.247047+0000","last_became_active":"2023-07-27T14:31:17.237926+0000","last_became_peered":"2023-07-27T14:31:17.237926+0000","last_unstale":"2023-07-27T14:31:17.247047+0000","last_undegraded":"2023-07-27T14:31:17.247047+0000","last_fullsized":"2023-07-27T14:31:17.247047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243988+0000","last_change":"2023-07-27T14:31:16.786418+0000","last_active":"2023-07-27T14:31:17.243988+0000","last_peered":"2023-07-27T14:31:17.243988+0000","last_clean":"2023-07-27T14:31:17.243988+0000","last_became_active":"2023-07-27T14:31:16.786127+0000","last_became_peered":"2023-07-27T14:31:16.786127+0000","last_unstale":"2023-07-27T14:31:17.243988+0000","last_undegraded":"2023-07-27T14:31:17.243988+0000","last_fullsized":"2023-07-27T14:31:17.243988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.765216+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:31:16.765216+0000","last_peered":"2023-07-27T14:31:16.765216+0000","last_clean":"2023-07-27T14:31:16.765216+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:31:16.765216+0000","last_undegraded":"2023-07-27T14:31:16.765216+0000","last_fullsized":"2023-07-27T14:31:16.765216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247141+0000","last_change":"2023-07-27T14:31:17.247141+0000","last_active":"2023-07-27T14:31:17.247141+0000","last_peered":"2023-07-27T14:31:17.247141+0000","last_clean":"2023-07-27T14:31:17.247141+0000","last_became_active":"2023-07-27T14:31:17.246415+0000","last_became_peered":"2023-07-27T14:31:17.246415+0000","last_unstale":"2023-07-27T14:31:17.247141+0000","last_undegraded":"2023-07-27T14:31:17.247141+0000","last_fullsized":"2023-07-27T14:31:17.247141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247261+0000","last_change":"2023-07-27T14:31:16.778997+0000","last_active":"2023-07-27T14:31:17.247261+0000","last_peered":"2023-07-27T14:31:17.247261+0000","last_clean":"2023-07-27T14:31:17.247261+0000","last_became_active":"2023-07-27T14:31:16.778106+0000","last_became_peered":"2023-07-27T14:31:16.778106+0000","last_unstale":"2023-07-27T14:31:17.247261+0000","last_undegraded":"2023-07-27T14:31:17.247261+0000","last_fullsized":"2023-07-27T14:31:17.247261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.760623+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:31:16.760623+0000","last_peered":"2023-07-27T14:31:16.760623+0000","last_clean":"2023-07-27T14:31:16.760623+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:31:16.760623+0000","last_undegraded":"2023-07-27T14:31:16.760623+0000","last_fullsized":"2023-07-27T14:31:16.760623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13240,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94358600,"statfs":{"total":96636764160,"available":96623206400,"internally_reserved":0,"allocated":1032192,"data_stored":472495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64200000000000002,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":1.133,"15min":1.133},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.87,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.749}]},{"osd":1,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.874,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79800000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.442,"5min":0.438,"15min":0.438},"max":{"1min":0.81899999999999995,"5min":1.119,"15min":1.119},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67400000000000004,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83299999999999996,"5min":1.069,"15min":1.069},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.53800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":1.165,"15min":1.165},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.318},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.76200000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77400000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.77900000000000003,"5min":1.038,"15min":1.038},"last":0.495}]},{"osd":6,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.54900000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.80500000000000005,"5min":1.034,"15min":1.034},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79000000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8304,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":7296,"kb_avail":94363536,"statfs":{"total":96636764160,"available":96628260864,"internally_reserved":0,"allocated":1024000,"data_stored":465929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7471104},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86399999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.755},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.78400000000000003,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66300000000000003,"15min":0.65500000000000003},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88700000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95199999999999996,"5min":1.2,"15min":1.2},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.65900000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86599999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.621},"min":{"1min":0.48499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86299999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68300000000000005,"15min":0.67600000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92000000000000004,"5min":1.079,"15min":1.079},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88100000000000001,"5min":1.198,"15min":1.198},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90900000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.60499999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0309999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.94199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":7360,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":1028096,"data_stored":466289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7536640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.46500000000000002,"15min":0.53800000000000003},"min":{"1min":0.29299999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52900000000000003,"5min":4.75,"15min":4.75},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.56599999999999995,"15min":0.71099999999999997},"min":{"1min":0.32200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69999999999999996,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.52100000000000002,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63700000000000001,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.63900000000000001,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.65300000000000002,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52600000000000002,"15min":0.58799999999999997},"min":{"1min":0.376,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.72499999999999998},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86299999999999999,"5min":2.181,"15min":2.181},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.58999999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.84899999999999998,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.79000000000000004},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72799999999999998,"15min":0.754},"min":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89900000000000002,"5min":2.149,"15min":2.149},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84999999999999998,"5min":2.052,"15min":2.052},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.88100000000000001},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":0.82699999999999996,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.59999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":2.016,"15min":2.016},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":0.86899999999999999},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.92500000000000004,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.89500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":7424,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":1011712,"data_stored":465215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7602176},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38900000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.49199999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.435},{"interface":"front","average":{"1min":0.44,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41699999999999998,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.504,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57699999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51200000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.63}]},{"osd":7,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.748,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.621},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.755},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13232,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94358608,"statfs":{"total":96636764160,"available":96623214592,"internally_reserved":0,"allocated":1024000,"data_stored":466751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40600000000000003,"15min":0.42299999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.46200000000000002,"15min":0.48499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55700000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.46600000000000003,"15min":0.49099999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.378},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.60799999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47399999999999998,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81100000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81699999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91900000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80400000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93799999999999994,"5min":1.014,"15min":1.014},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92300000000000004,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.77600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0049999999999999,"5min":1.091,"15min":1.091},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.036,"15min":1.036},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9008,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94362832,"statfs":{"total":96636764160,"available":96627539968,"internally_reserved":0,"allocated":1024000,"data_stored":471919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44500000000000001,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64800000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.373}]},{"osd":1,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.436,"15min":0.45400000000000001},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.53400000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.442}]},{"osd":2,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60099999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.5},"min":{"1min":0.41499999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68300000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.88700000000000001,"5min":1.149,"15min":1.149},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89800000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.497}]},{"osd":5,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84099999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.94099999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89900000000000002,"5min":1.298,"15min":1.298},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.751,"15min":0.748},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":0.995},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78300000000000003,"15min":0.77900000000000003},"min":{"1min":0.60899999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96299999999999997,"5min":1.117,"15min":1.117},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93000000000000005,"5min":1.24,"15min":1.24},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8368,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":7360,"kb_avail":94363472,"statfs":{"total":96636764160,"available":96628195328,"internally_reserved":0,"allocated":1024000,"data_stored":465893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7536640},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44900000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.879,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":2.8410000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.503,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.876,"5min":2.419,"15min":2.419},"last":4.3479999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":4.4409999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.876,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":2.9260000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83599999999999997,"5min":0.998,"15min":0.998},"last":2.7109999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46600000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":4.476}]},{"osd":3,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86399999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":3.1059999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68899999999999995,"15min":0.67400000000000004},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.84299999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":4.4829999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96899999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":4.3949999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64200000000000002,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":2.9649999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89800000000000002,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":5.194},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.745},"min":{"1min":0.59099999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":5.5990000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.57099999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96199999999999997,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":2.819},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95099999999999996,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":2.7829999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14312,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357528,"statfs":{"total":96636764160,"available":96622108672,"internally_reserved":0,"allocated":1015808,"data_stored":465249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":0.70999999999999996,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":12.127000000000001,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.497}]},{"osd":1,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.73499999999999999,"15min":0.70399999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.7489999999999997,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.73099999999999998,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":6.7370000000000001,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66200000000000003,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":0.73699999999999999,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.6920000000000002,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.163,"5min":0.82799999999999996,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":9.4299999999999997,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.66500000000000004,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.66500000000000004,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":8.0329999999999995,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.437},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.623}]},{"osd":7,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.69299999999999995,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.503,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:31:21.527 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:31:21.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.717+0000 7efe3cdff700 1 Processor -- start 2023-07-27T14:31:21.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.717+0000 7efe3cdff700 1 -- start start 2023-07-27T14:31:21.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.718+0000 7efe3cdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe38153ec0 0x7efe380a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.718+0000 7efe3cdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe380aa050 0x7efe380640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.718+0000 7efe3cdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efe380aaa40 0x7efe380645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.718+0000 7efe3cdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe38064ad0 con 0x7efe380aa050 2023-07-27T14:31:21.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.718+0000 7efe3cdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe380aa4d0 con 0x7efe380aaa40 2023-07-27T14:31:21.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.718+0000 7efe3cdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe380c05c0 con 0x7efe38153ec0 2023-07-27T14:31:21.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe380aa050 0x7efe380640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe380aa050 0x7efe380640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39582/0 (socket says 172.21.15.115:39582) 2023-07-27T14:31:21.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 -- 172.21.15.115:0/3510890406 learned_addr learned my addr 172.21.15.115:0/3510890406 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:21.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe3659c700 1 --2- 172.21.15.115:0/3510890406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe38153ec0 0x7efe380a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe36d9d700 1 --2- 172.21.15.115:0/3510890406 >> v2:172.21.15.159:3300/0 conn(0x7efe380aaa40 0x7efe380645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 -- 172.21.15.115:0/3510890406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe38153ec0 msgr2=0x7efe380a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:21.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 --2- 172.21.15.115:0/3510890406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe38153ec0 0x7efe380a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 -- 172.21.15.115:0/3510890406 >> v2:172.21.15.159:3300/0 conn(0x7efe380aaa40 msgr2=0x7efe380645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:21.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 --2- 172.21.15.115:0/3510890406 >> v2:172.21.15.159:3300/0 conn(0x7efe380aaa40 0x7efe380645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 -- 172.21.15.115:0/3510890406 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380bfc90 con 0x7efe380aa050 2023-07-27T14:31:21.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.719+0000 7efe35d9b700 1 --2- 172.21.15.115:0/3510890406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe380aa050 0x7efe380640f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7efe380843b0 tx=0x7efe2c0090f0).ready entity=mon.0 client_cookie=1ffc955f7f736ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:21.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3559a700 1 -- 172.21.15.115:0/3510890406 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00b600 con 0x7efe380aa050 2023-07-27T14:31:21.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3559a700 1 -- 172.21.15.115:0/3510890406 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00b760 con 0x7efe380aa050 2023-07-27T14:31:21.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3559a700 1 -- 172.21.15.115:0/3510890406 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00bae0 con 0x7efe380aa050 2023-07-27T14:31:21.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 -- 172.21.15.115:0/3510890406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe380aa050 msgr2=0x7efe380640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 --2- 172.21.15.115:0/3510890406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe380aa050 0x7efe380640f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7efe380843b0 tx=0x7efe2c0090f0).stop 2023-07-27T14:31:21.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 -- 172.21.15.115:0/3510890406 shutdown_connections 2023-07-27T14:31:21.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 --2- 172.21.15.115:0/3510890406 >> v2:172.21.15.159:3300/0 conn(0x7efe380aaa40 0x7efe380645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 --2- 172.21.15.115:0/3510890406 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe38153ec0 0x7efe380a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 --2- 172.21.15.115:0/3510890406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe380aa050 0x7efe380640f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 -- 172.21.15.115:0/3510890406 >> 172.21.15.115:0/3510890406 conn(0x7efe380cb610 msgr2=0x7efe380c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:21.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 -- 172.21.15.115:0/3510890406 shutdown_connections 2023-07-27T14:31:21.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.720+0000 7efe3cdff700 1 -- 172.21.15.115:0/3510890406 wait complete. 2023-07-27T14:31:21.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.722+0000 7efe3cdff700 1 Processor -- start 2023-07-27T14:31:21.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.722+0000 7efe3cdff700 1 -- start start 2023-07-27T14:31:21.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe3cdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe380aa050 0x7efe380a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe3cdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe380aaa40 0x7efe380af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe3cdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe38153ec0 0x7efe380c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe3cdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38163f00 con 0x7efe38153ec0 2023-07-27T14:31:21.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe3cdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38152060 con 0x7efe380aa050 2023-07-27T14:31:21.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe3cdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe38152340 con 0x7efe380aaa40 2023-07-27T14:31:21.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe36d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe38153ec0 0x7efe380c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe36d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe38153ec0 0x7efe380c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39594/0 (socket says 172.21.15.115:39594) 2023-07-27T14:31:21.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe36d9d700 1 -- 172.21.15.115:0/2422026045 learned_addr learned my addr 172.21.15.115:0/2422026045 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:21.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe3659c700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe380aa050 0x7efe380a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe35d9b700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe380aaa40 0x7efe380af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe36d9d700 1 -- 172.21.15.115:0/2422026045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe380aaa40 msgr2=0x7efe380af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe36d9d700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe380aaa40 0x7efe380af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe36d9d700 1 -- 172.21.15.115:0/2422026045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe380aa050 msgr2=0x7efe380a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe36d9d700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe380aa050 0x7efe380a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.723+0000 7efe36d9d700 1 -- 172.21.15.115:0/2422026045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009370 con 0x7efe38153ec0 2023-07-27T14:31:21.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.724+0000 7efe36d9d700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe38153ec0 0x7efe380c39c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7efe30007f20 tx=0x7efe300098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:21.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.724+0000 7efe267fc700 1 -- 172.21.15.115:0/2422026045 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000eca0 con 0x7efe38153ec0 2023-07-27T14:31:21.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.724+0000 7efe267fc700 1 -- 172.21.15.115:0/2422026045 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3000ee00 con 0x7efe38153ec0 2023-07-27T14:31:21.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.724+0000 7efe267fc700 1 -- 172.21.15.115:0/2422026045 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30014610 con 0x7efe38153ec0 2023-07-27T14:31:21.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.724+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe38152620 con 0x7efe38153ec0 2023-07-27T14:31:21.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.724+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe380a9520 con 0x7efe38153ec0 2023-07-27T14:31:21.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.725+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe38164070 con 0x7efe38153ec0 2023-07-27T14:31:21.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.726+0000 7efe267fc700 1 -- 172.21.15.115:0/2422026045 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7efe3001b030 con 0x7efe38153ec0 2023-07-27T14:31:21.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.727+0000 7efe267fc700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe1805f1c0 0x7efe18061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:21.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.727+0000 7efe267fc700 1 -- 172.21.15.115:0/2422026045 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efe3007a730 con 0x7efe38153ec0 2023-07-27T14:31:21.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.727+0000 7efe3659c700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe1805f1c0 0x7efe18061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:21.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.728+0000 7efe3659c700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe1805f1c0 0x7efe18061680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7efe28006fd0 tx=0x7efe28008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:21.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.731+0000 7efe267fc700 1 -- 172.21.15.115:0/2422026045 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efe3004b790 con 0x7efe38153ec0 2023-07-27T14:31:21.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.896+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe3806c470 con 0x7efe1805f1c0 2023-07-27T14:31:21.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.906+0000 7efe267fc700 1 -- 172.21.15.115:0/2422026045 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361292 (secure 0 0 0) 0x7efe3806c470 con 0x7efe1805f1c0 2023-07-27T14:31:21.942 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe1805f1c0 msgr2=0x7efe18061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe1805f1c0 0x7efe18061680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7efe28006fd0 tx=0x7efe28008040).stop 2023-07-27T14:31:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe38153ec0 msgr2=0x7efe380c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe38153ec0 0x7efe380c39c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7efe30007f20 tx=0x7efe300098a0).stop 2023-07-27T14:31:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 shutdown_connections 2023-07-27T14:31:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe1805f1c0 0x7efe18061680 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe38153ec0 0x7efe380c39c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe380aa050 0x7efe380a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 --2- 172.21.15.115:0/2422026045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efe380aaa40 0x7efe380af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 >> 172.21.15.115:0/2422026045 conn(0x7efe380cb610 msgr2=0x7efe380c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 shutdown_connections 2023-07-27T14:31:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:21.911+0000 7efe3cdff700 1 -- 172.21.15.115:0/2422026045 wait complete. 2023-07-27T14:31:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:31:21.960 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2023-07-27T14:31:21.495089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83256,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":75200,"kb_avail":754891464,"statfs":{"total":773094113280,"available":773008859136,"internally_reserved":0,"allocated":8183808,"data_stored":3739740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77004800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2823684,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-12,"num_read_kb":-31,"num_write":-553,"num_write_kb":-207647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-8,"num_bytes_recovered":-7340270,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.229057"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.235505+0000","last_change":"2023-07-27T14:31:17.235505+0000","last_active":"2023-07-27T14:31:17.235505+0000","last_peered":"2023-07-27T14:31:17.235505+0000","last_clean":"2023-07-27T14:31:17.235505+0000","last_became_active":"2023-07-27T14:31:17.235224+0000","last_became_peered":"2023-07-27T14:31:17.235224+0000","last_unstale":"2023-07-27T14:31:17.235505+0000","last_undegraded":"2023-07-27T14:31:17.235505+0000","last_fullsized":"2023-07-27T14:31:17.235505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"83'3","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250649+0000","last_change":"2023-07-27T14:31:16.788326+0000","last_active":"2023-07-27T14:31:17.250649+0000","last_peered":"2023-07-27T14:31:17.250649+0000","last_clean":"2023-07-27T14:31:17.250649+0000","last_became_active":"2023-07-27T14:31:16.788004+0000","last_became_peered":"2023-07-27T14:31:16.788004+0000","last_unstale":"2023-07-27T14:31:17.250649+0000","last_undegraded":"2023-07-27T14:31:17.250649+0000","last_fullsized":"2023-07-27T14:31:17.250649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250952+0000","last_change":"2023-07-27T14:31:17.250952+0000","last_active":"2023-07-27T14:31:17.250952+0000","last_peered":"2023-07-27T14:31:17.250952+0000","last_clean":"2023-07-27T14:31:17.250952+0000","last_became_active":"2023-07-27T14:31:17.250598+0000","last_became_peered":"2023-07-27T14:31:17.250598+0000","last_unstale":"2023-07-27T14:31:17.250952+0000","last_undegraded":"2023-07-27T14:31:17.250952+0000","last_fullsized":"2023-07-27T14:31:17.250952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790003+0000","last_change":"2023-07-27T14:31:16.782281+0000","last_active":"2023-07-27T14:31:16.790003+0000","last_peered":"2023-07-27T14:31:16.790003+0000","last_clean":"2023-07-27T14:31:16.790003+0000","last_became_active":"2023-07-27T14:31:16.782010+0000","last_became_peered":"2023-07-27T14:31:16.782010+0000","last_unstale":"2023-07-27T14:31:16.790003+0000","last_undegraded":"2023-07-27T14:31:16.790003+0000","last_fullsized":"2023-07-27T14:31:16.790003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245572+0000","last_change":"2023-07-27T14:31:17.241047+0000","last_active":"2023-07-27T14:31:17.245572+0000","last_peered":"2023-07-27T14:31:17.245572+0000","last_clean":"2023-07-27T14:31:17.245572+0000","last_became_active":"2023-07-27T14:31:17.240737+0000","last_became_peered":"2023-07-27T14:31:17.240737+0000","last_unstale":"2023-07-27T14:31:17.245572+0000","last_undegraded":"2023-07-27T14:31:17.245572+0000","last_fullsized":"2023-07-27T14:31:17.245572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221238+0000","last_change":"2023-07-27T14:31:16.778699+0000","last_active":"2023-07-27T14:31:17.221238+0000","last_peered":"2023-07-27T14:31:17.221238+0000","last_clean":"2023-07-27T14:31:17.221238+0000","last_became_active":"2023-07-27T14:31:16.778351+0000","last_became_peered":"2023-07-27T14:31:16.778351+0000","last_unstale":"2023-07-27T14:31:17.221238+0000","last_undegraded":"2023-07-27T14:31:17.221238+0000","last_fullsized":"2023-07-27T14:31:17.221238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.241680+0000","last_change":"2023-07-27T14:31:17.241680+0000","last_active":"2023-07-27T14:31:17.241680+0000","last_peered":"2023-07-27T14:31:17.241680+0000","last_clean":"2023-07-27T14:31:17.241680+0000","last_became_active":"2023-07-27T14:31:17.241408+0000","last_became_peered":"2023-07-27T14:31:17.241408+0000","last_unstale":"2023-07-27T14:31:17.241680+0000","last_undegraded":"2023-07-27T14:31:17.241680+0000","last_fullsized":"2023-07-27T14:31:17.241680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245035+0000","last_change":"2023-07-27T14:31:16.780648+0000","last_active":"2023-07-27T14:31:17.245035+0000","last_peered":"2023-07-27T14:31:17.245035+0000","last_clean":"2023-07-27T14:31:17.245035+0000","last_became_active":"2023-07-27T14:31:16.780370+0000","last_became_peered":"2023-07-27T14:31:16.780370+0000","last_unstale":"2023-07-27T14:31:17.245035+0000","last_undegraded":"2023-07-27T14:31:17.245035+0000","last_fullsized":"2023-07-27T14:31:17.245035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246068+0000","last_change":"2023-07-27T14:31:17.246068+0000","last_active":"2023-07-27T14:31:17.246068+0000","last_peered":"2023-07-27T14:31:17.246068+0000","last_clean":"2023-07-27T14:31:17.246068+0000","last_became_active":"2023-07-27T14:31:17.245780+0000","last_became_peered":"2023-07-27T14:31:17.245780+0000","last_unstale":"2023-07-27T14:31:17.246068+0000","last_undegraded":"2023-07-27T14:31:17.246068+0000","last_fullsized":"2023-07-27T14:31:17.246068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.227364+0000","last_change":"2023-07-27T14:31:16.783048+0000","last_active":"2023-07-27T14:31:17.227364+0000","last_peered":"2023-07-27T14:31:17.227364+0000","last_clean":"2023-07-27T14:31:17.227364+0000","last_became_active":"2023-07-27T14:31:16.782803+0000","last_became_peered":"2023-07-27T14:31:16.782803+0000","last_unstale":"2023-07-27T14:31:17.227364+0000","last_undegraded":"2023-07-27T14:31:17.227364+0000","last_fullsized":"2023-07-27T14:31:17.227364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250139+0000","last_change":"2023-07-27T14:31:17.250139+0000","last_active":"2023-07-27T14:31:17.250139+0000","last_peered":"2023-07-27T14:31:17.250139+0000","last_clean":"2023-07-27T14:31:17.250139+0000","last_became_active":"2023-07-27T14:31:17.249855+0000","last_became_peered":"2023-07-27T14:31:17.249855+0000","last_unstale":"2023-07-27T14:31:17.250139+0000","last_undegraded":"2023-07-27T14:31:17.250139+0000","last_fullsized":"2023-07-27T14:31:17.250139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.224536+0000","last_change":"2023-07-27T14:31:16.776222+0000","last_active":"2023-07-27T14:31:17.224536+0000","last_peered":"2023-07-27T14:31:17.224536+0000","last_clean":"2023-07-27T14:31:17.224536+0000","last_became_active":"2023-07-27T14:31:16.775951+0000","last_became_peered":"2023-07-27T14:31:16.775951+0000","last_unstale":"2023-07-27T14:31:17.224536+0000","last_undegraded":"2023-07-27T14:31:17.224536+0000","last_fullsized":"2023-07-27T14:31:17.224536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246049+0000","last_change":"2023-07-27T14:31:17.246049+0000","last_active":"2023-07-27T14:31:17.246049+0000","last_peered":"2023-07-27T14:31:17.246049+0000","last_clean":"2023-07-27T14:31:17.246049+0000","last_became_active":"2023-07-27T14:31:17.245768+0000","last_became_peered":"2023-07-27T14:31:17.245768+0000","last_unstale":"2023-07-27T14:31:17.246049+0000","last_undegraded":"2023-07-27T14:31:17.246049+0000","last_fullsized":"2023-07-27T14:31:17.246049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789175+0000","last_change":"2023-07-27T14:31:16.783160+0000","last_active":"2023-07-27T14:31:16.789175+0000","last_peered":"2023-07-27T14:31:16.789175+0000","last_clean":"2023-07-27T14:31:16.789175+0000","last_became_active":"2023-07-27T14:31:16.782874+0000","last_became_peered":"2023-07-27T14:31:16.782874+0000","last_unstale":"2023-07-27T14:31:16.789175+0000","last_undegraded":"2023-07-27T14:31:16.789175+0000","last_fullsized":"2023-07-27T14:31:16.789175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243883+0000","last_change":"2023-07-27T14:31:17.232184+0000","last_active":"2023-07-27T14:31:17.243883+0000","last_peered":"2023-07-27T14:31:17.243883+0000","last_clean":"2023-07-27T14:31:17.243883+0000","last_became_active":"2023-07-27T14:31:17.231880+0000","last_became_peered":"2023-07-27T14:31:17.231880+0000","last_unstale":"2023-07-27T14:31:17.243883+0000","last_undegraded":"2023-07-27T14:31:17.243883+0000","last_fullsized":"2023-07-27T14:31:17.243883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789311+0000","last_change":"2023-07-27T14:31:16.780819+0000","last_active":"2023-07-27T14:31:16.789311+0000","last_peered":"2023-07-27T14:31:16.789311+0000","last_clean":"2023-07-27T14:31:16.789311+0000","last_became_active":"2023-07-27T14:31:16.780376+0000","last_became_peered":"2023-07-27T14:31:16.780376+0000","last_unstale":"2023-07-27T14:31:16.789311+0000","last_undegraded":"2023-07-27T14:31:16.789311+0000","last_fullsized":"2023-07-27T14:31:16.789311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240599+0000","last_change":"2023-07-27T14:31:17.229878+0000","last_active":"2023-07-27T14:31:17.240599+0000","last_peered":"2023-07-27T14:31:17.240599+0000","last_clean":"2023-07-27T14:31:17.240599+0000","last_became_active":"2023-07-27T14:31:17.229059+0000","last_became_peered":"2023-07-27T14:31:17.229059+0000","last_unstale":"2023-07-27T14:31:17.240599+0000","last_undegraded":"2023-07-27T14:31:17.240599+0000","last_fullsized":"2023-07-27T14:31:17.240599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793436+0000","last_change":"2023-07-27T14:31:16.785109+0000","last_active":"2023-07-27T14:31:16.793436+0000","last_peered":"2023-07-27T14:31:16.793436+0000","last_clean":"2023-07-27T14:31:16.793436+0000","last_became_active":"2023-07-27T14:31:16.784793+0000","last_became_peered":"2023-07-27T14:31:16.784793+0000","last_unstale":"2023-07-27T14:31:16.793436+0000","last_undegraded":"2023-07-27T14:31:16.793436+0000","last_fullsized":"2023-07-27T14:31:16.793436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.242913+0000","last_change":"2023-07-27T14:31:17.242913+0000","last_active":"2023-07-27T14:31:17.242913+0000","last_peered":"2023-07-27T14:31:17.242913+0000","last_clean":"2023-07-27T14:31:17.242913+0000","last_became_active":"2023-07-27T14:31:17.242648+0000","last_became_peered":"2023-07-27T14:31:17.242648+0000","last_unstale":"2023-07-27T14:31:17.242913+0000","last_undegraded":"2023-07-27T14:31:17.242913+0000","last_fullsized":"2023-07-27T14:31:17.242913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790823+0000","last_change":"2023-07-27T14:31:16.787936+0000","last_active":"2023-07-27T14:31:16.790823+0000","last_peered":"2023-07-27T14:31:16.790823+0000","last_clean":"2023-07-27T14:31:16.790823+0000","last_became_active":"2023-07-27T14:31:16.787590+0000","last_became_peered":"2023-07-27T14:31:16.787590+0000","last_unstale":"2023-07-27T14:31:16.790823+0000","last_undegraded":"2023-07-27T14:31:16.790823+0000","last_fullsized":"2023-07-27T14:31:16.790823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245556+0000","last_change":"2023-07-27T14:31:17.240998+0000","last_active":"2023-07-27T14:31:17.245556+0000","last_peered":"2023-07-27T14:31:17.245556+0000","last_clean":"2023-07-27T14:31:17.245556+0000","last_became_active":"2023-07-27T14:31:17.240412+0000","last_became_peered":"2023-07-27T14:31:17.240412+0000","last_unstale":"2023-07-27T14:31:17.245556+0000","last_undegraded":"2023-07-27T14:31:17.245556+0000","last_fullsized":"2023-07-27T14:31:17.245556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.222174+0000","last_change":"2023-07-27T14:31:16.781936+0000","last_active":"2023-07-27T14:31:17.222174+0000","last_peered":"2023-07-27T14:31:17.222174+0000","last_clean":"2023-07-27T14:31:17.222174+0000","last_became_active":"2023-07-27T14:31:16.781579+0000","last_became_peered":"2023-07-27T14:31:16.781579+0000","last_unstale":"2023-07-27T14:31:17.222174+0000","last_undegraded":"2023-07-27T14:31:17.222174+0000","last_fullsized":"2023-07-27T14:31:17.222174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245255+0000","last_change":"2023-07-27T14:31:17.245255+0000","last_active":"2023-07-27T14:31:17.245255+0000","last_peered":"2023-07-27T14:31:17.245255+0000","last_clean":"2023-07-27T14:31:17.245255+0000","last_became_active":"2023-07-27T14:31:17.244919+0000","last_became_peered":"2023-07-27T14:31:17.244919+0000","last_unstale":"2023-07-27T14:31:17.245255+0000","last_undegraded":"2023-07-27T14:31:17.245255+0000","last_fullsized":"2023-07-27T14:31:17.245255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"83'4","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250562+0000","last_change":"2023-07-27T14:31:16.786211+0000","last_active":"2023-07-27T14:31:17.250562+0000","last_peered":"2023-07-27T14:31:17.250562+0000","last_clean":"2023-07-27T14:31:17.250562+0000","last_became_active":"2023-07-27T14:31:16.785903+0000","last_became_peered":"2023-07-27T14:31:16.785903+0000","last_unstale":"2023-07-27T14:31:17.250562+0000","last_undegraded":"2023-07-27T14:31:17.250562+0000","last_fullsized":"2023-07-27T14:31:17.250562+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.238554+0000","last_change":"2023-07-27T14:31:17.238554+0000","last_active":"2023-07-27T14:31:17.238554+0000","last_peered":"2023-07-27T14:31:17.238554+0000","last_clean":"2023-07-27T14:31:17.238554+0000","last_became_active":"2023-07-27T14:31:17.238252+0000","last_became_peered":"2023-07-27T14:31:17.238252+0000","last_unstale":"2023-07-27T14:31:17.238554+0000","last_undegraded":"2023-07-27T14:31:17.238554+0000","last_fullsized":"2023-07-27T14:31:17.238554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.224752+0000","last_change":"2023-07-27T14:31:16.773601+0000","last_active":"2023-07-27T14:31:17.224752+0000","last_peered":"2023-07-27T14:31:17.224752+0000","last_clean":"2023-07-27T14:31:17.224752+0000","last_became_active":"2023-07-27T14:31:16.773347+0000","last_became_peered":"2023-07-27T14:31:16.773347+0000","last_unstale":"2023-07-27T14:31:17.224752+0000","last_undegraded":"2023-07-27T14:31:17.224752+0000","last_fullsized":"2023-07-27T14:31:17.224752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246101+0000","last_change":"2023-07-27T14:31:17.246101+0000","last_active":"2023-07-27T14:31:17.246101+0000","last_peered":"2023-07-27T14:31:17.246101+0000","last_clean":"2023-07-27T14:31:17.246101+0000","last_became_active":"2023-07-27T14:31:17.245815+0000","last_became_peered":"2023-07-27T14:31:17.245815+0000","last_unstale":"2023-07-27T14:31:17.246101+0000","last_undegraded":"2023-07-27T14:31:17.246101+0000","last_fullsized":"2023-07-27T14:31:17.246101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793470+0000","last_change":"2023-07-27T14:31:16.784439+0000","last_active":"2023-07-27T14:31:16.793470+0000","last_peered":"2023-07-27T14:31:16.793470+0000","last_clean":"2023-07-27T14:31:16.793470+0000","last_became_active":"2023-07-27T14:31:16.784067+0000","last_became_peered":"2023-07-27T14:31:16.784067+0000","last_unstale":"2023-07-27T14:31:16.793470+0000","last_undegraded":"2023-07-27T14:31:16.793470+0000","last_fullsized":"2023-07-27T14:31:16.793470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.238119+0000","last_change":"2023-07-27T14:31:17.238119+0000","last_active":"2023-07-27T14:31:17.238119+0000","last_peered":"2023-07-27T14:31:17.238119+0000","last_clean":"2023-07-27T14:31:17.238119+0000","last_became_active":"2023-07-27T14:31:17.237837+0000","last_became_peered":"2023-07-27T14:31:17.237837+0000","last_unstale":"2023-07-27T14:31:17.238119+0000","last_undegraded":"2023-07-27T14:31:17.238119+0000","last_fullsized":"2023-07-27T14:31:17.238119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789243+0000","last_change":"2023-07-27T14:31:16.786362+0000","last_active":"2023-07-27T14:31:16.789243+0000","last_peered":"2023-07-27T14:31:16.789243+0000","last_clean":"2023-07-27T14:31:16.789243+0000","last_became_active":"2023-07-27T14:31:16.786021+0000","last_became_peered":"2023-07-27T14:31:16.786021+0000","last_unstale":"2023-07-27T14:31:16.789243+0000","last_undegraded":"2023-07-27T14:31:16.789243+0000","last_fullsized":"2023-07-27T14:31:16.789243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.236035+0000","last_change":"2023-07-27T14:31:17.236035+0000","last_active":"2023-07-27T14:31:17.236035+0000","last_peered":"2023-07-27T14:31:17.236035+0000","last_clean":"2023-07-27T14:31:17.236035+0000","last_became_active":"2023-07-27T14:31:17.235634+0000","last_became_peered":"2023-07-27T14:31:17.235634+0000","last_unstale":"2023-07-27T14:31:17.236035+0000","last_undegraded":"2023-07-27T14:31:17.236035+0000","last_fullsized":"2023-07-27T14:31:17.236035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"83'4","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250602+0000","last_change":"2023-07-27T14:31:16.775124+0000","last_active":"2023-07-27T14:31:17.250602+0000","last_peered":"2023-07-27T14:31:17.250602+0000","last_clean":"2023-07-27T14:31:17.250602+0000","last_became_active":"2023-07-27T14:31:16.774804+0000","last_became_peered":"2023-07-27T14:31:16.774804+0000","last_unstale":"2023-07-27T14:31:17.250602+0000","last_undegraded":"2023-07-27T14:31:17.250602+0000","last_fullsized":"2023-07-27T14:31:17.250602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.239521+0000","last_change":"2023-07-27T14:31:17.239521+0000","last_active":"2023-07-27T14:31:17.239521+0000","last_peered":"2023-07-27T14:31:17.239521+0000","last_clean":"2023-07-27T14:31:17.239521+0000","last_became_active":"2023-07-27T14:31:17.239236+0000","last_became_peered":"2023-07-27T14:31:17.239236+0000","last_unstale":"2023-07-27T14:31:17.239521+0000","last_undegraded":"2023-07-27T14:31:17.239521+0000","last_fullsized":"2023-07-27T14:31:17.239521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793458+0000","last_change":"2023-07-27T14:31:16.785635+0000","last_active":"2023-07-27T14:31:16.793458+0000","last_peered":"2023-07-27T14:31:16.793458+0000","last_clean":"2023-07-27T14:31:16.793458+0000","last_became_active":"2023-07-27T14:31:16.785351+0000","last_became_peered":"2023-07-27T14:31:16.785351+0000","last_unstale":"2023-07-27T14:31:16.793458+0000","last_undegraded":"2023-07-27T14:31:16.793458+0000","last_fullsized":"2023-07-27T14:31:16.793458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.233010+0000","last_change":"2023-07-27T14:31:17.233010+0000","last_active":"2023-07-27T14:31:17.233010+0000","last_peered":"2023-07-27T14:31:17.233010+0000","last_clean":"2023-07-27T14:31:17.233010+0000","last_became_active":"2023-07-27T14:31:17.232731+0000","last_became_peered":"2023-07-27T14:31:17.232731+0000","last_unstale":"2023-07-27T14:31:17.233010+0000","last_undegraded":"2023-07-27T14:31:17.233010+0000","last_fullsized":"2023-07-27T14:31:17.233010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790476+0000","last_change":"2023-07-27T14:31:16.786485+0000","last_active":"2023-07-27T14:31:16.790476+0000","last_peered":"2023-07-27T14:31:16.790476+0000","last_clean":"2023-07-27T14:31:16.790476+0000","last_became_active":"2023-07-27T14:31:16.786228+0000","last_became_peered":"2023-07-27T14:31:16.786228+0000","last_unstale":"2023-07-27T14:31:16.790476+0000","last_undegraded":"2023-07-27T14:31:16.790476+0000","last_fullsized":"2023-07-27T14:31:16.790476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.235954+0000","last_change":"2023-07-27T14:31:17.235954+0000","last_active":"2023-07-27T14:31:17.235954+0000","last_peered":"2023-07-27T14:31:17.235954+0000","last_clean":"2023-07-27T14:31:17.235954+0000","last_became_active":"2023-07-27T14:31:17.235624+0000","last_became_peered":"2023-07-27T14:31:17.235624+0000","last_unstale":"2023-07-27T14:31:17.235954+0000","last_undegraded":"2023-07-27T14:31:17.235954+0000","last_fullsized":"2023-07-27T14:31:17.235954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.226540+0000","last_change":"2023-07-27T14:31:16.781796+0000","last_active":"2023-07-27T14:31:17.226540+0000","last_peered":"2023-07-27T14:31:17.226540+0000","last_clean":"2023-07-27T14:31:17.226540+0000","last_became_active":"2023-07-27T14:31:16.781214+0000","last_became_peered":"2023-07-27T14:31:16.781214+0000","last_unstale":"2023-07-27T14:31:17.226540+0000","last_undegraded":"2023-07-27T14:31:17.226540+0000","last_fullsized":"2023-07-27T14:31:17.226540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244153+0000","last_change":"2023-07-27T14:31:17.244153+0000","last_active":"2023-07-27T14:31:17.244153+0000","last_peered":"2023-07-27T14:31:17.244153+0000","last_clean":"2023-07-27T14:31:17.244153+0000","last_became_active":"2023-07-27T14:31:17.243837+0000","last_became_peered":"2023-07-27T14:31:17.243837+0000","last_unstale":"2023-07-27T14:31:17.244153+0000","last_undegraded":"2023-07-27T14:31:17.244153+0000","last_fullsized":"2023-07-27T14:31:17.244153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.780774+0000","last_change":"2023-07-27T14:31:16.776248+0000","last_active":"2023-07-27T14:31:16.780774+0000","last_peered":"2023-07-27T14:31:16.780774+0000","last_clean":"2023-07-27T14:31:16.780774+0000","last_became_active":"2023-07-27T14:31:16.775917+0000","last_became_peered":"2023-07-27T14:31:16.775917+0000","last_unstale":"2023-07-27T14:31:16.780774+0000","last_undegraded":"2023-07-27T14:31:16.780774+0000","last_fullsized":"2023-07-27T14:31:16.780774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.238533+0000","last_change":"2023-07-27T14:31:17.238533+0000","last_active":"2023-07-27T14:31:17.238533+0000","last_peered":"2023-07-27T14:31:17.238533+0000","last_clean":"2023-07-27T14:31:17.238533+0000","last_became_active":"2023-07-27T14:31:17.238249+0000","last_became_peered":"2023-07-27T14:31:17.238249+0000","last_unstale":"2023-07-27T14:31:17.238533+0000","last_undegraded":"2023-07-27T14:31:17.238533+0000","last_fullsized":"2023-07-27T14:31:17.238533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.229319+0000","last_change":"2023-07-27T14:31:16.778960+0000","last_active":"2023-07-27T14:31:17.229319+0000","last_peered":"2023-07-27T14:31:17.229319+0000","last_clean":"2023-07-27T14:31:17.229319+0000","last_became_active":"2023-07-27T14:31:16.778121+0000","last_became_peered":"2023-07-27T14:31:16.778121+0000","last_unstale":"2023-07-27T14:31:17.229319+0000","last_undegraded":"2023-07-27T14:31:17.229319+0000","last_fullsized":"2023-07-27T14:31:17.229319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247004+0000","last_change":"2023-07-27T14:31:17.236501+0000","last_active":"2023-07-27T14:31:17.247004+0000","last_peered":"2023-07-27T14:31:17.247004+0000","last_clean":"2023-07-27T14:31:17.247004+0000","last_became_active":"2023-07-27T14:31:17.236239+0000","last_became_peered":"2023-07-27T14:31:17.236239+0000","last_unstale":"2023-07-27T14:31:17.247004+0000","last_undegraded":"2023-07-27T14:31:17.247004+0000","last_fullsized":"2023-07-27T14:31:17.247004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790484+0000","last_change":"2023-07-27T14:31:16.788123+0000","last_active":"2023-07-27T14:31:16.790484+0000","last_peered":"2023-07-27T14:31:16.790484+0000","last_clean":"2023-07-27T14:31:16.790484+0000","last_became_active":"2023-07-27T14:31:16.787855+0000","last_became_peered":"2023-07-27T14:31:16.787855+0000","last_unstale":"2023-07-27T14:31:16.790484+0000","last_undegraded":"2023-07-27T14:31:16.790484+0000","last_fullsized":"2023-07-27T14:31:16.790484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.248037+0000","last_change":"2023-07-27T14:31:17.248037+0000","last_active":"2023-07-27T14:31:17.248037+0000","last_peered":"2023-07-27T14:31:17.248037+0000","last_clean":"2023-07-27T14:31:17.248037+0000","last_became_active":"2023-07-27T14:31:17.247769+0000","last_became_peered":"2023-07-27T14:31:17.247769+0000","last_unstale":"2023-07-27T14:31:17.248037+0000","last_undegraded":"2023-07-27T14:31:17.248037+0000","last_fullsized":"2023-07-27T14:31:17.248037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221094+0000","last_change":"2023-07-27T14:31:16.783790+0000","last_active":"2023-07-27T14:31:17.221094+0000","last_peered":"2023-07-27T14:31:17.221094+0000","last_clean":"2023-07-27T14:31:17.221094+0000","last_became_active":"2023-07-27T14:31:16.783440+0000","last_became_peered":"2023-07-27T14:31:16.783440+0000","last_unstale":"2023-07-27T14:31:17.221094+0000","last_undegraded":"2023-07-27T14:31:17.221094+0000","last_fullsized":"2023-07-27T14:31:17.221094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244328+0000","last_change":"2023-07-27T14:31:17.244328+0000","last_active":"2023-07-27T14:31:17.244328+0000","last_peered":"2023-07-27T14:31:17.244328+0000","last_clean":"2023-07-27T14:31:17.244328+0000","last_became_active":"2023-07-27T14:31:17.244057+0000","last_became_peered":"2023-07-27T14:31:17.244057+0000","last_unstale":"2023-07-27T14:31:17.244328+0000","last_undegraded":"2023-07-27T14:31:17.244328+0000","last_fullsized":"2023-07-27T14:31:17.244328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221333+0000","last_change":"2023-07-27T14:31:16.791286+0000","last_active":"2023-07-27T14:31:17.221333+0000","last_peered":"2023-07-27T14:31:17.221333+0000","last_clean":"2023-07-27T14:31:17.221333+0000","last_became_active":"2023-07-27T14:31:16.790891+0000","last_became_peered":"2023-07-27T14:31:16.790891+0000","last_unstale":"2023-07-27T14:31:17.221333+0000","last_undegraded":"2023-07-27T14:31:17.221333+0000","last_fullsized":"2023-07-27T14:31:17.221333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245774+0000","last_change":"2023-07-27T14:31:17.243000+0000","last_active":"2023-07-27T14:31:17.245774+0000","last_peered":"2023-07-27T14:31:17.245774+0000","last_clean":"2023-07-27T14:31:17.245774+0000","last_became_active":"2023-07-27T14:31:17.242654+0000","last_became_peered":"2023-07-27T14:31:17.242654+0000","last_unstale":"2023-07-27T14:31:17.245774+0000","last_undegraded":"2023-07-27T14:31:17.245774+0000","last_fullsized":"2023-07-27T14:31:17.245774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.785176+0000","last_change":"2023-07-27T14:31:16.778458+0000","last_active":"2023-07-27T14:31:16.785176+0000","last_peered":"2023-07-27T14:31:16.785176+0000","last_clean":"2023-07-27T14:31:16.785176+0000","last_became_active":"2023-07-27T14:31:16.778157+0000","last_became_peered":"2023-07-27T14:31:16.778157+0000","last_unstale":"2023-07-27T14:31:16.785176+0000","last_undegraded":"2023-07-27T14:31:16.785176+0000","last_fullsized":"2023-07-27T14:31:16.785176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243112+0000","last_change":"2023-07-27T14:31:17.243112+0000","last_active":"2023-07-27T14:31:17.243112+0000","last_peered":"2023-07-27T14:31:17.243112+0000","last_clean":"2023-07-27T14:31:17.243112+0000","last_became_active":"2023-07-27T14:31:17.242784+0000","last_became_peered":"2023-07-27T14:31:17.242784+0000","last_unstale":"2023-07-27T14:31:17.243112+0000","last_undegraded":"2023-07-27T14:31:17.243112+0000","last_fullsized":"2023-07-27T14:31:17.243112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790065+0000","last_change":"2023-07-27T14:31:16.786829+0000","last_active":"2023-07-27T14:31:16.790065+0000","last_peered":"2023-07-27T14:31:16.790065+0000","last_clean":"2023-07-27T14:31:16.790065+0000","last_became_active":"2023-07-27T14:31:16.786566+0000","last_became_peered":"2023-07-27T14:31:16.786566+0000","last_unstale":"2023-07-27T14:31:16.790065+0000","last_undegraded":"2023-07-27T14:31:16.790065+0000","last_fullsized":"2023-07-27T14:31:16.790065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245195+0000","last_change":"2023-07-27T14:31:17.240262+0000","last_active":"2023-07-27T14:31:17.245195+0000","last_peered":"2023-07-27T14:31:17.245195+0000","last_clean":"2023-07-27T14:31:17.245195+0000","last_became_active":"2023-07-27T14:31:17.239944+0000","last_became_peered":"2023-07-27T14:31:17.239944+0000","last_unstale":"2023-07-27T14:31:17.245195+0000","last_undegraded":"2023-07-27T14:31:17.245195+0000","last_fullsized":"2023-07-27T14:31:17.245195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221329+0000","last_change":"2023-07-27T14:31:16.779260+0000","last_active":"2023-07-27T14:31:17.221329+0000","last_peered":"2023-07-27T14:31:17.221329+0000","last_clean":"2023-07-27T14:31:17.221329+0000","last_became_active":"2023-07-27T14:31:16.778996+0000","last_became_peered":"2023-07-27T14:31:16.778996+0000","last_unstale":"2023-07-27T14:31:17.221329+0000","last_undegraded":"2023-07-27T14:31:17.221329+0000","last_fullsized":"2023-07-27T14:31:17.221329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243426+0000","last_change":"2023-07-27T14:31:17.243426+0000","last_active":"2023-07-27T14:31:17.243426+0000","last_peered":"2023-07-27T14:31:17.243426+0000","last_clean":"2023-07-27T14:31:17.243426+0000","last_became_active":"2023-07-27T14:31:17.243159+0000","last_became_peered":"2023-07-27T14:31:17.243159+0000","last_unstale":"2023-07-27T14:31:17.243426+0000","last_undegraded":"2023-07-27T14:31:17.243426+0000","last_fullsized":"2023-07-27T14:31:17.243426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790435+0000","last_change":"2023-07-27T14:31:16.788140+0000","last_active":"2023-07-27T14:31:16.790435+0000","last_peered":"2023-07-27T14:31:16.790435+0000","last_clean":"2023-07-27T14:31:16.790435+0000","last_became_active":"2023-07-27T14:31:16.787722+0000","last_became_peered":"2023-07-27T14:31:16.787722+0000","last_unstale":"2023-07-27T14:31:16.790435+0000","last_undegraded":"2023-07-27T14:31:16.790435+0000","last_fullsized":"2023-07-27T14:31:16.790435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243941+0000","last_change":"2023-07-27T14:31:17.243941+0000","last_active":"2023-07-27T14:31:17.243941+0000","last_peered":"2023-07-27T14:31:17.243941+0000","last_clean":"2023-07-27T14:31:17.243941+0000","last_became_active":"2023-07-27T14:31:17.243679+0000","last_became_peered":"2023-07-27T14:31:17.243679+0000","last_unstale":"2023-07-27T14:31:17.243941+0000","last_undegraded":"2023-07-27T14:31:17.243941+0000","last_fullsized":"2023-07-27T14:31:17.243941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221043+0000","last_change":"2023-07-27T14:31:16.776337+0000","last_active":"2023-07-27T14:31:17.221043+0000","last_peered":"2023-07-27T14:31:17.221043+0000","last_clean":"2023-07-27T14:31:17.221043+0000","last_became_active":"2023-07-27T14:31:16.775264+0000","last_became_peered":"2023-07-27T14:31:16.775264+0000","last_unstale":"2023-07-27T14:31:17.221043+0000","last_undegraded":"2023-07-27T14:31:17.221043+0000","last_fullsized":"2023-07-27T14:31:17.221043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243695+0000","last_change":"2023-07-27T14:31:17.233072+0000","last_active":"2023-07-27T14:31:17.243695+0000","last_peered":"2023-07-27T14:31:17.243695+0000","last_clean":"2023-07-27T14:31:17.243695+0000","last_became_active":"2023-07-27T14:31:17.232793+0000","last_became_peered":"2023-07-27T14:31:17.232793+0000","last_unstale":"2023-07-27T14:31:17.243695+0000","last_undegraded":"2023-07-27T14:31:17.243695+0000","last_fullsized":"2023-07-27T14:31:17.243695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.782525+0000","last_change":"2023-07-27T14:31:16.771506+0000","last_active":"2023-07-27T14:31:16.782525+0000","last_peered":"2023-07-27T14:31:16.782525+0000","last_clean":"2023-07-27T14:31:16.782525+0000","last_became_active":"2023-07-27T14:31:16.771181+0000","last_became_peered":"2023-07-27T14:31:16.771181+0000","last_unstale":"2023-07-27T14:31:16.782525+0000","last_undegraded":"2023-07-27T14:31:16.782525+0000","last_fullsized":"2023-07-27T14:31:16.782525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250279+0000","last_change":"2023-07-27T14:31:17.250279+0000","last_active":"2023-07-27T14:31:17.250279+0000","last_peered":"2023-07-27T14:31:17.250279+0000","last_clean":"2023-07-27T14:31:17.250279+0000","last_became_active":"2023-07-27T14:31:17.249995+0000","last_became_peered":"2023-07-27T14:31:17.249995+0000","last_unstale":"2023-07-27T14:31:17.250279+0000","last_undegraded":"2023-07-27T14:31:17.250279+0000","last_fullsized":"2023-07-27T14:31:17.250279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790192+0000","last_change":"2023-07-27T14:31:16.787300+0000","last_active":"2023-07-27T14:31:16.790192+0000","last_peered":"2023-07-27T14:31:16.790192+0000","last_clean":"2023-07-27T14:31:16.790192+0000","last_became_active":"2023-07-27T14:31:16.786952+0000","last_became_peered":"2023-07-27T14:31:16.786952+0000","last_unstale":"2023-07-27T14:31:16.790192+0000","last_undegraded":"2023-07-27T14:31:16.790192+0000","last_fullsized":"2023-07-27T14:31:16.790192+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.237543+0000","last_change":"2023-07-27T14:31:17.237543+0000","last_active":"2023-07-27T14:31:17.237543+0000","last_peered":"2023-07-27T14:31:17.237543+0000","last_clean":"2023-07-27T14:31:17.237543+0000","last_became_active":"2023-07-27T14:31:17.237271+0000","last_became_peered":"2023-07-27T14:31:17.237271+0000","last_unstale":"2023-07-27T14:31:17.237543+0000","last_undegraded":"2023-07-27T14:31:17.237543+0000","last_fullsized":"2023-07-27T14:31:17.237543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789289+0000","last_change":"2023-07-27T14:31:16.780645+0000","last_active":"2023-07-27T14:31:16.789289+0000","last_peered":"2023-07-27T14:31:16.789289+0000","last_clean":"2023-07-27T14:31:16.789289+0000","last_became_active":"2023-07-27T14:31:16.779998+0000","last_became_peered":"2023-07-27T14:31:16.779998+0000","last_unstale":"2023-07-27T14:31:16.789289+0000","last_undegraded":"2023-07-27T14:31:16.789289+0000","last_fullsized":"2023-07-27T14:31:16.789289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.248251+0000","last_change":"2023-07-27T14:31:17.248251+0000","last_active":"2023-07-27T14:31:17.248251+0000","last_peered":"2023-07-27T14:31:17.248251+0000","last_clean":"2023-07-27T14:31:17.248251+0000","last_became_active":"2023-07-27T14:31:17.247944+0000","last_became_peered":"2023-07-27T14:31:17.247944+0000","last_unstale":"2023-07-27T14:31:17.248251+0000","last_undegraded":"2023-07-27T14:31:17.248251+0000","last_fullsized":"2023-07-27T14:31:17.248251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.231764+0000","last_change":"2023-07-27T14:31:16.783611+0000","last_active":"2023-07-27T14:31:17.231764+0000","last_peered":"2023-07-27T14:31:17.231764+0000","last_clean":"2023-07-27T14:31:17.231764+0000","last_became_active":"2023-07-27T14:31:16.783286+0000","last_became_peered":"2023-07-27T14:31:16.783286+0000","last_unstale":"2023-07-27T14:31:17.231764+0000","last_undegraded":"2023-07-27T14:31:17.231764+0000","last_fullsized":"2023-07-27T14:31:17.231764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.237150+0000","last_change":"2023-07-27T14:31:17.237150+0000","last_active":"2023-07-27T14:31:17.237150+0000","last_peered":"2023-07-27T14:31:17.237150+0000","last_clean":"2023-07-27T14:31:17.237150+0000","last_became_active":"2023-07-27T14:31:17.236872+0000","last_became_peered":"2023-07-27T14:31:17.236872+0000","last_unstale":"2023-07-27T14:31:17.237150+0000","last_undegraded":"2023-07-27T14:31:17.237150+0000","last_fullsized":"2023-07-27T14:31:17.237150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244363+0000","last_change":"2023-07-27T14:31:16.790809+0000","last_active":"2023-07-27T14:31:17.244363+0000","last_peered":"2023-07-27T14:31:17.244363+0000","last_clean":"2023-07-27T14:31:17.244363+0000","last_became_active":"2023-07-27T14:31:16.790483+0000","last_became_peered":"2023-07-27T14:31:16.790483+0000","last_unstale":"2023-07-27T14:31:17.244363+0000","last_undegraded":"2023-07-27T14:31:17.244363+0000","last_fullsized":"2023-07-27T14:31:17.244363+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.236611+0000","last_change":"2023-07-27T14:31:17.236611+0000","last_active":"2023-07-27T14:31:17.236611+0000","last_peered":"2023-07-27T14:31:17.236611+0000","last_clean":"2023-07-27T14:31:17.236611+0000","last_became_active":"2023-07-27T14:31:17.236271+0000","last_became_peered":"2023-07-27T14:31:17.236271+0000","last_unstale":"2023-07-27T14:31:17.236611+0000","last_undegraded":"2023-07-27T14:31:17.236611+0000","last_fullsized":"2023-07-27T14:31:17.236611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"83'2","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.249997+0000","last_change":"2023-07-27T14:31:16.782080+0000","last_active":"2023-07-27T14:31:17.249997+0000","last_peered":"2023-07-27T14:31:17.249997+0000","last_clean":"2023-07-27T14:31:17.249997+0000","last_became_active":"2023-07-27T14:31:16.781795+0000","last_became_peered":"2023-07-27T14:31:16.781795+0000","last_unstale":"2023-07-27T14:31:17.249997+0000","last_undegraded":"2023-07-27T14:31:17.249997+0000","last_fullsized":"2023-07-27T14:31:17.249997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.242619+0000","last_change":"2023-07-27T14:31:17.242619+0000","last_active":"2023-07-27T14:31:17.242619+0000","last_peered":"2023-07-27T14:31:17.242619+0000","last_clean":"2023-07-27T14:31:17.242619+0000","last_became_active":"2023-07-27T14:31:17.242350+0000","last_became_peered":"2023-07-27T14:31:17.242350+0000","last_unstale":"2023-07-27T14:31:17.242619+0000","last_undegraded":"2023-07-27T14:31:17.242619+0000","last_fullsized":"2023-07-27T14:31:17.242619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789300+0000","last_change":"2023-07-27T14:31:16.779682+0000","last_active":"2023-07-27T14:31:16.789300+0000","last_peered":"2023-07-27T14:31:16.789300+0000","last_clean":"2023-07-27T14:31:16.789300+0000","last_became_active":"2023-07-27T14:31:16.779411+0000","last_became_peered":"2023-07-27T14:31:16.779411+0000","last_unstale":"2023-07-27T14:31:16.789300+0000","last_undegraded":"2023-07-27T14:31:16.789300+0000","last_fullsized":"2023-07-27T14:31:16.789300+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245887+0000","last_change":"2023-07-27T14:31:17.245887+0000","last_active":"2023-07-27T14:31:17.245887+0000","last_peered":"2023-07-27T14:31:17.245887+0000","last_clean":"2023-07-27T14:31:17.245887+0000","last_became_active":"2023-07-27T14:31:17.245604+0000","last_became_peered":"2023-07-27T14:31:17.245604+0000","last_unstale":"2023-07-27T14:31:17.245887+0000","last_undegraded":"2023-07-27T14:31:17.245887+0000","last_fullsized":"2023-07-27T14:31:17.245887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.785736+0000","last_change":"2023-07-27T14:31:16.781214+0000","last_active":"2023-07-27T14:31:16.785736+0000","last_peered":"2023-07-27T14:31:16.785736+0000","last_clean":"2023-07-27T14:31:16.785736+0000","last_became_active":"2023-07-27T14:31:16.780896+0000","last_became_peered":"2023-07-27T14:31:16.780896+0000","last_unstale":"2023-07-27T14:31:16.785736+0000","last_undegraded":"2023-07-27T14:31:16.785736+0000","last_fullsized":"2023-07-27T14:31:16.785736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246058+0000","last_change":"2023-07-27T14:31:17.246058+0000","last_active":"2023-07-27T14:31:17.246058+0000","last_peered":"2023-07-27T14:31:17.246058+0000","last_clean":"2023-07-27T14:31:17.246058+0000","last_became_active":"2023-07-27T14:31:17.245506+0000","last_became_peered":"2023-07-27T14:31:17.245506+0000","last_unstale":"2023-07-27T14:31:17.246058+0000","last_undegraded":"2023-07-27T14:31:17.246058+0000","last_fullsized":"2023-07-27T14:31:17.246058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.779734+0000","last_change":"2023-07-27T14:31:16.769966+0000","last_active":"2023-07-27T14:31:16.779734+0000","last_peered":"2023-07-27T14:31:16.779734+0000","last_clean":"2023-07-27T14:31:16.779734+0000","last_became_active":"2023-07-27T14:31:16.769655+0000","last_became_peered":"2023-07-27T14:31:16.769655+0000","last_unstale":"2023-07-27T14:31:16.779734+0000","last_undegraded":"2023-07-27T14:31:16.779734+0000","last_fullsized":"2023-07-27T14:31:16.779734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240300+0000","last_change":"2023-07-27T14:31:17.240300+0000","last_active":"2023-07-27T14:31:17.240300+0000","last_peered":"2023-07-27T14:31:17.240300+0000","last_clean":"2023-07-27T14:31:17.240300+0000","last_became_active":"2023-07-27T14:31:17.239936+0000","last_became_peered":"2023-07-27T14:31:17.239936+0000","last_unstale":"2023-07-27T14:31:17.240300+0000","last_undegraded":"2023-07-27T14:31:17.240300+0000","last_fullsized":"2023-07-27T14:31:17.240300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.786474+0000","last_change":"2023-07-27T14:31:16.779372+0000","last_active":"2023-07-27T14:31:16.786474+0000","last_peered":"2023-07-27T14:31:16.786474+0000","last_clean":"2023-07-27T14:31:16.786474+0000","last_became_active":"2023-07-27T14:31:16.778803+0000","last_became_peered":"2023-07-27T14:31:16.778803+0000","last_unstale":"2023-07-27T14:31:16.786474+0000","last_undegraded":"2023-07-27T14:31:16.786474+0000","last_fullsized":"2023-07-27T14:31:16.786474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247629+0000","last_change":"2023-07-27T14:31:17.247629+0000","last_active":"2023-07-27T14:31:17.247629+0000","last_peered":"2023-07-27T14:31:17.247629+0000","last_clean":"2023-07-27T14:31:17.247629+0000","last_became_active":"2023-07-27T14:31:17.247266+0000","last_became_peered":"2023-07-27T14:31:17.247266+0000","last_unstale":"2023-07-27T14:31:17.247629+0000","last_undegraded":"2023-07-27T14:31:17.247629+0000","last_fullsized":"2023-07-27T14:31:17.247629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790992+0000","last_change":"2023-07-27T14:31:16.780133+0000","last_active":"2023-07-27T14:31:16.790992+0000","last_peered":"2023-07-27T14:31:16.790992+0000","last_clean":"2023-07-27T14:31:16.790992+0000","last_became_active":"2023-07-27T14:31:16.779735+0000","last_became_peered":"2023-07-27T14:31:16.779735+0000","last_unstale":"2023-07-27T14:31:16.790992+0000","last_undegraded":"2023-07-27T14:31:16.790992+0000","last_fullsized":"2023-07-27T14:31:16.790992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.242660+0000","last_change":"2023-07-27T14:31:17.242660+0000","last_active":"2023-07-27T14:31:17.242660+0000","last_peered":"2023-07-27T14:31:17.242660+0000","last_clean":"2023-07-27T14:31:17.242660+0000","last_became_active":"2023-07-27T14:31:17.242401+0000","last_became_peered":"2023-07-27T14:31:17.242401+0000","last_unstale":"2023-07-27T14:31:17.242660+0000","last_undegraded":"2023-07-27T14:31:17.242660+0000","last_fullsized":"2023-07-27T14:31:17.242660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.222104+0000","last_change":"2023-07-27T14:31:16.788673+0000","last_active":"2023-07-27T14:31:17.222104+0000","last_peered":"2023-07-27T14:31:17.222104+0000","last_clean":"2023-07-27T14:31:17.222104+0000","last_became_active":"2023-07-27T14:31:16.788223+0000","last_became_peered":"2023-07-27T14:31:16.788223+0000","last_unstale":"2023-07-27T14:31:17.222104+0000","last_undegraded":"2023-07-27T14:31:17.222104+0000","last_fullsized":"2023-07-27T14:31:17.222104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.234453+0000","last_change":"2023-07-27T14:31:17.234453+0000","last_active":"2023-07-27T14:31:17.234453+0000","last_peered":"2023-07-27T14:31:17.234453+0000","last_clean":"2023-07-27T14:31:17.234453+0000","last_became_active":"2023-07-27T14:31:17.233917+0000","last_became_peered":"2023-07-27T14:31:17.233917+0000","last_unstale":"2023-07-27T14:31:17.234453+0000","last_undegraded":"2023-07-27T14:31:17.234453+0000","last_fullsized":"2023-07-27T14:31:17.234453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.782680+0000","last_change":"2023-07-27T14:31:16.777065+0000","last_active":"2023-07-27T14:31:16.782680+0000","last_peered":"2023-07-27T14:31:16.782680+0000","last_clean":"2023-07-27T14:31:16.782680+0000","last_became_active":"2023-07-27T14:31:16.776730+0000","last_became_peered":"2023-07-27T14:31:16.776730+0000","last_unstale":"2023-07-27T14:31:16.782680+0000","last_undegraded":"2023-07-27T14:31:16.782680+0000","last_fullsized":"2023-07-27T14:31:16.782680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245537+0000","last_change":"2023-07-27T14:31:17.239013+0000","last_active":"2023-07-27T14:31:17.245537+0000","last_peered":"2023-07-27T14:31:17.245537+0000","last_clean":"2023-07-27T14:31:17.245537+0000","last_became_active":"2023-07-27T14:31:17.238696+0000","last_became_peered":"2023-07-27T14:31:17.238696+0000","last_unstale":"2023-07-27T14:31:17.245537+0000","last_undegraded":"2023-07-27T14:31:17.245537+0000","last_fullsized":"2023-07-27T14:31:17.245537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"83'3","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244474+0000","last_change":"2023-07-27T14:31:16.784977+0000","last_active":"2023-07-27T14:31:17.244474+0000","last_peered":"2023-07-27T14:31:17.244474+0000","last_clean":"2023-07-27T14:31:17.244474+0000","last_became_active":"2023-07-27T14:31:16.784701+0000","last_became_peered":"2023-07-27T14:31:16.784701+0000","last_unstale":"2023-07-27T14:31:17.244474+0000","last_undegraded":"2023-07-27T14:31:17.244474+0000","last_fullsized":"2023-07-27T14:31:17.244474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250265+0000","last_change":"2023-07-27T14:31:17.250265+0000","last_active":"2023-07-27T14:31:17.250265+0000","last_peered":"2023-07-27T14:31:17.250265+0000","last_clean":"2023-07-27T14:31:17.250265+0000","last_became_active":"2023-07-27T14:31:17.249947+0000","last_became_peered":"2023-07-27T14:31:17.249947+0000","last_unstale":"2023-07-27T14:31:17.250265+0000","last_undegraded":"2023-07-27T14:31:17.250265+0000","last_fullsized":"2023-07-27T14:31:17.250265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250539+0000","last_change":"2023-07-27T14:31:16.776738+0000","last_active":"2023-07-27T14:31:17.250539+0000","last_peered":"2023-07-27T14:31:17.250539+0000","last_clean":"2023-07-27T14:31:17.250539+0000","last_became_active":"2023-07-27T14:31:16.776414+0000","last_became_peered":"2023-07-27T14:31:16.776414+0000","last_unstale":"2023-07-27T14:31:17.250539+0000","last_undegraded":"2023-07-27T14:31:17.250539+0000","last_fullsized":"2023-07-27T14:31:17.250539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.231888+0000","last_change":"2023-07-27T14:31:17.231888+0000","last_active":"2023-07-27T14:31:17.231888+0000","last_peered":"2023-07-27T14:31:17.231888+0000","last_clean":"2023-07-27T14:31:17.231888+0000","last_became_active":"2023-07-27T14:31:17.231583+0000","last_became_peered":"2023-07-27T14:31:17.231583+0000","last_unstale":"2023-07-27T14:31:17.231888+0000","last_undegraded":"2023-07-27T14:31:17.231888+0000","last_fullsized":"2023-07-27T14:31:17.231888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"83'1","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.228505+0000","last_change":"2023-07-27T14:31:16.779918+0000","last_active":"2023-07-27T14:31:17.228505+0000","last_peered":"2023-07-27T14:31:17.228505+0000","last_clean":"2023-07-27T14:31:17.228505+0000","last_became_active":"2023-07-27T14:31:16.779602+0000","last_became_peered":"2023-07-27T14:31:16.779602+0000","last_unstale":"2023-07-27T14:31:17.228505+0000","last_undegraded":"2023-07-27T14:31:17.228505+0000","last_fullsized":"2023-07-27T14:31:17.228505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.241839+0000","last_change":"2023-07-27T14:31:17.241839+0000","last_active":"2023-07-27T14:31:17.241839+0000","last_peered":"2023-07-27T14:31:17.241839+0000","last_clean":"2023-07-27T14:31:17.241839+0000","last_became_active":"2023-07-27T14:31:17.241334+0000","last_became_peered":"2023-07-27T14:31:17.241334+0000","last_unstale":"2023-07-27T14:31:17.241839+0000","last_undegraded":"2023-07-27T14:31:17.241839+0000","last_fullsized":"2023-07-27T14:31:17.241839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221677+0000","last_change":"2023-07-27T14:31:16.788699+0000","last_active":"2023-07-27T14:31:17.221677+0000","last_peered":"2023-07-27T14:31:17.221677+0000","last_clean":"2023-07-27T14:31:17.221677+0000","last_became_active":"2023-07-27T14:31:16.788421+0000","last_became_peered":"2023-07-27T14:31:16.788421+0000","last_unstale":"2023-07-27T14:31:17.221677+0000","last_undegraded":"2023-07-27T14:31:17.221677+0000","last_fullsized":"2023-07-27T14:31:17.221677+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244805+0000","last_change":"2023-07-27T14:31:17.244805+0000","last_active":"2023-07-27T14:31:17.244805+0000","last_peered":"2023-07-27T14:31:17.244805+0000","last_clean":"2023-07-27T14:31:17.244805+0000","last_became_active":"2023-07-27T14:31:17.244488+0000","last_became_peered":"2023-07-27T14:31:17.244488+0000","last_unstale":"2023-07-27T14:31:17.244805+0000","last_undegraded":"2023-07-27T14:31:17.244805+0000","last_fullsized":"2023-07-27T14:31:17.244805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793325+0000","last_change":"2023-07-27T14:31:16.783048+0000","last_active":"2023-07-27T14:31:16.793325+0000","last_peered":"2023-07-27T14:31:16.793325+0000","last_clean":"2023-07-27T14:31:16.793325+0000","last_became_active":"2023-07-27T14:31:16.782759+0000","last_became_peered":"2023-07-27T14:31:16.782759+0000","last_unstale":"2023-07-27T14:31:16.793325+0000","last_undegraded":"2023-07-27T14:31:16.793325+0000","last_fullsized":"2023-07-27T14:31:16.793325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.236513+0000","last_change":"2023-07-27T14:31:17.236513+0000","last_active":"2023-07-27T14:31:17.236513+0000","last_peered":"2023-07-27T14:31:17.236513+0000","last_clean":"2023-07-27T14:31:17.236513+0000","last_became_active":"2023-07-27T14:31:17.236018+0000","last_became_peered":"2023-07-27T14:31:17.236018+0000","last_unstale":"2023-07-27T14:31:17.236513+0000","last_undegraded":"2023-07-27T14:31:17.236513+0000","last_fullsized":"2023-07-27T14:31:17.236513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"83'4","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.249105+0000","last_change":"2023-07-27T14:31:16.786705+0000","last_active":"2023-07-27T14:31:17.249105+0000","last_peered":"2023-07-27T14:31:17.249105+0000","last_clean":"2023-07-27T14:31:17.249105+0000","last_became_active":"2023-07-27T14:31:16.786398+0000","last_became_peered":"2023-07-27T14:31:16.786398+0000","last_unstale":"2023-07-27T14:31:17.249105+0000","last_undegraded":"2023-07-27T14:31:17.249105+0000","last_fullsized":"2023-07-27T14:31:17.249105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240889+0000","last_change":"2023-07-27T14:31:17.240889+0000","last_active":"2023-07-27T14:31:17.240889+0000","last_peered":"2023-07-27T14:31:17.240889+0000","last_clean":"2023-07-27T14:31:17.240889+0000","last_became_active":"2023-07-27T14:31:17.240547+0000","last_became_peered":"2023-07-27T14:31:17.240547+0000","last_unstale":"2023-07-27T14:31:17.240889+0000","last_undegraded":"2023-07-27T14:31:17.240889+0000","last_fullsized":"2023-07-27T14:31:17.240889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.241843+0000","last_change":"2023-07-27T14:31:16.780511+0000","last_active":"2023-07-27T14:31:17.241843+0000","last_peered":"2023-07-27T14:31:17.241843+0000","last_clean":"2023-07-27T14:31:17.241843+0000","last_became_active":"2023-07-27T14:31:16.780260+0000","last_became_peered":"2023-07-27T14:31:16.780260+0000","last_unstale":"2023-07-27T14:31:17.241843+0000","last_undegraded":"2023-07-27T14:31:17.241843+0000","last_fullsized":"2023-07-27T14:31:17.241843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.241295+0000","last_change":"2023-07-27T14:31:17.241295+0000","last_active":"2023-07-27T14:31:17.241295+0000","last_peered":"2023-07-27T14:31:17.241295+0000","last_clean":"2023-07-27T14:31:17.241295+0000","last_became_active":"2023-07-27T14:31:17.239220+0000","last_became_peered":"2023-07-27T14:31:17.239220+0000","last_unstale":"2023-07-27T14:31:17.241295+0000","last_undegraded":"2023-07-27T14:31:17.241295+0000","last_fullsized":"2023-07-27T14:31:17.241295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.787068+0000","last_change":"2023-07-27T14:31:16.785695+0000","last_active":"2023-07-27T14:31:16.787068+0000","last_peered":"2023-07-27T14:31:16.787068+0000","last_clean":"2023-07-27T14:31:16.787068+0000","last_became_active":"2023-07-27T14:31:16.785400+0000","last_became_peered":"2023-07-27T14:31:16.785400+0000","last_unstale":"2023-07-27T14:31:16.787068+0000","last_undegraded":"2023-07-27T14:31:16.787068+0000","last_fullsized":"2023-07-27T14:31:16.787068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.235106+0000","last_change":"2023-07-27T14:31:17.235106+0000","last_active":"2023-07-27T14:31:17.235106+0000","last_peered":"2023-07-27T14:31:17.235106+0000","last_clean":"2023-07-27T14:31:17.235106+0000","last_became_active":"2023-07-27T14:31:17.234819+0000","last_became_peered":"2023-07-27T14:31:17.234819+0000","last_unstale":"2023-07-27T14:31:17.235106+0000","last_undegraded":"2023-07-27T14:31:17.235106+0000","last_fullsized":"2023-07-27T14:31:17.235106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221933+0000","last_change":"2023-07-27T14:31:16.783387+0000","last_active":"2023-07-27T14:31:17.221933+0000","last_peered":"2023-07-27T14:31:17.221933+0000","last_clean":"2023-07-27T14:31:17.221933+0000","last_became_active":"2023-07-27T14:31:16.783086+0000","last_became_peered":"2023-07-27T14:31:16.783086+0000","last_unstale":"2023-07-27T14:31:17.221933+0000","last_undegraded":"2023-07-27T14:31:17.221933+0000","last_fullsized":"2023-07-27T14:31:17.221933+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.242214+0000","last_change":"2023-07-27T14:31:17.242214+0000","last_active":"2023-07-27T14:31:17.242214+0000","last_peered":"2023-07-27T14:31:17.242214+0000","last_clean":"2023-07-27T14:31:17.242214+0000","last_became_active":"2023-07-27T14:31:17.241932+0000","last_became_peered":"2023-07-27T14:31:17.241932+0000","last_unstale":"2023-07-27T14:31:17.242214+0000","last_undegraded":"2023-07-27T14:31:17.242214+0000","last_fullsized":"2023-07-27T14:31:17.242214+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221568+0000","last_change":"2023-07-27T14:31:16.790409+0000","last_active":"2023-07-27T14:31:17.221568+0000","last_peered":"2023-07-27T14:31:17.221568+0000","last_clean":"2023-07-27T14:31:17.221568+0000","last_became_active":"2023-07-27T14:31:16.790056+0000","last_became_peered":"2023-07-27T14:31:16.790056+0000","last_unstale":"2023-07-27T14:31:17.221568+0000","last_undegraded":"2023-07-27T14:31:17.221568+0000","last_fullsized":"2023-07-27T14:31:17.221568+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240262+0000","last_change":"2023-07-27T14:31:17.240262+0000","last_active":"2023-07-27T14:31:17.240262+0000","last_peered":"2023-07-27T14:31:17.240262+0000","last_clean":"2023-07-27T14:31:17.240262+0000","last_became_active":"2023-07-27T14:31:17.239922+0000","last_became_peered":"2023-07-27T14:31:17.239922+0000","last_unstale":"2023-07-27T14:31:17.240262+0000","last_undegraded":"2023-07-27T14:31:17.240262+0000","last_fullsized":"2023-07-27T14:31:17.240262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.789552+0000","last_change":"2023-07-27T14:31:16.783509+0000","last_active":"2023-07-27T14:31:16.789552+0000","last_peered":"2023-07-27T14:31:16.789552+0000","last_clean":"2023-07-27T14:31:16.789552+0000","last_became_active":"2023-07-27T14:31:16.783201+0000","last_became_peered":"2023-07-27T14:31:16.783201+0000","last_unstale":"2023-07-27T14:31:16.789552+0000","last_undegraded":"2023-07-27T14:31:16.789552+0000","last_fullsized":"2023-07-27T14:31:16.789552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247202+0000","last_change":"2023-07-27T14:31:17.247202+0000","last_active":"2023-07-27T14:31:17.247202+0000","last_peered":"2023-07-27T14:31:17.247202+0000","last_clean":"2023-07-27T14:31:17.247202+0000","last_became_active":"2023-07-27T14:31:17.246915+0000","last_became_peered":"2023-07-27T14:31:17.246915+0000","last_unstale":"2023-07-27T14:31:17.247202+0000","last_undegraded":"2023-07-27T14:31:17.247202+0000","last_fullsized":"2023-07-27T14:31:17.247202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.790893+0000","last_change":"2023-07-27T14:31:16.778131+0000","last_active":"2023-07-27T14:31:16.790893+0000","last_peered":"2023-07-27T14:31:16.790893+0000","last_clean":"2023-07-27T14:31:16.790893+0000","last_became_active":"2023-07-27T14:31:16.777539+0000","last_became_peered":"2023-07-27T14:31:16.777539+0000","last_unstale":"2023-07-27T14:31:16.790893+0000","last_undegraded":"2023-07-27T14:31:16.790893+0000","last_fullsized":"2023-07-27T14:31:16.790893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.250176+0000","last_change":"2023-07-27T14:31:17.250176+0000","last_active":"2023-07-27T14:31:17.250176+0000","last_peered":"2023-07-27T14:31:17.250176+0000","last_clean":"2023-07-27T14:31:17.250176+0000","last_became_active":"2023-07-27T14:31:17.249851+0000","last_became_peered":"2023-07-27T14:31:17.249851+0000","last_unstale":"2023-07-27T14:31:17.250176+0000","last_undegraded":"2023-07-27T14:31:17.250176+0000","last_fullsized":"2023-07-27T14:31:17.250176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.786736+0000","last_change":"2023-07-27T14:31:16.778172+0000","last_active":"2023-07-27T14:31:16.786736+0000","last_peered":"2023-07-27T14:31:16.786736+0000","last_clean":"2023-07-27T14:31:16.786736+0000","last_became_active":"2023-07-27T14:31:16.777903+0000","last_became_peered":"2023-07-27T14:31:16.777903+0000","last_unstale":"2023-07-27T14:31:16.786736+0000","last_undegraded":"2023-07-27T14:31:16.786736+0000","last_fullsized":"2023-07-27T14:31:16.786736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.244928+0000","last_change":"2023-07-27T14:31:17.244928+0000","last_active":"2023-07-27T14:31:17.244928+0000","last_peered":"2023-07-27T14:31:17.244928+0000","last_clean":"2023-07-27T14:31:17.244928+0000","last_became_active":"2023-07-27T14:31:17.244639+0000","last_became_peered":"2023-07-27T14:31:17.244639+0000","last_unstale":"2023-07-27T14:31:17.244928+0000","last_undegraded":"2023-07-27T14:31:17.244928+0000","last_fullsized":"2023-07-27T14:31:17.244928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.775612+0000","last_change":"2023-07-27T14:31:16.770354+0000","last_active":"2023-07-27T14:31:16.775612+0000","last_peered":"2023-07-27T14:31:16.775612+0000","last_clean":"2023-07-27T14:31:16.775612+0000","last_became_active":"2023-07-27T14:31:16.770042+0000","last_became_peered":"2023-07-27T14:31:16.770042+0000","last_unstale":"2023-07-27T14:31:16.775612+0000","last_undegraded":"2023-07-27T14:31:16.775612+0000","last_fullsized":"2023-07-27T14:31:16.775612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.239782+0000","last_change":"2023-07-27T14:31:17.239782+0000","last_active":"2023-07-27T14:31:17.239782+0000","last_peered":"2023-07-27T14:31:17.239782+0000","last_clean":"2023-07-27T14:31:17.239782+0000","last_became_active":"2023-07-27T14:31:17.239529+0000","last_became_peered":"2023-07-27T14:31:17.239529+0000","last_unstale":"2023-07-27T14:31:17.239782+0000","last_undegraded":"2023-07-27T14:31:17.239782+0000","last_fullsized":"2023-07-27T14:31:17.239782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.793479+0000","last_change":"2023-07-27T14:31:16.786632+0000","last_active":"2023-07-27T14:31:16.793479+0000","last_peered":"2023-07-27T14:31:16.793479+0000","last_clean":"2023-07-27T14:31:16.793479+0000","last_became_active":"2023-07-27T14:31:16.786379+0000","last_became_peered":"2023-07-27T14:31:16.786379+0000","last_unstale":"2023-07-27T14:31:16.793479+0000","last_undegraded":"2023-07-27T14:31:16.793479+0000","last_fullsized":"2023-07-27T14:31:16.793479+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.764853+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:31:16.764853+0000","last_peered":"2023-07-27T14:31:16.764853+0000","last_clean":"2023-07-27T14:31:16.764853+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:31:16.764853+0000","last_undegraded":"2023-07-27T14:31:16.764853+0000","last_fullsized":"2023-07-27T14:31:16.764853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.237011+0000","last_change":"2023-07-27T14:31:17.237011+0000","last_active":"2023-07-27T14:31:17.237011+0000","last_peered":"2023-07-27T14:31:17.237011+0000","last_clean":"2023-07-27T14:31:17.237011+0000","last_became_active":"2023-07-27T14:31:17.236638+0000","last_became_peered":"2023-07-27T14:31:17.236638+0000","last_unstale":"2023-07-27T14:31:17.237011+0000","last_undegraded":"2023-07-27T14:31:17.237011+0000","last_fullsized":"2023-07-27T14:31:17.237011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.240853+0000","last_change":"2023-07-27T14:31:16.776166+0000","last_active":"2023-07-27T14:31:17.240853+0000","last_peered":"2023-07-27T14:31:17.240853+0000","last_clean":"2023-07-27T14:31:17.240853+0000","last_became_active":"2023-07-27T14:31:16.775666+0000","last_became_peered":"2023-07-27T14:31:16.775666+0000","last_unstale":"2023-07-27T14:31:17.240853+0000","last_undegraded":"2023-07-27T14:31:17.240853+0000","last_fullsized":"2023-07-27T14:31:17.240853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.761484+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:31:16.761484+0000","last_peered":"2023-07-27T14:31:16.761484+0000","last_clean":"2023-07-27T14:31:16.761484+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:31:16.761484+0000","last_undegraded":"2023-07-27T14:31:16.761484+0000","last_fullsized":"2023-07-27T14:31:16.761484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.236882+0000","last_change":"2023-07-27T14:31:17.236882+0000","last_active":"2023-07-27T14:31:17.236882+0000","last_peered":"2023-07-27T14:31:17.236882+0000","last_clean":"2023-07-27T14:31:17.236882+0000","last_became_active":"2023-07-27T14:31:17.236472+0000","last_became_peered":"2023-07-27T14:31:17.236472+0000","last_unstale":"2023-07-27T14:31:17.236882+0000","last_undegraded":"2023-07-27T14:31:17.236882+0000","last_fullsized":"2023-07-27T14:31:17.236882+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.220316+0000","last_change":"2023-07-27T14:31:16.772242+0000","last_active":"2023-07-27T14:31:17.220316+0000","last_peered":"2023-07-27T14:31:17.220316+0000","last_clean":"2023-07-27T14:31:17.220316+0000","last_became_active":"2023-07-27T14:31:16.771942+0000","last_became_peered":"2023-07-27T14:31:16.771942+0000","last_unstale":"2023-07-27T14:31:17.220316+0000","last_undegraded":"2023-07-27T14:31:17.220316+0000","last_fullsized":"2023-07-27T14:31:17.220316+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.772475+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:31:16.772475+0000","last_peered":"2023-07-27T14:31:16.772475+0000","last_clean":"2023-07-27T14:31:16.772475+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:31:16.772475+0000","last_undegraded":"2023-07-27T14:31:16.772475+0000","last_fullsized":"2023-07-27T14:31:16.772475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243877+0000","last_change":"2023-07-27T14:31:17.238576+0000","last_active":"2023-07-27T14:31:17.243877+0000","last_peered":"2023-07-27T14:31:17.243877+0000","last_clean":"2023-07-27T14:31:17.243877+0000","last_became_active":"2023-07-27T14:31:17.238251+0000","last_became_peered":"2023-07-27T14:31:17.238251+0000","last_unstale":"2023-07-27T14:31:17.243877+0000","last_undegraded":"2023-07-27T14:31:17.243877+0000","last_fullsized":"2023-07-27T14:31:17.243877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.219978+0000","last_change":"2023-07-27T14:31:16.787960+0000","last_active":"2023-07-27T14:31:17.219978+0000","last_peered":"2023-07-27T14:31:17.219978+0000","last_clean":"2023-07-27T14:31:17.219978+0000","last_became_active":"2023-07-27T14:31:16.787650+0000","last_became_peered":"2023-07-27T14:31:16.787650+0000","last_unstale":"2023-07-27T14:31:17.219978+0000","last_undegraded":"2023-07-27T14:31:17.219978+0000","last_fullsized":"2023-07-27T14:31:17.219978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.761889+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:31:16.761889+0000","last_peered":"2023-07-27T14:31:16.761889+0000","last_clean":"2023-07-27T14:31:16.761889+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:31:16.761889+0000","last_undegraded":"2023-07-27T14:31:16.761889+0000","last_fullsized":"2023-07-27T14:31:16.761889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221370+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:31:17.221370+0000","last_peered":"2023-07-27T14:31:17.221370+0000","last_clean":"2023-07-27T14:31:17.221370+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:31:17.221370+0000","last_undegraded":"2023-07-27T14:31:17.221370+0000","last_fullsized":"2023-07-27T14:31:17.221370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.246846+0000","last_change":"2023-07-27T14:31:17.246846+0000","last_active":"2023-07-27T14:31:17.246846+0000","last_peered":"2023-07-27T14:31:17.246846+0000","last_clean":"2023-07-27T14:31:17.246846+0000","last_became_active":"2023-07-27T14:31:17.246595+0000","last_became_peered":"2023-07-27T14:31:17.246595+0000","last_unstale":"2023-07-27T14:31:17.246846+0000","last_undegraded":"2023-07-27T14:31:17.246846+0000","last_fullsized":"2023-07-27T14:31:17.246846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221496+0000","last_change":"2023-07-27T14:31:16.772294+0000","last_active":"2023-07-27T14:31:17.221496+0000","last_peered":"2023-07-27T14:31:17.221496+0000","last_clean":"2023-07-27T14:31:17.221496+0000","last_became_active":"2023-07-27T14:31:16.771987+0000","last_became_peered":"2023-07-27T14:31:16.771987+0000","last_unstale":"2023-07-27T14:31:17.221496+0000","last_undegraded":"2023-07-27T14:31:17.221496+0000","last_fullsized":"2023-07-27T14:31:17.221496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221429+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:31:17.221429+0000","last_peered":"2023-07-27T14:31:17.221429+0000","last_clean":"2023-07-27T14:31:17.221429+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:31:17.221429+0000","last_undegraded":"2023-07-27T14:31:17.221429+0000","last_fullsized":"2023-07-27T14:31:17.221429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.245154+0000","last_change":"2023-07-27T14:31:17.235779+0000","last_active":"2023-07-27T14:31:17.245154+0000","last_peered":"2023-07-27T14:31:17.245154+0000","last_clean":"2023-07-27T14:31:17.245154+0000","last_became_active":"2023-07-27T14:31:17.235501+0000","last_became_peered":"2023-07-27T14:31:17.235501+0000","last_unstale":"2023-07-27T14:31:17.245154+0000","last_undegraded":"2023-07-27T14:31:17.245154+0000","last_fullsized":"2023-07-27T14:31:17.245154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.787373+0000","last_change":"2023-07-27T14:31:16.783729+0000","last_active":"2023-07-27T14:31:16.787373+0000","last_peered":"2023-07-27T14:31:16.787373+0000","last_clean":"2023-07-27T14:31:16.787373+0000","last_became_active":"2023-07-27T14:31:16.783464+0000","last_became_peered":"2023-07-27T14:31:16.783464+0000","last_unstale":"2023-07-27T14:31:16.787373+0000","last_undegraded":"2023-07-27T14:31:16.787373+0000","last_fullsized":"2023-07-27T14:31:16.787373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.221813+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:31:17.221813+0000","last_peered":"2023-07-27T14:31:17.221813+0000","last_clean":"2023-07-27T14:31:17.221813+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:31:17.221813+0000","last_undegraded":"2023-07-27T14:31:17.221813+0000","last_fullsized":"2023-07-27T14:31:17.221813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247047+0000","last_change":"2023-07-27T14:31:17.238218+0000","last_active":"2023-07-27T14:31:17.247047+0000","last_peered":"2023-07-27T14:31:17.247047+0000","last_clean":"2023-07-27T14:31:17.247047+0000","last_became_active":"2023-07-27T14:31:17.237926+0000","last_became_peered":"2023-07-27T14:31:17.237926+0000","last_unstale":"2023-07-27T14:31:17.247047+0000","last_undegraded":"2023-07-27T14:31:17.247047+0000","last_fullsized":"2023-07-27T14:31:17.247047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"83'1","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.243988+0000","last_change":"2023-07-27T14:31:16.786418+0000","last_active":"2023-07-27T14:31:17.243988+0000","last_peered":"2023-07-27T14:31:17.243988+0000","last_clean":"2023-07-27T14:31:17.243988+0000","last_became_active":"2023-07-27T14:31:16.786127+0000","last_became_peered":"2023-07-27T14:31:16.786127+0000","last_unstale":"2023-07-27T14:31:17.243988+0000","last_undegraded":"2023-07-27T14:31:17.243988+0000","last_fullsized":"2023-07-27T14:31:17.243988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.765216+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:31:16.765216+0000","last_peered":"2023-07-27T14:31:16.765216+0000","last_clean":"2023-07-27T14:31:16.765216+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:31:16.765216+0000","last_undegraded":"2023-07-27T14:31:16.765216+0000","last_fullsized":"2023-07-27T14:31:16.765216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247141+0000","last_change":"2023-07-27T14:31:17.247141+0000","last_active":"2023-07-27T14:31:17.247141+0000","last_peered":"2023-07-27T14:31:17.247141+0000","last_clean":"2023-07-27T14:31:17.247141+0000","last_became_active":"2023-07-27T14:31:17.246415+0000","last_became_peered":"2023-07-27T14:31:17.246415+0000","last_unstale":"2023-07-27T14:31:17.247141+0000","last_undegraded":"2023-07-27T14:31:17.247141+0000","last_fullsized":"2023-07-27T14:31:17.247141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:16.751957+0000","last_clean_scrub_stamp":"2023-07-27T14:31:16.751957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"83'2","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-27T14:31:17.247261+0000","last_change":"2023-07-27T14:31:16.778997+0000","last_active":"2023-07-27T14:31:17.247261+0000","last_peered":"2023-07-27T14:31:17.247261+0000","last_clean":"2023-07-27T14:31:17.247261+0000","last_became_active":"2023-07-27T14:31:16.778106+0000","last_became_peered":"2023-07-27T14:31:16.778106+0000","last_unstale":"2023-07-27T14:31:17.247261+0000","last_undegraded":"2023-07-27T14:31:17.247261+0000","last_fullsized":"2023-07-27T14:31:17.247261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:31:15.746430+0000","last_clean_scrub_stamp":"2023-07-27T14:31:15.746430+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-27T14:31:16.760623+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:31:16.760623+0000","last_peered":"2023-07-27T14:31:16.760623+0000","last_clean":"2023-07-27T14:31:16.760623+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:31:16.760623+0000","last_undegraded":"2023-07-27T14:31:16.760623+0000","last_fullsized":"2023-07-27T14:31:16.760623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13240,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94358600,"statfs":{"total":96636764160,"available":96623206400,"internally_reserved":0,"allocated":1032192,"data_stored":472495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64200000000000002,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":1.133,"15min":1.133},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.87,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.749}]},{"osd":1,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.874,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79800000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.442,"5min":0.438,"15min":0.438},"max":{"1min":0.81899999999999995,"5min":1.119,"15min":1.119},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67400000000000004,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83299999999999996,"5min":1.069,"15min":1.069},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.53800000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":1.165,"15min":1.165},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61799999999999999,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.318},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.76200000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77400000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.48699999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.77900000000000003,"5min":1.038,"15min":1.038},"last":0.495}]},{"osd":6,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.54900000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.80500000000000005,"5min":1.034,"15min":1.034},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.51800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79000000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8304,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":7296,"kb_avail":94363536,"statfs":{"total":96636764160,"available":96628260864,"internally_reserved":0,"allocated":1024000,"data_stored":465929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7471104},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61899999999999999,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.49199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86399999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.755},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.78400000000000003,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93200000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66300000000000003,"15min":0.65500000000000003},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88700000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95199999999999996,"5min":1.2,"15min":1.2},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.65900000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86599999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.621},"min":{"1min":0.48499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86299999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68300000000000005,"15min":0.67600000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92000000000000004,"5min":1.079,"15min":1.079},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88100000000000001,"5min":1.198,"15min":1.198},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90900000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.60499999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0309999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.94199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":7360,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":1028096,"data_stored":466289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7536640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.46500000000000002,"15min":0.53800000000000003},"min":{"1min":0.29299999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52900000000000003,"5min":4.75,"15min":4.75},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.56599999999999995,"15min":0.71099999999999997},"min":{"1min":0.32200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69999999999999996,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.52100000000000002,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63700000000000001,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.63900000000000001,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.65300000000000002,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52600000000000002,"15min":0.58799999999999997},"min":{"1min":0.376,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.72499999999999998},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86299999999999999,"5min":2.181,"15min":2.181},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.58999999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.84899999999999998,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.79000000000000004},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72799999999999998,"15min":0.754},"min":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89900000000000002,"5min":2.149,"15min":2.149},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84999999999999998,"5min":2.052,"15min":2.052},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.88100000000000001},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":0.82699999999999996,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:31:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.59999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90700000000000003,"5min":2.016,"15min":2.016},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":0.86899999999999999},"min":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.92500000000000004,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.89500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":7424,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":1011712,"data_stored":465215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7602176},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38900000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.49199999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.435},{"interface":"front","average":{"1min":0.44,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.30599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.626,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41699999999999998,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.504,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57699999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51200000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.63}]},{"osd":7,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.748,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.621},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.755},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13232,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94358608,"statfs":{"total":96636764160,"available":96623214592,"internally_reserved":0,"allocated":1024000,"data_stored":466751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.40600000000000003,"15min":0.42299999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.46200000000000002,"15min":0.48499999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55700000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.46600000000000003,"15min":0.49099999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.378},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.60799999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47399999999999998,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81100000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81699999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91900000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80400000000000005,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93799999999999994,"5min":1.014,"15min":1.014},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92100000000000004,"5min":1.26,"15min":1.26},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92300000000000004,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.77600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0049999999999999,"5min":1.091,"15min":1.091},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.036,"15min":1.036},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9008,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94362832,"statfs":{"total":96636764160,"available":96627539968,"internally_reserved":0,"allocated":1024000,"data_stored":471919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44500000000000001,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64800000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.373}]},{"osd":1,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.436,"15min":0.45400000000000001},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.53400000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.442}]},{"osd":2,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60099999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.5},"min":{"1min":0.41499999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68300000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.88700000000000001,"5min":1.149,"15min":1.149},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.47399999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89800000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.497}]},{"osd":5,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84099999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.50600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.94099999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89900000000000002,"5min":1.298,"15min":1.298},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.751,"15min":0.748},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":0.995},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78300000000000003,"15min":0.77900000000000003},"min":{"1min":0.60899999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96299999999999997,"5min":1.117,"15min":1.117},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93000000000000005,"5min":1.24,"15min":1.24},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8368,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":7360,"kb_avail":94363472,"statfs":{"total":96636764160,"available":96628195328,"internally_reserved":0,"allocated":1024000,"data_stored":465893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7536640},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44900000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.879,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":2.8410000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.503,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.876,"5min":2.419,"15min":2.419},"last":4.3479999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":4.4409999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.876,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":2.9260000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83599999999999997,"5min":0.998,"15min":0.998},"last":2.7109999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.46600000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":4.476}]},{"osd":3,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86399999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":3.1059999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68899999999999995,"15min":0.67400000000000004},"min":{"1min":0.57599999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.84299999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":4.4829999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96899999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":4.3949999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64200000000000002,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":2.9649999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89800000000000002,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":5.194},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.745},"min":{"1min":0.59099999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":5.5990000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72099999999999997,"15min":0.71299999999999997},"min":{"1min":0.57099999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96199999999999997,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":2.819},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95099999999999996,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":2.7829999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14312,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357528,"statfs":{"total":96636764160,"available":96622108672,"internally_reserved":0,"allocated":1015808,"data_stored":465249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":0.70999999999999996,"15min":0.629},"min":{"1min":0.46600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":12.127000000000001,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.497}]},{"osd":1,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.73499999999999999,"15min":0.70399999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.7489999999999997,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.73099999999999998,"15min":0.68700000000000006},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":6.7370000000000001,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66200000000000003,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":0.73699999999999999,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.6920000000000002,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.163,"5min":0.82799999999999996,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":9.4299999999999997,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.66500000000000004,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.66500000000000004,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":8.0329999999999995,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.437},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.623}]},{"osd":7,"last update":"Thu Jul 27 14:30:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.69299999999999995,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.503,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:31:21.974 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:31:21.975 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:31:22.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.163+0000 7f41dc3ff700 1 Processor -- start 2023-07-27T14:31:22.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.163+0000 7f41dc3ff700 1 -- start start 2023-07-27T14:31:22.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41dc3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f41d414ae00 0x7f41d4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41dc3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d414b1e0 0x7f41d4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41dc3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41d40c5c50 0x7f41d4063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41dc3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d4063530 con 0x7f41d40c5c50 2023-07-27T14:31:22.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41dc3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d41553f0 con 0x7f41d414ae00 2023-07-27T14:31:22.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41dc3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4157a50 con 0x7f41d414b1e0 2023-07-27T14:31:22.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da99c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41d40c5c50 0x7f41d4063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da99c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41d40c5c50 0x7f41d4063040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39598/0 (socket says 172.21.15.115:39598) 2023-07-27T14:31:22.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da99c700 1 -- 172.21.15.115:0/3667978993 learned_addr learned my addr 172.21.15.115:0/3667978993 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:22.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da19b700 1 --2- 172.21.15.115:0/3667978993 >> v2:172.21.15.159:3300/0 conn(0x7f41d414ae00 0x7f41d4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41d999a700 1 --2- 172.21.15.115:0/3667978993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d414b1e0 0x7f41d4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da99c700 1 -- 172.21.15.115:0/3667978993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d414b1e0 msgr2=0x7f41d4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:22.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da99c700 1 --2- 172.21.15.115:0/3667978993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d414b1e0 0x7f41d4062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da99c700 1 -- 172.21.15.115:0/3667978993 >> v2:172.21.15.159:3300/0 conn(0x7f41d414ae00 msgr2=0x7f41d4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:22.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da99c700 1 --2- 172.21.15.115:0/3667978993 >> v2:172.21.15.159:3300/0 conn(0x7f41d414ae00 0x7f41d4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.165+0000 7f41da99c700 1 -- 172.21.15.115:0/3667978993 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4157d10 con 0x7f41d40c5c50 2023-07-27T14:31:22.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.166+0000 7f41da99c700 1 --2- 172.21.15.115:0/3667978993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d40c5c50 0x7f41d4063040 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f41d40caaf0 tx=0x7f41cc009840).ready entity=mon.0 client_cookie=9d78e44a61c790c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:22.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.166+0000 7f41d9199700 1 -- 172.21.15.115:0/3667978993 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00e070 con 0x7f41d40c5c50 2023-07-27T14:31:22.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.166+0000 7f41d9199700 1 -- 172.21.15.115:0/3667978993 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc00b970 con 0x7f41d40c5c50 2023-07-27T14:31:22.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.166+0000 7f41d9199700 1 -- 172.21.15.115:0/3667978993 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00bcf0 con 0x7f41d40c5c50 2023-07-27T14:31:22.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.166+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3667978993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d40c5c50 msgr2=0x7f41d4063040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.166+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3667978993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d40c5c50 0x7f41d4063040 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f41d40caaf0 tx=0x7f41cc009840).stop 2023-07-27T14:31:22.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.167+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3667978993 shutdown_connections 2023-07-27T14:31:22.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.167+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3667978993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d40c5c50 0x7f41d4063040 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.167+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3667978993 >> v2:172.21.15.159:3300/0 conn(0x7f41d414ae00 0x7f41d4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.167+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3667978993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d414b1e0 0x7f41d4062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.167+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3667978993 >> 172.21.15.115:0/3667978993 conn(0x7f41d405e940 msgr2=0x7f41d40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:22.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.167+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3667978993 shutdown_connections 2023-07-27T14:31:22.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.167+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3667978993 wait complete. 2023-07-27T14:31:22.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.168+0000 7f41dc3ff700 1 Processor -- start 2023-07-27T14:31:22.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.168+0000 7f41dc3ff700 1 -- start start 2023-07-27T14:31:22.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.169+0000 7f41dc3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d40c5c50 0x7f41d414a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.169+0000 7f41dc3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d414ae00 0x7f41d40a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.169+0000 7f41dc3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d414b1e0 0x7f41d40aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.169+0000 7f41dc3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d414aca0 con 0x7f41d414b1e0 2023-07-27T14:31:22.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.169+0000 7f41dc3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40aa5a0 con 0x7f41d414ae00 2023-07-27T14:31:22.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.169+0000 7f41dc3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40c48a0 con 0x7f41d40c5c50 2023-07-27T14:31:22.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d414b1e0 0x7f41d40aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d414b1e0 0x7f41d40aa0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39610/0 (socket says 172.21.15.115:39610) 2023-07-27T14:31:22.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 -- 172.21.15.115:0/3218476664 learned_addr learned my addr 172.21.15.115:0/3218476664 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:22.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da19b700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d40c5c50 0x7f41d414a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41d999a700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d414ae00 0x7f41d40a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 -- 172.21.15.115:0/3218476664 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d40c5c50 msgr2=0x7f41d414a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d40c5c50 0x7f41d414a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 -- 172.21.15.115:0/3218476664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d414ae00 msgr2=0x7f41d40a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d414ae00 0x7f41d40a9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 -- 172.21.15.115:0/3218476664 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc009ae0 con 0x7f41d414b1e0 2023-07-27T14:31:22.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41da99c700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d414b1e0 0x7f41d40aa0b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f41cc00b610 tx=0x7f41cc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:22.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41ca7fc700 1 -- 172.21.15.115:0/3218476664 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00bee0 con 0x7f41d414b1e0 2023-07-27T14:31:22.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41ca7fc700 1 -- 172.21.15.115:0/3218476664 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc00bcf0 con 0x7f41d414b1e0 2023-07-27T14:31:22.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d41641d0 con 0x7f41d414b1e0 2023-07-27T14:31:22.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.170+0000 7f41ca7fc700 1 -- 172.21.15.115:0/3218476664 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc01d6b0 con 0x7f41d414b1e0 2023-07-27T14:31:22.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.171+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d40aeae0 con 0x7f41d414b1e0 2023-07-27T14:31:22.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.171+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d406c470 con 0x7f41d414b1e0 2023-07-27T14:31:22.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.172+0000 7f41ca7fc700 1 -- 172.21.15.115:0/3218476664 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f41cc024030 con 0x7f41d414b1e0 2023-07-27T14:31:22.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.173+0000 7f41ca7fc700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f41b805f1c0 0x7f41b8061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.173+0000 7f41ca7fc700 1 -- 172.21.15.115:0/3218476664 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f41cc07b430 con 0x7f41d414b1e0 2023-07-27T14:31:22.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.173+0000 7f41da19b700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f41b805f1c0 0x7f41b8061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.174+0000 7f41da19b700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f41b805f1c0 0x7f41b8061680 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f41d0009c30 tx=0x7f41d0009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:22.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.177+0000 7f41ca7fc700 1 -- 172.21.15.115:0/3218476664 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41cc04c650 con 0x7f41d414b1e0 2023-07-27T14:31:22.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.409+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f41d40c5810 con 0x7f41d414b1e0 2023-07-27T14:31:22.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.415+0000 7f41ca7fc700 1 -- 172.21.15.115:0/3218476664 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f41cc022070 con 0x7f41d414b1e0 2023-07-27T14:31:22.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f41b805f1c0 msgr2=0x7f41b8061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f41b805f1c0 0x7f41b8061680 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f41d0009c30 tx=0x7f41d0009060).stop 2023-07-27T14:31:22.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d414b1e0 msgr2=0x7f41d40aa0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d414b1e0 0x7f41d40aa0b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f41cc00b610 tx=0x7f41cc009840).stop 2023-07-27T14:31:22.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 shutdown_connections 2023-07-27T14:31:22.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f41b805f1c0 0x7f41b8061680 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d414b1e0 0x7f41d40aa0b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d40c5c50 0x7f41d414a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 --2- 172.21.15.115:0/3218476664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d414ae00 0x7f41d40a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.417+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 >> 172.21.15.115:0/3218476664 conn(0x7f41d405e940 msgr2=0x7f41d40c8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:22.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.418+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 shutdown_connections 2023-07-27T14:31:22.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.418+0000 7f41dc3ff700 1 -- 172.21.15.115:0/3218476664 wait complete. 2023-07-27T14:31:22.451 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:31:22.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:31:22.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.623+0000 7f76cf7ff700 1 Processor -- start 2023-07-27T14:31:22.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.623+0000 7f76cf7ff700 1 -- start start 2023-07-27T14:31:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.624+0000 7f76cf7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f76c8066b80 0x7f76c815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.624+0000 7f76cf7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c8067080 con 0x7f76c8151d70 2023-07-27T14:31:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.624+0000 7f76cf7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c8068570 con 0x7f76c8065ff0 2023-07-27T14:31:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.624+0000 7f76cf7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c8063a90 con 0x7f76c8066b80 2023-07-27T14:31:22.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76cd59b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f76c8151d70 0x7f76c8155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47086/0 (socket says 172.21.15.115:47086) 2023-07-27T14:31:22.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76cd59b700 1 -- 172.21.15.115:0/1584460820 learned_addr learned my addr 172.21.15.115:0/1584460820 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:22.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76cdd9c700 1 --2- 172.21.15.115:0/1584460820 >> v2:172.21.15.115:3300/0 conn(0x7f76c8066b80 0x7f76c815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76bffff700 1 -- 172.21.15.115:0/1584460820 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968686141 0 0) 0x7f76c8067080 con 0x7f76c8151d70 2023-07-27T14:31:22.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76bffff700 1 -- 172.21.15.115:0/1584460820 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b40033f0 con 0x7f76c8151d70 2023-07-27T14:31:22.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76cdd9c700 1 -- 172.21.15.115:0/1584460820 >> v1:172.21.15.159:6789/0 conn(0x7f76c8065ff0 legacy=0x7f76c8066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76cdd9c700 1 -- 172.21.15.115:0/1584460820 >> v1:172.21.15.115:6789/0 conn(0x7f76c8151d70 legacy=0x7f76c8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76cdd9c700 1 -- 172.21.15.115:0/1584460820 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80634d0 con 0x7f76c8066b80 2023-07-27T14:31:22.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.625+0000 7f76cdd9c700 1 --2- 172.21.15.115:0/1584460820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8066b80 0x7f76c815ef90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f76c0009e60 tx=0x7f76c0009780).ready entity=mon.0 client_cookie=33eecadbb4d5f02a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:22.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76bffff700 1 -- 172.21.15.115:0/1584460820 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c000e070 con 0x7f76c8066b80 2023-07-27T14:31:22.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76bffff700 1 -- 172.21.15.115:0/1584460820 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c000bb60 con 0x7f76c8066b80 2023-07-27T14:31:22.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76bffff700 1 -- 172.21.15.115:0/1584460820 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0012410 con 0x7f76c8066b80 2023-07-27T14:31:22.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76cf7ff700 1 -- 172.21.15.115:0/1584460820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8066b80 msgr2=0x7f76c815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76cf7ff700 1 --2- 172.21.15.115:0/1584460820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8066b80 0x7f76c815ef90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f76c0009e60 tx=0x7f76c0009780).stop 2023-07-27T14:31:22.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76cf7ff700 1 -- 172.21.15.115:0/1584460820 shutdown_connections 2023-07-27T14:31:22.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76cf7ff700 1 --2- 172.21.15.115:0/1584460820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8066b80 0x7f76c815ef90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76cf7ff700 1 -- 172.21.15.115:0/1584460820 >> 172.21.15.115:0/1584460820 conn(0x7f76c80c89a0 msgr2=0x7f76c80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:22.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76cf7ff700 1 -- 172.21.15.115:0/1584460820 shutdown_connections 2023-07-27T14:31:22.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.626+0000 7f76cf7ff700 1 -- 172.21.15.115:0/1584460820 wait complete. 2023-07-27T14:31:22.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.628+0000 7f76cf7ff700 1 Processor -- start 2023-07-27T14:31:22.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.628+0000 7f76cf7ff700 1 -- start start 2023-07-27T14:31:22.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cf7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76c8065ff0 0x7f76c814b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cf7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76c8066b80 0x7f76c814c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cf7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8151d70 0x7f76c8150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cf7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c80c1bb0 con 0x7f76c8151d70 2023-07-27T14:31:22.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cf7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c80c0fa0 con 0x7f76c8065ff0 2023-07-27T14:31:22.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cf7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c80c1280 con 0x7f76c8066b80 2023-07-27T14:31:22.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cdd9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8151d70 0x7f76c8150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cdd9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8151d70 0x7f76c8150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39628/0 (socket says 172.21.15.115:39628) 2023-07-27T14:31:22.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cdd9c700 1 -- 172.21.15.115:0/289245828 learned_addr learned my addr 172.21.15.115:0/289245828 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:22.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.629+0000 7f76cd59b700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76c8065ff0 0x7f76c814b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76ccd9a700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76c8066b80 0x7f76c814c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cdd9c700 1 -- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76c8066b80 msgr2=0x7f76c814c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cdd9c700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76c8066b80 0x7f76c814c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cdd9c700 1 -- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76c8065ff0 msgr2=0x7f76c814b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cdd9c700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76c8065ff0 0x7f76c814b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cdd9c700 1 -- 172.21.15.115:0/289245828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0009a20 con 0x7f76c8151d70 2023-07-27T14:31:22.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cd59b700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76c8065ff0 0x7f76c814b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:22.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76ccd9a700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76c8066b80 0x7f76c814c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:22.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cdd9c700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8151d70 0x7f76c8150400 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f76c0011000 tx=0x7f76c0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:22.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76bd7fa700 1 -- 172.21.15.115:0/289245828 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c001d630 con 0x7f76c8151d70 2023-07-27T14:31:22.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76bd7fa700 1 -- 172.21.15.115:0/289245828 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c001d790 con 0x7f76c8151d70 2023-07-27T14:31:22.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76bd7fa700 1 -- 172.21.15.115:0/289245828 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c001db30 con 0x7f76c8151d70 2023-07-27T14:31:22.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c80c1560 con 0x7f76c8151d70 2023-07-27T14:31:22.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.630+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c814cd90 con 0x7f76c8151d70 2023-07-27T14:31:22.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.631+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c80c1d20 con 0x7f76c8151d70 2023-07-27T14:31:22.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.632+0000 7f76bd7fa700 1 -- 172.21.15.115:0/289245828 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f76c0026410 con 0x7f76c8151d70 2023-07-27T14:31:22.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.633+0000 7f76bd7fa700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f76ac05f1f0 0x7f76ac0616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:22.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.633+0000 7f76bd7fa700 1 -- 172.21.15.115:0/289245828 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f76c007c290 con 0x7f76c8151d70 2023-07-27T14:31:22.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.633+0000 7f76cd59b700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f76ac05f1f0 0x7f76ac0616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:22.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.634+0000 7f76cd59b700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f76ac05f1f0 0x7f76ac0616b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f76c4007fd0 tx=0x7f76c4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:22.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.637+0000 7f76bd7fa700 1 -- 172.21.15.115:0/289245828 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76c004d310 con 0x7f76c8151d70 2023-07-27T14:31:22.776 INFO:tasks.ceph.mds.a.smithi115.stderr:2023-07-27T14:31:22.744+0000 7f056dbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:31:22.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.848+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76c80c1f40 con 0x7f76c8151d70 2023-07-27T14:31:22.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.849+0000 7f76bd7fa700 1 -- 172.21.15.115:0/289245828 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f76c0050930 con 0x7f76c8151d70 2023-07-27T14:31:22.881 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:31:22.881 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4214348897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":4214348897},{"type":"v1","addr":"172.21.15.115:6837","nonce":4214348897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/445956953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":445956953},{"type":"v1","addr":"172.21.15.159:6834","nonce":445956953}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4278535768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":4278535768},{"type":"v1","addr":"172.21.15.159:6835","nonce":4278535768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:31:17.215158+0000","modified":"2023-07-27T14:31:20.233120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3446022806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3446022806},{"type":"v1","addr":"172.21.15.115:6835","nonce":3446022806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-07-27T14:31:22.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f76ac05f1f0 msgr2=0x7f76ac0616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f76ac05f1f0 0x7f76ac0616b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f76c4007fd0 tx=0x7f76c4009040).stop 2023-07-27T14:31:22.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8151d70 msgr2=0x7f76c8150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:22.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8151d70 0x7f76c8150400 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f76c0011000 tx=0x7f76c0009780).stop 2023-07-27T14:31:22.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 shutdown_connections 2023-07-27T14:31:22.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f76ac05f1f0 0x7f76ac0616b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76c8151d70 0x7f76c8150400 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76c8065ff0 0x7f76c814b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 --2- 172.21.15.115:0/289245828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76c8066b80 0x7f76c814c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 >> 172.21.15.115:0/289245828 conn(0x7f76c80c89a0 msgr2=0x7f76c8152630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 shutdown_connections 2023-07-27T14:31:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:22.851+0000 7f76cf7ff700 1 -- 172.21.15.115:0/289245828 wait complete. 2023-07-27T14:31:22.885 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 42 2023-07-27T14:31:23.303 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:31:17.215158+0000', 'modified': '2023-07-27T14:31:20.233120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6405}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6405': {'gid': 6405, 'name': 'a', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6835/3446022806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3446022806}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3446022806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:31:23.303 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:31:23.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-27T14:31:23.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.461+0000 7f26a4fff700 1 Processor -- start 2023-07-27T14:31:23.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.461+0000 7f26a4fff700 1 -- start start 2023-07-27T14:31:23.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f26a4fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f26a0151d70 0x7f26a0155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f26a4fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a0067080 con 0x7f26a0066b80 2023-07-27T14:31:23.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f26a4fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a00634d0 con 0x7f26a0065ff0 2023-07-27T14:31:23.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f26a4fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a0063a90 con 0x7f26a0151d70 2023-07-27T14:31:23.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f269ed9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f26a0066b80 0x7f26a0067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47096/0 (socket says 172.21.15.115:47096) 2023-07-27T14:31:23.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f269ed9d700 1 -- 172.21.15.115:0/1678627120 learned_addr learned my addr 172.21.15.115:0/1678627120 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:23.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f269e59c700 1 --2- 172.21.15.115:0/1678627120 >> v2:172.21.15.159:3300/0 conn(0x7f26a0151d70 0x7f26a0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f269d59a700 1 -- 172.21.15.115:0/1678627120 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474762266 0 0) 0x7f26a0067080 con 0x7f26a0066b80 2023-07-27T14:31:23.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.463+0000 7f269d59a700 1 -- 172.21.15.115:0/1678627120 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26880033f0 con 0x7f26a0066b80 2023-07-27T14:31:23.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269d59a700 1 -- 172.21.15.115:0/1678627120 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522828928 0 0) 0x7f26a00634d0 con 0x7f26a0065ff0 2023-07-27T14:31:23.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269d59a700 1 -- 172.21.15.115:0/1678627120 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a0067080 con 0x7f26a0065ff0 2023-07-27T14:31:23.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269d59a700 1 -- 172.21.15.115:0/1678627120 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2047763018 0 0) 0x7f26880033f0 con 0x7f26a0066b80 2023-07-27T14:31:23.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269e59c700 1 -- 172.21.15.115:0/1678627120 >> v1:172.21.15.159:6789/0 conn(0x7f26a0065ff0 legacy=0x7f26a0066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269e59c700 1 -- 172.21.15.115:0/1678627120 >> v1:172.21.15.115:6789/0 conn(0x7f26a0066b80 legacy=0x7f26a0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269e59c700 1 -- 172.21.15.115:0/1678627120 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00637b0 con 0x7f26a0151d70 2023-07-27T14:31:23.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269e59c700 1 --2- 172.21.15.115:0/1678627120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0151d70 0x7f26a0155060 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f2690009760 tx=0x7f2690009060).ready entity=mon.1 client_cookie=92b886785628ea60 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269d59a700 1 -- 172.21.15.115:0/1678627120 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980017f0 con 0x7f26a0151d70 2023-07-27T14:31:23.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269d59a700 1 -- 172.21.15.115:0/1678627120 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690011400 con 0x7f26a0151d70 2023-07-27T14:31:23.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.464+0000 7f269d59a700 1 -- 172.21.15.115:0/1678627120 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690011780 con 0x7f26a0151d70 2023-07-27T14:31:23.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.465+0000 7f26a4fff700 1 -- 172.21.15.115:0/1678627120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0151d70 msgr2=0x7f26a0155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.465+0000 7f26a4fff700 1 --2- 172.21.15.115:0/1678627120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0151d70 0x7f26a0155060 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f2690009760 tx=0x7f2690009060).stop 2023-07-27T14:31:23.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.465+0000 7f26a4fff700 1 -- 172.21.15.115:0/1678627120 shutdown_connections 2023-07-27T14:31:23.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.465+0000 7f26a4fff700 1 --2- 172.21.15.115:0/1678627120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0151d70 0x7f26a0155060 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.465+0000 7f26a4fff700 1 -- 172.21.15.115:0/1678627120 >> 172.21.15.115:0/1678627120 conn(0x7f26a00c89a0 msgr2=0x7f26a00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:23.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.465+0000 7f26a4fff700 1 -- 172.21.15.115:0/1678627120 shutdown_connections 2023-07-27T14:31:23.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.465+0000 7f26a4fff700 1 -- 172.21.15.115:0/1678627120 wait complete. 2023-07-27T14:31:23.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.466+0000 7f26a4fff700 1 Processor -- start 2023-07-27T14:31:23.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.466+0000 7f26a4fff700 1 -- start start 2023-07-27T14:31:23.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.467+0000 7f26a4fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0065ff0 0x7f26a00a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.467+0000 7f26a4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0066b80 0x7f26a00c11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.467+0000 7f26a4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a0151d70 0x7f26a00c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.467+0000 7f26a4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00c1bc0 con 0x7f26a0066b80 2023-07-27T14:31:23.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.467+0000 7f26a4fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00a51b0 con 0x7f26a0065ff0 2023-07-27T14:31:23.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.467+0000 7f26a4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00a5490 con 0x7f26a0151d70 2023-07-27T14:31:23.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0066b80 0x7f26a00c11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0066b80 0x7f26a00c11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39638/0 (socket says 172.21.15.115:39638) 2023-07-27T14:31:23.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 -- 172.21.15.115:0/637518078 learned_addr learned my addr 172.21.15.115:0/637518078 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:23.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269e59c700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0065ff0 0x7f26a00a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269ed9d700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a0151d70 0x7f26a00c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 -- 172.21.15.115:0/637518078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a0151d70 msgr2=0x7f26a00c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a0151d70 0x7f26a00c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 -- 172.21.15.115:0/637518078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0065ff0 msgr2=0x7f26a00a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0065ff0 0x7f26a00a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 -- 172.21.15.115:0/637518078 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900092a0 con 0x7f26a0066b80 2023-07-27T14:31:23.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f269dd9b700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0066b80 0x7f26a00c11e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f269400c490 tx=0x7f2694007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f268e7fc700 1 -- 172.21.15.115:0/637518078 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400f470 con 0x7f26a0066b80 2023-07-27T14:31:23.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f268e7fc700 1 -- 172.21.15.115:0/637518078 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400f5d0 con 0x7f26a0066b80 2023-07-27T14:31:23.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.468+0000 7f268e7fc700 1 -- 172.21.15.115:0/637518078 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400f970 con 0x7f26a0066b80 2023-07-27T14:31:23.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.469+0000 7f26a4fff700 1 -- 172.21.15.115:0/637518078 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a00a5770 con 0x7f26a0066b80 2023-07-27T14:31:23.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.469+0000 7f26a4fff700 1 -- 172.21.15.115:0/637518078 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a00a6730 con 0x7f26a0066b80 2023-07-27T14:31:23.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.470+0000 7f268e7fc700 1 -- 172.21.15.115:0/637518078 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f2694019030 con 0x7f26a0066b80 2023-07-27T14:31:23.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.471+0000 7f268e7fc700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005f1c0 0x7f2680061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.471+0000 7f268e7fc700 1 -- 172.21.15.115:0/637518078 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2694079800 con 0x7f26a0066b80 2023-07-27T14:31:23.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.471+0000 7f269e59c700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005f1c0 0x7f2680061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.472+0000 7f269e59c700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005f1c0 0x7f2680061680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2690009270 tx=0x7f2690016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.473+0000 7f26bc3ddb80 1 Processor -- start 2023-07-27T14:31:23.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.474+0000 7f26bc3ddb80 1 -- start start 2023-07-27T14:31:23.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.474+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86805c0 0x5618c86809a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.474+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a8830 0x5618c86cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.474+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.474+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c85bd9c0 con 0x5618c86a8830 2023-07-27T14:31:23.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.474+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c85d2cc0 con 0x5618c8682f60 2023-07-27T14:31:23.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.474+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618c8599e10 con 0x5618c86805c0 2023-07-27T14:31:23.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a8830 0x5618c86cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a8830 0x5618c86cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39654/0 (socket says 172.21.15.115:39654) 2023-07-27T14:31:23.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 -- 172.21.15.115:0/3233832819 learned_addr learned my addr 172.21.15.115:0/3233832819 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:23.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 -- 172.21.15.115:0/3233832819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86805c0 msgr2=0x5618c86809a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:23.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86805c0 0x5618c86809a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:23.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269ed9d700 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 -- 172.21.15.115:0/3233832819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 msgr2=0x5618c86cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:23.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 -- 172.21.15.115:0/3233832819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618c85cb9a0 con 0x5618c86a8830 2023-07-27T14:31:23.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269ed9d700 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:23.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f269dd9b700 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a8830 0x5618c86cecc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f269404e4c0 tx=0x7f269400f000).ready entity=mon.0 client_cookie=ba1810db9b983fac server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f267f7fe700 1 -- 172.21.15.115:0/3233832819 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694077540 con 0x5618c86a8830 2023-07-27T14:31:23.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f267f7fe700 1 -- 172.21.15.115:0/3233832819 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26940776a0 con 0x5618c86a8830 2023-07-27T14:31:23.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.475+0000 7f267f7fe700 1 -- 172.21.15.115:0/3233832819 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269404da10 con 0x5618c86a8830 2023-07-27T14:31:23.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/3233832819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a8830 msgr2=0x5618c86cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a8830 0x5618c86cecc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f269404e4c0 tx=0x7f269400f000).stop 2023-07-27T14:31:23.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/3233832819 shutdown_connections 2023-07-27T14:31:23.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86805c0 0x5618c86809a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:23.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/3233832819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a8830 0x5618c86cecc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/3233832819 >> 172.21.15.115:0/3233832819 conn(0x5618c84eb940 msgr2=0x5618c86c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:23.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/3233832819 shutdown_connections 2023-07-27T14:31:23.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.476+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/3233832819 wait complete. 2023-07-27T14:31:23.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.477+0000 7f26bc3ddb80 1 -- start start 2023-07-27T14:31:23.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.477+0000 7f26bc3ddb80 1 Processor -- start 2023-07-27T14:31:23.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86805c0 0x5618c86acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86a5610 0x5618c86aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c86c4b90 con 0x5618c86805c0 2023-07-27T14:31:23.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c86ad310 con 0x5618c8682f60 2023-07-27T14:31:23.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618c86a2f90 con 0x5618c86a5610 2023-07-27T14:31:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f26bc3ddb80 10 client.0 ll_register_callbacks cb 0x5618c85854a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:31:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f269e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86805c0 0x5618c86acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f269e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86805c0 0x5618c86acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39666/0 (socket says 172.21.15.115:39666) 2023-07-27T14:31:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.478+0000 7f269e59c700 1 -- 172.21.15.115:0/124776764 learned_addr learned my addr 172.21.15.115:0/124776764 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f269ed9d700 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86a5610 0x5618c86aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f269dd9b700 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f269e59c700 1 -- 172.21.15.115:0/124776764 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86a5610 msgr2=0x5618c86aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:23.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f269e59c700 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86a5610 0x5618c86aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f269e59c700 1 -- 172.21.15.115:0/124776764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 msgr2=0x5618c86ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f269e59c700 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f269e59c700 1 -- 172.21.15.115:0/124776764 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a00a6730 con 0x5618c86805c0 2023-07-27T14:31:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f269e59c700 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86805c0 0x5618c86acc60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f26a0060790 tx=0x7f2690020070).ready entity=mon.0 client_cookie=fa5ab14446f11e3d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f267cff9700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:31:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f267cff9700 1 -- 172.21.15.115:0/124776764 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690028430 con 0x5618c86805c0 2023-07-27T14:31:23.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/124776764 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618c867ad50 con 0x5618c86805c0 2023-07-27T14:31:23.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.479+0000 7f267cff9700 1 -- 172.21.15.115:0/124776764 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2690028590 con 0x5618c86805c0 2023-07-27T14:31:23.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f267cff9700 1 -- 172.21.15.115:0/124776764 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2690028960 con 0x5618c86805c0 2023-07-27T14:31:23.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f26bc3ddb80 10 client.6561 fetch_fsmap learned FSMap version 42 2023-07-27T14:31:23.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/124776764 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x5618c85c7190 con 0x5618c86805c0 2023-07-27T14:31:23.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f267cff9700 1 -- 172.21.15.115:0/124776764 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5618c867ad50 con 0x5618c86805c0 2023-07-27T14:31:23.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f267cff9700 1 -- 172.21.15.115:0/124776764 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2690028ac0 con 0x5618c86805c0 2023-07-27T14:31:23.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f26bc3ddb80 10 client.6561 fetch_fsmap finished waiting for FSMap version 42 2023-07-27T14:31:23.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f26bc3ddb80 10 client.6561 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:31:23.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f26bc3ddb80 20 client.6561 populate_metadata read hostname 'smithi115' 2023-07-27T14:31:23.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] conn(0x5618c86c3890 0x5618c86c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f26bc3ddb80 4 client.6561 mds_command: new command op to 6405 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:31:23.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/124776764 --> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618c843bef0 con 0x5618c86c3890 2023-07-27T14:31:23.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.480+0000 7f269dd9b700 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] conn(0x5618c86c3890 0x5618c86c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.481+0000 7f269dd9b700 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] conn(0x5618c86c3890 0x5618c86c4520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6f2b29e2b8eabd3f server_cookie=10a47d71fbbdebad in_seq=0 out_seq=0 2023-07-27T14:31:23.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.481+0000 7f267cff9700 10 client.6561 ms_handle_connect on v2:172.21.15.115:6834/3446022806 2023-07-27T14:31:23.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.481+0000 7f267cff9700 1 -- 172.21.15.115:0/124776764 <== mds.0 v2:172.21.15.115:6834/3446022806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x5618c843bef0 con 0x5618c86c3890 2023-07-27T14:31:23.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.481+0000 7f267cff9700 10 client.6561 handle_command_reply: tid=0 2023-07-27T14:31:23.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.481+0000 7f26bc3ddb80 1 client.6561 shutdown 2023-07-27T14:31:23.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/124776764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86805c0 msgr2=0x5618c86acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86805c0 0x5618c86acc60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f26a0060790 tx=0x7f2690020070).stop 2023-07-27T14:31:23.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/124776764 shutdown_connections 2023-07-27T14:31:23.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] conn(0x5618c86c3890 0x5618c86c4520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86a5610 0x5618c86aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86805c0 0x5618c86acc60 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f267cff9700 0 client.6561 ms_handle_reset on v2:172.21.15.115:6834/3446022806 2023-07-27T14:31:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/124776764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c8682f60 0x5618c86ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/124776764 >> 172.21.15.115:0/124776764 conn(0x5618c84eb940 msgr2=0x5618c86c6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/124776764 shutdown_connections 2023-07-27T14:31:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/124776764 wait complete. 2023-07-27T14:31:23.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.482+0000 7f26bc3ddb80 20 client.6561 trim_cache size 0 max 16384 2023-07-27T14:31:23.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.499+0000 7f26bc3ddb80 1 Processor -- start 2023-07-27T14:31:23.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.499+0000 7f26bc3ddb80 1 -- start start 2023-07-27T14:31:23.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86805c0 0x5618c86ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c8682f60 0x5618c86aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86a5610 0x5618c86c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c86ad0c0 con 0x5618c8682f60 2023-07-27T14:31:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c86aefc0 con 0x5618c86a5610 2023-07-27T14:31:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618c86c3de0 con 0x5618c86805c0 2023-07-27T14:31:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c8682f60 0x5618c86aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c8682f60 0x5618c86aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39668/0 (socket says 172.21.15.115:39668) 2023-07-27T14:31:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f269dd9b700 1 -- 172.21.15.115:0/2452006362 learned_addr learned my addr 172.21.15.115:0/2452006362 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:23.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f269dd9b700 1 -- 172.21.15.115:0/2452006362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86805c0 msgr2=0x5618c86ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f269dd9b700 1 --2- 172.21.15.115:0/2452006362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86805c0 0x5618c86ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f269dd9b700 1 -- 172.21.15.115:0/2452006362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86a5610 msgr2=0x5618c86c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f269dd9b700 1 --2- 172.21.15.115:0/2452006362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86a5610 0x5618c86c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.500+0000 7f269dd9b700 1 -- 172.21.15.115:0/2452006362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618c85c6ee0 con 0x5618c8682f60 2023-07-27T14:31:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f269dd9b700 1 --2- 172.21.15.115:0/2452006362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c8682f60 0x5618c86aead0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f269404dfd0 tx=0x7f269401e000).ready entity=mon.0 client_cookie=bb1b2215f84be979 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f267ffff700 1 -- 172.21.15.115:0/2452006362 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269404a860 con 0x5618c8682f60 2023-07-27T14:31:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f267ffff700 1 -- 172.21.15.115:0/2452006362 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400fb10 con 0x5618c8682f60 2023-07-27T14:31:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f267ffff700 1 -- 172.21.15.115:0/2452006362 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269404da10 con 0x5618c8682f60 2023-07-27T14:31:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/2452006362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c8682f60 msgr2=0x5618c86aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/2452006362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c8682f60 0x5618c86aead0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f269404dfd0 tx=0x7f269401e000).stop 2023-07-27T14:31:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/2452006362 shutdown_connections 2023-07-27T14:31:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/2452006362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86a5610 0x5618c86c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/2452006362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c86805c0 0x5618c86ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:23.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/2452006362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c8682f60 0x5618c86aead0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.501+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/2452006362 >> 172.21.15.115:0/2452006362 conn(0x5618c84eb940 msgr2=0x5618c8676c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.502+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/2452006362 shutdown_connections 2023-07-27T14:31:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.502+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/2452006362 wait complete. 2023-07-27T14:31:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.502+0000 7f26bc3ddb80 1 -- start start 2023-07-27T14:31:23.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.503+0000 7f26bc3ddb80 1 Processor -- start 2023-07-27T14:31:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.504+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86805c0 0x5618c8721a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.504+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c8682f60 0x5618c86a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.504+0000 7f26bc3ddb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a5610 0x5618c86c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.504+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c872edf0 con 0x5618c86a5610 2023-07-27T14:31:23.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.504+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c86a5260 con 0x5618c86805c0 2023-07-27T14:31:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.504+0000 7f26bc3ddb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618c86c1ea0 con 0x5618c8682f60 2023-07-27T14:31:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.504+0000 7f26bc3ddb80 10 client.0 ll_register_callbacks cb 0x5618c85854a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:31:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86805c0 0x5618c8721a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a5610 0x5618c86c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269dd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c8682f60 0x5618c86a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86805c0 0x5618c8721a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:47224/0 (socket says 172.21.15.115:47224) 2023-07-27T14:31:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269e59c700 1 -- 172.21.15.115:0/1871795581 learned_addr learned my addr 172.21.15.115:0/1871795581 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:23.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269ed9d700 1 -- 172.21.15.115:0/1871795581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c8682f60 msgr2=0x5618c86a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269ed9d700 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c8682f60 0x5618c86a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269ed9d700 1 -- 172.21.15.115:0/1871795581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86805c0 msgr2=0x5618c8721a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269ed9d700 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86805c0 0x5618c8721a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269ed9d700 1 -- 172.21.15.115:0/1871795581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2694057040 con 0x5618c86a5610 2023-07-27T14:31:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269e59c700 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86805c0 0x5618c8721a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f269ed9d700 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a5610 0x5618c86c2330 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x5618c86c53b0 tx=0x7f2698001e50).ready entity=mon.0 client_cookie=a58c88f9c4b9fb9f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f267cff9700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:31:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f267cff9700 1 -- 172.21.15.115:0/1871795581 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698015410 con 0x5618c86a5610 2023-07-27T14:31:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/1871795581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26940776a0 con 0x5618c86a5610 2023-07-27T14:31:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.505+0000 7f267cff9700 1 -- 172.21.15.115:0/1871795581 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2698015570 con 0x5618c86a5610 2023-07-27T14:31:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f267cff9700 1 -- 172.21.15.115:0/1871795581 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2698015940 con 0x5618c86a5610 2023-07-27T14:31:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f26bc3ddb80 10 client.6567 fetch_fsmap learned FSMap version 42 2023-07-27T14:31:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/1871795581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x5618c84411d0 con 0x5618c86a5610 2023-07-27T14:31:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f267cff9700 1 -- 172.21.15.115:0/1871795581 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26940776a0 con 0x5618c86a5610 2023-07-27T14:31:23.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f267cff9700 1 -- 172.21.15.115:0/1871795581 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2698015aa0 con 0x5618c86a5610 2023-07-27T14:31:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f26bc3ddb80 10 client.6567 fetch_fsmap finished waiting for FSMap version 42 2023-07-27T14:31:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f26bc3ddb80 10 client.6567 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:31:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f26bc3ddb80 20 client.6567 populate_metadata read hostname 'smithi115' 2023-07-27T14:31:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] conn(0x5618c86ae230 0x5618c86ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f26bc3ddb80 4 client.6567 mds_command: new command op to 6405 tid=0[{"prefix": "status"}] 2023-07-27T14:31:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/1871795581 --> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5618c8471040 con 0x5618c86ae230 2023-07-27T14:31:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.506+0000 7f269e59c700 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] conn(0x5618c86ae230 0x5618c86ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f267cff9700 10 client.6567 ms_handle_connect on v2:172.21.15.115:6834/3446022806 2023-07-27T14:31:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f269e59c700 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] conn(0x5618c86ae230 0x5618c86ae610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4860c4bff0a87057 server_cookie=befce7181f5f27ae in_seq=0 out_seq=0 2023-07-27T14:31:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f267cff9700 1 -- 172.21.15.115:0/1871795581 <== mds.0 v2:172.21.15.115:6834/3446022806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5618c8471040 con 0x5618c86ae230 2023-07-27T14:31:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f267cff9700 10 client.6567 handle_command_reply: tid=0 2023-07-27T14:31:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 client.6567 shutdown 2023-07-27T14:31:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/1871795581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a5610 msgr2=0x5618c86c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a5610 0x5618c86c2330 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x5618c86c53b0 tx=0x7f2698001e50).stop 2023-07-27T14:31:23.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/1871795581 shutdown_connections 2023-07-27T14:31:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.115:6834/3446022806,v1:172.21.15.115:6835/3446022806] conn(0x5618c86ae230 0x5618c86ae610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5618c86a5610 0x5618c86c2330 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5618c86805c0 0x5618c8721a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 --2- 172.21.15.115:0/1871795581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5618c8682f60 0x5618c86a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f267cff9700 0 client.6567 ms_handle_reset on v2:172.21.15.115:6834/3446022806 2023-07-27T14:31:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/1871795581 >> 172.21.15.115:0/1871795581 conn(0x5618c84eb940 msgr2=0x5618c86acbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:23.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/1871795581 shutdown_connections 2023-07-27T14:31:23.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.507+0000 7f26bc3ddb80 1 -- 172.21.15.115:0/1871795581 wait complete. 2023-07-27T14:31:23.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26bc3ddb80 20 client.6567 trim_cache size 0 max 16384 2023-07-27T14:31:23.549 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:31:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:31:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 6405, 2023-07-27T14:31:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:31:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:31:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:31:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2905223000000001, 2023-07-27T14:31:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 42, 2023-07-27T14:31:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 84, 2023-07-27T14:31:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 84, 2023-07-27T14:31:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.482500569999999 2023-07-27T14:31:23.551 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 -- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005f1c0 msgr2=0x7f2680061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005f1c0 0x7f2680061680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2690009270 tx=0x7f2690016000).stop 2023-07-27T14:31:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 -- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0066b80 msgr2=0x7f26a00c11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0066b80 0x7f26a00c11e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f269400c490 tx=0x7f2694007c90).stop 2023-07-27T14:31:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 -- 172.21.15.115:0/637518078 shutdown_connections 2023-07-27T14:31:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268005f1c0 0x7f2680061680 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a0151d70 0x7f26a00c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0065ff0 0x7f26a00a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 --2- 172.21.15.115:0/637518078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0066b80 0x7f26a00c11e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 -- 172.21.15.115:0/637518078 >> 172.21.15.115:0/637518078 conn(0x7f26a00c89a0 msgr2=0x7f26a00bf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:23.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 -- 172.21.15.115:0/637518078 shutdown_connections 2023-07-27T14:31:23.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.508+0000 7f26a4fff700 1 -- 172.21.15.115:0/637518078 wait complete. 2023-07-27T14:31:23.557 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:31:23.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.686+0000 7fcab33ff700 1 Processor -- start 2023-07-27T14:31:23.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.687+0000 7fcab33ff700 1 -- start start 2023-07-27T14:31:23.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.688+0000 7fcab33ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcaac064950 0x7fcaac0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.688+0000 7fcab33ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac0bfe30 con 0x7fcaac154500 2023-07-27T14:31:23.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.688+0000 7fcab33ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac0c0110 con 0x7fcaac154120 2023-07-27T14:31:23.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.688+0000 7fcab33ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0c68b0 con 0x7fcaac064950 2023-07-27T14:31:23.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.688+0000 7fcab199c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcaac154500 0x7fcaac0c0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41510/0 (socket says 172.21.15.115:41510) 2023-07-27T14:31:23.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.688+0000 7fcab199c700 1 -- 172.21.15.115:0/4182469146 learned_addr learned my addr 172.21.15.115:0/4182469146 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:23.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.688+0000 7fcab099a700 1 --2- 172.21.15.115:0/4182469146 >> v2:172.21.15.159:3300/0 conn(0x7fcaac064950 0x7fcaac0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcaa3fff700 1 -- 172.21.15.115:0/4182469146 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945072969 0 0) 0x7fcaac0bfe30 con 0x7fcaac154500 2023-07-27T14:31:23.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcaa3fff700 1 -- 172.21.15.115:0/4182469146 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca980033f0 con 0x7fcaac154500 2023-07-27T14:31:23.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcaa3fff700 1 -- 172.21.15.115:0/4182469146 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272207705 0 0) 0x7fcaac0c0110 con 0x7fcaac154120 2023-07-27T14:31:23.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcaa3fff700 1 -- 172.21.15.115:0/4182469146 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaac0bfe30 con 0x7fcaac154120 2023-07-27T14:31:23.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcab099a700 1 -- 172.21.15.115:0/4182469146 >> v1:172.21.15.159:6789/0 conn(0x7fcaac154120 legacy=0x7fcaac064240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcab099a700 1 -- 172.21.15.115:0/4182469146 >> v1:172.21.15.115:6789/0 conn(0x7fcaac154500 legacy=0x7fcaac0c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcab099a700 1 -- 172.21.15.115:0/4182469146 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0c03f0 con 0x7fcaac064950 2023-07-27T14:31:23.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcab099a700 1 --2- 172.21.15.115:0/4182469146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac064950 0x7fcaac0c5ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fca9c009760 tx=0x7fca9c009060).ready entity=mon.1 client_cookie=41c60f0bdcf485e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcaa3fff700 1 -- 172.21.15.115:0/4182469146 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c009120 con 0x7fcaac064950 2023-07-27T14:31:23.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcaa3fff700 1 -- 172.21.15.115:0/4182469146 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c00d4a0 con 0x7fcaac064950 2023-07-27T14:31:23.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.689+0000 7fcaa3fff700 1 -- 172.21.15.115:0/4182469146 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c00d820 con 0x7fcaac064950 2023-07-27T14:31:23.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.690+0000 7fcab33ff700 1 -- 172.21.15.115:0/4182469146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac064950 msgr2=0x7fcaac0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.690+0000 7fcab33ff700 1 --2- 172.21.15.115:0/4182469146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac064950 0x7fcaac0c5ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fca9c009760 tx=0x7fca9c009060).stop 2023-07-27T14:31:23.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.690+0000 7fcab33ff700 1 -- 172.21.15.115:0/4182469146 shutdown_connections 2023-07-27T14:31:23.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.690+0000 7fcab33ff700 1 --2- 172.21.15.115:0/4182469146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac064950 0x7fcaac0c5ca0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.690+0000 7fcab33ff700 1 -- 172.21.15.115:0/4182469146 >> 172.21.15.115:0/4182469146 conn(0x7fcaac0c8200 msgr2=0x7fcaac069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:23.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.690+0000 7fcab33ff700 1 -- 172.21.15.115:0/4182469146 shutdown_connections 2023-07-27T14:31:23.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.690+0000 7fcab33ff700 1 -- 172.21.15.115:0/4182469146 wait complete. 2023-07-27T14:31:23.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.692+0000 7fcab33ff700 1 Processor -- start 2023-07-27T14:31:23.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.692+0000 7fcab33ff700 1 -- start start 2023-07-27T14:31:23.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab33ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaac064950 0x7fcaac156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab33ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac154120 0x7fcaac157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab33ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaac154500 0x7fcaac14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab33ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac1595f0 con 0x7fcaac064950 2023-07-27T14:31:23.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab33ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac158a20 con 0x7fcaac154120 2023-07-27T14:31:23.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab33ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac158cc0 con 0x7fcaac154500 2023-07-27T14:31:23.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaac064950 0x7fcaac156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaac064950 0x7fcaac156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49568/0 (socket says 172.21.15.115:49568) 2023-07-27T14:31:23.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 -- 172.21.15.115:0/1265453908 learned_addr learned my addr 172.21.15.115:0/1265453908 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:23.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab099a700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac154120 0x7fcaac157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab199c700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaac154500 0x7fcaac14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 -- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaac154500 msgr2=0x7fcaac14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaac154500 0x7fcaac14d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 -- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac154120 msgr2=0x7fcaac157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac154120 0x7fcaac157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 -- 172.21.15.115:0/1265453908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0092a0 con 0x7fcaac064950 2023-07-27T14:31:23.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab199c700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaac154500 0x7fcaac14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:23.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.693+0000 7fcab119b700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaac064950 0x7fcaac156a80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fcaa800c490 tx=0x7fcaa8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.694+0000 7fcaa17fa700 1 -- 172.21.15.115:0/1265453908 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800f470 con 0x7fcaac064950 2023-07-27T14:31:23.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.694+0000 7fcaa17fa700 1 -- 172.21.15.115:0/1265453908 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800f5d0 con 0x7fcaac064950 2023-07-27T14:31:23.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.694+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac158fa0 con 0x7fcaac064950 2023-07-27T14:31:23.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.694+0000 7fcaa17fa700 1 -- 172.21.15.115:0/1265453908 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800f990 con 0x7fcaac064950 2023-07-27T14:31:23.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.694+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac158020 con 0x7fcaac064950 2023-07-27T14:31:23.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.695+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac05f0c0 con 0x7fcaac064950 2023-07-27T14:31:23.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.696+0000 7fcaa17fa700 1 -- 172.21.15.115:0/1265453908 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fcaa8019030 con 0x7fcaac064950 2023-07-27T14:31:23.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.697+0000 7fcaa17fa700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca9005f190 0x7fca90061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:23.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.697+0000 7fcaa17fa700 1 -- 172.21.15.115:0/1265453908 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcaa80795c0 con 0x7fcaac064950 2023-07-27T14:31:23.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.697+0000 7fcab099a700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca9005f190 0x7fca90061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:23.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.697+0000 7fcab099a700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca9005f190 0x7fca90061650 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fcaac064d50 tx=0x7fca9c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:23.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.700+0000 7fcaa17fa700 1 -- 172.21.15.115:0/1265453908 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcaa80488f0 con 0x7fcaac064950 2023-07-27T14:31:23.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.912+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcaac065320 con 0x7fcaac064950 2023-07-27T14:31:23.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.913+0000 7fcaa17fa700 1 -- 172.21.15.115:0/1265453908 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcaa804a6d0 con 0x7fcaac064950 2023-07-27T14:31:23.945 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:31:23.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca9005f190 msgr2=0x7fca90061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca9005f190 0x7fca90061650 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fcaac064d50 tx=0x7fca9c016000).stop 2023-07-27T14:31:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaac064950 msgr2=0x7fcaac156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaac064950 0x7fcaac156a80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fcaa800c490 tx=0x7fcaa8007c40).stop 2023-07-27T14:31:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 shutdown_connections 2023-07-27T14:31:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca9005f190 0x7fca90061650 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaac154500 0x7fcaac14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaac064950 0x7fcaac156a80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 --2- 172.21.15.115:0/1265453908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac154120 0x7fcaac157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:23.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 >> 172.21.15.115:0/1265453908 conn(0x7fcaac0c8200 msgr2=0x7fcaac14f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:23.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 shutdown_connections 2023-07-27T14:31:23.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:23.915+0000 7fcab33ff700 1 -- 172.21.15.115:0/1265453908 wait complete. 2023-07-27T14:31:23.961 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:31:23.962 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:31:23.962 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:31:23.962 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:31:23.963 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:31:23.963 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:31:23.963 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:31:23.963 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:31:23.964 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:31:23.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:23.964 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:31:24.012 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:31:24.013 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:31:24.013 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:31:24.013 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:24.013 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:31:24.014 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:24.014 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:31:24.014 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:24.015 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:31:24.015 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:31:24.015 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:24.015 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:31:24.015 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:31:24.016 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:24.016 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:31:24.016 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:24.016 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:31:24.016 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41717sec preferred_lft 41717sec 2023-07-27T14:31:24.016 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:31:24.017 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:24.017 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:31:24.017 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:24.017 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:31:24.018 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:24.018 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:31:24.018 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:24.018 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:31:24.019 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:31:24.019 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:31:24.019 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:24.019 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:31:24.020 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:31:24.020 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:31:24.020 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:24.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:24.022 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:31:24.090 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:31:24.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:24.093 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:31:24.142 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:31:24.143 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:31:24.143 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:31:24.143 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:31:24.143 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:31:24.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:24.144 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:31:24.145 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:31:24.146 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:31:24.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:31:24.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:31:24.148 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:31:24.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:24.318 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:31:24.365 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:31:24.365 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:31:24.365 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:31:24.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:24.366 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:31:24.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:24.476 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:31:24.523 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:31:24.523 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:31:24.661 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:31:24.661 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:31:24.687 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:31:24.687 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:31:24.693 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:31:24.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:24.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:31:24.764 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:31:24.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.903+0000 7fb1735ff700 1 Processor -- start 2023-07-27T14:31:24.936 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.903+0000 7fb1735ff700 1 -- start start 2023-07-27T14:31:24.936 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb1735ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c0641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:24.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb1735ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb16c0646c0 0x7fb16c154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:24.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb1735ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16c064b50 con 0x7fb16c154190 2023-07-27T14:31:24.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb1735ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16c0aa640 con 0x7fb16c0646c0 2023-07-27T14:31:24.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb1735ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c158e00 con 0x7fb16c0c64b0 2023-07-27T14:31:24.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb170b9a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c0641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:24.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb17139b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fb16c154190 0x7fb16c0a9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:39570/0 (socket says 172.21.15.159:39570) 2023-07-27T14:31:24.938 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb17139b700 1 -- 172.21.15.159:0/1641172139 learned_addr learned my addr 172.21.15.159:0/1641172139 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:31:24.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb171b9c700 1 --2- 172.21.15.159:0/1641172139 >> v2:172.21.15.115:3300/0 conn(0x7fb16c0646c0 0x7fb16c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:24.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb170b9a700 1 -- 172.21.15.159:0/1641172139 >> v2:172.21.15.115:3300/0 conn(0x7fb16c0646c0 msgr2=0x7fb16c154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:24.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb170b9a700 1 --2- 172.21.15.159:0/1641172139 >> v2:172.21.15.115:3300/0 conn(0x7fb16c0646c0 0x7fb16c154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:24.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb170b9a700 1 -- 172.21.15.159:0/1641172139 >> v1:172.21.15.159:6789/0 conn(0x7fb16c154190 legacy=0x7fb16c0a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:24.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb170b9a700 1 -- 172.21.15.159:0/1641172139 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c158040 con 0x7fb16c0c64b0 2023-07-27T14:31:24.939 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.905+0000 7fb163fff700 1 -- 172.21.15.159:0/1641172139 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857543920 0 0) 0x7fb16c064b50 con 0x7fb16c154190 2023-07-27T14:31:24.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb170b9a700 1 --2- 172.21.15.159:0/1641172139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c0641d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb15c009760 tx=0x7fb15c009060).ready entity=mon.2 client_cookie=a4be9e382a131a5d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:24.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb163fff700 1 -- 172.21.15.159:0/1641172139 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0090d0 con 0x7fb16c0c64b0 2023-07-27T14:31:24.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb163fff700 1 -- 172.21.15.159:0/1641172139 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c00f510 con 0x7fb16c0c64b0 2023-07-27T14:31:24.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb163fff700 1 -- 172.21.15.159:0/1641172139 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00f890 con 0x7fb16c0c64b0 2023-07-27T14:31:24.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb1735ff700 1 -- 172.21.15.159:0/1641172139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 msgr2=0x7fb16c0641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:24.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb1735ff700 1 --2- 172.21.15.159:0/1641172139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c0641d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb15c009760 tx=0x7fb15c009060).stop 2023-07-27T14:31:24.940 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb1735ff700 1 -- 172.21.15.159:0/1641172139 shutdown_connections 2023-07-27T14:31:24.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb1735ff700 1 --2- 172.21.15.159:0/1641172139 >> v2:172.21.15.115:3300/0 conn(0x7fb16c0646c0 0x7fb16c154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:24.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb1735ff700 1 --2- 172.21.15.159:0/1641172139 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c0641d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:24.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.906+0000 7fb1735ff700 1 -- 172.21.15.159:0/1641172139 >> 172.21.15.159:0/1641172139 conn(0x7fb16c0cb730 msgr2=0x7fb16c0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:24.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.907+0000 7fb1735ff700 1 -- 172.21.15.159:0/1641172139 shutdown_connections 2023-07-27T14:31:24.941 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.907+0000 7fb1735ff700 1 -- 172.21.15.159:0/1641172139 wait complete. 2023-07-27T14:31:24.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.908+0000 7fb1735ff700 1 Processor -- start 2023-07-27T14:31:24.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.908+0000 7fb1735ff700 1 -- start start 2023-07-27T14:31:24.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb1735ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0646c0 0x7fb16c0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:24.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb1735ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c168860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:24.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb1735ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c154190 0x7fb16c0ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:24.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb1735ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c1502f0 con 0x7fb16c154190 2023-07-27T14:31:24.943 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb1735ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c1680f0 con 0x7fb16c0646c0 2023-07-27T14:31:24.944 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb1735ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c0ae110 con 0x7fb16c0c64b0 2023-07-27T14:31:24.944 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb170b9a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c168860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:24.944 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb17139b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0646c0 0x7fb16c0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:24.944 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb170b9a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c168860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:45074/0 (socket says 172.21.15.159:45074) 2023-07-27T14:31:24.944 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.909+0000 7fb170b9a700 1 -- 172.21.15.159:0/3387375435 learned_addr learned my addr 172.21.15.159:0/3387375435 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:31:24.944 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb171b9c700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c154190 0x7fb16c0ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:24.944 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb170b9a700 1 -- 172.21.15.159:0/3387375435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0646c0 msgr2=0x7fb16c0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:24.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb170b9a700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0646c0 0x7fb16c0b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:24.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb170b9a700 1 -- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c154190 msgr2=0x7fb16c0ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:24.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb170b9a700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c154190 0x7fb16c0ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:24.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb170b9a700 1 -- 172.21.15.159:0/3387375435 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c0092a0 con 0x7fb16c0c64b0 2023-07-27T14:31:24.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb17139b700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0646c0 0x7fb16c0b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:24.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb170b9a700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c168860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb15c009e00 tx=0x7fb15c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:24.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb1617fa700 1 -- 172.21.15.159:0/3387375435 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00f890 con 0x7fb16c0c64b0 2023-07-27T14:31:24.945 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb1617fa700 1 -- 172.21.15.159:0/3387375435 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c00fc50 con 0x7fb16c0c64b0 2023-07-27T14:31:24.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16c0ae3f0 con 0x7fb16c0c64b0 2023-07-27T14:31:24.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.910+0000 7fb1617fa700 1 -- 172.21.15.159:0/3387375435 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c01b410 con 0x7fb16c0c64b0 2023-07-27T14:31:24.946 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.911+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16c168340 con 0x7fb16c0c64b0 2023-07-27T14:31:24.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.912+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16c05f0c0 con 0x7fb16c0c64b0 2023-07-27T14:31:24.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.913+0000 7fb1617fa700 1 -- 172.21.15.159:0/3387375435 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fb15c00f070 con 0x7fb16c0c64b0 2023-07-27T14:31:24.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.914+0000 7fb1617fa700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15005f1c0 0x7fb150061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:24.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.914+0000 7fb1617fa700 1 -- 172.21.15.159:0/3387375435 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb15c07bb70 con 0x7fb16c0c64b0 2023-07-27T14:31:24.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.914+0000 7fb17139b700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15005f1c0 0x7fb150061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:24.947 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.915+0000 7fb17139b700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15005f1c0 0x7fb150061680 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fb16c152570 tx=0x7fb168007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:24.950 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:24.918+0000 7fb1617fa700 1 -- 172.21.15.159:0/3387375435 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb15c04cb70 con 0x7fb16c0c64b0 2023-07-27T14:31:25.162 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.130+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb16c0c5210 con 0x7fb16c0c64b0 2023-07-27T14:31:25.163 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.131+0000 7fb1617fa700 1 -- 172.21.15.159:0/3387375435 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb15c050190 con 0x7fb16c0c64b0 2023-07-27T14:31:25.163 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:31:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15005f1c0 msgr2=0x7fb150061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15005f1c0 0x7fb150061680 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fb16c152570 tx=0x7fb168007bb0).stop 2023-07-27T14:31:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 msgr2=0x7fb16c168860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c168860 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb15c009e00 tx=0x7fb15c017000).stop 2023-07-27T14:31:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 shutdown_connections 2023-07-27T14:31:25.165 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15005f1c0 0x7fb150061680 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c154190 0x7fb16c0ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0646c0 0x7fb16c0b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 --2- 172.21.15.159:0/3387375435 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0c64b0 0x7fb16c168860 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 >> 172.21.15.159:0/3387375435 conn(0x7fb16c0cb730 msgr2=0x7fb16c0c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 shutdown_connections 2023-07-27T14:31:25.166 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:31:25.133+0000 7fb1735ff700 1 -- 172.21.15.159:0/3387375435 wait complete. 2023-07-27T14:31:25.179 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:31:25.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:31:25.180 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:31:25.180 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:31:25.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:31:25.181 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:31:25.181 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:31:25.181 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:31:25.181 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:31:25.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:25.182 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:31:25.229 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:31:25.229 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:31:25.229 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:31:25.230 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:25.230 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:31:25.230 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:25.230 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:31:25.230 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:25.230 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:31:25.230 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:31:25.231 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:25.231 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:31:25.231 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:31:25.231 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:25.231 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:31:25.231 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:25.231 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:31:25.231 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41711sec preferred_lft 41711sec 2023-07-27T14:31:25.232 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:31:25.232 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:25.232 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:31:25.232 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:31:25.232 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:31:25.232 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:25.232 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:31:25.233 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:25.233 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:31:25.233 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:31:25.233 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:31:25.233 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:25.233 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:31:25.233 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:31:25.233 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:31:25.234 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:31:25.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:25.234 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:31:25.338 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:31:25.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:25.342 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:31:25.391 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:31:25.391 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:31:25.391 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:31:25.392 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:31:25.392 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:31:25.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:25.393 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:31:25.393 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:31:25.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:31:25.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:31:25.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:31:25.395 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:31:25.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:25.565 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:31:25.612 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:31:25.613 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:31:25.613 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:31:25.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:25.614 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:31:25.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:25.686 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:31:25.732 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:31:25.733 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:31:25.831 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:31:25.832 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:31:25.858 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:31:25.858 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:31:25.862 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:31:25.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:31:25.863 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:31:25.932 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:31:26.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.098+0000 7f1e4b5ff700 1 Processor -- start 2023-07-27T14:31:26.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.098+0000 7f1e4b5ff700 1 -- start start 2023-07-27T14:31:26.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.099+0000 7f1e4b5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e44065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.099+0000 7f1e4b5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e440bd9a0 con 0x7f1e4413a350 2023-07-27T14:31:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.099+0000 7f1e4b5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e44066610 con 0x7f1e4413a730 2023-07-27T14:31:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.099+0000 7f1e4b5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44066400 con 0x7f1e440c36b0 2023-07-27T14:31:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.099+0000 7f1e4939b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1e4413a350 0x7f1e440c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41522/0 (socket says 172.21.15.115:41522) 2023-07-27T14:31:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e4939b700 1 -- 172.21.15.115:0/1280248397 learned_addr learned my addr 172.21.15.115:0/1280248397 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e49b9c700 1 --2- 172.21.15.115:0/1280248397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e44065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e3bfff700 1 -- 172.21.15.115:0/1280248397 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440940179 0 0) 0x7f1e440bd9a0 con 0x7f1e4413a350 2023-07-27T14:31:26.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e3bfff700 1 -- 172.21.15.115:0/1280248397 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e300033f0 con 0x7f1e4413a350 2023-07-27T14:31:26.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e3bfff700 1 -- 172.21.15.115:0/1280248397 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671515193 0 0) 0x7f1e44066610 con 0x7f1e4413a730 2023-07-27T14:31:26.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e3bfff700 1 -- 172.21.15.115:0/1280248397 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e440bd9a0 con 0x7f1e4413a730 2023-07-27T14:31:26.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e49b9c700 1 -- 172.21.15.115:0/1280248397 >> v1:172.21.15.159:6789/0 conn(0x7f1e4413a730 legacy=0x7f1e440be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e49b9c700 1 -- 172.21.15.115:0/1280248397 >> v1:172.21.15.115:6789/0 conn(0x7f1e4413a350 legacy=0x7f1e440c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e49b9c700 1 -- 172.21.15.115:0/1280248397 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440bdc10 con 0x7f1e440c36b0 2023-07-27T14:31:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.100+0000 7f1e49b9c700 1 --2- 172.21.15.115:0/1280248397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e44065f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1e3c009e90 tx=0x7f1e3c009780).ready entity=mon.2 client_cookie=7a2a1ad75be9ce59 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e3bfff700 1 -- 172.21.15.115:0/1280248397 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00e070 con 0x7f1e440c36b0 2023-07-27T14:31:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e3bfff700 1 -- 172.21.15.115:0/1280248397 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c00bab0 con 0x7f1e440c36b0 2023-07-27T14:31:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e3bfff700 1 -- 172.21.15.115:0/1280248397 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00be30 con 0x7f1e440c36b0 2023-07-27T14:31:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/1280248397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 msgr2=0x7f1e44065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e4b5ff700 1 --2- 172.21.15.115:0/1280248397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e44065f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1e3c009e90 tx=0x7f1e3c009780).stop 2023-07-27T14:31:26.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/1280248397 shutdown_connections 2023-07-27T14:31:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e4b5ff700 1 --2- 172.21.15.115:0/1280248397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e44065f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/1280248397 >> 172.21.15.115:0/1280248397 conn(0x7f1e4405e8f0 msgr2=0x7f1e440c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/1280248397 shutdown_connections 2023-07-27T14:31:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.101+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/1280248397 wait complete. 2023-07-27T14:31:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.103+0000 7f1e4b5ff700 1 Processor -- start 2023-07-27T14:31:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.103+0000 7f1e4b5ff700 1 -- start start 2023-07-27T14:31:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e4b5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e441394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e4b5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4413a350 0x7f1e440a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e4b5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e4413a730 0x7f1e440a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e4b5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440a77d0 con 0x7f1e4413a350 2023-07-27T14:31:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e4b5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440aa8c0 con 0x7f1e4413a730 2023-07-27T14:31:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e4b5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440a9cb0 con 0x7f1e440c36b0 2023-07-27T14:31:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e48b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4413a350 0x7f1e440a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e48b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4413a350 0x7f1e440a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49572/0 (socket says 172.21.15.115:49572) 2023-07-27T14:31:26.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e48b9a700 1 -- 172.21.15.115:0/366747215 learned_addr learned my addr 172.21.15.115:0/366747215 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e4939b700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e441394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e49b9c700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e4413a730 0x7f1e440a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e48b9a700 1 -- 172.21.15.115:0/366747215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 msgr2=0x7f1e441394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e48b9a700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e441394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e48b9a700 1 -- 172.21.15.115:0/366747215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e4413a730 msgr2=0x7f1e440a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e48b9a700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e4413a730 0x7f1e440a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.104+0000 7f1e48b9a700 1 -- 172.21.15.115:0/366747215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c009a20 con 0x7f1e4413a350 2023-07-27T14:31:26.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.105+0000 7f1e48b9a700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4413a350 0x7f1e440a6df0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f1e3400c4a0 tx=0x7f1e34007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.105+0000 7f1e397fa700 1 -- 172.21.15.115:0/366747215 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400ce50 con 0x7f1e4413a350 2023-07-27T14:31:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.105+0000 7f1e397fa700 1 -- 172.21.15.115:0/366747215 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3400f470 con 0x7f1e4413a350 2023-07-27T14:31:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.105+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e440a9f90 con 0x7f1e4413a350 2023-07-27T14:31:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.105+0000 7f1e397fa700 1 -- 172.21.15.115:0/366747215 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400f810 con 0x7f1e4413a350 2023-07-27T14:31:26.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.105+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e440aa550 con 0x7f1e4413a350 2023-07-27T14:31:26.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.106+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4406c470 con 0x7f1e4413a350 2023-07-27T14:31:26.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.107+0000 7f1e397fa700 1 -- 172.21.15.115:0/366747215 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f1e34019030 con 0x7f1e4413a350 2023-07-27T14:31:26.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.108+0000 7f1e397fa700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e2805f190 0x7f1e28061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.109+0000 7f1e397fa700 1 -- 172.21.15.115:0/366747215 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e34079600 con 0x7f1e4413a350 2023-07-27T14:31:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.109+0000 7f1e4939b700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e2805f190 0x7f1e28061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.109+0000 7f1e4939b700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e2805f190 0x7f1e28061650 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f1e40007fd0 tx=0x7f1e40009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:26.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.112+0000 7f1e397fa700 1 -- 172.21.15.115:0/366747215 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e3404a710 con 0x7f1e4413a350 2023-07-27T14:31:26.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.323+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e440bdef0 con 0x7f1e4413a350 2023-07-27T14:31:26.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.609+0000 7f1e397fa700 1 -- 172.21.15.115:0/366747215 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 136+0+0 (secure 0 0 0) 0x7f1e3404dd30 con 0x7f1e4413a350 2023-07-27T14:31:26.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e2805f190 msgr2=0x7f1e28061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e2805f190 0x7f1e28061650 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f1e40007fd0 tx=0x7f1e40009040).stop 2023-07-27T14:31:26.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4413a350 msgr2=0x7f1e440a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4413a350 0x7f1e440a6df0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f1e3400c4a0 tx=0x7f1e34007c50).stop 2023-07-27T14:31:26.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 shutdown_connections 2023-07-27T14:31:26.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e2805f190 0x7f1e28061650 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e4413a730 0x7f1e440a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440c36b0 0x7f1e441394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 --2- 172.21.15.115:0/366747215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e4413a350 0x7f1e440a6df0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 >> 172.21.15.115:0/366747215 conn(0x7f1e4405e8f0 msgr2=0x7f1e440ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:26.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 shutdown_connections 2023-07-27T14:31:26.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.611+0000 7f1e4b5ff700 1 -- 172.21.15.115:0/366747215 wait complete. 2023-07-27T14:31:26.661 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:31:26.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.818+0000 7f4cc6dff700 1 Processor -- start 2023-07-27T14:31:26.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.818+0000 7f4cc6dff700 1 -- start start 2023-07-27T14:31:26.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.819+0000 7f4cc6dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4cc00aaa40 0x7f4cc00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.819+0000 7f4cc6dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4cc01542a0 0x7f4cc00645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.819+0000 7f4cc6dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc00aa4d0 con 0x7f4cc0153ec0 2023-07-27T14:31:26.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.819+0000 7f4cc6dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc0064ad0 con 0x7f4cc01542a0 2023-07-27T14:31:26.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.819+0000 7f4cc6dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc00c05c0 con 0x7f4cc00aaa40 2023-07-27T14:31:26.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cc539c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4cc01542a0 0x7f4cc00645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cc4b9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4cc0153ec0 0x7f4cc00a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41528/0 (socket says 172.21.15.115:41528) 2023-07-27T14:31:26.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cc4b9b700 1 -- 172.21.15.115:0/1377917506 learned_addr learned my addr 172.21.15.115:0/1377917506 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cbffff700 1 --2- 172.21.15.115:0/1377917506 >> v2:172.21.15.159:3300/0 conn(0x7f4cc00aaa40 0x7f4cc00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cc539c700 1 -- 172.21.15.115:0/1377917506 >> v2:172.21.15.159:3300/0 conn(0x7f4cc00aaa40 msgr2=0x7f4cc00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cc539c700 1 --2- 172.21.15.115:0/1377917506 >> v2:172.21.15.159:3300/0 conn(0x7f4cc00aaa40 0x7f4cc00640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cc539c700 1 -- 172.21.15.115:0/1377917506 >> v1:172.21.15.115:6789/0 conn(0x7f4cc0153ec0 legacy=0x7f4cc00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cc539c700 1 -- 172.21.15.115:0/1377917506 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc00c1a60 con 0x7f4cc01542a0 2023-07-27T14:31:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cbf7fe700 1 -- 172.21.15.115:0/1377917506 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118251783 0 0) 0x7f4cb4001110 con 0x7f4cc0153ec0 2023-07-27T14:31:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.820+0000 7f4cc539c700 1 --2- 172.21.15.115:0/1377917506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc01542a0 0x7f4cc00645e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f4cc006c0d0 tx=0x7f4cb8009780).ready entity=mon.0 client_cookie=2f79d9e013b74ebf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cbf7fe700 1 -- 172.21.15.115:0/1377917506 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800e070 con 0x7f4cc01542a0 2023-07-27T14:31:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cbf7fe700 1 -- 172.21.15.115:0/1377917506 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb800bc30 con 0x7f4cc01542a0 2023-07-27T14:31:26.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cbf7fe700 1 -- 172.21.15.115:0/1377917506 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8012410 con 0x7f4cc01542a0 2023-07-27T14:31:26.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1377917506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc01542a0 msgr2=0x7f4cc00645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1377917506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc01542a0 0x7f4cc00645e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f4cc006c0d0 tx=0x7f4cb8009780).stop 2023-07-27T14:31:26.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1377917506 shutdown_connections 2023-07-27T14:31:26.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1377917506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc01542a0 0x7f4cc00645e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1377917506 >> v2:172.21.15.159:3300/0 conn(0x7f4cc00aaa40 0x7f4cc00640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1377917506 >> 172.21.15.115:0/1377917506 conn(0x7f4cc00cb610 msgr2=0x7f4cc00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:26.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1377917506 shutdown_connections 2023-07-27T14:31:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.821+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1377917506 wait complete. 2023-07-27T14:31:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.823+0000 7f4cc6dff700 1 Processor -- start 2023-07-27T14:31:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.823+0000 7f4cc6dff700 1 -- start start 2023-07-27T14:31:26.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc6dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc00aaa40 0x7f4cc0157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc6dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc0153ec0 0x7f4cc0150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc6dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc01542a0 0x7f4cc0152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc6dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc01686a0 con 0x7f4cc00aaa40 2023-07-27T14:31:26.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc6dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc0168090 con 0x7f4cc01542a0 2023-07-27T14:31:26.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc6dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc0158590 con 0x7f4cc0153ec0 2023-07-27T14:31:26.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc4b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc00aaa40 0x7f4cc0157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc4b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc00aaa40 0x7f4cc0157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49592/0 (socket says 172.21.15.115:49592) 2023-07-27T14:31:26.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc4b9b700 1 -- 172.21.15.115:0/1123678150 learned_addr learned my addr 172.21.15.115:0/1123678150 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:26.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cbffff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc0153ec0 0x7f4cc0150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc539c700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc01542a0 0x7f4cc0152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc4b9b700 1 -- 172.21.15.115:0/1123678150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc0153ec0 msgr2=0x7f4cc0150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc4b9b700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc0153ec0 0x7f4cc0150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc4b9b700 1 -- 172.21.15.115:0/1123678150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc01542a0 msgr2=0x7f4cc0152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:26.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc4b9b700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc01542a0 0x7f4cc0152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.824+0000 7f4cc4b9b700 1 -- 172.21.15.115:0/1123678150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb8009a20 con 0x7f4cc00aaa40 2023-07-27T14:31:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.825+0000 7f4cc4b9b700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc00aaa40 0x7f4cc0157d60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f4cb400c510 tx=0x7f4cb4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.825+0000 7f4cbcff9700 1 -- 172.21.15.115:0/1123678150 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400ce80 con 0x7f4cc00aaa40 2023-07-27T14:31:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.825+0000 7f4cbcff9700 1 -- 172.21.15.115:0/1123678150 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb40072e0 con 0x7f4cc00aaa40 2023-07-27T14:31:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.825+0000 7f4cbcff9700 1 -- 172.21.15.115:0/1123678150 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4007660 con 0x7f4cc00aaa40 2023-07-27T14:31:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.825+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc0168330 con 0x7f4cc00aaa40 2023-07-27T14:31:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.825+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc0158250 con 0x7f4cc00aaa40 2023-07-27T14:31:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.826+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc006c470 con 0x7f4cc00aaa40 2023-07-27T14:31:26.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.827+0000 7f4cbcff9700 1 -- 172.21.15.115:0/1123678150 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f4cb4010070 con 0x7f4cc00aaa40 2023-07-27T14:31:26.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.828+0000 7f4cbcff9700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ca405f1c0 0x7f4ca4061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:26.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.828+0000 7f4cbcff9700 1 -- 172.21.15.115:0/1123678150 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4cb40796f0 con 0x7f4cc00aaa40 2023-07-27T14:31:26.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.828+0000 7f4cbffff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ca405f1c0 0x7f4ca4061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:26.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.828+0000 7f4cbffff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ca405f1c0 0x7f4ca4061680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f4cc0157d10 tx=0x7f4cac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:26.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:26.832+0000 7f4cbcff9700 1 -- 172.21.15.115:0/1123678150 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4cb404a800 con 0x7f4cc00aaa40 2023-07-27T14:31:27.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.026+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cc01687e0 con 0x7f4ca405f1c0 2023-07-27T14:31:27.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.028+0000 7f4cbcff9700 1 -- 172.21.15.115:0/1123678150 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4cac0107c0 con 0x7f4ca405f1c0 2023-07-27T14:31:27.060 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:31:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:31:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:31:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:27.060 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:31:27.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ca405f1c0 msgr2=0x7f4ca4061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ca405f1c0 0x7f4ca4061680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f4cc0157d10 tx=0x7f4cac008040).stop 2023-07-27T14:31:27.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc00aaa40 msgr2=0x7f4cc0157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc00aaa40 0x7f4cc0157d60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f4cb400c510 tx=0x7f4cb4007ad0).stop 2023-07-27T14:31:27.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 shutdown_connections 2023-07-27T14:31:27.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ca405f1c0 0x7f4ca4061680 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc01542a0 0x7f4cc0152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc00aaa40 0x7f4cc0157d60 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 --2- 172.21.15.115:0/1123678150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cc0153ec0 0x7f4cc0150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 >> 172.21.15.115:0/1123678150 conn(0x7f4cc00cb610 msgr2=0x7f4cc00c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:27.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 shutdown_connections 2023-07-27T14:31:27.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.029+0000 7f4cc6dff700 1 -- 172.21.15.115:0/1123678150 wait complete. 2023-07-27T14:31:27.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:31:27.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.239+0000 7f6a45fff700 1 Processor -- start 2023-07-27T14:31:27.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.239+0000 7f6a45fff700 1 -- start start 2023-07-27T14:31:27.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a45fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a4014ae00 0x7f6a40154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a45fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a401553f0 con 0x7f6a40063260 2023-07-27T14:31:27.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a45fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a40157a50 con 0x7f6a4014b1e0 2023-07-27T14:31:27.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a45fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a40157d10 con 0x7f6a4014ae00 2023-07-27T14:31:27.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6a40063260 0x7f6a400a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41532/0 (socket says 172.21.15.115:41532) 2023-07-27T14:31:27.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3ffff700 1 -- 172.21.15.115:0/3239422397 learned_addr learned my addr 172.21.15.115:0/3239422397 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:27.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375495875 0 0) 0x7f6a401553f0 con 0x7f6a40063260 2023-07-27T14:31:27.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3f7fe700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a4014ae00 0x7f6a40154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a280033f0 con 0x7f6a40063260 2023-07-27T14:31:27.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883012578 0 0) 0x7f6a280033f0 con 0x7f6a40063260 2023-07-27T14:31:27.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a4014ae00 msgr2=0x7f6a40154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a4014ae00 0x7f6a40154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 >> v1:172.21.15.159:6789/0 conn(0x7f6a4014b1e0 legacy=0x7f6a40062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a40157ff0 con 0x7f6a40063260 2023-07-27T14:31:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f6a380017f0 con 0x7f6a40063260 2023-07-27T14:31:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 >> v1:172.21.15.115:6789/0 conn(0x7f6a40063260 legacy=0x7f6a400a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a28003910 0x7f6a28003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.241+0000 7f6a3e7fc700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a4014ae00 0x7f6a28004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3e7fc700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a28005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a40157d10 con 0x7f6a28004b80 2023-07-27T14:31:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2800b8e0 con 0x7f6a28003910 2023-07-27T14:31:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2800ba50 con 0x7f6a4014ae00 2023-07-27T14:31:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3ffff700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a28005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3f7fe700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a28003910 0x7f6a28003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3effd700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a4014ae00 0x7f6a28004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3ffff700 1 -- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a4014ae00 msgr2=0x7f6a28004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3ffff700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a4014ae00 0x7f6a28004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3ffff700 1 -- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a28003910 msgr2=0x7f6a28003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3ffff700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a28003910 0x7f6a28003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3ffff700 1 -- 172.21.15.115:0/3239422397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280033f0 con 0x7f6a28004b80 2023-07-27T14:31:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3f7fe700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a28003910 0x7f6a28003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.242+0000 7f6a3ffff700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a28005000 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f6a3800c5f0 tx=0x7f6a38001d90).ready entity=mon.0 client_cookie=f09b0f6ce5bdd7a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800ce60 con 0x7f6a28004b80 2023-07-27T14:31:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a38001fc0 con 0x7f6a28004b80 2023-07-27T14:31:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a3e7fc700 1 -- 172.21.15.115:0/3239422397 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38005d50 con 0x7f6a28004b80 2023-07-27T14:31:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a45fff700 1 -- 172.21.15.115:0/3239422397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 msgr2=0x7f6a28005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a45fff700 1 --2- 172.21.15.115:0/3239422397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a28005000 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f6a3800c5f0 tx=0x7f6a38001d90).stop 2023-07-27T14:31:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a3ffff700 1 -- 172.21.15.115:0/3239422397 reap_dead start 2023-07-27T14:31:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a45fff700 1 -- 172.21.15.115:0/3239422397 shutdown_connections 2023-07-27T14:31:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a45fff700 1 -- 172.21.15.115:0/3239422397 >> 172.21.15.115:0/3239422397 conn(0x7f6a4005e940 msgr2=0x7f6a400cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a45fff700 1 -- 172.21.15.115:0/3239422397 shutdown_connections 2023-07-27T14:31:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.243+0000 7f6a45fff700 1 -- 172.21.15.115:0/3239422397 wait complete. 2023-07-27T14:31:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.246+0000 7f6a45fff700 1 Processor -- start 2023-07-27T14:31:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.246+0000 7f6a45fff700 1 -- start start 2023-07-27T14:31:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a45fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a4014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a45fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a401598e0 0x7f6a40159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a45fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4014d7c0 0x7f6a4014dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a45fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4015a250 con 0x7f6a28004b80 2023-07-27T14:31:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a45fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a401544a0 con 0x7f6a4014d7c0 2023-07-27T14:31:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a45fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a40154740 con 0x7f6a401598e0 2023-07-27T14:31:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a4014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a4014a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49600/0 (socket says 172.21.15.115:49600) 2023-07-27T14:31:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 -- 172.21.15.115:0/2026640402 learned_addr learned my addr 172.21.15.115:0/2026640402 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3ffff700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4014d7c0 0x7f6a4014dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3effd700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a401598e0 0x7f6a40159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 -- 172.21.15.115:0/2026640402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a401598e0 msgr2=0x7f6a40159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a401598e0 0x7f6a40159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 -- 172.21.15.115:0/2026640402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4014d7c0 msgr2=0x7f6a4014dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4014d7c0 0x7f6a4014dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 -- 172.21.15.115:0/2026640402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a40154a20 con 0x7f6a28004b80 2023-07-27T14:31:27.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a3f7fe700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a4014a640 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f6a30011b10 tx=0x7f6a30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:27.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a277fe700 1 -- 172.21.15.115:0/2026640402 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000f9f0 con 0x7f6a28004b80 2023-07-27T14:31:27.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a277fe700 1 -- 172.21.15.115:0/2026640402 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3000fb50 con 0x7f6a28004b80 2023-07-27T14:31:27.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a277fe700 1 -- 172.21.15.115:0/2026640402 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000fed0 con 0x7f6a28004b80 2023-07-27T14:31:27.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a40154d00 con 0x7f6a28004b80 2023-07-27T14:31:27.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.247+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a401552c0 con 0x7f6a28004b80 2023-07-27T14:31:27.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.249+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a40155630 con 0x7f6a28004b80 2023-07-27T14:31:27.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.249+0000 7f6a277fe700 1 -- 172.21.15.115:0/2026640402 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7f6a30024070 con 0x7f6a28004b80 2023-07-27T14:31:27.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.251+0000 7f6a277fe700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a2c05f1c0 0x7f6a2c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.251+0000 7f6a277fe700 1 -- 172.21.15.115:0/2026640402 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6a3007ab20 con 0x7f6a28004b80 2023-07-27T14:31:27.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.251+0000 7f6a3effd700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a2c05f1c0 0x7f6a2c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.252+0000 7f6a3effd700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a2c05f1c0 0x7f6a2c061680 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f6a4014e610 tx=0x7f6a34009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:27.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.255+0000 7f6a277fe700 1 -- 172.21.15.115:0/2026640402 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6a3004bc90 con 0x7f6a28004b80 2023-07-27T14:31:27.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.426+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6a4006c470 con 0x7f6a28004b80 2023-07-27T14:31:27.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.427+0000 7f6a277fe700 1 -- 172.21.15.115:0/2026640402 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6a30022070 con 0x7f6a28004b80 2023-07-27T14:31:27.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a2c05f1c0 msgr2=0x7f6a2c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a2c05f1c0 0x7f6a2c061680 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f6a4014e610 tx=0x7f6a34009040).stop 2023-07-27T14:31:27.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 msgr2=0x7f6a4014a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a4014a640 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f6a30011b10 tx=0x7f6a30009060).stop 2023-07-27T14:31:27.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 shutdown_connections 2023-07-27T14:31:27.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a2c05f1c0 0x7f6a2c061680 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a4014d7c0 0x7f6a4014dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a28004b80 0x7f6a4014a640 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 --2- 172.21.15.115:0/2026640402 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a401598e0 0x7f6a40159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 >> 172.21.15.115:0/2026640402 conn(0x7f6a4005e940 msgr2=0x7f6a400c03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:27.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 shutdown_connections 2023-07-27T14:31:27.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.429+0000 7f6a45fff700 1 -- 172.21.15.115:0/2026640402 wait complete. 2023-07-27T14:31:27.478 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000313812 --mode=777 2023-07-27T14:31:27.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.642+0000 7feb1bbff700 1 Processor -- start 2023-07-27T14:31:27.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.642+0000 7feb1bbff700 1 -- start start 2023-07-27T14:31:27.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.643+0000 7feb1bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb1414f740 0x7feb1414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.643+0000 7feb1bbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb140c38f0 0x7feb140a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.643+0000 7feb1bbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb141530d0 con 0x7feb140a5850 2023-07-27T14:31:27.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.643+0000 7feb1bbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb14069f70 con 0x7feb140c38f0 2023-07-27T14:31:27.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.643+0000 7feb1bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140a61c0 con 0x7feb1414f740 2023-07-27T14:31:27.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.643+0000 7feb1a19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb140c38f0 0x7feb140a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb1a19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb140c38f0 0x7feb140a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49602/0 (socket says 172.21.15.115:49602) 2023-07-27T14:31:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb1a19c700 1 -- 172.21.15.115:0/3496017366 learned_addr learned my addr 172.21.15.115:0/3496017366 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb1999b700 1 --2- 172.21.15.115:0/3496017366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb1414f740 0x7feb1414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb1a19c700 1 -- 172.21.15.115:0/3496017366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb1414f740 msgr2=0x7feb1414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb1a19c700 1 --2- 172.21.15.115:0/3496017366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb1414f740 0x7feb1414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb1a19c700 1 -- 172.21.15.115:0/3496017366 >> v1:172.21.15.159:6789/0 conn(0x7feb140a5850 legacy=0x7feb140c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb1a19c700 1 -- 172.21.15.115:0/3496017366 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb141527a0 con 0x7feb140c38f0 2023-07-27T14:31:27.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb1a19c700 1 --2- 172.21.15.115:0/3496017366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140a5cd0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7feb0c009f50 tx=0x7feb0c009840).ready entity=mon.0 client_cookie=663dc56ea9e44e8f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:27.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb18999700 1 -- 172.21.15.115:0/3496017366 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00e070 con 0x7feb140c38f0 2023-07-27T14:31:27.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb18999700 1 -- 172.21.15.115:0/3496017366 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00b9c0 con 0x7feb140c38f0 2023-07-27T14:31:27.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.644+0000 7feb18999700 1 -- 172.21.15.115:0/3496017366 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00bd40 con 0x7feb140c38f0 2023-07-27T14:31:27.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.645+0000 7feb1bbff700 1 -- 172.21.15.115:0/3496017366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 msgr2=0x7feb140a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.645+0000 7feb1bbff700 1 --2- 172.21.15.115:0/3496017366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140a5cd0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7feb0c009f50 tx=0x7feb0c009840).stop 2023-07-27T14:31:27.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.645+0000 7feb1bbff700 1 -- 172.21.15.115:0/3496017366 shutdown_connections 2023-07-27T14:31:27.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.645+0000 7feb1bbff700 1 --2- 172.21.15.115:0/3496017366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb1414f740 0x7feb1414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.645+0000 7feb1bbff700 1 --2- 172.21.15.115:0/3496017366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140a5cd0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.645+0000 7feb1bbff700 1 -- 172.21.15.115:0/3496017366 >> 172.21.15.115:0/3496017366 conn(0x7feb14062320 msgr2=0x7feb14062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:27.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.645+0000 7feb1bbff700 1 -- 172.21.15.115:0/3496017366 shutdown_connections 2023-07-27T14:31:27.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.645+0000 7feb1bbff700 1 -- 172.21.15.115:0/3496017366 wait complete. 2023-07-27T14:31:27.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.646+0000 7feb1bbff700 1 Processor -- start 2023-07-27T14:31:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.647+0000 7feb1bbff700 1 -- start start 2023-07-27T14:31:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.647+0000 7feb1bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb140a5850 0x7feb140c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.647+0000 7feb1bbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140c0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.647+0000 7feb1bbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb1414f740 0x7feb14144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.647+0000 7feb1bbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c4cd0 con 0x7feb140c38f0 2023-07-27T14:31:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1bbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c4fb0 con 0x7feb1414f740 2023-07-27T14:31:27.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c5290 con 0x7feb140a5850 2023-07-27T14:31:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140c0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49604/0 (socket says 172.21.15.115:49604) 2023-07-27T14:31:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 -- 172.21.15.115:0/361526488 learned_addr learned my addr 172.21.15.115:0/361526488 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1999b700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb140a5850 0x7feb140c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1a19c700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb1414f740 0x7feb14144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 -- 172.21.15.115:0/361526488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb140a5850 msgr2=0x7feb140c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb140a5850 0x7feb140c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 -- 172.21.15.115:0/361526488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb1414f740 msgr2=0x7feb14144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb1414f740 0x7feb14144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 -- 172.21.15.115:0/361526488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c009ae0 con 0x7feb140c38f0 2023-07-27T14:31:27.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.648+0000 7feb1919a700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140c0220 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7feb0400c4c0 tx=0x7feb04007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:27.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.649+0000 7feb09ffb700 1 -- 172.21.15.115:0/361526488 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400ce10 con 0x7feb140c38f0 2023-07-27T14:31:27.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.649+0000 7feb09ffb700 1 -- 172.21.15.115:0/361526488 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04007020 con 0x7feb140c38f0 2023-07-27T14:31:27.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.649+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140c5570 con 0x7feb140c38f0 2023-07-27T14:31:27.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.649+0000 7feb09ffb700 1 -- 172.21.15.115:0/361526488 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb040073c0 con 0x7feb140c38f0 2023-07-27T14:31:27.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.649+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1414cc90 con 0x7feb140c38f0 2023-07-27T14:31:27.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.650+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb140c5a90 con 0x7feb140c38f0 2023-07-27T14:31:27.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.651+0000 7feb09ffb700 1 -- 172.21.15.115:0/361526488 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7feb04010070 con 0x7feb140c38f0 2023-07-27T14:31:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.651+0000 7feb09ffb700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feaf805f1c0 0x7feaf8061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.651+0000 7feb09ffb700 1 -- 172.21.15.115:0/361526488 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feb04079410 con 0x7feb140c38f0 2023-07-27T14:31:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.652+0000 7feb1999b700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feaf805f1c0 0x7feaf8061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:27.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.652+0000 7feb1999b700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feaf805f1c0 0x7feaf8061680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7feb140a9560 tx=0x7feb10009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:27.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.655+0000 7feb09ffb700 1 -- 172.21.15.115:0/361526488 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb040478f0 con 0x7feb140c38f0 2023-07-27T14:31:27.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.854+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000313812", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7feb1406c470 con 0x7feaf805f1c0 2023-07-27T14:31:27.892 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:27.861+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:27.893 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:27.861+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:27.893 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:27.861+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:27.893 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:27.861+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:27.893 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:27.861+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:27.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.896+0000 7feb09ffb700 1 -- 172.21.15.115:0/361526488 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7feb1406c470 con 0x7feaf805f1c0 2023-07-27T14:31:27.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feaf805f1c0 msgr2=0x7feaf8061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feaf805f1c0 0x7feaf8061680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7feb140a9560 tx=0x7feb10009060).stop 2023-07-27T14:31:27.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 msgr2=0x7feb140c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:27.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140c0220 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7feb0400c4c0 tx=0x7feb04007dd0).stop 2023-07-27T14:31:27.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 shutdown_connections 2023-07-27T14:31:27.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feaf805f1c0 0x7feaf8061680 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb1414f740 0x7feb14144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb140a5850 0x7feb140c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 --2- 172.21.15.115:0/361526488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb140c38f0 0x7feb140c0220 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 >> 172.21.15.115:0/361526488 conn(0x7feb14062320 msgr2=0x7feb1414d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 shutdown_connections 2023-07-27T14:31:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:27.898+0000 7feb1bbff700 1 -- 172.21.15.115:0/361526488 wait complete. 2023-07-27T14:31:27.947 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000313812 2023-07-27T14:31:28.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.107+0000 7fd8a3bff700 1 Processor -- start 2023-07-27T14:31:28.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.107+0000 7fd8a3bff700 1 -- start start 2023-07-27T14:31:28.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.108+0000 7fd8a3bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd89c14b1e0 0x7fd89c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:28.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.108+0000 7fd8a3bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c1553f0 con 0x7fd89c063260 2023-07-27T14:31:28.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.108+0000 7fd8a3bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c157a50 con 0x7fd89c14ae00 2023-07-27T14:31:28.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.108+0000 7fd8a3bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c157d10 con 0x7fd89c14b1e0 2023-07-27T14:31:28.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.108+0000 7fd8a119a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd89c063260 0x7fd89c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41542/0 (socket says 172.21.15.115:41542) 2023-07-27T14:31:28.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.108+0000 7fd8a119a700 1 -- 172.21.15.115:0/3970659711 learned_addr learned my addr 172.21.15.115:0/3970659711 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:28.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.109+0000 7fd8a219c700 1 --2- 172.21.15.115:0/3970659711 >> v2:172.21.15.159:3300/0 conn(0x7fd89c14b1e0 0x7fd89c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:28.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.109+0000 7fd8a0999700 1 -- 172.21.15.115:0/3970659711 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463382571 0 0) 0x7fd89c1553f0 con 0x7fd89c063260 2023-07-27T14:31:28.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.109+0000 7fd8a0999700 1 -- 172.21.15.115:0/3970659711 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8880033f0 con 0x7fd89c063260 2023-07-27T14:31:28.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.109+0000 7fd8a219c700 1 -- 172.21.15.115:0/3970659711 >> v1:172.21.15.159:6789/0 conn(0x7fd89c14ae00 legacy=0x7fd89c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:28.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.109+0000 7fd8a219c700 1 -- 172.21.15.115:0/3970659711 >> v1:172.21.15.115:6789/0 conn(0x7fd89c063260 legacy=0x7fd89c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:28.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.109+0000 7fd8a219c700 1 -- 172.21.15.115:0/3970659711 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c157ff0 con 0x7fd89c14b1e0 2023-07-27T14:31:28.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.109+0000 7fd8a219c700 1 --2- 172.21.15.115:0/3970659711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 0x7fd89c154f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fd894009e60 tx=0x7fd894009780).ready entity=mon.1 client_cookie=fb5452a3ccada358 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:28.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.109+0000 7fd8a0999700 1 -- 172.21.15.115:0/3970659711 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400e070 con 0x7fd89c14b1e0 2023-07-27T14:31:28.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a0999700 1 -- 172.21.15.115:0/3970659711 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400bb60 con 0x7fd89c14b1e0 2023-07-27T14:31:28.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a0999700 1 -- 172.21.15.115:0/3970659711 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894012410 con 0x7fd89c14b1e0 2023-07-27T14:31:28.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a3bff700 1 -- 172.21.15.115:0/3970659711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 msgr2=0x7fd89c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:28.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a3bff700 1 --2- 172.21.15.115:0/3970659711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 0x7fd89c154f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fd894009e60 tx=0x7fd894009780).stop 2023-07-27T14:31:28.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a3bff700 1 -- 172.21.15.115:0/3970659711 shutdown_connections 2023-07-27T14:31:28.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a3bff700 1 --2- 172.21.15.115:0/3970659711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 0x7fd89c154f00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:28.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a3bff700 1 -- 172.21.15.115:0/3970659711 >> 172.21.15.115:0/3970659711 conn(0x7fd89c05e940 msgr2=0x7fd89c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:28.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a3bff700 1 -- 172.21.15.115:0/3970659711 shutdown_connections 2023-07-27T14:31:28.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.110+0000 7fd8a3bff700 1 -- 172.21.15.115:0/3970659711 wait complete. 2023-07-27T14:31:28.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.112+0000 7fd8a3bff700 1 Processor -- start 2023-07-27T14:31:28.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.112+0000 7fd8a3bff700 1 -- start start 2023-07-27T14:31:28.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a3bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c063260 0x7fd89c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:28.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a3bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c14ae00 0x7fd89c14a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:28.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a3bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 0x7fd89c0c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:28.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a3bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0aebe0 con 0x7fd89c14ae00 2023-07-27T14:31:28.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a3bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0adfd0 con 0x7fd89c14b1e0 2023-07-27T14:31:28.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a3bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0ae2b0 con 0x7fd89c063260 2023-07-27T14:31:28.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a119a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c14ae00 0x7fd89c14a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:28.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a119a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c14ae00 0x7fd89c14a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49636/0 (socket says 172.21.15.115:49636) 2023-07-27T14:31:28.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a119a700 1 -- 172.21.15.115:0/2078238615 learned_addr learned my addr 172.21.15.115:0/2078238615 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:28.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a199b700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c063260 0x7fd89c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:28.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a219c700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 0x7fd89c0c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:28.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a119a700 1 -- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c063260 msgr2=0x7fd89c0c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a119a700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c063260 0x7fd89c0c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a119a700 1 -- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 msgr2=0x7fd89c0c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a119a700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 0x7fd89c0c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a119a700 1 -- 172.21.15.115:0/2078238615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894009a20 con 0x7fd89c14ae00 2023-07-27T14:31:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.113+0000 7fd8a219c700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 0x7fd89c0c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.114+0000 7fd8a119a700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c14ae00 0x7fd89c14a540 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fd88c00c420 tx=0x7fd88c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.114+0000 7fd891ffb700 1 -- 172.21.15.115:0/2078238615 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0072e0 con 0x7fd89c14ae00 2023-07-27T14:31:28.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.114+0000 7fd891ffb700 1 -- 172.21.15.115:0/2078238615 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c007440 con 0x7fd89c14ae00 2023-07-27T14:31:28.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.114+0000 7fd891ffb700 1 -- 172.21.15.115:0/2078238615 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0057a0 con 0x7fd89c14ae00 2023-07-27T14:31:28.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.114+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c0ae590 con 0x7fd89c14ae00 2023-07-27T14:31:28.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.114+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c0adb60 con 0x7fd89c14ae00 2023-07-27T14:31:28.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.115+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c0add80 con 0x7fd89c14ae00 2023-07-27T14:31:28.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.116+0000 7fd891ffb700 1 -- 172.21.15.115:0/2078238615 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 75842+0+0 (secure 0 0 0) 0x7fd88c010070 con 0x7fd89c14ae00 2023-07-27T14:31:28.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.116+0000 7fd891ffb700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88005f1c0 0x7fd880061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:28.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.117+0000 7fd891ffb700 1 -- 172.21.15.115:0/2078238615 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd88c079930 con 0x7fd89c14ae00 2023-07-27T14:31:28.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.117+0000 7fd8a199b700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88005f1c0 0x7fd880061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:28.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.117+0000 7fd8a199b700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88005f1c0 0x7fd880061680 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fd8980036d0 tx=0x7fd898009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:28.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.120+0000 7fd891ffb700 1 -- 172.21.15.115:0/2078238615 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd88c04a990 con 0x7fd89c14ae00 2023-07-27T14:31:28.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.321+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000313812", "target": ["mon-mgr", ""]}) v1 -- 0x7fd89c0c8520 con 0x7fd88005f1c0 2023-07-27T14:31:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.326+0000 7fd891ffb700 1 -- 172.21.15.115:0/2078238615 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fd89c0c8520 con 0x7fd88005f1c0 2023-07-27T14:31:28.358 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac 2023-07-27T14:31:28.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88005f1c0 msgr2=0x7fd880061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:28.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88005f1c0 0x7fd880061680 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fd8980036d0 tx=0x7fd898009040).stop 2023-07-27T14:31:28.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c14ae00 msgr2=0x7fd89c14a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c14ae00 0x7fd89c14a540 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fd88c00c420 tx=0x7fd88c007c50).stop 2023-07-27T14:31:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 shutdown_connections 2023-07-27T14:31:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88005f1c0 0x7fd880061680 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c14b1e0 0x7fd89c0c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c063260 0x7fd89c0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 --2- 172.21.15.115:0/2078238615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c14ae00 0x7fd89c14a540 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:28.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 >> 172.21.15.115:0/2078238615 conn(0x7fd89c05e940 msgr2=0x7fd89c156200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:28.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.328+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 shutdown_connections 2023-07-27T14:31:28.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:28.329+0000 7fd8a3bff700 1 -- 172.21.15.115:0/2078238615 wait complete. 2023-07-27T14:31:28.377 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000313812 with 200 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac 2023-07-27T14:31:28.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.378 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.449 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.449 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.449 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164459 s, 63.8 MB/s 2023-07-27T14:31:28.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.451 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.512 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.513 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.513 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148545 s, 70.6 MB/s 2023-07-27T14:31:28.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.515 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.575 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.576 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.576 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134891 s, 77.7 MB/s 2023-07-27T14:31:28.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.577 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.638 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.639 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.639 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145395 s, 72.1 MB/s 2023-07-27T14:31:28.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.640 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.704 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.704 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.704 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168961 s, 62.1 MB/s 2023-07-27T14:31:28.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.706 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.765 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.765 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.766 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129625 s, 80.9 MB/s 2023-07-27T14:31:28.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.767 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.828 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.828 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.828 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149353 s, 70.2 MB/s 2023-07-27T14:31:28.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.830 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.896 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.897 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.897 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202 s, 51.9 MB/s 2023-07-27T14:31:28.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.898 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:28.964 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:28.964 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:28.964 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018731 s, 56.0 MB/s 2023-07-27T14:31:28.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:28.966 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.025 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.025 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.025 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130868 s, 80.1 MB/s 2023-07-27T14:31:29.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.027 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.089 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.089 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.089 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164941 s, 63.6 MB/s 2023-07-27T14:31:29.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.091 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.152 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.153 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.153 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164202 s, 63.9 MB/s 2023-07-27T14:31:29.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.155 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.217 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.217 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.217 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148178 s, 70.8 MB/s 2023-07-27T14:31:29.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.218 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.280 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.280 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.280 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161084 s, 65.1 MB/s 2023-07-27T14:31:29.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.282 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.349 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.349 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.350 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019499 s, 53.8 MB/s 2023-07-27T14:31:29.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.350 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.410 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.410 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.410 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130219 s, 80.5 MB/s 2023-07-27T14:31:29.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.411 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:31:29.461 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:31:29.476 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.477 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.477 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185088 s, 56.7 MB/s 2023-07-27T14:31:29.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.479 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.579 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.580 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145862 s, 71.9 MB/s 2023-07-27T14:31:29.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.581 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.683 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.683 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.683 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130753 s, 80.2 MB/s 2023-07-27T14:31:29.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.685 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.748 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.748 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.748 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016799 s, 62.4 MB/s 2023-07-27T14:31:29.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.749 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.809 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.810 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.810 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137588 s, 76.2 MB/s 2023-07-27T14:31:29.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.811 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.875 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.875 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156009 s, 67.2 MB/s 2023-07-27T14:31:29.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.877 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:29.941 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:29.942 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:29.942 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164486 s, 63.7 MB/s 2023-07-27T14:31:29.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:29.944 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.004 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.005 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.005 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143517 s, 73.1 MB/s 2023-07-27T14:31:30.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.006 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.072 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.073 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.073 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196483 s, 53.4 MB/s 2023-07-27T14:31:30.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.075 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.139 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.139 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.139 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169051 s, 62.0 MB/s 2023-07-27T14:31:30.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.141 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.206 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.206 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.206 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168906 s, 62.1 MB/s 2023-07-27T14:31:30.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.207 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.269 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.269 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.269 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147493 s, 71.1 MB/s 2023-07-27T14:31:30.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.271 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.331 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.332 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.332 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144299 s, 72.7 MB/s 2023-07-27T14:31:30.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.333 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.393 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141364 s, 74.2 MB/s 2023-07-27T14:31:30.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.395 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.456 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.456 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.456 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140348 s, 74.7 MB/s 2023-07-27T14:31:30.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.457 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142063 s, 73.8 MB/s 2023-07-27T14:31:30.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.519 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.581 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.581 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.581 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148209 s, 70.8 MB/s 2023-07-27T14:31:30.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.582 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.646 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.646 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.646 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016909 s, 62.0 MB/s 2023-07-27T14:31:30.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.647 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.709 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.709 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.709 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133973 s, 78.3 MB/s 2023-07-27T14:31:30.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.710 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.771 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.771 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.771 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144887 s, 72.4 MB/s 2023-07-27T14:31:30.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.773 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.837 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.837 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.838 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171573 s, 61.1 MB/s 2023-07-27T14:31:30.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.839 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.899 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.900 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.900 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138655 s, 75.6 MB/s 2023-07-27T14:31:30.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.901 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:30.961 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:30.962 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:30.962 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135124 s, 77.6 MB/s 2023-07-27T14:31:30.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:30.963 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.026 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.026 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.026 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155276 s, 67.5 MB/s 2023-07-27T14:31:31.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.028 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.089 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.089 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.089 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149548 s, 70.1 MB/s 2023-07-27T14:31:31.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.091 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.151 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.152 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.152 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146733 s, 71.5 MB/s 2023-07-27T14:31:31.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.155 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.220 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.234 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.234 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177649 s, 59.0 MB/s 2023-07-27T14:31:31.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.236 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.300 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.300 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.300 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158477 s, 66.2 MB/s 2023-07-27T14:31:31.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.301 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.364 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.364 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.364 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158713 s, 66.1 MB/s 2023-07-27T14:31:31.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.366 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126263 s, 83.0 MB/s 2023-07-27T14:31:31.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.427 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.488 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.489 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.489 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144294 s, 72.7 MB/s 2023-07-27T14:31:31.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.490 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.552 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.552 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.552 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015103 s, 69.4 MB/s 2023-07-27T14:31:31.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.554 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.614 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.614 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.614 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013725 s, 76.4 MB/s 2023-07-27T14:31:31.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.615 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.680 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.680 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.680 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017326 s, 60.5 MB/s 2023-07-27T14:31:31.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.682 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.746 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.747 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.747 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179133 s, 58.5 MB/s 2023-07-27T14:31:31.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.748 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.811 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.811 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.811 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156615 s, 67.0 MB/s 2023-07-27T14:31:31.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.813 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148181 s, 70.8 MB/s 2023-07-27T14:31:31.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.876 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:31.936 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:31.937 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137276 s, 76.4 MB/s 2023-07-27T14:31:31.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:31.939 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.001 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.002 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.002 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163852 s, 64.0 MB/s 2023-07-27T14:31:32.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.003 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.064 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.065 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.065 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146037 s, 71.8 MB/s 2023-07-27T14:31:32.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.066 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.140 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.140 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.140 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180288 s, 58.2 MB/s 2023-07-27T14:31:32.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.141 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.201 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.201 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.201 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130643 s, 80.3 MB/s 2023-07-27T14:31:32.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.202 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.261 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.262 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.262 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124152 s, 84.5 MB/s 2023-07-27T14:31:32.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.263 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.323 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.324 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.324 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134344 s, 78.1 MB/s 2023-07-27T14:31:32.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.325 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154167 s, 68.0 MB/s 2023-07-27T14:31:32.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.389 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.449 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.449 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.450 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141606 s, 74.0 MB/s 2023-07-27T14:31:32.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.451 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.513 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.513 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.514 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149673 s, 70.1 MB/s 2023-07-27T14:31:32.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.516 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.578 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152696 s, 68.7 MB/s 2023-07-27T14:31:32.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.581 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.646 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.646 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.647 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167537 s, 62.6 MB/s 2023-07-27T14:31:32.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.649 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.711 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.711 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.711 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140421 s, 74.7 MB/s 2023-07-27T14:31:32.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.713 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.775 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.775 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.775 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148853 s, 70.4 MB/s 2023-07-27T14:31:32.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.777 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.838 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.838 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.838 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135907 s, 77.2 MB/s 2023-07-27T14:31:32.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.840 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.903 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.903 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.903 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164718 s, 63.7 MB/s 2023-07-27T14:31:32.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.905 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156063 s, 67.2 MB/s 2023-07-27T14:31:32.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:32.969 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158334 s, 66.2 MB/s 2023-07-27T14:31:33.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.035 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.101 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.101 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.101 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186636 s, 56.2 MB/s 2023-07-27T14:31:33.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.102 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.162 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.162 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.163 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130006 s, 80.7 MB/s 2023-07-27T14:31:33.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.165 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.231 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.232 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.232 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198127 s, 52.9 MB/s 2023-07-27T14:31:33.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.234 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.297 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.297 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.297 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131983 s, 79.4 MB/s 2023-07-27T14:31:33.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.299 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.363 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.364 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.364 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182536 s, 57.4 MB/s 2023-07-27T14:31:33.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.365 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.425 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.426 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.426 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132673 s, 79.0 MB/s 2023-07-27T14:31:33.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.427 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.488 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.489 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142457 s, 73.6 MB/s 2023-07-27T14:31:33.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.490 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.552 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158191 s, 66.3 MB/s 2023-07-27T14:31:33.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.554 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.614 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.615 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.615 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141136 s, 74.3 MB/s 2023-07-27T14:31:33.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.616 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.678 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.679 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.679 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150702 s, 69.6 MB/s 2023-07-27T14:31:33.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.681 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.741 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.742 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.742 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133966 s, 78.3 MB/s 2023-07-27T14:31:33.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.745 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.809 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.810 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.810 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170919 s, 61.3 MB/s 2023-07-27T14:31:33.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.812 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.873 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.874 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.874 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147672 s, 71.0 MB/s 2023-07-27T14:31:33.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.875 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.936 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:33.936 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:33.936 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141772 s, 74.0 MB/s 2023-07-27T14:31:33.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:33.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:33.999 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.000 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.000 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149941 s, 69.9 MB/s 2023-07-27T14:31:34.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.002 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.063 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.063 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.063 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146095 s, 71.8 MB/s 2023-07-27T14:31:34.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.066 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.129 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.129 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.129 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167546 s, 62.6 MB/s 2023-07-27T14:31:34.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.131 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180189 s, 58.2 MB/s 2023-07-27T14:31:34.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.198 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.258 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.259 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143996 s, 72.8 MB/s 2023-07-27T14:31:34.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.261 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.325 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.325 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.325 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160424 s, 65.4 MB/s 2023-07-27T14:31:34.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.327 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.388 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.388 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.388 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134804 s, 77.8 MB/s 2023-07-27T14:31:34.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.390 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.449 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.449 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.449 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012649 s, 82.9 MB/s 2023-07-27T14:31:34.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.451 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.511 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.511 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.512 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143822 s, 72.9 MB/s 2023-07-27T14:31:34.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.513 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.572 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.572 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.572 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125569 s, 83.5 MB/s 2023-07-27T14:31:34.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.574 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.637 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.637 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.637 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169436 s, 61.9 MB/s 2023-07-27T14:31:34.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.699 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.700 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.700 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013873 s, 75.6 MB/s 2023-07-27T14:31:34.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.701 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.760 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.761 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.761 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131089 s, 80.0 MB/s 2023-07-27T14:31:34.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.762 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.823 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.823 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.824 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140909 s, 74.4 MB/s 2023-07-27T14:31:34.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.825 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.885 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.886 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.886 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141188 s, 74.3 MB/s 2023-07-27T14:31:34.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.888 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:34.950 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:34.950 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:34.950 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150538 s, 69.7 MB/s 2023-07-27T14:31:34.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:34.952 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.011 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127928 s, 82.0 MB/s 2023-07-27T14:31:35.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.013 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.072 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.073 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132013 s, 79.4 MB/s 2023-07-27T14:31:35.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.074 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.133 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.134 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.134 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130077 s, 80.6 MB/s 2023-07-27T14:31:35.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.135 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.196 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.197 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.197 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150939 s, 69.5 MB/s 2023-07-27T14:31:35.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.198 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.260 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014737 s, 71.2 MB/s 2023-07-27T14:31:35.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.261 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.320 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.321 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.321 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132026 s, 79.4 MB/s 2023-07-27T14:31:35.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.323 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012063 s, 86.9 MB/s 2023-07-27T14:31:35.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.384 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.445 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.445 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.445 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146872 s, 71.4 MB/s 2023-07-27T14:31:35.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.447 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.509 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.509 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.509 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151553 s, 69.2 MB/s 2023-07-27T14:31:35.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.511 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.571 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.572 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.572 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142887 s, 73.4 MB/s 2023-07-27T14:31:35.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.574 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.635 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149521 s, 70.1 MB/s 2023-07-27T14:31:35.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.637 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.700 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.701 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.701 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157677 s, 66.5 MB/s 2023-07-27T14:31:35.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.702 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.761 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.762 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.762 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132085 s, 79.4 MB/s 2023-07-27T14:31:35.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.763 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.824 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142562 s, 73.6 MB/s 2023-07-27T14:31:35.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.826 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.895 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.895 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.896 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228472 s, 45.9 MB/s 2023-07-27T14:31:35.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.897 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:35.959 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:35.959 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:35.960 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141472 s, 74.1 MB/s 2023-07-27T14:31:35.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:35.961 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.021 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.021 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.021 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133466 s, 78.6 MB/s 2023-07-27T14:31:36.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.025 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.087 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.087 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.087 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154097 s, 68.0 MB/s 2023-07-27T14:31:36.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.089 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.152 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.152 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.153 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143589 s, 73.0 MB/s 2023-07-27T14:31:36.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.155 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135373 s, 77.5 MB/s 2023-07-27T14:31:36.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.218 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.280 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.280 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.280 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145339 s, 72.1 MB/s 2023-07-27T14:31:36.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.282 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.341 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.341 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.341 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126598 s, 82.8 MB/s 2023-07-27T14:31:36.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.343 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.405 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.406 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.406 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015443 s, 67.9 MB/s 2023-07-27T14:31:36.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.407 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.468 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.468 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.468 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140303 s, 74.7 MB/s 2023-07-27T14:31:36.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.470 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.532 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143577 s, 73.0 MB/s 2023-07-27T14:31:36.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.534 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.597 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.597 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131896 s, 79.5 MB/s 2023-07-27T14:31:36.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.598 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.660 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.661 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.661 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153998 s, 68.1 MB/s 2023-07-27T14:31:36.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.662 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.723 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.724 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.724 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143772 s, 72.9 MB/s 2023-07-27T14:31:36.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.725 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.790 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.790 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.790 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178741 s, 58.7 MB/s 2023-07-27T14:31:36.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.791 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013363 s, 78.5 MB/s 2023-07-27T14:31:36.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.854 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.914 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.915 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014913 s, 70.3 MB/s 2023-07-27T14:31:36.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.916 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:36.978 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:36.979 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:36.979 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150575 s, 69.6 MB/s 2023-07-27T14:31:36.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:36.980 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.043 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.043 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.044 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156147 s, 67.2 MB/s 2023-07-27T14:31:37.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.045 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.112 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.112 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.113 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143623 s, 73.0 MB/s 2023-07-27T14:31:37.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.115 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.175 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131754 s, 79.6 MB/s 2023-07-27T14:31:37.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.177 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.238 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.238 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.238 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146955 s, 71.4 MB/s 2023-07-27T14:31:37.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.240 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.301 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.302 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015189 s, 69.0 MB/s 2023-07-27T14:31:37.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.303 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.364 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.364 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.364 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145329 s, 72.2 MB/s 2023-07-27T14:31:37.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.366 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128618 s, 81.5 MB/s 2023-07-27T14:31:37.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.429 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.490 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.491 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.491 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147002 s, 71.3 MB/s 2023-07-27T14:31:37.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.493 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.554 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.555 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.555 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129614 s, 80.9 MB/s 2023-07-27T14:31:37.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.556 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.620 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.620 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.622 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167764 s, 62.5 MB/s 2023-07-27T14:31:37.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.623 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.686 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.686 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.686 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159942 s, 65.6 MB/s 2023-07-27T14:31:37.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.687 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.747 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.747 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.747 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132635 s, 79.1 MB/s 2023-07-27T14:31:37.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.748 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.808 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.809 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.809 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136979 s, 76.6 MB/s 2023-07-27T14:31:37.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.810 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.872 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.873 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.873 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152918 s, 68.6 MB/s 2023-07-27T14:31:37.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.874 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.935 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.935 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.935 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146424 s, 71.6 MB/s 2023-07-27T14:31:37.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:37.998 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146626 s, 71.5 MB/s 2023-07-27T14:31:37.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:37.999 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.059 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.059 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.059 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134155 s, 78.2 MB/s 2023-07-27T14:31:38.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.061 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.122 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.123 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.123 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149699 s, 70.0 MB/s 2023-07-27T14:31:38.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.124 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133397 s, 78.6 MB/s 2023-07-27T14:31:38.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.186 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.246 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.246 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.246 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132393 s, 79.2 MB/s 2023-07-27T14:31:38.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.248 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.308 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.309 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.309 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142878 s, 73.4 MB/s 2023-07-27T14:31:38.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.310 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.375 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.375 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183689 s, 57.1 MB/s 2023-07-27T14:31:38.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.376 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.437 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.437 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.437 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141861 s, 73.9 MB/s 2023-07-27T14:31:38.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.438 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.500 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.500 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.500 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155771 s, 67.3 MB/s 2023-07-27T14:31:38.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.501 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.562 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.562 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.562 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143789 s, 72.9 MB/s 2023-07-27T14:31:38.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.564 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.625 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.625 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.625 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147854 s, 70.9 MB/s 2023-07-27T14:31:38.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.627 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.688 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.688 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141789 s, 74.0 MB/s 2023-07-27T14:31:38.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.689 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.751 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.751 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.752 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155297 s, 67.5 MB/s 2023-07-27T14:31:38.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.753 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.815 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.816 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.816 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151237 s, 69.3 MB/s 2023-07-27T14:31:38.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.817 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.879 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.879 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.880 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154768 s, 67.8 MB/s 2023-07-27T14:31:38.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.881 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:38.942 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:38.943 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:38.943 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145378 s, 72.1 MB/s 2023-07-27T14:31:38.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:38.944 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.007 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.007 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.008 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164868 s, 63.6 MB/s 2023-07-27T14:31:39.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.009 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.071 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.071 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.071 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152777 s, 68.6 MB/s 2023-07-27T14:31:39.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.072 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.131 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.131 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.132 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127575 s, 82.2 MB/s 2023-07-27T14:31:39.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.133 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.194 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.194 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.195 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148759 s, 70.5 MB/s 2023-07-27T14:31:39.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.196 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.258 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.258 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.258 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158347 s, 66.2 MB/s 2023-07-27T14:31:39.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.260 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.319 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.319 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.320 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129051 s, 81.3 MB/s 2023-07-27T14:31:39.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.321 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.387 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195909 s, 53.5 MB/s 2023-07-27T14:31:39.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.389 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.450 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.451 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.451 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150832 s, 69.5 MB/s 2023-07-27T14:31:39.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.453 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.516 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.517 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.517 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174483 s, 60.1 MB/s 2023-07-27T14:31:39.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.518 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.579 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.580 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.580 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132641 s, 79.1 MB/s 2023-07-27T14:31:39.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.581 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.643 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.643 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.644 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159117 s, 65.9 MB/s 2023-07-27T14:31:39.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.645 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.708 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.709 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.709 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157599 s, 66.5 MB/s 2023-07-27T14:31:39.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.710 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.772 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.773 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.773 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015747 s, 66.6 MB/s 2023-07-27T14:31:39.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.774 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.839 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.840 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.840 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179272 s, 58.5 MB/s 2023-07-27T14:31:39.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.841 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.907 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.907 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.907 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189609 s, 55.3 MB/s 2023-07-27T14:31:39.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.908 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:39.974 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:39.975 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:39.975 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192862 s, 54.4 MB/s 2023-07-27T14:31:39.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:39.976 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139315 s, 75.3 MB/s 2023-07-27T14:31:40.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.039 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.106 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.106 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193891 s, 54.1 MB/s 2023-07-27T14:31:40.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.107 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.168 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.168 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.168 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137315 s, 76.4 MB/s 2023-07-27T14:31:40.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.170 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.230 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.231 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.231 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147712 s, 71.0 MB/s 2023-07-27T14:31:40.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.232 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.294 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.294 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.294 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142843 s, 73.4 MB/s 2023-07-27T14:31:40.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.295 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.357 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.357 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.358 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146672 s, 71.5 MB/s 2023-07-27T14:31:40.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.359 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.420 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149814 s, 70.0 MB/s 2023-07-27T14:31:40.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.422 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170535 s, 61.5 MB/s 2023-07-27T14:31:40.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.488 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.548 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.549 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.549 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139173 s, 75.3 MB/s 2023-07-27T14:31:40.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.550 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.612 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.613 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.613 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156698 s, 66.9 MB/s 2023-07-27T14:31:40.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.614 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.675 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.675 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.675 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01452 s, 72.2 MB/s 2023-07-27T14:31:40.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.677 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.740 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.740 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.740 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165283 s, 63.4 MB/s 2023-07-27T14:31:40.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.742 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.806 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.806 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.806 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162767 s, 64.4 MB/s 2023-07-27T14:31:40.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.808 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.871 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.871 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.872 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146135 s, 71.8 MB/s 2023-07-27T14:31:40.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.874 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.934 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.935 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.935 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135092 s, 77.6 MB/s 2023-07-27T14:31:40.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:40.997 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:40.997 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:40.998 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137598 s, 76.2 MB/s 2023-07-27T14:31:40.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:40.999 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:41.060 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:41.061 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:41.061 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137376 s, 76.3 MB/s 2023-07-27T14:31:41.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:41.063 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:41.123 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:41.123 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:41.123 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135256 s, 77.5 MB/s 2023-07-27T14:31:41.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:41.125 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:41.185 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142264 s, 73.7 MB/s 2023-07-27T14:31:41.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:41.187 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000313812/9cf95c32-b012-4e94-8a49-4a3fddf4fdac/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:31:41.250 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:31:41.251 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:31:41.251 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170185 s, 61.6 MB/s 2023-07-27T14:31:41.252 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000313812 snapshot_0000000000764682 2023-07-27T14:31:41.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.413+0000 7f2a3a9ff700 1 Processor -- start 2023-07-27T14:31:41.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.413+0000 7f2a3a9ff700 1 -- start start 2023-07-27T14:31:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a3a9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a34063260 0x7f2a34154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a3a9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 0x7f2a340a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a3a9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a341553f0 con 0x7f2a3414ae00 2023-07-27T14:31:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a3a9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a34157a50 con 0x7f2a34063260 2023-07-27T14:31:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a3a9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a34157d10 con 0x7f2a3414b1e0 2023-07-27T14:31:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a337fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a34063260 0x7f2a34154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a337fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a34063260 0x7f2a34154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46698/0 (socket says 172.21.15.115:46698) 2023-07-27T14:31:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a337fe700 1 -- 172.21.15.115:0/3622462314 learned_addr learned my addr 172.21.15.115:0/3622462314 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a38f9c700 1 --2- 172.21.15.115:0/3622462314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 0x7f2a340a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a337fe700 1 -- 172.21.15.115:0/3622462314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 msgr2=0x7f2a340a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a337fe700 1 --2- 172.21.15.115:0/3622462314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 0x7f2a340a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a337fe700 1 -- 172.21.15.115:0/3622462314 >> v1:172.21.15.159:6789/0 conn(0x7f2a3414ae00 legacy=0x7f2a34062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.415+0000 7f2a337fe700 1 -- 172.21.15.115:0/3622462314 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34157ff0 con 0x7f2a34063260 2023-07-27T14:31:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a337fe700 1 --2- 172.21.15.115:0/3622462314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34154f00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f2a20006fd0 tx=0x7f2a200090f0).ready entity=mon.0 client_cookie=accd922ea53ccb62 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a32ffd700 1 -- 172.21.15.115:0/3622462314 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000b600 con 0x7f2a34063260 2023-07-27T14:31:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a32ffd700 1 -- 172.21.15.115:0/3622462314 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2000b760 con 0x7f2a34063260 2023-07-27T14:31:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a32ffd700 1 -- 172.21.15.115:0/3622462314 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000bae0 con 0x7f2a34063260 2023-07-27T14:31:41.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3622462314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 msgr2=0x7f2a34154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3622462314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34154f00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f2a20006fd0 tx=0x7f2a200090f0).stop 2023-07-27T14:31:41.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3622462314 shutdown_connections 2023-07-27T14:31:41.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3622462314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 0x7f2a340a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3622462314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34154f00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3622462314 >> 172.21.15.115:0/3622462314 conn(0x7f2a3405e940 msgr2=0x7f2a340cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:41.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.416+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3622462314 shutdown_connections 2023-07-27T14:31:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.417+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3622462314 wait complete. 2023-07-27T14:31:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.418+0000 7f2a3a9ff700 1 Processor -- start 2023-07-27T14:31:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.418+0000 7f2a3a9ff700 1 -- start start 2023-07-27T14:31:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a3a9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a3a9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3414ae00 0x7f2a340af800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a3a9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 0x7f2a340c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a3a9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340b0050 con 0x7f2a34063260 2023-07-27T14:31:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a3a9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340ae5f0 con 0x7f2a3414ae00 2023-07-27T14:31:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a3a9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340add00 con 0x7f2a3414b1e0 2023-07-27T14:31:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34148f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46704/0 (socket says 172.21.15.115:46704) 2023-07-27T14:31:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a33fff700 1 -- 172.21.15.115:0/3479134756 learned_addr learned my addr 172.21.15.115:0/3479134756 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a337fe700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3414ae00 0x7f2a340af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.419+0000 7f2a38f9c700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 0x7f2a340c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a33fff700 1 -- 172.21.15.115:0/3479134756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 msgr2=0x7f2a340c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a33fff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 0x7f2a340c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a33fff700 1 -- 172.21.15.115:0/3479134756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3414ae00 msgr2=0x7f2a340af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a33fff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3414ae00 0x7f2a340af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a33fff700 1 -- 172.21.15.115:0/3479134756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20009370 con 0x7f2a34063260 2023-07-27T14:31:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a33fff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34148f20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f2a2400c4c0 tx=0x7f2a24007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a2bfff700 1 -- 172.21.15.115:0/3479134756 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24007020 con 0x7f2a34063260 2023-07-27T14:31:41.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a2bfff700 1 -- 172.21.15.115:0/3479134756 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a24001e90 con 0x7f2a34063260 2023-07-27T14:31:41.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a2bfff700 1 -- 172.21.15.115:0/3479134756 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240073d0 con 0x7f2a34063260 2023-07-27T14:31:41.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a340adfa0 con 0x7f2a34063260 2023-07-27T14:31:41.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.420+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a340afcf0 con 0x7f2a34063260 2023-07-27T14:31:41.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.421+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3406c470 con 0x7f2a34063260 2023-07-27T14:31:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.422+0000 7f2a2bfff700 1 -- 172.21.15.115:0/3479134756 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 14) v1 ==== 75882+0+0 (secure 0 0 0) 0x7f2a24010070 con 0x7f2a34063260 2023-07-27T14:31:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.423+0000 7f2a2bfff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a1c05f210 0x7f2a1c0616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.423+0000 7f2a2bfff700 1 -- 172.21.15.115:0/3479134756 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2a24079a60 con 0x7f2a34063260 2023-07-27T14:31:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.423+0000 7f2a337fe700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a1c05f210 0x7f2a1c0616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.424+0000 7f2a337fe700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a1c05f210 0x7f2a1c0616d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f2a34063660 tx=0x7f2a20017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:41.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.427+0000 7f2a2bfff700 1 -- 172.21.15.115:0/3479134756 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a2404aa70 con 0x7f2a34063260 2023-07-27T14:31:41.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.631+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000313812", "snap_name": "snapshot_0000000000764682", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a340ca6d0 con 0x7f2a1c05f210 2023-07-27T14:31:41.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.666+0000 7f2a2bfff700 1 -- 172.21.15.115:0/3479134756 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2a340ca6d0 con 0x7f2a1c05f210 2023-07-27T14:31:41.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a1c05f210 msgr2=0x7f2a1c0616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a1c05f210 0x7f2a1c0616d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f2a34063660 tx=0x7f2a20017000).stop 2023-07-27T14:31:41.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 msgr2=0x7f2a34148f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34148f20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f2a2400c4c0 tx=0x7f2a24007e00).stop 2023-07-27T14:31:41.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 shutdown_connections 2023-07-27T14:31:41.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a1c05f210 0x7f2a1c0616d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3414b1e0 0x7f2a340c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a34063260 0x7f2a34148f20 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 --2- 172.21.15.115:0/3479134756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3414ae00 0x7f2a340af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 >> 172.21.15.115:0/3479134756 conn(0x7f2a3405e940 msgr2=0x7f2a3414a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:41.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 shutdown_connections 2023-07-27T14:31:41.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.669+0000 7f2a3a9ff700 1 -- 172.21.15.115:0/3479134756 wait complete. 2023-07-27T14:31:41.720 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-07-27T14:31:41.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.879+0000 7fd4a45ff700 1 Processor -- start 2023-07-27T14:31:41.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.879+0000 7fd4a45ff700 1 -- start start 2023-07-27T14:31:41.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.880+0000 7fd4a45ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd49c153e00 0x7fd49c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.880+0000 7fd4a45ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd49c065de0 0x7fd49c062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a45ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c064a80 con 0x7fd49c064230 2023-07-27T14:31:41.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a45ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c062320 con 0x7fd49c153e00 2023-07-27T14:31:41.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a45ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c064d60 con 0x7fd49c065de0 2023-07-27T14:31:41.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a239b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd49c153e00 0x7fd49c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a239b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd49c153e00 0x7fd49c0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46716/0 (socket says 172.21.15.115:46716) 2023-07-27T14:31:41.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a239b700 1 -- 172.21.15.115:0/916083227 learned_addr learned my addr 172.21.15.115:0/916083227 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:41.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a2b9c700 1 --2- 172.21.15.115:0/916083227 >> v2:172.21.15.159:3300/0 conn(0x7fd49c065de0 0x7fd49c062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a239b700 1 -- 172.21.15.115:0/916083227 >> v2:172.21.15.159:3300/0 conn(0x7fd49c065de0 msgr2=0x7fd49c062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:41.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a239b700 1 --2- 172.21.15.115:0/916083227 >> v2:172.21.15.159:3300/0 conn(0x7fd49c065de0 0x7fd49c062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a239b700 1 -- 172.21.15.115:0/916083227 >> v1:172.21.15.159:6789/0 conn(0x7fd49c064230 legacy=0x7fd49c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.881+0000 7fd4a239b700 1 -- 172.21.15.115:0/916083227 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c065040 con 0x7fd49c153e00 2023-07-27T14:31:41.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a239b700 1 --2- 172.21.15.115:0/916083227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c153e00 0x7fd49c0c6b70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fd49c0c5df0 tx=0x7fd4980090f0).ready entity=mon.0 client_cookie=73dc64ec455bf0f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:41.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a1399700 1 -- 172.21.15.115:0/916083227 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49800b520 con 0x7fd49c153e00 2023-07-27T14:31:41.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a1399700 1 -- 172.21.15.115:0/916083227 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49800b680 con 0x7fd49c153e00 2023-07-27T14:31:41.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a1399700 1 -- 172.21.15.115:0/916083227 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49800ba00 con 0x7fd49c153e00 2023-07-27T14:31:41.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a45ff700 1 -- 172.21.15.115:0/916083227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c153e00 msgr2=0x7fd49c0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/916083227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c153e00 0x7fd49c0c6b70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fd49c0c5df0 tx=0x7fd4980090f0).stop 2023-07-27T14:31:41.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a45ff700 1 -- 172.21.15.115:0/916083227 shutdown_connections 2023-07-27T14:31:41.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/916083227 >> v2:172.21.15.159:3300/0 conn(0x7fd49c065de0 0x7fd49c062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/916083227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c153e00 0x7fd49c0c6b70 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a45ff700 1 -- 172.21.15.115:0/916083227 >> 172.21.15.115:0/916083227 conn(0x7fd49c0c7b90 msgr2=0x7fd49c0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:41.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.882+0000 7fd4a45ff700 1 -- 172.21.15.115:0/916083227 shutdown_connections 2023-07-27T14:31:41.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.883+0000 7fd4a45ff700 1 -- 172.21.15.115:0/916083227 wait complete. 2023-07-27T14:31:41.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.884+0000 7fd4a45ff700 1 Processor -- start 2023-07-27T14:31:41.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.884+0000 7fd4a45ff700 1 -- start start 2023-07-27T14:31:41.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a45ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c064230 0x7fd49c146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a45ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c065de0 0x7fd49c0be930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a45ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd49c153e00 0x7fd49c0bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a45ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c165560 con 0x7fd49c065de0 2023-07-27T14:31:41.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a45ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c164950 con 0x7fd49c064230 2023-07-27T14:31:41.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a45ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c164c30 con 0x7fd49c153e00 2023-07-27T14:31:41.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a1b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c065de0 0x7fd49c0be930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a1b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c065de0 0x7fd49c0be930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46722/0 (socket says 172.21.15.115:46722) 2023-07-27T14:31:41.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a1b9a700 1 -- 172.21.15.115:0/2424667385 learned_addr learned my addr 172.21.15.115:0/2424667385 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:41.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a2b9c700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd49c153e00 0x7fd49c0bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.885+0000 7fd4a239b700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c064230 0x7fd49c146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4a1b9a700 1 -- 172.21.15.115:0/2424667385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd49c153e00 msgr2=0x7fd49c0bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4a1b9a700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd49c153e00 0x7fd49c0bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4a1b9a700 1 -- 172.21.15.115:0/2424667385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c064230 msgr2=0x7fd49c146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:41.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4a1b9a700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c064230 0x7fd49c146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:41.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4a1b9a700 1 -- 172.21.15.115:0/2424667385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498009370 con 0x7fd49c065de0 2023-07-27T14:31:41.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4a1b9a700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c065de0 0x7fd49c0be930 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fd48c00c4c0 tx=0x7fd48c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:41.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4927fc700 1 -- 172.21.15.115:0/2424667385 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00ce70 con 0x7fd49c065de0 2023-07-27T14:31:41.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4927fc700 1 -- 172.21.15.115:0/2424667385 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c001e90 con 0x7fd49c065de0 2023-07-27T14:31:41.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c164f10 con 0x7fd49c065de0 2023-07-27T14:31:41.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4927fc700 1 -- 172.21.15.115:0/2424667385 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c007250 con 0x7fd49c065de0 2023-07-27T14:31:41.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.886+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c1473c0 con 0x7fd49c065de0 2023-07-27T14:31:41.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.887+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c06c470 con 0x7fd49c065de0 2023-07-27T14:31:41.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.888+0000 7fd4927fc700 1 -- 172.21.15.115:0/2424667385 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 14) v1 ==== 75882+0+0 (secure 0 0 0) 0x7fd48c010070 con 0x7fd49c065de0 2023-07-27T14:31:41.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.889+0000 7fd4927fc700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd48005f210 0x7fd4800616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:41.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.889+0000 7fd4927fc700 1 -- 172.21.15.115:0/2424667385 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd48c079a90 con 0x7fd49c065de0 2023-07-27T14:31:41.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.889+0000 7fd4a239b700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd48005f210 0x7fd4800616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:41.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.889+0000 7fd4a239b700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd48005f210 0x7fd4800616d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fd498009130 tx=0x7fd498017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:41.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:41.893+0000 7fd4927fc700 1 -- 172.21.15.115:0/2424667385 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd48c04aaa0 con 0x7fd49c065de0 2023-07-27T14:31:42.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.085+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7fd49c0c1490 con 0x7fd49c065de0 2023-07-27T14:31:42.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.088+0000 7fd4927fc700 1 -- 172.21.15.115:0/2424667385 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v15)=0 v15) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd48c04e0c0 con 0x7fd49c065de0 2023-07-27T14:31:42.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd48005f210 msgr2=0x7fd4800616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd48005f210 0x7fd4800616d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fd498009130 tx=0x7fd498017000).stop 2023-07-27T14:31:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c065de0 msgr2=0x7fd49c0be930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c065de0 0x7fd49c0be930 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fd48c00c4c0 tx=0x7fd48c007e00).stop 2023-07-27T14:31:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 shutdown_connections 2023-07-27T14:31:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd48005f210 0x7fd4800616d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd49c153e00 0x7fd49c0bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd49c064230 0x7fd49c146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 --2- 172.21.15.115:0/2424667385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49c065de0 0x7fd49c0be930 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 >> 172.21.15.115:0/2424667385 conn(0x7fd49c0c7b90 msgr2=0x7fd49c152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 shutdown_connections 2023-07-27T14:31:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.091+0000 7fd4a45ff700 1 -- 172.21.15.115:0/2424667385 wait complete. 2023-07-27T14:31:42.142 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000313812 snapshot_0000000000764682 clone_0000000000520718 2023-07-27T14:31:42.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.302+0000 7feb6dfff700 1 Processor -- start 2023-07-27T14:31:42.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.302+0000 7feb6dfff700 1 -- start start 2023-07-27T14:31:42.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.303+0000 7feb6dfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7feb6813a350 0x7feb68065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.303+0000 7feb6dfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb680bd9a0 con 0x7feb6813a730 2023-07-27T14:31:42.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.303+0000 7feb6dfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb68066610 con 0x7feb680c36b0 2023-07-27T14:31:42.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.303+0000 7feb6dfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb68066400 con 0x7feb6813a350 2023-07-27T14:31:42.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.303+0000 7feb66ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7feb6813a730 0x7feb680c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37942/0 (socket says 172.21.15.115:37942) 2023-07-27T14:31:42.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb66ffd700 1 -- 172.21.15.115:0/941444896 learned_addr learned my addr 172.21.15.115:0/941444896 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:42.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb677fe700 1 --2- 172.21.15.115:0/941444896 >> v2:172.21.15.159:3300/0 conn(0x7feb6813a350 0x7feb68065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036428071 0 0) 0x7feb680bd9a0 con 0x7feb6813a730 2023-07-27T14:31:42.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb500033f0 con 0x7feb6813a730 2023-07-27T14:31:42.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3027324594 0 0) 0x7feb500033f0 con 0x7feb6813a730 2023-07-27T14:31:42.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 >> v2:172.21.15.159:3300/0 conn(0x7feb6813a350 msgr2=0x7feb68065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:42.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 --2- 172.21.15.115:0/941444896 >> v2:172.21.15.159:3300/0 conn(0x7feb6813a350 0x7feb68065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 >> v1:172.21.15.159:6789/0 conn(0x7feb680c36b0 legacy=0x7feb680be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680bdc10 con 0x7feb6813a730 2023-07-27T14:31:42.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7feb5c001470 con 0x7feb6813a730 2023-07-27T14:31:42.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 >> v1:172.21.15.115:6789/0 conn(0x7feb6813a730 legacy=0x7feb680c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500038e0 0x7feb50003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb50004690 0x7feb50004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb50005000 0x7feb5000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68066400 con 0x7feb50005000 2023-07-27T14:31:42.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5000bf60 con 0x7feb50004690 2023-07-27T14:31:42.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.304+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5000c0f0 con 0x7feb500038e0 2023-07-27T14:31:42.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb677fe700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500038e0 0x7feb50003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb67fff700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb50005000 0x7feb5000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb66ffd700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb50004690 0x7feb50004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb677fe700 1 -- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb50004690 msgr2=0x7feb50004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:42.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb677fe700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb50004690 0x7feb50004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb677fe700 1 -- 172.21.15.115:0/941444896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb50005000 msgr2=0x7feb5000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:42.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb677fe700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb50005000 0x7feb5000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb677fe700 1 -- 172.21.15.115:0/941444896 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500033f0 con 0x7feb500038e0 2023-07-27T14:31:42.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb67fff700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb50005000 0x7feb5000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:42.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb67fff700 1 -- 172.21.15.115:0/941444896 reap_dead start 2023-07-27T14:31:42.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.305+0000 7feb677fe700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500038e0 0x7feb50003d00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7feb58009a80 tx=0x7feb58009060).ready entity=mon.2 client_cookie=37fdd9dd15ddcd9d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:42.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58009430 con 0x7feb500038e0 2023-07-27T14:31:42.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5800e640 con 0x7feb500038e0 2023-07-27T14:31:42.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb667fc700 1 -- 172.21.15.115:0/941444896 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800e9c0 con 0x7feb500038e0 2023-07-27T14:31:42.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb6dfff700 1 -- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500038e0 msgr2=0x7feb50003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb6dfff700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500038e0 0x7feb50003d00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7feb58009a80 tx=0x7feb58009060).stop 2023-07-27T14:31:42.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb6dfff700 1 -- 172.21.15.115:0/941444896 shutdown_connections 2023-07-27T14:31:42.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb6dfff700 1 --2- 172.21.15.115:0/941444896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500038e0 0x7feb50003d00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb6dfff700 1 -- 172.21.15.115:0/941444896 >> 172.21.15.115:0/941444896 conn(0x7feb6805e8f0 msgr2=0x7feb680c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:42.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb6dfff700 1 -- 172.21.15.115:0/941444896 shutdown_connections 2023-07-27T14:31:42.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.306+0000 7feb6dfff700 1 -- 172.21.15.115:0/941444896 wait complete. 2023-07-27T14:31:42.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.308+0000 7feb6dfff700 1 Processor -- start 2023-07-27T14:31:42.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.308+0000 7feb6dfff700 1 -- start start 2023-07-27T14:31:42.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb6dfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500038e0 0x7feb68167920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb6dfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68167e10 0x7feb680a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb6dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb680a5fd0 0x7feb681633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb6dfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c0be0 con 0x7feb500038e0 2023-07-27T14:31:42.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb6dfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68154f50 con 0x7feb68167e10 2023-07-27T14:31:42.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb6dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb68168290 con 0x7feb680a5fd0 2023-07-27T14:31:42.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb677fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500038e0 0x7feb68167920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb677fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500038e0 0x7feb68167920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46738/0 (socket says 172.21.15.115:46738) 2023-07-27T14:31:42.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb677fe700 1 -- 172.21.15.115:0/1512115358 learned_addr learned my addr 172.21.15.115:0/1512115358 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:42.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb67fff700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb680a5fd0 0x7feb681633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb66ffd700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68167e10 0x7feb680a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb677fe700 1 -- 172.21.15.115:0/1512115358 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb680a5fd0 msgr2=0x7feb681633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb677fe700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb680a5fd0 0x7feb681633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb677fe700 1 -- 172.21.15.115:0/1512115358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68167e10 msgr2=0x7feb680a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb677fe700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68167e10 0x7feb680a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.309+0000 7feb677fe700 1 -- 172.21.15.115:0/1512115358 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680a7110 con 0x7feb500038e0 2023-07-27T14:31:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.310+0000 7feb677fe700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500038e0 0x7feb68167920 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7feb580030b0 tx=0x7feb5801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.310+0000 7feb4f7fe700 1 -- 172.21.15.115:0/1512115358 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800ed30 con 0x7feb500038e0 2023-07-27T14:31:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.310+0000 7feb4f7fe700 1 -- 172.21.15.115:0/1512115358 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5800ee90 con 0x7feb500038e0 2023-07-27T14:31:42.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.310+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb680a6870 con 0x7feb500038e0 2023-07-27T14:31:42.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.310+0000 7feb4f7fe700 1 -- 172.21.15.115:0/1512115358 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580243f0 con 0x7feb500038e0 2023-07-27T14:31:42.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.310+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb680a6e30 con 0x7feb500038e0 2023-07-27T14:31:42.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.311+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6806c470 con 0x7feb500038e0 2023-07-27T14:31:42.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.312+0000 7feb4f7fe700 1 -- 172.21.15.115:0/1512115358 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 14) v1 ==== 75882+0+0 (secure 0 0 0) 0x7feb5802b030 con 0x7feb500038e0 2023-07-27T14:31:42.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.313+0000 7feb4f7fe700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb5405f210 0x7feb540616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.313+0000 7feb4f7fe700 1 -- 172.21.15.115:0/1512115358 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feb5807b650 con 0x7feb500038e0 2023-07-27T14:31:42.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.313+0000 7feb66ffd700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb5405f210 0x7feb540616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.314+0000 7feb66ffd700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb5405f210 0x7feb540616d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7feb5c000e10 tx=0x7feb5c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:42.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.317+0000 7feb4f7fe700 1 -- 172.21.15.115:0/1512115358 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb5804c600 con 0x7feb500038e0 2023-07-27T14:31:42.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.524+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000313812", "snap_name": "snapshot_0000000000764682", "target_sub_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7feb680bdef0 con 0x7feb5405f210 2023-07-27T14:31:42.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.581+0000 7feb4f7fe700 1 -- 172.21.15.115:0/1512115358 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7feb680bdef0 con 0x7feb5405f210 2023-07-27T14:31:42.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb5405f210 msgr2=0x7feb540616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb5405f210 0x7feb540616d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7feb5c000e10 tx=0x7feb5c009040).stop 2023-07-27T14:31:42.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500038e0 msgr2=0x7feb68167920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500038e0 0x7feb68167920 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7feb580030b0 tx=0x7feb5801a000).stop 2023-07-27T14:31:42.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 shutdown_connections 2023-07-27T14:31:42.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb5405f210 0x7feb540616d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb680a5fd0 0x7feb681633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500038e0 0x7feb68167920 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 --2- 172.21.15.115:0/1512115358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68167e10 0x7feb680a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 >> 172.21.15.115:0/1512115358 conn(0x7feb6805e8f0 msgr2=0x7feb680ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:42.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 shutdown_connections 2023-07-27T14:31:42.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.584+0000 7feb6dfff700 1 -- 172.21.15.115:0/1512115358 wait complete. 2023-07-27T14:31:42.622 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.589+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.622 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.589+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.623 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.589+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.623 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.589+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.623 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.589+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.640 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:42.641 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.607+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.641 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.607+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.641 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.607+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.642 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.607+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.642 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:42.607+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:42.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.803+0000 7f597b5ff700 1 Processor -- start 2023-07-27T14:31:42.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.803+0000 7f597b5ff700 1 -- start start 2023-07-27T14:31:42.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.804+0000 7f597b5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f597414ae00 0x7f5974154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.804+0000 7f597b5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f597414b1e0 0x7f5974062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.804+0000 7f597b5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59741553f0 con 0x7f59740c5c50 2023-07-27T14:31:42.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.804+0000 7f597b5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5974157a50 con 0x7f597414ae00 2023-07-27T14:31:42.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.804+0000 7f597b5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5974157d10 con 0x7f597414b1e0 2023-07-27T14:31:42.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f597939b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f597414ae00 0x7f5974154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f5979b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f59740c5c50 0x7f59740a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37948/0 (socket says 172.21.15.115:37948) 2023-07-27T14:31:42.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f597939b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f597414ae00 0x7f5974154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46790/0 (socket says 172.21.15.115:46790) 2023-07-27T14:31:42.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f5979b9c700 1 -- 172.21.15.115:0/4055458771 learned_addr learned my addr 172.21.15.115:0/4055458771 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:42.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f5978b9a700 1 --2- 172.21.15.115:0/4055458771 >> v2:172.21.15.159:3300/0 conn(0x7f597414b1e0 0x7f5974062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f597939b700 1 -- 172.21.15.115:0/4055458771 >> v2:172.21.15.159:3300/0 conn(0x7f597414b1e0 msgr2=0x7f5974062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:42.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f597939b700 1 --2- 172.21.15.115:0/4055458771 >> v2:172.21.15.159:3300/0 conn(0x7f597414b1e0 0x7f5974062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f597939b700 1 -- 172.21.15.115:0/4055458771 >> v1:172.21.15.115:6789/0 conn(0x7f59740c5c50 legacy=0x7f59740a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f596bfff700 1 -- 172.21.15.115:0/4055458771 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926913920 0 0) 0x7f59741553f0 con 0x7f59740c5c50 2023-07-27T14:31:42.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f597939b700 1 -- 172.21.15.115:0/4055458771 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974157ff0 con 0x7f597414ae00 2023-07-27T14:31:42.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.805+0000 7f597939b700 1 --2- 172.21.15.115:0/4055458771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f597414ae00 0x7f5974154f00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f5974155580 tx=0x7f5970009060).ready entity=mon.0 client_cookie=568498ecdc96dada server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:42.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f596bfff700 1 -- 172.21.15.115:0/4055458771 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597000f510 con 0x7f597414ae00 2023-07-27T14:31:42.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f596bfff700 1 -- 172.21.15.115:0/4055458771 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597000f670 con 0x7f597414ae00 2023-07-27T14:31:42.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f596bfff700 1 -- 172.21.15.115:0/4055458771 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597000f9f0 con 0x7f597414ae00 2023-07-27T14:31:42.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f597b5ff700 1 -- 172.21.15.115:0/4055458771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f597414ae00 msgr2=0x7f5974154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f597b5ff700 1 --2- 172.21.15.115:0/4055458771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f597414ae00 0x7f5974154f00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f5974155580 tx=0x7f5970009060).stop 2023-07-27T14:31:42.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f597b5ff700 1 -- 172.21.15.115:0/4055458771 shutdown_connections 2023-07-27T14:31:42.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f597b5ff700 1 --2- 172.21.15.115:0/4055458771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f597414ae00 0x7f5974154f00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f597b5ff700 1 --2- 172.21.15.115:0/4055458771 >> v2:172.21.15.159:3300/0 conn(0x7f597414b1e0 0x7f5974062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f597b5ff700 1 -- 172.21.15.115:0/4055458771 >> 172.21.15.115:0/4055458771 conn(0x7f597405e940 msgr2=0x7f59740cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:42.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f597b5ff700 1 -- 172.21.15.115:0/4055458771 shutdown_connections 2023-07-27T14:31:42.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.806+0000 7f597b5ff700 1 -- 172.21.15.115:0/4055458771 wait complete. 2023-07-27T14:31:42.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.808+0000 7f597b5ff700 1 Processor -- start 2023-07-27T14:31:42.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.808+0000 7f597b5ff700 1 -- start start 2023-07-27T14:31:42.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597b5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59740c5c50 0x7f59740ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597b5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f597414ae00 0x7f5974167700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597b5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f597414b1e0 0x7f59740c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597b5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741686f0 con 0x7f59740c5c50 2023-07-27T14:31:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597b5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974168130 con 0x7f597414b1e0 2023-07-27T14:31:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597b5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5974168410 con 0x7f597414ae00 2023-07-27T14:31:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597939b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59740c5c50 0x7f59740ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597939b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59740c5c50 0x7f59740ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46806/0 (socket says 172.21.15.115:46806) 2023-07-27T14:31:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597939b700 1 -- 172.21.15.115:0/2192347203 learned_addr learned my addr 172.21.15.115:0/2192347203 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f5979b9c700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f597414b1e0 0x7f59740c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f5978b9a700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f597414ae00 0x7f5974167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597939b700 1 -- 172.21.15.115:0/2192347203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f597414ae00 msgr2=0x7f5974167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597939b700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f597414ae00 0x7f5974167700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597939b700 1 -- 172.21.15.115:0/2192347203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f597414b1e0 msgr2=0x7f59740c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.809+0000 7f597939b700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f597414b1e0 0x7f59740c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.810+0000 7f597939b700 1 -- 172.21.15.115:0/2192347203 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59700092a0 con 0x7f59740c5c50 2023-07-27T14:31:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.810+0000 7f597939b700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59740c5c50 0x7f59740ae500 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f59740cbc00 tx=0x7f5970017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.810+0000 7f59697fa700 1 -- 172.21.15.115:0/2192347203 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59700117e0 con 0x7f59740c5c50 2023-07-27T14:31:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.810+0000 7f59697fa700 1 -- 172.21.15.115:0/2192347203 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5970011940 con 0x7f59740c5c50 2023-07-27T14:31:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.810+0000 7f59697fa700 1 -- 172.21.15.115:0/2192347203 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5970011ce0 con 0x7f59740c5c50 2023-07-27T14:31:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.810+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59740add00 con 0x7f59740c5c50 2023-07-27T14:31:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.810+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59740b0c00 con 0x7f59740c5c50 2023-07-27T14:31:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.811+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59740adb60 con 0x7f59740c5c50 2023-07-27T14:31:42.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.812+0000 7f59697fa700 1 -- 172.21.15.115:0/2192347203 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 14) v1 ==== 75882+0+0 (secure 0 0 0) 0x7f597000f070 con 0x7f59740c5c50 2023-07-27T14:31:42.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.813+0000 7f59697fa700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f595805f210 0x7f59580616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:42.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.813+0000 7f59697fa700 1 -- 172.21.15.115:0/2192347203 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f597007b8a0 con 0x7f59740c5c50 2023-07-27T14:31:42.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.813+0000 7f5978b9a700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f595805f210 0x7f59580616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:42.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.814+0000 7f5978b9a700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f595805f210 0x7f59580616d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f5964006fd0 tx=0x7f5964008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:42.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:42.817+0000 7f59697fa700 1 -- 172.21.15.115:0/2192347203 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59740adb60 con 0x7f59740c5c50 2023-07-27T14:31:43.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.025+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f59740adb60 con 0x7f595805f210 2023-07-27T14:31:43.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.033+0000 7f59697fa700 1 -- 172.21.15.115:0/2192347203 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f59740adb60 con 0x7f595805f210 2023-07-27T14:31:43.067 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:43.067 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:43.067 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:31:43.067 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:31:43.067 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:31:43.067 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000313812", 2023-07-27T14:31:43.068 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000764682" 2023-07-27T14:31:43.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:43.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:43.068 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:43.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f595805f210 msgr2=0x7f59580616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:43.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f595805f210 0x7f59580616d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f5964006fd0 tx=0x7f5964008040).stop 2023-07-27T14:31:43.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59740c5c50 msgr2=0x7f59740ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:43.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59740c5c50 0x7f59740ae500 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f59740cbc00 tx=0x7f5970017000).stop 2023-07-27T14:31:43.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 shutdown_connections 2023-07-27T14:31:43.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f595805f210 0x7f59580616d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f597414b1e0 0x7f59740c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59740c5c50 0x7f59740ae500 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 --2- 172.21.15.115:0/2192347203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f597414ae00 0x7f5974167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 >> 172.21.15.115:0/2192347203 conn(0x7f597405e940 msgr2=0x7f59740a9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:43.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 shutdown_connections 2023-07-27T14:31:43.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.035+0000 7f597b5ff700 1 -- 172.21.15.115:0/2192347203 wait complete. 2023-07-27T14:31:43.089 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:43.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.245+0000 7f48307ff700 1 Processor -- start 2023-07-27T14:31:43.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.245+0000 7f48307ff700 1 -- start start 2023-07-27T14:31:43.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.246+0000 7f48307ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280bfb50 0x7f48280c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:43.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.246+0000 7f48307ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f48280c0610 0x7f48280c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:43.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.246+0000 7f48307ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48280c60a0 con 0x7f4828153f30 2023-07-27T14:31:43.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.246+0000 7f48307ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280c0f90 con 0x7f48280c0610 2023-07-27T14:31:43.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.246+0000 7f48307ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48280c5d70 con 0x7f48280bfb50 2023-07-27T14:31:43.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482e59b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4828153f30 0x7f48280a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37960/0 (socket says 172.21.15.115:37960) 2023-07-27T14:31:43.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482e59b700 1 -- 172.21.15.115:0/2940155442 learned_addr learned my addr 172.21.15.115:0/2940155442 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:43.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482ed9c700 1 --2- 172.21.15.115:0/2940155442 >> v2:172.21.15.115:3300/0 conn(0x7f48280c0610 0x7f48280c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:43.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482dd9a700 1 --2- 172.21.15.115:0/2940155442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280bfb50 0x7f48280c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:43.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482d599700 1 -- 172.21.15.115:0/2940155442 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285004121 0 0) 0x7f48280c60a0 con 0x7f4828153f30 2023-07-27T14:31:43.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482d599700 1 -- 172.21.15.115:0/2940155442 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48140033f0 con 0x7f4828153f30 2023-07-27T14:31:43.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482ed9c700 1 -- 172.21.15.115:0/2940155442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280bfb50 msgr2=0x7f48280c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:43.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482ed9c700 1 --2- 172.21.15.115:0/2940155442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280bfb50 0x7f48280c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482ed9c700 1 -- 172.21.15.115:0/2940155442 >> v1:172.21.15.115:6789/0 conn(0x7f4828153f30 legacy=0x7f48280a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:43.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482ed9c700 1 -- 172.21.15.115:0/2940155442 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48280c7d80 con 0x7f48280c0610 2023-07-27T14:31:43.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.247+0000 7f482ed9c700 1 --2- 172.21.15.115:0/2940155442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48280c0610 0x7f48280c0aa0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f4820009e60 tx=0x7f4820009780).ready entity=mon.0 client_cookie=edde34fdf75d118d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:43.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f482d599700 1 -- 172.21.15.115:0/2940155442 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482000e070 con 0x7f48280c0610 2023-07-27T14:31:43.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f482d599700 1 -- 172.21.15.115:0/2940155442 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482000bab0 con 0x7f48280c0610 2023-07-27T14:31:43.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f482d599700 1 -- 172.21.15.115:0/2940155442 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482000be30 con 0x7f48280c0610 2023-07-27T14:31:43.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f48307ff700 1 -- 172.21.15.115:0/2940155442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48280c0610 msgr2=0x7f48280c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:43.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f48307ff700 1 --2- 172.21.15.115:0/2940155442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48280c0610 0x7f48280c0aa0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f4820009e60 tx=0x7f4820009780).stop 2023-07-27T14:31:43.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f48307ff700 1 -- 172.21.15.115:0/2940155442 shutdown_connections 2023-07-27T14:31:43.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f48307ff700 1 --2- 172.21.15.115:0/2940155442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48280c0610 0x7f48280c0aa0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f48307ff700 1 --2- 172.21.15.115:0/2940155442 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280bfb50 0x7f48280c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f48307ff700 1 -- 172.21.15.115:0/2940155442 >> 172.21.15.115:0/2940155442 conn(0x7f4828094280 msgr2=0x7f482805e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:43.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f48307ff700 1 -- 172.21.15.115:0/2940155442 shutdown_connections 2023-07-27T14:31:43.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.248+0000 7f48307ff700 1 -- 172.21.15.115:0/2940155442 wait complete. 2023-07-27T14:31:43.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.250+0000 7f48307ff700 1 Processor -- start 2023-07-27T14:31:43.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.251+0000 7f48307ff700 1 -- start start 2023-07-27T14:31:43.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f48307ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280bfb50 0x7f4828150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:43.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f48307ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280c0610 0x7f48280adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:43.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f48307ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4828153f30 0x7f48280cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:43.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f48307ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48280b0c40 con 0x7f4828153f30 2023-07-27T14:31:43.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f48307ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48281513f0 con 0x7f48280bfb50 2023-07-27T14:31:43.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f48307ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48280a81c0 con 0x7f48280c0610 2023-07-27T14:31:43.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f482ed9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4828153f30 0x7f48280cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:43.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f482ed9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4828153f30 0x7f48280cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46826/0 (socket says 172.21.15.115:46826) 2023-07-27T14:31:43.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f482ed9c700 1 -- 172.21.15.115:0/3220875670 learned_addr learned my addr 172.21.15.115:0/3220875670 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:43.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f482e59b700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280bfb50 0x7f4828150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:43.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.252+0000 7f482dd9a700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280c0610 0x7f48280adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:43.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f482ed9c700 1 -- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280c0610 msgr2=0x7f48280adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:43.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f482ed9c700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280c0610 0x7f48280adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f482ed9c700 1 -- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280bfb50 msgr2=0x7f4828150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:43.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f482ed9c700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280bfb50 0x7f4828150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f482ed9c700 1 -- 172.21.15.115:0/3220875670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820009a20 con 0x7f4828153f30 2023-07-27T14:31:43.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f482e59b700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280bfb50 0x7f4828150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:43.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f482ed9c700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4828153f30 0x7f48280cade0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f482000b610 tx=0x7f4820009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:43.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f481e7fc700 1 -- 172.21.15.115:0/3220875670 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482001d630 con 0x7f4828153f30 2023-07-27T14:31:43.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f481e7fc700 1 -- 172.21.15.115:0/3220875670 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482001d790 con 0x7f4828153f30 2023-07-27T14:31:43.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f481e7fc700 1 -- 172.21.15.115:0/3220875670 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482001db50 con 0x7f4828153f30 2023-07-27T14:31:43.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48280aa6d0 con 0x7f4828153f30 2023-07-27T14:31:43.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.253+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48280ae310 con 0x7f4828153f30 2023-07-27T14:31:43.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.254+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48280a8330 con 0x7f4828153f30 2023-07-27T14:31:43.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.255+0000 7f481e7fc700 1 -- 172.21.15.115:0/3220875670 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 14) v1 ==== 75882+0+0 (secure 0 0 0) 0x7f4820027460 con 0x7f4828153f30 2023-07-27T14:31:43.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.256+0000 7f481e7fc700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05f210 0x7f480c0616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:43.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.256+0000 7f481e7fc700 1 -- 172.21.15.115:0/3220875670 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f482007c670 con 0x7f4828153f30 2023-07-27T14:31:43.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.256+0000 7f482e59b700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05f210 0x7f480c0616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:43.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.256+0000 7f482e59b700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05f210 0x7f480c0616d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f4824007fd0 tx=0x7f4824009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:43.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.260+0000 7f481e7fc700 1 -- 172.21.15.115:0/3220875670 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f482004d620 con 0x7f4828153f30 2023-07-27T14:31:43.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.466+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f48280c8060 con 0x7f480c05f210 2023-07-27T14:31:43.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.471+0000 7f481e7fc700 1 -- 172.21.15.115:0/3220875670 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f48280c8060 con 0x7f480c05f210 2023-07-27T14:31:43.505 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:31:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:31:43.505 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:31:43.506 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000313812", 2023-07-27T14:31:43.506 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000764682" 2023-07-27T14:31:43.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:43.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:43.506 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.473+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05f210 msgr2=0x7f480c0616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.473+0000 7f48307ff700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05f210 0x7f480c0616d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f4824007fd0 tx=0x7f4824009040).stop 2023-07-27T14:31:43.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.473+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4828153f30 msgr2=0x7f48280cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:43.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.473+0000 7f48307ff700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4828153f30 0x7f48280cade0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f482000b610 tx=0x7f4820009780).stop 2023-07-27T14:31:43.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.474+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 shutdown_connections 2023-07-27T14:31:43.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.474+0000 7f48307ff700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f480c05f210 0x7f480c0616d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.474+0000 7f48307ff700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4828153f30 0x7f48280cade0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.474+0000 7f48307ff700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280bfb50 0x7f4828150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.474+0000 7f48307ff700 1 --2- 172.21.15.115:0/3220875670 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48280c0610 0x7f48280adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:43.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.474+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 >> 172.21.15.115:0/3220875670 conn(0x7f4828094280 msgr2=0x7f4828159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:43.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.474+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 shutdown_connections 2023-07-27T14:31:43.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:43.474+0000 7f48307ff700 1 -- 172.21.15.115:0/3220875670 wait complete. 2023-07-27T14:31:44.525 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:44.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.690+0000 7efbebfff700 1 Processor -- start 2023-07-27T14:31:44.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.690+0000 7efbebfff700 1 -- start start 2023-07-27T14:31:44.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.691+0000 7efbebfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efbe4151d20 0x7efbe40c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:44.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.691+0000 7efbebfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efbe41553f0 0x7efbe4062b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:44.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.691+0000 7efbebfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe40cb210 0x7efbe4063000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:44.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.691+0000 7efbebfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbe40cba60 con 0x7efbe4151d20 2023-07-27T14:31:44.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.691+0000 7efbebfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbe4154720 con 0x7efbe41553f0 2023-07-27T14:31:44.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.691+0000 7efbebfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe40634f0 con 0x7efbe40cb210 2023-07-27T14:31:44.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.691+0000 7efbe9d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efbe4151d20 0x7efbe40c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:44.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe9d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efbe4151d20 0x7efbe40c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57190/0 (socket says 172.21.15.115:57190) 2023-07-27T14:31:44.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe9d9b700 1 -- 172.21.15.115:0/291689707 learned_addr learned my addr 172.21.15.115:0/291689707 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:44.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe9d9b700 1 -- 172.21.15.115:0/291689707 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe40cb210 msgr2=0x7efbe4063000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:44.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe9d9b700 1 --2- 172.21.15.115:0/291689707 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe40cb210 0x7efbe4063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:44.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe9d9b700 1 -- 172.21.15.115:0/291689707 >> v2:172.21.15.159:3300/0 conn(0x7efbe41553f0 msgr2=0x7efbe4062b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:44.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe9d9b700 1 --2- 172.21.15.115:0/291689707 >> v2:172.21.15.159:3300/0 conn(0x7efbe41553f0 0x7efbe4062b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:44.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe9d9b700 1 -- 172.21.15.115:0/291689707 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe4154f60 con 0x7efbe4151d20 2023-07-27T14:31:44.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe9d9b700 1 --2- 172.21.15.115:0/291689707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe4151d20 0x7efbe40c5100 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7efbe4157c50 tx=0x7efbe00090f0).ready entity=mon.0 client_cookie=2642c988bc6fc580 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:44.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe8d99700 1 -- 172.21.15.115:0/291689707 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe000b600 con 0x7efbe4151d20 2023-07-27T14:31:44.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe8d99700 1 -- 172.21.15.115:0/291689707 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe000b760 con 0x7efbe4151d20 2023-07-27T14:31:44.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.692+0000 7efbe8d99700 1 -- 172.21.15.115:0/291689707 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe000bae0 con 0x7efbe4151d20 2023-07-27T14:31:44.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 -- 172.21.15.115:0/291689707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe4151d20 msgr2=0x7efbe40c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:44.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 --2- 172.21.15.115:0/291689707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe4151d20 0x7efbe40c5100 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7efbe4157c50 tx=0x7efbe00090f0).stop 2023-07-27T14:31:44.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 -- 172.21.15.115:0/291689707 shutdown_connections 2023-07-27T14:31:44.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 --2- 172.21.15.115:0/291689707 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe40cb210 0x7efbe4063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:44.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 --2- 172.21.15.115:0/291689707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe4151d20 0x7efbe40c5100 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:44.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 --2- 172.21.15.115:0/291689707 >> v2:172.21.15.159:3300/0 conn(0x7efbe41553f0 0x7efbe4062b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:31:44.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 -- 172.21.15.115:0/291689707 >> 172.21.15.115:0/291689707 conn(0x7efbe405e940 msgr2=0x7efbe40cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:44.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 -- 172.21.15.115:0/291689707 shutdown_connections 2023-07-27T14:31:44.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.693+0000 7efbebfff700 1 -- 172.21.15.115:0/291689707 wait complete. 2023-07-27T14:31:44.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.694+0000 7efbebfff700 1 Processor -- start 2023-07-27T14:31:44.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.695+0000 7efbebfff700 1 -- start start 2023-07-27T14:31:44.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.695+0000 7efbebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe40cb210 0x7efbe4158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:44.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.695+0000 7efbebfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe4151d20 0x7efbe40c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:44.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbebfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbe41553f0 0x7efbe414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:44.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbebfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe40c33e0 con 0x7efbe40cb210 2023-07-27T14:31:44.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbebfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe40c3620 con 0x7efbe41553f0 2023-07-27T14:31:44.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbebfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe40c3900 con 0x7efbe4151d20 2023-07-27T14:31:44.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe40cb210 0x7efbe4158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:44.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe40cb210 0x7efbe4158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57204/0 (socket says 172.21.15.115:57204) 2023-07-27T14:31:44.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 -- 172.21.15.115:0/988347850 learned_addr learned my addr 172.21.15.115:0/988347850 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:44.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe959a700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe4151d20 0x7efbe40c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:44.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 -- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe4151d20 msgr2=0x7efbe40c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:44.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbea59c700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbe41553f0 0x7efbe414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:44.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe4151d20 0x7efbe40c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:44.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 -- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbe41553f0 msgr2=0x7efbe414c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:44.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbe41553f0 0x7efbe414c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:44.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 -- 172.21.15.115:0/988347850 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe0009370 con 0x7efbe40cb210 2023-07-27T14:31:44.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe959a700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe4151d20 0x7efbe40c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:44.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbea59c700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbe41553f0 0x7efbe414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:44.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.696+0000 7efbe9d9b700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe40cb210 0x7efbe4158770 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7efbe406c0c0 tx=0x7efbe0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:44.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.697+0000 7efbd9ffb700 1 -- 172.21.15.115:0/988347850 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe000b8d0 con 0x7efbe40cb210 2023-07-27T14:31:44.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.697+0000 7efbd9ffb700 1 -- 172.21.15.115:0/988347850 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe000ba30 con 0x7efbe40cb210 2023-07-27T14:31:44.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.697+0000 7efbd9ffb700 1 -- 172.21.15.115:0/988347850 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe00246c0 con 0x7efbe40cb210 2023-07-27T14:31:44.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.697+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe40c3be0 con 0x7efbe40cb210 2023-07-27T14:31:44.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.697+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbe40c41a0 con 0x7efbe40cb210 2023-07-27T14:31:44.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.698+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbe40c4360 con 0x7efbe40cb210 2023-07-27T14:31:44.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.698+0000 7efbd9ffb700 1 -- 172.21.15.115:0/988347850 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7efbe000f070 con 0x7efbe40cb210 2023-07-27T14:31:44.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.699+0000 7efbd9ffb700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efbc805f2a0 0x7efbc8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:44.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.699+0000 7efbd9ffb700 1 -- 172.21.15.115:0/988347850 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efbe007bff0 con 0x7efbe40cb210 2023-07-27T14:31:44.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.700+0000 7efbe959a700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efbc805f2a0 0x7efbc8061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:44.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.700+0000 7efbe959a700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efbc805f2a0 0x7efbc8061760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7efbe4159cb0 tx=0x7efbd4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:44.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.703+0000 7efbd9ffb700 1 -- 172.21.15.115:0/988347850 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efbe004d1c0 con 0x7efbe40cb210 2023-07-27T14:31:44.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.912+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7efbe406c470 con 0x7efbc805f2a0 2023-07-27T14:31:44.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.918+0000 7efbd9ffb700 1 -- 172.21.15.115:0/988347850 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7efbe406c470 con 0x7efbc805f2a0 2023-07-27T14:31:44.952 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:44.952 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:44.952 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:31:44.952 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:31:44.953 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:31:44.953 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000313812", 2023-07-27T14:31:44.953 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000764682" 2023-07-27T14:31:44.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:44.954 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:44.954 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:44.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efbc805f2a0 msgr2=0x7efbc8061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:44.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efbc805f2a0 0x7efbc8061760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7efbe4159cb0 tx=0x7efbd4008040).stop 2023-07-27T14:31:44.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe40cb210 msgr2=0x7efbe4158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:44.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe40cb210 0x7efbe4158770 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7efbe406c0c0 tx=0x7efbe0017000).stop 2023-07-27T14:31:44.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 shutdown_connections 2023-07-27T14:31:44.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efbc805f2a0 0x7efbc8061760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:44.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efbe41553f0 0x7efbe414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:44.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbe40cb210 0x7efbe4158770 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:44.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 --2- 172.21.15.115:0/988347850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efbe4151d20 0x7efbe40c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:44.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 >> 172.21.15.115:0/988347850 conn(0x7efbe405e940 msgr2=0x7efbe40c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:44.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 shutdown_connections 2023-07-27T14:31:44.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:44.920+0000 7efbebfff700 1 -- 172.21.15.115:0/988347850 wait complete. 2023-07-27T14:31:45.971 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.137+0000 7f262a1ff700 1 Processor -- start 2023-07-27T14:31:46.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.137+0000 7f262a1ff700 1 -- start start 2023-07-27T14:31:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f262a1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2624063260 0x7f2624154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f262a1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 0x7f26240a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f262a1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26241553f0 con 0x7f262414ae00 2023-07-27T14:31:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f262a1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2624157a50 con 0x7f2624063260 2023-07-27T14:31:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f262a1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2624157d10 con 0x7f262414b1e0 2023-07-27T14:31:46.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f2622ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2624063260 0x7f2624154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:46.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f2622ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2624063260 0x7f2624154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57216/0 (socket says 172.21.15.115:57216) 2023-07-27T14:31:46.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f2622ffd700 1 -- 172.21.15.115:0/1439052017 learned_addr learned my addr 172.21.15.115:0/1439052017 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:46.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.138+0000 7f26237fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f262414ae00 0x7f2624062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60392/0 (socket says 172.21.15.115:60392) 2023-07-27T14:31:46.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f2623fff700 1 --2- 172.21.15.115:0/1439052017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 0x7f26240a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:46.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f2622ffd700 1 -- 172.21.15.115:0/1439052017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 msgr2=0x7f26240a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:46.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f2622ffd700 1 --2- 172.21.15.115:0/1439052017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 0x7f26240a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f2622ffd700 1 -- 172.21.15.115:0/1439052017 >> v1:172.21.15.115:6789/0 conn(0x7f262414ae00 legacy=0x7f2624062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:46.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f2622ffd700 1 -- 172.21.15.115:0/1439052017 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2624157ff0 con 0x7f2624063260 2023-07-27T14:31:46.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f2622ffd700 1 --2- 172.21.15.115:0/1439052017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2624063260 0x7f2624154f00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f2618006fd0 tx=0x7f26180090f0).ready entity=mon.0 client_cookie=31b64c7b27d5c2d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:46.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f26227fc700 1 -- 172.21.15.115:0/1439052017 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800b600 con 0x7f2624063260 2023-07-27T14:31:46.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f26227fc700 1 -- 172.21.15.115:0/1439052017 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800b760 con 0x7f2624063260 2023-07-27T14:31:46.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.139+0000 7f26227fc700 1 -- 172.21.15.115:0/1439052017 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800bae0 con 0x7f2624063260 2023-07-27T14:31:46.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.140+0000 7f262a1ff700 1 -- 172.21.15.115:0/1439052017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2624063260 msgr2=0x7f2624154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:46.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.140+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1439052017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2624063260 0x7f2624154f00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f2618006fd0 tx=0x7f26180090f0).stop 2023-07-27T14:31:46.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.140+0000 7f262a1ff700 1 -- 172.21.15.115:0/1439052017 shutdown_connections 2023-07-27T14:31:46.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.140+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1439052017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 0x7f26240a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.140+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1439052017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2624063260 0x7f2624154f00 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.140+0000 7f262a1ff700 1 -- 172.21.15.115:0/1439052017 >> 172.21.15.115:0/1439052017 conn(0x7f262405e940 msgr2=0x7f26240cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:46.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.140+0000 7f262a1ff700 1 -- 172.21.15.115:0/1439052017 shutdown_connections 2023-07-27T14:31:46.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.140+0000 7f262a1ff700 1 -- 172.21.15.115:0/1439052017 wait complete. 2023-07-27T14:31:46.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.141+0000 7f262a1ff700 1 Processor -- start 2023-07-27T14:31:46.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.142+0000 7f262a1ff700 1 -- start start 2023-07-27T14:31:46.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.142+0000 7f262a1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2624063260 0x7f2624149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:46.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f262a1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262414ae00 0x7f2624164920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:46.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f262a1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 0x7f26240c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:46.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f262a1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240ae4f0 con 0x7f262414ae00 2023-07-27T14:31:46.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f262a1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240adc00 con 0x7f2624063260 2023-07-27T14:31:46.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f262a1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26240b0a20 con 0x7f262414b1e0 2023-07-27T14:31:46.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262414ae00 0x7f2624164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:46.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262414ae00 0x7f2624164920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57218/0 (socket says 172.21.15.115:57218) 2023-07-27T14:31:46.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 -- 172.21.15.115:0/1393800403 learned_addr learned my addr 172.21.15.115:0/1393800403 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:46.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 -- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 msgr2=0x7f26240c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:46.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f26237fe700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2624063260 0x7f2624149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:46.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2623fff700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 0x7f26240c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:46.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 0x7f26240c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 -- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2624063260 msgr2=0x7f2624149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:46.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2624063260 0x7f2624149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 -- 172.21.15.115:0/1393800403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618009370 con 0x7f262414ae00 2023-07-27T14:31:46.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f26237fe700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2624063260 0x7f2624149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:46.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.143+0000 7f2622ffd700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262414ae00 0x7f2624164920 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f2618011000 tx=0x7f2618017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:46.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.144+0000 7f260b7fe700 1 -- 172.21.15.115:0/1393800403 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800b8d0 con 0x7f262414ae00 2023-07-27T14:31:46.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.144+0000 7f260b7fe700 1 -- 172.21.15.115:0/1393800403 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800ba30 con 0x7f262414ae00 2023-07-27T14:31:46.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.144+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26240adea0 con 0x7f262414ae00 2023-07-27T14:31:46.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.144+0000 7f260b7fe700 1 -- 172.21.15.115:0/1393800403 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261801b660 con 0x7f262414ae00 2023-07-27T14:31:46.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.144+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26240c31d0 con 0x7f262414ae00 2023-07-27T14:31:46.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.145+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26240ae660 con 0x7f262414ae00 2023-07-27T14:31:46.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.145+0000 7f260b7fe700 1 -- 172.21.15.115:0/1393800403 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f261802b070 con 0x7f262414ae00 2023-07-27T14:31:46.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.146+0000 7f260b7fe700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f261005f2a0 0x7f2610061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:46.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.146+0000 7f260b7fe700 1 -- 172.21.15.115:0/1393800403 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f261807bb40 con 0x7f262414ae00 2023-07-27T14:31:46.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.147+0000 7f26237fe700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f261005f2a0 0x7f2610061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:46.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.147+0000 7f26237fe700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f261005f2a0 0x7f2610061760 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f26140016b0 tx=0x7f2614009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:46.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.150+0000 7f260b7fe700 1 -- 172.21.15.115:0/1393800403 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f261804ccb0 con 0x7f262414ae00 2023-07-27T14:31:46.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.364+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f26240c2f30 con 0x7f261005f2a0 2023-07-27T14:31:46.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.369+0000 7f260b7fe700 1 -- 172.21.15.115:0/1393800403 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f26240c2f30 con 0x7f261005f2a0 2023-07-27T14:31:46.403 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:31:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:31:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:31:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000313812", 2023-07-27T14:31:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000764682" 2023-07-27T14:31:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:46.404 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:46.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.371+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f261005f2a0 msgr2=0x7f2610061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:46.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.371+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f261005f2a0 0x7f2610061760 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f26140016b0 tx=0x7f2614009040).stop 2023-07-27T14:31:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.371+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262414ae00 msgr2=0x7f2624164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.371+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262414ae00 0x7f2624164920 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f2618011000 tx=0x7f2618017000).stop 2023-07-27T14:31:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.372+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 shutdown_connections 2023-07-27T14:31:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.372+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f261005f2a0 0x7f2610061760 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.372+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262414b1e0 0x7f26240c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.372+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2624063260 0x7f2624149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.372+0000 7f262a1ff700 1 --2- 172.21.15.115:0/1393800403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262414ae00 0x7f2624164920 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:46.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.372+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 >> 172.21.15.115:0/1393800403 conn(0x7f262405e940 msgr2=0x7f26240c0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:46.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.372+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 shutdown_connections 2023-07-27T14:31:46.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:46.372+0000 7f262a1ff700 1 -- 172.21.15.115:0/1393800403 wait complete. 2023-07-27T14:31:47.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:47.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.591+0000 7f0687dff700 1 Processor -- start 2023-07-27T14:31:47.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.592+0000 7f0687dff700 1 -- start start 2023-07-27T14:31:47.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.593+0000 7f0687dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0680063260 0x7f0680154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:47.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.593+0000 7f0687dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f068014b1e0 0x7f06800a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:47.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.593+0000 7f0687dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06801553f0 con 0x7f068014ae00 2023-07-27T14:31:47.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.593+0000 7f0687dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0680157a50 con 0x7f068014b1e0 2023-07-27T14:31:47.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.593+0000 7f0687dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0680157d10 con 0x7f0680063260 2023-07-27T14:31:47.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.593+0000 7f068639c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f068014b1e0 0x7f06800a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:47.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.593+0000 7f068639c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f068014b1e0 0x7f06800a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57228/0 (socket says 172.21.15.115:57228) 2023-07-27T14:31:47.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.593+0000 7f068639c700 1 -- 172.21.15.115:0/3794716795 learned_addr learned my addr 172.21.15.115:0/3794716795 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:47.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f068539a700 1 --2- 172.21.15.115:0/3794716795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0680063260 0x7f0680154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:47.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f068639c700 1 -- 172.21.15.115:0/3794716795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0680063260 msgr2=0x7f0680154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:47.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f068639c700 1 --2- 172.21.15.115:0/3794716795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0680063260 0x7f0680154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:47.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f068639c700 1 -- 172.21.15.115:0/3794716795 >> v1:172.21.15.159:6789/0 conn(0x7f068014ae00 legacy=0x7f0680062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:47.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f068639c700 1 -- 172.21.15.115:0/3794716795 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680157ff0 con 0x7f068014b1e0 2023-07-27T14:31:47.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f068639c700 1 --2- 172.21.15.115:0/3794716795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068014b1e0 0x7f06800a98c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f0678009f20 tx=0x7f0678009840).ready entity=mon.0 client_cookie=638d8ef0b7121161 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:47.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f0684b99700 1 -- 172.21.15.115:0/3794716795 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800e070 con 0x7f068014b1e0 2023-07-27T14:31:47.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f0684b99700 1 -- 172.21.15.115:0/3794716795 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800ba80 con 0x7f068014b1e0 2023-07-27T14:31:47.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.594+0000 7f0684b99700 1 -- 172.21.15.115:0/3794716795 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800be00 con 0x7f068014b1e0 2023-07-27T14:31:47.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.595+0000 7f0687dff700 1 -- 172.21.15.115:0/3794716795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068014b1e0 msgr2=0x7f06800a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:47.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.595+0000 7f0687dff700 1 --2- 172.21.15.115:0/3794716795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068014b1e0 0x7f06800a98c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f0678009f20 tx=0x7f0678009840).stop 2023-07-27T14:31:47.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.595+0000 7f0687dff700 1 -- 172.21.15.115:0/3794716795 shutdown_connections 2023-07-27T14:31:47.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.595+0000 7f0687dff700 1 --2- 172.21.15.115:0/3794716795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068014b1e0 0x7f06800a98c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:47.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.595+0000 7f0687dff700 1 --2- 172.21.15.115:0/3794716795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0680063260 0x7f0680154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:47.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.595+0000 7f0687dff700 1 -- 172.21.15.115:0/3794716795 >> 172.21.15.115:0/3794716795 conn(0x7f068005e940 msgr2=0x7f06800cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:47.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.595+0000 7f0687dff700 1 -- 172.21.15.115:0/3794716795 shutdown_connections 2023-07-27T14:31:47.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.595+0000 7f0687dff700 1 -- 172.21.15.115:0/3794716795 wait complete. 2023-07-27T14:31:47.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.596+0000 7f0687dff700 1 Processor -- start 2023-07-27T14:31:47.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.597+0000 7f0687dff700 1 -- start start 2023-07-27T14:31:47.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.597+0000 7f0687dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0680063260 0x7f06800c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:47.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.597+0000 7f0687dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068014ae00 0x7f0680149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:47.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.597+0000 7f0687dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068014b1e0 0x7f0680152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:47.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.597+0000 7f0687dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800c2d20 con 0x7f0680063260 2023-07-27T14:31:47.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.597+0000 7f0687dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800aec80 con 0x7f068014ae00 2023-07-27T14:31:47.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.597+0000 7f0687dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800ae950 con 0x7f068014b1e0 2023-07-27T14:31:47.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0680063260 0x7f06800c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:47.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0680063260 0x7f06800c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57234/0 (socket says 172.21.15.115:57234) 2023-07-27T14:31:47.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 -- 172.21.15.115:0/4228020862 learned_addr learned my addr 172.21.15.115:0/4228020862 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:47.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f068539a700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068014ae00 0x7f0680149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:47.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f068639c700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068014b1e0 0x7f0680152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:47.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 -- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068014b1e0 msgr2=0x7f0680152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:47.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068014b1e0 0x7f0680152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:47.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 -- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068014ae00 msgr2=0x7f0680149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:47.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068014ae00 0x7f0680149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:47.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 -- 172.21.15.115:0/4228020862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009ae0 con 0x7f0680063260 2023-07-27T14:31:47.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f068539a700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068014ae00 0x7f0680149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:47.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.598+0000 7f0685b9b700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0680063260 0x7f06800c1c50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f067c00c470 tx=0x7f067c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:47.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.599+0000 7f0675ffb700 1 -- 172.21.15.115:0/4228020862 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c00f470 con 0x7f0680063260 2023-07-27T14:31:47.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.599+0000 7f0675ffb700 1 -- 172.21.15.115:0/4228020862 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c00f5d0 con 0x7f0680063260 2023-07-27T14:31:47.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.599+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06800c2480 con 0x7f0680063260 2023-07-27T14:31:47.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.599+0000 7f0675ffb700 1 -- 172.21.15.115:0/4228020862 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c00f970 con 0x7f0680063260 2023-07-27T14:31:47.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.599+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06800c2ac0 con 0x7f0680063260 2023-07-27T14:31:47.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.600+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06800c2200 con 0x7f0680063260 2023-07-27T14:31:47.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.600+0000 7f0675ffb700 1 -- 172.21.15.115:0/4228020862 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f067c019030 con 0x7f0680063260 2023-07-27T14:31:47.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.601+0000 7f0675ffb700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f066405f2a0 0x7f0664061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:47.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.601+0000 7f0675ffb700 1 -- 172.21.15.115:0/4228020862 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f067c079550 con 0x7f0680063260 2023-07-27T14:31:47.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.601+0000 7f068539a700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f066405f2a0 0x7f0664061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:47.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.602+0000 7f068539a700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f066405f2a0 0x7f0664061760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f06801568b0 tx=0x7f0670008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:47.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.606+0000 7f0675ffb700 1 -- 172.21.15.115:0/4228020862 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f067c0488f0 con 0x7f0680063260 2023-07-27T14:31:47.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:47.825+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f068006c470 con 0x7f066405f2a0 2023-07-27T14:31:52.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.045+0000 7f0675ffb700 1 -- 172.21.15.115:0/4228020862 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f068006c470 con 0x7f066405f2a0 2023-07-27T14:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000313812", 2023-07-27T14:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000764682" 2023-07-27T14:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:52.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f066405f2a0 msgr2=0x7f0664061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f066405f2a0 0x7f0664061760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f06801568b0 tx=0x7f0670008040).stop 2023-07-27T14:31:52.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0680063260 msgr2=0x7f06800c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0680063260 0x7f06800c1c50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f067c00c470 tx=0x7f067c007dc0).stop 2023-07-27T14:31:52.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 shutdown_connections 2023-07-27T14:31:52.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f066405f2a0 0x7f0664061760 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f068014b1e0 0x7f0680152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0680063260 0x7f06800c1c50 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 --2- 172.21.15.115:0/4228020862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f068014ae00 0x7f0680149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 >> 172.21.15.115:0/4228020862 conn(0x7f068005e940 msgr2=0x7f068014a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:52.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 shutdown_connections 2023-07-27T14:31:52.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.048+0000 7f0687dff700 1 -- 172.21.15.115:0/4228020862 wait complete. 2023-07-27T14:31:52.104 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:52.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.301+0000 7f2a3e7ff700 1 Processor -- start 2023-07-27T14:31:52.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.301+0000 7f2a3e7ff700 1 -- start start 2023-07-27T14:31:52.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a3e7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2a3813a350 0x7f2a38065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a3e7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a3813a730 0x7f2a381585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a3e7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a380c2fa0 0x7f2a380c3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a3e7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a38066400 con 0x7f2a3813a730 2023-07-27T14:31:52.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a3e7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a38158ae0 con 0x7f2a3813a350 2023-07-27T14:31:52.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a3e7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380c3940 con 0x7f2a380c2fa0 2023-07-27T14:31:52.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a377fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a3813a730 0x7f2a381585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a377fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a3813a730 0x7f2a381585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57236/0 (socket says 172.21.15.115:57236) 2023-07-27T14:31:52.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a377fe700 1 -- 172.21.15.115:0/83625970 learned_addr learned my addr 172.21.15.115:0/83625970 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:52.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a37fff700 1 --2- 172.21.15.115:0/83625970 >> v2:172.21.15.159:3300/0 conn(0x7f2a3813a350 0x7f2a38065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a3cd9c700 1 --2- 172.21.15.115:0/83625970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a380c2fa0 0x7f2a380c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a377fe700 1 -- 172.21.15.115:0/83625970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a380c2fa0 msgr2=0x7f2a380c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:52.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a377fe700 1 --2- 172.21.15.115:0/83625970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a380c2fa0 0x7f2a380c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a377fe700 1 -- 172.21.15.115:0/83625970 >> v2:172.21.15.159:3300/0 conn(0x7f2a3813a350 msgr2=0x7f2a38065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:52.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a377fe700 1 --2- 172.21.15.115:0/83625970 >> v2:172.21.15.159:3300/0 conn(0x7f2a3813a350 0x7f2a38065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.303+0000 7f2a377fe700 1 -- 172.21.15.115:0/83625970 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380bd9a0 con 0x7f2a3813a730 2023-07-27T14:31:52.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.304+0000 7f2a377fe700 1 --2- 172.21.15.115:0/83625970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a3813a730 0x7f2a381585f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f2a38066fd0 tx=0x7f2a2c0090f0).ready entity=mon.0 client_cookie=7087ac2a74533f75 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:52.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.304+0000 7f2a36ffd700 1 -- 172.21.15.115:0/83625970 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00b600 con 0x7f2a3813a730 2023-07-27T14:31:52.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.304+0000 7f2a36ffd700 1 -- 172.21.15.115:0/83625970 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00b760 con 0x7f2a3813a730 2023-07-27T14:31:52.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.304+0000 7f2a36ffd700 1 -- 172.21.15.115:0/83625970 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00bae0 con 0x7f2a3813a730 2023-07-27T14:31:52.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/83625970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a3813a730 msgr2=0x7f2a381585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/83625970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a3813a730 0x7f2a381585f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f2a38066fd0 tx=0x7f2a2c0090f0).stop 2023-07-27T14:31:52.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/83625970 shutdown_connections 2023-07-27T14:31:52.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/83625970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a380c2fa0 0x7f2a380c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/83625970 >> v2:172.21.15.159:3300/0 conn(0x7f2a3813a350 0x7f2a38065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/83625970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a3813a730 0x7f2a381585f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/83625970 >> 172.21.15.115:0/83625970 conn(0x7f2a3805e8f0 msgr2=0x7f2a380c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:52.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/83625970 shutdown_connections 2023-07-27T14:31:52.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.305+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/83625970 wait complete. 2023-07-27T14:31:52.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.306+0000 7f2a3e7ff700 1 Processor -- start 2023-07-27T14:31:52.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.307+0000 7f2a3e7ff700 1 -- start start 2023-07-27T14:31:52.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.308+0000 7f2a3e7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a380c2fa0 0x7f2a38152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.308+0000 7f2a3e7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3813a350 0x7f2a380a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.308+0000 7f2a3e7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3813a730 0x7f2a380c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.308+0000 7f2a3e7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a381534d0 con 0x7f2a380c2fa0 2023-07-27T14:31:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.308+0000 7f2a3e7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380a92a0 con 0x7f2a3813a350 2023-07-27T14:31:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.308+0000 7f2a3e7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380bfbe0 con 0x7f2a3813a730 2023-07-27T14:31:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a37fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a380c2fa0 0x7f2a38152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a37fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a380c2fa0 0x7f2a38152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57252/0 (socket says 172.21.15.115:57252) 2023-07-27T14:31:52.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a37fff700 1 -- 172.21.15.115:0/917507396 learned_addr learned my addr 172.21.15.115:0/917507396 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a377fe700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3813a350 0x7f2a380a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a3cd9c700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3813a730 0x7f2a380c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a37fff700 1 -- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3813a730 msgr2=0x7f2a380c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a37fff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3813a730 0x7f2a380c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a37fff700 1 -- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3813a350 msgr2=0x7f2a380a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a37fff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3813a350 0x7f2a380a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a37fff700 1 -- 172.21.15.115:0/917507396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009370 con 0x7f2a380c2fa0 2023-07-27T14:31:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a377fe700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3813a350 0x7f2a380a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.309+0000 7f2a3cd9c700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3813a730 0x7f2a380c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.310+0000 7f2a37fff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a380c2fa0 0x7f2a38152fe0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f2a2800d890 tx=0x7f2a28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:52.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.310+0000 7f2a1ffff700 1 -- 172.21.15.115:0/917507396 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280125f0 con 0x7f2a380c2fa0 2023-07-27T14:31:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.310+0000 7f2a1ffff700 1 -- 172.21.15.115:0/917507396 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a28012750 con 0x7f2a380c2fa0 2023-07-27T14:31:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.310+0000 7f2a1ffff700 1 -- 172.21.15.115:0/917507396 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28012ad0 con 0x7f2a380c2fa0 2023-07-27T14:31:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.310+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a380bfec0 con 0x7f2a380c2fa0 2023-07-27T14:31:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.310+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a380c0480 con 0x7f2a380c2fa0 2023-07-27T14:31:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.311+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a38167a70 con 0x7f2a380c2fa0 2023-07-27T14:31:52.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.312+0000 7f2a1ffff700 1 -- 172.21.15.115:0/917507396 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f2a28013480 con 0x7f2a380c2fa0 2023-07-27T14:31:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.313+0000 7f2a1ffff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2405f2f0 0x7f2a240617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.313+0000 7f2a1ffff700 1 -- 172.21.15.115:0/917507396 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f2a2807a2d0 con 0x7f2a380c2fa0 2023-07-27T14:31:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.313+0000 7f2a377fe700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2405f2f0 0x7f2a240617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.314+0000 7f2a377fe700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2405f2f0 0x7f2a240617b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f2a380c0a70 tx=0x7f2a2c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:52.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.318+0000 7f2a1ffff700 1 -- 172.21.15.115:0/917507396 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a2804b230 con 0x7f2a380c2fa0 2023-07-27T14:31:52.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.584+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a3806c470 con 0x7f2a2405f2f0 2023-07-27T14:31:52.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.595+0000 7f2a1ffff700 1 -- 172.21.15.115:0/917507396 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f2a3806c470 con 0x7f2a2405f2f0 2023-07-27T14:31:52.629 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:31:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:31:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:31:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000313812", 2023-07-27T14:31:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000764682" 2023-07-27T14:31:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:52.630 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:52.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2405f2f0 msgr2=0x7f2a240617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2405f2f0 0x7f2a240617b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f2a380c0a70 tx=0x7f2a2c017000).stop 2023-07-27T14:31:52.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a380c2fa0 msgr2=0x7f2a38152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a380c2fa0 0x7f2a38152fe0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f2a2800d890 tx=0x7f2a28008040).stop 2023-07-27T14:31:52.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 shutdown_connections 2023-07-27T14:31:52.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2405f2f0 0x7f2a240617b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a3813a730 0x7f2a380c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a380c2fa0 0x7f2a38152fe0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 --2- 172.21.15.115:0/917507396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a3813a350 0x7f2a380a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 >> 172.21.15.115:0/917507396 conn(0x7f2a3805e8f0 msgr2=0x7f2a38153760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:52.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 shutdown_connections 2023-07-27T14:31:52.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.598+0000 7f2a3e7ff700 1 -- 172.21.15.115:0/917507396 wait complete. 2023-07-27T14:31:52.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:52.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.848+0000 7fce39dff700 1 Processor -- start 2023-07-27T14:31:52.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.849+0000 7fce39dff700 1 -- start start 2023-07-27T14:31:52.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.850+0000 7fce39dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce3414ae00 0x7fce34154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.850+0000 7fce39dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce34063260 0x7fce340a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.850+0000 7fce39dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce341553f0 con 0x7fce3414b1e0 2023-07-27T14:31:52.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.850+0000 7fce39dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce34157a50 con 0x7fce34063260 2023-07-27T14:31:52.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.850+0000 7fce39dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce34157d10 con 0x7fce3414ae00 2023-07-27T14:31:52.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce33fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce34063260 0x7fce340a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce33fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fce34063260 0x7fce340a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57258/0 (socket says 172.21.15.115:57258) 2023-07-27T14:31:52.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce33fff700 1 -- 172.21.15.115:0/1173015614 learned_addr learned my addr 172.21.15.115:0/1173015614 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:52.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce337fe700 1 --2- 172.21.15.115:0/1173015614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce3414ae00 0x7fce34154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce33fff700 1 -- 172.21.15.115:0/1173015614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce3414ae00 msgr2=0x7fce34154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:52.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce33fff700 1 --2- 172.21.15.115:0/1173015614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce3414ae00 0x7fce34154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce33fff700 1 -- 172.21.15.115:0/1173015614 >> v1:172.21.15.159:6789/0 conn(0x7fce3414b1e0 legacy=0x7fce34062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce33fff700 1 -- 172.21.15.115:0/1173015614 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34157ff0 con 0x7fce34063260 2023-07-27T14:31:52.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.851+0000 7fce33fff700 1 --2- 172.21.15.115:0/1173015614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce34063260 0x7fce340a98c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fce2c009f20 tx=0x7fce2c009840).ready entity=mon.0 client_cookie=4890e84320bebd66 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:52.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce327fc700 1 -- 172.21.15.115:0/1173015614 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c00e070 con 0x7fce34063260 2023-07-27T14:31:52.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce327fc700 1 -- 172.21.15.115:0/1173015614 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c00ba80 con 0x7fce34063260 2023-07-27T14:31:52.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce327fc700 1 -- 172.21.15.115:0/1173015614 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c00be00 con 0x7fce34063260 2023-07-27T14:31:52.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce39dff700 1 -- 172.21.15.115:0/1173015614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce34063260 msgr2=0x7fce340a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce39dff700 1 --2- 172.21.15.115:0/1173015614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce34063260 0x7fce340a98c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fce2c009f20 tx=0x7fce2c009840).stop 2023-07-27T14:31:52.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce39dff700 1 -- 172.21.15.115:0/1173015614 shutdown_connections 2023-07-27T14:31:52.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce39dff700 1 --2- 172.21.15.115:0/1173015614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce3414ae00 0x7fce34154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce39dff700 1 --2- 172.21.15.115:0/1173015614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce34063260 0x7fce340a98c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.852+0000 7fce39dff700 1 -- 172.21.15.115:0/1173015614 >> 172.21.15.115:0/1173015614 conn(0x7fce3405e940 msgr2=0x7fce340cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:52.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.853+0000 7fce39dff700 1 -- 172.21.15.115:0/1173015614 shutdown_connections 2023-07-27T14:31:52.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.853+0000 7fce39dff700 1 -- 172.21.15.115:0/1173015614 wait complete. 2023-07-27T14:31:52.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.855+0000 7fce39dff700 1 Processor -- start 2023-07-27T14:31:52.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.855+0000 7fce39dff700 1 -- start start 2023-07-27T14:31:52.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce39dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce34063260 0x7fce34138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce39dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce3414ae00 0x7fce34165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce39dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce3414b1e0 0x7fce340abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce39dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34156680 con 0x7fce3414ae00 2023-07-27T14:31:52.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce39dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340af500 con 0x7fce3414b1e0 2023-07-27T14:31:52.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce39dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce340af7e0 con 0x7fce34063260 2023-07-27T14:31:52.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce32ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce3414ae00 0x7fce34165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce337fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce34063260 0x7fce34138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce337fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce34063260 0x7fce34138580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:60776/0 (socket says 172.21.15.115:60776) 2023-07-27T14:31:52.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce32ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce3414ae00 0x7fce34165170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57264/0 (socket says 172.21.15.115:57264) 2023-07-27T14:31:52.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce337fe700 1 -- 172.21.15.115:0/3628085079 learned_addr learned my addr 172.21.15.115:0/3628085079 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:52.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.857+0000 7fce33fff700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce3414b1e0 0x7fce340abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce32ffd700 1 -- 172.21.15.115:0/3628085079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce34063260 msgr2=0x7fce34138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce32ffd700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce34063260 0x7fce34138580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce32ffd700 1 -- 172.21.15.115:0/3628085079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce3414b1e0 msgr2=0x7fce340abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce32ffd700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce3414b1e0 0x7fce340abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce32ffd700 1 -- 172.21.15.115:0/3628085079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c009ae0 con 0x7fce3414ae00 2023-07-27T14:31:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce337fe700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce34063260 0x7fce34138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce32ffd700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce3414ae00 0x7fce34165170 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fce340cbc00 tx=0x7fce28007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:52.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce1b7fe700 1 -- 172.21.15.115:0/3628085079 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2800ce40 con 0x7fce3414ae00 2023-07-27T14:31:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce1b7fe700 1 -- 172.21.15.115:0/3628085079 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28007020 con 0x7fce3414ae00 2023-07-27T14:31:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce340afac0 con 0x7fce3414ae00 2023-07-27T14:31:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce1b7fe700 1 -- 172.21.15.115:0/3628085079 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280073c0 con 0x7fce3414ae00 2023-07-27T14:31:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.858+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce340af140 con 0x7fce3414ae00 2023-07-27T14:31:52.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.859+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34153f00 con 0x7fce3414ae00 2023-07-27T14:31:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.860+0000 7fce1b7fe700 1 -- 172.21.15.115:0/3628085079 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7fce28010070 con 0x7fce3414ae00 2023-07-27T14:31:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.861+0000 7fce1b7fe700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce2005f2a0 0x7fce20061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.861+0000 7fce1b7fe700 1 -- 172.21.15.115:0/3628085079 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fce28079230 con 0x7fce3414ae00 2023-07-27T14:31:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.861+0000 7fce337fe700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce2005f2a0 0x7fce20061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:52.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.862+0000 7fce337fe700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce2005f2a0 0x7fce20061760 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fce340ac830 tx=0x7fce24008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:52.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:52.867+0000 7fce1b7fe700 1 -- 172.21.15.115:0/3628085079 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce280478f0 con 0x7fce3414ae00 2023-07-27T14:31:53.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.123+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7fce340af330 con 0x7fce2005f2a0 2023-07-27T14:31:53.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.132+0000 7fce1b7fe700 1 -- 172.21.15.115:0/3628085079 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fce340af330 con 0x7fce2005f2a0 2023-07-27T14:31:53.166 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:31:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:31:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:31:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000313812", 2023-07-27T14:31:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000764682" 2023-07-27T14:31:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:53.168 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:53.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce2005f2a0 msgr2=0x7fce20061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:53.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce2005f2a0 0x7fce20061760 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fce340ac830 tx=0x7fce24008040).stop 2023-07-27T14:31:53.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce3414ae00 msgr2=0x7fce34165170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:53.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce3414ae00 0x7fce34165170 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fce340cbc00 tx=0x7fce28007d40).stop 2023-07-27T14:31:53.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 shutdown_connections 2023-07-27T14:31:53.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce2005f2a0 0x7fce20061760 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:53.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce3414b1e0 0x7fce340abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:53.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce34063260 0x7fce34138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:53.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 --2- 172.21.15.115:0/3628085079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce3414ae00 0x7fce34165170 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:53.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 >> 172.21.15.115:0/3628085079 conn(0x7fce3405e940 msgr2=0x7fce340a9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:53.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 shutdown_connections 2023-07-27T14:31:53.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:53.135+0000 7fce39dff700 1 -- 172.21.15.115:0/3628085079 wait complete. 2023-07-27T14:31:54.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:54.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.387+0000 7f0524dff700 1 Processor -- start 2023-07-27T14:31:54.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.387+0000 7f0524dff700 1 -- start start 2023-07-27T14:31:54.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f0524dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05200bc350 0x7f05200657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:54.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f0524dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0520065360 con 0x7f05201542b0 2023-07-27T14:31:54.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f0524dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05200bcbd0 con 0x7f0520153ed0 2023-07-27T14:31:54.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f0524dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05201546d0 con 0x7f05200bc350 2023-07-27T14:31:54.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f051dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05200bc350 0x7f05200657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:54.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f051dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05200bc350 0x7f05200657f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59722/0 (socket says 172.21.15.115:59722) 2023-07-27T14:31:54.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f051dd9b700 1 -- 172.21.15.115:0/2554454907 learned_addr learned my addr 172.21.15.115:0/2554454907 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:54.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f051ed9d700 1 --1- 172.21.15.115:0/2554454907 >> v1:172.21.15.115:6789/0 conn(0x7f05201542b0 0x7f0520157db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51674/0 (socket says 172.21.15.115:51674) 2023-07-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f051dd9b700 1 -- 172.21.15.115:0/2554454907 >> v1:172.21.15.159:6789/0 conn(0x7f0520153ed0 legacy=0x7f05200c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f051dd9b700 1 -- 172.21.15.115:0/2554454907 >> v1:172.21.15.115:6789/0 conn(0x7f05201542b0 legacy=0x7f0520157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.390+0000 7f051dd9b700 1 -- 172.21.15.115:0/2554454907 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520064d30 con 0x7f05200bc350 2023-07-27T14:31:54.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.389+0000 7f051d59a700 1 -- 172.21.15.115:0/2554454907 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425845038 0 0) 0x7f0520065360 con 0x7f05201542b0 2023-07-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.390+0000 7f051dd9b700 1 --2- 172.21.15.115:0/2554454907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05200bc350 0x7f05200657f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f0514006fd0 tx=0x7f05140090f0).ready entity=mon.0 client_cookie=59b5ae31e6ab605 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.390+0000 7f051d59a700 1 -- 172.21.15.115:0/2554454907 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400b600 con 0x7f05200bc350 2023-07-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.390+0000 7f051d59a700 1 -- 172.21.15.115:0/2554454907 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051400b760 con 0x7f05200bc350 2023-07-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.390+0000 7f051d59a700 1 -- 172.21.15.115:0/2554454907 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400bae0 con 0x7f05200bc350 2023-07-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.391+0000 7f0524dff700 1 -- 172.21.15.115:0/2554454907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05200bc350 msgr2=0x7f05200657f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.391+0000 7f0524dff700 1 --2- 172.21.15.115:0/2554454907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05200bc350 0x7f05200657f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f0514006fd0 tx=0x7f05140090f0).stop 2023-07-27T14:31:54.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.391+0000 7f0524dff700 1 -- 172.21.15.115:0/2554454907 shutdown_connections 2023-07-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.391+0000 7f0524dff700 1 --2- 172.21.15.115:0/2554454907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05200bc350 0x7f05200657f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.391+0000 7f0524dff700 1 -- 172.21.15.115:0/2554454907 >> 172.21.15.115:0/2554454907 conn(0x7f0520062df0 msgr2=0x7f05200c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.391+0000 7f0524dff700 1 -- 172.21.15.115:0/2554454907 shutdown_connections 2023-07-27T14:31:54.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.391+0000 7f0524dff700 1 -- 172.21.15.115:0/2554454907 wait complete. 2023-07-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.393+0000 7f0524dff700 1 Processor -- start 2023-07-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.393+0000 7f0524dff700 1 -- start start 2023-07-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f0524dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05200bc350 0x7f05200a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f0524dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0520153ed0 0x7f05200a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f0524dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05201542b0 0x7f05200a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f0524dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200a57e0 con 0x7f0520153ed0 2023-07-27T14:31:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f0524dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200a6fa0 con 0x7f05200bc350 2023-07-27T14:31:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f0524dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0520168960 con 0x7f05201542b0 2023-07-27T14:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f051dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0520153ed0 0x7f05200a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f051ed9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05201542b0 0x7f05200a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f051dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0520153ed0 0x7f05200a4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59738/0 (socket says 172.21.15.115:59738) 2023-07-27T14:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.394+0000 7f051dd9b700 1 -- 172.21.15.115:0/3800192807 learned_addr learned my addr 172.21.15.115:0/3800192807 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f051e59c700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05200bc350 0x7f05200a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f051dd9b700 1 -- 172.21.15.115:0/3800192807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05201542b0 msgr2=0x7f05200a52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f051dd9b700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05201542b0 0x7f05200a52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f051dd9b700 1 -- 172.21.15.115:0/3800192807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05200bc350 msgr2=0x7f05200a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f051dd9b700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05200bc350 0x7f05200a9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f051dd9b700 1 -- 172.21.15.115:0/3800192807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514009370 con 0x7f0520153ed0 2023-07-27T14:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f051e59c700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05200bc350 0x7f05200a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f051dd9b700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0520153ed0 0x7f05200a4e00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f05200bcd60 tx=0x7f0514017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.395+0000 7f050e7fc700 1 -- 172.21.15.115:0/3800192807 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400bae0 con 0x7f0520153ed0 2023-07-27T14:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.396+0000 7f050e7fc700 1 -- 172.21.15.115:0/3800192807 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514000c90 con 0x7f0520153ed0 2023-07-27T14:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.396+0000 7f050e7fc700 1 -- 172.21.15.115:0/3800192807 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051401c670 con 0x7f0520153ed0 2023-07-27T14:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.396+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05200a6670 con 0x7f0520153ed0 2023-07-27T14:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.396+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05200a6c30 con 0x7f0520153ed0 2023-07-27T14:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.397+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052006c470 con 0x7f0520153ed0 2023-07-27T14:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.399+0000 7f050e7fc700 1 -- 172.21.15.115:0/3800192807 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f051402c070 con 0x7f0520153ed0 2023-07-27T14:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.400+0000 7f050e7fc700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f050005f2a0 0x7f0500061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.400+0000 7f050e7fc700 1 -- 172.21.15.115:0/3800192807 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f051407be60 con 0x7f0520153ed0 2023-07-27T14:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.400+0000 7f051e59c700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f050005f2a0 0x7f0500061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:54.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.401+0000 7f051e59c700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f050005f2a0 0x7f0500061760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f0510001710 tx=0x7f0510009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:54.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.405+0000 7f050e7fc700 1 -- 172.21.15.115:0/3800192807 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f051404cf90 con 0x7f0520153ed0 2023-07-27T14:31:54.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.671+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f0520151c40 con 0x7f050005f2a0 2023-07-27T14:31:54.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.680+0000 7f050e7fc700 1 -- 172.21.15.115:0/3800192807 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f0520151c40 con 0x7f050005f2a0 2023-07-27T14:31:54.715 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:54.715 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:54.715 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:31:54.716 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:31:54.716 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:31:54.716 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000313812", 2023-07-27T14:31:54.716 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000764682" 2023-07-27T14:31:54.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:54.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:54.716 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:54.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.682+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f050005f2a0 msgr2=0x7f0500061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:54.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f050005f2a0 0x7f0500061760 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f0510001710 tx=0x7f0510009040).stop 2023-07-27T14:31:54.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0520153ed0 msgr2=0x7f05200a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:54.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0520153ed0 0x7f05200a4e00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f05200bcd60 tx=0x7f0514017000).stop 2023-07-27T14:31:54.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 shutdown_connections 2023-07-27T14:31:54.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f050005f2a0 0x7f0500061760 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:54.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05201542b0 0x7f05200a52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:54.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05200bc350 0x7f05200a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:54.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 --2- 172.21.15.115:0/3800192807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0520153ed0 0x7f05200a4e00 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:54.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 >> 172.21.15.115:0/3800192807 conn(0x7f0520062df0 msgr2=0x7f05200c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:54.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 shutdown_connections 2023-07-27T14:31:54.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:54.683+0000 7f0524dff700 1 -- 172.21.15.115:0/3800192807 wait complete. 2023-07-27T14:31:55.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:55.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.944+0000 7f7b379ff700 1 Processor -- start 2023-07-27T14:31:55.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.944+0000 7f7b379ff700 1 -- start start 2023-07-27T14:31:55.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b379ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7b3013d3a0 0x7f7b300c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:55.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b379ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7b3013d780 0x7f7b30068040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b379ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b30065f10 0x7f7b300663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b379ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b300c3490 con 0x7f7b3013d780 2023-07-27T14:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b379ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b30068530 con 0x7f7b3013d3a0 2023-07-27T14:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b379ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300be080 con 0x7f7b30065f10 2023-07-27T14:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b34f9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7b3013d780 0x7f7b30068040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b34f9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7b3013d780 0x7f7b30068040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59746/0 (socket says 172.21.15.115:59746) 2023-07-27T14:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b34f9a700 1 -- 172.21.15.115:0/606291090 learned_addr learned my addr 172.21.15.115:0/606291090 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b3579b700 1 --2- 172.21.15.115:0/606291090 >> v2:172.21.15.159:3300/0 conn(0x7f7b3013d3a0 0x7f7b300c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:55.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.946+0000 7f7b35f9c700 1 --2- 172.21.15.115:0/606291090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b30065f10 0x7f7b300663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:55.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b34f9a700 1 -- 172.21.15.115:0/606291090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b30065f10 msgr2=0x7f7b300663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:55.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b34f9a700 1 --2- 172.21.15.115:0/606291090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b30065f10 0x7f7b300663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:55.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b34f9a700 1 -- 172.21.15.115:0/606291090 >> v2:172.21.15.159:3300/0 conn(0x7f7b3013d3a0 msgr2=0x7f7b300c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:55.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b34f9a700 1 --2- 172.21.15.115:0/606291090 >> v2:172.21.15.159:3300/0 conn(0x7f7b3013d3a0 0x7f7b300c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:55.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b34f9a700 1 -- 172.21.15.115:0/606291090 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30066890 con 0x7f7b3013d780 2023-07-27T14:31:55.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b34f9a700 1 --2- 172.21.15.115:0/606291090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b30068040 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f7b300670f0 tx=0x7f7b200090f0).ready entity=mon.0 client_cookie=16361704196bd73 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:55.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b27fff700 1 -- 172.21.15.115:0/606291090 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000f510 con 0x7f7b3013d780 2023-07-27T14:31:55.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b27fff700 1 -- 172.21.15.115:0/606291090 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000f670 con 0x7f7b3013d780 2023-07-27T14:31:55.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.947+0000 7f7b27fff700 1 -- 172.21.15.115:0/606291090 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000fa10 con 0x7f7b3013d780 2023-07-27T14:31:55.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 -- 172.21.15.115:0/606291090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 msgr2=0x7f7b30068040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:55.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 --2- 172.21.15.115:0/606291090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b30068040 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f7b300670f0 tx=0x7f7b200090f0).stop 2023-07-27T14:31:55.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 -- 172.21.15.115:0/606291090 shutdown_connections 2023-07-27T14:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 --2- 172.21.15.115:0/606291090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b30065f10 0x7f7b300663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 --2- 172.21.15.115:0/606291090 >> v2:172.21.15.159:3300/0 conn(0x7f7b3013d3a0 0x7f7b300c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 --2- 172.21.15.115:0/606291090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b30068040 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 -- 172.21.15.115:0/606291090 >> 172.21.15.115:0/606291090 conn(0x7f7b3005e940 msgr2=0x7f7b300c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 -- 172.21.15.115:0/606291090 shutdown_connections 2023-07-27T14:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.948+0000 7f7b379ff700 1 -- 172.21.15.115:0/606291090 wait complete. 2023-07-27T14:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.949+0000 7f7b379ff700 1 Processor -- start 2023-07-27T14:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.950+0000 7f7b379ff700 1 -- start start 2023-07-27T14:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.950+0000 7f7b379ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b30065f10 0x7f7b30164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b379ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b3013d3a0 0x7f7b3013b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b379ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b300bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b379ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30165540 con 0x7f7b3013d780 2023-07-27T14:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b379ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3013b7c0 con 0x7f7b30065f10 2023-07-27T14:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b379ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300c0270 con 0x7f7b3013d3a0 2023-07-27T14:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b35f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b300bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b34f9a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b3013d3a0 0x7f7b3013b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b35f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b300bfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59758/0 (socket says 172.21.15.115:59758) 2023-07-27T14:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b35f9c700 1 -- 172.21.15.115:0/1819723244 learned_addr learned my addr 172.21.15.115:0/1819723244 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b3579b700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b30065f10 0x7f7b30164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b35f9c700 1 -- 172.21.15.115:0/1819723244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b3013d3a0 msgr2=0x7f7b3013b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b35f9c700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b3013d3a0 0x7f7b3013b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b35f9c700 1 -- 172.21.15.115:0/1819723244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b30065f10 msgr2=0x7f7b30164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.951+0000 7f7b35f9c700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b30065f10 0x7f7b30164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.952+0000 7f7b35f9c700 1 -- 172.21.15.115:0/1819723244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20009370 con 0x7f7b3013d780 2023-07-27T14:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.952+0000 7f7b3579b700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b30065f10 0x7f7b30164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.952+0000 7f7b35f9c700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b300bfa40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f7b28009e90 tx=0x7f7b2800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.952+0000 7f7b257fa700 1 -- 172.21.15.115:0/1819723244 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800cb50 con 0x7f7b3013d780 2023-07-27T14:31:55.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.952+0000 7f7b257fa700 1 -- 172.21.15.115:0/1819723244 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2800f040 con 0x7f7b3013d780 2023-07-27T14:31:55.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.952+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300c0550 con 0x7f7b3013d780 2023-07-27T14:31:55.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.952+0000 7f7b257fa700 1 -- 172.21.15.115:0/1819723244 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800cec0 con 0x7f7b3013d780 2023-07-27T14:31:55.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.952+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b300c0b10 con 0x7f7b3013d780 2023-07-27T14:31:55.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.954+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b301656b0 con 0x7f7b3013d780 2023-07-27T14:31:55.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.955+0000 7f7b257fa700 1 -- 172.21.15.115:0/1819723244 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f7b28013610 con 0x7f7b3013d780 2023-07-27T14:31:55.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.956+0000 7f7b257fa700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b1405f2a0 0x7f7b14061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:55.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.956+0000 7f7b257fa700 1 -- 172.21.15.115:0/1819723244 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f7b2807af20 con 0x7f7b3013d780 2023-07-27T14:31:55.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.956+0000 7f7b3579b700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b1405f2a0 0x7f7b14061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:55.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.957+0000 7f7b3579b700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b1405f2a0 0x7f7b14061760 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f7b2c006d80 tx=0x7f7b2c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:55.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:55.960+0000 7f7b257fa700 1 -- 172.21.15.115:0/1819723244 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b2804f890 con 0x7f7b3013d780 2023-07-27T14:31:56.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:56.214+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b3006c470 con 0x7f7b1405f2a0 2023-07-27T14:31:57.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.037+0000 7f7b257fa700 1 -- 172.21.15.115:0/1819723244 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f7b3006c470 con 0x7f7b1405f2a0 2023-07-27T14:31:57.072 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:57.072 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:57.072 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:31:57.072 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:57.072 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:57.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b1405f2a0 msgr2=0x7f7b14061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b1405f2a0 0x7f7b14061760 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f7b2c006d80 tx=0x7f7b2c008040).stop 2023-07-27T14:31:57.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 msgr2=0x7f7b300bfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b300bfa40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f7b28009e90 tx=0x7f7b2800b040).stop 2023-07-27T14:31:57.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 shutdown_connections 2023-07-27T14:31:57.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7b1405f2a0 0x7f7b14061760 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b3013d780 0x7f7b300bfa40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b30065f10 0x7f7b30164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 --2- 172.21.15.115:0/1819723244 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7b3013d3a0 0x7f7b3013b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 >> 172.21.15.115:0/1819723244 conn(0x7f7b3005e940 msgr2=0x7f7b3013c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:57.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 shutdown_connections 2023-07-27T14:31:57.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.040+0000 7f7b379ff700 1 -- 172.21.15.115:0/1819723244 wait complete. 2023-07-27T14:31:57.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000520718 2023-07-27T14:31:57.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.256+0000 7f445c5ff700 1 Processor -- start 2023-07-27T14:31:57.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.256+0000 7f445c5ff700 1 -- start start 2023-07-27T14:31:57.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.257+0000 7f445c5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44540c0ea0 0x7f4454150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.257+0000 7f445c5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4454068bb0 con 0x7f4454065220 2023-07-27T14:31:57.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.257+0000 7f445c5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445406a250 con 0x7f4454150220 2023-07-27T14:31:57.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.257+0000 7f445c5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540656b0 con 0x7f44540c0ea0 2023-07-27T14:31:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.257+0000 7f445ab9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4454065220 0x7f44540c1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51676/0 (socket says 172.21.15.115:51676) 2023-07-27T14:31:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.257+0000 7f445ab9c700 1 -- 172.21.15.115:0/2526753829 learned_addr learned my addr 172.21.15.115:0/2526753829 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459b9a700 1 --2- 172.21.15.115:0/2526753829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44540c0ea0 0x7f4454150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459399700 1 -- 172.21.15.115:0/2526753829 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872546002 0 0) 0x7f4454068bb0 con 0x7f4454065220 2023-07-27T14:31:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459399700 1 -- 172.21.15.115:0/2526753829 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44400033f0 con 0x7f4454065220 2023-07-27T14:31:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459399700 1 -- 172.21.15.115:0/2526753829 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596857027 0 0) 0x7f445406a250 con 0x7f4454150220 2023-07-27T14:31:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459399700 1 -- 172.21.15.115:0/2526753829 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4454068bb0 con 0x7f4454150220 2023-07-27T14:31:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459399700 1 -- 172.21.15.115:0/2526753829 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1567670698 0 0) 0x7f44400033f0 con 0x7f4454065220 2023-07-27T14:31:57.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459b9a700 1 -- 172.21.15.115:0/2526753829 >> v1:172.21.15.159:6789/0 conn(0x7f4454150220 legacy=0x7f4454069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459b9a700 1 -- 172.21.15.115:0/2526753829 >> v1:172.21.15.115:6789/0 conn(0x7f4454065220 legacy=0x7f44540c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459b9a700 1 -- 172.21.15.115:0/2526753829 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540c1380 con 0x7f44540c0ea0 2023-07-27T14:31:57.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.258+0000 7f4459b9a700 1 --2- 172.21.15.115:0/2526753829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44540c0ea0 0x7f4454150600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f4444009790 tx=0x7f4444009060).ready entity=mon.2 client_cookie=c43ad65154b0c02f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:57.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f4459399700 1 -- 172.21.15.115:0/2526753829 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0017f0 con 0x7f44540c0ea0 2023-07-27T14:31:57.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f4459399700 1 -- 172.21.15.115:0/2526753829 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444011400 con 0x7f44540c0ea0 2023-07-27T14:31:57.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f4459399700 1 -- 172.21.15.115:0/2526753829 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444011780 con 0x7f44540c0ea0 2023-07-27T14:31:57.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f445c5ff700 1 -- 172.21.15.115:0/2526753829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44540c0ea0 msgr2=0x7f4454150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f445c5ff700 1 --2- 172.21.15.115:0/2526753829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44540c0ea0 0x7f4454150600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f4444009790 tx=0x7f4444009060).stop 2023-07-27T14:31:57.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f445c5ff700 1 -- 172.21.15.115:0/2526753829 shutdown_connections 2023-07-27T14:31:57.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f445c5ff700 1 --2- 172.21.15.115:0/2526753829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44540c0ea0 0x7f4454150600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f445c5ff700 1 -- 172.21.15.115:0/2526753829 >> 172.21.15.115:0/2526753829 conn(0x7f4454062320 msgr2=0x7f4454062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f445c5ff700 1 -- 172.21.15.115:0/2526753829 shutdown_connections 2023-07-27T14:31:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.259+0000 7f445c5ff700 1 -- 172.21.15.115:0/2526753829 wait complete. 2023-07-27T14:31:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.261+0000 7f445c5ff700 1 Processor -- start 2023-07-27T14:31:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.261+0000 7f445c5ff700 1 -- start start 2023-07-27T14:31:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445c5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4454065220 0x7f4454147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445c5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44540c0ea0 0x7f4454063da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445c5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4454150220 0x7f4454064290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445c5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4454064780 con 0x7f4454065220 2023-07-27T14:31:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445c5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540a7080 con 0x7f44540c0ea0 2023-07-27T14:31:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445c5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540a6490 con 0x7f4454150220 2023-07-27T14:31:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445a39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4454065220 0x7f4454147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445a39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4454065220 0x7f4454147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59762/0 (socket says 172.21.15.115:59762) 2023-07-27T14:31:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445a39b700 1 -- 172.21.15.115:0/3799496128 learned_addr learned my addr 172.21.15.115:0/3799496128 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:57.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f4459b9a700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44540c0ea0 0x7f4454063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445ab9c700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4454150220 0x7f4454064290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445a39b700 1 -- 172.21.15.115:0/3799496128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4454150220 msgr2=0x7f4454064290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.262+0000 7f445a39b700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4454150220 0x7f4454064290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f445a39b700 1 -- 172.21.15.115:0/3799496128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44540c0ea0 msgr2=0x7f4454063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f445a39b700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44540c0ea0 0x7f4454063da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f445a39b700 1 -- 172.21.15.115:0/3799496128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44440092a0 con 0x7f4454065220 2023-07-27T14:31:57.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f445a39b700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4454065220 0x7f4454147920 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f445000c440 tx=0x7f4450007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:57.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f444a7fc700 1 -- 172.21.15.115:0/3799496128 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445000cea0 con 0x7f4454065220 2023-07-27T14:31:57.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f444a7fc700 1 -- 172.21.15.115:0/3799496128 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445000f470 con 0x7f4454065220 2023-07-27T14:31:57.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44540a6750 con 0x7f4454065220 2023-07-27T14:31:57.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f444a7fc700 1 -- 172.21.15.115:0/3799496128 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445000f830 con 0x7f4454065220 2023-07-27T14:31:57.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.263+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44540a6d10 con 0x7f4454065220 2023-07-27T14:31:57.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.264+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445406c470 con 0x7f4454065220 2023-07-27T14:31:57.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.265+0000 7f444a7fc700 1 -- 172.21.15.115:0/3799496128 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f4450019030 con 0x7f4454065220 2023-07-27T14:31:57.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.265+0000 7f444a7fc700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f443805f270 0x7f4438061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.266+0000 7f444a7fc700 1 -- 172.21.15.115:0/3799496128 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f4450079540 con 0x7f4454065220 2023-07-27T14:31:57.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.266+0000 7f4459b9a700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f443805f270 0x7f4438061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.266+0000 7f4459b9a700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f443805f270 0x7f4438061730 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f44440096e0 tx=0x7f4444016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:57.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.270+0000 7f444a7fc700 1 -- 172.21.15.115:0/3799496128 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f445004a780 con 0x7f4454065220 2023-07-27T14:31:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.480+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f44540a7780 con 0x7f443805f270 2023-07-27T14:31:57.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.486+0000 7f444a7fc700 1 -- 172.21.15.115:0/3799496128 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f44540a7780 con 0x7f443805f270 2023-07-27T14:31:57.521 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:31:57.521 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:31:57.521 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:31:57.522 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:31:57.522 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:31:57.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f443805f270 msgr2=0x7f4438061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f443805f270 0x7f4438061730 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f44440096e0 tx=0x7f4444016000).stop 2023-07-27T14:31:57.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4454065220 msgr2=0x7f4454147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4454065220 0x7f4454147920 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f445000c440 tx=0x7f4450007c90).stop 2023-07-27T14:31:57.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 shutdown_connections 2023-07-27T14:31:57.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f443805f270 0x7f4438061730 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4454150220 0x7f4454064290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4454065220 0x7f4454147920 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 --2- 172.21.15.115:0/3799496128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44540c0ea0 0x7f4454063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 >> 172.21.15.115:0/3799496128 conn(0x7f4454062320 msgr2=0x7f44540bbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:57.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 shutdown_connections 2023-07-27T14:31:57.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.488+0000 7f445c5ff700 1 -- 172.21.15.115:0/3799496128 wait complete. 2023-07-27T14:31:57.540 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000313812 snapshot_0000000000764682 2023-07-27T14:31:57.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.705+0000 7f6a27bff700 1 Processor -- start 2023-07-27T14:31:57.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.706+0000 7f6a27bff700 1 -- start start 2023-07-27T14:31:57.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a27bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a20063260 0x7f6a20154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a27bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6a2014b1e0 0x7f6a200a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a27bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a201553f0 con 0x7f6a2014ae00 2023-07-27T14:31:57.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a27bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a20157a50 con 0x7f6a20063260 2023-07-27T14:31:57.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a27bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a20157d10 con 0x7f6a2014b1e0 2023-07-27T14:31:57.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a2519a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a20063260 0x7f6a20154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a2599b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6a2014ae00 0x7f6a20062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51682/0 (socket says 172.21.15.115:51682) 2023-07-27T14:31:57.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a2599b700 1 -- 172.21.15.115:0/1647582664 learned_addr learned my addr 172.21.15.115:0/1647582664 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:57.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.707+0000 7f6a2619c700 1 --2- 172.21.15.115:0/1647582664 >> v2:172.21.15.159:3300/0 conn(0x7f6a2014b1e0 0x7f6a200a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a24999700 1 -- 172.21.15.115:0/1647582664 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244355185 0 0) 0x7f6a201553f0 con 0x7f6a2014ae00 2023-07-27T14:31:57.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a2519a700 1 -- 172.21.15.115:0/1647582664 >> v2:172.21.15.159:3300/0 conn(0x7f6a2014b1e0 msgr2=0x7f6a200a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:57.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a2519a700 1 --2- 172.21.15.115:0/1647582664 >> v2:172.21.15.159:3300/0 conn(0x7f6a2014b1e0 0x7f6a200a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a2519a700 1 -- 172.21.15.115:0/1647582664 >> v1:172.21.15.115:6789/0 conn(0x7f6a2014ae00 legacy=0x7f6a20062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a2519a700 1 -- 172.21.15.115:0/1647582664 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20157ff0 con 0x7f6a20063260 2023-07-27T14:31:57.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a2619c700 1 --2- 172.21.15.115:0/1647582664 >> v2:172.21.15.159:3300/0 conn(0x7f6a2014b1e0 0x7f6a200a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:57.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a2519a700 1 --2- 172.21.15.115:0/1647582664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a20063260 0x7f6a20154f00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f6a20083430 tx=0x7f6a10009060).ready entity=mon.0 client_cookie=7b93c39755ced74c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:57.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a24999700 1 -- 172.21.15.115:0/1647582664 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000b580 con 0x7f6a20063260 2023-07-27T14:31:57.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a24999700 1 -- 172.21.15.115:0/1647582664 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000b6e0 con 0x7f6a20063260 2023-07-27T14:31:57.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.708+0000 7f6a24999700 1 -- 172.21.15.115:0/1647582664 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000ba60 con 0x7f6a20063260 2023-07-27T14:31:57.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.709+0000 7f6a27bff700 1 -- 172.21.15.115:0/1647582664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a20063260 msgr2=0x7f6a20154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.709+0000 7f6a27bff700 1 --2- 172.21.15.115:0/1647582664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a20063260 0x7f6a20154f00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f6a20083430 tx=0x7f6a10009060).stop 2023-07-27T14:31:57.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.709+0000 7f6a27bff700 1 -- 172.21.15.115:0/1647582664 shutdown_connections 2023-07-27T14:31:57.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.709+0000 7f6a27bff700 1 --2- 172.21.15.115:0/1647582664 >> v2:172.21.15.159:3300/0 conn(0x7f6a2014b1e0 0x7f6a200a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.709+0000 7f6a27bff700 1 --2- 172.21.15.115:0/1647582664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a20063260 0x7f6a20154f00 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.709+0000 7f6a27bff700 1 -- 172.21.15.115:0/1647582664 >> 172.21.15.115:0/1647582664 conn(0x7f6a2005e940 msgr2=0x7f6a200cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:57.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.709+0000 7f6a27bff700 1 -- 172.21.15.115:0/1647582664 shutdown_connections 2023-07-27T14:31:57.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.709+0000 7f6a27bff700 1 -- 172.21.15.115:0/1647582664 wait complete. 2023-07-27T14:31:57.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.711+0000 7f6a27bff700 1 Processor -- start 2023-07-27T14:31:57.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.711+0000 7f6a27bff700 1 -- start start 2023-07-27T14:31:57.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.712+0000 7f6a27bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a20063260 0x7f6a20148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.712+0000 7f6a27bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2014ae00 0x7f6a200c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.712+0000 7f6a27bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a2014b1e0 0x7f6a200c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.712+0000 7f6a27bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200ca370 con 0x7f6a2014b1e0 2023-07-27T14:31:57.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.712+0000 7f6a27bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c2620 con 0x7f6a2014ae00 2023-07-27T14:31:57.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.712+0000 7f6a27bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20164c50 con 0x7f6a20063260 2023-07-27T14:31:57.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a2014b1e0 0x7f6a200c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2599b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a20063260 0x7f6a20148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a2014b1e0 0x7f6a200c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59788/0 (socket says 172.21.15.115:59788) 2023-07-27T14:31:57.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2519a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2014ae00 0x7f6a200c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 -- 172.21.15.115:0/2385551123 learned_addr learned my addr 172.21.15.115:0/2385551123 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:57.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 -- 172.21.15.115:0/2385551123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a20063260 msgr2=0x7f6a20148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a20063260 0x7f6a20148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 -- 172.21.15.115:0/2385551123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2014ae00 msgr2=0x7f6a200c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2014ae00 0x7f6a200c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 -- 172.21.15.115:0/2385551123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100092a0 con 0x7f6a2014b1e0 2023-07-27T14:31:57.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2599b700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a20063260 0x7f6a20148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:31:57.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.713+0000 7f6a2619c700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a2014b1e0 0x7f6a200c9e80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f6a18009f90 tx=0x7f6a180099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:57.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.714+0000 7f6a15ffb700 1 -- 172.21.15.115:0/2385551123 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800dbe0 con 0x7f6a2014b1e0 2023-07-27T14:31:57.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.714+0000 7f6a15ffb700 1 -- 172.21.15.115:0/2385551123 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1800f040 con 0x7f6a2014b1e0 2023-07-27T14:31:57.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.714+0000 7f6a15ffb700 1 -- 172.21.15.115:0/2385551123 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a180133f0 con 0x7f6a2014b1e0 2023-07-27T14:31:57.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.714+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a200c1cf0 con 0x7f6a2014b1e0 2023-07-27T14:31:57.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.714+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a200c22b0 con 0x7f6a2014b1e0 2023-07-27T14:31:57.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.715+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a200c27b0 con 0x7f6a2014b1e0 2023-07-27T14:31:57.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.716+0000 7f6a15ffb700 1 -- 172.21.15.115:0/2385551123 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f6a180137a0 con 0x7f6a2014b1e0 2023-07-27T14:31:57.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.717+0000 7f6a15ffb700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a0405f2a0 0x7f6a04061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:57.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.717+0000 7f6a15ffb700 1 -- 172.21.15.115:0/2385551123 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f6a1807a830 con 0x7f6a2014b1e0 2023-07-27T14:31:57.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.717+0000 7f6a2599b700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a0405f2a0 0x7f6a04061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:57.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.718+0000 7f6a2599b700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a0405f2a0 0x7f6a04061760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f6a200a18f0 tx=0x7f6a1c007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:57.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.721+0000 7f6a15ffb700 1 -- 172.21.15.115:0/2385551123 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6a1804ba70 con 0x7f6a2014b1e0 2023-07-27T14:31:57.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.927+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000313812", "snap_name": "snapshot_0000000000764682", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a2006c470 con 0x7f6a0405f2a0 2023-07-27T14:31:57.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.960+0000 7f6a15ffb700 1 -- 172.21.15.115:0/2385551123 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6a2006c470 con 0x7f6a0405f2a0 2023-07-27T14:31:57.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a0405f2a0 msgr2=0x7f6a04061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a0405f2a0 0x7f6a04061760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f6a200a18f0 tx=0x7f6a1c007bb0).stop 2023-07-27T14:31:57.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a2014b1e0 msgr2=0x7f6a200c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:57.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a2014b1e0 0x7f6a200c9e80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f6a18009f90 tx=0x7f6a180099b0).stop 2023-07-27T14:31:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 shutdown_connections 2023-07-27T14:31:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6a0405f2a0 0x7f6a04061760 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a2014b1e0 0x7f6a200c9e80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6a20063260 0x7f6a20148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 --2- 172.21.15.115:0/2385551123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a2014ae00 0x7f6a200c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.962+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 >> 172.21.15.115:0/2385551123 conn(0x7f6a2005e940 msgr2=0x7f6a200ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.963+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 shutdown_connections 2023-07-27T14:31:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:57.963+0000 7f6a27bff700 1 -- 172.21.15.115:0/2385551123 wait complete. 2023-07-27T14:31:58.014 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000313812 2023-07-27T14:31:58.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.168+0000 7f7ee61ff700 1 Processor -- start 2023-07-27T14:31:58.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.168+0000 7f7ee61ff700 1 -- start start 2023-07-27T14:31:58.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7ee61ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7ee61ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee01553f0 con 0x7f7ee0063260 2023-07-27T14:31:58.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7ee61ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0157a50 con 0x7f7ee014ae00 2023-07-27T14:31:58.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7ee61ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0157d10 con 0x7f7ee014b1e0 2023-07-27T14:31:58.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7edeffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7ee0063260 0x7f7ee00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51686/0 (socket says 172.21.15.115:51686) 2023-07-27T14:31:58.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7edeffd700 1 -- 172.21.15.115:0/652531996 learned_addr learned my addr 172.21.15.115:0/652531996 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:31:58.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7edffff700 1 --2- 172.21.15.115:0/652531996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7ede7fc700 1 -- 172.21.15.115:0/652531996 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119069198 0 0) 0x7f7ee01553f0 con 0x7f7ee0063260 2023-07-27T14:31:58.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.170+0000 7f7ede7fc700 1 -- 172.21.15.115:0/652531996 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec80033f0 con 0x7f7ee0063260 2023-07-27T14:31:58.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7ede7fc700 1 -- 172.21.15.115:0/652531996 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447180744 0 0) 0x7f7ee0157a50 con 0x7f7ee014ae00 2023-07-27T14:31:58.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7ede7fc700 1 -- 172.21.15.115:0/652531996 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee01553f0 con 0x7f7ee014ae00 2023-07-27T14:31:58.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7edffff700 1 -- 172.21.15.115:0/652531996 >> v1:172.21.15.159:6789/0 conn(0x7f7ee014ae00 legacy=0x7f7ee0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7edffff700 1 -- 172.21.15.115:0/652531996 >> v1:172.21.15.115:6789/0 conn(0x7f7ee0063260 legacy=0x7f7ee00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7ede7fc700 1 -- 172.21.15.115:0/652531996 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4262179054 0 0) 0x7f7ec80033f0 con 0x7f7ee0063260 2023-07-27T14:31:58.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7edffff700 1 -- 172.21.15.115:0/652531996 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0157ff0 con 0x7f7ee014b1e0 2023-07-27T14:31:58.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7edffff700 1 --2- 172.21.15.115:0/652531996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee0154f00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7ed8009e90 tx=0x7f7ed8009780).ready entity=mon.2 client_cookie=fe575eae3ab880f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:58.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7ede7fc700 1 -- 172.21.15.115:0/652531996 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800e070 con 0x7f7ee014b1e0 2023-07-27T14:31:58.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7ede7fc700 1 -- 172.21.15.115:0/652531996 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800b7a0 con 0x7f7ee014b1e0 2023-07-27T14:31:58.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.171+0000 7f7ede7fc700 1 -- 172.21.15.115:0/652531996 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4001470 con 0x7f7ee014b1e0 2023-07-27T14:31:58.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.172+0000 7f7ee61ff700 1 -- 172.21.15.115:0/652531996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 msgr2=0x7f7ee0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.172+0000 7f7ee61ff700 1 --2- 172.21.15.115:0/652531996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee0154f00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7ed8009e90 tx=0x7f7ed8009780).stop 2023-07-27T14:31:58.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.172+0000 7f7ee61ff700 1 -- 172.21.15.115:0/652531996 shutdown_connections 2023-07-27T14:31:58.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.172+0000 7f7ee61ff700 1 --2- 172.21.15.115:0/652531996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee0154f00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.172+0000 7f7ee61ff700 1 -- 172.21.15.115:0/652531996 >> 172.21.15.115:0/652531996 conn(0x7f7ee005e940 msgr2=0x7f7ee00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:58.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.172+0000 7f7ee61ff700 1 -- 172.21.15.115:0/652531996 shutdown_connections 2023-07-27T14:31:58.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.172+0000 7f7ee61ff700 1 -- 172.21.15.115:0/652531996 wait complete. 2023-07-27T14:31:58.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.174+0000 7f7ee61ff700 1 Processor -- start 2023-07-27T14:31:58.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.174+0000 7f7ee61ff700 1 -- start start 2023-07-27T14:31:58.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.175+0000 7f7ee61ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee0063260 0x7f7ee014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.175+0000 7f7ee61ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ee014ae00 0x7f7ee014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.175+0000 7f7ee61ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee00b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.175+0000 7f7ee61ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee014a380 con 0x7f7ee014ae00 2023-07-27T14:31:58.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.175+0000 7f7ee61ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0164be0 con 0x7f7ee0063260 2023-07-27T14:31:58.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.175+0000 7f7ee61ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0163d10 con 0x7f7ee014b1e0 2023-07-27T14:31:58.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ee014ae00 0x7f7ee014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ee014ae00 0x7f7ee014e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59798/0 (socket says 172.21.15.115:59798) 2023-07-27T14:31:58.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 -- 172.21.15.115:0/1221783960 learned_addr learned my addr 172.21.15.115:0/1221783960 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:58.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edf7fe700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee0063260 0x7f7ee014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edffff700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee00b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 -- 172.21.15.115:0/1221783960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 msgr2=0x7f7ee00b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee00b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 -- 172.21.15.115:0/1221783960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee0063260 msgr2=0x7f7ee014a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee0063260 0x7f7ee014a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 -- 172.21.15.115:0/1221783960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8009a20 con 0x7f7ee014ae00 2023-07-27T14:31:58.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7edeffd700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ee014ae00 0x7f7ee014e090 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f7ed400c790 tx=0x7f7ed4001a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:58.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7ec77fe700 1 -- 172.21.15.115:0/1221783960 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40072e0 con 0x7f7ee014ae00 2023-07-27T14:31:58.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7ec77fe700 1 -- 172.21.15.115:0/1221783960 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4007440 con 0x7f7ee014ae00 2023-07-27T14:31:58.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee0163fd0 con 0x7f7ee014ae00 2023-07-27T14:31:58.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.176+0000 7f7ec77fe700 1 -- 172.21.15.115:0/1221783960 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40057a0 con 0x7f7ee014ae00 2023-07-27T14:31:58.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.177+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee0164590 con 0x7f7ee014ae00 2023-07-27T14:31:58.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.178+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee006c470 con 0x7f7ee014ae00 2023-07-27T14:31:58.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.178+0000 7f7ec77fe700 1 -- 172.21.15.115:0/1221783960 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f7ed4010070 con 0x7f7ee014ae00 2023-07-27T14:31:58.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.179+0000 7f7ec77fe700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7ecc05f2a0 0x7f7ecc061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.179+0000 7f7ec77fe700 1 -- 172.21.15.115:0/1221783960 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f7ed4079a50 con 0x7f7ee014ae00 2023-07-27T14:31:58.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.179+0000 7f7edf7fe700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7ecc05f2a0 0x7f7ecc061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.180+0000 7f7edf7fe700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7ecc05f2a0 0x7f7ecc061760 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f7ee0155580 tx=0x7f7ed0007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:58.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.183+0000 7f7ec77fe700 1 -- 172.21.15.115:0/1221783960 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ed404ab80 con 0x7f7ee014ae00 2023-07-27T14:31:58.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.382+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000313812", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ee00c14c0 con 0x7f7ecc05f2a0 2023-07-27T14:31:58.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.399+0000 7f7ec77fe700 1 -- 172.21.15.115:0/1221783960 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7ee00c14c0 con 0x7f7ecc05f2a0 2023-07-27T14:31:58.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.401+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7ecc05f2a0 msgr2=0x7f7ecc061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.401+0000 7f7ee61ff700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7ecc05f2a0 0x7f7ecc061760 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f7ee0155580 tx=0x7f7ed0007bd0).stop 2023-07-27T14:31:58.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.401+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ee014ae00 msgr2=0x7f7ee014e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.401+0000 7f7ee61ff700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ee014ae00 0x7f7ee014e090 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f7ed400c790 tx=0x7f7ed4001a50).stop 2023-07-27T14:31:58.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.402+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 shutdown_connections 2023-07-27T14:31:58.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.402+0000 7f7ee61ff700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7ecc05f2a0 0x7f7ecc061760 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.402+0000 7f7ee61ff700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7ee014b1e0 0x7f7ee00b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.402+0000 7f7ee61ff700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ee0063260 0x7f7ee014a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.402+0000 7f7ee61ff700 1 --2- 172.21.15.115:0/1221783960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ee014ae00 0x7f7ee014e090 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.402+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 >> 172.21.15.115:0/1221783960 conn(0x7f7ee005e940 msgr2=0x7f7ee00ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:58.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.402+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 shutdown_connections 2023-07-27T14:31:58.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.402+0000 7f7ee61ff700 1 -- 172.21.15.115:0/1221783960 wait complete. 2023-07-27T14:31:58.440 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.406+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.441 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.406+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.441 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.406+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.441 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.406+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.441 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.406+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.457 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000520718 2023-07-27T14:31:58.458 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.423+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.458 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.423+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.458 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.423+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.458 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.423+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.459 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:58.423+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:58.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.638+0000 7f2a3ffff700 1 Processor -- start 2023-07-27T14:31:58.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.638+0000 7f2a3ffff700 1 -- start start 2023-07-27T14:31:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a40064520 0x7f2a4013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3ffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2a400680e0 0x7f2a400ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3ffff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4013bc70 con 0x7f2a400a88a0 2023-07-27T14:31:58.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3ffff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a400c3d10 con 0x7f2a40064520 2023-07-27T14:31:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3ffff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a400649b0 con 0x7f2a400680e0 2023-07-27T14:31:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3e7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a40064520 0x7f2a4013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3e7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2a40064520 0x7f2a4013b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59848/0 (socket says 172.21.15.115:59848) 2023-07-27T14:31:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3e7fc700 1 -- 172.21.15.115:0/858860235 learned_addr learned my addr 172.21.15.115:0/858860235 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.640+0000 7f2a3f7fe700 1 --2- 172.21.15.115:0/858860235 >> v2:172.21.15.159:3300/0 conn(0x7f2a400680e0 0x7f2a400ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.641+0000 7f2a3e7fc700 1 -- 172.21.15.115:0/858860235 >> v2:172.21.15.159:3300/0 conn(0x7f2a400680e0 msgr2=0x7f2a400ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:31:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.641+0000 7f2a3e7fc700 1 --2- 172.21.15.115:0/858860235 >> v2:172.21.15.159:3300/0 conn(0x7f2a400680e0 0x7f2a400ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.641+0000 7f2a3e7fc700 1 -- 172.21.15.115:0/858860235 >> v1:172.21.15.159:6789/0 conn(0x7f2a400a88a0 legacy=0x7f2a400679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.641+0000 7f2a3e7fc700 1 -- 172.21.15.115:0/858860235 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a40064c90 con 0x7f2a40064520 2023-07-27T14:31:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.641+0000 7f2a3e7fc700 1 --2- 172.21.15.115:0/858860235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a40064520 0x7f2a4013b780 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f2a400637e0 tx=0x7f2a340090f0).ready entity=mon.0 client_cookie=ccb2dcde32bcd4a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.641+0000 7f2a3dffb700 1 -- 172.21.15.115:0/858860235 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400b520 con 0x7f2a40064520 2023-07-27T14:31:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.641+0000 7f2a3dffb700 1 -- 172.21.15.115:0/858860235 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400b680 con 0x7f2a40064520 2023-07-27T14:31:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.641+0000 7f2a3dffb700 1 -- 172.21.15.115:0/858860235 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400ba00 con 0x7f2a40064520 2023-07-27T14:31:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.642+0000 7f2a3ffff700 1 -- 172.21.15.115:0/858860235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a40064520 msgr2=0x7f2a4013b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.642+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/858860235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a40064520 0x7f2a4013b780 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f2a400637e0 tx=0x7f2a340090f0).stop 2023-07-27T14:31:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.642+0000 7f2a3ffff700 1 -- 172.21.15.115:0/858860235 shutdown_connections 2023-07-27T14:31:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.642+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/858860235 >> v2:172.21.15.159:3300/0 conn(0x7f2a400680e0 0x7f2a400ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.642+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/858860235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a40064520 0x7f2a4013b780 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.642+0000 7f2a3ffff700 1 -- 172.21.15.115:0/858860235 >> 172.21.15.115:0/858860235 conn(0x7f2a400c6fe0 msgr2=0x7f2a400c2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:58.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.642+0000 7f2a3ffff700 1 -- 172.21.15.115:0/858860235 shutdown_connections 2023-07-27T14:31:58.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.642+0000 7f2a3ffff700 1 -- 172.21.15.115:0/858860235 wait complete. 2023-07-27T14:31:58.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.644+0000 7f2a3ffff700 1 Processor -- start 2023-07-27T14:31:58.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.644+0000 7f2a3ffff700 1 -- start start 2023-07-27T14:31:58.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a400680e0 0x7f2a40164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a400a88a0 0x7f2a40139ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a400a4cd0 0x7f2a400c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40165510 con 0x7f2a400a4cd0 2023-07-27T14:31:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3ffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4013a4c0 con 0x7f2a400a88a0 2023-07-27T14:31:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3ffff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4013a7a0 con 0x7f2a400680e0 2023-07-27T14:31:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a400a4cd0 0x7f2a400c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a400a4cd0 0x7f2a400c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59856/0 (socket says 172.21.15.115:59856) 2023-07-27T14:31:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.645+0000 7f2a3f7fe700 1 -- 172.21.15.115:0/1738710884 learned_addr learned my addr 172.21.15.115:0/1738710884 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:31:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3e7fc700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a400a88a0 0x7f2a40139ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3effd700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a400680e0 0x7f2a40164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3f7fe700 1 -- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a400680e0 msgr2=0x7f2a40164ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3f7fe700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a400680e0 0x7f2a40164ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3f7fe700 1 -- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a400a88a0 msgr2=0x7f2a40139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3f7fe700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a400a88a0 0x7f2a40139ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3f7fe700 1 -- 172.21.15.115:0/1738710884 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34009370 con 0x7f2a400a4cd0 2023-07-27T14:31:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3e7fc700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a400a88a0 0x7f2a40139ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:31:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3f7fe700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a400a4cd0 0x7f2a400c5450 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f2a38009ef0 tx=0x7f2a3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a26ffd700 1 -- 172.21.15.115:0/1738710884 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3800cc50 con 0x7f2a400a4cd0 2023-07-27T14:31:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a26ffd700 1 -- 172.21.15.115:0/1738710884 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3800f040 con 0x7f2a400a4cd0 2023-07-27T14:31:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4013aa80 con 0x7f2a400a4cd0 2023-07-27T14:31:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a26ffd700 1 -- 172.21.15.115:0/1738710884 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38013400 con 0x7f2a400a4cd0 2023-07-27T14:31:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.646+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4013a1d0 con 0x7f2a400a4cd0 2023-07-27T14:31:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.648+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a40047270 con 0x7f2a400a4cd0 2023-07-27T14:31:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.649+0000 7f2a26ffd700 1 -- 172.21.15.115:0/1738710884 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) v1 ==== 75962+0+0 (secure 0 0 0) 0x7f2a38013770 con 0x7f2a400a4cd0 2023-07-27T14:31:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.649+0000 7f2a26ffd700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2c05f2a0 0x7f2a2c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:31:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.650+0000 7f2a26ffd700 1 -- 172.21.15.115:0/1738710884 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f2a3807ae60 con 0x7f2a400a4cd0 2023-07-27T14:31:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.650+0000 7f2a3effd700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2c05f2a0 0x7f2a2c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:31:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.650+0000 7f2a3effd700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2c05f2a0 0x7f2a2c061760 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f2a300035a0 tx=0x7f2a30009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:31:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.654+0000 7f2a26ffd700 1 -- 172.21.15.115:0/1738710884 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a3804beb0 con 0x7f2a400a4cd0 2023-07-27T14:31:58.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.901+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000520718", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a40064f70 con 0x7f2a2c05f2a0 2023-07-27T14:31:58.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.919+0000 7f2a26ffd700 1 -- 172.21.15.115:0/1738710884 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2a40064f70 con 0x7f2a2c05f2a0 2023-07-27T14:31:58.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2c05f2a0 msgr2=0x7f2a2c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2c05f2a0 0x7f2a2c061760 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f2a300035a0 tx=0x7f2a30009040).stop 2023-07-27T14:31:58.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a400a4cd0 msgr2=0x7f2a400c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:31:58.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a400a4cd0 0x7f2a400c5450 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f2a38009ef0 tx=0x7f2a3800b040).stop 2023-07-27T14:31:58.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 shutdown_connections 2023-07-27T14:31:58.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2a2c05f2a0 0x7f2a2c061760 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a400a4cd0 0x7f2a400c5450 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a400680e0 0x7f2a40164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 --2- 172.21.15.115:0/1738710884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a400a88a0 0x7f2a40139ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:31:58.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 >> 172.21.15.115:0/1738710884 conn(0x7f2a400c6fe0 msgr2=0x7f2a400c0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:31:58.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 shutdown_connections 2023-07-27T14:31:58.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:31:58.921+0000 7f2a3ffff700 1 -- 172.21.15.115:0/1738710884 wait complete. 2023-07-27T14:31:58.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:31:58.981 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:31:59.139 INFO:teuthology.orchestra.run.smithi115.stdout:4 2023-07-27T14:31:59.151 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:59.117+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:59.151 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:59.117+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:59.151 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:59.117+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:59.151 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:59.117+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:59.152 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:31:59.117+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:31:59.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:31:59.572 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:32:04.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:32:04.142 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:32:04.238 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:32:04.239 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:32:04.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:32:04.343 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:32:04.461 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:32:04.462 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:32:04.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:32:04.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:32:04.587 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:32:04.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:04.587 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:32:04.637 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:32:04.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:32:04.637 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:32:04.728 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:32:04.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:04.729 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:32:04.776 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:04.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.931+0000 7feea8dff700 1 Processor -- start 2023-07-27T14:32:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.932+0000 7feea8dff700 1 -- start start 2023-07-27T14:32:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.933+0000 7feea8dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea41542a0 0x7feea415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.933+0000 7feea8dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40aa4d0 con 0x7feea40aaa40 2023-07-27T14:32:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.933+0000 7feea8dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40c05c0 con 0x7feea4153ec0 2023-07-27T14:32:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.933+0000 7feea8dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea40c1a60 con 0x7feea41542a0 2023-07-27T14:32:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.933+0000 7feea1d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7feea40aaa40 0x7feea40640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58696/0 (socket says 172.21.15.115:58696) 2023-07-27T14:32:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.933+0000 7feea1d9b700 1 -- 172.21.15.115:0/3045983163 learned_addr learned my addr 172.21.15.115:0/3045983163 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.933+0000 7feea2d9d700 1 --2- 172.21.15.115:0/3045983163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea41542a0 0x7feea415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea159a700 1 -- 172.21.15.115:0/3045983163 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757218218 0 0) 0x7fee98001110 con 0x7feea40aaa40 2023-07-27T14:32:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea159a700 1 -- 172.21.15.115:0/3045983163 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee8c0033f0 con 0x7feea40aaa40 2023-07-27T14:32:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea159a700 1 -- 172.21.15.115:0/3045983163 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836461108 0 0) 0x7feea40c05c0 con 0x7feea4153ec0 2023-07-27T14:32:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea159a700 1 -- 172.21.15.115:0/3045983163 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee98001110 con 0x7feea4153ec0 2023-07-27T14:32:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea2d9d700 1 -- 172.21.15.115:0/3045983163 >> v1:172.21.15.159:6789/0 conn(0x7feea4153ec0 legacy=0x7feea40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea2d9d700 1 -- 172.21.15.115:0/3045983163 >> v1:172.21.15.115:6789/0 conn(0x7feea40aaa40 legacy=0x7feea40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea2d9d700 1 -- 172.21.15.115:0/3045983163 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40aa270 con 0x7feea41542a0 2023-07-27T14:32:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea2d9d700 1 --2- 172.21.15.115:0/3045983163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea41542a0 0x7feea415efc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fee9c009e90 tx=0x7fee9c009780).ready entity=mon.2 client_cookie=9961f35af5da522e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea159a700 1 -- 172.21.15.115:0/3045983163 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00e070 con 0x7feea41542a0 2023-07-27T14:32:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea159a700 1 -- 172.21.15.115:0/3045983163 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00bab0 con 0x7feea41542a0 2023-07-27T14:32:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.934+0000 7feea159a700 1 -- 172.21.15.115:0/3045983163 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00be30 con 0x7feea41542a0 2023-07-27T14:32:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.935+0000 7feea8dff700 1 -- 172.21.15.115:0/3045983163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea41542a0 msgr2=0x7feea415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.935+0000 7feea8dff700 1 --2- 172.21.15.115:0/3045983163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea41542a0 0x7feea415efc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fee9c009e90 tx=0x7fee9c009780).stop 2023-07-27T14:32:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.935+0000 7feea8dff700 1 -- 172.21.15.115:0/3045983163 shutdown_connections 2023-07-27T14:32:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.935+0000 7feea8dff700 1 --2- 172.21.15.115:0/3045983163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea41542a0 0x7feea415efc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:04.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.935+0000 7feea8dff700 1 -- 172.21.15.115:0/3045983163 >> 172.21.15.115:0/3045983163 conn(0x7feea40cb610 msgr2=0x7feea40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:04.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.935+0000 7feea8dff700 1 -- 172.21.15.115:0/3045983163 shutdown_connections 2023-07-27T14:32:04.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.935+0000 7feea8dff700 1 -- 172.21.15.115:0/3045983163 wait complete. 2023-07-27T14:32:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.937+0000 7feea8dff700 1 Processor -- start 2023-07-27T14:32:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.937+0000 7feea8dff700 1 -- start start 2023-07-27T14:32:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea8dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea40aaa40 0x7feea40ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea8dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea4153ec0 0x7feea4146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea8dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feea41542a0 0x7feea4149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea8dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea40ae230 con 0x7feea41542a0 2023-07-27T14:32:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea8dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea414a590 con 0x7feea40aaa40 2023-07-27T14:32:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea8dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea40adbe0 con 0x7feea4153ec0 2023-07-27T14:32:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feea41542a0 0x7feea4149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feea41542a0 0x7feea4149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56822/0 (socket says 172.21.15.115:56822) 2023-07-27T14:32:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea2d9d700 1 -- 172.21.15.115:0/485590028 learned_addr learned my addr 172.21.15.115:0/485590028 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:04.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea1d9b700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea4153ec0 0x7feea4146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:04.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea259c700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea40aaa40 0x7feea40ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:04.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea2d9d700 1 -- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea4153ec0 msgr2=0x7feea4146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:04.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea2d9d700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea4153ec0 0x7feea4146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:04.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea2d9d700 1 -- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea40aaa40 msgr2=0x7feea40ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:04.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea2d9d700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea40aaa40 0x7feea40ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:04.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea2d9d700 1 -- 172.21.15.115:0/485590028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c009a20 con 0x7feea41542a0 2023-07-27T14:32:04.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.938+0000 7feea259c700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea40aaa40 0x7feea40ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:04.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.939+0000 7feea2d9d700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feea41542a0 0x7feea4149c20 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fee9c011000 tx=0x7fee9c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:04.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.939+0000 7fee927fc700 1 -- 172.21.15.115:0/485590028 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c01c660 con 0x7feea41542a0 2023-07-27T14:32:04.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.939+0000 7fee927fc700 1 -- 172.21.15.115:0/485590028 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c01c7c0 con 0x7feea41542a0 2023-07-27T14:32:04.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.939+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea40adec0 con 0x7feea41542a0 2023-07-27T14:32:04.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.939+0000 7fee927fc700 1 -- 172.21.15.115:0/485590028 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c01cb80 con 0x7feea41542a0 2023-07-27T14:32:04.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.939+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea414a870 con 0x7feea41542a0 2023-07-27T14:32:04.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.940+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea414aa00 con 0x7feea41542a0 2023-07-27T14:32:04.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.941+0000 7fee927fc700 1 -- 172.21.15.115:0/485590028 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fee9c027460 con 0x7feea41542a0 2023-07-27T14:32:04.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.941+0000 7fee927fc700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8405f340 0x7fee84061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:04.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.942+0000 7fee927fc700 1 -- 172.21.15.115:0/485590028 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fee9c07c720 con 0x7feea41542a0 2023-07-27T14:32:04.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.942+0000 7feea259c700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8405f340 0x7fee84061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:04.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.942+0000 7feea259c700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8405f340 0x7fee84061800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fee94007fd0 tx=0x7fee94009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:04.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:04.946+0000 7fee927fc700 1 -- 172.21.15.115:0/485590028 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fee9c04d7e0 con 0x7feea41542a0 2023-07-27T14:32:05.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.157+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feea406c470 con 0x7feea41542a0 2023-07-27T14:32:05.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.157+0000 7fee927fc700 1 -- 172.21.15.115:0/485590028 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fee9c050e00 con 0x7feea41542a0 2023-07-27T14:32:05.192 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:05.193 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4214348897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":4214348897},{"type":"v1","addr":"172.21.15.115:6837","nonce":4214348897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/445956953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":445956953},{"type":"v1","addr":"172.21.15.159:6834","nonce":445956953}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4278535768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":4278535768},{"type":"v1","addr":"172.21.15.159:6835","nonce":4278535768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:31:17.215158+0000","modified":"2023-07-27T14:31:20.233120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3446022806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3446022806},{"type":"v1","addr":"172.21.15.115:6835","nonce":3446022806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-07-27T14:32:05.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8405f340 msgr2=0x7fee84061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8405f340 0x7fee84061800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fee94007fd0 tx=0x7fee94009040).stop 2023-07-27T14:32:05.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feea41542a0 msgr2=0x7feea4149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feea41542a0 0x7feea4149c20 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fee9c011000 tx=0x7fee9c009780).stop 2023-07-27T14:32:05.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 shutdown_connections 2023-07-27T14:32:05.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee8405f340 0x7fee84061800 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feea41542a0 0x7feea4149c20 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea40aaa40 0x7feea40ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.159+0000 7feea8dff700 1 --2- 172.21.15.115:0/485590028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feea4153ec0 0x7feea4146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.160+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 >> 172.21.15.115:0/485590028 conn(0x7feea40cb610 msgr2=0x7feea40ab720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:05.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.160+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 shutdown_connections 2023-07-27T14:32:05.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.160+0000 7feea8dff700 1 -- 172.21.15.115:0/485590028 wait complete. 2023-07-27T14:32:05.196 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 43 2023-07-27T14:32:05.211 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:05.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.368+0000 7f9a0abff700 1 Processor -- start 2023-07-27T14:32:05.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.368+0000 7f9a0abff700 1 -- start start 2023-07-27T14:32:05.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.369+0000 7f9a0abff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a040aaa40 0x7f9a040640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.369+0000 7f9a0abff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a041542a0 0x7f9a040645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.369+0000 7f9a0abff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a040aa4d0 con 0x7f9a04153ec0 2023-07-27T14:32:05.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.369+0000 7f9a0abff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a04064ad0 con 0x7f9a040aaa40 2023-07-27T14:32:05.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.369+0000 7f9a0abff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040c05c0 con 0x7f9a041542a0 2023-07-27T14:32:05.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.369+0000 7f9a03fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a040aaa40 0x7f9a040640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.369+0000 7f9a03fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a040aaa40 0x7f9a040640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56824/0 (socket says 172.21.15.115:56824) 2023-07-27T14:32:05.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.369+0000 7f9a03fff700 1 -- 172.21.15.115:0/145126708 learned_addr learned my addr 172.21.15.115:0/145126708 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:05.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a0919c700 1 --2- 172.21.15.115:0/145126708 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a041542a0 0x7f9a040645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a03fff700 1 -- 172.21.15.115:0/145126708 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a041542a0 msgr2=0x7f9a040645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:05.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a03fff700 1 --2- 172.21.15.115:0/145126708 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a041542a0 0x7f9a040645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a03fff700 1 -- 172.21.15.115:0/145126708 >> v1:172.21.15.159:6789/0 conn(0x7f9a04153ec0 legacy=0x7f9a040a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a03fff700 1 -- 172.21.15.115:0/145126708 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040c1a60 con 0x7f9a040aaa40 2023-07-27T14:32:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a03fff700 1 --2- 172.21.15.115:0/145126708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a040aaa40 0x7f9a040640f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f99f0006fd0 tx=0x7f99f00090f0).ready entity=mon.0 client_cookie=519754a2060eb71e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a037fe700 1 -- 172.21.15.115:0/145126708 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000b580 con 0x7f9a040aaa40 2023-07-27T14:32:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a037fe700 1 -- 172.21.15.115:0/145126708 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000b6e0 con 0x7f9a040aaa40 2023-07-27T14:32:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.370+0000 7f9a037fe700 1 -- 172.21.15.115:0/145126708 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000ba60 con 0x7f9a040aaa40 2023-07-27T14:32:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.371+0000 7f9a0abff700 1 -- 172.21.15.115:0/145126708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a040aaa40 msgr2=0x7f9a040640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.371+0000 7f9a0abff700 1 --2- 172.21.15.115:0/145126708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a040aaa40 0x7f9a040640f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f99f0006fd0 tx=0x7f99f00090f0).stop 2023-07-27T14:32:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.371+0000 7f9a0abff700 1 -- 172.21.15.115:0/145126708 shutdown_connections 2023-07-27T14:32:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.371+0000 7f9a0abff700 1 --2- 172.21.15.115:0/145126708 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a041542a0 0x7f9a040645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.371+0000 7f9a0abff700 1 --2- 172.21.15.115:0/145126708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a040aaa40 0x7f9a040640f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.371+0000 7f9a0abff700 1 -- 172.21.15.115:0/145126708 >> 172.21.15.115:0/145126708 conn(0x7f9a040cb610 msgr2=0x7f9a040c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.371+0000 7f9a0abff700 1 -- 172.21.15.115:0/145126708 shutdown_connections 2023-07-27T14:32:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.371+0000 7f9a0abff700 1 -- 172.21.15.115:0/145126708 wait complete. 2023-07-27T14:32:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.373+0000 7f9a0abff700 1 Processor -- start 2023-07-27T14:32:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.373+0000 7f9a0abff700 1 -- start start 2023-07-27T14:32:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.374+0000 7f9a0abff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a040aaa40 0x7f9a04152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.374+0000 7f9a0abff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04153ec0 0x7f9a0414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.374+0000 7f9a0abff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a041542a0 0x7f9a041407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.374+0000 7f9a0abff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0414e870 con 0x7f9a04153ec0 2023-07-27T14:32:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.374+0000 7f9a0abff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0414eb20 con 0x7f9a041542a0 2023-07-27T14:32:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.374+0000 7f9a0abff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0414ee00 con 0x7f9a040aaa40 2023-07-27T14:32:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04153ec0 0x7f9a0414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04153ec0 0x7f9a0414e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56832/0 (socket says 172.21.15.115:56832) 2023-07-27T14:32:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 -- 172.21.15.115:0/3009464873 learned_addr learned my addr 172.21.15.115:0/3009464873 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 -- 172.21.15.115:0/3009464873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a040aaa40 msgr2=0x7f9a04152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a040aaa40 0x7f9a04152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 -- 172.21.15.115:0/3009464873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a041542a0 msgr2=0x7f9a041407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a041542a0 0x7f9a041407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 -- 172.21.15.115:0/3009464873 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009370 con 0x7f9a04153ec0 2023-07-27T14:32:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a03fff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04153ec0 0x7f9a0414e380 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f99f0009130 tx=0x7f99f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.375+0000 7f9a00ff9700 1 -- 172.21.15.115:0/3009464873 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000b850 con 0x7f9a04153ec0 2023-07-27T14:32:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.376+0000 7f9a00ff9700 1 -- 172.21.15.115:0/3009464873 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000b9b0 con 0x7f9a04153ec0 2023-07-27T14:32:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.376+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0414f0e0 con 0x7f9a04153ec0 2023-07-27T14:32:05.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.376+0000 7f9a00ff9700 1 -- 172.21.15.115:0/3009464873 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f001c670 con 0x7f9a04153ec0 2023-07-27T14:32:05.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.376+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0414f6a0 con 0x7f9a04153ec0 2023-07-27T14:32:05.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.377+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a040b0be0 con 0x7f9a04153ec0 2023-07-27T14:32:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.377+0000 7f9a00ff9700 1 -- 172.21.15.115:0/3009464873 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f99f002c070 con 0x7f9a04153ec0 2023-07-27T14:32:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.378+0000 7f9a00ff9700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f370 0x7f99e8061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.378+0000 7f9a00ff9700 1 -- 172.21.15.115:0/3009464873 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f99f007bee0 con 0x7f9a04153ec0 2023-07-27T14:32:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.378+0000 7f9a0899b700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f370 0x7f99e8061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.379+0000 7f9a0899b700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f370 0x7f99e8061830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f99f8001510 tx=0x7f99f80079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:05.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.382+0000 7f9a00ff9700 1 -- 172.21.15.115:0/3009464873 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99f004cf50 con 0x7f9a04153ec0 2023-07-27T14:32:05.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.554+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a041568b0 con 0x7f9a04153ec0 2023-07-27T14:32:05.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.555+0000 7f9a00ff9700 1 -- 172.21.15.115:0/3009464873 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+17283 (secure 0 0 0) 0x7f99f002a070 con 0x7f9a04153ec0 2023-07-27T14:32:05.590 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:05.591 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":87,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:02.739499+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:31:15.629735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-27T14:31:16.202513+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":87,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1c","mappings":[{"from":6,"to":0}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:05.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f370 msgr2=0x7f99e8061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f370 0x7f99e8061830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f99f8001510 tx=0x7f99f80079c0).stop 2023-07-27T14:32:05.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04153ec0 msgr2=0x7f9a0414e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04153ec0 0x7f9a0414e380 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f99f0009130 tx=0x7f99f0017000).stop 2023-07-27T14:32:05.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 shutdown_connections 2023-07-27T14:32:05.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f370 0x7f99e8061830 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a041542a0 0x7f9a041407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:05.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a040aaa40 0x7f9a04152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:05.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 --2- 172.21.15.115:0/3009464873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04153ec0 0x7f9a0414e380 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 >> 172.21.15.115:0/3009464873 conn(0x7f9a040cb610 msgr2=0x7f9a040ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:05.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 shutdown_connections 2023-07-27T14:32:05.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.558+0000 7f9a0abff700 1 -- 172.21.15.115:0/3009464873 wait complete. 2023-07-27T14:32:05.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:31:15.629735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:31:16.202513+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 87, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:32:05.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:32:05.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.768+0000 7f3ec59ff700 1 Processor -- start 2023-07-27T14:32:05.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.768+0000 7f3ec59ff700 1 -- start start 2023-07-27T14:32:05.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3ec59ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 0x7f3ec0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3ec59ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec01553f0 con 0x7f3ec014ae00 2023-07-27T14:32:05.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3ec59ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec0157a50 con 0x7f3ec014b1e0 2023-07-27T14:32:05.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3ec59ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0157d10 con 0x7f3ec0063260 2023-07-27T14:32:05.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3ebeffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3ec014ae00 0x7f3ec0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58708/0 (socket says 172.21.15.115:58708) 2023-07-27T14:32:05.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3ebeffd700 1 -- 172.21.15.115:0/3974276172 learned_addr learned my addr 172.21.15.115:0/3974276172 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:05.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832178866 0 0) 0x7f3ec01553f0 con 0x7f3ec014ae00 2023-07-27T14:32:05.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3eb7fff700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 0x7f3ec0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.770+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eac0033f0 con 0x7f3ec014ae00 2023-07-27T14:32:05.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2636621029 0 0) 0x7f3eac0033f0 con 0x7f3ec014ae00 2023-07-27T14:32:05.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 msgr2=0x7f3ec0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:05.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 0x7f3ec0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 >> v1:172.21.15.159:6789/0 conn(0x7f3ec014b1e0 legacy=0x7f3ec00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0157ff0 con 0x7f3ec014ae00 2023-07-27T14:32:05.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f3eb0001470 con 0x7f3ec014ae00 2023-07-27T14:32:05.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 >> v1:172.21.15.115:6789/0 conn(0x7f3ec014ae00 legacy=0x7f3ec0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3eac003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 0x7f3eac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eac004b80 0x7f3eac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0157d10 con 0x7f3eac003910 2023-07-27T14:32:05.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac00b910 con 0x7f3eac004b80 2023-07-27T14:32:05.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac00bad0 con 0x7f3ec0063260 2023-07-27T14:32:05.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebeffd700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3eac003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3eb7fff700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 0x7f3eac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebf7fe700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eac004b80 0x7f3eac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebeffd700 1 -- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 msgr2=0x7f3eac004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:05.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebeffd700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 0x7f3eac004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebeffd700 1 -- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eac004b80 msgr2=0x7f3eac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:05.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.771+0000 7f3ebeffd700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eac004b80 0x7f3eac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ebeffd700 1 -- 172.21.15.115:0/3974276172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0033f0 con 0x7f3eac003910 2023-07-27T14:32:05.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3eb7fff700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec0063260 0x7f3eac004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:05.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ebeffd700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3eac003d30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f3eb000c160 tx=0x7f3ec014eb20).ready entity=mon.0 client_cookie=e3347f4a8a53a63a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:05.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000ca90 con 0x7f3eac003910 2023-07-27T14:32:05.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb000cbf0 con 0x7f3eac003910 2023-07-27T14:32:05.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ebe7fc700 1 -- 172.21.15.115:0/3974276172 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00070d0 con 0x7f3eac003910 2023-07-27T14:32:05.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ec59ff700 1 -- 172.21.15.115:0/3974276172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 msgr2=0x7f3eac003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ec59ff700 1 --2- 172.21.15.115:0/3974276172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3eac003d30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f3eb000c160 tx=0x7f3ec014eb20).stop 2023-07-27T14:32:05.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ebf7fe700 1 -- 172.21.15.115:0/3974276172 reap_dead start 2023-07-27T14:32:05.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ec59ff700 1 -- 172.21.15.115:0/3974276172 shutdown_connections 2023-07-27T14:32:05.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.772+0000 7f3ec59ff700 1 -- 172.21.15.115:0/3974276172 >> 172.21.15.115:0/3974276172 conn(0x7f3ec005e940 msgr2=0x7f3ec00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:05.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.773+0000 7f3ec59ff700 1 -- 172.21.15.115:0/3974276172 shutdown_connections 2023-07-27T14:32:05.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.773+0000 7f3ec59ff700 1 -- 172.21.15.115:0/3974276172 wait complete. 2023-07-27T14:32:05.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.774+0000 7f3ec59ff700 1 Processor -- start 2023-07-27T14:32:05.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.774+0000 7f3ec59ff700 1 -- start start 2023-07-27T14:32:05.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ec59ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3ec00c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ec59ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec00c2140 0x7f3ec00c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ec59ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec00c43a0 0x7f3ec00c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ec59ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec01390b0 con 0x7f3eac003910 2023-07-27T14:32:05.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ec59ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00ae680 con 0x7f3ec00c43a0 2023-07-27T14:32:05.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ec59ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00aef20 con 0x7f3ec00c2140 2023-07-27T14:32:05.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ebeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3ec00c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ebeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3ec00c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56848/0 (socket says 172.21.15.115:56848) 2023-07-27T14:32:05.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ebeffd700 1 -- 172.21.15.115:0/2891410937 learned_addr learned my addr 172.21.15.115:0/2891410937 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:05.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3eb7fff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec00c2140 0x7f3ec00c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.775+0000 7f3ebf7fe700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec00c43a0 0x7f3ec00c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3ebeffd700 1 -- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec00c2140 msgr2=0x7f3ec00c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3ebeffd700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec00c2140 0x7f3ec00c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3ebeffd700 1 -- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec00c43a0 msgr2=0x7f3ec00c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3ebeffd700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec00c43a0 0x7f3ec00c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3ebeffd700 1 -- 172.21.15.115:0/2891410937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec00c25c0 con 0x7f3eac003910 2023-07-27T14:32:05.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3eb7fff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec00c2140 0x7f3ec00c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:05.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3ebeffd700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3ec00c1c50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f3eb0007b40 tx=0x7f3eb0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:05.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3eb6ffd700 1 -- 172.21.15.115:0/2891410937 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00017a0 con 0x7f3eac003910 2023-07-27T14:32:05.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3eb6ffd700 1 -- 172.21.15.115:0/2891410937 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb00046b0 con 0x7f3eac003910 2023-07-27T14:32:05.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec00ac360 con 0x7f3eac003910 2023-07-27T14:32:05.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3eb6ffd700 1 -- 172.21.15.115:0/2891410937 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0004a50 con 0x7f3eac003910 2023-07-27T14:32:05.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.776+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec00aebb0 con 0x7f3eac003910 2023-07-27T14:32:05.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.777+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec00af200 con 0x7f3eac003910 2023-07-27T14:32:05.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.778+0000 7f3eb6ffd700 1 -- 172.21.15.115:0/2891410937 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f3eb0010070 con 0x7f3eac003910 2023-07-27T14:32:05.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.779+0000 7f3eb6ffd700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ea005f370 0x7f3ea0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:05.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.779+0000 7f3eb6ffd700 1 -- 172.21.15.115:0/2891410937 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f3eb007a980 con 0x7f3eac003910 2023-07-27T14:32:05.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.779+0000 7f3eb7fff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ea005f370 0x7f3ea0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:05.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.779+0000 7f3eb7fff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ea005f370 0x7f3ea0061830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f3ea8006c40 tx=0x7f3ea8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:05.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.783+0000 7f3eb6ffd700 1 -- 172.21.15.115:0/2891410937 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3eb004b9f0 con 0x7f3eac003910 2023-07-27T14:32:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.950+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3ec006c470 con 0x7f3eac003910 2023-07-27T14:32:05.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.950+0000 7f3eb6ffd700 1 -- 172.21.15.115:0/2891410937 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v87) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3eb0025070 con 0x7f3eac003910 2023-07-27T14:32:05.985 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:32:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ea005f370 msgr2=0x7f3ea0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ea005f370 0x7f3ea0061830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f3ea8006c40 tx=0x7f3ea8008040).stop 2023-07-27T14:32:05.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 msgr2=0x7f3ec00c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3ec00c1c50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f3eb0007b40 tx=0x7f3eb0015000).stop 2023-07-27T14:32:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 shutdown_connections 2023-07-27T14:32:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ea005f370 0x7f3ea0061830 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec00c43a0 0x7f3ec00c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3eac003910 0x7f3ec00c1c50 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 --2- 172.21.15.115:0/2891410937 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3ec00c2140 0x7f3ec00c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:05.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 >> 172.21.15.115:0/2891410937 conn(0x7f3ec005e940 msgr2=0x7f3ec00a9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:05.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.952+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 shutdown_connections 2023-07-27T14:32:05.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:05.953+0000 7f3ec59ff700 1 -- 172.21.15.115:0/2891410937 wait complete. 2023-07-27T14:32:06.005 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:32:06.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.162+0000 7f61295ff700 1 Processor -- start 2023-07-27T14:32:06.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.163+0000 7f61295ff700 1 -- start start 2023-07-27T14:32:06.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.164+0000 7f61295ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6124153e00 0x7f61240c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.164+0000 7f61295ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124065de0 0x7f6124062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.164+0000 7f61295ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6124064a80 con 0x7f6124064230 2023-07-27T14:32:06.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.164+0000 7f61295ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6124062320 con 0x7f6124153e00 2023-07-27T14:32:06.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.164+0000 7f61295ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6124064d60 con 0x7f6124065de0 2023-07-27T14:32:06.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.164+0000 7f61237fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124065de0 0x7f6124062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.164+0000 7f6122ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6124153e00 0x7f61240c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.164+0000 7f61227fc700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f6124064230 0x7f61240656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:36152/0 (socket says 172.21.15.115:36152) 2023-07-27T14:32:06.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f61227fc700 1 -- 172.21.15.115:0/3050126403 learned_addr learned my addr 172.21.15.115:0/3050126403 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:06.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6122ffd700 1 -- 172.21.15.115:0/3050126403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124065de0 msgr2=0x7f6124062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:06.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6122ffd700 1 --2- 172.21.15.115:0/3050126403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124065de0 0x7f6124062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6122ffd700 1 -- 172.21.15.115:0/3050126403 >> v1:172.21.15.159:6789/0 conn(0x7f6124064230 legacy=0x7f61240656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6122ffd700 1 -- 172.21.15.115:0/3050126403 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124065040 con 0x7f6124153e00 2023-07-27T14:32:06.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6121ffb700 1 -- 172.21.15.115:0/3050126403 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995727806 0 0) 0x7f6124064a80 con 0x7f6124064230 2023-07-27T14:32:06.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6122ffd700 1 --2- 172.21.15.115:0/3050126403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124153e00 0x7f61240c6b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f6114009760 tx=0x7f6114009060).ready entity=mon.1 client_cookie=49a9b01f202e181e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:06.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6121ffb700 1 -- 172.21.15.115:0/3050126403 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400f510 con 0x7f6124153e00 2023-07-27T14:32:06.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6121ffb700 1 -- 172.21.15.115:0/3050126403 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611400f670 con 0x7f6124153e00 2023-07-27T14:32:06.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.165+0000 7f6121ffb700 1 -- 172.21.15.115:0/3050126403 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400f9f0 con 0x7f6124153e00 2023-07-27T14:32:06.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.166+0000 7f61295ff700 1 -- 172.21.15.115:0/3050126403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124153e00 msgr2=0x7f61240c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.166+0000 7f61295ff700 1 --2- 172.21.15.115:0/3050126403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124153e00 0x7f61240c6b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f6114009760 tx=0x7f6114009060).stop 2023-07-27T14:32:06.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.166+0000 7f61295ff700 1 -- 172.21.15.115:0/3050126403 shutdown_connections 2023-07-27T14:32:06.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.166+0000 7f61295ff700 1 --2- 172.21.15.115:0/3050126403 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124065de0 0x7f6124062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.166+0000 7f61295ff700 1 --2- 172.21.15.115:0/3050126403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124153e00 0x7f61240c6b70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.166+0000 7f61295ff700 1 -- 172.21.15.115:0/3050126403 >> 172.21.15.115:0/3050126403 conn(0x7f61240c7b90 msgr2=0x7f61240c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:06.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.166+0000 7f61295ff700 1 -- 172.21.15.115:0/3050126403 shutdown_connections 2023-07-27T14:32:06.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.166+0000 7f61295ff700 1 -- 172.21.15.115:0/3050126403 wait complete. 2023-07-27T14:32:06.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.167+0000 7f61295ff700 1 Processor -- start 2023-07-27T14:32:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.168+0000 7f61295ff700 1 -- start start 2023-07-27T14:32:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.168+0000 7f61295ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6124064230 0x7f61241513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f61295ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124065de0 0x7f6124094480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f61295ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124153e00 0x7f61240a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f61295ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61240aa0c0 con 0x7f6124064230 2023-07-27T14:32:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f61295ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61240a86d0 con 0x7f6124065de0 2023-07-27T14:32:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f61295ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61240a89b0 con 0x7f6124153e00 2023-07-27T14:32:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6124064230 0x7f61241513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6124064230 0x7f61241513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56858/0 (socket says 172.21.15.115:56858) 2023-07-27T14:32:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 -- 172.21.15.115:0/2061478940 learned_addr learned my addr 172.21.15.115:0/2061478940 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f61227fc700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124065de0 0x7f6124094480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f61237fe700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124153e00 0x7f61240a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 -- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124153e00 msgr2=0x7f61240a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124153e00 0x7f61240a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 -- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124065de0 msgr2=0x7f6124094480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124065de0 0x7f6124094480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 -- 172.21.15.115:0/2061478940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140092a0 con 0x7f6124064230 2023-07-27T14:32:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f61227fc700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124065de0 0x7f6124094480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.169+0000 7f6122ffd700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6124064230 0x7f61241513d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f6114009e00 tx=0x7f6114017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.170+0000 7f610affd700 1 -- 172.21.15.115:0/2061478940 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400f7e0 con 0x7f6124064230 2023-07-27T14:32:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.170+0000 7f610affd700 1 -- 172.21.15.115:0/2061478940 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611400f940 con 0x7f6124064230 2023-07-27T14:32:06.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.170+0000 7f610affd700 1 -- 172.21.15.115:0/2061478940 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611401b660 con 0x7f6124064230 2023-07-27T14:32:06.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.170+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61240a8c90 con 0x7f6124064230 2023-07-27T14:32:06.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.170+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61240a8370 con 0x7f6124064230 2023-07-27T14:32:06.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.171+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612406c470 con 0x7f6124064230 2023-07-27T14:32:06.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.172+0000 7f610affd700 1 -- 172.21.15.115:0/2061478940 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f6114023030 con 0x7f6124064230 2023-07-27T14:32:06.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.172+0000 7f610affd700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f611005f3a0 0x7f6110061860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.173+0000 7f610affd700 1 -- 172.21.15.115:0/2061478940 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f611407b260 con 0x7f6124064230 2023-07-27T14:32:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.173+0000 7f61227fc700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f611005f3a0 0x7f6110061860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.173+0000 7f61227fc700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f611005f3a0 0x7f6110061860 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f6118007fd0 tx=0x7f6118009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.177+0000 7f610affd700 1 -- 172.21.15.115:0/2061478940 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f611404c1b0 con 0x7f6124064230 2023-07-27T14:32:06.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.345+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6124065320 con 0x7f6124064230 2023-07-27T14:32:06.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.345+0000 7f610affd700 1 -- 172.21.15.115:0/2061478940 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6114021020 con 0x7f6124064230 2023-07-27T14:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:32:06.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f611005f3a0 msgr2=0x7f6110061860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f611005f3a0 0x7f6110061860 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f6118007fd0 tx=0x7f6118009040).stop 2023-07-27T14:32:06.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6124064230 msgr2=0x7f61241513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6124064230 0x7f61241513d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f6114009e00 tx=0x7f6114017000).stop 2023-07-27T14:32:06.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 shutdown_connections 2023-07-27T14:32:06.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f611005f3a0 0x7f6110061860 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6124153e00 0x7f61240a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6124064230 0x7f61241513d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 --2- 172.21.15.115:0/2061478940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6124065de0 0x7f6124094480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 >> 172.21.15.115:0/2061478940 conn(0x7f61240c7b90 msgr2=0x7f61240c6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:06.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 shutdown_connections 2023-07-27T14:32:06.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.347+0000 7f61295ff700 1 -- 172.21.15.115:0/2061478940 wait complete. 2023-07-27T14:32:06.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:32:06.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.554+0000 7fd2a7fff700 1 Processor -- start 2023-07-27T14:32:06.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.554+0000 7fd2a7fff700 1 -- start start 2023-07-27T14:32:06.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.555+0000 7fd2a7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.555+0000 7fd2a7fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd2a0063260 0x7fd2a00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.555+0000 7fd2a7fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a01553f0 con 0x7fd2a014b1e0 2023-07-27T14:32:06.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.555+0000 7fd2a7fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a0157a50 con 0x7fd2a0063260 2023-07-27T14:32:06.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.555+0000 7fd2a7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0157d10 con 0x7fd2a014ae00 2023-07-27T14:32:06.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.555+0000 7fd2a559a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd2a014b1e0 0x7fd2a0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58718/0 (socket says 172.21.15.115:58718) 2023-07-27T14:32:06.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a559a700 1 -- 172.21.15.115:0/1455424076 learned_addr learned my addr 172.21.15.115:0/1455424076 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:06.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a5d9b700 1 --2- 172.21.15.115:0/1455424076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a659c700 1 --2- 172.21.15.115:0/1455424076 >> v2:172.21.15.159:3300/0 conn(0x7fd2a0063260 0x7fd2a00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a4d99700 1 -- 172.21.15.115:0/1455424076 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159451870 0 0) 0x7fd2a01553f0 con 0x7fd2a014b1e0 2023-07-27T14:32:06.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a4d99700 1 -- 172.21.15.115:0/1455424076 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd28c0033f0 con 0x7fd2a014b1e0 2023-07-27T14:32:06.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a5d9b700 1 -- 172.21.15.115:0/1455424076 >> v2:172.21.15.159:3300/0 conn(0x7fd2a0063260 msgr2=0x7fd2a00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:06.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a5d9b700 1 --2- 172.21.15.115:0/1455424076 >> v2:172.21.15.159:3300/0 conn(0x7fd2a0063260 0x7fd2a00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a5d9b700 1 -- 172.21.15.115:0/1455424076 >> v1:172.21.15.115:6789/0 conn(0x7fd2a014b1e0 legacy=0x7fd2a0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a5d9b700 1 -- 172.21.15.115:0/1455424076 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0157ff0 con 0x7fd2a014ae00 2023-07-27T14:32:06.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.556+0000 7fd2a5d9b700 1 --2- 172.21.15.115:0/1455424076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a0154f00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd29c009760 tx=0x7fd29c009060).ready entity=mon.2 client_cookie=dcd50127d52d4092 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:06.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a4d99700 1 -- 172.21.15.115:0/1455424076 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00d4a0 con 0x7fd2a014ae00 2023-07-27T14:32:06.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a4d99700 1 -- 172.21.15.115:0/1455424076 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c00d600 con 0x7fd2a014ae00 2023-07-27T14:32:06.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a4d99700 1 -- 172.21.15.115:0/1455424076 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00d980 con 0x7fd2a014ae00 2023-07-27T14:32:06.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1455424076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 msgr2=0x7fd2a0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1455424076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a0154f00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd29c009760 tx=0x7fd29c009060).stop 2023-07-27T14:32:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1455424076 shutdown_connections 2023-07-27T14:32:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1455424076 >> v2:172.21.15.159:3300/0 conn(0x7fd2a0063260 0x7fd2a00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1455424076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a0154f00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1455424076 >> 172.21.15.115:0/1455424076 conn(0x7fd2a005e940 msgr2=0x7fd2a00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1455424076 shutdown_connections 2023-07-27T14:32:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.557+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1455424076 wait complete. 2023-07-27T14:32:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.559+0000 7fd2a7fff700 1 Processor -- start 2023-07-27T14:32:06.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.559+0000 7fd2a7fff700 1 -- start start 2023-07-27T14:32:06.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2a0063260 0x7fd2a0149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a00c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2a014b1e0 0x7fd2a00c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00c4780 con 0x7fd2a0063260 2023-07-27T14:32:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0167370 con 0x7fd2a014b1e0 2023-07-27T14:32:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0168190 con 0x7fd2a014ae00 2023-07-27T14:32:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2a0063260 0x7fd2a0149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2a0063260 0x7fd2a0149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56860/0 (socket says 172.21.15.115:56860) 2023-07-27T14:32:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a5d9b700 1 -- 172.21.15.115:0/1622275240 learned_addr learned my addr 172.21.15.115:0/1622275240 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a659c700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2a014b1e0 0x7fd2a00c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.560+0000 7fd2a559a700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a00c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd2a5d9b700 1 -- 172.21.15.115:0/1622275240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 msgr2=0x7fd2a00c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd2a5d9b700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a00c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd2a5d9b700 1 -- 172.21.15.115:0/1622275240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2a014b1e0 msgr2=0x7fd2a00c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd2a5d9b700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2a014b1e0 0x7fd2a00c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd2a5d9b700 1 -- 172.21.15.115:0/1622275240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0092a0 con 0x7fd2a0063260 2023-07-27T14:32:06.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd2a5d9b700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2a0063260 0x7fd2a0149830 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fd29c002ff0 tx=0x7fd29c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:06.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd295ffb700 1 -- 172.21.15.115:0/1622275240 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c000c90 con 0x7fd2a0063260 2023-07-27T14:32:06.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd295ffb700 1 -- 172.21.15.115:0/1622275240 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c00d770 con 0x7fd2a0063260 2023-07-27T14:32:06.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd295ffb700 1 -- 172.21.15.115:0/1622275240 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c01d430 con 0x7fd2a0063260 2023-07-27T14:32:06.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a0167580 con 0x7fd2a0063260 2023-07-27T14:32:06.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.561+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a0167b40 con 0x7fd2a0063260 2023-07-27T14:32:06.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.562+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a006c470 con 0x7fd2a0063260 2023-07-27T14:32:06.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.563+0000 7fd295ffb700 1 -- 172.21.15.115:0/1622275240 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fd29c00f070 con 0x7fd2a0063260 2023-07-27T14:32:06.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.564+0000 7fd295ffb700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd28405f370 0x7fd284061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.564+0000 7fd295ffb700 1 -- 172.21.15.115:0/1622275240 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fd29c07ba60 con 0x7fd2a0063260 2023-07-27T14:32:06.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.564+0000 7fd2a559a700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd28405f370 0x7fd284061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:06.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.564+0000 7fd2a559a700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd28405f370 0x7fd284061830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fd2a00c4b20 tx=0x7fd290009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:06.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.568+0000 7fd295ffb700 1 -- 172.21.15.115:0/1622275240 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd29c04caf0 con 0x7fd2a0063260 2023-07-27T14:32:06.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.740+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2a0152440 con 0x7fd2a0063260 2023-07-27T14:32:06.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.741+0000 7fd295ffb700 1 -- 172.21.15.115:0/1622275240 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd29c050110 con 0x7fd2a0063260 2023-07-27T14:32:06.776 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:32:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd28405f370 msgr2=0x7fd284061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd28405f370 0x7fd284061830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fd2a00c4b20 tx=0x7fd290009040).stop 2023-07-27T14:32:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2a0063260 msgr2=0x7fd2a0149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2a0063260 0x7fd2a0149830 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fd29c002ff0 tx=0x7fd29c016000).stop 2023-07-27T14:32:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 shutdown_connections 2023-07-27T14:32:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd28405f370 0x7fd284061830 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2a014b1e0 0x7fd2a00c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2a0063260 0x7fd2a0149830 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 --2- 172.21.15.115:0/1622275240 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2a014ae00 0x7fd2a00c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 >> 172.21.15.115:0/1622275240 conn(0x7fd2a005e940 msgr2=0x7fd2a00ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 shutdown_connections 2023-07-27T14:32:06.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.743+0000 7fd2a7fff700 1 -- 172.21.15.115:0/1622275240 wait complete. 2023-07-27T14:32:06.796 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:32:06.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.956+0000 7f7805dff700 1 Processor -- start 2023-07-27T14:32:06.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.956+0000 7f7805dff700 1 -- start start 2023-07-27T14:32:06.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.957+0000 7f7805dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7800063260 0x7f7800154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:06.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.957+0000 7f7805dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78001553f0 con 0x7f780014ae00 2023-07-27T14:32:06.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.957+0000 7f7805dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7800157a50 con 0x7f780014b1e0 2023-07-27T14:32:06.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.957+0000 7f7805dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7800157d10 con 0x7f7800063260 2023-07-27T14:32:07.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77ff7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f780014ae00 0x7f7800062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58732/0 (socket says 172.21.15.115:58732) 2023-07-27T14:32:07.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77ff7fe700 1 -- 172.21.15.115:0/3278563204 learned_addr learned my addr 172.21.15.115:0/3278563204 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:07.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77feffd700 1 --2- 172.21.15.115:0/3278563204 >> v2:172.21.15.159:3300/0 conn(0x7f7800063260 0x7f7800154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550089439 0 0) 0x7f78001553f0 con 0x7f780014ae00 2023-07-27T14:32:07.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e80033f0 con 0x7f780014ae00 2023-07-27T14:32:07.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 395650186 0 0) 0x7f77e80033f0 con 0x7f780014ae00 2023-07-27T14:32:07.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 >> v2:172.21.15.159:3300/0 conn(0x7f7800063260 msgr2=0x7f7800154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:07.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 --2- 172.21.15.115:0/3278563204 >> v2:172.21.15.159:3300/0 conn(0x7f7800063260 0x7f7800154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 >> v1:172.21.15.159:6789/0 conn(0x7f780014b1e0 legacy=0x7f78000a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800157ff0 con 0x7f780014ae00 2023-07-27T14:32:07.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f77f0001470 con 0x7f780014ae00 2023-07-27T14:32:07.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.958+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 >> v1:172.21.15.115:6789/0 conn(0x7f780014ae00 legacy=0x7f7800062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fe7fc700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e80038e0 0x7f77e8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fe7fc700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77e8004690 0x7f77e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fe7fc700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e8005000 0x7f77e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7800157d10 con 0x7f77e8005000 2023-07-27T14:32:07.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e800bf60 con 0x7f77e80038e0 2023-07-27T14:32:07.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e800c0f0 con 0x7f77e8004690 2023-07-27T14:32:07.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fffff700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e8005000 0x7f77e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77ff7fe700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e80038e0 0x7f77e8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77feffd700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77e8004690 0x7f77e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fffff700 1 -- 172.21.15.115:0/3278563204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77e8004690 msgr2=0x7f77e8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:07.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fffff700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77e8004690 0x7f77e8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fffff700 1 -- 172.21.15.115:0/3278563204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e80038e0 msgr2=0x7f77e8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:07.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fffff700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e80038e0 0x7f77e8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fffff700 1 -- 172.21.15.115:0/3278563204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80033f0 con 0x7f77e8005000 2023-07-27T14:32:07.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fffff700 1 -- 172.21.15.115:0/3278563204 reap_dead start 2023-07-27T14:32:07.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.959+0000 7f77fffff700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e8005000 0x7f77e800b8e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f77f8001e00 tx=0x7f77f8007f30).ready entity=mon.0 client_cookie=c01c30a6750e5787 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8006a20 con 0x7f77e8005000 2023-07-27T14:32:07.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f8006b80 con 0x7f77e8005000 2023-07-27T14:32:07.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f77fe7fc700 1 -- 172.21.15.115:0/3278563204 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800c5d0 con 0x7f77e8005000 2023-07-27T14:32:07.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f7805dff700 1 -- 172.21.15.115:0/3278563204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e8005000 msgr2=0x7f77e800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f7805dff700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e8005000 0x7f77e800b8e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f77f8001e00 tx=0x7f77f8007f30).stop 2023-07-27T14:32:07.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f7805dff700 1 -- 172.21.15.115:0/3278563204 shutdown_connections 2023-07-27T14:32:07.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f7805dff700 1 --2- 172.21.15.115:0/3278563204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77e8005000 0x7f77e800b8e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f7805dff700 1 -- 172.21.15.115:0/3278563204 >> 172.21.15.115:0/3278563204 conn(0x7f780005e940 msgr2=0x7f78000cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:07.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f7805dff700 1 -- 172.21.15.115:0/3278563204 shutdown_connections 2023-07-27T14:32:07.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.960+0000 7f7805dff700 1 -- 172.21.15.115:0/3278563204 wait complete. 2023-07-27T14:32:07.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.962+0000 7f7805dff700 1 Processor -- start 2023-07-27T14:32:07.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.962+0000 7f7805dff700 1 -- start start 2023-07-27T14:32:07.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f7805dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e8005000 0x7f780014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f7805dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f780014de40 0x7f7800149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f7805dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78000c0da0 0x7f78000c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f7805dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780014caa0 con 0x7f780014de40 2023-07-27T14:32:07.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f7805dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780014d8c0 con 0x7f77e8005000 2023-07-27T14:32:07.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f7805dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78000aca50 con 0x7f78000c0da0 2023-07-27T14:32:07.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f780014de40 0x7f7800149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f780014de40 0x7f7800149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56878/0 (socket says 172.21.15.115:56878) 2023-07-27T14:32:07.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 -- 172.21.15.115:0/2255626366 learned_addr learned my addr 172.21.15.115:0/2255626366 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:07.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 -- 172.21.15.115:0/2255626366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78000c0da0 msgr2=0x7f78000c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78000c0da0 0x7f78000c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:07.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 -- 172.21.15.115:0/2255626366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e8005000 msgr2=0x7f780014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e8005000 0x7f780014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:07.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 -- 172.21.15.115:0/2255626366 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78000c16f0 con 0x7f780014de40 2023-07-27T14:32:07.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.963+0000 7f77feffd700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f780014de40 0x7f7800149700 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f77f40119c0 tx=0x7f77f4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.964+0000 7f77e77fe700 1 -- 172.21.15.115:0/2255626366 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400f730 con 0x7f780014de40 2023-07-27T14:32:07.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.964+0000 7f77e77fe700 1 -- 172.21.15.115:0/2255626366 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f400f890 con 0x7f780014de40 2023-07-27T14:32:07.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.964+0000 7f77e77fe700 1 -- 172.21.15.115:0/2255626366 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400fc10 con 0x7f780014de40 2023-07-27T14:32:07.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.964+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780014ccb0 con 0x7f780014de40 2023-07-27T14:32:07.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.964+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780014d270 con 0x7f780014de40 2023-07-27T14:32:07.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.965+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780006c470 con 0x7f780014de40 2023-07-27T14:32:07.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.966+0000 7f77e77fe700 1 -- 172.21.15.115:0/2255626366 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f77f4024070 con 0x7f780014de40 2023-07-27T14:32:07.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.966+0000 7f77e77fe700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77ec05f340 0x7f77ec061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.966+0000 7f77e77fe700 1 -- 172.21.15.115:0/2255626366 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f77f407ad60 con 0x7f780014de40 2023-07-27T14:32:07.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.967+0000 7f77ff7fe700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77ec05f340 0x7f77ec061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.967+0000 7f77ff7fe700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77ec05f340 0x7f77ec061800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f77f0007bf0 tx=0x7f77f0001e50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:06.971+0000 7f77e77fe700 1 -- 172.21.15.115:0/2255626366 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77f404bdf0 con 0x7f780014de40 2023-07-27T14:32:07.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.144+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f780014da30 con 0x7f780014de40 2023-07-27T14:32:07.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.145+0000 7f77e77fe700 1 -- 172.21.15.115:0/2255626366 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77f404f410 con 0x7f780014de40 2023-07-27T14:32:07.180 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:32:07.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77ec05f340 msgr2=0x7f77ec061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77ec05f340 0x7f77ec061800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f77f0007bf0 tx=0x7f77f0001e50).stop 2023-07-27T14:32:07.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f780014de40 msgr2=0x7f7800149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f780014de40 0x7f7800149700 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f77f40119c0 tx=0x7f77f4009060).stop 2023-07-27T14:32:07.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 shutdown_connections 2023-07-27T14:32:07.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77ec05f340 0x7f77ec061800 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78000c0da0 0x7f78000c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:07.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77e8005000 0x7f780014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:07.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 --2- 172.21.15.115:0/2255626366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f780014de40 0x7f7800149700 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 >> 172.21.15.115:0/2255626366 conn(0x7f780005e940 msgr2=0x7f780014a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:07.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 shutdown_connections 2023-07-27T14:32:07.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.147+0000 7f7805dff700 1 -- 172.21.15.115:0/2255626366 wait complete. 2023-07-27T14:32:07.199 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:07.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.358+0000 7f3f927ff700 1 Processor -- start 2023-07-27T14:32:07.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.358+0000 7f3f927ff700 1 -- start start 2023-07-27T14:32:07.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.359+0000 7f3f927ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3f8c153ec0 0x7f3f8c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f927ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c0aaa40 0x7f3f8c0c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f927ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c0aa4d0 con 0x7f3f8c0aa050 2023-07-27T14:32:07.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f927ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c05c0 con 0x7f3f8c153ec0 2023-07-27T14:32:07.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f927ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0bfc90 con 0x7f3f8c0aaa40 2023-07-27T14:32:07.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f90d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c0aaa40 0x7f3f8c0c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f90d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c0aaa40 0x7f3f8c0c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:44672/0 (socket says 172.21.15.115:44672) 2023-07-27T14:32:07.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f90d9c700 1 -- 172.21.15.115:0/4076901812 learned_addr learned my addr 172.21.15.115:0/4076901812 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:07.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f8b7fe700 1 --1- 172.21.15.115:0/4076901812 >> v1:172.21.15.159:6789/0 conn(0x7f3f8c0aa050 0x7f3f8c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:36156/0 (socket says 172.21.15.115:36156) 2023-07-27T14:32:07.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.360+0000 7f3f8bfff700 1 --2- 172.21.15.115:0/4076901812 >> v2:172.21.15.159:3300/0 conn(0x7f3f8c153ec0 0x7f3f8c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f8affd700 1 -- 172.21.15.115:0/4076901812 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896474274 0 0) 0x7f3f80001110 con 0x7f3f8c0aa050 2023-07-27T14:32:07.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f8affd700 1 -- 172.21.15.115:0/4076901812 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f740033f0 con 0x7f3f8c0aa050 2023-07-27T14:32:07.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f90d9c700 1 -- 172.21.15.115:0/4076901812 >> v2:172.21.15.159:3300/0 conn(0x7f3f8c153ec0 msgr2=0x7f3f8c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:07.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f90d9c700 1 --2- 172.21.15.115:0/4076901812 >> v2:172.21.15.159:3300/0 conn(0x7f3f8c153ec0 0x7f3f8c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f90d9c700 1 -- 172.21.15.115:0/4076901812 >> v1:172.21.15.159:6789/0 conn(0x7f3f8c0aa050 legacy=0x7f3f8c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f90d9c700 1 -- 172.21.15.115:0/4076901812 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c0bff70 con 0x7f3f8c0aaa40 2023-07-27T14:32:07.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f8bfff700 1 --2- 172.21.15.115:0/4076901812 >> v2:172.21.15.159:3300/0 conn(0x7f3f8c153ec0 0x7f3f8c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:07.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f90d9c700 1 --2- 172.21.15.115:0/4076901812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c0aaa40 0x7f3f8c0c0a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3f84009f20 tx=0x7f3f84009840).ready entity=mon.2 client_cookie=25d924b98e90343e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f8affd700 1 -- 172.21.15.115:0/4076901812 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400e070 con 0x7f3f8c0aaa40 2023-07-27T14:32:07.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f8affd700 1 -- 172.21.15.115:0/4076901812 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400b970 con 0x7f3f8c0aaa40 2023-07-27T14:32:07.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.361+0000 7f3f8affd700 1 -- 172.21.15.115:0/4076901812 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400bcf0 con 0x7f3f8c0aaa40 2023-07-27T14:32:07.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.362+0000 7f3f927ff700 1 -- 172.21.15.115:0/4076901812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c0aaa40 msgr2=0x7f3f8c0c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.362+0000 7f3f927ff700 1 --2- 172.21.15.115:0/4076901812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c0aaa40 0x7f3f8c0c0a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3f84009f20 tx=0x7f3f84009840).stop 2023-07-27T14:32:07.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.362+0000 7f3f927ff700 1 -- 172.21.15.115:0/4076901812 shutdown_connections 2023-07-27T14:32:07.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.362+0000 7f3f927ff700 1 --2- 172.21.15.115:0/4076901812 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c0aaa40 0x7f3f8c0c0a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.362+0000 7f3f927ff700 1 --2- 172.21.15.115:0/4076901812 >> v2:172.21.15.159:3300/0 conn(0x7f3f8c153ec0 0x7f3f8c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.362+0000 7f3f927ff700 1 -- 172.21.15.115:0/4076901812 >> 172.21.15.115:0/4076901812 conn(0x7f3f8c0cb610 msgr2=0x7f3f8c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:07.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.362+0000 7f3f927ff700 1 -- 172.21.15.115:0/4076901812 shutdown_connections 2023-07-27T14:32:07.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.362+0000 7f3f927ff700 1 -- 172.21.15.115:0/4076901812 wait complete. 2023-07-27T14:32:07.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.364+0000 7f3f927ff700 1 Processor -- start 2023-07-27T14:32:07.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.364+0000 7f3f927ff700 1 -- start start 2023-07-27T14:32:07.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f927ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f8c0aa050 0x7f3f8c142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f927ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0aaa40 0x7f3f8c0a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f927ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c153ec0 0x7f3f8c0c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f927ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c2c00 con 0x7f3f8c0aa050 2023-07-27T14:32:07.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f927ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c1ff0 con 0x7f3f8c0aaa40 2023-07-27T14:32:07.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f927ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c22d0 con 0x7f3f8c153ec0 2023-07-27T14:32:07.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f8bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f8c0aa050 0x7f3f8c142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f8bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f8c0aa050 0x7f3f8c142030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56880/0 (socket says 172.21.15.115:56880) 2023-07-27T14:32:07.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f8bfff700 1 -- 172.21.15.115:0/2558412145 learned_addr learned my addr 172.21.15.115:0/2558412145 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:07.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f90d9c700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c153ec0 0x7f3f8c0c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.365+0000 7f3f8b7fe700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0aaa40 0x7f3f8c0a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f8bfff700 1 -- 172.21.15.115:0/2558412145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c153ec0 msgr2=0x7f3f8c0c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f8bfff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c153ec0 0x7f3f8c0c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f8bfff700 1 -- 172.21.15.115:0/2558412145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0aaa40 msgr2=0x7f3f8c0a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f8bfff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0aaa40 0x7f3f8c0a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f8bfff700 1 -- 172.21.15.115:0/2558412145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c0092a0 con 0x7f3f8c0aa050 2023-07-27T14:32:07.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f8bfff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f8c0aa050 0x7f3f8c142030 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f3f7c00e980 tx=0x7f3f7c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f73fff700 1 -- 172.21.15.115:0/2558412145 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c012600 con 0x7f3f8c0aa050 2023-07-27T14:32:07.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f73fff700 1 -- 172.21.15.115:0/2558412145 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c012760 con 0x7f3f8c0aa050 2023-07-27T14:32:07.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f84009ae0 con 0x7f3f8c0aa050 2023-07-27T14:32:07.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f73fff700 1 -- 172.21.15.115:0/2558412145 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c012ae0 con 0x7f3f8c0aa050 2023-07-27T14:32:07.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.366+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c0c2890 con 0x7f3f8c0aa050 2023-07-27T14:32:07.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.367+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c0c2ee0 con 0x7f3f8c0aa050 2023-07-27T14:32:07.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.368+0000 7f3f73fff700 1 -- 172.21.15.115:0/2558412145 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f3f7c022070 con 0x7f3f8c0aa050 2023-07-27T14:32:07.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.369+0000 7f3f73fff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f370 0x7f3f78061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.369+0000 7f3f73fff700 1 -- 172.21.15.115:0/2558412145 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f3f7c07a670 con 0x7f3f8c0aa050 2023-07-27T14:32:07.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.369+0000 7f3f8b7fe700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f370 0x7f3f78061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.369+0000 7f3f8b7fe700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f370 0x7f3f78061830 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f3f8c14fde0 tx=0x7f3f80007a30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.373+0000 7f3f73fff700 1 -- 172.21.15.115:0/2558412145 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f7c04b700 con 0x7f3f8c0aa050 2023-07-27T14:32:07.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.586+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f8c06c470 con 0x7f3f8c0aa050 2023-07-27T14:32:07.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.587+0000 7f3f73fff700 1 -- 172.21.15.115:0/2558412145 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f3f7c04ed20 con 0x7f3f8c0aa050 2023-07-27T14:32:07.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:07.623 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4214348897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":4214348897},{"type":"v1","addr":"172.21.15.115:6837","nonce":4214348897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/445956953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":445956953},{"type":"v1","addr":"172.21.15.159:6834","nonce":445956953}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4278535768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":4278535768},{"type":"v1","addr":"172.21.15.159:6835","nonce":4278535768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:31:17.215158+0000","modified":"2023-07-27T14:31:20.233120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3446022806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3446022806},{"type":"v1","addr":"172.21.15.115:6835","nonce":3446022806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-07-27T14:32:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f370 msgr2=0x7f3f78061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f370 0x7f3f78061830 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f3f8c14fde0 tx=0x7f3f80007a30).stop 2023-07-27T14:32:07.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f8c0aa050 msgr2=0x7f3f8c142030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f8c0aa050 0x7f3f8c142030 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f3f7c00e980 tx=0x7f3f7c009060).stop 2023-07-27T14:32:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 shutdown_connections 2023-07-27T14:32:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f7805f370 0x7f3f78061830 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f8c153ec0 0x7f3f8c0c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f8c0aa050 0x7f3f8c142030 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 --2- 172.21.15.115:0/2558412145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f8c0aaa40 0x7f3f8c0a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 >> 172.21.15.115:0/2558412145 conn(0x7f3f8c0cb610 msgr2=0x7f3f8c0ab2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:07.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 shutdown_connections 2023-07-27T14:32:07.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.589+0000 7f3f927ff700 1 -- 172.21.15.115:0/2558412145 wait complete. 2023-07-27T14:32:07.626 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 43 2023-07-27T14:32:07.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:07.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.796+0000 7f183d19d700 1 Processor -- start 2023-07-27T14:32:07.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.796+0000 7f183d19d700 1 -- start start 2023-07-27T14:32:07.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.797+0000 7f183d19d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1838062c00 0x7f1838063070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.797+0000 7f183d19d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18380c0bd0 con 0x7f1838153f90 2023-07-27T14:32:07.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.797+0000 7f183d19d700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1838063560 con 0x7f1838153bb0 2023-07-27T14:32:07.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.797+0000 7f183d19d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18380bffc0 con 0x7f1838062c00 2023-07-27T14:32:07.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.798+0000 7f183c99c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1838062c00 0x7f1838063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.798+0000 7f18377fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1838153f90 0x7f18380c1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58738/0 (socket says 172.21.15.115:58738) 2023-07-27T14:32:07.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.798+0000 7f18377fe700 1 -- 172.21.15.115:0/2145978413 learned_addr learned my addr 172.21.15.115:0/2145978413 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:07.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.798+0000 7f183c99c700 1 -- 172.21.15.115:0/2145978413 >> v1:172.21.15.159:6789/0 conn(0x7f1838153bb0 legacy=0x7f18380c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:07.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.798+0000 7f183c99c700 1 -- 172.21.15.115:0/2145978413 >> v1:172.21.15.115:6789/0 conn(0x7f1838153f90 legacy=0x7f18380c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.798+0000 7f183c99c700 1 -- 172.21.15.115:0/2145978413 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380c02a0 con 0x7f1838062c00 2023-07-27T14:32:07.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.798+0000 7f1836ffd700 1 -- 172.21.15.115:0/2145978413 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698049162 0 0) 0x7f18380c0bd0 con 0x7f1838153f90 2023-07-27T14:32:07.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.798+0000 7f183c99c700 1 --2- 172.21.15.115:0/2145978413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838063070 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f1830009e60 tx=0x7f1830009780).ready entity=mon.0 client_cookie=e7f8237487e29d41 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f1836ffd700 1 -- 172.21.15.115:0/2145978413 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000e070 con 0x7f1838062c00 2023-07-27T14:32:07.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f1836ffd700 1 -- 172.21.15.115:0/2145978413 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183000bbf0 con 0x7f1838062c00 2023-07-27T14:32:07.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f1836ffd700 1 -- 172.21.15.115:0/2145978413 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830012410 con 0x7f1838062c00 2023-07-27T14:32:07.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f183d19d700 1 -- 172.21.15.115:0/2145978413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 msgr2=0x7f1838063070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f183d19d700 1 --2- 172.21.15.115:0/2145978413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838063070 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f1830009e60 tx=0x7f1830009780).stop 2023-07-27T14:32:07.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f183d19d700 1 -- 172.21.15.115:0/2145978413 shutdown_connections 2023-07-27T14:32:07.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f183d19d700 1 --2- 172.21.15.115:0/2145978413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838063070 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f183d19d700 1 -- 172.21.15.115:0/2145978413 >> 172.21.15.115:0/2145978413 conn(0x7f183805e940 msgr2=0x7f18380cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:07.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f183d19d700 1 -- 172.21.15.115:0/2145978413 shutdown_connections 2023-07-27T14:32:07.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.799+0000 7f183d19d700 1 -- 172.21.15.115:0/2145978413 wait complete. 2023-07-27T14:32:07.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.802+0000 7f183d19d700 1 Processor -- start 2023-07-27T14:32:07.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.802+0000 7f183d19d700 1 -- start start 2023-07-27T14:32:07.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f183d19d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838166d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f183d19d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1838153bb0 0x7f18381562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f183d19d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1838153f90 0x7f18380c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f183d19d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380af520 con 0x7f1838062c00 2023-07-27T14:32:07.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f183d19d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380ae910 con 0x7f1838153f90 2023-07-27T14:32:07.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f183d19d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18380aebf0 con 0x7f1838153bb0 2023-07-27T14:32:07.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f1837fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838166d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f1837fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838166d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56910/0 (socket says 172.21.15.115:56910) 2023-07-27T14:32:07.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f1837fff700 1 -- 172.21.15.115:0/4057055800 learned_addr learned my addr 172.21.15.115:0/4057055800 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:07.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f18377fe700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1838153bb0 0x7f18381562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.803+0000 7f183c99c700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1838153f90 0x7f18380c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f1837fff700 1 -- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1838153bb0 msgr2=0x7f18381562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f1837fff700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1838153bb0 0x7f18381562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f1837fff700 1 -- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1838153f90 msgr2=0x7f18380c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:07.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f1837fff700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1838153f90 0x7f18380c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:07.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f1837fff700 1 -- 172.21.15.115:0/4057055800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009a20 con 0x7f1838062c00 2023-07-27T14:32:07.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f183c99c700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1838153f90 0x7f18380c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:07.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f1837fff700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838166d40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f182800c440 tx=0x7f1828007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f181ffff700 1 -- 172.21.15.115:0/4057055800 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800cea0 con 0x7f1838062c00 2023-07-27T14:32:07.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f181ffff700 1 -- 172.21.15.115:0/4057055800 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182800f470 con 0x7f1838062c00 2023-07-27T14:32:07.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18380aeed0 con 0x7f1838062c00 2023-07-27T14:32:07.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f181ffff700 1 -- 172.21.15.115:0/4057055800 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800f810 con 0x7f1838062c00 2023-07-27T14:32:07.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.804+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18380ae530 con 0x7f1838062c00 2023-07-27T14:32:07.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.805+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1838047270 con 0x7f1838062c00 2023-07-27T14:32:07.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.806+0000 7f181ffff700 1 -- 172.21.15.115:0/4057055800 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f1828019030 con 0x7f1838062c00 2023-07-27T14:32:07.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.807+0000 7f181ffff700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f182405f370 0x7f1824061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:07.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.807+0000 7f181ffff700 1 -- 172.21.15.115:0/4057055800 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f1828079880 con 0x7f1838062c00 2023-07-27T14:32:07.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.807+0000 7f18377fe700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f182405f370 0x7f1824061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:07.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.808+0000 7f18377fe700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f182405f370 0x7f1824061830 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f18380ab810 tx=0x7f182c007dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:07.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.811+0000 7f181ffff700 1 -- 172.21.15.115:0/4057055800 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18280488f0 con 0x7f1838062c00 2023-07-27T14:32:08.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.981+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18380ab560 con 0x7f1838062c00 2023-07-27T14:32:08.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.982+0000 7f181ffff700 1 -- 172.21.15.115:0/4057055800 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+17239 (secure 0 0 0) 0x7f182804a790 con 0x7f1838062c00 2023-07-27T14:32:08.017 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:08.017 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":88,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:06.599244+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:31:15.629735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-27T14:31:16.202513+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":87,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1c","mappings":[{"from":6,"to":0}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f182405f370 msgr2=0x7f1824061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f182405f370 0x7f1824061830 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f18380ab810 tx=0x7f182c007dd0).stop 2023-07-27T14:32:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 msgr2=0x7f1838166d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838166d40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f182800c440 tx=0x7f1828007de0).stop 2023-07-27T14:32:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 shutdown_connections 2023-07-27T14:32:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f182405f370 0x7f1824061830 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1838153f90 0x7f18380c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1838062c00 0x7f1838166d40 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 --2- 172.21.15.115:0/4057055800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1838153bb0 0x7f18381562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 >> 172.21.15.115:0/4057055800 conn(0x7f183805e940 msgr2=0x7f18380acbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 shutdown_connections 2023-07-27T14:32:08.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:07.984+0000 7f183d19d700 1 -- 172.21.15.115:0/4057055800 wait complete. 2023-07-27T14:32:08.036 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:32:08.037 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:08.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.190+0000 7f234dfff700 1 Processor -- start 2023-07-27T14:32:08.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.190+0000 7f234dfff700 1 -- start start 2023-07-27T14:32:08.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.191+0000 7f234dfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23480aaa40 0x7f23480640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.191+0000 7f234dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23481542a0 0x7f23480645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.191+0000 7f234dfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480aa4d0 con 0x7f2348153ec0 2023-07-27T14:32:08.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.191+0000 7f234dfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2348064ad0 con 0x7f23480aaa40 2023-07-27T14:32:08.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.191+0000 7f234dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c05c0 con 0x7f23481542a0 2023-07-27T14:32:08.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.191+0000 7f2346ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23480aaa40 0x7f23480640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f2346ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23480aaa40 0x7f23480640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56920/0 (socket says 172.21.15.115:56920) 2023-07-27T14:32:08.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f2346ffd700 1 -- 172.21.15.115:0/1238055571 learned_addr learned my addr 172.21.15.115:0/1238055571 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:08.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f2347fff700 1 --2- 172.21.15.115:0/1238055571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23481542a0 0x7f23480645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f2346ffd700 1 -- 172.21.15.115:0/1238055571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23481542a0 msgr2=0x7f23480645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:08.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f2346ffd700 1 --2- 172.21.15.115:0/1238055571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23481542a0 0x7f23480645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f2346ffd700 1 -- 172.21.15.115:0/1238055571 >> v1:172.21.15.159:6789/0 conn(0x7f2348153ec0 legacy=0x7f23480a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f2346ffd700 1 -- 172.21.15.115:0/1238055571 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480c1a60 con 0x7f23480aaa40 2023-07-27T14:32:08.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f2346ffd700 1 --2- 172.21.15.115:0/1238055571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23480aaa40 0x7f23480640f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f233c006fd0 tx=0x7f233c0090f0).ready entity=mon.0 client_cookie=a68710a740958dd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:08.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f23467fc700 1 -- 172.21.15.115:0/1238055571 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00b580 con 0x7f23480aaa40 2023-07-27T14:32:08.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f23467fc700 1 -- 172.21.15.115:0/1238055571 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00b6e0 con 0x7f23480aaa40 2023-07-27T14:32:08.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.192+0000 7f23467fc700 1 -- 172.21.15.115:0/1238055571 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00ba60 con 0x7f23480aaa40 2023-07-27T14:32:08.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.193+0000 7f234dfff700 1 -- 172.21.15.115:0/1238055571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23480aaa40 msgr2=0x7f23480640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.193+0000 7f234dfff700 1 --2- 172.21.15.115:0/1238055571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23480aaa40 0x7f23480640f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f233c006fd0 tx=0x7f233c0090f0).stop 2023-07-27T14:32:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.193+0000 7f234dfff700 1 -- 172.21.15.115:0/1238055571 shutdown_connections 2023-07-27T14:32:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.193+0000 7f234dfff700 1 --2- 172.21.15.115:0/1238055571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23481542a0 0x7f23480645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.193+0000 7f234dfff700 1 --2- 172.21.15.115:0/1238055571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23480aaa40 0x7f23480640f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.193+0000 7f234dfff700 1 -- 172.21.15.115:0/1238055571 >> 172.21.15.115:0/1238055571 conn(0x7f23480cb610 msgr2=0x7f23480c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.193+0000 7f234dfff700 1 -- 172.21.15.115:0/1238055571 shutdown_connections 2023-07-27T14:32:08.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.193+0000 7f234dfff700 1 -- 172.21.15.115:0/1238055571 wait complete. 2023-07-27T14:32:08.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.194+0000 7f234dfff700 1 Processor -- start 2023-07-27T14:32:08.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.195+0000 7f234dfff700 1 -- start start 2023-07-27T14:32:08.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.195+0000 7f234dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23480aaa40 0x7f234814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f234dfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2348153ec0 0x7f2348163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f234dfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23481542a0 0x7f2348151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f234dfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480aeb10 con 0x7f23481542a0 2023-07-27T14:32:08.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f234dfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480aed60 con 0x7f2348153ec0 2023-07-27T14:32:08.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f234dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480af040 con 0x7f23480aaa40 2023-07-27T14:32:08.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23481542a0 0x7f2348151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23481542a0 0x7f2348151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56932/0 (socket says 172.21.15.115:56932) 2023-07-27T14:32:08.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 -- 172.21.15.115:0/2286549577 learned_addr learned my addr 172.21.15.115:0/2286549577 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:08.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f23477fe700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23480aaa40 0x7f234814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2346ffd700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2348153ec0 0x7f2348163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 -- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23480aaa40 msgr2=0x7f234814e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23480aaa40 0x7f234814e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 -- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2348153ec0 msgr2=0x7f2348163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2348153ec0 0x7f2348163f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 -- 172.21.15.115:0/2286549577 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009370 con 0x7f23481542a0 2023-07-27T14:32:08.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2346ffd700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2348153ec0 0x7f2348163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:08.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.196+0000 7f2347fff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23481542a0 0x7f2348151ec0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f2340009d40 tx=0x7f234000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:08.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.197+0000 7f232f7fe700 1 -- 172.21.15.115:0/2286549577 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340009ad0 con 0x7f23481542a0 2023-07-27T14:32:08.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.197+0000 7f232f7fe700 1 -- 172.21.15.115:0/2286549577 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234000f040 con 0x7f23481542a0 2023-07-27T14:32:08.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.197+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23480af320 con 0x7f23481542a0 2023-07-27T14:32:08.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.197+0000 7f232f7fe700 1 -- 172.21.15.115:0/2286549577 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234000cda0 con 0x7f23481542a0 2023-07-27T14:32:08.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.197+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234814eb10 con 0x7f23481542a0 2023-07-27T14:32:08.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.198+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234814ed00 con 0x7f23481542a0 2023-07-27T14:32:08.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.198+0000 7f232f7fe700 1 -- 172.21.15.115:0/2286549577 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f2340013610 con 0x7f23481542a0 2023-07-27T14:32:08.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.199+0000 7f232f7fe700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f233405f370 0x7f2334061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.199+0000 7f232f7fe700 1 -- 172.21.15.115:0/2286549577 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f234007ab30 con 0x7f23481542a0 2023-07-27T14:32:08.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.199+0000 7f23477fe700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f233405f370 0x7f2334061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.200+0000 7f23477fe700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f233405f370 0x7f2334061830 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f2338003640 tx=0x7f2338009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:08.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.203+0000 7f232f7fe700 1 -- 172.21.15.115:0/2286549577 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f234814ed00 con 0x7f23481542a0 2023-07-27T14:32:08.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.413+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f234814ed00 con 0x7f23481542a0 2023-07-27T14:32:08.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.413+0000 7f232f7fe700 1 -- 172.21.15.115:0/2286549577 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f234814ed00 con 0x7f23481542a0 2023-07-27T14:32:08.449 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:08.449 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4214348897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":4214348897},{"type":"v1","addr":"172.21.15.115:6837","nonce":4214348897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/445956953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":445956953},{"type":"v1","addr":"172.21.15.159:6834","nonce":445956953}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4278535768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":4278535768},{"type":"v1","addr":"172.21.15.159:6835","nonce":4278535768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:31:17.215158+0000","modified":"2023-07-27T14:31:20.233120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3446022806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3446022806},{"type":"v1","addr":"172.21.15.115:6835","nonce":3446022806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-07-27T14:32:08.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f233405f370 msgr2=0x7f2334061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f233405f370 0x7f2334061830 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f2338003640 tx=0x7f2338009040).stop 2023-07-27T14:32:08.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23481542a0 msgr2=0x7f2348151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23481542a0 0x7f2348151ec0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f2340009d40 tx=0x7f234000b040).stop 2023-07-27T14:32:08.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 shutdown_connections 2023-07-27T14:32:08.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f233405f370 0x7f2334061830 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23481542a0 0x7f2348151ec0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23480aaa40 0x7f234814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 --2- 172.21.15.115:0/2286549577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2348153ec0 0x7f2348163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 >> 172.21.15.115:0/2286549577 conn(0x7f23480cb610 msgr2=0x7f2348062ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 shutdown_connections 2023-07-27T14:32:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.416+0000 7f234dfff700 1 -- 172.21.15.115:0/2286549577 wait complete. 2023-07-27T14:32:08.452 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 43 2023-07-27T14:32:08.468 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:08.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.621+0000 7f8f60fff700 1 Processor -- start 2023-07-27T14:32:08.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.621+0000 7f8f60fff700 1 -- start start 2023-07-27T14:32:08.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.623+0000 7f8f60fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c153ec0 0x7f8f5c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.623+0000 7f8f60fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c0aa4d0 con 0x7f8f5c0aa050 2023-07-27T14:32:08.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.623+0000 7f8f60fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c0c05c0 con 0x7f8f5c0aaa40 2023-07-27T14:32:08.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.623+0000 7f8f60fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0bfc90 con 0x7f8f5c153ec0 2023-07-27T14:32:08.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.623+0000 7f8f59d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8f5c0aa050 0x7f8f5c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58740/0 (socket says 172.21.15.115:58740) 2023-07-27T14:32:08.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.623+0000 7f8f59d9b700 1 -- 172.21.15.115:0/1433019673 learned_addr learned my addr 172.21.15.115:0/1433019673 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:08.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.623+0000 7f8f5a59c700 1 --2- 172.21.15.115:0/1433019673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c153ec0 0x7f8f5c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.623+0000 7f8f5959a700 1 -- 172.21.15.115:0/1433019673 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277079487 0 0) 0x7f8f50001110 con 0x7f8f5c0aa050 2023-07-27T14:32:08.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5959a700 1 -- 172.21.15.115:0/1433019673 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f440033f0 con 0x7f8f5c0aa050 2023-07-27T14:32:08.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5959a700 1 -- 172.21.15.115:0/1433019673 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211257853 0 0) 0x7f8f5c0c05c0 con 0x7f8f5c0aaa40 2023-07-27T14:32:08.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5959a700 1 -- 172.21.15.115:0/1433019673 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f50001110 con 0x7f8f5c0aaa40 2023-07-27T14:32:08.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5a59c700 1 -- 172.21.15.115:0/1433019673 >> v1:172.21.15.159:6789/0 conn(0x7f8f5c0aaa40 legacy=0x7f8f5c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5a59c700 1 -- 172.21.15.115:0/1433019673 >> v1:172.21.15.115:6789/0 conn(0x7f8f5c0aa050 legacy=0x7f8f5c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5a59c700 1 -- 172.21.15.115:0/1433019673 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0bff70 con 0x7f8f5c153ec0 2023-07-27T14:32:08.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5a59c700 1 --2- 172.21.15.115:0/1433019673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c153ec0 0x7f8f5c0a9b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8f4c009790 tx=0x7f8f4c009060).ready entity=mon.2 client_cookie=edfe59487339aeb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:08.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5959a700 1 -- 172.21.15.115:0/1433019673 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c00f510 con 0x7f8f5c153ec0 2023-07-27T14:32:08.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5959a700 1 -- 172.21.15.115:0/1433019673 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c00f670 con 0x7f8f5c153ec0 2023-07-27T14:32:08.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.624+0000 7f8f5959a700 1 -- 172.21.15.115:0/1433019673 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c00f9f0 con 0x7f8f5c153ec0 2023-07-27T14:32:08.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.625+0000 7f8f60fff700 1 -- 172.21.15.115:0/1433019673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c153ec0 msgr2=0x7f8f5c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.625+0000 7f8f60fff700 1 --2- 172.21.15.115:0/1433019673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c153ec0 0x7f8f5c0a9b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8f4c009790 tx=0x7f8f4c009060).stop 2023-07-27T14:32:08.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.625+0000 7f8f60fff700 1 -- 172.21.15.115:0/1433019673 shutdown_connections 2023-07-27T14:32:08.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.625+0000 7f8f60fff700 1 --2- 172.21.15.115:0/1433019673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c153ec0 0x7f8f5c0a9b60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.625+0000 7f8f60fff700 1 -- 172.21.15.115:0/1433019673 >> 172.21.15.115:0/1433019673 conn(0x7f8f5c0cb610 msgr2=0x7f8f5c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:08.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.625+0000 7f8f60fff700 1 -- 172.21.15.115:0/1433019673 shutdown_connections 2023-07-27T14:32:08.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.625+0000 7f8f60fff700 1 -- 172.21.15.115:0/1433019673 wait complete. 2023-07-27T14:32:08.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.626+0000 7f8f60fff700 1 Processor -- start 2023-07-27T14:32:08.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.627+0000 7f8f60fff700 1 -- start start 2023-07-27T14:32:08.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.627+0000 7f8f60fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5c0aa050 0x7f8f5c153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f60fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c0aaa40 0x7f8f5c140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f60fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f5c153ec0 0x7f8f5c1411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f60fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c1416d0 con 0x7f8f5c0aa050 2023-07-27T14:32:08.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f60fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0b0600 con 0x7f8f5c153ec0 2023-07-27T14:32:08.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f60fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0af9f0 con 0x7f8f5c0aaa40 2023-07-27T14:32:08.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5c0aa050 0x7f8f5c153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5c0aa050 0x7f8f5c153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56946/0 (socket says 172.21.15.115:56946) 2023-07-27T14:32:08.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 -- 172.21.15.115:0/1895710045 learned_addr learned my addr 172.21.15.115:0/1895710045 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:08.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f59d9b700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c0aaa40 0x7f8f5c140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 -- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c0aaa40 msgr2=0x7f8f5c140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c0aaa40 0x7f8f5c140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5ad9d700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f5c153ec0 0x7f8f5c1411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 -- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f5c153ec0 msgr2=0x7f8f5c1411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f5c153ec0 0x7f8f5c1411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 -- 172.21.15.115:0/1895710045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c0092a0 con 0x7f8f5c0aa050 2023-07-27T14:32:08.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f59d9b700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c0aaa40 0x7f8f5c140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:08.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5ad9d700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f5c153ec0 0x7f8f5c1411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:08.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.628+0000 7f8f5a59c700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5c0aa050 0x7f8f5c153000 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f8f5c05fc60 tx=0x7f8f4c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:08.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.629+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1895710045 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c00f7e0 con 0x7f8f5c0aa050 2023-07-27T14:32:08.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.629+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1895710045 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c00f940 con 0x7f8f5c0aa050 2023-07-27T14:32:08.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.629+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c0afcd0 con 0x7f8f5c0aa050 2023-07-27T14:32:08.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.629+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1895710045 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c01b660 con 0x7f8f5c0aa050 2023-07-27T14:32:08.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.629+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c0b0290 con 0x7f8f5c0aa050 2023-07-27T14:32:08.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.630+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c150680 con 0x7f8f5c0aa050 2023-07-27T14:32:08.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.631+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1895710045 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f8f4c02b070 con 0x7f8f5c0aa050 2023-07-27T14:32:08.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.632+0000 7f8f4a7fc700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3c05f370 0x7f8f3c061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:08.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.632+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1895710045 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f8f4c07ba30 con 0x7f8f5c0aa050 2023-07-27T14:32:08.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.632+0000 7f8f59d9b700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3c05f370 0x7f8f3c061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:08.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.632+0000 7f8f59d9b700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3c05f370 0x7f8f3c061830 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f8f5c06c0d0 tx=0x7f8f50009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:08.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.635+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1895710045 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f4c04cbd0 con 0x7f8f5c0aa050 2023-07-27T14:32:08.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.846+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f5c0c0250 con 0x7f8f5c0aa050 2023-07-27T14:32:08.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.846+0000 7f8f4a7fc700 1 -- 172.21.15.115:0/1895710045 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f8f4c029020 con 0x7f8f5c0aa050 2023-07-27T14:32:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:08.882 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4214348897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":4214348897},{"type":"v1","addr":"172.21.15.115:6837","nonce":4214348897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/445956953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":445956953},{"type":"v1","addr":"172.21.15.159:6834","nonce":445956953}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4278535768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":4278535768},{"type":"v1","addr":"172.21.15.159:6835","nonce":4278535768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:31:17.215158+0000","modified":"2023-07-27T14:31:20.233120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"a","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3446022806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3446022806},{"type":"v1","addr":"172.21.15.115:6835","nonce":3446022806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-07-27T14:32:08.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3c05f370 msgr2=0x7f8f3c061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3c05f370 0x7f8f3c061830 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f8f5c06c0d0 tx=0x7f8f50009040).stop 2023-07-27T14:32:08.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5c0aa050 msgr2=0x7f8f5c153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:08.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5c0aa050 0x7f8f5c153000 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f8f5c05fc60 tx=0x7f8f4c017000).stop 2023-07-27T14:32:08.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 shutdown_connections 2023-07-27T14:32:08.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f3c05f370 0x7f8f3c061830 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f5c153ec0 0x7f8f5c1411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f5c0aa050 0x7f8f5c153000 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 --2- 172.21.15.115:0/1895710045 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f5c0aaa40 0x7f8f5c140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:08.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 >> 172.21.15.115:0/1895710045 conn(0x7f8f5c0cb610 msgr2=0x7f8f5c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:08.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 shutdown_connections 2023-07-27T14:32:08.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:08.849+0000 7f8f60fff700 1 -- 172.21.15.115:0/1895710045 wait complete. 2023-07-27T14:32:08.886 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 43 2023-07-27T14:32:08.901 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.053+0000 7f66c9fff700 1 Processor -- start 2023-07-27T14:32:09.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.053+0000 7f66c9fff700 1 -- start start 2023-07-27T14:32:09.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.054+0000 7f66c9fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 0x7f66c4062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.054+0000 7f66c9fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66c40a4f50 0x7f66c40bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.054+0000 7f66c9fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c40639d0 con 0x7f66c4062810 2023-07-27T14:32:09.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.054+0000 7f66c9fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c4137610 con 0x7f66c40a4f50 2023-07-27T14:32:09.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.054+0000 7f66c9fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4062dc0 con 0x7f66c4151bd0 2023-07-27T14:32:09.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66c40a4f50 0x7f66c40bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66c40a4f50 0x7f66c40bc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56948/0 (socket says 172.21.15.115:56948) 2023-07-27T14:32:09.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c3fff700 1 -- 172.21.15.115:0/311288636 learned_addr learned my addr 172.21.15.115:0/311288636 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:09.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c37fe700 1 --2- 172.21.15.115:0/311288636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 0x7f66c4062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c3fff700 1 -- 172.21.15.115:0/311288636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 msgr2=0x7f66c4062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:09.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c3fff700 1 --2- 172.21.15.115:0/311288636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 0x7f66c4062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c3fff700 1 -- 172.21.15.115:0/311288636 >> v1:172.21.15.159:6789/0 conn(0x7f66c4062810 legacy=0x7f66c40a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c3fff700 1 -- 172.21.15.115:0/311288636 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c40630a0 con 0x7f66c40a4f50 2023-07-27T14:32:09.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.055+0000 7f66c3fff700 1 --2- 172.21.15.115:0/311288636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c40bc050 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f66bc009f20 tx=0x7f66bc009840).ready entity=mon.0 client_cookie=5f7552a32134f647 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:09.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c27fc700 1 -- 172.21.15.115:0/311288636 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00e070 con 0x7f66c40a4f50 2023-07-27T14:32:09.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c27fc700 1 -- 172.21.15.115:0/311288636 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc00ba80 con 0x7f66c40a4f50 2023-07-27T14:32:09.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c27fc700 1 -- 172.21.15.115:0/311288636 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00be00 con 0x7f66c40a4f50 2023-07-27T14:32:09.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c9fff700 1 -- 172.21.15.115:0/311288636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 msgr2=0x7f66c40bc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c9fff700 1 --2- 172.21.15.115:0/311288636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c40bc050 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f66bc009f20 tx=0x7f66bc009840).stop 2023-07-27T14:32:09.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c9fff700 1 -- 172.21.15.115:0/311288636 shutdown_connections 2023-07-27T14:32:09.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c9fff700 1 --2- 172.21.15.115:0/311288636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 0x7f66c4062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c9fff700 1 --2- 172.21.15.115:0/311288636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c40bc050 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c9fff700 1 -- 172.21.15.115:0/311288636 >> 172.21.15.115:0/311288636 conn(0x7f66c4064700 msgr2=0x7f66c4064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:09.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c9fff700 1 -- 172.21.15.115:0/311288636 shutdown_connections 2023-07-27T14:32:09.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.056+0000 7f66c9fff700 1 -- 172.21.15.115:0/311288636 wait complete. 2023-07-27T14:32:09.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.058+0000 7f66c9fff700 1 Processor -- start 2023-07-27T14:32:09.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.058+0000 7f66c9fff700 1 -- start start 2023-07-27T14:32:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c9fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c4062810 0x7f66c40c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c9fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c413c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c9fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 0x7f66c41356b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c9fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c41678e0 con 0x7f66c40a4f50 2023-07-27T14:32:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c9fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4168460 con 0x7f66c4062810 2023-07-27T14:32:09.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c9fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4167b30 con 0x7f66c4151bd0 2023-07-27T14:32:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c413c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c413c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56954/0 (socket says 172.21.15.115:56954) 2023-07-27T14:32:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c2ffd700 1 -- 172.21.15.115:0/1217194781 learned_addr learned my addr 172.21.15.115:0/1217194781 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c37fe700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c4062810 0x7f66c40c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.059+0000 7f66c3fff700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 0x7f66c41356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c2ffd700 1 -- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 msgr2=0x7f66c41356b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c2ffd700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 0x7f66c41356b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c2ffd700 1 -- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c4062810 msgr2=0x7f66c40c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c2ffd700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c4062810 0x7f66c40c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c2ffd700 1 -- 172.21.15.115:0/1217194781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009ae0 con 0x7f66c40a4f50 2023-07-27T14:32:09.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c37fe700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c4062810 0x7f66c40c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:09.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c2ffd700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c413c500 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f66b800c4f0 tx=0x7f66b8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:09.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66ab7fe700 1 -- 172.21.15.115:0/1217194781 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8007020 con 0x7f66c40a4f50 2023-07-27T14:32:09.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66ab7fe700 1 -- 172.21.15.115:0/1217194781 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b8007180 con 0x7f66c40a4f50 2023-07-27T14:32:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c4167e10 con 0x7f66c40a4f50 2023-07-27T14:32:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66ab7fe700 1 -- 172.21.15.115:0/1217194781 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8007520 con 0x7f66c40a4f50 2023-07-27T14:32:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.060+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c413c9f0 con 0x7f66c40a4f50 2023-07-27T14:32:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.061+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c406c470 con 0x7f66c40a4f50 2023-07-27T14:32:09.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.062+0000 7f66ab7fe700 1 -- 172.21.15.115:0/1217194781 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f66b8010070 con 0x7f66c40a4f50 2023-07-27T14:32:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.063+0000 7f66ab7fe700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66b005f370 0x7f66b0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.063+0000 7f66ab7fe700 1 -- 172.21.15.115:0/1217194781 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f66b8079790 con 0x7f66c40a4f50 2023-07-27T14:32:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.063+0000 7f66c37fe700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66b005f370 0x7f66b0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.063+0000 7f66c37fe700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66b005f370 0x7f66b0061830 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f66b4006fd0 tx=0x7f66b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:09.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.067+0000 7f66ab7fe700 1 -- 172.21.15.115:0/1217194781 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66b80478f0 con 0x7f66c40a4f50 2023-07-27T14:32:09.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.239+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c406aa60 con 0x7f66c40a4f50 2023-07-27T14:32:09.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.240+0000 7f66ab7fe700 1 -- 172.21.15.115:0/1217194781 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+17239 (secure 0 0 0) 0x7f66b804a5f0 con 0x7f66c40a4f50 2023-07-27T14:32:09.275 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:09.276 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":88,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:06.599244+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:31:15.629735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-27T14:31:16.202513+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":87,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1c","mappings":[{"from":6,"to":0}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:09.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66b005f370 msgr2=0x7f66b0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66b005f370 0x7f66b0061830 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f66b4006fd0 tx=0x7f66b4008040).stop 2023-07-27T14:32:09.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 msgr2=0x7f66c413c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c413c500 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f66b800c4f0 tx=0x7f66b8007dd0).stop 2023-07-27T14:32:09.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 shutdown_connections 2023-07-27T14:32:09.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f66b005f370 0x7f66b0061830 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66c4151bd0 0x7f66c41356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c4062810 0x7f66c40c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 --2- 172.21.15.115:0/1217194781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40a4f50 0x7f66c413c500 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 >> 172.21.15.115:0/1217194781 conn(0x7f66c4064700 msgr2=0x7f66c41366d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:09.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 shutdown_connections 2023-07-27T14:32:09.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.242+0000 7f66c9fff700 1 -- 172.21.15.115:0/1217194781 wait complete. 2023-07-27T14:32:09.295 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:32:09.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.448+0000 7efdfc1ff700 1 Processor -- start 2023-07-27T14:32:09.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.448+0000 7efdfc1ff700 1 -- start start 2023-07-27T14:32:09.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.449+0000 7efdfc1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efdf414e470 0x7efdf414e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.449+0000 7efdfc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4062a30 0x7efdf40a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.449+0000 7efdfc1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf40a4840 con 0x7efdf4155110 2023-07-27T14:32:09.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.449+0000 7efdfc1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf40a6ed0 con 0x7efdf414e470 2023-07-27T14:32:09.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdfc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40a71b0 con 0x7efdf4062a30 2023-07-27T14:32:09.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdfa79c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4062a30 0x7efdf40a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdfa79c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4062a30 0x7efdf40a5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:44736/0 (socket says 172.21.15.115:44736) 2023-07-27T14:32:09.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdfa79c700 1 -- 172.21.15.115:0/1017410199 learned_addr learned my addr 172.21.15.115:0/1017410199 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:09.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdf9f9b700 1 --2- 172.21.15.115:0/1017410199 >> v2:172.21.15.159:3300/0 conn(0x7efdf414e470 0x7efdf414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdf8f99700 1 -- 172.21.15.115:0/1017410199 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799110611 0 0) 0x7efdf40a4840 con 0x7efdf4155110 2023-07-27T14:32:09.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdf8f99700 1 -- 172.21.15.115:0/1017410199 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde00033f0 con 0x7efdf4155110 2023-07-27T14:32:09.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdfa79c700 1 -- 172.21.15.115:0/1017410199 >> v2:172.21.15.159:3300/0 conn(0x7efdf414e470 msgr2=0x7efdf414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:09.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdfa79c700 1 --2- 172.21.15.115:0/1017410199 >> v2:172.21.15.159:3300/0 conn(0x7efdf414e470 0x7efdf414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.450+0000 7efdfa79c700 1 -- 172.21.15.115:0/1017410199 >> v1:172.21.15.159:6789/0 conn(0x7efdf4155110 legacy=0x7efdf4062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.451+0000 7efdfa79c700 1 -- 172.21.15.115:0/1017410199 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf40a4a90 con 0x7efdf4062a30 2023-07-27T14:32:09.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.451+0000 7efdf9f9b700 1 --2- 172.21.15.115:0/1017410199 >> v2:172.21.15.159:3300/0 conn(0x7efdf414e470 0x7efdf414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:09.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.451+0000 7efdfa79c700 1 --2- 172.21.15.115:0/1017410199 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4062a30 0x7efdf40a5290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7efdec009f20 tx=0x7efdec009840).ready entity=mon.2 client_cookie=91b09ef47e677129 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:09.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.451+0000 7efdf8f99700 1 -- 172.21.15.115:0/1017410199 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00e070 con 0x7efdf4062a30 2023-07-27T14:32:09.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.451+0000 7efdf8f99700 1 -- 172.21.15.115:0/1017410199 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00b970 con 0x7efdf4062a30 2023-07-27T14:32:09.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.451+0000 7efdf8f99700 1 -- 172.21.15.115:0/1017410199 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00bcf0 con 0x7efdf4062a30 2023-07-27T14:32:09.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.451+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1017410199 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4062a30 msgr2=0x7efdf40a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.451+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1017410199 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4062a30 0x7efdf40a5290 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7efdec009f20 tx=0x7efdec009840).stop 2023-07-27T14:32:09.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.452+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1017410199 shutdown_connections 2023-07-27T14:32:09.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.452+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1017410199 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4062a30 0x7efdf40a5290 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.452+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1017410199 >> v2:172.21.15.159:3300/0 conn(0x7efdf414e470 0x7efdf414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.452+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1017410199 >> 172.21.15.115:0/1017410199 conn(0x7efdf40c7990 msgr2=0x7efdf40c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:09.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.452+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1017410199 shutdown_connections 2023-07-27T14:32:09.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.452+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1017410199 wait complete. 2023-07-27T14:32:09.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.453+0000 7efdfc1ff700 1 Processor -- start 2023-07-27T14:32:09.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.453+0000 7efdfc1ff700 1 -- start start 2023-07-27T14:32:09.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.454+0000 7efdfc1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf4062a30 0x7efdf4153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.454+0000 7efdfc1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdf414e470 0x7efdf4167540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.454+0000 7efdfc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4155110 0x7efdf4167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.454+0000 7efdfc1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4151cd0 con 0x7efdf414e470 2023-07-27T14:32:09.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.454+0000 7efdfc1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4067510 con 0x7efdf4062a30 2023-07-27T14:32:09.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.454+0000 7efdfc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4066900 con 0x7efdf4155110 2023-07-27T14:32:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdf414e470 0x7efdf4167540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdf414e470 0x7efdf4167540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56958/0 (socket says 172.21.15.115:56958) 2023-07-27T14:32:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 -- 172.21.15.115:0/1081103610 learned_addr learned my addr 172.21.15.115:0/1081103610 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf9f9b700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf4062a30 0x7efdf4153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdfa79c700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4155110 0x7efdf4167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 -- 172.21.15.115:0/1081103610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4155110 msgr2=0x7efdf4167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4155110 0x7efdf4167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 -- 172.21.15.115:0/1081103610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf4062a30 msgr2=0x7efdf4153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf4062a30 0x7efdf4153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 -- 172.21.15.115:0/1081103610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf00092a0 con 0x7efdf414e470 2023-07-27T14:32:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efdf979a700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdf414e470 0x7efdf4167540 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7efde400c440 tx=0x7efde4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.455+0000 7efde9ffb700 1 -- 172.21.15.115:0/1081103610 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400cea0 con 0x7efdf414e470 2023-07-27T14:32:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.456+0000 7efde9ffb700 1 -- 172.21.15.115:0/1081103610 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde400f470 con 0x7efdf414e470 2023-07-27T14:32:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.456+0000 7efde9ffb700 1 -- 172.21.15.115:0/1081103610 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400f830 con 0x7efdf414e470 2023-07-27T14:32:09.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.456+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec009ae0 con 0x7efdf414e470 2023-07-27T14:32:09.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.456+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf40671a0 con 0x7efdf414e470 2023-07-27T14:32:09.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.456+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf40c77d0 con 0x7efdf414e470 2023-07-27T14:32:09.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.458+0000 7efde9ffb700 1 -- 172.21.15.115:0/1081103610 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7efde4019030 con 0x7efdf414e470 2023-07-27T14:32:09.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.459+0000 7efde9ffb700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f370 0x7efdd8061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:09.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.459+0000 7efde9ffb700 1 -- 172.21.15.115:0/1081103610 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6207+0+0 (secure 0 0 0) 0x7efde4079890 con 0x7efdf414e470 2023-07-27T14:32:09.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.459+0000 7efdf9f9b700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f370 0x7efdd8061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:09.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.459+0000 7efdf9f9b700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f370 0x7efdd8061830 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7efdf0009dc0 tx=0x7efdf0009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:09.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.463+0000 7efde9ffb700 1 -- 172.21.15.115:0/1081103610 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efde404a800 con 0x7efdf414e470 2023-07-27T14:32:09.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.675+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efdf40676a0 con 0x7efdf414e470 2023-07-27T14:32:09.806 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:32:09.771+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:32:09.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.778+0000 7efde9ffb700 1 -- 172.21.15.115:0/1081103610 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7efde404de20 con 0x7efdf414e470 2023-07-27T14:32:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f370 msgr2=0x7efdd8061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f370 0x7efdd8061830 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7efdf0009dc0 tx=0x7efdf0009060).stop 2023-07-27T14:32:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdf414e470 msgr2=0x7efdf4167540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdf414e470 0x7efdf4167540 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7efde400c440 tx=0x7efde4007c90).stop 2023-07-27T14:32:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 shutdown_connections 2023-07-27T14:32:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f370 0x7efdd8061830 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf4155110 0x7efdf4167a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf4062a30 0x7efdf4153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 --2- 172.21.15.115:0/1081103610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdf414e470 0x7efdf4167540 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 >> 172.21.15.115:0/1081103610 conn(0x7efdf40c7990 msgr2=0x7efdf40c42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 shutdown_connections 2023-07-27T14:32:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.780+0000 7efdfc1ff700 1 -- 172.21.15.115:0/1081103610 wait complete. 2023-07-27T14:32:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:32:09.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:32:09.875 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:32:10.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.989+0000 7f10cafff700 1 Processor -- start 2023-07-27T14:32:10.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.989+0000 7f10cafff700 1 -- start start 2023-07-27T14:32:10.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.990+0000 7f10cafff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10c41509b0 0x7f10c40c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:10.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.990+0000 7f10cafff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f10c4150d90 0x7f10c4154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:10.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.990+0000 7f10cafff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c40c0ea0 con 0x7f10c40c3100 2023-07-27T14:32:10.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.990+0000 7f10cafff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c4068e10 con 0x7f10c41509b0 2023-07-27T14:32:10.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.990+0000 7f10cafff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c4155190 con 0x7f10c4150d90 2023-07-27T14:32:10.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.990+0000 7f10c959c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f10c40c3100 0x7f10c40c3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58750/0 (socket says 172.21.15.115:58750) 2023-07-27T14:32:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.990+0000 7f10c959c700 1 -- 172.21.15.115:0/2587935498 learned_addr learned my addr 172.21.15.115:0/2587935498 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.990+0000 7f10c8d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10c41509b0 0x7f10c40c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c3fff700 1 --2- 172.21.15.115:0/2587935498 >> v2:172.21.15.159:3300/0 conn(0x7f10c4150d90 0x7f10c4154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c37fe700 1 -- 172.21.15.115:0/2587935498 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884607881 0 0) 0x7f10c40c0ea0 con 0x7f10c40c3100 2023-07-27T14:32:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c37fe700 1 -- 172.21.15.115:0/2587935498 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b40033f0 con 0x7f10c40c3100 2023-07-27T14:32:10.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c8d9b700 1 -- 172.21.15.115:0/2587935498 >> v2:172.21.15.159:3300/0 conn(0x7f10c4150d90 msgr2=0x7f10c4154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:10.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c8d9b700 1 --2- 172.21.15.115:0/2587935498 >> v2:172.21.15.159:3300/0 conn(0x7f10c4150d90 0x7f10c4154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c8d9b700 1 -- 172.21.15.115:0/2587935498 >> v1:172.21.15.115:6789/0 conn(0x7f10c40c3100 legacy=0x7f10c40c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:10.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c8d9b700 1 -- 172.21.15.115:0/2587935498 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4155470 con 0x7f10c41509b0 2023-07-27T14:32:10.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c8d9b700 1 --2- 172.21.15.115:0/2587935498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c41509b0 0x7f10c40c58d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f10c4062ef0 tx=0x7f10b8009060).ready entity=mon.0 client_cookie=d17c7dcd425fed46 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:10.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c37fe700 1 -- 172.21.15.115:0/2587935498 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800f510 con 0x7f10c41509b0 2023-07-27T14:32:10.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c37fe700 1 -- 172.21.15.115:0/2587935498 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b800f670 con 0x7f10c41509b0 2023-07-27T14:32:10.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.991+0000 7f10c37fe700 1 -- 172.21.15.115:0/2587935498 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800f9f0 con 0x7f10c41509b0 2023-07-27T14:32:10.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.992+0000 7f10cafff700 1 -- 172.21.15.115:0/2587935498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c41509b0 msgr2=0x7f10c40c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:10.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.992+0000 7f10cafff700 1 --2- 172.21.15.115:0/2587935498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c41509b0 0x7f10c40c58d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f10c4062ef0 tx=0x7f10b8009060).stop 2023-07-27T14:32:10.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.992+0000 7f10cafff700 1 -- 172.21.15.115:0/2587935498 shutdown_connections 2023-07-27T14:32:10.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.992+0000 7f10cafff700 1 --2- 172.21.15.115:0/2587935498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c41509b0 0x7f10c40c58d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.992+0000 7f10cafff700 1 --2- 172.21.15.115:0/2587935498 >> v2:172.21.15.159:3300/0 conn(0x7f10c4150d90 0x7f10c4154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.992+0000 7f10cafff700 1 -- 172.21.15.115:0/2587935498 >> 172.21.15.115:0/2587935498 conn(0x7f10c4062320 msgr2=0x7f10c4062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.992+0000 7f10cafff700 1 -- 172.21.15.115:0/2587935498 shutdown_connections 2023-07-27T14:32:10.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.992+0000 7f10cafff700 1 -- 172.21.15.115:0/2587935498 wait complete. 2023-07-27T14:32:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.993+0000 7f10cafff700 1 Processor -- start 2023-07-27T14:32:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.994+0000 7f10cafff700 1 -- start start 2023-07-27T14:32:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.994+0000 7f10cafff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c40c3100 0x7f10c414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10cafff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c41509b0 0x7f10c40ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10cafff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4150d90 0x7f10c40abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:10.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10cafff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40ac3c0 con 0x7f10c40c3100 2023-07-27T14:32:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10cafff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40a8790 con 0x7f10c41509b0 2023-07-27T14:32:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10cafff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40a8a70 con 0x7f10c4150d90 2023-07-27T14:32:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c40c3100 0x7f10c414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c40c3100 0x7f10c414f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56996/0 (socket says 172.21.15.115:56996) 2023-07-27T14:32:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 -- 172.21.15.115:0/2689984917 learned_addr learned my addr 172.21.15.115:0/2689984917 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c3fff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c41509b0 0x7f10c40ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c959c700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4150d90 0x7f10c40abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 -- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4150d90 msgr2=0x7f10c40abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4150d90 0x7f10c40abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 -- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c41509b0 msgr2=0x7f10c40ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c41509b0 0x7f10c40ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 -- 172.21.15.115:0/2689984917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b80092a0 con 0x7f10c40c3100 2023-07-27T14:32:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c959c700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4150d90 0x7f10c40abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.995+0000 7f10c8d9b700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c40c3100 0x7f10c414f840 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f10b8009dd0 tx=0x7f10b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.996+0000 7f10c0ff9700 1 -- 172.21.15.115:0/2689984917 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800f9f0 con 0x7f10c40c3100 2023-07-27T14:32:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.996+0000 7f10c0ff9700 1 -- 172.21.15.115:0/2689984917 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b8000c90 con 0x7f10c40c3100 2023-07-27T14:32:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.996+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c40a8d50 con 0x7f10c40c3100 2023-07-27T14:32:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.996+0000 7f10c0ff9700 1 -- 172.21.15.115:0/2689984917 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b801b660 con 0x7f10c40c3100 2023-07-27T14:32:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.996+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c40a9310 con 0x7f10c40c3100 2023-07-27T14:32:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.997+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c406c470 con 0x7f10c40c3100 2023-07-27T14:32:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.998+0000 7f10c0ff9700 1 -- 172.21.15.115:0/2689984917 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f10b802b070 con 0x7f10c40c3100 2023-07-27T14:32:10.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.999+0000 7f10c0ff9700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a805f340 0x7f10a8061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:10.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.999+0000 7f10c0ff9700 1 -- 172.21.15.115:0/2689984917 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f10b807bc90 con 0x7f10c40c3100 2023-07-27T14:32:10.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.999+0000 7f10c3fff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a805f340 0x7f10a8061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:10.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:09.999+0000 7f10c3fff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a805f340 0x7f10a8061800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f10c40ac6f0 tx=0x7f10b0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:10.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.003+0000 7f10c0ff9700 1 -- 172.21.15.115:0/2689984917 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10b804cce0 con 0x7f10c40c3100 2023-07-27T14:32:10.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.212+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f10c40655d0 con 0x7f10c40c3100 2023-07-27T14:32:10.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.783+0000 7f10c0ff9700 1 -- 172.21.15.115:0/2689984917 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f10b80290a0 con 0x7f10c40c3100 2023-07-27T14:32:10.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a805f340 msgr2=0x7f10a8061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:10.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a805f340 0x7f10a8061800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f10c40ac6f0 tx=0x7f10b0008040).stop 2023-07-27T14:32:10.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c40c3100 msgr2=0x7f10c414f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c40c3100 0x7f10c414f840 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f10b8009dd0 tx=0x7f10b8017000).stop 2023-07-27T14:32:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 shutdown_connections 2023-07-27T14:32:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10a805f340 0x7f10a8061800 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10c4150d90 0x7f10c40abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10c40c3100 0x7f10c414f840 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 --2- 172.21.15.115:0/2689984917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c41509b0 0x7f10c40ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 >> 172.21.15.115:0/2689984917 conn(0x7f10c4062320 msgr2=0x7f10c40c1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:10.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 shutdown_connections 2023-07-27T14:32:10.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:10.786+0000 7f10cafff700 1 -- 172.21.15.115:0/2689984917 wait complete. 2023-07-27T14:32:10.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:32:11.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.039+0000 7fea1a3ff700 1 Processor -- start 2023-07-27T14:32:11.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.039+0000 7fea1a3ff700 1 -- start start 2023-07-27T14:32:11.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea1a3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1414ae00 0x7fea14154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:11.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea1a3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fea1414b1e0 0x7fea14062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:11.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea1a3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea141553f0 con 0x7fea140c5c50 2023-07-27T14:32:11.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea1a3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea14157a50 con 0x7fea1414b1e0 2023-07-27T14:32:11.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea1a3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea14157d10 con 0x7fea1414ae00 2023-07-27T14:32:11.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea1899c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fea140c5c50 0x7fea140a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58758/0 (socket says 172.21.15.115:58758) 2023-07-27T14:32:11.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea137fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fea1414b1e0 0x7fea14062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:11.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea1899c700 1 -- 172.21.15.115:0/1109786509 learned_addr learned my addr 172.21.15.115:0/1109786509 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:11.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea137fe700 1 -- 172.21.15.115:0/1109786509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1414ae00 msgr2=0x7fea14154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:11.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea13fff700 1 --2- 172.21.15.115:0/1109786509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1414ae00 0x7fea14154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:11.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea12ffd700 1 -- 172.21.15.115:0/1109786509 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733627059 0 0) 0x7fea141553f0 con 0x7fea140c5c50 2023-07-27T14:32:11.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea137fe700 1 --2- 172.21.15.115:0/1109786509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1414ae00 0x7fea14154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea137fe700 1 -- 172.21.15.115:0/1109786509 >> v1:172.21.15.115:6789/0 conn(0x7fea140c5c50 legacy=0x7fea140a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:11.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea137fe700 1 -- 172.21.15.115:0/1109786509 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14157ff0 con 0x7fea1414b1e0 2023-07-27T14:32:11.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.041+0000 7fea13fff700 1 --2- 172.21.15.115:0/1109786509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1414ae00 0x7fea14154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:11.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea137fe700 1 --2- 172.21.15.115:0/1109786509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea14062b50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fea08009760 tx=0x7fea08009060).ready entity=mon.0 client_cookie=ac245cfc5e1ad441 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:11.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea12ffd700 1 -- 172.21.15.115:0/1109786509 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800b580 con 0x7fea1414b1e0 2023-07-27T14:32:11.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea12ffd700 1 -- 172.21.15.115:0/1109786509 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800b6e0 con 0x7fea1414b1e0 2023-07-27T14:32:11.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea12ffd700 1 -- 172.21.15.115:0/1109786509 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800ba60 con 0x7fea1414b1e0 2023-07-27T14:32:11.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea1a3ff700 1 -- 172.21.15.115:0/1109786509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 msgr2=0x7fea14062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:11.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/1109786509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea14062b50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fea08009760 tx=0x7fea08009060).stop 2023-07-27T14:32:11.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea1a3ff700 1 -- 172.21.15.115:0/1109786509 shutdown_connections 2023-07-27T14:32:11.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/1109786509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea1414ae00 0x7fea14154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/1109786509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea14062b50 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.042+0000 7fea1a3ff700 1 -- 172.21.15.115:0/1109786509 >> 172.21.15.115:0/1109786509 conn(0x7fea1405e940 msgr2=0x7fea140cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:11.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.043+0000 7fea1a3ff700 1 -- 172.21.15.115:0/1109786509 shutdown_connections 2023-07-27T14:32:11.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.043+0000 7fea1a3ff700 1 -- 172.21.15.115:0/1109786509 wait complete. 2023-07-27T14:32:11.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.044+0000 7fea1a3ff700 1 Processor -- start 2023-07-27T14:32:11.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.044+0000 7fea1a3ff700 1 -- start start 2023-07-27T14:32:11.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1a3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140c5c50 0x7fea1413e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:11.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1a3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1414ae00 0x7fea140b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:11.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1a3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea140a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:11.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1a3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140c4550 con 0x7fea1414b1e0 2023-07-27T14:32:11.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1a3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140c3940 con 0x7fea1414ae00 2023-07-27T14:32:11.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1a3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140c3c20 con 0x7fea140c5c50 2023-07-27T14:32:11.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1899c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea140a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:11.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1899c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea140a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57006/0 (socket says 172.21.15.115:57006) 2023-07-27T14:32:11.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.045+0000 7fea1899c700 1 -- 172.21.15.115:0/688530613 learned_addr learned my addr 172.21.15.115:0/688530613 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:11.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea137fe700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1414ae00 0x7fea140b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:11.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea1899c700 1 -- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140c5c50 msgr2=0x7fea1413e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:11.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea13fff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140c5c50 0x7fea1413e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:11.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea1899c700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140c5c50 0x7fea1413e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea1899c700 1 -- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1414ae00 msgr2=0x7fea140b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:11.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea1899c700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1414ae00 0x7fea140b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea1899c700 1 -- 172.21.15.115:0/688530613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080092a0 con 0x7fea1414b1e0 2023-07-27T14:32:11.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea137fe700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1414ae00 0x7fea140b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:11.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea13fff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140c5c50 0x7fea1413e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:11.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea1899c700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea140a9b50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fea0c00c810 tx=0x7fea0c0014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:11.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fe9fbfff700 1 -- 172.21.15.115:0/688530613 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c005d30 con 0x7fea1414b1e0 2023-07-27T14:32:11.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fe9fbfff700 1 -- 172.21.15.115:0/688530613 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c005e90 con 0x7fea1414b1e0 2023-07-27T14:32:11.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fe9fbfff700 1 -- 172.21.15.115:0/688530613 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c007320 con 0x7fea1414b1e0 2023-07-27T14:32:11.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea140c3f00 con 0x7fea1414b1e0 2023-07-27T14:32:11.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.046+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1413ead0 con 0x7fea1414b1e0 2023-07-27T14:32:11.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.047+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1406c470 con 0x7fea1414b1e0 2023-07-27T14:32:11.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.048+0000 7fe9fbfff700 1 -- 172.21.15.115:0/688530613 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fea0c010030 con 0x7fea1414b1e0 2023-07-27T14:32:11.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.049+0000 7fe9fbfff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea0005f370 0x7fea00061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:11.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.049+0000 7fe9fbfff700 1 -- 172.21.15.115:0/688530613 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fea0c07a3a0 con 0x7fea1414b1e0 2023-07-27T14:32:11.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.050+0000 7fea13fff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea0005f370 0x7fea00061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:11.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.050+0000 7fea13fff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea0005f370 0x7fea00061830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fea04008990 tx=0x7fea04008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:11.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.053+0000 7fe9fbfff700 1 -- 172.21.15.115:0/688530613 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea0c04b270 con 0x7fea1414b1e0 2023-07-27T14:32:11.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.223+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fea140c4690 con 0x7fea1414b1e0 2023-07-27T14:32:11.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.789+0000 7fe9fbfff700 1 -- 172.21.15.115:0/688530613 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 181+0+0 (secure 0 0 0) 0x7fea0c04e890 con 0x7fea1414b1e0 2023-07-27T14:32:11.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea0005f370 msgr2=0x7fea00061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:11.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea0005f370 0x7fea00061830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fea04008990 tx=0x7fea04008040).stop 2023-07-27T14:32:11.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 msgr2=0x7fea140a9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:11.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea140a9b50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fea0c00c810 tx=0x7fea0c0014d0).stop 2023-07-27T14:32:11.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 shutdown_connections 2023-07-27T14:32:11.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea0005f370 0x7fea00061830 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea1414b1e0 0x7fea140a9b50 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea140c5c50 0x7fea1413e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 --2- 172.21.15.115:0/688530613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea1414ae00 0x7fea140b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 >> 172.21.15.115:0/688530613 conn(0x7fea1405e940 msgr2=0x7fea140ac450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.793+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 shutdown_connections 2023-07-27T14:32:11.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:11.794+0000 7fea1a3ff700 1 -- 172.21.15.115:0/688530613 wait complete. 2023-07-27T14:32:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:32:11.849 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:32:12.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.015+0000 7f4f403ff700 1 Processor -- start 2023-07-27T14:32:12.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.015+0000 7f4f403ff700 1 -- start start 2023-07-27T14:32:12.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.016+0000 7f4f403ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4f38063260 0x7f4f38154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:12.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.016+0000 7f4f403ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f381553f0 con 0x7f4f3814b1e0 2023-07-27T14:32:12.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.016+0000 7f4f403ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f38157a50 con 0x7f4f3814ae00 2023-07-27T14:32:12.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.016+0000 7f4f403ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f38157d10 con 0x7f4f38063260 2023-07-27T14:32:12.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.016+0000 7f4f3e99c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4f3814b1e0 0x7f4f380a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58770/0 (socket says 172.21.15.115:58770) 2023-07-27T14:32:12.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.016+0000 7f4f3e99c700 1 -- 172.21.15.115:0/4256088738 learned_addr learned my addr 172.21.15.115:0/4256088738 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:12.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d99a700 1 --2- 172.21.15.115:0/4256088738 >> v2:172.21.15.159:3300/0 conn(0x7f4f38063260 0x7f4f38154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:12.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549467168 0 0) 0x7f4f381553f0 con 0x7f4f3814b1e0 2023-07-27T14:32:12.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f240033f0 con 0x7f4f3814b1e0 2023-07-27T14:32:12.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399340653 0 0) 0x7f4f240033f0 con 0x7f4f3814b1e0 2023-07-27T14:32:12.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 >> v2:172.21.15.159:3300/0 conn(0x7f4f38063260 msgr2=0x7f4f38154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:12.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 --2- 172.21.15.115:0/4256088738 >> v2:172.21.15.159:3300/0 conn(0x7f4f38063260 0x7f4f38154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 >> v1:172.21.15.159:6789/0 conn(0x7f4f3814ae00 legacy=0x7f4f38062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:12.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38157ff0 con 0x7f4f3814b1e0 2023-07-27T14:32:12.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4f300017f0 con 0x7f4f3814b1e0 2023-07-27T14:32:12.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 >> v1:172.21.15.115:6789/0 conn(0x7f4f3814b1e0 legacy=0x7f4f380a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:12.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f240038e0 0x7f4f24003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:12.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f24004690 0x7f4f24004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:12.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f24005000 0x7f4f2400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:12.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38157d10 con 0x7f4f24004690 2023-07-27T14:32:12.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2400bf60 con 0x7f4f24005000 2023-07-27T14:32:12.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2400c0f0 con 0x7f4f240038e0 2023-07-27T14:32:12.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.017+0000 7f4f3d99a700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f24004690 0x7f4f24004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:12.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3e19b700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f240038e0 0x7f4f24003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:12.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3e99c700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f24005000 0x7f4f2400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:12.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d99a700 1 -- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f240038e0 msgr2=0x7f4f24003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:12.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d99a700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f240038e0 0x7f4f24003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d99a700 1 -- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f24005000 msgr2=0x7f4f2400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:12.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d99a700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f24005000 0x7f4f2400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d99a700 1 -- 172.21.15.115:0/4256088738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f240033f0 con 0x7f4f24004690 2023-07-27T14:32:12.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3e19b700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f240038e0 0x7f4f24003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:12.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3e99c700 1 -- 172.21.15.115:0/4256088738 reap_dead start 2023-07-27T14:32:12.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d99a700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f24004690 0x7f4f24004b10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f4f38063660 tx=0x7f4f28009060).ready entity=mon.0 client_cookie=55a2ebeb1fd2d15e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:12.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28009e90 con 0x7f4f24004690 2023-07-27T14:32:12.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f28009430 con 0x7f4f24004690 2023-07-27T14:32:12.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.018+0000 7f4f3d199700 1 -- 172.21.15.115:0/4256088738 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800e850 con 0x7f4f24004690 2023-07-27T14:32:12.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.019+0000 7f4f403ff700 1 -- 172.21.15.115:0/4256088738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f24004690 msgr2=0x7f4f24004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:12.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.019+0000 7f4f403ff700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f24004690 0x7f4f24004b10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f4f38063660 tx=0x7f4f28009060).stop 2023-07-27T14:32:12.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.019+0000 7f4f403ff700 1 -- 172.21.15.115:0/4256088738 shutdown_connections 2023-07-27T14:32:12.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.019+0000 7f4f403ff700 1 --2- 172.21.15.115:0/4256088738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f24004690 0x7f4f24004b10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.019+0000 7f4f403ff700 1 -- 172.21.15.115:0/4256088738 >> 172.21.15.115:0/4256088738 conn(0x7f4f3805e940 msgr2=0x7f4f380cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:12.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.019+0000 7f4f403ff700 1 -- 172.21.15.115:0/4256088738 shutdown_connections 2023-07-27T14:32:12.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.019+0000 7f4f403ff700 1 -- 172.21.15.115:0/4256088738 wait complete. 2023-07-27T14:32:12.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.020+0000 7f4f403ff700 1 Processor -- start 2023-07-27T14:32:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.020+0000 7f4f403ff700 1 -- start start 2023-07-27T14:32:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.021+0000 7f4f403ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f24004690 0x7f4f38148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.021+0000 7f4f403ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f3814d390 0x7f4f3814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.021+0000 7f4f403ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f380c74f0 0x7f4f380c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.021+0000 7f4f403ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380c2c00 con 0x7f4f380c74f0 2023-07-27T14:32:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.021+0000 7f4f403ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3814f1d0 con 0x7f4f3814d390 2023-07-27T14:32:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.021+0000 7f4f403ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380c7e40 con 0x7f4f24004690 2023-07-27T14:32:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f380c74f0 0x7f4f380c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f380c74f0 0x7f4f380c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57012/0 (socket says 172.21.15.115:57012) 2023-07-27T14:32:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 -- 172.21.15.115:0/1290701863 learned_addr learned my addr 172.21.15.115:0/1290701863 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e19b700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f24004690 0x7f4f38148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3d99a700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f3814d390 0x7f4f3814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 -- 172.21.15.115:0/1290701863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f24004690 msgr2=0x7f4f38148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f24004690 0x7f4f38148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 -- 172.21.15.115:0/1290701863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f3814d390 msgr2=0x7f4f3814d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f3814d390 0x7f4f3814d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 -- 172.21.15.115:0/1290701863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f380c1ff0 con 0x7f4f380c74f0 2023-07-27T14:32:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f3e99c700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f380c74f0 0x7f4f380c7950 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f4f3814b5e0 tx=0x7f4f30000fb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f2e7fc700 1 -- 172.21.15.115:0/1290701863 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000e540 con 0x7f4f380c74f0 2023-07-27T14:32:12.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f2e7fc700 1 -- 172.21.15.115:0/1290701863 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3000e6a0 con 0x7f4f380c74f0 2023-07-27T14:32:12.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f380c22d0 con 0x7f4f380c74f0 2023-07-27T14:32:12.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.022+0000 7f4f2e7fc700 1 -- 172.21.15.115:0/1290701863 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000ea20 con 0x7f4f380c74f0 2023-07-27T14:32:12.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.023+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f380c2890 con 0x7f4f380c74f0 2023-07-27T14:32:12.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.024+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3806c470 con 0x7f4f380c74f0 2023-07-27T14:32:12.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.024+0000 7f4f2e7fc700 1 -- 172.21.15.115:0/1290701863 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f4f3001e070 con 0x7f4f380c74f0 2023-07-27T14:32:12.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.025+0000 7f4f2e7fc700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f1c05f370 0x7f4f1c061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:12.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.025+0000 7f4f2e7fc700 1 -- 172.21.15.115:0/1290701863 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f4f30079c90 con 0x7f4f380c74f0 2023-07-27T14:32:12.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.025+0000 7f4f3e19b700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f1c05f370 0x7f4f1c061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:12.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.026+0000 7f4f3e19b700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f1c05f370 0x7f4f1c061830 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f4f34000c00 tx=0x7f4f34009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:12.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.030+0000 7f4f2e7fc700 1 -- 172.21.15.115:0/1290701863 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f3004ae70 con 0x7f4f380c74f0 2023-07-27T14:32:12.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.199+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4f38152b50 con 0x7f4f380c74f0 2023-07-27T14:32:12.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.795+0000 7f4f2e7fc700 1 -- 172.21.15.115:0/1290701863 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4f3004e490 con 0x7f4f380c74f0 2023-07-27T14:32:12.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f1c05f370 msgr2=0x7f4f1c061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:12.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f1c05f370 0x7f4f1c061830 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f4f34000c00 tx=0x7f4f34009040).stop 2023-07-27T14:32:12.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f380c74f0 msgr2=0x7f4f380c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:12.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f380c74f0 0x7f4f380c7950 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f4f3814b5e0 tx=0x7f4f30000fb0).stop 2023-07-27T14:32:12.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 shutdown_connections 2023-07-27T14:32:12.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f1c05f370 0x7f4f1c061830 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f380c74f0 0x7f4f380c7950 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f24004690 0x7f4f38148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 --2- 172.21.15.115:0/1290701863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f3814d390 0x7f4f3814d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:12.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 >> 172.21.15.115:0/1290701863 conn(0x7f4f3805e940 msgr2=0x7f4f381499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:12.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 shutdown_connections 2023-07-27T14:32:12.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:12.799+0000 7f4f403ff700 1 -- 172.21.15.115:0/1290701863 wait complete. 2023-07-27T14:32:12.837 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:32:12.856 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-07-27T14:32:13.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.014+0000 7fe319dff700 1 Processor -- start 2023-07-27T14:32:13.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.014+0000 7fe319dff700 1 -- start start 2023-07-27T14:32:13.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.015+0000 7fe319dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe31414ae00 0x7fe314154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.015+0000 7fe319dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe314063260 0x7fe3140a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.015+0000 7fe319dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3141553f0 con 0x7fe31414b1e0 2023-07-27T14:32:13.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.015+0000 7fe319dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe314157a50 con 0x7fe314063260 2023-07-27T14:32:13.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.015+0000 7fe319dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe314157d10 con 0x7fe31414ae00 2023-07-27T14:32:13.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.015+0000 7fe313fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe314063260 0x7fe3140a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.015+0000 7fe312ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe31414b1e0 0x7fe314062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58772/0 (socket says 172.21.15.115:58772) 2023-07-27T14:32:13.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.015+0000 7fe312ffd700 1 -- 172.21.15.115:0/957047581 learned_addr learned my addr 172.21.15.115:0/957047581 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:13.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe3137fe700 1 --2- 172.21.15.115:0/957047581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe31414ae00 0x7fe314154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe313fff700 1 -- 172.21.15.115:0/957047581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe31414ae00 msgr2=0x7fe314154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:13.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe313fff700 1 --2- 172.21.15.115:0/957047581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe31414ae00 0x7fe314154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe313fff700 1 -- 172.21.15.115:0/957047581 >> v1:172.21.15.115:6789/0 conn(0x7fe31414b1e0 legacy=0x7fe314062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe313fff700 1 -- 172.21.15.115:0/957047581 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314157ff0 con 0x7fe314063260 2023-07-27T14:32:13.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe3127fc700 1 -- 172.21.15.115:0/957047581 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673511796 0 0) 0x7fe3141553f0 con 0x7fe31414b1e0 2023-07-27T14:32:13.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe313fff700 1 --2- 172.21.15.115:0/957047581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe314063260 0x7fe3140a98c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fe30c009e60 tx=0x7fe30c009780).ready entity=mon.0 client_cookie=f811ac8740690643 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe3127fc700 1 -- 172.21.15.115:0/957047581 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00e070 con 0x7fe314063260 2023-07-27T14:32:13.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe3127fc700 1 -- 172.21.15.115:0/957047581 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00bb60 con 0x7fe314063260 2023-07-27T14:32:13.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.016+0000 7fe3127fc700 1 -- 172.21.15.115:0/957047581 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c012410 con 0x7fe314063260 2023-07-27T14:32:13.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.017+0000 7fe319dff700 1 -- 172.21.15.115:0/957047581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe314063260 msgr2=0x7fe3140a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.017+0000 7fe319dff700 1 --2- 172.21.15.115:0/957047581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe314063260 0x7fe3140a98c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fe30c009e60 tx=0x7fe30c009780).stop 2023-07-27T14:32:13.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.017+0000 7fe319dff700 1 -- 172.21.15.115:0/957047581 shutdown_connections 2023-07-27T14:32:13.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.017+0000 7fe319dff700 1 --2- 172.21.15.115:0/957047581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe31414ae00 0x7fe314154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.017+0000 7fe319dff700 1 --2- 172.21.15.115:0/957047581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe314063260 0x7fe3140a98c0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.017+0000 7fe319dff700 1 -- 172.21.15.115:0/957047581 >> 172.21.15.115:0/957047581 conn(0x7fe31405e940 msgr2=0x7fe3140cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:13.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.017+0000 7fe319dff700 1 -- 172.21.15.115:0/957047581 shutdown_connections 2023-07-27T14:32:13.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.017+0000 7fe319dff700 1 -- 172.21.15.115:0/957047581 wait complete. 2023-07-27T14:32:13.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.018+0000 7fe319dff700 1 Processor -- start 2023-07-27T14:32:13.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.018+0000 7fe319dff700 1 -- start start 2023-07-27T14:32:13.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.019+0000 7fe319dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe314063260 0x7fe3140c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.019+0000 7fe319dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31414ae00 0x7fe3140adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.019+0000 7fe319dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31414b1e0 0x7fe31413f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.019+0000 7fe319dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c4780 con 0x7fe31414ae00 2023-07-27T14:32:13.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.019+0000 7fe319dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140ae050 con 0x7fe31414b1e0 2023-07-27T14:32:13.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.019+0000 7fe319dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c4450 con 0x7fe314063260 2023-07-27T14:32:13.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31414ae00 0x7fe3140adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31414ae00 0x7fe3140adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57032/0 (socket says 172.21.15.115:57032) 2023-07-27T14:32:13.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 -- 172.21.15.115:0/3190781932 learned_addr learned my addr 172.21.15.115:0/3190781932 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:13.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe3137fe700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe314063260 0x7fe3140c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe313fff700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31414b1e0 0x7fe31413f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 -- 172.21.15.115:0/3190781932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe314063260 msgr2=0x7fe3140c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe314063260 0x7fe3140c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 -- 172.21.15.115:0/3190781932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31414b1e0 msgr2=0x7fe31413f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31414b1e0 0x7fe31413f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 -- 172.21.15.115:0/3190781932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c009a20 con 0x7fe31414ae00 2023-07-27T14:32:13.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe312ffd700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31414ae00 0x7fe3140adb60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fe30000c4c0 tx=0x7fe300007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe30b7fe700 1 -- 172.21.15.115:0/3190781932 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000ce80 con 0x7fe31414ae00 2023-07-27T14:32:13.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe30b7fe700 1 -- 172.21.15.115:0/3190781932 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3000072e0 con 0x7fe31414ae00 2023-07-27T14:32:13.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3140caa40 con 0x7fe31414ae00 2023-07-27T14:32:13.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.020+0000 7fe30b7fe700 1 -- 172.21.15.115:0/3190781932 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300007660 con 0x7fe31414ae00 2023-07-27T14:32:13.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.021+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe314167e70 con 0x7fe31414ae00 2023-07-27T14:32:13.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.022+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3140c48c0 con 0x7fe31414ae00 2023-07-27T14:32:13.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.023+0000 7fe30b7fe700 1 -- 172.21.15.115:0/3190781932 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fe30001a060 con 0x7fe31414ae00 2023-07-27T14:32:13.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.024+0000 7fe30b7fe700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2fc05f340 0x7fe2fc061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.024+0000 7fe30b7fe700 1 -- 172.21.15.115:0/3190781932 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe300079850 con 0x7fe31414ae00 2023-07-27T14:32:13.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.024+0000 7fe3137fe700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2fc05f340 0x7fe2fc061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.025+0000 7fe3137fe700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2fc05f340 0x7fe2fc061800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fe304009c30 tx=0x7fe304009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.028+0000 7fe30b7fe700 1 -- 172.21.15.115:0/3190781932 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3140c48c0 con 0x7fe31414ae00 2023-07-27T14:32:13.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.197+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7fe3140c48c0 con 0x7fe31414ae00 2023-07-27T14:32:13.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.202+0000 7fe30b7fe700 1 -- 172.21.15.115:0/3190781932 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v16) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe3140c48c0 con 0x7fe31414ae00 2023-07-27T14:32:13.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2fc05f340 msgr2=0x7fe2fc061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2fc05f340 0x7fe2fc061800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fe304009c30 tx=0x7fe304009060).stop 2023-07-27T14:32:13.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31414ae00 msgr2=0x7fe3140adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31414ae00 0x7fe3140adb60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fe30000c4c0 tx=0x7fe300007d70).stop 2023-07-27T14:32:13.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 shutdown_connections 2023-07-27T14:32:13.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe2fc05f340 0x7fe2fc061800 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe31414b1e0 0x7fe31413f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe314063260 0x7fe3140c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 --2- 172.21.15.115:0/3190781932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe31414ae00 0x7fe3140adb60 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 >> 172.21.15.115:0/3190781932 conn(0x7fe31405e940 msgr2=0x7fe3140a9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:13.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 shutdown_connections 2023-07-27T14:32:13.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.204+0000 7fe319dff700 1 -- 172.21.15.115:0/3190781932 wait complete. 2023-07-27T14:32:13.257 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:32:13.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.411+0000 7fb4ca1ff700 1 Processor -- start 2023-07-27T14:32:13.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.411+0000 7fb4ca1ff700 1 -- start start 2023-07-27T14:32:13.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.412+0000 7fb4ca1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb4c4153e00 0x7fb4c40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.412+0000 7fb4ca1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4064230 0x7fb4c40656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.412+0000 7fb4ca1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb4c4065bc0 0x7fb4c4157a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.412+0000 7fb4ca1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c4062320 con 0x7fb4c4065bc0 2023-07-27T14:32:13.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.412+0000 7fb4ca1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c4066050 con 0x7fb4c4153e00 2023-07-27T14:32:13.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.412+0000 7fb4ca1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4064a80 con 0x7fb4c4064230 2023-07-27T14:32:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb4c4065bc0 0x7fb4c4157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb4c4065bc0 0x7fb4c4157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57042/0 (socket says 172.21.15.115:57042) 2023-07-27T14:32:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 -- 172.21.15.115:0/852701188 learned_addr learned my addr 172.21.15.115:0/852701188 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c2ffd700 1 --2- 172.21.15.115:0/852701188 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4064230 0x7fb4c40656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c37fe700 1 --2- 172.21.15.115:0/852701188 >> v2:172.21.15.159:3300/0 conn(0x7fb4c4153e00 0x7fb4c40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 -- 172.21.15.115:0/852701188 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4064230 msgr2=0x7fb4c40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 --2- 172.21.15.115:0/852701188 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4064230 0x7fb4c40656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 -- 172.21.15.115:0/852701188 >> v2:172.21.15.159:3300/0 conn(0x7fb4c4153e00 msgr2=0x7fb4c40c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 --2- 172.21.15.115:0/852701188 >> v2:172.21.15.159:3300/0 conn(0x7fb4c4153e00 0x7fb4c40c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 -- 172.21.15.115:0/852701188 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c4064d60 con 0x7fb4c4065bc0 2023-07-27T14:32:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.413+0000 7fb4c3fff700 1 --2- 172.21.15.115:0/852701188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4065bc0 0x7fb4c4157a60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fb4c40671d0 tx=0x7fb4bc009840).ready entity=mon.0 client_cookie=1ada0418531e15c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4c27fc700 1 -- 172.21.15.115:0/852701188 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00e070 con 0x7fb4c4065bc0 2023-07-27T14:32:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4c27fc700 1 -- 172.21.15.115:0/852701188 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc00ba50 con 0x7fb4c4065bc0 2023-07-27T14:32:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4c27fc700 1 -- 172.21.15.115:0/852701188 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00bdd0 con 0x7fb4c4065bc0 2023-07-27T14:32:13.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/852701188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4065bc0 msgr2=0x7fb4c4157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/852701188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4065bc0 0x7fb4c4157a60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fb4c40671d0 tx=0x7fb4bc009840).stop 2023-07-27T14:32:13.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/852701188 shutdown_connections 2023-07-27T14:32:13.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/852701188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4065bc0 0x7fb4c4157a60 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/852701188 >> v2:172.21.15.159:3300/0 conn(0x7fb4c4153e00 0x7fb4c40c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/852701188 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4064230 0x7fb4c40656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/852701188 >> 172.21.15.115:0/852701188 conn(0x7fb4c40c7b90 msgr2=0x7fb4c40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/852701188 shutdown_connections 2023-07-27T14:32:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.414+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/852701188 wait complete. 2023-07-27T14:32:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.416+0000 7fb4ca1ff700 1 Processor -- start 2023-07-27T14:32:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.416+0000 7fb4ca1ff700 1 -- start start 2023-07-27T14:32:13.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4ca1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4064230 0x7fb4c40685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4ca1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4065bc0 0x7fb4c4162f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4ca1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4c4153e00 0x7fb4c40a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4ca1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4094ab0 con 0x7fb4c4064230 2023-07-27T14:32:13.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4ca1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4068f30 con 0x7fb4c4153e00 2023-07-27T14:32:13.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4ca1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4069210 con 0x7fb4c4065bc0 2023-07-27T14:32:13.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4064230 0x7fb4c40685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4064230 0x7fb4c40685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57044/0 (socket says 172.21.15.115:57044) 2023-07-27T14:32:13.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c37fe700 1 -- 172.21.15.115:0/727512452 learned_addr learned my addr 172.21.15.115:0/727512452 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:13.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c3fff700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4c4153e00 0x7fb4c40a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c2ffd700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4065bc0 0x7fb4c4162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c37fe700 1 -- 172.21.15.115:0/727512452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4065bc0 msgr2=0x7fb4c4162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c37fe700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4065bc0 0x7fb4c4162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c37fe700 1 -- 172.21.15.115:0/727512452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4c4153e00 msgr2=0x7fb4c40a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c37fe700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4c4153e00 0x7fb4c40a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.418+0000 7fb4c37fe700 1 -- 172.21.15.115:0/727512452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc009ae0 con 0x7fb4c4064230 2023-07-27T14:32:13.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.419+0000 7fb4c37fe700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4064230 0x7fb4c40685c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fb4b400d890 tx=0x7fb4b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.419+0000 7fb4ab7fe700 1 -- 172.21.15.115:0/727512452 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40125f0 con 0x7fb4c4064230 2023-07-27T14:32:13.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.419+0000 7fb4ab7fe700 1 -- 172.21.15.115:0/727512452 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b4012750 con 0x7fb4c4064230 2023-07-27T14:32:13.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.419+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c40694f0 con 0x7fb4c4064230 2023-07-27T14:32:13.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.419+0000 7fb4ab7fe700 1 -- 172.21.15.115:0/727512452 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4012ad0 con 0x7fb4c4064230 2023-07-27T14:32:13.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.419+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c4069ab0 con 0x7fb4c4064230 2023-07-27T14:32:13.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.420+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c4069e20 con 0x7fb4c4064230 2023-07-27T14:32:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.421+0000 7fb4ab7fe700 1 -- 172.21.15.115:0/727512452 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fb4b4013480 con 0x7fb4c4064230 2023-07-27T14:32:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.422+0000 7fb4ab7fe700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4b005f370 0x7fb4b0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.422+0000 7fb4ab7fe700 1 -- 172.21.15.115:0/727512452 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fb4b4079df0 con 0x7fb4c4064230 2023-07-27T14:32:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.422+0000 7fb4c2ffd700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4b005f370 0x7fb4b0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.422+0000 7fb4c2ffd700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4b005f370 0x7fb4b0061830 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fb4c4167f90 tx=0x7fb4b8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.426+0000 7fb4ab7fe700 1 -- 172.21.15.115:0/727512452 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4b404b280 con 0x7fb4c4064230 2023-07-27T14:32:13.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.605+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb4c406c470 con 0x7fb4c4064230 2023-07-27T14:32:13.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.609+0000 7fb4ab7fe700 1 -- 172.21.15.115:0/727512452 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb4c406c470 con 0x7fb4c4064230 2023-07-27T14:32:13.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4b005f370 msgr2=0x7fb4b0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4b005f370 0x7fb4b0061830 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fb4c4167f90 tx=0x7fb4b8008040).stop 2023-07-27T14:32:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4064230 msgr2=0x7fb4c40685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4064230 0x7fb4c40685c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fb4b400d890 tx=0x7fb4b4008040).stop 2023-07-27T14:32:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 shutdown_connections 2023-07-27T14:32:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4b005f370 0x7fb4b0061830 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4c4153e00 0x7fb4c40a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4c4064230 0x7fb4c40685c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 --2- 172.21.15.115:0/727512452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4c4065bc0 0x7fb4c4162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 >> 172.21.15.115:0/727512452 conn(0x7fb4c40c7b90 msgr2=0x7fb4c40a4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:13.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 shutdown_connections 2023-07-27T14:32:13.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.611+0000 7fb4ca1ff700 1 -- 172.21.15.115:0/727512452 wait complete. 2023-07-27T14:32:13.664 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete' 2023-07-27T14:32:13.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.816+0000 7f7f27fff700 1 Processor -- start 2023-07-27T14:32:13.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.816+0000 7f7f27fff700 1 -- start start 2023-07-27T14:32:13.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.817+0000 7f7f27fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7f200aaa40 0x7f7f200640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.817+0000 7f7f27fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f201542a0 0x7f7f200645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.817+0000 7f7f27fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200aa4d0 con 0x7f7f20153ec0 2023-07-27T14:32:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.817+0000 7f7f27fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f20064ad0 con 0x7f7f200aaa40 2023-07-27T14:32:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.817+0000 7f7f27fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200c05c0 con 0x7f7f201542a0 2023-07-27T14:32:13.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.817+0000 7f7f25d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7f20153ec0 0x7f7f200a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46130/0 (socket says 172.21.15.115:46130) 2023-07-27T14:32:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f25d9b700 1 -- 172.21.15.115:0/1631701781 learned_addr learned my addr 172.21.15.115:0/1631701781 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.817+0000 7f7f2559a700 1 --2- 172.21.15.115:0/1631701781 >> v2:172.21.15.115:3300/0 conn(0x7f7f200aaa40 0x7f7f200640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f2659c700 1 --2- 172.21.15.115:0/1631701781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f201542a0 0x7f7f200645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f2559a700 1 -- 172.21.15.115:0/1631701781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f201542a0 msgr2=0x7f7f200645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f2559a700 1 --2- 172.21.15.115:0/1631701781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f201542a0 0x7f7f200645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f2559a700 1 -- 172.21.15.115:0/1631701781 >> v1:172.21.15.115:6789/0 conn(0x7f7f20153ec0 legacy=0x7f7f200a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f24d99700 1 -- 172.21.15.115:0/1631701781 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177744404 0 0) 0x7f7f1c001110 con 0x7f7f20153ec0 2023-07-27T14:32:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f2559a700 1 -- 172.21.15.115:0/1631701781 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200c1a60 con 0x7f7f200aaa40 2023-07-27T14:32:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f2559a700 1 --2- 172.21.15.115:0/1631701781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f200aaa40 0x7f7f200640f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f7f10009760 tx=0x7f7f10009060).ready entity=mon.0 client_cookie=9e519c9e06becf42 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f24d99700 1 -- 172.21.15.115:0/1631701781 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000f510 con 0x7f7f200aaa40 2023-07-27T14:32:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f24d99700 1 -- 172.21.15.115:0/1631701781 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000f670 con 0x7f7f200aaa40 2023-07-27T14:32:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.818+0000 7f7f24d99700 1 -- 172.21.15.115:0/1631701781 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000f9f0 con 0x7f7f200aaa40 2023-07-27T14:32:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.819+0000 7f7f27fff700 1 -- 172.21.15.115:0/1631701781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f200aaa40 msgr2=0x7f7f200640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.819+0000 7f7f27fff700 1 --2- 172.21.15.115:0/1631701781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f200aaa40 0x7f7f200640f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f7f10009760 tx=0x7f7f10009060).stop 2023-07-27T14:32:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.819+0000 7f7f27fff700 1 -- 172.21.15.115:0/1631701781 shutdown_connections 2023-07-27T14:32:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.819+0000 7f7f27fff700 1 --2- 172.21.15.115:0/1631701781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f201542a0 0x7f7f200645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.819+0000 7f7f27fff700 1 --2- 172.21.15.115:0/1631701781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f200aaa40 0x7f7f200640f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.819+0000 7f7f27fff700 1 -- 172.21.15.115:0/1631701781 >> 172.21.15.115:0/1631701781 conn(0x7f7f200cb610 msgr2=0x7f7f200c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.819+0000 7f7f27fff700 1 -- 172.21.15.115:0/1631701781 shutdown_connections 2023-07-27T14:32:13.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.819+0000 7f7f27fff700 1 -- 172.21.15.115:0/1631701781 wait complete. 2023-07-27T14:32:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.820+0000 7f7f27fff700 1 Processor -- start 2023-07-27T14:32:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.821+0000 7f7f27fff700 1 -- start start 2023-07-27T14:32:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.821+0000 7f7f27fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f200aaa40 0x7f7f20156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.821+0000 7f7f27fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f20153ec0 0x7f7f20157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f27fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f201542a0 0x7f7f200c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f27fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20157940 con 0x7f7f201542a0 2023-07-27T14:32:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f27fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200c1f80 con 0x7f7f20153ec0 2023-07-27T14:32:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f27fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20157b40 con 0x7f7f200aaa40 2023-07-27T14:32:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f201542a0 0x7f7f200c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f201542a0 0x7f7f200c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33278/0 (socket says 172.21.15.115:33278) 2023-07-27T14:32:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 -- 172.21.15.115:0/608697245 learned_addr learned my addr 172.21.15.115:0/608697245 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:13.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2559a700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f20153ec0 0x7f7f20157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f25d9b700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f200aaa40 0x7f7f20156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 -- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f200aaa40 msgr2=0x7f7f20156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f200aaa40 0x7f7f20156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 -- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f20153ec0 msgr2=0x7f7f20157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f20153ec0 0x7f7f20157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 -- 172.21.15.115:0/608697245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100092a0 con 0x7f7f201542a0 2023-07-27T14:32:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f25d9b700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f200aaa40 0x7f7f20156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:13.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.822+0000 7f7f2659c700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f201542a0 0x7f7f200c35c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f7f18009d40 tx=0x7f7f1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.823+0000 7f7f15ffb700 1 -- 172.21.15.115:0/608697245 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18009ea0 con 0x7f7f201542a0 2023-07-27T14:32:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.823+0000 7f7f15ffb700 1 -- 172.21.15.115:0/608697245 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800f040 con 0x7f7f201542a0 2023-07-27T14:32:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.823+0000 7f7f15ffb700 1 -- 172.21.15.115:0/608697245 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800cd80 con 0x7f7f201542a0 2023-07-27T14:32:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.823+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f20157e20 con 0x7f7f201542a0 2023-07-27T14:32:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.823+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f201583e0 con 0x7f7f201542a0 2023-07-27T14:32:13.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.824+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f20158a30 con 0x7f7f201542a0 2023-07-27T14:32:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.825+0000 7f7f15ffb700 1 -- 172.21.15.115:0/608697245 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f7f18013610 con 0x7f7f201542a0 2023-07-27T14:32:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.825+0000 7f7f15ffb700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f0405f370 0x7f7f04061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:13.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.825+0000 7f7f15ffb700 1 -- 172.21.15.115:0/608697245 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f7f1807a8d0 con 0x7f7f201542a0 2023-07-27T14:32:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.826+0000 7f7f25d9b700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f0405f370 0x7f7f04061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.826+0000 7f7f25d9b700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f0405f370 0x7f7f04061830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f7f1c001720 tx=0x7f7f1c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:13.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:13.830+0000 7f7f15ffb700 1 -- 172.21.15.115:0/608697245 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f1804bcb0 con 0x7f7f201542a0 2023-07-27T14:32:14.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.067+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]} v 0) v1 -- 0x7f7f2006c470 con 0x7f7f201542a0 2023-07-27T14:32:14.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.800+0000 7f7f15ffb700 1 -- 172.21.15.115:0/608697245 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]}]=0 v283) v1 ==== 187+0+0 (secure 0 0 0) 0x7f7f1804f2d0 con 0x7f7f201542a0 2023-07-27T14:32:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f0405f370 msgr2=0x7f7f04061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f0405f370 0x7f7f04061830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f7f1c001720 tx=0x7f7f1c009040).stop 2023-07-27T14:32:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f201542a0 msgr2=0x7f7f200c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f201542a0 0x7f7f200c35c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f7f18009d40 tx=0x7f7f1800b040).stop 2023-07-27T14:32:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 shutdown_connections 2023-07-27T14:32:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f0405f370 0x7f7f04061830 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f201542a0 0x7f7f200c35c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f200aaa40 0x7f7f20156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 --2- 172.21.15.115:0/608697245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f20153ec0 0x7f7f20157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.803+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 >> 172.21.15.115:0/608697245 conn(0x7f7f200cb610 msgr2=0x7f7f200ab540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.804+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 shutdown_connections 2023-07-27T14:32:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:14.804+0000 7f7f27fff700 1 -- 172.21.15.115:0/608697245 wait complete. 2023-07-27T14:32:14.859 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:32:14.860 INFO:tasks.cephfs_test_runner:Starting test: test_clone_subvolume_info (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:32:14.860 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_subvolume_info' 2023-07-27T14:32:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.016+0000 7fd21d1ff700 1 Processor -- start 2023-07-27T14:32:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.016+0000 7fd21d1ff700 1 -- start start 2023-07-27T14:32:15.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd21d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2180a4840 0x7fd2180a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:15.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd21d1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd2180bc050 0x7fd2180bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:15.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd21d1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2180639d0 con 0x7fd218151bd0 2023-07-27T14:32:15.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd21d1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd218137610 con 0x7fd2180bc050 2023-07-27T14:32:15.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd21d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180a51b0 con 0x7fd2180a4840 2023-07-27T14:32:15.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd216d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd218151bd0 0x7fd218062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46146/0 (socket says 172.21.15.115:46146) 2023-07-27T14:32:15.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd216d9d700 1 -- 172.21.15.115:0/2468151438 learned_addr learned my addr 172.21.15.115:0/2468151438 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:15.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd21759e700 1 --2- 172.21.15.115:0/2468151438 >> v2:172.21.15.115:3300/0 conn(0x7fd2180bc050 0x7fd2180bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:15.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd215d9b700 1 -- 172.21.15.115:0/2468151438 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545901854 0 0) 0x7fd2180639d0 con 0x7fd218151bd0 2023-07-27T14:32:15.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd21659c700 1 --2- 172.21.15.115:0/2468151438 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2180a4840 0x7fd2180a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:15.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.018+0000 7fd215d9b700 1 -- 172.21.15.115:0/2468151438 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2000033f0 con 0x7fd218151bd0 2023-07-27T14:32:15.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd21759e700 1 -- 172.21.15.115:0/2468151438 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2180a4840 msgr2=0x7fd2180a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:15.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd21759e700 1 --2- 172.21.15.115:0/2468151438 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2180a4840 0x7fd2180a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:15.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd21759e700 1 -- 172.21.15.115:0/2468151438 >> v1:172.21.15.115:6789/0 conn(0x7fd218151bd0 legacy=0x7fd218062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:15.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd21759e700 1 -- 172.21.15.115:0/2468151438 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218062dc0 con 0x7fd2180bc050 2023-07-27T14:32:15.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd21759e700 1 --2- 172.21.15.115:0/2468151438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd2180bc4e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fd210009e60 tx=0x7fd210009780).ready entity=mon.0 client_cookie=fbf1f003a1c541ba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:15.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd215d9b700 1 -- 172.21.15.115:0/2468151438 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21000e070 con 0x7fd2180bc050 2023-07-27T14:32:15.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd215d9b700 1 -- 172.21.15.115:0/2468151438 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21000bb60 con 0x7fd2180bc050 2023-07-27T14:32:15.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd215d9b700 1 -- 172.21.15.115:0/2468151438 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210012410 con 0x7fd2180bc050 2023-07-27T14:32:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd21d1ff700 1 -- 172.21.15.115:0/2468151438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 msgr2=0x7fd2180bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/2468151438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd2180bc4e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fd210009e60 tx=0x7fd210009780).stop 2023-07-27T14:32:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.019+0000 7fd21d1ff700 1 -- 172.21.15.115:0/2468151438 shutdown_connections 2023-07-27T14:32:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.020+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/2468151438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd2180bc4e0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:15.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.020+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/2468151438 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2180a4840 0x7fd2180a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.020+0000 7fd21d1ff700 1 -- 172.21.15.115:0/2468151438 >> 172.21.15.115:0/2468151438 conn(0x7fd218064700 msgr2=0x7fd218064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.020+0000 7fd21d1ff700 1 -- 172.21.15.115:0/2468151438 shutdown_connections 2023-07-27T14:32:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.020+0000 7fd21d1ff700 1 -- 172.21.15.115:0/2468151438 wait complete. 2023-07-27T14:32:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.021+0000 7fd21d1ff700 1 Processor -- start 2023-07-27T14:32:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.021+0000 7fd21d1ff700 1 -- start start 2023-07-27T14:32:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21d1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2180a4840 0x7fd218136bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:15.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21d1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd218068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:15.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd218151bd0 0x7fd2180bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:15.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21d1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180a7650 con 0x7fd2180bc050 2023-07-27T14:32:15.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21d1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2181370e0 con 0x7fd2180a4840 2023-07-27T14:32:15.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd218068ef0 con 0x7fd218151bd0 2023-07-27T14:32:15.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd218068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:15.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd218068610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33288/0 (socket says 172.21.15.115:33288) 2023-07-27T14:32:15.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.022+0000 7fd21659c700 1 -- 172.21.15.115:0/433887795 learned_addr learned my addr 172.21.15.115:0/433887795 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:15.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd21659c700 1 -- 172.21.15.115:0/433887795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd218151bd0 msgr2=0x7fd2180bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:15.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd21659c700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd218151bd0 0x7fd2180bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:15.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd21659c700 1 -- 172.21.15.115:0/433887795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2180a4840 msgr2=0x7fd218136bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:15.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd21659c700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2180a4840 0x7fd218136bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:15.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd21659c700 1 -- 172.21.15.115:0/433887795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210009a20 con 0x7fd2180bc050 2023-07-27T14:32:15.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd21659c700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd218068610 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fd20c00d890 tx=0x7fd20c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:15.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd1feffd700 1 -- 172.21.15.115:0/433887795 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0125f0 con 0x7fd2180bc050 2023-07-27T14:32:15.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd1feffd700 1 -- 172.21.15.115:0/433887795 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c012750 con 0x7fd2180bc050 2023-07-27T14:32:15.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2180691d0 con 0x7fd2180bc050 2023-07-27T14:32:15.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd1feffd700 1 -- 172.21.15.115:0/433887795 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c012ad0 con 0x7fd2180bc050 2023-07-27T14:32:15.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.023+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2180a71e0 con 0x7fd2180bc050 2023-07-27T14:32:15.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.024+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2180a7400 con 0x7fd2180bc050 2023-07-27T14:32:15.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.025+0000 7fd1feffd700 1 -- 172.21.15.115:0/433887795 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fd20c013480 con 0x7fd2180bc050 2023-07-27T14:32:15.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.026+0000 7fd1feffd700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd20405f370 0x7fd204061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:15.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.026+0000 7fd1feffd700 1 -- 172.21.15.115:0/433887795 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd20c079ec0 con 0x7fd2180bc050 2023-07-27T14:32:15.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.026+0000 7fd216d9d700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd20405f370 0x7fd204061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:15.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.027+0000 7fd216d9d700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd20405f370 0x7fd204061830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fd208005750 tx=0x7fd208007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:15.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.030+0000 7fd1feffd700 1 -- 172.21.15.115:0/433887795 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd20c04b240 con 0x7fd2180bc050 2023-07-27T14:32:15.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.262+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_subvolume_info"]} v 0) v1 -- 0x7fd21806c470 con 0x7fd2180bc050 2023-07-27T14:32:15.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.807+0000 7fd1feffd700 1 -- 172.21.15.115:0/433887795 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_subvolume_info"]}]=0 v284) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd20c04e860 con 0x7fd2180bc050 2023-07-27T14:32:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd20405f370 msgr2=0x7fd204061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd20405f370 0x7fd204061830 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fd208005750 tx=0x7fd208007850).stop 2023-07-27T14:32:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 msgr2=0x7fd218068610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd218068610 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fd20c00d890 tx=0x7fd20c008040).stop 2023-07-27T14:32:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 shutdown_connections 2023-07-27T14:32:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd20405f370 0x7fd204061830 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd218151bd0 0x7fd2180bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2180a4840 0x7fd218136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 --2- 172.21.15.115:0/433887795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2180bc050 0x7fd218068610 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 >> 172.21.15.115:0/433887795 conn(0x7fd218064700 msgr2=0x7fd2180bcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 shutdown_connections 2023-07-27T14:32:15.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:15.810+0000 7fd21d1ff700 1 -- 172.21.15.115:0/433887795 wait complete. 2023-07-27T14:32:15.864 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:32:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.019+0000 7f279f9ff700 1 Processor -- start 2023-07-27T14:32:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.019+0000 7f279f9ff700 1 -- start start 2023-07-27T14:32:16.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.020+0000 7f279f9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f279814ae00 0x7f2798154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.020+0000 7f279f9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f279814b1e0 0x7f2798062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.020+0000 7f279f9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27981553f0 con 0x7f27980c5c50 2023-07-27T14:32:16.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.020+0000 7f279f9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2798157a50 con 0x7f279814b1e0 2023-07-27T14:32:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.020+0000 7f279f9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2798157d10 con 0x7f279814ae00 2023-07-27T14:32:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.020+0000 7f279cf9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f279814b1e0 0x7f2798062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.020+0000 7f279cf9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f279814b1e0 0x7f2798062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33294/0 (socket says 172.21.15.115:33294) 2023-07-27T14:32:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.020+0000 7f279cf9a700 1 -- 172.21.15.115:0/3435594387 learned_addr learned my addr 172.21.15.115:0/3435594387 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f279cf9a700 1 -- 172.21.15.115:0/3435594387 >> v2:172.21.15.159:3300/0 conn(0x7f279814ae00 msgr2=0x7f2798154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f279d79b700 1 --2- 172.21.15.115:0/3435594387 >> v2:172.21.15.159:3300/0 conn(0x7f279814ae00 0x7f2798154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f279cf9a700 1 --2- 172.21.15.115:0/3435594387 >> v2:172.21.15.159:3300/0 conn(0x7f279814ae00 0x7f2798154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f279cf9a700 1 -- 172.21.15.115:0/3435594387 >> v1:172.21.15.159:6789/0 conn(0x7f27980c5c50 legacy=0x7f27980a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f279cf9a700 1 -- 172.21.15.115:0/3435594387 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798157ff0 con 0x7f279814b1e0 2023-07-27T14:32:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f279d79b700 1 --2- 172.21.15.115:0/3435594387 >> v2:172.21.15.159:3300/0 conn(0x7f279814ae00 0x7f2798154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f279cf9a700 1 --2- 172.21.15.115:0/3435594387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f2798062b50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f2798155580 tx=0x7f27880090f0).ready entity=mon.0 client_cookie=aec2f6de48b1f845 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f278ffff700 1 -- 172.21.15.115:0/3435594387 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278800b5a0 con 0x7f279814b1e0 2023-07-27T14:32:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f278ffff700 1 -- 172.21.15.115:0/3435594387 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278800b700 con 0x7f279814b1e0 2023-07-27T14:32:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.021+0000 7f278ffff700 1 -- 172.21.15.115:0/3435594387 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278800ba80 con 0x7f279814b1e0 2023-07-27T14:32:16.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.022+0000 7f279f9ff700 1 -- 172.21.15.115:0/3435594387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 msgr2=0x7f2798062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.022+0000 7f279f9ff700 1 --2- 172.21.15.115:0/3435594387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f2798062b50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f2798155580 tx=0x7f27880090f0).stop 2023-07-27T14:32:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.022+0000 7f279f9ff700 1 -- 172.21.15.115:0/3435594387 shutdown_connections 2023-07-27T14:32:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.022+0000 7f279f9ff700 1 --2- 172.21.15.115:0/3435594387 >> v2:172.21.15.159:3300/0 conn(0x7f279814ae00 0x7f2798154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.022+0000 7f279f9ff700 1 --2- 172.21.15.115:0/3435594387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f2798062b50 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.022+0000 7f279f9ff700 1 -- 172.21.15.115:0/3435594387 >> 172.21.15.115:0/3435594387 conn(0x7f279805e940 msgr2=0x7f27980cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.022+0000 7f279f9ff700 1 -- 172.21.15.115:0/3435594387 shutdown_connections 2023-07-27T14:32:16.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.022+0000 7f279f9ff700 1 -- 172.21.15.115:0/3435594387 wait complete. 2023-07-27T14:32:16.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.023+0000 7f279f9ff700 1 Processor -- start 2023-07-27T14:32:16.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.024+0000 7f279f9ff700 1 -- start start 2023-07-27T14:32:16.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.024+0000 7f279f9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27980c5c50 0x7f27980ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.024+0000 7f279f9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f279814ae00 0x7f27980c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.024+0000 7f279f9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f27980aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.024+0000 7f279f9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980ac600 con 0x7f279814b1e0 2023-07-27T14:32:16.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.024+0000 7f279f9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c44a0 con 0x7f279814ae00 2023-07-27T14:32:16.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.024+0000 7f279f9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c4720 con 0x7f27980c5c50 2023-07-27T14:32:16.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f27980aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f27980aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33298/0 (socket says 172.21.15.115:33298) 2023-07-27T14:32:16.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 -- 172.21.15.115:0/830008537 learned_addr learned my addr 172.21.15.115:0/830008537 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:16.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 -- 172.21.15.115:0/830008537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27980c5c50 msgr2=0x7f27980ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27980c5c50 0x7f27980ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:16.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 -- 172.21.15.115:0/830008537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f279814ae00 msgr2=0x7f27980c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f279814ae00 0x7f27980c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:16.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 -- 172.21.15.115:0/830008537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2788009370 con 0x7f279814b1e0 2023-07-27T14:32:16.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279df9c700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f27980aac30 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f279000c810 tx=0x7f2790002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:16.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f278d7fa700 1 -- 172.21.15.115:0/830008537 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790010510 con 0x7f279814b1e0 2023-07-27T14:32:16.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f278d7fa700 1 -- 172.21.15.115:0/830008537 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790010690 con 0x7f279814b1e0 2023-07-27T14:32:16.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27980c4a00 con 0x7f279814b1e0 2023-07-27T14:32:16.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.025+0000 7f278d7fa700 1 -- 172.21.15.115:0/830008537 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790010a50 con 0x7f279814b1e0 2023-07-27T14:32:16.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.026+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27980c4fc0 con 0x7f279814b1e0 2023-07-27T14:32:16.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.027+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279806c470 con 0x7f279814b1e0 2023-07-27T14:32:16.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.027+0000 7f278d7fa700 1 -- 172.21.15.115:0/830008537 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f2790019030 con 0x7f279814b1e0 2023-07-27T14:32:16.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.028+0000 7f278d7fa700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f277c05f370 0x7f277c061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.028+0000 7f278d7fa700 1 -- 172.21.15.115:0/830008537 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f2790079a80 con 0x7f279814b1e0 2023-07-27T14:32:16.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.029+0000 7f279d79b700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f277c05f370 0x7f277c061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.029+0000 7f279d79b700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f277c05f370 0x7f277c061830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f2794006fd0 tx=0x7f2794008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:16.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.032+0000 7f278d7fa700 1 -- 172.21.15.115:0/830008537 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27900488f0 con 0x7f279814b1e0 2023-07-27T14:32:16.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.201+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2798063bb0 con 0x7f279814b1e0 2023-07-27T14:32:16.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.205+0000 7f278d7fa700 1 -- 172.21.15.115:0/830008537 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f279004ad70 con 0x7f279814b1e0 2023-07-27T14:32:16.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f277c05f370 msgr2=0x7f277c061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f277c05f370 0x7f277c061830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f2794006fd0 tx=0x7f2794008040).stop 2023-07-27T14:32:16.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 msgr2=0x7f27980aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f27980aac30 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f279000c810 tx=0x7f2790002530).stop 2023-07-27T14:32:16.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 shutdown_connections 2023-07-27T14:32:16.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f277c05f370 0x7f277c061830 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f279814b1e0 0x7f27980aac30 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27980c5c50 0x7f27980ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:16.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 --2- 172.21.15.115:0/830008537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f279814ae00 0x7f27980c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:16.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 >> 172.21.15.115:0/830008537 conn(0x7f279805e940 msgr2=0x7f2798152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:16.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 shutdown_connections 2023-07-27T14:32:16.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.207+0000 7f279f9ff700 1 -- 172.21.15.115:0/830008537 wait complete. 2023-07-27T14:32:16.260 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:32:16.261 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:32:16.359 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:32:16.466 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:32:16.466 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:32:16.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:16.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.619+0000 7fccc79ff700 1 Processor -- start 2023-07-27T14:32:16.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.619+0000 7fccc79ff700 1 -- start start 2023-07-27T14:32:16.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.620+0000 7fccc79ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc01542a0 0x7fccc015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.620+0000 7fccc79ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc00aa4d0 con 0x7fccc0153ec0 2023-07-27T14:32:16.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.620+0000 7fccc79ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc00c05c0 con 0x7fccc00aaa40 2023-07-27T14:32:16.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.620+0000 7fccc79ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c1a60 con 0x7fccc01542a0 2023-07-27T14:32:16.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.620+0000 7fccc579b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fccc0153ec0 0x7fccc00a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46160/0 (socket says 172.21.15.115:46160) 2023-07-27T14:32:16.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccc579b700 1 -- 172.21.15.115:0/363047424 learned_addr learned my addr 172.21.15.115:0/363047424 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:16.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccc5f9c700 1 --2- 172.21.15.115:0/363047424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc01542a0 0x7fccc015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccb7fff700 1 -- 172.21.15.115:0/363047424 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598120075 0 0) 0x7fccbc001110 con 0x7fccc0153ec0 2023-07-27T14:32:16.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccb7fff700 1 -- 172.21.15.115:0/363047424 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccac0033f0 con 0x7fccc0153ec0 2023-07-27T14:32:16.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccc5f9c700 1 -- 172.21.15.115:0/363047424 >> v1:172.21.15.159:6789/0 conn(0x7fccc00aaa40 legacy=0x7fccc00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccb7fff700 1 -- 172.21.15.115:0/363047424 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2788947622 0 0) 0x7fccac0033f0 con 0x7fccc0153ec0 2023-07-27T14:32:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccc5f9c700 1 -- 172.21.15.115:0/363047424 >> v1:172.21.15.115:6789/0 conn(0x7fccc0153ec0 legacy=0x7fccc00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccc5f9c700 1 -- 172.21.15.115:0/363047424 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00aa270 con 0x7fccc01542a0 2023-07-27T14:32:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.621+0000 7fccc5f9c700 1 --2- 172.21.15.115:0/363047424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc01542a0 0x7fccc015efc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fccb8009e90 tx=0x7fccb8009780).ready entity=mon.2 client_cookie=75a2add63ffcc46a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccb7fff700 1 -- 172.21.15.115:0/363047424 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800e070 con 0x7fccc01542a0 2023-07-27T14:32:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccb7fff700 1 -- 172.21.15.115:0/363047424 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb800b850 con 0x7fccc01542a0 2023-07-27T14:32:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccb7fff700 1 -- 172.21.15.115:0/363047424 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc001600 con 0x7fccc01542a0 2023-07-27T14:32:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccc79ff700 1 -- 172.21.15.115:0/363047424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc01542a0 msgr2=0x7fccc015efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccc79ff700 1 --2- 172.21.15.115:0/363047424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc01542a0 0x7fccc015efc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fccb8009e90 tx=0x7fccb8009780).stop 2023-07-27T14:32:16.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccc79ff700 1 -- 172.21.15.115:0/363047424 shutdown_connections 2023-07-27T14:32:16.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccc79ff700 1 --2- 172.21.15.115:0/363047424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc01542a0 0x7fccc015efc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccc79ff700 1 -- 172.21.15.115:0/363047424 >> 172.21.15.115:0/363047424 conn(0x7fccc00cb610 msgr2=0x7fccc00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:16.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccc79ff700 1 -- 172.21.15.115:0/363047424 shutdown_connections 2023-07-27T14:32:16.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.622+0000 7fccc79ff700 1 -- 172.21.15.115:0/363047424 wait complete. 2023-07-27T14:32:16.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.624+0000 7fccc79ff700 1 Processor -- start 2023-07-27T14:32:16.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.624+0000 7fccc79ff700 1 -- start start 2023-07-27T14:32:16.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc79ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc00aaa40 0x7fccc014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc79ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc0153ec0 0x7fccc00c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc79ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc01542a0 0x7fccc00c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc79ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc014fb50 con 0x7fccc01542a0 2023-07-27T14:32:16.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc79ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00adb40 con 0x7fccc0153ec0 2023-07-27T14:32:16.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc79ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c2130 con 0x7fccc00aaa40 2023-07-27T14:32:16.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc5f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc01542a0 0x7fccc00c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc5f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc01542a0 0x7fccc00c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33314/0 (socket says 172.21.15.115:33314) 2023-07-27T14:32:16.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc5f9c700 1 -- 172.21.15.115:0/2587980495 learned_addr learned my addr 172.21.15.115:0/2587980495 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:16.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc579b700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc00aaa40 0x7fccc014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.625+0000 7fccc4f9a700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc0153ec0 0x7fccc00c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc5f9c700 1 -- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc00aaa40 msgr2=0x7fccc014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc5f9c700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc00aaa40 0x7fccc014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc5f9c700 1 -- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc0153ec0 msgr2=0x7fccc00c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc5f9c700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc0153ec0 0x7fccc00c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc5f9c700 1 -- 172.21.15.115:0/2587980495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8009a20 con 0x7fccc01542a0 2023-07-27T14:32:16.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc4f9a700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc0153ec0 0x7fccc00c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:16.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc5f9c700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc01542a0 0x7fccc00c3f20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fccc0060760 tx=0x7fccb8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:16.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccb57fa700 1 -- 172.21.15.115:0/2587980495 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb801d650 con 0x7fccc01542a0 2023-07-27T14:32:16.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccb57fa700 1 -- 172.21.15.115:0/2587980495 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb801d7b0 con 0x7fccc01542a0 2023-07-27T14:32:16.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc00c2410 con 0x7fccc01542a0 2023-07-27T14:32:16.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccb57fa700 1 -- 172.21.15.115:0/2587980495 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb801db50 con 0x7fccc01542a0 2023-07-27T14:32:16.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.626+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc00ae0e0 con 0x7fccc01542a0 2023-07-27T14:32:16.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.627+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc00ae300 con 0x7fccc01542a0 2023-07-27T14:32:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.628+0000 7fccb57fa700 1 -- 172.21.15.115:0/2587980495 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fccb8027460 con 0x7fccc01542a0 2023-07-27T14:32:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.629+0000 7fccb57fa700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcca405f370 0x7fcca4061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.629+0000 7fccb57fa700 1 -- 172.21.15.115:0/2587980495 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fccb807c270 con 0x7fccc01542a0 2023-07-27T14:32:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.629+0000 7fccc579b700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcca405f370 0x7fcca4061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.630+0000 7fccc579b700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcca405f370 0x7fcca4061830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fccbc005b00 tx=0x7fccbc000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:16.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.633+0000 7fccb57fa700 1 -- 172.21.15.115:0/2587980495 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fccb804d700 con 0x7fccc01542a0 2023-07-27T14:32:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.842+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccc00bfc90 con 0x7fccc01542a0 2023-07-27T14:32:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.842+0000 7fccb57fa700 1 -- 172.21.15.115:0/2587980495 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3538 (secure 0 0 0) 0x7fccb8050d20 con 0x7fccc01542a0 2023-07-27T14:32:16.878 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:16.878 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/4214348897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":4214348897},{"type":"v1","addr":"172.21.15.115:6837","nonce":4214348897}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/445956953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":445956953},{"type":"v1","addr":"172.21.15.159:6834","nonce":445956953}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4278535768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":4278535768},{"type":"v1","addr":"172.21.15.159:6835","nonce":4278535768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6831,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/4055874844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":4055874844},{"type":"v1","addr":"172.21.15.115:6835","nonce":4055874844}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[]} 2023-07-27T14:32:16.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.844+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcca405f370 msgr2=0x7fcca4061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.844+0000 7fccc79ff700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcca405f370 0x7fcca4061830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fccbc005b00 tx=0x7fccbc000bc0).stop 2023-07-27T14:32:16.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.844+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc01542a0 msgr2=0x7fccc00c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:16.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.844+0000 7fccc79ff700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc01542a0 0x7fccc00c3f20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fccc0060760 tx=0x7fccb8009780).stop 2023-07-27T14:32:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.845+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 shutdown_connections 2023-07-27T14:32:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.845+0000 7fccc79ff700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcca405f370 0x7fcca4061830 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.845+0000 7fccc79ff700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc01542a0 0x7fccc00c3f20 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.845+0000 7fccc79ff700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fccc00aaa40 0x7fccc014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.845+0000 7fccc79ff700 1 --2- 172.21.15.115:0/2587980495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccc0153ec0 0x7fccc00c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.845+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 >> 172.21.15.115:0/2587980495 conn(0x7fccc00cb610 msgr2=0x7fccc0062ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:16.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.845+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 shutdown_connections 2023-07-27T14:32:16.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:16.845+0000 7fccc79ff700 1 -- 172.21.15.115:0/2587980495 wait complete. 2023-07-27T14:32:16.882 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 45 2023-07-27T14:32:16.898 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:32:16.898 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:32:16.898 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:32:16.899 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:32:16.899 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:32:16.899 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:32:16.899 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:32:16.899 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:32:16.900 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:32:16.900 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:32:16.900 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:32:16.900 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:32:16.901 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:32:16.901 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:32:16.901 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:32:16.901 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:32:16.911 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:32:16.911 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:32:16.912 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:32:16.913 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:32:16.916 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:32:16.916 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:32:16.917 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:32:16.917 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:32:16.956 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:32:16.957 DEBUG:teuthology.parallel:result is None 2023-07-27T14:32:16.960 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:32:16.960 DEBUG:teuthology.parallel:result is None 2023-07-27T14:32:16.961 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:32:16.962 DEBUG:teuthology.parallel:result is None 2023-07-27T14:32:16.965 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:32:16.965 DEBUG:teuthology.parallel:result is None 2023-07-27T14:32:16.966 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:32:17.099 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:32:17.100 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:32:17.110 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:32:17.110 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:32:17.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.137+0000 7fdfc7fff700 1 Processor -- start 2023-07-27T14:32:17.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.138+0000 7fdfc7fff700 1 -- start start 2023-07-27T14:32:17.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc0155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:17.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdfc0065ff0 0x7fdfc0066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:17.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc7fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc0067080 con 0x7fdfc0066960 2023-07-27T14:32:17.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc0063a90 con 0x7fdfc0065ff0 2023-07-27T14:32:17.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0068570 con 0x7fdfc0151d70 2023-07-27T14:32:17.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc559a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdfc0065ff0 0x7fdfc0066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:17.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc559a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdfc0065ff0 0x7fdfc0066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33346/0 (socket says 172.21.15.115:33346) 2023-07-27T14:32:17.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc559a700 1 -- 172.21.15.115:0/3532742625 learned_addr learned my addr 172.21.15.115:0/3532742625 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:17.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.139+0000 7fdfc5d9b700 1 --2- 172.21.15.115:0/3532742625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:17.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc559a700 1 -- 172.21.15.115:0/3532742625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 msgr2=0x7fdfc0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:17.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc559a700 1 --2- 172.21.15.115:0/3532742625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc0155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:17.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc559a700 1 -- 172.21.15.115:0/3532742625 >> v1:172.21.15.159:6789/0 conn(0x7fdfc0066960 legacy=0x7fdfc0157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:17.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc559a700 1 -- 172.21.15.115:0/3532742625 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0066e10 con 0x7fdfc0065ff0 2023-07-27T14:32:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc5d9b700 1 --2- 172.21.15.115:0/3532742625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc559a700 1 --2- 172.21.15.115:0/3532742625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc0066470 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fdfb0006fd0 tx=0x7fdfb00090f0).ready entity=mon.0 client_cookie=b418896a9d6bfe35 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc4d99700 1 -- 172.21.15.115:0/3532742625 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000b600 con 0x7fdfc0065ff0 2023-07-27T14:32:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc4d99700 1 -- 172.21.15.115:0/3532742625 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000b760 con 0x7fdfc0065ff0 2023-07-27T14:32:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc4d99700 1 -- 172.21.15.115:0/3532742625 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000bae0 con 0x7fdfc0065ff0 2023-07-27T14:32:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc7fff700 1 -- 172.21.15.115:0/3532742625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 msgr2=0x7fdfc0066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.140+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/3532742625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc0066470 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fdfb0006fd0 tx=0x7fdfb00090f0).stop 2023-07-27T14:32:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.141+0000 7fdfc7fff700 1 -- 172.21.15.115:0/3532742625 shutdown_connections 2023-07-27T14:32:17.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.141+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/3532742625 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:17.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.141+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/3532742625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc0066470 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:17.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.141+0000 7fdfc7fff700 1 -- 172.21.15.115:0/3532742625 >> 172.21.15.115:0/3532742625 conn(0x7fdfc00c89a0 msgr2=0x7fdfc00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:17.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.141+0000 7fdfc7fff700 1 -- 172.21.15.115:0/3532742625 shutdown_connections 2023-07-27T14:32:17.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.141+0000 7fdfc7fff700 1 -- 172.21.15.115:0/3532742625 wait complete. 2023-07-27T14:32:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.142+0000 7fdfc7fff700 1 Processor -- start 2023-07-27T14:32:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.142+0000 7fdfc7fff700 1 -- start start 2023-07-27T14:32:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc00a7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc0066960 0x7fdfc00c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00bff40 con 0x7fdfc0065ff0 2023-07-27T14:32:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00c0220 con 0x7fdfc0066960 2023-07-27T14:32:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00c0500 con 0x7fdfc0151d70 2023-07-27T14:32:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc00a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc00a7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33358/0 (socket says 172.21.15.115:33358) 2023-07-27T14:32:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.143+0000 7fdfc5d9b700 1 -- 172.21.15.115:0/656200771 learned_addr learned my addr 172.21.15.115:0/656200771 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc659c700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc559a700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc0066960 0x7fdfc00c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc5d9b700 1 -- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 msgr2=0x7fdfc00a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc5d9b700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc00a50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc5d9b700 1 -- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc0066960 msgr2=0x7fdfc00c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc5d9b700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc0066960 0x7fdfc00c1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc5d9b700 1 -- 172.21.15.115:0/656200771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009370 con 0x7fdfc0065ff0 2023-07-27T14:32:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc559a700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc0066960 0x7fdfc00c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc5d9b700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc00a7340 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fdfbc00d890 tx=0x7fdfbc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfb5ffb700 1 -- 172.21.15.115:0/656200771 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc011590 con 0x7fdfc0065ff0 2023-07-27T14:32:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfb5ffb700 1 -- 172.21.15.115:0/656200771 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0116f0 con 0x7fdfc0065ff0 2023-07-27T14:32:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc0167c90 con 0x7fdfc0065ff0 2023-07-27T14:32:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfb5ffb700 1 -- 172.21.15.115:0/656200771 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc011a70 con 0x7fdfc0065ff0 2023-07-27T14:32:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.144+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc00c1ff0 con 0x7fdfc0065ff0 2023-07-27T14:32:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.145+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc006c470 con 0x7fdfc0065ff0 2023-07-27T14:32:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.146+0000 7fdfb5ffb700 1 -- 172.21.15.115:0/656200771 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fdfbc01c460 con 0x7fdfc0065ff0 2023-07-27T14:32:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.147+0000 7fdfb5ffb700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfa405f370 0x7fdfa4061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.147+0000 7fdfb5ffb700 1 -- 172.21.15.115:0/656200771 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fdfbc079f80 con 0x7fdfc0065ff0 2023-07-27T14:32:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.147+0000 7fdfc559a700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfa405f370 0x7fdfa4061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.148+0000 7fdfc559a700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfa405f370 0x7fdfa4061830 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fdfb0006fd0 tx=0x7fdfb0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:17.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.151+0000 7fdfb5ffb700 1 -- 172.21.15.115:0/656200771 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdfbc04b300 con 0x7fdfc0065ff0 2023-07-27T14:32:17.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:17.334+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdfc014d4a0 con 0x7fdfc0065ff0 2023-07-27T14:32:18.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.123+0000 7fdfb5ffb700 1 -- 172.21.15.115:0/656200771 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdfbc04e920 con 0x7fdfc0065ff0 2023-07-27T14:32:18.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfa405f370 msgr2=0x7fdfa4061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfa405f370 0x7fdfa4061830 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fdfb0006fd0 tx=0x7fdfb0017000).stop 2023-07-27T14:32:18.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 msgr2=0x7fdfc00a7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc00a7340 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fdfbc00d890 tx=0x7fdfbc008040).stop 2023-07-27T14:32:18.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 shutdown_connections 2023-07-27T14:32:18.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdfa405f370 0x7fdfa4061830 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdfc0151d70 0x7fdfc00a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc0065ff0 0x7fdfc00a7340 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 --2- 172.21.15.115:0/656200771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfc0066960 0x7fdfc00c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 >> 172.21.15.115:0/656200771 conn(0x7fdfc00c89a0 msgr2=0x7fdfc00c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:18.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 shutdown_connections 2023-07-27T14:32:18.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.127+0000 7fdfc7fff700 1 -- 172.21.15.115:0/656200771 wait complete. 2023-07-27T14:32:18.165 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:32:18.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:32:18.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.341+0000 7fa2e2dff700 1 Processor -- start 2023-07-27T14:32:18.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.341+0000 7fa2e2dff700 1 -- start start 2023-07-27T14:32:18.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.341+0000 7fa2e2dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0aaa40 0x7fa2dc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.341+0000 7fa2e2dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0aa4d0 con 0x7fa2dc1542a0 2023-07-27T14:32:18.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.341+0000 7fa2e2dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0c05c0 con 0x7fa2dc153ec0 2023-07-27T14:32:18.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.341+0000 7fa2e2dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0aa270 con 0x7fa2dc0aaa40 2023-07-27T14:32:18.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2e139c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa2dc1542a0 0x7fa2dc0c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46172/0 (socket says 172.21.15.115:46172) 2023-07-27T14:32:18.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2e139c700 1 -- 172.21.15.115:0/4056459313 learned_addr learned my addr 172.21.15.115:0/4056459313 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:18.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2dbfff700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0aaa40 0x7fa2dc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886979465 0 0) 0x7fa2d4001490 con 0x7fa2dc1542a0 2023-07-27T14:32:18.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2cc0033f0 con 0x7fa2dc1542a0 2023-07-27T14:32:18.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256511157 0 0) 0x7fa2dc0c05c0 con 0x7fa2dc153ec0 2023-07-27T14:32:18.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d4001490 con 0x7fa2dc153ec0 2023-07-27T14:32:18.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710345002 0 0) 0x7fa2cc0033f0 con 0x7fa2dc1542a0 2023-07-27T14:32:18.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0aaa40 msgr2=0x7fa2dc0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:18.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0aaa40 0x7fa2dc0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 >> v1:172.21.15.159:6789/0 conn(0x7fa2dc153ec0 legacy=0x7fa2dc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0bfc90 con 0x7fa2dc1542a0 2023-07-27T14:32:18.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.342+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fa2d4001980 con 0x7fa2dc1542a0 2023-07-27T14:32:18.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 >> v1:172.21.15.115:6789/0 conn(0x7fa2dc1542a0 legacy=0x7fa2dc0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2db7fe700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc003aa0 0x7fa2cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2db7fe700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0aaa40 0x7fa2cc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2db7fe700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2cc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0aa270 con 0x7fa2cc004b80 2023-07-27T14:32:18.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc00b910 con 0x7fa2cc003aa0 2023-07-27T14:32:18.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc00bad0 con 0x7fa2dc0aaa40 2023-07-27T14:32:18.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2e139c700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2cc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2e0b9b700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc003aa0 0x7fa2cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2dbfff700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0aaa40 0x7fa2cc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2e139c700 1 -- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0aaa40 msgr2=0x7fa2cc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:18.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2e139c700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0aaa40 0x7fa2cc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2e139c700 1 -- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc003aa0 msgr2=0x7fa2cc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:18.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2e139c700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2cc003aa0 0x7fa2cc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2e139c700 1 -- 172.21.15.115:0/4056459313 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc0033f0 con 0x7fa2cc004b80 2023-07-27T14:32:18.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.343+0000 7fa2e139c700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2cc005000 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7fa2dc0c75e0 tx=0x7fa2d4007c00).ready entity=mon.0 client_cookie=767637fa3cd31fab server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:18.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4005b20 con 0x7fa2cc004b80 2023-07-27T14:32:18.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4005c80 con 0x7fa2cc004b80 2023-07-27T14:32:18.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2db7fe700 1 -- 172.21.15.115:0/4056459313 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40070d0 con 0x7fa2cc004b80 2023-07-27T14:32:18.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2e2dff700 1 -- 172.21.15.115:0/4056459313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 msgr2=0x7fa2cc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2e2dff700 1 --2- 172.21.15.115:0/4056459313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2cc005000 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7fa2dc0c75e0 tx=0x7fa2d4007c00).stop 2023-07-27T14:32:18.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2e139c700 1 -- 172.21.15.115:0/4056459313 reap_dead start 2023-07-27T14:32:18.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2e2dff700 1 -- 172.21.15.115:0/4056459313 shutdown_connections 2023-07-27T14:32:18.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2e2dff700 1 -- 172.21.15.115:0/4056459313 >> 172.21.15.115:0/4056459313 conn(0x7fa2dc0cb610 msgr2=0x7fa2dc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:18.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2e2dff700 1 -- 172.21.15.115:0/4056459313 shutdown_connections 2023-07-27T14:32:18.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.344+0000 7fa2e2dff700 1 -- 172.21.15.115:0/4056459313 wait complete. 2023-07-27T14:32:18.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.346+0000 7fa2e2dff700 1 Processor -- start 2023-07-27T14:32:18.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.346+0000 7fa2e2dff700 1 -- start start 2023-07-27T14:32:18.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e2dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2dc150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e2dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0ae510 0x7fa2dc0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e2dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2dc0c8810 0x7fa2dc0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e2dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1513a0 con 0x7fa2cc004b80 2023-07-27T14:32:18.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e2dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0c9160 con 0x7fa2dc0c8810 2023-07-27T14:32:18.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e2dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc150720 con 0x7fa2dc0ae510 2023-07-27T14:32:18.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e0b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2dc150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e0b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2dc150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33382/0 (socket says 172.21.15.115:33382) 2023-07-27T14:32:18.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2e0b9b700 1 -- 172.21.15.115:0/2465282985 learned_addr learned my addr 172.21.15.115:0/2465282985 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:18.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.347+0000 7fa2dbfff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0ae510 0x7fa2dc0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e139c700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2dc0c8810 0x7fa2dc0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e0b9b700 1 -- 172.21.15.115:0/2465282985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0ae510 msgr2=0x7fa2dc0c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e0b9b700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0ae510 0x7fa2dc0c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e0b9b700 1 -- 172.21.15.115:0/2465282985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2dc0c8810 msgr2=0x7fa2dc0c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e0b9b700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2dc0c8810 0x7fa2dc0c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e0b9b700 1 -- 172.21.15.115:0/2465282985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc150a00 con 0x7fa2cc004b80 2023-07-27T14:32:18.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e0b9b700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2dc150180 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7fa2d00010e0 tx=0x7fa2d0007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:18.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2d8ff9700 1 -- 172.21.15.115:0/2465282985 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000f8d0 con 0x7fa2cc004b80 2023-07-27T14:32:18.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2d8ff9700 1 -- 172.21.15.115:0/2465282985 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000fa30 con 0x7fa2cc004b80 2023-07-27T14:32:18.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc150ce0 con 0x7fa2cc004b80 2023-07-27T14:32:18.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2d8ff9700 1 -- 172.21.15.115:0/2465282985 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000fdb0 con 0x7fa2cc004b80 2023-07-27T14:32:18.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.348+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc0ae990 con 0x7fa2cc004b80 2023-07-27T14:32:18.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.349+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc151610 con 0x7fa2cc004b80 2023-07-27T14:32:18.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.350+0000 7fa2d8ff9700 1 -- 172.21.15.115:0/2465282985 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fa2d001b030 con 0x7fa2cc004b80 2023-07-27T14:32:18.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.351+0000 7fa2d8ff9700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2c005f370 0x7fa2c0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.351+0000 7fa2d8ff9700 1 -- 172.21.15.115:0/2465282985 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa2d0079ea0 con 0x7fa2cc004b80 2023-07-27T14:32:18.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.351+0000 7fa2dbfff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2c005f370 0x7fa2c0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.352+0000 7fa2dbfff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2c005f370 0x7fa2c0061830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fa2dc0b0d10 tx=0x7fa2c8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:18.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.355+0000 7fa2d8ff9700 1 -- 172.21.15.115:0/2465282985 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2d004a8f0 con 0x7fa2cc004b80 2023-07-27T14:32:18.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.601+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa2dc06c470 con 0x7fa2cc004b80 2023-07-27T14:32:18.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.601+0000 7fa2d8ff9700 1 -- 172.21.15.115:0/2465282985 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa2d004b260 con 0x7fa2cc004b80 2023-07-27T14:32:18.637 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:18.637 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:18.637 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:32:18.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.638 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:32:18.638 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:32:18.638 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.638 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:32:18.638 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:32:18.639 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:32:18.639 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.639 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.639 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:32:18.639 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:32:18.640 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.640 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:32:18.640 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:32:18.640 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:32:18.640 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.640 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.641 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:32:18.641 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:32:18.641 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.641 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:32:18.641 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:32:18.641 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:32:18.642 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.642 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.642 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:32:18.642 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:32:18.642 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.643 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:32:18.643 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:32:18.643 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:32:18.643 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.643 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.644 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:32:18.644 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:32:18.644 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.644 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:32:18.644 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:32:18.644 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.645 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.645 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:32:18.645 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:32:18.645 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.645 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:32:18.645 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:32:18.646 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.646 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:32:18.646 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:32:18.647 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.647 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:32:18.647 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:32:18.647 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.647 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:32:18.648 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:32:18.648 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.648 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:32:18.648 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:32:18.648 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.648 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.649 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:32:18.649 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:32:18.649 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.649 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:32:18.649 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:32:18.650 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.650 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.650 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:32:18.650 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:32:18.650 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.650 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:32:18.651 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:32:18.651 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.651 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.651 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:32:18.651 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:32:18.652 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.652 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:32:18.652 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:32:18.652 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.653 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:32:18.654 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:32:18.654 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.654 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:32:18.654 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:32:18.655 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.655 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.656 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:32:18.656 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:32:18.657 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.657 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:32:18.657 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:32:18.657 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:32:18.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.658 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:32:18.658 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:32:18.659 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.659 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:32:18.659 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:32:18.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:32:18.660 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:32:18.660 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.661 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:32:18.661 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:32:18.661 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.661 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:32:18.661 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:32:18.661 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:32:18.661 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:32:18.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:32:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:32:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:32:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:32:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:32:18.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:32:18.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.663 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:32:18.663 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:32:18.663 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.664 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:32:18.664 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:32:18.664 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:32:18.664 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.665 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:32:18.665 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:32:18.665 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.665 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:32:18.665 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:32:18.665 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.665 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:18.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:18.666 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:32:18.666 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:32:18.666 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:32:18.666 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:32:18.667 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:32:18.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:32:18.667 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.667 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:18.667 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:32:18.667 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:18.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2c005f370 msgr2=0x7fa2c0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2c005f370 0x7fa2c0061830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fa2dc0b0d10 tx=0x7fa2c8008040).stop 2023-07-27T14:32:18.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 msgr2=0x7fa2dc150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2dc150180 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7fa2d00010e0 tx=0x7fa2d0007bb0).stop 2023-07-27T14:32:18.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 shutdown_connections 2023-07-27T14:32:18.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2c005f370 0x7fa2c0061830 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2dc0c8810 0x7fa2dc0c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2cc004b80 0x7fa2dc150180 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 --2- 172.21.15.115:0/2465282985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2dc0ae510 0x7fa2dc0c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 >> 172.21.15.115:0/2465282985 conn(0x7fa2dc0cb610 msgr2=0x7fa2dc154730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:18.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.604+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 shutdown_connections 2023-07-27T14:32:18.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.605+0000 7fa2e2dff700 1 -- 172.21.15.115:0/2465282985 wait complete. 2023-07-27T14:32:18.671 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:18.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.823+0000 7fd8a27ff700 1 Processor -- start 2023-07-27T14:32:18.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.824+0000 7fd8a27ff700 1 -- start start 2023-07-27T14:32:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.825+0000 7fd8a27ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd89c1542a0 0x7fd89c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.825+0000 7fd8a27ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0aa4d0 con 0x7fd89c0aaa40 2023-07-27T14:32:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.825+0000 7fd8a27ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0c05c0 con 0x7fd89c153ec0 2023-07-27T14:32:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.825+0000 7fd8a27ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c0c1a60 con 0x7fd89c1542a0 2023-07-27T14:32:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.825+0000 7fd89b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd89c0aaa40 0x7fd89c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46188/0 (socket says 172.21.15.115:46188) 2023-07-27T14:32:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.825+0000 7fd89b7fe700 1 -- 172.21.15.115:0/4158139545 learned_addr learned my addr 172.21.15.115:0/4158139545 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.825+0000 7fd8a0d9c700 1 --2- 172.21.15.115:0/4158139545 >> v2:172.21.15.115:3300/0 conn(0x7fd89c1542a0 0x7fd89c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd89affd700 1 -- 172.21.15.115:0/4158139545 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211670429 0 0) 0x7fd890001110 con 0x7fd89c0aaa40 2023-07-27T14:32:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd89affd700 1 -- 172.21.15.115:0/4158139545 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8840033f0 con 0x7fd89c0aaa40 2023-07-27T14:32:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd8a0d9c700 1 -- 172.21.15.115:0/4158139545 >> v1:172.21.15.159:6789/0 conn(0x7fd89c153ec0 legacy=0x7fd89c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd8a0d9c700 1 -- 172.21.15.115:0/4158139545 >> v1:172.21.15.115:6789/0 conn(0x7fd89c0aaa40 legacy=0x7fd89c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd8a0d9c700 1 -- 172.21.15.115:0/4158139545 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0aa270 con 0x7fd89c1542a0 2023-07-27T14:32:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd8a0d9c700 1 --2- 172.21.15.115:0/4158139545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c1542a0 0x7fd89c15efc0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fd894009e60 tx=0x7fd894009780).ready entity=mon.0 client_cookie=20e9ec31b77c3fde server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd89affd700 1 -- 172.21.15.115:0/4158139545 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400e070 con 0x7fd89c1542a0 2023-07-27T14:32:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd89affd700 1 -- 172.21.15.115:0/4158139545 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400bb60 con 0x7fd89c1542a0 2023-07-27T14:32:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.826+0000 7fd89affd700 1 -- 172.21.15.115:0/4158139545 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894012410 con 0x7fd89c1542a0 2023-07-27T14:32:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.827+0000 7fd8a27ff700 1 -- 172.21.15.115:0/4158139545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c1542a0 msgr2=0x7fd89c15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.827+0000 7fd8a27ff700 1 --2- 172.21.15.115:0/4158139545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c1542a0 0x7fd89c15efc0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fd894009e60 tx=0x7fd894009780).stop 2023-07-27T14:32:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.827+0000 7fd8a27ff700 1 -- 172.21.15.115:0/4158139545 shutdown_connections 2023-07-27T14:32:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.827+0000 7fd8a27ff700 1 --2- 172.21.15.115:0/4158139545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c1542a0 0x7fd89c15efc0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.827+0000 7fd8a27ff700 1 -- 172.21.15.115:0/4158139545 >> 172.21.15.115:0/4158139545 conn(0x7fd89c0cb610 msgr2=0x7fd89c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:18.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.827+0000 7fd8a27ff700 1 -- 172.21.15.115:0/4158139545 shutdown_connections 2023-07-27T14:32:18.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.827+0000 7fd8a27ff700 1 -- 172.21.15.115:0/4158139545 wait complete. 2023-07-27T14:32:18.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.828+0000 7fd8a27ff700 1 Processor -- start 2023-07-27T14:32:18.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.829+0000 7fd8a27ff700 1 -- start start 2023-07-27T14:32:18.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.829+0000 7fd8a27ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c0aaa40 0x7fd89c0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.829+0000 7fd8a27ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c153ec0 0x7fd89c0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd8a27ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c1542a0 0x7fd89c0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd8a27ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0c2610 con 0x7fd89c153ec0 2023-07-27T14:32:18.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd8a27ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0ae5e0 con 0x7fd89c1542a0 2023-07-27T14:32:18.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd8a27ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0ae8c0 con 0x7fd89c0aaa40 2023-07-27T14:32:18.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c153ec0 0x7fd89c0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c153ec0 0x7fd89c0c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33408/0 (socket says 172.21.15.115:33408) 2023-07-27T14:32:18.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 -- 172.21.15.115:0/2930924125 learned_addr learned my addr 172.21.15.115:0/2930924125 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:18.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd8a0d9c700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c1542a0 0x7fd89c0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89bfff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c0aaa40 0x7fd89c0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 -- 172.21.15.115:0/2930924125 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c0aaa40 msgr2=0x7fd89c0ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c0aaa40 0x7fd89c0ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 -- 172.21.15.115:0/2930924125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c1542a0 msgr2=0x7fd89c0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:18.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c1542a0 0x7fd89c0c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:18.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 -- 172.21.15.115:0/2930924125 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894009a20 con 0x7fd89c153ec0 2023-07-27T14:32:18.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.830+0000 7fd89b7fe700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c153ec0 0x7fd89c0c1c30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fd89000c470 tx=0x7fd890007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:18.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.831+0000 7fd883fff700 1 -- 172.21.15.115:0/2930924125 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900072e0 con 0x7fd89c153ec0 2023-07-27T14:32:18.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.831+0000 7fd883fff700 1 -- 172.21.15.115:0/2930924125 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890007440 con 0x7fd89c153ec0 2023-07-27T14:32:18.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.831+0000 7fd883fff700 1 -- 172.21.15.115:0/2930924125 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900057a0 con 0x7fd89c153ec0 2023-07-27T14:32:18.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.831+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c0aeba0 con 0x7fd89c153ec0 2023-07-27T14:32:18.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.831+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c0af160 con 0x7fd89c153ec0 2023-07-27T14:32:18.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.832+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c0af320 con 0x7fd89c153ec0 2023-07-27T14:32:18.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.833+0000 7fd883fff700 1 -- 172.21.15.115:0/2930924125 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fd890010070 con 0x7fd89c153ec0 2023-07-27T14:32:18.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.833+0000 7fd883fff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88805f370 0x7fd888061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:18.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.834+0000 7fd883fff700 1 -- 172.21.15.115:0/2930924125 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd890079600 con 0x7fd89c153ec0 2023-07-27T14:32:18.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.834+0000 7fd89bfff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88805f370 0x7fd888061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:18.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.834+0000 7fd89bfff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88805f370 0x7fd888061830 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fd88c003750 tx=0x7fd88c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:18.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:18.838+0000 7fd883fff700 1 -- 172.21.15.115:0/2930924125 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd89004a910 con 0x7fd89c153ec0 2023-07-27T14:32:19.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.009+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd89c0af4d0 con 0x7fd89c153ec0 2023-07-27T14:32:19.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.010+0000 7fd883fff700 1 -- 172.21.15.115:0/2930924125 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+13857 (secure 0 0 0) 0x7fd89004df30 con 0x7fd89c153ec0 2023-07-27T14:32:19.045 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:19.045 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":96,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:18.118089+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:19.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88805f370 msgr2=0x7fd888061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88805f370 0x7fd888061830 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fd88c003750 tx=0x7fd88c009040).stop 2023-07-27T14:32:19.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c153ec0 msgr2=0x7fd89c0c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c153ec0 0x7fd89c0c1c30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fd89000c470 tx=0x7fd890007ad0).stop 2023-07-27T14:32:19.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 shutdown_connections 2023-07-27T14:32:19.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd88805f370 0x7fd888061830 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd89c1542a0 0x7fd89c0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd89c0aaa40 0x7fd89c0ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 --2- 172.21.15.115:0/2930924125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c153ec0 0x7fd89c0c1c30 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 >> 172.21.15.115:0/2930924125 conn(0x7fd89c0cb610 msgr2=0x7fd89c155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:19.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 shutdown_connections 2023-07-27T14:32:19.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.012+0000 7fd8a27ff700 1 -- 172.21.15.115:0/2930924125 wait complete. 2023-07-27T14:32:19.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:32:19.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:32:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.221+0000 7f1e9efff700 1 Processor -- start 2023-07-27T14:32:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.221+0000 7f1e9efff700 1 -- start start 2023-07-27T14:32:19.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.222+0000 7f1e9efff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1e980c0610 0x7f1e980c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.222+0000 7f1e9efff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980c60a0 con 0x7f1e98153f30 2023-07-27T14:32:19.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.222+0000 7f1e9efff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980c0f90 con 0x7f1e980bfb50 2023-07-27T14:32:19.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.222+0000 7f1e9efff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e980c5d70 con 0x7f1e980c0610 2023-07-27T14:32:19.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e9cd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1e98153f30 0x7f1e980a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46202/0 (socket says 172.21.15.115:46202) 2023-07-27T14:32:19.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e9cd9b700 1 -- 172.21.15.115:0/3896481589 learned_addr learned my addr 172.21.15.115:0/3896481589 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:19.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e9d59c700 1 --2- 172.21.15.115:0/3896481589 >> v2:172.21.15.159:3300/0 conn(0x7f1e980c0610 0x7f1e980c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e977fe700 1 -- 172.21.15.115:0/3896481589 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633797863 0 0) 0x7f1e980c60a0 con 0x7f1e98153f30 2023-07-27T14:32:19.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e977fe700 1 -- 172.21.15.115:0/3896481589 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e880033f0 con 0x7f1e98153f30 2023-07-27T14:32:19.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e9d59c700 1 -- 172.21.15.115:0/3896481589 >> v1:172.21.15.159:6789/0 conn(0x7f1e980bfb50 legacy=0x7f1e980c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e9d59c700 1 -- 172.21.15.115:0/3896481589 >> v1:172.21.15.115:6789/0 conn(0x7f1e98153f30 legacy=0x7f1e980a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e977fe700 1 -- 172.21.15.115:0/3896481589 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429662197 0 0) 0x7f1e880033f0 con 0x7f1e98153f30 2023-07-27T14:32:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.223+0000 7f1e9d59c700 1 -- 172.21.15.115:0/3896481589 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980c7d80 con 0x7f1e980c0610 2023-07-27T14:32:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e9d59c700 1 --2- 172.21.15.115:0/3896481589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e980c0610 0x7f1e980c0aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f1e90009e60 tx=0x7f1e90009780).ready entity=mon.1 client_cookie=288fb2b841fe7e17 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e977fe700 1 -- 172.21.15.115:0/3896481589 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9000e070 con 0x7f1e980c0610 2023-07-27T14:32:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e977fe700 1 -- 172.21.15.115:0/3896481589 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9000b850 con 0x7f1e980c0610 2023-07-27T14:32:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e977fe700 1 -- 172.21.15.115:0/3896481589 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c001470 con 0x7f1e980c0610 2023-07-27T14:32:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e9efff700 1 -- 172.21.15.115:0/3896481589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e980c0610 msgr2=0x7f1e980c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e9efff700 1 --2- 172.21.15.115:0/3896481589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e980c0610 0x7f1e980c0aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f1e90009e60 tx=0x7f1e90009780).stop 2023-07-27T14:32:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e9efff700 1 -- 172.21.15.115:0/3896481589 shutdown_connections 2023-07-27T14:32:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e9efff700 1 --2- 172.21.15.115:0/3896481589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e980c0610 0x7f1e980c0aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.224+0000 7f1e9efff700 1 -- 172.21.15.115:0/3896481589 >> 172.21.15.115:0/3896481589 conn(0x7f1e98094280 msgr2=0x7f1e9805e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.225+0000 7f1e9efff700 1 -- 172.21.15.115:0/3896481589 shutdown_connections 2023-07-27T14:32:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.225+0000 7f1e9efff700 1 -- 172.21.15.115:0/3896481589 wait complete. 2023-07-27T14:32:19.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.226+0000 7f1e9efff700 1 Processor -- start 2023-07-27T14:32:19.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.226+0000 7f1e9efff700 1 -- start start 2023-07-27T14:32:19.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9efff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e980bfb50 0x7f1e980c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e980c0610 0x7f1e980ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9efff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e98153f30 0x7f1e980ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9efff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980acdd0 con 0x7f1e980bfb50 2023-07-27T14:32:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9efff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980c3170 con 0x7f1e98153f30 2023-07-27T14:32:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980c2840 con 0x7f1e980c0610 2023-07-27T14:32:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9cd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e980bfb50 0x7f1e980c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9cd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e980bfb50 0x7f1e980c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33418/0 (socket says 172.21.15.115:33418) 2023-07-27T14:32:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.227+0000 7f1e9cd9b700 1 -- 172.21.15.115:0/3300191611 learned_addr learned my addr 172.21.15.115:0/3300191611 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9d59c700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e98153f30 0x7f1e980ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e97fff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e980c0610 0x7f1e980ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9cd9b700 1 -- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e980c0610 msgr2=0x7f1e980ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9cd9b700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e980c0610 0x7f1e980ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9cd9b700 1 -- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e98153f30 msgr2=0x7f1e980ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9cd9b700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e98153f30 0x7f1e980ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9cd9b700 1 -- 172.21.15.115:0/3300191611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009a20 con 0x7f1e980bfb50 2023-07-27T14:32:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9d59c700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e98153f30 0x7f1e980ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e97fff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e980c0610 0x7f1e980ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9cd9b700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e980bfb50 0x7f1e980c4120 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f1e8c00c7e0 tx=0x7f1e8c001a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e94ff9700 1 -- 172.21.15.115:0/3300191611 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c007170 con 0x7f1e980bfb50 2023-07-27T14:32:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e94ff9700 1 -- 172.21.15.115:0/3300191611 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c0072d0 con 0x7f1e980bfb50 2023-07-27T14:32:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e980c2b20 con 0x7f1e980bfb50 2023-07-27T14:32:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e94ff9700 1 -- 172.21.15.115:0/3300191611 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0048c0 con 0x7f1e980bfb50 2023-07-27T14:32:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.228+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e980c3600 con 0x7f1e980bfb50 2023-07-27T14:32:19.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.229+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9806c470 con 0x7f1e980bfb50 2023-07-27T14:32:19.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.230+0000 7f1e94ff9700 1 -- 172.21.15.115:0/3300191611 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f1e8c01b060 con 0x7f1e980bfb50 2023-07-27T14:32:19.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.232+0000 7f1e94ff9700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e7c05f370 0x7f1e7c061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.232+0000 7f1e94ff9700 1 -- 172.21.15.115:0/3300191611 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1e8c079de0 con 0x7f1e980bfb50 2023-07-27T14:32:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.232+0000 7f1e97fff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e7c05f370 0x7f1e7c061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.232+0000 7f1e97fff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e7c05f370 0x7f1e7c061830 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f1e980ae650 tx=0x7f1e84009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.235+0000 7f1e94ff9700 1 -- 172.21.15.115:0/3300191611 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e8c04afe0 con 0x7f1e980bfb50 2023-07-27T14:32:19.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.406+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1e980c3450 con 0x7f1e980bfb50 2023-07-27T14:32:19.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.406+0000 7f1e94ff9700 1 -- 172.21.15.115:0/3300191611 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v96) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1e8c019070 con 0x7f1e980bfb50 2023-07-27T14:32:19.441 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:32:19.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e7c05f370 msgr2=0x7f1e7c061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e7c05f370 0x7f1e7c061830 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f1e980ae650 tx=0x7f1e84009040).stop 2023-07-27T14:32:19.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e980bfb50 msgr2=0x7f1e980c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e980bfb50 0x7f1e980c4120 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f1e8c00c7e0 tx=0x7f1e8c001a60).stop 2023-07-27T14:32:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 shutdown_connections 2023-07-27T14:32:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1e7c05f370 0x7f1e7c061830 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e98153f30 0x7f1e980ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e980bfb50 0x7f1e980c4120 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 --2- 172.21.15.115:0/3300191611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e980c0610 0x7f1e980ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.408+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 >> 172.21.15.115:0/3300191611 conn(0x7f1e98094280 msgr2=0x7f1e980c6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:19.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.409+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 shutdown_connections 2023-07-27T14:32:19.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.409+0000 7f1e9efff700 1 -- 172.21.15.115:0/3300191611 wait complete. 2023-07-27T14:32:19.460 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:32:19.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.616+0000 7f3cf3bff700 1 Processor -- start 2023-07-27T14:32:19.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.616+0000 7f3cf3bff700 1 -- start start 2023-07-27T14:32:19.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf3bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3cec063260 0x7f3cec154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf3bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf3bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec1553f0 con 0x7f3cec14ae00 2023-07-27T14:32:19.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf3bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec157a50 con 0x7f3cec063260 2023-07-27T14:32:19.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf3bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec157d10 con 0x7f3cec14b1e0 2023-07-27T14:32:19.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf199b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3cec14ae00 0x7f3cec062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46208/0 (socket says 172.21.15.115:46208) 2023-07-27T14:32:19.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf199b700 1 -- 172.21.15.115:0/2634197793 learned_addr learned my addr 172.21.15.115:0/2634197793 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:19.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf119a700 1 --2- 172.21.15.115:0/2634197793 >> v2:172.21.15.115:3300/0 conn(0x7f3cec063260 0x7f3cec154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf219c700 1 --2- 172.21.15.115:0/2634197793 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf0999700 1 -- 172.21.15.115:0/2634197793 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479343565 0 0) 0x7f3cec1553f0 con 0x7f3cec14ae00 2023-07-27T14:32:19.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf0999700 1 -- 172.21.15.115:0/2634197793 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd80033f0 con 0x7f3cec14ae00 2023-07-27T14:32:19.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf119a700 1 -- 172.21.15.115:0/2634197793 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 msgr2=0x7f3cec0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:19.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf119a700 1 --2- 172.21.15.115:0/2634197793 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.618+0000 7f3cf119a700 1 -- 172.21.15.115:0/2634197793 >> v1:172.21.15.115:6789/0 conn(0x7f3cec14ae00 legacy=0x7f3cec062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.619+0000 7f3cf119a700 1 -- 172.21.15.115:0/2634197793 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec157ff0 con 0x7f3cec063260 2023-07-27T14:32:19.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.619+0000 7f3cf119a700 1 --2- 172.21.15.115:0/2634197793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec154f00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f3cdc009760 tx=0x7f3cdc009060).ready entity=mon.0 client_cookie=7e8051703ac5e606 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:19.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.619+0000 7f3cf0999700 1 -- 172.21.15.115:0/2634197793 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00d4a0 con 0x7f3cec063260 2023-07-27T14:32:19.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.619+0000 7f3cf0999700 1 -- 172.21.15.115:0/2634197793 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00d600 con 0x7f3cec063260 2023-07-27T14:32:19.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.619+0000 7f3cf0999700 1 -- 172.21.15.115:0/2634197793 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00d980 con 0x7f3cec063260 2023-07-27T14:32:19.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.619+0000 7f3cf3bff700 1 -- 172.21.15.115:0/2634197793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 msgr2=0x7f3cec154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.619+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/2634197793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec154f00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f3cdc009760 tx=0x7f3cdc009060).stop 2023-07-27T14:32:19.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.620+0000 7f3cf3bff700 1 -- 172.21.15.115:0/2634197793 shutdown_connections 2023-07-27T14:32:19.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.620+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/2634197793 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.620+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/2634197793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec154f00 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.620+0000 7f3cf3bff700 1 -- 172.21.15.115:0/2634197793 >> 172.21.15.115:0/2634197793 conn(0x7f3cec05e940 msgr2=0x7f3cec0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:19.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.620+0000 7f3cf3bff700 1 -- 172.21.15.115:0/2634197793 shutdown_connections 2023-07-27T14:32:19.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.620+0000 7f3cf3bff700 1 -- 172.21.15.115:0/2634197793 wait complete. 2023-07-27T14:32:19.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.622+0000 7f3cf3bff700 1 Processor -- start 2023-07-27T14:32:19.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.622+0000 7f3cf3bff700 1 -- start start 2023-07-27T14:32:19.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.623+0000 7f3cf3bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.623+0000 7f3cf3bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec14ae00 0x7f3cec1674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.623+0000 7f3cf3bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec1679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.623+0000 7f3cf3bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec155480 con 0x7f3cec063260 2023-07-27T14:32:19.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.623+0000 7f3cf3bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec154ec0 con 0x7f3cec14ae00 2023-07-27T14:32:19.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.623+0000 7f3cf3bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec1551a0 con 0x7f3cec14b1e0 2023-07-27T14:32:19.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.623+0000 7f3cf199b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.623+0000 7f3cf199b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec0c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33440/0 (socket says 172.21.15.115:33440) 2023-07-27T14:32:19.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf199b700 1 -- 172.21.15.115:0/3374939165 learned_addr learned my addr 172.21.15.115:0/3374939165 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:19.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf119a700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec14ae00 0x7f3cec1674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf219c700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec1679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf199b700 1 -- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 msgr2=0x7f3cec1679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf199b700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec1679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf199b700 1 -- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec14ae00 msgr2=0x7f3cec1674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf199b700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec14ae00 0x7f3cec1674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf199b700 1 -- 172.21.15.115:0/3374939165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0092a0 con 0x7f3cec063260 2023-07-27T14:32:19.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf219c700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec1679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:19.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf119a700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec14ae00 0x7f3cec1674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:19.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf199b700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec0c8b80 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f3ce8001ed0 tx=0x7f3ce8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:19.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3ce1ffb700 1 -- 172.21.15.115:0/3374939165 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80072e0 con 0x7f3cec063260 2023-07-27T14:32:19.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3ce1ffb700 1 -- 172.21.15.115:0/3374939165 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8007440 con 0x7f3cec063260 2023-07-27T14:32:19.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3ce1ffb700 1 -- 172.21.15.115:0/3374939165 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80057a0 con 0x7f3cec063260 2023-07-27T14:32:19.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec0c1d80 con 0x7f3cec063260 2023-07-27T14:32:19.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.624+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec154600 con 0x7f3cec063260 2023-07-27T14:32:19.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.626+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec06c470 con 0x7f3cec063260 2023-07-27T14:32:19.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.626+0000 7f3ce1ffb700 1 -- 172.21.15.115:0/3374939165 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f3ce8010070 con 0x7f3cec063260 2023-07-27T14:32:19.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.627+0000 7f3ce1ffb700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cd005f370 0x7f3cd0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:19.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.627+0000 7f3ce1ffb700 1 -- 172.21.15.115:0/3374939165 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3ce80796f0 con 0x7f3cec063260 2023-07-27T14:32:19.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.627+0000 7f3cf119a700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cd005f370 0x7f3cd0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:19.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.628+0000 7f3cf119a700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cd005f370 0x7f3cd0061830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f3cec063660 tx=0x7f3cdc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:19.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.631+0000 7f3ce1ffb700 1 -- 172.21.15.115:0/3374939165 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ce804aab0 con 0x7f3cec063260 2023-07-27T14:32:19.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.800+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3cec0c5160 con 0x7f3cec063260 2023-07-27T14:32:19.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.801+0000 7f3ce1ffb700 1 -- 172.21.15.115:0/3374939165 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3ce8007d00 con 0x7f3cec063260 2023-07-27T14:32:19.836 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:32:19.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cd005f370 msgr2=0x7f3cd0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cd005f370 0x7f3cd0061830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f3cec063660 tx=0x7f3cdc016000).stop 2023-07-27T14:32:19.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 msgr2=0x7f3cec0c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:19.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec0c8b80 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f3ce8001ed0 tx=0x7f3ce8007c70).stop 2023-07-27T14:32:19.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 shutdown_connections 2023-07-27T14:32:19.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3cd005f370 0x7f3cd0061830 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3cec14b1e0 0x7f3cec1679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cec063260 0x7f3cec0c8b80 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 --2- 172.21.15.115:0/3374939165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec14ae00 0x7f3cec1674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:19.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 >> 172.21.15.115:0/3374939165 conn(0x7f3cec05e940 msgr2=0x7f3cec0ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:19.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 shutdown_connections 2023-07-27T14:32:19.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:19.803+0000 7f3cf3bff700 1 -- 172.21.15.115:0/3374939165 wait complete. 2023-07-27T14:32:19.856 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:32:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.009+0000 7efea91ff700 1 Processor -- start 2023-07-27T14:32:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.009+0000 7efea91ff700 1 -- start start 2023-07-27T14:32:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.010+0000 7efea91ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efea4153ec0 0x7efea40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.010+0000 7efea91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 0x7efea40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.010+0000 7efea91ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea40aa4d0 con 0x7efea40aa050 2023-07-27T14:32:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.010+0000 7efea91ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea40c05c0 con 0x7efea4153ec0 2023-07-27T14:32:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.010+0000 7efea91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea40bfc90 con 0x7efea40aaa40 2023-07-27T14:32:20.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.010+0000 7efea259c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efea40aa050 0x7efea40640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46214/0 (socket says 172.21.15.115:46214) 2023-07-27T14:32:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.010+0000 7efea2d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efea4153ec0 0x7efea40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.010+0000 7efea259c700 1 -- 172.21.15.115:0/1434028929 learned_addr learned my addr 172.21.15.115:0/1434028929 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea359e700 1 --2- 172.21.15.115:0/1434028929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 0x7efea40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea2d9d700 1 -- 172.21.15.115:0/1434028929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 msgr2=0x7efea40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea2d9d700 1 --2- 172.21.15.115:0/1434028929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 0x7efea40c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea2d9d700 1 -- 172.21.15.115:0/1434028929 >> v1:172.21.15.115:6789/0 conn(0x7efea40aa050 legacy=0x7efea40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea2d9d700 1 -- 172.21.15.115:0/1434028929 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40bff70 con 0x7efea4153ec0 2023-07-27T14:32:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea1d9b700 1 -- 172.21.15.115:0/1434028929 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436254167 0 0) 0x7efe98001110 con 0x7efea40aa050 2023-07-27T14:32:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea2d9d700 1 --2- 172.21.15.115:0/1434028929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea4153ec0 0x7efea40a9b60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7efe94009760 tx=0x7efe94009060).ready entity=mon.0 client_cookie=b32f8a641f91f1e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea1d9b700 1 -- 172.21.15.115:0/1434028929 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400b580 con 0x7efea4153ec0 2023-07-27T14:32:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea1d9b700 1 -- 172.21.15.115:0/1434028929 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400b6e0 con 0x7efea4153ec0 2023-07-27T14:32:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.011+0000 7efea1d9b700 1 -- 172.21.15.115:0/1434028929 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400ba60 con 0x7efea4153ec0 2023-07-27T14:32:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.012+0000 7efea91ff700 1 -- 172.21.15.115:0/1434028929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea4153ec0 msgr2=0x7efea40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.012+0000 7efea91ff700 1 --2- 172.21.15.115:0/1434028929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea4153ec0 0x7efea40a9b60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7efe94009760 tx=0x7efe94009060).stop 2023-07-27T14:32:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.012+0000 7efea91ff700 1 -- 172.21.15.115:0/1434028929 shutdown_connections 2023-07-27T14:32:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.012+0000 7efea91ff700 1 --2- 172.21.15.115:0/1434028929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 0x7efea40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.012+0000 7efea91ff700 1 --2- 172.21.15.115:0/1434028929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea4153ec0 0x7efea40a9b60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.012+0000 7efea91ff700 1 -- 172.21.15.115:0/1434028929 >> 172.21.15.115:0/1434028929 conn(0x7efea40cb610 msgr2=0x7efea40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.012+0000 7efea91ff700 1 -- 172.21.15.115:0/1434028929 shutdown_connections 2023-07-27T14:32:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.012+0000 7efea91ff700 1 -- 172.21.15.115:0/1434028929 wait complete. 2023-07-27T14:32:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.014+0000 7efea91ff700 1 Processor -- start 2023-07-27T14:32:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.014+0000 7efea91ff700 1 -- start start 2023-07-27T14:32:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea91ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40aa050 0x7efea40c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 0x7efea4151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea91ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea4153ec0 0x7efea40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea91ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea4151e50 con 0x7efea40aa050 2023-07-27T14:32:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea91ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea4151680 con 0x7efea4153ec0 2023-07-27T14:32:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea40c39a0 con 0x7efea40aaa40 2023-07-27T14:32:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40aa050 0x7efea40c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40aa050 0x7efea40c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33450/0 (socket says 172.21.15.115:33450) 2023-07-27T14:32:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 -- 172.21.15.115:0/4180401081 learned_addr learned my addr 172.21.15.115:0/4180401081 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea259c700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 0x7efea4151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea359e700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea4153ec0 0x7efea40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 -- 172.21.15.115:0/4180401081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 msgr2=0x7efea4151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 0x7efea4151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 -- 172.21.15.115:0/4180401081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea4153ec0 msgr2=0x7efea40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea4153ec0 0x7efea40c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 -- 172.21.15.115:0/4180401081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe940092a0 con 0x7efea40aa050 2023-07-27T14:32:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.015+0000 7efea2d9d700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40aa050 0x7efea40c45b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7efea4060760 tx=0x7efe94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.016+0000 7efe8affd700 1 -- 172.21.15.115:0/4180401081 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400b850 con 0x7efea40aa050 2023-07-27T14:32:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.016+0000 7efe8affd700 1 -- 172.21.15.115:0/4180401081 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400b9b0 con 0x7efea40aa050 2023-07-27T14:32:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.016+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea40c3b80 con 0x7efea40aa050 2023-07-27T14:32:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.016+0000 7efe8affd700 1 -- 172.21.15.115:0/4180401081 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9401b650 con 0x7efea40aa050 2023-07-27T14:32:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.016+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea4151b70 con 0x7efea40aa050 2023-07-27T14:32:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.017+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea406c470 con 0x7efea40aa050 2023-07-27T14:32:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.018+0000 7efe8affd700 1 -- 172.21.15.115:0/4180401081 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7efe9400f070 con 0x7efea40aa050 2023-07-27T14:32:20.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.018+0000 7efe8affd700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe9005f340 0x7efe90061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.018+0000 7efe8affd700 1 -- 172.21.15.115:0/4180401081 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5269+0+0 (secure 0 0 0) 0x7efe9407b7f0 con 0x7efea40aa050 2023-07-27T14:32:20.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.019+0000 7efea259c700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe9005f340 0x7efe90061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.019+0000 7efea259c700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe9005f340 0x7efe90061800 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7efea4153970 tx=0x7efe98009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:20.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.023+0000 7efe8affd700 1 -- 172.21.15.115:0/4180401081 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efe9404cc20 con 0x7efea40aa050 2023-07-27T14:32:20.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.192+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efea40ad120 con 0x7efea40aa050 2023-07-27T14:32:20.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.193+0000 7efe8affd700 1 -- 172.21.15.115:0/4180401081 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v96) v1 ==== 84+0+143 (secure 0 0 0) 0x7efe94050240 con 0x7efea40aa050 2023-07-27T14:32:20.227 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:20.228 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:32:20.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:20.228 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:32:20.228 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:32:20.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:32:20.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:20.228 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:32:20.229 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:32:20.229 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:20.229 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:32:20.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe9005f340 msgr2=0x7efe90061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe9005f340 0x7efe90061800 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7efea4153970 tx=0x7efe98009040).stop 2023-07-27T14:32:20.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40aa050 msgr2=0x7efea40c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40aa050 0x7efea40c45b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7efea4060760 tx=0x7efe94017000).stop 2023-07-27T14:32:20.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 shutdown_connections 2023-07-27T14:32:20.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe9005f340 0x7efe90061800 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea4153ec0 0x7efea40c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40aa050 0x7efea40c45b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 --2- 172.21.15.115:0/4180401081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea40aaa40 0x7efea4151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 >> 172.21.15.115:0/4180401081 conn(0x7efea40cb610 msgr2=0x7efea40ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:20.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 shutdown_connections 2023-07-27T14:32:20.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.195+0000 7efea91ff700 1 -- 172.21.15.115:0/4180401081 wait complete. 2023-07-27T14:32:20.247 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:32:20.248 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:32:20.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.404+0000 7f77d73ff700 1 Processor -- start 2023-07-27T14:32:20.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.404+0000 7f77d73ff700 1 -- start start 2023-07-27T14:32:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.405+0000 7f77d73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00c58d0 0x7f77d0150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.405+0000 7f77d73ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f77d00c3100 0x7f77d00c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.405+0000 7f77d73ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d00c0ea0 con 0x7f77d01509b0 2023-07-27T14:32:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.405+0000 7f77d73ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d0068e10 con 0x7f77d00c3100 2023-07-27T14:32:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.405+0000 7f77d73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0151280 con 0x7f77d00c58d0 2023-07-27T14:32:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77d519b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f77d01509b0 0x7f77d0154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46218/0 (socket says 172.21.15.115:46218) 2023-07-27T14:32:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77d519b700 1 -- 172.21.15.115:0/4247297503 learned_addr learned my addr 172.21.15.115:0/4247297503 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77d599c700 1 --2- 172.21.15.115:0/4247297503 >> v2:172.21.15.159:3300/0 conn(0x7f77d00c3100 0x7f77d00c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77d499a700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00c58d0 0x7f77d0150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332582089 0 0) 0x7f77d00c0ea0 con 0x7f77d01509b0 2023-07-27T14:32:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77bc0033f0 con 0x7f77d01509b0 2023-07-27T14:32:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 365906077 0 0) 0x7f77bc0033f0 con 0x7f77d01509b0 2023-07-27T14:32:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00c58d0 msgr2=0x7f77d0150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00c58d0 0x7f77d0150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 >> v2:172.21.15.159:3300/0 conn(0x7f77d00c3100 msgr2=0x7f77d00c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 --2- 172.21.15.115:0/4247297503 >> v2:172.21.15.159:3300/0 conn(0x7f77d00c3100 0x7f77d00c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0155190 con 0x7f77d01509b0 2023-07-27T14:32:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.406+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f77cc001470 con 0x7f77d01509b0 2023-07-27T14:32:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 >> v1:172.21.15.115:6789/0 conn(0x7f77d01509b0 legacy=0x7f77d0154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77c7fff700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77bc0038e0 0x7f77bc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77c7fff700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc004690 0x7f77bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77c7fff700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00c58d0 0x7f77bc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0068e10 con 0x7f77bc0038e0 2023-07-27T14:32:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0151280 con 0x7f77bc004690 2023-07-27T14:32:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc00fcf0 con 0x7f77d00c58d0 2023-07-27T14:32:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d519b700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77bc0038e0 0x7f77bc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d499a700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc004690 0x7f77bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d599c700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00c58d0 0x7f77bc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d519b700 1 -- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00c58d0 msgr2=0x7f77bc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d519b700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00c58d0 0x7f77bc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d519b700 1 -- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc004690 msgr2=0x7f77bc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d519b700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc004690 0x7f77bc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d519b700 1 -- 172.21.15.115:0/4247297503 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0033f0 con 0x7f77bc0038e0 2023-07-27T14:32:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.407+0000 7f77d519b700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77bc0038e0 0x7f77bc003d00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f77cc00c210 tx=0x7f77d0068f50).ready entity=mon.0 client_cookie=4fbe5ede7794a036 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc007a60 con 0x7f77bc0038e0 2023-07-27T14:32:20.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc00cae0 con 0x7f77bc0038e0 2023-07-27T14:32:20.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77c7fff700 1 -- 172.21.15.115:0/4247297503 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00ce60 con 0x7f77bc0038e0 2023-07-27T14:32:20.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77d73ff700 1 -- 172.21.15.115:0/4247297503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77bc0038e0 msgr2=0x7f77bc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77d73ff700 1 --2- 172.21.15.115:0/4247297503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77bc0038e0 0x7f77bc003d00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f77cc00c210 tx=0x7f77d0068f50).stop 2023-07-27T14:32:20.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77d599c700 1 -- 172.21.15.115:0/4247297503 reap_dead start 2023-07-27T14:32:20.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77d73ff700 1 -- 172.21.15.115:0/4247297503 shutdown_connections 2023-07-27T14:32:20.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77d73ff700 1 -- 172.21.15.115:0/4247297503 >> 172.21.15.115:0/4247297503 conn(0x7f77d0062320 msgr2=0x7f77d0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:20.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77d73ff700 1 -- 172.21.15.115:0/4247297503 shutdown_connections 2023-07-27T14:32:20.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.408+0000 7f77d73ff700 1 -- 172.21.15.115:0/4247297503 wait complete. 2023-07-27T14:32:20.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.410+0000 7f77d73ff700 1 Processor -- start 2023-07-27T14:32:20.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.410+0000 7f77d73ff700 1 -- start start 2023-07-27T14:32:20.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d73ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc0038e0 0x7f77d0152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00a6a60 0x7f77d014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d73ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d014e410 0x7f77d014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d73ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0153d30 con 0x7f77d014e410 2023-07-27T14:32:20.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d73ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d01538a0 con 0x7f77bc0038e0 2023-07-27T14:32:20.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0149ef0 con 0x7f77d00a6a60 2023-07-27T14:32:20.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d599c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d014e410 0x7f77d014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d599c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d014e410 0x7f77d014e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33464/0 (socket says 172.21.15.115:33464) 2023-07-27T14:32:20.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d599c700 1 -- 172.21.15.115:0/2459322422 learned_addr learned my addr 172.21.15.115:0/2459322422 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:20.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d519b700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc0038e0 0x7f77d0152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d499a700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00a6a60 0x7f77d014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d599c700 1 -- 172.21.15.115:0/2459322422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00a6a60 msgr2=0x7f77d014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d599c700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00a6a60 0x7f77d014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d599c700 1 -- 172.21.15.115:0/2459322422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc0038e0 msgr2=0x7f77d0152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d599c700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc0038e0 0x7f77d0152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.411+0000 7f77d599c700 1 -- 172.21.15.115:0/2459322422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0152c90 con 0x7f77d014e410 2023-07-27T14:32:20.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.412+0000 7f77d599c700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d014e410 0x7f77d014e890 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f77d00a63f0 tx=0x7f77c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:20.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.412+0000 7f77c57fa700 1 -- 172.21.15.115:0/2459322422 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c800e040 con 0x7f77d014e410 2023-07-27T14:32:20.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.412+0000 7f77c57fa700 1 -- 172.21.15.115:0/2459322422 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c800f040 con 0x7f77d014e410 2023-07-27T14:32:20.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.412+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d0152f70 con 0x7f77d014e410 2023-07-27T14:32:20.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.412+0000 7f77c57fa700 1 -- 172.21.15.115:0/2459322422 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c800fe20 con 0x7f77d014e410 2023-07-27T14:32:20.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.412+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d0153530 con 0x7f77d014e410 2023-07-27T14:32:20.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.413+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d0153a30 con 0x7f77d014e410 2023-07-27T14:32:20.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.414+0000 7f77c57fa700 1 -- 172.21.15.115:0/2459322422 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f77c8015660 con 0x7f77d014e410 2023-07-27T14:32:20.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.415+0000 7f77c57fa700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77b405f370 0x7f77b4061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:20.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.415+0000 7f77c57fa700 1 -- 172.21.15.115:0/2459322422 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f77c807ab50 con 0x7f77d014e410 2023-07-27T14:32:20.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.415+0000 7f77d519b700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77b405f370 0x7f77b4061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:20.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.415+0000 7f77d519b700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77b405f370 0x7f77b4061830 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f77cc00cab0 tx=0x7f77cc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:20.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.419+0000 7f77c57fa700 1 -- 172.21.15.115:0/2459322422 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77c804bf80 con 0x7f77d014e410 2023-07-27T14:32:20.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.588+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f77d0155470 con 0x7f77d014e410 2023-07-27T14:32:20.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.830+0000 7f77c57fa700 1 -- 172.21.15.115:0/2459322422 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v97) v1 ==== 152+0+0 (secure 0 0 0) 0x7f77c804f5a0 con 0x7f77d014e410 2023-07-27T14:32:20.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77b405f370 msgr2=0x7f77b4061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77b405f370 0x7f77b4061830 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f77cc00cab0 tx=0x7f77cc015000).stop 2023-07-27T14:32:20.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d014e410 msgr2=0x7f77d014e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:20.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d014e410 0x7f77d014e890 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f77d00a63f0 tx=0x7f77c800b040).stop 2023-07-27T14:32:20.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 shutdown_connections 2023-07-27T14:32:20.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77b405f370 0x7f77b4061830 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d014e410 0x7f77d014e890 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77bc0038e0 0x7f77d0152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 --2- 172.21.15.115:0/2459322422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77d00a6a60 0x7f77d014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:20.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.834+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 >> 172.21.15.115:0/2459322422 conn(0x7f77d0062320 msgr2=0x7f77d0064910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:20.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.835+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 shutdown_connections 2023-07-27T14:32:20.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:20.838+0000 7f77d73ff700 1 -- 172.21.15.115:0/2459322422 wait complete. 2023-07-27T14:32:20.875 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:32:20.892 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:32:21.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.052+0000 7fa7f31ff700 1 Processor -- start 2023-07-27T14:32:21.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.052+0000 7fa7f31ff700 1 -- start start 2023-07-27T14:32:21.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.053+0000 7fa7f31ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 0x7fa7ec0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:21.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.053+0000 7fa7f31ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa7ec154850 0x7fa7ec068520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:21.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.053+0000 7fa7f31ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7ec150240 0x7fa7ec1506d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:21.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.053+0000 7fa7f31ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0c0f60 con 0x7fa7ec150240 2023-07-27T14:32:21.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.053+0000 7fa7f31ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec154dc0 con 0x7fa7ec154850 2023-07-27T14:32:21.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.053+0000 7fa7f31ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec1550a0 con 0x7fa7ec068f00 2023-07-27T14:32:21.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7ec150240 0x7fa7ec1506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:21.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7ec150240 0x7fa7ec1506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33478/0 (socket says 172.21.15.115:33478) 2023-07-27T14:32:21.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 -- 172.21.15.115:0/391992607 learned_addr learned my addr 172.21.15.115:0/391992607 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:21.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f0f9b700 1 --2- 172.21.15.115:0/391992607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 0x7fa7ec0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:21.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7ebfff700 1 --2- 172.21.15.115:0/391992607 >> v2:172.21.15.159:3300/0 conn(0x7fa7ec154850 0x7fa7ec068520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:21.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 -- 172.21.15.115:0/391992607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 msgr2=0x7fa7ec0692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:21.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 --2- 172.21.15.115:0/391992607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 0x7fa7ec0692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 -- 172.21.15.115:0/391992607 >> v2:172.21.15.159:3300/0 conn(0x7fa7ec154850 msgr2=0x7fa7ec068520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:21.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 --2- 172.21.15.115:0/391992607 >> v2:172.21.15.159:3300/0 conn(0x7fa7ec154850 0x7fa7ec068520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 -- 172.21.15.115:0/391992607 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec155380 con 0x7fa7ec150240 2023-07-27T14:32:21.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7ebfff700 1 --2- 172.21.15.115:0/391992607 >> v2:172.21.15.159:3300/0 conn(0x7fa7ec154850 0x7fa7ec068520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:21.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.054+0000 7fa7f179c700 1 --2- 172.21.15.115:0/391992607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec1506d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fa7ec063260 tx=0x7fa7e4009840).ready entity=mon.0 client_cookie=2ad221db6811cb2c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:21.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7eb7fe700 1 -- 172.21.15.115:0/391992607 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400e070 con 0x7fa7ec150240 2023-07-27T14:32:21.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7eb7fe700 1 -- 172.21.15.115:0/391992607 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400ba20 con 0x7fa7ec150240 2023-07-27T14:32:21.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7eb7fe700 1 -- 172.21.15.115:0/391992607 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400bda0 con 0x7fa7ec150240 2023-07-27T14:32:21.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 -- 172.21.15.115:0/391992607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 msgr2=0x7fa7ec1506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:21.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/391992607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec1506d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fa7ec063260 tx=0x7fa7e4009840).stop 2023-07-27T14:32:21.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 -- 172.21.15.115:0/391992607 shutdown_connections 2023-07-27T14:32:21.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/391992607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec1506d0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/391992607 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 0x7fa7ec0692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/391992607 >> v2:172.21.15.159:3300/0 conn(0x7fa7ec154850 0x7fa7ec068520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 -- 172.21.15.115:0/391992607 >> 172.21.15.115:0/391992607 conn(0x7fa7ec062df0 msgr2=0x7fa7ec0c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:21.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 -- 172.21.15.115:0/391992607 shutdown_connections 2023-07-27T14:32:21.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.055+0000 7fa7f31ff700 1 -- 172.21.15.115:0/391992607 wait complete. 2023-07-27T14:32:21.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.057+0000 7fa7f31ff700 1 Processor -- start 2023-07-27T14:32:21.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.057+0000 7fa7f31ff700 1 -- start start 2023-07-27T14:32:21.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7f31ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 0x7fa7ec13df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:21.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7f31ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:21.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7f31ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7ec154850 0x7fa7ec143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:21.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7f31ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec1536a0 con 0x7fa7ec150240 2023-07-27T14:32:21.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7f31ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec152a90 con 0x7fa7ec154850 2023-07-27T14:32:21.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7f31ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec152d70 con 0x7fa7ec068f00 2023-07-27T14:32:21.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:21.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33486/0 (socket says 172.21.15.115:33486) 2023-07-27T14:32:21.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7ebfff700 1 -- 172.21.15.115:0/1190248859 learned_addr learned my addr 172.21.15.115:0/1190248859 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:21.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7f0f9b700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 0x7fa7ec13df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:21.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7f179c700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7ec154850 0x7fa7ec143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7ebfff700 1 -- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 msgr2=0x7fa7ec13df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7ebfff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 0x7fa7ec13df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7ebfff700 1 -- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7ec154850 msgr2=0x7fa7ec143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7ebfff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7ec154850 0x7fa7ec143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.058+0000 7fa7ebfff700 1 -- 172.21.15.115:0/1190248859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4009ae0 con 0x7fa7ec150240 2023-07-27T14:32:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.059+0000 7fa7f179c700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7ec154850 0x7fa7ec143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.059+0000 7fa7ebfff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec153b30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7fa7d800d860 tx=0x7fa7d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:21.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.059+0000 7fa7e8ff9700 1 -- 172.21.15.115:0/1190248859 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80125f0 con 0x7fa7ec150240 2023-07-27T14:32:21.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.059+0000 7fa7e8ff9700 1 -- 172.21.15.115:0/1190248859 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8012750 con 0x7fa7ec150240 2023-07-27T14:32:21.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.059+0000 7fa7e8ff9700 1 -- 172.21.15.115:0/1190248859 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8012ad0 con 0x7fa7ec150240 2023-07-27T14:32:21.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.059+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec153050 con 0x7fa7ec150240 2023-07-27T14:32:21.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.059+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec13e400 con 0x7fa7ec150240 2023-07-27T14:32:21.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.060+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec06c470 con 0x7fa7ec150240 2023-07-27T14:32:21.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.061+0000 7fa7e8ff9700 1 -- 172.21.15.115:0/1190248859 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fa7d8013480 con 0x7fa7ec150240 2023-07-27T14:32:21.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.062+0000 7fa7e8ff9700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa7d005f370 0x7fa7d0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:21.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.062+0000 7fa7e8ff9700 1 -- 172.21.15.115:0/1190248859 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fa7d807aa70 con 0x7fa7ec150240 2023-07-27T14:32:21.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.062+0000 7fa7f0f9b700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa7d005f370 0x7fa7d0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:21.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.063+0000 7fa7f0f9b700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa7d005f370 0x7fa7d0061830 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fa7e0009bc0 tx=0x7fa7e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:21.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.066+0000 7fa7e8ff9700 1 -- 172.21.15.115:0/1190248859 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7d804bd50 con 0x7fa7ec150240 2023-07-27T14:32:21.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.236+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa7ec154630 con 0x7fa7ec150240 2023-07-27T14:32:21.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.839+0000 7fa7e8ff9700 1 -- 172.21.15.115:0/1190248859 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v98) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa7d804f370 con 0x7fa7ec150240 2023-07-27T14:32:21.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.857+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa7d005f370 msgr2=0x7fa7d0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:21.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.857+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa7d005f370 0x7fa7d0061830 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fa7e0009bc0 tx=0x7fa7e0008040).stop 2023-07-27T14:32:21.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.857+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 msgr2=0x7fa7ec153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:21.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.857+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec153b30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7fa7d800d860 tx=0x7fa7d8008040).stop 2023-07-27T14:32:21.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.858+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 shutdown_connections 2023-07-27T14:32:21.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.858+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa7d005f370 0x7fa7d0061830 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.858+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7ec154850 0x7fa7ec143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.858+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa7ec068f00 0x7fa7ec13df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:21.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.858+0000 7fa7f31ff700 1 --2- 172.21.15.115:0/1190248859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7ec150240 0x7fa7ec153b30 secure :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0x7fa7d800d860 tx=0x7fa7d8008040).stop 2023-07-27T14:32:21.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.858+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 >> 172.21.15.115:0/1190248859 conn(0x7fa7ec062df0 msgr2=0x7fa7ec140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:21.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.858+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 shutdown_connections 2023-07-27T14:32:21.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:21.860+0000 7fa7f31ff700 1 -- 172.21.15.115:0/1190248859 wait complete. 2023-07-27T14:32:21.900 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:32:21.919 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:32:22.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.076+0000 7fd9ac3ff700 1 Processor -- start 2023-07-27T14:32:22.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.076+0000 7fd9ac3ff700 1 -- start start 2023-07-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9ac3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9a414ae00 0x7fd9a4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9ac3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd9a414b1e0 0x7fd9a4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9ac3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a40c5c50 0x7fd9a4063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9ac3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a4063530 con 0x7fd9a414ae00 2023-07-27T14:32:22.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9ac3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a41553f0 con 0x7fd9a414b1e0 2023-07-27T14:32:22.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9ac3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4157a50 con 0x7fd9a40c5c50 2023-07-27T14:32:22.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9aa19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9a414ae00 0x7fd9a4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9aa19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9a414ae00 0x7fd9a4154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33494/0 (socket says 172.21.15.115:33494) 2023-07-27T14:32:22.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.077+0000 7fd9aa19b700 1 -- 172.21.15.115:0/683139543 learned_addr learned my addr 172.21.15.115:0/683139543 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9a999a700 1 --2- 172.21.15.115:0/683139543 >> v2:172.21.15.159:3300/0 conn(0x7fd9a414b1e0 0x7fd9a4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9aa99c700 1 --2- 172.21.15.115:0/683139543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a40c5c50 0x7fd9a4063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9aa19b700 1 -- 172.21.15.115:0/683139543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a40c5c50 msgr2=0x7fd9a4063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9aa19b700 1 --2- 172.21.15.115:0/683139543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a40c5c50 0x7fd9a4063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9aa19b700 1 -- 172.21.15.115:0/683139543 >> v2:172.21.15.159:3300/0 conn(0x7fd9a414b1e0 msgr2=0x7fd9a4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:22.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9aa19b700 1 --2- 172.21.15.115:0/683139543 >> v2:172.21.15.159:3300/0 conn(0x7fd9a414b1e0 0x7fd9a4062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9aa19b700 1 -- 172.21.15.115:0/683139543 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4157d10 con 0x7fd9a414ae00 2023-07-27T14:32:22.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9aa99c700 1 --2- 172.21.15.115:0/683139543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a40c5c50 0x7fd9a4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:22.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9a999a700 1 --2- 172.21.15.115:0/683139543 >> v2:172.21.15.159:3300/0 conn(0x7fd9a414b1e0 0x7fd9a4062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:22.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9aa19b700 1 --2- 172.21.15.115:0/683139543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a4154f00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fd9a40cbc00 tx=0x7fd9a00090f0).ready entity=mon.0 client_cookie=d8e1c4beb8f40b2b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9a9199700 1 -- 172.21.15.115:0/683139543 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000b600 con 0x7fd9a414ae00 2023-07-27T14:32:22.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9a9199700 1 -- 172.21.15.115:0/683139543 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a000b760 con 0x7fd9a414ae00 2023-07-27T14:32:22.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.078+0000 7fd9a9199700 1 -- 172.21.15.115:0/683139543 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000bae0 con 0x7fd9a414ae00 2023-07-27T14:32:22.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/683139543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 msgr2=0x7fd9a4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/683139543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a4154f00 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fd9a40cbc00 tx=0x7fd9a00090f0).stop 2023-07-27T14:32:22.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/683139543 shutdown_connections 2023-07-27T14:32:22.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/683139543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a40c5c50 0x7fd9a4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/683139543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a4154f00 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/683139543 >> v2:172.21.15.159:3300/0 conn(0x7fd9a414b1e0 0x7fd9a4062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/683139543 >> 172.21.15.115:0/683139543 conn(0x7fd9a405e940 msgr2=0x7fd9a40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:22.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/683139543 shutdown_connections 2023-07-27T14:32:22.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.079+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/683139543 wait complete. 2023-07-27T14:32:22.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.080+0000 7fd9ac3ff700 1 Processor -- start 2023-07-27T14:32:22.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.081+0000 7fd9ac3ff700 1 -- start start 2023-07-27T14:32:22.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.081+0000 7fd9ac3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a40c5c50 0x7fd9a4167de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.081+0000 7fd9ac3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.081+0000 7fd9ac3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a414b1e0 0x7fd9a414a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.081+0000 7fd9ac3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40c22a0 con 0x7fd9a414ae00 2023-07-27T14:32:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.081+0000 7fd9ac3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40ae3b0 con 0x7fd9a40c5c50 2023-07-27T14:32:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.081+0000 7fd9ac3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40ae690 con 0x7fd9a414b1e0 2023-07-27T14:32:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a40adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33500/0 (socket says 172.21.15.115:33500) 2023-07-27T14:32:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 -- 172.21.15.115:0/436895895 learned_addr learned my addr 172.21.15.115:0/436895895 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 -- 172.21.15.115:0/436895895 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a414b1e0 msgr2=0x7fd9a414a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a414b1e0 0x7fd9a414a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 -- 172.21.15.115:0/436895895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a40c5c50 msgr2=0x7fd9a4167de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a40c5c50 0x7fd9a4167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 -- 172.21.15.115:0/436895895 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0009370 con 0x7fd9a414ae00 2023-07-27T14:32:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9a999a700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a40adb60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fd99400c880 tx=0x7fd994008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd99a7fc700 1 -- 172.21.15.115:0/436895895 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994010580 con 0x7fd9a414ae00 2023-07-27T14:32:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd99a7fc700 1 -- 172.21.15.115:0/436895895 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9940106e0 con 0x7fd9a414ae00 2023-07-27T14:32:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a40c1c50 con 0x7fd9a414ae00 2023-07-27T14:32:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.082+0000 7fd99a7fc700 1 -- 172.21.15.115:0/436895895 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994010a60 con 0x7fd9a414ae00 2023-07-27T14:32:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.083+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a40ae050 con 0x7fd9a414ae00 2023-07-27T14:32:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.084+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a406c470 con 0x7fd9a414ae00 2023-07-27T14:32:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.084+0000 7fd99a7fc700 1 -- 172.21.15.115:0/436895895 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fd99401b460 con 0x7fd9a414ae00 2023-07-27T14:32:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.085+0000 7fd99a7fc700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd98805f370 0x7fd988061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.085+0000 7fd99a7fc700 1 -- 172.21.15.115:0/436895895 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fd99407a330 con 0x7fd9a414ae00 2023-07-27T14:32:22.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.085+0000 7fd9aa19b700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd98805f370 0x7fd988061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.086+0000 7fd9aa19b700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd98805f370 0x7fd988061830 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fd9a0009fd0 tx=0x7fd9a0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.090+0000 7fd99a7fc700 1 -- 172.21.15.115:0/436895895 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd99404b410 con 0x7fd9a414ae00 2023-07-27T14:32:22.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.296+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd9a40c5160 con 0x7fd9a414ae00 2023-07-27T14:32:22.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.304+0000 7fd99a7fc700 1 -- 172.21.15.115:0/436895895 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd99404ea30 con 0x7fd9a414ae00 2023-07-27T14:32:22.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.310+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd98805f370 msgr2=0x7fd988061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.310+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd98805f370 0x7fd988061830 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fd9a0009fd0 tx=0x7fd9a0017000).stop 2023-07-27T14:32:22.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.310+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 msgr2=0x7fd9a40adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.310+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a40adb60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fd99400c880 tx=0x7fd994008040).stop 2023-07-27T14:32:22.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.314+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 shutdown_connections 2023-07-27T14:32:22.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.314+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd98805f370 0x7fd988061830 secure :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0x7fd9a0009fd0 tx=0x7fd9a0017000).stop 2023-07-27T14:32:22.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.314+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9a414b1e0 0x7fd9a414a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:22.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.314+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9a40c5c50 0x7fd9a4167de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:22.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.314+0000 7fd9ac3ff700 1 --2- 172.21.15.115:0/436895895 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a414ae00 0x7fd9a40adb60 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.314+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 >> 172.21.15.115:0/436895895 conn(0x7fd9a405e940 msgr2=0x7fd9a40a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:22.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.323+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 shutdown_connections 2023-07-27T14:32:22.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.324+0000 7fd9ac3ff700 1 -- 172.21.15.115:0/436895895 wait complete. 2023-07-27T14:32:22.367 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 13 and data pool 14 2023-07-27T14:32:22.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.537+0000 7fdd903ff700 1 Processor -- start 2023-07-27T14:32:22.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.537+0000 7fdd903ff700 1 -- start start 2023-07-27T14:32:22.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.538+0000 7fdd903ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdd880aaa40 0x7fdd880640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.538+0000 7fdd903ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd880aa4d0 con 0x7fdd88153ec0 2023-07-27T14:32:22.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.538+0000 7fdd903ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd880c05c0 con 0x7fdd881542a0 2023-07-27T14:32:22.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.538+0000 7fdd903ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd880aa270 con 0x7fdd880aaa40 2023-07-27T14:32:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.538+0000 7fdd8e19b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdd88153ec0 0x7fdd880a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46226/0 (socket says 172.21.15.115:46226) 2023-07-27T14:32:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8e19b700 1 -- 172.21.15.115:0/501484096 learned_addr learned my addr 172.21.15.115:0/501484096 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:22.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192770440 0 0) 0x7fdd84001110 con 0x7fdd88153ec0 2023-07-27T14:32:22.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd740033f0 con 0x7fdd88153ec0 2023-07-27T14:32:22.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d99a700 1 --2- 172.21.15.115:0/501484096 >> v2:172.21.15.159:3300/0 conn(0x7fdd880aaa40 0x7fdd880640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155298802 0 0) 0x7fdd740033f0 con 0x7fdd88153ec0 2023-07-27T14:32:22.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 >> v2:172.21.15.159:3300/0 conn(0x7fdd880aaa40 msgr2=0x7fdd880640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:22.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 --2- 172.21.15.115:0/501484096 >> v2:172.21.15.159:3300/0 conn(0x7fdd880aaa40 0x7fdd880640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 >> v1:172.21.15.159:6789/0 conn(0x7fdd881542a0 legacy=0x7fdd880c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd880bfc90 con 0x7fdd88153ec0 2023-07-27T14:32:22.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fdd84001600 con 0x7fdd88153ec0 2023-07-27T14:32:22.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 >> v1:172.21.15.115:6789/0 conn(0x7fdd88153ec0 legacy=0x7fdd880a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd740038e0 0x7fdd74003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd74004690 0x7fdd74004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd74005000 0x7fdd7400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880aa270 con 0x7fdd74005000 2023-07-27T14:32:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7400bf60 con 0x7fdd74004690 2023-07-27T14:32:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.539+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7400c0f0 con 0x7fdd740038e0 2023-07-27T14:32:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e99c700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd74005000 0x7fdd7400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8d99a700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd74004690 0x7fdd74004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e19b700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd740038e0 0x7fdd74003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e99c700 1 -- 172.21.15.115:0/501484096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd740038e0 msgr2=0x7fdd74003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:22.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e99c700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd740038e0 0x7fdd74003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e99c700 1 -- 172.21.15.115:0/501484096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd74004690 msgr2=0x7fdd74004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e99c700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd74004690 0x7fdd74004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e99c700 1 -- 172.21.15.115:0/501484096 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740033f0 con 0x7fdd74005000 2023-07-27T14:32:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e99c700 1 -- 172.21.15.115:0/501484096 reap_dead start 2023-07-27T14:32:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8e99c700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd74005000 0x7fdd7400b8e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fdd80001e00 tx=0x7fdd80007f30).ready entity=mon.0 client_cookie=96caba8ad4117366 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80006a20 con 0x7fdd74005000 2023-07-27T14:32:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd80006b80 con 0x7fdd74005000 2023-07-27T14:32:22.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.540+0000 7fdd8d199700 1 -- 172.21.15.115:0/501484096 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000c5d0 con 0x7fdd74005000 2023-07-27T14:32:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.541+0000 7fdd903ff700 1 -- 172.21.15.115:0/501484096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd74005000 msgr2=0x7fdd7400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.541+0000 7fdd903ff700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd74005000 0x7fdd7400b8e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7fdd80001e00 tx=0x7fdd80007f30).stop 2023-07-27T14:32:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.541+0000 7fdd903ff700 1 -- 172.21.15.115:0/501484096 shutdown_connections 2023-07-27T14:32:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.541+0000 7fdd903ff700 1 --2- 172.21.15.115:0/501484096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd74005000 0x7fdd7400b8e0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.541+0000 7fdd903ff700 1 -- 172.21.15.115:0/501484096 >> 172.21.15.115:0/501484096 conn(0x7fdd880cb610 msgr2=0x7fdd880c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.541+0000 7fdd903ff700 1 -- 172.21.15.115:0/501484096 shutdown_connections 2023-07-27T14:32:22.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.541+0000 7fdd903ff700 1 -- 172.21.15.115:0/501484096 wait complete. 2023-07-27T14:32:22.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.542+0000 7fdd903ff700 1 Processor -- start 2023-07-27T14:32:22.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.543+0000 7fdd903ff700 1 -- start start 2023-07-27T14:32:22.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.543+0000 7fdd903ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd74005000 0x7fdd880ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd903ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd880abc40 0x7fdd880c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd903ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd880c2120 0x7fdd8813f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd903ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88168b90 con 0x7fdd880c2120 2023-07-27T14:32:22.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd903ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88167dd0 con 0x7fdd880abc40 2023-07-27T14:32:22.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd903ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881680b0 con 0x7fdd74005000 2023-07-27T14:32:22.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd880c2120 0x7fdd8813f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd880c2120 0x7fdd8813f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33520/0 (socket says 172.21.15.115:33520) 2023-07-27T14:32:22.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e99c700 1 -- 172.21.15.115:0/1083783903 learned_addr learned my addr 172.21.15.115:0/1083783903 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:22.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e19b700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd74005000 0x7fdd880ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8d99a700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd880abc40 0x7fdd880c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e99c700 1 -- 172.21.15.115:0/1083783903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd74005000 msgr2=0x7fdd880ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e99c700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd74005000 0x7fdd880ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e99c700 1 -- 172.21.15.115:0/1083783903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd880abc40 msgr2=0x7fdd880c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e99c700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd880abc40 0x7fdd880c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.544+0000 7fdd8e99c700 1 -- 172.21.15.115:0/1083783903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88168390 con 0x7fdd880c2120 2023-07-27T14:32:22.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.545+0000 7fdd8e99c700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd880c2120 0x7fdd8813f5c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fdd80009000 tx=0x7fdd80015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.545+0000 7fdd7e7fc700 1 -- 172.21.15.115:0/1083783903 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80006a20 con 0x7fdd880c2120 2023-07-27T14:32:22.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.545+0000 7fdd7e7fc700 1 -- 172.21.15.115:0/1083783903 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8000c5d0 con 0x7fdd880c2120 2023-07-27T14:32:22.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.545+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd88168670 con 0x7fdd880c2120 2023-07-27T14:32:22.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.545+0000 7fdd7e7fc700 1 -- 172.21.15.115:0/1083783903 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80012c90 con 0x7fdd880c2120 2023-07-27T14:32:22.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.545+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8813fab0 con 0x7fdd880c2120 2023-07-27T14:32:22.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.546+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd88168890 con 0x7fdd880c2120 2023-07-27T14:32:22.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.547+0000 7fdd7e7fc700 1 -- 172.21.15.115:0/1083783903 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fdd80024030 con 0x7fdd880c2120 2023-07-27T14:32:22.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.548+0000 7fdd7e7fc700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6c05f370 0x7fdd6c061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.548+0000 7fdd7e7fc700 1 -- 172.21.15.115:0/1083783903 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdd80018040 con 0x7fdd880c2120 2023-07-27T14:32:22.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.548+0000 7fdd8e19b700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6c05f370 0x7fdd6c061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.548+0000 7fdd8e19b700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6c05f370 0x7fdd6c061830 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fdd84001050 tx=0x7fdd880c0530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.552+0000 7fdd7e7fc700 1 -- 172.21.15.115:0/1083783903 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd8004c1e0 con 0x7fdd880c2120 2023-07-27T14:32:22.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.721+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd8806c470 con 0x7fdd880c2120 2023-07-27T14:32:22.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.722+0000 7fdd7e7fc700 1 -- 172.21.15.115:0/1083783903 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+17088 (secure 0 0 0) 0x7fdd80016070 con 0x7fdd880c2120 2023-07-27T14:32:22.757 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:22.758 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":99,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:22.296788+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:32:20.631951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-27T14:32:21.280167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:22.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6c05f370 msgr2=0x7fdd6c061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6c05f370 0x7fdd6c061830 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fdd84001050 tx=0x7fdd880c0530).stop 2023-07-27T14:32:22.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd880c2120 msgr2=0x7fdd8813f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd880c2120 0x7fdd8813f5c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fdd80009000 tx=0x7fdd80015000).stop 2023-07-27T14:32:22.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 shutdown_connections 2023-07-27T14:32:22.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd6c05f370 0x7fdd6c061830 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd880c2120 0x7fdd8813f5c0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd74005000 0x7fdd880ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 --2- 172.21.15.115:0/1083783903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd880abc40 0x7fdd880c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 >> 172.21.15.115:0/1083783903 conn(0x7fdd880cb610 msgr2=0x7fdd880aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:22.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 shutdown_connections 2023-07-27T14:32:22.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.724+0000 7fdd903ff700 1 -- 172.21.15.115:0/1083783903 wait complete. 2023-07-27T14:32:22.776 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:22.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.930+0000 7f67e39ff700 1 Processor -- start 2023-07-27T14:32:22.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.931+0000 7f67e39ff700 1 -- start start 2023-07-27T14:32:22.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e39ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f67dc153ec0 0x7f67dc0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e39ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc0aa050 0x7f67dc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e39ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc0aa4d0 con 0x7f67dc0aaa40 2023-07-27T14:32:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e39ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc0c05c0 con 0x7f67dc153ec0 2023-07-27T14:32:22.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e39ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c1a60 con 0x7f67dc0aa050 2023-07-27T14:32:22.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e1f9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f67dc0aaa40 0x7f67dc157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46242/0 (socket says 172.21.15.115:46242) 2023-07-27T14:32:22.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e1f9c700 1 -- 172.21.15.115:0/4189764114 learned_addr learned my addr 172.21.15.115:0/4189764114 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:22.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e0f9a700 1 --2- 172.21.15.115:0/4189764114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc0aa050 0x7f67dc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.932+0000 7f67e179b700 1 --2- 172.21.15.115:0/4189764114 >> v2:172.21.15.159:3300/0 conn(0x7f67dc153ec0 0x7f67dc0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67d3fff700 1 -- 172.21.15.115:0/4189764114 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287364045 0 0) 0x7f67d4001490 con 0x7f67dc0aaa40 2023-07-27T14:32:22.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67d3fff700 1 -- 172.21.15.115:0/4189764114 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c80033f0 con 0x7f67dc0aaa40 2023-07-27T14:32:22.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67e0f9a700 1 -- 172.21.15.115:0/4189764114 >> v2:172.21.15.159:3300/0 conn(0x7f67dc153ec0 msgr2=0x7f67dc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:22.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67e0f9a700 1 --2- 172.21.15.115:0/4189764114 >> v2:172.21.15.159:3300/0 conn(0x7f67dc153ec0 0x7f67dc0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67e0f9a700 1 -- 172.21.15.115:0/4189764114 >> v1:172.21.15.115:6789/0 conn(0x7f67dc0aaa40 legacy=0x7f67dc157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67e0f9a700 1 -- 172.21.15.115:0/4189764114 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0bfc90 con 0x7f67dc0aa050 2023-07-27T14:32:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67e179b700 1 --2- 172.21.15.115:0/4189764114 >> v2:172.21.15.159:3300/0 conn(0x7f67dc153ec0 0x7f67dc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67e0f9a700 1 --2- 172.21.15.115:0/4189764114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc0aa050 0x7f67dc0640f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f67cc009760 tx=0x7f67cc009060).ready entity=mon.2 client_cookie=585c9c866edf739d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67d3fff700 1 -- 172.21.15.115:0/4189764114 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00d4a0 con 0x7f67dc0aa050 2023-07-27T14:32:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67d3fff700 1 -- 172.21.15.115:0/4189764114 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc00d600 con 0x7f67dc0aa050 2023-07-27T14:32:22.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.933+0000 7f67d3fff700 1 -- 172.21.15.115:0/4189764114 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00d980 con 0x7f67dc0aa050 2023-07-27T14:32:22.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.934+0000 7f67e39ff700 1 -- 172.21.15.115:0/4189764114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc0aa050 msgr2=0x7f67dc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.934+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4189764114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc0aa050 0x7f67dc0640f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f67cc009760 tx=0x7f67cc009060).stop 2023-07-27T14:32:22.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.934+0000 7f67e39ff700 1 -- 172.21.15.115:0/4189764114 shutdown_connections 2023-07-27T14:32:22.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.934+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4189764114 >> v2:172.21.15.159:3300/0 conn(0x7f67dc153ec0 0x7f67dc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.934+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4189764114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc0aa050 0x7f67dc0640f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:22.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.934+0000 7f67e39ff700 1 -- 172.21.15.115:0/4189764114 >> 172.21.15.115:0/4189764114 conn(0x7f67dc0cb610 msgr2=0x7f67dc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:22.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.934+0000 7f67e39ff700 1 -- 172.21.15.115:0/4189764114 shutdown_connections 2023-07-27T14:32:22.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.934+0000 7f67e39ff700 1 -- 172.21.15.115:0/4189764114 wait complete. 2023-07-27T14:32:22.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.935+0000 7f67e39ff700 1 Processor -- start 2023-07-27T14:32:22.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.936+0000 7f67e39ff700 1 -- start start 2023-07-27T14:32:22.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.936+0000 7f67e39ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67dc0aa050 0x7f67dc14c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.936+0000 7f67e39ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67dc0aaa40 0x7f67dc150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.936+0000 7f67e39ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc153ec0 0x7f67dc0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.936+0000 7f67e39ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c2cf0 con 0x7f67dc0aaa40 2023-07-27T14:32:22.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.936+0000 7f67e39ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc150960 con 0x7f67dc0aa050 2023-07-27T14:32:22.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.936+0000 7f67e39ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc150bb0 con 0x7f67dc153ec0 2023-07-27T14:32:22.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67dc0aaa40 0x7f67dc150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67dc0aaa40 0x7f67dc150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33526/0 (socket says 172.21.15.115:33526) 2023-07-27T14:32:22.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 -- 172.21.15.115:0/4179170893 learned_addr learned my addr 172.21.15.115:0/4179170893 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:22.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 -- 172.21.15.115:0/4179170893 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc153ec0 msgr2=0x7f67dc0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc153ec0 0x7f67dc0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:22.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 -- 172.21.15.115:0/4179170893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67dc0aa050 msgr2=0x7f67dc14c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:22.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67dc0aa050 0x7f67dc14c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:22.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 -- 172.21.15.115:0/4179170893 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d80092a0 con 0x7f67dc0aaa40 2023-07-27T14:32:22.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e0f9a700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67dc0aaa40 0x7f67dc150080 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f67cc009d50 tx=0x7f67cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67d17fa700 1 -- 172.21.15.115:0/4179170893 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc000bc0 con 0x7f67dc0aaa40 2023-07-27T14:32:22.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67d17fa700 1 -- 172.21.15.115:0/4179170893 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc00d770 con 0x7f67dc0aaa40 2023-07-27T14:32:22.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67d17fa700 1 -- 172.21.15.115:0/4179170893 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc000d20 con 0x7f67dc0aaa40 2023-07-27T14:32:22.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.937+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67cc0092a0 con 0x7f67dc0aaa40 2023-07-27T14:32:22.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.938+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc151170 con 0x7f67dc0aaa40 2023-07-27T14:32:22.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.938+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc06c470 con 0x7f67dc0aaa40 2023-07-27T14:32:22.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.939+0000 7f67d17fa700 1 -- 172.21.15.115:0/4179170893 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f67cc024030 con 0x7f67dc0aaa40 2023-07-27T14:32:22.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.940+0000 7f67d17fa700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67c005f340 0x7f67c0061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:22.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.940+0000 7f67d17fa700 1 -- 172.21.15.115:0/4179170893 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f67cc07b190 con 0x7f67dc0aaa40 2023-07-27T14:32:22.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.941+0000 7f67e179b700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67c005f340 0x7f67c0061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:22.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.941+0000 7f67e179b700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67c005f340 0x7f67c0061800 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f67d8009b40 tx=0x7f67d8009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:22.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:22.944+0000 7f67d17fa700 1 -- 172.21.15.115:0/4179170893 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f67cc04c200 con 0x7f67dc0aaa40 2023-07-27T14:32:23.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.114+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67dc0bff70 con 0x7f67dc0aaa40 2023-07-27T14:32:23.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.115+0000 7f67d17fa700 1 -- 172.21.15.115:0/4179170893 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+17088 (secure 0 0 0) 0x7f67cc04fe60 con 0x7f67dc0aaa40 2023-07-27T14:32:23.150 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:23.150 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":99,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:22.296788+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:32:20.631951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-27T14:32:21.280167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:23.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67c005f340 msgr2=0x7f67c0061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:23.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67c005f340 0x7f67c0061800 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f67d8009b40 tx=0x7f67d8009060).stop 2023-07-27T14:32:23.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67dc0aaa40 msgr2=0x7f67dc150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:23.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67dc0aaa40 0x7f67dc150080 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f67cc009d50 tx=0x7f67cc016000).stop 2023-07-27T14:32:23.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 shutdown_connections 2023-07-27T14:32:23.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67c005f340 0x7f67c0061800 secure :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0x7f67d8009b40 tx=0x7f67d8009060).stop 2023-07-27T14:32:23.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67dc153ec0 0x7f67dc0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:23.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67dc0aa050 0x7f67dc14c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:23.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 --2- 172.21.15.115:0/4179170893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67dc0aaa40 0x7f67dc150080 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:23.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 >> 172.21.15.115:0/4179170893 conn(0x7f67dc0cb610 msgr2=0x7f67dc0640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:23.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 shutdown_connections 2023-07-27T14:32:23.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.117+0000 7f67e39ff700 1 -- 172.21.15.115:0/4179170893 wait complete. 2023-07-27T14:32:23.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:32:23.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.327+0000 7f222edff700 1 Processor -- start 2023-07-27T14:32:23.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.328+0000 7f222edff700 1 -- start start 2023-07-27T14:32:23.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.329+0000 7f222edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2228063260 0x7f2228154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:23.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.329+0000 7f222edff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22281553f0 con 0x7f222814ae00 2023-07-27T14:32:23.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.329+0000 7f222edff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2228157a50 con 0x7f222814b1e0 2023-07-27T14:32:23.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.329+0000 7f222edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2228157d10 con 0x7f2228063260 2023-07-27T14:32:23.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.329+0000 7f222cb9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f222814ae00 0x7f2228062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46250/0 (socket says 172.21.15.115:46250) 2023-07-27T14:32:23.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.329+0000 7f222cb9b700 1 -- 172.21.15.115:0/2496334001 learned_addr learned my addr 172.21.15.115:0/2496334001 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:23.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f2227fff700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2228063260 0x7f2228154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:23.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906185387 0 0) 0x7f22281553f0 con 0x7f222814ae00 2023-07-27T14:32:23.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22180033f0 con 0x7f222814ae00 2023-07-27T14:32:23.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 52118160 0 0) 0x7f22180033f0 con 0x7f222814ae00 2023-07-27T14:32:23.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2228063260 msgr2=0x7f2228154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:23.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2228063260 0x7f2228154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:23.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 >> v1:172.21.15.159:6789/0 conn(0x7f222814b1e0 legacy=0x7f22280a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:23.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228157ff0 con 0x7f222814ae00 2023-07-27T14:32:23.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f221c001470 con 0x7f222814ae00 2023-07-27T14:32:23.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 >> v1:172.21.15.115:6789/0 conn(0x7f222814ae00 legacy=0x7f2228062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:23.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2228063260 0x7f2218003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:23.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2218003e00 0x7f2218004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:23.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2218004b80 0x7f2218005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:23.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228157d10 con 0x7f2218004b80 2023-07-27T14:32:23.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221800b8e0 con 0x7f2218003e00 2023-07-27T14:32:23.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221800baa0 con 0x7f2228063260 2023-07-27T14:32:23.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f222d39c700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2218004b80 0x7f2218005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:23.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f222cb9b700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2228063260 0x7f2218003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:23.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.330+0000 7f2227fff700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2218003e00 0x7f2218004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:23.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f222d39c700 1 -- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2228063260 msgr2=0x7f2218003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:23.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f222d39c700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2228063260 0x7f2218003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:23.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f222d39c700 1 -- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2218003e00 msgr2=0x7f2218004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:23.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f222d39c700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2218003e00 0x7f2218004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:23.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f222d39c700 1 -- 172.21.15.115:0/2496334001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180033f0 con 0x7f2218004b80 2023-07-27T14:32:23.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f222d39c700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2218004b80 0x7f2218005000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f2220001fe0 tx=0x7f2220007f30).ready entity=mon.0 client_cookie=8c95cb764a6c8ddb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:23.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000c870 con 0x7f2218004b80 2023-07-27T14:32:23.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2220003030 con 0x7f2218004b80 2023-07-27T14:32:23.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.331+0000 7f22277fe700 1 -- 172.21.15.115:0/2496334001 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000cc20 con 0x7f2218004b80 2023-07-27T14:32:23.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.332+0000 7f222edff700 1 -- 172.21.15.115:0/2496334001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2218004b80 msgr2=0x7f2218005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:23.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.332+0000 7f222edff700 1 --2- 172.21.15.115:0/2496334001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2218004b80 0x7f2218005000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f2220001fe0 tx=0x7f2220007f30).stop 2023-07-27T14:32:23.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.332+0000 7f222d39c700 1 -- 172.21.15.115:0/2496334001 reap_dead start 2023-07-27T14:32:23.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.332+0000 7f222edff700 1 -- 172.21.15.115:0/2496334001 shutdown_connections 2023-07-27T14:32:23.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.332+0000 7f222edff700 1 -- 172.21.15.115:0/2496334001 >> 172.21.15.115:0/2496334001 conn(0x7f222805e940 msgr2=0x7f22280cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:23.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.332+0000 7f222edff700 1 -- 172.21.15.115:0/2496334001 shutdown_connections 2023-07-27T14:32:23.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.332+0000 7f222edff700 1 -- 172.21.15.115:0/2496334001 wait complete. 2023-07-27T14:32:23.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.333+0000 7f222edff700 1 Processor -- start 2023-07-27T14:32:23.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.333+0000 7f222edff700 1 -- start start 2023-07-27T14:32:23.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.334+0000 7f222edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2218004b80 0x7f222814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:23.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.334+0000 7f222edff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22281670b0 0x7f222814e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.334+0000 7f222edff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280aee80 0x7f22280af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.334+0000 7f222edff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228168050 con 0x7f22280aee80 2023-07-27T14:32:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.334+0000 7f222edff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222814aba0 con 0x7f22281670b0 2023-07-27T14:32:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.334+0000 7f222edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280c3000 con 0x7f2218004b80 2023-07-27T14:32:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280aee80 0x7f22280af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280aee80 0x7f22280af300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33538/0 (socket says 172.21.15.115:33538) 2023-07-27T14:32:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 -- 172.21.15.115:0/4005498167 learned_addr learned my addr 172.21.15.115:0/4005498167 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f2227fff700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22281670b0 0x7f222814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222cb9b700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2218004b80 0x7f222814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 -- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2218004b80 msgr2=0x7f222814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2218004b80 0x7f222814a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 -- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22281670b0 msgr2=0x7f222814e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22281670b0 0x7f222814e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 -- 172.21.15.115:0/4005498167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228167530 con 0x7f22280aee80 2023-07-27T14:32:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222cb9b700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2218004b80 0x7f222814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:23.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222d39c700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280aee80 0x7f22280af300 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f2220010000 tx=0x7f2220016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:23.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f2224ff9700 1 -- 172.21.15.115:0/4005498167 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000ca80 con 0x7f22280aee80 2023-07-27T14:32:23.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f2224ff9700 1 -- 172.21.15.115:0/4005498167 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222000cbe0 con 0x7f22280aee80 2023-07-27T14:32:23.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222814e670 con 0x7f22280aee80 2023-07-27T14:32:23.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.335+0000 7f2224ff9700 1 -- 172.21.15.115:0/4005498167 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220006c30 con 0x7f22280aee80 2023-07-27T14:32:23.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.336+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2228167a90 con 0x7f22280aee80 2023-07-27T14:32:23.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.336+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22280c2dd0 con 0x7f22280aee80 2023-07-27T14:32:23.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.337+0000 7f2224ff9700 1 -- 172.21.15.115:0/4005498167 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f2220025030 con 0x7f22280aee80 2023-07-27T14:32:23.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.338+0000 7f2224ff9700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f220c05f370 0x7f220c061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:23.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.338+0000 7f2224ff9700 1 -- 172.21.15.115:0/4005498167 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f222007b510 con 0x7f22280aee80 2023-07-27T14:32:23.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.338+0000 7f222cb9b700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f220c05f370 0x7f220c061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:23.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.339+0000 7f222cb9b700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f220c05f370 0x7f220c061830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f221c0010e0 tx=0x7f221c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:23.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.342+0000 7f2224ff9700 1 -- 172.21.15.115:0/4005498167 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22280c2dd0 con 0x7f22280aee80 2023-07-27T14:32:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:23.559+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f22280c2dd0 con 0x7f22280aee80 2023-07-27T14:32:24.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.314+0000 7f2224ff9700 1 -- 172.21.15.115:0/4005498167 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7f22280c2dd0 con 0x7f22280aee80 2023-07-27T14:32:24.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f220c05f370 msgr2=0x7f220c061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:24.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f220c05f370 0x7f220c061830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f221c0010e0 tx=0x7f221c009040).stop 2023-07-27T14:32:24.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280aee80 msgr2=0x7f22280af300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:24.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280aee80 0x7f22280af300 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f2220010000 tx=0x7f2220016000).stop 2023-07-27T14:32:24.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 shutdown_connections 2023-07-27T14:32:24.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f220c05f370 0x7f220c061830 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280aee80 0x7f22280af300 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2218004b80 0x7f222814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.316+0000 7f222edff700 1 --2- 172.21.15.115:0/4005498167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f22281670b0 0x7f222814e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.317+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 >> 172.21.15.115:0/4005498167 conn(0x7f222805e940 msgr2=0x7f2228064a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:24.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.317+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 shutdown_connections 2023-07-27T14:32:24.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.317+0000 7f222edff700 1 -- 172.21.15.115:0/4005498167 wait complete. 2023-07-27T14:32:24.370 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:32:24.370 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:32:24.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.526+0000 7f6ed47ff700 1 Processor -- start 2023-07-27T14:32:24.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.526+0000 7f6ed47ff700 1 -- start start 2023-07-27T14:32:24.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.527+0000 7f6ed47ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ecc153e00 0x7f6ecc0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:24.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed47ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6ecc064230 0x7f6ecc0656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:24.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed47ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc066050 con 0x7f6ecc065bc0 2023-07-27T14:32:24.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed47ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc062320 con 0x7f6ecc153e00 2023-07-27T14:32:24.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed47ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc064a80 con 0x7f6ecc064230 2023-07-27T14:32:24.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed259b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ecc153e00 0x7f6ecc0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:24.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed259b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ecc153e00 0x7f6ecc0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47240/0 (socket says 172.21.15.115:47240) 2023-07-27T14:32:24.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed259b700 1 -- 172.21.15.115:0/2821137052 learned_addr learned my addr 172.21.15.115:0/2821137052 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:24.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed1d9a700 1 --2- 172.21.15.115:0/2821137052 >> v2:172.21.15.159:3300/0 conn(0x7f6ecc064230 0x7f6ecc0656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:24.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed259b700 1 -- 172.21.15.115:0/2821137052 >> v2:172.21.15.159:3300/0 conn(0x7f6ecc064230 msgr2=0x7f6ecc0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:24.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed259b700 1 --2- 172.21.15.115:0/2821137052 >> v2:172.21.15.159:3300/0 conn(0x7f6ecc064230 0x7f6ecc0656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed259b700 1 -- 172.21.15.115:0/2821137052 >> v1:172.21.15.159:6789/0 conn(0x7f6ecc065bc0 legacy=0x7f6ecc157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:24.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed259b700 1 -- 172.21.15.115:0/2821137052 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc064d60 con 0x7f6ecc153e00 2023-07-27T14:32:24.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.528+0000 7f6ed259b700 1 --2- 172.21.15.115:0/2821137052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0c6b70 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f6ecc0c3b80 tx=0x7f6ec80090f0).ready entity=mon.0 client_cookie=af325ab9e8fe28aa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:24.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed1599700 1 -- 172.21.15.115:0/2821137052 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800b5a0 con 0x7f6ecc153e00 2023-07-27T14:32:24.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed1599700 1 -- 172.21.15.115:0/2821137052 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec800b700 con 0x7f6ecc153e00 2023-07-27T14:32:24.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed1599700 1 -- 172.21.15.115:0/2821137052 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800ba80 con 0x7f6ecc153e00 2023-07-27T14:32:24.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2821137052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 msgr2=0x7f6ecc0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:24.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2821137052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0c6b70 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f6ecc0c3b80 tx=0x7f6ec80090f0).stop 2023-07-27T14:32:24.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2821137052 shutdown_connections 2023-07-27T14:32:24.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2821137052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0c6b70 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2821137052 >> v2:172.21.15.159:3300/0 conn(0x7f6ecc064230 0x7f6ecc0656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2821137052 >> 172.21.15.115:0/2821137052 conn(0x7f6ecc0c7b90 msgr2=0x7f6ecc0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:24.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2821137052 shutdown_connections 2023-07-27T14:32:24.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.529+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2821137052 wait complete. 2023-07-27T14:32:24.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.531+0000 7f6ed47ff700 1 Processor -- start 2023-07-27T14:32:24.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.531+0000 7f6ed47ff700 1 -- start start 2023-07-27T14:32:24.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed47ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ecc064230 0x7f6ecc14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:24.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed47ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:24.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed47ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:24.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed47ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc063d10 con 0x7f6ecc153e00 2023-07-27T14:32:24.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed47ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0a9760 con 0x7f6ecc065bc0 2023-07-27T14:32:24.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed47ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0a8340 con 0x7f6ecc064230 2023-07-27T14:32:24.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed2d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:24.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed2d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0a87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47244/0 (socket says 172.21.15.115:47244) 2023-07-27T14:32:24.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed2d9c700 1 -- 172.21.15.115:0/2354522256 learned_addr learned my addr 172.21.15.115:0/2354522256 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:24.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed1d9a700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:24.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.532+0000 7f6ed259b700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ecc064230 0x7f6ecc14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:24.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ed2d9c700 1 -- 172.21.15.115:0/2354522256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ecc064230 msgr2=0x7f6ecc14f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:24.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ed2d9c700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ecc064230 0x7f6ecc14f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ed2d9c700 1 -- 172.21.15.115:0/2354522256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc065bc0 msgr2=0x7f6ecc156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:24.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ed2d9c700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:24.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ed2d9c700 1 -- 172.21.15.115:0/2354522256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8009370 con 0x7f6ecc153e00 2023-07-27T14:32:24.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ed2d9c700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0a87d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f6ec400c840 tx=0x7f6ec4002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:24.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ec27fc700 1 -- 172.21.15.115:0/2354522256 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400e4a0 con 0x7f6ecc153e00 2023-07-27T14:32:24.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ec27fc700 1 -- 172.21.15.115:0/2354522256 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400e620 con 0x7f6ecc153e00 2023-07-27T14:32:24.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0a9480 con 0x7f6ecc153e00 2023-07-27T14:32:24.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ec27fc700 1 -- 172.21.15.115:0/2354522256 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400e9e0 con 0x7f6ecc153e00 2023-07-27T14:32:24.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.533+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc0a7fd0 con 0x7f6ecc153e00 2023-07-27T14:32:24.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.534+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc06c470 con 0x7f6ecc153e00 2023-07-27T14:32:24.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.535+0000 7f6ec27fc700 1 -- 172.21.15.115:0/2354522256 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f6ec4004030 con 0x7f6ecc153e00 2023-07-27T14:32:24.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.536+0000 7f6ec27fc700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6eb005f370 0x7f6eb0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:24.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.536+0000 7f6ec27fc700 1 -- 172.21.15.115:0/2354522256 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6ec4079d90 con 0x7f6ecc153e00 2023-07-27T14:32:24.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.537+0000 7f6ed259b700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6eb005f370 0x7f6eb0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:24.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.537+0000 7f6ed259b700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6eb005f370 0x7f6eb0061830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f6ec8009130 tx=0x7f6ec8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:24.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.540+0000 7f6ec27fc700 1 -- 172.21.15.115:0/2354522256 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ec40478f0 con 0x7f6ecc153e00 2023-07-27T14:32:24.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:24.751+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6ecc065040 con 0x7f6ecc153e00 2023-07-27T14:32:25.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.317+0000 7f6ec27fc700 1 -- 172.21.15.115:0/2354522256 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ec404e670 con 0x7f6ecc153e00 2023-07-27T14:32:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6eb005f370 msgr2=0x7f6eb0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6eb005f370 0x7f6eb0061830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f6ec8009130 tx=0x7f6ec8015000).stop 2023-07-27T14:32:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 msgr2=0x7f6ecc0a87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0a87d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f6ec400c840 tx=0x7f6ec4002560).stop 2023-07-27T14:32:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 shutdown_connections 2023-07-27T14:32:25.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6eb005f370 0x7f6eb0061830 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ecc153e00 0x7f6ecc0a87d0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ecc064230 0x7f6ecc14f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 --2- 172.21.15.115:0/2354522256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 >> 172.21.15.115:0/2354522256 conn(0x7f6ecc0c7b90 msgr2=0x7f6ecc0bc070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:25.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 shutdown_connections 2023-07-27T14:32:25.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.319+0000 7f6ed47ff700 1 -- 172.21.15.115:0/2354522256 wait complete. 2023-07-27T14:32:25.372 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:32:25.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:25.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.526+0000 7f37ac3ff700 1 Processor -- start 2023-07-27T14:32:25.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.526+0000 7f37ac3ff700 1 -- start start 2023-07-27T14:32:25.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.527+0000 7f37ac3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a4155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:25.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.527+0000 7f37ac3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f37a4065ff0 0x7f37a4066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:25.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.527+0000 7f37ac3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a4067080 con 0x7f37a4066960 2023-07-27T14:32:25.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.527+0000 7f37ac3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a4063a90 con 0x7f37a4065ff0 2023-07-27T14:32:25.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.527+0000 7f37ac3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4068570 con 0x7f37a4151d70 2023-07-27T14:32:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37aa99c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f37a4066960 0x7f37a4157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40624/0 (socket says 172.21.15.115:40624) 2023-07-27T14:32:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37aa99c700 1 -- 172.21.15.115:0/1594092062 learned_addr learned my addr 172.21.15.115:0/1594092062 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37a999a700 1 --2- 172.21.15.115:0/1594092062 >> v2:172.21.15.159:3300/0 conn(0x7f37a4065ff0 0x7f37a4066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37aa19b700 1 --2- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a4155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37a9199700 1 -- 172.21.15.115:0/1594092062 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330008379 0 0) 0x7f37a4067080 con 0x7f37a4066960 2023-07-27T14:32:25.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37a9199700 1 -- 172.21.15.115:0/1594092062 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37900033f0 con 0x7f37a4066960 2023-07-27T14:32:25.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37a9199700 1 -- 172.21.15.115:0/1594092062 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 67092576 0 0) 0x7f37900033f0 con 0x7f37a4066960 2023-07-27T14:32:25.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37a999a700 1 -- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 msgr2=0x7f37a4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:25.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37a999a700 1 --2- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a4155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37a999a700 1 -- 172.21.15.115:0/1594092062 >> v1:172.21.15.115:6789/0 conn(0x7f37a4066960 legacy=0x7f37a4157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37a999a700 1 -- 172.21.15.115:0/1594092062 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a4066e10 con 0x7f37a4065ff0 2023-07-27T14:32:25.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.528+0000 7f37aa19b700 1 --2- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a4155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:25.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.529+0000 7f37a999a700 1 --2- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4065ff0 0x7f37a4066470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f3794009760 tx=0x7f3794009060).ready entity=mon.1 client_cookie=84c87fc17b57462e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:25.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.529+0000 7f37a9199700 1 -- 172.21.15.115:0/1594092062 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c0017f0 con 0x7f37a4065ff0 2023-07-27T14:32:25.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.529+0000 7f37a9199700 1 -- 172.21.15.115:0/1594092062 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794011400 con 0x7f37a4065ff0 2023-07-27T14:32:25.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.529+0000 7f37a9199700 1 -- 172.21.15.115:0/1594092062 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794011780 con 0x7f37a4065ff0 2023-07-27T14:32:25.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.530+0000 7f37ac3ff700 1 -- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4065ff0 msgr2=0x7f37a4066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.530+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4065ff0 0x7f37a4066470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f3794009760 tx=0x7f3794009060).stop 2023-07-27T14:32:25.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.530+0000 7f37ac3ff700 1 -- 172.21.15.115:0/1594092062 shutdown_connections 2023-07-27T14:32:25.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.530+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a4155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.530+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/1594092062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4065ff0 0x7f37a4066470 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.530+0000 7f37ac3ff700 1 -- 172.21.15.115:0/1594092062 >> 172.21.15.115:0/1594092062 conn(0x7f37a40c89a0 msgr2=0x7f37a40c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:25.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.530+0000 7f37ac3ff700 1 -- 172.21.15.115:0/1594092062 shutdown_connections 2023-07-27T14:32:25.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.530+0000 7f37ac3ff700 1 -- 172.21.15.115:0/1594092062 wait complete. 2023-07-27T14:32:25.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.531+0000 7f37ac3ff700 1 Processor -- start 2023-07-27T14:32:25.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.531+0000 7f37ac3ff700 1 -- start start 2023-07-27T14:32:25.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.532+0000 7f37ac3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37a4065ff0 0x7f37a414b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:25.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.532+0000 7f37ac3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4066960 0x7f37a40a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:25.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.532+0000 7f37ac3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a40a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:25.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.532+0000 7f37ac3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a414cf50 con 0x7f37a4065ff0 2023-07-27T14:32:25.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.532+0000 7f37ac3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40a8b20 con 0x7f37a4066960 2023-07-27T14:32:25.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.532+0000 7f37ac3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40a8d20 con 0x7f37a4151d70 2023-07-27T14:32:25.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37a4065ff0 0x7f37a414b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:25.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37a4065ff0 0x7f37a414b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47260/0 (socket says 172.21.15.115:47260) 2023-07-27T14:32:25.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 -- 172.21.15.115:0/2921543196 learned_addr learned my addr 172.21.15.115:0/2921543196 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:25.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37a999a700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4066960 0x7f37a40a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:25.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa99c700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a40a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:25.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 -- 172.21.15.115:0/2921543196 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 msgr2=0x7f37a40a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a40a8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 -- 172.21.15.115:0/2921543196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4066960 msgr2=0x7f37a40a8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4066960 0x7f37a40a8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 -- 172.21.15.115:0/2921543196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00092a0 con 0x7f37a4065ff0 2023-07-27T14:32:25.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.533+0000 7f37aa19b700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37a4065ff0 0x7f37a414b7e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f37a000e980 tx=0x7f37a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:25.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.534+0000 7f379a7fc700 1 -- 172.21.15.115:0/2921543196 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0012600 con 0x7f37a4065ff0 2023-07-27T14:32:25.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.534+0000 7f379a7fc700 1 -- 172.21.15.115:0/2921543196 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a0012760 con 0x7f37a4065ff0 2023-07-27T14:32:25.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.534+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37940092a0 con 0x7f37a4065ff0 2023-07-27T14:32:25.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.534+0000 7f379a7fc700 1 -- 172.21.15.115:0/2921543196 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0012ae0 con 0x7f37a4065ff0 2023-07-27T14:32:25.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.534+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a40a95c0 con 0x7f37a4065ff0 2023-07-27T14:32:25.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.535+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a40a9c10 con 0x7f37a4065ff0 2023-07-27T14:32:25.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.536+0000 7f379a7fc700 1 -- 172.21.15.115:0/2921543196 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f37a0022070 con 0x7f37a4065ff0 2023-07-27T14:32:25.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.536+0000 7f379a7fc700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f378805f370 0x7f3788061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:25.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.536+0000 7f379a7fc700 1 -- 172.21.15.115:0/2921543196 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f37a007a620 con 0x7f37a4065ff0 2023-07-27T14:32:25.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.536+0000 7f37a999a700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f378805f370 0x7f3788061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:25.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.537+0000 7f37a999a700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f378805f370 0x7f3788061830 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f3794009760 tx=0x7f3794016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:25.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.540+0000 7f379a7fc700 1 -- 172.21.15.115:0/2921543196 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37a004b700 con 0x7f37a4065ff0 2023-07-27T14:32:25.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.749+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37a406c470 con 0x7f37a4065ff0 2023-07-27T14:32:25.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.749+0000 7f379a7fc700 1 -- 172.21.15.115:0/2921543196 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f37a004ed20 con 0x7f37a4065ff0 2023-07-27T14:32:25.784 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:25.785 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/291900736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":291900736},{"type":"v1","addr":"172.21.15.159:6834","nonce":291900736}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/469026388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":469026388},{"type":"v1","addr":"172.21.15.115:6837","nonce":469026388}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1581340296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":1581340296},{"type":"v1","addr":"172.21.15.159:6835","nonce":1581340296}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:32:22.297133+0000","modified":"2023-07-27T14:32:25.313130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1932712314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1932712314},{"type":"v1","addr":"172.21.15.115:6836","nonce":1932712314}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-07-27T14:32:25.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.751+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f378805f370 msgr2=0x7f3788061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.751+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f378805f370 0x7f3788061830 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f3794009760 tx=0x7f3794016000).stop 2023-07-27T14:32:25.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.751+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37a4065ff0 msgr2=0x7f37a414b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.751+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37a4065ff0 0x7f37a414b7e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f37a000e980 tx=0x7f37a0009060).stop 2023-07-27T14:32:25.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.752+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 shutdown_connections 2023-07-27T14:32:25.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.752+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f378805f370 0x7f3788061830 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.752+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37a4151d70 0x7f37a40a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.752+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37a4065ff0 0x7f37a414b7e0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.752+0000 7f37ac3ff700 1 --2- 172.21.15.115:0/2921543196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37a4066960 0x7f37a40a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.752+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 >> 172.21.15.115:0/2921543196 conn(0x7f37a40c89a0 msgr2=0x7f37a41529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:25.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.752+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 shutdown_connections 2023-07-27T14:32:25.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.752+0000 7f37ac3ff700 1 -- 172.21.15.115:0/2921543196 wait complete. 2023-07-27T14:32:25.788 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 51 2023-07-27T14:32:25.803 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:25.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.955+0000 7f9a0d59d700 1 Processor -- start 2023-07-27T14:32:25.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.956+0000 7f9a0d59d700 1 -- start start 2023-07-27T14:32:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a0d59d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a08153bb0 0x7f9a080c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a0d59d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a080c60d0 0x7f9a080c1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a0d59d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a080c0bd0 con 0x7f9a08153f90 2023-07-27T14:32:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a0d59d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080bffc0 con 0x7f9a08153bb0 2023-07-27T14:32:25.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a0d59d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080c02a0 con 0x7f9a080c60d0 2023-07-27T14:32:25.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a07fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a08153bb0 0x7f9a080c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:25.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a0cd9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9a08153f90 0x7f9a08062c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40638/0 (socket says 172.21.15.115:40638) 2023-07-27T14:32:25.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a07fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a08153bb0 0x7f9a080c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47262/0 (socket says 172.21.15.115:47262) 2023-07-27T14:32:25.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.957+0000 7f9a0cd9c700 1 -- 172.21.15.115:0/2254493680 learned_addr learned my addr 172.21.15.115:0/2254493680 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:25.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a077fe700 1 --2- 172.21.15.115:0/2254493680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a080c60d0 0x7f9a080c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:25.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a07fff700 1 -- 172.21.15.115:0/2254493680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a080c60d0 msgr2=0x7f9a080c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:25.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a07fff700 1 --2- 172.21.15.115:0/2254493680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a080c60d0 0x7f9a080c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a07fff700 1 -- 172.21.15.115:0/2254493680 >> v1:172.21.15.115:6789/0 conn(0x7f9a08153f90 legacy=0x7f9a08062c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a07fff700 1 -- 172.21.15.115:0/2254493680 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080c0580 con 0x7f9a08153bb0 2023-07-27T14:32:25.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a077fe700 1 --2- 172.21.15.115:0/2254493680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a080c60d0 0x7f9a080c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:25.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a06ffd700 1 -- 172.21.15.115:0/2254493680 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222298147 0 0) 0x7f9a080c0bd0 con 0x7f9a08153f90 2023-07-27T14:32:25.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a07fff700 1 --2- 172.21.15.115:0/2254493680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a08153bb0 0x7f9a080c5be0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f99f8009760 tx=0x7f99f8009060).ready entity=mon.0 client_cookie=861ae6c787e12145 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:25.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a06ffd700 1 -- 172.21.15.115:0/2254493680 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800b580 con 0x7f9a08153bb0 2023-07-27T14:32:25.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a06ffd700 1 -- 172.21.15.115:0/2254493680 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f800b6e0 con 0x7f9a08153bb0 2023-07-27T14:32:25.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.958+0000 7f9a06ffd700 1 -- 172.21.15.115:0/2254493680 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800ba60 con 0x7f9a08153bb0 2023-07-27T14:32:25.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.959+0000 7f9a0d59d700 1 -- 172.21.15.115:0/2254493680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a08153bb0 msgr2=0x7f9a080c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:25.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.959+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/2254493680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a08153bb0 0x7f9a080c5be0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f99f8009760 tx=0x7f99f8009060).stop 2023-07-27T14:32:25.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.959+0000 7f9a0d59d700 1 -- 172.21.15.115:0/2254493680 shutdown_connections 2023-07-27T14:32:25.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.959+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/2254493680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a08153bb0 0x7f9a080c5be0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.959+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/2254493680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a080c60d0 0x7f9a080c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:25.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.959+0000 7f9a0d59d700 1 -- 172.21.15.115:0/2254493680 >> 172.21.15.115:0/2254493680 conn(0x7f9a0805e940 msgr2=0x7f9a080cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:25.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.959+0000 7f9a0d59d700 1 -- 172.21.15.115:0/2254493680 shutdown_connections 2023-07-27T14:32:25.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.959+0000 7f9a0d59d700 1 -- 172.21.15.115:0/2254493680 wait complete. 2023-07-27T14:32:26.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.961+0000 7f9a0d59d700 1 Processor -- start 2023-07-27T14:32:26.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.961+0000 7f9a0d59d700 1 -- start start 2023-07-27T14:32:26.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.962+0000 7f9a0d59d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a080c60d0 0x7f9a080ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.962+0000 7f9a0d59d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a08153bb0 0x7f9a080a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.962+0000 7f9a0d59d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a08153f90 0x7f9a080b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.962+0000 7f9a0d59d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080b0c60 con 0x7f9a080c60d0 2023-07-27T14:32:26.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.962+0000 7f9a0d59d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08154c60 con 0x7f9a08153bb0 2023-07-27T14:32:26.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.962+0000 7f9a0d59d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080b0980 con 0x7f9a08153f90 2023-07-27T14:32:26.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a080c60d0 0x7f9a080ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a080c60d0 0x7f9a080ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47278/0 (socket says 172.21.15.115:47278) 2023-07-27T14:32:26.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 -- 172.21.15.115:0/4047129709 learned_addr learned my addr 172.21.15.115:0/4047129709 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:26.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a0cd9c700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a08153f90 0x7f9a080b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 -- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a08153f90 msgr2=0x7f9a080b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a077fe700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a08153bb0 0x7f9a080a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a08153f90 0x7f9a080b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 -- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a08153bb0 msgr2=0x7f9a080a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a08153bb0 0x7f9a080a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 -- 172.21.15.115:0/4047129709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80092a0 con 0x7f9a080c60d0 2023-07-27T14:32:26.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a077fe700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a08153bb0 0x7f9a080a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:26.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a0cd9c700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a08153f90 0x7f9a080b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:26.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.963+0000 7f9a07fff700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a080c60d0 0x7f9a080ae880 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f99f8009eb0 tx=0x7f99f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:26.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.964+0000 7f99effff700 1 -- 172.21.15.115:0/4047129709 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8000bc0 con 0x7f9a080c60d0 2023-07-27T14:32:26.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.964+0000 7f99effff700 1 -- 172.21.15.115:0/4047129709 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f800b850 con 0x7f9a080c60d0 2023-07-27T14:32:26.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.964+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a08154610 con 0x7f9a080c60d0 2023-07-27T14:32:26.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.964+0000 7f99effff700 1 -- 172.21.15.115:0/4047129709 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8000d20 con 0x7f9a080c60d0 2023-07-27T14:32:26.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.964+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a080aa210 con 0x7f9a080c60d0 2023-07-27T14:32:26.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.965+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a08154470 con 0x7f9a080c60d0 2023-07-27T14:32:26.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.966+0000 7f99effff700 1 -- 172.21.15.115:0/4047129709 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f99f802c070 con 0x7f9a080c60d0 2023-07-27T14:32:26.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.967+0000 7f99effff700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f405f370 0x7f99f4061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.967+0000 7f99effff700 1 -- 172.21.15.115:0/4047129709 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f99f807be20 con 0x7f9a080c60d0 2023-07-27T14:32:26.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.967+0000 7f9a077fe700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f405f370 0x7f99f4061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.967+0000 7f9a077fe700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f405f370 0x7f99f4061830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f99fc006d80 tx=0x7f99fc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:26.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:25.971+0000 7f99effff700 1 -- 172.21.15.115:0/4047129709 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9a08154470 con 0x7f9a080c60d0 2023-07-27T14:32:26.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.139+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a08154470 con 0x7f9a080c60d0 2023-07-27T14:32:26.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.140+0000 7f99effff700 1 -- 172.21.15.115:0/4047129709 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+17077 (secure 0 0 0) 0x7f9a08154470 con 0x7f9a080c60d0 2023-07-27T14:32:26.176 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:26.176 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":100,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:23.299831+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:32:20.631951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-27T14:32:21.280167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:26.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f405f370 msgr2=0x7f99f4061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f405f370 0x7f99f4061830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f99fc006d80 tx=0x7f99fc008040).stop 2023-07-27T14:32:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a080c60d0 msgr2=0x7f9a080ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a080c60d0 0x7f9a080ae880 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f99f8009eb0 tx=0x7f99f8017000).stop 2023-07-27T14:32:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 shutdown_connections 2023-07-27T14:32:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f405f370 0x7f99f4061830 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a08153f90 0x7f9a080b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a080c60d0 0x7f9a080ae880 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 --2- 172.21.15.115:0/4047129709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a08153bb0 0x7f9a080a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.142+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 >> 172.21.15.115:0/4047129709 conn(0x7f9a0805e940 msgr2=0x7f9a080cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.143+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 shutdown_connections 2023-07-27T14:32:26.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.143+0000 7f9a0d59d700 1 -- 172.21.15.115:0/4047129709 wait complete. 2023-07-27T14:32:26.195 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:32:26.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:32:26.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.348+0000 7fdaa33ff700 1 Processor -- start 2023-07-27T14:32:26.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.349+0000 7fdaa33ff700 1 -- start start 2023-07-27T14:32:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa33ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fda9c150320 0x7fda9c150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa33ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda9c0c1f70 0x7fda9c069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa33ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c068380 con 0x7fda9c0c0e80 2023-07-27T14:32:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa33ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c065790 con 0x7fda9c0c1f70 2023-07-27T14:32:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa33ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c068ee0 con 0x7fda9c150320 2023-07-27T14:32:26.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa199c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda9c0c1f70 0x7fda9c069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa099a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fda9c0c0e80 0x7fda9c0c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40650/0 (socket says 172.21.15.115:40650) 2023-07-27T14:32:26.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa099a700 1 -- 172.21.15.115:0/1755965099 learned_addr learned my addr 172.21.15.115:0/1755965099 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:26.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.350+0000 7fdaa119b700 1 --2- 172.21.15.115:0/1755965099 >> v2:172.21.15.159:3300/0 conn(0x7fda9c150320 0x7fda9c150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fdaa199c700 1 -- 172.21.15.115:0/1755965099 >> v2:172.21.15.159:3300/0 conn(0x7fda9c150320 msgr2=0x7fda9c150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:26.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fdaa199c700 1 --2- 172.21.15.115:0/1755965099 >> v2:172.21.15.159:3300/0 conn(0x7fda9c150320 0x7fda9c150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fda93fff700 1 -- 172.21.15.115:0/1755965099 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601623386 0 0) 0x7fda9c068380 con 0x7fda9c0c0e80 2023-07-27T14:32:26.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fdaa199c700 1 -- 172.21.15.115:0/1755965099 >> v1:172.21.15.115:6789/0 conn(0x7fda9c0c0e80 legacy=0x7fda9c0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fdaa199c700 1 -- 172.21.15.115:0/1755965099 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0685b0 con 0x7fda9c0c1f70 2023-07-27T14:32:26.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fdaa199c700 1 --2- 172.21.15.115:0/1755965099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c069370 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fda9c0c3280 tx=0x7fda94009780).ready entity=mon.0 client_cookie=f7b639b85a39e90f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:26.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fda93fff700 1 -- 172.21.15.115:0/1755965099 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400e070 con 0x7fda9c0c1f70 2023-07-27T14:32:26.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fda93fff700 1 -- 172.21.15.115:0/1755965099 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400bc30 con 0x7fda9c0c1f70 2023-07-27T14:32:26.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fda93fff700 1 -- 172.21.15.115:0/1755965099 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94012410 con 0x7fda9c0c1f70 2023-07-27T14:32:26.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fdaa33ff700 1 -- 172.21.15.115:0/1755965099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 msgr2=0x7fda9c069370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.351+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/1755965099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c069370 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fda9c0c3280 tx=0x7fda94009780).stop 2023-07-27T14:32:26.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.352+0000 7fdaa33ff700 1 -- 172.21.15.115:0/1755965099 shutdown_connections 2023-07-27T14:32:26.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.352+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/1755965099 >> v2:172.21.15.159:3300/0 conn(0x7fda9c150320 0x7fda9c150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.352+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/1755965099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c069370 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.352+0000 7fdaa33ff700 1 -- 172.21.15.115:0/1755965099 >> 172.21.15.115:0/1755965099 conn(0x7fda9c062320 msgr2=0x7fda9c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:26.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.352+0000 7fdaa33ff700 1 -- 172.21.15.115:0/1755965099 shutdown_connections 2023-07-27T14:32:26.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.352+0000 7fdaa33ff700 1 -- 172.21.15.115:0/1755965099 wait complete. 2023-07-27T14:32:26.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.354+0000 7fdaa33ff700 1 Processor -- start 2023-07-27T14:32:26.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.354+0000 7fdaa33ff700 1 -- start start 2023-07-27T14:32:26.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.355+0000 7fdaa33ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c0c0e80 0x7fda9c0bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.355+0000 7fdaa33ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c0c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.355+0000 7fdaa33ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c150320 0x7fda9c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.355+0000 7fdaa33ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c13db00 con 0x7fda9c0c1f70 2023-07-27T14:32:26.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.355+0000 7fdaa33ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0c0bc0 con 0x7fda9c150320 2023-07-27T14:32:26.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.355+0000 7fdaa33ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0be4b0 con 0x7fda9c0c0e80 2023-07-27T14:32:26.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.355+0000 7fdaa099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c0c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c0c01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47298/0 (socket says 172.21.15.115:47298) 2023-07-27T14:32:26.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa099a700 1 -- 172.21.15.115:0/223104582 learned_addr learned my addr 172.21.15.115:0/223104582 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:26.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa119b700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c0c0e80 0x7fda9c0bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa199c700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c150320 0x7fda9c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa099a700 1 -- 172.21.15.115:0/223104582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c0c0e80 msgr2=0x7fda9c0bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa099a700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c0c0e80 0x7fda9c0bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa099a700 1 -- 172.21.15.115:0/223104582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c150320 msgr2=0x7fda9c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa099a700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c150320 0x7fda9c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa099a700 1 -- 172.21.15.115:0/223104582 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94009a20 con 0x7fda9c0c1f70 2023-07-27T14:32:26.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa099a700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c0c01e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fda8c001eb0 tx=0x7fda8c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:26.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fda917fa700 1 -- 172.21.15.115:0/223104582 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0070d0 con 0x7fda9c0c1f70 2023-07-27T14:32:26.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fda917fa700 1 -- 172.21.15.115:0/223104582 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c007230 con 0x7fda9c0c1f70 2023-07-27T14:32:26.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c0be790 con 0x7fda9c0c1f70 2023-07-27T14:32:26.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.356+0000 7fda917fa700 1 -- 172.21.15.115:0/223104582 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0075d0 con 0x7fda9c0c1f70 2023-07-27T14:32:26.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.357+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c0bed50 con 0x7fda9c0c1f70 2023-07-27T14:32:26.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.358+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c06c470 con 0x7fda9c0c1f70 2023-07-27T14:32:26.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.358+0000 7fda917fa700 1 -- 172.21.15.115:0/223104582 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fda8c010070 con 0x7fda9c0c1f70 2023-07-27T14:32:26.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.359+0000 7fda917fa700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8005f370 0x7fda80061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.359+0000 7fda917fa700 1 -- 172.21.15.115:0/223104582 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fda8c079cc0 con 0x7fda9c0c1f70 2023-07-27T14:32:26.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.359+0000 7fdaa119b700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8005f370 0x7fda80061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.360+0000 7fdaa119b700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8005f370 0x7fda80061830 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fda9800bbc0 tx=0x7fda98008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:26.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.363+0000 7fda917fa700 1 -- 172.21.15.115:0/223104582 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda8c080080 con 0x7fda9c0c1f70 2023-07-27T14:32:26.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.531+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda9c064bd0 con 0x7fda8005f370 2023-07-27T14:32:26.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.541+0000 7fda917fa700 1 -- 172.21.15.115:0/223104582 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361084 (secure 0 0 0) 0x7fda9c064bd0 con 0x7fda8005f370 2023-07-27T14:32:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:26.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8005f370 msgr2=0x7fda80061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8005f370 0x7fda80061830 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fda9800bbc0 tx=0x7fda98008040).stop 2023-07-27T14:32:26.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 msgr2=0x7fda9c0c01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c0c01e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fda8c001eb0 tx=0x7fda8c007e90).stop 2023-07-27T14:32:26.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 shutdown_connections 2023-07-27T14:32:26.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda8005f370 0x7fda80061830 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c150320 0x7fda9c0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c0c0e80 0x7fda9c0bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 --2- 172.21.15.115:0/223104582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda9c0c1f70 0x7fda9c0c01e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 >> 172.21.15.115:0/223104582 conn(0x7fda9c062320 msgr2=0x7fda9c063df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:26.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 shutdown_connections 2023-07-27T14:32:26.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.546+0000 7fdaa33ff700 1 -- 172.21.15.115:0/223104582 wait complete. 2023-07-27T14:32:26.584 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:32:26.599 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-07-27T14:32:25.510449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":118124,"kb_used_data":9580,"kb_used_omap":0,"kb_used_meta":108480,"kb_avail":754856596,"statfs":{"total":773094113280,"available":772973154304,"internally_reserved":0,"allocated":9809920,"data_stored":4529388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":111083520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5223013,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-219,"num_read_kb":-204856,"num_write":-1378,"num_write_kb":-414850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.193971"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334999+0000","last_change":"2023-07-27T14:32:22.331609+0000","last_active":"2023-07-27T14:32:22.334999+0000","last_peered":"2023-07-27T14:32:22.334999+0000","last_clean":"2023-07-27T14:32:22.334999+0000","last_became_active":"2023-07-27T14:32:22.331313+0000","last_became_peered":"2023-07-27T14:32:22.331313+0000","last_unstale":"2023-07-27T14:32:22.334999+0000","last_undegraded":"2023-07-27T14:32:22.334999+0000","last_fullsized":"2023-07-27T14:32:22.334999+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"99'3","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332867+0000","last_change":"2023-07-27T14:32:21.862225+0000","last_active":"2023-07-27T14:32:22.332867+0000","last_peered":"2023-07-27T14:32:22.332867+0000","last_clean":"2023-07-27T14:32:22.332867+0000","last_became_active":"2023-07-27T14:32:21.861927+0000","last_became_peered":"2023-07-27T14:32:21.861927+0000","last_unstale":"2023-07-27T14:32:22.332867+0000","last_undegraded":"2023-07-27T14:32:22.332867+0000","last_fullsized":"2023-07-27T14:32:22.332867+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322501+0000","last_change":"2023-07-27T14:32:22.321337+0000","last_active":"2023-07-27T14:32:22.322501+0000","last_peered":"2023-07-27T14:32:22.322501+0000","last_clean":"2023-07-27T14:32:22.322501+0000","last_became_active":"2023-07-27T14:32:22.321073+0000","last_became_peered":"2023-07-27T14:32:22.321073+0000","last_unstale":"2023-07-27T14:32:22.322501+0000","last_undegraded":"2023-07-27T14:32:22.322501+0000","last_fullsized":"2023-07-27T14:32:22.322501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317927+0000","last_change":"2023-07-27T14:32:21.854483+0000","last_active":"2023-07-27T14:32:22.317927+0000","last_peered":"2023-07-27T14:32:22.317927+0000","last_clean":"2023-07-27T14:32:22.317927+0000","last_became_active":"2023-07-27T14:32:21.854185+0000","last_became_peered":"2023-07-27T14:32:21.854185+0000","last_unstale":"2023-07-27T14:32:22.317927+0000","last_undegraded":"2023-07-27T14:32:22.317927+0000","last_fullsized":"2023-07-27T14:32:22.317927+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328418+0000","last_change":"2023-07-27T14:32:22.326353+0000","last_active":"2023-07-27T14:32:22.328418+0000","last_peered":"2023-07-27T14:32:22.328418+0000","last_clean":"2023-07-27T14:32:22.328418+0000","last_became_active":"2023-07-27T14:32:22.326043+0000","last_became_peered":"2023-07-27T14:32:22.326043+0000","last_unstale":"2023-07-27T14:32:22.328418+0000","last_undegraded":"2023-07-27T14:32:22.328418+0000","last_fullsized":"2023-07-27T14:32:22.328418+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.858540+0000","last_change":"2023-07-27T14:32:21.856016+0000","last_active":"2023-07-27T14:32:21.858540+0000","last_peered":"2023-07-27T14:32:21.858540+0000","last_clean":"2023-07-27T14:32:21.858540+0000","last_became_active":"2023-07-27T14:32:21.855769+0000","last_became_peered":"2023-07-27T14:32:21.855769+0000","last_unstale":"2023-07-27T14:32:21.858540+0000","last_undegraded":"2023-07-27T14:32:21.858540+0000","last_fullsized":"2023-07-27T14:32:21.858540+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.320770+0000","last_change":"2023-07-27T14:32:22.316498+0000","last_active":"2023-07-27T14:32:22.320770+0000","last_peered":"2023-07-27T14:32:22.320770+0000","last_clean":"2023-07-27T14:32:22.320770+0000","last_became_active":"2023-07-27T14:32:22.316235+0000","last_became_peered":"2023-07-27T14:32:22.316235+0000","last_unstale":"2023-07-27T14:32:22.320770+0000","last_undegraded":"2023-07-27T14:32:22.320770+0000","last_fullsized":"2023-07-27T14:32:22.320770+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328680+0000","last_change":"2023-07-27T14:32:21.862501+0000","last_active":"2023-07-27T14:32:22.328680+0000","last_peered":"2023-07-27T14:32:22.328680+0000","last_clean":"2023-07-27T14:32:22.328680+0000","last_became_active":"2023-07-27T14:32:21.862264+0000","last_became_peered":"2023-07-27T14:32:21.862264+0000","last_unstale":"2023-07-27T14:32:22.328680+0000","last_undegraded":"2023-07-27T14:32:22.328680+0000","last_fullsized":"2023-07-27T14:32:22.328680+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334665+0000","last_change":"2023-07-27T14:32:22.324666+0000","last_active":"2023-07-27T14:32:22.334665+0000","last_peered":"2023-07-27T14:32:22.334665+0000","last_clean":"2023-07-27T14:32:22.334665+0000","last_became_active":"2023-07-27T14:32:22.324122+0000","last_became_peered":"2023-07-27T14:32:22.324122+0000","last_unstale":"2023-07-27T14:32:22.334665+0000","last_undegraded":"2023-07-27T14:32:22.334665+0000","last_fullsized":"2023-07-27T14:32:22.334665+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.307345+0000","last_change":"2023-07-27T14:32:21.859444+0000","last_active":"2023-07-27T14:32:22.307345+0000","last_peered":"2023-07-27T14:32:22.307345+0000","last_clean":"2023-07-27T14:32:22.307345+0000","last_became_active":"2023-07-27T14:32:21.859176+0000","last_became_peered":"2023-07-27T14:32:21.859176+0000","last_unstale":"2023-07-27T14:32:22.307345+0000","last_undegraded":"2023-07-27T14:32:22.307345+0000","last_fullsized":"2023-07-27T14:32:22.307345+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327943+0000","last_change":"2023-07-27T14:32:22.327943+0000","last_active":"2023-07-27T14:32:22.327943+0000","last_peered":"2023-07-27T14:32:22.327943+0000","last_clean":"2023-07-27T14:32:22.327943+0000","last_became_active":"2023-07-27T14:32:22.327634+0000","last_became_peered":"2023-07-27T14:32:22.327634+0000","last_unstale":"2023-07-27T14:32:22.327943+0000","last_undegraded":"2023-07-27T14:32:22.327943+0000","last_fullsized":"2023-07-27T14:32:22.327943+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328725+0000","last_change":"2023-07-27T14:32:21.859877+0000","last_active":"2023-07-27T14:32:22.328725+0000","last_peered":"2023-07-27T14:32:22.328725+0000","last_clean":"2023-07-27T14:32:22.328725+0000","last_became_active":"2023-07-27T14:32:21.859559+0000","last_became_peered":"2023-07-27T14:32:21.859559+0000","last_unstale":"2023-07-27T14:32:22.328725+0000","last_undegraded":"2023-07-27T14:32:22.328725+0000","last_fullsized":"2023-07-27T14:32:22.328725+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.324214+0000","last_change":"2023-07-27T14:32:22.319476+0000","last_active":"2023-07-27T14:32:22.324214+0000","last_peered":"2023-07-27T14:32:22.324214+0000","last_clean":"2023-07-27T14:32:22.324214+0000","last_became_active":"2023-07-27T14:32:22.319243+0000","last_became_peered":"2023-07-27T14:32:22.319243+0000","last_unstale":"2023-07-27T14:32:22.324214+0000","last_undegraded":"2023-07-27T14:32:22.324214+0000","last_fullsized":"2023-07-27T14:32:22.324214+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.311203+0000","last_change":"2023-07-27T14:32:21.859966+0000","last_active":"2023-07-27T14:32:22.311203+0000","last_peered":"2023-07-27T14:32:22.311203+0000","last_clean":"2023-07-27T14:32:22.311203+0000","last_became_active":"2023-07-27T14:32:21.859687+0000","last_became_peered":"2023-07-27T14:32:21.859687+0000","last_unstale":"2023-07-27T14:32:22.311203+0000","last_undegraded":"2023-07-27T14:32:22.311203+0000","last_fullsized":"2023-07-27T14:32:22.311203+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.318841+0000","last_change":"2023-07-27T14:32:22.318841+0000","last_active":"2023-07-27T14:32:22.318841+0000","last_peered":"2023-07-27T14:32:22.318841+0000","last_clean":"2023-07-27T14:32:22.318841+0000","last_became_active":"2023-07-27T14:32:22.318504+0000","last_became_peered":"2023-07-27T14:32:22.318504+0000","last_unstale":"2023-07-27T14:32:22.318841+0000","last_undegraded":"2023-07-27T14:32:22.318841+0000","last_fullsized":"2023-07-27T14:32:22.318841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305701+0000","last_change":"2023-07-27T14:32:21.859040+0000","last_active":"2023-07-27T14:32:22.305701+0000","last_peered":"2023-07-27T14:32:22.305701+0000","last_clean":"2023-07-27T14:32:22.305701+0000","last_became_active":"2023-07-27T14:32:21.858660+0000","last_became_peered":"2023-07-27T14:32:21.858660+0000","last_unstale":"2023-07-27T14:32:22.305701+0000","last_undegraded":"2023-07-27T14:32:22.305701+0000","last_fullsized":"2023-07-27T14:32:22.305701+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.333366+0000","last_change":"2023-07-27T14:32:22.329188+0000","last_active":"2023-07-27T14:32:22.333366+0000","last_peered":"2023-07-27T14:32:22.333366+0000","last_clean":"2023-07-27T14:32:22.333366+0000","last_became_active":"2023-07-27T14:32:22.328709+0000","last_became_peered":"2023-07-27T14:32:22.328709+0000","last_unstale":"2023-07-27T14:32:22.333366+0000","last_undegraded":"2023-07-27T14:32:22.333366+0000","last_fullsized":"2023-07-27T14:32:22.333366+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305020+0000","last_change":"2023-07-27T14:32:21.863667+0000","last_active":"2023-07-27T14:32:22.305020+0000","last_peered":"2023-07-27T14:32:22.305020+0000","last_clean":"2023-07-27T14:32:22.305020+0000","last_became_active":"2023-07-27T14:32:21.863401+0000","last_became_peered":"2023-07-27T14:32:21.863401+0000","last_unstale":"2023-07-27T14:32:22.305020+0000","last_undegraded":"2023-07-27T14:32:22.305020+0000","last_fullsized":"2023-07-27T14:32:22.305020+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.319481+0000","last_change":"2023-07-27T14:32:22.319481+0000","last_active":"2023-07-27T14:32:22.319481+0000","last_peered":"2023-07-27T14:32:22.319481+0000","last_clean":"2023-07-27T14:32:22.319481+0000","last_became_active":"2023-07-27T14:32:22.319158+0000","last_became_peered":"2023-07-27T14:32:22.319158+0000","last_unstale":"2023-07-27T14:32:22.319481+0000","last_undegraded":"2023-07-27T14:32:22.319481+0000","last_fullsized":"2023-07-27T14:32:22.319481+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.862910+0000","last_change":"2023-07-27T14:32:21.856929+0000","last_active":"2023-07-27T14:32:21.862910+0000","last_peered":"2023-07-27T14:32:21.862910+0000","last_clean":"2023-07-27T14:32:21.862910+0000","last_became_active":"2023-07-27T14:32:21.856658+0000","last_became_peered":"2023-07-27T14:32:21.856658+0000","last_unstale":"2023-07-27T14:32:21.862910+0000","last_undegraded":"2023-07-27T14:32:21.862910+0000","last_fullsized":"2023-07-27T14:32:21.862910+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330148+0000","last_change":"2023-07-27T14:32:22.328017+0000","last_active":"2023-07-27T14:32:22.330148+0000","last_peered":"2023-07-27T14:32:22.330148+0000","last_clean":"2023-07-27T14:32:22.330148+0000","last_became_active":"2023-07-27T14:32:22.327626+0000","last_became_peered":"2023-07-27T14:32:22.327626+0000","last_unstale":"2023-07-27T14:32:22.330148+0000","last_undegraded":"2023-07-27T14:32:22.330148+0000","last_fullsized":"2023-07-27T14:32:22.330148+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317565+0000","last_change":"2023-07-27T14:32:21.861832+0000","last_active":"2023-07-27T14:32:22.317565+0000","last_peered":"2023-07-27T14:32:22.317565+0000","last_clean":"2023-07-27T14:32:22.317565+0000","last_became_active":"2023-07-27T14:32:21.861546+0000","last_became_peered":"2023-07-27T14:32:21.861546+0000","last_unstale":"2023-07-27T14:32:22.317565+0000","last_undegraded":"2023-07-27T14:32:22.317565+0000","last_fullsized":"2023-07-27T14:32:22.317565+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.319602+0000","last_change":"2023-07-27T14:32:22.319602+0000","last_active":"2023-07-27T14:32:22.319602+0000","last_peered":"2023-07-27T14:32:22.319602+0000","last_clean":"2023-07-27T14:32:22.319602+0000","last_became_active":"2023-07-27T14:32:22.319344+0000","last_became_peered":"2023-07-27T14:32:22.319344+0000","last_unstale":"2023-07-27T14:32:22.319602+0000","last_undegraded":"2023-07-27T14:32:22.319602+0000","last_fullsized":"2023-07-27T14:32:22.319602+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"99'4","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.335077+0000","last_change":"2023-07-27T14:32:21.853722+0000","last_active":"2023-07-27T14:32:22.335077+0000","last_peered":"2023-07-27T14:32:22.335077+0000","last_clean":"2023-07-27T14:32:22.335077+0000","last_became_active":"2023-07-27T14:32:21.853432+0000","last_became_peered":"2023-07-27T14:32:21.853432+0000","last_unstale":"2023-07-27T14:32:22.335077+0000","last_undegraded":"2023-07-27T14:32:22.335077+0000","last_fullsized":"2023-07-27T14:32:22.335077+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332286+0000","last_change":"2023-07-27T14:32:22.325355+0000","last_active":"2023-07-27T14:32:22.332286+0000","last_peered":"2023-07-27T14:32:22.332286+0000","last_clean":"2023-07-27T14:32:22.332286+0000","last_became_active":"2023-07-27T14:32:22.324949+0000","last_became_peered":"2023-07-27T14:32:22.324949+0000","last_unstale":"2023-07-27T14:32:22.332286+0000","last_undegraded":"2023-07-27T14:32:22.332286+0000","last_fullsized":"2023-07-27T14:32:22.332286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.314464+0000","last_change":"2023-07-27T14:32:21.862959+0000","last_active":"2023-07-27T14:32:22.314464+0000","last_peered":"2023-07-27T14:32:22.314464+0000","last_clean":"2023-07-27T14:32:22.314464+0000","last_became_active":"2023-07-27T14:32:21.862647+0000","last_became_peered":"2023-07-27T14:32:21.862647+0000","last_unstale":"2023-07-27T14:32:22.314464+0000","last_undegraded":"2023-07-27T14:32:22.314464+0000","last_fullsized":"2023-07-27T14:32:22.314464+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332139+0000","last_change":"2023-07-27T14:32:22.323020+0000","last_active":"2023-07-27T14:32:22.332139+0000","last_peered":"2023-07-27T14:32:22.332139+0000","last_clean":"2023-07-27T14:32:22.332139+0000","last_became_active":"2023-07-27T14:32:22.322735+0000","last_became_peered":"2023-07-27T14:32:22.322735+0000","last_unstale":"2023-07-27T14:32:22.332139+0000","last_undegraded":"2023-07-27T14:32:22.332139+0000","last_fullsized":"2023-07-27T14:32:22.332139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313570+0000","last_change":"2023-07-27T14:32:21.865060+0000","last_active":"2023-07-27T14:32:22.313570+0000","last_peered":"2023-07-27T14:32:22.313570+0000","last_clean":"2023-07-27T14:32:22.313570+0000","last_became_active":"2023-07-27T14:32:21.864508+0000","last_became_peered":"2023-07-27T14:32:21.864508+0000","last_unstale":"2023-07-27T14:32:22.313570+0000","last_undegraded":"2023-07-27T14:32:22.313570+0000","last_fullsized":"2023-07-27T14:32:22.313570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327882+0000","last_change":"2023-07-27T14:32:22.327882+0000","last_active":"2023-07-27T14:32:22.327882+0000","last_peered":"2023-07-27T14:32:22.327882+0000","last_clean":"2023-07-27T14:32:22.327882+0000","last_became_active":"2023-07-27T14:32:22.327593+0000","last_became_peered":"2023-07-27T14:32:22.327593+0000","last_unstale":"2023-07-27T14:32:22.327882+0000","last_undegraded":"2023-07-27T14:32:22.327882+0000","last_fullsized":"2023-07-27T14:32:22.327882+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.301682+0000","last_change":"2023-07-27T14:32:21.859236+0000","last_active":"2023-07-27T14:32:22.301682+0000","last_peered":"2023-07-27T14:32:22.301682+0000","last_clean":"2023-07-27T14:32:22.301682+0000","last_became_active":"2023-07-27T14:32:21.858946+0000","last_became_peered":"2023-07-27T14:32:21.858946+0000","last_unstale":"2023-07-27T14:32:22.301682+0000","last_undegraded":"2023-07-27T14:32:22.301682+0000","last_fullsized":"2023-07-27T14:32:22.301682+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334781+0000","last_change":"2023-07-27T14:32:22.328061+0000","last_active":"2023-07-27T14:32:22.334781+0000","last_peered":"2023-07-27T14:32:22.334781+0000","last_clean":"2023-07-27T14:32:22.334781+0000","last_became_active":"2023-07-27T14:32:22.327809+0000","last_became_peered":"2023-07-27T14:32:22.327809+0000","last_unstale":"2023-07-27T14:32:22.334781+0000","last_undegraded":"2023-07-27T14:32:22.334781+0000","last_fullsized":"2023-07-27T14:32:22.334781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"99'4","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330004+0000","last_change":"2023-07-27T14:32:21.857321+0000","last_active":"2023-07-27T14:32:22.330004+0000","last_peered":"2023-07-27T14:32:22.330004+0000","last_clean":"2023-07-27T14:32:22.330004+0000","last_became_active":"2023-07-27T14:32:21.857058+0000","last_became_peered":"2023-07-27T14:32:21.857058+0000","last_unstale":"2023-07-27T14:32:22.330004+0000","last_undegraded":"2023-07-27T14:32:22.330004+0000","last_fullsized":"2023-07-27T14:32:22.330004+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334881+0000","last_change":"2023-07-27T14:32:22.328666+0000","last_active":"2023-07-27T14:32:22.334881+0000","last_peered":"2023-07-27T14:32:22.334881+0000","last_clean":"2023-07-27T14:32:22.334881+0000","last_became_active":"2023-07-27T14:32:22.328421+0000","last_became_peered":"2023-07-27T14:32:22.328421+0000","last_unstale":"2023-07-27T14:32:22.334881+0000","last_undegraded":"2023-07-27T14:32:22.334881+0000","last_fullsized":"2023-07-27T14:32:22.334881+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.873914+0000","last_change":"2023-07-27T14:32:21.870175+0000","last_active":"2023-07-27T14:32:21.873914+0000","last_peered":"2023-07-27T14:32:21.873914+0000","last_clean":"2023-07-27T14:32:21.873914+0000","last_became_active":"2023-07-27T14:32:21.869880+0000","last_became_peered":"2023-07-27T14:32:21.869880+0000","last_unstale":"2023-07-27T14:32:21.873914+0000","last_undegraded":"2023-07-27T14:32:21.873914+0000","last_fullsized":"2023-07-27T14:32:21.873914+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328585+0000","last_change":"2023-07-27T14:32:22.328585+0000","last_active":"2023-07-27T14:32:22.328585+0000","last_peered":"2023-07-27T14:32:22.328585+0000","last_clean":"2023-07-27T14:32:22.328585+0000","last_became_active":"2023-07-27T14:32:22.327226+0000","last_became_peered":"2023-07-27T14:32:22.327226+0000","last_unstale":"2023-07-27T14:32:22.328585+0000","last_undegraded":"2023-07-27T14:32:22.328585+0000","last_fullsized":"2023-07-27T14:32:22.328585+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313569+0000","last_change":"2023-07-27T14:32:21.869897+0000","last_active":"2023-07-27T14:32:22.313569+0000","last_peered":"2023-07-27T14:32:22.313569+0000","last_clean":"2023-07-27T14:32:22.313569+0000","last_became_active":"2023-07-27T14:32:21.869600+0000","last_became_peered":"2023-07-27T14:32:21.869600+0000","last_unstale":"2023-07-27T14:32:22.313569+0000","last_undegraded":"2023-07-27T14:32:22.313569+0000","last_fullsized":"2023-07-27T14:32:22.313569+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322949+0000","last_change":"2023-07-27T14:32:22.316102+0000","last_active":"2023-07-27T14:32:22.322949+0000","last_peered":"2023-07-27T14:32:22.322949+0000","last_clean":"2023-07-27T14:32:22.322949+0000","last_became_active":"2023-07-27T14:32:22.315847+0000","last_became_peered":"2023-07-27T14:32:22.315847+0000","last_unstale":"2023-07-27T14:32:22.322949+0000","last_undegraded":"2023-07-27T14:32:22.322949+0000","last_fullsized":"2023-07-27T14:32:22.322949+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.323648+0000","last_change":"2023-07-27T14:32:21.858912+0000","last_active":"2023-07-27T14:32:22.323648+0000","last_peered":"2023-07-27T14:32:22.323648+0000","last_clean":"2023-07-27T14:32:22.323648+0000","last_became_active":"2023-07-27T14:32:21.855292+0000","last_became_peered":"2023-07-27T14:32:21.855292+0000","last_unstale":"2023-07-27T14:32:22.323648+0000","last_undegraded":"2023-07-27T14:32:22.323648+0000","last_fullsized":"2023-07-27T14:32:22.323648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332322+0000","last_change":"2023-07-27T14:32:22.324388+0000","last_active":"2023-07-27T14:32:22.332322+0000","last_peered":"2023-07-27T14:32:22.332322+0000","last_clean":"2023-07-27T14:32:22.332322+0000","last_became_active":"2023-07-27T14:32:22.323104+0000","last_became_peered":"2023-07-27T14:32:22.323104+0000","last_unstale":"2023-07-27T14:32:22.332322+0000","last_undegraded":"2023-07-27T14:32:22.332322+0000","last_fullsized":"2023-07-27T14:32:22.332322+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.314174+0000","last_change":"2023-07-27T14:32:21.863858+0000","last_active":"2023-07-27T14:32:22.314174+0000","last_peered":"2023-07-27T14:32:22.314174+0000","last_clean":"2023-07-27T14:32:22.314174+0000","last_became_active":"2023-07-27T14:32:21.863600+0000","last_became_peered":"2023-07-27T14:32:21.863600+0000","last_unstale":"2023-07-27T14:32:22.314174+0000","last_undegraded":"2023-07-27T14:32:22.314174+0000","last_fullsized":"2023-07-27T14:32:22.314174+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.321460+0000","last_change":"2023-07-27T14:32:22.316498+0000","last_active":"2023-07-27T14:32:22.321460+0000","last_peered":"2023-07-27T14:32:22.321460+0000","last_clean":"2023-07-27T14:32:22.321460+0000","last_became_active":"2023-07-27T14:32:22.315699+0000","last_became_peered":"2023-07-27T14:32:22.315699+0000","last_unstale":"2023-07-27T14:32:22.321460+0000","last_undegraded":"2023-07-27T14:32:22.321460+0000","last_fullsized":"2023-07-27T14:32:22.321460+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327597+0000","last_change":"2023-07-27T14:32:21.866805+0000","last_active":"2023-07-27T14:32:22.327597+0000","last_peered":"2023-07-27T14:32:22.327597+0000","last_clean":"2023-07-27T14:32:22.327597+0000","last_became_active":"2023-07-27T14:32:21.866508+0000","last_became_peered":"2023-07-27T14:32:21.866508+0000","last_unstale":"2023-07-27T14:32:22.327597+0000","last_undegraded":"2023-07-27T14:32:22.327597+0000","last_fullsized":"2023-07-27T14:32:22.327597+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326762+0000","last_change":"2023-07-27T14:32:22.326762+0000","last_active":"2023-07-27T14:32:22.326762+0000","last_peered":"2023-07-27T14:32:22.326762+0000","last_clean":"2023-07-27T14:32:22.326762+0000","last_became_active":"2023-07-27T14:32:22.326279+0000","last_became_peered":"2023-07-27T14:32:22.326279+0000","last_unstale":"2023-07-27T14:32:22.326762+0000","last_undegraded":"2023-07-27T14:32:22.326762+0000","last_fullsized":"2023-07-27T14:32:22.326762+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317796+0000","last_change":"2023-07-27T14:32:21.864391+0000","last_active":"2023-07-27T14:32:22.317796+0000","last_peered":"2023-07-27T14:32:22.317796+0000","last_clean":"2023-07-27T14:32:22.317796+0000","last_became_active":"2023-07-27T14:32:21.863866+0000","last_became_peered":"2023-07-27T14:32:21.863866+0000","last_unstale":"2023-07-27T14:32:22.317796+0000","last_undegraded":"2023-07-27T14:32:22.317796+0000","last_fullsized":"2023-07-27T14:32:22.317796+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327669+0000","last_change":"2023-07-27T14:32:22.327669+0000","last_active":"2023-07-27T14:32:22.327669+0000","last_peered":"2023-07-27T14:32:22.327669+0000","last_clean":"2023-07-27T14:32:22.327669+0000","last_became_active":"2023-07-27T14:32:22.327350+0000","last_became_peered":"2023-07-27T14:32:22.327350+0000","last_unstale":"2023-07-27T14:32:22.327669+0000","last_undegraded":"2023-07-27T14:32:22.327669+0000","last_fullsized":"2023-07-27T14:32:22.327669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866269+0000","last_change":"2023-07-27T14:32:21.864070+0000","last_active":"2023-07-27T14:32:21.866269+0000","last_peered":"2023-07-27T14:32:21.866269+0000","last_clean":"2023-07-27T14:32:21.866269+0000","last_became_active":"2023-07-27T14:32:21.863794+0000","last_became_peered":"2023-07-27T14:32:21.863794+0000","last_unstale":"2023-07-27T14:32:21.866269+0000","last_undegraded":"2023-07-27T14:32:21.866269+0000","last_fullsized":"2023-07-27T14:32:21.866269+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.316468+0000","last_change":"2023-07-27T14:32:22.316468+0000","last_active":"2023-07-27T14:32:22.316468+0000","last_peered":"2023-07-27T14:32:22.316468+0000","last_clean":"2023-07-27T14:32:22.316468+0000","last_became_active":"2023-07-27T14:32:22.316146+0000","last_became_peered":"2023-07-27T14:32:22.316146+0000","last_unstale":"2023-07-27T14:32:22.316468+0000","last_undegraded":"2023-07-27T14:32:22.316468+0000","last_fullsized":"2023-07-27T14:32:22.316468+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.311388+0000","last_change":"2023-07-27T14:32:21.864783+0000","last_active":"2023-07-27T14:32:22.311388+0000","last_peered":"2023-07-27T14:32:22.311388+0000","last_clean":"2023-07-27T14:32:22.311388+0000","last_became_active":"2023-07-27T14:32:21.864206+0000","last_became_peered":"2023-07-27T14:32:21.864206+0000","last_unstale":"2023-07-27T14:32:22.311388+0000","last_undegraded":"2023-07-27T14:32:22.311388+0000","last_fullsized":"2023-07-27T14:32:22.311388+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332099+0000","last_change":"2023-07-27T14:32:22.323849+0000","last_active":"2023-07-27T14:32:22.332099+0000","last_peered":"2023-07-27T14:32:22.332099+0000","last_clean":"2023-07-27T14:32:22.332099+0000","last_became_active":"2023-07-27T14:32:22.323584+0000","last_became_peered":"2023-07-27T14:32:22.323584+0000","last_unstale":"2023-07-27T14:32:22.332099+0000","last_undegraded":"2023-07-27T14:32:22.332099+0000","last_fullsized":"2023-07-27T14:32:22.332099+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317901+0000","last_change":"2023-07-27T14:32:21.854001+0000","last_active":"2023-07-27T14:32:22.317901+0000","last_peered":"2023-07-27T14:32:22.317901+0000","last_clean":"2023-07-27T14:32:22.317901+0000","last_became_active":"2023-07-27T14:32:21.853736+0000","last_became_peered":"2023-07-27T14:32:21.853736+0000","last_unstale":"2023-07-27T14:32:22.317901+0000","last_undegraded":"2023-07-27T14:32:22.317901+0000","last_fullsized":"2023-07-27T14:32:22.317901+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325685+0000","last_change":"2023-07-27T14:32:22.322273+0000","last_active":"2023-07-27T14:32:22.325685+0000","last_peered":"2023-07-27T14:32:22.325685+0000","last_clean":"2023-07-27T14:32:22.325685+0000","last_became_active":"2023-07-27T14:32:22.321933+0000","last_became_peered":"2023-07-27T14:32:22.321933+0000","last_unstale":"2023-07-27T14:32:22.325685+0000","last_undegraded":"2023-07-27T14:32:22.325685+0000","last_fullsized":"2023-07-27T14:32:22.325685+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.865609+0000","last_change":"2023-07-27T14:32:21.859370+0000","last_active":"2023-07-27T14:32:21.865609+0000","last_peered":"2023-07-27T14:32:21.865609+0000","last_clean":"2023-07-27T14:32:21.865609+0000","last_became_active":"2023-07-27T14:32:21.858665+0000","last_became_peered":"2023-07-27T14:32:21.858665+0000","last_unstale":"2023-07-27T14:32:21.865609+0000","last_undegraded":"2023-07-27T14:32:21.865609+0000","last_fullsized":"2023-07-27T14:32:21.865609+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322883+0000","last_change":"2023-07-27T14:32:22.322883+0000","last_active":"2023-07-27T14:32:22.322883+0000","last_peered":"2023-07-27T14:32:22.322883+0000","last_clean":"2023-07-27T14:32:22.322883+0000","last_became_active":"2023-07-27T14:32:22.322526+0000","last_became_peered":"2023-07-27T14:32:22.322526+0000","last_unstale":"2023-07-27T14:32:22.322883+0000","last_undegraded":"2023-07-27T14:32:22.322883+0000","last_fullsized":"2023-07-27T14:32:22.322883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866356+0000","last_change":"2023-07-27T14:32:21.859036+0000","last_active":"2023-07-27T14:32:21.866356+0000","last_peered":"2023-07-27T14:32:21.866356+0000","last_clean":"2023-07-27T14:32:21.866356+0000","last_became_active":"2023-07-27T14:32:21.858767+0000","last_became_peered":"2023-07-27T14:32:21.858767+0000","last_unstale":"2023-07-27T14:32:21.866356+0000","last_undegraded":"2023-07-27T14:32:21.866356+0000","last_fullsized":"2023-07-27T14:32:21.866356+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.318892+0000","last_change":"2023-07-27T14:32:22.318018+0000","last_active":"2023-07-27T14:32:22.318892+0000","last_peered":"2023-07-27T14:32:22.318892+0000","last_clean":"2023-07-27T14:32:22.318892+0000","last_became_active":"2023-07-27T14:32:22.317695+0000","last_became_peered":"2023-07-27T14:32:22.317695+0000","last_unstale":"2023-07-27T14:32:22.318892+0000","last_undegraded":"2023-07-27T14:32:22.318892+0000","last_fullsized":"2023-07-27T14:32:22.318892+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.865295+0000","last_change":"2023-07-27T14:32:21.860498+0000","last_active":"2023-07-27T14:32:21.865295+0000","last_peered":"2023-07-27T14:32:21.865295+0000","last_clean":"2023-07-27T14:32:21.865295+0000","last_became_active":"2023-07-27T14:32:21.859871+0000","last_became_peered":"2023-07-27T14:32:21.859871+0000","last_unstale":"2023-07-27T14:32:21.865295+0000","last_undegraded":"2023-07-27T14:32:21.865295+0000","last_fullsized":"2023-07-27T14:32:21.865295+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332268+0000","last_change":"2023-07-27T14:32:22.325196+0000","last_active":"2023-07-27T14:32:22.332268+0000","last_peered":"2023-07-27T14:32:22.332268+0000","last_clean":"2023-07-27T14:32:22.332268+0000","last_became_active":"2023-07-27T14:32:22.324625+0000","last_became_peered":"2023-07-27T14:32:22.324625+0000","last_unstale":"2023-07-27T14:32:22.332268+0000","last_undegraded":"2023-07-27T14:32:22.332268+0000","last_fullsized":"2023-07-27T14:32:22.332268+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317659+0000","last_change":"2023-07-27T14:32:21.860793+0000","last_active":"2023-07-27T14:32:22.317659+0000","last_peered":"2023-07-27T14:32:22.317659+0000","last_clean":"2023-07-27T14:32:22.317659+0000","last_became_active":"2023-07-27T14:32:21.860306+0000","last_became_peered":"2023-07-27T14:32:21.860306+0000","last_unstale":"2023-07-27T14:32:22.317659+0000","last_undegraded":"2023-07-27T14:32:22.317659+0000","last_fullsized":"2023-07-27T14:32:22.317659+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326503+0000","last_change":"2023-07-27T14:32:22.324342+0000","last_active":"2023-07-27T14:32:22.326503+0000","last_peered":"2023-07-27T14:32:22.326503+0000","last_clean":"2023-07-27T14:32:22.326503+0000","last_became_active":"2023-07-27T14:32:22.324014+0000","last_became_peered":"2023-07-27T14:32:22.324014+0000","last_unstale":"2023-07-27T14:32:22.326503+0000","last_undegraded":"2023-07-27T14:32:22.326503+0000","last_fullsized":"2023-07-27T14:32:22.326503+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317894+0000","last_change":"2023-07-27T14:32:21.862504+0000","last_active":"2023-07-27T14:32:22.317894+0000","last_peered":"2023-07-27T14:32:22.317894+0000","last_clean":"2023-07-27T14:32:22.317894+0000","last_became_active":"2023-07-27T14:32:21.862042+0000","last_became_peered":"2023-07-27T14:32:21.862042+0000","last_unstale":"2023-07-27T14:32:22.317894+0000","last_undegraded":"2023-07-27T14:32:22.317894+0000","last_fullsized":"2023-07-27T14:32:22.317894+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313166+0000","last_change":"2023-07-27T14:32:22.313166+0000","last_active":"2023-07-27T14:32:22.313166+0000","last_peered":"2023-07-27T14:32:22.313166+0000","last_clean":"2023-07-27T14:32:22.313166+0000","last_became_active":"2023-07-27T14:32:22.312847+0000","last_became_peered":"2023-07-27T14:32:22.312847+0000","last_unstale":"2023-07-27T14:32:22.313166+0000","last_undegraded":"2023-07-27T14:32:22.313166+0000","last_fullsized":"2023-07-27T14:32:22.313166+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.860220+0000","last_change":"2023-07-27T14:32:21.856311+0000","last_active":"2023-07-27T14:32:21.860220+0000","last_peered":"2023-07-27T14:32:21.860220+0000","last_clean":"2023-07-27T14:32:21.860220+0000","last_became_active":"2023-07-27T14:32:21.856046+0000","last_became_peered":"2023-07-27T14:32:21.856046+0000","last_unstale":"2023-07-27T14:32:21.860220+0000","last_undegraded":"2023-07-27T14:32:21.860220+0000","last_fullsized":"2023-07-27T14:32:21.860220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.329557+0000","last_change":"2023-07-27T14:32:22.329557+0000","last_active":"2023-07-27T14:32:22.329557+0000","last_peered":"2023-07-27T14:32:22.329557+0000","last_clean":"2023-07-27T14:32:22.329557+0000","last_became_active":"2023-07-27T14:32:22.329158+0000","last_became_peered":"2023-07-27T14:32:22.329158+0000","last_unstale":"2023-07-27T14:32:22.329557+0000","last_undegraded":"2023-07-27T14:32:22.329557+0000","last_fullsized":"2023-07-27T14:32:22.329557+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866214+0000","last_change":"2023-07-27T14:32:21.863680+0000","last_active":"2023-07-27T14:32:21.866214+0000","last_peered":"2023-07-27T14:32:21.866214+0000","last_clean":"2023-07-27T14:32:21.866214+0000","last_became_active":"2023-07-27T14:32:21.863401+0000","last_became_peered":"2023-07-27T14:32:21.863401+0000","last_unstale":"2023-07-27T14:32:21.866214+0000","last_undegraded":"2023-07-27T14:32:21.866214+0000","last_fullsized":"2023-07-27T14:32:21.866214+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322908+0000","last_change":"2023-07-27T14:32:22.312687+0000","last_active":"2023-07-27T14:32:22.322908+0000","last_peered":"2023-07-27T14:32:22.322908+0000","last_clean":"2023-07-27T14:32:22.322908+0000","last_became_active":"2023-07-27T14:32:22.312445+0000","last_became_peered":"2023-07-27T14:32:22.312445+0000","last_unstale":"2023-07-27T14:32:22.322908+0000","last_undegraded":"2023-07-27T14:32:22.322908+0000","last_fullsized":"2023-07-27T14:32:22.322908+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.311004+0000","last_change":"2023-07-27T14:32:21.864546+0000","last_active":"2023-07-27T14:32:22.311004+0000","last_peered":"2023-07-27T14:32:22.311004+0000","last_clean":"2023-07-27T14:32:22.311004+0000","last_became_active":"2023-07-27T14:32:21.864180+0000","last_became_peered":"2023-07-27T14:32:21.864180+0000","last_unstale":"2023-07-27T14:32:22.311004+0000","last_undegraded":"2023-07-27T14:32:22.311004+0000","last_fullsized":"2023-07-27T14:32:22.311004+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334605+0000","last_change":"2023-07-27T14:32:22.329450+0000","last_active":"2023-07-27T14:32:22.334605+0000","last_peered":"2023-07-27T14:32:22.334605+0000","last_clean":"2023-07-27T14:32:22.334605+0000","last_became_active":"2023-07-27T14:32:22.329204+0000","last_became_peered":"2023-07-27T14:32:22.329204+0000","last_unstale":"2023-07-27T14:32:22.334605+0000","last_undegraded":"2023-07-27T14:32:22.334605+0000","last_fullsized":"2023-07-27T14:32:22.334605+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.309238+0000","last_change":"2023-07-27T14:32:21.861282+0000","last_active":"2023-07-27T14:32:22.309238+0000","last_peered":"2023-07-27T14:32:22.309238+0000","last_clean":"2023-07-27T14:32:22.309238+0000","last_became_active":"2023-07-27T14:32:21.860855+0000","last_became_peered":"2023-07-27T14:32:21.860855+0000","last_unstale":"2023-07-27T14:32:22.309238+0000","last_undegraded":"2023-07-27T14:32:22.309238+0000","last_fullsized":"2023-07-27T14:32:22.309238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322982+0000","last_change":"2023-07-27T14:32:22.322982+0000","last_active":"2023-07-27T14:32:22.322982+0000","last_peered":"2023-07-27T14:32:22.322982+0000","last_clean":"2023-07-27T14:32:22.322982+0000","last_became_active":"2023-07-27T14:32:22.322647+0000","last_became_peered":"2023-07-27T14:32:22.322647+0000","last_unstale":"2023-07-27T14:32:22.322982+0000","last_undegraded":"2023-07-27T14:32:22.322982+0000","last_fullsized":"2023-07-27T14:32:22.322982+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"99'2","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328565+0000","last_change":"2023-07-27T14:32:21.866007+0000","last_active":"2023-07-27T14:32:22.328565+0000","last_peered":"2023-07-27T14:32:22.328565+0000","last_clean":"2023-07-27T14:32:22.328565+0000","last_became_active":"2023-07-27T14:32:21.865679+0000","last_became_peered":"2023-07-27T14:32:21.865679+0000","last_unstale":"2023-07-27T14:32:22.328565+0000","last_undegraded":"2023-07-27T14:32:22.328565+0000","last_fullsized":"2023-07-27T14:32:22.328565+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.323528+0000","last_change":"2023-07-27T14:32:22.318537+0000","last_active":"2023-07-27T14:32:22.323528+0000","last_peered":"2023-07-27T14:32:22.323528+0000","last_clean":"2023-07-27T14:32:22.323528+0000","last_became_active":"2023-07-27T14:32:22.318289+0000","last_became_peered":"2023-07-27T14:32:22.318289+0000","last_unstale":"2023-07-27T14:32:22.323528+0000","last_undegraded":"2023-07-27T14:32:22.323528+0000","last_fullsized":"2023-07-27T14:32:22.323528+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.865218+0000","last_change":"2023-07-27T14:32:21.859349+0000","last_active":"2023-07-27T14:32:21.865218+0000","last_peered":"2023-07-27T14:32:21.865218+0000","last_clean":"2023-07-27T14:32:21.865218+0000","last_became_active":"2023-07-27T14:32:21.859083+0000","last_became_peered":"2023-07-27T14:32:21.859083+0000","last_unstale":"2023-07-27T14:32:21.865218+0000","last_undegraded":"2023-07-27T14:32:21.865218+0000","last_fullsized":"2023-07-27T14:32:21.865218+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334691+0000","last_change":"2023-07-27T14:32:22.324839+0000","last_active":"2023-07-27T14:32:22.334691+0000","last_peered":"2023-07-27T14:32:22.334691+0000","last_clean":"2023-07-27T14:32:22.334691+0000","last_became_active":"2023-07-27T14:32:22.324391+0000","last_became_peered":"2023-07-27T14:32:22.324391+0000","last_unstale":"2023-07-27T14:32:22.334691+0000","last_undegraded":"2023-07-27T14:32:22.334691+0000","last_fullsized":"2023-07-27T14:32:22.334691+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.873920+0000","last_change":"2023-07-27T14:32:21.870237+0000","last_active":"2023-07-27T14:32:21.873920+0000","last_peered":"2023-07-27T14:32:21.873920+0000","last_clean":"2023-07-27T14:32:21.873920+0000","last_became_active":"2023-07-27T14:32:21.869941+0000","last_became_peered":"2023-07-27T14:32:21.869941+0000","last_unstale":"2023-07-27T14:32:21.873920+0000","last_undegraded":"2023-07-27T14:32:21.873920+0000","last_fullsized":"2023-07-27T14:32:21.873920+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326568+0000","last_change":"2023-07-27T14:32:22.326568+0000","last_active":"2023-07-27T14:32:22.326568+0000","last_peered":"2023-07-27T14:32:22.326568+0000","last_clean":"2023-07-27T14:32:22.326568+0000","last_became_active":"2023-07-27T14:32:22.325856+0000","last_became_peered":"2023-07-27T14:32:22.325856+0000","last_unstale":"2023-07-27T14:32:22.326568+0000","last_undegraded":"2023-07-27T14:32:22.326568+0000","last_fullsized":"2023-07-27T14:32:22.326568+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317993+0000","last_change":"2023-07-27T14:32:21.868762+0000","last_active":"2023-07-27T14:32:22.317993+0000","last_peered":"2023-07-27T14:32:22.317993+0000","last_clean":"2023-07-27T14:32:22.317993+0000","last_became_active":"2023-07-27T14:32:21.866858+0000","last_became_peered":"2023-07-27T14:32:21.866858+0000","last_unstale":"2023-07-27T14:32:22.317993+0000","last_undegraded":"2023-07-27T14:32:22.317993+0000","last_fullsized":"2023-07-27T14:32:22.317993+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.324187+0000","last_change":"2023-07-27T14:32:22.319458+0000","last_active":"2023-07-27T14:32:22.324187+0000","last_peered":"2023-07-27T14:32:22.324187+0000","last_clean":"2023-07-27T14:32:22.324187+0000","last_became_active":"2023-07-27T14:32:22.319209+0000","last_became_peered":"2023-07-27T14:32:22.319209+0000","last_unstale":"2023-07-27T14:32:22.324187+0000","last_undegraded":"2023-07-27T14:32:22.324187+0000","last_fullsized":"2023-07-27T14:32:22.324187+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.301780+0000","last_change":"2023-07-27T14:32:21.857070+0000","last_active":"2023-07-27T14:32:22.301780+0000","last_peered":"2023-07-27T14:32:22.301780+0000","last_clean":"2023-07-27T14:32:22.301780+0000","last_became_active":"2023-07-27T14:32:21.856813+0000","last_became_peered":"2023-07-27T14:32:21.856813+0000","last_unstale":"2023-07-27T14:32:22.301780+0000","last_undegraded":"2023-07-27T14:32:22.301780+0000","last_fullsized":"2023-07-27T14:32:22.301780+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325148+0000","last_change":"2023-07-27T14:32:22.319742+0000","last_active":"2023-07-27T14:32:22.325148+0000","last_peered":"2023-07-27T14:32:22.325148+0000","last_clean":"2023-07-27T14:32:22.325148+0000","last_became_active":"2023-07-27T14:32:22.318523+0000","last_became_peered":"2023-07-27T14:32:22.318523+0000","last_unstale":"2023-07-27T14:32:22.325148+0000","last_undegraded":"2023-07-27T14:32:22.325148+0000","last_fullsized":"2023-07-27T14:32:22.325148+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866947+0000","last_change":"2023-07-27T14:32:21.863998+0000","last_active":"2023-07-27T14:32:21.866947+0000","last_peered":"2023-07-27T14:32:21.866947+0000","last_clean":"2023-07-27T14:32:21.866947+0000","last_became_active":"2023-07-27T14:32:21.863525+0000","last_became_peered":"2023-07-27T14:32:21.863525+0000","last_unstale":"2023-07-27T14:32:21.866947+0000","last_undegraded":"2023-07-27T14:32:21.866947+0000","last_fullsized":"2023-07-27T14:32:21.866947+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325103+0000","last_change":"2023-07-27T14:32:22.325103+0000","last_active":"2023-07-27T14:32:22.325103+0000","last_peered":"2023-07-27T14:32:22.325103+0000","last_clean":"2023-07-27T14:32:22.325103+0000","last_became_active":"2023-07-27T14:32:22.324624+0000","last_became_peered":"2023-07-27T14:32:22.324624+0000","last_unstale":"2023-07-27T14:32:22.325103+0000","last_undegraded":"2023-07-27T14:32:22.325103+0000","last_fullsized":"2023-07-27T14:32:22.325103+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305118+0000","last_change":"2023-07-27T14:32:21.866143+0000","last_active":"2023-07-27T14:32:22.305118+0000","last_peered":"2023-07-27T14:32:22.305118+0000","last_clean":"2023-07-27T14:32:22.305118+0000","last_became_active":"2023-07-27T14:32:21.865841+0000","last_became_peered":"2023-07-27T14:32:21.865841+0000","last_unstale":"2023-07-27T14:32:22.305118+0000","last_undegraded":"2023-07-27T14:32:22.305118+0000","last_fullsized":"2023-07-27T14:32:22.305118+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.331669+0000","last_change":"2023-07-27T14:32:22.331669+0000","last_active":"2023-07-27T14:32:22.331669+0000","last_peered":"2023-07-27T14:32:22.331669+0000","last_clean":"2023-07-27T14:32:22.331669+0000","last_became_active":"2023-07-27T14:32:22.331356+0000","last_became_peered":"2023-07-27T14:32:22.331356+0000","last_unstale":"2023-07-27T14:32:22.331669+0000","last_undegraded":"2023-07-27T14:32:22.331669+0000","last_fullsized":"2023-07-27T14:32:22.331669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.302395+0000","last_change":"2023-07-27T14:32:21.861878+0000","last_active":"2023-07-27T14:32:22.302395+0000","last_peered":"2023-07-27T14:32:22.302395+0000","last_clean":"2023-07-27T14:32:22.302395+0000","last_became_active":"2023-07-27T14:32:21.861588+0000","last_became_peered":"2023-07-27T14:32:21.861588+0000","last_unstale":"2023-07-27T14:32:22.302395+0000","last_undegraded":"2023-07-27T14:32:22.302395+0000","last_fullsized":"2023-07-27T14:32:22.302395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322925+0000","last_change":"2023-07-27T14:32:22.312758+0000","last_active":"2023-07-27T14:32:22.322925+0000","last_peered":"2023-07-27T14:32:22.322925+0000","last_clean":"2023-07-27T14:32:22.322925+0000","last_became_active":"2023-07-27T14:32:22.312485+0000","last_became_peered":"2023-07-27T14:32:22.312485+0000","last_unstale":"2023-07-27T14:32:22.322925+0000","last_undegraded":"2023-07-27T14:32:22.322925+0000","last_fullsized":"2023-07-27T14:32:22.322925+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"99'3","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330961+0000","last_change":"2023-07-27T14:32:21.860643+0000","last_active":"2023-07-27T14:32:22.330961+0000","last_peered":"2023-07-27T14:32:22.330961+0000","last_clean":"2023-07-27T14:32:22.330961+0000","last_became_active":"2023-07-27T14:32:21.860229+0000","last_became_peered":"2023-07-27T14:32:21.860229+0000","last_unstale":"2023-07-27T14:32:22.330961+0000","last_undegraded":"2023-07-27T14:32:22.330961+0000","last_fullsized":"2023-07-27T14:32:22.330961+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327113+0000","last_change":"2023-07-27T14:32:22.318762+0000","last_active":"2023-07-27T14:32:22.327113+0000","last_peered":"2023-07-27T14:32:22.327113+0000","last_clean":"2023-07-27T14:32:22.327113+0000","last_became_active":"2023-07-27T14:32:22.318487+0000","last_became_peered":"2023-07-27T14:32:22.318487+0000","last_unstale":"2023-07-27T14:32:22.327113+0000","last_undegraded":"2023-07-27T14:32:22.327113+0000","last_fullsized":"2023-07-27T14:32:22.327113+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.323059+0000","last_change":"2023-07-27T14:32:21.859824+0000","last_active":"2023-07-27T14:32:22.323059+0000","last_peered":"2023-07-27T14:32:22.323059+0000","last_clean":"2023-07-27T14:32:22.323059+0000","last_became_active":"2023-07-27T14:32:21.859438+0000","last_became_peered":"2023-07-27T14:32:21.859438+0000","last_unstale":"2023-07-27T14:32:22.323059+0000","last_undegraded":"2023-07-27T14:32:22.323059+0000","last_fullsized":"2023-07-27T14:32:22.323059+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325573+0000","last_change":"2023-07-27T14:32:22.319411+0000","last_active":"2023-07-27T14:32:22.325573+0000","last_peered":"2023-07-27T14:32:22.325573+0000","last_clean":"2023-07-27T14:32:22.325573+0000","last_became_active":"2023-07-27T14:32:22.319154+0000","last_became_peered":"2023-07-27T14:32:22.319154+0000","last_unstale":"2023-07-27T14:32:22.325573+0000","last_undegraded":"2023-07-27T14:32:22.325573+0000","last_fullsized":"2023-07-27T14:32:22.325573+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.314566+0000","last_change":"2023-07-27T14:32:21.863663+0000","last_active":"2023-07-27T14:32:22.314566+0000","last_peered":"2023-07-27T14:32:22.314566+0000","last_clean":"2023-07-27T14:32:22.314566+0000","last_became_active":"2023-07-27T14:32:21.863371+0000","last_became_peered":"2023-07-27T14:32:21.863371+0000","last_unstale":"2023-07-27T14:32:22.314566+0000","last_undegraded":"2023-07-27T14:32:22.314566+0000","last_fullsized":"2023-07-27T14:32:22.314566+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.318845+0000","last_change":"2023-07-27T14:32:22.318845+0000","last_active":"2023-07-27T14:32:22.318845+0000","last_peered":"2023-07-27T14:32:22.318845+0000","last_clean":"2023-07-27T14:32:22.318845+0000","last_became_active":"2023-07-27T14:32:22.318534+0000","last_became_peered":"2023-07-27T14:32:22.318534+0000","last_unstale":"2023-07-27T14:32:22.318845+0000","last_undegraded":"2023-07-27T14:32:22.318845+0000","last_fullsized":"2023-07-27T14:32:22.318845+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.306449+0000","last_change":"2023-07-27T14:32:21.860479+0000","last_active":"2023-07-27T14:32:22.306449+0000","last_peered":"2023-07-27T14:32:22.306449+0000","last_clean":"2023-07-27T14:32:22.306449+0000","last_became_active":"2023-07-27T14:32:21.860133+0000","last_became_peered":"2023-07-27T14:32:21.860133+0000","last_unstale":"2023-07-27T14:32:22.306449+0000","last_undegraded":"2023-07-27T14:32:22.306449+0000","last_fullsized":"2023-07-27T14:32:22.306449+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.329937+0000","last_change":"2023-07-27T14:32:22.327019+0000","last_active":"2023-07-27T14:32:22.329937+0000","last_peered":"2023-07-27T14:32:22.329937+0000","last_clean":"2023-07-27T14:32:22.329937+0000","last_became_active":"2023-07-27T14:32:22.326720+0000","last_became_peered":"2023-07-27T14:32:22.326720+0000","last_unstale":"2023-07-27T14:32:22.329937+0000","last_undegraded":"2023-07-27T14:32:22.329937+0000","last_fullsized":"2023-07-27T14:32:22.329937+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317828+0000","last_change":"2023-07-27T14:32:21.859742+0000","last_active":"2023-07-27T14:32:22.317828+0000","last_peered":"2023-07-27T14:32:22.317828+0000","last_clean":"2023-07-27T14:32:22.317828+0000","last_became_active":"2023-07-27T14:32:21.859412+0000","last_became_peered":"2023-07-27T14:32:21.859412+0000","last_unstale":"2023-07-27T14:32:22.317828+0000","last_undegraded":"2023-07-27T14:32:22.317828+0000","last_fullsized":"2023-07-27T14:32:22.317828+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330051+0000","last_change":"2023-07-27T14:32:22.328030+0000","last_active":"2023-07-27T14:32:22.330051+0000","last_peered":"2023-07-27T14:32:22.330051+0000","last_clean":"2023-07-27T14:32:22.330051+0000","last_became_active":"2023-07-27T14:32:22.327758+0000","last_became_peered":"2023-07-27T14:32:22.327758+0000","last_unstale":"2023-07-27T14:32:22.330051+0000","last_undegraded":"2023-07-27T14:32:22.330051+0000","last_fullsized":"2023-07-27T14:32:22.330051+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"99'4","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.335053+0000","last_change":"2023-07-27T14:32:21.868455+0000","last_active":"2023-07-27T14:32:22.335053+0000","last_peered":"2023-07-27T14:32:22.335053+0000","last_clean":"2023-07-27T14:32:22.335053+0000","last_became_active":"2023-07-27T14:32:21.867797+0000","last_became_peered":"2023-07-27T14:32:21.867797+0000","last_unstale":"2023-07-27T14:32:22.335053+0000","last_undegraded":"2023-07-27T14:32:22.335053+0000","last_fullsized":"2023-07-27T14:32:22.335053+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317143+0000","last_change":"2023-07-27T14:32:22.317143+0000","last_active":"2023-07-27T14:32:22.317143+0000","last_peered":"2023-07-27T14:32:22.317143+0000","last_clean":"2023-07-27T14:32:22.317143+0000","last_became_active":"2023-07-27T14:32:22.316501+0000","last_became_peered":"2023-07-27T14:32:22.316501+0000","last_unstale":"2023-07-27T14:32:22.317143+0000","last_undegraded":"2023-07-27T14:32:22.317143+0000","last_fullsized":"2023-07-27T14:32:22.317143+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"99'2","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330981+0000","last_change":"2023-07-27T14:32:21.855779+0000","last_active":"2023-07-27T14:32:22.330981+0000","last_peered":"2023-07-27T14:32:22.330981+0000","last_clean":"2023-07-27T14:32:22.330981+0000","last_became_active":"2023-07-27T14:32:21.855489+0000","last_became_peered":"2023-07-27T14:32:21.855489+0000","last_unstale":"2023-07-27T14:32:22.330981+0000","last_undegraded":"2023-07-27T14:32:22.330981+0000","last_fullsized":"2023-07-27T14:32:22.330981+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.323740+0000","last_change":"2023-07-27T14:32:22.319894+0000","last_active":"2023-07-27T14:32:22.323740+0000","last_peered":"2023-07-27T14:32:22.323740+0000","last_clean":"2023-07-27T14:32:22.323740+0000","last_became_active":"2023-07-27T14:32:22.319634+0000","last_became_peered":"2023-07-27T14:32:22.319634+0000","last_unstale":"2023-07-27T14:32:22.323740+0000","last_undegraded":"2023-07-27T14:32:22.323740+0000","last_fullsized":"2023-07-27T14:32:22.323740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866637+0000","last_change":"2023-07-27T14:32:21.861114+0000","last_active":"2023-07-27T14:32:21.866637+0000","last_peered":"2023-07-27T14:32:21.866637+0000","last_clean":"2023-07-27T14:32:21.866637+0000","last_became_active":"2023-07-27T14:32:21.860582+0000","last_became_peered":"2023-07-27T14:32:21.860582+0000","last_unstale":"2023-07-27T14:32:21.866637+0000","last_undegraded":"2023-07-27T14:32:21.866637+0000","last_fullsized":"2023-07-27T14:32:21.866637+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332463+0000","last_change":"2023-07-27T14:32:22.328802+0000","last_active":"2023-07-27T14:32:22.332463+0000","last_peered":"2023-07-27T14:32:22.332463+0000","last_clean":"2023-07-27T14:32:22.332463+0000","last_became_active":"2023-07-27T14:32:22.328521+0000","last_became_peered":"2023-07-27T14:32:22.328521+0000","last_unstale":"2023-07-27T14:32:22.332463+0000","last_undegraded":"2023-07-27T14:32:22.332463+0000","last_fullsized":"2023-07-27T14:32:22.332463+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866543+0000","last_change":"2023-07-27T14:32:21.860241+0000","last_active":"2023-07-27T14:32:21.866543+0000","last_peered":"2023-07-27T14:32:21.866543+0000","last_clean":"2023-07-27T14:32:21.866543+0000","last_became_active":"2023-07-27T14:32:21.859871+0000","last_became_peered":"2023-07-27T14:32:21.859871+0000","last_unstale":"2023-07-27T14:32:21.866543+0000","last_undegraded":"2023-07-27T14:32:21.866543+0000","last_fullsized":"2023-07-27T14:32:21.866543+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.316199+0000","last_change":"2023-07-27T14:32:22.313876+0000","last_active":"2023-07-27T14:32:22.316199+0000","last_peered":"2023-07-27T14:32:22.316199+0000","last_clean":"2023-07-27T14:32:22.316199+0000","last_became_active":"2023-07-27T14:32:22.313578+0000","last_became_peered":"2023-07-27T14:32:22.313578+0000","last_unstale":"2023-07-27T14:32:22.316199+0000","last_undegraded":"2023-07-27T14:32:22.316199+0000","last_fullsized":"2023-07-27T14:32:22.316199+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.873876+0000","last_change":"2023-07-27T14:32:21.870407+0000","last_active":"2023-07-27T14:32:21.873876+0000","last_peered":"2023-07-27T14:32:21.873876+0000","last_clean":"2023-07-27T14:32:21.873876+0000","last_became_active":"2023-07-27T14:32:21.869999+0000","last_became_peered":"2023-07-27T14:32:21.869999+0000","last_unstale":"2023-07-27T14:32:21.873876+0000","last_undegraded":"2023-07-27T14:32:21.873876+0000","last_fullsized":"2023-07-27T14:32:21.873876+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.333345+0000","last_change":"2023-07-27T14:32:22.328746+0000","last_active":"2023-07-27T14:32:22.333345+0000","last_peered":"2023-07-27T14:32:22.333345+0000","last_clean":"2023-07-27T14:32:22.333345+0000","last_became_active":"2023-07-27T14:32:22.328505+0000","last_became_peered":"2023-07-27T14:32:22.328505+0000","last_unstale":"2023-07-27T14:32:22.333345+0000","last_undegraded":"2023-07-27T14:32:22.333345+0000","last_fullsized":"2023-07-27T14:32:22.333345+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305610+0000","last_change":"2023-07-27T14:32:21.861454+0000","last_active":"2023-07-27T14:32:22.305610+0000","last_peered":"2023-07-27T14:32:22.305610+0000","last_clean":"2023-07-27T14:32:22.305610+0000","last_became_active":"2023-07-27T14:32:21.861149+0000","last_became_peered":"2023-07-27T14:32:21.861149+0000","last_unstale":"2023-07-27T14:32:22.305610+0000","last_undegraded":"2023-07-27T14:32:22.305610+0000","last_fullsized":"2023-07-27T14:32:22.305610+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.321701+0000","last_change":"2023-07-27T14:32:22.318229+0000","last_active":"2023-07-27T14:32:22.321701+0000","last_peered":"2023-07-27T14:32:22.321701+0000","last_clean":"2023-07-27T14:32:22.321701+0000","last_became_active":"2023-07-27T14:32:22.317926+0000","last_became_peered":"2023-07-27T14:32:22.317926+0000","last_unstale":"2023-07-27T14:32:22.321701+0000","last_undegraded":"2023-07-27T14:32:22.321701+0000","last_fullsized":"2023-07-27T14:32:22.321701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305729+0000","last_change":"2023-07-27T14:32:21.855128+0000","last_active":"2023-07-27T14:32:22.305729+0000","last_peered":"2023-07-27T14:32:22.305729+0000","last_clean":"2023-07-27T14:32:22.305729+0000","last_became_active":"2023-07-27T14:32:21.854628+0000","last_became_peered":"2023-07-27T14:32:21.854628+0000","last_unstale":"2023-07-27T14:32:22.305729+0000","last_undegraded":"2023-07-27T14:32:22.305729+0000","last_fullsized":"2023-07-27T14:32:22.305729+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325294+0000","last_change":"2023-07-27T14:32:22.325294+0000","last_active":"2023-07-27T14:32:22.325294+0000","last_peered":"2023-07-27T14:32:22.325294+0000","last_clean":"2023-07-27T14:32:22.325294+0000","last_became_active":"2023-07-27T14:32:22.325001+0000","last_became_peered":"2023-07-27T14:32:22.325001+0000","last_unstale":"2023-07-27T14:32:22.325294+0000","last_undegraded":"2023-07-27T14:32:22.325294+0000","last_fullsized":"2023-07-27T14:32:22.325294+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.873873+0000","last_change":"2023-07-27T14:32:21.870411+0000","last_active":"2023-07-27T14:32:21.873873+0000","last_peered":"2023-07-27T14:32:21.873873+0000","last_clean":"2023-07-27T14:32:21.873873+0000","last_became_active":"2023-07-27T14:32:21.870075+0000","last_became_peered":"2023-07-27T14:32:21.870075+0000","last_unstale":"2023-07-27T14:32:21.873873+0000","last_undegraded":"2023-07-27T14:32:21.873873+0000","last_fullsized":"2023-07-27T14:32:21.873873+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332136+0000","last_change":"2023-07-27T14:32:22.323862+0000","last_active":"2023-07-27T14:32:22.332136+0000","last_peered":"2023-07-27T14:32:22.332136+0000","last_clean":"2023-07-27T14:32:22.332136+0000","last_became_active":"2023-07-27T14:32:22.323588+0000","last_became_peered":"2023-07-27T14:32:22.323588+0000","last_unstale":"2023-07-27T14:32:22.332136+0000","last_undegraded":"2023-07-27T14:32:22.332136+0000","last_fullsized":"2023-07-27T14:32:22.332136+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866878+0000","last_change":"2023-07-27T14:32:21.862600+0000","last_active":"2023-07-27T14:32:21.866878+0000","last_peered":"2023-07-27T14:32:21.866878+0000","last_clean":"2023-07-27T14:32:21.866878+0000","last_became_active":"2023-07-27T14:32:21.862314+0000","last_became_peered":"2023-07-27T14:32:21.862314+0000","last_unstale":"2023-07-27T14:32:21.866878+0000","last_undegraded":"2023-07-27T14:32:21.866878+0000","last_fullsized":"2023-07-27T14:32:21.866878+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.324783+0000","last_change":"2023-07-27T14:32:22.317866+0000","last_active":"2023-07-27T14:32:22.324783+0000","last_peered":"2023-07-27T14:32:22.324783+0000","last_clean":"2023-07-27T14:32:22.324783+0000","last_became_active":"2023-07-27T14:32:22.317592+0000","last_became_peered":"2023-07-27T14:32:22.317592+0000","last_unstale":"2023-07-27T14:32:22.324783+0000","last_undegraded":"2023-07-27T14:32:22.324783+0000","last_fullsized":"2023-07-27T14:32:22.324783+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334852+0000","last_change":"2023-07-27T14:32:21.855219+0000","last_active":"2023-07-27T14:32:22.334852+0000","last_peered":"2023-07-27T14:32:22.334852+0000","last_clean":"2023-07-27T14:32:22.334852+0000","last_became_active":"2023-07-27T14:32:21.854672+0000","last_became_peered":"2023-07-27T14:32:21.854672+0000","last_unstale":"2023-07-27T14:32:22.334852+0000","last_undegraded":"2023-07-27T14:32:22.334852+0000","last_fullsized":"2023-07-27T14:32:22.334852+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.321317+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:32:22.321317+0000","last_peered":"2023-07-27T14:32:22.321317+0000","last_clean":"2023-07-27T14:32:22.321317+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:32:22.321317+0000","last_undegraded":"2023-07-27T14:32:22.321317+0000","last_fullsized":"2023-07-27T14:32:22.321317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.329622+0000","last_change":"2023-07-27T14:32:22.329622+0000","last_active":"2023-07-27T14:32:22.329622+0000","last_peered":"2023-07-27T14:32:22.329622+0000","last_clean":"2023-07-27T14:32:22.329622+0000","last_became_active":"2023-07-27T14:32:22.329316+0000","last_became_peered":"2023-07-27T14:32:22.329316+0000","last_unstale":"2023-07-27T14:32:22.329622+0000","last_undegraded":"2023-07-27T14:32:22.329622+0000","last_fullsized":"2023-07-27T14:32:22.329622+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866520+0000","last_change":"2023-07-27T14:32:21.859616+0000","last_active":"2023-07-27T14:32:21.866520+0000","last_peered":"2023-07-27T14:32:21.866520+0000","last_clean":"2023-07-27T14:32:21.866520+0000","last_became_active":"2023-07-27T14:32:21.859311+0000","last_became_peered":"2023-07-27T14:32:21.859311+0000","last_unstale":"2023-07-27T14:32:21.866520+0000","last_undegraded":"2023-07-27T14:32:21.866520+0000","last_fullsized":"2023-07-27T14:32:21.866520+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305841+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:32:22.305841+0000","last_peered":"2023-07-27T14:32:22.305841+0000","last_clean":"2023-07-27T14:32:22.305841+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:32:22.305841+0000","last_undegraded":"2023-07-27T14:32:22.305841+0000","last_fullsized":"2023-07-27T14:32:22.305841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317411+0000","last_change":"2023-07-27T14:32:22.317411+0000","last_active":"2023-07-27T14:32:22.317411+0000","last_peered":"2023-07-27T14:32:22.317411+0000","last_clean":"2023-07-27T14:32:22.317411+0000","last_became_active":"2023-07-27T14:32:22.317113+0000","last_became_peered":"2023-07-27T14:32:22.317113+0000","last_unstale":"2023-07-27T14:32:22.317411+0000","last_undegraded":"2023-07-27T14:32:22.317411+0000","last_fullsized":"2023-07-27T14:32:22.317411+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"99'2","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328773+0000","last_change":"2023-07-27T14:32:21.859580+0000","last_active":"2023-07-27T14:32:22.328773+0000","last_peered":"2023-07-27T14:32:22.328773+0000","last_clean":"2023-07-27T14:32:22.328773+0000","last_became_active":"2023-07-27T14:32:21.859074+0000","last_became_peered":"2023-07-27T14:32:21.859074+0000","last_unstale":"2023-07-27T14:32:22.328773+0000","last_undegraded":"2023-07-27T14:32:22.328773+0000","last_fullsized":"2023-07-27T14:32:22.328773+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.311286+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:32:22.311286+0000","last_peered":"2023-07-27T14:32:22.311286+0000","last_clean":"2023-07-27T14:32:22.311286+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:32:22.311286+0000","last_undegraded":"2023-07-27T14:32:22.311286+0000","last_fullsized":"2023-07-27T14:32:22.311286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326003+0000","last_change":"2023-07-27T14:32:22.326003+0000","last_active":"2023-07-27T14:32:22.326003+0000","last_peered":"2023-07-27T14:32:22.326003+0000","last_clean":"2023-07-27T14:32:22.326003+0000","last_became_active":"2023-07-27T14:32:22.325688+0000","last_became_peered":"2023-07-27T14:32:22.325688+0000","last_unstale":"2023-07-27T14:32:22.326003+0000","last_undegraded":"2023-07-27T14:32:22.326003+0000","last_fullsized":"2023-07-27T14:32:22.326003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.321236+0000","last_change":"2023-07-27T14:32:21.860367+0000","last_active":"2023-07-27T14:32:22.321236+0000","last_peered":"2023-07-27T14:32:22.321236+0000","last_clean":"2023-07-27T14:32:22.321236+0000","last_became_active":"2023-07-27T14:32:21.860050+0000","last_became_peered":"2023-07-27T14:32:21.860050+0000","last_unstale":"2023-07-27T14:32:22.321236+0000","last_undegraded":"2023-07-27T14:32:22.321236+0000","last_fullsized":"2023-07-27T14:32:22.321236+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.304438+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:32:22.304438+0000","last_peered":"2023-07-27T14:32:22.304438+0000","last_clean":"2023-07-27T14:32:22.304438+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:32:22.304438+0000","last_undegraded":"2023-07-27T14:32:22.304438+0000","last_fullsized":"2023-07-27T14:32:22.304438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.848806+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:32:21.848806+0000","last_peered":"2023-07-27T14:32:21.848806+0000","last_clean":"2023-07-27T14:32:21.848806+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:32:21.848806+0000","last_undegraded":"2023-07-27T14:32:21.848806+0000","last_fullsized":"2023-07-27T14:32:21.848806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322884+0000","last_change":"2023-07-27T14:32:22.312568+0000","last_active":"2023-07-27T14:32:22.322884+0000","last_peered":"2023-07-27T14:32:22.322884+0000","last_clean":"2023-07-27T14:32:22.322884+0000","last_became_active":"2023-07-27T14:32:22.312320+0000","last_became_peered":"2023-07-27T14:32:22.312320+0000","last_unstale":"2023-07-27T14:32:22.322884+0000","last_undegraded":"2023-07-27T14:32:22.322884+0000","last_fullsized":"2023-07-27T14:32:22.322884+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.310928+0000","last_change":"2023-07-27T14:32:21.856081+0000","last_active":"2023-07-27T14:32:22.310928+0000","last_peered":"2023-07-27T14:32:22.310928+0000","last_clean":"2023-07-27T14:32:22.310928+0000","last_became_active":"2023-07-27T14:32:21.855812+0000","last_became_peered":"2023-07-27T14:32:21.855812+0000","last_unstale":"2023-07-27T14:32:22.310928+0000","last_undegraded":"2023-07-27T14:32:22.310928+0000","last_fullsized":"2023-07-27T14:32:22.310928+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.848901+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:32:21.848901+0000","last_peered":"2023-07-27T14:32:21.848901+0000","last_clean":"2023-07-27T14:32:21.848901+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:32:21.848901+0000","last_undegraded":"2023-07-27T14:32:21.848901+0000","last_fullsized":"2023-07-27T14:32:21.848901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326485+0000","last_change":"2023-07-27T14:32:22.324120+0000","last_active":"2023-07-27T14:32:22.326485+0000","last_peered":"2023-07-27T14:32:22.326485+0000","last_clean":"2023-07-27T14:32:22.326485+0000","last_became_active":"2023-07-27T14:32:22.323586+0000","last_became_peered":"2023-07-27T14:32:22.323586+0000","last_unstale":"2023-07-27T14:32:22.326485+0000","last_undegraded":"2023-07-27T14:32:22.326485+0000","last_fullsized":"2023-07-27T14:32:22.326485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313492+0000","last_change":"2023-07-27T14:32:21.865235+0000","last_active":"2023-07-27T14:32:22.313492+0000","last_peered":"2023-07-27T14:32:22.313492+0000","last_clean":"2023-07-27T14:32:22.313492+0000","last_became_active":"2023-07-27T14:32:21.864797+0000","last_became_peered":"2023-07-27T14:32:21.864797+0000","last_unstale":"2023-07-27T14:32:22.313492+0000","last_undegraded":"2023-07-27T14:32:22.313492+0000","last_fullsized":"2023-07-27T14:32:22.313492+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.846936+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:32:21.846936+0000","last_peered":"2023-07-27T14:32:21.846936+0000","last_clean":"2023-07-27T14:32:21.846936+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:32:21.846936+0000","last_undegraded":"2023-07-27T14:32:21.846936+0000","last_fullsized":"2023-07-27T14:32:21.846936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326405+0000","last_change":"2023-07-27T14:32:22.322838+0000","last_active":"2023-07-27T14:32:22.326405+0000","last_peered":"2023-07-27T14:32:22.326405+0000","last_clean":"2023-07-27T14:32:22.326405+0000","last_became_active":"2023-07-27T14:32:22.322528+0000","last_became_peered":"2023-07-27T14:32:22.322528+0000","last_unstale":"2023-07-27T14:32:22.326405+0000","last_undegraded":"2023-07-27T14:32:22.326405+0000","last_fullsized":"2023-07-27T14:32:22.326405+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.304924+0000","last_change":"2023-07-27T14:32:21.854866+0000","last_active":"2023-07-27T14:32:22.304924+0000","last_peered":"2023-07-27T14:32:22.304924+0000","last_clean":"2023-07-27T14:32:22.304924+0000","last_became_active":"2023-07-27T14:32:21.854463+0000","last_became_peered":"2023-07-27T14:32:21.854463+0000","last_unstale":"2023-07-27T14:32:22.304924+0000","last_undegraded":"2023-07-27T14:32:22.304924+0000","last_fullsized":"2023-07-27T14:32:22.304924+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317831+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:32:22.317831+0000","last_peered":"2023-07-27T14:32:22.317831+0000","last_clean":"2023-07-27T14:32:22.317831+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:32:22.317831+0000","last_undegraded":"2023-07-27T14:32:22.317831+0000","last_fullsized":"2023-07-27T14:32:22.317831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332229+0000","last_change":"2023-07-27T14:32:22.328756+0000","last_active":"2023-07-27T14:32:22.332229+0000","last_peered":"2023-07-27T14:32:22.332229+0000","last_clean":"2023-07-27T14:32:22.332229+0000","last_became_active":"2023-07-27T14:32:22.328504+0000","last_became_peered":"2023-07-27T14:32:22.328504+0000","last_unstale":"2023-07-27T14:32:22.332229+0000","last_undegraded":"2023-07-27T14:32:22.332229+0000","last_fullsized":"2023-07-27T14:32:22.332229+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313668+0000","last_change":"2023-07-27T14:32:21.864971+0000","last_active":"2023-07-27T14:32:22.313668+0000","last_peered":"2023-07-27T14:32:22.313668+0000","last_clean":"2023-07-27T14:32:22.313668+0000","last_became_active":"2023-07-27T14:32:21.864534+0000","last_became_peered":"2023-07-27T14:32:21.864534+0000","last_unstale":"2023-07-27T14:32:22.313668+0000","last_undegraded":"2023-07-27T14:32:22.313668+0000","last_fullsized":"2023-07-27T14:32:22.313668+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.847862+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:32:21.847862+0000","last_peered":"2023-07-27T14:32:21.847862+0000","last_clean":"2023-07-27T14:32:21.847862+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:32:21.847862+0000","last_undegraded":"2023-07-27T14:32:21.847862+0000","last_fullsized":"2023-07-27T14:32:21.847862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14196,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94357644,"statfs":{"total":96636764160,"available":96622227456,"internally_reserved":0,"allocated":1224704,"data_stored":564815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86099999999999999,"5min":1.133,"15min":1.133},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68600000000000005,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.72999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96999999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0449999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.438,"15min":0.438},"max":{"1min":0.90500000000000003,"5min":1.119,"15min":1.119},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":1.069,"15min":1.069},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92800000000000005,"5min":1.165,"15min":1.165},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.63800000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77600000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81499999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68100000000000005,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95999999999999996,"5min":1.038,"15min":1.038},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73699999999999999,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.034,"15min":1.034},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70699999999999996,"15min":0.71499999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93700000000000006,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13504,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94358336,"statfs":{"total":96636764160,"available":96622936064,"internally_reserved":0,"allocated":1236992,"data_stored":566871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.441,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77600000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77500000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.629}]},{"osd":1,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.624,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78800000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81799999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81799999999999995,"5min":1.2,"15min":1.2},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68500000000000005,"15min":0.66000000000000003},"min":{"1min":0.55200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86599999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98999999999999999,"5min":1.079,"15min":1.079},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67300000000000004,"15min":0.68200000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80500000000000005,"5min":1.198,"15min":1.198},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51700000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88900000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.443}]},{"osd":7,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.61699999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94199999999999995,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16300,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355540,"statfs":{"total":96636764160,"available":96620072960,"internally_reserved":0,"allocated":1216512,"data_stored":564759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.42899999999999999,"15min":0.52600000000000002},"min":{"1min":0.28799999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54400000000000004,"5min":4.75,"15min":4.75},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.497,"15min":0.68799999999999994},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70199999999999996,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.434}]},{"osd":2,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.496,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67500000000000004,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.496,"15min":0.54200000000000004},"min":{"1min":0.33100000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.52900000000000003},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68400000000000005,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.499,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.58299999999999996,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91300000000000003,"5min":2.181,"15min":2.181},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.73199999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91300000000000003,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.78300000000000003},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95099999999999996,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.751},"min":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96599999999999997,"5min":2.149,"15min":2.149},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97699999999999998,"5min":2.052,"15min":2.052},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.86599999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95099999999999996,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.018,"5min":2.016,"15min":2.016},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.85999999999999999},"min":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0449999999999999,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.78500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13760,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358080,"statfs":{"total":96636764160,"available":96622673920,"internally_reserved":0,"allocated":1236992,"data_stored":565597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.40699999999999997,"15min":0.42499999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.5,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.442},{"interface":"front","average":{"1min":0.436,"5min":0.46000000000000002,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.57199999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":1.5589999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.50800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47299999999999998,"15min":0.48399999999999999},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.58899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.68200000000000005},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95399999999999996,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.873,"5min":1.28,"15min":1.28},"last":0.75}]},{"osd":5,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.25,"15min":1.25},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.874,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.6020000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93500000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95699999999999996,"5min":1.22,"15min":1.22},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97899999999999998,"5min":1.244,"15min":1.244},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.66600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17400,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354440,"statfs":{"total":96636764160,"available":96618946560,"internally_reserved":0,"allocated":1228800,"data_stored":571463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52100000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45200000000000001,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45500000000000002,"15min":0.48699999999999999},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63500000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.58699999999999997,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":5.601}]},{"osd":3,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46000000000000002,"15min":0.48399999999999999},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55000000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.498,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":1.353}]},{"osd":4,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.849},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91500000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":6.9660000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":1.014,"15min":1.014},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72699999999999998,"15min":0.751},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":1.26,"15min":1.26},"last":1.772}]},{"osd":6,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.46700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88200000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":3.1600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.77100000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91100000000000003,"5min":1.091,"15min":1.091},"last":3.1360000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.79800000000000004},"min":{"1min":0.55800000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94399999999999995,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.8089999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96199999999999997,"5min":1.036,"15min":1.036},"last":1.5980000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14196,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94357644,"statfs":{"total":96636764160,"available":96622227456,"internally_reserved":0,"allocated":1224704,"data_stored":565721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.28399999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.38}]},{"osd":1,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.45100000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.748,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46000000000000002,"15min":0.44},"min":{"1min":0.315,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.442},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51900000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.46100000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.91600000000000004,"5min":1.149,"15min":1.149},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.1059999999999999,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.55900000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0920000000000001,"5min":1.298,"15min":1.298},"last":0.873},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.78100000000000003},"min":{"1min":0.57799999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78700000000000003,"15min":0.77500000000000002},"min":{"1min":0.59199999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.78500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13492,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94358348,"statfs":{"total":96636764160,"available":96622948352,"internally_reserved":0,"allocated":1224704,"data_stored":565403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.36399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74199999999999999,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":4.3479999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.66400000000000003,"15min":0.65000000000000002},"min":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.69699999999999995,"15min":0.68100000000000005},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.72499999999999998,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.65600000000000003,"15min":0.61799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":2.9649999999999999,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.69899999999999995,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.194,"5min":5.194,"15min":5.194},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.51000000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.5990000000000002,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73699999999999999,"15min":0.71899999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.819,"5min":2.819,"15min":2.819},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.52300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15276,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":94356564,"statfs":{"total":96636764160,"available":96621121536,"internally_reserved":0,"allocated":1216512,"data_stored":564759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79900000000000004,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.71199999999999997,"15min":0.63},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73299999999999998,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72699999999999998,"15min":0.68600000000000005},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.629,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77000000000000002,"5min":1.581,"15min":1.581},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.69799999999999995,"15min":0.66100000000000003},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.82299999999999995,"15min":0.79400000000000004},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0660000000000001,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":1.121,"5min":1.978,"15min":1.978},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67200000000000004,"15min":0.64600000000000002},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85599999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67400000000000004,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82399999999999995,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0960000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86599999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92100000000000004,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:32:26.607 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:32:26.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.791+0000 7f42ad5ff700 1 Processor -- start 2023-07-27T14:32:26.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.792+0000 7f42ad5ff700 1 -- start start 2023-07-27T14:32:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.793+0000 7f42ad5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42a8153ec0 0x7f42a80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.793+0000 7f42ad5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aa050 0x7f42a80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.793+0000 7f42ad5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a80aa4d0 con 0x7f42a80aaa40 2023-07-27T14:32:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.793+0000 7f42ad5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a80c05c0 con 0x7f42a8153ec0 2023-07-27T14:32:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.793+0000 7f42ad5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80c1a60 con 0x7f42a80aa050 2023-07-27T14:32:26.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.793+0000 7f42a6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42a8153ec0 0x7f42a80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.793+0000 7f42a77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f42a80aaa40 0x7f42a8157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40664/0 (socket says 172.21.15.115:40664) 2023-07-27T14:32:26.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.793+0000 7f42a77fe700 1 -- 172.21.15.115:0/1873355481 learned_addr learned my addr 172.21.15.115:0/1873355481 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:26.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a67fc700 1 --2- 172.21.15.115:0/1873355481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aa050 0x7f42a80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a5ffb700 1 -- 172.21.15.115:0/1873355481 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187649076 0 0) 0x7f42a0001490 con 0x7f42a80aaa40 2023-07-27T14:32:26.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a6ffd700 1 -- 172.21.15.115:0/1873355481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aa050 msgr2=0x7f42a80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:26.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a6ffd700 1 --2- 172.21.15.115:0/1873355481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aa050 0x7f42a80640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a6ffd700 1 -- 172.21.15.115:0/1873355481 >> v1:172.21.15.115:6789/0 conn(0x7f42a80aaa40 legacy=0x7f42a8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a6ffd700 1 -- 172.21.15.115:0/1873355481 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a80bfc90 con 0x7f42a8153ec0 2023-07-27T14:32:26.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a67fc700 1 --2- 172.21.15.115:0/1873355481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aa050 0x7f42a80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:26.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a6ffd700 1 --2- 172.21.15.115:0/1873355481 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80a9b60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f4298009760 tx=0x7f4298009060).ready entity=mon.0 client_cookie=c60a35ae786f2b92 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:26.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a5ffb700 1 -- 172.21.15.115:0/1873355481 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800b580 con 0x7f42a8153ec0 2023-07-27T14:32:26.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a5ffb700 1 -- 172.21.15.115:0/1873355481 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800b6e0 con 0x7f42a8153ec0 2023-07-27T14:32:26.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.794+0000 7f42a5ffb700 1 -- 172.21.15.115:0/1873355481 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800ba60 con 0x7f42a8153ec0 2023-07-27T14:32:26.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.795+0000 7f42ad5ff700 1 -- 172.21.15.115:0/1873355481 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 msgr2=0x7f42a80a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.795+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/1873355481 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80a9b60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f4298009760 tx=0x7f4298009060).stop 2023-07-27T14:32:26.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.795+0000 7f42ad5ff700 1 -- 172.21.15.115:0/1873355481 shutdown_connections 2023-07-27T14:32:26.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.795+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/1873355481 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80a9b60 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.795+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/1873355481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aa050 0x7f42a80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.795+0000 7f42ad5ff700 1 -- 172.21.15.115:0/1873355481 >> 172.21.15.115:0/1873355481 conn(0x7f42a80cb610 msgr2=0x7f42a80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:26.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.795+0000 7f42ad5ff700 1 -- 172.21.15.115:0/1873355481 shutdown_connections 2023-07-27T14:32:26.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.795+0000 7f42ad5ff700 1 -- 172.21.15.115:0/1873355481 wait complete. 2023-07-27T14:32:26.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.796+0000 7f42ad5ff700 1 Processor -- start 2023-07-27T14:32:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.796+0000 7f42ad5ff700 1 -- start start 2023-07-27T14:32:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.797+0000 7f42ad5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a80aa050 0x7f42a814db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.797+0000 7f42ad5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aaa40 0x7f42a80aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.797+0000 7f42ad5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.797+0000 7f42ad5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80b0900 con 0x7f42a8153ec0 2023-07-27T14:32:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.797+0000 7f42ad5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80aeb50 con 0x7f42a80aa050 2023-07-27T14:32:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.797+0000 7f42ad5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80aee30 con 0x7f42a80aaa40 2023-07-27T14:32:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47324/0 (socket says 172.21.15.115:47324) 2023-07-27T14:32:26.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 -- 172.21.15.115:0/586702228 learned_addr learned my addr 172.21.15.115:0/586702228 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:26.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a6ffd700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a80aa050 0x7f42a814db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a67fc700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aaa40 0x7f42a80aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 -- 172.21.15.115:0/586702228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aaa40 msgr2=0x7f42a80aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aaa40 0x7f42a80aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 -- 172.21.15.115:0/586702228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a80aa050 msgr2=0x7f42a814db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:26.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a80aa050 0x7f42a814db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:26.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 -- 172.21.15.115:0/586702228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980092a0 con 0x7f42a8153ec0 2023-07-27T14:32:26.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f42a77fe700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80b0410 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f42a000c810 tx=0x7f42a0007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:26.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.798+0000 7f428effd700 1 -- 172.21.15.115:0/586702228 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0005d30 con 0x7f42a8153ec0 2023-07-27T14:32:26.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.799+0000 7f428effd700 1 -- 172.21.15.115:0/586702228 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0005e90 con 0x7f42a8153ec0 2023-07-27T14:32:26.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.799+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a80af110 con 0x7f42a8153ec0 2023-07-27T14:32:26.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.799+0000 7f428effd700 1 -- 172.21.15.115:0/586702228 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0007300 con 0x7f42a8153ec0 2023-07-27T14:32:26.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.799+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a81645e0 con 0x7f42a8153ec0 2023-07-27T14:32:26.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.800+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a806c470 con 0x7f42a8153ec0 2023-07-27T14:32:26.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.801+0000 7f428effd700 1 -- 172.21.15.115:0/586702228 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f42a0010070 con 0x7f42a8153ec0 2023-07-27T14:32:26.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.801+0000 7f428effd700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429405f340 0x7f4294061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:26.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.801+0000 7f428effd700 1 -- 172.21.15.115:0/586702228 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f42a0079ac0 con 0x7f42a8153ec0 2023-07-27T14:32:26.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.802+0000 7f42a6ffd700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429405f340 0x7f4294061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:26.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.802+0000 7f42a6ffd700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429405f340 0x7f4294061800 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f4298006d30 tx=0x7f4298017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:26.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.806+0000 7f428effd700 1 -- 172.21.15.115:0/586702228 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42a004aa80 con 0x7f42a8153ec0 2023-07-27T14:32:27.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.971+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42a80aa4d0 con 0x7f429405f340 2023-07-27T14:32:27.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.981+0000 7f428effd700 1 -- 172.21.15.115:0/586702228 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361084 (secure 0 0 0) 0x7f42a80aa4d0 con 0x7f429405f340 2023-07-27T14:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:27.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429405f340 msgr2=0x7f4294061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429405f340 0x7f4294061800 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f4298006d30 tx=0x7f4298017000).stop 2023-07-27T14:32:27.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 msgr2=0x7f42a80b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80b0410 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f42a000c810 tx=0x7f42a0007d00).stop 2023-07-27T14:32:27.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 shutdown_connections 2023-07-27T14:32:27.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f429405f340 0x7f4294061800 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a8153ec0 0x7f42a80b0410 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a80aa050 0x7f42a814db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 --2- 172.21.15.115:0/586702228 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42a80aaa40 0x7f42a80aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 >> 172.21.15.115:0/586702228 conn(0x7f42a80cb610 msgr2=0x7f42a80ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:27.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 shutdown_connections 2023-07-27T14:32:27.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:26.986+0000 7f42ad5ff700 1 -- 172.21.15.115:0/586702228 wait complete. 2023-07-27T14:32:27.024 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-07-27T14:32:25.510449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":118124,"kb_used_data":9580,"kb_used_omap":0,"kb_used_meta":108480,"kb_avail":754856596,"statfs":{"total":773094113280,"available":772973154304,"internally_reserved":0,"allocated":9809920,"data_stored":4529388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":111083520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5223013,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-219,"num_read_kb":-204856,"num_write":-1378,"num_write_kb":-414850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.193971"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334999+0000","last_change":"2023-07-27T14:32:22.331609+0000","last_active":"2023-07-27T14:32:22.334999+0000","last_peered":"2023-07-27T14:32:22.334999+0000","last_clean":"2023-07-27T14:32:22.334999+0000","last_became_active":"2023-07-27T14:32:22.331313+0000","last_became_peered":"2023-07-27T14:32:22.331313+0000","last_unstale":"2023-07-27T14:32:22.334999+0000","last_undegraded":"2023-07-27T14:32:22.334999+0000","last_fullsized":"2023-07-27T14:32:22.334999+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"99'3","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332867+0000","last_change":"2023-07-27T14:32:21.862225+0000","last_active":"2023-07-27T14:32:22.332867+0000","last_peered":"2023-07-27T14:32:22.332867+0000","last_clean":"2023-07-27T14:32:22.332867+0000","last_became_active":"2023-07-27T14:32:21.861927+0000","last_became_peered":"2023-07-27T14:32:21.861927+0000","last_unstale":"2023-07-27T14:32:22.332867+0000","last_undegraded":"2023-07-27T14:32:22.332867+0000","last_fullsized":"2023-07-27T14:32:22.332867+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322501+0000","last_change":"2023-07-27T14:32:22.321337+0000","last_active":"2023-07-27T14:32:22.322501+0000","last_peered":"2023-07-27T14:32:22.322501+0000","last_clean":"2023-07-27T14:32:22.322501+0000","last_became_active":"2023-07-27T14:32:22.321073+0000","last_became_peered":"2023-07-27T14:32:22.321073+0000","last_unstale":"2023-07-27T14:32:22.322501+0000","last_undegraded":"2023-07-27T14:32:22.322501+0000","last_fullsized":"2023-07-27T14:32:22.322501+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317927+0000","last_change":"2023-07-27T14:32:21.854483+0000","last_active":"2023-07-27T14:32:22.317927+0000","last_peered":"2023-07-27T14:32:22.317927+0000","last_clean":"2023-07-27T14:32:22.317927+0000","last_became_active":"2023-07-27T14:32:21.854185+0000","last_became_peered":"2023-07-27T14:32:21.854185+0000","last_unstale":"2023-07-27T14:32:22.317927+0000","last_undegraded":"2023-07-27T14:32:22.317927+0000","last_fullsized":"2023-07-27T14:32:22.317927+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328418+0000","last_change":"2023-07-27T14:32:22.326353+0000","last_active":"2023-07-27T14:32:22.328418+0000","last_peered":"2023-07-27T14:32:22.328418+0000","last_clean":"2023-07-27T14:32:22.328418+0000","last_became_active":"2023-07-27T14:32:22.326043+0000","last_became_peered":"2023-07-27T14:32:22.326043+0000","last_unstale":"2023-07-27T14:32:22.328418+0000","last_undegraded":"2023-07-27T14:32:22.328418+0000","last_fullsized":"2023-07-27T14:32:22.328418+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.858540+0000","last_change":"2023-07-27T14:32:21.856016+0000","last_active":"2023-07-27T14:32:21.858540+0000","last_peered":"2023-07-27T14:32:21.858540+0000","last_clean":"2023-07-27T14:32:21.858540+0000","last_became_active":"2023-07-27T14:32:21.855769+0000","last_became_peered":"2023-07-27T14:32:21.855769+0000","last_unstale":"2023-07-27T14:32:21.858540+0000","last_undegraded":"2023-07-27T14:32:21.858540+0000","last_fullsized":"2023-07-27T14:32:21.858540+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.320770+0000","last_change":"2023-07-27T14:32:22.316498+0000","last_active":"2023-07-27T14:32:22.320770+0000","last_peered":"2023-07-27T14:32:22.320770+0000","last_clean":"2023-07-27T14:32:22.320770+0000","last_became_active":"2023-07-27T14:32:22.316235+0000","last_became_peered":"2023-07-27T14:32:22.316235+0000","last_unstale":"2023-07-27T14:32:22.320770+0000","last_undegraded":"2023-07-27T14:32:22.320770+0000","last_fullsized":"2023-07-27T14:32:22.320770+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328680+0000","last_change":"2023-07-27T14:32:21.862501+0000","last_active":"2023-07-27T14:32:22.328680+0000","last_peered":"2023-07-27T14:32:22.328680+0000","last_clean":"2023-07-27T14:32:22.328680+0000","last_became_active":"2023-07-27T14:32:21.862264+0000","last_became_peered":"2023-07-27T14:32:21.862264+0000","last_unstale":"2023-07-27T14:32:22.328680+0000","last_undegraded":"2023-07-27T14:32:22.328680+0000","last_fullsized":"2023-07-27T14:32:22.328680+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334665+0000","last_change":"2023-07-27T14:32:22.324666+0000","last_active":"2023-07-27T14:32:22.334665+0000","last_peered":"2023-07-27T14:32:22.334665+0000","last_clean":"2023-07-27T14:32:22.334665+0000","last_became_active":"2023-07-27T14:32:22.324122+0000","last_became_peered":"2023-07-27T14:32:22.324122+0000","last_unstale":"2023-07-27T14:32:22.334665+0000","last_undegraded":"2023-07-27T14:32:22.334665+0000","last_fullsized":"2023-07-27T14:32:22.334665+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.307345+0000","last_change":"2023-07-27T14:32:21.859444+0000","last_active":"2023-07-27T14:32:22.307345+0000","last_peered":"2023-07-27T14:32:22.307345+0000","last_clean":"2023-07-27T14:32:22.307345+0000","last_became_active":"2023-07-27T14:32:21.859176+0000","last_became_peered":"2023-07-27T14:32:21.859176+0000","last_unstale":"2023-07-27T14:32:22.307345+0000","last_undegraded":"2023-07-27T14:32:22.307345+0000","last_fullsized":"2023-07-27T14:32:22.307345+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327943+0000","last_change":"2023-07-27T14:32:22.327943+0000","last_active":"2023-07-27T14:32:22.327943+0000","last_peered":"2023-07-27T14:32:22.327943+0000","last_clean":"2023-07-27T14:32:22.327943+0000","last_became_active":"2023-07-27T14:32:22.327634+0000","last_became_peered":"2023-07-27T14:32:22.327634+0000","last_unstale":"2023-07-27T14:32:22.327943+0000","last_undegraded":"2023-07-27T14:32:22.327943+0000","last_fullsized":"2023-07-27T14:32:22.327943+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328725+0000","last_change":"2023-07-27T14:32:21.859877+0000","last_active":"2023-07-27T14:32:22.328725+0000","last_peered":"2023-07-27T14:32:22.328725+0000","last_clean":"2023-07-27T14:32:22.328725+0000","last_became_active":"2023-07-27T14:32:21.859559+0000","last_became_peered":"2023-07-27T14:32:21.859559+0000","last_unstale":"2023-07-27T14:32:22.328725+0000","last_undegraded":"2023-07-27T14:32:22.328725+0000","last_fullsized":"2023-07-27T14:32:22.328725+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.324214+0000","last_change":"2023-07-27T14:32:22.319476+0000","last_active":"2023-07-27T14:32:22.324214+0000","last_peered":"2023-07-27T14:32:22.324214+0000","last_clean":"2023-07-27T14:32:22.324214+0000","last_became_active":"2023-07-27T14:32:22.319243+0000","last_became_peered":"2023-07-27T14:32:22.319243+0000","last_unstale":"2023-07-27T14:32:22.324214+0000","last_undegraded":"2023-07-27T14:32:22.324214+0000","last_fullsized":"2023-07-27T14:32:22.324214+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.311203+0000","last_change":"2023-07-27T14:32:21.859966+0000","last_active":"2023-07-27T14:32:22.311203+0000","last_peered":"2023-07-27T14:32:22.311203+0000","last_clean":"2023-07-27T14:32:22.311203+0000","last_became_active":"2023-07-27T14:32:21.859687+0000","last_became_peered":"2023-07-27T14:32:21.859687+0000","last_unstale":"2023-07-27T14:32:22.311203+0000","last_undegraded":"2023-07-27T14:32:22.311203+0000","last_fullsized":"2023-07-27T14:32:22.311203+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.318841+0000","last_change":"2023-07-27T14:32:22.318841+0000","last_active":"2023-07-27T14:32:22.318841+0000","last_peered":"2023-07-27T14:32:22.318841+0000","last_clean":"2023-07-27T14:32:22.318841+0000","last_became_active":"2023-07-27T14:32:22.318504+0000","last_became_peered":"2023-07-27T14:32:22.318504+0000","last_unstale":"2023-07-27T14:32:22.318841+0000","last_undegraded":"2023-07-27T14:32:22.318841+0000","last_fullsized":"2023-07-27T14:32:22.318841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305701+0000","last_change":"2023-07-27T14:32:21.859040+0000","last_active":"2023-07-27T14:32:22.305701+0000","last_peered":"2023-07-27T14:32:22.305701+0000","last_clean":"2023-07-27T14:32:22.305701+0000","last_became_active":"2023-07-27T14:32:21.858660+0000","last_became_peered":"2023-07-27T14:32:21.858660+0000","last_unstale":"2023-07-27T14:32:22.305701+0000","last_undegraded":"2023-07-27T14:32:22.305701+0000","last_fullsized":"2023-07-27T14:32:22.305701+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.333366+0000","last_change":"2023-07-27T14:32:22.329188+0000","last_active":"2023-07-27T14:32:22.333366+0000","last_peered":"2023-07-27T14:32:22.333366+0000","last_clean":"2023-07-27T14:32:22.333366+0000","last_became_active":"2023-07-27T14:32:22.328709+0000","last_became_peered":"2023-07-27T14:32:22.328709+0000","last_unstale":"2023-07-27T14:32:22.333366+0000","last_undegraded":"2023-07-27T14:32:22.333366+0000","last_fullsized":"2023-07-27T14:32:22.333366+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305020+0000","last_change":"2023-07-27T14:32:21.863667+0000","last_active":"2023-07-27T14:32:22.305020+0000","last_peered":"2023-07-27T14:32:22.305020+0000","last_clean":"2023-07-27T14:32:22.305020+0000","last_became_active":"2023-07-27T14:32:21.863401+0000","last_became_peered":"2023-07-27T14:32:21.863401+0000","last_unstale":"2023-07-27T14:32:22.305020+0000","last_undegraded":"2023-07-27T14:32:22.305020+0000","last_fullsized":"2023-07-27T14:32:22.305020+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.319481+0000","last_change":"2023-07-27T14:32:22.319481+0000","last_active":"2023-07-27T14:32:22.319481+0000","last_peered":"2023-07-27T14:32:22.319481+0000","last_clean":"2023-07-27T14:32:22.319481+0000","last_became_active":"2023-07-27T14:32:22.319158+0000","last_became_peered":"2023-07-27T14:32:22.319158+0000","last_unstale":"2023-07-27T14:32:22.319481+0000","last_undegraded":"2023-07-27T14:32:22.319481+0000","last_fullsized":"2023-07-27T14:32:22.319481+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.862910+0000","last_change":"2023-07-27T14:32:21.856929+0000","last_active":"2023-07-27T14:32:21.862910+0000","last_peered":"2023-07-27T14:32:21.862910+0000","last_clean":"2023-07-27T14:32:21.862910+0000","last_became_active":"2023-07-27T14:32:21.856658+0000","last_became_peered":"2023-07-27T14:32:21.856658+0000","last_unstale":"2023-07-27T14:32:21.862910+0000","last_undegraded":"2023-07-27T14:32:21.862910+0000","last_fullsized":"2023-07-27T14:32:21.862910+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330148+0000","last_change":"2023-07-27T14:32:22.328017+0000","last_active":"2023-07-27T14:32:22.330148+0000","last_peered":"2023-07-27T14:32:22.330148+0000","last_clean":"2023-07-27T14:32:22.330148+0000","last_became_active":"2023-07-27T14:32:22.327626+0000","last_became_peered":"2023-07-27T14:32:22.327626+0000","last_unstale":"2023-07-27T14:32:22.330148+0000","last_undegraded":"2023-07-27T14:32:22.330148+0000","last_fullsized":"2023-07-27T14:32:22.330148+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317565+0000","last_change":"2023-07-27T14:32:21.861832+0000","last_active":"2023-07-27T14:32:22.317565+0000","last_peered":"2023-07-27T14:32:22.317565+0000","last_clean":"2023-07-27T14:32:22.317565+0000","last_became_active":"2023-07-27T14:32:21.861546+0000","last_became_peered":"2023-07-27T14:32:21.861546+0000","last_unstale":"2023-07-27T14:32:22.317565+0000","last_undegraded":"2023-07-27T14:32:22.317565+0000","last_fullsized":"2023-07-27T14:32:22.317565+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.319602+0000","last_change":"2023-07-27T14:32:22.319602+0000","last_active":"2023-07-27T14:32:22.319602+0000","last_peered":"2023-07-27T14:32:22.319602+0000","last_clean":"2023-07-27T14:32:22.319602+0000","last_became_active":"2023-07-27T14:32:22.319344+0000","last_became_peered":"2023-07-27T14:32:22.319344+0000","last_unstale":"2023-07-27T14:32:22.319602+0000","last_undegraded":"2023-07-27T14:32:22.319602+0000","last_fullsized":"2023-07-27T14:32:22.319602+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"99'4","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.335077+0000","last_change":"2023-07-27T14:32:21.853722+0000","last_active":"2023-07-27T14:32:22.335077+0000","last_peered":"2023-07-27T14:32:22.335077+0000","last_clean":"2023-07-27T14:32:22.335077+0000","last_became_active":"2023-07-27T14:32:21.853432+0000","last_became_peered":"2023-07-27T14:32:21.853432+0000","last_unstale":"2023-07-27T14:32:22.335077+0000","last_undegraded":"2023-07-27T14:32:22.335077+0000","last_fullsized":"2023-07-27T14:32:22.335077+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332286+0000","last_change":"2023-07-27T14:32:22.325355+0000","last_active":"2023-07-27T14:32:22.332286+0000","last_peered":"2023-07-27T14:32:22.332286+0000","last_clean":"2023-07-27T14:32:22.332286+0000","last_became_active":"2023-07-27T14:32:22.324949+0000","last_became_peered":"2023-07-27T14:32:22.324949+0000","last_unstale":"2023-07-27T14:32:22.332286+0000","last_undegraded":"2023-07-27T14:32:22.332286+0000","last_fullsized":"2023-07-27T14:32:22.332286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.314464+0000","last_change":"2023-07-27T14:32:21.862959+0000","last_active":"2023-07-27T14:32:22.314464+0000","last_peered":"2023-07-27T14:32:22.314464+0000","last_clean":"2023-07-27T14:32:22.314464+0000","last_became_active":"2023-07-27T14:32:21.862647+0000","last_became_peered":"2023-07-27T14:32:21.862647+0000","last_unstale":"2023-07-27T14:32:22.314464+0000","last_undegraded":"2023-07-27T14:32:22.314464+0000","last_fullsized":"2023-07-27T14:32:22.314464+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332139+0000","last_change":"2023-07-27T14:32:22.323020+0000","last_active":"2023-07-27T14:32:22.332139+0000","last_peered":"2023-07-27T14:32:22.332139+0000","last_clean":"2023-07-27T14:32:22.332139+0000","last_became_active":"2023-07-27T14:32:22.322735+0000","last_became_peered":"2023-07-27T14:32:22.322735+0000","last_unstale":"2023-07-27T14:32:22.332139+0000","last_undegraded":"2023-07-27T14:32:22.332139+0000","last_fullsized":"2023-07-27T14:32:22.332139+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313570+0000","last_change":"2023-07-27T14:32:21.865060+0000","last_active":"2023-07-27T14:32:22.313570+0000","last_peered":"2023-07-27T14:32:22.313570+0000","last_clean":"2023-07-27T14:32:22.313570+0000","last_became_active":"2023-07-27T14:32:21.864508+0000","last_became_peered":"2023-07-27T14:32:21.864508+0000","last_unstale":"2023-07-27T14:32:22.313570+0000","last_undegraded":"2023-07-27T14:32:22.313570+0000","last_fullsized":"2023-07-27T14:32:22.313570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327882+0000","last_change":"2023-07-27T14:32:22.327882+0000","last_active":"2023-07-27T14:32:22.327882+0000","last_peered":"2023-07-27T14:32:22.327882+0000","last_clean":"2023-07-27T14:32:22.327882+0000","last_became_active":"2023-07-27T14:32:22.327593+0000","last_became_peered":"2023-07-27T14:32:22.327593+0000","last_unstale":"2023-07-27T14:32:22.327882+0000","last_undegraded":"2023-07-27T14:32:22.327882+0000","last_fullsized":"2023-07-27T14:32:22.327882+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.301682+0000","last_change":"2023-07-27T14:32:21.859236+0000","last_active":"2023-07-27T14:32:22.301682+0000","last_peered":"2023-07-27T14:32:22.301682+0000","last_clean":"2023-07-27T14:32:22.301682+0000","last_became_active":"2023-07-27T14:32:21.858946+0000","last_became_peered":"2023-07-27T14:32:21.858946+0000","last_unstale":"2023-07-27T14:32:22.301682+0000","last_undegraded":"2023-07-27T14:32:22.301682+0000","last_fullsized":"2023-07-27T14:32:22.301682+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334781+0000","last_change":"2023-07-27T14:32:22.328061+0000","last_active":"2023-07-27T14:32:22.334781+0000","last_peered":"2023-07-27T14:32:22.334781+0000","last_clean":"2023-07-27T14:32:22.334781+0000","last_became_active":"2023-07-27T14:32:22.327809+0000","last_became_peered":"2023-07-27T14:32:22.327809+0000","last_unstale":"2023-07-27T14:32:22.334781+0000","last_undegraded":"2023-07-27T14:32:22.334781+0000","last_fullsized":"2023-07-27T14:32:22.334781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"99'4","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330004+0000","last_change":"2023-07-27T14:32:21.857321+0000","last_active":"2023-07-27T14:32:22.330004+0000","last_peered":"2023-07-27T14:32:22.330004+0000","last_clean":"2023-07-27T14:32:22.330004+0000","last_became_active":"2023-07-27T14:32:21.857058+0000","last_became_peered":"2023-07-27T14:32:21.857058+0000","last_unstale":"2023-07-27T14:32:22.330004+0000","last_undegraded":"2023-07-27T14:32:22.330004+0000","last_fullsized":"2023-07-27T14:32:22.330004+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334881+0000","last_change":"2023-07-27T14:32:22.328666+0000","last_active":"2023-07-27T14:32:22.334881+0000","last_peered":"2023-07-27T14:32:22.334881+0000","last_clean":"2023-07-27T14:32:22.334881+0000","last_became_active":"2023-07-27T14:32:22.328421+0000","last_became_peered":"2023-07-27T14:32:22.328421+0000","last_unstale":"2023-07-27T14:32:22.334881+0000","last_undegraded":"2023-07-27T14:32:22.334881+0000","last_fullsized":"2023-07-27T14:32:22.334881+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.873914+0000","last_change":"2023-07-27T14:32:21.870175+0000","last_active":"2023-07-27T14:32:21.873914+0000","last_peered":"2023-07-27T14:32:21.873914+0000","last_clean":"2023-07-27T14:32:21.873914+0000","last_became_active":"2023-07-27T14:32:21.869880+0000","last_became_peered":"2023-07-27T14:32:21.869880+0000","last_unstale":"2023-07-27T14:32:21.873914+0000","last_undegraded":"2023-07-27T14:32:21.873914+0000","last_fullsized":"2023-07-27T14:32:21.873914+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328585+0000","last_change":"2023-07-27T14:32:22.328585+0000","last_active":"2023-07-27T14:32:22.328585+0000","last_peered":"2023-07-27T14:32:22.328585+0000","last_clean":"2023-07-27T14:32:22.328585+0000","last_became_active":"2023-07-27T14:32:22.327226+0000","last_became_peered":"2023-07-27T14:32:22.327226+0000","last_unstale":"2023-07-27T14:32:22.328585+0000","last_undegraded":"2023-07-27T14:32:22.328585+0000","last_fullsized":"2023-07-27T14:32:22.328585+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313569+0000","last_change":"2023-07-27T14:32:21.869897+0000","last_active":"2023-07-27T14:32:22.313569+0000","last_peered":"2023-07-27T14:32:22.313569+0000","last_clean":"2023-07-27T14:32:22.313569+0000","last_became_active":"2023-07-27T14:32:21.869600+0000","last_became_peered":"2023-07-27T14:32:21.869600+0000","last_unstale":"2023-07-27T14:32:22.313569+0000","last_undegraded":"2023-07-27T14:32:22.313569+0000","last_fullsized":"2023-07-27T14:32:22.313569+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322949+0000","last_change":"2023-07-27T14:32:22.316102+0000","last_active":"2023-07-27T14:32:22.322949+0000","last_peered":"2023-07-27T14:32:22.322949+0000","last_clean":"2023-07-27T14:32:22.322949+0000","last_became_active":"2023-07-27T14:32:22.315847+0000","last_became_peered":"2023-07-27T14:32:22.315847+0000","last_unstale":"2023-07-27T14:32:22.322949+0000","last_undegraded":"2023-07-27T14:32:22.322949+0000","last_fullsized":"2023-07-27T14:32:22.322949+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.323648+0000","last_change":"2023-07-27T14:32:21.858912+0000","last_active":"2023-07-27T14:32:22.323648+0000","last_peered":"2023-07-27T14:32:22.323648+0000","last_clean":"2023-07-27T14:32:22.323648+0000","last_became_active":"2023-07-27T14:32:21.855292+0000","last_became_peered":"2023-07-27T14:32:21.855292+0000","last_unstale":"2023-07-27T14:32:22.323648+0000","last_undegraded":"2023-07-27T14:32:22.323648+0000","last_fullsized":"2023-07-27T14:32:22.323648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332322+0000","last_change":"2023-07-27T14:32:22.324388+0000","last_active":"2023-07-27T14:32:22.332322+0000","last_peered":"2023-07-27T14:32:22.332322+0000","last_clean":"2023-07-27T14:32:22.332322+0000","last_became_active":"2023-07-27T14:32:22.323104+0000","last_became_peered":"2023-07-27T14:32:22.323104+0000","last_unstale":"2023-07-27T14:32:22.332322+0000","last_undegraded":"2023-07-27T14:32:22.332322+0000","last_fullsized":"2023-07-27T14:32:22.332322+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.314174+0000","last_change":"2023-07-27T14:32:21.863858+0000","last_active":"2023-07-27T14:32:22.314174+0000","last_peered":"2023-07-27T14:32:22.314174+0000","last_clean":"2023-07-27T14:32:22.314174+0000","last_became_active":"2023-07-27T14:32:21.863600+0000","last_became_peered":"2023-07-27T14:32:21.863600+0000","last_unstale":"2023-07-27T14:32:22.314174+0000","last_undegraded":"2023-07-27T14:32:22.314174+0000","last_fullsized":"2023-07-27T14:32:22.314174+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.321460+0000","last_change":"2023-07-27T14:32:22.316498+0000","last_active":"2023-07-27T14:32:22.321460+0000","last_peered":"2023-07-27T14:32:22.321460+0000","last_clean":"2023-07-27T14:32:22.321460+0000","last_became_active":"2023-07-27T14:32:22.315699+0000","last_became_peered":"2023-07-27T14:32:22.315699+0000","last_unstale":"2023-07-27T14:32:22.321460+0000","last_undegraded":"2023-07-27T14:32:22.321460+0000","last_fullsized":"2023-07-27T14:32:22.321460+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327597+0000","last_change":"2023-07-27T14:32:21.866805+0000","last_active":"2023-07-27T14:32:22.327597+0000","last_peered":"2023-07-27T14:32:22.327597+0000","last_clean":"2023-07-27T14:32:22.327597+0000","last_became_active":"2023-07-27T14:32:21.866508+0000","last_became_peered":"2023-07-27T14:32:21.866508+0000","last_unstale":"2023-07-27T14:32:22.327597+0000","last_undegraded":"2023-07-27T14:32:22.327597+0000","last_fullsized":"2023-07-27T14:32:22.327597+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326762+0000","last_change":"2023-07-27T14:32:22.326762+0000","last_active":"2023-07-27T14:32:22.326762+0000","last_peered":"2023-07-27T14:32:22.326762+0000","last_clean":"2023-07-27T14:32:22.326762+0000","last_became_active":"2023-07-27T14:32:22.326279+0000","last_became_peered":"2023-07-27T14:32:22.326279+0000","last_unstale":"2023-07-27T14:32:22.326762+0000","last_undegraded":"2023-07-27T14:32:22.326762+0000","last_fullsized":"2023-07-27T14:32:22.326762+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317796+0000","last_change":"2023-07-27T14:32:21.864391+0000","last_active":"2023-07-27T14:32:22.317796+0000","last_peered":"2023-07-27T14:32:22.317796+0000","last_clean":"2023-07-27T14:32:22.317796+0000","last_became_active":"2023-07-27T14:32:21.863866+0000","last_became_peered":"2023-07-27T14:32:21.863866+0000","last_unstale":"2023-07-27T14:32:22.317796+0000","last_undegraded":"2023-07-27T14:32:22.317796+0000","last_fullsized":"2023-07-27T14:32:22.317796+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327669+0000","last_change":"2023-07-27T14:32:22.327669+0000","last_active":"2023-07-27T14:32:22.327669+0000","last_peered":"2023-07-27T14:32:22.327669+0000","last_clean":"2023-07-27T14:32:22.327669+0000","last_became_active":"2023-07-27T14:32:22.327350+0000","last_became_peered":"2023-07-27T14:32:22.327350+0000","last_unstale":"2023-07-27T14:32:22.327669+0000","last_undegraded":"2023-07-27T14:32:22.327669+0000","last_fullsized":"2023-07-27T14:32:22.327669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866269+0000","last_change":"2023-07-27T14:32:21.864070+0000","last_active":"2023-07-27T14:32:21.866269+0000","last_peered":"2023-07-27T14:32:21.866269+0000","last_clean":"2023-07-27T14:32:21.866269+0000","last_became_active":"2023-07-27T14:32:21.863794+0000","last_became_peered":"2023-07-27T14:32:21.863794+0000","last_unstale":"2023-07-27T14:32:21.866269+0000","last_undegraded":"2023-07-27T14:32:21.866269+0000","last_fullsized":"2023-07-27T14:32:21.866269+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.316468+0000","last_change":"2023-07-27T14:32:22.316468+0000","last_active":"2023-07-27T14:32:22.316468+0000","last_peered":"2023-07-27T14:32:22.316468+0000","last_clean":"2023-07-27T14:32:22.316468+0000","last_became_active":"2023-07-27T14:32:22.316146+0000","last_became_peered":"2023-07-27T14:32:22.316146+0000","last_unstale":"2023-07-27T14:32:22.316468+0000","last_undegraded":"2023-07-27T14:32:22.316468+0000","last_fullsized":"2023-07-27T14:32:22.316468+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.311388+0000","last_change":"2023-07-27T14:32:21.864783+0000","last_active":"2023-07-27T14:32:22.311388+0000","last_peered":"2023-07-27T14:32:22.311388+0000","last_clean":"2023-07-27T14:32:22.311388+0000","last_became_active":"2023-07-27T14:32:21.864206+0000","last_became_peered":"2023-07-27T14:32:21.864206+0000","last_unstale":"2023-07-27T14:32:22.311388+0000","last_undegraded":"2023-07-27T14:32:22.311388+0000","last_fullsized":"2023-07-27T14:32:22.311388+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332099+0000","last_change":"2023-07-27T14:32:22.323849+0000","last_active":"2023-07-27T14:32:22.332099+0000","last_peered":"2023-07-27T14:32:22.332099+0000","last_clean":"2023-07-27T14:32:22.332099+0000","last_became_active":"2023-07-27T14:32:22.323584+0000","last_became_peered":"2023-07-27T14:32:22.323584+0000","last_unstale":"2023-07-27T14:32:22.332099+0000","last_undegraded":"2023-07-27T14:32:22.332099+0000","last_fullsized":"2023-07-27T14:32:22.332099+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317901+0000","last_change":"2023-07-27T14:32:21.854001+0000","last_active":"2023-07-27T14:32:22.317901+0000","last_peered":"2023-07-27T14:32:22.317901+0000","last_clean":"2023-07-27T14:32:22.317901+0000","last_became_active":"2023-07-27T14:32:21.853736+0000","last_became_peered":"2023-07-27T14:32:21.853736+0000","last_unstale":"2023-07-27T14:32:22.317901+0000","last_undegraded":"2023-07-27T14:32:22.317901+0000","last_fullsized":"2023-07-27T14:32:22.317901+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325685+0000","last_change":"2023-07-27T14:32:22.322273+0000","last_active":"2023-07-27T14:32:22.325685+0000","last_peered":"2023-07-27T14:32:22.325685+0000","last_clean":"2023-07-27T14:32:22.325685+0000","last_became_active":"2023-07-27T14:32:22.321933+0000","last_became_peered":"2023-07-27T14:32:22.321933+0000","last_unstale":"2023-07-27T14:32:22.325685+0000","last_undegraded":"2023-07-27T14:32:22.325685+0000","last_fullsized":"2023-07-27T14:32:22.325685+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.865609+0000","last_change":"2023-07-27T14:32:21.859370+0000","last_active":"2023-07-27T14:32:21.865609+0000","last_peered":"2023-07-27T14:32:21.865609+0000","last_clean":"2023-07-27T14:32:21.865609+0000","last_became_active":"2023-07-27T14:32:21.858665+0000","last_became_peered":"2023-07-27T14:32:21.858665+0000","last_unstale":"2023-07-27T14:32:21.865609+0000","last_undegraded":"2023-07-27T14:32:21.865609+0000","last_fullsized":"2023-07-27T14:32:21.865609+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322883+0000","last_change":"2023-07-27T14:32:22.322883+0000","last_active":"2023-07-27T14:32:22.322883+0000","last_peered":"2023-07-27T14:32:22.322883+0000","last_clean":"2023-07-27T14:32:22.322883+0000","last_became_active":"2023-07-27T14:32:22.322526+0000","last_became_peered":"2023-07-27T14:32:22.322526+0000","last_unstale":"2023-07-27T14:32:22.322883+0000","last_undegraded":"2023-07-27T14:32:22.322883+0000","last_fullsized":"2023-07-27T14:32:22.322883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866356+0000","last_change":"2023-07-27T14:32:21.859036+0000","last_active":"2023-07-27T14:32:21.866356+0000","last_peered":"2023-07-27T14:32:21.866356+0000","last_clean":"2023-07-27T14:32:21.866356+0000","last_became_active":"2023-07-27T14:32:21.858767+0000","last_became_peered":"2023-07-27T14:32:21.858767+0000","last_unstale":"2023-07-27T14:32:21.866356+0000","last_undegraded":"2023-07-27T14:32:21.866356+0000","last_fullsized":"2023-07-27T14:32:21.866356+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.318892+0000","last_change":"2023-07-27T14:32:22.318018+0000","last_active":"2023-07-27T14:32:22.318892+0000","last_peered":"2023-07-27T14:32:22.318892+0000","last_clean":"2023-07-27T14:32:22.318892+0000","last_became_active":"2023-07-27T14:32:22.317695+0000","last_became_peered":"2023-07-27T14:32:22.317695+0000","last_unstale":"2023-07-27T14:32:22.318892+0000","last_undegraded":"2023-07-27T14:32:22.318892+0000","last_fullsized":"2023-07-27T14:32:22.318892+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.865295+0000","last_change":"2023-07-27T14:32:21.860498+0000","last_active":"2023-07-27T14:32:21.865295+0000","last_peered":"2023-07-27T14:32:21.865295+0000","last_clean":"2023-07-27T14:32:21.865295+0000","last_became_active":"2023-07-27T14:32:21.859871+0000","last_became_peered":"2023-07-27T14:32:21.859871+0000","last_unstale":"2023-07-27T14:32:21.865295+0000","last_undegraded":"2023-07-27T14:32:21.865295+0000","last_fullsized":"2023-07-27T14:32:21.865295+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332268+0000","last_change":"2023-07-27T14:32:22.325196+0000","last_active":"2023-07-27T14:32:22.332268+0000","last_peered":"2023-07-27T14:32:22.332268+0000","last_clean":"2023-07-27T14:32:22.332268+0000","last_became_active":"2023-07-27T14:32:22.324625+0000","last_became_peered":"2023-07-27T14:32:22.324625+0000","last_unstale":"2023-07-27T14:32:22.332268+0000","last_undegraded":"2023-07-27T14:32:22.332268+0000","last_fullsized":"2023-07-27T14:32:22.332268+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317659+0000","last_change":"2023-07-27T14:32:21.860793+0000","last_active":"2023-07-27T14:32:22.317659+0000","last_peered":"2023-07-27T14:32:22.317659+0000","last_clean":"2023-07-27T14:32:22.317659+0000","last_became_active":"2023-07-27T14:32:21.860306+0000","last_became_peered":"2023-07-27T14:32:21.860306+0000","last_unstale":"2023-07-27T14:32:22.317659+0000","last_undegraded":"2023-07-27T14:32:22.317659+0000","last_fullsized":"2023-07-27T14:32:22.317659+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326503+0000","last_change":"2023-07-27T14:32:22.324342+0000","last_active":"2023-07-27T14:32:22.326503+0000","last_peered":"2023-07-27T14:32:22.326503+0000","last_clean":"2023-07-27T14:32:22.326503+0000","last_became_active":"2023-07-27T14:32:22.324014+0000","last_became_peered":"2023-07-27T14:32:22.324014+0000","last_unstale":"2023-07-27T14:32:22.326503+0000","last_undegraded":"2023-07-27T14:32:22.326503+0000","last_fullsized":"2023-07-27T14:32:22.326503+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317894+0000","last_change":"2023-07-27T14:32:21.862504+0000","last_active":"2023-07-27T14:32:22.317894+0000","last_peered":"2023-07-27T14:32:22.317894+0000","last_clean":"2023-07-27T14:32:22.317894+0000","last_became_active":"2023-07-27T14:32:21.862042+0000","last_became_peered":"2023-07-27T14:32:21.862042+0000","last_unstale":"2023-07-27T14:32:22.317894+0000","last_undegraded":"2023-07-27T14:32:22.317894+0000","last_fullsized":"2023-07-27T14:32:22.317894+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313166+0000","last_change":"2023-07-27T14:32:22.313166+0000","last_active":"2023-07-27T14:32:22.313166+0000","last_peered":"2023-07-27T14:32:22.313166+0000","last_clean":"2023-07-27T14:32:22.313166+0000","last_became_active":"2023-07-27T14:32:22.312847+0000","last_became_peered":"2023-07-27T14:32:22.312847+0000","last_unstale":"2023-07-27T14:32:22.313166+0000","last_undegraded":"2023-07-27T14:32:22.313166+0000","last_fullsized":"2023-07-27T14:32:22.313166+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.860220+0000","last_change":"2023-07-27T14:32:21.856311+0000","last_active":"2023-07-27T14:32:21.860220+0000","last_peered":"2023-07-27T14:32:21.860220+0000","last_clean":"2023-07-27T14:32:21.860220+0000","last_became_active":"2023-07-27T14:32:21.856046+0000","last_became_peered":"2023-07-27T14:32:21.856046+0000","last_unstale":"2023-07-27T14:32:21.860220+0000","last_undegraded":"2023-07-27T14:32:21.860220+0000","last_fullsized":"2023-07-27T14:32:21.860220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.329557+0000","last_change":"2023-07-27T14:32:22.329557+0000","last_active":"2023-07-27T14:32:22.329557+0000","last_peered":"2023-07-27T14:32:22.329557+0000","last_clean":"2023-07-27T14:32:22.329557+0000","last_became_active":"2023-07-27T14:32:22.329158+0000","last_became_peered":"2023-07-27T14:32:22.329158+0000","last_unstale":"2023-07-27T14:32:22.329557+0000","last_undegraded":"2023-07-27T14:32:22.329557+0000","last_fullsized":"2023-07-27T14:32:22.329557+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866214+0000","last_change":"2023-07-27T14:32:21.863680+0000","last_active":"2023-07-27T14:32:21.866214+0000","last_peered":"2023-07-27T14:32:21.866214+0000","last_clean":"2023-07-27T14:32:21.866214+0000","last_became_active":"2023-07-27T14:32:21.863401+0000","last_became_peered":"2023-07-27T14:32:21.863401+0000","last_unstale":"2023-07-27T14:32:21.866214+0000","last_undegraded":"2023-07-27T14:32:21.866214+0000","last_fullsized":"2023-07-27T14:32:21.866214+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322908+0000","last_change":"2023-07-27T14:32:22.312687+0000","last_active":"2023-07-27T14:32:22.322908+0000","last_peered":"2023-07-27T14:32:22.322908+0000","last_clean":"2023-07-27T14:32:22.322908+0000","last_became_active":"2023-07-27T14:32:22.312445+0000","last_became_peered":"2023-07-27T14:32:22.312445+0000","last_unstale":"2023-07-27T14:32:22.322908+0000","last_undegraded":"2023-07-27T14:32:22.322908+0000","last_fullsized":"2023-07-27T14:32:22.322908+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.311004+0000","last_change":"2023-07-27T14:32:21.864546+0000","last_active":"2023-07-27T14:32:22.311004+0000","last_peered":"2023-07-27T14:32:22.311004+0000","last_clean":"2023-07-27T14:32:22.311004+0000","last_became_active":"2023-07-27T14:32:21.864180+0000","last_became_peered":"2023-07-27T14:32:21.864180+0000","last_unstale":"2023-07-27T14:32:22.311004+0000","last_undegraded":"2023-07-27T14:32:22.311004+0000","last_fullsized":"2023-07-27T14:32:22.311004+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334605+0000","last_change":"2023-07-27T14:32:22.329450+0000","last_active":"2023-07-27T14:32:22.334605+0000","last_peered":"2023-07-27T14:32:22.334605+0000","last_clean":"2023-07-27T14:32:22.334605+0000","last_became_active":"2023-07-27T14:32:22.329204+0000","last_became_peered":"2023-07-27T14:32:22.329204+0000","last_unstale":"2023-07-27T14:32:22.334605+0000","last_undegraded":"2023-07-27T14:32:22.334605+0000","last_fullsized":"2023-07-27T14:32:22.334605+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.309238+0000","last_change":"2023-07-27T14:32:21.861282+0000","last_active":"2023-07-27T14:32:22.309238+0000","last_peered":"2023-07-27T14:32:22.309238+0000","last_clean":"2023-07-27T14:32:22.309238+0000","last_became_active":"2023-07-27T14:32:21.860855+0000","last_became_peered":"2023-07-27T14:32:21.860855+0000","last_unstale":"2023-07-27T14:32:22.309238+0000","last_undegraded":"2023-07-27T14:32:22.309238+0000","last_fullsized":"2023-07-27T14:32:22.309238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322982+0000","last_change":"2023-07-27T14:32:22.322982+0000","last_active":"2023-07-27T14:32:22.322982+0000","last_peered":"2023-07-27T14:32:22.322982+0000","last_clean":"2023-07-27T14:32:22.322982+0000","last_became_active":"2023-07-27T14:32:22.322647+0000","last_became_peered":"2023-07-27T14:32:22.322647+0000","last_unstale":"2023-07-27T14:32:22.322982+0000","last_undegraded":"2023-07-27T14:32:22.322982+0000","last_fullsized":"2023-07-27T14:32:22.322982+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"99'2","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328565+0000","last_change":"2023-07-27T14:32:21.866007+0000","last_active":"2023-07-27T14:32:22.328565+0000","last_peered":"2023-07-27T14:32:22.328565+0000","last_clean":"2023-07-27T14:32:22.328565+0000","last_became_active":"2023-07-27T14:32:21.865679+0000","last_became_peered":"2023-07-27T14:32:21.865679+0000","last_unstale":"2023-07-27T14:32:22.328565+0000","last_undegraded":"2023-07-27T14:32:22.328565+0000","last_fullsized":"2023-07-27T14:32:22.328565+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.323528+0000","last_change":"2023-07-27T14:32:22.318537+0000","last_active":"2023-07-27T14:32:22.323528+0000","last_peered":"2023-07-27T14:32:22.323528+0000","last_clean":"2023-07-27T14:32:22.323528+0000","last_became_active":"2023-07-27T14:32:22.318289+0000","last_became_peered":"2023-07-27T14:32:22.318289+0000","last_unstale":"2023-07-27T14:32:22.323528+0000","last_undegraded":"2023-07-27T14:32:22.323528+0000","last_fullsized":"2023-07-27T14:32:22.323528+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.865218+0000","last_change":"2023-07-27T14:32:21.859349+0000","last_active":"2023-07-27T14:32:21.865218+0000","last_peered":"2023-07-27T14:32:21.865218+0000","last_clean":"2023-07-27T14:32:21.865218+0000","last_became_active":"2023-07-27T14:32:21.859083+0000","last_became_peered":"2023-07-27T14:32:21.859083+0000","last_unstale":"2023-07-27T14:32:21.865218+0000","last_undegraded":"2023-07-27T14:32:21.865218+0000","last_fullsized":"2023-07-27T14:32:21.865218+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334691+0000","last_change":"2023-07-27T14:32:22.324839+0000","last_active":"2023-07-27T14:32:22.334691+0000","last_peered":"2023-07-27T14:32:22.334691+0000","last_clean":"2023-07-27T14:32:22.334691+0000","last_became_active":"2023-07-27T14:32:22.324391+0000","last_became_peered":"2023-07-27T14:32:22.324391+0000","last_unstale":"2023-07-27T14:32:22.334691+0000","last_undegraded":"2023-07-27T14:32:22.334691+0000","last_fullsized":"2023-07-27T14:32:22.334691+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.873920+0000","last_change":"2023-07-27T14:32:21.870237+0000","last_active":"2023-07-27T14:32:21.873920+0000","last_peered":"2023-07-27T14:32:21.873920+0000","last_clean":"2023-07-27T14:32:21.873920+0000","last_became_active":"2023-07-27T14:32:21.869941+0000","last_became_peered":"2023-07-27T14:32:21.869941+0000","last_unstale":"2023-07-27T14:32:21.873920+0000","last_undegraded":"2023-07-27T14:32:21.873920+0000","last_fullsized":"2023-07-27T14:32:21.873920+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326568+0000","last_change":"2023-07-27T14:32:22.326568+0000","last_active":"2023-07-27T14:32:22.326568+0000","last_peered":"2023-07-27T14:32:22.326568+0000","last_clean":"2023-07-27T14:32:22.326568+0000","last_became_active":"2023-07-27T14:32:22.325856+0000","last_became_peered":"2023-07-27T14:32:22.325856+0000","last_unstale":"2023-07-27T14:32:22.326568+0000","last_undegraded":"2023-07-27T14:32:22.326568+0000","last_fullsized":"2023-07-27T14:32:22.326568+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317993+0000","last_change":"2023-07-27T14:32:21.868762+0000","last_active":"2023-07-27T14:32:22.317993+0000","last_peered":"2023-07-27T14:32:22.317993+0000","last_clean":"2023-07-27T14:32:22.317993+0000","last_became_active":"2023-07-27T14:32:21.866858+0000","last_became_peered":"2023-07-27T14:32:21.866858+0000","last_unstale":"2023-07-27T14:32:22.317993+0000","last_undegraded":"2023-07-27T14:32:22.317993+0000","last_fullsized":"2023-07-27T14:32:22.317993+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.324187+0000","last_change":"2023-07-27T14:32:22.319458+0000","last_active":"2023-07-27T14:32:22.324187+0000","last_peered":"2023-07-27T14:32:22.324187+0000","last_clean":"2023-07-27T14:32:22.324187+0000","last_became_active":"2023-07-27T14:32:22.319209+0000","last_became_peered":"2023-07-27T14:32:22.319209+0000","last_unstale":"2023-07-27T14:32:22.324187+0000","last_undegraded":"2023-07-27T14:32:22.324187+0000","last_fullsized":"2023-07-27T14:32:22.324187+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.301780+0000","last_change":"2023-07-27T14:32:21.857070+0000","last_active":"2023-07-27T14:32:22.301780+0000","last_peered":"2023-07-27T14:32:22.301780+0000","last_clean":"2023-07-27T14:32:22.301780+0000","last_became_active":"2023-07-27T14:32:21.856813+0000","last_became_peered":"2023-07-27T14:32:21.856813+0000","last_unstale":"2023-07-27T14:32:22.301780+0000","last_undegraded":"2023-07-27T14:32:22.301780+0000","last_fullsized":"2023-07-27T14:32:22.301780+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325148+0000","last_change":"2023-07-27T14:32:22.319742+0000","last_active":"2023-07-27T14:32:22.325148+0000","last_peered":"2023-07-27T14:32:22.325148+0000","last_clean":"2023-07-27T14:32:22.325148+0000","last_became_active":"2023-07-27T14:32:22.318523+0000","last_became_peered":"2023-07-27T14:32:22.318523+0000","last_unstale":"2023-07-27T14:32:22.325148+0000","last_undegraded":"2023-07-27T14:32:22.325148+0000","last_fullsized":"2023-07-27T14:32:22.325148+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866947+0000","last_change":"2023-07-27T14:32:21.863998+0000","last_active":"2023-07-27T14:32:21.866947+0000","last_peered":"2023-07-27T14:32:21.866947+0000","last_clean":"2023-07-27T14:32:21.866947+0000","last_became_active":"2023-07-27T14:32:21.863525+0000","last_became_peered":"2023-07-27T14:32:21.863525+0000","last_unstale":"2023-07-27T14:32:21.866947+0000","last_undegraded":"2023-07-27T14:32:21.866947+0000","last_fullsized":"2023-07-27T14:32:21.866947+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325103+0000","last_change":"2023-07-27T14:32:22.325103+0000","last_active":"2023-07-27T14:32:22.325103+0000","last_peered":"2023-07-27T14:32:22.325103+0000","last_clean":"2023-07-27T14:32:22.325103+0000","last_became_active":"2023-07-27T14:32:22.324624+0000","last_became_peered":"2023-07-27T14:32:22.324624+0000","last_unstale":"2023-07-27T14:32:22.325103+0000","last_undegraded":"2023-07-27T14:32:22.325103+0000","last_fullsized":"2023-07-27T14:32:22.325103+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305118+0000","last_change":"2023-07-27T14:32:21.866143+0000","last_active":"2023-07-27T14:32:22.305118+0000","last_peered":"2023-07-27T14:32:22.305118+0000","last_clean":"2023-07-27T14:32:22.305118+0000","last_became_active":"2023-07-27T14:32:21.865841+0000","last_became_peered":"2023-07-27T14:32:21.865841+0000","last_unstale":"2023-07-27T14:32:22.305118+0000","last_undegraded":"2023-07-27T14:32:22.305118+0000","last_fullsized":"2023-07-27T14:32:22.305118+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.331669+0000","last_change":"2023-07-27T14:32:22.331669+0000","last_active":"2023-07-27T14:32:22.331669+0000","last_peered":"2023-07-27T14:32:22.331669+0000","last_clean":"2023-07-27T14:32:22.331669+0000","last_became_active":"2023-07-27T14:32:22.331356+0000","last_became_peered":"2023-07-27T14:32:22.331356+0000","last_unstale":"2023-07-27T14:32:22.331669+0000","last_undegraded":"2023-07-27T14:32:22.331669+0000","last_fullsized":"2023-07-27T14:32:22.331669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.302395+0000","last_change":"2023-07-27T14:32:21.861878+0000","last_active":"2023-07-27T14:32:22.302395+0000","last_peered":"2023-07-27T14:32:22.302395+0000","last_clean":"2023-07-27T14:32:22.302395+0000","last_became_active":"2023-07-27T14:32:21.861588+0000","last_became_peered":"2023-07-27T14:32:21.861588+0000","last_unstale":"2023-07-27T14:32:22.302395+0000","last_undegraded":"2023-07-27T14:32:22.302395+0000","last_fullsized":"2023-07-27T14:32:22.302395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322925+0000","last_change":"2023-07-27T14:32:22.312758+0000","last_active":"2023-07-27T14:32:22.322925+0000","last_peered":"2023-07-27T14:32:22.322925+0000","last_clean":"2023-07-27T14:32:22.322925+0000","last_became_active":"2023-07-27T14:32:22.312485+0000","last_became_peered":"2023-07-27T14:32:22.312485+0000","last_unstale":"2023-07-27T14:32:22.322925+0000","last_undegraded":"2023-07-27T14:32:22.322925+0000","last_fullsized":"2023-07-27T14:32:22.322925+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"99'3","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330961+0000","last_change":"2023-07-27T14:32:21.860643+0000","last_active":"2023-07-27T14:32:22.330961+0000","last_peered":"2023-07-27T14:32:22.330961+0000","last_clean":"2023-07-27T14:32:22.330961+0000","last_became_active":"2023-07-27T14:32:21.860229+0000","last_became_peered":"2023-07-27T14:32:21.860229+0000","last_unstale":"2023-07-27T14:32:22.330961+0000","last_undegraded":"2023-07-27T14:32:22.330961+0000","last_fullsized":"2023-07-27T14:32:22.330961+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.327113+0000","last_change":"2023-07-27T14:32:22.318762+0000","last_active":"2023-07-27T14:32:22.327113+0000","last_peered":"2023-07-27T14:32:22.327113+0000","last_clean":"2023-07-27T14:32:22.327113+0000","last_became_active":"2023-07-27T14:32:22.318487+0000","last_became_peered":"2023-07-27T14:32:22.318487+0000","last_unstale":"2023-07-27T14:32:22.327113+0000","last_undegraded":"2023-07-27T14:32:22.327113+0000","last_fullsized":"2023-07-27T14:32:22.327113+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"99'2","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.323059+0000","last_change":"2023-07-27T14:32:21.859824+0000","last_active":"2023-07-27T14:32:22.323059+0000","last_peered":"2023-07-27T14:32:22.323059+0000","last_clean":"2023-07-27T14:32:22.323059+0000","last_became_active":"2023-07-27T14:32:21.859438+0000","last_became_peered":"2023-07-27T14:32:21.859438+0000","last_unstale":"2023-07-27T14:32:22.323059+0000","last_undegraded":"2023-07-27T14:32:22.323059+0000","last_fullsized":"2023-07-27T14:32:22.323059+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325573+0000","last_change":"2023-07-27T14:32:22.319411+0000","last_active":"2023-07-27T14:32:22.325573+0000","last_peered":"2023-07-27T14:32:22.325573+0000","last_clean":"2023-07-27T14:32:22.325573+0000","last_became_active":"2023-07-27T14:32:22.319154+0000","last_became_peered":"2023-07-27T14:32:22.319154+0000","last_unstale":"2023-07-27T14:32:22.325573+0000","last_undegraded":"2023-07-27T14:32:22.325573+0000","last_fullsized":"2023-07-27T14:32:22.325573+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.314566+0000","last_change":"2023-07-27T14:32:21.863663+0000","last_active":"2023-07-27T14:32:22.314566+0000","last_peered":"2023-07-27T14:32:22.314566+0000","last_clean":"2023-07-27T14:32:22.314566+0000","last_became_active":"2023-07-27T14:32:21.863371+0000","last_became_peered":"2023-07-27T14:32:21.863371+0000","last_unstale":"2023-07-27T14:32:22.314566+0000","last_undegraded":"2023-07-27T14:32:22.314566+0000","last_fullsized":"2023-07-27T14:32:22.314566+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.318845+0000","last_change":"2023-07-27T14:32:22.318845+0000","last_active":"2023-07-27T14:32:22.318845+0000","last_peered":"2023-07-27T14:32:22.318845+0000","last_clean":"2023-07-27T14:32:22.318845+0000","last_became_active":"2023-07-27T14:32:22.318534+0000","last_became_peered":"2023-07-27T14:32:22.318534+0000","last_unstale":"2023-07-27T14:32:22.318845+0000","last_undegraded":"2023-07-27T14:32:22.318845+0000","last_fullsized":"2023-07-27T14:32:22.318845+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.306449+0000","last_change":"2023-07-27T14:32:21.860479+0000","last_active":"2023-07-27T14:32:22.306449+0000","last_peered":"2023-07-27T14:32:22.306449+0000","last_clean":"2023-07-27T14:32:22.306449+0000","last_became_active":"2023-07-27T14:32:21.860133+0000","last_became_peered":"2023-07-27T14:32:21.860133+0000","last_unstale":"2023-07-27T14:32:22.306449+0000","last_undegraded":"2023-07-27T14:32:22.306449+0000","last_fullsized":"2023-07-27T14:32:22.306449+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.329937+0000","last_change":"2023-07-27T14:32:22.327019+0000","last_active":"2023-07-27T14:32:22.329937+0000","last_peered":"2023-07-27T14:32:22.329937+0000","last_clean":"2023-07-27T14:32:22.329937+0000","last_became_active":"2023-07-27T14:32:22.326720+0000","last_became_peered":"2023-07-27T14:32:22.326720+0000","last_unstale":"2023-07-27T14:32:22.329937+0000","last_undegraded":"2023-07-27T14:32:22.329937+0000","last_fullsized":"2023-07-27T14:32:22.329937+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317828+0000","last_change":"2023-07-27T14:32:21.859742+0000","last_active":"2023-07-27T14:32:22.317828+0000","last_peered":"2023-07-27T14:32:22.317828+0000","last_clean":"2023-07-27T14:32:22.317828+0000","last_became_active":"2023-07-27T14:32:21.859412+0000","last_became_peered":"2023-07-27T14:32:21.859412+0000","last_unstale":"2023-07-27T14:32:22.317828+0000","last_undegraded":"2023-07-27T14:32:22.317828+0000","last_fullsized":"2023-07-27T14:32:22.317828+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330051+0000","last_change":"2023-07-27T14:32:22.328030+0000","last_active":"2023-07-27T14:32:22.330051+0000","last_peered":"2023-07-27T14:32:22.330051+0000","last_clean":"2023-07-27T14:32:22.330051+0000","last_became_active":"2023-07-27T14:32:22.327758+0000","last_became_peered":"2023-07-27T14:32:22.327758+0000","last_unstale":"2023-07-27T14:32:22.330051+0000","last_undegraded":"2023-07-27T14:32:22.330051+0000","last_fullsized":"2023-07-27T14:32:22.330051+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"99'4","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.335053+0000","last_change":"2023-07-27T14:32:21.868455+0000","last_active":"2023-07-27T14:32:22.335053+0000","last_peered":"2023-07-27T14:32:22.335053+0000","last_clean":"2023-07-27T14:32:22.335053+0000","last_became_active":"2023-07-27T14:32:21.867797+0000","last_became_peered":"2023-07-27T14:32:21.867797+0000","last_unstale":"2023-07-27T14:32:22.335053+0000","last_undegraded":"2023-07-27T14:32:22.335053+0000","last_fullsized":"2023-07-27T14:32:22.335053+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317143+0000","last_change":"2023-07-27T14:32:22.317143+0000","last_active":"2023-07-27T14:32:22.317143+0000","last_peered":"2023-07-27T14:32:22.317143+0000","last_clean":"2023-07-27T14:32:22.317143+0000","last_became_active":"2023-07-27T14:32:22.316501+0000","last_became_peered":"2023-07-27T14:32:22.316501+0000","last_unstale":"2023-07-27T14:32:22.317143+0000","last_undegraded":"2023-07-27T14:32:22.317143+0000","last_fullsized":"2023-07-27T14:32:22.317143+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"99'2","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.330981+0000","last_change":"2023-07-27T14:32:21.855779+0000","last_active":"2023-07-27T14:32:22.330981+0000","last_peered":"2023-07-27T14:32:22.330981+0000","last_clean":"2023-07-27T14:32:22.330981+0000","last_became_active":"2023-07-27T14:32:21.855489+0000","last_became_peered":"2023-07-27T14:32:21.855489+0000","last_unstale":"2023-07-27T14:32:22.330981+0000","last_undegraded":"2023-07-27T14:32:22.330981+0000","last_fullsized":"2023-07-27T14:32:22.330981+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.323740+0000","last_change":"2023-07-27T14:32:22.319894+0000","last_active":"2023-07-27T14:32:22.323740+0000","last_peered":"2023-07-27T14:32:22.323740+0000","last_clean":"2023-07-27T14:32:22.323740+0000","last_became_active":"2023-07-27T14:32:22.319634+0000","last_became_peered":"2023-07-27T14:32:22.319634+0000","last_unstale":"2023-07-27T14:32:22.323740+0000","last_undegraded":"2023-07-27T14:32:22.323740+0000","last_fullsized":"2023-07-27T14:32:22.323740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866637+0000","last_change":"2023-07-27T14:32:21.861114+0000","last_active":"2023-07-27T14:32:21.866637+0000","last_peered":"2023-07-27T14:32:21.866637+0000","last_clean":"2023-07-27T14:32:21.866637+0000","last_became_active":"2023-07-27T14:32:21.860582+0000","last_became_peered":"2023-07-27T14:32:21.860582+0000","last_unstale":"2023-07-27T14:32:21.866637+0000","last_undegraded":"2023-07-27T14:32:21.866637+0000","last_fullsized":"2023-07-27T14:32:21.866637+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332463+0000","last_change":"2023-07-27T14:32:22.328802+0000","last_active":"2023-07-27T14:32:22.332463+0000","last_peered":"2023-07-27T14:32:22.332463+0000","last_clean":"2023-07-27T14:32:22.332463+0000","last_became_active":"2023-07-27T14:32:22.328521+0000","last_became_peered":"2023-07-27T14:32:22.328521+0000","last_unstale":"2023-07-27T14:32:22.332463+0000","last_undegraded":"2023-07-27T14:32:22.332463+0000","last_fullsized":"2023-07-27T14:32:22.332463+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866543+0000","last_change":"2023-07-27T14:32:21.860241+0000","last_active":"2023-07-27T14:32:21.866543+0000","last_peered":"2023-07-27T14:32:21.866543+0000","last_clean":"2023-07-27T14:32:21.866543+0000","last_became_active":"2023-07-27T14:32:21.859871+0000","last_became_peered":"2023-07-27T14:32:21.859871+0000","last_unstale":"2023-07-27T14:32:21.866543+0000","last_undegraded":"2023-07-27T14:32:21.866543+0000","last_fullsized":"2023-07-27T14:32:21.866543+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.316199+0000","last_change":"2023-07-27T14:32:22.313876+0000","last_active":"2023-07-27T14:32:22.316199+0000","last_peered":"2023-07-27T14:32:22.316199+0000","last_clean":"2023-07-27T14:32:22.316199+0000","last_became_active":"2023-07-27T14:32:22.313578+0000","last_became_peered":"2023-07-27T14:32:22.313578+0000","last_unstale":"2023-07-27T14:32:22.316199+0000","last_undegraded":"2023-07-27T14:32:22.316199+0000","last_fullsized":"2023-07-27T14:32:22.316199+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.873876+0000","last_change":"2023-07-27T14:32:21.870407+0000","last_active":"2023-07-27T14:32:21.873876+0000","last_peered":"2023-07-27T14:32:21.873876+0000","last_clean":"2023-07-27T14:32:21.873876+0000","last_became_active":"2023-07-27T14:32:21.869999+0000","last_became_peered":"2023-07-27T14:32:21.869999+0000","last_unstale":"2023-07-27T14:32:21.873876+0000","last_undegraded":"2023-07-27T14:32:21.873876+0000","last_fullsized":"2023-07-27T14:32:21.873876+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.333345+0000","last_change":"2023-07-27T14:32:22.328746+0000","last_active":"2023-07-27T14:32:22.333345+0000","last_peered":"2023-07-27T14:32:22.333345+0000","last_clean":"2023-07-27T14:32:22.333345+0000","last_became_active":"2023-07-27T14:32:22.328505+0000","last_became_peered":"2023-07-27T14:32:22.328505+0000","last_unstale":"2023-07-27T14:32:22.333345+0000","last_undegraded":"2023-07-27T14:32:22.333345+0000","last_fullsized":"2023-07-27T14:32:22.333345+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305610+0000","last_change":"2023-07-27T14:32:21.861454+0000","last_active":"2023-07-27T14:32:22.305610+0000","last_peered":"2023-07-27T14:32:22.305610+0000","last_clean":"2023-07-27T14:32:22.305610+0000","last_became_active":"2023-07-27T14:32:21.861149+0000","last_became_peered":"2023-07-27T14:32:21.861149+0000","last_unstale":"2023-07-27T14:32:22.305610+0000","last_undegraded":"2023-07-27T14:32:22.305610+0000","last_fullsized":"2023-07-27T14:32:22.305610+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.321701+0000","last_change":"2023-07-27T14:32:22.318229+0000","last_active":"2023-07-27T14:32:22.321701+0000","last_peered":"2023-07-27T14:32:22.321701+0000","last_clean":"2023-07-27T14:32:22.321701+0000","last_became_active":"2023-07-27T14:32:22.317926+0000","last_became_peered":"2023-07-27T14:32:22.317926+0000","last_unstale":"2023-07-27T14:32:22.321701+0000","last_undegraded":"2023-07-27T14:32:22.321701+0000","last_fullsized":"2023-07-27T14:32:22.321701+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305729+0000","last_change":"2023-07-27T14:32:21.855128+0000","last_active":"2023-07-27T14:32:22.305729+0000","last_peered":"2023-07-27T14:32:22.305729+0000","last_clean":"2023-07-27T14:32:22.305729+0000","last_became_active":"2023-07-27T14:32:21.854628+0000","last_became_peered":"2023-07-27T14:32:21.854628+0000","last_unstale":"2023-07-27T14:32:22.305729+0000","last_undegraded":"2023-07-27T14:32:22.305729+0000","last_fullsized":"2023-07-27T14:32:22.305729+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.325294+0000","last_change":"2023-07-27T14:32:22.325294+0000","last_active":"2023-07-27T14:32:22.325294+0000","last_peered":"2023-07-27T14:32:22.325294+0000","last_clean":"2023-07-27T14:32:22.325294+0000","last_became_active":"2023-07-27T14:32:22.325001+0000","last_became_peered":"2023-07-27T14:32:22.325001+0000","last_unstale":"2023-07-27T14:32:22.325294+0000","last_undegraded":"2023-07-27T14:32:22.325294+0000","last_fullsized":"2023-07-27T14:32:22.325294+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.873873+0000","last_change":"2023-07-27T14:32:21.870411+0000","last_active":"2023-07-27T14:32:21.873873+0000","last_peered":"2023-07-27T14:32:21.873873+0000","last_clean":"2023-07-27T14:32:21.873873+0000","last_became_active":"2023-07-27T14:32:21.870075+0000","last_became_peered":"2023-07-27T14:32:21.870075+0000","last_unstale":"2023-07-27T14:32:21.873873+0000","last_undegraded":"2023-07-27T14:32:21.873873+0000","last_fullsized":"2023-07-27T14:32:21.873873+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332136+0000","last_change":"2023-07-27T14:32:22.323862+0000","last_active":"2023-07-27T14:32:22.332136+0000","last_peered":"2023-07-27T14:32:22.332136+0000","last_clean":"2023-07-27T14:32:22.332136+0000","last_became_active":"2023-07-27T14:32:22.323588+0000","last_became_peered":"2023-07-27T14:32:22.323588+0000","last_unstale":"2023-07-27T14:32:22.332136+0000","last_undegraded":"2023-07-27T14:32:22.332136+0000","last_fullsized":"2023-07-27T14:32:22.332136+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866878+0000","last_change":"2023-07-27T14:32:21.862600+0000","last_active":"2023-07-27T14:32:21.866878+0000","last_peered":"2023-07-27T14:32:21.866878+0000","last_clean":"2023-07-27T14:32:21.866878+0000","last_became_active":"2023-07-27T14:32:21.862314+0000","last_became_peered":"2023-07-27T14:32:21.862314+0000","last_unstale":"2023-07-27T14:32:21.866878+0000","last_undegraded":"2023-07-27T14:32:21.866878+0000","last_fullsized":"2023-07-27T14:32:21.866878+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.324783+0000","last_change":"2023-07-27T14:32:22.317866+0000","last_active":"2023-07-27T14:32:22.324783+0000","last_peered":"2023-07-27T14:32:22.324783+0000","last_clean":"2023-07-27T14:32:22.324783+0000","last_became_active":"2023-07-27T14:32:22.317592+0000","last_became_peered":"2023-07-27T14:32:22.317592+0000","last_unstale":"2023-07-27T14:32:22.324783+0000","last_undegraded":"2023-07-27T14:32:22.324783+0000","last_fullsized":"2023-07-27T14:32:22.324783+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.334852+0000","last_change":"2023-07-27T14:32:21.855219+0000","last_active":"2023-07-27T14:32:22.334852+0000","last_peered":"2023-07-27T14:32:22.334852+0000","last_clean":"2023-07-27T14:32:22.334852+0000","last_became_active":"2023-07-27T14:32:21.854672+0000","last_became_peered":"2023-07-27T14:32:21.854672+0000","last_unstale":"2023-07-27T14:32:22.334852+0000","last_undegraded":"2023-07-27T14:32:22.334852+0000","last_fullsized":"2023-07-27T14:32:22.334852+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.321317+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:32:22.321317+0000","last_peered":"2023-07-27T14:32:22.321317+0000","last_clean":"2023-07-27T14:32:22.321317+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:32:22.321317+0000","last_undegraded":"2023-07-27T14:32:22.321317+0000","last_fullsized":"2023-07-27T14:32:22.321317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.329622+0000","last_change":"2023-07-27T14:32:22.329622+0000","last_active":"2023-07-27T14:32:22.329622+0000","last_peered":"2023-07-27T14:32:22.329622+0000","last_clean":"2023-07-27T14:32:22.329622+0000","last_became_active":"2023-07-27T14:32:22.329316+0000","last_became_peered":"2023-07-27T14:32:22.329316+0000","last_unstale":"2023-07-27T14:32:22.329622+0000","last_undegraded":"2023-07-27T14:32:22.329622+0000","last_fullsized":"2023-07-27T14:32:22.329622+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.866520+0000","last_change":"2023-07-27T14:32:21.859616+0000","last_active":"2023-07-27T14:32:21.866520+0000","last_peered":"2023-07-27T14:32:21.866520+0000","last_clean":"2023-07-27T14:32:21.866520+0000","last_became_active":"2023-07-27T14:32:21.859311+0000","last_became_peered":"2023-07-27T14:32:21.859311+0000","last_unstale":"2023-07-27T14:32:21.866520+0000","last_undegraded":"2023-07-27T14:32:21.866520+0000","last_fullsized":"2023-07-27T14:32:21.866520+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.305841+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:32:22.305841+0000","last_peered":"2023-07-27T14:32:22.305841+0000","last_clean":"2023-07-27T14:32:22.305841+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:32:22.305841+0000","last_undegraded":"2023-07-27T14:32:22.305841+0000","last_fullsized":"2023-07-27T14:32:22.305841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317411+0000","last_change":"2023-07-27T14:32:22.317411+0000","last_active":"2023-07-27T14:32:22.317411+0000","last_peered":"2023-07-27T14:32:22.317411+0000","last_clean":"2023-07-27T14:32:22.317411+0000","last_became_active":"2023-07-27T14:32:22.317113+0000","last_became_peered":"2023-07-27T14:32:22.317113+0000","last_unstale":"2023-07-27T14:32:22.317411+0000","last_undegraded":"2023-07-27T14:32:22.317411+0000","last_fullsized":"2023-07-27T14:32:22.317411+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"99'2","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.328773+0000","last_change":"2023-07-27T14:32:21.859580+0000","last_active":"2023-07-27T14:32:22.328773+0000","last_peered":"2023-07-27T14:32:22.328773+0000","last_clean":"2023-07-27T14:32:22.328773+0000","last_became_active":"2023-07-27T14:32:21.859074+0000","last_became_peered":"2023-07-27T14:32:21.859074+0000","last_unstale":"2023-07-27T14:32:22.328773+0000","last_undegraded":"2023-07-27T14:32:22.328773+0000","last_fullsized":"2023-07-27T14:32:22.328773+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.311286+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:32:22.311286+0000","last_peered":"2023-07-27T14:32:22.311286+0000","last_clean":"2023-07-27T14:32:22.311286+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:32:22.311286+0000","last_undegraded":"2023-07-27T14:32:22.311286+0000","last_fullsized":"2023-07-27T14:32:22.311286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326003+0000","last_change":"2023-07-27T14:32:22.326003+0000","last_active":"2023-07-27T14:32:22.326003+0000","last_peered":"2023-07-27T14:32:22.326003+0000","last_clean":"2023-07-27T14:32:22.326003+0000","last_became_active":"2023-07-27T14:32:22.325688+0000","last_became_peered":"2023-07-27T14:32:22.325688+0000","last_unstale":"2023-07-27T14:32:22.326003+0000","last_undegraded":"2023-07-27T14:32:22.326003+0000","last_fullsized":"2023-07-27T14:32:22.326003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.321236+0000","last_change":"2023-07-27T14:32:21.860367+0000","last_active":"2023-07-27T14:32:22.321236+0000","last_peered":"2023-07-27T14:32:22.321236+0000","last_clean":"2023-07-27T14:32:22.321236+0000","last_became_active":"2023-07-27T14:32:21.860050+0000","last_became_peered":"2023-07-27T14:32:21.860050+0000","last_unstale":"2023-07-27T14:32:22.321236+0000","last_undegraded":"2023-07-27T14:32:22.321236+0000","last_fullsized":"2023-07-27T14:32:22.321236+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.304438+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:32:22.304438+0000","last_peered":"2023-07-27T14:32:22.304438+0000","last_clean":"2023-07-27T14:32:22.304438+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:32:22.304438+0000","last_undegraded":"2023-07-27T14:32:22.304438+0000","last_fullsized":"2023-07-27T14:32:22.304438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.848806+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:32:21.848806+0000","last_peered":"2023-07-27T14:32:21.848806+0000","last_clean":"2023-07-27T14:32:21.848806+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:32:21.848806+0000","last_undegraded":"2023-07-27T14:32:21.848806+0000","last_fullsized":"2023-07-27T14:32:21.848806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.322884+0000","last_change":"2023-07-27T14:32:22.312568+0000","last_active":"2023-07-27T14:32:22.322884+0000","last_peered":"2023-07-27T14:32:22.322884+0000","last_clean":"2023-07-27T14:32:22.322884+0000","last_became_active":"2023-07-27T14:32:22.312320+0000","last_became_peered":"2023-07-27T14:32:22.312320+0000","last_unstale":"2023-07-27T14:32:22.322884+0000","last_undegraded":"2023-07-27T14:32:22.322884+0000","last_fullsized":"2023-07-27T14:32:22.322884+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"99'1","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.310928+0000","last_change":"2023-07-27T14:32:21.856081+0000","last_active":"2023-07-27T14:32:22.310928+0000","last_peered":"2023-07-27T14:32:22.310928+0000","last_clean":"2023-07-27T14:32:22.310928+0000","last_became_active":"2023-07-27T14:32:21.855812+0000","last_became_peered":"2023-07-27T14:32:21.855812+0000","last_unstale":"2023-07-27T14:32:22.310928+0000","last_undegraded":"2023-07-27T14:32:22.310928+0000","last_fullsized":"2023-07-27T14:32:22.310928+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.848901+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:32:21.848901+0000","last_peered":"2023-07-27T14:32:21.848901+0000","last_clean":"2023-07-27T14:32:21.848901+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:32:21.848901+0000","last_undegraded":"2023-07-27T14:32:21.848901+0000","last_fullsized":"2023-07-27T14:32:21.848901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326485+0000","last_change":"2023-07-27T14:32:22.324120+0000","last_active":"2023-07-27T14:32:22.326485+0000","last_peered":"2023-07-27T14:32:22.326485+0000","last_clean":"2023-07-27T14:32:22.326485+0000","last_became_active":"2023-07-27T14:32:22.323586+0000","last_became_peered":"2023-07-27T14:32:22.323586+0000","last_unstale":"2023-07-27T14:32:22.326485+0000","last_undegraded":"2023-07-27T14:32:22.326485+0000","last_fullsized":"2023-07-27T14:32:22.326485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313492+0000","last_change":"2023-07-27T14:32:21.865235+0000","last_active":"2023-07-27T14:32:22.313492+0000","last_peered":"2023-07-27T14:32:22.313492+0000","last_clean":"2023-07-27T14:32:22.313492+0000","last_became_active":"2023-07-27T14:32:21.864797+0000","last_became_peered":"2023-07-27T14:32:21.864797+0000","last_unstale":"2023-07-27T14:32:22.313492+0000","last_undegraded":"2023-07-27T14:32:22.313492+0000","last_fullsized":"2023-07-27T14:32:22.313492+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.846936+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:32:21.846936+0000","last_peered":"2023-07-27T14:32:21.846936+0000","last_clean":"2023-07-27T14:32:21.846936+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:32:21.846936+0000","last_undegraded":"2023-07-27T14:32:21.846936+0000","last_fullsized":"2023-07-27T14:32:21.846936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.326405+0000","last_change":"2023-07-27T14:32:22.322838+0000","last_active":"2023-07-27T14:32:22.326405+0000","last_peered":"2023-07-27T14:32:22.326405+0000","last_clean":"2023-07-27T14:32:22.326405+0000","last_became_active":"2023-07-27T14:32:22.322528+0000","last_became_peered":"2023-07-27T14:32:22.322528+0000","last_unstale":"2023-07-27T14:32:22.326405+0000","last_undegraded":"2023-07-27T14:32:22.326405+0000","last_fullsized":"2023-07-27T14:32:22.326405+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.304924+0000","last_change":"2023-07-27T14:32:21.854866+0000","last_active":"2023-07-27T14:32:22.304924+0000","last_peered":"2023-07-27T14:32:22.304924+0000","last_clean":"2023-07-27T14:32:22.304924+0000","last_became_active":"2023-07-27T14:32:21.854463+0000","last_became_peered":"2023-07-27T14:32:21.854463+0000","last_unstale":"2023-07-27T14:32:22.304924+0000","last_undegraded":"2023-07-27T14:32:22.304924+0000","last_fullsized":"2023-07-27T14:32:22.304924+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.317831+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:32:22.317831+0000","last_peered":"2023-07-27T14:32:22.317831+0000","last_clean":"2023-07-27T14:32:22.317831+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:32:22.317831+0000","last_undegraded":"2023-07-27T14:32:22.317831+0000","last_fullsized":"2023-07-27T14:32:22.317831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.332229+0000","last_change":"2023-07-27T14:32:22.328756+0000","last_active":"2023-07-27T14:32:22.332229+0000","last_peered":"2023-07-27T14:32:22.332229+0000","last_clean":"2023-07-27T14:32:22.332229+0000","last_became_active":"2023-07-27T14:32:22.328504+0000","last_became_peered":"2023-07-27T14:32:22.328504+0000","last_unstale":"2023-07-27T14:32:22.332229+0000","last_undegraded":"2023-07-27T14:32:22.332229+0000","last_fullsized":"2023-07-27T14:32:22.332229+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:21.829691+0000","last_clean_scrub_stamp":"2023-07-27T14:32:21.829691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-27T14:32:22.313668+0000","last_change":"2023-07-27T14:32:21.864971+0000","last_active":"2023-07-27T14:32:22.313668+0000","last_peered":"2023-07-27T14:32:22.313668+0000","last_clean":"2023-07-27T14:32:22.313668+0000","last_became_active":"2023-07-27T14:32:21.864534+0000","last_became_peered":"2023-07-27T14:32:21.864534+0000","last_unstale":"2023-07-27T14:32:22.313668+0000","last_undegraded":"2023-07-27T14:32:22.313668+0000","last_fullsized":"2023-07-27T14:32:22.313668+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:32:20.823146+0000","last_clean_scrub_stamp":"2023-07-27T14:32:20.823146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-27T14:32:21.847862+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:32:21.847862+0000","last_peered":"2023-07-27T14:32:21.847862+0000","last_clean":"2023-07-27T14:32:21.847862+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:32:21.847862+0000","last_undegraded":"2023-07-27T14:32:21.847862+0000","last_fullsized":"2023-07-27T14:32:21.847862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14196,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94357644,"statfs":{"total":96636764160,"available":96622227456,"internally_reserved":0,"allocated":1224704,"data_stored":564815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86099999999999999,"5min":1.133,"15min":1.133},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82099999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68600000000000005,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.72999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96999999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0449999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.505,"5min":0.438,"15min":0.438},"max":{"1min":0.90500000000000003,"5min":1.119,"15min":1.119},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":1.069,"15min":1.069},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92800000000000005,"5min":1.165,"15min":1.165},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.63800000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77600000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81499999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68100000000000005,"15min":0.70499999999999996},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95999999999999996,"5min":1.038,"15min":1.038},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73699999999999999,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.034,"15min":1.034},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70699999999999996,"15min":0.71499999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93700000000000006,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13504,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94358336,"statfs":{"total":96636764160,"available":96622936064,"internally_reserved":0,"allocated":1236992,"data_stored":566871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.441,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77600000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.58799999999999997},"min":{"1min":0.40799999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77500000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.629}]},{"osd":1,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.624,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78800000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.47399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81799999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81799999999999995,"5min":1.2,"15min":1.2},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68500000000000005,"15min":0.66000000000000003},"min":{"1min":0.55200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86599999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98999999999999999,"5min":1.079,"15min":1.079},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67300000000000004,"15min":0.68200000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80500000000000005,"5min":1.198,"15min":1.198},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.51700000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88900000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.443}]},{"osd":7,"last update":"Thu Jul 27 14:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.61699999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94199999999999995,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16300,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":94355540,"statfs":{"total":96636764160,"available":96620072960,"internally_reserved":0,"allocated":1216512,"data_stored":564759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.42899999999999999,"15min":0.52600000000000002},"min":{"1min":0.28799999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54400000000000004,"5min":4.75,"15min":4.75},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.497,"15min":0.68799999999999994},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70199999999999996,"5min":9.3100000000000005,"15min":9.3100000000000005},"last":0.434}]},{"osd":2,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.496,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67500000000000004,"5min":3.7210000000000001,"15min":3.7210000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.496,"15min":0.54200000000000004},"min":{"1min":0.33100000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.52900000000000003},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68400000000000005,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.499,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.58299999999999996,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91300000000000003,"5min":2.181,"15min":2.181},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.73199999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91300000000000003,"5min":2.4180000000000001,"15min":2.4180000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.78300000000000003},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95099999999999996,"5min":3.7440000000000002,"15min":3.7440000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.751},"min":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96599999999999997,"5min":2.149,"15min":2.149},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97699999999999998,"5min":2.052,"15min":2.052},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.86599999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95099999999999996,"5min":6.1980000000000004,"15min":6.1980000000000004},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.018,"5min":2.016,"15min":2.016},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.85999999999999999},"min":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0449999999999999,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.78500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13760,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358080,"statfs":{"total":96636764160,"available":96622673920,"internally_reserved":0,"allocated":1236992,"data_stored":565597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.57499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41899999999999998,"15min":0.42399999999999999},"min":{"1min":0.27400000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.47099999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.40699999999999997,"15min":0.42499999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.5,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.442},{"interface":"front","average":{"1min":0.436,"5min":0.46000000000000002,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.57199999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":1.5589999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.50800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47299999999999998,"15min":0.48399999999999999},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.58899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.68200000000000005},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95399999999999996,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71399999999999997,"15min":0.72099999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.873,"5min":1.28,"15min":1.28},"last":0.75}]},{"osd":5,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.014,"5min":1.25,"15min":1.25},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.874,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.6020000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93500000000000005,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95699999999999996,"5min":1.22,"15min":1.22},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97899999999999998,"5min":1.244,"15min":1.244},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.66600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17400,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94354440,"statfs":{"total":96636764160,"available":96618946560,"internally_reserved":0,"allocated":1228800,"data_stored":571463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39200000000000002,"15min":0.41799999999999998},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52100000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45200000000000001,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78000000000000003,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45500000000000002,"15min":0.48699999999999999},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63500000000000001,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.58699999999999997,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":5.601}]},{"osd":3,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46000000000000002,"15min":0.48399999999999999},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55000000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.498,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":1.353}]},{"osd":4,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.849},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91500000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":6.9660000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":1.014,"15min":1.014},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72699999999999998,"15min":0.751},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":1.26,"15min":1.26},"last":1.772}]},{"osd":6,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.46700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88200000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":3.1600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.77100000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91100000000000003,"5min":1.091,"15min":1.091},"last":3.1360000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:32:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.79800000000000004},"min":{"1min":0.55800000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94399999999999995,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.8089999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.77100000000000002,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96199999999999997,"5min":1.036,"15min":1.036},"last":1.5980000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14196,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94357644,"statfs":{"total":96636764160,"available":96622227456,"internally_reserved":0,"allocated":1224704,"data_stored":565721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.28399999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.38}]},{"osd":1,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.45100000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.748,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46000000000000002,"15min":0.44},"min":{"1min":0.315,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.442},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51900000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.46100000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.91600000000000004,"5min":1.149,"15min":1.149},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.1059999999999999,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.55900000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0920000000000001,"5min":1.298,"15min":1.298},"last":0.873},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.78100000000000003},"min":{"1min":0.57799999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78700000000000003,"15min":0.77500000000000002},"min":{"1min":0.59199999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.78500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13492,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94358348,"statfs":{"total":96636764160,"available":96622948352,"internally_reserved":0,"allocated":1224704,"data_stored":565403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.36399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74199999999999999,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":4.3479999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.66400000000000003,"15min":0.65000000000000002},"min":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.69699999999999995,"15min":0.68100000000000005},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.47899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.72499999999999998,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.65600000000000003,"15min":0.61799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":2.9649999999999999,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.69899999999999995,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.194,"5min":5.194,"15min":5.194},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.51000000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.5990000000000002,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73699999999999999,"15min":0.71899999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.819,"5min":2.819,"15min":2.819},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.52300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15276,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":94356564,"statfs":{"total":96636764160,"available":96621121536,"internally_reserved":0,"allocated":1216512,"data_stored":564759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79900000000000004,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.71199999999999997,"15min":0.63},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73299999999999998,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72699999999999998,"15min":0.68600000000000005},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.629,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77000000000000002,"5min":1.581,"15min":1.581},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.69799999999999995,"15min":0.66100000000000003},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.82299999999999995,"15min":0.79400000000000004},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0660000000000001,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":1.121,"5min":1.978,"15min":1.978},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67200000000000004,"15min":0.64600000000000002},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85599999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67400000000000004,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82399999999999995,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0960000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:32:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86599999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.504,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92100000000000004,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:32:27.046 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:32:27.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:32:27.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.237+0000 7fc4dd1ff700 1 Processor -- start 2023-07-27T14:32:27.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.237+0000 7fc4dd1ff700 1 -- start start 2023-07-27T14:32:27.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4dd1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4dd1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc4d814b1e0 0x7fc4d80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4dd1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d81553f0 con 0x7fc4d814ae00 2023-07-27T14:32:27.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4dd1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d8157a50 con 0x7fc4d814b1e0 2023-07-27T14:32:27.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4dd1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d8157d10 con 0x7fc4d8063260 2023-07-27T14:32:27.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4d759e700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc4d814b1e0 0x7fc4d80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4d659c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4d759e700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc4d814b1e0 0x7fc4d80a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:57052/0 (socket says 172.21.15.115:57052) 2023-07-27T14:32:27.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4d759e700 1 -- 172.21.15.115:0/2270577026 learned_addr learned my addr 172.21.15.115:0/2270577026 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:27.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.239+0000 7fc4d6d9d700 1 --1- 172.21.15.115:0/2270577026 >> v1:172.21.15.159:6789/0 conn(0x7fc4d814ae00 0x7fc4d8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:38824/0 (socket says 172.21.15.115:38824) 2023-07-27T14:32:27.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d759e700 1 -- 172.21.15.115:0/2270577026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 msgr2=0x7fc4d8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:27.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d759e700 1 --2- 172.21.15.115:0/2270577026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d759e700 1 -- 172.21.15.115:0/2270577026 >> v1:172.21.15.159:6789/0 conn(0x7fc4d814ae00 legacy=0x7fc4d8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d759e700 1 -- 172.21.15.115:0/2270577026 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d8157ff0 con 0x7fc4d814b1e0 2023-07-27T14:32:27.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d5d9b700 1 -- 172.21.15.115:0/2270577026 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973487132 0 0) 0x7fc4d81553f0 con 0x7fc4d814ae00 2023-07-27T14:32:27.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d659c700 1 --2- 172.21.15.115:0/2270577026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:27.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d759e700 1 --2- 172.21.15.115:0/2270577026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 0x7fc4d80a98c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fc4d0009f20 tx=0x7fc4d0009840).ready entity=mon.1 client_cookie=72425c83fc88079a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:27.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d5d9b700 1 -- 172.21.15.115:0/2270577026 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d000e070 con 0x7fc4d814b1e0 2023-07-27T14:32:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d5d9b700 1 -- 172.21.15.115:0/2270577026 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d000b9d0 con 0x7fc4d814b1e0 2023-07-27T14:32:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.240+0000 7fc4d5d9b700 1 -- 172.21.15.115:0/2270577026 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d000bd50 con 0x7fc4d814b1e0 2023-07-27T14:32:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.241+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2270577026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 msgr2=0x7fc4d80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.241+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2270577026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 0x7fc4d80a98c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fc4d0009f20 tx=0x7fc4d0009840).stop 2023-07-27T14:32:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.241+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2270577026 shutdown_connections 2023-07-27T14:32:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.241+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2270577026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 0x7fc4d80a98c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.241+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2270577026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.241+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2270577026 >> 172.21.15.115:0/2270577026 conn(0x7fc4d805e940 msgr2=0x7fc4d80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:27.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.241+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2270577026 shutdown_connections 2023-07-27T14:32:27.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.241+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2270577026 wait complete. 2023-07-27T14:32:27.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.242+0000 7fc4dd1ff700 1 Processor -- start 2023-07-27T14:32:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.242+0000 7fc4dd1ff700 1 -- start start 2023-07-27T14:32:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.243+0000 7fc4dd1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.243+0000 7fc4dd1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4d814ae00 0x7fc4d80c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.243+0000 7fc4dd1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 0x7fc4d80b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.243+0000 7fc4dd1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d80c2520 con 0x7fc4d814ae00 2023-07-27T14:32:27.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.243+0000 7fc4dd1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d80c3340 con 0x7fc4d814b1e0 2023-07-27T14:32:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.243+0000 7fc4dd1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d80b0190 con 0x7fc4d8063260 2023-07-27T14:32:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4d814ae00 0x7fc4d80c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4d814ae00 0x7fc4d80c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47340/0 (socket says 172.21.15.115:47340) 2023-07-27T14:32:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 -- 172.21.15.115:0/2121094930 learned_addr learned my addr 172.21.15.115:0/2121094930 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d6d9d700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d759e700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 0x7fc4d80b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 -- 172.21.15.115:0/2121094930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 msgr2=0x7fc4d814a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d814a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 -- 172.21.15.115:0/2121094930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 msgr2=0x7fc4d80b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 0x7fc4d80b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 -- 172.21.15.115:0/2121094930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0092a0 con 0x7fc4d814ae00 2023-07-27T14:32:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4d659c700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4d814ae00 0x7fc4d80c37d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fc4cc00ea50 tx=0x7fc4cc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.244+0000 7fc4beffd700 1 -- 172.21.15.115:0/2121094930 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00c640 con 0x7fc4d814ae00 2023-07-27T14:32:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.245+0000 7fc4beffd700 1 -- 172.21.15.115:0/2121094930 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc00c7a0 con 0x7fc4d814ae00 2023-07-27T14:32:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.245+0000 7fc4beffd700 1 -- 172.21.15.115:0/2121094930 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00cb20 con 0x7fc4d814ae00 2023-07-27T14:32:27.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.245+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d0009ae0 con 0x7fc4d814ae00 2023-07-27T14:32:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.245+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d80c2a10 con 0x7fc4d814ae00 2023-07-27T14:32:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.246+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d80c34b0 con 0x7fc4d814ae00 2023-07-27T14:32:27.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.247+0000 7fc4beffd700 1 -- 172.21.15.115:0/2121094930 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fc4cc0123f0 con 0x7fc4d814ae00 2023-07-27T14:32:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.247+0000 7fc4beffd700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c405f370 0x7fc4c4061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.248+0000 7fc4beffd700 1 -- 172.21.15.115:0/2121094930 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc4cc07a410 con 0x7fc4d814ae00 2023-07-27T14:32:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.248+0000 7fc4d6d9d700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c405f370 0x7fc4c4061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.248+0000 7fc4d6d9d700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c405f370 0x7fc4c4061830 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fc4c80011e0 tx=0x7fc4c8007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:27.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.252+0000 7fc4beffd700 1 -- 172.21.15.115:0/2121094930 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4cc04b370 con 0x7fc4d814ae00 2023-07-27T14:32:27.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.484+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc4d806c470 con 0x7fc4d814ae00 2023-07-27T14:32:27.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.488+0000 7fc4beffd700 1 -- 172.21.15.115:0/2121094930 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc4cc04e990 con 0x7fc4d814ae00 2023-07-27T14:32:27.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c405f370 msgr2=0x7fc4c4061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c405f370 0x7fc4c4061830 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fc4c80011e0 tx=0x7fc4c8007bd0).stop 2023-07-27T14:32:27.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4d814ae00 msgr2=0x7fc4d80c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4d814ae00 0x7fc4d80c37d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fc4cc00ea50 tx=0x7fc4cc009060).stop 2023-07-27T14:32:27.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 shutdown_connections 2023-07-27T14:32:27.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c405f370 0x7fc4c4061830 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4d814b1e0 0x7fc4d80b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4d8063260 0x7fc4d814a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 --2- 172.21.15.115:0/2121094930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4d814ae00 0x7fc4d80c37d0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 >> 172.21.15.115:0/2121094930 conn(0x7fc4d805e940 msgr2=0x7fc4d80a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:27.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 shutdown_connections 2023-07-27T14:32:27.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.491+0000 7fc4dd1ff700 1 -- 172.21.15.115:0/2121094930 wait complete. 2023-07-27T14:32:27.528 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:32:27.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:27.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.696+0000 7fa00b9ff700 1 Processor -- start 2023-07-27T14:32:27.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.697+0000 7fa00b9ff700 1 -- start start 2023-07-27T14:32:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa00b9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa004153ec0 0x7fa0040a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa00b9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa0040aa050 0x7fa0040640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa00b9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040aa4d0 con 0x7fa0040aaa40 2023-07-27T14:32:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa00b9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040c05c0 con 0x7fa0040aa050 2023-07-27T14:32:27.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa00b9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040c1a60 con 0x7fa004153ec0 2023-07-27T14:32:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa008f9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa0040aa050 0x7fa0040640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa009f9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa0040aaa40 0x7fa004157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40668/0 (socket says 172.21.15.115:40668) 2023-07-27T14:32:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa009f9c700 1 -- 172.21.15.115:0/2005244220 learned_addr learned my addr 172.21.15.115:0/2005244220 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.698+0000 7fa00979b700 1 --2- 172.21.15.115:0/2005244220 >> v2:172.21.15.159:3300/0 conn(0x7fa004153ec0 0x7fa0040a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7fa008f9a700 1 -- 172.21.15.115:0/2005244220 >> v2:172.21.15.159:3300/0 conn(0x7fa004153ec0 msgr2=0x7fa0040a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7fa008f9a700 1 --2- 172.21.15.115:0/2005244220 >> v2:172.21.15.159:3300/0 conn(0x7fa004153ec0 0x7fa0040a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7fa008f9a700 1 -- 172.21.15.115:0/2005244220 >> v1:172.21.15.115:6789/0 conn(0x7fa0040aaa40 legacy=0x7fa004157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7fa008f9a700 1 -- 172.21.15.115:0/2005244220 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040bfc90 con 0x7fa0040aa050 2023-07-27T14:32:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7fa008f9a700 1 --2- 172.21.15.115:0/2005244220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aa050 0x7fa0040640f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fa004083e30 tx=0x7f9ff4009060).ready entity=mon.0 client_cookie=2c208389e4b65474 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7f9ffbfff700 1 -- 172.21.15.115:0/2005244220 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40090d0 con 0x7fa0040aa050 2023-07-27T14:32:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7f9ffbfff700 1 -- 172.21.15.115:0/2005244220 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff400f510 con 0x7fa0040aa050 2023-07-27T14:32:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7f9ffbfff700 1 -- 172.21.15.115:0/2005244220 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400f890 con 0x7fa0040aa050 2023-07-27T14:32:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7fa00b9ff700 1 -- 172.21.15.115:0/2005244220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aa050 msgr2=0x7fa0040640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.699+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/2005244220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aa050 0x7fa0040640f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fa004083e30 tx=0x7f9ff4009060).stop 2023-07-27T14:32:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.700+0000 7fa00b9ff700 1 -- 172.21.15.115:0/2005244220 shutdown_connections 2023-07-27T14:32:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.700+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/2005244220 >> v2:172.21.15.159:3300/0 conn(0x7fa004153ec0 0x7fa0040a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.700+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/2005244220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aa050 0x7fa0040640f0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.700+0000 7fa00b9ff700 1 -- 172.21.15.115:0/2005244220 >> 172.21.15.115:0/2005244220 conn(0x7fa0040cb610 msgr2=0x7fa0040c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.700+0000 7fa00b9ff700 1 -- 172.21.15.115:0/2005244220 shutdown_connections 2023-07-27T14:32:27.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.700+0000 7fa00b9ff700 1 -- 172.21.15.115:0/2005244220 wait complete. 2023-07-27T14:32:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.701+0000 7fa00b9ff700 1 Processor -- start 2023-07-27T14:32:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.701+0000 7fa00b9ff700 1 -- start start 2023-07-27T14:32:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.702+0000 7fa00b9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0040aa050 0x7fa0041531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.702+0000 7fa00b9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aaa40 0x7fa0040c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.702+0000 7fa00b9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa004153ec0 0x7fa004150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.702+0000 7fa00b9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041651c0 con 0x7fa0040aaa40 2023-07-27T14:32:27.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.702+0000 7fa00b9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040c3250 con 0x7fa004153ec0 2023-07-27T14:32:27.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.702+0000 7fa00b9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041645b0 con 0x7fa0040aa050 2023-07-27T14:32:27.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.702+0000 7fa008f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aaa40 0x7fa0040c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa008f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aaa40 0x7fa0040c2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47356/0 (socket says 172.21.15.115:47356) 2023-07-27T14:32:27.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa008f9a700 1 -- 172.21.15.115:0/3080804799 learned_addr learned my addr 172.21.15.115:0/3080804799 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:27.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa00979b700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0040aa050 0x7fa0041531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa009f9c700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa004153ec0 0x7fa004150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa008f9a700 1 -- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0040aa050 msgr2=0x7fa0041531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa008f9a700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0040aa050 0x7fa0041531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa008f9a700 1 -- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa004153ec0 msgr2=0x7fa004150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa008f9a700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa004153ec0 0x7fa004150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa008f9a700 1 -- 172.21.15.115:0/3080804799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40092a0 con 0x7fa0040aaa40 2023-07-27T14:32:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa009f9c700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa004153ec0 0x7fa004150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:27.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa008f9a700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aaa40 0x7fa0040c2d60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fa004060760 tx=0x7f9ff4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7f9ff97fa700 1 -- 172.21.15.115:0/3080804799 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400f680 con 0x7fa0040aaa40 2023-07-27T14:32:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7f9ff97fa700 1 -- 172.21.15.115:0/3080804799 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff400f7e0 con 0x7fa0040aaa40 2023-07-27T14:32:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa004164890 con 0x7fa0040aaa40 2023-07-27T14:32:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.703+0000 7f9ff97fa700 1 -- 172.21.15.115:0/3080804799 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff401c670 con 0x7fa0040aaa40 2023-07-27T14:32:27.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.704+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa004164e50 con 0x7fa0040aaa40 2023-07-27T14:32:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.704+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0040c1c10 con 0x7fa0040aaa40 2023-07-27T14:32:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.705+0000 7f9ff97fa700 1 -- 172.21.15.115:0/3080804799 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f9ff402c070 con 0x7fa0040aaa40 2023-07-27T14:32:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.706+0000 7f9ff97fa700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fe805f340 0x7f9fe8061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.706+0000 7f9ff97fa700 1 -- 172.21.15.115:0/3080804799 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9ff407c090 con 0x7fa0040aaa40 2023-07-27T14:32:27.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.706+0000 7fa00979b700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fe805f340 0x7f9fe8061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:27.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.707+0000 7fa00979b700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fe805f340 0x7f9fe8061800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fa000006fd0 tx=0x7fa000008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:27.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.710+0000 7f9ff97fa700 1 -- 172.21.15.115:0/3080804799 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ff404d170 con 0x7fa0040aaa40 2023-07-27T14:32:27.855 INFO:tasks.ceph.mds.c.smithi115.stderr:2023-07-27T14:32:27.820+0000 7ff0679f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:32:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.918+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa00406c470 con 0x7fa0040aaa40 2023-07-27T14:32:27.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.918+0000 7f9ff97fa700 1 -- 172.21.15.115:0/3080804799 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f9ff4020030 con 0x7fa0040aaa40 2023-07-27T14:32:27.954 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:27.954 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/291900736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":291900736},{"type":"v1","addr":"172.21.15.159:6834","nonce":291900736}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/469026388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":469026388},{"type":"v1","addr":"172.21.15.115:6837","nonce":469026388}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1581340296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":1581340296},{"type":"v1","addr":"172.21.15.159:6835","nonce":1581340296}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:32:22.297133+0000","modified":"2023-07-27T14:32:25.313130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1932712314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1932712314},{"type":"v1","addr":"172.21.15.115:6836","nonce":1932712314}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-07-27T14:32:27.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fe805f340 msgr2=0x7f9fe8061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fe805f340 0x7f9fe8061800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fa000006fd0 tx=0x7fa000008040).stop 2023-07-27T14:32:27.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aaa40 msgr2=0x7fa0040c2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:27.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aaa40 0x7fa0040c2d60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fa004060760 tx=0x7f9ff4017000).stop 2023-07-27T14:32:27.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 shutdown_connections 2023-07-27T14:32:27.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fe805f340 0x7f9fe8061800 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa004153ec0 0x7fa004150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0040aa050 0x7fa0041531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 --2- 172.21.15.115:0/3080804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040aaa40 0x7fa0040c2d60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:27.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 >> 172.21.15.115:0/3080804799 conn(0x7fa0040cb610 msgr2=0x7fa0040abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:27.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 shutdown_connections 2023-07-27T14:32:27.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:27.921+0000 7fa00b9ff700 1 -- 172.21.15.115:0/3080804799 wait complete. 2023-07-27T14:32:27.958 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 51 2023-07-27T14:32:28.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:32:22.297133+0000', 'modified': '2023-07-27T14:32:25.313130+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6915}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6915': {'gid': 6915, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6836/1932712314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 1932712314}, {'type': 'v1', 'addr': '172.21.15.115:6836', 'nonce': 1932712314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:32:28.376 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:32:28.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-27T14:32:28.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.531+0000 7f5d35dff700 1 Processor -- start 2023-07-27T14:32:28.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.531+0000 7f5d35dff700 1 -- start start 2023-07-27T14:32:28.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.532+0000 7f5d35dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5d300c3470 0x7f5d30064b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.532+0000 7f5d35dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5d3014fbd0 0x7f5d30152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.532+0000 7f5d35dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d301532a0 con 0x7f5d300c3850 2023-07-27T14:32:28.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.532+0000 7f5d35dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d30064060 con 0x7f5d300c3470 2023-07-27T14:32:28.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.532+0000 7f5d35dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d30064340 con 0x7f5d3014fbd0 2023-07-27T14:32:28.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5d300c3470 0x7f5d30064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5d300c3850 0x7f5d3014f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40684/0 (socket says 172.21.15.115:40684) 2023-07-27T14:32:28.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2effd700 1 -- 172.21.15.115:0/3907210712 learned_addr learned my addr 172.21.15.115:0/3907210712 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:28.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/3907210712 >> v2:172.21.15.159:3300/0 conn(0x7f5d3014fbd0 0x7f5d30152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/3907210712 >> v2:172.21.15.159:3300/0 conn(0x7f5d3014fbd0 msgr2=0x7f5d30152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/3907210712 >> v2:172.21.15.159:3300/0 conn(0x7f5d3014fbd0 0x7f5d30152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/3907210712 >> v1:172.21.15.115:6789/0 conn(0x7f5d300c3850 legacy=0x7f5d3014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/3907210712 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30064620 con 0x7f5d300c3470 2023-07-27T14:32:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2e7fc700 1 -- 172.21.15.115:0/3907210712 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392900382 0 0) 0x7f5d301532a0 con 0x7f5d300c3850 2023-07-27T14:32:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/3907210712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d30064b40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f5d30069870 tx=0x7f5d20009060).ready entity=mon.0 client_cookie=e7d92176a0e70fb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.533+0000 7f5d2e7fc700 1 -- 172.21.15.115:0/3907210712 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000b580 con 0x7f5d300c3470 2023-07-27T14:32:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d2e7fc700 1 -- 172.21.15.115:0/3907210712 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000b6e0 con 0x7f5d300c3470 2023-07-27T14:32:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d2e7fc700 1 -- 172.21.15.115:0/3907210712 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000ba60 con 0x7f5d300c3470 2023-07-27T14:32:28.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d35dff700 1 -- 172.21.15.115:0/3907210712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 msgr2=0x7f5d30064b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d35dff700 1 --2- 172.21.15.115:0/3907210712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d30064b40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f5d30069870 tx=0x7f5d20009060).stop 2023-07-27T14:32:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d35dff700 1 -- 172.21.15.115:0/3907210712 shutdown_connections 2023-07-27T14:32:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d35dff700 1 --2- 172.21.15.115:0/3907210712 >> v2:172.21.15.159:3300/0 conn(0x7f5d3014fbd0 0x7f5d30152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d35dff700 1 --2- 172.21.15.115:0/3907210712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d30064b40 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d35dff700 1 -- 172.21.15.115:0/3907210712 >> 172.21.15.115:0/3907210712 conn(0x7f5d30062320 msgr2=0x7f5d30062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d35dff700 1 -- 172.21.15.115:0/3907210712 shutdown_connections 2023-07-27T14:32:28.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.534+0000 7f5d35dff700 1 -- 172.21.15.115:0/3907210712 wait complete. 2023-07-27T14:32:28.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.536+0000 7f5d35dff700 1 Processor -- start 2023-07-27T14:32:28.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.536+0000 7f5d35dff700 1 -- start start 2023-07-27T14:32:28.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d35dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d3014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d35dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d300c3850 0x7f5d300be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d35dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3014fbd0 0x7f5d300a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d35dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300bee30 con 0x7f5d300c3470 2023-07-27T14:32:28.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d35dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300c2130 con 0x7f5d3014fbd0 2023-07-27T14:32:28.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d35dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300c2410 con 0x7f5d300c3850 2023-07-27T14:32:28.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d3014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d3014e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47370/0 (socket says 172.21.15.115:47370) 2023-07-27T14:32:28.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/1937511064 learned_addr learned my addr 172.21.15.115:0/1937511064 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:28.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2effd700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d300c3850 0x7f5d300be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3014fbd0 0x7f5d300a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d300c3850 msgr2=0x7f5d300be3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d300c3850 0x7f5d300be3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3014fbd0 msgr2=0x7f5d300a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3014fbd0 0x7f5d300a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/1937511064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d200092a0 con 0x7f5d300c3470 2023-07-27T14:32:28.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2effd700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d300c3850 0x7f5d300be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:28.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.537+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d3014e600 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f5d20009fd0 tx=0x7f5d20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.538+0000 7f5d177fe700 1 -- 172.21.15.115:0/1937511064 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000b850 con 0x7f5d300c3470 2023-07-27T14:32:28.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.538+0000 7f5d177fe700 1 -- 172.21.15.115:0/1937511064 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000b9b0 con 0x7f5d300c3470 2023-07-27T14:32:28.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.538+0000 7f5d35dff700 1 -- 172.21.15.115:0/1937511064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d300c26f0 con 0x7f5d300c3470 2023-07-27T14:32:28.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.538+0000 7f5d177fe700 1 -- 172.21.15.115:0/1937511064 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2001b660 con 0x7f5d300c3470 2023-07-27T14:32:28.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.538+0000 7f5d35dff700 1 -- 172.21.15.115:0/1937511064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3014eaf0 con 0x7f5d300c3470 2023-07-27T14:32:28.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.540+0000 7f5d177fe700 1 -- 172.21.15.115:0/1937511064 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f5d2002b070 con 0x7f5d300c3470 2023-07-27T14:32:28.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.540+0000 7f5d177fe700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5d1c05f370 0x7f5d1c061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.541+0000 7f5d177fe700 1 -- 172.21.15.115:0/1937511064 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5d2007bd10 con 0x7f5d300c3470 2023-07-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.541+0000 7f5d2effd700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5d1c05f370 0x7f5d1c061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.541+0000 7f5d2effd700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5d1c05f370 0x7f5d1c061830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f5d300c0920 tx=0x7f5d24009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.543+0000 7f5d4d107b80 1 Processor -- start 2023-07-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.543+0000 7f5d4d107b80 1 -- start start 2023-07-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002a5c0 0x55f44002a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440052830 0x55f440078cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002cf60 0x55f4400791b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f43ff679c0 con 0x55f44002cf60 2023-07-27T14:32:28.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f43ff7ccc0 con 0x55f440052830 2023-07-27T14:32:28.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f43ff43e10 con 0x55f44002a5c0 2023-07-27T14:32:28.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002cf60 0x55f4400791b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002cf60 0x55f4400791b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47384/0 (socket says 172.21.15.115:47384) 2023-07-27T14:32:28.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2ffff700 1 -- 172.21.15.115:0/3721632914 learned_addr learned my addr 172.21.15.115:0/3721632914 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:28.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002a5c0 0x55f44002a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2effd700 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440052830 0x55f440078cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2ffff700 1 -- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002a5c0 msgr2=0x55f44002a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002a5c0 0x55f44002a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2ffff700 1 -- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440052830 msgr2=0x55f440078cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.544+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440052830 0x55f440078cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.545+0000 7f5d2ffff700 1 -- 172.21.15.115:0/3721632914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f43ff759a0 con 0x55f44002cf60 2023-07-27T14:32:28.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.545+0000 7f5d2effd700 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440052830 0x55f440078cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:28.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.545+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002cf60 0x55f4400791b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f5d28007420 tx=0x7f5d2800b040).ready entity=mon.0 client_cookie=b8c9261158a2c04b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.545+0000 7f5d149fe700 1 -- 172.21.15.115:0/3721632914 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28007e50 con 0x55f44002cf60 2023-07-27T14:32:28.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.545+0000 7f5d149fe700 1 -- 172.21.15.115:0/3721632914 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800f030 con 0x55f44002cf60 2023-07-27T14:32:28.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.545+0000 7f5d149fe700 1 -- 172.21.15.115:0/3721632914 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280126f0 con 0x55f44002cf60 2023-07-27T14:32:28.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.545+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3721632914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002cf60 msgr2=0x55f4400791b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.545+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002cf60 0x55f4400791b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f5d28007420 tx=0x7f5d2800b040).stop 2023-07-27T14:32:28.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.546+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3721632914 shutdown_connections 2023-07-27T14:32:28.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.546+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002cf60 0x55f4400791b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.546+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002a5c0 0x55f44002a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.546+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3721632914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440052830 0x55f440078cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.546+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3721632914 >> 172.21.15.115:0/3721632914 conn(0x55f43fe95940 msgr2=0x55f4400736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:28.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.546+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3721632914 shutdown_connections 2023-07-27T14:32:28.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.546+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3721632914 wait complete. 2023-07-27T14:32:28.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.547+0000 7f5d4d107b80 1 -- start start 2023-07-27T14:32:28.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.547+0000 7f5d4d107b80 1 Processor -- start 2023-07-27T14:32:28.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f44004f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f4400566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f440056250 con 0x55f440056b90 2023-07-27T14:32:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f440070f70 con 0x55f44002a5c0 2023-07-27T14:32:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f440057060 con 0x55f44002cf60 2023-07-27T14:32:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d4d107b80 10 client.0 ll_register_callbacks cb 0x55f43ff2f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:32:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47388/0 (socket says 172.21.15.115:47388) 2023-07-27T14:32:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 -- 172.21.15.115:0/15776539 learned_addr learned my addr 172.21.15.115:0/15776539 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f44004f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2effd700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f4400566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 -- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 msgr2=0x55f4400566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f4400566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 -- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 msgr2=0x55f44004f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f44004f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 -- 172.21.15.115:0/15776539 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d28009cc0 con 0x55f440056b90 2023-07-27T14:32:28.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f44004f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:28.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2effd700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f4400566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:28.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.549+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e490 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f5d28009f60 tx=0x7f5d2801a000).ready entity=mon.0 client_cookie=e8af5654fbe3069 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:32:28.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d0dffb700 1 -- 172.21.15.115:0/15776539 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28012e00 con 0x55f440056b90 2023-07-27T14:32:28.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 1 -- 172.21.15.115:0/15776539 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f440024d50 con 0x55f440056b90 2023-07-27T14:32:28.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d0dffb700 1 -- 172.21.15.115:0/15776539 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5d28015470 con 0x55f440056b90 2023-07-27T14:32:28.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d0dffb700 1 -- 172.21.15.115:0/15776539 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d28015840 con 0x55f440056b90 2023-07-27T14:32:28.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 10 client.7071 fetch_fsmap learned FSMap version 51 2023-07-27T14:32:28.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 1 -- 172.21.15.115:0/15776539 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55f43ff71190 con 0x55f440056b90 2023-07-27T14:32:28.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d0dffb700 1 -- 172.21.15.115:0/15776539 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f440024d50 con 0x55f440056b90 2023-07-27T14:32:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d0dffb700 1 -- 172.21.15.115:0/15776539 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 51) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d280159a0 con 0x55f440056b90 2023-07-27T14:32:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 10 client.7071 fetch_fsmap finished waiting for FSMap version 51 2023-07-27T14:32:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 10 client.7071 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:32:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 20 client.7071 populate_metadata read hostname 'smithi115' 2023-07-27T14:32:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] conn(0x55f44006ccd0 0x55f4400709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 4 client.7071 mds_command: new command op to 6915 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:32:28.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.550+0000 7f5d4d107b80 1 -- 172.21.15.115:0/15776539 --> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f43fde5ef0 con 0x55f44006ccd0 2023-07-27T14:32:28.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.551+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] conn(0x55f44006ccd0 0x55f4400709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.551+0000 7f5d0dffb700 10 client.7071 ms_handle_connect on v2:172.21.15.115:6834/1932712314 2023-07-27T14:32:28.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.551+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] conn(0x55f44006ccd0 0x55f4400709f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=13d1aaa884efe430 server_cookie=4caab17482273e6a in_seq=0 out_seq=0 2023-07-27T14:32:28.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d0dffb700 1 -- 172.21.15.115:0/15776539 <== mds.0 v2:172.21.15.115:6834/1932712314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x55f43fde5ef0 con 0x55f44006ccd0 2023-07-27T14:32:28.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d0dffb700 10 client.7071 handle_command_reply: tid=0 2023-07-27T14:32:28.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 client.7071 shutdown 2023-07-27T14:32:28.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 -- 172.21.15.115:0/15776539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 msgr2=0x55f44004e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e490 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f5d28009f60 tx=0x7f5d2801a000).stop 2023-07-27T14:32:28.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 -- 172.21.15.115:0/15776539 shutdown_connections 2023-07-27T14:32:28.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e490 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] conn(0x55f44006ccd0 0x55f4400709f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f44004f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/15776539 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f4400566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 -- 172.21.15.115:0/15776539 >> 172.21.15.115:0/15776539 conn(0x55f43fe95940 msgr2=0x55f440073560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:28.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d0dffb700 0 client.7071 ms_handle_reset on v2:172.21.15.115:6834/1932712314 2023-07-27T14:32:28.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 -- 172.21.15.115:0/15776539 shutdown_connections 2023-07-27T14:32:28.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.552+0000 7f5d4d107b80 1 -- 172.21.15.115:0/15776539 wait complete. 2023-07-27T14:32:28.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.553+0000 7f5d4d107b80 20 client.7071 trim_cache size 0 max 16384 2023-07-27T14:32:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.569+0000 7f5d4d107b80 1 Processor -- start 2023-07-27T14:32:28.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.569+0000 7f5d4d107b80 1 -- start start 2023-07-27T14:32:28.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.569+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f440026720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f44004dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44006d150 con 0x55f440056b90 2023-07-27T14:32:28.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44004e700 con 0x55f44002a5c0 2023-07-27T14:32:28.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4400588b0 con 0x55f44002cf60 2023-07-27T14:32:28.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47390/0 (socket says 172.21.15.115:47390) 2023-07-27T14:32:28.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 -- 172.21.15.115:0/652942864 learned_addr learned my addr 172.21.15.115:0/652942864 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:28.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f440026720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2effd700 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f44004dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 -- 172.21.15.115:0/652942864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 msgr2=0x55f44004dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f44004dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 -- 172.21.15.115:0/652942864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 msgr2=0x55f440026720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f440026720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 -- 172.21.15.115:0/652942864 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f440027970 con 0x55f440056b90 2023-07-27T14:32:28.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.570+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e210 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f5d28002230 tx=0x7f5d2801f000).ready entity=mon.0 client_cookie=5d1bc0ba1da68b84 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d151ff700 1 -- 172.21.15.115:0/652942864 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28012e00 con 0x55f440056b90 2023-07-27T14:32:28.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d151ff700 1 -- 172.21.15.115:0/652942864 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28015470 con 0x55f440056b90 2023-07-27T14:32:28.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d151ff700 1 -- 172.21.15.115:0/652942864 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28007000 con 0x55f440056b90 2023-07-27T14:32:28.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 -- 172.21.15.115:0/652942864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 msgr2=0x55f44004e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e210 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f5d28002230 tx=0x7f5d2801f000).stop 2023-07-27T14:32:28.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 -- 172.21.15.115:0/652942864 shutdown_connections 2023-07-27T14:32:28.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f440056b90 0x55f44004e210 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f44002a5c0 0x55f440026720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/652942864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f44004dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 -- 172.21.15.115:0/652942864 >> 172.21.15.115:0/652942864 conn(0x55f43fe95940 msgr2=0x55f4400707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:28.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 -- 172.21.15.115:0/652942864 shutdown_connections 2023-07-27T14:32:28.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.571+0000 7f5d4d107b80 1 -- 172.21.15.115:0/652942864 wait complete. 2023-07-27T14:32:28.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.572+0000 7f5d4d107b80 1 -- start start 2023-07-27T14:32:28.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.572+0000 7f5d4d107b80 1 Processor -- start 2023-07-27T14:32:28.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002a5c0 0x55f44004dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f44004e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d4d107b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440056b90 0x55f4400d8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f440057d60 con 0x55f44002a5c0 2023-07-27T14:32:28.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44004e700 con 0x55f440056b90 2023-07-27T14:32:28.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d4d107b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4400d9420 con 0x55f44002cf60 2023-07-27T14:32:28.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d4d107b80 10 client.0 ll_register_callbacks cb 0x55f43ff2f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:32:28.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d2f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002a5c0 0x55f44004dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d2f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002a5c0 0x55f44004dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47398/0 (socket says 172.21.15.115:47398) 2023-07-27T14:32:28.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/3375016531 learned_addr learned my addr 172.21.15.115:0/3375016531 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:28.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d2effd700 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f44004e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.574+0000 7f5d2ffff700 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440056b90 0x55f4400d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/3375016531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 msgr2=0x55f44004e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f44004e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/3375016531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440056b90 msgr2=0x55f4400d8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440056b90 0x55f4400d8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d2f7fe700 1 -- 172.21.15.115:0/3375016531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f43ff71190 con 0x55f44002a5c0 2023-07-27T14:32:28.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d2f7fe700 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002a5c0 0x55f44004dd20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f5d20009e80 tx=0x7f5d2000e000).ready entity=mon.0 client_cookie=76e2b1085e22d8b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:32:28.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d0dffb700 1 -- 172.21.15.115:0/3375016531 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20050a50 con 0x55f44002a5c0 2023-07-27T14:32:28.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d0dffb700 1 -- 172.21.15.115:0/3375016531 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5d20055030 con 0x55f44002a5c0 2023-07-27T14:32:28.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3375016531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d2800f030 con 0x55f44002a5c0 2023-07-27T14:32:28.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d0dffb700 1 -- 172.21.15.115:0/3375016531 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d2004d1c0 con 0x55f44002a5c0 2023-07-27T14:32:28.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d4d107b80 10 client.7077 fetch_fsmap learned FSMap version 51 2023-07-27T14:32:28.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3375016531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55f43ff70ee0 con 0x55f44002a5c0 2023-07-27T14:32:28.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d0dffb700 1 -- 172.21.15.115:0/3375016531 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800f030 con 0x55f44002a5c0 2023-07-27T14:32:28.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.575+0000 7f5d0dffb700 1 -- 172.21.15.115:0/3375016531 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 51) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d2004ffa0 con 0x55f44002a5c0 2023-07-27T14:32:28.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d4d107b80 10 client.7077 fetch_fsmap finished waiting for FSMap version 51 2023-07-27T14:32:28.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d4d107b80 10 client.7077 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:32:28.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d4d107b80 20 client.7077 populate_metadata read hostname 'smithi115' 2023-07-27T14:32:28.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] conn(0x55f44006b3f0 0x55f4400d8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d4d107b80 4 client.7077 mds_command: new command op to 6915 tid=0[{"prefix": "status"}] 2023-07-27T14:32:28.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3375016531 --> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f43fe1b040 con 0x55f44006b3f0 2023-07-27T14:32:28.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d2effd700 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] conn(0x55f44006b3f0 0x55f4400d8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d2effd700 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] conn(0x55f44006b3f0 0x55f4400d8a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b46d358c09fae4bb server_cookie=b18f94174c4b989e in_seq=0 out_seq=0 2023-07-27T14:32:28.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d0dffb700 10 client.7077 ms_handle_connect on v2:172.21.15.115:6834/1932712314 2023-07-27T14:32:28.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d0dffb700 1 -- 172.21.15.115:0/3375016531 <== mds.0 v2:172.21.15.115:6834/1932712314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55f43fe1b040 con 0x55f44006b3f0 2023-07-27T14:32:28.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d0dffb700 10 client.7077 handle_command_reply: tid=0 2023-07-27T14:32:28.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.576+0000 7f5d4d107b80 1 client.7077 shutdown 2023-07-27T14:32:28.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3375016531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002a5c0 msgr2=0x55f44004dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002a5c0 0x55f44004dd20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f5d20009e80 tx=0x7f5d2000e000).stop 2023-07-27T14:32:28.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3375016531 shutdown_connections 2023-07-27T14:32:28.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.115:6834/1932712314,v1:172.21.15.115:6836/1932712314] conn(0x55f44006b3f0 0x55f4400d8a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f440056b90 0x55f4400d8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f44002a5c0 0x55f44004dd20 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d0dffb700 0 client.7077 ms_handle_reset on v2:172.21.15.115:6834/1932712314 2023-07-27T14:32:28.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 --2- 172.21.15.115:0/3375016531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55f44002cf60 0x55f44004e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3375016531 >> 172.21.15.115:0/3375016531 conn(0x55f43fe95940 msgr2=0x55f44006f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:28.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3375016531 shutdown_connections 2023-07-27T14:32:28.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 1 -- 172.21.15.115:0/3375016531 wait complete. 2023-07-27T14:32:28.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.577+0000 7f5d4d107b80 20 client.7077 trim_cache size 0 max 16384 2023-07-27T14:32:28.625 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:28.625 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:32:28.625 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:32:28.625 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 6915, 2023-07-27T14:32:28.625 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:32:28.626 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:32:28.626 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:32:28.626 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2778153769999996, 2023-07-27T14:32:28.626 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 51, 2023-07-27T14:32:28.626 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 100, 2023-07-27T14:32:28.626 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 100, 2023-07-27T14:32:28.626 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.507927994999999 2023-07-27T14:32:28.627 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:28.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 -- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5d1c05f370 msgr2=0x7f5d1c061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5d1c05f370 0x7f5d1c061830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f5d300c0920 tx=0x7f5d24009040).stop 2023-07-27T14:32:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 -- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 msgr2=0x7f5d3014e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d3014e600 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f5d20009fd0 tx=0x7f5d20017000).stop 2023-07-27T14:32:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 -- 172.21.15.115:0/1937511064 shutdown_connections 2023-07-27T14:32:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5d1c05f370 0x7f5d1c061830 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d3014fbd0 0x7f5d300a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d300c3470 0x7f5d3014e600 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 --2- 172.21.15.115:0/1937511064 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d300c3850 0x7f5d300be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 -- 172.21.15.115:0/1937511064 >> 172.21.15.115:0/1937511064 conn(0x7f5d30062320 msgr2=0x7f5d301384f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 -- 172.21.15.115:0/1937511064 shutdown_connections 2023-07-27T14:32:28.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.578+0000 7f5d35dff700 1 -- 172.21.15.115:0/1937511064 wait complete. 2023-07-27T14:32:28.630 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:32:28.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.752+0000 7f21ff9ff700 1 Processor -- start 2023-07-27T14:32:28.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.752+0000 7f21ff9ff700 1 -- start start 2023-07-27T14:32:28.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.753+0000 7f21ff9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f21f8155580 0x7f21f815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.753+0000 7f21ff9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f8158e00 con 0x7f21f8154190 2023-07-27T14:32:28.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.753+0000 7f21ff9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f8158040 con 0x7f21f80c64b0 2023-07-27T14:32:28.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.753+0000 7f21ff9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80aa640 con 0x7f21f8155580 2023-07-27T14:32:28.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.753+0000 7f21fd79b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f21f8154190 0x7f21f80a9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40696/0 (socket says 172.21.15.115:40696) 2023-07-27T14:32:28.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.753+0000 7f21fd79b700 1 -- 172.21.15.115:0/673570412 learned_addr learned my addr 172.21.15.115:0/673570412 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:28.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.753+0000 7f21fdf9c700 1 --2- 172.21.15.115:0/673570412 >> v2:172.21.15.115:3300/0 conn(0x7f21f8155580 0x7f21f815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21effff700 1 -- 172.21.15.115:0/673570412 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632851247 0 0) 0x7f21f8158e00 con 0x7f21f8154190 2023-07-27T14:32:28.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21effff700 1 -- 172.21.15.115:0/673570412 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e40033f0 con 0x7f21f8154190 2023-07-27T14:32:28.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21fdf9c700 1 -- 172.21.15.115:0/673570412 >> v1:172.21.15.159:6789/0 conn(0x7f21f80c64b0 legacy=0x7f21f80641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:28.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21fdf9c700 1 -- 172.21.15.115:0/673570412 >> v1:172.21.15.115:6789/0 conn(0x7f21f8154190 legacy=0x7f21f80a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21fdf9c700 1 -- 172.21.15.115:0/673570412 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8158320 con 0x7f21f8155580 2023-07-27T14:32:28.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21fdf9c700 1 --2- 172.21.15.115:0/673570412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f8155580 0x7f21f815f240 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f21f0009e60 tx=0x7f21f0009780).ready entity=mon.0 client_cookie=aa2a4648d2322631 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21effff700 1 -- 172.21.15.115:0/673570412 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f000e070 con 0x7f21f8155580 2023-07-27T14:32:28.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21effff700 1 -- 172.21.15.115:0/673570412 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f000bb60 con 0x7f21f8155580 2023-07-27T14:32:28.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.754+0000 7f21effff700 1 -- 172.21.15.115:0/673570412 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0012410 con 0x7f21f8155580 2023-07-27T14:32:28.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.755+0000 7f21ff9ff700 1 -- 172.21.15.115:0/673570412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f8155580 msgr2=0x7f21f815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.755+0000 7f21ff9ff700 1 --2- 172.21.15.115:0/673570412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f8155580 0x7f21f815f240 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f21f0009e60 tx=0x7f21f0009780).stop 2023-07-27T14:32:28.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.755+0000 7f21ff9ff700 1 -- 172.21.15.115:0/673570412 shutdown_connections 2023-07-27T14:32:28.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.755+0000 7f21ff9ff700 1 --2- 172.21.15.115:0/673570412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f8155580 0x7f21f815f240 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.755+0000 7f21ff9ff700 1 -- 172.21.15.115:0/673570412 >> 172.21.15.115:0/673570412 conn(0x7f21f80cb730 msgr2=0x7f21f80c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:28.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.755+0000 7f21ff9ff700 1 -- 172.21.15.115:0/673570412 shutdown_connections 2023-07-27T14:32:28.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.755+0000 7f21ff9ff700 1 -- 172.21.15.115:0/673570412 wait complete. 2023-07-27T14:32:28.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.756+0000 7f21ff9ff700 1 Processor -- start 2023-07-27T14:32:28.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.757+0000 7f21ff9ff700 1 -- start start 2023-07-27T14:32:28.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.757+0000 7f21ff9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f80c64b0 0x7f21f8150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.757+0000 7f21ff9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f8154190 0x7f21f814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.757+0000 7f21ff9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f814c470 0x7f21f80bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.757+0000 7f21ff9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8165920 con 0x7f21f80c64b0 2023-07-27T14:32:28.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.757+0000 7f21ff9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8164ff0 con 0x7f21f814c470 2023-07-27T14:32:28.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.757+0000 7f21ff9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f81652d0 con 0x7f21f8154190 2023-07-27T14:32:28.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f80c64b0 0x7f21f8150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f80c64b0 0x7f21f8150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47404/0 (socket says 172.21.15.115:47404) 2023-07-27T14:32:28.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 -- 172.21.15.115:0/874483719 learned_addr learned my addr 172.21.15.115:0/874483719 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:28.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fdf9c700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f814c470 0x7f21f80bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fcf9a700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f8154190 0x7f21f814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 -- 172.21.15.115:0/874483719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f8154190 msgr2=0x7f21f814bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f8154190 0x7f21f814bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 -- 172.21.15.115:0/874483719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f814c470 msgr2=0x7f21f80bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:28.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f814c470 0x7f21f80bfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:28.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 -- 172.21.15.115:0/874483719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009a20 con 0x7f21f80c64b0 2023-07-27T14:32:28.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.758+0000 7f21fd79b700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f80c64b0 0x7f21f8150ab0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f21f400c590 tx=0x7f21f4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.759+0000 7f21ed7fa700 1 -- 172.21.15.115:0/874483719 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40072e0 con 0x7f21f80c64b0 2023-07-27T14:32:28.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.759+0000 7f21ed7fa700 1 -- 172.21.15.115:0/874483719 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4007440 con 0x7f21f80c64b0 2023-07-27T14:32:28.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.759+0000 7f21ed7fa700 1 -- 172.21.15.115:0/874483719 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40057a0 con 0x7f21f80c64b0 2023-07-27T14:32:28.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.759+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f81655b0 con 0x7f21f80c64b0 2023-07-27T14:32:28.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.759+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8150fa0 con 0x7f21f80c64b0 2023-07-27T14:32:28.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.760+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f81511c0 con 0x7f21f80c64b0 2023-07-27T14:32:28.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.761+0000 7f21ed7fa700 1 -- 172.21.15.115:0/874483719 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f21f4010070 con 0x7f21f80c64b0 2023-07-27T14:32:28.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.761+0000 7f21ed7fa700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21dc05f340 0x7f21dc061800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:28.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.761+0000 7f21ed7fa700 1 -- 172.21.15.115:0/874483719 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f21f4079b20 con 0x7f21f80c64b0 2023-07-27T14:32:28.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.762+0000 7f21fcf9a700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21dc05f340 0x7f21dc061800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:28.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.762+0000 7f21fcf9a700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21dc05f340 0x7f21dc061800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f21f80aa040 tx=0x7f21e8007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:28.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.765+0000 7f21ed7fa700 1 -- 172.21.15.115:0/874483719 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21f81511c0 con 0x7f21f80c64b0 2023-07-27T14:32:29.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.975+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f21f81511c0 con 0x7f21f80c64b0 2023-07-27T14:32:29.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.975+0000 7f21ed7fa700 1 -- 172.21.15.115:0/874483719 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f21f81511c0 con 0x7f21f80c64b0 2023-07-27T14:32:29.012 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21dc05f340 msgr2=0x7f21dc061800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21dc05f340 0x7f21dc061800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f21f80aa040 tx=0x7f21e8007d40).stop 2023-07-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f80c64b0 msgr2=0x7f21f8150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f80c64b0 0x7f21f8150ab0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f21f400c590 tx=0x7f21f4007c80).stop 2023-07-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 shutdown_connections 2023-07-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f21dc05f340 0x7f21dc061800 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21f814c470 0x7f21f80bfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21f80c64b0 0x7f21f8150ab0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 --2- 172.21.15.115:0/874483719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f21f8154190 0x7f21f814bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.977+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 >> 172.21.15.115:0/874483719 conn(0x7f21f80cb730 msgr2=0x7f21f80c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.978+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 shutdown_connections 2023-07-27T14:32:29.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:28.978+0000 7f21ff9ff700 1 -- 172.21.15.115:0/874483719 wait complete. 2023-07-27T14:32:29.028 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:32:29.028 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:32:29.029 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:32:29.029 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:32:29.029 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:32:29.030 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:32:29.030 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:32:29.030 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:32:29.030 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:32:29.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:29.032 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:32:29.078 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:32:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:32:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:32:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:32:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:29.079 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:32:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:32:29.080 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:32:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:32:29.080 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:32:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:29.080 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:32:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:32:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41652sec preferred_lft 41652sec 2023-07-27T14:32:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:32:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:29.081 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:32:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:32:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:32:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:29.083 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:32:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:32:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:32:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:29.083 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:32:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:32:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:32:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:29.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:29.085 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:32:29.152 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:32:29.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:29.155 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:32:29.204 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:32:29.204 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:32:29.204 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:32:29.205 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:32:29.205 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:32:29.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:29.206 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:32:29.206 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:32:29.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:32:29.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:32:29.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:32:29.208 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:32:29.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:29.377 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:32:29.423 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:32:29.424 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:32:29.425 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:32:29.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:29.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:32:29.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:29.496 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:32:29.542 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:32:29.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:32:29.680 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:32:29.680 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:32:29.682 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:32:29.686 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:32:29.706 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:32:29.706 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:32:29.710 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:32:29.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:29.711 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:32:29.821 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:32:29.985 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.950+0000 7f9213fff700 1 Processor -- start 2023-07-27T14:32:29.985 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.950+0000 7f9213fff700 1 -- start start 2023-07-27T14:32:29.987 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f9213fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c0647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:29.987 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f9213fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f920c06a230 0x7f920c0a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:29.987 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f9213fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c0aa570 con 0x7f920c153dc0 2023-07-27T14:32:29.987 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f9213fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c0c05f0 con 0x7f920c06a230 2023-07-27T14:32:29.987 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f9213fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0c1a90 con 0x7f920c064400 2023-07-27T14:32:29.987 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f921159a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f920c06a230 0x7f920c0a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:29.988 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f9211d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c0647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:29.988 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f921159a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f920c06a230 0x7f920c0a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46210/0 (socket says 172.21.15.159:46210) 2023-07-27T14:32:29.988 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f921159a700 1 -- 172.21.15.159:0/4233178776 learned_addr learned my addr 172.21.15.159:0/4233178776 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:32:29.988 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.951+0000 7f921259c700 1 --1- 172.21.15.159:0/4233178776 >> v1:172.21.15.159:6789/0 conn(0x7f920c153dc0 0x7f920c154250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:37498/0 (socket says 172.21.15.159:37498) 2023-07-27T14:32:29.989 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9211d9b700 1 -- 172.21.15.159:0/4233178776 >> v2:172.21.15.159:3300/0 conn(0x7f920c06a230 msgr2=0x7f920c0a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:29.989 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9211d9b700 1 --2- 172.21.15.159:0/4233178776 >> v2:172.21.15.159:3300/0 conn(0x7f920c06a230 0x7f920c0a9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.990 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9211d9b700 1 -- 172.21.15.159:0/4233178776 >> v1:172.21.15.159:6789/0 conn(0x7f920c153dc0 legacy=0x7f920c154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:29.990 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9211d9b700 1 -- 172.21.15.159:0/4233178776 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0aa2a0 con 0x7f920c064400 2023-07-27T14:32:29.990 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9210d99700 1 -- 172.21.15.159:0/4233178776 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426462610 0 0) 0x7f920c0aa570 con 0x7f920c153dc0 2023-07-27T14:32:29.990 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f921159a700 1 --2- 172.21.15.159:0/4233178776 >> v2:172.21.15.159:3300/0 conn(0x7f920c06a230 0x7f920c0a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:29.990 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9211d9b700 1 --2- 172.21.15.159:0/4233178776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c0647e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f9208009760 tx=0x7f9208009060).ready entity=mon.2 client_cookie=c9558f49fb11a866 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:29.990 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9210d99700 1 -- 172.21.15.159:0/4233178776 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800f510 con 0x7f920c064400 2023-07-27T14:32:29.990 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9210d99700 1 -- 172.21.15.159:0/4233178776 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920800f670 con 0x7f920c064400 2023-07-27T14:32:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.952+0000 7f9210d99700 1 -- 172.21.15.159:0/4233178776 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800f9f0 con 0x7f920c064400 2023-07-27T14:32:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.953+0000 7f9213fff700 1 -- 172.21.15.159:0/4233178776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 msgr2=0x7f920c0647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.953+0000 7f9213fff700 1 --2- 172.21.15.159:0/4233178776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c0647e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f9208009760 tx=0x7f9208009060).stop 2023-07-27T14:32:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.953+0000 7f9213fff700 1 -- 172.21.15.159:0/4233178776 shutdown_connections 2023-07-27T14:32:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.953+0000 7f9213fff700 1 --2- 172.21.15.159:0/4233178776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c0647e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.953+0000 7f9213fff700 1 --2- 172.21.15.159:0/4233178776 >> v2:172.21.15.159:3300/0 conn(0x7f920c06a230 0x7f920c0a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.953+0000 7f9213fff700 1 -- 172.21.15.159:0/4233178776 >> 172.21.15.159:0/4233178776 conn(0x7f920c0c81c0 msgr2=0x7f920c069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:29.991 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.953+0000 7f9213fff700 1 -- 172.21.15.159:0/4233178776 shutdown_connections 2023-07-27T14:32:29.992 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.953+0000 7f9213fff700 1 -- 172.21.15.159:0/4233178776 wait complete. 2023-07-27T14:32:29.993 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.954+0000 7f9213fff700 1 Processor -- start 2023-07-27T14:32:29.993 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.955+0000 7f9213fff700 1 -- start start 2023-07-27T14:32:29.993 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.955+0000 7f9213fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:29.994 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9213fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f920c06a230 0x7f920c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:29.994 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9213fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f920c153dc0 0x7f920c0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:29.994 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9213fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0af6f0 con 0x7f920c06a230 2023-07-27T14:32:29.994 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9213fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c157520 con 0x7f920c153dc0 2023-07-27T14:32:29.994 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9213fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c156bf0 con 0x7f920c064400 2023-07-27T14:32:29.994 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:29.994 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f921259c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f920c153dc0 0x7f920c0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:29.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:56956/0 (socket says 172.21.15.159:56956) 2023-07-27T14:32:29.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 -- 172.21.15.159:0/3086088863 learned_addr learned my addr 172.21.15.159:0/3086088863 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:32:29.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f921159a700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f920c06a230 0x7f920c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:29.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 -- 172.21.15.159:0/3086088863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f920c153dc0 msgr2=0x7f920c0aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:29.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f920c153dc0 0x7f920c0aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 -- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f920c06a230 msgr2=0x7f920c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:29.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f920c06a230 0x7f920c0ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:29.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 -- 172.21.15.159:0/3086088863 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc009370 con 0x7f920c064400 2023-07-27T14:32:29.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.956+0000 7f9211d9b700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c144890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9208009e00 tx=0x7f9208017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:29.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.957+0000 7f9201ffb700 1 -- 172.21.15.159:0/3086088863 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800fe80 con 0x7f920c064400 2023-07-27T14:32:29.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.957+0000 7f9201ffb700 1 -- 172.21.15.159:0/3086088863 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920800f7e0 con 0x7f920c064400 2023-07-27T14:32:29.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.957+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92080092a0 con 0x7f920c064400 2023-07-27T14:32:29.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.957+0000 7f9201ffb700 1 -- 172.21.15.159:0/3086088863 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920801b640 con 0x7f920c064400 2023-07-27T14:32:29.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.957+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c156f80 con 0x7f920c064400 2023-07-27T14:32:29.997 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.958+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c05f0c0 con 0x7f920c064400 2023-07-27T14:32:29.997 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.959+0000 7f9201ffb700 1 -- 172.21.15.159:0/3086088863 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f920802b070 con 0x7f920c064400 2023-07-27T14:32:29.997 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.960+0000 7f9201ffb700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f005f370 0x7f91f0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:29.998 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.960+0000 7f9201ffb700 1 -- 172.21.15.159:0/3086088863 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f920807b8e0 con 0x7f920c064400 2023-07-27T14:32:29.998 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.961+0000 7f921159a700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f005f370 0x7f91f0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:29.998 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.961+0000 7f921159a700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f005f370 0x7f91f0061830 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f920c0aa250 tx=0x7f91fc0090f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:30.000 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:29.965+0000 7f9201ffb700 1 -- 172.21.15.159:0/3086088863 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f920804cad0 con 0x7f920c064400 2023-07-27T14:32:30.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.174+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f920c156d80 con 0x7f920c064400 2023-07-27T14:32:30.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.175+0000 7f9201ffb700 1 -- 172.21.15.159:0/3086088863 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f920801f070 con 0x7f920c064400 2023-07-27T14:32:30.210 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:32:30.212 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.176+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f005f370 msgr2=0x7f91f0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:30.213 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f005f370 0x7f91f0061830 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f920c0aa250 tx=0x7f91fc0090f0).stop 2023-07-27T14:32:30.213 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 msgr2=0x7f920c144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:30.213 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c144890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9208009e00 tx=0x7f9208017000).stop 2023-07-27T14:32:30.213 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 shutdown_connections 2023-07-27T14:32:30.213 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f005f370 0x7f91f0061830 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:30.213 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f920c153dc0 0x7f920c0aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:30.213 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f920c064400 0x7f920c144890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:30.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 --2- 172.21.15.159:0/3086088863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f920c06a230 0x7f920c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:30.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 >> 172.21.15.159:0/3086088863 conn(0x7f920c0c81c0 msgr2=0x7f920c069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:30.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 shutdown_connections 2023-07-27T14:32:30.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:32:30.177+0000 7f9213fff700 1 -- 172.21.15.159:0/3086088863 wait complete. 2023-07-27T14:32:30.227 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:32:30.227 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:32:30.228 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:32:30.228 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:32:30.228 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:32:30.228 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:32:30.229 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:32:30.229 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:32:30.229 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:32:30.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:30.230 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:32:30.277 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:32:30.277 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:32:30.277 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:32:30.277 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:30.277 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:32:30.278 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:30.278 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:32:30.278 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:30.278 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:32:30.278 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:32:30.278 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:30.278 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:32:30.278 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:32:30.279 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:30.279 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:32:30.279 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:30.279 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:32:30.279 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41646sec preferred_lft 41646sec 2023-07-27T14:32:30.279 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:32:30.279 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:30.279 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:32:30.280 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:32:30.280 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:32:30.280 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:30.280 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:32:30.280 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:30.280 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:32:30.280 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:32:30.281 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:32:30.281 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:30.281 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:32:30.281 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:32:30.281 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:32:30.281 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:32:30.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:30.283 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:32:30.350 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:32:30.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:30.354 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:32:30.403 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:32:30.403 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:32:30.403 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:32:30.403 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:32:30.403 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:32:30.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:30.405 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:32:30.405 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:32:30.405 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:32:30.406 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:32:30.406 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:32:30.406 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:32:30.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:30.577 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:32:30.624 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:32:30.624 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:32:30.625 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:32:30.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:30.626 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:32:30.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:30.698 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:32:30.744 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:32:30.745 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:32:30.882 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:32:30.882 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:32:30.910 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:32:30.911 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:32:30.916 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:32:30.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:30.918 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:32:30.988 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:32:31.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.154+0000 7fcaf31ff700 1 Processor -- start 2023-07-27T14:32:31.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.154+0000 7fcaf31ff700 1 -- start start 2023-07-27T14:32:31.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.155+0000 7fcaf31ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcaec0c6b70 0x7fcaec0656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.155+0000 7fcaf31ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcaec065bc0 0x7fcaec062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.155+0000 7fcaf31ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec066050 con 0x7fcaec153e00 2023-07-27T14:32:31.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.155+0000 7fcaf31ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec062320 con 0x7fcaec065bc0 2023-07-27T14:32:31.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.155+0000 7fcaf31ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec064a80 con 0x7fcaec0c6b70 2023-07-27T14:32:31.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.155+0000 7fcaf0f9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcaec153e00 0x7fcaec064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40698/0 (socket says 172.21.15.115:40698) 2023-07-27T14:32:31.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.155+0000 7fcaf0f9b700 1 -- 172.21.15.115:0/3187122656 learned_addr learned my addr 172.21.15.115:0/3187122656 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:31.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.155+0000 7fcaf179c700 1 --2- 172.21.15.115:0/3187122656 >> v2:172.21.15.115:3300/0 conn(0x7fcaec065bc0 0x7fcaec062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaebfff700 1 --2- 172.21.15.115:0/3187122656 >> v2:172.21.15.159:3300/0 conn(0x7fcaec0c6b70 0x7fcaec0656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaeb7fe700 1 -- 172.21.15.115:0/3187122656 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19169754 0 0) 0x7fcaec066050 con 0x7fcaec153e00 2023-07-27T14:32:31.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaeb7fe700 1 -- 172.21.15.115:0/3187122656 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcadc0033f0 con 0x7fcaec153e00 2023-07-27T14:32:31.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaf179c700 1 -- 172.21.15.115:0/3187122656 >> v2:172.21.15.159:3300/0 conn(0x7fcaec0c6b70 msgr2=0x7fcaec0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:31.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaf179c700 1 --2- 172.21.15.115:0/3187122656 >> v2:172.21.15.159:3300/0 conn(0x7fcaec0c6b70 0x7fcaec0656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaf179c700 1 -- 172.21.15.115:0/3187122656 >> v1:172.21.15.115:6789/0 conn(0x7fcaec153e00 legacy=0x7fcaec064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaf179c700 1 -- 172.21.15.115:0/3187122656 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec064d60 con 0x7fcaec065bc0 2023-07-27T14:32:31.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaebfff700 1 --2- 172.21.15.115:0/3187122656 >> v2:172.21.15.159:3300/0 conn(0x7fcaec0c6b70 0x7fcaec0656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:31.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaf179c700 1 --2- 172.21.15.115:0/3187122656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec065bc0 0x7fcaec062770 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fcaec0c3b80 tx=0x7fcae4009780).ready entity=mon.0 client_cookie=9ba951e023d9f79c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:31.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaeb7fe700 1 -- 172.21.15.115:0/3187122656 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae400e070 con 0x7fcaec065bc0 2023-07-27T14:32:31.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaeb7fe700 1 -- 172.21.15.115:0/3187122656 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae400bb60 con 0x7fcaec065bc0 2023-07-27T14:32:31.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.156+0000 7fcaeb7fe700 1 -- 172.21.15.115:0/3187122656 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4012410 con 0x7fcaec065bc0 2023-07-27T14:32:31.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.157+0000 7fcaf31ff700 1 -- 172.21.15.115:0/3187122656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec065bc0 msgr2=0x7fcaec062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.157+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/3187122656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec065bc0 0x7fcaec062770 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fcaec0c3b80 tx=0x7fcae4009780).stop 2023-07-27T14:32:31.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.157+0000 7fcaf31ff700 1 -- 172.21.15.115:0/3187122656 shutdown_connections 2023-07-27T14:32:31.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.157+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/3187122656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec065bc0 0x7fcaec062770 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.157+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/3187122656 >> v2:172.21.15.159:3300/0 conn(0x7fcaec0c6b70 0x7fcaec0656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.157+0000 7fcaf31ff700 1 -- 172.21.15.115:0/3187122656 >> 172.21.15.115:0/3187122656 conn(0x7fcaec0c7b90 msgr2=0x7fcaec0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:31.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.157+0000 7fcaf31ff700 1 -- 172.21.15.115:0/3187122656 shutdown_connections 2023-07-27T14:32:31.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.157+0000 7fcaf31ff700 1 -- 172.21.15.115:0/3187122656 wait complete. 2023-07-27T14:32:31.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.159+0000 7fcaf31ff700 1 Processor -- start 2023-07-27T14:32:31.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.159+0000 7fcaf31ff700 1 -- start start 2023-07-27T14:32:31.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaf31ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaec065bc0 0x7fcaec155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaf31ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec0c6b70 0x7fcaec155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaf31ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaec153e00 0x7fcaec14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaf31ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec155e00 con 0x7fcaec0c6b70 2023-07-27T14:32:31.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaf31ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec156c50 con 0x7fcaec153e00 2023-07-27T14:32:31.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaf31ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec156040 con 0x7fcaec065bc0 2023-07-27T14:32:31.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec0c6b70 0x7fcaec155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec0c6b70 0x7fcaec155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47428/0 (socket says 172.21.15.115:47428) 2023-07-27T14:32:31.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaebfff700 1 -- 172.21.15.115:0/1730693213 learned_addr learned my addr 172.21.15.115:0/1730693213 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:31.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaf0f9b700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaec065bc0 0x7fcaec155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaf179c700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaec153e00 0x7fcaec14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaebfff700 1 -- 172.21.15.115:0/1730693213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaec065bc0 msgr2=0x7fcaec155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaebfff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaec065bc0 0x7fcaec155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaebfff700 1 -- 172.21.15.115:0/1730693213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaec153e00 msgr2=0x7fcaec14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaebfff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaec153e00 0x7fcaec14c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.160+0000 7fcaebfff700 1 -- 172.21.15.115:0/1730693213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae4009a20 con 0x7fcaec0c6b70 2023-07-27T14:32:31.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.161+0000 7fcaebfff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec0c6b70 0x7fcaec155910 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fcad800d860 tx=0x7fcad8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:31.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.161+0000 7fcae8ff9700 1 -- 172.21.15.115:0/1730693213 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800f520 con 0x7fcaec0c6b70 2023-07-27T14:32:31.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.161+0000 7fcae8ff9700 1 -- 172.21.15.115:0/1730693213 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad800f680 con 0x7fcaec0c6b70 2023-07-27T14:32:31.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.161+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec156320 con 0x7fcaec0c6b70 2023-07-27T14:32:31.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.161+0000 7fcae8ff9700 1 -- 172.21.15.115:0/1730693213 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800fa00 con 0x7fcaec0c6b70 2023-07-27T14:32:31.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.161+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec1568e0 con 0x7fcaec0c6b70 2023-07-27T14:32:31.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.162+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec156de0 con 0x7fcaec0c6b70 2023-07-27T14:32:31.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.163+0000 7fcae8ff9700 1 -- 172.21.15.115:0/1730693213 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fcad801a030 con 0x7fcaec0c6b70 2023-07-27T14:32:31.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.164+0000 7fcae8ff9700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcad005f370 0x7fcad0061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.164+0000 7fcae8ff9700 1 -- 172.21.15.115:0/1730693213 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcad8079fe0 con 0x7fcaec0c6b70 2023-07-27T14:32:31.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.164+0000 7fcaf0f9b700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcad005f370 0x7fcad0061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.164+0000 7fcaf0f9b700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcad005f370 0x7fcad0061830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fcae0007fd0 tx=0x7fcae0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:31.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.167+0000 7fcae8ff9700 1 -- 172.21.15.115:0/1730693213 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcad804aef0 con 0x7fcaec0c6b70 2023-07-27T14:32:31.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.379+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcaec06c470 con 0x7fcaec0c6b70 2023-07-27T14:32:31.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.622+0000 7fcae8ff9700 1 -- 172.21.15.115:0/1730693213 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 136+0+0 (secure 0 0 0) 0x7fcad804e510 con 0x7fcaec0c6b70 2023-07-27T14:32:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcad005f370 msgr2=0x7fcad0061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcad005f370 0x7fcad0061830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fcae0007fd0 tx=0x7fcae0009040).stop 2023-07-27T14:32:31.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec0c6b70 msgr2=0x7fcaec155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec0c6b70 0x7fcaec155910 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fcad800d860 tx=0x7fcad8008040).stop 2023-07-27T14:32:31.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 shutdown_connections 2023-07-27T14:32:31.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcad005f370 0x7fcad0061830 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaec153e00 0x7fcaec14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcaec065bc0 0x7fcaec155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 --2- 172.21.15.115:0/1730693213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcaec0c6b70 0x7fcaec155910 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 >> 172.21.15.115:0/1730693213 conn(0x7fcaec0c7b90 msgr2=0x7fcaec0bc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:31.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 shutdown_connections 2023-07-27T14:32:31.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.624+0000 7fcaf31ff700 1 -- 172.21.15.115:0/1730693213 wait complete. 2023-07-27T14:32:31.678 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:32:31.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.831+0000 7f85299ff700 1 Processor -- start 2023-07-27T14:32:31.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.831+0000 7f85299ff700 1 -- start start 2023-07-27T14:32:31.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.832+0000 7f85299ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f85240a7750 0x7f85240a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.832+0000 7f85299ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852414c960 con 0x7f85241530e0 2023-07-27T14:32:31.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.832+0000 7f85299ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85240c4c30 con 0x7f852414c580 2023-07-27T14:32:31.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.832+0000 7f85299ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8524067a30 con 0x7f85240a7750 2023-07-27T14:32:31.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.832+0000 7f85227fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f85241530e0 0x7f85240c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40710/0 (socket says 172.21.15.115:40710) 2023-07-27T14:32:31.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.832+0000 7f85227fc700 1 -- 172.21.15.115:0/3733246097 learned_addr learned my addr 172.21.15.115:0/3733246097 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:31.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.832+0000 7f85237fe700 1 --2- 172.21.15.115:0/3733246097 >> v2:172.21.15.115:3300/0 conn(0x7f85240a7750 0x7f85240a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.833+0000 7f85237fe700 1 -- 172.21.15.115:0/3733246097 >> v1:172.21.15.159:6789/0 conn(0x7f852414c580 legacy=0x7f8524067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:31.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.833+0000 7f85237fe700 1 -- 172.21.15.115:0/3733246097 >> v1:172.21.15.115:6789/0 conn(0x7f85241530e0 legacy=0x7f85240c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.833+0000 7f85237fe700 1 -- 172.21.15.115:0/3733246097 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524067690 con 0x7f85240a7750 2023-07-27T14:32:31.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.833+0000 7f8521ffb700 1 -- 172.21.15.115:0/3733246097 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361424454 0 0) 0x7f852414c960 con 0x7f85241530e0 2023-07-27T14:32:31.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.833+0000 7f85237fe700 1 --2- 172.21.15.115:0/3733246097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f85240a7b60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f851c009e60 tx=0x7f851c009780).ready entity=mon.0 client_cookie=7c1d733ef27e54c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:31.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.833+0000 7f8521ffb700 1 -- 172.21.15.115:0/3733246097 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00e070 con 0x7f85240a7750 2023-07-27T14:32:31.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.833+0000 7f8521ffb700 1 -- 172.21.15.115:0/3733246097 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00bbf0 con 0x7f85240a7750 2023-07-27T14:32:31.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.833+0000 7f8521ffb700 1 -- 172.21.15.115:0/3733246097 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c012410 con 0x7f85240a7750 2023-07-27T14:32:31.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.834+0000 7f85299ff700 1 -- 172.21.15.115:0/3733246097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 msgr2=0x7f85240a7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.834+0000 7f85299ff700 1 --2- 172.21.15.115:0/3733246097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f85240a7b60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f851c009e60 tx=0x7f851c009780).stop 2023-07-27T14:32:31.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.834+0000 7f85299ff700 1 -- 172.21.15.115:0/3733246097 shutdown_connections 2023-07-27T14:32:31.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.834+0000 7f85299ff700 1 --2- 172.21.15.115:0/3733246097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f85240a7b60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.834+0000 7f85299ff700 1 -- 172.21.15.115:0/3733246097 >> 172.21.15.115:0/3733246097 conn(0x7f85240c89a0 msgr2=0x7f85240c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:31.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.834+0000 7f85299ff700 1 -- 172.21.15.115:0/3733246097 shutdown_connections 2023-07-27T14:32:31.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.834+0000 7f85299ff700 1 -- 172.21.15.115:0/3733246097 wait complete. 2023-07-27T14:32:31.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.835+0000 7f85299ff700 1 Processor -- start 2023-07-27T14:32:31.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.835+0000 7f85299ff700 1 -- start start 2023-07-27T14:32:31.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.836+0000 7f85299ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f8524064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.836+0000 7f85299ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f852414c580 0x7f85241549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.836+0000 7f85299ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85241530e0 0x7f8524154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.836+0000 7f85299ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524068560 con 0x7f85240a7750 2023-07-27T14:32:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.836+0000 7f85299ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85241650c0 con 0x7f85241530e0 2023-07-27T14:32:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.836+0000 7f85299ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85241553b0 con 0x7f852414c580 2023-07-27T14:32:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f8524064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f8524064ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47456/0 (socket says 172.21.15.115:47456) 2023-07-27T14:32:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 -- 172.21.15.115:0/2319607494 learned_addr learned my addr 172.21.15.115:0/2319607494 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f85237fe700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85241530e0 0x7f8524154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f85227fc700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f852414c580 0x7f85241549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 -- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f852414c580 msgr2=0x7f85241549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f852414c580 0x7f85241549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 -- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85241530e0 msgr2=0x7f8524154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:31.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85241530e0 0x7f8524154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:31.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 -- 172.21.15.115:0/2319607494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009a20 con 0x7f85240a7750 2023-07-27T14:32:31.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f85227fc700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f852414c580 0x7f85241549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:31.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f8522ffd700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f8524064ef0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f851400b490 tx=0x7f8514009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:31.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f850affd700 1 -- 172.21.15.115:0/2319607494 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400be90 con 0x7f85240a7750 2023-07-27T14:32:31.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f850affd700 1 -- 172.21.15.115:0/2319607494 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514012410 con 0x7f85240a7750 2023-07-27T14:32:31.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.837+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85240aa210 con 0x7f85240a7750 2023-07-27T14:32:31.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.838+0000 7f850affd700 1 -- 172.21.15.115:0/2319607494 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140127d0 con 0x7f85240a7750 2023-07-27T14:32:31.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.838+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85240aa560 con 0x7f85240a7750 2023-07-27T14:32:31.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.839+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852406c470 con 0x7f85240a7750 2023-07-27T14:32:31.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.839+0000 7f850affd700 1 -- 172.21.15.115:0/2319607494 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7f851400f030 con 0x7f85240a7750 2023-07-27T14:32:31.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.841+0000 7f850affd700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f851005f370 0x7f8510061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:31.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.841+0000 7f850affd700 1 -- 172.21.15.115:0/2319607494 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8514079fe0 con 0x7f85240a7750 2023-07-27T14:32:31.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.841+0000 7f85227fc700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f851005f370 0x7f8510061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:31.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.841+0000 7f85227fc700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f851005f370 0x7f8510061830 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f8524069ae0 tx=0x7f8518009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:31.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:31.845+0000 7f850affd700 1 -- 172.21.15.115:0/2319607494 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f851404af10 con 0x7f85240a7750 2023-07-27T14:32:32.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.039+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8524068720 con 0x7f851005f370 2023-07-27T14:32:32.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.041+0000 7f850affd700 1 -- 172.21.15.115:0/2319607494 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8524068720 con 0x7f851005f370 2023-07-27T14:32:32.077 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:32:32.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:32:32.077 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:32:32.077 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:32.077 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:32:32.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f851005f370 msgr2=0x7f8510061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f851005f370 0x7f8510061830 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f8524069ae0 tx=0x7f8518009040).stop 2023-07-27T14:32:32.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 msgr2=0x7f8524064ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f8524064ef0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f851400b490 tx=0x7f8514009060).stop 2023-07-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 shutdown_connections 2023-07-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f851005f370 0x7f8510061830 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85241530e0 0x7f8524154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85240a7750 0x7f8524064ef0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 --2- 172.21.15.115:0/2319607494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f852414c580 0x7f85241549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 >> 172.21.15.115:0/2319607494 conn(0x7f85240c89a0 msgr2=0x7f85240c7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:32.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 shutdown_connections 2023-07-27T14:32:32.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.043+0000 7f85299ff700 1 -- 172.21.15.115:0/2319607494 wait complete. 2023-07-27T14:32:32.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:32:32.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.250+0000 7fd7219ff700 1 Processor -- start 2023-07-27T14:32:32.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.250+0000 7fd7219ff700 1 -- start start 2023-07-27T14:32:32.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd7219ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd71c063260 0x7fd71c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd7219ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c14b1e0 0x7fd71c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd7219ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c1553f0 con 0x7fd71c14ae00 2023-07-27T14:32:32.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd7219ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c157a50 con 0x7fd71c063260 2023-07-27T14:32:32.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd7219ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c157d10 con 0x7fd71c14b1e0 2023-07-27T14:32:32.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd71a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd71c063260 0x7fd71c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd71a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd71c063260 0x7fd71c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47470/0 (socket says 172.21.15.115:47470) 2023-07-27T14:32:32.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd71a7fc700 1 -- 172.21.15.115:0/180507553 learned_addr learned my addr 172.21.15.115:0/180507553 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:32.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd71b7fe700 1 --2- 172.21.15.115:0/180507553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c14b1e0 0x7fd71c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd71a7fc700 1 -- 172.21.15.115:0/180507553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c14b1e0 msgr2=0x7fd71c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:32.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd71a7fc700 1 --2- 172.21.15.115:0/180507553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c14b1e0 0x7fd71c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd71a7fc700 1 -- 172.21.15.115:0/180507553 >> v1:172.21.15.115:6789/0 conn(0x7fd71c14ae00 legacy=0x7fd71c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd71a7fc700 1 -- 172.21.15.115:0/180507553 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c157ff0 con 0x7fd71c063260 2023-07-27T14:32:32.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.252+0000 7fd719ffb700 1 -- 172.21.15.115:0/180507553 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729785435 0 0) 0x7fd71c1553f0 con 0x7fd71c14ae00 2023-07-27T14:32:32.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd71a7fc700 1 --2- 172.21.15.115:0/180507553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c063260 0x7fd71c154f00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fd710006fd0 tx=0x7fd7100090f0).ready entity=mon.0 client_cookie=703bd72190640f8d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:32.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd719ffb700 1 -- 172.21.15.115:0/180507553 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000b600 con 0x7fd71c063260 2023-07-27T14:32:32.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd719ffb700 1 -- 172.21.15.115:0/180507553 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000b760 con 0x7fd71c063260 2023-07-27T14:32:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd719ffb700 1 -- 172.21.15.115:0/180507553 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000bae0 con 0x7fd71c063260 2023-07-27T14:32:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd7219ff700 1 -- 172.21.15.115:0/180507553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c063260 msgr2=0x7fd71c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd7219ff700 1 --2- 172.21.15.115:0/180507553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c063260 0x7fd71c154f00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fd710006fd0 tx=0x7fd7100090f0).stop 2023-07-27T14:32:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd7219ff700 1 -- 172.21.15.115:0/180507553 shutdown_connections 2023-07-27T14:32:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd7219ff700 1 --2- 172.21.15.115:0/180507553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c14b1e0 0x7fd71c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd7219ff700 1 --2- 172.21.15.115:0/180507553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c063260 0x7fd71c154f00 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.253+0000 7fd7219ff700 1 -- 172.21.15.115:0/180507553 >> 172.21.15.115:0/180507553 conn(0x7fd71c05e940 msgr2=0x7fd71c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.254+0000 7fd7219ff700 1 -- 172.21.15.115:0/180507553 shutdown_connections 2023-07-27T14:32:32.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.254+0000 7fd7219ff700 1 -- 172.21.15.115:0/180507553 wait complete. 2023-07-27T14:32:32.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.255+0000 7fd7219ff700 1 Processor -- start 2023-07-27T14:32:32.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.255+0000 7fd7219ff700 1 -- start start 2023-07-27T14:32:32.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd7219ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c063260 0x7fd71c149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd7219ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c14ae00 0x7fd71c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd7219ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd71c14b1e0 0x7fd71c0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd7219ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0c93a0 con 0x7fd71c14ae00 2023-07-27T14:32:32.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd7219ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0b00d0 con 0x7fd71c14b1e0 2023-07-27T14:32:32.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd7219ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0b03b0 con 0x7fd71c063260 2023-07-27T14:32:32.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd71a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c14ae00 0x7fd71c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd71a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c14ae00 0x7fd71c0c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47476/0 (socket says 172.21.15.115:47476) 2023-07-27T14:32:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.256+0000 7fd71a7fc700 1 -- 172.21.15.115:0/1976399756 learned_addr learned my addr 172.21.15.115:0/1976399756 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd71a7fc700 1 -- 172.21.15.115:0/1976399756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c063260 msgr2=0x7fd71c149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd71a7fc700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c063260 0x7fd71c149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd71a7fc700 1 -- 172.21.15.115:0/1976399756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd71c14b1e0 msgr2=0x7fd71c0c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd71b7fe700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd71c14b1e0 0x7fd71c0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd71a7fc700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd71c14b1e0 0x7fd71c0c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd71a7fc700 1 -- 172.21.15.115:0/1976399756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710009370 con 0x7fd71c14ae00 2023-07-27T14:32:32.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd71b7fe700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd71c14b1e0 0x7fd71c0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd71a7fc700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c14ae00 0x7fd71c0c89c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fd710011000 tx=0x7fd710017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd702ffd700 1 -- 172.21.15.115:0/1976399756 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710006a40 con 0x7fd71c14ae00 2023-07-27T14:32:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd702ffd700 1 -- 172.21.15.115:0/1976399756 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000b8d0 con 0x7fd71c14ae00 2023-07-27T14:32:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c0b0690 con 0x7fd71c14ae00 2023-07-27T14:32:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd702ffd700 1 -- 172.21.15.115:0/1976399756 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71001b660 con 0x7fd71c14ae00 2023-07-27T14:32:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.257+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c164270 con 0x7fd71c14ae00 2023-07-27T14:32:32.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.258+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c06c470 con 0x7fd71c14ae00 2023-07-27T14:32:32.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.259+0000 7fd702ffd700 1 -- 172.21.15.115:0/1976399756 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fd71000f070 con 0x7fd71c14ae00 2023-07-27T14:32:32.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.260+0000 7fd702ffd700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd70805f370 0x7fd708061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.260+0000 7fd702ffd700 1 -- 172.21.15.115:0/1976399756 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd71007b9f0 con 0x7fd71c14ae00 2023-07-27T14:32:32.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.260+0000 7fd71affd700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd70805f370 0x7fd708061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.261+0000 7fd71affd700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd70805f370 0x7fd708061830 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fd70c001570 tx=0x7fd70c007830).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:32.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.264+0000 7fd702ffd700 1 -- 172.21.15.115:0/1976399756 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd71004c8a0 con 0x7fd71c14ae00 2023-07-27T14:32:32.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.433+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd71c06b610 con 0x7fd71c14ae00 2023-07-27T14:32:32.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.434+0000 7fd702ffd700 1 -- 172.21.15.115:0/1976399756 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd71001f070 con 0x7fd71c14ae00 2023-07-27T14:32:32.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd70805f370 msgr2=0x7fd708061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd70805f370 0x7fd708061830 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fd70c001570 tx=0x7fd70c007830).stop 2023-07-27T14:32:32.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c14ae00 msgr2=0x7fd71c0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c14ae00 0x7fd71c0c89c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fd710011000 tx=0x7fd710017000).stop 2023-07-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 shutdown_connections 2023-07-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd70805f370 0x7fd708061830 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd71c14b1e0 0x7fd71c0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd71c063260 0x7fd71c149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 --2- 172.21.15.115:0/1976399756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd71c14ae00 0x7fd71c0c89c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 >> 172.21.15.115:0/1976399756 conn(0x7fd71c05e940 msgr2=0x7fd71c14a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 shutdown_connections 2023-07-27T14:32:32.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.436+0000 7fd7219ff700 1 -- 172.21.15.115:0/1976399756 wait complete. 2023-07-27T14:32:32.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000105917 --mode=777 2023-07-27T14:32:32.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.646+0000 7fcc0b1ff700 1 Processor -- start 2023-07-27T14:32:32.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.646+0000 7fcc0b1ff700 1 -- start start 2023-07-27T14:32:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.647+0000 7fcc0b1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc0414ae00 0x7fcc04154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.647+0000 7fcc0b1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcc0414b1e0 0x7fcc04062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.647+0000 7fcc0b1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc041553f0 con 0x7fcc040c5c50 2023-07-27T14:32:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.647+0000 7fcc0b1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc04157a50 con 0x7fcc0414ae00 2023-07-27T14:32:32.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.647+0000 7fcc0b1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc04157d10 con 0x7fcc0414b1e0 2023-07-27T14:32:32.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc08f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc0414ae00 0x7fcc04154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc08f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc0414ae00 0x7fcc04154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47488/0 (socket says 172.21.15.115:47488) 2023-07-27T14:32:32.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc08f9b700 1 -- 172.21.15.115:0/1936776218 learned_addr learned my addr 172.21.15.115:0/1936776218 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:32.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc0979c700 1 --1- 172.21.15.115:0/1936776218 >> v1:172.21.15.115:6789/0 conn(0x7fcc040c5c50 0x7fcc040a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40740/0 (socket says 172.21.15.115:40740) 2023-07-27T14:32:32.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc03fff700 1 --2- 172.21.15.115:0/1936776218 >> v2:172.21.15.159:3300/0 conn(0x7fcc0414b1e0 0x7fcc04062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc08f9b700 1 -- 172.21.15.115:0/1936776218 >> v2:172.21.15.159:3300/0 conn(0x7fcc0414b1e0 msgr2=0x7fcc04062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:32.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc08f9b700 1 --2- 172.21.15.115:0/1936776218 >> v2:172.21.15.159:3300/0 conn(0x7fcc0414b1e0 0x7fcc04062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc08f9b700 1 -- 172.21.15.115:0/1936776218 >> v1:172.21.15.115:6789/0 conn(0x7fcc040c5c50 legacy=0x7fcc040a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc08f9b700 1 -- 172.21.15.115:0/1936776218 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc04157ff0 con 0x7fcc0414ae00 2023-07-27T14:32:32.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc03fff700 1 --2- 172.21.15.115:0/1936776218 >> v2:172.21.15.159:3300/0 conn(0x7fcc0414b1e0 0x7fcc04062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:32.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc08f9b700 1 --2- 172.21.15.115:0/1936776218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0414ae00 0x7fcc04154f00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fcc04155580 tx=0x7fcbf80090f0).ready entity=mon.0 client_cookie=5d19387cd133b13a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:32.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.648+0000 7fcc037fe700 1 -- 172.21.15.115:0/1936776218 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800b600 con 0x7fcc0414ae00 2023-07-27T14:32:32.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc037fe700 1 -- 172.21.15.115:0/1936776218 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf800b760 con 0x7fcc0414ae00 2023-07-27T14:32:32.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc037fe700 1 -- 172.21.15.115:0/1936776218 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800bae0 con 0x7fcc0414ae00 2023-07-27T14:32:32.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1936776218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0414ae00 msgr2=0x7fcc04154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1936776218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0414ae00 0x7fcc04154f00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fcc04155580 tx=0x7fcbf80090f0).stop 2023-07-27T14:32:32.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1936776218 shutdown_connections 2023-07-27T14:32:32.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1936776218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc0414ae00 0x7fcc04154f00 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1936776218 >> v2:172.21.15.159:3300/0 conn(0x7fcc0414b1e0 0x7fcc04062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1936776218 >> 172.21.15.115:0/1936776218 conn(0x7fcc0405e940 msgr2=0x7fcc040cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:32.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1936776218 shutdown_connections 2023-07-27T14:32:32.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.649+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1936776218 wait complete. 2023-07-27T14:32:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.651+0000 7fcc0b1ff700 1 Processor -- start 2023-07-27T14:32:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.651+0000 7fcc0b1ff700 1 -- start start 2023-07-27T14:32:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc0b1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc040c5c50 0x7fcc04163e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc0b1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc0414ae00 0x7fcc04166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc0b1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc0414b1e0 0x7fcc040afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc0b1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040c2000 con 0x7fcc040c5c50 2023-07-27T14:32:32.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc0b1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040c22a0 con 0x7fcc0414ae00 2023-07-27T14:32:32.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc0b1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040c2580 con 0x7fcc0414b1e0 2023-07-27T14:32:32.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc08f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc040c5c50 0x7fcc04163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc08f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc040c5c50 0x7fcc04163e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47500/0 (socket says 172.21.15.115:47500) 2023-07-27T14:32:32.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc08f9b700 1 -- 172.21.15.115:0/1954015495 learned_addr learned my addr 172.21.15.115:0/1954015495 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:32.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc03fff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc0414ae00 0x7fcc04166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc0979c700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc0414b1e0 0x7fcc040afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc08f9b700 1 -- 172.21.15.115:0/1954015495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc0414b1e0 msgr2=0x7fcc040afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc08f9b700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc0414b1e0 0x7fcc040afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc08f9b700 1 -- 172.21.15.115:0/1954015495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc0414ae00 msgr2=0x7fcc04166ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc08f9b700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc0414ae00 0x7fcc04166ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.653+0000 7fcc08f9b700 1 -- 172.21.15.115:0/1954015495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009370 con 0x7fcc040c5c50 2023-07-27T14:32:32.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.654+0000 7fcc08f9b700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc040c5c50 0x7fcc04163e60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fcc041579b0 tx=0x7fcbf8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:32.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.654+0000 7fcc00ff9700 1 -- 172.21.15.115:0/1954015495 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800b8d0 con 0x7fcc040c5c50 2023-07-27T14:32:32.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.654+0000 7fcc00ff9700 1 -- 172.21.15.115:0/1954015495 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf800ba30 con 0x7fcc040c5c50 2023-07-27T14:32:32.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.654+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc040c2860 con 0x7fcc040c5c50 2023-07-27T14:32:32.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.654+0000 7fcc00ff9700 1 -- 172.21.15.115:0/1954015495 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80246c0 con 0x7fcc040c5c50 2023-07-27T14:32:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.654+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc040caf10 con 0x7fcc040c5c50 2023-07-27T14:32:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.655+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc040c4330 con 0x7fcc040c5c50 2023-07-27T14:32:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.656+0000 7fcc00ff9700 1 -- 172.21.15.115:0/1954015495 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fcbf800f070 con 0x7fcc040c5c50 2023-07-27T14:32:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.657+0000 7fcc00ff9700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbe805f370 0x7fcbe8061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.657+0000 7fcc00ff9700 1 -- 172.21.15.115:0/1954015495 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcbf807c3d0 con 0x7fcc040c5c50 2023-07-27T14:32:32.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.657+0000 7fcc03fff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbe805f370 0x7fcbe8061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:32.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.657+0000 7fcc03fff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbe805f370 0x7fcbe8061830 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fcc040c1e50 tx=0x7fcbf0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:32.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.661+0000 7fcc00ff9700 1 -- 172.21.15.115:0/1954015495 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbf804d280 con 0x7fcc040c5c50 2023-07-27T14:32:32.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.863+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000105917", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc040cb100 con 0x7fcbe805f370 2023-07-27T14:32:32.904 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:32.869+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:32.905 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:32.869+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:32.905 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:32.869+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:32.905 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:32.869+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:32.905 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:32.869+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:32.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.902+0000 7fcc00ff9700 1 -- 172.21.15.115:0/1954015495 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcc040cb100 con 0x7fcbe805f370 2023-07-27T14:32:32.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbe805f370 msgr2=0x7fcbe8061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbe805f370 0x7fcbe8061830 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fcc040c1e50 tx=0x7fcbf0008040).stop 2023-07-27T14:32:32.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc040c5c50 msgr2=0x7fcc04163e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc040c5c50 0x7fcc04163e60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fcc041579b0 tx=0x7fcbf8017000).stop 2023-07-27T14:32:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 shutdown_connections 2023-07-27T14:32:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbe805f370 0x7fcbe8061830 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc0414b1e0 0x7fcc040afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc040c5c50 0x7fcc04163e60 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 --2- 172.21.15.115:0/1954015495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc0414ae00 0x7fcc04166ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:32.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 >> 172.21.15.115:0/1954015495 conn(0x7fcc0405e940 msgr2=0x7fcc04152160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:32.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 shutdown_connections 2023-07-27T14:32:32.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:32.904+0000 7fcc0b1ff700 1 -- 172.21.15.115:0/1954015495 wait complete. 2023-07-27T14:32:32.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000105917 2023-07-27T14:32:33.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.112+0000 7fb308fff700 1 Processor -- start 2023-07-27T14:32:33.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.112+0000 7fb308fff700 1 -- start start 2023-07-27T14:32:33.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb308fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb30414ae00 0x7fb304154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb308fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb30414b1e0 0x7fb304062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb308fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3041553f0 con 0x7fb3040c5c50 2023-07-27T14:32:33.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb308fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb304157a50 con 0x7fb30414ae00 2023-07-27T14:32:33.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb308fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb304157d10 con 0x7fb30414b1e0 2023-07-27T14:32:33.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb30259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb30414ae00 0x7fb304154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb302d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb3040c5c50 0x7fb3040a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40746/0 (socket says 172.21.15.115:40746) 2023-07-27T14:32:33.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb302d9d700 1 -- 172.21.15.115:0/1748290764 learned_addr learned my addr 172.21.15.115:0/1748290764 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:33.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb301d9b700 1 --2- 172.21.15.115:0/1748290764 >> v2:172.21.15.159:3300/0 conn(0x7fb30414b1e0 0x7fb304062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb30259c700 1 -- 172.21.15.115:0/1748290764 >> v2:172.21.15.159:3300/0 conn(0x7fb30414b1e0 msgr2=0x7fb304062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:33.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb30259c700 1 --2- 172.21.15.115:0/1748290764 >> v2:172.21.15.159:3300/0 conn(0x7fb30414b1e0 0x7fb304062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb30259c700 1 -- 172.21.15.115:0/1748290764 >> v1:172.21.15.115:6789/0 conn(0x7fb3040c5c50 legacy=0x7fb3040a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.114+0000 7fb30259c700 1 -- 172.21.15.115:0/1748290764 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304157ff0 con 0x7fb30414ae00 2023-07-27T14:32:33.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb30259c700 1 --2- 172.21.15.115:0/1748290764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30414ae00 0x7fb304154f00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fb304155580 tx=0x7fb2f4009060).ready entity=mon.0 client_cookie=a4521bd403fc3d06 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:33.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb30159a700 1 -- 172.21.15.115:0/1748290764 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400f510 con 0x7fb30414ae00 2023-07-27T14:32:33.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb30159a700 1 -- 172.21.15.115:0/1748290764 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f400f670 con 0x7fb30414ae00 2023-07-27T14:32:33.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb30159a700 1 -- 172.21.15.115:0/1748290764 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400f9f0 con 0x7fb30414ae00 2023-07-27T14:32:33.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb308fff700 1 -- 172.21.15.115:0/1748290764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30414ae00 msgr2=0x7fb304154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb308fff700 1 --2- 172.21.15.115:0/1748290764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30414ae00 0x7fb304154f00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fb304155580 tx=0x7fb2f4009060).stop 2023-07-27T14:32:33.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb308fff700 1 -- 172.21.15.115:0/1748290764 shutdown_connections 2023-07-27T14:32:33.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb308fff700 1 --2- 172.21.15.115:0/1748290764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30414ae00 0x7fb304154f00 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb308fff700 1 --2- 172.21.15.115:0/1748290764 >> v2:172.21.15.159:3300/0 conn(0x7fb30414b1e0 0x7fb304062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb308fff700 1 -- 172.21.15.115:0/1748290764 >> 172.21.15.115:0/1748290764 conn(0x7fb30405e940 msgr2=0x7fb3040cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:33.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.115+0000 7fb308fff700 1 -- 172.21.15.115:0/1748290764 shutdown_connections 2023-07-27T14:32:33.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.116+0000 7fb308fff700 1 -- 172.21.15.115:0/1748290764 wait complete. 2023-07-27T14:32:33.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.117+0000 7fb308fff700 1 Processor -- start 2023-07-27T14:32:33.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.117+0000 7fb308fff700 1 -- start start 2023-07-27T14:32:33.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb308fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3040c5c50 0x7fb3040ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb308fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb30414ae00 0x7fb3040c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb308fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb30414b1e0 0x7fb3040c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb308fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040ae8f0 con 0x7fb3040c5c50 2023-07-27T14:32:33.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb308fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040adce0 con 0x7fb30414ae00 2023-07-27T14:32:33.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb308fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040adfc0 con 0x7fb30414b1e0 2023-07-27T14:32:33.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb30259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3040c5c50 0x7fb3040ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb30259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3040c5c50 0x7fb3040ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47534/0 (socket says 172.21.15.115:47534) 2023-07-27T14:32:33.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb30259c700 1 -- 172.21.15.115:0/954226391 learned_addr learned my addr 172.21.15.115:0/954226391 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:33.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.118+0000 7fb301d9b700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb30414ae00 0x7fb3040c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb302d9d700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb30414b1e0 0x7fb3040c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb30259c700 1 -- 172.21.15.115:0/954226391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb30414b1e0 msgr2=0x7fb3040c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb30259c700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb30414b1e0 0x7fb3040c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb30259c700 1 -- 172.21.15.115:0/954226391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb30414ae00 msgr2=0x7fb3040c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb30259c700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb30414ae00 0x7fb3040c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb30259c700 1 -- 172.21.15.115:0/954226391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f40092a0 con 0x7fb3040c5c50 2023-07-27T14:32:33.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb30259c700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3040c5c50 0x7fb3040ab890 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fb3040cbc00 tx=0x7fb2f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:33.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb2f27fc700 1 -- 172.21.15.115:0/954226391 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4011760 con 0x7fb3040c5c50 2023-07-27T14:32:33.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb2f27fc700 1 -- 172.21.15.115:0/954226391 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f40118e0 con 0x7fb3040c5c50 2023-07-27T14:32:33.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3040ae2a0 con 0x7fb3040c5c50 2023-07-27T14:32:33.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb2f27fc700 1 -- 172.21.15.115:0/954226391 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4011ca0 con 0x7fb3040c5c50 2023-07-27T14:32:33.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.119+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3040abd80 con 0x7fb3040c5c50 2023-07-27T14:32:33.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.120+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3040aebd0 con 0x7fb3040c5c50 2023-07-27T14:32:33.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.121+0000 7fb2f27fc700 1 -- 172.21.15.115:0/954226391 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fb2f400f070 con 0x7fb3040c5c50 2023-07-27T14:32:33.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.122+0000 7fb2f27fc700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2e405f370 0x7fb2e4061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.122+0000 7fb2f27fc700 1 -- 172.21.15.115:0/954226391 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb2f407ba30 con 0x7fb3040c5c50 2023-07-27T14:32:33.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.122+0000 7fb301d9b700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2e405f370 0x7fb2e4061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.123+0000 7fb301d9b700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2e405f370 0x7fb2e4061830 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fb2f8006fd0 tx=0x7fb2f8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:33.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.126+0000 7fb2f27fc700 1 -- 172.21.15.115:0/954226391 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2f404c8e0 con 0x7fb3040c5c50 2023-07-27T14:32:33.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.327+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000105917", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3040aea30 con 0x7fb2e405f370 2023-07-27T14:32:33.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.332+0000 7fb2f27fc700 1 -- 172.21.15.115:0/954226391 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fb2f800f630 con 0x7fb2e405f370 2023-07-27T14:32:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000105917/cb9eef6f-ffa4-4ff3-8d9a-60a959e060f2 2023-07-27T14:32:33.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2e405f370 msgr2=0x7fb2e4061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2e405f370 0x7fb2e4061830 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fb2f8006fd0 tx=0x7fb2f8008040).stop 2023-07-27T14:32:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3040c5c50 msgr2=0x7fb3040ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3040c5c50 0x7fb3040ab890 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fb3040cbc00 tx=0x7fb2f4017000).stop 2023-07-27T14:32:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 shutdown_connections 2023-07-27T14:32:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb2e405f370 0x7fb2e4061830 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb30414b1e0 0x7fb3040c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3040c5c50 0x7fb3040ab890 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 --2- 172.21.15.115:0/954226391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb30414ae00 0x7fb3040c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 >> 172.21.15.115:0/954226391 conn(0x7fb30405e940 msgr2=0x7fb3040c03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:33.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 shutdown_connections 2023-07-27T14:32:33.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.334+0000 7fb308fff700 1 -- 172.21.15.115:0/954226391 wait complete. 2023-07-27T14:32:33.387 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000105917 with 1 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000105917/cb9eef6f-ffa4-4ff3-8d9a-60a959e060f2 2023-07-27T14:32:33.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:32:33.388 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000105917/cb9eef6f-ffa4-4ff3-8d9a-60a959e060f2/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:32:33.459 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:32:33.459 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:32:33.460 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170162 s, 61.6 MB/s 2023-07-27T14:32:33.460 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000105917 snapshot_0000000000897738 2023-07-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.618+0000 7fcb1c3ff700 1 Processor -- start 2023-07-27T14:32:33.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.618+0000 7fcb1c3ff700 1 -- start start 2023-07-27T14:32:33.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.619+0000 7fcb1c3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb1414ae00 0x7fcb14154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.619+0000 7fcb1c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb1414b1e0 0x7fcb14062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.619+0000 7fcb1c3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcb140c5c50 0x7fcb14063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.619+0000 7fcb1c3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb14063530 con 0x7fcb1414ae00 2023-07-27T14:32:33.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.619+0000 7fcb1c3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb141553f0 con 0x7fcb140c5c50 2023-07-27T14:32:33.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.619+0000 7fcb1c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14157a50 con 0x7fcb1414b1e0 2023-07-27T14:32:33.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.619+0000 7fcb1a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb1414ae00 0x7fcb14154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcb1414ae00 0x7fcb14154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54248/0 (socket says 172.21.15.115:54248) 2023-07-27T14:32:33.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a19b700 1 -- 172.21.15.115:0/1355836238 learned_addr learned my addr 172.21.15.115:0/1355836238 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:33.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a99c700 1 --2- 172.21.15.115:0/1355836238 >> v2:172.21.15.159:3300/0 conn(0x7fcb140c5c50 0x7fcb14063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1999a700 1 --2- 172.21.15.115:0/1355836238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb1414b1e0 0x7fcb14062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a19b700 1 -- 172.21.15.115:0/1355836238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb1414b1e0 msgr2=0x7fcb14062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:33.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a19b700 1 --2- 172.21.15.115:0/1355836238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb1414b1e0 0x7fcb14062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a19b700 1 -- 172.21.15.115:0/1355836238 >> v2:172.21.15.159:3300/0 conn(0x7fcb140c5c50 msgr2=0x7fcb14063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:33.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a19b700 1 --2- 172.21.15.115:0/1355836238 >> v2:172.21.15.159:3300/0 conn(0x7fcb140c5c50 0x7fcb14063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a19b700 1 -- 172.21.15.115:0/1355836238 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14157d10 con 0x7fcb1414ae00 2023-07-27T14:32:33.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1999a700 1 --2- 172.21.15.115:0/1355836238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb1414b1e0 0x7fcb14062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:33.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb1a19b700 1 --2- 172.21.15.115:0/1355836238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb14154f00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fcb14084190 tx=0x7fcb100090f0).ready entity=mon.0 client_cookie=5ded544398ba8e9a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:33.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb19199700 1 -- 172.21.15.115:0/1355836238 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000b520 con 0x7fcb1414ae00 2023-07-27T14:32:33.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb19199700 1 -- 172.21.15.115:0/1355836238 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1000b680 con 0x7fcb1414ae00 2023-07-27T14:32:33.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.620+0000 7fcb19199700 1 -- 172.21.15.115:0/1355836238 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000ba00 con 0x7fcb1414ae00 2023-07-27T14:32:33.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/1355836238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 msgr2=0x7fcb14154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/1355836238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb14154f00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fcb14084190 tx=0x7fcb100090f0).stop 2023-07-27T14:32:33.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/1355836238 shutdown_connections 2023-07-27T14:32:33.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/1355836238 >> v2:172.21.15.159:3300/0 conn(0x7fcb140c5c50 0x7fcb14063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/1355836238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb14154f00 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/1355836238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb1414b1e0 0x7fcb14062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/1355836238 >> 172.21.15.115:0/1355836238 conn(0x7fcb1405e940 msgr2=0x7fcb140cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:33.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/1355836238 shutdown_connections 2023-07-27T14:32:33.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.621+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/1355836238 wait complete. 2023-07-27T14:32:33.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.623+0000 7fcb1c3ff700 1 Processor -- start 2023-07-27T14:32:33.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.623+0000 7fcb1c3ff700 1 -- start start 2023-07-27T14:32:33.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb140c5c50 0x7fcb141496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1c3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb140adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1c3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb1414b1e0 0x7fcb140ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1c3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140c1c50 con 0x7fcb1414ae00 2023-07-27T14:32:33.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1c3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140c2210 con 0x7fcb1414b1e0 2023-07-27T14:32:33.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140afd40 con 0x7fcb140c5c50 2023-07-27T14:32:33.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb140adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb140adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54252/0 (socket says 172.21.15.115:54252) 2023-07-27T14:32:33.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1999a700 1 -- 172.21.15.115:0/2032552709 learned_addr learned my addr 172.21.15.115:0/2032552709 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:33.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1999a700 1 -- 172.21.15.115:0/2032552709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb140c5c50 msgr2=0x7fcb141496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1999a700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb140c5c50 0x7fcb141496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:33.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1999a700 1 -- 172.21.15.115:0/2032552709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb1414b1e0 msgr2=0x7fcb140ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1999a700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb1414b1e0 0x7fcb140ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:33.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.624+0000 7fcb1999a700 1 -- 172.21.15.115:0/2032552709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009370 con 0x7fcb1414ae00 2023-07-27T14:32:33.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.625+0000 7fcb1999a700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb140adb60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fcb0400d890 tx=0x7fcb04008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:33.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.626+0000 7fcb0a7fc700 1 -- 172.21.15.115:0/2032552709 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040125f0 con 0x7fcb1414ae00 2023-07-27T14:32:33.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.626+0000 7fcb0a7fc700 1 -- 172.21.15.115:0/2032552709 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb04012750 con 0x7fcb1414ae00 2023-07-27T14:32:33.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.626+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb140b0020 con 0x7fcb1414ae00 2023-07-27T14:32:33.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.626+0000 7fcb0a7fc700 1 -- 172.21.15.115:0/2032552709 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04012ad0 con 0x7fcb1414ae00 2023-07-27T14:32:33.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.626+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb140c1ea0 con 0x7fcb1414ae00 2023-07-27T14:32:33.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.627+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb140b04c0 con 0x7fcb1414ae00 2023-07-27T14:32:33.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.628+0000 7fcb0a7fc700 1 -- 172.21.15.115:0/2032552709 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 76082+0+0 (secure 0 0 0) 0x7fcb04013480 con 0x7fcb1414ae00 2023-07-27T14:32:33.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.629+0000 7fcb0a7fc700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcaf805f370 0x7fcaf8061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:33.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.629+0000 7fcb0a7fc700 1 -- 172.21.15.115:0/2032552709 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcb0407a200 con 0x7fcb1414ae00 2023-07-27T14:32:33.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.629+0000 7fcb1a19b700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcaf805f370 0x7fcaf8061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:33.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.630+0000 7fcb1a19b700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcaf805f370 0x7fcaf8061830 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fcb1000b2e0 tx=0x7fcb10017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:33.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.633+0000 7fcb0a7fc700 1 -- 172.21.15.115:0/2032552709 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb140b04c0 con 0x7fcb1414ae00 2023-07-27T14:32:33.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.638+0000 7fcb0a7fc700 1 -- 172.21.15.115:0/2032552709 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 17) v1 ==== 76122+0+0 (secure 0 0 0) 0x7fcb04077c40 con 0x7fcb1414ae00 2023-07-27T14:32:33.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.838+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000105917", "snap_name": "snapshot_0000000000897738", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb140b04c0 con 0x7fcaf805f370 2023-07-27T14:32:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.853+0000 7fcb0a7fc700 1 -- 172.21.15.115:0/2032552709 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcb140b04c0 con 0x7fcaf805f370 2023-07-27T14:32:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.855+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcaf805f370 msgr2=0x7fcaf8061830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.855+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcaf805f370 0x7fcaf8061830 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fcb1000b2e0 tx=0x7fcb10017000).stop 2023-07-27T14:32:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.855+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 msgr2=0x7fcb140adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:33.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.855+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb140adb60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fcb0400d890 tx=0x7fcb04008040).stop 2023-07-27T14:32:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.856+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 shutdown_connections 2023-07-27T14:32:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.856+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcaf805f370 0x7fcaf8061830 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.856+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb1414b1e0 0x7fcb140ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.856+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb140c5c50 0x7fcb141496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.856+0000 7fcb1c3ff700 1 --2- 172.21.15.115:0/2032552709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb1414ae00 0x7fcb140adb60 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.856+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 >> 172.21.15.115:0/2032552709 conn(0x7fcb1405e940 msgr2=0x7fcb1414a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.856+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 shutdown_connections 2023-07-27T14:32:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:33.856+0000 7fcb1c3ff700 1 -- 172.21.15.115:0/2032552709 wait complete. 2023-07-27T14:32:33.909 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000105917 snapshot_0000000000897738 clone_0000000000272363 2023-07-27T14:32:34.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.066+0000 7f9cdbdff700 1 Processor -- start 2023-07-27T14:32:34.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.066+0000 7f9cdbdff700 1 -- start start 2023-07-27T14:32:34.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.067+0000 7f9cdbdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd40c6b70 0x7f9cd40656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.067+0000 7f9cdbdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9cd4065bc0 0x7f9cd4062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.067+0000 7f9cdbdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd4066050 con 0x7f9cd4153e00 2023-07-27T14:32:34.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.067+0000 7f9cdbdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd4062320 con 0x7f9cd4065bc0 2023-07-27T14:32:34.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.067+0000 7f9cdbdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4064a80 con 0x7f9cd40c6b70 2023-07-27T14:32:34.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.067+0000 7f9cd9b9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9cd4153e00 0x7f9cd4064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39356/0 (socket says 172.21.15.115:39356) 2023-07-27T14:32:34.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.067+0000 7f9cda39c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9cd4065bc0 0x7f9cd4062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.067+0000 7f9cd9b9b700 1 -- 172.21.15.115:0/22640859 learned_addr learned my addr 172.21.15.115:0/22640859 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:34.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cda39c700 1 -- 172.21.15.115:0/22640859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd40c6b70 msgr2=0x7f9cd40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:34.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cd939a700 1 --2- 172.21.15.115:0/22640859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd40c6b70 0x7f9cd40656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cda39c700 1 --2- 172.21.15.115:0/22640859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd40c6b70 0x7f9cd40656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cd8b99700 1 -- 172.21.15.115:0/22640859 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969251773 0 0) 0x7f9cd4066050 con 0x7f9cd4153e00 2023-07-27T14:32:34.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cda39c700 1 -- 172.21.15.115:0/22640859 >> v1:172.21.15.115:6789/0 conn(0x7f9cd4153e00 legacy=0x7f9cd4064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cda39c700 1 -- 172.21.15.115:0/22640859 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd4064d60 con 0x7f9cd4065bc0 2023-07-27T14:32:34.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cd939a700 1 --2- 172.21.15.115:0/22640859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd40c6b70 0x7f9cd40656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:34.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cda39c700 1 --2- 172.21.15.115:0/22640859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd4065bc0 0x7f9cd4062770 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f9ccc009e60 tx=0x7f9ccc009780).ready entity=mon.0 client_cookie=37b6d4ee29d054e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:34.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cd8b99700 1 -- 172.21.15.115:0/22640859 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00e070 con 0x7f9cd4065bc0 2023-07-27T14:32:34.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cd8b99700 1 -- 172.21.15.115:0/22640859 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc00bc30 con 0x7f9cd4065bc0 2023-07-27T14:32:34.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.068+0000 7f9cd8b99700 1 -- 172.21.15.115:0/22640859 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc012410 con 0x7f9cd4065bc0 2023-07-27T14:32:34.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.069+0000 7f9cdbdff700 1 -- 172.21.15.115:0/22640859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd4065bc0 msgr2=0x7f9cd4062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.069+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/22640859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd4065bc0 0x7f9cd4062770 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f9ccc009e60 tx=0x7f9ccc009780).stop 2023-07-27T14:32:34.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.069+0000 7f9cdbdff700 1 -- 172.21.15.115:0/22640859 shutdown_connections 2023-07-27T14:32:34.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.069+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/22640859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd4065bc0 0x7f9cd4062770 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.069+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/22640859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd40c6b70 0x7f9cd40656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.069+0000 7f9cdbdff700 1 -- 172.21.15.115:0/22640859 >> 172.21.15.115:0/22640859 conn(0x7f9cd40c7b90 msgr2=0x7f9cd40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:34.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.069+0000 7f9cdbdff700 1 -- 172.21.15.115:0/22640859 shutdown_connections 2023-07-27T14:32:34.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.069+0000 7f9cdbdff700 1 -- 172.21.15.115:0/22640859 wait complete. 2023-07-27T14:32:34.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.070+0000 7f9cdbdff700 1 Processor -- start 2023-07-27T14:32:34.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.071+0000 7f9cdbdff700 1 -- start start 2023-07-27T14:32:34.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.071+0000 7f9cdbdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd4065bc0 0x7f9cd414a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.071+0000 7f9cdbdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd40c6b70 0x7f9cd4152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.071+0000 7f9cdbdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd4153e00 0x7f9cd4152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.071+0000 7f9cdbdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4153460 con 0x7f9cd40c6b70 2023-07-27T14:32:34.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.071+0000 7f9cdbdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd414a730 con 0x7f9cd4065bc0 2023-07-27T14:32:34.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.071+0000 7f9cdbdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4093be0 con 0x7f9cd4153e00 2023-07-27T14:32:34.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd40c6b70 0x7f9cd4152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd40c6b70 0x7f9cd4152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54270/0 (socket says 172.21.15.115:54270) 2023-07-27T14:32:34.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 -- 172.21.15.115:0/2106666014 learned_addr learned my addr 172.21.15.115:0/2106666014 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:34.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd9b9b700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd4065bc0 0x7f9cd414a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cda39c700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd4153e00 0x7f9cd4152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 -- 172.21.15.115:0/2106666014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd4153e00 msgr2=0x7f9cd4152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd4153e00 0x7f9cd4152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 -- 172.21.15.115:0/2106666014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd4065bc0 msgr2=0x7f9cd414a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd4065bc0 0x7f9cd414a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 -- 172.21.15.115:0/2106666014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc009a20 con 0x7f9cd40c6b70 2023-07-27T14:32:34.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.072+0000 7f9cd939a700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd40c6b70 0x7f9cd4152a80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f9cc400c880 tx=0x7f9cc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:34.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.073+0000 7f9cc9ffb700 1 -- 172.21.15.115:0/2106666014 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4010580 con 0x7f9cd40c6b70 2023-07-27T14:32:34.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.073+0000 7f9cc9ffb700 1 -- 172.21.15.115:0/2106666014 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc40106e0 con 0x7f9cd40c6b70 2023-07-27T14:32:34.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.073+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd4093ec0 con 0x7f9cd40c6b70 2023-07-27T14:32:34.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.073+0000 7f9cc9ffb700 1 -- 172.21.15.115:0/2106666014 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4010a60 con 0x7f9cd40c6b70 2023-07-27T14:32:34.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.073+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd4094480 con 0x7f9cd40c6b70 2023-07-27T14:32:34.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.074+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd406c470 con 0x7f9cd40c6b70 2023-07-27T14:32:34.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.074+0000 7f9cc9ffb700 1 -- 172.21.15.115:0/2106666014 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 76122+0+0 (secure 0 0 0) 0x7f9cc401b460 con 0x7f9cd40c6b70 2023-07-27T14:32:34.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.075+0000 7f9cc9ffb700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9cb805f3c0 0x7f9cb8061880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.075+0000 7f9cc9ffb700 1 -- 172.21.15.115:0/2106666014 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9cc407a290 con 0x7f9cd40c6b70 2023-07-27T14:32:34.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.075+0000 7f9cd9b9b700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9cb805f3c0 0x7f9cb8061880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.076+0000 7f9cd9b9b700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9cb805f3c0 0x7f9cb8061880 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f9cd0007fd0 tx=0x7f9cd0007dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:34.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.079+0000 7f9cc9ffb700 1 -- 172.21.15.115:0/2106666014 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9cc404b3f0 con 0x7f9cd40c6b70 2023-07-27T14:32:34.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.285+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000105917", "snap_name": "snapshot_0000000000897738", "target_sub_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cd40605f0 con 0x7f9cb805f3c0 2023-07-27T14:32:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.343+0000 7f9cc9ffb700 1 -- 172.21.15.115:0/2106666014 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9cd40605f0 con 0x7f9cb805f3c0 2023-07-27T14:32:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.345+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9cb805f3c0 msgr2=0x7f9cb8061880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.345+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9cb805f3c0 0x7f9cb8061880 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f9cd0007fd0 tx=0x7f9cd0007dd0).stop 2023-07-27T14:32:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd40c6b70 msgr2=0x7f9cd4152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd40c6b70 0x7f9cd4152a80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f9cc400c880 tx=0x7f9cc4008040).stop 2023-07-27T14:32:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 shutdown_connections 2023-07-27T14:32:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9cb805f3c0 0x7f9cb8061880 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9cd4153e00 0x7f9cd4152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9cd4065bc0 0x7f9cd414a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 --2- 172.21.15.115:0/2106666014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9cd40c6b70 0x7f9cd4152a80 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 >> 172.21.15.115:0/2106666014 conn(0x7f9cd40c7b90 msgr2=0x7f9cd40c6020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 shutdown_connections 2023-07-27T14:32:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.346+0000 7f9cdbdff700 1 -- 172.21.15.115:0/2106666014 wait complete. 2023-07-27T14:32:34.387 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.350+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.387 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.350+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.387 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.350+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.387 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.351+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.387 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.351+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000272363 2023-07-27T14:32:34.407 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.370+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.407 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.370+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.407 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.370+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.407 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.370+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.407 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:34.370+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.560+0000 7f42cebff700 1 Processor -- start 2023-07-27T14:32:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.560+0000 7f42cebff700 1 -- start start 2023-07-27T14:32:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cebff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42c80c38f0 0x7f42c814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cebff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c81530d0 con 0x7f42c814f740 2023-07-27T14:32:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cebff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c81527a0 con 0x7f42c80a5f60 2023-07-27T14:32:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cebff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c8069f70 con 0x7f42c80c38f0 2023-07-27T14:32:34.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cd19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42c80c38f0 0x7f42c814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cd19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f42c80c38f0 0x7f42c814fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54322/0 (socket says 172.21.15.115:54322) 2023-07-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cd19c700 1 -- 172.21.15.115:0/1995350493 learned_addr learned my addr 172.21.15.115:0/1995350493 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cd19c700 1 -- 172.21.15.115:0/1995350493 >> v1:172.21.15.159:6789/0 conn(0x7f42c80a5f60 legacy=0x7f42c80c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cd19c700 1 -- 172.21.15.115:0/1995350493 >> v1:172.21.15.115:6789/0 conn(0x7f42c814f740 legacy=0x7f42c80a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42cd19c700 1 -- 172.21.15.115:0/1995350493 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8152a80 con 0x7f42c80c38f0 2023-07-27T14:32:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.562+0000 7f42c77fe700 1 -- 172.21.15.115:0/1995350493 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996544695 0 0) 0x7f42c81530d0 con 0x7f42c814f740 2023-07-27T14:32:34.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42cd19c700 1 --2- 172.21.15.115:0/1995350493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80c38f0 0x7f42c814fb20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f42c0009f20 tx=0x7f42c0009840).ready entity=mon.0 client_cookie=b271f95e6790350c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:34.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42c77fe700 1 -- 172.21.15.115:0/1995350493 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000e070 con 0x7f42c80c38f0 2023-07-27T14:32:34.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42c77fe700 1 -- 172.21.15.115:0/1995350493 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000ba40 con 0x7f42c80c38f0 2023-07-27T14:32:34.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42c77fe700 1 -- 172.21.15.115:0/1995350493 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000bdc0 con 0x7f42c80c38f0 2023-07-27T14:32:34.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42cebff700 1 -- 172.21.15.115:0/1995350493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80c38f0 msgr2=0x7f42c814fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42cebff700 1 --2- 172.21.15.115:0/1995350493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80c38f0 0x7f42c814fb20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f42c0009f20 tx=0x7f42c0009840).stop 2023-07-27T14:32:34.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42cebff700 1 -- 172.21.15.115:0/1995350493 shutdown_connections 2023-07-27T14:32:34.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42cebff700 1 --2- 172.21.15.115:0/1995350493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80c38f0 0x7f42c814fb20 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.563+0000 7f42cebff700 1 -- 172.21.15.115:0/1995350493 >> 172.21.15.115:0/1995350493 conn(0x7f42c8062320 msgr2=0x7f42c8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:34.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.564+0000 7f42cebff700 1 -- 172.21.15.115:0/1995350493 shutdown_connections 2023-07-27T14:32:34.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.564+0000 7f42cebff700 1 -- 172.21.15.115:0/1995350493 wait complete. 2023-07-27T14:32:34.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.565+0000 7f42cebff700 1 Processor -- start 2023-07-27T14:32:34.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.565+0000 7f42cebff700 1 -- start start 2023-07-27T14:32:34.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80a5f60 0x7f42c80aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42c80c38f0 0x7f42c80c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cebff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c814f740 0x7f42c814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80aabe0 con 0x7f42c80a5f60 2023-07-27T14:32:34.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cebff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80abe70 con 0x7f42c814f740 2023-07-27T14:32:34.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80aadd0 con 0x7f42c80c38f0 2023-07-27T14:32:34.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cc99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80a5f60 0x7f42c80aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cc99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80a5f60 0x7f42c80aa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54324/0 (socket says 172.21.15.115:54324) 2023-07-27T14:32:34.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.566+0000 7f42cc99b700 1 -- 172.21.15.115:0/3482469993 learned_addr learned my addr 172.21.15.115:0/3482469993 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:34.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cd19c700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c814f740 0x7f42c814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42c7fff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42c80c38f0 0x7f42c80c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cc99b700 1 -- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42c80c38f0 msgr2=0x7f42c80c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cc99b700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42c80c38f0 0x7f42c80c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cc99b700 1 -- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c814f740 msgr2=0x7f42c814d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cc99b700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c814f740 0x7f42c814d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cc99b700 1 -- 172.21.15.115:0/3482469993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c0009ae0 con 0x7f42c80a5f60 2023-07-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42c7fff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42c80c38f0 0x7f42c80c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cc99b700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80a5f60 0x7f42c80aa6f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f42bc00c410 tx=0x7f42bc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42c4ff9700 1 -- 172.21.15.115:0/3482469993 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc007020 con 0x7f42c80a5f60 2023-07-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42c4ff9700 1 -- 172.21.15.115:0/3482469993 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0071a0 con 0x7f42c80a5f60 2023-07-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c80ab0b0 con 0x7f42c80a5f60 2023-07-27T14:32:34.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42c4ff9700 1 -- 172.21.15.115:0/3482469993 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc007560 con 0x7f42c80a5f60 2023-07-27T14:32:34.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.567+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c80ab670 con 0x7f42c80a5f60 2023-07-27T14:32:34.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.568+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c806c470 con 0x7f42c80a5f60 2023-07-27T14:32:34.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.569+0000 7f42c4ff9700 1 -- 172.21.15.115:0/3482469993 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 76122+0+0 (secure 0 0 0) 0x7f42bc010070 con 0x7f42c80a5f60 2023-07-27T14:32:34.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.570+0000 7f42c4ff9700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42ac05f3c0 0x7f42ac061880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:34.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.570+0000 7f42c4ff9700 1 -- 172.21.15.115:0/3482469993 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f42bc079800 con 0x7f42c80a5f60 2023-07-27T14:32:34.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.570+0000 7f42c7fff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42ac05f3c0 0x7f42ac061880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:34.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.571+0000 7f42c7fff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42ac05f3c0 0x7f42ac061880 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f42c80ac740 tx=0x7f42b4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:34.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.574+0000 7f42c4ff9700 1 -- 172.21.15.115:0/3482469993 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42bc0478f0 con 0x7f42c80a5f60 2023-07-27T14:32:34.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.785+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7f42c8065270 con 0x7f42ac05f3c0 2023-07-27T14:32:34.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.792+0000 7f42c4ff9700 1 -- 172.21.15.115:0/3482469993 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f42c8065270 con 0x7f42ac05f3c0 2023-07-27T14:32:34.828 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:34.828 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:32:34.828 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:32:34.828 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:32:34.829 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:32:34.829 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000105917", 2023-07-27T14:32:34.829 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000897738" 2023-07-27T14:32:34.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:34.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:34.829 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:34.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42ac05f3c0 msgr2=0x7f42ac061880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42ac05f3c0 0x7f42ac061880 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f42c80ac740 tx=0x7f42b4009040).stop 2023-07-27T14:32:34.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80a5f60 msgr2=0x7f42c80aa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:34.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80a5f60 0x7f42c80aa6f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f42bc00c410 tx=0x7f42bc007e00).stop 2023-07-27T14:32:34.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 shutdown_connections 2023-07-27T14:32:34.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f42ac05f3c0 0x7f42ac061880 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42c814f740 0x7f42c814d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42c80a5f60 0x7f42c80aa6f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 --2- 172.21.15.115:0/3482469993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42c80c38f0 0x7f42c80c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:34.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 >> 172.21.15.115:0/3482469993 conn(0x7f42c8062320 msgr2=0x7f42c80bcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:34.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 shutdown_connections 2023-07-27T14:32:34.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:34.794+0000 7f42cebff700 1 -- 172.21.15.115:0/3482469993 wait complete. 2023-07-27T14:32:35.848 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000272363 2023-07-27T14:32:36.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.012+0000 7f79265ff700 1 Processor -- start 2023-07-27T14:32:36.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.012+0000 7f79265ff700 1 -- start start 2023-07-27T14:32:36.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.013+0000 7f79265ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920153e00 0x7f79200c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:36.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.013+0000 7f79265ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7920064230 0x7f79200656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:36.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.013+0000 7f79265ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7920066070 con 0x7f7920065bc0 2023-07-27T14:32:36.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.013+0000 7f79265ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7920062320 con 0x7f7920064230 2023-07-27T14:32:36.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.013+0000 7f79265ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7920064a80 con 0x7f7920153e00 2023-07-27T14:32:36.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f7924b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7920065bc0 0x7f7920157a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39372/0 (socket says 172.21.15.115:39372) 2023-07-27T14:32:36.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f7924b9c700 1 -- 172.21.15.115:0/1399963848 learned_addr learned my addr 172.21.15.115:0/1399963848 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:36.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791ffff700 1 --2- 172.21.15.115:0/1399963848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920153e00 0x7f79200c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:36.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791f7fe700 1 --2- 172.21.15.115:0/1399963848 >> v2:172.21.15.159:3300/0 conn(0x7f7920064230 0x7f79200656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:36.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791effd700 1 -- 172.21.15.115:0/1399963848 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024972217 0 0) 0x7f7918001490 con 0x7f7920065bc0 2023-07-27T14:32:36.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791effd700 1 -- 172.21.15.115:0/1399963848 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79080033f0 con 0x7f7920065bc0 2023-07-27T14:32:36.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791ffff700 1 -- 172.21.15.115:0/1399963848 >> v2:172.21.15.159:3300/0 conn(0x7f7920064230 msgr2=0x7f79200656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:36.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791ffff700 1 --2- 172.21.15.115:0/1399963848 >> v2:172.21.15.159:3300/0 conn(0x7f7920064230 0x7f79200656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791ffff700 1 -- 172.21.15.115:0/1399963848 >> v1:172.21.15.115:6789/0 conn(0x7f7920065bc0 legacy=0x7f7920157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:36.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791effd700 1 -- 172.21.15.115:0/1399963848 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2533675791 0 0) 0x7f79080033f0 con 0x7f7920065bc0 2023-07-27T14:32:36.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791ffff700 1 -- 172.21.15.115:0/1399963848 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920064d60 con 0x7f7920153e00 2023-07-27T14:32:36.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791f7fe700 1 --2- 172.21.15.115:0/1399963848 >> v2:172.21.15.159:3300/0 conn(0x7f7920064230 0x7f79200656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:36.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.014+0000 7f791ffff700 1 --2- 172.21.15.115:0/1399963848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920153e00 0x7f79200c6b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7910009790 tx=0x7f7910009060).ready entity=mon.2 client_cookie=18d97c3af9707532 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:36.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f791effd700 1 -- 172.21.15.115:0/1399963848 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7918001980 con 0x7f7920153e00 2023-07-27T14:32:36.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f791effd700 1 -- 172.21.15.115:0/1399963848 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910011400 con 0x7f7920153e00 2023-07-27T14:32:36.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f791effd700 1 -- 172.21.15.115:0/1399963848 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910011780 con 0x7f7920153e00 2023-07-27T14:32:36.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f79265ff700 1 -- 172.21.15.115:0/1399963848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920153e00 msgr2=0x7f79200c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:36.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f79265ff700 1 --2- 172.21.15.115:0/1399963848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920153e00 0x7f79200c6b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7910009790 tx=0x7f7910009060).stop 2023-07-27T14:32:36.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f79265ff700 1 -- 172.21.15.115:0/1399963848 shutdown_connections 2023-07-27T14:32:36.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f79265ff700 1 --2- 172.21.15.115:0/1399963848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920153e00 0x7f79200c6b70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f79265ff700 1 --2- 172.21.15.115:0/1399963848 >> v2:172.21.15.159:3300/0 conn(0x7f7920064230 0x7f79200656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f79265ff700 1 -- 172.21.15.115:0/1399963848 >> 172.21.15.115:0/1399963848 conn(0x7f79200c7b90 msgr2=0x7f79200c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:36.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f79265ff700 1 -- 172.21.15.115:0/1399963848 shutdown_connections 2023-07-27T14:32:36.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.015+0000 7f79265ff700 1 -- 172.21.15.115:0/1399963848 wait complete. 2023-07-27T14:32:36.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.017+0000 7f79265ff700 1 Processor -- start 2023-07-27T14:32:36.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.017+0000 7f79265ff700 1 -- start start 2023-07-27T14:32:36.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f79265ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7920064230 0x7f7920148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:36.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f79265ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920065bc0 0x7f7920149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:36.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f79265ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7920153e00 0x7f79200ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:36.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f79265ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200ad0e0 con 0x7f7920064230 2023-07-27T14:32:36.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f79265ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200a6e20 con 0x7f7920153e00 2023-07-27T14:32:36.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f79265ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200ac840 con 0x7f7920065bc0 2023-07-27T14:32:36.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7920064230 0x7f7920148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:36.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7920064230 0x7f7920148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54330/0 (socket says 172.21.15.115:54330) 2023-07-27T14:32:36.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791ffff700 1 -- 172.21.15.115:0/1302597734 learned_addr learned my addr 172.21.15.115:0/1302597734 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:36.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f7924b9c700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7920153e00 0x7f79200ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:36.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791f7fe700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920065bc0 0x7f7920149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:36.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791ffff700 1 -- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920065bc0 msgr2=0x7f7920149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:36.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791ffff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920065bc0 0x7f7920149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791ffff700 1 -- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7920153e00 msgr2=0x7f79200ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:36.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791ffff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7920153e00 0x7f79200ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791ffff700 1 -- 172.21.15.115:0/1302597734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79140092a0 con 0x7f7920064230 2023-07-27T14:32:36.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f791f7fe700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920065bc0 0x7f7920149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:36.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.018+0000 7f7924b9c700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7920153e00 0x7f79200ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:36.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.019+0000 7f791ffff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7920064230 0x7f7920148b40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f7910009d80 tx=0x7f7910016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:36.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.019+0000 7f7907fff700 1 -- 172.21.15.115:0/1302597734 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100108a0 con 0x7f7920064230 2023-07-27T14:32:36.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.019+0000 7f7907fff700 1 -- 172.21.15.115:0/1302597734 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910010a00 con 0x7f7920064230 2023-07-27T14:32:36.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.019+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79100092a0 con 0x7f7920064230 2023-07-27T14:32:36.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.019+0000 7f7907fff700 1 -- 172.21.15.115:0/1302597734 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910010dc0 con 0x7f7920064230 2023-07-27T14:32:36.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.019+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79200ace00 con 0x7f7920064230 2023-07-27T14:32:36.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.020+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79200a6bf0 con 0x7f7920064230 2023-07-27T14:32:36.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.021+0000 7f7907fff700 1 -- 172.21.15.115:0/1302597734 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7f791000f070 con 0x7f7920064230 2023-07-27T14:32:36.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.022+0000 7f7907fff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f790c05f450 0x7f790c061910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:36.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.022+0000 7f7907fff700 1 -- 172.21.15.115:0/1302597734 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f791007b810 con 0x7f7920064230 2023-07-27T14:32:36.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.022+0000 7f791f7fe700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f790c05f450 0x7f790c061910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:36.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.023+0000 7f791f7fe700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f790c05f450 0x7f790c061910 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f7914009270 tx=0x7f7914008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:36.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.027+0000 7f7907fff700 1 -- 172.21.15.115:0/1302597734 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79200a6bf0 con 0x7f7920064230 2023-07-27T14:32:36.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.236+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7f79200a6bf0 con 0x7f790c05f450 2023-07-27T14:32:36.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.242+0000 7f7907fff700 1 -- 172.21.15.115:0/1302597734 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f79200a6bf0 con 0x7f790c05f450 2023-07-27T14:32:36.279 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:36.279 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:32:36.279 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:32:36.279 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:32:36.280 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:32:36.280 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000105917", 2023-07-27T14:32:36.280 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000897738" 2023-07-27T14:32:36.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:36.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:36.280 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:36.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f790c05f450 msgr2=0x7f790c061910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:36.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f790c05f450 0x7f790c061910 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f7914009270 tx=0x7f7914008040).stop 2023-07-27T14:32:36.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7920064230 msgr2=0x7f7920148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7920064230 0x7f7920148b40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f7910009d80 tx=0x7f7910016000).stop 2023-07-27T14:32:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 shutdown_connections 2023-07-27T14:32:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f790c05f450 0x7f790c061910 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7920153e00 0x7f79200ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7920064230 0x7f7920148b40 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 --2- 172.21.15.115:0/1302597734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7920065bc0 0x7f7920149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 >> 172.21.15.115:0/1302597734 conn(0x7f79200c7b90 msgr2=0x7f79200bc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:36.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 shutdown_connections 2023-07-27T14:32:36.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:36.245+0000 7f79265ff700 1 -- 172.21.15.115:0/1302597734 wait complete. 2023-07-27T14:32:37.299 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000272363 2023-07-27T14:32:37.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.464+0000 7fc863fff700 1 Processor -- start 2023-07-27T14:32:37.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.464+0000 7fc863fff700 1 -- start start 2023-07-27T14:32:37.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc863fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc85c063260 0x7fc85c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc863fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc85c14b1e0 0x7fc85c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc863fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c1553f0 con 0x7fc85c14ae00 2023-07-27T14:32:37.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc863fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c157a50 con 0x7fc85c14b1e0 2023-07-27T14:32:37.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc863fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c157d10 con 0x7fc85c063260 2023-07-27T14:32:37.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc861d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc85c14ae00 0x7fc85c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39384/0 (socket says 172.21.15.115:39384) 2023-07-27T14:32:37.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc861d9b700 1 -- 172.21.15.115:0/2947048978 learned_addr learned my addr 172.21.15.115:0/2947048978 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:37.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc86259c700 1 --2- 172.21.15.115:0/2947048978 >> v2:172.21.15.159:3300/0 conn(0x7fc85c14b1e0 0x7fc85c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc86159a700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc85c063260 0x7fc85c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271845096 0 0) 0x7fc85c1553f0 con 0x7fc85c14ae00 2023-07-27T14:32:37.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.466+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8480033f0 con 0x7fc85c14ae00 2023-07-27T14:32:37.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3903392374 0 0) 0x7fc8480033f0 con 0x7fc85c14ae00 2023-07-27T14:32:37.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc85c063260 msgr2=0x7fc85c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:37.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc85c063260 0x7fc85c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 >> v2:172.21.15.159:3300/0 conn(0x7fc85c14b1e0 msgr2=0x7fc85c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:37.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 --2- 172.21.15.115:0/2947048978 >> v2:172.21.15.159:3300/0 conn(0x7fc85c14b1e0 0x7fc85c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c157ff0 con 0x7fc85c14ae00 2023-07-27T14:32:37.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fc858001470 con 0x7fc85c14ae00 2023-07-27T14:32:37.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 >> v1:172.21.15.115:6789/0 conn(0x7fc85c14ae00 legacy=0x7fc85c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:37.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc85c063260 0x7fc8480038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc848003e10 0x7fc848004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc848004b80 0x7fc848005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c157a50 con 0x7fc848003e10 2023-07-27T14:32:37.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c157d10 con 0x7fc848004b80 2023-07-27T14:32:37.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84800b8e0 con 0x7fc85c063260 2023-07-27T14:32:37.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc86159a700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc848003e10 0x7fc848004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc86259c700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc848004b80 0x7fc848005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.467+0000 7fc861d9b700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc85c063260 0x7fc8480038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc86159a700 1 -- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc85c063260 msgr2=0x7fc8480038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:37.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc86159a700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc85c063260 0x7fc8480038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc86159a700 1 -- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc848004b80 msgr2=0x7fc848005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:37.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc86159a700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc848004b80 0x7fc848005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc86159a700 1 -- 172.21.15.115:0/2947048978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8480033f0 con 0x7fc848003e10 2023-07-27T14:32:37.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc86159a700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc848003e10 0x7fc848004690 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fc84c009a80 tx=0x7fc84c009060).ready entity=mon.0 client_cookie=18aef14e280d472a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:37.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c009430 con 0x7fc848003e10 2023-07-27T14:32:37.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00e640 con 0x7fc848003e10 2023-07-27T14:32:37.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc860d99700 1 -- 172.21.15.115:0/2947048978 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00e9c0 con 0x7fc848003e10 2023-07-27T14:32:37.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc863fff700 1 -- 172.21.15.115:0/2947048978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc848003e10 msgr2=0x7fc848004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:37.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc863fff700 1 --2- 172.21.15.115:0/2947048978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc848003e10 0x7fc848004690 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fc84c009a80 tx=0x7fc84c009060).stop 2023-07-27T14:32:37.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.468+0000 7fc86259c700 1 -- 172.21.15.115:0/2947048978 reap_dead start 2023-07-27T14:32:37.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.469+0000 7fc863fff700 1 -- 172.21.15.115:0/2947048978 shutdown_connections 2023-07-27T14:32:37.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.469+0000 7fc863fff700 1 -- 172.21.15.115:0/2947048978 >> 172.21.15.115:0/2947048978 conn(0x7fc85c05e940 msgr2=0x7fc85c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:37.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.469+0000 7fc863fff700 1 -- 172.21.15.115:0/2947048978 shutdown_connections 2023-07-27T14:32:37.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.469+0000 7fc863fff700 1 -- 172.21.15.115:0/2947048978 wait complete. 2023-07-27T14:32:37.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.470+0000 7fc863fff700 1 Processor -- start 2023-07-27T14:32:37.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.470+0000 7fc863fff700 1 -- start start 2023-07-27T14:32:37.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc863fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc848003e10 0x7fc85c0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc863fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0afd60 0x7fc85c0c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc863fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc85c0b01e0 0x7fc85c0c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc863fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0c2970 con 0x7fc85c0b01e0 2023-07-27T14:32:37.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc863fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0c1cf0 con 0x7fc85c0afd60 2023-07-27T14:32:37.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc863fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0c1fd0 con 0x7fc848003e10 2023-07-27T14:32:37.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc86259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc85c0b01e0 0x7fc85c0c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc86259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc85c0b01e0 0x7fc85c0c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54354/0 (socket says 172.21.15.115:54354) 2023-07-27T14:32:37.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc86259c700 1 -- 172.21.15.115:0/1076728569 learned_addr learned my addr 172.21.15.115:0/1076728569 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:37.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.471+0000 7fc861d9b700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc848003e10 0x7fc85c0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc86159a700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0afd60 0x7fc85c0c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc86259c700 1 -- 172.21.15.115:0/1076728569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc848003e10 msgr2=0x7fc85c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:37.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc86259c700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc848003e10 0x7fc85c0c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc86259c700 1 -- 172.21.15.115:0/1076728569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0afd60 msgr2=0x7fc85c0c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:37.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc86259c700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0afd60 0x7fc85c0c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc86259c700 1 -- 172.21.15.115:0/1076728569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0c22b0 con 0x7fc85c0b01e0 2023-07-27T14:32:37.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc86259c700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc85c0b01e0 0x7fc85c0c3280 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fc85c0cb870 tx=0x7fc85400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:37.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc851ffb700 1 -- 172.21.15.115:0/1076728569 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400e040 con 0x7fc85c0b01e0 2023-07-27T14:32:37.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc851ffb700 1 -- 172.21.15.115:0/1076728569 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400f040 con 0x7fc85c0b01e0 2023-07-27T14:32:37.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c0c2590 con 0x7fc85c0b01e0 2023-07-27T14:32:37.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc851ffb700 1 -- 172.21.15.115:0/1076728569 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400fd70 con 0x7fc85c0b01e0 2023-07-27T14:32:37.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.472+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c0add20 con 0x7fc85c0b01e0 2023-07-27T14:32:37.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.473+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c0c2ab0 con 0x7fc85c0b01e0 2023-07-27T14:32:37.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.474+0000 7fc851ffb700 1 -- 172.21.15.115:0/1076728569 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7fc854015660 con 0x7fc85c0b01e0 2023-07-27T14:32:37.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.475+0000 7fc851ffb700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc84005f450 0x7fc840061910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:37.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.475+0000 7fc851ffb700 1 -- 172.21.15.115:0/1076728569 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc85407aff0 con 0x7fc85c0b01e0 2023-07-27T14:32:37.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.475+0000 7fc861d9b700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc84005f450 0x7fc840061910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:37.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.475+0000 7fc861d9b700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc84005f450 0x7fc840061910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fc858007dd0 tx=0x7fc858001e90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:37.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.479+0000 7fc851ffb700 1 -- 172.21.15.115:0/1076728569 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc85c0c2ab0 con 0x7fc85c0b01e0 2023-07-27T14:32:37.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.692+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7fc85c0c2ab0 con 0x7fc84005f450 2023-07-27T14:32:37.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.698+0000 7fc851ffb700 1 -- 172.21.15.115:0/1076728569 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7fc85c0c2ab0 con 0x7fc84005f450 2023-07-27T14:32:37.735 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:37.735 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:32:37.735 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:32:37.736 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:32:37.736 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:32:37.736 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000105917", 2023-07-27T14:32:37.736 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000897738" 2023-07-27T14:32:37.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:37.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:37.737 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:37.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc84005f450 msgr2=0x7fc840061910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:37.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc84005f450 0x7fc840061910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fc858007dd0 tx=0x7fc858001e90).stop 2023-07-27T14:32:37.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc85c0b01e0 msgr2=0x7fc85c0c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:37.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc85c0b01e0 0x7fc85c0c3280 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fc85c0cb870 tx=0x7fc85400b040).stop 2023-07-27T14:32:37.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 shutdown_connections 2023-07-27T14:32:37.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc84005f450 0x7fc840061910 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc85c0b01e0 0x7fc85c0c3280 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc848003e10 0x7fc85c0c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 --2- 172.21.15.115:0/1076728569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc85c0afd60 0x7fc85c0c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:37.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 >> 172.21.15.115:0/1076728569 conn(0x7fc85c05e940 msgr2=0x7fc85c0c0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:37.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 shutdown_connections 2023-07-27T14:32:37.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:37.700+0000 7fc863fff700 1 -- 172.21.15.115:0/1076728569 wait complete. 2023-07-27T14:32:38.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000272363 2023-07-27T14:32:38.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.921+0000 7ffbc0fff700 1 Processor -- start 2023-07-27T14:32:38.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.921+0000 7ffbc0fff700 1 -- start start 2023-07-27T14:32:38.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.922+0000 7ffbc0fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc14ae00 0x7ffbbc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:38.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.922+0000 7ffbc0fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffbbc14b1e0 0x7ffbbc062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:38.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.922+0000 7ffbc0fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbbc1553f0 con 0x7ffbbc0c5c50 2023-07-27T14:32:38.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.922+0000 7ffbc0fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc157a50 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.922+0000 7ffbc0fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc157d10 con 0x7ffbbc14ae00 2023-07-27T14:32:38.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb9d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffbbc14b1e0 0x7ffbbc062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:38.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb9d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffbbc14b1e0 0x7ffbbc062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54362/0 (socket says 172.21.15.115:54362) 2023-07-27T14:32:38.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb9d9b700 1 -- 172.21.15.115:0/1126739565 learned_addr learned my addr 172.21.15.115:0/1126739565 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:38.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbba59c700 1 --2- 172.21.15.115:0/1126739565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc14ae00 0x7ffbbc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:38.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb9d9b700 1 -- 172.21.15.115:0/1126739565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc14ae00 msgr2=0x7ffbbc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:38.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb9d9b700 1 --2- 172.21.15.115:0/1126739565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc14ae00 0x7ffbbc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:38.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb9d9b700 1 -- 172.21.15.115:0/1126739565 >> v1:172.21.15.159:6789/0 conn(0x7ffbbc0c5c50 legacy=0x7ffbbc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:38.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb9d9b700 1 -- 172.21.15.115:0/1126739565 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc157ff0 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb9d9b700 1 --2- 172.21.15.115:0/1126739565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc062b50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7ffbb0006fd0 tx=0x7ffbb00090f0).ready entity=mon.0 client_cookie=fa4b69bf70ed62bb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:38.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb959a700 1 -- 172.21.15.115:0/1126739565 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000b600 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb959a700 1 -- 172.21.15.115:0/1126739565 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb000b760 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.923+0000 7ffbb959a700 1 -- 172.21.15.115:0/1126739565 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000bae0 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.924+0000 7ffbc0fff700 1 -- 172.21.15.115:0/1126739565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 msgr2=0x7ffbbc062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:38.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.924+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/1126739565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc062b50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7ffbb0006fd0 tx=0x7ffbb00090f0).stop 2023-07-27T14:32:38.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.924+0000 7ffbc0fff700 1 -- 172.21.15.115:0/1126739565 shutdown_connections 2023-07-27T14:32:38.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.924+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/1126739565 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc14ae00 0x7ffbbc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:38.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.924+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/1126739565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc062b50 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:38.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.924+0000 7ffbc0fff700 1 -- 172.21.15.115:0/1126739565 >> 172.21.15.115:0/1126739565 conn(0x7ffbbc05e940 msgr2=0x7ffbbc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:38.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.924+0000 7ffbc0fff700 1 -- 172.21.15.115:0/1126739565 shutdown_connections 2023-07-27T14:32:38.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.924+0000 7ffbc0fff700 1 -- 172.21.15.115:0/1126739565 wait complete. 2023-07-27T14:32:38.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.926+0000 7ffbc0fff700 1 Processor -- start 2023-07-27T14:32:38.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.926+0000 7ffbc0fff700 1 -- start start 2023-07-27T14:32:38.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbc0fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc0c5c50 0x7ffbbc1680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:38.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbc0fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbbc14ae00 0x7ffbbc14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:38.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbc0fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc14bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:38.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbc0fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc14c080 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbc0fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc165eb0 con 0x7ffbbc14ae00 2023-07-27T14:32:38.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbc0fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc165580 con 0x7ffbbc0c5c50 2023-07-27T14:32:38.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc14bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:38.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc14bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54372/0 (socket says 172.21.15.115:54372) 2023-07-27T14:32:38.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 -- 172.21.15.115:0/282256350 learned_addr learned my addr 172.21.15.115:0/282256350 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:38.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbb9d9b700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbbc14ae00 0x7ffbbc14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:38.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 -- 172.21.15.115:0/282256350 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc0c5c50 msgr2=0x7ffbbc1680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:38.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc0c5c50 0x7ffbbc1680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:38.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 -- 172.21.15.115:0/282256350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbbc14ae00 msgr2=0x7ffbbc14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:38.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbbc14ae00 0x7ffbbc14b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:38.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 -- 172.21.15.115:0/282256350 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0009370 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.927+0000 7ffbbad9d700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc14bad0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7ffbb400b810 tx=0x7ffbb4009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:38.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.928+0000 7ffbaa7fc700 1 -- 172.21.15.115:0/282256350 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400d600 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.928+0000 7ffbaa7fc700 1 -- 172.21.15.115:0/282256350 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb400d780 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.928+0000 7ffbaa7fc700 1 -- 172.21.15.115:0/282256350 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400db40 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.928+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc165860 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.928+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc1685b0 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.929+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbbc0c5480 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.930+0000 7ffbaa7fc700 1 -- 172.21.15.115:0/282256350 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7ffbb4019460 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.930+0000 7ffbaa7fc700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb9c05f450 0x7ffb9c061910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:38.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.930+0000 7ffbaa7fc700 1 -- 172.21.15.115:0/282256350 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffbb407a6b0 con 0x7ffbbc14b1e0 2023-07-27T14:32:38.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.931+0000 7ffbba59c700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb9c05f450 0x7ffb9c061910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:38.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.931+0000 7ffbba59c700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb9c05f450 0x7ffb9c061910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7ffbac00b8f0 tx=0x7ffbac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:38.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:38.934+0000 7ffbaa7fc700 1 -- 172.21.15.115:0/282256350 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffbb404b6a0 con 0x7ffbbc14b1e0 2023-07-27T14:32:39.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.142+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbbc166020 con 0x7ffb9c05f450 2023-07-27T14:32:39.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.148+0000 7ffbaa7fc700 1 -- 172.21.15.115:0/282256350 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7ffbbc166020 con 0x7ffb9c05f450 2023-07-27T14:32:39.185 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000105917", 2023-07-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000897738" 2023-07-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:39.186 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:39.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb9c05f450 msgr2=0x7ffb9c061910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:39.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb9c05f450 0x7ffb9c061910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7ffbac00b8f0 tx=0x7ffbac008040).stop 2023-07-27T14:32:39.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 msgr2=0x7ffbbc14bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:39.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc14bad0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7ffbb400b810 tx=0x7ffbb4009290).stop 2023-07-27T14:32:39.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 shutdown_connections 2023-07-27T14:32:39.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb9c05f450 0x7ffb9c061910 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:39.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbbc14b1e0 0x7ffbbc14bad0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:39.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbbc0c5c50 0x7ffbbc1680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:39.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 --2- 172.21.15.115:0/282256350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbbc14ae00 0x7ffbbc14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:39.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.150+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 >> 172.21.15.115:0/282256350 conn(0x7ffbbc05e940 msgr2=0x7ffbbc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:39.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.151+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 shutdown_connections 2023-07-27T14:32:39.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:39.151+0000 7ffbc0fff700 1 -- 172.21.15.115:0/282256350 wait complete. 2023-07-27T14:32:40.206 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000272363 2023-07-27T14:32:40.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.367+0000 7f571a3ff700 1 Processor -- start 2023-07-27T14:32:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.367+0000 7f571a3ff700 1 -- start start 2023-07-27T14:32:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.368+0000 7f571a3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414ae00 0x7f5714154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.368+0000 7f571a3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f571414b1e0 0x7f5714062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.368+0000 7f571a3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57141553f0 con 0x7f57140c5c50 2023-07-27T14:32:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.368+0000 7f571a3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5714157a50 con 0x7f571414b1e0 2023-07-27T14:32:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.368+0000 7f571a3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5714157d10 con 0x7f571414ae00 2023-07-27T14:32:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5713fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414ae00 0x7f5714154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f57137fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f571414b1e0 0x7f5714062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5713fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414ae00 0x7f5714154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:48322/0 (socket says 172.21.15.115:48322) 2023-07-27T14:32:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5713fff700 1 -- 172.21.15.115:0/2841048094 learned_addr learned my addr 172.21.15.115:0/2841048094 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f57137fe700 1 --2- 172.21.15.115:0/2841048094 >> v2:172.21.15.159:3300/0 conn(0x7f571414b1e0 0x7f5714062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:37656/0 (socket says 172.21.15.115:37656) 2023-07-27T14:32:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5713fff700 1 -- 172.21.15.115:0/2841048094 >> v2:172.21.15.159:3300/0 conn(0x7f571414b1e0 msgr2=0x7f5714062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5713fff700 1 --2- 172.21.15.115:0/2841048094 >> v2:172.21.15.159:3300/0 conn(0x7f571414b1e0 0x7f5714062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5713fff700 1 -- 172.21.15.115:0/2841048094 >> v1:172.21.15.159:6789/0 conn(0x7f57140c5c50 legacy=0x7f57140a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5713fff700 1 -- 172.21.15.115:0/2841048094 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714157ff0 con 0x7f571414ae00 2023-07-27T14:32:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f57137fe700 1 --2- 172.21.15.115:0/2841048094 >> v2:172.21.15.159:3300/0 conn(0x7f571414b1e0 0x7f5714062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5713fff700 1 --2- 172.21.15.115:0/2841048094 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414ae00 0x7f5714154f00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5704006fd0 tx=0x7f57040090f0).ready entity=mon.2 client_cookie=81b8614459143a42 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.369+0000 7f5712ffd700 1 -- 172.21.15.115:0/2841048094 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400b580 con 0x7f571414ae00 2023-07-27T14:32:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f5712ffd700 1 -- 172.21.15.115:0/2841048094 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400b6e0 con 0x7f571414ae00 2023-07-27T14:32:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f5712ffd700 1 -- 172.21.15.115:0/2841048094 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400ba60 con 0x7f571414ae00 2023-07-27T14:32:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f571a3ff700 1 -- 172.21.15.115:0/2841048094 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414ae00 msgr2=0x7f5714154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f571a3ff700 1 --2- 172.21.15.115:0/2841048094 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414ae00 0x7f5714154f00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5704006fd0 tx=0x7f57040090f0).stop 2023-07-27T14:32:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f571a3ff700 1 -- 172.21.15.115:0/2841048094 shutdown_connections 2023-07-27T14:32:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f571a3ff700 1 --2- 172.21.15.115:0/2841048094 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414ae00 0x7f5714154f00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f571a3ff700 1 --2- 172.21.15.115:0/2841048094 >> v2:172.21.15.159:3300/0 conn(0x7f571414b1e0 0x7f5714062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f571a3ff700 1 -- 172.21.15.115:0/2841048094 >> 172.21.15.115:0/2841048094 conn(0x7f571405e940 msgr2=0x7f57140cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f571a3ff700 1 -- 172.21.15.115:0/2841048094 shutdown_connections 2023-07-27T14:32:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.370+0000 7f571a3ff700 1 -- 172.21.15.115:0/2841048094 wait complete. 2023-07-27T14:32:40.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.372+0000 7f571a3ff700 1 Processor -- start 2023-07-27T14:32:40.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.372+0000 7f571a3ff700 1 -- start start 2023-07-27T14:32:40.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f571a3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57140c5c50 0x7f5714147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:40.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f571a3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f571414ae00 0x7f57140c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:40.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f571a3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414b1e0 0x7f5714062a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:40.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f571a3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140a9ad0 con 0x7f571414ae00 2023-07-27T14:32:40.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f571a3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140a9d20 con 0x7f57140c5c50 2023-07-27T14:32:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f571a3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140aa000 con 0x7f571414b1e0 2023-07-27T14:32:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f57137fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f571414ae00 0x7f57140c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f57137fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f571414ae00 0x7f57140c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54382/0 (socket says 172.21.15.115:54382) 2023-07-27T14:32:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f57137fe700 1 -- 172.21.15.115:0/1894943502 learned_addr learned my addr 172.21.15.115:0/1894943502 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f5713fff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57140c5c50 0x7f5714147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f571899c700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414b1e0 0x7f5714062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f57137fe700 1 -- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414b1e0 msgr2=0x7f5714062a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f57137fe700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414b1e0 0x7f5714062a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f57137fe700 1 -- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57140c5c50 msgr2=0x7f5714147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f57137fe700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57140c5c50 0x7f5714147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f57137fe700 1 -- 172.21.15.115:0/1894943502 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57080092a0 con 0x7f571414ae00 2023-07-27T14:32:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.374+0000 7f571899c700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414b1e0 0x7f5714062a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.375+0000 7f57137fe700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f571414ae00 0x7f57140c2380 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f570800e980 tx=0x7f5708009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.375+0000 7f56fbfff700 1 -- 172.21.15.115:0/1894943502 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800c7f0 con 0x7f571414ae00 2023-07-27T14:32:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.375+0000 7f56fbfff700 1 -- 172.21.15.115:0/1894943502 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570800c950 con 0x7f571414ae00 2023-07-27T14:32:40.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.375+0000 7f56fbfff700 1 -- 172.21.15.115:0/1894943502 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800ccd0 con 0x7f571414ae00 2023-07-27T14:32:40.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.375+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5704009370 con 0x7f571414ae00 2023-07-27T14:32:40.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.375+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57141573e0 con 0x7f571414ae00 2023-07-27T14:32:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.376+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571406c470 con 0x7f571414ae00 2023-07-27T14:32:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.377+0000 7f56fbfff700 1 -- 172.21.15.115:0/1894943502 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7f5708022070 con 0x7f571414ae00 2023-07-27T14:32:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.377+0000 7f56fbfff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f570005f450 0x7f5700061910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.378+0000 7f56fbfff700 1 -- 172.21.15.115:0/1894943502 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f570807aae0 con 0x7f571414ae00 2023-07-27T14:32:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.378+0000 7f5713fff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f570005f450 0x7f5700061910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.378+0000 7f5713fff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f570005f450 0x7f5700061910 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f5704009130 tx=0x7f5704017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:40.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.382+0000 7f56fbfff700 1 -- 172.21.15.115:0/1894943502 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f570804b8b0 con 0x7f571414ae00 2023-07-27T14:32:40.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:40.591+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7f57140aa4a0 con 0x7f570005f450 2023-07-27T14:32:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.089+0000 7f56fbfff700 1 -- 172.21.15.115:0/1894943502 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f57140aa4a0 con 0x7f570005f450 2023-07-27T14:32:42.126 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:42.127 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:32:42.127 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:32:42.127 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:32:42.127 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:32:42.127 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000105917", 2023-07-27T14:32:42.127 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000897738" 2023-07-27T14:32:42.127 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:42.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:42.128 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:42.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f570005f450 msgr2=0x7f5700061910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:42.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f570005f450 0x7f5700061910 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f5704009130 tx=0x7f5704017000).stop 2023-07-27T14:32:42.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f571414ae00 msgr2=0x7f57140c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:42.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f571414ae00 0x7f57140c2380 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f570800e980 tx=0x7f5708009060).stop 2023-07-27T14:32:42.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 shutdown_connections 2023-07-27T14:32:42.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f570005f450 0x7f5700061910 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f571414b1e0 0x7f5714062a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57140c5c50 0x7f5714147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 --2- 172.21.15.115:0/1894943502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f571414ae00 0x7f57140c2380 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 >> 172.21.15.115:0/1894943502 conn(0x7f571405e940 msgr2=0x7f57140640b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 shutdown_connections 2023-07-27T14:32:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:42.093+0000 7f571a3ff700 1 -- 172.21.15.115:0/1894943502 wait complete. 2023-07-27T14:32:43.153 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000272363 2023-07-27T14:32:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.318+0000 7fb8ef9ff700 1 Processor -- start 2023-07-27T14:32:43.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.318+0000 7fb8ef9ff700 1 -- start start 2023-07-27T14:32:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.319+0000 7fb8ef9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb8e813a730 0x7fb8e8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.319+0000 7fb8ef9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 0x7fb8e81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.319+0000 7fb8ef9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80bd9a0 con 0x7fb8e813a350 2023-07-27T14:32:43.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.319+0000 7fb8ef9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e8066400 con 0x7fb8e813a730 2023-07-27T14:32:43.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.319+0000 7fb8ef9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8158ae0 con 0x7fb8e80c36b0 2023-07-27T14:32:43.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8ed79b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb8e813a350 0x7fb8e80c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:39388/0 (socket says 172.21.15.115:39388) 2023-07-27T14:32:43.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8ed79b700 1 -- 172.21.15.115:0/1668853580 learned_addr learned my addr 172.21.15.115:0/1668853580 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:43.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8ecf9a700 1 --2- 172.21.15.115:0/1668853580 >> v2:172.21.15.159:3300/0 conn(0x7fb8e813a730 0x7fb8e8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8edf9c700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 0x7fb8e81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467608300 0 0) 0x7fb8e80bd9a0 con 0x7fb8e813a350 2023-07-27T14:32:43.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d40033f0 con 0x7fb8e813a350 2023-07-27T14:32:43.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463886283 0 0) 0x7fb8d40033f0 con 0x7fb8e813a350 2023-07-27T14:32:43.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 msgr2=0x7fb8e81585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:43.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 0x7fb8e81585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:43.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 >> v2:172.21.15.159:3300/0 conn(0x7fb8e813a730 msgr2=0x7fb8e8065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:43.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 --2- 172.21.15.115:0/1668853580 >> v2:172.21.15.159:3300/0 conn(0x7fb8e813a730 0x7fb8e8065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:43.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8066610 con 0x7fb8e813a350 2023-07-27T14:32:43.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb8e4001470 con 0x7fb8e813a350 2023-07-27T14:32:43.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.320+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 >> v1:172.21.15.115:6789/0 conn(0x7fb8e813a350 legacy=0x7fb8e80c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:43.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8dffff700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 0x7fb8d40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8dffff700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8d4003e10 0x7fb8d4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8dffff700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8d4004b80 0x7fb8d4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8066400 con 0x7fb8d4003e10 2023-07-27T14:32:43.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8158ae0 con 0x7fb8d4004b80 2023-07-27T14:32:43.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d400b8e0 con 0x7fb8e80c36b0 2023-07-27T14:32:43.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ecf9a700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8d4003e10 0x7fb8d4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8edf9c700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8d4004b80 0x7fb8d4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ed79b700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 0x7fb8d40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ecf9a700 1 -- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 msgr2=0x7fb8d40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:43.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ecf9a700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 0x7fb8d40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:43.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ecf9a700 1 -- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8d4004b80 msgr2=0x7fb8d4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:43.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ecf9a700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8d4004b80 0x7fb8d4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:43.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ecf9a700 1 -- 172.21.15.115:0/1668853580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d40033f0 con 0x7fb8d4003e10 2023-07-27T14:32:43.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ed79b700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8e80c36b0 0x7fb8d40038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:43.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.321+0000 7fb8ecf9a700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8d4003e10 0x7fb8d4004690 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fb8d8009ab0 tx=0x7fb8d8009060).ready entity=mon.0 client_cookie=2ef96638b3672950 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:43.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8009430 con 0x7fb8d4003e10 2023-07-27T14:32:43.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d800e640 con 0x7fb8d4003e10 2023-07-27T14:32:43.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8dffff700 1 -- 172.21.15.115:0/1668853580 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800e9c0 con 0x7fb8d4003e10 2023-07-27T14:32:43.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/1668853580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8d4003e10 msgr2=0x7fb8d4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:43.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8ef9ff700 1 --2- 172.21.15.115:0/1668853580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8d4003e10 0x7fb8d4004690 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fb8d8009ab0 tx=0x7fb8d8009060).stop 2023-07-27T14:32:43.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8edf9c700 1 -- 172.21.15.115:0/1668853580 reap_dead start 2023-07-27T14:32:43.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/1668853580 shutdown_connections 2023-07-27T14:32:43.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/1668853580 >> 172.21.15.115:0/1668853580 conn(0x7fb8e805e8f0 msgr2=0x7fb8e80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:43.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/1668853580 shutdown_connections 2023-07-27T14:32:43.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.322+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/1668853580 wait complete. 2023-07-27T14:32:43.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.324+0000 7fb8ef9ff700 1 Processor -- start 2023-07-27T14:32:43.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.324+0000 7fb8ef9ff700 1 -- start start 2023-07-27T14:32:43.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ef9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8d4003e10 0x7fb8e80c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ef9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8e8164590 0x7fb8e81528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ef9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8e80a99a0 0x7fb8e80a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ef9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8165580 con 0x7fb8e8164590 2023-07-27T14:32:43.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ef9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80c2c50 con 0x7fb8e80a99a0 2023-07-27T14:32:43.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ef9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80bfc00 con 0x7fb8d4003e10 2023-07-27T14:32:43.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ecf9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8e8164590 0x7fb8e81528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ecf9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8e8164590 0x7fb8e81528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54394/0 (socket says 172.21.15.115:54394) 2023-07-27T14:32:43.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ecf9a700 1 -- 172.21.15.115:0/569953154 learned_addr learned my addr 172.21.15.115:0/569953154 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:43.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8edf9c700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8e80a99a0 0x7fb8e80a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ed79b700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8d4003e10 0x7fb8e80c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ecf9a700 1 -- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8d4003e10 msgr2=0x7fb8e80c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:43.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ecf9a700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8d4003e10 0x7fb8e80c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:43.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ecf9a700 1 -- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8e80a99a0 msgr2=0x7fb8e80a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:43.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ecf9a700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8e80a99a0 0x7fb8e80a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:43.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ecf9a700 1 -- 172.21.15.115:0/569953154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80aa310 con 0x7fb8e8164590 2023-07-27T14:32:43.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8edf9c700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8e80a99a0 0x7fb8e80a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:43.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.325+0000 7fb8ed79b700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8d4003e10 0x7fb8e80c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:43.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.326+0000 7fb8ecf9a700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8e8164590 0x7fb8e81528e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fb8d800e4b0 tx=0x7fb8d801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:43.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.326+0000 7fb8dd7fa700 1 -- 172.21.15.115:0/569953154 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800ed70 con 0x7fb8e8164590 2023-07-27T14:32:43.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.326+0000 7fb8dd7fa700 1 -- 172.21.15.115:0/569953154 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d800eed0 con 0x7fb8e8164590 2023-07-27T14:32:43.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.326+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e8152dd0 con 0x7fb8e8164590 2023-07-27T14:32:43.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.326+0000 7fb8dd7fa700 1 -- 172.21.15.115:0/569953154 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800ea00 con 0x7fb8e8164590 2023-07-27T14:32:43.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.326+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e8164ce0 con 0x7fb8e8164590 2023-07-27T14:32:43.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.327+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e80bfd70 con 0x7fb8e8164590 2023-07-27T14:32:43.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.328+0000 7fb8dd7fa700 1 -- 172.21.15.115:0/569953154 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7fb8d801b660 con 0x7fb8e8164590 2023-07-27T14:32:43.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.329+0000 7fb8dd7fa700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb8cc05f420 0x7fb8cc0618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:43.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.329+0000 7fb8dd7fa700 1 -- 172.21.15.115:0/569953154 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb8d807bf20 con 0x7fb8e8164590 2023-07-27T14:32:43.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.329+0000 7fb8ed79b700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb8cc05f420 0x7fb8cc0618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:43.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.330+0000 7fb8ed79b700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb8cc05f420 0x7fb8cc0618e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fb8e4000e10 tx=0x7fb8e4001e60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:43.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.333+0000 7fb8dd7fa700 1 -- 172.21.15.115:0/569953154 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8d804cf70 con 0x7fb8e8164590 2023-07-27T14:32:43.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:43.542+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8e81653e0 con 0x7fb8cc05f420 2023-07-27T14:32:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.081+0000 7fb8dd7fa700 1 -- 172.21.15.115:0/569953154 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fb8e81653e0 con 0x7fb8cc05f420 2023-07-27T14:32:47.119 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:47.119 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:32:47.119 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:32:47.119 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:32:47.120 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:47.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb8cc05f420 msgr2=0x7fb8cc0618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb8cc05f420 0x7fb8cc0618e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fb8e4000e10 tx=0x7fb8e4001e60).stop 2023-07-27T14:32:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8e8164590 msgr2=0x7fb8e81528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8e8164590 0x7fb8e81528e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fb8d800e4b0 tx=0x7fb8d801a000).stop 2023-07-27T14:32:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 shutdown_connections 2023-07-27T14:32:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb8cc05f420 0x7fb8cc0618e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8e80a99a0 0x7fb8e80a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb8d4003e10 0x7fb8e80c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 --2- 172.21.15.115:0/569953154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8e8164590 0x7fb8e81528e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.084+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 >> 172.21.15.115:0/569953154 conn(0x7fb8e805e8f0 msgr2=0x7fb8e8064f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:47.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.085+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 shutdown_connections 2023-07-27T14:32:47.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.085+0000 7fb8ef9ff700 1 -- 172.21.15.115:0/569953154 wait complete. 2023-07-27T14:32:47.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000105917 snapshot_0000000000897738 2023-07-27T14:32:47.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.300+0000 7f255efff700 1 Processor -- start 2023-07-27T14:32:47.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.300+0000 7f255efff700 1 -- start start 2023-07-27T14:32:47.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.301+0000 7f255efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814ae00 0x7f2558154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.301+0000 7f255efff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f255814b1e0 0x7f2558062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.301+0000 7f255efff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25581553f0 con 0x7f25580c5c50 2023-07-27T14:32:47.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.301+0000 7f255efff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2558157a50 con 0x7f255814b1e0 2023-07-27T14:32:47.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.301+0000 7f255efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2558157d10 con 0x7f255814ae00 2023-07-27T14:32:47.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f2557fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f255814b1e0 0x7f2558062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f2557fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f255814b1e0 0x7f2558062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46658/0 (socket says 172.21.15.115:46658) 2023-07-27T14:32:47.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f2557fff700 1 -- 172.21.15.115:0/4054457826 learned_addr learned my addr 172.21.15.115:0/4054457826 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:47.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f2557fff700 1 -- 172.21.15.115:0/4054457826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814ae00 msgr2=0x7f2558154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:47.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f2557fff700 1 --2- 172.21.15.115:0/4054457826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814ae00 0x7f2558154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:47.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f2557fff700 1 -- 172.21.15.115:0/4054457826 >> v1:172.21.15.159:6789/0 conn(0x7f25580c5c50 legacy=0x7f25580a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:47.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f2557fff700 1 -- 172.21.15.115:0/4054457826 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558157ff0 con 0x7f255814b1e0 2023-07-27T14:32:47.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f2557fff700 1 --2- 172.21.15.115:0/4054457826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814b1e0 0x7f2558062b50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f2544006fd0 tx=0x7f25440090f0).ready entity=mon.0 client_cookie=5ae6a83dcec5bfc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:47.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.302+0000 7f25577fe700 1 -- 172.21.15.115:0/4054457826 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400b600 con 0x7f255814b1e0 2023-07-27T14:32:47.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f25577fe700 1 -- 172.21.15.115:0/4054457826 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400b760 con 0x7f255814b1e0 2023-07-27T14:32:47.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f25577fe700 1 -- 172.21.15.115:0/4054457826 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400bae0 con 0x7f255814b1e0 2023-07-27T14:32:47.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f255efff700 1 -- 172.21.15.115:0/4054457826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814b1e0 msgr2=0x7f2558062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f255efff700 1 --2- 172.21.15.115:0/4054457826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814b1e0 0x7f2558062b50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f2544006fd0 tx=0x7f25440090f0).stop 2023-07-27T14:32:47.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f255efff700 1 -- 172.21.15.115:0/4054457826 shutdown_connections 2023-07-27T14:32:47.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f255efff700 1 --2- 172.21.15.115:0/4054457826 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814ae00 0x7f2558154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:47.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f255efff700 1 --2- 172.21.15.115:0/4054457826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814b1e0 0x7f2558062b50 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f255efff700 1 -- 172.21.15.115:0/4054457826 >> 172.21.15.115:0/4054457826 conn(0x7f255805e940 msgr2=0x7f25580cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:47.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f255efff700 1 -- 172.21.15.115:0/4054457826 shutdown_connections 2023-07-27T14:32:47.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.303+0000 7f255efff700 1 -- 172.21.15.115:0/4054457826 wait complete. 2023-07-27T14:32:47.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.305+0000 7f255efff700 1 Processor -- start 2023-07-27T14:32:47.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.305+0000 7f255efff700 1 -- start start 2023-07-27T14:32:47.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f255efff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 0x7f2558167c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f255efff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f25580c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f255efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 0x7f25580af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f255efff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580aea50 con 0x7f255814ae00 2023-07-27T14:32:47.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f255efff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580adb60 con 0x7f25580c5c50 2023-07-27T14:32:47.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f255efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580ade40 con 0x7f255814b1e0 2023-07-27T14:32:47.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f25580c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f25580c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46674/0 (socket says 172.21.15.115:46674) 2023-07-27T14:32:47.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 -- 172.21.15.115:0/3595076606 learned_addr learned my addr 172.21.15.115:0/3595076606 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:47.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f255cd9b700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 0x7f2558167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f255d59c700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 0x7f25580af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 -- 172.21.15.115:0/3595076606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 msgr2=0x7f25580af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 0x7f25580af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 -- 172.21.15.115:0/3595076606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 msgr2=0x7f2558167c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 0x7f2558167c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 -- 172.21.15.115:0/3595076606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009370 con 0x7f255814ae00 2023-07-27T14:32:47.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.306+0000 7f2557fff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f25580c3e70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f2544011000 tx=0x7f2544017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:47.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.307+0000 7f2554ff9700 1 -- 172.21.15.115:0/3595076606 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400b8d0 con 0x7f255814ae00 2023-07-27T14:32:47.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.307+0000 7f2554ff9700 1 -- 172.21.15.115:0/3595076606 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400ba30 con 0x7f255814ae00 2023-07-27T14:32:47.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.307+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25580ae120 con 0x7f255814ae00 2023-07-27T14:32:47.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.307+0000 7f2554ff9700 1 -- 172.21.15.115:0/3595076606 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254401c670 con 0x7f255814ae00 2023-07-27T14:32:47.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.307+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25580ae6e0 con 0x7f255814ae00 2023-07-27T14:32:47.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.308+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25580aebc0 con 0x7f255814ae00 2023-07-27T14:32:47.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.309+0000 7f2554ff9700 1 -- 172.21.15.115:0/3595076606 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7f254402c070 con 0x7f255814ae00 2023-07-27T14:32:47.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.309+0000 7f2554ff9700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f253c05f480 0x7f253c061940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.310+0000 7f2554ff9700 1 -- 172.21.15.115:0/3595076606 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f254407c180 con 0x7f255814ae00 2023-07-27T14:32:47.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.310+0000 7f255cd9b700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f253c05f480 0x7f253c061940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.310+0000 7f255cd9b700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f253c05f480 0x7f253c061940 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f254c00b910 tx=0x7f254c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:47.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.314+0000 7f2554ff9700 1 -- 172.21.15.115:0/3595076606 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f254404d060 con 0x7f255814ae00 2023-07-27T14:32:47.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.521+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000105917", "snap_name": "snapshot_0000000000897738", "target": ["mon-mgr", ""]}) v1 -- 0x7f255806c470 con 0x7f253c05f480 2023-07-27T14:32:47.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.552+0000 7f2554ff9700 1 -- 172.21.15.115:0/3595076606 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f255806c470 con 0x7f253c05f480 2023-07-27T14:32:47.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f253c05f480 msgr2=0x7f253c061940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f253c05f480 0x7f253c061940 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f254c00b910 tx=0x7f254c008040).stop 2023-07-27T14:32:47.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 msgr2=0x7f25580c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f25580c3e70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f2544011000 tx=0x7f2544017000).stop 2023-07-27T14:32:47.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 shutdown_connections 2023-07-27T14:32:47.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f253c05f480 0x7f253c061940 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 0x7f25580af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 0x7f2558167c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 --2- 172.21.15.115:0/3595076606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f25580c3e70 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 >> 172.21.15.115:0/3595076606 conn(0x7f255805e940 msgr2=0x7f25580ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:47.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 shutdown_connections 2023-07-27T14:32:47.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.555+0000 7f255efff700 1 -- 172.21.15.115:0/3595076606 wait complete. 2023-07-27T14:32:47.609 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs clone_0000000000272363 2023-07-27T14:32:47.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.765+0000 7fb321bff700 1 Processor -- start 2023-07-27T14:32:47.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.765+0000 7fb321bff700 1 -- start start 2023-07-27T14:32:47.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.766+0000 7fb321bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb31c153e00 0x7fb31c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb321bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c065de0 0x7fb31c062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb321bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c064a80 con 0x7fb31c064230 2023-07-27T14:32:47.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb321bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c062320 con 0x7fb31c153e00 2023-07-27T14:32:47.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb321bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c064d60 con 0x7fb31c065de0 2023-07-27T14:32:47.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb31bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c065de0 0x7fb31c062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb31b7fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb31c153e00 0x7fb31c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb31bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c065de0 0x7fb31c062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:59638/0 (socket says 172.21.15.115:59638) 2023-07-27T14:32:47.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb31b7fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb31c153e00 0x7fb31c0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:51512/0 (socket says 172.21.15.115:51512) 2023-07-27T14:32:47.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb31bfff700 1 -- 172.21.15.115:0/3526068029 learned_addr learned my addr 172.21.15.115:0/3526068029 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:47.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.767+0000 7fb31affd700 1 --1- 172.21.15.115:0/3526068029 >> v1:172.21.15.159:6789/0 conn(0x7fb31c064230 0x7fb31c0656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:34994/0 (socket says 172.21.15.115:34994) 2023-07-27T14:32:47.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.768+0000 7fb31b7fe700 1 -- 172.21.15.115:0/3526068029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c065de0 msgr2=0x7fb31c062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:47.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.768+0000 7fb31b7fe700 1 --2- 172.21.15.115:0/3526068029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c065de0 0x7fb31c062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.768+0000 7fb31b7fe700 1 -- 172.21.15.115:0/3526068029 >> v1:172.21.15.159:6789/0 conn(0x7fb31c064230 legacy=0x7fb31c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.768+0000 7fb31b7fe700 1 -- 172.21.15.115:0/3526068029 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c065040 con 0x7fb31c153e00 2023-07-27T14:32:47.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.768+0000 7fb31b7fe700 1 --2- 172.21.15.115:0/3526068029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c153e00 0x7fb31c0c6b70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fb30c009760 tx=0x7fb30c009060).ready entity=mon.1 client_cookie=906bda486fe29224 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:47.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.768+0000 7fb31a7fc700 1 -- 172.21.15.115:0/3526068029 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c00f510 con 0x7fb31c153e00 2023-07-27T14:32:47.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.768+0000 7fb31a7fc700 1 -- 172.21.15.115:0/3526068029 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c00f670 con 0x7fb31c153e00 2023-07-27T14:32:47.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.768+0000 7fb31a7fc700 1 -- 172.21.15.115:0/3526068029 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c00f9f0 con 0x7fb31c153e00 2023-07-27T14:32:47.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.769+0000 7fb321bff700 1 -- 172.21.15.115:0/3526068029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c153e00 msgr2=0x7fb31c0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.769+0000 7fb321bff700 1 --2- 172.21.15.115:0/3526068029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c153e00 0x7fb31c0c6b70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fb30c009760 tx=0x7fb30c009060).stop 2023-07-27T14:32:47.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.769+0000 7fb321bff700 1 -- 172.21.15.115:0/3526068029 shutdown_connections 2023-07-27T14:32:47.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.769+0000 7fb321bff700 1 --2- 172.21.15.115:0/3526068029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c065de0 0x7fb31c062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.769+0000 7fb321bff700 1 --2- 172.21.15.115:0/3526068029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c153e00 0x7fb31c0c6b70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.769+0000 7fb321bff700 1 -- 172.21.15.115:0/3526068029 >> 172.21.15.115:0/3526068029 conn(0x7fb31c0c7b90 msgr2=0x7fb31c0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:47.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.769+0000 7fb321bff700 1 -- 172.21.15.115:0/3526068029 shutdown_connections 2023-07-27T14:32:47.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.769+0000 7fb321bff700 1 -- 172.21.15.115:0/3526068029 wait complete. 2023-07-27T14:32:47.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.770+0000 7fb321bff700 1 Processor -- start 2023-07-27T14:32:47.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.771+0000 7fb321bff700 1 -- start start 2023-07-27T14:32:47.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.771+0000 7fb321bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb31c064230 0x7fb31c0a7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.771+0000 7fb321bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c065de0 0x7fb31c0bc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.771+0000 7fb321bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c153e00 0x7fb31c14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.771+0000 7fb321bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0ace40 con 0x7fb31c064230 2023-07-27T14:32:47.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.771+0000 7fb321bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0919d0 con 0x7fb31c065de0 2023-07-27T14:32:47.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.771+0000 7fb321bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c091cb0 con 0x7fb31c153e00 2023-07-27T14:32:47.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb31c064230 0x7fb31c0a7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb31c064230 0x7fb31c0a7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46690/0 (socket says 172.21.15.115:46690) 2023-07-27T14:32:47.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 -- 172.21.15.115:0/3913772253 learned_addr learned my addr 172.21.15.115:0/3913772253 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:47.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31affd700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c065de0 0x7fb31c0bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 -- 172.21.15.115:0/3913772253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c153e00 msgr2=0x7fb31c14f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c153e00 0x7fb31c14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:47.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 -- 172.21.15.115:0/3913772253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c065de0 msgr2=0x7fb31c0bc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:47.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c065de0 0x7fb31c0bc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:47.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 -- 172.21.15.115:0/3913772253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0092a0 con 0x7fb31c064230 2023-07-27T14:32:47.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31affd700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c065de0 0x7fb31c0bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:47.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb31b7fe700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb31c064230 0x7fb31c0a7bc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fb30c011e50 tx=0x7fb30c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:47.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.772+0000 7fb3037fe700 1 -- 172.21.15.115:0/3913772253 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c00f9f0 con 0x7fb31c064230 2023-07-27T14:32:47.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.773+0000 7fb3037fe700 1 -- 172.21.15.115:0/3913772253 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c000c90 con 0x7fb31c064230 2023-07-27T14:32:47.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.773+0000 7fb3037fe700 1 -- 172.21.15.115:0/3913772253 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c01b660 con 0x7fb31c064230 2023-07-27T14:32:47.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.773+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c0a8530 con 0x7fb31c064230 2023-07-27T14:32:47.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.773+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c0a8af0 con 0x7fb31c064230 2023-07-27T14:32:47.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.774+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c06c470 con 0x7fb31c064230 2023-07-27T14:32:47.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.774+0000 7fb3037fe700 1 -- 172.21.15.115:0/3913772253 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7fb30c00f070 con 0x7fb31c064230 2023-07-27T14:32:47.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.775+0000 7fb3037fe700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f450 0x7fb308061910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:47.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.775+0000 7fb3037fe700 1 -- 172.21.15.115:0/3913772253 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb30c07bc60 con 0x7fb31c064230 2023-07-27T14:32:47.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.775+0000 7fb31affd700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f450 0x7fb308061910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:47.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.776+0000 7fb31affd700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f450 0x7fb308061910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fb31c162350 tx=0x7fb310009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:47.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.779+0000 7fb3037fe700 1 -- 172.21.15.115:0/3913772253 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb30c04ccb0 con 0x7fb31c064230 2023-07-27T14:32:48.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.978+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7fb31c065320 con 0x7fb30805f450 2023-07-27T14:32:48.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.985+0000 7fb3037fe700 1 -- 172.21.15.115:0/3913772253 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+713 (secure 0 0 0) 0x7fb31c065320 con 0x7fb30805f450 2023-07-27T14:32:48.023 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:32:48.023 INFO:teuthology.orchestra.run.smithi115.stdout: "atime": "2023-07-27 14:32:32", 2023-07-27T14:32:48.023 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_pcent": "undefined", 2023-07-27T14:32:48.023 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_quota": "infinite", 2023-07-27T14:32:48.024 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_used": 1048576, 2023-07-27T14:32:48.024 INFO:teuthology.orchestra.run.smithi115.stdout: "created_at": "2023-07-27 14:32:34", 2023-07-27T14:32:48.024 INFO:teuthology.orchestra.run.smithi115.stdout: "ctime": "2023-07-27 14:32:42", 2023-07-27T14:32:48.024 INFO:teuthology.orchestra.run.smithi115.stdout: "data_pool": "cephfs_data", 2023-07-27T14:32:48.024 INFO:teuthology.orchestra.run.smithi115.stdout: "features": [ 2023-07-27T14:32:48.024 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-clone", 2023-07-27T14:32:48.024 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-autoprotect", 2023-07-27T14:32:48.025 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-retention" 2023-07-27T14:32:48.025 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:32:48.025 INFO:teuthology.orchestra.run.smithi115.stdout: "gid": 0, 2023-07-27T14:32:48.025 INFO:teuthology.orchestra.run.smithi115.stdout: "mode": 16895, 2023-07-27T14:32:48.025 INFO:teuthology.orchestra.run.smithi115.stdout: "mon_addrs": [ 2023-07-27T14:32:48.025 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.115:6789", 2023-07-27T14:32:48.025 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6789", 2023-07-27T14:32:48.026 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6790" 2023-07-27T14:32:48.026 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:32:48.026 INFO:teuthology.orchestra.run.smithi115.stdout: "mtime": "2023-07-27 14:32:33", 2023-07-27T14:32:48.026 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/volumes/_nogroup/clone_0000000000272363/3baa67f6-0b8a-4a58-b692-8d05d112fda5", 2023-07-27T14:32:48.026 INFO:teuthology.orchestra.run.smithi115.stdout: "pool_namespace": "", 2023-07-27T14:32:48.026 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete", 2023-07-27T14:32:48.026 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "clone", 2023-07-27T14:32:48.026 INFO:teuthology.orchestra.run.smithi115.stdout: "uid": 0 2023-07-27T14:32:48.027 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:32:48.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f450 msgr2=0x7fb308061910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f450 0x7fb308061910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fb31c162350 tx=0x7fb310009040).stop 2023-07-27T14:32:48.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb31c064230 msgr2=0x7fb31c0a7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb31c064230 0x7fb31c0a7bc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fb30c011e50 tx=0x7fb30c017000).stop 2023-07-27T14:32:48.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 shutdown_connections 2023-07-27T14:32:48.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f450 0x7fb308061910 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb31c153e00 0x7fb31c14f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:48.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb31c064230 0x7fb31c0a7bc0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.987+0000 7fb321bff700 1 --2- 172.21.15.115:0/3913772253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb31c065de0 0x7fb31c0bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.988+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 >> 172.21.15.115:0/3913772253 conn(0x7fb31c0c7b90 msgr2=0x7fb31c0c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.988+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 shutdown_connections 2023-07-27T14:32:48.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:47.988+0000 7fb321bff700 1 -- 172.21.15.115:0/3913772253 wait complete. 2023-07-27T14:32:48.042 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000105917 2023-07-27T14:32:48.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.197+0000 7f76a61ff700 1 Processor -- start 2023-07-27T14:32:48.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.197+0000 7f76a61ff700 1 -- start start 2023-07-27T14:32:48.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f76a61ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f76a013a350 0x7f76a0065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f76a61ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f76a61ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00bd9a0 con 0x7f76a00c2fa0 2023-07-27T14:32:48.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f76a61ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a0066400 con 0x7f76a013a350 2023-07-27T14:32:48.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f76a61ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0158ae0 con 0x7f76a013a730 2023-07-27T14:32:48.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f769ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f76a00c2fa0 0x7f76a0067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51464/0 (socket says 172.21.15.115:51464) 2023-07-27T14:32:48.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f769f7fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f76a013a350 0x7f76a0065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f769ffff700 1 -- 172.21.15.115:0/2183505303 learned_addr learned my addr 172.21.15.115:0/2183505303 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:48.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.198+0000 7f769effd700 1 --2- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769e7fc700 1 -- 172.21.15.115:0/2183505303 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867261944 0 0) 0x7f76a00bd9a0 con 0x7f76a00c2fa0 2023-07-27T14:32:48.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769f7fe700 1 -- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 msgr2=0x7f76a01585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:48.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769f7fe700 1 --2- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a01585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769f7fe700 1 -- 172.21.15.115:0/2183505303 >> v1:172.21.15.115:6789/0 conn(0x7f76a00c2fa0 legacy=0x7f76a0067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769f7fe700 1 -- 172.21.15.115:0/2183505303 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0066610 con 0x7f76a013a350 2023-07-27T14:32:48.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769effd700 1 --2- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a01585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:48.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769f7fe700 1 --2- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 0x7f76a0065f10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f7690009760 tx=0x7f7690009060).ready entity=mon.1 client_cookie=fe9b352f051843e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:48.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769e7fc700 1 -- 172.21.15.115:0/2183505303 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769000f510 con 0x7f76a013a350 2023-07-27T14:32:48.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769e7fc700 1 -- 172.21.15.115:0/2183505303 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769000f670 con 0x7f76a013a350 2023-07-27T14:32:48.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.199+0000 7f769e7fc700 1 -- 172.21.15.115:0/2183505303 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769000f9f0 con 0x7f76a013a350 2023-07-27T14:32:48.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.200+0000 7f76a61ff700 1 -- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 msgr2=0x7f76a0065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.200+0000 7f76a61ff700 1 --2- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 0x7f76a0065f10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f7690009760 tx=0x7f7690009060).stop 2023-07-27T14:32:48.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.200+0000 7f76a61ff700 1 -- 172.21.15.115:0/2183505303 shutdown_connections 2023-07-27T14:32:48.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.200+0000 7f76a61ff700 1 --2- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 0x7f76a0065f10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.200+0000 7f76a61ff700 1 --2- 172.21.15.115:0/2183505303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a01585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.200+0000 7f76a61ff700 1 -- 172.21.15.115:0/2183505303 >> 172.21.15.115:0/2183505303 conn(0x7f76a005e8f0 msgr2=0x7f76a00c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:48.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.200+0000 7f76a61ff700 1 -- 172.21.15.115:0/2183505303 shutdown_connections 2023-07-27T14:32:48.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.200+0000 7f76a61ff700 1 -- 172.21.15.115:0/2183505303 wait complete. 2023-07-27T14:32:48.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.201+0000 7f76a61ff700 1 Processor -- start 2023-07-27T14:32:48.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.202+0000 7f76a61ff700 1 -- start start 2023-07-27T14:32:48.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.202+0000 7f76a61ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76a00c2fa0 0x7f76a01673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.202+0000 7f76a61ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 0x7f76a00a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f76a61ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a00a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f76a61ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01678a0 con 0x7f76a00c2fa0 2023-07-27T14:32:48.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f76a61ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00a9820 con 0x7f76a013a350 2023-07-27T14:32:48.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f76a61ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00c6b00 con 0x7f76a013a730 2023-07-27T14:32:48.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76a00c2fa0 0x7f76a01673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76a00c2fa0 0x7f76a01673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46696/0 (socket says 172.21.15.115:46696) 2023-07-27T14:32:48.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 -- 172.21.15.115:0/3551505921 learned_addr learned my addr 172.21.15.115:0/3551505921 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:48.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769ffff700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a00a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 -- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 msgr2=0x7f76a00a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769effd700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 0x7f76a00a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a00a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 -- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 msgr2=0x7f76a00a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 0x7f76a00a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 -- 172.21.15.115:0/3551505921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76940092a0 con 0x7f76a00c2fa0 2023-07-27T14:32:48.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769ffff700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a00a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:48.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769effd700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 0x7f76a00a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:48.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.203+0000 7f769f7fe700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76a00c2fa0 0x7f76a01673b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f7690009e00 tx=0x7f7690017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:48.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.204+0000 7f76877fe700 1 -- 172.21.15.115:0/3551505921 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76900117e0 con 0x7f76a00c2fa0 2023-07-27T14:32:48.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.204+0000 7f76877fe700 1 -- 172.21.15.115:0/3551505921 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690011960 con 0x7f76a00c2fa0 2023-07-27T14:32:48.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.204+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76900092a0 con 0x7f76a00c2fa0 2023-07-27T14:32:48.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.204+0000 7f76877fe700 1 -- 172.21.15.115:0/3551505921 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690011d20 con 0x7f76a00c2fa0 2023-07-27T14:32:48.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.204+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a00c61d0 con 0x7f76a00c2fa0 2023-07-27T14:32:48.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.205+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a006c470 con 0x7f76a00c2fa0 2023-07-27T14:32:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.205+0000 7f76877fe700 1 -- 172.21.15.115:0/3551505921 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7f769000f070 con 0x7f76a00c2fa0 2023-07-27T14:32:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.206+0000 7f76877fe700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f768c05f450 0x7f768c061910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.206+0000 7f76877fe700 1 -- 172.21.15.115:0/3551505921 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f769007b860 con 0x7f76a00c2fa0 2023-07-27T14:32:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.206+0000 7f769effd700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f768c05f450 0x7f768c061910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.207+0000 7f769effd700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f768c05f450 0x7f768c061910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f7694009270 tx=0x7f7694008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:48.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.210+0000 7f76877fe700 1 -- 172.21.15.115:0/3551505921 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f769004c630 con 0x7f76a00c2fa0 2023-07-27T14:32:48.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.409+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000105917", "target": ["mon-mgr", ""]}) v1 -- 0x7f76a00bdc10 con 0x7f768c05f450 2023-07-27T14:32:48.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.425+0000 7f76877fe700 1 -- 172.21.15.115:0/3551505921 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f76a00bdc10 con 0x7f768c05f450 2023-07-27T14:32:48.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f768c05f450 msgr2=0x7f768c061910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f768c05f450 0x7f768c061910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f7694009270 tx=0x7f7694008040).stop 2023-07-27T14:32:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76a00c2fa0 msgr2=0x7f76a01673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76a00c2fa0 0x7f76a01673b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f7690009e00 tx=0x7f7690017000).stop 2023-07-27T14:32:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 shutdown_connections 2023-07-27T14:32:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f768c05f450 0x7f768c061910 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f76a013a730 0x7f76a00a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76a00c2fa0 0x7f76a01673b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 --2- 172.21.15.115:0/3551505921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76a013a350 0x7f76a00a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.427+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 >> 172.21.15.115:0/3551505921 conn(0x7f76a005e8f0 msgr2=0x7f76a00ac430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.428+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 shutdown_connections 2023-07-27T14:32:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.428+0000 7f76a61ff700 1 -- 172.21.15.115:0/3551505921 wait complete. 2023-07-27T14:32:48.471 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.434+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.471 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.434+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.471 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.434+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.471 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.434+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.471 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.434+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.485 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000272363 2023-07-27T14:32:48.492 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.453+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.492 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.453+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.492 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.453+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.493 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.453+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.493 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:32:48.454+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:32:48.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.647+0000 7fc6eabff700 1 Processor -- start 2023-07-27T14:32:48.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.647+0000 7fc6eabff700 1 -- start start 2023-07-27T14:32:48.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.648+0000 7fc6eabff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6e4153e00 0x7fc6e40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.648+0000 7fc6eabff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e4064a80 con 0x7fc6e4065de0 2023-07-27T14:32:48.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.648+0000 7fc6eabff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e4064d60 con 0x7fc6e4064230 2023-07-27T14:32:48.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.648+0000 7fc6eabff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e4062320 con 0x7fc6e4153e00 2023-07-27T14:32:48.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e899b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6e4153e00 0x7fc6e40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e919c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc6e4065de0 0x7fc6e4062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51468/0 (socket says 172.21.15.115:51468) 2023-07-27T14:32:48.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e919c700 1 -- 172.21.15.115:0/256268282 learned_addr learned my addr 172.21.15.115:0/256268282 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:48.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e899b700 1 -- 172.21.15.115:0/256268282 >> v1:172.21.15.159:6789/0 conn(0x7fc6e4064230 legacy=0x7fc6e40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e899b700 1 -- 172.21.15.115:0/256268282 >> v1:172.21.15.115:6789/0 conn(0x7fc6e4065de0 legacy=0x7fc6e4062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e899b700 1 -- 172.21.15.115:0/256268282 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4065040 con 0x7fc6e4153e00 2023-07-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e37fe700 1 -- 172.21.15.115:0/256268282 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033159230 0 0) 0x7fc6e4064a80 con 0x7fc6e4065de0 2023-07-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e899b700 1 --2- 172.21.15.115:0/256268282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4153e00 0x7fc6e40c6b70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fc6d8009760 tx=0x7fc6d8009060).ready entity=mon.0 client_cookie=45748df3b855f0ba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.649+0000 7fc6e37fe700 1 -- 172.21.15.115:0/256268282 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800b580 con 0x7fc6e4153e00 2023-07-27T14:32:48.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6e37fe700 1 -- 172.21.15.115:0/256268282 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d800b6e0 con 0x7fc6e4153e00 2023-07-27T14:32:48.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6e37fe700 1 -- 172.21.15.115:0/256268282 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800ba60 con 0x7fc6e4153e00 2023-07-27T14:32:48.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6eabff700 1 -- 172.21.15.115:0/256268282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4153e00 msgr2=0x7fc6e40c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6eabff700 1 --2- 172.21.15.115:0/256268282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4153e00 0x7fc6e40c6b70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fc6d8009760 tx=0x7fc6d8009060).stop 2023-07-27T14:32:48.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6eabff700 1 -- 172.21.15.115:0/256268282 shutdown_connections 2023-07-27T14:32:48.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6eabff700 1 --2- 172.21.15.115:0/256268282 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4153e00 0x7fc6e40c6b70 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6eabff700 1 -- 172.21.15.115:0/256268282 >> 172.21.15.115:0/256268282 conn(0x7fc6e40c7b90 msgr2=0x7fc6e40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:48.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6eabff700 1 -- 172.21.15.115:0/256268282 shutdown_connections 2023-07-27T14:32:48.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.650+0000 7fc6eabff700 1 -- 172.21.15.115:0/256268282 wait complete. 2023-07-27T14:32:48.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.652+0000 7fc6eabff700 1 Processor -- start 2023-07-27T14:32:48.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.652+0000 7fc6eabff700 1 -- start start 2023-07-27T14:32:48.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6eabff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4064230 0x7fc6e4144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6eabff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e4065de0 0x7fc6e40aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6eabff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6e4153e00 0x7fc6e4093d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6eabff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4145430 con 0x7fc6e4064230 2023-07-27T14:32:48.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6eabff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4091d40 con 0x7fc6e4065de0 2023-07-27T14:32:48.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6eabff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40ac1d0 con 0x7fc6e4153e00 2023-07-27T14:32:48.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e899b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4064230 0x7fc6e4144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e899b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4064230 0x7fc6e4144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46764/0 (socket says 172.21.15.115:46764) 2023-07-27T14:32:48.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e899b700 1 -- 172.21.15.115:0/23517157 learned_addr learned my addr 172.21.15.115:0/23517157 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:48.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e919c700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6e4153e00 0x7fc6e4093d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e3fff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e4065de0 0x7fc6e40aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e899b700 1 -- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6e4153e00 msgr2=0x7fc6e4093d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e899b700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6e4153e00 0x7fc6e4093d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e899b700 1 -- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e4065de0 msgr2=0x7fc6e40aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e899b700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e4065de0 0x7fc6e40aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e899b700 1 -- 172.21.15.115:0/23517157 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80092a0 con 0x7fc6e4064230 2023-07-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e919c700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6e4153e00 0x7fc6e4093d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.653+0000 7fc6e3fff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e4065de0 0x7fc6e40aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.654+0000 7fc6e899b700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4064230 0x7fc6e4144f40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fc6d8009eb0 tx=0x7fc6d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.654+0000 7fc6e0ff9700 1 -- 172.21.15.115:0/23517157 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800ba60 con 0x7fc6e4064230 2023-07-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.654+0000 7fc6e0ff9700 1 -- 172.21.15.115:0/23517157 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8000c90 con 0x7fc6e4064230 2023-07-27T14:32:48.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.654+0000 7fc6e0ff9700 1 -- 172.21.15.115:0/23517157 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d801b670 con 0x7fc6e4064230 2023-07-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.654+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e40ac4b0 con 0x7fc6e4064230 2023-07-27T14:32:48.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.654+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e40919d0 con 0x7fc6e4064230 2023-07-27T14:32:48.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.655+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e406c470 con 0x7fc6e4064230 2023-07-27T14:32:48.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.656+0000 7fc6e0ff9700 1 -- 172.21.15.115:0/23517157 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 76202+0+0 (secure 0 0 0) 0x7fc6d802a070 con 0x7fc6e4064230 2023-07-27T14:32:48.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.657+0000 7fc6e0ff9700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6c805f450 0x7fc6c8061910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:48.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.657+0000 7fc6e0ff9700 1 -- 172.21.15.115:0/23517157 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc6d807be40 con 0x7fc6e4064230 2023-07-27T14:32:48.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.657+0000 7fc6e3fff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6c805f450 0x7fc6c8061910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:48.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.657+0000 7fc6e3fff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6c805f450 0x7fc6c8061910 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fc6e4152aa0 tx=0x7fc6d0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:48.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.660+0000 7fc6e0ff9700 1 -- 172.21.15.115:0/23517157 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6d804cc10 con 0x7fc6e4064230 2023-07-27T14:32:48.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.858+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000272363", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e4065320 con 0x7fc6c805f450 2023-07-27T14:32:48.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.882+0000 7fc6e0ff9700 1 -- 172.21.15.115:0/23517157 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc6e4065320 con 0x7fc6c805f450 2023-07-27T14:32:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6c805f450 msgr2=0x7fc6c8061910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6c805f450 0x7fc6c8061910 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fc6e4152aa0 tx=0x7fc6d0009040).stop 2023-07-27T14:32:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4064230 msgr2=0x7fc6e4144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4064230 0x7fc6e4144f40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fc6d8009eb0 tx=0x7fc6d8017000).stop 2023-07-27T14:32:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 shutdown_connections 2023-07-27T14:32:48.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6c805f450 0x7fc6c8061910 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6e4153e00 0x7fc6e4093d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e4064230 0x7fc6e4144f40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 --2- 172.21.15.115:0/23517157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6e4065de0 0x7fc6e40aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.884+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 >> 172.21.15.115:0/23517157 conn(0x7fc6e40c7b90 msgr2=0x7fc6e4152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.885+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 shutdown_connections 2023-07-27T14:32:48.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:48.885+0000 7fc6eabff700 1 -- 172.21.15.115:0/23517157 wait complete. 2023-07-27T14:32:48.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:32:48.943 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:32:49.033 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:32:49.034 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:32:49.034 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:32:49.140 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:32:49.254 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:32:49.255 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:32:49.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:32:49.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:32:49.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:32:49.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:49.344 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:32:49.391 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:32:49.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:32:49.392 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:32:49.489 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:32:49.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:32:49.490 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:32:49.537 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:49.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.688+0000 7f6574dff700 1 Processor -- start 2023-07-27T14:32:49.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.688+0000 7f6574dff700 1 -- start start 2023-07-27T14:32:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.690+0000 7f6574dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f65700aaa40 0x7f65700640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.690+0000 7f6574dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700aa4d0 con 0x7f6570153ec0 2023-07-27T14:32:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.690+0000 7f6574dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700c05c0 con 0x7f65701542a0 2023-07-27T14:32:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.690+0000 7f6574dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700aa270 con 0x7f65700aaa40 2023-07-27T14:32:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.691+0000 7f656e59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6570153ec0 0x7f65700a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51484/0 (socket says 172.21.15.115:51484) 2023-07-27T14:32:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.691+0000 7f656e59c700 1 -- 172.21.15.115:0/1797353053 learned_addr learned my addr 172.21.15.115:0/1797353053 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.691+0000 7f656dd9b700 1 --2- 172.21.15.115:0/1797353053 >> v2:172.21.15.159:3300/0 conn(0x7f65700aaa40 0x7f65700640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.692+0000 7f656dd9b700 1 -- 172.21.15.115:0/1797353053 >> v1:172.21.15.159:6789/0 conn(0x7f65701542a0 legacy=0x7f65700c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.692+0000 7f656dd9b700 1 -- 172.21.15.115:0/1797353053 >> v1:172.21.15.115:6789/0 conn(0x7f6570153ec0 legacy=0x7f65700a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.692+0000 7f656dd9b700 1 -- 172.21.15.115:0/1797353053 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700bfc90 con 0x7f65700aaa40 2023-07-27T14:32:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.692+0000 7f656dd9b700 1 --2- 172.21.15.115:0/1797353053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 0x7f65700640f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6564009760 tx=0x7f6564009060).ready entity=mon.1 client_cookie=9cfa06ffd1dd7290 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.692+0000 7f656d59a700 1 -- 172.21.15.115:0/1797353053 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400b580 con 0x7f65700aaa40 2023-07-27T14:32:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.692+0000 7f656d59a700 1 -- 172.21.15.115:0/1797353053 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656400b6e0 con 0x7f65700aaa40 2023-07-27T14:32:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.692+0000 7f656d59a700 1 -- 172.21.15.115:0/1797353053 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400ba60 con 0x7f65700aaa40 2023-07-27T14:32:49.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.693+0000 7f6574dff700 1 -- 172.21.15.115:0/1797353053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 msgr2=0x7f65700640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:49.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.693+0000 7f6574dff700 1 --2- 172.21.15.115:0/1797353053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 0x7f65700640f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6564009760 tx=0x7f6564009060).stop 2023-07-27T14:32:49.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.693+0000 7f6574dff700 1 -- 172.21.15.115:0/1797353053 shutdown_connections 2023-07-27T14:32:49.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.693+0000 7f6574dff700 1 --2- 172.21.15.115:0/1797353053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 0x7f65700640f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:49.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.693+0000 7f6574dff700 1 -- 172.21.15.115:0/1797353053 >> 172.21.15.115:0/1797353053 conn(0x7f65700cb610 msgr2=0x7f65700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:49.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.693+0000 7f6574dff700 1 -- 172.21.15.115:0/1797353053 shutdown_connections 2023-07-27T14:32:49.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.693+0000 7f6574dff700 1 -- 172.21.15.115:0/1797353053 wait complete. 2023-07-27T14:32:49.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.695+0000 7f6574dff700 1 Processor -- start 2023-07-27T14:32:49.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.695+0000 7f6574dff700 1 -- start start 2023-07-27T14:32:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f6574dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 0x7f65701524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f6574dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6570153ec0 0x7f65700b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f6574dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65701542a0 0x7f657014f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f6574dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570148550 con 0x7f65701542a0 2023-07-27T14:32:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f6574dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701682d0 con 0x7f65700aaa40 2023-07-27T14:32:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f6574dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b07d0 con 0x7f6570153ec0 2023-07-27T14:32:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f656ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65701542a0 0x7f657014f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f656ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65701542a0 0x7f657014f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46778/0 (socket says 172.21.15.115:46778) 2023-07-27T14:32:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f656ed9d700 1 -- 172.21.15.115:0/3003541691 learned_addr learned my addr 172.21.15.115:0/3003541691 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f656e59c700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 0x7f65701524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.696+0000 7f656dd9b700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6570153ec0 0x7f65700b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f656ed9d700 1 -- 172.21.15.115:0/3003541691 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6570153ec0 msgr2=0x7f65700b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f656ed9d700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6570153ec0 0x7f65700b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f656ed9d700 1 -- 172.21.15.115:0/3003541691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 msgr2=0x7f65701524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f656ed9d700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 0x7f65701524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f656ed9d700 1 -- 172.21.15.115:0/3003541691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640092a0 con 0x7f65701542a0 2023-07-27T14:32:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f656ed9d700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65701542a0 0x7f657014f210 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f656800c7f0 tx=0x7f65680014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f655e7fc700 1 -- 172.21.15.115:0/3003541691 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800e4a0 con 0x7f65701542a0 2023-07-27T14:32:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f655e7fc700 1 -- 172.21.15.115:0/3003541691 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800e600 con 0x7f65701542a0 2023-07-27T14:32:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6570152ba0 con 0x7f65701542a0 2023-07-27T14:32:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f655e7fc700 1 -- 172.21.15.115:0/3003541691 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800e9a0 con 0x7f65701542a0 2023-07-27T14:32:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.697+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6570167f60 con 0x7f65701542a0 2023-07-27T14:32:49.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.698+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657006c470 con 0x7f65701542a0 2023-07-27T14:32:49.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.699+0000 7f655e7fc700 1 -- 172.21.15.115:0/3003541691 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f6568010070 con 0x7f65701542a0 2023-07-27T14:32:49.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.700+0000 7f655e7fc700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655005f4e0 0x7f65500619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:49.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.700+0000 7f655e7fc700 1 -- 172.21.15.115:0/3003541691 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6568079cc0 con 0x7f65701542a0 2023-07-27T14:32:49.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.700+0000 7f656e59c700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655005f4e0 0x7f65500619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:49.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.701+0000 7f656e59c700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655005f4e0 0x7f65500619a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f65700abfb0 tx=0x7f6560007d30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:49.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.704+0000 7f655e7fc700 1 -- 172.21.15.115:0/3003541691 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f65680478f0 con 0x7f65701542a0 2023-07-27T14:32:49.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.918+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6570153710 con 0x7f65701542a0 2023-07-27T14:32:49.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.919+0000 7f655e7fc700 1 -- 172.21.15.115:0/3003541691 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f656804ab10 con 0x7f65701542a0 2023-07-27T14:32:49.956 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:49.956 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/291900736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":291900736},{"type":"v1","addr":"172.21.15.159:6834","nonce":291900736}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/469026388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":469026388},{"type":"v1","addr":"172.21.15.115:6837","nonce":469026388}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1581340296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":1581340296},{"type":"v1","addr":"172.21.15.159:6835","nonce":1581340296}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:32:22.297133+0000","modified":"2023-07-27T14:32:25.313130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1932712314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1932712314},{"type":"v1","addr":"172.21.15.115:6836","nonce":1932712314}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-07-27T14:32:49.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655005f4e0 msgr2=0x7f65500619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:49.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655005f4e0 0x7f65500619a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f65700abfb0 tx=0x7f6560007d30).stop 2023-07-27T14:32:49.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65701542a0 msgr2=0x7f657014f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:49.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65701542a0 0x7f657014f210 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f656800c7f0 tx=0x7f65680014e0).stop 2023-07-27T14:32:49.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 shutdown_connections 2023-07-27T14:32:49.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655005f4e0 0x7f65500619a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:49.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65701542a0 0x7f657014f210 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:49.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aaa40 0x7f65701524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:49.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 --2- 172.21.15.115:0/3003541691 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6570153ec0 0x7f65700b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:49.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 >> 172.21.15.115:0/3003541691 conn(0x7f65700cb610 msgr2=0x7f657014fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:49.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 shutdown_connections 2023-07-27T14:32:49.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:49.921+0000 7f6574dff700 1 -- 172.21.15.115:0/3003541691 wait complete. 2023-07-27T14:32:49.960 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 52 2023-07-27T14:32:49.975 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:50.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.125+0000 7f9e415ff700 1 Processor -- start 2023-07-27T14:32:50.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.125+0000 7f9e415ff700 1 -- start start 2023-07-27T14:32:50.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e415ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c151d70 0x7f9e3c155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e415ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9e3c065ff0 0x7f9e3c066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e415ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e3c066960 0x7f9e3c157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e415ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c063a90 con 0x7f9e3c066960 2023-07-27T14:32:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e415ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c067080 con 0x7f9e3c065ff0 2023-07-27T14:32:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e415ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c066e10 con 0x7f9e3c151d70 2023-07-27T14:32:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e3c066960 0x7f9e3c157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e3c066960 0x7f9e3c157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46780/0 (socket says 172.21.15.115:46780) 2023-07-27T14:32:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3b7fe700 1 -- 172.21.15.115:0/3979997334 learned_addr learned my addr 172.21.15.115:0/3979997334 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3affd700 1 --2- 172.21.15.115:0/3979997334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c151d70 0x7f9e3c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3a7fc700 1 --2- 172.21.15.115:0/3979997334 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c065ff0 0x7f9e3c066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3b7fe700 1 -- 172.21.15.115:0/3979997334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c151d70 msgr2=0x7f9e3c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3b7fe700 1 --2- 172.21.15.115:0/3979997334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c151d70 0x7f9e3c155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3b7fe700 1 -- 172.21.15.115:0/3979997334 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c065ff0 msgr2=0x7f9e3c066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3b7fe700 1 --2- 172.21.15.115:0/3979997334 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c065ff0 0x7f9e3c066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3b7fe700 1 -- 172.21.15.115:0/3979997334 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0634d0 con 0x7f9e3c066960 2023-07-27T14:32:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3affd700 1 --2- 172.21.15.115:0/3979997334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c151d70 0x7f9e3c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.127+0000 7f9e3a7fc700 1 --2- 172.21.15.115:0/3979997334 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c065ff0 0x7f9e3c066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e3b7fe700 1 --2- 172.21.15.115:0/3979997334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c066960 0x7f9e3c157bf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f9e3c060730 tx=0x7f9e34009840).ready entity=mon.0 client_cookie=4e71cc78e8885d0a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e39ffb700 1 -- 172.21.15.115:0/3979997334 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400e070 con 0x7f9e3c066960 2023-07-27T14:32:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e39ffb700 1 -- 172.21.15.115:0/3979997334 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3400ba50 con 0x7f9e3c066960 2023-07-27T14:32:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e39ffb700 1 -- 172.21.15.115:0/3979997334 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400bdd0 con 0x7f9e3c066960 2023-07-27T14:32:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e415ff700 1 -- 172.21.15.115:0/3979997334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c066960 msgr2=0x7f9e3c157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e415ff700 1 --2- 172.21.15.115:0/3979997334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c066960 0x7f9e3c157bf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f9e3c060730 tx=0x7f9e34009840).stop 2023-07-27T14:32:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e415ff700 1 -- 172.21.15.115:0/3979997334 shutdown_connections 2023-07-27T14:32:50.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e415ff700 1 --2- 172.21.15.115:0/3979997334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c066960 0x7f9e3c157bf0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e415ff700 1 --2- 172.21.15.115:0/3979997334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c151d70 0x7f9e3c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e415ff700 1 --2- 172.21.15.115:0/3979997334 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c065ff0 0x7f9e3c066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e415ff700 1 -- 172.21.15.115:0/3979997334 >> 172.21.15.115:0/3979997334 conn(0x7f9e3c0c89a0 msgr2=0x7f9e3c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:50.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.128+0000 7f9e415ff700 1 -- 172.21.15.115:0/3979997334 shutdown_connections 2023-07-27T14:32:50.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.129+0000 7f9e415ff700 1 -- 172.21.15.115:0/3979997334 wait complete. 2023-07-27T14:32:50.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.130+0000 7f9e415ff700 1 Processor -- start 2023-07-27T14:32:50.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.130+0000 7f9e415ff700 1 -- start start 2023-07-27T14:32:50.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e415ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c065ff0 0x7f9e3c14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e415ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c066960 0x7f9e3c1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e415ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c151d70 0x7f9e3c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e415ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c157040 con 0x7f9e3c065ff0 2023-07-27T14:32:50.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e415ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0c3a30 con 0x7f9e3c151d70 2023-07-27T14:32:50.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e415ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0c3100 con 0x7f9e3c066960 2023-07-27T14:32:50.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e3affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c065ff0 0x7f9e3c14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e3affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c065ff0 0x7f9e3c14a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46790/0 (socket says 172.21.15.115:46790) 2023-07-27T14:32:50.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.131+0000 7f9e3affd700 1 -- 172.21.15.115:0/1465741234 learned_addr learned my addr 172.21.15.115:0/1465741234 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:50.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3a7fc700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c066960 0x7f9e3c1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3b7fe700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c151d70 0x7f9e3c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3affd700 1 -- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c066960 msgr2=0x7f9e3c1565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3affd700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c066960 0x7f9e3c1565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3affd700 1 -- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c151d70 msgr2=0x7f9e3c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3affd700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c151d70 0x7f9e3c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3affd700 1 -- 172.21.15.115:0/1465741234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e34009ae0 con 0x7f9e3c065ff0 2023-07-27T14:32:50.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3a7fc700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c066960 0x7f9e3c1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:50.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3b7fe700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c151d70 0x7f9e3c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:50.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e3affd700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c065ff0 0x7f9e3c14a9c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f9e2c00d860 tx=0x7f9e2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e22ffd700 1 -- 172.21.15.115:0/1465741234 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0125f0 con 0x7f9e3c065ff0 2023-07-27T14:32:50.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e22ffd700 1 -- 172.21.15.115:0/1465741234 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c012750 con 0x7f9e3c065ff0 2023-07-27T14:32:50.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c0c33e0 con 0x7f9e3c065ff0 2023-07-27T14:32:50.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e22ffd700 1 -- 172.21.15.115:0/1465741234 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c012ad0 con 0x7f9e3c065ff0 2023-07-27T14:32:50.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.132+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c14aeb0 con 0x7f9e3c065ff0 2023-07-27T14:32:50.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.133+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c0c3d10 con 0x7f9e3c065ff0 2023-07-27T14:32:50.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.134+0000 7f9e22ffd700 1 -- 172.21.15.115:0/1465741234 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f9e2c013480 con 0x7f9e3c065ff0 2023-07-27T14:32:50.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.135+0000 7f9e22ffd700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2805f4e0 0x7f9e280619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.135+0000 7f9e22ffd700 1 -- 172.21.15.115:0/1465741234 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9e2c07aaa0 con 0x7f9e3c065ff0 2023-07-27T14:32:50.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.135+0000 7f9e3a7fc700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2805f4e0 0x7f9e280619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.136+0000 7f9e3a7fc700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2805f4e0 0x7f9e280619a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f9e3c1677a0 tx=0x7f9e30008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.139+0000 7f9e22ffd700 1 -- 172.21.15.115:0/1465741234 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e2c04b780 con 0x7f9e3c065ff0 2023-07-27T14:32:50.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.310+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e3c06c470 con 0x7f9e3c065ff0 2023-07-27T14:32:50.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.312+0000 7f9e22ffd700 1 -- 172.21.15.115:0/1465741234 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+17077 (secure 0 0 0) 0x7f9e2c04eda0 con 0x7f9e3c065ff0 2023-07-27T14:32:50.349 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:50.349 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":100,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:23.299831+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:32:20.631951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-27T14:32:21.280167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:50.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2805f4e0 msgr2=0x7f9e280619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2805f4e0 0x7f9e280619a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f9e3c1677a0 tx=0x7f9e30008040).stop 2023-07-27T14:32:50.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c065ff0 msgr2=0x7f9e3c14a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c065ff0 0x7f9e3c14a9c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f9e2c00d860 tx=0x7f9e2c008040).stop 2023-07-27T14:32:50.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 shutdown_connections 2023-07-27T14:32:50.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2805f4e0 0x7f9e280619a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c151d70 0x7f9e3c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c065ff0 0x7f9e3c14a9c0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 --2- 172.21.15.115:0/1465741234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c066960 0x7f9e3c1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 >> 172.21.15.115:0/1465741234 conn(0x7f9e3c0c89a0 msgr2=0x7f9e3c064f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:50.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 shutdown_connections 2023-07-27T14:32:50.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.314+0000 7f9e415ff700 1 -- 172.21.15.115:0/1465741234 wait complete. 2023-07-27T14:32:50.369 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:32:20.631951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:32:21.280167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:32:50.370 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:32:50.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.524+0000 7f4f583ff700 1 Processor -- start 2023-07-27T14:32:50.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.524+0000 7f4f583ff700 1 -- start start 2023-07-27T14:32:50.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.525+0000 7f4f583ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f500c36b0 0x7f4f50065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.525+0000 7f4f583ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f500bd9a0 con 0x7f4f5013a350 2023-07-27T14:32:50.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.525+0000 7f4f583ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f50066610 con 0x7f4f5013a730 2023-07-27T14:32:50.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.525+0000 7f4f583ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f50066400 con 0x7f4f500c36b0 2023-07-27T14:32:50.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.525+0000 7f4f5699c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f500c36b0 0x7f4f50065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.525+0000 7f4f5619b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4f5013a350 0x7f4f500c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51496/0 (socket says 172.21.15.115:51496) 2023-07-27T14:32:50.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.525+0000 7f4f5619b700 1 -- 172.21.15.115:0/485230911 learned_addr learned my addr 172.21.15.115:0/485230911 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:50.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.526+0000 7f4f5699c700 1 -- 172.21.15.115:0/485230911 >> v1:172.21.15.159:6789/0 conn(0x7f4f5013a730 legacy=0x7f4f500be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.526+0000 7f4f5699c700 1 -- 172.21.15.115:0/485230911 >> v1:172.21.15.115:6789/0 conn(0x7f4f5013a350 legacy=0x7f4f500c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.526+0000 7f4f5699c700 1 -- 172.21.15.115:0/485230911 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500bdc10 con 0x7f4f500c36b0 2023-07-27T14:32:50.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.526+0000 7f4f55199700 1 -- 172.21.15.115:0/485230911 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496166943 0 0) 0x7f4f500bd9a0 con 0x7f4f5013a350 2023-07-27T14:32:50.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.526+0000 7f4f5699c700 1 --2- 172.21.15.115:0/485230911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f50065f10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f4f48009e60 tx=0x7f4f48009780).ready entity=mon.0 client_cookie=38c1a8c40157d22c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.526+0000 7f4f55199700 1 -- 172.21.15.115:0/485230911 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4800e070 con 0x7f4f500c36b0 2023-07-27T14:32:50.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.526+0000 7f4f55199700 1 -- 172.21.15.115:0/485230911 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4800bc30 con 0x7f4f500c36b0 2023-07-27T14:32:50.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.526+0000 7f4f55199700 1 -- 172.21.15.115:0/485230911 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48012410 con 0x7f4f500c36b0 2023-07-27T14:32:50.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.527+0000 7f4f583ff700 1 -- 172.21.15.115:0/485230911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 msgr2=0x7f4f50065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.527+0000 7f4f583ff700 1 --2- 172.21.15.115:0/485230911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f50065f10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f4f48009e60 tx=0x7f4f48009780).stop 2023-07-27T14:32:50.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.527+0000 7f4f583ff700 1 -- 172.21.15.115:0/485230911 shutdown_connections 2023-07-27T14:32:50.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.527+0000 7f4f583ff700 1 --2- 172.21.15.115:0/485230911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f50065f10 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.527+0000 7f4f583ff700 1 -- 172.21.15.115:0/485230911 >> 172.21.15.115:0/485230911 conn(0x7f4f5005e8f0 msgr2=0x7f4f500c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:50.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.527+0000 7f4f583ff700 1 -- 172.21.15.115:0/485230911 shutdown_connections 2023-07-27T14:32:50.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.527+0000 7f4f583ff700 1 -- 172.21.15.115:0/485230911 wait complete. 2023-07-27T14:32:50.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.528+0000 7f4f583ff700 1 Processor -- start 2023-07-27T14:32:50.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.528+0000 7f4f583ff700 1 -- start start 2023-07-27T14:32:50.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.529+0000 7f4f583ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f500c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.529+0000 7f4f583ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f5013a350 0x7f4f50153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.529+0000 7f4f583ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f5013a730 0x7f4f500a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.529+0000 7f4f583ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500a7ff0 con 0x7f4f500c36b0 2023-07-27T14:32:50.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.529+0000 7f4f583ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f50155fa0 con 0x7f4f5013a350 2023-07-27T14:32:50.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.529+0000 7f4f583ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f50155670 con 0x7f4f5013a730 2023-07-27T14:32:50.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f500c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f500c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46812/0 (socket says 172.21.15.115:46812) 2023-07-27T14:32:50.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 -- 172.21.15.115:0/2816451781 learned_addr learned my addr 172.21.15.115:0/2816451781 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:50.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 -- 172.21.15.115:0/2816451781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f5013a730 msgr2=0x7f4f500a4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f5013a730 0x7f4f500a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:50.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 -- 172.21.15.115:0/2816451781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f5013a350 msgr2=0x7f4f50153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f5013a350 0x7f4f50153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:50.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 -- 172.21.15.115:0/2816451781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48009a20 con 0x7f4f500c36b0 2023-07-27T14:32:50.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f5619b700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f500c6290 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f4f4c00c4c0 tx=0x7f4f4c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f467fc700 1 -- 172.21.15.115:0/2816451781 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0072e0 con 0x7f4f500c36b0 2023-07-27T14:32:50.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f467fc700 1 -- 172.21.15.115:0/2816451781 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c007460 con 0x7f4f500c36b0 2023-07-27T14:32:50.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f467fc700 1 -- 172.21.15.115:0/2816451781 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0059f0 con 0x7f4f500c36b0 2023-07-27T14:32:50.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.530+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f50155950 con 0x7f4f500c36b0 2023-07-27T14:32:50.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.531+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f500c6780 con 0x7f4f500c36b0 2023-07-27T14:32:50.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.532+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5006c470 con 0x7f4f500c36b0 2023-07-27T14:32:50.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.532+0000 7f4f467fc700 1 -- 172.21.15.115:0/2816451781 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f4f4c010070 con 0x7f4f500c36b0 2023-07-27T14:32:50.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.533+0000 7f4f467fc700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f3405f4e0 0x7f4f340619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.533+0000 7f4f467fc700 1 -- 172.21.15.115:0/2816451781 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f4c079d10 con 0x7f4f500c36b0 2023-07-27T14:32:50.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.533+0000 7f4f5599a700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f3405f4e0 0x7f4f340619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.534+0000 7f4f5599a700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f3405f4e0 0x7f4f340619a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f4f500a4c40 tx=0x7f4f400079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.537+0000 7f4f467fc700 1 -- 172.21.15.115:0/2816451781 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f4c04ab60 con 0x7f4f500c36b0 2023-07-27T14:32:50.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.714+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4f500bdef0 con 0x7f4f500c36b0 2023-07-27T14:32:50.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.715+0000 7f4f467fc700 1 -- 172.21.15.115:0/2816451781 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v101) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4f4c04e180 con 0x7f4f500c36b0 2023-07-27T14:32:50.752 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:32:50.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f3405f4e0 msgr2=0x7f4f340619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f3405f4e0 0x7f4f340619a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f4f500a4c40 tx=0x7f4f400079c0).stop 2023-07-27T14:32:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 msgr2=0x7f4f500c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f500c6290 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f4f4c00c4c0 tx=0x7f4f4c007c10).stop 2023-07-27T14:32:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 shutdown_connections 2023-07-27T14:32:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4f3405f4e0 0x7f4f340619a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4f5013a730 0x7f4f500a4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f500c36b0 0x7f4f500c6290 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 --2- 172.21.15.115:0/2816451781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f5013a350 0x7f4f50153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 >> 172.21.15.115:0/2816451781 conn(0x7f4f5005e8f0 msgr2=0x7f4f500acc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 shutdown_connections 2023-07-27T14:32:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.717+0000 7f4f583ff700 1 -- 172.21.15.115:0/2816451781 wait complete. 2023-07-27T14:32:50.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:32:50.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.924+0000 7fcc417ff700 1 Processor -- start 2023-07-27T14:32:50.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.925+0000 7fcc417ff700 1 -- start start 2023-07-27T14:32:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.926+0000 7fcc417ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcc3c14b1e0 0x7fcc3c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.926+0000 7fcc417ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3c1553f0 con 0x7fcc3c063260 2023-07-27T14:32:50.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.926+0000 7fcc417ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3c157a50 con 0x7fcc3c14ae00 2023-07-27T14:32:50.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.926+0000 7fcc417ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c157d10 con 0x7fcc3c14b1e0 2023-07-27T14:32:50.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.926+0000 7fcc33fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcc3c063260 0x7fcc3c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51504/0 (socket says 172.21.15.115:51504) 2023-07-27T14:32:50.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.926+0000 7fcc33fff700 1 -- 172.21.15.115:0/1377234025 learned_addr learned my addr 172.21.15.115:0/1377234025 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:50.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.926+0000 7fcc3b7fe700 1 --2- 172.21.15.115:0/1377234025 >> v2:172.21.15.159:3300/0 conn(0x7fcc3c14b1e0 0x7fcc3c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844872874 0 0) 0x7fcc3c1553f0 con 0x7fcc3c063260 2023-07-27T14:32:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc280033f0 con 0x7fcc3c063260 2023-07-27T14:32:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358187761 0 0) 0x7fcc3c157a50 con 0x7fcc3c14ae00 2023-07-27T14:32:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc3c1553f0 con 0x7fcc3c14ae00 2023-07-27T14:32:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1480678176 0 0) 0x7fcc280033f0 con 0x7fcc3c063260 2023-07-27T14:32:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 >> v2:172.21.15.159:3300/0 conn(0x7fcc3c14b1e0 msgr2=0x7fcc3c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 --2- 172.21.15.115:0/1377234025 >> v2:172.21.15.159:3300/0 conn(0x7fcc3c14b1e0 0x7fcc3c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 >> v1:172.21.15.159:6789/0 conn(0x7fcc3c14ae00 legacy=0x7fcc3c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c157ff0 con 0x7fcc3c063260 2023-07-27T14:32:50.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fcc24001470 con 0x7fcc3c063260 2023-07-27T14:32:50.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 >> v1:172.21.15.115:6789/0 conn(0x7fcc3c063260 legacy=0x7fcc3c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28003a70 0x7fcc28003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc28004690 0x7fcc28004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc28005000 0x7fcc2800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c157d10 con 0x7fcc28004690 2023-07-27T14:32:50.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2800bf60 con 0x7fcc28003a70 2023-07-27T14:32:50.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2800c0d0 con 0x7fcc28005000 2023-07-27T14:32:50.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc33fff700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc28004690 0x7fcc28004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.927+0000 7fcc3affd700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28003a70 0x7fcc28003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc3b7fe700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc28005000 0x7fcc2800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc33fff700 1 -- 172.21.15.115:0/1377234025 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc28005000 msgr2=0x7fcc2800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:50.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc33fff700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc28005000 0x7fcc2800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc33fff700 1 -- 172.21.15.115:0/1377234025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28003a70 msgr2=0x7fcc28003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:50.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc33fff700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28003a70 0x7fcc28003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc33fff700 1 -- 172.21.15.115:0/1377234025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280033f0 con 0x7fcc28004690 2023-07-27T14:32:50.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc3b7fe700 1 -- 172.21.15.115:0/1377234025 reap_dead start 2023-07-27T14:32:50.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc33fff700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc28004690 0x7fcc28004b10 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7fcc2400c160 tx=0x7fcc24001e10).ready entity=mon.0 client_cookie=bd3d3a6a0899eff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400c9d0 con 0x7fcc28004690 2023-07-27T14:32:50.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2400cb30 con 0x7fcc28004690 2023-07-27T14:32:50.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.928+0000 7fcc3a7fc700 1 -- 172.21.15.115:0/1377234025 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc240070d0 con 0x7fcc28004690 2023-07-27T14:32:50.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.929+0000 7fcc417ff700 1 -- 172.21.15.115:0/1377234025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc28004690 msgr2=0x7fcc28004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.929+0000 7fcc417ff700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc28004690 0x7fcc28004b10 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7fcc2400c160 tx=0x7fcc24001e10).stop 2023-07-27T14:32:50.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.929+0000 7fcc417ff700 1 -- 172.21.15.115:0/1377234025 shutdown_connections 2023-07-27T14:32:50.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.929+0000 7fcc417ff700 1 --2- 172.21.15.115:0/1377234025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc28004690 0x7fcc28004b10 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.929+0000 7fcc417ff700 1 -- 172.21.15.115:0/1377234025 >> 172.21.15.115:0/1377234025 conn(0x7fcc3c05e940 msgr2=0x7fcc3c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:50.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.929+0000 7fcc417ff700 1 -- 172.21.15.115:0/1377234025 shutdown_connections 2023-07-27T14:32:50.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.929+0000 7fcc417ff700 1 -- 172.21.15.115:0/1377234025 wait complete. 2023-07-27T14:32:50.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.930+0000 7fcc417ff700 1 Processor -- start 2023-07-27T14:32:50.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.931+0000 7fcc417ff700 1 -- start start 2023-07-27T14:32:50.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.931+0000 7fcc417ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28004690 0x7fcc3c0c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.931+0000 7fcc417ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc3c0c3610 0x7fcc3c1495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.931+0000 7fcc417ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc3c155d40 0x7fcc3c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.931+0000 7fcc417ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c1558b0 con 0x7fcc3c0c3610 2023-07-27T14:32:50.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.931+0000 7fcc417ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c155580 con 0x7fcc28004690 2023-07-27T14:32:50.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.931+0000 7fcc417ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0c3b10 con 0x7fcc3c155d40 2023-07-27T14:32:50.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc3c0c3610 0x7fcc3c1495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc3c0c3610 0x7fcc3c1495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46834/0 (socket says 172.21.15.115:46834) 2023-07-27T14:32:50.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 -- 172.21.15.115:0/1378758009 learned_addr learned my addr 172.21.15.115:0/1378758009 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:50.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc3affd700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28004690 0x7fcc3c0c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc3b7fe700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc3c155d40 0x7fcc3c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 -- 172.21.15.115:0/1378758009 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc3c155d40 msgr2=0x7fcc3c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc3c155d40 0x7fcc3c156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 -- 172.21.15.115:0/1378758009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28004690 msgr2=0x7fcc3c0c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:50.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28004690 0x7fcc3c0c0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:50.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 -- 172.21.15.115:0/1378758009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0c3df0 con 0x7fcc3c0c3610 2023-07-27T14:32:50.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc33fff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc3c0c3610 0x7fcc3c1495c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fcc2400c750 tx=0x7fcc24015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc32ffd700 1 -- 172.21.15.115:0/1378758009 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24000bc0 con 0x7fcc3c0c3610 2023-07-27T14:32:50.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.932+0000 7fcc32ffd700 1 -- 172.21.15.115:0/1378758009 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc240046b0 con 0x7fcc3c0c3610 2023-07-27T14:32:50.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.933+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3c0c40d0 con 0x7fcc3c0c3610 2023-07-27T14:32:50.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.933+0000 7fcc32ffd700 1 -- 172.21.15.115:0/1378758009 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24000d20 con 0x7fcc3c0c3610 2023-07-27T14:32:50.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.933+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3c0c14e0 con 0x7fcc3c0c3610 2023-07-27T14:32:50.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.934+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3c155a60 con 0x7fcc3c0c3610 2023-07-27T14:32:50.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.934+0000 7fcc32ffd700 1 -- 172.21.15.115:0/1378758009 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fcc24027070 con 0x7fcc3c0c3610 2023-07-27T14:32:50.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.935+0000 7fcc32ffd700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc1c05f4e0 0x7fcc1c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:50.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.935+0000 7fcc32ffd700 1 -- 172.21.15.115:0/1378758009 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fcc2407afe0 con 0x7fcc3c0c3610 2023-07-27T14:32:50.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.935+0000 7fcc3affd700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc1c05f4e0 0x7fcc1c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:50.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.936+0000 7fcc3affd700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc1c05f4e0 0x7fcc1c0619a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fcc2c000f60 tx=0x7fcc2c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:50.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:50.939+0000 7fcc32ffd700 1 -- 172.21.15.115:0/1378758009 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc240a98f0 con 0x7fcc3c0c3610 2023-07-27T14:32:51.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.107+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc3c1558b0 con 0x7fcc3c0c3610 2023-07-27T14:32:51.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.107+0000 7fcc32ffd700 1 -- 172.21.15.115:0/1378758009 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v101) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc24025030 con 0x7fcc3c0c3610 2023-07-27T14:32:51.145 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:32:51.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc1c05f4e0 msgr2=0x7fcc1c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc1c05f4e0 0x7fcc1c0619a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fcc2c000f60 tx=0x7fcc2c009040).stop 2023-07-27T14:32:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc3c0c3610 msgr2=0x7fcc3c1495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc3c0c3610 0x7fcc3c1495c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fcc2400c750 tx=0x7fcc24015000).stop 2023-07-27T14:32:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 shutdown_connections 2023-07-27T14:32:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcc1c05f4e0 0x7fcc1c0619a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcc3c155d40 0x7fcc3c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc28004690 0x7fcc3c0c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 --2- 172.21.15.115:0/1378758009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc3c0c3610 0x7fcc3c1495c0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 >> 172.21.15.115:0/1378758009 conn(0x7fcc3c05e940 msgr2=0x7fcc3c14a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 shutdown_connections 2023-07-27T14:32:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.110+0000 7fcc417ff700 1 -- 172.21.15.115:0/1378758009 wait complete. 2023-07-27T14:32:51.164 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:32:51.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.318+0000 7f523cbff700 1 Processor -- start 2023-07-27T14:32:51.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.318+0000 7f523cbff700 1 -- start start 2023-07-27T14:32:51.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.319+0000 7f523cbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f523814ae00 0x7f5238154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.319+0000 7f523cbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52381553f0 con 0x7f523814b1e0 2023-07-27T14:32:51.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.319+0000 7f523cbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5238157a50 con 0x7f5238063260 2023-07-27T14:32:51.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.319+0000 7f523cbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5238157d10 con 0x7f523814ae00 2023-07-27T14:32:51.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.320+0000 7f523659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f523814ae00 0x7f5238154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.320+0000 7f523659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f523814ae00 0x7f5238154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46838/0 (socket says 172.21.15.115:46838) 2023-07-27T14:32:51.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.320+0000 7f523659c700 1 -- 172.21.15.115:0/336445790 learned_addr learned my addr 172.21.15.115:0/336445790 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:51.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.320+0000 7f523659c700 1 -- 172.21.15.115:0/336445790 >> v1:172.21.15.159:6789/0 conn(0x7f5238063260 legacy=0x7f52380a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.320+0000 7f523659c700 1 -- 172.21.15.115:0/336445790 >> v1:172.21.15.115:6789/0 conn(0x7f523814b1e0 legacy=0x7f5238062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.320+0000 7f523659c700 1 -- 172.21.15.115:0/336445790 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238157ff0 con 0x7f523814ae00 2023-07-27T14:32:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.320+0000 7f523559a700 1 -- 172.21.15.115:0/336445790 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364221165 0 0) 0x7f52381553f0 con 0x7f523814b1e0 2023-07-27T14:32:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.320+0000 7f523659c700 1 --2- 172.21.15.115:0/336445790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 0x7f5238154f00 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f5228006fd0 tx=0x7f52280090f0).ready entity=mon.0 client_cookie=eeca668798fcc0be server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.321+0000 7f523559a700 1 -- 172.21.15.115:0/336445790 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800b600 con 0x7f523814ae00 2023-07-27T14:32:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.321+0000 7f523559a700 1 -- 172.21.15.115:0/336445790 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800b760 con 0x7f523814ae00 2023-07-27T14:32:51.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.321+0000 7f523559a700 1 -- 172.21.15.115:0/336445790 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800bae0 con 0x7f523814ae00 2023-07-27T14:32:51.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.321+0000 7f523cbff700 1 -- 172.21.15.115:0/336445790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 msgr2=0x7f5238154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.321+0000 7f523cbff700 1 --2- 172.21.15.115:0/336445790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 0x7f5238154f00 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f5228006fd0 tx=0x7f52280090f0).stop 2023-07-27T14:32:51.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.321+0000 7f523cbff700 1 -- 172.21.15.115:0/336445790 shutdown_connections 2023-07-27T14:32:51.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.321+0000 7f523cbff700 1 --2- 172.21.15.115:0/336445790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 0x7f5238154f00 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.321+0000 7f523cbff700 1 -- 172.21.15.115:0/336445790 >> 172.21.15.115:0/336445790 conn(0x7f523805e940 msgr2=0x7f52380cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.322+0000 7f523cbff700 1 -- 172.21.15.115:0/336445790 shutdown_connections 2023-07-27T14:32:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.322+0000 7f523cbff700 1 -- 172.21.15.115:0/336445790 wait complete. 2023-07-27T14:32:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.324+0000 7f523cbff700 1 Processor -- start 2023-07-27T14:32:51.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.324+0000 7f523cbff700 1 -- start start 2023-07-27T14:32:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.325+0000 7f523cbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5238063260 0x7f5238149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.325+0000 7f523cbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 0x7f52380c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.325+0000 7f523cbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f523814b1e0 0x7f5238152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.325+0000 7f523cbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380c9990 con 0x7f523814ae00 2023-07-27T14:32:51.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.325+0000 7f523cbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523814c3e0 con 0x7f5238063260 2023-07-27T14:32:51.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.325+0000 7f523cbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380c43b0 con 0x7f523814b1e0 2023-07-27T14:32:51.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f523659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5238063260 0x7f5238149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f5235d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 0x7f52380c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f523659c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5238063260 0x7f5238149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:51680/0 (socket says 172.21.15.115:51680) 2023-07-27T14:32:51.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f523659c700 1 -- 172.21.15.115:0/1714781083 learned_addr learned my addr 172.21.15.115:0/1714781083 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:51.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f5236d9d700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f523814b1e0 0x7f5238152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f5235d9b700 1 -- 172.21.15.115:0/1714781083 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f523814b1e0 msgr2=0x7f5238152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f5235d9b700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f523814b1e0 0x7f5238152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f5235d9b700 1 -- 172.21.15.115:0/1714781083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5238063260 msgr2=0x7f5238149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f5235d9b700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5238063260 0x7f5238149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.326+0000 7f5235d9b700 1 -- 172.21.15.115:0/1714781083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228009370 con 0x7f523814ae00 2023-07-27T14:32:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.327+0000 7f5235d9b700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 0x7f52380c3a60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f523814b5e0 tx=0x7f522c007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.327+0000 7f52267fc700 1 -- 172.21.15.115:0/1714781083 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c012400 con 0x7f523814ae00 2023-07-27T14:32:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.327+0000 7f52267fc700 1 -- 172.21.15.115:0/1714781083 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c012580 con 0x7f523814ae00 2023-07-27T14:32:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.327+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52380c9be0 con 0x7f523814ae00 2023-07-27T14:32:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.327+0000 7f52267fc700 1 -- 172.21.15.115:0/1714781083 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c012940 con 0x7f523814ae00 2023-07-27T14:32:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.327+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52380ca1a0 con 0x7f523814ae00 2023-07-27T14:32:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.328+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523806c470 con 0x7f523814ae00 2023-07-27T14:32:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.329+0000 7f52267fc700 1 -- 172.21.15.115:0/1714781083 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f522c019030 con 0x7f523814ae00 2023-07-27T14:32:51.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.330+0000 7f52267fc700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f521805f4b0 0x7f5218061970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.330+0000 7f52267fc700 1 -- 172.21.15.115:0/1714781083 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f522c079df0 con 0x7f523814ae00 2023-07-27T14:32:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.330+0000 7f523659c700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f521805f4b0 0x7f5218061970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.330+0000 7f523659c700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f521805f4b0 0x7f5218061970 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f522800b3c0 tx=0x7f5228017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:51.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.334+0000 7f52267fc700 1 -- 172.21.15.115:0/1714781083 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f522c04aaa0 con 0x7f523814ae00 2023-07-27T14:32:51.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.502+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52380c06b0 con 0x7f523814ae00 2023-07-27T14:32:51.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.502+0000 7f52267fc700 1 -- 172.21.15.115:0/1714781083 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) v1 ==== 104+0+11 (secure 0 0 0) 0x7f522c017020 con 0x7f523814ae00 2023-07-27T14:32:51.540 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:32:51.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f521805f4b0 msgr2=0x7f5218061970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f521805f4b0 0x7f5218061970 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f522800b3c0 tx=0x7f5228017000).stop 2023-07-27T14:32:51.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 msgr2=0x7f52380c3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 0x7f52380c3a60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f523814b5e0 tx=0x7f522c007b60).stop 2023-07-27T14:32:51.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 shutdown_connections 2023-07-27T14:32:51.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f521805f4b0 0x7f5218061970 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f523814b1e0 0x7f5238152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5238063260 0x7f5238149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 --2- 172.21.15.115:0/1714781083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f523814ae00 0x7f52380c3a60 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.504+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 >> 172.21.15.115:0/1714781083 conn(0x7f523805e940 msgr2=0x7f523814a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:51.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.505+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 shutdown_connections 2023-07-27T14:32:51.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.505+0000 7f523cbff700 1 -- 172.21.15.115:0/1714781083 wait complete. 2023-07-27T14:32:51.559 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:32:51.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.722+0000 7f59b09ff700 1 Processor -- start 2023-07-27T14:32:51.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.722+0000 7f59b09ff700 1 -- start start 2023-07-27T14:32:51.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.723+0000 7f59b09ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f59ac14ae00 0x7f59ac154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.723+0000 7f59b09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac063260 0x7f59ac0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.723+0000 7f59b09ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ac1553f0 con 0x7f59ac14b1e0 2023-07-27T14:32:51.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.723+0000 7f59b09ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ac157a50 con 0x7f59ac14ae00 2023-07-27T14:32:51.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.723+0000 7f59b09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac157d10 con 0x7f59ac063260 2023-07-27T14:32:51.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.723+0000 7f59a9d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f59ac14b1e0 0x7f59ac062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51528/0 (socket says 172.21.15.115:51528) 2023-07-27T14:32:51.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a9d9b700 1 -- 172.21.15.115:0/1363994512 learned_addr learned my addr 172.21.15.115:0/1363994512 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:51.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150202697 0 0) 0x7f59ac1553f0 con 0x7f59ac14b1e0 2023-07-27T14:32:51.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59940033f0 con 0x7f59ac14b1e0 2023-07-27T14:32:51.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59aa59c700 1 --2- 172.21.15.115:0/1363994512 >> v2:172.21.15.159:3300/0 conn(0x7f59ac14ae00 0x7f59ac154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59aad9d700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac063260 0x7f59ac0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3313943747 0 0) 0x7f59940033f0 con 0x7f59ac14b1e0 2023-07-27T14:32:51.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac063260 msgr2=0x7f59ac0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:51.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac063260 0x7f59ac0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 >> v2:172.21.15.159:3300/0 conn(0x7f59ac14ae00 msgr2=0x7f59ac154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:51.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 --2- 172.21.15.115:0/1363994512 >> v2:172.21.15.159:3300/0 conn(0x7f59ac14ae00 0x7f59ac154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac157ff0 con 0x7f59ac14b1e0 2023-07-27T14:32:51.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f59a0001470 con 0x7f59ac14b1e0 2023-07-27T14:32:51.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59aa59c700 1 --2- 172.21.15.115:0/1363994512 >> v2:172.21.15.159:3300/0 conn(0x7f59ac14ae00 0x7f59ac154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:51.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 >> v1:172.21.15.115:6789/0 conn(0x7f59ac14b1e0 legacy=0x7f59ac062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59940038e0 0x7f5994003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f5994004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac063260 0x7f5994005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac157a50 con 0x7f5994004690 2023-07-27T14:32:51.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac157d10 con 0x7f59940038e0 2023-07-27T14:32:51.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.724+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599400b960 con 0x7f59ac063260 2023-07-27T14:32:51.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a9d9b700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f5994004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59aa59c700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59940038e0 0x7f5994003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59aad9d700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac063260 0x7f5994005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a9d9b700 1 -- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac063260 msgr2=0x7f5994005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:51.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a9d9b700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac063260 0x7f5994005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a9d9b700 1 -- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59940038e0 msgr2=0x7f5994003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:51.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a9d9b700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59940038e0 0x7f5994003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a9d9b700 1 -- 172.21.15.115:0/1363994512 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940033f0 con 0x7f5994004690 2023-07-27T14:32:51.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59aa59c700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59940038e0 0x7f5994003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:51.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a9d9b700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f5994004b10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f59a000c1e0 tx=0x7f59a0001e90).ready entity=mon.0 client_cookie=ef5414b8b4ec2e75 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:51.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0007a60 con 0x7f5994004690 2023-07-27T14:32:51.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a000cab0 con 0x7f5994004690 2023-07-27T14:32:51.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.725+0000 7f59a959a700 1 -- 172.21.15.115:0/1363994512 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a000ce50 con 0x7f5994004690 2023-07-27T14:32:51.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.726+0000 7f59b09ff700 1 -- 172.21.15.115:0/1363994512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 msgr2=0x7f5994004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.726+0000 7f59b09ff700 1 --2- 172.21.15.115:0/1363994512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f5994004b10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f59a000c1e0 tx=0x7f59a0001e90).stop 2023-07-27T14:32:51.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.726+0000 7f59aad9d700 1 -- 172.21.15.115:0/1363994512 reap_dead start 2023-07-27T14:32:51.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.726+0000 7f59b09ff700 1 -- 172.21.15.115:0/1363994512 shutdown_connections 2023-07-27T14:32:51.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.726+0000 7f59b09ff700 1 -- 172.21.15.115:0/1363994512 >> 172.21.15.115:0/1363994512 conn(0x7f59ac05e940 msgr2=0x7f59ac0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:51.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.726+0000 7f59b09ff700 1 -- 172.21.15.115:0/1363994512 shutdown_connections 2023-07-27T14:32:51.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.726+0000 7f59b09ff700 1 -- 172.21.15.115:0/1363994512 wait complete. 2023-07-27T14:32:51.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.728+0000 7f59b09ff700 1 Processor -- start 2023-07-27T14:32:51.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.728+0000 7f59b09ff700 1 -- start start 2023-07-27T14:32:51.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.729+0000 7f59b09ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f59ac0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.729+0000 7f59b09ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59ac0af8d0 0x7f59ac1673f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.729+0000 7f59b09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac0afd50 0x7f59ac1678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.729+0000 7f59b09ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac167dd0 con 0x7f5994004690 2023-07-27T14:32:51.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.729+0000 7f59b09ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac155640 con 0x7f59ac0af8d0 2023-07-27T14:32:51.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.729+0000 7f59b09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac0b02b0 con 0x7f59ac0afd50 2023-07-27T14:32:51.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f59ac0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f59ac0c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46870/0 (socket says 172.21.15.115:46870) 2023-07-27T14:32:51.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 -- 172.21.15.115:0/2482413560 learned_addr learned my addr 172.21.15.115:0/2482413560 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59a9d9b700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59ac0af8d0 0x7f59ac1673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aad9d700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac0afd50 0x7f59ac1678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 -- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac0afd50 msgr2=0x7f59ac1678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac0afd50 0x7f59ac1678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 -- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59ac0af8d0 msgr2=0x7f59ac1673f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59ac0af8d0 0x7f59ac1673f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 -- 172.21.15.115:0/2482413560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0b0590 con 0x7f5994004690 2023-07-27T14:32:51.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aad9d700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac0afd50 0x7f59ac1678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:51.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f59aa59c700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f59ac0c4570 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f599c010d00 tx=0x7f599c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:51.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.730+0000 7f599a7fc700 1 -- 172.21.15.115:0/2482413560 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00ea50 con 0x7f5994004690 2023-07-27T14:32:51.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.731+0000 7f599a7fc700 1 -- 172.21.15.115:0/2482413560 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00ebb0 con 0x7f5994004690 2023-07-27T14:32:51.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.731+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ac0b0870 con 0x7f5994004690 2023-07-27T14:32:51.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.731+0000 7f599a7fc700 1 -- 172.21.15.115:0/2482413560 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c014470 con 0x7f5994004690 2023-07-27T14:32:51.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.731+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ac0c4a60 con 0x7f5994004690 2023-07-27T14:32:51.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.732+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ac0ad090 con 0x7f5994004690 2023-07-27T14:32:51.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.733+0000 7f599a7fc700 1 -- 172.21.15.115:0/2482413560 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f599c014860 con 0x7f5994004690 2023-07-27T14:32:51.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.733+0000 7f599a7fc700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f598c05f4e0 0x7f598c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:51.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.733+0000 7f599a7fc700 1 -- 172.21.15.115:0/2482413560 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f599c07b2d0 con 0x7f5994004690 2023-07-27T14:32:51.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.734+0000 7f59a9d9b700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f598c05f4e0 0x7f598c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:51.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.734+0000 7f59a9d9b700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f598c05f4e0 0x7f598c0619a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f59a0001ed0 tx=0x7f59a0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:51.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.738+0000 7f599a7fc700 1 -- 172.21.15.115:0/2482413560 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f599c04c050 con 0x7f5994004690 2023-07-27T14:32:51.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.908+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59ac06c470 con 0x7f5994004690 2023-07-27T14:32:51.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.909+0000 7f599a7fc700 1 -- 172.21.15.115:0/2482413560 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7f599c01b310 con 0x7f5994004690 2023-07-27T14:32:51.946 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:32:51.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.910+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f598c05f4e0 msgr2=0x7f598c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.910+0000 7f59b09ff700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f598c05f4e0 0x7f598c0619a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f59a0001ed0 tx=0x7f59a0015000).stop 2023-07-27T14:32:51.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 msgr2=0x7f59ac0c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:51.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f59ac0c4570 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f599c010d00 tx=0x7f599c008040).stop 2023-07-27T14:32:51.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 shutdown_connections 2023-07-27T14:32:51.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f598c05f4e0 0x7f598c0619a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f59ac0afd50 0x7f59ac1678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5994004690 0x7f59ac0c4570 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 --2- 172.21.15.115:0/2482413560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59ac0af8d0 0x7f59ac1673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:51.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 >> 172.21.15.115:0/2482413560 conn(0x7f59ac05e940 msgr2=0x7f59ac0ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:51.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 shutdown_connections 2023-07-27T14:32:51.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:51.911+0000 7f59b09ff700 1 -- 172.21.15.115:0/2482413560 wait complete. 2023-07-27T14:32:51.965 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.122+0000 7f836d1ff700 1 Processor -- start 2023-07-27T14:32:52.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.123+0000 7f836d1ff700 1 -- start start 2023-07-27T14:32:52.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836d1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8368151bd0 0x7f8368062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836d1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8368062810 0x7f83680a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 0x7f8368157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836d1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8368137610 con 0x7f8368062810 2023-07-27T14:32:52.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836d1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83680639d0 con 0x7f8368151bd0 2023-07-27T14:32:52.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83680a51c0 con 0x7f83680a4d30 2023-07-27T14:32:52.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8368062810 0x7f83680a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8368062810 0x7f83680a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46876/0 (socket says 172.21.15.115:46876) 2023-07-27T14:32:52.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836659c700 1 -- 172.21.15.115:0/4280525453 learned_addr learned my addr 172.21.15.115:0/4280525453 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:52.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.124+0000 7f836759e700 1 --2- 172.21.15.115:0/4280525453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 0x7f8368157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f8366d9d700 1 --2- 172.21.15.115:0/4280525453 >> v2:172.21.15.159:3300/0 conn(0x7f8368151bd0 0x7f8368062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f836659c700 1 -- 172.21.15.115:0/4280525453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 msgr2=0x7f8368157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:52.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f836659c700 1 --2- 172.21.15.115:0/4280525453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 0x7f8368157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f836659c700 1 -- 172.21.15.115:0/4280525453 >> v2:172.21.15.159:3300/0 conn(0x7f8368151bd0 msgr2=0x7f8368062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:52.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f836659c700 1 --2- 172.21.15.115:0/4280525453 >> v2:172.21.15.159:3300/0 conn(0x7f8368151bd0 0x7f8368062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f836659c700 1 -- 172.21.15.115:0/4280525453 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368062dc0 con 0x7f8368062810 2023-07-27T14:32:52.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f8366d9d700 1 --2- 172.21.15.115:0/4280525453 >> v2:172.21.15.159:3300/0 conn(0x7f8368151bd0 0x7f8368062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:52.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f836659c700 1 --2- 172.21.15.115:0/4280525453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368062810 0x7f83680a4840 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f8368066fb0 tx=0x7f835c0090f0).ready entity=mon.0 client_cookie=39d08396e99d0d40 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:52.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f8365d9b700 1 -- 172.21.15.115:0/4280525453 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00b600 con 0x7f8368062810 2023-07-27T14:32:52.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f8365d9b700 1 -- 172.21.15.115:0/4280525453 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00b760 con 0x7f8368062810 2023-07-27T14:32:52.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f8365d9b700 1 -- 172.21.15.115:0/4280525453 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00bae0 con 0x7f8368062810 2023-07-27T14:32:52.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f836d1ff700 1 -- 172.21.15.115:0/4280525453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368062810 msgr2=0x7f83680a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.125+0000 7f836d1ff700 1 --2- 172.21.15.115:0/4280525453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368062810 0x7f83680a4840 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f8368066fb0 tx=0x7f835c0090f0).stop 2023-07-27T14:32:52.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.126+0000 7f836d1ff700 1 -- 172.21.15.115:0/4280525453 shutdown_connections 2023-07-27T14:32:52.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.126+0000 7f836d1ff700 1 --2- 172.21.15.115:0/4280525453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 0x7f8368157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.126+0000 7f836d1ff700 1 --2- 172.21.15.115:0/4280525453 >> v2:172.21.15.159:3300/0 conn(0x7f8368151bd0 0x7f8368062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.126+0000 7f836d1ff700 1 --2- 172.21.15.115:0/4280525453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368062810 0x7f83680a4840 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.126+0000 7f836d1ff700 1 -- 172.21.15.115:0/4280525453 >> 172.21.15.115:0/4280525453 conn(0x7f8368064700 msgr2=0x7f8368064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:52.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.126+0000 7f836d1ff700 1 -- 172.21.15.115:0/4280525453 shutdown_connections 2023-07-27T14:32:52.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.126+0000 7f836d1ff700 1 -- 172.21.15.115:0/4280525453 wait complete. 2023-07-27T14:32:52.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.127+0000 7f836d1ff700 1 Processor -- start 2023-07-27T14:32:52.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.127+0000 7f836d1ff700 1 -- start start 2023-07-27T14:32:52.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836d1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8368062810 0x7f8368135e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 0x7f8368068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836d1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368151bd0 0x7f836806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836d1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8368068b00 con 0x7f8368151bd0 2023-07-27T14:32:52.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836d1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8368138770 con 0x7f8368062810 2023-07-27T14:32:52.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836806aaa0 con 0x7f83680a4d30 2023-07-27T14:32:52.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368151bd0 0x7f836806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368151bd0 0x7f836806a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46880/0 (socket says 172.21.15.115:46880) 2023-07-27T14:32:52.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.128+0000 7f836759e700 1 -- 172.21.15.115:0/2267064718 learned_addr learned my addr 172.21.15.115:0/2267064718 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:52.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f8366d9d700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8368062810 0x7f8368135e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836659c700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 0x7f8368068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836759e700 1 -- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 msgr2=0x7f8368068610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836759e700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 0x7f8368068610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836759e700 1 -- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8368062810 msgr2=0x7f8368135e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836759e700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8368062810 0x7f8368135e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836759e700 1 -- 172.21.15.115:0/2267064718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c009370 con 0x7f8368151bd0 2023-07-27T14:32:52.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f8366d9d700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8368062810 0x7f8368135e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:52.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836759e700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368151bd0 0x7f836806a5b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f8360009fd0 tx=0x7f8360009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:52.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f834effd700 1 -- 172.21.15.115:0/2267064718 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836000eca0 con 0x7f8368151bd0 2023-07-27T14:32:52.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f834effd700 1 -- 172.21.15.115:0/2267064718 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836000ee00 con 0x7f8368151bd0 2023-07-27T14:32:52.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f834effd700 1 -- 172.21.15.115:0/2267064718 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360014610 con 0x7f8368151bd0 2023-07-27T14:32:52.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8368068cf0 con 0x7f8368151bd0 2023-07-27T14:32:52.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.129+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83680692b0 con 0x7f8368151bd0 2023-07-27T14:32:52.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.130+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8368138900 con 0x7f8368151bd0 2023-07-27T14:32:52.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.131+0000 7f834effd700 1 -- 172.21.15.115:0/2267064718 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f836001b030 con 0x7f8368151bd0 2023-07-27T14:32:52.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.132+0000 7f834effd700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f835405f4e0 0x7f83540619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.132+0000 7f834effd700 1 -- 172.21.15.115:0/2267064718 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f836007ac80 con 0x7f8368151bd0 2023-07-27T14:32:52.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.132+0000 7f8366d9d700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f835405f4e0 0x7f83540619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.133+0000 7f8366d9d700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f835405f4e0 0x7f83540619a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f835800aa90 tx=0x7f8358008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:52.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.136+0000 7f834effd700 1 -- 172.21.15.115:0/2267064718 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f836004b890 con 0x7f8368151bd0 2023-07-27T14:32:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.347+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83680c6d10 con 0x7f8368151bd0 2023-07-27T14:32:52.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.348+0000 7f834effd700 1 -- 172.21.15.115:0/2267064718 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f836004eeb0 con 0x7f8368151bd0 2023-07-27T14:32:52.386 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:52.386 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/291900736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":291900736},{"type":"v1","addr":"172.21.15.159:6834","nonce":291900736}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/469026388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":469026388},{"type":"v1","addr":"172.21.15.115:6837","nonce":469026388}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1581340296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":1581340296},{"type":"v1","addr":"172.21.15.159:6835","nonce":1581340296}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:32:22.297133+0000","modified":"2023-07-27T14:32:25.313130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1932712314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1932712314},{"type":"v1","addr":"172.21.15.115:6836","nonce":1932712314}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-07-27T14:32:52.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f835405f4e0 msgr2=0x7f83540619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f835405f4e0 0x7f83540619a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f835800aa90 tx=0x7f8358008040).stop 2023-07-27T14:32:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368151bd0 msgr2=0x7f836806a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368151bd0 0x7f836806a5b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f8360009fd0 tx=0x7f8360009900).stop 2023-07-27T14:32:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 shutdown_connections 2023-07-27T14:32:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f835405f4e0 0x7f83540619a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368151bd0 0x7f836806a5b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8368062810 0x7f8368135e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 --2- 172.21.15.115:0/2267064718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83680a4d30 0x7f8368068610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 >> 172.21.15.115:0/2267064718 conn(0x7f8368064700 msgr2=0x7f83680bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:52.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 shutdown_connections 2023-07-27T14:32:52.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.350+0000 7f836d1ff700 1 -- 172.21.15.115:0/2267064718 wait complete. 2023-07-27T14:32:52.389 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 52 2023-07-27T14:32:52.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:52.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.555+0000 7fbd7b7ff700 1 Processor -- start 2023-07-27T14:32:52.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.555+0000 7fbd7b7ff700 1 -- start start 2023-07-27T14:32:52.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.556+0000 7fbd7b7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbd74153ec0 0x7fbd740a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd7b7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbd740aa050 0x7fbd740640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd7b7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd740aaa40 0x7fbd740645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd7b7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd74064ad0 con 0x7fbd740aa050 2023-07-27T14:32:52.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd7b7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740aa4d0 con 0x7fbd74153ec0 2023-07-27T14:32:52.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd7b7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740c05c0 con 0x7fbd740aaa40 2023-07-27T14:32:52.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbd740aa050 0x7fbd740640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbd740aa050 0x7fbd740640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46888/0 (socket says 172.21.15.115:46888) 2023-07-27T14:32:52.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 -- 172.21.15.115:0/3868022794 learned_addr learned my addr 172.21.15.115:0/3868022794 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:52.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd7959b700 1 --2- 172.21.15.115:0/3868022794 >> v2:172.21.15.159:3300/0 conn(0x7fbd74153ec0 0x7fbd740a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd79d9c700 1 --2- 172.21.15.115:0/3868022794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd740aaa40 0x7fbd740645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 -- 172.21.15.115:0/3868022794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd740aaa40 msgr2=0x7fbd740645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:52.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 --2- 172.21.15.115:0/3868022794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd740aaa40 0x7fbd740645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 -- 172.21.15.115:0/3868022794 >> v2:172.21.15.159:3300/0 conn(0x7fbd74153ec0 msgr2=0x7fbd740a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:52.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 --2- 172.21.15.115:0/3868022794 >> v2:172.21.15.159:3300/0 conn(0x7fbd74153ec0 0x7fbd740a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 -- 172.21.15.115:0/3868022794 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740bfc90 con 0x7fbd740aa050 2023-07-27T14:32:52.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd79d9c700 1 --2- 172.21.15.115:0/3868022794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd740aaa40 0x7fbd740645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:52.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd7959b700 1 --2- 172.21.15.115:0/3868022794 >> v2:172.21.15.159:3300/0 conn(0x7fbd74153ec0 0x7fbd740a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:52.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.557+0000 7fbd78d9a700 1 --2- 172.21.15.115:0/3868022794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aa050 0x7fbd740640f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7fbd74083e30 tx=0x7fbd640090f0).ready entity=mon.0 client_cookie=ed84ab110be6ebaf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:52.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd6bfff700 1 -- 172.21.15.115:0/3868022794 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6400b600 con 0x7fbd740aa050 2023-07-27T14:32:52.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd6bfff700 1 -- 172.21.15.115:0/3868022794 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6400b760 con 0x7fbd740aa050 2023-07-27T14:32:52.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd6bfff700 1 -- 172.21.15.115:0/3868022794 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6400bae0 con 0x7fbd740aa050 2023-07-27T14:32:52.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/3868022794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aa050 msgr2=0x7fbd740640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/3868022794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aa050 0x7fbd740640f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7fbd74083e30 tx=0x7fbd640090f0).stop 2023-07-27T14:32:52.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/3868022794 shutdown_connections 2023-07-27T14:32:52.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/3868022794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd740aaa40 0x7fbd740645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/3868022794 >> v2:172.21.15.159:3300/0 conn(0x7fbd74153ec0 0x7fbd740a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/3868022794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aa050 0x7fbd740640f0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/3868022794 >> 172.21.15.115:0/3868022794 conn(0x7fbd740cb610 msgr2=0x7fbd740c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:52.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/3868022794 shutdown_connections 2023-07-27T14:32:52.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.558+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/3868022794 wait complete. 2023-07-27T14:32:52.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.560+0000 7fbd7b7ff700 1 Processor -- start 2023-07-27T14:32:52.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.560+0000 7fbd7b7ff700 1 -- start start 2023-07-27T14:32:52.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd7b7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd740aa050 0x7fbd740aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd7b7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aaa40 0x7fbd74152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd7b7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd74153ec0 0x7fbd7414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd7b7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740b0220 con 0x7fbd740aaa40 2023-07-27T14:32:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd7b7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740af610 con 0x7fbd740aa050 2023-07-27T14:32:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd7b7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740af8f0 con 0x7fbd74153ec0 2023-07-27T14:32:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd78d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aaa40 0x7fbd74152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd78d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aaa40 0x7fbd74152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46892/0 (socket says 172.21.15.115:46892) 2023-07-27T14:32:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd78d9a700 1 -- 172.21.15.115:0/2542669620 learned_addr learned my addr 172.21.15.115:0/2542669620 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd7959b700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd740aa050 0x7fbd740aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd78d9a700 1 -- 172.21.15.115:0/2542669620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd74153ec0 msgr2=0x7fbd7414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd78d9a700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd74153ec0 0x7fbd7414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd78d9a700 1 -- 172.21.15.115:0/2542669620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd740aa050 msgr2=0x7fbd740aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd78d9a700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd740aa050 0x7fbd740aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.561+0000 7fbd78d9a700 1 -- 172.21.15.115:0/2542669620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd64009370 con 0x7fbd740aaa40 2023-07-27T14:32:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.562+0000 7fbd78d9a700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aaa40 0x7fbd74152ef0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fbd64009130 tx=0x7fbd64017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.562+0000 7fbd697fa700 1 -- 172.21.15.115:0/2542669620 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6400bae0 con 0x7fbd740aaa40 2023-07-27T14:32:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.562+0000 7fbd697fa700 1 -- 172.21.15.115:0/2542669620 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64000c90 con 0x7fbd740aaa40 2023-07-27T14:32:52.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.562+0000 7fbd697fa700 1 -- 172.21.15.115:0/2542669620 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6401c670 con 0x7fbd740aaa40 2023-07-27T14:32:52.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.562+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd740afbd0 con 0x7fbd740aaa40 2023-07-27T14:32:52.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.562+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd740af1b0 con 0x7fbd740aaa40 2023-07-27T14:32:52.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.563+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7406c470 con 0x7fbd740aaa40 2023-07-27T14:32:52.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.564+0000 7fbd697fa700 1 -- 172.21.15.115:0/2542669620 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fbd6400f070 con 0x7fbd740aaa40 2023-07-27T14:32:52.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.565+0000 7fbd697fa700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd5805f4e0 0x7fbd580619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.565+0000 7fbd697fa700 1 -- 172.21.15.115:0/2542669620 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fbd6407bfd0 con 0x7fbd740aaa40 2023-07-27T14:32:52.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.565+0000 7fbd7959b700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd5805f4e0 0x7fbd580619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.565+0000 7fbd7959b700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd5805f4e0 0x7fbd580619a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fbd7000b850 tx=0x7fbd70008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:52.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.568+0000 7fbd697fa700 1 -- 172.21.15.115:0/2542669620 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd64050670 con 0x7fbd740aaa40 2023-07-27T14:32:52.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.741+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd740bff70 con 0x7fbd740aaa40 2023-07-27T14:32:52.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.742+0000 7fbd697fa700 1 -- 172.21.15.115:0/2542669620 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+17434 (secure 0 0 0) 0x7fbd64020020 con 0x7fbd740aaa40 2023-07-27T14:32:52.780 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:52.780 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":102,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:51.685307+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:32:20.631951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-27T14:32:21.280167+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1a","mappings":[{"from":1,"to":3}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.24","mappings":[{"from":1,"to":2}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:52.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd5805f4e0 msgr2=0x7fbd580619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd5805f4e0 0x7fbd580619a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fbd7000b850 tx=0x7fbd70008040).stop 2023-07-27T14:32:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aaa40 msgr2=0x7fbd74152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aaa40 0x7fbd74152ef0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fbd64009130 tx=0x7fbd64017000).stop 2023-07-27T14:32:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 shutdown_connections 2023-07-27T14:32:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd5805f4e0 0x7fbd580619a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd74153ec0 0x7fbd7414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd740aa050 0x7fbd740aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 --2- 172.21.15.115:0/2542669620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd740aaa40 0x7fbd74152ef0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 >> 172.21.15.115:0/2542669620 conn(0x7fbd740cb610 msgr2=0x7fbd740c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 shutdown_connections 2023-07-27T14:32:52.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.744+0000 7fbd7b7ff700 1 -- 172.21.15.115:0/2542669620 wait complete. 2023-07-27T14:32:52.799 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:32:52.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:52.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.949+0000 7f30187ff700 1 Processor -- start 2023-07-27T14:32:52.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.949+0000 7f30187ff700 1 -- start start 2023-07-27T14:32:52.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f30187ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3010066b80 0x7f301015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f30187ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3010067080 con 0x7f3010151d70 2023-07-27T14:32:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f30187ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3010068570 con 0x7f3010065ff0 2023-07-27T14:32:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f30187ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3010063a90 con 0x7f3010066b80 2023-07-27T14:32:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f301659b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3010151d70 0x7f3010155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51538/0 (socket says 172.21.15.115:51538) 2023-07-27T14:32:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f301659b700 1 -- 172.21.15.115:0/2742152285 learned_addr learned my addr 172.21.15.115:0/2742152285 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:52.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775416663 0 0) 0x7f3010067080 con 0x7f3010151d70 2023-07-27T14:32:52.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ffc0033f0 con 0x7f3010151d70 2023-07-27T14:32:52.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.951+0000 7f3016d9c700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3010066b80 0x7f301015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1783788123 0 0) 0x7f2ffc0033f0 con 0x7f3010151d70 2023-07-27T14:32:52.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3010066b80 msgr2=0x7f301015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:52.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3010066b80 0x7f301015ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 >> v1:172.21.15.159:6789/0 conn(0x7f3010065ff0 legacy=0x7f3010066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100634d0 con 0x7f3010151d70 2023-07-27T14:32:52.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f300c001470 con 0x7f3010151d70 2023-07-27T14:32:52.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 >> v1:172.21.15.115:6789/0 conn(0x7f3010151d70 legacy=0x7f3010155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ffc003910 0x7f2ffc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc004690 0x7f2ffc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc005050 0x7f2ffc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:52.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010063a90 con 0x7f2ffc004690 2023-07-27T14:32:52.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc00beb0 con 0x7f2ffc003910 2023-07-27T14:32:52.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc00c070 con 0x7f2ffc005050 2023-07-27T14:32:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3016d9c700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3010066b80 0x7f301015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3015d9a700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc004690 0x7f2ffc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f301659b700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ffc003910 0x7f2ffc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.952+0000 7f3016d9c700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc005050 0x7f2ffc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015d9a700 1 -- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc005050 msgr2=0x7f2ffc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015d9a700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc005050 0x7f2ffc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015d9a700 1 -- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ffc003910 msgr2=0x7f2ffc003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015d9a700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ffc003910 0x7f2ffc003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015d9a700 1 -- 172.21.15.115:0/2742152285 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc0033f0 con 0x7f2ffc004690 2023-07-27T14:32:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015d9a700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc004690 0x7f2ffc004b10 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f3000001760 tx=0x7f3000007bb0).ready entity=mon.0 client_cookie=32ed2a40152dae09 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000007020 con 0x7f2ffc004690 2023-07-27T14:32:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3000007180 con 0x7f2ffc004690 2023-07-27T14:32:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3015599700 1 -- 172.21.15.115:0/2742152285 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000007500 con 0x7f2ffc004690 2023-07-27T14:32:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f30187ff700 1 -- 172.21.15.115:0/2742152285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc004690 msgr2=0x7f2ffc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f30187ff700 1 --2- 172.21.15.115:0/2742152285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ffc004690 0x7f2ffc004b10 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f3000001760 tx=0x7f3000007bb0).stop 2023-07-27T14:32:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.953+0000 7f3016d9c700 1 -- 172.21.15.115:0/2742152285 reap_dead start 2023-07-27T14:32:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.954+0000 7f30187ff700 1 -- 172.21.15.115:0/2742152285 shutdown_connections 2023-07-27T14:32:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.954+0000 7f30187ff700 1 -- 172.21.15.115:0/2742152285 >> 172.21.15.115:0/2742152285 conn(0x7f30100c89a0 msgr2=0x7f30100c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.954+0000 7f30187ff700 1 -- 172.21.15.115:0/2742152285 shutdown_connections 2023-07-27T14:32:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.954+0000 7f30187ff700 1 -- 172.21.15.115:0/2742152285 wait complete. 2023-07-27T14:32:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.955+0000 7f30187ff700 1 Processor -- start 2023-07-27T14:32:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.955+0000 7f30187ff700 1 -- start start 2023-07-27T14:32:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f30187ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc004690 0x7f30100ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f30187ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30100bfda0 0x7f3010163fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f30187ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30100ad5c0 0x7f30100ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f30187ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30100aeaa0 con 0x7f30100bfda0 2023-07-27T14:32:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f30187ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30100c1120 con 0x7f30100ad5c0 2023-07-27T14:32:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f30187ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3010164490 con 0x7f2ffc004690 2023-07-27T14:32:53.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f3015d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30100bfda0 0x7f3010163fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f3015d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30100bfda0 0x7f3010163fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46906/0 (socket says 172.21.15.115:46906) 2023-07-27T14:32:53.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f3015d9a700 1 -- 172.21.15.115:0/3325283119 learned_addr learned my addr 172.21.15.115:0/3325283119 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:53.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f301659b700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc004690 0x7f30100ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.956+0000 7f3016d9c700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30100ad5c0 0x7f30100ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f3015d9a700 1 -- 172.21.15.115:0/3325283119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc004690 msgr2=0x7f30100ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f3015d9a700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc004690 0x7f30100ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f3015d9a700 1 -- 172.21.15.115:0/3325283119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30100ad5c0 msgr2=0x7f30100ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f3015d9a700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30100ad5c0 0x7f30100ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f3015d9a700 1 -- 172.21.15.115:0/3325283119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100c0510 con 0x7f30100bfda0 2023-07-27T14:32:53.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f3015d9a700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30100bfda0 0x7f3010163fa0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f2ffc00be80 tx=0x7f3000016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:53.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f30067fc700 1 -- 172.21.15.115:0/3325283119 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000006f70 con 0x7f30100bfda0 2023-07-27T14:32:53.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f30067fc700 1 -- 172.21.15.115:0/3325283119 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300001d440 con 0x7f30100bfda0 2023-07-27T14:32:53.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30100c07f0 con 0x7f30100bfda0 2023-07-27T14:32:53.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f30067fc700 1 -- 172.21.15.115:0/3325283119 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300001d800 con 0x7f30100bfda0 2023-07-27T14:32:53.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.957+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30100c0db0 con 0x7f30100bfda0 2023-07-27T14:32:53.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.958+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301006c470 con 0x7f30100bfda0 2023-07-27T14:32:53.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.959+0000 7f30067fc700 1 -- 172.21.15.115:0/3325283119 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f3000024030 con 0x7f30100bfda0 2023-07-27T14:32:53.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.960+0000 7f30067fc700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ff405f4e0 0x7f2ff40619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.960+0000 7f30067fc700 1 -- 172.21.15.115:0/3325283119 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f300007b090 con 0x7f30100bfda0 2023-07-27T14:32:53.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.960+0000 7f301659b700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ff405f4e0 0x7f2ff40619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.961+0000 7f301659b700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ff405f4e0 0x7f2ff40619a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f300c007dd0 tx=0x7f300c001e50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:53.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:52.964+0000 7f30067fc700 1 -- 172.21.15.115:0/3325283119 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f300004be10 con 0x7f30100bfda0 2023-07-27T14:32:53.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.172+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3010068720 con 0x7f30100bfda0 2023-07-27T14:32:53.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.173+0000 7f30067fc700 1 -- 172.21.15.115:0/3325283119 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f3000022090 con 0x7f30100bfda0 2023-07-27T14:32:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:53.211 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/291900736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":291900736},{"type":"v1","addr":"172.21.15.159:6834","nonce":291900736}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/469026388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":469026388},{"type":"v1","addr":"172.21.15.115:6837","nonce":469026388}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1581340296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":1581340296},{"type":"v1","addr":"172.21.15.159:6835","nonce":1581340296}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:32:22.297133+0000","modified":"2023-07-27T14:32:25.313130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1932712314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1932712314},{"type":"v1","addr":"172.21.15.115:6836","nonce":1932712314}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-07-27T14:32:53.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ff405f4e0 msgr2=0x7f2ff40619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ff405f4e0 0x7f2ff40619a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f300c007dd0 tx=0x7f300c001e50).stop 2023-07-27T14:32:53.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30100bfda0 msgr2=0x7f3010163fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30100bfda0 0x7f3010163fa0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f2ffc00be80 tx=0x7f3000016000).stop 2023-07-27T14:32:53.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 shutdown_connections 2023-07-27T14:32:53.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ff405f4e0 0x7f2ff40619a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30100ad5c0 0x7f30100ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ffc004690 0x7f30100ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 --2- 172.21.15.115:0/3325283119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30100bfda0 0x7f3010163fa0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 >> 172.21.15.115:0/3325283119 conn(0x7f30100c89a0 msgr2=0x7f3010154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:53.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 shutdown_connections 2023-07-27T14:32:53.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.175+0000 7f30187ff700 1 -- 172.21.15.115:0/3325283119 wait complete. 2023-07-27T14:32:53.214 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 52 2023-07-27T14:32:53.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:32:53.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.379+0000 7fa86a5ff700 1 Processor -- start 2023-07-27T14:32:53.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.380+0000 7fa86a5ff700 1 -- start start 2023-07-27T14:32:53.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.381+0000 7fa86a5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa864153ec0 0x7fa8640a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.381+0000 7fa86a5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640aa4d0 con 0x7fa8640aaa40 2023-07-27T14:32:53.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.381+0000 7fa86a5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640c05c0 con 0x7fa8640aa050 2023-07-27T14:32:53.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.381+0000 7fa86a5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640bfc90 con 0x7fa864153ec0 2023-07-27T14:32:53.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.381+0000 7fa868b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa8640aaa40 0x7fa8640c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51546/0 (socket says 172.21.15.115:51546) 2023-07-27T14:32:53.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa868b9c700 1 -- 172.21.15.115:0/3851633495 learned_addr learned my addr 172.21.15.115:0/3851633495 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:53.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa863fff700 1 --2- 172.21.15.115:0/3851633495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa864153ec0 0x7fa8640a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa862ffd700 1 -- 172.21.15.115:0/3851633495 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109492514 0 0) 0x7fa85c001490 con 0x7fa8640aaa40 2023-07-27T14:32:53.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa862ffd700 1 -- 172.21.15.115:0/3851633495 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84c0033f0 con 0x7fa8640aaa40 2023-07-27T14:32:53.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa862ffd700 1 -- 172.21.15.115:0/3851633495 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565434318 0 0) 0x7fa8640c05c0 con 0x7fa8640aa050 2023-07-27T14:32:53.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa862ffd700 1 -- 172.21.15.115:0/3851633495 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa85c001490 con 0x7fa8640aa050 2023-07-27T14:32:53.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa863fff700 1 -- 172.21.15.115:0/3851633495 >> v1:172.21.15.159:6789/0 conn(0x7fa8640aa050 legacy=0x7fa8640640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa862ffd700 1 -- 172.21.15.115:0/3851633495 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2383601439 0 0) 0x7fa84c0033f0 con 0x7fa8640aaa40 2023-07-27T14:32:53.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa863fff700 1 -- 172.21.15.115:0/3851633495 >> v1:172.21.15.115:6789/0 conn(0x7fa8640aaa40 legacy=0x7fa8640c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa863fff700 1 -- 172.21.15.115:0/3851633495 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8640bff70 con 0x7fa864153ec0 2023-07-27T14:32:53.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.382+0000 7fa863fff700 1 --2- 172.21.15.115:0/3851633495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa864153ec0 0x7fa8640a9b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa854009790 tx=0x7fa854009060).ready entity=mon.2 client_cookie=1dcdd79b72d545ac server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:53.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa862ffd700 1 -- 172.21.15.115:0/3851633495 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c001980 con 0x7fa864153ec0 2023-07-27T14:32:53.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa862ffd700 1 -- 172.21.15.115:0/3851633495 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa854011400 con 0x7fa864153ec0 2023-07-27T14:32:53.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa862ffd700 1 -- 172.21.15.115:0/3851633495 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854011780 con 0x7fa864153ec0 2023-07-27T14:32:53.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa86a5ff700 1 -- 172.21.15.115:0/3851633495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa864153ec0 msgr2=0x7fa8640a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa86a5ff700 1 --2- 172.21.15.115:0/3851633495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa864153ec0 0x7fa8640a9b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa854009790 tx=0x7fa854009060).stop 2023-07-27T14:32:53.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa86a5ff700 1 -- 172.21.15.115:0/3851633495 shutdown_connections 2023-07-27T14:32:53.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa86a5ff700 1 --2- 172.21.15.115:0/3851633495 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa864153ec0 0x7fa8640a9b60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa86a5ff700 1 -- 172.21.15.115:0/3851633495 >> 172.21.15.115:0/3851633495 conn(0x7fa8640cb610 msgr2=0x7fa8640c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:53.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa86a5ff700 1 -- 172.21.15.115:0/3851633495 shutdown_connections 2023-07-27T14:32:53.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.383+0000 7fa86a5ff700 1 -- 172.21.15.115:0/3851633495 wait complete. 2023-07-27T14:32:53.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.385+0000 7fa86a5ff700 1 Processor -- start 2023-07-27T14:32:53.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.385+0000 7fa86a5ff700 1 -- start start 2023-07-27T14:32:53.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa86a5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8640aa050 0x7fa8641500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa86a5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8640aaa40 0x7fa864168610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa86a5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa864153ec0 0x7fa864138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa86a5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864168b00 con 0x7fa864153ec0 2023-07-27T14:32:53.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa86a5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864150760 con 0x7fa8640aaa40 2023-07-27T14:32:53.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa86a5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa864152140 con 0x7fa8640aa050 2023-07-27T14:32:53.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa868b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa864153ec0 0x7fa864138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa868b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa864153ec0 0x7fa864138080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46914/0 (socket says 172.21.15.115:46914) 2023-07-27T14:32:53.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa868b9c700 1 -- 172.21.15.115:0/4127064835 learned_addr learned my addr 172.21.15.115:0/4127064835 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:53.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa868b9c700 1 -- 172.21.15.115:0/4127064835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8640aa050 msgr2=0x7fa8641500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa868b9c700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8640aa050 0x7fa8641500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:53.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa868b9c700 1 -- 172.21.15.115:0/4127064835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8640aaa40 msgr2=0x7fa864168610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.386+0000 7fa8637fe700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8640aaa40 0x7fa864168610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa868b9c700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8640aaa40 0x7fa864168610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa868b9c700 1 -- 172.21.15.115:0/4127064835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540092a0 con 0x7fa864153ec0 2023-07-27T14:32:53.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa8637fe700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8640aaa40 0x7fa864168610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:53.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa868b9c700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa864153ec0 0x7fa864138080 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fa85c00cc90 tx=0x7fa85c001fe0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:53.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa84bfff700 1 -- 172.21.15.115:0/4127064835 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c00cea0 con 0x7fa864153ec0 2023-07-27T14:32:53.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa84bfff700 1 -- 172.21.15.115:0/4127064835 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c004c40 con 0x7fa864153ec0 2023-07-27T14:32:53.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa84bfff700 1 -- 172.21.15.115:0/4127064835 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c00a8c0 con 0x7fa864153ec0 2023-07-27T14:32:53.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa864152420 con 0x7fa864153ec0 2023-07-27T14:32:53.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.387+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa864151df0 con 0x7fa864153ec0 2023-07-27T14:32:53.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.388+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa864152940 con 0x7fa864153ec0 2023-07-27T14:32:53.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.389+0000 7fa84bfff700 1 -- 172.21.15.115:0/4127064835 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fa85c010070 con 0x7fa864153ec0 2023-07-27T14:32:53.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.390+0000 7fa84bfff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa85005f4e0 0x7fa8500619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.390+0000 7fa84bfff700 1 -- 172.21.15.115:0/4127064835 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa85c07a500 con 0x7fa864153ec0 2023-07-27T14:32:53.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.390+0000 7fa863fff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa85005f4e0 0x7fa8500619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.390+0000 7fa863fff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa85005f4e0 0x7fa8500619a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fa8640c47e0 tx=0x7fa854016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:53.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.393+0000 7fa84bfff700 1 -- 172.21.15.115:0/4127064835 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa85c04b220 con 0x7fa864153ec0 2023-07-27T14:32:53.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.604+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa86406c470 con 0x7fa864153ec0 2023-07-27T14:32:53.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.604+0000 7fa84bfff700 1 -- 172.21.15.115:0/4127064835 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fa85c04e840 con 0x7fa864153ec0 2023-07-27T14:32:53.642 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:53.642 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/291900736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":291900736},{"type":"v1","addr":"172.21.15.159:6834","nonce":291900736}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/469026388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":469026388},{"type":"v1","addr":"172.21.15.115:6837","nonce":469026388}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1581340296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":1581340296},{"type":"v1","addr":"172.21.15.159:6835","nonce":1581340296}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:32:22.297133+0000","modified":"2023-07-27T14:32:25.313130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6915},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6915":{"gid":6915,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/1932712314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1932712314},{"type":"v1","addr":"172.21.15.115:6836","nonce":1932712314}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-07-27T14:32:53.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa85005f4e0 msgr2=0x7fa8500619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa85005f4e0 0x7fa8500619a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fa8640c47e0 tx=0x7fa854016000).stop 2023-07-27T14:32:53.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa864153ec0 msgr2=0x7fa864138080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa864153ec0 0x7fa864138080 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fa85c00cc90 tx=0x7fa85c001fe0).stop 2023-07-27T14:32:53.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 shutdown_connections 2023-07-27T14:32:53.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa85005f4e0 0x7fa8500619a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa864153ec0 0x7fa864138080 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8640aa050 0x7fa8641500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:53.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 --2- 172.21.15.115:0/4127064835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8640aaa40 0x7fa864168610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 >> 172.21.15.115:0/4127064835 conn(0x7fa8640cb610 msgr2=0x7fa8640640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:53.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 shutdown_connections 2023-07-27T14:32:53.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.607+0000 7fa86a5ff700 1 -- 172.21.15.115:0/4127064835 wait complete. 2023-07-27T14:32:53.646 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 52 2023-07-27T14:32:53.661 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:32:53.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.813+0000 7f4d0abff700 1 Processor -- start 2023-07-27T14:32:53.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.813+0000 7f4d0abff700 1 -- start start 2023-07-27T14:32:53.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.814+0000 7f4d0abff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d04065ff0 0x7f4d04066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.814+0000 7f4d0abff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04066960 0x7f4d04067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.814+0000 7f4d0abff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d04067080 con 0x7f4d04151d70 2023-07-27T14:32:53.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.814+0000 7f4d0abff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d04063a90 con 0x7f4d04065ff0 2023-07-27T14:32:53.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.814+0000 7f4d0abff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04066df0 con 0x7f4d04066960 2023-07-27T14:32:53.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d03fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d04065ff0 0x7f4d04066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0919c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04066960 0x7f4d04067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0919c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04066960 0x7f4d04067560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:46426/0 (socket says 172.21.15.115:46426) 2023-07-27T14:32:53.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d03fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4d04065ff0 0x7f4d04066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:41314/0 (socket says 172.21.15.115:41314) 2023-07-27T14:32:53.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0919c700 1 -- 172.21.15.115:0/2616057449 learned_addr learned my addr 172.21.15.115:0/2616057449 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:53.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0899b700 1 --1- 172.21.15.115:0/2616057449 >> v1:172.21.15.159:6789/0 conn(0x7f4d04151d70 0x7f4d04155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:41642/0 (socket says 172.21.15.115:41642) 2023-07-27T14:32:53.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0919c700 1 -- 172.21.15.115:0/2616057449 >> v2:172.21.15.159:3300/0 conn(0x7f4d04065ff0 msgr2=0x7f4d04066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:53.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0919c700 1 --2- 172.21.15.115:0/2616057449 >> v2:172.21.15.159:3300/0 conn(0x7f4d04065ff0 0x7f4d04066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0919c700 1 -- 172.21.15.115:0/2616057449 >> v1:172.21.15.159:6789/0 conn(0x7f4d04151d70 legacy=0x7f4d04155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0919c700 1 -- 172.21.15.115:0/2616057449 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040634d0 con 0x7f4d04066960 2023-07-27T14:32:53.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d03fff700 1 --2- 172.21.15.115:0/2616057449 >> v2:172.21.15.159:3300/0 conn(0x7f4d04065ff0 0x7f4d04066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:53.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.815+0000 7f4d0919c700 1 --2- 172.21.15.115:0/2616057449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04066960 0x7f4d04067560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4cfc009f20 tx=0x7f4cfc009840).ready entity=mon.2 client_cookie=37c1f3d0ddd529e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:53.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d037fe700 1 -- 172.21.15.115:0/2616057449 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00e070 con 0x7f4d04066960 2023-07-27T14:32:53.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d037fe700 1 -- 172.21.15.115:0/2616057449 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00b9d0 con 0x7f4d04066960 2023-07-27T14:32:53.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d037fe700 1 -- 172.21.15.115:0/2616057449 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00bd50 con 0x7f4d04066960 2023-07-27T14:32:53.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d0abff700 1 -- 172.21.15.115:0/2616057449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04066960 msgr2=0x7f4d04067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d0abff700 1 --2- 172.21.15.115:0/2616057449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04066960 0x7f4d04067560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f4cfc009f20 tx=0x7f4cfc009840).stop 2023-07-27T14:32:53.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d0abff700 1 -- 172.21.15.115:0/2616057449 shutdown_connections 2023-07-27T14:32:53.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d0abff700 1 --2- 172.21.15.115:0/2616057449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04066960 0x7f4d04067560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d0abff700 1 --2- 172.21.15.115:0/2616057449 >> v2:172.21.15.159:3300/0 conn(0x7f4d04065ff0 0x7f4d04066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d0abff700 1 -- 172.21.15.115:0/2616057449 >> 172.21.15.115:0/2616057449 conn(0x7f4d040c89a0 msgr2=0x7f4d040c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:53.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d0abff700 1 -- 172.21.15.115:0/2616057449 shutdown_connections 2023-07-27T14:32:53.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.816+0000 7f4d0abff700 1 -- 172.21.15.115:0/2616057449 wait complete. 2023-07-27T14:32:53.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.818+0000 7f4d0abff700 1 Processor -- start 2023-07-27T14:32:53.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.818+0000 7f4d0abff700 1 -- start start 2023-07-27T14:32:53.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0abff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d04065ff0 0x7f4d040a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0abff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d04066960 0x7f4d040c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0abff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04151d70 0x7f4d040c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0abff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040a6720 con 0x7f4d04065ff0 2023-07-27T14:32:53.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0abff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040c2570 con 0x7f4d04066960 2023-07-27T14:32:53.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0abff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040ad490 con 0x7f4d04151d70 2023-07-27T14:32:53.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0899b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d04065ff0 0x7f4d040a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0899b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d04065ff0 0x7f4d040a6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51684/0 (socket says 172.21.15.115:51684) 2023-07-27T14:32:53.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0899b700 1 -- 172.21.15.115:0/1213538376 learned_addr learned my addr 172.21.15.115:0/1213538376 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:53.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d0919c700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04151d70 0x7f4d040c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.819+0000 7f4d03fff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d04066960 0x7f4d040c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d0899b700 1 -- 172.21.15.115:0/1213538376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04151d70 msgr2=0x7f4d040c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d0899b700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04151d70 0x7f4d040c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d0899b700 1 -- 172.21.15.115:0/1213538376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d04066960 msgr2=0x7f4d040c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:53.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d0899b700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d04066960 0x7f4d040c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:53.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d0899b700 1 -- 172.21.15.115:0/1213538376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf00092a0 con 0x7f4d04065ff0 2023-07-27T14:32:53.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d0899b700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d04065ff0 0x7f4d040a6230 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f4cf8007fd0 tx=0x7f4cf8007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:53.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d00ff9700 1 -- 172.21.15.115:0/1213538376 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80072e0 con 0x7f4d04065ff0 2023-07-27T14:32:53.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d00ff9700 1 -- 172.21.15.115:0/1213538376 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8007440 con 0x7f4d04065ff0 2023-07-27T14:32:53.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc009ae0 con 0x7f4d04065ff0 2023-07-27T14:32:53.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d00ff9700 1 -- 172.21.15.115:0/1213538376 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80058f0 con 0x7f4d04065ff0 2023-07-27T14:32:53.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.820+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d040c7d50 con 0x7f4d04065ff0 2023-07-27T14:32:53.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.821+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d040ad730 con 0x7f4d04065ff0 2023-07-27T14:32:53.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.822+0000 7f4d00ff9700 1 -- 172.21.15.115:0/1213538376 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f4cf801a060 con 0x7f4d04065ff0 2023-07-27T14:32:53.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.823+0000 7f4d00ff9700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce805f4e0 0x7f4ce80619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:53.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.823+0000 7f4d00ff9700 1 -- 172.21.15.115:0/1213538376 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f4cf8079ef0 con 0x7f4d04065ff0 2023-07-27T14:32:53.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.823+0000 7f4d03fff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce805f4e0 0x7f4ce80619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:53.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.824+0000 7f4d03fff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce805f4e0 0x7f4ce80619a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f4cf0009270 tx=0x7f4cf0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:53.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:53.827+0000 7f4d00ff9700 1 -- 172.21.15.115:0/1213538376 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4cf804ac70 con 0x7f4d04065ff0 2023-07-27T14:32:54.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.001+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d0406c470 con 0x7f4d04065ff0 2023-07-27T14:32:54.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.002+0000 7f4d00ff9700 1 -- 172.21.15.115:0/1213538376 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+17434 (secure 0 0 0) 0x7f4cf8018070 con 0x7f4d04065ff0 2023-07-27T14:32:54.039 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:32:54.040 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":102,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:32:51.685307+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:32:20.631951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-27T14:32:21.280167+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1a","mappings":[{"from":1,"to":3}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.24","mappings":[{"from":1,"to":2}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:32:54.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce805f4e0 msgr2=0x7f4ce80619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce805f4e0 0x7f4ce80619a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f4cf0009270 tx=0x7f4cf0008040).stop 2023-07-27T14:32:54.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d04065ff0 msgr2=0x7f4d040a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d04065ff0 0x7f4d040a6230 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f4cf8007fd0 tx=0x7f4cf8007df0).stop 2023-07-27T14:32:54.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 shutdown_connections 2023-07-27T14:32:54.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce805f4e0 0x7f4ce80619a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4d04151d70 0x7f4d040c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d04065ff0 0x7f4d040a6230 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 --2- 172.21.15.115:0/1213538376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d04066960 0x7f4d040c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 >> 172.21.15.115:0/1213538376 conn(0x7f4d040c89a0 msgr2=0x7f4d040bf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:54.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 shutdown_connections 2023-07-27T14:32:54.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.004+0000 7f4d0abff700 1 -- 172.21.15.115:0/1213538376 wait complete. 2023-07-27T14:32:54.059 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:32:54.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.210+0000 7fcbeffff700 1 Processor -- start 2023-07-27T14:32:54.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.210+0000 7fcbeffff700 1 -- start start 2023-07-27T14:32:54.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.211+0000 7fcbeffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbe80aaa40 0x7fcbe80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.211+0000 7fcbeffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcbe81542a0 0x7fcbe80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.211+0000 7fcbeffff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe80aa4d0 con 0x7fcbe8153ec0 2023-07-27T14:32:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.211+0000 7fcbeffff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe8064ad0 con 0x7fcbe80aaa40 2023-07-27T14:32:54.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.211+0000 7fcbeffff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe80c05c0 con 0x7fcbe81542a0 2023-07-27T14:32:54.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.211+0000 7fcbed59a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbe80aaa40 0x7fcbe80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbed59a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbe80aaa40 0x7fcbe80640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51686/0 (socket says 172.21.15.115:51686) 2023-07-27T14:32:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbed59a700 1 -- 172.21.15.115:0/335262189 learned_addr learned my addr 172.21.15.115:0/335262189 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbee59c700 1 --2- 172.21.15.115:0/335262189 >> v2:172.21.15.159:3300/0 conn(0x7fcbe81542a0 0x7fcbe80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbed59a700 1 -- 172.21.15.115:0/335262189 >> v2:172.21.15.159:3300/0 conn(0x7fcbe81542a0 msgr2=0x7fcbe80645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbed59a700 1 --2- 172.21.15.115:0/335262189 >> v2:172.21.15.159:3300/0 conn(0x7fcbe81542a0 0x7fcbe80645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbed59a700 1 -- 172.21.15.115:0/335262189 >> v1:172.21.15.159:6789/0 conn(0x7fcbe8153ec0 legacy=0x7fcbe80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbed59a700 1 -- 172.21.15.115:0/335262189 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe80c1a60 con 0x7fcbe80aaa40 2023-07-27T14:32:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbed59a700 1 --2- 172.21.15.115:0/335262189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe80aaa40 0x7fcbe80640f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7fcbe80c5470 tx=0x7fcbd80090f0).ready entity=mon.0 client_cookie=d6b21ef53558002e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbecd99700 1 -- 172.21.15.115:0/335262189 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800b600 con 0x7fcbe80aaa40 2023-07-27T14:32:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbecd99700 1 -- 172.21.15.115:0/335262189 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd800b760 con 0x7fcbe80aaa40 2023-07-27T14:32:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.212+0000 7fcbecd99700 1 -- 172.21.15.115:0/335262189 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800bae0 con 0x7fcbe80aaa40 2023-07-27T14:32:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.213+0000 7fcbeffff700 1 -- 172.21.15.115:0/335262189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe80aaa40 msgr2=0x7fcbe80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.213+0000 7fcbeffff700 1 --2- 172.21.15.115:0/335262189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe80aaa40 0x7fcbe80640f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7fcbe80c5470 tx=0x7fcbd80090f0).stop 2023-07-27T14:32:54.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.213+0000 7fcbeffff700 1 -- 172.21.15.115:0/335262189 shutdown_connections 2023-07-27T14:32:54.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.213+0000 7fcbeffff700 1 --2- 172.21.15.115:0/335262189 >> v2:172.21.15.159:3300/0 conn(0x7fcbe81542a0 0x7fcbe80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.213+0000 7fcbeffff700 1 --2- 172.21.15.115:0/335262189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe80aaa40 0x7fcbe80640f0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.213+0000 7fcbeffff700 1 -- 172.21.15.115:0/335262189 >> 172.21.15.115:0/335262189 conn(0x7fcbe80cb610 msgr2=0x7fcbe80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:54.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.213+0000 7fcbeffff700 1 -- 172.21.15.115:0/335262189 shutdown_connections 2023-07-27T14:32:54.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.213+0000 7fcbeffff700 1 -- 172.21.15.115:0/335262189 wait complete. 2023-07-27T14:32:54.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.214+0000 7fcbeffff700 1 Processor -- start 2023-07-27T14:32:54.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.215+0000 7fcbeffff700 1 -- start start 2023-07-27T14:32:54.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.215+0000 7fcbeffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbe80aaa40 0x7fcbe8141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbeffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbe8153ec0 0x7fcbe80c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbeffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe81542a0 0x7fcbe80ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbeffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe814da20 con 0x7fcbe81542a0 2023-07-27T14:32:54.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbeffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8141d60 con 0x7fcbe8153ec0 2023-07-27T14:32:54.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbeffff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe814ef60 con 0x7fcbe80aaa40 2023-07-27T14:32:54.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe81542a0 0x7fcbe80ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe81542a0 0x7fcbe80ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51696/0 (socket says 172.21.15.115:51696) 2023-07-27T14:32:54.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 -- 172.21.15.115:0/3829186483 learned_addr learned my addr 172.21.15.115:0/3829186483 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:54.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbed59a700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbe8153ec0 0x7fcbe80c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbedd9b700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbe80aaa40 0x7fcbe8141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 -- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbe80aaa40 msgr2=0x7fcbe8141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbe80aaa40 0x7fcbe8141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 -- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbe8153ec0 msgr2=0x7fcbe80c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbe8153ec0 0x7fcbe80c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 -- 172.21.15.115:0/3829186483 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8009370 con 0x7fcbe81542a0 2023-07-27T14:32:54.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbedd9b700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbe80aaa40 0x7fcbe8141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:54.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.216+0000 7fcbee59c700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe81542a0 0x7fcbe80ab340 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7fcbe0007ef0 tx=0x7fcbe0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:54.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.217+0000 7fcbddffb700 1 -- 172.21.15.115:0/3829186483 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000ebb0 con 0x7fcbe81542a0 2023-07-27T14:32:54.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.217+0000 7fcbddffb700 1 -- 172.21.15.115:0/3829186483 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe000ed10 con 0x7fcbe81542a0 2023-07-27T14:32:54.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.217+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe814e350 con 0x7fcbe81542a0 2023-07-27T14:32:54.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.217+0000 7fcbddffb700 1 -- 172.21.15.115:0/3829186483 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0014610 con 0x7fcbe81542a0 2023-07-27T14:32:54.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.217+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe814e910 con 0x7fcbe81542a0 2023-07-27T14:32:54.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.218+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe806c470 con 0x7fcbe81542a0 2023-07-27T14:32:54.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.219+0000 7fcbddffb700 1 -- 172.21.15.115:0/3829186483 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fcbe001b030 con 0x7fcbe81542a0 2023-07-27T14:32:54.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.219+0000 7fcbddffb700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbcc05f4e0 0x7fcbcc0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.219+0000 7fcbddffb700 1 -- 172.21.15.115:0/3829186483 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fcbe007ac30 con 0x7fcbe81542a0 2023-07-27T14:32:54.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.220+0000 7fcbedd9b700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbcc05f4e0 0x7fcbcc0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.220+0000 7fcbedd9b700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbcc05f4e0 0x7fcbcc0619a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fcbe80af790 tx=0x7fcbe4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:54.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.223+0000 7fcbddffb700 1 -- 172.21.15.115:0/3829186483 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbe004b8a0 con 0x7fcbe81542a0 2023-07-27T14:32:54.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.440+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcbe8062540 con 0x7fcbe81542a0 2023-07-27T14:32:54.750 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:32:54.713+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:32:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.717+0000 7fcbddffb700 1 -- 172.21.15.115:0/3829186483 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcbe004eec0 con 0x7fcbe81542a0 2023-07-27T14:32:54.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbcc05f4e0 msgr2=0x7fcbcc0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbcc05f4e0 0x7fcbcc0619a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fcbe80af790 tx=0x7fcbe4009040).stop 2023-07-27T14:32:54.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe81542a0 msgr2=0x7fcbe80ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe81542a0 0x7fcbe80ab340 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7fcbe0007ef0 tx=0x7fcbe0009840).stop 2023-07-27T14:32:54.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 shutdown_connections 2023-07-27T14:32:54.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcbcc05f4e0 0x7fcbcc0619a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbe81542a0 0x7fcbe80ab340 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbe80aaa40 0x7fcbe8141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 --2- 172.21.15.115:0/3829186483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbe8153ec0 0x7fcbe80c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.719+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 >> 172.21.15.115:0/3829186483 conn(0x7fcbe80cb610 msgr2=0x7fcbe80c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:54.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.720+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 shutdown_connections 2023-07-27T14:32:54.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.720+0000 7fcbeffff700 1 -- 172.21.15.115:0/3829186483 wait complete. 2023-07-27T14:32:54.759 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:32:54.782 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:32:54.825 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:32:54.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.937+0000 7f31f7bff700 1 Processor -- start 2023-07-27T14:32:54.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.938+0000 7f31f7bff700 1 -- start start 2023-07-27T14:32:54.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.939+0000 7f31f7bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f0150220 0x7f31f0150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.939+0000 7f31f7bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f31f0065220 0x7f31f00c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f7bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f0068bb0 con 0x7f31f00c0ea0 2023-07-27T14:32:54.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f7bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f00656b0 con 0x7f31f0065220 2023-07-27T14:32:54.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f7bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f006a250 con 0x7f31f0150220 2023-07-27T14:32:54.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f619c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f31f0065220 0x7f31f00c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f619c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f31f0065220 0x7f31f00c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51726/0 (socket says 172.21.15.115:51726) 2023-07-27T14:32:54.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f619c700 1 -- 172.21.15.115:0/2170549362 learned_addr learned my addr 172.21.15.115:0/2170549362 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:54.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f599b700 1 --2- 172.21.15.115:0/2170549362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f0150220 0x7f31f0150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f619c700 1 -- 172.21.15.115:0/2170549362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f0150220 msgr2=0x7f31f0150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:54.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f619c700 1 --2- 172.21.15.115:0/2170549362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f0150220 0x7f31f0150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f619c700 1 -- 172.21.15.115:0/2170549362 >> v1:172.21.15.159:6789/0 conn(0x7f31f00c0ea0 legacy=0x7f31f0069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f619c700 1 -- 172.21.15.115:0/2170549362 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f00c1380 con 0x7f31f0065220 2023-07-27T14:32:54.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.940+0000 7f31f4999700 1 -- 172.21.15.115:0/2170549362 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149290367 0 0) 0x7f31f0068bb0 con 0x7f31f00c0ea0 2023-07-27T14:32:54.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f619c700 1 --2- 172.21.15.115:0/2170549362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f00c1770 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f31e8009f50 tx=0x7f31e8009840).ready entity=mon.0 client_cookie=eb6f401b7bfa5e15 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:54.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f4999700 1 -- 172.21.15.115:0/2170549362 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e800e070 con 0x7f31f0065220 2023-07-27T14:32:54.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f4999700 1 -- 172.21.15.115:0/2170549362 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e800b9c0 con 0x7f31f0065220 2023-07-27T14:32:54.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f4999700 1 -- 172.21.15.115:0/2170549362 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e800bd40 con 0x7f31f0065220 2023-07-27T14:32:54.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f7bff700 1 -- 172.21.15.115:0/2170549362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 msgr2=0x7f31f00c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f7bff700 1 --2- 172.21.15.115:0/2170549362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f00c1770 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f31e8009f50 tx=0x7f31e8009840).stop 2023-07-27T14:32:54.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f7bff700 1 -- 172.21.15.115:0/2170549362 shutdown_connections 2023-07-27T14:32:54.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f7bff700 1 --2- 172.21.15.115:0/2170549362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f0150220 0x7f31f0150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f7bff700 1 --2- 172.21.15.115:0/2170549362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f00c1770 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f7bff700 1 -- 172.21.15.115:0/2170549362 >> 172.21.15.115:0/2170549362 conn(0x7f31f0062320 msgr2=0x7f31f0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:54.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f7bff700 1 -- 172.21.15.115:0/2170549362 shutdown_connections 2023-07-27T14:32:54.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.941+0000 7f31f7bff700 1 -- 172.21.15.115:0/2170549362 wait complete. 2023-07-27T14:32:54.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.943+0000 7f31f7bff700 1 Processor -- start 2023-07-27T14:32:54.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.943+0000 7f31f7bff700 1 -- start start 2023-07-27T14:32:54.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f7bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f013a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f7bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f00c0ea0 0x7f31f0158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f7bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31f0150220 0x7f31f0159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f7bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00c0210 con 0x7f31f0065220 2023-07-27T14:32:54.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f7bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f01598f0 con 0x7f31f0150220 2023-07-27T14:32:54.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f7bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00bf600 con 0x7f31f00c0ea0 2023-07-27T14:32:54.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f599b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f013a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f599b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f013a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51734/0 (socket says 172.21.15.115:51734) 2023-07-27T14:32:54.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f599b700 1 -- 172.21.15.115:0/1556918262 learned_addr learned my addr 172.21.15.115:0/1556918262 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:54.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f619c700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31f0150220 0x7f31f0159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.944+0000 7f31f519a700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f00c0ea0 0x7f31f0158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31f599b700 1 -- 172.21.15.115:0/1556918262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f00c0ea0 msgr2=0x7f31f0158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31f599b700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f00c0ea0 0x7f31f0158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31f599b700 1 -- 172.21.15.115:0/1556918262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31f0150220 msgr2=0x7f31f0159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:54.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31f599b700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31f0150220 0x7f31f0159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:54.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31f599b700 1 -- 172.21.15.115:0/1556918262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8009ae0 con 0x7f31f0065220 2023-07-27T14:32:54.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31f599b700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f013a320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f31ec00e930 tx=0x7f31ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:54.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31e5ffb700 1 -- 172.21.15.115:0/1556918262 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec012600 con 0x7f31f0065220 2023-07-27T14:32:54.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31e5ffb700 1 -- 172.21.15.115:0/1556918262 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec012760 con 0x7f31f0065220 2023-07-27T14:32:54.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31e5ffb700 1 -- 172.21.15.115:0/1556918262 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec012ae0 con 0x7f31f0065220 2023-07-27T14:32:54.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f00bf8e0 con 0x7f31f0065220 2023-07-27T14:32:54.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.945+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f00bfea0 con 0x7f31f0065220 2023-07-27T14:32:54.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.946+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f006c470 con 0x7f31f0065220 2023-07-27T14:32:54.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.947+0000 7f31e5ffb700 1 -- 172.21.15.115:0/1556918262 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f31ec022070 con 0x7f31f0065220 2023-07-27T14:32:54.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.948+0000 7f31e5ffb700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31d405f4e0 0x7f31d40619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:54.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.948+0000 7f31e5ffb700 1 -- 172.21.15.115:0/1556918262 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6380+0+0 (secure 0 0 0) 0x7f31ec07a9f0 con 0x7f31f0065220 2023-07-27T14:32:54.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.948+0000 7f31f519a700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31d405f4e0 0x7f31d40619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:54.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.949+0000 7f31f519a700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31d405f4e0 0x7f31d40619a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f31e0007fd0 tx=0x7f31e0007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:54.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:54.952+0000 7f31e5ffb700 1 -- 172.21.15.115:0/1556918262 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31ec04b630 con 0x7f31f0065220 2023-07-27T14:32:55.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.160+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f31f0064d50 con 0x7f31f0065220 2023-07-27T14:32:55.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.727+0000 7f31e5ffb700 1 -- 172.21.15.115:0/1556918262 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7f31ec04ec50 con 0x7f31f0065220 2023-07-27T14:32:55.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31d405f4e0 msgr2=0x7f31d40619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:55.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31d405f4e0 0x7f31d40619a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f31e0007fd0 tx=0x7f31e0007bd0).stop 2023-07-27T14:32:55.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 msgr2=0x7f31f013a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:55.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f013a320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f31ec00e930 tx=0x7f31ec009060).stop 2023-07-27T14:32:55.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 shutdown_connections 2023-07-27T14:32:55.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31d405f4e0 0x7f31d40619a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:55.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31f0150220 0x7f31f0159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:55.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31f0065220 0x7f31f013a320 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:55.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 --2- 172.21.15.115:0/1556918262 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31f00c0ea0 0x7f31f0158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:55.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 >> 172.21.15.115:0/1556918262 conn(0x7f31f0062320 msgr2=0x7f31f014eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:55.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 shutdown_connections 2023-07-27T14:32:55.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.730+0000 7f31f7bff700 1 -- 172.21.15.115:0/1556918262 wait complete. 2023-07-27T14:32:55.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:32:56.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.982+0000 7fc6b23ff700 1 Processor -- start 2023-07-27T14:32:56.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.982+0000 7fc6b23ff700 1 -- start start 2023-07-27T14:32:56.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6b23ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6ac14ae00 0x7fc6ac154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6b23ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc6ac14b1e0 0x7fc6ac062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6b23ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac1553f0 con 0x7fc6ac0c5c50 2023-07-27T14:32:56.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6b23ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac157a50 con 0x7fc6ac14ae00 2023-07-27T14:32:56.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6b23ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac157d10 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6abfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6ac14ae00 0x7fc6ac154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6abfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6ac14ae00 0x7fc6ac154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51744/0 (socket says 172.21.15.115:51744) 2023-07-27T14:32:56.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6b099c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc6ac0c5c50 0x7fc6ac0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55302/0 (socket says 172.21.15.115:55302) 2023-07-27T14:32:56.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6abfff700 1 -- 172.21.15.115:0/241883009 learned_addr learned my addr 172.21.15.115:0/241883009 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:56.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6ab7fe700 1 --2- 172.21.15.115:0/241883009 >> v2:172.21.15.159:3300/0 conn(0x7fc6ac14b1e0 0x7fc6ac062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6abfff700 1 -- 172.21.15.115:0/241883009 >> v2:172.21.15.159:3300/0 conn(0x7fc6ac14b1e0 msgr2=0x7fc6ac062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:56.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6abfff700 1 --2- 172.21.15.115:0/241883009 >> v2:172.21.15.159:3300/0 conn(0x7fc6ac14b1e0 0x7fc6ac062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.984+0000 7fc6abfff700 1 -- 172.21.15.115:0/241883009 >> v1:172.21.15.115:6789/0 conn(0x7fc6ac0c5c50 legacy=0x7fc6ac0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.985+0000 7fc6abfff700 1 -- 172.21.15.115:0/241883009 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac157ff0 con 0x7fc6ac14ae00 2023-07-27T14:32:56.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.985+0000 7fc6aaffd700 1 -- 172.21.15.115:0/241883009 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127047818 0 0) 0x7fc6ac1553f0 con 0x7fc6ac0c5c50 2023-07-27T14:32:56.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.985+0000 7fc6abfff700 1 --2- 172.21.15.115:0/241883009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14ae00 0x7fc6ac154f00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fc6ac155580 tx=0x7fc69c0090f0).ready entity=mon.0 client_cookie=f483d701a525b7e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:56.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.985+0000 7fc6aaffd700 1 -- 172.21.15.115:0/241883009 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00b600 con 0x7fc6ac14ae00 2023-07-27T14:32:56.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.985+0000 7fc6aaffd700 1 -- 172.21.15.115:0/241883009 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00b760 con 0x7fc6ac14ae00 2023-07-27T14:32:56.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.985+0000 7fc6aaffd700 1 -- 172.21.15.115:0/241883009 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00bae0 con 0x7fc6ac14ae00 2023-07-27T14:32:56.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.985+0000 7fc6b23ff700 1 -- 172.21.15.115:0/241883009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14ae00 msgr2=0x7fc6ac154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.985+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/241883009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14ae00 0x7fc6ac154f00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7fc6ac155580 tx=0x7fc69c0090f0).stop 2023-07-27T14:32:56.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.986+0000 7fc6b23ff700 1 -- 172.21.15.115:0/241883009 shutdown_connections 2023-07-27T14:32:56.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.986+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/241883009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14ae00 0x7fc6ac154f00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.986+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/241883009 >> v2:172.21.15.159:3300/0 conn(0x7fc6ac14b1e0 0x7fc6ac062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.986+0000 7fc6b23ff700 1 -- 172.21.15.115:0/241883009 >> 172.21.15.115:0/241883009 conn(0x7fc6ac05e940 msgr2=0x7fc6ac0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:56.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.986+0000 7fc6b23ff700 1 -- 172.21.15.115:0/241883009 shutdown_connections 2023-07-27T14:32:56.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.986+0000 7fc6b23ff700 1 -- 172.21.15.115:0/241883009 wait complete. 2023-07-27T14:32:56.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.988+0000 7fc6b23ff700 1 Processor -- start 2023-07-27T14:32:56.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.988+0000 7fc6b23ff700 1 -- start start 2023-07-27T14:32:56.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b23ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac0c5c50 0x7fc6ac149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b23ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac14ae00 0x7fc6ac0c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b23ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14b1e0 0x7fc6ac0ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b23ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c45b0 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b23ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c39a0 con 0x7fc6ac0c5c50 2023-07-27T14:32:56.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b23ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c3c80 con 0x7fc6ac14ae00 2023-07-27T14:32:56.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b099c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14b1e0 0x7fc6ac0ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b099c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14b1e0 0x7fc6ac0ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51752/0 (socket says 172.21.15.115:51752) 2023-07-27T14:32:56.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6abfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac0c5c50 0x7fc6ac149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.989+0000 7fc6b099c700 1 -- 172.21.15.115:0/3087519883 learned_addr learned my addr 172.21.15.115:0/3087519883 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:56.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6ab7fe700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac14ae00 0x7fc6ac0c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6b099c700 1 -- 172.21.15.115:0/3087519883 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac14ae00 msgr2=0x7fc6ac0c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6b099c700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac14ae00 0x7fc6ac0c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6b099c700 1 -- 172.21.15.115:0/3087519883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac0c5c50 msgr2=0x7fc6ac149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6b099c700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac0c5c50 0x7fc6ac149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6b099c700 1 -- 172.21.15.115:0/3087519883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009370 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6ab7fe700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac14ae00 0x7fc6ac0c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:56.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6b099c700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14b1e0 0x7fc6ac0ac090 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7fc6a400c7e0 tx=0x7fc6a4007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:56.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc693fff700 1 -- 172.21.15.115:0/3087519883 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4005c70 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc693fff700 1 -- 172.21.15.115:0/3087519883 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4005dd0 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac0c3f60 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc693fff700 1 -- 172.21.15.115:0/3087519883 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4007340 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.990+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac0c3590 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.992+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac0c4400 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.992+0000 7fc693fff700 1 -- 172.21.15.115:0/3087519883 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fc6a4010030 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.993+0000 7fc693fff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc69805f4e0 0x7fc6980619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.993+0000 7fc693fff700 1 -- 172.21.15.115:0/3087519883 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6380+0+0 (secure 0 0 0) 0x7fc6a407a760 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.993+0000 7fc6abfff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc69805f4e0 0x7fc6980619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.994+0000 7fc6abfff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc69805f4e0 0x7fc6980619a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fc6ac155580 tx=0x7fc69c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:56.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:55.997+0000 7fc693fff700 1 -- 172.21.15.115:0/3087519883 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6a404b3a0 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.168+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6ac0c46f0 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.615+0000 7fc693fff700 1 -- 172.21.15.115:0/3087519883 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc6ac0c46f0 con 0x7fc6ac14b1e0 2023-07-27T14:32:56.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc69805f4e0 msgr2=0x7fc6980619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc69805f4e0 0x7fc6980619a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fc6ac155580 tx=0x7fc69c017000).stop 2023-07-27T14:32:56.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14b1e0 msgr2=0x7fc6ac0ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14b1e0 0x7fc6ac0ac090 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7fc6a400c7e0 tx=0x7fc6a4007ef0).stop 2023-07-27T14:32:56.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 shutdown_connections 2023-07-27T14:32:56.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc69805f4e0 0x7fc6980619a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac14b1e0 0x7fc6ac0ac090 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac0c5c50 0x7fc6ac149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 --2- 172.21.15.115:0/3087519883 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac14ae00 0x7fc6ac0c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 >> 172.21.15.115:0/3087519883 conn(0x7fc6ac05e940 msgr2=0x7fc6ac14a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:56.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 shutdown_connections 2023-07-27T14:32:56.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.618+0000 7fc6b23ff700 1 -- 172.21.15.115:0/3087519883 wait complete. 2023-07-27T14:32:56.658 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:32:56.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:32:56.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.833+0000 7f24c07ff700 1 Processor -- start 2023-07-27T14:32:56.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.833+0000 7f24c07ff700 1 -- start start 2023-07-27T14:32:56.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.834+0000 7f24c07ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f24b8063260 0x7f24b8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.834+0000 7f24c07ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b81553f0 con 0x7f24b814b1e0 2023-07-27T14:32:56.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24c07ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b8157a50 con 0x7f24b814ae00 2023-07-27T14:32:56.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24c07ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b8157d10 con 0x7f24b8063260 2023-07-27T14:32:56.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bed9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f24b814b1e0 0x7f24b80a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55316/0 (socket says 172.21.15.115:55316) 2023-07-27T14:32:56.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bed9c700 1 -- 172.21.15.115:0/175132056 learned_addr learned my addr 172.21.15.115:0/175132056 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:56.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bdd9a700 1 --2- 172.21.15.115:0/175132056 >> v2:172.21.15.159:3300/0 conn(0x7f24b8063260 0x7f24b8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579922300 0 0) 0x7f24b81553f0 con 0x7f24b814b1e0 2023-07-27T14:32:56.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a40033f0 con 0x7f24b814b1e0 2023-07-27T14:32:56.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362630191 0 0) 0x7f24a40033f0 con 0x7f24b814b1e0 2023-07-27T14:32:56.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 >> v2:172.21.15.159:3300/0 conn(0x7f24b8063260 msgr2=0x7f24b8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:56.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bd599700 1 --2- 172.21.15.115:0/175132056 >> v2:172.21.15.159:3300/0 conn(0x7f24b8063260 0x7f24b8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 >> v1:172.21.15.159:6789/0 conn(0x7f24b814ae00 legacy=0x7f24b8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b8157ff0 con 0x7f24b814b1e0 2023-07-27T14:32:56.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.835+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f24b00017f0 con 0x7f24b814b1e0 2023-07-27T14:32:56.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 >> v1:172.21.15.115:6789/0 conn(0x7f24b814b1e0 legacy=0x7f24b80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bd599700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24a40038e0 0x7f24a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bd599700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a4004690 0x7f24a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bd599700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24a4005000 0x7f24a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8157d10 con 0x7f24a4005000 2023-07-27T14:32:56.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a400bf60 con 0x7f24a4004690 2023-07-27T14:32:56.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a400c0f0 con 0x7f24a40038e0 2023-07-27T14:32:56.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bed9c700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24a4005000 0x7f24a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24be59b700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24a40038e0 0x7f24a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bdd9a700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a4004690 0x7f24a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bed9c700 1 -- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24a40038e0 msgr2=0x7f24a4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:56.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bed9c700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24a40038e0 0x7f24a4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bed9c700 1 -- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a4004690 msgr2=0x7f24a4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:56.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bed9c700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a4004690 0x7f24a4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bed9c700 1 -- 172.21.15.115:0/175132056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40033f0 con 0x7f24a4005000 2023-07-27T14:32:56.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bdd9a700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24a4004690 0x7f24a4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:32:56.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bed9c700 1 -- 172.21.15.115:0/175132056 reap_dead start 2023-07-27T14:32:56.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.836+0000 7f24bed9c700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24a4005000 0x7f24a400b8e0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f24b000c450 tx=0x7f24b000c760).ready entity=mon.0 client_cookie=56d765cb535bef00 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:56.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0002030 con 0x7f24a4005000 2023-07-27T14:32:56.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b000cdf0 con 0x7f24a4005000 2023-07-27T14:32:56.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24bd599700 1 -- 172.21.15.115:0/175132056 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0005d30 con 0x7f24a4005000 2023-07-27T14:32:56.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24c07ff700 1 -- 172.21.15.115:0/175132056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24a4005000 msgr2=0x7f24a400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24c07ff700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24a4005000 0x7f24a400b8e0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f24b000c450 tx=0x7f24b000c760).stop 2023-07-27T14:32:56.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24c07ff700 1 -- 172.21.15.115:0/175132056 shutdown_connections 2023-07-27T14:32:56.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24c07ff700 1 --2- 172.21.15.115:0/175132056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24a4005000 0x7f24a400b8e0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:56.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24c07ff700 1 -- 172.21.15.115:0/175132056 >> 172.21.15.115:0/175132056 conn(0x7f24b805e940 msgr2=0x7f24b80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:56.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24c07ff700 1 -- 172.21.15.115:0/175132056 shutdown_connections 2023-07-27T14:32:56.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.837+0000 7f24c07ff700 1 -- 172.21.15.115:0/175132056 wait complete. 2023-07-27T14:32:56.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.839+0000 7f24c07ff700 1 Processor -- start 2023-07-27T14:32:56.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.839+0000 7f24c07ff700 1 -- start start 2023-07-27T14:32:56.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24c07ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24a4005000 0x7f24b814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24c07ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b8148de0 0x7f24b80c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24c07ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24b80c3940 0x7f24b8064390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24c07ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b814bad0 con 0x7f24b8148de0 2023-07-27T14:32:56.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24c07ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8168350 con 0x7f24b80c3940 2023-07-27T14:32:56.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24c07ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8167740 con 0x7f24a4005000 2023-07-27T14:32:56.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b8148de0 0x7f24b80c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b8148de0 0x7f24b80c3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51768/0 (socket says 172.21.15.115:51768) 2023-07-27T14:32:56.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 -- 172.21.15.115:0/2194908879 learned_addr learned my addr 172.21.15.115:0/2194908879 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:56.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 -- 172.21.15.115:0/2194908879 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24a4005000 msgr2=0x7f24b814b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24a4005000 0x7f24b814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:56.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 -- 172.21.15.115:0/2194908879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24b80c3940 msgr2=0x7f24b8064390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:56.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24b80c3940 0x7f24b8064390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:56.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 -- 172.21.15.115:0/2194908879 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b8167a20 con 0x7f24b8148de0 2023-07-27T14:32:56.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.840+0000 7f24bdd9a700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b8148de0 0x7f24b80c3450 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f24a8011610 tx=0x7f24a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:56.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.841+0000 7f24ae7fc700 1 -- 172.21.15.115:0/2194908879 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8013620 con 0x7f24b8148de0 2023-07-27T14:32:56.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.841+0000 7f24ae7fc700 1 -- 172.21.15.115:0/2194908879 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a8013780 con 0x7f24b8148de0 2023-07-27T14:32:56.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.841+0000 7f24ae7fc700 1 -- 172.21.15.115:0/2194908879 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8013b40 con 0x7f24b8148de0 2023-07-27T14:32:56.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.841+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b8167d00 con 0x7f24b8148de0 2023-07-27T14:32:56.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.841+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b81673d0 con 0x7f24b8148de0 2023-07-27T14:32:56.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.842+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b81681a0 con 0x7f24b8148de0 2023-07-27T14:32:56.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.843+0000 7f24ae7fc700 1 -- 172.21.15.115:0/2194908879 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f24a8012040 con 0x7f24b8148de0 2023-07-27T14:32:56.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.843+0000 7f24ae7fc700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f249c05f4e0 0x7f249c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:56.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.843+0000 7f24ae7fc700 1 -- 172.21.15.115:0/2194908879 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5913+0+0 (secure 0 0 0) 0x7f24a807aac0 con 0x7f24b8148de0 2023-07-27T14:32:56.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.844+0000 7f24be59b700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f249c05f4e0 0x7f249c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:56.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.844+0000 7f24be59b700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f249c05f4e0 0x7f249c0619a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f24b4007fd0 tx=0x7f24b4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:56.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:56.848+0000 7f24ae7fc700 1 -- 172.21.15.115:0/2194908879 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f24a804b9e0 con 0x7f24b8148de0 2023-07-27T14:32:57.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.026+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24b8163e70 con 0x7f24b8148de0 2023-07-27T14:32:57.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.739+0000 7f24ae7fc700 1 -- 172.21.15.115:0/2194908879 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) v1 ==== 169+0+0 (secure 0 0 0) 0x7f24b8163e70 con 0x7f24b8148de0 2023-07-27T14:32:57.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.743+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f249c05f4e0 msgr2=0x7f249c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:57.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.743+0000 7f24c07ff700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f249c05f4e0 0x7f249c0619a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f24b4007fd0 tx=0x7f24b4009040).stop 2023-07-27T14:32:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.743+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b8148de0 msgr2=0x7f24b80c3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.743+0000 7f24c07ff700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b8148de0 0x7f24b80c3450 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f24a8011610 tx=0x7f24a8008040).stop 2023-07-27T14:32:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.744+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 shutdown_connections 2023-07-27T14:32:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.744+0000 7f24c07ff700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f249c05f4e0 0x7f249c0619a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.744+0000 7f24c07ff700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24b80c3940 0x7f24b8064390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.744+0000 7f24c07ff700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24a4005000 0x7f24b814b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:32:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.744+0000 7f24c07ff700 1 --2- 172.21.15.115:0/2194908879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24b8148de0 0x7f24b80c3450 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.744+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 >> 172.21.15.115:0/2194908879 conn(0x7f24b805e940 msgr2=0x7f24b814a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:57.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.745+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 shutdown_connections 2023-07-27T14:32:57.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.745+0000 7f24c07ff700 1 -- 172.21.15.115:0/2194908879 wait complete. 2023-07-27T14:32:57.785 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:32:57.803 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:32:57.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.958+0000 7f879d1ff700 1 Processor -- start 2023-07-27T14:32:57.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.958+0000 7f879d1ff700 1 -- start start 2023-07-27T14:32:57.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.959+0000 7f879d1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f87981509b0 0x7f87980c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:57.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.959+0000 7f879d1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87980c0ea0 con 0x7f87980c3100 2023-07-27T14:32:57.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.959+0000 7f879d1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8798068e10 con 0x7f8798150d90 2023-07-27T14:32:57.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.959+0000 7f879d1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8798155190 con 0x7f87981509b0 2023-07-27T14:32:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.959+0000 7f8796d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f87981509b0 0x7f87980c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.959+0000 7f879759e700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f87980c3100 0x7f87980c3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55320/0 (socket says 172.21.15.115:55320) 2023-07-27T14:32:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.959+0000 7f879759e700 1 -- 172.21.15.115:0/2848530863 learned_addr learned my addr 172.21.15.115:0/2848530863 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.960+0000 7f8796d9d700 1 -- 172.21.15.115:0/2848530863 >> v1:172.21.15.159:6789/0 conn(0x7f8798150d90 legacy=0x7f8798154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:57.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.960+0000 7f8796d9d700 1 -- 172.21.15.115:0/2848530863 >> v1:172.21.15.115:6789/0 conn(0x7f87980c3100 legacy=0x7f87980c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:57.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.960+0000 7f8796d9d700 1 -- 172.21.15.115:0/2848530863 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8798155470 con 0x7f87981509b0 2023-07-27T14:32:57.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.960+0000 7f8796d9d700 1 --2- 172.21.15.115:0/2848530863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980c58d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f8788009760 tx=0x7f8788009060).ready entity=mon.0 client_cookie=92a93906fd1b7301 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:57.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.960+0000 7f8795d9b700 1 -- 172.21.15.115:0/2848530863 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800f6b0 con 0x7f87981509b0 2023-07-27T14:32:57.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.960+0000 7f8795d9b700 1 -- 172.21.15.115:0/2848530863 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800f810 con 0x7f87981509b0 2023-07-27T14:32:57.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.960+0000 7f8795d9b700 1 -- 172.21.15.115:0/2848530863 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800fb90 con 0x7f87981509b0 2023-07-27T14:32:58.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.961+0000 7f879d1ff700 1 -- 172.21.15.115:0/2848530863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 msgr2=0x7f87980c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.961+0000 7f879d1ff700 1 --2- 172.21.15.115:0/2848530863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980c58d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f8788009760 tx=0x7f8788009060).stop 2023-07-27T14:32:58.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.961+0000 7f879d1ff700 1 -- 172.21.15.115:0/2848530863 shutdown_connections 2023-07-27T14:32:58.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.961+0000 7f879d1ff700 1 --2- 172.21.15.115:0/2848530863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980c58d0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.961+0000 7f879d1ff700 1 -- 172.21.15.115:0/2848530863 >> 172.21.15.115:0/2848530863 conn(0x7f8798062320 msgr2=0x7f8798062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:58.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.961+0000 7f879d1ff700 1 -- 172.21.15.115:0/2848530863 shutdown_connections 2023-07-27T14:32:58.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.961+0000 7f879d1ff700 1 -- 172.21.15.115:0/2848530863 wait complete. 2023-07-27T14:32:58.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.963+0000 7f879d1ff700 1 Processor -- start 2023-07-27T14:32:58.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.963+0000 7f879d1ff700 1 -- start start 2023-07-27T14:32:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87980c3100 0x7f879814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879d1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879d1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8798150d90 0x7f87980abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879d1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980bdfc0 con 0x7f87981509b0 2023-07-27T14:32:58.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879d1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980bd9e0 con 0x7f8798150d90 2023-07-27T14:32:58.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87980ac330 con 0x7f87980c3100 2023-07-27T14:32:58.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51784/0 (socket says 172.21.15.115:51784) 2023-07-27T14:32:58.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879659c700 1 -- 172.21.15.115:0/494723965 learned_addr learned my addr 172.21.15.115:0/494723965 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:58.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f8796d9d700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87980c3100 0x7f879814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879659c700 1 -- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87980c3100 msgr2=0x7f879814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879659c700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87980c3100 0x7f879814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879659c700 1 -- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8798150d90 msgr2=0x7f87980abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879759e700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8798150d90 0x7f87980abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879659c700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8798150d90 0x7f87980abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879659c700 1 -- 172.21.15.115:0/494723965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880092a0 con 0x7f87981509b0 2023-07-27T14:32:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.964+0000 7f879759e700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8798150d90 0x7f87980abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:32:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.965+0000 7f879659c700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980ab8a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f878c00c440 tx=0x7f878c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.965+0000 7f877effd700 1 -- 172.21.15.115:0/494723965 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c00cea0 con 0x7f87981509b0 2023-07-27T14:32:58.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.965+0000 7f877effd700 1 -- 172.21.15.115:0/494723965 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c00f470 con 0x7f87981509b0 2023-07-27T14:32:58.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.965+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87980bdc50 con 0x7f87981509b0 2023-07-27T14:32:58.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.965+0000 7f877effd700 1 -- 172.21.15.115:0/494723965 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c00f810 con 0x7f87981509b0 2023-07-27T14:32:58.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.965+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87980a65b0 con 0x7f87981509b0 2023-07-27T14:32:58.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.966+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87980be170 con 0x7f87981509b0 2023-07-27T14:32:58.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.967+0000 7f877effd700 1 -- 172.21.15.115:0/494723965 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f878c019030 con 0x7f87981509b0 2023-07-27T14:32:58.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.968+0000 7f877effd700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f878405f510 0x7f87840619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.968+0000 7f877effd700 1 -- 172.21.15.115:0/494723965 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f878c079850 con 0x7f87981509b0 2023-07-27T14:32:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.968+0000 7f8796d9d700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f878405f510 0x7f87840619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.968+0000 7f8796d9d700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f878405f510 0x7f87840619d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f878800f470 tx=0x7f8788019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:57.972+0000 7f877effd700 1 -- 172.21.15.115:0/494723965 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87980be170 con 0x7f87981509b0 2023-07-27T14:32:58.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.146+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f879806c470 con 0x7f87981509b0 2023-07-27T14:32:58.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.150+0000 7f877effd700 1 -- 172.21.15.115:0/494723965 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f878c04a830 con 0x7f87981509b0 2023-07-27T14:32:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f878405f510 msgr2=0x7f87840619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f878405f510 0x7f87840619d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f878800f470 tx=0x7f8788019000).stop 2023-07-27T14:32:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 msgr2=0x7f87980ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980ab8a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f878c00c440 tx=0x7f878c007db0).stop 2023-07-27T14:32:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 shutdown_connections 2023-07-27T14:32:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f878405f510 0x7f87840619d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8798150d90 0x7f87980abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87980c3100 0x7f879814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 --2- 172.21.15.115:0/494723965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87981509b0 0x7f87980ab8a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.152+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 >> 172.21.15.115:0/494723965 conn(0x7f8798062320 msgr2=0x7f87980691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.153+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 shutdown_connections 2023-07-27T14:32:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.153+0000 7f879d1ff700 1 -- 172.21.15.115:0/494723965 wait complete. 2023-07-27T14:32:58.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_subvolume_info' 2023-07-27T14:32:58.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.356+0000 7fd35d9ff700 1 Processor -- start 2023-07-27T14:32:58.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.356+0000 7fd35d9ff700 1 -- start start 2023-07-27T14:32:58.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.357+0000 7fd35d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd35d9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580aa4d0 con 0x7fd3581542a0 2023-07-27T14:32:58.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd35d9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580c05c0 con 0x7fd358153ec0 2023-07-27T14:32:58.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd35d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580aa270 con 0x7fd3580aaa40 2023-07-27T14:32:58.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd3577fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd3581542a0 0x7fd3580c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55328/0 (socket says 172.21.15.115:55328) 2023-07-27T14:32:58.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd3577fe700 1 -- 172.21.15.115:0/2813279657 learned_addr learned my addr 172.21.15.115:0/2813279657 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:58.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd3567fc700 1 --2- 172.21.15.115:0/2813279657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd355ffb700 1 -- 172.21.15.115:0/2813279657 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022467222 0 0) 0x7fd350001490 con 0x7fd3581542a0 2023-07-27T14:32:58.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd355ffb700 1 -- 172.21.15.115:0/2813279657 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3400033f0 con 0x7fd3581542a0 2023-07-27T14:32:58.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd355ffb700 1 -- 172.21.15.115:0/2813279657 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716706564 0 0) 0x7fd3580c05c0 con 0x7fd358153ec0 2023-07-27T14:32:58.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.358+0000 7fd355ffb700 1 -- 172.21.15.115:0/2813279657 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd350001490 con 0x7fd358153ec0 2023-07-27T14:32:58.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.359+0000 7fd3567fc700 1 -- 172.21.15.115:0/2813279657 >> v1:172.21.15.159:6789/0 conn(0x7fd358153ec0 legacy=0x7fd3580a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.359+0000 7fd355ffb700 1 -- 172.21.15.115:0/2813279657 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3500350612 0 0) 0x7fd3400033f0 con 0x7fd3581542a0 2023-07-27T14:32:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.359+0000 7fd3567fc700 1 -- 172.21.15.115:0/2813279657 >> v1:172.21.15.115:6789/0 conn(0x7fd3581542a0 legacy=0x7fd3580c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.359+0000 7fd3567fc700 1 -- 172.21.15.115:0/2813279657 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580bfc90 con 0x7fd3580aaa40 2023-07-27T14:32:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.359+0000 7fd3567fc700 1 --2- 172.21.15.115:0/2813279657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580640f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd34c009790 tx=0x7fd34c009060).ready entity=mon.2 client_cookie=ffe2550848f3c691 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.359+0000 7fd355ffb700 1 -- 172.21.15.115:0/2813279657 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350001980 con 0x7fd3580aaa40 2023-07-27T14:32:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.359+0000 7fd355ffb700 1 -- 172.21.15.115:0/2813279657 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c011400 con 0x7fd3580aaa40 2023-07-27T14:32:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.359+0000 7fd355ffb700 1 -- 172.21.15.115:0/2813279657 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c011780 con 0x7fd3580aaa40 2023-07-27T14:32:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.360+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2813279657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 msgr2=0x7fd3580640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.360+0000 7fd35d9ff700 1 --2- 172.21.15.115:0/2813279657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580640f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd34c009790 tx=0x7fd34c009060).stop 2023-07-27T14:32:58.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.360+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2813279657 shutdown_connections 2023-07-27T14:32:58.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.360+0000 7fd35d9ff700 1 --2- 172.21.15.115:0/2813279657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580640f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.360+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2813279657 >> 172.21.15.115:0/2813279657 conn(0x7fd3580cb610 msgr2=0x7fd3580c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:58.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.360+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2813279657 shutdown_connections 2023-07-27T14:32:58.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.360+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2813279657 wait complete. 2023-07-27T14:32:58.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.361+0000 7fd35d9ff700 1 Processor -- start 2023-07-27T14:32:58.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.361+0000 7fd35d9ff700 1 -- start start 2023-07-27T14:32:58.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.362+0000 7fd35d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.362+0000 7fd35d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd358153ec0 0x7fd35814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.362+0000 7fd35d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3581542a0 0x7fd358167790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.362+0000 7fd35d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580aec40 con 0x7fd3581542a0 2023-07-27T14:32:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.362+0000 7fd35d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580c1c30 con 0x7fd358153ec0 2023-07-27T14:32:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.362+0000 7fd35d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580c1f10 con 0x7fd3580aaa40 2023-07-27T14:32:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3581542a0 0x7fd358167790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3581542a0 0x7fd358167790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51796/0 (socket says 172.21.15.115:51796) 2023-07-27T14:32:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 -- 172.21.15.115:0/2830679229 learned_addr learned my addr 172.21.15.115:0/2830679229 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3567fc700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd358153ec0 0x7fd35814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd356ffd700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 -- 172.21.15.115:0/2830679229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 msgr2=0x7fd3580af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 -- 172.21.15.115:0/2830679229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd358153ec0 msgr2=0x7fd35814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd358153ec0 0x7fd35814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 -- 172.21.15.115:0/2830679229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c0092a0 con 0x7fd3581542a0 2023-07-27T14:32:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd3577fe700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3581542a0 0x7fd358167790 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fd35000cb90 tx=0x7fd350001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.363+0000 7fd33effd700 1 -- 172.21.15.115:0/2830679229 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350004c40 con 0x7fd3581542a0 2023-07-27T14:32:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.364+0000 7fd33effd700 1 -- 172.21.15.115:0/2830679229 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350004dc0 con 0x7fd3581542a0 2023-07-27T14:32:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.364+0000 7fd33effd700 1 -- 172.21.15.115:0/2830679229 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500073c0 con 0x7fd3581542a0 2023-07-27T14:32:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.364+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3580aeee0 con 0x7fd3581542a0 2023-07-27T14:32:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.364+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3580c21f0 con 0x7fd3581542a0 2023-07-27T14:32:58.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.365+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35806c470 con 0x7fd3581542a0 2023-07-27T14:32:58.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.366+0000 7fd33effd700 1 -- 172.21.15.115:0/2830679229 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fd350010070 con 0x7fd3581542a0 2023-07-27T14:32:58.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.367+0000 7fd33effd700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd34405f4b0 0x7fd344061970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.367+0000 7fd33effd700 1 -- 172.21.15.115:0/2830679229 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd350079f60 con 0x7fd3581542a0 2023-07-27T14:32:58.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.367+0000 7fd356ffd700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd34405f4b0 0x7fd344061970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.368+0000 7fd356ffd700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd34405f4b0 0x7fd344061970 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fd348003930 tx=0x7fd348007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:58.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.371+0000 7fd33effd700 1 -- 172.21.15.115:0/2830679229 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd35004afa0 con 0x7fd3581542a0 2023-07-27T14:32:58.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.607+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_subvolume_info"]} v 0) v1 -- 0x7fd3580aa4d0 con 0x7fd3581542a0 2023-07-27T14:32:58.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.738+0000 7fd33effd700 1 -- 172.21.15.115:0/2830679229 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_subvolume_info"]}]=0 v322) v1 ==== 158+0+0 (secure 0 0 0) 0x7fd3580aa4d0 con 0x7fd3581542a0 2023-07-27T14:32:58.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd34405f4b0 msgr2=0x7fd344061970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd34405f4b0 0x7fd344061970 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fd348003930 tx=0x7fd348007bd0).stop 2023-07-27T14:32:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3581542a0 msgr2=0x7fd358167790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3581542a0 0x7fd358167790 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fd35000cb90 tx=0x7fd350001b30).stop 2023-07-27T14:32:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 shutdown_connections 2023-07-27T14:32:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd34405f4b0 0x7fd344061970 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3581542a0 0x7fd358167790 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3580aaa40 0x7fd3580af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 --2- 172.21.15.115:0/2830679229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd358153ec0 0x7fd35814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 >> 172.21.15.115:0/2830679229 conn(0x7fd3580cb610 msgr2=0x7fd3580abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:58.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 shutdown_connections 2023-07-27T14:32:58.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.741+0000 7fd35d9ff700 1 -- 172.21.15.115:0/2830679229 wait complete. 2023-07-27T14:32:58.796 INFO:tasks.cephfs_test_runner:test_clone_subvolume_info (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:32:58.796 INFO:tasks.cephfs_test_runner:Starting test: test_non_clone_status (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:32:58.797 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_non_clone_status' 2023-07-27T14:32:58.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.947+0000 7fc32dfff700 1 Processor -- start 2023-07-27T14:32:58.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.948+0000 7fc32dfff700 1 -- start start 2023-07-27T14:32:58.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.949+0000 7fc32dfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc3281542a0 0x7fc32815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.949+0000 7fc32dfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280aa4d0 con 0x7fc328153ec0 2023-07-27T14:32:58.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.949+0000 7fc32dfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280c05c0 con 0x7fc3280aaa40 2023-07-27T14:32:58.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.949+0000 7fc32dfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280c1a60 con 0x7fc3281542a0 2023-07-27T14:32:58.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.949+0000 7fc3277fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc328153ec0 0x7fc3280a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55330/0 (socket says 172.21.15.115:55330) 2023-07-27T14:32:58.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.949+0000 7fc3277fe700 1 -- 172.21.15.115:0/751465250 learned_addr learned my addr 172.21.15.115:0/751465250 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:32:58.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc327fff700 1 --2- 172.21.15.115:0/751465250 >> v2:172.21.15.159:3300/0 conn(0x7fc3281542a0 0x7fc32815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406821372 0 0) 0x7fc318001110 con 0x7fc328153ec0 2023-07-27T14:32:58.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3100033f0 con 0x7fc328153ec0 2023-07-27T14:32:58.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1646232977 0 0) 0x7fc3100033f0 con 0x7fc328153ec0 2023-07-27T14:32:58.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 >> v2:172.21.15.159:3300/0 conn(0x7fc3281542a0 msgr2=0x7fc32815efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:58.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 --2- 172.21.15.115:0/751465250 >> v2:172.21.15.159:3300/0 conn(0x7fc3281542a0 0x7fc32815efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 >> v1:172.21.15.159:6789/0 conn(0x7fc3280aaa40 legacy=0x7fc3280640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280aa270 con 0x7fc328153ec0 2023-07-27T14:32:58.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fc318001600 con 0x7fc328153ec0 2023-07-27T14:32:58.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 >> v1:172.21.15.115:6789/0 conn(0x7fc328153ec0 legacy=0x7fc3280a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3100038e0 0x7fc310003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc310004690 0x7fc310004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc310005000 0x7fc31000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280c1a60 con 0x7fc310005000 2023-07-27T14:32:58.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31000beb0 con 0x7fc3100038e0 2023-07-27T14:32:58.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31000c070 con 0x7fc310004690 2023-07-27T14:32:58.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.950+0000 7fc327fff700 1 --2- 172.21.15.115:0/751465250 >> v2:172.21.15.159:3300/0 conn(0x7fc3281542a0 0x7fc32815efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:58.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3277fe700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3100038e0 0x7fc310003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc326ffd700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc310004690 0x7fc310004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc327fff700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc310005000 0x7fc31000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:58.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3277fe700 1 -- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc310004690 msgr2=0x7fc310004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:58.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3277fe700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc310004690 0x7fc310004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3277fe700 1 -- 172.21.15.115:0/751465250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc310005000 msgr2=0x7fc31000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:32:58.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3277fe700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc310005000 0x7fc31000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3277fe700 1 -- 172.21.15.115:0/751465250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100033f0 con 0x7fc3100038e0 2023-07-27T14:32:58.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc327fff700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc310005000 0x7fc31000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:32:58.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc327fff700 1 -- 172.21.15.115:0/751465250 reap_dead start 2023-07-27T14:32:58.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3277fe700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3100038e0 0x7fc310003cc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fc31800c3c0 tx=0x7fc3280c1ba0).ready entity=mon.1 client_cookie=81755e41fb2b556a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:58.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318007c20 con 0x7fc3100038e0 2023-07-27T14:32:58.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.951+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800ccf0 con 0x7fc3100038e0 2023-07-27T14:32:58.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.952+0000 7fc3267fc700 1 -- 172.21.15.115:0/751465250 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318007320 con 0x7fc3100038e0 2023-07-27T14:32:58.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.952+0000 7fc32dfff700 1 -- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3100038e0 msgr2=0x7fc310003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:58.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.952+0000 7fc32dfff700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3100038e0 0x7fc310003cc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fc31800c3c0 tx=0x7fc3280c1ba0).stop 2023-07-27T14:32:58.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.952+0000 7fc32dfff700 1 -- 172.21.15.115:0/751465250 shutdown_connections 2023-07-27T14:32:58.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.952+0000 7fc32dfff700 1 --2- 172.21.15.115:0/751465250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3100038e0 0x7fc310003cc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:58.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.952+0000 7fc32dfff700 1 -- 172.21.15.115:0/751465250 >> 172.21.15.115:0/751465250 conn(0x7fc3280cb610 msgr2=0x7fc3280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:58.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.952+0000 7fc32dfff700 1 -- 172.21.15.115:0/751465250 shutdown_connections 2023-07-27T14:32:58.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.952+0000 7fc32dfff700 1 -- 172.21.15.115:0/751465250 wait complete. 2023-07-27T14:32:58.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.954+0000 7fc32dfff700 1 Processor -- start 2023-07-27T14:32:58.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.954+0000 7fc32dfff700 1 -- start start 2023-07-27T14:32:58.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc32dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3100038e0 0x7fc32814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc32dfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc32814f210 0x7fc32814ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc32dfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3280640f0 0x7fc328064570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:58.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc32dfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328064a60 con 0x7fc3280640f0 2023-07-27T14:32:59.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc32dfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280c3720 con 0x7fc32814f210 2023-07-27T14:32:59.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc32dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc328156f80 con 0x7fc3100038e0 2023-07-27T14:32:59.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc327fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3280640f0 0x7fc328064570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:59.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc327fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3280640f0 0x7fc328064570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51824/0 (socket says 172.21.15.115:51824) 2023-07-27T14:32:59.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc327fff700 1 -- 172.21.15.115:0/167085465 learned_addr learned my addr 172.21.15.115:0/167085465 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:32:59.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc3277fe700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3100038e0 0x7fc32814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:59.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc326ffd700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc32814f210 0x7fc32814ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:59.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc327fff700 1 -- 172.21.15.115:0/167085465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3100038e0 msgr2=0x7fc32814f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc327fff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3100038e0 0x7fc32814f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc327fff700 1 -- 172.21.15.115:0/167085465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc32814f210 msgr2=0x7fc32814ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc327fff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc32814f210 0x7fc32814ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.955+0000 7fc327fff700 1 -- 172.21.15.115:0/167085465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280c2280 con 0x7fc3280640f0 2023-07-27T14:32:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.956+0000 7fc327fff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3280640f0 0x7fc328064570 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fc3200094d0 tx=0x7fc32000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.956+0000 7fc30f7fe700 1 -- 172.21.15.115:0/167085465 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000e040 con 0x7fc3280640f0 2023-07-27T14:32:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.956+0000 7fc30f7fe700 1 -- 172.21.15.115:0/167085465 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000f040 con 0x7fc3280640f0 2023-07-27T14:32:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.956+0000 7fc30f7fe700 1 -- 172.21.15.115:0/167085465 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320015680 con 0x7fc3280640f0 2023-07-27T14:32:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.956+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280c1fa0 con 0x7fc3280640f0 2023-07-27T14:32:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.956+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32814ef50 con 0x7fc3280640f0 2023-07-27T14:32:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.957+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc328156de0 con 0x7fc3280640f0 2023-07-27T14:32:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.958+0000 7fc30f7fe700 1 -- 172.21.15.115:0/167085465 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fc320015ab0 con 0x7fc3280640f0 2023-07-27T14:32:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.958+0000 7fc30f7fe700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc31405f4e0 0x7fc3140619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:32:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.959+0000 7fc30f7fe700 1 -- 172.21.15.115:0/167085465 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fc32007b060 con 0x7fc3280640f0 2023-07-27T14:32:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.959+0000 7fc3277fe700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc31405f4e0 0x7fc3140619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:32:59.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.959+0000 7fc3277fe700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc31405f4e0 0x7fc3140619a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fc31800ccc0 tx=0x7fc318013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:32:59.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:58.962+0000 7fc30f7fe700 1 -- 172.21.15.115:0/167085465 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc328156de0 con 0x7fc3280640f0 2023-07-27T14:32:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.193+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_non_clone_status"]} v 0) v1 -- 0x7fc32806c470 con 0x7fc3280640f0 2023-07-27T14:32:59.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.743+0000 7fc30f7fe700 1 -- 172.21.15.115:0/167085465 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_non_clone_status"]}]=0 v323) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc32004c1b0 con 0x7fc3280640f0 2023-07-27T14:32:59.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc31405f4e0 msgr2=0x7fc3140619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:59.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc31405f4e0 0x7fc3140619a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fc31800ccc0 tx=0x7fc318013000).stop 2023-07-27T14:32:59.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3280640f0 msgr2=0x7fc328064570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:32:59.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3280640f0 0x7fc328064570 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fc3200094d0 tx=0x7fc32000b040).stop 2023-07-27T14:32:59.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 shutdown_connections 2023-07-27T14:32:59.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc31405f4e0 0x7fc3140619a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:59.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3280640f0 0x7fc328064570 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:59.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3100038e0 0x7fc32814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:59.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 --2- 172.21.15.115:0/167085465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc32814f210 0x7fc32814ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:32:59.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 >> 172.21.15.115:0/167085465 conn(0x7fc3280cb610 msgr2=0x7fc3280acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:32:59.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 shutdown_connections 2023-07-27T14:32:59.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.746+0000 7fc32dfff700 1 -- 172.21.15.115:0/167085465 wait complete. 2023-07-27T14:32:59.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:32:59.796 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:32:59.804 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:33:00.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.999+0000 7f2e4f7ff700 1 Processor -- start 2023-07-27T14:33:00.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:32:59.999+0000 7f2e4f7ff700 1 -- start start 2023-07-27T14:33:00.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4f7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2e48063260 0x7f2e48154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4f7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e4814b1e0 0x7f2e480a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4f7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e481553f0 con 0x7f2e4814ae00 2023-07-27T14:33:00.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4f7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e48157a50 con 0x7f2e4814b1e0 2023-07-27T14:33:00.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4f7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e48157d10 con 0x7f2e48063260 2023-07-27T14:33:00.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4dd9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e4814b1e0 0x7f2e480a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4dd9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e4814b1e0 0x7f2e480a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51830/0 (socket says 172.21.15.115:51830) 2023-07-27T14:33:00.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4dd9c700 1 -- 172.21.15.115:0/2058268695 learned_addr learned my addr 172.21.15.115:0/2058268695 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:00.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4cd9a700 1 --2- 172.21.15.115:0/2058268695 >> v2:172.21.15.159:3300/0 conn(0x7f2e48063260 0x7f2e48154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4dd9c700 1 -- 172.21.15.115:0/2058268695 >> v2:172.21.15.159:3300/0 conn(0x7f2e48063260 msgr2=0x7f2e48154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:00.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4dd9c700 1 --2- 172.21.15.115:0/2058268695 >> v2:172.21.15.159:3300/0 conn(0x7f2e48063260 0x7f2e48154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4dd9c700 1 -- 172.21.15.115:0/2058268695 >> v1:172.21.15.159:6789/0 conn(0x7f2e4814ae00 legacy=0x7f2e48062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.001+0000 7f2e4dd9c700 1 -- 172.21.15.115:0/2058268695 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48157ff0 con 0x7f2e4814b1e0 2023-07-27T14:33:00.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e4dd9c700 1 --2- 172.21.15.115:0/2058268695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4814b1e0 0x7f2e480a98c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f2e480cbc00 tx=0x7f2e40009840).ready entity=mon.0 client_cookie=f9587ffa5d15ffd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:00.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e3ffff700 1 -- 172.21.15.115:0/2058268695 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000e070 con 0x7f2e4814b1e0 2023-07-27T14:33:00.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e3ffff700 1 -- 172.21.15.115:0/2058268695 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4000ba50 con 0x7f2e4814b1e0 2023-07-27T14:33:00.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e3ffff700 1 -- 172.21.15.115:0/2058268695 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000bdd0 con 0x7f2e4814b1e0 2023-07-27T14:33:00.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2058268695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4814b1e0 msgr2=0x7f2e480a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2058268695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4814b1e0 0x7f2e480a98c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f2e480cbc00 tx=0x7f2e40009840).stop 2023-07-27T14:33:00.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2058268695 shutdown_connections 2023-07-27T14:33:00.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2058268695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4814b1e0 0x7f2e480a98c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2058268695 >> v2:172.21.15.159:3300/0 conn(0x7f2e48063260 0x7f2e48154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.002+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2058268695 >> 172.21.15.115:0/2058268695 conn(0x7f2e4805e940 msgr2=0x7f2e480cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:00.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.003+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2058268695 shutdown_connections 2023-07-27T14:33:00.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.003+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2058268695 wait complete. 2023-07-27T14:33:00.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.004+0000 7f2e4f7ff700 1 Processor -- start 2023-07-27T14:33:00.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.004+0000 7f2e4f7ff700 1 -- start start 2023-07-27T14:33:00.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4f7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e48063260 0x7f2e48149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4f7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e4814ae00 0x7f2e48166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4f7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e4814b1e0 0x7f2e48167490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4f7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48167980 con 0x7f2e48063260 2023-07-27T14:33:00.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4f7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480c1df0 con 0x7f2e4814b1e0 2023-07-27T14:33:00.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4f7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e481650b0 con 0x7f2e4814ae00 2023-07-27T14:33:00.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4d59b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e48063260 0x7f2e48149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4d59b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e48063260 0x7f2e48149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51846/0 (socket says 172.21.15.115:51846) 2023-07-27T14:33:00.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4d59b700 1 -- 172.21.15.115:0/2443336097 learned_addr learned my addr 172.21.15.115:0/2443336097 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:00.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.005+0000 7f2e4cd9a700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e4814ae00 0x7f2e48166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4dd9c700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e4814b1e0 0x7f2e48167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4d59b700 1 -- 172.21.15.115:0/2443336097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e4814ae00 msgr2=0x7f2e48166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4d59b700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e4814ae00 0x7f2e48166fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4d59b700 1 -- 172.21.15.115:0/2443336097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e4814b1e0 msgr2=0x7f2e48167490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4d59b700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e4814b1e0 0x7f2e48167490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4d59b700 1 -- 172.21.15.115:0/2443336097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40009ae0 con 0x7f2e48063260 2023-07-27T14:33:00.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4d59b700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e48063260 0x7f2e48149a30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f2e4400c4c0 tx=0x7f2e44007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:00.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e3d7fa700 1 -- 172.21.15.115:0/2443336097 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44007020 con 0x7f2e48063260 2023-07-27T14:33:00.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e3d7fa700 1 -- 172.21.15.115:0/2443336097 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44001e90 con 0x7f2e48063260 2023-07-27T14:33:00.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e3d7fa700 1 -- 172.21.15.115:0/2443336097 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440073b0 con 0x7f2e48063260 2023-07-27T14:33:00.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e480afa90 con 0x7f2e48063260 2023-07-27T14:33:00.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.006+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e48164d40 con 0x7f2e48063260 2023-07-27T14:33:00.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.007+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4806c470 con 0x7f2e48063260 2023-07-27T14:33:00.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.008+0000 7f2e3d7fa700 1 -- 172.21.15.115:0/2443336097 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f2e44010070 con 0x7f2e48063260 2023-07-27T14:33:00.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.009+0000 7f2e3d7fa700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e2c05f4e0 0x7f2e2c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.009+0000 7f2e3d7fa700 1 -- 172.21.15.115:0/2443336097 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f2e44079c30 con 0x7f2e48063260 2023-07-27T14:33:00.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.009+0000 7f2e4cd9a700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e2c05f4e0 0x7f2e2c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.010+0000 7f2e4cd9a700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e2c05f4e0 0x7f2e2c0619a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f2e48166f00 tx=0x7f2e38008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:00.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.013+0000 7f2e3d7fa700 1 -- 172.21.15.115:0/2443336097 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e4404ac70 con 0x7f2e48063260 2023-07-27T14:33:00.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.183+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2e480a9c00 con 0x7f2e48063260 2023-07-27T14:33:00.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.187+0000 7f2e3d7fa700 1 -- 172.21.15.115:0/2443336097 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e4404e290 con 0x7f2e48063260 2023-07-27T14:33:00.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.189+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e2c05f4e0 msgr2=0x7f2e2c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.189+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e2c05f4e0 0x7f2e2c0619a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f2e48166f00 tx=0x7f2e38008040).stop 2023-07-27T14:33:00.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.189+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e48063260 msgr2=0x7f2e48149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.189+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e48063260 0x7f2e48149a30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f2e4400c4c0 tx=0x7f2e44007e00).stop 2023-07-27T14:33:00.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.190+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 shutdown_connections 2023-07-27T14:33:00.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.190+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e2c05f4e0 0x7f2e2c0619a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.190+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e4814b1e0 0x7f2e48167490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.190+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e48063260 0x7f2e48149a30 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.190+0000 7f2e4f7ff700 1 --2- 172.21.15.115:0/2443336097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e4814ae00 0x7f2e48166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.190+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 >> 172.21.15.115:0/2443336097 conn(0x7f2e4805e940 msgr2=0x7f2e4814a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:00.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.190+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 shutdown_connections 2023-07-27T14:33:00.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.190+0000 7f2e4f7ff700 1 -- 172.21.15.115:0/2443336097 wait complete. 2023-07-27T14:33:00.244 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:33:00.245 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:33:00.345 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:33:00.447 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:33:00.448 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:33:00.448 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:00.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.597+0000 7f1d0c5ff700 1 Processor -- start 2023-07-27T14:33:00.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.598+0000 7f1d0c5ff700 1 -- start start 2023-07-27T14:33:00.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.599+0000 7f1d0c5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1d040aaa40 0x7f1d040640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.599+0000 7f1d0c5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d040aa4d0 con 0x7f1d04153ec0 2023-07-27T14:33:00.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.599+0000 7f1d0c5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d040c05c0 con 0x7f1d041542a0 2023-07-27T14:33:00.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.599+0000 7f1d0c5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d040aa270 con 0x7f1d040aaa40 2023-07-27T14:33:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.599+0000 7f1d0a39b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1d04153ec0 0x7f1d040a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55332/0 (socket says 172.21.15.115:55332) 2023-07-27T14:33:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.599+0000 7f1d0a39b700 1 -- 172.21.15.115:0/4158882474 learned_addr learned my addr 172.21.15.115:0/4158882474 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.599+0000 7f1d09b9a700 1 --2- 172.21.15.115:0/4158882474 >> v2:172.21.15.115:3300/0 conn(0x7f1d040aaa40 0x7f1d040640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09399700 1 -- 172.21.15.115:0/4158882474 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622050412 0 0) 0x7f1d00001110 con 0x7f1d04153ec0 2023-07-27T14:33:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09399700 1 -- 172.21.15.115:0/4158882474 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf00033f0 con 0x7f1d04153ec0 2023-07-27T14:33:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09b9a700 1 -- 172.21.15.115:0/4158882474 >> v1:172.21.15.159:6789/0 conn(0x7f1d041542a0 legacy=0x7f1d040c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09b9a700 1 -- 172.21.15.115:0/4158882474 >> v1:172.21.15.115:6789/0 conn(0x7f1d04153ec0 legacy=0x7f1d040a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09b9a700 1 -- 172.21.15.115:0/4158882474 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d040bfc90 con 0x7f1d040aaa40 2023-07-27T14:33:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09b9a700 1 --2- 172.21.15.115:0/4158882474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d040aaa40 0x7f1d040640f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f1cf4009760 tx=0x7f1cf4009060).ready entity=mon.0 client_cookie=ec6c2990b08cb9ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09399700 1 -- 172.21.15.115:0/4158882474 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400f510 con 0x7f1d040aaa40 2023-07-27T14:33:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09399700 1 -- 172.21.15.115:0/4158882474 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400f670 con 0x7f1d040aaa40 2023-07-27T14:33:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.600+0000 7f1d09399700 1 -- 172.21.15.115:0/4158882474 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400f9f0 con 0x7f1d040aaa40 2023-07-27T14:33:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.601+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/4158882474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d040aaa40 msgr2=0x7f1d040640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.601+0000 7f1d0c5ff700 1 --2- 172.21.15.115:0/4158882474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d040aaa40 0x7f1d040640f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f1cf4009760 tx=0x7f1cf4009060).stop 2023-07-27T14:33:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.601+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/4158882474 shutdown_connections 2023-07-27T14:33:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.601+0000 7f1d0c5ff700 1 --2- 172.21.15.115:0/4158882474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d040aaa40 0x7f1d040640f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.601+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/4158882474 >> 172.21.15.115:0/4158882474 conn(0x7f1d040cb610 msgr2=0x7f1d040c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.601+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/4158882474 shutdown_connections 2023-07-27T14:33:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.601+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/4158882474 wait complete. 2023-07-27T14:33:00.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.602+0000 7f1d0c5ff700 1 Processor -- start 2023-07-27T14:33:00.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.602+0000 7f1d0c5ff700 1 -- start start 2023-07-27T14:33:00.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.603+0000 7f1d0c5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d040aaa40 0x7f1d04144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.603+0000 7f1d0c5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04153ec0 0x7f1d040af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.603+0000 7f1d0c5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d041542a0 0x7f1d040afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.603+0000 7f1d0c5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040b02c0 con 0x7f1d041542a0 2023-07-27T14:33:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.603+0000 7f1d0c5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040c1c30 con 0x7f1d040aaa40 2023-07-27T14:33:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.603+0000 7f1d0c5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040ae7c0 con 0x7f1d04153ec0 2023-07-27T14:33:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d041542a0 0x7f1d040afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d041542a0 0x7f1d040afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51870/0 (socket says 172.21.15.115:51870) 2023-07-27T14:33:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 -- 172.21.15.115:0/3576627638 learned_addr learned my addr 172.21.15.115:0/3576627638 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:00.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0a39b700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d040aaa40 0x7f1d04144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d09b9a700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04153ec0 0x7f1d040af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 -- 172.21.15.115:0/3576627638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04153ec0 msgr2=0x7f1d040af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04153ec0 0x7f1d040af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 -- 172.21.15.115:0/3576627638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d040aaa40 msgr2=0x7f1d04144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d040aaa40 0x7f1d04144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 -- 172.21.15.115:0/3576627638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40092a0 con 0x7f1d041542a0 2023-07-27T14:33:00.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1d0ab9c700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d041542a0 0x7f1d040afdd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f1cfc00c7c0 tx=0x7f1cfc0014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:00.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.604+0000 7f1cfa7fc700 1 -- 172.21.15.115:0/3576627638 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc010510 con 0x7f1d041542a0 2023-07-27T14:33:00.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.605+0000 7f1cfa7fc700 1 -- 172.21.15.115:0/3576627638 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc010670 con 0x7f1d041542a0 2023-07-27T14:33:00.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.605+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d040aeaa0 con 0x7f1d041542a0 2023-07-27T14:33:00.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.605+0000 7f1cfa7fc700 1 -- 172.21.15.115:0/3576627638 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc010a10 con 0x7f1d041542a0 2023-07-27T14:33:00.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.605+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d040af060 con 0x7f1d041542a0 2023-07-27T14:33:00.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.606+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d040c1e50 con 0x7f1d041542a0 2023-07-27T14:33:00.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.607+0000 7f1cfa7fc700 1 -- 172.21.15.115:0/3576627638 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f1cfc019030 con 0x7f1d041542a0 2023-07-27T14:33:00.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.607+0000 7f1cfa7fc700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ce805f4e0 0x7f1ce80619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:00.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.607+0000 7f1cfa7fc700 1 -- 172.21.15.115:0/3576627638 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f1cfc079c40 con 0x7f1d041542a0 2023-07-27T14:33:00.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.608+0000 7f1d0a39b700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ce805f4e0 0x7f1ce80619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:00.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.608+0000 7f1d0a39b700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ce805f4e0 0x7f1ce80619a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f1d00001270 tx=0x7f1d00009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:00.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.611+0000 7f1cfa7fc700 1 -- 172.21.15.115:0/3576627638 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d040c1e50 con 0x7f1d041542a0 2023-07-27T14:33:00.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.820+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d0406c470 con 0x7f1d041542a0 2023-07-27T14:33:00.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.821+0000 7f1cfa7fc700 1 -- 172.21.15.115:0/3576627638 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f1cfc04ad90 con 0x7f1d041542a0 2023-07-27T14:33:00.860 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:00.860 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/291900736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":291900736},{"type":"v1","addr":"172.21.15.159:6834","nonce":291900736}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6334,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/469026388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":469026388},{"type":"v1","addr":"172.21.15.115:6837","nonce":469026388}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1581340296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":1581340296},{"type":"v1","addr":"172.21.15.159:6835","nonce":1581340296}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7326,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1166300379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1166300379},{"type":"v1","addr":"172.21.15.115:6836","nonce":1166300379}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[]} 2023-07-27T14:33:00.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ce805f4e0 msgr2=0x7f1ce80619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ce805f4e0 0x7f1ce80619a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f1d00001270 tx=0x7f1d00009040).stop 2023-07-27T14:33:00.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d041542a0 msgr2=0x7f1d040afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:00.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d041542a0 0x7f1d040afdd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f1cfc00c7c0 tx=0x7f1cfc0014e0).stop 2023-07-27T14:33:00.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 shutdown_connections 2023-07-27T14:33:00.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ce805f4e0 0x7f1ce80619a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d041542a0 0x7f1d040afdd0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d040aaa40 0x7f1d04144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 --2- 172.21.15.115:0/3576627638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04153ec0 0x7f1d040af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:00.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 >> 172.21.15.115:0/3576627638 conn(0x7f1d040cb610 msgr2=0x7f1d04154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:00.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 shutdown_connections 2023-07-27T14:33:00.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:00.823+0000 7f1d0c5ff700 1 -- 172.21.15.115:0/3576627638 wait complete. 2023-07-27T14:33:00.865 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 54 2023-07-27T14:33:00.878 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:33:00.878 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:33:00.879 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:33:00.879 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:33:00.879 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:33:00.879 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:33:00.879 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:33:00.880 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:33:00.880 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:33:00.880 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:33:00.881 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:33:00.881 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:33:00.881 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:33:00.881 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:33:00.881 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:33:00.882 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:33:00.895 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:33:00.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:33:00.896 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:33:00.896 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:33:00.897 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:33:00.897 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:33:00.898 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:33:00.898 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:33:00.939 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:33:00.939 DEBUG:teuthology.parallel:result is None 2023-07-27T14:33:00.941 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:33:00.942 DEBUG:teuthology.parallel:result is None 2023-07-27T14:33:00.942 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:33:00.942 DEBUG:teuthology.parallel:result is None 2023-07-27T14:33:00.944 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:33:00.944 DEBUG:teuthology.parallel:result is None 2023-07-27T14:33:00.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:33:01.084 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:33:01.085 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:33:01.088 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:33:01.089 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:33:01.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.114+0000 7fcdaadff700 1 Processor -- start 2023-07-27T14:33:01.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.114+0000 7fcdaadff700 1 -- start start 2023-07-27T14:33:01.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.115+0000 7fcdaadff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcda4150320 0x7fcda4150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.115+0000 7fcdaadff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40c0e80 0x7fcda4069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.115+0000 7fcdaadff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda4068380 con 0x7fcda4065020 2023-07-27T14:33:01.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.115+0000 7fcdaadff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda4065790 con 0x7fcda4150320 2023-07-27T14:33:01.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.115+0000 7fcdaadff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4068ee0 con 0x7fcda40c0e80 2023-07-27T14:33:01.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda939c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcda4065020 0x7fcda40c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55352/0 (socket says 172.21.15.115:55352) 2023-07-27T14:33:01.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda939c700 1 -- 172.21.15.115:0/2878546892 learned_addr learned my addr 172.21.15.115:0/2878546892 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:01.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843352797 0 0) 0x7fcda4068380 con 0x7fcda4065020 2023-07-27T14:33:01.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda3fff700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40c0e80 0x7fcda4069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda8b9b700 1 --2- 172.21.15.115:0/2878546892 >> v2:172.21.15.159:3300/0 conn(0x7fcda4150320 0x7fcda4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd94004500 con 0x7fcda4065020 2023-07-27T14:33:01.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3199122485 0 0) 0x7fcd94004500 con 0x7fcda4065020 2023-07-27T14:33:01.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40c0e80 msgr2=0x7fcda4069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:01.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40c0e80 0x7fcda4069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:01.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 >> v2:172.21.15.159:3300/0 conn(0x7fcda4150320 msgr2=0x7fcda4150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:01.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 --2- 172.21.15.115:0/2878546892 >> v2:172.21.15.159:3300/0 conn(0x7fcda4150320 0x7fcda4150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:01.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40685b0 con 0x7fcda4065020 2023-07-27T14:33:01.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fcd9c0017f0 con 0x7fcda4065020 2023-07-27T14:33:01.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 >> v1:172.21.15.115:6789/0 conn(0x7fcda4065020 legacy=0x7fcda40c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:01.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd940049f0 0x7fcd94004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.116+0000 7fcda37fe700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940057a0 0x7fcd94005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda37fe700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40c0e80 0x7fcd94006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4065790 con 0x7fcd940049f0 2023-07-27T14:33:01.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4068ee0 con 0x7fcd940057a0 2023-07-27T14:33:01.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9400c9f0 con 0x7fcda40c0e80 2023-07-27T14:33:01.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda8b9b700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd940049f0 0x7fcd94004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda3fff700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940057a0 0x7fcd94005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda939c700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40c0e80 0x7fcd94006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda8b9b700 1 -- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40c0e80 msgr2=0x7fcd94006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:01.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda8b9b700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40c0e80 0x7fcd94006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:01.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda8b9b700 1 -- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940057a0 msgr2=0x7fcd94005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:01.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda8b9b700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940057a0 0x7fcd94005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:01.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda8b9b700 1 -- 172.21.15.115:0/2878546892 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94004500 con 0x7fcd940049f0 2023-07-27T14:33:01.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda3fff700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940057a0 0x7fcd94005c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:01.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.117+0000 7fcda8b9b700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd940049f0 0x7fcd94004e10 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fcd98009a80 tx=0x7fcd98009060).ready entity=mon.0 client_cookie=a4a19b1ec91a2860 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:01.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98009430 con 0x7fcd940049f0 2023-07-27T14:33:01.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9800e640 con 0x7fcd940049f0 2023-07-27T14:33:01.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcda37fe700 1 -- 172.21.15.115:0/2878546892 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800e9c0 con 0x7fcd940049f0 2023-07-27T14:33:01.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcdaadff700 1 -- 172.21.15.115:0/2878546892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd940049f0 msgr2=0x7fcd94004e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:01.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcdaadff700 1 --2- 172.21.15.115:0/2878546892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd940049f0 0x7fcd94004e10 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fcd98009a80 tx=0x7fcd98009060).stop 2023-07-27T14:33:01.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcda939c700 1 -- 172.21.15.115:0/2878546892 reap_dead start 2023-07-27T14:33:01.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcdaadff700 1 -- 172.21.15.115:0/2878546892 shutdown_connections 2023-07-27T14:33:01.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcdaadff700 1 -- 172.21.15.115:0/2878546892 >> 172.21.15.115:0/2878546892 conn(0x7fcda4062320 msgr2=0x7fcda4062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:01.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcdaadff700 1 -- 172.21.15.115:0/2878546892 shutdown_connections 2023-07-27T14:33:01.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.118+0000 7fcdaadff700 1 -- 172.21.15.115:0/2878546892 wait complete. 2023-07-27T14:33:01.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.120+0000 7fcdaadff700 1 Processor -- start 2023-07-27T14:33:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.120+0000 7fcdaadff700 1 -- start start 2023-07-27T14:33:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcdaadff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940049f0 0x7fcda40a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcdaadff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcda40beaa0 0x7fcda414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcdaadff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40bef20 0x7fcda4167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcdaadff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40aa100 con 0x7fcda40beaa0 2023-07-27T14:33:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcdaadff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40ac890 con 0x7fcd940049f0 2023-07-27T14:33:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcdaadff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40ac2f0 con 0x7fcda40bef20 2023-07-27T14:33:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcda3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcda40beaa0 0x7fcda414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcda3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcda40beaa0 0x7fcda414f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51932/0 (socket says 172.21.15.115:51932) 2023-07-27T14:33:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcda3fff700 1 -- 172.21.15.115:0/2891997673 learned_addr learned my addr 172.21.15.115:0/2891997673 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcda8b9b700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940049f0 0x7fcda40a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.121+0000 7fcda939c700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40bef20 0x7fcda4167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda3fff700 1 -- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40bef20 msgr2=0x7fcda4167a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda3fff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40bef20 0x7fcda4167a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda3fff700 1 -- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940049f0 msgr2=0x7fcda40a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda3fff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940049f0 0x7fcda40a9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda3fff700 1 -- 172.21.15.115:0/2891997673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40ac5b0 con 0x7fcda40beaa0 2023-07-27T14:33:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda939c700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40bef20 0x7fcda4167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda3fff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcda40beaa0 0x7fcda414f530 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fcd90011d40 tx=0x7fcd90009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda0ff9700 1 -- 172.21.15.115:0/2891997673 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000fac0 con 0x7fcda40beaa0 2023-07-27T14:33:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda0ff9700 1 -- 172.21.15.115:0/2891997673 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000fc20 con 0x7fcda40beaa0 2023-07-27T14:33:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcda0ff9700 1 -- 172.21.15.115:0/2891997673 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90014440 con 0x7fcda40beaa0 2023-07-27T14:33:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda4150830 con 0x7fcda40beaa0 2023-07-27T14:33:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.122+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda414fa20 con 0x7fcda40beaa0 2023-07-27T14:33:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.123+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda4150d50 con 0x7fcda40beaa0 2023-07-27T14:33:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.124+0000 7fcda0ff9700 1 -- 172.21.15.115:0/2891997673 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fcd90024070 con 0x7fcda40beaa0 2023-07-27T14:33:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.125+0000 7fcda0ff9700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd8805f510 0x7fcd880619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.126+0000 7fcda0ff9700 1 -- 172.21.15.115:0/2891997673 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fcd9007ae00 con 0x7fcda40beaa0 2023-07-27T14:33:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.126+0000 7fcda8b9b700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd8805f510 0x7fcd880619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.126+0000 7fcda8b9b700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd8805f510 0x7fcd880619d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fcd98006c40 tx=0x7fcd9801a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.130+0000 7fcda0ff9700 1 -- 172.21.15.115:0/2891997673 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcda4150d50 con 0x7fcda40beaa0 2023-07-27T14:33:01.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:01.311+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcda40c52b0 con 0x7fcda40beaa0 2023-07-27T14:33:02.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.086+0000 7fcda0ff9700 1 -- 172.21.15.115:0/2891997673 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcd90022070 con 0x7fcda40beaa0 2023-07-27T14:33:02.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd8805f510 msgr2=0x7fcd880619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd8805f510 0x7fcd880619d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fcd98006c40 tx=0x7fcd9801a000).stop 2023-07-27T14:33:02.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcda40beaa0 msgr2=0x7fcda414f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcda40beaa0 0x7fcda414f530 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fcd90011d40 tx=0x7fcd90009060).stop 2023-07-27T14:33:02.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 shutdown_connections 2023-07-27T14:33:02.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd8805f510 0x7fcd880619d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcda40bef20 0x7fcda4167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd940049f0 0x7fcda40a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.088+0000 7fcdaadff700 1 --2- 172.21.15.115:0/2891997673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcda40beaa0 0x7fcda414f530 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.089+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 >> 172.21.15.115:0/2891997673 conn(0x7fcda4062320 msgr2=0x7fcda40c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:02.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.089+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 shutdown_connections 2023-07-27T14:33:02.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.089+0000 7fcdaadff700 1 -- 172.21.15.115:0/2891997673 wait complete. 2023-07-27T14:33:02.128 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:33:02.145 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:33:02.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.296+0000 7f4955fff700 1 Processor -- start 2023-07-27T14:33:02.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.296+0000 7f4955fff700 1 -- start start 2023-07-27T14:33:02.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.297+0000 7f4955fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f49501542a0 0x7f495015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.297+0000 7f4955fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500aa4d0 con 0x7f49500aaa40 2023-07-27T14:33:02.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.297+0000 7f4955fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500c05c0 con 0x7f4950153ec0 2023-07-27T14:33:02.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.297+0000 7f4955fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49500c1a60 con 0x7f49501542a0 2023-07-27T14:33:02.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f49500aaa40 0x7f49500640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55358/0 (socket says 172.21.15.115:55358) 2023-07-27T14:33:02.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494effd700 1 -- 172.21.15.115:0/1294125975 learned_addr learned my addr 172.21.15.115:0/1294125975 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:02.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494ffff700 1 --2- 172.21.15.115:0/1294125975 >> v2:172.21.15.159:3300/0 conn(0x7f49501542a0 0x7f495015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256085999 0 0) 0x7f4944001110 con 0x7f49500aaa40 2023-07-27T14:33:02.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49380033f0 con 0x7f49500aaa40 2023-07-27T14:33:02.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461962279 0 0) 0x7f49500c05c0 con 0x7f4950153ec0 2023-07-27T14:33:02.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4944001110 con 0x7f4950153ec0 2023-07-27T14:33:02.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 764714572 0 0) 0x7f49380033f0 con 0x7f49500aaa40 2023-07-27T14:33:02.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 >> v2:172.21.15.159:3300/0 conn(0x7f49501542a0 msgr2=0x7f495015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:02.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 --2- 172.21.15.115:0/1294125975 >> v2:172.21.15.159:3300/0 conn(0x7f49501542a0 0x7f495015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 >> v1:172.21.15.159:6789/0 conn(0x7f4950153ec0 legacy=0x7f49500a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500aa270 con 0x7f49500aaa40 2023-07-27T14:33:02.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4944001600 con 0x7f49500aaa40 2023-07-27T14:33:02.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 >> v1:172.21.15.115:6789/0 conn(0x7f49500aaa40 legacy=0x7f49500640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4938003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.298+0000 7f494e7fc700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4938004690 0x7f4938004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494e7fc700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4938005000 0x7f493800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c1a60 con 0x7f4938003a70 2023-07-27T14:33:02.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493800bf60 con 0x7f4938005000 2023-07-27T14:33:02.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493800c0d0 con 0x7f4938004690 2023-07-27T14:33:02.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494f7fe700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4938003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494ffff700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4938005000 0x7f493800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494effd700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4938004690 0x7f4938004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494f7fe700 1 -- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4938004690 msgr2=0x7f4938004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494f7fe700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4938004690 0x7f4938004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494f7fe700 1 -- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4938005000 msgr2=0x7f493800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494f7fe700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4938005000 0x7f493800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494f7fe700 1 -- 172.21.15.115:0/1294125975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380033f0 con 0x7f4938003a70 2023-07-27T14:33:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494ffff700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4938005000 0x7f493800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:02.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494ffff700 1 -- 172.21.15.115:0/1294125975 reap_dead start 2023-07-27T14:33:02.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494f7fe700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4938003e70 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f4940001890 tx=0x7f4940007bb0).ready entity=mon.0 client_cookie=33167041bfeef0c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:02.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940007020 con 0x7f4938003a70 2023-07-27T14:33:02.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4940007180 con 0x7f4938003a70 2023-07-27T14:33:02.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.299+0000 7f494e7fc700 1 -- 172.21.15.115:0/1294125975 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940007520 con 0x7f4938003a70 2023-07-27T14:33:02.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.300+0000 7f4955fff700 1 -- 172.21.15.115:0/1294125975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 msgr2=0x7f4938003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.300+0000 7f4955fff700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4938003e70 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f4940001890 tx=0x7f4940007bb0).stop 2023-07-27T14:33:02.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.300+0000 7f4955fff700 1 -- 172.21.15.115:0/1294125975 shutdown_connections 2023-07-27T14:33:02.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.300+0000 7f4955fff700 1 --2- 172.21.15.115:0/1294125975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4938003e70 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.300+0000 7f4955fff700 1 -- 172.21.15.115:0/1294125975 >> 172.21.15.115:0/1294125975 conn(0x7f49500cb610 msgr2=0x7f49500c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:02.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.300+0000 7f4955fff700 1 -- 172.21.15.115:0/1294125975 shutdown_connections 2023-07-27T14:33:02.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.300+0000 7f4955fff700 1 -- 172.21.15.115:0/1294125975 wait complete. 2023-07-27T14:33:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.302+0000 7f4955fff700 1 Processor -- start 2023-07-27T14:33:02.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.302+0000 7f4955fff700 1 -- start start 2023-07-27T14:33:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f4955fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4950150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f4955fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4950168030 0x7f49500b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f4955fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49500c9b60 0x7f49500c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f4955fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c37f0 con 0x7f4938003a70 2023-07-27T14:33:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f4955fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49501684b0 con 0x7f49500c9b60 2023-07-27T14:33:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f4955fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c4b00 con 0x7f4950168030 2023-07-27T14:33:02.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4950150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4950150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51948/0 (socket says 172.21.15.115:51948) 2023-07-27T14:33:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 -- 172.21.15.115:0/2172392878 learned_addr learned my addr 172.21.15.115:0/2172392878 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 -- 172.21.15.115:0/2172392878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4950168030 msgr2=0x7f49500b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4950168030 0x7f49500b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 -- 172.21.15.115:0/2172392878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49500c9b60 msgr2=0x7f49500c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494ffff700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49500c9b60 0x7f49500c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49500c9b60 0x7f49500c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 -- 172.21.15.115:0/2172392878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500ca4d0 con 0x7f4938003a70 2023-07-27T14:33:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494ffff700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49500c9b60 0x7f49500c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.304+0000 7f494f7fe700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4950150a70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f4940006eb0 tx=0x7f4940015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.305+0000 7f49377fe700 1 -- 172.21.15.115:0/2172392878 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940013460 con 0x7f4938003a70 2023-07-27T14:33:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.305+0000 7f49377fe700 1 -- 172.21.15.115:0/2172392878 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49400135c0 con 0x7f4938003a70 2023-07-27T14:33:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.305+0000 7f49377fe700 1 -- 172.21.15.115:0/2172392878 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940013960 con 0x7f4938003a70 2023-07-27T14:33:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.305+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49500c2c00 con 0x7f4938003a70 2023-07-27T14:33:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.305+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49500c31a0 con 0x7f4938003a70 2023-07-27T14:33:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.306+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49500c3ad0 con 0x7f4938003a70 2023-07-27T14:33:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.307+0000 7f49377fe700 1 -- 172.21.15.115:0/2172392878 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f4940025070 con 0x7f4938003a70 2023-07-27T14:33:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.307+0000 7f49377fe700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f493c05f4e0 0x7f493c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.308+0000 7f49377fe700 1 -- 172.21.15.115:0/2172392878 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f494007a3a0 con 0x7f4938003a70 2023-07-27T14:33:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.308+0000 7f494effd700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f493c05f4e0 0x7f493c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.308+0000 7f494effd700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f493c05f4e0 0x7f493c0619a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f4944001390 tx=0x7f49500c1ba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.312+0000 7f49377fe700 1 -- 172.21.15.115:0/2172392878 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f494004b870 con 0x7f4938003a70 2023-07-27T14:33:02.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.544+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f495006c470 con 0x7f4938003a70 2023-07-27T14:33:02.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.545+0000 7f49377fe700 1 -- 172.21.15.115:0/2172392878 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4940023070 con 0x7f4938003a70 2023-07-27T14:33:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:02.583 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:33:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:33:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:33:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:33:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:33:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:33:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:33:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:33:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:33:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:33:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:33:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:33:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:33:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:33:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:33:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:33:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:33:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:33:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:33:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:33:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:33:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:33:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:33:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:33:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:33:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:33:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:33:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:33:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:33:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:33:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:33:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:33:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:33:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:33:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:33:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:33:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:33:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:33:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:33:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:33:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:33:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:33:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:33:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:33:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:33:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:33:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:33:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:33:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:33:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:33:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:33:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:33:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:33:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:33:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:33:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:33:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:33:02.611 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:33:02.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f493c05f4e0 msgr2=0x7f493c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f493c05f4e0 0x7f493c0619a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f4944001390 tx=0x7f49500c1ba0).stop 2023-07-27T14:33:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 msgr2=0x7f4950150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4950150a70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f4940006eb0 tx=0x7f4940015000).stop 2023-07-27T14:33:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 shutdown_connections 2023-07-27T14:33:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f493c05f4e0 0x7f493c0619a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49500c9b60 0x7f49500c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4938003a70 0x7f4950150a70 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 --2- 172.21.15.115:0/2172392878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4950168030 0x7f49500b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:02.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 >> 172.21.15.115:0/2172392878 conn(0x7f49500cb610 msgr2=0x7f49500ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:02.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 shutdown_connections 2023-07-27T14:33:02.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.547+0000 7f4955fff700 1 -- 172.21.15.115:0/2172392878 wait complete. 2023-07-27T14:33:02.614 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:02.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.765+0000 7fd12e9ff700 1 Processor -- start 2023-07-27T14:33:02.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.765+0000 7fd12e9ff700 1 -- start start 2023-07-27T14:33:02.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.766+0000 7fd12e9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd1280aaa40 0x7fd1280640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.766+0000 7fd12e9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280aa4d0 con 0x7fd1281542a0 2023-07-27T14:33:02.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.766+0000 7fd12e9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280c05c0 con 0x7fd128153ec0 2023-07-27T14:33:02.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.766+0000 7fd12e9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280aa270 con 0x7fd1280aaa40 2023-07-27T14:33:02.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.766+0000 7fd12cf9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd1281542a0 0x7fd1280c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55372/0 (socket says 172.21.15.115:55372) 2023-07-27T14:33:02.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.766+0000 7fd12cf9c700 1 -- 172.21.15.115:0/1103561325 learned_addr learned my addr 172.21.15.115:0/1103561325 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:02.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd1277fe700 1 --2- 172.21.15.115:0/1103561325 >> v2:172.21.15.159:3300/0 conn(0x7fd1280aaa40 0x7fd1280640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314547450 0 0) 0x7fd120001490 con 0x7fd1281542a0 2023-07-27T14:33:02.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1100033f0 con 0x7fd1281542a0 2023-07-27T14:33:02.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1256360528 0 0) 0x7fd1100033f0 con 0x7fd1281542a0 2023-07-27T14:33:02.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 >> v2:172.21.15.159:3300/0 conn(0x7fd1280aaa40 msgr2=0x7fd1280640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:02.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 --2- 172.21.15.115:0/1103561325 >> v2:172.21.15.159:3300/0 conn(0x7fd1280aaa40 0x7fd1280640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 >> v1:172.21.15.159:6789/0 conn(0x7fd128153ec0 legacy=0x7fd1280a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280bfc90 con 0x7fd1281542a0 2023-07-27T14:33:02.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fd120001980 con 0x7fd1281542a0 2023-07-27T14:33:02.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd1277fe700 1 --2- 172.21.15.115:0/1103561325 >> v2:172.21.15.159:3300/0 conn(0x7fd1280aaa40 0x7fd1280640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:02.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 >> v1:172.21.15.115:6789/0 conn(0x7fd1281542a0 legacy=0x7fd1280c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd110003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd110004690 0x7fd110004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd110005000 0x7fd11000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280aa270 con 0x7fd1100038e0 2023-07-27T14:33:02.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11000beb0 con 0x7fd110004690 2023-07-27T14:33:02.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.767+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11000c070 con 0x7fd110005000 2023-07-27T14:33:02.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd127fff700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd110003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd1277fe700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd110004690 0x7fd110004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd12cf9c700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd110005000 0x7fd11000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd127fff700 1 -- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd110005000 msgr2=0x7fd11000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:02.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd127fff700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd110005000 0x7fd11000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd127fff700 1 -- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd110004690 msgr2=0x7fd110004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:02.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd127fff700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd110004690 0x7fd110004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd127fff700 1 -- 172.21.15.115:0/1103561325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100033f0 con 0x7fd1100038e0 2023-07-27T14:33:02.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd12cf9c700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd110005000 0x7fd11000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:02.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd12cf9c700 1 -- 172.21.15.115:0/1103561325 reap_dead start 2023-07-27T14:33:02.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd127fff700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd110003cc0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fd118001820 tx=0x7fd118007b90).ready entity=mon.0 client_cookie=78eb793bf31c839f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:02.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118007ea0 con 0x7fd1100038e0 2023-07-27T14:33:02.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118012400 con 0x7fd1100038e0 2023-07-27T14:33:02.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.768+0000 7fd126ffd700 1 -- 172.21.15.115:0/1103561325 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180127a0 con 0x7fd1100038e0 2023-07-27T14:33:02.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.769+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1103561325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 msgr2=0x7fd110003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.769+0000 7fd12e9ff700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd110003cc0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fd118001820 tx=0x7fd118007b90).stop 2023-07-27T14:33:02.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.769+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1103561325 shutdown_connections 2023-07-27T14:33:02.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.769+0000 7fd12e9ff700 1 --2- 172.21.15.115:0/1103561325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd110003cc0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.769+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1103561325 >> 172.21.15.115:0/1103561325 conn(0x7fd1280cb610 msgr2=0x7fd1280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:02.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.769+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1103561325 shutdown_connections 2023-07-27T14:33:02.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.769+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1103561325 wait complete. 2023-07-27T14:33:02.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.771+0000 7fd12e9ff700 1 Processor -- start 2023-07-27T14:33:02.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.771+0000 7fd12e9ff700 1 -- start start 2023-07-27T14:33:02.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.772+0000 7fd12e9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd128156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.772+0000 7fd12e9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd128148be0 0x7fd1280afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.772+0000 7fd12e9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd128155650 0x7fd1280b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.772+0000 7fd12e9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280b0880 con 0x7fd1100038e0 2023-07-27T14:33:02.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.772+0000 7fd12e9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280adb40 con 0x7fd128155650 2023-07-27T14:33:02.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.772+0000 7fd12e9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd128156b50 con 0x7fd128148be0 2023-07-27T14:33:02.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd128156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd128156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51968/0 (socket says 172.21.15.115:51968) 2023-07-27T14:33:02.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 -- 172.21.15.115:0/1937880232 learned_addr learned my addr 172.21.15.115:0/1937880232 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:02.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd12cf9c700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd128155650 0x7fd1280b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd1277fe700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd128148be0 0x7fd1280afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 -- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd128148be0 msgr2=0x7fd1280afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd128148be0 0x7fd1280afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 -- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd128155650 msgr2=0x7fd1280b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd128155650 0x7fd1280b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 -- 172.21.15.115:0/1937880232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128156e30 con 0x7fd1100038e0 2023-07-27T14:33:02.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd1277fe700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd128148be0 0x7fd1280afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:02.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd127fff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd128156570 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fd118012e80 tx=0x7fd118016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:02.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.773+0000 7fd10ffff700 1 -- 172.21.15.115:0/1937880232 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118007ea0 con 0x7fd1100038e0 2023-07-27T14:33:02.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.774+0000 7fd10ffff700 1 -- 172.21.15.115:0/1937880232 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118007240 con 0x7fd1100038e0 2023-07-27T14:33:02.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.774+0000 7fd10ffff700 1 -- 172.21.15.115:0/1937880232 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180075e0 con 0x7fd1100038e0 2023-07-27T14:33:02.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.774+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1280add90 con 0x7fd1100038e0 2023-07-27T14:33:02.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.774+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1280c4510 con 0x7fd1100038e0 2023-07-27T14:33:02.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.775+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12806c470 con 0x7fd1100038e0 2023-07-27T14:33:02.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.775+0000 7fd10ffff700 1 -- 172.21.15.115:0/1937880232 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fd11801b040 con 0x7fd1100038e0 2023-07-27T14:33:02.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.776+0000 7fd10ffff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd11405f4b0 0x7fd114061970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:02.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.776+0000 7fd10ffff700 1 -- 172.21.15.115:0/1937880232 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd11807acb0 con 0x7fd1100038e0 2023-07-27T14:33:02.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.777+0000 7fd1277fe700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd11405f4b0 0x7fd114061970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:02.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.777+0000 7fd1277fe700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd11405f4b0 0x7fd114061970 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fd11c009270 tx=0x7fd11c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:02.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.781+0000 7fd10ffff700 1 -- 172.21.15.115:0/1937880232 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd11804bd40 con 0x7fd1100038e0 2023-07-27T14:33:02.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.951+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1280bff70 con 0x7fd1100038e0 2023-07-27T14:33:02.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.952+0000 7fd10ffff700 1 -- 172.21.15.115:0/1937880232 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+13862 (secure 0 0 0) 0x7fd118023020 con 0x7fd1100038e0 2023-07-27T14:33:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:02.990 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":110,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:02.079991+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:02.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd11405f4b0 msgr2=0x7fd114061970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd11405f4b0 0x7fd114061970 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fd11c009270 tx=0x7fd11c008040).stop 2023-07-27T14:33:02.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 msgr2=0x7fd128156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:02.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd128156570 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fd118012e80 tx=0x7fd118016000).stop 2023-07-27T14:33:02.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 shutdown_connections 2023-07-27T14:33:02.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd11405f4b0 0x7fd114061970 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd128155650 0x7fd1280b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1100038e0 0x7fd128156570 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 --2- 172.21.15.115:0/1937880232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd128148be0 0x7fd1280afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:02.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 >> 172.21.15.115:0/1937880232 conn(0x7fd1280cb610 msgr2=0x7fd1280c1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:02.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 shutdown_connections 2023-07-27T14:33:02.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:02.954+0000 7fd12e9ff700 1 -- 172.21.15.115:0/1937880232 wait complete. 2023-07-27T14:33:03.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:33:03.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:33:03.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.162+0000 7f79521ff700 1 Processor -- start 2023-07-27T14:33:03.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.163+0000 7f79521ff700 1 -- start start 2023-07-27T14:33:03.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f79521ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c14ae00 0x7f794c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f79521ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f794c063260 0x7f794c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f79521ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c1553f0 con 0x7f794c14b1e0 2023-07-27T14:33:03.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f79521ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c157a50 con 0x7f794c063260 2023-07-27T14:33:03.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f79521ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c157d10 con 0x7f794c14ae00 2023-07-27T14:33:03.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f794affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f794c14b1e0 0x7f794c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55380/0 (socket says 172.21.15.115:55380) 2023-07-27T14:33:03.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f794affd700 1 -- 172.21.15.115:0/925254482 learned_addr learned my addr 172.21.15.115:0/925254482 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:03.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f794b7fe700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c14ae00 0x7f794c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.164+0000 7f794bfff700 1 --2- 172.21.15.115:0/925254482 >> v2:172.21.15.159:3300/0 conn(0x7f794c063260 0x7f794c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861110107 0 0) 0x7f794c1553f0 con 0x7f794c14b1e0 2023-07-27T14:33:03.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79340033f0 con 0x7f794c14b1e0 2023-07-27T14:33:03.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 666469306 0 0) 0x7f79340033f0 con 0x7f794c14b1e0 2023-07-27T14:33:03.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c14ae00 msgr2=0x7f794c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c14ae00 0x7f794c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 >> v2:172.21.15.159:3300/0 conn(0x7f794c063260 msgr2=0x7f794c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 --2- 172.21.15.115:0/925254482 >> v2:172.21.15.159:3300/0 conn(0x7f794c063260 0x7f794c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c157ff0 con 0x7f794c14b1e0 2023-07-27T14:33:03.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f7940001470 con 0x7f794c14b1e0 2023-07-27T14:33:03.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794bfff700 1 --2- 172.21.15.115:0/925254482 >> v2:172.21.15.159:3300/0 conn(0x7f794c063260 0x7f794c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:03.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 >> v1:172.21.15.115:6789/0 conn(0x7f794c14b1e0 legacy=0x7f794c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c14ae00 0x7f79340038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7934003e10 0x7f7934004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7934004b80 0x7f7934005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c157a50 con 0x7f7934004b80 2023-07-27T14:33:03.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c157d10 con 0x7f7934003e10 2023-07-27T14:33:03.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793400b8e0 con 0x7f794c14ae00 2023-07-27T14:33:03.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794bfff700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7934004b80 0x7f7934005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794b7fe700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c14ae00 0x7f79340038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.165+0000 7f794affd700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7934003e10 0x7f7934004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794bfff700 1 -- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c14ae00 msgr2=0x7f79340038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794bfff700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c14ae00 0x7f79340038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794bfff700 1 -- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7934003e10 msgr2=0x7f7934004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794bfff700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7934003e10 0x7f7934004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794bfff700 1 -- 172.21.15.115:0/925254482 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79340033f0 con 0x7f7934004b80 2023-07-27T14:33:03.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794bfff700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7934004b80 0x7f7934005000 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f794400e3f0 tx=0x7f794400b040).ready entity=mon.0 client_cookie=36fd76d11912071e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:03.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944009c50 con 0x7f7934004b80 2023-07-27T14:33:03.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794400f040 con 0x7f7934004b80 2023-07-27T14:33:03.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.166+0000 7f794a7fc700 1 -- 172.21.15.115:0/925254482 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400eeb0 con 0x7f7934004b80 2023-07-27T14:33:03.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.167+0000 7f79521ff700 1 -- 172.21.15.115:0/925254482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7934004b80 msgr2=0x7f7934005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.167+0000 7f79521ff700 1 --2- 172.21.15.115:0/925254482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7934004b80 0x7f7934005000 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f794400e3f0 tx=0x7f794400b040).stop 2023-07-27T14:33:03.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.167+0000 7f794bfff700 1 -- 172.21.15.115:0/925254482 reap_dead start 2023-07-27T14:33:03.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.167+0000 7f79521ff700 1 -- 172.21.15.115:0/925254482 shutdown_connections 2023-07-27T14:33:03.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.167+0000 7f79521ff700 1 -- 172.21.15.115:0/925254482 >> 172.21.15.115:0/925254482 conn(0x7f794c05e940 msgr2=0x7f794c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:03.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.167+0000 7f79521ff700 1 -- 172.21.15.115:0/925254482 shutdown_connections 2023-07-27T14:33:03.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.167+0000 7f79521ff700 1 -- 172.21.15.115:0/925254482 wait complete. 2023-07-27T14:33:03.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.168+0000 7f79521ff700 1 Processor -- start 2023-07-27T14:33:03.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.168+0000 7f79521ff700 1 -- start start 2023-07-27T14:33:03.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.169+0000 7f79521ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7934004b80 0x7f794c147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.169+0000 7f79521ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f794c0c35a0 0x7f794c0640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.169+0000 7f79521ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c0c3a20 0x7f794c0645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.169+0000 7f79521ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c064a90 con 0x7f794c0c35a0 2023-07-27T14:33:03.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.169+0000 7f79521ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c148400 con 0x7f7934004b80 2023-07-27T14:33:03.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.169+0000 7f79521ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0c3f80 con 0x7f794c0c3a20 2023-07-27T14:33:03.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f794c0c35a0 0x7f794c0640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f794c0c35a0 0x7f794c0640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51992/0 (socket says 172.21.15.115:51992) 2023-07-27T14:33:03.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 -- 172.21.15.115:0/967176473 learned_addr learned my addr 172.21.15.115:0/967176473 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:03.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 -- 172.21.15.115:0/967176473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c0c3a20 msgr2=0x7f794c0645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c0c3a20 0x7f794c0645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:03.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 -- 172.21.15.115:0/967176473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7934004b80 msgr2=0x7f794c147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7934004b80 0x7f794c147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:03.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 -- 172.21.15.115:0/967176473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0c4260 con 0x7f794c0c35a0 2023-07-27T14:33:03.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f794affd700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f794c0c35a0 0x7f794c0640b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f79400010e0 tx=0x7f79400077c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:03.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f79337fe700 1 -- 172.21.15.115:0/967176473 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940011590 con 0x7f794c0c35a0 2023-07-27T14:33:03.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f79337fe700 1 -- 172.21.15.115:0/967176473 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79400116f0 con 0x7f794c0c35a0 2023-07-27T14:33:03.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f79337fe700 1 -- 172.21.15.115:0/967176473 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940011ab0 con 0x7f794c0c35a0 2023-07-27T14:33:03.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c0c4540 con 0x7f794c0c35a0 2023-07-27T14:33:03.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.170+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c0b07f0 con 0x7f794c0c35a0 2023-07-27T14:33:03.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.171+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0b09e0 con 0x7f794c0c35a0 2023-07-27T14:33:03.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.172+0000 7f79337fe700 1 -- 172.21.15.115:0/967176473 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f794001b030 con 0x7f794c0c35a0 2023-07-27T14:33:03.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.173+0000 7f79337fe700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f793805f4e0 0x7f79380619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.173+0000 7f79337fe700 1 -- 172.21.15.115:0/967176473 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7940079a80 con 0x7f794c0c35a0 2023-07-27T14:33:03.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.173+0000 7f794b7fe700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f793805f4e0 0x7f79380619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.174+0000 7f794b7fe700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f793805f4e0 0x7f79380619a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f793c006d30 tx=0x7f793c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:03.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.177+0000 7f79337fe700 1 -- 172.21.15.115:0/967176473 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f794004acd0 con 0x7f794c0c35a0 2023-07-27T14:33:03.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.345+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f794c06c470 con 0x7f794c0c35a0 2023-07-27T14:33:03.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.346+0000 7f79337fe700 1 -- 172.21.15.115:0/967176473 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v110) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7940019020 con 0x7f794c0c35a0 2023-07-27T14:33:03.384 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:33:03.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f793805f4e0 msgr2=0x7f79380619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f793805f4e0 0x7f79380619a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f793c006d30 tx=0x7f793c009060).stop 2023-07-27T14:33:03.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f794c0c35a0 msgr2=0x7f794c0640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f794c0c35a0 0x7f794c0640b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f79400010e0 tx=0x7f79400077c0).stop 2023-07-27T14:33:03.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 shutdown_connections 2023-07-27T14:33:03.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f793805f4e0 0x7f79380619a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f794c0c3a20 0x7f794c0645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:03.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7934004b80 0x7f794c147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:03.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 --2- 172.21.15.115:0/967176473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f794c0c35a0 0x7f794c0640b0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 >> 172.21.15.115:0/967176473 conn(0x7f794c05e940 msgr2=0x7f794c0aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:03.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 shutdown_connections 2023-07-27T14:33:03.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.348+0000 7f79521ff700 1 -- 172.21.15.115:0/967176473 wait complete. 2023-07-27T14:33:03.403 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:33:03.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.555+0000 7f336f3ff700 1 Processor -- start 2023-07-27T14:33:03.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.555+0000 7f336f3ff700 1 -- start start 2023-07-27T14:33:03.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f336f3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3368150220 0x7f3368150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f336f3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3368068bb0 con 0x7f33680c0ea0 2023-07-27T14:33:03.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f336f3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336806a250 con 0x7f3368065220 2023-07-27T14:33:03.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f336f3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680656b0 con 0x7f3368150220 2023-07-27T14:33:03.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f336c99a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f33680c0ea0 0x7f3368069040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37082/0 (socket says 172.21.15.115:37082) 2023-07-27T14:33:03.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f336c99a700 1 -- 172.21.15.115:0/1130763232 learned_addr learned my addr 172.21.15.115:0/1130763232 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:03.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f336d19b700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3368150220 0x7f3368150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002481990 0 0) 0x7f3368068bb0 con 0x7f33680c0ea0 2023-07-27T14:33:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.557+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3354004500 con 0x7f33680c0ea0 2023-07-27T14:33:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817686135 0 0) 0x7f336806a250 con 0x7f3368065220 2023-07-27T14:33:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3368068bb0 con 0x7f3368065220 2023-07-27T14:33:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764822152 0 0) 0x7f3354004500 con 0x7f33680c0ea0 2023-07-27T14:33:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3368150220 msgr2=0x7f3368150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3368150220 0x7f3368150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 >> v1:172.21.15.159:6789/0 conn(0x7f3368065220 legacy=0x7f33680c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680c1380 con 0x7f33680c0ea0 2023-07-27T14:33:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f33580013f0 con 0x7f33680c0ea0 2023-07-27T14:33:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 >> v1:172.21.15.115:6789/0 conn(0x7f33680c0ea0 legacy=0x7f3368069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354004bb0 0x7f3354004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33540057a0 0x7f3354005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3354006110 0x7f3354003310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680656b0 con 0x7f3354006110 2023-07-27T14:33:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3354003860 con 0x7f3354004bb0 2023-07-27T14:33:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3354003a20 con 0x7f33540057a0 2023-07-27T14:33:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f336d19b700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3368150220 0x7f3368150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f336d99c700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3354006110 0x7f3354003310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f336c99a700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33540057a0 0x7f3354005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.558+0000 7f336d19b700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354004bb0 0x7f3354004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336d99c700 1 -- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33540057a0 msgr2=0x7f3354005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336d99c700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33540057a0 0x7f3354005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336d99c700 1 -- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354004bb0 msgr2=0x7f3354004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336d99c700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354004bb0 0x7f3354004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336d99c700 1 -- 172.21.15.115:0/1130763232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354004500 con 0x7f3354006110 2023-07-27T14:33:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336d99c700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3354006110 0x7f3354003310 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f3360001f90 tx=0x7f3360007f30).ready entity=mon.0 client_cookie=a4ab323d343472bb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600020f0 con 0x7f3354006110 2023-07-27T14:33:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3360006a20 con 0x7f3354006110 2023-07-27T14:33:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f335ffff700 1 -- 172.21.15.115:0/1130763232 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360006dc0 con 0x7f3354006110 2023-07-27T14:33:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336f3ff700 1 -- 172.21.15.115:0/1130763232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3354006110 msgr2=0x7f3354003310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336f3ff700 1 --2- 172.21.15.115:0/1130763232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3354006110 0x7f3354003310 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f3360001f90 tx=0x7f3360007f30).stop 2023-07-27T14:33:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336d99c700 1 -- 172.21.15.115:0/1130763232 reap_dead start 2023-07-27T14:33:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336f3ff700 1 -- 172.21.15.115:0/1130763232 shutdown_connections 2023-07-27T14:33:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.559+0000 7f336f3ff700 1 -- 172.21.15.115:0/1130763232 >> 172.21.15.115:0/1130763232 conn(0x7f3368062320 msgr2=0x7f3368062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.560+0000 7f336f3ff700 1 -- 172.21.15.115:0/1130763232 shutdown_connections 2023-07-27T14:33:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.560+0000 7f336f3ff700 1 -- 172.21.15.115:0/1130763232 wait complete. 2023-07-27T14:33:03.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.561+0000 7f336f3ff700 1 Processor -- start 2023-07-27T14:33:03.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.561+0000 7f336f3ff700 1 -- start start 2023-07-27T14:33:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336f3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354006110 0x7f33680c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336f3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33680be980 0x7f33680a73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336f3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33680c1d50 0x7f336814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336f3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33681543e0 con 0x7f33680be980 2023-07-27T14:33:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336f3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680a7e40 con 0x7f3354006110 2023-07-27T14:33:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336f3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680a8120 con 0x7f33680c1d50 2023-07-27T14:33:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336c99a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33680be980 0x7f33680a73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336c99a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33680be980 0x7f33680a73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54474/0 (socket says 172.21.15.115:54474) 2023-07-27T14:33:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336c99a700 1 -- 172.21.15.115:0/1949007363 learned_addr learned my addr 172.21.15.115:0/1949007363 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336d19b700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354006110 0x7f33680c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.562+0000 7f336d99c700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33680c1d50 0x7f336814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f336c99a700 1 -- 172.21.15.115:0/1949007363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33680c1d50 msgr2=0x7f336814f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f336c99a700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33680c1d50 0x7f336814f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f336c99a700 1 -- 172.21.15.115:0/1949007363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354006110 msgr2=0x7f33680c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f336c99a700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354006110 0x7f33680c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f336c99a700 1 -- 172.21.15.115:0/1949007363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680a8400 con 0x7f33680be980 2023-07-27T14:33:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f336c99a700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33680be980 0x7f33680a73f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f3358007f80 tx=0x7f33680c2bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f335d7fa700 1 -- 172.21.15.115:0/1949007363 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580114c0 con 0x7f33680be980 2023-07-27T14:33:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f335d7fa700 1 -- 172.21.15.115:0/1949007363 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358011620 con 0x7f33680be980 2023-07-27T14:33:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3368154070 con 0x7f33680be980 2023-07-27T14:33:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f335d7fa700 1 -- 172.21.15.115:0/1949007363 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580119a0 con 0x7f33680be980 2023-07-27T14:33:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.563+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33680a78e0 con 0x7f33680be980 2023-07-27T14:33:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.564+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3368154590 con 0x7f33680be980 2023-07-27T14:33:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.565+0000 7f335d7fa700 1 -- 172.21.15.115:0/1949007363 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f335801b030 con 0x7f33680be980 2023-07-27T14:33:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.566+0000 7f335d7fa700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f334c05f4e0 0x7f334c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.566+0000 7f335d7fa700 1 -- 172.21.15.115:0/1949007363 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f33580798f0 con 0x7f33680be980 2023-07-27T14:33:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.566+0000 7f336d19b700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f334c05f4e0 0x7f334c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.567+0000 7f336d19b700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f334c05f4e0 0x7f334c0619a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f3368067850 tx=0x7f3364009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.570+0000 7f335d7fa700 1 -- 172.21.15.115:0/1949007363 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3368154590 con 0x7f33680be980 2023-07-27T14:33:03.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.739+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f336806c470 con 0x7f33680be980 2023-07-27T14:33:03.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.739+0000 7f335d7fa700 1 -- 172.21.15.115:0/1949007363 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3358019020 con 0x7f33680be980 2023-07-27T14:33:03.778 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:33:03.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f334c05f4e0 msgr2=0x7f334c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f334c05f4e0 0x7f334c0619a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f3368067850 tx=0x7f3364009060).stop 2023-07-27T14:33:03.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33680be980 msgr2=0x7f33680a73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33680be980 0x7f33680a73f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f3358007f80 tx=0x7f33680c2bf0).stop 2023-07-27T14:33:03.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 shutdown_connections 2023-07-27T14:33:03.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f334c05f4e0 0x7f334c0619a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33680c1d50 0x7f336814f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3354006110 0x7f33680c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 --2- 172.21.15.115:0/1949007363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33680be980 0x7f33680a73f0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 >> 172.21.15.115:0/1949007363 conn(0x7f3368062320 msgr2=0x7f33680c5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:03.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.741+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 shutdown_connections 2023-07-27T14:33:03.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.742+0000 7f336f3ff700 1 -- 172.21.15.115:0/1949007363 wait complete. 2023-07-27T14:33:03.798 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:33:03.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.948+0000 7fb0809ff700 1 Processor -- start 2023-07-27T14:33:03.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.948+0000 7fb0809ff700 1 -- start start 2023-07-27T14:33:03.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.949+0000 7fb0809ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c066b80 0x7fb07c15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.949+0000 7fb0809ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c067080 con 0x7fb07c065ff0 2023-07-27T14:33:03.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.949+0000 7fb0809ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c068570 con 0x7fb07c151d70 2023-07-27T14:33:03.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.949+0000 7fb0809ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c063a90 con 0x7fb07c066b80 2023-07-27T14:33:03.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.949+0000 7fb079d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb07c065ff0 0x7fb07c066470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37086/0 (socket says 172.21.15.115:37086) 2023-07-27T14:33:03.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.949+0000 7fb079d9b700 1 -- 172.21.15.115:0/4170642014 learned_addr learned my addr 172.21.15.115:0/4170642014 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:03.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07ad9d700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c066b80 0x7fb07c15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359085615 0 0) 0x7fb07c067080 con 0x7fb07c065ff0 2023-07-27T14:33:03.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0640033f0 con 0x7fb07c065ff0 2023-07-27T14:33:03.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2112287071 0 0) 0x7fb0640033f0 con 0x7fb07c065ff0 2023-07-27T14:33:03.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c066b80 msgr2=0x7fb07c15ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c066b80 0x7fb07c15ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 >> v1:172.21.15.159:6789/0 conn(0x7fb07c151d70 legacy=0x7fb07c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0634d0 con 0x7fb07c065ff0 2023-07-27T14:33:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb070001470 con 0x7fb07c065ff0 2023-07-27T14:33:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 >> v1:172.21.15.115:6789/0 conn(0x7fb07c065ff0 legacy=0x7fb07c066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb064003910 0x7fb064003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb064004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c066b80 0x7fb064005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c063a90 con 0x7fb064004690 2023-07-27T14:33:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06400b910 con 0x7fb064003910 2023-07-27T14:33:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.950+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06400bad0 con 0x7fb07c066b80 2023-07-27T14:33:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb079d9b700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb064004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb07a59c700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb064003910 0x7fb064003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb07ad9d700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c066b80 0x7fb064005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb079d9b700 1 -- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c066b80 msgr2=0x7fb064005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb079d9b700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c066b80 0x7fb064005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb079d9b700 1 -- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb064003910 msgr2=0x7fb064003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb079d9b700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb064003910 0x7fb064003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb079d9b700 1 -- 172.21.15.115:0/4170642014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640033f0 con 0x7fb064004690 2023-07-27T14:33:03.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb079d9b700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb064004b10 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fb07000c190 tx=0x7fb070001e50).ready entity=mon.0 client_cookie=29611260a27ab4a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:03.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070007a20 con 0x7fb064004690 2023-07-27T14:33:03.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07000cac0 con 0x7fb064004690 2023-07-27T14:33:03.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.951+0000 7fb07959a700 1 -- 172.21.15.115:0/4170642014 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000ce60 con 0x7fb064004690 2023-07-27T14:33:03.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.952+0000 7fb0809ff700 1 -- 172.21.15.115:0/4170642014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 msgr2=0x7fb064004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.952+0000 7fb0809ff700 1 --2- 172.21.15.115:0/4170642014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb064004b10 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fb07000c190 tx=0x7fb070001e50).stop 2023-07-27T14:33:03.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.952+0000 7fb07ad9d700 1 -- 172.21.15.115:0/4170642014 reap_dead start 2023-07-27T14:33:03.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.952+0000 7fb0809ff700 1 -- 172.21.15.115:0/4170642014 shutdown_connections 2023-07-27T14:33:03.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.952+0000 7fb0809ff700 1 -- 172.21.15.115:0/4170642014 >> 172.21.15.115:0/4170642014 conn(0x7fb07c0c89a0 msgr2=0x7fb07c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:03.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.952+0000 7fb0809ff700 1 -- 172.21.15.115:0/4170642014 shutdown_connections 2023-07-27T14:33:03.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.952+0000 7fb0809ff700 1 -- 172.21.15.115:0/4170642014 wait complete. 2023-07-27T14:33:03.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.953+0000 7fb0809ff700 1 Processor -- start 2023-07-27T14:33:03.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.954+0000 7fb0809ff700 1 -- start start 2023-07-27T14:33:03.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb0809ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb07c1640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb0809ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0a99e0 0x7fb07c0a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb0809ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c167bb0 0x7fb07c168010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:03.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb0809ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0a5170 con 0x7fb064004690 2023-07-27T14:33:03.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb0809ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c168500 con 0x7fb07c0a99e0 2023-07-27T14:33:03.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb0809ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0a4e40 con 0x7fb07c167bb0 2023-07-27T14:33:03.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb07c1640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb07c1640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54488/0 (socket says 172.21.15.115:54488) 2023-07-27T14:33:03.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 -- 172.21.15.115:0/1415035227 learned_addr learned my addr 172.21.15.115:0/1415035227 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:03.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb079d9b700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0a99e0 0x7fb07c0a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07ad9d700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c167bb0 0x7fb07c168010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:03.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 -- 172.21.15.115:0/1415035227 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c167bb0 msgr2=0x7fb07c168010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c167bb0 0x7fb07c168010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 -- 172.21.15.115:0/1415035227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0a99e0 msgr2=0x7fb07c0a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:03.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0a99e0 0x7fb07c0a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:03.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 -- 172.21.15.115:0/1415035227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0aa520 con 0x7fb064004690 2023-07-27T14:33:03.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.955+0000 7fb07a59c700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb07c1640d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fb06c00e4a0 tx=0x7fb06c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:03.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.956+0000 7fb06a7fc700 1 -- 172.21.15.115:0/1415035227 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c010450 con 0x7fb064004690 2023-07-27T14:33:03.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.956+0000 7fb06a7fc700 1 -- 172.21.15.115:0/1415035227 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c0105b0 con 0x7fb064004690 2023-07-27T14:33:03.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.956+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0aa800 con 0x7fb064004690 2023-07-27T14:33:03.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.956+0000 7fb06a7fc700 1 -- 172.21.15.115:0/1415035227 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c010930 con 0x7fb064004690 2023-07-27T14:33:03.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.956+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0a7610 con 0x7fb064004690 2023-07-27T14:33:03.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.957+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c0a5450 con 0x7fb064004690 2023-07-27T14:33:03.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.957+0000 7fb06a7fc700 1 -- 172.21.15.115:0/1415035227 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fb06c010d20 con 0x7fb064004690 2023-07-27T14:33:04.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.958+0000 7fb06a7fc700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05c05f4e0 0x7fb05c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:04.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.958+0000 7fb06a7fc700 1 -- 172.21.15.115:0/1415035227 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb06c07a0a0 con 0x7fb064004690 2023-07-27T14:33:04.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.958+0000 7fb079d9b700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05c05f4e0 0x7fb05c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:04.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.959+0000 7fb079d9b700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05c05f4e0 0x7fb05c0619a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb07c0c6010 tx=0x7fb070015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:04.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:03.962+0000 7fb06a7fc700 1 -- 172.21.15.115:0/1415035227 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb06c0498f0 con 0x7fb064004690 2023-07-27T14:33:04.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.132+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb07c06c470 con 0x7fb064004690 2023-07-27T14:33:04.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.133+0000 7fb06a7fc700 1 -- 172.21.15.115:0/1415035227 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v110) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb06c04b130 con 0x7fb064004690 2023-07-27T14:33:04.171 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:04.171 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:33:04.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:04.172 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:33:04.172 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:33:04.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:04.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:04.172 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:33:04.172 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:33:04.172 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:04.173 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:33:04.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05c05f4e0 msgr2=0x7fb05c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:04.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05c05f4e0 0x7fb05c0619a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb07c0c6010 tx=0x7fb070015000).stop 2023-07-27T14:33:04.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 msgr2=0x7fb07c1640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:04.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb07c1640d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fb06c00e4a0 tx=0x7fb06c009040).stop 2023-07-27T14:33:04.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 shutdown_connections 2023-07-27T14:33:04.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb05c05f4e0 0x7fb05c0619a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb07c167bb0 0x7fb07c168010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb064004690 0x7fb07c1640d0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 --2- 172.21.15.115:0/1415035227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb07c0a99e0 0x7fb07c0a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 >> 172.21.15.115:0/1415035227 conn(0x7fb07c0c89a0 msgr2=0x7fb07c153440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:04.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 shutdown_connections 2023-07-27T14:33:04.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.135+0000 7fb0809ff700 1 -- 172.21.15.115:0/1415035227 wait complete. 2023-07-27T14:33:04.190 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:33:04.191 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:33:04.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.345+0000 7facbd5ff700 1 Processor -- start 2023-07-27T14:33:04.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.345+0000 7facbd5ff700 1 -- start start 2023-07-27T14:33:04.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facbd5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7facb814ae00 0x7facb8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:04.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facbd5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7facb814b1e0 0x7facb8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:04.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facbd5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb80c5c50 0x7facb8063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:04.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facbd5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb8063530 con 0x7facb814ae00 2023-07-27T14:33:04.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facbd5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb81553f0 con 0x7facb814b1e0 2023-07-27T14:33:04.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facbd5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb8157a50 con 0x7facb80c5c50 2023-07-27T14:33:04.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7facb814ae00 0x7facb8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:04.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7facb814ae00 0x7facb8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54496/0 (socket says 172.21.15.115:54496) 2023-07-27T14:33:04.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb6ffd700 1 -- 172.21.15.115:0/1069958182 learned_addr learned my addr 172.21.15.115:0/1069958182 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:04.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb6ffd700 1 -- 172.21.15.115:0/1069958182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb80c5c50 msgr2=0x7facb8063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:04.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb6ffd700 1 --2- 172.21.15.115:0/1069958182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb80c5c50 0x7facb8063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:04.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb6ffd700 1 -- 172.21.15.115:0/1069958182 >> v2:172.21.15.159:3300/0 conn(0x7facb814b1e0 msgr2=0x7facb8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:04.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb67fc700 1 --2- 172.21.15.115:0/1069958182 >> v2:172.21.15.159:3300/0 conn(0x7facb814b1e0 0x7facb8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:04.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb6ffd700 1 --2- 172.21.15.115:0/1069958182 >> v2:172.21.15.159:3300/0 conn(0x7facb814b1e0 0x7facb8062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.347+0000 7facb6ffd700 1 -- 172.21.15.115:0/1069958182 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8157d10 con 0x7facb814ae00 2023-07-27T14:33:04.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facb67fc700 1 --2- 172.21.15.115:0/1069958182 >> v2:172.21.15.159:3300/0 conn(0x7facb814b1e0 0x7facb8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:04.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facb6ffd700 1 --2- 172.21.15.115:0/1069958182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb8154f00 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7facb80cbc00 tx=0x7faca80090f0).ready entity=mon.0 client_cookie=2bc6b640d6b4a1fe server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:04.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facb5ffb700 1 -- 172.21.15.115:0/1069958182 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800b600 con 0x7facb814ae00 2023-07-27T14:33:04.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facb5ffb700 1 -- 172.21.15.115:0/1069958182 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca800b760 con 0x7facb814ae00 2023-07-27T14:33:04.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facb5ffb700 1 -- 172.21.15.115:0/1069958182 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800bae0 con 0x7facb814ae00 2023-07-27T14:33:04.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facbd5ff700 1 -- 172.21.15.115:0/1069958182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 msgr2=0x7facb8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:04.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facbd5ff700 1 --2- 172.21.15.115:0/1069958182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb8154f00 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7facb80cbc00 tx=0x7faca80090f0).stop 2023-07-27T14:33:04.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facbd5ff700 1 -- 172.21.15.115:0/1069958182 shutdown_connections 2023-07-27T14:33:04.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facbd5ff700 1 --2- 172.21.15.115:0/1069958182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb80c5c50 0x7facb8063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:04.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facbd5ff700 1 --2- 172.21.15.115:0/1069958182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb8154f00 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facbd5ff700 1 --2- 172.21.15.115:0/1069958182 >> v2:172.21.15.159:3300/0 conn(0x7facb814b1e0 0x7facb8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.348+0000 7facbd5ff700 1 -- 172.21.15.115:0/1069958182 >> 172.21.15.115:0/1069958182 conn(0x7facb805e940 msgr2=0x7facb80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:04.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.349+0000 7facbd5ff700 1 -- 172.21.15.115:0/1069958182 shutdown_connections 2023-07-27T14:33:04.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.349+0000 7facbd5ff700 1 -- 172.21.15.115:0/1069958182 wait complete. 2023-07-27T14:33:04.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.350+0000 7facbd5ff700 1 Processor -- start 2023-07-27T14:33:04.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.350+0000 7facbd5ff700 1 -- start start 2023-07-27T14:33:04.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facbd5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facb80c5c50 0x7facb8149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:04.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facbd5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb80c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:04.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facbd5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb814b1e0 0x7facb80c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:04.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facbd5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80c42e0 con 0x7facb814ae00 2023-07-27T14:33:04.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facbd5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80c4770 con 0x7facb80c5c50 2023-07-27T14:33:04.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facbd5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb80c36d0 con 0x7facb814b1e0 2023-07-27T14:33:04.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facb67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb80c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:04.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facb67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb80c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54500/0 (socket says 172.21.15.115:54500) 2023-07-27T14:33:04.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facb67fc700 1 -- 172.21.15.115:0/2768683636 learned_addr learned my addr 172.21.15.115:0/2768683636 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:04.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facb6ffd700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facb80c5c50 0x7facb8149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:04.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.351+0000 7facb77fe700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb814b1e0 0x7facb80c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:04.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facb67fc700 1 -- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb814b1e0 msgr2=0x7facb80c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:04.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facb67fc700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb814b1e0 0x7facb80c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facb67fc700 1 -- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facb80c5c50 msgr2=0x7facb8149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:04.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facb67fc700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facb80c5c50 0x7facb8149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facb67fc700 1 -- 172.21.15.115:0/2768683636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009370 con 0x7facb814ae00 2023-07-27T14:33:04.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facb77fe700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb814b1e0 0x7facb80c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:04.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facb67fc700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb80c2710 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7facac00c670 tx=0x7facac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:04.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7fac9effd700 1 -- 172.21.15.115:0/2768683636 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac015070 con 0x7facb814ae00 2023-07-27T14:33:04.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7fac9effd700 1 -- 172.21.15.115:0/2768683636 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac010580 con 0x7facb814ae00 2023-07-27T14:33:04.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7fac9effd700 1 -- 172.21.15.115:0/2768683636 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac010900 con 0x7facb814ae00 2023-07-27T14:33:04.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb80c39b0 con 0x7facb814ae00 2023-07-27T14:33:04.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.352+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb80c3f70 con 0x7facb814ae00 2023-07-27T14:33:04.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.353+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb80c4450 con 0x7facb814ae00 2023-07-27T14:33:04.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.354+0000 7fac9effd700 1 -- 172.21.15.115:0/2768683636 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7facac010cf0 con 0x7facb814ae00 2023-07-27T14:33:04.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.355+0000 7fac9effd700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faca405f4e0 0x7faca40619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:04.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.355+0000 7fac9effd700 1 -- 172.21.15.115:0/2768683636 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5269+0+0 (secure 0 0 0) 0x7facac079f80 con 0x7facb814ae00 2023-07-27T14:33:04.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.355+0000 7facb6ffd700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faca405f4e0 0x7faca40619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:04.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.356+0000 7facb6ffd700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faca405f4e0 0x7faca40619a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7faca8009130 tx=0x7faca8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:04.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.359+0000 7fac9effd700 1 -- 172.21.15.115:0/2768683636 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7facac04b120 con 0x7facb814ae00 2023-07-27T14:33:04.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.529+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7facb806c470 con 0x7facb814ae00 2023-07-27T14:33:04.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.763+0000 7fac9effd700 1 -- 172.21.15.115:0/2768683636 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v111) v1 ==== 152+0+0 (secure 0 0 0) 0x7facac04e740 con 0x7facb814ae00 2023-07-27T14:33:04.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.766+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faca405f4e0 msgr2=0x7faca40619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:04.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.766+0000 7facbd5ff700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faca405f4e0 0x7faca40619a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7faca8009130 tx=0x7faca8017000).stop 2023-07-27T14:33:04.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.766+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 msgr2=0x7facb80c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:04.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.766+0000 7facbd5ff700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb80c2710 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7facac00c670 tx=0x7facac008040).stop 2023-07-27T14:33:04.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.767+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 shutdown_connections 2023-07-27T14:33:04.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.767+0000 7facbd5ff700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faca405f4e0 0x7faca40619a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.767+0000 7facbd5ff700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facb814b1e0 0x7facb80c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.767+0000 7facbd5ff700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facb80c5c50 0x7facb8149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:04.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.767+0000 7facbd5ff700 1 --2- 172.21.15.115:0/2768683636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facb814ae00 0x7facb80c2710 secure :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0x7facac00c670 tx=0x7facac008040).stop 2023-07-27T14:33:04.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.767+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 >> 172.21.15.115:0/2768683636 conn(0x7facb805e940 msgr2=0x7facb814a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:04.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.768+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 shutdown_connections 2023-07-27T14:33:04.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.768+0000 7facbd5ff700 1 -- 172.21.15.115:0/2768683636 wait complete. 2023-07-27T14:33:04.811 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:33:04.828 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:33:05.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.985+0000 7fc7ca9ff700 1 Processor -- start 2023-07-27T14:33:05.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.985+0000 7fc7ca9ff700 1 -- start start 2023-07-27T14:33:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7ca9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c414ae00 0x7fc7c4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7ca9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7c414b1e0 0x7fc7c4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:05.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7ca9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc7c40c5c50 0x7fc7c4063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7ca9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c4063530 con 0x7fc7c414b1e0 2023-07-27T14:33:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7ca9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c41553f0 con 0x7fc7c40c5c50 2023-07-27T14:33:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7ca9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4157a50 con 0x7fc7c414ae00 2023-07-27T14:33:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7c37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7c414b1e0 0x7fc7c4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7c37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7c414b1e0 0x7fc7c4062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54504/0 (socket says 172.21.15.115:54504) 2023-07-27T14:33:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7c37fe700 1 -- 172.21.15.115:0/2602667007 learned_addr learned my addr 172.21.15.115:0/2602667007 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7c8f9c700 1 --2- 172.21.15.115:0/2602667007 >> v2:172.21.15.159:3300/0 conn(0x7fc7c40c5c50 0x7fc7c4063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:05.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.987+0000 7fc7c3fff700 1 --2- 172.21.15.115:0/2602667007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c414ae00 0x7fc7c4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c37fe700 1 -- 172.21.15.115:0/2602667007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c414ae00 msgr2=0x7fc7c4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c37fe700 1 --2- 172.21.15.115:0/2602667007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c414ae00 0x7fc7c4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c37fe700 1 -- 172.21.15.115:0/2602667007 >> v2:172.21.15.159:3300/0 conn(0x7fc7c40c5c50 msgr2=0x7fc7c4063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:05.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c37fe700 1 --2- 172.21.15.115:0/2602667007 >> v2:172.21.15.159:3300/0 conn(0x7fc7c40c5c50 0x7fc7c4063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c37fe700 1 -- 172.21.15.115:0/2602667007 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4157d10 con 0x7fc7c414b1e0 2023-07-27T14:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c8f9c700 1 --2- 172.21.15.115:0/2602667007 >> v2:172.21.15.159:3300/0 conn(0x7fc7c40c5c50 0x7fc7c4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c3fff700 1 --2- 172.21.15.115:0/2602667007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c414ae00 0x7fc7c4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c37fe700 1 --2- 172.21.15.115:0/2602667007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414b1e0 0x7fc7c4062b50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fc7c405fbe0 tx=0x7fc7b80090f0).ready entity=mon.0 client_cookie=b6346239796a9935 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c2ffd700 1 -- 172.21.15.115:0/2602667007 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800b600 con 0x7fc7c414b1e0 2023-07-27T14:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c2ffd700 1 -- 172.21.15.115:0/2602667007 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b800b760 con 0x7fc7c414b1e0 2023-07-27T14:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7c2ffd700 1 -- 172.21.15.115:0/2602667007 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800bae0 con 0x7fc7c414b1e0 2023-07-27T14:33:05.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/2602667007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414b1e0 msgr2=0x7fc7c4062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:05.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.988+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/2602667007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414b1e0 0x7fc7c4062b50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fc7c405fbe0 tx=0x7fc7b80090f0).stop 2023-07-27T14:33:05.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.989+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/2602667007 shutdown_connections 2023-07-27T14:33:05.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.989+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/2602667007 >> v2:172.21.15.159:3300/0 conn(0x7fc7c40c5c50 0x7fc7c4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.989+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/2602667007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c414ae00 0x7fc7c4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.989+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/2602667007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414b1e0 0x7fc7c4062b50 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.989+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/2602667007 >> 172.21.15.115:0/2602667007 conn(0x7fc7c405e940 msgr2=0x7fc7c40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:05.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.989+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/2602667007 shutdown_connections 2023-07-27T14:33:05.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.989+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/2602667007 wait complete. 2023-07-27T14:33:05.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.990+0000 7fc7ca9ff700 1 Processor -- start 2023-07-27T14:33:05.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.990+0000 7fc7ca9ff700 1 -- start start 2023-07-27T14:33:05.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7ca9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c40c5c50 0x7fc7c4149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:05.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7ca9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414ae00 0x7fc7c40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:05.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7ca9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c414b1e0 0x7fc7c40ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:05.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7ca9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40ae620 con 0x7fc7c414ae00 2023-07-27T14:33:05.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7ca9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40ae900 con 0x7fc7c414b1e0 2023-07-27T14:33:05.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7ca9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40aebe0 con 0x7fc7c40c5c50 2023-07-27T14:33:05.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414ae00 0x7fc7c40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:05.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414ae00 0x7fc7c40adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54508/0 (socket says 172.21.15.115:54508) 2023-07-27T14:33:05.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.991+0000 7fc7c37fe700 1 -- 172.21.15.115:0/1792213797 learned_addr learned my addr 172.21.15.115:0/1792213797 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:05.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c3fff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c40c5c50 0x7fc7c4149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:05.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c8f9c700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c414b1e0 0x7fc7c40ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:05.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c37fe700 1 -- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c40c5c50 msgr2=0x7fc7c4149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:05.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c37fe700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c40c5c50 0x7fc7c4149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c37fe700 1 -- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c414b1e0 msgr2=0x7fc7c40ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:05.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c37fe700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c414b1e0 0x7fc7c40ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c37fe700 1 -- 172.21.15.115:0/1792213797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8009370 con 0x7fc7c414ae00 2023-07-27T14:33:05.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c8f9c700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c414b1e0 0x7fc7c40ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:05.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7c37fe700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414ae00 0x7fc7c40adb60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fc7c40caac0 tx=0x7fc7b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:05.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7abfff700 1 -- 172.21.15.115:0/1792213797 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800b8d0 con 0x7fc7c414ae00 2023-07-27T14:33:05.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7abfff700 1 -- 172.21.15.115:0/1792213797 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b800ba30 con 0x7fc7c414ae00 2023-07-27T14:33:05.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c40aeec0 con 0x7fc7c414ae00 2023-07-27T14:33:05.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7abfff700 1 -- 172.21.15.115:0/1792213797 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b801c670 con 0x7fc7c414ae00 2023-07-27T14:33:05.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.992+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c4149e80 con 0x7fc7c414ae00 2023-07-27T14:33:05.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.993+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c40af3e0 con 0x7fc7c414ae00 2023-07-27T14:33:05.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.995+0000 7fc7abfff700 1 -- 172.21.15.115:0/1792213797 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fc7b8022020 con 0x7fc7c414ae00 2023-07-27T14:33:05.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.995+0000 7fc7abfff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc7b005f4e0 0x7fc7b00619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:05.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.996+0000 7fc7abfff700 1 -- 172.21.15.115:0/1792213797 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fc7b807c5c0 con 0x7fc7c414ae00 2023-07-27T14:33:05.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.996+0000 7fc7c3fff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc7b005f4e0 0x7fc7b00619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:05.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.996+0000 7fc7c3fff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc7b005f4e0 0x7fc7b00619a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fc7c40afa20 tx=0x7fc7b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:05.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:04.999+0000 7fc7abfff700 1 -- 172.21.15.115:0/1792213797 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc7b804d610 con 0x7fc7c414ae00 2023-07-27T14:33:05.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.169+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc7c40af3e0 con 0x7fc7c414ae00 2023-07-27T14:33:05.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.769+0000 7fc7abfff700 1 -- 172.21.15.115:0/1792213797 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v112) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc7c40af3e0 con 0x7fc7c414ae00 2023-07-27T14:33:05.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.781+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc7b005f4e0 msgr2=0x7fc7b00619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:05.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.781+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc7b005f4e0 0x7fc7b00619a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fc7c40afa20 tx=0x7fc7b4008040).stop 2023-07-27T14:33:05.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.781+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414ae00 msgr2=0x7fc7c40adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:05.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.781+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414ae00 0x7fc7c40adb60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fc7c40caac0 tx=0x7fc7b8017000).stop 2023-07-27T14:33:05.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.785+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 shutdown_connections 2023-07-27T14:33:05.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.785+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc7b005f4e0 0x7fc7b00619a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.785+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7c414b1e0 0x7fc7c40ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.785+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc7c40c5c50 0x7fc7c4149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.785+0000 7fc7ca9ff700 1 --2- 172.21.15.115:0/1792213797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7c414ae00 0x7fc7c40adb60 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:05.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.785+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 >> 172.21.15.115:0/1792213797 conn(0x7fc7c405e940 msgr2=0x7fc7c40c10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:05.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.787+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 shutdown_connections 2023-07-27T14:33:05.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:05.787+0000 7fc7ca9ff700 1 -- 172.21.15.115:0/1792213797 wait complete. 2023-07-27T14:33:05.832 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:33:05.853 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:33:06.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.007+0000 7f31c99ff700 1 Processor -- start 2023-07-27T14:33:06.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.008+0000 7f31c99ff700 1 -- start start 2023-07-27T14:33:06.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c99ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f31c40c6b70 0x7f31c40656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c99ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c4066050 con 0x7f31c4153e00 2023-07-27T14:33:06.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c99ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c4064a80 con 0x7f31c4065bc0 2023-07-27T14:33:06.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c99ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c4062320 con 0x7f31c40c6b70 2023-07-27T14:33:06.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f31c4153e00 0x7f31c4064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37092/0 (socket says 172.21.15.115:37092) 2023-07-27T14:33:06.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c2ffd700 1 -- 172.21.15.115:0/4118808994 learned_addr learned my addr 172.21.15.115:0/4118808994 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:06.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c27fc700 1 --2- 172.21.15.115:0/4118808994 >> v2:172.21.15.159:3300/0 conn(0x7f31c40c6b70 0x7f31c40656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260905530 0 0) 0x7f31c4066050 con 0x7f31c4153e00 2023-07-27T14:33:06.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.009+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ac0033f0 con 0x7f31c4153e00 2023-07-27T14:33:06.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640375559 0 0) 0x7f31ac0033f0 con 0x7f31c4153e00 2023-07-27T14:33:06.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 >> v2:172.21.15.159:3300/0 conn(0x7f31c40c6b70 msgr2=0x7f31c40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:06.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 --2- 172.21.15.115:0/4118808994 >> v2:172.21.15.159:3300/0 conn(0x7f31c40c6b70 0x7f31c40656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 >> v1:172.21.15.159:6789/0 conn(0x7f31c4065bc0 legacy=0x7f31c4062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4064d60 con 0x7f31c4153e00 2023-07-27T14:33:06.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f31b4001470 con 0x7f31c4153e00 2023-07-27T14:33:06.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 >> v1:172.21.15.115:6789/0 conn(0x7f31c4153e00 legacy=0x7f31c4064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31ac0038e0 0x7f31ac003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31ac004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ac005000 0x7f31ac00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac00be80 con 0x7f31ac004690 2023-07-27T14:33:06.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac00bff0 con 0x7f31ac005000 2023-07-27T14:33:06.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac00c1b0 con 0x7f31ac0038e0 2023-07-27T14:33:06.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c27fc700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31ac004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c2ffd700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31ac0038e0 0x7f31ac003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c37fe700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ac005000 0x7f31ac00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c27fc700 1 -- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31ac0038e0 msgr2=0x7f31ac003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c27fc700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31ac0038e0 0x7f31ac003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.010+0000 7f31c27fc700 1 -- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ac005000 msgr2=0x7f31ac00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c27fc700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ac005000 0x7f31ac00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c27fc700 1 -- 172.21.15.115:0/4118808994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0033f0 con 0x7f31ac004690 2023-07-27T14:33:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c37fe700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31ac005000 0x7f31ac00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c37fe700 1 -- 172.21.15.115:0/4118808994 reap_dead start 2023-07-27T14:33:06.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c27fc700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31ac004b10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f31b8009a80 tx=0x7f31b8009060).ready entity=mon.0 client_cookie=ad9816f401b83dc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8009430 con 0x7f31ac004690 2023-07-27T14:33:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b800e640 con 0x7f31ac004690 2023-07-27T14:33:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c1ffb700 1 -- 172.21.15.115:0/4118808994 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b800e9c0 con 0x7f31ac004690 2023-07-27T14:33:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c99ff700 1 -- 172.21.15.115:0/4118808994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 msgr2=0x7f31ac004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c99ff700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31ac004b10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f31b8009a80 tx=0x7f31b8009060).stop 2023-07-27T14:33:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c99ff700 1 -- 172.21.15.115:0/4118808994 shutdown_connections 2023-07-27T14:33:06.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c99ff700 1 --2- 172.21.15.115:0/4118808994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31ac004b10 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c99ff700 1 -- 172.21.15.115:0/4118808994 >> 172.21.15.115:0/4118808994 conn(0x7f31c40c7b90 msgr2=0x7f31c40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:06.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.011+0000 7f31c99ff700 1 -- 172.21.15.115:0/4118808994 shutdown_connections 2023-07-27T14:33:06.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.012+0000 7f31c99ff700 1 -- 172.21.15.115:0/4118808994 wait complete. 2023-07-27T14:33:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.013+0000 7f31c99ff700 1 Processor -- start 2023-07-27T14:33:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.013+0000 7f31c99ff700 1 -- start start 2023-07-27T14:33:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c99ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31c40a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c99ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c41502f0 0x7f31c4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c99ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c4069c30 0x7f31c40a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c99ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4092430 con 0x7f31ac004690 2023-07-27T14:33:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c99ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c406a0b0 con 0x7f31c41502f0 2023-07-27T14:33:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c99ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40a9c00 con 0x7f31c4069c30 2023-07-27T14:33:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31c40a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31c40a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54522/0 (socket says 172.21.15.115:54522) 2023-07-27T14:33:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.014+0000 7f31c2ffd700 1 -- 172.21.15.115:0/2513129913 learned_addr learned my addr 172.21.15.115:0/2513129913 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:06.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c37fe700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c4069c30 0x7f31c40a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c27fc700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c41502f0 0x7f31c4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c2ffd700 1 -- 172.21.15.115:0/2513129913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c4069c30 msgr2=0x7f31c40a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c2ffd700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c4069c30 0x7f31c40a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c2ffd700 1 -- 172.21.15.115:0/2513129913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c41502f0 msgr2=0x7f31c4069740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c2ffd700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c41502f0 0x7f31c4069740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c2ffd700 1 -- 172.21.15.115:0/2513129913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4151210 con 0x7f31ac004690 2023-07-27T14:33:06.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c2ffd700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31c40a95f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f31b400e8b0 tx=0x7f31b4001c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31aaffd700 1 -- 172.21.15.115:0/2513129913 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400c580 con 0x7f31ac004690 2023-07-27T14:33:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31aaffd700 1 -- 172.21.15.115:0/2513129913 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b400c6e0 con 0x7f31ac004690 2023-07-27T14:33:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c4091b00 con 0x7f31ac004690 2023-07-27T14:33:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31aaffd700 1 -- 172.21.15.115:0/2513129913 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400ca60 con 0x7f31ac004690 2023-07-27T14:33:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.015+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c40920c0 con 0x7f31ac004690 2023-07-27T14:33:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.016+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c406c470 con 0x7f31ac004690 2023-07-27T14:33:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.017+0000 7f31aaffd700 1 -- 172.21.15.115:0/2513129913 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f31b4014430 con 0x7f31ac004690 2023-07-27T14:33:06.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.018+0000 7f31aaffd700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31b005f4e0 0x7f31b00619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.018+0000 7f31aaffd700 1 -- 172.21.15.115:0/2513129913 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f31b407a4a0 con 0x7f31ac004690 2023-07-27T14:33:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.018+0000 7f31c27fc700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31b005f4e0 0x7f31b00619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.019+0000 7f31c27fc700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31b005f4e0 0x7f31b00619a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f31c406b990 tx=0x7f31b801a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.023+0000 7f31aaffd700 1 -- 172.21.15.115:0/2513129913 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31b40498f0 con 0x7f31ac004690 2023-07-27T14:33:06.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.231+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f31c4065040 con 0x7f31ac004690 2023-07-27T14:33:06.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.239+0000 7f31aaffd700 1 -- 172.21.15.115:0/2513129913 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7f31b404b1e0 con 0x7f31ac004690 2023-07-27T14:33:06.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.245+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31b005f4e0 msgr2=0x7f31b00619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.245+0000 7f31c99ff700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31b005f4e0 0x7f31b00619a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f31c406b990 tx=0x7f31b801a000).stop 2023-07-27T14:33:06.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.245+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 msgr2=0x7f31c40a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.245+0000 7f31c99ff700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31c40a95f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f31b400e8b0 tx=0x7f31b4001c70).stop 2023-07-27T14:33:06.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.256+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 shutdown_connections 2023-07-27T14:33:06.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.256+0000 7f31c99ff700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f31b005f4e0 0x7f31b00619a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.256+0000 7f31c99ff700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31c4069c30 0x7f31c40a72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.256+0000 7f31c99ff700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31ac004690 0x7f31c40a95f0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.256+0000 7f31c99ff700 1 --2- 172.21.15.115:0/2513129913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31c41502f0 0x7f31c4069740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.257+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 >> 172.21.15.115:0/2513129913 conn(0x7f31c40c7b90 msgr2=0x7f31c40bc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:06.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.259+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 shutdown_connections 2023-07-27T14:33:06.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.262+0000 7f31c99ff700 1 -- 172.21.15.115:0/2513129913 wait complete. 2023-07-27T14:33:06.305 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 15 and data pool 16 2023-07-27T14:33:06.322 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:06.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.472+0000 7f6d581ff700 1 Processor -- start 2023-07-27T14:33:06.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.472+0000 7f6d581ff700 1 -- start start 2023-07-27T14:33:06.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.473+0000 7f6d581ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6d50153ec0 0x7f6d500a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.473+0000 7f6d581ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500aa4d0 con 0x7f6d500aa050 2023-07-27T14:33:06.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.473+0000 7f6d581ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500c05c0 con 0x7f6d500aaa40 2023-07-27T14:33:06.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.473+0000 7f6d581ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500bfc90 con 0x7f6d50153ec0 2023-07-27T14:33:06.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.473+0000 7f6d5579a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6d500aa050 0x7f6d500640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37094/0 (socket says 172.21.15.115:37094) 2023-07-27T14:33:06.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.473+0000 7f6d5579a700 1 -- 172.21.15.115:0/1832102948 learned_addr learned my addr 172.21.15.115:0/1832102948 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:06.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d55f9b700 1 --2- 172.21.15.115:0/1832102948 >> v2:172.21.15.159:3300/0 conn(0x7f6d50153ec0 0x7f6d500a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729928814 0 0) 0x7f6d40001110 con 0x7f6d500aa050 2023-07-27T14:33:06.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d3c0033f0 con 0x7f6d500aa050 2023-07-27T14:33:06.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 243249827 0 0) 0x7f6d3c0033f0 con 0x7f6d500aa050 2023-07-27T14:33:06.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 >> v2:172.21.15.159:3300/0 conn(0x7f6d50153ec0 msgr2=0x7f6d500a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:06.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 --2- 172.21.15.115:0/1832102948 >> v2:172.21.15.159:3300/0 conn(0x7f6d50153ec0 0x7f6d500a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 >> v1:172.21.15.159:6789/0 conn(0x7f6d500aaa40 legacy=0x7f6d500c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500bff70 con 0x7f6d500aa050 2023-07-27T14:33:06.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f6d40001600 con 0x7f6d500aa050 2023-07-27T14:33:06.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 >> v1:172.21.15.115:6789/0 conn(0x7f6d500aa050 legacy=0x7f6d500640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0038e0 0x7f6d3c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3c004690 0x7f6d3c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c005000 0x7f6d3c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500bfc90 con 0x7f6d3c0038e0 2023-07-27T14:33:06.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c00bf60 con 0x7f6d3c004690 2023-07-27T14:33:06.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c00c0f0 con 0x7f6d3c005000 2023-07-27T14:33:06.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.474+0000 7f6d55f9b700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0038e0 0x7f6d3c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d5579a700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3c004690 0x7f6d3c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d5679c700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c005000 0x7f6d3c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d55f9b700 1 -- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c005000 msgr2=0x7f6d3c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:06.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d55f9b700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c005000 0x7f6d3c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d55f9b700 1 -- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3c004690 msgr2=0x7f6d3c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:06.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d55f9b700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d3c004690 0x7f6d3c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d55f9b700 1 -- 172.21.15.115:0/1832102948 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0033f0 con 0x7f6d3c0038e0 2023-07-27T14:33:06.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d5679c700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c005000 0x7f6d3c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:06.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d5679c700 1 -- 172.21.15.115:0/1832102948 reap_dead start 2023-07-27T14:33:06.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d55f9b700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0038e0 0x7f6d3c003d00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f6d4c009a80 tx=0x7f6d4c009060).ready entity=mon.0 client_cookie=684e33982b03652c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c009430 con 0x7f6d3c0038e0 2023-07-27T14:33:06.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c00e640 con 0x7f6d3c0038e0 2023-07-27T14:33:06.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.475+0000 7f6d54f99700 1 -- 172.21.15.115:0/1832102948 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c00e9c0 con 0x7f6d3c0038e0 2023-07-27T14:33:06.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.476+0000 7f6d581ff700 1 -- 172.21.15.115:0/1832102948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0038e0 msgr2=0x7f6d3c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.476+0000 7f6d581ff700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0038e0 0x7f6d3c003d00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f6d4c009a80 tx=0x7f6d4c009060).stop 2023-07-27T14:33:06.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.476+0000 7f6d581ff700 1 -- 172.21.15.115:0/1832102948 shutdown_connections 2023-07-27T14:33:06.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.476+0000 7f6d581ff700 1 --2- 172.21.15.115:0/1832102948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0038e0 0x7f6d3c003d00 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.476+0000 7f6d581ff700 1 -- 172.21.15.115:0/1832102948 >> 172.21.15.115:0/1832102948 conn(0x7f6d500cb610 msgr2=0x7f6d500c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:06.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.476+0000 7f6d581ff700 1 -- 172.21.15.115:0/1832102948 shutdown_connections 2023-07-27T14:33:06.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.476+0000 7f6d581ff700 1 -- 172.21.15.115:0/1832102948 wait complete. 2023-07-27T14:33:06.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.477+0000 7f6d581ff700 1 Processor -- start 2023-07-27T14:33:06.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.477+0000 7f6d581ff700 1 -- start start 2023-07-27T14:33:06.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.478+0000 7f6d581ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c0038e0 0x7f6d50164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.478+0000 7f6d581ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d500c3510 0x7f6d500aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.478+0000 7f6d581ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d500af280 0x7f6d50151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.478+0000 7f6d581ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50168450 con 0x7f6d500af280 2023-07-27T14:33:06.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.478+0000 7f6d581ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500c3cf0 con 0x7f6d500c3510 2023-07-27T14:33:06.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.478+0000 7f6d581ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50167b60 con 0x7f6d3c0038e0 2023-07-27T14:33:06.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d500af280 0x7f6d50151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d500af280 0x7f6d50151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54542/0 (socket says 172.21.15.115:54542) 2023-07-27T14:33:06.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 -- 172.21.15.115:0/2161123749 learned_addr learned my addr 172.21.15.115:0/2161123749 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:06.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5579a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d500c3510 0x7f6d500aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d55f9b700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c0038e0 0x7f6d50164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 -- 172.21.15.115:0/2161123749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c0038e0 msgr2=0x7f6d50164fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c0038e0 0x7f6d50164fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 -- 172.21.15.115:0/2161123749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d500c3510 msgr2=0x7f6d500aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d500c3510 0x7f6d500aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 -- 172.21.15.115:0/2161123749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50167e00 con 0x7f6d500af280 2023-07-27T14:33:06.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d5679c700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d500af280 0x7f6d50151750 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f6d500c75c0 tx=0x7f6d48009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d45ffb700 1 -- 172.21.15.115:0/2161123749 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48013420 con 0x7f6d500af280 2023-07-27T14:33:06.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d45ffb700 1 -- 172.21.15.115:0/2161123749 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48013580 con 0x7f6d500af280 2023-07-27T14:33:06.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d501680e0 con 0x7f6d500af280 2023-07-27T14:33:06.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.479+0000 7f6d45ffb700 1 -- 172.21.15.115:0/2161123749 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48013900 con 0x7f6d500af280 2023-07-27T14:33:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.480+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d50151c40 con 0x7f6d500af280 2023-07-27T14:33:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.481+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5006c470 con 0x7f6d500af280 2023-07-27T14:33:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.482+0000 7f6d45ffb700 1 -- 172.21.15.115:0/2161123749 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f6d480123d0 con 0x7f6d500af280 2023-07-27T14:33:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.482+0000 7f6d45ffb700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6d3405f4e0 0x7f6d340619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.483+0000 7f6d45ffb700 1 -- 172.21.15.115:0/2161123749 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6d4807a260 con 0x7f6d500af280 2023-07-27T14:33:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.483+0000 7f6d55f9b700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6d3405f4e0 0x7f6d340619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.483+0000 7f6d55f9b700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6d3405f4e0 0x7f6d340619a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f6d4c006d50 tx=0x7f6d4c01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.487+0000 7f6d45ffb700 1 -- 172.21.15.115:0/2161123749 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d480488f0 con 0x7f6d500af280 2023-07-27T14:33:06.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.658+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d500c0250 con 0x7f6d500af280 2023-07-27T14:33:06.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.659+0000 7f6d45ffb700 1 -- 172.21.15.115:0/2161123749 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+17099 (secure 0 0 0) 0x7f6d4804b1f0 con 0x7f6d500af280 2023-07-27T14:33:06.697 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:06.698 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":113,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:06.232680+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:04.573925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:05.213515+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:06.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6d3405f4e0 msgr2=0x7f6d340619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6d3405f4e0 0x7f6d340619a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f6d4c006d50 tx=0x7f6d4c01a000).stop 2023-07-27T14:33:06.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d500af280 msgr2=0x7f6d50151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d500af280 0x7f6d50151750 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f6d500c75c0 tx=0x7f6d48009040).stop 2023-07-27T14:33:06.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 shutdown_connections 2023-07-27T14:33:06.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6d3405f4e0 0x7f6d340619a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d500af280 0x7f6d50151750 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d3c0038e0 0x7f6d50164fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 --2- 172.21.15.115:0/2161123749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d500c3510 0x7f6d500aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 >> 172.21.15.115:0/2161123749 conn(0x7f6d500cb610 msgr2=0x7f6d500ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:06.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 shutdown_connections 2023-07-27T14:33:06.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.661+0000 7f6d581ff700 1 -- 172.21.15.115:0/2161123749 wait complete. 2023-07-27T14:33:06.717 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:06.793 INFO:tasks.ceph.mds.c.smithi115.stderr:2023-07-27T14:33:06.755+0000 7fc7115f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:33:06.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.869+0000 7f5b333ff700 1 Processor -- start 2023-07-27T14:33:06.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.869+0000 7f5b333ff700 1 -- start start 2023-07-27T14:33:06.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.870+0000 7f5b333ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b2c0aaa40 0x7f5b2c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.870+0000 7f5b333ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c0aa4d0 con 0x7f5b2c1542a0 2023-07-27T14:33:06.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.870+0000 7f5b333ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c0c05c0 con 0x7f5b2c153ec0 2023-07-27T14:33:06.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.870+0000 7f5b333ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c0aa270 con 0x7f5b2c0aaa40 2023-07-27T14:33:06.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b3099a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b2c0aaa40 0x7f5b2c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b3199c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5b2c1542a0 0x7f5b2c0c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37106/0 (socket says 172.21.15.115:37106) 2023-07-27T14:33:06.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b3199c700 1 -- 172.21.15.115:0/1788630404 learned_addr learned my addr 172.21.15.115:0/1788630404 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:06.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b3099a700 1 -- 172.21.15.115:0/1788630404 >> v1:172.21.15.159:6789/0 conn(0x7f5b2c153ec0 legacy=0x7f5b2c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b3099a700 1 -- 172.21.15.115:0/1788630404 >> v1:172.21.15.115:6789/0 conn(0x7f5b2c1542a0 legacy=0x7f5b2c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b3099a700 1 -- 172.21.15.115:0/1788630404 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0bfc90 con 0x7f5b2c0aaa40 2023-07-27T14:33:06.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b23fff700 1 -- 172.21.15.115:0/1788630404 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391469832 0 0) 0x7f5b24001490 con 0x7f5b2c1542a0 2023-07-27T14:33:06.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b3099a700 1 --2- 172.21.15.115:0/1788630404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c0aaa40 0x7f5b2c0640f0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f5b1c009760 tx=0x7f5b1c009060).ready entity=mon.0 client_cookie=640981c448287d83 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b23fff700 1 -- 172.21.15.115:0/1788630404 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00b580 con 0x7f5b2c0aaa40 2023-07-27T14:33:06.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.871+0000 7f5b23fff700 1 -- 172.21.15.115:0/1788630404 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00b6e0 con 0x7f5b2c0aaa40 2023-07-27T14:33:06.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.872+0000 7f5b23fff700 1 -- 172.21.15.115:0/1788630404 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00ba60 con 0x7f5b2c0aaa40 2023-07-27T14:33:06.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.872+0000 7f5b333ff700 1 -- 172.21.15.115:0/1788630404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c0aaa40 msgr2=0x7f5b2c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.872+0000 7f5b333ff700 1 --2- 172.21.15.115:0/1788630404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c0aaa40 0x7f5b2c0640f0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f5b1c009760 tx=0x7f5b1c009060).stop 2023-07-27T14:33:06.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.872+0000 7f5b333ff700 1 -- 172.21.15.115:0/1788630404 shutdown_connections 2023-07-27T14:33:06.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.872+0000 7f5b333ff700 1 --2- 172.21.15.115:0/1788630404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c0aaa40 0x7f5b2c0640f0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.872+0000 7f5b333ff700 1 -- 172.21.15.115:0/1788630404 >> 172.21.15.115:0/1788630404 conn(0x7f5b2c0cb610 msgr2=0x7f5b2c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:06.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.872+0000 7f5b333ff700 1 -- 172.21.15.115:0/1788630404 shutdown_connections 2023-07-27T14:33:06.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.872+0000 7f5b333ff700 1 -- 172.21.15.115:0/1788630404 wait complete. 2023-07-27T14:33:06.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.874+0000 7f5b333ff700 1 Processor -- start 2023-07-27T14:33:06.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.874+0000 7f5b333ff700 1 -- start start 2023-07-27T14:33:06.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b333ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b2c0aaa40 0x7f5b2c150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b333ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b2c153ec0 0x7f5b2c14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b333ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1542a0 0x7f5b2c0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b333ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c164540 con 0x7f5b2c1542a0 2023-07-27T14:33:06.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b333ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c165030 con 0x7f5b2c0aaa40 2023-07-27T14:33:06.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b333ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c159d60 con 0x7f5b2c153ec0 2023-07-27T14:33:06.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3199c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1542a0 0x7f5b2c0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3199c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1542a0 0x7f5b2c0c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54570/0 (socket says 172.21.15.115:54570) 2023-07-27T14:33:06.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3199c700 1 -- 172.21.15.115:0/1638143004 learned_addr learned my addr 172.21.15.115:0/1638143004 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:06.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3099a700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b2c153ec0 0x7f5b2c14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3119b700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b2c0aaa40 0x7f5b2c150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3199c700 1 -- 172.21.15.115:0/1638143004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b2c153ec0 msgr2=0x7f5b2c14f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3199c700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b2c153ec0 0x7f5b2c14f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3199c700 1 -- 172.21.15.115:0/1638143004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b2c0aaa40 msgr2=0x7f5b2c150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:06.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3199c700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b2c0aaa40 0x7f5b2c150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:06.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.875+0000 7f5b3199c700 1 -- 172.21.15.115:0/1638143004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0092a0 con 0x7f5b2c1542a0 2023-07-27T14:33:06.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.876+0000 7f5b3199c700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1542a0 0x7f5b2c0c3ec0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f5b2400c810 tx=0x7f5b240014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.876+0000 7f5b217fa700 1 -- 172.21.15.115:0/1638143004 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24005d30 con 0x7f5b2c1542a0 2023-07-27T14:33:06.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.876+0000 7f5b217fa700 1 -- 172.21.15.115:0/1638143004 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b24005e90 con 0x7f5b2c1542a0 2023-07-27T14:33:06.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.876+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c164740 con 0x7f5b2c1542a0 2023-07-27T14:33:06.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.876+0000 7f5b217fa700 1 -- 172.21.15.115:0/1638143004 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240072e0 con 0x7f5b2c1542a0 2023-07-27T14:33:06.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.876+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c1649e0 con 0x7f5b2c1542a0 2023-07-27T14:33:06.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.877+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c1653c0 con 0x7f5b2c1542a0 2023-07-27T14:33:06.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.878+0000 7f5b217fa700 1 -- 172.21.15.115:0/1638143004 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f5b24010070 con 0x7f5b2c1542a0 2023-07-27T14:33:06.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.879+0000 7f5b217fa700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b1005f4b0 0x7f5b10061970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:06.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.879+0000 7f5b217fa700 1 -- 172.21.15.115:0/1638143004 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5b24079b70 con 0x7f5b2c1542a0 2023-07-27T14:33:06.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.879+0000 7f5b3119b700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b1005f4b0 0x7f5b10061970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:06.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.880+0000 7f5b3119b700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b1005f4b0 0x7f5b10061970 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f5b2c152880 tx=0x7f5b28009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:06.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:06.883+0000 7f5b217fa700 1 -- 172.21.15.115:0/1638143004 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b2404a9c0 con 0x7f5b2c1542a0 2023-07-27T14:33:07.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.056+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b2c1651c0 con 0x7f5b2c1542a0 2023-07-27T14:33:07.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.057+0000 7f5b217fa700 1 -- 172.21.15.115:0/1638143004 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+17099 (secure 0 0 0) 0x7f5b2404dfe0 con 0x7f5b2c1542a0 2023-07-27T14:33:07.095 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:07.095 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":113,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:06.232680+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:04.573925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:05.213515+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:07.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b1005f4b0 msgr2=0x7f5b10061970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:07.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b1005f4b0 0x7f5b10061970 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f5b2c152880 tx=0x7f5b28009040).stop 2023-07-27T14:33:07.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1542a0 msgr2=0x7f5b2c0c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:07.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1542a0 0x7f5b2c0c3ec0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f5b2400c810 tx=0x7f5b240014a0).stop 2023-07-27T14:33:07.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 shutdown_connections 2023-07-27T14:33:07.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b1005f4b0 0x7f5b10061970 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1542a0 0x7f5b2c0c3ec0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b2c0aaa40 0x7f5b2c150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 --2- 172.21.15.115:0/1638143004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b2c153ec0 0x7f5b2c14f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 >> 172.21.15.115:0/1638143004 conn(0x7f5b2c0cb610 msgr2=0x7f5b2c15a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:07.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 shutdown_connections 2023-07-27T14:33:07.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.059+0000 7f5b333ff700 1 -- 172.21.15.115:0/1638143004 wait complete. 2023-07-27T14:33:07.115 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:33:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.268+0000 7f630ffff700 1 Processor -- start 2023-07-27T14:33:07.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.268+0000 7f630ffff700 1 -- start start 2023-07-27T14:33:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630ffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f63081509b0 0x7f63080c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63080c3100 0x7f63080c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630ffff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63080c0ea0 con 0x7f6308150d90 2023-07-27T14:33:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630ffff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6308068e10 con 0x7f63081509b0 2023-07-27T14:33:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630ffff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6308155190 con 0x7f63080c3100 2023-07-27T14:33:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630d59a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6308150d90 0x7f6308154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37116/0 (socket says 172.21.15.115:37116) 2023-07-27T14:33:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630d59a700 1 -- 172.21.15.115:0/1057721471 learned_addr learned my addr 172.21.15.115:0/1057721471 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630e59c700 1 --2- 172.21.15.115:0/1057721471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63080c3100 0x7f63080c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630dd9b700 1 --2- 172.21.15.115:0/1057721471 >> v2:172.21.15.159:3300/0 conn(0x7f63081509b0 0x7f63080c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630cd99700 1 -- 172.21.15.115:0/1057721471 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786607845 0 0) 0x7f63080c0ea0 con 0x7f6308150d90 2023-07-27T14:33:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.270+0000 7f630cd99700 1 -- 172.21.15.115:0/1057721471 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f40033f0 con 0x7f6308150d90 2023-07-27T14:33:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.271+0000 7f630dd9b700 1 -- 172.21.15.115:0/1057721471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63080c3100 msgr2=0x7f63080c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.271+0000 7f630dd9b700 1 --2- 172.21.15.115:0/1057721471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63080c3100 0x7f63080c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.271+0000 7f630dd9b700 1 -- 172.21.15.115:0/1057721471 >> v1:172.21.15.115:6789/0 conn(0x7f6308150d90 legacy=0x7f6308154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.271+0000 7f630dd9b700 1 -- 172.21.15.115:0/1057721471 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308155470 con 0x7f63081509b0 2023-07-27T14:33:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.271+0000 7f630dd9b700 1 --2- 172.21.15.115:0/1057721471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63081509b0 0x7f63080c58d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f6304009760 tx=0x7f6304009060).ready entity=mon.1 client_cookie=6d2d7e8c56ea3259 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:07.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.271+0000 7f630cd99700 1 -- 172.21.15.115:0/1057721471 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400d4a0 con 0x7f63081509b0 2023-07-27T14:33:07.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.271+0000 7f630cd99700 1 -- 172.21.15.115:0/1057721471 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400d600 con 0x7f63081509b0 2023-07-27T14:33:07.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.271+0000 7f630cd99700 1 -- 172.21.15.115:0/1057721471 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400d980 con 0x7f63081509b0 2023-07-27T14:33:07.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.272+0000 7f630ffff700 1 -- 172.21.15.115:0/1057721471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63081509b0 msgr2=0x7f63080c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:07.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.272+0000 7f630ffff700 1 --2- 172.21.15.115:0/1057721471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63081509b0 0x7f63080c58d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f6304009760 tx=0x7f6304009060).stop 2023-07-27T14:33:07.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.272+0000 7f630ffff700 1 -- 172.21.15.115:0/1057721471 shutdown_connections 2023-07-27T14:33:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.272+0000 7f630ffff700 1 --2- 172.21.15.115:0/1057721471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63080c3100 0x7f63080c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.272+0000 7f630ffff700 1 --2- 172.21.15.115:0/1057721471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63081509b0 0x7f63080c58d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.272+0000 7f630ffff700 1 -- 172.21.15.115:0/1057721471 >> 172.21.15.115:0/1057721471 conn(0x7f6308062320 msgr2=0x7f6308062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.272+0000 7f630ffff700 1 -- 172.21.15.115:0/1057721471 shutdown_connections 2023-07-27T14:33:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.272+0000 7f630ffff700 1 -- 172.21.15.115:0/1057721471 wait complete. 2023-07-27T14:33:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.273+0000 7f630ffff700 1 Processor -- start 2023-07-27T14:33:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.273+0000 7f630ffff700 1 -- start start 2023-07-27T14:33:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.274+0000 7f630ffff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63080c3100 0x7f63080a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.274+0000 7f630ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63081509b0 0x7f6308164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.274+0000 7f630ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6308150d90 0x7f6308069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.274+0000 7f630ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63080a6240 con 0x7f63081509b0 2023-07-27T14:33:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.274+0000 7f630ffff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6308164e60 con 0x7f63080c3100 2023-07-27T14:33:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.274+0000 7f630ffff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630814d410 con 0x7f6308150d90 2023-07-27T14:33:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63081509b0 0x7f6308164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63081509b0 0x7f6308164970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54582/0 (socket says 172.21.15.115:54582) 2023-07-27T14:33:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 -- 172.21.15.115:0/2859387960 learned_addr learned my addr 172.21.15.115:0/2859387960 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630dd9b700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63080c3100 0x7f63080a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630e59c700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6308150d90 0x7f6308069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 -- 172.21.15.115:0/2859387960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6308150d90 msgr2=0x7f6308069140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6308150d90 0x7f6308069140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 -- 172.21.15.115:0/2859387960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63080c3100 msgr2=0x7f63080a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63080c3100 0x7f63080a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 -- 172.21.15.115:0/2859387960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040092a0 con 0x7f63081509b0 2023-07-27T14:33:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630d59a700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63081509b0 0x7f6308164970 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f62f800c410 tx=0x7f62f8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f62fdffb700 1 -- 172.21.15.115:0/2859387960 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800ce70 con 0x7f63081509b0 2023-07-27T14:33:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f62fdffb700 1 -- 172.21.15.115:0/2859387960 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f80072e0 con 0x7f63081509b0 2023-07-27T14:33:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630814d6f0 con 0x7f63081509b0 2023-07-27T14:33:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.275+0000 7f62fdffb700 1 -- 172.21.15.115:0/2859387960 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80057a0 con 0x7f63081509b0 2023-07-27T14:33:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.276+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630814dcb0 con 0x7f63081509b0 2023-07-27T14:33:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.276+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63080a64b0 con 0x7f63081509b0 2023-07-27T14:33:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.277+0000 7f62fdffb700 1 -- 172.21.15.115:0/2859387960 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f62f8010070 con 0x7f63081509b0 2023-07-27T14:33:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.278+0000 7f62fdffb700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ec05f4e0 0x7f62ec0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.278+0000 7f62fdffb700 1 -- 172.21.15.115:0/2859387960 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f62f8079c20 con 0x7f63081509b0 2023-07-27T14:33:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.278+0000 7f630dd9b700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ec05f4e0 0x7f62ec0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.279+0000 7f630dd9b700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ec05f4e0 0x7f62ec0619a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f630400d260 tx=0x7f6304016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.282+0000 7f62fdffb700 1 -- 172.21.15.115:0/2859387960 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63080a64b0 con 0x7f63081509b0 2023-07-27T14:33:07.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:07.494+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f630806c470 con 0x7f63081509b0 2023-07-27T14:33:08.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.244+0000 7f62fdffb700 1 -- 172.21.15.115:0/2859387960 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) v1 ==== 118+0+0 (secure 0 0 0) 0x7f62f804a960 con 0x7f63081509b0 2023-07-27T14:33:08.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ec05f4e0 msgr2=0x7f62ec0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:08.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ec05f4e0 0x7f62ec0619a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f630400d260 tx=0x7f6304016000).stop 2023-07-27T14:33:08.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63081509b0 msgr2=0x7f6308164970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:08.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63081509b0 0x7f6308164970 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f62f800c410 tx=0x7f62f8007c70).stop 2023-07-27T14:33:08.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 shutdown_connections 2023-07-27T14:33:08.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ec05f4e0 0x7f62ec0619a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6308150d90 0x7f6308069140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63080c3100 0x7f63080a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 --2- 172.21.15.115:0/2859387960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63081509b0 0x7f6308164970 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 >> 172.21.15.115:0/2859387960 conn(0x7f6308062320 msgr2=0x7f6308064360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 shutdown_connections 2023-07-27T14:33:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.247+0000 7f630ffff700 1 -- 172.21.15.115:0/2859387960 wait complete. 2023-07-27T14:33:08.305 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:33:08.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:33:08.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.462+0000 7f7f7f5ff700 1 Processor -- start 2023-07-27T14:33:08.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.462+0000 7f7f7f5ff700 1 -- start start 2023-07-27T14:33:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.463+0000 7f7f7f5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 0x7f7f78154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.463+0000 7f7f7f5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f781553f0 con 0x7f7f7814ae00 2023-07-27T14:33:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.463+0000 7f7f7f5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f78157a50 con 0x7f7f78063260 2023-07-27T14:33:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.463+0000 7f7f7f5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78157d10 con 0x7f7f7814b1e0 2023-07-27T14:33:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f7d39b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7f7814ae00 0x7f7f78062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37132/0 (socket says 172.21.15.115:37132) 2023-07-27T14:33:08.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f7d39b700 1 -- 172.21.15.115:0/1094285036 learned_addr learned my addr 172.21.15.115:0/1094285036 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 0x7f7f78154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194279281 0 0) 0x7f7f781553f0 con 0x7f7f7814ae00 2023-07-27T14:33:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f640033f0 con 0x7f7f7814ae00 2023-07-27T14:33:08.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802339498 0 0) 0x7f7f78157a50 con 0x7f7f78063260 2023-07-27T14:33:08.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f781553f0 con 0x7f7f78063260 2023-07-27T14:33:08.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648321624 0 0) 0x7f7f640033f0 con 0x7f7f7814ae00 2023-07-27T14:33:08.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 msgr2=0x7f7f78154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:08.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 0x7f7f78154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 >> v1:172.21.15.159:6789/0 conn(0x7f7f78063260 legacy=0x7f7f780a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:08.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78157ff0 con 0x7f7f7814ae00 2023-07-27T14:33:08.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f7f74001470 con 0x7f7f7814ae00 2023-07-27T14:33:08.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.464+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 0x7f7f78154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:08.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 >> v1:172.21.15.115:6789/0 conn(0x7f7f7814ae00 legacy=0x7f7f78062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:08.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f6ffff700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 0x7f7f64003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:08.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f6ffff700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64003f90 0x7f7f64004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:08.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f6ffff700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f64004b80 0x7f7f64005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:08.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78157d10 con 0x7f7f64004b80 2023-07-27T14:33:08.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6400b940 con 0x7f7f64003f90 2023-07-27T14:33:08.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6400bb00 con 0x7f7f7814b1e0 2023-07-27T14:33:08.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f64004b80 0x7f7f64005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:08.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7cb9a700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64003f90 0x7f7f64004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:08.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7d39b700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 0x7f7f64003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:08.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7db9c700 1 -- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 msgr2=0x7f7f64003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:08.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f7814b1e0 0x7f7f64003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7db9c700 1 -- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64003f90 msgr2=0x7f7f64004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:08.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64003f90 0x7f7f64004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7db9c700 1 -- 172.21.15.115:0/1094285036 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70009a20 con 0x7f7f64004b80 2023-07-27T14:33:08.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.465+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f64004b80 0x7f7f64005000 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f7f7814b5e0 tx=0x7f7f7000b040).ready entity=mon.0 client_cookie=fbf9fa51415de4a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:08.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70009c50 con 0x7f7f64004b80 2023-07-27T14:33:08.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000f040 con 0x7f7f64004b80 2023-07-27T14:33:08.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f6ffff700 1 -- 172.21.15.115:0/1094285036 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000ee50 con 0x7f7f64004b80 2023-07-27T14:33:08.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/1094285036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f64004b80 msgr2=0x7f7f64005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:08.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f7f5ff700 1 --2- 172.21.15.115:0/1094285036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f64004b80 0x7f7f64005000 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f7f7814b5e0 tx=0x7f7f7000b040).stop 2023-07-27T14:33:08.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f7db9c700 1 -- 172.21.15.115:0/1094285036 reap_dead start 2023-07-27T14:33:08.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/1094285036 shutdown_connections 2023-07-27T14:33:08.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/1094285036 >> 172.21.15.115:0/1094285036 conn(0x7f7f7805e940 msgr2=0x7f7f780cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:08.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/1094285036 shutdown_connections 2023-07-27T14:33:08.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.466+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/1094285036 wait complete. 2023-07-27T14:33:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.468+0000 7f7f7f5ff700 1 Processor -- start 2023-07-27T14:33:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.468+0000 7f7f7f5ff700 1 -- start start 2023-07-27T14:33:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7f5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f64004b80 0x7f7f7814a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7f5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f7814d730 0x7f7f7814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7f5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f7814d070 0x7f7f780af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:08.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7f5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7814aca0 con 0x7f7f7814d070 2023-07-27T14:33:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7f5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780af2b0 con 0x7f7f7814d730 2023-07-27T14:33:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7f5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7814d4f0 con 0x7f7f64004b80 2023-07-27T14:33:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7db9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f7814d070 0x7f7f780af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7db9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f7814d070 0x7f7f780af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54598/0 (socket says 172.21.15.115:54598) 2023-07-27T14:33:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7db9c700 1 -- 172.21.15.115:0/4151445740 learned_addr learned my addr 172.21.15.115:0/4151445740 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7d39b700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f64004b80 0x7f7f7814a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:08.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.469+0000 7f7f7cb9a700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f7814d730 0x7f7f7814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f7db9c700 1 -- 172.21.15.115:0/4151445740 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f64004b80 msgr2=0x7f7f7814a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f64004b80 0x7f7f7814a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f7db9c700 1 -- 172.21.15.115:0/4151445740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f7814d730 msgr2=0x7f7f7814cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f7814d730 0x7f7f7814cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f7db9c700 1 -- 172.21.15.115:0/4151445740 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780ae6a0 con 0x7f7f7814d070 2023-07-27T14:33:08.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f7db9c700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f7814d070 0x7f7f780af740 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f7f70013940 tx=0x7f7f7001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f6d7fa700 1 -- 172.21.15.115:0/4151445740 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70021030 con 0x7f7f7814d070 2023-07-27T14:33:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f6d7fa700 1 -- 172.21.15.115:0/4151445740 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f70009c50 con 0x7f7f7814d070 2023-07-27T14:33:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f780ae980 con 0x7f7f7814d070 2023-07-27T14:33:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f6d7fa700 1 -- 172.21.15.115:0/4151445740 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7001d400 con 0x7f7f7814d070 2023-07-27T14:33:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.470+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f780aef40 con 0x7f7f7814d070 2023-07-27T14:33:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.471+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7806c470 con 0x7f7f7814d070 2023-07-27T14:33:08.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.472+0000 7f7f6d7fa700 1 -- 172.21.15.115:0/4151445740 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f7f7001d830 con 0x7f7f7814d070 2023-07-27T14:33:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.473+0000 7f7f6d7fa700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f5c05f4e0 0x7f7f5c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.473+0000 7f7f6d7fa700 1 -- 172.21.15.115:0/4151445740 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7f70022070 con 0x7f7f7814d070 2023-07-27T14:33:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.473+0000 7f7f7d39b700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f5c05f4e0 0x7f7f5c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.474+0000 7f7f7d39b700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f5c05f4e0 0x7f7f5c0619a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f7f74001200 tx=0x7f7f7814eb20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.477+0000 7f7f6d7fa700 1 -- 172.21.15.115:0/4151445740 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f7004cbb0 con 0x7f7f7814d070 2023-07-27T14:33:08.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:08.688+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7f780af3f0 con 0x7f7f7814d070 2023-07-27T14:33:09.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.246+0000 7f7f6d7fa700 1 -- 172.21.15.115:0/4151445740 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7f700501d0 con 0x7f7f7814d070 2023-07-27T14:33:09.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f5c05f4e0 msgr2=0x7f7f5c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f5c05f4e0 0x7f7f5c0619a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f7f74001200 tx=0x7f7f7814eb20).stop 2023-07-27T14:33:09.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f7814d070 msgr2=0x7f7f780af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f7814d070 0x7f7f780af740 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f7f70013940 tx=0x7f7f7001a000).stop 2023-07-27T14:33:09.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 shutdown_connections 2023-07-27T14:33:09.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7f5c05f4e0 0x7f7f5c0619a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f7814d070 0x7f7f780af740 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7f64004b80 0x7f7f7814a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 --2- 172.21.15.115:0/4151445740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f7814d730 0x7f7f7814cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 >> 172.21.15.115:0/4151445740 conn(0x7f7f7805e940 msgr2=0x7f7f78157090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:09.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 shutdown_connections 2023-07-27T14:33:09.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.248+0000 7f7f7f5ff700 1 -- 172.21.15.115:0/4151445740 wait complete. 2023-07-27T14:33:09.305 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:33:09.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.456+0000 7f2252dff700 1 Processor -- start 2023-07-27T14:33:09.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.456+0000 7f2252dff700 1 -- start start 2023-07-27T14:33:09.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.457+0000 7f2252dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f224c0aaa40 0x7f224c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.458+0000 7f2252dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224c0aa4d0 con 0x7f224c1542a0 2023-07-27T14:33:09.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.458+0000 7f2252dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224c0c05c0 con 0x7f224c153ec0 2023-07-27T14:33:09.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.458+0000 7f2252dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0aa270 con 0x7f224c0aaa40 2023-07-27T14:33:09.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.458+0000 7f225139c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f224c1542a0 0x7f224c0c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37146/0 (socket says 172.21.15.115:37146) 2023-07-27T14:33:09.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.458+0000 7f225139c700 1 -- 172.21.15.115:0/3354419763 learned_addr learned my addr 172.21.15.115:0/3354419763 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:09.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.458+0000 7f224bfff700 1 --2- 172.21.15.115:0/3354419763 >> v2:172.21.15.159:3300/0 conn(0x7f224c0aaa40 0x7f224c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.458+0000 7f224b7fe700 1 -- 172.21.15.115:0/3354419763 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867260793 0 0) 0x7f2244001490 con 0x7f224c1542a0 2023-07-27T14:33:09.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.458+0000 7f224b7fe700 1 -- 172.21.15.115:0/3354419763 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f223c0033f0 con 0x7f224c1542a0 2023-07-27T14:33:09.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f224b7fe700 1 -- 172.21.15.115:0/3354419763 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 806230047 0 0) 0x7f223c0033f0 con 0x7f224c1542a0 2023-07-27T14:33:09.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f224bfff700 1 -- 172.21.15.115:0/3354419763 >> v1:172.21.15.159:6789/0 conn(0x7f224c153ec0 legacy=0x7f224c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f224bfff700 1 -- 172.21.15.115:0/3354419763 >> v1:172.21.15.115:6789/0 conn(0x7f224c1542a0 legacy=0x7f224c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f224bfff700 1 -- 172.21.15.115:0/3354419763 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0bfc90 con 0x7f224c0aaa40 2023-07-27T14:33:09.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f224bfff700 1 --2- 172.21.15.115:0/3354419763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c0aaa40 0x7f224c0640f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f2238009760 tx=0x7f2238009060).ready entity=mon.1 client_cookie=13f48962e6fdb5bd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:09.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f224b7fe700 1 -- 172.21.15.115:0/3354419763 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244001980 con 0x7f224c0aaa40 2023-07-27T14:33:09.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f224b7fe700 1 -- 172.21.15.115:0/3354419763 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2238011400 con 0x7f224c0aaa40 2023-07-27T14:33:09.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f224b7fe700 1 -- 172.21.15.115:0/3354419763 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238011780 con 0x7f224c0aaa40 2023-07-27T14:33:09.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f2252dff700 1 -- 172.21.15.115:0/3354419763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c0aaa40 msgr2=0x7f224c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.459+0000 7f2252dff700 1 --2- 172.21.15.115:0/3354419763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c0aaa40 0x7f224c0640f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f2238009760 tx=0x7f2238009060).stop 2023-07-27T14:33:09.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.460+0000 7f2252dff700 1 -- 172.21.15.115:0/3354419763 shutdown_connections 2023-07-27T14:33:09.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.460+0000 7f2252dff700 1 --2- 172.21.15.115:0/3354419763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c0aaa40 0x7f224c0640f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.460+0000 7f2252dff700 1 -- 172.21.15.115:0/3354419763 >> 172.21.15.115:0/3354419763 conn(0x7f224c0cb610 msgr2=0x7f224c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:09.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.460+0000 7f2252dff700 1 -- 172.21.15.115:0/3354419763 shutdown_connections 2023-07-27T14:33:09.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.460+0000 7f2252dff700 1 -- 172.21.15.115:0/3354419763 wait complete. 2023-07-27T14:33:09.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.461+0000 7f2252dff700 1 Processor -- start 2023-07-27T14:33:09.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.461+0000 7f2252dff700 1 -- start start 2023-07-27T14:33:09.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.462+0000 7f2252dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f224c0aaa40 0x7f224c152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.462+0000 7f2252dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c153ec0 0x7f224c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.462+0000 7f2252dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f224c1542a0 0x7f224c14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.462+0000 7f2252dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c155670 con 0x7f224c1542a0 2023-07-27T14:33:09.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.462+0000 7f2252dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c154a60 con 0x7f224c153ec0 2023-07-27T14:33:09.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.462+0000 7f2252dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c154d40 con 0x7f224c0aaa40 2023-07-27T14:33:09.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.462+0000 7f225139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f224c1542a0 0x7f224c14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f225139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f224c1542a0 0x7f224c14f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54604/0 (socket says 172.21.15.115:54604) 2023-07-27T14:33:09.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f225139c700 1 -- 172.21.15.115:0/2621062825 learned_addr learned my addr 172.21.15.115:0/2621062825 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:09.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f224bfff700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c153ec0 0x7f224c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f2250b9b700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f224c0aaa40 0x7f224c152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f225139c700 1 -- 172.21.15.115:0/2621062825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f224c0aaa40 msgr2=0x7f224c152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f225139c700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f224c0aaa40 0x7f224c152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f225139c700 1 -- 172.21.15.115:0/2621062825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c153ec0 msgr2=0x7f224c155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f225139c700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c153ec0 0x7f224c155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f225139c700 1 -- 172.21.15.115:0/2621062825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380092a0 con 0x7f224c1542a0 2023-07-27T14:33:09.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f225139c700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f224c1542a0 0x7f224c14f8c0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f224400cb60 tx=0x7f2244002170).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:09.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f2248ff9700 1 -- 172.21.15.115:0/2621062825 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440019c0 con 0x7f224c1542a0 2023-07-27T14:33:09.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f2248ff9700 1 -- 172.21.15.115:0/2621062825 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2244001720 con 0x7f224c1542a0 2023-07-27T14:33:09.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f2248ff9700 1 -- 172.21.15.115:0/2621062825 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244004e90 con 0x7f224c1542a0 2023-07-27T14:33:09.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.463+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c155020 con 0x7f224c1542a0 2023-07-27T14:33:09.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.464+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c14fdb0 con 0x7f224c1542a0 2023-07-27T14:33:09.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.464+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c155ff0 con 0x7f224c1542a0 2023-07-27T14:33:09.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.465+0000 7f2248ff9700 1 -- 172.21.15.115:0/2621062825 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f2244010070 con 0x7f224c1542a0 2023-07-27T14:33:09.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.466+0000 7f2248ff9700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f223005f4b0 0x7f2230061970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.466+0000 7f2248ff9700 1 -- 172.21.15.115:0/2621062825 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f224407a170 con 0x7f224c1542a0 2023-07-27T14:33:09.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.467+0000 7f2250b9b700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f223005f4b0 0x7f2230061970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.467+0000 7f2250b9b700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f223005f4b0 0x7f2230061970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f2240003900 tx=0x7f2240007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:09.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.470+0000 7f2248ff9700 1 -- 172.21.15.115:0/2621062825 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f224404aeb0 con 0x7f224c1542a0 2023-07-27T14:33:09.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.684+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f224c0aa4d0 con 0x7f224c1542a0 2023-07-27T14:33:09.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.685+0000 7f2248ff9700 1 -- 172.21.15.115:0/2621062825 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f224c0aa4d0 con 0x7f224c1542a0 2023-07-27T14:33:09.723 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:09.723 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1059927938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1059927938},{"type":"v1","addr":"172.21.15.159:6834","nonce":1059927938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2712836683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2712836683},{"type":"v1","addr":"172.21.15.159:6835","nonce":2712836683}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2509102546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2509102546},{"type":"v1","addr":"172.21.15.115:6836","nonce":2509102546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:06.232999+0000","modified":"2023-07-27T14:33:09.243791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7410":{"gid":7410,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2904047998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2904047998},{"type":"v1","addr":"172.21.15.115:6837","nonce":2904047998}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-07-27T14:33:09.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f223005f4b0 msgr2=0x7f2230061970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f223005f4b0 0x7f2230061970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f2240003900 tx=0x7f2240007d40).stop 2023-07-27T14:33:09.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f224c1542a0 msgr2=0x7f224c14f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f224c1542a0 0x7f224c14f8c0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f224400cb60 tx=0x7f2244002170).stop 2023-07-27T14:33:09.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 shutdown_connections 2023-07-27T14:33:09.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f223005f4b0 0x7f2230061970 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f224c1542a0 0x7f224c14f8c0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f224c0aaa40 0x7f224c152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 --2- 172.21.15.115:0/2621062825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f224c153ec0 0x7f224c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 >> 172.21.15.115:0/2621062825 conn(0x7f224c0cb610 msgr2=0x7f224c159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:09.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 shutdown_connections 2023-07-27T14:33:09.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.687+0000 7f2252dff700 1 -- 172.21.15.115:0/2621062825 wait complete. 2023-07-27T14:33:09.727 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 59 2023-07-27T14:33:09.743 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:09.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.892+0000 7f70327ff700 1 Processor -- start 2023-07-27T14:33:09.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.892+0000 7f70327ff700 1 -- start start 2023-07-27T14:33:09.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.894+0000 7f70327ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f702c1542a0 0x7f702c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.894+0000 7f70327ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c0aa4d0 con 0x7f702c0aaa40 2023-07-27T14:33:09.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.894+0000 7f70327ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c0c05c0 con 0x7f702c153ec0 2023-07-27T14:33:09.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.894+0000 7f70327ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c0c1a60 con 0x7f702c1542a0 2023-07-27T14:33:09.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.894+0000 7f702b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f702c0aaa40 0x7f702c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37150/0 (socket says 172.21.15.115:37150) 2023-07-27T14:33:09.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.894+0000 7f702b7fe700 1 -- 172.21.15.115:0/2106840717 learned_addr learned my addr 172.21.15.115:0/2106840717 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:09.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.894+0000 7f7030d9c700 1 --2- 172.21.15.115:0/2106840717 >> v2:172.21.15.115:3300/0 conn(0x7f702c1542a0 0x7f702c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f702affd700 1 -- 172.21.15.115:0/2106840717 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657414800 0 0) 0x7f7020001110 con 0x7f702c0aaa40 2023-07-27T14:33:09.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f702affd700 1 -- 172.21.15.115:0/2106840717 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70140033f0 con 0x7f702c0aaa40 2023-07-27T14:33:09.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f702affd700 1 -- 172.21.15.115:0/2106840717 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216258531 0 0) 0x7f702c0c05c0 con 0x7f702c153ec0 2023-07-27T14:33:09.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f702affd700 1 -- 172.21.15.115:0/2106840717 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7020001110 con 0x7f702c153ec0 2023-07-27T14:33:09.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f7030d9c700 1 -- 172.21.15.115:0/2106840717 >> v1:172.21.15.159:6789/0 conn(0x7f702c153ec0 legacy=0x7f702c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f7030d9c700 1 -- 172.21.15.115:0/2106840717 >> v1:172.21.15.115:6789/0 conn(0x7f702c0aaa40 legacy=0x7f702c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f7030d9c700 1 -- 172.21.15.115:0/2106840717 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0aa270 con 0x7f702c1542a0 2023-07-27T14:33:09.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f7030d9c700 1 --2- 172.21.15.115:0/2106840717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c1542a0 0x7f702c15efc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f7024009e60 tx=0x7f7024009780).ready entity=mon.0 client_cookie=ad2bcc97785fb80 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f702affd700 1 -- 172.21.15.115:0/2106840717 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400e070 con 0x7f702c1542a0 2023-07-27T14:33:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f702affd700 1 -- 172.21.15.115:0/2106840717 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400bab0 con 0x7f702c1542a0 2023-07-27T14:33:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.895+0000 7f702affd700 1 -- 172.21.15.115:0/2106840717 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400be30 con 0x7f702c1542a0 2023-07-27T14:33:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.896+0000 7f70327ff700 1 -- 172.21.15.115:0/2106840717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c1542a0 msgr2=0x7f702c15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.896+0000 7f70327ff700 1 --2- 172.21.15.115:0/2106840717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c1542a0 0x7f702c15efc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f7024009e60 tx=0x7f7024009780).stop 2023-07-27T14:33:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.896+0000 7f70327ff700 1 -- 172.21.15.115:0/2106840717 shutdown_connections 2023-07-27T14:33:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.896+0000 7f70327ff700 1 --2- 172.21.15.115:0/2106840717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c1542a0 0x7f702c15efc0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.896+0000 7f70327ff700 1 -- 172.21.15.115:0/2106840717 >> 172.21.15.115:0/2106840717 conn(0x7f702c0cb610 msgr2=0x7f702c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:09.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.896+0000 7f70327ff700 1 -- 172.21.15.115:0/2106840717 shutdown_connections 2023-07-27T14:33:09.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.896+0000 7f70327ff700 1 -- 172.21.15.115:0/2106840717 wait complete. 2023-07-27T14:33:09.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.897+0000 7f70327ff700 1 Processor -- start 2023-07-27T14:33:09.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.897+0000 7f70327ff700 1 -- start start 2023-07-27T14:33:09.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.898+0000 7f70327ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c0aaa40 0x7f702c141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.898+0000 7f70327ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f702c153ec0 0x7f702c0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.898+0000 7f70327ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f702c1542a0 0x7f702c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.898+0000 7f70327ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0ad310 con 0x7f702c0aaa40 2023-07-27T14:33:09.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.898+0000 7f70327ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c164fa0 con 0x7f702c1542a0 2023-07-27T14:33:09.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.898+0000 7f70327ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c141e00 con 0x7f702c153ec0 2023-07-27T14:33:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c0aaa40 0x7f702c141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c0aaa40 0x7f702c141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54626/0 (socket says 172.21.15.115:54626) 2023-07-27T14:33:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 -- 172.21.15.115:0/1059058540 learned_addr learned my addr 172.21.15.115:0/1059058540 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f7030d9c700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f702c1542a0 0x7f702c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702b7fe700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f702c153ec0 0x7f702c0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 -- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f702c153ec0 msgr2=0x7f702c0ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f702c153ec0 0x7f702c0ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 -- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f702c1542a0 msgr2=0x7f702c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f702c1542a0 0x7f702c0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 -- 172.21.15.115:0/1059058540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024009a20 con 0x7f702c0aaa40 2023-07-27T14:33:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f7030d9c700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f702c1542a0 0x7f702c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f702bfff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c0aaa40 0x7f702c141910 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f701c00c490 tx=0x7f701c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f7013fff700 1 -- 172.21.15.115:0/1059058540 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c00f470 con 0x7f702c0aaa40 2023-07-27T14:33:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f7013fff700 1 -- 172.21.15.115:0/1059058540 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c00f5d0 con 0x7f702c0aaa40 2023-07-27T14:33:09.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c164390 con 0x7f702c0aaa40 2023-07-27T14:33:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.899+0000 7f7013fff700 1 -- 172.21.15.115:0/1059058540 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c00f970 con 0x7f702c0aaa40 2023-07-27T14:33:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.900+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c164950 con 0x7f702c0aaa40 2023-07-27T14:33:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.900+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c06c470 con 0x7f702c0aaa40 2023-07-27T14:33:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.901+0000 7f7013fff700 1 -- 172.21.15.115:0/1059058540 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f701c019030 con 0x7f702c0aaa40 2023-07-27T14:33:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.902+0000 7f7013fff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f701805f510 0x7f70180619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.903+0000 7f7013fff700 1 -- 172.21.15.115:0/1059058540 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f701c079c20 con 0x7f702c0aaa40 2023-07-27T14:33:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.903+0000 7f702b7fe700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f701805f510 0x7f70180619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.903+0000 7f702b7fe700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f701805f510 0x7f70180619d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f702c064b70 tx=0x7f7020009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:09.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:09.906+0000 7f7013fff700 1 -- 172.21.15.115:0/1059058540 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f701c04aa70 con 0x7f702c0aaa40 2023-07-27T14:33:10.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.075+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f702c0c8230 con 0x7f702c0aaa40 2023-07-27T14:33:10.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.076+0000 7f7013fff700 1 -- 172.21.15.115:0/1059058540 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17086 (secure 0 0 0) 0x7f701c04e090 con 0x7f702c0aaa40 2023-07-27T14:33:10.115 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:10.115 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":114,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:07.235250+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:04.573925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:05.213515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:10.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f701805f510 msgr2=0x7f70180619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f701805f510 0x7f70180619d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f702c064b70 tx=0x7f7020009040).stop 2023-07-27T14:33:10.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c0aaa40 msgr2=0x7f702c141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c0aaa40 0x7f702c141910 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f701c00c490 tx=0x7f701c007c90).stop 2023-07-27T14:33:10.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 shutdown_connections 2023-07-27T14:33:10.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f701805f510 0x7f70180619d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f702c1542a0 0x7f702c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f702c0aaa40 0x7f702c141910 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 --2- 172.21.15.115:0/1059058540 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f702c153ec0 0x7f702c0ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 >> 172.21.15.115:0/1059058540 conn(0x7f702c0cb610 msgr2=0x7f702c0afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:10.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 shutdown_connections 2023-07-27T14:33:10.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.078+0000 7f70327ff700 1 -- 172.21.15.115:0/1059058540 wait complete. 2023-07-27T14:33:10.134 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:33:10.135 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:33:10.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.286+0000 7f8ea05ff700 1 Processor -- start 2023-07-27T14:33:10.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.286+0000 7f8ea05ff700 1 -- start start 2023-07-27T14:33:10.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.287+0000 7f8ea05ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8e98153ec0 0x7f8e980a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.287+0000 7f8ea05ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e980aa050 0x7f8e980640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.287+0000 7f8ea05ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980aa4d0 con 0x7f8e980aaa40 2023-07-27T14:33:10.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.287+0000 7f8ea05ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980c05c0 con 0x7f8e980aa050 2023-07-27T14:33:10.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.287+0000 7f8ea05ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980c1a60 con 0x7f8e98153ec0 2023-07-27T14:33:10.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9db9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e980aa050 0x7f8e980640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9db9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e980aa050 0x7f8e980640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54628/0 (socket says 172.21.15.115:54628) 2023-07-27T14:33:10.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9db9a700 1 -- 172.21.15.115:0/161391020 learned_addr learned my addr 172.21.15.115:0/161391020 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:10.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9e39b700 1 --2- 172.21.15.115:0/161391020 >> v2:172.21.15.159:3300/0 conn(0x7f8e98153ec0 0x7f8e980a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9db9a700 1 -- 172.21.15.115:0/161391020 >> v2:172.21.15.159:3300/0 conn(0x7f8e98153ec0 msgr2=0x7f8e980a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9db9a700 1 --2- 172.21.15.115:0/161391020 >> v2:172.21.15.159:3300/0 conn(0x7f8e98153ec0 0x7f8e980a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9db9a700 1 -- 172.21.15.115:0/161391020 >> v1:172.21.15.159:6789/0 conn(0x7f8e980aaa40 legacy=0x7f8e98157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9db9a700 1 -- 172.21.15.115:0/161391020 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980bfc90 con 0x7f8e980aa050 2023-07-27T14:33:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9e39b700 1 --2- 172.21.15.115:0/161391020 >> v2:172.21.15.159:3300/0 conn(0x7f8e98153ec0 0x7f8e980a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.288+0000 7f8e9db9a700 1 --2- 172.21.15.115:0/161391020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e980640f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f8e98083e30 tx=0x7f8e880090f0).ready entity=mon.0 client_cookie=811eb2328811aa16 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8e9d399700 1 -- 172.21.15.115:0/161391020 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800b600 con 0x7f8e980aa050 2023-07-27T14:33:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8e9d399700 1 -- 172.21.15.115:0/161391020 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8800b760 con 0x7f8e980aa050 2023-07-27T14:33:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8e9d399700 1 -- 172.21.15.115:0/161391020 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800bae0 con 0x7f8e980aa050 2023-07-27T14:33:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8ea05ff700 1 -- 172.21.15.115:0/161391020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 msgr2=0x7f8e980640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/161391020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e980640f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f8e98083e30 tx=0x7f8e880090f0).stop 2023-07-27T14:33:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8ea05ff700 1 -- 172.21.15.115:0/161391020 shutdown_connections 2023-07-27T14:33:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/161391020 >> v2:172.21.15.159:3300/0 conn(0x7f8e98153ec0 0x7f8e980a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/161391020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e980640f0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8ea05ff700 1 -- 172.21.15.115:0/161391020 >> 172.21.15.115:0/161391020 conn(0x7f8e980cb610 msgr2=0x7f8e980c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:10.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8ea05ff700 1 -- 172.21.15.115:0/161391020 shutdown_connections 2023-07-27T14:33:10.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.289+0000 7f8ea05ff700 1 -- 172.21.15.115:0/161391020 wait complete. 2023-07-27T14:33:10.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.291+0000 7f8ea05ff700 1 Processor -- start 2023-07-27T14:33:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.291+0000 7f8ea05ff700 1 -- start start 2023-07-27T14:33:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8ea05ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e98153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8ea05ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e980aaa40 0x7f8e98151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8ea05ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e98153ec0 0x7f8e9814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8ea05ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e981537f0 con 0x7f8e980aa050 2023-07-27T14:33:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8ea05ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98151610 con 0x7f8e980aaa40 2023-07-27T14:33:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8ea05ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9814f040 con 0x7f8e98153ec0 2023-07-27T14:33:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9e39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e98153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9e39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e98153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54640/0 (socket says 172.21.15.115:54640) 2023-07-27T14:33:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9e39b700 1 -- 172.21.15.115:0/721049670 learned_addr learned my addr 172.21.15.115:0/721049670 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9db9a700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e980aaa40 0x7f8e98151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9eb9c700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e98153ec0 0x7f8e9814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9e39b700 1 -- 172.21.15.115:0/721049670 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e98153ec0 msgr2=0x7f8e9814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9e39b700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e98153ec0 0x7f8e9814eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9e39b700 1 -- 172.21.15.115:0/721049670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e980aaa40 msgr2=0x7f8e98151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9e39b700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e980aaa40 0x7f8e98151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.292+0000 7f8e9e39b700 1 -- 172.21.15.115:0/721049670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88009370 con 0x7f8e980aa050 2023-07-27T14:33:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.293+0000 7f8e9e39b700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e98153300 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f8e9400d890 tx=0x7f8e94008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.293+0000 7f8e8e7fc700 1 -- 172.21.15.115:0/721049670 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940125f0 con 0x7f8e980aa050 2023-07-27T14:33:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.293+0000 7f8e8e7fc700 1 -- 172.21.15.115:0/721049670 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94012750 con 0x7f8e980aa050 2023-07-27T14:33:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.293+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e981523c0 con 0x7f8e980aa050 2023-07-27T14:33:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.293+0000 7f8e8e7fc700 1 -- 172.21.15.115:0/721049670 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94012ad0 con 0x7f8e980aa050 2023-07-27T14:33:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.293+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e98151b20 con 0x7f8e980aa050 2023-07-27T14:33:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.294+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e981646f0 con 0x7f8e980aa050 2023-07-27T14:33:10.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.295+0000 7f8e8e7fc700 1 -- 172.21.15.115:0/721049670 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f8e94013480 con 0x7f8e980aa050 2023-07-27T14:33:10.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.295+0000 7f8e8e7fc700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e7c05f4b0 0x7f8e7c061970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.296+0000 7f8e8e7fc700 1 -- 172.21.15.115:0/721049670 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e9407a570 con 0x7f8e980aa050 2023-07-27T14:33:10.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.296+0000 7f8e9db9a700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e7c05f4b0 0x7f8e7c061970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.296+0000 7f8e9db9a700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e7c05f4b0 0x7f8e7c061970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f8e88009130 tx=0x7f8e88017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:10.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.300+0000 7f8e8e7fc700 1 -- 172.21.15.115:0/721049670 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e9404b360 con 0x7f8e980aa050 2023-07-27T14:33:10.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.465+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e980bff70 con 0x7f8e7c05f4b0 2023-07-27T14:33:10.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.475+0000 7f8e8e7fc700 1 -- 172.21.15.115:0/721049670 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361473 (secure 0 0 0) 0x7f8e980bff70 con 0x7f8e7c05f4b0 2023-07-27T14:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:10.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e7c05f4b0 msgr2=0x7f8e7c061970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e7c05f4b0 0x7f8e7c061970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f8e88009130 tx=0x7f8e88017000).stop 2023-07-27T14:33:10.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 msgr2=0x7f8e98153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e98153300 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f8e9400d890 tx=0x7f8e94008040).stop 2023-07-27T14:33:10.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 shutdown_connections 2023-07-27T14:33:10.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e7c05f4b0 0x7f8e7c061970 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e98153ec0 0x7f8e9814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e980aa050 0x7f8e98153300 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 --2- 172.21.15.115:0/721049670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e980aaa40 0x7f8e98151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 >> 172.21.15.115:0/721049670 conn(0x7f8e980cb610 msgr2=0x7f8e980640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:10.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 shutdown_connections 2023-07-27T14:33:10.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.481+0000 7f8ea05ff700 1 -- 172.21.15.115:0/721049670 wait complete. 2023-07-27T14:33:10.521 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2023-07-27T14:33:09.520743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":123792,"kb_used_data":11024,"kb_used_omap":0,"kb_used_meta":112704,"kb_avail":754850928,"statfs":{"total":773094113280,"available":772967350272,"internally_reserved":0,"allocated":11288576,"data_stored":5248388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":115408896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2351732,"num_objects":-30,"num_object_clones":-1,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":-1,"num_read":-11,"num_read_kb":-1034,"num_write":-131,"num_write_kb":-2350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.048875"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268070+0000","last_change":"2023-07-27T14:33:06.266797+0000","last_active":"2023-07-27T14:33:06.268070+0000","last_peered":"2023-07-27T14:33:06.268070+0000","last_clean":"2023-07-27T14:33:06.268070+0000","last_became_active":"2023-07-27T14:33:06.266536+0000","last_became_peered":"2023-07-27T14:33:06.266536+0000","last_unstale":"2023-07-27T14:33:06.268070+0000","last_undegraded":"2023-07-27T14:33:06.268070+0000","last_fullsized":"2023-07-27T14:33:06.268070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"113'3","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269986+0000","last_change":"2023-07-27T14:33:05.786176+0000","last_active":"2023-07-27T14:33:06.269986+0000","last_peered":"2023-07-27T14:33:06.269986+0000","last_clean":"2023-07-27T14:33:06.269986+0000","last_became_active":"2023-07-27T14:33:05.785809+0000","last_became_peered":"2023-07-27T14:33:05.785809+0000","last_unstale":"2023-07-27T14:33:06.269986+0000","last_undegraded":"2023-07-27T14:33:06.269986+0000","last_fullsized":"2023-07-27T14:33:06.269986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257020+0000","last_change":"2023-07-27T14:33:06.254403+0000","last_active":"2023-07-27T14:33:06.257020+0000","last_peered":"2023-07-27T14:33:06.257020+0000","last_clean":"2023-07-27T14:33:06.257020+0000","last_became_active":"2023-07-27T14:33:06.254028+0000","last_became_peered":"2023-07-27T14:33:06.254028+0000","last_unstale":"2023-07-27T14:33:06.257020+0000","last_undegraded":"2023-07-27T14:33:06.257020+0000","last_fullsized":"2023-07-27T14:33:06.257020+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.238034+0000","last_change":"2023-07-27T14:33:05.796171+0000","last_active":"2023-07-27T14:33:06.238034+0000","last_peered":"2023-07-27T14:33:06.238034+0000","last_clean":"2023-07-27T14:33:06.238034+0000","last_became_active":"2023-07-27T14:33:05.795128+0000","last_became_peered":"2023-07-27T14:33:05.795128+0000","last_unstale":"2023-07-27T14:33:06.238034+0000","last_undegraded":"2023-07-27T14:33:06.238034+0000","last_fullsized":"2023-07-27T14:33:06.238034+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269925+0000","last_change":"2023-07-27T14:33:06.266761+0000","last_active":"2023-07-27T14:33:06.269925+0000","last_peered":"2023-07-27T14:33:06.269925+0000","last_clean":"2023-07-27T14:33:06.269925+0000","last_became_active":"2023-07-27T14:33:06.266445+0000","last_became_peered":"2023-07-27T14:33:06.266445+0000","last_unstale":"2023-07-27T14:33:06.269925+0000","last_undegraded":"2023-07-27T14:33:06.269925+0000","last_fullsized":"2023-07-27T14:33:06.269925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246809+0000","last_change":"2023-07-27T14:33:05.785528+0000","last_active":"2023-07-27T14:33:06.246809+0000","last_peered":"2023-07-27T14:33:06.246809+0000","last_clean":"2023-07-27T14:33:06.246809+0000","last_became_active":"2023-07-27T14:33:05.785271+0000","last_became_peered":"2023-07-27T14:33:05.785271+0000","last_unstale":"2023-07-27T14:33:06.246809+0000","last_undegraded":"2023-07-27T14:33:06.246809+0000","last_fullsized":"2023-07-27T14:33:06.246809+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258518+0000","last_change":"2023-07-27T14:33:06.254861+0000","last_active":"2023-07-27T14:33:06.258518+0000","last_peered":"2023-07-27T14:33:06.258518+0000","last_clean":"2023-07-27T14:33:06.258518+0000","last_became_active":"2023-07-27T14:33:06.254608+0000","last_became_peered":"2023-07-27T14:33:06.254608+0000","last_unstale":"2023-07-27T14:33:06.258518+0000","last_undegraded":"2023-07-27T14:33:06.258518+0000","last_fullsized":"2023-07-27T14:33:06.258518+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.263501+0000","last_change":"2023-07-27T14:33:05.790605+0000","last_active":"2023-07-27T14:33:06.263501+0000","last_peered":"2023-07-27T14:33:06.263501+0000","last_clean":"2023-07-27T14:33:06.263501+0000","last_became_active":"2023-07-27T14:33:05.790316+0000","last_became_peered":"2023-07-27T14:33:05.790316+0000","last_unstale":"2023-07-27T14:33:06.263501+0000","last_undegraded":"2023-07-27T14:33:06.263501+0000","last_fullsized":"2023-07-27T14:33:06.263501+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256757+0000","last_change":"2023-07-27T14:33:06.252141+0000","last_active":"2023-07-27T14:33:06.256757+0000","last_peered":"2023-07-27T14:33:06.256757+0000","last_clean":"2023-07-27T14:33:06.256757+0000","last_became_active":"2023-07-27T14:33:06.251859+0000","last_became_peered":"2023-07-27T14:33:06.251859+0000","last_unstale":"2023-07-27T14:33:06.256757+0000","last_undegraded":"2023-07-27T14:33:06.256757+0000","last_fullsized":"2023-07-27T14:33:06.256757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.266064+0000","last_change":"2023-07-27T14:33:05.795397+0000","last_active":"2023-07-27T14:33:06.266064+0000","last_peered":"2023-07-27T14:33:06.266064+0000","last_clean":"2023-07-27T14:33:06.266064+0000","last_became_active":"2023-07-27T14:33:05.795081+0000","last_became_peered":"2023-07-27T14:33:05.795081+0000","last_unstale":"2023-07-27T14:33:06.266064+0000","last_undegraded":"2023-07-27T14:33:06.266064+0000","last_fullsized":"2023-07-27T14:33:06.266064+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257014+0000","last_change":"2023-07-27T14:33:06.252188+0000","last_active":"2023-07-27T14:33:06.257014+0000","last_peered":"2023-07-27T14:33:06.257014+0000","last_clean":"2023-07-27T14:33:06.257014+0000","last_became_active":"2023-07-27T14:33:06.251895+0000","last_became_peered":"2023-07-27T14:33:06.251895+0000","last_unstale":"2023-07-27T14:33:06.257014+0000","last_undegraded":"2023-07-27T14:33:06.257014+0000","last_fullsized":"2023-07-27T14:33:06.257014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265640+0000","last_change":"2023-07-27T14:33:05.787322+0000","last_active":"2023-07-27T14:33:06.265640+0000","last_peered":"2023-07-27T14:33:06.265640+0000","last_clean":"2023-07-27T14:33:06.265640+0000","last_became_active":"2023-07-27T14:33:05.787045+0000","last_became_peered":"2023-07-27T14:33:05.787045+0000","last_unstale":"2023-07-27T14:33:06.265640+0000","last_undegraded":"2023-07-27T14:33:06.265640+0000","last_fullsized":"2023-07-27T14:33:06.265640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269939+0000","last_change":"2023-07-27T14:33:06.266851+0000","last_active":"2023-07-27T14:33:06.269939+0000","last_peered":"2023-07-27T14:33:06.269939+0000","last_clean":"2023-07-27T14:33:06.269939+0000","last_became_active":"2023-07-27T14:33:06.266503+0000","last_became_peered":"2023-07-27T14:33:06.266503+0000","last_unstale":"2023-07-27T14:33:06.269939+0000","last_undegraded":"2023-07-27T14:33:06.269939+0000","last_fullsized":"2023-07-27T14:33:06.269939+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244517+0000","last_change":"2023-07-27T14:33:05.787155+0000","last_active":"2023-07-27T14:33:06.244517+0000","last_peered":"2023-07-27T14:33:06.244517+0000","last_clean":"2023-07-27T14:33:06.244517+0000","last_became_active":"2023-07-27T14:33:05.786876+0000","last_became_peered":"2023-07-27T14:33:05.786876+0000","last_unstale":"2023-07-27T14:33:06.244517+0000","last_undegraded":"2023-07-27T14:33:06.244517+0000","last_fullsized":"2023-07-27T14:33:06.244517+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269851+0000","last_change":"2023-07-27T14:33:06.266087+0000","last_active":"2023-07-27T14:33:06.269851+0000","last_peered":"2023-07-27T14:33:06.269851+0000","last_clean":"2023-07-27T14:33:06.269851+0000","last_became_active":"2023-07-27T14:33:06.265553+0000","last_became_peered":"2023-07-27T14:33:06.265553+0000","last_unstale":"2023-07-27T14:33:06.269851+0000","last_undegraded":"2023-07-27T14:33:06.269851+0000","last_fullsized":"2023-07-27T14:33:06.269851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.237732+0000","last_change":"2023-07-27T14:33:05.786072+0000","last_active":"2023-07-27T14:33:06.237732+0000","last_peered":"2023-07-27T14:33:06.237732+0000","last_clean":"2023-07-27T14:33:06.237732+0000","last_became_active":"2023-07-27T14:33:05.785778+0000","last_became_peered":"2023-07-27T14:33:05.785778+0000","last_unstale":"2023-07-27T14:33:06.237732+0000","last_undegraded":"2023-07-27T14:33:06.237732+0000","last_fullsized":"2023-07-27T14:33:06.237732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258706+0000","last_change":"2023-07-27T14:33:06.257044+0000","last_active":"2023-07-27T14:33:06.258706+0000","last_peered":"2023-07-27T14:33:06.258706+0000","last_clean":"2023-07-27T14:33:06.258706+0000","last_became_active":"2023-07-27T14:33:06.256782+0000","last_became_peered":"2023-07-27T14:33:06.256782+0000","last_unstale":"2023-07-27T14:33:06.258706+0000","last_undegraded":"2023-07-27T14:33:06.258706+0000","last_fullsized":"2023-07-27T14:33:06.258706+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.255990+0000","last_change":"2023-07-27T14:33:05.794363+0000","last_active":"2023-07-27T14:33:06.255990+0000","last_peered":"2023-07-27T14:33:06.255990+0000","last_clean":"2023-07-27T14:33:06.255990+0000","last_became_active":"2023-07-27T14:33:05.794055+0000","last_became_peered":"2023-07-27T14:33:05.794055+0000","last_unstale":"2023-07-27T14:33:06.255990+0000","last_undegraded":"2023-07-27T14:33:06.255990+0000","last_fullsized":"2023-07-27T14:33:06.255990+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252572+0000","last_change":"2023-07-27T14:33:06.250740+0000","last_active":"2023-07-27T14:33:06.252572+0000","last_peered":"2023-07-27T14:33:06.252572+0000","last_clean":"2023-07-27T14:33:06.252572+0000","last_became_active":"2023-07-27T14:33:06.250323+0000","last_became_peered":"2023-07-27T14:33:06.250323+0000","last_unstale":"2023-07-27T14:33:06.252572+0000","last_undegraded":"2023-07-27T14:33:06.252572+0000","last_fullsized":"2023-07-27T14:33:06.252572+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247177+0000","last_change":"2023-07-27T14:33:05.791286+0000","last_active":"2023-07-27T14:33:06.247177+0000","last_peered":"2023-07-27T14:33:06.247177+0000","last_clean":"2023-07-27T14:33:06.247177+0000","last_became_active":"2023-07-27T14:33:05.790998+0000","last_became_peered":"2023-07-27T14:33:05.790998+0000","last_unstale":"2023-07-27T14:33:06.247177+0000","last_undegraded":"2023-07-27T14:33:06.247177+0000","last_fullsized":"2023-07-27T14:33:06.247177+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257462+0000","last_change":"2023-07-27T14:33:06.253120+0000","last_active":"2023-07-27T14:33:06.257462+0000","last_peered":"2023-07-27T14:33:06.257462+0000","last_clean":"2023-07-27T14:33:06.257462+0000","last_became_active":"2023-07-27T14:33:06.252721+0000","last_became_peered":"2023-07-27T14:33:06.252721+0000","last_unstale":"2023-07-27T14:33:06.257462+0000","last_undegraded":"2023-07-27T14:33:06.257462+0000","last_fullsized":"2023-07-27T14:33:06.257462+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246459+0000","last_change":"2023-07-27T14:33:05.792950+0000","last_active":"2023-07-27T14:33:06.246459+0000","last_peered":"2023-07-27T14:33:06.246459+0000","last_clean":"2023-07-27T14:33:06.246459+0000","last_became_active":"2023-07-27T14:33:05.792527+0000","last_became_peered":"2023-07-27T14:33:05.792527+0000","last_unstale":"2023-07-27T14:33:06.246459+0000","last_undegraded":"2023-07-27T14:33:06.246459+0000","last_fullsized":"2023-07-27T14:33:06.246459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258534+0000","last_change":"2023-07-27T14:33:06.256099+0000","last_active":"2023-07-27T14:33:06.258534+0000","last_peered":"2023-07-27T14:33:06.258534+0000","last_clean":"2023-07-27T14:33:06.258534+0000","last_became_active":"2023-07-27T14:33:06.255500+0000","last_became_peered":"2023-07-27T14:33:06.255500+0000","last_unstale":"2023-07-27T14:33:06.258534+0000","last_undegraded":"2023-07-27T14:33:06.258534+0000","last_fullsized":"2023-07-27T14:33:06.258534+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"113'4","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.271872+0000","last_change":"2023-07-27T14:33:05.778934+0000","last_active":"2023-07-27T14:33:06.271872+0000","last_peered":"2023-07-27T14:33:06.271872+0000","last_clean":"2023-07-27T14:33:06.271872+0000","last_became_active":"2023-07-27T14:33:05.777799+0000","last_became_peered":"2023-07-27T14:33:05.777799+0000","last_unstale":"2023-07-27T14:33:06.271872+0000","last_undegraded":"2023-07-27T14:33:06.271872+0000","last_fullsized":"2023-07-27T14:33:06.271872+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.270978+0000","last_change":"2023-07-27T14:33:06.269633+0000","last_active":"2023-07-27T14:33:06.270978+0000","last_peered":"2023-07-27T14:33:06.270978+0000","last_clean":"2023-07-27T14:33:06.270978+0000","last_became_active":"2023-07-27T14:33:06.269297+0000","last_became_peered":"2023-07-27T14:33:06.269297+0000","last_unstale":"2023-07-27T14:33:06.270978+0000","last_undegraded":"2023-07-27T14:33:06.270978+0000","last_fullsized":"2023-07-27T14:33:06.270978+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262512+0000","last_change":"2023-07-27T14:33:05.793768+0000","last_active":"2023-07-27T14:33:06.262512+0000","last_peered":"2023-07-27T14:33:06.262512+0000","last_clean":"2023-07-27T14:33:06.262512+0000","last_became_active":"2023-07-27T14:33:05.793457+0000","last_became_peered":"2023-07-27T14:33:05.793457+0000","last_unstale":"2023-07-27T14:33:06.262512+0000","last_undegraded":"2023-07-27T14:33:06.262512+0000","last_fullsized":"2023-07-27T14:33:06.262512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.260524+0000","last_change":"2023-07-27T14:33:06.255436+0000","last_active":"2023-07-27T14:33:06.260524+0000","last_peered":"2023-07-27T14:33:06.260524+0000","last_clean":"2023-07-27T14:33:06.260524+0000","last_became_active":"2023-07-27T14:33:06.254991+0000","last_became_peered":"2023-07-27T14:33:06.254991+0000","last_unstale":"2023-07-27T14:33:06.260524+0000","last_undegraded":"2023-07-27T14:33:06.260524+0000","last_fullsized":"2023-07-27T14:33:06.260524+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244897+0000","last_change":"2023-07-27T14:33:05.791347+0000","last_active":"2023-07-27T14:33:06.244897+0000","last_peered":"2023-07-27T14:33:06.244897+0000","last_clean":"2023-07-27T14:33:06.244897+0000","last_became_active":"2023-07-27T14:33:05.791052+0000","last_became_peered":"2023-07-27T14:33:05.791052+0000","last_unstale":"2023-07-27T14:33:06.244897+0000","last_undegraded":"2023-07-27T14:33:06.244897+0000","last_fullsized":"2023-07-27T14:33:06.244897+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265552+0000","last_change":"2023-07-27T14:33:06.259433+0000","last_active":"2023-07-27T14:33:06.265552+0000","last_peered":"2023-07-27T14:33:06.265552+0000","last_clean":"2023-07-27T14:33:06.265552+0000","last_became_active":"2023-07-27T14:33:06.259110+0000","last_became_peered":"2023-07-27T14:33:06.259110+0000","last_unstale":"2023-07-27T14:33:06.265552+0000","last_undegraded":"2023-07-27T14:33:06.265552+0000","last_fullsized":"2023-07-27T14:33:06.265552+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244118+0000","last_change":"2023-07-27T14:33:05.799466+0000","last_active":"2023-07-27T14:33:06.244118+0000","last_peered":"2023-07-27T14:33:06.244118+0000","last_clean":"2023-07-27T14:33:06.244118+0000","last_became_active":"2023-07-27T14:33:05.799255+0000","last_became_peered":"2023-07-27T14:33:05.799255+0000","last_unstale":"2023-07-27T14:33:06.244118+0000","last_undegraded":"2023-07-27T14:33:06.244118+0000","last_fullsized":"2023-07-27T14:33:06.244118+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252531+0000","last_change":"2023-07-27T14:33:06.249187+0000","last_active":"2023-07-27T14:33:06.252531+0000","last_peered":"2023-07-27T14:33:06.252531+0000","last_clean":"2023-07-27T14:33:06.252531+0000","last_became_active":"2023-07-27T14:33:06.248936+0000","last_became_peered":"2023-07-27T14:33:06.248936+0000","last_unstale":"2023-07-27T14:33:06.252531+0000","last_undegraded":"2023-07-27T14:33:06.252531+0000","last_fullsized":"2023-07-27T14:33:06.252531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"113'4","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.266114+0000","last_change":"2023-07-27T14:33:05.802317+0000","last_active":"2023-07-27T14:33:06.266114+0000","last_peered":"2023-07-27T14:33:06.266114+0000","last_clean":"2023-07-27T14:33:06.266114+0000","last_became_active":"2023-07-27T14:33:05.801875+0000","last_became_peered":"2023-07-27T14:33:05.801875+0000","last_unstale":"2023-07-27T14:33:06.266114+0000","last_undegraded":"2023-07-27T14:33:06.266114+0000","last_fullsized":"2023-07-27T14:33:06.266114+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.255888+0000","last_change":"2023-07-27T14:33:06.251057+0000","last_active":"2023-07-27T14:33:06.255888+0000","last_peered":"2023-07-27T14:33:06.255888+0000","last_clean":"2023-07-27T14:33:06.255888+0000","last_became_active":"2023-07-27T14:33:06.250778+0000","last_became_peered":"2023-07-27T14:33:06.250778+0000","last_unstale":"2023-07-27T14:33:06.255888+0000","last_undegraded":"2023-07-27T14:33:06.255888+0000","last_fullsized":"2023-07-27T14:33:06.255888+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.239262+0000","last_change":"2023-07-27T14:33:05.794268+0000","last_active":"2023-07-27T14:33:06.239262+0000","last_peered":"2023-07-27T14:33:06.239262+0000","last_clean":"2023-07-27T14:33:06.239262+0000","last_became_active":"2023-07-27T14:33:05.793903+0000","last_became_peered":"2023-07-27T14:33:05.793903+0000","last_unstale":"2023-07-27T14:33:06.239262+0000","last_undegraded":"2023-07-27T14:33:06.239262+0000","last_fullsized":"2023-07-27T14:33:06.239262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258676+0000","last_change":"2023-07-27T14:33:06.252056+0000","last_active":"2023-07-27T14:33:06.258676+0000","last_peered":"2023-07-27T14:33:06.258676+0000","last_clean":"2023-07-27T14:33:06.258676+0000","last_became_active":"2023-07-27T14:33:06.251780+0000","last_became_peered":"2023-07-27T14:33:06.251780+0000","last_unstale":"2023-07-27T14:33:06.258676+0000","last_undegraded":"2023-07-27T14:33:06.258676+0000","last_fullsized":"2023-07-27T14:33:06.258676+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244944+0000","last_change":"2023-07-27T14:33:05.792003+0000","last_active":"2023-07-27T14:33:06.244944+0000","last_peered":"2023-07-27T14:33:06.244944+0000","last_clean":"2023-07-27T14:33:06.244944+0000","last_became_active":"2023-07-27T14:33:05.791747+0000","last_became_peered":"2023-07-27T14:33:05.791747+0000","last_unstale":"2023-07-27T14:33:06.244944+0000","last_undegraded":"2023-07-27T14:33:06.244944+0000","last_fullsized":"2023-07-27T14:33:06.244944+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262292+0000","last_change":"2023-07-27T14:33:06.258561+0000","last_active":"2023-07-27T14:33:06.262292+0000","last_peered":"2023-07-27T14:33:06.262292+0000","last_clean":"2023-07-27T14:33:06.262292+0000","last_became_active":"2023-07-27T14:33:06.258262+0000","last_became_peered":"2023-07-27T14:33:06.258262+0000","last_unstale":"2023-07-27T14:33:06.262292+0000","last_undegraded":"2023-07-27T14:33:06.262292+0000","last_fullsized":"2023-07-27T14:33:06.262292+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261841+0000","last_change":"2023-07-27T14:33:05.794105+0000","last_active":"2023-07-27T14:33:06.261841+0000","last_peered":"2023-07-27T14:33:06.261841+0000","last_clean":"2023-07-27T14:33:06.261841+0000","last_became_active":"2023-07-27T14:33:05.793805+0000","last_became_peered":"2023-07-27T14:33:05.793805+0000","last_unstale":"2023-07-27T14:33:06.261841+0000","last_undegraded":"2023-07-27T14:33:06.261841+0000","last_fullsized":"2023-07-27T14:33:06.261841+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265635+0000","last_change":"2023-07-27T14:33:06.260116+0000","last_active":"2023-07-27T14:33:06.265635+0000","last_peered":"2023-07-27T14:33:06.265635+0000","last_clean":"2023-07-27T14:33:06.265635+0000","last_became_active":"2023-07-27T14:33:06.259859+0000","last_became_peered":"2023-07-27T14:33:06.259859+0000","last_unstale":"2023-07-27T14:33:06.265635+0000","last_undegraded":"2023-07-27T14:33:06.265635+0000","last_fullsized":"2023-07-27T14:33:06.265635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262515+0000","last_change":"2023-07-27T14:33:05.794454+0000","last_active":"2023-07-27T14:33:06.262515+0000","last_peered":"2023-07-27T14:33:06.262515+0000","last_clean":"2023-07-27T14:33:06.262515+0000","last_became_active":"2023-07-27T14:33:05.794132+0000","last_became_peered":"2023-07-27T14:33:05.794132+0000","last_unstale":"2023-07-27T14:33:06.262515+0000","last_undegraded":"2023-07-27T14:33:06.262515+0000","last_fullsized":"2023-07-27T14:33:06.262515+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.270487+0000","last_change":"2023-07-27T14:33:06.267162+0000","last_active":"2023-07-27T14:33:06.270487+0000","last_peered":"2023-07-27T14:33:06.270487+0000","last_clean":"2023-07-27T14:33:06.270487+0000","last_became_active":"2023-07-27T14:33:06.266873+0000","last_became_peered":"2023-07-27T14:33:06.266873+0000","last_unstale":"2023-07-27T14:33:06.270487+0000","last_undegraded":"2023-07-27T14:33:06.270487+0000","last_fullsized":"2023-07-27T14:33:06.270487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257972+0000","last_change":"2023-07-27T14:33:05.794219+0000","last_active":"2023-07-27T14:33:06.257972+0000","last_peered":"2023-07-27T14:33:06.257972+0000","last_clean":"2023-07-27T14:33:06.257972+0000","last_became_active":"2023-07-27T14:33:05.793918+0000","last_became_peered":"2023-07-27T14:33:05.793918+0000","last_unstale":"2023-07-27T14:33:06.257972+0000","last_undegraded":"2023-07-27T14:33:06.257972+0000","last_fullsized":"2023-07-27T14:33:06.257972+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262560+0000","last_change":"2023-07-27T14:33:06.255862+0000","last_active":"2023-07-27T14:33:06.262560+0000","last_peered":"2023-07-27T14:33:06.262560+0000","last_clean":"2023-07-27T14:33:06.262560+0000","last_became_active":"2023-07-27T14:33:06.255555+0000","last_became_peered":"2023-07-27T14:33:06.255555+0000","last_unstale":"2023-07-27T14:33:06.262560+0000","last_undegraded":"2023-07-27T14:33:06.262560+0000","last_fullsized":"2023-07-27T14:33:06.262560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.237620+0000","last_change":"2023-07-27T14:33:05.799379+0000","last_active":"2023-07-27T14:33:06.237620+0000","last_peered":"2023-07-27T14:33:06.237620+0000","last_clean":"2023-07-27T14:33:06.237620+0000","last_became_active":"2023-07-27T14:33:05.799093+0000","last_became_peered":"2023-07-27T14:33:05.799093+0000","last_unstale":"2023-07-27T14:33:06.237620+0000","last_undegraded":"2023-07-27T14:33:06.237620+0000","last_fullsized":"2023-07-27T14:33:06.237620+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257865+0000","last_change":"2023-07-27T14:33:06.254020+0000","last_active":"2023-07-27T14:33:06.257865+0000","last_peered":"2023-07-27T14:33:06.257865+0000","last_clean":"2023-07-27T14:33:06.257865+0000","last_became_active":"2023-07-27T14:33:06.253733+0000","last_became_peered":"2023-07-27T14:33:06.253733+0000","last_unstale":"2023-07-27T14:33:06.257865+0000","last_undegraded":"2023-07-27T14:33:06.257865+0000","last_fullsized":"2023-07-27T14:33:06.257865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.237499+0000","last_change":"2023-07-27T14:33:05.797408+0000","last_active":"2023-07-27T14:33:06.237499+0000","last_peered":"2023-07-27T14:33:06.237499+0000","last_clean":"2023-07-27T14:33:06.237499+0000","last_became_active":"2023-07-27T14:33:05.796884+0000","last_became_peered":"2023-07-27T14:33:05.796884+0000","last_unstale":"2023-07-27T14:33:06.237499+0000","last_undegraded":"2023-07-27T14:33:06.237499+0000","last_fullsized":"2023-07-27T14:33:06.237499+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257059+0000","last_change":"2023-07-27T14:33:06.254305+0000","last_active":"2023-07-27T14:33:06.257059+0000","last_peered":"2023-07-27T14:33:06.257059+0000","last_clean":"2023-07-27T14:33:06.257059+0000","last_became_active":"2023-07-27T14:33:06.253952+0000","last_became_peered":"2023-07-27T14:33:06.253952+0000","last_unstale":"2023-07-27T14:33:06.257059+0000","last_undegraded":"2023-07-27T14:33:06.257059+0000","last_fullsized":"2023-07-27T14:33:06.257059+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246260+0000","last_change":"2023-07-27T14:33:05.788329+0000","last_active":"2023-07-27T14:33:06.246260+0000","last_peered":"2023-07-27T14:33:06.246260+0000","last_clean":"2023-07-27T14:33:06.246260+0000","last_became_active":"2023-07-27T14:33:05.787620+0000","last_became_peered":"2023-07-27T14:33:05.787620+0000","last_unstale":"2023-07-27T14:33:06.246260+0000","last_undegraded":"2023-07-27T14:33:06.246260+0000","last_fullsized":"2023-07-27T14:33:06.246260+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262937+0000","last_change":"2023-07-27T14:33:06.260436+0000","last_active":"2023-07-27T14:33:06.262937+0000","last_peered":"2023-07-27T14:33:06.262937+0000","last_clean":"2023-07-27T14:33:06.262937+0000","last_became_active":"2023-07-27T14:33:06.260127+0000","last_became_peered":"2023-07-27T14:33:06.260127+0000","last_unstale":"2023-07-27T14:33:06.262937+0000","last_undegraded":"2023-07-27T14:33:06.262937+0000","last_fullsized":"2023-07-27T14:33:06.262937+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247230+0000","last_change":"2023-07-27T14:33:05.792906+0000","last_active":"2023-07-27T14:33:06.247230+0000","last_peered":"2023-07-27T14:33:06.247230+0000","last_clean":"2023-07-27T14:33:06.247230+0000","last_became_active":"2023-07-27T14:33:05.792577+0000","last_became_peered":"2023-07-27T14:33:05.792577+0000","last_unstale":"2023-07-27T14:33:06.247230+0000","last_undegraded":"2023-07-27T14:33:06.247230+0000","last_fullsized":"2023-07-27T14:33:06.247230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265976+0000","last_change":"2023-07-27T14:33:06.260259+0000","last_active":"2023-07-27T14:33:06.265976+0000","last_peered":"2023-07-27T14:33:06.265976+0000","last_clean":"2023-07-27T14:33:06.265976+0000","last_became_active":"2023-07-27T14:33:06.259934+0000","last_became_peered":"2023-07-27T14:33:06.259934+0000","last_unstale":"2023-07-27T14:33:06.265976+0000","last_undegraded":"2023-07-27T14:33:06.265976+0000","last_fullsized":"2023-07-27T14:33:06.265976+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.238141+0000","last_change":"2023-07-27T14:33:05.782301+0000","last_active":"2023-07-27T14:33:06.238141+0000","last_peered":"2023-07-27T14:33:06.238141+0000","last_clean":"2023-07-27T14:33:06.238141+0000","last_became_active":"2023-07-27T14:33:05.782020+0000","last_became_peered":"2023-07-27T14:33:05.782020+0000","last_unstale":"2023-07-27T14:33:06.238141+0000","last_undegraded":"2023-07-27T14:33:06.238141+0000","last_fullsized":"2023-07-27T14:33:06.238141+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265664+0000","last_change":"2023-07-27T14:33:06.259534+0000","last_active":"2023-07-27T14:33:06.265664+0000","last_peered":"2023-07-27T14:33:06.265664+0000","last_clean":"2023-07-27T14:33:06.265664+0000","last_became_active":"2023-07-27T14:33:06.259215+0000","last_became_peered":"2023-07-27T14:33:06.259215+0000","last_unstale":"2023-07-27T14:33:06.265664+0000","last_undegraded":"2023-07-27T14:33:06.265664+0000","last_fullsized":"2023-07-27T14:33:06.265664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246116+0000","last_change":"2023-07-27T14:33:05.789970+0000","last_active":"2023-07-27T14:33:06.246116+0000","last_peered":"2023-07-27T14:33:06.246116+0000","last_clean":"2023-07-27T14:33:06.246116+0000","last_became_active":"2023-07-27T14:33:05.789681+0000","last_became_peered":"2023-07-27T14:33:05.789681+0000","last_unstale":"2023-07-27T14:33:06.246116+0000","last_undegraded":"2023-07-27T14:33:06.246116+0000","last_fullsized":"2023-07-27T14:33:06.246116+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268366+0000","last_change":"2023-07-27T14:33:06.266559+0000","last_active":"2023-07-27T14:33:06.268366+0000","last_peered":"2023-07-27T14:33:06.268366+0000","last_clean":"2023-07-27T14:33:06.268366+0000","last_became_active":"2023-07-27T14:33:06.266304+0000","last_became_peered":"2023-07-27T14:33:06.266304+0000","last_unstale":"2023-07-27T14:33:06.268366+0000","last_undegraded":"2023-07-27T14:33:06.268366+0000","last_fullsized":"2023-07-27T14:33:06.268366+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.248928+0000","last_change":"2023-07-27T14:33:05.792942+0000","last_active":"2023-07-27T14:33:06.248928+0000","last_peered":"2023-07-27T14:33:06.248928+0000","last_clean":"2023-07-27T14:33:06.248928+0000","last_became_active":"2023-07-27T14:33:05.792674+0000","last_became_peered":"2023-07-27T14:33:05.792674+0000","last_unstale":"2023-07-27T14:33:06.248928+0000","last_undegraded":"2023-07-27T14:33:06.248928+0000","last_fullsized":"2023-07-27T14:33:06.248928+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.267327+0000","last_change":"2023-07-27T14:33:06.266506+0000","last_active":"2023-07-27T14:33:06.267327+0000","last_peered":"2023-07-27T14:33:06.267327+0000","last_clean":"2023-07-27T14:33:06.267327+0000","last_became_active":"2023-07-27T14:33:06.266201+0000","last_became_peered":"2023-07-27T14:33:06.266201+0000","last_unstale":"2023-07-27T14:33:06.267327+0000","last_undegraded":"2023-07-27T14:33:06.267327+0000","last_fullsized":"2023-07-27T14:33:06.267327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.237975+0000","last_change":"2023-07-27T14:33:05.781590+0000","last_active":"2023-07-27T14:33:06.237975+0000","last_peered":"2023-07-27T14:33:06.237975+0000","last_clean":"2023-07-27T14:33:06.237975+0000","last_became_active":"2023-07-27T14:33:05.781301+0000","last_became_peered":"2023-07-27T14:33:05.781301+0000","last_unstale":"2023-07-27T14:33:06.237975+0000","last_undegraded":"2023-07-27T14:33:06.237975+0000","last_fullsized":"2023-07-27T14:33:06.237975+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252462+0000","last_change":"2023-07-27T14:33:06.249183+0000","last_active":"2023-07-27T14:33:06.252462+0000","last_peered":"2023-07-27T14:33:06.252462+0000","last_clean":"2023-07-27T14:33:06.252462+0000","last_became_active":"2023-07-27T14:33:06.248899+0000","last_became_peered":"2023-07-27T14:33:06.248899+0000","last_unstale":"2023-07-27T14:33:06.252462+0000","last_undegraded":"2023-07-27T14:33:06.252462+0000","last_fullsized":"2023-07-27T14:33:06.252462+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244987+0000","last_change":"2023-07-27T14:33:05.797114+0000","last_active":"2023-07-27T14:33:06.244987+0000","last_peered":"2023-07-27T14:33:06.244987+0000","last_clean":"2023-07-27T14:33:06.244987+0000","last_became_active":"2023-07-27T14:33:05.794749+0000","last_became_peered":"2023-07-27T14:33:05.794749+0000","last_unstale":"2023-07-27T14:33:06.244987+0000","last_undegraded":"2023-07-27T14:33:06.244987+0000","last_fullsized":"2023-07-27T14:33:06.244987+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.255687+0000","last_change":"2023-07-27T14:33:06.253391+0000","last_active":"2023-07-27T14:33:06.255687+0000","last_peered":"2023-07-27T14:33:06.255687+0000","last_clean":"2023-07-27T14:33:06.255687+0000","last_became_active":"2023-07-27T14:33:06.252804+0000","last_became_peered":"2023-07-27T14:33:06.252804+0000","last_unstale":"2023-07-27T14:33:06.255687+0000","last_undegraded":"2023-07-27T14:33:06.255687+0000","last_fullsized":"2023-07-27T14:33:06.255687+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244233+0000","last_change":"2023-07-27T14:33:05.795070+0000","last_active":"2023-07-27T14:33:06.244233+0000","last_peered":"2023-07-27T14:33:06.244233+0000","last_clean":"2023-07-27T14:33:06.244233+0000","last_became_active":"2023-07-27T14:33:05.794703+0000","last_became_peered":"2023-07-27T14:33:05.794703+0000","last_unstale":"2023-07-27T14:33:06.244233+0000","last_undegraded":"2023-07-27T14:33:06.244233+0000","last_fullsized":"2023-07-27T14:33:06.244233+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257185+0000","last_change":"2023-07-27T14:33:06.253801+0000","last_active":"2023-07-27T14:33:06.257185+0000","last_peered":"2023-07-27T14:33:06.257185+0000","last_clean":"2023-07-27T14:33:06.257185+0000","last_became_active":"2023-07-27T14:33:06.253557+0000","last_became_peered":"2023-07-27T14:33:06.253557+0000","last_unstale":"2023-07-27T14:33:06.257185+0000","last_undegraded":"2023-07-27T14:33:06.257185+0000","last_fullsized":"2023-07-27T14:33:06.257185+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.242023+0000","last_change":"2023-07-27T14:33:05.787329+0000","last_active":"2023-07-27T14:33:06.242023+0000","last_peered":"2023-07-27T14:33:06.242023+0000","last_clean":"2023-07-27T14:33:06.242023+0000","last_became_active":"2023-07-27T14:33:05.787034+0000","last_became_peered":"2023-07-27T14:33:05.787034+0000","last_unstale":"2023-07-27T14:33:06.242023+0000","last_undegraded":"2023-07-27T14:33:06.242023+0000","last_fullsized":"2023-07-27T14:33:06.242023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261230+0000","last_change":"2023-07-27T14:33:06.256613+0000","last_active":"2023-07-27T14:33:06.261230+0000","last_peered":"2023-07-27T14:33:06.261230+0000","last_clean":"2023-07-27T14:33:06.261230+0000","last_became_active":"2023-07-27T14:33:06.255728+0000","last_became_peered":"2023-07-27T14:33:06.255728+0000","last_unstale":"2023-07-27T14:33:06.261230+0000","last_undegraded":"2023-07-27T14:33:06.261230+0000","last_fullsized":"2023-07-27T14:33:06.261230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256526+0000","last_change":"2023-07-27T14:33:05.792785+0000","last_active":"2023-07-27T14:33:06.256526+0000","last_peered":"2023-07-27T14:33:06.256526+0000","last_clean":"2023-07-27T14:33:06.256526+0000","last_became_active":"2023-07-27T14:33:05.792101+0000","last_became_peered":"2023-07-27T14:33:05.792101+0000","last_unstale":"2023-07-27T14:33:06.256526+0000","last_undegraded":"2023-07-27T14:33:06.256526+0000","last_fullsized":"2023-07-27T14:33:06.256526+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261148+0000","last_change":"2023-07-27T14:33:06.259637+0000","last_active":"2023-07-27T14:33:06.261148+0000","last_peered":"2023-07-27T14:33:06.261148+0000","last_clean":"2023-07-27T14:33:06.261148+0000","last_became_active":"2023-07-27T14:33:06.259287+0000","last_became_peered":"2023-07-27T14:33:06.259287+0000","last_unstale":"2023-07-27T14:33:06.261148+0000","last_undegraded":"2023-07-27T14:33:06.261148+0000","last_fullsized":"2023-07-27T14:33:06.261148+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261248+0000","last_change":"2023-07-27T14:33:05.787790+0000","last_active":"2023-07-27T14:33:06.261248+0000","last_peered":"2023-07-27T14:33:06.261248+0000","last_clean":"2023-07-27T14:33:06.261248+0000","last_became_active":"2023-07-27T14:33:05.787388+0000","last_became_peered":"2023-07-27T14:33:05.787388+0000","last_unstale":"2023-07-27T14:33:06.261248+0000","last_undegraded":"2023-07-27T14:33:06.261248+0000","last_fullsized":"2023-07-27T14:33:06.261248+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269905+0000","last_change":"2023-07-27T14:33:06.266247+0000","last_active":"2023-07-27T14:33:06.269905+0000","last_peered":"2023-07-27T14:33:06.269905+0000","last_clean":"2023-07-27T14:33:06.269905+0000","last_became_active":"2023-07-27T14:33:06.265826+0000","last_became_peered":"2023-07-27T14:33:06.265826+0000","last_unstale":"2023-07-27T14:33:06.269905+0000","last_undegraded":"2023-07-27T14:33:06.269905+0000","last_fullsized":"2023-07-27T14:33:06.269905+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268205+0000","last_change":"2023-07-27T14:33:05.779217+0000","last_active":"2023-07-27T14:33:06.268205+0000","last_peered":"2023-07-27T14:33:06.268205+0000","last_clean":"2023-07-27T14:33:06.268205+0000","last_became_active":"2023-07-27T14:33:05.777840+0000","last_became_peered":"2023-07-27T14:33:05.777840+0000","last_unstale":"2023-07-27T14:33:06.268205+0000","last_undegraded":"2023-07-27T14:33:06.268205+0000","last_fullsized":"2023-07-27T14:33:06.268205+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269418+0000","last_change":"2023-07-27T14:33:06.267760+0000","last_active":"2023-07-27T14:33:06.269418+0000","last_peered":"2023-07-27T14:33:06.269418+0000","last_clean":"2023-07-27T14:33:06.269418+0000","last_became_active":"2023-07-27T14:33:06.267393+0000","last_became_peered":"2023-07-27T14:33:06.267393+0000","last_unstale":"2023-07-27T14:33:06.269418+0000","last_undegraded":"2023-07-27T14:33:06.269418+0000","last_fullsized":"2023-07-27T14:33:06.269418+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.245989+0000","last_change":"2023-07-27T14:33:05.793125+0000","last_active":"2023-07-27T14:33:06.245989+0000","last_peered":"2023-07-27T14:33:06.245989+0000","last_clean":"2023-07-27T14:33:06.245989+0000","last_became_active":"2023-07-27T14:33:05.792538+0000","last_became_peered":"2023-07-27T14:33:05.792538+0000","last_unstale":"2023-07-27T14:33:06.245989+0000","last_undegraded":"2023-07-27T14:33:06.245989+0000","last_fullsized":"2023-07-27T14:33:06.245989+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265814+0000","last_change":"2023-07-27T14:33:06.261244+0000","last_active":"2023-07-27T14:33:06.265814+0000","last_peered":"2023-07-27T14:33:06.265814+0000","last_clean":"2023-07-27T14:33:06.265814+0000","last_became_active":"2023-07-27T14:33:06.260981+0000","last_became_peered":"2023-07-27T14:33:06.260981+0000","last_unstale":"2023-07-27T14:33:06.265814+0000","last_undegraded":"2023-07-27T14:33:06.265814+0000","last_fullsized":"2023-07-27T14:33:06.265814+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.245665+0000","last_change":"2023-07-27T14:33:05.788692+0000","last_active":"2023-07-27T14:33:06.245665+0000","last_peered":"2023-07-27T14:33:06.245665+0000","last_clean":"2023-07-27T14:33:06.245665+0000","last_became_active":"2023-07-27T14:33:05.788375+0000","last_became_peered":"2023-07-27T14:33:05.788375+0000","last_unstale":"2023-07-27T14:33:06.245665+0000","last_undegraded":"2023-07-27T14:33:06.245665+0000","last_fullsized":"2023-07-27T14:33:06.245665+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.260505+0000","last_change":"2023-07-27T14:33:06.255278+0000","last_active":"2023-07-27T14:33:06.260505+0000","last_peered":"2023-07-27T14:33:06.260505+0000","last_clean":"2023-07-27T14:33:06.260505+0000","last_became_active":"2023-07-27T14:33:06.254677+0000","last_became_peered":"2023-07-27T14:33:06.254677+0000","last_unstale":"2023-07-27T14:33:06.260505+0000","last_undegraded":"2023-07-27T14:33:06.260505+0000","last_fullsized":"2023-07-27T14:33:06.260505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.241004+0000","last_change":"2023-07-27T14:33:05.787768+0000","last_active":"2023-07-27T14:33:06.241004+0000","last_peered":"2023-07-27T14:33:06.241004+0000","last_clean":"2023-07-27T14:33:06.241004+0000","last_became_active":"2023-07-27T14:33:05.786195+0000","last_became_peered":"2023-07-27T14:33:05.786195+0000","last_unstale":"2023-07-27T14:33:06.241004+0000","last_undegraded":"2023-07-27T14:33:06.241004+0000","last_fullsized":"2023-07-27T14:33:06.241004+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.255663+0000","last_change":"2023-07-27T14:33:06.253186+0000","last_active":"2023-07-27T14:33:06.255663+0000","last_peered":"2023-07-27T14:33:06.255663+0000","last_clean":"2023-07-27T14:33:06.255663+0000","last_became_active":"2023-07-27T14:33:06.252775+0000","last_became_peered":"2023-07-27T14:33:06.252775+0000","last_unstale":"2023-07-27T14:33:06.255663+0000","last_undegraded":"2023-07-27T14:33:06.255663+0000","last_fullsized":"2023-07-27T14:33:06.255663+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257570+0000","last_change":"2023-07-27T14:33:05.779870+0000","last_active":"2023-07-27T14:33:06.257570+0000","last_peered":"2023-07-27T14:33:06.257570+0000","last_clean":"2023-07-27T14:33:06.257570+0000","last_became_active":"2023-07-27T14:33:05.779586+0000","last_became_peered":"2023-07-27T14:33:05.779586+0000","last_unstale":"2023-07-27T14:33:06.257570+0000","last_undegraded":"2023-07-27T14:33:06.257570+0000","last_fullsized":"2023-07-27T14:33:06.257570+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257684+0000","last_change":"2023-07-27T14:33:06.253083+0000","last_active":"2023-07-27T14:33:06.257684+0000","last_peered":"2023-07-27T14:33:06.257684+0000","last_clean":"2023-07-27T14:33:06.257684+0000","last_became_active":"2023-07-27T14:33:06.252764+0000","last_became_peered":"2023-07-27T14:33:06.252764+0000","last_unstale":"2023-07-27T14:33:06.257684+0000","last_undegraded":"2023-07-27T14:33:06.257684+0000","last_fullsized":"2023-07-27T14:33:06.257684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247653+0000","last_change":"2023-07-27T14:33:05.788674+0000","last_active":"2023-07-27T14:33:06.247653+0000","last_peered":"2023-07-27T14:33:06.247653+0000","last_clean":"2023-07-27T14:33:06.247653+0000","last_became_active":"2023-07-27T14:33:05.788385+0000","last_became_peered":"2023-07-27T14:33:05.788385+0000","last_unstale":"2023-07-27T14:33:06.247653+0000","last_undegraded":"2023-07-27T14:33:06.247653+0000","last_fullsized":"2023-07-27T14:33:06.247653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261246+0000","last_change":"2023-07-27T14:33:06.257061+0000","last_active":"2023-07-27T14:33:06.261246+0000","last_peered":"2023-07-27T14:33:06.261246+0000","last_clean":"2023-07-27T14:33:06.261246+0000","last_became_active":"2023-07-27T14:33:06.256721+0000","last_became_peered":"2023-07-27T14:33:06.256721+0000","last_unstale":"2023-07-27T14:33:06.261246+0000","last_undegraded":"2023-07-27T14:33:06.261246+0000","last_fullsized":"2023-07-27T14:33:06.261246+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256105+0000","last_change":"2023-07-27T14:33:05.781100+0000","last_active":"2023-07-27T14:33:06.256105+0000","last_peered":"2023-07-27T14:33:06.256105+0000","last_clean":"2023-07-27T14:33:06.256105+0000","last_became_active":"2023-07-27T14:33:05.780805+0000","last_became_peered":"2023-07-27T14:33:05.780805+0000","last_unstale":"2023-07-27T14:33:06.256105+0000","last_undegraded":"2023-07-27T14:33:06.256105+0000","last_fullsized":"2023-07-27T14:33:06.256105+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258763+0000","last_change":"2023-07-27T14:33:06.256270+0000","last_active":"2023-07-27T14:33:06.258763+0000","last_peered":"2023-07-27T14:33:06.258763+0000","last_clean":"2023-07-27T14:33:06.258763+0000","last_became_active":"2023-07-27T14:33:06.256007+0000","last_became_peered":"2023-07-27T14:33:06.256007+0000","last_unstale":"2023-07-27T14:33:06.258763+0000","last_undegraded":"2023-07-27T14:33:06.258763+0000","last_fullsized":"2023-07-27T14:33:06.258763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.238257+0000","last_change":"2023-07-27T14:33:05.796522+0000","last_active":"2023-07-27T14:33:06.238257+0000","last_peered":"2023-07-27T14:33:06.238257+0000","last_clean":"2023-07-27T14:33:06.238257+0000","last_became_active":"2023-07-27T14:33:05.795889+0000","last_became_peered":"2023-07-27T14:33:05.795889+0000","last_unstale":"2023-07-27T14:33:06.238257+0000","last_undegraded":"2023-07-27T14:33:06.238257+0000","last_fullsized":"2023-07-27T14:33:06.238257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261173+0000","last_change":"2023-07-27T14:33:06.259320+0000","last_active":"2023-07-27T14:33:06.261173+0000","last_peered":"2023-07-27T14:33:06.261173+0000","last_clean":"2023-07-27T14:33:06.261173+0000","last_became_active":"2023-07-27T14:33:06.259024+0000","last_became_peered":"2023-07-27T14:33:06.259024+0000","last_unstale":"2023-07-27T14:33:06.261173+0000","last_undegraded":"2023-07-27T14:33:06.261173+0000","last_fullsized":"2023-07-27T14:33:06.261173+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"113'3","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265419+0000","last_change":"2023-07-27T14:33:05.801974+0000","last_active":"2023-07-27T14:33:06.265419+0000","last_peered":"2023-07-27T14:33:06.265419+0000","last_clean":"2023-07-27T14:33:06.265419+0000","last_became_active":"2023-07-27T14:33:05.801723+0000","last_became_peered":"2023-07-27T14:33:05.801723+0000","last_unstale":"2023-07-27T14:33:06.265419+0000","last_undegraded":"2023-07-27T14:33:06.265419+0000","last_fullsized":"2023-07-27T14:33:06.265419+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258463+0000","last_change":"2023-07-27T14:33:06.254844+0000","last_active":"2023-07-27T14:33:06.258463+0000","last_peered":"2023-07-27T14:33:06.258463+0000","last_clean":"2023-07-27T14:33:06.258463+0000","last_became_active":"2023-07-27T14:33:06.254289+0000","last_became_peered":"2023-07-27T14:33:06.254289+0000","last_unstale":"2023-07-27T14:33:06.258463+0000","last_undegraded":"2023-07-27T14:33:06.258463+0000","last_fullsized":"2023-07-27T14:33:06.258463+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265056+0000","last_change":"2023-07-27T14:33:05.792824+0000","last_active":"2023-07-27T14:33:06.265056+0000","last_peered":"2023-07-27T14:33:06.265056+0000","last_clean":"2023-07-27T14:33:06.265056+0000","last_became_active":"2023-07-27T14:33:05.792523+0000","last_became_peered":"2023-07-27T14:33:05.792523+0000","last_unstale":"2023-07-27T14:33:06.265056+0000","last_undegraded":"2023-07-27T14:33:06.265056+0000","last_fullsized":"2023-07-27T14:33:06.265056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.253832+0000","last_change":"2023-07-27T14:33:06.249482+0000","last_active":"2023-07-27T14:33:06.253832+0000","last_peered":"2023-07-27T14:33:06.253832+0000","last_clean":"2023-07-27T14:33:06.253832+0000","last_became_active":"2023-07-27T14:33:06.249176+0000","last_became_peered":"2023-07-27T14:33:06.249176+0000","last_unstale":"2023-07-27T14:33:06.253832+0000","last_undegraded":"2023-07-27T14:33:06.253832+0000","last_fullsized":"2023-07-27T14:33:06.253832+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.267453+0000","last_change":"2023-07-27T14:33:05.793873+0000","last_active":"2023-07-27T14:33:06.267453+0000","last_peered":"2023-07-27T14:33:06.267453+0000","last_clean":"2023-07-27T14:33:06.267453+0000","last_became_active":"2023-07-27T14:33:05.793616+0000","last_became_peered":"2023-07-27T14:33:05.793616+0000","last_unstale":"2023-07-27T14:33:06.267453+0000","last_undegraded":"2023-07-27T14:33:06.267453+0000","last_fullsized":"2023-07-27T14:33:06.267453+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256845+0000","last_change":"2023-07-27T14:33:06.253991+0000","last_active":"2023-07-27T14:33:06.256845+0000","last_peered":"2023-07-27T14:33:06.256845+0000","last_clean":"2023-07-27T14:33:06.256845+0000","last_became_active":"2023-07-27T14:33:06.253684+0000","last_became_peered":"2023-07-27T14:33:06.253684+0000","last_unstale":"2023-07-27T14:33:06.256845+0000","last_undegraded":"2023-07-27T14:33:06.256845+0000","last_fullsized":"2023-07-27T14:33:06.256845+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247479+0000","last_change":"2023-07-27T14:33:05.789961+0000","last_active":"2023-07-27T14:33:06.247479+0000","last_peered":"2023-07-27T14:33:06.247479+0000","last_clean":"2023-07-27T14:33:06.247479+0000","last_became_active":"2023-07-27T14:33:05.788448+0000","last_became_peered":"2023-07-27T14:33:05.788448+0000","last_unstale":"2023-07-27T14:33:06.247479+0000","last_undegraded":"2023-07-27T14:33:06.247479+0000","last_fullsized":"2023-07-27T14:33:06.247479+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268816+0000","last_change":"2023-07-27T14:33:06.267581+0000","last_active":"2023-07-27T14:33:06.268816+0000","last_peered":"2023-07-27T14:33:06.268816+0000","last_clean":"2023-07-27T14:33:06.268816+0000","last_became_active":"2023-07-27T14:33:06.267296+0000","last_became_peered":"2023-07-27T14:33:06.267296+0000","last_unstale":"2023-07-27T14:33:06.268816+0000","last_undegraded":"2023-07-27T14:33:06.268816+0000","last_fullsized":"2023-07-27T14:33:06.268816+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244341+0000","last_change":"2023-07-27T14:33:05.790982+0000","last_active":"2023-07-27T14:33:06.244341+0000","last_peered":"2023-07-27T14:33:06.244341+0000","last_clean":"2023-07-27T14:33:06.244341+0000","last_became_active":"2023-07-27T14:33:05.790711+0000","last_became_peered":"2023-07-27T14:33:05.790711+0000","last_unstale":"2023-07-27T14:33:06.244341+0000","last_undegraded":"2023-07-27T14:33:06.244341+0000","last_fullsized":"2023-07-27T14:33:06.244341+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252549+0000","last_change":"2023-07-27T14:33:06.249876+0000","last_active":"2023-07-27T14:33:06.252549+0000","last_peered":"2023-07-27T14:33:06.252549+0000","last_clean":"2023-07-27T14:33:06.252549+0000","last_became_active":"2023-07-27T14:33:06.249520+0000","last_became_peered":"2023-07-27T14:33:06.249520+0000","last_unstale":"2023-07-27T14:33:06.252549+0000","last_undegraded":"2023-07-27T14:33:06.252549+0000","last_fullsized":"2023-07-27T14:33:06.252549+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'4","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269001+0000","last_change":"2023-07-27T14:33:05.777544+0000","last_active":"2023-07-27T14:33:06.269001+0000","last_peered":"2023-07-27T14:33:06.269001+0000","last_clean":"2023-07-27T14:33:06.269001+0000","last_became_active":"2023-07-27T14:33:05.777246+0000","last_became_peered":"2023-07-27T14:33:05.777246+0000","last_unstale":"2023-07-27T14:33:06.269001+0000","last_undegraded":"2023-07-27T14:33:06.269001+0000","last_fullsized":"2023-07-27T14:33:06.269001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257290+0000","last_change":"2023-07-27T14:33:06.253720+0000","last_active":"2023-07-27T14:33:06.257290+0000","last_peered":"2023-07-27T14:33:06.257290+0000","last_clean":"2023-07-27T14:33:06.257290+0000","last_became_active":"2023-07-27T14:33:06.253474+0000","last_became_peered":"2023-07-27T14:33:06.253474+0000","last_unstale":"2023-07-27T14:33:06.257290+0000","last_undegraded":"2023-07-27T14:33:06.257290+0000","last_fullsized":"2023-07-27T14:33:06.257290+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268505+0000","last_change":"2023-07-27T14:33:05.789773+0000","last_active":"2023-07-27T14:33:06.268505+0000","last_peered":"2023-07-27T14:33:06.268505+0000","last_clean":"2023-07-27T14:33:06.268505+0000","last_became_active":"2023-07-27T14:33:05.789467+0000","last_became_peered":"2023-07-27T14:33:05.789467+0000","last_unstale":"2023-07-27T14:33:06.268505+0000","last_undegraded":"2023-07-27T14:33:06.268505+0000","last_fullsized":"2023-07-27T14:33:06.268505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.270102+0000","last_change":"2023-07-27T14:33:06.267253+0000","last_active":"2023-07-27T14:33:06.270102+0000","last_peered":"2023-07-27T14:33:06.270102+0000","last_clean":"2023-07-27T14:33:06.270102+0000","last_became_active":"2023-07-27T14:33:06.266951+0000","last_became_peered":"2023-07-27T14:33:06.266951+0000","last_unstale":"2023-07-27T14:33:06.270102+0000","last_undegraded":"2023-07-27T14:33:06.270102+0000","last_fullsized":"2023-07-27T14:33:06.270102+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.238347+0000","last_change":"2023-07-27T14:33:05.796344+0000","last_active":"2023-07-27T14:33:06.238347+0000","last_peered":"2023-07-27T14:33:06.238347+0000","last_clean":"2023-07-27T14:33:06.238347+0000","last_became_active":"2023-07-27T14:33:05.795471+0000","last_became_peered":"2023-07-27T14:33:05.795471+0000","last_unstale":"2023-07-27T14:33:06.238347+0000","last_undegraded":"2023-07-27T14:33:06.238347+0000","last_fullsized":"2023-07-27T14:33:06.238347+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265684+0000","last_change":"2023-07-27T14:33:06.260737+0000","last_active":"2023-07-27T14:33:06.265684+0000","last_peered":"2023-07-27T14:33:06.265684+0000","last_clean":"2023-07-27T14:33:06.265684+0000","last_became_active":"2023-07-27T14:33:06.260484+0000","last_became_peered":"2023-07-27T14:33:06.260484+0000","last_unstale":"2023-07-27T14:33:06.265684+0000","last_undegraded":"2023-07-27T14:33:06.265684+0000","last_fullsized":"2023-07-27T14:33:06.265684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246824+0000","last_change":"2023-07-27T14:33:05.795422+0000","last_active":"2023-07-27T14:33:06.246824+0000","last_peered":"2023-07-27T14:33:06.246824+0000","last_clean":"2023-07-27T14:33:06.246824+0000","last_became_active":"2023-07-27T14:33:05.795149+0000","last_became_peered":"2023-07-27T14:33:05.795149+0000","last_unstale":"2023-07-27T14:33:06.246824+0000","last_undegraded":"2023-07-27T14:33:06.246824+0000","last_fullsized":"2023-07-27T14:33:06.246824+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.264980+0000","last_change":"2023-07-27T14:33:06.262175+0000","last_active":"2023-07-27T14:33:06.264980+0000","last_peered":"2023-07-27T14:33:06.264980+0000","last_clean":"2023-07-27T14:33:06.264980+0000","last_became_active":"2023-07-27T14:33:06.260656+0000","last_became_peered":"2023-07-27T14:33:06.260656+0000","last_unstale":"2023-07-27T14:33:06.264980+0000","last_undegraded":"2023-07-27T14:33:06.264980+0000","last_fullsized":"2023-07-27T14:33:06.264980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246079+0000","last_change":"2023-07-27T14:33:05.793330+0000","last_active":"2023-07-27T14:33:06.246079+0000","last_peered":"2023-07-27T14:33:06.246079+0000","last_clean":"2023-07-27T14:33:06.246079+0000","last_became_active":"2023-07-27T14:33:05.792874+0000","last_became_peered":"2023-07-27T14:33:05.792874+0000","last_unstale":"2023-07-27T14:33:06.246079+0000","last_undegraded":"2023-07-27T14:33:06.246079+0000","last_fullsized":"2023-07-27T14:33:06.246079+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258494+0000","last_change":"2023-07-27T14:33:06.255924+0000","last_active":"2023-07-27T14:33:06.258494+0000","last_peered":"2023-07-27T14:33:06.258494+0000","last_clean":"2023-07-27T14:33:06.258494+0000","last_became_active":"2023-07-27T14:33:06.255640+0000","last_became_peered":"2023-07-27T14:33:06.255640+0000","last_unstale":"2023-07-27T14:33:06.258494+0000","last_undegraded":"2023-07-27T14:33:06.258494+0000","last_fullsized":"2023-07-27T14:33:06.258494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.260066+0000","last_change":"2023-07-27T14:33:05.784409+0000","last_active":"2023-07-27T14:33:06.260066+0000","last_peered":"2023-07-27T14:33:06.260066+0000","last_clean":"2023-07-27T14:33:06.260066+0000","last_became_active":"2023-07-27T14:33:05.783990+0000","last_became_peered":"2023-07-27T14:33:05.783990+0000","last_unstale":"2023-07-27T14:33:06.260066+0000","last_undegraded":"2023-07-27T14:33:06.260066+0000","last_fullsized":"2023-07-27T14:33:06.260066+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261335+0000","last_change":"2023-07-27T14:33:06.259650+0000","last_active":"2023-07-27T14:33:06.261335+0000","last_peered":"2023-07-27T14:33:06.261335+0000","last_clean":"2023-07-27T14:33:06.261335+0000","last_became_active":"2023-07-27T14:33:06.259381+0000","last_became_peered":"2023-07-27T14:33:06.259381+0000","last_unstale":"2023-07-27T14:33:06.261335+0000","last_undegraded":"2023-07-27T14:33:06.261335+0000","last_fullsized":"2023-07-27T14:33:06.261335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.245170+0000","last_change":"2023-07-27T14:33:05.791855+0000","last_active":"2023-07-27T14:33:06.245170+0000","last_peered":"2023-07-27T14:33:06.245170+0000","last_clean":"2023-07-27T14:33:06.245170+0000","last_became_active":"2023-07-27T14:33:05.791607+0000","last_became_peered":"2023-07-27T14:33:05.791607+0000","last_unstale":"2023-07-27T14:33:06.245170+0000","last_undegraded":"2023-07-27T14:33:06.245170+0000","last_fullsized":"2023-07-27T14:33:06.245170+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252981+0000","last_change":"2023-07-27T14:33:06.249845+0000","last_active":"2023-07-27T14:33:06.252981+0000","last_peered":"2023-07-27T14:33:06.252981+0000","last_clean":"2023-07-27T14:33:06.252981+0000","last_became_active":"2023-07-27T14:33:06.249540+0000","last_became_peered":"2023-07-27T14:33:06.249540+0000","last_unstale":"2023-07-27T14:33:06.252981+0000","last_undegraded":"2023-07-27T14:33:06.252981+0000","last_fullsized":"2023-07-27T14:33:06.252981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246741+0000","last_change":"2023-07-27T14:33:05.796337+0000","last_active":"2023-07-27T14:33:06.246741+0000","last_peered":"2023-07-27T14:33:06.246741+0000","last_clean":"2023-07-27T14:33:06.246741+0000","last_became_active":"2023-07-27T14:33:05.796101+0000","last_became_peered":"2023-07-27T14:33:05.796101+0000","last_unstale":"2023-07-27T14:33:06.246741+0000","last_undegraded":"2023-07-27T14:33:06.246741+0000","last_fullsized":"2023-07-27T14:33:06.246741+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258511+0000","last_change":"2023-07-27T14:33:06.254897+0000","last_active":"2023-07-27T14:33:06.258511+0000","last_peered":"2023-07-27T14:33:06.258511+0000","last_clean":"2023-07-27T14:33:06.258511+0000","last_became_active":"2023-07-27T14:33:06.254587+0000","last_became_peered":"2023-07-27T14:33:06.254587+0000","last_unstale":"2023-07-27T14:33:06.258511+0000","last_undegraded":"2023-07-27T14:33:06.258511+0000","last_fullsized":"2023-07-27T14:33:06.258511+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.243924+0000","last_change":"2023-07-27T14:33:05.792802+0000","last_active":"2023-07-27T14:33:06.243924+0000","last_peered":"2023-07-27T14:33:06.243924+0000","last_clean":"2023-07-27T14:33:06.243924+0000","last_became_active":"2023-07-27T14:33:05.792506+0000","last_became_peered":"2023-07-27T14:33:05.792506+0000","last_unstale":"2023-07-27T14:33:06.243924+0000","last_undegraded":"2023-07-27T14:33:06.243924+0000","last_fullsized":"2023-07-27T14:33:06.243924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265654+0000","last_change":"2023-07-27T14:33:06.259587+0000","last_active":"2023-07-27T14:33:06.265654+0000","last_peered":"2023-07-27T14:33:06.265654+0000","last_clean":"2023-07-27T14:33:06.265654+0000","last_became_active":"2023-07-27T14:33:06.259328+0000","last_became_peered":"2023-07-27T14:33:06.259328+0000","last_unstale":"2023-07-27T14:33:06.265654+0000","last_undegraded":"2023-07-27T14:33:06.265654+0000","last_fullsized":"2023-07-27T14:33:06.265654+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246731+0000","last_change":"2023-07-27T14:33:05.795008+0000","last_active":"2023-07-27T14:33:06.246731+0000","last_peered":"2023-07-27T14:33:06.246731+0000","last_clean":"2023-07-27T14:33:06.246731+0000","last_became_active":"2023-07-27T14:33:05.794642+0000","last_became_peered":"2023-07-27T14:33:05.794642+0000","last_unstale":"2023-07-27T14:33:06.246731+0000","last_undegraded":"2023-07-27T14:33:06.246731+0000","last_fullsized":"2023-07-27T14:33:06.246731+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246158+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:33:06.246158+0000","last_peered":"2023-07-27T14:33:06.246158+0000","last_clean":"2023-07-27T14:33:06.246158+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:33:06.246158+0000","last_undegraded":"2023-07-27T14:33:06.246158+0000","last_fullsized":"2023-07-27T14:33:06.246158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258488+0000","last_change":"2023-07-27T14:33:06.254303+0000","last_active":"2023-07-27T14:33:06.258488+0000","last_peered":"2023-07-27T14:33:06.258488+0000","last_clean":"2023-07-27T14:33:06.258488+0000","last_became_active":"2023-07-27T14:33:06.254025+0000","last_became_peered":"2023-07-27T14:33:06.254025+0000","last_unstale":"2023-07-27T14:33:06.258488+0000","last_undegraded":"2023-07-27T14:33:06.258488+0000","last_fullsized":"2023-07-27T14:33:06.258488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.266641+0000","last_change":"2023-07-27T14:33:05.790664+0000","last_active":"2023-07-27T14:33:06.266641+0000","last_peered":"2023-07-27T14:33:06.266641+0000","last_clean":"2023-07-27T14:33:06.266641+0000","last_became_active":"2023-07-27T14:33:05.790301+0000","last_became_peered":"2023-07-27T14:33:05.790301+0000","last_unstale":"2023-07-27T14:33:06.266641+0000","last_undegraded":"2023-07-27T14:33:06.266641+0000","last_fullsized":"2023-07-27T14:33:06.266641+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.241437+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:33:06.241437+0000","last_peered":"2023-07-27T14:33:06.241437+0000","last_clean":"2023-07-27T14:33:06.241437+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:33:06.241437+0000","last_undegraded":"2023-07-27T14:33:06.241437+0000","last_fullsized":"2023-07-27T14:33:06.241437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258480+0000","last_change":"2023-07-27T14:33:06.255024+0000","last_active":"2023-07-27T14:33:06.258480+0000","last_peered":"2023-07-27T14:33:06.258480+0000","last_clean":"2023-07-27T14:33:06.258480+0000","last_became_active":"2023-07-27T14:33:06.254615+0000","last_became_peered":"2023-07-27T14:33:06.254615+0000","last_unstale":"2023-07-27T14:33:06.258480+0000","last_undegraded":"2023-07-27T14:33:06.258480+0000","last_fullsized":"2023-07-27T14:33:06.258480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.241566+0000","last_change":"2023-07-27T14:33:05.785324+0000","last_active":"2023-07-27T14:33:06.241566+0000","last_peered":"2023-07-27T14:33:06.241566+0000","last_clean":"2023-07-27T14:33:06.241566+0000","last_became_active":"2023-07-27T14:33:05.785056+0000","last_became_peered":"2023-07-27T14:33:05.785056+0000","last_unstale":"2023-07-27T14:33:06.241566+0000","last_undegraded":"2023-07-27T14:33:06.241566+0000","last_fullsized":"2023-07-27T14:33:06.241566+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244439+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:33:06.244439+0000","last_peered":"2023-07-27T14:33:06.244439+0000","last_clean":"2023-07-27T14:33:06.244439+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:33:06.244439+0000","last_undegraded":"2023-07-27T14:33:06.244439+0000","last_fullsized":"2023-07-27T14:33:06.244439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.250522+0000","last_change":"2023-07-27T14:33:06.249330+0000","last_active":"2023-07-27T14:33:06.250522+0000","last_peered":"2023-07-27T14:33:06.250522+0000","last_clean":"2023-07-27T14:33:06.250522+0000","last_became_active":"2023-07-27T14:33:06.248930+0000","last_became_peered":"2023-07-27T14:33:06.248930+0000","last_unstale":"2023-07-27T14:33:06.250522+0000","last_undegraded":"2023-07-27T14:33:06.250522+0000","last_fullsized":"2023-07-27T14:33:06.250522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261382+0000","last_change":"2023-07-27T14:33:05.795088+0000","last_active":"2023-07-27T14:33:06.261382+0000","last_peered":"2023-07-27T14:33:06.261382+0000","last_clean":"2023-07-27T14:33:06.261382+0000","last_became_active":"2023-07-27T14:33:05.794724+0000","last_became_peered":"2023-07-27T14:33:05.794724+0000","last_unstale":"2023-07-27T14:33:06.261382+0000","last_undegraded":"2023-07-27T14:33:06.261382+0000","last_fullsized":"2023-07-27T14:33:06.261382+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.242430+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:33:06.242430+0000","last_peered":"2023-07-27T14:33:06.242430+0000","last_clean":"2023-07-27T14:33:06.242430+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:33:06.242430+0000","last_undegraded":"2023-07-27T14:33:06.242430+0000","last_fullsized":"2023-07-27T14:33:06.242430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246269+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:33:06.246269+0000","last_peered":"2023-07-27T14:33:06.246269+0000","last_clean":"2023-07-27T14:33:06.246269+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:33:06.246269+0000","last_undegraded":"2023-07-27T14:33:06.246269+0000","last_fullsized":"2023-07-27T14:33:06.246269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256703+0000","last_change":"2023-07-27T14:33:06.253647+0000","last_active":"2023-07-27T14:33:06.256703+0000","last_peered":"2023-07-27T14:33:06.256703+0000","last_clean":"2023-07-27T14:33:06.256703+0000","last_became_active":"2023-07-27T14:33:06.253379+0000","last_became_peered":"2023-07-27T14:33:06.253379+0000","last_unstale":"2023-07-27T14:33:06.256703+0000","last_undegraded":"2023-07-27T14:33:06.256703+0000","last_fullsized":"2023-07-27T14:33:06.256703+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246357+0000","last_change":"2023-07-27T14:33:05.792407+0000","last_active":"2023-07-27T14:33:06.246357+0000","last_peered":"2023-07-27T14:33:06.246357+0000","last_clean":"2023-07-27T14:33:06.246357+0000","last_became_active":"2023-07-27T14:33:05.792129+0000","last_became_peered":"2023-07-27T14:33:05.792129+0000","last_unstale":"2023-07-27T14:33:06.246357+0000","last_undegraded":"2023-07-27T14:33:06.246357+0000","last_fullsized":"2023-07-27T14:33:06.246357+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246354+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:33:06.246354+0000","last_peered":"2023-07-27T14:33:06.246354+0000","last_clean":"2023-07-27T14:33:06.246354+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:33:06.246354+0000","last_undegraded":"2023-07-27T14:33:06.246354+0000","last_fullsized":"2023-07-27T14:33:06.246354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261357+0000","last_change":"2023-07-27T14:33:06.259819+0000","last_active":"2023-07-27T14:33:06.261357+0000","last_peered":"2023-07-27T14:33:06.261357+0000","last_clean":"2023-07-27T14:33:06.261357+0000","last_became_active":"2023-07-27T14:33:06.259057+0000","last_became_peered":"2023-07-27T14:33:06.259057+0000","last_unstale":"2023-07-27T14:33:06.261357+0000","last_undegraded":"2023-07-27T14:33:06.261357+0000","last_fullsized":"2023-07-27T14:33:06.261357+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.243839+0000","last_change":"2023-07-27T14:33:05.798376+0000","last_active":"2023-07-27T14:33:06.243839+0000","last_peered":"2023-07-27T14:33:06.243839+0000","last_clean":"2023-07-27T14:33:06.243839+0000","last_became_active":"2023-07-27T14:33:05.798058+0000","last_became_peered":"2023-07-27T14:33:05.798058+0000","last_unstale":"2023-07-27T14:33:06.243839+0000","last_undegraded":"2023-07-27T14:33:06.243839+0000","last_fullsized":"2023-07-27T14:33:06.243839+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246540+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:33:06.246540+0000","last_peered":"2023-07-27T14:33:06.246540+0000","last_clean":"2023-07-27T14:33:06.246540+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:33:06.246540+0000","last_undegraded":"2023-07-27T14:33:06.246540+0000","last_fullsized":"2023-07-27T14:33:06.246540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257143+0000","last_change":"2023-07-27T14:33:06.254307+0000","last_active":"2023-07-27T14:33:06.257143+0000","last_peered":"2023-07-27T14:33:06.257143+0000","last_clean":"2023-07-27T14:33:06.257143+0000","last_became_active":"2023-07-27T14:33:06.254050+0000","last_became_peered":"2023-07-27T14:33:06.254050+0000","last_unstale":"2023-07-27T14:33:06.257143+0000","last_undegraded":"2023-07-27T14:33:06.257143+0000","last_fullsized":"2023-07-27T14:33:06.257143+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.264776+0000","last_change":"2023-07-27T14:33:05.801651+0000","last_active":"2023-07-27T14:33:06.264776+0000","last_peered":"2023-07-27T14:33:06.264776+0000","last_clean":"2023-07-27T14:33:06.264776+0000","last_became_active":"2023-07-27T14:33:05.801272+0000","last_became_peered":"2023-07-27T14:33:05.801272+0000","last_unstale":"2023-07-27T14:33:06.264776+0000","last_undegraded":"2023-07-27T14:33:06.264776+0000","last_fullsized":"2023-07-27T14:33:06.264776+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247670+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:33:06.247670+0000","last_peered":"2023-07-27T14:33:06.247670+0000","last_clean":"2023-07-27T14:33:06.247670+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:33:06.247670+0000","last_undegraded":"2023-07-27T14:33:06.247670+0000","last_fullsized":"2023-07-27T14:33:06.247670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261205+0000","last_change":"2023-07-27T14:33:06.258152+0000","last_active":"2023-07-27T14:33:06.261205+0000","last_peered":"2023-07-27T14:33:06.261205+0000","last_clean":"2023-07-27T14:33:06.261205+0000","last_became_active":"2023-07-27T14:33:06.257879+0000","last_became_peered":"2023-07-27T14:33:06.257879+0000","last_unstale":"2023-07-27T14:33:06.261205+0000","last_undegraded":"2023-07-27T14:33:06.261205+0000","last_fullsized":"2023-07-27T14:33:06.261205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.245080+0000","last_change":"2023-07-27T14:33:05.798340+0000","last_active":"2023-07-27T14:33:06.245080+0000","last_peered":"2023-07-27T14:33:06.245080+0000","last_clean":"2023-07-27T14:33:06.245080+0000","last_became_active":"2023-07-27T14:33:05.798050+0000","last_became_peered":"2023-07-27T14:33:05.798050+0000","last_unstale":"2023-07-27T14:33:06.245080+0000","last_undegraded":"2023-07-27T14:33:06.245080+0000","last_fullsized":"2023-07-27T14:33:06.245080+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.248419+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:33:06.248419+0000","last_peered":"2023-07-27T14:33:06.248419+0000","last_clean":"2023-07-27T14:33:06.248419+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:33:06.248419+0000","last_undegraded":"2023-07-27T14:33:06.248419+0000","last_fullsized":"2023-07-27T14:33:06.248419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14688,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357152,"statfs":{"total":96636764160,"available":96621723648,"internally_reserved":0,"allocated":1400832,"data_stored":652210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.627,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.96599999999999997,"15min":1.133},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.67500000000000004},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.0589999999999999,"15min":1.1180000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.72599999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.90700000000000003,"5min":0.96999999999999997,"15min":1.1459999999999999},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.90000000000000002,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66700000000000004,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.119},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.069,"15min":1.069},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.55300000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85799999999999998,"5min":0.92800000000000005,"15min":1.165},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61499999999999999,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.746},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97899999999999998,"15min":1.0249999999999999},"last":0.626}]},{"osd":5,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86199999999999999,"5min":1.202,"15min":1.202},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.70399999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.999,"5min":1.028,"15min":1.0409999999999999},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14452,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357388,"statfs":{"total":96636764160,"available":96621965312,"internally_reserved":0,"allocated":1421312,"data_stored":659490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86399999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.746},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.45700000000000002,"5min":0.44900000000000001,"15min":0.42999999999999999},"max":{"1min":0.92900000000000005,"5min":1.2,"15min":1.2},"last":0.63},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.66300000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.496}]},{"osd":4,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.745,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.079},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.67800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.0309999999999999,"15min":1.198},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.84199999999999997,"5min":0.92200000000000004,"15min":0.94099999999999995},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.748,"15min":0.74099999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.1000000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":0.76100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17004,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94354836,"statfs":{"total":96636764160,"available":96619352064,"internally_reserved":0,"allocated":1413120,"data_stored":653670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.51400000000000001},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55100000000000005,"5min":0.65500000000000003,"15min":4.75},"last":0.442},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.66400000000000003},"min":{"1min":0.26900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64100000000000001,"5min":0.70199999999999996,"15min":9.3100000000000005},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.56000000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.55600000000000005,"5min":0.67500000000000004,"15min":3.7210000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.53500000000000003},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.59099999999999997,"5min":0.79700000000000004,"15min":2.7160000000000002},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46600000000000003,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":3.8580000000000001},"last":0.495}]},{"osd":4,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97999999999999998,"5min":1.2010000000000001,"15min":2.181},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":1.127,"15min":2.4180000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":3.7440000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1040000000000001,"15min":2.149},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69699999999999995,"15min":0.74099999999999999},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":0.85499999999999998,"5min":1.032,"15min":2.052},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69499999999999995,"15min":0.84999999999999998},"min":{"1min":0.51800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.23,"15min":6.1980000000000004},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.103,"15min":2.016},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.002,"5min":1.087,"15min":3.7799999999999998},"last":0.69999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14440,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357400,"statfs":{"total":96636764160,"available":96621977600,"internally_reserved":0,"allocated":1409024,"data_stored":652854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.52300000000000002,"5min":0.58299999999999996,"15min":0.79500000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.24399999999999999},"max":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.37}]},{"osd":2,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.42599999999999999},"min":{"1min":0.32000000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.41599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55400000000000005,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.085,"5min":1.28,"15min":1.28},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95199999999999996,"5min":1.25,"15min":1.25},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.54100000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90700000000000003,"5min":1.22,"15min":1.22},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":0.93799999999999994,"5min":1.244,"15min":1.244},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55800000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0029999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.71099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18032,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353808,"statfs":{"total":96636764160,"available":96618299392,"internally_reserved":0,"allocated":1417216,"data_stored":658928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60099999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.601,"5min":5.601,"15min":5.601},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45400000000000001,"15min":0.48199999999999998},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70799999999999996,"5min":0.81100000000000005,"15min":0.83499999999999996},"last":0.434},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.53700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.05,"5min":0.76400000000000001,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":6.9660000000000002,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.97099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.75700000000000001,"15min":0.77800000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.1360000000000001,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":1.016}]},{"osd":7,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.131},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.087}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15144,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356696,"statfs":{"total":96636764160,"available":96621256704,"internally_reserved":0,"allocated":1409024,"data_stored":658824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39300000000000002},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.52100000000000002,"5min":1.302,"15min":1.302},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.45000000000000001},"min":{"1min":0.32700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59299999999999997,"5min":0.748,"15min":0.88900000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.47399999999999998,"15min":0.44500000000000001},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2749999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.438}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.149},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.54300000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.111,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.51000000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91200000000000003,"5min":1.232,"15min":1.232},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1639999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.45200000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.298},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":1.0209999999999999,"5min":1.343,"15min":1.343},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.78100000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78600000000000003,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.49299999999999999},"max":{"1min":1.1020000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14180,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":12800,"kb_avail":94357660,"statfs":{"total":96636764160,"available":96622243840,"internally_reserved":0,"allocated":1404928,"data_stored":653034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13107200},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.52500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85599999999999998,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.627},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79000000000000004,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.495,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81399999999999995,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.753},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":4.476,"15min":4.476},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88900000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.497,"15min":0.49199999999999999},"max":{"1min":0.93000000000000005,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66600000000000004,"15min":0.621},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.66200000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0029999999999999,"5min":5.194,"15min":5.194},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94799999999999995,"5min":2.819,"15min":2.819},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0389999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.84299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15852,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":14464,"kb_avail":94355988,"statfs":{"total":96636764160,"available":96620531712,"internally_reserved":0,"allocated":1413120,"data_stored":659378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14811136},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86199999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72299999999999998,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.754},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.68500000000000005},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.91900000000000004,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":1.581,"15min":1.581},"last":0.623},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69999999999999996,"15min":0.66200000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98899999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":0.93100000000000005,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96099999999999997,"5min":1.978,"15min":1.978},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67700000000000005,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.88800000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85399999999999998,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92300000000000004,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:33:10.547 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:33:10.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.725+0000 7fd7085ff700 1 Processor -- start 2023-07-27T14:33:10.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.726+0000 7fd7085ff700 1 -- start start 2023-07-27T14:33:10.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.727+0000 7fd7085ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd7000a4840 0x7fd7000a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.727+0000 7fd7085ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000639d0 con 0x7fd7000bc050 2023-07-27T14:33:10.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.727+0000 7fd7085ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000a51b0 con 0x7fd700151bd0 2023-07-27T14:33:10.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.727+0000 7fd7085ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd700137610 con 0x7fd7000a4840 2023-07-27T14:33:10.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.727+0000 7fd705b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd7000a4840 0x7fd7000a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.727+0000 7fd706b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd7000bc050 0x7fd7000bc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37154/0 (socket says 172.21.15.115:37154) 2023-07-27T14:33:10.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.727+0000 7fd706b9c700 1 -- 172.21.15.115:0/3008138956 learned_addr learned my addr 172.21.15.115:0/3008138956 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:10.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.727+0000 7fd705399700 1 -- 172.21.15.115:0/3008138956 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561509039 0 0) 0x7fd7000639d0 con 0x7fd7000bc050 2023-07-27T14:33:10.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd705399700 1 -- 172.21.15.115:0/3008138956 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ec0033f0 con 0x7fd7000bc050 2023-07-27T14:33:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd705b9a700 1 -- 172.21.15.115:0/3008138956 >> v1:172.21.15.159:6789/0 conn(0x7fd700151bd0 legacy=0x7fd700062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd705b9a700 1 -- 172.21.15.115:0/3008138956 >> v1:172.21.15.115:6789/0 conn(0x7fd7000bc050 legacy=0x7fd7000bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd705b9a700 1 -- 172.21.15.115:0/3008138956 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700062dc0 con 0x7fd7000a4840 2023-07-27T14:33:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd705b9a700 1 --2- 172.21.15.115:0/3008138956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000a4840 0x7fd7000a4cc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fd6f0009760 tx=0x7fd6f0009060).ready entity=mon.0 client_cookie=8fa4af9e4b7b3e34 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd705399700 1 -- 172.21.15.115:0/3008138956 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000f510 con 0x7fd7000a4840 2023-07-27T14:33:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd705399700 1 -- 172.21.15.115:0/3008138956 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f000f670 con 0x7fd7000a4840 2023-07-27T14:33:10.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd705399700 1 -- 172.21.15.115:0/3008138956 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000f9f0 con 0x7fd7000a4840 2023-07-27T14:33:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd7085ff700 1 -- 172.21.15.115:0/3008138956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000a4840 msgr2=0x7fd7000a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.728+0000 7fd7085ff700 1 --2- 172.21.15.115:0/3008138956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000a4840 0x7fd7000a4cc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fd6f0009760 tx=0x7fd6f0009060).stop 2023-07-27T14:33:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.729+0000 7fd7085ff700 1 -- 172.21.15.115:0/3008138956 shutdown_connections 2023-07-27T14:33:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.729+0000 7fd7085ff700 1 --2- 172.21.15.115:0/3008138956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000a4840 0x7fd7000a4cc0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.729+0000 7fd7085ff700 1 -- 172.21.15.115:0/3008138956 >> 172.21.15.115:0/3008138956 conn(0x7fd700064700 msgr2=0x7fd700064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.729+0000 7fd7085ff700 1 -- 172.21.15.115:0/3008138956 shutdown_connections 2023-07-27T14:33:10.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.729+0000 7fd7085ff700 1 -- 172.21.15.115:0/3008138956 wait complete. 2023-07-27T14:33:10.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.730+0000 7fd7085ff700 1 Processor -- start 2023-07-27T14:33:10.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.730+0000 7fd7085ff700 1 -- start start 2023-07-27T14:33:10.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.731+0000 7fd7085ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7000a4840 0x7fd700154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.731+0000 7fd7085ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000bc050 0x7fd700139740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.731+0000 7fd7085ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd700151bd0 0x7fd700159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.731+0000 7fd7085ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000a7c90 con 0x7fd7000bc050 2023-07-27T14:33:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.731+0000 7fd7085ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000a7080 con 0x7fd7000a4840 2023-07-27T14:33:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.731+0000 7fd7085ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000a7360 con 0x7fd700151bd0 2023-07-27T14:33:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.731+0000 7fd705b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000bc050 0x7fd700139740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd705b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000bc050 0x7fd700139740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54656/0 (socket says 172.21.15.115:54656) 2023-07-27T14:33:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd705b9a700 1 -- 172.21.15.115:0/3177432387 learned_addr learned my addr 172.21.15.115:0/3177432387 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd70639b700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7000a4840 0x7fd700154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd706b9c700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd700151bd0 0x7fd700159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd705b9a700 1 -- 172.21.15.115:0/3177432387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd700151bd0 msgr2=0x7fd700159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd705b9a700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd700151bd0 0x7fd700159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd705b9a700 1 -- 172.21.15.115:0/3177432387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7000a4840 msgr2=0x7fd700154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd705b9a700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7000a4840 0x7fd700154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd705b9a700 1 -- 172.21.15.115:0/3177432387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00092a0 con 0x7fd7000bc050 2023-07-27T14:33:10.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd705b9a700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000bc050 0x7fd700139740 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fd6f0009e00 tx=0x7fd6f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:10.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd6f67fc700 1 -- 172.21.15.115:0/3177432387 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000f7e0 con 0x7fd7000bc050 2023-07-27T14:33:10.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd6f67fc700 1 -- 172.21.15.115:0/3177432387 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f000f940 con 0x7fd7000bc050 2023-07-27T14:33:10.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd6f67fc700 1 -- 172.21.15.115:0/3177432387 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f001b690 con 0x7fd7000bc050 2023-07-27T14:33:10.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7000a7640 con 0x7fd7000bc050 2023-07-27T14:33:10.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.732+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd700154a60 con 0x7fd7000bc050 2023-07-27T14:33:10.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.733+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70006c470 con 0x7fd7000bc050 2023-07-27T14:33:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.734+0000 7fd6f67fc700 1 -- 172.21.15.115:0/3177432387 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fd6f000f070 con 0x7fd7000bc050 2023-07-27T14:33:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.735+0000 7fd6f67fc700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405f4e0 0x7fd6e40619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.735+0000 7fd6f67fc700 1 -- 172.21.15.115:0/3177432387 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd6f007be50 con 0x7fd7000bc050 2023-07-27T14:33:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.736+0000 7fd70639b700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405f4e0 0x7fd6e40619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.736+0000 7fd70639b700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405f4e0 0x7fd6e40619a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fd6fc0036d0 tx=0x7fd6fc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:10.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.740+0000 7fd6f67fc700 1 -- 172.21.15.115:0/3177432387 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd6f004cbd0 con 0x7fd7000bc050 2023-07-27T14:33:10.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.905+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd70005ea50 con 0x7fd6e405f4e0 2023-07-27T14:33:10.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.916+0000 7fd6f67fc700 1 -- 172.21.15.115:0/3177432387 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361473 (secure 0 0 0) 0x7fd70005ea50 con 0x7fd6e405f4e0 2023-07-27T14:33:10.957 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405f4e0 msgr2=0x7fd6e40619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405f4e0 0x7fd6e40619a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fd6fc0036d0 tx=0x7fd6fc009040).stop 2023-07-27T14:33:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000bc050 msgr2=0x7fd700139740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000bc050 0x7fd700139740 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fd6f0009e00 tx=0x7fd6f0017000).stop 2023-07-27T14:33:10.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 shutdown_connections 2023-07-27T14:33:10.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6e405f4e0 0x7fd6e40619a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd700151bd0 0x7fd700159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7000a4840 0x7fd700154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 --2- 172.21.15.115:0/3177432387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7000bc050 0x7fd700139740 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:10.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.920+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 >> 172.21.15.115:0/3177432387 conn(0x7fd700064700 msgr2=0x7fd7000bd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:10.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.921+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 shutdown_connections 2023-07-27T14:33:10.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:10.921+0000 7fd7085ff700 1 -- 172.21.15.115:0/3177432387 wait complete. 2023-07-27T14:33:10.961 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:33:10.975 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2023-07-27T14:33:09.520743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":123792,"kb_used_data":11024,"kb_used_omap":0,"kb_used_meta":112704,"kb_avail":754850928,"statfs":{"total":773094113280,"available":772967350272,"internally_reserved":0,"allocated":11288576,"data_stored":5248388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":115408896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2351732,"num_objects":-30,"num_object_clones":-1,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":-1,"num_read":-11,"num_read_kb":-1034,"num_write":-131,"num_write_kb":-2350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.048875"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268070+0000","last_change":"2023-07-27T14:33:06.266797+0000","last_active":"2023-07-27T14:33:06.268070+0000","last_peered":"2023-07-27T14:33:06.268070+0000","last_clean":"2023-07-27T14:33:06.268070+0000","last_became_active":"2023-07-27T14:33:06.266536+0000","last_became_peered":"2023-07-27T14:33:06.266536+0000","last_unstale":"2023-07-27T14:33:06.268070+0000","last_undegraded":"2023-07-27T14:33:06.268070+0000","last_fullsized":"2023-07-27T14:33:06.268070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"113'3","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269986+0000","last_change":"2023-07-27T14:33:05.786176+0000","last_active":"2023-07-27T14:33:06.269986+0000","last_peered":"2023-07-27T14:33:06.269986+0000","last_clean":"2023-07-27T14:33:06.269986+0000","last_became_active":"2023-07-27T14:33:05.785809+0000","last_became_peered":"2023-07-27T14:33:05.785809+0000","last_unstale":"2023-07-27T14:33:06.269986+0000","last_undegraded":"2023-07-27T14:33:06.269986+0000","last_fullsized":"2023-07-27T14:33:06.269986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257020+0000","last_change":"2023-07-27T14:33:06.254403+0000","last_active":"2023-07-27T14:33:06.257020+0000","last_peered":"2023-07-27T14:33:06.257020+0000","last_clean":"2023-07-27T14:33:06.257020+0000","last_became_active":"2023-07-27T14:33:06.254028+0000","last_became_peered":"2023-07-27T14:33:06.254028+0000","last_unstale":"2023-07-27T14:33:06.257020+0000","last_undegraded":"2023-07-27T14:33:06.257020+0000","last_fullsized":"2023-07-27T14:33:06.257020+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.238034+0000","last_change":"2023-07-27T14:33:05.796171+0000","last_active":"2023-07-27T14:33:06.238034+0000","last_peered":"2023-07-27T14:33:06.238034+0000","last_clean":"2023-07-27T14:33:06.238034+0000","last_became_active":"2023-07-27T14:33:05.795128+0000","last_became_peered":"2023-07-27T14:33:05.795128+0000","last_unstale":"2023-07-27T14:33:06.238034+0000","last_undegraded":"2023-07-27T14:33:06.238034+0000","last_fullsized":"2023-07-27T14:33:06.238034+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269925+0000","last_change":"2023-07-27T14:33:06.266761+0000","last_active":"2023-07-27T14:33:06.269925+0000","last_peered":"2023-07-27T14:33:06.269925+0000","last_clean":"2023-07-27T14:33:06.269925+0000","last_became_active":"2023-07-27T14:33:06.266445+0000","last_became_peered":"2023-07-27T14:33:06.266445+0000","last_unstale":"2023-07-27T14:33:06.269925+0000","last_undegraded":"2023-07-27T14:33:06.269925+0000","last_fullsized":"2023-07-27T14:33:06.269925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246809+0000","last_change":"2023-07-27T14:33:05.785528+0000","last_active":"2023-07-27T14:33:06.246809+0000","last_peered":"2023-07-27T14:33:06.246809+0000","last_clean":"2023-07-27T14:33:06.246809+0000","last_became_active":"2023-07-27T14:33:05.785271+0000","last_became_peered":"2023-07-27T14:33:05.785271+0000","last_unstale":"2023-07-27T14:33:06.246809+0000","last_undegraded":"2023-07-27T14:33:06.246809+0000","last_fullsized":"2023-07-27T14:33:06.246809+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258518+0000","last_change":"2023-07-27T14:33:06.254861+0000","last_active":"2023-07-27T14:33:06.258518+0000","last_peered":"2023-07-27T14:33:06.258518+0000","last_clean":"2023-07-27T14:33:06.258518+0000","last_became_active":"2023-07-27T14:33:06.254608+0000","last_became_peered":"2023-07-27T14:33:06.254608+0000","last_unstale":"2023-07-27T14:33:06.258518+0000","last_undegraded":"2023-07-27T14:33:06.258518+0000","last_fullsized":"2023-07-27T14:33:06.258518+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.263501+0000","last_change":"2023-07-27T14:33:05.790605+0000","last_active":"2023-07-27T14:33:06.263501+0000","last_peered":"2023-07-27T14:33:06.263501+0000","last_clean":"2023-07-27T14:33:06.263501+0000","last_became_active":"2023-07-27T14:33:05.790316+0000","last_became_peered":"2023-07-27T14:33:05.790316+0000","last_unstale":"2023-07-27T14:33:06.263501+0000","last_undegraded":"2023-07-27T14:33:06.263501+0000","last_fullsized":"2023-07-27T14:33:06.263501+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256757+0000","last_change":"2023-07-27T14:33:06.252141+0000","last_active":"2023-07-27T14:33:06.256757+0000","last_peered":"2023-07-27T14:33:06.256757+0000","last_clean":"2023-07-27T14:33:06.256757+0000","last_became_active":"2023-07-27T14:33:06.251859+0000","last_became_peered":"2023-07-27T14:33:06.251859+0000","last_unstale":"2023-07-27T14:33:06.256757+0000","last_undegraded":"2023-07-27T14:33:06.256757+0000","last_fullsized":"2023-07-27T14:33:06.256757+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.266064+0000","last_change":"2023-07-27T14:33:05.795397+0000","last_active":"2023-07-27T14:33:06.266064+0000","last_peered":"2023-07-27T14:33:06.266064+0000","last_clean":"2023-07-27T14:33:06.266064+0000","last_became_active":"2023-07-27T14:33:05.795081+0000","last_became_peered":"2023-07-27T14:33:05.795081+0000","last_unstale":"2023-07-27T14:33:06.266064+0000","last_undegraded":"2023-07-27T14:33:06.266064+0000","last_fullsized":"2023-07-27T14:33:06.266064+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257014+0000","last_change":"2023-07-27T14:33:06.252188+0000","last_active":"2023-07-27T14:33:06.257014+0000","last_peered":"2023-07-27T14:33:06.257014+0000","last_clean":"2023-07-27T14:33:06.257014+0000","last_became_active":"2023-07-27T14:33:06.251895+0000","last_became_peered":"2023-07-27T14:33:06.251895+0000","last_unstale":"2023-07-27T14:33:06.257014+0000","last_undegraded":"2023-07-27T14:33:06.257014+0000","last_fullsized":"2023-07-27T14:33:06.257014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265640+0000","last_change":"2023-07-27T14:33:05.787322+0000","last_active":"2023-07-27T14:33:06.265640+0000","last_peered":"2023-07-27T14:33:06.265640+0000","last_clean":"2023-07-27T14:33:06.265640+0000","last_became_active":"2023-07-27T14:33:05.787045+0000","last_became_peered":"2023-07-27T14:33:05.787045+0000","last_unstale":"2023-07-27T14:33:06.265640+0000","last_undegraded":"2023-07-27T14:33:06.265640+0000","last_fullsized":"2023-07-27T14:33:06.265640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269939+0000","last_change":"2023-07-27T14:33:06.266851+0000","last_active":"2023-07-27T14:33:06.269939+0000","last_peered":"2023-07-27T14:33:06.269939+0000","last_clean":"2023-07-27T14:33:06.269939+0000","last_became_active":"2023-07-27T14:33:06.266503+0000","last_became_peered":"2023-07-27T14:33:06.266503+0000","last_unstale":"2023-07-27T14:33:06.269939+0000","last_undegraded":"2023-07-27T14:33:06.269939+0000","last_fullsized":"2023-07-27T14:33:06.269939+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244517+0000","last_change":"2023-07-27T14:33:05.787155+0000","last_active":"2023-07-27T14:33:06.244517+0000","last_peered":"2023-07-27T14:33:06.244517+0000","last_clean":"2023-07-27T14:33:06.244517+0000","last_became_active":"2023-07-27T14:33:05.786876+0000","last_became_peered":"2023-07-27T14:33:05.786876+0000","last_unstale":"2023-07-27T14:33:06.244517+0000","last_undegraded":"2023-07-27T14:33:06.244517+0000","last_fullsized":"2023-07-27T14:33:06.244517+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269851+0000","last_change":"2023-07-27T14:33:06.266087+0000","last_active":"2023-07-27T14:33:06.269851+0000","last_peered":"2023-07-27T14:33:06.269851+0000","last_clean":"2023-07-27T14:33:06.269851+0000","last_became_active":"2023-07-27T14:33:06.265553+0000","last_became_peered":"2023-07-27T14:33:06.265553+0000","last_unstale":"2023-07-27T14:33:06.269851+0000","last_undegraded":"2023-07-27T14:33:06.269851+0000","last_fullsized":"2023-07-27T14:33:06.269851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.237732+0000","last_change":"2023-07-27T14:33:05.786072+0000","last_active":"2023-07-27T14:33:06.237732+0000","last_peered":"2023-07-27T14:33:06.237732+0000","last_clean":"2023-07-27T14:33:06.237732+0000","last_became_active":"2023-07-27T14:33:05.785778+0000","last_became_peered":"2023-07-27T14:33:05.785778+0000","last_unstale":"2023-07-27T14:33:06.237732+0000","last_undegraded":"2023-07-27T14:33:06.237732+0000","last_fullsized":"2023-07-27T14:33:06.237732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258706+0000","last_change":"2023-07-27T14:33:06.257044+0000","last_active":"2023-07-27T14:33:06.258706+0000","last_peered":"2023-07-27T14:33:06.258706+0000","last_clean":"2023-07-27T14:33:06.258706+0000","last_became_active":"2023-07-27T14:33:06.256782+0000","last_became_peered":"2023-07-27T14:33:06.256782+0000","last_unstale":"2023-07-27T14:33:06.258706+0000","last_undegraded":"2023-07-27T14:33:06.258706+0000","last_fullsized":"2023-07-27T14:33:06.258706+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.255990+0000","last_change":"2023-07-27T14:33:05.794363+0000","last_active":"2023-07-27T14:33:06.255990+0000","last_peered":"2023-07-27T14:33:06.255990+0000","last_clean":"2023-07-27T14:33:06.255990+0000","last_became_active":"2023-07-27T14:33:05.794055+0000","last_became_peered":"2023-07-27T14:33:05.794055+0000","last_unstale":"2023-07-27T14:33:06.255990+0000","last_undegraded":"2023-07-27T14:33:06.255990+0000","last_fullsized":"2023-07-27T14:33:06.255990+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252572+0000","last_change":"2023-07-27T14:33:06.250740+0000","last_active":"2023-07-27T14:33:06.252572+0000","last_peered":"2023-07-27T14:33:06.252572+0000","last_clean":"2023-07-27T14:33:06.252572+0000","last_became_active":"2023-07-27T14:33:06.250323+0000","last_became_peered":"2023-07-27T14:33:06.250323+0000","last_unstale":"2023-07-27T14:33:06.252572+0000","last_undegraded":"2023-07-27T14:33:06.252572+0000","last_fullsized":"2023-07-27T14:33:06.252572+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247177+0000","last_change":"2023-07-27T14:33:05.791286+0000","last_active":"2023-07-27T14:33:06.247177+0000","last_peered":"2023-07-27T14:33:06.247177+0000","last_clean":"2023-07-27T14:33:06.247177+0000","last_became_active":"2023-07-27T14:33:05.790998+0000","last_became_peered":"2023-07-27T14:33:05.790998+0000","last_unstale":"2023-07-27T14:33:06.247177+0000","last_undegraded":"2023-07-27T14:33:06.247177+0000","last_fullsized":"2023-07-27T14:33:06.247177+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257462+0000","last_change":"2023-07-27T14:33:06.253120+0000","last_active":"2023-07-27T14:33:06.257462+0000","last_peered":"2023-07-27T14:33:06.257462+0000","last_clean":"2023-07-27T14:33:06.257462+0000","last_became_active":"2023-07-27T14:33:06.252721+0000","last_became_peered":"2023-07-27T14:33:06.252721+0000","last_unstale":"2023-07-27T14:33:06.257462+0000","last_undegraded":"2023-07-27T14:33:06.257462+0000","last_fullsized":"2023-07-27T14:33:06.257462+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246459+0000","last_change":"2023-07-27T14:33:05.792950+0000","last_active":"2023-07-27T14:33:06.246459+0000","last_peered":"2023-07-27T14:33:06.246459+0000","last_clean":"2023-07-27T14:33:06.246459+0000","last_became_active":"2023-07-27T14:33:05.792527+0000","last_became_peered":"2023-07-27T14:33:05.792527+0000","last_unstale":"2023-07-27T14:33:06.246459+0000","last_undegraded":"2023-07-27T14:33:06.246459+0000","last_fullsized":"2023-07-27T14:33:06.246459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258534+0000","last_change":"2023-07-27T14:33:06.256099+0000","last_active":"2023-07-27T14:33:06.258534+0000","last_peered":"2023-07-27T14:33:06.258534+0000","last_clean":"2023-07-27T14:33:06.258534+0000","last_became_active":"2023-07-27T14:33:06.255500+0000","last_became_peered":"2023-07-27T14:33:06.255500+0000","last_unstale":"2023-07-27T14:33:06.258534+0000","last_undegraded":"2023-07-27T14:33:06.258534+0000","last_fullsized":"2023-07-27T14:33:06.258534+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"113'4","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.271872+0000","last_change":"2023-07-27T14:33:05.778934+0000","last_active":"2023-07-27T14:33:06.271872+0000","last_peered":"2023-07-27T14:33:06.271872+0000","last_clean":"2023-07-27T14:33:06.271872+0000","last_became_active":"2023-07-27T14:33:05.777799+0000","last_became_peered":"2023-07-27T14:33:05.777799+0000","last_unstale":"2023-07-27T14:33:06.271872+0000","last_undegraded":"2023-07-27T14:33:06.271872+0000","last_fullsized":"2023-07-27T14:33:06.271872+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.270978+0000","last_change":"2023-07-27T14:33:06.269633+0000","last_active":"2023-07-27T14:33:06.270978+0000","last_peered":"2023-07-27T14:33:06.270978+0000","last_clean":"2023-07-27T14:33:06.270978+0000","last_became_active":"2023-07-27T14:33:06.269297+0000","last_became_peered":"2023-07-27T14:33:06.269297+0000","last_unstale":"2023-07-27T14:33:06.270978+0000","last_undegraded":"2023-07-27T14:33:06.270978+0000","last_fullsized":"2023-07-27T14:33:06.270978+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262512+0000","last_change":"2023-07-27T14:33:05.793768+0000","last_active":"2023-07-27T14:33:06.262512+0000","last_peered":"2023-07-27T14:33:06.262512+0000","last_clean":"2023-07-27T14:33:06.262512+0000","last_became_active":"2023-07-27T14:33:05.793457+0000","last_became_peered":"2023-07-27T14:33:05.793457+0000","last_unstale":"2023-07-27T14:33:06.262512+0000","last_undegraded":"2023-07-27T14:33:06.262512+0000","last_fullsized":"2023-07-27T14:33:06.262512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.260524+0000","last_change":"2023-07-27T14:33:06.255436+0000","last_active":"2023-07-27T14:33:06.260524+0000","last_peered":"2023-07-27T14:33:06.260524+0000","last_clean":"2023-07-27T14:33:06.260524+0000","last_became_active":"2023-07-27T14:33:06.254991+0000","last_became_peered":"2023-07-27T14:33:06.254991+0000","last_unstale":"2023-07-27T14:33:06.260524+0000","last_undegraded":"2023-07-27T14:33:06.260524+0000","last_fullsized":"2023-07-27T14:33:06.260524+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244897+0000","last_change":"2023-07-27T14:33:05.791347+0000","last_active":"2023-07-27T14:33:06.244897+0000","last_peered":"2023-07-27T14:33:06.244897+0000","last_clean":"2023-07-27T14:33:06.244897+0000","last_became_active":"2023-07-27T14:33:05.791052+0000","last_became_peered":"2023-07-27T14:33:05.791052+0000","last_unstale":"2023-07-27T14:33:06.244897+0000","last_undegraded":"2023-07-27T14:33:06.244897+0000","last_fullsized":"2023-07-27T14:33:06.244897+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265552+0000","last_change":"2023-07-27T14:33:06.259433+0000","last_active":"2023-07-27T14:33:06.265552+0000","last_peered":"2023-07-27T14:33:06.265552+0000","last_clean":"2023-07-27T14:33:06.265552+0000","last_became_active":"2023-07-27T14:33:06.259110+0000","last_became_peered":"2023-07-27T14:33:06.259110+0000","last_unstale":"2023-07-27T14:33:06.265552+0000","last_undegraded":"2023-07-27T14:33:06.265552+0000","last_fullsized":"2023-07-27T14:33:06.265552+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244118+0000","last_change":"2023-07-27T14:33:05.799466+0000","last_active":"2023-07-27T14:33:06.244118+0000","last_peered":"2023-07-27T14:33:06.244118+0000","last_clean":"2023-07-27T14:33:06.244118+0000","last_became_active":"2023-07-27T14:33:05.799255+0000","last_became_peered":"2023-07-27T14:33:05.799255+0000","last_unstale":"2023-07-27T14:33:06.244118+0000","last_undegraded":"2023-07-27T14:33:06.244118+0000","last_fullsized":"2023-07-27T14:33:06.244118+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252531+0000","last_change":"2023-07-27T14:33:06.249187+0000","last_active":"2023-07-27T14:33:06.252531+0000","last_peered":"2023-07-27T14:33:06.252531+0000","last_clean":"2023-07-27T14:33:06.252531+0000","last_became_active":"2023-07-27T14:33:06.248936+0000","last_became_peered":"2023-07-27T14:33:06.248936+0000","last_unstale":"2023-07-27T14:33:06.252531+0000","last_undegraded":"2023-07-27T14:33:06.252531+0000","last_fullsized":"2023-07-27T14:33:06.252531+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"113'4","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.266114+0000","last_change":"2023-07-27T14:33:05.802317+0000","last_active":"2023-07-27T14:33:06.266114+0000","last_peered":"2023-07-27T14:33:06.266114+0000","last_clean":"2023-07-27T14:33:06.266114+0000","last_became_active":"2023-07-27T14:33:05.801875+0000","last_became_peered":"2023-07-27T14:33:05.801875+0000","last_unstale":"2023-07-27T14:33:06.266114+0000","last_undegraded":"2023-07-27T14:33:06.266114+0000","last_fullsized":"2023-07-27T14:33:06.266114+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.255888+0000","last_change":"2023-07-27T14:33:06.251057+0000","last_active":"2023-07-27T14:33:06.255888+0000","last_peered":"2023-07-27T14:33:06.255888+0000","last_clean":"2023-07-27T14:33:06.255888+0000","last_became_active":"2023-07-27T14:33:06.250778+0000","last_became_peered":"2023-07-27T14:33:06.250778+0000","last_unstale":"2023-07-27T14:33:06.255888+0000","last_undegraded":"2023-07-27T14:33:06.255888+0000","last_fullsized":"2023-07-27T14:33:06.255888+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.239262+0000","last_change":"2023-07-27T14:33:05.794268+0000","last_active":"2023-07-27T14:33:06.239262+0000","last_peered":"2023-07-27T14:33:06.239262+0000","last_clean":"2023-07-27T14:33:06.239262+0000","last_became_active":"2023-07-27T14:33:05.793903+0000","last_became_peered":"2023-07-27T14:33:05.793903+0000","last_unstale":"2023-07-27T14:33:06.239262+0000","last_undegraded":"2023-07-27T14:33:06.239262+0000","last_fullsized":"2023-07-27T14:33:06.239262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258676+0000","last_change":"2023-07-27T14:33:06.252056+0000","last_active":"2023-07-27T14:33:06.258676+0000","last_peered":"2023-07-27T14:33:06.258676+0000","last_clean":"2023-07-27T14:33:06.258676+0000","last_became_active":"2023-07-27T14:33:06.251780+0000","last_became_peered":"2023-07-27T14:33:06.251780+0000","last_unstale":"2023-07-27T14:33:06.258676+0000","last_undegraded":"2023-07-27T14:33:06.258676+0000","last_fullsized":"2023-07-27T14:33:06.258676+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244944+0000","last_change":"2023-07-27T14:33:05.792003+0000","last_active":"2023-07-27T14:33:06.244944+0000","last_peered":"2023-07-27T14:33:06.244944+0000","last_clean":"2023-07-27T14:33:06.244944+0000","last_became_active":"2023-07-27T14:33:05.791747+0000","last_became_peered":"2023-07-27T14:33:05.791747+0000","last_unstale":"2023-07-27T14:33:06.244944+0000","last_undegraded":"2023-07-27T14:33:06.244944+0000","last_fullsized":"2023-07-27T14:33:06.244944+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262292+0000","last_change":"2023-07-27T14:33:06.258561+0000","last_active":"2023-07-27T14:33:06.262292+0000","last_peered":"2023-07-27T14:33:06.262292+0000","last_clean":"2023-07-27T14:33:06.262292+0000","last_became_active":"2023-07-27T14:33:06.258262+0000","last_became_peered":"2023-07-27T14:33:06.258262+0000","last_unstale":"2023-07-27T14:33:06.262292+0000","last_undegraded":"2023-07-27T14:33:06.262292+0000","last_fullsized":"2023-07-27T14:33:06.262292+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261841+0000","last_change":"2023-07-27T14:33:05.794105+0000","last_active":"2023-07-27T14:33:06.261841+0000","last_peered":"2023-07-27T14:33:06.261841+0000","last_clean":"2023-07-27T14:33:06.261841+0000","last_became_active":"2023-07-27T14:33:05.793805+0000","last_became_peered":"2023-07-27T14:33:05.793805+0000","last_unstale":"2023-07-27T14:33:06.261841+0000","last_undegraded":"2023-07-27T14:33:06.261841+0000","last_fullsized":"2023-07-27T14:33:06.261841+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265635+0000","last_change":"2023-07-27T14:33:06.260116+0000","last_active":"2023-07-27T14:33:06.265635+0000","last_peered":"2023-07-27T14:33:06.265635+0000","last_clean":"2023-07-27T14:33:06.265635+0000","last_became_active":"2023-07-27T14:33:06.259859+0000","last_became_peered":"2023-07-27T14:33:06.259859+0000","last_unstale":"2023-07-27T14:33:06.265635+0000","last_undegraded":"2023-07-27T14:33:06.265635+0000","last_fullsized":"2023-07-27T14:33:06.265635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262515+0000","last_change":"2023-07-27T14:33:05.794454+0000","last_active":"2023-07-27T14:33:06.262515+0000","last_peered":"2023-07-27T14:33:06.262515+0000","last_clean":"2023-07-27T14:33:06.262515+0000","last_became_active":"2023-07-27T14:33:05.794132+0000","last_became_peered":"2023-07-27T14:33:05.794132+0000","last_unstale":"2023-07-27T14:33:06.262515+0000","last_undegraded":"2023-07-27T14:33:06.262515+0000","last_fullsized":"2023-07-27T14:33:06.262515+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.270487+0000","last_change":"2023-07-27T14:33:06.267162+0000","last_active":"2023-07-27T14:33:06.270487+0000","last_peered":"2023-07-27T14:33:06.270487+0000","last_clean":"2023-07-27T14:33:06.270487+0000","last_became_active":"2023-07-27T14:33:06.266873+0000","last_became_peered":"2023-07-27T14:33:06.266873+0000","last_unstale":"2023-07-27T14:33:06.270487+0000","last_undegraded":"2023-07-27T14:33:06.270487+0000","last_fullsized":"2023-07-27T14:33:06.270487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257972+0000","last_change":"2023-07-27T14:33:05.794219+0000","last_active":"2023-07-27T14:33:06.257972+0000","last_peered":"2023-07-27T14:33:06.257972+0000","last_clean":"2023-07-27T14:33:06.257972+0000","last_became_active":"2023-07-27T14:33:05.793918+0000","last_became_peered":"2023-07-27T14:33:05.793918+0000","last_unstale":"2023-07-27T14:33:06.257972+0000","last_undegraded":"2023-07-27T14:33:06.257972+0000","last_fullsized":"2023-07-27T14:33:06.257972+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262560+0000","last_change":"2023-07-27T14:33:06.255862+0000","last_active":"2023-07-27T14:33:06.262560+0000","last_peered":"2023-07-27T14:33:06.262560+0000","last_clean":"2023-07-27T14:33:06.262560+0000","last_became_active":"2023-07-27T14:33:06.255555+0000","last_became_peered":"2023-07-27T14:33:06.255555+0000","last_unstale":"2023-07-27T14:33:06.262560+0000","last_undegraded":"2023-07-27T14:33:06.262560+0000","last_fullsized":"2023-07-27T14:33:06.262560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.237620+0000","last_change":"2023-07-27T14:33:05.799379+0000","last_active":"2023-07-27T14:33:06.237620+0000","last_peered":"2023-07-27T14:33:06.237620+0000","last_clean":"2023-07-27T14:33:06.237620+0000","last_became_active":"2023-07-27T14:33:05.799093+0000","last_became_peered":"2023-07-27T14:33:05.799093+0000","last_unstale":"2023-07-27T14:33:06.237620+0000","last_undegraded":"2023-07-27T14:33:06.237620+0000","last_fullsized":"2023-07-27T14:33:06.237620+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257865+0000","last_change":"2023-07-27T14:33:06.254020+0000","last_active":"2023-07-27T14:33:06.257865+0000","last_peered":"2023-07-27T14:33:06.257865+0000","last_clean":"2023-07-27T14:33:06.257865+0000","last_became_active":"2023-07-27T14:33:06.253733+0000","last_became_peered":"2023-07-27T14:33:06.253733+0000","last_unstale":"2023-07-27T14:33:06.257865+0000","last_undegraded":"2023-07-27T14:33:06.257865+0000","last_fullsized":"2023-07-27T14:33:06.257865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.237499+0000","last_change":"2023-07-27T14:33:05.797408+0000","last_active":"2023-07-27T14:33:06.237499+0000","last_peered":"2023-07-27T14:33:06.237499+0000","last_clean":"2023-07-27T14:33:06.237499+0000","last_became_active":"2023-07-27T14:33:05.796884+0000","last_became_peered":"2023-07-27T14:33:05.796884+0000","last_unstale":"2023-07-27T14:33:06.237499+0000","last_undegraded":"2023-07-27T14:33:06.237499+0000","last_fullsized":"2023-07-27T14:33:06.237499+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257059+0000","last_change":"2023-07-27T14:33:06.254305+0000","last_active":"2023-07-27T14:33:06.257059+0000","last_peered":"2023-07-27T14:33:06.257059+0000","last_clean":"2023-07-27T14:33:06.257059+0000","last_became_active":"2023-07-27T14:33:06.253952+0000","last_became_peered":"2023-07-27T14:33:06.253952+0000","last_unstale":"2023-07-27T14:33:06.257059+0000","last_undegraded":"2023-07-27T14:33:06.257059+0000","last_fullsized":"2023-07-27T14:33:06.257059+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246260+0000","last_change":"2023-07-27T14:33:05.788329+0000","last_active":"2023-07-27T14:33:06.246260+0000","last_peered":"2023-07-27T14:33:06.246260+0000","last_clean":"2023-07-27T14:33:06.246260+0000","last_became_active":"2023-07-27T14:33:05.787620+0000","last_became_peered":"2023-07-27T14:33:05.787620+0000","last_unstale":"2023-07-27T14:33:06.246260+0000","last_undegraded":"2023-07-27T14:33:06.246260+0000","last_fullsized":"2023-07-27T14:33:06.246260+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.262937+0000","last_change":"2023-07-27T14:33:06.260436+0000","last_active":"2023-07-27T14:33:06.262937+0000","last_peered":"2023-07-27T14:33:06.262937+0000","last_clean":"2023-07-27T14:33:06.262937+0000","last_became_active":"2023-07-27T14:33:06.260127+0000","last_became_peered":"2023-07-27T14:33:06.260127+0000","last_unstale":"2023-07-27T14:33:06.262937+0000","last_undegraded":"2023-07-27T14:33:06.262937+0000","last_fullsized":"2023-07-27T14:33:06.262937+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247230+0000","last_change":"2023-07-27T14:33:05.792906+0000","last_active":"2023-07-27T14:33:06.247230+0000","last_peered":"2023-07-27T14:33:06.247230+0000","last_clean":"2023-07-27T14:33:06.247230+0000","last_became_active":"2023-07-27T14:33:05.792577+0000","last_became_peered":"2023-07-27T14:33:05.792577+0000","last_unstale":"2023-07-27T14:33:06.247230+0000","last_undegraded":"2023-07-27T14:33:06.247230+0000","last_fullsized":"2023-07-27T14:33:06.247230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265976+0000","last_change":"2023-07-27T14:33:06.260259+0000","last_active":"2023-07-27T14:33:06.265976+0000","last_peered":"2023-07-27T14:33:06.265976+0000","last_clean":"2023-07-27T14:33:06.265976+0000","last_became_active":"2023-07-27T14:33:06.259934+0000","last_became_peered":"2023-07-27T14:33:06.259934+0000","last_unstale":"2023-07-27T14:33:06.265976+0000","last_undegraded":"2023-07-27T14:33:06.265976+0000","last_fullsized":"2023-07-27T14:33:06.265976+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.238141+0000","last_change":"2023-07-27T14:33:05.782301+0000","last_active":"2023-07-27T14:33:06.238141+0000","last_peered":"2023-07-27T14:33:06.238141+0000","last_clean":"2023-07-27T14:33:06.238141+0000","last_became_active":"2023-07-27T14:33:05.782020+0000","last_became_peered":"2023-07-27T14:33:05.782020+0000","last_unstale":"2023-07-27T14:33:06.238141+0000","last_undegraded":"2023-07-27T14:33:06.238141+0000","last_fullsized":"2023-07-27T14:33:06.238141+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265664+0000","last_change":"2023-07-27T14:33:06.259534+0000","last_active":"2023-07-27T14:33:06.265664+0000","last_peered":"2023-07-27T14:33:06.265664+0000","last_clean":"2023-07-27T14:33:06.265664+0000","last_became_active":"2023-07-27T14:33:06.259215+0000","last_became_peered":"2023-07-27T14:33:06.259215+0000","last_unstale":"2023-07-27T14:33:06.265664+0000","last_undegraded":"2023-07-27T14:33:06.265664+0000","last_fullsized":"2023-07-27T14:33:06.265664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246116+0000","last_change":"2023-07-27T14:33:05.789970+0000","last_active":"2023-07-27T14:33:06.246116+0000","last_peered":"2023-07-27T14:33:06.246116+0000","last_clean":"2023-07-27T14:33:06.246116+0000","last_became_active":"2023-07-27T14:33:05.789681+0000","last_became_peered":"2023-07-27T14:33:05.789681+0000","last_unstale":"2023-07-27T14:33:06.246116+0000","last_undegraded":"2023-07-27T14:33:06.246116+0000","last_fullsized":"2023-07-27T14:33:06.246116+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268366+0000","last_change":"2023-07-27T14:33:06.266559+0000","last_active":"2023-07-27T14:33:06.268366+0000","last_peered":"2023-07-27T14:33:06.268366+0000","last_clean":"2023-07-27T14:33:06.268366+0000","last_became_active":"2023-07-27T14:33:06.266304+0000","last_became_peered":"2023-07-27T14:33:06.266304+0000","last_unstale":"2023-07-27T14:33:06.268366+0000","last_undegraded":"2023-07-27T14:33:06.268366+0000","last_fullsized":"2023-07-27T14:33:06.268366+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.248928+0000","last_change":"2023-07-27T14:33:05.792942+0000","last_active":"2023-07-27T14:33:06.248928+0000","last_peered":"2023-07-27T14:33:06.248928+0000","last_clean":"2023-07-27T14:33:06.248928+0000","last_became_active":"2023-07-27T14:33:05.792674+0000","last_became_peered":"2023-07-27T14:33:05.792674+0000","last_unstale":"2023-07-27T14:33:06.248928+0000","last_undegraded":"2023-07-27T14:33:06.248928+0000","last_fullsized":"2023-07-27T14:33:06.248928+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.267327+0000","last_change":"2023-07-27T14:33:06.266506+0000","last_active":"2023-07-27T14:33:06.267327+0000","last_peered":"2023-07-27T14:33:06.267327+0000","last_clean":"2023-07-27T14:33:06.267327+0000","last_became_active":"2023-07-27T14:33:06.266201+0000","last_became_peered":"2023-07-27T14:33:06.266201+0000","last_unstale":"2023-07-27T14:33:06.267327+0000","last_undegraded":"2023-07-27T14:33:06.267327+0000","last_fullsized":"2023-07-27T14:33:06.267327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.237975+0000","last_change":"2023-07-27T14:33:05.781590+0000","last_active":"2023-07-27T14:33:06.237975+0000","last_peered":"2023-07-27T14:33:06.237975+0000","last_clean":"2023-07-27T14:33:06.237975+0000","last_became_active":"2023-07-27T14:33:05.781301+0000","last_became_peered":"2023-07-27T14:33:05.781301+0000","last_unstale":"2023-07-27T14:33:06.237975+0000","last_undegraded":"2023-07-27T14:33:06.237975+0000","last_fullsized":"2023-07-27T14:33:06.237975+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252462+0000","last_change":"2023-07-27T14:33:06.249183+0000","last_active":"2023-07-27T14:33:06.252462+0000","last_peered":"2023-07-27T14:33:06.252462+0000","last_clean":"2023-07-27T14:33:06.252462+0000","last_became_active":"2023-07-27T14:33:06.248899+0000","last_became_peered":"2023-07-27T14:33:06.248899+0000","last_unstale":"2023-07-27T14:33:06.252462+0000","last_undegraded":"2023-07-27T14:33:06.252462+0000","last_fullsized":"2023-07-27T14:33:06.252462+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244987+0000","last_change":"2023-07-27T14:33:05.797114+0000","last_active":"2023-07-27T14:33:06.244987+0000","last_peered":"2023-07-27T14:33:06.244987+0000","last_clean":"2023-07-27T14:33:06.244987+0000","last_became_active":"2023-07-27T14:33:05.794749+0000","last_became_peered":"2023-07-27T14:33:05.794749+0000","last_unstale":"2023-07-27T14:33:06.244987+0000","last_undegraded":"2023-07-27T14:33:06.244987+0000","last_fullsized":"2023-07-27T14:33:06.244987+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.255687+0000","last_change":"2023-07-27T14:33:06.253391+0000","last_active":"2023-07-27T14:33:06.255687+0000","last_peered":"2023-07-27T14:33:06.255687+0000","last_clean":"2023-07-27T14:33:06.255687+0000","last_became_active":"2023-07-27T14:33:06.252804+0000","last_became_peered":"2023-07-27T14:33:06.252804+0000","last_unstale":"2023-07-27T14:33:06.255687+0000","last_undegraded":"2023-07-27T14:33:06.255687+0000","last_fullsized":"2023-07-27T14:33:06.255687+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244233+0000","last_change":"2023-07-27T14:33:05.795070+0000","last_active":"2023-07-27T14:33:06.244233+0000","last_peered":"2023-07-27T14:33:06.244233+0000","last_clean":"2023-07-27T14:33:06.244233+0000","last_became_active":"2023-07-27T14:33:05.794703+0000","last_became_peered":"2023-07-27T14:33:05.794703+0000","last_unstale":"2023-07-27T14:33:06.244233+0000","last_undegraded":"2023-07-27T14:33:06.244233+0000","last_fullsized":"2023-07-27T14:33:06.244233+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257185+0000","last_change":"2023-07-27T14:33:06.253801+0000","last_active":"2023-07-27T14:33:06.257185+0000","last_peered":"2023-07-27T14:33:06.257185+0000","last_clean":"2023-07-27T14:33:06.257185+0000","last_became_active":"2023-07-27T14:33:06.253557+0000","last_became_peered":"2023-07-27T14:33:06.253557+0000","last_unstale":"2023-07-27T14:33:06.257185+0000","last_undegraded":"2023-07-27T14:33:06.257185+0000","last_fullsized":"2023-07-27T14:33:06.257185+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.242023+0000","last_change":"2023-07-27T14:33:05.787329+0000","last_active":"2023-07-27T14:33:06.242023+0000","last_peered":"2023-07-27T14:33:06.242023+0000","last_clean":"2023-07-27T14:33:06.242023+0000","last_became_active":"2023-07-27T14:33:05.787034+0000","last_became_peered":"2023-07-27T14:33:05.787034+0000","last_unstale":"2023-07-27T14:33:06.242023+0000","last_undegraded":"2023-07-27T14:33:06.242023+0000","last_fullsized":"2023-07-27T14:33:06.242023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261230+0000","last_change":"2023-07-27T14:33:06.256613+0000","last_active":"2023-07-27T14:33:06.261230+0000","last_peered":"2023-07-27T14:33:06.261230+0000","last_clean":"2023-07-27T14:33:06.261230+0000","last_became_active":"2023-07-27T14:33:06.255728+0000","last_became_peered":"2023-07-27T14:33:06.255728+0000","last_unstale":"2023-07-27T14:33:06.261230+0000","last_undegraded":"2023-07-27T14:33:06.261230+0000","last_fullsized":"2023-07-27T14:33:06.261230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256526+0000","last_change":"2023-07-27T14:33:05.792785+0000","last_active":"2023-07-27T14:33:06.256526+0000","last_peered":"2023-07-27T14:33:06.256526+0000","last_clean":"2023-07-27T14:33:06.256526+0000","last_became_active":"2023-07-27T14:33:05.792101+0000","last_became_peered":"2023-07-27T14:33:05.792101+0000","last_unstale":"2023-07-27T14:33:06.256526+0000","last_undegraded":"2023-07-27T14:33:06.256526+0000","last_fullsized":"2023-07-27T14:33:06.256526+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261148+0000","last_change":"2023-07-27T14:33:06.259637+0000","last_active":"2023-07-27T14:33:06.261148+0000","last_peered":"2023-07-27T14:33:06.261148+0000","last_clean":"2023-07-27T14:33:06.261148+0000","last_became_active":"2023-07-27T14:33:06.259287+0000","last_became_peered":"2023-07-27T14:33:06.259287+0000","last_unstale":"2023-07-27T14:33:06.261148+0000","last_undegraded":"2023-07-27T14:33:06.261148+0000","last_fullsized":"2023-07-27T14:33:06.261148+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261248+0000","last_change":"2023-07-27T14:33:05.787790+0000","last_active":"2023-07-27T14:33:06.261248+0000","last_peered":"2023-07-27T14:33:06.261248+0000","last_clean":"2023-07-27T14:33:06.261248+0000","last_became_active":"2023-07-27T14:33:05.787388+0000","last_became_peered":"2023-07-27T14:33:05.787388+0000","last_unstale":"2023-07-27T14:33:06.261248+0000","last_undegraded":"2023-07-27T14:33:06.261248+0000","last_fullsized":"2023-07-27T14:33:06.261248+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269905+0000","last_change":"2023-07-27T14:33:06.266247+0000","last_active":"2023-07-27T14:33:06.269905+0000","last_peered":"2023-07-27T14:33:06.269905+0000","last_clean":"2023-07-27T14:33:06.269905+0000","last_became_active":"2023-07-27T14:33:06.265826+0000","last_became_peered":"2023-07-27T14:33:06.265826+0000","last_unstale":"2023-07-27T14:33:06.269905+0000","last_undegraded":"2023-07-27T14:33:06.269905+0000","last_fullsized":"2023-07-27T14:33:06.269905+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268205+0000","last_change":"2023-07-27T14:33:05.779217+0000","last_active":"2023-07-27T14:33:06.268205+0000","last_peered":"2023-07-27T14:33:06.268205+0000","last_clean":"2023-07-27T14:33:06.268205+0000","last_became_active":"2023-07-27T14:33:05.777840+0000","last_became_peered":"2023-07-27T14:33:05.777840+0000","last_unstale":"2023-07-27T14:33:06.268205+0000","last_undegraded":"2023-07-27T14:33:06.268205+0000","last_fullsized":"2023-07-27T14:33:06.268205+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269418+0000","last_change":"2023-07-27T14:33:06.267760+0000","last_active":"2023-07-27T14:33:06.269418+0000","last_peered":"2023-07-27T14:33:06.269418+0000","last_clean":"2023-07-27T14:33:06.269418+0000","last_became_active":"2023-07-27T14:33:06.267393+0000","last_became_peered":"2023-07-27T14:33:06.267393+0000","last_unstale":"2023-07-27T14:33:06.269418+0000","last_undegraded":"2023-07-27T14:33:06.269418+0000","last_fullsized":"2023-07-27T14:33:06.269418+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.245989+0000","last_change":"2023-07-27T14:33:05.793125+0000","last_active":"2023-07-27T14:33:06.245989+0000","last_peered":"2023-07-27T14:33:06.245989+0000","last_clean":"2023-07-27T14:33:06.245989+0000","last_became_active":"2023-07-27T14:33:05.792538+0000","last_became_peered":"2023-07-27T14:33:05.792538+0000","last_unstale":"2023-07-27T14:33:06.245989+0000","last_undegraded":"2023-07-27T14:33:06.245989+0000","last_fullsized":"2023-07-27T14:33:06.245989+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265814+0000","last_change":"2023-07-27T14:33:06.261244+0000","last_active":"2023-07-27T14:33:06.265814+0000","last_peered":"2023-07-27T14:33:06.265814+0000","last_clean":"2023-07-27T14:33:06.265814+0000","last_became_active":"2023-07-27T14:33:06.260981+0000","last_became_peered":"2023-07-27T14:33:06.260981+0000","last_unstale":"2023-07-27T14:33:06.265814+0000","last_undegraded":"2023-07-27T14:33:06.265814+0000","last_fullsized":"2023-07-27T14:33:06.265814+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.245665+0000","last_change":"2023-07-27T14:33:05.788692+0000","last_active":"2023-07-27T14:33:06.245665+0000","last_peered":"2023-07-27T14:33:06.245665+0000","last_clean":"2023-07-27T14:33:06.245665+0000","last_became_active":"2023-07-27T14:33:05.788375+0000","last_became_peered":"2023-07-27T14:33:05.788375+0000","last_unstale":"2023-07-27T14:33:06.245665+0000","last_undegraded":"2023-07-27T14:33:06.245665+0000","last_fullsized":"2023-07-27T14:33:06.245665+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.260505+0000","last_change":"2023-07-27T14:33:06.255278+0000","last_active":"2023-07-27T14:33:06.260505+0000","last_peered":"2023-07-27T14:33:06.260505+0000","last_clean":"2023-07-27T14:33:06.260505+0000","last_became_active":"2023-07-27T14:33:06.254677+0000","last_became_peered":"2023-07-27T14:33:06.254677+0000","last_unstale":"2023-07-27T14:33:06.260505+0000","last_undegraded":"2023-07-27T14:33:06.260505+0000","last_fullsized":"2023-07-27T14:33:06.260505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.241004+0000","last_change":"2023-07-27T14:33:05.787768+0000","last_active":"2023-07-27T14:33:06.241004+0000","last_peered":"2023-07-27T14:33:06.241004+0000","last_clean":"2023-07-27T14:33:06.241004+0000","last_became_active":"2023-07-27T14:33:05.786195+0000","last_became_peered":"2023-07-27T14:33:05.786195+0000","last_unstale":"2023-07-27T14:33:06.241004+0000","last_undegraded":"2023-07-27T14:33:06.241004+0000","last_fullsized":"2023-07-27T14:33:06.241004+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.255663+0000","last_change":"2023-07-27T14:33:06.253186+0000","last_active":"2023-07-27T14:33:06.255663+0000","last_peered":"2023-07-27T14:33:06.255663+0000","last_clean":"2023-07-27T14:33:06.255663+0000","last_became_active":"2023-07-27T14:33:06.252775+0000","last_became_peered":"2023-07-27T14:33:06.252775+0000","last_unstale":"2023-07-27T14:33:06.255663+0000","last_undegraded":"2023-07-27T14:33:06.255663+0000","last_fullsized":"2023-07-27T14:33:06.255663+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257570+0000","last_change":"2023-07-27T14:33:05.779870+0000","last_active":"2023-07-27T14:33:06.257570+0000","last_peered":"2023-07-27T14:33:06.257570+0000","last_clean":"2023-07-27T14:33:06.257570+0000","last_became_active":"2023-07-27T14:33:05.779586+0000","last_became_peered":"2023-07-27T14:33:05.779586+0000","last_unstale":"2023-07-27T14:33:06.257570+0000","last_undegraded":"2023-07-27T14:33:06.257570+0000","last_fullsized":"2023-07-27T14:33:06.257570+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257684+0000","last_change":"2023-07-27T14:33:06.253083+0000","last_active":"2023-07-27T14:33:06.257684+0000","last_peered":"2023-07-27T14:33:06.257684+0000","last_clean":"2023-07-27T14:33:06.257684+0000","last_became_active":"2023-07-27T14:33:06.252764+0000","last_became_peered":"2023-07-27T14:33:06.252764+0000","last_unstale":"2023-07-27T14:33:06.257684+0000","last_undegraded":"2023-07-27T14:33:06.257684+0000","last_fullsized":"2023-07-27T14:33:06.257684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247653+0000","last_change":"2023-07-27T14:33:05.788674+0000","last_active":"2023-07-27T14:33:06.247653+0000","last_peered":"2023-07-27T14:33:06.247653+0000","last_clean":"2023-07-27T14:33:06.247653+0000","last_became_active":"2023-07-27T14:33:05.788385+0000","last_became_peered":"2023-07-27T14:33:05.788385+0000","last_unstale":"2023-07-27T14:33:06.247653+0000","last_undegraded":"2023-07-27T14:33:06.247653+0000","last_fullsized":"2023-07-27T14:33:06.247653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261246+0000","last_change":"2023-07-27T14:33:06.257061+0000","last_active":"2023-07-27T14:33:06.261246+0000","last_peered":"2023-07-27T14:33:06.261246+0000","last_clean":"2023-07-27T14:33:06.261246+0000","last_became_active":"2023-07-27T14:33:06.256721+0000","last_became_peered":"2023-07-27T14:33:06.256721+0000","last_unstale":"2023-07-27T14:33:06.261246+0000","last_undegraded":"2023-07-27T14:33:06.261246+0000","last_fullsized":"2023-07-27T14:33:06.261246+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256105+0000","last_change":"2023-07-27T14:33:05.781100+0000","last_active":"2023-07-27T14:33:06.256105+0000","last_peered":"2023-07-27T14:33:06.256105+0000","last_clean":"2023-07-27T14:33:06.256105+0000","last_became_active":"2023-07-27T14:33:05.780805+0000","last_became_peered":"2023-07-27T14:33:05.780805+0000","last_unstale":"2023-07-27T14:33:06.256105+0000","last_undegraded":"2023-07-27T14:33:06.256105+0000","last_fullsized":"2023-07-27T14:33:06.256105+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258763+0000","last_change":"2023-07-27T14:33:06.256270+0000","last_active":"2023-07-27T14:33:06.258763+0000","last_peered":"2023-07-27T14:33:06.258763+0000","last_clean":"2023-07-27T14:33:06.258763+0000","last_became_active":"2023-07-27T14:33:06.256007+0000","last_became_peered":"2023-07-27T14:33:06.256007+0000","last_unstale":"2023-07-27T14:33:06.258763+0000","last_undegraded":"2023-07-27T14:33:06.258763+0000","last_fullsized":"2023-07-27T14:33:06.258763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.238257+0000","last_change":"2023-07-27T14:33:05.796522+0000","last_active":"2023-07-27T14:33:06.238257+0000","last_peered":"2023-07-27T14:33:06.238257+0000","last_clean":"2023-07-27T14:33:06.238257+0000","last_became_active":"2023-07-27T14:33:05.795889+0000","last_became_peered":"2023-07-27T14:33:05.795889+0000","last_unstale":"2023-07-27T14:33:06.238257+0000","last_undegraded":"2023-07-27T14:33:06.238257+0000","last_fullsized":"2023-07-27T14:33:06.238257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261173+0000","last_change":"2023-07-27T14:33:06.259320+0000","last_active":"2023-07-27T14:33:06.261173+0000","last_peered":"2023-07-27T14:33:06.261173+0000","last_clean":"2023-07-27T14:33:06.261173+0000","last_became_active":"2023-07-27T14:33:06.259024+0000","last_became_peered":"2023-07-27T14:33:06.259024+0000","last_unstale":"2023-07-27T14:33:06.261173+0000","last_undegraded":"2023-07-27T14:33:06.261173+0000","last_fullsized":"2023-07-27T14:33:06.261173+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"113'3","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265419+0000","last_change":"2023-07-27T14:33:05.801974+0000","last_active":"2023-07-27T14:33:06.265419+0000","last_peered":"2023-07-27T14:33:06.265419+0000","last_clean":"2023-07-27T14:33:06.265419+0000","last_became_active":"2023-07-27T14:33:05.801723+0000","last_became_peered":"2023-07-27T14:33:05.801723+0000","last_unstale":"2023-07-27T14:33:06.265419+0000","last_undegraded":"2023-07-27T14:33:06.265419+0000","last_fullsized":"2023-07-27T14:33:06.265419+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258463+0000","last_change":"2023-07-27T14:33:06.254844+0000","last_active":"2023-07-27T14:33:06.258463+0000","last_peered":"2023-07-27T14:33:06.258463+0000","last_clean":"2023-07-27T14:33:06.258463+0000","last_became_active":"2023-07-27T14:33:06.254289+0000","last_became_peered":"2023-07-27T14:33:06.254289+0000","last_unstale":"2023-07-27T14:33:06.258463+0000","last_undegraded":"2023-07-27T14:33:06.258463+0000","last_fullsized":"2023-07-27T14:33:06.258463+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265056+0000","last_change":"2023-07-27T14:33:05.792824+0000","last_active":"2023-07-27T14:33:06.265056+0000","last_peered":"2023-07-27T14:33:06.265056+0000","last_clean":"2023-07-27T14:33:06.265056+0000","last_became_active":"2023-07-27T14:33:05.792523+0000","last_became_peered":"2023-07-27T14:33:05.792523+0000","last_unstale":"2023-07-27T14:33:06.265056+0000","last_undegraded":"2023-07-27T14:33:06.265056+0000","last_fullsized":"2023-07-27T14:33:06.265056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.253832+0000","last_change":"2023-07-27T14:33:06.249482+0000","last_active":"2023-07-27T14:33:06.253832+0000","last_peered":"2023-07-27T14:33:06.253832+0000","last_clean":"2023-07-27T14:33:06.253832+0000","last_became_active":"2023-07-27T14:33:06.249176+0000","last_became_peered":"2023-07-27T14:33:06.249176+0000","last_unstale":"2023-07-27T14:33:06.253832+0000","last_undegraded":"2023-07-27T14:33:06.253832+0000","last_fullsized":"2023-07-27T14:33:06.253832+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.267453+0000","last_change":"2023-07-27T14:33:05.793873+0000","last_active":"2023-07-27T14:33:06.267453+0000","last_peered":"2023-07-27T14:33:06.267453+0000","last_clean":"2023-07-27T14:33:06.267453+0000","last_became_active":"2023-07-27T14:33:05.793616+0000","last_became_peered":"2023-07-27T14:33:05.793616+0000","last_unstale":"2023-07-27T14:33:06.267453+0000","last_undegraded":"2023-07-27T14:33:06.267453+0000","last_fullsized":"2023-07-27T14:33:06.267453+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256845+0000","last_change":"2023-07-27T14:33:06.253991+0000","last_active":"2023-07-27T14:33:06.256845+0000","last_peered":"2023-07-27T14:33:06.256845+0000","last_clean":"2023-07-27T14:33:06.256845+0000","last_became_active":"2023-07-27T14:33:06.253684+0000","last_became_peered":"2023-07-27T14:33:06.253684+0000","last_unstale":"2023-07-27T14:33:06.256845+0000","last_undegraded":"2023-07-27T14:33:06.256845+0000","last_fullsized":"2023-07-27T14:33:06.256845+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247479+0000","last_change":"2023-07-27T14:33:05.789961+0000","last_active":"2023-07-27T14:33:06.247479+0000","last_peered":"2023-07-27T14:33:06.247479+0000","last_clean":"2023-07-27T14:33:06.247479+0000","last_became_active":"2023-07-27T14:33:05.788448+0000","last_became_peered":"2023-07-27T14:33:05.788448+0000","last_unstale":"2023-07-27T14:33:06.247479+0000","last_undegraded":"2023-07-27T14:33:06.247479+0000","last_fullsized":"2023-07-27T14:33:06.247479+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268816+0000","last_change":"2023-07-27T14:33:06.267581+0000","last_active":"2023-07-27T14:33:06.268816+0000","last_peered":"2023-07-27T14:33:06.268816+0000","last_clean":"2023-07-27T14:33:06.268816+0000","last_became_active":"2023-07-27T14:33:06.267296+0000","last_became_peered":"2023-07-27T14:33:06.267296+0000","last_unstale":"2023-07-27T14:33:06.268816+0000","last_undegraded":"2023-07-27T14:33:06.268816+0000","last_fullsized":"2023-07-27T14:33:06.268816+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244341+0000","last_change":"2023-07-27T14:33:05.790982+0000","last_active":"2023-07-27T14:33:06.244341+0000","last_peered":"2023-07-27T14:33:06.244341+0000","last_clean":"2023-07-27T14:33:06.244341+0000","last_became_active":"2023-07-27T14:33:05.790711+0000","last_became_peered":"2023-07-27T14:33:05.790711+0000","last_unstale":"2023-07-27T14:33:06.244341+0000","last_undegraded":"2023-07-27T14:33:06.244341+0000","last_fullsized":"2023-07-27T14:33:06.244341+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252549+0000","last_change":"2023-07-27T14:33:06.249876+0000","last_active":"2023-07-27T14:33:06.252549+0000","last_peered":"2023-07-27T14:33:06.252549+0000","last_clean":"2023-07-27T14:33:06.252549+0000","last_became_active":"2023-07-27T14:33:06.249520+0000","last_became_peered":"2023-07-27T14:33:06.249520+0000","last_unstale":"2023-07-27T14:33:06.252549+0000","last_undegraded":"2023-07-27T14:33:06.252549+0000","last_fullsized":"2023-07-27T14:33:06.252549+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'4","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.269001+0000","last_change":"2023-07-27T14:33:05.777544+0000","last_active":"2023-07-27T14:33:06.269001+0000","last_peered":"2023-07-27T14:33:06.269001+0000","last_clean":"2023-07-27T14:33:06.269001+0000","last_became_active":"2023-07-27T14:33:05.777246+0000","last_became_peered":"2023-07-27T14:33:05.777246+0000","last_unstale":"2023-07-27T14:33:06.269001+0000","last_undegraded":"2023-07-27T14:33:06.269001+0000","last_fullsized":"2023-07-27T14:33:06.269001+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257290+0000","last_change":"2023-07-27T14:33:06.253720+0000","last_active":"2023-07-27T14:33:06.257290+0000","last_peered":"2023-07-27T14:33:06.257290+0000","last_clean":"2023-07-27T14:33:06.257290+0000","last_became_active":"2023-07-27T14:33:06.253474+0000","last_became_peered":"2023-07-27T14:33:06.253474+0000","last_unstale":"2023-07-27T14:33:06.257290+0000","last_undegraded":"2023-07-27T14:33:06.257290+0000","last_fullsized":"2023-07-27T14:33:06.257290+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.268505+0000","last_change":"2023-07-27T14:33:05.789773+0000","last_active":"2023-07-27T14:33:06.268505+0000","last_peered":"2023-07-27T14:33:06.268505+0000","last_clean":"2023-07-27T14:33:06.268505+0000","last_became_active":"2023-07-27T14:33:05.789467+0000","last_became_peered":"2023-07-27T14:33:05.789467+0000","last_unstale":"2023-07-27T14:33:06.268505+0000","last_undegraded":"2023-07-27T14:33:06.268505+0000","last_fullsized":"2023-07-27T14:33:06.268505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.270102+0000","last_change":"2023-07-27T14:33:06.267253+0000","last_active":"2023-07-27T14:33:06.270102+0000","last_peered":"2023-07-27T14:33:06.270102+0000","last_clean":"2023-07-27T14:33:06.270102+0000","last_became_active":"2023-07-27T14:33:06.266951+0000","last_became_peered":"2023-07-27T14:33:06.266951+0000","last_unstale":"2023-07-27T14:33:06.270102+0000","last_undegraded":"2023-07-27T14:33:06.270102+0000","last_fullsized":"2023-07-27T14:33:06.270102+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.238347+0000","last_change":"2023-07-27T14:33:05.796344+0000","last_active":"2023-07-27T14:33:06.238347+0000","last_peered":"2023-07-27T14:33:06.238347+0000","last_clean":"2023-07-27T14:33:06.238347+0000","last_became_active":"2023-07-27T14:33:05.795471+0000","last_became_peered":"2023-07-27T14:33:05.795471+0000","last_unstale":"2023-07-27T14:33:06.238347+0000","last_undegraded":"2023-07-27T14:33:06.238347+0000","last_fullsized":"2023-07-27T14:33:06.238347+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265684+0000","last_change":"2023-07-27T14:33:06.260737+0000","last_active":"2023-07-27T14:33:06.265684+0000","last_peered":"2023-07-27T14:33:06.265684+0000","last_clean":"2023-07-27T14:33:06.265684+0000","last_became_active":"2023-07-27T14:33:06.260484+0000","last_became_peered":"2023-07-27T14:33:06.260484+0000","last_unstale":"2023-07-27T14:33:06.265684+0000","last_undegraded":"2023-07-27T14:33:06.265684+0000","last_fullsized":"2023-07-27T14:33:06.265684+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246824+0000","last_change":"2023-07-27T14:33:05.795422+0000","last_active":"2023-07-27T14:33:06.246824+0000","last_peered":"2023-07-27T14:33:06.246824+0000","last_clean":"2023-07-27T14:33:06.246824+0000","last_became_active":"2023-07-27T14:33:05.795149+0000","last_became_peered":"2023-07-27T14:33:05.795149+0000","last_unstale":"2023-07-27T14:33:06.246824+0000","last_undegraded":"2023-07-27T14:33:06.246824+0000","last_fullsized":"2023-07-27T14:33:06.246824+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.264980+0000","last_change":"2023-07-27T14:33:06.262175+0000","last_active":"2023-07-27T14:33:06.264980+0000","last_peered":"2023-07-27T14:33:06.264980+0000","last_clean":"2023-07-27T14:33:06.264980+0000","last_became_active":"2023-07-27T14:33:06.260656+0000","last_became_peered":"2023-07-27T14:33:06.260656+0000","last_unstale":"2023-07-27T14:33:06.264980+0000","last_undegraded":"2023-07-27T14:33:06.264980+0000","last_fullsized":"2023-07-27T14:33:06.264980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246079+0000","last_change":"2023-07-27T14:33:05.793330+0000","last_active":"2023-07-27T14:33:06.246079+0000","last_peered":"2023-07-27T14:33:06.246079+0000","last_clean":"2023-07-27T14:33:06.246079+0000","last_became_active":"2023-07-27T14:33:05.792874+0000","last_became_peered":"2023-07-27T14:33:05.792874+0000","last_unstale":"2023-07-27T14:33:06.246079+0000","last_undegraded":"2023-07-27T14:33:06.246079+0000","last_fullsized":"2023-07-27T14:33:06.246079+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258494+0000","last_change":"2023-07-27T14:33:06.255924+0000","last_active":"2023-07-27T14:33:06.258494+0000","last_peered":"2023-07-27T14:33:06.258494+0000","last_clean":"2023-07-27T14:33:06.258494+0000","last_became_active":"2023-07-27T14:33:06.255640+0000","last_became_peered":"2023-07-27T14:33:06.255640+0000","last_unstale":"2023-07-27T14:33:06.258494+0000","last_undegraded":"2023-07-27T14:33:06.258494+0000","last_fullsized":"2023-07-27T14:33:06.258494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.260066+0000","last_change":"2023-07-27T14:33:05.784409+0000","last_active":"2023-07-27T14:33:06.260066+0000","last_peered":"2023-07-27T14:33:06.260066+0000","last_clean":"2023-07-27T14:33:06.260066+0000","last_became_active":"2023-07-27T14:33:05.783990+0000","last_became_peered":"2023-07-27T14:33:05.783990+0000","last_unstale":"2023-07-27T14:33:06.260066+0000","last_undegraded":"2023-07-27T14:33:06.260066+0000","last_fullsized":"2023-07-27T14:33:06.260066+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261335+0000","last_change":"2023-07-27T14:33:06.259650+0000","last_active":"2023-07-27T14:33:06.261335+0000","last_peered":"2023-07-27T14:33:06.261335+0000","last_clean":"2023-07-27T14:33:06.261335+0000","last_became_active":"2023-07-27T14:33:06.259381+0000","last_became_peered":"2023-07-27T14:33:06.259381+0000","last_unstale":"2023-07-27T14:33:06.261335+0000","last_undegraded":"2023-07-27T14:33:06.261335+0000","last_fullsized":"2023-07-27T14:33:06.261335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.245170+0000","last_change":"2023-07-27T14:33:05.791855+0000","last_active":"2023-07-27T14:33:06.245170+0000","last_peered":"2023-07-27T14:33:06.245170+0000","last_clean":"2023-07-27T14:33:06.245170+0000","last_became_active":"2023-07-27T14:33:05.791607+0000","last_became_peered":"2023-07-27T14:33:05.791607+0000","last_unstale":"2023-07-27T14:33:06.245170+0000","last_undegraded":"2023-07-27T14:33:06.245170+0000","last_fullsized":"2023-07-27T14:33:06.245170+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.252981+0000","last_change":"2023-07-27T14:33:06.249845+0000","last_active":"2023-07-27T14:33:06.252981+0000","last_peered":"2023-07-27T14:33:06.252981+0000","last_clean":"2023-07-27T14:33:06.252981+0000","last_became_active":"2023-07-27T14:33:06.249540+0000","last_became_peered":"2023-07-27T14:33:06.249540+0000","last_unstale":"2023-07-27T14:33:06.252981+0000","last_undegraded":"2023-07-27T14:33:06.252981+0000","last_fullsized":"2023-07-27T14:33:06.252981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246741+0000","last_change":"2023-07-27T14:33:05.796337+0000","last_active":"2023-07-27T14:33:06.246741+0000","last_peered":"2023-07-27T14:33:06.246741+0000","last_clean":"2023-07-27T14:33:06.246741+0000","last_became_active":"2023-07-27T14:33:05.796101+0000","last_became_peered":"2023-07-27T14:33:05.796101+0000","last_unstale":"2023-07-27T14:33:06.246741+0000","last_undegraded":"2023-07-27T14:33:06.246741+0000","last_fullsized":"2023-07-27T14:33:06.246741+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258511+0000","last_change":"2023-07-27T14:33:06.254897+0000","last_active":"2023-07-27T14:33:06.258511+0000","last_peered":"2023-07-27T14:33:06.258511+0000","last_clean":"2023-07-27T14:33:06.258511+0000","last_became_active":"2023-07-27T14:33:06.254587+0000","last_became_peered":"2023-07-27T14:33:06.254587+0000","last_unstale":"2023-07-27T14:33:06.258511+0000","last_undegraded":"2023-07-27T14:33:06.258511+0000","last_fullsized":"2023-07-27T14:33:06.258511+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.243924+0000","last_change":"2023-07-27T14:33:05.792802+0000","last_active":"2023-07-27T14:33:06.243924+0000","last_peered":"2023-07-27T14:33:06.243924+0000","last_clean":"2023-07-27T14:33:06.243924+0000","last_became_active":"2023-07-27T14:33:05.792506+0000","last_became_peered":"2023-07-27T14:33:05.792506+0000","last_unstale":"2023-07-27T14:33:06.243924+0000","last_undegraded":"2023-07-27T14:33:06.243924+0000","last_fullsized":"2023-07-27T14:33:06.243924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.265654+0000","last_change":"2023-07-27T14:33:06.259587+0000","last_active":"2023-07-27T14:33:06.265654+0000","last_peered":"2023-07-27T14:33:06.265654+0000","last_clean":"2023-07-27T14:33:06.265654+0000","last_became_active":"2023-07-27T14:33:06.259328+0000","last_became_peered":"2023-07-27T14:33:06.259328+0000","last_unstale":"2023-07-27T14:33:06.265654+0000","last_undegraded":"2023-07-27T14:33:06.265654+0000","last_fullsized":"2023-07-27T14:33:06.265654+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246731+0000","last_change":"2023-07-27T14:33:05.795008+0000","last_active":"2023-07-27T14:33:06.246731+0000","last_peered":"2023-07-27T14:33:06.246731+0000","last_clean":"2023-07-27T14:33:06.246731+0000","last_became_active":"2023-07-27T14:33:05.794642+0000","last_became_peered":"2023-07-27T14:33:05.794642+0000","last_unstale":"2023-07-27T14:33:06.246731+0000","last_undegraded":"2023-07-27T14:33:06.246731+0000","last_fullsized":"2023-07-27T14:33:06.246731+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246158+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:33:06.246158+0000","last_peered":"2023-07-27T14:33:06.246158+0000","last_clean":"2023-07-27T14:33:06.246158+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:33:06.246158+0000","last_undegraded":"2023-07-27T14:33:06.246158+0000","last_fullsized":"2023-07-27T14:33:06.246158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258488+0000","last_change":"2023-07-27T14:33:06.254303+0000","last_active":"2023-07-27T14:33:06.258488+0000","last_peered":"2023-07-27T14:33:06.258488+0000","last_clean":"2023-07-27T14:33:06.258488+0000","last_became_active":"2023-07-27T14:33:06.254025+0000","last_became_peered":"2023-07-27T14:33:06.254025+0000","last_unstale":"2023-07-27T14:33:06.258488+0000","last_undegraded":"2023-07-27T14:33:06.258488+0000","last_fullsized":"2023-07-27T14:33:06.258488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.266641+0000","last_change":"2023-07-27T14:33:05.790664+0000","last_active":"2023-07-27T14:33:06.266641+0000","last_peered":"2023-07-27T14:33:06.266641+0000","last_clean":"2023-07-27T14:33:06.266641+0000","last_became_active":"2023-07-27T14:33:05.790301+0000","last_became_peered":"2023-07-27T14:33:05.790301+0000","last_unstale":"2023-07-27T14:33:06.266641+0000","last_undegraded":"2023-07-27T14:33:06.266641+0000","last_fullsized":"2023-07-27T14:33:06.266641+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.241437+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:33:06.241437+0000","last_peered":"2023-07-27T14:33:06.241437+0000","last_clean":"2023-07-27T14:33:06.241437+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:33:06.241437+0000","last_undegraded":"2023-07-27T14:33:06.241437+0000","last_fullsized":"2023-07-27T14:33:06.241437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.258480+0000","last_change":"2023-07-27T14:33:06.255024+0000","last_active":"2023-07-27T14:33:06.258480+0000","last_peered":"2023-07-27T14:33:06.258480+0000","last_clean":"2023-07-27T14:33:06.258480+0000","last_became_active":"2023-07-27T14:33:06.254615+0000","last_became_peered":"2023-07-27T14:33:06.254615+0000","last_unstale":"2023-07-27T14:33:06.258480+0000","last_undegraded":"2023-07-27T14:33:06.258480+0000","last_fullsized":"2023-07-27T14:33:06.258480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.241566+0000","last_change":"2023-07-27T14:33:05.785324+0000","last_active":"2023-07-27T14:33:06.241566+0000","last_peered":"2023-07-27T14:33:06.241566+0000","last_clean":"2023-07-27T14:33:06.241566+0000","last_became_active":"2023-07-27T14:33:05.785056+0000","last_became_peered":"2023-07-27T14:33:05.785056+0000","last_unstale":"2023-07-27T14:33:06.241566+0000","last_undegraded":"2023-07-27T14:33:06.241566+0000","last_fullsized":"2023-07-27T14:33:06.241566+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.244439+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:33:06.244439+0000","last_peered":"2023-07-27T14:33:06.244439+0000","last_clean":"2023-07-27T14:33:06.244439+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:33:06.244439+0000","last_undegraded":"2023-07-27T14:33:06.244439+0000","last_fullsized":"2023-07-27T14:33:06.244439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.250522+0000","last_change":"2023-07-27T14:33:06.249330+0000","last_active":"2023-07-27T14:33:06.250522+0000","last_peered":"2023-07-27T14:33:06.250522+0000","last_clean":"2023-07-27T14:33:06.250522+0000","last_became_active":"2023-07-27T14:33:06.248930+0000","last_became_peered":"2023-07-27T14:33:06.248930+0000","last_unstale":"2023-07-27T14:33:06.250522+0000","last_undegraded":"2023-07-27T14:33:06.250522+0000","last_fullsized":"2023-07-27T14:33:06.250522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261382+0000","last_change":"2023-07-27T14:33:05.795088+0000","last_active":"2023-07-27T14:33:06.261382+0000","last_peered":"2023-07-27T14:33:06.261382+0000","last_clean":"2023-07-27T14:33:06.261382+0000","last_became_active":"2023-07-27T14:33:05.794724+0000","last_became_peered":"2023-07-27T14:33:05.794724+0000","last_unstale":"2023-07-27T14:33:06.261382+0000","last_undegraded":"2023-07-27T14:33:06.261382+0000","last_fullsized":"2023-07-27T14:33:06.261382+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.242430+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:33:06.242430+0000","last_peered":"2023-07-27T14:33:06.242430+0000","last_clean":"2023-07-27T14:33:06.242430+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:33:06.242430+0000","last_undegraded":"2023-07-27T14:33:06.242430+0000","last_fullsized":"2023-07-27T14:33:06.242430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246269+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:33:06.246269+0000","last_peered":"2023-07-27T14:33:06.246269+0000","last_clean":"2023-07-27T14:33:06.246269+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:33:06.246269+0000","last_undegraded":"2023-07-27T14:33:06.246269+0000","last_fullsized":"2023-07-27T14:33:06.246269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.256703+0000","last_change":"2023-07-27T14:33:06.253647+0000","last_active":"2023-07-27T14:33:06.256703+0000","last_peered":"2023-07-27T14:33:06.256703+0000","last_clean":"2023-07-27T14:33:06.256703+0000","last_became_active":"2023-07-27T14:33:06.253379+0000","last_became_peered":"2023-07-27T14:33:06.253379+0000","last_unstale":"2023-07-27T14:33:06.256703+0000","last_undegraded":"2023-07-27T14:33:06.256703+0000","last_fullsized":"2023-07-27T14:33:06.256703+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246357+0000","last_change":"2023-07-27T14:33:05.792407+0000","last_active":"2023-07-27T14:33:06.246357+0000","last_peered":"2023-07-27T14:33:06.246357+0000","last_clean":"2023-07-27T14:33:06.246357+0000","last_became_active":"2023-07-27T14:33:05.792129+0000","last_became_peered":"2023-07-27T14:33:05.792129+0000","last_unstale":"2023-07-27T14:33:06.246357+0000","last_undegraded":"2023-07-27T14:33:06.246357+0000","last_fullsized":"2023-07-27T14:33:06.246357+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246354+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:33:06.246354+0000","last_peered":"2023-07-27T14:33:06.246354+0000","last_clean":"2023-07-27T14:33:06.246354+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:33:06.246354+0000","last_undegraded":"2023-07-27T14:33:06.246354+0000","last_fullsized":"2023-07-27T14:33:06.246354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261357+0000","last_change":"2023-07-27T14:33:06.259819+0000","last_active":"2023-07-27T14:33:06.261357+0000","last_peered":"2023-07-27T14:33:06.261357+0000","last_clean":"2023-07-27T14:33:06.261357+0000","last_became_active":"2023-07-27T14:33:06.259057+0000","last_became_peered":"2023-07-27T14:33:06.259057+0000","last_unstale":"2023-07-27T14:33:06.261357+0000","last_undegraded":"2023-07-27T14:33:06.261357+0000","last_fullsized":"2023-07-27T14:33:06.261357+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.243839+0000","last_change":"2023-07-27T14:33:05.798376+0000","last_active":"2023-07-27T14:33:06.243839+0000","last_peered":"2023-07-27T14:33:06.243839+0000","last_clean":"2023-07-27T14:33:06.243839+0000","last_became_active":"2023-07-27T14:33:05.798058+0000","last_became_peered":"2023-07-27T14:33:05.798058+0000","last_unstale":"2023-07-27T14:33:06.243839+0000","last_undegraded":"2023-07-27T14:33:06.243839+0000","last_fullsized":"2023-07-27T14:33:06.243839+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.246540+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:33:06.246540+0000","last_peered":"2023-07-27T14:33:06.246540+0000","last_clean":"2023-07-27T14:33:06.246540+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:33:06.246540+0000","last_undegraded":"2023-07-27T14:33:06.246540+0000","last_fullsized":"2023-07-27T14:33:06.246540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.257143+0000","last_change":"2023-07-27T14:33:06.254307+0000","last_active":"2023-07-27T14:33:06.257143+0000","last_peered":"2023-07-27T14:33:06.257143+0000","last_clean":"2023-07-27T14:33:06.257143+0000","last_became_active":"2023-07-27T14:33:06.254050+0000","last_became_peered":"2023-07-27T14:33:06.254050+0000","last_unstale":"2023-07-27T14:33:06.257143+0000","last_undegraded":"2023-07-27T14:33:06.257143+0000","last_fullsized":"2023-07-27T14:33:06.257143+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.264776+0000","last_change":"2023-07-27T14:33:05.801651+0000","last_active":"2023-07-27T14:33:06.264776+0000","last_peered":"2023-07-27T14:33:06.264776+0000","last_clean":"2023-07-27T14:33:06.264776+0000","last_became_active":"2023-07-27T14:33:05.801272+0000","last_became_peered":"2023-07-27T14:33:05.801272+0000","last_unstale":"2023-07-27T14:33:06.264776+0000","last_undegraded":"2023-07-27T14:33:06.264776+0000","last_fullsized":"2023-07-27T14:33:06.264776+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.247670+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:33:06.247670+0000","last_peered":"2023-07-27T14:33:06.247670+0000","last_clean":"2023-07-27T14:33:06.247670+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:33:06.247670+0000","last_undegraded":"2023-07-27T14:33:06.247670+0000","last_fullsized":"2023-07-27T14:33:06.247670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.261205+0000","last_change":"2023-07-27T14:33:06.258152+0000","last_active":"2023-07-27T14:33:06.261205+0000","last_peered":"2023-07-27T14:33:06.261205+0000","last_clean":"2023-07-27T14:33:06.261205+0000","last_became_active":"2023-07-27T14:33:06.257879+0000","last_became_peered":"2023-07-27T14:33:06.257879+0000","last_unstale":"2023-07-27T14:33:06.261205+0000","last_undegraded":"2023-07-27T14:33:06.261205+0000","last_fullsized":"2023-07-27T14:33:06.261205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:05.761423+0000","last_clean_scrub_stamp":"2023-07-27T14:33:05.761423+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.245080+0000","last_change":"2023-07-27T14:33:05.798340+0000","last_active":"2023-07-27T14:33:06.245080+0000","last_peered":"2023-07-27T14:33:06.245080+0000","last_clean":"2023-07-27T14:33:06.245080+0000","last_became_active":"2023-07-27T14:33:05.798050+0000","last_became_peered":"2023-07-27T14:33:05.798050+0000","last_unstale":"2023-07-27T14:33:06.245080+0000","last_undegraded":"2023-07-27T14:33:06.245080+0000","last_fullsized":"2023-07-27T14:33:06.245080+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:04.758800+0000","last_clean_scrub_stamp":"2023-07-27T14:33:04.758800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-27T14:33:06.248419+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:33:06.248419+0000","last_peered":"2023-07-27T14:33:06.248419+0000","last_clean":"2023-07-27T14:33:06.248419+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:33:06.248419+0000","last_undegraded":"2023-07-27T14:33:06.248419+0000","last_fullsized":"2023-07-27T14:33:06.248419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14688,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357152,"statfs":{"total":96636764160,"available":96621723648,"internally_reserved":0,"allocated":1400832,"data_stored":652210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.627,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.96599999999999997,"15min":1.133},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.67500000000000004},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.0589999999999999,"15min":1.1180000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.72599999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.90700000000000003,"5min":0.96999999999999997,"15min":1.1459999999999999},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.90000000000000002,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66700000000000004,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.119},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.069,"15min":1.069},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.55300000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85799999999999998,"5min":0.92800000000000005,"15min":1.165},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61499999999999999,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.746},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97899999999999998,"15min":1.0249999999999999},"last":0.626}]},{"osd":5,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86199999999999999,"5min":1.202,"15min":1.202},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.70399999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.999,"5min":1.028,"15min":1.0409999999999999},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14452,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357388,"statfs":{"total":96636764160,"available":96621965312,"internally_reserved":0,"allocated":1421312,"data_stored":659490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86399999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.746},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.45700000000000002,"5min":0.44900000000000001,"15min":0.42999999999999999},"max":{"1min":0.92900000000000005,"5min":1.2,"15min":1.2},"last":0.63},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.66300000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.496}]},{"osd":4,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.745,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.079},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.67800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.0309999999999999,"15min":1.198},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.84199999999999997,"5min":0.92200000000000004,"15min":0.94099999999999995},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.748,"15min":0.74099999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.1000000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":0.76100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17004,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94354836,"statfs":{"total":96636764160,"available":96619352064,"internally_reserved":0,"allocated":1413120,"data_stored":653670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.51400000000000001},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55100000000000005,"5min":0.65500000000000003,"15min":4.75},"last":0.442},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.66400000000000003},"min":{"1min":0.26900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64100000000000001,"5min":0.70199999999999996,"15min":9.3100000000000005},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.56000000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.55600000000000005,"5min":0.67500000000000004,"15min":3.7210000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.53500000000000003},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.59099999999999997,"5min":0.79700000000000004,"15min":2.7160000000000002},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46600000000000003,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":3.8580000000000001},"last":0.495}]},{"osd":4,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97999999999999998,"5min":1.2010000000000001,"15min":2.181},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":1.127,"15min":2.4180000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":3.7440000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1040000000000001,"15min":2.149},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69699999999999995,"15min":0.74099999999999999},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":0.85499999999999998,"5min":1.032,"15min":2.052},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69499999999999995,"15min":0.84999999999999998},"min":{"1min":0.51800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.23,"15min":6.1980000000000004},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.103,"15min":2.016},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.002,"5min":1.087,"15min":3.7799999999999998},"last":0.69999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14440,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357400,"statfs":{"total":96636764160,"available":96621977600,"internally_reserved":0,"allocated":1409024,"data_stored":652854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.52300000000000002,"5min":0.58299999999999996,"15min":0.79500000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.24399999999999999},"max":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.37}]},{"osd":2,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.42599999999999999},"min":{"1min":0.32000000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.41599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55400000000000005,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.085,"5min":1.28,"15min":1.28},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95199999999999996,"5min":1.25,"15min":1.25},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.54100000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90700000000000003,"5min":1.22,"15min":1.22},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":0.93799999999999994,"5min":1.244,"15min":1.244},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55800000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0029999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.71099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18032,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":16640,"kb_avail":94353808,"statfs":{"total":96636764160,"available":96618299392,"internally_reserved":0,"allocated":1417216,"data_stored":658928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17039360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60099999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.601,"5min":5.601,"15min":5.601},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45400000000000001,"15min":0.48199999999999998},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70799999999999996,"5min":0.81100000000000005,"15min":0.83499999999999996},"last":0.434},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.53700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.05,"5min":0.76400000000000001,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":6.9660000000000002,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.97099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.75700000000000001,"15min":0.77800000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.1360000000000001,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":1.016}]},{"osd":7,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.131},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.087}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15144,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356696,"statfs":{"total":96636764160,"available":96621256704,"internally_reserved":0,"allocated":1409024,"data_stored":658824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39300000000000002},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.52100000000000002,"5min":1.302,"15min":1.302},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.45000000000000001},"min":{"1min":0.32700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59299999999999997,"5min":0.748,"15min":0.88900000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.47399999999999998,"15min":0.44500000000000001},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2749999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.438}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.149},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.54300000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.111,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.51000000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91200000000000003,"5min":1.232,"15min":1.232},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1639999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.45200000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.298},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":1.0209999999999999,"5min":1.343,"15min":1.343},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.78100000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78600000000000003,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.49299999999999999},"max":{"1min":1.1020000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14180,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":12800,"kb_avail":94357660,"statfs":{"total":96636764160,"available":96622243840,"internally_reserved":0,"allocated":1404928,"data_stored":653034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13107200},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.52500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85599999999999998,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.627},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79000000000000004,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.495,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81399999999999995,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.753},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":4.476,"15min":4.476},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88900000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.497,"15min":0.49199999999999999},"max":{"1min":0.93000000000000005,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66600000000000004,"15min":0.621},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.66200000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0029999999999999,"5min":5.194,"15min":5.194},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94799999999999995,"5min":2.819,"15min":2.819},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0389999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.84299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15852,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":14464,"kb_avail":94355988,"statfs":{"total":96636764160,"available":96620531712,"internally_reserved":0,"allocated":1413120,"data_stored":659378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14811136},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86199999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72299999999999998,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.754},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.68500000000000005},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.91900000000000004,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":1.581,"15min":1.581},"last":0.623},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69999999999999996,"15min":0.66200000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98899999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":0.93100000000000005,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96099999999999997,"5min":1.978,"15min":1.978},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67700000000000005,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.88800000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85399999999999998,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92300000000000004,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:33:10.984 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:33:10.984 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:33:11.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.174+0000 7f93905ff700 1 Processor -- start 2023-07-27T14:33:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.174+0000 7f93905ff700 1 -- start start 2023-07-27T14:33:11.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.175+0000 7f93905ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388063260 0x7f9388154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.175+0000 7f93905ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93881553f0 con 0x7f938814ae00 2023-07-27T14:33:11.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.175+0000 7f93905ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9388157a50 con 0x7f938814b1e0 2023-07-27T14:33:11.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.175+0000 7f93905ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9388157d10 con 0x7f9388063260 2023-07-27T14:33:11.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.175+0000 7f938e39b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f938814ae00 0x7f9388062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:37160/0 (socket says 172.21.15.115:37160) 2023-07-27T14:33:11.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.175+0000 7f938e39b700 1 -- 172.21.15.115:0/3805365300 learned_addr learned my addr 172.21.15.115:0/3805365300 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:11.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938db9a700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388063260 0x7f9388154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862470569 0 0) 0x7f93881553f0 con 0x7f938814ae00 2023-07-27T14:33:11.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93740033f0 con 0x7f938814ae00 2023-07-27T14:33:11.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171651727 0 0) 0x7f93740033f0 con 0x7f938814ae00 2023-07-27T14:33:11.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388063260 msgr2=0x7f9388154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:11.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388063260 0x7f9388154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 >> v1:172.21.15.159:6789/0 conn(0x7f938814b1e0 legacy=0x7f93880a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388157ff0 con 0x7f938814ae00 2023-07-27T14:33:11.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f9384001470 con 0x7f938814ae00 2023-07-27T14:33:11.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 >> v1:172.21.15.115:6789/0 conn(0x7f938814ae00 legacy=0x7f9388062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374003910 0x7f9374003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.176+0000 7f938d399700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388063260 0x7f9374004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938d399700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9374004b80 0x7f9374005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9388157d10 con 0x7f9374004b80 2023-07-27T14:33:11.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937400b8e0 con 0x7f9374003910 2023-07-27T14:33:11.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937400ba50 con 0x7f9388063260 2023-07-27T14:33:11.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938eb9c700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9374004b80 0x7f9374005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938db9a700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388063260 0x7f9374004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938e39b700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374003910 0x7f9374003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938eb9c700 1 -- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388063260 msgr2=0x7f9374004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:11.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938eb9c700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388063260 0x7f9374004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938eb9c700 1 -- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374003910 msgr2=0x7f9374003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:11.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938eb9c700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374003910 0x7f9374003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938eb9c700 1 -- 172.21.15.115:0/3805365300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93740033f0 con 0x7f9374004b80 2023-07-27T14:33:11.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938eb9c700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9374004b80 0x7f9374005000 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f9380001f20 tx=0x7f9380007f10).ready entity=mon.0 client_cookie=5373b267d3be2643 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:11.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.177+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93800017e0 con 0x7f9374004b80 2023-07-27T14:33:11.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938000c670 con 0x7f9374004b80 2023-07-27T14:33:11.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f938d399700 1 -- 172.21.15.115:0/3805365300 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938000c9f0 con 0x7f9374004b80 2023-07-27T14:33:11.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f93905ff700 1 -- 172.21.15.115:0/3805365300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9374004b80 msgr2=0x7f9374005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f93905ff700 1 --2- 172.21.15.115:0/3805365300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9374004b80 0x7f9374005000 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f9380001f20 tx=0x7f9380007f10).stop 2023-07-27T14:33:11.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f938eb9c700 1 -- 172.21.15.115:0/3805365300 reap_dead start 2023-07-27T14:33:11.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f93905ff700 1 -- 172.21.15.115:0/3805365300 shutdown_connections 2023-07-27T14:33:11.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f93905ff700 1 -- 172.21.15.115:0/3805365300 >> 172.21.15.115:0/3805365300 conn(0x7f938805e940 msgr2=0x7f93880cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:11.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f93905ff700 1 -- 172.21.15.115:0/3805365300 shutdown_connections 2023-07-27T14:33:11.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.178+0000 7f93905ff700 1 -- 172.21.15.115:0/3805365300 wait complete. 2023-07-27T14:33:11.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.180+0000 7f93905ff700 1 Processor -- start 2023-07-27T14:33:11.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.181+0000 7f93905ff700 1 -- start start 2023-07-27T14:33:11.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f93905ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374004b80 0x7f93880c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f93905ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93880abec0 0x7f93880adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f93905ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388154450 0x7f93881548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f93905ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9388154da0 con 0x7f93880abec0 2023-07-27T14:33:11.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f93905ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93880ae460 con 0x7f9374004b80 2023-07-27T14:33:11.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f93905ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93880ae740 con 0x7f9388154450 2023-07-27T14:33:11.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938db9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93880abec0 0x7f93880adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938db9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93880abec0 0x7f93880adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54668/0 (socket says 172.21.15.115:54668) 2023-07-27T14:33:11.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938db9a700 1 -- 172.21.15.115:0/1044995870 learned_addr learned my addr 172.21.15.115:0/1044995870 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:11.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938eb9c700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388154450 0x7f93881548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938e39b700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374004b80 0x7f93880c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938db9a700 1 -- 172.21.15.115:0/1044995870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388154450 msgr2=0x7f93881548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938db9a700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388154450 0x7f93881548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938db9a700 1 -- 172.21.15.115:0/1044995870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374004b80 msgr2=0x7f93880c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938db9a700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374004b80 0x7f93880c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.182+0000 7f938db9a700 1 -- 172.21.15.115:0/1044995870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93880aea20 con 0x7f93880abec0 2023-07-27T14:33:11.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.183+0000 7f938db9a700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93880abec0 0x7f93880adb60 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f93780119f0 tx=0x7f9378009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:11.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.183+0000 7f937e7fc700 1 -- 172.21.15.115:0/1044995870 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937800f940 con 0x7f93880abec0 2023-07-27T14:33:11.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.183+0000 7f937e7fc700 1 -- 172.21.15.115:0/1044995870 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937800faa0 con 0x7f93880abec0 2023-07-27T14:33:11.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.183+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93880aed00 con 0x7f93880abec0 2023-07-27T14:33:11.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.183+0000 7f937e7fc700 1 -- 172.21.15.115:0/1044995870 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937800fe20 con 0x7f93880abec0 2023-07-27T14:33:11.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.183+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93880c4de0 con 0x7f93880abec0 2023-07-27T14:33:11.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.184+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938806c470 con 0x7f93880abec0 2023-07-27T14:33:11.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.185+0000 7f937e7fc700 1 -- 172.21.15.115:0/1044995870 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f9378014650 con 0x7f93880abec0 2023-07-27T14:33:11.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.185+0000 7f937e7fc700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936c05f4e0 0x7f936c0619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.186+0000 7f937e7fc700 1 -- 172.21.15.115:0/1044995870 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f937807ae60 con 0x7f93880abec0 2023-07-27T14:33:11.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.186+0000 7f938e39b700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936c05f4e0 0x7f936c0619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.186+0000 7f938e39b700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936c05f4e0 0x7f936c0619a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f9384000e10 tx=0x7f9384009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:11.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.190+0000 7f937e7fc700 1 -- 172.21.15.115:0/1044995870 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f937804bba0 con 0x7f93880abec0 2023-07-27T14:33:11.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.425+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f93880c0140 con 0x7f93880abec0 2023-07-27T14:33:11.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.429+0000 7f937e7fc700 1 -- 172.21.15.115:0/1044995870 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9378018070 con 0x7f93880abec0 2023-07-27T14:33:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.431+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936c05f4e0 msgr2=0x7f936c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936c05f4e0 0x7f936c0619a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f9384000e10 tx=0x7f9384009040).stop 2023-07-27T14:33:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93880abec0 msgr2=0x7f93880adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93880abec0 0x7f93880adb60 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f93780119f0 tx=0x7f9378009060).stop 2023-07-27T14:33:11.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 shutdown_connections 2023-07-27T14:33:11.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f936c05f4e0 0x7f936c0619a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9388154450 0x7f93881548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9374004b80 0x7f93880c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 --2- 172.21.15.115:0/1044995870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93880abec0 0x7f93880adb60 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 >> 172.21.15.115:0/1044995870 conn(0x7f938805e940 msgr2=0x7f93880ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:11.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 shutdown_connections 2023-07-27T14:33:11.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.432+0000 7f93905ff700 1 -- 172.21.15.115:0/1044995870 wait complete. 2023-07-27T14:33:11.471 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:33:11.486 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.637+0000 7fd00dfff700 1 Processor -- start 2023-07-27T14:33:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.638+0000 7fd00dfff700 1 -- start start 2023-07-27T14:33:11.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd00dfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd008151bd0 0x7fd008062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd00dfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd008062810 0x7fd0080a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd00dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0080a4d30 0x7fd008157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd00dfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd008137610 con 0x7fd008151bd0 2023-07-27T14:33:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd00dfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0080639d0 con 0x7fd008062810 2023-07-27T14:33:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd00dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080a51c0 con 0x7fd0080a4d30 2023-07-27T14:33:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd0077fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd008151bd0 0x7fd008062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd0077fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd008151bd0 0x7fd008062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54680/0 (socket says 172.21.15.115:54680) 2023-07-27T14:33:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd0077fe700 1 -- 172.21.15.115:0/1208986305 learned_addr learned my addr 172.21.15.115:0/1208986305 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd006ffd700 1 --2- 172.21.15.115:0/1208986305 >> v2:172.21.15.159:3300/0 conn(0x7fd008062810 0x7fd0080a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.639+0000 7fd007fff700 1 --2- 172.21.15.115:0/1208986305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0080a4d30 0x7fd008157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0077fe700 1 -- 172.21.15.115:0/1208986305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0080a4d30 msgr2=0x7fd008157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0077fe700 1 --2- 172.21.15.115:0/1208986305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0080a4d30 0x7fd008157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0077fe700 1 -- 172.21.15.115:0/1208986305 >> v2:172.21.15.159:3300/0 conn(0x7fd008062810 msgr2=0x7fd0080a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0077fe700 1 --2- 172.21.15.115:0/1208986305 >> v2:172.21.15.159:3300/0 conn(0x7fd008062810 0x7fd0080a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0077fe700 1 -- 172.21.15.115:0/1208986305 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008062dc0 con 0x7fd008151bd0 2023-07-27T14:33:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0077fe700 1 --2- 172.21.15.115:0/1208986305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd008151bd0 0x7fd008062320 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fd0080be140 tx=0x7fcff80090f0).ready entity=mon.0 client_cookie=b40d407953d59580 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0067fc700 1 -- 172.21.15.115:0/1208986305 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff800f510 con 0x7fd008151bd0 2023-07-27T14:33:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0067fc700 1 -- 172.21.15.115:0/1208986305 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff800f670 con 0x7fd008151bd0 2023-07-27T14:33:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.640+0000 7fd0067fc700 1 -- 172.21.15.115:0/1208986305 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff800fa10 con 0x7fd008151bd0 2023-07-27T14:33:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 -- 172.21.15.115:0/1208986305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd008151bd0 msgr2=0x7fd008062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 --2- 172.21.15.115:0/1208986305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd008151bd0 0x7fd008062320 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7fd0080be140 tx=0x7fcff80090f0).stop 2023-07-27T14:33:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 -- 172.21.15.115:0/1208986305 shutdown_connections 2023-07-27T14:33:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 --2- 172.21.15.115:0/1208986305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0080a4d30 0x7fd008157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 --2- 172.21.15.115:0/1208986305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd008151bd0 0x7fd008062320 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 --2- 172.21.15.115:0/1208986305 >> v2:172.21.15.159:3300/0 conn(0x7fd008062810 0x7fd0080a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 -- 172.21.15.115:0/1208986305 >> 172.21.15.115:0/1208986305 conn(0x7fd008064700 msgr2=0x7fd008064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 -- 172.21.15.115:0/1208986305 shutdown_connections 2023-07-27T14:33:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.641+0000 7fd00dfff700 1 -- 172.21.15.115:0/1208986305 wait complete. 2023-07-27T14:33:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.642+0000 7fd00dfff700 1 Processor -- start 2023-07-27T14:33:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.642+0000 7fd00dfff700 1 -- start start 2023-07-27T14:33:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.643+0000 7fd00dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd008062810 0x7fd0081362a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.643+0000 7fd00dfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0080a4d30 0x7fd00813c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.643+0000 7fd00dfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd008151bd0 0x7fd00813c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.643+0000 7fd00dfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd008136790 con 0x7fd0080a4d30 2023-07-27T14:33:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.643+0000 7fd00dfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00813cbb0 con 0x7fd008151bd0 2023-07-27T14:33:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.643+0000 7fd00dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00813ce90 con 0x7fd008062810 2023-07-27T14:33:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0080a4d30 0x7fd00813c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0080a4d30 0x7fd00813c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54688/0 (socket says 172.21.15.115:54688) 2023-07-27T14:33:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 -- 172.21.15.115:0/396914847 learned_addr learned my addr 172.21.15.115:0/396914847 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd0077fe700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd008062810 0x7fd0081362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd007fff700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd008151bd0 0x7fd00813c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 -- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd008062810 msgr2=0x7fd0081362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd008062810 0x7fd0081362a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 -- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd008151bd0 msgr2=0x7fd00813c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd008151bd0 0x7fd00813c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 -- 172.21.15.115:0/396914847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8009370 con 0x7fd0080a4d30 2023-07-27T14:33:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd007fff700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd008151bd0 0x7fd00813c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd006ffd700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0080a4d30 0x7fd00813c130 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7fcffc00e900 tx=0x7fcffc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fcfef7fe700 1 -- 172.21.15.115:0/396914847 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00c640 con 0x7fd0080a4d30 2023-07-27T14:33:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fcfef7fe700 1 -- 172.21.15.115:0/396914847 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc00c7a0 con 0x7fd0080a4d30 2023-07-27T14:33:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00813d170 con 0x7fd0080a4d30 2023-07-27T14:33:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.644+0000 7fcfef7fe700 1 -- 172.21.15.115:0/396914847 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00cb20 con 0x7fd0080a4d30 2023-07-27T14:33:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.645+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00813d730 con 0x7fd0080a4d30 2023-07-27T14:33:11.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.646+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00813daa0 con 0x7fd0080a4d30 2023-07-27T14:33:11.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.646+0000 7fcfef7fe700 1 -- 172.21.15.115:0/396914847 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fcffc022070 con 0x7fd0080a4d30 2023-07-27T14:33:11.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.647+0000 7fcfef7fe700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcff405f4e0 0x7fcff40619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:11.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.647+0000 7fcfef7fe700 1 -- 172.21.15.115:0/396914847 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcffc07aa10 con 0x7fd0080a4d30 2023-07-27T14:33:11.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.647+0000 7fd0077fe700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcff405f4e0 0x7fcff40619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:11.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.648+0000 7fd0077fe700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcff405f4e0 0x7fcff40619a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fd0080be140 tx=0x7fcff8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:11.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.651+0000 7fcfef7fe700 1 -- 172.21.15.115:0/396914847 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcffc04b750 con 0x7fd0080a4d30 2023-07-27T14:33:11.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.863+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd00806c470 con 0x7fd0080a4d30 2023-07-27T14:33:11.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.863+0000 7fcfef7fe700 1 -- 172.21.15.115:0/396914847 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fcffc016070 con 0x7fd0080a4d30 2023-07-27T14:33:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:11.901 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1059927938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1059927938},{"type":"v1","addr":"172.21.15.159:6834","nonce":1059927938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2712836683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2712836683},{"type":"v1","addr":"172.21.15.159:6835","nonce":2712836683}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2509102546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2509102546},{"type":"v1","addr":"172.21.15.115:6836","nonce":2509102546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:06.232999+0000","modified":"2023-07-27T14:33:09.243791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7410":{"gid":7410,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2904047998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2904047998},{"type":"v1","addr":"172.21.15.115:6837","nonce":2904047998}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-07-27T14:33:11.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcff405f4e0 msgr2=0x7fcff40619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcff405f4e0 0x7fcff40619a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fd0080be140 tx=0x7fcff8017000).stop 2023-07-27T14:33:11.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0080a4d30 msgr2=0x7fd00813c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:11.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0080a4d30 0x7fd00813c130 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7fcffc00e900 tx=0x7fcffc009060).stop 2023-07-27T14:33:11.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 shutdown_connections 2023-07-27T14:33:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcff405f4e0 0x7fcff40619a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd008151bd0 0x7fd00813c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd008062810 0x7fd0081362a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 --2- 172.21.15.115:0/396914847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0080a4d30 0x7fd00813c130 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.865+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 >> 172.21.15.115:0/396914847 conn(0x7fd008064700 msgr2=0x7fd0080c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.866+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 shutdown_connections 2023-07-27T14:33:11.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:11.866+0000 7fd00dfff700 1 -- 172.21.15.115:0/396914847 wait complete. 2023-07-27T14:33:11.905 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 59 2023-07-27T14:33:12.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:33:06.232999+0000', 'modified': '2023-07-27T14:33:09.243791+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7410}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7410': {'gid': 7410, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6837/2904047998', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 2904047998}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 2904047998}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:33:12.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:33:12.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-27T14:33:12.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.477+0000 7f44eb5ff700 1 Processor -- start 2023-07-27T14:33:12.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.477+0000 7f44eb5ff700 1 -- start start 2023-07-27T14:33:12.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.478+0000 7f44eb5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f44e4153ec0 0x7f44e40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.478+0000 7f44eb5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f44e40aaa40 0x7f44e40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.478+0000 7f44eb5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e40aa4d0 con 0x7f44e40aa050 2023-07-27T14:33:12.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.478+0000 7f44eb5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e40c05c0 con 0x7f44e40aaa40 2023-07-27T14:33:12.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.478+0000 7f44eb5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e40bfc90 con 0x7f44e4153ec0 2023-07-27T14:33:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e9b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f44e40aaa40 0x7f44e40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e9b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f44e40aaa40 0x7f44e40c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54694/0 (socket says 172.21.15.115:54694) 2023-07-27T14:33:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e9b9c700 1 -- 172.21.15.115:0/3208711060 learned_addr learned my addr 172.21.15.115:0/3208711060 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e939b700 1 --2- 172.21.15.115:0/3208711060 >> v2:172.21.15.159:3300/0 conn(0x7f44e4153ec0 0x7f44e40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e9b9c700 1 -- 172.21.15.115:0/3208711060 >> v2:172.21.15.159:3300/0 conn(0x7f44e4153ec0 msgr2=0x7f44e40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/3208711060 >> v2:172.21.15.159:3300/0 conn(0x7f44e4153ec0 0x7f44e40a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e9b9c700 1 -- 172.21.15.115:0/3208711060 >> v1:172.21.15.159:6789/0 conn(0x7f44e40aa050 legacy=0x7f44e40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e9b9c700 1 -- 172.21.15.115:0/3208711060 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40bff70 con 0x7f44e40aaa40 2023-07-27T14:33:12.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/3208711060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c0a50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f44e4083e30 tx=0x7f44dc009840).ready entity=mon.0 client_cookie=62c5729196b5401e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.479+0000 7f44dbfff700 1 -- 172.21.15.115:0/3208711060 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00e070 con 0x7f44e40aaa40 2023-07-27T14:33:12.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44dbfff700 1 -- 172.21.15.115:0/3208711060 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00ba10 con 0x7f44e40aaa40 2023-07-27T14:33:12.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44dbfff700 1 -- 172.21.15.115:0/3208711060 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00bd90 con 0x7f44e40aaa40 2023-07-27T14:33:12.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3208711060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 msgr2=0x7f44e40c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3208711060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c0a50 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f44e4083e30 tx=0x7f44dc009840).stop 2023-07-27T14:33:12.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3208711060 shutdown_connections 2023-07-27T14:33:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3208711060 >> v2:172.21.15.159:3300/0 conn(0x7f44e4153ec0 0x7f44e40a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3208711060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c0a50 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3208711060 >> 172.21.15.115:0/3208711060 conn(0x7f44e40cb610 msgr2=0x7f44e40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3208711060 shutdown_connections 2023-07-27T14:33:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.480+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3208711060 wait complete. 2023-07-27T14:33:12.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.482+0000 7f44eb5ff700 1 Processor -- start 2023-07-27T14:33:12.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.482+0000 7f44eb5ff700 1 -- start start 2023-07-27T14:33:12.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44eb5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44e40aa050 0x7f44e414e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44eb5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44eb5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44e4153ec0 0x7f44e40c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44eb5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40c90b0 con 0x7f44e40aaa40 2023-07-27T14:33:12.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44eb5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40afa80 con 0x7f44e4153ec0 2023-07-27T14:33:12.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44eb5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e4152520 con 0x7f44e40aa050 2023-07-27T14:33:12.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44e8b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44e8b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54708/0 (socket says 172.21.15.115:54708) 2023-07-27T14:33:12.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44e8b9a700 1 -- 172.21.15.115:0/3888783540 learned_addr learned my addr 172.21.15.115:0/3888783540 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:12.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44e939b700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44e40aa050 0x7f44e414e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.483+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44e4153ec0 0x7f44e40c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44e8b9a700 1 -- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44e40aa050 msgr2=0x7f44e414e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44e40aa050 0x7f44e414e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44e8b9a700 1 -- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44e4153ec0 msgr2=0x7f44e40c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44e4153ec0 0x7f44e40c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44e8b9a700 1 -- 172.21.15.115:0/3888783540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc009ae0 con 0x7f44e40aaa40 2023-07-27T14:33:12.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44e4153ec0 0x7f44e40c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:12.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c86d0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f44d400c440 tx=0x7f44d4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44d97fa700 1 -- 172.21.15.115:0/3888783540 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400cea0 con 0x7f44e40aaa40 2023-07-27T14:33:12.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44d97fa700 1 -- 172.21.15.115:0/3888783540 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400f470 con 0x7f44e40aaa40 2023-07-27T14:33:12.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3888783540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e4152800 con 0x7f44e40aaa40 2023-07-27T14:33:12.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44d97fa700 1 -- 172.21.15.115:0/3888783540 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400f810 con 0x7f44e40aaa40 2023-07-27T14:33:12.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.484+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3888783540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e4152dc0 con 0x7f44e40aaa40 2023-07-27T14:33:12.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.486+0000 7f44d97fa700 1 -- 172.21.15.115:0/3888783540 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f44d4019030 con 0x7f44e40aaa40 2023-07-27T14:33:12.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.487+0000 7f44d97fa700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44c805f4e0 0x7f44c80619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.487+0000 7f44d97fa700 1 -- 172.21.15.115:0/3888783540 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f44d4079990 con 0x7f44e40aaa40 2023-07-27T14:33:12.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.487+0000 7f44e939b700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44c805f4e0 0x7f44c80619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.488+0000 7f44e939b700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44c805f4e0 0x7f44c80619a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f44e000bb10 tx=0x7f44e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.489+0000 7f45028f5b80 1 Processor -- start 2023-07-27T14:33:12.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.489+0000 7f45028f5b80 1 -- start start 2023-07-27T14:33:12.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.490+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.490+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da25830 0x557e0da4bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.490+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0da4c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.490+0000 7f45028f5b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e0d93a9c0 con 0x557e0d9fd5c0 2023-07-27T14:33:12.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.490+0000 7f45028f5b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e0d94fcc0 con 0x557e0da25830 2023-07-27T14:33:12.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.490+0000 7f45028f5b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e0d916e10 con 0x557e0d9fff60 2023-07-27T14:33:12.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54716/0 (socket says 172.21.15.115:54716) 2023-07-27T14:33:12.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 -- 172.21.15.115:0/2169118739 learned_addr learned my addr 172.21.15.115:0/2169118739 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:12.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0da4c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da25830 0x557e0da4bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 -- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 msgr2=0x557e0da4c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0da4c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 -- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da25830 msgr2=0x557e0da4bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da25830 0x557e0da4bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 -- 172.21.15.115:0/2169118739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e0d9489a0 con 0x557e0d9fd5c0 2023-07-27T14:33:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da25830 0x557e0da4bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44e939b700 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fd9a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f44e0010a60 tx=0x7f44e0015000).ready entity=mon.0 client_cookie=f4aaf262b37686b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44ce1fe700 1 -- 172.21.15.115:0/2169118739 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0014b10 con 0x557e0d9fd5c0 2023-07-27T14:33:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44ce1fe700 1 -- 172.21.15.115:0/2169118739 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0014c70 con 0x557e0d9fd5c0 2023-07-27T14:33:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.491+0000 7f44ce1fe700 1 -- 172.21.15.115:0/2169118739 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e001f400 con 0x557e0d9fd5c0 2023-07-27T14:33:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 -- 172.21.15.115:0/2169118739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 msgr2=0x557e0d9fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fd9a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f44e0010a60 tx=0x7f44e0015000).stop 2023-07-27T14:33:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 -- 172.21.15.115:0/2169118739 shutdown_connections 2023-07-27T14:33:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0da4c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fd9a0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 --2- 172.21.15.115:0/2169118739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da25830 0x557e0da4bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 -- 172.21.15.115:0/2169118739 >> 172.21.15.115:0/2169118739 conn(0x557e0d868940 msgr2=0x557e0da466f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:12.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 -- 172.21.15.115:0/2169118739 shutdown_connections 2023-07-27T14:33:12.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.492+0000 7f45028f5b80 1 -- 172.21.15.115:0/2169118739 wait complete. 2023-07-27T14:33:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.493+0000 7f45028f5b80 1 -- start start 2023-07-27T14:33:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.493+0000 7f45028f5b80 1 Processor -- start 2023-07-27T14:33:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fd5c0 0x557e0da55ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fff60 0x557e0da233e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 0x557e0da238d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f45028f5b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e0da23dc0 con 0x557e0d9fff60 2023-07-27T14:33:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f45028f5b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e0da27c60 con 0x557e0da51fd0 2023-07-27T14:33:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f45028f5b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e0da524b0 con 0x557e0d9fd5c0 2023-07-27T14:33:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f45028f5b80 10 client.0 ll_register_callbacks cb 0x557e0d9024a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:33:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f44e8b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fff60 0x557e0da233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f44e8b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fff60 0x557e0da233e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54718/0 (socket says 172.21.15.115:54718) 2023-07-27T14:33:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.494+0000 7f44e8b9a700 1 -- 172.21.15.115:0/799168719 learned_addr learned my addr 172.21.15.115:0/799168719 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 0x557e0da238d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44e939b700 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fd5c0 0x557e0da55ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44e8b9a700 1 -- 172.21.15.115:0/799168719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fd5c0 msgr2=0x557e0da55ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fd5c0 0x557e0da55ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44e8b9a700 1 -- 172.21.15.115:0/799168719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 msgr2=0x557e0da238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 0x557e0da238d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44e8b9a700 1 -- 172.21.15.115:0/799168719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e000e040 con 0x557e0d9fff60 2023-07-27T14:33:12.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fff60 0x557e0da233e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f44d400c410 tx=0x7f44d400f000).ready entity=mon.0 client_cookie=a1af41206afee649 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:33:12.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44c37fe700 1 -- 172.21.15.115:0/799168719 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4053070 con 0x557e0d9fff60 2023-07-27T14:33:12.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f45028f5b80 1 -- 172.21.15.115:0/799168719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e0d9f7d50 con 0x557e0d9fff60 2023-07-27T14:33:12.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44c37fe700 1 -- 172.21.15.115:0/799168719 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f44d404dc50 con 0x557e0d9fff60 2023-07-27T14:33:12.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f44c37fe700 1 -- 172.21.15.115:0/799168719 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44d4079040 con 0x557e0d9fff60 2023-07-27T14:33:12.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f45028f5b80 10 client.7551 fetch_fsmap learned FSMap version 59 2023-07-27T14:33:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.495+0000 7f45028f5b80 1 -- 172.21.15.115:0/799168719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x557e0d944190 con 0x557e0d9fff60 2023-07-27T14:33:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f44c37fe700 1 -- 172.21.15.115:0/799168719 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557e0d9f7d50 con 0x557e0d9fff60 2023-07-27T14:33:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f44c37fe700 1 -- 172.21.15.115:0/799168719 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 59) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f44d404a550 con 0x557e0d9fff60 2023-07-27T14:33:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f45028f5b80 10 client.7551 fetch_fsmap finished waiting for FSMap version 59 2023-07-27T14:33:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f45028f5b80 10 client.7551 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:33:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f45028f5b80 20 client.7551 populate_metadata read hostname 'smithi115' 2023-07-27T14:33:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f45028f5b80 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] conn(0x557e0da40340 0x557e0da40890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f45028f5b80 4 client.7551 mds_command: new command op to 7410 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:33:12.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f45028f5b80 1 -- 172.21.15.115:0/799168719 --> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e0d7b8ef0 con 0x557e0da40340 2023-07-27T14:33:12.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f44e939b700 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] conn(0x557e0da40340 0x557e0da40890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f44e939b700 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] conn(0x557e0da40340 0x557e0da40890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b1587d2a0ba36f3e server_cookie=ad773d94a8fd898c in_seq=0 out_seq=0 2023-07-27T14:33:12.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.496+0000 7f44c37fe700 10 client.7551 ms_handle_connect on v2:172.21.15.115:6835/2904047998 2023-07-27T14:33:12.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.497+0000 7f44c37fe700 1 -- 172.21.15.115:0/799168719 <== mds.0 v2:172.21.15.115:6835/2904047998 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x557e0d7b8ef0 con 0x557e0da40340 2023-07-27T14:33:12.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.497+0000 7f44c37fe700 10 client.7551 handle_command_reply: tid=0 2023-07-27T14:33:12.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.497+0000 7f45028f5b80 1 client.7551 shutdown 2023-07-27T14:33:12.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.497+0000 7f45028f5b80 1 -- 172.21.15.115:0/799168719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fff60 msgr2=0x557e0da233e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.497+0000 7f45028f5b80 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fff60 0x557e0da233e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f44d400c410 tx=0x7f44d400f000).stop 2023-07-27T14:33:12.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 1 -- 172.21.15.115:0/799168719 shutdown_connections 2023-07-27T14:33:12.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] conn(0x557e0da40340 0x557e0da40890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 0x557e0da238d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fd5c0 0x557e0da55ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f44c37fe700 0 client.7551 ms_handle_reset on v2:172.21.15.115:6835/2904047998 2023-07-27T14:33:12.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 1 --2- 172.21.15.115:0/799168719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fff60 0x557e0da233e0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 1 -- 172.21.15.115:0/799168719 >> 172.21.15.115:0/799168719 conn(0x557e0d868940 msgr2=0x557e0da46560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:12.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 1 -- 172.21.15.115:0/799168719 shutdown_connections 2023-07-27T14:33:12.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 1 -- 172.21.15.115:0/799168719 wait complete. 2023-07-27T14:33:12.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.498+0000 7f45028f5b80 20 client.7551 trim_cache size 0 max 16384 2023-07-27T14:33:12.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.515+0000 7f45028f5b80 1 Processor -- start 2023-07-27T14:33:12.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.515+0000 7f45028f5b80 1 -- start start 2023-07-27T14:33:12.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0d9fe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0da51fd0 0x557e0da44e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f45028f5b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e0da23050 con 0x557e0da51fd0 2023-07-27T14:33:12.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f45028f5b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e0da55e20 con 0x557e0d9fd5c0 2023-07-27T14:33:12.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f45028f5b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e0da52cc0 con 0x557e0d9fff60 2023-07-27T14:33:12.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f44e9b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0da51fd0 0x557e0da44e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f44e9b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0da51fd0 0x557e0da44e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54732/0 (socket says 172.21.15.115:54732) 2023-07-27T14:33:12.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.516+0000 7f44e9b9c700 1 -- 172.21.15.115:0/3452593378 learned_addr learned my addr 172.21.15.115:0/3452593378 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:12.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44e939b700 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0d9fe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44e9b9c700 1 -- 172.21.15.115:0/3452593378 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 msgr2=0x557e0d9fe270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0d9fe270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44e9b9c700 1 -- 172.21.15.115:0/3452593378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0d9fd5c0 msgr2=0x557e0d9fdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44e9b9c700 1 -- 172.21.15.115:0/3452593378 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e0d943ee0 con 0x557e0da51fd0 2023-07-27T14:33:12.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0da51fd0 0x557e0da44e40 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f44dc009fd0 tx=0x7f44dc009840).ready entity=mon.0 client_cookie=2ec06c41fb0854e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44ce9ff700 1 -- 172.21.15.115:0/3452593378 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00bcd0 con 0x557e0da51fd0 2023-07-27T14:33:12.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44ce9ff700 1 -- 172.21.15.115:0/3452593378 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00be30 con 0x557e0da51fd0 2023-07-27T14:33:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.517+0000 7f44ce9ff700 1 -- 172.21.15.115:0/3452593378 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc013630 con 0x557e0da51fd0 2023-07-27T14:33:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 -- 172.21.15.115:0/3452593378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0da51fd0 msgr2=0x557e0da44e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0da51fd0 0x557e0da44e40 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f44dc009fd0 tx=0x7f44dc009840).stop 2023-07-27T14:33:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 -- 172.21.15.115:0/3452593378 shutdown_connections 2023-07-27T14:33:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0da51fd0 0x557e0da44e40 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0d9fd5c0 0x557e0d9fdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3452593378 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0d9fe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 -- 172.21.15.115:0/3452593378 >> 172.21.15.115:0/3452593378 conn(0x557e0d868940 msgr2=0x557e0da27070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 -- 172.21.15.115:0/3452593378 shutdown_connections 2023-07-27T14:33:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 -- 172.21.15.115:0/3452593378 wait complete. 2023-07-27T14:33:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.518+0000 7f45028f5b80 1 -- start start 2023-07-27T14:33:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.519+0000 7f45028f5b80 1 Processor -- start 2023-07-27T14:33:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0da8ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0da3e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f45028f5b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 0x557e0da25ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f45028f5b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e0d9f9c20 con 0x557e0d9fd5c0 2023-07-27T14:33:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f45028f5b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e0da24d90 con 0x557e0da51fd0 2023-07-27T14:33:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f45028f5b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e0da25100 con 0x557e0d9fff60 2023-07-27T14:33:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f45028f5b80 10 client.0 ll_register_callbacks cb 0x557e0d9024a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:33:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0da8ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0da8ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54744/0 (socket says 172.21.15.115:54744) 2023-07-27T14:33:12.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 -- 172.21.15.115:0/3179284259 learned_addr learned my addr 172.21.15.115:0/3179284259 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:12.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e9b9c700 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 0x557e0da25ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0da3e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 -- 172.21.15.115:0/3179284259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 msgr2=0x557e0da3e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0da3e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 -- 172.21.15.115:0/3179284259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 msgr2=0x557e0da25ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 0x557e0da25ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 -- 172.21.15.115:0/3179284259 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc017040 con 0x557e0d9fd5c0 2023-07-27T14:33:12.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44e939b700 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0da8ea10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f44e0010530 tx=0x7f44e0016040).ready entity=mon.0 client_cookie=ead4d1d648e8ecdf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.520+0000 7f44c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:33:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f44c37fe700 1 -- 172.21.15.115:0/3179284259 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0010ed0 con 0x557e0d9fd5c0 2023-07-27T14:33:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f44c37fe700 1 -- 172.21.15.115:0/3179284259 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f44e002e580 con 0x557e0d9fd5c0 2023-07-27T14:33:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 1 -- 172.21.15.115:0/3179284259 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44e0014c70 con 0x557e0d9fd5c0 2023-07-27T14:33:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f44c37fe700 1 -- 172.21.15.115:0/3179284259 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44e002e950 con 0x557e0d9fd5c0 2023-07-27T14:33:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 10 client.7557 fetch_fsmap learned FSMap version 59 2023-07-27T14:33:12.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 1 -- 172.21.15.115:0/3179284259 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x557e0d7be1d0 con 0x557e0d9fd5c0 2023-07-27T14:33:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f44c37fe700 1 -- 172.21.15.115:0/3179284259 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0014c70 con 0x557e0d9fd5c0 2023-07-27T14:33:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f44c37fe700 1 -- 172.21.15.115:0/3179284259 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 59) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f44e002eab0 con 0x557e0d9fd5c0 2023-07-27T14:33:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 10 client.7557 fetch_fsmap finished waiting for FSMap version 59 2023-07-27T14:33:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 10 client.7557 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:33:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 20 client.7557 populate_metadata read hostname 'smithi115' 2023-07-27T14:33:12.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] conn(0x557e0da28420 0x557e0da28800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 4 client.7557 mds_command: new command op to 7410 tid=0[{"prefix": "status"}] 2023-07-27T14:33:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.521+0000 7f45028f5b80 1 -- 172.21.15.115:0/3179284259 --> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557e0d7ee040 con 0x557e0da28420 2023-07-27T14:33:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] conn(0x557e0da28420 0x557e0da28800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f44e8b9a700 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] conn(0x557e0da28420 0x557e0da28800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c7502aaf23074085 server_cookie=e28b8529617c335d in_seq=0 out_seq=0 2023-07-27T14:33:12.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f44c37fe700 10 client.7557 ms_handle_connect on v2:172.21.15.115:6835/2904047998 2023-07-27T14:33:12.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f44c37fe700 1 -- 172.21.15.115:0/3179284259 <== mds.0 v2:172.21.15.115:6835/2904047998 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x557e0d7ee040 con 0x557e0da28420 2023-07-27T14:33:12.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f44c37fe700 10 client.7557 handle_command_reply: tid=0 2023-07-27T14:33:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 client.7557 shutdown 2023-07-27T14:33:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 -- 172.21.15.115:0/3179284259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 msgr2=0x557e0da8ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0da8ea10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f44e0010530 tx=0x7f44e0016040).stop 2023-07-27T14:33:12.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 -- 172.21.15.115:0/3179284259 shutdown_connections 2023-07-27T14:33:12.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.115:6835/2904047998,v1:172.21.15.115:6837/2904047998] conn(0x557e0da28420 0x557e0da28800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x557e0da51fd0 0x557e0da25ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557e0d9fd5c0 0x557e0da8ea10 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 --2- 172.21.15.115:0/3179284259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x557e0d9fff60 0x557e0da3e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 -- 172.21.15.115:0/3179284259 >> 172.21.15.115:0/3179284259 conn(0x557e0d868940 msgr2=0x557e0d9fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:12.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f44c37fe700 0 client.7557 ms_handle_reset on v2:172.21.15.115:6835/2904047998 2023-07-27T14:33:12.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 -- 172.21.15.115:0/3179284259 shutdown_connections 2023-07-27T14:33:12.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.522+0000 7f45028f5b80 1 -- 172.21.15.115:0/3179284259 wait complete. 2023-07-27T14:33:12.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f45028f5b80 20 client.7557 trim_cache size 0 max 16384 2023-07-27T14:33:12.575 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:33:12.575 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:33:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:33:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 7410, 2023-07-27T14:33:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:33:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:33:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:33:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2865814779999996, 2023-07-27T14:33:12.576 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 59, 2023-07-27T14:33:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 114, 2023-07-27T14:33:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 114, 2023-07-27T14:33:12.577 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.470642225000001 2023-07-27T14:33:12.577 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:33:12.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44c805f4e0 msgr2=0x7f44c80619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44c805f4e0 0x7f44c80619a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f44e000bb10 tx=0x7f44e0008040).stop 2023-07-27T14:33:12.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 msgr2=0x7f44e40c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c86d0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f44d400c440 tx=0x7f44d4007de0).stop 2023-07-27T14:33:12.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3888783540 shutdown_connections 2023-07-27T14:33:12.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44c805f4e0 0x7f44c80619a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44e4153ec0 0x7f44e40c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f44e40aa050 0x7f44e414e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 --2- 172.21.15.115:0/3888783540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e40aaa40 0x7f44e40c86d0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3888783540 >> 172.21.15.115:0/3888783540 conn(0x7f44e40cb610 msgr2=0x7f44e40ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:12.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3888783540 shutdown_connections 2023-07-27T14:33:12.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.523+0000 7f44eb5ff700 1 -- 172.21.15.115:0/3888783540 wait complete. 2023-07-27T14:33:12.580 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:33:12.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.701+0000 7fb7193ff700 1 Processor -- start 2023-07-27T14:33:12.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.701+0000 7fb7193ff700 1 -- start start 2023-07-27T14:33:12.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.702+0000 7fb7193ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 0x7fb7140bb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.702+0000 7fb7193ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb714068de0 0x7fb714154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.702+0000 7fb7193ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb714154d60 0x7fb714153720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.702+0000 7fb7193ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb714065a90 con 0x7fb714068de0 2023-07-27T14:33:12.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.702+0000 7fb7193ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7140c1a30 con 0x7fb714154d60 2023-07-27T14:33:12.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.702+0000 7fb7193ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140bbcc0 con 0x7fb714154490 2023-07-27T14:33:12.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb714068de0 0x7fb714154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb714068de0 0x7fb714154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54752/0 (socket says 172.21.15.115:54752) 2023-07-27T14:33:12.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb712ffd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 0x7fb7140bb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 -- 172.21.15.115:0/1671630408 learned_addr learned my addr 172.21.15.115:0/1671630408 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:12.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7137fe700 1 --2- 172.21.15.115:0/1671630408 >> v2:172.21.15.159:3300/0 conn(0x7fb714154d60 0x7fb714153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 -- 172.21.15.115:0/1671630408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 msgr2=0x7fb7140bb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 --2- 172.21.15.115:0/1671630408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 0x7fb7140bb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 -- 172.21.15.115:0/1671630408 >> v2:172.21.15.159:3300/0 conn(0x7fb714154d60 msgr2=0x7fb714153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:12.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 --2- 172.21.15.115:0/1671630408 >> v2:172.21.15.159:3300/0 conn(0x7fb714154d60 0x7fb714153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 -- 172.21.15.115:0/1671630408 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714064fe0 con 0x7fb714068de0 2023-07-27T14:33:12.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb7127fc700 1 --2- 172.21.15.115:0/1671630408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714068de0 0x7fb714154870 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fb71406a510 tx=0x7fb7080090f0).ready entity=mon.0 client_cookie=4977b116fc39479b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb711ffb700 1 -- 172.21.15.115:0/1671630408 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800f510 con 0x7fb714068de0 2023-07-27T14:33:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb711ffb700 1 -- 172.21.15.115:0/1671630408 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70800f670 con 0x7fb714068de0 2023-07-27T14:33:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.703+0000 7fb711ffb700 1 -- 172.21.15.115:0/1671630408 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800fa10 con 0x7fb714068de0 2023-07-27T14:33:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 -- 172.21.15.115:0/1671630408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714068de0 msgr2=0x7fb714154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1671630408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714068de0 0x7fb714154870 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fb71406a510 tx=0x7fb7080090f0).stop 2023-07-27T14:33:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 -- 172.21.15.115:0/1671630408 shutdown_connections 2023-07-27T14:33:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1671630408 >> v2:172.21.15.159:3300/0 conn(0x7fb714154d60 0x7fb714153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1671630408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 0x7fb7140bb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1671630408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714068de0 0x7fb714154870 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 -- 172.21.15.115:0/1671630408 >> 172.21.15.115:0/1671630408 conn(0x7fb714062ec0 msgr2=0x7fb7140c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:12.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 -- 172.21.15.115:0/1671630408 shutdown_connections 2023-07-27T14:33:12.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.704+0000 7fb7193ff700 1 -- 172.21.15.115:0/1671630408 wait complete. 2023-07-27T14:33:12.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.706+0000 7fb7193ff700 1 Processor -- start 2023-07-27T14:33:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.706+0000 7fb7193ff700 1 -- start start 2023-07-27T14:33:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7193ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb714068de0 0x7fb7140c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7193ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 0x7fb7141475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7193ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714154d60 0x7fb7140c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7193ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140c07b0 con 0x7fb714154d60 2023-07-27T14:33:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7193ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140bf220 con 0x7fb714068de0 2023-07-27T14:33:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7193ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140bf500 con 0x7fb714154490 2023-07-27T14:33:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714154d60 0x7fb7140c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714154d60 0x7fb7140c3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54766/0 (socket says 172.21.15.115:54766) 2023-07-27T14:33:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 -- 172.21.15.115:0/1013186293 learned_addr learned my addr 172.21.15.115:0/1013186293 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb712ffd700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb714068de0 0x7fb7140c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7127fc700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 0x7fb7141475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 -- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 msgr2=0x7fb7141475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 0x7fb7141475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 -- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb714068de0 msgr2=0x7fb7140c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb714068de0 0x7fb7140c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 -- 172.21.15.115:0/1013186293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009370 con 0x7fb714154d60 2023-07-27T14:33:12.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb712ffd700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb714068de0 0x7fb7140c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:12.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.707+0000 7fb7137fe700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714154d60 0x7fb7140c3510 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fb70c009df0 tx=0x7fb70c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.708+0000 7fb6faffd700 1 -- 172.21.15.115:0/1013186293 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00cb50 con 0x7fb714154d60 2023-07-27T14:33:12.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.708+0000 7fb6faffd700 1 -- 172.21.15.115:0/1013186293 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c00f040 con 0x7fb714154d60 2023-07-27T14:33:12.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.708+0000 7fb6faffd700 1 -- 172.21.15.115:0/1013186293 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00cec0 con 0x7fb714154d60 2023-07-27T14:33:12.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.708+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7140bf7e0 con 0x7fb714154d60 2023-07-27T14:33:12.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.708+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7140bfda0 con 0x7fb714154d60 2023-07-27T14:33:12.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.709+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb714067f10 con 0x7fb714154d60 2023-07-27T14:33:12.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.710+0000 7fb6faffd700 1 -- 172.21.15.115:0/1013186293 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fb70c013610 con 0x7fb714154d60 2023-07-27T14:33:12.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.711+0000 7fb6faffd700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb70005f4e0 0x7fb7000619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:12.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.711+0000 7fb6faffd700 1 -- 172.21.15.115:0/1013186293 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb70c07afa0 con 0x7fb714154d60 2023-07-27T14:33:12.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.711+0000 7fb712ffd700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb70005f4e0 0x7fb7000619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:12.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.711+0000 7fb712ffd700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb70005f4e0 0x7fb7000619a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb704009c00 tx=0x7fb704008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:12.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.715+0000 7fb6faffd700 1 -- 172.21.15.115:0/1013186293 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb70c04bdf0 con 0x7fb714154d60 2023-07-27T14:33:12.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.926+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb7140bffc0 con 0x7fb714154d60 2023-07-27T14:33:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.926+0000 7fb6faffd700 1 -- 172.21.15.115:0/1013186293 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb70c04f410 con 0x7fb714154d60 2023-07-27T14:33:12.964 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:33:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.928+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb70005f4e0 msgr2=0x7fb7000619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.928+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb70005f4e0 0x7fb7000619a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb704009c00 tx=0x7fb704008040).stop 2023-07-27T14:33:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.928+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714154d60 msgr2=0x7fb7140c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.928+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714154d60 0x7fb7140c3510 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fb70c009df0 tx=0x7fb70c00b040).stop 2023-07-27T14:33:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.928+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 shutdown_connections 2023-07-27T14:33:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.928+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb70005f4e0 0x7fb7000619a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.928+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb714154d60 0x7fb7140c3510 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.929+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb714068de0 0x7fb7140c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.929+0000 7fb7193ff700 1 --2- 172.21.15.115:0/1013186293 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb714154490 0x7fb7141475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:12.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.929+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 >> 172.21.15.115:0/1013186293 conn(0x7fb714062ec0 msgr2=0x7fb7140a5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:12.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.929+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 shutdown_connections 2023-07-27T14:33:12.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:12.929+0000 7fb7193ff700 1 -- 172.21.15.115:0/1013186293 wait complete. 2023-07-27T14:33:12.981 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:33:12.981 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:33:12.982 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:33:12.982 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:33:12.982 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:33:12.982 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:33:12.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:33:12.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:33:12.983 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:33:12.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:12.984 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:33:13.031 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:33:13.031 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:33:13.032 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:33:13.032 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:13.032 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:33:13.032 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:13.032 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:13.032 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:13.032 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:33:13.033 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:13.033 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:13.033 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:33:13.033 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:13.033 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:13.033 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:33:13.033 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:13.034 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:33:13.034 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41608sec preferred_lft 41608sec 2023-07-27T14:33:13.034 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:33:13.034 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:13.034 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:33:13.034 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:13.034 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:33:13.034 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:13.035 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:33:13.035 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:13.035 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:33:13.035 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:33:13.035 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:33:13.035 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:13.035 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:33:13.035 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:33:13.036 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:33:13.036 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:13.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:13.037 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:33:13.103 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:33:13.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:13.107 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:33:13.156 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:33:13.156 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:33:13.156 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:33:13.157 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:33:13.157 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:33:13.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:13.158 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:33:13.158 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:33:13.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:33:13.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:33:13.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:33:13.159 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:33:13.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:13.328 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:33:13.375 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:33:13.375 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:33:13.376 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:33:13.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:13.377 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:33:13.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:13.488 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:33:13.534 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:33:13.535 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:13.672 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:33:13.699 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:13.699 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:33:13.703 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:33:13.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:13.704 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:33:13.776 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:33:13.948 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.910+0000 7fbd64dff700 1 Processor -- start 2023-07-27T14:33:13.948 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.910+0000 7fbd64dff700 1 -- start start 2023-07-27T14:33:13.950 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.912+0000 7fbd64dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbd600c64b0 0x7fbd600641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:13.950 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.912+0000 7fbd64dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd60158e00 con 0x7fbd60154190 2023-07-27T14:33:13.950 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.912+0000 7fbd64dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd60064b30 con 0x7fbd600646c0 2023-07-27T14:33:13.950 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.912+0000 7fbd64dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd600aa640 con 0x7fbd600c64b0 2023-07-27T14:33:13.950 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.912+0000 7fbd5ed9d700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fbd600646c0 0x7fbd60154570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:37866/0 (socket says 172.21.15.159:37866) 2023-07-27T14:33:13.951 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.912+0000 7fbd5ed9d700 1 -- 172.21.15.159:0/3459108944 learned_addr learned my addr 172.21.15.159:0/3459108944 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:33:13.952 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.912+0000 7fbd5dd9b700 1 --2- 172.21.15.159:0/3459108944 >> v2:172.21.15.115:3300/0 conn(0x7fbd600c64b0 0x7fbd600641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:13.952 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5d59a700 1 -- 172.21.15.159:0/3459108944 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528411522 0 0) 0x7fbd60064b30 con 0x7fbd600646c0 2023-07-27T14:33:13.952 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5d59a700 1 -- 172.21.15.159:0/3459108944 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd480033f0 con 0x7fbd600646c0 2023-07-27T14:33:13.952 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5dd9b700 1 -- 172.21.15.159:0/3459108944 >> v1:172.21.15.159:6789/0 conn(0x7fbd600646c0 legacy=0x7fbd60154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:13.953 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5d59a700 1 -- 172.21.15.159:0/3459108944 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690156240 0 0) 0x7fbd60158e00 con 0x7fbd60154190 2023-07-27T14:33:13.953 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5dd9b700 1 -- 172.21.15.159:0/3459108944 >> v1:172.21.15.115:6789/0 conn(0x7fbd60154190 legacy=0x7fbd600a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:13.953 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5dd9b700 1 -- 172.21.15.159:0/3459108944 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd60158040 con 0x7fbd600c64b0 2023-07-27T14:33:13.953 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5dd9b700 1 --2- 172.21.15.159:0/3459108944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd600c64b0 0x7fbd600641d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fbd54009760 tx=0x7fbd54009060).ready entity=mon.0 client_cookie=170a900910c296e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:13.953 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5d59a700 1 -- 172.21.15.159:0/3459108944 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd540090d0 con 0x7fbd600c64b0 2023-07-27T14:33:13.953 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5d59a700 1 -- 172.21.15.159:0/3459108944 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5400f510 con 0x7fbd600c64b0 2023-07-27T14:33:13.953 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.913+0000 7fbd5d59a700 1 -- 172.21.15.159:0/3459108944 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400f890 con 0x7fbd600c64b0 2023-07-27T14:33:13.954 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.914+0000 7fbd64dff700 1 -- 172.21.15.159:0/3459108944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd600c64b0 msgr2=0x7fbd600641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:13.954 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.914+0000 7fbd64dff700 1 --2- 172.21.15.159:0/3459108944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd600c64b0 0x7fbd600641d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fbd54009760 tx=0x7fbd54009060).stop 2023-07-27T14:33:13.954 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.914+0000 7fbd64dff700 1 -- 172.21.15.159:0/3459108944 shutdown_connections 2023-07-27T14:33:13.954 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.914+0000 7fbd64dff700 1 --2- 172.21.15.159:0/3459108944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd600c64b0 0x7fbd600641d0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:13.954 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.914+0000 7fbd64dff700 1 -- 172.21.15.159:0/3459108944 >> 172.21.15.159:0/3459108944 conn(0x7fbd600cb730 msgr2=0x7fbd600c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:13.954 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.914+0000 7fbd64dff700 1 -- 172.21.15.159:0/3459108944 shutdown_connections 2023-07-27T14:33:13.955 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.914+0000 7fbd64dff700 1 -- 172.21.15.159:0/3459108944 wait complete. 2023-07-27T14:33:13.955 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.916+0000 7fbd64dff700 1 Processor -- start 2023-07-27T14:33:13.955 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.916+0000 7fbd64dff700 1 -- start start 2023-07-27T14:33:13.956 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.917+0000 7fbd64dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd600646c0 0x7fbd600aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:13.956 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.917+0000 7fbd64dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd600c64b0 0x7fbd600c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:13.956 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd64dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd60154190 0x7fbd60164470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:13.956 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd64dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600c2520 con 0x7fbd60154190 2023-07-27T14:33:13.956 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd64dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600c2800 con 0x7fbd600646c0 2023-07-27T14:33:13.956 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd64dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600c2ae0 con 0x7fbd600c64b0 2023-07-27T14:33:13.957 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd600646c0 0x7fbd600aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:13.958 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd600c64b0 0x7fbd600c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:13.958 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd600c64b0 0x7fbd600c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:54926/0 (socket says 172.21.15.159:54926) 2023-07-27T14:33:13.958 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd600646c0 0x7fbd600aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36214/0 (socket says 172.21.15.159:36214) 2023-07-27T14:33:13.958 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 -- 172.21.15.159:0/305299935 learned_addr learned my addr 172.21.15.159:0/305299935 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:33:13.958 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 -- 172.21.15.159:0/305299935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd600646c0 msgr2=0x7fbd600aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:13.958 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd600646c0 0x7fbd600aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:13.958 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5ed9d700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd60154190 0x7fbd60164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:13.959 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 -- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd60154190 msgr2=0x7fbd60164470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:13.959 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd60154190 0x7fbd60164470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:13.959 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 -- 172.21.15.159:0/305299935 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540092a0 con 0x7fbd600c64b0 2023-07-27T14:33:13.959 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5ed9d700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd60154190 0x7fbd60164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:13.959 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.918+0000 7fbd5dd9b700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd600c64b0 0x7fbd600c1d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fbd54009e00 tx=0x7fbd54017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:13.959 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.919+0000 7fbd4e7fc700 1 -- 172.21.15.159:0/305299935 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54006990 con 0x7fbd600c64b0 2023-07-27T14:33:13.959 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.919+0000 7fbd4e7fc700 1 -- 172.21.15.159:0/305299935 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5400fc50 con 0x7fbd600c64b0 2023-07-27T14:33:13.960 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.919+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd600c2dc0 con 0x7fbd600c64b0 2023-07-27T14:33:13.960 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.919+0000 7fbd4e7fc700 1 -- 172.21.15.159:0/305299935 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400f890 con 0x7fbd600c64b0 2023-07-27T14:33:13.960 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.919+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd600c2230 con 0x7fbd600c64b0 2023-07-27T14:33:13.960 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.920+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600c3260 con 0x7fbd600c64b0 2023-07-27T14:33:13.961 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.921+0000 7fbd4e7fc700 1 -- 172.21.15.159:0/305299935 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fbd5400f070 con 0x7fbd600c64b0 2023-07-27T14:33:13.961 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.921+0000 7fbd4e7fc700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd4005f4e0 0x7fbd400619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:13.961 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.921+0000 7fbd4e7fc700 1 -- 172.21.15.159:0/305299935 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbd5407bfb0 con 0x7fbd600c64b0 2023-07-27T14:33:13.961 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.922+0000 7fbd5e59c700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd4005f4e0 0x7fbd400619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:13.961 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.922+0000 7fbd5e59c700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd4005f4e0 0x7fbd400619a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fbd600c9cd0 tx=0x7fbd50009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:13.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:13.926+0000 7fbd4e7fc700 1 -- 172.21.15.159:0/305299935 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd5404ccf0 con 0x7fbd600c64b0 2023-07-27T14:33:14.174 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.136+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbd600c2c20 con 0x7fbd600c64b0 2023-07-27T14:33:14.175 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.137+0000 7fbd4e7fc700 1 -- 172.21.15.159:0/305299935 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbd600c2c20 con 0x7fbd600c64b0 2023-07-27T14:33:14.175 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:33:14.177 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd4005f4e0 msgr2=0x7fbd400619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:14.177 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd4005f4e0 0x7fbd400619a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fbd600c9cd0 tx=0x7fbd50009040).stop 2023-07-27T14:33:14.177 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd600c64b0 msgr2=0x7fbd600c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:14.178 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd600c64b0 0x7fbd600c1d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fbd54009e00 tx=0x7fbd54017000).stop 2023-07-27T14:33:14.178 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 shutdown_connections 2023-07-27T14:33:14.178 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd4005f4e0 0x7fbd400619a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:14.178 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd60154190 0x7fbd60164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:14.179 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd600646c0 0x7fbd600aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:14.179 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 --2- 172.21.15.159:0/305299935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd600c64b0 0x7fbd600c1d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:14.179 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 >> 172.21.15.159:0/305299935 conn(0x7fbd600cb730 msgr2=0x7fbd60152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:14.179 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 shutdown_connections 2023-07-27T14:33:14.180 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:14.139+0000 7fbd64dff700 1 -- 172.21.15.159:0/305299935 wait complete. 2023-07-27T14:33:14.191 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:33:14.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:33:14.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:33:14.193 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:33:14.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:33:14.194 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:33:14.194 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:33:14.195 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:33:14.195 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:33:14.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:14.196 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:33:14.244 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:33:14.244 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:33:14.245 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:33:14.245 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:14.245 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:33:14.245 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:14.246 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:14.246 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:14.246 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:33:14.246 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:14.247 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:14.247 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:33:14.247 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:14.247 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:14.248 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:33:14.248 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:14.248 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:33:14.248 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41602sec preferred_lft 41602sec 2023-07-27T14:33:14.249 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:33:14.249 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:14.249 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:33:14.249 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:14.250 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:33:14.250 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:14.250 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:33:14.250 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:14.251 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:33:14.251 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:33:14.251 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:33:14.252 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:14.252 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:33:14.252 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:33:14.252 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:33:14.252 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:14.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:14.253 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:33:14.354 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:33:14.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:14.357 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:33:14.406 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:33:14.406 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:33:14.406 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:33:14.406 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:33:14.406 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:33:14.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:14.407 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:33:14.407 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:33:14.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:33:14.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:33:14.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:33:14.409 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:33:14.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:14.580 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:33:14.628 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:33:14.628 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:33:14.628 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:33:14.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:14.629 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:33:14.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:14.703 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:33:14.749 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:33:14.749 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:14.887 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:14.887 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:33:14.914 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:14.915 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:33:14.918 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:33:14.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:14.919 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:33:14.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:33:15.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.152+0000 7f8c487ff700 1 Processor -- start 2023-07-27T14:33:15.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.153+0000 7f8c487ff700 1 -- start start 2023-07-27T14:33:15.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c487ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8c4013a730 0x7f8c40065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c487ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c401585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c487ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c400bd9a0 con 0x7f8c4013a350 2023-07-27T14:33:15.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c487ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c40066400 con 0x7f8c4013a730 2023-07-27T14:33:15.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c487ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40158ae0 con 0x7f8c400c36b0 2023-07-27T14:33:15.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c45d9a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8c4013a730 0x7f8c40065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c45d9a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8c4013a730 0x7f8c40065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:47918/0 (socket says 172.21.15.115:47918) 2023-07-27T14:33:15.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c45d9a700 1 -- 172.21.15.115:0/1268386950 learned_addr learned my addr 172.21.15.115:0/1268386950 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:15.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c46d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c401585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.154+0000 7f8c4659b700 1 --1- 172.21.15.115:0/1268386950 >> v1:172.21.15.159:6789/0 conn(0x7f8c4013a350 0x7f8c400c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:38892/0 (socket says 172.21.15.115:38892) 2023-07-27T14:33:15.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45d9a700 1 -- 172.21.15.115:0/1268386950 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 msgr2=0x7f8c401585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:15.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45d9a700 1 --2- 172.21.15.115:0/1268386950 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c401585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45d9a700 1 -- 172.21.15.115:0/1268386950 >> v1:172.21.15.159:6789/0 conn(0x7f8c4013a350 legacy=0x7f8c400c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45d9a700 1 -- 172.21.15.115:0/1268386950 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40066610 con 0x7f8c4013a730 2023-07-27T14:33:15.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45599700 1 -- 172.21.15.115:0/1268386950 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366042522 0 0) 0x7f8c400bd9a0 con 0x7f8c4013a350 2023-07-27T14:33:15.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c46d9c700 1 --2- 172.21.15.115:0/1268386950 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c401585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:15.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45d9a700 1 --2- 172.21.15.115:0/1268386950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a730 0x7f8c40065f10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f8c30006fd0 tx=0x7f8c300090f0).ready entity=mon.1 client_cookie=b1ed4501d8e8bc47 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:15.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45599700 1 -- 172.21.15.115:0/1268386950 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000b580 con 0x7f8c4013a730 2023-07-27T14:33:15.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45599700 1 -- 172.21.15.115:0/1268386950 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000b6e0 con 0x7f8c4013a730 2023-07-27T14:33:15.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.155+0000 7f8c45599700 1 -- 172.21.15.115:0/1268386950 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000ba60 con 0x7f8c4013a730 2023-07-27T14:33:15.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.156+0000 7f8c487ff700 1 -- 172.21.15.115:0/1268386950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a730 msgr2=0x7f8c40065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.156+0000 7f8c487ff700 1 --2- 172.21.15.115:0/1268386950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a730 0x7f8c40065f10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f8c30006fd0 tx=0x7f8c300090f0).stop 2023-07-27T14:33:15.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.156+0000 7f8c487ff700 1 -- 172.21.15.115:0/1268386950 shutdown_connections 2023-07-27T14:33:15.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.156+0000 7f8c487ff700 1 --2- 172.21.15.115:0/1268386950 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c401585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.156+0000 7f8c487ff700 1 --2- 172.21.15.115:0/1268386950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a730 0x7f8c40065f10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.156+0000 7f8c487ff700 1 -- 172.21.15.115:0/1268386950 >> 172.21.15.115:0/1268386950 conn(0x7f8c4005e8f0 msgr2=0x7f8c400c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:15.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.156+0000 7f8c487ff700 1 -- 172.21.15.115:0/1268386950 shutdown_connections 2023-07-27T14:33:15.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.156+0000 7f8c487ff700 1 -- 172.21.15.115:0/1268386950 wait complete. 2023-07-27T14:33:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.158+0000 7f8c487ff700 1 Processor -- start 2023-07-27T14:33:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.158+0000 7f8c487ff700 1 -- start start 2023-07-27T14:33:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.159+0000 7f8c487ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c400c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.159+0000 7f8c487ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a350 0x7f8c400a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c487ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c4013a730 0x7f8c400a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c487ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400a9a60 con 0x7f8c4013a730 2023-07-27T14:33:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c487ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400a8fc0 con 0x7f8c4013a350 2023-07-27T14:33:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c487ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400a91c0 con 0x7f8c400c36b0 2023-07-27T14:33:15.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c4013a730 0x7f8c400a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c4013a730 0x7f8c400a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34992/0 (socket says 172.21.15.115:34992) 2023-07-27T14:33:15.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 -- 172.21.15.115:0/3770787016 learned_addr learned my addr 172.21.15.115:0/3770787016 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:15.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c4659b700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c400c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c45d9a700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a350 0x7f8c400a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 -- 172.21.15.115:0/3770787016 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 msgr2=0x7f8c400c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c400c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 -- 172.21.15.115:0/3770787016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a350 msgr2=0x7f8c400a85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a350 0x7f8c400a85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 -- 172.21.15.115:0/3770787016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009a20 con 0x7f8c4013a730 2023-07-27T14:33:15.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.160+0000 7f8c46d9c700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c4013a730 0x7f8c400a8ad0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f8c38009f30 tx=0x7f8c3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:15.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.161+0000 7f8c367fc700 1 -- 172.21.15.115:0/3770787016 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800cb70 con 0x7f8c4013a730 2023-07-27T14:33:15.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.161+0000 7f8c367fc700 1 -- 172.21.15.115:0/3770787016 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800f040 con 0x7f8c4013a730 2023-07-27T14:33:15.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.161+0000 7f8c367fc700 1 -- 172.21.15.115:0/3770787016 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38013400 con 0x7f8c4013a730 2023-07-27T14:33:15.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.161+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c30009370 con 0x7f8c4013a730 2023-07-27T14:33:15.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.161+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c400a9780 con 0x7f8c4013a730 2023-07-27T14:33:15.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.162+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c40065ac0 con 0x7f8c4013a730 2023-07-27T14:33:15.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.163+0000 7f8c367fc700 1 -- 172.21.15.115:0/3770787016 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f8c38013770 con 0x7f8c4013a730 2023-07-27T14:33:15.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.163+0000 7f8c367fc700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c2405f4e0 0x7f8c240619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.163+0000 7f8c367fc700 1 -- 172.21.15.115:0/3770787016 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8c3807b030 con 0x7f8c4013a730 2023-07-27T14:33:15.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.164+0000 7f8c4659b700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c2405f4e0 0x7f8c240619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.164+0000 7f8c4659b700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c2405f4e0 0x7f8c240619a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f8c3c0011e0 tx=0x7f8c3c007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:15.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.168+0000 7f8c367fc700 1 -- 172.21.15.115:0/3770787016 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c3804be80 con 0x7f8c4013a730 2023-07-27T14:33:15.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.379+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8c4006c470 con 0x7f8c4013a730 2023-07-27T14:33:15.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.444+0000 7f8c367fc700 1 -- 172.21.15.115:0/3770787016 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 136+0+0 (secure 0 0 0) 0x7f8c3804f4a0 con 0x7f8c4013a730 2023-07-27T14:33:15.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.446+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c2405f4e0 msgr2=0x7f8c240619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.446+0000 7f8c487ff700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c2405f4e0 0x7f8c240619a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f8c3c0011e0 tx=0x7f8c3c007bd0).stop 2023-07-27T14:33:15.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c4013a730 msgr2=0x7f8c400a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c4013a730 0x7f8c400a8ad0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f8c38009f30 tx=0x7f8c3800b040).stop 2023-07-27T14:33:15.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 shutdown_connections 2023-07-27T14:33:15.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c2405f4e0 0x7f8c240619a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c4013a730 0x7f8c400a8ad0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c400c36b0 0x7f8c400c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 --2- 172.21.15.115:0/3770787016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c4013a350 0x7f8c400a85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 >> 172.21.15.115:0/3770787016 conn(0x7f8c4005e8f0 msgr2=0x7f8c400ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:15.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 shutdown_connections 2023-07-27T14:33:15.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.447+0000 7f8c487ff700 1 -- 172.21.15.115:0/3770787016 wait complete. 2023-07-27T14:33:15.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:33:15.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.652+0000 7fb739dff700 1 Processor -- start 2023-07-27T14:33:15.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.653+0000 7fb739dff700 1 -- start start 2023-07-27T14:33:15.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb739dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734151bd0 0x7fb734062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb739dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb734062810 0x7fb7340a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb739dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7340639d0 con 0x7fb7340a4d30 2023-07-27T14:33:15.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb739dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb734137610 con 0x7fb734062810 2023-07-27T14:33:15.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb739dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340a51e0 con 0x7fb734151bd0 2023-07-27T14:33:15.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb732ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb734062810 0x7fb7340a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb732ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb734062810 0x7fb7340a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35004/0 (socket says 172.21.15.115:35004) 2023-07-27T14:33:15.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb732ffd700 1 -- 172.21.15.115:0/1345402235 learned_addr learned my addr 172.21.15.115:0/1345402235 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:15.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.654+0000 7fb7337fe700 1 --2- 172.21.15.115:0/1345402235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734151bd0 0x7fb734062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.655+0000 7fb732ffd700 1 -- 172.21.15.115:0/1345402235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734151bd0 msgr2=0x7fb734062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:15.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.655+0000 7fb732ffd700 1 --2- 172.21.15.115:0/1345402235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734151bd0 0x7fb734062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.655+0000 7fb732ffd700 1 -- 172.21.15.115:0/1345402235 >> v1:172.21.15.159:6789/0 conn(0x7fb7340a4d30 legacy=0x7fb734157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.655+0000 7fb732ffd700 1 -- 172.21.15.115:0/1345402235 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734062dc0 con 0x7fb734062810 2023-07-27T14:33:15.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.655+0000 7fb732ffd700 1 --2- 172.21.15.115:0/1345402235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734062810 0x7fb7340a4840 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fb728006fd0 tx=0x7fb7280090f0).ready entity=mon.0 client_cookie=25fd515b9bddccd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:15.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.655+0000 7fb7327fc700 1 -- 172.21.15.115:0/1345402235 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800b600 con 0x7fb734062810 2023-07-27T14:33:15.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.655+0000 7fb7327fc700 1 -- 172.21.15.115:0/1345402235 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800b760 con 0x7fb734062810 2023-07-27T14:33:15.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.655+0000 7fb7327fc700 1 -- 172.21.15.115:0/1345402235 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800bae0 con 0x7fb734062810 2023-07-27T14:33:15.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.656+0000 7fb739dff700 1 -- 172.21.15.115:0/1345402235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734062810 msgr2=0x7fb7340a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.656+0000 7fb739dff700 1 --2- 172.21.15.115:0/1345402235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734062810 0x7fb7340a4840 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fb728006fd0 tx=0x7fb7280090f0).stop 2023-07-27T14:33:15.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.656+0000 7fb739dff700 1 -- 172.21.15.115:0/1345402235 shutdown_connections 2023-07-27T14:33:15.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.656+0000 7fb739dff700 1 --2- 172.21.15.115:0/1345402235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734151bd0 0x7fb734062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.656+0000 7fb739dff700 1 --2- 172.21.15.115:0/1345402235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734062810 0x7fb7340a4840 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.656+0000 7fb739dff700 1 -- 172.21.15.115:0/1345402235 >> 172.21.15.115:0/1345402235 conn(0x7fb734064700 msgr2=0x7fb734064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:15.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.656+0000 7fb739dff700 1 -- 172.21.15.115:0/1345402235 shutdown_connections 2023-07-27T14:33:15.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.656+0000 7fb739dff700 1 -- 172.21.15.115:0/1345402235 wait complete. 2023-07-27T14:33:15.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.657+0000 7fb739dff700 1 Processor -- start 2023-07-27T14:33:15.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.657+0000 7fb739dff700 1 -- start start 2023-07-27T14:33:15.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.658+0000 7fb739dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734062810 0x7fb73412d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.658+0000 7fb739dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7340a4d30 0x7fb734135ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.658+0000 7fb739dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734151bd0 0x7fb7340be190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.658+0000 7fb739dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340abbc0 con 0x7fb734151bd0 2023-07-27T14:33:15.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.658+0000 7fb739dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340aafb0 con 0x7fb7340a4d30 2023-07-27T14:33:15.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.658+0000 7fb739dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340ab290 con 0x7fb734062810 2023-07-27T14:33:15.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734151bd0 0x7fb7340be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734151bd0 0x7fb7340be190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35012/0 (socket says 172.21.15.115:35012) 2023-07-27T14:33:15.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 -- 172.21.15.115:0/3705399027 learned_addr learned my addr 172.21.15.115:0/3705399027 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:15.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb732ffd700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7340a4d30 0x7fb734135ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb7337fe700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734062810 0x7fb73412d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 -- 172.21.15.115:0/3705399027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734062810 msgr2=0x7fb73412d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734062810 0x7fb73412d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 -- 172.21.15.115:0/3705399027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7340a4d30 msgr2=0x7fb734135ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7340a4d30 0x7fb734135ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 -- 172.21.15.115:0/3705399027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728009370 con 0x7fb734151bd0 2023-07-27T14:33:15.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb733fff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734151bd0 0x7fb7340be190 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fb72c00c7c0 tx=0x7fb72c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:15.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb71b7fe700 1 -- 172.21.15.115:0/3705399027 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00e4a0 con 0x7fb734151bd0 2023-07-27T14:33:15.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb71b7fe700 1 -- 172.21.15.115:0/3705399027 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c00e600 con 0x7fb734151bd0 2023-07-27T14:33:15.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7340ab570 con 0x7fb734151bd0 2023-07-27T14:33:15.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.659+0000 7fb71b7fe700 1 -- 172.21.15.115:0/3705399027 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00e980 con 0x7fb734151bd0 2023-07-27T14:33:15.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.660+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb734135fd0 con 0x7fb734151bd0 2023-07-27T14:33:15.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.661+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7340abd70 con 0x7fb734151bd0 2023-07-27T14:33:15.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.661+0000 7fb71b7fe700 1 -- 172.21.15.115:0/3705399027 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7fb72c010070 con 0x7fb734151bd0 2023-07-27T14:33:15.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.662+0000 7fb71b7fe700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb72005f4e0 0x7fb7200619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:15.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.662+0000 7fb71b7fe700 1 -- 172.21.15.115:0/3705399027 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb72c079df0 con 0x7fb734151bd0 2023-07-27T14:33:15.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.662+0000 7fb7337fe700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb72005f4e0 0x7fb7200619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:15.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.663+0000 7fb7337fe700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb72005f4e0 0x7fb7200619a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fb7340bde20 tx=0x7fb724008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:15.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.666+0000 7fb71b7fe700 1 -- 172.21.15.115:0/3705399027 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb72c0478f0 con 0x7fb734151bd0 2023-07-27T14:33:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.862+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb73405ea50 con 0x7fb72005f4e0 2023-07-27T14:33:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.863+0000 7fb71b7fe700 1 -- 172.21.15.115:0/3705399027 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb73405ea50 con 0x7fb72005f4e0 2023-07-27T14:33:15.901 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:33:15.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:15.902 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:33:15.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:15.902 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:33:15.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb72005f4e0 msgr2=0x7fb7200619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb72005f4e0 0x7fb7200619a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fb7340bde20 tx=0x7fb724008040).stop 2023-07-27T14:33:15.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734151bd0 msgr2=0x7fb7340be190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:15.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734151bd0 0x7fb7340be190 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fb72c00c7c0 tx=0x7fb72c001510).stop 2023-07-27T14:33:15.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 shutdown_connections 2023-07-27T14:33:15.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb72005f4e0 0x7fb7200619a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb734151bd0 0x7fb7340be190 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb734062810 0x7fb73412d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 --2- 172.21.15.115:0/3705399027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7340a4d30 0x7fb734135ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:15.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 >> 172.21.15.115:0/3705399027 conn(0x7fb734064700 msgr2=0x7fb7340c6060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:15.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 shutdown_connections 2023-07-27T14:33:15.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:15.866+0000 7fb739dff700 1 -- 172.21.15.115:0/3705399027 wait complete. 2023-07-27T14:33:15.920 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:33:16.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.074+0000 7f07719ff700 1 Processor -- start 2023-07-27T14:33:16.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.074+0000 7f07719ff700 1 -- start start 2023-07-27T14:33:16.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.075+0000 7f07719ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f076c14ae00 0x7f076c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.075+0000 7f07719ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c1553f0 con 0x7f076c063260 2023-07-27T14:33:16.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.075+0000 7f07719ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c157a50 con 0x7f076c14b1e0 2023-07-27T14:33:16.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.075+0000 7f07719ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c157d10 con 0x7f076c14ae00 2023-07-27T14:33:16.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f076affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f076c14ae00 0x7f076c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f076affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f076c14ae00 0x7f076c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35024/0 (socket says 172.21.15.115:35024) 2023-07-27T14:33:16.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f076affd700 1 -- 172.21.15.115:0/3808062767 learned_addr learned my addr 172.21.15.115:0/3808062767 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:16.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f076b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f076c063260 0x7f076c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44420/0 (socket says 172.21.15.115:44420) 2023-07-27T14:33:16.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f076affd700 1 -- 172.21.15.115:0/3808062767 >> v1:172.21.15.159:6789/0 conn(0x7f076c14b1e0 legacy=0x7f076c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:16.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f076affd700 1 -- 172.21.15.115:0/3808062767 >> v1:172.21.15.115:6789/0 conn(0x7f076c063260 legacy=0x7f076c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f0769ffb700 1 -- 172.21.15.115:0/3808062767 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852490560 0 0) 0x7f076c1553f0 con 0x7f076c063260 2023-07-27T14:33:16.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f076affd700 1 -- 172.21.15.115:0/3808062767 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c157ff0 con 0x7f076c14ae00 2023-07-27T14:33:16.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f076affd700 1 --2- 172.21.15.115:0/3808062767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14ae00 0x7f076c154f00 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f075c006fd0 tx=0x7f075c0090f0).ready entity=mon.0 client_cookie=78f088860b658b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.076+0000 7f0769ffb700 1 -- 172.21.15.115:0/3808062767 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c00b600 con 0x7f076c14ae00 2023-07-27T14:33:16.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f0769ffb700 1 -- 172.21.15.115:0/3808062767 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c00b760 con 0x7f076c14ae00 2023-07-27T14:33:16.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f0769ffb700 1 -- 172.21.15.115:0/3808062767 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c00bae0 con 0x7f076c14ae00 2023-07-27T14:33:16.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f07719ff700 1 -- 172.21.15.115:0/3808062767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14ae00 msgr2=0x7f076c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f07719ff700 1 --2- 172.21.15.115:0/3808062767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14ae00 0x7f076c154f00 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f075c006fd0 tx=0x7f075c0090f0).stop 2023-07-27T14:33:16.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f07719ff700 1 -- 172.21.15.115:0/3808062767 shutdown_connections 2023-07-27T14:33:16.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f07719ff700 1 --2- 172.21.15.115:0/3808062767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14ae00 0x7f076c154f00 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f07719ff700 1 -- 172.21.15.115:0/3808062767 >> 172.21.15.115:0/3808062767 conn(0x7f076c05e940 msgr2=0x7f076c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:16.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f07719ff700 1 -- 172.21.15.115:0/3808062767 shutdown_connections 2023-07-27T14:33:16.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.077+0000 7f07719ff700 1 -- 172.21.15.115:0/3808062767 wait complete. 2023-07-27T14:33:16.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.079+0000 7f07719ff700 1 Processor -- start 2023-07-27T14:33:16.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.079+0000 7f07719ff700 1 -- start start 2023-07-27T14:33:16.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f07719ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f076c063260 0x7f076c151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f07719ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f076c14ae00 0x7f076c14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f07719ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14b1e0 0x7f076c152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f07719ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c14c210 con 0x7f076c14b1e0 2023-07-27T14:33:16.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f07719ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0ca020 con 0x7f076c14ae00 2023-07-27T14:33:16.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f07719ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0ca300 con 0x7f076c063260 2023-07-27T14:33:16.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14b1e0 0x7f076c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14b1e0 0x7f076c152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35032/0 (socket says 172.21.15.115:35032) 2023-07-27T14:33:16.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076b7fe700 1 -- 172.21.15.115:0/3669421395 learned_addr learned my addr 172.21.15.115:0/3669421395 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:16.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076a7fc700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f076c14ae00 0x7f076c14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076affd700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f076c063260 0x7f076c151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076b7fe700 1 -- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f076c063260 msgr2=0x7f076c151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076b7fe700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f076c063260 0x7f076c151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076b7fe700 1 -- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f076c14ae00 msgr2=0x7f076c14a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076b7fe700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f076c14ae00 0x7f076c14a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076b7fe700 1 -- 172.21.15.115:0/3669421395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c009370 con 0x7f076c14b1e0 2023-07-27T14:33:16.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.080+0000 7f076affd700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f076c063260 0x7f076c151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:16.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.081+0000 7f076b7fe700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14b1e0 0x7f076c152030 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f076400c810 tx=0x7f07640014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.081+0000 7f0752ffd700 1 -- 172.21.15.115:0/3669421395 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764005c70 con 0x7f076c14b1e0 2023-07-27T14:33:16.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.081+0000 7f0752ffd700 1 -- 172.21.15.115:0/3669421395 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764005dd0 con 0x7f076c14b1e0 2023-07-27T14:33:16.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.081+0000 7f0752ffd700 1 -- 172.21.15.115:0/3669421395 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764007340 con 0x7f076c14b1e0 2023-07-27T14:33:16.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.081+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c0ca5e0 con 0x7f076c14b1e0 2023-07-27T14:33:16.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.081+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c151d60 con 0x7f076c14b1e0 2023-07-27T14:33:16.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.082+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c06c470 con 0x7f076c14b1e0 2023-07-27T14:33:16.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.083+0000 7f0752ffd700 1 -- 172.21.15.115:0/3669421395 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f0764010030 con 0x7f076c14b1e0 2023-07-27T14:33:16.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.084+0000 7f0752ffd700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f075805f4e0 0x7f07580619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.084+0000 7f0752ffd700 1 -- 172.21.15.115:0/3669421395 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f076407a610 con 0x7f076c14b1e0 2023-07-27T14:33:16.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.084+0000 7f076affd700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f075805f4e0 0x7f07580619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.084+0000 7f076affd700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f075805f4e0 0x7f07580619a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f075c00b3c0 tx=0x7f075c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.088+0000 7f0752ffd700 1 -- 172.21.15.115:0/3669421395 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f076404b460 con 0x7f076c14b1e0 2023-07-27T14:33:16.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.256+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f076c14c350 con 0x7f076c14b1e0 2023-07-27T14:33:16.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.257+0000 7f0752ffd700 1 -- 172.21.15.115:0/3669421395 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f076404ea80 con 0x7f076c14b1e0 2023-07-27T14:33:16.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f075805f4e0 msgr2=0x7f07580619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f075805f4e0 0x7f07580619a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f075c00b3c0 tx=0x7f075c017000).stop 2023-07-27T14:33:16.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14b1e0 msgr2=0x7f076c152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14b1e0 0x7f076c152030 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f076400c810 tx=0x7f07640014d0).stop 2023-07-27T14:33:16.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 shutdown_connections 2023-07-27T14:33:16.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f075805f4e0 0x7f07580619a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f076c14b1e0 0x7f076c152030 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f076c063260 0x7f076c151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 --2- 172.21.15.115:0/3669421395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f076c14ae00 0x7f076c14a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 >> 172.21.15.115:0/3669421395 conn(0x7f076c05e940 msgr2=0x7f076c0c7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:16.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 shutdown_connections 2023-07-27T14:33:16.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.259+0000 7f07719ff700 1 -- 172.21.15.115:0/3669421395 wait complete. 2023-07-27T14:33:16.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000916240 2023-07-27T14:33:16.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.470+0000 7f0397dff700 1 Processor -- start 2023-07-27T14:33:16.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.470+0000 7f0397dff700 1 -- start start 2023-07-27T14:33:16.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.471+0000 7f0397dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f0390154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.471+0000 7f0397dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f039014b1e0 0x7f0390062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.471+0000 7f0397dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03901553f0 con 0x7f03900c5c50 2023-07-27T14:33:16.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.471+0000 7f0397dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0390157a50 con 0x7f039014b1e0 2023-07-27T14:33:16.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.471+0000 7f0397dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0390157d10 con 0x7f039014ae00 2023-07-27T14:33:16.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f039539a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f039014b1e0 0x7f0390062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f039539a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f039014b1e0 0x7f0390062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35034/0 (socket says 172.21.15.115:35034) 2023-07-27T14:33:16.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f039539a700 1 -- 172.21.15.115:0/3066113190 learned_addr learned my addr 172.21.15.115:0/3066113190 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:16.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f0395b9b700 1 --2- 172.21.15.115:0/3066113190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f0390154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f039539a700 1 -- 172.21.15.115:0/3066113190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 msgr2=0x7f0390154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f039539a700 1 --2- 172.21.15.115:0/3066113190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f0390154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f039539a700 1 -- 172.21.15.115:0/3066113190 >> v1:172.21.15.159:6789/0 conn(0x7f03900c5c50 legacy=0x7f03900a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f039539a700 1 -- 172.21.15.115:0/3066113190 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0390157ff0 con 0x7f039014b1e0 2023-07-27T14:33:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f0395b9b700 1 --2- 172.21.15.115:0/3066113190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f0390154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f039539a700 1 --2- 172.21.15.115:0/3066113190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f039014b1e0 0x7f0390062b50 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f0380006fd0 tx=0x7f03800090f0).ready entity=mon.0 client_cookie=1625f9a3d5b96dc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.472+0000 7f0394b99700 1 -- 172.21.15.115:0/3066113190 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038000b600 con 0x7f039014b1e0 2023-07-27T14:33:16.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0394b99700 1 -- 172.21.15.115:0/3066113190 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038000b760 con 0x7f039014b1e0 2023-07-27T14:33:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0394b99700 1 -- 172.21.15.115:0/3066113190 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038000bae0 con 0x7f039014b1e0 2023-07-27T14:33:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0397dff700 1 -- 172.21.15.115:0/3066113190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f039014b1e0 msgr2=0x7f0390062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0397dff700 1 --2- 172.21.15.115:0/3066113190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f039014b1e0 0x7f0390062b50 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f0380006fd0 tx=0x7f03800090f0).stop 2023-07-27T14:33:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0397dff700 1 -- 172.21.15.115:0/3066113190 shutdown_connections 2023-07-27T14:33:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0397dff700 1 --2- 172.21.15.115:0/3066113190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f0390154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0397dff700 1 --2- 172.21.15.115:0/3066113190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f039014b1e0 0x7f0390062b50 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0397dff700 1 -- 172.21.15.115:0/3066113190 >> 172.21.15.115:0/3066113190 conn(0x7f039005e940 msgr2=0x7f03900cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:16.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0397dff700 1 -- 172.21.15.115:0/3066113190 shutdown_connections 2023-07-27T14:33:16.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.473+0000 7f0397dff700 1 -- 172.21.15.115:0/3066113190 wait complete. 2023-07-27T14:33:16.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.475+0000 7f0397dff700 1 Processor -- start 2023-07-27T14:33:16.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.475+0000 7f0397dff700 1 -- start start 2023-07-27T14:33:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0397dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03900c5c50 0x7f0390149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0397dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f03900aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0397dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f039014b1e0 0x7f03900ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0397dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900ab620 con 0x7f03900c5c50 2023-07-27T14:33:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0397dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900ae860 con 0x7f039014b1e0 2023-07-27T14:33:16.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0397dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03900adc90 con 0x7f039014ae00 2023-07-27T14:33:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0395b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03900c5c50 0x7f0390149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0395b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03900c5c50 0x7f0390149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35050/0 (socket says 172.21.15.115:35050) 2023-07-27T14:33:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0395b9b700 1 -- 172.21.15.115:0/1083904976 learned_addr learned my addr 172.21.15.115:0/1083904976 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f039539a700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f03900aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0395b9b700 1 -- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 msgr2=0x7f03900aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0395b9b700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f03900aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f039639c700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f039014b1e0 0x7f03900ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0395b9b700 1 -- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f039014b1e0 msgr2=0x7f03900ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.476+0000 7f0395b9b700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f039014b1e0 0x7f03900ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.477+0000 7f0395b9b700 1 -- 172.21.15.115:0/1083904976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0380009370 con 0x7f03900c5c50 2023-07-27T14:33:16.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.477+0000 7f039639c700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f039014b1e0 0x7f03900ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:16.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.477+0000 7f0395b9b700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03900c5c50 0x7f0390149b60 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f038c00d890 tx=0x7f038c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.477+0000 7f0385ffb700 1 -- 172.21.15.115:0/1083904976 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011590 con 0x7f03900c5c50 2023-07-27T14:33:16.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.477+0000 7f0385ffb700 1 -- 172.21.15.115:0/1083904976 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c0116f0 con 0x7f03900c5c50 2023-07-27T14:33:16.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.477+0000 7f0385ffb700 1 -- 172.21.15.115:0/1083904976 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011a70 con 0x7f03900c5c50 2023-07-27T14:33:16.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.477+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03900adf30 con 0x7f03900c5c50 2023-07-27T14:33:16.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.477+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03900ae4f0 con 0x7f03900c5c50 2023-07-27T14:33:16.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.478+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039006c470 con 0x7f03900c5c50 2023-07-27T14:33:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.479+0000 7f0385ffb700 1 -- 172.21.15.115:0/1083904976 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f038c01c460 con 0x7f03900c5c50 2023-07-27T14:33:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.479+0000 7f0385ffb700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f037405f4e0 0x7f03740619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.480+0000 7f0385ffb700 1 -- 172.21.15.115:0/1083904976 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f038c07a830 con 0x7f03900c5c50 2023-07-27T14:33:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.480+0000 7f039539a700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f037405f4e0 0x7f03740619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.480+0000 7f039539a700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f037405f4e0 0x7f03740619a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f03900c1c00 tx=0x7f0380017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.483+0000 7f0385ffb700 1 -- 172.21.15.115:0/1083904976 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f038c04b510 con 0x7f03900c5c50 2023-07-27T14:33:16.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.679+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000916240", "target": ["mon-mgr", ""]}) v1 -- 0x7f039014a050 con 0x7f037405f4e0 2023-07-27T14:33:16.723 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:16.686+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:16.723 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:16.686+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:16.724 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:16.686+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:16.724 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:16.686+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:16.724 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:16.686+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:16.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.719+0000 7f0385ffb700 1 -- 172.21.15.115:0/1083904976 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f039014a050 con 0x7f037405f4e0 2023-07-27T14:33:16.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f037405f4e0 msgr2=0x7f03740619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f037405f4e0 0x7f03740619a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f03900c1c00 tx=0x7f0380017000).stop 2023-07-27T14:33:16.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03900c5c50 msgr2=0x7f0390149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03900c5c50 0x7f0390149b60 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f038c00d890 tx=0x7f038c008040).stop 2023-07-27T14:33:16.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 shutdown_connections 2023-07-27T14:33:16.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f037405f4e0 0x7f03740619a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f039014b1e0 0x7f03900ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03900c5c50 0x7f0390149b60 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 --2- 172.21.15.115:0/1083904976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f039014ae00 0x7f03900aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 >> 172.21.15.115:0/1083904976 conn(0x7f039005e940 msgr2=0x7f03900abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:16.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 shutdown_connections 2023-07-27T14:33:16.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.721+0000 7f0397dff700 1 -- 172.21.15.115:0/1083904976 wait complete. 2023-07-27T14:33:16.776 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvolume_0000000000916240 2023-07-27T14:33:16.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.928+0000 7f71f33ff700 1 Processor -- start 2023-07-27T14:33:16.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.928+0000 7f71f33ff700 1 -- start start 2023-07-27T14:33:16.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.929+0000 7f71f33ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f71ec0c58d0 0x7f71ec150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.929+0000 7f71f33ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c3100 0x7f71ec0c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.929+0000 7f71f33ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec0c0ea0 con 0x7f71ec1509b0 2023-07-27T14:33:16.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.929+0000 7f71f33ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec068e10 con 0x7f71ec0c58d0 2023-07-27T14:33:16.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.929+0000 7f71f33ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec151280 con 0x7f71ec0c3100 2023-07-27T14:33:16.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f099a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f71ec0c58d0 0x7f71ec150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f119b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f71ec1509b0 0x7f71ec154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:38936/0 (socket says 172.21.15.115:38936) 2023-07-27T14:33:16.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f119b700 1 -- 172.21.15.115:0/4090986863 learned_addr learned my addr 172.21.15.115:0/4090986863 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:16.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f199c700 1 --2- 172.21.15.115:0/4090986863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c3100 0x7f71ec0c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f099a700 1 -- 172.21.15.115:0/4090986863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c3100 msgr2=0x7f71ec0c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:16.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f099a700 1 --2- 172.21.15.115:0/4090986863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c3100 0x7f71ec0c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f099a700 1 -- 172.21.15.115:0/4090986863 >> v1:172.21.15.159:6789/0 conn(0x7f71ec1509b0 legacy=0x7f71ec154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f099a700 1 -- 172.21.15.115:0/4090986863 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec155190 con 0x7f71ec0c58d0 2023-07-27T14:33:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.930+0000 7f71f099a700 1 --2- 172.21.15.115:0/4090986863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71ec0c58d0 0x7f71ec150d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f71dc009760 tx=0x7f71dc009060).ready entity=mon.1 client_cookie=9525767cc8789baa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71e3fff700 1 -- 172.21.15.115:0/4090986863 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00f510 con 0x7f71ec0c58d0 2023-07-27T14:33:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71e3fff700 1 -- 172.21.15.115:0/4090986863 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00f670 con 0x7f71ec0c58d0 2023-07-27T14:33:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71e3fff700 1 -- 172.21.15.115:0/4090986863 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00f9f0 con 0x7f71ec0c58d0 2023-07-27T14:33:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71f33ff700 1 -- 172.21.15.115:0/4090986863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71ec0c58d0 msgr2=0x7f71ec150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71f33ff700 1 --2- 172.21.15.115:0/4090986863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71ec0c58d0 0x7f71ec150d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f71dc009760 tx=0x7f71dc009060).stop 2023-07-27T14:33:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71f33ff700 1 -- 172.21.15.115:0/4090986863 shutdown_connections 2023-07-27T14:33:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71f33ff700 1 --2- 172.21.15.115:0/4090986863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c3100 0x7f71ec0c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71f33ff700 1 --2- 172.21.15.115:0/4090986863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71ec0c58d0 0x7f71ec150d90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71f33ff700 1 -- 172.21.15.115:0/4090986863 >> 172.21.15.115:0/4090986863 conn(0x7f71ec062320 msgr2=0x7f71ec062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71f33ff700 1 -- 172.21.15.115:0/4090986863 shutdown_connections 2023-07-27T14:33:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.931+0000 7f71f33ff700 1 -- 172.21.15.115:0/4090986863 wait complete. 2023-07-27T14:33:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.933+0000 7f71f33ff700 1 Processor -- start 2023-07-27T14:33:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.933+0000 7f71f33ff700 1 -- start start 2023-07-27T14:33:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f33ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71ec0c3100 0x7f71ec13e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f33ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c58d0 0x7f71ec142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f33ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71ec1509b0 0x7f71ec13ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f33ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec152160 con 0x7f71ec1509b0 2023-07-27T14:33:16.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f33ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0aa930 con 0x7f71ec0c3100 2023-07-27T14:33:16.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f33ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0aac10 con 0x7f71ec0c58d0 2023-07-27T14:33:16.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f199c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71ec1509b0 0x7f71ec13ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f199c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71ec1509b0 0x7f71ec13ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35066/0 (socket says 172.21.15.115:35066) 2023-07-27T14:33:16.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f199c700 1 -- 172.21.15.115:0/813216473 learned_addr learned my addr 172.21.15.115:0/813216473 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:16.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f099a700 1 --2- 172.21.15.115:0/813216473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c58d0 0x7f71ec142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.934+0000 7f71f119b700 1 --2- 172.21.15.115:0/813216473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71ec0c3100 0x7f71ec13e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71f199c700 1 -- 172.21.15.115:0/813216473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c58d0 msgr2=0x7f71ec142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71f199c700 1 --2- 172.21.15.115:0/813216473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f71ec0c58d0 0x7f71ec142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71f199c700 1 -- 172.21.15.115:0/813216473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71ec0c3100 msgr2=0x7f71ec13e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:16.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71f199c700 1 --2- 172.21.15.115:0/813216473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71ec0c3100 0x7f71ec13e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:16.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71f199c700 1 -- 172.21.15.115:0/813216473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0092a0 con 0x7f71ec1509b0 2023-07-27T14:33:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71f199c700 1 --2- 172.21.15.115:0/813216473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71ec1509b0 0x7f71ec13ec20 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f71e4009e90 tx=0x7f71e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71e17fa700 1 -- 172.21.15.115:0/813216473 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400caa0 con 0x7f71ec1509b0 2023-07-27T14:33:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71e17fa700 1 -- 172.21.15.115:0/813216473 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400f040 con 0x7f71ec1509b0 2023-07-27T14:33:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71f33ff700 1 -- 172.21.15.115:0/813216473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec0aaef0 con 0x7f71ec1509b0 2023-07-27T14:33:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71e17fa700 1 -- 172.21.15.115:0/813216473 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400ce10 con 0x7f71ec1509b0 2023-07-27T14:33:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.935+0000 7f71f33ff700 1 -- 172.21.15.115:0/813216473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec0ab4b0 con 0x7f71ec1509b0 2023-07-27T14:33:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.936+0000 7f71f33ff700 1 -- 172.21.15.115:0/813216473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec06c470 con 0x7f71ec1509b0 2023-07-27T14:33:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.937+0000 7f71e17fa700 1 -- 172.21.15.115:0/813216473 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f71e4013610 con 0x7f71ec1509b0 2023-07-27T14:33:16.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.938+0000 7f71e17fa700 1 --2- 172.21.15.115:0/813216473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71d005f4e0 0x7f71d00619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:16.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.938+0000 7f71e17fa700 1 -- 172.21.15.115:0/813216473 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f71e407b160 con 0x7f71ec1509b0 2023-07-27T14:33:16.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.938+0000 7f71f119b700 1 --2- 172.21.15.115:0/813216473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71d005f4e0 0x7f71d00619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:16.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.939+0000 7f71f119b700 1 --2- 172.21.15.115:0/813216473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71d005f4e0 0x7f71d00619a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f71e8007fd0 tx=0x7f71e8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:16.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:16.943+0000 7f71e17fa700 1 -- 172.21.15.115:0/813216473 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71e404bea0 con 0x7f71ec1509b0 2023-07-27T14:33:17.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.152+0000 7f71f33ff700 1 -- 172.21.15.115:0/813216473 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvolume_0000000000916240", "target": ["mon-mgr", ""]}) v1 -- 0x7f71ec0655d0 con 0x7f71d005f4e0 2023-07-27T14:33:17.194 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.156+0000 7fa7af9f9700 -1 mgr.server reply reply (95) Operation not supported operation 'clone-status' is not allowed on subvolume 'subvolume_0000000000916240' of type subvolume 2023-07-27T14:33:17.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.156+0000 7f71e17fa700 1 -- 172.21.15.115:0/813216473 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: -95 operation 'clone-status' is not allowed on subvolume 'subvolume_0000000000916240' of type subvolume) v1 ==== 107+0+0 (secure 0 0 0) 0x7f71ec0655d0 con 0x7f71d005f4e0 2023-07-27T14:33:17.195 INFO:teuthology.orchestra.run.smithi115.stderr:Error ENOTSUP: operation 'clone-status' is not allowed on subvolume 'subvolume_0000000000916240' of type subvolume 2023-07-27T14:33:17.203 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-07-27T14:33:17.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000916240 2023-07-27T14:33:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.356+0000 7f2784fff700 1 Processor -- start 2023-07-27T14:33:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.356+0000 7f2784fff700 1 -- start start 2023-07-27T14:33:17.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.357+0000 7f2784fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f278014ae00 0x7f2780154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:17.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.357+0000 7f2784fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2780063260 0x7f27800a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:17.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.357+0000 7f2784fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27801553f0 con 0x7f278014b1e0 2023-07-27T14:33:17.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.357+0000 7f2784fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2780157a50 con 0x7f278014ae00 2023-07-27T14:33:17.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.357+0000 7f2784fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2780157d10 con 0x7f2780063260 2023-07-27T14:33:17.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f278014ae00 0x7f2780154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:17.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277dd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f278014b1e0 0x7f2780062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44434/0 (socket says 172.21.15.115:44434) 2023-07-27T14:33:17.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277dd9b700 1 -- 172.21.15.115:0/2043156527 learned_addr learned my addr 172.21.15.115:0/2043156527 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:17.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277ed9d700 1 --2- 172.21.15.115:0/2043156527 >> v2:172.21.15.159:3300/0 conn(0x7f2780063260 0x7f27800a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:17.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277e59c700 1 -- 172.21.15.115:0/2043156527 >> v2:172.21.15.159:3300/0 conn(0x7f2780063260 msgr2=0x7f27800a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:17.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277e59c700 1 --2- 172.21.15.115:0/2043156527 >> v2:172.21.15.159:3300/0 conn(0x7f2780063260 0x7f27800a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277e59c700 1 -- 172.21.15.115:0/2043156527 >> v1:172.21.15.115:6789/0 conn(0x7f278014b1e0 legacy=0x7f2780062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:17.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277e59c700 1 -- 172.21.15.115:0/2043156527 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780157ff0 con 0x7f278014ae00 2023-07-27T14:33:17.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277ed9d700 1 --2- 172.21.15.115:0/2043156527 >> v2:172.21.15.159:3300/0 conn(0x7f2780063260 0x7f27800a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:17.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277e59c700 1 --2- 172.21.15.115:0/2043156527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f2780154f00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f2780083430 tx=0x7f2770009060).ready entity=mon.0 client_cookie=da9a1e070dedb3be server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:17.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.358+0000 7f277d59a700 1 -- 172.21.15.115:0/2043156527 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000b580 con 0x7f278014ae00 2023-07-27T14:33:17.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f277d59a700 1 -- 172.21.15.115:0/2043156527 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000b6e0 con 0x7f278014ae00 2023-07-27T14:33:17.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f277d59a700 1 -- 172.21.15.115:0/2043156527 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000ba60 con 0x7f278014ae00 2023-07-27T14:33:17.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f2784fff700 1 -- 172.21.15.115:0/2043156527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 msgr2=0x7f2780154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:17.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f2784fff700 1 --2- 172.21.15.115:0/2043156527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f2780154f00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f2780083430 tx=0x7f2770009060).stop 2023-07-27T14:33:17.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f2784fff700 1 -- 172.21.15.115:0/2043156527 shutdown_connections 2023-07-27T14:33:17.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f2784fff700 1 --2- 172.21.15.115:0/2043156527 >> v2:172.21.15.159:3300/0 conn(0x7f2780063260 0x7f27800a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f2784fff700 1 --2- 172.21.15.115:0/2043156527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f2780154f00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f2784fff700 1 -- 172.21.15.115:0/2043156527 >> 172.21.15.115:0/2043156527 conn(0x7f278005e940 msgr2=0x7f27800cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:17.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f2784fff700 1 -- 172.21.15.115:0/2043156527 shutdown_connections 2023-07-27T14:33:17.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.359+0000 7f2784fff700 1 -- 172.21.15.115:0/2043156527 wait complete. 2023-07-27T14:33:17.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.361+0000 7f2784fff700 1 Processor -- start 2023-07-27T14:33:17.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.361+0000 7f2784fff700 1 -- start start 2023-07-27T14:33:17.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f2784fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2780063260 0x7f2780167180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:17.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f2784fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f27800ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:17.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f2784fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f278014b1e0 0x7f27800c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:17.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f2784fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278013beb0 con 0x7f278014ae00 2023-07-27T14:33:17.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f2784fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27800b07d0 con 0x7f278014b1e0 2023-07-27T14:33:17.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f2784fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2780167670 con 0x7f2780063260 2023-07-27T14:33:17.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f277dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f27800ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:17.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f277dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f27800ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35096/0 (socket says 172.21.15.115:35096) 2023-07-27T14:33:17.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f277dd9b700 1 -- 172.21.15.115:0/741071211 learned_addr learned my addr 172.21.15.115:0/741071211 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:17.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f277e59c700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2780063260 0x7f2780167180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:17.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.362+0000 7f277ed9d700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f278014b1e0 0x7f27800c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:17.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f277dd9b700 1 -- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2780063260 msgr2=0x7f2780167180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:17.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f277dd9b700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2780063260 0x7f2780167180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f277dd9b700 1 -- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f278014b1e0 msgr2=0x7f27800c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:17.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f277dd9b700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f278014b1e0 0x7f27800c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f277dd9b700 1 -- 172.21.15.115:0/741071211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700092a0 con 0x7f278014ae00 2023-07-27T14:33:17.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f277ed9d700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f278014b1e0 0x7f27800c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f277dd9b700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f27800ca480 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f277400c440 tx=0x7f2774007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f276e7fc700 1 -- 172.21.15.115:0/741071211 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400ce40 con 0x7f278014ae00 2023-07-27T14:33:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f276e7fc700 1 -- 172.21.15.115:0/741071211 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27740072e0 con 0x7f278014ae00 2023-07-27T14:33:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f276e7fc700 1 -- 172.21.15.115:0/741071211 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774007660 con 0x7f278014ae00 2023-07-27T14:33:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27800b0c60 con 0x7f278014ae00 2023-07-27T14:33:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.363+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27800afea0 con 0x7f278014ae00 2023-07-27T14:33:17.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.364+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27800b0960 con 0x7f278014ae00 2023-07-27T14:33:17.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.365+0000 7f276e7fc700 1 -- 172.21.15.115:0/741071211 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 76282+0+0 (secure 0 0 0) 0x7f2774010070 con 0x7f278014ae00 2023-07-27T14:33:17.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.366+0000 7f276e7fc700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f276005f4e0 0x7f27600619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:17.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.366+0000 7f276e7fc700 1 -- 172.21.15.115:0/741071211 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2774079c00 con 0x7f278014ae00 2023-07-27T14:33:17.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.366+0000 7f277e59c700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f276005f4e0 0x7f27600619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:17.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.367+0000 7f277e59c700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f276005f4e0 0x7f27600619a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f2770009fd0 tx=0x7f2770017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:17.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.370+0000 7f276e7fc700 1 -- 172.21.15.115:0/741071211 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f277407f020 con 0x7f278014ae00 2023-07-27T14:33:17.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.568+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000916240", "target": ["mon-mgr", ""]}) v1 -- 0x7f27800c51c0 con 0x7f276005f4e0 2023-07-27T14:33:17.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.584+0000 7f276e7fc700 1 -- 172.21.15.115:0/741071211 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f27800c51c0 con 0x7f276005f4e0 2023-07-27T14:33:17.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.586+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f276005f4e0 msgr2=0x7f27600619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:17.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.586+0000 7f2784fff700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f276005f4e0 0x7f27600619a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f2770009fd0 tx=0x7f2770017000).stop 2023-07-27T14:33:17.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.586+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 msgr2=0x7f27800ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:17.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.586+0000 7f2784fff700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f27800ca480 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f277400c440 tx=0x7f2774007e20).stop 2023-07-27T14:33:17.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.587+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 shutdown_connections 2023-07-27T14:33:17.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.587+0000 7f2784fff700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f276005f4e0 0x7f27600619a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.587+0000 7f2784fff700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f278014b1e0 0x7f27800c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.587+0000 7f2784fff700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2780063260 0x7f2780167180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.587+0000 7f2784fff700 1 --2- 172.21.15.115:0/741071211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f278014ae00 0x7f27800ca480 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:17.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.587+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 >> 172.21.15.115:0/741071211 conn(0x7f278005e940 msgr2=0x7f27800a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:17.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.587+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 shutdown_connections 2023-07-27T14:33:17.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:17.587+0000 7f2784fff700 1 -- 172.21.15.115:0/741071211 wait complete. 2023-07-27T14:33:17.629 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.592+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.629 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.592+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.629 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.592+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.630 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.592+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.630 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.592+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:17.645 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:33:17.646 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.608+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.646 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.608+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.647 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.608+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.647 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.608+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.647 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:17.608+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:17.744 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:33:17.745 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:33:17.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:33:17.845 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:33:17.954 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:33:17.955 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:33:17.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:17.955 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:33:18.044 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:33:18.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:18.045 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:33:18.091 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:33:18.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:18.092 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:33:18.182 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:33:18.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:18.183 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:33:18.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:18.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.381+0000 7f61ed7ff700 1 Processor -- start 2023-07-27T14:33:18.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.381+0000 7f61ed7ff700 1 -- start start 2023-07-27T14:33:18.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.382+0000 7f61ed7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e81542a0 0x7f61e815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.382+0000 7f61ed7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e80aa4d0 con 0x7f61e8153ec0 2023-07-27T14:33:18.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.382+0000 7f61ed7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e80c05c0 con 0x7f61e80aaa40 2023-07-27T14:33:18.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.382+0000 7f61ed7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80c1a60 con 0x7f61e81542a0 2023-07-27T14:33:18.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f61e8153ec0 0x7f61e80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44450/0 (socket says 172.21.15.115:44450) 2023-07-27T14:33:18.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e6ffd700 1 -- 172.21.15.115:0/241225677 learned_addr learned my addr 172.21.15.115:0/241225677 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:18.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e77fe700 1 --2- 172.21.15.115:0/241225677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e81542a0 0x7f61e815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e5ffb700 1 -- 172.21.15.115:0/241225677 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580025290 0 0) 0x7f61d8001110 con 0x7f61e8153ec0 2023-07-27T14:33:18.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e5ffb700 1 -- 172.21.15.115:0/241225677 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d00033f0 con 0x7f61e8153ec0 2023-07-27T14:33:18.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e77fe700 1 -- 172.21.15.115:0/241225677 >> v1:172.21.15.159:6789/0 conn(0x7f61e80aaa40 legacy=0x7f61e80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e5ffb700 1 -- 172.21.15.115:0/241225677 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525241672 0 0) 0x7f61e80c05c0 con 0x7f61e80aaa40 2023-07-27T14:33:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e77fe700 1 -- 172.21.15.115:0/241225677 >> v1:172.21.15.115:6789/0 conn(0x7f61e8153ec0 legacy=0x7f61e80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e77fe700 1 -- 172.21.15.115:0/241225677 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80aa270 con 0x7f61e81542a0 2023-07-27T14:33:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.383+0000 7f61e77fe700 1 --2- 172.21.15.115:0/241225677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e81542a0 0x7f61e815efc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f61e0009e90 tx=0x7f61e0009780).ready entity=mon.2 client_cookie=ee87e7cb7ee9ea22 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61e5ffb700 1 -- 172.21.15.115:0/241225677 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000e070 con 0x7f61e81542a0 2023-07-27T14:33:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61e5ffb700 1 -- 172.21.15.115:0/241225677 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e000bb60 con 0x7f61e81542a0 2023-07-27T14:33:18.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61e5ffb700 1 -- 172.21.15.115:0/241225677 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000bee0 con 0x7f61e81542a0 2023-07-27T14:33:18.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61ed7ff700 1 -- 172.21.15.115:0/241225677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e81542a0 msgr2=0x7f61e815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61ed7ff700 1 --2- 172.21.15.115:0/241225677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e81542a0 0x7f61e815efc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f61e0009e90 tx=0x7f61e0009780).stop 2023-07-27T14:33:18.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61ed7ff700 1 -- 172.21.15.115:0/241225677 shutdown_connections 2023-07-27T14:33:18.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61ed7ff700 1 --2- 172.21.15.115:0/241225677 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e81542a0 0x7f61e815efc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61ed7ff700 1 -- 172.21.15.115:0/241225677 >> 172.21.15.115:0/241225677 conn(0x7f61e80cb610 msgr2=0x7f61e80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:18.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61ed7ff700 1 -- 172.21.15.115:0/241225677 shutdown_connections 2023-07-27T14:33:18.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.384+0000 7f61ed7ff700 1 -- 172.21.15.115:0/241225677 wait complete. 2023-07-27T14:33:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.386+0000 7f61ed7ff700 1 Processor -- start 2023-07-27T14:33:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.386+0000 7f61ed7ff700 1 -- start start 2023-07-27T14:33:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61ed7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61e80aaa40 0x7f61e80c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61ed7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e8153ec0 0x7f61e813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61ed7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e81542a0 0x7f61e8164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61ed7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8159990 con 0x7f61e81542a0 2023-07-27T14:33:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61ed7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80c41d0 con 0x7f61e80aaa40 2023-07-27T14:33:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61ed7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e81571d0 con 0x7f61e8153ec0 2023-07-27T14:33:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e81542a0 0x7f61e8164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e81542a0 0x7f61e8164260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35160/0 (socket says 172.21.15.115:35160) 2023-07-27T14:33:18.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e77fe700 1 -- 172.21.15.115:0/2270363057 learned_addr learned my addr 172.21.15.115:0/2270363057 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:18.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e6ffd700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61e80aaa40 0x7f61e80c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e67fc700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e8153ec0 0x7f61e813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e77fe700 1 -- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e8153ec0 msgr2=0x7f61e813b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e77fe700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e8153ec0 0x7f61e813b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e77fe700 1 -- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61e80aaa40 msgr2=0x7f61e80c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e77fe700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61e80aaa40 0x7f61e80c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e77fe700 1 -- 172.21.15.115:0/2270363057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0009a20 con 0x7f61e81542a0 2023-07-27T14:33:18.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.387+0000 7f61e67fc700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e8153ec0 0x7f61e813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.388+0000 7f61e77fe700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e81542a0 0x7f61e8164260 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f61e8060760 tx=0x7f61e0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.388+0000 7f61ceffd700 1 -- 172.21.15.115:0/2270363057 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e001c660 con 0x7f61e81542a0 2023-07-27T14:33:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.388+0000 7f61ceffd700 1 -- 172.21.15.115:0/2270363057 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e001c7c0 con 0x7f61e81542a0 2023-07-27T14:33:18.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.388+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e8156c10 con 0x7f61e81542a0 2023-07-27T14:33:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.388+0000 7f61ceffd700 1 -- 172.21.15.115:0/2270363057 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e001cb60 con 0x7f61e81542a0 2023-07-27T14:33:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.388+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e813bc90 con 0x7f61e81542a0 2023-07-27T14:33:18.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.389+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e80c4340 con 0x7f61e81542a0 2023-07-27T14:33:18.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.390+0000 7f61ceffd700 1 -- 172.21.15.115:0/2270363057 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 76322+0+0 (secure 0 0 0) 0x7f61e001d420 con 0x7f61e81542a0 2023-07-27T14:33:18.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.391+0000 7f61ceffd700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61d405f520 0x7f61d40619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.391+0000 7f61ceffd700 1 -- 172.21.15.115:0/2270363057 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f61e007c5c0 con 0x7f61e81542a0 2023-07-27T14:33:18.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.391+0000 7f61e6ffd700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61d405f520 0x7f61d40619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.392+0000 7f61e6ffd700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61d405f520 0x7f61d40619e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f61d8007fd0 tx=0x7f61d8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:18.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.395+0000 7f61ceffd700 1 -- 172.21.15.115:0/2270363057 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f61e80c4340 con 0x7f61e81542a0 2023-07-27T14:33:18.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.603+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61e80c4340 con 0x7f61e81542a0 2023-07-27T14:33:18.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.604+0000 7f61ceffd700 1 -- 172.21.15.115:0/2270363057 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f61e80c4340 con 0x7f61e81542a0 2023-07-27T14:33:18.642 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:18.642 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1059927938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1059927938},{"type":"v1","addr":"172.21.15.159:6834","nonce":1059927938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2712836683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2712836683},{"type":"v1","addr":"172.21.15.159:6835","nonce":2712836683}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2509102546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2509102546},{"type":"v1","addr":"172.21.15.115:6836","nonce":2509102546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:06.232999+0000","modified":"2023-07-27T14:33:09.243791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7410":{"gid":7410,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2904047998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2904047998},{"type":"v1","addr":"172.21.15.115:6837","nonce":2904047998}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-07-27T14:33:18.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61d405f520 msgr2=0x7f61d40619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61d405f520 0x7f61d40619e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f61d8007fd0 tx=0x7f61d8009040).stop 2023-07-27T14:33:18.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e81542a0 msgr2=0x7f61e8164260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e81542a0 0x7f61e8164260 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f61e8060760 tx=0x7f61e0009780).stop 2023-07-27T14:33:18.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 shutdown_connections 2023-07-27T14:33:18.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61d405f520 0x7f61d40619e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61e81542a0 0x7f61e8164260 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61e80aaa40 0x7f61e80c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 --2- 172.21.15.115:0/2270363057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61e8153ec0 0x7f61e813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.606+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 >> 172.21.15.115:0/2270363057 conn(0x7f61e80cb610 msgr2=0x7f61e80ac330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:18.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.607+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 shutdown_connections 2023-07-27T14:33:18.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.607+0000 7f61ed7ff700 1 -- 172.21.15.115:0/2270363057 wait complete. 2023-07-27T14:33:18.646 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 60 2023-07-27T14:33:18.662 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.812+0000 7f35567ff700 1 Processor -- start 2023-07-27T14:33:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.812+0000 7f35567ff700 1 -- start start 2023-07-27T14:33:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.813+0000 7f35567ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3550153ec0 0x7f35500a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.813+0000 7f35567ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f35500aa050 0x7f35500640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.813+0000 7f35567ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35500aa4d0 con 0x7f35500aaa40 2023-07-27T14:33:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.813+0000 7f35567ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35500c05c0 con 0x7f3550153ec0 2023-07-27T14:33:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.813+0000 7f35567ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35500c1a60 con 0x7f35500aa050 2023-07-27T14:33:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3550153ec0 0x7f35500a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3550153ec0 0x7f35500a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35170/0 (socket says 172.21.15.115:35170) 2023-07-27T14:33:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354ffff700 1 -- 172.21.15.115:0/2492164592 learned_addr learned my addr 172.21.15.115:0/2492164592 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354f7fe700 1 --2- 172.21.15.115:0/2492164592 >> v2:172.21.15.159:3300/0 conn(0x7f35500aa050 0x7f35500640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354ffff700 1 -- 172.21.15.115:0/2492164592 >> v2:172.21.15.159:3300/0 conn(0x7f35500aa050 msgr2=0x7f35500640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354ffff700 1 --2- 172.21.15.115:0/2492164592 >> v2:172.21.15.159:3300/0 conn(0x7f35500aa050 0x7f35500640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354ffff700 1 -- 172.21.15.115:0/2492164592 >> v1:172.21.15.159:6789/0 conn(0x7f35500aaa40 legacy=0x7f3550157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354ffff700 1 -- 172.21.15.115:0/2492164592 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500bfc90 con 0x7f3550153ec0 2023-07-27T14:33:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.814+0000 7f354ffff700 1 --2- 172.21.15.115:0/2492164592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3550153ec0 0x7f35500a9b60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f355006c0d0 tx=0x7f35400090f0).ready entity=mon.0 client_cookie=ea64228afea2dfbe server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f354effd700 1 -- 172.21.15.115:0/2492164592 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000b520 con 0x7f3550153ec0 2023-07-27T14:33:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f354effd700 1 -- 172.21.15.115:0/2492164592 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354000b680 con 0x7f3550153ec0 2023-07-27T14:33:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f354effd700 1 -- 172.21.15.115:0/2492164592 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000ba00 con 0x7f3550153ec0 2023-07-27T14:33:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f35567ff700 1 -- 172.21.15.115:0/2492164592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3550153ec0 msgr2=0x7f35500a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f35567ff700 1 --2- 172.21.15.115:0/2492164592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3550153ec0 0x7f35500a9b60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f355006c0d0 tx=0x7f35400090f0).stop 2023-07-27T14:33:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f35567ff700 1 -- 172.21.15.115:0/2492164592 shutdown_connections 2023-07-27T14:33:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f35567ff700 1 --2- 172.21.15.115:0/2492164592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3550153ec0 0x7f35500a9b60 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f35567ff700 1 --2- 172.21.15.115:0/2492164592 >> v2:172.21.15.159:3300/0 conn(0x7f35500aa050 0x7f35500640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f35567ff700 1 -- 172.21.15.115:0/2492164592 >> 172.21.15.115:0/2492164592 conn(0x7f35500cb610 msgr2=0x7f35500c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:18.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f35567ff700 1 -- 172.21.15.115:0/2492164592 shutdown_connections 2023-07-27T14:33:18.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.815+0000 7f35567ff700 1 -- 172.21.15.115:0/2492164592 wait complete. 2023-07-27T14:33:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.817+0000 7f35567ff700 1 Processor -- start 2023-07-27T14:33:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.818+0000 7f35567ff700 1 -- start start 2023-07-27T14:33:18.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f35567ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35500aa050 0x7f35500a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f35567ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35500aaa40 0x7f35501500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f35567ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3550153ec0 0x7f355014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f35567ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35500a9800 con 0x7f35500aaa40 2023-07-27T14:33:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f35567ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35501505e0 con 0x7f35500aa050 2023-07-27T14:33:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f35567ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3550153510 con 0x7f3550153ec0 2023-07-27T14:33:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35500aaa40 0x7f35501500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35500aaa40 0x7f35501500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35184/0 (socket says 172.21.15.115:35184) 2023-07-27T14:33:18.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f354f7fe700 1 -- 172.21.15.115:0/1257980765 learned_addr learned my addr 172.21.15.115:0/1257980765 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f354ffff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35500aa050 0x7f35500a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f3554d9c700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3550153ec0 0x7f355014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f354f7fe700 1 -- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3550153ec0 msgr2=0x7f355014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f354f7fe700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3550153ec0 0x7f355014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f354f7fe700 1 -- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35500aa050 msgr2=0x7f35500a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.819+0000 7f354f7fe700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35500aa050 0x7f35500a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.820+0000 7f354f7fe700 1 -- 172.21.15.115:0/1257980765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540009370 con 0x7f35500aaa40 2023-07-27T14:33:18.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.820+0000 7f354ffff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35500aa050 0x7f35500a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.820+0000 7f354f7fe700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35500aaa40 0x7f35501500f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f354400e930 tx=0x7f3544009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.820+0000 7f3537fff700 1 -- 172.21.15.115:0/1257980765 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400eed0 con 0x7f35500aaa40 2023-07-27T14:33:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.820+0000 7f3537fff700 1 -- 172.21.15.115:0/1257980765 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400c7f0 con 0x7f35500aaa40 2023-07-27T14:33:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.820+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3550150aa0 con 0x7f35500aaa40 2023-07-27T14:33:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.820+0000 7f3537fff700 1 -- 172.21.15.115:0/1257980765 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400cb70 con 0x7f35500aaa40 2023-07-27T14:33:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.820+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3550151060 con 0x7f35500aaa40 2023-07-27T14:33:18.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.821+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355006c470 con 0x7f35500aaa40 2023-07-27T14:33:18.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.822+0000 7f3537fff700 1 -- 172.21.15.115:0/1257980765 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 76322+0+0 (secure 0 0 0) 0x7f3544022070 con 0x7f35500aaa40 2023-07-27T14:33:18.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.823+0000 7f3537fff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f353c05f520 0x7f353c0619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:18.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.823+0000 7f3537fff700 1 -- 172.21.15.115:0/1257980765 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f354407ab50 con 0x7f35500aaa40 2023-07-27T14:33:18.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.823+0000 7f354ffff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f353c05f520 0x7f353c0619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:18.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.823+0000 7f354ffff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f353c05f520 0x7f353c0619e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f3540009130 tx=0x7f3540017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:18.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.827+0000 7f3537fff700 1 -- 172.21.15.115:0/1257980765 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f354404b960 con 0x7f35500aaa40 2023-07-27T14:33:19.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.996+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35500c8230 con 0x7f35500aaa40 2023-07-27T14:33:19.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.997+0000 7f3537fff700 1 -- 172.21.15.115:0/1257980765 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17086 (secure 0 0 0) 0x7f354404ef80 con 0x7f35500aaa40 2023-07-27T14:33:19.035 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:19.035 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":114,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:07.235250+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:04.573925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:05.213515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f353c05f520 msgr2=0x7f353c0619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f353c05f520 0x7f353c0619e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f3540009130 tx=0x7f3540017000).stop 2023-07-27T14:33:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35500aaa40 msgr2=0x7f35501500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35500aaa40 0x7f35501500f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f354400e930 tx=0x7f3544009060).stop 2023-07-27T14:33:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 shutdown_connections 2023-07-27T14:33:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f353c05f520 0x7f353c0619e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3550153ec0 0x7f355014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35500aa050 0x7f35500a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 --2- 172.21.15.115:0/1257980765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35500aaa40 0x7f35501500f0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 >> 172.21.15.115:0/1257980765 conn(0x7f35500cb610 msgr2=0x7f35500ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 shutdown_connections 2023-07-27T14:33:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:18.999+0000 7f35567ff700 1 -- 172.21.15.115:0/1257980765 wait complete. 2023-07-27T14:33:19.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:33:04.573925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:33:05.213515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:33:19.055 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:33:19.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.207+0000 7fec4bdff700 1 Processor -- start 2023-07-27T14:33:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.207+0000 7fec4bdff700 1 -- start start 2023-07-27T14:33:19.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.208+0000 7fec4bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec44151d20 0x7fec440c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.208+0000 7fec4bdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec441553f0 0x7fec44062b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.208+0000 7fec4bdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fec440cb210 0x7fec44063000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.208+0000 7fec4bdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440cba60 con 0x7fec441553f0 2023-07-27T14:33:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.208+0000 7fec4bdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec44154720 con 0x7fec440cb210 2023-07-27T14:33:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.208+0000 7fec4bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec440634f0 con 0x7fec44151d20 2023-07-27T14:33:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec441553f0 0x7fec44062b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec441553f0 0x7fec44062b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35190/0 (socket says 172.21.15.115:35190) 2023-07-27T14:33:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 -- 172.21.15.115:0/2340760830 learned_addr learned my addr 172.21.15.115:0/2340760830 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec49b9b700 1 --2- 172.21.15.115:0/2340760830 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec44151d20 0x7fec440c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4a39c700 1 --2- 172.21.15.115:0/2340760830 >> v2:172.21.15.159:3300/0 conn(0x7fec440cb210 0x7fec44063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 -- 172.21.15.115:0/2340760830 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec44151d20 msgr2=0x7fec440c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 --2- 172.21.15.115:0/2340760830 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec44151d20 0x7fec440c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 -- 172.21.15.115:0/2340760830 >> v2:172.21.15.159:3300/0 conn(0x7fec440cb210 msgr2=0x7fec44063000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 --2- 172.21.15.115:0/2340760830 >> v2:172.21.15.159:3300/0 conn(0x7fec440cb210 0x7fec44063000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 -- 172.21.15.115:0/2340760830 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44154f60 con 0x7fec441553f0 2023-07-27T14:33:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4a39c700 1 --2- 172.21.15.115:0/2340760830 >> v2:172.21.15.159:3300/0 conn(0x7fec440cb210 0x7fec44063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec4939a700 1 --2- 172.21.15.115:0/2340760830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec441553f0 0x7fec44062b10 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fec4406a5d0 tx=0x7fec340090f0).ready entity=mon.0 client_cookie=bbcc2fb44571f580 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec48b99700 1 -- 172.21.15.115:0/2340760830 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400b520 con 0x7fec441553f0 2023-07-27T14:33:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec48b99700 1 -- 172.21.15.115:0/2340760830 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3400b680 con 0x7fec441553f0 2023-07-27T14:33:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.209+0000 7fec48b99700 1 -- 172.21.15.115:0/2340760830 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400ba00 con 0x7fec441553f0 2023-07-27T14:33:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 -- 172.21.15.115:0/2340760830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec441553f0 msgr2=0x7fec44062b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2340760830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec441553f0 0x7fec44062b10 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fec4406a5d0 tx=0x7fec340090f0).stop 2023-07-27T14:33:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 -- 172.21.15.115:0/2340760830 shutdown_connections 2023-07-27T14:33:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2340760830 >> v2:172.21.15.159:3300/0 conn(0x7fec440cb210 0x7fec44063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2340760830 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec44151d20 0x7fec440c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2340760830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec441553f0 0x7fec44062b10 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 -- 172.21.15.115:0/2340760830 >> 172.21.15.115:0/2340760830 conn(0x7fec4405e940 msgr2=0x7fec440cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 -- 172.21.15.115:0/2340760830 shutdown_connections 2023-07-27T14:33:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.210+0000 7fec4bdff700 1 -- 172.21.15.115:0/2340760830 wait complete. 2023-07-27T14:33:19.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.212+0000 7fec4bdff700 1 Processor -- start 2023-07-27T14:33:19.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.212+0000 7fec4bdff700 1 -- start start 2023-07-27T14:33:19.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec4bdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec440cb210 0x7fec440abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec4bdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec44151d20 0x7fec440af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec4bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec441553f0 0x7fec4414ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec4bdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440ac000 con 0x7fec440cb210 2023-07-27T14:33:19.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec4bdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c2900 con 0x7fec44151d20 2023-07-27T14:33:19.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec4bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec440af6f0 con 0x7fec441553f0 2023-07-27T14:33:19.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec49b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec440cb210 0x7fec440abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec49b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec440cb210 0x7fec440abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35194/0 (socket says 172.21.15.115:35194) 2023-07-27T14:33:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec49b9b700 1 -- 172.21.15.115:0/2670212446 learned_addr learned my addr 172.21.15.115:0/2670212446 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec4939a700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec44151d20 0x7fec440af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec4a39c700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec441553f0 0x7fec4414ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec49b9b700 1 -- 172.21.15.115:0/2670212446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec441553f0 msgr2=0x7fec4414ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec49b9b700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec441553f0 0x7fec4414ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec49b9b700 1 -- 172.21.15.115:0/2670212446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec44151d20 msgr2=0x7fec440af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec49b9b700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec44151d20 0x7fec440af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.213+0000 7fec49b9b700 1 -- 172.21.15.115:0/2670212446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34009370 con 0x7fec440cb210 2023-07-27T14:33:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.214+0000 7fec49b9b700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec440cb210 0x7fec440abb10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fec4000e930 tx=0x7fec40009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.214+0000 7fec39ffb700 1 -- 172.21.15.115:0/2670212446 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40012600 con 0x7fec440cb210 2023-07-27T14:33:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.214+0000 7fec39ffb700 1 -- 172.21.15.115:0/2670212446 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec40012760 con 0x7fec440cb210 2023-07-27T14:33:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.214+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec440b05c0 con 0x7fec440cb210 2023-07-27T14:33:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.214+0000 7fec39ffb700 1 -- 172.21.15.115:0/2670212446 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40012ae0 con 0x7fec440cb210 2023-07-27T14:33:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.214+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec440aff10 con 0x7fec440cb210 2023-07-27T14:33:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.215+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec441515d0 con 0x7fec440cb210 2023-07-27T14:33:19.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.216+0000 7fec39ffb700 1 -- 172.21.15.115:0/2670212446 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 76322+0+0 (secure 0 0 0) 0x7fec40022070 con 0x7fec440cb210 2023-07-27T14:33:19.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.216+0000 7fec39ffb700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec2805f520 0x7fec280619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.217+0000 7fec39ffb700 1 -- 172.21.15.115:0/2670212446 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fec4007a950 con 0x7fec440cb210 2023-07-27T14:33:19.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.217+0000 7fec4939a700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec2805f520 0x7fec280619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.217+0000 7fec4939a700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec2805f520 0x7fec280619e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fec4406a5d0 tx=0x7fec34017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:19.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.221+0000 7fec39ffb700 1 -- 172.21.15.115:0/2670212446 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec4004b650 con 0x7fec440cb210 2023-07-27T14:33:19.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.390+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fec44060610 con 0x7fec440cb210 2023-07-27T14:33:19.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.391+0000 7fec39ffb700 1 -- 172.21.15.115:0/2670212446 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v114) v1 ==== 110+0+10 (secure 0 0 0) 0x7fec4004ec70 con 0x7fec440cb210 2023-07-27T14:33:19.429 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:33:19.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec2805f520 msgr2=0x7fec280619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec2805f520 0x7fec280619e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fec4406a5d0 tx=0x7fec34017000).stop 2023-07-27T14:33:19.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec440cb210 msgr2=0x7fec440abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec440cb210 0x7fec440abb10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fec4000e930 tx=0x7fec40009060).stop 2023-07-27T14:33:19.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 shutdown_connections 2023-07-27T14:33:19.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec2805f520 0x7fec280619e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec441553f0 0x7fec4414ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec440cb210 0x7fec440abb10 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 --2- 172.21.15.115:0/2670212446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec44151d20 0x7fec440af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 >> 172.21.15.115:0/2670212446 conn(0x7fec4405e940 msgr2=0x7fec440c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:19.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 shutdown_connections 2023-07-27T14:33:19.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.393+0000 7fec4bdff700 1 -- 172.21.15.115:0/2670212446 wait complete. 2023-07-27T14:33:19.448 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:33:19.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.601+0000 7f4df0bff700 1 Processor -- start 2023-07-27T14:33:19.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.601+0000 7f4df0bff700 1 -- start start 2023-07-27T14:33:19.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.602+0000 7f4df0bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4dec14ae00 0x7f4dec154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.602+0000 7f4df0bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4dec14b1e0 0x7f4dec062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.602+0000 7f4df0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec0c5c50 0x7f4dec063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.602+0000 7f4df0bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec063530 con 0x7f4dec14ae00 2023-07-27T14:33:19.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.602+0000 7f4df0bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec1553f0 con 0x7f4dec14b1e0 2023-07-27T14:33:19.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.602+0000 7f4df0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec157a50 con 0x7f4dec0c5c50 2023-07-27T14:33:19.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.602+0000 7f4dea59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4dec14ae00 0x7f4dec154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dea59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4dec14ae00 0x7f4dec154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35206/0 (socket says 172.21.15.115:35206) 2023-07-27T14:33:19.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dea59c700 1 -- 172.21.15.115:0/4141365910 learned_addr learned my addr 172.21.15.115:0/4141365910 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:19.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4de9d9b700 1 --2- 172.21.15.115:0/4141365910 >> v2:172.21.15.159:3300/0 conn(0x7f4dec14b1e0 0x7f4dec062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dead9d700 1 --2- 172.21.15.115:0/4141365910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec0c5c50 0x7f4dec063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dea59c700 1 -- 172.21.15.115:0/4141365910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec0c5c50 msgr2=0x7f4dec063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:19.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dea59c700 1 --2- 172.21.15.115:0/4141365910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec0c5c50 0x7f4dec063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dea59c700 1 -- 172.21.15.115:0/4141365910 >> v2:172.21.15.159:3300/0 conn(0x7f4dec14b1e0 msgr2=0x7f4dec062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:19.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dea59c700 1 --2- 172.21.15.115:0/4141365910 >> v2:172.21.15.159:3300/0 conn(0x7f4dec14b1e0 0x7f4dec062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dea59c700 1 -- 172.21.15.115:0/4141365910 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec157d10 con 0x7f4dec14ae00 2023-07-27T14:33:19.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dead9d700 1 --2- 172.21.15.115:0/4141365910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec0c5c50 0x7f4dec063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:19.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4dea59c700 1 --2- 172.21.15.115:0/4141365910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14ae00 0x7f4dec154f00 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f4dec0cbc00 tx=0x7f4ddc0090f0).ready entity=mon.0 client_cookie=1eea60dd5f51b9e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:19.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4de959a700 1 -- 172.21.15.115:0/4141365910 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00b520 con 0x7f4dec14ae00 2023-07-27T14:33:19.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4de959a700 1 -- 172.21.15.115:0/4141365910 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc00b680 con 0x7f4dec14ae00 2023-07-27T14:33:19.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.603+0000 7f4de959a700 1 -- 172.21.15.115:0/4141365910 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00ba00 con 0x7f4dec14ae00 2023-07-27T14:33:19.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 -- 172.21.15.115:0/4141365910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14ae00 msgr2=0x7f4dec154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 --2- 172.21.15.115:0/4141365910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14ae00 0x7f4dec154f00 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f4dec0cbc00 tx=0x7f4ddc0090f0).stop 2023-07-27T14:33:19.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 -- 172.21.15.115:0/4141365910 shutdown_connections 2023-07-27T14:33:19.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 --2- 172.21.15.115:0/4141365910 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec0c5c50 0x7f4dec063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 --2- 172.21.15.115:0/4141365910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14ae00 0x7f4dec154f00 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 --2- 172.21.15.115:0/4141365910 >> v2:172.21.15.159:3300/0 conn(0x7f4dec14b1e0 0x7f4dec062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 -- 172.21.15.115:0/4141365910 >> 172.21.15.115:0/4141365910 conn(0x7f4dec05e940 msgr2=0x7f4dec0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:19.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 -- 172.21.15.115:0/4141365910 shutdown_connections 2023-07-27T14:33:19.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.604+0000 7f4df0bff700 1 -- 172.21.15.115:0/4141365910 wait complete. 2023-07-27T14:33:19.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.606+0000 7f4df0bff700 1 Processor -- start 2023-07-27T14:33:19.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.606+0000 7f4df0bff700 1 -- start start 2023-07-27T14:33:19.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4df0bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dec0c5c50 0x7f4dec167f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4df0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec14ae00 0x7f4dec0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4df0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14b1e0 0x7f4dec0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4df0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0aff90 con 0x7f4dec14b1e0 2023-07-27T14:33:19.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4df0bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0af3c0 con 0x7f4dec0c5c50 2023-07-27T14:33:19.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4df0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0af660 con 0x7f4dec14ae00 2023-07-27T14:33:19.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14b1e0 0x7f4dec0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dead9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14b1e0 0x7f4dec0b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35210/0 (socket says 172.21.15.115:35210) 2023-07-27T14:33:19.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dead9d700 1 -- 172.21.15.115:0/3668405448 learned_addr learned my addr 172.21.15.115:0/3668405448 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:19.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dea59c700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dec0c5c50 0x7f4dec167f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dead9d700 1 -- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec14ae00 msgr2=0x7f4dec0b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4de9d9b700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec14ae00 0x7f4dec0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dead9d700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec14ae00 0x7f4dec0b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dead9d700 1 -- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dec0c5c50 msgr2=0x7f4dec167f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dead9d700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dec0c5c50 0x7f4dec167f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dead9d700 1 -- 172.21.15.115:0/3668405448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc009370 con 0x7f4dec14b1e0 2023-07-27T14:33:19.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4dea59c700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dec0c5c50 0x7f4dec167f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:19.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.607+0000 7f4de9d9b700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec14ae00 0x7f4dec0b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:19.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.608+0000 7f4dead9d700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14b1e0 0x7f4dec0b0910 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f4de4009f90 tx=0x7f4de40099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:19.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.608+0000 7f4dda7fc700 1 -- 172.21.15.115:0/3668405448 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400dd40 con 0x7f4dec14b1e0 2023-07-27T14:33:19.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.608+0000 7f4dda7fc700 1 -- 172.21.15.115:0/3668405448 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de400f040 con 0x7f4dec14b1e0 2023-07-27T14:33:19.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.608+0000 7f4dda7fc700 1 -- 172.21.15.115:0/3668405448 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400dea0 con 0x7f4dec14b1e0 2023-07-27T14:33:19.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.608+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec0af940 con 0x7f4dec14b1e0 2023-07-27T14:33:19.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.608+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec168420 con 0x7f4dec14b1e0 2023-07-27T14:33:19.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.609+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec0b0140 con 0x7f4dec14b1e0 2023-07-27T14:33:19.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.610+0000 7f4dda7fc700 1 -- 172.21.15.115:0/3668405448 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 76322+0+0 (secure 0 0 0) 0x7f4de4013810 con 0x7f4dec14b1e0 2023-07-27T14:33:19.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.611+0000 7f4dda7fc700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4dcc05f520 0x7f4dcc0619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:19.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.611+0000 7f4dda7fc700 1 -- 172.21.15.115:0/3668405448 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4de407af10 con 0x7f4dec14b1e0 2023-07-27T14:33:19.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.611+0000 7f4dea59c700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4dcc05f520 0x7f4dcc0619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:19.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.611+0000 7f4dea59c700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4dcc05f520 0x7f4dcc0619e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f4ddc00b2e0 tx=0x7f4ddc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:19.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.614+0000 7f4dda7fc700 1 -- 172.21.15.115:0/3668405448 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4dec0b0140 con 0x7f4dec14b1e0 2023-07-27T14:33:19.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.640+0000 7f4dda7fc700 1 -- 172.21.15.115:0/3668405448 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f4de4078680 con 0x7f4dec14b1e0 2023-07-27T14:33:19.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.792+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4dec0b0140 con 0x7f4dec14b1e0 2023-07-27T14:33:19.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.793+0000 7f4dda7fc700 1 -- 172.21.15.115:0/3668405448 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4dec0b0140 con 0x7f4dec14b1e0 2023-07-27T14:33:19.831 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:33:19.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4dcc05f520 msgr2=0x7f4dcc0619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4dcc05f520 0x7f4dcc0619e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f4ddc00b2e0 tx=0x7f4ddc017000).stop 2023-07-27T14:33:19.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14b1e0 msgr2=0x7f4dec0b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:19.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14b1e0 0x7f4dec0b0910 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f4de4009f90 tx=0x7f4de40099b0).stop 2023-07-27T14:33:19.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 shutdown_connections 2023-07-27T14:33:19.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4dcc05f520 0x7f4dcc0619e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec14b1e0 0x7f4dec0b0910 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4dec0c5c50 0x7f4dec167f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 --2- 172.21.15.115:0/3668405448 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4dec14ae00 0x7f4dec0b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:19.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 >> 172.21.15.115:0/3668405448 conn(0x7f4dec05e940 msgr2=0x7f4dec064770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:19.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 shutdown_connections 2023-07-27T14:33:19.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:19.795+0000 7f4df0bff700 1 -- 172.21.15.115:0/3668405448 wait complete. 2023-07-27T14:33:19.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:33:20.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.002+0000 7f0004fff700 1 Processor -- start 2023-07-27T14:33:20.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.002+0000 7f0004fff700 1 -- start start 2023-07-27T14:33:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.003+0000 7f0004fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f00001509b0 0x7f00000c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.003+0000 7f0004fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00000c0ea0 con 0x7f0000150d90 2023-07-27T14:33:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.003+0000 7f0004fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0000068e10 con 0x7f00000c3100 2023-07-27T14:33:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.003+0000 7f0004fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0000155190 con 0x7f00001509b0 2023-07-27T14:33:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.003+0000 7efffdd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0000150d90 0x7f0000154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44452/0 (socket says 172.21.15.115:44452) 2023-07-27T14:33:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.003+0000 7efffdd9b700 1 -- 172.21.15.115:0/3406659656 learned_addr learned my addr 172.21.15.115:0/3406659656 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffe59c700 1 --2- 172.21.15.115:0/3406659656 >> v2:172.21.15.159:3300/0 conn(0x7f00001509b0 0x7f00000c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103953625 0 0) 0x7f00000c0ea0 con 0x7f0000150d90 2023-07-27T14:33:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe80033f0 con 0x7f0000150d90 2023-07-27T14:33:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207575237 0 0) 0x7effe80033f0 con 0x7f0000150d90 2023-07-27T14:33:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 >> v2:172.21.15.159:3300/0 conn(0x7f00001509b0 msgr2=0x7f00000c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 --2- 172.21.15.115:0/3406659656 >> v2:172.21.15.159:3300/0 conn(0x7f00001509b0 0x7f00000c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 >> v1:172.21.15.159:6789/0 conn(0x7f00000c3100 legacy=0x7f00000c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000155470 con 0x7f0000150d90 2023-07-27T14:33:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7efff4001470 con 0x7f0000150d90 2023-07-27T14:33:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 >> v1:172.21.15.115:6789/0 conn(0x7f0000150d90 legacy=0x7f0000154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe80038e0 0x7effe8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe8004690 0x7effe8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe8005000 0x7effe800daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0000155190 con 0x7effe80038e0 2023-07-27T14:33:20.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe800e0c0 con 0x7effe8005000 2023-07-27T14:33:20.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe800e280 con 0x7effe8004690 2023-07-27T14:33:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.004+0000 7efffe59c700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe80038e0 0x7effe8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffdd9b700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe8004690 0x7effe8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffed9d700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe8005000 0x7effe800daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffe59c700 1 -- 172.21.15.115:0/3406659656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe8004690 msgr2=0x7effe8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffe59c700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe8004690 0x7effe8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffe59c700 1 -- 172.21.15.115:0/3406659656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe8005000 msgr2=0x7effe800daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffe59c700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe8005000 0x7effe800daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffe59c700 1 -- 172.21.15.115:0/3406659656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80033f0 con 0x7effe80038e0 2023-07-27T14:33:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffed9d700 1 -- 172.21.15.115:0/3406659656 reap_dead start 2023-07-27T14:33:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffe59c700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe80038e0 0x7effe8003d00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7efff0009a80 tx=0x7efff0009060).ready entity=mon.0 client_cookie=bd2cd4519f9e24f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0009430 con 0x7effe80038e0 2023-07-27T14:33:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff000e640 con 0x7effe80038e0 2023-07-27T14:33:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.005+0000 7efffd59a700 1 -- 172.21.15.115:0/3406659656 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000e9c0 con 0x7effe80038e0 2023-07-27T14:33:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.006+0000 7f0004fff700 1 -- 172.21.15.115:0/3406659656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe80038e0 msgr2=0x7effe8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.006+0000 7f0004fff700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe80038e0 0x7effe8003d00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7efff0009a80 tx=0x7efff0009060).stop 2023-07-27T14:33:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.006+0000 7f0004fff700 1 -- 172.21.15.115:0/3406659656 shutdown_connections 2023-07-27T14:33:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.006+0000 7f0004fff700 1 --2- 172.21.15.115:0/3406659656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe80038e0 0x7effe8003d00 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.006+0000 7f0004fff700 1 -- 172.21.15.115:0/3406659656 >> 172.21.15.115:0/3406659656 conn(0x7f0000062320 msgr2=0x7f0000062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.006+0000 7f0004fff700 1 -- 172.21.15.115:0/3406659656 shutdown_connections 2023-07-27T14:33:20.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.006+0000 7f0004fff700 1 -- 172.21.15.115:0/3406659656 wait complete. 2023-07-27T14:33:20.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.007+0000 7f0004fff700 1 Processor -- start 2023-07-27T14:33:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.007+0000 7f0004fff700 1 -- start start 2023-07-27T14:33:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.008+0000 7f0004fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe80038e0 0x7f00000a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.008+0000 7f0004fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00000a87c0 0x7f0000164730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.008+0000 7f0004fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0000164c20 0x7f0000063da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.008+0000 7f0004fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000aa410 con 0x7f0000164c20 2023-07-27T14:33:20.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.008+0000 7f0004fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000aa110 con 0x7f00000a87c0 2023-07-27T14:33:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.008+0000 7f0004fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00000a8c50 con 0x7effe80038e0 2023-07-27T14:33:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.008+0000 7efffed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0000164c20 0x7f0000063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0000164c20 0x7f0000063da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35226/0 (socket says 172.21.15.115:35226) 2023-07-27T14:33:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffed9d700 1 -- 172.21.15.115:0/3434989821 learned_addr learned my addr 172.21.15.115:0/3434989821 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffe59c700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe80038e0 0x7f00000a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffdd9b700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00000a87c0 0x7f0000164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffed9d700 1 -- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe80038e0 msgr2=0x7f00000a82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffed9d700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe80038e0 0x7f00000a82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffed9d700 1 -- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00000a87c0 msgr2=0x7f0000164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffed9d700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00000a87c0 0x7f0000164730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffed9d700 1 -- 172.21.15.115:0/3434989821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00000a8f30 con 0x7f0000164c20 2023-07-27T14:33:20.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffdd9b700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00000a87c0 0x7f0000164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7efffed9d700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0000164c20 0x7f0000063da0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f0000067c90 tx=0x7efff8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7effee7fc700 1 -- 172.21.15.115:0/3434989821 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8003030 con 0x7f0000164c20 2023-07-27T14:33:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7effee7fc700 1 -- 172.21.15.115:0/3434989821 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff8003190 con 0x7f0000164c20 2023-07-27T14:33:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00000a9210 con 0x7f0000164c20 2023-07-27T14:33:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.009+0000 7effee7fc700 1 -- 172.21.15.115:0/3434989821 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8003510 con 0x7f0000164c20 2023-07-27T14:33:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.010+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0000064450 con 0x7f0000164c20 2023-07-27T14:33:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.010+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00000aa5c0 con 0x7f0000164c20 2023-07-27T14:33:20.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.011+0000 7effee7fc700 1 -- 172.21.15.115:0/3434989821 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7efff801e070 con 0x7f0000164c20 2023-07-27T14:33:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.012+0000 7effee7fc700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effe005f5b0 0x7effe0061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.012+0000 7effee7fc700 1 -- 172.21.15.115:0/3434989821 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efff8079bc0 con 0x7f0000164c20 2023-07-27T14:33:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.012+0000 7efffe59c700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effe005f5b0 0x7effe0061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.013+0000 7efffe59c700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effe005f5b0 0x7effe0061a70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7efff0006d50 tx=0x7efff001a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.016+0000 7effee7fc700 1 -- 172.21.15.115:0/3434989821 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f00000aa5c0 con 0x7f0000164c20 2023-07-27T14:33:20.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.183+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00000aa5c0 con 0x7f0000164c20 2023-07-27T14:33:20.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.184+0000 7effee7fc700 1 -- 172.21.15.115:0/3434989821 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00000aa5c0 con 0x7f0000164c20 2023-07-27T14:33:20.222 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:33:20.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effe005f5b0 msgr2=0x7effe0061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effe005f5b0 0x7effe0061a70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7efff0006d50 tx=0x7efff001a000).stop 2023-07-27T14:33:20.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0000164c20 msgr2=0x7f0000063da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0000164c20 0x7f0000063da0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f0000067c90 tx=0x7efff8009040).stop 2023-07-27T14:33:20.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 shutdown_connections 2023-07-27T14:33:20.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effe005f5b0 0x7effe0061a70 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0000164c20 0x7f0000063da0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe80038e0 0x7f00000a82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 --2- 172.21.15.115:0/3434989821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00000a87c0 0x7f0000164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 >> 172.21.15.115:0/3434989821 conn(0x7f0000062320 msgr2=0x7f00000c4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:20.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 shutdown_connections 2023-07-27T14:33:20.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.186+0000 7f0004fff700 1 -- 172.21.15.115:0/3434989821 wait complete. 2023-07-27T14:33:20.241 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:33:20.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.394+0000 7ff46d5ff700 1 Processor -- start 2023-07-27T14:33:20.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.394+0000 7ff46d5ff700 1 -- start start 2023-07-27T14:33:20.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.395+0000 7ff46d5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff468063260 0x7ff468154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.395+0000 7ff46d5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff46814b1e0 0x7ff4680a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.395+0000 7ff46d5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4681553f0 con 0x7ff46814ae00 2023-07-27T14:33:20.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.395+0000 7ff46d5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff468157a50 con 0x7ff46814b1e0 2023-07-27T14:33:20.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.395+0000 7ff46d5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff468157d10 con 0x7ff468063260 2023-07-27T14:33:20.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff4677fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff46814b1e0 0x7ff4680a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff4677fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff46814b1e0 0x7ff4680a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:48144/0 (socket says 172.21.15.115:48144) 2023-07-27T14:33:20.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff4677fe700 1 -- 172.21.15.115:0/2176732840 learned_addr learned my addr 172.21.15.115:0/2176732840 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:20.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff4667fc700 1 --2- 172.21.15.115:0/2176732840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff468063260 0x7ff468154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff466ffd700 1 --1- 172.21.15.115:0/2176732840 >> v1:172.21.15.159:6789/0 conn(0x7ff46814ae00 0x7ff468062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:38976/0 (socket says 172.21.15.115:38976) 2023-07-27T14:33:20.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff4667fc700 1 -- 172.21.15.115:0/2176732840 >> v2:172.21.15.159:3300/0 conn(0x7ff46814b1e0 msgr2=0x7ff4680a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:20.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff4667fc700 1 --2- 172.21.15.115:0/2176732840 >> v2:172.21.15.159:3300/0 conn(0x7ff46814b1e0 0x7ff4680a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff4667fc700 1 -- 172.21.15.115:0/2176732840 >> v1:172.21.15.159:6789/0 conn(0x7ff46814ae00 legacy=0x7ff468062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.396+0000 7ff4667fc700 1 -- 172.21.15.115:0/2176732840 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468157ff0 con 0x7ff468063260 2023-07-27T14:33:20.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff4667fc700 1 --2- 172.21.15.115:0/2176732840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff468063260 0x7ff468154f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff45c009760 tx=0x7ff45c009060).ready entity=mon.2 client_cookie=8352d1b95746685 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff465ffb700 1 -- 172.21.15.115:0/2176732840 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00f510 con 0x7ff468063260 2023-07-27T14:33:20.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff465ffb700 1 -- 172.21.15.115:0/2176732840 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c00f670 con 0x7ff468063260 2023-07-27T14:33:20.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff465ffb700 1 -- 172.21.15.115:0/2176732840 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00f9f0 con 0x7ff468063260 2023-07-27T14:33:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff46d5ff700 1 -- 172.21.15.115:0/2176732840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff468063260 msgr2=0x7ff468154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/2176732840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff468063260 0x7ff468154f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff45c009760 tx=0x7ff45c009060).stop 2023-07-27T14:33:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff46d5ff700 1 -- 172.21.15.115:0/2176732840 shutdown_connections 2023-07-27T14:33:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/2176732840 >> v2:172.21.15.159:3300/0 conn(0x7ff46814b1e0 0x7ff4680a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/2176732840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff468063260 0x7ff468154f00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff46d5ff700 1 -- 172.21.15.115:0/2176732840 >> 172.21.15.115:0/2176732840 conn(0x7ff46805e940 msgr2=0x7ff4680cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.397+0000 7ff46d5ff700 1 -- 172.21.15.115:0/2176732840 shutdown_connections 2023-07-27T14:33:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.398+0000 7ff46d5ff700 1 -- 172.21.15.115:0/2176732840 wait complete. 2023-07-27T14:33:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.399+0000 7ff46d5ff700 1 Processor -- start 2023-07-27T14:33:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.399+0000 7ff46d5ff700 1 -- start start 2023-07-27T14:33:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff46d5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff468063260 0x7ff4680b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff46d5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff46814ae00 0x7ff4680ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff46d5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46814b1e0 0x7ff4680c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff46d5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680af170 con 0x7ff468063260 2023-07-27T14:33:20.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff46d5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680c1c50 con 0x7ff46814b1e0 2023-07-27T14:33:20.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff46d5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680ae930 con 0x7ff46814ae00 2023-07-27T14:33:20.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff468063260 0x7ff4680b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff468063260 0x7ff4680b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35234/0 (socket says 172.21.15.115:35234) 2023-07-27T14:33:20.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff466ffd700 1 -- 172.21.15.115:0/691994832 learned_addr learned my addr 172.21.15.115:0/691994832 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:20.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff4667fc700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff46814ae00 0x7ff4680ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.400+0000 7ff4677fe700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46814b1e0 0x7ff4680c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff466ffd700 1 -- 172.21.15.115:0/691994832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff46814ae00 msgr2=0x7ff4680ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff466ffd700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff46814ae00 0x7ff4680ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff466ffd700 1 -- 172.21.15.115:0/691994832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46814b1e0 msgr2=0x7ff4680c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff466ffd700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46814b1e0 0x7ff4680c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff466ffd700 1 -- 172.21.15.115:0/691994832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0092a0 con 0x7ff468063260 2023-07-27T14:33:20.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff466ffd700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff468063260 0x7ff4680b0870 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7ff458007fd0 tx=0x7ff458007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff44effd700 1 -- 172.21.15.115:0/691994832 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45800ce10 con 0x7ff468063260 2023-07-27T14:33:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff44effd700 1 -- 172.21.15.115:0/691994832 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4580072e0 con 0x7ff468063260 2023-07-27T14:33:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff44effd700 1 -- 172.21.15.115:0/691994832 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580056e0 con 0x7ff468063260 2023-07-27T14:33:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4680aebb0 con 0x7ff468063260 2023-07-27T14:33:20.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.401+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4680c1e60 con 0x7ff468063260 2023-07-27T14:33:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.402+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46806c470 con 0x7ff468063260 2023-07-27T14:33:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.403+0000 7ff44effd700 1 -- 172.21.15.115:0/691994832 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7ff458010070 con 0x7ff468063260 2023-07-27T14:33:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.404+0000 7ff44effd700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff45405f5b0 0x7ff454061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.404+0000 7ff44effd700 1 -- 172.21.15.115:0/691994832 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff458079e30 con 0x7ff468063260 2023-07-27T14:33:20.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.404+0000 7ff4667fc700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff45405f5b0 0x7ff454061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.405+0000 7ff4667fc700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff45405f5b0 0x7ff454061a70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7ff468063660 tx=0x7ff45c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.408+0000 7ff44effd700 1 -- 172.21.15.115:0/691994832 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff45804aaa0 con 0x7ff468063260 2023-07-27T14:33:20.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.578+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4680c2470 con 0x7ff468063260 2023-07-27T14:33:20.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.579+0000 7ff44effd700 1 -- 172.21.15.115:0/691994832 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff45804e0c0 con 0x7ff468063260 2023-07-27T14:33:20.618 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:33:20.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff45405f5b0 msgr2=0x7ff454061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff45405f5b0 0x7ff454061a70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7ff468063660 tx=0x7ff45c017000).stop 2023-07-27T14:33:20.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff468063260 msgr2=0x7ff4680b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff468063260 0x7ff4680b0870 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7ff458007fd0 tx=0x7ff458007df0).stop 2023-07-27T14:33:20.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 shutdown_connections 2023-07-27T14:33:20.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff45405f5b0 0x7ff454061a70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46814b1e0 0x7ff4680c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff468063260 0x7ff4680b0870 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 --2- 172.21.15.115:0/691994832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff46814ae00 0x7ff4680ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 >> 172.21.15.115:0/691994832 conn(0x7ff46805e940 msgr2=0x7ff4680ac4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:20.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 shutdown_connections 2023-07-27T14:33:20.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.581+0000 7ff46d5ff700 1 -- 172.21.15.115:0/691994832 wait complete. 2023-07-27T14:33:20.637 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:20.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.787+0000 7f1040dff700 1 Processor -- start 2023-07-27T14:33:20.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.787+0000 7f1040dff700 1 -- start start 2023-07-27T14:33:20.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.788+0000 7f1040dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f103c0aaa40 0x7f103c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.788+0000 7f1040dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f103c1542a0 0x7f103c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.788+0000 7f1040dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0aa4d0 con 0x7f103c153ec0 2023-07-27T14:33:20.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.788+0000 7f1040dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c064ad0 con 0x7f103c0aaa40 2023-07-27T14:33:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.788+0000 7f1040dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0c05c0 con 0x7f103c1542a0 2023-07-27T14:33:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f1039d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f103c0aaa40 0x7f103c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f1039d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f103c0aaa40 0x7f103c0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35248/0 (socket says 172.21.15.115:35248) 2023-07-27T14:33:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f1039d9b700 1 -- 172.21.15.115:0/1185172926 learned_addr learned my addr 172.21.15.115:0/1185172926 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f103ad9d700 1 --2- 172.21.15.115:0/1185172926 >> v2:172.21.15.159:3300/0 conn(0x7f103c1542a0 0x7f103c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f1039d9b700 1 -- 172.21.15.115:0/1185172926 >> v2:172.21.15.159:3300/0 conn(0x7f103c1542a0 msgr2=0x7f103c0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:20.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f1039d9b700 1 --2- 172.21.15.115:0/1185172926 >> v2:172.21.15.159:3300/0 conn(0x7f103c1542a0 0x7f103c0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f1039d9b700 1 -- 172.21.15.115:0/1185172926 >> v1:172.21.15.159:6789/0 conn(0x7f103c153ec0 legacy=0x7f103c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:20.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f1039d9b700 1 -- 172.21.15.115:0/1185172926 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c0c1a60 con 0x7f103c0aaa40 2023-07-27T14:33:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f1039d9b700 1 --2- 172.21.15.115:0/1185172926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0aaa40 0x7f103c0640f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f103c0c5470 tx=0x7f10300090f0).ready entity=mon.0 client_cookie=b01f032247945152 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.789+0000 7f103959a700 1 -- 172.21.15.115:0/1185172926 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103000b5a0 con 0x7f103c0aaa40 2023-07-27T14:33:20.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f103959a700 1 -- 172.21.15.115:0/1185172926 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103000b700 con 0x7f103c0aaa40 2023-07-27T14:33:20.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f103959a700 1 -- 172.21.15.115:0/1185172926 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103000ba80 con 0x7f103c0aaa40 2023-07-27T14:33:20.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f1040dff700 1 -- 172.21.15.115:0/1185172926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0aaa40 msgr2=0x7f103c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f1040dff700 1 --2- 172.21.15.115:0/1185172926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0aaa40 0x7f103c0640f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f103c0c5470 tx=0x7f10300090f0).stop 2023-07-27T14:33:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f1040dff700 1 -- 172.21.15.115:0/1185172926 shutdown_connections 2023-07-27T14:33:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f1040dff700 1 --2- 172.21.15.115:0/1185172926 >> v2:172.21.15.159:3300/0 conn(0x7f103c1542a0 0x7f103c0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f1040dff700 1 --2- 172.21.15.115:0/1185172926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0aaa40 0x7f103c0640f0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f1040dff700 1 -- 172.21.15.115:0/1185172926 >> 172.21.15.115:0/1185172926 conn(0x7f103c0cb610 msgr2=0x7f103c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f1040dff700 1 -- 172.21.15.115:0/1185172926 shutdown_connections 2023-07-27T14:33:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.790+0000 7f1040dff700 1 -- 172.21.15.115:0/1185172926 wait complete. 2023-07-27T14:33:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.792+0000 7f1040dff700 1 Processor -- start 2023-07-27T14:33:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.792+0000 7f1040dff700 1 -- start start 2023-07-27T14:33:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1040dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f103c0aaa40 0x7f103c0b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1040dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c153ec0 0x7f103c1674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1040dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f103c1542a0 0x7f103c1679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1040dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c167ea0 con 0x7f103c153ec0 2023-07-27T14:33:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1040dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c14d8f0 con 0x7f103c1542a0 2023-07-27T14:33:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1040dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c159be0 con 0x7f103c0aaa40 2023-07-27T14:33:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1039d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c153ec0 0x7f103c1674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1039d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c153ec0 0x7f103c1674c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35264/0 (socket says 172.21.15.115:35264) 2023-07-27T14:33:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1039d9b700 1 -- 172.21.15.115:0/109536820 learned_addr learned my addr 172.21.15.115:0/109536820 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f103ad9d700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f103c1542a0 0x7f103c1679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f103a59c700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f103c0aaa40 0x7f103c0b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1039d9b700 1 -- 172.21.15.115:0/109536820 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f103c0aaa40 msgr2=0x7f103c0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1039d9b700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f103c0aaa40 0x7f103c0b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1039d9b700 1 -- 172.21.15.115:0/109536820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f103c1542a0 msgr2=0x7f103c1679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1039d9b700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f103c1542a0 0x7f103c1679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.793+0000 7f1039d9b700 1 -- 172.21.15.115:0/109536820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030009370 con 0x7f103c153ec0 2023-07-27T14:33:20.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.794+0000 7f1039d9b700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c153ec0 0x7f103c1674c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f1030009130 tx=0x7f1030015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.794+0000 7f102a7fc700 1 -- 172.21.15.115:0/109536820 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103000ba80 con 0x7f103c153ec0 2023-07-27T14:33:20.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.794+0000 7f102a7fc700 1 -- 172.21.15.115:0/109536820 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1030000c90 con 0x7f103c153ec0 2023-07-27T14:33:20.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.794+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c159900 con 0x7f103c153ec0 2023-07-27T14:33:20.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.794+0000 7f102a7fc700 1 -- 172.21.15.115:0/109536820 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103001c670 con 0x7f103c153ec0 2023-07-27T14:33:20.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.794+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c14d580 con 0x7f103c153ec0 2023-07-27T14:33:20.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.795+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c06c470 con 0x7f103c153ec0 2023-07-27T14:33:20.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.796+0000 7f102a7fc700 1 -- 172.21.15.115:0/109536820 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f103002c070 con 0x7f103c153ec0 2023-07-27T14:33:20.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.796+0000 7f102a7fc700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f101c05f580 0x7f101c061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:20.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.797+0000 7f102a7fc700 1 -- 172.21.15.115:0/109536820 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f103007bef0 con 0x7f103c153ec0 2023-07-27T14:33:20.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.797+0000 7f103a59c700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f101c05f580 0x7f101c061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:20.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.797+0000 7f103a59c700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f101c05f580 0x7f101c061a40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f102c0036e0 tx=0x7f102c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:20.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:20.801+0000 7f102a7fc700 1 -- 172.21.15.115:0/109536820 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f103004cf60 con 0x7f103c153ec0 2023-07-27T14:33:21.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.013+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f103c0aa4d0 con 0x7f103c153ec0 2023-07-27T14:33:21.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.013+0000 7f102a7fc700 1 -- 172.21.15.115:0/109536820 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f103c0aa4d0 con 0x7f103c153ec0 2023-07-27T14:33:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:21.053 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1059927938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1059927938},{"type":"v1","addr":"172.21.15.159:6834","nonce":1059927938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2712836683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2712836683},{"type":"v1","addr":"172.21.15.159:6835","nonce":2712836683}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2509102546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2509102546},{"type":"v1","addr":"172.21.15.115:6836","nonce":2509102546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:06.232999+0000","modified":"2023-07-27T14:33:09.243791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7410":{"gid":7410,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2904047998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2904047998},{"type":"v1","addr":"172.21.15.115:6837","nonce":2904047998}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-07-27T14:33:21.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f101c05f580 msgr2=0x7f101c061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f101c05f580 0x7f101c061a40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f102c0036e0 tx=0x7f102c009040).stop 2023-07-27T14:33:21.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c153ec0 msgr2=0x7f103c1674c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c153ec0 0x7f103c1674c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f1030009130 tx=0x7f1030015000).stop 2023-07-27T14:33:21.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 shutdown_connections 2023-07-27T14:33:21.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f101c05f580 0x7f101c061a40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f103c1542a0 0x7f103c1679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f103c0aaa40 0x7f103c0b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.015+0000 7f1040dff700 1 --2- 172.21.15.115:0/109536820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c153ec0 0x7f103c1674c0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.016+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 >> 172.21.15.115:0/109536820 conn(0x7f103c0cb610 msgr2=0x7f103c0abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:21.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.016+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 shutdown_connections 2023-07-27T14:33:21.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.016+0000 7f1040dff700 1 -- 172.21.15.115:0/109536820 wait complete. 2023-07-27T14:33:21.056 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 60 2023-07-27T14:33:21.071 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:21.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.220+0000 7f190d7ff700 1 Processor -- start 2023-07-27T14:33:21.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.220+0000 7f190d7ff700 1 -- start start 2023-07-27T14:33:21.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.221+0000 7f190d7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19081542a0 0x7f190815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.221+0000 7f190d7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19080aa4d0 con 0x7f1908153ec0 2023-07-27T14:33:21.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.221+0000 7f190d7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19080c05c0 con 0x7f19080aaa40 2023-07-27T14:33:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.221+0000 7f190d7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080c1a60 con 0x7f19081542a0 2023-07-27T14:33:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f1906ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1908153ec0 0x7f19080a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44468/0 (socket says 172.21.15.115:44468) 2023-07-27T14:33:21.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f1906ffd700 1 -- 172.21.15.115:0/1806869168 learned_addr learned my addr 172.21.15.115:0/1806869168 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:21.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f19077fe700 1 --2- 172.21.15.115:0/1806869168 >> v2:172.21.15.115:3300/0 conn(0x7f19081542a0 0x7f190815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f1905ffb700 1 -- 172.21.15.115:0/1806869168 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686566384 0 0) 0x7f18f8001110 con 0x7f1908153ec0 2023-07-27T14:33:21.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f1905ffb700 1 -- 172.21.15.115:0/1806869168 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f00033f0 con 0x7f1908153ec0 2023-07-27T14:33:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f19077fe700 1 -- 172.21.15.115:0/1806869168 >> v1:172.21.15.159:6789/0 conn(0x7f19080aaa40 legacy=0x7f19080640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f19077fe700 1 -- 172.21.15.115:0/1806869168 >> v1:172.21.15.115:6789/0 conn(0x7f1908153ec0 legacy=0x7f19080a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f19077fe700 1 -- 172.21.15.115:0/1806869168 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080aa270 con 0x7f19081542a0 2023-07-27T14:33:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.222+0000 7f19077fe700 1 --2- 172.21.15.115:0/1806869168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f190815efc0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f1900009e60 tx=0x7f1900009780).ready entity=mon.0 client_cookie=46ad24000779b718 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f1905ffb700 1 -- 172.21.15.115:0/1806869168 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190000e070 con 0x7f19081542a0 2023-07-27T14:33:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f1905ffb700 1 -- 172.21.15.115:0/1806869168 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190000bb60 con 0x7f19081542a0 2023-07-27T14:33:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f1905ffb700 1 -- 172.21.15.115:0/1806869168 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900012410 con 0x7f19081542a0 2023-07-27T14:33:21.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f190d7ff700 1 -- 172.21.15.115:0/1806869168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 msgr2=0x7f190815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f190d7ff700 1 --2- 172.21.15.115:0/1806869168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f190815efc0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f1900009e60 tx=0x7f1900009780).stop 2023-07-27T14:33:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f190d7ff700 1 -- 172.21.15.115:0/1806869168 shutdown_connections 2023-07-27T14:33:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f190d7ff700 1 --2- 172.21.15.115:0/1806869168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f190815efc0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f190d7ff700 1 -- 172.21.15.115:0/1806869168 >> 172.21.15.115:0/1806869168 conn(0x7f19080cb610 msgr2=0x7f19080c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f190d7ff700 1 -- 172.21.15.115:0/1806869168 shutdown_connections 2023-07-27T14:33:21.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.223+0000 7f190d7ff700 1 -- 172.21.15.115:0/1806869168 wait complete. 2023-07-27T14:33:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.225+0000 7f190d7ff700 1 Processor -- start 2023-07-27T14:33:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.225+0000 7f190d7ff700 1 -- start start 2023-07-27T14:33:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f190d7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080aaa40 0x7f1908141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f190d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1908153ec0 0x7f19080c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f190d7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f19080c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f190d7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19080c9d00 con 0x7f19081542a0 2023-07-27T14:33:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f190d7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908164c10 con 0x7f19080aaa40 2023-07-27T14:33:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f190d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1908164300 con 0x7f1908153ec0 2023-07-27T14:33:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f19080c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f19080c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35282/0 (socket says 172.21.15.115:35282) 2023-07-27T14:33:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 -- 172.21.15.115:0/1158037174 learned_addr learned my addr 172.21.15.115:0/1158037174 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:21.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19067fc700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1908153ec0 0x7f19080c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f1906ffd700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080aaa40 0x7f1908141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 -- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1908153ec0 msgr2=0x7f19080c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1908153ec0 0x7f19080c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 -- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080aaa40 msgr2=0x7f1908141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080aaa40 0x7f1908141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 -- 172.21.15.115:0/1158037174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900009a20 con 0x7f19081542a0 2023-07-27T14:33:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19067fc700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1908153ec0 0x7f19080c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:21.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f1906ffd700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080aaa40 0x7f1908141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:21.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.226+0000 7f19077fe700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f19080c9810 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f1900011000 tx=0x7f19080c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:21.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.227+0000 7f18eeffd700 1 -- 172.21.15.115:0/1158037174 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190001d630 con 0x7f19081542a0 2023-07-27T14:33:21.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.227+0000 7f18eeffd700 1 -- 172.21.15.115:0/1158037174 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190001d790 con 0x7f19081542a0 2023-07-27T14:33:21.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.227+0000 7f18eeffd700 1 -- 172.21.15.115:0/1158037174 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190001db10 con 0x7f19081542a0 2023-07-27T14:33:21.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.227+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19080c1dd0 con 0x7f19081542a0 2023-07-27T14:33:21.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.227+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19081648a0 con 0x7f19081542a0 2023-07-27T14:33:21.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.228+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1908164da0 con 0x7f19081542a0 2023-07-27T14:33:21.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.229+0000 7f18eeffd700 1 -- 172.21.15.115:0/1158037174 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f1900027460 con 0x7f19081542a0 2023-07-27T14:33:21.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.230+0000 7f18eeffd700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18f405f5b0 0x7f18f4061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.230+0000 7f18eeffd700 1 -- 172.21.15.115:0/1158037174 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f190007c8b0 con 0x7f19081542a0 2023-07-27T14:33:21.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.230+0000 7f1906ffd700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18f405f5b0 0x7f18f4061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.230+0000 7f1906ffd700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18f405f5b0 0x7f18f4061a70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f18f8007fd0 tx=0x7f18f8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:21.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.234+0000 7f18eeffd700 1 -- 172.21.15.115:0/1158037174 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f190004d4c0 con 0x7f19081542a0 2023-07-27T14:33:21.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.404+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19080bfc90 con 0x7f19081542a0 2023-07-27T14:33:21.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.405+0000 7f18eeffd700 1 -- 172.21.15.115:0/1158037174 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17086 (secure 0 0 0) 0x7f1900050ae0 con 0x7f19081542a0 2023-07-27T14:33:21.444 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:21.444 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":114,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:07.235250+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:04.573925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:05.213515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:21.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18f405f5b0 msgr2=0x7f18f4061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18f405f5b0 0x7f18f4061a70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f18f8007fd0 tx=0x7f18f8009040).stop 2023-07-27T14:33:21.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 msgr2=0x7f19080c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f19080c9810 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f1900011000 tx=0x7f19080c0530).stop 2023-07-27T14:33:21.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 shutdown_connections 2023-07-27T14:33:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18f405f5b0 0x7f18f4061a70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f19080c9810 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19080aaa40 0x7f1908141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 --2- 172.21.15.115:0/1158037174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1908153ec0 0x7f19080c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 >> 172.21.15.115:0/1158037174 conn(0x7f19080cb610 msgr2=0x7f19080afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 shutdown_connections 2023-07-27T14:33:21.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.407+0000 7f190d7ff700 1 -- 172.21.15.115:0/1158037174 wait complete. 2023-07-27T14:33:21.463 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:33:21.464 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:21.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.612+0000 7f6f513ff700 1 Processor -- start 2023-07-27T14:33:21.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.613+0000 7f6f513ff700 1 -- start start 2023-07-27T14:33:21.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.614+0000 7f6f513ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6f4c0aaa40 0x7f6f4c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.614+0000 7f6f513ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c0aa4d0 con 0x7f6f4c1542a0 2023-07-27T14:33:21.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.614+0000 7f6f513ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c0c05c0 con 0x7f6f4c153ec0 2023-07-27T14:33:21.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.614+0000 7f6f513ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c0aa270 con 0x7f6f4c0aaa40 2023-07-27T14:33:21.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.614+0000 7f6f4a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6f4c0aaa40 0x7f6f4c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.614+0000 7f6f4b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6f4c1542a0 0x7f6f4c0c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44478/0 (socket says 172.21.15.115:44478) 2023-07-27T14:33:21.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.614+0000 7f6f4b7fe700 1 -- 172.21.15.115:0/649564534 learned_addr learned my addr 172.21.15.115:0/649564534 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:21.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f4a7fc700 1 -- 172.21.15.115:0/649564534 >> v1:172.21.15.159:6789/0 conn(0x7f6f4c153ec0 legacy=0x7f6f4c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f4a7fc700 1 -- 172.21.15.115:0/649564534 >> v1:172.21.15.115:6789/0 conn(0x7f6f4c1542a0 legacy=0x7f6f4c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f4a7fc700 1 -- 172.21.15.115:0/649564534 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0bfc90 con 0x7f6f4c0aaa40 2023-07-27T14:33:21.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f49ffb700 1 -- 172.21.15.115:0/649564534 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228213764 0 0) 0x7f6f44001490 con 0x7f6f4c1542a0 2023-07-27T14:33:21.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f4a7fc700 1 --2- 172.21.15.115:0/649564534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c0aaa40 0x7f6f4c0640f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f6f40009760 tx=0x7f6f40009060).ready entity=mon.0 client_cookie=7624a681e7ce6902 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:21.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f49ffb700 1 -- 172.21.15.115:0/649564534 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000b580 con 0x7f6f4c0aaa40 2023-07-27T14:33:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f49ffb700 1 -- 172.21.15.115:0/649564534 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4000b6e0 con 0x7f6f4c0aaa40 2023-07-27T14:33:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f49ffb700 1 -- 172.21.15.115:0/649564534 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000ba60 con 0x7f6f4c0aaa40 2023-07-27T14:33:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f513ff700 1 -- 172.21.15.115:0/649564534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c0aaa40 msgr2=0x7f6f4c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f513ff700 1 --2- 172.21.15.115:0/649564534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c0aaa40 0x7f6f4c0640f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f6f40009760 tx=0x7f6f40009060).stop 2023-07-27T14:33:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f513ff700 1 -- 172.21.15.115:0/649564534 shutdown_connections 2023-07-27T14:33:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f513ff700 1 --2- 172.21.15.115:0/649564534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c0aaa40 0x7f6f4c0640f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.615+0000 7f6f513ff700 1 -- 172.21.15.115:0/649564534 >> 172.21.15.115:0/649564534 conn(0x7f6f4c0cb610 msgr2=0x7f6f4c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:21.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.616+0000 7f6f513ff700 1 -- 172.21.15.115:0/649564534 shutdown_connections 2023-07-27T14:33:21.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.616+0000 7f6f513ff700 1 -- 172.21.15.115:0/649564534 wait complete. 2023-07-27T14:33:21.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.618+0000 7f6f513ff700 1 Processor -- start 2023-07-27T14:33:21.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.618+0000 7f6f513ff700 1 -- start start 2023-07-27T14:33:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f513ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f4c0aaa40 0x7f6f4c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f513ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f4c153ec0 0x7f6f4c0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f513ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c1542a0 0x7f6f4c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f513ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0c3080 con 0x7f6f4c1542a0 2023-07-27T14:33:21.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f513ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c167c80 con 0x7f6f4c153ec0 2023-07-27T14:33:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f513ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c167f20 con 0x7f6f4c0aaa40 2023-07-27T14:33:21.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c1542a0 0x7f6f4c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f4a7fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f4c153ec0 0x7f6f4c0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.620+0000 7f6f4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c1542a0 0x7f6f4c0c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35306/0 (socket says 172.21.15.115:35306) 2023-07-27T14:33:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.619+0000 7f6f4affd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f4c0aaa40 0x7f6f4c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.620+0000 7f6f4b7fe700 1 -- 172.21.15.115:0/3954294232 learned_addr learned my addr 172.21.15.115:0/3954294232 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.620+0000 7f6f4b7fe700 1 -- 172.21.15.115:0/3954294232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f4c0aaa40 msgr2=0x7f6f4c14f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.620+0000 7f6f4b7fe700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f4c0aaa40 0x7f6f4c14f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.620+0000 7f6f4b7fe700 1 -- 172.21.15.115:0/3954294232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f4c153ec0 msgr2=0x7f6f4c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.620+0000 7f6f4b7fe700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f4c153ec0 0x7f6f4c0c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.620+0000 7f6f4b7fe700 1 -- 172.21.15.115:0/3954294232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400092a0 con 0x7f6f4c1542a0 2023-07-27T14:33:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.620+0000 7f6f4b7fe700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c1542a0 0x7f6f4c0c9e20 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f6f4400c810 tx=0x7f6f440014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.621+0000 7f6f32ffd700 1 -- 172.21.15.115:0/3954294232 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44005d30 con 0x7f6f4c1542a0 2023-07-27T14:33:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.621+0000 7f6f32ffd700 1 -- 172.21.15.115:0/3954294232 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44005e90 con 0x7f6f4c1542a0 2023-07-27T14:33:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.621+0000 7f6f32ffd700 1 -- 172.21.15.115:0/3954294232 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440072e0 con 0x7f6f4c1542a0 2023-07-27T14:33:21.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.621+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c168200 con 0x7f6f4c1542a0 2023-07-27T14:33:21.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.621+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c1687c0 con 0x7f6f4c1542a0 2023-07-27T14:33:21.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.622+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c0ae180 con 0x7f6f4c1542a0 2023-07-27T14:33:21.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.623+0000 7f6f32ffd700 1 -- 172.21.15.115:0/3954294232 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f6f44010070 con 0x7f6f4c1542a0 2023-07-27T14:33:21.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.624+0000 7f6f32ffd700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f3805f580 0x7f6f38061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:21.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.624+0000 7f6f32ffd700 1 -- 172.21.15.115:0/3954294232 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6f44079d00 con 0x7f6f4c1542a0 2023-07-27T14:33:21.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.624+0000 7f6f4affd700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f3805f580 0x7f6f38061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:21.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.624+0000 7f6f4affd700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f3805f580 0x7f6f38061a40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f6f3c003920 tx=0x7f6f3c007d00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:21.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.628+0000 7f6f32ffd700 1 -- 172.21.15.115:0/3954294232 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6f4c0ae180 con 0x7f6f4c1542a0 2023-07-27T14:33:21.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.847+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f4c0aa4d0 con 0x7f6f4c1542a0 2023-07-27T14:33:21.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.848+0000 7f6f32ffd700 1 -- 172.21.15.115:0/3954294232 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f6f4c0aa4d0 con 0x7f6f4c1542a0 2023-07-27T14:33:21.887 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:21.888 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1059927938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1059927938},{"type":"v1","addr":"172.21.15.159:6834","nonce":1059927938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2712836683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2712836683},{"type":"v1","addr":"172.21.15.159:6835","nonce":2712836683}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2509102546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2509102546},{"type":"v1","addr":"172.21.15.115:6836","nonce":2509102546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:06.232999+0000","modified":"2023-07-27T14:33:09.243791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7410":{"gid":7410,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2904047998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2904047998},{"type":"v1","addr":"172.21.15.115:6837","nonce":2904047998}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-07-27T14:33:21.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f3805f580 msgr2=0x7f6f38061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f3805f580 0x7f6f38061a40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f6f3c003920 tx=0x7f6f3c007d00).stop 2023-07-27T14:33:21.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c1542a0 msgr2=0x7f6f4c0c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:21.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c1542a0 0x7f6f4c0c9e20 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f6f4400c810 tx=0x7f6f440014a0).stop 2023-07-27T14:33:21.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 shutdown_connections 2023-07-27T14:33:21.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f3805f580 0x7f6f38061a40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c1542a0 0x7f6f4c0c9e20 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f4c0aaa40 0x7f6f4c14f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 --2- 172.21.15.115:0/3954294232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f4c153ec0 0x7f6f4c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:21.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 >> 172.21.15.115:0/3954294232 conn(0x7f6f4c0cb610 msgr2=0x7f6f4c0abab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:21.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 shutdown_connections 2023-07-27T14:33:21.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:21.850+0000 7f6f513ff700 1 -- 172.21.15.115:0/3954294232 wait complete. 2023-07-27T14:33:21.892 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 60 2023-07-27T14:33:21.906 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:22.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.055+0000 7f9423bff700 1 Processor -- start 2023-07-27T14:33:22.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.055+0000 7f9423bff700 1 -- start start 2023-07-27T14:33:22.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.056+0000 7f9423bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f941c0aaa40 0x7f941c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.056+0000 7f9423bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f941c1542a0 0x7f941c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.056+0000 7f9423bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0aa4d0 con 0x7f941c153ec0 2023-07-27T14:33:22.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.056+0000 7f9423bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c064ad0 con 0x7f941c1542a0 2023-07-27T14:33:22.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.056+0000 7f9423bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0c05c0 con 0x7f941c0aaa40 2023-07-27T14:33:22.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.056+0000 7f942219c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f941c1542a0 0x7f941c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.056+0000 7f942199b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f941c153ec0 0x7f941c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44484/0 (socket says 172.21.15.115:44484) 2023-07-27T14:33:22.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.056+0000 7f942199b700 1 -- 172.21.15.115:0/723738573 learned_addr learned my addr 172.21.15.115:0/723738573 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:22.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f942119a700 1 --2- 172.21.15.115:0/723738573 >> v2:172.21.15.159:3300/0 conn(0x7f941c0aaa40 0x7f941c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f9420999700 1 -- 172.21.15.115:0/723738573 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713985989 0 0) 0x7f9418001110 con 0x7f941c153ec0 2023-07-27T14:33:22.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f9420999700 1 -- 172.21.15.115:0/723738573 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94080033f0 con 0x7f941c153ec0 2023-07-27T14:33:22.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f942219c700 1 -- 172.21.15.115:0/723738573 >> v2:172.21.15.159:3300/0 conn(0x7f941c0aaa40 msgr2=0x7f941c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:22.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f942219c700 1 --2- 172.21.15.115:0/723738573 >> v2:172.21.15.159:3300/0 conn(0x7f941c0aaa40 0x7f941c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f942219c700 1 -- 172.21.15.115:0/723738573 >> v1:172.21.15.115:6789/0 conn(0x7f941c153ec0 legacy=0x7f941c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f942219c700 1 -- 172.21.15.115:0/723738573 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0c1a60 con 0x7f941c1542a0 2023-07-27T14:33:22.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f942219c700 1 --2- 172.21.15.115:0/723738573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c1542a0 0x7f941c0645e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f941c06c0d0 tx=0x7f9414009780).ready entity=mon.0 client_cookie=ece25b6cce3af9a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f9420999700 1 -- 172.21.15.115:0/723738573 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400e070 con 0x7f941c1542a0 2023-07-27T14:33:22.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f9420999700 1 -- 172.21.15.115:0/723738573 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400bb60 con 0x7f941c1542a0 2023-07-27T14:33:22.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.057+0000 7f9420999700 1 -- 172.21.15.115:0/723738573 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414012410 con 0x7f941c1542a0 2023-07-27T14:33:22.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.058+0000 7f9423bff700 1 -- 172.21.15.115:0/723738573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c1542a0 msgr2=0x7f941c0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.058+0000 7f9423bff700 1 --2- 172.21.15.115:0/723738573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c1542a0 0x7f941c0645e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f941c06c0d0 tx=0x7f9414009780).stop 2023-07-27T14:33:22.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.058+0000 7f9423bff700 1 -- 172.21.15.115:0/723738573 shutdown_connections 2023-07-27T14:33:22.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.058+0000 7f9423bff700 1 --2- 172.21.15.115:0/723738573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c1542a0 0x7f941c0645e0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.058+0000 7f9423bff700 1 --2- 172.21.15.115:0/723738573 >> v2:172.21.15.159:3300/0 conn(0x7f941c0aaa40 0x7f941c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.058+0000 7f9423bff700 1 -- 172.21.15.115:0/723738573 >> 172.21.15.115:0/723738573 conn(0x7f941c0cb610 msgr2=0x7f941c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:22.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.058+0000 7f9423bff700 1 -- 172.21.15.115:0/723738573 shutdown_connections 2023-07-27T14:33:22.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.058+0000 7f9423bff700 1 -- 172.21.15.115:0/723738573 wait complete. 2023-07-27T14:33:22.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.059+0000 7f9423bff700 1 Processor -- start 2023-07-27T14:33:22.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.060+0000 7f9423bff700 1 -- start start 2023-07-27T14:33:22.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f9423bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c0aaa40 0x7f941c142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f9423bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f941c153ec0 0x7f941c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f9423bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c1542a0 0x7f941c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f9423bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c48a0 con 0x7f941c0aaa40 2023-07-27T14:33:22.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f9423bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c164060 con 0x7f941c1542a0 2023-07-27T14:33:22.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f9423bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c152110 con 0x7f941c153ec0 2023-07-27T14:33:22.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c0aaa40 0x7f941c142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c0aaa40 0x7f941c142a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35330/0 (socket says 172.21.15.115:35330) 2023-07-27T14:33:22.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 -- 172.21.15.115:0/2320539387 learned_addr learned my addr 172.21.15.115:0/2320539387 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:22.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942219c700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c1542a0 0x7f941c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942119a700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f941c153ec0 0x7f941c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 -- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f941c153ec0 msgr2=0x7f941c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f941c153ec0 0x7f941c152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 -- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c1542a0 msgr2=0x7f941c0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c1542a0 0x7f941c0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 -- 172.21.15.115:0/2320539387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009a20 con 0x7f941c0aaa40 2023-07-27T14:33:22.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942219c700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c1542a0 0x7f941c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:22.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.061+0000 7f942199b700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c0aaa40 0x7f941c142a20 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f941800c4a0 tx=0x7f9418007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.062+0000 7f9411ffb700 1 -- 172.21.15.115:0/2320539387 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180072e0 con 0x7f941c0aaa40 2023-07-27T14:33:22.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.062+0000 7f9411ffb700 1 -- 172.21.15.115:0/2320539387 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9418007440 con 0x7f941c0aaa40 2023-07-27T14:33:22.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.062+0000 7f9411ffb700 1 -- 172.21.15.115:0/2320539387 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180057a0 con 0x7f941c0aaa40 2023-07-27T14:33:22.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.062+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c151500 con 0x7f941c0aaa40 2023-07-27T14:33:22.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.062+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c151ac0 con 0x7f941c0aaa40 2023-07-27T14:33:22.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.063+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c1523f0 con 0x7f941c0aaa40 2023-07-27T14:33:22.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.063+0000 7f9411ffb700 1 -- 172.21.15.115:0/2320539387 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f9418010070 con 0x7f941c0aaa40 2023-07-27T14:33:22.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.064+0000 7f9411ffb700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f940005f5b0 0x7f9400061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.064+0000 7f9411ffb700 1 -- 172.21.15.115:0/2320539387 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9418079e50 con 0x7f941c0aaa40 2023-07-27T14:33:22.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.065+0000 7f942119a700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f940005f5b0 0x7f9400061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.065+0000 7f942119a700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f940005f5b0 0x7f9400061a70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f940c006fd0 tx=0x7f940c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.068+0000 7f9411ffb700 1 -- 172.21.15.115:0/2320539387 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f941804aac0 con 0x7f941c0aaa40 2023-07-27T14:33:22.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.280+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f941c0aa4d0 con 0x7f941c0aaa40 2023-07-27T14:33:22.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.281+0000 7f9411ffb700 1 -- 172.21.15.115:0/2320539387 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f941c0aa4d0 con 0x7f941c0aaa40 2023-07-27T14:33:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:22.320 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1059927938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1059927938},{"type":"v1","addr":"172.21.15.159:6834","nonce":1059927938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2712836683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2712836683},{"type":"v1","addr":"172.21.15.159:6835","nonce":2712836683}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2509102546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2509102546},{"type":"v1","addr":"172.21.15.115:6836","nonce":2509102546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:06.232999+0000","modified":"2023-07-27T14:33:09.243791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7410":{"gid":7410,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2904047998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2904047998},{"type":"v1","addr":"172.21.15.115:6837","nonce":2904047998}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-07-27T14:33:22.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f940005f5b0 msgr2=0x7f9400061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f940005f5b0 0x7f9400061a70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f940c006fd0 tx=0x7f940c008040).stop 2023-07-27T14:33:22.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c0aaa40 msgr2=0x7f941c142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c0aaa40 0x7f941c142a20 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f941800c4a0 tx=0x7f9418007af0).stop 2023-07-27T14:33:22.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 shutdown_connections 2023-07-27T14:33:22.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f940005f5b0 0x7f9400061a70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f941c1542a0 0x7f941c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f941c0aaa40 0x7f941c142a20 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 --2- 172.21.15.115:0/2320539387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f941c153ec0 0x7f941c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.283+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 >> 172.21.15.115:0/2320539387 conn(0x7f941c0cb610 msgr2=0x7f941c0ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:22.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.284+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 shutdown_connections 2023-07-27T14:33:22.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.284+0000 7f9423bff700 1 -- 172.21.15.115:0/2320539387 wait complete. 2023-07-27T14:33:22.326 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 60 2023-07-27T14:33:22.340 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.488+0000 7f2fd1dff700 1 Processor -- start 2023-07-27T14:33:22.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.488+0000 7f2fd1dff700 1 -- start start 2023-07-27T14:33:22.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fd1dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2fcc151bd0 0x7f2fcc062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fd1dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2fcc062810 0x7f2fcc0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fd1dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fcc0639d0 con 0x7f2fcc0a4d30 2023-07-27T14:33:22.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fd1dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc137610 con 0x7f2fcc062810 2023-07-27T14:33:22.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fd1dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc0a51c0 con 0x7f2fcc151bd0 2023-07-27T14:33:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fcaffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2fcc062810 0x7f2fcc0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fcaffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2fcc062810 0x7f2fcc0a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35346/0 (socket says 172.21.15.115:35346) 2023-07-27T14:33:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fcaffd700 1 -- 172.21.15.115:0/2194718304 learned_addr learned my addr 172.21.15.115:0/2194718304 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:22.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.490+0000 7f2fcb7fe700 1 --2- 172.21.15.115:0/2194718304 >> v2:172.21.15.159:3300/0 conn(0x7f2fcc151bd0 0x7f2fcc062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fcaffd700 1 -- 172.21.15.115:0/2194718304 >> v2:172.21.15.159:3300/0 conn(0x7f2fcc151bd0 msgr2=0x7f2fcc062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fcaffd700 1 --2- 172.21.15.115:0/2194718304 >> v2:172.21.15.159:3300/0 conn(0x7f2fcc151bd0 0x7f2fcc062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fcaffd700 1 -- 172.21.15.115:0/2194718304 >> v1:172.21.15.159:6789/0 conn(0x7f2fcc0a4d30 legacy=0x7f2fcc157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fcaffd700 1 -- 172.21.15.115:0/2194718304 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc062dc0 con 0x7f2fcc062810 2023-07-27T14:33:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fca7fc700 1 -- 172.21.15.115:0/2194718304 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412516989 0 0) 0x7f2fcc0639d0 con 0x7f2fcc0a4d30 2023-07-27T14:33:22.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fcaffd700 1 --2- 172.21.15.115:0/2194718304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc0a4840 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f2fcc066fb0 tx=0x7f2fc00090f0).ready entity=mon.0 client_cookie=44515ad3e0ffc84f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fca7fc700 1 -- 172.21.15.115:0/2194718304 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000b520 con 0x7f2fcc062810 2023-07-27T14:33:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fca7fc700 1 -- 172.21.15.115:0/2194718304 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000b680 con 0x7f2fcc062810 2023-07-27T14:33:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.491+0000 7f2fca7fc700 1 -- 172.21.15.115:0/2194718304 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000ba00 con 0x7f2fcc062810 2023-07-27T14:33:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.492+0000 7f2fd1dff700 1 -- 172.21.15.115:0/2194718304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 msgr2=0x7f2fcc0a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.492+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/2194718304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc0a4840 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f2fcc066fb0 tx=0x7f2fc00090f0).stop 2023-07-27T14:33:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.492+0000 7f2fd1dff700 1 -- 172.21.15.115:0/2194718304 shutdown_connections 2023-07-27T14:33:22.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.492+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/2194718304 >> v2:172.21.15.159:3300/0 conn(0x7f2fcc151bd0 0x7f2fcc062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.492+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/2194718304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc0a4840 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.492+0000 7f2fd1dff700 1 -- 172.21.15.115:0/2194718304 >> 172.21.15.115:0/2194718304 conn(0x7f2fcc064700 msgr2=0x7f2fcc064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.492+0000 7f2fd1dff700 1 -- 172.21.15.115:0/2194718304 shutdown_connections 2023-07-27T14:33:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.492+0000 7f2fd1dff700 1 -- 172.21.15.115:0/2194718304 wait complete. 2023-07-27T14:33:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.493+0000 7f2fd1dff700 1 Processor -- start 2023-07-27T14:33:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.493+0000 7f2fd1dff700 1 -- start start 2023-07-27T14:33:22.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.494+0000 7f2fd1dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc13d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.494+0000 7f2fd1dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fcc0a4d30 0x7f2fcc0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.494+0000 7f2fd1dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fcc151bd0 0x7f2fcc135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.494+0000 7f2fd1dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c38e0 con 0x7f2fcc062810 2023-07-27T14:33:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.494+0000 7f2fd1dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc153d80 con 0x7f2fcc151bd0 2023-07-27T14:33:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.494+0000 7f2fd1dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc154060 con 0x7f2fcc0a4d30 2023-07-27T14:33:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc13d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc13d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35356/0 (socket says 172.21.15.115:35356) 2023-07-27T14:33:22.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 -- 172.21.15.115:0/1905198209 learned_addr learned my addr 172.21.15.115:0/1905198209 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcaffd700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fcc0a4d30 0x7f2fcc0c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcbfff700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fcc151bd0 0x7f2fcc135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 -- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fcc0a4d30 msgr2=0x7f2fcc0c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fcc0a4d30 0x7f2fcc0c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 -- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fcc151bd0 msgr2=0x7f2fcc135220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fcc151bd0 0x7f2fcc135220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 -- 172.21.15.115:0/1905198209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc0009370 con 0x7f2fcc062810 2023-07-27T14:33:22.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcbfff700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fcc151bd0 0x7f2fcc135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcaffd700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fcc0a4d30 0x7f2fcc0c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fcb7fe700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc13d790 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f2fbc00e930 tx=0x7f2fbc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fb37fe700 1 -- 172.21.15.115:0/1905198209 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00eed0 con 0x7f2fcc062810 2023-07-27T14:33:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fb37fe700 1 -- 172.21.15.115:0/1905198209 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00c850 con 0x7f2fcc062810 2023-07-27T14:33:22.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc154340 con 0x7f2fcc062810 2023-07-27T14:33:22.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.495+0000 7f2fb37fe700 1 -- 172.21.15.115:0/1905198209 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00cbd0 con 0x7f2fcc062810 2023-07-27T14:33:22.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.496+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc153a60 con 0x7f2fcc062810 2023-07-27T14:33:22.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.496+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc06c470 con 0x7f2fcc062810 2023-07-27T14:33:22.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.497+0000 7f2fb37fe700 1 -- 172.21.15.115:0/1905198209 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f2fbc022070 con 0x7f2fcc062810 2023-07-27T14:33:22.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.498+0000 7f2fb37fe700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2fb805f5b0 0x7f2fb8061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.498+0000 7f2fb37fe700 1 -- 172.21.15.115:0/1905198209 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2fbc07aa60 con 0x7f2fcc062810 2023-07-27T14:33:22.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.498+0000 7f2fcaffd700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2fb805f5b0 0x7f2fb8061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.499+0000 7f2fcaffd700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2fb805f5b0 0x7f2fb8061a70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f2fc0009130 tx=0x7f2fc0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.502+0000 7f2fb37fe700 1 -- 172.21.15.115:0/1905198209 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2fbc04b9c0 con 0x7f2fcc062810 2023-07-27T14:33:22.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.674+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fcc0c4dd0 con 0x7f2fcc062810 2023-07-27T14:33:22.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.675+0000 7f2fb37fe700 1 -- 172.21.15.115:0/1905198209 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17086 (secure 0 0 0) 0x7f2fbc04efe0 con 0x7f2fcc062810 2023-07-27T14:33:22.715 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:22.715 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":114,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:07.235250+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:04.573925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:05.213515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:22.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.677+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2fb805f5b0 msgr2=0x7f2fb8061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.677+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2fb805f5b0 0x7f2fb8061a70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f2fc0009130 tx=0x7f2fc0017000).stop 2023-07-27T14:33:22.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.677+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 msgr2=0x7f2fcc13d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.677+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc13d790 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f2fbc00e930 tx=0x7f2fbc009060).stop 2023-07-27T14:33:22.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.678+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 shutdown_connections 2023-07-27T14:33:22.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.678+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2fb805f5b0 0x7f2fb8061a70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.678+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fcc151bd0 0x7f2fcc135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.678+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fcc062810 0x7f2fcc13d790 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.678+0000 7f2fd1dff700 1 --2- 172.21.15.115:0/1905198209 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fcc0a4d30 0x7f2fcc0c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.678+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 >> 172.21.15.115:0/1905198209 conn(0x7f2fcc064700 msgr2=0x7f2fcc068c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:22.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.678+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 shutdown_connections 2023-07-27T14:33:22.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.678+0000 7f2fd1dff700 1 -- 172.21.15.115:0/1905198209 wait complete. 2023-07-27T14:33:22.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:33:22.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.883+0000 7f1b2b7ff700 1 Processor -- start 2023-07-27T14:33:22.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.884+0000 7f1b2b7ff700 1 -- start start 2023-07-27T14:33:22.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b2b7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1b24151bd0 0x7f1b24062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b2b7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1b24062810 0x7f1b240a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b2b7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b240639d0 con 0x7f1b240a4d30 2023-07-27T14:33:22.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b2b7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b24137610 con 0x7f1b24062810 2023-07-27T14:33:22.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b2b7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b240a51c0 con 0x7f1b24151bd0 2023-07-27T14:33:22.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b29d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1b240a4d30 0x7f1b24157ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44488/0 (socket says 172.21.15.115:44488) 2023-07-27T14:33:22.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b29d9c700 1 -- 172.21.15.115:0/2687676397 learned_addr learned my addr 172.21.15.115:0/2687676397 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:22.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b28d9a700 1 --2- 172.21.15.115:0/2687676397 >> v2:172.21.15.115:3300/0 conn(0x7f1b24062810 0x7f1b240a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.885+0000 7f1b2959b700 1 --2- 172.21.15.115:0/2687676397 >> v2:172.21.15.159:3300/0 conn(0x7f1b24151bd0 0x7f1b24062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b1bfff700 1 -- 172.21.15.115:0/2687676397 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703304905 0 0) 0x7f1b240639d0 con 0x7f1b240a4d30 2023-07-27T14:33:22.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b1bfff700 1 -- 172.21.15.115:0/2687676397 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b100033f0 con 0x7f1b240a4d30 2023-07-27T14:33:22.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b28d9a700 1 -- 172.21.15.115:0/2687676397 >> v2:172.21.15.159:3300/0 conn(0x7f1b24151bd0 msgr2=0x7f1b24062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:22.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b28d9a700 1 --2- 172.21.15.115:0/2687676397 >> v2:172.21.15.159:3300/0 conn(0x7f1b24151bd0 0x7f1b24062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b28d9a700 1 -- 172.21.15.115:0/2687676397 >> v1:172.21.15.115:6789/0 conn(0x7f1b240a4d30 legacy=0x7f1b24157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b28d9a700 1 -- 172.21.15.115:0/2687676397 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24062dc0 con 0x7f1b24062810 2023-07-27T14:33:22.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b28d9a700 1 --2- 172.21.15.115:0/2687676397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b24062810 0x7f1b240a4840 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f1b24066fb0 tx=0x7f1b14009060).ready entity=mon.0 client_cookie=324edce7e5d749f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b1bfff700 1 -- 172.21.15.115:0/2687676397 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400d4a0 con 0x7f1b24062810 2023-07-27T14:33:22.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b1bfff700 1 -- 172.21.15.115:0/2687676397 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1400d600 con 0x7f1b24062810 2023-07-27T14:33:22.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.886+0000 7f1b1bfff700 1 -- 172.21.15.115:0/2687676397 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400d980 con 0x7f1b24062810 2023-07-27T14:33:22.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.887+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/2687676397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b24062810 msgr2=0x7f1b240a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.887+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/2687676397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b24062810 0x7f1b240a4840 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f1b24066fb0 tx=0x7f1b14009060).stop 2023-07-27T14:33:22.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.887+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/2687676397 shutdown_connections 2023-07-27T14:33:22.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.887+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/2687676397 >> v2:172.21.15.159:3300/0 conn(0x7f1b24151bd0 0x7f1b24062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.887+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/2687676397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b24062810 0x7f1b240a4840 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.887+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/2687676397 >> 172.21.15.115:0/2687676397 conn(0x7f1b24064700 msgr2=0x7f1b24064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:22.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.887+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/2687676397 shutdown_connections 2023-07-27T14:33:22.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.887+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/2687676397 wait complete. 2023-07-27T14:33:22.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.888+0000 7f1b2b7ff700 1 Processor -- start 2023-07-27T14:33:22.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.888+0000 7f1b2b7ff700 1 -- start start 2023-07-27T14:33:22.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.889+0000 7f1b2b7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b24062810 0x7f1b2413c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.889+0000 7f1b2b7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b240a4d30 0x7f1b2413b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.889+0000 7f1b2b7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b24151bd0 0x7f1b24163330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.889+0000 7f1b2b7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2413cb70 con 0x7f1b240a4d30 2023-07-27T14:33:22.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.889+0000 7f1b2b7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2413bb40 con 0x7f1b24151bd0 2023-07-27T14:33:22.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.889+0000 7f1b2b7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240aa1b0 con 0x7f1b24062810 2023-07-27T14:33:22.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b240a4d30 0x7f1b2413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b240a4d30 0x7f1b2413b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35366/0 (socket says 172.21.15.115:35366) 2023-07-27T14:33:22.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 -- 172.21.15.115:0/4201581030 learned_addr learned my addr 172.21.15.115:0/4201581030 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:22.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b29d9c700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b24151bd0 0x7f1b24163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b2959b700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b24062810 0x7f1b2413c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 -- 172.21.15.115:0/4201581030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b24062810 msgr2=0x7f1b2413c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b24062810 0x7f1b2413c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 -- 172.21.15.115:0/4201581030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b24151bd0 msgr2=0x7f1b24163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:22.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b24151bd0 0x7f1b24163330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:22.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 -- 172.21.15.115:0/4201581030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b140092a0 con 0x7f1b240a4d30 2023-07-27T14:33:22.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b28d9a700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b240a4d30 0x7f1b2413b650 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f1b14009d20 tx=0x7f1b14016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b197fa700 1 -- 172.21.15.115:0/4201581030 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14021070 con 0x7f1b240a4d30 2023-07-27T14:33:22.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.890+0000 7f1b197fa700 1 -- 172.21.15.115:0/4201581030 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1400dd30 con 0x7f1b240a4d30 2023-07-27T14:33:22.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.891+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2413cdc0 con 0x7f1b240a4d30 2023-07-27T14:33:22.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.891+0000 7f1b197fa700 1 -- 172.21.15.115:0/4201581030 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400dea0 con 0x7f1b240a4d30 2023-07-27T14:33:22.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.891+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2413d600 con 0x7f1b240a4d30 2023-07-27T14:33:22.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.892+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2406c470 con 0x7f1b240a4d30 2023-07-27T14:33:22.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.893+0000 7f1b197fa700 1 -- 172.21.15.115:0/4201581030 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f1b1400f070 con 0x7f1b240a4d30 2023-07-27T14:33:22.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.894+0000 7f1b197fa700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0805f5e0 0x7f1b08061aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:22.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.894+0000 7f1b197fa700 1 -- 172.21.15.115:0/4201581030 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b1407b720 con 0x7f1b240a4d30 2023-07-27T14:33:22.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.894+0000 7f1b2959b700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0805f5e0 0x7f1b08061aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:22.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.894+0000 7f1b2959b700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0805f5e0 0x7f1b08061aa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f1b20009c30 tx=0x7f1b20009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:22.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:22.897+0000 7f1b197fa700 1 -- 172.21.15.115:0/4201581030 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b1404c6c0 con 0x7f1b240a4d30 2023-07-27T14:33:23.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.106+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1b2405ea50 con 0x7f1b240a4d30 2023-07-27T14:33:23.683 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:33:23.644+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:33:23.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.653+0000 7f1b197fa700 1 -- 172.21.15.115:0/4201581030 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1b1400d980 con 0x7f1b240a4d30 2023-07-27T14:33:23.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.655+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0805f5e0 msgr2=0x7f1b08061aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:23.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.655+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0805f5e0 0x7f1b08061aa0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f1b20009c30 tx=0x7f1b20009060).stop 2023-07-27T14:33:23.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.655+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b240a4d30 msgr2=0x7f1b2413b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:23.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.655+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b240a4d30 0x7f1b2413b650 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f1b14009d20 tx=0x7f1b14016000).stop 2023-07-27T14:33:23.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.656+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 shutdown_connections 2023-07-27T14:33:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.656+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1b0805f5e0 0x7f1b08061aa0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.656+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b24151bd0 0x7f1b24163330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.656+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1b24062810 0x7f1b2413c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.656+0000 7f1b2b7ff700 1 --2- 172.21.15.115:0/4201581030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b240a4d30 0x7f1b2413b650 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.656+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 >> 172.21.15.115:0/4201581030 conn(0x7f1b24064700 msgr2=0x7f1b24068fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:23.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.656+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 shutdown_connections 2023-07-27T14:33:23.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.656+0000 7f1b2b7ff700 1 -- 172.21.15.115:0/4201581030 wait complete. 2023-07-27T14:33:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:33:23.703 INFO:tasks.ceph.mds.c.smithi115.stderr: -9862> 2023-07-27T14:33:06.755+0000 7fc7115f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:33:23.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:33:23.755 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:33:23.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.868+0000 7f49941ff700 1 Processor -- start 2023-07-27T14:33:23.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.869+0000 7f49941ff700 1 -- start start 2023-07-27T14:33:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.870+0000 7f49941ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 0x7f498c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.870+0000 7f49941ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c1553f0 con 0x7f498c14ae00 2023-07-27T14:33:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.870+0000 7f49941ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c157a50 con 0x7f498c14b1e0 2023-07-27T14:33:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.870+0000 7f49941ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c157d10 con 0x7f498c063260 2023-07-27T14:33:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.870+0000 7f4991f9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f498c14ae00 0x7f498c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49514/0 (socket says 172.21.15.115:49514) 2023-07-27T14:33:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.870+0000 7f4991f9b700 1 -- 172.21.15.115:0/792804799 learned_addr learned my addr 172.21.15.115:0/792804799 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.870+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975949720 0 0) 0x7f498c1553f0 con 0x7f498c14ae00 2023-07-27T14:33:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.870+0000 7f499179a700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 0x7f498c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49780033f0 con 0x7f498c14ae00 2023-07-27T14:33:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4004205517 0 0) 0x7f49780033f0 con 0x7f498c14ae00 2023-07-27T14:33:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 msgr2=0x7f498c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:23.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 0x7f498c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 >> v1:172.21.15.159:6789/0 conn(0x7f498c14b1e0 legacy=0x7f498c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c157ff0 con 0x7f498c14ae00 2023-07-27T14:33:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4988001470 con 0x7f498c14ae00 2023-07-27T14:33:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 >> v1:172.21.15.115:6789/0 conn(0x7f498c14ae00 legacy=0x7f498c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978003910 0x7f4978003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4978004690 0x7f4978004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:23.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 0x7f4978005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c157d10 con 0x7f4978004690 2023-07-27T14:33:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497800b910 con 0x7f4978003910 2023-07-27T14:33:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497800bad0 con 0x7f498c063260 2023-07-27T14:33:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f499179a700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4978004690 0x7f4978004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f4991f9b700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978003910 0x7f4978003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.871+0000 7f499279c700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 0x7f4978005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f499179a700 1 -- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 msgr2=0x7f4978005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:23.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f499179a700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 0x7f4978005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f499179a700 1 -- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978003910 msgr2=0x7f4978003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f499179a700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978003910 0x7f4978003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f499179a700 1 -- 172.21.15.115:0/792804799 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780033f0 con 0x7f4978004690 2023-07-27T14:33:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f499279c700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c063260 0x7f4978005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f499179a700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4978004690 0x7f4978004b10 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f498c063660 tx=0x7f497c009060).ready entity=mon.0 client_cookie=cfbd93eb0f816882 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c009e90 con 0x7f4978004690 2023-07-27T14:33:23.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c009430 con 0x7f4978004690 2023-07-27T14:33:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f4990f99700 1 -- 172.21.15.115:0/792804799 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c00e850 con 0x7f4978004690 2023-07-27T14:33:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f49941ff700 1 -- 172.21.15.115:0/792804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4978004690 msgr2=0x7f4978004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f49941ff700 1 --2- 172.21.15.115:0/792804799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4978004690 0x7f4978004b10 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f498c063660 tx=0x7f497c009060).stop 2023-07-27T14:33:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.872+0000 7f499279c700 1 -- 172.21.15.115:0/792804799 reap_dead start 2023-07-27T14:33:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.873+0000 7f49941ff700 1 -- 172.21.15.115:0/792804799 shutdown_connections 2023-07-27T14:33:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.873+0000 7f49941ff700 1 -- 172.21.15.115:0/792804799 >> 172.21.15.115:0/792804799 conn(0x7f498c05e940 msgr2=0x7f498c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.873+0000 7f49941ff700 1 -- 172.21.15.115:0/792804799 shutdown_connections 2023-07-27T14:33:23.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.873+0000 7f49941ff700 1 -- 172.21.15.115:0/792804799 wait complete. 2023-07-27T14:33:23.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.874+0000 7f49941ff700 1 Processor -- start 2023-07-27T14:33:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.874+0000 7f49941ff700 1 -- start start 2023-07-27T14:33:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f49941ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978004690 0x7f498c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f49941ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f498c0c1c50 0x7f498c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f49941ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c163dc0 0x7f498c164240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f49941ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c167420 con 0x7f498c0c1c50 2023-07-27T14:33:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f49941ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0c4110 con 0x7f4978004690 2023-07-27T14:33:23.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f49941ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0c2110 con 0x7f498c163dc0 2023-07-27T14:33:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f499179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f498c0c1c50 0x7f498c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f499179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f498c0c1c50 0x7f498c0b0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57180/0 (socket says 172.21.15.115:57180) 2023-07-27T14:33:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f499179a700 1 -- 172.21.15.115:0/2688829323 learned_addr learned my addr 172.21.15.115:0/2688829323 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f4991f9b700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978004690 0x7f498c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.875+0000 7f499279c700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c163dc0 0x7f498c164240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:23.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f499179a700 1 -- 172.21.15.115:0/2688829323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c163dc0 msgr2=0x7f498c164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f499179a700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c163dc0 0x7f498c164240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f499179a700 1 -- 172.21.15.115:0/2688829323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978004690 msgr2=0x7f498c0c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f499179a700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978004690 0x7f498c0c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f499179a700 1 -- 172.21.15.115:0/2688829323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0c23f0 con 0x7f498c0c1c50 2023-07-27T14:33:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f499179a700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f498c0c1c50 0x7f498c0b0380 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f497c00e970 tx=0x7f497c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:23.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f4981ffb700 1 -- 172.21.15.115:0/2688829323 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c01d8a0 con 0x7f498c0c1c50 2023-07-27T14:33:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f4981ffb700 1 -- 172.21.15.115:0/2688829323 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c01da20 con 0x7f498c0c1c50 2023-07-27T14:33:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c0c26d0 con 0x7f498c0c1c50 2023-07-27T14:33:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f4981ffb700 1 -- 172.21.15.115:0/2688829323 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c01dde0 con 0x7f498c0c1c50 2023-07-27T14:33:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.876+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c0c36d0 con 0x7f498c0c1c50 2023-07-27T14:33:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.877+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c1675d0 con 0x7f498c0c1c50 2023-07-27T14:33:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.878+0000 7f4981ffb700 1 -- 172.21.15.115:0/2688829323 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f497c02c020 con 0x7f498c0c1c50 2023-07-27T14:33:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.879+0000 7f4981ffb700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f497005f5b0 0x7f4970061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:23.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.879+0000 7f4981ffb700 1 -- 172.21.15.115:0/2688829323 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f497c07c030 con 0x7f498c0c1c50 2023-07-27T14:33:23.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.879+0000 7f4991f9b700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f497005f5b0 0x7f4970061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:23.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.880+0000 7f4991f9b700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f497005f5b0 0x7f4970061a70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f498c154090 tx=0x7f498c14eb20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:23.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:23.883+0000 7f4981ffb700 1 -- 172.21.15.115:0/2688829323 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f498c1675d0 con 0x7f498c0c1c50 2023-07-27T14:33:24.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.092+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f498c1675d0 con 0x7f498c0c1c50 2023-07-27T14:33:24.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.654+0000 7f4981ffb700 1 -- 172.21.15.115:0/2688829323 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f498c1675d0 con 0x7f498c0c1c50 2023-07-27T14:33:24.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.656+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f497005f5b0 msgr2=0x7f4970061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:24.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.656+0000 7f49941ff700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f497005f5b0 0x7f4970061a70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f498c154090 tx=0x7f498c14eb20).stop 2023-07-27T14:33:24.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.656+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f498c0c1c50 msgr2=0x7f498c0b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:24.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.656+0000 7f49941ff700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f498c0c1c50 0x7f498c0b0380 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f497c00e970 tx=0x7f497c01a000).stop 2023-07-27T14:33:24.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.657+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 shutdown_connections 2023-07-27T14:33:24.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.657+0000 7f49941ff700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f497005f5b0 0x7f4970061a70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:24.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.657+0000 7f49941ff700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f498c163dc0 0x7f498c164240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:24.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.657+0000 7f49941ff700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978004690 0x7f498c0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:24.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.657+0000 7f49941ff700 1 --2- 172.21.15.115:0/2688829323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f498c0c1c50 0x7f498c0b0380 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:24.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.657+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 >> 172.21.15.115:0/2688829323 conn(0x7f498c05e940 msgr2=0x7f498c14a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:24.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.657+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 shutdown_connections 2023-07-27T14:33:24.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.657+0000 7f49941ff700 1 -- 172.21.15.115:0/2688829323 wait complete. 2023-07-27T14:33:24.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:33:24.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.910+0000 7fc5045ff700 1 Processor -- start 2023-07-27T14:33:24.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.910+0000 7fc5045ff700 1 -- start start 2023-07-27T14:33:24.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.911+0000 7fc5045ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4fc13a350 0x7fc4fc065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:24.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc5045ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0bd9a0 con 0x7fc4fc0c36b0 2023-07-27T14:33:24.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc5045ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc066610 con 0x7fc4fc13a730 2023-07-27T14:33:24.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc5045ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc066400 con 0x7fc4fc13a350 2023-07-27T14:33:24.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc50239b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4fc13a350 0x7fc4fc065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:24.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc502b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc4fc0c36b0 0x7fc4fc0be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49516/0 (socket says 172.21.15.115:49516) 2023-07-27T14:33:24.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc502b9c700 1 -- 172.21.15.115:0/2020493726 learned_addr learned my addr 172.21.15.115:0/2020493726 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:24.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc50239b700 1 --2- 172.21.15.115:0/2020493726 >> v2:172.21.15.115:3300/0 conn(0x7fc4fc13a350 0x7fc4fc065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57190/0 (socket says 172.21.15.115:57190) 2023-07-27T14:33:24.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc50239b700 1 -- 172.21.15.115:0/2020493726 >> v1:172.21.15.159:6789/0 conn(0x7fc4fc13a730 legacy=0x7fc4fc0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:24.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc50239b700 1 -- 172.21.15.115:0/2020493726 >> v1:172.21.15.115:6789/0 conn(0x7fc4fc0c36b0 legacy=0x7fc4fc0be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:24.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc50239b700 1 -- 172.21.15.115:0/2020493726 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0bdc10 con 0x7fc4fc13a350 2023-07-27T14:33:24.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.912+0000 7fc501399700 1 -- 172.21.15.115:0/2020493726 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104840253 0 0) 0x7fc4fc0bd9a0 con 0x7fc4fc0c36b0 2023-07-27T14:33:24.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc50239b700 1 --2- 172.21.15.115:0/2020493726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc065f10 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fc4f8009760 tx=0x7fc4f8009060).ready entity=mon.0 client_cookie=5acf161db82f226b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:24.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc501399700 1 -- 172.21.15.115:0/2020493726 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800b580 con 0x7fc4fc13a350 2023-07-27T14:33:24.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc501399700 1 -- 172.21.15.115:0/2020493726 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f800b6e0 con 0x7fc4fc13a350 2023-07-27T14:33:24.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc501399700 1 -- 172.21.15.115:0/2020493726 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800ba60 con 0x7fc4fc13a350 2023-07-27T14:33:24.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc5045ff700 1 -- 172.21.15.115:0/2020493726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 msgr2=0x7fc4fc065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:24.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc5045ff700 1 --2- 172.21.15.115:0/2020493726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc065f10 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fc4f8009760 tx=0x7fc4f8009060).stop 2023-07-27T14:33:24.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc5045ff700 1 -- 172.21.15.115:0/2020493726 shutdown_connections 2023-07-27T14:33:24.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc5045ff700 1 --2- 172.21.15.115:0/2020493726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc065f10 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:24.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc5045ff700 1 -- 172.21.15.115:0/2020493726 >> 172.21.15.115:0/2020493726 conn(0x7fc4fc05e8f0 msgr2=0x7fc4fc0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:24.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc5045ff700 1 -- 172.21.15.115:0/2020493726 shutdown_connections 2023-07-27T14:33:24.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.913+0000 7fc5045ff700 1 -- 172.21.15.115:0/2020493726 wait complete. 2023-07-27T14:33:24.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.915+0000 7fc5045ff700 1 Processor -- start 2023-07-27T14:33:24.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.915+0000 7fc5045ff700 1 -- start start 2023-07-27T14:33:24.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc5045ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4fc0c36b0 0x7fc4fc153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:24.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc5045ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:24.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc5045ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc13a730 0x7fc4fc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:24.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc5045ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0c1250 con 0x7fc4fc13a350 2023-07-27T14:33:24.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc5045ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0c0640 con 0x7fc4fc13a730 2023-07-27T14:33:24.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc5045ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0c0920 con 0x7fc4fc0c36b0 2023-07-27T14:33:24.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc501b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:24.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc501b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57194/0 (socket says 172.21.15.115:57194) 2023-07-27T14:33:24.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc501b9a700 1 -- 172.21.15.115:0/2729924082 learned_addr learned my addr 172.21.15.115:0/2729924082 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:24.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc502b9c700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc13a730 0x7fc4fc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:24.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc50239b700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4fc0c36b0 0x7fc4fc153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:24.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc501b9a700 1 -- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4fc0c36b0 msgr2=0x7fc4fc153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:24.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc501b9a700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4fc0c36b0 0x7fc4fc153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:24.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc501b9a700 1 -- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc13a730 msgr2=0x7fc4fc156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:24.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc501b9a700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc13a730 0x7fc4fc156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:24.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc501b9a700 1 -- 172.21.15.115:0/2729924082 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f80092a0 con 0x7fc4fc13a350 2023-07-27T14:33:24.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.916+0000 7fc502b9c700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc13a730 0x7fc4fc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:24.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.917+0000 7fc501b9a700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc156890 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fc4ec00c440 tx=0x7fc4ec007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:24.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.917+0000 7fc4f27fc700 1 -- 172.21.15.115:0/2729924082 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec007020 con 0x7fc4fc13a350 2023-07-27T14:33:24.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.917+0000 7fc4f27fc700 1 -- 172.21.15.115:0/2729924082 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec007180 con 0x7fc4fc13a350 2023-07-27T14:33:24.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.917+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc0c0c00 con 0x7fc4fc13a350 2023-07-27T14:33:24.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.917+0000 7fc4f27fc700 1 -- 172.21.15.115:0/2729924082 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec007520 con 0x7fc4fc13a350 2023-07-27T14:33:24.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.917+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc157270 con 0x7fc4fc13a350 2023-07-27T14:33:24.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.918+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc0c13c0 con 0x7fc4fc13a350 2023-07-27T14:33:24.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.919+0000 7fc4f27fc700 1 -- 172.21.15.115:0/2729924082 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fc4ec010070 con 0x7fc4fc13a350 2023-07-27T14:33:24.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.919+0000 7fc4f27fc700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4e005f5b0 0x7fc4e0061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:24.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.920+0000 7fc4f27fc700 1 -- 172.21.15.115:0/2729924082 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fc4ec079af0 con 0x7fc4fc13a350 2023-07-27T14:33:24.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.920+0000 7fc50239b700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4e005f5b0 0x7fc4e0061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:24.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.920+0000 7fc50239b700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4e005f5b0 0x7fc4e0061a70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc4f8009630 tx=0x7fc4f8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:24.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:24.924+0000 7fc4f27fc700 1 -- 172.21.15.115:0/2729924082 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4ec0478f0 con 0x7fc4fc13a350 2023-07-27T14:33:25.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.092+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc4fc06c470 con 0x7fc4fc13a350 2023-07-27T14:33:25.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.660+0000 7fc4f27fc700 1 -- 172.21.15.115:0/2729924082 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc4ec079e60 con 0x7fc4fc13a350 2023-07-27T14:33:25.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4e005f5b0 msgr2=0x7fc4e0061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4e005f5b0 0x7fc4e0061a70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc4f8009630 tx=0x7fc4f8017000).stop 2023-07-27T14:33:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 msgr2=0x7fc4fc156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc156890 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fc4ec00c440 tx=0x7fc4ec007e00).stop 2023-07-27T14:33:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 shutdown_connections 2023-07-27T14:33:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4e005f5b0 0x7fc4e0061a70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4fc13a730 0x7fc4fc156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4fc0c36b0 0x7fc4fc153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 --2- 172.21.15.115:0/2729924082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4fc13a350 0x7fc4fc156890 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 >> 172.21.15.115:0/2729924082 conn(0x7fc4fc05e8f0 msgr2=0x7fc4fc0aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.663+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 shutdown_connections 2023-07-27T14:33:25.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.664+0000 7fc5045ff700 1 -- 172.21.15.115:0/2729924082 wait complete. 2023-07-27T14:33:25.705 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:33:25.723 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:33:25.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.875+0000 7f5a80bff700 1 Processor -- start 2023-07-27T14:33:25.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.876+0000 7f5a80bff700 1 -- start start 2023-07-27T14:33:25.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a80bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5a7c0bfb50 0x7f5a7c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:25.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a80bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5a7c0c0610 0x7f5a7c0c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:25.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a80bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c0c60a0 con 0x7f5a7c153f30 2023-07-27T14:33:25.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a80bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c0c0f90 con 0x7f5a7c0c0610 2023-07-27T14:33:25.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a80bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c0c5d70 con 0x7f5a7c0bfb50 2023-07-27T14:33:25.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a7a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5a7c153f30 0x7f5a7c0a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49518/0 (socket says 172.21.15.115:49518) 2023-07-27T14:33:25.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a7a59c700 1 -- 172.21.15.115:0/1744564357 learned_addr learned my addr 172.21.15.115:0/1744564357 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:25.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a7ad9d700 1 --2- 172.21.15.115:0/1744564357 >> v2:172.21.15.115:3300/0 conn(0x7f5a7c0c0610 0x7f5a7c0c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:25.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.877+0000 7f5a79d9b700 1 --2- 172.21.15.115:0/1744564357 >> v2:172.21.15.159:3300/0 conn(0x7f5a7c0bfb50 0x7f5a7c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:25.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7959a700 1 -- 172.21.15.115:0/1744564357 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304511605 0 0) 0x7f5a7c0c60a0 con 0x7f5a7c153f30 2023-07-27T14:33:25.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7959a700 1 -- 172.21.15.115:0/1744564357 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a640033f0 con 0x7f5a7c153f30 2023-07-27T14:33:25.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7ad9d700 1 -- 172.21.15.115:0/1744564357 >> v2:172.21.15.159:3300/0 conn(0x7f5a7c0bfb50 msgr2=0x7f5a7c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:25.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7ad9d700 1 --2- 172.21.15.115:0/1744564357 >> v2:172.21.15.159:3300/0 conn(0x7f5a7c0bfb50 0x7f5a7c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7ad9d700 1 -- 172.21.15.115:0/1744564357 >> v1:172.21.15.115:6789/0 conn(0x7f5a7c153f30 legacy=0x7f5a7c0a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:25.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7ad9d700 1 -- 172.21.15.115:0/1744564357 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0c7d80 con 0x7f5a7c0c0610 2023-07-27T14:33:25.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7ad9d700 1 --2- 172.21.15.115:0/1744564357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c0c0610 0x7f5a7c0c0aa0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f5a7c0850a0 tx=0x7f5a74009780).ready entity=mon.0 client_cookie=6b55e04a789aab61 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:25.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7959a700 1 -- 172.21.15.115:0/1744564357 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400e070 con 0x7f5a7c0c0610 2023-07-27T14:33:25.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7959a700 1 -- 172.21.15.115:0/1744564357 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7400bab0 con 0x7f5a7c0c0610 2023-07-27T14:33:25.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.878+0000 7f5a7959a700 1 -- 172.21.15.115:0/1744564357 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400be30 con 0x7f5a7c0c0610 2023-07-27T14:33:25.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.879+0000 7f5a80bff700 1 -- 172.21.15.115:0/1744564357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c0c0610 msgr2=0x7f5a7c0c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:25.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.879+0000 7f5a80bff700 1 --2- 172.21.15.115:0/1744564357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c0c0610 0x7f5a7c0c0aa0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f5a7c0850a0 tx=0x7f5a74009780).stop 2023-07-27T14:33:25.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.879+0000 7f5a80bff700 1 -- 172.21.15.115:0/1744564357 shutdown_connections 2023-07-27T14:33:25.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.879+0000 7f5a80bff700 1 --2- 172.21.15.115:0/1744564357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c0c0610 0x7f5a7c0c0aa0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.879+0000 7f5a80bff700 1 --2- 172.21.15.115:0/1744564357 >> v2:172.21.15.159:3300/0 conn(0x7f5a7c0bfb50 0x7f5a7c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.879+0000 7f5a80bff700 1 -- 172.21.15.115:0/1744564357 >> 172.21.15.115:0/1744564357 conn(0x7f5a7c094280 msgr2=0x7f5a7c05e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:25.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.879+0000 7f5a80bff700 1 -- 172.21.15.115:0/1744564357 shutdown_connections 2023-07-27T14:33:25.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.879+0000 7f5a80bff700 1 -- 172.21.15.115:0/1744564357 wait complete. 2023-07-27T14:33:25.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.880+0000 7f5a80bff700 1 Processor -- start 2023-07-27T14:33:25.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.880+0000 7f5a80bff700 1 -- start start 2023-07-27T14:33:25.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.881+0000 7f5a80bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a7c0bfb50 0x7f5a7c167d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:25.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.881+0000 7f5a80bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a7c0c0610 0x7f5a7c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:25.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.881+0000 7f5a80bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c153f30 0x7f5a7c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:25.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.881+0000 7f5a80bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0c4a30 con 0x7f5a7c153f30 2023-07-27T14:33:25.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.881+0000 7f5a80bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c168210 con 0x7f5a7c0bfb50 2023-07-27T14:33:25.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.881+0000 7f5a80bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0ab110 con 0x7f5a7c0c0610 2023-07-27T14:33:25.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.881+0000 7f5a7ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c153f30 0x7f5a7c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:25.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c153f30 0x7f5a7c0c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57224/0 (socket says 172.21.15.115:57224) 2023-07-27T14:33:25.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7ad9d700 1 -- 172.21.15.115:0/607586182 learned_addr learned my addr 172.21.15.115:0/607586182 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:25.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7a59c700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a7c0bfb50 0x7f5a7c167d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:25.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a79d9b700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a7c0c0610 0x7f5a7c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:25.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7ad9d700 1 -- 172.21.15.115:0/607586182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a7c0c0610 msgr2=0x7f5a7c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:25.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7ad9d700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a7c0c0610 0x7f5a7c14ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7ad9d700 1 -- 172.21.15.115:0/607586182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a7c0bfb50 msgr2=0x7f5a7c167d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:25.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7ad9d700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a7c0bfb50 0x7f5a7c167d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:25.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7ad9d700 1 -- 172.21.15.115:0/607586182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74009a20 con 0x7f5a7c153f30 2023-07-27T14:33:25.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a7ad9d700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c153f30 0x7f5a7c0c9cf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f5a7c05ed90 tx=0x7f5a74009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:25.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a6a7fc700 1 -- 172.21.15.115:0/607586182 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400b640 con 0x7f5a7c153f30 2023-07-27T14:33:25.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a6a7fc700 1 -- 172.21.15.115:0/607586182 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7401d5a0 con 0x7f5a7c153f30 2023-07-27T14:33:25.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c0ab3f0 con 0x7f5a7c153f30 2023-07-27T14:33:25.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.882+0000 7f5a6a7fc700 1 -- 172.21.15.115:0/607586182 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7401d960 con 0x7f5a7c153f30 2023-07-27T14:33:25.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.883+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c0ab9b0 con 0x7f5a7c153f30 2023-07-27T14:33:25.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.884+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c0af330 con 0x7f5a7c153f30 2023-07-27T14:33:25.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.884+0000 7f5a6a7fc700 1 -- 172.21.15.115:0/607586182 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f5a7401dcd0 con 0x7f5a7c153f30 2023-07-27T14:33:25.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.885+0000 7f5a6a7fc700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5a5c05f5b0 0x7f5a5c061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:25.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.885+0000 7f5a6a7fc700 1 -- 172.21.15.115:0/607586182 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f5a7407cba0 con 0x7f5a7c153f30 2023-07-27T14:33:25.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.885+0000 7f5a7a59c700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5a5c05f5b0 0x7f5a5c061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:25.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.886+0000 7f5a7a59c700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5a5c05f5b0 0x7f5a5c061a70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f5a6c005750 tx=0x7f5a6c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:25.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:25.895+0000 7f5a6a7fc700 1 -- 172.21.15.115:0/607586182 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a7404d970 con 0x7f5a7c153f30 2023-07-27T14:33:26.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.068+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a7c06c470 con 0x7f5a7c153f30 2023-07-27T14:33:26.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.669+0000 7f5a6a7fc700 1 -- 172.21.15.115:0/607586182 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5a74050f90 con 0x7f5a7c153f30 2023-07-27T14:33:26.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.671+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5a5c05f5b0 msgr2=0x7f5a5c061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:26.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.671+0000 7f5a80bff700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5a5c05f5b0 0x7f5a5c061a70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f5a6c005750 tx=0x7f5a6c009040).stop 2023-07-27T14:33:26.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.671+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c153f30 msgr2=0x7f5a7c0c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:26.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.671+0000 7f5a80bff700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c153f30 0x7f5a7c0c9cf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f5a7c05ed90 tx=0x7f5a74009780).stop 2023-07-27T14:33:26.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.672+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 shutdown_connections 2023-07-27T14:33:26.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.672+0000 7f5a80bff700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5a5c05f5b0 0x7f5a5c061a70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.672+0000 7f5a80bff700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a7c153f30 0x7f5a7c0c9cf0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.672+0000 7f5a80bff700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a7c0bfb50 0x7f5a7c167d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.672+0000 7f5a80bff700 1 --2- 172.21.15.115:0/607586182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a7c0c0610 0x7f5a7c14ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.672+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 >> 172.21.15.115:0/607586182 conn(0x7f5a7c094280 msgr2=0x7f5a7c0c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:26.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.673+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 shutdown_connections 2023-07-27T14:33:26.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.673+0000 7f5a80bff700 1 -- 172.21.15.115:0/607586182 wait complete. 2023-07-27T14:33:26.713 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:33:26.732 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:33:26.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.883+0000 7f45c97ff700 1 Processor -- start 2023-07-27T14:33:26.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.883+0000 7f45c97ff700 1 -- start start 2023-07-27T14:33:26.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.884+0000 7f45c97ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45c41509b0 0x7f45c40c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:26.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.884+0000 7f45c97ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c4150d90 0x7f45c4154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:26.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.884+0000 7f45c97ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c40c0ea0 con 0x7f45c40c3100 2023-07-27T14:33:26.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.884+0000 7f45c97ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c4068e10 con 0x7f45c41509b0 2023-07-27T14:33:26.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.884+0000 7f45c97ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4155190 con 0x7f45c4150d90 2023-07-27T14:33:26.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.885+0000 7f45c2ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45c41509b0 0x7f45c40c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:26.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.885+0000 7f45c27fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c4150d90 0x7f45c4154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:26.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.885+0000 7f45c2ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45c41509b0 0x7f45c40c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:42008/0 (socket says 172.21.15.115:42008) 2023-07-27T14:33:26.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.885+0000 7f45c27fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c4150d90 0x7f45c4154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:37804/0 (socket says 172.21.15.115:37804) 2023-07-27T14:33:26.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.885+0000 7f45c2ffd700 1 -- 172.21.15.115:0/2177879507 learned_addr learned my addr 172.21.15.115:0/2177879507 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:26.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.885+0000 7f45c37fe700 1 --1- 172.21.15.115:0/2177879507 >> v1:172.21.15.159:6789/0 conn(0x7f45c40c3100 0x7f45c40c3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:58438/0 (socket says 172.21.15.115:58438) 2023-07-27T14:33:26.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.885+0000 7f45c1ffb700 1 -- 172.21.15.115:0/2177879507 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633013541 0 0) 0x7f45c40c0ea0 con 0x7f45c40c3100 2023-07-27T14:33:26.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c1ffb700 1 -- 172.21.15.115:0/2177879507 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45ac0033f0 con 0x7f45c40c3100 2023-07-27T14:33:26.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c27fc700 1 -- 172.21.15.115:0/2177879507 >> v2:172.21.15.159:3300/0 conn(0x7f45c41509b0 msgr2=0x7f45c40c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:26.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c27fc700 1 --2- 172.21.15.115:0/2177879507 >> v2:172.21.15.159:3300/0 conn(0x7f45c41509b0 0x7f45c40c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c27fc700 1 -- 172.21.15.115:0/2177879507 >> v1:172.21.15.159:6789/0 conn(0x7f45c40c3100 legacy=0x7f45c40c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:26.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c27fc700 1 -- 172.21.15.115:0/2177879507 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4155470 con 0x7f45c4150d90 2023-07-27T14:33:26.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c2ffd700 1 --2- 172.21.15.115:0/2177879507 >> v2:172.21.15.159:3300/0 conn(0x7f45c41509b0 0x7f45c40c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:26.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c27fc700 1 --2- 172.21.15.115:0/2177879507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c4150d90 0x7f45c4154940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f45b8009760 tx=0x7f45b8009060).ready entity=mon.2 client_cookie=302e13168116bcb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:26.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c1ffb700 1 -- 172.21.15.115:0/2177879507 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800d4a0 con 0x7f45c4150d90 2023-07-27T14:33:26.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c1ffb700 1 -- 172.21.15.115:0/2177879507 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b800d600 con 0x7f45c4150d90 2023-07-27T14:33:26.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.886+0000 7f45c1ffb700 1 -- 172.21.15.115:0/2177879507 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800d980 con 0x7f45c4150d90 2023-07-27T14:33:26.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.887+0000 7f45c97ff700 1 -- 172.21.15.115:0/2177879507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c4150d90 msgr2=0x7f45c4154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:26.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.887+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2177879507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c4150d90 0x7f45c4154940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f45b8009760 tx=0x7f45b8009060).stop 2023-07-27T14:33:26.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.887+0000 7f45c97ff700 1 -- 172.21.15.115:0/2177879507 shutdown_connections 2023-07-27T14:33:26.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.887+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2177879507 >> v2:172.21.15.159:3300/0 conn(0x7f45c41509b0 0x7f45c40c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.887+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2177879507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c4150d90 0x7f45c4154940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.887+0000 7f45c97ff700 1 -- 172.21.15.115:0/2177879507 >> 172.21.15.115:0/2177879507 conn(0x7f45c4062320 msgr2=0x7f45c4062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:26.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.887+0000 7f45c97ff700 1 -- 172.21.15.115:0/2177879507 shutdown_connections 2023-07-27T14:33:26.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.887+0000 7f45c97ff700 1 -- 172.21.15.115:0/2177879507 wait complete. 2023-07-27T14:33:26.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.888+0000 7f45c97ff700 1 Processor -- start 2023-07-27T14:33:26.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.888+0000 7f45c97ff700 1 -- start start 2023-07-27T14:33:26.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c97ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45c40c3100 0x7f45c40a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:26.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c97ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c41509b0 0x7f45c40c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:26.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c97ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45c4150d90 0x7f45c414a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:26.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c97ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40a9110 con 0x7f45c40c3100 2023-07-27T14:33:26.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c97ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40a8790 con 0x7f45c4150d90 2023-07-27T14:33:26.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c97ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40a7b80 con 0x7f45c41509b0 2023-07-27T14:33:26.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45c40c3100 0x7f45c40a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:26.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45c40c3100 0x7f45c40a8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57230/0 (socket says 172.21.15.115:57230) 2023-07-27T14:33:26.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.889+0000 7f45c2ffd700 1 -- 172.21.15.115:0/2313880299 learned_addr learned my addr 172.21.15.115:0/2313880299 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:26.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c37fe700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45c4150d90 0x7f45c414a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c27fc700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c41509b0 0x7f45c40c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c2ffd700 1 -- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c41509b0 msgr2=0x7f45c40c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c2ffd700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c41509b0 0x7f45c40c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c2ffd700 1 -- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45c4150d90 msgr2=0x7f45c414a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c2ffd700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45c4150d90 0x7f45c414a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c2ffd700 1 -- 172.21.15.115:0/2313880299 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4009370 con 0x7f45c40c3100 2023-07-27T14:33:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c27fc700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c41509b0 0x7f45c40c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c2ffd700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45c40c3100 0x7f45c40a8c20 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f45b400ea20 tx=0x7f45b40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45aaffd700 1 -- 172.21.15.115:0/2313880299 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400c850 con 0x7f45c40c3100 2023-07-27T14:33:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45aaffd700 1 -- 172.21.15.115:0/2313880299 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400c9b0 con 0x7f45c40c3100 2023-07-27T14:33:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b80092a0 con 0x7f45c40c3100 2023-07-27T14:33:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45aaffd700 1 -- 172.21.15.115:0/2313880299 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400cd30 con 0x7f45c40c3100 2023-07-27T14:33:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.890+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c40a8420 con 0x7f45c40c3100 2023-07-27T14:33:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.891+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c406c470 con 0x7f45c40c3100 2023-07-27T14:33:26.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.892+0000 7f45aaffd700 1 -- 172.21.15.115:0/2313880299 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f45b4022070 con 0x7f45c40c3100 2023-07-27T14:33:26.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.893+0000 7f45aaffd700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45b005f5b0 0x7f45b0061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:26.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.893+0000 7f45aaffd700 1 -- 172.21.15.115:0/2313880299 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f45b407a7c0 con 0x7f45c40c3100 2023-07-27T14:33:26.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.893+0000 7f45c27fc700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45b005f5b0 0x7f45b0061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:26.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.894+0000 7f45c27fc700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45b005f5b0 0x7f45b0061a70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f45c40a6010 tx=0x7f45b8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:26.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:26.898+0000 7f45aaffd700 1 -- 172.21.15.115:0/2313880299 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45b404ba20 con 0x7f45c40c3100 2023-07-27T14:33:27.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.068+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f45c40a8a70 con 0x7f45c40c3100 2023-07-27T14:33:27.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.072+0000 7f45aaffd700 1 -- 172.21.15.115:0/2313880299 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f45b40160a0 con 0x7f45c40c3100 2023-07-27T14:33:27.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.074+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45b005f5b0 msgr2=0x7f45b0061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.074+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45b005f5b0 0x7f45b0061a70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f45c40a6010 tx=0x7f45b8016000).stop 2023-07-27T14:33:27.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.074+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45c40c3100 msgr2=0x7f45c40a8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.074+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45c40c3100 0x7f45c40a8c20 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f45b400ea20 tx=0x7f45b40090f0).stop 2023-07-27T14:33:27.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.075+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 shutdown_connections 2023-07-27T14:33:27.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.075+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45b005f5b0 0x7f45b0061a70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.075+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45c4150d90 0x7f45c414a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.075+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45c40c3100 0x7f45c40a8c20 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.075+0000 7f45c97ff700 1 --2- 172.21.15.115:0/2313880299 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45c41509b0 0x7f45c40c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.075+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 >> 172.21.15.115:0/2313880299 conn(0x7f45c4062320 msgr2=0x7f45c40ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:27.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.075+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 shutdown_connections 2023-07-27T14:33:27.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.075+0000 7f45c97ff700 1 -- 172.21.15.115:0/2313880299 wait complete. 2023-07-27T14:33:27.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_non_clone_status' 2023-07-27T14:33:27.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.279+0000 7ff7651ff700 1 Processor -- start 2023-07-27T14:33:27.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.279+0000 7ff7651ff700 1 -- start start 2023-07-27T14:33:27.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.280+0000 7ff7651ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff760153ec0 0x7ff7600a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.280+0000 7ff7651ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 0x7ff7600640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff7651ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7600aa4d0 con 0x7ff7600aaa40 2023-07-27T14:33:27.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff7651ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7600c05c0 con 0x7ff760153ec0 2023-07-27T14:33:27.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff7651ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600c1a60 con 0x7ff7600aa050 2023-07-27T14:33:27.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75ed9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff760153ec0 0x7ff7600a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75ed9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff760153ec0 0x7ff7600a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57232/0 (socket says 172.21.15.115:57232) 2023-07-27T14:33:27.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75ed9d700 1 -- 172.21.15.115:0/4135266453 learned_addr learned my addr 172.21.15.115:0/4135266453 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:27.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75ed9d700 1 -- 172.21.15.115:0/4135266453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 msgr2=0x7ff7600640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:27.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75ed9d700 1 --2- 172.21.15.115:0/4135266453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 0x7ff7600640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:27.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75ed9d700 1 -- 172.21.15.115:0/4135266453 >> v1:172.21.15.115:6789/0 conn(0x7ff7600aaa40 legacy=0x7ff760157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75ed9d700 1 -- 172.21.15.115:0/4135266453 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600bfc90 con 0x7ff760153ec0 2023-07-27T14:33:27.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75dd9b700 1 -- 172.21.15.115:0/4135266453 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936355365 0 0) 0x7ff758001490 con 0x7ff7600aaa40 2023-07-27T14:33:27.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.281+0000 7ff75ed9d700 1 --2- 172.21.15.115:0/4135266453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7600a9b60 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7ff750006fd0 tx=0x7ff7500090f0).ready entity=mon.0 client_cookie=43777619a1f87bac server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:27.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff75dd9b700 1 -- 172.21.15.115:0/4135266453 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75000b600 con 0x7ff760153ec0 2023-07-27T14:33:27.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff75dd9b700 1 -- 172.21.15.115:0/4135266453 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75000b760 con 0x7ff760153ec0 2023-07-27T14:33:27.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff75dd9b700 1 -- 172.21.15.115:0/4135266453 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75000bae0 con 0x7ff760153ec0 2023-07-27T14:33:27.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff7651ff700 1 -- 172.21.15.115:0/4135266453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 msgr2=0x7ff7600a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff7651ff700 1 --2- 172.21.15.115:0/4135266453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7600a9b60 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7ff750006fd0 tx=0x7ff7500090f0).stop 2023-07-27T14:33:27.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff7651ff700 1 -- 172.21.15.115:0/4135266453 shutdown_connections 2023-07-27T14:33:27.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff7651ff700 1 --2- 172.21.15.115:0/4135266453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7600a9b60 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff7651ff700 1 --2- 172.21.15.115:0/4135266453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 0x7ff7600640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:27.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff7651ff700 1 -- 172.21.15.115:0/4135266453 >> 172.21.15.115:0/4135266453 conn(0x7ff7600cb610 msgr2=0x7ff7600c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:27.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff7651ff700 1 -- 172.21.15.115:0/4135266453 shutdown_connections 2023-07-27T14:33:27.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.282+0000 7ff7651ff700 1 -- 172.21.15.115:0/4135266453 wait complete. 2023-07-27T14:33:27.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.284+0000 7ff7651ff700 1 Processor -- start 2023-07-27T14:33:27.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.285+0000 7ff7651ff700 1 -- start start 2023-07-27T14:33:27.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff7651ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 0x7ff7601500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff7651ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7600aaa40 0x7ff76014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff7651ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7601679d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff7651ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760166970 con 0x7ff760153ec0 2023-07-27T14:33:27.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff7651ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600c4ce0 con 0x7ff7600aaa40 2023-07-27T14:33:27.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff7651ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601505e0 con 0x7ff7600aa050 2023-07-27T14:33:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7601679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7601679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57242/0 (socket says 172.21.15.115:57242) 2023-07-27T14:33:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75f59e700 1 -- 172.21.15.115:0/2201866537 learned_addr learned my addr 172.21.15.115:0/2201866537 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75ed9d700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 0x7ff7601500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75e59c700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7600aaa40 0x7ff76014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75f59e700 1 -- 172.21.15.115:0/2201866537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 msgr2=0x7ff7601500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75f59e700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 0x7ff7601500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75f59e700 1 -- 172.21.15.115:0/2201866537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7600aaa40 msgr2=0x7ff76014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75f59e700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7600aaa40 0x7ff76014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.286+0000 7ff75f59e700 1 -- 172.21.15.115:0/2201866537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750009370 con 0x7ff760153ec0 2023-07-27T14:33:27.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.287+0000 7ff75f59e700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7601679d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7ff75800c810 tx=0x7ff758007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:27.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.287+0000 7ff746ffd700 1 -- 172.21.15.115:0/2201866537 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758010510 con 0x7ff760153ec0 2023-07-27T14:33:27.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.287+0000 7ff746ffd700 1 -- 172.21.15.115:0/2201866537 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758010670 con 0x7ff760153ec0 2023-07-27T14:33:27.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.287+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff760152d10 con 0x7ff760153ec0 2023-07-27T14:33:27.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.287+0000 7ff746ffd700 1 -- 172.21.15.115:0/2201866537 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758010a10 con 0x7ff760153ec0 2023-07-27T14:33:27.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.287+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7601532d0 con 0x7ff760153ec0 2023-07-27T14:33:27.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.288+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff760166b20 con 0x7ff760153ec0 2023-07-27T14:33:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.289+0000 7ff746ffd700 1 -- 172.21.15.115:0/2201866537 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7ff758019030 con 0x7ff760153ec0 2023-07-27T14:33:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.290+0000 7ff746ffd700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff74c05f580 0x7ff74c061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.290+0000 7ff746ffd700 1 -- 172.21.15.115:0/2201866537 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff758079ae0 con 0x7ff760153ec0 2023-07-27T14:33:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.290+0000 7ff75ed9d700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff74c05f580 0x7ff74c061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.290+0000 7ff75ed9d700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff74c05f580 0x7ff74c061a40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7ff750009130 tx=0x7ff750017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:27.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.294+0000 7ff746ffd700 1 -- 172.21.15.115:0/2201866537 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff760166b20 con 0x7ff760153ec0 2023-07-27T14:33:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.523+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_non_clone_status"]} v 0) v1 -- 0x7ff7600aa4d0 con 0x7ff760153ec0 2023-07-27T14:33:27.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.671+0000 7ff746ffd700 1 -- 172.21.15.115:0/2201866537 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_non_clone_status"]}]=0 v350) v1 ==== 154+0+0 (secure 0 0 0) 0x7ff7600aa4d0 con 0x7ff760153ec0 2023-07-27T14:33:27.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff74c05f580 msgr2=0x7ff74c061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff74c05f580 0x7ff74c061a40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7ff750009130 tx=0x7ff750017000).stop 2023-07-27T14:33:27.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 msgr2=0x7ff7601679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7601679d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7ff75800c810 tx=0x7ff758007d40).stop 2023-07-27T14:33:27.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 shutdown_connections 2023-07-27T14:33:27.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff74c05f580 0x7ff74c061a40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff760153ec0 0x7ff7601679d0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7600aa050 0x7ff7601500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 --2- 172.21.15.115:0/2201866537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7600aaa40 0x7ff76014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 >> 172.21.15.115:0/2201866537 conn(0x7ff7600cb610 msgr2=0x7ff7600aae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:27.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 shutdown_connections 2023-07-27T14:33:27.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.673+0000 7ff7651ff700 1 -- 172.21.15.115:0/2201866537 wait complete. 2023-07-27T14:33:27.730 INFO:tasks.cephfs_test_runner:test_non_clone_status (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:33:27.731 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_clone_in_progress_getpath (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:33:27.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_getpath' 2023-07-27T14:33:27.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.883+0000 7fb14d5ff700 1 Processor -- start 2023-07-27T14:33:27.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.883+0000 7fb14d5ff700 1 -- start start 2023-07-27T14:33:27.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb14d5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb148153ec0 0x7fb1480a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb14d5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb1480640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb14d5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1480aa4d0 con 0x7fb1480aaa40 2023-07-27T14:33:27.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb14d5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1480c05c0 con 0x7fb148153ec0 2023-07-27T14:33:27.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb14d5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1480c1a60 con 0x7fb1480aa050 2023-07-27T14:33:27.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb1467fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb1480640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb146ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb148153ec0 0x7fb1480a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb1467fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb1480640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:37852/0 (socket says 172.21.15.115:37852) 2023-07-27T14:33:27.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb1467fc700 1 -- 172.21.15.115:0/88339081 learned_addr learned my addr 172.21.15.115:0/88339081 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:27.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.885+0000 7fb1477fe700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fb1480aaa40 0x7fb148157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:58452/0 (socket says 172.21.15.115:58452) 2023-07-27T14:33:27.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.886+0000 7fb1467fc700 1 -- 172.21.15.115:0/88339081 >> v2:172.21.15.159:3300/0 conn(0x7fb148153ec0 msgr2=0x7fb1480a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:27.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.886+0000 7fb1467fc700 1 --2- 172.21.15.115:0/88339081 >> v2:172.21.15.159:3300/0 conn(0x7fb148153ec0 0x7fb1480a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.886+0000 7fb1467fc700 1 -- 172.21.15.115:0/88339081 >> v1:172.21.15.159:6789/0 conn(0x7fb1480aaa40 legacy=0x7fb148157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.886+0000 7fb1467fc700 1 -- 172.21.15.115:0/88339081 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1480bfc90 con 0x7fb1480aa050 2023-07-27T14:33:27.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.886+0000 7fb145ffb700 1 -- 172.21.15.115:0/88339081 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072832643 0 0) 0x7fb140001490 con 0x7fb1480aaa40 2023-07-27T14:33:27.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.886+0000 7fb1467fc700 1 --2- 172.21.15.115:0/88339081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb1480640f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb13c006fd0 tx=0x7fb13c0090f0).ready entity=mon.2 client_cookie=6d18cac2b8eddbdf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:27.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.886+0000 7fb145ffb700 1 -- 172.21.15.115:0/88339081 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00b580 con 0x7fb1480aa050 2023-07-27T14:33:27.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb145ffb700 1 -- 172.21.15.115:0/88339081 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00b6e0 con 0x7fb1480aa050 2023-07-27T14:33:27.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb145ffb700 1 -- 172.21.15.115:0/88339081 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00ba60 con 0x7fb1480aa050 2023-07-27T14:33:27.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb14d5ff700 1 -- 172.21.15.115:0/88339081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 msgr2=0x7fb1480640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/88339081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb1480640f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb13c006fd0 tx=0x7fb13c0090f0).stop 2023-07-27T14:33:27.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb14d5ff700 1 -- 172.21.15.115:0/88339081 shutdown_connections 2023-07-27T14:33:27.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/88339081 >> v2:172.21.15.159:3300/0 conn(0x7fb148153ec0 0x7fb1480a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/88339081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb1480640f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb14d5ff700 1 -- 172.21.15.115:0/88339081 >> 172.21.15.115:0/88339081 conn(0x7fb1480cb610 msgr2=0x7fb1480c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:27.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb14d5ff700 1 -- 172.21.15.115:0/88339081 shutdown_connections 2023-07-27T14:33:27.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.887+0000 7fb14d5ff700 1 -- 172.21.15.115:0/88339081 wait complete. 2023-07-27T14:33:27.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.889+0000 7fb14d5ff700 1 Processor -- start 2023-07-27T14:33:27.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.889+0000 7fb14d5ff700 1 -- start start 2023-07-27T14:33:27.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb14d5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb148148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb14d5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1480aaa40 0x7fb148149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb14d5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb148153ec0 0x7fb1480640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb14d5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148148f00 con 0x7fb148153ec0 2023-07-27T14:33:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb14d5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1480aeb10 con 0x7fb1480aaa40 2023-07-27T14:33:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb14d5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1480af970 con 0x7fb1480aa050 2023-07-27T14:33:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb1477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb148153ec0 0x7fb1480640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb1477fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb148153ec0 0x7fb1480640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57244/0 (socket says 172.21.15.115:57244) 2023-07-27T14:33:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb1477fe700 1 -- 172.21.15.115:0/2111817237 learned_addr learned my addr 172.21.15.115:0/2111817237 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb146ffd700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb148148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.890+0000 7fb1467fc700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1480aaa40 0x7fb148149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb1477fe700 1 -- 172.21.15.115:0/2111817237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 msgr2=0x7fb148148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb1477fe700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb148148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb1477fe700 1 -- 172.21.15.115:0/2111817237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1480aaa40 msgr2=0x7fb148149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb1477fe700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1480aaa40 0x7fb148149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb1477fe700 1 -- 172.21.15.115:0/2111817237 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c009370 con 0x7fb148153ec0 2023-07-27T14:33:27.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb1477fe700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb148153ec0 0x7fb1480640f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fb14000c760 tx=0x7fb140007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:27.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb12effd700 1 -- 172.21.15.115:0/2111817237 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140005c70 con 0x7fb148153ec0 2023-07-27T14:33:27.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb12effd700 1 -- 172.21.15.115:0/2111817237 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140005dd0 con 0x7fb148153ec0 2023-07-27T14:33:27.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb12effd700 1 -- 172.21.15.115:0/2111817237 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400072e0 con 0x7fb148153ec0 2023-07-27T14:33:27.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1480aed60 con 0x7fb148153ec0 2023-07-27T14:33:27.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.891+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1480af320 con 0x7fb148153ec0 2023-07-27T14:33:27.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.892+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14806c470 con 0x7fb148153ec0 2023-07-27T14:33:27.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.893+0000 7fb12effd700 1 -- 172.21.15.115:0/2111817237 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fb140010070 con 0x7fb148153ec0 2023-07-27T14:33:27.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.894+0000 7fb12effd700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb13405f580 0x7fb134061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:27.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.894+0000 7fb12effd700 1 -- 172.21.15.115:0/2111817237 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fb140079be0 con 0x7fb148153ec0 2023-07-27T14:33:27.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.894+0000 7fb146ffd700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb13405f580 0x7fb134061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:27.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.895+0000 7fb146ffd700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb13405f580 0x7fb134061a40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fb138009b90 tx=0x7fb138009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:27.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:27.898+0000 7fb12effd700 1 -- 172.21.15.115:0/2111817237 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb14004aaf0 con 0x7fb148153ec0 2023-07-27T14:33:28.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.139+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_getpath"]} v 0) v1 -- 0x7fb1480aa4d0 con 0x7fb148153ec0 2023-07-27T14:33:28.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.673+0000 7fb12effd700 1 -- 172.21.15.115:0/2111817237 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_getpath"]}]=0 v351) v1 ==== 176+0+0 (secure 0 0 0) 0x7fb1480aa4d0 con 0x7fb148153ec0 2023-07-27T14:33:28.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb13405f580 msgr2=0x7fb134061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:28.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb13405f580 0x7fb134061a40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fb138009b90 tx=0x7fb138009060).stop 2023-07-27T14:33:28.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb148153ec0 msgr2=0x7fb1480640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:28.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb148153ec0 0x7fb1480640f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fb14000c760 tx=0x7fb140007d50).stop 2023-07-27T14:33:28.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 shutdown_connections 2023-07-27T14:33:28.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb13405f580 0x7fb134061a40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:28.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb148153ec0 0x7fb1480640f0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:28.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1480aa050 0x7fb148148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:28.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 --2- 172.21.15.115:0/2111817237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1480aaa40 0x7fb148149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:28.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.675+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 >> 172.21.15.115:0/2111817237 conn(0x7fb1480cb610 msgr2=0x7fb1480abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:28.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.676+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 shutdown_connections 2023-07-27T14:33:28.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.676+0000 7fb14d5ff700 1 -- 172.21.15.115:0/2111817237 wait complete. 2023-07-27T14:33:28.733 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:33:28.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.885+0000 7fc4e2bff700 1 Processor -- start 2023-07-27T14:33:28.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.885+0000 7fc4e2bff700 1 -- start start 2023-07-27T14:33:28.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.886+0000 7fc4e2bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc4dc14b1e0 0x7fc4dc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:28.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.886+0000 7fc4e2bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4dc1553f0 con 0x7fc4dc063260 2023-07-27T14:33:28.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.886+0000 7fc4e2bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4dc157a50 con 0x7fc4dc14ae00 2023-07-27T14:33:28.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.886+0000 7fc4e2bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc157d10 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.886+0000 7fc4dbfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc4dc063260 0x7fc4dc0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49530/0 (socket says 172.21.15.115:49530) 2023-07-27T14:33:28.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.886+0000 7fc4dbfff700 1 -- 172.21.15.115:0/4128220239 learned_addr learned my addr 172.21.15.115:0/4128220239 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:28.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.886+0000 7fc4e119c700 1 --2- 172.21.15.115:0/4128220239 >> v2:172.21.15.159:3300/0 conn(0x7fc4dc14b1e0 0x7fc4dc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:28.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4db7fe700 1 -- 172.21.15.115:0/4128220239 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307454265 0 0) 0x7fc4dc1553f0 con 0x7fc4dc063260 2023-07-27T14:33:28.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4db7fe700 1 -- 172.21.15.115:0/4128220239 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4cc0033f0 con 0x7fc4dc063260 2023-07-27T14:33:28.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4db7fe700 1 -- 172.21.15.115:0/4128220239 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459274923 0 0) 0x7fc4dc157a50 con 0x7fc4dc14ae00 2023-07-27T14:33:28.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4db7fe700 1 -- 172.21.15.115:0/4128220239 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4dc1553f0 con 0x7fc4dc14ae00 2023-07-27T14:33:28.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4e119c700 1 -- 172.21.15.115:0/4128220239 >> v1:172.21.15.159:6789/0 conn(0x7fc4dc14ae00 legacy=0x7fc4dc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:28.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4e119c700 1 -- 172.21.15.115:0/4128220239 >> v1:172.21.15.115:6789/0 conn(0x7fc4dc063260 legacy=0x7fc4dc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:28.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4e119c700 1 -- 172.21.15.115:0/4128220239 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc157ff0 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4e119c700 1 --2- 172.21.15.115:0/4128220239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc154f00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fc4d4009e60 tx=0x7fc4d4009780).ready entity=mon.1 client_cookie=5252b7bc1fefab62 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:28.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4db7fe700 1 -- 172.21.15.115:0/4128220239 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400e070 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4db7fe700 1 -- 172.21.15.115:0/4128220239 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d400bab0 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.887+0000 7fc4db7fe700 1 -- 172.21.15.115:0/4128220239 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400be30 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.888+0000 7fc4e2bff700 1 -- 172.21.15.115:0/4128220239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14b1e0 msgr2=0x7fc4dc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:28.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.888+0000 7fc4e2bff700 1 --2- 172.21.15.115:0/4128220239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc154f00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fc4d4009e60 tx=0x7fc4d4009780).stop 2023-07-27T14:33:28.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.888+0000 7fc4e2bff700 1 -- 172.21.15.115:0/4128220239 shutdown_connections 2023-07-27T14:33:28.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.888+0000 7fc4e2bff700 1 --2- 172.21.15.115:0/4128220239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc154f00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:28.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.888+0000 7fc4e2bff700 1 -- 172.21.15.115:0/4128220239 >> 172.21.15.115:0/4128220239 conn(0x7fc4dc05e940 msgr2=0x7fc4dc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:28.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.888+0000 7fc4e2bff700 1 -- 172.21.15.115:0/4128220239 shutdown_connections 2023-07-27T14:33:28.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.888+0000 7fc4e2bff700 1 -- 172.21.15.115:0/4128220239 wait complete. 2023-07-27T14:33:28.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.889+0000 7fc4e2bff700 1 Processor -- start 2023-07-27T14:33:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.890+0000 7fc4e2bff700 1 -- start start 2023-07-27T14:33:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e2bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4dc063260 0x7fc4dc0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e2bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14ae00 0x7fc4dc149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e2bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e2bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0c3100 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e2bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0c2530 con 0x7fc4dc14ae00 2023-07-27T14:33:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e2bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0c27d0 con 0x7fc4dc063260 2023-07-27T14:33:28.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:28.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57256/0 (socket says 172.21.15.115:57256) 2023-07-27T14:33:28.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 -- 172.21.15.115:0/3777919357 learned_addr learned my addr 172.21.15.115:0/3777919357 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:28.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4dbfff700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14ae00 0x7fc4dc149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:28.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 -- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4dc063260 msgr2=0x7fc4dc0c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:28.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e099b700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4dc063260 0x7fc4dc0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:28.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4dc063260 0x7fc4dc0c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:28.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 -- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14ae00 msgr2=0x7fc4dc149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:28.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14ae00 0x7fc4dc149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:28.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 -- 172.21.15.115:0/3777919357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d4009a20 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4dbfff700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14ae00 0x7fc4dc149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:28.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e099b700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4dc063260 0x7fc4dc0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:28.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.891+0000 7fc4e119c700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc149730 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7fc4d4011000 tx=0x7fc4d4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:28.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.892+0000 7fc4d8ff9700 1 -- 172.21.15.115:0/3777919357 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d401d630 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.892+0000 7fc4d8ff9700 1 -- 172.21.15.115:0/3777919357 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d401d790 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.892+0000 7fc4d8ff9700 1 -- 172.21.15.115:0/3777919357 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d401db10 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.892+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc0c2ab0 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.892+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc149c20 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.893+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4dc06c470 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.894+0000 7fc4d8ff9700 1 -- 172.21.15.115:0/3777919357 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fc4d4026410 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.895+0000 7fc4d8ff9700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c005f5b0 0x7fc4c0061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:28.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.895+0000 7fc4d8ff9700 1 -- 172.21.15.115:0/3777919357 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fc4d407c3e0 con 0x7fc4dc14b1e0 2023-07-27T14:33:28.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.895+0000 7fc4e099b700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c005f5b0 0x7fc4c0061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:28.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.896+0000 7fc4e099b700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c005f5b0 0x7fc4c0061a70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fc4d0002750 tx=0x7fc4d0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:28.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:28.899+0000 7fc4d8ff9700 1 -- 172.21.15.115:0/3777919357 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4d404d400 con 0x7fc4dc14b1e0 2023-07-27T14:33:29.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.068+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc4dc0a9f90 con 0x7fc4dc14b1e0 2023-07-27T14:33:29.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.072+0000 7fc4d8ff9700 1 -- 172.21.15.115:0/3777919357 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc4d4050a20 con 0x7fc4dc14b1e0 2023-07-27T14:33:29.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.073+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c005f5b0 msgr2=0x7fc4c0061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:29.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.073+0000 7fc4e2bff700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c005f5b0 0x7fc4c0061a70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fc4d0002750 tx=0x7fc4d0009040).stop 2023-07-27T14:33:29.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4dc14b1e0 msgr2=0x7fc4dc149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:29.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc149730 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7fc4d4011000 tx=0x7fc4d4009780).stop 2023-07-27T14:33:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 shutdown_connections 2023-07-27T14:33:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4c005f5b0 0x7fc4c0061a70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4dc14b1e0 0x7fc4dc149730 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4dc063260 0x7fc4dc0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 --2- 172.21.15.115:0/3777919357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4dc14ae00 0x7fc4dc149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 >> 172.21.15.115:0/3777919357 conn(0x7fc4dc05e940 msgr2=0x7fc4dc14a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 shutdown_connections 2023-07-27T14:33:29.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.074+0000 7fc4e2bff700 1 -- 172.21.15.115:0/3777919357 wait complete. 2023-07-27T14:33:29.130 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:33:29.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:33:29.223 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:33:29.333 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:33:29.333 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:33:29.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:29.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.481+0000 7fcfa87ff700 1 Processor -- start 2023-07-27T14:33:29.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.481+0000 7fcfa87ff700 1 -- start start 2023-07-27T14:33:29.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.482+0000 7fcfa87ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcfa0153ec0 0x7fcfa00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:29.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.482+0000 7fcfa87ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcfa00aaa40 0x7fcfa00c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:29.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.482+0000 7fcfa87ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00aa4d0 con 0x7fcfa00aa050 2023-07-27T14:33:29.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.482+0000 7fcfa87ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00c05c0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.482+0000 7fcfa87ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00bfc90 con 0x7fcfa0153ec0 2023-07-27T14:33:29.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa5d9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcfa00aa050 0x7fcfa00640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49536/0 (socket says 172.21.15.115:49536) 2023-07-27T14:33:29.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa6d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcfa00aaa40 0x7fcfa00c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:29.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa5d9a700 1 -- 172.21.15.115:0/1268163079 learned_addr learned my addr 172.21.15.115:0/1268163079 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:29.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa659b700 1 --2- 172.21.15.115:0/1268163079 >> v2:172.21.15.159:3300/0 conn(0x7fcfa0153ec0 0x7fcfa00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:29.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa6d9c700 1 -- 172.21.15.115:0/1268163079 >> v2:172.21.15.159:3300/0 conn(0x7fcfa0153ec0 msgr2=0x7fcfa00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:29.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa6d9c700 1 --2- 172.21.15.115:0/1268163079 >> v2:172.21.15.159:3300/0 conn(0x7fcfa0153ec0 0x7fcfa00a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa6d9c700 1 -- 172.21.15.115:0/1268163079 >> v1:172.21.15.115:6789/0 conn(0x7fcfa00aa050 legacy=0x7fcfa00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:29.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa6d9c700 1 -- 172.21.15.115:0/1268163079 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa00bff70 con 0x7fcfa00aaa40 2023-07-27T14:33:29.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa5599700 1 -- 172.21.15.115:0/1268163079 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129692627 0 0) 0x7fcf90001110 con 0x7fcfa00aa050 2023-07-27T14:33:29.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.483+0000 7fcfa6d9c700 1 --2- 172.21.15.115:0/1268163079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa00c0a50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fcfa0083e30 tx=0x7fcf98009780).ready entity=mon.0 client_cookie=1026fb2d9dcd35df server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:29.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa5599700 1 -- 172.21.15.115:0/1268163079 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800e070 con 0x7fcfa00aaa40 2023-07-27T14:33:29.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa5599700 1 -- 172.21.15.115:0/1268163079 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9800bc30 con 0x7fcfa00aaa40 2023-07-27T14:33:29.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa5599700 1 -- 172.21.15.115:0/1268163079 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98012410 con 0x7fcfa00aaa40 2023-07-27T14:33:29.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa87ff700 1 -- 172.21.15.115:0/1268163079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 msgr2=0x7fcfa00c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:29.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/1268163079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa00c0a50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fcfa0083e30 tx=0x7fcf98009780).stop 2023-07-27T14:33:29.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa87ff700 1 -- 172.21.15.115:0/1268163079 shutdown_connections 2023-07-27T14:33:29.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/1268163079 >> v2:172.21.15.159:3300/0 conn(0x7fcfa0153ec0 0x7fcfa00a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/1268163079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa00c0a50 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa87ff700 1 -- 172.21.15.115:0/1268163079 >> 172.21.15.115:0/1268163079 conn(0x7fcfa00cb610 msgr2=0x7fcfa00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:29.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa87ff700 1 -- 172.21.15.115:0/1268163079 shutdown_connections 2023-07-27T14:33:29.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.484+0000 7fcfa87ff700 1 -- 172.21.15.115:0/1268163079 wait complete. 2023-07-27T14:33:29.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.486+0000 7fcfa87ff700 1 Processor -- start 2023-07-27T14:33:29.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.487+0000 7fcfa87ff700 1 -- start start 2023-07-27T14:33:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa87ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcfa00aa050 0x7fcfa013e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa87ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa013bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa87ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa0153ec0 0x7fcfa01674d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa87ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa013d110 con 0x7fcfa00aaa40 2023-07-27T14:33:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa87ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa013c500 con 0x7fcfa0153ec0 2023-07-27T14:33:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa87ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa013c7e0 con 0x7fcfa00aa050 2023-07-27T14:33:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa5d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa013bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa5d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa013bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57272/0 (socket says 172.21.15.115:57272) 2023-07-27T14:33:29.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa5d9a700 1 -- 172.21.15.115:0/746437742 learned_addr learned my addr 172.21.15.115:0/746437742 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:29.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa6d9c700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa0153ec0 0x7fcfa01674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:29.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa659b700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcfa00aa050 0x7fcfa013e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:29.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa5d9a700 1 -- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcfa00aa050 msgr2=0x7fcfa013e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:29.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa5d9a700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcfa00aa050 0x7fcfa013e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa5d9a700 1 -- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa0153ec0 msgr2=0x7fcfa01674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:29.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa5d9a700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa0153ec0 0x7fcfa01674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.488+0000 7fcfa5d9a700 1 -- 172.21.15.115:0/746437742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009a20 con 0x7fcfa00aaa40 2023-07-27T14:33:29.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.489+0000 7fcfa659b700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcfa00aa050 0x7fcfa013e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:29.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.489+0000 7fcfa6d9c700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa0153ec0 0x7fcfa01674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:29.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.489+0000 7fcfa5d9a700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa013bbc0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7fcf9000c510 tx=0x7fcf90007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:29.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.489+0000 7fcf967fc700 1 -- 172.21.15.115:0/746437742 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900072e0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.489+0000 7fcf967fc700 1 -- 172.21.15.115:0/746437742 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90007440 con 0x7fcfa00aaa40 2023-07-27T14:33:29.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.489+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa013cac0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.489+0000 7fcf967fc700 1 -- 172.21.15.115:0/746437742 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900057a0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.489+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa013ebb0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.490+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa013d2c0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.491+0000 7fcf967fc700 1 -- 172.21.15.115:0/746437742 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fcf90010070 con 0x7fcfa00aaa40 2023-07-27T14:33:29.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.491+0000 7fcf967fc700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcf8405f580 0x7fcf84061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:29.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.492+0000 7fcf967fc700 1 -- 172.21.15.115:0/746437742 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fcf90079b30 con 0x7fcfa00aaa40 2023-07-27T14:33:29.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.492+0000 7fcfa659b700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcf8405f580 0x7fcf84061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:29.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.492+0000 7fcfa659b700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcf8405f580 0x7fcf84061a40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fcf9c006fd0 tx=0x7fcf9c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:29.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.496+0000 7fcf967fc700 1 -- 172.21.15.115:0/746437742 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcfa013d2c0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.704+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfa00aa4d0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.705+0000 7fcf967fc700 1 -- 172.21.15.115:0/746437742 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3538 (secure 0 0 0) 0x7fcfa00aa4d0 con 0x7fcfa00aaa40 2023-07-27T14:33:29.744 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:29.745 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1059927938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1059927938},{"type":"v1","addr":"172.21.15.159:6834","nonce":1059927938}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2712836683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2712836683},{"type":"v1","addr":"172.21.15.159:6835","nonce":2712836683}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2509102546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2509102546},{"type":"v1","addr":"172.21.15.115:6836","nonce":2509102546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7713,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/151503049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":151503049},{"type":"v1","addr":"172.21.15.115:6837","nonce":151503049}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-07-27T14:33:29.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcf8405f580 msgr2=0x7fcf84061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:29.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcf8405f580 0x7fcf84061a40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fcf9c006fd0 tx=0x7fcf9c008040).stop 2023-07-27T14:33:29.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 msgr2=0x7fcfa013bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:29.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa013bbc0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7fcf9000c510 tx=0x7fcf90007ad0).stop 2023-07-27T14:33:29.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 shutdown_connections 2023-07-27T14:33:29.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcf8405f580 0x7fcf84061a40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfa0153ec0 0x7fcfa01674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcfa00aa050 0x7fcfa013e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 --2- 172.21.15.115:0/746437742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfa00aaa40 0x7fcfa013bbc0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:29.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 >> 172.21.15.115:0/746437742 conn(0x7fcfa00cb610 msgr2=0x7fcfa00abc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:29.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 shutdown_connections 2023-07-27T14:33:29.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.707+0000 7fcfa87ff700 1 -- 172.21.15.115:0/746437742 wait complete. 2023-07-27T14:33:29.748 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 62 2023-07-27T14:33:29.764 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:33:29.764 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:33:29.765 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:33:29.765 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:33:29.765 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:33:29.765 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:33:29.766 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:33:29.766 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:33:29.766 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:33:29.766 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:33:29.766 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:33:29.767 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:33:29.767 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:33:29.767 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:33:29.767 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:33:29.767 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:33:29.778 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:33:29.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:33:29.779 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:33:29.780 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:33:29.783 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:33:29.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:33:29.784 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:33:29.784 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:33:29.824 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:33:29.824 DEBUG:teuthology.parallel:result is None 2023-07-27T14:33:29.827 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:33:29.827 DEBUG:teuthology.parallel:result is None 2023-07-27T14:33:29.828 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:33:29.828 DEBUG:teuthology.parallel:result is None 2023-07-27T14:33:29.830 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:33:29.830 DEBUG:teuthology.parallel:result is None 2023-07-27T14:33:29.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:33:29.907 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:33:29.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:33:29.969 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:33:29.975 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:33:29.977 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:33:29.979 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:33:29.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-07-27T14:33:29.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-27T14:33:29.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-27T14:33:30.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.996+0000 7f5fc83ff700 1 Processor -- start 2023-07-27T14:33:30.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.997+0000 7f5fc83ff700 1 -- start start 2023-07-27T14:33:30.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.998+0000 7f5fc83ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5fc00bc450 0x7f5fc00a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:30.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc83ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc00c2ed0 con 0x7f5fc0154060 2023-07-27T14:33:30.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc83ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc00a58d0 con 0x7f5fc0154440 2023-07-27T14:33:30.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc83ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc00a5bb0 con 0x7f5fc00bc450 2023-07-27T14:33:30.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc619b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5fc0154060 0x7f5fc00bbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49550/0 (socket says 172.21.15.115:49550) 2023-07-27T14:33:30.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc619b700 1 -- 172.21.15.115:0/3084704468 learned_addr learned my addr 172.21.15.115:0/3084704468 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:30.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc599a700 1 --2- 172.21.15.115:0/3084704468 >> v2:172.21.15.159:3300/0 conn(0x7f5fc00bc450 0x7f5fc00a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:30.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc5199700 1 -- 172.21.15.115:0/3084704468 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43069598 0 0) 0x7f5fc00c2ed0 con 0x7f5fc0154060 2023-07-27T14:33:30.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc5199700 1 -- 172.21.15.115:0/3084704468 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fac0033f0 con 0x7f5fc0154060 2023-07-27T14:33:30.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc5199700 1 -- 172.21.15.115:0/3084704468 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443070665 0 0) 0x7f5fc00a58d0 con 0x7f5fc0154440 2023-07-27T14:33:30.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:29.999+0000 7f5fc5199700 1 -- 172.21.15.115:0/3084704468 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc00c2ed0 con 0x7f5fc0154440 2023-07-27T14:33:30.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.000+0000 7f5fc599a700 1 -- 172.21.15.115:0/3084704468 >> v1:172.21.15.159:6789/0 conn(0x7f5fc0154440 legacy=0x7f5fc00c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:30.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.000+0000 7f5fc5199700 1 -- 172.21.15.115:0/3084704468 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2248246832 0 0) 0x7f5fac0033f0 con 0x7f5fc0154060 2023-07-27T14:33:30.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.000+0000 7f5fc599a700 1 -- 172.21.15.115:0/3084704468 >> v1:172.21.15.115:6789/0 conn(0x7f5fc0154060 legacy=0x7f5fc00bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:30.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.000+0000 7f5fc599a700 1 -- 172.21.15.115:0/3084704468 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00a5e90 con 0x7f5fc00bc450 2023-07-27T14:33:30.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.000+0000 7f5fc599a700 1 --2- 172.21.15.115:0/3084704468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc00bc450 0x7f5fc00a4c80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f5fb0009760 tx=0x7f5fb0009060).ready entity=mon.1 client_cookie=2fa4b6638ef2576e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:30.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.000+0000 7f5fc5199700 1 -- 172.21.15.115:0/3084704468 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc001470 con 0x7f5fc00bc450 2023-07-27T14:33:30.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.000+0000 7f5fc5199700 1 -- 172.21.15.115:0/3084704468 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb0011400 con 0x7f5fc00bc450 2023-07-27T14:33:30.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.000+0000 7f5fc5199700 1 -- 172.21.15.115:0/3084704468 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0011780 con 0x7f5fc00bc450 2023-07-27T14:33:30.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.001+0000 7f5fc83ff700 1 -- 172.21.15.115:0/3084704468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc00bc450 msgr2=0x7f5fc00a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:30.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.001+0000 7f5fc83ff700 1 --2- 172.21.15.115:0/3084704468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc00bc450 0x7f5fc00a4c80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f5fb0009760 tx=0x7f5fb0009060).stop 2023-07-27T14:33:30.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.001+0000 7f5fc83ff700 1 -- 172.21.15.115:0/3084704468 shutdown_connections 2023-07-27T14:33:30.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.001+0000 7f5fc83ff700 1 --2- 172.21.15.115:0/3084704468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc00bc450 0x7f5fc00a4c80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:30.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.001+0000 7f5fc83ff700 1 -- 172.21.15.115:0/3084704468 >> 172.21.15.115:0/3084704468 conn(0x7f5fc0062320 msgr2=0x7f5fc0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:30.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.001+0000 7f5fc83ff700 1 -- 172.21.15.115:0/3084704468 shutdown_connections 2023-07-27T14:33:30.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.001+0000 7f5fc83ff700 1 -- 172.21.15.115:0/3084704468 wait complete. 2023-07-27T14:33:30.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.002+0000 7f5fc83ff700 1 Processor -- start 2023-07-27T14:33:30.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.003+0000 7f5fc83ff700 1 -- start start 2023-07-27T14:33:30.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.003+0000 7f5fc83ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc00bc450 0x7f5fc00ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:30.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.003+0000 7f5fc83ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc0154060 0x7f5fc00a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:30.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc83ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc0154440 0x7f5fc00a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:30.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc83ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00a9220 con 0x7f5fc00bc450 2023-07-27T14:33:30.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc83ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00ab080 con 0x7f5fc0154060 2023-07-27T14:33:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc83ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00ab360 con 0x7f5fc0154440 2023-07-27T14:33:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc00bc450 0x7f5fc00ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc00bc450 0x7f5fc00ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57326/0 (socket says 172.21.15.115:57326) 2023-07-27T14:33:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 -- 172.21.15.115:0/1902598859 learned_addr learned my addr 172.21.15.115:0/1902598859 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc599a700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc0154060 0x7f5fc00a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc699c700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc0154440 0x7f5fc00a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 -- 172.21.15.115:0/1902598859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc0154440 msgr2=0x7f5fc00a8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:30.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc0154440 0x7f5fc00a8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:30.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 -- 172.21.15.115:0/1902598859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc0154060 msgr2=0x7f5fc00a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:30.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc0154060 0x7f5fc00a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:30.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 -- 172.21.15.115:0/1902598859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00092a0 con 0x7f5fc00bc450 2023-07-27T14:33:30.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.004+0000 7f5fc619b700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc00bc450 0x7f5fc00ac5d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f5fbc00c800 tx=0x7f5fbc001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:30.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.005+0000 7f5fb67fc700 1 -- 172.21.15.115:0/1902598859 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc007170 con 0x7f5fc00bc450 2023-07-27T14:33:30.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.005+0000 7f5fb67fc700 1 -- 172.21.15.115:0/1902598859 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc0072d0 con 0x7f5fc00bc450 2023-07-27T14:33:30.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.005+0000 7f5fb67fc700 1 -- 172.21.15.115:0/1902598859 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0048c0 con 0x7f5fc00bc450 2023-07-27T14:33:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.005+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc00ab640 con 0x7f5fc00bc450 2023-07-27T14:33:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.005+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc00aacc0 con 0x7f5fc00bc450 2023-07-27T14:33:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.006+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc00c5140 con 0x7f5fc00bc450 2023-07-27T14:33:30.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.007+0000 7f5fb67fc700 1 -- 172.21.15.115:0/1902598859 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f5fbc01b070 con 0x7f5fc00bc450 2023-07-27T14:33:30.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.007+0000 7f5fb67fc700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa405f5b0 0x7f5fa4061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:30.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.008+0000 7f5fb67fc700 1 -- 172.21.15.115:0/1902598859 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f5fbc079b00 con 0x7f5fc00bc450 2023-07-27T14:33:30.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.008+0000 7f5fc599a700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa405f5b0 0x7f5fa4061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:30.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.008+0000 7f5fc599a700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa405f5b0 0x7f5fa4061a70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f5fb0009760 tx=0x7f5fb0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:30.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.011+0000 7f5fb67fc700 1 -- 172.21.15.115:0/1902598859 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fbc07be60 con 0x7f5fc00bc450 2023-07-27T14:33:30.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:30.198+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5fc006c470 con 0x7f5fc00bc450 2023-07-27T14:33:31.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.076+0000 7f5fb67fc700 1 -- 172.21.15.115:0/1902598859 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v122) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5fbc019020 con 0x7f5fc00bc450 2023-07-27T14:33:31.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa405f5b0 msgr2=0x7f5fa4061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa405f5b0 0x7f5fa4061a70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f5fb0009760 tx=0x7f5fb0016000).stop 2023-07-27T14:33:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc00bc450 msgr2=0x7f5fc00ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc00bc450 0x7f5fc00ac5d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f5fbc00c800 tx=0x7f5fbc001b50).stop 2023-07-27T14:33:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 shutdown_connections 2023-07-27T14:33:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fa405f5b0 0x7f5fa4061a70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fc0154440 0x7f5fc00a8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc00bc450 0x7f5fc00ac5d0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 --2- 172.21.15.115:0/1902598859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fc0154060 0x7f5fc00a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 >> 172.21.15.115:0/1902598859 conn(0x7f5fc0062320 msgr2=0x7f5fc00c1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 shutdown_connections 2023-07-27T14:33:31.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.079+0000 7f5fc83ff700 1 -- 172.21.15.115:0/1902598859 wait complete. 2023-07-27T14:33:31.120 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:33:31.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:33:31.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.330+0000 7ff4b81ff700 1 Processor -- start 2023-07-27T14:33:31.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.330+0000 7ff4b81ff700 1 -- start start 2023-07-27T14:33:31.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b81ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b0062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b81ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff4b00a4f50 0x7ff4b00bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b81ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00639d0 con 0x7ff4b0062810 2023-07-27T14:33:31.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b81ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b0137610 con 0x7ff4b00a4f50 2023-07-27T14:33:31.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b81ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0062dc0 con 0x7ff4b0151bd0 2023-07-27T14:33:31.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b679c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff4b00a4f50 0x7ff4b00bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b5f9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b0062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b679c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff4b00a4f50 0x7ff4b00bc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:42124/0 (socket says 172.21.15.115:42124) 2023-07-27T14:33:31.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b579a700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7ff4b0062810 0x7ff4b00a4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:58490/0 (socket says 172.21.15.115:58490) 2023-07-27T14:33:31.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.332+0000 7ff4b679c700 1 -- 172.21.15.115:0/1949105504 learned_addr learned my addr 172.21.15.115:0/1949105504 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:31.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.333+0000 7ff4b5f9b700 1 -- 172.21.15.115:0/1949105504 >> v2:172.21.15.159:3300/0 conn(0x7ff4b00a4f50 msgr2=0x7ff4b00bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:31.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.333+0000 7ff4b5f9b700 1 --2- 172.21.15.115:0/1949105504 >> v2:172.21.15.159:3300/0 conn(0x7ff4b00a4f50 0x7ff4b00bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.333+0000 7ff4b5f9b700 1 -- 172.21.15.115:0/1949105504 >> v1:172.21.15.159:6789/0 conn(0x7ff4b0062810 legacy=0x7ff4b00a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.333+0000 7ff4b5f9b700 1 -- 172.21.15.115:0/1949105504 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00630a0 con 0x7ff4b0151bd0 2023-07-27T14:33:31.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.333+0000 7ff4b5f9b700 1 --2- 172.21.15.115:0/1949105504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b0062320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff4ac009760 tx=0x7ff4ac009060).ready entity=mon.2 client_cookie=ab098ac752cb3fb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:31.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.333+0000 7ff4b4f99700 1 -- 172.21.15.115:0/1949105504 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00f510 con 0x7ff4b0151bd0 2023-07-27T14:33:31.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.333+0000 7ff4b4f99700 1 -- 172.21.15.115:0/1949105504 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00f670 con 0x7ff4b0151bd0 2023-07-27T14:33:31.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b4f99700 1 -- 172.21.15.115:0/1949105504 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00f9f0 con 0x7ff4b0151bd0 2023-07-27T14:33:31.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b81ff700 1 -- 172.21.15.115:0/1949105504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 msgr2=0x7ff4b0062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/1949105504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b0062320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff4ac009760 tx=0x7ff4ac009060).stop 2023-07-27T14:33:31.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b81ff700 1 -- 172.21.15.115:0/1949105504 shutdown_connections 2023-07-27T14:33:31.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/1949105504 >> v2:172.21.15.159:3300/0 conn(0x7ff4b00a4f50 0x7ff4b00bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/1949105504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b0062320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b81ff700 1 -- 172.21.15.115:0/1949105504 >> 172.21.15.115:0/1949105504 conn(0x7ff4b0064700 msgr2=0x7ff4b0064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:31.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b81ff700 1 -- 172.21.15.115:0/1949105504 shutdown_connections 2023-07-27T14:33:31.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.334+0000 7ff4b81ff700 1 -- 172.21.15.115:0/1949105504 wait complete. 2023-07-27T14:33:31.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.336+0000 7ff4b81ff700 1 Processor -- start 2023-07-27T14:33:31.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.336+0000 7ff4b81ff700 1 -- start start 2023-07-27T14:33:31.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b81ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4b0062810 0x7ff4b013d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b81ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b00a4f50 0x7ff4b00be190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b81ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b013c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b81ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00ad0e0 con 0x7ff4b00a4f50 2023-07-27T14:33:31.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b81ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b013db60 con 0x7ff4b0062810 2023-07-27T14:33:31.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b81ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b01647f0 con 0x7ff4b0151bd0 2023-07-27T14:33:31.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b579a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b00a4f50 0x7ff4b00be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b579a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b00a4f50 0x7ff4b00be190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57334/0 (socket says 172.21.15.115:57334) 2023-07-27T14:33:31.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b579a700 1 -- 172.21.15.115:0/3883510920 learned_addr learned my addr 172.21.15.115:0/3883510920 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:31.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b679c700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b013c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.337+0000 7ff4b5f9b700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4b0062810 0x7ff4b013d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4b579a700 1 -- 172.21.15.115:0/3883510920 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 msgr2=0x7ff4b013c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4b579a700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b013c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4b579a700 1 -- 172.21.15.115:0/3883510920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4b0062810 msgr2=0x7ff4b013d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4b579a700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4b0062810 0x7ff4b013d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4b579a700 1 -- 172.21.15.115:0/3883510920 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0092a0 con 0x7ff4b00a4f50 2023-07-27T14:33:31.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4b579a700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b00a4f50 0x7ff4b00be190 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7ff4a000c410 tx=0x7ff4a0007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:31.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4a5ffb700 1 -- 172.21.15.115:0/3883510920 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00070d0 con 0x7ff4b00a4f50 2023-07-27T14:33:31.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4a5ffb700 1 -- 172.21.15.115:0/3883510920 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a0007230 con 0x7ff4b00a4f50 2023-07-27T14:33:31.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4a5ffb700 1 -- 172.21.15.115:0/3883510920 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00056e0 con 0x7ff4b00a4f50 2023-07-27T14:33:31.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b0164ad0 con 0x7ff4b00a4f50 2023-07-27T14:33:31.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.338+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b0165090 con 0x7ff4b00a4f50 2023-07-27T14:33:31.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.339+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b006c470 con 0x7ff4b00a4f50 2023-07-27T14:33:31.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.340+0000 7ff4a5ffb700 1 -- 172.21.15.115:0/3883510920 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7ff4a0010070 con 0x7ff4b00a4f50 2023-07-27T14:33:31.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.341+0000 7ff4a5ffb700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff49405f5b0 0x7ff494061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.341+0000 7ff4a5ffb700 1 -- 172.21.15.115:0/3883510920 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff4a0079aa0 con 0x7ff4b00a4f50 2023-07-27T14:33:31.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.342+0000 7ff4b5f9b700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff49405f5b0 0x7ff494061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.342+0000 7ff4b5f9b700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff49405f5b0 0x7ff494061a70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ff4ac009760 tx=0x7ff4ac017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:31.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.346+0000 7ff4a5ffb700 1 -- 172.21.15.115:0/3883510920 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4a004aa60 con 0x7ff4b00a4f50 2023-07-27T14:33:31.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.577+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff4b0065370 con 0x7ff4b00a4f50 2023-07-27T14:33:31.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.578+0000 7ff4a5ffb700 1 -- 172.21.15.115:0/3883510920 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff4a004e080 con 0x7ff4b00a4f50 2023-07-27T14:33:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:31.618 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:33:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:33:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:33:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:33:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:33:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:33:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:33:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:33:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:33:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:33:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:33:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:33:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:33:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:33:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:33:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:33:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:33:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:33:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:33:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:33:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:33:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:33:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:33:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:33:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:33:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:33:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:33:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:33:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:33:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:33:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:33:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:33:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:33:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:33:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:33:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:33:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:33:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:33:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:33:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:33:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:33:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:33:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:33:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:33:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:33:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:33:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:33:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:33:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:33:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:33:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:33:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:33:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:33:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:33:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:33:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:33:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:33:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:33:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:33:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:33:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:33:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:33:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:33:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:33:31.641 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:33:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff49405f5b0 msgr2=0x7ff494061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff49405f5b0 0x7ff494061a70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ff4ac009760 tx=0x7ff4ac017000).stop 2023-07-27T14:33:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b00a4f50 msgr2=0x7ff4b00be190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b00a4f50 0x7ff4b00be190 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7ff4a000c410 tx=0x7ff4a0007d80).stop 2023-07-27T14:33:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 shutdown_connections 2023-07-27T14:33:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff49405f5b0 0x7ff494061a70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4b0151bd0 0x7ff4b013c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4b0062810 0x7ff4b013d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 --2- 172.21.15.115:0/3883510920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4b00a4f50 0x7ff4b00be190 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 >> 172.21.15.115:0/3883510920 conn(0x7ff4b0064700 msgr2=0x7ff4b00c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 shutdown_connections 2023-07-27T14:33:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.580+0000 7ff4b81ff700 1 -- 172.21.15.115:0/3883510920 wait complete. 2023-07-27T14:33:31.645 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:31.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.795+0000 7f4a2adff700 1 Processor -- start 2023-07-27T14:33:31.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.795+0000 7f4a2adff700 1 -- start start 2023-07-27T14:33:31.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.796+0000 7f4a2adff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4a240aaa40 0x7f4a240640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a2adff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240aa4d0 con 0x7f4a241542a0 2023-07-27T14:33:31.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a2adff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240c05c0 con 0x7f4a24153ec0 2023-07-27T14:33:31.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a2adff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a240aa270 con 0x7f4a240aaa40 2023-07-27T14:33:31.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a2939c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4a241542a0 0x7f4a240c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49552/0 (socket says 172.21.15.115:49552) 2023-07-27T14:33:31.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a2939c700 1 -- 172.21.15.115:0/3865842411 learned_addr learned my addr 172.21.15.115:0/3865842411 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:31.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a23fff700 1 --2- 172.21.15.115:0/3865842411 >> v2:172.21.15.159:3300/0 conn(0x7f4a240aaa40 0x7f4a240640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677242723 0 0) 0x7f4a1c001490 con 0x7f4a241542a0 2023-07-27T14:33:31.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a140033f0 con 0x7f4a241542a0 2023-07-27T14:33:31.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1689428905 0 0) 0x7f4a140033f0 con 0x7f4a241542a0 2023-07-27T14:33:31.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 >> v2:172.21.15.159:3300/0 conn(0x7f4a240aaa40 msgr2=0x7f4a240640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:31.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a237fe700 1 --2- 172.21.15.115:0/3865842411 >> v2:172.21.15.159:3300/0 conn(0x7f4a240aaa40 0x7f4a240640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 >> v1:172.21.15.159:6789/0 conn(0x7f4a24153ec0 legacy=0x7f4a240a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.797+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240bfc90 con 0x7f4a241542a0 2023-07-27T14:33:31.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4a1c001980 con 0x7f4a241542a0 2023-07-27T14:33:31.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 >> v1:172.21.15.115:6789/0 conn(0x7f4a241542a0 legacy=0x7f4a240c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a237fe700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a140038e0 0x7f4a14003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a237fe700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a14004690 0x7f4a14004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a237fe700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a14005000 0x7f4a1400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240aa270 con 0x7f4a140038e0 2023-07-27T14:33:31.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1400bf60 con 0x7f4a14005000 2023-07-27T14:33:31.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1400c0f0 con 0x7f4a14004690 2023-07-27T14:33:31.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a28b9b700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a140038e0 0x7f4a14003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a2939c700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a14005000 0x7f4a1400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a23fff700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a14004690 0x7f4a14004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a28b9b700 1 -- 172.21.15.115:0/3865842411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a14004690 msgr2=0x7f4a14004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:31.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a28b9b700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a14004690 0x7f4a14004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a28b9b700 1 -- 172.21.15.115:0/3865842411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a14005000 msgr2=0x7f4a1400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:31.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a28b9b700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a14005000 0x7f4a1400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a28b9b700 1 -- 172.21.15.115:0/3865842411 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140033f0 con 0x7f4a140038e0 2023-07-27T14:33:31.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.798+0000 7f4a2939c700 1 -- 172.21.15.115:0/3865842411 reap_dead start 2023-07-27T14:33:31.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a28b9b700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a140038e0 0x7f4a14003d00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f4a18001730 tx=0x7f4a18007bb0).ready entity=mon.0 client_cookie=7c6f0dff4c45923d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:31.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18007020 con 0x7f4a140038e0 2023-07-27T14:33:31.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18007180 con 0x7f4a140038e0 2023-07-27T14:33:31.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a237fe700 1 -- 172.21.15.115:0/3865842411 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18007520 con 0x7f4a140038e0 2023-07-27T14:33:31.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a2adff700 1 -- 172.21.15.115:0/3865842411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a140038e0 msgr2=0x7f4a14003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a2adff700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a140038e0 0x7f4a14003d00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f4a18001730 tx=0x7f4a18007bb0).stop 2023-07-27T14:33:31.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a2adff700 1 -- 172.21.15.115:0/3865842411 shutdown_connections 2023-07-27T14:33:31.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a2adff700 1 --2- 172.21.15.115:0/3865842411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a140038e0 0x7f4a14003d00 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a2adff700 1 -- 172.21.15.115:0/3865842411 >> 172.21.15.115:0/3865842411 conn(0x7f4a240cb610 msgr2=0x7f4a240c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:31.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a2adff700 1 -- 172.21.15.115:0/3865842411 shutdown_connections 2023-07-27T14:33:31.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.799+0000 7f4a2adff700 1 -- 172.21.15.115:0/3865842411 wait complete. 2023-07-27T14:33:31.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.801+0000 7f4a2adff700 1 Processor -- start 2023-07-27T14:33:31.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.801+0000 7f4a2adff700 1 -- start start 2023-07-27T14:33:31.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a2adff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a140038e0 0x7f4a2413c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a2adff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a240b0430 0x7f4a240ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a2adff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a240b08b0 0x7f4a240ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a2adff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240aba50 con 0x7f4a240b0430 2023-07-27T14:33:31.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a2adff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2413c910 con 0x7f4a140038e0 2023-07-27T14:33:31.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a2adff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240c31e0 con 0x7f4a240b08b0 2023-07-27T14:33:31.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a23fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a240b0430 0x7f4a240ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a23fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a240b0430 0x7f4a240ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57342/0 (socket says 172.21.15.115:57342) 2023-07-27T14:33:31.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a23fff700 1 -- 172.21.15.115:0/445002678 learned_addr learned my addr 172.21.15.115:0/445002678 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:31.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a28b9b700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a140038e0 0x7f4a2413c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a2939c700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a240b08b0 0x7f4a240ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a23fff700 1 -- 172.21.15.115:0/445002678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a240b08b0 msgr2=0x7f4a240ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a23fff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a240b08b0 0x7f4a240ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a23fff700 1 -- 172.21.15.115:0/445002678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a140038e0 msgr2=0x7f4a2413c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:31.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a23fff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a140038e0 0x7f4a2413c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:31.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.802+0000 7f4a23fff700 1 -- 172.21.15.115:0/445002678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240c25d0 con 0x7f4a240b0430 2023-07-27T14:33:31.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.803+0000 7f4a23fff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a240b0430 0x7f4a240ab070 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f4a100119a0 tx=0x7f4a10009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:31.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.803+0000 7f4a20ff9700 1 -- 172.21.15.115:0/445002678 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000f730 con 0x7f4a240b0430 2023-07-27T14:33:31.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.803+0000 7f4a20ff9700 1 -- 172.21.15.115:0/445002678 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000f890 con 0x7f4a240b0430 2023-07-27T14:33:31.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.803+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a240c28b0 con 0x7f4a240b0430 2023-07-27T14:33:31.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.803+0000 7f4a20ff9700 1 -- 172.21.15.115:0/445002678 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000fc10 con 0x7f4a240b0430 2023-07-27T14:33:31.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.803+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a240c2e70 con 0x7f4a240b0430 2023-07-27T14:33:31.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.804+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2406c470 con 0x7f4a240b0430 2023-07-27T14:33:31.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.805+0000 7f4a20ff9700 1 -- 172.21.15.115:0/445002678 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f4a10024070 con 0x7f4a240b0430 2023-07-27T14:33:31.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.806+0000 7f4a20ff9700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805f580 0x7f4a08061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:31.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.806+0000 7f4a20ff9700 1 -- 172.21.15.115:0/445002678 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4a1007ab30 con 0x7f4a240b0430 2023-07-27T14:33:31.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.806+0000 7f4a28b9b700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805f580 0x7f4a08061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:31.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.807+0000 7f4a28b9b700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805f580 0x7f4a08061a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f4a18001010 tx=0x7f4a18015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:31.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.810+0000 7f4a20ff9700 1 -- 172.21.15.115:0/445002678 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a1004bde0 con 0x7f4a240b0430 2023-07-27T14:33:32.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.979+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a24159d30 con 0x7f4a240b0430 2023-07-27T14:33:32.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.980+0000 7f4a20ff9700 1 -- 172.21.15.115:0/445002678 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+13866 (secure 0 0 0) 0x7f4a10018070 con 0x7f4a240b0430 2023-07-27T14:33:32.020 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:32.020 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":122,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:31.072676+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:32.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805f580 msgr2=0x7f4a08061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805f580 0x7f4a08061a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f4a18001010 tx=0x7f4a18015000).stop 2023-07-27T14:33:32.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a240b0430 msgr2=0x7f4a240ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a240b0430 0x7f4a240ab070 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f4a100119a0 tx=0x7f4a10009060).stop 2023-07-27T14:33:32.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 shutdown_connections 2023-07-27T14:33:32.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805f580 0x7f4a08061a40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a240b08b0 0x7f4a240ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a140038e0 0x7f4a2413c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 --2- 172.21.15.115:0/445002678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a240b0430 0x7f4a240ab070 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 >> 172.21.15.115:0/445002678 conn(0x7f4a240cb610 msgr2=0x7f4a240c08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:32.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 shutdown_connections 2023-07-27T14:33:32.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:31.982+0000 7f4a2adff700 1 -- 172.21.15.115:0/445002678 wait complete. 2023-07-27T14:33:32.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:33:32.039 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:33:32.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.191+0000 7f966cbff700 1 Processor -- start 2023-07-27T14:33:32.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.191+0000 7f966cbff700 1 -- start start 2023-07-27T14:33:32.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.192+0000 7f966cbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814ae00 0x7f9668154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.192+0000 7f966cbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f966814b1e0 0x7f9668062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.192+0000 7f966cbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f96680c5c50 0x7f9668063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.192+0000 7f966cbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9668063530 con 0x7f96680c5c50 2023-07-27T14:33:32.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.192+0000 7f966cbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96681553f0 con 0x7f966814b1e0 2023-07-27T14:33:32.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.192+0000 7f966cbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9668157a50 con 0x7f966814ae00 2023-07-27T14:33:32.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f96680c5c50 0x7f9668063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f96680c5c50 0x7f9668063040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57354/0 (socket says 172.21.15.115:57354) 2023-07-27T14:33:32.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 -- 172.21.15.115:0/3357494338 learned_addr learned my addr 172.21.15.115:0/3357494338 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:32.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f966659c700 1 --2- 172.21.15.115:0/3357494338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814ae00 0x7f9668154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9665d9b700 1 --2- 172.21.15.115:0/3357494338 >> v2:172.21.15.159:3300/0 conn(0x7f966814b1e0 0x7f9668062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 -- 172.21.15.115:0/3357494338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814ae00 msgr2=0x7f9668154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:32.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 --2- 172.21.15.115:0/3357494338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814ae00 0x7f9668154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 -- 172.21.15.115:0/3357494338 >> v2:172.21.15.159:3300/0 conn(0x7f966814b1e0 msgr2=0x7f9668062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:32.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 --2- 172.21.15.115:0/3357494338 >> v2:172.21.15.159:3300/0 conn(0x7f966814b1e0 0x7f9668062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 -- 172.21.15.115:0/3357494338 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668157d10 con 0x7f96680c5c50 2023-07-27T14:33:32.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f9666d9d700 1 --2- 172.21.15.115:0/3357494338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96680c5c50 0x7f9668063040 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f96680cb6f0 tx=0x7f9660009840).ready entity=mon.0 client_cookie=3633dfb5367945dd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:32.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.193+0000 7f966559a700 1 -- 172.21.15.115:0/3357494338 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966000e070 con 0x7f96680c5c50 2023-07-27T14:33:32.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966559a700 1 -- 172.21.15.115:0/3357494338 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966000ba50 con 0x7f96680c5c50 2023-07-27T14:33:32.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966559a700 1 -- 172.21.15.115:0/3357494338 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966000bdd0 con 0x7f96680c5c50 2023-07-27T14:33:32.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 -- 172.21.15.115:0/3357494338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96680c5c50 msgr2=0x7f9668063040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 --2- 172.21.15.115:0/3357494338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96680c5c50 0x7f9668063040 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f96680cb6f0 tx=0x7f9660009840).stop 2023-07-27T14:33:32.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 -- 172.21.15.115:0/3357494338 shutdown_connections 2023-07-27T14:33:32.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 --2- 172.21.15.115:0/3357494338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96680c5c50 0x7f9668063040 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 --2- 172.21.15.115:0/3357494338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814ae00 0x7f9668154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 --2- 172.21.15.115:0/3357494338 >> v2:172.21.15.159:3300/0 conn(0x7f966814b1e0 0x7f9668062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 -- 172.21.15.115:0/3357494338 >> 172.21.15.115:0/3357494338 conn(0x7f966805e940 msgr2=0x7f96680cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:32.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 -- 172.21.15.115:0/3357494338 shutdown_connections 2023-07-27T14:33:32.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.194+0000 7f966cbff700 1 -- 172.21.15.115:0/3357494338 wait complete. 2023-07-27T14:33:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.196+0000 7f966cbff700 1 Processor -- start 2023-07-27T14:33:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.196+0000 7f966cbff700 1 -- start start 2023-07-27T14:33:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f966cbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96680c5c50 0x7f96681390d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f966cbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f966814ae00 0x7f96680c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f966cbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814b1e0 0x7f96680c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f966cbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96680c4cb0 con 0x7f966814ae00 2023-07-27T14:33:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f966cbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96680c2810 con 0x7f96680c5c50 2023-07-27T14:33:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f966cbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680ae490 con 0x7f966814b1e0 2023-07-27T14:33:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f966814ae00 0x7f96680c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f966814ae00 0x7f96680c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57368/0 (socket says 172.21.15.115:57368) 2023-07-27T14:33:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 -- 172.21.15.115:0/2024657551 learned_addr learned my addr 172.21.15.115:0/2024657551 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f966659c700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96680c5c50 0x7f96681390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9666d9d700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814b1e0 0x7f96680c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 -- 172.21.15.115:0/2024657551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814b1e0 msgr2=0x7f96680c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814b1e0 0x7f96680c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 -- 172.21.15.115:0/2024657551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96680c5c50 msgr2=0x7f96681390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96680c5c50 0x7f96681390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 -- 172.21.15.115:0/2024657551 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660009ae0 con 0x7f966814ae00 2023-07-27T14:33:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.197+0000 7f9665d9b700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f966814ae00 0x7f96680c47c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f965c00d5e0 tx=0x7f965c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.198+0000 7f96567fc700 1 -- 172.21.15.115:0/2024657551 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c011590 con 0x7f966814ae00 2023-07-27T14:33:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.198+0000 7f96567fc700 1 -- 172.21.15.115:0/2024657551 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c0116f0 con 0x7f966814ae00 2023-07-27T14:33:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.198+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96680c4e90 con 0x7f966814ae00 2023-07-27T14:33:32.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.198+0000 7f96567fc700 1 -- 172.21.15.115:0/2024657551 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c011a70 con 0x7f966814ae00 2023-07-27T14:33:32.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.198+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96680ade40 con 0x7f966814ae00 2023-07-27T14:33:32.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.199+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96680ae640 con 0x7f966814ae00 2023-07-27T14:33:32.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.200+0000 7f96567fc700 1 -- 172.21.15.115:0/2024657551 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f965c012420 con 0x7f966814ae00 2023-07-27T14:33:32.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.200+0000 7f96567fc700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f964805f580 0x7f9648061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.201+0000 7f96567fc700 1 -- 172.21.15.115:0/2024657551 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f965c079f50 con 0x7f966814ae00 2023-07-27T14:33:32.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.201+0000 7f966659c700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f964805f580 0x7f9648061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.201+0000 7f966659c700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f964805f580 0x7f9648061a40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f965800bb20 tx=0x7f9658008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:32.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.205+0000 7f96567fc700 1 -- 172.21.15.115:0/2024657551 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f965c04afc0 con 0x7f966814ae00 2023-07-27T14:33:32.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.373+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f966806c470 con 0x7f966814ae00 2023-07-27T14:33:32.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.374+0000 7f96567fc700 1 -- 172.21.15.115:0/2024657551 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v122) v1 ==== 110+0+10 (secure 0 0 0) 0x7f965c04e5e0 con 0x7f966814ae00 2023-07-27T14:33:32.413 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:33:32.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f964805f580 msgr2=0x7f9648061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f964805f580 0x7f9648061a40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f965800bb20 tx=0x7f9658008040).stop 2023-07-27T14:33:32.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f966814ae00 msgr2=0x7f96680c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f966814ae00 0x7f96680c47c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f965c00d5e0 tx=0x7f965c008040).stop 2023-07-27T14:33:32.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 shutdown_connections 2023-07-27T14:33:32.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f964805f580 0x7f9648061a40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f966814b1e0 0x7f96680c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96680c5c50 0x7f96681390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 --2- 172.21.15.115:0/2024657551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f966814ae00 0x7f96680c47c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 >> 172.21.15.115:0/2024657551 conn(0x7f966805e940 msgr2=0x7f96680c03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:32.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 shutdown_connections 2023-07-27T14:33:32.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.376+0000 7f966cbff700 1 -- 172.21.15.115:0/2024657551 wait complete. 2023-07-27T14:33:32.433 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:33:32.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.584+0000 7f2e7cfff700 1 Processor -- start 2023-07-27T14:33:32.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.584+0000 7f2e7cfff700 1 -- start start 2023-07-27T14:33:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.585+0000 7f2e7cfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2e7814ae00 0x7f2e78154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.585+0000 7f2e7cfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e781553f0 con 0x7f2e7814b1e0 2023-07-27T14:33:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.585+0000 7f2e7cfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e78157a50 con 0x7f2e78063260 2023-07-27T14:33:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.585+0000 7f2e7cfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e78157d10 con 0x7f2e7814ae00 2023-07-27T14:33:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e75d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2e7814b1e0 0x7f2e78062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49566/0 (socket says 172.21.15.115:49566) 2023-07-27T14:33:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e75d9b700 1 -- 172.21.15.115:0/1359969003 learned_addr learned my addr 172.21.15.115:0/1359969003 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:32.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1359969003 >> v2:172.21.15.159:3300/0 conn(0x7f2e7814ae00 0x7f2e78154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166570617 0 0) 0x7f2e781553f0 con 0x7f2e7814b1e0 2023-07-27T14:33:32.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e600033f0 con 0x7f2e7814b1e0 2023-07-27T14:33:32.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710251486 0 0) 0x7f2e600033f0 con 0x7f2e7814b1e0 2023-07-27T14:33:32.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 >> v2:172.21.15.159:3300/0 conn(0x7f2e7814ae00 msgr2=0x7f2e78154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:32.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 --2- 172.21.15.115:0/1359969003 >> v2:172.21.15.159:3300/0 conn(0x7f2e7814ae00 0x7f2e78154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 >> v1:172.21.15.159:6789/0 conn(0x7f2e78063260 legacy=0x7f2e780a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e78157ff0 con 0x7f2e7814b1e0 2023-07-27T14:33:32.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f2e6c001470 con 0x7f2e7814b1e0 2023-07-27T14:33:32.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 >> v1:172.21.15.115:6789/0 conn(0x7f2e7814b1e0 legacy=0x7f2e78062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e600038e0 0x7f2e60003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e60004690 0x7f2e60004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e60005000 0x7f2e6000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e78157d10 con 0x7f2e600038e0 2023-07-27T14:33:32.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6000bf60 con 0x7f2e60005000 2023-07-27T14:33:32.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.586+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6000c0f0 con 0x7f2e60004690 2023-07-27T14:33:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e600038e0 0x7f2e60003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e75d9b700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e60004690 0x7f2e60004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e76d9d700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e60005000 0x7f2e6000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7659c700 1 -- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e60004690 msgr2=0x7f2e60004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e60004690 0x7f2e60004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7659c700 1 -- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e60005000 msgr2=0x7f2e6000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:32.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e60005000 0x7f2e6000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7659c700 1 -- 172.21.15.115:0/1359969003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600033f0 con 0x7f2e600038e0 2023-07-27T14:33:32.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e76d9d700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e60005000 0x7f2e6000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:32.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e76d9d700 1 -- 172.21.15.115:0/1359969003 reap_dead start 2023-07-27T14:33:32.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e600038e0 0x7f2e60003d00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f2e68009a80 tx=0x7f2e68009060).ready entity=mon.0 client_cookie=64d7092bafdb98c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:32.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68009430 con 0x7f2e600038e0 2023-07-27T14:33:32.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800e640 con 0x7f2e600038e0 2023-07-27T14:33:32.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.587+0000 7f2e7559a700 1 -- 172.21.15.115:0/1359969003 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800e9c0 con 0x7f2e600038e0 2023-07-27T14:33:32.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.588+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1359969003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e600038e0 msgr2=0x7f2e60003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.588+0000 7f2e7cfff700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e600038e0 0x7f2e60003d00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f2e68009a80 tx=0x7f2e68009060).stop 2023-07-27T14:33:32.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.588+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1359969003 shutdown_connections 2023-07-27T14:33:32.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.588+0000 7f2e7cfff700 1 --2- 172.21.15.115:0/1359969003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e600038e0 0x7f2e60003d00 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.588+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1359969003 >> 172.21.15.115:0/1359969003 conn(0x7f2e7805e940 msgr2=0x7f2e780cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:32.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.588+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1359969003 shutdown_connections 2023-07-27T14:33:32.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.588+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1359969003 wait complete. 2023-07-27T14:33:32.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.590+0000 7f2e7cfff700 1 Processor -- start 2023-07-27T14:33:32.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.590+0000 7f2e7cfff700 1 -- start start 2023-07-27T14:33:32.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e7cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e600038e0 0x7f2e7814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e7cfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e780b0760 0x7f2e78164db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e7cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e78150710 0x7f2e78150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e7cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781502f0 con 0x7f2e78150710 2023-07-27T14:33:32.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e7cfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7814fd00 con 0x7f2e780b0760 2023-07-27T14:33:32.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e7cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781513c0 con 0x7f2e600038e0 2023-07-27T14:33:32.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e78150710 0x7f2e78150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e78150710 0x7f2e78150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57382/0 (socket says 172.21.15.115:57382) 2023-07-27T14:33:32.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 -- 172.21.15.115:0/1904013149 learned_addr learned my addr 172.21.15.115:0/1904013149 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:32.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 -- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e600038e0 msgr2=0x7f2e7814a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e600038e0 0x7f2e7814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e75d9b700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e780b0760 0x7f2e78164db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e600038e0 0x7f2e7814a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 -- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e780b0760 msgr2=0x7f2e78164db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e780b0760 0x7f2e78164db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 -- 172.21.15.115:0/1904013149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e781652a0 con 0x7f2e78150710 2023-07-27T14:33:32.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e600038e0 0x7f2e7814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:32.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e75d9b700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e780b0760 0x7f2e78164db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:32.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e76d9d700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e78150710 0x7f2e78150b70 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f2e780cb870 tx=0x7f2e70009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:32.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.591+0000 7f2e667fc700 1 -- 172.21.15.115:0/1904013149 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70002490 con 0x7f2e78150710 2023-07-27T14:33:32.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.592+0000 7f2e667fc700 1 -- 172.21.15.115:0/1904013149 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e700025f0 con 0x7f2e78150710 2023-07-27T14:33:32.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.592+0000 7f2e667fc700 1 -- 172.21.15.115:0/1904013149 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70002970 con 0x7f2e78150710 2023-07-27T14:33:32.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.592+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e78151610 con 0x7f2e78150710 2023-07-27T14:33:32.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.592+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7814ff10 con 0x7f2e78150710 2023-07-27T14:33:32.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.593+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e78150430 con 0x7f2e78150710 2023-07-27T14:33:32.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.593+0000 7f2e667fc700 1 -- 172.21.15.115:0/1904013149 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f2e70002d20 con 0x7f2e78150710 2023-07-27T14:33:32.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.595+0000 7f2e667fc700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e5805f580 0x7f2e58061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:32.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.595+0000 7f2e667fc700 1 -- 172.21.15.115:0/1904013149 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2e7007a1d0 con 0x7f2e78150710 2023-07-27T14:33:32.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.595+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e5805f580 0x7f2e58061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:32.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.595+0000 7f2e7659c700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e5805f580 0x7f2e58061a40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f2e68006d50 tx=0x7f2e6801a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:32.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.599+0000 7f2e667fc700 1 -- 172.21.15.115:0/1904013149 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e700498f0 con 0x7f2e78150710 2023-07-27T14:33:32.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.771+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e78151ab0 con 0x7f2e78150710 2023-07-27T14:33:32.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.771+0000 7f2e667fc700 1 -- 172.21.15.115:0/1904013149 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e78150430 con 0x7f2e78150710 2023-07-27T14:33:32.811 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:33:32.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e5805f580 msgr2=0x7f2e58061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e5805f580 0x7f2e58061a40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f2e68006d50 tx=0x7f2e6801a000).stop 2023-07-27T14:33:32.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e78150710 msgr2=0x7f2e78150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e78150710 0x7f2e78150b70 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f2e780cb870 tx=0x7f2e70009040).stop 2023-07-27T14:33:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 shutdown_connections 2023-07-27T14:33:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e5805f580 0x7f2e58061a40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e78150710 0x7f2e78150b70 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e600038e0 0x7f2e7814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.773+0000 7f2e7cfff700 1 --2- 172.21.15.115:0/1904013149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e780b0760 0x7f2e78164db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.774+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 >> 172.21.15.115:0/1904013149 conn(0x7f2e7805e940 msgr2=0x7f2e780ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:32.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.774+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 shutdown_connections 2023-07-27T14:33:32.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.774+0000 7f2e7cfff700 1 -- 172.21.15.115:0/1904013149 wait complete. 2023-07-27T14:33:32.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:33:33.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.979+0000 7fd7751ff700 1 Processor -- start 2023-07-27T14:33:33.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.979+0000 7fd7751ff700 1 -- start start 2023-07-27T14:33:33.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.980+0000 7fd7751ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd770154060 0x7fd7700bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.980+0000 7fd7751ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7700a5390 0x7fd7700bc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.980+0000 7fd7751ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7700c2ed0 con 0x7fd770154440 2023-07-27T14:33:33.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.980+0000 7fd7751ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7700bc720 con 0x7fd770154060 2023-07-27T14:33:33.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.980+0000 7fd7751ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700a58d0 con 0x7fd7700a5390 2023-07-27T14:33:33.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76e59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd770154440 0x7fd7700a4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49570/0 (socket says 172.21.15.115:49570) 2023-07-27T14:33:33.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76e59c700 1 -- 172.21.15.115:0/61543536 learned_addr learned my addr 172.21.15.115:0/61543536 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:33.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748064058 0 0) 0x7fd7700c2ed0 con 0x7fd770154440 2023-07-27T14:33:33.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76f59e700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7700a5390 0x7fd7700bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76ed9d700 1 --2- 172.21.15.115:0/61543536 >> v2:172.21.15.159:3300/0 conn(0x7fd770154060 0x7fd7700bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7580033f0 con 0x7fd770154440 2023-07-27T14:33:33.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979255654 0 0) 0x7fd7580033f0 con 0x7fd770154440 2023-07-27T14:33:33.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7700a5390 msgr2=0x7fd7700bc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:33.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7700a5390 0x7fd7700bc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 >> v2:172.21.15.159:3300/0 conn(0x7fd770154060 msgr2=0x7fd7700bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:33.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 --2- 172.21.15.115:0/61543536 >> v2:172.21.15.159:3300/0 conn(0x7fd770154060 0x7fd7700bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7700a5bb0 con 0x7fd770154440 2023-07-27T14:33:33.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fd764001470 con 0x7fd770154440 2023-07-27T14:33:33.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 >> v1:172.21.15.115:6789/0 conn(0x7fd770154440 legacy=0x7fd7700a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580038e0 0x7fd758003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd758004690 0x7fd758004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7700a5390 0x7fd758005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700bc720 con 0x7fd758004690 2023-07-27T14:33:33.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700a58d0 con 0x7fd7580038e0 2023-07-27T14:33:33.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.981+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800b8e0 con 0x7fd7700a5390 2023-07-27T14:33:33.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76e59c700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd758004690 0x7fd758004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76ed9d700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580038e0 0x7fd758003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76f59e700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7700a5390 0x7fd758005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76e59c700 1 -- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7700a5390 msgr2=0x7fd758005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:33.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76e59c700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7700a5390 0x7fd758005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76e59c700 1 -- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580038e0 msgr2=0x7fd758003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:33.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76e59c700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7580038e0 0x7fd758003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76e59c700 1 -- 172.21.15.115:0/61543536 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580033f0 con 0x7fd758004690 2023-07-27T14:33:33.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76e59c700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd758004690 0x7fd758004b10 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7fd76400c210 tx=0x7fd7700c2e40).ready entity=mon.0 client_cookie=8f8596f158dd9512 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764007a60 con 0x7fd758004690 2023-07-27T14:33:33.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76400cae0 con 0x7fd758004690 2023-07-27T14:33:33.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.982+0000 7fd76dd9b700 1 -- 172.21.15.115:0/61543536 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400ce60 con 0x7fd758004690 2023-07-27T14:33:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.983+0000 7fd7751ff700 1 -- 172.21.15.115:0/61543536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd758004690 msgr2=0x7fd758004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.983+0000 7fd7751ff700 1 --2- 172.21.15.115:0/61543536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd758004690 0x7fd758004b10 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7fd76400c210 tx=0x7fd7700c2e40).stop 2023-07-27T14:33:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.983+0000 7fd76f59e700 1 -- 172.21.15.115:0/61543536 reap_dead start 2023-07-27T14:33:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.983+0000 7fd7751ff700 1 -- 172.21.15.115:0/61543536 shutdown_connections 2023-07-27T14:33:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.983+0000 7fd7751ff700 1 -- 172.21.15.115:0/61543536 >> 172.21.15.115:0/61543536 conn(0x7fd770062320 msgr2=0x7fd770062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.983+0000 7fd7751ff700 1 -- 172.21.15.115:0/61543536 shutdown_connections 2023-07-27T14:33:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.983+0000 7fd7751ff700 1 -- 172.21.15.115:0/61543536 wait complete. 2023-07-27T14:33:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.984+0000 7fd7751ff700 1 Processor -- start 2023-07-27T14:33:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.985+0000 7fd7751ff700 1 -- start start 2023-07-27T14:33:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.985+0000 7fd7751ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd758004690 0x7fd7700be860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.985+0000 7fd7751ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd770158fb0 0x7fd7700c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.985+0000 7fd7751ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd770147eb0 0x7fd7700c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.985+0000 7fd7751ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd770159c70 con 0x7fd770147eb0 2023-07-27T14:33:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.985+0000 7fd7751ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700bed50 con 0x7fd770158fb0 2023-07-27T14:33:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.985+0000 7fd7751ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700695e0 con 0x7fd758004690 2023-07-27T14:33:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd770147eb0 0x7fd7700c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd770147eb0 0x7fd7700c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57408/0 (socket says 172.21.15.115:57408) 2023-07-27T14:33:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 -- 172.21.15.115:0/3945122853 learned_addr learned my addr 172.21.15.115:0/3945122853 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76ed9d700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd758004690 0x7fd7700be860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76e59c700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd770158fb0 0x7fd7700c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 -- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd758004690 msgr2=0x7fd7700be860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd758004690 0x7fd7700be860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 -- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd770158fb0 msgr2=0x7fd7700c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd770158fb0 0x7fd7700c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 -- 172.21.15.115:0/3945122853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7700c6a00 con 0x7fd770147eb0 2023-07-27T14:33:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76e59c700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd770158fb0 0x7fd7700c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.986+0000 7fd76f59e700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd770147eb0 0x7fd7700c48e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fd7680094d0 tx=0x7fd76800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.987+0000 7fd756ffd700 1 -- 172.21.15.115:0/3945122853 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800e040 con 0x7fd770147eb0 2023-07-27T14:33:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.987+0000 7fd756ffd700 1 -- 172.21.15.115:0/3945122853 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76800f040 con 0x7fd770147eb0 2023-07-27T14:33:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.987+0000 7fd756ffd700 1 -- 172.21.15.115:0/3945122853 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800fe50 con 0x7fd770147eb0 2023-07-27T14:33:33.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.987+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7700c6c80 con 0x7fd770147eb0 2023-07-27T14:33:33.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.987+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd770069270 con 0x7fd770147eb0 2023-07-27T14:33:33.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.988+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd770069770 con 0x7fd770147eb0 2023-07-27T14:33:33.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.989+0000 7fd756ffd700 1 -- 172.21.15.115:0/3945122853 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fd768015660 con 0x7fd770147eb0 2023-07-27T14:33:33.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.989+0000 7fd756ffd700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd75c05f5b0 0x7fd75c061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.989+0000 7fd756ffd700 1 -- 172.21.15.115:0/3945122853 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd76807aff0 con 0x7fd770147eb0 2023-07-27T14:33:33.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.990+0000 7fd76ed9d700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd75c05f5b0 0x7fd75c061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.990+0000 7fd76ed9d700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd75c05f5b0 0x7fd75c061a70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fd760006d80 tx=0x7fd760009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:32.993+0000 7fd756ffd700 1 -- 172.21.15.115:0/3945122853 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7680a98f0 con 0x7fd770147eb0 2023-07-27T14:33:33.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.163+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd77006c470 con 0x7fd770147eb0 2023-07-27T14:33:33.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.163+0000 7fd756ffd700 1 -- 172.21.15.115:0/3945122853 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v122) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd76804fa20 con 0x7fd770147eb0 2023-07-27T14:33:33.204 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:33.204 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:33:33.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:33.205 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:33:33.205 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:33:33.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:33:33.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:33.206 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:33:33.206 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:33:33.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:33.207 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:33:33.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.165+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd75c05f5b0 msgr2=0x7fd75c061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.165+0000 7fd7751ff700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd75c05f5b0 0x7fd75c061a70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fd760006d80 tx=0x7fd760009060).stop 2023-07-27T14:33:33.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.165+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd770147eb0 msgr2=0x7fd7700c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.165+0000 7fd7751ff700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd770147eb0 0x7fd7700c48e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fd7680094d0 tx=0x7fd76800b040).stop 2023-07-27T14:33:33.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.166+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 shutdown_connections 2023-07-27T14:33:33.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.166+0000 7fd7751ff700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd75c05f5b0 0x7fd75c061a70 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.166+0000 7fd7751ff700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd770147eb0 0x7fd7700c48e0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.166+0000 7fd7751ff700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd758004690 0x7fd7700be860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.166+0000 7fd7751ff700 1 --2- 172.21.15.115:0/3945122853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd770158fb0 0x7fd7700c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.166+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 >> 172.21.15.115:0/3945122853 conn(0x7fd770062320 msgr2=0x7fd770149e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:33.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.166+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 shutdown_connections 2023-07-27T14:33:33.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.166+0000 7fd7751ff700 1 -- 172.21.15.115:0/3945122853 wait complete. 2023-07-27T14:33:33.222 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:33:33.223 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:33:33.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.377+0000 7f003e1ff700 1 Processor -- start 2023-07-27T14:33:33.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.377+0000 7f003e1ff700 1 -- start start 2023-07-27T14:33:33.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.378+0000 7f003e1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 0x7f003814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.378+0000 7f003e1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f00380a5850 0x7f00380a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.378+0000 7f003e1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00380c31e0 0x7f00380c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.378+0000 7f003e1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0038069f70 con 0x7f00380c31e0 2023-07-27T14:33:33.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.378+0000 7f003e1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00381530d0 con 0x7f00380a5850 2023-07-27T14:33:33.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.378+0000 7f003e1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380a61c0 con 0x7f003814f740 2023-07-27T14:33:33.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.378+0000 7f0037fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00380c31e0 0x7f00380c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0037fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00380c31e0 0x7f00380c3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57418/0 (socket says 172.21.15.115:57418) 2023-07-27T14:33:33.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0037fff700 1 -- 172.21.15.115:0/1825526408 learned_addr learned my addr 172.21.15.115:0/1825526408 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:33.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f00377fe700 1 --2- 172.21.15.115:0/1825526408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 0x7f003814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0036ffd700 1 --2- 172.21.15.115:0/1825526408 >> v2:172.21.15.159:3300/0 conn(0x7f00380a5850 0x7f00380a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0037fff700 1 -- 172.21.15.115:0/1825526408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 msgr2=0x7f003814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:33.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0037fff700 1 --2- 172.21.15.115:0/1825526408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 0x7f003814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0037fff700 1 -- 172.21.15.115:0/1825526408 >> v2:172.21.15.159:3300/0 conn(0x7f00380a5850 msgr2=0x7f00380a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:33.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0037fff700 1 --2- 172.21.15.115:0/1825526408 >> v2:172.21.15.159:3300/0 conn(0x7f00380a5850 0x7f00380a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0037fff700 1 -- 172.21.15.115:0/1825526408 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380c3b80 con 0x7f00380c31e0 2023-07-27T14:33:33.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0036ffd700 1 --2- 172.21.15.115:0/1825526408 >> v2:172.21.15.159:3300/0 conn(0x7f00380a5850 0x7f00380a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:33.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f0037fff700 1 --2- 172.21.15.115:0/1825526408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380c3690 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f0030009f20 tx=0x7f0030009840).ready entity=mon.0 client_cookie=ff210dd229a48e2f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f00367fc700 1 -- 172.21.15.115:0/1825526408 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000e070 con 0x7f00380c31e0 2023-07-27T14:33:33.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f00367fc700 1 -- 172.21.15.115:0/1825526408 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003000ba40 con 0x7f00380c31e0 2023-07-27T14:33:33.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.379+0000 7f00367fc700 1 -- 172.21.15.115:0/1825526408 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000bdc0 con 0x7f00380c31e0 2023-07-27T14:33:33.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 -- 172.21.15.115:0/1825526408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 msgr2=0x7f00380c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 --2- 172.21.15.115:0/1825526408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380c3690 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f0030009f20 tx=0x7f0030009840).stop 2023-07-27T14:33:33.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 -- 172.21.15.115:0/1825526408 shutdown_connections 2023-07-27T14:33:33.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 --2- 172.21.15.115:0/1825526408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380c3690 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 --2- 172.21.15.115:0/1825526408 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 0x7f003814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 --2- 172.21.15.115:0/1825526408 >> v2:172.21.15.159:3300/0 conn(0x7f00380a5850 0x7f00380a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 -- 172.21.15.115:0/1825526408 >> 172.21.15.115:0/1825526408 conn(0x7f0038062320 msgr2=0x7f0038062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:33.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 -- 172.21.15.115:0/1825526408 shutdown_connections 2023-07-27T14:33:33.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.380+0000 7f003e1ff700 1 -- 172.21.15.115:0/1825526408 wait complete. 2023-07-27T14:33:33.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.381+0000 7f003e1ff700 1 Processor -- start 2023-07-27T14:33:33.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.382+0000 7f003e1ff700 1 -- start start 2023-07-27T14:33:33.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.382+0000 7f003e1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00380a5850 0x7f00380c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.382+0000 7f003e1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f003e1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 0x7f0038164f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f003e1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0038164af0 con 0x7f00380c31e0 2023-07-27T14:33:33.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f003e1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380a89c0 con 0x7f00380a5850 2023-07-27T14:33:33.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f003e1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0038168490 con 0x7f003814f740 2023-07-27T14:33:33.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57432/0 (socket says 172.21.15.115:57432) 2023-07-27T14:33:33.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 -- 172.21.15.115:0/2440246798 learned_addr learned my addr 172.21.15.115:0/2440246798 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:33.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 -- 172.21.15.115:0/2440246798 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 msgr2=0x7f0038164f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 0x7f0038164f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:33.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f00377fe700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00380a5850 0x7f00380c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 -- 172.21.15.115:0/2440246798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00380a5850 msgr2=0x7f00380c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00380a5850 0x7f00380c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 -- 172.21.15.115:0/2440246798 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0030009ae0 con 0x7f00380c31e0 2023-07-27T14:33:33.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.383+0000 7f0036ffd700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380a84d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f002c00c880 tx=0x7f002c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.384+0000 7f001f7fe700 1 -- 172.21.15.115:0/2440246798 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c010580 con 0x7f00380c31e0 2023-07-27T14:33:33.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.384+0000 7f001f7fe700 1 -- 172.21.15.115:0/2440246798 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c0106e0 con 0x7f00380c31e0 2023-07-27T14:33:33.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.384+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0038168770 con 0x7f00380c31e0 2023-07-27T14:33:33.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.384+0000 7f001f7fe700 1 -- 172.21.15.115:0/2440246798 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c010a60 con 0x7f00380c31e0 2023-07-27T14:33:33.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.384+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0038164780 con 0x7f00380c31e0 2023-07-27T14:33:33.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.385+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0038164ca0 con 0x7f00380c31e0 2023-07-27T14:33:33.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.386+0000 7f001f7fe700 1 -- 172.21.15.115:0/2440246798 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f002c01b460 con 0x7f00380c31e0 2023-07-27T14:33:33.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.386+0000 7f001f7fe700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002405f5b0 0x7f0024061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.386+0000 7f001f7fe700 1 -- 172.21.15.115:0/2440246798 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f002c07a680 con 0x7f00380c31e0 2023-07-27T14:33:33.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.387+0000 7f00377fe700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002405f5b0 0x7f0024061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.387+0000 7f00377fe700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002405f5b0 0x7f0024061a70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f0028006fd0 tx=0x7f0028008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.390+0000 7f001f7fe700 1 -- 172.21.15.115:0/2440246798 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0038164ca0 con 0x7f00380c31e0 2023-07-27T14:33:33.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.561+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f0038164c30 con 0x7f00380c31e0 2023-07-27T14:33:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.691+0000 7f001f7fe700 1 -- 172.21.15.115:0/2440246798 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v123) v1 ==== 152+0+0 (secure 0 0 0) 0x7f002c07a070 con 0x7f00380c31e0 2023-07-27T14:33:33.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.695+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002405f5b0 msgr2=0x7f0024061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.695+0000 7f003e1ff700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002405f5b0 0x7f0024061a70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f0028006fd0 tx=0x7f0028008040).stop 2023-07-27T14:33:33.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.695+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 msgr2=0x7f00380a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.695+0000 7f003e1ff700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380a84d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f002c00c880 tx=0x7f002c008040).stop 2023-07-27T14:33:33.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.700+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 shutdown_connections 2023-07-27T14:33:33.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.700+0000 7f003e1ff700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002405f5b0 0x7f0024061a70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.700+0000 7f003e1ff700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f003814f740 0x7f0038164f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:33.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.700+0000 7f003e1ff700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00380a5850 0x7f00380c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.700+0000 7f003e1ff700 1 --2- 172.21.15.115:0/2440246798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00380c31e0 0x7f00380a84d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.700+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 >> 172.21.15.115:0/2440246798 conn(0x7f0038062320 msgr2=0x7f003814de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:33.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.701+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 shutdown_connections 2023-07-27T14:33:33.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.701+0000 7f003e1ff700 1 -- 172.21.15.115:0/2440246798 wait complete. 2023-07-27T14:33:33.742 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:33:33.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:33:33.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.913+0000 7f764e7ff700 1 Processor -- start 2023-07-27T14:33:33.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.914+0000 7f764e7ff700 1 -- start start 2023-07-27T14:33:33.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.915+0000 7f764e7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f7648064240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.915+0000 7f764e7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76480c1350 con 0x7f76481540e0 2023-07-27T14:33:33.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.915+0000 7f764e7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7648158a50 con 0x7f7648064730 2023-07-27T14:33:33.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.915+0000 7f764e7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480bc8f0 con 0x7f7648153d00 2023-07-27T14:33:33.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.915+0000 7f764cd9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f76481540e0 0x7f76480a5b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56718/0 (socket says 172.21.15.115:56718) 2023-07-27T14:33:33.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.915+0000 7f764cd9c700 1 -- 172.21.15.115:0/3141611499 learned_addr learned my addr 172.21.15.115:0/3141611499 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:33.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7647fff700 1 --2- 172.21.15.115:0/3141611499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f7648064240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7646ffd700 1 -- 172.21.15.115:0/3141611499 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137745423 0 0) 0x7f76480c1350 con 0x7f76481540e0 2023-07-27T14:33:33.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7646ffd700 1 -- 172.21.15.115:0/3141611499 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76300033f0 con 0x7f76481540e0 2023-07-27T14:33:33.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7646ffd700 1 -- 172.21.15.115:0/3141611499 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141216918 0 0) 0x7f7648158a50 con 0x7f7648064730 2023-07-27T14:33:33.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7646ffd700 1 -- 172.21.15.115:0/3141611499 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76480c1350 con 0x7f7648064730 2023-07-27T14:33:33.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7647fff700 1 -- 172.21.15.115:0/3141611499 >> v1:172.21.15.159:6789/0 conn(0x7f7648064730 legacy=0x7f76480bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7647fff700 1 -- 172.21.15.115:0/3141611499 >> v1:172.21.15.115:6789/0 conn(0x7f76481540e0 legacy=0x7f76480a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7646ffd700 1 -- 172.21.15.115:0/3141611499 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 799403097 0 0) 0x7f76300033f0 con 0x7f76481540e0 2023-07-27T14:33:33.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7647fff700 1 -- 172.21.15.115:0/3141611499 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480c1580 con 0x7f7648153d00 2023-07-27T14:33:33.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.916+0000 7f7647fff700 1 --2- 172.21.15.115:0/3141611499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f7648064240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f76380097c0 tx=0x7f7638009060).ready entity=mon.2 client_cookie=95dbde2e54426a34 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f7646ffd700 1 -- 172.21.15.115:0/3141611499 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400017f0 con 0x7f7648153d00 2023-07-27T14:33:33.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f7646ffd700 1 -- 172.21.15.115:0/3141611499 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7638011400 con 0x7f7648153d00 2023-07-27T14:33:33.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f7646ffd700 1 -- 172.21.15.115:0/3141611499 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638011780 con 0x7f7648153d00 2023-07-27T14:33:33.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f764e7ff700 1 -- 172.21.15.115:0/3141611499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 msgr2=0x7f7648064240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f764e7ff700 1 --2- 172.21.15.115:0/3141611499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f7648064240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f76380097c0 tx=0x7f7638009060).stop 2023-07-27T14:33:33.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f764e7ff700 1 -- 172.21.15.115:0/3141611499 shutdown_connections 2023-07-27T14:33:33.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f764e7ff700 1 --2- 172.21.15.115:0/3141611499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f7648064240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f764e7ff700 1 -- 172.21.15.115:0/3141611499 >> 172.21.15.115:0/3141611499 conn(0x7f7648062da0 msgr2=0x7f76480c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:33.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f764e7ff700 1 -- 172.21.15.115:0/3141611499 shutdown_connections 2023-07-27T14:33:33.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.917+0000 7f764e7ff700 1 -- 172.21.15.115:0/3141611499 wait complete. 2023-07-27T14:33:33.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.919+0000 7f764e7ff700 1 Processor -- start 2023-07-27T14:33:33.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.919+0000 7f764e7ff700 1 -- start start 2023-07-27T14:33:33.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f764e7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7648064730 0x7f7648164520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f764e7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f76480be910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f764e7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76481540e0 0x7f76480aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f764e7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764814d290 con 0x7f7648064730 2023-07-27T14:33:33.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f764e7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480bfb20 con 0x7f76481540e0 2023-07-27T14:33:33.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f764e7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480bf820 con 0x7f7648153d00 2023-07-27T14:33:33.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f7647fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7648064730 0x7f7648164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f7647fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7648064730 0x7f7648164520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48650/0 (socket says 172.21.15.115:48650) 2023-07-27T14:33:33.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f7647fff700 1 -- 172.21.15.115:0/3536262059 learned_addr learned my addr 172.21.15.115:0/3536262059 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:33.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f764cd9c700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76481540e0 0x7f76480aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.920+0000 7f76477fe700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f76480be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f7647fff700 1 -- 172.21.15.115:0/3536262059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 msgr2=0x7f76480be910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f7647fff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f76480be910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f7647fff700 1 -- 172.21.15.115:0/3536262059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76481540e0 msgr2=0x7f76480aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:33.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f7647fff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76481540e0 0x7f76480aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:33.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f7647fff700 1 -- 172.21.15.115:0/3536262059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380092a0 con 0x7f7648064730 2023-07-27T14:33:33.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f7647fff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7648064730 0x7f7648164520 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f76380118a0 tx=0x7f7638016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f762ffff700 1 -- 172.21.15.115:0/3536262059 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380107c0 con 0x7f7648064730 2023-07-27T14:33:33.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f762ffff700 1 -- 172.21.15.115:0/3536262059 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7638010920 con 0x7f7648064730 2023-07-27T14:33:33.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76480bdf90 con 0x7f7648064730 2023-07-27T14:33:33.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f762ffff700 1 -- 172.21.15.115:0/3536262059 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638010cc0 con 0x7f7648064730 2023-07-27T14:33:33.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.921+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76480ab180 con 0x7f7648064730 2023-07-27T14:33:33.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.922+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764806c470 con 0x7f7648064730 2023-07-27T14:33:33.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.923+0000 7f762ffff700 1 -- 172.21.15.115:0/3536262059 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f763800f070 con 0x7f7648064730 2023-07-27T14:33:33.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.924+0000 7f762ffff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f763405f5b0 0x7f7634061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:33.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.924+0000 7f762ffff700 1 -- 172.21.15.115:0/3536262059 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f763807ba10 con 0x7f7648064730 2023-07-27T14:33:33.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.924+0000 7f76477fe700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f763405f5b0 0x7f7634061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:33.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.925+0000 7f76477fe700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f763405f5b0 0x7f7634061a70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f76480acd90 tx=0x7f763c007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:33.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:33.929+0000 7f762ffff700 1 -- 172.21.15.115:0/3536262059 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f763804c860 con 0x7f7648064730 2023-07-27T14:33:34.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.102+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f76480aac40 con 0x7f7648064730 2023-07-27T14:33:34.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.702+0000 7f762ffff700 1 -- 172.21.15.115:0/3536262059 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v124) v1 ==== 170+0+0 (secure 0 0 0) 0x7f763804fe80 con 0x7f7648064730 2023-07-27T14:33:34.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.709+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f763405f5b0 msgr2=0x7f7634061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:34.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.709+0000 7f764e7ff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f763405f5b0 0x7f7634061a70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f76480acd90 tx=0x7f763c007bd0).stop 2023-07-27T14:33:34.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.709+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7648064730 msgr2=0x7f7648164520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:34.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.709+0000 7f764e7ff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7648064730 0x7f7648164520 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f76380118a0 tx=0x7f7638016000).stop 2023-07-27T14:33:34.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.711+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 shutdown_connections 2023-07-27T14:33:34.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.711+0000 7f764e7ff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f763405f5b0 0x7f7634061a70 secure :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0x7f76480acd90 tx=0x7f763c007bd0).stop 2023-07-27T14:33:34.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.711+0000 7f764e7ff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76481540e0 0x7f76480aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.711+0000 7f764e7ff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7648064730 0x7f7648164520 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.711+0000 7f764e7ff700 1 --2- 172.21.15.115:0/3536262059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7648153d00 0x7f76480be910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.711+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 >> 172.21.15.115:0/3536262059 conn(0x7f7648062da0 msgr2=0x7f764814e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:34.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.714+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 shutdown_connections 2023-07-27T14:33:34.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.716+0000 7f764e7ff700 1 -- 172.21.15.115:0/3536262059 wait complete. 2023-07-27T14:33:34.770 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:33:34.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:33:34.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.938+0000 7f17dabff700 1 Processor -- start 2023-07-27T14:33:34.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.939+0000 7f17dabff700 1 -- start start 2023-07-27T14:33:34.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.940+0000 7f17dabff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f17d4063260 0x7f17d4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:34.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.940+0000 7f17dabff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d41553f0 con 0x7f17d414ae00 2023-07-27T14:33:34.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.940+0000 7f17dabff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d4157a50 con 0x7f17d414b1e0 2023-07-27T14:33:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.940+0000 7f17dabff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d4157d10 con 0x7f17d4063260 2023-07-27T14:33:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d899b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f17d414ae00 0x7f17d4062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56720/0 (socket says 172.21.15.115:56720) 2023-07-27T14:33:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d899b700 1 -- 172.21.15.115:0/3536939133 learned_addr learned my addr 172.21.15.115:0/3536939133 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:34.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034972645 0 0) 0x7f17d41553f0 con 0x7f17d414ae00 2023-07-27T14:33:34.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c40033f0 con 0x7f17d414ae00 2023-07-27T14:33:34.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d3fff700 1 --2- 172.21.15.115:0/3536939133 >> v2:172.21.15.159:3300/0 conn(0x7f17d4063260 0x7f17d4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:34.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3704526104 0 0) 0x7f17c40033f0 con 0x7f17d414ae00 2023-07-27T14:33:34.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 >> v2:172.21.15.159:3300/0 conn(0x7f17d4063260 msgr2=0x7f17d4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 --2- 172.21.15.115:0/3536939133 >> v2:172.21.15.159:3300/0 conn(0x7f17d4063260 0x7f17d4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 >> v1:172.21.15.159:6789/0 conn(0x7f17d414b1e0 legacy=0x7f17d40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4157ff0 con 0x7f17d414ae00 2023-07-27T14:33:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f17c8001470 con 0x7f17d414ae00 2023-07-27T14:33:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.941+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 >> v1:172.21.15.115:6789/0 conn(0x7f17d414ae00 legacy=0x7f17d4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d37fe700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c40038e0 0x7f17c4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d37fe700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17c4004690 0x7f17c4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:34.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d37fe700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4005050 0x7f17c400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4157d10 con 0x7f17c40038e0 2023-07-27T14:33:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c400bfe0 con 0x7f17c4005050 2023-07-27T14:33:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c400c1a0 con 0x7f17c4004690 2023-07-27T14:33:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d899b700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c40038e0 0x7f17c4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d919c700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4005050 0x7f17c400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d3fff700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17c4004690 0x7f17c4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:34.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d899b700 1 -- 172.21.15.115:0/3536939133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17c4004690 msgr2=0x7f17c4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d899b700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17c4004690 0x7f17c4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d899b700 1 -- 172.21.15.115:0/3536939133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4005050 msgr2=0x7f17c400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d899b700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4005050 0x7f17c400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d899b700 1 -- 172.21.15.115:0/3536939133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40033f0 con 0x7f17c40038e0 2023-07-27T14:33:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d919c700 1 -- 172.21.15.115:0/3536939133 reap_dead start 2023-07-27T14:33:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.942+0000 7f17d899b700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c40038e0 0x7f17c4003d00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f17c800c190 tx=0x7f17c8001e50).ready entity=mon.0 client_cookie=a4a0f4587392a124 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8007a20 con 0x7f17c40038e0 2023-07-27T14:33:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c800cac0 con 0x7f17c40038e0 2023-07-27T14:33:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17d37fe700 1 -- 172.21.15.115:0/3536939133 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c800ce60 con 0x7f17c40038e0 2023-07-27T14:33:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17dabff700 1 -- 172.21.15.115:0/3536939133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c40038e0 msgr2=0x7f17c4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:34.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17dabff700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c40038e0 0x7f17c4003d00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f17c800c190 tx=0x7f17c8001e50).stop 2023-07-27T14:33:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17dabff700 1 -- 172.21.15.115:0/3536939133 shutdown_connections 2023-07-27T14:33:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17dabff700 1 --2- 172.21.15.115:0/3536939133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c40038e0 0x7f17c4003d00 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17dabff700 1 -- 172.21.15.115:0/3536939133 >> 172.21.15.115:0/3536939133 conn(0x7f17d405e940 msgr2=0x7f17d40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17dabff700 1 -- 172.21.15.115:0/3536939133 shutdown_connections 2023-07-27T14:33:34.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.943+0000 7f17dabff700 1 -- 172.21.15.115:0/3536939133 wait complete. 2023-07-27T14:33:34.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.945+0000 7f17dabff700 1 Processor -- start 2023-07-27T14:33:34.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.945+0000 7f17dabff700 1 -- start start 2023-07-27T14:33:34.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17dabff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c40038e0 0x7f17d40c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:34.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17dabff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17d414d1f0 0x7f17d414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:34.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17dabff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d40c9c90 0x7f17d40ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:34.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17dabff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c4a80 con 0x7f17d40c9c90 2023-07-27T14:33:34.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17dabff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4165250 con 0x7f17c40038e0 2023-07-27T14:33:34.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17dabff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40ca600 con 0x7f17d414d1f0 2023-07-27T14:33:34.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d919c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d40c9c90 0x7f17d40ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:34.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d919c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d40c9c90 0x7f17d40ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48678/0 (socket says 172.21.15.115:48678) 2023-07-27T14:33:34.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d919c700 1 -- 172.21.15.115:0/1853338385 learned_addr learned my addr 172.21.15.115:0/1853338385 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:34.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d899b700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c40038e0 0x7f17d40c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:34.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d3fff700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17d414d1f0 0x7f17d414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:34.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d919c700 1 -- 172.21.15.115:0/1853338385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17d414d1f0 msgr2=0x7f17d414d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:34.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d919c700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17d414d1f0 0x7f17d414d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d919c700 1 -- 172.21.15.115:0/1853338385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c40038e0 msgr2=0x7f17d40c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:34.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.946+0000 7f17d919c700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c40038e0 0x7f17d40c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:34.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.947+0000 7f17d919c700 1 -- 172.21.15.115:0/1853338385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d414dc40 con 0x7f17d40c9c90 2023-07-27T14:33:34.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.947+0000 7f17d919c700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d40c9c90 0x7f17d40ca110 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f17d414b5e0 tx=0x7f17cc007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:34.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.947+0000 7f17d0ff9700 1 -- 172.21.15.115:0/1853338385 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc006c30 con 0x7f17d40c9c90 2023-07-27T14:33:34.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.947+0000 7f17d0ff9700 1 -- 172.21.15.115:0/1853338385 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc006d90 con 0x7f17d40c9c90 2023-07-27T14:33:34.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.947+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d414df20 con 0x7f17d40c9c90 2023-07-27T14:33:34.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.947+0000 7f17d0ff9700 1 -- 172.21.15.115:0/1853338385 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0072a0 con 0x7f17d40c9c90 2023-07-27T14:33:34.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.947+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d414e4e0 con 0x7f17d40c9c90 2023-07-27T14:33:34.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.948+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d406c470 con 0x7f17d40c9c90 2023-07-27T14:33:34.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.950+0000 7f17d0ff9700 1 -- 172.21.15.115:0/1853338385 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f17cc007610 con 0x7f17d40c9c90 2023-07-27T14:33:34.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.951+0000 7f17d0ff9700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f17b805f5b0 0x7f17b8061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:34.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.951+0000 7f17d0ff9700 1 -- 172.21.15.115:0/1853338385 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f17cc07a400 con 0x7f17d40c9c90 2023-07-27T14:33:34.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.951+0000 7f17d899b700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f17b805f5b0 0x7f17b8061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:34.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.952+0000 7f17d899b700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f17b805f5b0 0x7f17b8061a70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f17c8001e90 tx=0x7f17c8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:34.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:34.955+0000 7f17d0ff9700 1 -- 172.21.15.115:0/1853338385 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17cc04b0d0 con 0x7f17d40c9c90 2023-07-27T14:33:35.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.173+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f17d40c84f0 con 0x7f17d40c9c90 2023-07-27T14:33:35.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.180+0000 7f17d0ff9700 1 -- 172.21.15.115:0/1853338385 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7f17cc04e6f0 con 0x7f17d40c9c90 2023-07-27T14:33:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.184+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f17b805f5b0 msgr2=0x7f17b8061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.184+0000 7f17dabff700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f17b805f5b0 0x7f17b8061a70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f17c8001e90 tx=0x7f17c8015000).stop 2023-07-27T14:33:35.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.184+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d40c9c90 msgr2=0x7f17d40ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.184+0000 7f17dabff700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d40c9c90 0x7f17d40ca110 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f17d414b5e0 tx=0x7f17cc007f30).stop 2023-07-27T14:33:35.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.185+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 shutdown_connections 2023-07-27T14:33:35.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.185+0000 7f17dabff700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f17b805f5b0 0x7f17b8061a70 secure :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0x7f17c8001e90 tx=0x7f17c8015000).stop 2023-07-27T14:33:35.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.185+0000 7f17dabff700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17d40c9c90 0x7f17d40ca110 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.185+0000 7f17dabff700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c40038e0 0x7f17d40c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.185+0000 7f17dabff700 1 --2- 172.21.15.115:0/1853338385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17d414d1f0 0x7f17d414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.185+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 >> 172.21.15.115:0/1853338385 conn(0x7f17d405e940 msgr2=0x7f17d40c13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:35.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.202+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 shutdown_connections 2023-07-27T14:33:35.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.204+0000 7f17dabff700 1 -- 172.21.15.115:0/1853338385 wait complete. 2023-07-27T14:33:35.249 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 17 and data pool 18 2023-07-27T14:33:35.267 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:35.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.414+0000 7f0084fff700 1 Processor -- start 2023-07-27T14:33:35.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.414+0000 7f0084fff700 1 -- start start 2023-07-27T14:33:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.415+0000 7f0084fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0080153ec0 0x7f00800a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.415+0000 7f0084fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00800aa050 0x7f00800640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.415+0000 7f0084fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00800aa4d0 con 0x7f00800aaa40 2023-07-27T14:33:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.415+0000 7f0084fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800c05c0 con 0x7f00800aa050 2023-07-27T14:33:35.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.415+0000 7f0084fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800c1a60 con 0x7f0080153ec0 2023-07-27T14:33:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00800aa050 0x7f00800640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f00800aa050 0x7f00800640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48686/0 (socket says 172.21.15.115:48686) 2023-07-27T14:33:35.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007dd9b700 1 -- 172.21.15.115:0/3259747395 learned_addr learned my addr 172.21.15.115:0/3259747395 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:35.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007e59c700 1 --2- 172.21.15.115:0/3259747395 >> v2:172.21.15.159:3300/0 conn(0x7f0080153ec0 0x7f00800a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007dd9b700 1 -- 172.21.15.115:0/3259747395 >> v2:172.21.15.159:3300/0 conn(0x7f0080153ec0 msgr2=0x7f00800a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007dd9b700 1 --2- 172.21.15.115:0/3259747395 >> v2:172.21.15.159:3300/0 conn(0x7f0080153ec0 0x7f00800a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007dd9b700 1 -- 172.21.15.115:0/3259747395 >> v1:172.21.15.159:6789/0 conn(0x7f00800aaa40 legacy=0x7f0080157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007dd9b700 1 -- 172.21.15.115:0/3259747395 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800bfc90 con 0x7f00800aa050 2023-07-27T14:33:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007dd9b700 1 --2- 172.21.15.115:0/3259747395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aa050 0x7f00800640f0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f0080083e30 tx=0x7f00740090f0).ready entity=mon.0 client_cookie=31b2054af62b9ef4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.416+0000 7f007d59a700 1 -- 172.21.15.115:0/3259747395 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400b520 con 0x7f00800aa050 2023-07-27T14:33:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f007d59a700 1 -- 172.21.15.115:0/3259747395 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400b680 con 0x7f00800aa050 2023-07-27T14:33:35.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f007d59a700 1 -- 172.21.15.115:0/3259747395 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400ba00 con 0x7f00800aa050 2023-07-27T14:33:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f0084fff700 1 -- 172.21.15.115:0/3259747395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aa050 msgr2=0x7f00800640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f0084fff700 1 --2- 172.21.15.115:0/3259747395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aa050 0x7f00800640f0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f0080083e30 tx=0x7f00740090f0).stop 2023-07-27T14:33:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f0084fff700 1 -- 172.21.15.115:0/3259747395 shutdown_connections 2023-07-27T14:33:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f0084fff700 1 --2- 172.21.15.115:0/3259747395 >> v2:172.21.15.159:3300/0 conn(0x7f0080153ec0 0x7f00800a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f0084fff700 1 --2- 172.21.15.115:0/3259747395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aa050 0x7f00800640f0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f0084fff700 1 -- 172.21.15.115:0/3259747395 >> 172.21.15.115:0/3259747395 conn(0x7f00800cb610 msgr2=0x7f00800c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f0084fff700 1 -- 172.21.15.115:0/3259747395 shutdown_connections 2023-07-27T14:33:35.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.417+0000 7f0084fff700 1 -- 172.21.15.115:0/3259747395 wait complete. 2023-07-27T14:33:35.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.419+0000 7f0084fff700 1 Processor -- start 2023-07-27T14:33:35.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.419+0000 7f0084fff700 1 -- start start 2023-07-27T14:33:35.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f0084fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00800aa050 0x7f008014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f0084fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aaa40 0x7f0080164800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f0084fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0080153ec0 0x7f0080164cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f0084fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0080165940 con 0x7f00800aaa40 2023-07-27T14:33:35.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f0084fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00800c3d10 con 0x7f00800aa050 2023-07-27T14:33:35.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f0084fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00800c3ff0 con 0x7f0080153ec0 2023-07-27T14:33:35.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aaa40 0x7f0080164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aaa40 0x7f0080164800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48696/0 (socket says 172.21.15.115:48696) 2023-07-27T14:33:35.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007dd9b700 1 -- 172.21.15.115:0/776823659 learned_addr learned my addr 172.21.15.115:0/776823659 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007e59c700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00800aa050 0x7f008014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007ed9d700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0080153ec0 0x7f0080164cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007dd9b700 1 -- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0080153ec0 msgr2=0x7f0080164cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007dd9b700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0080153ec0 0x7f0080164cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007dd9b700 1 -- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00800aa050 msgr2=0x7f008014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007dd9b700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00800aa050 0x7f008014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007dd9b700 1 -- 172.21.15.115:0/776823659 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074009370 con 0x7f00800aaa40 2023-07-27T14:33:35.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.420+0000 7f007ed9d700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0080153ec0 0x7f0080164cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:35.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.421+0000 7f007dd9b700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aaa40 0x7f0080164800 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f0074009130 tx=0x7f0074017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:35.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.421+0000 7f006e7fc700 1 -- 172.21.15.115:0/776823659 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400b7f0 con 0x7f00800aaa40 2023-07-27T14:33:35.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.421+0000 7f006e7fc700 1 -- 172.21.15.115:0/776823659 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400b950 con 0x7f00800aaa40 2023-07-27T14:33:35.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.421+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00800c42d0 con 0x7f00800aaa40 2023-07-27T14:33:35.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.421+0000 7f006e7fc700 1 -- 172.21.15.115:0/776823659 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007401c670 con 0x7f00800aaa40 2023-07-27T14:33:35.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.421+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008013b5e0 con 0x7f00800aaa40 2023-07-27T14:33:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.422+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0080165b10 con 0x7f00800aaa40 2023-07-27T14:33:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.423+0000 7f006e7fc700 1 -- 172.21.15.115:0/776823659 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f007402c070 con 0x7f00800aaa40 2023-07-27T14:33:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.424+0000 7f006e7fc700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f006005f580 0x7f0060061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.424+0000 7f006e7fc700 1 -- 172.21.15.115:0/776823659 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f007407c0c0 con 0x7f00800aaa40 2023-07-27T14:33:35.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.424+0000 7f007e59c700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f006005f580 0x7f0060061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.424+0000 7f007e59c700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f006005f580 0x7f0060061a40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f0070009b20 tx=0x7f0070008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:35.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.428+0000 7f006e7fc700 1 -- 172.21.15.115:0/776823659 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0080165b10 con 0x7f00800aaa40 2023-07-27T14:33:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.596+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00800c4770 con 0x7f00800aaa40 2023-07-27T14:33:35.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.597+0000 7f006e7fc700 1 -- 172.21.15.115:0/776823659 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17099 (secure 0 0 0) 0x7f007402a070 con 0x7f00800aaa40 2023-07-27T14:33:35.637 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:35.637 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":125,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:35.174691+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:33.605422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:34.146639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:35.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f006005f580 msgr2=0x7f0060061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f006005f580 0x7f0060061a40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f0070009b20 tx=0x7f0070008040).stop 2023-07-27T14:33:35.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aaa40 msgr2=0x7f0080164800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aaa40 0x7f0080164800 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f0074009130 tx=0x7f0074017000).stop 2023-07-27T14:33:35.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 shutdown_connections 2023-07-27T14:33:35.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f006005f580 0x7f0060061a40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0080153ec0 0x7f0080164cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00800aa050 0x7f008014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 --2- 172.21.15.115:0/776823659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00800aaa40 0x7f0080164800 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 >> 172.21.15.115:0/776823659 conn(0x7f00800cb610 msgr2=0x7f00800640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:35.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 shutdown_connections 2023-07-27T14:33:35.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.599+0000 7f0084fff700 1 -- 172.21.15.115:0/776823659 wait complete. 2023-07-27T14:33:35.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:35.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.805+0000 7fa5c33ff700 1 Processor -- start 2023-07-27T14:33:35.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.805+0000 7fa5c33ff700 1 -- start start 2023-07-27T14:33:35.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c33ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5bc151bd0 0x7fa5bc062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c33ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc0a4f50 0x7fa5bc0bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c33ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0639d0 con 0x7fa5bc062810 2023-07-27T14:33:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c33ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc137610 con 0x7fa5bc151bd0 2023-07-27T14:33:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c33ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc062dc0 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c119b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5bc151bd0 0x7fa5bc062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c119b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5bc151bd0 0x7fa5bc062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48710/0 (socket says 172.21.15.115:48710) 2023-07-27T14:33:35.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c119b700 1 -- 172.21.15.115:0/3896498385 learned_addr learned my addr 172.21.15.115:0/3896498385 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:35.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c199c700 1 --2- 172.21.15.115:0/3896498385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc0a4f50 0x7fa5bc0bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c119b700 1 -- 172.21.15.115:0/3896498385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc0a4f50 msgr2=0x7fa5bc0bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:35.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c119b700 1 --2- 172.21.15.115:0/3896498385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc0a4f50 0x7fa5bc0bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c119b700 1 -- 172.21.15.115:0/3896498385 >> v1:172.21.15.159:6789/0 conn(0x7fa5bc062810 legacy=0x7fa5bc0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:35.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.807+0000 7fa5c119b700 1 -- 172.21.15.115:0/3896498385 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0630a0 con 0x7fa5bc151bd0 2023-07-27T14:33:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c119b700 1 --2- 172.21.15.115:0/3896498385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc151bd0 0x7fa5bc062320 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fa5b8006fd0 tx=0x7fa5b80090f0).ready entity=mon.0 client_cookie=d4ee5950849d6dac server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5b3fff700 1 -- 172.21.15.115:0/3896498385 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800b600 con 0x7fa5bc151bd0 2023-07-27T14:33:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5b3fff700 1 -- 172.21.15.115:0/3896498385 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b800b760 con 0x7fa5bc151bd0 2023-07-27T14:33:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5b3fff700 1 -- 172.21.15.115:0/3896498385 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800bae0 con 0x7fa5bc151bd0 2023-07-27T14:33:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c33ff700 1 -- 172.21.15.115:0/3896498385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc151bd0 msgr2=0x7fa5bc062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/3896498385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc151bd0 0x7fa5bc062320 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fa5b8006fd0 tx=0x7fa5b80090f0).stop 2023-07-27T14:33:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c33ff700 1 -- 172.21.15.115:0/3896498385 shutdown_connections 2023-07-27T14:33:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/3896498385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc0a4f50 0x7fa5bc0bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/3896498385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc151bd0 0x7fa5bc062320 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c33ff700 1 -- 172.21.15.115:0/3896498385 >> 172.21.15.115:0/3896498385 conn(0x7fa5bc064700 msgr2=0x7fa5bc064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c33ff700 1 -- 172.21.15.115:0/3896498385 shutdown_connections 2023-07-27T14:33:35.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.808+0000 7fa5c33ff700 1 -- 172.21.15.115:0/3896498385 wait complete. 2023-07-27T14:33:35.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.810+0000 7fa5c33ff700 1 Processor -- start 2023-07-27T14:33:35.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.810+0000 7fa5c33ff700 1 -- start start 2023-07-27T14:33:35.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c33ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc062810 0x7fa5bc13d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c33ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc0a4f50 0x7fa5bc1397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c33ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5bc151bd0 0x7fa5bc1674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c33ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc138830 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c33ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc165030 con 0x7fa5bc151bd0 2023-07-27T14:33:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c33ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc13a620 con 0x7fa5bc062810 2023-07-27T14:33:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc0a4f50 0x7fa5bc1397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc0a4f50 0x7fa5bc1397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48720/0 (socket says 172.21.15.115:48720) 2023-07-27T14:33:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c099a700 1 -- 172.21.15.115:0/2355187610 learned_addr learned my addr 172.21.15.115:0/2355187610 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c119b700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc062810 0x7fa5bc13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.811+0000 7fa5c199c700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5bc151bd0 0x7fa5bc1674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5c099a700 1 -- 172.21.15.115:0/2355187610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc062810 msgr2=0x7fa5bc13d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5c099a700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc062810 0x7fa5bc13d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5c099a700 1 -- 172.21.15.115:0/2355187610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5bc151bd0 msgr2=0x7fa5bc1674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5c099a700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5bc151bd0 0x7fa5bc1674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5c099a700 1 -- 172.21.15.115:0/2355187610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009370 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5c099a700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc0a4f50 0x7fa5bc1397e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fa5ac00c440 tx=0x7fa5ac007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5b17fa700 1 -- 172.21.15.115:0/2355187610 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac007020 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5b17fa700 1 -- 172.21.15.115:0/2355187610 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac007180 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5b17fa700 1 -- 172.21.15.115:0/2355187610 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac007540 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc13a060 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.812+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc0bf290 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.813+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc06c470 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.814+0000 7fa5b17fa700 1 -- 172.21.15.115:0/2355187610 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fa5ac010070 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.815+0000 7fa5b17fa700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5a005f5b0 0x7fa5a0061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.815+0000 7fa5b17fa700 1 -- 172.21.15.115:0/2355187610 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa5ac0797f0 con 0x7fa5bc0a4f50 2023-07-27T14:33:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.815+0000 7fa5c119b700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5a005f5b0 0x7fa5a0061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:35.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.816+0000 7fa5c119b700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5a005f5b0 0x7fa5a0061a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fa5b8009130 tx=0x7fa5b8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:35.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.819+0000 7fa5b17fa700 1 -- 172.21.15.115:0/2355187610 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5ac0478f0 con 0x7fa5bc0a4f50 2023-07-27T14:33:36.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.988+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5bc136cb0 con 0x7fa5bc0a4f50 2023-07-27T14:33:36.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.989+0000 7fa5b17fa700 1 -- 172.21.15.115:0/2355187610 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17099 (secure 0 0 0) 0x7fa5ac04a570 con 0x7fa5bc0a4f50 2023-07-27T14:33:36.029 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:36.030 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":125,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:35.174691+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:33.605422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:34.146639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:36.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5a005f5b0 msgr2=0x7fa5a0061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:36.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5a005f5b0 0x7fa5a0061a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fa5b8009130 tx=0x7fa5b8017000).stop 2023-07-27T14:33:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc0a4f50 msgr2=0x7fa5bc1397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc0a4f50 0x7fa5bc1397e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fa5ac00c440 tx=0x7fa5ac007e00).stop 2023-07-27T14:33:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 shutdown_connections 2023-07-27T14:33:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5a005f5b0 0x7fa5a0061a70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5bc151bd0 0x7fa5bc1674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5bc062810 0x7fa5bc13d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.991+0000 7fa5c33ff700 1 --2- 172.21.15.115:0/2355187610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5bc0a4f50 0x7fa5bc1397e0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.992+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 >> 172.21.15.115:0/2355187610 conn(0x7fa5bc064700 msgr2=0x7fa5bc0c1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:36.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.992+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 shutdown_connections 2023-07-27T14:33:36.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:35.992+0000 7fa5c33ff700 1 -- 172.21.15.115:0/2355187610 wait complete. 2023-07-27T14:33:36.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:33:36.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.200+0000 7f550adff700 1 Processor -- start 2023-07-27T14:33:36.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.200+0000 7f550adff700 1 -- start start 2023-07-27T14:33:36.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.201+0000 7f550adff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55041509b0 0x7f55040c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:36.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.201+0000 7f550adff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5504150d90 0x7f5504154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f550adff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55040c3100 0x7f55040c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f550adff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55040c0ea0 con 0x7f55041509b0 2023-07-27T14:33:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f550adff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5504068e10 con 0x7f5504150d90 2023-07-27T14:33:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f550adff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5504155190 con 0x7f55040c3100 2023-07-27T14:33:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55041509b0 0x7f55040c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55041509b0 0x7f55040c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48732/0 (socket says 172.21.15.115:48732) 2023-07-27T14:33:36.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 -- 172.21.15.115:0/2676342087 learned_addr learned my addr 172.21.15.115:0/2676342087 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:36.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5503fff700 1 --2- 172.21.15.115:0/2676342087 >> v2:172.21.15.159:3300/0 conn(0x7f5504150d90 0x7f5504154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:36.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f550939c700 1 --2- 172.21.15.115:0/2676342087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55040c3100 0x7f55040c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:36.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 -- 172.21.15.115:0/2676342087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55040c3100 msgr2=0x7f55040c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:36.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 --2- 172.21.15.115:0/2676342087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55040c3100 0x7f55040c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 -- 172.21.15.115:0/2676342087 >> v2:172.21.15.159:3300/0 conn(0x7f5504150d90 msgr2=0x7f5504154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:36.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 --2- 172.21.15.115:0/2676342087 >> v2:172.21.15.159:3300/0 conn(0x7f5504150d90 0x7f5504154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 -- 172.21.15.115:0/2676342087 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504155470 con 0x7f55041509b0 2023-07-27T14:33:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.202+0000 7f5508b9b700 1 --2- 172.21.15.115:0/2676342087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55041509b0 0x7f55040c58d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f5504062ef0 tx=0x7f54f80090f0).ready entity=mon.0 client_cookie=f05241208f1e3d8a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f55037fe700 1 -- 172.21.15.115:0/2676342087 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f800b600 con 0x7f55041509b0 2023-07-27T14:33:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f55037fe700 1 -- 172.21.15.115:0/2676342087 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f800b760 con 0x7f55041509b0 2023-07-27T14:33:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f55037fe700 1 -- 172.21.15.115:0/2676342087 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f800bae0 con 0x7f55041509b0 2023-07-27T14:33:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 -- 172.21.15.115:0/2676342087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55041509b0 msgr2=0x7f55040c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 --2- 172.21.15.115:0/2676342087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55041509b0 0x7f55040c58d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f5504062ef0 tx=0x7f54f80090f0).stop 2023-07-27T14:33:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 -- 172.21.15.115:0/2676342087 shutdown_connections 2023-07-27T14:33:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 --2- 172.21.15.115:0/2676342087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55040c3100 0x7f55040c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 --2- 172.21.15.115:0/2676342087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55041509b0 0x7f55040c58d0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 --2- 172.21.15.115:0/2676342087 >> v2:172.21.15.159:3300/0 conn(0x7f5504150d90 0x7f5504154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 -- 172.21.15.115:0/2676342087 >> 172.21.15.115:0/2676342087 conn(0x7f5504062320 msgr2=0x7f5504062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 -- 172.21.15.115:0/2676342087 shutdown_connections 2023-07-27T14:33:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.203+0000 7f550adff700 1 -- 172.21.15.115:0/2676342087 wait complete. 2023-07-27T14:33:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.205+0000 7f550adff700 1 Processor -- start 2023-07-27T14:33:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.205+0000 7f550adff700 1 -- start start 2023-07-27T14:33:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550adff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55040c3100 0x7f55040c2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550adff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55041509b0 0x7f55040a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:36.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550adff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5504150d90 0x7f55040c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550adff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55040aac40 con 0x7f5504150d90 2023-07-27T14:33:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550adff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55040a9d80 con 0x7f55040c3100 2023-07-27T14:33:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550adff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55040aa030 con 0x7f55041509b0 2023-07-27T14:33:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550939c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5504150d90 0x7f55040c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550939c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5504150d90 0x7f55040c0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48746/0 (socket says 172.21.15.115:48746) 2023-07-27T14:33:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f550939c700 1 -- 172.21.15.115:0/3093561878 learned_addr learned my addr 172.21.15.115:0/3093561878 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.206+0000 7f5508b9b700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55040c3100 0x7f55040c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f550939c700 1 -- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55041509b0 msgr2=0x7f55040a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f5503fff700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55041509b0 0x7f55040a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f550939c700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55041509b0 0x7f55040a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f550939c700 1 -- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55040c3100 msgr2=0x7f55040c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f550939c700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55040c3100 0x7f55040c2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f550939c700 1 -- 172.21.15.115:0/3093561878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8009370 con 0x7f5504150d90 2023-07-27T14:33:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f5508b9b700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55040c3100 0x7f55040c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f5503fff700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55041509b0 0x7f55040a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f550939c700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5504150d90 0x7f55040c0100 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f54fc009fa0 tx=0x7f54fc009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f5500ff9700 1 -- 172.21.15.115:0/3093561878 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00ed20 con 0x7f5504150d90 2023-07-27T14:33:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f5500ff9700 1 -- 172.21.15.115:0/3093561878 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc00ee80 con 0x7f5504150d90 2023-07-27T14:33:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55040aa310 con 0x7f5504150d90 2023-07-27T14:33:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f5500ff9700 1 -- 172.21.15.115:0/3093561878 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc014610 con 0x7f5504150d90 2023-07-27T14:33:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.207+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55040aa8d0 con 0x7f5504150d90 2023-07-27T14:33:36.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.208+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55040aadf0 con 0x7f5504150d90 2023-07-27T14:33:36.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.209+0000 7f5500ff9700 1 -- 172.21.15.115:0/3093561878 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f54fc01b030 con 0x7f5504150d90 2023-07-27T14:33:36.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.210+0000 7f5500ff9700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f54e805f5b0 0x7f54e8061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:36.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.210+0000 7f5500ff9700 1 -- 172.21.15.115:0/3093561878 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f54fc07a980 con 0x7f5504150d90 2023-07-27T14:33:36.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.210+0000 7f5508b9b700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f54e805f5b0 0x7f54e8061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:36.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.211+0000 7f5508b9b700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f54e805f5b0 0x7f54e8061a70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f54f8009fd0 tx=0x7f54f8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:36.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.214+0000 7f5500ff9700 1 -- 172.21.15.115:0/3093561878 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55040aadf0 con 0x7f5504150d90 2023-07-27T14:33:36.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:36.427+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f55040aad80 con 0x7f5504150d90 2023-07-27T14:33:36.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-07-27T14:33:36.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-27T14:33:36.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-07-27T14:33:37.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.185+0000 7f5500ff9700 1 -- 172.21.15.115:0/3093561878 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7f54fc04b990 con 0x7f5504150d90 2023-07-27T14:33:37.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f54e805f5b0 msgr2=0x7f54e8061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:37.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f54e805f5b0 0x7f54e8061a70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f54f8009fd0 tx=0x7f54f8017000).stop 2023-07-27T14:33:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5504150d90 msgr2=0x7f55040c0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5504150d90 0x7f55040c0100 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f54fc009fa0 tx=0x7f54fc009900).stop 2023-07-27T14:33:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 shutdown_connections 2023-07-27T14:33:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f54e805f5b0 0x7f54e8061a70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5504150d90 0x7f55040c0100 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55040c3100 0x7f55040c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 --2- 172.21.15.115:0/3093561878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55041509b0 0x7f55040a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.187+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 >> 172.21.15.115:0/3093561878 conn(0x7f5504062320 msgr2=0x7f550414c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.188+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 shutdown_connections 2023-07-27T14:33:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.188+0000 7f550adff700 1 -- 172.21.15.115:0/3093561878 wait complete. 2023-07-27T14:33:37.246 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:33:37.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:33:37.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.399+0000 7ff84d7ff700 1 Processor -- start 2023-07-27T14:33:37.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.399+0000 7ff84d7ff700 1 -- start start 2023-07-27T14:33:37.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.400+0000 7ff84d7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff84814ae00 0x7ff848154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:37.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.400+0000 7ff84d7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8481553f0 con 0x7ff848063260 2023-07-27T14:33:37.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.400+0000 7ff84d7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff848157a50 con 0x7ff84814b1e0 2023-07-27T14:33:37.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.400+0000 7ff84d7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff848157d10 con 0x7ff84814ae00 2023-07-27T14:33:37.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff8477fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff848063260 0x7ff8480a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56722/0 (socket says 172.21.15.115:56722) 2023-07-27T14:33:37.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff8477fe700 1 -- 172.21.15.115:0/559374235 learned_addr learned my addr 172.21.15.115:0/559374235 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:37.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff846ffd700 1 --2- 172.21.15.115:0/559374235 >> v2:172.21.15.159:3300/0 conn(0x7ff84814ae00 0x7ff848154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:37.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620632873 0 0) 0x7ff8481553f0 con 0x7ff848063260 2023-07-27T14:33:37.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8300033f0 con 0x7ff848063260 2023-07-27T14:33:37.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3880693094 0 0) 0x7ff8300033f0 con 0x7ff848063260 2023-07-27T14:33:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 >> v2:172.21.15.159:3300/0 conn(0x7ff84814ae00 msgr2=0x7ff848154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 --2- 172.21.15.115:0/559374235 >> v2:172.21.15.159:3300/0 conn(0x7ff84814ae00 0x7ff848154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 >> v1:172.21.15.159:6789/0 conn(0x7ff84814b1e0 legacy=0x7ff848062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848157ff0 con 0x7ff848063260 2023-07-27T14:33:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7ff8400017f0 con 0x7ff848063260 2023-07-27T14:33:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 >> v1:172.21.15.115:6789/0 conn(0x7ff848063260 legacy=0x7ff8480a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8300038e0 0x7ff830003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830004690 0x7ff830004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff830005000 0x7ff83000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff848157d10 con 0x7ff830005000 2023-07-27T14:33:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83000bf60 con 0x7ff8300038e0 2023-07-27T14:33:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.401+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83000c0f0 con 0x7ff830004690 2023-07-27T14:33:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8477fe700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff830005000 0x7ff83000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff846ffd700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8300038e0 0x7ff830003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:37.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8467fc700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830004690 0x7ff830004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:37.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8477fe700 1 -- 172.21.15.115:0/559374235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830004690 msgr2=0x7ff830004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:37.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8477fe700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830004690 0x7ff830004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8477fe700 1 -- 172.21.15.115:0/559374235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8300038e0 msgr2=0x7ff830003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:37.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8477fe700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8300038e0 0x7ff830003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8477fe700 1 -- 172.21.15.115:0/559374235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300033f0 con 0x7ff830005000 2023-07-27T14:33:37.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8477fe700 1 -- 172.21.15.115:0/559374235 reap_dead start 2023-07-27T14:33:37.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.402+0000 7ff8477fe700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff830005000 0x7ff83000b8e0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7ff84000c450 tx=0x7ff84000c760).ready entity=mon.0 client_cookie=917005f35d6fb39d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:37.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840002030 con 0x7ff830005000 2023-07-27T14:33:37.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84000cdf0 con 0x7ff830005000 2023-07-27T14:33:37.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff845ffb700 1 -- 172.21.15.115:0/559374235 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840005d30 con 0x7ff830005000 2023-07-27T14:33:37.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff84d7ff700 1 -- 172.21.15.115:0/559374235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff830005000 msgr2=0x7ff83000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:37.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff84d7ff700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff830005000 0x7ff83000b8e0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7ff84000c450 tx=0x7ff84000c760).stop 2023-07-27T14:33:37.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff84d7ff700 1 -- 172.21.15.115:0/559374235 shutdown_connections 2023-07-27T14:33:37.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff84d7ff700 1 --2- 172.21.15.115:0/559374235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff830005000 0x7ff83000b8e0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff84d7ff700 1 -- 172.21.15.115:0/559374235 >> 172.21.15.115:0/559374235 conn(0x7ff84805e940 msgr2=0x7ff8480cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:37.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff84d7ff700 1 -- 172.21.15.115:0/559374235 shutdown_connections 2023-07-27T14:33:37.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.403+0000 7ff84d7ff700 1 -- 172.21.15.115:0/559374235 wait complete. 2023-07-27T14:33:37.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.405+0000 7ff84d7ff700 1 Processor -- start 2023-07-27T14:33:37.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.405+0000 7ff84d7ff700 1 -- start start 2023-07-27T14:33:37.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff84d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830005000 0x7ff8481533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:37.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff84d7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8481538b0 0x7ff848149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:37.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff84d7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff848149960 0x7ff8481504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:37.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff84d7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff848149de0 con 0x7ff8481538b0 2023-07-27T14:33:37.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff84d7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84814d2d0 con 0x7ff848149960 2023-07-27T14:33:37.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff84d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84814d5b0 con 0x7ff830005000 2023-07-27T14:33:37.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8467fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8481538b0 0x7ff848149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:37.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8467fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8481538b0 0x7ff848149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48754/0 (socket says 172.21.15.115:48754) 2023-07-27T14:33:37.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8467fc700 1 -- 172.21.15.115:0/1188770915 learned_addr learned my addr 172.21.15.115:0/1188770915 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:37.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff846ffd700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830005000 0x7ff8481533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:37.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8477fe700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff848149960 0x7ff8481504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:37.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8467fc700 1 -- 172.21.15.115:0/1188770915 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830005000 msgr2=0x7ff8481533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:37.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8467fc700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830005000 0x7ff8481533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8467fc700 1 -- 172.21.15.115:0/1188770915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff848149960 msgr2=0x7ff8481504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:37.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8467fc700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff848149960 0x7ff8481504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:37.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.406+0000 7ff8467fc700 1 -- 172.21.15.115:0/1188770915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84814d890 con 0x7ff8481538b0 2023-07-27T14:33:37.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.407+0000 7ff8467fc700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8481538b0 0x7ff848149470 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7ff83c007cc0 tx=0x7ff83c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:37.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.407+0000 7ff82effd700 1 -- 172.21.15.115:0/1188770915 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011590 con 0x7ff8481538b0 2023-07-27T14:33:37.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.407+0000 7ff82effd700 1 -- 172.21.15.115:0/1188770915 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0116f0 con 0x7ff8481538b0 2023-07-27T14:33:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.407+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84814db70 con 0x7ff8481538b0 2023-07-27T14:33:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.407+0000 7ff82effd700 1 -- 172.21.15.115:0/1188770915 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011a70 con 0x7ff8481538b0 2023-07-27T14:33:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.407+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8481509e0 con 0x7ff8481538b0 2023-07-27T14:33:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.408+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84814ebf0 con 0x7ff8481538b0 2023-07-27T14:33:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.409+0000 7ff82effd700 1 -- 172.21.15.115:0/1188770915 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7ff83c01b030 con 0x7ff8481538b0 2023-07-27T14:33:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.409+0000 7ff82effd700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff83405f5b0 0x7ff834061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.410+0000 7ff82effd700 1 -- 172.21.15.115:0/1188770915 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff83c07a100 con 0x7ff8481538b0 2023-07-27T14:33:37.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.410+0000 7ff846ffd700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff83405f5b0 0x7ff834061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:37.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.410+0000 7ff846ffd700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff83405f5b0 0x7ff834061a70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7ff838006d50 tx=0x7ff838008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:37.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.414+0000 7ff82effd700 1 -- 172.21.15.115:0/1188770915 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff83c04a8f0 con 0x7ff8481538b0 2023-07-27T14:33:37.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:37.625+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff84806c470 con 0x7ff8481538b0 2023-07-27T14:33:38.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.190+0000 7ff82effd700 1 -- 172.21.15.115:0/1188770915 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff83c04b110 con 0x7ff8481538b0 2023-07-27T14:33:38.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff83405f5b0 msgr2=0x7ff834061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff83405f5b0 0x7ff834061a70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7ff838006d50 tx=0x7ff838008040).stop 2023-07-27T14:33:38.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8481538b0 msgr2=0x7ff848149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8481538b0 0x7ff848149470 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7ff83c007cc0 tx=0x7ff83c007bb0).stop 2023-07-27T14:33:38.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 shutdown_connections 2023-07-27T14:33:38.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff83405f5b0 0x7ff834061a70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff848149960 0x7ff8481504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff830005000 0x7ff8481533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 --2- 172.21.15.115:0/1188770915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8481538b0 0x7ff848149470 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 >> 172.21.15.115:0/1188770915 conn(0x7ff84805e940 msgr2=0x7ff84814a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:38.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 shutdown_connections 2023-07-27T14:33:38.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.193+0000 7ff84d7ff700 1 -- 172.21.15.115:0/1188770915 wait complete. 2023-07-27T14:33:38.251 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:33:38.252 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:38.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.401+0000 7f4166fff700 1 Processor -- start 2023-07-27T14:33:38.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.401+0000 7f4166fff700 1 -- start start 2023-07-27T14:33:38.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f4166fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4160151d70 0x7f4160155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f4166fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4160065ff0 0x7f4160066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f4166fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160066960 0x7f4160157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f4166fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4160063a90 con 0x7f4160065ff0 2023-07-27T14:33:38.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f4166fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4160067080 con 0x7f4160151d70 2023-07-27T14:33:38.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f4166fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160066df0 con 0x7f4160066960 2023-07-27T14:33:38.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f415ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4160065ff0 0x7f4160066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f415ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4160065ff0 0x7f4160066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48758/0 (socket says 172.21.15.115:48758) 2023-07-27T14:33:38.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.402+0000 7f415ffff700 1 -- 172.21.15.115:0/3633522379 learned_addr learned my addr 172.21.15.115:0/3633522379 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:38.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f4164d9b700 1 --2- 172.21.15.115:0/3633522379 >> v2:172.21.15.159:3300/0 conn(0x7f4160151d70 0x7f4160155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f416559c700 1 --2- 172.21.15.115:0/3633522379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160066960 0x7f4160157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415ffff700 1 -- 172.21.15.115:0/3633522379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160066960 msgr2=0x7f4160157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:38.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415ffff700 1 --2- 172.21.15.115:0/3633522379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160066960 0x7f4160157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415ffff700 1 -- 172.21.15.115:0/3633522379 >> v2:172.21.15.159:3300/0 conn(0x7f4160151d70 msgr2=0x7f4160155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:38.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415ffff700 1 --2- 172.21.15.115:0/3633522379 >> v2:172.21.15.159:3300/0 conn(0x7f4160151d70 0x7f4160155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415ffff700 1 -- 172.21.15.115:0/3633522379 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600634d0 con 0x7f4160065ff0 2023-07-27T14:33:38.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f416559c700 1 --2- 172.21.15.115:0/3633522379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160066960 0x7f4160157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:38.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f4164d9b700 1 --2- 172.21.15.115:0/3633522379 >> v2:172.21.15.159:3300/0 conn(0x7f4160151d70 0x7f4160155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:38.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415ffff700 1 --2- 172.21.15.115:0/3633522379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160065ff0 0x7f4160066470 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f41600c88b0 tx=0x7f414c0090f0).ready entity=mon.0 client_cookie=5d8247f1b27b0878 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:38.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415f7fe700 1 -- 172.21.15.115:0/3633522379 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c00b600 con 0x7f4160065ff0 2023-07-27T14:33:38.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415f7fe700 1 -- 172.21.15.115:0/3633522379 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c00b760 con 0x7f4160065ff0 2023-07-27T14:33:38.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.403+0000 7f415f7fe700 1 -- 172.21.15.115:0/3633522379 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c00bae0 con 0x7f4160065ff0 2023-07-27T14:33:38.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 -- 172.21.15.115:0/3633522379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160065ff0 msgr2=0x7f4160066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 --2- 172.21.15.115:0/3633522379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160065ff0 0x7f4160066470 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f41600c88b0 tx=0x7f414c0090f0).stop 2023-07-27T14:33:38.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 -- 172.21.15.115:0/3633522379 shutdown_connections 2023-07-27T14:33:38.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 --2- 172.21.15.115:0/3633522379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160066960 0x7f4160157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 --2- 172.21.15.115:0/3633522379 >> v2:172.21.15.159:3300/0 conn(0x7f4160151d70 0x7f4160155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 --2- 172.21.15.115:0/3633522379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160065ff0 0x7f4160066470 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 -- 172.21.15.115:0/3633522379 >> 172.21.15.115:0/3633522379 conn(0x7f41600c89a0 msgr2=0x7f41600c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:38.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 -- 172.21.15.115:0/3633522379 shutdown_connections 2023-07-27T14:33:38.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.404+0000 7f4166fff700 1 -- 172.21.15.115:0/3633522379 wait complete. 2023-07-27T14:33:38.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.405+0000 7f4166fff700 1 Processor -- start 2023-07-27T14:33:38.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.405+0000 7f4166fff700 1 -- start start 2023-07-27T14:33:38.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.406+0000 7f4166fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4160065ff0 0x7f41600ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.406+0000 7f4166fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160066960 0x7f41600ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.406+0000 7f4166fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160151d70 0x7f41600a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.406+0000 7f4166fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ad260 con 0x7f4160066960 2023-07-27T14:33:38.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.406+0000 7f4166fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ad4b0 con 0x7f4160065ff0 2023-07-27T14:33:38.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.406+0000 7f4166fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ad790 con 0x7f4160151d70 2023-07-27T14:33:38.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160066960 0x7f41600ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160066960 0x7f41600ac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48766/0 (socket says 172.21.15.115:48766) 2023-07-27T14:33:38.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 -- 172.21.15.115:0/1760710620 learned_addr learned my addr 172.21.15.115:0/1760710620 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:38.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f4164d9b700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4160065ff0 0x7f41600ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f416559c700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160151d70 0x7f41600a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 -- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160151d70 msgr2=0x7f41600a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160151d70 0x7f41600a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 -- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4160065ff0 msgr2=0x7f41600ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4160065ff0 0x7f41600ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 -- 172.21.15.115:0/1760710620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c009370 con 0x7f4160066960 2023-07-27T14:33:38.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f4164d9b700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4160065ff0 0x7f41600ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:38.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f416559c700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160151d70 0x7f41600a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:38.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415ffff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160066960 0x7f41600ac200 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f414c009130 tx=0x7f414c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:38.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.407+0000 7f415cff9700 1 -- 172.21.15.115:0/1760710620 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c00bae0 con 0x7f4160066960 2023-07-27T14:33:38.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.408+0000 7f415cff9700 1 -- 172.21.15.115:0/1760710620 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c000c90 con 0x7f4160066960 2023-07-27T14:33:38.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.408+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41600ada70 con 0x7f4160066960 2023-07-27T14:33:38.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.408+0000 7f415cff9700 1 -- 172.21.15.115:0/1760710620 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c01c670 con 0x7f4160066960 2023-07-27T14:33:38.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.408+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41600ae760 con 0x7f4160066960 2023-07-27T14:33:38.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.409+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416006c470 con 0x7f4160066960 2023-07-27T14:33:38.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.410+0000 7f415cff9700 1 -- 172.21.15.115:0/1760710620 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f414c00f070 con 0x7f4160066960 2023-07-27T14:33:38.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.410+0000 7f415cff9700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f414405f5b0 0x7f4144061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.411+0000 7f415cff9700 1 -- 172.21.15.115:0/1760710620 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f414c07bd60 con 0x7f4160066960 2023-07-27T14:33:38.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.411+0000 7f4164d9b700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f414405f5b0 0x7f4144061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.411+0000 7f4164d9b700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f414405f5b0 0x7f4144061a70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f4154006fd0 tx=0x7f4154008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:38.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.415+0000 7f415cff9700 1 -- 172.21.15.115:0/1760710620 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f414c0506f0 con 0x7f4160066960 2023-07-27T14:33:38.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.624+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4160068720 con 0x7f4160066960 2023-07-27T14:33:38.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.625+0000 7f415cff9700 1 -- 172.21.15.115:0/1760710620 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f414c0502e0 con 0x7f4160066960 2023-07-27T14:33:38.665 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:38.665 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3206086489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3206086489},{"type":"v1","addr":"172.21.15.159:6835","nonce":3206086489}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1201288824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1201288824},{"type":"v1","addr":"172.21.15.159:6833","nonce":1201288824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7785,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3016973491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3016973491},{"type":"v1","addr":"172.21.15.115:6835","nonce":3016973491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:35.175025+0000","modified":"2023-07-27T14:33:38.185034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3532071498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3532071498},{"type":"v1","addr":"172.21.15.115:6837","nonce":3532071498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-07-27T14:33:38.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f414405f5b0 msgr2=0x7f4144061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f414405f5b0 0x7f4144061a70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f4154006fd0 tx=0x7f4154008040).stop 2023-07-27T14:33:38.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160066960 msgr2=0x7f41600ac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160066960 0x7f41600ac200 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f414c009130 tx=0x7f414c017000).stop 2023-07-27T14:33:38.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 shutdown_connections 2023-07-27T14:33:38.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f414405f5b0 0x7f4144061a70 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4160151d70 0x7f41600a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4160065ff0 0x7f41600ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 --2- 172.21.15.115:0/1760710620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4160066960 0x7f41600ac200 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 >> 172.21.15.115:0/1760710620 conn(0x7f41600c89a0 msgr2=0x7f4160153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:38.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 shutdown_connections 2023-07-27T14:33:38.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.627+0000 7f4166fff700 1 -- 172.21.15.115:0/1760710620 wait complete. 2023-07-27T14:33:38.669 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 68 2023-07-27T14:33:38.684 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:33:38.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.832+0000 7f9dc7bff700 1 Processor -- start 2023-07-27T14:33:38.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.832+0000 7f9dc7bff700 1 -- start start 2023-07-27T14:33:38.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc7bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9dc0153ec0 0x7f9dc00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc7bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 0x7f9dc00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc7bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00aa4d0 con 0x7f9dc00aaa40 2023-07-27T14:33:38.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc7bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00c05c0 con 0x7f9dc0153ec0 2023-07-27T14:33:38.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc7bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00c1a60 con 0x7f9dc00aa050 2023-07-27T14:33:38.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc599b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9dc0153ec0 0x7f9dc00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc599b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9dc0153ec0 0x7f9dc00a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48780/0 (socket says 172.21.15.115:48780) 2023-07-27T14:33:38.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc599b700 1 -- 172.21.15.115:0/2526355931 learned_addr learned my addr 172.21.15.115:0/2526355931 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:38.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc519a700 1 --2- 172.21.15.115:0/2526355931 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 0x7f9dc00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc599b700 1 -- 172.21.15.115:0/2526355931 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 msgr2=0x7f9dc00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:38.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc599b700 1 --2- 172.21.15.115:0/2526355931 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 0x7f9dc00640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc599b700 1 -- 172.21.15.115:0/2526355931 >> v1:172.21.15.159:6789/0 conn(0x7f9dc00aaa40 legacy=0x7f9dc0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.834+0000 7f9dc599b700 1 -- 172.21.15.115:0/2526355931 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00bfc90 con 0x7f9dc0153ec0 2023-07-27T14:33:38.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc599b700 1 --2- 172.21.15.115:0/2526355931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc00a9b60 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f9dbc006fd0 tx=0x7f9dbc0090f0).ready entity=mon.0 client_cookie=5b14282e2464ccf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:38.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc4999700 1 -- 172.21.15.115:0/2526355931 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00b600 con 0x7f9dc0153ec0 2023-07-27T14:33:38.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc4999700 1 -- 172.21.15.115:0/2526355931 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc00b760 con 0x7f9dc0153ec0 2023-07-27T14:33:38.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc4999700 1 -- 172.21.15.115:0/2526355931 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00bae0 con 0x7f9dc0153ec0 2023-07-27T14:33:38.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2526355931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 msgr2=0x7f9dc00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2526355931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc00a9b60 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f9dbc006fd0 tx=0x7f9dbc0090f0).stop 2023-07-27T14:33:38.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2526355931 shutdown_connections 2023-07-27T14:33:38.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2526355931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc00a9b60 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2526355931 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 0x7f9dc00640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.835+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2526355931 >> 172.21.15.115:0/2526355931 conn(0x7f9dc00cb610 msgr2=0x7f9dc00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:38.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.836+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2526355931 shutdown_connections 2023-07-27T14:33:38.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.836+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2526355931 wait complete. 2023-07-27T14:33:38.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.837+0000 7f9dc7bff700 1 Processor -- start 2023-07-27T14:33:38.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.837+0000 7f9dc7bff700 1 -- start start 2023-07-27T14:33:38.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc7bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 0x7f9dc00c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc7bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aaa40 0x7f9dc013e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc7bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc0163cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc7bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc01641a0 con 0x7f9dc0153ec0 2023-07-27T14:33:38.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc7bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc013d020 con 0x7f9dc00aaa40 2023-07-27T14:33:38.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc7bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc013c410 con 0x7f9dc00aa050 2023-07-27T14:33:38.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc619c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc0163cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc619c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc0163cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48794/0 (socket says 172.21.15.115:48794) 2023-07-27T14:33:38.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc619c700 1 -- 172.21.15.115:0/2052505110 learned_addr learned my addr 172.21.15.115:0/2052505110 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:38.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc599b700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 0x7f9dc00c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.838+0000 7f9dc519a700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aaa40 0x7f9dc013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9dc619c700 1 -- 172.21.15.115:0/2052505110 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 msgr2=0x7f9dc00c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9dc619c700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 0x7f9dc00c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9dc619c700 1 -- 172.21.15.115:0/2052505110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aaa40 msgr2=0x7f9dc013e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:38.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9dc619c700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aaa40 0x7f9dc013e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:38.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9dc619c700 1 -- 172.21.15.115:0/2052505110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc009370 con 0x7f9dc0153ec0 2023-07-27T14:33:38.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9dc619c700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc0163cb0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f9db800c7c0 tx=0x7f9db8001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:38.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9db5ffb700 1 -- 172.21.15.115:0/2052505110 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db800e4a0 con 0x7f9dc0153ec0 2023-07-27T14:33:38.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9db5ffb700 1 -- 172.21.15.115:0/2052505110 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db800e600 con 0x7f9dc0153ec0 2023-07-27T14:33:38.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9db5ffb700 1 -- 172.21.15.115:0/2052505110 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db800e980 con 0x7f9dc0153ec0 2023-07-27T14:33:38.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc013c6f0 con 0x7f9dc0153ec0 2023-07-27T14:33:38.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.839+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc013ccb0 con 0x7f9dc0153ec0 2023-07-27T14:33:38.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.840+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc006c470 con 0x7f9dc0153ec0 2023-07-27T14:33:38.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.841+0000 7f9db5ffb700 1 -- 172.21.15.115:0/2052505110 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f9db8010070 con 0x7f9dc0153ec0 2023-07-27T14:33:38.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.842+0000 7f9db5ffb700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9da405f580 0x7f9da4061a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:38.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.842+0000 7f9db5ffb700 1 -- 172.21.15.115:0/2052505110 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9db8079d10 con 0x7f9dc0153ec0 2023-07-27T14:33:38.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.842+0000 7f9dc599b700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9da405f580 0x7f9da4061a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:38.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.843+0000 7f9dc599b700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9da405f580 0x7f9da4061a40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f9dbc009130 tx=0x7f9dbc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:38.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:38.846+0000 7f9db5ffb700 1 -- 172.21.15.115:0/2052505110 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9db80478f0 con 0x7f9dc0153ec0 2023-07-27T14:33:39.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.014+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dc00aa4d0 con 0x7f9dc0153ec0 2023-07-27T14:33:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.015+0000 7f9db5ffb700 1 -- 172.21.15.115:0/2052505110 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17086 (secure 0 0 0) 0x7f9dc00aa4d0 con 0x7f9dc0153ec0 2023-07-27T14:33:39.055 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:39.056 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":126,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:33:36.177584+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:33.605422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:34.146639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:33:39.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.017+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9da405f580 msgr2=0x7f9da4061a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.017+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9da405f580 0x7f9da4061a40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f9dbc009130 tx=0x7f9dbc017000).stop 2023-07-27T14:33:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.017+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 msgr2=0x7f9dc0163cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.017+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc0163cb0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f9db800c7c0 tx=0x7f9db8001530).stop 2023-07-27T14:33:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.018+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 shutdown_connections 2023-07-27T14:33:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.018+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9da405f580 0x7f9da4061a40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.018+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc0153ec0 0x7f9dc0163cb0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.018+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9dc00aa050 0x7f9dc00c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.018+0000 7f9dc7bff700 1 --2- 172.21.15.115:0/2052505110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aaa40 0x7f9dc013e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.018+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 >> 172.21.15.115:0/2052505110 conn(0x7f9dc00cb610 msgr2=0x7f9dc00ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.018+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 shutdown_connections 2023-07-27T14:33:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.018+0000 7f9dc7bff700 1 -- 172.21.15.115:0/2052505110 wait complete. 2023-07-27T14:33:39.075 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:33:39.076 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:33:39.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.224+0000 7f8b30bff700 1 Processor -- start 2023-07-27T14:33:39.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.224+0000 7f8b30bff700 1 -- start start 2023-07-27T14:33:39.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.225+0000 7f8b30bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c1542a0 0x7f8b2c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.225+0000 7f8b30bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c0aa4d0 con 0x7f8b2c153ec0 2023-07-27T14:33:39.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.225+0000 7f8b30bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c0c05c0 con 0x7f8b2c0aaa40 2023-07-27T14:33:39.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.225+0000 7f8b30bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0c1a60 con 0x7f8b2c1542a0 2023-07-27T14:33:39.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8b2c153ec0 0x7f8b2c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56738/0 (socket says 172.21.15.115:56738) 2023-07-27T14:33:39.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2a59c700 1 -- 172.21.15.115:0/769615050 learned_addr learned my addr 172.21.15.115:0/769615050 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:39.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166824518 0 0) 0x7f8b1c001110 con 0x7f8b2c153ec0 2023-07-27T14:33:39.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b140033f0 con 0x7f8b2c153ec0 2023-07-27T14:33:39.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2ad9d700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c1542a0 0x7f8b2c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 472629498 0 0) 0x7f8b140033f0 con 0x7f8b2c153ec0 2023-07-27T14:33:39.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c1542a0 msgr2=0x7f8b2c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:39.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c1542a0 0x7f8b2c15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 >> v1:172.21.15.159:6789/0 conn(0x7f8b2c0aaa40 legacy=0x7f8b2c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0aa270 con 0x7f8b2c153ec0 2023-07-27T14:33:39.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f8b1c001600 con 0x7f8b2c153ec0 2023-07-27T14:33:39.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 >> v1:172.21.15.115:6789/0 conn(0x7f8b2c153ec0 legacy=0x7f8b2c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c1542a0 0x7f8b14003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b14003e40 0x7f8b14004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14004b80 0x7f8b14005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0c1a60 con 0x7f8b14003e40 2023-07-27T14:33:39.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1400b990 con 0x7f8b14004b80 2023-07-27T14:33:39.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.226+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1400bb50 con 0x7f8b2c1542a0 2023-07-27T14:33:39.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b29d9b700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b14003e40 0x7f8b14004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b2a59c700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c1542a0 0x7f8b14003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b2ad9d700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14004b80 0x7f8b14005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b29d9b700 1 -- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c1542a0 msgr2=0x7f8b14003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:39.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b29d9b700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c1542a0 0x7f8b14003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b29d9b700 1 -- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14004b80 msgr2=0x7f8b14005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:39.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b29d9b700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14004b80 0x7f8b14005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b29d9b700 1 -- 172.21.15.115:0/769615050 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140033f0 con 0x7f8b14003e40 2023-07-27T14:33:39.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.227+0000 7f8b29d9b700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b14003e40 0x7f8b14004690 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f8b20001700 tx=0x7f8b20007bb0).ready entity=mon.0 client_cookie=2a820598d273567b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:39.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20007020 con 0x7f8b14003e40 2023-07-27T14:33:39.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b20007180 con 0x7f8b14003e40 2023-07-27T14:33:39.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b2959a700 1 -- 172.21.15.115:0/769615050 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20007500 con 0x7f8b14003e40 2023-07-27T14:33:39.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b30bff700 1 -- 172.21.15.115:0/769615050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b14003e40 msgr2=0x7f8b14004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b30bff700 1 --2- 172.21.15.115:0/769615050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b14003e40 0x7f8b14004690 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f8b20001700 tx=0x7f8b20007bb0).stop 2023-07-27T14:33:39.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b2ad9d700 1 -- 172.21.15.115:0/769615050 reap_dead start 2023-07-27T14:33:39.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b30bff700 1 -- 172.21.15.115:0/769615050 shutdown_connections 2023-07-27T14:33:39.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b30bff700 1 -- 172.21.15.115:0/769615050 >> 172.21.15.115:0/769615050 conn(0x7f8b2c0cb610 msgr2=0x7f8b2c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:39.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b30bff700 1 -- 172.21.15.115:0/769615050 shutdown_connections 2023-07-27T14:33:39.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.228+0000 7f8b30bff700 1 -- 172.21.15.115:0/769615050 wait complete. 2023-07-27T14:33:39.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.230+0000 7f8b30bff700 1 Processor -- start 2023-07-27T14:33:39.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.230+0000 7f8b30bff700 1 -- start start 2023-07-27T14:33:39.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b30bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14003e40 0x7f8b2c14cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b30bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c0adb40 0x7f8b2c0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b30bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c0c2820 0x7f8b2c0c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b30bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0af1f0 con 0x7f8b2c0c2820 2023-07-27T14:33:39.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b30bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0ae5e0 con 0x7f8b14003e40 2023-07-27T14:33:39.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b30bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0ae8c0 con 0x7f8b2c0adb40 2023-07-27T14:33:39.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b2ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c0c2820 0x7f8b2c0c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b2ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c0c2820 0x7f8b2c0c2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48824/0 (socket says 172.21.15.115:48824) 2023-07-27T14:33:39.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b2ad9d700 1 -- 172.21.15.115:0/569820589 learned_addr learned my addr 172.21.15.115:0/569820589 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:39.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b2a59c700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14003e40 0x7f8b2c14cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.231+0000 7f8b29d9b700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c0adb40 0x7f8b2c0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b2ad9d700 1 -- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c0adb40 msgr2=0x7f8b2c0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b2ad9d700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c0adb40 0x7f8b2c0adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b2ad9d700 1 -- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14003e40 msgr2=0x7f8b2c14cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b2ad9d700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14003e40 0x7f8b2c14cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b2ad9d700 1 -- 172.21.15.115:0/569820589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0aeba0 con 0x7f8b2c0c2820 2023-07-27T14:33:39.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b2a59c700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14003e40 0x7f8b2c14cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:39.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b2ad9d700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c0c2820 0x7f8b2c0c2ca0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f8b2c0843d0 tx=0x7f8b2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:39.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b1a7fc700 1 -- 172.21.15.115:0/569820589 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400e040 con 0x7f8b2c0c2820 2023-07-27T14:33:39.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b1a7fc700 1 -- 172.21.15.115:0/569820589 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2400f040 con 0x7f8b2c0c2820 2023-07-27T14:33:39.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2c0aee80 con 0x7f8b2c0c2820 2023-07-27T14:33:39.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b1a7fc700 1 -- 172.21.15.115:0/569820589 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400fe20 con 0x7f8b2c0c2820 2023-07-27T14:33:39.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.232+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c14d040 con 0x7f8b2c0c2820 2023-07-27T14:33:39.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.233+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2c0af3a0 con 0x7f8b2c0c2820 2023-07-27T14:33:39.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.234+0000 7f8b1a7fc700 1 -- 172.21.15.115:0/569820589 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f8b24015660 con 0x7f8b2c0c2820 2023-07-27T14:33:39.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.235+0000 7f8b1a7fc700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8b0c05f5b0 0x7f8b0c061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.235+0000 7f8b1a7fc700 1 -- 172.21.15.115:0/569820589 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8b2407b5c0 con 0x7f8b2c0c2820 2023-07-27T14:33:39.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.235+0000 7f8b2a59c700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8b0c05f5b0 0x7f8b0c061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.236+0000 7f8b2a59c700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8b0c05f5b0 0x7f8b0c061a70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f8b1c001730 tx=0x7f8b1c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:39.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.239+0000 7f8b1a7fc700 1 -- 172.21.15.115:0/569820589 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8b2c0af3a0 con 0x7f8b2c0c2820 2023-07-27T14:33:39.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.404+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b2c06c470 con 0x7f8b0c05f5b0 2023-07-27T14:33:39.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.414+0000 7f8b1a7fc700 1 -- 172.21.15.115:0/569820589 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349750 (secure 0 0 0) 0x7f8b2c06c470 con 0x7f8b0c05f5b0 2023-07-27T14:33:39.458 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:39.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8b0c05f5b0 msgr2=0x7f8b0c061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8b0c05f5b0 0x7f8b0c061a70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f8b1c001730 tx=0x7f8b1c009040).stop 2023-07-27T14:33:39.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c0c2820 msgr2=0x7f8b2c0c2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c0c2820 0x7f8b2c0c2ca0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f8b2c0843d0 tx=0x7f8b2400b040).stop 2023-07-27T14:33:39.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 shutdown_connections 2023-07-27T14:33:39.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8b0c05f5b0 0x7f8b0c061a70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b2c0c2820 0x7f8b2c0c2ca0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8b14003e40 0x7f8b2c14cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 --2- 172.21.15.115:0/569820589 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8b2c0adb40 0x7f8b2c0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.418+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 >> 172.21.15.115:0/569820589 conn(0x7f8b2c0cb610 msgr2=0x7f8b2c14f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:39.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.419+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 shutdown_connections 2023-07-27T14:33:39.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.419+0000 7f8b30bff700 1 -- 172.21.15.115:0/569820589 wait complete. 2023-07-27T14:33:39.462 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:33:39.475 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2023-07-27T14:33:37.526794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":125696,"kb_used_data":11840,"kb_used_omap":0,"kb_used_meta":113792,"kb_avail":754849024,"statfs":{"total":773094113280,"available":772965400576,"internally_reserved":0,"allocated":12124160,"data_stored":5643232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":116523008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-47032,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.145857"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.031551+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:33:30.031551+0000","last_peered":"2023-07-27T14:33:30.031551+0000","last_clean":"2023-07-27T14:33:30.031551+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:33:30.031551+0000","last_undegraded":"2023-07-27T14:33:30.031551+0000","last_fullsized":"2023-07-27T14:33:30.031551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.031506+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:33:30.031506+0000","last_peered":"2023-07-27T14:33:30.031506+0000","last_clean":"2023-07-27T14:33:30.031506+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:33:30.031506+0000","last_undegraded":"2023-07-27T14:33:30.031506+0000","last_fullsized":"2023-07-27T14:33:30.031506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.031321+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:33:30.031321+0000","last_peered":"2023-07-27T14:33:30.031321+0000","last_clean":"2023-07-27T14:33:30.031321+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:33:30.031321+0000","last_undegraded":"2023-07-27T14:33:30.031321+0000","last_fullsized":"2023-07-27T14:33:30.031321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.031553+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:33:30.031553+0000","last_peered":"2023-07-27T14:33:30.031553+0000","last_clean":"2023-07-27T14:33:30.031553+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:33:30.031553+0000","last_undegraded":"2023-07-27T14:33:30.031553+0000","last_fullsized":"2023-07-27T14:33:30.031553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":104,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.030563+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:33:30.030563+0000","last_peered":"2023-07-27T14:33:30.030563+0000","last_clean":"2023-07-27T14:33:30.030563+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:33:30.030563+0000","last_undegraded":"2023-07-27T14:33:30.030563+0000","last_fullsized":"2023-07-27T14:33:30.030563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.030567+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:33:30.030567+0000","last_peered":"2023-07-27T14:33:30.030567+0000","last_clean":"2023-07-27T14:33:30.030567+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:33:30.030567+0000","last_undegraded":"2023-07-27T14:33:30.030567+0000","last_fullsized":"2023-07-27T14:33:30.030567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.030584+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:33:30.030584+0000","last_peered":"2023-07-27T14:33:30.030584+0000","last_clean":"2023-07-27T14:33:30.030584+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:33:30.030584+0000","last_undegraded":"2023-07-27T14:33:30.030584+0000","last_fullsized":"2023-07-27T14:33:30.030584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.031568+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:33:30.031568+0000","last_peered":"2023-07-27T14:33:30.031568+0000","last_clean":"2023-07-27T14:33:30.031568+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:33:30.031568+0000","last_undegraded":"2023-07-27T14:33:30.031568+0000","last_fullsized":"2023-07-27T14:33:30.031568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:34.692036+0000","last_change":"2023-07-27T14:33:34.692036+0000","last_active":"2023-07-27T14:33:34.692036+0000","last_peered":"2023-07-27T14:33:34.692036+0000","last_clean":"2023-07-27T14:33:34.692036+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:34.692036+0000","last_undegraded":"2023-07-27T14:33:34.692036+0000","last_fullsized":"2023-07-27T14:33:34.692036+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:33:33.685394+0000","last_change":"2023-07-27T14:33:33.685394+0000","last_active":"2023-07-27T14:33:33.685394+0000","last_peered":"2023-07-27T14:33:33.685394+0000","last_clean":"2023-07-27T14:33:33.685394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:33:33.685394+0000","last_undegraded":"2023-07-27T14:33:33.685394+0000","last_fullsized":"2023-07-27T14:33:33.685394+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-07-27T14:33:30.030954+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:33:30.030954+0000","last_peered":"2023-07-27T14:33:30.030954+0000","last_clean":"2023-07-27T14:33:30.030954+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:33:30.030954+0000","last_undegraded":"2023-07-27T14:33:30.030954+0000","last_fullsized":"2023-07-27T14:33:30.030954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14928,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":13440,"kb_avail":94356912,"statfs":{"total":96636764160,"available":96621477888,"internally_reserved":0,"allocated":1515520,"data_stored":705404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13762560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.627,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.96599999999999997,"15min":1.133},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.67500000000000004},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.0589999999999999,"15min":1.1180000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.72599999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.90700000000000003,"5min":0.96999999999999997,"15min":1.1459999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.90000000000000002,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66700000000000004,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.119},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.069,"15min":1.069},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.55300000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85799999999999998,"5min":0.92800000000000005,"15min":1.165},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61499999999999999,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97899999999999998,"15min":1.0249999999999999},"last":0.747}]},{"osd":5,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86199999999999999,"5min":1.202,"15min":1.202},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.70399999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.999,"5min":1.028,"15min":1.0409999999999999},"last":0.54600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357168,"statfs":{"total":96636764160,"available":96621740032,"internally_reserved":0,"allocated":1515520,"data_stored":705404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86399999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.502},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.45700000000000002,"5min":0.44900000000000001,"15min":0.42999999999999999},"max":{"1min":0.92900000000000005,"5min":1.2,"15min":1.2},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.66300000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.745,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.079},"last":0.443}]},{"osd":5,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.67800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.0309999999999999,"15min":1.198},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.84199999999999997,"5min":0.92200000000000004,"15min":0.94099999999999995},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.748,"15min":0.74099999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.1000000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":0.57199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17296,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354544,"statfs":{"total":96636764160,"available":96619053056,"internally_reserved":0,"allocated":1515520,"data_stored":705404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.51400000000000001},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55100000000000005,"5min":0.65500000000000003,"15min":4.75},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.66400000000000003},"min":{"1min":0.26900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64100000000000001,"5min":0.70199999999999996,"15min":9.3100000000000005},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.56000000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.55600000000000005,"5min":0.67500000000000004,"15min":3.7210000000000001},"last":0.434},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.53500000000000003},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.59099999999999997,"5min":0.79700000000000004,"15min":2.7160000000000002},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46600000000000003,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":3.8580000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97999999999999998,"5min":1.2010000000000001,"15min":2.181},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":1.127,"15min":2.4180000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":3.7440000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1040000000000001,"15min":2.149},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69699999999999995,"15min":0.74099999999999999},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":0.85499999999999998,"5min":1.032,"15min":2.052},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69499999999999995,"15min":0.84999999999999998},"min":{"1min":0.51800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.23,"15min":6.1980000000000004},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.103,"15min":2.016},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.002,"5min":1.087,"15min":3.7799999999999998},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357168,"statfs":{"total":96636764160,"available":96621740032,"internally_reserved":0,"allocated":1515520,"data_stored":705404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.52300000000000002,"5min":0.58299999999999996,"15min":0.79500000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.24399999999999999},"max":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.42599999999999999},"min":{"1min":0.32000000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.41599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55400000000000005,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.085,"5min":1.28,"15min":1.28},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95199999999999996,"5min":1.25,"15min":1.25},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.54100000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90700000000000003,"5min":1.22,"15min":1.22},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":0.93799999999999994,"5min":1.244,"15min":1.244},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55800000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0029999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18256,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":16768,"kb_avail":94353584,"statfs":{"total":96636764160,"available":96618070016,"internally_reserved":0,"allocated":1515520,"data_stored":705404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17170432},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.439}]},{"osd":1,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60099999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.495},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.601,"5min":5.601,"15min":5.601},"last":0.501}]},{"osd":3,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45400000000000001,"15min":0.48199999999999998},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70799999999999996,"5min":0.81100000000000005,"15min":0.83499999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.53700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.05,"5min":0.76400000000000001,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":6.9660000000000002,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.75700000000000001,"15min":0.77800000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.1360000000000001,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15376,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":13888,"kb_avail":94356464,"statfs":{"total":96636764160,"available":96621019136,"internally_reserved":0,"allocated":1515520,"data_stored":705404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14221312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39300000000000002},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.52100000000000002,"5min":1.302,"15min":1.302},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.45000000000000001},"min":{"1min":0.32700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59299999999999997,"5min":0.748,"15min":0.88900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.47399999999999998,"15min":0.44500000000000001},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2749999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.149},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.54300000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.111,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.51000000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91200000000000003,"5min":1.232,"15min":1.232},"last":0.62},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1639999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.45200000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.298},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":1.0209999999999999,"5min":1.343,"15min":1.343},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.78100000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78600000000000003,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.49299999999999999},"max":{"1min":1.1020000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":14480,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94357360,"statfs":{"total":96636764160,"available":96621936640,"internally_reserved":0,"allocated":1515520,"data_stored":705404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.52500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85599999999999998,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.874},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.90100000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79000000000000004,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.495,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81399999999999995,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":4.476,"15min":4.476},"last":0.95799999999999996}]},{"osd":3,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88900000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.497,"15min":0.49199999999999999},"max":{"1min":0.93000000000000005,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66600000000000004,"15min":0.621},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.66200000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0029999999999999,"5min":5.194,"15min":5.194},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94799999999999995,"5min":2.819,"15min":2.819},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0389999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.96999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16016,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":14528,"kb_avail":94355824,"statfs":{"total":96636764160,"available":96620363776,"internally_reserved":0,"allocated":1515520,"data_stored":705404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14876672},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86199999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72299999999999998,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.68500000000000005},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.91900000000000004,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":1.581,"15min":1.581},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69999999999999996,"15min":0.66200000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98899999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":0.93100000000000005,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96099999999999997,"5min":1.978,"15min":1.978},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67700000000000005,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.88800000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85399999999999998,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92300000000000004,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:33:39.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:33:39.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.662+0000 7fb9ce1ff700 1 Processor -- start 2023-07-27T14:33:39.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.663+0000 7fb9ce1ff700 1 -- start start 2023-07-27T14:33:39.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9ce1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb9c80aaa40 0x7fb9c80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9ce1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb9c81542a0 0x7fb9c80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9ce1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80aa4d0 con 0x7fb9c8153ec0 2023-07-27T14:33:39.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9ce1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c8064ad0 con 0x7fb9c80aaa40 2023-07-27T14:33:39.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9ce1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c80c05c0 con 0x7fb9c81542a0 2023-07-27T14:33:39.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9c6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb9c80aaa40 0x7fb9c80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9c6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb9c80aaa40 0x7fb9c80640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48838/0 (socket says 172.21.15.115:48838) 2023-07-27T14:33:39.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9c6ffd700 1 -- 172.21.15.115:0/2118526274 learned_addr learned my addr 172.21.15.115:0/2118526274 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:39.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9c77fe700 1 --1- 172.21.15.115:0/2118526274 >> v1:172.21.15.115:6789/0 conn(0x7fb9c8153ec0 0x7fb9c80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56742/0 (socket says 172.21.15.115:56742) 2023-07-27T14:33:39.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.664+0000 7fb9c7fff700 1 --2- 172.21.15.115:0/2118526274 >> v2:172.21.15.159:3300/0 conn(0x7fb9c81542a0 0x7fb9c80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9c6ffd700 1 -- 172.21.15.115:0/2118526274 >> v2:172.21.15.159:3300/0 conn(0x7fb9c81542a0 msgr2=0x7fb9c80645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:39.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9c6ffd700 1 --2- 172.21.15.115:0/2118526274 >> v2:172.21.15.159:3300/0 conn(0x7fb9c81542a0 0x7fb9c80645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9c6ffd700 1 -- 172.21.15.115:0/2118526274 >> v1:172.21.15.115:6789/0 conn(0x7fb9c8153ec0 legacy=0x7fb9c80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9c6ffd700 1 -- 172.21.15.115:0/2118526274 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80c1a60 con 0x7fb9c80aaa40 2023-07-27T14:33:39.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9c6ffd700 1 --2- 172.21.15.115:0/2118526274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c80aaa40 0x7fb9c80640f0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fb9c80c5470 tx=0x7fb9bc0090f0).ready entity=mon.0 client_cookie=c0f3340a39f17f4c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:39.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9c67fc700 1 -- 172.21.15.115:0/2118526274 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00b600 con 0x7fb9c80aaa40 2023-07-27T14:33:39.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9c67fc700 1 -- 172.21.15.115:0/2118526274 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc00b760 con 0x7fb9c80aaa40 2023-07-27T14:33:39.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9c67fc700 1 -- 172.21.15.115:0/2118526274 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00bae0 con 0x7fb9c80aaa40 2023-07-27T14:33:39.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/2118526274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c80aaa40 msgr2=0x7fb9c80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.665+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/2118526274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c80aaa40 0x7fb9c80640f0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fb9c80c5470 tx=0x7fb9bc0090f0).stop 2023-07-27T14:33:39.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.666+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/2118526274 shutdown_connections 2023-07-27T14:33:39.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.666+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/2118526274 >> v2:172.21.15.159:3300/0 conn(0x7fb9c81542a0 0x7fb9c80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.666+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/2118526274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c80aaa40 0x7fb9c80640f0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.666+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/2118526274 >> 172.21.15.115:0/2118526274 conn(0x7fb9c80cb610 msgr2=0x7fb9c80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:39.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.666+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/2118526274 shutdown_connections 2023-07-27T14:33:39.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.666+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/2118526274 wait complete. 2023-07-27T14:33:39.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.667+0000 7fb9ce1ff700 1 Processor -- start 2023-07-27T14:33:39.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.667+0000 7fb9ce1ff700 1 -- start start 2023-07-27T14:33:39.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9ce1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c80aaa40 0x7fb9c8141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9ce1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c8153ec0 0x7fb9c80c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9ce1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9c81542a0 0x7fb9c80ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9ce1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c814da20 con 0x7fb9c8153ec0 2023-07-27T14:33:39.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9ce1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8141d60 con 0x7fb9c80aaa40 2023-07-27T14:33:39.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9ce1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c814ef60 con 0x7fb9c81542a0 2023-07-27T14:33:39.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9c6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c8153ec0 0x7fb9c80c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9c6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c8153ec0 0x7fb9c80c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48848/0 (socket says 172.21.15.115:48848) 2023-07-27T14:33:39.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9c6ffd700 1 -- 172.21.15.115:0/1095932669 learned_addr learned my addr 172.21.15.115:0/1095932669 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:39.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.668+0000 7fb9c77fe700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c80aaa40 0x7fb9c8141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9c7fff700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9c81542a0 0x7fb9c80ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9c6ffd700 1 -- 172.21.15.115:0/1095932669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9c81542a0 msgr2=0x7fb9c80ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9c6ffd700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9c81542a0 0x7fb9c80ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9c6ffd700 1 -- 172.21.15.115:0/1095932669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c80aaa40 msgr2=0x7fb9c8141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9c6ffd700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c80aaa40 0x7fb9c8141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9c6ffd700 1 -- 172.21.15.115:0/1095932669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009370 con 0x7fb9c8153ec0 2023-07-27T14:33:39.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9c6ffd700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c8153ec0 0x7fb9c80c9890 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fb9bc011000 tx=0x7fb9bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:39.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9af7fe700 1 -- 172.21.15.115:0/1095932669 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00b8d0 con 0x7fb9c8153ec0 2023-07-27T14:33:39.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9af7fe700 1 -- 172.21.15.115:0/1095932669 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc00ba30 con 0x7fb9c8153ec0 2023-07-27T14:33:39.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9af7fe700 1 -- 172.21.15.115:0/1095932669 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc01c630 con 0x7fb9c8153ec0 2023-07-27T14:33:39.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.669+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c814e350 con 0x7fb9c8153ec0 2023-07-27T14:33:39.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.670+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c814e910 con 0x7fb9c8153ec0 2023-07-27T14:33:39.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.670+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c806c470 con 0x7fb9c8153ec0 2023-07-27T14:33:39.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.671+0000 7fb9af7fe700 1 -- 172.21.15.115:0/1095932669 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fb9bc02c070 con 0x7fb9c8153ec0 2023-07-27T14:33:39.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.672+0000 7fb9af7fe700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb9b405f5b0 0x7fb9b4061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:39.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.672+0000 7fb9af7fe700 1 -- 172.21.15.115:0/1095932669 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb9bc07c160 con 0x7fb9c8153ec0 2023-07-27T14:33:39.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.672+0000 7fb9c77fe700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb9b405f5b0 0x7fb9b4061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:39.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.673+0000 7fb9c77fe700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb9b405f5b0 0x7fb9b4061a70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fb9c80af790 tx=0x7fb9b8007d30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:39.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.676+0000 7fb9af7fe700 1 -- 172.21.15.115:0/1095932669 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9bc04d0c0 con 0x7fb9c8153ec0 2023-07-27T14:33:39.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.842+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9c8062540 con 0x7fb9b405f5b0 2023-07-27T14:33:39.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.852+0000 7fb9af7fe700 1 -- 172.21.15.115:0/1095932669 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361511 (secure 0 0 0) 0x7fb9c8062540 con 0x7fb9b405f5b0 2023-07-27T14:33:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb9b405f5b0 msgr2=0x7fb9b4061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb9b405f5b0 0x7fb9b4061a70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fb9c80af790 tx=0x7fb9b8007d30).stop 2023-07-27T14:33:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c8153ec0 msgr2=0x7fb9c80c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:39.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c8153ec0 0x7fb9c80c9890 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fb9bc011000 tx=0x7fb9bc017000).stop 2023-07-27T14:33:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 shutdown_connections 2023-07-27T14:33:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb9b405f5b0 0x7fb9b4061a70 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9c81542a0 0x7fb9c80ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9c80aaa40 0x7fb9c8141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 --2- 172.21.15.115:0/1095932669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9c8153ec0 0x7fb9c80c9890 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 >> 172.21.15.115:0/1095932669 conn(0x7fb9c80cb610 msgr2=0x7fb9c80c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:39.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 shutdown_connections 2023-07-27T14:33:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:39.857+0000 7fb9ce1ff700 1 -- 172.21.15.115:0/1095932669 wait complete. 2023-07-27T14:33:39.900 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:33:39.914 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2023-07-27T14:33:39.527143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":249,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":127744,"kb_used_data":12288,"kb_used_omap":0,"kb_used_meta":115392,"kb_avail":754846976,"statfs":{"total":773094113280,"available":772963303424,"internally_reserved":0,"allocated":12582912,"data_stored":5862108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":118161408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-47032,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.145857"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.211973+0000","last_change":"2023-07-27T14:33:35.207832+0000","last_active":"2023-07-27T14:33:35.211973+0000","last_peered":"2023-07-27T14:33:35.211973+0000","last_clean":"2023-07-27T14:33:35.211973+0000","last_became_active":"2023-07-27T14:33:35.207342+0000","last_became_peered":"2023-07-27T14:33:35.207342+0000","last_unstale":"2023-07-27T14:33:35.211973+0000","last_undegraded":"2023-07-27T14:33:35.211973+0000","last_fullsized":"2023-07-27T14:33:35.211973+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206150+0000","last_change":"2023-07-27T14:33:34.718942+0000","last_active":"2023-07-27T14:33:35.206150+0000","last_peered":"2023-07-27T14:33:35.206150+0000","last_clean":"2023-07-27T14:33:35.206150+0000","last_became_active":"2023-07-27T14:33:34.718483+0000","last_became_peered":"2023-07-27T14:33:34.718483+0000","last_unstale":"2023-07-27T14:33:35.206150+0000","last_undegraded":"2023-07-27T14:33:35.206150+0000","last_fullsized":"2023-07-27T14:33:35.206150+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.207662+0000","last_change":"2023-07-27T14:33:35.201273+0000","last_active":"2023-07-27T14:33:35.207662+0000","last_peered":"2023-07-27T14:33:35.207662+0000","last_clean":"2023-07-27T14:33:35.207662+0000","last_became_active":"2023-07-27T14:33:35.199961+0000","last_became_peered":"2023-07-27T14:33:35.199961+0000","last_unstale":"2023-07-27T14:33:35.207662+0000","last_undegraded":"2023-07-27T14:33:35.207662+0000","last_fullsized":"2023-07-27T14:33:35.207662+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.192116+0000","last_change":"2023-07-27T14:33:34.726891+0000","last_active":"2023-07-27T14:33:35.192116+0000","last_peered":"2023-07-27T14:33:35.192116+0000","last_clean":"2023-07-27T14:33:35.192116+0000","last_became_active":"2023-07-27T14:33:34.726388+0000","last_became_peered":"2023-07-27T14:33:34.726388+0000","last_unstale":"2023-07-27T14:33:35.192116+0000","last_undegraded":"2023-07-27T14:33:35.192116+0000","last_fullsized":"2023-07-27T14:33:35.192116+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.214019+0000","last_change":"2023-07-27T14:33:35.212658+0000","last_active":"2023-07-27T14:33:35.214019+0000","last_peered":"2023-07-27T14:33:35.214019+0000","last_clean":"2023-07-27T14:33:35.214019+0000","last_became_active":"2023-07-27T14:33:35.212377+0000","last_became_peered":"2023-07-27T14:33:35.212377+0000","last_unstale":"2023-07-27T14:33:35.214019+0000","last_undegraded":"2023-07-27T14:33:35.214019+0000","last_fullsized":"2023-07-27T14:33:35.214019+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206021+0000","last_change":"2023-07-27T14:33:34.725414+0000","last_active":"2023-07-27T14:33:35.206021+0000","last_peered":"2023-07-27T14:33:35.206021+0000","last_clean":"2023-07-27T14:33:35.206021+0000","last_became_active":"2023-07-27T14:33:34.725121+0000","last_became_peered":"2023-07-27T14:33:34.725121+0000","last_unstale":"2023-07-27T14:33:35.206021+0000","last_undegraded":"2023-07-27T14:33:35.206021+0000","last_fullsized":"2023-07-27T14:33:35.206021+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206461+0000","last_change":"2023-07-27T14:33:35.203008+0000","last_active":"2023-07-27T14:33:35.206461+0000","last_peered":"2023-07-27T14:33:35.206461+0000","last_clean":"2023-07-27T14:33:35.206461+0000","last_became_active":"2023-07-27T14:33:35.202715+0000","last_became_peered":"2023-07-27T14:33:35.202715+0000","last_unstale":"2023-07-27T14:33:35.206461+0000","last_undegraded":"2023-07-27T14:33:35.206461+0000","last_fullsized":"2023-07-27T14:33:35.206461+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.210637+0000","last_change":"2023-07-27T14:33:34.727097+0000","last_active":"2023-07-27T14:33:35.210637+0000","last_peered":"2023-07-27T14:33:35.210637+0000","last_clean":"2023-07-27T14:33:35.210637+0000","last_became_active":"2023-07-27T14:33:34.723035+0000","last_became_peered":"2023-07-27T14:33:34.723035+0000","last_unstale":"2023-07-27T14:33:35.210637+0000","last_undegraded":"2023-07-27T14:33:35.210637+0000","last_fullsized":"2023-07-27T14:33:35.210637+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.197054+0000","last_change":"2023-07-27T14:33:35.193970+0000","last_active":"2023-07-27T14:33:35.197054+0000","last_peered":"2023-07-27T14:33:35.197054+0000","last_clean":"2023-07-27T14:33:35.197054+0000","last_became_active":"2023-07-27T14:33:35.193710+0000","last_became_peered":"2023-07-27T14:33:35.193710+0000","last_unstale":"2023-07-27T14:33:35.197054+0000","last_undegraded":"2023-07-27T14:33:35.197054+0000","last_fullsized":"2023-07-27T14:33:35.197054+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.212031+0000","last_change":"2023-07-27T14:33:34.725616+0000","last_active":"2023-07-27T14:33:35.212031+0000","last_peered":"2023-07-27T14:33:35.212031+0000","last_clean":"2023-07-27T14:33:35.212031+0000","last_became_active":"2023-07-27T14:33:34.723120+0000","last_became_peered":"2023-07-27T14:33:34.723120+0000","last_unstale":"2023-07-27T14:33:35.212031+0000","last_undegraded":"2023-07-27T14:33:35.212031+0000","last_fullsized":"2023-07-27T14:33:35.212031+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.212403+0000","last_change":"2023-07-27T14:33:35.210756+0000","last_active":"2023-07-27T14:33:35.212403+0000","last_peered":"2023-07-27T14:33:35.212403+0000","last_clean":"2023-07-27T14:33:35.212403+0000","last_became_active":"2023-07-27T14:33:35.210417+0000","last_became_peered":"2023-07-27T14:33:35.210417+0000","last_unstale":"2023-07-27T14:33:35.212403+0000","last_undegraded":"2023-07-27T14:33:35.212403+0000","last_fullsized":"2023-07-27T14:33:35.212403+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.195949+0000","last_change":"2023-07-27T14:33:34.731274+0000","last_active":"2023-07-27T14:33:35.195949+0000","last_peered":"2023-07-27T14:33:35.195949+0000","last_clean":"2023-07-27T14:33:35.195949+0000","last_became_active":"2023-07-27T14:33:34.730985+0000","last_became_peered":"2023-07-27T14:33:34.730985+0000","last_unstale":"2023-07-27T14:33:35.195949+0000","last_undegraded":"2023-07-27T14:33:35.195949+0000","last_fullsized":"2023-07-27T14:33:35.195949+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.202625+0000","last_change":"2023-07-27T14:33:35.198761+0000","last_active":"2023-07-27T14:33:35.202625+0000","last_peered":"2023-07-27T14:33:35.202625+0000","last_clean":"2023-07-27T14:33:35.202625+0000","last_became_active":"2023-07-27T14:33:35.198440+0000","last_became_peered":"2023-07-27T14:33:35.198440+0000","last_unstale":"2023-07-27T14:33:35.202625+0000","last_undegraded":"2023-07-27T14:33:35.202625+0000","last_fullsized":"2023-07-27T14:33:35.202625+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184842+0000","last_change":"2023-07-27T14:33:34.717950+0000","last_active":"2023-07-27T14:33:35.184842+0000","last_peered":"2023-07-27T14:33:35.184842+0000","last_clean":"2023-07-27T14:33:35.184842+0000","last_became_active":"2023-07-27T14:33:34.717641+0000","last_became_peered":"2023-07-27T14:33:34.717641+0000","last_unstale":"2023-07-27T14:33:35.184842+0000","last_undegraded":"2023-07-27T14:33:35.184842+0000","last_fullsized":"2023-07-27T14:33:35.184842+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.207480+0000","last_change":"2023-07-27T14:33:35.200350+0000","last_active":"2023-07-27T14:33:35.207480+0000","last_peered":"2023-07-27T14:33:35.207480+0000","last_clean":"2023-07-27T14:33:35.207480+0000","last_became_active":"2023-07-27T14:33:35.200066+0000","last_became_peered":"2023-07-27T14:33:35.200066+0000","last_unstale":"2023-07-27T14:33:35.207480+0000","last_undegraded":"2023-07-27T14:33:35.207480+0000","last_fullsized":"2023-07-27T14:33:35.207480+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.198668+0000","last_change":"2023-07-27T14:33:34.720297+0000","last_active":"2023-07-27T14:33:35.198668+0000","last_peered":"2023-07-27T14:33:35.198668+0000","last_clean":"2023-07-27T14:33:35.198668+0000","last_became_active":"2023-07-27T14:33:34.720039+0000","last_became_peered":"2023-07-27T14:33:34.720039+0000","last_unstale":"2023-07-27T14:33:35.198668+0000","last_undegraded":"2023-07-27T14:33:35.198668+0000","last_fullsized":"2023-07-27T14:33:35.198668+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206576+0000","last_change":"2023-07-27T14:33:35.205039+0000","last_active":"2023-07-27T14:33:35.206576+0000","last_peered":"2023-07-27T14:33:35.206576+0000","last_clean":"2023-07-27T14:33:35.206576+0000","last_became_active":"2023-07-27T14:33:35.204759+0000","last_became_peered":"2023-07-27T14:33:35.204759+0000","last_unstale":"2023-07-27T14:33:35.206576+0000","last_undegraded":"2023-07-27T14:33:35.206576+0000","last_fullsized":"2023-07-27T14:33:35.206576+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184874+0000","last_change":"2023-07-27T14:33:34.729808+0000","last_active":"2023-07-27T14:33:35.184874+0000","last_peered":"2023-07-27T14:33:35.184874+0000","last_clean":"2023-07-27T14:33:35.184874+0000","last_became_active":"2023-07-27T14:33:34.729495+0000","last_became_peered":"2023-07-27T14:33:34.729495+0000","last_unstale":"2023-07-27T14:33:35.184874+0000","last_undegraded":"2023-07-27T14:33:35.184874+0000","last_fullsized":"2023-07-27T14:33:35.184874+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.207834+0000","last_change":"2023-07-27T14:33:35.205182+0000","last_active":"2023-07-27T14:33:35.207834+0000","last_peered":"2023-07-27T14:33:35.207834+0000","last_clean":"2023-07-27T14:33:35.207834+0000","last_became_active":"2023-07-27T14:33:35.204772+0000","last_became_peered":"2023-07-27T14:33:35.204772+0000","last_unstale":"2023-07-27T14:33:35.207834+0000","last_undegraded":"2023-07-27T14:33:35.207834+0000","last_fullsized":"2023-07-27T14:33:35.207834+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.186778+0000","last_change":"2023-07-27T14:33:34.712662+0000","last_active":"2023-07-27T14:33:35.186778+0000","last_peered":"2023-07-27T14:33:35.186778+0000","last_clean":"2023-07-27T14:33:35.186778+0000","last_became_active":"2023-07-27T14:33:34.712292+0000","last_became_peered":"2023-07-27T14:33:34.712292+0000","last_unstale":"2023-07-27T14:33:35.186778+0000","last_undegraded":"2023-07-27T14:33:35.186778+0000","last_fullsized":"2023-07-27T14:33:35.186778+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.203908+0000","last_change":"2023-07-27T14:33:35.200899+0000","last_active":"2023-07-27T14:33:35.203908+0000","last_peered":"2023-07-27T14:33:35.203908+0000","last_clean":"2023-07-27T14:33:35.203908+0000","last_became_active":"2023-07-27T14:33:35.200626+0000","last_became_peered":"2023-07-27T14:33:35.200626+0000","last_unstale":"2023-07-27T14:33:35.203908+0000","last_undegraded":"2023-07-27T14:33:35.203908+0000","last_fullsized":"2023-07-27T14:33:35.203908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.191881+0000","last_change":"2023-07-27T14:33:34.727138+0000","last_active":"2023-07-27T14:33:35.191881+0000","last_peered":"2023-07-27T14:33:35.191881+0000","last_clean":"2023-07-27T14:33:35.191881+0000","last_became_active":"2023-07-27T14:33:34.726531+0000","last_became_peered":"2023-07-27T14:33:34.726531+0000","last_unstale":"2023-07-27T14:33:35.191881+0000","last_undegraded":"2023-07-27T14:33:35.191881+0000","last_fullsized":"2023-07-27T14:33:35.191881+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.213990+0000","last_change":"2023-07-27T14:33:35.212810+0000","last_active":"2023-07-27T14:33:35.213990+0000","last_peered":"2023-07-27T14:33:35.213990+0000","last_clean":"2023-07-27T14:33:35.213990+0000","last_became_active":"2023-07-27T14:33:35.212478+0000","last_became_peered":"2023-07-27T14:33:35.212478+0000","last_unstale":"2023-07-27T14:33:35.213990+0000","last_undegraded":"2023-07-27T14:33:35.213990+0000","last_fullsized":"2023-07-27T14:33:35.213990+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.214728+0000","last_change":"2023-07-27T14:33:34.722743+0000","last_active":"2023-07-27T14:33:35.214728+0000","last_peered":"2023-07-27T14:33:35.214728+0000","last_clean":"2023-07-27T14:33:35.214728+0000","last_became_active":"2023-07-27T14:33:34.719803+0000","last_became_peered":"2023-07-27T14:33:34.719803+0000","last_unstale":"2023-07-27T14:33:35.214728+0000","last_undegraded":"2023-07-27T14:33:35.214728+0000","last_fullsized":"2023-07-27T14:33:35.214728+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206559+0000","last_change":"2023-07-27T14:33:35.204872+0000","last_active":"2023-07-27T14:33:35.206559+0000","last_peered":"2023-07-27T14:33:35.206559+0000","last_clean":"2023-07-27T14:33:35.206559+0000","last_became_active":"2023-07-27T14:33:35.204584+0000","last_became_peered":"2023-07-27T14:33:35.204584+0000","last_unstale":"2023-07-27T14:33:35.206559+0000","last_undegraded":"2023-07-27T14:33:35.206559+0000","last_fullsized":"2023-07-27T14:33:35.206559+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.211052+0000","last_change":"2023-07-27T14:33:34.713430+0000","last_active":"2023-07-27T14:33:35.211052+0000","last_peered":"2023-07-27T14:33:35.211052+0000","last_clean":"2023-07-27T14:33:35.211052+0000","last_became_active":"2023-07-27T14:33:34.713074+0000","last_became_peered":"2023-07-27T14:33:34.713074+0000","last_unstale":"2023-07-27T14:33:35.211052+0000","last_undegraded":"2023-07-27T14:33:35.211052+0000","last_fullsized":"2023-07-27T14:33:35.211052+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.208248+0000","last_change":"2023-07-27T14:33:35.203881+0000","last_active":"2023-07-27T14:33:35.208248+0000","last_peered":"2023-07-27T14:33:35.208248+0000","last_clean":"2023-07-27T14:33:35.208248+0000","last_became_active":"2023-07-27T14:33:35.203593+0000","last_became_peered":"2023-07-27T14:33:35.203593+0000","last_unstale":"2023-07-27T14:33:35.208248+0000","last_undegraded":"2023-07-27T14:33:35.208248+0000","last_fullsized":"2023-07-27T14:33:35.208248+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.200115+0000","last_change":"2023-07-27T14:33:34.721427+0000","last_active":"2023-07-27T14:33:35.200115+0000","last_peered":"2023-07-27T14:33:35.200115+0000","last_clean":"2023-07-27T14:33:35.200115+0000","last_became_active":"2023-07-27T14:33:34.721111+0000","last_became_peered":"2023-07-27T14:33:34.721111+0000","last_unstale":"2023-07-27T14:33:35.200115+0000","last_undegraded":"2023-07-27T14:33:35.200115+0000","last_fullsized":"2023-07-27T14:33:35.200115+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.197044+0000","last_change":"2023-07-27T14:33:35.194488+0000","last_active":"2023-07-27T14:33:35.197044+0000","last_peered":"2023-07-27T14:33:35.197044+0000","last_clean":"2023-07-27T14:33:35.197044+0000","last_became_active":"2023-07-27T14:33:35.193824+0000","last_became_peered":"2023-07-27T14:33:35.193824+0000","last_unstale":"2023-07-27T14:33:35.197044+0000","last_undegraded":"2023-07-27T14:33:35.197044+0000","last_fullsized":"2023-07-27T14:33:35.197044+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184877+0000","last_change":"2023-07-27T14:33:34.726889+0000","last_active":"2023-07-27T14:33:35.184877+0000","last_peered":"2023-07-27T14:33:35.184877+0000","last_clean":"2023-07-27T14:33:35.184877+0000","last_became_active":"2023-07-27T14:33:34.726590+0000","last_became_peered":"2023-07-27T14:33:34.726590+0000","last_unstale":"2023-07-27T14:33:35.184877+0000","last_undegraded":"2023-07-27T14:33:35.184877+0000","last_fullsized":"2023-07-27T14:33:35.184877+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.199525+0000","last_change":"2023-07-27T14:33:35.197444+0000","last_active":"2023-07-27T14:33:35.199525+0000","last_peered":"2023-07-27T14:33:35.199525+0000","last_clean":"2023-07-27T14:33:35.199525+0000","last_became_active":"2023-07-27T14:33:35.197131+0000","last_became_peered":"2023-07-27T14:33:35.197131+0000","last_unstale":"2023-07-27T14:33:35.199525+0000","last_undegraded":"2023-07-27T14:33:35.199525+0000","last_fullsized":"2023-07-27T14:33:35.199525+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.204153+0000","last_change":"2023-07-27T14:33:34.726674+0000","last_active":"2023-07-27T14:33:35.204153+0000","last_peered":"2023-07-27T14:33:35.204153+0000","last_clean":"2023-07-27T14:33:35.204153+0000","last_became_active":"2023-07-27T14:33:34.726425+0000","last_became_peered":"2023-07-27T14:33:34.726425+0000","last_unstale":"2023-07-27T14:33:35.204153+0000","last_undegraded":"2023-07-27T14:33:35.204153+0000","last_fullsized":"2023-07-27T14:33:35.204153+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.209535+0000","last_change":"2023-07-27T14:33:35.200835+0000","last_active":"2023-07-27T14:33:35.209535+0000","last_peered":"2023-07-27T14:33:35.209535+0000","last_clean":"2023-07-27T14:33:35.209535+0000","last_became_active":"2023-07-27T14:33:35.200549+0000","last_became_peered":"2023-07-27T14:33:35.200549+0000","last_unstale":"2023-07-27T14:33:35.209535+0000","last_undegraded":"2023-07-27T14:33:35.209535+0000","last_fullsized":"2023-07-27T14:33:35.209535+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.193810+0000","last_change":"2023-07-27T14:33:34.728826+0000","last_active":"2023-07-27T14:33:35.193810+0000","last_peered":"2023-07-27T14:33:35.193810+0000","last_clean":"2023-07-27T14:33:35.193810+0000","last_became_active":"2023-07-27T14:33:34.728510+0000","last_became_peered":"2023-07-27T14:33:34.728510+0000","last_unstale":"2023-07-27T14:33:35.193810+0000","last_undegraded":"2023-07-27T14:33:35.193810+0000","last_fullsized":"2023-07-27T14:33:35.193810+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.207239+0000","last_change":"2023-07-27T14:33:35.205382+0000","last_active":"2023-07-27T14:33:35.207239+0000","last_peered":"2023-07-27T14:33:35.207239+0000","last_clean":"2023-07-27T14:33:35.207239+0000","last_became_active":"2023-07-27T14:33:35.204838+0000","last_became_peered":"2023-07-27T14:33:35.204838+0000","last_unstale":"2023-07-27T14:33:35.207239+0000","last_undegraded":"2023-07-27T14:33:35.207239+0000","last_fullsized":"2023-07-27T14:33:35.207239+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.185332+0000","last_change":"2023-07-27T14:33:34.722163+0000","last_active":"2023-07-27T14:33:35.185332+0000","last_peered":"2023-07-27T14:33:35.185332+0000","last_clean":"2023-07-27T14:33:35.185332+0000","last_became_active":"2023-07-27T14:33:34.720851+0000","last_became_peered":"2023-07-27T14:33:34.720851+0000","last_unstale":"2023-07-27T14:33:35.185332+0000","last_undegraded":"2023-07-27T14:33:35.185332+0000","last_fullsized":"2023-07-27T14:33:35.185332+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.210846+0000","last_change":"2023-07-27T14:33:35.207875+0000","last_active":"2023-07-27T14:33:35.210846+0000","last_peered":"2023-07-27T14:33:35.210846+0000","last_clean":"2023-07-27T14:33:35.210846+0000","last_became_active":"2023-07-27T14:33:35.207595+0000","last_became_peered":"2023-07-27T14:33:35.207595+0000","last_unstale":"2023-07-27T14:33:35.210846+0000","last_undegraded":"2023-07-27T14:33:35.210846+0000","last_fullsized":"2023-07-27T14:33:35.210846+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.213192+0000","last_change":"2023-07-27T14:33:34.714314+0000","last_active":"2023-07-27T14:33:35.213192+0000","last_peered":"2023-07-27T14:33:35.213192+0000","last_clean":"2023-07-27T14:33:35.213192+0000","last_became_active":"2023-07-27T14:33:34.713592+0000","last_became_peered":"2023-07-27T14:33:34.713592+0000","last_unstale":"2023-07-27T14:33:35.213192+0000","last_undegraded":"2023-07-27T14:33:35.213192+0000","last_fullsized":"2023-07-27T14:33:35.213192+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.200353+0000","last_change":"2023-07-27T14:33:35.197970+0000","last_active":"2023-07-27T14:33:35.200353+0000","last_peered":"2023-07-27T14:33:35.200353+0000","last_clean":"2023-07-27T14:33:35.200353+0000","last_became_active":"2023-07-27T14:33:35.197312+0000","last_became_peered":"2023-07-27T14:33:35.197312+0000","last_unstale":"2023-07-27T14:33:35.200353+0000","last_undegraded":"2023-07-27T14:33:35.200353+0000","last_fullsized":"2023-07-27T14:33:35.200353+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.193510+0000","last_change":"2023-07-27T14:33:34.718535+0000","last_active":"2023-07-27T14:33:35.193510+0000","last_peered":"2023-07-27T14:33:35.193510+0000","last_clean":"2023-07-27T14:33:35.193510+0000","last_became_active":"2023-07-27T14:33:34.718168+0000","last_became_peered":"2023-07-27T14:33:34.718168+0000","last_unstale":"2023-07-27T14:33:35.193510+0000","last_undegraded":"2023-07-27T14:33:35.193510+0000","last_fullsized":"2023-07-27T14:33:35.193510+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.202568+0000","last_change":"2023-07-27T14:33:35.197875+0000","last_active":"2023-07-27T14:33:35.202568+0000","last_peered":"2023-07-27T14:33:35.202568+0000","last_clean":"2023-07-27T14:33:35.202568+0000","last_became_active":"2023-07-27T14:33:35.197324+0000","last_became_peered":"2023-07-27T14:33:35.197324+0000","last_unstale":"2023-07-27T14:33:35.202568+0000","last_undegraded":"2023-07-27T14:33:35.202568+0000","last_fullsized":"2023-07-27T14:33:35.202568+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.197846+0000","last_change":"2023-07-27T14:33:34.728589+0000","last_active":"2023-07-27T14:33:35.197846+0000","last_peered":"2023-07-27T14:33:35.197846+0000","last_clean":"2023-07-27T14:33:35.197846+0000","last_became_active":"2023-07-27T14:33:34.728322+0000","last_became_peered":"2023-07-27T14:33:34.728322+0000","last_unstale":"2023-07-27T14:33:35.197846+0000","last_undegraded":"2023-07-27T14:33:35.197846+0000","last_fullsized":"2023-07-27T14:33:35.197846+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.213925+0000","last_change":"2023-07-27T14:33:35.212776+0000","last_active":"2023-07-27T14:33:35.213925+0000","last_peered":"2023-07-27T14:33:35.213925+0000","last_clean":"2023-07-27T14:33:35.213925+0000","last_became_active":"2023-07-27T14:33:35.212459+0000","last_became_peered":"2023-07-27T14:33:35.212459+0000","last_unstale":"2023-07-27T14:33:35.213925+0000","last_undegraded":"2023-07-27T14:33:35.213925+0000","last_fullsized":"2023-07-27T14:33:35.213925+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.181958+0000","last_change":"2023-07-27T14:33:34.720084+0000","last_active":"2023-07-27T14:33:35.181958+0000","last_peered":"2023-07-27T14:33:35.181958+0000","last_clean":"2023-07-27T14:33:35.181958+0000","last_became_active":"2023-07-27T14:33:34.718612+0000","last_became_peered":"2023-07-27T14:33:34.718612+0000","last_unstale":"2023-07-27T14:33:35.181958+0000","last_undegraded":"2023-07-27T14:33:35.181958+0000","last_fullsized":"2023-07-27T14:33:35.181958+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.201170+0000","last_change":"2023-07-27T14:33:35.198815+0000","last_active":"2023-07-27T14:33:35.201170+0000","last_peered":"2023-07-27T14:33:35.201170+0000","last_clean":"2023-07-27T14:33:35.201170+0000","last_became_active":"2023-07-27T14:33:35.198279+0000","last_became_peered":"2023-07-27T14:33:35.198279+0000","last_unstale":"2023-07-27T14:33:35.201170+0000","last_undegraded":"2023-07-27T14:33:35.201170+0000","last_fullsized":"2023-07-27T14:33:35.201170+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.193928+0000","last_change":"2023-07-27T14:33:34.719638+0000","last_active":"2023-07-27T14:33:35.193928+0000","last_peered":"2023-07-27T14:33:35.193928+0000","last_clean":"2023-07-27T14:33:35.193928+0000","last_became_active":"2023-07-27T14:33:34.719330+0000","last_became_peered":"2023-07-27T14:33:34.719330+0000","last_unstale":"2023-07-27T14:33:35.193928+0000","last_undegraded":"2023-07-27T14:33:35.193928+0000","last_fullsized":"2023-07-27T14:33:35.193928+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.212460+0000","last_change":"2023-07-27T14:33:35.210845+0000","last_active":"2023-07-27T14:33:35.212460+0000","last_peered":"2023-07-27T14:33:35.212460+0000","last_clean":"2023-07-27T14:33:35.212460+0000","last_became_active":"2023-07-27T14:33:35.210412+0000","last_became_peered":"2023-07-27T14:33:35.210412+0000","last_unstale":"2023-07-27T14:33:35.212460+0000","last_undegraded":"2023-07-27T14:33:35.212460+0000","last_fullsized":"2023-07-27T14:33:35.212460+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.179327+0000","last_change":"2023-07-27T14:33:34.724745+0000","last_active":"2023-07-27T14:33:35.179327+0000","last_peered":"2023-07-27T14:33:35.179327+0000","last_clean":"2023-07-27T14:33:35.179327+0000","last_became_active":"2023-07-27T14:33:34.724397+0000","last_became_peered":"2023-07-27T14:33:34.724397+0000","last_unstale":"2023-07-27T14:33:35.179327+0000","last_undegraded":"2023-07-27T14:33:35.179327+0000","last_fullsized":"2023-07-27T14:33:35.179327+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.204514+0000","last_change":"2023-07-27T14:33:35.199015+0000","last_active":"2023-07-27T14:33:35.204514+0000","last_peered":"2023-07-27T14:33:35.204514+0000","last_clean":"2023-07-27T14:33:35.204514+0000","last_became_active":"2023-07-27T14:33:35.198682+0000","last_became_peered":"2023-07-27T14:33:35.198682+0000","last_unstale":"2023-07-27T14:33:35.204514+0000","last_undegraded":"2023-07-27T14:33:35.204514+0000","last_fullsized":"2023-07-27T14:33:35.204514+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.193910+0000","last_change":"2023-07-27T14:33:34.727867+0000","last_active":"2023-07-27T14:33:35.193910+0000","last_peered":"2023-07-27T14:33:35.193910+0000","last_clean":"2023-07-27T14:33:35.193910+0000","last_became_active":"2023-07-27T14:33:34.726137+0000","last_became_peered":"2023-07-27T14:33:34.726137+0000","last_unstale":"2023-07-27T14:33:35.193910+0000","last_undegraded":"2023-07-27T14:33:35.193910+0000","last_fullsized":"2023-07-27T14:33:35.193910+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.207261+0000","last_change":"2023-07-27T14:33:35.205505+0000","last_active":"2023-07-27T14:33:35.207261+0000","last_peered":"2023-07-27T14:33:35.207261+0000","last_clean":"2023-07-27T14:33:35.207261+0000","last_became_active":"2023-07-27T14:33:35.205176+0000","last_became_peered":"2023-07-27T14:33:35.205176+0000","last_unstale":"2023-07-27T14:33:35.207261+0000","last_undegraded":"2023-07-27T14:33:35.207261+0000","last_fullsized":"2023-07-27T14:33:35.207261+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.186865+0000","last_change":"2023-07-27T14:33:34.730411+0000","last_active":"2023-07-27T14:33:35.186865+0000","last_peered":"2023-07-27T14:33:35.186865+0000","last_clean":"2023-07-27T14:33:35.186865+0000","last_became_active":"2023-07-27T14:33:34.730103+0000","last_became_peered":"2023-07-27T14:33:34.730103+0000","last_unstale":"2023-07-27T14:33:35.186865+0000","last_undegraded":"2023-07-27T14:33:35.186865+0000","last_fullsized":"2023-07-27T14:33:35.186865+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.211176+0000","last_change":"2023-07-27T14:33:35.204762+0000","last_active":"2023-07-27T14:33:35.211176+0000","last_peered":"2023-07-27T14:33:35.211176+0000","last_clean":"2023-07-27T14:33:35.211176+0000","last_became_active":"2023-07-27T14:33:35.204533+0000","last_became_peered":"2023-07-27T14:33:35.204533+0000","last_unstale":"2023-07-27T14:33:35.211176+0000","last_undegraded":"2023-07-27T14:33:35.211176+0000","last_fullsized":"2023-07-27T14:33:35.211176+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.185923+0000","last_change":"2023-07-27T14:33:34.718863+0000","last_active":"2023-07-27T14:33:35.185923+0000","last_peered":"2023-07-27T14:33:35.185923+0000","last_clean":"2023-07-27T14:33:35.185923+0000","last_became_active":"2023-07-27T14:33:34.718606+0000","last_became_peered":"2023-07-27T14:33:34.718606+0000","last_unstale":"2023-07-27T14:33:35.185923+0000","last_undegraded":"2023-07-27T14:33:35.185923+0000","last_fullsized":"2023-07-27T14:33:35.185923+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.208025+0000","last_change":"2023-07-27T14:33:35.204340+0000","last_active":"2023-07-27T14:33:35.208025+0000","last_peered":"2023-07-27T14:33:35.208025+0000","last_clean":"2023-07-27T14:33:35.208025+0000","last_became_active":"2023-07-27T14:33:35.203760+0000","last_became_peered":"2023-07-27T14:33:35.203760+0000","last_unstale":"2023-07-27T14:33:35.208025+0000","last_undegraded":"2023-07-27T14:33:35.208025+0000","last_fullsized":"2023-07-27T14:33:35.208025+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.179772+0000","last_change":"2023-07-27T14:33:34.733842+0000","last_active":"2023-07-27T14:33:35.179772+0000","last_peered":"2023-07-27T14:33:35.179772+0000","last_clean":"2023-07-27T14:33:35.179772+0000","last_became_active":"2023-07-27T14:33:34.733538+0000","last_became_peered":"2023-07-27T14:33:34.733538+0000","last_unstale":"2023-07-27T14:33:35.179772+0000","last_undegraded":"2023-07-27T14:33:35.179772+0000","last_fullsized":"2023-07-27T14:33:35.179772+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.202513+0000","last_change":"2023-07-27T14:33:35.197671+0000","last_active":"2023-07-27T14:33:35.202513+0000","last_peered":"2023-07-27T14:33:35.202513+0000","last_clean":"2023-07-27T14:33:35.202513+0000","last_became_active":"2023-07-27T14:33:35.196971+0000","last_became_peered":"2023-07-27T14:33:35.196971+0000","last_unstale":"2023-07-27T14:33:35.202513+0000","last_undegraded":"2023-07-27T14:33:35.202513+0000","last_fullsized":"2023-07-27T14:33:35.202513+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.192649+0000","last_change":"2023-07-27T14:33:34.725396+0000","last_active":"2023-07-27T14:33:35.192649+0000","last_peered":"2023-07-27T14:33:35.192649+0000","last_clean":"2023-07-27T14:33:35.192649+0000","last_became_active":"2023-07-27T14:33:34.725115+0000","last_became_peered":"2023-07-27T14:33:34.725115+0000","last_unstale":"2023-07-27T14:33:35.192649+0000","last_undegraded":"2023-07-27T14:33:35.192649+0000","last_fullsized":"2023-07-27T14:33:35.192649+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.199255+0000","last_change":"2023-07-27T14:33:35.195439+0000","last_active":"2023-07-27T14:33:35.199255+0000","last_peered":"2023-07-27T14:33:35.199255+0000","last_clean":"2023-07-27T14:33:35.199255+0000","last_became_active":"2023-07-27T14:33:35.195152+0000","last_became_peered":"2023-07-27T14:33:35.195152+0000","last_unstale":"2023-07-27T14:33:35.199255+0000","last_undegraded":"2023-07-27T14:33:35.199255+0000","last_fullsized":"2023-07-27T14:33:35.199255+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184307+0000","last_change":"2023-07-27T14:33:34.726896+0000","last_active":"2023-07-27T14:33:35.184307+0000","last_peered":"2023-07-27T14:33:35.184307+0000","last_clean":"2023-07-27T14:33:35.184307+0000","last_became_active":"2023-07-27T14:33:34.723976+0000","last_became_peered":"2023-07-27T14:33:34.723976+0000","last_unstale":"2023-07-27T14:33:35.184307+0000","last_undegraded":"2023-07-27T14:33:35.184307+0000","last_fullsized":"2023-07-27T14:33:35.184307+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.201557+0000","last_change":"2023-07-27T14:33:35.197911+0000","last_active":"2023-07-27T14:33:35.201557+0000","last_peered":"2023-07-27T14:33:35.201557+0000","last_clean":"2023-07-27T14:33:35.201557+0000","last_became_active":"2023-07-27T14:33:35.197661+0000","last_became_peered":"2023-07-27T14:33:35.197661+0000","last_unstale":"2023-07-27T14:33:35.201557+0000","last_undegraded":"2023-07-27T14:33:35.201557+0000","last_fullsized":"2023-07-27T14:33:35.201557+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.186112+0000","last_change":"2023-07-27T14:33:34.725573+0000","last_active":"2023-07-27T14:33:35.186112+0000","last_peered":"2023-07-27T14:33:35.186112+0000","last_clean":"2023-07-27T14:33:35.186112+0000","last_became_active":"2023-07-27T14:33:34.725286+0000","last_became_peered":"2023-07-27T14:33:34.725286+0000","last_unstale":"2023-07-27T14:33:35.186112+0000","last_undegraded":"2023-07-27T14:33:35.186112+0000","last_fullsized":"2023-07-27T14:33:35.186112+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.209692+0000","last_change":"2023-07-27T14:33:35.203921+0000","last_active":"2023-07-27T14:33:35.209692+0000","last_peered":"2023-07-27T14:33:35.209692+0000","last_clean":"2023-07-27T14:33:35.209692+0000","last_became_active":"2023-07-27T14:33:35.203616+0000","last_became_peered":"2023-07-27T14:33:35.203616+0000","last_unstale":"2023-07-27T14:33:35.209692+0000","last_undegraded":"2023-07-27T14:33:35.209692+0000","last_fullsized":"2023-07-27T14:33:35.209692+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184263+0000","last_change":"2023-07-27T14:33:34.727533+0000","last_active":"2023-07-27T14:33:35.184263+0000","last_peered":"2023-07-27T14:33:35.184263+0000","last_clean":"2023-07-27T14:33:35.184263+0000","last_became_active":"2023-07-27T14:33:34.727263+0000","last_became_peered":"2023-07-27T14:33:34.727263+0000","last_unstale":"2023-07-27T14:33:35.184263+0000","last_undegraded":"2023-07-27T14:33:35.184263+0000","last_fullsized":"2023-07-27T14:33:35.184263+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.203847+0000","last_change":"2023-07-27T14:33:35.200296+0000","last_active":"2023-07-27T14:33:35.203847+0000","last_peered":"2023-07-27T14:33:35.203847+0000","last_clean":"2023-07-27T14:33:35.203847+0000","last_became_active":"2023-07-27T14:33:35.199925+0000","last_became_peered":"2023-07-27T14:33:35.199925+0000","last_unstale":"2023-07-27T14:33:35.203847+0000","last_undegraded":"2023-07-27T14:33:35.203847+0000","last_fullsized":"2023-07-27T14:33:35.203847+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.201918+0000","last_change":"2023-07-27T14:33:34.721572+0000","last_active":"2023-07-27T14:33:35.201918+0000","last_peered":"2023-07-27T14:33:35.201918+0000","last_clean":"2023-07-27T14:33:35.201918+0000","last_became_active":"2023-07-27T14:33:34.721220+0000","last_became_peered":"2023-07-27T14:33:34.721220+0000","last_unstale":"2023-07-27T14:33:35.201918+0000","last_undegraded":"2023-07-27T14:33:35.201918+0000","last_fullsized":"2023-07-27T14:33:35.201918+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.209663+0000","last_change":"2023-07-27T14:33:35.202538+0000","last_active":"2023-07-27T14:33:35.209663+0000","last_peered":"2023-07-27T14:33:35.209663+0000","last_clean":"2023-07-27T14:33:35.209663+0000","last_became_active":"2023-07-27T14:33:35.202254+0000","last_became_peered":"2023-07-27T14:33:35.202254+0000","last_unstale":"2023-07-27T14:33:35.209663+0000","last_undegraded":"2023-07-27T14:33:35.209663+0000","last_fullsized":"2023-07-27T14:33:35.209663+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.190799+0000","last_change":"2023-07-27T14:33:34.716562+0000","last_active":"2023-07-27T14:33:35.190799+0000","last_peered":"2023-07-27T14:33:35.190799+0000","last_clean":"2023-07-27T14:33:35.190799+0000","last_became_active":"2023-07-27T14:33:34.716243+0000","last_became_peered":"2023-07-27T14:33:34.716243+0000","last_unstale":"2023-07-27T14:33:35.190799+0000","last_undegraded":"2023-07-27T14:33:35.190799+0000","last_fullsized":"2023-07-27T14:33:35.190799+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.203563+0000","last_change":"2023-07-27T14:33:35.200261+0000","last_active":"2023-07-27T14:33:35.203563+0000","last_peered":"2023-07-27T14:33:35.203563+0000","last_clean":"2023-07-27T14:33:35.203563+0000","last_became_active":"2023-07-27T14:33:35.199911+0000","last_became_peered":"2023-07-27T14:33:35.199911+0000","last_unstale":"2023-07-27T14:33:35.203563+0000","last_undegraded":"2023-07-27T14:33:35.203563+0000","last_fullsized":"2023-07-27T14:33:35.203563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.213718+0000","last_change":"2023-07-27T14:33:34.713863+0000","last_active":"2023-07-27T14:33:35.213718+0000","last_peered":"2023-07-27T14:33:35.213718+0000","last_clean":"2023-07-27T14:33:35.213718+0000","last_became_active":"2023-07-27T14:33:34.713200+0000","last_became_peered":"2023-07-27T14:33:34.713200+0000","last_unstale":"2023-07-27T14:33:35.213718+0000","last_undegraded":"2023-07-27T14:33:35.213718+0000","last_fullsized":"2023-07-27T14:33:35.213718+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.214308+0000","last_change":"2023-07-27T14:33:35.213564+0000","last_active":"2023-07-27T14:33:35.214308+0000","last_peered":"2023-07-27T14:33:35.214308+0000","last_clean":"2023-07-27T14:33:35.214308+0000","last_became_active":"2023-07-27T14:33:35.213227+0000","last_became_peered":"2023-07-27T14:33:35.213227+0000","last_unstale":"2023-07-27T14:33:35.214308+0000","last_undegraded":"2023-07-27T14:33:35.214308+0000","last_fullsized":"2023-07-27T14:33:35.214308+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.186420+0000","last_change":"2023-07-27T14:33:34.727051+0000","last_active":"2023-07-27T14:33:35.186420+0000","last_peered":"2023-07-27T14:33:35.186420+0000","last_clean":"2023-07-27T14:33:35.186420+0000","last_became_active":"2023-07-27T14:33:34.726760+0000","last_became_peered":"2023-07-27T14:33:34.726760+0000","last_unstale":"2023-07-27T14:33:35.186420+0000","last_undegraded":"2023-07-27T14:33:35.186420+0000","last_fullsized":"2023-07-27T14:33:35.186420+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.196933+0000","last_change":"2023-07-27T14:33:35.190624+0000","last_active":"2023-07-27T14:33:35.196933+0000","last_peered":"2023-07-27T14:33:35.196933+0000","last_clean":"2023-07-27T14:33:35.196933+0000","last_became_active":"2023-07-27T14:33:35.190365+0000","last_became_peered":"2023-07-27T14:33:35.190365+0000","last_unstale":"2023-07-27T14:33:35.196933+0000","last_undegraded":"2023-07-27T14:33:35.196933+0000","last_fullsized":"2023-07-27T14:33:35.196933+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.192787+0000","last_change":"2023-07-27T14:33:34.728405+0000","last_active":"2023-07-27T14:33:35.192787+0000","last_peered":"2023-07-27T14:33:35.192787+0000","last_clean":"2023-07-27T14:33:35.192787+0000","last_became_active":"2023-07-27T14:33:34.728053+0000","last_became_peered":"2023-07-27T14:33:34.728053+0000","last_unstale":"2023-07-27T14:33:35.192787+0000","last_undegraded":"2023-07-27T14:33:35.192787+0000","last_fullsized":"2023-07-27T14:33:35.192787+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.209717+0000","last_change":"2023-07-27T14:33:35.208564+0000","last_active":"2023-07-27T14:33:35.209717+0000","last_peered":"2023-07-27T14:33:35.209717+0000","last_clean":"2023-07-27T14:33:35.209717+0000","last_became_active":"2023-07-27T14:33:35.208282+0000","last_became_peered":"2023-07-27T14:33:35.208282+0000","last_unstale":"2023-07-27T14:33:35.209717+0000","last_undegraded":"2023-07-27T14:33:35.209717+0000","last_fullsized":"2023-07-27T14:33:35.209717+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.183701+0000","last_change":"2023-07-27T14:33:34.729910+0000","last_active":"2023-07-27T14:33:35.183701+0000","last_peered":"2023-07-27T14:33:35.183701+0000","last_clean":"2023-07-27T14:33:35.183701+0000","last_became_active":"2023-07-27T14:33:34.729590+0000","last_became_peered":"2023-07-27T14:33:34.729590+0000","last_unstale":"2023-07-27T14:33:35.183701+0000","last_undegraded":"2023-07-27T14:33:35.183701+0000","last_fullsized":"2023-07-27T14:33:35.183701+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.197024+0000","last_change":"2023-07-27T14:33:35.192529+0000","last_active":"2023-07-27T14:33:35.197024+0000","last_peered":"2023-07-27T14:33:35.197024+0000","last_clean":"2023-07-27T14:33:35.197024+0000","last_became_active":"2023-07-27T14:33:35.192263+0000","last_became_peered":"2023-07-27T14:33:35.192263+0000","last_unstale":"2023-07-27T14:33:35.197024+0000","last_undegraded":"2023-07-27T14:33:35.197024+0000","last_fullsized":"2023-07-27T14:33:35.197024+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184933+0000","last_change":"2023-07-27T14:33:34.717564+0000","last_active":"2023-07-27T14:33:35.184933+0000","last_peered":"2023-07-27T14:33:35.184933+0000","last_clean":"2023-07-27T14:33:35.184933+0000","last_became_active":"2023-07-27T14:33:34.717081+0000","last_became_peered":"2023-07-27T14:33:34.717081+0000","last_unstale":"2023-07-27T14:33:35.184933+0000","last_undegraded":"2023-07-27T14:33:35.184933+0000","last_fullsized":"2023-07-27T14:33:35.184933+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.197398+0000","last_change":"2023-07-27T14:33:35.195133+0000","last_active":"2023-07-27T14:33:35.197398+0000","last_peered":"2023-07-27T14:33:35.197398+0000","last_clean":"2023-07-27T14:33:35.197398+0000","last_became_active":"2023-07-27T14:33:35.194876+0000","last_became_peered":"2023-07-27T14:33:35.194876+0000","last_unstale":"2023-07-27T14:33:35.197398+0000","last_undegraded":"2023-07-27T14:33:35.197398+0000","last_fullsized":"2023-07-27T14:33:35.197398+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184378+0000","last_change":"2023-07-27T14:33:34.728085+0000","last_active":"2023-07-27T14:33:35.184378+0000","last_peered":"2023-07-27T14:33:35.184378+0000","last_clean":"2023-07-27T14:33:35.184378+0000","last_became_active":"2023-07-27T14:33:34.727759+0000","last_became_peered":"2023-07-27T14:33:34.727759+0000","last_unstale":"2023-07-27T14:33:35.184378+0000","last_undegraded":"2023-07-27T14:33:35.184378+0000","last_fullsized":"2023-07-27T14:33:35.184378+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206283+0000","last_change":"2023-07-27T14:33:35.201888+0000","last_active":"2023-07-27T14:33:35.206283+0000","last_peered":"2023-07-27T14:33:35.206283+0000","last_clean":"2023-07-27T14:33:35.206283+0000","last_became_active":"2023-07-27T14:33:35.201492+0000","last_became_peered":"2023-07-27T14:33:35.201492+0000","last_unstale":"2023-07-27T14:33:35.206283+0000","last_undegraded":"2023-07-27T14:33:35.206283+0000","last_fullsized":"2023-07-27T14:33:35.206283+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.202681+0000","last_change":"2023-07-27T14:33:34.715073+0000","last_active":"2023-07-27T14:33:35.202681+0000","last_peered":"2023-07-27T14:33:35.202681+0000","last_clean":"2023-07-27T14:33:35.202681+0000","last_became_active":"2023-07-27T14:33:34.714768+0000","last_became_peered":"2023-07-27T14:33:34.714768+0000","last_unstale":"2023-07-27T14:33:35.202681+0000","last_undegraded":"2023-07-27T14:33:35.202681+0000","last_fullsized":"2023-07-27T14:33:35.202681+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.210778+0000","last_change":"2023-07-27T14:33:35.209296+0000","last_active":"2023-07-27T14:33:35.210778+0000","last_peered":"2023-07-27T14:33:35.210778+0000","last_clean":"2023-07-27T14:33:35.210778+0000","last_became_active":"2023-07-27T14:33:35.208978+0000","last_became_peered":"2023-07-27T14:33:35.208978+0000","last_unstale":"2023-07-27T14:33:35.210778+0000","last_undegraded":"2023-07-27T14:33:35.210778+0000","last_fullsized":"2023-07-27T14:33:35.210778+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.211901+0000","last_change":"2023-07-27T14:33:34.711931+0000","last_active":"2023-07-27T14:33:35.211901+0000","last_peered":"2023-07-27T14:33:35.211901+0000","last_clean":"2023-07-27T14:33:35.211901+0000","last_became_active":"2023-07-27T14:33:34.711639+0000","last_became_peered":"2023-07-27T14:33:34.711639+0000","last_unstale":"2023-07-27T14:33:35.211901+0000","last_undegraded":"2023-07-27T14:33:35.211901+0000","last_fullsized":"2023-07-27T14:33:35.211901+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.199585+0000","last_change":"2023-07-27T14:33:35.198548+0000","last_active":"2023-07-27T14:33:35.199585+0000","last_peered":"2023-07-27T14:33:35.199585+0000","last_clean":"2023-07-27T14:33:35.199585+0000","last_became_active":"2023-07-27T14:33:35.198235+0000","last_became_peered":"2023-07-27T14:33:35.198235+0000","last_unstale":"2023-07-27T14:33:35.199585+0000","last_undegraded":"2023-07-27T14:33:35.199585+0000","last_fullsized":"2023-07-27T14:33:35.199585+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206378+0000","last_change":"2023-07-27T14:33:34.722496+0000","last_active":"2023-07-27T14:33:35.206378+0000","last_peered":"2023-07-27T14:33:35.206378+0000","last_clean":"2023-07-27T14:33:35.206378+0000","last_became_active":"2023-07-27T14:33:34.722224+0000","last_became_peered":"2023-07-27T14:33:34.722224+0000","last_unstale":"2023-07-27T14:33:35.206378+0000","last_undegraded":"2023-07-27T14:33:35.206378+0000","last_fullsized":"2023-07-27T14:33:35.206378+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.210032+0000","last_change":"2023-07-27T14:33:35.208571+0000","last_active":"2023-07-27T14:33:35.210032+0000","last_peered":"2023-07-27T14:33:35.210032+0000","last_clean":"2023-07-27T14:33:35.210032+0000","last_became_active":"2023-07-27T14:33:35.208278+0000","last_became_peered":"2023-07-27T14:33:35.208278+0000","last_unstale":"2023-07-27T14:33:35.210032+0000","last_undegraded":"2023-07-27T14:33:35.210032+0000","last_fullsized":"2023-07-27T14:33:35.210032+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.200872+0000","last_change":"2023-07-27T14:33:34.732395+0000","last_active":"2023-07-27T14:33:35.200872+0000","last_peered":"2023-07-27T14:33:35.200872+0000","last_clean":"2023-07-27T14:33:35.200872+0000","last_became_active":"2023-07-27T14:33:34.732084+0000","last_became_peered":"2023-07-27T14:33:34.732084+0000","last_unstale":"2023-07-27T14:33:35.200872+0000","last_undegraded":"2023-07-27T14:33:35.200872+0000","last_fullsized":"2023-07-27T14:33:35.200872+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.199684+0000","last_change":"2023-07-27T14:33:35.198363+0000","last_active":"2023-07-27T14:33:35.199684+0000","last_peered":"2023-07-27T14:33:35.199684+0000","last_clean":"2023-07-27T14:33:35.199684+0000","last_became_active":"2023-07-27T14:33:35.198067+0000","last_became_peered":"2023-07-27T14:33:35.198067+0000","last_unstale":"2023-07-27T14:33:35.199684+0000","last_undegraded":"2023-07-27T14:33:35.199684+0000","last_fullsized":"2023-07-27T14:33:35.199684+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.205072+0000","last_change":"2023-07-27T14:33:34.726100+0000","last_active":"2023-07-27T14:33:35.205072+0000","last_peered":"2023-07-27T14:33:35.205072+0000","last_clean":"2023-07-27T14:33:35.205072+0000","last_became_active":"2023-07-27T14:33:34.725835+0000","last_became_peered":"2023-07-27T14:33:34.725835+0000","last_unstale":"2023-07-27T14:33:35.205072+0000","last_undegraded":"2023-07-27T14:33:35.205072+0000","last_fullsized":"2023-07-27T14:33:35.205072+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.196846+0000","last_change":"2023-07-27T14:33:35.192010+0000","last_active":"2023-07-27T14:33:35.196846+0000","last_peered":"2023-07-27T14:33:35.196846+0000","last_clean":"2023-07-27T14:33:35.196846+0000","last_became_active":"2023-07-27T14:33:35.191738+0000","last_became_peered":"2023-07-27T14:33:35.191738+0000","last_unstale":"2023-07-27T14:33:35.196846+0000","last_undegraded":"2023-07-27T14:33:35.196846+0000","last_fullsized":"2023-07-27T14:33:35.196846+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.200218+0000","last_change":"2023-07-27T14:33:34.721734+0000","last_active":"2023-07-27T14:33:35.200218+0000","last_peered":"2023-07-27T14:33:35.200218+0000","last_clean":"2023-07-27T14:33:35.200218+0000","last_became_active":"2023-07-27T14:33:34.720819+0000","last_became_peered":"2023-07-27T14:33:34.720819+0000","last_unstale":"2023-07-27T14:33:35.200218+0000","last_undegraded":"2023-07-27T14:33:35.200218+0000","last_fullsized":"2023-07-27T14:33:35.200218+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.197071+0000","last_change":"2023-07-27T14:33:35.194667+0000","last_active":"2023-07-27T14:33:35.197071+0000","last_peered":"2023-07-27T14:33:35.197071+0000","last_clean":"2023-07-27T14:33:35.197071+0000","last_became_active":"2023-07-27T14:33:35.194202+0000","last_became_peered":"2023-07-27T14:33:35.194202+0000","last_unstale":"2023-07-27T14:33:35.197071+0000","last_undegraded":"2023-07-27T14:33:35.197071+0000","last_fullsized":"2023-07-27T14:33:35.197071+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.180768+0000","last_change":"2023-07-27T14:33:34.725752+0000","last_active":"2023-07-27T14:33:35.180768+0000","last_peered":"2023-07-27T14:33:35.180768+0000","last_clean":"2023-07-27T14:33:35.180768+0000","last_became_active":"2023-07-27T14:33:34.725182+0000","last_became_peered":"2023-07-27T14:33:34.725182+0000","last_unstale":"2023-07-27T14:33:35.180768+0000","last_undegraded":"2023-07-27T14:33:35.180768+0000","last_fullsized":"2023-07-27T14:33:35.180768+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.200080+0000","last_change":"2023-07-27T14:33:35.196088+0000","last_active":"2023-07-27T14:33:35.200080+0000","last_peered":"2023-07-27T14:33:35.200080+0000","last_clean":"2023-07-27T14:33:35.200080+0000","last_became_active":"2023-07-27T14:33:35.195808+0000","last_became_peered":"2023-07-27T14:33:35.195808+0000","last_unstale":"2023-07-27T14:33:35.200080+0000","last_undegraded":"2023-07-27T14:33:35.200080+0000","last_fullsized":"2023-07-27T14:33:35.200080+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.198805+0000","last_change":"2023-07-27T14:33:34.712234+0000","last_active":"2023-07-27T14:33:35.198805+0000","last_peered":"2023-07-27T14:33:35.198805+0000","last_clean":"2023-07-27T14:33:35.198805+0000","last_became_active":"2023-07-27T14:33:34.711917+0000","last_became_peered":"2023-07-27T14:33:34.711917+0000","last_unstale":"2023-07-27T14:33:35.198805+0000","last_undegraded":"2023-07-27T14:33:35.198805+0000","last_fullsized":"2023-07-27T14:33:35.198805+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.204426+0000","last_change":"2023-07-27T14:33:35.199040+0000","last_active":"2023-07-27T14:33:35.204426+0000","last_peered":"2023-07-27T14:33:35.204426+0000","last_clean":"2023-07-27T14:33:35.204426+0000","last_became_active":"2023-07-27T14:33:35.198319+0000","last_became_peered":"2023-07-27T14:33:35.198319+0000","last_unstale":"2023-07-27T14:33:35.204426+0000","last_undegraded":"2023-07-27T14:33:35.204426+0000","last_fullsized":"2023-07-27T14:33:35.204426+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.211051+0000","last_change":"2023-07-27T14:33:34.724545+0000","last_active":"2023-07-27T14:33:35.211051+0000","last_peered":"2023-07-27T14:33:35.211051+0000","last_clean":"2023-07-27T14:33:35.211051+0000","last_became_active":"2023-07-27T14:33:34.723140+0000","last_became_peered":"2023-07-27T14:33:34.723140+0000","last_unstale":"2023-07-27T14:33:35.211051+0000","last_undegraded":"2023-07-27T14:33:35.211051+0000","last_fullsized":"2023-07-27T14:33:35.211051+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.197548+0000","last_change":"2023-07-27T14:33:35.195549+0000","last_active":"2023-07-27T14:33:35.197548+0000","last_peered":"2023-07-27T14:33:35.197548+0000","last_clean":"2023-07-27T14:33:35.197548+0000","last_became_active":"2023-07-27T14:33:35.195273+0000","last_became_peered":"2023-07-27T14:33:35.195273+0000","last_unstale":"2023-07-27T14:33:35.197548+0000","last_undegraded":"2023-07-27T14:33:35.197548+0000","last_fullsized":"2023-07-27T14:33:35.197548+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.185451+0000","last_change":"2023-07-27T14:33:34.725421+0000","last_active":"2023-07-27T14:33:35.185451+0000","last_peered":"2023-07-27T14:33:35.185451+0000","last_clean":"2023-07-27T14:33:35.185451+0000","last_became_active":"2023-07-27T14:33:34.724404+0000","last_became_peered":"2023-07-27T14:33:34.724404+0000","last_unstale":"2023-07-27T14:33:35.185451+0000","last_undegraded":"2023-07-27T14:33:35.185451+0000","last_fullsized":"2023-07-27T14:33:35.185451+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.213912+0000","last_change":"2023-07-27T14:33:35.212582+0000","last_active":"2023-07-27T14:33:35.213912+0000","last_peered":"2023-07-27T14:33:35.213912+0000","last_clean":"2023-07-27T14:33:35.213912+0000","last_became_active":"2023-07-27T14:33:35.212057+0000","last_became_peered":"2023-07-27T14:33:35.212057+0000","last_unstale":"2023-07-27T14:33:35.213912+0000","last_undegraded":"2023-07-27T14:33:35.213912+0000","last_fullsized":"2023-07-27T14:33:35.213912+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.186853+0000","last_change":"2023-07-27T14:33:34.723794+0000","last_active":"2023-07-27T14:33:35.186853+0000","last_peered":"2023-07-27T14:33:35.186853+0000","last_clean":"2023-07-27T14:33:35.186853+0000","last_became_active":"2023-07-27T14:33:34.723500+0000","last_became_peered":"2023-07-27T14:33:34.723500+0000","last_unstale":"2023-07-27T14:33:35.186853+0000","last_undegraded":"2023-07-27T14:33:35.186853+0000","last_fullsized":"2023-07-27T14:33:35.186853+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.205303+0000","last_change":"2023-07-27T14:33:35.198616+0000","last_active":"2023-07-27T14:33:35.205303+0000","last_peered":"2023-07-27T14:33:35.205303+0000","last_clean":"2023-07-27T14:33:35.205303+0000","last_became_active":"2023-07-27T14:33:35.198343+0000","last_became_peered":"2023-07-27T14:33:35.198343+0000","last_unstale":"2023-07-27T14:33:35.205303+0000","last_undegraded":"2023-07-27T14:33:35.205303+0000","last_fullsized":"2023-07-27T14:33:35.205303+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.185415+0000","last_change":"2023-07-27T14:33:34.728016+0000","last_active":"2023-07-27T14:33:35.185415+0000","last_peered":"2023-07-27T14:33:35.185415+0000","last_clean":"2023-07-27T14:33:35.185415+0000","last_became_active":"2023-07-27T14:33:34.727716+0000","last_became_peered":"2023-07-27T14:33:34.727716+0000","last_unstale":"2023-07-27T14:33:35.185415+0000","last_undegraded":"2023-07-27T14:33:35.185415+0000","last_fullsized":"2023-07-27T14:33:35.185415+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206539+0000","last_change":"2023-07-27T14:33:35.204003+0000","last_active":"2023-07-27T14:33:35.206539+0000","last_peered":"2023-07-27T14:33:35.206539+0000","last_clean":"2023-07-27T14:33:35.206539+0000","last_became_active":"2023-07-27T14:33:35.203704+0000","last_became_peered":"2023-07-27T14:33:35.203704+0000","last_unstale":"2023-07-27T14:33:35.206539+0000","last_undegraded":"2023-07-27T14:33:35.206539+0000","last_fullsized":"2023-07-27T14:33:35.206539+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.192950+0000","last_change":"2023-07-27T14:33:34.729166+0000","last_active":"2023-07-27T14:33:35.192950+0000","last_peered":"2023-07-27T14:33:35.192950+0000","last_clean":"2023-07-27T14:33:35.192950+0000","last_became_active":"2023-07-27T14:33:34.728883+0000","last_became_peered":"2023-07-27T14:33:34.728883+0000","last_unstale":"2023-07-27T14:33:35.192950+0000","last_undegraded":"2023-07-27T14:33:35.192950+0000","last_fullsized":"2023-07-27T14:33:35.192950+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.196865+0000","last_change":"2023-07-27T14:33:35.193513+0000","last_active":"2023-07-27T14:33:35.196865+0000","last_peered":"2023-07-27T14:33:35.196865+0000","last_clean":"2023-07-27T14:33:35.196865+0000","last_became_active":"2023-07-27T14:33:35.193216+0000","last_became_peered":"2023-07-27T14:33:35.193216+0000","last_unstale":"2023-07-27T14:33:35.196865+0000","last_undegraded":"2023-07-27T14:33:35.196865+0000","last_fullsized":"2023-07-27T14:33:35.196865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.192588+0000","last_change":"2023-07-27T14:33:34.724706+0000","last_active":"2023-07-27T14:33:35.192588+0000","last_peered":"2023-07-27T14:33:35.192588+0000","last_clean":"2023-07-27T14:33:35.192588+0000","last_became_active":"2023-07-27T14:33:34.724112+0000","last_became_peered":"2023-07-27T14:33:34.724112+0000","last_unstale":"2023-07-27T14:33:35.192588+0000","last_undegraded":"2023-07-27T14:33:35.192588+0000","last_fullsized":"2023-07-27T14:33:35.192588+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.212057+0000","last_change":"2023-07-27T14:33:35.208658+0000","last_active":"2023-07-27T14:33:35.212057+0000","last_peered":"2023-07-27T14:33:35.212057+0000","last_clean":"2023-07-27T14:33:35.212057+0000","last_became_active":"2023-07-27T14:33:35.208251+0000","last_became_peered":"2023-07-27T14:33:35.208251+0000","last_unstale":"2023-07-27T14:33:35.212057+0000","last_undegraded":"2023-07-27T14:33:35.212057+0000","last_fullsized":"2023-07-27T14:33:35.212057+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.186212+0000","last_change":"2023-07-27T14:33:34.729058+0000","last_active":"2023-07-27T14:33:35.186212+0000","last_peered":"2023-07-27T14:33:35.186212+0000","last_clean":"2023-07-27T14:33:35.186212+0000","last_became_active":"2023-07-27T14:33:34.728798+0000","last_became_peered":"2023-07-27T14:33:34.728798+0000","last_unstale":"2023-07-27T14:33:35.186212+0000","last_undegraded":"2023-07-27T14:33:35.186212+0000","last_fullsized":"2023-07-27T14:33:35.186212+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206311+0000","last_change":"2023-07-27T14:33:35.202818+0000","last_active":"2023-07-27T14:33:35.206311+0000","last_peered":"2023-07-27T14:33:35.206311+0000","last_clean":"2023-07-27T14:33:35.206311+0000","last_became_active":"2023-07-27T14:33:35.202514+0000","last_became_peered":"2023-07-27T14:33:35.202514+0000","last_unstale":"2023-07-27T14:33:35.206311+0000","last_undegraded":"2023-07-27T14:33:35.206311+0000","last_fullsized":"2023-07-27T14:33:35.206311+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.198932+0000","last_change":"2023-07-27T14:33:34.718572+0000","last_active":"2023-07-27T14:33:35.198932+0000","last_peered":"2023-07-27T14:33:35.198932+0000","last_clean":"2023-07-27T14:33:35.198932+0000","last_became_active":"2023-07-27T14:33:34.718284+0000","last_became_peered":"2023-07-27T14:33:34.718284+0000","last_unstale":"2023-07-27T14:33:35.198932+0000","last_undegraded":"2023-07-27T14:33:35.198932+0000","last_fullsized":"2023-07-27T14:33:35.198932+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.209611+0000","last_change":"2023-07-27T14:33:35.206934+0000","last_active":"2023-07-27T14:33:35.209611+0000","last_peered":"2023-07-27T14:33:35.209611+0000","last_clean":"2023-07-27T14:33:35.209611+0000","last_became_active":"2023-07-27T14:33:35.206529+0000","last_became_peered":"2023-07-27T14:33:35.206529+0000","last_unstale":"2023-07-27T14:33:35.209611+0000","last_undegraded":"2023-07-27T14:33:35.209611+0000","last_fullsized":"2023-07-27T14:33:35.209611+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.185637+0000","last_change":"2023-07-27T14:33:34.715466+0000","last_active":"2023-07-27T14:33:35.185637+0000","last_peered":"2023-07-27T14:33:35.185637+0000","last_clean":"2023-07-27T14:33:35.185637+0000","last_became_active":"2023-07-27T14:33:34.715193+0000","last_became_peered":"2023-07-27T14:33:34.715193+0000","last_unstale":"2023-07-27T14:33:35.185637+0000","last_undegraded":"2023-07-27T14:33:35.185637+0000","last_fullsized":"2023-07-27T14:33:35.185637+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.186428+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:33:35.186428+0000","last_peered":"2023-07-27T14:33:35.186428+0000","last_clean":"2023-07-27T14:33:35.186428+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:33:35.186428+0000","last_undegraded":"2023-07-27T14:33:35.186428+0000","last_fullsized":"2023-07-27T14:33:35.186428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.209585+0000","last_change":"2023-07-27T14:33:35.202257+0000","last_active":"2023-07-27T14:33:35.209585+0000","last_peered":"2023-07-27T14:33:35.209585+0000","last_clean":"2023-07-27T14:33:35.209585+0000","last_became_active":"2023-07-27T14:33:35.201998+0000","last_became_peered":"2023-07-27T14:33:35.201998+0000","last_unstale":"2023-07-27T14:33:35.209585+0000","last_undegraded":"2023-07-27T14:33:35.209585+0000","last_fullsized":"2023-07-27T14:33:35.209585+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.180884+0000","last_change":"2023-07-27T14:33:34.722785+0000","last_active":"2023-07-27T14:33:35.180884+0000","last_peered":"2023-07-27T14:33:35.180884+0000","last_clean":"2023-07-27T14:33:35.180884+0000","last_became_active":"2023-07-27T14:33:34.722495+0000","last_became_peered":"2023-07-27T14:33:34.722495+0000","last_unstale":"2023-07-27T14:33:35.180884+0000","last_undegraded":"2023-07-27T14:33:35.180884+0000","last_fullsized":"2023-07-27T14:33:35.180884+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184398+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:33:35.184398+0000","last_peered":"2023-07-27T14:33:35.184398+0000","last_clean":"2023-07-27T14:33:35.184398+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:33:35.184398+0000","last_undegraded":"2023-07-27T14:33:35.184398+0000","last_fullsized":"2023-07-27T14:33:35.184398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.210624+0000","last_change":"2023-07-27T14:33:35.208454+0000","last_active":"2023-07-27T14:33:35.210624+0000","last_peered":"2023-07-27T14:33:35.210624+0000","last_clean":"2023-07-27T14:33:35.210624+0000","last_became_active":"2023-07-27T14:33:35.208049+0000","last_became_peered":"2023-07-27T14:33:35.208049+0000","last_unstale":"2023-07-27T14:33:35.210624+0000","last_undegraded":"2023-07-27T14:33:35.210624+0000","last_fullsized":"2023-07-27T14:33:35.210624+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.181995+0000","last_change":"2023-07-27T14:33:34.730494+0000","last_active":"2023-07-27T14:33:35.181995+0000","last_peered":"2023-07-27T14:33:35.181995+0000","last_clean":"2023-07-27T14:33:35.181995+0000","last_became_active":"2023-07-27T14:33:34.730235+0000","last_became_peered":"2023-07-27T14:33:34.730235+0000","last_unstale":"2023-07-27T14:33:35.181995+0000","last_undegraded":"2023-07-27T14:33:35.181995+0000","last_fullsized":"2023-07-27T14:33:35.181995+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.197172+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:33:35.197172+0000","last_peered":"2023-07-27T14:33:35.197172+0000","last_clean":"2023-07-27T14:33:35.197172+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:33:35.197172+0000","last_undegraded":"2023-07-27T14:33:35.197172+0000","last_fullsized":"2023-07-27T14:33:35.197172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.212485+0000","last_change":"2023-07-27T14:33:35.211172+0000","last_active":"2023-07-27T14:33:35.212485+0000","last_peered":"2023-07-27T14:33:35.212485+0000","last_clean":"2023-07-27T14:33:35.212485+0000","last_became_active":"2023-07-27T14:33:35.210753+0000","last_became_peered":"2023-07-27T14:33:35.210753+0000","last_unstale":"2023-07-27T14:33:35.212485+0000","last_undegraded":"2023-07-27T14:33:35.212485+0000","last_fullsized":"2023-07-27T14:33:35.212485+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.207770+0000","last_change":"2023-07-27T14:33:34.724417+0000","last_active":"2023-07-27T14:33:35.207770+0000","last_peered":"2023-07-27T14:33:35.207770+0000","last_clean":"2023-07-27T14:33:35.207770+0000","last_became_active":"2023-07-27T14:33:34.724013+0000","last_became_peered":"2023-07-27T14:33:34.724013+0000","last_unstale":"2023-07-27T14:33:35.207770+0000","last_undegraded":"2023-07-27T14:33:35.207770+0000","last_fullsized":"2023-07-27T14:33:35.207770+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.184557+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:33:35.184557+0000","last_peered":"2023-07-27T14:33:35.184557+0000","last_clean":"2023-07-27T14:33:35.184557+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:33:35.184557+0000","last_undegraded":"2023-07-27T14:33:35.184557+0000","last_fullsized":"2023-07-27T14:33:35.184557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":108,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.199111+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:33:35.199111+0000","last_peered":"2023-07-27T14:33:35.199111+0000","last_clean":"2023-07-27T14:33:35.199111+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:33:35.199111+0000","last_undegraded":"2023-07-27T14:33:35.199111+0000","last_fullsized":"2023-07-27T14:33:35.199111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.205295+0000","last_change":"2023-07-27T14:33:35.199651+0000","last_active":"2023-07-27T14:33:35.205295+0000","last_peered":"2023-07-27T14:33:35.205295+0000","last_clean":"2023-07-27T14:33:35.205295+0000","last_became_active":"2023-07-27T14:33:35.196834+0000","last_became_peered":"2023-07-27T14:33:35.196834+0000","last_unstale":"2023-07-27T14:33:35.205295+0000","last_undegraded":"2023-07-27T14:33:35.205295+0000","last_fullsized":"2023-07-27T14:33:35.205295+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.212133+0000","last_change":"2023-07-27T14:33:34.724226+0000","last_active":"2023-07-27T14:33:35.212133+0000","last_peered":"2023-07-27T14:33:35.212133+0000","last_clean":"2023-07-27T14:33:35.212133+0000","last_became_active":"2023-07-27T14:33:34.723923+0000","last_became_peered":"2023-07-27T14:33:34.723923+0000","last_unstale":"2023-07-27T14:33:35.212133+0000","last_undegraded":"2023-07-27T14:33:35.212133+0000","last_fullsized":"2023-07-27T14:33:35.212133+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.199192+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:33:35.199192+0000","last_peered":"2023-07-27T14:33:35.199192+0000","last_clean":"2023-07-27T14:33:35.199192+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:33:35.199192+0000","last_undegraded":"2023-07-27T14:33:35.199192+0000","last_fullsized":"2023-07-27T14:33:35.199192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206203+0000","last_change":"2023-07-27T14:33:35.202816+0000","last_active":"2023-07-27T14:33:35.206203+0000","last_peered":"2023-07-27T14:33:35.206203+0000","last_clean":"2023-07-27T14:33:35.206203+0000","last_became_active":"2023-07-27T14:33:35.202515+0000","last_became_peered":"2023-07-27T14:33:35.202515+0000","last_unstale":"2023-07-27T14:33:35.206203+0000","last_undegraded":"2023-07-27T14:33:35.206203+0000","last_fullsized":"2023-07-27T14:33:35.206203+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.186542+0000","last_change":"2023-07-27T14:33:34.722398+0000","last_active":"2023-07-27T14:33:35.186542+0000","last_peered":"2023-07-27T14:33:35.186542+0000","last_clean":"2023-07-27T14:33:35.186542+0000","last_became_active":"2023-07-27T14:33:34.721919+0000","last_became_peered":"2023-07-27T14:33:34.721919+0000","last_unstale":"2023-07-27T14:33:35.186542+0000","last_undegraded":"2023-07-27T14:33:35.186542+0000","last_fullsized":"2023-07-27T14:33:35.186542+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.206463+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:33:35.206463+0000","last_peered":"2023-07-27T14:33:35.206463+0000","last_clean":"2023-07-27T14:33:35.206463+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:33:35.206463+0000","last_undegraded":"2023-07-27T14:33:35.206463+0000","last_fullsized":"2023-07-27T14:33:35.206463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.207762+0000","last_change":"2023-07-27T14:33:35.201979+0000","last_active":"2023-07-27T14:33:35.207762+0000","last_peered":"2023-07-27T14:33:35.207762+0000","last_clean":"2023-07-27T14:33:35.207762+0000","last_became_active":"2023-07-27T14:33:35.201679+0000","last_became_peered":"2023-07-27T14:33:35.201679+0000","last_unstale":"2023-07-27T14:33:35.207762+0000","last_undegraded":"2023-07-27T14:33:35.207762+0000","last_fullsized":"2023-07-27T14:33:35.207762+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.211494+0000","last_change":"2023-07-27T14:33:34.710835+0000","last_active":"2023-07-27T14:33:35.211494+0000","last_peered":"2023-07-27T14:33:35.211494+0000","last_clean":"2023-07-27T14:33:35.211494+0000","last_became_active":"2023-07-27T14:33:34.709942+0000","last_became_peered":"2023-07-27T14:33:34.709942+0000","last_unstale":"2023-07-27T14:33:35.211494+0000","last_undegraded":"2023-07-27T14:33:35.211494+0000","last_fullsized":"2023-07-27T14:33:35.211494+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.187578+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:33:35.187578+0000","last_peered":"2023-07-27T14:33:35.187578+0000","last_clean":"2023-07-27T14:33:35.187578+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:33:35.187578+0000","last_undegraded":"2023-07-27T14:33:35.187578+0000","last_fullsized":"2023-07-27T14:33:35.187578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.208045+0000","last_change":"2023-07-27T14:33:35.205146+0000","last_active":"2023-07-27T14:33:35.208045+0000","last_peered":"2023-07-27T14:33:35.208045+0000","last_clean":"2023-07-27T14:33:35.208045+0000","last_became_active":"2023-07-27T14:33:35.204803+0000","last_became_peered":"2023-07-27T14:33:35.204803+0000","last_unstale":"2023-07-27T14:33:35.208045+0000","last_undegraded":"2023-07-27T14:33:35.208045+0000","last_fullsized":"2023-07-27T14:33:35.208045+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:34.692036+0000","last_clean_scrub_stamp":"2023-07-27T14:33:34.692036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.201244+0000","last_change":"2023-07-27T14:33:34.722078+0000","last_active":"2023-07-27T14:33:35.201244+0000","last_peered":"2023-07-27T14:33:35.201244+0000","last_clean":"2023-07-27T14:33:35.201244+0000","last_became_active":"2023-07-27T14:33:34.721812+0000","last_became_peered":"2023-07-27T14:33:34.721812+0000","last_unstale":"2023-07-27T14:33:35.201244+0000","last_undegraded":"2023-07-27T14:33:35.201244+0000","last_fullsized":"2023-07-27T14:33:35.201244+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:33:33.685394+0000","last_clean_scrub_stamp":"2023-07-27T14:33:33.685394+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-27T14:33:35.185732+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:33:35.185732+0000","last_peered":"2023-07-27T14:33:35.185732+0000","last_clean":"2023-07-27T14:33:35.185732+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:33:35.185732+0000","last_undegraded":"2023-07-27T14:33:35.185732+0000","last_fullsized":"2023-07-27T14:33:35.185732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15244,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":13696,"kb_avail":94356596,"statfs":{"total":96636764160,"available":96621154304,"internally_reserved":0,"allocated":1576960,"data_stored":732381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14024704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.627,"15min":0.66500000000000004},"min":{"1min":0.48199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.96599999999999997,"15min":1.133},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.67500000000000004},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":1.0589999999999999,"15min":1.1180000000000001},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67900000000000005,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.72599999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.90700000000000003,"5min":0.96999999999999997,"15min":1.1459999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.90000000000000002,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66700000000000004,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.119},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.44500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.069,"15min":1.069},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68100000000000005,"15min":0.70599999999999996},"min":{"1min":0.55300000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85799999999999998,"5min":0.92800000000000005,"15min":1.165},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61499999999999999,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88500000000000001,"5min":0.97899999999999998,"15min":1.0249999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86199999999999999,"5min":1.202,"15min":1.202},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.70399999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.999,"5min":1.028,"15min":1.0409999999999999},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14916,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":13376,"kb_avail":94356924,"statfs":{"total":96636764160,"available":96621490176,"internally_reserved":0,"allocated":1568768,"data_stored":732741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13697024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.58999999999999997},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86399999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.45700000000000002,"5min":0.44900000000000001,"15min":0.42999999999999999},"max":{"1min":0.92900000000000005,"5min":1.2,"15min":1.2},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.66300000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.745,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.079},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.67800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.0309999999999999,"15min":1.198},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.84199999999999997,"5min":0.92200000000000004,"15min":0.94099999999999995},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:33:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.748,"15min":0.74099999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.1000000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.52400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":0.5}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17540,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":94354300,"statfs":{"total":96636764160,"available":96618803200,"internally_reserved":0,"allocated":1568768,"data_stored":732209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39200000000000002,"15min":0.51400000000000001},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55100000000000005,"5min":0.65500000000000003,"15min":4.75},"last":0.313},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42399999999999999,"15min":0.66400000000000003},"min":{"1min":0.26900000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64100000000000001,"5min":0.70199999999999996,"15min":9.3100000000000005},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.56000000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.55600000000000005,"5min":0.67500000000000004,"15min":3.7210000000000001},"last":0.441},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47399999999999998,"15min":0.53500000000000003},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.59099999999999997,"5min":0.79700000000000004,"15min":2.7160000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46600000000000003,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":3.8580000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.48999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97999999999999998,"5min":1.2010000000000001,"15min":2.181},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68100000000000005,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":1.127,"15min":2.4180000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":3.7440000000000002},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.747},"min":{"1min":0.54200000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97799999999999998,"5min":1.1040000000000001,"15min":2.149},"last":1.131}]},{"osd":6,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69699999999999995,"15min":0.74099999999999999},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.47699999999999998},"max":{"1min":0.85499999999999998,"5min":1.032,"15min":2.052},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69499999999999995,"15min":0.84999999999999998},"min":{"1min":0.51800000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.23,"15min":6.1980000000000004},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95899999999999996,"5min":1.103,"15min":2.016},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.002,"5min":1.087,"15min":3.7799999999999998},"last":1.054}]}]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14988,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":13440,"kb_avail":94356852,"statfs":{"total":96636764160,"available":96621416448,"internally_reserved":0,"allocated":1576960,"data_stored":733655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13762560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.52300000000000002,"5min":0.58299999999999996,"15min":0.79500000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.36899999999999999,"5min":0.27400000000000002,"15min":0.24399999999999999},"max":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.435}]},{"osd":2,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.42599999999999999},"min":{"1min":0.32000000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.378},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.41599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.55400000000000005,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70099999999999996,"15min":0.68500000000000005},"min":{"1min":0.54700000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.085,"5min":1.28,"15min":1.28},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95199999999999996,"5min":1.25,"15min":1.25},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.54100000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.54400000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90700000000000003,"5min":1.22,"15min":1.22},"last":0.626}]},{"osd":7,"last update":"Thu Jul 27 14:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72699999999999998,"15min":0.747},"min":{"1min":0.56100000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":0.93799999999999994,"5min":1.244,"15min":1.244},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.55800000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0029999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.57699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18440,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":16896,"kb_avail":94353400,"statfs":{"total":96636764160,"available":96617881600,"internally_reserved":0,"allocated":1572864,"data_stored":733149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17301504},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.495}]},{"osd":1,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.48399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60099999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.601,"5min":5.601,"15min":5.601},"last":0.438}]},{"osd":3,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45400000000000001,"15min":0.48199999999999998},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70799999999999996,"5min":0.81100000000000005,"15min":0.83499999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.53700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.88},{"interface":"front","average":{"1min":1.05,"5min":0.76400000000000001,"15min":0.71599999999999997},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":6.9660000000000002,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.1600000000000001,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.75700000000000001,"15min":0.77800000000000002},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.1360000000000001,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15628,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":94356212,"statfs":{"total":96636764160,"available":96620761088,"internally_reserved":0,"allocated":1576960,"data_stored":732865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39300000000000002},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.23400000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.52100000000000002,"5min":1.302,"15min":1.302},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.45000000000000001},"min":{"1min":0.32700000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59299999999999997,"5min":0.748,"15min":0.88900000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.47399999999999998,"15min":0.44500000000000001},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.495}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2749999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.149},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.54300000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.111,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.51000000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91200000000000003,"5min":1.232,"15min":1.232},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1639999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.45200000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.298},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":1.0209999999999999,"5min":1.343,"15min":1.343},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79100000000000004,"15min":0.78100000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78600000000000003,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.49299999999999999},"max":{"1min":1.1020000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.98299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14728,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357112,"statfs":{"total":96636764160,"available":96621682688,"internally_reserved":0,"allocated":1572864,"data_stored":732831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.52500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85599999999999998,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.71199999999999997},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79000000000000004,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.495,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81399999999999995,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75800000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":4.476,"15min":4.476},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88900000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.497,"15min":0.49199999999999999},"max":{"1min":0.93000000000000005,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66600000000000004,"15min":0.621},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.64100000000000001},"min":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.66200000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0029999999999999,"5min":5.194,"15min":5.194},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94799999999999995,"5min":2.819,"15min":2.819},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0389999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.83299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574932,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16260,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":14720,"kb_avail":94355580,"statfs":{"total":96636764160,"available":96620113920,"internally_reserved":0,"allocated":1568768,"data_stored":732277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15073280},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86199999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.72299999999999998,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.68500000000000005},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.91900000000000004,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":1.581,"15min":1.581},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69999999999999996,"15min":0.66200000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98899999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":0.93100000000000005,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81299999999999994,"15min":0.79100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.876}]},{"osd":4,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.96099999999999997,"5min":1.978,"15min":1.978},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67700000000000005,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.88800000000000001,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85399999999999998,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.755},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92300000000000004,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.89800000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.67400000000000004},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.85699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:33:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:33:39.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:33:40.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.108+0000 7f91355ff700 1 Processor -- start 2023-07-27T14:33:40.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.108+0000 7f91355ff700 1 -- start start 2023-07-27T14:33:40.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.109+0000 7f91355ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9130157400 0x7f91300c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.109+0000 7f91355ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91300c7120 con 0x7f91300a7940 2023-07-27T14:33:40.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.109+0000 7f91355ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91300c7ad0 con 0x7f91300c7550 2023-07-27T14:33:40.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.109+0000 7f91355ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91300c5590 con 0x7f9130157400 2023-07-27T14:33:40.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9130157400 0x7f91300c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9130157400 0x7f91300c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48854/0 (socket says 172.21.15.115:48854) 2023-07-27T14:33:40.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912e7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f91300a7940 0x7f91300c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56744/0 (socket says 172.21.15.115:56744) 2023-07-27T14:33:40.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912effd700 1 -- 172.21.15.115:0/699921283 learned_addr learned my addr 172.21.15.115:0/699921283 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:40.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912dffb700 1 -- 172.21.15.115:0/699921283 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662422194 0 0) 0x7f91300c7120 con 0x7f91300a7940 2023-07-27T14:33:40.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912dffb700 1 -- 172.21.15.115:0/699921283 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91180033f0 con 0x7f91300a7940 2023-07-27T14:33:40.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912effd700 1 -- 172.21.15.115:0/699921283 >> v1:172.21.15.159:6789/0 conn(0x7f91300c7550 legacy=0x7f91300c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912effd700 1 -- 172.21.15.115:0/699921283 >> v1:172.21.15.115:6789/0 conn(0x7f91300a7940 legacy=0x7f91300c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912effd700 1 -- 172.21.15.115:0/699921283 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91300c7db0 con 0x7f9130157400 2023-07-27T14:33:40.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.110+0000 7f912effd700 1 --2- 172.21.15.115:0/699921283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f91300c05d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f9120006fd0 tx=0x7f91200090f0).ready entity=mon.0 client_cookie=752934b273e25385 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:40.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f912dffb700 1 -- 172.21.15.115:0/699921283 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000b580 con 0x7f9130157400 2023-07-27T14:33:40.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f912dffb700 1 -- 172.21.15.115:0/699921283 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912000b6e0 con 0x7f9130157400 2023-07-27T14:33:40.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f912dffb700 1 -- 172.21.15.115:0/699921283 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000ba60 con 0x7f9130157400 2023-07-27T14:33:40.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f91355ff700 1 -- 172.21.15.115:0/699921283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 msgr2=0x7f91300c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f91355ff700 1 --2- 172.21.15.115:0/699921283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f91300c05d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f9120006fd0 tx=0x7f91200090f0).stop 2023-07-27T14:33:40.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f91355ff700 1 -- 172.21.15.115:0/699921283 shutdown_connections 2023-07-27T14:33:40.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f91355ff700 1 --2- 172.21.15.115:0/699921283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f91300c05d0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f91355ff700 1 -- 172.21.15.115:0/699921283 >> 172.21.15.115:0/699921283 conn(0x7f9130094280 msgr2=0x7f913005e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:40.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f91355ff700 1 -- 172.21.15.115:0/699921283 shutdown_connections 2023-07-27T14:33:40.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.111+0000 7f91355ff700 1 -- 172.21.15.115:0/699921283 wait complete. 2023-07-27T14:33:40.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.113+0000 7f91355ff700 1 Processor -- start 2023-07-27T14:33:40.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.114+0000 7f91355ff700 1 -- start start 2023-07-27T14:33:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f91355ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91300a7940 0x7f9130156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f91355ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300c7550 0x7f91300adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f91355ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f913014c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f91355ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300ae3b0 con 0x7f9130157400 2023-07-27T14:33:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f91355ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300ae690 con 0x7f91300c7550 2023-07-27T14:33:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f91355ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300ae970 con 0x7f91300a7940 2023-07-27T14:33:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f912f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f913014c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f912f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f913014c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48856/0 (socket says 172.21.15.115:48856) 2023-07-27T14:33:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f912f7fe700 1 -- 172.21.15.115:0/3480041115 learned_addr learned my addr 172.21.15.115:0/3480041115 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f912effd700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91300a7940 0x7f9130156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f912f7fe700 1 -- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91300a7940 msgr2=0x7f9130156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f912f7fe700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91300a7940 0x7f9130156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f912f7fe700 1 -- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300c7550 msgr2=0x7f91300adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.115+0000 7f912e7fc700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300c7550 0x7f91300adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f912f7fe700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300c7550 0x7f91300adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f912f7fe700 1 -- 172.21.15.115:0/3480041115 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120009370 con 0x7f9130157400 2023-07-27T14:33:40.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f912effd700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91300a7940 0x7f9130156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:40.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f912e7fc700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300c7550 0x7f91300adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:40.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f912f7fe700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f913014c6d0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f9128002230 tx=0x7f91280015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:40.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f9116ffd700 1 -- 172.21.15.115:0/3480041115 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128010510 con 0x7f9130157400 2023-07-27T14:33:40.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f9116ffd700 1 -- 172.21.15.115:0/3480041115 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9128010670 con 0x7f9130157400 2023-07-27T14:33:40.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f9116ffd700 1 -- 172.21.15.115:0/3480041115 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91280109f0 con 0x7f9130157400 2023-07-27T14:33:40.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91300aec50 con 0x7f9130157400 2023-07-27T14:33:40.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.116+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91300ae090 con 0x7f9130157400 2023-07-27T14:33:40.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.117+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91300aa6d0 con 0x7f9130157400 2023-07-27T14:33:40.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.118+0000 7f9116ffd700 1 -- 172.21.15.115:0/3480041115 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f9128010070 con 0x7f9130157400 2023-07-27T14:33:40.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.119+0000 7f9116ffd700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f911c05f5b0 0x7f911c061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.119+0000 7f9116ffd700 1 -- 172.21.15.115:0/3480041115 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f912807a620 con 0x7f9130157400 2023-07-27T14:33:40.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.120+0000 7f912effd700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f911c05f5b0 0x7f911c061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.120+0000 7f912effd700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f911c05f5b0 0x7f911c061a70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f912000b340 tx=0x7f9120017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:40.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.123+0000 7f9116ffd700 1 -- 172.21.15.115:0/3480041115 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91300aa6d0 con 0x7f9130157400 2023-07-27T14:33:40.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.361+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f91300aa6d0 con 0x7f9130157400 2023-07-27T14:33:40.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.365+0000 7f9116ffd700 1 -- 172.21.15.115:0/3480041115 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f91300aa6d0 con 0x7f9130157400 2023-07-27T14:33:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f911c05f5b0 msgr2=0x7f911c061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f911c05f5b0 0x7f911c061a70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f912000b340 tx=0x7f9120017000).stop 2023-07-27T14:33:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 msgr2=0x7f913014c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f913014c6d0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f9128002230 tx=0x7f91280015e0).stop 2023-07-27T14:33:40.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 shutdown_connections 2023-07-27T14:33:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f911c05f5b0 0x7f911c061a70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9130157400 0x7f913014c6d0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91300a7940 0x7f9130156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 --2- 172.21.15.115:0/3480041115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91300c7550 0x7f91300adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 >> 172.21.15.115:0/3480041115 conn(0x7f9130094280 msgr2=0x7f91300a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 shutdown_connections 2023-07-27T14:33:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.367+0000 7f91355ff700 1 -- 172.21.15.115:0/3480041115 wait complete. 2023-07-27T14:33:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:33:40.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:33:40.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.572+0000 7ff8171ff700 1 Processor -- start 2023-07-27T14:33:40.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.572+0000 7ff8171ff700 1 -- start start 2023-07-27T14:33:40.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.573+0000 7ff8171ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff8100aaa40 0x7ff8100640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.573+0000 7ff8171ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.573+0000 7ff8171ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100aa4d0 con 0x7ff810153ec0 2023-07-27T14:33:40.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.573+0000 7ff8171ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff810064ad0 con 0x7ff8100aaa40 2023-07-27T14:33:40.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.573+0000 7ff8171ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100c05c0 con 0x7ff8101542a0 2023-07-27T14:33:40.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff80ffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff8100aaa40 0x7ff8100640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff81579c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff81579c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:42152/0 (socket says 172.21.15.115:42152) 2023-07-27T14:33:40.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff80ffff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff8100aaa40 0x7ff8100640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:48754/0 (socket says 172.21.15.115:48754) 2023-07-27T14:33:40.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff81579c700 1 -- 172.21.15.115:0/1093180934 learned_addr learned my addr 172.21.15.115:0/1093180934 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:40.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff814f9b700 1 --1- 172.21.15.115:0/1093180934 >> v1:172.21.15.159:6789/0 conn(0x7ff810153ec0 0x7ff8100a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:43480/0 (socket says 172.21.15.115:43480) 2023-07-27T14:33:40.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff81579c700 1 -- 172.21.15.115:0/1093180934 >> v2:172.21.15.159:3300/0 conn(0x7ff8100aaa40 msgr2=0x7ff8100640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:40.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff81579c700 1 --2- 172.21.15.115:0/1093180934 >> v2:172.21.15.159:3300/0 conn(0x7ff8100aaa40 0x7ff8100640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff81579c700 1 -- 172.21.15.115:0/1093180934 >> v1:172.21.15.159:6789/0 conn(0x7ff810153ec0 legacy=0x7ff8100a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff81579c700 1 -- 172.21.15.115:0/1093180934 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100c1a60 con 0x7ff8101542a0 2023-07-27T14:33:40.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.574+0000 7ff80ffff700 1 --2- 172.21.15.115:0/1093180934 >> v2:172.21.15.159:3300/0 conn(0x7ff8100aaa40 0x7ff8100640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:40.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.575+0000 7ff81579c700 1 --2- 172.21.15.115:0/1093180934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100645e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff808009f20 tx=0x7ff808009840).ready entity=mon.2 client_cookie=bd26a7b575012a2d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:40.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.575+0000 7ff80f7fe700 1 -- 172.21.15.115:0/1093180934 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800e070 con 0x7ff8101542a0 2023-07-27T14:33:40.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.575+0000 7ff80f7fe700 1 -- 172.21.15.115:0/1093180934 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800b9d0 con 0x7ff8101542a0 2023-07-27T14:33:40.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.575+0000 7ff80f7fe700 1 -- 172.21.15.115:0/1093180934 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800bd50 con 0x7ff8101542a0 2023-07-27T14:33:40.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.575+0000 7ff8171ff700 1 -- 172.21.15.115:0/1093180934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 msgr2=0x7ff8100645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.575+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1093180934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100645e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff808009f20 tx=0x7ff808009840).stop 2023-07-27T14:33:40.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.576+0000 7ff8171ff700 1 -- 172.21.15.115:0/1093180934 shutdown_connections 2023-07-27T14:33:40.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.576+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1093180934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100645e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.576+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1093180934 >> v2:172.21.15.159:3300/0 conn(0x7ff8100aaa40 0x7ff8100640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.576+0000 7ff8171ff700 1 -- 172.21.15.115:0/1093180934 >> 172.21.15.115:0/1093180934 conn(0x7ff8100cb610 msgr2=0x7ff8100c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:40.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.576+0000 7ff8171ff700 1 -- 172.21.15.115:0/1093180934 shutdown_connections 2023-07-27T14:33:40.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.576+0000 7ff8171ff700 1 -- 172.21.15.115:0/1093180934 wait complete. 2023-07-27T14:33:40.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.577+0000 7ff8171ff700 1 Processor -- start 2023-07-27T14:33:40.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.577+0000 7ff8171ff700 1 -- start start 2023-07-27T14:33:40.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff8171ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8100aaa40 0x7ff8101517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff8171ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff810153ec0 0x7ff81014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff8171ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff8171ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810152bb0 con 0x7ff8100aaa40 2023-07-27T14:33:40.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff8171ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810151fa0 con 0x7ff810153ec0 2023-07-27T14:33:40.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff8171ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff810152280 con 0x7ff8101542a0 2023-07-27T14:33:40.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff814f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8100aaa40 0x7ff8101517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff814f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8100aaa40 0x7ff8101517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48860/0 (socket says 172.21.15.115:48860) 2023-07-27T14:33:40.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.578+0000 7ff814f9b700 1 -- 172.21.15.115:0/1589338841 learned_addr learned my addr 172.21.15.115:0/1589338841 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:40.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff81579c700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff80ffff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff810153ec0 0x7ff81014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff814f9b700 1 -- 172.21.15.115:0/1589338841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 msgr2=0x7ff8100ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff814f9b700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff814f9b700 1 -- 172.21.15.115:0/1589338841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff810153ec0 msgr2=0x7ff81014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff814f9b700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff810153ec0 0x7ff81014e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff814f9b700 1 -- 172.21.15.115:0/1589338841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc0092a0 con 0x7ff8100aaa40 2023-07-27T14:33:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff814f9b700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8100aaa40 0x7ff8101517b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7ff804007fd0 tx=0x7ff804007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff80cff9700 1 -- 172.21.15.115:0/1589338841 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400ce10 con 0x7ff8100aaa40 2023-07-27T14:33:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff80cff9700 1 -- 172.21.15.115:0/1589338841 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8040072e0 con 0x7ff8100aaa40 2023-07-27T14:33:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff808009ae0 con 0x7ff8100aaa40 2023-07-27T14:33:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.579+0000 7ff80cff9700 1 -- 172.21.15.115:0/1589338841 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040056e0 con 0x7ff8100aaa40 2023-07-27T14:33:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.580+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff810152840 con 0x7ff8100aaa40 2023-07-27T14:33:40.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.580+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff81006c470 con 0x7ff8100aaa40 2023-07-27T14:33:40.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.581+0000 7ff80cff9700 1 -- 172.21.15.115:0/1589338841 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7ff80401a060 con 0x7ff8100aaa40 2023-07-27T14:33:40.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.582+0000 7ff80cff9700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7f405f5b0 0x7ff7f4061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:40.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.582+0000 7ff80cff9700 1 -- 172.21.15.115:0/1589338841 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff804079d70 con 0x7ff8100aaa40 2023-07-27T14:33:40.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.582+0000 7ff80ffff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7f405f5b0 0x7ff7f4061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:40.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.583+0000 7ff80ffff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7f405f5b0 0x7ff7f4061a70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7ff81014f6e0 tx=0x7ff7fc009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:40.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.586+0000 7ff80cff9700 1 -- 172.21.15.115:0/1589338841 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff80404a9e0 con 0x7ff8100aaa40 2023-07-27T14:33:40.725 INFO:tasks.ceph.mds.c.smithi115.stderr:2023-07-27T14:33:40.685+0000 7f3b7adf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:33:40.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.795+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8100aa4d0 con 0x7ff8100aaa40 2023-07-27T14:33:40.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.795+0000 7ff80cff9700 1 -- 172.21.15.115:0/1589338841 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4503 (secure 0 0 0) 0x7ff8100aa4d0 con 0x7ff8100aaa40 2023-07-27T14:33:40.835 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:33:40.835 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3206086489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3206086489},{"type":"v1","addr":"172.21.15.159:6835","nonce":3206086489}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1201288824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1201288824},{"type":"v1","addr":"172.21.15.159:6833","nonce":1201288824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7785,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3016973491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3016973491},{"type":"v1","addr":"172.21.15.115:6835","nonce":3016973491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:35.175025+0000","modified":"2023-07-27T14:33:38.185034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3532071498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3532071498},{"type":"v1","addr":"172.21.15.115:6837","nonce":3532071498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-07-27T14:33:40.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7f405f5b0 msgr2=0x7ff7f4061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7f405f5b0 0x7ff7f4061a70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7ff81014f6e0 tx=0x7ff7fc009060).stop 2023-07-27T14:33:40.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8100aaa40 msgr2=0x7ff8101517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:40.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8100aaa40 0x7ff8101517b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7ff804007fd0 tx=0x7ff804007df0).stop 2023-07-27T14:33:40.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 shutdown_connections 2023-07-27T14:33:40.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7f405f5b0 0x7ff7f4061a70 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8101542a0 0x7ff8100ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8100aaa40 0x7ff8101517b0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 --2- 172.21.15.115:0/1589338841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff810153ec0 0x7ff81014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:40.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 >> 172.21.15.115:0/1589338841 conn(0x7ff8100cb610 msgr2=0x7ff81014f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:40.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 shutdown_connections 2023-07-27T14:33:40.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:40.797+0000 7ff8171ff700 1 -- 172.21.15.115:0/1589338841 wait complete. 2023-07-27T14:33:40.839 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 68 2023-07-27T14:33:41.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:33:35.175025+0000', 'modified': '2023-07-27T14:33:38.185034+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7791}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7791': {'gid': 7791, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6837/3532071498', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 3532071498}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 3532071498}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:33:41.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:33:41.257 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-27T14:33:41.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.405+0000 7fdb5fdff700 1 Processor -- start 2023-07-27T14:33:41.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.405+0000 7fdb5fdff700 1 -- start start 2023-07-27T14:33:41.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb580aaa40 0x7fdb580640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5fdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb581542a0 0x7fdb580645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5fdff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580aa4d0 con 0x7fdb58153ec0 2023-07-27T14:33:41.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5fdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb58064ad0 con 0x7fdb581542a0 2023-07-27T14:33:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c05c0 con 0x7fdb580aaa40 2023-07-27T14:33:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5e39c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb581542a0 0x7fdb580645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5e39c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb581542a0 0x7fdb580645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48862/0 (socket says 172.21.15.115:48862) 2023-07-27T14:33:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5e39c700 1 -- 172.21.15.115:0/3134085298 learned_addr learned my addr 172.21.15.115:0/3134085298 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/3134085298 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb580aaa40 0x7fdb580640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5e39c700 1 -- 172.21.15.115:0/3134085298 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb580aaa40 msgr2=0x7fdb580640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5e39c700 1 --2- 172.21.15.115:0/3134085298 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb580aaa40 0x7fdb580640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5e39c700 1 -- 172.21.15.115:0/3134085298 >> v1:172.21.15.159:6789/0 conn(0x7fdb58153ec0 legacy=0x7fdb580a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.407+0000 7fdb5e39c700 1 -- 172.21.15.115:0/3134085298 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580c1a60 con 0x7fdb581542a0 2023-07-27T14:33:41.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5e39c700 1 --2- 172.21.15.115:0/3134085298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb581542a0 0x7fdb580645e0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fdb50009f20 tx=0x7fdb50009840).ready entity=mon.0 client_cookie=bf73dd1721a3c0de server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5cb99700 1 -- 172.21.15.115:0/3134085298 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000e070 con 0x7fdb581542a0 2023-07-27T14:33:41.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5cb99700 1 -- 172.21.15.115:0/3134085298 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000ba80 con 0x7fdb581542a0 2023-07-27T14:33:41.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5cb99700 1 -- 172.21.15.115:0/3134085298 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000be00 con 0x7fdb581542a0 2023-07-27T14:33:41.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5fdff700 1 -- 172.21.15.115:0/3134085298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb581542a0 msgr2=0x7fdb580645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/3134085298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb581542a0 0x7fdb580645e0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fdb50009f20 tx=0x7fdb50009840).stop 2023-07-27T14:33:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5fdff700 1 -- 172.21.15.115:0/3134085298 shutdown_connections 2023-07-27T14:33:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/3134085298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb581542a0 0x7fdb580645e0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/3134085298 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb580aaa40 0x7fdb580640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5fdff700 1 -- 172.21.15.115:0/3134085298 >> 172.21.15.115:0/3134085298 conn(0x7fdb580cb610 msgr2=0x7fdb580c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5fdff700 1 -- 172.21.15.115:0/3134085298 shutdown_connections 2023-07-27T14:33:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.408+0000 7fdb5fdff700 1 -- 172.21.15.115:0/3134085298 wait complete. 2023-07-27T14:33:41.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.410+0000 7fdb5fdff700 1 Processor -- start 2023-07-27T14:33:41.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.410+0000 7fdb5fdff700 1 -- start start 2023-07-27T14:33:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5fdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb580aaa40 0x7fdb580c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb58153ec0 0x7fdb580afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb581542a0 0x7fdb58152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb581572a0 con 0x7fdb58153ec0 2023-07-27T14:33:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5fdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c21d0 con 0x7fdb580aaa40 2023-07-27T14:33:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c24b0 con 0x7fdb581542a0 2023-07-27T14:33:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5d39a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb58153ec0 0x7fdb580afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5d39a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb58153ec0 0x7fdb580afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48872/0 (socket says 172.21.15.115:48872) 2023-07-27T14:33:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5d39a700 1 -- 172.21.15.115:0/199220927 learned_addr learned my addr 172.21.15.115:0/199220927 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5e39c700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb581542a0 0x7fdb58152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.411+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb580aaa40 0x7fdb580c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5d39a700 1 -- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb581542a0 msgr2=0x7fdb58152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb581542a0 0x7fdb58152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5d39a700 1 -- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb580aaa40 msgr2=0x7fdb580c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb580aaa40 0x7fdb580c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5d39a700 1 -- 172.21.15.115:0/199220927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009ae0 con 0x7fdb58153ec0 2023-07-27T14:33:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5e39c700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb581542a0 0x7fdb58152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb580aaa40 0x7fdb580c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:41.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb58153ec0 0x7fdb580afc80 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fdb4800d860 tx=0x7fdb48008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb4dffb700 1 -- 172.21.15.115:0/199220927 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480125f0 con 0x7fdb58153ec0 2023-07-27T14:33:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb4dffb700 1 -- 172.21.15.115:0/199220927 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48012750 con 0x7fdb58153ec0 2023-07-27T14:33:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5fdff700 1 -- 172.21.15.115:0/199220927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb580c2790 con 0x7fdb58153ec0 2023-07-27T14:33:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb4dffb700 1 -- 172.21.15.115:0/199220927 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48012ad0 con 0x7fdb58153ec0 2023-07-27T14:33:41.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.412+0000 7fdb5fdff700 1 -- 172.21.15.115:0/199220927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb580b0170 con 0x7fdb58153ec0 2023-07-27T14:33:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.414+0000 7fdb4dffb700 1 -- 172.21.15.115:0/199220927 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fdb48013480 con 0x7fdb58153ec0 2023-07-27T14:33:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.415+0000 7fdb4dffb700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb3c05f5b0 0x7fdb3c061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.415+0000 7fdb4dffb700 1 -- 172.21.15.115:0/199220927 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb4807a7b0 con 0x7fdb58153ec0 2023-07-27T14:33:41.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.415+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb3c05f5b0 0x7fdb3c061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.416+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb3c05f5b0 0x7fdb3c061a70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fdb54001730 tx=0x7fdb54009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.417+0000 7fdb77133b80 1 Processor -- start 2023-07-27T14:33:41.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.417+0000 7fdb77133b80 1 -- start start 2023-07-27T14:33:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f6f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f97830 0x55c7e9fbdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7e9fbe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb77133b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9eac9c0 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb77133b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9ec1cc0 con 0x55c7e9f71f60 2023-07-27T14:33:41.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb77133b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9e88e10 con 0x55c7e9f97830 2023-07-27T14:33:41.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb5db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f6f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb5db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f6f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48878/0 (socket says 172.21.15.115:48878) 2023-07-27T14:33:41.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb5db9b700 1 -- 172.21.15.115:0/130869956 learned_addr learned my addr 172.21.15.115:0/130869956 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:41.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f97830 0x55c7e9fbdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.418+0000 7fdb5e39c700 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7e9fbe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb5db9b700 1 -- 172.21.15.115:0/130869956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f97830 msgr2=0x55c7e9fbdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f97830 0x55c7e9fbdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb5db9b700 1 -- 172.21.15.115:0/130869956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 msgr2=0x55c7e9fbe1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7e9fbe1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb5db9b700 1 -- 172.21.15.115:0/130869956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e9eba9a0 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f6f9a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fdb5400e720 tx=0x7fdb54003000).ready entity=mon.0 client_cookie=f1ad360efebf175f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb429fe700 1 -- 172.21.15.115:0/130869956 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54017610 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb429fe700 1 -- 172.21.15.115:0/130869956 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54017770 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.419+0000 7fdb429fe700 1 -- 172.21.15.115:0/130869956 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54017af0 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 -- 172.21.15.115:0/130869956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 msgr2=0x55c7e9f6f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f6f9a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fdb5400e720 tx=0x7fdb54003000).stop 2023-07-27T14:33:41.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 -- 172.21.15.115:0/130869956 shutdown_connections 2023-07-27T14:33:41.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7e9fbe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f6f9a0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 --2- 172.21.15.115:0/130869956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f97830 0x55c7e9fbdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 -- 172.21.15.115:0/130869956 >> 172.21.15.115:0/130869956 conn(0x55c7e9dda940 msgr2=0x55c7e9fb86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:41.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 -- 172.21.15.115:0/130869956 shutdown_connections 2023-07-27T14:33:41.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.420+0000 7fdb77133b80 1 -- 172.21.15.115:0/130869956 wait complete. 2023-07-27T14:33:41.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.421+0000 7fdb77133b80 1 -- start start 2023-07-27T14:33:41.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.421+0000 7fdb77133b80 1 Processor -- start 2023-07-27T14:33:41.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f6f5c0 0x55c7e9f9dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f71f60 0x55c7e9f954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f95990 0x55c7e9fb2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb77133b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9f99e30 con 0x55c7e9f71f60 2023-07-27T14:33:41.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb77133b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9f9e370 con 0x55c7e9f95990 2023-07-27T14:33:41.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb77133b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9fb1f40 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb77133b80 10 client.0 ll_register_callbacks cb 0x55c7e9e744a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:33:41.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb5d39a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f71f60 0x55c7e9f954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb5d39a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f71f60 0x55c7e9f954a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48886/0 (socket says 172.21.15.115:48886) 2023-07-27T14:33:41.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb5d39a700 1 -- 172.21.15.115:0/1102570727 learned_addr learned my addr 172.21.15.115:0/1102570727 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:41.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb5e39c700 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f95990 0x55c7e9fb2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f6f5c0 0x55c7e9f9dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb5d39a700 1 -- 172.21.15.115:0/1102570727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f6f5c0 msgr2=0x55c7e9f9dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.422+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f6f5c0 0x55c7e9f9dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb5d39a700 1 -- 172.21.15.115:0/1102570727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f95990 msgr2=0x55c7e9fb2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f95990 0x55c7e9fb2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb5d39a700 1 -- 172.21.15.115:0/1102570727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5400f040 con 0x55c7e9f71f60 2023-07-27T14:33:41.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f71f60 0x55c7e9f954a0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fdb4804efb0 tx=0x7fdb4807a040).ready entity=mon.0 client_cookie=9d96594e7d2b6961 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb37fff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:33:41.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb37fff700 1 -- 172.21.15.115:0/1102570727 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48078230 con 0x55c7e9f71f60 2023-07-27T14:33:41.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb37fff700 1 -- 172.21.15.115:0/1102570727 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb4804e570 con 0x55c7e9f71f60 2023-07-27T14:33:41.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb77133b80 1 -- 172.21.15.115:0/1102570727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7e9f69d50 con 0x55c7e9f71f60 2023-07-27T14:33:41.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb37fff700 1 -- 172.21.15.115:0/1102570727 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb4804ae70 con 0x55c7e9f71f60 2023-07-27T14:33:41.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb77133b80 10 client.7917 fetch_fsmap learned FSMap version 68 2023-07-27T14:33:41.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb77133b80 1 -- 172.21.15.115:0/1102570727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55c7e9eb6190 con 0x55c7e9f71f60 2023-07-27T14:33:41.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb37fff700 1 -- 172.21.15.115:0/1102570727 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7e9f69d50 con 0x55c7e9f71f60 2023-07-27T14:33:41.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb37fff700 1 -- 172.21.15.115:0/1102570727 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdb4804afd0 con 0x55c7e9f71f60 2023-07-27T14:33:41.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb77133b80 10 client.7917 fetch_fsmap finished waiting for FSMap version 68 2023-07-27T14:33:41.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb77133b80 10 client.7917 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:33:41.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb77133b80 20 client.7917 populate_metadata read hostname 'smithi115' 2023-07-27T14:33:41.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.423+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] conn(0x55c7e9f98af0 0x55c7e9f98ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.424+0000 7fdb77133b80 4 client.7917 mds_command: new command op to 7791 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:33:41.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.424+0000 7fdb77133b80 1 -- 172.21.15.115:0/1102570727 --> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7e9d2aef0 con 0x55c7e9f98af0 2023-07-27T14:33:41.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.424+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] conn(0x55c7e9f98af0 0x55c7e9f98ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.424+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] conn(0x55c7e9f98af0 0x55c7e9f98ed0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=46c58a098abe1270 server_cookie=799a53501f400bc0 in_seq=0 out_seq=0 2023-07-27T14:33:41.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.424+0000 7fdb37fff700 10 client.7917 ms_handle_connect on v2:172.21.15.115:6836/3532071498 2023-07-27T14:33:41.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb37fff700 1 -- 172.21.15.115:0/1102570727 <== mds.0 v2:172.21.15.115:6836/3532071498 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x55c7e9d2aef0 con 0x55c7e9f98af0 2023-07-27T14:33:41.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb37fff700 10 client.7917 handle_command_reply: tid=0 2023-07-27T14:33:41.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 client.7917 shutdown 2023-07-27T14:33:41.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 -- 172.21.15.115:0/1102570727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f71f60 msgr2=0x55c7e9f954a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f71f60 0x55c7e9f954a0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fdb4804efb0 tx=0x7fdb4807a040).stop 2023-07-27T14:33:41.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 -- 172.21.15.115:0/1102570727 shutdown_connections 2023-07-27T14:33:41.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] conn(0x55c7e9f98af0 0x55c7e9f98ed0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f95990 0x55c7e9fb2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f6f5c0 0x55c7e9f9dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb37fff700 0 client.7917 ms_handle_reset on v2:172.21.15.115:6836/3532071498 2023-07-27T14:33:41.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1102570727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f71f60 0x55c7e9f954a0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 -- 172.21.15.115:0/1102570727 >> 172.21.15.115:0/1102570727 conn(0x55c7e9dda940 msgr2=0x55c7e9fb8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:41.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 -- 172.21.15.115:0/1102570727 shutdown_connections 2023-07-27T14:33:41.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.425+0000 7fdb77133b80 1 -- 172.21.15.115:0/1102570727 wait complete. 2023-07-27T14:33:41.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.426+0000 7fdb77133b80 20 client.7917 trim_cache size 0 max 16384 2023-07-27T14:33:41.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.442+0000 7fdb77133b80 1 Processor -- start 2023-07-27T14:33:41.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.442+0000 7fdb77133b80 1 -- start start 2023-07-27T14:33:41.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7e9f6cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 0x55c7e9f94d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb77133b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9fb9370 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb77133b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9fb8500 con 0x55c7e9f71f60 2023-07-27T14:33:41.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb77133b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9fb95e0 con 0x55c7e9f95990 2023-07-27T14:33:41.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb5db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb5db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48890/0 (socket says 172.21.15.115:48890) 2023-07-27T14:33:41.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.443+0000 7fdb5db9b700 1 -- 172.21.15.115:0/1850258609 learned_addr learned my addr 172.21.15.115:0/1850258609 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:41.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb5db9b700 1 -- 172.21.15.115:0/1850258609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 msgr2=0x55c7e9f94d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/1850258609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 0x55c7e9f94d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:41.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb5db9b700 1 -- 172.21.15.115:0/1850258609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 msgr2=0x55c7e9f6cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/1850258609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7e9f6cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:41.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb5db9b700 1 -- 172.21.15.115:0/1850258609 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e9eb5ee0 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/1850258609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9b6c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fdb54008000 tx=0x7fdb54015000).ready entity=mon.0 client_cookie=fa5a4674902ce1f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb431ff700 1 -- 172.21.15.115:0/1850258609 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54029030 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb431ff700 1 -- 172.21.15.115:0/1850258609 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5402a040 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.444+0000 7fdb431ff700 1 -- 172.21.15.115:0/1850258609 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5402d170 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 -- 172.21.15.115:0/1850258609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 msgr2=0x55c7e9f9b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1850258609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9b6c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fdb54008000 tx=0x7fdb54015000).stop 2023-07-27T14:33:41.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 -- 172.21.15.115:0/1850258609 shutdown_connections 2023-07-27T14:33:41.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1850258609 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 0x55c7e9f94d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:41.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1850258609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9b6c0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 --2- 172.21.15.115:0/1850258609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7e9f6cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:41.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 -- 172.21.15.115:0/1850258609 >> 172.21.15.115:0/1850258609 conn(0x55c7e9dda940 msgr2=0x55c7e9f9be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:41.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 -- 172.21.15.115:0/1850258609 shutdown_connections 2023-07-27T14:33:41.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 -- 172.21.15.115:0/1850258609 wait complete. 2023-07-27T14:33:41.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.445+0000 7fdb77133b80 1 -- start start 2023-07-27T14:33:41.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.446+0000 7fdb77133b80 1 Processor -- start 2023-07-27T14:33:41.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7ea010940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb77133b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 0x55c7e9f94d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb77133b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ea00d950 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb77133b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9fb7450 con 0x55c7e9f71f60 2023-07-27T14:33:41.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb77133b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7e9f6d230 con 0x55c7e9f95990 2023-07-27T14:33:41.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb77133b80 10 client.0 ll_register_callbacks cb 0x55c7e9e744a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:33:41.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48892/0 (socket says 172.21.15.115:48892) 2023-07-27T14:33:41.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5db9b700 1 -- 172.21.15.115:0/2283847093 learned_addr learned my addr 172.21.15.115:0/2283847093 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:41.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5e39c700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 0x55c7e9f94d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7ea010940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5db9b700 1 -- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 msgr2=0x55c7e9f94d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 0x55c7e9f94d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5db9b700 1 -- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 msgr2=0x55c7ea010940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:41.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7ea010940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5db9b700 1 -- 172.21.15.115:0/2283847093 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7e9eba9a0 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5e39c700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 0x55c7e9f94d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:41.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.447+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7ea010940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:41.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb5db9b700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9ab80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x55c7e9f9b420 tx=0x7fdb54016000).ready entity=mon.0 client_cookie=4a41ee1d33e9818 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb37fff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:33:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb37fff700 1 -- 172.21.15.115:0/2283847093 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54017610 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 1 -- 172.21.15.115:0/2283847093 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb54017770 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb37fff700 1 -- 172.21.15.115:0/2283847093 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb5403ac80 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb37fff700 1 -- 172.21.15.115:0/2283847093 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb5403ae40 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 10 client.7923 fetch_fsmap learned FSMap version 68 2023-07-27T14:33:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 1 -- 172.21.15.115:0/2283847093 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55c7e9d301d0 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb37fff700 1 -- 172.21.15.115:0/2283847093 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54017770 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb37fff700 1 -- 172.21.15.115:0/2283847093 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdb54024660 con 0x55c7e9f6f5c0 2023-07-27T14:33:41.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 10 client.7923 fetch_fsmap finished waiting for FSMap version 68 2023-07-27T14:33:41.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 10 client.7923 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:33:41.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 20 client.7923 populate_metadata read hostname 'smithi115' 2023-07-27T14:33:41.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] conn(0x55c7e9f9d270 0x55c7e9f9d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 4 client.7923 mds_command: new command op to 7791 tid=0[{"prefix": "status"}] 2023-07-27T14:33:41.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.448+0000 7fdb77133b80 1 -- 172.21.15.115:0/2283847093 --> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7e9d60040 con 0x55c7e9f9d270 2023-07-27T14:33:41.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] conn(0x55c7e9f9d270 0x55c7e9f9d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb5d39a700 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] conn(0x55c7e9f9d270 0x55c7e9f9d650 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2925b3402fa03e01 server_cookie=5003a2affd4e6f8c in_seq=0 out_seq=0 2023-07-27T14:33:41.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb37fff700 10 client.7923 ms_handle_connect on v2:172.21.15.115:6836/3532071498 2023-07-27T14:33:41.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb37fff700 1 -- 172.21.15.115:0/2283847093 <== mds.0 v2:172.21.15.115:6836/3532071498 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55c7e9d60040 con 0x55c7e9f9d270 2023-07-27T14:33:41.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb37fff700 10 client.7923 handle_command_reply: tid=0 2023-07-27T14:33:41.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb77133b80 1 client.7923 shutdown 2023-07-27T14:33:41.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb77133b80 1 -- 172.21.15.115:0/2283847093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 msgr2=0x55c7e9f9ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb77133b80 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9ab80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x55c7e9f9b420 tx=0x7fdb54016000).stop 2023-07-27T14:33:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.449+0000 7fdb77133b80 1 -- 172.21.15.115:0/2283847093 shutdown_connections 2023-07-27T14:33:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb77133b80 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.115:6836/3532071498,v1:172.21.15.115:6837/3532071498] conn(0x55c7e9f9d270 0x55c7e9f9d650 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb77133b80 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55c7e9f95990 0x55c7e9f94d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb77133b80 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c7e9f6f5c0 0x55c7e9f9ab80 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb77133b80 1 --2- 172.21.15.115:0/2283847093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7e9f71f60 0x55c7ea010940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb37fff700 0 client.7923 ms_handle_reset on v2:172.21.15.115:6836/3532071498 2023-07-27T14:33:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb77133b80 1 -- 172.21.15.115:0/2283847093 >> 172.21.15.115:0/2283847093 conn(0x55c7e9dda940 msgr2=0x55c7e9f9b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb77133b80 1 -- 172.21.15.115:0/2283847093 shutdown_connections 2023-07-27T14:33:41.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb77133b80 1 -- 172.21.15.115:0/2283847093 wait complete. 2023-07-27T14:33:41.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb77133b80 20 client.7923 trim_cache size 0 max 16384 2023-07-27T14:33:41.498 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:33:41.498 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:33:41.498 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:33:41.498 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 7791, 2023-07-27T14:33:41.499 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:33:41.499 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:33:41.499 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:33:41.499 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2731468890000004, 2023-07-27T14:33:41.499 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 68, 2023-07-27T14:33:41.499 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 126, 2023-07-27T14:33:41.499 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 126, 2023-07-27T14:33:41.499 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.505110384 2023-07-27T14:33:41.500 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:33:41.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 -- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb3c05f5b0 msgr2=0x7fdb3c061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb3c05f5b0 0x7fdb3c061a70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fdb54001730 tx=0x7fdb54009040).stop 2023-07-27T14:33:41.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 -- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb58153ec0 msgr2=0x7fdb580afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb58153ec0 0x7fdb580afc80 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fdb4800d860 tx=0x7fdb48008040).stop 2023-07-27T14:33:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 -- 172.21.15.115:0/199220927 shutdown_connections 2023-07-27T14:33:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb3c05f5b0 0x7fdb3c061a70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb581542a0 0x7fdb58152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb580aaa40 0x7fdb580c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 --2- 172.21.15.115:0/199220927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb58153ec0 0x7fdb580afc80 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.450+0000 7fdb5fdff700 1 -- 172.21.15.115:0/199220927 >> 172.21.15.115:0/199220927 conn(0x7fdb580cb610 msgr2=0x7fdb580ab560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.451+0000 7fdb5fdff700 1 -- 172.21.15.115:0/199220927 shutdown_connections 2023-07-27T14:33:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.451+0000 7fdb5fdff700 1 -- 172.21.15.115:0/199220927 wait complete. 2023-07-27T14:33:41.506 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:33:41.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.625+0000 7f36ed3ff700 1 Processor -- start 2023-07-27T14:33:41.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.625+0000 7f36ed3ff700 1 -- start start 2023-07-27T14:33:41.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.626+0000 7f36ed3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f36e8065b30 0x7f36e8154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.626+0000 7f36ed3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e8155410 con 0x7f36e80a48a0 2023-07-27T14:33:41.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.626+0000 7f36ed3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80c12e0 con 0x7f36e80c2920 2023-07-27T14:33:41.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.626+0000 7f36ed3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e80c2440 con 0x7f36e8065b30 2023-07-27T14:33:41.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.626+0000 7f36e77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f36e80a48a0 0x7f36e80bbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56750/0 (socket says 172.21.15.115:56750) 2023-07-27T14:33:41.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.626+0000 7f36e77fe700 1 -- 172.21.15.115:0/2782028848 learned_addr learned my addr 172.21.15.115:0/2782028848 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:41.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.626+0000 7f36e6ffd700 1 --2- 172.21.15.115:0/2782028848 >> v2:172.21.15.159:3300/0 conn(0x7f36e8065b30 0x7f36e8154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e5ffb700 1 -- 172.21.15.115:0/2782028848 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859851585 0 0) 0x7f36e8155410 con 0x7f36e80a48a0 2023-07-27T14:33:41.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e5ffb700 1 -- 172.21.15.115:0/2782028848 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d00033f0 con 0x7f36e80a48a0 2023-07-27T14:33:41.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e5ffb700 1 -- 172.21.15.115:0/2782028848 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818858856 0 0) 0x7f36e80c12e0 con 0x7f36e80c2920 2023-07-27T14:33:41.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e5ffb700 1 -- 172.21.15.115:0/2782028848 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36e8155410 con 0x7f36e80c2920 2023-07-27T14:33:41.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e6ffd700 1 -- 172.21.15.115:0/2782028848 >> v1:172.21.15.159:6789/0 conn(0x7f36e80c2920 legacy=0x7f36e80c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e6ffd700 1 -- 172.21.15.115:0/2782028848 >> v1:172.21.15.115:6789/0 conn(0x7f36e80a48a0 legacy=0x7f36e80bbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e5ffb700 1 -- 172.21.15.115:0/2782028848 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142290160 0 0) 0x7f36d00033f0 con 0x7f36e80a48a0 2023-07-27T14:33:41.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e6ffd700 1 -- 172.21.15.115:0/2782028848 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80c2da0 con 0x7f36e8065b30 2023-07-27T14:33:41.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e6ffd700 1 --2- 172.21.15.115:0/2782028848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e8065b30 0x7f36e8154f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f36d8009760 tx=0x7f36d8009060).ready entity=mon.1 client_cookie=1dc4565192ed49e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e5ffb700 1 -- 172.21.15.115:0/2782028848 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00017f0 con 0x7f36e8065b30 2023-07-27T14:33:41.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e5ffb700 1 -- 172.21.15.115:0/2782028848 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8011400 con 0x7f36e8065b30 2023-07-27T14:33:41.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.627+0000 7f36e5ffb700 1 -- 172.21.15.115:0/2782028848 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8011780 con 0x7f36e8065b30 2023-07-27T14:33:41.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.628+0000 7f36ed3ff700 1 -- 172.21.15.115:0/2782028848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e8065b30 msgr2=0x7f36e8154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.628+0000 7f36ed3ff700 1 --2- 172.21.15.115:0/2782028848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e8065b30 0x7f36e8154f20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f36d8009760 tx=0x7f36d8009060).stop 2023-07-27T14:33:41.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.628+0000 7f36ed3ff700 1 -- 172.21.15.115:0/2782028848 shutdown_connections 2023-07-27T14:33:41.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.628+0000 7f36ed3ff700 1 --2- 172.21.15.115:0/2782028848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e8065b30 0x7f36e8154f20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.628+0000 7f36ed3ff700 1 -- 172.21.15.115:0/2782028848 >> 172.21.15.115:0/2782028848 conn(0x7f36e8062ec0 msgr2=0x7f36e80c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:41.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.628+0000 7f36ed3ff700 1 -- 172.21.15.115:0/2782028848 shutdown_connections 2023-07-27T14:33:41.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.628+0000 7f36ed3ff700 1 -- 172.21.15.115:0/2782028848 wait complete. 2023-07-27T14:33:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.629+0000 7f36ed3ff700 1 Processor -- start 2023-07-27T14:33:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.630+0000 7f36ed3ff700 1 -- start start 2023-07-27T14:33:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.630+0000 7f36ed3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36e8065b30 0x7f36e8147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.630+0000 7f36ed3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80a48a0 0x7f36e8156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36ed3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e80c2920 0x7f36e814a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36ed3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8147fd0 con 0x7f36e80a48a0 2023-07-27T14:33:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36ed3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80c5b40 con 0x7f36e80c2920 2023-07-27T14:33:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36ed3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80c5e20 con 0x7f36e8065b30 2023-07-27T14:33:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80a48a0 0x7f36e8156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80a48a0 0x7f36e8156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48904/0 (socket says 172.21.15.115:48904) 2023-07-27T14:33:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 -- 172.21.15.115:0/3827033097 learned_addr learned my addr 172.21.15.115:0/3827033097 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e6ffd700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36e8065b30 0x7f36e8147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e77fe700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e80c2920 0x7f36e814a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 -- 172.21.15.115:0/3827033097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36e8065b30 msgr2=0x7f36e8147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36e8065b30 0x7f36e8147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 -- 172.21.15.115:0/3827033097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e80c2920 msgr2=0x7f36e814a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e80c2920 0x7f36e814a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 -- 172.21.15.115:0/3827033097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d80092a0 con 0x7f36e80a48a0 2023-07-27T14:33:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.631+0000 7f36e67fc700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80a48a0 0x7f36e8156720 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f36dc00c440 tx=0x7f36dc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.632+0000 7f36ceffd700 1 -- 172.21.15.115:0/3827033097 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc012400 con 0x7f36e80a48a0 2023-07-27T14:33:41.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.632+0000 7f36ceffd700 1 -- 172.21.15.115:0/3827033097 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc012560 con 0x7f36e80a48a0 2023-07-27T14:33:41.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.632+0000 7f36ceffd700 1 -- 172.21.15.115:0/3827033097 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc012920 con 0x7f36e80a48a0 2023-07-27T14:33:41.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.632+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e80c6100 con 0x7f36e80a48a0 2023-07-27T14:33:41.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.632+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e8147c00 con 0x7f36e80a48a0 2023-07-27T14:33:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.633+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e805f0c0 con 0x7f36e80a48a0 2023-07-27T14:33:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.634+0000 7f36ceffd700 1 -- 172.21.15.115:0/3827033097 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f36dc019030 con 0x7f36e80a48a0 2023-07-27T14:33:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.635+0000 7f36ceffd700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f36d405f5b0 0x7f36d4061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.635+0000 7f36ceffd700 1 -- 172.21.15.115:0/3827033097 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f36dc079c10 con 0x7f36e80a48a0 2023-07-27T14:33:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.635+0000 7f36e6ffd700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f36d405f5b0 0x7f36d4061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:41.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.635+0000 7f36e6ffd700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f36d405f5b0 0x7f36d4061a70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f36d8009760 tx=0x7f36d8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:41.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.639+0000 7f36ceffd700 1 -- 172.21.15.115:0/3827033097 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f36dc04ab10 con 0x7f36e80a48a0 2023-07-27T14:33:41.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.852+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36e80c3070 con 0x7f36e80a48a0 2023-07-27T14:33:41.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.852+0000 7f36ceffd700 1 -- 172.21.15.115:0/3827033097 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7f36dc04e130 con 0x7f36e80a48a0 2023-07-27T14:33:41.892 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:33:41.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f36d405f5b0 msgr2=0x7f36d4061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f36d405f5b0 0x7f36d4061a70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f36d8009760 tx=0x7f36d8016000).stop 2023-07-27T14:33:41.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80a48a0 msgr2=0x7f36e8156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:41.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80a48a0 0x7f36e8156720 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f36dc00c440 tx=0x7f36dc007c90).stop 2023-07-27T14:33:41.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 shutdown_connections 2023-07-27T14:33:41.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f36d405f5b0 0x7f36d4061a70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e80c2920 0x7f36e814a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36e8065b30 0x7f36e8147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 --2- 172.21.15.115:0/3827033097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80a48a0 0x7f36e8156720 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:41.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.854+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 >> 172.21.15.115:0/3827033097 conn(0x7f36e8062ec0 msgr2=0x7f36e815a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:41.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.855+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 shutdown_connections 2023-07-27T14:33:41.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:41.855+0000 7f36ed3ff700 1 -- 172.21.15.115:0/3827033097 wait complete. 2023-07-27T14:33:41.909 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:33:41.909 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:33:41.909 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:33:41.910 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:33:41.910 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:33:41.910 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:33:41.910 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:33:41.911 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:33:41.911 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:33:41.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:41.912 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:33:41.958 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:33:41.959 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:33:41.959 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:33:41.959 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:41.959 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:33:41.959 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:41.959 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:41.960 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:41.960 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:33:41.960 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:41.960 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:41.960 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:33:41.960 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:41.960 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:41.961 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:33:41.961 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:41.961 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:33:41.961 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41579sec preferred_lft 41579sec 2023-07-27T14:33:41.961 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:33:41.961 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:41.961 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:33:41.961 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:41.962 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:33:41.962 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:41.962 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:33:41.962 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:41.962 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:33:41.962 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:33:41.962 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:33:41.962 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:41.963 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:33:41.963 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:33:41.963 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:33:41.963 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:41.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:41.964 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:33:42.031 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:33:42.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:42.034 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:33:42.083 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:33:42.083 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:33:42.083 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:33:42.083 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:33:42.083 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:33:42.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:42.085 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:33:42.085 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:33:42.085 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:33:42.085 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:33:42.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:33:42.086 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:33:42.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:42.255 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:33:42.300 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:33:42.301 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:33:42.301 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:33:42.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:42.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:33:42.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:42.411 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:33:42.456 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:33:42.457 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:42.593 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:42.593 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:33:42.619 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:42.619 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:33:42.623 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:33:42.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:42.624 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:33:42.693 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:33:42.865 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.825+0000 7f09e8fff700 1 Processor -- start 2023-07-27T14:33:42.865 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.825+0000 7f09e8fff700 1 -- start start 2023-07-27T14:33:42.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e8fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e4154190 0x7f09e40a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:42.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e8fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09e40c64b0 0x7f09e40641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:42.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e8fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e4064b70 con 0x7f09e40646c0 2023-07-27T14:33:42.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e8fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e40aa640 con 0x7f09e40c64b0 2023-07-27T14:33:42.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e8fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4158e00 con 0x7f09e4154190 2023-07-27T14:33:42.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e259c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e4154190 0x7f09e40a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:42.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e259c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e4154190 0x7f09e40a9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57096/0 (socket says 172.21.15.159:57096) 2023-07-27T14:33:42.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e259c700 1 -- 172.21.15.159:0/2144206124 learned_addr learned my addr 172.21.15.159:0/2144206124 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:33:42.868 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e2d9d700 1 --1- 172.21.15.159:0/2144206124 >> v1:172.21.15.159:6789/0 conn(0x7f09e40646c0 0x7f09e40bfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:48886/0 (socket says 172.21.15.159:48886) 2023-07-27T14:33:42.868 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e1d9b700 1 --2- 172.21.15.159:0/2144206124 >> v2:172.21.15.115:3300/0 conn(0x7f09e40c64b0 0x7f09e40641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:42.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e259c700 1 -- 172.21.15.159:0/2144206124 >> v2:172.21.15.115:3300/0 conn(0x7f09e40c64b0 msgr2=0x7f09e40641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:42.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.827+0000 7f09e259c700 1 --2- 172.21.15.159:0/2144206124 >> v2:172.21.15.115:3300/0 conn(0x7f09e40c64b0 0x7f09e40641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:42.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.828+0000 7f09e259c700 1 -- 172.21.15.159:0/2144206124 >> v1:172.21.15.159:6789/0 conn(0x7f09e40646c0 legacy=0x7f09e40bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:42.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.828+0000 7f09e259c700 1 -- 172.21.15.159:0/2144206124 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e4158040 con 0x7f09e4154190 2023-07-27T14:33:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.828+0000 7f09e259c700 1 --2- 172.21.15.159:0/2144206124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e4154190 0x7f09e40a9d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f09d4006fd0 tx=0x7f09d40090f0).ready entity=mon.2 client_cookie=6e046b1a1016fc9c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.828+0000 7f09e159a700 1 -- 172.21.15.159:0/2144206124 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400b580 con 0x7f09e4154190 2023-07-27T14:33:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.828+0000 7f09e159a700 1 -- 172.21.15.159:0/2144206124 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400b6e0 con 0x7f09e4154190 2023-07-27T14:33:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.828+0000 7f09e159a700 1 -- 172.21.15.159:0/2144206124 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400ba60 con 0x7f09e4154190 2023-07-27T14:33:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.828+0000 7f09e8fff700 1 -- 172.21.15.159:0/2144206124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e4154190 msgr2=0x7f09e40a9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.828+0000 7f09e8fff700 1 --2- 172.21.15.159:0/2144206124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e4154190 0x7f09e40a9d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f09d4006fd0 tx=0x7f09d40090f0).stop 2023-07-27T14:33:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.829+0000 7f09e8fff700 1 -- 172.21.15.159:0/2144206124 shutdown_connections 2023-07-27T14:33:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.829+0000 7f09e8fff700 1 --2- 172.21.15.159:0/2144206124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e4154190 0x7f09e40a9d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:42.871 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.829+0000 7f09e8fff700 1 --2- 172.21.15.159:0/2144206124 >> v2:172.21.15.115:3300/0 conn(0x7f09e40c64b0 0x7f09e40641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:42.871 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.829+0000 7f09e8fff700 1 -- 172.21.15.159:0/2144206124 >> 172.21.15.159:0/2144206124 conn(0x7f09e40cb730 msgr2=0x7f09e40c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:42.871 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.829+0000 7f09e8fff700 1 -- 172.21.15.159:0/2144206124 shutdown_connections 2023-07-27T14:33:42.871 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.829+0000 7f09e8fff700 1 -- 172.21.15.159:0/2144206124 wait complete. 2023-07-27T14:33:42.872 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.830+0000 7f09e8fff700 1 Processor -- start 2023-07-27T14:33:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.830+0000 7f09e8fff700 1 -- start start 2023-07-27T14:33:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e8fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40646c0 0x7f09e4141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e8fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e40c64b0 0x7f09e40c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e8fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e4154190 0x7f09e40c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e8fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c39d0 con 0x7f09e40646c0 2023-07-27T14:33:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e8fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c2dc0 con 0x7f09e4154190 2023-07-27T14:33:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e8fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c30a0 con 0x7f09e40c64b0 2023-07-27T14:33:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e1d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e40c64b0 0x7f09e40c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e2d9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e4154190 0x7f09e40c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e1d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e40c64b0 0x7f09e40c2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:57104/0 (socket says 172.21.15.159:57104) 2023-07-27T14:33:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.831+0000 7f09e1d9b700 1 -- 172.21.15.159:0/1382875182 learned_addr learned my addr 172.21.15.159:0/1382875182 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:33:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e259c700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40646c0 0x7f09e4141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e1d9b700 1 -- 172.21.15.159:0/1382875182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e4154190 msgr2=0x7f09e40c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e1d9b700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e4154190 0x7f09e40c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e1d9b700 1 -- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40646c0 msgr2=0x7f09e4141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e1d9b700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40646c0 0x7f09e4141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e1d9b700 1 -- 172.21.15.159:0/1382875182 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d4009370 con 0x7f09e40c64b0 2023-07-27T14:33:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e1d9b700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e40c64b0 0x7f09e40c2300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f09d800e900 tx=0x7f09d8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09d27fc700 1 -- 172.21.15.159:0/1382875182 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8012600 con 0x7f09e40c64b0 2023-07-27T14:33:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09d27fc700 1 -- 172.21.15.159:0/1382875182 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8012760 con 0x7f09e40c64b0 2023-07-27T14:33:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e40c3380 con 0x7f09e40c64b0 2023-07-27T14:33:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09d27fc700 1 -- 172.21.15.159:0/1382875182 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8012ae0 con 0x7f09e40c64b0 2023-07-27T14:33:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.832+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e40c1f90 con 0x7f09e40c64b0 2023-07-27T14:33:42.876 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.833+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40c3b80 con 0x7f09e40c64b0 2023-07-27T14:33:42.876 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.834+0000 7f09d27fc700 1 -- 172.21.15.159:0/1382875182 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f09d8022070 con 0x7f09e40c64b0 2023-07-27T14:33:42.876 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.835+0000 7f09d27fc700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09c405f5e0 0x7f09c4061aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.835+0000 7f09d27fc700 1 -- 172.21.15.159:0/1382875182 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f09d807a830 con 0x7f09e40c64b0 2023-07-27T14:33:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.836+0000 7f09e259c700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09c405f5e0 0x7f09c4061aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:42.877 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.836+0000 7f09e259c700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09c405f5e0 0x7f09c4061aa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f09d4006df0 tx=0x7f09d4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:42.840+0000 7f09d27fc700 1 -- 172.21.15.159:0/1382875182 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09e40c3b80 con 0x7f09e40c64b0 2023-07-27T14:33:43.089 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.050+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f09e40c3b40 con 0x7f09e40c64b0 2023-07-27T14:33:43.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.050+0000 7f09d27fc700 1 -- 172.21.15.159:0/1382875182 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7f09d804b790 con 0x7f09e40c64b0 2023-07-27T14:33:43.090 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:33:43.092 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09c405f5e0 msgr2=0x7f09c4061aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:43.092 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09c405f5e0 0x7f09c4061aa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f09d4006df0 tx=0x7f09d4017000).stop 2023-07-27T14:33:43.092 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e40c64b0 msgr2=0x7f09e40c2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:43.092 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e40c64b0 0x7f09e40c2300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f09d800e900 tx=0x7f09d8009060).stop 2023-07-27T14:33:43.092 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 shutdown_connections 2023-07-27T14:33:43.092 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f09c405f5e0 0x7f09c4061aa0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:43.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e4154190 0x7f09e40c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:43.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40646c0 0x7f09e4141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:43.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 --2- 172.21.15.159:0/1382875182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09e40c64b0 0x7f09e40c2300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:43.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 >> 172.21.15.159:0/1382875182 conn(0x7f09e40cb730 msgr2=0x7f09e4157570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:43.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 shutdown_connections 2023-07-27T14:33:43.093 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:33:43.052+0000 7f09e8fff700 1 -- 172.21.15.159:0/1382875182 wait complete. 2023-07-27T14:33:43.106 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:33:43.107 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:33:43.107 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:33:43.107 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:33:43.107 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:33:43.108 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:33:43.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:33:43.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:33:43.108 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:33:43.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:43.109 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:33:43.157 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:33:43.157 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:33:43.157 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:33:43.157 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:43.158 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:33:43.158 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:43.158 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:43.158 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:43.158 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:33:43.158 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:43.158 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:43.158 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:33:43.159 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:33:43.159 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:43.159 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:33:43.159 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:43.159 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:33:43.159 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41574sec preferred_lft 41574sec 2023-07-27T14:33:43.159 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:33:43.160 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:43.160 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:33:43.160 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:33:43.160 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:33:43.160 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:43.160 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:33:43.160 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:43.160 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:33:43.161 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:33:43.161 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:33:43.161 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:43.161 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:33:43.161 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:33:43.161 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:33:43.161 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:33:43.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:43.162 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:33:43.229 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:33:43.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:43.232 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:33:43.282 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:33:43.283 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:33:43.283 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:33:43.283 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:33:43.283 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:33:43.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:43.284 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:33:43.285 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:33:43.285 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:33:43.285 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:33:43.285 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:33:43.286 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:33:43.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:43.458 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:33:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:33:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:33:43.505 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:33:43.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:43.506 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:33:43.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:43.577 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:33:43.623 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:33:43.624 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:43.726 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:43.726 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:33:43.752 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:33:43.753 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:33:43.757 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:33:43.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:33:43.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:33:43.828 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:33:44.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.990+0000 7eff329ff700 1 Processor -- start 2023-07-27T14:33:44.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.990+0000 7eff329ff700 1 -- start start 2023-07-27T14:33:44.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.991+0000 7eff329ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 0x7eff2c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.991+0000 7eff329ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c0bd9a0 con 0x7eff2c13a730 2023-07-27T14:33:44.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.991+0000 7eff329ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c066610 con 0x7eff2c13a350 2023-07-27T14:33:44.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.991+0000 7eff329ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c066400 con 0x7eff2c0c36b0 2023-07-27T14:33:44.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7eff2c13a730 0x7eff2c0be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43028/0 (socket says 172.21.15.115:43028) 2023-07-27T14:33:44.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2b7fe700 1 -- 172.21.15.115:0/1097195163 learned_addr learned my addr 172.21.15.115:0/1097195163 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:44.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff30f9c700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 0x7eff2c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316491494 0 0) 0x7eff2c0bd9a0 con 0x7eff2c13a730 2023-07-27T14:33:44.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff140033f0 con 0x7eff2c13a730 2023-07-27T14:33:44.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748361555 0 0) 0x7eff2c066610 con 0x7eff2c13a350 2023-07-27T14:33:44.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff2c0bd9a0 con 0x7eff2c13a350 2023-07-27T14:33:44.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019356048 0 0) 0x7eff140033f0 con 0x7eff2c13a730 2023-07-27T14:33:44.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 msgr2=0x7eff2c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:44.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2affd700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 0x7eff2c065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.992+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 >> v1:172.21.15.159:6789/0 conn(0x7eff2c13a350 legacy=0x7eff2c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0bdc10 con 0x7eff2c13a730 2023-07-27T14:33:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7eff20001470 con 0x7eff2c13a730 2023-07-27T14:33:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff30f9c700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 0x7eff2c065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 >> v1:172.21.15.115:6789/0 conn(0x7eff2c13a730 legacy=0x7eff2c0be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14003aa0 0x7eff14003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 0x7eff14004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14004b80 0x7eff14005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c066400 con 0x7eff14004b80 2023-07-27T14:33:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1400b8e0 con 0x7eff14003aa0 2023-07-27T14:33:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1400baa0 con 0x7eff2c0c36b0 2023-07-27T14:33:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2b7fe700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 0x7eff14004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff30f9c700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14004b80 0x7eff14005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2bfff700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14003aa0 0x7eff14003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff30f9c700 1 -- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 msgr2=0x7eff14004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:44.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff30f9c700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 0x7eff14004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff30f9c700 1 -- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14003aa0 msgr2=0x7eff14003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:44.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff30f9c700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14003aa0 0x7eff14003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff30f9c700 1 -- 172.21.15.115:0/1097195163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24009a20 con 0x7eff14004b80 2023-07-27T14:33:44.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.993+0000 7eff2b7fe700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c0c36b0 0x7eff14004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:44.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff30f9c700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14004b80 0x7eff14005000 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7eff2c0c9a10 tx=0x7eff2400b040).ready entity=mon.0 client_cookie=a322521d37f347e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:44.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24017070 con 0x7eff14004b80 2023-07-27T14:33:44.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2400f040 con 0x7eff14004b80 2023-07-27T14:33:44.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff2affd700 1 -- 172.21.15.115:0/1097195163 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2400ee20 con 0x7eff14004b80 2023-07-27T14:33:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff329ff700 1 -- 172.21.15.115:0/1097195163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14004b80 msgr2=0x7eff14005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff329ff700 1 --2- 172.21.15.115:0/1097195163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14004b80 0x7eff14005000 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7eff2c0c9a10 tx=0x7eff2400b040).stop 2023-07-27T14:33:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff30f9c700 1 -- 172.21.15.115:0/1097195163 reap_dead start 2023-07-27T14:33:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff329ff700 1 -- 172.21.15.115:0/1097195163 shutdown_connections 2023-07-27T14:33:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff329ff700 1 -- 172.21.15.115:0/1097195163 >> 172.21.15.115:0/1097195163 conn(0x7eff2c05e8f0 msgr2=0x7eff2c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff329ff700 1 -- 172.21.15.115:0/1097195163 shutdown_connections 2023-07-27T14:33:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.994+0000 7eff329ff700 1 -- 172.21.15.115:0/1097195163 wait complete. 2023-07-27T14:33:44.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.996+0000 7eff329ff700 1 Processor -- start 2023-07-27T14:33:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.996+0000 7eff329ff700 1 -- start start 2023-07-27T14:33:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff329ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14004b80 0x7eff2c0c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff329ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c2280 0x7eff2c1651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff329ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c1656e0 0x7eff2c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff329ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c165b60 con 0x7eff2c0c2280 2023-07-27T14:33:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff329ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c1900 con 0x7eff14004b80 2023-07-27T14:33:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff329ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c51f0 con 0x7eff2c1656e0 2023-07-27T14:33:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff2b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c2280 0x7eff2c1651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff2b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c2280 0x7eff2c1651f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34048/0 (socket says 172.21.15.115:34048) 2023-07-27T14:33:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff2b7fe700 1 -- 172.21.15.115:0/2299895908 learned_addr learned my addr 172.21.15.115:0/2299895908 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff2bfff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14004b80 0x7eff2c0c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.997+0000 7eff30f9c700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c1656e0 0x7eff2c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff2b7fe700 1 -- 172.21.15.115:0/2299895908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c1656e0 msgr2=0x7eff2c0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff2b7fe700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c1656e0 0x7eff2c0c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff2b7fe700 1 -- 172.21.15.115:0/2299895908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14004b80 msgr2=0x7eff2c0c1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff2b7fe700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14004b80 0x7eff2c0c1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff2b7fe700 1 -- 172.21.15.115:0/2299895908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0c0cf0 con 0x7eff2c0c2280 2023-07-27T14:33:44.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff2b7fe700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c2280 0x7eff2c1651f0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7eff200049e0 tx=0x7eff20001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:44.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff13fff700 1 -- 172.21.15.115:0/2299895908 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20011590 con 0x7eff2c0c2280 2023-07-27T14:33:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff13fff700 1 -- 172.21.15.115:0/2299895908 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff200116f0 con 0x7eff2c0c2280 2023-07-27T14:33:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c0c0fd0 con 0x7eff2c0c2280 2023-07-27T14:33:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff13fff700 1 -- 172.21.15.115:0/2299895908 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20011a90 con 0x7eff2c0c2280 2023-07-27T14:33:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.998+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c0c1590 con 0x7eff2c0c2280 2023-07-27T14:33:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:43.999+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c0c1750 con 0x7eff2c0c2280 2023-07-27T14:33:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.000+0000 7eff13fff700 1 -- 172.21.15.115:0/2299895908 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7eff2001b030 con 0x7eff2c0c2280 2023-07-27T14:33:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.001+0000 7eff13fff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1805f5b0 0x7eff18061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.001+0000 7eff13fff700 1 -- 172.21.15.115:0/2299895908 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7eff20079fe0 con 0x7eff2c0c2280 2023-07-27T14:33:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.001+0000 7eff2bfff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1805f5b0 0x7eff18061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.001+0000 7eff2bfff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1805f5b0 0x7eff18061a70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7eff1c007fd0 tx=0x7eff1c007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.005+0000 7eff13fff700 1 -- 172.21.15.115:0/2299895908 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff200a88f0 con 0x7eff2c0c2280 2023-07-27T14:33:44.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.216+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff2c0c1a90 con 0x7eff2c0c2280 2023-07-27T14:33:44.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.634+0000 7eff13fff700 1 -- 172.21.15.115:0/2299895908 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v69) v1 ==== 136+0+0 (secure 0 0 0) 0x7eff2004afc0 con 0x7eff2c0c2280 2023-07-27T14:33:44.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1805f5b0 msgr2=0x7eff18061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1805f5b0 0x7eff18061a70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7eff1c007fd0 tx=0x7eff1c007bb0).stop 2023-07-27T14:33:44.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c2280 msgr2=0x7eff2c1651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c2280 0x7eff2c1651f0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7eff200049e0 tx=0x7eff20001e10).stop 2023-07-27T14:33:44.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 shutdown_connections 2023-07-27T14:33:44.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7eff1805f5b0 0x7eff18061a70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff2c1656e0 0x7eff2c0c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff14004b80 0x7eff2c0c1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 --2- 172.21.15.115:0/2299895908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff2c0c2280 0x7eff2c1651f0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 >> 172.21.15.115:0/2299895908 conn(0x7eff2c05e8f0 msgr2=0x7eff2c0ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:44.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 shutdown_connections 2023-07-27T14:33:44.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.636+0000 7eff329ff700 1 -- 172.21.15.115:0/2299895908 wait complete. 2023-07-27T14:33:44.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:33:44.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.843+0000 7fb8535ff700 1 Processor -- start 2023-07-27T14:33:44.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.843+0000 7fb8535ff700 1 -- start start 2023-07-27T14:33:44.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.844+0000 7fb8535ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c151bd0 0x7fb84c062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.844+0000 7fb8535ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84c0639d0 con 0x7fb84c0a4f50 2023-07-27T14:33:44.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.844+0000 7fb8535ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84c062dc0 con 0x7fb84c062810 2023-07-27T14:33:44.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.844+0000 7fb8535ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c137610 con 0x7fb84c151bd0 2023-07-27T14:33:44.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb851b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb84c0a4f50 0x7fb84c0bc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43044/0 (socket says 172.21.15.115:43044) 2023-07-27T14:33:44.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb851b9c700 1 -- 172.21.15.115:0/3235257092 learned_addr learned my addr 172.21.15.115:0/3235257092 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:44.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341495146 0 0) 0x7fb84c0639d0 con 0x7fb84c0a4f50 2023-07-27T14:33:44.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb85139b700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c151bd0 0x7fb84c062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8380033f0 con 0x7fb84c0a4f50 2023-07-27T14:33:44.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2408565768 0 0) 0x7fb8380033f0 con 0x7fb84c0a4f50 2023-07-27T14:33:44.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c151bd0 msgr2=0x7fb84c062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:44.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c151bd0 0x7fb84c062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 >> v1:172.21.15.159:6789/0 conn(0x7fb84c062810 legacy=0x7fb84c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c0630a0 con 0x7fb84c0a4f50 2023-07-27T14:33:44.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb8440017f0 con 0x7fb84c0a4f50 2023-07-27T14:33:44.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 >> v1:172.21.15.115:6789/0 conn(0x7fb84c0a4f50 legacy=0x7fb84c0bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb838003910 0x7fb838003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c151bd0 0x7fb838004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb838004b80 0x7fb838005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83800b8e0 con 0x7fb838004b80 2023-07-27T14:33:44.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83800ba50 con 0x7fb838003910 2023-07-27T14:33:44.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.845+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83800bc10 con 0x7fb84c151bd0 2023-07-27T14:33:44.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb851b9c700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb838004b80 0x7fb838005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb85139b700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb838003910 0x7fb838003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb850b9a700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c151bd0 0x7fb838004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb851b9c700 1 -- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c151bd0 msgr2=0x7fb838004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb851b9c700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c151bd0 0x7fb838004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb851b9c700 1 -- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb838003910 msgr2=0x7fb838003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb851b9c700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb838003910 0x7fb838003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb851b9c700 1 -- 172.21.15.115:0/3235257092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380033f0 con 0x7fb838004b80 2023-07-27T14:33:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb851b9c700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb838004b80 0x7fb838005000 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fb84400c450 tx=0x7fb84400c760).ready entity=mon.0 client_cookie=63920e9885b4808 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:44.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844002030 con 0x7fb838004b80 2023-07-27T14:33:44.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84400cdf0 con 0x7fb838004b80 2023-07-27T14:33:44.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.846+0000 7fb843fff700 1 -- 172.21.15.115:0/3235257092 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844005d70 con 0x7fb838004b80 2023-07-27T14:33:44.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.847+0000 7fb8535ff700 1 -- 172.21.15.115:0/3235257092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb838004b80 msgr2=0x7fb838005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.847+0000 7fb8535ff700 1 --2- 172.21.15.115:0/3235257092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb838004b80 0x7fb838005000 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fb84400c450 tx=0x7fb84400c760).stop 2023-07-27T14:33:44.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.847+0000 7fb851b9c700 1 -- 172.21.15.115:0/3235257092 reap_dead start 2023-07-27T14:33:44.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.847+0000 7fb8535ff700 1 -- 172.21.15.115:0/3235257092 shutdown_connections 2023-07-27T14:33:44.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.847+0000 7fb8535ff700 1 -- 172.21.15.115:0/3235257092 >> 172.21.15.115:0/3235257092 conn(0x7fb84c064700 msgr2=0x7fb84c064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:44.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.847+0000 7fb8535ff700 1 -- 172.21.15.115:0/3235257092 shutdown_connections 2023-07-27T14:33:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.847+0000 7fb8535ff700 1 -- 172.21.15.115:0/3235257092 wait complete. 2023-07-27T14:33:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.849+0000 7fb8535ff700 1 Processor -- start 2023-07-27T14:33:44.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.849+0000 7fb8535ff700 1 -- start start 2023-07-27T14:33:44.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb8535ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb838004b80 0x7fb84c135d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb8535ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb84c13c7f0 0x7fb84c13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb8535ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c0bd380 0x7fb84c0bd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb8535ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c0a9530 con 0x7fb84c13c7f0 2023-07-27T14:33:44.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb8535ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c0bdcf0 con 0x7fb838004b80 2023-07-27T14:33:44.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb8535ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c137900 con 0x7fb84c0bd380 2023-07-27T14:33:44.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb84c13c7f0 0x7fb84c13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb84c13c7f0 0x7fb84c13cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34064/0 (socket says 172.21.15.115:34064) 2023-07-27T14:33:44.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 -- 172.21.15.115:0/156267484 learned_addr learned my addr 172.21.15.115:0/156267484 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:44.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 -- 172.21.15.115:0/156267484 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c0bd380 msgr2=0x7fb84c0bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c0bd380 0x7fb84c0bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:44.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 -- 172.21.15.115:0/156267484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb838004b80 msgr2=0x7fb84c135d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:44.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb838004b80 0x7fb84c135d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:44.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 -- 172.21.15.115:0/156267484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c137be0 con 0x7fb84c13c7f0 2023-07-27T14:33:44.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.850+0000 7fb850b9a700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb84c13c7f0 0x7fb84c13cc70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fb83c007900 tx=0x7fb83c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:44.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.851+0000 7fb8417fa700 1 -- 172.21.15.115:0/156267484 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011590 con 0x7fb84c13c7f0 2023-07-27T14:33:44.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.851+0000 7fb8417fa700 1 -- 172.21.15.115:0/156267484 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c0116f0 con 0x7fb84c13c7f0 2023-07-27T14:33:44.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.851+0000 7fb8417fa700 1 -- 172.21.15.115:0/156267484 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011a70 con 0x7fb84c13c7f0 2023-07-27T14:33:44.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.851+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c137ec0 con 0x7fb84c13c7f0 2023-07-27T14:33:44.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.851+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c138480 con 0x7fb84c13c7f0 2023-07-27T14:33:44.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.852+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c06c470 con 0x7fb84c13c7f0 2023-07-27T14:33:44.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.853+0000 7fb8417fa700 1 -- 172.21.15.115:0/156267484 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7fb83c01b030 con 0x7fb84c13c7f0 2023-07-27T14:33:44.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.854+0000 7fb8417fa700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb83005f5b0 0x7fb830061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:44.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.854+0000 7fb8417fa700 1 -- 172.21.15.115:0/156267484 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb83c079ff0 con 0x7fb84c13c7f0 2023-07-27T14:33:44.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.854+0000 7fb85139b700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb83005f5b0 0x7fb830061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:44.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.854+0000 7fb85139b700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb83005f5b0 0x7fb830061a70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fb848006d30 tx=0x7fb848009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:44.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:44.858+0000 7fb8417fa700 1 -- 172.21.15.115:0/156267484 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb83c04a8f0 con 0x7fb84c13c7f0 2023-07-27T14:33:45.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.051+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb84c0c69f0 con 0x7fb83005f5b0 2023-07-27T14:33:45.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.052+0000 7fb8417fa700 1 -- 172.21.15.115:0/156267484 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb84c0c69f0 con 0x7fb83005f5b0 2023-07-27T14:33:45.092 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:33:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:33:45.093 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:33:45.093 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:45.093 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:33:45.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb83005f5b0 msgr2=0x7fb830061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb83005f5b0 0x7fb830061a70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fb848006d30 tx=0x7fb848009060).stop 2023-07-27T14:33:45.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb84c13c7f0 msgr2=0x7fb84c13cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb84c13c7f0 0x7fb84c13cc70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fb83c007900 tx=0x7fb83c007bb0).stop 2023-07-27T14:33:45.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 shutdown_connections 2023-07-27T14:33:45.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb83005f5b0 0x7fb830061a70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb84c0bd380 0x7fb84c0bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:45.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb838004b80 0x7fb84c135d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:33:45.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 --2- 172.21.15.115:0/156267484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb84c13c7f0 0x7fb84c13cc70 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 >> 172.21.15.115:0/156267484 conn(0x7fb84c064700 msgr2=0x7fb84c0a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:45.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 shutdown_connections 2023-07-27T14:33:45.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.054+0000 7fb8535ff700 1 -- 172.21.15.115:0/156267484 wait complete. 2023-07-27T14:33:45.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:33:45.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.263+0000 7f5dba7ff700 1 Processor -- start 2023-07-27T14:33:45.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.263+0000 7f5dba7ff700 1 -- start start 2023-07-27T14:33:45.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.264+0000 7f5dba7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db414ae00 0x7f5db4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.264+0000 7f5dba7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5db4063260 0x7f5db40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.264+0000 7f5dba7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db41553f0 con 0x7f5db414b1e0 2023-07-27T14:33:45.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.264+0000 7f5dba7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db4157a50 con 0x7f5db4063260 2023-07-27T14:33:45.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.264+0000 7f5dba7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4157d10 con 0x7f5db414ae00 2023-07-27T14:33:45.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db8d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5db4063260 0x7f5db40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db8d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5db4063260 0x7f5db40a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34078/0 (socket says 172.21.15.115:34078) 2023-07-27T14:33:45.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db8d9c700 1 -- 172.21.15.115:0/2276533761 learned_addr learned my addr 172.21.15.115:0/2276533761 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:45.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db3fff700 1 --2- 172.21.15.115:0/2276533761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db414ae00 0x7f5db4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db8d9c700 1 -- 172.21.15.115:0/2276533761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db414ae00 msgr2=0x7f5db4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:45.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db8d9c700 1 --2- 172.21.15.115:0/2276533761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db414ae00 0x7f5db4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db8d9c700 1 -- 172.21.15.115:0/2276533761 >> v1:172.21.15.159:6789/0 conn(0x7f5db414b1e0 legacy=0x7f5db4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:45.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db8d9c700 1 -- 172.21.15.115:0/2276533761 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db4157ff0 con 0x7f5db4063260 2023-07-27T14:33:45.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db3fff700 1 --2- 172.21.15.115:0/2276533761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db414ae00 0x7f5db4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:45.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db8d9c700 1 --2- 172.21.15.115:0/2276533761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4063260 0x7f5db40a98c0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f5dac009f20 tx=0x7f5dac009840).ready entity=mon.0 client_cookie=18a240a1a5f9efc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:45.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db2ffd700 1 -- 172.21.15.115:0/2276533761 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00e070 con 0x7f5db4063260 2023-07-27T14:33:45.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.265+0000 7f5db2ffd700 1 -- 172.21.15.115:0/2276533761 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac00ba40 con 0x7f5db4063260 2023-07-27T14:33:45.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5db2ffd700 1 -- 172.21.15.115:0/2276533761 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00bdc0 con 0x7f5db4063260 2023-07-27T14:33:45.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2276533761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4063260 msgr2=0x7f5db40a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2276533761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4063260 0x7f5db40a98c0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f5dac009f20 tx=0x7f5dac009840).stop 2023-07-27T14:33:45.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2276533761 shutdown_connections 2023-07-27T14:33:45.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2276533761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db414ae00 0x7f5db4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2276533761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4063260 0x7f5db40a98c0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2276533761 >> 172.21.15.115:0/2276533761 conn(0x7f5db405e940 msgr2=0x7f5db40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:45.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2276533761 shutdown_connections 2023-07-27T14:33:45.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.266+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2276533761 wait complete. 2023-07-27T14:33:45.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.268+0000 7f5dba7ff700 1 Processor -- start 2023-07-27T14:33:45.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.268+0000 7f5dba7ff700 1 -- start start 2023-07-27T14:33:45.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5dba7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db4063260 0x7f5db40b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5dba7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db414ae00 0x7f5db40abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5dba7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5db414b1e0 0x7f5db40ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5dba7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40ac5f0 con 0x7f5db414ae00 2023-07-27T14:33:45.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5dba7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40c2730 con 0x7f5db414b1e0 2023-07-27T14:33:45.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5dba7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40c1e20 con 0x7f5db4063260 2023-07-27T14:33:45.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5db37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db414ae00 0x7f5db40abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5db37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db414ae00 0x7f5db40abc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34084/0 (socket says 172.21.15.115:34084) 2023-07-27T14:33:45.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5db37fe700 1 -- 172.21.15.115:0/2984575487 learned_addr learned my addr 172.21.15.115:0/2984575487 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:45.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5db3fff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db4063260 0x7f5db40b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.269+0000 7f5db8d9c700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5db414b1e0 0x7f5db40ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5db37fe700 1 -- 172.21.15.115:0/2984575487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db4063260 msgr2=0x7f5db40b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5db37fe700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db4063260 0x7f5db40b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5db37fe700 1 -- 172.21.15.115:0/2984575487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5db414b1e0 msgr2=0x7f5db40ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5db37fe700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5db414b1e0 0x7f5db40ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5db37fe700 1 -- 172.21.15.115:0/2984575487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac009ae0 con 0x7f5db414ae00 2023-07-27T14:33:45.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5db37fe700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db414ae00 0x7f5db40abc10 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f5da8009470 tx=0x7f5da8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:45.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5d9bfff700 1 -- 172.21.15.115:0/2984575487 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8013460 con 0x7f5db414ae00 2023-07-27T14:33:45.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5d9bfff700 1 -- 172.21.15.115:0/2984575487 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da80135c0 con 0x7f5db414ae00 2023-07-27T14:33:45.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5d9bfff700 1 -- 172.21.15.115:0/2984575487 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8013980 con 0x7f5db414ae00 2023-07-27T14:33:45.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db40b0b40 con 0x7f5db414ae00 2023-07-27T14:33:45.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.270+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db40c23c0 con 0x7f5db414ae00 2023-07-27T14:33:45.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.271+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db40c28a0 con 0x7f5db414ae00 2023-07-27T14:33:45.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.272+0000 7f5d9bfff700 1 -- 172.21.15.115:0/2984575487 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f5da800f070 con 0x7f5db414ae00 2023-07-27T14:33:45.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.273+0000 7f5d9bfff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5da005f5e0 0x7f5da0061aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.273+0000 7f5d9bfff700 1 -- 172.21.15.115:0/2984575487 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5da8079da0 con 0x7f5db414ae00 2023-07-27T14:33:45.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.273+0000 7f5db3fff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5da005f5e0 0x7f5da0061aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.273+0000 7f5db3fff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5da005f5e0 0x7f5da0061aa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f5da400abd0 tx=0x7f5da4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:45.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.277+0000 7f5d9bfff700 1 -- 172.21.15.115:0/2984575487 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5da804ab20 con 0x7f5db414ae00 2023-07-27T14:33:45.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.446+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5db406c470 con 0x7f5db414ae00 2023-07-27T14:33:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.447+0000 7f5d9bfff700 1 -- 172.21.15.115:0/2984575487 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5da804e140 con 0x7f5db414ae00 2023-07-27T14:33:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5da005f5e0 msgr2=0x7f5da0061aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5da005f5e0 0x7f5da0061aa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f5da400abd0 tx=0x7f5da4008040).stop 2023-07-27T14:33:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db414ae00 msgr2=0x7f5db40abc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db414ae00 0x7f5db40abc10 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f5da8009470 tx=0x7f5da8006ec0).stop 2023-07-27T14:33:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 shutdown_connections 2023-07-27T14:33:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5da005f5e0 0x7f5da0061aa0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5db414b1e0 0x7f5db40ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5db4063260 0x7f5db40b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 --2- 172.21.15.115:0/2984575487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db414ae00 0x7f5db40abc10 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 >> 172.21.15.115:0/2984575487 conn(0x7f5db405e940 msgr2=0x7f5db4152030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 shutdown_connections 2023-07-27T14:33:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.449+0000 7f5dba7ff700 1 -- 172.21.15.115:0/2984575487 wait complete. 2023-07-27T14:33:45.506 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000686370 --mode=777 2023-07-27T14:33:45.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.657+0000 7ff0a4dff700 1 Processor -- start 2023-07-27T14:33:45.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.657+0000 7ff0a4dff700 1 -- start start 2023-07-27T14:33:45.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.658+0000 7ff0a4dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0153e00 0x7ff0a00c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.658+0000 7ff0a4dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0a0065de0 0x7ff0a0062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.658+0000 7ff0a4dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a0064a80 con 0x7ff0a0064230 2023-07-27T14:33:45.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.658+0000 7ff0a4dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a0062320 con 0x7ff0a0065de0 2023-07-27T14:33:45.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.658+0000 7ff0a4dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0064d60 con 0x7ff0a0153e00 2023-07-27T14:33:45.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09ed9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0a0065de0 0x7ff0a0062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09ed9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0a0065de0 0x7ff0a0062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34096/0 (socket says 172.21.15.115:34096) 2023-07-27T14:33:45.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09ed9d700 1 -- 172.21.15.115:0/299863019 learned_addr learned my addr 172.21.15.115:0/299863019 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:45.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09e59c700 1 --2- 172.21.15.115:0/299863019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0153e00 0x7ff0a00c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09ed9d700 1 -- 172.21.15.115:0/299863019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0153e00 msgr2=0x7ff0a00c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:45.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09ed9d700 1 --2- 172.21.15.115:0/299863019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0153e00 0x7ff0a00c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09ed9d700 1 -- 172.21.15.115:0/299863019 >> v1:172.21.15.159:6789/0 conn(0x7ff0a0064230 legacy=0x7ff0a00656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:45.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09ed9d700 1 -- 172.21.15.115:0/299863019 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a0065040 con 0x7ff0a0065de0 2023-07-27T14:33:45.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09e59c700 1 --2- 172.21.15.115:0/299863019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0153e00 0x7ff0a00c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:45.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09ed9d700 1 --2- 172.21.15.115:0/299863019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0065de0 0x7ff0a0062770 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7ff098009f20 tx=0x7ff098009840).ready entity=mon.0 client_cookie=6193a792436fd289 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:45.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.659+0000 7ff09d59a700 1 -- 172.21.15.115:0/299863019 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800e070 con 0x7ff0a0065de0 2023-07-27T14:33:45.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff09d59a700 1 -- 172.21.15.115:0/299863019 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800ba40 con 0x7ff0a0065de0 2023-07-27T14:33:45.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff09d59a700 1 -- 172.21.15.115:0/299863019 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800bdc0 con 0x7ff0a0065de0 2023-07-27T14:33:45.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff0a4dff700 1 -- 172.21.15.115:0/299863019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0065de0 msgr2=0x7ff0a0062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/299863019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0065de0 0x7ff0a0062770 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7ff098009f20 tx=0x7ff098009840).stop 2023-07-27T14:33:45.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff0a4dff700 1 -- 172.21.15.115:0/299863019 shutdown_connections 2023-07-27T14:33:45.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/299863019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0153e00 0x7ff0a00c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/299863019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0065de0 0x7ff0a0062770 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff0a4dff700 1 -- 172.21.15.115:0/299863019 >> 172.21.15.115:0/299863019 conn(0x7ff0a00c7b90 msgr2=0x7ff0a00c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:45.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff0a4dff700 1 -- 172.21.15.115:0/299863019 shutdown_connections 2023-07-27T14:33:45.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.660+0000 7ff0a4dff700 1 -- 172.21.15.115:0/299863019 wait complete. 2023-07-27T14:33:45.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.662+0000 7ff0a4dff700 1 Processor -- start 2023-07-27T14:33:45.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.662+0000 7ff0a4dff700 1 -- start start 2023-07-27T14:33:45.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff0a4dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a0064230 0x7ff0a00aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff0a4dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0065de0 0x7ff0a0144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff0a4dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0153e00 0x7ff0a01675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff0a4dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00919d0 con 0x7ff0a0153e00 2023-07-27T14:33:45.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff0a4dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0091f90 con 0x7ff0a0064230 2023-07-27T14:33:45.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff0a4dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0168040 con 0x7ff0a0065de0 2023-07-27T14:33:45.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0153e00 0x7ff0a01675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0153e00 0x7ff0a01675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34108/0 (socket says 172.21.15.115:34108) 2023-07-27T14:33:45.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 -- 172.21.15.115:0/1785355235 learned_addr learned my addr 172.21.15.115:0/1785355235 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:45.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09e59c700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a0064230 0x7ff0a00aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09dd9b700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0065de0 0x7ff0a0144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 -- 172.21.15.115:0/1785355235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0065de0 msgr2=0x7ff0a0144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0065de0 0x7ff0a0144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 -- 172.21.15.115:0/1785355235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a0064230 msgr2=0x7ff0a00aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a0064230 0x7ff0a00aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 -- 172.21.15.115:0/1785355235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009ae0 con 0x7ff0a0153e00 2023-07-27T14:33:45.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.663+0000 7ff09ed9d700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0153e00 0x7ff0a01675f0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7ff09800bee0 tx=0x7ff098009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:45.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.664+0000 7ff08e7fc700 1 -- 172.21.15.115:0/1785355235 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09801e470 con 0x7ff0a0153e00 2023-07-27T14:33:45.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.664+0000 7ff08e7fc700 1 -- 172.21.15.115:0/1785355235 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09801e5d0 con 0x7ff0a0153e00 2023-07-27T14:33:45.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.664+0000 7ff08e7fc700 1 -- 172.21.15.115:0/1785355235 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09801e970 con 0x7ff0a0153e00 2023-07-27T14:33:45.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.664+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a0168320 con 0x7ff0a0153e00 2023-07-27T14:33:45.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.664+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a00a9510 con 0x7ff0a0153e00 2023-07-27T14:33:45.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.665+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0092120 con 0x7ff0a0153e00 2023-07-27T14:33:45.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.666+0000 7ff08e7fc700 1 -- 172.21.15.115:0/1785355235 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7ff098025030 con 0x7ff0a0153e00 2023-07-27T14:33:45.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.666+0000 7ff08e7fc700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08005f5b0 0x7ff080061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:45.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.666+0000 7ff08e7fc700 1 -- 172.21.15.115:0/1785355235 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff09807be00 con 0x7ff0a0153e00 2023-07-27T14:33:45.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.667+0000 7ff09e59c700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08005f5b0 0x7ff080061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:45.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.667+0000 7ff09e59c700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08005f5b0 0x7ff080061a70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff09000a9d0 tx=0x7ff090008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:45.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.671+0000 7ff08e7fc700 1 -- 172.21.15.115:0/1785355235 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff09804ce10 con 0x7ff0a0153e00 2023-07-27T14:33:45.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.871+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000686370", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a0092120 con 0x7ff08005f5b0 2023-07-27T14:33:45.917 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:45.877+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:45.917 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:45.877+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:45.917 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:45.877+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:45.917 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:45.877+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:45.917 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:45.877+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:45.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.909+0000 7ff08e7fc700 1 -- 172.21.15.115:0/1785355235 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff0a0092120 con 0x7ff08005f5b0 2023-07-27T14:33:45.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.911+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08005f5b0 msgr2=0x7ff080061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.911+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08005f5b0 0x7ff080061a70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff09000a9d0 tx=0x7ff090008040).stop 2023-07-27T14:33:45.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.911+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0153e00 msgr2=0x7ff0a01675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:45.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.911+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0153e00 0x7ff0a01675f0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7ff09800bee0 tx=0x7ff098009840).stop 2023-07-27T14:33:45.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.912+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 shutdown_connections 2023-07-27T14:33:45.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.912+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08005f5b0 0x7ff080061a70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.912+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a0153e00 0x7ff0a01675f0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.912+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a0064230 0x7ff0a00aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.912+0000 7ff0a4dff700 1 --2- 172.21.15.115:0/1785355235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a0065de0 0x7ff0a0144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:45.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.912+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 >> 172.21.15.115:0/1785355235 conn(0x7ff0a00c7b90 msgr2=0x7ff0a00a3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:45.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.912+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 shutdown_connections 2023-07-27T14:33:45.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:45.912+0000 7ff0a4dff700 1 -- 172.21.15.115:0/1785355235 wait complete. 2023-07-27T14:33:45.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000686370 2023-07-27T14:33:46.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.119+0000 7f8fe95ff700 1 Processor -- start 2023-07-27T14:33:46.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.120+0000 7f8fe95ff700 1 -- start start 2023-07-27T14:33:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.121+0000 7f8fe95ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fe40a5f60 0x7f8fe414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.121+0000 7f8fe95ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe41530d0 con 0x7f8fe40c31e0 2023-07-27T14:33:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.121+0000 7f8fe95ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe41527a0 con 0x7f8fe414f740 2023-07-27T14:33:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.121+0000 7f8fe95ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4069f70 con 0x7f8fe40a5f60 2023-07-27T14:33:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.121+0000 7f8fe37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8fe40c31e0 0x7f8fe4063e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43046/0 (socket says 172.21.15.115:43046) 2023-07-27T14:33:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.121+0000 7f8fe37fe700 1 -- 172.21.15.115:0/3830366515 learned_addr learned my addr 172.21.15.115:0/3830366515 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:46.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe27fc700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fe40a5f60 0x7f8fe414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:46.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085596044 0 0) 0x7f8fe41530d0 con 0x7f8fe40c31e0 2023-07-27T14:33:46.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fcc0033f0 con 0x7f8fe40c31e0 2023-07-27T14:33:46.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965386294 0 0) 0x7f8fcc0033f0 con 0x7f8fe40c31e0 2023-07-27T14:33:46.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fe40a5f60 msgr2=0x7f8fe414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:46.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fe40a5f60 0x7f8fe414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 >> v1:172.21.15.159:6789/0 conn(0x7f8fe414f740 legacy=0x7f8fe40a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4152a80 con 0x7f8fe40c31e0 2023-07-27T14:33:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f8fdc0017f0 con 0x7f8fe40c31e0 2023-07-27T14:33:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 >> v1:172.21.15.115:6789/0 conn(0x7f8fe40c31e0 legacy=0x7f8fe4063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fe40a5f60 0x7f8fcc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc003e00 0x7f8fcc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fcc004b80 0x7f8fcc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc00b990 con 0x7f8fcc003e00 2023-07-27T14:33:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc00bad0 con 0x7f8fcc004b80 2023-07-27T14:33:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc00bc90 con 0x7f8fe40a5f60 2023-07-27T14:33:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.122+0000 7f8fe27fc700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc003e00 0x7f8fcc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe37fe700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fcc004b80 0x7f8fcc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe2ffd700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fe40a5f60 0x7f8fcc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe27fc700 1 -- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fe40a5f60 msgr2=0x7f8fcc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe27fc700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fe40a5f60 0x7f8fcc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe27fc700 1 -- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fcc004b80 msgr2=0x7f8fcc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:46.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe27fc700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fcc004b80 0x7f8fcc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe27fc700 1 -- 172.21.15.115:0/3830366515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0033f0 con 0x7f8fcc003e00 2023-07-27T14:33:46.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe27fc700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc003e00 0x7f8fcc004690 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f8fe40a6360 tx=0x7f8fd8009060).ready entity=mon.0 client_cookie=f1312b44615e58d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:46.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8009430 con 0x7f8fcc003e00 2023-07-27T14:33:46.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd800e640 con 0x7f8fcc003e00 2023-07-27T14:33:46.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.123+0000 7f8fe1ffb700 1 -- 172.21.15.115:0/3830366515 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800e9c0 con 0x7f8fcc003e00 2023-07-27T14:33:46.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.124+0000 7f8fe95ff700 1 -- 172.21.15.115:0/3830366515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc003e00 msgr2=0x7f8fcc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:46.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.124+0000 7f8fe95ff700 1 --2- 172.21.15.115:0/3830366515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc003e00 0x7f8fcc004690 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f8fe40a6360 tx=0x7f8fd8009060).stop 2023-07-27T14:33:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.124+0000 7f8fe37fe700 1 -- 172.21.15.115:0/3830366515 reap_dead start 2023-07-27T14:33:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.124+0000 7f8fe95ff700 1 -- 172.21.15.115:0/3830366515 shutdown_connections 2023-07-27T14:33:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.124+0000 7f8fe95ff700 1 -- 172.21.15.115:0/3830366515 >> 172.21.15.115:0/3830366515 conn(0x7f8fe4062320 msgr2=0x7f8fe4062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.124+0000 7f8fe95ff700 1 -- 172.21.15.115:0/3830366515 shutdown_connections 2023-07-27T14:33:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.124+0000 7f8fe95ff700 1 -- 172.21.15.115:0/3830366515 wait complete. 2023-07-27T14:33:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.126+0000 7f8fe95ff700 1 Processor -- start 2023-07-27T14:33:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.126+0000 7f8fe95ff700 1 -- start start 2023-07-27T14:33:46.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe95ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fcc003e00 0x7f8fe414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:46.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe95ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fe414e670 0x7f8fe40a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:46.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe95ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe414eaf0 0x7f8fe40a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:46.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe95ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40a52d0 con 0x7f8fe414eaf0 2023-07-27T14:33:46.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe95ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40a71d0 con 0x7f8fe414e670 2023-07-27T14:33:46.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe95ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40a65c0 con 0x7f8fcc003e00 2023-07-27T14:33:46.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe414eaf0 0x7f8fe40a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:46.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe414eaf0 0x7f8fe40a4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34132/0 (socket says 172.21.15.115:34132) 2023-07-27T14:33:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe37fe700 1 -- 172.21.15.115:0/1437139619 learned_addr learned my addr 172.21.15.115:0/1437139619 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe2ffd700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fcc003e00 0x7f8fe414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe27fc700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fe414e670 0x7f8fe40a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe37fe700 1 -- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fcc003e00 msgr2=0x7f8fe414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe37fe700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fcc003e00 0x7f8fe414de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe37fe700 1 -- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fe414e670 msgr2=0x7f8fe40a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:46.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe37fe700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fe414e670 0x7f8fe40a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe37fe700 1 -- 172.21.15.115:0/1437139619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe40a68a0 con 0x7f8fe414eaf0 2023-07-27T14:33:46.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe2ffd700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fcc003e00 0x7f8fe414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:46.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.127+0000 7f8fe27fc700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fe414e670 0x7f8fe40a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:46.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.128+0000 7f8fe37fe700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe414eaf0 0x7f8fe40a4de0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f8fe405e9c0 tx=0x7f8fdc001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:46.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.128+0000 7f8fcaffd700 1 -- 172.21.15.115:0/1437139619 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00f910 con 0x7f8fe414eaf0 2023-07-27T14:33:46.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.128+0000 7f8fcaffd700 1 -- 172.21.15.115:0/1437139619 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00fa70 con 0x7f8fe414eaf0 2023-07-27T14:33:46.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.128+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe40a6b80 con 0x7f8fe414eaf0 2023-07-27T14:33:46.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.128+0000 7f8fcaffd700 1 -- 172.21.15.115:0/1437139619 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00fe30 con 0x7f8fe414eaf0 2023-07-27T14:33:46.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.128+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe40c5f30 con 0x7f8fe414eaf0 2023-07-27T14:33:46.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.129+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe40a7360 con 0x7f8fe414eaf0 2023-07-27T14:33:46.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.130+0000 7f8fcaffd700 1 -- 172.21.15.115:0/1437139619 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 21) v1 ==== 76402+0+0 (secure 0 0 0) 0x7f8fdc012560 con 0x7f8fe414eaf0 2023-07-27T14:33:46.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.131+0000 7f8fcaffd700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fd005f5b0 0x7f8fd0061a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:46.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.131+0000 7f8fcaffd700 1 -- 172.21.15.115:0/1437139619 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8fdc07a400 con 0x7f8fe414eaf0 2023-07-27T14:33:46.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.131+0000 7f8fe2ffd700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fd005f5b0 0x7f8fd0061a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:46.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.132+0000 7f8fe2ffd700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fd005f5b0 0x7f8fd0061a70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f8fd4000f60 tx=0x7f8fd4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:46.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.135+0000 7f8fcaffd700 1 -- 172.21.15.115:0/1437139619 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fdc04b010 con 0x7f8fe414eaf0 2023-07-27T14:33:46.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.335+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000686370", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fe4152d60 con 0x7f8fd005f5b0 2023-07-27T14:33:46.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.340+0000 7f8fcaffd700 1 -- 172.21.15.115:0/1437139619 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f8fe4152d60 con 0x7f8fd005f5b0 2023-07-27T14:33:46.381 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520 2023-07-27T14:33:46.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fd005f5b0 msgr2=0x7f8fd0061a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:46.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fd005f5b0 0x7f8fd0061a70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f8fd4000f60 tx=0x7f8fd4009040).stop 2023-07-27T14:33:46.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe414eaf0 msgr2=0x7f8fe40a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:46.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe414eaf0 0x7f8fe40a4de0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f8fe405e9c0 tx=0x7f8fdc001d90).stop 2023-07-27T14:33:46.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 shutdown_connections 2023-07-27T14:33:46.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fd005f5b0 0x7f8fd0061a70 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe414eaf0 0x7f8fe40a4de0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8fcc003e00 0x7f8fe414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 --2- 172.21.15.115:0/1437139619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fe414e670 0x7f8fe40a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:46.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 >> 172.21.15.115:0/1437139619 conn(0x7f8fe4062320 msgr2=0x7f8fe40c0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:46.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.342+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 shutdown_connections 2023-07-27T14:33:46.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:46.343+0000 7f8fe95ff700 1 -- 172.21.15.115:0/1437139619 wait complete. 2023-07-27T14:33:46.400 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000686370 with 64 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520 2023-07-27T14:33:46.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.401 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.472 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.473 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.473 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162256 s, 64.6 MB/s 2023-07-27T14:33:46.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.474 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164376 s, 63.8 MB/s 2023-07-27T14:33:46.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.539 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.599 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.599 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.599 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013982 s, 75.0 MB/s 2023-07-27T14:33:46.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.601 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.661 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.661 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.661 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139382 s, 75.2 MB/s 2023-07-27T14:33:46.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.663 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.725 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.725 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.725 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155817 s, 67.3 MB/s 2023-07-27T14:33:46.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.726 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.788 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.788 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.788 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152824 s, 68.6 MB/s 2023-07-27T14:33:46.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.790 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.851 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.851 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.851 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155939 s, 67.2 MB/s 2023-07-27T14:33:46.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.853 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.916 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.916 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.916 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163736 s, 64.0 MB/s 2023-07-27T14:33:46.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.917 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:46.989 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:46.990 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:46.990 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252674 s, 41.5 MB/s 2023-07-27T14:33:46.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:46.991 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.052 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.052 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.052 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142347 s, 73.7 MB/s 2023-07-27T14:33:47.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.053 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01767 s, 59.3 MB/s 2023-07-27T14:33:47.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.119 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.183 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.183 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.183 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173363 s, 60.5 MB/s 2023-07-27T14:33:47.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.185 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.248 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.249 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.249 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165376 s, 63.4 MB/s 2023-07-27T14:33:47.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.250 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.315 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.316 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.316 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185046 s, 56.7 MB/s 2023-07-27T14:33:47.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.317 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.378 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.379 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.379 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151343 s, 69.3 MB/s 2023-07-27T14:33:47.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.381 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.440 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.441 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.441 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129863 s, 80.7 MB/s 2023-07-27T14:33:47.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.442 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.505 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.505 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.505 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165583 s, 63.3 MB/s 2023-07-27T14:33:47.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.507 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.573 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.574 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.574 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175849 s, 59.6 MB/s 2023-07-27T14:33:47.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.575 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.641 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.641 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.641 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019005 s, 55.2 MB/s 2023-07-27T14:33:47.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.643 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.705 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.705 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.705 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156383 s, 67.1 MB/s 2023-07-27T14:33:47.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.707 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.768 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.769 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.769 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143145 s, 73.3 MB/s 2023-07-27T14:33:47.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.770 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.835 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.835 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.835 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175437 s, 59.8 MB/s 2023-07-27T14:33:47.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.836 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.899 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155142 s, 67.6 MB/s 2023-07-27T14:33:47.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.901 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:47.965 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:47.965 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:47.966 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177818 s, 59.0 MB/s 2023-07-27T14:33:47.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:47.967 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.030 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.030 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.030 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01537 s, 68.2 MB/s 2023-07-27T14:33:48.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.032 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.094 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.094 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.094 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150731 s, 69.6 MB/s 2023-07-27T14:33:48.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.095 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.158 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.158 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.158 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150991 s, 69.4 MB/s 2023-07-27T14:33:48.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.159 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.221 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.221 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.221 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141222 s, 74.3 MB/s 2023-07-27T14:33:48.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.222 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.283 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01471 s, 71.3 MB/s 2023-07-27T14:33:48.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.285 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.350 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.350 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.350 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176209 s, 59.5 MB/s 2023-07-27T14:33:48.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.351 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.411 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.411 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.411 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131345 s, 79.8 MB/s 2023-07-27T14:33:48.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.413 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.476 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.476 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.477 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160387 s, 65.4 MB/s 2023-07-27T14:33:48.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.478 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.539 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.539 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.540 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145319 s, 72.2 MB/s 2023-07-27T14:33:48.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.541 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.601 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.601 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.601 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133727 s, 78.4 MB/s 2023-07-27T14:33:48.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.603 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.667 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.667 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.667 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166037 s, 63.2 MB/s 2023-07-27T14:33:48.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.668 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.730 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.730 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.730 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146045 s, 71.8 MB/s 2023-07-27T14:33:48.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.732 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.793 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.794 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.794 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154262 s, 68.0 MB/s 2023-07-27T14:33:48.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.795 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.856 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.856 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.857 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144422 s, 72.6 MB/s 2023-07-27T14:33:48.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.858 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.921 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166996 s, 62.8 MB/s 2023-07-27T14:33:48.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.922 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:48.992 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:48.993 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:48.993 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236743 s, 44.3 MB/s 2023-07-27T14:33:48.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:48.994 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.055 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.055 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.055 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128255 s, 81.8 MB/s 2023-07-27T14:33:49.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.057 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.124 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.124 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.124 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204101 s, 51.4 MB/s 2023-07-27T14:33:49.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.125 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.191 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.192 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.192 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186723 s, 56.2 MB/s 2023-07-27T14:33:49.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.193 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.254 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.255 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.255 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146683 s, 71.5 MB/s 2023-07-27T14:33:49.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.256 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.316 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.317 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.317 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133818 s, 78.4 MB/s 2023-07-27T14:33:49.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.318 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.379 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.380 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.380 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146886 s, 71.4 MB/s 2023-07-27T14:33:49.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.381 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.444 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.445 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.445 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168516 s, 62.2 MB/s 2023-07-27T14:33:49.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.446 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.506 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.507 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.507 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140888 s, 74.4 MB/s 2023-07-27T14:33:49.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.509 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.571 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.571 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.571 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163659 s, 64.1 MB/s 2023-07-27T14:33:49.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.573 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.633 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.633 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.634 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140917 s, 74.4 MB/s 2023-07-27T14:33:49.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.635 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.698 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.698 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.698 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167063 s, 62.8 MB/s 2023-07-27T14:33:49.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.700 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.761 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.761 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.761 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142754 s, 73.5 MB/s 2023-07-27T14:33:49.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.763 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.824 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.824 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.825 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141294 s, 74.2 MB/s 2023-07-27T14:33:49.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.826 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.887 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.887 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.887 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138534 s, 75.7 MB/s 2023-07-27T14:33:49.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.889 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:49.950 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:49.950 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:49.950 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143591 s, 73.0 MB/s 2023-07-27T14:33:49.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:49.952 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.015 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.015 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.015 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152227 s, 68.9 MB/s 2023-07-27T14:33:50.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:50.016 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.078 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153948 s, 68.1 MB/s 2023-07-27T14:33:50.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:50.080 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.141 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.141 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.141 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150215 s, 69.8 MB/s 2023-07-27T14:33:50.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:50.142 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.205 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.206 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.206 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170111 s, 61.6 MB/s 2023-07-27T14:33:50.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:50.207 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.268 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.268 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.268 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147996 s, 70.9 MB/s 2023-07-27T14:33:50.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:50.269 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.332 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.333 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.333 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169539 s, 61.8 MB/s 2023-07-27T14:33:50.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:50.334 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.396 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.396 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.396 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155954 s, 67.2 MB/s 2023-07-27T14:33:50.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:50.398 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.458 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.458 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.459 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143851 s, 72.9 MB/s 2023-07-27T14:33:50.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:50.460 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:33:50.525 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:33:50.525 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:33:50.526 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188915 s, 55.5 MB/s 2023-07-27T14:33:50.527 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000686370 snapshot_0000000000048506 2023-07-27T14:33:50.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.679+0000 7f8ebebff700 1 Processor -- start 2023-07-27T14:33:50.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.679+0000 7f8ebebff700 1 -- start start 2023-07-27T14:33:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.680+0000 7f8ebebff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8eb81509b0 0x7f8eb80c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.680+0000 7f8ebebff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb80c0ea0 con 0x7f8eb8150d90 2023-07-27T14:33:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.680+0000 7f8ebebff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb8068e10 con 0x7f8eb80c3100 2023-07-27T14:33:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.680+0000 7f8ebebff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb8155190 con 0x7f8eb81509b0 2023-07-27T14:33:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.680+0000 7f8ebc99b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8eb81509b0 0x7f8eb80c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.680+0000 7f8eb7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8eb8150d90 0x7f8eb8154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43060/0 (socket says 172.21.15.115:43060) 2023-07-27T14:33:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8eb7fff700 1 -- 172.21.15.115:0/3245142885 learned_addr learned my addr 172.21.15.115:0/3245142885 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:50.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8ebc99b700 1 -- 172.21.15.115:0/3245142885 >> v1:172.21.15.159:6789/0 conn(0x7f8eb80c3100 legacy=0x7f8eb80c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:50.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8ebc99b700 1 -- 172.21.15.115:0/3245142885 >> v1:172.21.15.115:6789/0 conn(0x7f8eb8150d90 legacy=0x7f8eb8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:50.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8eb77fe700 1 -- 172.21.15.115:0/3245142885 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599623619 0 0) 0x7f8eb80c0ea0 con 0x7f8eb8150d90 2023-07-27T14:33:50.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8ebc99b700 1 -- 172.21.15.115:0/3245142885 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8155470 con 0x7f8eb81509b0 2023-07-27T14:33:50.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8ebc99b700 1 --2- 172.21.15.115:0/3245142885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb80c58d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f8eac009e60 tx=0x7f8eac009780).ready entity=mon.0 client_cookie=1f9147e2f7c852a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:50.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8eb77fe700 1 -- 172.21.15.115:0/3245142885 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00e070 con 0x7f8eb81509b0 2023-07-27T14:33:50.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8eb77fe700 1 -- 172.21.15.115:0/3245142885 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac00bc30 con 0x7f8eb81509b0 2023-07-27T14:33:50.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.681+0000 7f8eb77fe700 1 -- 172.21.15.115:0/3245142885 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac012410 con 0x7f8eb81509b0 2023-07-27T14:33:50.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.682+0000 7f8ebebff700 1 -- 172.21.15.115:0/3245142885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 msgr2=0x7f8eb80c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:50.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.682+0000 7f8ebebff700 1 --2- 172.21.15.115:0/3245142885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb80c58d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f8eac009e60 tx=0x7f8eac009780).stop 2023-07-27T14:33:50.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.682+0000 7f8ebebff700 1 -- 172.21.15.115:0/3245142885 shutdown_connections 2023-07-27T14:33:50.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.682+0000 7f8ebebff700 1 --2- 172.21.15.115:0/3245142885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb80c58d0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:50.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.682+0000 7f8ebebff700 1 -- 172.21.15.115:0/3245142885 >> 172.21.15.115:0/3245142885 conn(0x7f8eb8062320 msgr2=0x7f8eb8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:50.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.682+0000 7f8ebebff700 1 -- 172.21.15.115:0/3245142885 shutdown_connections 2023-07-27T14:33:50.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.682+0000 7f8ebebff700 1 -- 172.21.15.115:0/3245142885 wait complete. 2023-07-27T14:33:50.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.683+0000 7f8ebebff700 1 Processor -- start 2023-07-27T14:33:50.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.684+0000 7f8ebebff700 1 -- start start 2023-07-27T14:33:50.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8ebebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80c3100 0x7f8eb80a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:50.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8ebebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb8064770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:50.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8ebebff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb8150d90 0x7f8eb8153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:50.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8ebebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80a8d40 con 0x7f8eb81509b0 2023-07-27T14:33:50.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8ebebff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8064c60 con 0x7f8eb8150d90 2023-07-27T14:33:50.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8ebebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8152020 con 0x7f8eb80c3100 2023-07-27T14:33:50.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb8064770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:50.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb8064770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34140/0 (socket says 172.21.15.115:34140) 2023-07-27T14:33:50.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 -- 172.21.15.115:0/310315872 learned_addr learned my addr 172.21.15.115:0/310315872 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:50.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8ebc99b700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80c3100 0x7f8eb80a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:50.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8ebd19c700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb8150d90 0x7f8eb8153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:50.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 -- 172.21.15.115:0/310315872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80c3100 msgr2=0x7f8eb80a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:50.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80c3100 0x7f8eb80a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:50.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 -- 172.21.15.115:0/310315872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb8150d90 msgr2=0x7f8eb8153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb8150d90 0x7f8eb8153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 -- 172.21.15.115:0/310315872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac009a20 con 0x7f8eb81509b0 2023-07-27T14:33:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.685+0000 7f8eb7fff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb8064770 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f8ea400c490 tx=0x7f8ea4007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.686+0000 7f8eb4ff9700 1 -- 172.21.15.115:0/310315872 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40072e0 con 0x7f8eb81509b0 2023-07-27T14:33:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.686+0000 7f8eb4ff9700 1 -- 172.21.15.115:0/310315872 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4007440 con 0x7f8eb81509b0 2023-07-27T14:33:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.686+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb80a8130 con 0x7f8eb81509b0 2023-07-27T14:33:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.686+0000 7f8eb4ff9700 1 -- 172.21.15.115:0/310315872 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40057a0 con 0x7f8eb81509b0 2023-07-27T14:33:50.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.686+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb80a86f0 con 0x7f8eb81509b0 2023-07-27T14:33:50.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.687+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb806c470 con 0x7f8eb81509b0 2023-07-27T14:33:50.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.688+0000 7f8eb4ff9700 1 -- 172.21.15.115:0/310315872 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 22) v1 ==== 76442+0+0 (secure 0 0 0) 0x7f8ea4010070 con 0x7f8eb81509b0 2023-07-27T14:33:50.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.689+0000 7f8eb4ff9700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e9c05f600 0x7f8e9c061ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:50.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.689+0000 7f8eb4ff9700 1 -- 172.21.15.115:0/310315872 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ea4079ec0 con 0x7f8eb81509b0 2023-07-27T14:33:50.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.689+0000 7f8ebc99b700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e9c05f600 0x7f8e9c061ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:50.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.689+0000 7f8ebc99b700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e9c05f600 0x7f8e9c061ac0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8eac009e60 tx=0x7f8eac009780).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:50.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.694+0000 7f8eb4ff9700 1 -- 172.21.15.115:0/310315872 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ea404abf0 con 0x7f8eb81509b0 2023-07-27T14:33:50.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.901+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000686370", "snap_name": "snapshot_0000000000048506", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eb80655d0 con 0x7f8e9c05f600 2023-07-27T14:33:50.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.920+0000 7f8eb4ff9700 1 -- 172.21.15.115:0/310315872 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8eb80655d0 con 0x7f8e9c05f600 2023-07-27T14:33:50.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e9c05f600 msgr2=0x7f8e9c061ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:50.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e9c05f600 0x7f8e9c061ac0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8eac009e60 tx=0x7f8eac009780).stop 2023-07-27T14:33:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 msgr2=0x7f8eb8064770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb8064770 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f8ea400c490 tx=0x7f8ea4007e40).stop 2023-07-27T14:33:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 shutdown_connections 2023-07-27T14:33:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8e9c05f600 0x7f8e9c061ac0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8eb8150d90 0x7f8eb8153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8eb80c3100 0x7f8eb80a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 --2- 172.21.15.115:0/310315872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8eb81509b0 0x7f8eb8064770 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:50.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 >> 172.21.15.115:0/310315872 conn(0x7f8eb8062320 msgr2=0x7f8eb8069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:50.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 shutdown_connections 2023-07-27T14:33:50.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:50.922+0000 7f8ebebff700 1 -- 172.21.15.115:0/310315872 wait complete. 2023-07-27T14:33:50.986 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 2 2023-07-27T14:33:51.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.135+0000 7fb43f7ff700 1 Processor -- start 2023-07-27T14:33:51.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.135+0000 7fb43f7ff700 1 -- start start 2023-07-27T14:33:51.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb43f7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 0x7fb4380bc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb43f7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb438065360 con 0x7fb4380657f0 2023-07-27T14:33:51.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb43f7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4380bcbd0 con 0x7fb4381542b0 2023-07-27T14:33:51.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb43f7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb438065c50 con 0x7fb438153ed0 2023-07-27T14:33:51.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb43cd9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb4380657f0 0x7fb4380c2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43068/0 (socket says 172.21.15.115:43068) 2023-07-27T14:33:51.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb43cd9a700 1 -- 172.21.15.115:0/2489152721 learned_addr learned my addr 172.21.15.115:0/2489152721 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:51.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507700935 0 0) 0x7fb438065360 con 0x7fb4380657f0 2023-07-27T14:33:51.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb43d59b700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 0x7fb4380bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.137+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4240033f0 con 0x7fb4380657f0 2023-07-27T14:33:51.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4016780945 0 0) 0x7fb4240033f0 con 0x7fb4380657f0 2023-07-27T14:33:51.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 msgr2=0x7fb4380bc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:51.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 0x7fb4380bc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 >> v1:172.21.15.159:6789/0 conn(0x7fb4381542b0 legacy=0x7fb438157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438064d30 con 0x7fb4380657f0 2023-07-27T14:33:51.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb428001470 con 0x7fb4380657f0 2023-07-27T14:33:51.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 >> v1:172.21.15.115:6789/0 conn(0x7fb4380657f0 legacy=0x7fb4380c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb424003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb424004690 0x7fb424004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 0x7fb424005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42400b8e0 con 0x7fb424003910 2023-07-27T14:33:51.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42400ba50 con 0x7fb424004690 2023-07-27T14:33:51.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42400bc10 con 0x7fb438153ed0 2023-07-27T14:33:51.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43d59b700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb424003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43cd9a700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb424004690 0x7fb424004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43dd9c700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 0x7fb424005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43d59b700 1 -- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 msgr2=0x7fb424005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:51.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43d59b700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 0x7fb424005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43d59b700 1 -- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb424004690 msgr2=0x7fb424004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:51.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43d59b700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb424004690 0x7fb424004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43d59b700 1 -- 172.21.15.115:0/2489152721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240033f0 con 0x7fb424003910 2023-07-27T14:33:51.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.138+0000 7fb43dd9c700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb438153ed0 0x7fb424005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:51.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb43d59b700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb424003d30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fb434009a80 tx=0x7fb434009060).ready entity=mon.0 client_cookie=27f15f420f84fb59 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:51.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434009430 con 0x7fb424003910 2023-07-27T14:33:51.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400e640 con 0x7fb424003910 2023-07-27T14:33:51.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb42ffff700 1 -- 172.21.15.115:0/2489152721 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400e9c0 con 0x7fb424003910 2023-07-27T14:33:51.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2489152721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 msgr2=0x7fb424003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb43f7ff700 1 --2- 172.21.15.115:0/2489152721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb424003d30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fb434009a80 tx=0x7fb434009060).stop 2023-07-27T14:33:51.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb43dd9c700 1 -- 172.21.15.115:0/2489152721 reap_dead start 2023-07-27T14:33:51.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2489152721 shutdown_connections 2023-07-27T14:33:51.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2489152721 >> 172.21.15.115:0/2489152721 conn(0x7fb438062df0 msgr2=0x7fb4380c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:51.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.139+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2489152721 shutdown_connections 2023-07-27T14:33:51.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.140+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2489152721 wait complete. 2023-07-27T14:33:51.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.141+0000 7fb43f7ff700 1 Processor -- start 2023-07-27T14:33:51.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.141+0000 7fb43f7ff700 1 -- start start 2023-07-27T14:33:51.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43f7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb438151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43f7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4380a7d10 0x7fb4380a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43f7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4381569c0 0x7fb438156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43f7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380aae50 con 0x7fb424003910 2023-07-27T14:33:51.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43f7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380a9b60 con 0x7fb4380a7d10 2023-07-27T14:33:51.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43f7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380aa9c0 con 0x7fb4381569c0 2023-07-27T14:33:51.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43d59b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb438151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43d59b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb438151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34156/0 (socket says 172.21.15.115:34156) 2023-07-27T14:33:51.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43d59b700 1 -- 172.21.15.115:0/2870072469 learned_addr learned my addr 172.21.15.115:0/2870072469 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:51.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43cd9a700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4380a7d10 0x7fb4380a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43dd9c700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4381569c0 0x7fb438156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43d59b700 1 -- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4381569c0 msgr2=0x7fb438156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43d59b700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4381569c0 0x7fb438156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.142+0000 7fb43d59b700 1 -- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4380a7d10 msgr2=0x7fb4380a8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb43d59b700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4380a7d10 0x7fb4380a8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb43d59b700 1 -- 172.21.15.115:0/2870072469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438157330 con 0x7fb424003910 2023-07-27T14:33:51.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb43cd9a700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4380a7d10 0x7fb4380a8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:51.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb43d59b700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb438151f60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fb4340030b0 tx=0x7fb43401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:51.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb42d7fa700 1 -- 172.21.15.115:0/2870072469 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400ed30 con 0x7fb424003910 2023-07-27T14:33:51.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb42d7fa700 1 -- 172.21.15.115:0/2870072469 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400ee90 con 0x7fb424003910 2023-07-27T14:33:51.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb438152450 con 0x7fb424003910 2023-07-27T14:33:51.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb42d7fa700 1 -- 172.21.15.115:0/2870072469 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434026440 con 0x7fb424003910 2023-07-27T14:33:51.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.143+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4380aa090 con 0x7fb424003910 2023-07-27T14:33:51.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.144+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43806c470 con 0x7fb424003910 2023-07-27T14:33:51.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.145+0000 7fb42d7fa700 1 -- 172.21.15.115:0/2870072469 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 22) v1 ==== 76442+0+0 (secure 0 0 0) 0x7fb43402c020 con 0x7fb424003910 2023-07-27T14:33:51.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.146+0000 7fb42d7fa700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb41c05f5d0 0x7fb41c061a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.146+0000 7fb42d7fa700 1 -- 172.21.15.115:0/2870072469 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb43407c3e0 con 0x7fb424003910 2023-07-27T14:33:51.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.146+0000 7fb43cd9a700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb41c05f5d0 0x7fb41c061a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.147+0000 7fb43cd9a700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb41c05f5d0 0x7fb41c061a90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fb438065ec0 tx=0x7fb428009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:51.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.150+0000 7fb42d7fa700 1 -- 172.21.15.115:0/2870072469 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb43404d110 con 0x7fb424003910 2023-07-27T14:33:51.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.323+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7fb4380c7780 con 0x7fb424003910 2023-07-27T14:33:51.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.327+0000 7fb42d7fa700 1 -- 172.21.15.115:0/2870072469 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v23)=0 v23) v1 ==== 130+0+0 (secure 0 0 0) 0x7fb434016020 con 0x7fb424003910 2023-07-27T14:33:51.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb41c05f5d0 msgr2=0x7fb41c061a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb41c05f5d0 0x7fb41c061a90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fb438065ec0 tx=0x7fb428009040).stop 2023-07-27T14:33:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 msgr2=0x7fb438151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb438151f60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fb4340030b0 tx=0x7fb43401a000).stop 2023-07-27T14:33:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 shutdown_connections 2023-07-27T14:33:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb41c05f5d0 0x7fb41c061a90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4381569c0 0x7fb438156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb424003910 0x7fb438151f60 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 --2- 172.21.15.115:0/2870072469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4380a7d10 0x7fb4380a8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 >> 172.21.15.115:0/2870072469 conn(0x7fb438062df0 msgr2=0x7fb4381536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:51.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 shutdown_connections 2023-07-27T14:33:51.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.330+0000 7fb43f7ff700 1 -- 172.21.15.115:0/2870072469 wait complete. 2023-07-27T14:33:51.388 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000686370 snapshot_0000000000048506 clone_0000000000704288 2023-07-27T14:33:51.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.541+0000 7f08a5fff700 1 Processor -- start 2023-07-27T14:33:51.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.541+0000 7f08a5fff700 1 -- start start 2023-07-27T14:33:51.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.542+0000 7f08a5fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f08a014ae00 0x7f08a0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.542+0000 7f08a5fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.542+0000 7f08a5fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a01553f0 con 0x7f08a014b1e0 2023-07-27T14:33:51.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.542+0000 7f08a5fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a0157a50 con 0x7f08a014ae00 2023-07-27T14:33:51.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.542+0000 7f08a5fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0157d10 con 0x7f08a0063260 2023-07-27T14:33:51.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089f7fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f08a014ae00 0x7f08a0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089f7fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f08a014ae00 0x7f08a0154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:60556/0 (socket says 172.21.15.115:60556) 2023-07-27T14:33:51.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089f7fe700 1 -- 172.21.15.115:0/2170356397 learned_addr learned my addr 172.21.15.115:0/2170356397 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:51.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089effd700 1 --1- 172.21.15.115:0/2170356397 >> v1:172.21.15.159:6789/0 conn(0x7f08a014b1e0 0x7f08a0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:38442/0 (socket says 172.21.15.115:38442) 2023-07-27T14:33:51.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089f7fe700 1 -- 172.21.15.115:0/2170356397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 msgr2=0x7f08a00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:51.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089f7fe700 1 --2- 172.21.15.115:0/2170356397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089f7fe700 1 -- 172.21.15.115:0/2170356397 >> v1:172.21.15.159:6789/0 conn(0x7f08a014b1e0 legacy=0x7f08a0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089f7fe700 1 -- 172.21.15.115:0/2170356397 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a0157ff0 con 0x7f08a014ae00 2023-07-27T14:33:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.544+0000 7f089ffff700 1 --2- 172.21.15.115:0/2170356397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.543+0000 7f089e7fc700 1 -- 172.21.15.115:0/2170356397 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077239671 0 0) 0x7f08a01553f0 con 0x7f08a014b1e0 2023-07-27T14:33:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.544+0000 7f089f7fe700 1 --2- 172.21.15.115:0/2170356397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 0x7f08a0154f00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f0890006fd0 tx=0x7f08900090f0).ready entity=mon.1 client_cookie=233469bbff426bc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.544+0000 7f089e7fc700 1 -- 172.21.15.115:0/2170356397 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000b580 con 0x7f08a014ae00 2023-07-27T14:33:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.544+0000 7f089e7fc700 1 -- 172.21.15.115:0/2170356397 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089000b6e0 con 0x7f08a014ae00 2023-07-27T14:33:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.544+0000 7f089e7fc700 1 -- 172.21.15.115:0/2170356397 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000ba60 con 0x7f08a014ae00 2023-07-27T14:33:51.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.544+0000 7f08a5fff700 1 -- 172.21.15.115:0/2170356397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 msgr2=0x7f08a0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.544+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2170356397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 0x7f08a0154f00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f0890006fd0 tx=0x7f08900090f0).stop 2023-07-27T14:33:51.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.545+0000 7f08a5fff700 1 -- 172.21.15.115:0/2170356397 shutdown_connections 2023-07-27T14:33:51.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.545+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2170356397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.545+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2170356397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 0x7f08a0154f00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.545+0000 7f08a5fff700 1 -- 172.21.15.115:0/2170356397 >> 172.21.15.115:0/2170356397 conn(0x7f08a005e940 msgr2=0x7f08a00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.545+0000 7f08a5fff700 1 -- 172.21.15.115:0/2170356397 shutdown_connections 2023-07-27T14:33:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.545+0000 7f08a5fff700 1 -- 172.21.15.115:0/2170356397 wait complete. 2023-07-27T14:33:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.546+0000 7f08a5fff700 1 Processor -- start 2023-07-27T14:33:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.546+0000 7f08a5fff700 1 -- start start 2023-07-27T14:33:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f08a5fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a01498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f08a5fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 0x7f08a00aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f08a5fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a014b1e0 0x7f08a0153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f08a5fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00affe0 con 0x7f08a014b1e0 2023-07-27T14:33:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f08a5fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00b02c0 con 0x7f08a014ae00 2023-07-27T14:33:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f08a5fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00b05a0 con 0x7f08a0063260 2023-07-27T14:33:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f089ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a014b1e0 0x7f08a0153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f089ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a014b1e0 0x7f08a0153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34158/0 (socket says 172.21.15.115:34158) 2023-07-27T14:33:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f089ffff700 1 -- 172.21.15.115:0/2409532075 learned_addr learned my addr 172.21.15.115:0/2409532075 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:51.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.547+0000 7f089f7fe700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a01498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f089effd700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 0x7f08a00aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f089ffff700 1 -- 172.21.15.115:0/2409532075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 msgr2=0x7f08a01498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f089ffff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a01498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f089ffff700 1 -- 172.21.15.115:0/2409532075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 msgr2=0x7f08a00aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f089ffff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 0x7f08a00aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f089ffff700 1 -- 172.21.15.115:0/2409532075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0898009a20 con 0x7f08a014b1e0 2023-07-27T14:33:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f089ffff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a014b1e0 0x7f08a0153240 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f0898009f50 tx=0x7f089800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:51.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f08877fe700 1 -- 172.21.15.115:0/2409532075 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898009c60 con 0x7f08a014b1e0 2023-07-27T14:33:51.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f08877fe700 1 -- 172.21.15.115:0/2409532075 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089800f040 con 0x7f08a014b1e0 2023-07-27T14:33:51.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0890009370 con 0x7f08a014b1e0 2023-07-27T14:33:51.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.548+0000 7f08877fe700 1 -- 172.21.15.115:0/2409532075 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089800cd00 con 0x7f08a014b1e0 2023-07-27T14:33:51.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.549+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a00b0b60 con 0x7f08a014b1e0 2023-07-27T14:33:51.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.550+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a0155c90 con 0x7f08a014b1e0 2023-07-27T14:33:51.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.550+0000 7f08877fe700 1 -- 172.21.15.115:0/2409532075 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 22) v1 ==== 76442+0+0 (secure 0 0 0) 0x7f0898013610 con 0x7f08a014b1e0 2023-07-27T14:33:51.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.551+0000 7f08877fe700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f088c05f600 0x7f088c061ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:51.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.551+0000 7f08877fe700 1 -- 172.21.15.115:0/2409532075 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f089807b1c0 con 0x7f08a014b1e0 2023-07-27T14:33:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.551+0000 7f089f7fe700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f088c05f600 0x7f088c061ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.552+0000 7f089f7fe700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f088c05f600 0x7f088c061ac0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0890009130 tx=0x7f0890017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.556+0000 7f08877fe700 1 -- 172.21.15.115:0/2409532075 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f089804bde0 con 0x7f08a014b1e0 2023-07-27T14:33:51.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.770+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000686370", "snap_name": "snapshot_0000000000048506", "target_sub_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7f08a006c470 con 0x7f088c05f600 2023-07-27T14:33:51.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.838+0000 7f08877fe700 1 -- 172.21.15.115:0/2409532075 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f08a006c470 con 0x7f088c05f600 2023-07-27T14:33:51.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.840+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f088c05f600 msgr2=0x7f088c061ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.840+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f088c05f600 0x7f088c061ac0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0890009130 tx=0x7f0890017000).stop 2023-07-27T14:33:51.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.840+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a014b1e0 msgr2=0x7f08a0153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:51.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.840+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a014b1e0 0x7f08a0153240 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f0898009f50 tx=0x7f089800b040).stop 2023-07-27T14:33:51.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.841+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 shutdown_connections 2023-07-27T14:33:51.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.841+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f088c05f600 0x7f088c061ac0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.841+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a014b1e0 0x7f08a0153240 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.841+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08a0063260 0x7f08a01498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.841+0000 7f08a5fff700 1 --2- 172.21.15.115:0/2409532075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08a014ae00 0x7f08a00aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:51.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.841+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 >> 172.21.15.115:0/2409532075 conn(0x7f08a005e940 msgr2=0x7f08a00ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:51.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.841+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 shutdown_connections 2023-07-27T14:33:51.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:51.841+0000 7f08a5fff700 1 -- 172.21.15.115:0/2409532075 wait complete. 2023-07-27T14:33:51.883 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.842+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.883 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.842+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.883 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.843+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.884 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.843+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.884 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.843+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.901 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000704288 2023-07-27T14:33:51.902 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.860+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.902 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.861+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.902 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.861+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.902 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.861+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:51.902 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:51.861+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:33:52.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.054+0000 7f04d79ff700 1 Processor -- start 2023-07-27T14:33:52.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.054+0000 7f04d79ff700 1 -- start start 2023-07-27T14:33:52.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.055+0000 7f04d79ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04d0153f30 0x7f04d00a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.055+0000 7f04d79ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00bfb50 0x7f04d00c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d79ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d00c60a0 con 0x7f04d00c0610 2023-07-27T14:33:52.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d79ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00c5d70 con 0x7f04d0153f30 2023-07-27T14:33:52.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d79ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00a7e30 con 0x7f04d00bfb50 2023-07-27T14:33:52.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d579b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04d0153f30 0x7f04d00a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d5f9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f04d00c0610 0x7f04d00c6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43074/0 (socket says 172.21.15.115:43074) 2023-07-27T14:33:52.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d5f9c700 1 -- 172.21.15.115:0/3841700419 learned_addr learned my addr 172.21.15.115:0/3841700419 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:52.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d4f9a700 1 --2- 172.21.15.115:0/3841700419 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00bfb50 0x7f04d00c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d579b700 1 -- 172.21.15.115:0/3841700419 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00bfb50 msgr2=0x7f04d00c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:52.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d579b700 1 --2- 172.21.15.115:0/3841700419 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00bfb50 0x7f04d00c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04c7fff700 1 -- 172.21.15.115:0/3841700419 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518966513 0 0) 0x7f04d00c60a0 con 0x7f04d00c0610 2023-07-27T14:33:52.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d579b700 1 -- 172.21.15.115:0/3841700419 >> v1:172.21.15.115:6789/0 conn(0x7f04d00c0610 legacy=0x7f04d00c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.056+0000 7f04d579b700 1 -- 172.21.15.115:0/3841700419 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00c7d80 con 0x7f04d0153f30 2023-07-27T14:33:52.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d579b700 1 --2- 172.21.15.115:0/3841700419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04d0153f30 0x7f04d00a7940 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f04cc009760 tx=0x7f04cc009060).ready entity=mon.0 client_cookie=615a7cd8f20c8c2f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:52.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04c7fff700 1 -- 172.21.15.115:0/3841700419 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00b580 con 0x7f04d0153f30 2023-07-27T14:33:52.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04c7fff700 1 -- 172.21.15.115:0/3841700419 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc00b6e0 con 0x7f04d0153f30 2023-07-27T14:33:52.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04c7fff700 1 -- 172.21.15.115:0/3841700419 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00ba60 con 0x7f04d0153f30 2023-07-27T14:33:52.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d79ff700 1 -- 172.21.15.115:0/3841700419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04d0153f30 msgr2=0x7f04d00a7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d79ff700 1 --2- 172.21.15.115:0/3841700419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04d0153f30 0x7f04d00a7940 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f04cc009760 tx=0x7f04cc009060).stop 2023-07-27T14:33:52.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d79ff700 1 -- 172.21.15.115:0/3841700419 shutdown_connections 2023-07-27T14:33:52.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d79ff700 1 --2- 172.21.15.115:0/3841700419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04d0153f30 0x7f04d00a7940 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d79ff700 1 --2- 172.21.15.115:0/3841700419 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00bfb50 0x7f04d00c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d79ff700 1 -- 172.21.15.115:0/3841700419 >> 172.21.15.115:0/3841700419 conn(0x7f04d0094280 msgr2=0x7f04d005e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:52.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d79ff700 1 -- 172.21.15.115:0/3841700419 shutdown_connections 2023-07-27T14:33:52.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.057+0000 7f04d79ff700 1 -- 172.21.15.115:0/3841700419 wait complete. 2023-07-27T14:33:52.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.059+0000 7f04d79ff700 1 Processor -- start 2023-07-27T14:33:52.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.059+0000 7f04d79ff700 1 -- start start 2023-07-27T14:33:52.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d79ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d00bfb50 0x7f04d014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d79ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00c0610 0x7f04d00ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d79ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04d0153f30 0x7f04d00acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d79ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00aa760 con 0x7f04d0153f30 2023-07-27T14:33:52.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d79ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b00f0 con 0x7f04d00bfb50 2023-07-27T14:33:52.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d79ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b0390 con 0x7f04d00c0610 2023-07-27T14:33:52.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d5f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04d0153f30 0x7f04d00acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d5f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04d0153f30 0x7f04d00acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34214/0 (socket says 172.21.15.115:34214) 2023-07-27T14:33:52.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d5f9c700 1 -- 172.21.15.115:0/1258536868 learned_addr learned my addr 172.21.15.115:0/1258536868 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:52.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d579b700 1 --2- 172.21.15.115:0/1258536868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d00bfb50 0x7f04d014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.060+0000 7f04d4f9a700 1 --2- 172.21.15.115:0/1258536868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00c0610 0x7f04d00ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04d5f9c700 1 -- 172.21.15.115:0/1258536868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00c0610 msgr2=0x7f04d00ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04d5f9c700 1 --2- 172.21.15.115:0/1258536868 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04d00c0610 0x7f04d00ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04d5f9c700 1 -- 172.21.15.115:0/1258536868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d00bfb50 msgr2=0x7f04d014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04d5f9c700 1 --2- 172.21.15.115:0/1258536868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04d00bfb50 0x7f04d014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04d5f9c700 1 -- 172.21.15.115:0/1258536868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0092a0 con 0x7f04d0153f30 2023-07-27T14:33:52.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04d5f9c700 1 --2- 172.21.15.115:0/1258536868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04d0153f30 0x7f04d00acd30 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f04c800c7e0 tx=0x7f04c8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:52.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04c57fa700 1 -- 172.21.15.115:0/1258536868 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8005d30 con 0x7f04d0153f30 2023-07-27T14:33:52.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04c57fa700 1 -- 172.21.15.115:0/1258536868 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c8005e90 con 0x7f04d0153f30 2023-07-27T14:33:52.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04c57fa700 1 -- 172.21.15.115:0/1258536868 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8007320 con 0x7f04d0153f30 2023-07-27T14:33:52.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04d79ff700 1 -- 172.21.15.115:0/1258536868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d00b0670 con 0x7f04d0153f30 2023-07-27T14:33:52.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.061+0000 7f04d79ff700 1 -- 172.21.15.115:0/1258536868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d00add90 con 0x7f04d0153f30 2023-07-27T14:33:52.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.062+0000 7f04d79ff700 1 -- 172.21.15.115:0/1258536868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d00aa8d0 con 0x7f04d0153f30 2023-07-27T14:33:52.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.063+0000 7f04c57fa700 1 -- 172.21.15.115:0/1258536868 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 22) v1 ==== 76442+0+0 (secure 0 0 0) 0x7f04c8010030 con 0x7f04d0153f30 2023-07-27T14:33:52.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.064+0000 7f04c57fa700 1 --2- 172.21.15.115:0/1258536868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04b405f600 0x7f04b4061ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.064+0000 7f04c57fa700 1 -- 172.21.15.115:0/1258536868 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f04c807a890 con 0x7f04d0153f30 2023-07-27T14:33:52.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.064+0000 7f04d579b700 1 --2- 172.21.15.115:0/1258536868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04b405f600 0x7f04b4061ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.065+0000 7f04d579b700 1 --2- 172.21.15.115:0/1258536868 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04b405f600 0x7f04b4061ac0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f04cc00b340 tx=0x7f04cc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:52.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.068+0000 7f04c57fa700 1 -- 172.21.15.115:0/1258536868 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f04d00aa8d0 con 0x7f04d0153f30 2023-07-27T14:33:52.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.266+0000 7f04d79ff700 1 -- 172.21.15.115:0/1258536868 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7f04d006c4e0 con 0x7f04b405f600 2023-07-27T14:33:52.312 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:33:52.272+0000 7fa7af9f9700 -1 mgr.server reply reply (11) Resource temporarily unavailable subvolume 'clone_0000000000704288' is not ready for operation getpath 2023-07-27T14:33:52.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.272+0000 7f04c57fa700 1 -- 172.21.15.115:0/1258536868 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: -11 subvolume 'clone_0000000000704288' is not ready for operation getpath) v1 ==== 77+0+0 (secure 0 0 0) 0x7f04d006c4e0 con 0x7f04b405f600 2023-07-27T14:33:52.314 INFO:teuthology.orchestra.run.smithi115.stderr:Error EAGAIN: subvolume 'clone_0000000000704288' is not ready for operation getpath 2023-07-27T14:33:52.321 DEBUG:teuthology.orchestra.run:got remote process result: 11 2023-07-27T14:33:52.321 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000704288 2023-07-27T14:33:52.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.471+0000 7f9a0afff700 1 Processor -- start 2023-07-27T14:33:52.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.472+0000 7f9a0afff700 1 -- start start 2023-07-27T14:33:52.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a0afff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04153e00 0x7f9a040c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a0afff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a04064230 0x7f9a040656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a0afff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9a04065bc0 0x7f9a04157a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a0afff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a04062320 con 0x7f9a04064230 2023-07-27T14:33:52.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a0afff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a04066070 con 0x7f9a04065bc0 2023-07-27T14:33:52.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a0afff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04064a80 con 0x7f9a04153e00 2023-07-27T14:33:52.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a03fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a04064230 0x7f9a040656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a03fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a04064230 0x7f9a040656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34218/0 (socket says 172.21.15.115:34218) 2023-07-27T14:33:52.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a03fff700 1 -- 172.21.15.115:0/2132191321 learned_addr learned my addr 172.21.15.115:0/2132191321 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a08d9b700 1 --2- 172.21.15.115:0/2132191321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04153e00 0x7f9a040c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a0959c700 1 --2- 172.21.15.115:0/2132191321 >> v2:172.21.15.159:3300/0 conn(0x7f9a04065bc0 0x7f9a04157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a03fff700 1 -- 172.21.15.115:0/2132191321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04153e00 msgr2=0x7f9a040c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a03fff700 1 --2- 172.21.15.115:0/2132191321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04153e00 0x7f9a040c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a03fff700 1 -- 172.21.15.115:0/2132191321 >> v2:172.21.15.159:3300/0 conn(0x7f9a04065bc0 msgr2=0x7f9a04157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a03fff700 1 --2- 172.21.15.115:0/2132191321 >> v2:172.21.15.159:3300/0 conn(0x7f9a04065bc0 0x7f9a04157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.473+0000 7f9a03fff700 1 -- 172.21.15.115:0/2132191321 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04064d60 con 0x7f9a04064230 2023-07-27T14:33:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.474+0000 7f9a03fff700 1 --2- 172.21.15.115:0/2132191321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04064230 0x7f9a040656d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f99f0006fd0 tx=0x7f99f00090f0).ready entity=mon.0 client_cookie=fc85030f8f07e7c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.474+0000 7f9a037fe700 1 -- 172.21.15.115:0/2132191321 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000b600 con 0x7f9a04064230 2023-07-27T14:33:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.474+0000 7f9a037fe700 1 -- 172.21.15.115:0/2132191321 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000b760 con 0x7f9a04064230 2023-07-27T14:33:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.474+0000 7f9a037fe700 1 -- 172.21.15.115:0/2132191321 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000bae0 con 0x7f9a04064230 2023-07-27T14:33:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.474+0000 7f9a0afff700 1 -- 172.21.15.115:0/2132191321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04064230 msgr2=0x7f9a040656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.474+0000 7f9a0afff700 1 --2- 172.21.15.115:0/2132191321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04064230 0x7f9a040656d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f99f0006fd0 tx=0x7f99f00090f0).stop 2023-07-27T14:33:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.474+0000 7f9a0afff700 1 -- 172.21.15.115:0/2132191321 shutdown_connections 2023-07-27T14:33:52.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.474+0000 7f9a0afff700 1 --2- 172.21.15.115:0/2132191321 >> v2:172.21.15.159:3300/0 conn(0x7f9a04065bc0 0x7f9a04157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.475+0000 7f9a0afff700 1 --2- 172.21.15.115:0/2132191321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04153e00 0x7f9a040c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.475+0000 7f9a0afff700 1 --2- 172.21.15.115:0/2132191321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04064230 0x7f9a040656d0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.475+0000 7f9a0afff700 1 -- 172.21.15.115:0/2132191321 >> 172.21.15.115:0/2132191321 conn(0x7f9a040c7b90 msgr2=0x7f9a040c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:52.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.475+0000 7f9a0afff700 1 -- 172.21.15.115:0/2132191321 shutdown_connections 2023-07-27T14:33:52.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.475+0000 7f9a0afff700 1 -- 172.21.15.115:0/2132191321 wait complete. 2023-07-27T14:33:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.477+0000 7f9a0afff700 1 Processor -- start 2023-07-27T14:33:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.477+0000 7f9a0afff700 1 -- start start 2023-07-27T14:33:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a0afff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04064230 0x7f9a04063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a0afff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04065bc0 0x7f9a041642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a0afff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a04153e00 0x7f9a040ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a0afff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040640b0 con 0x7f9a04065bc0 2023-07-27T14:33:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a0afff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04093ca0 con 0x7f9a04153e00 2023-07-27T14:33:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a0afff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04164ab0 con 0x7f9a04064230 2023-07-27T14:33:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04065bc0 0x7f9a041642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04065bc0 0x7f9a041642d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34224/0 (socket says 172.21.15.115:34224) 2023-07-27T14:33:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.478+0000 7f9a03fff700 1 -- 172.21.15.115:0/1710301641 learned_addr learned my addr 172.21.15.115:0/1710301641 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a08d9b700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04064230 0x7f9a04063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a0959c700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a04153e00 0x7f9a040ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a03fff700 1 -- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04064230 msgr2=0x7f9a04063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a03fff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04064230 0x7f9a04063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a03fff700 1 -- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a04153e00 msgr2=0x7f9a040ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a03fff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a04153e00 0x7f9a040ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a03fff700 1 -- 172.21.15.115:0/1710301641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009370 con 0x7f9a04065bc0 2023-07-27T14:33:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a08d9b700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04064230 0x7f9a04063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a03fff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04065bc0 0x7f9a041642d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f99f0011000 tx=0x7f99f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a00ff9700 1 -- 172.21.15.115:0/1710301641 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000b8d0 con 0x7f9a04065bc0 2023-07-27T14:33:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a00ff9700 1 -- 172.21.15.115:0/1710301641 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000ba50 con 0x7f9a04065bc0 2023-07-27T14:33:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a04164d90 con 0x7f9a04065bc0 2023-07-27T14:33:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a00ff9700 1 -- 172.21.15.115:0/1710301641 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f001c670 con 0x7f9a04065bc0 2023-07-27T14:33:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.479+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a041647c0 con 0x7f9a04065bc0 2023-07-27T14:33:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.480+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a04093e10 con 0x7f9a04065bc0 2023-07-27T14:33:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.481+0000 7f9a00ff9700 1 -- 172.21.15.115:0/1710301641 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 22) v1 ==== 76442+0+0 (secure 0 0 0) 0x7f99f002c070 con 0x7f9a04065bc0 2023-07-27T14:33:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.482+0000 7f9a00ff9700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f600 0x7f99e8061ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.482+0000 7f9a00ff9700 1 -- 172.21.15.115:0/1710301641 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f99f007c550 con 0x7f9a04065bc0 2023-07-27T14:33:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.482+0000 7f9a08d9b700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f600 0x7f99e8061ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:52.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.483+0000 7f9a08d9b700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f600 0x7f99e8061ac0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f99f8006fd0 tx=0x7f99f8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:52.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.486+0000 7f9a00ff9700 1 -- 172.21.15.115:0/1710301641 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99f004d170 con 0x7f9a04065bc0 2023-07-27T14:33:52.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.703+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a04065040 con 0x7f99e805f600 2023-07-27T14:33:52.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.710+0000 7f9a00ff9700 1 -- 172.21.15.115:0/1710301641 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f9a04065040 con 0x7f99e805f600 2023-07-27T14:33:52.750 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:33:52.750 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:33:52.750 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:33:52.751 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:33:52.751 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:33:52.751 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000686370", 2023-07-27T14:33:52.751 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000048506" 2023-07-27T14:33:52.751 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:52.751 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:52.751 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:33:52.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f600 msgr2=0x7f99e8061ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f600 0x7f99e8061ac0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f99f8006fd0 tx=0x7f99f8008040).stop 2023-07-27T14:33:52.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04065bc0 msgr2=0x7f9a041642d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:52.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04065bc0 0x7f9a041642d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f99f0011000 tx=0x7f99f0017000).stop 2023-07-27T14:33:52.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 shutdown_connections 2023-07-27T14:33:52.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99e805f600 0x7f99e8061ac0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a04153e00 0x7f9a040ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a04064230 0x7f9a04063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 --2- 172.21.15.115:0/1710301641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04065bc0 0x7f9a041642d0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:52.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 >> 172.21.15.115:0/1710301641 conn(0x7f9a040c7b90 msgr2=0x7f9a04151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:52.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 shutdown_connections 2023-07-27T14:33:52.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:52.712+0000 7f9a0afff700 1 -- 172.21.15.115:0/1710301641 wait complete. 2023-07-27T14:33:53.770 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000704288 2023-07-27T14:33:53.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.936+0000 7ff448bff700 1 Processor -- start 2023-07-27T14:33:53.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.936+0000 7ff448bff700 1 -- start start 2023-07-27T14:33:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.937+0000 7ff448bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff444068740 0x7ff4440658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.937+0000 7ff448bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441388b0 0x7ff4441525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.937+0000 7ff448bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff444065440 con 0x7ff4441384d0 2023-07-27T14:33:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.937+0000 7ff448bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4440c7a00 con 0x7ff444068740 2023-07-27T14:33:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.937+0000 7ff448bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff444064830 con 0x7ff4441388b0 2023-07-27T14:33:53.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.937+0000 7ff44259c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff4441384d0 0x7ff444068030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55720/0 (socket says 172.21.15.115:55720) 2023-07-27T14:33:53.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.937+0000 7ff44259c700 1 -- 172.21.15.115:0/1297515283 learned_addr learned my addr 172.21.15.115:0/1297515283 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff442d9d700 1 --2- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441388b0 0x7ff4441525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:53.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff441d9b700 1 --2- 172.21.15.115:0/1297515283 >> v2:172.21.15.159:3300/0 conn(0x7ff444068740 0x7ff4440658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff44159a700 1 -- 172.21.15.115:0/1297515283 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634063646 0 0) 0x7ff444065440 con 0x7ff4441384d0 2023-07-27T14:33:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff44159a700 1 -- 172.21.15.115:0/1297515283 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff42c0033f0 con 0x7ff4441384d0 2023-07-27T14:33:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff44159a700 1 -- 172.21.15.115:0/1297515283 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044663573 0 0) 0x7ff42c0033f0 con 0x7ff4441384d0 2023-07-27T14:33:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff441d9b700 1 -- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441388b0 msgr2=0x7ff4441525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff441d9b700 1 --2- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441388b0 0x7ff4441525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff441d9b700 1 -- 172.21.15.115:0/1297515283 >> v1:172.21.15.115:6789/0 conn(0x7ff4441384d0 legacy=0x7ff444068030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:53.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff441d9b700 1 -- 172.21.15.115:0/1297515283 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff444064b10 con 0x7ff444068740 2023-07-27T14:33:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff442d9d700 1 --2- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441388b0 0x7ff4441525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.938+0000 7ff441d9b700 1 --2- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff444068740 0x7ff4440658d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7ff438009790 tx=0x7ff438009060).ready entity=mon.1 client_cookie=40de3d1a798340a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff44159a700 1 -- 172.21.15.115:0/1297515283 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434001470 con 0x7ff444068740 2023-07-27T14:33:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff44159a700 1 -- 172.21.15.115:0/1297515283 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff438011400 con 0x7ff444068740 2023-07-27T14:33:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff44159a700 1 -- 172.21.15.115:0/1297515283 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438011780 con 0x7ff444068740 2023-07-27T14:33:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff448bff700 1 -- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff444068740 msgr2=0x7ff4440658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:53.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff448bff700 1 --2- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff444068740 0x7ff4440658d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7ff438009790 tx=0x7ff438009060).stop 2023-07-27T14:33:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff448bff700 1 -- 172.21.15.115:0/1297515283 shutdown_connections 2023-07-27T14:33:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff448bff700 1 --2- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441388b0 0x7ff4441525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff448bff700 1 --2- 172.21.15.115:0/1297515283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff444068740 0x7ff4440658d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff448bff700 1 -- 172.21.15.115:0/1297515283 >> 172.21.15.115:0/1297515283 conn(0x7ff444062df0 msgr2=0x7ff4440c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff448bff700 1 -- 172.21.15.115:0/1297515283 shutdown_connections 2023-07-27T14:33:53.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.939+0000 7ff448bff700 1 -- 172.21.15.115:0/1297515283 wait complete. 2023-07-27T14:33:53.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.941+0000 7ff448bff700 1 Processor -- start 2023-07-27T14:33:53.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.941+0000 7ff448bff700 1 -- start start 2023-07-27T14:33:53.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff448bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff444068740 0x7ff44414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:53.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff448bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441384d0 0x7ff4440a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:53.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff448bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4441388b0 0x7ff4441541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:53.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff448bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444136d80 con 0x7ff444068740 2023-07-27T14:33:53.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff448bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4440ab020 con 0x7ff4441388b0 2023-07-27T14:33:53.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff448bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4440aa410 con 0x7ff4441384d0 2023-07-27T14:33:53.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff44259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff444068740 0x7ff44414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:53.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff44259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff444068740 0x7ff44414fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59794/0 (socket says 172.21.15.115:59794) 2023-07-27T14:33:53.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff44259c700 1 -- 172.21.15.115:0/2523201942 learned_addr learned my addr 172.21.15.115:0/2523201942 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:53.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff442d9d700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4441388b0 0x7ff4441541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:53.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff441d9b700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441384d0 0x7ff4440a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:53.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff44259c700 1 -- 172.21.15.115:0/2523201942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441384d0 msgr2=0x7ff4440a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:53.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff44259c700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441384d0 0x7ff4440a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:53.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff44259c700 1 -- 172.21.15.115:0/2523201942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4441388b0 msgr2=0x7ff4441541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:53.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff44259c700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4441388b0 0x7ff4441541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:53.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.942+0000 7ff44259c700 1 -- 172.21.15.115:0/2523201942 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009a20 con 0x7ff444068740 2023-07-27T14:33:53.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.943+0000 7ff44259c700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff444068740 0x7ff44414fc60 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7ff43400c890 tx=0x7ff434001bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:53.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.943+0000 7ff4327fc700 1 -- 172.21.15.115:0/2523201942 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434007170 con 0x7ff444068740 2023-07-27T14:33:53.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.943+0000 7ff4327fc700 1 -- 172.21.15.115:0/2523201942 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340072d0 con 0x7ff444068740 2023-07-27T14:33:53.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.943+0000 7ff4327fc700 1 -- 172.21.15.115:0/2523201942 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340048c0 con 0x7ff444068740 2023-07-27T14:33:53.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.943+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4380092a0 con 0x7ff444068740 2023-07-27T14:33:53.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.943+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4440aa9d0 con 0x7ff444068740 2023-07-27T14:33:53.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.944+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44406c470 con 0x7ff444068740 2023-07-27T14:33:53.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.945+0000 7ff4327fc700 1 -- 172.21.15.115:0/2523201942 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7ff434010070 con 0x7ff444068740 2023-07-27T14:33:53.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.946+0000 7ff4327fc700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff42405f690 0x7ff424061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:53.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.946+0000 7ff4327fc700 1 -- 172.21.15.115:0/2523201942 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7ff43407a250 con 0x7ff444068740 2023-07-27T14:33:53.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.946+0000 7ff441d9b700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff42405f690 0x7ff424061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:53.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.946+0000 7ff441d9b700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff42405f690 0x7ff424061b50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7ff4440acd80 tx=0x7ff438016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:53.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:53.950+0000 7ff4327fc700 1 -- 172.21.15.115:0/2523201942 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff43404b0e0 con 0x7ff444068740 2023-07-27T14:33:54.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.157+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4440c75d0 con 0x7ff42405f690 2023-07-27T14:33:55.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.964+0000 7ff4327fc700 1 -- 172.21.15.115:0/2523201942 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7ff4440c75d0 con 0x7ff42405f690 2023-07-27T14:33:55.005 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:33:55.005 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:33:55.006 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:33:55.006 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:33:55.006 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:33:55.006 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000686370", 2023-07-27T14:33:55.006 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000048506" 2023-07-27T14:33:55.006 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:55.006 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:55.007 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:33:55.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff42405f690 msgr2=0x7ff424061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:55.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff42405f690 0x7ff424061b50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7ff4440acd80 tx=0x7ff438016000).stop 2023-07-27T14:33:55.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff444068740 msgr2=0x7ff44414fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:55.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff444068740 0x7ff44414fc60 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7ff43400c890 tx=0x7ff434001bd0).stop 2023-07-27T14:33:55.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 shutdown_connections 2023-07-27T14:33:55.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff42405f690 0x7ff424061b50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:55.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4441388b0 0x7ff4441541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:55.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff444068740 0x7ff44414fc60 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:55.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 --2- 172.21.15.115:0/2523201942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff4441384d0 0x7ff4440a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:55.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.967+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 >> 172.21.15.115:0/2523201942 conn(0x7ff444062df0 msgr2=0x7ff4440c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:55.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.968+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 shutdown_connections 2023-07-27T14:33:55.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:54.968+0000 7ff448bff700 1 -- 172.21.15.115:0/2523201942 wait complete. 2023-07-27T14:33:56.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000704288 2023-07-27T14:33:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.209+0000 7efdf21ff700 1 Processor -- start 2023-07-27T14:33:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.209+0000 7efdf21ff700 1 -- start start 2023-07-27T14:33:56.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdf21ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:56.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdf21ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec068bb0 con 0x7efdec065220 2023-07-27T14:33:56.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdf21ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec06a250 con 0x7efdec0c0ea0 2023-07-27T14:33:56.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdf21ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0656b0 con 0x7efdec150220 2023-07-27T14:33:56.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdebfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efdec065220 0x7efdec0c1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55730/0 (socket says 172.21.15.115:55730) 2023-07-27T14:33:56.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdebfff700 1 -- 172.21.15.115:0/1115862835 learned_addr learned my addr 172.21.15.115:0/1115862835 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:56.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdeb7fe700 1 --2- 172.21.15.115:0/1115862835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:56.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdea7fc700 1 -- 172.21.15.115:0/1115862835 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152589376 0 0) 0x7efdec068bb0 con 0x7efdec065220 2023-07-27T14:33:56.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.211+0000 7efdea7fc700 1 -- 172.21.15.115:0/1115862835 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd40033f0 con 0x7efdec065220 2023-07-27T14:33:56.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdea7fc700 1 -- 172.21.15.115:0/1115862835 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905213199 0 0) 0x7efdec06a250 con 0x7efdec0c0ea0 2023-07-27T14:33:56.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdea7fc700 1 -- 172.21.15.115:0/1115862835 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdec068bb0 con 0x7efdec0c0ea0 2023-07-27T14:33:56.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdeb7fe700 1 -- 172.21.15.115:0/1115862835 >> v1:172.21.15.159:6789/0 conn(0x7efdec0c0ea0 legacy=0x7efdec069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:56.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdeb7fe700 1 -- 172.21.15.115:0/1115862835 >> v1:172.21.15.115:6789/0 conn(0x7efdec065220 legacy=0x7efdec0c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:56.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdeb7fe700 1 -- 172.21.15.115:0/1115862835 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0c1380 con 0x7efdec150220 2023-07-27T14:33:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdeb7fe700 1 --2- 172.21.15.115:0/1115862835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec150600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7efddc0097c0 tx=0x7efddc009060).ready entity=mon.2 client_cookie=59c6c1ac2890a40d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdea7fc700 1 -- 172.21.15.115:0/1115862835 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc00d4a0 con 0x7efdec150220 2023-07-27T14:33:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdea7fc700 1 -- 172.21.15.115:0/1115862835 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc00d600 con 0x7efdec150220 2023-07-27T14:33:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.212+0000 7efdea7fc700 1 -- 172.21.15.115:0/1115862835 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc00d980 con 0x7efdec150220 2023-07-27T14:33:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.213+0000 7efdf21ff700 1 -- 172.21.15.115:0/1115862835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 msgr2=0x7efdec150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.213+0000 7efdf21ff700 1 --2- 172.21.15.115:0/1115862835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec150600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7efddc0097c0 tx=0x7efddc009060).stop 2023-07-27T14:33:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.213+0000 7efdf21ff700 1 -- 172.21.15.115:0/1115862835 shutdown_connections 2023-07-27T14:33:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.213+0000 7efdf21ff700 1 --2- 172.21.15.115:0/1115862835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec150600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:56.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.213+0000 7efdf21ff700 1 -- 172.21.15.115:0/1115862835 >> 172.21.15.115:0/1115862835 conn(0x7efdec062320 msgr2=0x7efdec062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:56.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.213+0000 7efdf21ff700 1 -- 172.21.15.115:0/1115862835 shutdown_connections 2023-07-27T14:33:56.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.213+0000 7efdf21ff700 1 -- 172.21.15.115:0/1115862835 wait complete. 2023-07-27T14:33:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.214+0000 7efdf21ff700 1 Processor -- start 2023-07-27T14:33:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.214+0000 7efdf21ff700 1 -- start start 2023-07-27T14:33:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.215+0000 7efdf21ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdec065220 0x7efdec132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.215+0000 7efdf21ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdec0c0ea0 0x7efdec136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.215+0000 7efdf21ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec137130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.215+0000 7efdf21ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec136410 con 0x7efdec065220 2023-07-27T14:33:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.215+0000 7efdf21ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec135800 con 0x7efdec0c0ea0 2023-07-27T14:33:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.215+0000 7efdf21ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec135ae0 con 0x7efdec150220 2023-07-27T14:33:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdec065220 0x7efdec132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdec065220 0x7efdec132d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59796/0 (socket says 172.21.15.115:59796) 2023-07-27T14:33:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 -- 172.21.15.115:0/1156024304 learned_addr learned my addr 172.21.15.115:0/1156024304 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeaffd700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdec0c0ea0 0x7efdec136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdebfff700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec137130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 -- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 msgr2=0x7efdec137130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec137130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 -- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdec0c0ea0 msgr2=0x7efdec136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdec0c0ea0 0x7efdec136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 -- 172.21.15.115:0/1156024304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc0092a0 con 0x7efdec065220 2023-07-27T14:33:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeaffd700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdec0c0ea0 0x7efdec136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdeb7fe700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdec065220 0x7efdec132d80 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7efddc009db0 tx=0x7efddc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdd37fe700 1 -- 172.21.15.115:0/1156024304 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc000cb0 con 0x7efdec065220 2023-07-27T14:33:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdd37fe700 1 -- 172.21.15.115:0/1156024304 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc00d770 con 0x7efdec065220 2023-07-27T14:33:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec135dc0 con 0x7efdec065220 2023-07-27T14:33:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.216+0000 7efdd37fe700 1 -- 172.21.15.115:0/1156024304 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc01d680 con 0x7efdec065220 2023-07-27T14:33:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.217+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec133270 con 0x7efdec065220 2023-07-27T14:33:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.218+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec06c470 con 0x7efdec065220 2023-07-27T14:33:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.218+0000 7efdd37fe700 1 -- 172.21.15.115:0/1156024304 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7efddc00f070 con 0x7efdec065220 2023-07-27T14:33:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.219+0000 7efdd37fe700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f690 0x7efdd8061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.219+0000 7efdd37fe700 1 -- 172.21.15.115:0/1156024304 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7efddc07bef0 con 0x7efdec065220 2023-07-27T14:33:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.219+0000 7efdeaffd700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f690 0x7efdd8061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.220+0000 7efdeaffd700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f690 0x7efdd8061b50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7efdec14c040 tx=0x7efde0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.223+0000 7efdd37fe700 1 -- 172.21.15.115:0/1156024304 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efddc04ce30 con 0x7efdec065220 2023-07-27T14:33:56.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:56.435+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7efdec068560 con 0x7efdd805f690 2023-07-27T14:33:57.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.177+0000 7efdd37fe700 1 -- 172.21.15.115:0/1156024304 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7efdec068560 con 0x7efdd805f690 2023-07-27T14:33:57.219 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:33:57.219 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:33:57.219 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:33:57.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:33:57.219 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:33:57.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f690 msgr2=0x7efdd8061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f690 0x7efdd8061b50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7efdec14c040 tx=0x7efde0009040).stop 2023-07-27T14:33:57.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdec065220 msgr2=0x7efdec132d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdec065220 0x7efdec132d80 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7efddc009db0 tx=0x7efddc016000).stop 2023-07-27T14:33:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 shutdown_connections 2023-07-27T14:33:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efdd805f690 0x7efdd8061b50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdec150220 0x7efdec137130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdec065220 0x7efdec132d80 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 --2- 172.21.15.115:0/1156024304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdec0c0ea0 0x7efdec136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 >> 172.21.15.115:0/1156024304 conn(0x7efdec062320 msgr2=0x7efdec0c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 shutdown_connections 2023-07-27T14:33:57.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.180+0000 7efdf21ff700 1 -- 172.21.15.115:0/1156024304 wait complete. 2023-07-27T14:33:57.241 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000704288 2023-07-27T14:33:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.394+0000 7f9a099ff700 1 Processor -- start 2023-07-27T14:33:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.394+0000 7f9a099ff700 1 -- start start 2023-07-27T14:33:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a099ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a04063260 0x7f9a04154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a099ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a041553f0 con 0x7f9a0414b1e0 2023-07-27T14:33:57.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a099ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a04157a50 con 0x7f9a0414ae00 2023-07-27T14:33:57.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a099ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a04157d10 con 0x7f9a04063260 2023-07-27T14:33:57.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a027fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a04063260 0x7f9a04154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a037fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9a0414b1e0 0x7f9a040a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55744/0 (socket says 172.21.15.115:55744) 2023-07-27T14:33:57.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a037fe700 1 -- 172.21.15.115:0/2192398276 learned_addr learned my addr 172.21.15.115:0/2192398276 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a027fc700 1 -- 172.21.15.115:0/2192398276 >> v1:172.21.15.159:6789/0 conn(0x7f9a0414ae00 legacy=0x7f9a04062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a027fc700 1 -- 172.21.15.115:0/2192398276 >> v1:172.21.15.115:6789/0 conn(0x7f9a0414b1e0 legacy=0x7f9a040a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.396+0000 7f9a027fc700 1 -- 172.21.15.115:0/2192398276 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04157ff0 con 0x7f9a04063260 2023-07-27T14:33:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a027fc700 1 --2- 172.21.15.115:0/2192398276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a04154f00 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f99f8009760 tx=0x7f99f8009060).ready entity=mon.0 client_cookie=f0693971d6d3b9b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a01ffb700 1 -- 172.21.15.115:0/2192398276 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800b580 con 0x7f9a04063260 2023-07-27T14:33:57.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a01ffb700 1 -- 172.21.15.115:0/2192398276 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f800b6e0 con 0x7f9a04063260 2023-07-27T14:33:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a01ffb700 1 -- 172.21.15.115:0/2192398276 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800ba60 con 0x7f9a04063260 2023-07-27T14:33:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a099ff700 1 -- 172.21.15.115:0/2192398276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 msgr2=0x7f9a04154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a099ff700 1 --2- 172.21.15.115:0/2192398276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a04154f00 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f99f8009760 tx=0x7f99f8009060).stop 2023-07-27T14:33:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a099ff700 1 -- 172.21.15.115:0/2192398276 shutdown_connections 2023-07-27T14:33:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a099ff700 1 --2- 172.21.15.115:0/2192398276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a04154f00 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a099ff700 1 -- 172.21.15.115:0/2192398276 >> 172.21.15.115:0/2192398276 conn(0x7f9a0405e940 msgr2=0x7f9a040cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.397+0000 7f9a099ff700 1 -- 172.21.15.115:0/2192398276 shutdown_connections 2023-07-27T14:33:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.398+0000 7f9a099ff700 1 -- 172.21.15.115:0/2192398276 wait complete. 2023-07-27T14:33:57.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.399+0000 7f9a099ff700 1 Processor -- start 2023-07-27T14:33:57.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.399+0000 7f9a099ff700 1 -- start start 2023-07-27T14:33:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a099ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a041497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a099ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a0414ae00 0x7f9a0414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a099ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a0414b1e0 0x7f9a0414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a099ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0414bff0 con 0x7f9a04063260 2023-07-27T14:33:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a099ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0414d920 con 0x7f9a0414ae00 2023-07-27T14:33:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a099ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04164e40 con 0x7f9a0414b1e0 2023-07-27T14:33:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a02ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a041497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a02ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a041497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59828/0 (socket says 172.21.15.115:59828) 2023-07-27T14:33:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a02ffd700 1 -- 172.21.15.115:0/870067696 learned_addr learned my addr 172.21.15.115:0/870067696 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a027fc700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a0414ae00 0x7f9a0414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.400+0000 7f9a037fe700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a0414b1e0 0x7f9a0414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a02ffd700 1 -- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a0414b1e0 msgr2=0x7f9a0414bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a02ffd700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a0414b1e0 0x7f9a0414bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a02ffd700 1 -- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a0414ae00 msgr2=0x7f9a0414b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a02ffd700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a0414ae00 0x7f9a0414b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a02ffd700 1 -- 172.21.15.115:0/870067696 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80092a0 con 0x7f9a04063260 2023-07-27T14:33:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a027fc700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a0414ae00 0x7f9a0414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:33:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a02ffd700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a041497a0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f99f400c4c0 tx=0x7f99f4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f99eaffd700 1 -- 172.21.15.115:0/870067696 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4007020 con 0x7f9a04063260 2023-07-27T14:33:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f99eaffd700 1 -- 172.21.15.115:0/870067696 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f4001e90 con 0x7f9a04063260 2023-07-27T14:33:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f99eaffd700 1 -- 172.21.15.115:0/870067696 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40073b0 con 0x7f9a04063260 2023-07-27T14:33:57.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0414cff0 con 0x7f9a04063260 2023-07-27T14:33:57.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.401+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0414d5b0 con 0x7f9a04063260 2023-07-27T14:33:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.402+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0406c470 con 0x7f9a04063260 2023-07-27T14:33:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.403+0000 7f99eaffd700 1 -- 172.21.15.115:0/870067696 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7f99f4010070 con 0x7f9a04063260 2023-07-27T14:33:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.404+0000 7f99eaffd700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f005f690 0x7f99f0061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.404+0000 7f99eaffd700 1 -- 172.21.15.115:0/870067696 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f99f407a1d0 con 0x7f9a04063260 2023-07-27T14:33:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.404+0000 7f9a027fc700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f005f690 0x7f99f0061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.405+0000 7f9a027fc700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f005f690 0x7f99f0061b50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f9a04063660 tx=0x7f99f8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:57.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.409+0000 7f99eaffd700 1 -- 172.21.15.115:0/870067696 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99f404ae30 con 0x7f9a04063260 2023-07-27T14:33:57.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.608+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a040c53f0 con 0x7f99f005f690 2023-07-27T14:33:57.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.614+0000 7f99eaffd700 1 -- 172.21.15.115:0/870067696 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f9a040c53f0 con 0x7f99f005f690 2023-07-27T14:33:57.655 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b 2023-07-27T14:33:57.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f005f690 msgr2=0x7f99f0061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f005f690 0x7f99f0061b50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f9a04063660 tx=0x7f99f8017000).stop 2023-07-27T14:33:57.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 msgr2=0x7f9a041497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a041497a0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f99f400c4c0 tx=0x7f99f4007e00).stop 2023-07-27T14:33:57.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 shutdown_connections 2023-07-27T14:33:57.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f99f005f690 0x7f99f0061b50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9a0414b1e0 0x7f9a0414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a04063260 0x7f9a041497a0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 --2- 172.21.15.115:0/870067696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a0414ae00 0x7f9a0414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 >> 172.21.15.115:0/870067696 conn(0x7f9a0405e940 msgr2=0x7f9a0414a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:57.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 shutdown_connections 2023-07-27T14:33:57.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.616+0000 7f9a099ff700 1 -- 172.21.15.115:0/870067696 wait complete. 2023-07-27T14:33:57.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000686370 2023-07-27T14:33:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.824+0000 7fbf083ff700 1 Processor -- start 2023-07-27T14:33:57.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.824+0000 7fbf083ff700 1 -- start start 2023-07-27T14:33:57.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf083ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbf000a5f60 0x7fbf0014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf083ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbf000c31e0 0x7fbf000c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf083ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf001530d0 con 0x7fbf0014f740 2023-07-27T14:33:57.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf083ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf00069f70 con 0x7fbf000c31e0 2023-07-27T14:33:57.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf083ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf000c3b80 con 0x7fbf000a5f60 2023-07-27T14:33:57.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf0619b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbf0014f740 0x7fbf000a5850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55756/0 (socket says 172.21.15.115:55756) 2023-07-27T14:33:57.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf0619b700 1 -- 172.21.15.115:0/2223460268 learned_addr learned my addr 172.21.15.115:0/2223460268 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:57.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf0699c700 1 --2- 172.21.15.115:0/2223460268 >> v2:172.21.15.115:3300/0 conn(0x7fbf000c31e0 0x7fbf000c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.825+0000 7fbf0599a700 1 --2- 172.21.15.115:0/2223460268 >> v2:172.21.15.159:3300/0 conn(0x7fbf000a5f60 0x7fbf0014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf05199700 1 -- 172.21.15.115:0/2223460268 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107240965 0 0) 0x7fbf001530d0 con 0x7fbf0014f740 2023-07-27T14:33:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf05199700 1 -- 172.21.15.115:0/2223460268 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeec0033f0 con 0x7fbf0014f740 2023-07-27T14:33:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf0699c700 1 -- 172.21.15.115:0/2223460268 >> v2:172.21.15.159:3300/0 conn(0x7fbf000a5f60 msgr2=0x7fbf0014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf0699c700 1 --2- 172.21.15.115:0/2223460268 >> v2:172.21.15.159:3300/0 conn(0x7fbf000a5f60 0x7fbf0014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf0699c700 1 -- 172.21.15.115:0/2223460268 >> v1:172.21.15.115:6789/0 conn(0x7fbf0014f740 legacy=0x7fbf000a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf0699c700 1 -- 172.21.15.115:0/2223460268 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf001527a0 con 0x7fbf000c31e0 2023-07-27T14:33:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf0699c700 1 --2- 172.21.15.115:0/2223460268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000c3690 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7fbf00069900 tx=0x7fbef8009780).ready entity=mon.0 client_cookie=8cbcc220c5e91acc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf05199700 1 -- 172.21.15.115:0/2223460268 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef800e070 con 0x7fbf000c31e0 2023-07-27T14:33:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf05199700 1 -- 172.21.15.115:0/2223460268 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef800bab0 con 0x7fbf000c31e0 2023-07-27T14:33:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.826+0000 7fbf05199700 1 -- 172.21.15.115:0/2223460268 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef800be30 con 0x7fbf000c31e0 2023-07-27T14:33:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.827+0000 7fbf083ff700 1 -- 172.21.15.115:0/2223460268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 msgr2=0x7fbf000c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.827+0000 7fbf083ff700 1 --2- 172.21.15.115:0/2223460268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000c3690 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7fbf00069900 tx=0x7fbef8009780).stop 2023-07-27T14:33:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.827+0000 7fbf083ff700 1 -- 172.21.15.115:0/2223460268 shutdown_connections 2023-07-27T14:33:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.827+0000 7fbf083ff700 1 --2- 172.21.15.115:0/2223460268 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000c3690 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.827+0000 7fbf083ff700 1 --2- 172.21.15.115:0/2223460268 >> v2:172.21.15.159:3300/0 conn(0x7fbf000a5f60 0x7fbf0014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.827+0000 7fbf083ff700 1 -- 172.21.15.115:0/2223460268 >> 172.21.15.115:0/2223460268 conn(0x7fbf00062320 msgr2=0x7fbf00062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.827+0000 7fbf083ff700 1 -- 172.21.15.115:0/2223460268 shutdown_connections 2023-07-27T14:33:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.827+0000 7fbf083ff700 1 -- 172.21.15.115:0/2223460268 wait complete. 2023-07-27T14:33:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.828+0000 7fbf083ff700 1 Processor -- start 2023-07-27T14:33:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.828+0000 7fbf083ff700 1 -- start start 2023-07-27T14:33:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.829+0000 7fbf083ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf000a5f60 0x7fbf0014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.829+0000 7fbf083ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.829+0000 7fbf083ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0014f740 0x7fbf000bbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.829+0000 7fbf083ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000a8a10 con 0x7fbf000c31e0 2023-07-27T14:33:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.829+0000 7fbf083ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000a8cf0 con 0x7fbf0014f740 2023-07-27T14:33:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.829+0000 7fbf083ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000a8fd0 con 0x7fbf000a5f60 2023-07-27T14:33:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000a80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59848/0 (socket says 172.21.15.115:59848) 2023-07-27T14:33:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 -- 172.21.15.115:0/3605161811 learned_addr learned my addr 172.21.15.115:0/3605161811 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0619b700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf000a5f60 0x7fbf0014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 -- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf000a5f60 msgr2=0x7fbf0014deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf000a5f60 0x7fbf0014deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0699c700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0014f740 0x7fbf000bbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 -- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0014f740 msgr2=0x7fbf000bbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0014f740 0x7fbf000bbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 -- 172.21.15.115:0/3605161811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8009a20 con 0x7fbf000c31e0 2023-07-27T14:33:57.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0699c700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0014f740 0x7fbf000bbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.830+0000 7fbf0599a700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000a80a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fbef000e900 tx=0x7fbef0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.831+0000 7fbef67fc700 1 -- 172.21.15.115:0/3605161811 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000eea0 con 0x7fbf000c31e0 2023-07-27T14:33:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.831+0000 7fbef67fc700 1 -- 172.21.15.115:0/3605161811 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000c850 con 0x7fbf000c31e0 2023-07-27T14:33:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.831+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf000a92b0 con 0x7fbf000c31e0 2023-07-27T14:33:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.831+0000 7fbef67fc700 1 -- 172.21.15.115:0/3605161811 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000cbd0 con 0x7fbf000c31e0 2023-07-27T14:33:57.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.831+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf000a8590 con 0x7fbf000c31e0 2023-07-27T14:33:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.832+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0006c470 con 0x7fbf000c31e0 2023-07-27T14:33:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.832+0000 7fbef67fc700 1 -- 172.21.15.115:0/3605161811 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7fbef0022070 con 0x7fbf000c31e0 2023-07-27T14:33:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.833+0000 7fbef67fc700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee405f690 0x7fbee4061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:57.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.834+0000 7fbef67fc700 1 -- 172.21.15.115:0/3605161811 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fbef007ab50 con 0x7fbf000c31e0 2023-07-27T14:33:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.834+0000 7fbf0619b700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee405f690 0x7fbee4061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.834+0000 7fbf0619b700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee405f690 0x7fbee4061b50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fbefc005750 tx=0x7fbefc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:57.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:57.838+0000 7fbef67fc700 1 -- 172.21.15.115:0/3605161811 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbef004b9e0 con 0x7fbf000c31e0 2023-07-27T14:33:58.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.037+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000686370", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf000aaef0 con 0x7fbee405f690 2023-07-27T14:33:58.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.048+0000 7fbef67fc700 1 -- 172.21.15.115:0/3605161811 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fbf000aaef0 con 0x7fbee405f690 2023-07-27T14:33:58.089 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000686370/d2f022e1-fb9b-48c4-9759-faaafb16e520 2023-07-27T14:33:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee405f690 msgr2=0x7fbee4061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee405f690 0x7fbee4061b50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fbefc005750 tx=0x7fbefc009040).stop 2023-07-27T14:33:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 msgr2=0x7fbf000a80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000a80a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7fbef000e900 tx=0x7fbef0009060).stop 2023-07-27T14:33:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 shutdown_connections 2023-07-27T14:33:58.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbee405f690 0x7fbee4061b50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0014f740 0x7fbf000bbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf000a5f60 0x7fbf0014deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 --2- 172.21.15.115:0/3605161811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf000c31e0 0x7fbf000a80a0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 >> 172.21.15.115:0/3605161811 conn(0x7fbf00062320 msgr2=0x7fbf000c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:58.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 shutdown_connections 2023-07-27T14:33:58.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.050+0000 7fbf083ff700 1 -- 172.21.15.115:0/3605161811 wait complete. 2023-07-27T14:33:58.107 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000704288 2023-07-27T14:33:58.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.257+0000 7f14401ff700 1 Processor -- start 2023-07-27T14:33:58.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.258+0000 7f14401ff700 1 -- start start 2023-07-27T14:33:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f14401ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f143814f740 0x7f143814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f14401ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14380a5850 0x7f14380a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f14401ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14381530d0 con 0x7f14380c31e0 2023-07-27T14:33:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f14401ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1438069f70 con 0x7f14380a5850 2023-07-27T14:33:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f14401ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14380a61c0 con 0x7f143814f740 2023-07-27T14:33:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f143d79a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14380a5850 0x7f14380a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f143d79a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14380a5850 0x7f14380a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59860/0 (socket says 172.21.15.115:59860) 2023-07-27T14:33:58.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f143d79a700 1 -- 172.21.15.115:0/3916360537 learned_addr learned my addr 172.21.15.115:0/3916360537 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:58.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.259+0000 7f143df9b700 1 --2- 172.21.15.115:0/3916360537 >> v2:172.21.15.159:3300/0 conn(0x7f143814f740 0x7f143814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f143d79a700 1 -- 172.21.15.115:0/3916360537 >> v2:172.21.15.159:3300/0 conn(0x7f143814f740 msgr2=0x7f143814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:58.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f143d79a700 1 --2- 172.21.15.115:0/3916360537 >> v2:172.21.15.159:3300/0 conn(0x7f143814f740 0x7f143814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f143d79a700 1 -- 172.21.15.115:0/3916360537 >> v1:172.21.15.159:6789/0 conn(0x7f14380c31e0 legacy=0x7f14380c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f143d79a700 1 -- 172.21.15.115:0/3916360537 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14381527a0 con 0x7f14380a5850 2023-07-27T14:33:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f143d79a700 1 --2- 172.21.15.115:0/3916360537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380a5850 0x7f14380a5cd0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f1438067850 tx=0x7f14280090f0).ready entity=mon.0 client_cookie=36e2160c8ea380b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f143cf99700 1 -- 172.21.15.115:0/3916360537 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800b5a0 con 0x7f14380a5850 2023-07-27T14:33:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f143cf99700 1 -- 172.21.15.115:0/3916360537 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800b700 con 0x7f14380a5850 2023-07-27T14:33:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f143cf99700 1 -- 172.21.15.115:0/3916360537 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800ba80 con 0x7f14380a5850 2023-07-27T14:33:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f14401ff700 1 -- 172.21.15.115:0/3916360537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380a5850 msgr2=0x7f14380a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.260+0000 7f14401ff700 1 --2- 172.21.15.115:0/3916360537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380a5850 0x7f14380a5cd0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f1438067850 tx=0x7f14280090f0).stop 2023-07-27T14:33:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.261+0000 7f14401ff700 1 -- 172.21.15.115:0/3916360537 shutdown_connections 2023-07-27T14:33:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.261+0000 7f14401ff700 1 --2- 172.21.15.115:0/3916360537 >> v2:172.21.15.159:3300/0 conn(0x7f143814f740 0x7f143814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.261+0000 7f14401ff700 1 --2- 172.21.15.115:0/3916360537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380a5850 0x7f14380a5cd0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.261+0000 7f14401ff700 1 -- 172.21.15.115:0/3916360537 >> 172.21.15.115:0/3916360537 conn(0x7f1438062320 msgr2=0x7f1438062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.261+0000 7f14401ff700 1 -- 172.21.15.115:0/3916360537 shutdown_connections 2023-07-27T14:33:58.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.261+0000 7f14401ff700 1 -- 172.21.15.115:0/3916360537 wait complete. 2023-07-27T14:33:58.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.262+0000 7f14401ff700 1 Processor -- start 2023-07-27T14:33:58.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.262+0000 7f14401ff700 1 -- start start 2023-07-27T14:33:58.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.263+0000 7f14401ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14380a5850 0x7f14380a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.263+0000 7f14401ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380c31e0 0x7f143814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.263+0000 7f14401ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f143814f740 0x7f1438150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.263+0000 7f14401ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380a7fb0 con 0x7f14380c31e0 2023-07-27T14:33:58.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.263+0000 7f14401ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380a8290 con 0x7f14380a5850 2023-07-27T14:33:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.263+0000 7f14401ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14380a8570 con 0x7f143814f740 2023-07-27T14:33:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380c31e0 0x7f143814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380c31e0 0x7f143814d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59874/0 (socket says 172.21.15.115:59874) 2023-07-27T14:33:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 -- 172.21.15.115:0/2844416142 learned_addr learned my addr 172.21.15.115:0/2844416142 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143df9b700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14380a5850 0x7f14380a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143e79c700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f143814f740 0x7f1438150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 -- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f143814f740 msgr2=0x7f1438150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f143814f740 0x7f1438150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 -- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14380a5850 msgr2=0x7f14380a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14380a5850 0x7f14380a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 -- 172.21.15.115:0/2844416142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009370 con 0x7f14380c31e0 2023-07-27T14:33:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143e79c700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f143814f740 0x7f1438150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:33:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f143d79a700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380c31e0 0x7f143814d7b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f1428009130 tx=0x7f1428015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f142dffb700 1 -- 172.21.15.115:0/2844416142 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800b870 con 0x7f14380c31e0 2023-07-27T14:33:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f142dffb700 1 -- 172.21.15.115:0/2844416142 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800b9d0 con 0x7f14380c31e0 2023-07-27T14:33:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f142dffb700 1 -- 172.21.15.115:0/2844416142 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142801c670 con 0x7f14380c31e0 2023-07-27T14:33:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.264+0000 7f14401ff700 1 -- 172.21.15.115:0/2844416142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14380a8850 con 0x7f14380c31e0 2023-07-27T14:33:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.265+0000 7f14401ff700 1 -- 172.21.15.115:0/2844416142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143814dca0 con 0x7f14380c31e0 2023-07-27T14:33:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.266+0000 7f141b7fe700 1 -- 172.21.15.115:0/2844416142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14380a8cf0 con 0x7f14380c31e0 2023-07-27T14:33:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.266+0000 7f142dffb700 1 -- 172.21.15.115:0/2844416142 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7f142800f070 con 0x7f14380c31e0 2023-07-27T14:33:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.267+0000 7f142dffb700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f141c05f690 0x7f141c061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.267+0000 7f142dffb700 1 -- 172.21.15.115:0/2844416142 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f142807bdf0 con 0x7f14380c31e0 2023-07-27T14:33:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.267+0000 7f143df9b700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f141c05f690 0x7f141c061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.268+0000 7f143df9b700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f141c05f690 0x7f141c061b50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f1434006fd0 tx=0x7f1434008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:58.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.271+0000 7f142dffb700 1 -- 172.21.15.115:0/2844416142 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f142804cc80 con 0x7f14380c31e0 2023-07-27T14:33:58.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.471+0000 7f141b7fe700 1 -- 172.21.15.115:0/2844416142 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7f14380a8400 con 0x7f141c05f690 2023-07-27T14:33:58.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.477+0000 7f142dffb700 1 -- 172.21.15.115:0/2844416142 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f14380a8400 con 0x7f141c05f690 2023-07-27T14:33:58.518 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b 2023-07-27T14:33:58.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 -- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f141c05f690 msgr2=0x7f141c061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f141c05f690 0x7f141c061b50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f1434006fd0 tx=0x7f1434008040).stop 2023-07-27T14:33:58.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 -- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380c31e0 msgr2=0x7f143814d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380c31e0 0x7f143814d7b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f1428009130 tx=0x7f1428015000).stop 2023-07-27T14:33:58.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 -- 172.21.15.115:0/2844416142 shutdown_connections 2023-07-27T14:33:58.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f141c05f690 0x7f141c061b50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f143814f740 0x7f1438150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14380a5850 0x7f14380a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 --2- 172.21.15.115:0/2844416142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14380c31e0 0x7f143814d7b0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 -- 172.21.15.115:0/2844416142 >> 172.21.15.115:0/2844416142 conn(0x7f1438062320 msgr2=0x7f14380c0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:58.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 -- 172.21.15.115:0/2844416142 shutdown_connections 2023-07-27T14:33:58.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.479+0000 7f141b7fe700 1 -- 172.21.15.115:0/2844416142 wait complete. 2023-07-27T14:33:58.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:58.537 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:58.590 INFO:teuthology.orchestra.run.smithi115.stdout:65 2023-07-27T14:33:58.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:58.591 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b) 2023-07-27T14:33:58.639 INFO:teuthology.orchestra.run.smithi115.stdout:65 2023-07-27T14:33:58.639 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs clone_0000000000704288 2023-07-27T14:33:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.793+0000 7f4b333ff700 1 Processor -- start 2023-07-27T14:33:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.793+0000 7f4b333ff700 1 -- start start 2023-07-27T14:33:58.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b333ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c0c36b0 0x7f4b2c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b333ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0bd9a0 con 0x7f4b2c13a730 2023-07-27T14:33:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b333ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c066610 con 0x7f4b2c13a350 2023-07-27T14:33:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b333ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c066400 con 0x7f4b2c0c36b0 2023-07-27T14:33:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b3099a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4b2c13a730 0x7f4b2c0be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55772/0 (socket says 172.21.15.115:55772) 2023-07-27T14:33:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b3099a700 1 -- 172.21.15.115:0/2074244288 learned_addr learned my addr 172.21.15.115:0/2074244288 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:33:58.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b3199c700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c0c36b0 0x7f4b2c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297949031 0 0) 0x7f4b2c0bd9a0 con 0x7f4b2c13a730 2023-07-27T14:33:58.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b180033f0 con 0x7f4b2c13a730 2023-07-27T14:33:58.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.795+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735818176 0 0) 0x7f4b2c066610 con 0x7f4b2c13a350 2023-07-27T14:33:58.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b2c0bd9a0 con 0x7f4b2c13a350 2023-07-27T14:33:58.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096754824 0 0) 0x7f4b180033f0 con 0x7f4b2c13a730 2023-07-27T14:33:58.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c0c36b0 msgr2=0x7f4b2c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:58.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c0c36b0 0x7f4b2c065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 >> v1:172.21.15.159:6789/0 conn(0x7f4b2c13a350 legacy=0x7f4b2c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0bdc10 con 0x7f4b2c13a730 2023-07-27T14:33:58.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4b1c001470 con 0x7f4b2c13a730 2023-07-27T14:33:58.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 >> v1:172.21.15.115:6789/0 conn(0x7f4b2c13a730 legacy=0x7f4b2c0be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b18003aa0 0x7f4b18003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18004690 0x7f4b18004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18005000 0x7f4b1800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c066400 con 0x7f4b18005000 2023-07-27T14:33:58.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1800be80 con 0x7f4b18004690 2023-07-27T14:33:58.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1800c040 con 0x7f4b18003aa0 2023-07-27T14:33:58.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3199c700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c0c36b0 0x7f4b2c065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:33:58.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3199c700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18005000 0x7f4b1800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3099a700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18004690 0x7f4b18004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3119b700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b18003aa0 0x7f4b18003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3199c700 1 -- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b18003aa0 msgr2=0x7f4b18003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:58.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3199c700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b18003aa0 0x7f4b18003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3199c700 1 -- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18004690 msgr2=0x7f4b18004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:33:58.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3199c700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18004690 0x7f4b18004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.796+0000 7f4b3199c700 1 -- 172.21.15.115:0/2074244288 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180033f0 con 0x7f4b18005000 2023-07-27T14:33:58.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b3199c700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18005000 0x7f4b1800b8e0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f4b2c0c9a10 tx=0x7f4b2400b040).ready entity=mon.0 client_cookie=86e908b03ed0e8cd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:58.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400ead0 con 0x7f4b18005000 2023-07-27T14:33:58.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2400f040 con 0x7f4b18005000 2023-07-27T14:33:58.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b23fff700 1 -- 172.21.15.115:0/2074244288 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400ee60 con 0x7f4b18005000 2023-07-27T14:33:58.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b333ff700 1 -- 172.21.15.115:0/2074244288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18005000 msgr2=0x7f4b1800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b333ff700 1 --2- 172.21.15.115:0/2074244288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18005000 0x7f4b1800b8e0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f4b2c0c9a10 tx=0x7f4b2400b040).stop 2023-07-27T14:33:58.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b3199c700 1 -- 172.21.15.115:0/2074244288 reap_dead start 2023-07-27T14:33:58.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b333ff700 1 -- 172.21.15.115:0/2074244288 shutdown_connections 2023-07-27T14:33:58.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b333ff700 1 -- 172.21.15.115:0/2074244288 >> 172.21.15.115:0/2074244288 conn(0x7f4b2c05e8f0 msgr2=0x7f4b2c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:58.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.797+0000 7f4b333ff700 1 -- 172.21.15.115:0/2074244288 shutdown_connections 2023-07-27T14:33:58.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.798+0000 7f4b333ff700 1 -- 172.21.15.115:0/2074244288 wait complete. 2023-07-27T14:33:58.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.799+0000 7f4b333ff700 1 Processor -- start 2023-07-27T14:33:58.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.799+0000 7f4b333ff700 1 -- start start 2023-07-27T14:33:58.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b333ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18005000 0x7f4b2c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b333ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b2c153320 0x7f4b2c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b333ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c156a00 0x7f4b2c156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b333ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c15a0 con 0x7f4b2c153320 2023-07-27T14:33:58.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b333ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c0990 con 0x7f4b18005000 2023-07-27T14:33:58.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b333ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c0c70 con 0x7f4b2c156a00 2023-07-27T14:33:58.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b3099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b2c153320 0x7f4b2c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b3099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b2c153320 0x7f4b2c154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59886/0 (socket says 172.21.15.115:59886) 2023-07-27T14:33:58.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.800+0000 7f4b3099a700 1 -- 172.21.15.115:0/4224041897 learned_addr learned my addr 172.21.15.115:0/4224041897 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:33:58.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b3119b700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18005000 0x7f4b2c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b3199c700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c156a00 0x7f4b2c156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b3099a700 1 -- 172.21.15.115:0/4224041897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c156a00 msgr2=0x7f4b2c156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b3099a700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c156a00 0x7f4b2c156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b3099a700 1 -- 172.21.15.115:0/4224041897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18005000 msgr2=0x7f4b2c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:58.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b3099a700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18005000 0x7f4b2c157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:58.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b3099a700 1 -- 172.21.15.115:0/4224041897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0c0f50 con 0x7f4b2c153320 2023-07-27T14:33:58.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b3099a700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b2c153320 0x7f4b2c154f20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f4b1c004a10 tx=0x7f4b1c001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:58.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b217fa700 1 -- 172.21.15.115:0/4224041897 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00f6c0 con 0x7f4b2c153320 2023-07-27T14:33:58.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b217fa700 1 -- 172.21.15.115:0/4224041897 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c00f820 con 0x7f4b2c153320 2023-07-27T14:33:58.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0c1230 con 0x7f4b2c153320 2023-07-27T14:33:58.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b217fa700 1 -- 172.21.15.115:0/4224041897 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00fba0 con 0x7f4b2c153320 2023-07-27T14:33:58.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.801+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c157370 con 0x7f4b2c153320 2023-07-27T14:33:58.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.802+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c06c470 con 0x7f4b2c153320 2023-07-27T14:33:58.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.803+0000 7f4b217fa700 1 -- 172.21.15.115:0/4224041897 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7f4b1c01b030 con 0x7f4b2c153320 2023-07-27T14:33:58.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.804+0000 7f4b217fa700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b1005f690 0x7f4b10061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:33:58.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.804+0000 7f4b217fa700 1 -- 172.21.15.115:0/4224041897 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f4b1c07a1e0 con 0x7f4b2c153320 2023-07-27T14:33:58.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.804+0000 7f4b3119b700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b1005f690 0x7f4b10061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:33:58.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.805+0000 7f4b3119b700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b1005f690 0x7f4b10061b50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f4b28007cc0 tx=0x7f4b28009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:33:58.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:58.808+0000 7f4b217fa700 1 -- 172.21.15.115:0/4224041897 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b1c04aef0 con 0x7f4b2c153320 2023-07-27T14:33:59.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.009+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b2c0bdef0 con 0x7f4b1005f690 2023-07-27T14:33:59.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.016+0000 7f4b217fa700 1 -- 172.21.15.115:0/4224041897 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+714 (secure 0 0 0) 0x7f4b2c0bdef0 con 0x7f4b1005f690 2023-07-27T14:33:59.057 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:33:59.057 INFO:teuthology.orchestra.run.smithi115.stdout: "atime": "2023-07-27 14:33:45", 2023-07-27T14:33:59.058 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_pcent": "undefined", 2023-07-27T14:33:59.058 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_quota": "infinite", 2023-07-27T14:33:59.058 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_used": 67108864, 2023-07-27T14:33:59.058 INFO:teuthology.orchestra.run.smithi115.stdout: "created_at": "2023-07-27 14:33:51", 2023-07-27T14:33:59.058 INFO:teuthology.orchestra.run.smithi115.stdout: "ctime": "2023-07-27 14:33:56", 2023-07-27T14:33:59.058 INFO:teuthology.orchestra.run.smithi115.stdout: "data_pool": "cephfs_data", 2023-07-27T14:33:59.059 INFO:teuthology.orchestra.run.smithi115.stdout: "features": [ 2023-07-27T14:33:59.059 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-clone", 2023-07-27T14:33:59.059 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-autoprotect", 2023-07-27T14:33:59.059 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-retention" 2023-07-27T14:33:59.059 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:33:59.059 INFO:teuthology.orchestra.run.smithi115.stdout: "gid": 0, 2023-07-27T14:33:59.060 INFO:teuthology.orchestra.run.smithi115.stdout: "mode": 16895, 2023-07-27T14:33:59.060 INFO:teuthology.orchestra.run.smithi115.stdout: "mon_addrs": [ 2023-07-27T14:33:59.060 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.115:6789", 2023-07-27T14:33:59.060 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6789", 2023-07-27T14:33:59.060 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6790" 2023-07-27T14:33:59.060 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:33:59.060 INFO:teuthology.orchestra.run.smithi115.stdout: "mtime": "2023-07-27 14:33:50", 2023-07-27T14:33:59.061 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b", 2023-07-27T14:33:59.061 INFO:teuthology.orchestra.run.smithi115.stdout: "pool_namespace": "", 2023-07-27T14:33:59.061 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete", 2023-07-27T14:33:59.061 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "clone", 2023-07-27T14:33:59.061 INFO:teuthology.orchestra.run.smithi115.stdout: "uid": 0 2023-07-27T14:33:59.061 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:33:59.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b1005f690 msgr2=0x7f4b10061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:59.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b1005f690 0x7f4b10061b50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f4b28007cc0 tx=0x7f4b28009040).stop 2023-07-27T14:33:59.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b2c153320 msgr2=0x7f4b2c154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:33:59.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b2c153320 0x7f4b2c154f20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f4b1c004a10 tx=0x7f4b1c001e10).stop 2023-07-27T14:33:59.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 shutdown_connections 2023-07-27T14:33:59.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b1005f690 0x7f4b10061b50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:59.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b2c156a00 0x7f4b2c156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:59.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b18005000 0x7f4b2c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:59.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 --2- 172.21.15.115:0/4224041897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b2c153320 0x7f4b2c154f20 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:33:59.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 >> 172.21.15.115:0/4224041897 conn(0x7f4b2c05e8f0 msgr2=0x7f4b2c0aa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:33:59.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 shutdown_connections 2023-07-27T14:33:59.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:33:59.019+0000 7f4b333ff700 1 -- 172.21.15.115:0/4224041897 wait complete. 2023-07-27T14:33:59.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.077 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:59.123 INFO:teuthology.orchestra.run.smithi115.stderr:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520: ceph.quota.max_bytes: No such attribute 2023-07-27T14:33:59.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:33:59.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.125 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:59.211 INFO:teuthology.orchestra.run.smithi115.stdout:cephfs_data 2023-07-27T14:33:59.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.212 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:59.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.300 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:59.350 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520 2023-07-27T14:33:59.350 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.49 2023-07-27T14:33:59.351 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.22 2023-07-27T14:33:59.351 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.20 2023-07-27T14:33:59.351 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.34 2023-07-27T14:33:59.351 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.55 2023-07-27T14:33:59.351 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.2 2023-07-27T14:33:59.352 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.35 2023-07-27T14:33:59.352 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.30 2023-07-27T14:33:59.352 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.14 2023-07-27T14:33:59.352 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.26 2023-07-27T14:33:59.352 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.51 2023-07-27T14:33:59.352 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.50 2023-07-27T14:33:59.352 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.13 2023-07-27T14:33:59.352 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.10 2023-07-27T14:33:59.353 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.47 2023-07-27T14:33:59.353 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.5 2023-07-27T14:33:59.353 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.37 2023-07-27T14:33:59.353 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.39 2023-07-27T14:33:59.353 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.54 2023-07-27T14:33:59.353 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.36 2023-07-27T14:33:59.353 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.18 2023-07-27T14:33:59.353 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.17 2023-07-27T14:33:59.354 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.4 2023-07-27T14:33:59.354 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.58 2023-07-27T14:33:59.354 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.29 2023-07-27T14:33:59.354 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.38 2023-07-27T14:33:59.354 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.19 2023-07-27T14:33:59.354 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.7 2023-07-27T14:33:59.354 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.48 2023-07-27T14:33:59.355 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.57 2023-07-27T14:33:59.355 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.6 2023-07-27T14:33:59.355 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.53 2023-07-27T14:33:59.355 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.40 2023-07-27T14:33:59.355 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.42 2023-07-27T14:33:59.355 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.0 2023-07-27T14:33:59.355 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.27 2023-07-27T14:33:59.355 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.25 2023-07-27T14:33:59.356 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.32 2023-07-27T14:33:59.356 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.28 2023-07-27T14:33:59.356 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.21 2023-07-27T14:33:59.356 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.9 2023-07-27T14:33:59.356 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.23 2023-07-27T14:33:59.356 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.15 2023-07-27T14:33:59.356 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.8 2023-07-27T14:33:59.356 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.46 2023-07-27T14:33:59.357 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.33 2023-07-27T14:33:59.357 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.45 2023-07-27T14:33:59.357 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.61 2023-07-27T14:33:59.357 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.62 2023-07-27T14:33:59.357 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.52 2023-07-27T14:33:59.357 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.11 2023-07-27T14:33:59.357 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.44 2023-07-27T14:33:59.357 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.3 2023-07-27T14:33:59.358 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.24 2023-07-27T14:33:59.358 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.56 2023-07-27T14:33:59.358 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.63 2023-07-27T14:33:59.358 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.59 2023-07-27T14:33:59.358 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.41 2023-07-27T14:33:59.358 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.12 2023-07-27T14:33:59.358 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.43 2023-07-27T14:33:59.358 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.16 2023-07-27T14:33:59.359 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.31 2023-07-27T14:33:59.359 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.1 2023-07-27T14:33:59.359 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.60 2023-07-27T14:33:59.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.360 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:59.405 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:33:59.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.407 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/) 2023-07-27T14:33:59.492 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:33:59.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.493 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:59.579 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:33:59.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.581 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/) 2023-07-27T14:33:59.627 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:33:59.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.628 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:59.674 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:33:59.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.675 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/) 2023-07-27T14:33:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:33:59.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.723 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520) 2023-07-27T14:33:59.769 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:33:59.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.771 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/) 2023-07-27T14:33:59.817 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:33:59.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.819 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.49) 2023-07-27T14:33:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:33:59.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.906 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.49) 2023-07-27T14:33:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:33:59.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:33:59.958 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.49) 2023-07-27T14:34:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:00.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.007 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.49) 2023-07-27T14:34:00.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:34:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:00.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.053 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.49) 2023-07-27T14:34:00.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:34:00.103 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:00.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.104 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.49) 2023-07-27T14:34:00.189 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:00.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.191 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.49) 2023-07-27T14:34:00.276 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:00.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.277 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.49) 2023-07-27T14:34:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:00.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.366 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.22) 2023-07-27T14:34:00.412 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:00.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.413 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.22) 2023-07-27T14:34:00.501 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:00.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.503 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.22) 2023-07-27T14:34:00.549 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:00.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.551 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.22) 2023-07-27T14:34:00.636 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:00.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.637 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.22) 2023-07-27T14:34:00.723 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:00.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.725 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.22) 2023-07-27T14:34:00.771 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:00.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.772 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.22) 2023-07-27T14:34:00.818 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:00.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.819 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.22) 2023-07-27T14:34:00.907 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:00.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.909 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.20) 2023-07-27T14:34:00.954 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:00.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:00.956 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.20) 2023-07-27T14:34:01.045 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:01.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.046 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.20) 2023-07-27T14:34:01.093 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:01.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.095 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.20) 2023-07-27T14:34:01.141 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:01.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.142 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.20) 2023-07-27T14:34:01.188 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:01.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.190 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.20) 2023-07-27T14:34:01.275 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:01.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.277 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.20) 2023-07-27T14:34:01.323 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:01.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.325 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.20) 2023-07-27T14:34:01.411 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:01.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.412 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.34) 2023-07-27T14:34:01.496 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:01.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.498 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.34) 2023-07-27T14:34:01.544 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:01.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.545 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.34) 2023-07-27T14:34:01.632 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:01.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.634 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.34) 2023-07-27T14:34:01.719 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:01.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.721 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.34) 2023-07-27T14:34:01.767 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:01.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.769 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.34) 2023-07-27T14:34:01.815 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:01.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.817 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.34) 2023-07-27T14:34:01.863 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:01.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.864 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.34) 2023-07-27T14:34:01.949 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:01.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:01.950 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.55) 2023-07-27T14:34:02.037 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:02.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.039 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.55) 2023-07-27T14:34:02.086 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:02.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.087 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.55) 2023-07-27T14:34:02.133 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:02.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.134 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.55) 2023-07-27T14:34:02.220 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:02.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.222 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.55) 2023-07-27T14:34:02.307 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:02.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.309 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.55) 2023-07-27T14:34:02.394 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:02.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.396 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.55) 2023-07-27T14:34:02.441 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:02.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.443 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.55) 2023-07-27T14:34:02.528 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:02.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.529 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.2) 2023-07-27T14:34:02.614 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:02.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.616 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.2) 2023-07-27T14:34:02.703 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:02.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.704 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.2) 2023-07-27T14:34:02.750 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:02.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.752 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.2) 2023-07-27T14:34:02.797 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:02.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.799 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.2) 2023-07-27T14:34:02.844 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:02.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.846 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.2) 2023-07-27T14:34:02.891 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:02.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.893 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.2) 2023-07-27T14:34:02.938 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:02.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:02.940 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.2) 2023-07-27T14:34:03.024 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:03.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.026 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.35) 2023-07-27T14:34:03.111 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:03.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.113 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.35) 2023-07-27T14:34:03.159 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:03.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.160 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.35) 2023-07-27T14:34:03.245 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:03.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.247 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.35) 2023-07-27T14:34:03.332 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:03.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.334 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.35) 2023-07-27T14:34:03.379 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:03.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.381 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.35) 2023-07-27T14:34:03.426 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:03.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.427 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.35) 2023-07-27T14:34:03.512 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:03.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.514 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.35) 2023-07-27T14:34:03.559 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:03.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.561 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.30) 2023-07-27T14:34:03.647 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:03.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.648 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.30) 2023-07-27T14:34:03.694 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:03.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.696 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.30) 2023-07-27T14:34:03.781 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:03.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.783 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.30) 2023-07-27T14:34:03.868 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:03.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.870 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.30) 2023-07-27T14:34:03.915 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:03.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:03.917 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.30) 2023-07-27T14:34:04.002 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:04.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.003 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.30) 2023-07-27T14:34:04.088 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:04.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.090 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.30) 2023-07-27T14:34:04.175 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:04.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.176 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.14) 2023-07-27T14:34:04.262 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:04.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.263 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.14) 2023-07-27T14:34:04.349 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:04.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.350 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.14) 2023-07-27T14:34:04.395 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:04.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.397 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.14) 2023-07-27T14:34:04.481 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:04.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.483 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.14) 2023-07-27T14:34:04.527 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:04.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.529 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.14) 2023-07-27T14:34:04.614 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:04.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.615 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.14) 2023-07-27T14:34:04.701 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:04.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.702 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.14) 2023-07-27T14:34:04.747 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:04.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.749 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.26) 2023-07-27T14:34:04.835 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:04.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.836 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.26) 2023-07-27T14:34:04.882 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:04.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.883 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.26) 2023-07-27T14:34:04.929 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:04.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:04.931 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.26) 2023-07-27T14:34:05.020 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:05.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.022 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.26) 2023-07-27T14:34:05.067 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:05.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.069 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.26) 2023-07-27T14:34:05.154 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:05.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.156 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.26) 2023-07-27T14:34:05.201 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:05.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.203 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.26) 2023-07-27T14:34:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:05.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.290 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.51) 2023-07-27T14:34:05.375 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:05.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.377 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.51) 2023-07-27T14:34:05.423 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:05.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.424 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.51) 2023-07-27T14:34:05.509 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:05.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.511 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.51) 2023-07-27T14:34:05.598 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:05.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.599 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.51) 2023-07-27T14:34:05.684 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:05.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.685 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.51) 2023-07-27T14:34:05.731 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:05.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.733 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.51) 2023-07-27T14:34:05.818 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:05.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.821 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.51) 2023-07-27T14:34:05.867 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:05.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.869 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.50) 2023-07-27T14:34:05.954 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:05.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:05.955 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.50) 2023-07-27T14:34:06.041 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:06.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.042 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.50) 2023-07-27T14:34:06.128 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:06.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.129 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.50) 2023-07-27T14:34:06.215 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:06.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.216 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.50) 2023-07-27T14:34:06.301 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:06.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.302 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.50) 2023-07-27T14:34:06.387 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:06.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.389 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.50) 2023-07-27T14:34:06.473 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:06.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.475 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.50) 2023-07-27T14:34:06.560 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:06.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.562 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.13) 2023-07-27T14:34:06.647 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:06.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.650 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.13) 2023-07-27T14:34:06.737 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:06.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.739 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.13) 2023-07-27T14:34:06.786 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:06.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.788 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.13) 2023-07-27T14:34:06.834 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:06.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.835 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.13) 2023-07-27T14:34:06.920 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:06.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:06.922 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.13) 2023-07-27T14:34:07.008 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:07.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.010 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.13) 2023-07-27T14:34:07.096 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:07.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.097 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.13) 2023-07-27T14:34:07.142 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:07.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.143 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.10) 2023-07-27T14:34:07.228 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:07.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.229 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.10) 2023-07-27T14:34:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:07.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.317 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.10) 2023-07-27T14:34:07.362 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:07.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.363 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.10) 2023-07-27T14:34:07.448 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:07.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.450 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.10) 2023-07-27T14:34:07.534 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:07.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.535 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.10) 2023-07-27T14:34:07.619 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:07.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.620 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.10) 2023-07-27T14:34:07.706 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:07.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.707 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.10) 2023-07-27T14:34:07.752 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:07.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.754 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.47) 2023-07-27T14:34:07.840 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:07.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.841 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.47) 2023-07-27T14:34:07.887 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:07.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.889 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.47) 2023-07-27T14:34:07.974 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:07.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:07.976 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.47) 2023-07-27T14:34:08.060 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:08.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.061 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.47) 2023-07-27T14:34:08.146 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:08.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.147 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.47) 2023-07-27T14:34:08.193 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:08.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.194 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.47) 2023-07-27T14:34:08.240 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:08.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.241 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.47) 2023-07-27T14:34:08.286 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:08.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.288 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.5) 2023-07-27T14:34:08.373 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:08.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.375 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.5) 2023-07-27T14:34:08.460 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:08.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.462 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.5) 2023-07-27T14:34:08.507 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:08.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.508 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.5) 2023-07-27T14:34:08.593 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:08.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.594 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.5) 2023-07-27T14:34:08.679 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:08.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.681 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.5) 2023-07-27T14:34:08.726 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:08.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.728 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.5) 2023-07-27T14:34:08.813 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:08.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.815 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.5) 2023-07-27T14:34:08.900 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:08.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.903 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.37) 2023-07-27T14:34:08.988 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:08.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:08.989 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.37) 2023-07-27T14:34:09.075 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:09.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.077 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.37) 2023-07-27T14:34:09.122 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:09.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.123 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.37) 2023-07-27T14:34:09.208 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:09.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.209 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.37) 2023-07-27T14:34:09.294 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:09.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.295 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.37) 2023-07-27T14:34:09.380 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:09.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.382 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.37) 2023-07-27T14:34:09.466 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:09.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.467 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.37) 2023-07-27T14:34:09.552 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:09.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.554 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.39) 2023-07-27T14:34:09.638 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:09.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.640 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.39) 2023-07-27T14:34:09.726 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:09.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.727 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.39) 2023-07-27T14:34:09.813 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:09.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.815 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.39) 2023-07-27T14:34:09.860 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:09.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.861 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.39) 2023-07-27T14:34:09.947 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:09.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:09.948 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.39) 2023-07-27T14:34:10.033 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:10.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.035 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.39) 2023-07-27T14:34:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:10.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.121 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.39) 2023-07-27T14:34:10.206 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:10.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.207 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.54) 2023-07-27T14:34:10.252 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:10.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.254 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.54) 2023-07-27T14:34:10.340 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:10.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.341 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.54) 2023-07-27T14:34:10.386 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:10.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.388 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.54) 2023-07-27T14:34:10.472 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:10.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.474 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.54) 2023-07-27T14:34:10.560 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:10.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.562 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.54) 2023-07-27T14:34:10.646 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:10.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.648 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.54) 2023-07-27T14:34:10.733 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:10.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.735 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.54) 2023-07-27T14:34:10.820 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:10.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.822 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.36) 2023-07-27T14:34:10.907 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:10.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.909 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.36) 2023-07-27T14:34:10.956 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:10.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:10.958 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.36) 2023-07-27T14:34:11.004 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:11.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.006 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.36) 2023-07-27T14:34:11.091 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:11.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.093 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.36) 2023-07-27T14:34:11.178 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:11.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.179 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.36) 2023-07-27T14:34:11.264 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:11.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.266 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.36) 2023-07-27T14:34:11.350 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:11.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.352 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.36) 2023-07-27T14:34:11.437 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:11.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.438 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.18) 2023-07-27T14:34:11.523 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:11.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.525 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.18) 2023-07-27T14:34:11.610 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:11.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.612 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.18) 2023-07-27T14:34:11.657 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:11.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.659 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.18) 2023-07-27T14:34:11.745 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:11.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.746 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.18) 2023-07-27T14:34:11.792 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:11.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.794 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.18) 2023-07-27T14:34:11.839 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:11.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.841 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.18) 2023-07-27T14:34:11.887 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:11.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.888 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.18) 2023-07-27T14:34:11.973 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:11.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:11.975 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.17) 2023-07-27T14:34:12.060 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:12.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.062 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.17) 2023-07-27T14:34:12.148 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:12.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.150 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.17) 2023-07-27T14:34:12.195 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:12.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.197 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.17) 2023-07-27T14:34:12.242 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:12.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.243 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.17) 2023-07-27T14:34:12.289 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:12.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.290 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.17) 2023-07-27T14:34:12.375 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:12.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.377 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.17) 2023-07-27T14:34:12.422 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:12.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.424 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.17) 2023-07-27T14:34:12.469 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:12.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.470 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.4) 2023-07-27T14:34:12.516 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:12.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.517 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.4) 2023-07-27T14:34:12.603 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:12.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.605 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.4) 2023-07-27T14:34:12.651 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:12.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.653 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.4) 2023-07-27T14:34:12.737 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:12.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.739 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.4) 2023-07-27T14:34:12.824 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:12.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.827 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.4) 2023-07-27T14:34:12.873 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:12.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.874 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.4) 2023-07-27T14:34:12.960 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:12.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:12.961 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.4) 2023-07-27T14:34:13.046 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:13.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.048 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.58) 2023-07-27T14:34:13.133 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:13.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.134 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.58) 2023-07-27T14:34:13.220 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:13.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.221 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.58) 2023-07-27T14:34:13.267 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:13.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.269 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.58) 2023-07-27T14:34:13.355 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:13.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.357 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.58) 2023-07-27T14:34:13.403 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:13.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.406 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.58) 2023-07-27T14:34:13.490 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:13.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.492 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.58) 2023-07-27T14:34:13.577 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:13.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.578 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.58) 2023-07-27T14:34:13.624 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:13.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.625 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.29) 2023-07-27T14:34:13.710 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:13.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.712 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.29) 2023-07-27T14:34:13.797 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:13.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.799 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.29) 2023-07-27T14:34:13.845 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:13.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.847 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.29) 2023-07-27T14:34:13.931 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:13.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:13.933 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.29) 2023-07-27T14:34:14.018 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:14.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.019 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.29) 2023-07-27T14:34:14.105 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:14.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.106 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.29) 2023-07-27T14:34:14.151 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:14.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.153 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.29) 2023-07-27T14:34:14.238 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:14.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.239 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.38) 2023-07-27T14:34:14.285 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:14.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.287 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.38) 2023-07-27T14:34:14.373 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:14.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.374 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.38) 2023-07-27T14:34:14.419 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:14.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.421 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.38) 2023-07-27T14:34:14.506 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:14.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.507 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.38) 2023-07-27T14:34:14.593 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:14.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.594 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.38) 2023-07-27T14:34:14.680 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:14.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.681 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.38) 2023-07-27T14:34:14.767 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:14.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.769 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.38) 2023-07-27T14:34:14.854 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:14.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.855 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.19) 2023-07-27T14:34:14.901 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:14.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.903 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.19) 2023-07-27T14:34:14.949 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:14.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.950 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.19) 2023-07-27T14:34:14.997 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:14.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:14.998 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.19) 2023-07-27T14:34:15.084 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:15.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.086 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.19) 2023-07-27T14:34:15.131 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:15.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.133 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.19) 2023-07-27T14:34:15.178 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:15.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.179 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.19) 2023-07-27T14:34:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:15.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.227 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.19) 2023-07-27T14:34:15.312 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:15.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.313 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.7) 2023-07-27T14:34:15.398 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:15.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.400 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.7) 2023-07-27T14:34:15.486 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:15.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.487 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.7) 2023-07-27T14:34:15.533 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:15.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.534 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.7) 2023-07-27T14:34:15.579 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:15.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.581 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.7) 2023-07-27T14:34:15.627 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:15.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.628 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.7) 2023-07-27T14:34:15.713 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:15.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.714 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.7) 2023-07-27T14:34:15.760 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:15.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.761 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.7) 2023-07-27T14:34:15.846 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:15.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.848 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.48) 2023-07-27T14:34:15.893 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:15.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.894 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.48) 2023-07-27T14:34:15.940 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:15.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:15.942 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.48) 2023-07-27T14:34:16.027 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:16.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.028 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.48) 2023-07-27T14:34:16.113 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:16.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.114 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.48) 2023-07-27T14:34:16.159 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:16.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.160 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.48) 2023-07-27T14:34:16.206 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:16.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.207 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.48) 2023-07-27T14:34:16.252 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:16.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.254 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.48) 2023-07-27T14:34:16.339 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:16.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.340 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.57) 2023-07-27T14:34:16.386 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:16.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.387 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.57) 2023-07-27T14:34:16.433 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:16.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.435 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.57) 2023-07-27T14:34:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:16.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.482 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.57) 2023-07-27T14:34:16.566 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:16.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.568 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.57) 2023-07-27T14:34:16.613 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:16.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.615 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.57) 2023-07-27T14:34:16.660 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:16.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.661 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.57) 2023-07-27T14:34:16.747 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:16.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.748 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.57) 2023-07-27T14:34:16.834 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:16.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.836 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.6) 2023-07-27T14:34:16.881 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:16.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.883 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.6) 2023-07-27T14:34:16.969 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:16.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:16.970 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.6) 2023-07-27T14:34:17.056 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:17.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.057 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.6) 2023-07-27T14:34:17.103 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:17.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.104 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.6) 2023-07-27T14:34:17.189 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:17.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.191 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.6) 2023-07-27T14:34:17.275 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:17.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.276 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.6) 2023-07-27T14:34:17.322 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:17.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.323 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.6) 2023-07-27T14:34:17.408 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:17.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.410 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.53) 2023-07-27T14:34:17.495 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:17.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.496 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.53) 2023-07-27T14:34:17.542 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:17.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.544 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.53) 2023-07-27T14:34:17.589 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:17.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.590 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.53) 2023-07-27T14:34:17.676 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:17.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.677 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.53) 2023-07-27T14:34:17.723 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:17.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.724 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.53) 2023-07-27T14:34:17.810 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:17.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.811 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.53) 2023-07-27T14:34:17.857 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:17.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.858 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.53) 2023-07-27T14:34:17.943 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:17.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:17.944 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.40) 2023-07-27T14:34:18.030 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:18.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.031 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.40) 2023-07-27T14:34:18.117 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:18.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.118 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.40) 2023-07-27T14:34:18.163 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:18.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.165 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.40) 2023-07-27T14:34:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:18.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.251 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.40) 2023-07-27T14:34:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:18.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.338 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.40) 2023-07-27T14:34:18.383 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:18.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.385 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.40) 2023-07-27T14:34:18.470 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:18.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.471 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.40) 2023-07-27T14:34:18.556 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:18.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.558 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.42) 2023-07-27T14:34:18.643 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:18.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.645 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.42) 2023-07-27T14:34:18.691 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:18.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.693 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.42) 2023-07-27T14:34:18.738 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:18.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.740 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.42) 2023-07-27T14:34:18.826 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:18.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.828 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.42) 2023-07-27T14:34:18.913 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:18.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:18.915 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.42) 2023-07-27T14:34:19.000 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:19.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.001 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.42) 2023-07-27T14:34:19.087 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:19.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.089 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.42) 2023-07-27T14:34:19.173 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:19.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.175 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.0) 2023-07-27T14:34:19.260 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:19.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.261 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.0) 2023-07-27T14:34:19.348 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:19.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.350 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.0) 2023-07-27T14:34:19.395 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:19.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.397 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.0) 2023-07-27T14:34:19.443 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:19.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.444 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.0) 2023-07-27T14:34:19.530 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:19.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.531 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.0) 2023-07-27T14:34:19.616 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:19.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.618 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.0) 2023-07-27T14:34:19.664 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:19.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.666 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.0) 2023-07-27T14:34:19.712 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:19.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.715 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.27) 2023-07-27T14:34:19.800 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:19.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.802 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.27) 2023-07-27T14:34:19.888 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:19.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.889 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.27) 2023-07-27T14:34:19.935 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:19.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:19.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.27) 2023-07-27T14:34:20.022 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:20.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.023 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.27) 2023-07-27T14:34:20.109 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:20.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.110 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.27) 2023-07-27T14:34:20.196 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:20.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.198 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.27) 2023-07-27T14:34:20.283 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:20.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.284 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.27) 2023-07-27T14:34:20.329 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:20.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.331 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.25) 2023-07-27T14:34:20.376 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:20.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.378 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.25) 2023-07-27T14:34:20.423 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:20.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.425 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.25) 2023-07-27T14:34:20.510 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:20.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.512 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.25) 2023-07-27T14:34:20.557 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:20.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.559 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.25) 2023-07-27T14:34:20.644 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:20.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.646 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.25) 2023-07-27T14:34:20.730 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:20.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.732 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.25) 2023-07-27T14:34:20.818 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:20.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.820 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.25) 2023-07-27T14:34:20.865 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:20.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.867 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.32) 2023-07-27T14:34:20.912 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:20.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:20.914 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.32) 2023-07-27T14:34:21.000 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:21.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.001 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.32) 2023-07-27T14:34:21.047 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:21.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.048 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.32) 2023-07-27T14:34:21.093 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:21.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.095 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.32) 2023-07-27T14:34:21.141 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:21.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.142 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.32) 2023-07-27T14:34:21.188 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:21.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.190 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.32) 2023-07-27T14:34:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:21.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.277 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.32) 2023-07-27T14:34:21.362 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:21.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.363 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.28) 2023-07-27T14:34:21.448 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:21.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.450 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.28) 2023-07-27T14:34:21.536 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:21.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.537 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.28) 2023-07-27T14:34:21.623 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:21.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.624 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.28) 2023-07-27T14:34:21.670 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:21.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.671 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.28) 2023-07-27T14:34:21.757 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:21.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.759 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.28) 2023-07-27T14:34:21.844 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:21.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.846 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.28) 2023-07-27T14:34:21.891 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:21.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.892 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.28) 2023-07-27T14:34:21.978 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:21.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:21.980 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.21) 2023-07-27T14:34:22.068 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:22.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.069 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.21) 2023-07-27T14:34:22.115 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:22.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.116 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.21) 2023-07-27T14:34:22.202 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:22.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.203 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.21) 2023-07-27T14:34:22.289 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:22.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.291 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.21) 2023-07-27T14:34:22.376 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:22.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.377 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.21) 2023-07-27T14:34:22.462 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:22.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.464 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.21) 2023-07-27T14:34:22.549 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:22.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.551 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.21) 2023-07-27T14:34:22.636 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:22.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.638 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.9) 2023-07-27T14:34:22.723 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:22.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.725 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.9) 2023-07-27T14:34:22.812 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:22.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.813 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.9) 2023-07-27T14:34:22.858 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:22.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.860 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.9) 2023-07-27T14:34:22.905 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:22.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.906 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.9) 2023-07-27T14:34:22.991 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:22.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:22.992 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.9) 2023-07-27T14:34:23.038 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:23.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.039 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.9) 2023-07-27T14:34:23.084 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:23.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.086 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.9) 2023-07-27T14:34:23.131 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:23.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.133 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.23) 2023-07-27T14:34:23.218 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:23.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.220 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.23) 2023-07-27T14:34:23.306 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:23.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.307 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.23) 2023-07-27T14:34:23.353 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:23.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.355 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.23) 2023-07-27T14:34:23.439 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:23.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.441 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.23) 2023-07-27T14:34:23.525 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:23.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.527 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.23) 2023-07-27T14:34:23.612 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:23.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.614 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.23) 2023-07-27T14:34:23.699 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:23.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.701 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.23) 2023-07-27T14:34:23.786 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:23.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.788 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.15) 2023-07-27T14:34:23.834 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:23.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.835 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.15) 2023-07-27T14:34:23.921 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:23.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.922 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.15) 2023-07-27T14:34:23.967 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:23.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:23.969 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.15) 2023-07-27T14:34:24.014 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:24.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.016 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.15) 2023-07-27T14:34:24.101 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:24.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.103 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.15) 2023-07-27T14:34:24.148 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:24.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.151 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.15) 2023-07-27T14:34:24.196 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:24.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.198 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.15) 2023-07-27T14:34:24.283 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:24.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.284 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.8) 2023-07-27T14:34:24.369 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:24.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.370 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.8) 2023-07-27T14:34:24.416 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:24.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.418 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.8) 2023-07-27T14:34:24.463 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:24.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.464 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.8) 2023-07-27T14:34:24.549 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:24.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.550 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.8) 2023-07-27T14:34:24.636 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:24.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.637 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.8) 2023-07-27T14:34:24.683 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:24.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.684 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.8) 2023-07-27T14:34:24.769 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:24.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.771 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.8) 2023-07-27T14:34:24.857 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:24.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.859 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.46) 2023-07-27T14:34:24.904 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:24.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.905 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.46) 2023-07-27T14:34:24.952 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:24.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:24.954 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.46) 2023-07-27T14:34:25.000 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:25.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.002 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.46) 2023-07-27T14:34:25.087 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:25.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.088 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.46) 2023-07-27T14:34:25.174 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:25.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.175 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.46) 2023-07-27T14:34:25.260 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:25.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.262 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.46) 2023-07-27T14:34:25.348 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:25.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.350 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.46) 2023-07-27T14:34:25.435 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:25.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.437 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.33) 2023-07-27T14:34:25.522 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:25.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.524 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.33) 2023-07-27T14:34:25.569 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:25.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.571 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.33) 2023-07-27T14:34:25.617 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:25.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.618 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.33) 2023-07-27T14:34:25.664 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:25.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.665 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.33) 2023-07-27T14:34:25.750 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:25.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.752 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.33) 2023-07-27T14:34:25.838 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:25.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.839 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.33) 2023-07-27T14:34:25.884 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:25.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.886 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.33) 2023-07-27T14:34:25.971 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:25.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:25.972 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.45) 2023-07-27T14:34:26.056 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:26.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.058 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.45) 2023-07-27T14:34:26.145 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:26.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.147 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.45) 2023-07-27T14:34:26.232 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:26.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.233 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.45) 2023-07-27T14:34:26.278 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:26.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.280 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.45) 2023-07-27T14:34:26.325 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:26.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.327 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.45) 2023-07-27T14:34:26.412 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:26.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.413 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.45) 2023-07-27T14:34:26.499 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:26.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.500 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.45) 2023-07-27T14:34:26.546 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:26.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.547 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.61) 2023-07-27T14:34:26.592 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:26.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.594 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.61) 2023-07-27T14:34:26.680 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:26.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.682 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.61) 2023-07-27T14:34:26.727 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:26.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.729 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.61) 2023-07-27T14:34:26.776 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:26.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.777 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.61) 2023-07-27T14:34:26.862 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:26.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.864 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.61) 2023-07-27T14:34:26.949 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:26.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.951 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.61) 2023-07-27T14:34:26.997 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:26.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:26.999 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.61) 2023-07-27T14:34:27.044 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:27.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.045 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.62) 2023-07-27T14:34:27.130 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:27.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.131 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.62) 2023-07-27T14:34:27.217 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:27.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.218 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.62) 2023-07-27T14:34:27.304 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:27.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.306 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.62) 2023-07-27T14:34:27.391 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:27.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.393 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.62) 2023-07-27T14:34:27.478 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:27.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.479 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.62) 2023-07-27T14:34:27.564 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:27.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.566 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.62) 2023-07-27T14:34:27.650 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:27.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.652 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.62) 2023-07-27T14:34:27.737 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:27.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.739 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.52) 2023-07-27T14:34:27.824 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:27.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.825 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.52) 2023-07-27T14:34:27.911 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:27.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.912 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.52) 2023-07-27T14:34:27.957 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:27.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:27.959 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.52) 2023-07-27T14:34:28.044 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:28.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.046 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.52) 2023-07-27T14:34:28.130 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:28.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.132 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.52) 2023-07-27T14:34:28.216 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:28.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.218 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.52) 2023-07-27T14:34:28.303 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:28.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.304 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.52) 2023-07-27T14:34:28.389 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:28.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.391 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.11) 2023-07-27T14:34:28.475 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:28.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.476 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.11) 2023-07-27T14:34:28.562 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:28.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.564 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.11) 2023-07-27T14:34:28.609 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:28.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.611 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.11) 2023-07-27T14:34:28.656 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:28.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.658 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.11) 2023-07-27T14:34:28.703 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:28.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.704 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.11) 2023-07-27T14:34:28.789 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:28.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.791 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.11) 2023-07-27T14:34:28.876 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:28.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.878 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.11) 2023-07-27T14:34:28.963 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:28.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:28.964 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.44) 2023-07-27T14:34:29.049 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:29.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.051 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.44) 2023-07-27T14:34:29.137 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:29.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.138 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.44) 2023-07-27T14:34:29.183 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:29.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.185 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.44) 2023-07-27T14:34:29.270 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:29.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.272 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.44) 2023-07-27T14:34:29.357 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:29.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.358 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.44) 2023-07-27T14:34:29.444 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:29.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.445 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.44) 2023-07-27T14:34:29.490 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:29.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.492 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.44) 2023-07-27T14:34:29.577 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:29.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.578 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.3) 2023-07-27T14:34:29.664 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:29.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.665 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.3) 2023-07-27T14:34:29.712 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:29.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.713 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.3) 2023-07-27T14:34:29.759 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:29.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.761 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.3) 2023-07-27T14:34:29.806 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:29.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.807 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.3) 2023-07-27T14:34:29.853 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:29.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.855 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.3) 2023-07-27T14:34:29.900 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:29.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.902 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.3) 2023-07-27T14:34:29.988 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:29.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:29.989 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.3) 2023-07-27T14:34:30.035 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:30.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.036 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.24) 2023-07-27T14:34:30.122 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:30.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.123 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.24) 2023-07-27T14:34:30.169 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:30.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.171 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.24) 2023-07-27T14:34:30.224 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:34:30.256 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:30.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.258 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.24) 2023-07-27T14:34:30.260 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:34:30.306 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:30.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.307 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.24) 2023-07-27T14:34:30.392 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:30.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.394 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.24) 2023-07-27T14:34:30.477 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:30.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.479 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.24) 2023-07-27T14:34:30.564 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:30.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.565 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.24) 2023-07-27T14:34:30.650 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:30.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.651 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.56) 2023-07-27T14:34:30.738 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:30.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.740 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.56) 2023-07-27T14:34:30.787 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:30.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.789 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.56) 2023-07-27T14:34:30.834 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:30.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.836 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.56) 2023-07-27T14:34:30.882 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:30.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.883 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.56) 2023-07-27T14:34:30.968 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:30.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:30.969 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.56) 2023-07-27T14:34:31.055 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:31.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.056 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.56) 2023-07-27T14:34:31.102 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:31.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.103 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.56) 2023-07-27T14:34:31.149 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:31.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.150 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.63) 2023-07-27T14:34:31.195 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:31.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.197 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.63) 2023-07-27T14:34:31.286 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:31.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.287 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.63) 2023-07-27T14:34:31.332 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:31.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.333 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.63) 2023-07-27T14:34:31.419 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:31.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.420 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.63) 2023-07-27T14:34:31.506 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:31.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.507 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.63) 2023-07-27T14:34:31.553 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:31.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.555 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.63) 2023-07-27T14:34:31.640 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:31.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.642 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.63) 2023-07-27T14:34:31.727 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:31.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.729 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.59) 2023-07-27T14:34:31.774 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:31.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.776 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.59) 2023-07-27T14:34:31.821 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:31.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.823 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.59) 2023-07-27T14:34:31.908 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:31.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.909 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.59) 2023-07-27T14:34:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:31.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:31.996 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.59) 2023-07-27T14:34:32.082 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:32.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.083 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.59) 2023-07-27T14:34:32.129 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:32.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.131 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.59) 2023-07-27T14:34:32.176 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:32.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.178 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.59) 2023-07-27T14:34:32.223 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:32.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.225 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.41) 2023-07-27T14:34:32.270 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:32.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.272 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.41) 2023-07-27T14:34:32.319 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:32.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.320 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.41) 2023-07-27T14:34:32.406 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:32.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.407 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.41) 2023-07-27T14:34:32.453 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:32.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.455 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.41) 2023-07-27T14:34:32.500 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:32.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.501 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.41) 2023-07-27T14:34:32.547 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:32.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.549 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.41) 2023-07-27T14:34:32.594 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:32.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.595 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.41) 2023-07-27T14:34:32.641 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:32.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.643 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.12) 2023-07-27T14:34:32.727 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:32.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.729 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.12) 2023-07-27T14:34:32.816 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:32.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.817 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.12) 2023-07-27T14:34:32.903 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:32.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.904 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.12) 2023-07-27T14:34:32.949 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:32.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:32.950 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.12) 2023-07-27T14:34:33.035 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:33.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.036 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.12) 2023-07-27T14:34:33.082 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:33.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.083 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.12) 2023-07-27T14:34:33.168 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:33.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.169 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.12) 2023-07-27T14:34:33.215 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:33.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.216 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.43) 2023-07-27T14:34:33.301 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:33.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.302 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.43) 2023-07-27T14:34:33.389 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:33.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.390 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.43) 2023-07-27T14:34:33.436 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:33.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.437 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.43) 2023-07-27T14:34:33.483 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:33.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.484 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.43) 2023-07-27T14:34:33.530 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:33.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.532 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.43) 2023-07-27T14:34:33.617 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:33.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.618 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.43) 2023-07-27T14:34:33.705 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:33.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.706 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.43) 2023-07-27T14:34:33.792 INFO:teuthology.orchestra.run.smithi115.stdout:1690468429 2023-07-27T14:34:33.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.793 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.16) 2023-07-27T14:34:33.879 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:33.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.880 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.16) 2023-07-27T14:34:33.927 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:33.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.928 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.16) 2023-07-27T14:34:33.974 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:33.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:33.976 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.16) 2023-07-27T14:34:34.021 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:34.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.022 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.16) 2023-07-27T14:34:34.068 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:34.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.069 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.16) 2023-07-27T14:34:34.114 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:34.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.116 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.16) 2023-07-27T14:34:34.200 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:34.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.202 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.16) 2023-07-27T14:34:34.286 INFO:teuthology.orchestra.run.smithi115.stdout:1690468427 2023-07-27T14:34:34.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.288 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.31) 2023-07-27T14:34:34.373 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:34.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.374 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.31) 2023-07-27T14:34:34.460 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:34.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.462 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.31) 2023-07-27T14:34:34.507 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:34.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.508 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.31) 2023-07-27T14:34:34.593 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:34.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.595 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.31) 2023-07-27T14:34:34.679 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:34.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.681 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.31) 2023-07-27T14:34:34.765 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:34.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.766 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.31) 2023-07-27T14:34:34.852 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:34.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.853 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.31) 2023-07-27T14:34:34.898 INFO:teuthology.orchestra.run.smithi115.stdout:1690468428 2023-07-27T14:34:34.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.900 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.1) 2023-07-27T14:34:34.984 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:34.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:34.986 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.1) 2023-07-27T14:34:35.071 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:35.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.073 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.1) 2023-07-27T14:34:35.118 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:35.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.119 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.1) 2023-07-27T14:34:35.205 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:35.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.207 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.1) 2023-07-27T14:34:35.292 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:35.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.294 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.1) 2023-07-27T14:34:35.378 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:35.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.380 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.1) 2023-07-27T14:34:35.465 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:35.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.466 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.1) 2023-07-27T14:34:35.551 INFO:teuthology.orchestra.run.smithi115.stdout:1690468426 2023-07-27T14:34:35.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.553 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.60) 2023-07-27T14:34:35.638 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:35.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.60) 2023-07-27T14:34:35.685 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:34:35.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.687 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.60) 2023-07-27T14:34:35.732 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:35.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.733 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.60) 2023-07-27T14:34:35.818 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:34:35.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.820 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.60) 2023-07-27T14:34:35.865 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:35.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.867 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.60) 2023-07-27T14:34:35.912 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:34:35.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.914 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000686370/.snap/snapshot_0000000000048506/d2f022e1-fb9b-48c4-9759-faaafb16e520/subvolume_file.60) 2023-07-27T14:34:35.998 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:35.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:35.999 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000704288/fe2eb58a-5775-4920-a115-468199e6d63b/subvolume_file.60) 2023-07-27T14:34:36.044 INFO:teuthology.orchestra.run.smithi115.stdout:1690468430 2023-07-27T14:34:36.045 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000686370 snapshot_0000000000048506 2023-07-27T14:34:36.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.234+0000 7fbcb91ff700 1 Processor -- start 2023-07-27T14:34:36.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.234+0000 7fbcb91ff700 1 -- start start 2023-07-27T14:34:36.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.235+0000 7fbcb91ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbcb413a350 0x7fbcb4065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.235+0000 7fbcb91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a730 0x7fbcb41585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.235+0000 7fbcb91ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb40bd9a0 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.235+0000 7fbcb91ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb4066400 con 0x7fbcb413a350 2023-07-27T14:34:36.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.235+0000 7fbcb91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4158ae0 con 0x7fbcb413a730 2023-07-27T14:34:36.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb259c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a730 0x7fbcb41585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb2d9d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbcb413a350 0x7fbcb4065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb2d9d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbcb413a350 0x7fbcb4065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:37902/0 (socket says 172.21.15.115:37902) 2023-07-27T14:34:36.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb2d9d700 1 -- 172.21.15.115:0/355662393 learned_addr learned my addr 172.21.15.115:0/355662393 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:36.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb2d9d700 1 -- 172.21.15.115:0/355662393 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a730 msgr2=0x7fbcb41585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:36.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb2d9d700 1 --2- 172.21.15.115:0/355662393 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a730 0x7fbcb41585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb2d9d700 1 -- 172.21.15.115:0/355662393 >> v1:172.21.15.159:6789/0 conn(0x7fbcb40c2fa0 legacy=0x7fbcb4067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb2d9d700 1 -- 172.21.15.115:0/355662393 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4066610 con 0x7fbcb413a350 2023-07-27T14:34:36.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.236+0000 7fbcb1d9b700 1 -- 172.21.15.115:0/355662393 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130409218 0 0) 0x7fbcb40bd9a0 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb2d9d700 1 --2- 172.21.15.115:0/355662393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a350 0x7fbcb4065f10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fbca4006fd0 tx=0x7fbca40090f0).ready entity=mon.1 client_cookie=b8fd071df3cb339d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:36.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb1d9b700 1 -- 172.21.15.115:0/355662393 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca400b580 con 0x7fbcb413a350 2023-07-27T14:34:36.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb1d9b700 1 -- 172.21.15.115:0/355662393 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca400b6e0 con 0x7fbcb413a350 2023-07-27T14:34:36.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb1d9b700 1 -- 172.21.15.115:0/355662393 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca400ba60 con 0x7fbcb413a350 2023-07-27T14:34:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb91ff700 1 -- 172.21.15.115:0/355662393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a350 msgr2=0x7fbcb4065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/355662393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a350 0x7fbcb4065f10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fbca4006fd0 tx=0x7fbca40090f0).stop 2023-07-27T14:34:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb91ff700 1 -- 172.21.15.115:0/355662393 shutdown_connections 2023-07-27T14:34:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/355662393 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a350 0x7fbcb4065f10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/355662393 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a730 0x7fbcb41585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb91ff700 1 -- 172.21.15.115:0/355662393 >> 172.21.15.115:0/355662393 conn(0x7fbcb405e8f0 msgr2=0x7fbcb40c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:36.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb91ff700 1 -- 172.21.15.115:0/355662393 shutdown_connections 2023-07-27T14:34:36.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.237+0000 7fbcb91ff700 1 -- 172.21.15.115:0/355662393 wait complete. 2023-07-27T14:34:36.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.239+0000 7fbcb91ff700 1 Processor -- start 2023-07-27T14:34:36.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.239+0000 7fbcb91ff700 1 -- start start 2023-07-27T14:34:36.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb91ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcb40c2fa0 0x7fbcb41673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a350 0x7fbcb40a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb91ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a730 0x7fbcb40a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb91ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb41678a0 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb91ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb40a9820 con 0x7fbcb413a730 2023-07-27T14:34:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb40c6b00 con 0x7fbcb413a350 2023-07-27T14:34:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcb40c2fa0 0x7fbcb41673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcb40c2fa0 0x7fbcb41673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55562/0 (socket says 172.21.15.115:55562) 2023-07-27T14:34:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb2d9d700 1 -- 172.21.15.115:0/2695035359 learned_addr learned my addr 172.21.15.115:0/2695035359 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb359e700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a730 0x7fbcb40a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.240+0000 7fbcb259c700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a350 0x7fbcb40a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbcb2d9d700 1 -- 172.21.15.115:0/2695035359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a350 msgr2=0x7fbcb40a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbcb2d9d700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a350 0x7fbcb40a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbcb2d9d700 1 -- 172.21.15.115:0/2695035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a730 msgr2=0x7fbcb40a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbcb2d9d700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a730 0x7fbcb40a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbcb2d9d700 1 -- 172.21.15.115:0/2695035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4009370 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbcb2d9d700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcb40c2fa0 0x7fbcb41673b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7fbca4009130 tx=0x7fbca4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbc9affd700 1 -- 172.21.15.115:0/2695035359 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4000bc0 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbc9affd700 1 -- 172.21.15.115:0/2695035359 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca400b850 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb40c5ef0 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbc9affd700 1 -- 172.21.15.115:0/2695035359 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca401c670 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.241+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb40c64b0 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.242+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb406c470 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.243+0000 7fbc9affd700 1 -- 172.21.15.115:0/2695035359 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7fbca402c070 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.244+0000 7fbc9affd700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbca005f690 0x7fbca0061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.244+0000 7fbc9affd700 1 -- 172.21.15.115:0/2695035359 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fbca407c6f0 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.244+0000 7fbcb259c700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbca005f690 0x7fbca0061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.244+0000 7fbcb259c700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbca005f690 0x7fbca0061b50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fbcb4158220 tx=0x7fbca8009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:36.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.248+0000 7fbc9affd700 1 -- 172.21.15.115:0/2695035359 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbca404d240 con 0x7fbcb40c2fa0 2023-07-27T14:34:36.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.453+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000686370", "snap_name": "snapshot_0000000000048506", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcb40bdc10 con 0x7fbca005f690 2023-07-27T14:34:36.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.485+0000 7fbc9affd700 1 -- 172.21.15.115:0/2695035359 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbcb40bdc10 con 0x7fbca005f690 2023-07-27T14:34:36.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbca005f690 msgr2=0x7fbca0061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbca005f690 0x7fbca0061b50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fbcb4158220 tx=0x7fbca8009060).stop 2023-07-27T14:34:36.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcb40c2fa0 msgr2=0x7fbcb41673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcb40c2fa0 0x7fbcb41673b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7fbca4009130 tx=0x7fbca4017000).stop 2023-07-27T14:34:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 shutdown_connections 2023-07-27T14:34:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbca005f690 0x7fbca0061b50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcb413a730 0x7fbcb40a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcb40c2fa0 0x7fbcb41673b0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 --2- 172.21.15.115:0/2695035359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbcb413a350 0x7fbcb40a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 >> 172.21.15.115:0/2695035359 conn(0x7fbcb405e8f0 msgr2=0x7fbcb40ac430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:36.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 shutdown_connections 2023-07-27T14:34:36.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.487+0000 7fbcb91ff700 1 -- 172.21.15.115:0/2695035359 wait complete. 2023-07-27T14:34:36.547 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000686370 2023-07-27T14:34:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.696+0000 7fa1479ff700 1 Processor -- start 2023-07-27T14:34:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.696+0000 7fa1479ff700 1 -- start start 2023-07-27T14:34:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.697+0000 7fa1479ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 0x7fa140154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa1479ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa140063260 0x7fa1400a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa1479ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1401553f0 con 0x7fa14014b1e0 2023-07-27T14:34:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa1479ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa140157a50 con 0x7fa140063260 2023-07-27T14:34:36.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa1479ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa140157d10 con 0x7fa14014ae00 2023-07-27T14:34:36.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa144f9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa14014b1e0 0x7fa140062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49358/0 (socket says 172.21.15.115:49358) 2023-07-27T14:34:36.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa144f9a700 1 -- 172.21.15.115:0/3117208972 learned_addr learned my addr 172.21.15.115:0/3117208972 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa145f9c700 1 --2- 172.21.15.115:0/3117208972 >> v2:172.21.15.115:3300/0 conn(0x7fa140063260 0x7fa1400a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa14579b700 1 --2- 172.21.15.115:0/3117208972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 0x7fa140154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa137fff700 1 -- 172.21.15.115:0/3117208972 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545934401 0 0) 0x7fa1401553f0 con 0x7fa14014b1e0 2023-07-27T14:34:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa137fff700 1 -- 172.21.15.115:0/3117208972 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa12c0033f0 con 0x7fa14014b1e0 2023-07-27T14:34:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa145f9c700 1 -- 172.21.15.115:0/3117208972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 msgr2=0x7fa140154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa145f9c700 1 --2- 172.21.15.115:0/3117208972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 0x7fa140154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa145f9c700 1 -- 172.21.15.115:0/3117208972 >> v1:172.21.15.115:6789/0 conn(0x7fa14014b1e0 legacy=0x7fa140062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.698+0000 7fa145f9c700 1 -- 172.21.15.115:0/3117208972 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140157ff0 con 0x7fa140063260 2023-07-27T14:34:36.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa145f9c700 1 --2- 172.21.15.115:0/3117208972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa140063260 0x7fa1400a98c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fa138009e60 tx=0x7fa138009780).ready entity=mon.0 client_cookie=afe04ab71d13ff7e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:36.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa137fff700 1 -- 172.21.15.115:0/3117208972 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800e070 con 0x7fa140063260 2023-07-27T14:34:36.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa137fff700 1 -- 172.21.15.115:0/3117208972 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13800bb60 con 0x7fa140063260 2023-07-27T14:34:36.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa137fff700 1 -- 172.21.15.115:0/3117208972 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138012410 con 0x7fa140063260 2023-07-27T14:34:36.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa1479ff700 1 -- 172.21.15.115:0/3117208972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa140063260 msgr2=0x7fa1400a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa1479ff700 1 --2- 172.21.15.115:0/3117208972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa140063260 0x7fa1400a98c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fa138009e60 tx=0x7fa138009780).stop 2023-07-27T14:34:36.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa1479ff700 1 -- 172.21.15.115:0/3117208972 shutdown_connections 2023-07-27T14:34:36.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa1479ff700 1 --2- 172.21.15.115:0/3117208972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 0x7fa140154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa1479ff700 1 --2- 172.21.15.115:0/3117208972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa140063260 0x7fa1400a98c0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.699+0000 7fa1479ff700 1 -- 172.21.15.115:0/3117208972 >> 172.21.15.115:0/3117208972 conn(0x7fa14005e940 msgr2=0x7fa1400cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:36.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.700+0000 7fa1479ff700 1 -- 172.21.15.115:0/3117208972 shutdown_connections 2023-07-27T14:34:36.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.700+0000 7fa1479ff700 1 -- 172.21.15.115:0/3117208972 wait complete. 2023-07-27T14:34:36.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.701+0000 7fa1479ff700 1 Processor -- start 2023-07-27T14:34:36.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.701+0000 7fa1479ff700 1 -- start start 2023-07-27T14:34:36.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa1479ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa140063260 0x7fa140149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa1479ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 0x7fa1400c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa1479ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14014b1e0 0x7fa1400c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa1479ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400af010 con 0x7fa14014b1e0 2023-07-27T14:34:36.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa1479ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14014a0b0 con 0x7fa140063260 2023-07-27T14:34:36.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa1479ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400c9e50 con 0x7fa14014ae00 2023-07-27T14:34:36.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa145f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14014b1e0 0x7fa1400c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa145f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14014b1e0 0x7fa1400c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55578/0 (socket says 172.21.15.115:55578) 2023-07-27T14:34:36.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa145f9c700 1 -- 172.21.15.115:0/2273828271 learned_addr learned my addr 172.21.15.115:0/2273828271 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:36.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa144f9a700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 0x7fa1400c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.702+0000 7fa14579b700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa140063260 0x7fa140149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa145f9c700 1 -- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 msgr2=0x7fa1400c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa145f9c700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 0x7fa1400c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa145f9c700 1 -- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa140063260 msgr2=0x7fa140149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa145f9c700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa140063260 0x7fa140149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa145f9c700 1 -- 172.21.15.115:0/2273828271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138009a20 con 0x7fa14014b1e0 2023-07-27T14:34:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa14579b700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa140063260 0x7fa140149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:36.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa145f9c700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14014b1e0 0x7fa1400c98c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fa13800b6c0 tx=0x7fa138009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa1357fa700 1 -- 172.21.15.115:0/2273828271 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13801d630 con 0x7fa14014b1e0 2023-07-27T14:34:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa1357fa700 1 -- 172.21.15.115:0/2273828271 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13801d790 con 0x7fa14014b1e0 2023-07-27T14:34:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1400ca130 con 0x7fa14014b1e0 2023-07-27T14:34:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa1357fa700 1 -- 172.21.15.115:0/2273828271 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13801db30 con 0x7fa14014b1e0 2023-07-27T14:34:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.703+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1400c2e80 con 0x7fa14014b1e0 2023-07-27T14:34:36.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.704+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1400af180 con 0x7fa14014b1e0 2023-07-27T14:34:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.705+0000 7fa1357fa700 1 -- 172.21.15.115:0/2273828271 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7fa138026410 con 0x7fa14014b1e0 2023-07-27T14:34:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.706+0000 7fa1357fa700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12405f660 0x7fa124061b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.706+0000 7fa1357fa700 1 -- 172.21.15.115:0/2273828271 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fa13807c610 con 0x7fa14014b1e0 2023-07-27T14:34:36.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.706+0000 7fa14579b700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12405f660 0x7fa124061b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:36.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.707+0000 7fa14579b700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12405f660 0x7fa124061b20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fa13c00bb60 tx=0x7fa13c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:36.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.710+0000 7fa1357fa700 1 -- 172.21.15.115:0/2273828271 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa13804d550 con 0x7fa14014b1e0 2023-07-27T14:34:36.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.909+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000686370", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1400c1690 con 0x7fa12405f660 2023-07-27T14:34:36.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.926+0000 7fa1357fa700 1 -- 172.21.15.115:0/2273828271 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa13c00f770 con 0x7fa12405f660 2023-07-27T14:34:36.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12405f660 msgr2=0x7fa124061b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12405f660 0x7fa124061b20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fa13c00bb60 tx=0x7fa13c008040).stop 2023-07-27T14:34:36.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14014b1e0 msgr2=0x7fa1400c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:36.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14014b1e0 0x7fa1400c98c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fa13800b6c0 tx=0x7fa138009780).stop 2023-07-27T14:34:36.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 shutdown_connections 2023-07-27T14:34:36.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12405f660 0x7fa124061b20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa14014b1e0 0x7fa1400c98c0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa140063260 0x7fa140149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 --2- 172.21.15.115:0/2273828271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa14014ae00 0x7fa1400c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:36.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 >> 172.21.15.115:0/2273828271 conn(0x7fa14005e940 msgr2=0x7fa14014a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:36.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.928+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 shutdown_connections 2023-07-27T14:34:36.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:36.929+0000 7fa1479ff700 1 -- 172.21.15.115:0/2273828271 wait complete. 2023-07-27T14:34:36.975 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.933+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.975 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.933+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.975 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.933+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.975 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.933+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.976 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.933+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.991 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000704288 2023-07-27T14:34:36.993 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.951+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.993 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.951+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.993 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.951+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.993 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.951+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:36.994 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:34:36.951+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:34:37.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.169+0000 7f363d9ff700 1 Processor -- start 2023-07-27T14:34:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.170+0000 7f363d9ff700 1 -- start start 2023-07-27T14:34:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.171+0000 7f363d9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f36380aab30 0x7f3638156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.171+0000 7f363d9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f36380aaf10 0x7f36380c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.171+0000 7f363d9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3638156070 con 0x7f3638065f10 2023-07-27T14:34:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.171+0000 7f363d9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3638152210 con 0x7f36380aaf10 2023-07-27T14:34:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.171+0000 7f363d9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36380c3380 con 0x7f36380aab30 2023-07-27T14:34:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.171+0000 7f36377fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3638065f10 0x7f3638066310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49362/0 (socket says 172.21.15.115:49362) 2023-07-27T14:34:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.171+0000 7f36367fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f36380aaf10 0x7f36380c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.171+0000 7f36377fe700 1 -- 172.21.15.115:0/1099652579 learned_addr learned my addr 172.21.15.115:0/1099652579 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f3636ffd700 1 --2- 172.21.15.115:0/1099652579 >> v2:172.21.15.159:3300/0 conn(0x7f36380aab30 0x7f3638156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f36367fc700 1 -- 172.21.15.115:0/1099652579 >> v2:172.21.15.159:3300/0 conn(0x7f36380aab30 msgr2=0x7f3638156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f36367fc700 1 --2- 172.21.15.115:0/1099652579 >> v2:172.21.15.159:3300/0 conn(0x7f36380aab30 0x7f3638156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f36367fc700 1 -- 172.21.15.115:0/1099652579 >> v1:172.21.15.115:6789/0 conn(0x7f3638065f10 legacy=0x7f3638066310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f36367fc700 1 -- 172.21.15.115:0/1099652579 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3638155a20 con 0x7f36380aaf10 2023-07-27T14:34:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f3635ffb700 1 -- 172.21.15.115:0/1099652579 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989311034 0 0) 0x7f3638156070 con 0x7f3638065f10 2023-07-27T14:34:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f36367fc700 1 --2- 172.21.15.115:0/1099652579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c4bd0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f363805ee10 tx=0x7f362c009060).ready entity=mon.0 client_cookie=1307622cc75fbd2e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:37.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f3635ffb700 1 -- 172.21.15.115:0/1099652579 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00f510 con 0x7f36380aaf10 2023-07-27T14:34:37.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.172+0000 7f3635ffb700 1 -- 172.21.15.115:0/1099652579 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00f670 con 0x7f36380aaf10 2023-07-27T14:34:37.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.173+0000 7f3635ffb700 1 -- 172.21.15.115:0/1099652579 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00f9f0 con 0x7f36380aaf10 2023-07-27T14:34:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.173+0000 7f363d9ff700 1 -- 172.21.15.115:0/1099652579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 msgr2=0x7f36380c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.173+0000 7f363d9ff700 1 --2- 172.21.15.115:0/1099652579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c4bd0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f363805ee10 tx=0x7f362c009060).stop 2023-07-27T14:34:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.173+0000 7f363d9ff700 1 -- 172.21.15.115:0/1099652579 shutdown_connections 2023-07-27T14:34:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.173+0000 7f363d9ff700 1 --2- 172.21.15.115:0/1099652579 >> v2:172.21.15.159:3300/0 conn(0x7f36380aab30 0x7f3638156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.173+0000 7f363d9ff700 1 --2- 172.21.15.115:0/1099652579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c4bd0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.173+0000 7f363d9ff700 1 -- 172.21.15.115:0/1099652579 >> 172.21.15.115:0/1099652579 conn(0x7f363805e8f0 msgr2=0x7f36380c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.173+0000 7f363d9ff700 1 -- 172.21.15.115:0/1099652579 shutdown_connections 2023-07-27T14:34:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.174+0000 7f363d9ff700 1 -- 172.21.15.115:0/1099652579 wait complete. 2023-07-27T14:34:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.175+0000 7f363d9ff700 1 Processor -- start 2023-07-27T14:34:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.175+0000 7f363d9ff700 1 -- start start 2023-07-27T14:34:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.176+0000 7f363d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3638065f10 0x7f36380ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.176+0000 7f363d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36380aab30 0x7f36380ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.176+0000 7f363d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.176+0000 7f363d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36381465c0 con 0x7f36380aaf10 2023-07-27T14:34:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.176+0000 7f363d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36381459b0 con 0x7f36380aab30 2023-07-27T14:34:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.176+0000 7f363d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3638145c90 con 0x7f3638065f10 2023-07-27T14:34:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55624/0 (socket says 172.21.15.115:55624) 2023-07-27T14:34:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 -- 172.21.15.115:0/2790278765 learned_addr learned my addr 172.21.15.115:0/2790278765 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f3636ffd700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3638065f10 0x7f36380ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36367fc700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36380aab30 0x7f36380ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 -- 172.21.15.115:0/2790278765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3638065f10 msgr2=0x7f36380ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3638065f10 0x7f36380ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 -- 172.21.15.115:0/2790278765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36380aab30 msgr2=0x7f36380ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36380aab30 0x7f36380ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 -- 172.21.15.115:0/2790278765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0092a0 con 0x7f36380aaf10 2023-07-27T14:34:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.177+0000 7f36377fe700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c79a0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f363000c810 tx=0x7f3630007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.178+0000 7f361effd700 1 -- 172.21.15.115:0/2790278765 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630005d30 con 0x7f36380aaf10 2023-07-27T14:34:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.178+0000 7f361effd700 1 -- 172.21.15.115:0/2790278765 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630007110 con 0x7f36380aaf10 2023-07-27T14:34:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.178+0000 7f361effd700 1 -- 172.21.15.115:0/2790278765 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36300074d0 con 0x7f36380aaf10 2023-07-27T14:34:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.178+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3638145f70 con 0x7f36380aaf10 2023-07-27T14:34:37.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.178+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3638147380 con 0x7f36380aaf10 2023-07-27T14:34:37.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.179+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363806c470 con 0x7f36380aaf10 2023-07-27T14:34:37.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.180+0000 7f361effd700 1 -- 172.21.15.115:0/2790278765 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) v1 ==== 76522+0+0 (secure 0 0 0) 0x7f3630010030 con 0x7f36380aaf10 2023-07-27T14:34:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.181+0000 7f361effd700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f362405f690 0x7f3624061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.181+0000 7f361effd700 1 -- 172.21.15.115:0/2790278765 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f363007a940 con 0x7f36380aaf10 2023-07-27T14:34:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.182+0000 7f3636ffd700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f362405f690 0x7f3624061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.182+0000 7f3636ffd700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f362405f690 0x7f3624061b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f363815d990 tx=0x7f3628008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.189+0000 7f361effd700 1 -- 172.21.15.115:0/2790278765 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f363004b490 con 0x7f36380aaf10 2023-07-27T14:34:37.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.396+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000704288", "target": ["mon-mgr", ""]}) v1 -- 0x7f3638155d00 con 0x7f362405f690 2023-07-27T14:34:37.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.417+0000 7f361effd700 1 -- 172.21.15.115:0/2790278765 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3638155d00 con 0x7f362405f690 2023-07-27T14:34:37.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f362405f690 msgr2=0x7f3624061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:37.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f362405f690 0x7f3624061b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f363815d990 tx=0x7f3628008040).stop 2023-07-27T14:34:37.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 msgr2=0x7f36380c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:37.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c79a0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f363000c810 tx=0x7f3630007f30).stop 2023-07-27T14:34:37.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 shutdown_connections 2023-07-27T14:34:37.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f362405f690 0x7f3624061b50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36380aaf10 0x7f36380c79a0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3638065f10 0x7f36380ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 --2- 172.21.15.115:0/2790278765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36380aab30 0x7f36380ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:37.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 >> 172.21.15.115:0/2790278765 conn(0x7f363805e8f0 msgr2=0x7f36380c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:37.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 shutdown_connections 2023-07-27T14:34:37.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:37.419+0000 7f363d9ff700 1 -- 172.21.15.115:0/2790278765 wait complete. 2023-07-27T14:34:37.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:37.484 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:34:37.579 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-07-27T14:34:42.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:42.582 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:34:42.677 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:34:42.678 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:34:42.678 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:34:42.775 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:34:42.884 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:34:42.885 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:34:42.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:42.886 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:34:42.986 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:34:42.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:34:42.986 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:34:43.041 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:34:43.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:34:43.042 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:34:43.135 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:34:43.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:34:43.136 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:34:43.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:34:43.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.328+0000 7f5fe17ff700 1 Processor -- start 2023-07-27T14:34:43.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.328+0000 7f5fe17ff700 1 -- start start 2023-07-27T14:34:43.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fe17ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5fdc0c3470 0x7f5fdc064b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fe17ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc0c3850 0x7f5fdc14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fe17ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc1532a0 con 0x7f5fdc14f9b0 2023-07-27T14:34:43.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fe17ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc064060 con 0x7f5fdc0c3470 2023-07-27T14:34:43.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fe17ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc064340 con 0x7f5fdc0c3850 2023-07-27T14:34:43.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fdb7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5fdc14f9b0 0x7f5fdc152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49372/0 (socket says 172.21.15.115:49372) 2023-07-27T14:34:43.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fdb7fe700 1 -- 172.21.15.115:0/211566397 learned_addr learned my addr 172.21.15.115:0/211566397 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:43.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fdaffd700 1 --2- 172.21.15.115:0/211566397 >> v2:172.21.15.159:3300/0 conn(0x7f5fdc0c3470 0x7f5fdc064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.329+0000 7f5fda7fc700 1 --2- 172.21.15.115:0/211566397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc0c3850 0x7f5fdc14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fd9ffb700 1 -- 172.21.15.115:0/211566397 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667010782 0 0) 0x7f5fdc1532a0 con 0x7f5fdc14f9b0 2023-07-27T14:34:43.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fd9ffb700 1 -- 172.21.15.115:0/211566397 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc40033f0 con 0x7f5fdc14f9b0 2023-07-27T14:34:43.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fda7fc700 1 -- 172.21.15.115:0/211566397 >> v2:172.21.15.159:3300/0 conn(0x7f5fdc0c3470 msgr2=0x7f5fdc064b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:43.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fda7fc700 1 --2- 172.21.15.115:0/211566397 >> v2:172.21.15.159:3300/0 conn(0x7f5fdc0c3470 0x7f5fdc064b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fda7fc700 1 -- 172.21.15.115:0/211566397 >> v1:172.21.15.115:6789/0 conn(0x7f5fdc14f9b0 legacy=0x7f5fdc152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fda7fc700 1 -- 172.21.15.115:0/211566397 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc064620 con 0x7f5fdc0c3850 2023-07-27T14:34:43.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fdaffd700 1 --2- 172.21.15.115:0/211566397 >> v2:172.21.15.159:3300/0 conn(0x7f5fdc0c3470 0x7f5fdc064b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:34:43.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fda7fc700 1 --2- 172.21.15.115:0/211566397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc0c3850 0x7f5fdc14f4c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5fd0009760 tx=0x7f5fd0009060).ready entity=mon.2 client_cookie=d6227745890276ba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:43.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fd9ffb700 1 -- 172.21.15.115:0/211566397 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000d4a0 con 0x7f5fdc0c3850 2023-07-27T14:34:43.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fd9ffb700 1 -- 172.21.15.115:0/211566397 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd000d600 con 0x7f5fdc0c3850 2023-07-27T14:34:43.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.330+0000 7f5fd9ffb700 1 -- 172.21.15.115:0/211566397 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000d980 con 0x7f5fdc0c3850 2023-07-27T14:34:43.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.331+0000 7f5fe17ff700 1 -- 172.21.15.115:0/211566397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc0c3850 msgr2=0x7f5fdc14f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.331+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/211566397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc0c3850 0x7f5fdc14f4c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5fd0009760 tx=0x7f5fd0009060).stop 2023-07-27T14:34:43.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.331+0000 7f5fe17ff700 1 -- 172.21.15.115:0/211566397 shutdown_connections 2023-07-27T14:34:43.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.331+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/211566397 >> v2:172.21.15.159:3300/0 conn(0x7f5fdc0c3470 0x7f5fdc064b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.331+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/211566397 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc0c3850 0x7f5fdc14f4c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.331+0000 7f5fe17ff700 1 -- 172.21.15.115:0/211566397 >> 172.21.15.115:0/211566397 conn(0x7f5fdc062320 msgr2=0x7f5fdc062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:43.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.331+0000 7f5fe17ff700 1 -- 172.21.15.115:0/211566397 shutdown_connections 2023-07-27T14:34:43.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.331+0000 7f5fe17ff700 1 -- 172.21.15.115:0/211566397 wait complete. 2023-07-27T14:34:43.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.332+0000 7f5fe17ff700 1 Processor -- start 2023-07-27T14:34:43.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.332+0000 7f5fe17ff700 1 -- start start 2023-07-27T14:34:43.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.333+0000 7f5fe17ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fdc0c3470 0x7f5fdc0c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.333+0000 7f5fe17ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c3850 0x7f5fdc1612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.333+0000 7f5fe17ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc14f9b0 0x7f5fdc0bec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.333+0000 7f5fe17ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c1cd0 con 0x7f5fdc0c3850 2023-07-27T14:34:43.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.333+0000 7f5fe17ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc14ef00 con 0x7f5fdc0c3470 2023-07-27T14:34:43.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.333+0000 7f5fe17ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc163f90 con 0x7f5fdc14f9b0 2023-07-27T14:34:43.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c3850 0x7f5fdc1612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c3850 0x7f5fdc1612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55626/0 (socket says 172.21.15.115:55626) 2023-07-27T14:34:43.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 -- 172.21.15.115:0/3801860839 learned_addr learned my addr 172.21.15.115:0/3801860839 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:43.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fdb7fe700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc14f9b0 0x7f5fdc0bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fdaffd700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fdc0c3470 0x7f5fdc0c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 -- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc14f9b0 msgr2=0x7f5fdc0bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc14f9b0 0x7f5fdc0bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 -- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fdc0c3470 msgr2=0x7f5fdc0c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fdc0c3470 0x7f5fdc0c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 -- 172.21.15.115:0/3801860839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0092a0 con 0x7f5fdc0c3850 2023-07-27T14:34:43.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fdaffd700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fdc0c3470 0x7f5fdc0c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:43.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fdb7fe700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc14f9b0 0x7f5fdc0bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:43.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fda7fc700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c3850 0x7f5fdc1612e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f5fd0009d50 tx=0x7f5fd0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:43.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fc2ffd700 1 -- 172.21.15.115:0/3801860839 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0000c90 con 0x7f5fdc0c3850 2023-07-27T14:34:43.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fc2ffd700 1 -- 172.21.15.115:0/3801860839 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd000d770 con 0x7f5fdc0c3850 2023-07-27T14:34:43.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.334+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd00092a0 con 0x7f5fdc0c3850 2023-07-27T14:34:43.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.335+0000 7f5fc2ffd700 1 -- 172.21.15.115:0/3801860839 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd001d640 con 0x7f5fdc0c3850 2023-07-27T14:34:43.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.335+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc164300 con 0x7f5fdc0c3850 2023-07-27T14:34:43.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.336+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc0bd900 con 0x7f5fdc0c3850 2023-07-27T14:34:43.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.336+0000 7f5fc2ffd700 1 -- 172.21.15.115:0/3801860839 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f5fd000f070 con 0x7f5fdc0c3850 2023-07-27T14:34:43.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.337+0000 7f5fc2ffd700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc805f720 0x7f5fc8061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.337+0000 7f5fc2ffd700 1 -- 172.21.15.115:0/3801860839 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f5fd007c230 con 0x7f5fdc0c3850 2023-07-27T14:34:43.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.337+0000 7f5fdaffd700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc805f720 0x7f5fc8061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.338+0000 7f5fdaffd700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc805f720 0x7f5fc8061be0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f5fcc009270 tx=0x7f5fcc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:43.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.341+0000 7f5fc2ffd700 1 -- 172.21.15.115:0/3801860839 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fd004cd40 con 0x7f5fdc0c3850 2023-07-27T14:34:43.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.550+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fdc06c470 con 0x7f5fdc0c3850 2023-07-27T14:34:43.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.551+0000 7f5fc2ffd700 1 -- 172.21.15.115:0/3801860839 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f5fd0050360 con 0x7f5fdc0c3850 2023-07-27T14:34:43.594 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:43.594 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3206086489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3206086489},{"type":"v1","addr":"172.21.15.159:6835","nonce":3206086489}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1201288824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1201288824},{"type":"v1","addr":"172.21.15.159:6833","nonce":1201288824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7785,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3016973491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3016973491},{"type":"v1","addr":"172.21.15.115:6835","nonce":3016973491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:35.175025+0000","modified":"2023-07-27T14:33:38.185034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3532071498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3532071498},{"type":"v1","addr":"172.21.15.115:6837","nonce":3532071498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-07-27T14:34:43.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc805f720 msgr2=0x7f5fc8061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc805f720 0x7f5fc8061be0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f5fcc009270 tx=0x7f5fcc008040).stop 2023-07-27T14:34:43.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c3850 msgr2=0x7f5fdc1612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c3850 0x7f5fdc1612e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f5fd0009d50 tx=0x7f5fd0016000).stop 2023-07-27T14:34:43.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 shutdown_connections 2023-07-27T14:34:43.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc805f720 0x7f5fc8061be0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fdc14f9b0 0x7f5fdc0bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fdc0c3470 0x7f5fdc0c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 --2- 172.21.15.115:0/3801860839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fdc0c3850 0x7f5fdc1612e0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 >> 172.21.15.115:0/3801860839 conn(0x7f5fdc062320 msgr2=0x7f5fdc151890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:43.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 shutdown_connections 2023-07-27T14:34:43.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.553+0000 7f5fe17ff700 1 -- 172.21.15.115:0/3801860839 wait complete. 2023-07-27T14:34:43.598 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 69 2023-07-27T14:34:43.613 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:34:43.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.759+0000 7f6dfddff700 1 Processor -- start 2023-07-27T14:34:43.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.759+0000 7f6dfddff700 1 -- start start 2023-07-27T14:34:43.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.760+0000 7f6dfddff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6df8153ec0 0x7f6df80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.760+0000 7f6dfddff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6df80aa050 0x7f6df80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.760+0000 7f6dfddff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df80aa4d0 con 0x7f6df80aaa40 2023-07-27T14:34:43.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.760+0000 7f6dfddff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df80c05c0 con 0x7f6df8153ec0 2023-07-27T14:34:43.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.760+0000 7f6dfddff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df80c1a60 con 0x7f6df80aa050 2023-07-27T14:34:43.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6df80aaa40 0x7f6df8157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41436/0 (socket says 172.21.15.115:41436) 2023-07-27T14:34:43.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df7fff700 1 -- 172.21.15.115:0/3808909448 learned_addr learned my addr 172.21.15.115:0/3808909448 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:43.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df77fe700 1 --2- 172.21.15.115:0/3808909448 >> v2:172.21.15.115:3300/0 conn(0x7f6df8153ec0 0x7f6df80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df6ffd700 1 --2- 172.21.15.115:0/3808909448 >> v2:172.21.15.159:3300/0 conn(0x7f6df80aa050 0x7f6df80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df77fe700 1 -- 172.21.15.115:0/3808909448 >> v2:172.21.15.159:3300/0 conn(0x7f6df80aa050 msgr2=0x7f6df80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:43.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df77fe700 1 --2- 172.21.15.115:0/3808909448 >> v2:172.21.15.159:3300/0 conn(0x7f6df80aa050 0x7f6df80640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df77fe700 1 -- 172.21.15.115:0/3808909448 >> v1:172.21.15.115:6789/0 conn(0x7f6df80aaa40 legacy=0x7f6df8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df77fe700 1 -- 172.21.15.115:0/3808909448 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80bfc90 con 0x7f6df8153ec0 2023-07-27T14:34:43.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df67fc700 1 -- 172.21.15.115:0/3808909448 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223865291 0 0) 0x7f6df0001490 con 0x7f6df80aaa40 2023-07-27T14:34:43.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.761+0000 7f6df77fe700 1 --2- 172.21.15.115:0/3808909448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df8153ec0 0x7f6df80a9b60 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f6df806c0d0 tx=0x7f6de8009060).ready entity=mon.0 client_cookie=3ff6ba84bec4be5b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:43.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6df67fc700 1 -- 172.21.15.115:0/3808909448 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800f510 con 0x7f6df8153ec0 2023-07-27T14:34:43.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6df67fc700 1 -- 172.21.15.115:0/3808909448 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de800f670 con 0x7f6df8153ec0 2023-07-27T14:34:43.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6df67fc700 1 -- 172.21.15.115:0/3808909448 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800f9f0 con 0x7f6df8153ec0 2023-07-27T14:34:43.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6dfddff700 1 -- 172.21.15.115:0/3808909448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df8153ec0 msgr2=0x7f6df80a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3808909448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df8153ec0 0x7f6df80a9b60 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f6df806c0d0 tx=0x7f6de8009060).stop 2023-07-27T14:34:43.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6dfddff700 1 -- 172.21.15.115:0/3808909448 shutdown_connections 2023-07-27T14:34:43.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3808909448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df8153ec0 0x7f6df80a9b60 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3808909448 >> v2:172.21.15.159:3300/0 conn(0x7f6df80aa050 0x7f6df80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6dfddff700 1 -- 172.21.15.115:0/3808909448 >> 172.21.15.115:0/3808909448 conn(0x7f6df80cb610 msgr2=0x7f6df80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:43.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6dfddff700 1 -- 172.21.15.115:0/3808909448 shutdown_connections 2023-07-27T14:34:43.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.762+0000 7f6dfddff700 1 -- 172.21.15.115:0/3808909448 wait complete. 2023-07-27T14:34:43.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.764+0000 7f6dfddff700 1 Processor -- start 2023-07-27T14:34:43.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.764+0000 7f6dfddff700 1 -- start start 2023-07-27T14:34:43.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6dfddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df80aa050 0x7f6df80aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6dfddff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df80aaa40 0x7f6df8163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6dfddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6df8153ec0 0x7f6df8163c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6dfddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80c1c30 con 0x7f6df80aa050 2023-07-27T14:34:43.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6dfddff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8164100 con 0x7f6df80aaa40 2023-07-27T14:34:43.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6dfddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80c1e80 con 0x7f6df8153ec0 2023-07-27T14:34:43.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df80aa050 0x7f6df80aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df80aa050 0x7f6df80aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33144/0 (socket says 172.21.15.115:33144) 2023-07-27T14:34:43.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df77fe700 1 -- 172.21.15.115:0/3533308266 learned_addr learned my addr 172.21.15.115:0/3533308266 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:43.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df7fff700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6df8153ec0 0x7f6df8163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df6ffd700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df80aaa40 0x7f6df8163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df77fe700 1 -- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6df8153ec0 msgr2=0x7f6df8163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df77fe700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6df8153ec0 0x7f6df8163c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df77fe700 1 -- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df80aaa40 msgr2=0x7f6df8163720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df77fe700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df80aaa40 0x7f6df8163720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df77fe700 1 -- 172.21.15.115:0/3533308266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de80092a0 con 0x7f6df80aa050 2023-07-27T14:34:43.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.765+0000 7f6df6ffd700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df80aaa40 0x7f6df8163720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:43.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.766+0000 7f6df77fe700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df80aa050 0x7f6df80aecd0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f6de8009dd0 tx=0x7f6de8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:43.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.766+0000 7f6ddf7fe700 1 -- 172.21.15.115:0/3533308266 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800f7e0 con 0x7f6df80aa050 2023-07-27T14:34:43.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.766+0000 7f6ddf7fe700 1 -- 172.21.15.115:0/3533308266 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de800f940 con 0x7f6df80aa050 2023-07-27T14:34:43.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.766+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df80c2160 con 0x7f6df80aa050 2023-07-27T14:34:43.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.766+0000 7f6ddf7fe700 1 -- 172.21.15.115:0/3533308266 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de801b690 con 0x7f6df80aa050 2023-07-27T14:34:43.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.766+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df80c2720 con 0x7f6df80aa050 2023-07-27T14:34:43.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.767+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df806c470 con 0x7f6df80aa050 2023-07-27T14:34:43.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.768+0000 7f6ddf7fe700 1 -- 172.21.15.115:0/3533308266 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f6de800f070 con 0x7f6df80aa050 2023-07-27T14:34:43.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.769+0000 7f6ddf7fe700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6de405f720 0x7f6de4061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:43.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.769+0000 7f6ddf7fe700 1 -- 172.21.15.115:0/3533308266 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f6de807bfe0 con 0x7f6df80aa050 2023-07-27T14:34:43.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.769+0000 7f6df6ffd700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6de405f720 0x7f6de4061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:43.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.770+0000 7f6df6ffd700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6de405f720 0x7f6de4061be0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f6df80c4c30 tx=0x7f6dec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:43.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.773+0000 7f6ddf7fe700 1 -- 172.21.15.115:0/3533308266 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6de80aa8f0 con 0x7f6df80aa050 2023-07-27T14:34:43.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.944+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6df80c8230 con 0x7f6df80aa050 2023-07-27T14:34:43.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.945+0000 7f6ddf7fe700 1 -- 172.21.15.115:0/3533308266 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+17294 (secure 0 0 0) 0x7f6de804cb80 con 0x7f6df80aa050 2023-07-27T14:34:43.988 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:43.988 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":129,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:34:40.790529+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:33.605422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:34.146639+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":129,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.c","mappings":[{"from":0,"to":5}]},{"pgid":"17.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:34:43.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6de405f720 msgr2=0x7f6de4061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6de405f720 0x7f6de4061be0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f6df80c4c30 tx=0x7f6dec008040).stop 2023-07-27T14:34:43.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df80aa050 msgr2=0x7f6df80aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:43.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df80aa050 0x7f6df80aecd0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f6de8009dd0 tx=0x7f6de8017000).stop 2023-07-27T14:34:43.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 shutdown_connections 2023-07-27T14:34:43.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6de405f720 0x7f6de4061be0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6df8153ec0 0x7f6df8163c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6df80aa050 0x7f6df80aecd0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 --2- 172.21.15.115:0/3533308266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df80aaa40 0x7f6df8163720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:43.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 >> 172.21.15.115:0/3533308266 conn(0x7f6df80cb610 msgr2=0x7f6df80640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:43.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 shutdown_connections 2023-07-27T14:34:43.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:43.947+0000 7f6dfddff700 1 -- 172.21.15.115:0/3533308266 wait complete. 2023-07-27T14:34:44.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:33:33.605422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:33:34.146639+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 129, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:34:44.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:34:44.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.155+0000 7f5adc9ff700 1 Processor -- start 2023-07-27T14:34:44.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.155+0000 7f5adc9ff700 1 -- start start 2023-07-27T14:34:44.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.156+0000 7f5adc9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 0x7f5ad8150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.156+0000 7f5adc9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5ad80c0ea0 0x7f5ad8065220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.156+0000 7f5adc9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad8068bb0 con 0x7f5ad8069040 2023-07-27T14:34:44.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.156+0000 7f5adc9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad806a250 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.156+0000 7f5adc9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80c1380 con 0x7f5ad8150220 2023-07-27T14:34:44.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5ad80c0ea0 0x7f5ad8065220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5ad80c0ea0 0x7f5ad8065220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33152/0 (socket says 172.21.15.115:33152) 2023-07-27T14:34:44.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad5d9b700 1 -- 172.21.15.115:0/1772811595 learned_addr learned my addr 172.21.15.115:0/1772811595 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:44.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad659c700 1 --2- 172.21.15.115:0/1772811595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 0x7f5ad8150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad5d9b700 1 -- 172.21.15.115:0/1772811595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 msgr2=0x7f5ad8150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:44.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad5d9b700 1 --2- 172.21.15.115:0/1772811595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 0x7f5ad8150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad5d9b700 1 -- 172.21.15.115:0/1772811595 >> v1:172.21.15.159:6789/0 conn(0x7f5ad8069040 legacy=0x7f5ad80c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:44.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad5d9b700 1 -- 172.21.15.115:0/1772811595 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8068560 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad5d9b700 1 --2- 172.21.15.115:0/1772811595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad8065220 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f5acc00baf0 tx=0x7f5acc00b370).ready entity=mon.0 client_cookie=b695fa7d868b6941 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:44.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.157+0000 7f5ad559a700 1 -- 172.21.15.115:0/1772811595 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00dbc0 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5ad559a700 1 -- 172.21.15.115:0/1772811595 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00dd20 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5ad559a700 1 -- 172.21.15.115:0/1772811595 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc015600 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1772811595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 msgr2=0x7f5ad8065220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1772811595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad8065220 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f5acc00baf0 tx=0x7f5acc00b370).stop 2023-07-27T14:34:44.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1772811595 shutdown_connections 2023-07-27T14:34:44.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1772811595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 0x7f5ad8150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1772811595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad8065220 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1772811595 >> 172.21.15.115:0/1772811595 conn(0x7f5ad8062320 msgr2=0x7f5ad8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:44.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1772811595 shutdown_connections 2023-07-27T14:34:44.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.158+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1772811595 wait complete. 2023-07-27T14:34:44.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.160+0000 7f5adc9ff700 1 Processor -- start 2023-07-27T14:34:44.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.160+0000 7f5adc9ff700 1 -- start start 2023-07-27T14:34:44.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5adc9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ad8069040 0x7f5ad80ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5adc9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad80a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5adc9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 0x7f5ad81602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5adc9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8163940 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5adc9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80a6740 con 0x7f5ad8069040 2023-07-27T14:34:44.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5adc9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80a6a20 con 0x7f5ad8150220 2023-07-27T14:34:44.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad80a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad80a7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33158/0 (socket says 172.21.15.115:33158) 2023-07-27T14:34:44.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 -- 172.21.15.115:0/1975373825 learned_addr learned my addr 172.21.15.115:0/1975373825 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:44.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad659c700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ad8069040 0x7f5ad80ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 -- 172.21.15.115:0/1975373825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 msgr2=0x7f5ad81602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 0x7f5ad81602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:34:44.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 -- 172.21.15.115:0/1975373825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ad8069040 msgr2=0x7f5ad80ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ad8069040 0x7f5ad80ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 -- 172.21.15.115:0/1975373825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc00b6a0 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.161+0000 7f5ad5d9b700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad80a7e80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f5acc014000 tx=0x7f5acc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.162+0000 7f5ac67fc700 1 -- 172.21.15.115:0/1975373825 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc014560 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.162+0000 7f5ac67fc700 1 -- 172.21.15.115:0/1975373825 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00de90 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.162+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad80a6d00 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.162+0000 7f5ac67fc700 1 -- 172.21.15.115:0/1975373825 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0148f0 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.162+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad80abe90 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.163+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad8163af0 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.164+0000 7f5ac67fc700 1 -- 172.21.15.115:0/1975373825 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f5acc025030 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.164+0000 7f5ac67fc700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ab805f720 0x7f5ab8061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.164+0000 7f5ac67fc700 1 -- 172.21.15.115:0/1975373825 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f5acc07b970 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.165+0000 7f5ad659c700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ab805f720 0x7f5ab8061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.165+0000 7f5ad659c700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ab805f720 0x7f5ab8061be0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f5ac8006fd0 tx=0x7f5ac8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:44.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.169+0000 7f5ac67fc700 1 -- 172.21.15.115:0/1975373825 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ad8163af0 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.338+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5ad80c3a90 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.338+0000 7f5ac67fc700 1 -- 172.21.15.115:0/1975373825 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v129) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5acc023070 con 0x7f5ad80c0ea0 2023-07-27T14:34:44.382 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:34:44.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ab805f720 msgr2=0x7f5ab8061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ab805f720 0x7f5ab8061be0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f5ac8006fd0 tx=0x7f5ac8008040).stop 2023-07-27T14:34:44.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 msgr2=0x7f5ad80a7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad80a7e80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f5acc014000 tx=0x7f5acc01a000).stop 2023-07-27T14:34:44.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 shutdown_connections 2023-07-27T14:34:44.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ab805f720 0x7f5ab8061be0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5ad8150220 0x7f5ad81602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:34:44.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ad8069040 0x7f5ad80ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 --2- 172.21.15.115:0/1975373825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ad80c0ea0 0x7f5ad80a7e80 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 >> 172.21.15.115:0/1975373825 conn(0x7f5ad8062320 msgr2=0x7f5ad814f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:44.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 shutdown_connections 2023-07-27T14:34:44.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.340+0000 7f5adc9ff700 1 -- 172.21.15.115:0/1975373825 wait complete. 2023-07-27T14:34:44.400 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:34:44.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.549+0000 7fac31dff700 1 Processor -- start 2023-07-27T14:34:44.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.549+0000 7fac31dff700 1 -- start start 2023-07-27T14:34:44.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.550+0000 7fac31dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fac2c0a5f60 0x7fac2c14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.550+0000 7fac31dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c0c31e0 0x7fac2c0c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.550+0000 7fac31dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c1530d0 con 0x7fac2c14f740 2023-07-27T14:34:44.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.550+0000 7fac31dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c069f70 con 0x7fac2c0a5f60 2023-07-27T14:34:44.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.550+0000 7fac31dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0c3b80 con 0x7fac2c0c31e0 2023-07-27T14:34:44.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c0c31e0 0x7fac2c0c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2affd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fac2c0a5f60 0x7fac2c14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c0c31e0 0x7fac2c0c3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:59302/0 (socket says 172.21.15.115:59302) 2023-07-27T14:34:44.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2affd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fac2c0a5f60 0x7fac2c14fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:39528/0 (socket says 172.21.15.115:39528) 2023-07-27T14:34:44.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2bfff700 1 -- 172.21.15.115:0/4026952567 learned_addr learned my addr 172.21.15.115:0/4026952567 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:44.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2b7fe700 1 --1- 172.21.15.115:0/4026952567 >> v1:172.21.15.159:6789/0 conn(0x7fac2c14f740 0x7fac2c0a5850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:57872/0 (socket says 172.21.15.115:57872) 2023-07-27T14:34:44.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2bfff700 1 -- 172.21.15.115:0/4026952567 >> v2:172.21.15.159:3300/0 conn(0x7fac2c0a5f60 msgr2=0x7fac2c14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:44.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2bfff700 1 --2- 172.21.15.115:0/4026952567 >> v2:172.21.15.159:3300/0 conn(0x7fac2c0a5f60 0x7fac2c14fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2bfff700 1 -- 172.21.15.115:0/4026952567 >> v1:172.21.15.159:6789/0 conn(0x7fac2c14f740 legacy=0x7fac2c0a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2bfff700 1 -- 172.21.15.115:0/4026952567 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c1527a0 con 0x7fac2c0c31e0 2023-07-27T14:34:44.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2affd700 1 --2- 172.21.15.115:0/4026952567 >> v2:172.21.15.159:3300/0 conn(0x7fac2c0a5f60 0x7fac2c14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:34:44.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.551+0000 7fac2bfff700 1 --2- 172.21.15.115:0/4026952567 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c0c31e0 0x7fac2c0c3690 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fac24009f20 tx=0x7fac24009840).ready entity=mon.2 client_cookie=b5e9639e8373af1a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:44.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac2a7fc700 1 -- 172.21.15.115:0/4026952567 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400e070 con 0x7fac2c0c31e0 2023-07-27T14:34:44.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac2a7fc700 1 -- 172.21.15.115:0/4026952567 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400b9d0 con 0x7fac2c0c31e0 2023-07-27T14:34:44.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac2a7fc700 1 -- 172.21.15.115:0/4026952567 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400bd50 con 0x7fac2c0c31e0 2023-07-27T14:34:44.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac31dff700 1 -- 172.21.15.115:0/4026952567 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c0c31e0 msgr2=0x7fac2c0c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac31dff700 1 --2- 172.21.15.115:0/4026952567 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c0c31e0 0x7fac2c0c3690 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fac24009f20 tx=0x7fac24009840).stop 2023-07-27T14:34:44.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac31dff700 1 -- 172.21.15.115:0/4026952567 shutdown_connections 2023-07-27T14:34:44.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac31dff700 1 --2- 172.21.15.115:0/4026952567 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c0c31e0 0x7fac2c0c3690 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac31dff700 1 --2- 172.21.15.115:0/4026952567 >> v2:172.21.15.159:3300/0 conn(0x7fac2c0a5f60 0x7fac2c14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac31dff700 1 -- 172.21.15.115:0/4026952567 >> 172.21.15.115:0/4026952567 conn(0x7fac2c062320 msgr2=0x7fac2c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:44.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac31dff700 1 -- 172.21.15.115:0/4026952567 shutdown_connections 2023-07-27T14:34:44.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.552+0000 7fac31dff700 1 -- 172.21.15.115:0/4026952567 wait complete. 2023-07-27T14:34:44.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.554+0000 7fac31dff700 1 Processor -- start 2023-07-27T14:34:44.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.554+0000 7fac31dff700 1 -- start start 2023-07-27T14:34:44.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac31dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac2c0a5f60 0x7fac2c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac31dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c0c31e0 0x7fac2c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac31dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c14f740 0x7fac2c0bd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac31dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c151760 con 0x7fac2c0a5f60 2023-07-27T14:34:44.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac31dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c150b70 con 0x7fac2c0c31e0 2023-07-27T14:34:44.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac31dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c150e30 con 0x7fac2c14f740 2023-07-27T14:34:44.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac2b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac2c0a5f60 0x7fac2c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac2b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac2c0a5f60 0x7fac2c14ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33160/0 (socket says 172.21.15.115:33160) 2023-07-27T14:34:44.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac2b7fe700 1 -- 172.21.15.115:0/3356331996 learned_addr learned my addr 172.21.15.115:0/3356331996 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:44.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac2bfff700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c14f740 0x7fac2c0bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.555+0000 7fac2affd700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c0c31e0 0x7fac2c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac2b7fe700 1 -- 172.21.15.115:0/3356331996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c14f740 msgr2=0x7fac2c0bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac2b7fe700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c14f740 0x7fac2c0bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac2b7fe700 1 -- 172.21.15.115:0/3356331996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c0c31e0 msgr2=0x7fac2c14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac2b7fe700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c0c31e0 0x7fac2c14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac2b7fe700 1 -- 172.21.15.115:0/3356331996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200092a0 con 0x7fac2c0a5f60 2023-07-27T14:34:44.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac2b7fe700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac2c0a5f60 0x7fac2c14ae80 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fac1c010840 tx=0x7fac1c001290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:44.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac137fe700 1 -- 172.21.15.115:0/3356331996 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c009d00 con 0x7fac2c0a5f60 2023-07-27T14:34:44.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac137fe700 1 -- 172.21.15.115:0/3356331996 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c009e60 con 0x7fac2c0a5f60 2023-07-27T14:34:44.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac24009ae0 con 0x7fac2c0a5f60 2023-07-27T14:34:44.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac137fe700 1 -- 172.21.15.115:0/3356331996 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00b320 con 0x7fac2c0a5f60 2023-07-27T14:34:44.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.556+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c1513f0 con 0x7fac2c0a5f60 2023-07-27T14:34:44.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.557+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c06c470 con 0x7fac2c0a5f60 2023-07-27T14:34:44.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.558+0000 7fac137fe700 1 -- 172.21.15.115:0/3356331996 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fac1c014030 con 0x7fac2c0a5f60 2023-07-27T14:34:44.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.559+0000 7fac137fe700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac1805f750 0x7fac18061c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.559+0000 7fac137fe700 1 -- 172.21.15.115:0/3356331996 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fac1c07e960 con 0x7fac2c0a5f60 2023-07-27T14:34:44.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.559+0000 7fac2affd700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac1805f750 0x7fac18061c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.559+0000 7fac2affd700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac1805f750 0x7fac18061c10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fac2c062da0 tx=0x7fac20009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:44.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.563+0000 7fac137fe700 1 -- 172.21.15.115:0/3356331996 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac1c04f3f0 con 0x7fac2c0a5f60 2023-07-27T14:34:44.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.734+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac2c152a80 con 0x7fac2c0a5f60 2023-07-27T14:34:44.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.735+0000 7fac137fe700 1 -- 172.21.15.115:0/3356331996 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v129) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac1c052a10 con 0x7fac2c0a5f60 2023-07-27T14:34:44.778 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:34:44.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac1805f750 msgr2=0x7fac18061c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac1805f750 0x7fac18061c10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fac2c062da0 tx=0x7fac20009060).stop 2023-07-27T14:34:44.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac2c0a5f60 msgr2=0x7fac2c14ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac2c0a5f60 0x7fac2c14ae80 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fac1c010840 tx=0x7fac1c001290).stop 2023-07-27T14:34:44.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 shutdown_connections 2023-07-27T14:34:44.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac1805f750 0x7fac18061c10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac2c14f740 0x7fac2c0bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac2c0a5f60 0x7fac2c14ae80 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 --2- 172.21.15.115:0/3356331996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c0c31e0 0x7fac2c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 >> 172.21.15.115:0/3356331996 conn(0x7fac2c062320 msgr2=0x7fac2c14e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:44.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 shutdown_connections 2023-07-27T14:34:44.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.737+0000 7fac31dff700 1 -- 172.21.15.115:0/3356331996 wait complete. 2023-07-27T14:34:44.797 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:34:44.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.945+0000 7fb5035ff700 1 Processor -- start 2023-07-27T14:34:44.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.945+0000 7fb5035ff700 1 -- start start 2023-07-27T14:34:44.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb5035ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c3810 0x7fb4fc150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb5035ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0c0ea0 con 0x7fb4fc1509b0 2023-07-27T14:34:44.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb5035ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc068e10 con 0x7fb4fc0c58d0 2023-07-27T14:34:44.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb5035ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc151280 con 0x7fb4fc0c3810 2023-07-27T14:34:44.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb50139b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb4fc1509b0 0x7fb4fc154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41442/0 (socket says 172.21.15.115:41442) 2023-07-27T14:34:44.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb50139b700 1 -- 172.21.15.115:0/2708604187 learned_addr learned my addr 172.21.15.115:0/2708604187 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:44.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb501b9c700 1 --2- 172.21.15.115:0/2708604187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c3810 0x7fb4fc150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb4f3fff700 1 -- 172.21.15.115:0/2708604187 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836529515 0 0) 0x7fb4fc0c0ea0 con 0x7fb4fc1509b0 2023-07-27T14:34:44.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.947+0000 7fb4f3fff700 1 -- 172.21.15.115:0/2708604187 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e80033f0 con 0x7fb4fc1509b0 2023-07-27T14:34:44.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb4f3fff700 1 -- 172.21.15.115:0/2708604187 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231174962 0 0) 0x7fb4fc068e10 con 0x7fb4fc0c58d0 2023-07-27T14:34:44.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb4f3fff700 1 -- 172.21.15.115:0/2708604187 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4fc0c0ea0 con 0x7fb4fc0c58d0 2023-07-27T14:34:44.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb4f3fff700 1 -- 172.21.15.115:0/2708604187 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1674375173 0 0) 0x7fb4e80033f0 con 0x7fb4fc1509b0 2023-07-27T14:34:44.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb501b9c700 1 -- 172.21.15.115:0/2708604187 >> v1:172.21.15.159:6789/0 conn(0x7fb4fc0c58d0 legacy=0x7fb4fc0c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb501b9c700 1 -- 172.21.15.115:0/2708604187 >> v1:172.21.15.115:6789/0 conn(0x7fb4fc1509b0 legacy=0x7fb4fc154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb501b9c700 1 -- 172.21.15.115:0/2708604187 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc155190 con 0x7fb4fc0c3810 2023-07-27T14:34:44.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb501b9c700 1 --2- 172.21.15.115:0/2708604187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c3810 0x7fb4fc150d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb4f4009e90 tx=0x7fb4f4009780).ready entity=mon.2 client_cookie=c566b2009cc9109e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:44.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb4f3fff700 1 -- 172.21.15.115:0/2708604187 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400e070 con 0x7fb4fc0c3810 2023-07-27T14:34:44.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb4f3fff700 1 -- 172.21.15.115:0/2708604187 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400b7a0 con 0x7fb4fc0c3810 2023-07-27T14:34:44.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.948+0000 7fb4f3fff700 1 -- 172.21.15.115:0/2708604187 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8001470 con 0x7fb4fc0c3810 2023-07-27T14:34:44.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.949+0000 7fb5035ff700 1 -- 172.21.15.115:0/2708604187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c3810 msgr2=0x7fb4fc150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.949+0000 7fb5035ff700 1 --2- 172.21.15.115:0/2708604187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c3810 0x7fb4fc150d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb4f4009e90 tx=0x7fb4f4009780).stop 2023-07-27T14:34:44.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.949+0000 7fb5035ff700 1 -- 172.21.15.115:0/2708604187 shutdown_connections 2023-07-27T14:34:44.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.949+0000 7fb5035ff700 1 --2- 172.21.15.115:0/2708604187 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c3810 0x7fb4fc150d90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.949+0000 7fb5035ff700 1 -- 172.21.15.115:0/2708604187 >> 172.21.15.115:0/2708604187 conn(0x7fb4fc062320 msgr2=0x7fb4fc062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:44.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.949+0000 7fb5035ff700 1 -- 172.21.15.115:0/2708604187 shutdown_connections 2023-07-27T14:34:44.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.949+0000 7fb5035ff700 1 -- 172.21.15.115:0/2708604187 wait complete. 2023-07-27T14:34:44.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.951+0000 7fb5035ff700 1 Processor -- start 2023-07-27T14:34:44.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.951+0000 7fb5035ff700 1 -- start start 2023-07-27T14:34:44.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.952+0000 7fb5035ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4fc0c3810 0x7fb4fc167de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.952+0000 7fb5035ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c58d0 0x7fb4fc0bc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb5035ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4fc1509b0 0x7fb4fc14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:44.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb5035ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0bdc90 con 0x7fb4fc1509b0 2023-07-27T14:34:44.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb5035ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0bd940 con 0x7fb4fc0c3810 2023-07-27T14:34:44.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb5035ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc168610 con 0x7fb4fc0c58d0 2023-07-27T14:34:44.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb50139b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4fc0c3810 0x7fb4fc167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb501b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4fc1509b0 0x7fb4fc14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:44.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb50139b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4fc0c3810 0x7fb4fc167de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:39546/0 (socket says 172.21.15.115:39546) 2023-07-27T14:34:44.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb501b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4fc1509b0 0x7fb4fc14d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33172/0 (socket says 172.21.15.115:33172) 2023-07-27T14:34:44.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.953+0000 7fb50139b700 1 -- 172.21.15.115:0/1800614620 learned_addr learned my addr 172.21.15.115:0/1800614620 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:44.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb50139b700 1 -- 172.21.15.115:0/1800614620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c58d0 msgr2=0x7fb4fc0bc990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-27T14:34:44.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb50139b700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c58d0 0x7fb4fc0bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:34:44.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb50139b700 1 -- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4fc1509b0 msgr2=0x7fb4fc14d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:44.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb50139b700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4fc1509b0 0x7fb4fc14d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:44.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb50139b700 1 -- 172.21.15.115:0/1800614620 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f4009a20 con 0x7fb4fc0c3810 2023-07-27T14:34:44.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb501b9c700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4fc1509b0 0x7fb4fc14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:34:44.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb50139b700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4fc0c3810 0x7fb4fc167de0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fb4f800c840 tx=0x7fb4f8001a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:44.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb4f17fa700 1 -- 172.21.15.115:0/1800614620 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8007170 con 0x7fb4fc0c3810 2023-07-27T14:34:44.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb4f17fa700 1 -- 172.21.15.115:0/1800614620 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80072d0 con 0x7fb4fc0c3810 2023-07-27T14:34:44.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc1688f0 con 0x7fb4fc0c3810 2023-07-27T14:34:44.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.954+0000 7fb4f17fa700 1 -- 172.21.15.115:0/1800614620 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80048c0 con 0x7fb4fc0c3810 2023-07-27T14:34:44.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.955+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc1682d0 con 0x7fb4fc0c3810 2023-07-27T14:34:45.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.957+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc06b8e0 con 0x7fb4fc0c3810 2023-07-27T14:34:45.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.958+0000 7fb4f17fa700 1 -- 172.21.15.115:0/1800614620 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fb4f8004cb0 con 0x7fb4fc0c3810 2023-07-27T14:34:45.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.959+0000 7fb4f17fa700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4e005f770 0x7fb4e0061c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.959+0000 7fb4f17fa700 1 -- 172.21.15.115:0/1800614620 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fb4f807a5b0 con 0x7fb4fc0c3810 2023-07-27T14:34:45.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.959+0000 7fb500b9a700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4e005f770 0x7fb4e0061c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.960+0000 7fb500b9a700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4e005f770 0x7fb4e0061c30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fb4fc06a0d0 tx=0x7fb4ec007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:45.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:44.963+0000 7fb4f17fa700 1 -- 172.21.15.115:0/1800614620 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4f804b280 con 0x7fb4fc0c3810 2023-07-27T14:34:45.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.132+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4fc155470 con 0x7fb4fc0c3810 2023-07-27T14:34:45.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.133+0000 7fb4f17fa700 1 -- 172.21.15.115:0/1800614620 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v129) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4f804e8a0 con 0x7fb4fc0c3810 2023-07-27T14:34:45.176 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:34:45.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4e005f770 msgr2=0x7fb4e0061c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4e005f770 0x7fb4e0061c30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fb4fc06a0d0 tx=0x7fb4ec007850).stop 2023-07-27T14:34:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4fc0c3810 msgr2=0x7fb4fc167de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4fc0c3810 0x7fb4fc167de0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fb4f800c840 tx=0x7fb4f8001a20).stop 2023-07-27T14:34:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 shutdown_connections 2023-07-27T14:34:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb4e005f770 0x7fb4e0061c30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4fc1509b0 0x7fb4fc14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4fc0c3810 0x7fb4fc167de0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 --2- 172.21.15.115:0/1800614620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4fc0c58d0 0x7fb4fc0bc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:34:45.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.135+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 >> 172.21.15.115:0/1800614620 conn(0x7fb4fc062320 msgr2=0x7fb4fc0ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:45.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.136+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 shutdown_connections 2023-07-27T14:34:45.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.136+0000 7fb5035ff700 1 -- 172.21.15.115:0/1800614620 wait complete. 2023-07-27T14:34:45.196 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:34:45.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.344+0000 7f0125bff700 1 Processor -- start 2023-07-27T14:34:45.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.344+0000 7f0125bff700 1 -- start start 2023-07-27T14:34:45.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.345+0000 7f0125bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0120063260 0x7f0120154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.345+0000 7f0125bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f012014b1e0 0x7f01200a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.345+0000 7f0125bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01201553f0 con 0x7f012014ae00 2023-07-27T14:34:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.345+0000 7f0125bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0120157a50 con 0x7f0120063260 2023-07-27T14:34:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.345+0000 7f0125bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0120157d10 con 0x7f012014b1e0 2023-07-27T14:34:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0120063260 0x7f0120154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f012014ae00 0x7f0120062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41450/0 (socket says 172.21.15.115:41450) 2023-07-27T14:34:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011f7fe700 1 -- 172.21.15.115:0/3289142543 learned_addr learned my addr 172.21.15.115:0/3289142543 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011ffff700 1 --2- 172.21.15.115:0/3289142543 >> v2:172.21.15.159:3300/0 conn(0x7f012014b1e0 0x7f01200a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011e7fc700 1 -- 172.21.15.115:0/3289142543 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823915011 0 0) 0x7f01201553f0 con 0x7f012014ae00 2023-07-27T14:34:45.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011effd700 1 -- 172.21.15.115:0/3289142543 >> v2:172.21.15.159:3300/0 conn(0x7f012014b1e0 msgr2=0x7f01200a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:45.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011effd700 1 --2- 172.21.15.115:0/3289142543 >> v2:172.21.15.159:3300/0 conn(0x7f012014b1e0 0x7f01200a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011effd700 1 -- 172.21.15.115:0/3289142543 >> v1:172.21.15.115:6789/0 conn(0x7f012014ae00 legacy=0x7f0120062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011effd700 1 -- 172.21.15.115:0/3289142543 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120157ff0 con 0x7f0120063260 2023-07-27T14:34:45.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.346+0000 7f011effd700 1 --2- 172.21.15.115:0/3289142543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0120063260 0x7f0120154f00 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f0120083430 tx=0x7f0114009060).ready entity=mon.0 client_cookie=5b71f5b73faf51f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:45.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f011e7fc700 1 -- 172.21.15.115:0/3289142543 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011400f510 con 0x7f0120063260 2023-07-27T14:34:45.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f011e7fc700 1 -- 172.21.15.115:0/3289142543 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011400f670 con 0x7f0120063260 2023-07-27T14:34:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f011e7fc700 1 -- 172.21.15.115:0/3289142543 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011400f9f0 con 0x7f0120063260 2023-07-27T14:34:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f0125bff700 1 -- 172.21.15.115:0/3289142543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0120063260 msgr2=0x7f0120154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f0125bff700 1 --2- 172.21.15.115:0/3289142543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0120063260 0x7f0120154f00 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f0120083430 tx=0x7f0114009060).stop 2023-07-27T14:34:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f0125bff700 1 -- 172.21.15.115:0/3289142543 shutdown_connections 2023-07-27T14:34:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f0125bff700 1 --2- 172.21.15.115:0/3289142543 >> v2:172.21.15.159:3300/0 conn(0x7f012014b1e0 0x7f01200a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f0125bff700 1 --2- 172.21.15.115:0/3289142543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0120063260 0x7f0120154f00 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f0125bff700 1 -- 172.21.15.115:0/3289142543 >> 172.21.15.115:0/3289142543 conn(0x7f012005e940 msgr2=0x7f01200cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:45.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f0125bff700 1 -- 172.21.15.115:0/3289142543 shutdown_connections 2023-07-27T14:34:45.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.347+0000 7f0125bff700 1 -- 172.21.15.115:0/3289142543 wait complete. 2023-07-27T14:34:45.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.349+0000 7f0125bff700 1 Processor -- start 2023-07-27T14:34:45.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.349+0000 7f0125bff700 1 -- start start 2023-07-27T14:34:45.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f0125bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0120063260 0x7f012013a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f0125bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f012014ae00 0x7f01201671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f0125bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f012014b1e0 0x7f01201676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f0125bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200c4450 con 0x7f012014b1e0 2023-07-27T14:34:45.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f0125bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200ae640 con 0x7f0120063260 2023-07-27T14:34:45.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f0125bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0120167c80 con 0x7f012014ae00 2023-07-27T14:34:45.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f012014b1e0 0x7f01201676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f012014b1e0 0x7f01201676b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33194/0 (socket says 172.21.15.115:33194) 2023-07-27T14:34:45.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011ffff700 1 -- 172.21.15.115:0/1368478355 learned_addr learned my addr 172.21.15.115:0/1368478355 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:45.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011f7fe700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0120063260 0x7f012013a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011effd700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f012014ae00 0x7f01201671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011ffff700 1 -- 172.21.15.115:0/1368478355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f012014ae00 msgr2=0x7f01201671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011ffff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f012014ae00 0x7f01201671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011ffff700 1 -- 172.21.15.115:0/1368478355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0120063260 msgr2=0x7f012013a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.351+0000 7f011ffff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0120063260 0x7f012013a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.352+0000 7f011ffff700 1 -- 172.21.15.115:0/1368478355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140092a0 con 0x7f012014b1e0 2023-07-27T14:34:45.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.352+0000 7f011ffff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f012014b1e0 0x7f01201676b0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f0118009d70 tx=0x7f011800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:45.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.352+0000 7f01077fe700 1 -- 172.21.15.115:0/1368478355 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011800caa0 con 0x7f012014b1e0 2023-07-27T14:34:45.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.352+0000 7f01077fe700 1 -- 172.21.15.115:0/1368478355 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011800f040 con 0x7f012014b1e0 2023-07-27T14:34:45.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.352+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0120167f60 con 0x7f012014b1e0 2023-07-27T14:34:45.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.352+0000 7f01077fe700 1 -- 172.21.15.115:0/1368478355 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011800ce10 con 0x7f012014b1e0 2023-07-27T14:34:45.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.352+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012013aa90 con 0x7f012014b1e0 2023-07-27T14:34:45.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.353+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01200c45c0 con 0x7f012014b1e0 2023-07-27T14:34:45.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.354+0000 7f01077fe700 1 -- 172.21.15.115:0/1368478355 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f0118013610 con 0x7f012014b1e0 2023-07-27T14:34:45.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.355+0000 7f01077fe700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f010c05f720 0x7f010c061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.355+0000 7f01077fe700 1 -- 172.21.15.115:0/1368478355 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f011807afe0 con 0x7f012014b1e0 2023-07-27T14:34:45.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.355+0000 7f011f7fe700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f010c05f720 0x7f010c061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.355+0000 7f011f7fe700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f010c05f720 0x7f010c061be0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f01100011e0 tx=0x7f0110007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:45.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.359+0000 7f01077fe700 1 -- 172.21.15.115:0/1368478355 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f01180a98f0 con 0x7f012014b1e0 2023-07-27T14:34:45.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.527+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f012006c470 con 0x7f012014b1e0 2023-07-27T14:34:45.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.527+0000 7f01077fe700 1 -- 172.21.15.115:0/1368478355 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v129) v1 ==== 100+0+11 (secure 0 0 0) 0x7f011804be60 con 0x7f012014b1e0 2023-07-27T14:34:45.571 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:34:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f010c05f720 msgr2=0x7f010c061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f010c05f720 0x7f010c061be0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f01100011e0 tx=0x7f0110007bb0).stop 2023-07-27T14:34:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f012014b1e0 msgr2=0x7f01201676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f012014b1e0 0x7f01201676b0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f0118009d70 tx=0x7f011800b040).stop 2023-07-27T14:34:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 shutdown_connections 2023-07-27T14:34:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f010c05f720 0x7f010c061be0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f012014b1e0 0x7f01201676b0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0120063260 0x7f012013a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.529+0000 7f0125bff700 1 --2- 172.21.15.115:0/1368478355 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f012014ae00 0x7f01201671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.530+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 >> 172.21.15.115:0/1368478355 conn(0x7f012005e940 msgr2=0x7f01201495d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:45.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.530+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 shutdown_connections 2023-07-27T14:34:45.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.530+0000 7f0125bff700 1 -- 172.21.15.115:0/1368478355 wait complete. 2023-07-27T14:34:45.591 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:34:45.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.737+0000 7fb32cfff700 1 Processor -- start 2023-07-27T14:34:45.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.737+0000 7fb32cfff700 1 -- start start 2023-07-27T14:34:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.738+0000 7fb32cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.738+0000 7fb32cfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb3280aa050 0x7fb3280640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb32cfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3280aaa40 0x7fb3280645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb32cfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb328064ad0 con 0x7fb3280aaa40 2023-07-27T14:34:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb32cfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3280aa4d0 con 0x7fb3280aa050 2023-07-27T14:34:45.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb32cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280c05c0 con 0x7fb328153ec0 2023-07-27T14:34:45.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3280aaa40 0x7fb3280645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3280aaa40 0x7fb3280645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33198/0 (socket says 172.21.15.115:33198) 2023-07-27T14:34:45.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 -- 172.21.15.115:0/2988728333 learned_addr learned my addr 172.21.15.115:0/2988728333 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:45.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb32659c700 1 --2- 172.21.15.115:0/2988728333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 -- 172.21.15.115:0/2988728333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 msgr2=0x7fb3280a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb325d9b700 1 --2- 172.21.15.115:0/2988728333 >> v2:172.21.15.159:3300/0 conn(0x7fb3280aa050 0x7fb3280640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 --2- 172.21.15.115:0/2988728333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 -- 172.21.15.115:0/2988728333 >> v2:172.21.15.159:3300/0 conn(0x7fb3280aa050 msgr2=0x7fb3280640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 --2- 172.21.15.115:0/2988728333 >> v2:172.21.15.159:3300/0 conn(0x7fb3280aa050 0x7fb3280640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 -- 172.21.15.115:0/2988728333 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280bfc90 con 0x7fb3280aaa40 2023-07-27T14:34:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb32659c700 1 --2- 172.21.15.115:0/2988728333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:45.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb325d9b700 1 --2- 172.21.15.115:0/2988728333 >> v2:172.21.15.159:3300/0 conn(0x7fb3280aa050 0x7fb3280640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.739+0000 7fb326d9d700 1 --2- 172.21.15.115:0/2988728333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280645e0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fb32805f080 tx=0x7fb320009840).ready entity=mon.0 client_cookie=1e0cb1ff2ec192d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32559a700 1 -- 172.21.15.115:0/2988728333 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000e070 con 0x7fb3280aaa40 2023-07-27T14:34:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32559a700 1 -- 172.21.15.115:0/2988728333 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32000ba50 con 0x7fb3280aaa40 2023-07-27T14:34:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32559a700 1 -- 172.21.15.115:0/2988728333 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000bdd0 con 0x7fb3280aaa40 2023-07-27T14:34:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 -- 172.21.15.115:0/2988728333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 msgr2=0x7fb3280645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 --2- 172.21.15.115:0/2988728333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280645e0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fb32805f080 tx=0x7fb320009840).stop 2023-07-27T14:34:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 -- 172.21.15.115:0/2988728333 shutdown_connections 2023-07-27T14:34:45.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 --2- 172.21.15.115:0/2988728333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280645e0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 --2- 172.21.15.115:0/2988728333 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 --2- 172.21.15.115:0/2988728333 >> v2:172.21.15.159:3300/0 conn(0x7fb3280aa050 0x7fb3280640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 -- 172.21.15.115:0/2988728333 >> 172.21.15.115:0/2988728333 conn(0x7fb3280cb610 msgr2=0x7fb3280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 -- 172.21.15.115:0/2988728333 shutdown_connections 2023-07-27T14:34:45.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.740+0000 7fb32cfff700 1 -- 172.21.15.115:0/2988728333 wait complete. 2023-07-27T14:34:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.742+0000 7fb32cfff700 1 Processor -- start 2023-07-27T14:34:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.743+0000 7fb32cfff700 1 -- start start 2023-07-27T14:34:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb32cfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3280aa050 0x7fb3281590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb32cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb32cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb32cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb328159990 con 0x7fb3280aaa40 2023-07-27T14:34:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb32cfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb328156e80 con 0x7fb3280aa050 2023-07-27T14:34:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb32cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281596b0 con 0x7fb328153ec0 2023-07-27T14:34:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb325d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb325d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33208/0 (socket says 172.21.15.115:33208) 2023-07-27T14:34:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb325d9b700 1 -- 172.21.15.115:0/3743222035 learned_addr learned my addr 172.21.15.115:0/3743222035 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb326d9d700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb32659c700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3280aa050 0x7fb3281590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb325d9b700 1 -- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 msgr2=0x7fb3280aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb325d9b700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb325d9b700 1 -- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3280aa050 msgr2=0x7fb3281590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:45.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.744+0000 7fb325d9b700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3280aa050 0x7fb3281590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:45.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.745+0000 7fb325d9b700 1 -- 172.21.15.115:0/3743222035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb320009ae0 con 0x7fb3280aaa40 2023-07-27T14:34:45.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.745+0000 7fb32659c700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3280aa050 0x7fb3281590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:45.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.745+0000 7fb325d9b700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280afb50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fb31c00c880 tx=0x7fb31c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:45.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.745+0000 7fb3167fc700 1 -- 172.21.15.115:0/3743222035 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c010580 con 0x7fb3280aaa40 2023-07-27T14:34:45.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.745+0000 7fb3167fc700 1 -- 172.21.15.115:0/3743222035 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0106e0 con 0x7fb3280aaa40 2023-07-27T14:34:45.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.745+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb328156830 con 0x7fb3280aaa40 2023-07-27T14:34:45.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.745+0000 7fb3167fc700 1 -- 172.21.15.115:0/3743222035 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c010a60 con 0x7fb3280aaa40 2023-07-27T14:34:45.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.745+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3280b0040 con 0x7fb3280aaa40 2023-07-27T14:34:45.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.746+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32806c470 con 0x7fb3280aaa40 2023-07-27T14:34:45.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.747+0000 7fb3167fc700 1 -- 172.21.15.115:0/3743222035 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fb31c01b460 con 0x7fb3280aaa40 2023-07-27T14:34:45.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.748+0000 7fb3167fc700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f6f0 0x7fb308061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:45.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.748+0000 7fb3167fc700 1 -- 172.21.15.115:0/3743222035 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fb31c07aa00 con 0x7fb3280aaa40 2023-07-27T14:34:45.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.748+0000 7fb32659c700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f6f0 0x7fb308061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:45.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.748+0000 7fb32659c700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f6f0 0x7fb308061bb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fb318006fd0 tx=0x7fb318008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:45.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.751+0000 7fb3167fc700 1 -- 172.21.15.115:0/3743222035 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb31c04b540 con 0x7fb3280aaa40 2023-07-27T14:34:46.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.966+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3280c8230 con 0x7fb3280aaa40 2023-07-27T14:34:46.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.967+0000 7fb3167fc700 1 -- 172.21.15.115:0/3743222035 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fb31c04eb60 con 0x7fb3280aaa40 2023-07-27T14:34:46.010 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:46.011 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3206086489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3206086489},{"type":"v1","addr":"172.21.15.159:6835","nonce":3206086489}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1201288824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1201288824},{"type":"v1","addr":"172.21.15.159:6833","nonce":1201288824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7785,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3016973491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3016973491},{"type":"v1","addr":"172.21.15.115:6835","nonce":3016973491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:35.175025+0000","modified":"2023-07-27T14:33:38.185034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3532071498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3532071498},{"type":"v1","addr":"172.21.15.115:6837","nonce":3532071498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-07-27T14:34:46.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f6f0 msgr2=0x7fb308061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f6f0 0x7fb308061bb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fb318006fd0 tx=0x7fb318008040).stop 2023-07-27T14:34:46.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 msgr2=0x7fb3280afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280afb50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fb31c00c880 tx=0x7fb31c008040).stop 2023-07-27T14:34:46.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 shutdown_connections 2023-07-27T14:34:46.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb30805f6f0 0x7fb308061bb0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb328153ec0 0x7fb3280aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3280aa050 0x7fb3281590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 --2- 172.21.15.115:0/3743222035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3280aaa40 0x7fb3280afb50 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 >> 172.21.15.115:0/3743222035 conn(0x7fb3280cb610 msgr2=0x7fb3280ac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:46.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 shutdown_connections 2023-07-27T14:34:46.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:45.969+0000 7fb32cfff700 1 -- 172.21.15.115:0/3743222035 wait complete. 2023-07-27T14:34:46.014 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 69 2023-07-27T14:34:46.030 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:34:46.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.175+0000 7fda491ff700 1 Processor -- start 2023-07-27T14:34:46.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.175+0000 7fda491ff700 1 -- start start 2023-07-27T14:34:46.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.176+0000 7fda491ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fda44153ec0 0x7fda440a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.176+0000 7fda491ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda440aa050 0x7fda440640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.176+0000 7fda491ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda440aaa40 0x7fda440645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.176+0000 7fda491ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda44064ad0 con 0x7fda440aa050 2023-07-27T14:34:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.176+0000 7fda491ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda440aa4d0 con 0x7fda44153ec0 2023-07-27T14:34:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.176+0000 7fda491ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda440c05c0 con 0x7fda440aaa40 2023-07-27T14:34:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda440aa050 0x7fda440640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda440aa050 0x7fda440640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33214/0 (socket says 172.21.15.115:33214) 2023-07-27T14:34:46.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 -- 172.21.15.115:0/1338488052 learned_addr learned my addr 172.21.15.115:0/1338488052 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda42d9d700 1 --2- 172.21.15.115:0/1338488052 >> v2:172.21.15.159:3300/0 conn(0x7fda44153ec0 0x7fda440a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4359e700 1 --2- 172.21.15.115:0/1338488052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda440aaa40 0x7fda440645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 -- 172.21.15.115:0/1338488052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda440aaa40 msgr2=0x7fda440645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:46.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 --2- 172.21.15.115:0/1338488052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda440aaa40 0x7fda440645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 -- 172.21.15.115:0/1338488052 >> v2:172.21.15.159:3300/0 conn(0x7fda44153ec0 msgr2=0x7fda440a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 --2- 172.21.15.115:0/1338488052 >> v2:172.21.15.159:3300/0 conn(0x7fda44153ec0 0x7fda440a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 -- 172.21.15.115:0/1338488052 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda440bfc90 con 0x7fda440aa050 2023-07-27T14:34:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda42d9d700 1 --2- 172.21.15.115:0/1338488052 >> v2:172.21.15.159:3300/0 conn(0x7fda44153ec0 0x7fda440a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.177+0000 7fda4259c700 1 --2- 172.21.15.115:0/1338488052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda440640f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fda44083e30 tx=0x7fda380090f0).ready entity=mon.0 client_cookie=c06d2c0cfd1c76fb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda41d9b700 1 -- 172.21.15.115:0/1338488052 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800b600 con 0x7fda440aa050 2023-07-27T14:34:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda41d9b700 1 -- 172.21.15.115:0/1338488052 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3800b760 con 0x7fda440aa050 2023-07-27T14:34:46.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda41d9b700 1 -- 172.21.15.115:0/1338488052 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800bae0 con 0x7fda440aa050 2023-07-27T14:34:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 -- 172.21.15.115:0/1338488052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 msgr2=0x7fda440640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 --2- 172.21.15.115:0/1338488052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda440640f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fda44083e30 tx=0x7fda380090f0).stop 2023-07-27T14:34:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 -- 172.21.15.115:0/1338488052 shutdown_connections 2023-07-27T14:34:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 --2- 172.21.15.115:0/1338488052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda440aaa40 0x7fda440645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 --2- 172.21.15.115:0/1338488052 >> v2:172.21.15.159:3300/0 conn(0x7fda44153ec0 0x7fda440a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 --2- 172.21.15.115:0/1338488052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda440640f0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 -- 172.21.15.115:0/1338488052 >> 172.21.15.115:0/1338488052 conn(0x7fda440cb610 msgr2=0x7fda440c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:46.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 -- 172.21.15.115:0/1338488052 shutdown_connections 2023-07-27T14:34:46.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.178+0000 7fda491ff700 1 -- 172.21.15.115:0/1338488052 wait complete. 2023-07-27T14:34:46.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.180+0000 7fda491ff700 1 Processor -- start 2023-07-27T14:34:46.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.180+0000 7fda491ff700 1 -- start start 2023-07-27T14:34:46.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda491ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda44152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda491ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda440aaa40 0x7fda440c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda491ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda44153ec0 0x7fda440c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda491ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda440c1430 con 0x7fda440aa050 2023-07-27T14:34:46.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda491ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4414f1d0 con 0x7fda440aaa40 2023-07-27T14:34:46.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda491ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44151040 con 0x7fda44153ec0 2023-07-27T14:34:46.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda42d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda44152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda42d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda44152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33222/0 (socket says 172.21.15.115:33222) 2023-07-27T14:34:46.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda42d9d700 1 -- 172.21.15.115:0/2688714935 learned_addr learned my addr 172.21.15.115:0/2688714935 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:46.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda4259c700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda440aaa40 0x7fda440c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.181+0000 7fda4359e700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda44153ec0 0x7fda440c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda42d9d700 1 -- 172.21.15.115:0/2688714935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda44153ec0 msgr2=0x7fda440c0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda42d9d700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda44153ec0 0x7fda440c0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda42d9d700 1 -- 172.21.15.115:0/2688714935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda440aaa40 msgr2=0x7fda440c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda42d9d700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda440aaa40 0x7fda440c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda42d9d700 1 -- 172.21.15.115:0/2688714935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda38009370 con 0x7fda440aa050 2023-07-27T14:34:46.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda42d9d700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda44152f90 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fda3400d8c0 tx=0x7fda34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:46.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda2affd700 1 -- 172.21.15.115:0/2688714935 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34011590 con 0x7fda440aa050 2023-07-27T14:34:46.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda2affd700 1 -- 172.21.15.115:0/2688714935 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda340116f0 con 0x7fda440aa050 2023-07-27T14:34:46.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda44150430 con 0x7fda440aa050 2023-07-27T14:34:46.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda2affd700 1 -- 172.21.15.115:0/2688714935 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34011a70 con 0x7fda440aa050 2023-07-27T14:34:46.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.182+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda44150cd0 con 0x7fda440aa050 2023-07-27T14:34:46.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.183+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda44150820 con 0x7fda440aa050 2023-07-27T14:34:46.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.184+0000 7fda2affd700 1 -- 172.21.15.115:0/2688714935 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fda34012420 con 0x7fda440aa050 2023-07-27T14:34:46.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.185+0000 7fda2affd700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda3005f720 0x7fda30061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.185+0000 7fda2affd700 1 -- 172.21.15.115:0/2688714935 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fda3407a630 con 0x7fda440aa050 2023-07-27T14:34:46.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.185+0000 7fda4259c700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda3005f720 0x7fda30061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.186+0000 7fda4259c700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda3005f720 0x7fda30061be0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fda38009130 tx=0x7fda38017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:46.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.189+0000 7fda2affd700 1 -- 172.21.15.115:0/2688714935 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda3404b060 con 0x7fda440aa050 2023-07-27T14:34:46.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.359+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda4406c470 con 0x7fda440aa050 2023-07-27T14:34:46.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.360+0000 7fda2affd700 1 -- 172.21.15.115:0/2688714935 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+17294 (secure 0 0 0) 0x7fda3404e680 con 0x7fda440aa050 2023-07-27T14:34:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:46.403 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":129,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:34:40.790529+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:33.605422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:34.146639+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":129,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.c","mappings":[{"from":0,"to":5}]},{"pgid":"17.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:34:46.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda3005f720 msgr2=0x7fda30061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda3005f720 0x7fda30061be0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fda38009130 tx=0x7fda38017000).stop 2023-07-27T14:34:46.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 msgr2=0x7fda44152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda44152f90 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fda3400d8c0 tx=0x7fda34008040).stop 2023-07-27T14:34:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 shutdown_connections 2023-07-27T14:34:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda3005f720 0x7fda30061be0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda44153ec0 0x7fda440c0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda440aa050 0x7fda44152f90 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 --2- 172.21.15.115:0/2688714935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda440aaa40 0x7fda440c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 >> 172.21.15.115:0/2688714935 conn(0x7fda440cb610 msgr2=0x7fda440abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:46.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 shutdown_connections 2023-07-27T14:34:46.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.362+0000 7fda491ff700 1 -- 172.21.15.115:0/2688714935 wait complete. 2023-07-27T14:34:46.422 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:34:46.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:34:46.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.567+0000 7fadc09ff700 1 Processor -- start 2023-07-27T14:34:46.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.567+0000 7fadc09ff700 1 -- start start 2023-07-27T14:34:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.569+0000 7fadc09ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fadbc153ec0 0x7fadbc0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.569+0000 7fadc09ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadbc0aa050 0x7fadbc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.569+0000 7fadc09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 0x7fadbc0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.569+0000 7fadc09ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc064ad0 con 0x7fadbc0aa050 2023-07-27T14:34:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.569+0000 7fadc09ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc0aa4d0 con 0x7fadbc153ec0 2023-07-27T14:34:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.569+0000 7fadc09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0c05c0 con 0x7fadbc0aaa40 2023-07-27T14:34:46.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.569+0000 7fadb9d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadbc0aa050 0x7fadbc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb9d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadbc0aa050 0x7fadbc0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33236/0 (socket says 172.21.15.115:33236) 2023-07-27T14:34:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb9d9b700 1 -- 172.21.15.115:0/4053681089 learned_addr learned my addr 172.21.15.115:0/4053681089 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadba59c700 1 --2- 172.21.15.115:0/4053681089 >> v2:172.21.15.159:3300/0 conn(0x7fadbc153ec0 0x7fadbc0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadbad9d700 1 --2- 172.21.15.115:0/4053681089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 0x7fadbc0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb9d9b700 1 -- 172.21.15.115:0/4053681089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 msgr2=0x7fadbc0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb9d9b700 1 --2- 172.21.15.115:0/4053681089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 0x7fadbc0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb9d9b700 1 -- 172.21.15.115:0/4053681089 >> v2:172.21.15.159:3300/0 conn(0x7fadbc153ec0 msgr2=0x7fadbc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb9d9b700 1 --2- 172.21.15.115:0/4053681089 >> v2:172.21.15.159:3300/0 conn(0x7fadbc153ec0 0x7fadbc0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb9d9b700 1 -- 172.21.15.115:0/4053681089 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0bfc90 con 0x7fadbc0aa050 2023-07-27T14:34:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb9d9b700 1 --2- 172.21.15.115:0/4053681089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc0aa050 0x7fadbc0640f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fadbc083e30 tx=0x7fadb00090f0).ready entity=mon.0 client_cookie=653fbd90e26f6d5e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb959a700 1 -- 172.21.15.115:0/4053681089 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000f510 con 0x7fadbc0aa050 2023-07-27T14:34:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb959a700 1 -- 172.21.15.115:0/4053681089 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb000f670 con 0x7fadbc0aa050 2023-07-27T14:34:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.570+0000 7fadb959a700 1 -- 172.21.15.115:0/4053681089 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000fa10 con 0x7fadbc0aa050 2023-07-27T14:34:46.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 -- 172.21.15.115:0/4053681089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc0aa050 msgr2=0x7fadbc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 --2- 172.21.15.115:0/4053681089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc0aa050 0x7fadbc0640f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fadbc083e30 tx=0x7fadb00090f0).stop 2023-07-27T14:34:46.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 -- 172.21.15.115:0/4053681089 shutdown_connections 2023-07-27T14:34:46.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 --2- 172.21.15.115:0/4053681089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 0x7fadbc0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 --2- 172.21.15.115:0/4053681089 >> v2:172.21.15.159:3300/0 conn(0x7fadbc153ec0 0x7fadbc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 --2- 172.21.15.115:0/4053681089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc0aa050 0x7fadbc0640f0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 -- 172.21.15.115:0/4053681089 >> 172.21.15.115:0/4053681089 conn(0x7fadbc0cb610 msgr2=0x7fadbc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:46.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 -- 172.21.15.115:0/4053681089 shutdown_connections 2023-07-27T14:34:46.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.571+0000 7fadc09ff700 1 -- 172.21.15.115:0/4053681089 wait complete. 2023-07-27T14:34:46.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.572+0000 7fadc09ff700 1 Processor -- start 2023-07-27T14:34:46.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.573+0000 7fadc09ff700 1 -- start start 2023-07-27T14:34:46.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.573+0000 7fadc09ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadbc0aa050 0x7fadbc165270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadc09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 0x7fadbc1382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadc09ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc153ec0 0x7fadbc167670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadc09ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc152e40 con 0x7fadbc153ec0 2023-07-27T14:34:46.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadc09ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc153120 con 0x7fadbc0aa050 2023-07-27T14:34:46.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadc09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0c2e50 con 0x7fadbc0aaa40 2023-07-27T14:34:46.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc153ec0 0x7fadbc167670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc153ec0 0x7fadbc167670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33238/0 (socket says 172.21.15.115:33238) 2023-07-27T14:34:46.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 -- 172.21.15.115:0/2138202933 learned_addr learned my addr 172.21.15.115:0/2138202933 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:46.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadb9d9b700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 0x7fadbc1382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadba59c700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadbc0aa050 0x7fadbc165270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 -- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 msgr2=0x7fadbc1382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 0x7fadbc1382b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 -- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadbc0aa050 msgr2=0x7fadbc165270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadbc0aa050 0x7fadbc165270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 -- 172.21.15.115:0/2138202933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0009370 con 0x7fadbc153ec0 2023-07-27T14:34:46.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadba59c700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadbc0aa050 0x7fadbc165270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:46.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.574+0000 7fadbad9d700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc153ec0 0x7fadbc167670 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fadb4009ec0 tx=0x7fadb400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:46.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.575+0000 7fadaa7fc700 1 -- 172.21.15.115:0/2138202933 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4009c50 con 0x7fadbc153ec0 2023-07-27T14:34:46.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.575+0000 7fadaa7fc700 1 -- 172.21.15.115:0/2138202933 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb400f040 con 0x7fadbc153ec0 2023-07-27T14:34:46.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.575+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc0c3130 con 0x7fadbc153ec0 2023-07-27T14:34:46.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.575+0000 7fadaa7fc700 1 -- 172.21.15.115:0/2138202933 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400ce70 con 0x7fadbc153ec0 2023-07-27T14:34:46.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.575+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc1387a0 con 0x7fadbc153ec0 2023-07-27T14:34:46.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.576+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc0c5550 con 0x7fadbc153ec0 2023-07-27T14:34:46.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.576+0000 7fadaa7fc700 1 -- 172.21.15.115:0/2138202933 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fadb4013610 con 0x7fadbc153ec0 2023-07-27T14:34:46.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.577+0000 7fadaa7fc700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad9c05f720 0x7fad9c061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:46.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.577+0000 7fadaa7fc700 1 -- 172.21.15.115:0/2138202933 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fadb407b1a0 con 0x7fadbc153ec0 2023-07-27T14:34:46.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.577+0000 7fadba59c700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad9c05f720 0x7fad9c061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:46.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.578+0000 7fadba59c700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad9c05f720 0x7fad9c061be0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fadac009b60 tx=0x7fadac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:46.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.581+0000 7fadaa7fc700 1 -- 172.21.15.115:0/2138202933 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fadb404bfa0 con 0x7fadbc153ec0 2023-07-27T14:34:46.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.797+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadbc0bff70 con 0x7fadbc153ec0 2023-07-27T14:34:46.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.798+0000 7fadaa7fc700 1 -- 172.21.15.115:0/2138202933 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fadb404f5c0 con 0x7fadbc153ec0 2023-07-27T14:34:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:46.842 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3206086489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3206086489},{"type":"v1","addr":"172.21.15.159:6835","nonce":3206086489}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1201288824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1201288824},{"type":"v1","addr":"172.21.15.159:6833","nonce":1201288824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7785,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3016973491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3016973491},{"type":"v1","addr":"172.21.15.115:6835","nonce":3016973491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:35.175025+0000","modified":"2023-07-27T14:33:38.185034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3532071498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3532071498},{"type":"v1","addr":"172.21.15.115:6837","nonce":3532071498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-07-27T14:34:46.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad9c05f720 msgr2=0x7fad9c061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad9c05f720 0x7fad9c061be0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fadac009b60 tx=0x7fadac008040).stop 2023-07-27T14:34:46.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc153ec0 msgr2=0x7fadbc167670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:46.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc153ec0 0x7fadbc167670 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fadb4009ec0 tx=0x7fadb400b040).stop 2023-07-27T14:34:46.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 shutdown_connections 2023-07-27T14:34:46.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad9c05f720 0x7fad9c061be0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadbc153ec0 0x7fadbc167670 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadbc0aa050 0x7fadbc165270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 --2- 172.21.15.115:0/2138202933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadbc0aaa40 0x7fadbc1382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:46.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 >> 172.21.15.115:0/2138202933 conn(0x7fadbc0cb610 msgr2=0x7fadbc0abc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:46.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.800+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 shutdown_connections 2023-07-27T14:34:46.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:46.801+0000 7fadc09ff700 1 -- 172.21.15.115:0/2138202933 wait complete. 2023-07-27T14:34:46.845 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 69 2023-07-27T14:34:46.860 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:34:47.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.009+0000 7efc44bff700 1 Processor -- start 2023-07-27T14:34:47.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.009+0000 7efc44bff700 1 -- start start 2023-07-27T14:34:47.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.010+0000 7efc44bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40151d70 0x7efc40155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.010+0000 7efc44bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efc40066b80 0x7efc40067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.010+0000 7efc44bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc40067080 con 0x7efc40065ff0 2023-07-27T14:34:47.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.010+0000 7efc44bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc40063a90 con 0x7efc40066b80 2023-07-27T14:34:47.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.010+0000 7efc44bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400634d0 con 0x7efc40151d70 2023-07-27T14:34:47.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.010+0000 7efc3dd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efc40065ff0 0x7efc40066470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41460/0 (socket says 172.21.15.115:41460) 2023-07-27T14:34:47.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.010+0000 7efc3dd9b700 1 -- 172.21.15.115:0/1701337055 learned_addr learned my addr 172.21.15.115:0/1701337055 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:47.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.010+0000 7efc3e59c700 1 --2- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40151d70 0x7efc40155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3ed9d700 1 --2- 172.21.15.115:0/1701337055 >> v2:172.21.15.159:3300/0 conn(0x7efc40066b80 0x7efc40067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3d59a700 1 -- 172.21.15.115:0/1701337055 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451617941 0 0) 0x7efc40067080 con 0x7efc40065ff0 2023-07-27T14:34:47.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3d59a700 1 -- 172.21.15.115:0/1701337055 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc280033f0 con 0x7efc40065ff0 2023-07-27T14:34:47.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3ed9d700 1 -- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40151d70 msgr2=0x7efc40155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:47.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3ed9d700 1 --2- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40151d70 0x7efc40155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3ed9d700 1 -- 172.21.15.115:0/1701337055 >> v1:172.21.15.115:6789/0 conn(0x7efc40065ff0 legacy=0x7efc40066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3d59a700 1 -- 172.21.15.115:0/1701337055 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1013716092 0 0) 0x7efc280033f0 con 0x7efc40065ff0 2023-07-27T14:34:47.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3ed9d700 1 -- 172.21.15.115:0/1701337055 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400637b0 con 0x7efc40066b80 2023-07-27T14:34:47.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3e59c700 1 --2- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40151d70 0x7efc40155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:34:47.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3ed9d700 1 --2- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40066b80 0x7efc40067560 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7efc38009e60 tx=0x7efc38009780).ready entity=mon.1 client_cookie=f33719387fd8ff72 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.011+0000 7efc3d59a700 1 -- 172.21.15.115:0/1701337055 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800e070 con 0x7efc40066b80 2023-07-27T14:34:47.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc3d59a700 1 -- 172.21.15.115:0/1701337055 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3800b7a0 con 0x7efc40066b80 2023-07-27T14:34:47.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc3d59a700 1 -- 172.21.15.115:0/1701337055 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34001470 con 0x7efc40066b80 2023-07-27T14:34:47.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc44bff700 1 -- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40066b80 msgr2=0x7efc40067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc44bff700 1 --2- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40066b80 0x7efc40067560 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7efc38009e60 tx=0x7efc38009780).stop 2023-07-27T14:34:47.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc44bff700 1 -- 172.21.15.115:0/1701337055 shutdown_connections 2023-07-27T14:34:47.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc44bff700 1 --2- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40066b80 0x7efc40067560 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc44bff700 1 --2- 172.21.15.115:0/1701337055 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40151d70 0x7efc40155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc44bff700 1 -- 172.21.15.115:0/1701337055 >> 172.21.15.115:0/1701337055 conn(0x7efc400c89a0 msgr2=0x7efc400c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:47.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc44bff700 1 -- 172.21.15.115:0/1701337055 shutdown_connections 2023-07-27T14:34:47.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.012+0000 7efc44bff700 1 -- 172.21.15.115:0/1701337055 wait complete. 2023-07-27T14:34:47.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.014+0000 7efc44bff700 1 Processor -- start 2023-07-27T14:34:47.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.014+0000 7efc44bff700 1 -- start start 2023-07-27T14:34:47.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc44bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40065ff0 0x7efc4014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc44bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40066b80 0x7efc400ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc44bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc40151d70 0x7efc400a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc44bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc400ad340 con 0x7efc40151d70 2023-07-27T14:34:47.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc44bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc400ac2a0 con 0x7efc40065ff0 2023-07-27T14:34:47.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc44bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400ac580 con 0x7efc40066b80 2023-07-27T14:34:47.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc40151d70 0x7efc400a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc40151d70 0x7efc400a60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33248/0 (socket says 172.21.15.115:33248) 2023-07-27T14:34:47.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3ed9d700 1 -- 172.21.15.115:0/2302085364 learned_addr learned my addr 172.21.15.115:0/2302085364 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:47.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3e59c700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40065ff0 0x7efc4014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3dd9b700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40066b80 0x7efc400ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3ed9d700 1 -- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40066b80 msgr2=0x7efc400ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3ed9d700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40066b80 0x7efc400ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3ed9d700 1 -- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40065ff0 msgr2=0x7efc4014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3ed9d700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40065ff0 0x7efc4014d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3ed9d700 1 -- 172.21.15.115:0/2302085364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc300092a0 con 0x7efc40151d70 2023-07-27T14:34:47.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3dd9b700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40066b80 0x7efc400ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:47.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.015+0000 7efc3e59c700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40065ff0 0x7efc4014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:47.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.016+0000 7efc3ed9d700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc40151d70 0x7efc400a60c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7efc40060790 tx=0x7efc38009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.016+0000 7efc2e7fc700 1 -- 172.21.15.115:0/2302085364 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800be50 con 0x7efc40151d70 2023-07-27T14:34:47.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.016+0000 7efc2e7fc700 1 -- 172.21.15.115:0/2302085364 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3801d600 con 0x7efc40151d70 2023-07-27T14:34:47.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.016+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc38009a20 con 0x7efc40151d70 2023-07-27T14:34:47.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.016+0000 7efc2e7fc700 1 -- 172.21.15.115:0/2302085364 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3801d9a0 con 0x7efc40151d70 2023-07-27T14:34:47.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.016+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc400acb40 con 0x7efc40151d70 2023-07-27T14:34:47.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.017+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4006c470 con 0x7efc40151d70 2023-07-27T14:34:47.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.018+0000 7efc2e7fc700 1 -- 172.21.15.115:0/2302085364 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7efc3802d070 con 0x7efc40151d70 2023-07-27T14:34:47.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.018+0000 7efc2e7fc700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efc2005f720 0x7efc20061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.019+0000 7efc2e7fc700 1 -- 172.21.15.115:0/2302085364 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6207+0+0 (secure 0 0 0) 0x7efc3807c590 con 0x7efc40151d70 2023-07-27T14:34:47.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.019+0000 7efc3e59c700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efc2005f720 0x7efc20061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.019+0000 7efc3e59c700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efc2005f720 0x7efc20061be0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7efc30009270 tx=0x7efc30008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.023+0000 7efc2e7fc700 1 -- 172.21.15.115:0/2302085364 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc3804d4c0 con 0x7efc40151d70 2023-07-27T14:34:47.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.242+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc40068720 con 0x7efc40151d70 2023-07-27T14:34:47.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.243+0000 7efc2e7fc700 1 -- 172.21.15.115:0/2302085364 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4503 (secure 0 0 0) 0x7efc3802b090 con 0x7efc40151d70 2023-07-27T14:34:47.286 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:47.286 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3206086489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3206086489},{"type":"v1","addr":"172.21.15.159:6835","nonce":3206086489}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1201288824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1201288824},{"type":"v1","addr":"172.21.15.159:6833","nonce":1201288824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7785,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3016973491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3016973491},{"type":"v1","addr":"172.21.15.115:6835","nonce":3016973491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:33:35.175025+0000","modified":"2023-07-27T14:33:38.185034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/3532071498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3532071498},{"type":"v1","addr":"172.21.15.115:6837","nonce":3532071498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-07-27T14:34:47.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efc2005f720 msgr2=0x7efc20061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efc2005f720 0x7efc20061be0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7efc30009270 tx=0x7efc30008040).stop 2023-07-27T14:34:47.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc40151d70 msgr2=0x7efc400a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc40151d70 0x7efc400a60c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7efc40060790 tx=0x7efc38009780).stop 2023-07-27T14:34:47.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 shutdown_connections 2023-07-27T14:34:47.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efc2005f720 0x7efc20061be0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc40151d70 0x7efc400a60c0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efc40065ff0 0x7efc4014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 --2- 172.21.15.115:0/2302085364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efc40066b80 0x7efc400ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 >> 172.21.15.115:0/2302085364 conn(0x7efc400c89a0 msgr2=0x7efc400c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:47.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 shutdown_connections 2023-07-27T14:34:47.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.245+0000 7efc44bff700 1 -- 172.21.15.115:0/2302085364 wait complete. 2023-07-27T14:34:47.290 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 69 2023-07-27T14:34:47.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:34:47.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.450+0000 7f1117fff700 1 Processor -- start 2023-07-27T14:34:47.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.450+0000 7f1117fff700 1 -- start start 2023-07-27T14:34:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.451+0000 7f1117fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f11100c3470 0x7f1110064b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.451+0000 7f1117fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f111014fbd0 0x7f1110152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.451+0000 7f1117fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11101532a0 con 0x7f11100c3850 2023-07-27T14:34:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.451+0000 7f1117fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1110064060 con 0x7f111014fbd0 2023-07-27T14:34:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.451+0000 7f1117fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1110064340 con 0x7f11100c3470 2023-07-27T14:34:47.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f111659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f111014fbd0 0x7f1110152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f111659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f111014fbd0 0x7f1110152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33260/0 (socket says 172.21.15.115:33260) 2023-07-27T14:34:47.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f111659c700 1 -- 172.21.15.115:0/3486160113 learned_addr learned my addr 172.21.15.115:0/3486160113 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:47.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f1115d9b700 1 --2- 172.21.15.115:0/3486160113 >> v2:172.21.15.159:3300/0 conn(0x7f11100c3470 0x7f1110064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f111659c700 1 -- 172.21.15.115:0/3486160113 >> v2:172.21.15.159:3300/0 conn(0x7f11100c3470 msgr2=0x7f1110064b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:47.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f111659c700 1 --2- 172.21.15.115:0/3486160113 >> v2:172.21.15.159:3300/0 conn(0x7f11100c3470 0x7f1110064b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f111659c700 1 -- 172.21.15.115:0/3486160113 >> v1:172.21.15.159:6789/0 conn(0x7f11100c3850 legacy=0x7f111014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f111659c700 1 -- 172.21.15.115:0/3486160113 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110064620 con 0x7f111014fbd0 2023-07-27T14:34:47.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.452+0000 7f111659c700 1 --2- 172.21.15.115:0/3486160113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f111014fbd0 0x7f1110152500 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f11100c67b0 tx=0x7f1108009840).ready entity=mon.0 client_cookie=bcf0ab2745297eea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1114d99700 1 -- 172.21.15.115:0/3486160113 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800e070 con 0x7f111014fbd0 2023-07-27T14:34:47.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1114d99700 1 -- 172.21.15.115:0/3486160113 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110800ba50 con 0x7f111014fbd0 2023-07-27T14:34:47.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1114d99700 1 -- 172.21.15.115:0/3486160113 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800bdd0 con 0x7f111014fbd0 2023-07-27T14:34:47.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1117fff700 1 -- 172.21.15.115:0/3486160113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f111014fbd0 msgr2=0x7f1110152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1117fff700 1 --2- 172.21.15.115:0/3486160113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f111014fbd0 0x7f1110152500 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f11100c67b0 tx=0x7f1108009840).stop 2023-07-27T14:34:47.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1117fff700 1 -- 172.21.15.115:0/3486160113 shutdown_connections 2023-07-27T14:34:47.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1117fff700 1 --2- 172.21.15.115:0/3486160113 >> v2:172.21.15.159:3300/0 conn(0x7f11100c3470 0x7f1110064b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1117fff700 1 --2- 172.21.15.115:0/3486160113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f111014fbd0 0x7f1110152500 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1117fff700 1 -- 172.21.15.115:0/3486160113 >> 172.21.15.115:0/3486160113 conn(0x7f1110062320 msgr2=0x7f1110062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:47.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1117fff700 1 -- 172.21.15.115:0/3486160113 shutdown_connections 2023-07-27T14:34:47.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.453+0000 7f1117fff700 1 -- 172.21.15.115:0/3486160113 wait complete. 2023-07-27T14:34:47.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.455+0000 7f1117fff700 1 Processor -- start 2023-07-27T14:34:47.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.455+0000 7f1117fff700 1 -- start start 2023-07-27T14:34:47.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f1117fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11100c3470 0x7f11100a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f1117fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11100c3850 0x7f1110162cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f1117fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f111014fbd0 0x7f111014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f1117fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11100a84a0 con 0x7f11100c3850 2023-07-27T14:34:47.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f1117fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11101631b0 con 0x7f111014fbd0 2023-07-27T14:34:47.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f1117fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11100abdd0 con 0x7f11100c3470 2023-07-27T14:34:47.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11100c3850 0x7f1110162cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11100c3850 0x7f1110162cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33270/0 (socket says 172.21.15.115:33270) 2023-07-27T14:34:47.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111559a700 1 -- 172.21.15.115:0/777380204 learned_addr learned my addr 172.21.15.115:0/777380204 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:47.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111659c700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f111014fbd0 0x7f111014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f1115d9b700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11100c3470 0x7f11100a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111559a700 1 -- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11100c3470 msgr2=0x7f11100a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111559a700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11100c3470 0x7f11100a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111559a700 1 -- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f111014fbd0 msgr2=0x7f111014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111559a700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f111014fbd0 0x7f111014f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.456+0000 7f111559a700 1 -- 172.21.15.115:0/777380204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1108009ae0 con 0x7f11100c3850 2023-07-27T14:34:47.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.457+0000 7f111659c700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f111014fbd0 0x7f111014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:47.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.457+0000 7f111559a700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11100c3850 0x7f1110162cc0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f110000c4c0 tx=0x7f1100007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.457+0000 7f1105ffb700 1 -- 172.21.15.115:0/777380204 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100007020 con 0x7f11100c3850 2023-07-27T14:34:47.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.457+0000 7f1105ffb700 1 -- 172.21.15.115:0/777380204 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100001e90 con 0x7f11100c3850 2023-07-27T14:34:47.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.457+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11100ac0b0 con 0x7f11100c3850 2023-07-27T14:34:47.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.457+0000 7f1105ffb700 1 -- 172.21.15.115:0/777380204 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000073b0 con 0x7f11100c3850 2023-07-27T14:34:47.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.457+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11100ac670 con 0x7f11100c3850 2023-07-27T14:34:47.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.458+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111006c470 con 0x7f11100c3850 2023-07-27T14:34:47.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.459+0000 7f1105ffb700 1 -- 172.21.15.115:0/777380204 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f1100010070 con 0x7f11100c3850 2023-07-27T14:34:47.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.459+0000 7f1105ffb700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10f405f720 0x7f10f4061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.460+0000 7f1105ffb700 1 -- 172.21.15.115:0/777380204 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f110007a390 con 0x7f11100c3850 2023-07-27T14:34:47.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.460+0000 7f1115d9b700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10f405f720 0x7f10f4061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.460+0000 7f1115d9b700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10f405f720 0x7f10f4061be0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f110c00bbc0 tx=0x7f110c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.463+0000 7f1105ffb700 1 -- 172.21.15.115:0/777380204 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f110004ae40 con 0x7f11100c3850 2023-07-27T14:34:47.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.638+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1110063880 con 0x7f11100c3850 2023-07-27T14:34:47.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.639+0000 7f1105ffb700 1 -- 172.21.15.115:0/777380204 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+17250 (secure 0 0 0) 0x7f110004e460 con 0x7f11100c3850 2023-07-27T14:34:47.683 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:47.683 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":130,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:34:46.636443+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:33:33.605422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-27T14:33:34.146639+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":129,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.c","mappings":[{"from":0,"to":5}]},{"pgid":"17.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":18,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:34:47.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.641+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10f405f720 msgr2=0x7f10f4061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.641+0000 7f1117fff700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10f405f720 0x7f10f4061be0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f110c00bbc0 tx=0x7f110c008040).stop 2023-07-27T14:34:47.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.641+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11100c3850 msgr2=0x7f1110162cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.641+0000 7f1117fff700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11100c3850 0x7f1110162cc0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f110000c4c0 tx=0x7f1100007e00).stop 2023-07-27T14:34:47.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.641+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 shutdown_connections 2023-07-27T14:34:47.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.641+0000 7f1117fff700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10f405f720 0x7f10f4061be0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.642+0000 7f1117fff700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f111014fbd0 0x7f111014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.642+0000 7f1117fff700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11100c3470 0x7f11100a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.642+0000 7f1117fff700 1 --2- 172.21.15.115:0/777380204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11100c3850 0x7f1110162cc0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.642+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 >> 172.21.15.115:0/777380204 conn(0x7f1110062320 msgr2=0x7f11101381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:47.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.642+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 shutdown_connections 2023-07-27T14:34:47.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.642+0000 7f1117fff700 1 -- 172.21.15.115:0/777380204 wait complete. 2023-07-27T14:34:47.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:34:47.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.848+0000 7f2577dff700 1 Processor -- start 2023-07-27T14:34:47.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.849+0000 7f2577dff700 1 -- start start 2023-07-27T14:34:47.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f2577dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2570151d70 0x7f2570155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f2577dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2570065ff0 0x7f2570066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f2577dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 0x7f2570157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f2577dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2570063a90 con 0x7f2570065ff0 2023-07-27T14:34:47.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f2577dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2570067080 con 0x7f2570151d70 2023-07-27T14:34:47.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f2577dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2570066df0 con 0x7f2570066960 2023-07-27T14:34:47.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f257539a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2570065ff0 0x7f2570066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f257539a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2570065ff0 0x7f2570066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33276/0 (socket says 172.21.15.115:33276) 2023-07-27T14:34:47.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f257539a700 1 -- 172.21.15.115:0/2891298723 learned_addr learned my addr 172.21.15.115:0/2891298723 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:47.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f257639c700 1 --2- 172.21.15.115:0/2891298723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 0x7f2570157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.850+0000 7f2575b9b700 1 --2- 172.21.15.115:0/2891298723 >> v2:172.21.15.159:3300/0 conn(0x7f2570151d70 0x7f2570155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f257539a700 1 -- 172.21.15.115:0/2891298723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 msgr2=0x7f2570157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:47.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f257539a700 1 --2- 172.21.15.115:0/2891298723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 0x7f2570157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f257539a700 1 -- 172.21.15.115:0/2891298723 >> v2:172.21.15.159:3300/0 conn(0x7f2570151d70 msgr2=0x7f2570155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:47.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f257539a700 1 --2- 172.21.15.115:0/2891298723 >> v2:172.21.15.159:3300/0 conn(0x7f2570151d70 0x7f2570155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f257539a700 1 -- 172.21.15.115:0/2891298723 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700634d0 con 0x7f2570065ff0 2023-07-27T14:34:47.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f257539a700 1 --2- 172.21.15.115:0/2891298723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f2570066470 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f25700c88b0 tx=0x7f25600090f0).ready entity=mon.0 client_cookie=deab4453017bade2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f2574b99700 1 -- 172.21.15.115:0/2891298723 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000f510 con 0x7f2570065ff0 2023-07-27T14:34:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f2574b99700 1 -- 172.21.15.115:0/2891298723 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000f670 con 0x7f2570065ff0 2023-07-27T14:34:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f2574b99700 1 -- 172.21.15.115:0/2891298723 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000f9f0 con 0x7f2570065ff0 2023-07-27T14:34:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f2577dff700 1 -- 172.21.15.115:0/2891298723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 msgr2=0x7f2570066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.851+0000 7f2577dff700 1 --2- 172.21.15.115:0/2891298723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f2570066470 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f25700c88b0 tx=0x7f25600090f0).stop 2023-07-27T14:34:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.852+0000 7f2577dff700 1 -- 172.21.15.115:0/2891298723 shutdown_connections 2023-07-27T14:34:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.852+0000 7f2577dff700 1 --2- 172.21.15.115:0/2891298723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 0x7f2570157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.852+0000 7f2577dff700 1 --2- 172.21.15.115:0/2891298723 >> v2:172.21.15.159:3300/0 conn(0x7f2570151d70 0x7f2570155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.852+0000 7f2577dff700 1 --2- 172.21.15.115:0/2891298723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f2570066470 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.852+0000 7f2577dff700 1 -- 172.21.15.115:0/2891298723 >> 172.21.15.115:0/2891298723 conn(0x7f25700c89a0 msgr2=0x7f25700c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.852+0000 7f2577dff700 1 -- 172.21.15.115:0/2891298723 shutdown_connections 2023-07-27T14:34:47.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.852+0000 7f2577dff700 1 -- 172.21.15.115:0/2891298723 wait complete. 2023-07-27T14:34:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.853+0000 7f2577dff700 1 Processor -- start 2023-07-27T14:34:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.853+0000 7f2577dff700 1 -- start start 2023-07-27T14:34:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2577dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f257014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2577dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 0x7f2570159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2577dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2570151d70 0x7f257014ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2577dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257014d660 con 0x7f2570065ff0 2023-07-27T14:34:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2577dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2570159f20 con 0x7f2570151d70 2023-07-27T14:34:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2577dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700ac660 con 0x7f2570066960 2023-07-27T14:34:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2575b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f257014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2575b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f257014d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33292/0 (socket says 172.21.15.115:33292) 2023-07-27T14:34:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.854+0000 7f2575b9b700 1 -- 172.21.15.115:0/3528943739 learned_addr learned my addr 172.21.15.115:0/3528943739 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f257539a700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 0x7f2570159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f257639c700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2570151d70 0x7f257014ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2575b9b700 1 -- 172.21.15.115:0/3528943739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 msgr2=0x7f2570159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2575b9b700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 0x7f2570159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2575b9b700 1 -- 172.21.15.115:0/3528943739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2570151d70 msgr2=0x7f257014ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2575b9b700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2570151d70 0x7f257014ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2575b9b700 1 -- 172.21.15.115:0/3528943739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009370 con 0x7f2570065ff0 2023-07-27T14:34:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2575b9b700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f257014d170 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f256c00e900 tx=0x7f256c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2565ffb700 1 -- 172.21.15.115:0/3528943739 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00c640 con 0x7f2570065ff0 2023-07-27T14:34:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2565ffb700 1 -- 172.21.15.115:0/3528943739 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c00c7a0 con 0x7f2570065ff0 2023-07-27T14:34:47.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25700ac940 con 0x7f2570065ff0 2023-07-27T14:34:47.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2565ffb700 1 -- 172.21.15.115:0/3528943739 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00cb20 con 0x7f2570065ff0 2023-07-27T14:34:47.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.855+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25700acf00 con 0x7f2570065ff0 2023-07-27T14:34:47.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.857+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257006c470 con 0x7f2570065ff0 2023-07-27T14:34:47.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.857+0000 7f2565ffb700 1 -- 172.21.15.115:0/3528943739 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f256c022070 con 0x7f2570065ff0 2023-07-27T14:34:47.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.858+0000 7f2565ffb700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f255405f720 0x7f2554061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:47.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.858+0000 7f2565ffb700 1 -- 172.21.15.115:0/3528943739 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f256c07ad20 con 0x7f2570065ff0 2023-07-27T14:34:47.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.858+0000 7f257539a700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f255405f720 0x7f2554061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:47.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.859+0000 7f257539a700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f255405f720 0x7f2554061be0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f2560009130 tx=0x7f2560017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:47.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:47.862+0000 7f2565ffb700 1 -- 172.21.15.115:0/3528943739 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f256c04b8e0 con 0x7f2570065ff0 2023-07-27T14:34:48.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.074+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2570068720 con 0x7f2570065ff0 2023-07-27T14:34:48.873 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:34:48.829+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:34:48.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.837+0000 7f2565ffb700 1 -- 172.21.15.115:0/3528943739 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7f256c016070 con 0x7f2570065ff0 2023-07-27T14:34:48.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f255405f720 msgr2=0x7f2554061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:48.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f255405f720 0x7f2554061be0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f2560009130 tx=0x7f2560017000).stop 2023-07-27T14:34:48.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 msgr2=0x7f257014d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:48.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f257014d170 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f256c00e900 tx=0x7f256c009060).stop 2023-07-27T14:34:48.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 shutdown_connections 2023-07-27T14:34:48.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f255405f720 0x7f2554061be0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:48.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2570151d70 0x7f257014ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:48.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2570065ff0 0x7f257014d170 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:48.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 --2- 172.21.15.115:0/3528943739 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2570066960 0x7f2570159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:48.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 >> 172.21.15.115:0/3528943739 conn(0x7f25700c89a0 msgr2=0x7f2570155310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:48.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.840+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 shutdown_connections 2023-07-27T14:34:48.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:48.841+0000 7f2577dff700 1 -- 172.21.15.115:0/3528943739 wait complete. 2023-07-27T14:34:48.886 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:34:48.906 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:34:48.947 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:34:49.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.057+0000 7f00fabff700 1 Processor -- start 2023-07-27T14:34:49.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.057+0000 7f00fabff700 1 -- start start 2023-07-27T14:34:49.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00fabff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414ae00 0x7f00f4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:49.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00fabff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f00f4063260 0x7f00f40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:49.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00fabff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f41553f0 con 0x7f00f414b1e0 2023-07-27T14:34:49.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00fabff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f4157a50 con 0x7f00f4063260 2023-07-27T14:34:49.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00fabff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f4157d10 con 0x7f00f414ae00 2023-07-27T14:34:49.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00f3fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f00f414b1e0 0x7f00f4062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41468/0 (socket says 172.21.15.115:41468) 2023-07-27T14:34:49.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00f3fff700 1 -- 172.21.15.115:0/3414135459 learned_addr learned my addr 172.21.15.115:0/3414135459 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:49.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00f899b700 1 --2- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414ae00 0x7f00f4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:49.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00f919c700 1 --2- 172.21.15.115:0/3414135459 >> v2:172.21.15.159:3300/0 conn(0x7f00f4063260 0x7f00f40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:49.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00f37fe700 1 -- 172.21.15.115:0/3414135459 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985348462 0 0) 0x7f00f41553f0 con 0x7f00f414b1e0 2023-07-27T14:34:49.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.059+0000 7f00f37fe700 1 -- 172.21.15.115:0/3414135459 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e40033f0 con 0x7f00f414b1e0 2023-07-27T14:34:49.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f919c700 1 -- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414ae00 msgr2=0x7f00f4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:49.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f37fe700 1 -- 172.21.15.115:0/3414135459 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2085580065 0 0) 0x7f00e40033f0 con 0x7f00f414b1e0 2023-07-27T14:34:49.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f919c700 1 --2- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414ae00 0x7f00f4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f919c700 1 -- 172.21.15.115:0/3414135459 >> v1:172.21.15.115:6789/0 conn(0x7f00f414b1e0 legacy=0x7f00f4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:49.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f919c700 1 -- 172.21.15.115:0/3414135459 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4157ff0 con 0x7f00f4063260 2023-07-27T14:34:49.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f899b700 1 --2- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414ae00 0x7f00f4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:34:49.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f919c700 1 --2- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 0x7f00f40a98c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f00ec009e60 tx=0x7f00ec009780).ready entity=mon.1 client_cookie=bd27bb16023b2593 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:49.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f37fe700 1 -- 172.21.15.115:0/3414135459 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00e070 con 0x7f00f4063260 2023-07-27T14:34:49.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f37fe700 1 -- 172.21.15.115:0/3414135459 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec00b7a0 con 0x7f00f4063260 2023-07-27T14:34:49.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.060+0000 7f00f37fe700 1 -- 172.21.15.115:0/3414135459 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0001470 con 0x7f00f4063260 2023-07-27T14:34:49.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.061+0000 7f00fabff700 1 -- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 msgr2=0x7f00f40a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:49.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.061+0000 7f00fabff700 1 --2- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 0x7f00f40a98c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f00ec009e60 tx=0x7f00ec009780).stop 2023-07-27T14:34:49.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.061+0000 7f00fabff700 1 -- 172.21.15.115:0/3414135459 shutdown_connections 2023-07-27T14:34:49.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.061+0000 7f00fabff700 1 --2- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 0x7f00f40a98c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.061+0000 7f00fabff700 1 --2- 172.21.15.115:0/3414135459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414ae00 0x7f00f4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.061+0000 7f00fabff700 1 -- 172.21.15.115:0/3414135459 >> 172.21.15.115:0/3414135459 conn(0x7f00f405e940 msgr2=0x7f00f40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:49.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.061+0000 7f00fabff700 1 -- 172.21.15.115:0/3414135459 shutdown_connections 2023-07-27T14:34:49.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.061+0000 7f00fabff700 1 -- 172.21.15.115:0/3414135459 wait complete. 2023-07-27T14:34:49.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.062+0000 7f00fabff700 1 Processor -- start 2023-07-27T14:34:49.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.062+0000 7f00fabff700 1 -- start start 2023-07-27T14:34:49.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.063+0000 7f00fabff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 0x7f00f40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:49.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.063+0000 7f00fabff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00f414ae00 0x7f00f414a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:49.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.063+0000 7f00fabff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414b1e0 0x7f00f40c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:49.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.063+0000 7f00fabff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f414ab10 con 0x7f00f414ae00 2023-07-27T14:34:49.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.063+0000 7f00fabff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40ae100 con 0x7f00f4063260 2023-07-27T14:34:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.063+0000 7f00fabff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40ae3e0 con 0x7f00f414b1e0 2023-07-27T14:34:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00f414ae00 0x7f00f414a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00f414ae00 0x7f00f414a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33328/0 (socket says 172.21.15.115:33328) 2023-07-27T14:34:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 -- 172.21.15.115:0/4108109759 learned_addr learned my addr 172.21.15.115:0/4108109759 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:49.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f919c700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414b1e0 0x7f00f40c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:49.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f899b700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 0x7f00f40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:49.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 -- 172.21.15.115:0/4108109759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414b1e0 msgr2=0x7f00f40c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:49.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414b1e0 0x7f00f40c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 -- 172.21.15.115:0/4108109759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 msgr2=0x7f00f40adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:49.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 0x7f00f40adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 -- 172.21.15.115:0/4108109759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80092a0 con 0x7f00f414ae00 2023-07-27T14:34:49.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f3fff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00f414ae00 0x7f00f414a620 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f00e000c790 tx=0x7f00e00018a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:49.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f0ff9700 1 -- 172.21.15.115:0/4108109759 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00072e0 con 0x7f00f414ae00 2023-07-27T14:34:49.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f0ff9700 1 -- 172.21.15.115:0/4108109759 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e0007440 con 0x7f00f414ae00 2023-07-27T14:34:49.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00f0ff9700 1 -- 172.21.15.115:0/4108109759 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0005780 con 0x7f00f414ae00 2023-07-27T14:34:49.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.064+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec009a20 con 0x7f00f414ae00 2023-07-27T14:34:49.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.065+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f40ae9a0 con 0x7f00f414ae00 2023-07-27T14:34:49.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.066+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f406c470 con 0x7f00f414ae00 2023-07-27T14:34:49.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.066+0000 7f00f0ff9700 1 -- 172.21.15.115:0/4108109759 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f00e0010070 con 0x7f00f414ae00 2023-07-27T14:34:49.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.067+0000 7f00f0ff9700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f00d805f720 0x7f00d8061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:49.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.067+0000 7f00f0ff9700 1 -- 172.21.15.115:0/4108109759 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f00e007a1d0 con 0x7f00f414ae00 2023-07-27T14:34:49.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.068+0000 7f00f899b700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f00d805f720 0x7f00d8061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:49.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.068+0000 7f00f899b700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f00d805f720 0x7f00d8061be0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f00e8009270 tx=0x7f00e8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:49.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.071+0000 7f00f0ff9700 1 -- 172.21.15.115:0/4108109759 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f00e004e780 con 0x7f00f414ae00 2023-07-27T14:34:49.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.280+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f00f40aefe0 con 0x7f00f414ae00 2023-07-27T14:34:49.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.845+0000 7f00f0ff9700 1 -- 172.21.15.115:0/4108109759 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00f40aefe0 con 0x7f00f414ae00 2023-07-27T14:34:49.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.847+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f00d805f720 msgr2=0x7f00d8061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.847+0000 7f00fabff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f00d805f720 0x7f00d8061be0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f00e8009270 tx=0x7f00e8008040).stop 2023-07-27T14:34:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.847+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00f414ae00 msgr2=0x7f00f414a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.847+0000 7f00fabff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00f414ae00 0x7f00f414a620 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f00e000c790 tx=0x7f00e00018a0).stop 2023-07-27T14:34:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.848+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 shutdown_connections 2023-07-27T14:34:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.848+0000 7f00fabff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f00d805f720 0x7f00d8061be0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.848+0000 7f00fabff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00f414b1e0 0x7f00f40c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.848+0000 7f00fabff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f4063260 0x7f00f40adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.848+0000 7f00fabff700 1 --2- 172.21.15.115:0/4108109759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00f414ae00 0x7f00f414a620 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.848+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 >> 172.21.15.115:0/4108109759 conn(0x7f00f405e940 msgr2=0x7f00f40c03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.848+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 shutdown_connections 2023-07-27T14:34:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:49.848+0000 7f00fabff700 1 -- 172.21.15.115:0/4108109759 wait complete. 2023-07-27T14:34:49.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:34:50.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.100+0000 7fab673ff700 1 Processor -- start 2023-07-27T14:34:50.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.100+0000 7fab673ff700 1 -- start start 2023-07-27T14:34:50.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.101+0000 7fab673ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fab60063260 0x7fab60154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:50.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.101+0000 7fab673ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab601553f0 con 0x7fab6014b1e0 2023-07-27T14:34:50.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.101+0000 7fab673ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab60157a50 con 0x7fab6014ae00 2023-07-27T14:34:50.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.101+0000 7fab673ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab60157d10 con 0x7fab60063260 2023-07-27T14:34:50.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.101+0000 7fab6599c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fab6014b1e0 0x7fab600a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41482/0 (socket says 172.21.15.115:41482) 2023-07-27T14:34:50.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.101+0000 7fab6599c700 1 -- 172.21.15.115:0/2148519352 learned_addr learned my addr 172.21.15.115:0/2148519352 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:50.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.102+0000 7fab6499a700 1 --2- 172.21.15.115:0/2148519352 >> v2:172.21.15.159:3300/0 conn(0x7fab60063260 0x7fab60154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:50.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.102+0000 7fab57fff700 1 -- 172.21.15.115:0/2148519352 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461146410 0 0) 0x7fab601553f0 con 0x7fab6014b1e0 2023-07-27T14:34:50.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.102+0000 7fab57fff700 1 -- 172.21.15.115:0/2148519352 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4c0033f0 con 0x7fab6014b1e0 2023-07-27T14:34:50.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.102+0000 7fab57fff700 1 -- 172.21.15.115:0/2148519352 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1473649159 0 0) 0x7fab4c0033f0 con 0x7fab6014b1e0 2023-07-27T14:34:50.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.102+0000 7fab6499a700 1 -- 172.21.15.115:0/2148519352 >> v1:172.21.15.159:6789/0 conn(0x7fab6014ae00 legacy=0x7fab60062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:50.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.102+0000 7fab6499a700 1 -- 172.21.15.115:0/2148519352 >> v1:172.21.15.115:6789/0 conn(0x7fab6014b1e0 legacy=0x7fab600a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:50.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.102+0000 7fab6499a700 1 -- 172.21.15.115:0/2148519352 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60157ff0 con 0x7fab60063260 2023-07-27T14:34:50.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.102+0000 7fab6499a700 1 --2- 172.21.15.115:0/2148519352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 0x7fab60154f00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fab50009760 tx=0x7fab50009060).ready entity=mon.1 client_cookie=c9fc87de9c89817e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:50.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab57fff700 1 -- 172.21.15.115:0/2148519352 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580017f0 con 0x7fab60063260 2023-07-27T14:34:50.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab57fff700 1 -- 172.21.15.115:0/2148519352 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50009130 con 0x7fab60063260 2023-07-27T14:34:50.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab57fff700 1 -- 172.21.15.115:0/2148519352 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50012620 con 0x7fab60063260 2023-07-27T14:34:50.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab673ff700 1 -- 172.21.15.115:0/2148519352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 msgr2=0x7fab60154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:50.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab673ff700 1 --2- 172.21.15.115:0/2148519352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 0x7fab60154f00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fab50009760 tx=0x7fab50009060).stop 2023-07-27T14:34:50.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab673ff700 1 -- 172.21.15.115:0/2148519352 shutdown_connections 2023-07-27T14:34:50.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab673ff700 1 --2- 172.21.15.115:0/2148519352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 0x7fab60154f00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:50.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab673ff700 1 -- 172.21.15.115:0/2148519352 >> 172.21.15.115:0/2148519352 conn(0x7fab6005e940 msgr2=0x7fab600cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:50.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab673ff700 1 -- 172.21.15.115:0/2148519352 shutdown_connections 2023-07-27T14:34:50.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.103+0000 7fab673ff700 1 -- 172.21.15.115:0/2148519352 wait complete. 2023-07-27T14:34:50.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.105+0000 7fab673ff700 1 Processor -- start 2023-07-27T14:34:50.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.105+0000 7fab673ff700 1 -- start start 2023-07-27T14:34:50.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab673ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 0x7fab600aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:50.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab673ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab6014ae00 0x7fab600c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:50.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab673ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab6014b1e0 0x7fab60148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:50.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab673ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c3020 con 0x7fab6014ae00 2023-07-27T14:34:50.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab673ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6014b610 con 0x7fab60063260 2023-07-27T14:34:50.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab673ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c2140 con 0x7fab6014b1e0 2023-07-27T14:34:50.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6499a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab6014ae00 0x7fab600c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:50.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6499a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab6014ae00 0x7fab600c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33342/0 (socket says 172.21.15.115:33342) 2023-07-27T14:34:50.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6499a700 1 -- 172.21.15.115:0/3648603422 learned_addr learned my addr 172.21.15.115:0/3648603422 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:50.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6519b700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 0x7fab600aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:50.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6599c700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab6014b1e0 0x7fab60148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:50.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6499a700 1 -- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab6014b1e0 msgr2=0x7fab60148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:50.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6499a700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab6014b1e0 0x7fab60148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:50.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6499a700 1 -- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 msgr2=0x7fab600aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:50.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6499a700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 0x7fab600aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:50.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6499a700 1 -- 172.21.15.115:0/3648603422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500092a0 con 0x7fab6014ae00 2023-07-27T14:34:50.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6519b700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 0x7fab600aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:50.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.106+0000 7fab6599c700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab6014b1e0 0x7fab60148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:50.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.107+0000 7fab6499a700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab6014ae00 0x7fab600c1c50 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fab60155580 tx=0x7fab50015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:50.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.107+0000 7fab557fa700 1 -- 172.21.15.115:0/3648603422 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50006990 con 0x7fab6014ae00 2023-07-27T14:34:50.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.107+0000 7fab557fa700 1 -- 172.21.15.115:0/3648603422 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50011a30 con 0x7fab6014ae00 2023-07-27T14:34:50.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.107+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab600c2410 con 0x7fab6014ae00 2023-07-27T14:34:50.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.107+0000 7fab557fa700 1 -- 172.21.15.115:0/3648603422 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50011db0 con 0x7fab6014ae00 2023-07-27T14:34:50.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.107+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab600c29d0 con 0x7fab6014ae00 2023-07-27T14:34:50.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.108+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab600c31d0 con 0x7fab6014ae00 2023-07-27T14:34:50.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.109+0000 7fab557fa700 1 -- 172.21.15.115:0/3648603422 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fab50024030 con 0x7fab6014ae00 2023-07-27T14:34:50.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.110+0000 7fab557fa700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fab4405f720 0x7fab44061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:50.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.110+0000 7fab557fa700 1 -- 172.21.15.115:0/3648603422 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fab5007b710 con 0x7fab6014ae00 2023-07-27T14:34:50.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.110+0000 7fab6519b700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fab4405f720 0x7fab44061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:50.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.110+0000 7fab6519b700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fab4405f720 0x7fab44061be0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fab5c001890 tx=0x7fab5c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:50.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.114+0000 7fab557fa700 1 -- 172.21.15.115:0/3648603422 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab600c31d0 con 0x7fab6014ae00 2023-07-27T14:34:50.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.284+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fab6006c470 con 0x7fab6014ae00 2023-07-27T14:34:50.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.848+0000 7fab557fa700 1 -- 172.21.15.115:0/3648603422 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) v1 ==== 181+0+0 (secure 0 0 0) 0x7fab50022070 con 0x7fab6014ae00 2023-07-27T14:34:50.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fab4405f720 msgr2=0x7fab44061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:50.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fab4405f720 0x7fab44061be0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fab5c001890 tx=0x7fab5c009040).stop 2023-07-27T14:34:50.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab6014ae00 msgr2=0x7fab600c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:50.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab6014ae00 0x7fab600c1c50 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fab60155580 tx=0x7fab50015000).stop 2023-07-27T14:34:50.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 shutdown_connections 2023-07-27T14:34:50.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fab4405f720 0x7fab44061be0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:50.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab6014b1e0 0x7fab60148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:50.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab60063260 0x7fab600aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:50.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 --2- 172.21.15.115:0/3648603422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab6014ae00 0x7fab600c1c50 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:50.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 >> 172.21.15.115:0/3648603422 conn(0x7fab6005e940 msgr2=0x7fab600640b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:50.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 shutdown_connections 2023-07-27T14:34:50.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:50.852+0000 7fab673ff700 1 -- 172.21.15.115:0/3648603422 wait complete. 2023-07-27T14:34:50.954 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:34:50.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:34:51.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.102+0000 7ff7d0fff700 1 Processor -- start 2023-07-27T14:34:51.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.102+0000 7ff7d0fff700 1 -- start start 2023-07-27T14:34:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.103+0000 7ff7d0fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff7cc14ae00 0x7ff7cc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:51.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.103+0000 7ff7d0fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc063260 0x7ff7cc0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:51.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.103+0000 7ff7d0fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc1553f0 con 0x7ff7cc14b1e0 2023-07-27T14:34:51.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.103+0000 7ff7d0fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc157a50 con 0x7ff7cc14ae00 2023-07-27T14:34:51.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.103+0000 7ff7d0fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc157d10 con 0x7ff7cc063260 2023-07-27T14:34:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7cad9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc063260 0x7ff7cc0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7ca59c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff7cc14ae00 0x7ff7cc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7cad9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc063260 0x7ff7cc0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:59468/0 (socket says 172.21.15.115:59468) 2023-07-27T14:34:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7cad9d700 1 -- 172.21.15.115:0/1528559029 learned_addr learned my addr 172.21.15.115:0/1528559029 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:51.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7c9d9b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7ff7cc14b1e0 0x7ff7cc062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:57900/0 (socket says 172.21.15.115:57900) 2023-07-27T14:34:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7cad9d700 1 -- 172.21.15.115:0/1528559029 >> v2:172.21.15.159:3300/0 conn(0x7ff7cc14ae00 msgr2=0x7ff7cc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7cad9d700 1 --2- 172.21.15.115:0/1528559029 >> v2:172.21.15.159:3300/0 conn(0x7ff7cc14ae00 0x7ff7cc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7cad9d700 1 -- 172.21.15.115:0/1528559029 >> v1:172.21.15.159:6789/0 conn(0x7ff7cc14b1e0 legacy=0x7ff7cc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7cad9d700 1 -- 172.21.15.115:0/1528559029 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc157ff0 con 0x7ff7cc063260 2023-07-27T14:34:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7ca59c700 1 --2- 172.21.15.115:0/1528559029 >> v2:172.21.15.159:3300/0 conn(0x7ff7cc14ae00 0x7ff7cc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:34:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.104+0000 7ff7cad9d700 1 --2- 172.21.15.115:0/1528559029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc063260 0x7ff7cc0a98c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff7c4009f20 tx=0x7ff7c4009840).ready entity=mon.2 client_cookie=b40a28d1bdd60892 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:51.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7c959a700 1 -- 172.21.15.115:0/1528559029 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400e070 con 0x7ff7cc063260 2023-07-27T14:34:51.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7c959a700 1 -- 172.21.15.115:0/1528559029 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400b9d0 con 0x7ff7cc063260 2023-07-27T14:34:51.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7c959a700 1 -- 172.21.15.115:0/1528559029 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400bd50 con 0x7ff7cc063260 2023-07-27T14:34:51.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7d0fff700 1 -- 172.21.15.115:0/1528559029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc063260 msgr2=0x7ff7cc0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:51.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/1528559029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc063260 0x7ff7cc0a98c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff7c4009f20 tx=0x7ff7c4009840).stop 2023-07-27T14:34:51.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7d0fff700 1 -- 172.21.15.115:0/1528559029 shutdown_connections 2023-07-27T14:34:51.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/1528559029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc063260 0x7ff7cc0a98c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/1528559029 >> v2:172.21.15.159:3300/0 conn(0x7ff7cc14ae00 0x7ff7cc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7d0fff700 1 -- 172.21.15.115:0/1528559029 >> 172.21.15.115:0/1528559029 conn(0x7ff7cc05e940 msgr2=0x7ff7cc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:51.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7d0fff700 1 -- 172.21.15.115:0/1528559029 shutdown_connections 2023-07-27T14:34:51.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.105+0000 7ff7d0fff700 1 -- 172.21.15.115:0/1528559029 wait complete. 2023-07-27T14:34:51.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.107+0000 7ff7d0fff700 1 Processor -- start 2023-07-27T14:34:51.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.107+0000 7ff7d0fff700 1 -- start start 2023-07-27T14:34:51.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7d0fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc063260 0x7ff7cc0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:51.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7d0fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc14ae00 0x7ff7cc0a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:51.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7d0fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7cc14b1e0 0x7ff7cc0c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:51.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7d0fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0aa530 con 0x7ff7cc063260 2023-07-27T14:34:51.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7d0fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0aa2b0 con 0x7ff7cc14b1e0 2023-07-27T14:34:51.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7d0fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c2fa0 con 0x7ff7cc14ae00 2023-07-27T14:34:51.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7ca59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc063260 0x7ff7cc0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:51.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7ca59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc063260 0x7ff7cc0c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33354/0 (socket says 172.21.15.115:33354) 2023-07-27T14:34:51.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7ca59c700 1 -- 172.21.15.115:0/194264584 learned_addr learned my addr 172.21.15.115:0/194264584 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:51.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7cad9d700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7cc14b1e0 0x7ff7cc0c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:51.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.108+0000 7ff7c9d9b700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc14ae00 0x7ff7cc0a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:51.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ca59c700 1 -- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc14ae00 msgr2=0x7ff7cc0a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:51.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ca59c700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc14ae00 0x7ff7cc0a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ca59c700 1 -- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7cc14b1e0 msgr2=0x7ff7cc0c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:51.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ca59c700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7cc14b1e0 0x7ff7cc0c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ca59c700 1 -- 172.21.15.115:0/194264584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0092a0 con 0x7ff7cc063260 2023-07-27T14:34:51.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7c9d9b700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc14ae00 0x7ff7cc0a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:51.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ca59c700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc063260 0x7ff7cc0c43c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7ff7bc00ea50 tx=0x7ff7bc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:51.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ba7fc700 1 -- 172.21.15.115:0/194264584 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00c850 con 0x7ff7cc063260 2023-07-27T14:34:51.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ba7fc700 1 -- 172.21.15.115:0/194264584 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00c9b0 con 0x7ff7cc063260 2023-07-27T14:34:51.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c4009ae0 con 0x7ff7cc063260 2023-07-27T14:34:51.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7ba7fc700 1 -- 172.21.15.115:0/194264584 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00cd30 con 0x7ff7cc063260 2023-07-27T14:34:51.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.109+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc0c1fd0 con 0x7ff7cc063260 2023-07-27T14:34:51.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.110+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc0c2900 con 0x7ff7cc063260 2023-07-27T14:34:51.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.111+0000 7ff7ba7fc700 1 -- 172.21.15.115:0/194264584 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7ff7bc022070 con 0x7ff7cc063260 2023-07-27T14:34:51.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.112+0000 7ff7ba7fc700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7ac05f720 0x7ff7ac061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:51.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.112+0000 7ff7ba7fc700 1 -- 172.21.15.115:0/194264584 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5769+0+0 (secure 0 0 0) 0x7ff7bc07ace0 con 0x7ff7cc063260 2023-07-27T14:34:51.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.112+0000 7ff7c9d9b700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7ac05f720 0x7ff7ac061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:51.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.112+0000 7ff7c9d9b700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7ac05f720 0x7ff7ac061be0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7ff7cc0c5750 tx=0x7ff7c0007c90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:51.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.116+0000 7ff7ba7fc700 1 -- 172.21.15.115:0/194264584 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7bc04ba50 con 0x7ff7cc063260 2023-07-27T14:34:51.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.284+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7cc06c470 con 0x7ff7cc063260 2023-07-27T14:34:51.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.856+0000 7ff7ba7fc700 1 -- 172.21.15.115:0/194264584 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff7bc04f070 con 0x7ff7cc063260 2023-07-27T14:34:51.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.861+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7ac05f720 msgr2=0x7ff7ac061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:51.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.861+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7ac05f720 0x7ff7ac061be0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7ff7cc0c5750 tx=0x7ff7c0007c90).stop 2023-07-27T14:34:51.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.861+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc063260 msgr2=0x7ff7cc0c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:51.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.861+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc063260 0x7ff7cc0c43c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7ff7bc00ea50 tx=0x7ff7bc009060).stop 2023-07-27T14:34:51.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.862+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 shutdown_connections 2023-07-27T14:34:51.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.862+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7ac05f720 0x7ff7ac061be0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.862+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7cc14b1e0 0x7ff7cc0c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.862+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7cc063260 0x7ff7cc0c43c0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.862+0000 7ff7d0fff700 1 --2- 172.21.15.115:0/194264584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7cc14ae00 0x7ff7cc0a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:51.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.862+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 >> 172.21.15.115:0/194264584 conn(0x7ff7cc05e940 msgr2=0x7ff7cc14a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:51.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.862+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 shutdown_connections 2023-07-27T14:34:51.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:51.862+0000 7ff7d0fff700 1 -- 172.21.15.115:0/194264584 wait complete. 2023-07-27T14:34:51.908 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:34:51.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-07-27T14:34:52.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.076+0000 7f04f85ff700 1 Processor -- start 2023-07-27T14:34:52.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.076+0000 7f04f85ff700 1 -- start start 2023-07-27T14:34:52.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.077+0000 7f04f85ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04f0153e00 0x7f04f00c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.077+0000 7f04f85ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f0064a80 con 0x7f04f0064230 2023-07-27T14:34:52.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.077+0000 7f04f85ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f0064d60 con 0x7f04f0065de0 2023-07-27T14:34:52.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.077+0000 7f04f85ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f0062320 con 0x7f04f0153e00 2023-07-27T14:34:52.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.078+0000 7f04f639b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04f0153e00 0x7f04f00c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.078+0000 7f04f5b9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f04f0064230 0x7f04f00656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41490/0 (socket says 172.21.15.115:41490) 2023-07-27T14:34:52.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.078+0000 7f04f5b9a700 1 -- 172.21.15.115:0/4070612971 learned_addr learned my addr 172.21.15.115:0/4070612971 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:52.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.078+0000 7f04f5399700 1 -- 172.21.15.115:0/4070612971 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496027901 0 0) 0x7f04f0064a80 con 0x7f04f0064230 2023-07-27T14:34:52.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.078+0000 7f04f639b700 1 -- 172.21.15.115:0/4070612971 >> v1:172.21.15.159:6789/0 conn(0x7f04f0065de0 legacy=0x7f04f0062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:52.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.078+0000 7f04f639b700 1 -- 172.21.15.115:0/4070612971 >> v1:172.21.15.115:6789/0 conn(0x7f04f0064230 legacy=0x7f04f00656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.078+0000 7f04f639b700 1 -- 172.21.15.115:0/4070612971 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0065040 con 0x7f04f0153e00 2023-07-27T14:34:52.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.078+0000 7f04f639b700 1 --2- 172.21.15.115:0/4070612971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0153e00 0x7f04f00c6b70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f04ec009760 tx=0x7f04ec009060).ready entity=mon.0 client_cookie=cf9a0e47d7dbe83 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f5399700 1 -- 172.21.15.115:0/4070612971 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00b520 con 0x7f04f0153e00 2023-07-27T14:34:52.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f5399700 1 -- 172.21.15.115:0/4070612971 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00b680 con 0x7f04f0153e00 2023-07-27T14:34:52.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f5399700 1 -- 172.21.15.115:0/4070612971 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00ba00 con 0x7f04f0153e00 2023-07-27T14:34:52.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f85ff700 1 -- 172.21.15.115:0/4070612971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0153e00 msgr2=0x7f04f00c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f85ff700 1 --2- 172.21.15.115:0/4070612971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0153e00 0x7f04f00c6b70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f04ec009760 tx=0x7f04ec009060).stop 2023-07-27T14:34:52.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f85ff700 1 -- 172.21.15.115:0/4070612971 shutdown_connections 2023-07-27T14:34:52.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f85ff700 1 --2- 172.21.15.115:0/4070612971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0153e00 0x7f04f00c6b70 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f85ff700 1 -- 172.21.15.115:0/4070612971 >> 172.21.15.115:0/4070612971 conn(0x7f04f00c7b90 msgr2=0x7f04f00c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:52.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f85ff700 1 -- 172.21.15.115:0/4070612971 shutdown_connections 2023-07-27T14:34:52.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.079+0000 7f04f85ff700 1 -- 172.21.15.115:0/4070612971 wait complete. 2023-07-27T14:34:52.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.081+0000 7f04f85ff700 1 Processor -- start 2023-07-27T14:34:52.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.081+0000 7f04f85ff700 1 -- start start 2023-07-27T14:34:52.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f85ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f0064230 0x7f04f00aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f85ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0065de0 0x7f04f0165650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f85ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f0153e00 0x7f04f00acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f85ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0165470 con 0x7f04f0065de0 2023-07-27T14:34:52.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f85ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00aad70 con 0x7f04f0153e00 2023-07-27T14:34:52.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f85ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0165b40 con 0x7f04f0064230 2023-07-27T14:34:52.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f5b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0065de0 0x7f04f0165650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f5b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0065de0 0x7f04f0165650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33370/0 (socket says 172.21.15.115:33370) 2023-07-27T14:34:52.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f5b9a700 1 -- 172.21.15.115:0/2468868788 learned_addr learned my addr 172.21.15.115:0/2468868788 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:52.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f639b700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f0064230 0x7f04f00aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f6b9c700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f0153e00 0x7f04f00acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f5b9a700 1 -- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f0064230 msgr2=0x7f04f00aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.082+0000 7f04f5b9a700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f0064230 0x7f04f00aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04f5b9a700 1 -- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f0153e00 msgr2=0x7f04f00acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04f5b9a700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f0153e00 0x7f04f00acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04f5b9a700 1 -- 172.21.15.115:0/2468868788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec0092a0 con 0x7f04f0065de0 2023-07-27T14:34:52.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04f639b700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f0064230 0x7f04f00aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:52.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04f6b9c700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f0153e00 0x7f04f00acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:52.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04f5b9a700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0065de0 0x7f04f0165650 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f04e000c4e0 tx=0x7f04e0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04e67fc700 1 -- 172.21.15.115:0/2468868788 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00072e0 con 0x7f04f0065de0 2023-07-27T14:34:52.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04e67fc700 1 -- 172.21.15.115:0/2468868788 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0007440 con 0x7f04f0065de0 2023-07-27T14:34:52.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f01648f0 con 0x7f04f0065de0 2023-07-27T14:34:52.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04e67fc700 1 -- 172.21.15.115:0/2468868788 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00057a0 con 0x7f04f0065de0 2023-07-27T14:34:52.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.083+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f0164eb0 con 0x7f04f0065de0 2023-07-27T14:34:52.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.084+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f0167ae0 con 0x7f04f0065de0 2023-07-27T14:34:52.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.085+0000 7f04e67fc700 1 -- 172.21.15.115:0/2468868788 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f04e001a060 con 0x7f04f0065de0 2023-07-27T14:34:52.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.086+0000 7f04e67fc700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04d405f720 0x7f04d4061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.086+0000 7f04e67fc700 1 -- 172.21.15.115:0/2468868788 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f04e0079db0 con 0x7f04f0065de0 2023-07-27T14:34:52.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.086+0000 7f04f639b700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04d405f720 0x7f04d4061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.087+0000 7f04f639b700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04d405f720 0x7f04d4061be0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f04f0146d10 tx=0x7f04ec017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.091+0000 7f04e67fc700 1 -- 172.21.15.115:0/2468868788 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f04f0167ae0 con 0x7f04f0065de0 2023-07-27T14:34:52.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.259+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f04f006c470 con 0x7f04f0065de0 2023-07-27T14:34:52.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.264+0000 7f04e67fc700 1 -- 172.21.15.115:0/2468868788 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v24) v1 ==== 115+0+0 (secure 0 0 0) 0x7f04e007e070 con 0x7f04f0065de0 2023-07-27T14:34:52.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04d405f720 msgr2=0x7f04d4061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04d405f720 0x7f04d4061be0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f04f0146d10 tx=0x7f04ec017000).stop 2023-07-27T14:34:52.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0065de0 msgr2=0x7f04f0165650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0065de0 0x7f04f0165650 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f04e000c4e0 tx=0x7f04e0007c70).stop 2023-07-27T14:34:52.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 shutdown_connections 2023-07-27T14:34:52.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f04d405f720 0x7f04d4061be0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04f0153e00 0x7f04f00acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04f0064230 0x7f04f00aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 --2- 172.21.15.115:0/2468868788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f0065de0 0x7f04f0165650 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 >> 172.21.15.115:0/2468868788 conn(0x7f04f00c7b90 msgr2=0x7f04f0152240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:52.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 shutdown_connections 2023-07-27T14:34:52.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.266+0000 7f04f85ff700 1 -- 172.21.15.115:0/2468868788 wait complete. 2023-07-27T14:34:52.327 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:34:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.472+0000 7fd342fff700 1 Processor -- start 2023-07-27T14:34:52.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.473+0000 7fd342fff700 1 -- start start 2023-07-27T14:34:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.474+0000 7fd342fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd33c13a350 0x7fd33c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.474+0000 7fd342fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0bd9a0 con 0x7fd33c13a730 2023-07-27T14:34:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.474+0000 7fd342fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c066610 con 0x7fd33c0c36b0 2023-07-27T14:34:52.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.474+0000 7fd342fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c066400 con 0x7fd33c13a350 2023-07-27T14:34:52.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.474+0000 7fd33bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd33c13a730 0x7fd33c0c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41500/0 (socket says 172.21.15.115:41500) 2023-07-27T14:34:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.474+0000 7fd33bfff700 1 -- 172.21.15.115:0/2302681029 learned_addr learned my addr 172.21.15.115:0/2302681029 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.474+0000 7fd340d9b700 1 --2- 172.21.15.115:0/2302681029 >> v2:172.21.15.159:3300/0 conn(0x7fd33c13a350 0x7fd33c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.474+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022953227 0 0) 0x7fd33c0bd9a0 con 0x7fd33c13a730 2023-07-27T14:34:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd32c0033f0 con 0x7fd33c13a730 2023-07-27T14:34:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 63032688 0 0) 0x7fd32c0033f0 con 0x7fd33c13a730 2023-07-27T14:34:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 >> v2:172.21.15.159:3300/0 conn(0x7fd33c13a350 msgr2=0x7fd33c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:52.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 --2- 172.21.15.115:0/2302681029 >> v2:172.21.15.159:3300/0 conn(0x7fd33c13a350 0x7fd33c065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 >> v1:172.21.15.159:6789/0 conn(0x7fd33c0c36b0 legacy=0x7fd33c0be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0bdc10 con 0x7fd33c13a730 2023-07-27T14:34:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fd328001470 con 0x7fd33c13a730 2023-07-27T14:34:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 >> v1:172.21.15.115:6789/0 conn(0x7fd33c13a730 legacy=0x7fd33c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd32c0038e0 0x7fd32c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c004690 0x7fd32c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd32c005000 0x7fd32c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c066400 con 0x7fd32c005000 2023-07-27T14:34:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c00bf60 con 0x7fd32c0038e0 2023-07-27T14:34:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c00c0f0 con 0x7fd32c004690 2023-07-27T14:34:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd34159c700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd32c005000 0x7fd32c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd33bfff700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c004690 0x7fd32c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.475+0000 7fd340d9b700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd32c0038e0 0x7fd32c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd34159c700 1 -- 172.21.15.115:0/2302681029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c004690 msgr2=0x7fd32c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd34159c700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c004690 0x7fd32c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd34159c700 1 -- 172.21.15.115:0/2302681029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd32c0038e0 msgr2=0x7fd32c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd34159c700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd32c0038e0 0x7fd32c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd34159c700 1 -- 172.21.15.115:0/2302681029 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c0033f0 con 0x7fd32c005000 2023-07-27T14:34:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd34159c700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd32c005000 0x7fd32c00b8e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fd33c065cd0 tx=0x7fd334007f30).ready entity=mon.0 client_cookie=955d2d41db1b882 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd34159c700 1 -- 172.21.15.115:0/2302681029 reap_dead start 2023-07-27T14:34:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334006a20 con 0x7fd32c005000 2023-07-27T14:34:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334006b80 con 0x7fd32c005000 2023-07-27T14:34:52.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.476+0000 7fd33b7fe700 1 -- 172.21.15.115:0/2302681029 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400c5d0 con 0x7fd32c005000 2023-07-27T14:34:52.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.477+0000 7fd342fff700 1 -- 172.21.15.115:0/2302681029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd32c005000 msgr2=0x7fd32c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.477+0000 7fd342fff700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd32c005000 0x7fd32c00b8e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fd33c065cd0 tx=0x7fd334007f30).stop 2023-07-27T14:34:52.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.477+0000 7fd342fff700 1 -- 172.21.15.115:0/2302681029 shutdown_connections 2023-07-27T14:34:52.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.477+0000 7fd342fff700 1 --2- 172.21.15.115:0/2302681029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd32c005000 0x7fd32c00b8e0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.477+0000 7fd342fff700 1 -- 172.21.15.115:0/2302681029 >> 172.21.15.115:0/2302681029 conn(0x7fd33c05e8f0 msgr2=0x7fd33c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:52.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.477+0000 7fd342fff700 1 -- 172.21.15.115:0/2302681029 shutdown_connections 2023-07-27T14:34:52.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.477+0000 7fd342fff700 1 -- 172.21.15.115:0/2302681029 wait complete. 2023-07-27T14:34:52.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.478+0000 7fd342fff700 1 Processor -- start 2023-07-27T14:34:52.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.478+0000 7fd342fff700 1 -- start start 2023-07-27T14:34:52.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.479+0000 7fd342fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c005000 0x7fd33c139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.479+0000 7fd342fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c154570 0x7fd33c1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.479+0000 7fd342fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd33c0c1b90 0x7fd33c0c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.479+0000 7fd342fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c1555d0 con 0x7fd33c0c1b90 2023-07-27T14:34:52.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.479+0000 7fd342fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0a86d0 con 0x7fd33c154570 2023-07-27T14:34:52.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.479+0000 7fd342fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0c2500 con 0x7fd32c005000 2023-07-27T14:34:52.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd33c0c1b90 0x7fd33c0c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd33c0c1b90 0x7fd33c0c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33390/0 (socket says 172.21.15.115:33390) 2023-07-27T14:34:52.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 -- 172.21.15.115:0/3212325909 learned_addr learned my addr 172.21.15.115:0/3212325909 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:52.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd340d9b700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c005000 0x7fd33c139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd33bfff700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c154570 0x7fd33c1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 -- 172.21.15.115:0/3212325909 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c005000 msgr2=0x7fd33c139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c005000 0x7fd33c139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 -- 172.21.15.115:0/3212325909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c154570 msgr2=0x7fd33c1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c154570 0x7fd33c1549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 -- 172.21.15.115:0/3212325909 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c139900 con 0x7fd33c0c1b90 2023-07-27T14:34:52.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd34159c700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd33c0c1b90 0x7fd33c0c2010 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fd33400c4c0 tx=0x7fd334015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.480+0000 7fd338ff9700 1 -- 172.21.15.115:0/3212325909 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400c5d0 con 0x7fd33c0c1b90 2023-07-27T14:34:52.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.481+0000 7fd338ff9700 1 -- 172.21.15.115:0/3212325909 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334013b50 con 0x7fd33c0c1b90 2023-07-27T14:34:52.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.481+0000 7fd338ff9700 1 -- 172.21.15.115:0/3212325909 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334006a20 con 0x7fd33c0c1b90 2023-07-27T14:34:52.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.481+0000 7fd342fff700 1 -- 172.21.15.115:0/3212325909 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c155010 con 0x7fd33c0c1b90 2023-07-27T14:34:52.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.481+0000 7fd342fff700 1 -- 172.21.15.115:0/3212325909 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c0a8360 con 0x7fd33c0c1b90 2023-07-27T14:34:52.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.482+0000 7fd3267fc700 1 -- 172.21.15.115:0/3212325909 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c0a8520 con 0x7fd33c0c1b90 2023-07-27T14:34:52.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.483+0000 7fd338ff9700 1 -- 172.21.15.115:0/3212325909 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fd33401d070 con 0x7fd33c0c1b90 2023-07-27T14:34:52.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.483+0000 7fd338ff9700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd32005f720 0x7fd320061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.484+0000 7fd338ff9700 1 -- 172.21.15.115:0/3212325909 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd33407b0e0 con 0x7fd33c0c1b90 2023-07-27T14:34:52.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.484+0000 7fd340d9b700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd32005f720 0x7fd320061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.484+0000 7fd340d9b700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd32005f720 0x7fd320061be0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fd330006d80 tx=0x7fd330009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.490+0000 7fd338ff9700 1 -- 172.21.15.115:0/3212325909 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd33404bff0 con 0x7fd33c0c1b90 2023-07-27T14:34:52.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.662+0000 7fd3267fc700 1 -- 172.21.15.115:0/3212325909 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd33c06c470 con 0x7fd33c0c1b90 2023-07-27T14:34:52.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.666+0000 7fd338ff9700 1 -- 172.21.15.115:0/3212325909 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd33401a0a0 con 0x7fd33c0c1b90 2023-07-27T14:34:52.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 -- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd32005f720 msgr2=0x7fd320061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd32005f720 0x7fd320061be0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fd330006d80 tx=0x7fd330009060).stop 2023-07-27T14:34:52.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 -- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd33c0c1b90 msgr2=0x7fd33c0c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd33c0c1b90 0x7fd33c0c2010 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fd33400c4c0 tx=0x7fd334015000).stop 2023-07-27T14:34:52.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 -- 172.21.15.115:0/3212325909 shutdown_connections 2023-07-27T14:34:52.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd32005f720 0x7fd320061be0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd33c0c1b90 0x7fd33c0c2010 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd32c005000 0x7fd33c139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 --2- 172.21.15.115:0/3212325909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd33c154570 0x7fd33c1549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 -- 172.21.15.115:0/3212325909 >> 172.21.15.115:0/3212325909 conn(0x7fd33c05e8f0 msgr2=0x7fd33c0beb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:52.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 -- 172.21.15.115:0/3212325909 shutdown_connections 2023-07-27T14:34:52.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.668+0000 7fd3267fc700 1 -- 172.21.15.115:0/3212325909 wait complete. 2023-07-27T14:34:52.729 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_getpath' 2023-07-27T14:34:52.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.873+0000 7fee5a5ff700 1 Processor -- start 2023-07-27T14:34:52.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.873+0000 7fee5a5ff700 1 -- start start 2023-07-27T14:34:52.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.874+0000 7fee5a5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee54153ec0 0x7fee540a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee5a5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee540aa050 0x7fee540640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee5a5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540aa4d0 con 0x7fee540aaa40 2023-07-27T14:34:52.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee5a5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540c05c0 con 0x7fee540aa050 2023-07-27T14:34:52.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee5a5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c1a60 con 0x7fee54153ec0 2023-07-27T14:34:52.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee58b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fee540aaa40 0x7fee54157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41510/0 (socket says 172.21.15.115:41510) 2023-07-27T14:34:52.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee58b9c700 1 -- 172.21.15.115:0/1357897450 learned_addr learned my addr 172.21.15.115:0/1357897450 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:52.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee537fe700 1 --2- 172.21.15.115:0/1357897450 >> v2:172.21.15.115:3300/0 conn(0x7fee540aa050 0x7fee540640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee53fff700 1 --2- 172.21.15.115:0/1357897450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee54153ec0 0x7fee540a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee537fe700 1 -- 172.21.15.115:0/1357897450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee54153ec0 msgr2=0x7fee540a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:52.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee537fe700 1 --2- 172.21.15.115:0/1357897450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee54153ec0 0x7fee540a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee537fe700 1 -- 172.21.15.115:0/1357897450 >> v1:172.21.15.115:6789/0 conn(0x7fee540aaa40 legacy=0x7fee54157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.875+0000 7fee537fe700 1 -- 172.21.15.115:0/1357897450 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540bfc90 con 0x7fee540aa050 2023-07-27T14:34:52.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee537fe700 1 --2- 172.21.15.115:0/1357897450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee540aa050 0x7fee540640f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fee48009760 tx=0x7fee48009060).ready entity=mon.0 client_cookie=1460366b9fa91420 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee52ffd700 1 -- 172.21.15.115:0/1357897450 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee480090d0 con 0x7fee540aa050 2023-07-27T14:34:52.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee52ffd700 1 -- 172.21.15.115:0/1357897450 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800f510 con 0x7fee540aa050 2023-07-27T14:34:52.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee52ffd700 1 -- 172.21.15.115:0/1357897450 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800f890 con 0x7fee540aa050 2023-07-27T14:34:52.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee5a5ff700 1 -- 172.21.15.115:0/1357897450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee540aa050 msgr2=0x7fee540640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/1357897450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee540aa050 0x7fee540640f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fee48009760 tx=0x7fee48009060).stop 2023-07-27T14:34:52.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee5a5ff700 1 -- 172.21.15.115:0/1357897450 shutdown_connections 2023-07-27T14:34:52.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/1357897450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee54153ec0 0x7fee540a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/1357897450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee540aa050 0x7fee540640f0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.876+0000 7fee5a5ff700 1 -- 172.21.15.115:0/1357897450 >> 172.21.15.115:0/1357897450 conn(0x7fee540cb610 msgr2=0x7fee540c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:52.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.877+0000 7fee5a5ff700 1 -- 172.21.15.115:0/1357897450 shutdown_connections 2023-07-27T14:34:52.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.877+0000 7fee5a5ff700 1 -- 172.21.15.115:0/1357897450 wait complete. 2023-07-27T14:34:52.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.878+0000 7fee5a5ff700 1 Processor -- start 2023-07-27T14:34:52.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.878+0000 7fee5a5ff700 1 -- start start 2023-07-27T14:34:52.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee5a5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee540aa050 0x7fee540c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee5a5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee540aaa40 0x7fee54153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee5a5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee54153ec0 0x7fee5414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee5a5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee54150480 con 0x7fee54153ec0 2023-07-27T14:34:52.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee5a5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c32d0 con 0x7fee540aaa40 2023-07-27T14:34:52.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee5a5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c36f0 con 0x7fee540aa050 2023-07-27T14:34:52.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee54153ec0 0x7fee5414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee58b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee54153ec0 0x7fee5414c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33418/0 (socket says 172.21.15.115:33418) 2023-07-27T14:34:52.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee58b9c700 1 -- 172.21.15.115:0/3658997272 learned_addr learned my addr 172.21.15.115:0/3658997272 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:52.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee53fff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee540aa050 0x7fee540c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.879+0000 7fee537fe700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee540aaa40 0x7fee54153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee58b9c700 1 -- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee540aa050 msgr2=0x7fee540c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee58b9c700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee540aa050 0x7fee540c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee58b9c700 1 -- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee540aaa40 msgr2=0x7fee54153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:52.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee58b9c700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee540aaa40 0x7fee54153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:52.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee58b9c700 1 -- 172.21.15.115:0/3658997272 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480092a0 con 0x7fee54153ec0 2023-07-27T14:34:52.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee537fe700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee540aaa40 0x7fee54153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:52.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee58b9c700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee54153ec0 0x7fee5414c760 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fee4c00cb90 tx=0x7fee4c001850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee3bfff700 1 -- 172.21.15.115:0/3658997272 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c005d30 con 0x7fee54153ec0 2023-07-27T14:34:52.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee3bfff700 1 -- 172.21.15.115:0/3658997272 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c005e90 con 0x7fee54153ec0 2023-07-27T14:34:52.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee3bfff700 1 -- 172.21.15.115:0/3658997272 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c007340 con 0x7fee54153ec0 2023-07-27T14:34:52.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee54150b00 con 0x7fee54153ec0 2023-07-27T14:34:52.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.880+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee541510c0 con 0x7fee54153ec0 2023-07-27T14:34:52.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.881+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee541512b0 con 0x7fee54153ec0 2023-07-27T14:34:52.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.882+0000 7fee3bfff700 1 -- 172.21.15.115:0/3658997272 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fee4c010030 con 0x7fee54153ec0 2023-07-27T14:34:52.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.883+0000 7fee3bfff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005f720 0x7fee40061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:52.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.883+0000 7fee3bfff700 1 -- 172.21.15.115:0/3658997272 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fee4c07a680 con 0x7fee54153ec0 2023-07-27T14:34:52.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.883+0000 7fee53fff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005f720 0x7fee40061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:52.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.883+0000 7fee53fff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005f720 0x7fee40061be0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fee4400bb10 tx=0x7fee44008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:52.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:52.887+0000 7fee3bfff700 1 -- 172.21.15.115:0/3658997272 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fee4c04b530 con 0x7fee54153ec0 2023-07-27T14:34:53.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.121+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_getpath"]} v 0) v1 -- 0x7fee540c3860 con 0x7fee54153ec0 2023-07-27T14:34:53.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.862+0000 7fee3bfff700 1 -- 172.21.15.115:0/3658997272 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_getpath"]}]=0 v415) v1 ==== 173+0+0 (secure 0 0 0) 0x7fee4c04eb50 con 0x7fee54153ec0 2023-07-27T14:34:53.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005f720 msgr2=0x7fee40061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:53.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005f720 0x7fee40061be0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fee4400bb10 tx=0x7fee44008040).stop 2023-07-27T14:34:53.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee54153ec0 msgr2=0x7fee5414c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:53.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee54153ec0 0x7fee5414c760 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fee4c00cb90 tx=0x7fee4c001850).stop 2023-07-27T14:34:53.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 shutdown_connections 2023-07-27T14:34:53.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fee4005f720 0x7fee40061be0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:53.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee54153ec0 0x7fee5414c760 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:53.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fee540aa050 0x7fee540c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:53.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 --2- 172.21.15.115:0/3658997272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee540aaa40 0x7fee54153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:53.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 >> 172.21.15.115:0/3658997272 conn(0x7fee540cb610 msgr2=0x7fee540ab230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:53.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 shutdown_connections 2023-07-27T14:34:53.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:53.864+0000 7fee5a5ff700 1 -- 172.21.15.115:0/3658997272 wait complete. 2023-07-27T14:34:53.925 INFO:tasks.cephfs_test_runner:test_subvolume_clone_in_progress_getpath (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:34:53.926 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_clone_in_progress_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:34:53.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_snapshot_rm' 2023-07-27T14:34:54.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.072+0000 7f5fc0dff700 1 Processor -- start 2023-07-27T14:34:54.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.072+0000 7f5fc0dff700 1 -- start start 2023-07-27T14:34:54.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.073+0000 7f5fc0dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5fbc14e470 0x7f5fbc14e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:54.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.073+0000 7f5fc0dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fbc0a4840 con 0x7f5fbc062a30 2023-07-27T14:34:54.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.073+0000 7f5fc0dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fbc0a6ed0 con 0x7f5fbc155110 2023-07-27T14:34:54.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.073+0000 7f5fc0dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fbc0a71b0 con 0x7f5fbc14e470 2023-07-27T14:34:54.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fba59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5fbc14e470 0x7f5fbc14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:54.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fbad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5fbc062a30 0x7f5fbc0a5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54606/0 (socket says 172.21.15.115:54606) 2023-07-27T14:34:54.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fbad9d700 1 -- 172.21.15.115:0/650896099 learned_addr learned my addr 172.21.15.115:0/650896099 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:54.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fba59c700 1 -- 172.21.15.115:0/650896099 >> v1:172.21.15.159:6789/0 conn(0x7f5fbc155110 legacy=0x7f5fbc062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:54.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fba59c700 1 -- 172.21.15.115:0/650896099 >> v1:172.21.15.115:6789/0 conn(0x7f5fbc062a30 legacy=0x7f5fbc0a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:54.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fba59c700 1 -- 172.21.15.115:0/650896099 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0a4a90 con 0x7f5fbc14e470 2023-07-27T14:34:54.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fb959a700 1 -- 172.21.15.115:0/650896099 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545653881 0 0) 0x7f5fbc0a4840 con 0x7f5fbc062a30 2023-07-27T14:34:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fba59c700 1 --2- 172.21.15.115:0/650896099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc14e470 0x7f5fbc14e850 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f5fac009760 tx=0x7f5fac009060).ready entity=mon.0 client_cookie=309f1662f671d6ca server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fb959a700 1 -- 172.21.15.115:0/650896099 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00b520 con 0x7f5fbc14e470 2023-07-27T14:34:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fb959a700 1 -- 172.21.15.115:0/650896099 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac00b680 con 0x7f5fbc14e470 2023-07-27T14:34:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.074+0000 7f5fb959a700 1 -- 172.21.15.115:0/650896099 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00ba00 con 0x7f5fbc14e470 2023-07-27T14:34:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.075+0000 7f5fc0dff700 1 -- 172.21.15.115:0/650896099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc14e470 msgr2=0x7f5fbc14e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.075+0000 7f5fc0dff700 1 --2- 172.21.15.115:0/650896099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc14e470 0x7f5fbc14e850 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f5fac009760 tx=0x7f5fac009060).stop 2023-07-27T14:34:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.075+0000 7f5fc0dff700 1 -- 172.21.15.115:0/650896099 shutdown_connections 2023-07-27T14:34:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.075+0000 7f5fc0dff700 1 --2- 172.21.15.115:0/650896099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc14e470 0x7f5fbc14e850 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:54.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.075+0000 7f5fc0dff700 1 -- 172.21.15.115:0/650896099 >> 172.21.15.115:0/650896099 conn(0x7f5fbc0c7990 msgr2=0x7f5fbc0c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:54.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.075+0000 7f5fc0dff700 1 -- 172.21.15.115:0/650896099 shutdown_connections 2023-07-27T14:34:54.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.075+0000 7f5fc0dff700 1 -- 172.21.15.115:0/650896099 wait complete. 2023-07-27T14:34:54.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.077+0000 7f5fc0dff700 1 Processor -- start 2023-07-27T14:34:54.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.077+0000 7f5fc0dff700 1 -- start start 2023-07-27T14:34:54.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.077+0000 7f5fc0dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc062a30 0x7f5fbc0ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:54.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fc0dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fbc14e470 0x7f5fbc0a8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:54.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fc0dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fbc155110 0x7f5fbc0a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:54.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fc0dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0a8f00 con 0x7f5fbc062a30 2023-07-27T14:34:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fc0dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc149fb0 con 0x7f5fbc14e470 2023-07-27T14:34:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fc0dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0a7510 con 0x7f5fbc155110 2023-07-27T14:34:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc062a30 0x7f5fbc0ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc062a30 0x7f5fbc0ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41126/0 (socket says 172.21.15.115:41126) 2023-07-27T14:34:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 -- 172.21.15.115:0/3817186679 learned_addr learned my addr 172.21.15.115:0/3817186679 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fbad9d700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fbc155110 0x7f5fbc0a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 -- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fbc155110 msgr2=0x7f5fbc0a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fb9d9b700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fbc14e470 0x7f5fbc0a8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fbc155110 0x7f5fbc0a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 -- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fbc14e470 msgr2=0x7f5fbc0a8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fbc14e470 0x7f5fbc0a8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 -- 172.21.15.115:0/3817186679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac0092a0 con 0x7f5fbc062a30 2023-07-27T14:34:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fbad9d700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fbc155110 0x7f5fbc0a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fb9d9b700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fbc14e470 0x7f5fbc0a8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.078+0000 7f5fba59c700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc062a30 0x7f5fbc0ab350 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f5fac009eb0 tx=0x7f5fac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.079+0000 7f5faa7fc700 1 -- 172.21.15.115:0/3817186679 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00b7f0 con 0x7f5fbc062a30 2023-07-27T14:34:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.079+0000 7f5faa7fc700 1 -- 172.21.15.115:0/3817186679 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac00b950 con 0x7f5fbc062a30 2023-07-27T14:34:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.079+0000 7f5faa7fc700 1 -- 172.21.15.115:0/3817186679 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac01b620 con 0x7f5fbc062a30 2023-07-27T14:34:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.079+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc0a7760 con 0x7f5fbc062a30 2023-07-27T14:34:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.079+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc0a7d20 con 0x7f5fbc062a30 2023-07-27T14:34:54.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.080+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fbc06c470 con 0x7f5fbc062a30 2023-07-27T14:34:54.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.080+0000 7f5faa7fc700 1 -- 172.21.15.115:0/3817186679 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f5fac00f070 con 0x7f5fbc062a30 2023-07-27T14:34:54.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.081+0000 7f5faa7fc700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f9c05f720 0x7f5f9c061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:54.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.081+0000 7f5faa7fc700 1 -- 172.21.15.115:0/3817186679 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f5fac07c430 con 0x7f5fbc062a30 2023-07-27T14:34:54.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.082+0000 7f5fb9d9b700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f9c05f720 0x7f5f9c061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:54.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.082+0000 7f5fb9d9b700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f9c05f720 0x7f5f9c061be0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f5fbc06a280 tx=0x7f5fb0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:54.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.085+0000 7f5faa7fc700 1 -- 172.21.15.115:0/3817186679 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fac04d230 con 0x7f5fbc062a30 2023-07-27T14:34:54.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.316+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_snapshot_rm"]} v 0) v1 -- 0x7f5fbc14eb60 con 0x7f5fbc062a30 2023-07-27T14:34:54.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.865+0000 7f5faa7fc700 1 -- 172.21.15.115:0/3817186679 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_snapshot_rm"]}]=0 v416) v1 ==== 180+0+0 (secure 0 0 0) 0x7f5fac050850 con 0x7f5fbc062a30 2023-07-27T14:34:54.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f9c05f720 msgr2=0x7f5f9c061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:54.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f9c05f720 0x7f5f9c061be0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f5fbc06a280 tx=0x7f5fb0009040).stop 2023-07-27T14:34:54.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc062a30 msgr2=0x7f5fbc0ab350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:54.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc062a30 0x7f5fbc0ab350 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f5fac009eb0 tx=0x7f5fac017000).stop 2023-07-27T14:34:54.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 shutdown_connections 2023-07-27T14:34:54.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f9c05f720 0x7f5f9c061be0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:54.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fbc155110 0x7f5fbc0a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:54.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fbc062a30 0x7f5fbc0ab350 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:54.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.867+0000 7f5fc0dff700 1 --2- 172.21.15.115:0/3817186679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fbc14e470 0x7f5fbc0a8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:54.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.868+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 >> 172.21.15.115:0/3817186679 conn(0x7f5fbc0c7990 msgr2=0x7f5fbc062320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:54.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.868+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 shutdown_connections 2023-07-27T14:34:54.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:54.868+0000 7f5fc0dff700 1 -- 172.21.15.115:0/3817186679 wait complete. 2023-07-27T14:34:54.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:34:55.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.080+0000 7fd3157ff700 1 Processor -- start 2023-07-27T14:34:55.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.080+0000 7fd3157ff700 1 -- start start 2023-07-27T14:34:55.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.081+0000 7fd3157ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd31014ae00 0x7fd310154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.081+0000 7fd3157ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd310062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.081+0000 7fd3157ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3100c5c50 0x7fd310063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.081+0000 7fd3157ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd310063530 con 0x7fd3100c5c50 2023-07-27T14:34:55.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.081+0000 7fd3157ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3101553f0 con 0x7fd31014ae00 2023-07-27T14:34:55.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.081+0000 7fd3157ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd310157a50 con 0x7fd31014b1e0 2023-07-27T14:34:55.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3100c5c50 0x7fd310063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3100c5c50 0x7fd310063040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41142/0 (socket says 172.21.15.115:41142) 2023-07-27T14:34:55.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 -- 172.21.15.115:0/2093102367 learned_addr learned my addr 172.21.15.115:0/2093102367 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:55.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30e7fc700 1 --2- 172.21.15.115:0/2093102367 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd310062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30effd700 1 --2- 172.21.15.115:0/2093102367 >> v2:172.21.15.159:3300/0 conn(0x7fd31014ae00 0x7fd310154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 -- 172.21.15.115:0/2093102367 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 msgr2=0x7fd310062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:55.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 --2- 172.21.15.115:0/2093102367 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd310062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 -- 172.21.15.115:0/2093102367 >> v2:172.21.15.159:3300/0 conn(0x7fd31014ae00 msgr2=0x7fd310154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:55.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 --2- 172.21.15.115:0/2093102367 >> v2:172.21.15.159:3300/0 conn(0x7fd31014ae00 0x7fd310154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 -- 172.21.15.115:0/2093102367 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310157d10 con 0x7fd3100c5c50 2023-07-27T14:34:55.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30e7fc700 1 --2- 172.21.15.115:0/2093102367 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd310062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:55.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30f7fe700 1 --2- 172.21.15.115:0/2093102367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd310063040 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fd3100caaf0 tx=0x7fd308009840).ready entity=mon.0 client_cookie=f68dcc6a549b6553 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:55.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30dffb700 1 -- 172.21.15.115:0/2093102367 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800e070 con 0x7fd3100c5c50 2023-07-27T14:34:55.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30dffb700 1 -- 172.21.15.115:0/2093102367 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800ba50 con 0x7fd3100c5c50 2023-07-27T14:34:55.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.082+0000 7fd30dffb700 1 -- 172.21.15.115:0/2093102367 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800bdd0 con 0x7fd3100c5c50 2023-07-27T14:34:55.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 -- 172.21.15.115:0/2093102367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 msgr2=0x7fd310063040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 --2- 172.21.15.115:0/2093102367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd310063040 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fd3100caaf0 tx=0x7fd308009840).stop 2023-07-27T14:34:55.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 -- 172.21.15.115:0/2093102367 shutdown_connections 2023-07-27T14:34:55.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 --2- 172.21.15.115:0/2093102367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd310063040 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 --2- 172.21.15.115:0/2093102367 >> v2:172.21.15.159:3300/0 conn(0x7fd31014ae00 0x7fd310154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 --2- 172.21.15.115:0/2093102367 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd310062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 -- 172.21.15.115:0/2093102367 >> 172.21.15.115:0/2093102367 conn(0x7fd31005e940 msgr2=0x7fd3100cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:55.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 -- 172.21.15.115:0/2093102367 shutdown_connections 2023-07-27T14:34:55.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.083+0000 7fd3157ff700 1 -- 172.21.15.115:0/2093102367 wait complete. 2023-07-27T14:34:55.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.084+0000 7fd3157ff700 1 Processor -- start 2023-07-27T14:34:55.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.085+0000 7fd3157ff700 1 -- start start 2023-07-27T14:34:55.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd3157ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd3100c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd3157ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd31014ae00 0x7fd3100a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd3157ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd3100c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd3157ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd310163cb0 con 0x7fd3100c5c50 2023-07-27T14:34:55.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd3157ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100c2480 con 0x7fd31014ae00 2023-07-27T14:34:55.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd3157ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100c2760 con 0x7fd31014b1e0 2023-07-27T14:34:55.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd3100c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd3100c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41144/0 (socket says 172.21.15.115:41144) 2023-07-27T14:34:55.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 -- 172.21.15.115:0/198777837 learned_addr learned my addr 172.21.15.115:0/198777837 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:55.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30f7fe700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd3100c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30e7fc700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd31014ae00 0x7fd3100a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 -- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 msgr2=0x7fd3100c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd3100c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 -- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd31014ae00 msgr2=0x7fd3100a9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd31014ae00 0x7fd3100a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 -- 172.21.15.115:0/198777837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308009ae0 con 0x7fd3100c5c50 2023-07-27T14:34:55.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30e7fc700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd31014ae00 0x7fd3100a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:55.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.086+0000 7fd30effd700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd3100c1c50 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fd30000d890 tx=0x7fd300008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:55.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.087+0000 7fd2f6ffd700 1 -- 172.21.15.115:0/198777837 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000125f0 con 0x7fd3100c5c50 2023-07-27T14:34:55.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.087+0000 7fd2f6ffd700 1 -- 172.21.15.115:0/198777837 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd300012750 con 0x7fd3100c5c50 2023-07-27T14:34:55.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.087+0000 7fd2f6ffd700 1 -- 172.21.15.115:0/198777837 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300012ad0 con 0x7fd3100c5c50 2023-07-27T14:34:55.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.087+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3100c2a40 con 0x7fd3100c5c50 2023-07-27T14:34:55.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.087+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3100c2140 con 0x7fd3100c5c50 2023-07-27T14:34:55.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.088+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd310163f80 con 0x7fd3100c5c50 2023-07-27T14:34:55.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.089+0000 7fd2f6ffd700 1 -- 172.21.15.115:0/198777837 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fd300013480 con 0x7fd3100c5c50 2023-07-27T14:34:55.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.089+0000 7fd2f6ffd700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2fc05f720 0x7fd2fc061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.089+0000 7fd2f6ffd700 1 -- 172.21.15.115:0/198777837 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd30007a210 con 0x7fd3100c5c50 2023-07-27T14:34:55.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.090+0000 7fd30e7fc700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2fc05f720 0x7fd2fc061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.090+0000 7fd30e7fc700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2fc05f720 0x7fd2fc061be0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fd3100c9730 tx=0x7fd304008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:55.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.093+0000 7fd2f6ffd700 1 -- 172.21.15.115:0/198777837 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd30004b430 con 0x7fd3100c5c50 2023-07-27T14:34:55.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.265+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd31006c470 con 0x7fd3100c5c50 2023-07-27T14:34:55.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.270+0000 7fd2f6ffd700 1 -- 172.21.15.115:0/198777837 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd30004ea50 con 0x7fd3100c5c50 2023-07-27T14:34:55.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.272+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2fc05f720 msgr2=0x7fd2fc061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.272+0000 7fd3157ff700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2fc05f720 0x7fd2fc061be0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fd3100c9730 tx=0x7fd304008040).stop 2023-07-27T14:34:55.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 msgr2=0x7fd3100c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd3100c1c50 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fd30000d890 tx=0x7fd300008040).stop 2023-07-27T14:34:55.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 shutdown_connections 2023-07-27T14:34:55.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2fc05f720 0x7fd2fc061be0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd31014b1e0 0x7fd3100c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3100c5c50 0x7fd3100c1c50 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 --2- 172.21.15.115:0/198777837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd31014ae00 0x7fd3100a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 >> 172.21.15.115:0/198777837 conn(0x7fd31005e940 msgr2=0x7fd3100c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:55.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 shutdown_connections 2023-07-27T14:34:55.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.273+0000 7fd3157ff700 1 -- 172.21.15.115:0/198777837 wait complete. 2023-07-27T14:34:55.332 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:34:55.333 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:34:55.433 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:34:55.545 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:34:55.545 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:34:55.545 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:34:55.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.690+0000 7fbc9dbff700 1 Processor -- start 2023-07-27T14:34:55.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.690+0000 7fbc9dbff700 1 -- start start 2023-07-27T14:34:55.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.691+0000 7fbc9dbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbc98065ff0 0x7fbc98066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.691+0000 7fbc9dbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc98066960 0x7fbc98067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.691+0000 7fbc9dbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc98067080 con 0x7fbc98151d70 2023-07-27T14:34:55.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.691+0000 7fbc9dbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc98063a90 con 0x7fbc98066960 2023-07-27T14:34:55.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.691+0000 7fbc9dbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc98066df0 con 0x7fbc98065ff0 2023-07-27T14:34:55.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.691+0000 7fbc97fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc98066960 0x7fbc98067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc97fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc98066960 0x7fbc98067560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41156/0 (socket says 172.21.15.115:41156) 2023-07-27T14:34:55.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc97fff700 1 -- 172.21.15.115:0/3537476172 learned_addr learned my addr 172.21.15.115:0/3537476172 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:55.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc96ffd700 1 --2- 172.21.15.115:0/3537476172 >> v2:172.21.15.159:3300/0 conn(0x7fbc98065ff0 0x7fbc98066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc97fff700 1 -- 172.21.15.115:0/3537476172 >> v2:172.21.15.159:3300/0 conn(0x7fbc98065ff0 msgr2=0x7fbc98066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc97fff700 1 --2- 172.21.15.115:0/3537476172 >> v2:172.21.15.159:3300/0 conn(0x7fbc98065ff0 0x7fbc98066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc97fff700 1 -- 172.21.15.115:0/3537476172 >> v1:172.21.15.159:6789/0 conn(0x7fbc98151d70 legacy=0x7fbc98155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc97fff700 1 -- 172.21.15.115:0/3537476172 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980634d0 con 0x7fbc98066960 2023-07-27T14:34:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc97fff700 1 --2- 172.21.15.115:0/3537476172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98066960 0x7fbc98067560 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fbc980c6450 tx=0x7fbc90009840).ready entity=mon.0 client_cookie=dd79f425ed3378a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc967fc700 1 -- 172.21.15.115:0/3537476172 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9000e070 con 0x7fbc98066960 2023-07-27T14:34:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc967fc700 1 -- 172.21.15.115:0/3537476172 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9000ba50 con 0x7fbc98066960 2023-07-27T14:34:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.692+0000 7fbc967fc700 1 -- 172.21.15.115:0/3537476172 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9000bdd0 con 0x7fbc98066960 2023-07-27T14:34:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.693+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3537476172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98066960 msgr2=0x7fbc98067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.693+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3537476172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98066960 0x7fbc98067560 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fbc980c6450 tx=0x7fbc90009840).stop 2023-07-27T14:34:55.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.693+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3537476172 shutdown_connections 2023-07-27T14:34:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.693+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3537476172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98066960 0x7fbc98067560 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.693+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3537476172 >> v2:172.21.15.159:3300/0 conn(0x7fbc98065ff0 0x7fbc98066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.693+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3537476172 >> 172.21.15.115:0/3537476172 conn(0x7fbc980c89a0 msgr2=0x7fbc980c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.693+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3537476172 shutdown_connections 2023-07-27T14:34:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.693+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3537476172 wait complete. 2023-07-27T14:34:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.695+0000 7fbc9dbff700 1 Processor -- start 2023-07-27T14:34:55.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.695+0000 7fbc9dbff700 1 -- start start 2023-07-27T14:34:55.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc9dbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98065ff0 0x7fbc980c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc9dbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc98066960 0x7fbc980c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc9dbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc98151d70 0x7fbc9814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc9dbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980c4140 con 0x7fbc98065ff0 2023-07-27T14:34:55.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc9dbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980bfe20 con 0x7fbc98151d70 2023-07-27T14:34:55.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc9dbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980c0100 con 0x7fbc98066960 2023-07-27T14:34:55.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98065ff0 0x7fbc980c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98065ff0 0x7fbc980c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41166/0 (socket says 172.21.15.115:41166) 2023-07-27T14:34:55.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 -- 172.21.15.115:0/3080558459 learned_addr learned my addr 172.21.15.115:0/3080558459 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:55.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc96ffd700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc98066960 0x7fbc980c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc97fff700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc98151d70 0x7fbc9814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 -- 172.21.15.115:0/3080558459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc98066960 msgr2=0x7fbc980c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc98066960 0x7fbc980c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 -- 172.21.15.115:0/3080558459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc98151d70 msgr2=0x7fbc9814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc98151d70 0x7fbc9814ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 -- 172.21.15.115:0/3080558459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90009ae0 con 0x7fbc98065ff0 2023-07-27T14:34:55.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.696+0000 7fbc977fe700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98065ff0 0x7fbc980c4d60 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7fbc8800c4c0 tx=0x7fbc88007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:55.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.697+0000 7fbc7f7fe700 1 -- 172.21.15.115:0/3080558459 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88007020 con 0x7fbc98065ff0 2023-07-27T14:34:55.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.697+0000 7fbc7f7fe700 1 -- 172.21.15.115:0/3080558459 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc88001e90 con 0x7fbc98065ff0 2023-07-27T14:34:55.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.697+0000 7fbc7f7fe700 1 -- 172.21.15.115:0/3080558459 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc880073b0 con 0x7fbc98065ff0 2023-07-27T14:34:55.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.697+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc980c03e0 con 0x7fbc98065ff0 2023-07-27T14:34:55.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.697+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc980bfa40 con 0x7fbc98065ff0 2023-07-27T14:34:55.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.698+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc980c05d0 con 0x7fbc98065ff0 2023-07-27T14:34:55.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.699+0000 7fbc7f7fe700 1 -- 172.21.15.115:0/3080558459 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fbc88010070 con 0x7fbc98065ff0 2023-07-27T14:34:55.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.699+0000 7fbc7f7fe700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc8405f750 0x7fbc84061c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:55.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.699+0000 7fbc7f7fe700 1 -- 172.21.15.115:0/3080558459 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fbc88079f40 con 0x7fbc98065ff0 2023-07-27T14:34:55.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.700+0000 7fbc96ffd700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc8405f750 0x7fbc84061c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:55.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.700+0000 7fbc96ffd700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc8405f750 0x7fbc84061c10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fbc8c006fd0 tx=0x7fbc8c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:55.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.703+0000 7fbc7f7fe700 1 -- 172.21.15.115:0/3080558459 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc8804ae50 con 0x7fbc98065ff0 2023-07-27T14:34:55.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.918+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc9806c470 con 0x7fbc98065ff0 2023-07-27T14:34:55.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.919+0000 7fbc7f7fe700 1 -- 172.21.15.115:0/3080558459 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fbc8804e470 con 0x7fbc98065ff0 2023-07-27T14:34:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:55.962 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3206086489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3206086489},{"type":"v1","addr":"172.21.15.159:6835","nonce":3206086489}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1201288824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1201288824},{"type":"v1","addr":"172.21.15.159:6833","nonce":1201288824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7785,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3016973491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3016973491},{"type":"v1","addr":"172.21.15.115:6835","nonce":3016973491}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8172,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2412966171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2412966171},{"type":"v1","addr":"172.21.15.115:6837","nonce":2412966171}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-07-27T14:34:55.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc8405f750 msgr2=0x7fbc84061c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc8405f750 0x7fbc84061c10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fbc8c006fd0 tx=0x7fbc8c008040).stop 2023-07-27T14:34:55.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98065ff0 msgr2=0x7fbc980c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:55.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98065ff0 0x7fbc980c4d60 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7fbc8800c4c0 tx=0x7fbc88007e00).stop 2023-07-27T14:34:55.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 shutdown_connections 2023-07-27T14:34:55.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc8405f750 0x7fbc84061c10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc98151d70 0x7fbc9814ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc98065ff0 0x7fbc980c4d60 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 --2- 172.21.15.115:0/3080558459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc98066960 0x7fbc980c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:55.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 >> 172.21.15.115:0/3080558459 conn(0x7fbc980c89a0 msgr2=0x7fbc980bd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:55.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 shutdown_connections 2023-07-27T14:34:55.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:55.921+0000 7fbc9dbff700 1 -- 172.21.15.115:0/3080558459 wait complete. 2023-07-27T14:34:55.966 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 71 2023-07-27T14:34:55.981 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:34:55.981 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:34:55.982 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:34:55.982 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:34:55.982 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:34:55.982 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:34:55.983 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:34:55.983 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:34:55.983 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:34:55.983 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:34:55.983 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:34:55.984 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:34:55.984 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:34:55.984 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:34:55.984 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:34:55.985 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:34:55.996 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:34:55.996 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:34:55.998 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:34:55.998 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:34:56.000 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:34:56.000 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:34:56.001 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:34:56.001 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:34:56.040 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:34:56.041 DEBUG:teuthology.parallel:result is None 2023-07-27T14:34:56.043 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:34:56.043 DEBUG:teuthology.parallel:result is None 2023-07-27T14:34:56.045 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:34:56.045 DEBUG:teuthology.parallel:result is None 2023-07-27T14:34:56.048 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:34:56.048 DEBUG:teuthology.parallel:result is None 2023-07-27T14:34:56.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:34:56.184 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:34:56.185 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:34:56.193 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:34:56.193 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:34:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.212+0000 7fa05cfff700 1 Processor -- start 2023-07-27T14:34:56.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.212+0000 7fa05cfff700 1 -- start start 2023-07-27T14:34:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.213+0000 7fa05cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580a4840 0x7fa0580a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:56.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.213+0000 7fa05cfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa0580bc050 0x7fa0580bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.213+0000 7fa05cfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580639d0 con 0x7fa058151bd0 2023-07-27T14:34:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.213+0000 7fa05cfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa058137610 con 0x7fa0580bc050 2023-07-27T14:34:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.213+0000 7fa05cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580a51b0 con 0x7fa0580a4840 2023-07-27T14:34:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.213+0000 7fa05659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa058151bd0 0x7fa058062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54624/0 (socket says 172.21.15.115:54624) 2023-07-27T14:34:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa05659c700 1 -- 172.21.15.115:0/1658405338 learned_addr learned my addr 172.21.15.115:0/1658405338 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa056d9d700 1 --2- 172.21.15.115:0/1658405338 >> v2:172.21.15.115:3300/0 conn(0x7fa0580bc050 0x7fa0580bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:56.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa055d9b700 1 --2- 172.21.15.115:0/1658405338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580a4840 0x7fa0580a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa056d9d700 1 -- 172.21.15.115:0/1658405338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580a4840 msgr2=0x7fa0580a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa056d9d700 1 --2- 172.21.15.115:0/1658405338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580a4840 0x7fa0580a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa056d9d700 1 -- 172.21.15.115:0/1658405338 >> v1:172.21.15.115:6789/0 conn(0x7fa058151bd0 legacy=0x7fa058062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa056d9d700 1 -- 172.21.15.115:0/1658405338 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa058062dc0 con 0x7fa0580bc050 2023-07-27T14:34:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa05559a700 1 -- 172.21.15.115:0/1658405338 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884291656 0 0) 0x7fa0580639d0 con 0x7fa058151bd0 2023-07-27T14:34:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa056d9d700 1 --2- 172.21.15.115:0/1658405338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0580bc050 0x7fa0580bc4e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7fa050009e60 tx=0x7fa050009780).ready entity=mon.0 client_cookie=9349d5f05bd44ba5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.214+0000 7fa05559a700 1 -- 172.21.15.115:0/1658405338 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000e070 con 0x7fa0580bc050 2023-07-27T14:34:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05559a700 1 -- 172.21.15.115:0/1658405338 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05000bb60 con 0x7fa0580bc050 2023-07-27T14:34:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05559a700 1 -- 172.21.15.115:0/1658405338 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050012410 con 0x7fa0580bc050 2023-07-27T14:34:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05cfff700 1 -- 172.21.15.115:0/1658405338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0580bc050 msgr2=0x7fa0580bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05cfff700 1 --2- 172.21.15.115:0/1658405338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0580bc050 0x7fa0580bc4e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7fa050009e60 tx=0x7fa050009780).stop 2023-07-27T14:34:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05cfff700 1 -- 172.21.15.115:0/1658405338 shutdown_connections 2023-07-27T14:34:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05cfff700 1 --2- 172.21.15.115:0/1658405338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0580bc050 0x7fa0580bc4e0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05cfff700 1 --2- 172.21.15.115:0/1658405338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580a4840 0x7fa0580a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05cfff700 1 -- 172.21.15.115:0/1658405338 >> 172.21.15.115:0/1658405338 conn(0x7fa058064700 msgr2=0x7fa058064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05cfff700 1 -- 172.21.15.115:0/1658405338 shutdown_connections 2023-07-27T14:34:56.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.215+0000 7fa05cfff700 1 -- 172.21.15.115:0/1658405338 wait complete. 2023-07-27T14:34:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.217+0000 7fa05cfff700 1 Processor -- start 2023-07-27T14:34:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.217+0000 7fa05cfff700 1 -- start start 2023-07-27T14:34:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa05cfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580a4840 0x7fa0580c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa05cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580bc050 0x7fa0580a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa05cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa058151bd0 0x7fa0580a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa05cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580c2ac0 con 0x7fa058151bd0 2023-07-27T14:34:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa05cfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580c2da0 con 0x7fa0580a4840 2023-07-27T14:34:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa05cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580c3080 con 0x7fa0580bc050 2023-07-27T14:34:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa056d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa058151bd0 0x7fa0580a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa056d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa058151bd0 0x7fa0580a8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41216/0 (socket says 172.21.15.115:41216) 2023-07-27T14:34:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa056d9d700 1 -- 172.21.15.115:0/415322835 learned_addr learned my addr 172.21.15.115:0/415322835 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa05659c700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580a4840 0x7fa0580c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa055d9b700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580bc050 0x7fa0580a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:56.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa056d9d700 1 -- 172.21.15.115:0/415322835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580bc050 msgr2=0x7fa0580a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:56.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa056d9d700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580bc050 0x7fa0580a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:56.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa056d9d700 1 -- 172.21.15.115:0/415322835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580a4840 msgr2=0x7fa0580c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:56.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa056d9d700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580a4840 0x7fa0580c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:56.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.218+0000 7fa056d9d700 1 -- 172.21.15.115:0/415322835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009a20 con 0x7fa058151bd0 2023-07-27T14:34:56.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.219+0000 7fa056d9d700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa058151bd0 0x7fa0580a8d30 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fa05000b6c0 tx=0x7fa050009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:56.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.219+0000 7fa0467fc700 1 -- 172.21.15.115:0/415322835 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050012410 con 0x7fa058151bd0 2023-07-27T14:34:56.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.219+0000 7fa0467fc700 1 -- 172.21.15.115:0/415322835 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05001d630 con 0x7fa058151bd0 2023-07-27T14:34:56.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.219+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0580c3360 con 0x7fa058151bd0 2023-07-27T14:34:56.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.219+0000 7fa0467fc700 1 -- 172.21.15.115:0/415322835 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05001d9f0 con 0x7fa058151bd0 2023-07-27T14:34:56.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.219+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa058163770 con 0x7fa058151bd0 2023-07-27T14:34:56.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.220+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0580be820 con 0x7fa058151bd0 2023-07-27T14:34:56.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.221+0000 7fa0467fc700 1 -- 172.21.15.115:0/415322835 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fa05001dd60 con 0x7fa058151bd0 2023-07-27T14:34:56.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.222+0000 7fa0467fc700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa03805f720 0x7fa038061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:56.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.222+0000 7fa0467fc700 1 -- 172.21.15.115:0/415322835 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fa05007c480 con 0x7fa058151bd0 2023-07-27T14:34:56.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.222+0000 7fa05659c700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa03805f720 0x7fa038061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:56.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.222+0000 7fa05659c700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa03805f720 0x7fa038061be0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fa0580668c0 tx=0x7fa048007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:56.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.226+0000 7fa0467fc700 1 -- 172.21.15.115:0/415322835 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa0500510a0 con 0x7fa058151bd0 2023-07-27T14:34:56.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:56.410+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa058062750 con 0x7fa058151bd0 2023-07-27T14:34:57.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.274+0000 7fa0467fc700 1 -- 172.21.15.115:0/415322835 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v138) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa05007ae60 con 0x7fa058151bd0 2023-07-27T14:34:57.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa03805f720 msgr2=0x7fa038061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:57.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa03805f720 0x7fa038061be0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fa0580668c0 tx=0x7fa048007bb0).stop 2023-07-27T14:34:57.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa058151bd0 msgr2=0x7fa0580a8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:57.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa058151bd0 0x7fa0580a8d30 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fa05000b6c0 tx=0x7fa050009780).stop 2023-07-27T14:34:57.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 shutdown_connections 2023-07-27T14:34:57.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa03805f720 0x7fa038061be0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa058151bd0 0x7fa0580a8d30 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0580a4840 0x7fa0580c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 --2- 172.21.15.115:0/415322835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0580bc050 0x7fa0580a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.277+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 >> 172.21.15.115:0/415322835 conn(0x7fa058064700 msgr2=0x7fa058159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:57.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.278+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 shutdown_connections 2023-07-27T14:34:57.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.278+0000 7fa05cfff700 1 -- 172.21.15.115:0/415322835 wait complete. 2023-07-27T14:34:57.322 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:34:57.340 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:34:57.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.488+0000 7f62d0dff700 1 Processor -- start 2023-07-27T14:34:57.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.488+0000 7f62d0dff700 1 -- start start 2023-07-27T14:34:57.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62d0dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc153ec0 0x7f62cc0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:57.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62d0dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f62cc0aa050 0x7f62cc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:57.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62d0dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc0aa4d0 con 0x7f62cc0aaa40 2023-07-27T14:34:57.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62d0dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62cc0c05c0 con 0x7f62cc0aa050 2023-07-27T14:34:57.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62d0dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc0c1a60 con 0x7f62cc153ec0 2023-07-27T14:34:57.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62cad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f62cc0aaa40 0x7f62cc157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54640/0 (socket says 172.21.15.115:54640) 2023-07-27T14:34:57.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62cad9d700 1 -- 172.21.15.115:0/2864418471 learned_addr learned my addr 172.21.15.115:0/2864418471 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:57.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62ca59c700 1 --2- 172.21.15.115:0/2864418471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc153ec0 0x7f62cc0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:57.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62c9d9b700 1 --2- 172.21.15.115:0/2864418471 >> v2:172.21.15.159:3300/0 conn(0x7f62cc0aa050 0x7f62cc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:57.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.490+0000 7f62c959a700 1 -- 172.21.15.115:0/2864418471 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778922445 0 0) 0x7f62c4001490 con 0x7f62cc0aaa40 2023-07-27T14:34:57.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62c959a700 1 -- 172.21.15.115:0/2864418471 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b40033f0 con 0x7f62cc0aaa40 2023-07-27T14:34:57.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62ca59c700 1 -- 172.21.15.115:0/2864418471 >> v2:172.21.15.159:3300/0 conn(0x7f62cc0aa050 msgr2=0x7f62cc0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:57.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62ca59c700 1 --2- 172.21.15.115:0/2864418471 >> v2:172.21.15.159:3300/0 conn(0x7f62cc0aa050 0x7f62cc0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62ca59c700 1 -- 172.21.15.115:0/2864418471 >> v1:172.21.15.115:6789/0 conn(0x7f62cc0aaa40 legacy=0x7f62cc157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:57.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62ca59c700 1 -- 172.21.15.115:0/2864418471 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc0bfc90 con 0x7f62cc153ec0 2023-07-27T14:34:57.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62ca59c700 1 --2- 172.21.15.115:0/2864418471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc153ec0 0x7f62cc0a9b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f62bc009760 tx=0x7f62bc009060).ready entity=mon.2 client_cookie=788ffe5b88ca1cdc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:57.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62c959a700 1 -- 172.21.15.115:0/2864418471 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00d4a0 con 0x7f62cc153ec0 2023-07-27T14:34:57.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62c959a700 1 -- 172.21.15.115:0/2864418471 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00d600 con 0x7f62cc153ec0 2023-07-27T14:34:57.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.491+0000 7f62c959a700 1 -- 172.21.15.115:0/2864418471 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00d980 con 0x7f62cc153ec0 2023-07-27T14:34:57.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.492+0000 7f62d0dff700 1 -- 172.21.15.115:0/2864418471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc153ec0 msgr2=0x7f62cc0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:57.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.492+0000 7f62d0dff700 1 --2- 172.21.15.115:0/2864418471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc153ec0 0x7f62cc0a9b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f62bc009760 tx=0x7f62bc009060).stop 2023-07-27T14:34:57.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.492+0000 7f62d0dff700 1 -- 172.21.15.115:0/2864418471 shutdown_connections 2023-07-27T14:34:57.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.492+0000 7f62d0dff700 1 --2- 172.21.15.115:0/2864418471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc153ec0 0x7f62cc0a9b60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.492+0000 7f62d0dff700 1 --2- 172.21.15.115:0/2864418471 >> v2:172.21.15.159:3300/0 conn(0x7f62cc0aa050 0x7f62cc0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.492+0000 7f62d0dff700 1 -- 172.21.15.115:0/2864418471 >> 172.21.15.115:0/2864418471 conn(0x7f62cc0cb610 msgr2=0x7f62cc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:57.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.492+0000 7f62d0dff700 1 -- 172.21.15.115:0/2864418471 shutdown_connections 2023-07-27T14:34:57.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.492+0000 7f62d0dff700 1 -- 172.21.15.115:0/2864418471 wait complete. 2023-07-27T14:34:57.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.493+0000 7f62d0dff700 1 Processor -- start 2023-07-27T14:34:57.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.493+0000 7f62d0dff700 1 -- start start 2023-07-27T14:34:57.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.494+0000 7f62d0dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62cc0aa050 0x7f62cc164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:57.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.494+0000 7f62d0dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc0aaa40 0x7f62cc1684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:57.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.494+0000 7f62d0dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc153ec0 0x7f62cc1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:57.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.494+0000 7f62d0dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc0c3840 con 0x7f62cc0aa050 2023-07-27T14:34:57.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.494+0000 7f62d0dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc151760 con 0x7f62cc153ec0 2023-07-27T14:34:57.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.494+0000 7f62d0dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc0c2f10 con 0x7f62cc0aaa40 2023-07-27T14:34:57.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62cc0aa050 0x7f62cc164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:57.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62cc0aa050 0x7f62cc164870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41224/0 (socket says 172.21.15.115:41224) 2023-07-27T14:34:57.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 -- 172.21.15.115:0/3989356961 learned_addr learned my addr 172.21.15.115:0/3989356961 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:57.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62cad9d700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc153ec0 0x7f62cc1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:57.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62c9d9b700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc0aaa40 0x7f62cc1684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:57.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 -- 172.21.15.115:0/3989356961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc0aaa40 msgr2=0x7f62cc1684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:57.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc0aaa40 0x7f62cc1684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 -- 172.21.15.115:0/3989356961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc153ec0 msgr2=0x7f62cc1689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:57.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc153ec0 0x7f62cc1689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 -- 172.21.15.115:0/3989356961 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0092a0 con 0x7f62cc0aa050 2023-07-27T14:34:57.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ca59c700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62cc0aa050 0x7f62cc164870 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f62bc009d50 tx=0x7f62bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:57.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ba7fc700 1 -- 172.21.15.115:0/3989356961 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc000c90 con 0x7f62cc0aa050 2023-07-27T14:34:57.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ba7fc700 1 -- 172.21.15.115:0/3989356961 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00d770 con 0x7f62cc0aa050 2023-07-27T14:34:57.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62ba7fc700 1 -- 172.21.15.115:0/3989356961 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc01d430 con 0x7f62cc0aa050 2023-07-27T14:34:57.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.495+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc0c31f0 con 0x7f62cc0aa050 2023-07-27T14:34:57.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.496+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc0af060 con 0x7f62cc0aa050 2023-07-27T14:34:57.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.497+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62cc06c470 con 0x7f62cc0aa050 2023-07-27T14:34:57.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.497+0000 7f62ba7fc700 1 -- 172.21.15.115:0/3989356961 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f62bc00f070 con 0x7f62cc0aa050 2023-07-27T14:34:57.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.498+0000 7f62ba7fc700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ac05f6f0 0x7f62ac061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:57.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.498+0000 7f62ba7fc700 1 -- 172.21.15.115:0/3989356961 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f62bc07be60 con 0x7f62cc0aa050 2023-07-27T14:34:57.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.499+0000 7f62c9d9b700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ac05f6f0 0x7f62ac061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:57.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.499+0000 7f62c9d9b700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ac05f6f0 0x7f62ac061bb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f62cc0abf70 tx=0x7f62c0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:57.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.503+0000 7f62ba7fc700 1 -- 172.21.15.115:0/3989356961 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f62bc04ccb0 con 0x7f62cc0aa050 2023-07-27T14:34:57.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.736+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f62cc0bff70 con 0x7f62cc0aa050 2023-07-27T14:34:57.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.736+0000 7f62ba7fc700 1 -- 172.21.15.115:0/3989356961 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f62bc0502d0 con 0x7f62cc0aa050 2023-07-27T14:34:57.779 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:57.779 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:34:57.780 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:34:57.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.780 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:34:57.780 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:34:57.780 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.780 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:34:57.781 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:34:57.781 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:34:57.781 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.781 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.781 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:34:57.782 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:34:57.782 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.782 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:34:57.782 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:34:57.782 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:34:57.782 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.783 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:34:57.783 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:34:57.783 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.783 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:34:57.783 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:34:57.783 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:34:57.784 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.784 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.784 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:34:57.784 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:34:57.784 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.785 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:34:57.785 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:34:57.785 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:34:57.785 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.786 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:34:57.786 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:34:57.786 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.786 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:34:57.786 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:34:57.786 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.787 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:34:57.787 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:34:57.787 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.787 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:34:57.787 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:34:57.788 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.788 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.788 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:34:57.788 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:34:57.788 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.789 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:34:57.789 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:34:57.789 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.789 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:34:57.789 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:34:57.790 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.790 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:34:57.790 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:34:57.790 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.791 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:34:57.791 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:34:57.791 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.791 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:34:57.791 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:34:57.791 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.792 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:34:57.792 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:34:57.792 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.792 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:34:57.792 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:34:57.793 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.793 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.793 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:34:57.793 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:34:57.794 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.794 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:34:57.794 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:34:57.794 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.794 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:34:57.795 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:34:57.795 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.795 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:34:57.795 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:34:57.795 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.796 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:34:57.796 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:34:57.796 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.796 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:34:57.796 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:34:57.796 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:34:57.797 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.797 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:34:57.797 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:34:57.797 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.797 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:34:57.798 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:34:57.798 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:34:57.798 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:34:57.798 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.798 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:34:57.799 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:34:57.799 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.799 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:34:57.799 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:34:57.799 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:34:57.799 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:34:57.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:34:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:34:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:34:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:34:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:34:57.801 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:34:57.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.801 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:34:57.801 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:34:57.801 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.802 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:34:57.802 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:34:57.802 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:34:57.802 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.802 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.803 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:34:57.803 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:34:57.803 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.803 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:34:57.803 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:34:57.803 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.803 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:57.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:57.804 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:34:57.804 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:34:57.804 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:34:57.804 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:34:57.804 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:34:57.804 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:34:57.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:57.805 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:34:57.805 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:34:57.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ac05f6f0 msgr2=0x7f62ac061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:57.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ac05f6f0 0x7f62ac061bb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f62cc0abf70 tx=0x7f62c0008040).stop 2023-07-27T14:34:57.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62cc0aa050 msgr2=0x7f62cc164870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:57.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62cc0aa050 0x7f62cc164870 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f62bc009d50 tx=0x7f62bc016000).stop 2023-07-27T14:34:57.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 shutdown_connections 2023-07-27T14:34:57.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62ac05f6f0 0x7f62ac061bb0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62cc153ec0 0x7f62cc1689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62cc0aa050 0x7f62cc164870 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 --2- 172.21.15.115:0/3989356961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62cc0aaa40 0x7f62cc1684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:57.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 >> 172.21.15.115:0/3989356961 conn(0x7f62cc0cb610 msgr2=0x7f62cc0acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:57.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 shutdown_connections 2023-07-27T14:34:57.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.738+0000 7f62d0dff700 1 -- 172.21.15.115:0/3989356961 wait complete. 2023-07-27T14:34:57.809 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:34:58.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.961+0000 7f74df5ff700 1 Processor -- start 2023-07-27T14:34:58.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.961+0000 7f74df5ff700 1 -- start start 2023-07-27T14:34:58.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.962+0000 7f74df5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d8155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.962+0000 7f74df5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74d8065ff0 0x7f74d8066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.962+0000 7f74df5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d8067080 con 0x7f74d8066960 2023-07-27T14:34:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.962+0000 7f74df5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d8063a90 con 0x7f74d8065ff0 2023-07-27T14:34:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.962+0000 7f74df5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8068570 con 0x7f74d8151d70 2023-07-27T14:34:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dcb9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74d8065ff0 0x7f74d8066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dcb9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74d8065ff0 0x7f74d8066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41230/0 (socket says 172.21.15.115:41230) 2023-07-27T14:34:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dcb9a700 1 -- 172.21.15.115:0/3538530218 learned_addr learned my addr 172.21.15.115:0/3538530218 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:58.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74ddb9c700 1 --1- 172.21.15.115:0/3538530218 >> v1:172.21.15.115:6789/0 conn(0x7f74d8066960 0x7f74d8157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54644/0 (socket says 172.21.15.115:54644) 2023-07-27T14:34:58.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dd39b700 1 --2- 172.21.15.115:0/3538530218 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dcb9a700 1 -- 172.21.15.115:0/3538530218 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 msgr2=0x7f74d8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:58.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dcb9a700 1 --2- 172.21.15.115:0/3538530218 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d8155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dcb9a700 1 -- 172.21.15.115:0/3538530218 >> v1:172.21.15.115:6789/0 conn(0x7f74d8066960 legacy=0x7f74d8157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dcb9a700 1 -- 172.21.15.115:0/3538530218 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8066e10 con 0x7f74d8065ff0 2023-07-27T14:34:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dd39b700 1 --2- 172.21.15.115:0/3538530218 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74dcb9a700 1 --2- 172.21.15.115:0/3538530218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8065ff0 0x7f74d8066470 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f74c8006fd0 tx=0x7f74c80090f0).ready entity=mon.0 client_cookie=fb02b220eff23426 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74cffff700 1 -- 172.21.15.115:0/3538530218 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800b600 con 0x7f74d8065ff0 2023-07-27T14:34:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74cffff700 1 -- 172.21.15.115:0/3538530218 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c800b760 con 0x7f74d8065ff0 2023-07-27T14:34:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.963+0000 7f74cffff700 1 -- 172.21.15.115:0/3538530218 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800bae0 con 0x7f74d8065ff0 2023-07-27T14:34:58.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.964+0000 7f74df5ff700 1 -- 172.21.15.115:0/3538530218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8065ff0 msgr2=0x7f74d8066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.964+0000 7f74df5ff700 1 --2- 172.21.15.115:0/3538530218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8065ff0 0x7f74d8066470 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f74c8006fd0 tx=0x7f74c80090f0).stop 2023-07-27T14:34:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.964+0000 7f74df5ff700 1 -- 172.21.15.115:0/3538530218 shutdown_connections 2023-07-27T14:34:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.964+0000 7f74df5ff700 1 --2- 172.21.15.115:0/3538530218 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.964+0000 7f74df5ff700 1 --2- 172.21.15.115:0/3538530218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8065ff0 0x7f74d8066470 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.964+0000 7f74df5ff700 1 -- 172.21.15.115:0/3538530218 >> 172.21.15.115:0/3538530218 conn(0x7f74d80c89a0 msgr2=0x7f74d80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.964+0000 7f74df5ff700 1 -- 172.21.15.115:0/3538530218 shutdown_connections 2023-07-27T14:34:58.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.964+0000 7f74df5ff700 1 -- 172.21.15.115:0/3538530218 wait complete. 2023-07-27T14:34:58.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.965+0000 7f74df5ff700 1 Processor -- start 2023-07-27T14:34:58.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.966+0000 7f74df5ff700 1 -- start start 2023-07-27T14:34:58.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.966+0000 7f74df5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74d8065ff0 0x7f74d80c0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.966+0000 7f74df5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8066960 0x7f74d8164c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74df5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d80ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74df5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80c0940 con 0x7f74d8066960 2023-07-27T14:34:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74df5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80a92c0 con 0x7f74d8065ff0 2023-07-27T14:34:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74df5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80a9880 con 0x7f74d8151d70 2023-07-27T14:34:58.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8066960 0x7f74d8164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8066960 0x7f74d8164c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41240/0 (socket says 172.21.15.115:41240) 2023-07-27T14:34:58.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 -- 172.21.15.115:0/2581136192 learned_addr learned my addr 172.21.15.115:0/2581136192 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:58.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dd39b700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74d8065ff0 0x7f74d80c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74ddb9c700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d80ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 -- 172.21.15.115:0/2581136192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 msgr2=0x7f74d80ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d80ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 -- 172.21.15.115:0/2581136192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74d8065ff0 msgr2=0x7f74d80c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74d8065ff0 0x7f74d80c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 -- 172.21.15.115:0/2581136192 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8009370 con 0x7f74d8066960 2023-07-27T14:34:58.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.967+0000 7f74dcb9a700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8066960 0x7f74d8164c60 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f74c8011000 tx=0x7f74c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.968+0000 7f74cd7fa700 1 -- 172.21.15.115:0/2581136192 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800b8d0 con 0x7f74d8066960 2023-07-27T14:34:58.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.968+0000 7f74cd7fa700 1 -- 172.21.15.115:0/2581136192 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c800ba30 con 0x7f74d8066960 2023-07-27T14:34:58.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.968+0000 7f74cd7fa700 1 -- 172.21.15.115:0/2581136192 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8023670 con 0x7f74d8066960 2023-07-27T14:34:58.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.968+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d8165150 con 0x7f74d8066960 2023-07-27T14:34:58.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.968+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d80a7560 con 0x7f74d8066960 2023-07-27T14:34:58.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.969+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d806c470 con 0x7f74d8066960 2023-07-27T14:34:58.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.970+0000 7f74cd7fa700 1 -- 172.21.15.115:0/2581136192 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f74c800f070 con 0x7f74d8066960 2023-07-27T14:34:58.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.971+0000 7f74cd7fa700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74bc05f6f0 0x7f74bc061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.971+0000 7f74cd7fa700 1 -- 172.21.15.115:0/2581136192 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f74c807c380 con 0x7f74d8066960 2023-07-27T14:34:58.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.971+0000 7f74dd39b700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74bc05f6f0 0x7f74bc061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.971+0000 7f74dd39b700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74bc05f6f0 0x7f74bc061bb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f74d80aafc0 tx=0x7f74d4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:57.975+0000 7f74cd7fa700 1 -- 172.21.15.115:0/2581136192 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74c8050c00 con 0x7f74d8066960 2023-07-27T14:34:58.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.143+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74d80ae280 con 0x7f74d8066960 2023-07-27T14:34:58.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.144+0000 7f74cd7fa700 1 -- 172.21.15.115:0/2581136192 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+13866 (secure 0 0 0) 0x7f74c80507f0 con 0x7f74d8066960 2023-07-27T14:34:58.187 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:58.187 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":138,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:34:57.270280+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:34:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.146+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74bc05f6f0 msgr2=0x7f74bc061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.146+0000 7f74df5ff700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74bc05f6f0 0x7f74bc061bb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f74d80aafc0 tx=0x7f74d4008040).stop 2023-07-27T14:34:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.146+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8066960 msgr2=0x7f74d8164c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.146+0000 7f74df5ff700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8066960 0x7f74d8164c60 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f74c8011000 tx=0x7f74c8017000).stop 2023-07-27T14:34:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.147+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 shutdown_connections 2023-07-27T14:34:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.147+0000 7f74df5ff700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f74bc05f6f0 0x7f74bc061bb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.147+0000 7f74df5ff700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74d8151d70 0x7f74d80ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.147+0000 7f74df5ff700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74d8065ff0 0x7f74d80c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.147+0000 7f74df5ff700 1 --2- 172.21.15.115:0/2581136192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74d8066960 0x7f74d8164c60 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.147+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 >> 172.21.15.115:0/2581136192 conn(0x7f74d80c89a0 msgr2=0x7f74d8152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.147+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 shutdown_connections 2023-07-27T14:34:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.147+0000 7f74df5ff700 1 -- 172.21.15.115:0/2581136192 wait complete. 2023-07-27T14:34:58.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:34:58.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:34:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.356+0000 7f00181ff700 1 Processor -- start 2023-07-27T14:34:58.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.357+0000 7f00181ff700 1 -- start start 2023-07-27T14:34:58.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f00181ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010153e00 0x7f00100c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f00181ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0010065de0 0x7f0010062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f00181ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0010064a80 con 0x7f0010064230 2023-07-27T14:34:58.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f00181ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0010062320 con 0x7f0010065de0 2023-07-27T14:34:58.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f00181ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0010064d60 con 0x7f0010153e00 2023-07-27T14:34:58.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f001579a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0010064230 0x7f00100656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54654/0 (socket says 172.21.15.115:54654) 2023-07-27T14:34:58.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f001579a700 1 -- 172.21.15.115:0/3138759423 learned_addr learned my addr 172.21.15.115:0/3138759423 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f001679c700 1 --2- 172.21.15.115:0/3138759423 >> v2:172.21.15.159:3300/0 conn(0x7f0010065de0 0x7f0010062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.358+0000 7f0015f9b700 1 --2- 172.21.15.115:0/3138759423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010153e00 0x7f00100c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f0014f99700 1 -- 172.21.15.115:0/3138759423 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917124543 0 0) 0x7f0010064a80 con 0x7f0010064230 2023-07-27T14:34:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f0014f99700 1 -- 172.21.15.115:0/3138759423 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efffc0033f0 con 0x7f0010064230 2023-07-27T14:34:58.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f001679c700 1 -- 172.21.15.115:0/3138759423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010153e00 msgr2=0x7f00100c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f001679c700 1 --2- 172.21.15.115:0/3138759423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010153e00 0x7f00100c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f001679c700 1 -- 172.21.15.115:0/3138759423 >> v1:172.21.15.115:6789/0 conn(0x7f0010064230 legacy=0x7f00100656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f001679c700 1 -- 172.21.15.115:0/3138759423 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010065040 con 0x7f0010065de0 2023-07-27T14:34:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f001679c700 1 --2- 172.21.15.115:0/3138759423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010065de0 0x7f0010062770 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f0008009e60 tx=0x7f0008009780).ready entity=mon.1 client_cookie=6125ad8cdcb4bc01 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f0014f99700 1 -- 172.21.15.115:0/3138759423 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800e070 con 0x7f0010065de0 2023-07-27T14:34:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f0014f99700 1 -- 172.21.15.115:0/3138759423 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000800bab0 con 0x7f0010065de0 2023-07-27T14:34:58.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.359+0000 7f0014f99700 1 -- 172.21.15.115:0/3138759423 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800be30 con 0x7f0010065de0 2023-07-27T14:34:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.360+0000 7f00181ff700 1 -- 172.21.15.115:0/3138759423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010065de0 msgr2=0x7f0010062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.360+0000 7f00181ff700 1 --2- 172.21.15.115:0/3138759423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010065de0 0x7f0010062770 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f0008009e60 tx=0x7f0008009780).stop 2023-07-27T14:34:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.360+0000 7f00181ff700 1 -- 172.21.15.115:0/3138759423 shutdown_connections 2023-07-27T14:34:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.360+0000 7f00181ff700 1 --2- 172.21.15.115:0/3138759423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010065de0 0x7f0010062770 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.360+0000 7f00181ff700 1 --2- 172.21.15.115:0/3138759423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010153e00 0x7f00100c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.360+0000 7f00181ff700 1 -- 172.21.15.115:0/3138759423 >> 172.21.15.115:0/3138759423 conn(0x7f00100c7b90 msgr2=0x7f00100c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:58.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.360+0000 7f00181ff700 1 -- 172.21.15.115:0/3138759423 shutdown_connections 2023-07-27T14:34:58.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.360+0000 7f00181ff700 1 -- 172.21.15.115:0/3138759423 wait complete. 2023-07-27T14:34:58.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.362+0000 7f00181ff700 1 Processor -- start 2023-07-27T14:34:58.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.362+0000 7f00181ff700 1 -- start start 2023-07-27T14:34:58.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f00181ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0010064230 0x7f0010151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f00181ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010065de0 0x7f00100a7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f00181ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010153e00 0x7f0010069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f00181ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00101649a0 con 0x7f0010064230 2023-07-27T14:34:58.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f00181ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100a73e0 con 0x7f0010153e00 2023-07-27T14:34:58.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f00181ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00101646c0 con 0x7f0010065de0 2023-07-27T14:34:58.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0010064230 0x7f0010151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0010064230 0x7f0010151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41252/0 (socket says 172.21.15.115:41252) 2023-07-27T14:34:58.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 -- 172.21.15.115:0/3907076629 learned_addr learned my addr 172.21.15.115:0/3907076629 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:58.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f001679c700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010153e00 0x7f0010069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f001579a700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010065de0 0x7f00100a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 -- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010065de0 msgr2=0x7f00100a7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010065de0 0x7f00100a7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 -- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010153e00 msgr2=0x7f0010069590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010153e00 0x7f0010069590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 -- 172.21.15.115:0/3907076629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008009a20 con 0x7f0010064230 2023-07-27T14:34:58.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f001679c700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010153e00 0x7f0010069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:58.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.363+0000 7f0015f9b700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0010064230 0x7f0010151d70 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f000c00e900 tx=0x7f000c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.364+0000 7f0005ffb700 1 -- 172.21.15.115:0/3907076629 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c00c640 con 0x7f0010064230 2023-07-27T14:34:58.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.364+0000 7f0005ffb700 1 -- 172.21.15.115:0/3907076629 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c00c7a0 con 0x7f0010064230 2023-07-27T14:34:58.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.364+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00100a6d90 con 0x7f0010064230 2023-07-27T14:34:58.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.364+0000 7f0005ffb700 1 -- 172.21.15.115:0/3907076629 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c00cb20 con 0x7f0010064230 2023-07-27T14:34:58.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.364+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0010069a80 con 0x7f0010064230 2023-07-27T14:34:58.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.365+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00100a6bf0 con 0x7f0010064230 2023-07-27T14:34:58.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.366+0000 7f0005ffb700 1 -- 172.21.15.115:0/3907076629 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f000c022070 con 0x7f0010064230 2023-07-27T14:34:58.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.367+0000 7f0005ffb700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efff405f720 0x7efff4061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.367+0000 7f0005ffb700 1 -- 172.21.15.115:0/3907076629 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f000c07aa40 con 0x7f0010064230 2023-07-27T14:34:58.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.367+0000 7f001579a700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efff405f720 0x7efff4061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.368+0000 7f001579a700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efff405f720 0x7efff4061be0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f00101538b0 tx=0x7f0000009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.371+0000 7f0005ffb700 1 -- 172.21.15.115:0/3907076629 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f00100a6bf0 con 0x7f0010064230 2023-07-27T14:34:58.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.538+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f00100a6bf0 con 0x7f0010064230 2023-07-27T14:34:58.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.538+0000 7f0005ffb700 1 -- 172.21.15.115:0/3907076629 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v138) v1 ==== 110+0+10 (secure 0 0 0) 0x7f00100a6bf0 con 0x7f0010064230 2023-07-27T14:34:58.581 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:34:58.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.540+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efff405f720 msgr2=0x7efff4061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.540+0000 7f00181ff700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efff405f720 0x7efff4061be0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f00101538b0 tx=0x7f0000009040).stop 2023-07-27T14:34:58.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.540+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0010064230 msgr2=0x7f0010151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.540+0000 7f00181ff700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0010064230 0x7f0010151d70 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f000c00e900 tx=0x7f000c009060).stop 2023-07-27T14:34:58.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.541+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 shutdown_connections 2023-07-27T14:34:58.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.541+0000 7f00181ff700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efff405f720 0x7efff4061be0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.541+0000 7f00181ff700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0010153e00 0x7f0010069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.541+0000 7f00181ff700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0010064230 0x7f0010151d70 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.541+0000 7f00181ff700 1 --2- 172.21.15.115:0/3907076629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0010065de0 0x7f00100a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.541+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 >> 172.21.15.115:0/3907076629 conn(0x7f00100c7b90 msgr2=0x7f00100bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:58.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.541+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 shutdown_connections 2023-07-27T14:34:58.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.541+0000 7f00181ff700 1 -- 172.21.15.115:0/3907076629 wait complete. 2023-07-27T14:34:58.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:34:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.748+0000 7f26a5fff700 1 Processor -- start 2023-07-27T14:34:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.748+0000 7f26a5fff700 1 -- start start 2023-07-27T14:34:58.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f26a5fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f26a0063260 0x7f26a0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f26a5fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a01553f0 con 0x7f26a014b1e0 2023-07-27T14:34:58.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f26a5fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a0157a50 con 0x7f26a014ae00 2023-07-27T14:34:58.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f26a5fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a0157d10 con 0x7f26a0063260 2023-07-27T14:34:58.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f269ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f26a014b1e0 0x7f26a00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54670/0 (socket says 172.21.15.115:54670) 2023-07-27T14:34:58.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f269ffff700 1 -- 172.21.15.115:0/2866413590 learned_addr learned my addr 172.21.15.115:0/2866413590 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:58.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f269effd700 1 --2- 172.21.15.115:0/2866413590 >> v2:172.21.15.159:3300/0 conn(0x7f26a0063260 0x7f26a0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486136296 0 0) 0x7f26a01553f0 con 0x7f26a014b1e0 2023-07-27T14:34:58.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.750+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26880033f0 con 0x7f26a014b1e0 2023-07-27T14:34:58.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394934511 0 0) 0x7f26880033f0 con 0x7f26a014b1e0 2023-07-27T14:34:58.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 >> v2:172.21.15.159:3300/0 conn(0x7f26a0063260 msgr2=0x7f26a0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:58.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 --2- 172.21.15.115:0/2866413590 >> v2:172.21.15.159:3300/0 conn(0x7f26a0063260 0x7f26a0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 >> v1:172.21.15.159:6789/0 conn(0x7f26a014ae00 legacy=0x7f26a0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0157ff0 con 0x7f26a014b1e0 2023-07-27T14:34:58.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f26980017f0 con 0x7f26a014b1e0 2023-07-27T14:34:58.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 >> v1:172.21.15.115:6789/0 conn(0x7f26a014b1e0 legacy=0x7f26a00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f2688003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004690 0x7f2688004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2688005000 0x7f268800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a0157d10 con 0x7f26880038e0 2023-07-27T14:34:58.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268800beb0 con 0x7f2688004690 2023-07-27T14:34:58.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268800c070 con 0x7f2688005000 2023-07-27T14:34:58.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269f7fe700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f2688003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269effd700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004690 0x7f2688004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.751+0000 7f269ffff700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2688005000 0x7f268800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269f7fe700 1 -- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2688005000 msgr2=0x7f268800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:58.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269f7fe700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2688005000 0x7f268800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269f7fe700 1 -- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004690 msgr2=0x7f2688004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:58.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269f7fe700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004690 0x7f2688004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269f7fe700 1 -- 172.21.15.115:0/2866413590 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880033f0 con 0x7f26880038e0 2023-07-27T14:34:58.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269ffff700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2688005000 0x7f268800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:34:58.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269effd700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2688004690 0x7f2688004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:34:58.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269ffff700 1 -- 172.21.15.115:0/2866413590 reap_dead start 2023-07-27T14:34:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269f7fe700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f2688003cc0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f2690001820 tx=0x7f2690007b90).ready entity=mon.0 client_cookie=d6fb1c08a3f3294 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690007ea0 con 0x7f26880038e0 2023-07-27T14:34:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690012400 con 0x7f26880038e0 2023-07-27T14:34:58.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f269e7fc700 1 -- 172.21.15.115:0/2866413590 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26900127a0 con 0x7f26880038e0 2023-07-27T14:34:58.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f26a5fff700 1 -- 172.21.15.115:0/2866413590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 msgr2=0x7f2688003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.752+0000 7f26a5fff700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f2688003cc0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f2690001820 tx=0x7f2690007b90).stop 2023-07-27T14:34:58.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.753+0000 7f26a5fff700 1 -- 172.21.15.115:0/2866413590 shutdown_connections 2023-07-27T14:34:58.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.753+0000 7f26a5fff700 1 --2- 172.21.15.115:0/2866413590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f2688003cc0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.753+0000 7f26a5fff700 1 -- 172.21.15.115:0/2866413590 >> 172.21.15.115:0/2866413590 conn(0x7f26a005e940 msgr2=0x7f26a00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.753+0000 7f26a5fff700 1 -- 172.21.15.115:0/2866413590 shutdown_connections 2023-07-27T14:34:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.753+0000 7f26a5fff700 1 -- 172.21.15.115:0/2866413590 wait complete. 2023-07-27T14:34:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.754+0000 7f26a5fff700 1 Processor -- start 2023-07-27T14:34:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.754+0000 7f26a5fff700 1 -- start start 2023-07-27T14:34:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f26a5fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f26a00abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f26a5fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a014a050 0x7f26a00ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f26a5fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0167530 0x7f26a01679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f26a5fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00ac790 con 0x7f26880038e0 2023-07-27T14:34:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f26a5fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a0163b70 con 0x7f26a0167530 2023-07-27T14:34:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f26a5fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a0163d80 con 0x7f26a014a050 2023-07-27T14:34:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f269f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f26a00abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f269f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f26a00abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41272/0 (socket says 172.21.15.115:41272) 2023-07-27T14:34:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.755+0000 7f269f7fe700 1 -- 172.21.15.115:0/1465743370 learned_addr learned my addr 172.21.15.115:0/1465743370 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f269effd700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a014a050 0x7f26a00ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f269ffff700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0167530 0x7f26a01679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f269f7fe700 1 -- 172.21.15.115:0/1465743370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a014a050 msgr2=0x7f26a00ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f269f7fe700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a014a050 0x7f26a00ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f269f7fe700 1 -- 172.21.15.115:0/1465743370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0167530 msgr2=0x7f26a01679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f269f7fe700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0167530 0x7f26a01679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f269f7fe700 1 -- 172.21.15.115:0/1465743370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0164060 con 0x7f26880038e0 2023-07-27T14:34:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f269f7fe700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f26a00abdb0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f2690001e10 tx=0x7f2690016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f26877fe700 1 -- 172.21.15.115:0/1465743370 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690007ea0 con 0x7f26880038e0 2023-07-27T14:34:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f26877fe700 1 -- 172.21.15.115:0/1465743370 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690011790 con 0x7f26880038e0 2023-07-27T14:34:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a0164340 con 0x7f26880038e0 2023-07-27T14:34:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f26877fe700 1 -- 172.21.15.115:0/1465743370 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690011b10 con 0x7f26880038e0 2023-07-27T14:34:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.756+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a0167ea0 con 0x7f26880038e0 2023-07-27T14:34:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.757+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a00c1940 con 0x7f26880038e0 2023-07-27T14:34:58.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.758+0000 7f26877fe700 1 -- 172.21.15.115:0/1465743370 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f269001b040 con 0x7f26880038e0 2023-07-27T14:34:58.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.759+0000 7f26877fe700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268c05f750 0x7f268c061c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:58.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.760+0000 7f26877fe700 1 -- 172.21.15.115:0/1465743370 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f269007afe0 con 0x7f26880038e0 2023-07-27T14:34:58.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.760+0000 7f269effd700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268c05f750 0x7f268c061c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:58.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.760+0000 7f269effd700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268c05f750 0x7f268c061c10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f26a0155150 tx=0x7f2694009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:58.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.764+0000 7f26877fe700 1 -- 172.21.15.115:0/1465743370 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f269004c1a0 con 0x7f26880038e0 2023-07-27T14:34:58.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.934+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f26a006c470 con 0x7f26880038e0 2023-07-27T14:34:58.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.934+0000 7f26877fe700 1 -- 172.21.15.115:0/1465743370 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v138) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2690023020 con 0x7f26880038e0 2023-07-27T14:34:58.977 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:34:58.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.936+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268c05f750 msgr2=0x7f268c061c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.936+0000 7f26a5fff700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268c05f750 0x7f268c061c10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f26a0155150 tx=0x7f2694009060).stop 2023-07-27T14:34:58.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 msgr2=0x7f26a00abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:58.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f26a00abdb0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f2690001e10 tx=0x7f2690016000).stop 2023-07-27T14:34:58.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 shutdown_connections 2023-07-27T14:34:58.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268c05f750 0x7f268c061c10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a0167530 0x7f26a01679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26880038e0 0x7f26a00abdb0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 --2- 172.21.15.115:0/1465743370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a014a050 0x7f26a00ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:58.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 >> 172.21.15.115:0/1465743370 conn(0x7f26a005e940 msgr2=0x7f26a01524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:58.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 shutdown_connections 2023-07-27T14:34:58.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:58.937+0000 7f26a5fff700 1 -- 172.21.15.115:0/1465743370 wait complete. 2023-07-27T14:34:58.997 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:34:59.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.142+0000 7fd0b67ff700 1 Processor -- start 2023-07-27T14:34:59.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.142+0000 7fd0b67ff700 1 -- start start 2023-07-27T14:34:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.144+0000 7fd0b67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.144+0000 7fd0b67ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b00aa4d0 con 0x7fd0b00aaa40 2023-07-27T14:34:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.144+0000 7fd0b67ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b00c05c0 con 0x7fd0b00aa050 2023-07-27T14:34:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.144+0000 7fd0b67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00bfc90 con 0x7fd0b0153ec0 2023-07-27T14:34:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.144+0000 7fd0b4d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd0b00aaa40 0x7fd0b00c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54678/0 (socket says 172.21.15.115:54678) 2023-07-27T14:34:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.144+0000 7fd0b4d9c700 1 -- 172.21.15.115:0/2244826641 learned_addr learned my addr 172.21.15.115:0/2244826641 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:34:59.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.144+0000 7fd0affff700 1 --2- 172.21.15.115:0/2244826641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0aeffd700 1 -- 172.21.15.115:0/2244826641 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178979073 0 0) 0x7fd0a8001490 con 0x7fd0b00aaa40 2023-07-27T14:34:59.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0aeffd700 1 -- 172.21.15.115:0/2244826641 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0980033f0 con 0x7fd0b00aaa40 2023-07-27T14:34:59.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0affff700 1 -- 172.21.15.115:0/2244826641 >> v1:172.21.15.159:6789/0 conn(0x7fd0b00aa050 legacy=0x7fd0b00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0aeffd700 1 -- 172.21.15.115:0/2244826641 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251832136 0 0) 0x7fd0b00c05c0 con 0x7fd0b00aa050 2023-07-27T14:34:59.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0affff700 1 -- 172.21.15.115:0/2244826641 >> v1:172.21.15.115:6789/0 conn(0x7fd0b00aaa40 legacy=0x7fd0b00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0affff700 1 -- 172.21.15.115:0/2244826641 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00bff70 con 0x7fd0b0153ec0 2023-07-27T14:34:59.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0affff700 1 --2- 172.21.15.115:0/2244826641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00a9b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd0a0009790 tx=0x7fd0a0009060).ready entity=mon.2 client_cookie=b9d5287acb57705d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0aeffd700 1 -- 172.21.15.115:0/2244826641 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000f510 con 0x7fd0b0153ec0 2023-07-27T14:34:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0aeffd700 1 -- 172.21.15.115:0/2244826641 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a000f670 con 0x7fd0b0153ec0 2023-07-27T14:34:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.145+0000 7fd0aeffd700 1 -- 172.21.15.115:0/2244826641 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000f9f0 con 0x7fd0b0153ec0 2023-07-27T14:34:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.146+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2244826641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 msgr2=0x7fd0b00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.146+0000 7fd0b67ff700 1 --2- 172.21.15.115:0/2244826641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00a9b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd0a0009790 tx=0x7fd0a0009060).stop 2023-07-27T14:34:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.146+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2244826641 shutdown_connections 2023-07-27T14:34:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.146+0000 7fd0b67ff700 1 --2- 172.21.15.115:0/2244826641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00a9b60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.146+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2244826641 >> 172.21.15.115:0/2244826641 conn(0x7fd0b00cb610 msgr2=0x7fd0b00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.146+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2244826641 shutdown_connections 2023-07-27T14:34:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.146+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2244826641 wait complete. 2023-07-27T14:34:59.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.148+0000 7fd0b67ff700 1 Processor -- start 2023-07-27T14:34:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.148+0000 7fd0b67ff700 1 -- start start 2023-07-27T14:34:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0b67ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00aa050 0x7fd0b0148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0b67ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0b00aaa40 0x7fd0b0153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0b67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0b67ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b0148f70 con 0x7fd0b00aaa40 2023-07-27T14:34:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0b67ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b0151050 con 0x7fd0b00aa050 2023-07-27T14:34:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0b67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b0150440 con 0x7fd0b0153ec0 2023-07-27T14:34:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0b00aaa40 0x7fd0b0153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0b00aaa40 0x7fd0b0153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41282/0 (socket says 172.21.15.115:41282) 2023-07-27T14:34:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 -- 172.21.15.115:0/2998977348 learned_addr learned my addr 172.21.15.115:0/2998977348 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0b4d9c700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0affff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00aa050 0x7fd0b0148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 -- 172.21.15.115:0/2998977348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 msgr2=0x7fd0b00c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 -- 172.21.15.115:0/2998977348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00aa050 msgr2=0x7fd0b0148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00aa050 0x7fd0b0148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 -- 172.21.15.115:0/2998977348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00092a0 con 0x7fd0b00aaa40 2023-07-27T14:34:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.149+0000 7fd0af7fe700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0b00aaa40 0x7fd0b0153090 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fd0a400c420 tx=0x7fd0a4007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.150+0000 7fd097fff700 1 -- 172.21.15.115:0/2998977348 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a400f470 con 0x7fd0b00aaa40 2023-07-27T14:34:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.150+0000 7fd097fff700 1 -- 172.21.15.115:0/2998977348 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a400f5d0 con 0x7fd0b00aaa40 2023-07-27T14:34:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.150+0000 7fd097fff700 1 -- 172.21.15.115:0/2998977348 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a400f950 con 0x7fd0b00aaa40 2023-07-27T14:34:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.150+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b0150720 con 0x7fd0b00aaa40 2023-07-27T14:34:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.150+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b0150ce0 con 0x7fd0b00aaa40 2023-07-27T14:34:59.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.151+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b0151200 con 0x7fd0b00aaa40 2023-07-27T14:34:59.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.151+0000 7fd097fff700 1 -- 172.21.15.115:0/2998977348 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fd0a4019030 con 0x7fd0b00aaa40 2023-07-27T14:34:59.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.153+0000 7fd097fff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd09c05f6f0 0x7fd09c061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.153+0000 7fd097fff700 1 -- 172.21.15.115:0/2998977348 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd0a4079a90 con 0x7fd0b00aaa40 2023-07-27T14:34:59.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.153+0000 7fd0affff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd09c05f6f0 0x7fd09c061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.153+0000 7fd0affff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd09c05f6f0 0x7fd09c061bb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fd0a00096e0 tx=0x7fd0a0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:59.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.157+0000 7fd097fff700 1 -- 172.21.15.115:0/2998977348 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0a40488f0 con 0x7fd0b00aaa40 2023-07-27T14:34:59.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.327+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd0b00c0250 con 0x7fd0b00aaa40 2023-07-27T14:34:59.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.328+0000 7fd097fff700 1 -- 172.21.15.115:0/2998977348 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd0b0151200 con 0x7fd0b00aaa40 2023-07-27T14:34:59.371 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:34:59.371 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:34:59.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:59.371 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:34:59.371 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:34:59.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:34:59.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:34:59.372 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:34:59.372 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:34:59.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:34:59.372 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:34:59.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd09c05f6f0 msgr2=0x7fd09c061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd09c05f6f0 0x7fd09c061bb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fd0a00096e0 tx=0x7fd0a0017000).stop 2023-07-27T14:34:59.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0b00aaa40 msgr2=0x7fd0b0153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0b00aaa40 0x7fd0b0153090 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fd0a400c420 tx=0x7fd0a4007bd0).stop 2023-07-27T14:34:59.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 shutdown_connections 2023-07-27T14:34:59.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd09c05f6f0 0x7fd09c061bb0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0b0153ec0 0x7fd0b00c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0b00aa050 0x7fd0b0148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 --2- 172.21.15.115:0/2998977348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0b00aaa40 0x7fd0b0153090 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 >> 172.21.15.115:0/2998977348 conn(0x7fd0b00cb610 msgr2=0x7fd0b00aba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:59.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 shutdown_connections 2023-07-27T14:34:59.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.330+0000 7fd0b67ff700 1 -- 172.21.15.115:0/2998977348 wait complete. 2023-07-27T14:34:59.390 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:34:59.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:34:59.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.540+0000 7f463b3ff700 1 Processor -- start 2023-07-27T14:34:59.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.540+0000 7f463b3ff700 1 -- start start 2023-07-27T14:34:59.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.541+0000 7f463b3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f463414ae00 0x7f4634154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.541+0000 7f463b3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f463414b1e0 0x7f4634062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.541+0000 7f463b3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46341553f0 con 0x7f46340c5c50 2023-07-27T14:34:59.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.541+0000 7f463b3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4634157a50 con 0x7f463414b1e0 2023-07-27T14:34:59.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.541+0000 7f463b3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4634157d10 con 0x7f463414ae00 2023-07-27T14:34:59.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.541+0000 7f463899a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f463414b1e0 0x7f4634062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.541+0000 7f463899a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f463414b1e0 0x7f4634062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41290/0 (socket says 172.21.15.115:41290) 2023-07-27T14:34:59.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.541+0000 7f463899a700 1 -- 172.21.15.115:0/2716065375 learned_addr learned my addr 172.21.15.115:0/2716065375 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:59.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f463899a700 1 -- 172.21.15.115:0/2716065375 >> v2:172.21.15.159:3300/0 conn(0x7f463414ae00 msgr2=0x7f4634154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:59.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f463919b700 1 --2- 172.21.15.115:0/2716065375 >> v2:172.21.15.159:3300/0 conn(0x7f463414ae00 0x7f4634154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f463899a700 1 --2- 172.21.15.115:0/2716065375 >> v2:172.21.15.159:3300/0 conn(0x7f463414ae00 0x7f4634154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f463899a700 1 -- 172.21.15.115:0/2716065375 >> v1:172.21.15.159:6789/0 conn(0x7f46340c5c50 legacy=0x7f46340a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:34:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f463899a700 1 -- 172.21.15.115:0/2716065375 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634157ff0 con 0x7f463414b1e0 2023-07-27T14:34:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f463919b700 1 --2- 172.21.15.115:0/2716065375 >> v2:172.21.15.159:3300/0 conn(0x7f463414ae00 0x7f4634154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:34:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f463899a700 1 --2- 172.21.15.115:0/2716065375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634062b50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f4634155580 tx=0x7f46240090f0).ready entity=mon.0 client_cookie=f3e1159bad229dbe server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f462bfff700 1 -- 172.21.15.115:0/2716065375 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400b5a0 con 0x7f463414b1e0 2023-07-27T14:34:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f462bfff700 1 -- 172.21.15.115:0/2716065375 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462400b700 con 0x7f463414b1e0 2023-07-27T14:34:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.542+0000 7f462bfff700 1 -- 172.21.15.115:0/2716065375 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400ba80 con 0x7f463414b1e0 2023-07-27T14:34:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.543+0000 7f463b3ff700 1 -- 172.21.15.115:0/2716065375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 msgr2=0x7f4634062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.543+0000 7f463b3ff700 1 --2- 172.21.15.115:0/2716065375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634062b50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f4634155580 tx=0x7f46240090f0).stop 2023-07-27T14:34:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.543+0000 7f463b3ff700 1 -- 172.21.15.115:0/2716065375 shutdown_connections 2023-07-27T14:34:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.543+0000 7f463b3ff700 1 --2- 172.21.15.115:0/2716065375 >> v2:172.21.15.159:3300/0 conn(0x7f463414ae00 0x7f4634154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.543+0000 7f463b3ff700 1 --2- 172.21.15.115:0/2716065375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634062b50 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.543+0000 7f463b3ff700 1 -- 172.21.15.115:0/2716065375 >> 172.21.15.115:0/2716065375 conn(0x7f463405e940 msgr2=0x7f46340cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.543+0000 7f463b3ff700 1 -- 172.21.15.115:0/2716065375 shutdown_connections 2023-07-27T14:34:59.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.543+0000 7f463b3ff700 1 -- 172.21.15.115:0/2716065375 wait complete. 2023-07-27T14:34:59.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.544+0000 7f463b3ff700 1 Processor -- start 2023-07-27T14:34:59.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.544+0000 7f463b3ff700 1 -- start start 2023-07-27T14:34:59.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.545+0000 7f463b3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46340c5c50 0x7f46340ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.545+0000 7f463b3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f463414ae00 0x7f46340ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.545+0000 7f463b3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.545+0000 7f463b3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340abb20 con 0x7f463414b1e0 2023-07-27T14:34:59.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.545+0000 7f463b3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634138ea0 con 0x7f463414ae00 2023-07-27T14:34:59.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.545+0000 7f463b3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46340c5280 con 0x7f46340c5c50 2023-07-27T14:34:59.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41300/0 (socket says 172.21.15.115:41300) 2023-07-27T14:34:59.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 -- 172.21.15.115:0/3737108516 learned_addr learned my addr 172.21.15.115:0/3737108516 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:34:59.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463899a700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f463414ae00 0x7f46340ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463919b700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46340c5c50 0x7f46340ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 -- 172.21.15.115:0/3737108516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46340c5c50 msgr2=0x7f46340ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46340c5c50 0x7f46340ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 -- 172.21.15.115:0/3737108516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f463414ae00 msgr2=0x7f46340ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f463414ae00 0x7f46340ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 -- 172.21.15.115:0/3737108516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624009370 con 0x7f463414b1e0 2023-07-27T14:34:59.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.546+0000 7f463999c700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634156580 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f462c00c810 tx=0x7f462c002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:59.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.547+0000 7f46297fa700 1 -- 172.21.15.115:0/3737108516 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00e4a0 con 0x7f463414b1e0 2023-07-27T14:34:59.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.547+0000 7f46297fa700 1 -- 172.21.15.115:0/3737108516 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c00e640 con 0x7f463414b1e0 2023-07-27T14:34:59.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.547+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46340c4fa0 con 0x7f463414b1e0 2023-07-27T14:34:59.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.547+0000 7f46297fa700 1 -- 172.21.15.115:0/3737108516 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00ea00 con 0x7f463414b1e0 2023-07-27T14:34:59.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.547+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46340ae3c0 con 0x7f463414b1e0 2023-07-27T14:34:59.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.548+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4634151850 con 0x7f463414b1e0 2023-07-27T14:34:59.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.548+0000 7f46297fa700 1 -- 172.21.15.115:0/3737108516 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f462c019030 con 0x7f463414b1e0 2023-07-27T14:34:59.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.549+0000 7f46297fa700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f461805f750 0x7f4618061c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:34:59.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.549+0000 7f46297fa700 1 -- 172.21.15.115:0/3737108516 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f462c079b50 con 0x7f463414b1e0 2023-07-27T14:34:59.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.550+0000 7f463919b700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f461805f750 0x7f4618061c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:34:59.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.550+0000 7f463919b700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f461805f750 0x7f4618061c10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f463000abd0 tx=0x7f4630008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:34:59.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.553+0000 7f46297fa700 1 -- 172.21.15.115:0/3737108516 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f462c0488f0 con 0x7f463414b1e0 2023-07-27T14:34:59.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.723+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f46340ae9d0 con 0x7f463414b1e0 2023-07-27T14:34:59.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.888+0000 7f46297fa700 1 -- 172.21.15.115:0/3737108516 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v139) v1 ==== 152+0+0 (secure 0 0 0) 0x7f462c017030 con 0x7f463414b1e0 2023-07-27T14:34:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f461805f750 msgr2=0x7f4618061c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f461805f750 0x7f4618061c10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f463000abd0 tx=0x7f4630008040).stop 2023-07-27T14:34:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 msgr2=0x7f4634156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:34:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634156580 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f462c00c810 tx=0x7f462c002530).stop 2023-07-27T14:34:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 shutdown_connections 2023-07-27T14:34:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f461805f750 0x7f4618061c10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f463414b1e0 0x7f4634156580 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46340c5c50 0x7f46340ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 --2- 172.21.15.115:0/3737108516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f463414ae00 0x7f46340ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:34:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 >> 172.21.15.115:0/3737108516 conn(0x7f463405e940 msgr2=0x7f4634062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:34:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 shutdown_connections 2023-07-27T14:34:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:34:59.891+0000 7f463b3ff700 1 -- 172.21.15.115:0/3737108516 wait complete. 2023-07-27T14:34:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:34:59.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:35:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.110+0000 7f0c4d1ff700 1 Processor -- start 2023-07-27T14:35:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.110+0000 7f0c4d1ff700 1 -- start start 2023-07-27T14:35:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4d1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c480bd9f0 0x7f0c48154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 0x7f0c480c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4d1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c48157b90 con 0x7f0c48153d50 2023-07-27T14:35:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4d1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c481589f0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c48157de0 con 0x7f0c480c6ba0 2023-07-27T14:35:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c480bd9f0 0x7f0c48154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:00.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c480bd9f0 0x7f0c48154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41306/0 (socket says 172.21.15.115:41306) 2023-07-27T14:35:00.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4659c700 1 -- 172.21.15.115:0/1156759128 learned_addr learned my addr 172.21.15.115:0/1156759128 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:00.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.111+0000 7f0c4759e700 1 --2- 172.21.15.115:0/1156759128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 0x7f0c480c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:00.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c4659c700 1 -- 172.21.15.115:0/1156759128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 msgr2=0x7f0c480c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:00.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c4659c700 1 --2- 172.21.15.115:0/1156759128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 0x7f0c480c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:00.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c4659c700 1 -- 172.21.15.115:0/1156759128 >> v1:172.21.15.115:6789/0 conn(0x7f0c48153d50 legacy=0x7f0c480bd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:00.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c4659c700 1 -- 172.21.15.115:0/1156759128 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c481580c0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c4659c700 1 --2- 172.21.15.115:0/1156759128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c48154130 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f0c3c006fd0 tx=0x7f0c3c0090f0).ready entity=mon.0 client_cookie=10f4d3eaaf369454 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:00.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c45d9b700 1 -- 172.21.15.115:0/1156759128 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00b600 con 0x7f0c480bd9f0 2023-07-27T14:35:00.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c45d9b700 1 -- 172.21.15.115:0/1156759128 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00b760 con 0x7f0c480bd9f0 2023-07-27T14:35:00.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c45d9b700 1 -- 172.21.15.115:0/1156759128 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00bae0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1156759128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 msgr2=0x7f0c48154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:00.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.112+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1156759128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c48154130 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f0c3c006fd0 tx=0x7f0c3c0090f0).stop 2023-07-27T14:35:00.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.113+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1156759128 shutdown_connections 2023-07-27T14:35:00.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.113+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1156759128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 0x7f0c480c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:00.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.113+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1156759128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c48154130 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:00.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.113+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1156759128 >> 172.21.15.115:0/1156759128 conn(0x7f0c480c7c30 msgr2=0x7f0c480c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:00.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.113+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1156759128 shutdown_connections 2023-07-27T14:35:00.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.113+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1156759128 wait complete. 2023-07-27T14:35:00.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.114+0000 7f0c4d1ff700 1 Processor -- start 2023-07-27T14:35:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.114+0000 7f0c4d1ff700 1 -- start start 2023-07-27T14:35:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.115+0000 7f0c4d1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c481502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.115+0000 7f0c4d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 0x7f0c480a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.115+0000 7f0c4d1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48153d50 0x7f0c480a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.115+0000 7f0c4d1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c481546b0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.115+0000 7f0c4d1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c481507a0 con 0x7f0c48153d50 2023-07-27T14:35:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.115+0000 7f0c4d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c48154c30 con 0x7f0c480c6ba0 2023-07-27T14:35:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.115+0000 7f0c46d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c481502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.115+0000 7f0c46d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c481502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41316/0 (socket says 172.21.15.115:41316) 2023-07-27T14:35:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c46d9d700 1 -- 172.21.15.115:0/1748132836 learned_addr learned my addr 172.21.15.115:0/1748132836 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c46d9d700 1 -- 172.21.15.115:0/1748132836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 msgr2=0x7f0c480a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c46d9d700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 0x7f0c480a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c46d9d700 1 -- 172.21.15.115:0/1748132836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48153d50 msgr2=0x7f0c480a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c46d9d700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48153d50 0x7f0c480a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c46d9d700 1 -- 172.21.15.115:0/1748132836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c009370 con 0x7f0c480bd9f0 2023-07-27T14:35:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c46d9d700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c481502b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f0c3800c440 tx=0x7f0c38007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c2effd700 1 -- 172.21.15.115:0/1748132836 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800ce90 con 0x7f0c480bd9f0 2023-07-27T14:35:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c2effd700 1 -- 172.21.15.115:0/1748132836 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38007020 con 0x7f0c480bd9f0 2023-07-27T14:35:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c48157280 con 0x7f0c480bd9f0 2023-07-27T14:35:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c2effd700 1 -- 172.21.15.115:0/1748132836 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380073c0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.116+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c481548c0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.117+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4806c470 con 0x7f0c480bd9f0 2023-07-27T14:35:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.118+0000 7f0c2effd700 1 -- 172.21.15.115:0/1748132836 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f0c38010070 con 0x7f0c480bd9f0 2023-07-27T14:35:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.119+0000 7f0c2effd700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3405f6f0 0x7f0c34061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:00.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.119+0000 7f0c2effd700 1 -- 172.21.15.115:0/1748132836 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f0c38079b10 con 0x7f0c480bd9f0 2023-07-27T14:35:00.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.119+0000 7f0c4659c700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3405f6f0 0x7f0c34061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:00.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.120+0000 7f0c4659c700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3405f6f0 0x7f0c34061bb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f0c480bddf0 tx=0x7f0c3c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.124+0000 7f0c2effd700 1 -- 172.21.15.115:0/1748132836 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0c380478f0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.294+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0c480c43e0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.653 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:35:00.658 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:35:00.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.901+0000 7f0c2effd700 1 -- 172.21.15.115:0/1748132836 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v140) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0c3804a7f0 con 0x7f0c480bd9f0 2023-07-27T14:35:00.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.912+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3405f6f0 msgr2=0x7f0c34061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:00.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.912+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3405f6f0 0x7f0c34061bb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f0c480bddf0 tx=0x7f0c3c017000).stop 2023-07-27T14:35:00.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.912+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 msgr2=0x7f0c481502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:00.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.912+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c481502b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f0c3800c440 tx=0x7f0c38007e00).stop 2023-07-27T14:35:00.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.913+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 shutdown_connections 2023-07-27T14:35:00.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.913+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0c3405f6f0 0x7f0c34061bb0 secure :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0x7f0c480bddf0 tx=0x7f0c3c017000).stop 2023-07-27T14:35:00.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.913+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48153d50 0x7f0c480a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:00.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.913+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c480bd9f0 0x7f0c481502b0 secure :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0x7f0c3800c440 tx=0x7f0c38007e00).stop 2023-07-27T14:35:00.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.913+0000 7f0c4d1ff700 1 --2- 172.21.15.115:0/1748132836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0c480c6ba0 0x7f0c480a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:00.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.913+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 >> 172.21.15.115:0/1748132836 conn(0x7f0c480c7c30 msgr2=0x7f0c480658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:00.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.914+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 shutdown_connections 2023-07-27T14:35:00.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:00.915+0000 7f0c4d1ff700 1 -- 172.21.15.115:0/1748132836 wait complete. 2023-07-27T14:35:00.967 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:35:00.985 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:35:01.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.132+0000 7f553e3ff700 1 Processor -- start 2023-07-27T14:35:01.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.132+0000 7f553e3ff700 1 -- start start 2023-07-27T14:35:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.133+0000 7f553e3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.133+0000 7f553e3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5538063260 0x7f55380a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.133+0000 7f553e3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55381553f0 con 0x7f553814b1e0 2023-07-27T14:35:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.133+0000 7f553e3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5538157a50 con 0x7f5538063260 2023-07-27T14:35:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f553e3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5538157d10 con 0x7f553814ae00 2023-07-27T14:35:01.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f5537fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f5537fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:36108/0 (socket says 172.21.15.115:36108) 2023-07-27T14:35:01.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f5537fff700 1 -- 172.21.15.115:0/2784212465 learned_addr learned my addr 172.21.15.115:0/2784212465 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f553c99c700 1 --2- 172.21.15.115:0/2784212465 >> v2:172.21.15.159:3300/0 conn(0x7f5538063260 0x7f55380a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f5537fff700 1 -- 172.21.15.115:0/2784212465 >> v2:172.21.15.159:3300/0 conn(0x7f5538063260 msgr2=0x7f55380a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f5537fff700 1 --2- 172.21.15.115:0/2784212465 >> v2:172.21.15.159:3300/0 conn(0x7f5538063260 0x7f55380a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f5537fff700 1 -- 172.21.15.115:0/2784212465 >> v1:172.21.15.159:6789/0 conn(0x7f553814b1e0 legacy=0x7f5538062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f5537fff700 1 -- 172.21.15.115:0/2784212465 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538157ff0 con 0x7f553814ae00 2023-07-27T14:35:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.135+0000 7f553c99c700 1 --2- 172.21.15.115:0/2784212465 >> v2:172.21.15.159:3300/0 conn(0x7f5538063260 0x7f55380a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:35:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.134+0000 7f5536ffd700 1 -- 172.21.15.115:0/2784212465 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683767696 0 0) 0x7f55381553f0 con 0x7f553814b1e0 2023-07-27T14:35:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.135+0000 7f5537fff700 1 --2- 172.21.15.115:0/2784212465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538154f00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5528006fd0 tx=0x7f55280090f0).ready entity=mon.2 client_cookie=15b07d2c95124c43 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.135+0000 7f5536ffd700 1 -- 172.21.15.115:0/2784212465 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552800b580 con 0x7f553814ae00 2023-07-27T14:35:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.135+0000 7f5536ffd700 1 -- 172.21.15.115:0/2784212465 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552800b6e0 con 0x7f553814ae00 2023-07-27T14:35:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.135+0000 7f5536ffd700 1 -- 172.21.15.115:0/2784212465 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552800ba60 con 0x7f553814ae00 2023-07-27T14:35:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.135+0000 7f553e3ff700 1 -- 172.21.15.115:0/2784212465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 msgr2=0x7f5538154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.135+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2784212465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538154f00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5528006fd0 tx=0x7f55280090f0).stop 2023-07-27T14:35:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.136+0000 7f553e3ff700 1 -- 172.21.15.115:0/2784212465 shutdown_connections 2023-07-27T14:35:01.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.136+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2784212465 >> v2:172.21.15.159:3300/0 conn(0x7f5538063260 0x7f55380a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.136+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2784212465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538154f00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.136+0000 7f553e3ff700 1 -- 172.21.15.115:0/2784212465 >> 172.21.15.115:0/2784212465 conn(0x7f553805e940 msgr2=0x7f55380cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.136+0000 7f553e3ff700 1 -- 172.21.15.115:0/2784212465 shutdown_connections 2023-07-27T14:35:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.136+0000 7f553e3ff700 1 -- 172.21.15.115:0/2784212465 wait complete. 2023-07-27T14:35:01.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.137+0000 7f553e3ff700 1 Processor -- start 2023-07-27T14:35:01.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.137+0000 7f553e3ff700 1 -- start start 2023-07-27T14:35:01.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.138+0000 7f553e3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538063260 0x7f55381571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.138+0000 7f553e3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.138+0000 7f553e3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f553814b1e0 0x7f55381490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.138+0000 7f553e3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55381495d0 con 0x7f553814b1e0 2023-07-27T14:35:01.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.138+0000 7f553e3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538156d60 con 0x7f5538063260 2023-07-27T14:35:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.138+0000 7f553e3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5538156150 con 0x7f553814ae00 2023-07-27T14:35:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f553814b1e0 0x7f55381490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f5537fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538063260 0x7f55381571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f553814b1e0 0x7f55381490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41332/0 (socket says 172.21.15.115:41332) 2023-07-27T14:35:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 -- 172.21.15.115:0/2929369848 learned_addr learned my addr 172.21.15.115:0/2929369848 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f55377fe700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 -- 172.21.15.115:0/2929369848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 msgr2=0x7f5538155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 -- 172.21.15.115:0/2929369848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538063260 msgr2=0x7f55381571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538063260 0x7f55381571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 -- 172.21.15.115:0/2929369848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5530009a20 con 0x7f553814b1e0 2023-07-27T14:35:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f5537fff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538063260 0x7f55381571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:35:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f553c99c700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f553814b1e0 0x7f55381490e0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f553000c0f0 tx=0x7f553000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.139+0000 7f551ffff700 1 -- 172.21.15.115:0/2929369848 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553000cbd0 con 0x7f553814b1e0 2023-07-27T14:35:01.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.140+0000 7f551ffff700 1 -- 172.21.15.115:0/2929369848 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553000f040 con 0x7f553814b1e0 2023-07-27T14:35:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.140+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5528009370 con 0x7f553814b1e0 2023-07-27T14:35:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.140+0000 7f551ffff700 1 -- 172.21.15.115:0/2929369848 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530013400 con 0x7f553814b1e0 2023-07-27T14:35:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.140+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5538156710 con 0x7f553814b1e0 2023-07-27T14:35:01.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.141+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553806a600 con 0x7f553814b1e0 2023-07-27T14:35:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.142+0000 7f551ffff700 1 -- 172.21.15.115:0/2929369848 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f55300137f0 con 0x7f553814b1e0 2023-07-27T14:35:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.142+0000 7f551ffff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405f720 0x7f5524061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.143+0000 7f551ffff700 1 -- 172.21.15.115:0/2929369848 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f553007b060 con 0x7f553814b1e0 2023-07-27T14:35:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.143+0000 7f5537fff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405f720 0x7f5524061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.143+0000 7f5537fff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405f720 0x7f5524061be0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f5528006df0 tx=0x7f5528017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:01.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.147+0000 7f551ffff700 1 -- 172.21.15.115:0/2929369848 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f553004c040 con 0x7f553814b1e0 2023-07-27T14:35:01.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.358+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5538156ef0 con 0x7f553814b1e0 2023-07-27T14:35:01.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.365+0000 7f551ffff700 1 -- 172.21.15.115:0/2929369848 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v73) v1 ==== 174+0+0 (secure 0 0 0) 0x7f553004f660 con 0x7f553814b1e0 2023-07-27T14:35:01.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.371+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405f720 msgr2=0x7f5524061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.371+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405f720 0x7f5524061be0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f5528006df0 tx=0x7f5528017000).stop 2023-07-27T14:35:01.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.372+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f553814b1e0 msgr2=0x7f55381490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.372+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f553814b1e0 0x7f55381490e0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f553000c0f0 tx=0x7f553000b040).stop 2023-07-27T14:35:01.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.372+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 shutdown_connections 2023-07-27T14:35:01.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.372+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f552405f720 0x7f5524061be0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.372+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f553814b1e0 0x7f55381490e0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.372+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5538063260 0x7f55381571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.372+0000 7f553e3ff700 1 --2- 172.21.15.115:0/2929369848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f553814ae00 0x7f5538155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.372+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 >> 172.21.15.115:0/2929369848 conn(0x7f553805e940 msgr2=0x7f55380ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:01.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.375+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 shutdown_connections 2023-07-27T14:35:01.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.376+0000 7f553e3ff700 1 -- 172.21.15.115:0/2929369848 wait complete. 2023-07-27T14:35:01.428 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 19 and data pool 20 2023-07-27T14:35:01.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:35:01.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.595+0000 7fa1f4bff700 1 Processor -- start 2023-07-27T14:35:01.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.595+0000 7fa1f4bff700 1 -- start start 2023-07-27T14:35:01.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.596+0000 7fa1f4bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 0x7fa1f00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.596+0000 7fa1f4bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00aa4d0 con 0x7fa1f01542a0 2023-07-27T14:35:01.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.596+0000 7fa1f4bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00c05c0 con 0x7fa1f0153ec0 2023-07-27T14:35:01.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.596+0000 7fa1f4bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00aa270 con 0x7fa1f00aaa40 2023-07-27T14:35:01.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1eed9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa1f01542a0 0x7fa1f00c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54696/0 (socket says 172.21.15.115:54696) 2023-07-27T14:35:01.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1eed9d700 1 -- 172.21.15.115:0/2156024544 learned_addr learned my addr 172.21.15.115:0/2156024544 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:01.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1edd9b700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 0x7fa1f00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545684265 0 0) 0x7fa1e8001490 con 0x7fa1f01542a0 2023-07-27T14:35:01.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d80033f0 con 0x7fa1f01542a0 2023-07-27T14:35:01.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390978506 0 0) 0x7fa1f00c05c0 con 0x7fa1f0153ec0 2023-07-27T14:35:01.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e8001490 con 0x7fa1f0153ec0 2023-07-27T14:35:01.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 741135438 0 0) 0x7fa1d80033f0 con 0x7fa1f01542a0 2023-07-27T14:35:01.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 msgr2=0x7fa1f00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:01.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 0x7fa1f00640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 >> v1:172.21.15.159:6789/0 conn(0x7fa1f0153ec0 legacy=0x7fa1f00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00bfc90 con 0x7fa1f01542a0 2023-07-27T14:35:01.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fa1e8001980 con 0x7fa1f01542a0 2023-07-27T14:35:01.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 >> v1:172.21.15.115:6789/0 conn(0x7fa1f01542a0 legacy=0x7fa1f00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.597+0000 7fa1ed59a700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d8003aa0 0x7fa1d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1ed59a700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1d8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1ed59a700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 0x7fa1d8005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00aa270 con 0x7fa1d8004690 2023-07-27T14:35:01.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d800b990 con 0x7fa1d8003aa0 2023-07-27T14:35:01.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d800bb20 con 0x7fa1f00aaa40 2023-07-27T14:35:01.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1edd9b700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1d8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1ee59c700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d8003aa0 0x7fa1d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1eed9d700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 0x7fa1d8005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1edd9b700 1 -- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 msgr2=0x7fa1d8005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:01.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1edd9b700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 0x7fa1d8005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1edd9b700 1 -- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d8003aa0 msgr2=0x7fa1d8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:01.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1edd9b700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d8003aa0 0x7fa1d8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1edd9b700 1 -- 172.21.15.115:0/2156024544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80033f0 con 0x7fa1d8004690 2023-07-27T14:35:01.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1eed9d700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00aaa40 0x7fa1d8005020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:01.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.598+0000 7fa1edd9b700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1d8004b10 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fa1e4009a80 tx=0x7fa1e4009060).ready entity=mon.0 client_cookie=800d07272e6f552a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:01.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4009430 con 0x7fa1d8004690 2023-07-27T14:35:01.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e400e640 con 0x7fa1d8004690 2023-07-27T14:35:01.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1ed59a700 1 -- 172.21.15.115:0/2156024544 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400e9c0 con 0x7fa1d8004690 2023-07-27T14:35:01.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1f4bff700 1 -- 172.21.15.115:0/2156024544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 msgr2=0x7fa1d8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1f4bff700 1 --2- 172.21.15.115:0/2156024544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1d8004b10 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fa1e4009a80 tx=0x7fa1e4009060).stop 2023-07-27T14:35:01.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1eed9d700 1 -- 172.21.15.115:0/2156024544 reap_dead start 2023-07-27T14:35:01.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1f4bff700 1 -- 172.21.15.115:0/2156024544 shutdown_connections 2023-07-27T14:35:01.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1f4bff700 1 -- 172.21.15.115:0/2156024544 >> 172.21.15.115:0/2156024544 conn(0x7fa1f00cb610 msgr2=0x7fa1f00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:01.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1f4bff700 1 -- 172.21.15.115:0/2156024544 shutdown_connections 2023-07-27T14:35:01.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.599+0000 7fa1f4bff700 1 -- 172.21.15.115:0/2156024544 wait complete. 2023-07-27T14:35:01.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.601+0000 7fa1f4bff700 1 Processor -- start 2023-07-27T14:35:01.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.601+0000 7fa1f4bff700 1 -- start start 2023-07-27T14:35:01.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1f4bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1f00c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1f4bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00c3440 0x7fa1f00c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1f4bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f00af6c0 0x7fa1f00afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1f4bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00c2120 con 0x7fa1d8004690 2023-07-27T14:35:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1f4bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00c23a0 con 0x7fa1f00af6c0 2023-07-27T14:35:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1f4bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00c2680 con 0x7fa1f00c3440 2023-07-27T14:35:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1ee59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1f00c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1ee59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1f00c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41346/0 (socket says 172.21.15.115:41346) 2023-07-27T14:35:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1ee59c700 1 -- 172.21.15.115:0/4118575242 learned_addr learned my addr 172.21.15.115:0/4118575242 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1edd9b700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00c3440 0x7fa1f00c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1eed9d700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f00af6c0 0x7fa1f00afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1ee59c700 1 -- 172.21.15.115:0/4118575242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00c3440 msgr2=0x7fa1f00c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1ee59c700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00c3440 0x7fa1f00c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1ee59c700 1 -- 172.21.15.115:0/4118575242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f00af6c0 msgr2=0x7fa1f00afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1ee59c700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f00af6c0 0x7fa1f00afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.602+0000 7fa1ee59c700 1 -- 172.21.15.115:0/4118575242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00c2960 con 0x7fa1d8004690 2023-07-27T14:35:01.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.603+0000 7fa1ee59c700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1f00c4810 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7fa1e00010e0 tx=0x7fa1e0007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:01.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.603+0000 7fa1de7fc700 1 -- 172.21.15.115:0/4118575242 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0002e80 con 0x7fa1d8004690 2023-07-27T14:35:01.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.603+0000 7fa1de7fc700 1 -- 172.21.15.115:0/4118575242 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e0007240 con 0x7fa1d8004690 2023-07-27T14:35:01.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.603+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00c2c40 con 0x7fa1d8004690 2023-07-27T14:35:01.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.603+0000 7fa1de7fc700 1 -- 172.21.15.115:0/4118575242 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00075c0 con 0x7fa1d8004690 2023-07-27T14:35:01.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.603+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f0144440 con 0x7fa1d8004690 2023-07-27T14:35:01.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.604+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f006c470 con 0x7fa1d8004690 2023-07-27T14:35:01.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.606+0000 7fa1de7fc700 1 -- 172.21.15.115:0/4118575242 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fa1e001a030 con 0x7fa1d8004690 2023-07-27T14:35:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.607+0000 7fa1de7fc700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa1d005f6f0 0x7fa1d0061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.607+0000 7fa1de7fc700 1 -- 172.21.15.115:0/4118575242 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa1e007ab60 con 0x7fa1d8004690 2023-07-27T14:35:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.607+0000 7fa1edd9b700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa1d005f6f0 0x7fa1d0061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.607+0000 7fa1edd9b700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa1d005f6f0 0x7fa1d0061bb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fa1f00c38a0 tx=0x7fa1e401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.610+0000 7fa1de7fc700 1 -- 172.21.15.115:0/4118575242 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa1e004b8a0 con 0x7fa1d8004690 2023-07-27T14:35:01.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.783+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f00bff70 con 0x7fa1d8004690 2023-07-27T14:35:01.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.784+0000 7fa1de7fc700 1 -- 172.21.15.115:0/4118575242 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+17099 (secure 0 0 0) 0x7fa1e0022020 con 0x7fa1d8004690 2023-07-27T14:35:01.827 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:35:01.827 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":141,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:35:01.358973+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:34:59.767019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-27T14:35:00.338085+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:35:01.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.786+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa1d005f6f0 msgr2=0x7fa1d0061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.786+0000 7fa1f4bff700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa1d005f6f0 0x7fa1d0061bb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fa1f00c38a0 tx=0x7fa1e401a000).stop 2023-07-27T14:35:01.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.786+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 msgr2=0x7fa1f00c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:01.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.786+0000 7fa1f4bff700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1f00c4810 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7fa1e00010e0 tx=0x7fa1e0007bb0).stop 2023-07-27T14:35:01.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.787+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 shutdown_connections 2023-07-27T14:35:01.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.787+0000 7fa1f4bff700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa1d005f6f0 0x7fa1d0061bb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.787+0000 7fa1f4bff700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1f00af6c0 0x7fa1f00afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.787+0000 7fa1f4bff700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1d8004690 0x7fa1f00c4810 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.787+0000 7fa1f4bff700 1 --2- 172.21.15.115:0/4118575242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1f00c3440 0x7fa1f00c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:01.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.787+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 >> 172.21.15.115:0/4118575242 conn(0x7fa1f00cb610 msgr2=0x7fa1f00ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:01.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.787+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 shutdown_connections 2023-07-27T14:35:01.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.787+0000 7fa1f4bff700 1 -- 172.21.15.115:0/4118575242 wait complete. 2023-07-27T14:35:01.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:35:01.920 INFO:tasks.ceph.mds.c.smithi115.stderr:2023-07-27T14:35:01.877+0000 7f7d185f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:35:02.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.993+0000 7fd7b29ff700 1 Processor -- start 2023-07-27T14:35:02.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.993+0000 7fd7b29ff700 1 -- start start 2023-07-27T14:35:02.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.994+0000 7fd7b29ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.994+0000 7fd7b29ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd7ac0bc050 0x7fd7ac0bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.994+0000 7fd7b29ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ac0639d0 con 0x7fd7ac151bd0 2023-07-27T14:35:02.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.994+0000 7fd7b29ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac137610 con 0x7fd7ac0bc050 2023-07-27T14:35:02.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.994+0000 7fd7b29ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0a51b0 con 0x7fd7ac0a4840 2023-07-27T14:35:02.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7ab7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7ab7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac0a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:36150/0 (socket says 172.21.15.115:36150) 2023-07-27T14:35:02.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7ab7fe700 1 -- 172.21.15.115:0/232777444 learned_addr learned my addr 172.21.15.115:0/232777444 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:02.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7abfff700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fd7ac151bd0 0x7fd7ac062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:44608/0 (socket says 172.21.15.115:44608) 2023-07-27T14:35:02.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7b0f9c700 1 --2- 172.21.15.115:0/232777444 >> v2:172.21.15.159:3300/0 conn(0x7fd7ac0bc050 0x7fd7ac0bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7ab7fe700 1 -- 172.21.15.115:0/232777444 >> v2:172.21.15.159:3300/0 conn(0x7fd7ac0bc050 msgr2=0x7fd7ac0bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:02.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7ab7fe700 1 --2- 172.21.15.115:0/232777444 >> v2:172.21.15.159:3300/0 conn(0x7fd7ac0bc050 0x7fd7ac0bc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7ab7fe700 1 -- 172.21.15.115:0/232777444 >> v1:172.21.15.159:6789/0 conn(0x7fd7ac151bd0 legacy=0x7fd7ac062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7ab7fe700 1 -- 172.21.15.115:0/232777444 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac062dc0 con 0x7fd7ac0a4840 2023-07-27T14:35:02.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7aaffd700 1 -- 172.21.15.115:0/232777444 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031696479 0 0) 0x7fd7ac0639d0 con 0x7fd7ac151bd0 2023-07-27T14:35:02.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.995+0000 7fd7ab7fe700 1 --2- 172.21.15.115:0/232777444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac0a4cc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd7a0006fd0 tx=0x7fd7a00090f0).ready entity=mon.2 client_cookie=63e4b57ae8fd5d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:02.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7aaffd700 1 -- 172.21.15.115:0/232777444 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000b580 con 0x7fd7ac0a4840 2023-07-27T14:35:02.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7aaffd700 1 -- 172.21.15.115:0/232777444 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000b6e0 con 0x7fd7ac0a4840 2023-07-27T14:35:02.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7aaffd700 1 -- 172.21.15.115:0/232777444 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000ba60 con 0x7fd7ac0a4840 2023-07-27T14:35:02.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7b29ff700 1 -- 172.21.15.115:0/232777444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 msgr2=0x7fd7ac0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/232777444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac0a4cc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd7a0006fd0 tx=0x7fd7a00090f0).stop 2023-07-27T14:35:02.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7b29ff700 1 -- 172.21.15.115:0/232777444 shutdown_connections 2023-07-27T14:35:02.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/232777444 >> v2:172.21.15.159:3300/0 conn(0x7fd7ac0bc050 0x7fd7ac0bc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/232777444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac0a4cc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7b29ff700 1 -- 172.21.15.115:0/232777444 >> 172.21.15.115:0/232777444 conn(0x7fd7ac064700 msgr2=0x7fd7ac064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:02.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7b29ff700 1 -- 172.21.15.115:0/232777444 shutdown_connections 2023-07-27T14:35:02.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.996+0000 7fd7b29ff700 1 -- 172.21.15.115:0/232777444 wait complete. 2023-07-27T14:35:02.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.998+0000 7fd7b29ff700 1 Processor -- start 2023-07-27T14:35:02.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.998+0000 7fd7b29ff700 1 -- start start 2023-07-27T14:35:02.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b29ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac136c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b29ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7ac0bc050 0x7fd7ac13b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b29ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7ac151bd0 0x7fd7ac13ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b29ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac13ccb0 con 0x7fd7ac151bd0 2023-07-27T14:35:02.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b29ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac13d140 con 0x7fd7ac0bc050 2023-07-27T14:35:02.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b29ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac13c0a0 con 0x7fd7ac0a4840 2023-07-27T14:35:02.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b0f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7ac151bd0 0x7fd7ac13ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b0f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7ac151bd0 0x7fd7ac13ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41354/0 (socket says 172.21.15.115:41354) 2023-07-27T14:35:02.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7b0f9c700 1 -- 172.21.15.115:0/1756106862 learned_addr learned my addr 172.21.15.115:0/1756106862 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:02.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7abfff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:01.999+0000 7fd7ab7fe700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7ac0bc050 0x7fd7ac13b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd7b0f9c700 1 -- 172.21.15.115:0/1756106862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 msgr2=0x7fd7ac136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd7b0f9c700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd7b0f9c700 1 -- 172.21.15.115:0/1756106862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7ac0bc050 msgr2=0x7fd7ac13b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd7b0f9c700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7ac0bc050 0x7fd7ac13b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd7b0f9c700 1 -- 172.21.15.115:0/1756106862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a0009370 con 0x7fd7ac151bd0 2023-07-27T14:35:02.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd7b0f9c700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7ac151bd0 0x7fd7ac13ba90 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fd7a4009e90 tx=0x7fd7a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:02.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd793fff700 1 -- 172.21.15.115:0/1756106862 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400caa0 con 0x7fd7ac151bd0 2023-07-27T14:35:02.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd793fff700 1 -- 172.21.15.115:0/1756106862 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a400f040 con 0x7fd7ac151bd0 2023-07-27T14:35:02.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd793fff700 1 -- 172.21.15.115:0/1756106862 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400ce10 con 0x7fd7ac151bd0 2023-07-27T14:35:02.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac13c380 con 0x7fd7ac151bd0 2023-07-27T14:35:02.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.000+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac13c940 con 0x7fd7ac151bd0 2023-07-27T14:35:02.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.001+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ac06c470 con 0x7fd7ac151bd0 2023-07-27T14:35:02.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.002+0000 7fd793fff700 1 -- 172.21.15.115:0/1756106862 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fd7a4013610 con 0x7fd7ac151bd0 2023-07-27T14:35:02.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.003+0000 7fd793fff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd79805f720 0x7fd798061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.003+0000 7fd793fff700 1 -- 172.21.15.115:0/1756106862 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd7a407b060 con 0x7fd7ac151bd0 2023-07-27T14:35:02.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.003+0000 7fd7abfff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd79805f720 0x7fd798061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.004+0000 7fd7abfff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd79805f720 0x7fd798061be0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fd79c0011e0 tx=0x7fd79c007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:02.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.007+0000 7fd793fff700 1 -- 172.21.15.115:0/1756106862 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7a404bfe0 con 0x7fd7ac151bd0 2023-07-27T14:35:02.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.179+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7ac13cdf0 con 0x7fd7ac151bd0 2023-07-27T14:35:02.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.180+0000 7fd793fff700 1 -- 172.21.15.115:0/1756106862 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+17099 (secure 0 0 0) 0x7fd7a404f600 con 0x7fd7ac151bd0 2023-07-27T14:35:02.223 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:35:02.223 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":141,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:35:01.358973+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:34:59.767019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-27T14:35:00.338085+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:35:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd79805f720 msgr2=0x7fd798061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd79805f720 0x7fd798061be0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fd79c0011e0 tx=0x7fd79c007bd0).stop 2023-07-27T14:35:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7ac151bd0 msgr2=0x7fd7ac13ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7ac151bd0 0x7fd7ac13ba90 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fd7a4009e90 tx=0x7fd7a400b040).stop 2023-07-27T14:35:02.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 shutdown_connections 2023-07-27T14:35:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd79805f720 0x7fd798061be0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7ac151bd0 0x7fd7ac13ba90 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7ac0a4840 0x7fd7ac136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 --2- 172.21.15.115:0/1756106862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7ac0bc050 0x7fd7ac13b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 >> 172.21.15.115:0/1756106862 conn(0x7fd7ac064700 msgr2=0x7fd7ac065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 shutdown_connections 2023-07-27T14:35:02.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.182+0000 7fd7b29ff700 1 -- 172.21.15.115:0/1756106862 wait complete. 2023-07-27T14:35:02.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:35:02.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.392+0000 7f13ca5ff700 1 Processor -- start 2023-07-27T14:35:02.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.392+0000 7f13ca5ff700 1 -- start start 2023-07-27T14:35:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.393+0000 7f13ca5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c41509b0 0x7f13c40c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.393+0000 7f13ca5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f13c40c3100 0x7f13c40c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.393+0000 7f13ca5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c40c0ea0 con 0x7f13c4150d90 2023-07-27T14:35:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.393+0000 7f13ca5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c4068e10 con 0x7f13c40c3100 2023-07-27T14:35:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.393+0000 7f13ca5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4155190 con 0x7f13c41509b0 2023-07-27T14:35:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c8b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f13c40c3100 0x7f13c40c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c8b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f13c40c3100 0x7f13c40c35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41356/0 (socket says 172.21.15.115:41356) 2023-07-27T14:35:02.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c8b9c700 1 -- 172.21.15.115:0/4055727366 learned_addr learned my addr 172.21.15.115:0/4055727366 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c8b9c700 1 -- 172.21.15.115:0/4055727366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c41509b0 msgr2=0x7f13c40c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c3fff700 1 --2- 172.21.15.115:0/4055727366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c41509b0 0x7f13c40c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c8b9c700 1 --2- 172.21.15.115:0/4055727366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c41509b0 0x7f13c40c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c8b9c700 1 -- 172.21.15.115:0/4055727366 >> v1:172.21.15.115:6789/0 conn(0x7f13c4150d90 legacy=0x7f13c4154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c8b9c700 1 -- 172.21.15.115:0/4055727366 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4155470 con 0x7f13c40c3100 2023-07-27T14:35:02.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c3fff700 1 --2- 172.21.15.115:0/4055727366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c41509b0 0x7f13c40c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.394+0000 7f13c8b9c700 1 --2- 172.21.15.115:0/4055727366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c40c3100 0x7f13c40c35b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f13bc009f20 tx=0x7f13bc009840).ready entity=mon.0 client_cookie=91d0e8100d25a5bd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13c2ffd700 1 -- 172.21.15.115:0/4055727366 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00e070 con 0x7f13c40c3100 2023-07-27T14:35:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13c2ffd700 1 -- 172.21.15.115:0/4055727366 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00ba80 con 0x7f13c40c3100 2023-07-27T14:35:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13c2ffd700 1 -- 172.21.15.115:0/4055727366 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00be00 con 0x7f13c40c3100 2023-07-27T14:35:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13ca5ff700 1 -- 172.21.15.115:0/4055727366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c40c3100 msgr2=0x7f13c40c35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/4055727366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c40c3100 0x7f13c40c35b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f13bc009f20 tx=0x7f13bc009840).stop 2023-07-27T14:35:02.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13ca5ff700 1 -- 172.21.15.115:0/4055727366 shutdown_connections 2023-07-27T14:35:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/4055727366 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c41509b0 0x7f13c40c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/4055727366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c40c3100 0x7f13c40c35b0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13ca5ff700 1 -- 172.21.15.115:0/4055727366 >> 172.21.15.115:0/4055727366 conn(0x7f13c4062320 msgr2=0x7f13c4062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13ca5ff700 1 -- 172.21.15.115:0/4055727366 shutdown_connections 2023-07-27T14:35:02.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.395+0000 7f13ca5ff700 1 -- 172.21.15.115:0/4055727366 wait complete. 2023-07-27T14:35:02.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.397+0000 7f13ca5ff700 1 Processor -- start 2023-07-27T14:35:02.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.397+0000 7f13ca5ff700 1 -- start start 2023-07-27T14:35:02.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13ca5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c40c3100 0x7f13c414b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13ca5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c41509b0 0x7f13c40a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13ca5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c4150d90 0x7f13c40a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13ca5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c414bd10 con 0x7f13c41509b0 2023-07-27T14:35:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13ca5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40be5f0 con 0x7f13c40c3100 2023-07-27T14:35:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13ca5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40a8ab0 con 0x7f13c4150d90 2023-07-27T14:35:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c41509b0 0x7f13c40a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c41509b0 0x7f13c40a8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41370/0 (socket says 172.21.15.115:41370) 2023-07-27T14:35:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c37fe700 1 -- 172.21.15.115:0/2759438718 learned_addr learned my addr 172.21.15.115:0/2759438718 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:02.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c3fff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c40c3100 0x7f13c414b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c8b9c700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c4150d90 0x7f13c40a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c37fe700 1 -- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c4150d90 msgr2=0x7f13c40a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c37fe700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c4150d90 0x7f13c40a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c37fe700 1 -- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c40c3100 msgr2=0x7f13c414b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c37fe700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c40c3100 0x7f13c414b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c37fe700 1 -- 172.21.15.115:0/2759438718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc009ae0 con 0x7f13c41509b0 2023-07-27T14:35:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.398+0000 7f13c3fff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c40c3100 0x7f13c414b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:02.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.399+0000 7f13c37fe700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c41509b0 0x7f13c40a8f40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f13b800c440 tx=0x7f13b8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.399+0000 7f13abfff700 1 -- 172.21.15.115:0/2759438718 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b800ce90 con 0x7f13c41509b0 2023-07-27T14:35:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.399+0000 7f13abfff700 1 -- 172.21.15.115:0/2759438718 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b8007020 con 0x7f13c41509b0 2023-07-27T14:35:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.399+0000 7f13abfff700 1 -- 172.21.15.115:0/2759438718 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b80073c0 con 0x7f13c41509b0 2023-07-27T14:35:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.399+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c40a9430 con 0x7f13c41509b0 2023-07-27T14:35:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.399+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c40a8180 con 0x7f13c41509b0 2023-07-27T14:35:02.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.400+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c406c470 con 0x7f13c41509b0 2023-07-27T14:35:02.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.401+0000 7f13abfff700 1 -- 172.21.15.115:0/2759438718 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f13b8010070 con 0x7f13c41509b0 2023-07-27T14:35:02.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.402+0000 7f13abfff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f13b005f720 0x7f13b0061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:02.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.402+0000 7f13abfff700 1 -- 172.21.15.115:0/2759438718 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f13b807a420 con 0x7f13c41509b0 2023-07-27T14:35:02.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.403+0000 7f13c3fff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f13b005f720 0x7f13b0061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:02.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.403+0000 7f13c3fff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f13b005f720 0x7f13b0061be0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f13b400aa90 tx=0x7f13b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:02.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.406+0000 7f13abfff700 1 -- 172.21.15.115:0/2759438718 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13b804af20 con 0x7f13c41509b0 2023-07-27T14:35:02.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:02.619+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f13c4155750 con 0x7f13c41509b0 2023-07-27T14:35:03.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.371+0000 7f13abfff700 1 -- 172.21.15.115:0/2759438718 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f13b804e540 con 0x7f13c41509b0 2023-07-27T14:35:03.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f13b005f720 msgr2=0x7f13b0061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:03.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f13b005f720 0x7f13b0061be0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f13b400aa90 tx=0x7f13b4008040).stop 2023-07-27T14:35:03.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c41509b0 msgr2=0x7f13c40a8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:03.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c41509b0 0x7f13c40a8f40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f13b800c440 tx=0x7f13b8007dd0).stop 2023-07-27T14:35:03.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 shutdown_connections 2023-07-27T14:35:03.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f13b005f720 0x7f13b0061be0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f13c4150d90 0x7f13c40a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c40c3100 0x7f13c414b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 --2- 172.21.15.115:0/2759438718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13c41509b0 0x7f13c40a8f40 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.374+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 >> 172.21.15.115:0/2759438718 conn(0x7f13c4062320 msgr2=0x7f13c40c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:03.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.375+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 shutdown_connections 2023-07-27T14:35:03.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.375+0000 7f13ca5ff700 1 -- 172.21.15.115:0/2759438718 wait complete. 2023-07-27T14:35:03.439 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:35:03.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:35:03.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.590+0000 7fc2285ff700 1 Processor -- start 2023-07-27T14:35:03.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.590+0000 7fc2285ff700 1 -- start start 2023-07-27T14:35:03.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.591+0000 7fc2285ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014ae00 0x7fc220154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:03.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.591+0000 7fc2285ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc22014b1e0 0x7fc220062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:03.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.591+0000 7fc2285ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc2200c5c50 0x7fc220063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:03.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.591+0000 7fc2285ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc220063530 con 0x7fc22014b1e0 2023-07-27T14:35:03.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.591+0000 7fc2285ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2201553f0 con 0x7fc2200c5c50 2023-07-27T14:35:03.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.591+0000 7fc2285ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc220157a50 con 0x7fc22014ae00 2023-07-27T14:35:03.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.591+0000 7fc225b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc22014b1e0 0x7fc220062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:03.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc22014b1e0 0x7fc220062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38070/0 (socket says 172.21.15.115:38070) 2023-07-27T14:35:03.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225b9a700 1 -- 172.21.15.115:0/1743083284 learned_addr learned my addr 172.21.15.115:0/1743083284 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:03.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc22639b700 1 --2- 172.21.15.115:0/1743083284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014ae00 0x7fc220154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:03.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc226b9c700 1 --2- 172.21.15.115:0/1743083284 >> v2:172.21.15.159:3300/0 conn(0x7fc2200c5c50 0x7fc220063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:03.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225b9a700 1 -- 172.21.15.115:0/1743083284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014ae00 msgr2=0x7fc220154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:03.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225b9a700 1 --2- 172.21.15.115:0/1743083284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014ae00 0x7fc220154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225b9a700 1 -- 172.21.15.115:0/1743083284 >> v2:172.21.15.159:3300/0 conn(0x7fc2200c5c50 msgr2=0x7fc220063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:03.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225b9a700 1 --2- 172.21.15.115:0/1743083284 >> v2:172.21.15.159:3300/0 conn(0x7fc2200c5c50 0x7fc220063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225b9a700 1 -- 172.21.15.115:0/1743083284 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc220157d10 con 0x7fc22014b1e0 2023-07-27T14:35:03.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc226b9c700 1 --2- 172.21.15.115:0/1743083284 >> v2:172.21.15.159:3300/0 conn(0x7fc2200c5c50 0x7fc220063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:03.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225b9a700 1 --2- 172.21.15.115:0/1743083284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc22014b1e0 0x7fc220062b50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fc22005fbe0 tx=0x7fc2100090f0).ready entity=mon.0 client_cookie=e5a995d12ab2ff20 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:03.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225399700 1 -- 172.21.15.115:0/1743083284 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000b520 con 0x7fc22014b1e0 2023-07-27T14:35:03.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.592+0000 7fc225399700 1 -- 172.21.15.115:0/1743083284 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21000b680 con 0x7fc22014b1e0 2023-07-27T14:35:03.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc225399700 1 -- 172.21.15.115:0/1743083284 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000ba00 con 0x7fc22014b1e0 2023-07-27T14:35:03.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 -- 172.21.15.115:0/1743083284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc22014b1e0 msgr2=0x7fc220062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:03.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1743083284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc22014b1e0 0x7fc220062b50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fc22005fbe0 tx=0x7fc2100090f0).stop 2023-07-27T14:35:03.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 -- 172.21.15.115:0/1743083284 shutdown_connections 2023-07-27T14:35:03.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1743083284 >> v2:172.21.15.159:3300/0 conn(0x7fc2200c5c50 0x7fc220063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1743083284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014ae00 0x7fc220154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1743083284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc22014b1e0 0x7fc220062b50 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 -- 172.21.15.115:0/1743083284 >> 172.21.15.115:0/1743083284 conn(0x7fc22005e940 msgr2=0x7fc2200cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:03.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 -- 172.21.15.115:0/1743083284 shutdown_connections 2023-07-27T14:35:03.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.593+0000 7fc2285ff700 1 -- 172.21.15.115:0/1743083284 wait complete. 2023-07-27T14:35:03.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.595+0000 7fc2285ff700 1 Processor -- start 2023-07-27T14:35:03.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.595+0000 7fc2285ff700 1 -- start start 2023-07-27T14:35:03.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc2285ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2200c5c50 0x7fc220164cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:03.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc2285ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc22014ae00 0x7fc220149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:03.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc2285ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014b1e0 0x7fc2200c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:03.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc2285ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22014a4a0 con 0x7fc2200c5c50 2023-07-27T14:35:03.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc2285ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200c3040 con 0x7fc22014ae00 2023-07-27T14:35:03.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc2285ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200c2430 con 0x7fc22014b1e0 2023-07-27T14:35:03.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc22639b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2200c5c50 0x7fc220164cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:03.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc22639b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2200c5c50 0x7fc220164cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38080/0 (socket says 172.21.15.115:38080) 2023-07-27T14:35:03.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc22639b700 1 -- 172.21.15.115:0/1950744001 learned_addr learned my addr 172.21.15.115:0/1950744001 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:03.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc226b9c700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014b1e0 0x7fc2200c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:03.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc22639b700 1 -- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014b1e0 msgr2=0x7fc2200c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:03.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc225b9a700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc22014ae00 0x7fc220149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:03.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc22639b700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014b1e0 0x7fc2200c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc22639b700 1 -- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc22014ae00 msgr2=0x7fc220149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:03.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc22639b700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc22014ae00 0x7fc220149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:03.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc22639b700 1 -- 172.21.15.115:0/1950744001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009370 con 0x7fc2200c5c50 2023-07-27T14:35:03.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc225b9a700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc22014ae00 0x7fc220149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:03.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.597+0000 7fc226b9c700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014b1e0 0x7fc2200c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:03.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.598+0000 7fc22639b700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2200c5c50 0x7fc220164cf0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fc21c00e930 tx=0x7fc21c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:03.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.598+0000 7fc2167fc700 1 -- 172.21.15.115:0/1950744001 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00eed0 con 0x7fc2200c5c50 2023-07-27T14:35:03.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.598+0000 7fc2167fc700 1 -- 172.21.15.115:0/1950744001 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c00c850 con 0x7fc2200c5c50 2023-07-27T14:35:03.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.598+0000 7fc2167fc700 1 -- 172.21.15.115:0/1950744001 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00cbd0 con 0x7fc2200c5c50 2023-07-27T14:35:03.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.598+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2200c2710 con 0x7fc2200c5c50 2023-07-27T14:35:03.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.598+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2200c2cd0 con 0x7fc2200c5c50 2023-07-27T14:35:03.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.599+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2200c9a10 con 0x7fc2200c5c50 2023-07-27T14:35:03.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.600+0000 7fc2167fc700 1 -- 172.21.15.115:0/1950744001 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fc21c022070 con 0x7fc2200c5c50 2023-07-27T14:35:03.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.601+0000 7fc2167fc700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20405f720 0x7fc204061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:03.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.601+0000 7fc2167fc700 1 -- 172.21.15.115:0/1950744001 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc21c07afc0 con 0x7fc2200c5c50 2023-07-27T14:35:03.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.601+0000 7fc225b9a700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20405f720 0x7fc204061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:03.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.602+0000 7fc225b9a700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20405f720 0x7fc204061be0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fc2200c1c00 tx=0x7fc210017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:03.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.605+0000 7fc2167fc700 1 -- 172.21.15.115:0/1950744001 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc21c04bac0 con 0x7fc2200c5c50 2023-07-27T14:35:03.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:03.819+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc22006c470 con 0x7fc2200c5c50 2023-07-27T14:35:04.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.378+0000 7fc2167fc700 1 -- 172.21.15.115:0/1950744001 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc21c04f0e0 con 0x7fc2200c5c50 2023-07-27T14:35:04.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20405f720 msgr2=0x7fc204061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:04.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20405f720 0x7fc204061be0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fc2200c1c00 tx=0x7fc210017000).stop 2023-07-27T14:35:04.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2200c5c50 msgr2=0x7fc220164cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:04.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2200c5c50 0x7fc220164cf0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fc21c00e930 tx=0x7fc21c009060).stop 2023-07-27T14:35:04.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 shutdown_connections 2023-07-27T14:35:04.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20405f720 0x7fc204061be0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc22014b1e0 0x7fc2200c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2200c5c50 0x7fc220164cf0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 --2- 172.21.15.115:0/1950744001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc22014ae00 0x7fc220149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 >> 172.21.15.115:0/1950744001 conn(0x7fc22005e940 msgr2=0x7fc2200a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:04.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 shutdown_connections 2023-07-27T14:35:04.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.381+0000 7fc2285ff700 1 -- 172.21.15.115:0/1950744001 wait complete. 2023-07-27T14:35:04.444 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:35:04.445 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:35:04.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.590+0000 7f2ed4fff700 1 Processor -- start 2023-07-27T14:35:04.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.590+0000 7f2ed4fff700 1 -- start start 2023-07-27T14:35:04.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.591+0000 7f2ed4fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ed00c3470 0x7f2ed0064b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:04.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.591+0000 7f2ed4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3850 0x7f2ed014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:04.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.591+0000 7f2ed4fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed01532a0 con 0x7f2ed014f9b0 2023-07-27T14:35:04.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.591+0000 7f2ed4fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed0064060 con 0x7f2ed00c3470 2023-07-27T14:35:04.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.591+0000 7f2ed4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0064340 con 0x7f2ed00c3850 2023-07-27T14:35:04.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ece59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ed00c3470 0x7f2ed0064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:04.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ece59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ed00c3470 0x7f2ed0064b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38090/0 (socket says 172.21.15.115:38090) 2023-07-27T14:35:04.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ece59c700 1 -- 172.21.15.115:0/2965295204 learned_addr learned my addr 172.21.15.115:0/2965295204 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:04.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2eced9d700 1 --1- 172.21.15.115:0/2965295204 >> v1:172.21.15.115:6789/0 conn(0x7f2ed014f9b0 0x7f2ed0152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46674/0 (socket says 172.21.15.115:46674) 2023-07-27T14:35:04.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ecdd9b700 1 --2- 172.21.15.115:0/2965295204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3850 0x7f2ed014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:04.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ece59c700 1 -- 172.21.15.115:0/2965295204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3850 msgr2=0x7f2ed014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:04.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ece59c700 1 --2- 172.21.15.115:0/2965295204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3850 0x7f2ed014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ece59c700 1 -- 172.21.15.115:0/2965295204 >> v1:172.21.15.115:6789/0 conn(0x7f2ed014f9b0 legacy=0x7f2ed0152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:04.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ece59c700 1 -- 172.21.15.115:0/2965295204 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0064620 con 0x7f2ed00c3470 2023-07-27T14:35:04.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ecdd9b700 1 --2- 172.21.15.115:0/2965295204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3850 0x7f2ed014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:04.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.592+0000 7f2ece59c700 1 --2- 172.21.15.115:0/2965295204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3470 0x7f2ed0064b40 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f2ec0006fd0 tx=0x7f2ec00090f0).ready entity=mon.0 client_cookie=90a714e24ffe50e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:04.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ecd59a700 1 -- 172.21.15.115:0/2965295204 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000b600 con 0x7f2ed00c3470 2023-07-27T14:35:04.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ecd59a700 1 -- 172.21.15.115:0/2965295204 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000b760 con 0x7f2ed00c3470 2023-07-27T14:35:04.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ecd59a700 1 -- 172.21.15.115:0/2965295204 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000bae0 con 0x7f2ed00c3470 2023-07-27T14:35:04.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ed4fff700 1 -- 172.21.15.115:0/2965295204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3470 msgr2=0x7f2ed0064b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:04.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/2965295204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3470 0x7f2ed0064b40 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f2ec0006fd0 tx=0x7f2ec00090f0).stop 2023-07-27T14:35:04.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ed4fff700 1 -- 172.21.15.115:0/2965295204 shutdown_connections 2023-07-27T14:35:04.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/2965295204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3470 0x7f2ed0064b40 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/2965295204 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3850 0x7f2ed014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ed4fff700 1 -- 172.21.15.115:0/2965295204 >> 172.21.15.115:0/2965295204 conn(0x7f2ed0062320 msgr2=0x7f2ed0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:04.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ed4fff700 1 -- 172.21.15.115:0/2965295204 shutdown_connections 2023-07-27T14:35:04.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.593+0000 7f2ed4fff700 1 -- 172.21.15.115:0/2965295204 wait complete. 2023-07-27T14:35:04.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.595+0000 7f2ed4fff700 1 Processor -- start 2023-07-27T14:35:04.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.595+0000 7f2ed4fff700 1 -- start start 2023-07-27T14:35:04.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ed4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3470 0x7f2ed0135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:04.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ed4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3850 0x7f2ed00bd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:04.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ed4fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed014f9b0 0x7f2ed00c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:04.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ed4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed01364b0 con 0x7f2ed00c3850 2023-07-27T14:35:04.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ed4fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0168020 con 0x7f2ed014f9b0 2023-07-27T14:35:04.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ed4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0167a10 con 0x7f2ed00c3470 2023-07-27T14:35:04.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ecdd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3850 0x7f2ed00bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:04.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ecdd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3850 0x7f2ed00bd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38098/0 (socket says 172.21.15.115:38098) 2023-07-27T14:35:04.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ecdd9b700 1 -- 172.21.15.115:0/1573181092 learned_addr learned my addr 172.21.15.115:0/1573181092 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:04.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ece59c700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3470 0x7f2ed0135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:04.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2eced9d700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed014f9b0 0x7f2ed00c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:04.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ecdd9b700 1 -- 172.21.15.115:0/1573181092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3470 msgr2=0x7f2ed0135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:04.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ecdd9b700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3470 0x7f2ed0135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ecdd9b700 1 -- 172.21.15.115:0/1573181092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed014f9b0 msgr2=0x7f2ed00c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:04.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ecdd9b700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed014f9b0 0x7f2ed00c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.596+0000 7f2ecdd9b700 1 -- 172.21.15.115:0/1573181092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0009370 con 0x7f2ed00c3850 2023-07-27T14:35:04.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.597+0000 7f2ecdd9b700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3850 0x7f2ed00bd920 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f2ec400d860 tx=0x7f2ec4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:04.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.597+0000 7f2ebe7fc700 1 -- 172.21.15.115:0/1573181092 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4011590 con 0x7f2ed00c3850 2023-07-27T14:35:04.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.597+0000 7f2ebe7fc700 1 -- 172.21.15.115:0/1573181092 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec40116f0 con 0x7f2ed00c3850 2023-07-27T14:35:04.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.597+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed00be290 con 0x7f2ed00c3850 2023-07-27T14:35:04.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.597+0000 7f2ebe7fc700 1 -- 172.21.15.115:0/1573181092 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4011a70 con 0x7f2ed00c3850 2023-07-27T14:35:04.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.597+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed0167cb0 con 0x7f2ed00c3850 2023-07-27T14:35:04.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.598+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed00be790 con 0x7f2ed00c3850 2023-07-27T14:35:04.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.599+0000 7f2ebe7fc700 1 -- 172.21.15.115:0/1573181092 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f2ec4012420 con 0x7f2ed00c3850 2023-07-27T14:35:04.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.599+0000 7f2ebe7fc700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2eb005f720 0x7f2eb0061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:04.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.600+0000 7f2ebe7fc700 1 -- 172.21.15.115:0/1573181092 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2ec407a730 con 0x7f2ed00c3850 2023-07-27T14:35:04.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.600+0000 7f2ece59c700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2eb005f720 0x7f2eb0061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:04.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.600+0000 7f2ece59c700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2eb005f720 0x7f2eb0061be0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f2ec000b3c0 tx=0x7f2ec0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:04.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.603+0000 7f2ebe7fc700 1 -- 172.21.15.115:0/1573181092 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ed00be790 con 0x7f2ed00c3850 2023-07-27T14:35:04.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.813+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ed00be790 con 0x7f2ed00c3850 2023-07-27T14:35:04.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.813+0000 7f2ebe7fc700 1 -- 172.21.15.115:0/1573181092 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f2ed00be790 con 0x7f2ed00c3850 2023-07-27T14:35:04.857 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:35:04.858 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/231954123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":231954123},{"type":"v1","addr":"172.21.15.159:6834","nonce":231954123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7432,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3337360418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3337360418},{"type":"v1","addr":"172.21.15.159:6835","nonce":3337360418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2630769428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2630769428},{"type":"v1","addr":"172.21.15.115:6836","nonce":2630769428}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:35:01.359343+0000","modified":"2023-07-27T14:35:04.371738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2708675397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2708675397},{"type":"v1","addr":"172.21.15.115:6837","nonce":2708675397}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-07-27T14:35:04.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2eb005f720 msgr2=0x7f2eb0061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:04.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2eb005f720 0x7f2eb0061be0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f2ec000b3c0 tx=0x7f2ec0017000).stop 2023-07-27T14:35:04.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3850 msgr2=0x7f2ed00bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:04.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3850 0x7f2ed00bd920 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f2ec400d860 tx=0x7f2ec4008040).stop 2023-07-27T14:35:04.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 shutdown_connections 2023-07-27T14:35:04.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2eb005f720 0x7f2eb0061be0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed014f9b0 0x7f2ed00c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed00c3470 0x7f2ed0135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 --2- 172.21.15.115:0/1573181092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed00c3850 0x7f2ed00bd920 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:04.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 >> 172.21.15.115:0/1573181092 conn(0x7f2ed0062320 msgr2=0x7f2ed0151430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:04.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 shutdown_connections 2023-07-27T14:35:04.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:04.815+0000 7f2ed4fff700 1 -- 172.21.15.115:0/1573181092 wait complete. 2023-07-27T14:35:04.861 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 76 2023-07-27T14:35:04.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:35:05.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.020+0000 7f38a0dff700 1 Processor -- start 2023-07-27T14:35:05.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.021+0000 7f38a0dff700 1 -- start start 2023-07-27T14:35:05.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f38a0dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f389c153ec0 0x7f389c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f38a0dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f389c0aaa40 0x7f389c0c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f38a0dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389c0aa4d0 con 0x7f389c0aa050 2023-07-27T14:35:05.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f38a0dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c0c05c0 con 0x7f389c153ec0 2023-07-27T14:35:05.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f38a0dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c0bfc90 con 0x7f389c0aaa40 2023-07-27T14:35:05.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f389a59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f389c153ec0 0x7f389c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f389a59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f389c153ec0 0x7f389c0a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38112/0 (socket says 172.21.15.115:38112) 2023-07-27T14:35:05.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f389a59c700 1 -- 172.21.15.115:0/507135254 learned_addr learned my addr 172.21.15.115:0/507135254 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:05.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f389ad9d700 1 --2- 172.21.15.115:0/507135254 >> v2:172.21.15.159:3300/0 conn(0x7f389c0aaa40 0x7f389c0c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f389a59c700 1 -- 172.21.15.115:0/507135254 >> v2:172.21.15.159:3300/0 conn(0x7f389c0aaa40 msgr2=0x7f389c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:05.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f389a59c700 1 --2- 172.21.15.115:0/507135254 >> v2:172.21.15.159:3300/0 conn(0x7f389c0aaa40 0x7f389c0c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.022+0000 7f389a59c700 1 -- 172.21.15.115:0/507135254 >> v1:172.21.15.115:6789/0 conn(0x7f389c0aa050 legacy=0x7f389c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f389a59c700 1 -- 172.21.15.115:0/507135254 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c0bff70 con 0x7f389c153ec0 2023-07-27T14:35:05.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f389ad9d700 1 --2- 172.21.15.115:0/507135254 >> v2:172.21.15.159:3300/0 conn(0x7f389c0aaa40 0x7f389c0c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:05.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f389a59c700 1 --2- 172.21.15.115:0/507135254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c153ec0 0x7f389c0a9b60 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f389c0c5470 tx=0x7f388c0090f0).ready entity=mon.0 client_cookie=a809b0c288435947 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f389959a700 1 -- 172.21.15.115:0/507135254 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00b600 con 0x7f389c153ec0 2023-07-27T14:35:05.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f389959a700 1 -- 172.21.15.115:0/507135254 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00b760 con 0x7f389c153ec0 2023-07-27T14:35:05.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f389959a700 1 -- 172.21.15.115:0/507135254 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00bae0 con 0x7f389c153ec0 2023-07-27T14:35:05.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f38a0dff700 1 -- 172.21.15.115:0/507135254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c153ec0 msgr2=0x7f389c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f38a0dff700 1 --2- 172.21.15.115:0/507135254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c153ec0 0x7f389c0a9b60 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f389c0c5470 tx=0x7f388c0090f0).stop 2023-07-27T14:35:05.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.023+0000 7f38a0dff700 1 -- 172.21.15.115:0/507135254 shutdown_connections 2023-07-27T14:35:05.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.024+0000 7f38a0dff700 1 --2- 172.21.15.115:0/507135254 >> v2:172.21.15.159:3300/0 conn(0x7f389c0aaa40 0x7f389c0c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.024+0000 7f38a0dff700 1 --2- 172.21.15.115:0/507135254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c153ec0 0x7f389c0a9b60 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.024+0000 7f38a0dff700 1 -- 172.21.15.115:0/507135254 >> 172.21.15.115:0/507135254 conn(0x7f389c0cb610 msgr2=0x7f389c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:05.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.024+0000 7f38a0dff700 1 -- 172.21.15.115:0/507135254 shutdown_connections 2023-07-27T14:35:05.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.024+0000 7f38a0dff700 1 -- 172.21.15.115:0/507135254 wait complete. 2023-07-27T14:35:05.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.025+0000 7f38a0dff700 1 Processor -- start 2023-07-27T14:35:05.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.025+0000 7f38a0dff700 1 -- start start 2023-07-27T14:35:05.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f38a0dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389c0aa050 0x7f389c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f38a0dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c0aaa40 0x7f389c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f38a0dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389c153ec0 0x7f389c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f38a0dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c150ca0 con 0x7f389c0aaa40 2023-07-27T14:35:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f38a0dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c0af620 con 0x7f389c0aa050 2023-07-27T14:35:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f38a0dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389c151180 con 0x7f389c153ec0 2023-07-27T14:35:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f3899d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c0aaa40 0x7f389c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f3899d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c0aaa40 0x7f389c1502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38114/0 (socket says 172.21.15.115:38114) 2023-07-27T14:35:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.026+0000 7f3899d9b700 1 -- 172.21.15.115:0/991059581 learned_addr learned my addr 172.21.15.115:0/991059581 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:05.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f389a59c700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389c0aa050 0x7f389c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f389ad9d700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389c153ec0 0x7f389c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f3899d9b700 1 -- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389c153ec0 msgr2=0x7f389c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f3899d9b700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389c153ec0 0x7f389c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f3899d9b700 1 -- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389c0aa050 msgr2=0x7f389c14cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f3899d9b700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389c0aa050 0x7f389c14cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f3899d9b700 1 -- 172.21.15.115:0/991059581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c009370 con 0x7f389c0aaa40 2023-07-27T14:35:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f389a59c700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389c0aa050 0x7f389c14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f3899d9b700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c0aaa40 0x7f389c1502c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f389000c4c0 tx=0x7f3890007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f388a7fc700 1 -- 172.21.15.115:0/991059581 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890007020 con 0x7f389c0aaa40 2023-07-27T14:35:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f388a7fc700 1 -- 172.21.15.115:0/991059581 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890001e90 con 0x7f389c0aaa40 2023-07-27T14:35:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c0aea10 con 0x7f389c0aaa40 2023-07-27T14:35:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f388a7fc700 1 -- 172.21.15.115:0/991059581 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38900073b0 con 0x7f389c0aaa40 2023-07-27T14:35:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.027+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c0aefd0 con 0x7f389c0aaa40 2023-07-27T14:35:05.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.028+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c0af7d0 con 0x7f389c0aaa40 2023-07-27T14:35:05.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.029+0000 7f388a7fc700 1 -- 172.21.15.115:0/991059581 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f3890010070 con 0x7f389c0aaa40 2023-07-27T14:35:05.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.030+0000 7f388a7fc700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05f6f0 0x7f387c061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.030+0000 7f388a7fc700 1 -- 172.21.15.115:0/991059581 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f389007a190 con 0x7f389c0aaa40 2023-07-27T14:35:05.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.030+0000 7f389a59c700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05f6f0 0x7f387c061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.031+0000 7f389a59c700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05f6f0 0x7f387c061bb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f388c009130 tx=0x7f388c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.034+0000 7f388a7fc700 1 -- 172.21.15.115:0/991059581 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f389004ada0 con 0x7f389c0aaa40 2023-07-27T14:35:05.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.201+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f389c06c470 con 0x7f389c0aaa40 2023-07-27T14:35:05.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.202+0000 7f388a7fc700 1 -- 172.21.15.115:0/991059581 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+17086 (secure 0 0 0) 0x7f389004e3c0 con 0x7f389c0aaa40 2023-07-27T14:35:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:35:05.247 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":142,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:35:02.361753+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:34:59.767019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-27T14:35:00.338085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:35:05.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05f6f0 msgr2=0x7f387c061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05f6f0 0x7f387c061bb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f388c009130 tx=0x7f388c017000).stop 2023-07-27T14:35:05.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c0aaa40 msgr2=0x7f389c1502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c0aaa40 0x7f389c1502c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f389000c4c0 tx=0x7f3890007e00).stop 2023-07-27T14:35:05.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 shutdown_connections 2023-07-27T14:35:05.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05f6f0 0x7f387c061bb0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389c153ec0 0x7f389c1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389c0aa050 0x7f389c14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 --2- 172.21.15.115:0/991059581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389c0aaa40 0x7f389c1502c0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.204+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 >> 172.21.15.115:0/991059581 conn(0x7f389c0cb610 msgr2=0x7f389c0acf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:05.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.205+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 shutdown_connections 2023-07-27T14:35:05.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.205+0000 7f38a0dff700 1 -- 172.21.15.115:0/991059581 wait complete. 2023-07-27T14:35:05.266 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:35:05.267 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:35:05.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.411+0000 7f8e209ff700 1 Processor -- start 2023-07-27T14:35:05.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.412+0000 7f8e209ff700 1 -- start start 2023-07-27T14:35:05.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e209ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e1c0c1f70 0x7f8e1c150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e209ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8e1c0c0e80 0x7f8e1c069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e209ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c068380 con 0x7f8e1c150320 2023-07-27T14:35:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e209ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c065790 con 0x7f8e1c0c1f70 2023-07-27T14:35:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e209ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c068ee0 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e19d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e1c0c1f70 0x7f8e1c150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e19d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e1c0c1f70 0x7f8e1c150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38122/0 (socket says 172.21.15.115:38122) 2023-07-27T14:35:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e19d9b700 1 -- 172.21.15.115:0/2689998098 learned_addr learned my addr 172.21.15.115:0/2689998098 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e1ad9d700 1 --2- 172.21.15.115:0/2689998098 >> v2:172.21.15.159:3300/0 conn(0x7f8e1c0c0e80 0x7f8e1c069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e19d9b700 1 -- 172.21.15.115:0/2689998098 >> v2:172.21.15.159:3300/0 conn(0x7f8e1c0c0e80 msgr2=0x7f8e1c069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e19d9b700 1 --2- 172.21.15.115:0/2689998098 >> v2:172.21.15.159:3300/0 conn(0x7f8e1c0c0e80 0x7f8e1c069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e19d9b700 1 -- 172.21.15.115:0/2689998098 >> v1:172.21.15.115:6789/0 conn(0x7f8e1c150320 legacy=0x7f8e1c0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e19d9b700 1 -- 172.21.15.115:0/2689998098 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0685b0 con 0x7f8e1c0c1f70 2023-07-27T14:35:05.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e1ad9d700 1 --2- 172.21.15.115:0/2689998098 >> v2:172.21.15.159:3300/0 conn(0x7f8e1c0c0e80 0x7f8e1c069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:05.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.414+0000 7f8e19d9b700 1 --2- 172.21.15.115:0/2689998098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c1f70 0x7f8e1c150700 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f8e1c068150 tx=0x7f8e1000b3b0).ready entity=mon.0 client_cookie=60856b7f2c94baf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e1959a700 1 -- 172.21.15.115:0/2689998098 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000db10 con 0x7f8e1c0c1f70 2023-07-27T14:35:05.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e1959a700 1 -- 172.21.15.115:0/2689998098 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000dc70 con 0x7f8e1c0c1f70 2023-07-27T14:35:05.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e1959a700 1 -- 172.21.15.115:0/2689998098 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10010470 con 0x7f8e1c0c1f70 2023-07-27T14:35:05.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e209ff700 1 -- 172.21.15.115:0/2689998098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c1f70 msgr2=0x7f8e1c150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e209ff700 1 --2- 172.21.15.115:0/2689998098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c1f70 0x7f8e1c150700 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f8e1c068150 tx=0x7f8e1000b3b0).stop 2023-07-27T14:35:05.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e209ff700 1 -- 172.21.15.115:0/2689998098 shutdown_connections 2023-07-27T14:35:05.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e209ff700 1 --2- 172.21.15.115:0/2689998098 >> v2:172.21.15.159:3300/0 conn(0x7f8e1c0c0e80 0x7f8e1c069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e209ff700 1 --2- 172.21.15.115:0/2689998098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c1f70 0x7f8e1c150700 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e209ff700 1 -- 172.21.15.115:0/2689998098 >> 172.21.15.115:0/2689998098 conn(0x7f8e1c062320 msgr2=0x7f8e1c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:05.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e209ff700 1 -- 172.21.15.115:0/2689998098 shutdown_connections 2023-07-27T14:35:05.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.415+0000 7f8e209ff700 1 -- 172.21.15.115:0/2689998098 wait complete. 2023-07-27T14:35:05.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.417+0000 7f8e209ff700 1 Processor -- start 2023-07-27T14:35:05.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.417+0000 7f8e209ff700 1 -- start start 2023-07-27T14:35:05.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e209ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c0e80 0x7f8e1c0c0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e209ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e1c0c1f70 0x7f8e1c13d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e209ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e1c150320 0x7f8e1c0bd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e209ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0a9ca0 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e209ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c0710 con 0x7f8e1c150320 2023-07-27T14:35:05.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e209ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0a85e0 con 0x7f8e1c0c1f70 2023-07-27T14:35:05.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e1a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c0e80 0x7f8e1c0c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e1a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c0e80 0x7f8e1c0c0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38132/0 (socket says 172.21.15.115:38132) 2023-07-27T14:35:05.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e1a59c700 1 -- 172.21.15.115:0/4267615541 learned_addr learned my addr 172.21.15.115:0/4267615541 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:05.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e19d9b700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e1c0c1f70 0x7f8e1c13d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e1a59c700 1 -- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e1c0c1f70 msgr2=0x7f8e1c13d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.418+0000 7f8e1ad9d700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e1c150320 0x7f8e1c0bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e1a59c700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e1c0c1f70 0x7f8e1c13d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e1a59c700 1 -- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e1c150320 msgr2=0x7f8e1c0bd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e1a59c700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e1c150320 0x7f8e1c0bd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e1a59c700 1 -- 172.21.15.115:0/4267615541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1000b610 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e1ad9d700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e1c150320 0x7f8e1c0bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:05.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e1a59c700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c0e80 0x7f8e1c0c0220 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f8e0c00c440 tx=0x7f8e0c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e0a7fc700 1 -- 172.21.15.115:0/4267615541 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c007020 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e0a7fc700 1 -- 172.21.15.115:0/4267615541 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c007180 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c0a88c0 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e0a7fc700 1 -- 172.21.15.115:0/4267615541 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c007520 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.419+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c0a9930 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.420+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c06c470 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.421+0000 7f8e0a7fc700 1 -- 172.21.15.115:0/4267615541 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f8e0c010070 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.422+0000 7f8e0a7fc700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8dfc05f6f0 0x7f8dfc061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.422+0000 7f8e0a7fc700 1 -- 172.21.15.115:0/4267615541 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e0c079d90 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.422+0000 7f8e19d9b700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8dfc05f6f0 0x7f8dfc061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.422+0000 7f8e19d9b700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8dfc05f6f0 0x7f8dfc061bb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f8e1c0c2370 tx=0x7f8e1000b3b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.426+0000 7f8e0a7fc700 1 -- 172.21.15.115:0/4267615541 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e0c0478f0 con 0x7f8e1c0c0e80 2023-07-27T14:35:05.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.592+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e1c0c3060 con 0x7f8dfc05f6f0 2023-07-27T14:35:05.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.602+0000 7f8e0a7fc700 1 -- 172.21.15.115:0/4267615541 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361770 (secure 0 0 0) 0x7f8e1c0c3060 con 0x7f8dfc05f6f0 2023-07-27T14:35:05.650 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:35:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8dfc05f6f0 msgr2=0x7f8dfc061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8dfc05f6f0 0x7f8dfc061bb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f8e1c0c2370 tx=0x7f8e1000b3b0).stop 2023-07-27T14:35:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c0e80 msgr2=0x7f8e1c0c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c0e80 0x7f8e1c0c0220 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f8e0c00c440 tx=0x7f8e0c007e00).stop 2023-07-27T14:35:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 shutdown_connections 2023-07-27T14:35:05.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8dfc05f6f0 0x7f8dfc061bb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e1c150320 0x7f8e1c0bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e1c0c0e80 0x7f8e1c0c0220 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 --2- 172.21.15.115:0/4267615541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8e1c0c1f70 0x7f8e1c13d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.606+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 >> 172.21.15.115:0/4267615541 conn(0x7f8e1c062320 msgr2=0x7f8e1c14b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.607+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 shutdown_connections 2023-07-27T14:35:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.607+0000 7f8e209ff700 1 -- 172.21.15.115:0/4267615541 wait complete. 2023-07-27T14:35:05.653 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:35:05.668 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2023-07-27T14:35:05.546809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":141020,"kb_used_data":13852,"kb_used_omap":0,"kb_used_meta":127104,"kb_avail":754833700,"statfs":{"total":773094113280,"available":772949708800,"internally_reserved":0,"allocated":14184448,"data_stored":6638348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":130154496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1895966,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-77,"num_read_kb":-65561,"num_write":-553,"num_write_kb":-133019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.216922"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393266+0000","last_change":"2023-07-27T14:35:01.387587+0000","last_active":"2023-07-27T14:35:01.393266+0000","last_peered":"2023-07-27T14:35:01.393266+0000","last_clean":"2023-07-27T14:35:01.393266+0000","last_became_active":"2023-07-27T14:35:01.387259+0000","last_became_peered":"2023-07-27T14:35:01.387259+0000","last_unstale":"2023-07-27T14:35:01.393266+0000","last_undegraded":"2023-07-27T14:35:01.393266+0000","last_fullsized":"2023-07-27T14:35:01.393266+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396229+0000","last_change":"2023-07-27T14:35:00.921158+0000","last_active":"2023-07-27T14:35:01.396229+0000","last_peered":"2023-07-27T14:35:01.396229+0000","last_clean":"2023-07-27T14:35:01.396229+0000","last_became_active":"2023-07-27T14:35:00.920899+0000","last_became_peered":"2023-07-27T14:35:00.920899+0000","last_unstale":"2023-07-27T14:35:01.396229+0000","last_undegraded":"2023-07-27T14:35:01.396229+0000","last_fullsized":"2023-07-27T14:35:01.396229+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392137+0000","last_change":"2023-07-27T14:35:01.386576+0000","last_active":"2023-07-27T14:35:01.392137+0000","last_peered":"2023-07-27T14:35:01.392137+0000","last_clean":"2023-07-27T14:35:01.392137+0000","last_became_active":"2023-07-27T14:35:01.386243+0000","last_became_peered":"2023-07-27T14:35:01.386243+0000","last_unstale":"2023-07-27T14:35:01.392137+0000","last_undegraded":"2023-07-27T14:35:01.392137+0000","last_fullsized":"2023-07-27T14:35:01.392137+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.922965+0000","last_change":"2023-07-27T14:35:00.914222+0000","last_active":"2023-07-27T14:35:00.922965+0000","last_peered":"2023-07-27T14:35:00.922965+0000","last_clean":"2023-07-27T14:35:00.922965+0000","last_became_active":"2023-07-27T14:35:00.913894+0000","last_became_peered":"2023-07-27T14:35:00.913894+0000","last_unstale":"2023-07-27T14:35:00.922965+0000","last_undegraded":"2023-07-27T14:35:00.922965+0000","last_fullsized":"2023-07-27T14:35:00.922965+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.388756+0000","last_change":"2023-07-27T14:35:01.388756+0000","last_active":"2023-07-27T14:35:01.388756+0000","last_peered":"2023-07-27T14:35:01.388756+0000","last_clean":"2023-07-27T14:35:01.388756+0000","last_became_active":"2023-07-27T14:35:01.388405+0000","last_became_peered":"2023-07-27T14:35:01.388405+0000","last_unstale":"2023-07-27T14:35:01.388756+0000","last_undegraded":"2023-07-27T14:35:01.388756+0000","last_fullsized":"2023-07-27T14:35:01.388756+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.372714+0000","last_change":"2023-07-27T14:35:00.923571+0000","last_active":"2023-07-27T14:35:01.372714+0000","last_peered":"2023-07-27T14:35:01.372714+0000","last_clean":"2023-07-27T14:35:01.372714+0000","last_became_active":"2023-07-27T14:35:00.923161+0000","last_became_peered":"2023-07-27T14:35:00.923161+0000","last_unstale":"2023-07-27T14:35:01.372714+0000","last_undegraded":"2023-07-27T14:35:01.372714+0000","last_fullsized":"2023-07-27T14:35:01.372714+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.384595+0000","last_change":"2023-07-27T14:35:01.379040+0000","last_active":"2023-07-27T14:35:01.384595+0000","last_peered":"2023-07-27T14:35:01.384595+0000","last_clean":"2023-07-27T14:35:01.384595+0000","last_became_active":"2023-07-27T14:35:01.378750+0000","last_became_peered":"2023-07-27T14:35:01.378750+0000","last_unstale":"2023-07-27T14:35:01.384595+0000","last_undegraded":"2023-07-27T14:35:01.384595+0000","last_fullsized":"2023-07-27T14:35:01.384595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.394025+0000","last_change":"2023-07-27T14:35:00.917665+0000","last_active":"2023-07-27T14:35:01.394025+0000","last_peered":"2023-07-27T14:35:01.394025+0000","last_clean":"2023-07-27T14:35:01.394025+0000","last_became_active":"2023-07-27T14:35:00.917409+0000","last_became_peered":"2023-07-27T14:35:00.917409+0000","last_unstale":"2023-07-27T14:35:01.394025+0000","last_undegraded":"2023-07-27T14:35:01.394025+0000","last_fullsized":"2023-07-27T14:35:01.394025+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.387411+0000","last_change":"2023-07-27T14:35:01.383661+0000","last_active":"2023-07-27T14:35:01.387411+0000","last_peered":"2023-07-27T14:35:01.387411+0000","last_clean":"2023-07-27T14:35:01.387411+0000","last_became_active":"2023-07-27T14:35:01.383368+0000","last_became_peered":"2023-07-27T14:35:01.383368+0000","last_unstale":"2023-07-27T14:35:01.387411+0000","last_undegraded":"2023-07-27T14:35:01.387411+0000","last_fullsized":"2023-07-27T14:35:01.387411+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386402+0000","last_change":"2023-07-27T14:35:00.914098+0000","last_active":"2023-07-27T14:35:01.386402+0000","last_peered":"2023-07-27T14:35:01.386402+0000","last_clean":"2023-07-27T14:35:01.386402+0000","last_became_active":"2023-07-27T14:35:00.913705+0000","last_became_peered":"2023-07-27T14:35:00.913705+0000","last_unstale":"2023-07-27T14:35:01.386402+0000","last_undegraded":"2023-07-27T14:35:01.386402+0000","last_fullsized":"2023-07-27T14:35:01.386402+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393535+0000","last_change":"2023-07-27T14:35:01.390304+0000","last_active":"2023-07-27T14:35:01.393535+0000","last_peered":"2023-07-27T14:35:01.393535+0000","last_clean":"2023-07-27T14:35:01.393535+0000","last_became_active":"2023-07-27T14:35:01.390011+0000","last_became_peered":"2023-07-27T14:35:01.390011+0000","last_unstale":"2023-07-27T14:35:01.393535+0000","last_undegraded":"2023-07-27T14:35:01.393535+0000","last_fullsized":"2023-07-27T14:35:01.393535+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396067+0000","last_change":"2023-07-27T14:35:00.922931+0000","last_active":"2023-07-27T14:35:01.396067+0000","last_peered":"2023-07-27T14:35:01.396067+0000","last_clean":"2023-07-27T14:35:01.396067+0000","last_became_active":"2023-07-27T14:35:00.922586+0000","last_became_peered":"2023-07-27T14:35:00.922586+0000","last_unstale":"2023-07-27T14:35:01.396067+0000","last_undegraded":"2023-07-27T14:35:01.396067+0000","last_fullsized":"2023-07-27T14:35:01.396067+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.383115+0000","last_change":"2023-07-27T14:35:01.380659+0000","last_active":"2023-07-27T14:35:01.383115+0000","last_peered":"2023-07-27T14:35:01.383115+0000","last_clean":"2023-07-27T14:35:01.383115+0000","last_became_active":"2023-07-27T14:35:01.380357+0000","last_became_peered":"2023-07-27T14:35:01.380357+0000","last_unstale":"2023-07-27T14:35:01.383115+0000","last_undegraded":"2023-07-27T14:35:01.383115+0000","last_fullsized":"2023-07-27T14:35:01.383115+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369891+0000","last_change":"2023-07-27T14:35:00.918308+0000","last_active":"2023-07-27T14:35:01.369891+0000","last_peered":"2023-07-27T14:35:01.369891+0000","last_clean":"2023-07-27T14:35:01.369891+0000","last_became_active":"2023-07-27T14:35:00.917984+0000","last_became_peered":"2023-07-27T14:35:00.917984+0000","last_unstale":"2023-07-27T14:35:01.369891+0000","last_undegraded":"2023-07-27T14:35:01.369891+0000","last_fullsized":"2023-07-27T14:35:01.369891+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393141+0000","last_change":"2023-07-27T14:35:01.387024+0000","last_active":"2023-07-27T14:35:01.393141+0000","last_peered":"2023-07-27T14:35:01.393141+0000","last_clean":"2023-07-27T14:35:01.393141+0000","last_became_active":"2023-07-27T14:35:01.386765+0000","last_became_peered":"2023-07-27T14:35:01.386765+0000","last_unstale":"2023-07-27T14:35:01.393141+0000","last_undegraded":"2023-07-27T14:35:01.393141+0000","last_fullsized":"2023-07-27T14:35:01.393141+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.373468+0000","last_change":"2023-07-27T14:35:00.923072+0000","last_active":"2023-07-27T14:35:01.373468+0000","last_peered":"2023-07-27T14:35:01.373468+0000","last_clean":"2023-07-27T14:35:01.373468+0000","last_became_active":"2023-07-27T14:35:00.922453+0000","last_became_peered":"2023-07-27T14:35:00.922453+0000","last_unstale":"2023-07-27T14:35:01.373468+0000","last_undegraded":"2023-07-27T14:35:01.373468+0000","last_fullsized":"2023-07-27T14:35:01.373468+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.387363+0000","last_change":"2023-07-27T14:35:01.387363+0000","last_active":"2023-07-27T14:35:01.387363+0000","last_peered":"2023-07-27T14:35:01.387363+0000","last_clean":"2023-07-27T14:35:01.387363+0000","last_became_active":"2023-07-27T14:35:01.387081+0000","last_became_peered":"2023-07-27T14:35:01.387081+0000","last_unstale":"2023-07-27T14:35:01.387363+0000","last_undegraded":"2023-07-27T14:35:01.387363+0000","last_fullsized":"2023-07-27T14:35:01.387363+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.377176+0000","last_change":"2023-07-27T14:35:00.923017+0000","last_active":"2023-07-27T14:35:01.377176+0000","last_peered":"2023-07-27T14:35:01.377176+0000","last_clean":"2023-07-27T14:35:01.377176+0000","last_became_active":"2023-07-27T14:35:00.922735+0000","last_became_peered":"2023-07-27T14:35:00.922735+0000","last_unstale":"2023-07-27T14:35:01.377176+0000","last_undegraded":"2023-07-27T14:35:01.377176+0000","last_fullsized":"2023-07-27T14:35:01.377176+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393175+0000","last_change":"2023-07-27T14:35:01.386124+0000","last_active":"2023-07-27T14:35:01.393175+0000","last_peered":"2023-07-27T14:35:01.393175+0000","last_clean":"2023-07-27T14:35:01.393175+0000","last_became_active":"2023-07-27T14:35:01.385850+0000","last_became_peered":"2023-07-27T14:35:01.385850+0000","last_unstale":"2023-07-27T14:35:01.393175+0000","last_undegraded":"2023-07-27T14:35:01.393175+0000","last_fullsized":"2023-07-27T14:35:01.393175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.919652+0000","last_change":"2023-07-27T14:35:00.911053+0000","last_active":"2023-07-27T14:35:00.919652+0000","last_peered":"2023-07-27T14:35:00.919652+0000","last_clean":"2023-07-27T14:35:00.919652+0000","last_became_active":"2023-07-27T14:35:00.909978+0000","last_became_peered":"2023-07-27T14:35:00.909978+0000","last_unstale":"2023-07-27T14:35:00.919652+0000","last_undegraded":"2023-07-27T14:35:00.919652+0000","last_fullsized":"2023-07-27T14:35:00.919652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393120+0000","last_change":"2023-07-27T14:35:01.385447+0000","last_active":"2023-07-27T14:35:01.393120+0000","last_peered":"2023-07-27T14:35:01.393120+0000","last_clean":"2023-07-27T14:35:01.393120+0000","last_became_active":"2023-07-27T14:35:01.385003+0000","last_became_peered":"2023-07-27T14:35:01.385003+0000","last_unstale":"2023-07-27T14:35:01.393120+0000","last_undegraded":"2023-07-27T14:35:01.393120+0000","last_fullsized":"2023-07-27T14:35:01.393120+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369891+0000","last_change":"2023-07-27T14:35:00.922494+0000","last_active":"2023-07-27T14:35:01.369891+0000","last_peered":"2023-07-27T14:35:01.369891+0000","last_clean":"2023-07-27T14:35:01.369891+0000","last_became_active":"2023-07-27T14:35:00.922258+0000","last_became_peered":"2023-07-27T14:35:00.922258+0000","last_unstale":"2023-07-27T14:35:01.369891+0000","last_undegraded":"2023-07-27T14:35:01.369891+0000","last_fullsized":"2023-07-27T14:35:01.369891+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393501+0000","last_change":"2023-07-27T14:35:01.393501+0000","last_active":"2023-07-27T14:35:01.393501+0000","last_peered":"2023-07-27T14:35:01.393501+0000","last_clean":"2023-07-27T14:35:01.393501+0000","last_became_active":"2023-07-27T14:35:01.393237+0000","last_became_peered":"2023-07-27T14:35:01.393237+0000","last_unstale":"2023-07-27T14:35:01.393501+0000","last_undegraded":"2023-07-27T14:35:01.393501+0000","last_fullsized":"2023-07-27T14:35:01.393501+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.400514+0000","last_change":"2023-07-27T14:35:00.920294+0000","last_active":"2023-07-27T14:35:01.400514+0000","last_peered":"2023-07-27T14:35:01.400514+0000","last_clean":"2023-07-27T14:35:01.400514+0000","last_became_active":"2023-07-27T14:35:00.919988+0000","last_became_peered":"2023-07-27T14:35:00.919988+0000","last_unstale":"2023-07-27T14:35:01.400514+0000","last_undegraded":"2023-07-27T14:35:01.400514+0000","last_fullsized":"2023-07-27T14:35:01.400514+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393249+0000","last_change":"2023-07-27T14:35:01.389936+0000","last_active":"2023-07-27T14:35:01.393249+0000","last_peered":"2023-07-27T14:35:01.393249+0000","last_clean":"2023-07-27T14:35:01.393249+0000","last_became_active":"2023-07-27T14:35:01.389647+0000","last_became_peered":"2023-07-27T14:35:01.389647+0000","last_unstale":"2023-07-27T14:35:01.393249+0000","last_undegraded":"2023-07-27T14:35:01.393249+0000","last_fullsized":"2023-07-27T14:35:01.393249+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.395484+0000","last_change":"2023-07-27T14:35:00.921306+0000","last_active":"2023-07-27T14:35:01.395484+0000","last_peered":"2023-07-27T14:35:01.395484+0000","last_clean":"2023-07-27T14:35:01.395484+0000","last_became_active":"2023-07-27T14:35:00.920921+0000","last_became_peered":"2023-07-27T14:35:00.920921+0000","last_unstale":"2023-07-27T14:35:01.395484+0000","last_undegraded":"2023-07-27T14:35:01.395484+0000","last_fullsized":"2023-07-27T14:35:01.395484+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393035+0000","last_change":"2023-07-27T14:35:01.385953+0000","last_active":"2023-07-27T14:35:01.393035+0000","last_peered":"2023-07-27T14:35:01.393035+0000","last_clean":"2023-07-27T14:35:01.393035+0000","last_became_active":"2023-07-27T14:35:01.385603+0000","last_became_peered":"2023-07-27T14:35:01.385603+0000","last_unstale":"2023-07-27T14:35:01.393035+0000","last_undegraded":"2023-07-27T14:35:01.393035+0000","last_fullsized":"2023-07-27T14:35:01.393035+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.923301+0000","last_change":"2023-07-27T14:35:00.918595+0000","last_active":"2023-07-27T14:35:00.923301+0000","last_peered":"2023-07-27T14:35:00.923301+0000","last_clean":"2023-07-27T14:35:00.923301+0000","last_became_active":"2023-07-27T14:35:00.918315+0000","last_became_peered":"2023-07-27T14:35:00.918315+0000","last_unstale":"2023-07-27T14:35:00.923301+0000","last_undegraded":"2023-07-27T14:35:00.923301+0000","last_fullsized":"2023-07-27T14:35:00.923301+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.387216+0000","last_change":"2023-07-27T14:35:01.381054+0000","last_active":"2023-07-27T14:35:01.387216+0000","last_peered":"2023-07-27T14:35:01.387216+0000","last_clean":"2023-07-27T14:35:01.387216+0000","last_became_active":"2023-07-27T14:35:01.380745+0000","last_became_peered":"2023-07-27T14:35:01.380745+0000","last_unstale":"2023-07-27T14:35:01.387216+0000","last_undegraded":"2023-07-27T14:35:01.387216+0000","last_fullsized":"2023-07-27T14:35:01.387216+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369685+0000","last_change":"2023-07-27T14:35:00.925351+0000","last_active":"2023-07-27T14:35:01.369685+0000","last_peered":"2023-07-27T14:35:01.369685+0000","last_clean":"2023-07-27T14:35:01.369685+0000","last_became_active":"2023-07-27T14:35:00.924514+0000","last_became_peered":"2023-07-27T14:35:00.924514+0000","last_unstale":"2023-07-27T14:35:01.369685+0000","last_undegraded":"2023-07-27T14:35:01.369685+0000","last_fullsized":"2023-07-27T14:35:01.369685+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.384403+0000","last_change":"2023-07-27T14:35:01.384403+0000","last_active":"2023-07-27T14:35:01.384403+0000","last_peered":"2023-07-27T14:35:01.384403+0000","last_clean":"2023-07-27T14:35:01.384403+0000","last_became_active":"2023-07-27T14:35:01.384116+0000","last_became_peered":"2023-07-27T14:35:01.384116+0000","last_unstale":"2023-07-27T14:35:01.384403+0000","last_undegraded":"2023-07-27T14:35:01.384403+0000","last_fullsized":"2023-07-27T14:35:01.384403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.395404+0000","last_change":"2023-07-27T14:35:00.922634+0000","last_active":"2023-07-27T14:35:01.395404+0000","last_peered":"2023-07-27T14:35:01.395404+0000","last_clean":"2023-07-27T14:35:01.395404+0000","last_became_active":"2023-07-27T14:35:00.922343+0000","last_became_peered":"2023-07-27T14:35:00.922343+0000","last_unstale":"2023-07-27T14:35:01.395404+0000","last_undegraded":"2023-07-27T14:35:01.395404+0000","last_fullsized":"2023-07-27T14:35:01.395404+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.383213+0000","last_change":"2023-07-27T14:35:01.383213+0000","last_active":"2023-07-27T14:35:01.383213+0000","last_peered":"2023-07-27T14:35:01.383213+0000","last_clean":"2023-07-27T14:35:01.383213+0000","last_became_active":"2023-07-27T14:35:01.382834+0000","last_became_peered":"2023-07-27T14:35:01.382834+0000","last_unstale":"2023-07-27T14:35:01.383213+0000","last_undegraded":"2023-07-27T14:35:01.383213+0000","last_fullsized":"2023-07-27T14:35:01.383213+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369259+0000","last_change":"2023-07-27T14:35:00.918567+0000","last_active":"2023-07-27T14:35:01.369259+0000","last_peered":"2023-07-27T14:35:01.369259+0000","last_clean":"2023-07-27T14:35:01.369259+0000","last_became_active":"2023-07-27T14:35:00.918283+0000","last_became_peered":"2023-07-27T14:35:00.918283+0000","last_unstale":"2023-07-27T14:35:01.369259+0000","last_undegraded":"2023-07-27T14:35:01.369259+0000","last_fullsized":"2023-07-27T14:35:01.369259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.379408+0000","last_change":"2023-07-27T14:35:01.376700+0000","last_active":"2023-07-27T14:35:01.379408+0000","last_peered":"2023-07-27T14:35:01.379408+0000","last_clean":"2023-07-27T14:35:01.379408+0000","last_became_active":"2023-07-27T14:35:01.376393+0000","last_became_peered":"2023-07-27T14:35:01.376393+0000","last_unstale":"2023-07-27T14:35:01.379408+0000","last_undegraded":"2023-07-27T14:35:01.379408+0000","last_fullsized":"2023-07-27T14:35:01.379408+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368462+0000","last_change":"2023-07-27T14:35:00.919003+0000","last_active":"2023-07-27T14:35:01.368462+0000","last_peered":"2023-07-27T14:35:01.368462+0000","last_clean":"2023-07-27T14:35:01.368462+0000","last_became_active":"2023-07-27T14:35:00.918752+0000","last_became_peered":"2023-07-27T14:35:00.918752+0000","last_unstale":"2023-07-27T14:35:01.368462+0000","last_undegraded":"2023-07-27T14:35:01.368462+0000","last_fullsized":"2023-07-27T14:35:01.368462+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.374273+0000","last_change":"2023-07-27T14:35:01.373153+0000","last_active":"2023-07-27T14:35:01.374273+0000","last_peered":"2023-07-27T14:35:01.374273+0000","last_clean":"2023-07-27T14:35:01.374273+0000","last_became_active":"2023-07-27T14:35:01.372845+0000","last_became_peered":"2023-07-27T14:35:01.372845+0000","last_unstale":"2023-07-27T14:35:01.374273+0000","last_undegraded":"2023-07-27T14:35:01.374273+0000","last_fullsized":"2023-07-27T14:35:01.374273+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385442+0000","last_change":"2023-07-27T14:35:00.921092+0000","last_active":"2023-07-27T14:35:01.385442+0000","last_peered":"2023-07-27T14:35:01.385442+0000","last_clean":"2023-07-27T14:35:01.385442+0000","last_became_active":"2023-07-27T14:35:00.920769+0000","last_became_peered":"2023-07-27T14:35:00.920769+0000","last_unstale":"2023-07-27T14:35:01.385442+0000","last_undegraded":"2023-07-27T14:35:01.385442+0000","last_fullsized":"2023-07-27T14:35:01.385442+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.382086+0000","last_change":"2023-07-27T14:35:01.380374+0000","last_active":"2023-07-27T14:35:01.382086+0000","last_peered":"2023-07-27T14:35:01.382086+0000","last_clean":"2023-07-27T14:35:01.382086+0000","last_became_active":"2023-07-27T14:35:01.380064+0000","last_became_peered":"2023-07-27T14:35:01.380064+0000","last_unstale":"2023-07-27T14:35:01.382086+0000","last_undegraded":"2023-07-27T14:35:01.382086+0000","last_fullsized":"2023-07-27T14:35:01.382086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369516+0000","last_change":"2023-07-27T14:35:00.920111+0000","last_active":"2023-07-27T14:35:01.369516+0000","last_peered":"2023-07-27T14:35:01.369516+0000","last_clean":"2023-07-27T14:35:01.369516+0000","last_became_active":"2023-07-27T14:35:00.919827+0000","last_became_peered":"2023-07-27T14:35:00.919827+0000","last_unstale":"2023-07-27T14:35:01.369516+0000","last_undegraded":"2023-07-27T14:35:01.369516+0000","last_fullsized":"2023-07-27T14:35:01.369516+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.388076+0000","last_change":"2023-07-27T14:35:01.381699+0000","last_active":"2023-07-27T14:35:01.388076+0000","last_peered":"2023-07-27T14:35:01.388076+0000","last_clean":"2023-07-27T14:35:01.388076+0000","last_became_active":"2023-07-27T14:35:01.381445+0000","last_became_peered":"2023-07-27T14:35:01.381445+0000","last_unstale":"2023-07-27T14:35:01.388076+0000","last_undegraded":"2023-07-27T14:35:01.388076+0000","last_fullsized":"2023-07-27T14:35:01.388076+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386481+0000","last_change":"2023-07-27T14:35:00.914447+0000","last_active":"2023-07-27T14:35:01.386481+0000","last_peered":"2023-07-27T14:35:01.386481+0000","last_clean":"2023-07-27T14:35:01.386481+0000","last_became_active":"2023-07-27T14:35:00.914100+0000","last_became_peered":"2023-07-27T14:35:00.914100+0000","last_unstale":"2023-07-27T14:35:01.386481+0000","last_undegraded":"2023-07-27T14:35:01.386481+0000","last_fullsized":"2023-07-27T14:35:01.386481+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386086+0000","last_change":"2023-07-27T14:35:01.381632+0000","last_active":"2023-07-27T14:35:01.386086+0000","last_peered":"2023-07-27T14:35:01.386086+0000","last_clean":"2023-07-27T14:35:01.386086+0000","last_became_active":"2023-07-27T14:35:01.381369+0000","last_became_peered":"2023-07-27T14:35:01.381369+0000","last_unstale":"2023-07-27T14:35:01.386086+0000","last_undegraded":"2023-07-27T14:35:01.386086+0000","last_fullsized":"2023-07-27T14:35:01.386086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369701+0000","last_change":"2023-07-27T14:35:00.921963+0000","last_active":"2023-07-27T14:35:01.369701+0000","last_peered":"2023-07-27T14:35:01.369701+0000","last_clean":"2023-07-27T14:35:01.369701+0000","last_became_active":"2023-07-27T14:35:00.921723+0000","last_became_peered":"2023-07-27T14:35:00.921723+0000","last_unstale":"2023-07-27T14:35:01.369701+0000","last_undegraded":"2023-07-27T14:35:01.369701+0000","last_fullsized":"2023-07-27T14:35:01.369701+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.384511+0000","last_change":"2023-07-27T14:35:01.379756+0000","last_active":"2023-07-27T14:35:01.384511+0000","last_peered":"2023-07-27T14:35:01.384511+0000","last_clean":"2023-07-27T14:35:01.384511+0000","last_became_active":"2023-07-27T14:35:01.379500+0000","last_became_peered":"2023-07-27T14:35:01.379500+0000","last_unstale":"2023-07-27T14:35:01.384511+0000","last_undegraded":"2023-07-27T14:35:01.384511+0000","last_fullsized":"2023-07-27T14:35:01.384511+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.370441+0000","last_change":"2023-07-27T14:35:00.921424+0000","last_active":"2023-07-27T14:35:01.370441+0000","last_peered":"2023-07-27T14:35:01.370441+0000","last_clean":"2023-07-27T14:35:01.370441+0000","last_became_active":"2023-07-27T14:35:00.921110+0000","last_became_peered":"2023-07-27T14:35:00.921110+0000","last_unstale":"2023-07-27T14:35:01.370441+0000","last_undegraded":"2023-07-27T14:35:01.370441+0000","last_fullsized":"2023-07-27T14:35:01.370441+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.391619+0000","last_change":"2023-07-27T14:35:01.391619+0000","last_active":"2023-07-27T14:35:01.391619+0000","last_peered":"2023-07-27T14:35:01.391619+0000","last_clean":"2023-07-27T14:35:01.391619+0000","last_became_active":"2023-07-27T14:35:01.391309+0000","last_became_peered":"2023-07-27T14:35:01.391309+0000","last_unstale":"2023-07-27T14:35:01.391619+0000","last_undegraded":"2023-07-27T14:35:01.391619+0000","last_fullsized":"2023-07-27T14:35:01.391619+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.367877+0000","last_change":"2023-07-27T14:35:00.914244+0000","last_active":"2023-07-27T14:35:01.367877+0000","last_peered":"2023-07-27T14:35:01.367877+0000","last_clean":"2023-07-27T14:35:01.367877+0000","last_became_active":"2023-07-27T14:35:00.913921+0000","last_became_peered":"2023-07-27T14:35:00.913921+0000","last_unstale":"2023-07-27T14:35:01.367877+0000","last_undegraded":"2023-07-27T14:35:01.367877+0000","last_fullsized":"2023-07-27T14:35:01.367877+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385286+0000","last_change":"2023-07-27T14:35:01.380455+0000","last_active":"2023-07-27T14:35:01.385286+0000","last_peered":"2023-07-27T14:35:01.385286+0000","last_clean":"2023-07-27T14:35:01.385286+0000","last_became_active":"2023-07-27T14:35:01.380125+0000","last_became_peered":"2023-07-27T14:35:01.380125+0000","last_unstale":"2023-07-27T14:35:01.385286+0000","last_undegraded":"2023-07-27T14:35:01.385286+0000","last_fullsized":"2023-07-27T14:35:01.385286+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.921161+0000","last_change":"2023-07-27T14:35:00.910910+0000","last_active":"2023-07-27T14:35:00.921161+0000","last_peered":"2023-07-27T14:35:00.921161+0000","last_clean":"2023-07-27T14:35:00.921161+0000","last_became_active":"2023-07-27T14:35:00.910565+0000","last_became_peered":"2023-07-27T14:35:00.910565+0000","last_unstale":"2023-07-27T14:35:00.921161+0000","last_undegraded":"2023-07-27T14:35:00.921161+0000","last_fullsized":"2023-07-27T14:35:00.921161+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385437+0000","last_change":"2023-07-27T14:35:01.383430+0000","last_active":"2023-07-27T14:35:01.385437+0000","last_peered":"2023-07-27T14:35:01.385437+0000","last_clean":"2023-07-27T14:35:01.385437+0000","last_became_active":"2023-07-27T14:35:01.383156+0000","last_became_peered":"2023-07-27T14:35:01.383156+0000","last_unstale":"2023-07-27T14:35:01.385437+0000","last_undegraded":"2023-07-27T14:35:01.385437+0000","last_fullsized":"2023-07-27T14:35:01.385437+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368556+0000","last_change":"2023-07-27T14:35:00.922656+0000","last_active":"2023-07-27T14:35:01.368556+0000","last_peered":"2023-07-27T14:35:01.368556+0000","last_clean":"2023-07-27T14:35:01.368556+0000","last_became_active":"2023-07-27T14:35:00.922298+0000","last_became_peered":"2023-07-27T14:35:00.922298+0000","last_unstale":"2023-07-27T14:35:01.368556+0000","last_undegraded":"2023-07-27T14:35:01.368556+0000","last_fullsized":"2023-07-27T14:35:01.368556+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392722+0000","last_change":"2023-07-27T14:35:01.385098+0000","last_active":"2023-07-27T14:35:01.392722+0000","last_peered":"2023-07-27T14:35:01.392722+0000","last_clean":"2023-07-27T14:35:01.392722+0000","last_became_active":"2023-07-27T14:35:01.384518+0000","last_became_peered":"2023-07-27T14:35:01.384518+0000","last_unstale":"2023-07-27T14:35:01.392722+0000","last_undegraded":"2023-07-27T14:35:01.392722+0000","last_fullsized":"2023-07-27T14:35:01.392722+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.371835+0000","last_change":"2023-07-27T14:35:00.921725+0000","last_active":"2023-07-27T14:35:01.371835+0000","last_peered":"2023-07-27T14:35:01.371835+0000","last_clean":"2023-07-27T14:35:01.371835+0000","last_became_active":"2023-07-27T14:35:00.921466+0000","last_became_peered":"2023-07-27T14:35:00.921466+0000","last_unstale":"2023-07-27T14:35:01.371835+0000","last_undegraded":"2023-07-27T14:35:01.371835+0000","last_fullsized":"2023-07-27T14:35:01.371835+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.391953+0000","last_change":"2023-07-27T14:35:01.384214+0000","last_active":"2023-07-27T14:35:01.391953+0000","last_peered":"2023-07-27T14:35:01.391953+0000","last_clean":"2023-07-27T14:35:01.391953+0000","last_became_active":"2023-07-27T14:35:01.383900+0000","last_became_peered":"2023-07-27T14:35:01.383900+0000","last_unstale":"2023-07-27T14:35:01.391953+0000","last_undegraded":"2023-07-27T14:35:01.391953+0000","last_fullsized":"2023-07-27T14:35:01.391953+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365605+0000","last_change":"2023-07-27T14:35:00.914418+0000","last_active":"2023-07-27T14:35:01.365605+0000","last_peered":"2023-07-27T14:35:01.365605+0000","last_clean":"2023-07-27T14:35:01.365605+0000","last_became_active":"2023-07-27T14:35:00.914148+0000","last_became_peered":"2023-07-27T14:35:00.914148+0000","last_unstale":"2023-07-27T14:35:01.365605+0000","last_undegraded":"2023-07-27T14:35:01.365605+0000","last_fullsized":"2023-07-27T14:35:01.365605+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.387481+0000","last_change":"2023-07-27T14:35:01.381848+0000","last_active":"2023-07-27T14:35:01.387481+0000","last_peered":"2023-07-27T14:35:01.387481+0000","last_clean":"2023-07-27T14:35:01.387481+0000","last_became_active":"2023-07-27T14:35:01.381570+0000","last_became_peered":"2023-07-27T14:35:01.381570+0000","last_unstale":"2023-07-27T14:35:01.387481+0000","last_undegraded":"2023-07-27T14:35:01.387481+0000","last_fullsized":"2023-07-27T14:35:01.387481+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.373153+0000","last_change":"2023-07-27T14:35:00.925143+0000","last_active":"2023-07-27T14:35:01.373153+0000","last_peered":"2023-07-27T14:35:01.373153+0000","last_clean":"2023-07-27T14:35:01.373153+0000","last_became_active":"2023-07-27T14:35:00.924900+0000","last_became_peered":"2023-07-27T14:35:00.924900+0000","last_unstale":"2023-07-27T14:35:01.373153+0000","last_undegraded":"2023-07-27T14:35:01.373153+0000","last_fullsized":"2023-07-27T14:35:01.373153+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386068+0000","last_change":"2023-07-27T14:35:01.379515+0000","last_active":"2023-07-27T14:35:01.386068+0000","last_peered":"2023-07-27T14:35:01.386068+0000","last_clean":"2023-07-27T14:35:01.386068+0000","last_became_active":"2023-07-27T14:35:01.379227+0000","last_became_peered":"2023-07-27T14:35:01.379227+0000","last_unstale":"2023-07-27T14:35:01.386068+0000","last_undegraded":"2023-07-27T14:35:01.386068+0000","last_fullsized":"2023-07-27T14:35:01.386068+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369552+0000","last_change":"2023-07-27T14:35:00.924715+0000","last_active":"2023-07-27T14:35:01.369552+0000","last_peered":"2023-07-27T14:35:01.369552+0000","last_clean":"2023-07-27T14:35:01.369552+0000","last_became_active":"2023-07-27T14:35:00.924438+0000","last_became_peered":"2023-07-27T14:35:00.924438+0000","last_unstale":"2023-07-27T14:35:01.369552+0000","last_undegraded":"2023-07-27T14:35:01.369552+0000","last_fullsized":"2023-07-27T14:35:01.369552+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392540+0000","last_change":"2023-07-27T14:35:01.384473+0000","last_active":"2023-07-27T14:35:01.392540+0000","last_peered":"2023-07-27T14:35:01.392540+0000","last_clean":"2023-07-27T14:35:01.392540+0000","last_became_active":"2023-07-27T14:35:01.384127+0000","last_became_peered":"2023-07-27T14:35:01.384127+0000","last_unstale":"2023-07-27T14:35:01.392540+0000","last_undegraded":"2023-07-27T14:35:01.392540+0000","last_fullsized":"2023-07-27T14:35:01.392540+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368370+0000","last_change":"2023-07-27T14:35:00.925169+0000","last_active":"2023-07-27T14:35:01.368370+0000","last_peered":"2023-07-27T14:35:01.368370+0000","last_clean":"2023-07-27T14:35:01.368370+0000","last_became_active":"2023-07-27T14:35:00.924823+0000","last_became_peered":"2023-07-27T14:35:00.924823+0000","last_unstale":"2023-07-27T14:35:01.368370+0000","last_undegraded":"2023-07-27T14:35:01.368370+0000","last_fullsized":"2023-07-27T14:35:01.368370+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393240+0000","last_change":"2023-07-27T14:35:01.386808+0000","last_active":"2023-07-27T14:35:01.393240+0000","last_peered":"2023-07-27T14:35:01.393240+0000","last_clean":"2023-07-27T14:35:01.393240+0000","last_became_active":"2023-07-27T14:35:01.386483+0000","last_became_peered":"2023-07-27T14:35:01.386483+0000","last_unstale":"2023-07-27T14:35:01.393240+0000","last_undegraded":"2023-07-27T14:35:01.393240+0000","last_fullsized":"2023-07-27T14:35:01.393240+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.370659+0000","last_change":"2023-07-27T14:35:00.914466+0000","last_active":"2023-07-27T14:35:01.370659+0000","last_peered":"2023-07-27T14:35:01.370659+0000","last_clean":"2023-07-27T14:35:01.370659+0000","last_became_active":"2023-07-27T14:35:00.914160+0000","last_became_peered":"2023-07-27T14:35:00.914160+0000","last_unstale":"2023-07-27T14:35:01.370659+0000","last_undegraded":"2023-07-27T14:35:01.370659+0000","last_fullsized":"2023-07-27T14:35:01.370659+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393355+0000","last_change":"2023-07-27T14:35:01.388182+0000","last_active":"2023-07-27T14:35:01.393355+0000","last_peered":"2023-07-27T14:35:01.393355+0000","last_clean":"2023-07-27T14:35:01.393355+0000","last_became_active":"2023-07-27T14:35:01.387908+0000","last_became_peered":"2023-07-27T14:35:01.387908+0000","last_unstale":"2023-07-27T14:35:01.393355+0000","last_undegraded":"2023-07-27T14:35:01.393355+0000","last_fullsized":"2023-07-27T14:35:01.393355+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396542+0000","last_change":"2023-07-27T14:35:00.929577+0000","last_active":"2023-07-27T14:35:01.396542+0000","last_peered":"2023-07-27T14:35:01.396542+0000","last_clean":"2023-07-27T14:35:01.396542+0000","last_became_active":"2023-07-27T14:35:00.929215+0000","last_became_peered":"2023-07-27T14:35:00.929215+0000","last_unstale":"2023-07-27T14:35:01.396542+0000","last_undegraded":"2023-07-27T14:35:01.396542+0000","last_fullsized":"2023-07-27T14:35:01.396542+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393200+0000","last_change":"2023-07-27T14:35:01.386993+0000","last_active":"2023-07-27T14:35:01.393200+0000","last_peered":"2023-07-27T14:35:01.393200+0000","last_clean":"2023-07-27T14:35:01.393200+0000","last_became_active":"2023-07-27T14:35:01.386711+0000","last_became_peered":"2023-07-27T14:35:01.386711+0000","last_unstale":"2023-07-27T14:35:01.393200+0000","last_undegraded":"2023-07-27T14:35:01.393200+0000","last_fullsized":"2023-07-27T14:35:01.393200+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.390066+0000","last_change":"2023-07-27T14:35:00.914069+0000","last_active":"2023-07-27T14:35:01.390066+0000","last_peered":"2023-07-27T14:35:01.390066+0000","last_clean":"2023-07-27T14:35:01.390066+0000","last_became_active":"2023-07-27T14:35:00.913703+0000","last_became_peered":"2023-07-27T14:35:00.913703+0000","last_unstale":"2023-07-27T14:35:01.390066+0000","last_undegraded":"2023-07-27T14:35:01.390066+0000","last_fullsized":"2023-07-27T14:35:01.390066+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.379087+0000","last_change":"2023-07-27T14:35:01.376009+0000","last_active":"2023-07-27T14:35:01.379087+0000","last_peered":"2023-07-27T14:35:01.379087+0000","last_clean":"2023-07-27T14:35:01.379087+0000","last_became_active":"2023-07-27T14:35:01.375097+0000","last_became_peered":"2023-07-27T14:35:01.375097+0000","last_unstale":"2023-07-27T14:35:01.379087+0000","last_undegraded":"2023-07-27T14:35:01.379087+0000","last_fullsized":"2023-07-27T14:35:01.379087+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385054+0000","last_change":"2023-07-27T14:35:00.920449+0000","last_active":"2023-07-27T14:35:01.385054+0000","last_peered":"2023-07-27T14:35:01.385054+0000","last_clean":"2023-07-27T14:35:01.385054+0000","last_became_active":"2023-07-27T14:35:00.920183+0000","last_became_peered":"2023-07-27T14:35:00.920183+0000","last_unstale":"2023-07-27T14:35:01.385054+0000","last_undegraded":"2023-07-27T14:35:01.385054+0000","last_fullsized":"2023-07-27T14:35:01.385054+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396765+0000","last_change":"2023-07-27T14:35:01.393738+0000","last_active":"2023-07-27T14:35:01.396765+0000","last_peered":"2023-07-27T14:35:01.396765+0000","last_clean":"2023-07-27T14:35:01.396765+0000","last_became_active":"2023-07-27T14:35:01.393489+0000","last_became_peered":"2023-07-27T14:35:01.393489+0000","last_unstale":"2023-07-27T14:35:01.396765+0000","last_undegraded":"2023-07-27T14:35:01.396765+0000","last_fullsized":"2023-07-27T14:35:01.396765+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.366833+0000","last_change":"2023-07-27T14:35:00.907880+0000","last_active":"2023-07-27T14:35:01.366833+0000","last_peered":"2023-07-27T14:35:01.366833+0000","last_clean":"2023-07-27T14:35:01.366833+0000","last_became_active":"2023-07-27T14:35:00.907585+0000","last_became_peered":"2023-07-27T14:35:00.907585+0000","last_unstale":"2023-07-27T14:35:01.366833+0000","last_undegraded":"2023-07-27T14:35:01.366833+0000","last_fullsized":"2023-07-27T14:35:01.366833+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.389903+0000","last_change":"2023-07-27T14:35:01.383594+0000","last_active":"2023-07-27T14:35:01.389903+0000","last_peered":"2023-07-27T14:35:01.389903+0000","last_clean":"2023-07-27T14:35:01.389903+0000","last_became_active":"2023-07-27T14:35:01.383293+0000","last_became_peered":"2023-07-27T14:35:01.383293+0000","last_unstale":"2023-07-27T14:35:01.389903+0000","last_undegraded":"2023-07-27T14:35:01.389903+0000","last_fullsized":"2023-07-27T14:35:01.389903+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.372349+0000","last_change":"2023-07-27T14:35:00.919117+0000","last_active":"2023-07-27T14:35:01.372349+0000","last_peered":"2023-07-27T14:35:01.372349+0000","last_clean":"2023-07-27T14:35:01.372349+0000","last_became_active":"2023-07-27T14:35:00.918842+0000","last_became_peered":"2023-07-27T14:35:00.918842+0000","last_unstale":"2023-07-27T14:35:01.372349+0000","last_undegraded":"2023-07-27T14:35:01.372349+0000","last_fullsized":"2023-07-27T14:35:01.372349+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393369+0000","last_change":"2023-07-27T14:35:01.386906+0000","last_active":"2023-07-27T14:35:01.393369+0000","last_peered":"2023-07-27T14:35:01.393369+0000","last_clean":"2023-07-27T14:35:01.393369+0000","last_became_active":"2023-07-27T14:35:01.386535+0000","last_became_peered":"2023-07-27T14:35:01.386535+0000","last_unstale":"2023-07-27T14:35:01.393369+0000","last_undegraded":"2023-07-27T14:35:01.393369+0000","last_fullsized":"2023-07-27T14:35:01.393369+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.367932+0000","last_change":"2023-07-27T14:35:00.914565+0000","last_active":"2023-07-27T14:35:01.367932+0000","last_peered":"2023-07-27T14:35:01.367932+0000","last_clean":"2023-07-27T14:35:01.367932+0000","last_became_active":"2023-07-27T14:35:00.914304+0000","last_became_peered":"2023-07-27T14:35:00.914304+0000","last_unstale":"2023-07-27T14:35:01.367932+0000","last_undegraded":"2023-07-27T14:35:01.367932+0000","last_fullsized":"2023-07-27T14:35:01.367932+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.379706+0000","last_change":"2023-07-27T14:35:01.374387+0000","last_active":"2023-07-27T14:35:01.379706+0000","last_peered":"2023-07-27T14:35:01.379706+0000","last_clean":"2023-07-27T14:35:01.379706+0000","last_became_active":"2023-07-27T14:35:01.374103+0000","last_became_peered":"2023-07-27T14:35:01.374103+0000","last_unstale":"2023-07-27T14:35:01.379706+0000","last_undegraded":"2023-07-27T14:35:01.379706+0000","last_fullsized":"2023-07-27T14:35:01.379706+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.924236+0000","last_change":"2023-07-27T14:35:00.915385+0000","last_active":"2023-07-27T14:35:00.924236+0000","last_peered":"2023-07-27T14:35:00.924236+0000","last_clean":"2023-07-27T14:35:00.924236+0000","last_became_active":"2023-07-27T14:35:00.915121+0000","last_became_peered":"2023-07-27T14:35:00.915121+0000","last_unstale":"2023-07-27T14:35:00.924236+0000","last_undegraded":"2023-07-27T14:35:00.924236+0000","last_fullsized":"2023-07-27T14:35:00.924236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.390284+0000","last_change":"2023-07-27T14:35:01.385698+0000","last_active":"2023-07-27T14:35:01.390284+0000","last_peered":"2023-07-27T14:35:01.390284+0000","last_clean":"2023-07-27T14:35:01.390284+0000","last_became_active":"2023-07-27T14:35:01.385317+0000","last_became_peered":"2023-07-27T14:35:01.385317+0000","last_unstale":"2023-07-27T14:35:01.390284+0000","last_undegraded":"2023-07-27T14:35:01.390284+0000","last_fullsized":"2023-07-27T14:35:01.390284+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.373587+0000","last_change":"2023-07-27T14:35:00.922418+0000","last_active":"2023-07-27T14:35:01.373587+0000","last_peered":"2023-07-27T14:35:01.373587+0000","last_clean":"2023-07-27T14:35:01.373587+0000","last_became_active":"2023-07-27T14:35:00.922112+0000","last_became_peered":"2023-07-27T14:35:00.922112+0000","last_unstale":"2023-07-27T14:35:01.373587+0000","last_undegraded":"2023-07-27T14:35:01.373587+0000","last_fullsized":"2023-07-27T14:35:01.373587+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393542+0000","last_change":"2023-07-27T14:35:01.390101+0000","last_active":"2023-07-27T14:35:01.393542+0000","last_peered":"2023-07-27T14:35:01.393542+0000","last_clean":"2023-07-27T14:35:01.393542+0000","last_became_active":"2023-07-27T14:35:01.389765+0000","last_became_peered":"2023-07-27T14:35:01.389765+0000","last_unstale":"2023-07-27T14:35:01.393542+0000","last_undegraded":"2023-07-27T14:35:01.393542+0000","last_fullsized":"2023-07-27T14:35:01.393542+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.389110+0000","last_change":"2023-07-27T14:35:00.917249+0000","last_active":"2023-07-27T14:35:01.389110+0000","last_peered":"2023-07-27T14:35:01.389110+0000","last_clean":"2023-07-27T14:35:01.389110+0000","last_became_active":"2023-07-27T14:35:00.916377+0000","last_became_peered":"2023-07-27T14:35:00.916377+0000","last_unstale":"2023-07-27T14:35:01.389110+0000","last_undegraded":"2023-07-27T14:35:01.389110+0000","last_fullsized":"2023-07-27T14:35:01.389110+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386437+0000","last_change":"2023-07-27T14:35:01.380445+0000","last_active":"2023-07-27T14:35:01.386437+0000","last_peered":"2023-07-27T14:35:01.386437+0000","last_clean":"2023-07-27T14:35:01.386437+0000","last_became_active":"2023-07-27T14:35:01.378873+0000","last_became_peered":"2023-07-27T14:35:01.378873+0000","last_unstale":"2023-07-27T14:35:01.386437+0000","last_undegraded":"2023-07-27T14:35:01.386437+0000","last_fullsized":"2023-07-27T14:35:01.386437+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396993+0000","last_change":"2023-07-27T14:35:00.929473+0000","last_active":"2023-07-27T14:35:01.396993+0000","last_peered":"2023-07-27T14:35:01.396993+0000","last_clean":"2023-07-27T14:35:01.396993+0000","last_became_active":"2023-07-27T14:35:00.929185+0000","last_became_peered":"2023-07-27T14:35:00.929185+0000","last_unstale":"2023-07-27T14:35:01.396993+0000","last_undegraded":"2023-07-27T14:35:01.396993+0000","last_fullsized":"2023-07-27T14:35:01.396993+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386857+0000","last_change":"2023-07-27T14:35:01.380773+0000","last_active":"2023-07-27T14:35:01.386857+0000","last_peered":"2023-07-27T14:35:01.386857+0000","last_clean":"2023-07-27T14:35:01.386857+0000","last_became_active":"2023-07-27T14:35:01.380486+0000","last_became_peered":"2023-07-27T14:35:01.380486+0000","last_unstale":"2023-07-27T14:35:01.386857+0000","last_undegraded":"2023-07-27T14:35:01.386857+0000","last_fullsized":"2023-07-27T14:35:01.386857+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.919414+0000","last_change":"2023-07-27T14:35:00.910175+0000","last_active":"2023-07-27T14:35:00.919414+0000","last_peered":"2023-07-27T14:35:00.919414+0000","last_clean":"2023-07-27T14:35:00.919414+0000","last_became_active":"2023-07-27T14:35:00.909877+0000","last_became_peered":"2023-07-27T14:35:00.909877+0000","last_unstale":"2023-07-27T14:35:00.919414+0000","last_undegraded":"2023-07-27T14:35:00.919414+0000","last_fullsized":"2023-07-27T14:35:00.919414+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.395471+0000","last_change":"2023-07-27T14:35:01.390402+0000","last_active":"2023-07-27T14:35:01.395471+0000","last_peered":"2023-07-27T14:35:01.395471+0000","last_clean":"2023-07-27T14:35:01.395471+0000","last_became_active":"2023-07-27T14:35:01.390096+0000","last_became_peered":"2023-07-27T14:35:01.390096+0000","last_unstale":"2023-07-27T14:35:01.395471+0000","last_undegraded":"2023-07-27T14:35:01.395471+0000","last_fullsized":"2023-07-27T14:35:01.395471+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369546+0000","last_change":"2023-07-27T14:35:00.923150+0000","last_active":"2023-07-27T14:35:01.369546+0000","last_peered":"2023-07-27T14:35:01.369546+0000","last_clean":"2023-07-27T14:35:01.369546+0000","last_became_active":"2023-07-27T14:35:00.922880+0000","last_became_peered":"2023-07-27T14:35:00.922880+0000","last_unstale":"2023-07-27T14:35:01.369546+0000","last_undegraded":"2023-07-27T14:35:01.369546+0000","last_fullsized":"2023-07-27T14:35:01.369546+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392586+0000","last_change":"2023-07-27T14:35:01.389601+0000","last_active":"2023-07-27T14:35:01.392586+0000","last_peered":"2023-07-27T14:35:01.392586+0000","last_clean":"2023-07-27T14:35:01.392586+0000","last_became_active":"2023-07-27T14:35:01.389322+0000","last_became_peered":"2023-07-27T14:35:01.389322+0000","last_unstale":"2023-07-27T14:35:01.392586+0000","last_undegraded":"2023-07-27T14:35:01.392586+0000","last_fullsized":"2023-07-27T14:35:01.392586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.391704+0000","last_change":"2023-07-27T14:35:00.923250+0000","last_active":"2023-07-27T14:35:01.391704+0000","last_peered":"2023-07-27T14:35:01.391704+0000","last_clean":"2023-07-27T14:35:01.391704+0000","last_became_active":"2023-07-27T14:35:00.922965+0000","last_became_peered":"2023-07-27T14:35:00.922965+0000","last_unstale":"2023-07-27T14:35:01.391704+0000","last_undegraded":"2023-07-27T14:35:01.391704+0000","last_fullsized":"2023-07-27T14:35:01.391704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393166+0000","last_change":"2023-07-27T14:35:01.385698+0000","last_active":"2023-07-27T14:35:01.393166+0000","last_peered":"2023-07-27T14:35:01.393166+0000","last_clean":"2023-07-27T14:35:01.393166+0000","last_became_active":"2023-07-27T14:35:01.385153+0000","last_became_peered":"2023-07-27T14:35:01.385153+0000","last_unstale":"2023-07-27T14:35:01.393166+0000","last_undegraded":"2023-07-27T14:35:01.393166+0000","last_fullsized":"2023-07-27T14:35:01.393166+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369645+0000","last_change":"2023-07-27T14:35:00.922676+0000","last_active":"2023-07-27T14:35:01.369645+0000","last_peered":"2023-07-27T14:35:01.369645+0000","last_clean":"2023-07-27T14:35:01.369645+0000","last_became_active":"2023-07-27T14:35:00.922428+0000","last_became_peered":"2023-07-27T14:35:00.922428+0000","last_unstale":"2023-07-27T14:35:01.369645+0000","last_undegraded":"2023-07-27T14:35:01.369645+0000","last_fullsized":"2023-07-27T14:35:01.369645+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392624+0000","last_change":"2023-07-27T14:35:01.389077+0000","last_active":"2023-07-27T14:35:01.392624+0000","last_peered":"2023-07-27T14:35:01.392624+0000","last_clean":"2023-07-27T14:35:01.392624+0000","last_became_active":"2023-07-27T14:35:01.388800+0000","last_became_peered":"2023-07-27T14:35:01.388800+0000","last_unstale":"2023-07-27T14:35:01.392624+0000","last_undegraded":"2023-07-27T14:35:01.392624+0000","last_fullsized":"2023-07-27T14:35:01.392624+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368494+0000","last_change":"2023-07-27T14:35:00.924978+0000","last_active":"2023-07-27T14:35:01.368494+0000","last_peered":"2023-07-27T14:35:01.368494+0000","last_clean":"2023-07-27T14:35:01.368494+0000","last_became_active":"2023-07-27T14:35:00.924697+0000","last_became_peered":"2023-07-27T14:35:00.924697+0000","last_unstale":"2023-07-27T14:35:01.368494+0000","last_undegraded":"2023-07-27T14:35:01.368494+0000","last_fullsized":"2023-07-27T14:35:01.368494+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393447+0000","last_change":"2023-07-27T14:35:01.389711+0000","last_active":"2023-07-27T14:35:01.393447+0000","last_peered":"2023-07-27T14:35:01.393447+0000","last_clean":"2023-07-27T14:35:01.393447+0000","last_became_active":"2023-07-27T14:35:01.389441+0000","last_became_peered":"2023-07-27T14:35:01.389441+0000","last_unstale":"2023-07-27T14:35:01.393447+0000","last_undegraded":"2023-07-27T14:35:01.393447+0000","last_fullsized":"2023-07-27T14:35:01.393447+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.923286+0000","last_change":"2023-07-27T14:35:00.918169+0000","last_active":"2023-07-27T14:35:00.923286+0000","last_peered":"2023-07-27T14:35:00.923286+0000","last_clean":"2023-07-27T14:35:00.923286+0000","last_became_active":"2023-07-27T14:35:00.917597+0000","last_became_peered":"2023-07-27T14:35:00.917597+0000","last_unstale":"2023-07-27T14:35:00.923286+0000","last_undegraded":"2023-07-27T14:35:00.923286+0000","last_fullsized":"2023-07-27T14:35:00.923286+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386485+0000","last_change":"2023-07-27T14:35:01.381146+0000","last_active":"2023-07-27T14:35:01.386485+0000","last_peered":"2023-07-27T14:35:01.386485+0000","last_clean":"2023-07-27T14:35:01.386485+0000","last_became_active":"2023-07-27T14:35:01.380870+0000","last_became_peered":"2023-07-27T14:35:01.380870+0000","last_unstale":"2023-07-27T14:35:01.386485+0000","last_undegraded":"2023-07-27T14:35:01.386485+0000","last_fullsized":"2023-07-27T14:35:01.386485+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.394438+0000","last_change":"2023-07-27T14:35:00.925366+0000","last_active":"2023-07-27T14:35:01.394438+0000","last_peered":"2023-07-27T14:35:01.394438+0000","last_clean":"2023-07-27T14:35:01.394438+0000","last_became_active":"2023-07-27T14:35:00.925066+0000","last_became_peered":"2023-07-27T14:35:00.925066+0000","last_unstale":"2023-07-27T14:35:01.394438+0000","last_undegraded":"2023-07-27T14:35:01.394438+0000","last_fullsized":"2023-07-27T14:35:01.394438+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393373+0000","last_change":"2023-07-27T14:35:01.387371+0000","last_active":"2023-07-27T14:35:01.393373+0000","last_peered":"2023-07-27T14:35:01.393373+0000","last_clean":"2023-07-27T14:35:01.393373+0000","last_became_active":"2023-07-27T14:35:01.387082+0000","last_became_peered":"2023-07-27T14:35:01.387082+0000","last_unstale":"2023-07-27T14:35:01.393373+0000","last_undegraded":"2023-07-27T14:35:01.393373+0000","last_fullsized":"2023-07-27T14:35:01.393373+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.371659+0000","last_change":"2023-07-27T14:35:00.911707+0000","last_active":"2023-07-27T14:35:01.371659+0000","last_peered":"2023-07-27T14:35:01.371659+0000","last_clean":"2023-07-27T14:35:01.371659+0000","last_became_active":"2023-07-27T14:35:00.910806+0000","last_became_peered":"2023-07-27T14:35:00.910806+0000","last_unstale":"2023-07-27T14:35:01.371659+0000","last_undegraded":"2023-07-27T14:35:01.371659+0000","last_fullsized":"2023-07-27T14:35:01.371659+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.391907+0000","last_change":"2023-07-27T14:35:01.386756+0000","last_active":"2023-07-27T14:35:01.391907+0000","last_peered":"2023-07-27T14:35:01.391907+0000","last_clean":"2023-07-27T14:35:01.391907+0000","last_became_active":"2023-07-27T14:35:01.386299+0000","last_became_peered":"2023-07-27T14:35:01.386299+0000","last_unstale":"2023-07-27T14:35:01.391907+0000","last_undegraded":"2023-07-27T14:35:01.391907+0000","last_fullsized":"2023-07-27T14:35:01.391907+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.373603+0000","last_change":"2023-07-27T14:35:00.922418+0000","last_active":"2023-07-27T14:35:01.373603+0000","last_peered":"2023-07-27T14:35:01.373603+0000","last_clean":"2023-07-27T14:35:01.373603+0000","last_became_active":"2023-07-27T14:35:00.922153+0000","last_became_peered":"2023-07-27T14:35:00.922153+0000","last_unstale":"2023-07-27T14:35:01.373603+0000","last_undegraded":"2023-07-27T14:35:01.373603+0000","last_fullsized":"2023-07-27T14:35:01.373603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385329+0000","last_change":"2023-07-27T14:35:01.380431+0000","last_active":"2023-07-27T14:35:01.385329+0000","last_peered":"2023-07-27T14:35:01.385329+0000","last_clean":"2023-07-27T14:35:01.385329+0000","last_became_active":"2023-07-27T14:35:01.380143+0000","last_became_peered":"2023-07-27T14:35:01.380143+0000","last_unstale":"2023-07-27T14:35:01.385329+0000","last_undegraded":"2023-07-27T14:35:01.385329+0000","last_fullsized":"2023-07-27T14:35:01.385329+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.919851+0000","last_change":"2023-07-27T14:35:00.910756+0000","last_active":"2023-07-27T14:35:00.919851+0000","last_peered":"2023-07-27T14:35:00.919851+0000","last_clean":"2023-07-27T14:35:00.919851+0000","last_became_active":"2023-07-27T14:35:00.910496+0000","last_became_peered":"2023-07-27T14:35:00.910496+0000","last_unstale":"2023-07-27T14:35:00.919851+0000","last_undegraded":"2023-07-27T14:35:00.919851+0000","last_fullsized":"2023-07-27T14:35:00.919851+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.388173+0000","last_change":"2023-07-27T14:35:01.388173+0000","last_active":"2023-07-27T14:35:01.388173+0000","last_peered":"2023-07-27T14:35:01.388173+0000","last_clean":"2023-07-27T14:35:01.388173+0000","last_became_active":"2023-07-27T14:35:01.387864+0000","last_became_peered":"2023-07-27T14:35:01.387864+0000","last_unstale":"2023-07-27T14:35:01.388173+0000","last_undegraded":"2023-07-27T14:35:01.388173+0000","last_fullsized":"2023-07-27T14:35:01.388173+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365775+0000","last_change":"2023-07-27T14:35:00.921168+0000","last_active":"2023-07-27T14:35:01.365775+0000","last_peered":"2023-07-27T14:35:01.365775+0000","last_clean":"2023-07-27T14:35:01.365775+0000","last_became_active":"2023-07-27T14:35:00.920852+0000","last_became_peered":"2023-07-27T14:35:00.920852+0000","last_unstale":"2023-07-27T14:35:01.365775+0000","last_undegraded":"2023-07-27T14:35:01.365775+0000","last_fullsized":"2023-07-27T14:35:01.365775+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.380266+0000","last_change":"2023-07-27T14:35:01.380266+0000","last_active":"2023-07-27T14:35:01.380266+0000","last_peered":"2023-07-27T14:35:01.380266+0000","last_clean":"2023-07-27T14:35:01.380266+0000","last_became_active":"2023-07-27T14:35:01.379948+0000","last_became_peered":"2023-07-27T14:35:01.379948+0000","last_unstale":"2023-07-27T14:35:01.380266+0000","last_undegraded":"2023-07-27T14:35:01.380266+0000","last_fullsized":"2023-07-27T14:35:01.380266+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369071+0000","last_change":"2023-07-27T14:35:00.914925+0000","last_active":"2023-07-27T14:35:01.369071+0000","last_peered":"2023-07-27T14:35:01.369071+0000","last_clean":"2023-07-27T14:35:01.369071+0000","last_became_active":"2023-07-27T14:35:00.914651+0000","last_became_peered":"2023-07-27T14:35:00.914651+0000","last_unstale":"2023-07-27T14:35:01.369071+0000","last_undegraded":"2023-07-27T14:35:01.369071+0000","last_fullsized":"2023-07-27T14:35:01.369071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.394519+0000","last_change":"2023-07-27T14:35:01.394519+0000","last_active":"2023-07-27T14:35:01.394519+0000","last_peered":"2023-07-27T14:35:01.394519+0000","last_clean":"2023-07-27T14:35:01.394519+0000","last_became_active":"2023-07-27T14:35:01.394224+0000","last_became_peered":"2023-07-27T14:35:01.394224+0000","last_unstale":"2023-07-27T14:35:01.394519+0000","last_undegraded":"2023-07-27T14:35:01.394519+0000","last_fullsized":"2023-07-27T14:35:01.394519+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.920801+0000","last_change":"2023-07-27T14:35:00.911669+0000","last_active":"2023-07-27T14:35:00.920801+0000","last_peered":"2023-07-27T14:35:00.920801+0000","last_clean":"2023-07-27T14:35:00.920801+0000","last_became_active":"2023-07-27T14:35:00.910715+0000","last_became_peered":"2023-07-27T14:35:00.910715+0000","last_unstale":"2023-07-27T14:35:00.920801+0000","last_undegraded":"2023-07-27T14:35:00.920801+0000","last_fullsized":"2023-07-27T14:35:00.920801+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392280+0000","last_change":"2023-07-27T14:35:01.391034+0000","last_active":"2023-07-27T14:35:01.392280+0000","last_peered":"2023-07-27T14:35:01.392280+0000","last_clean":"2023-07-27T14:35:01.392280+0000","last_became_active":"2023-07-27T14:35:01.390339+0000","last_became_peered":"2023-07-27T14:35:01.390339+0000","last_unstale":"2023-07-27T14:35:01.392280+0000","last_undegraded":"2023-07-27T14:35:01.392280+0000","last_fullsized":"2023-07-27T14:35:01.392280+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369289+0000","last_change":"2023-07-27T14:35:00.917273+0000","last_active":"2023-07-27T14:35:01.369289+0000","last_peered":"2023-07-27T14:35:01.369289+0000","last_clean":"2023-07-27T14:35:01.369289+0000","last_became_active":"2023-07-27T14:35:00.916842+0000","last_became_peered":"2023-07-27T14:35:00.916842+0000","last_unstale":"2023-07-27T14:35:01.369289+0000","last_undegraded":"2023-07-27T14:35:01.369289+0000","last_fullsized":"2023-07-27T14:35:01.369289+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392703+0000","last_change":"2023-07-27T14:35:01.384902+0000","last_active":"2023-07-27T14:35:01.392703+0000","last_peered":"2023-07-27T14:35:01.392703+0000","last_clean":"2023-07-27T14:35:01.392703+0000","last_became_active":"2023-07-27T14:35:01.384101+0000","last_became_peered":"2023-07-27T14:35:01.384101+0000","last_unstale":"2023-07-27T14:35:01.392703+0000","last_undegraded":"2023-07-27T14:35:01.392703+0000","last_fullsized":"2023-07-27T14:35:01.392703+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392583+0000","last_change":"2023-07-27T14:35:00.920472+0000","last_active":"2023-07-27T14:35:01.392583+0000","last_peered":"2023-07-27T14:35:01.392583+0000","last_clean":"2023-07-27T14:35:01.392583+0000","last_became_active":"2023-07-27T14:35:00.920112+0000","last_became_peered":"2023-07-27T14:35:00.920112+0000","last_unstale":"2023-07-27T14:35:01.392583+0000","last_undegraded":"2023-07-27T14:35:01.392583+0000","last_fullsized":"2023-07-27T14:35:01.392583+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":113,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.899800+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:35:00.899800+0000","last_peered":"2023-07-27T14:35:00.899800+0000","last_clean":"2023-07-27T14:35:00.899800+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:35:00.899800+0000","last_undegraded":"2023-07-27T14:35:00.899800+0000","last_fullsized":"2023-07-27T14:35:00.899800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.394473+0000","last_change":"2023-07-27T14:35:01.388696+0000","last_active":"2023-07-27T14:35:01.394473+0000","last_peered":"2023-07-27T14:35:01.394473+0000","last_clean":"2023-07-27T14:35:01.394473+0000","last_became_active":"2023-07-27T14:35:01.387517+0000","last_became_peered":"2023-07-27T14:35:01.387517+0000","last_unstale":"2023-07-27T14:35:01.394473+0000","last_undegraded":"2023-07-27T14:35:01.394473+0000","last_fullsized":"2023-07-27T14:35:01.394473+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.395358+0000","last_change":"2023-07-27T14:35:00.918149+0000","last_active":"2023-07-27T14:35:01.395358+0000","last_peered":"2023-07-27T14:35:01.395358+0000","last_clean":"2023-07-27T14:35:01.395358+0000","last_became_active":"2023-07-27T14:35:00.917905+0000","last_became_peered":"2023-07-27T14:35:00.917905+0000","last_unstale":"2023-07-27T14:35:01.395358+0000","last_undegraded":"2023-07-27T14:35:01.395358+0000","last_fullsized":"2023-07-27T14:35:01.395358+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":116,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365535+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:35:01.365535+0000","last_peered":"2023-07-27T14:35:01.365535+0000","last_clean":"2023-07-27T14:35:01.365535+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:35:01.365535+0000","last_undegraded":"2023-07-27T14:35:01.365535+0000","last_fullsized":"2023-07-27T14:35:01.365535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393967+0000","last_change":"2023-07-27T14:35:01.388677+0000","last_active":"2023-07-27T14:35:01.393967+0000","last_peered":"2023-07-27T14:35:01.393967+0000","last_clean":"2023-07-27T14:35:01.393967+0000","last_became_active":"2023-07-27T14:35:01.388398+0000","last_became_peered":"2023-07-27T14:35:01.388398+0000","last_unstale":"2023-07-27T14:35:01.393967+0000","last_undegraded":"2023-07-27T14:35:01.393967+0000","last_fullsized":"2023-07-27T14:35:01.393967+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"141'4","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392928+0000","last_change":"2023-07-27T14:35:00.918341+0000","last_active":"2023-07-27T14:35:01.392928+0000","last_peered":"2023-07-27T14:35:01.392928+0000","last_clean":"2023-07-27T14:35:01.392928+0000","last_became_active":"2023-07-27T14:35:00.917925+0000","last_became_peered":"2023-07-27T14:35:00.917925+0000","last_unstale":"2023-07-27T14:35:01.392928+0000","last_undegraded":"2023-07-27T14:35:01.392928+0000","last_fullsized":"2023-07-27T14:35:01.392928+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369768+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:35:01.369768+0000","last_peered":"2023-07-27T14:35:01.369768+0000","last_clean":"2023-07-27T14:35:01.369768+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:35:01.369768+0000","last_undegraded":"2023-07-27T14:35:01.369768+0000","last_fullsized":"2023-07-27T14:35:01.369768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393513+0000","last_change":"2023-07-27T14:35:01.390183+0000","last_active":"2023-07-27T14:35:01.393513+0000","last_peered":"2023-07-27T14:35:01.393513+0000","last_clean":"2023-07-27T14:35:01.393513+0000","last_became_active":"2023-07-27T14:35:01.389884+0000","last_became_peered":"2023-07-27T14:35:01.389884+0000","last_unstale":"2023-07-27T14:35:01.393513+0000","last_undegraded":"2023-07-27T14:35:01.393513+0000","last_fullsized":"2023-07-27T14:35:01.393513+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368966+0000","last_change":"2023-07-27T14:35:00.923235+0000","last_active":"2023-07-27T14:35:01.368966+0000","last_peered":"2023-07-27T14:35:01.368966+0000","last_clean":"2023-07-27T14:35:01.368966+0000","last_became_active":"2023-07-27T14:35:00.922650+0000","last_became_peered":"2023-07-27T14:35:00.922650+0000","last_unstale":"2023-07-27T14:35:01.368966+0000","last_undegraded":"2023-07-27T14:35:01.368966+0000","last_fullsized":"2023-07-27T14:35:01.368966+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365862+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:35:01.365862+0000","last_peered":"2023-07-27T14:35:01.365862+0000","last_clean":"2023-07-27T14:35:01.365862+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:35:01.365862+0000","last_undegraded":"2023-07-27T14:35:01.365862+0000","last_fullsized":"2023-07-27T14:35:01.365862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.366991+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:35:01.366991+0000","last_peered":"2023-07-27T14:35:01.366991+0000","last_clean":"2023-07-27T14:35:01.366991+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:35:01.366991+0000","last_undegraded":"2023-07-27T14:35:01.366991+0000","last_fullsized":"2023-07-27T14:35:01.366991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.380217+0000","last_change":"2023-07-27T14:35:01.375815+0000","last_active":"2023-07-27T14:35:01.380217+0000","last_peered":"2023-07-27T14:35:01.380217+0000","last_clean":"2023-07-27T14:35:01.380217+0000","last_became_active":"2023-07-27T14:35:01.375317+0000","last_became_peered":"2023-07-27T14:35:01.375317+0000","last_unstale":"2023-07-27T14:35:01.380217+0000","last_undegraded":"2023-07-27T14:35:01.380217+0000","last_fullsized":"2023-07-27T14:35:01.380217+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.370547+0000","last_change":"2023-07-27T14:35:00.920933+0000","last_active":"2023-07-27T14:35:01.370547+0000","last_peered":"2023-07-27T14:35:01.370547+0000","last_clean":"2023-07-27T14:35:01.370547+0000","last_became_active":"2023-07-27T14:35:00.920621+0000","last_became_peered":"2023-07-27T14:35:00.920621+0000","last_unstale":"2023-07-27T14:35:01.370547+0000","last_undegraded":"2023-07-27T14:35:01.370547+0000","last_fullsized":"2023-07-27T14:35:01.370547+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.367090+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:35:01.367090+0000","last_peered":"2023-07-27T14:35:01.367090+0000","last_clean":"2023-07-27T14:35:01.367090+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:35:01.367090+0000","last_undegraded":"2023-07-27T14:35:01.367090+0000","last_fullsized":"2023-07-27T14:35:01.367090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393394+0000","last_change":"2023-07-27T14:35:01.387660+0000","last_active":"2023-07-27T14:35:01.393394+0000","last_peered":"2023-07-27T14:35:01.393394+0000","last_clean":"2023-07-27T14:35:01.393394+0000","last_became_active":"2023-07-27T14:35:01.387317+0000","last_became_peered":"2023-07-27T14:35:01.387317+0000","last_unstale":"2023-07-27T14:35:01.393394+0000","last_undegraded":"2023-07-27T14:35:01.393394+0000","last_fullsized":"2023-07-27T14:35:01.393394+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393033+0000","last_change":"2023-07-27T14:35:00.916113+0000","last_active":"2023-07-27T14:35:01.393033+0000","last_peered":"2023-07-27T14:35:01.393033+0000","last_clean":"2023-07-27T14:35:01.393033+0000","last_became_active":"2023-07-27T14:35:00.915823+0000","last_became_peered":"2023-07-27T14:35:00.915823+0000","last_unstale":"2023-07-27T14:35:01.393033+0000","last_undegraded":"2023-07-27T14:35:01.393033+0000","last_fullsized":"2023-07-27T14:35:01.393033+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369055+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:35:01.369055+0000","last_peered":"2023-07-27T14:35:01.369055+0000","last_clean":"2023-07-27T14:35:01.369055+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:35:01.369055+0000","last_undegraded":"2023-07-27T14:35:01.369055+0000","last_fullsized":"2023-07-27T14:35:01.369055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396275+0000","last_change":"2023-07-27T14:35:01.392464+0000","last_active":"2023-07-27T14:35:01.396275+0000","last_peered":"2023-07-27T14:35:01.396275+0000","last_clean":"2023-07-27T14:35:01.396275+0000","last_became_active":"2023-07-27T14:35:01.392079+0000","last_became_peered":"2023-07-27T14:35:01.392079+0000","last_unstale":"2023-07-27T14:35:01.396275+0000","last_undegraded":"2023-07-27T14:35:01.396275+0000","last_fullsized":"2023-07-27T14:35:01.396275+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365536+0000","last_change":"2023-07-27T14:35:00.915291+0000","last_active":"2023-07-27T14:35:01.365536+0000","last_peered":"2023-07-27T14:35:01.365536+0000","last_clean":"2023-07-27T14:35:01.365536+0000","last_became_active":"2023-07-27T14:35:00.915025+0000","last_became_peered":"2023-07-27T14:35:00.915025+0000","last_unstale":"2023-07-27T14:35:01.365536+0000","last_undegraded":"2023-07-27T14:35:01.365536+0000","last_fullsized":"2023-07-27T14:35:01.365536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":113,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.900638+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:35:00.900638+0000","last_peered":"2023-07-27T14:35:00.900638+0000","last_clean":"2023-07-27T14:35:00.900638+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:35:00.900638+0000","last_undegraded":"2023-07-27T14:35:00.900638+0000","last_fullsized":"2023-07-27T14:35:00.900638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.388425+0000","last_change":"2023-07-27T14:35:01.388425+0000","last_active":"2023-07-27T14:35:01.388425+0000","last_peered":"2023-07-27T14:35:01.388425+0000","last_clean":"2023-07-27T14:35:01.388425+0000","last_became_active":"2023-07-27T14:35:01.387458+0000","last_became_peered":"2023-07-27T14:35:01.387458+0000","last_unstale":"2023-07-27T14:35:01.388425+0000","last_undegraded":"2023-07-27T14:35:01.388425+0000","last_fullsized":"2023-07-27T14:35:01.388425+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.370506+0000","last_change":"2023-07-27T14:35:00.923963+0000","last_active":"2023-07-27T14:35:01.370506+0000","last_peered":"2023-07-27T14:35:01.370506+0000","last_clean":"2023-07-27T14:35:01.370506+0000","last_became_active":"2023-07-27T14:35:00.921720+0000","last_became_peered":"2023-07-27T14:35:00.921720+0000","last_unstale":"2023-07-27T14:35:01.370506+0000","last_undegraded":"2023-07-27T14:35:01.370506+0000","last_fullsized":"2023-07-27T14:35:01.370506+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.377341+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:35:01.377341+0000","last_peered":"2023-07-27T14:35:01.377341+0000","last_clean":"2023-07-27T14:35:01.377341+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:35:01.377341+0000","last_undegraded":"2023-07-27T14:35:01.377341+0000","last_fullsized":"2023-07-27T14:35:01.377341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16148,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":14400,"kb_avail":94355692,"statfs":{"total":96636764160,"available":96620228608,"internally_reserved":0,"allocated":1781760,"data_stored":832465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14745600},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.66100000000000003},"min":{"1min":0.439,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80100000000000005,"5min":0.96599999999999997,"15min":1.133},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.67200000000000004},"min":{"1min":0.498,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89900000000000002,"5min":1.0589999999999999,"15min":1.1180000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.45300000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.72299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88700000000000001,"5min":0.96999999999999997,"15min":1.1459999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.68200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84199999999999997,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":0.96499999999999997,"15min":1.119},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65900000000000003,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99399999999999999,"5min":1.069,"15min":1.069},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84099999999999997,"5min":0.92800000000000005,"15min":1.165},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.88700000000000001,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.754},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88500000000000001,"5min":1.202,"15min":1.202},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.54800000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":1.101,"15min":1.101},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90800000000000003,"5min":1.056,"15min":1.056},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.52400000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0409999999999999},"last":0.875}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15760,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94356080,"statfs":{"total":96636764160,"available":96620625920,"internally_reserved":0,"allocated":1777664,"data_stored":832713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.45400000000000001,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.996}]},{"osd":1,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86399999999999999,"15min":0.94399999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64400000000000002,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88700000000000001,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.66600000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":0.95199999999999996,"15min":1.2},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.52000000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.97699999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.49399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.86299999999999999,"15min":0.94399999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.98999999999999999,"15min":1.079},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.67400000000000004},"min":{"1min":0.41799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":0.98899999999999999,"15min":1.198},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67300000000000004,"15min":0.68600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":1.0149999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.54400000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.052,"5min":1.054,"15min":1.1000000000000001},"last":1.052},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0389999999999999,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":1.0389999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":16512,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":1757184,"data_stored":825027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16908288},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38900000000000001,"15min":0.501},"min":{"1min":0.27800000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.65500000000000003,"15min":4.75},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.42499999999999999,"15min":0.64100000000000001},"min":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.70199999999999996,"15min":9.3100000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46300000000000002,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.56200000000000006,"5min":0.67500000000000004,"15min":3.7210000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64300000000000002,"5min":0.79700000000000004,"15min":2.7160000000000002},"last":0.432}]},{"osd":3,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.52000000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.58299999999999996,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.55700000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61299999999999999,"5min":0.747,"15min":3.8580000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":2.181},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67700000000000005,"15min":0.72199999999999998},"min":{"1min":0.53300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":2.4180000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.76700000000000002},"min":{"1min":0.52300000000000002,"5min":0.47999999999999998,"15min":0.46600000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":3.7440000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70599999999999996,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":1.131,"5min":1.131,"15min":2.149},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69399999999999995,"15min":0.73699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":2.052},"last":0.873},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68799999999999994,"15min":0.83399999999999996},"min":{"1min":0.54000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.98499999999999999,"15min":6.1980000000000004},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.748},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.44800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":2.016},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76500000000000001,"15min":0.84299999999999997},"min":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.55700000000000005},"max":{"1min":1.054,"5min":1.054,"15min":3.7799999999999998},"last":0.83699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17032,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94354808,"statfs":{"total":96636764160,"available":96619323392,"internally_reserved":0,"allocated":1769472,"data_stored":825153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.48899999999999999,"5min":0.58299999999999996,"15min":0.79500000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.24399999999999999},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32500000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51100000000000001,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.496},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.52800000000000002,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45700000000000002,"15min":0.46999999999999997},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.624,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.57899999999999996,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.56499999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89200000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.47899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93100000000000005,"5min":1.28,"15min":1.28},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.45000000000000001},"max":{"1min":0.96999999999999997,"5min":1.25,"15min":1.25},"last":0.871},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70499999999999996,"15min":0.71999999999999997},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82999999999999996,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.89300000000000002,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95099999999999996,"5min":1.22,"15min":1.22},"last":0.753}]},{"osd":7,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":0.88200000000000001,"5min":1.244,"15min":1.244},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91900000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24592,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":22848,"kb_avail":94347248,"statfs":{"total":96636764160,"available":96611581952,"internally_reserved":0,"allocated":1777664,"data_stored":832319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23396352},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.41499999999999998},"min":{"1min":0.29399999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57399999999999995,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.45300000000000001,"15min":0.47699999999999998},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58899999999999997,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.48099999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60999999999999999,"5min":0.73999999999999999,"15min":0.96399999999999997},"last":0.377},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53700000000000003,"5min":5.601,"15min":5.601},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.47799999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57199999999999995,"5min":0.81100000000000005,"15min":0.83499999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60099999999999998,"5min":1.353,"15min":1.353},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88,"5min":1.849,"15min":1.849},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76000000000000001,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.85899999999999999,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.53700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.96199999999999997,"5min":1.073,"15min":1.073},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89300000000000002,"5min":1.772,"15min":1.772},"last":1.04}]},{"osd":6,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.872,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.77400000000000002},"min":{"1min":0.50700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.998,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":1.048}]},{"osd":7,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94299999999999995,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.85599999999999998,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16592,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94355248,"statfs":{"total":96636764160,"available":96619773952,"internally_reserved":0,"allocated":1777664,"data_stored":832375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.66800000000000004,"5min":1.202,"15min":1.202},"last":0.438},{"interface":"front","average":{"1min":0.374,"5min":0.41199999999999998,"15min":0.436},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51100000000000001,"5min":1.302,"15min":1.302},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.28000000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52500000000000002,"5min":0.748,"15min":0.88900000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.46400000000000002,"15min":0.44700000000000001},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.56499999999999995,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.5}]},{"osd":2,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47999999999999998,"15min":0.49099999999999999},"min":{"1min":0.39100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53800000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.53900000000000003,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67400000000000004,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.90700000000000003,"5min":0.96299999999999997,"15min":1.149},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73699999999999999,"15min":0.72599999999999998},"min":{"1min":0.54200000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.92400000000000004,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69599999999999995,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92700000000000005,"5min":1.232,"15min":1.232},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.58399999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.45200000000000001},"max":{"1min":0.95399999999999996,"5min":1.121,"15min":1.298},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.60699999999999998,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":1.0129999999999999,"5min":1.343,"15min":1.343},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.64400000000000002,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.96499999999999997,"5min":2.048,"15min":2.048},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.625,"5min":0.505,"15min":0.49299999999999999},"max":{"1min":1.0649999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.0649999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15492,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356348,"statfs":{"total":96636764160,"available":96620900352,"internally_reserved":0,"allocated":1765376,"data_stored":825651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65900000000000003,"15min":0.66800000000000004},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.874,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.52800000000000002,"5min":0.435,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.97199999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86899999999999999,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.752},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84299999999999997,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":4.476,"15min":4.476},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94199999999999995,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.71699999999999997,"15min":0.68500000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81899999999999995,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.497},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82899999999999996,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.66200000000000003},"min":{"1min":0.434,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":5.194,"15min":5.194},"last":0.443},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0089999999999999,"5min":2.819,"15min":2.819},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96999999999999997,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17168,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94354672,"statfs":{"total":96636764160,"available":96619184128,"internally_reserved":0,"allocated":1777664,"data_stored":832645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.35499999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.371},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.71699999999999997,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.438}]},{"osd":1,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.71899999999999997,"15min":0.69799999999999995},"min":{"1min":0.45600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.71599999999999997,"15min":0.68300000000000005},"min":{"1min":0.52000000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.88300000000000001,"5min":1.581,"15min":1.581},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86399999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.505}]},{"osd":3,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72099999999999997,"15min":0.68799999999999994},"min":{"1min":0.51500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.89800000000000002,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.80600000000000005,"15min":0.78400000000000003},"min":{"1min":0.496,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.41399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88200000000000001,"5min":1.978,"15min":1.978},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.46999999999999997,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.77400000000000002,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.67600000000000005,"15min":0.61599999999999999},"min":{"1min":0.45100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.755,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89800000000000002,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.82799999999999996,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.85699999999999998,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:35:05.676 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:35:05.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.850+0000 7efd659ff700 1 Processor -- start 2023-07-27T14:35:05.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.850+0000 7efd659ff700 1 -- start start 2023-07-27T14:35:05.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.851+0000 7efd659ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd600aaa40 0x7efd600640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.851+0000 7efd659ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600aa4d0 con 0x7efd60153ec0 2023-07-27T14:35:05.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.851+0000 7efd659ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600c05c0 con 0x7efd601542a0 2023-07-27T14:35:05.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.851+0000 7efd659ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600aa270 con 0x7efd600aaa40 2023-07-27T14:35:05.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.851+0000 7efd5effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efd60153ec0 0x7efd600a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46698/0 (socket says 172.21.15.115:46698) 2023-07-27T14:35:05.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.851+0000 7efd5effd700 1 -- 172.21.15.115:0/2942137636 learned_addr learned my addr 172.21.15.115:0/2942137636 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:05.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5e7fc700 1 --2- 172.21.15.115:0/2942137636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd600aaa40 0x7efd600640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5dffb700 1 -- 172.21.15.115:0/2942137636 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192301513 0 0) 0x7efd50001110 con 0x7efd60153ec0 2023-07-27T14:35:05.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5dffb700 1 -- 172.21.15.115:0/2942137636 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd480033f0 con 0x7efd60153ec0 2023-07-27T14:35:05.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5dffb700 1 -- 172.21.15.115:0/2942137636 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635311308 0 0) 0x7efd600c05c0 con 0x7efd601542a0 2023-07-27T14:35:05.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5dffb700 1 -- 172.21.15.115:0/2942137636 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd50001110 con 0x7efd601542a0 2023-07-27T14:35:05.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5dffb700 1 -- 172.21.15.115:0/2942137636 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2413642714 0 0) 0x7efd480033f0 con 0x7efd60153ec0 2023-07-27T14:35:05.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5e7fc700 1 -- 172.21.15.115:0/2942137636 >> v1:172.21.15.159:6789/0 conn(0x7efd601542a0 legacy=0x7efd600c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5e7fc700 1 -- 172.21.15.115:0/2942137636 >> v1:172.21.15.115:6789/0 conn(0x7efd60153ec0 legacy=0x7efd600a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5e7fc700 1 -- 172.21.15.115:0/2942137636 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600bfc90 con 0x7efd600aaa40 2023-07-27T14:35:05.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.852+0000 7efd5e7fc700 1 --2- 172.21.15.115:0/2942137636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd600aaa40 0x7efd600640f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7efd54009790 tx=0x7efd54009060).ready entity=mon.2 client_cookie=38ccff35d1db252c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd5dffb700 1 -- 172.21.15.115:0/2942137636 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50001600 con 0x7efd600aaa40 2023-07-27T14:35:05.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd5dffb700 1 -- 172.21.15.115:0/2942137636 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54011400 con 0x7efd600aaa40 2023-07-27T14:35:05.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd5dffb700 1 -- 172.21.15.115:0/2942137636 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011780 con 0x7efd600aaa40 2023-07-27T14:35:05.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd659ff700 1 -- 172.21.15.115:0/2942137636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd600aaa40 msgr2=0x7efd600640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd659ff700 1 --2- 172.21.15.115:0/2942137636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd600aaa40 0x7efd600640f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7efd54009790 tx=0x7efd54009060).stop 2023-07-27T14:35:05.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd659ff700 1 -- 172.21.15.115:0/2942137636 shutdown_connections 2023-07-27T14:35:05.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd659ff700 1 --2- 172.21.15.115:0/2942137636 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd600aaa40 0x7efd600640f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd659ff700 1 -- 172.21.15.115:0/2942137636 >> 172.21.15.115:0/2942137636 conn(0x7efd600cb610 msgr2=0x7efd600c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:05.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd659ff700 1 -- 172.21.15.115:0/2942137636 shutdown_connections 2023-07-27T14:35:05.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.853+0000 7efd659ff700 1 -- 172.21.15.115:0/2942137636 wait complete. 2023-07-27T14:35:05.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.855+0000 7efd659ff700 1 Processor -- start 2023-07-27T14:35:05.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.855+0000 7efd659ff700 1 -- start start 2023-07-27T14:35:05.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd659ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd600aaa40 0x7efd6014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd659ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd60153ec0 0x7efd601569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd659ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd601542a0 0x7efd60156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd659ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd60157b00 con 0x7efd600aaa40 2023-07-27T14:35:05.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd659ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd600c2140 con 0x7efd601542a0 2023-07-27T14:35:05.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd659ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd60158c00 con 0x7efd60153ec0 2023-07-27T14:35:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd600aaa40 0x7efd6014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd600aaa40 0x7efd6014f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38142/0 (socket says 172.21.15.115:38142) 2023-07-27T14:35:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5effd700 1 -- 172.21.15.115:0/542956755 learned_addr learned my addr 172.21.15.115:0/542956755 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5e7fc700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd60153ec0 0x7efd601569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5f7fe700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd601542a0 0x7efd60156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5effd700 1 -- 172.21.15.115:0/542956755 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd60153ec0 msgr2=0x7efd601569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5effd700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd60153ec0 0x7efd601569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5effd700 1 -- 172.21.15.115:0/542956755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd601542a0 msgr2=0x7efd60156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5effd700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd601542a0 0x7efd60156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.856+0000 7efd5effd700 1 -- 172.21.15.115:0/542956755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd540092a0 con 0x7efd600aaa40 2023-07-27T14:35:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.857+0000 7efd5effd700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd600aaa40 0x7efd6014f9f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7efd5000c930 tx=0x7efd50001c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.857+0000 7efd46ffd700 1 -- 172.21.15.115:0/542956755 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50007170 con 0x7efd600aaa40 2023-07-27T14:35:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.857+0000 7efd46ffd700 1 -- 172.21.15.115:0/542956755 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500072d0 con 0x7efd600aaa40 2023-07-27T14:35:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.857+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd60157540 con 0x7efd600aaa40 2023-07-27T14:35:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.857+0000 7efd46ffd700 1 -- 172.21.15.115:0/542956755 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500048c0 con 0x7efd600aaa40 2023-07-27T14:35:05.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.857+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd600c1dd0 con 0x7efd600aaa40 2023-07-27T14:35:05.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.858+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd600c1c10 con 0x7efd600aaa40 2023-07-27T14:35:05.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.859+0000 7efd46ffd700 1 -- 172.21.15.115:0/542956755 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7efd50010070 con 0x7efd600aaa40 2023-07-27T14:35:05.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.860+0000 7efd46ffd700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efd4c05f720 0x7efd4c061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:05.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.860+0000 7efd46ffd700 1 -- 172.21.15.115:0/542956755 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efd5007a5c0 con 0x7efd600aaa40 2023-07-27T14:35:05.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.860+0000 7efd5e7fc700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efd4c05f720 0x7efd4c061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:05.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.860+0000 7efd5e7fc700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efd4c05f720 0x7efd4c061be0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7efd600aae20 tx=0x7efd54016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:05.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:05.863+0000 7efd46ffd700 1 -- 172.21.15.115:0/542956755 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efd5004b0c0 con 0x7efd600aaa40 2023-07-27T14:35:06.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.028+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd600aa4d0 con 0x7efd4c05f720 2023-07-27T14:35:06.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.038+0000 7efd46ffd700 1 -- 172.21.15.115:0/542956755 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361770 (secure 0 0 0) 0x7efd600aa4d0 con 0x7efd4c05f720 2023-07-27T14:35:06.086 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:35:06.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efd4c05f720 msgr2=0x7efd4c061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efd4c05f720 0x7efd4c061be0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7efd600aae20 tx=0x7efd54016000).stop 2023-07-27T14:35:06.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd600aaa40 msgr2=0x7efd6014f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd600aaa40 0x7efd6014f9f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7efd5000c930 tx=0x7efd50001c90).stop 2023-07-27T14:35:06.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 shutdown_connections 2023-07-27T14:35:06.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efd4c05f720 0x7efd4c061be0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd601542a0 0x7efd60156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd600aaa40 0x7efd6014f9f0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 --2- 172.21.15.115:0/542956755 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efd60153ec0 0x7efd601569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 >> 172.21.15.115:0/542956755 conn(0x7efd600cb610 msgr2=0x7efd60156080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:06.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 shutdown_connections 2023-07-27T14:35:06.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.043+0000 7efd659ff700 1 -- 172.21.15.115:0/542956755 wait complete. 2023-07-27T14:35:06.090 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:35:06.104 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2023-07-27T14:35:05.546809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":141020,"kb_used_data":13852,"kb_used_omap":0,"kb_used_meta":127104,"kb_avail":754833700,"statfs":{"total":773094113280,"available":772949708800,"internally_reserved":0,"allocated":14184448,"data_stored":6638348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":130154496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1895966,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-77,"num_read_kb":-65561,"num_write":-553,"num_write_kb":-133019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.216922"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393266+0000","last_change":"2023-07-27T14:35:01.387587+0000","last_active":"2023-07-27T14:35:01.393266+0000","last_peered":"2023-07-27T14:35:01.393266+0000","last_clean":"2023-07-27T14:35:01.393266+0000","last_became_active":"2023-07-27T14:35:01.387259+0000","last_became_peered":"2023-07-27T14:35:01.387259+0000","last_unstale":"2023-07-27T14:35:01.393266+0000","last_undegraded":"2023-07-27T14:35:01.393266+0000","last_fullsized":"2023-07-27T14:35:01.393266+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396229+0000","last_change":"2023-07-27T14:35:00.921158+0000","last_active":"2023-07-27T14:35:01.396229+0000","last_peered":"2023-07-27T14:35:01.396229+0000","last_clean":"2023-07-27T14:35:01.396229+0000","last_became_active":"2023-07-27T14:35:00.920899+0000","last_became_peered":"2023-07-27T14:35:00.920899+0000","last_unstale":"2023-07-27T14:35:01.396229+0000","last_undegraded":"2023-07-27T14:35:01.396229+0000","last_fullsized":"2023-07-27T14:35:01.396229+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392137+0000","last_change":"2023-07-27T14:35:01.386576+0000","last_active":"2023-07-27T14:35:01.392137+0000","last_peered":"2023-07-27T14:35:01.392137+0000","last_clean":"2023-07-27T14:35:01.392137+0000","last_became_active":"2023-07-27T14:35:01.386243+0000","last_became_peered":"2023-07-27T14:35:01.386243+0000","last_unstale":"2023-07-27T14:35:01.392137+0000","last_undegraded":"2023-07-27T14:35:01.392137+0000","last_fullsized":"2023-07-27T14:35:01.392137+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.922965+0000","last_change":"2023-07-27T14:35:00.914222+0000","last_active":"2023-07-27T14:35:00.922965+0000","last_peered":"2023-07-27T14:35:00.922965+0000","last_clean":"2023-07-27T14:35:00.922965+0000","last_became_active":"2023-07-27T14:35:00.913894+0000","last_became_peered":"2023-07-27T14:35:00.913894+0000","last_unstale":"2023-07-27T14:35:00.922965+0000","last_undegraded":"2023-07-27T14:35:00.922965+0000","last_fullsized":"2023-07-27T14:35:00.922965+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.388756+0000","last_change":"2023-07-27T14:35:01.388756+0000","last_active":"2023-07-27T14:35:01.388756+0000","last_peered":"2023-07-27T14:35:01.388756+0000","last_clean":"2023-07-27T14:35:01.388756+0000","last_became_active":"2023-07-27T14:35:01.388405+0000","last_became_peered":"2023-07-27T14:35:01.388405+0000","last_unstale":"2023-07-27T14:35:01.388756+0000","last_undegraded":"2023-07-27T14:35:01.388756+0000","last_fullsized":"2023-07-27T14:35:01.388756+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.372714+0000","last_change":"2023-07-27T14:35:00.923571+0000","last_active":"2023-07-27T14:35:01.372714+0000","last_peered":"2023-07-27T14:35:01.372714+0000","last_clean":"2023-07-27T14:35:01.372714+0000","last_became_active":"2023-07-27T14:35:00.923161+0000","last_became_peered":"2023-07-27T14:35:00.923161+0000","last_unstale":"2023-07-27T14:35:01.372714+0000","last_undegraded":"2023-07-27T14:35:01.372714+0000","last_fullsized":"2023-07-27T14:35:01.372714+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.384595+0000","last_change":"2023-07-27T14:35:01.379040+0000","last_active":"2023-07-27T14:35:01.384595+0000","last_peered":"2023-07-27T14:35:01.384595+0000","last_clean":"2023-07-27T14:35:01.384595+0000","last_became_active":"2023-07-27T14:35:01.378750+0000","last_became_peered":"2023-07-27T14:35:01.378750+0000","last_unstale":"2023-07-27T14:35:01.384595+0000","last_undegraded":"2023-07-27T14:35:01.384595+0000","last_fullsized":"2023-07-27T14:35:01.384595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.394025+0000","last_change":"2023-07-27T14:35:00.917665+0000","last_active":"2023-07-27T14:35:01.394025+0000","last_peered":"2023-07-27T14:35:01.394025+0000","last_clean":"2023-07-27T14:35:01.394025+0000","last_became_active":"2023-07-27T14:35:00.917409+0000","last_became_peered":"2023-07-27T14:35:00.917409+0000","last_unstale":"2023-07-27T14:35:01.394025+0000","last_undegraded":"2023-07-27T14:35:01.394025+0000","last_fullsized":"2023-07-27T14:35:01.394025+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.387411+0000","last_change":"2023-07-27T14:35:01.383661+0000","last_active":"2023-07-27T14:35:01.387411+0000","last_peered":"2023-07-27T14:35:01.387411+0000","last_clean":"2023-07-27T14:35:01.387411+0000","last_became_active":"2023-07-27T14:35:01.383368+0000","last_became_peered":"2023-07-27T14:35:01.383368+0000","last_unstale":"2023-07-27T14:35:01.387411+0000","last_undegraded":"2023-07-27T14:35:01.387411+0000","last_fullsized":"2023-07-27T14:35:01.387411+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386402+0000","last_change":"2023-07-27T14:35:00.914098+0000","last_active":"2023-07-27T14:35:01.386402+0000","last_peered":"2023-07-27T14:35:01.386402+0000","last_clean":"2023-07-27T14:35:01.386402+0000","last_became_active":"2023-07-27T14:35:00.913705+0000","last_became_peered":"2023-07-27T14:35:00.913705+0000","last_unstale":"2023-07-27T14:35:01.386402+0000","last_undegraded":"2023-07-27T14:35:01.386402+0000","last_fullsized":"2023-07-27T14:35:01.386402+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393535+0000","last_change":"2023-07-27T14:35:01.390304+0000","last_active":"2023-07-27T14:35:01.393535+0000","last_peered":"2023-07-27T14:35:01.393535+0000","last_clean":"2023-07-27T14:35:01.393535+0000","last_became_active":"2023-07-27T14:35:01.390011+0000","last_became_peered":"2023-07-27T14:35:01.390011+0000","last_unstale":"2023-07-27T14:35:01.393535+0000","last_undegraded":"2023-07-27T14:35:01.393535+0000","last_fullsized":"2023-07-27T14:35:01.393535+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396067+0000","last_change":"2023-07-27T14:35:00.922931+0000","last_active":"2023-07-27T14:35:01.396067+0000","last_peered":"2023-07-27T14:35:01.396067+0000","last_clean":"2023-07-27T14:35:01.396067+0000","last_became_active":"2023-07-27T14:35:00.922586+0000","last_became_peered":"2023-07-27T14:35:00.922586+0000","last_unstale":"2023-07-27T14:35:01.396067+0000","last_undegraded":"2023-07-27T14:35:01.396067+0000","last_fullsized":"2023-07-27T14:35:01.396067+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.383115+0000","last_change":"2023-07-27T14:35:01.380659+0000","last_active":"2023-07-27T14:35:01.383115+0000","last_peered":"2023-07-27T14:35:01.383115+0000","last_clean":"2023-07-27T14:35:01.383115+0000","last_became_active":"2023-07-27T14:35:01.380357+0000","last_became_peered":"2023-07-27T14:35:01.380357+0000","last_unstale":"2023-07-27T14:35:01.383115+0000","last_undegraded":"2023-07-27T14:35:01.383115+0000","last_fullsized":"2023-07-27T14:35:01.383115+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369891+0000","last_change":"2023-07-27T14:35:00.918308+0000","last_active":"2023-07-27T14:35:01.369891+0000","last_peered":"2023-07-27T14:35:01.369891+0000","last_clean":"2023-07-27T14:35:01.369891+0000","last_became_active":"2023-07-27T14:35:00.917984+0000","last_became_peered":"2023-07-27T14:35:00.917984+0000","last_unstale":"2023-07-27T14:35:01.369891+0000","last_undegraded":"2023-07-27T14:35:01.369891+0000","last_fullsized":"2023-07-27T14:35:01.369891+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393141+0000","last_change":"2023-07-27T14:35:01.387024+0000","last_active":"2023-07-27T14:35:01.393141+0000","last_peered":"2023-07-27T14:35:01.393141+0000","last_clean":"2023-07-27T14:35:01.393141+0000","last_became_active":"2023-07-27T14:35:01.386765+0000","last_became_peered":"2023-07-27T14:35:01.386765+0000","last_unstale":"2023-07-27T14:35:01.393141+0000","last_undegraded":"2023-07-27T14:35:01.393141+0000","last_fullsized":"2023-07-27T14:35:01.393141+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.373468+0000","last_change":"2023-07-27T14:35:00.923072+0000","last_active":"2023-07-27T14:35:01.373468+0000","last_peered":"2023-07-27T14:35:01.373468+0000","last_clean":"2023-07-27T14:35:01.373468+0000","last_became_active":"2023-07-27T14:35:00.922453+0000","last_became_peered":"2023-07-27T14:35:00.922453+0000","last_unstale":"2023-07-27T14:35:01.373468+0000","last_undegraded":"2023-07-27T14:35:01.373468+0000","last_fullsized":"2023-07-27T14:35:01.373468+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.387363+0000","last_change":"2023-07-27T14:35:01.387363+0000","last_active":"2023-07-27T14:35:01.387363+0000","last_peered":"2023-07-27T14:35:01.387363+0000","last_clean":"2023-07-27T14:35:01.387363+0000","last_became_active":"2023-07-27T14:35:01.387081+0000","last_became_peered":"2023-07-27T14:35:01.387081+0000","last_unstale":"2023-07-27T14:35:01.387363+0000","last_undegraded":"2023-07-27T14:35:01.387363+0000","last_fullsized":"2023-07-27T14:35:01.387363+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.377176+0000","last_change":"2023-07-27T14:35:00.923017+0000","last_active":"2023-07-27T14:35:01.377176+0000","last_peered":"2023-07-27T14:35:01.377176+0000","last_clean":"2023-07-27T14:35:01.377176+0000","last_became_active":"2023-07-27T14:35:00.922735+0000","last_became_peered":"2023-07-27T14:35:00.922735+0000","last_unstale":"2023-07-27T14:35:01.377176+0000","last_undegraded":"2023-07-27T14:35:01.377176+0000","last_fullsized":"2023-07-27T14:35:01.377176+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393175+0000","last_change":"2023-07-27T14:35:01.386124+0000","last_active":"2023-07-27T14:35:01.393175+0000","last_peered":"2023-07-27T14:35:01.393175+0000","last_clean":"2023-07-27T14:35:01.393175+0000","last_became_active":"2023-07-27T14:35:01.385850+0000","last_became_peered":"2023-07-27T14:35:01.385850+0000","last_unstale":"2023-07-27T14:35:01.393175+0000","last_undegraded":"2023-07-27T14:35:01.393175+0000","last_fullsized":"2023-07-27T14:35:01.393175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.919652+0000","last_change":"2023-07-27T14:35:00.911053+0000","last_active":"2023-07-27T14:35:00.919652+0000","last_peered":"2023-07-27T14:35:00.919652+0000","last_clean":"2023-07-27T14:35:00.919652+0000","last_became_active":"2023-07-27T14:35:00.909978+0000","last_became_peered":"2023-07-27T14:35:00.909978+0000","last_unstale":"2023-07-27T14:35:00.919652+0000","last_undegraded":"2023-07-27T14:35:00.919652+0000","last_fullsized":"2023-07-27T14:35:00.919652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393120+0000","last_change":"2023-07-27T14:35:01.385447+0000","last_active":"2023-07-27T14:35:01.393120+0000","last_peered":"2023-07-27T14:35:01.393120+0000","last_clean":"2023-07-27T14:35:01.393120+0000","last_became_active":"2023-07-27T14:35:01.385003+0000","last_became_peered":"2023-07-27T14:35:01.385003+0000","last_unstale":"2023-07-27T14:35:01.393120+0000","last_undegraded":"2023-07-27T14:35:01.393120+0000","last_fullsized":"2023-07-27T14:35:01.393120+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369891+0000","last_change":"2023-07-27T14:35:00.922494+0000","last_active":"2023-07-27T14:35:01.369891+0000","last_peered":"2023-07-27T14:35:01.369891+0000","last_clean":"2023-07-27T14:35:01.369891+0000","last_became_active":"2023-07-27T14:35:00.922258+0000","last_became_peered":"2023-07-27T14:35:00.922258+0000","last_unstale":"2023-07-27T14:35:01.369891+0000","last_undegraded":"2023-07-27T14:35:01.369891+0000","last_fullsized":"2023-07-27T14:35:01.369891+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393501+0000","last_change":"2023-07-27T14:35:01.393501+0000","last_active":"2023-07-27T14:35:01.393501+0000","last_peered":"2023-07-27T14:35:01.393501+0000","last_clean":"2023-07-27T14:35:01.393501+0000","last_became_active":"2023-07-27T14:35:01.393237+0000","last_became_peered":"2023-07-27T14:35:01.393237+0000","last_unstale":"2023-07-27T14:35:01.393501+0000","last_undegraded":"2023-07-27T14:35:01.393501+0000","last_fullsized":"2023-07-27T14:35:01.393501+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.400514+0000","last_change":"2023-07-27T14:35:00.920294+0000","last_active":"2023-07-27T14:35:01.400514+0000","last_peered":"2023-07-27T14:35:01.400514+0000","last_clean":"2023-07-27T14:35:01.400514+0000","last_became_active":"2023-07-27T14:35:00.919988+0000","last_became_peered":"2023-07-27T14:35:00.919988+0000","last_unstale":"2023-07-27T14:35:01.400514+0000","last_undegraded":"2023-07-27T14:35:01.400514+0000","last_fullsized":"2023-07-27T14:35:01.400514+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393249+0000","last_change":"2023-07-27T14:35:01.389936+0000","last_active":"2023-07-27T14:35:01.393249+0000","last_peered":"2023-07-27T14:35:01.393249+0000","last_clean":"2023-07-27T14:35:01.393249+0000","last_became_active":"2023-07-27T14:35:01.389647+0000","last_became_peered":"2023-07-27T14:35:01.389647+0000","last_unstale":"2023-07-27T14:35:01.393249+0000","last_undegraded":"2023-07-27T14:35:01.393249+0000","last_fullsized":"2023-07-27T14:35:01.393249+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.395484+0000","last_change":"2023-07-27T14:35:00.921306+0000","last_active":"2023-07-27T14:35:01.395484+0000","last_peered":"2023-07-27T14:35:01.395484+0000","last_clean":"2023-07-27T14:35:01.395484+0000","last_became_active":"2023-07-27T14:35:00.920921+0000","last_became_peered":"2023-07-27T14:35:00.920921+0000","last_unstale":"2023-07-27T14:35:01.395484+0000","last_undegraded":"2023-07-27T14:35:01.395484+0000","last_fullsized":"2023-07-27T14:35:01.395484+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393035+0000","last_change":"2023-07-27T14:35:01.385953+0000","last_active":"2023-07-27T14:35:01.393035+0000","last_peered":"2023-07-27T14:35:01.393035+0000","last_clean":"2023-07-27T14:35:01.393035+0000","last_became_active":"2023-07-27T14:35:01.385603+0000","last_became_peered":"2023-07-27T14:35:01.385603+0000","last_unstale":"2023-07-27T14:35:01.393035+0000","last_undegraded":"2023-07-27T14:35:01.393035+0000","last_fullsized":"2023-07-27T14:35:01.393035+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.923301+0000","last_change":"2023-07-27T14:35:00.918595+0000","last_active":"2023-07-27T14:35:00.923301+0000","last_peered":"2023-07-27T14:35:00.923301+0000","last_clean":"2023-07-27T14:35:00.923301+0000","last_became_active":"2023-07-27T14:35:00.918315+0000","last_became_peered":"2023-07-27T14:35:00.918315+0000","last_unstale":"2023-07-27T14:35:00.923301+0000","last_undegraded":"2023-07-27T14:35:00.923301+0000","last_fullsized":"2023-07-27T14:35:00.923301+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.387216+0000","last_change":"2023-07-27T14:35:01.381054+0000","last_active":"2023-07-27T14:35:01.387216+0000","last_peered":"2023-07-27T14:35:01.387216+0000","last_clean":"2023-07-27T14:35:01.387216+0000","last_became_active":"2023-07-27T14:35:01.380745+0000","last_became_peered":"2023-07-27T14:35:01.380745+0000","last_unstale":"2023-07-27T14:35:01.387216+0000","last_undegraded":"2023-07-27T14:35:01.387216+0000","last_fullsized":"2023-07-27T14:35:01.387216+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369685+0000","last_change":"2023-07-27T14:35:00.925351+0000","last_active":"2023-07-27T14:35:01.369685+0000","last_peered":"2023-07-27T14:35:01.369685+0000","last_clean":"2023-07-27T14:35:01.369685+0000","last_became_active":"2023-07-27T14:35:00.924514+0000","last_became_peered":"2023-07-27T14:35:00.924514+0000","last_unstale":"2023-07-27T14:35:01.369685+0000","last_undegraded":"2023-07-27T14:35:01.369685+0000","last_fullsized":"2023-07-27T14:35:01.369685+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.384403+0000","last_change":"2023-07-27T14:35:01.384403+0000","last_active":"2023-07-27T14:35:01.384403+0000","last_peered":"2023-07-27T14:35:01.384403+0000","last_clean":"2023-07-27T14:35:01.384403+0000","last_became_active":"2023-07-27T14:35:01.384116+0000","last_became_peered":"2023-07-27T14:35:01.384116+0000","last_unstale":"2023-07-27T14:35:01.384403+0000","last_undegraded":"2023-07-27T14:35:01.384403+0000","last_fullsized":"2023-07-27T14:35:01.384403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.395404+0000","last_change":"2023-07-27T14:35:00.922634+0000","last_active":"2023-07-27T14:35:01.395404+0000","last_peered":"2023-07-27T14:35:01.395404+0000","last_clean":"2023-07-27T14:35:01.395404+0000","last_became_active":"2023-07-27T14:35:00.922343+0000","last_became_peered":"2023-07-27T14:35:00.922343+0000","last_unstale":"2023-07-27T14:35:01.395404+0000","last_undegraded":"2023-07-27T14:35:01.395404+0000","last_fullsized":"2023-07-27T14:35:01.395404+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.383213+0000","last_change":"2023-07-27T14:35:01.383213+0000","last_active":"2023-07-27T14:35:01.383213+0000","last_peered":"2023-07-27T14:35:01.383213+0000","last_clean":"2023-07-27T14:35:01.383213+0000","last_became_active":"2023-07-27T14:35:01.382834+0000","last_became_peered":"2023-07-27T14:35:01.382834+0000","last_unstale":"2023-07-27T14:35:01.383213+0000","last_undegraded":"2023-07-27T14:35:01.383213+0000","last_fullsized":"2023-07-27T14:35:01.383213+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369259+0000","last_change":"2023-07-27T14:35:00.918567+0000","last_active":"2023-07-27T14:35:01.369259+0000","last_peered":"2023-07-27T14:35:01.369259+0000","last_clean":"2023-07-27T14:35:01.369259+0000","last_became_active":"2023-07-27T14:35:00.918283+0000","last_became_peered":"2023-07-27T14:35:00.918283+0000","last_unstale":"2023-07-27T14:35:01.369259+0000","last_undegraded":"2023-07-27T14:35:01.369259+0000","last_fullsized":"2023-07-27T14:35:01.369259+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.379408+0000","last_change":"2023-07-27T14:35:01.376700+0000","last_active":"2023-07-27T14:35:01.379408+0000","last_peered":"2023-07-27T14:35:01.379408+0000","last_clean":"2023-07-27T14:35:01.379408+0000","last_became_active":"2023-07-27T14:35:01.376393+0000","last_became_peered":"2023-07-27T14:35:01.376393+0000","last_unstale":"2023-07-27T14:35:01.379408+0000","last_undegraded":"2023-07-27T14:35:01.379408+0000","last_fullsized":"2023-07-27T14:35:01.379408+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368462+0000","last_change":"2023-07-27T14:35:00.919003+0000","last_active":"2023-07-27T14:35:01.368462+0000","last_peered":"2023-07-27T14:35:01.368462+0000","last_clean":"2023-07-27T14:35:01.368462+0000","last_became_active":"2023-07-27T14:35:00.918752+0000","last_became_peered":"2023-07-27T14:35:00.918752+0000","last_unstale":"2023-07-27T14:35:01.368462+0000","last_undegraded":"2023-07-27T14:35:01.368462+0000","last_fullsized":"2023-07-27T14:35:01.368462+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.374273+0000","last_change":"2023-07-27T14:35:01.373153+0000","last_active":"2023-07-27T14:35:01.374273+0000","last_peered":"2023-07-27T14:35:01.374273+0000","last_clean":"2023-07-27T14:35:01.374273+0000","last_became_active":"2023-07-27T14:35:01.372845+0000","last_became_peered":"2023-07-27T14:35:01.372845+0000","last_unstale":"2023-07-27T14:35:01.374273+0000","last_undegraded":"2023-07-27T14:35:01.374273+0000","last_fullsized":"2023-07-27T14:35:01.374273+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385442+0000","last_change":"2023-07-27T14:35:00.921092+0000","last_active":"2023-07-27T14:35:01.385442+0000","last_peered":"2023-07-27T14:35:01.385442+0000","last_clean":"2023-07-27T14:35:01.385442+0000","last_became_active":"2023-07-27T14:35:00.920769+0000","last_became_peered":"2023-07-27T14:35:00.920769+0000","last_unstale":"2023-07-27T14:35:01.385442+0000","last_undegraded":"2023-07-27T14:35:01.385442+0000","last_fullsized":"2023-07-27T14:35:01.385442+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.382086+0000","last_change":"2023-07-27T14:35:01.380374+0000","last_active":"2023-07-27T14:35:01.382086+0000","last_peered":"2023-07-27T14:35:01.382086+0000","last_clean":"2023-07-27T14:35:01.382086+0000","last_became_active":"2023-07-27T14:35:01.380064+0000","last_became_peered":"2023-07-27T14:35:01.380064+0000","last_unstale":"2023-07-27T14:35:01.382086+0000","last_undegraded":"2023-07-27T14:35:01.382086+0000","last_fullsized":"2023-07-27T14:35:01.382086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369516+0000","last_change":"2023-07-27T14:35:00.920111+0000","last_active":"2023-07-27T14:35:01.369516+0000","last_peered":"2023-07-27T14:35:01.369516+0000","last_clean":"2023-07-27T14:35:01.369516+0000","last_became_active":"2023-07-27T14:35:00.919827+0000","last_became_peered":"2023-07-27T14:35:00.919827+0000","last_unstale":"2023-07-27T14:35:01.369516+0000","last_undegraded":"2023-07-27T14:35:01.369516+0000","last_fullsized":"2023-07-27T14:35:01.369516+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.388076+0000","last_change":"2023-07-27T14:35:01.381699+0000","last_active":"2023-07-27T14:35:01.388076+0000","last_peered":"2023-07-27T14:35:01.388076+0000","last_clean":"2023-07-27T14:35:01.388076+0000","last_became_active":"2023-07-27T14:35:01.381445+0000","last_became_peered":"2023-07-27T14:35:01.381445+0000","last_unstale":"2023-07-27T14:35:01.388076+0000","last_undegraded":"2023-07-27T14:35:01.388076+0000","last_fullsized":"2023-07-27T14:35:01.388076+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386481+0000","last_change":"2023-07-27T14:35:00.914447+0000","last_active":"2023-07-27T14:35:01.386481+0000","last_peered":"2023-07-27T14:35:01.386481+0000","last_clean":"2023-07-27T14:35:01.386481+0000","last_became_active":"2023-07-27T14:35:00.914100+0000","last_became_peered":"2023-07-27T14:35:00.914100+0000","last_unstale":"2023-07-27T14:35:01.386481+0000","last_undegraded":"2023-07-27T14:35:01.386481+0000","last_fullsized":"2023-07-27T14:35:01.386481+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386086+0000","last_change":"2023-07-27T14:35:01.381632+0000","last_active":"2023-07-27T14:35:01.386086+0000","last_peered":"2023-07-27T14:35:01.386086+0000","last_clean":"2023-07-27T14:35:01.386086+0000","last_became_active":"2023-07-27T14:35:01.381369+0000","last_became_peered":"2023-07-27T14:35:01.381369+0000","last_unstale":"2023-07-27T14:35:01.386086+0000","last_undegraded":"2023-07-27T14:35:01.386086+0000","last_fullsized":"2023-07-27T14:35:01.386086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369701+0000","last_change":"2023-07-27T14:35:00.921963+0000","last_active":"2023-07-27T14:35:01.369701+0000","last_peered":"2023-07-27T14:35:01.369701+0000","last_clean":"2023-07-27T14:35:01.369701+0000","last_became_active":"2023-07-27T14:35:00.921723+0000","last_became_peered":"2023-07-27T14:35:00.921723+0000","last_unstale":"2023-07-27T14:35:01.369701+0000","last_undegraded":"2023-07-27T14:35:01.369701+0000","last_fullsized":"2023-07-27T14:35:01.369701+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.384511+0000","last_change":"2023-07-27T14:35:01.379756+0000","last_active":"2023-07-27T14:35:01.384511+0000","last_peered":"2023-07-27T14:35:01.384511+0000","last_clean":"2023-07-27T14:35:01.384511+0000","last_became_active":"2023-07-27T14:35:01.379500+0000","last_became_peered":"2023-07-27T14:35:01.379500+0000","last_unstale":"2023-07-27T14:35:01.384511+0000","last_undegraded":"2023-07-27T14:35:01.384511+0000","last_fullsized":"2023-07-27T14:35:01.384511+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.370441+0000","last_change":"2023-07-27T14:35:00.921424+0000","last_active":"2023-07-27T14:35:01.370441+0000","last_peered":"2023-07-27T14:35:01.370441+0000","last_clean":"2023-07-27T14:35:01.370441+0000","last_became_active":"2023-07-27T14:35:00.921110+0000","last_became_peered":"2023-07-27T14:35:00.921110+0000","last_unstale":"2023-07-27T14:35:01.370441+0000","last_undegraded":"2023-07-27T14:35:01.370441+0000","last_fullsized":"2023-07-27T14:35:01.370441+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.391619+0000","last_change":"2023-07-27T14:35:01.391619+0000","last_active":"2023-07-27T14:35:01.391619+0000","last_peered":"2023-07-27T14:35:01.391619+0000","last_clean":"2023-07-27T14:35:01.391619+0000","last_became_active":"2023-07-27T14:35:01.391309+0000","last_became_peered":"2023-07-27T14:35:01.391309+0000","last_unstale":"2023-07-27T14:35:01.391619+0000","last_undegraded":"2023-07-27T14:35:01.391619+0000","last_fullsized":"2023-07-27T14:35:01.391619+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.367877+0000","last_change":"2023-07-27T14:35:00.914244+0000","last_active":"2023-07-27T14:35:01.367877+0000","last_peered":"2023-07-27T14:35:01.367877+0000","last_clean":"2023-07-27T14:35:01.367877+0000","last_became_active":"2023-07-27T14:35:00.913921+0000","last_became_peered":"2023-07-27T14:35:00.913921+0000","last_unstale":"2023-07-27T14:35:01.367877+0000","last_undegraded":"2023-07-27T14:35:01.367877+0000","last_fullsized":"2023-07-27T14:35:01.367877+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385286+0000","last_change":"2023-07-27T14:35:01.380455+0000","last_active":"2023-07-27T14:35:01.385286+0000","last_peered":"2023-07-27T14:35:01.385286+0000","last_clean":"2023-07-27T14:35:01.385286+0000","last_became_active":"2023-07-27T14:35:01.380125+0000","last_became_peered":"2023-07-27T14:35:01.380125+0000","last_unstale":"2023-07-27T14:35:01.385286+0000","last_undegraded":"2023-07-27T14:35:01.385286+0000","last_fullsized":"2023-07-27T14:35:01.385286+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.921161+0000","last_change":"2023-07-27T14:35:00.910910+0000","last_active":"2023-07-27T14:35:00.921161+0000","last_peered":"2023-07-27T14:35:00.921161+0000","last_clean":"2023-07-27T14:35:00.921161+0000","last_became_active":"2023-07-27T14:35:00.910565+0000","last_became_peered":"2023-07-27T14:35:00.910565+0000","last_unstale":"2023-07-27T14:35:00.921161+0000","last_undegraded":"2023-07-27T14:35:00.921161+0000","last_fullsized":"2023-07-27T14:35:00.921161+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385437+0000","last_change":"2023-07-27T14:35:01.383430+0000","last_active":"2023-07-27T14:35:01.385437+0000","last_peered":"2023-07-27T14:35:01.385437+0000","last_clean":"2023-07-27T14:35:01.385437+0000","last_became_active":"2023-07-27T14:35:01.383156+0000","last_became_peered":"2023-07-27T14:35:01.383156+0000","last_unstale":"2023-07-27T14:35:01.385437+0000","last_undegraded":"2023-07-27T14:35:01.385437+0000","last_fullsized":"2023-07-27T14:35:01.385437+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368556+0000","last_change":"2023-07-27T14:35:00.922656+0000","last_active":"2023-07-27T14:35:01.368556+0000","last_peered":"2023-07-27T14:35:01.368556+0000","last_clean":"2023-07-27T14:35:01.368556+0000","last_became_active":"2023-07-27T14:35:00.922298+0000","last_became_peered":"2023-07-27T14:35:00.922298+0000","last_unstale":"2023-07-27T14:35:01.368556+0000","last_undegraded":"2023-07-27T14:35:01.368556+0000","last_fullsized":"2023-07-27T14:35:01.368556+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392722+0000","last_change":"2023-07-27T14:35:01.385098+0000","last_active":"2023-07-27T14:35:01.392722+0000","last_peered":"2023-07-27T14:35:01.392722+0000","last_clean":"2023-07-27T14:35:01.392722+0000","last_became_active":"2023-07-27T14:35:01.384518+0000","last_became_peered":"2023-07-27T14:35:01.384518+0000","last_unstale":"2023-07-27T14:35:01.392722+0000","last_undegraded":"2023-07-27T14:35:01.392722+0000","last_fullsized":"2023-07-27T14:35:01.392722+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.371835+0000","last_change":"2023-07-27T14:35:00.921725+0000","last_active":"2023-07-27T14:35:01.371835+0000","last_peered":"2023-07-27T14:35:01.371835+0000","last_clean":"2023-07-27T14:35:01.371835+0000","last_became_active":"2023-07-27T14:35:00.921466+0000","last_became_peered":"2023-07-27T14:35:00.921466+0000","last_unstale":"2023-07-27T14:35:01.371835+0000","last_undegraded":"2023-07-27T14:35:01.371835+0000","last_fullsized":"2023-07-27T14:35:01.371835+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.391953+0000","last_change":"2023-07-27T14:35:01.384214+0000","last_active":"2023-07-27T14:35:01.391953+0000","last_peered":"2023-07-27T14:35:01.391953+0000","last_clean":"2023-07-27T14:35:01.391953+0000","last_became_active":"2023-07-27T14:35:01.383900+0000","last_became_peered":"2023-07-27T14:35:01.383900+0000","last_unstale":"2023-07-27T14:35:01.391953+0000","last_undegraded":"2023-07-27T14:35:01.391953+0000","last_fullsized":"2023-07-27T14:35:01.391953+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365605+0000","last_change":"2023-07-27T14:35:00.914418+0000","last_active":"2023-07-27T14:35:01.365605+0000","last_peered":"2023-07-27T14:35:01.365605+0000","last_clean":"2023-07-27T14:35:01.365605+0000","last_became_active":"2023-07-27T14:35:00.914148+0000","last_became_peered":"2023-07-27T14:35:00.914148+0000","last_unstale":"2023-07-27T14:35:01.365605+0000","last_undegraded":"2023-07-27T14:35:01.365605+0000","last_fullsized":"2023-07-27T14:35:01.365605+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.387481+0000","last_change":"2023-07-27T14:35:01.381848+0000","last_active":"2023-07-27T14:35:01.387481+0000","last_peered":"2023-07-27T14:35:01.387481+0000","last_clean":"2023-07-27T14:35:01.387481+0000","last_became_active":"2023-07-27T14:35:01.381570+0000","last_became_peered":"2023-07-27T14:35:01.381570+0000","last_unstale":"2023-07-27T14:35:01.387481+0000","last_undegraded":"2023-07-27T14:35:01.387481+0000","last_fullsized":"2023-07-27T14:35:01.387481+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.373153+0000","last_change":"2023-07-27T14:35:00.925143+0000","last_active":"2023-07-27T14:35:01.373153+0000","last_peered":"2023-07-27T14:35:01.373153+0000","last_clean":"2023-07-27T14:35:01.373153+0000","last_became_active":"2023-07-27T14:35:00.924900+0000","last_became_peered":"2023-07-27T14:35:00.924900+0000","last_unstale":"2023-07-27T14:35:01.373153+0000","last_undegraded":"2023-07-27T14:35:01.373153+0000","last_fullsized":"2023-07-27T14:35:01.373153+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386068+0000","last_change":"2023-07-27T14:35:01.379515+0000","last_active":"2023-07-27T14:35:01.386068+0000","last_peered":"2023-07-27T14:35:01.386068+0000","last_clean":"2023-07-27T14:35:01.386068+0000","last_became_active":"2023-07-27T14:35:01.379227+0000","last_became_peered":"2023-07-27T14:35:01.379227+0000","last_unstale":"2023-07-27T14:35:01.386068+0000","last_undegraded":"2023-07-27T14:35:01.386068+0000","last_fullsized":"2023-07-27T14:35:01.386068+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369552+0000","last_change":"2023-07-27T14:35:00.924715+0000","last_active":"2023-07-27T14:35:01.369552+0000","last_peered":"2023-07-27T14:35:01.369552+0000","last_clean":"2023-07-27T14:35:01.369552+0000","last_became_active":"2023-07-27T14:35:00.924438+0000","last_became_peered":"2023-07-27T14:35:00.924438+0000","last_unstale":"2023-07-27T14:35:01.369552+0000","last_undegraded":"2023-07-27T14:35:01.369552+0000","last_fullsized":"2023-07-27T14:35:01.369552+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392540+0000","last_change":"2023-07-27T14:35:01.384473+0000","last_active":"2023-07-27T14:35:01.392540+0000","last_peered":"2023-07-27T14:35:01.392540+0000","last_clean":"2023-07-27T14:35:01.392540+0000","last_became_active":"2023-07-27T14:35:01.384127+0000","last_became_peered":"2023-07-27T14:35:01.384127+0000","last_unstale":"2023-07-27T14:35:01.392540+0000","last_undegraded":"2023-07-27T14:35:01.392540+0000","last_fullsized":"2023-07-27T14:35:01.392540+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368370+0000","last_change":"2023-07-27T14:35:00.925169+0000","last_active":"2023-07-27T14:35:01.368370+0000","last_peered":"2023-07-27T14:35:01.368370+0000","last_clean":"2023-07-27T14:35:01.368370+0000","last_became_active":"2023-07-27T14:35:00.924823+0000","last_became_peered":"2023-07-27T14:35:00.924823+0000","last_unstale":"2023-07-27T14:35:01.368370+0000","last_undegraded":"2023-07-27T14:35:01.368370+0000","last_fullsized":"2023-07-27T14:35:01.368370+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393240+0000","last_change":"2023-07-27T14:35:01.386808+0000","last_active":"2023-07-27T14:35:01.393240+0000","last_peered":"2023-07-27T14:35:01.393240+0000","last_clean":"2023-07-27T14:35:01.393240+0000","last_became_active":"2023-07-27T14:35:01.386483+0000","last_became_peered":"2023-07-27T14:35:01.386483+0000","last_unstale":"2023-07-27T14:35:01.393240+0000","last_undegraded":"2023-07-27T14:35:01.393240+0000","last_fullsized":"2023-07-27T14:35:01.393240+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.370659+0000","last_change":"2023-07-27T14:35:00.914466+0000","last_active":"2023-07-27T14:35:01.370659+0000","last_peered":"2023-07-27T14:35:01.370659+0000","last_clean":"2023-07-27T14:35:01.370659+0000","last_became_active":"2023-07-27T14:35:00.914160+0000","last_became_peered":"2023-07-27T14:35:00.914160+0000","last_unstale":"2023-07-27T14:35:01.370659+0000","last_undegraded":"2023-07-27T14:35:01.370659+0000","last_fullsized":"2023-07-27T14:35:01.370659+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393355+0000","last_change":"2023-07-27T14:35:01.388182+0000","last_active":"2023-07-27T14:35:01.393355+0000","last_peered":"2023-07-27T14:35:01.393355+0000","last_clean":"2023-07-27T14:35:01.393355+0000","last_became_active":"2023-07-27T14:35:01.387908+0000","last_became_peered":"2023-07-27T14:35:01.387908+0000","last_unstale":"2023-07-27T14:35:01.393355+0000","last_undegraded":"2023-07-27T14:35:01.393355+0000","last_fullsized":"2023-07-27T14:35:01.393355+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396542+0000","last_change":"2023-07-27T14:35:00.929577+0000","last_active":"2023-07-27T14:35:01.396542+0000","last_peered":"2023-07-27T14:35:01.396542+0000","last_clean":"2023-07-27T14:35:01.396542+0000","last_became_active":"2023-07-27T14:35:00.929215+0000","last_became_peered":"2023-07-27T14:35:00.929215+0000","last_unstale":"2023-07-27T14:35:01.396542+0000","last_undegraded":"2023-07-27T14:35:01.396542+0000","last_fullsized":"2023-07-27T14:35:01.396542+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393200+0000","last_change":"2023-07-27T14:35:01.386993+0000","last_active":"2023-07-27T14:35:01.393200+0000","last_peered":"2023-07-27T14:35:01.393200+0000","last_clean":"2023-07-27T14:35:01.393200+0000","last_became_active":"2023-07-27T14:35:01.386711+0000","last_became_peered":"2023-07-27T14:35:01.386711+0000","last_unstale":"2023-07-27T14:35:01.393200+0000","last_undegraded":"2023-07-27T14:35:01.393200+0000","last_fullsized":"2023-07-27T14:35:01.393200+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.390066+0000","last_change":"2023-07-27T14:35:00.914069+0000","last_active":"2023-07-27T14:35:01.390066+0000","last_peered":"2023-07-27T14:35:01.390066+0000","last_clean":"2023-07-27T14:35:01.390066+0000","last_became_active":"2023-07-27T14:35:00.913703+0000","last_became_peered":"2023-07-27T14:35:00.913703+0000","last_unstale":"2023-07-27T14:35:01.390066+0000","last_undegraded":"2023-07-27T14:35:01.390066+0000","last_fullsized":"2023-07-27T14:35:01.390066+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.379087+0000","last_change":"2023-07-27T14:35:01.376009+0000","last_active":"2023-07-27T14:35:01.379087+0000","last_peered":"2023-07-27T14:35:01.379087+0000","last_clean":"2023-07-27T14:35:01.379087+0000","last_became_active":"2023-07-27T14:35:01.375097+0000","last_became_peered":"2023-07-27T14:35:01.375097+0000","last_unstale":"2023-07-27T14:35:01.379087+0000","last_undegraded":"2023-07-27T14:35:01.379087+0000","last_fullsized":"2023-07-27T14:35:01.379087+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385054+0000","last_change":"2023-07-27T14:35:00.920449+0000","last_active":"2023-07-27T14:35:01.385054+0000","last_peered":"2023-07-27T14:35:01.385054+0000","last_clean":"2023-07-27T14:35:01.385054+0000","last_became_active":"2023-07-27T14:35:00.920183+0000","last_became_peered":"2023-07-27T14:35:00.920183+0000","last_unstale":"2023-07-27T14:35:01.385054+0000","last_undegraded":"2023-07-27T14:35:01.385054+0000","last_fullsized":"2023-07-27T14:35:01.385054+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396765+0000","last_change":"2023-07-27T14:35:01.393738+0000","last_active":"2023-07-27T14:35:01.396765+0000","last_peered":"2023-07-27T14:35:01.396765+0000","last_clean":"2023-07-27T14:35:01.396765+0000","last_became_active":"2023-07-27T14:35:01.393489+0000","last_became_peered":"2023-07-27T14:35:01.393489+0000","last_unstale":"2023-07-27T14:35:01.396765+0000","last_undegraded":"2023-07-27T14:35:01.396765+0000","last_fullsized":"2023-07-27T14:35:01.396765+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.366833+0000","last_change":"2023-07-27T14:35:00.907880+0000","last_active":"2023-07-27T14:35:01.366833+0000","last_peered":"2023-07-27T14:35:01.366833+0000","last_clean":"2023-07-27T14:35:01.366833+0000","last_became_active":"2023-07-27T14:35:00.907585+0000","last_became_peered":"2023-07-27T14:35:00.907585+0000","last_unstale":"2023-07-27T14:35:01.366833+0000","last_undegraded":"2023-07-27T14:35:01.366833+0000","last_fullsized":"2023-07-27T14:35:01.366833+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.389903+0000","last_change":"2023-07-27T14:35:01.383594+0000","last_active":"2023-07-27T14:35:01.389903+0000","last_peered":"2023-07-27T14:35:01.389903+0000","last_clean":"2023-07-27T14:35:01.389903+0000","last_became_active":"2023-07-27T14:35:01.383293+0000","last_became_peered":"2023-07-27T14:35:01.383293+0000","last_unstale":"2023-07-27T14:35:01.389903+0000","last_undegraded":"2023-07-27T14:35:01.389903+0000","last_fullsized":"2023-07-27T14:35:01.389903+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.372349+0000","last_change":"2023-07-27T14:35:00.919117+0000","last_active":"2023-07-27T14:35:01.372349+0000","last_peered":"2023-07-27T14:35:01.372349+0000","last_clean":"2023-07-27T14:35:01.372349+0000","last_became_active":"2023-07-27T14:35:00.918842+0000","last_became_peered":"2023-07-27T14:35:00.918842+0000","last_unstale":"2023-07-27T14:35:01.372349+0000","last_undegraded":"2023-07-27T14:35:01.372349+0000","last_fullsized":"2023-07-27T14:35:01.372349+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393369+0000","last_change":"2023-07-27T14:35:01.386906+0000","last_active":"2023-07-27T14:35:01.393369+0000","last_peered":"2023-07-27T14:35:01.393369+0000","last_clean":"2023-07-27T14:35:01.393369+0000","last_became_active":"2023-07-27T14:35:01.386535+0000","last_became_peered":"2023-07-27T14:35:01.386535+0000","last_unstale":"2023-07-27T14:35:01.393369+0000","last_undegraded":"2023-07-27T14:35:01.393369+0000","last_fullsized":"2023-07-27T14:35:01.393369+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.367932+0000","last_change":"2023-07-27T14:35:00.914565+0000","last_active":"2023-07-27T14:35:01.367932+0000","last_peered":"2023-07-27T14:35:01.367932+0000","last_clean":"2023-07-27T14:35:01.367932+0000","last_became_active":"2023-07-27T14:35:00.914304+0000","last_became_peered":"2023-07-27T14:35:00.914304+0000","last_unstale":"2023-07-27T14:35:01.367932+0000","last_undegraded":"2023-07-27T14:35:01.367932+0000","last_fullsized":"2023-07-27T14:35:01.367932+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.379706+0000","last_change":"2023-07-27T14:35:01.374387+0000","last_active":"2023-07-27T14:35:01.379706+0000","last_peered":"2023-07-27T14:35:01.379706+0000","last_clean":"2023-07-27T14:35:01.379706+0000","last_became_active":"2023-07-27T14:35:01.374103+0000","last_became_peered":"2023-07-27T14:35:01.374103+0000","last_unstale":"2023-07-27T14:35:01.379706+0000","last_undegraded":"2023-07-27T14:35:01.379706+0000","last_fullsized":"2023-07-27T14:35:01.379706+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.924236+0000","last_change":"2023-07-27T14:35:00.915385+0000","last_active":"2023-07-27T14:35:00.924236+0000","last_peered":"2023-07-27T14:35:00.924236+0000","last_clean":"2023-07-27T14:35:00.924236+0000","last_became_active":"2023-07-27T14:35:00.915121+0000","last_became_peered":"2023-07-27T14:35:00.915121+0000","last_unstale":"2023-07-27T14:35:00.924236+0000","last_undegraded":"2023-07-27T14:35:00.924236+0000","last_fullsized":"2023-07-27T14:35:00.924236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.390284+0000","last_change":"2023-07-27T14:35:01.385698+0000","last_active":"2023-07-27T14:35:01.390284+0000","last_peered":"2023-07-27T14:35:01.390284+0000","last_clean":"2023-07-27T14:35:01.390284+0000","last_became_active":"2023-07-27T14:35:01.385317+0000","last_became_peered":"2023-07-27T14:35:01.385317+0000","last_unstale":"2023-07-27T14:35:01.390284+0000","last_undegraded":"2023-07-27T14:35:01.390284+0000","last_fullsized":"2023-07-27T14:35:01.390284+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.373587+0000","last_change":"2023-07-27T14:35:00.922418+0000","last_active":"2023-07-27T14:35:01.373587+0000","last_peered":"2023-07-27T14:35:01.373587+0000","last_clean":"2023-07-27T14:35:01.373587+0000","last_became_active":"2023-07-27T14:35:00.922112+0000","last_became_peered":"2023-07-27T14:35:00.922112+0000","last_unstale":"2023-07-27T14:35:01.373587+0000","last_undegraded":"2023-07-27T14:35:01.373587+0000","last_fullsized":"2023-07-27T14:35:01.373587+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393542+0000","last_change":"2023-07-27T14:35:01.390101+0000","last_active":"2023-07-27T14:35:01.393542+0000","last_peered":"2023-07-27T14:35:01.393542+0000","last_clean":"2023-07-27T14:35:01.393542+0000","last_became_active":"2023-07-27T14:35:01.389765+0000","last_became_peered":"2023-07-27T14:35:01.389765+0000","last_unstale":"2023-07-27T14:35:01.393542+0000","last_undegraded":"2023-07-27T14:35:01.393542+0000","last_fullsized":"2023-07-27T14:35:01.393542+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.389110+0000","last_change":"2023-07-27T14:35:00.917249+0000","last_active":"2023-07-27T14:35:01.389110+0000","last_peered":"2023-07-27T14:35:01.389110+0000","last_clean":"2023-07-27T14:35:01.389110+0000","last_became_active":"2023-07-27T14:35:00.916377+0000","last_became_peered":"2023-07-27T14:35:00.916377+0000","last_unstale":"2023-07-27T14:35:01.389110+0000","last_undegraded":"2023-07-27T14:35:01.389110+0000","last_fullsized":"2023-07-27T14:35:01.389110+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386437+0000","last_change":"2023-07-27T14:35:01.380445+0000","last_active":"2023-07-27T14:35:01.386437+0000","last_peered":"2023-07-27T14:35:01.386437+0000","last_clean":"2023-07-27T14:35:01.386437+0000","last_became_active":"2023-07-27T14:35:01.378873+0000","last_became_peered":"2023-07-27T14:35:01.378873+0000","last_unstale":"2023-07-27T14:35:01.386437+0000","last_undegraded":"2023-07-27T14:35:01.386437+0000","last_fullsized":"2023-07-27T14:35:01.386437+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396993+0000","last_change":"2023-07-27T14:35:00.929473+0000","last_active":"2023-07-27T14:35:01.396993+0000","last_peered":"2023-07-27T14:35:01.396993+0000","last_clean":"2023-07-27T14:35:01.396993+0000","last_became_active":"2023-07-27T14:35:00.929185+0000","last_became_peered":"2023-07-27T14:35:00.929185+0000","last_unstale":"2023-07-27T14:35:01.396993+0000","last_undegraded":"2023-07-27T14:35:01.396993+0000","last_fullsized":"2023-07-27T14:35:01.396993+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386857+0000","last_change":"2023-07-27T14:35:01.380773+0000","last_active":"2023-07-27T14:35:01.386857+0000","last_peered":"2023-07-27T14:35:01.386857+0000","last_clean":"2023-07-27T14:35:01.386857+0000","last_became_active":"2023-07-27T14:35:01.380486+0000","last_became_peered":"2023-07-27T14:35:01.380486+0000","last_unstale":"2023-07-27T14:35:01.386857+0000","last_undegraded":"2023-07-27T14:35:01.386857+0000","last_fullsized":"2023-07-27T14:35:01.386857+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.919414+0000","last_change":"2023-07-27T14:35:00.910175+0000","last_active":"2023-07-27T14:35:00.919414+0000","last_peered":"2023-07-27T14:35:00.919414+0000","last_clean":"2023-07-27T14:35:00.919414+0000","last_became_active":"2023-07-27T14:35:00.909877+0000","last_became_peered":"2023-07-27T14:35:00.909877+0000","last_unstale":"2023-07-27T14:35:00.919414+0000","last_undegraded":"2023-07-27T14:35:00.919414+0000","last_fullsized":"2023-07-27T14:35:00.919414+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.395471+0000","last_change":"2023-07-27T14:35:01.390402+0000","last_active":"2023-07-27T14:35:01.395471+0000","last_peered":"2023-07-27T14:35:01.395471+0000","last_clean":"2023-07-27T14:35:01.395471+0000","last_became_active":"2023-07-27T14:35:01.390096+0000","last_became_peered":"2023-07-27T14:35:01.390096+0000","last_unstale":"2023-07-27T14:35:01.395471+0000","last_undegraded":"2023-07-27T14:35:01.395471+0000","last_fullsized":"2023-07-27T14:35:01.395471+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369546+0000","last_change":"2023-07-27T14:35:00.923150+0000","last_active":"2023-07-27T14:35:01.369546+0000","last_peered":"2023-07-27T14:35:01.369546+0000","last_clean":"2023-07-27T14:35:01.369546+0000","last_became_active":"2023-07-27T14:35:00.922880+0000","last_became_peered":"2023-07-27T14:35:00.922880+0000","last_unstale":"2023-07-27T14:35:01.369546+0000","last_undegraded":"2023-07-27T14:35:01.369546+0000","last_fullsized":"2023-07-27T14:35:01.369546+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392586+0000","last_change":"2023-07-27T14:35:01.389601+0000","last_active":"2023-07-27T14:35:01.392586+0000","last_peered":"2023-07-27T14:35:01.392586+0000","last_clean":"2023-07-27T14:35:01.392586+0000","last_became_active":"2023-07-27T14:35:01.389322+0000","last_became_peered":"2023-07-27T14:35:01.389322+0000","last_unstale":"2023-07-27T14:35:01.392586+0000","last_undegraded":"2023-07-27T14:35:01.392586+0000","last_fullsized":"2023-07-27T14:35:01.392586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.391704+0000","last_change":"2023-07-27T14:35:00.923250+0000","last_active":"2023-07-27T14:35:01.391704+0000","last_peered":"2023-07-27T14:35:01.391704+0000","last_clean":"2023-07-27T14:35:01.391704+0000","last_became_active":"2023-07-27T14:35:00.922965+0000","last_became_peered":"2023-07-27T14:35:00.922965+0000","last_unstale":"2023-07-27T14:35:01.391704+0000","last_undegraded":"2023-07-27T14:35:01.391704+0000","last_fullsized":"2023-07-27T14:35:01.391704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393166+0000","last_change":"2023-07-27T14:35:01.385698+0000","last_active":"2023-07-27T14:35:01.393166+0000","last_peered":"2023-07-27T14:35:01.393166+0000","last_clean":"2023-07-27T14:35:01.393166+0000","last_became_active":"2023-07-27T14:35:01.385153+0000","last_became_peered":"2023-07-27T14:35:01.385153+0000","last_unstale":"2023-07-27T14:35:01.393166+0000","last_undegraded":"2023-07-27T14:35:01.393166+0000","last_fullsized":"2023-07-27T14:35:01.393166+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369645+0000","last_change":"2023-07-27T14:35:00.922676+0000","last_active":"2023-07-27T14:35:01.369645+0000","last_peered":"2023-07-27T14:35:01.369645+0000","last_clean":"2023-07-27T14:35:01.369645+0000","last_became_active":"2023-07-27T14:35:00.922428+0000","last_became_peered":"2023-07-27T14:35:00.922428+0000","last_unstale":"2023-07-27T14:35:01.369645+0000","last_undegraded":"2023-07-27T14:35:01.369645+0000","last_fullsized":"2023-07-27T14:35:01.369645+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392624+0000","last_change":"2023-07-27T14:35:01.389077+0000","last_active":"2023-07-27T14:35:01.392624+0000","last_peered":"2023-07-27T14:35:01.392624+0000","last_clean":"2023-07-27T14:35:01.392624+0000","last_became_active":"2023-07-27T14:35:01.388800+0000","last_became_peered":"2023-07-27T14:35:01.388800+0000","last_unstale":"2023-07-27T14:35:01.392624+0000","last_undegraded":"2023-07-27T14:35:01.392624+0000","last_fullsized":"2023-07-27T14:35:01.392624+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368494+0000","last_change":"2023-07-27T14:35:00.924978+0000","last_active":"2023-07-27T14:35:01.368494+0000","last_peered":"2023-07-27T14:35:01.368494+0000","last_clean":"2023-07-27T14:35:01.368494+0000","last_became_active":"2023-07-27T14:35:00.924697+0000","last_became_peered":"2023-07-27T14:35:00.924697+0000","last_unstale":"2023-07-27T14:35:01.368494+0000","last_undegraded":"2023-07-27T14:35:01.368494+0000","last_fullsized":"2023-07-27T14:35:01.368494+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393447+0000","last_change":"2023-07-27T14:35:01.389711+0000","last_active":"2023-07-27T14:35:01.393447+0000","last_peered":"2023-07-27T14:35:01.393447+0000","last_clean":"2023-07-27T14:35:01.393447+0000","last_became_active":"2023-07-27T14:35:01.389441+0000","last_became_peered":"2023-07-27T14:35:01.389441+0000","last_unstale":"2023-07-27T14:35:01.393447+0000","last_undegraded":"2023-07-27T14:35:01.393447+0000","last_fullsized":"2023-07-27T14:35:01.393447+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.923286+0000","last_change":"2023-07-27T14:35:00.918169+0000","last_active":"2023-07-27T14:35:00.923286+0000","last_peered":"2023-07-27T14:35:00.923286+0000","last_clean":"2023-07-27T14:35:00.923286+0000","last_became_active":"2023-07-27T14:35:00.917597+0000","last_became_peered":"2023-07-27T14:35:00.917597+0000","last_unstale":"2023-07-27T14:35:00.923286+0000","last_undegraded":"2023-07-27T14:35:00.923286+0000","last_fullsized":"2023-07-27T14:35:00.923286+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.386485+0000","last_change":"2023-07-27T14:35:01.381146+0000","last_active":"2023-07-27T14:35:01.386485+0000","last_peered":"2023-07-27T14:35:01.386485+0000","last_clean":"2023-07-27T14:35:01.386485+0000","last_became_active":"2023-07-27T14:35:01.380870+0000","last_became_peered":"2023-07-27T14:35:01.380870+0000","last_unstale":"2023-07-27T14:35:01.386485+0000","last_undegraded":"2023-07-27T14:35:01.386485+0000","last_fullsized":"2023-07-27T14:35:01.386485+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.394438+0000","last_change":"2023-07-27T14:35:00.925366+0000","last_active":"2023-07-27T14:35:01.394438+0000","last_peered":"2023-07-27T14:35:01.394438+0000","last_clean":"2023-07-27T14:35:01.394438+0000","last_became_active":"2023-07-27T14:35:00.925066+0000","last_became_peered":"2023-07-27T14:35:00.925066+0000","last_unstale":"2023-07-27T14:35:01.394438+0000","last_undegraded":"2023-07-27T14:35:01.394438+0000","last_fullsized":"2023-07-27T14:35:01.394438+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393373+0000","last_change":"2023-07-27T14:35:01.387371+0000","last_active":"2023-07-27T14:35:01.393373+0000","last_peered":"2023-07-27T14:35:01.393373+0000","last_clean":"2023-07-27T14:35:01.393373+0000","last_became_active":"2023-07-27T14:35:01.387082+0000","last_became_peered":"2023-07-27T14:35:01.387082+0000","last_unstale":"2023-07-27T14:35:01.393373+0000","last_undegraded":"2023-07-27T14:35:01.393373+0000","last_fullsized":"2023-07-27T14:35:01.393373+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.371659+0000","last_change":"2023-07-27T14:35:00.911707+0000","last_active":"2023-07-27T14:35:01.371659+0000","last_peered":"2023-07-27T14:35:01.371659+0000","last_clean":"2023-07-27T14:35:01.371659+0000","last_became_active":"2023-07-27T14:35:00.910806+0000","last_became_peered":"2023-07-27T14:35:00.910806+0000","last_unstale":"2023-07-27T14:35:01.371659+0000","last_undegraded":"2023-07-27T14:35:01.371659+0000","last_fullsized":"2023-07-27T14:35:01.371659+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.391907+0000","last_change":"2023-07-27T14:35:01.386756+0000","last_active":"2023-07-27T14:35:01.391907+0000","last_peered":"2023-07-27T14:35:01.391907+0000","last_clean":"2023-07-27T14:35:01.391907+0000","last_became_active":"2023-07-27T14:35:01.386299+0000","last_became_peered":"2023-07-27T14:35:01.386299+0000","last_unstale":"2023-07-27T14:35:01.391907+0000","last_undegraded":"2023-07-27T14:35:01.391907+0000","last_fullsized":"2023-07-27T14:35:01.391907+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.373603+0000","last_change":"2023-07-27T14:35:00.922418+0000","last_active":"2023-07-27T14:35:01.373603+0000","last_peered":"2023-07-27T14:35:01.373603+0000","last_clean":"2023-07-27T14:35:01.373603+0000","last_became_active":"2023-07-27T14:35:00.922153+0000","last_became_peered":"2023-07-27T14:35:00.922153+0000","last_unstale":"2023-07-27T14:35:01.373603+0000","last_undegraded":"2023-07-27T14:35:01.373603+0000","last_fullsized":"2023-07-27T14:35:01.373603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.385329+0000","last_change":"2023-07-27T14:35:01.380431+0000","last_active":"2023-07-27T14:35:01.385329+0000","last_peered":"2023-07-27T14:35:01.385329+0000","last_clean":"2023-07-27T14:35:01.385329+0000","last_became_active":"2023-07-27T14:35:01.380143+0000","last_became_peered":"2023-07-27T14:35:01.380143+0000","last_unstale":"2023-07-27T14:35:01.385329+0000","last_undegraded":"2023-07-27T14:35:01.385329+0000","last_fullsized":"2023-07-27T14:35:01.385329+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.919851+0000","last_change":"2023-07-27T14:35:00.910756+0000","last_active":"2023-07-27T14:35:00.919851+0000","last_peered":"2023-07-27T14:35:00.919851+0000","last_clean":"2023-07-27T14:35:00.919851+0000","last_became_active":"2023-07-27T14:35:00.910496+0000","last_became_peered":"2023-07-27T14:35:00.910496+0000","last_unstale":"2023-07-27T14:35:00.919851+0000","last_undegraded":"2023-07-27T14:35:00.919851+0000","last_fullsized":"2023-07-27T14:35:00.919851+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.388173+0000","last_change":"2023-07-27T14:35:01.388173+0000","last_active":"2023-07-27T14:35:01.388173+0000","last_peered":"2023-07-27T14:35:01.388173+0000","last_clean":"2023-07-27T14:35:01.388173+0000","last_became_active":"2023-07-27T14:35:01.387864+0000","last_became_peered":"2023-07-27T14:35:01.387864+0000","last_unstale":"2023-07-27T14:35:01.388173+0000","last_undegraded":"2023-07-27T14:35:01.388173+0000","last_fullsized":"2023-07-27T14:35:01.388173+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365775+0000","last_change":"2023-07-27T14:35:00.921168+0000","last_active":"2023-07-27T14:35:01.365775+0000","last_peered":"2023-07-27T14:35:01.365775+0000","last_clean":"2023-07-27T14:35:01.365775+0000","last_became_active":"2023-07-27T14:35:00.920852+0000","last_became_peered":"2023-07-27T14:35:00.920852+0000","last_unstale":"2023-07-27T14:35:01.365775+0000","last_undegraded":"2023-07-27T14:35:01.365775+0000","last_fullsized":"2023-07-27T14:35:01.365775+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.380266+0000","last_change":"2023-07-27T14:35:01.380266+0000","last_active":"2023-07-27T14:35:01.380266+0000","last_peered":"2023-07-27T14:35:01.380266+0000","last_clean":"2023-07-27T14:35:01.380266+0000","last_became_active":"2023-07-27T14:35:01.379948+0000","last_became_peered":"2023-07-27T14:35:01.379948+0000","last_unstale":"2023-07-27T14:35:01.380266+0000","last_undegraded":"2023-07-27T14:35:01.380266+0000","last_fullsized":"2023-07-27T14:35:01.380266+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369071+0000","last_change":"2023-07-27T14:35:00.914925+0000","last_active":"2023-07-27T14:35:01.369071+0000","last_peered":"2023-07-27T14:35:01.369071+0000","last_clean":"2023-07-27T14:35:01.369071+0000","last_became_active":"2023-07-27T14:35:00.914651+0000","last_became_peered":"2023-07-27T14:35:00.914651+0000","last_unstale":"2023-07-27T14:35:01.369071+0000","last_undegraded":"2023-07-27T14:35:01.369071+0000","last_fullsized":"2023-07-27T14:35:01.369071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.394519+0000","last_change":"2023-07-27T14:35:01.394519+0000","last_active":"2023-07-27T14:35:01.394519+0000","last_peered":"2023-07-27T14:35:01.394519+0000","last_clean":"2023-07-27T14:35:01.394519+0000","last_became_active":"2023-07-27T14:35:01.394224+0000","last_became_peered":"2023-07-27T14:35:01.394224+0000","last_unstale":"2023-07-27T14:35:01.394519+0000","last_undegraded":"2023-07-27T14:35:01.394519+0000","last_fullsized":"2023-07-27T14:35:01.394519+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.920801+0000","last_change":"2023-07-27T14:35:00.911669+0000","last_active":"2023-07-27T14:35:00.920801+0000","last_peered":"2023-07-27T14:35:00.920801+0000","last_clean":"2023-07-27T14:35:00.920801+0000","last_became_active":"2023-07-27T14:35:00.910715+0000","last_became_peered":"2023-07-27T14:35:00.910715+0000","last_unstale":"2023-07-27T14:35:00.920801+0000","last_undegraded":"2023-07-27T14:35:00.920801+0000","last_fullsized":"2023-07-27T14:35:00.920801+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392280+0000","last_change":"2023-07-27T14:35:01.391034+0000","last_active":"2023-07-27T14:35:01.392280+0000","last_peered":"2023-07-27T14:35:01.392280+0000","last_clean":"2023-07-27T14:35:01.392280+0000","last_became_active":"2023-07-27T14:35:01.390339+0000","last_became_peered":"2023-07-27T14:35:01.390339+0000","last_unstale":"2023-07-27T14:35:01.392280+0000","last_undegraded":"2023-07-27T14:35:01.392280+0000","last_fullsized":"2023-07-27T14:35:01.392280+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369289+0000","last_change":"2023-07-27T14:35:00.917273+0000","last_active":"2023-07-27T14:35:01.369289+0000","last_peered":"2023-07-27T14:35:01.369289+0000","last_clean":"2023-07-27T14:35:01.369289+0000","last_became_active":"2023-07-27T14:35:00.916842+0000","last_became_peered":"2023-07-27T14:35:00.916842+0000","last_unstale":"2023-07-27T14:35:01.369289+0000","last_undegraded":"2023-07-27T14:35:01.369289+0000","last_fullsized":"2023-07-27T14:35:01.369289+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392703+0000","last_change":"2023-07-27T14:35:01.384902+0000","last_active":"2023-07-27T14:35:01.392703+0000","last_peered":"2023-07-27T14:35:01.392703+0000","last_clean":"2023-07-27T14:35:01.392703+0000","last_became_active":"2023-07-27T14:35:01.384101+0000","last_became_peered":"2023-07-27T14:35:01.384101+0000","last_unstale":"2023-07-27T14:35:01.392703+0000","last_undegraded":"2023-07-27T14:35:01.392703+0000","last_fullsized":"2023-07-27T14:35:01.392703+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392583+0000","last_change":"2023-07-27T14:35:00.920472+0000","last_active":"2023-07-27T14:35:01.392583+0000","last_peered":"2023-07-27T14:35:01.392583+0000","last_clean":"2023-07-27T14:35:01.392583+0000","last_became_active":"2023-07-27T14:35:00.920112+0000","last_became_peered":"2023-07-27T14:35:00.920112+0000","last_unstale":"2023-07-27T14:35:01.392583+0000","last_undegraded":"2023-07-27T14:35:01.392583+0000","last_fullsized":"2023-07-27T14:35:01.392583+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":113,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.899800+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:35:00.899800+0000","last_peered":"2023-07-27T14:35:00.899800+0000","last_clean":"2023-07-27T14:35:00.899800+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:35:00.899800+0000","last_undegraded":"2023-07-27T14:35:00.899800+0000","last_fullsized":"2023-07-27T14:35:00.899800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.394473+0000","last_change":"2023-07-27T14:35:01.388696+0000","last_active":"2023-07-27T14:35:01.394473+0000","last_peered":"2023-07-27T14:35:01.394473+0000","last_clean":"2023-07-27T14:35:01.394473+0000","last_became_active":"2023-07-27T14:35:01.387517+0000","last_became_peered":"2023-07-27T14:35:01.387517+0000","last_unstale":"2023-07-27T14:35:01.394473+0000","last_undegraded":"2023-07-27T14:35:01.394473+0000","last_fullsized":"2023-07-27T14:35:01.394473+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.395358+0000","last_change":"2023-07-27T14:35:00.918149+0000","last_active":"2023-07-27T14:35:01.395358+0000","last_peered":"2023-07-27T14:35:01.395358+0000","last_clean":"2023-07-27T14:35:01.395358+0000","last_became_active":"2023-07-27T14:35:00.917905+0000","last_became_peered":"2023-07-27T14:35:00.917905+0000","last_unstale":"2023-07-27T14:35:01.395358+0000","last_undegraded":"2023-07-27T14:35:01.395358+0000","last_fullsized":"2023-07-27T14:35:01.395358+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":116,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365535+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:35:01.365535+0000","last_peered":"2023-07-27T14:35:01.365535+0000","last_clean":"2023-07-27T14:35:01.365535+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:35:01.365535+0000","last_undegraded":"2023-07-27T14:35:01.365535+0000","last_fullsized":"2023-07-27T14:35:01.365535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393967+0000","last_change":"2023-07-27T14:35:01.388677+0000","last_active":"2023-07-27T14:35:01.393967+0000","last_peered":"2023-07-27T14:35:01.393967+0000","last_clean":"2023-07-27T14:35:01.393967+0000","last_became_active":"2023-07-27T14:35:01.388398+0000","last_became_peered":"2023-07-27T14:35:01.388398+0000","last_unstale":"2023-07-27T14:35:01.393967+0000","last_undegraded":"2023-07-27T14:35:01.393967+0000","last_fullsized":"2023-07-27T14:35:01.393967+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"141'4","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.392928+0000","last_change":"2023-07-27T14:35:00.918341+0000","last_active":"2023-07-27T14:35:01.392928+0000","last_peered":"2023-07-27T14:35:01.392928+0000","last_clean":"2023-07-27T14:35:01.392928+0000","last_became_active":"2023-07-27T14:35:00.917925+0000","last_became_peered":"2023-07-27T14:35:00.917925+0000","last_unstale":"2023-07-27T14:35:01.392928+0000","last_undegraded":"2023-07-27T14:35:01.392928+0000","last_fullsized":"2023-07-27T14:35:01.392928+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369768+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:35:01.369768+0000","last_peered":"2023-07-27T14:35:01.369768+0000","last_clean":"2023-07-27T14:35:01.369768+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:35:01.369768+0000","last_undegraded":"2023-07-27T14:35:01.369768+0000","last_fullsized":"2023-07-27T14:35:01.369768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393513+0000","last_change":"2023-07-27T14:35:01.390183+0000","last_active":"2023-07-27T14:35:01.393513+0000","last_peered":"2023-07-27T14:35:01.393513+0000","last_clean":"2023-07-27T14:35:01.393513+0000","last_became_active":"2023-07-27T14:35:01.389884+0000","last_became_peered":"2023-07-27T14:35:01.389884+0000","last_unstale":"2023-07-27T14:35:01.393513+0000","last_undegraded":"2023-07-27T14:35:01.393513+0000","last_fullsized":"2023-07-27T14:35:01.393513+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.368966+0000","last_change":"2023-07-27T14:35:00.923235+0000","last_active":"2023-07-27T14:35:01.368966+0000","last_peered":"2023-07-27T14:35:01.368966+0000","last_clean":"2023-07-27T14:35:01.368966+0000","last_became_active":"2023-07-27T14:35:00.922650+0000","last_became_peered":"2023-07-27T14:35:00.922650+0000","last_unstale":"2023-07-27T14:35:01.368966+0000","last_undegraded":"2023-07-27T14:35:01.368966+0000","last_fullsized":"2023-07-27T14:35:01.368966+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365862+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:35:01.365862+0000","last_peered":"2023-07-27T14:35:01.365862+0000","last_clean":"2023-07-27T14:35:01.365862+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:35:01.365862+0000","last_undegraded":"2023-07-27T14:35:01.365862+0000","last_fullsized":"2023-07-27T14:35:01.365862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.366991+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:35:01.366991+0000","last_peered":"2023-07-27T14:35:01.366991+0000","last_clean":"2023-07-27T14:35:01.366991+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:35:01.366991+0000","last_undegraded":"2023-07-27T14:35:01.366991+0000","last_fullsized":"2023-07-27T14:35:01.366991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.380217+0000","last_change":"2023-07-27T14:35:01.375815+0000","last_active":"2023-07-27T14:35:01.380217+0000","last_peered":"2023-07-27T14:35:01.380217+0000","last_clean":"2023-07-27T14:35:01.380217+0000","last_became_active":"2023-07-27T14:35:01.375317+0000","last_became_peered":"2023-07-27T14:35:01.375317+0000","last_unstale":"2023-07-27T14:35:01.380217+0000","last_undegraded":"2023-07-27T14:35:01.380217+0000","last_fullsized":"2023-07-27T14:35:01.380217+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.370547+0000","last_change":"2023-07-27T14:35:00.920933+0000","last_active":"2023-07-27T14:35:01.370547+0000","last_peered":"2023-07-27T14:35:01.370547+0000","last_clean":"2023-07-27T14:35:01.370547+0000","last_became_active":"2023-07-27T14:35:00.920621+0000","last_became_peered":"2023-07-27T14:35:00.920621+0000","last_unstale":"2023-07-27T14:35:01.370547+0000","last_undegraded":"2023-07-27T14:35:01.370547+0000","last_fullsized":"2023-07-27T14:35:01.370547+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.367090+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:35:01.367090+0000","last_peered":"2023-07-27T14:35:01.367090+0000","last_clean":"2023-07-27T14:35:01.367090+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:35:01.367090+0000","last_undegraded":"2023-07-27T14:35:01.367090+0000","last_fullsized":"2023-07-27T14:35:01.367090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393394+0000","last_change":"2023-07-27T14:35:01.387660+0000","last_active":"2023-07-27T14:35:01.393394+0000","last_peered":"2023-07-27T14:35:01.393394+0000","last_clean":"2023-07-27T14:35:01.393394+0000","last_became_active":"2023-07-27T14:35:01.387317+0000","last_became_peered":"2023-07-27T14:35:01.387317+0000","last_unstale":"2023-07-27T14:35:01.393394+0000","last_undegraded":"2023-07-27T14:35:01.393394+0000","last_fullsized":"2023-07-27T14:35:01.393394+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.393033+0000","last_change":"2023-07-27T14:35:00.916113+0000","last_active":"2023-07-27T14:35:01.393033+0000","last_peered":"2023-07-27T14:35:01.393033+0000","last_clean":"2023-07-27T14:35:01.393033+0000","last_became_active":"2023-07-27T14:35:00.915823+0000","last_became_peered":"2023-07-27T14:35:00.915823+0000","last_unstale":"2023-07-27T14:35:01.393033+0000","last_undegraded":"2023-07-27T14:35:01.393033+0000","last_fullsized":"2023-07-27T14:35:01.393033+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.369055+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:35:01.369055+0000","last_peered":"2023-07-27T14:35:01.369055+0000","last_clean":"2023-07-27T14:35:01.369055+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:35:01.369055+0000","last_undegraded":"2023-07-27T14:35:01.369055+0000","last_fullsized":"2023-07-27T14:35:01.369055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.396275+0000","last_change":"2023-07-27T14:35:01.392464+0000","last_active":"2023-07-27T14:35:01.396275+0000","last_peered":"2023-07-27T14:35:01.396275+0000","last_clean":"2023-07-27T14:35:01.396275+0000","last_became_active":"2023-07-27T14:35:01.392079+0000","last_became_peered":"2023-07-27T14:35:01.392079+0000","last_unstale":"2023-07-27T14:35:01.396275+0000","last_undegraded":"2023-07-27T14:35:01.396275+0000","last_fullsized":"2023-07-27T14:35:01.396275+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.365536+0000","last_change":"2023-07-27T14:35:00.915291+0000","last_active":"2023-07-27T14:35:01.365536+0000","last_peered":"2023-07-27T14:35:01.365536+0000","last_clean":"2023-07-27T14:35:01.365536+0000","last_became_active":"2023-07-27T14:35:00.915025+0000","last_became_peered":"2023-07-27T14:35:00.915025+0000","last_unstale":"2023-07-27T14:35:01.365536+0000","last_undegraded":"2023-07-27T14:35:01.365536+0000","last_fullsized":"2023-07-27T14:35:01.365536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":113,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-27T14:35:00.900638+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:35:00.900638+0000","last_peered":"2023-07-27T14:35:00.900638+0000","last_clean":"2023-07-27T14:35:00.900638+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:35:00.900638+0000","last_undegraded":"2023-07-27T14:35:00.900638+0000","last_fullsized":"2023-07-27T14:35:00.900638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.388425+0000","last_change":"2023-07-27T14:35:01.388425+0000","last_active":"2023-07-27T14:35:01.388425+0000","last_peered":"2023-07-27T14:35:01.388425+0000","last_clean":"2023-07-27T14:35:01.388425+0000","last_became_active":"2023-07-27T14:35:01.387458+0000","last_became_peered":"2023-07-27T14:35:01.387458+0000","last_unstale":"2023-07-27T14:35:01.388425+0000","last_undegraded":"2023-07-27T14:35:01.388425+0000","last_fullsized":"2023-07-27T14:35:01.388425+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:35:00.887266+0000","last_clean_scrub_stamp":"2023-07-27T14:35:00.887266+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.370506+0000","last_change":"2023-07-27T14:35:00.923963+0000","last_active":"2023-07-27T14:35:01.370506+0000","last_peered":"2023-07-27T14:35:01.370506+0000","last_clean":"2023-07-27T14:35:01.370506+0000","last_became_active":"2023-07-27T14:35:00.921720+0000","last_became_peered":"2023-07-27T14:35:00.921720+0000","last_unstale":"2023-07-27T14:35:01.370506+0000","last_undegraded":"2023-07-27T14:35:01.370506+0000","last_fullsized":"2023-07-27T14:35:01.370506+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:34:59.879925+0000","last_clean_scrub_stamp":"2023-07-27T14:34:59.879925+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-27T14:35:01.377341+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:35:01.377341+0000","last_peered":"2023-07-27T14:35:01.377341+0000","last_clean":"2023-07-27T14:35:01.377341+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:35:01.377341+0000","last_undegraded":"2023-07-27T14:35:01.377341+0000","last_fullsized":"2023-07-27T14:35:01.377341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16148,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":14400,"kb_avail":94355692,"statfs":{"total":96636764160,"available":96620228608,"internally_reserved":0,"allocated":1781760,"data_stored":832465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14745600},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.66100000000000003},"min":{"1min":0.439,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80100000000000005,"5min":0.96599999999999997,"15min":1.133},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.67200000000000004},"min":{"1min":0.498,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89900000000000002,"5min":1.0589999999999999,"15min":1.1180000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.45300000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.72299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88700000000000001,"5min":0.96999999999999997,"15min":1.1459999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.68200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84199999999999997,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":0.96499999999999997,"15min":1.119},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65900000000000003,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99399999999999999,"5min":1.069,"15min":1.069},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84099999999999997,"5min":0.92800000000000005,"15min":1.165},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.88700000000000001,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.754},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.54600000000000004,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88500000000000001,"5min":1.202,"15min":1.202},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.54800000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":1.101,"15min":1.101},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.747,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90800000000000003,"5min":1.056,"15min":1.056},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.52400000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0409999999999999},"last":0.875}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15760,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94356080,"statfs":{"total":96636764160,"available":96620625920,"internally_reserved":0,"allocated":1777664,"data_stored":832713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.45400000000000001,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.996}]},{"osd":1,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86399999999999999,"15min":0.94399999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64400000000000002,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88700000000000001,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.66600000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":0.95199999999999996,"15min":1.2},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.52000000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.97699999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.49399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85599999999999998,"5min":0.86299999999999999,"15min":0.94399999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.98999999999999999,"15min":1.079},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.67400000000000004},"min":{"1min":0.41799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97599999999999998,"5min":0.98899999999999999,"15min":1.198},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67300000000000004,"15min":0.68600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":1.0149999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.54400000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.052,"5min":1.054,"15min":1.1000000000000001},"last":1.052},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0389999999999999,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":1.0389999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18236,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":16512,"kb_avail":94353604,"statfs":{"total":96636764160,"available":96618090496,"internally_reserved":0,"allocated":1757184,"data_stored":825027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16908288},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38900000000000001,"15min":0.501},"min":{"1min":0.27800000000000002,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":0.51500000000000001,"5min":0.65500000000000003,"15min":4.75},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.42499999999999999,"15min":0.64100000000000001},"min":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.70199999999999996,"15min":9.3100000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46300000000000002,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.56200000000000006,"5min":0.67500000000000004,"15min":3.7210000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46800000000000003,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.64300000000000002,"5min":0.79700000000000004,"15min":2.7160000000000002},"last":0.432}]},{"osd":3,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.52000000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.58299999999999996,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.55700000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61299999999999999,"5min":0.747,"15min":3.8580000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":2.181},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67700000000000005,"15min":0.72199999999999998},"min":{"1min":0.53300000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":2.4180000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.76700000000000002},"min":{"1min":0.52300000000000002,"5min":0.47999999999999998,"15min":0.46600000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":3.7440000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70599999999999996,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":1.131,"5min":1.131,"15min":2.149},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69399999999999995,"15min":0.73699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92600000000000005,"5min":0.97699999999999998,"15min":2.052},"last":0.873},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68799999999999994,"15min":0.83399999999999996},"min":{"1min":0.54000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97099999999999997,"5min":0.98499999999999999,"15min":6.1980000000000004},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71899999999999997,"15min":0.748},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.44800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":2.016},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76500000000000001,"15min":0.84299999999999997},"min":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.55700000000000005},"max":{"1min":1.054,"5min":1.054,"15min":3.7799999999999998},"last":0.83699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17032,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":94354808,"statfs":{"total":96636764160,"available":96619323392,"internally_reserved":0,"allocated":1769472,"data_stored":825153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.48899999999999999,"5min":0.58299999999999996,"15min":0.79500000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.24399999999999999},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.42499999999999999},"min":{"1min":0.32500000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51100000000000001,"5min":0.63500000000000001,"15min":0.68200000000000005},"last":0.496},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.52800000000000002,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45700000000000002,"15min":0.46999999999999997},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.624,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.57899999999999996,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.56499999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89200000000000002,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69899999999999995,"15min":0.71899999999999997},"min":{"1min":0.47899999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93100000000000005,"5min":1.28,"15min":1.28},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.45000000000000001},"max":{"1min":0.96999999999999997,"5min":1.25,"15min":1.25},"last":0.871},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70499999999999996,"15min":0.71999999999999997},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82999999999999996,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.89300000000000002,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95099999999999996,"5min":1.22,"15min":1.22},"last":0.753}]},{"osd":7,"last update":"Thu Jul 27 14:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":0.88200000000000001,"5min":1.244,"15min":1.244},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91900000000000004,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24592,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":22848,"kb_avail":94347248,"statfs":{"total":96636764160,"available":96611581952,"internally_reserved":0,"allocated":1777664,"data_stored":832319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23396352},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.41499999999999998},"min":{"1min":0.29399999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57399999999999995,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.45300000000000001,"15min":0.47699999999999998},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58899999999999997,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.48099999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60999999999999999,"5min":0.73999999999999999,"15min":0.96399999999999997},"last":0.377},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53700000000000003,"5min":5.601,"15min":5.601},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.47799999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57199999999999995,"5min":0.81100000000000005,"15min":0.83499999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48999999999999999,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60099999999999998,"5min":1.353,"15min":1.353},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88,"5min":1.849,"15min":1.849},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76000000000000001,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.85899999999999999,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.53700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.96199999999999997,"5min":1.073,"15min":1.073},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89300000000000002,"5min":1.772,"15min":1.772},"last":1.04}]},{"osd":6,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.872,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.77400000000000002},"min":{"1min":0.50700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.998,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":1.048}]},{"osd":7,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94299999999999995,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.85599999999999998,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574948,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16592,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94355248,"statfs":{"total":96636764160,"available":96619773952,"internally_reserved":0,"allocated":1777664,"data_stored":832375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.66800000000000004,"5min":1.202,"15min":1.202},"last":0.438},{"interface":"front","average":{"1min":0.374,"5min":0.41199999999999998,"15min":0.436},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.51100000000000001,"5min":1.302,"15min":1.302},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41199999999999998,"15min":0.441},"min":{"1min":0.28000000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52500000000000002,"5min":0.748,"15min":0.88900000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.46400000000000002,"15min":0.44700000000000001},"min":{"1min":0.33100000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.56499999999999995,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.5}]},{"osd":2,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47999999999999998,"15min":0.49099999999999999},"min":{"1min":0.39100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.53800000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.53900000000000003,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67400000000000004,"15min":0.69599999999999995},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.90700000000000003,"5min":0.96299999999999997,"15min":1.149},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73699999999999999,"15min":0.72599999999999998},"min":{"1min":0.54200000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.92400000000000004,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69599999999999995,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92700000000000005,"5min":1.232,"15min":1.232},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.58399999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98899999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.45200000000000001},"max":{"1min":0.95399999999999996,"5min":1.121,"15min":1.298},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.60699999999999998,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":1.0129999999999999,"5min":1.343,"15min":1.343},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:35:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.64400000000000002,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.96499999999999997,"5min":2.048,"15min":2.048},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.625,"5min":0.505,"15min":0.49299999999999999},"max":{"1min":1.0649999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.0649999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15492,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356348,"statfs":{"total":96636764160,"available":96620900352,"internally_reserved":0,"allocated":1765376,"data_stored":825651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65900000000000003,"15min":0.66800000000000004},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.874,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.52800000000000002,"5min":0.435,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.97199999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86899999999999999,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.752},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65200000000000002,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84299999999999997,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.68000000000000005},"min":{"1min":0.47599999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":4.476,"15min":4.476},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94199999999999995,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.71699999999999997,"15min":0.68500000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81899999999999995,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83399999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.497},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66800000000000004,"15min":0.64100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82899999999999996,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.66200000000000003},"min":{"1min":0.434,"5min":0.377,"15min":0.377},"max":{"1min":0.88700000000000001,"5min":5.194,"15min":5.194},"last":0.443},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0089999999999999,"5min":2.819,"15min":2.819},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96999999999999997,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17168,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94354672,"statfs":{"total":96636764160,"available":96619184128,"internally_reserved":0,"allocated":1777664,"data_stored":832645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.35499999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.371},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.71699999999999997,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":12.127000000000001,"15min":12.127000000000001},"last":0.438}]},{"osd":1,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.71899999999999997,"15min":0.69799999999999995},"min":{"1min":0.45600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":6.7489999999999997,"15min":6.7489999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.71599999999999997,"15min":0.68300000000000005},"min":{"1min":0.52000000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.84999999999999998,"5min":6.7370000000000001,"15min":6.7370000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.88300000000000001,"5min":1.581,"15min":1.581},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86399999999999999,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.505}]},{"osd":3,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72099999999999997,"15min":0.68799999999999994},"min":{"1min":0.51500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.89800000000000002,"5min":9.6920000000000002,"15min":9.6920000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.80600000000000005,"15min":0.78400000000000003},"min":{"1min":0.496,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":9.4299999999999997,"15min":9.4299999999999997},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.41399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88200000000000001,"5min":1.978,"15min":1.978},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.46999999999999997,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.77400000000000002,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.67600000000000005,"15min":0.61599999999999999},"min":{"1min":0.45100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.755,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89800000000000002,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.82799999999999996,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.85699999999999998,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:35:06.112 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:35:06.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:35:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.295+0000 7f66abfff700 1 Processor -- start 2023-07-27T14:35:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.295+0000 7f66abfff700 1 -- start start 2023-07-27T14:35:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.296+0000 7f66abfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66a4063260 0x7f66a4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.296+0000 7f66abfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a414b1e0 0x7f66a40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.296+0000 7f66abfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a41553f0 con 0x7f66a414ae00 2023-07-27T14:35:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.296+0000 7f66abfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a4157a50 con 0x7f66a4063260 2023-07-27T14:35:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.296+0000 7f66abfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4157d10 con 0x7f66a414b1e0 2023-07-27T14:35:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.296+0000 7f66a959a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66a4063260 0x7f66a4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a959a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66a4063260 0x7f66a4154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38148/0 (socket says 172.21.15.115:38148) 2023-07-27T14:35:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a959a700 1 -- 172.21.15.115:0/3940072790 learned_addr learned my addr 172.21.15.115:0/3940072790 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66aa59c700 1 --2- 172.21.15.115:0/3940072790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a414b1e0 0x7f66a40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a959a700 1 -- 172.21.15.115:0/3940072790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a414b1e0 msgr2=0x7f66a40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a959a700 1 --2- 172.21.15.115:0/3940072790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a414b1e0 0x7f66a40a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a959a700 1 -- 172.21.15.115:0/3940072790 >> v1:172.21.15.159:6789/0 conn(0x7f66a414ae00 legacy=0x7f66a4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a959a700 1 -- 172.21.15.115:0/3940072790 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4157ff0 con 0x7f66a4063260 2023-07-27T14:35:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66aa59c700 1 --2- 172.21.15.115:0/3940072790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a414b1e0 0x7f66a40a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a959a700 1 --2- 172.21.15.115:0/3940072790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a4063260 0x7f66a4154f00 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f6694006fd0 tx=0x7f66940090f0).ready entity=mon.0 client_cookie=e4d9774feeee2a01 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a8d99700 1 -- 172.21.15.115:0/3940072790 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400b600 con 0x7f66a4063260 2023-07-27T14:35:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a8d99700 1 -- 172.21.15.115:0/3940072790 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400b760 con 0x7f66a4063260 2023-07-27T14:35:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.297+0000 7f66a8d99700 1 -- 172.21.15.115:0/3940072790 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400bae0 con 0x7f66a4063260 2023-07-27T14:35:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.298+0000 7f66abfff700 1 -- 172.21.15.115:0/3940072790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a4063260 msgr2=0x7f66a4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.298+0000 7f66abfff700 1 --2- 172.21.15.115:0/3940072790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a4063260 0x7f66a4154f00 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f6694006fd0 tx=0x7f66940090f0).stop 2023-07-27T14:35:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.298+0000 7f66abfff700 1 -- 172.21.15.115:0/3940072790 shutdown_connections 2023-07-27T14:35:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.298+0000 7f66abfff700 1 --2- 172.21.15.115:0/3940072790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a414b1e0 0x7f66a40a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.298+0000 7f66abfff700 1 --2- 172.21.15.115:0/3940072790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a4063260 0x7f66a4154f00 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.298+0000 7f66abfff700 1 -- 172.21.15.115:0/3940072790 >> 172.21.15.115:0/3940072790 conn(0x7f66a405e940 msgr2=0x7f66a40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.298+0000 7f66abfff700 1 -- 172.21.15.115:0/3940072790 shutdown_connections 2023-07-27T14:35:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.298+0000 7f66abfff700 1 -- 172.21.15.115:0/3940072790 wait complete. 2023-07-27T14:35:06.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.299+0000 7f66abfff700 1 Processor -- start 2023-07-27T14:35:06.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.300+0000 7f66abfff700 1 -- start start 2023-07-27T14:35:06.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.300+0000 7f66abfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a4063260 0x7f66a40c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66abfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a414ae00 0x7f66a41491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66abfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a414b1e0 0x7f66a4167a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66abfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40c44b0 con 0x7f66a414ae00 2023-07-27T14:35:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66abfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40afbe0 con 0x7f66a414b1e0 2023-07-27T14:35:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66abfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a41496c0 con 0x7f66a4063260 2023-07-27T14:35:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a414ae00 0x7f66a41491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a414ae00 0x7f66a41491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38160/0 (socket says 172.21.15.115:38160) 2023-07-27T14:35:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 -- 172.21.15.115:0/818962181 learned_addr learned my addr 172.21.15.115:0/818962181 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 -- 172.21.15.115:0/818962181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a4063260 msgr2=0x7f66a40c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a4063260 0x7f66a40c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 -- 172.21.15.115:0/818962181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a414b1e0 msgr2=0x7f66a4167a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a414b1e0 0x7f66a4167a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 -- 172.21.15.115:0/818962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009370 con 0x7f66a414ae00 2023-07-27T14:35:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.301+0000 7f66a959a700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a414ae00 0x7f66a41491d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f6694011000 tx=0x7f6694017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.302+0000 7f6699ffb700 1 -- 172.21.15.115:0/818962181 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400bae0 con 0x7f66a414ae00 2023-07-27T14:35:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.302+0000 7f6699ffb700 1 -- 172.21.15.115:0/818962181 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694000c90 con 0x7f66a414ae00 2023-07-27T14:35:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.302+0000 7f6699ffb700 1 -- 172.21.15.115:0/818962181 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669401b660 con 0x7f66a414ae00 2023-07-27T14:35:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.302+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a40c3e90 con 0x7f66a414ae00 2023-07-27T14:35:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.302+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a40c4970 con 0x7f66a414ae00 2023-07-27T14:35:06.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.303+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a406c470 con 0x7f66a414ae00 2023-07-27T14:35:06.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.304+0000 7f6699ffb700 1 -- 172.21.15.115:0/818962181 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f669400f070 con 0x7f66a414ae00 2023-07-27T14:35:06.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.304+0000 7f6699ffb700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f668805f720 0x7f6688061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.304+0000 7f6699ffb700 1 -- 172.21.15.115:0/818962181 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f669407bfe0 con 0x7f66a414ae00 2023-07-27T14:35:06.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.305+0000 7f66a9d9b700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f668805f720 0x7f6688061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.305+0000 7f66a9d9b700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f668805f720 0x7f6688061be0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f66a414a490 tx=0x7f66a00079a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:06.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.308+0000 7f6699ffb700 1 -- 172.21.15.115:0/818962181 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f669404cbc0 con 0x7f66a414ae00 2023-07-27T14:35:06.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.544+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f66a40c8b40 con 0x7f66a414ae00 2023-07-27T14:35:06.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.548+0000 7f6699ffb700 1 -- 172.21.15.115:0/818962181 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f669401f070 con 0x7f66a414ae00 2023-07-27T14:35:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f668805f720 msgr2=0x7f6688061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f668805f720 0x7f6688061be0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f66a414a490 tx=0x7f66a00079a0).stop 2023-07-27T14:35:06.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a414ae00 msgr2=0x7f66a41491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a414ae00 0x7f66a41491d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f6694011000 tx=0x7f6694017000).stop 2023-07-27T14:35:06.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 shutdown_connections 2023-07-27T14:35:06.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f668805f720 0x7f6688061be0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a414b1e0 0x7f66a4167a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:06.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66a4063260 0x7f66a40c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:06.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 --2- 172.21.15.115:0/818962181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a414ae00 0x7f66a41491d0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 >> 172.21.15.115:0/818962181 conn(0x7f66a405e940 msgr2=0x7f66a41544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:06.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 shutdown_connections 2023-07-27T14:35:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.550+0000 7f66abfff700 1 -- 172.21.15.115:0/818962181 wait complete. 2023-07-27T14:35:06.598 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:35:06.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:35:06.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.755+0000 7f893c9ff700 1 Processor -- start 2023-07-27T14:35:06.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.755+0000 7f893c9ff700 1 -- start start 2023-07-27T14:35:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.756+0000 7f893c9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89380aaa40 0x7f89380640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.756+0000 7f893c9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89381542a0 0x7f89380645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.756+0000 7f893c9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89380aa4d0 con 0x7f8938153ec0 2023-07-27T14:35:06.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.756+0000 7f893c9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8938064ad0 con 0x7f89381542a0 2023-07-27T14:35:06.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.756+0000 7f893c9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89380c05c0 con 0x7f89380aaa40 2023-07-27T14:35:06.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8936d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89381542a0 0x7f89380645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8936d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89381542a0 0x7f89380645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38164/0 (socket says 172.21.15.115:38164) 2023-07-27T14:35:06.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8936d9d700 1 -- 172.21.15.115:0/3080194325 learned_addr learned my addr 172.21.15.115:0/3080194325 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:06.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8935d9b700 1 --2- 172.21.15.115:0/3080194325 >> v2:172.21.15.159:3300/0 conn(0x7f89380aaa40 0x7f89380640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8936d9d700 1 -- 172.21.15.115:0/3080194325 >> v2:172.21.15.159:3300/0 conn(0x7f89380aaa40 msgr2=0x7f89380640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:06.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8936d9d700 1 --2- 172.21.15.115:0/3080194325 >> v2:172.21.15.159:3300/0 conn(0x7f89380aaa40 0x7f89380640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8936d9d700 1 -- 172.21.15.115:0/3080194325 >> v1:172.21.15.115:6789/0 conn(0x7f8938153ec0 legacy=0x7f89380a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8936d9d700 1 -- 172.21.15.115:0/3080194325 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380c1a60 con 0x7f89381542a0 2023-07-27T14:35:06.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f8936d9d700 1 --2- 172.21.15.115:0/3080194325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89381542a0 0x7f89380645e0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f893806c0d0 tx=0x7f8930009840).ready entity=mon.0 client_cookie=3cdf938d01228f7f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:06.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.757+0000 7f893559a700 1 -- 172.21.15.115:0/3080194325 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893000e070 con 0x7f89381542a0 2023-07-27T14:35:06.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893559a700 1 -- 172.21.15.115:0/3080194325 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893000ba50 con 0x7f89381542a0 2023-07-27T14:35:06.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893559a700 1 -- 172.21.15.115:0/3080194325 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893000bdd0 con 0x7f89381542a0 2023-07-27T14:35:06.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893c9ff700 1 -- 172.21.15.115:0/3080194325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89381542a0 msgr2=0x7f89380645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893c9ff700 1 --2- 172.21.15.115:0/3080194325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89381542a0 0x7f89380645e0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f893806c0d0 tx=0x7f8930009840).stop 2023-07-27T14:35:06.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893c9ff700 1 -- 172.21.15.115:0/3080194325 shutdown_connections 2023-07-27T14:35:06.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893c9ff700 1 --2- 172.21.15.115:0/3080194325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89381542a0 0x7f89380645e0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893c9ff700 1 --2- 172.21.15.115:0/3080194325 >> v2:172.21.15.159:3300/0 conn(0x7f89380aaa40 0x7f89380640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893c9ff700 1 -- 172.21.15.115:0/3080194325 >> 172.21.15.115:0/3080194325 conn(0x7f89380cb610 msgr2=0x7f89380c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:06.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893c9ff700 1 -- 172.21.15.115:0/3080194325 shutdown_connections 2023-07-27T14:35:06.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.758+0000 7f893c9ff700 1 -- 172.21.15.115:0/3080194325 wait complete. 2023-07-27T14:35:06.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.760+0000 7f893c9ff700 1 Processor -- start 2023-07-27T14:35:06.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.760+0000 7f893c9ff700 1 -- start start 2023-07-27T14:35:06.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f893c9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89380aaa40 0x7f893813e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f893c9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8938153ec0 0x7f8938151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f893c9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89381542a0 0x7f89380c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f893c9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8938150450 con 0x7f8938153ec0 2023-07-27T14:35:06.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f893c9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8938150730 con 0x7f89380aaa40 2023-07-27T14:35:06.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f893c9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8938150a10 con 0x7f89381542a0 2023-07-27T14:35:06.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8938153ec0 0x7f8938151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8938153ec0 0x7f8938151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38180/0 (socket says 172.21.15.115:38180) 2023-07-27T14:35:06.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 -- 172.21.15.115:0/2261900180 learned_addr learned my addr 172.21.15.115:0/2261900180 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:06.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8936d9d700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89381542a0 0x7f89380c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f893659c700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89380aaa40 0x7f893813e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 -- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89381542a0 msgr2=0x7f89380c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89381542a0 0x7f89380c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 -- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89380aaa40 msgr2=0x7f893813e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:06.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89380aaa40 0x7f893813e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:06.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 -- 172.21.15.115:0/2261900180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8930009ae0 con 0x7f8938153ec0 2023-07-27T14:35:06.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8936d9d700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89381542a0 0x7f89380c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:06.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f893659c700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89380aaa40 0x7f893813e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:06.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.761+0000 7f8935d9b700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8938153ec0 0x7f8938151b70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f892c00d860 tx=0x7f892c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:06.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.762+0000 7f89267fc700 1 -- 172.21.15.115:0/2261900180 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0125f0 con 0x7f8938153ec0 2023-07-27T14:35:06.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.762+0000 7f89267fc700 1 -- 172.21.15.115:0/2261900180 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c012750 con 0x7f8938153ec0 2023-07-27T14:35:06.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.762+0000 7f89267fc700 1 -- 172.21.15.115:0/2261900180 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c012ad0 con 0x7f8938153ec0 2023-07-27T14:35:06.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.762+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8938150cf0 con 0x7f8938153ec0 2023-07-27T14:35:06.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.762+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893813eb60 con 0x7f8938153ec0 2023-07-27T14:35:06.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.763+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8938151210 con 0x7f8938153ec0 2023-07-27T14:35:06.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.764+0000 7f89267fc700 1 -- 172.21.15.115:0/2261900180 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f892c013480 con 0x7f8938153ec0 2023-07-27T14:35:06.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.764+0000 7f89267fc700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f891805f720 0x7f8918061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:06.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.764+0000 7f89267fc700 1 -- 172.21.15.115:0/2261900180 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f892c07a590 con 0x7f8938153ec0 2023-07-27T14:35:06.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.765+0000 7f893659c700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f891805f720 0x7f8918061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:06.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.765+0000 7f893659c700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f891805f720 0x7f8918061be0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f8928001710 tx=0x7f8928009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:06.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.768+0000 7f89267fc700 1 -- 172.21.15.115:0/2261900180 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8938151210 con 0x7f8938153ec0 2023-07-27T14:35:07.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.984+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8938151210 con 0x7f8938153ec0 2023-07-27T14:35:07.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.985+0000 7f89267fc700 1 -- 172.21.15.115:0/2261900180 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f8938151210 con 0x7f8938153ec0 2023-07-27T14:35:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:35:07.029 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/231954123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":231954123},{"type":"v1","addr":"172.21.15.159:6834","nonce":231954123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7432,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3337360418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3337360418},{"type":"v1","addr":"172.21.15.159:6835","nonce":3337360418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2630769428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2630769428},{"type":"v1","addr":"172.21.15.115:6836","nonce":2630769428}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:35:01.359343+0000","modified":"2023-07-27T14:35:04.371738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2708675397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2708675397},{"type":"v1","addr":"172.21.15.115:6837","nonce":2708675397}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-07-27T14:35:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f891805f720 msgr2=0x7f8918061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f891805f720 0x7f8918061be0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f8928001710 tx=0x7f8928009040).stop 2023-07-27T14:35:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8938153ec0 msgr2=0x7f8938151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8938153ec0 0x7f8938151b70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f892c00d860 tx=0x7f892c008040).stop 2023-07-27T14:35:07.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 shutdown_connections 2023-07-27T14:35:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f891805f720 0x7f8918061be0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89381542a0 0x7f89380c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89380aaa40 0x7f893813e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 --2- 172.21.15.115:0/2261900180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8938153ec0 0x7f8938151b70 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 >> 172.21.15.115:0/2261900180 conn(0x7f89380cb610 msgr2=0x7f893814fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 shutdown_connections 2023-07-27T14:35:07.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:06.987+0000 7f893c9ff700 1 -- 172.21.15.115:0/2261900180 wait complete. 2023-07-27T14:35:07.033 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 76 2023-07-27T14:35:07.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:35:01.359343+0000', 'modified': '2023-07-27T14:35:04.371738+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8247}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8247': {'gid': 8247, 'name': 'c', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6837/2708675397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 2708675397}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 2708675397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:35:07.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:35:07.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-27T14:35:07.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.596+0000 7f6bbc1ff700 1 Processor -- start 2023-07-27T14:35:07.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.597+0000 7f6bbc1ff700 1 -- start start 2023-07-27T14:35:07.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.598+0000 7f6bbc1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bb4153ec0 0x7f6bb40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.598+0000 7f6bbc1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6bb40aaa40 0x7f6bb40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.598+0000 7f6bbc1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40aa4d0 con 0x7f6bb40aa050 2023-07-27T14:35:07.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.598+0000 7f6bbc1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb40c05c0 con 0x7f6bb4153ec0 2023-07-27T14:35:07.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.598+0000 7f6bbc1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb40bfc90 con 0x7f6bb40aaa40 2023-07-27T14:35:07.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bb9f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bb4153ec0 0x7f6bb40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bb9f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bb4153ec0 0x7f6bb40a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38182/0 (socket says 172.21.15.115:38182) 2023-07-27T14:35:07.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/2354636819 learned_addr learned my addr 172.21.15.115:0/2354636819 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:07.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bba79c700 1 --2- 172.21.15.115:0/2354636819 >> v2:172.21.15.159:3300/0 conn(0x7f6bb40aaa40 0x7f6bb40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/2354636819 >> v2:172.21.15.159:3300/0 conn(0x7f6bb40aaa40 msgr2=0x7f6bb40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/2354636819 >> v2:172.21.15.159:3300/0 conn(0x7f6bb40aaa40 0x7f6bb40c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/2354636819 >> v1:172.21.15.159:6789/0 conn(0x7f6bb40aa050 legacy=0x7f6bb40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/2354636819 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40bff70 con 0x7f6bb4153ec0 2023-07-27T14:35:07.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bba79c700 1 --2- 172.21.15.115:0/2354636819 >> v2:172.21.15.159:3300/0 conn(0x7f6bb40aaa40 0x7f6bb40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:07.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.599+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/2354636819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb40a9b60 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f6bb40c5470 tx=0x7f6bb00090f0).ready entity=mon.0 client_cookie=a10784a965118637 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bb8f99700 1 -- 172.21.15.115:0/2354636819 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000b600 con 0x7f6bb4153ec0 2023-07-27T14:35:07.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bb8f99700 1 -- 172.21.15.115:0/2354636819 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000b760 con 0x7f6bb4153ec0 2023-07-27T14:35:07.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bb8f99700 1 -- 172.21.15.115:0/2354636819 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000bae0 con 0x7f6bb4153ec0 2023-07-27T14:35:07.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/2354636819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 msgr2=0x7f6bb40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/2354636819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb40a9b60 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f6bb40c5470 tx=0x7f6bb00090f0).stop 2023-07-27T14:35:07.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/2354636819 shutdown_connections 2023-07-27T14:35:07.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/2354636819 >> v2:172.21.15.159:3300/0 conn(0x7f6bb40aaa40 0x7f6bb40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/2354636819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb40a9b60 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/2354636819 >> 172.21.15.115:0/2354636819 conn(0x7f6bb40cb610 msgr2=0x7f6bb40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:07.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/2354636819 shutdown_connections 2023-07-27T14:35:07.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.600+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/2354636819 wait complete. 2023-07-27T14:35:07.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.602+0000 7f6bbc1ff700 1 Processor -- start 2023-07-27T14:35:07.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.602+0000 7f6bbc1ff700 1 -- start start 2023-07-27T14:35:07.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bbc1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40aa050 0x7f6bb414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bbc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb40aaa40 0x7f6bb41501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bbc1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bbc1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb41537e0 con 0x7f6bb4153ec0 2023-07-27T14:35:07.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bbc1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4152eb0 con 0x7f6bb40aa050 2023-07-27T14:35:07.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bbc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4153190 con 0x7f6bb40aaa40 2023-07-27T14:35:07.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bba79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bba79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb414bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38194/0 (socket says 172.21.15.115:38194) 2023-07-27T14:35:07.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bba79c700 1 -- 172.21.15.115:0/4259632356 learned_addr learned my addr 172.21.15.115:0/4259632356 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:07.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40aa050 0x7f6bb414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bb979a700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb40aaa40 0x7f6bb41501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bba79c700 1 -- 172.21.15.115:0/4259632356 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb40aaa40 msgr2=0x7f6bb41501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bba79c700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb40aaa40 0x7f6bb41501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bba79c700 1 -- 172.21.15.115:0/4259632356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40aa050 msgr2=0x7f6bb414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bba79c700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40aa050 0x7f6bb414c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.604+0000 7f6bba79c700 1 -- 172.21.15.115:0/4259632356 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0009370 con 0x7f6bb4153ec0 2023-07-27T14:35:07.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.605+0000 7f6bba79c700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb414bab0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f6bac00d150 tx=0x7f6bac009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.605+0000 7f6ba9ffb700 1 -- 172.21.15.115:0/4259632356 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00ddf0 con 0x7f6bb4153ec0 2023-07-27T14:35:07.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.605+0000 7f6ba9ffb700 1 -- 172.21.15.115:0/4259632356 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac00f040 con 0x7f6bb4153ec0 2023-07-27T14:35:07.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.605+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/4259632356 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb4153470 con 0x7f6bb4153ec0 2023-07-27T14:35:07.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.605+0000 7f6ba9ffb700 1 -- 172.21.15.115:0/4259632356 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac013600 con 0x7f6bb4153ec0 2023-07-27T14:35:07.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.605+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/4259632356 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4152ad0 con 0x7f6bb4153ec0 2023-07-27T14:35:07.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.607+0000 7f6ba9ffb700 1 -- 172.21.15.115:0/4259632356 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f6bac0139b0 con 0x7f6bb4153ec0 2023-07-27T14:35:07.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.607+0000 7f6ba9ffb700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9805f6f0 0x7f6b98061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.608+0000 7f6ba9ffb700 1 -- 172.21.15.115:0/4259632356 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6bac07aff0 con 0x7f6bb4153ec0 2023-07-27T14:35:07.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.608+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9805f6f0 0x7f6b98061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.608+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9805f6f0 0x7f6b98061bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f6bb0009130 tx=0x7f6bb0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.610+0000 7f6bd34fdb80 1 Processor -- start 2023-07-27T14:35:07.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.610+0000 7f6bd34fdb80 1 -- start start 2023-07-27T14:35:07.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223c5c0 0x560d2223c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d22264830 0x560d2228acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223ef60 0x560d2228b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d221799c0 con 0x560d2223ef60 2023-07-27T14:35:07.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d2218ecc0 con 0x560d2223c5c0 2023-07-27T14:35:07.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d22155e10 con 0x560d22264830 2023-07-27T14:35:07.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223ef60 0x560d2228b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223ef60 0x560d2228b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38210/0 (socket says 172.21.15.115:38210) 2023-07-27T14:35:07.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 -- 172.21.15.115:0/1334929182 learned_addr learned my addr 172.21.15.115:0/1334929182 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:07.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 -- 172.21.15.115:0/1334929182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d22264830 msgr2=0x560d2228acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 --2- 172.21.15.115:0/1334929182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d22264830 0x560d2228acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:07.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 -- 172.21.15.115:0/1334929182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223c5c0 msgr2=0x560d2223c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 --2- 172.21.15.115:0/1334929182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223c5c0 0x560d2223c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:07.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 -- 172.21.15.115:0/1334929182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d221879a0 con 0x560d2223ef60 2023-07-27T14:35:07.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.611+0000 7f6bba79c700 1 --2- 172.21.15.115:0/1334929182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223ef60 0x560d2228b1b0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f6bac04f7a0 tx=0x7f6bac010000).ready entity=mon.0 client_cookie=d5649d852bb44478 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6b9effd700 1 -- 172.21.15.115:0/1334929182 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac054070 con 0x560d2223ef60 2023-07-27T14:35:07.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6b9effd700 1 -- 172.21.15.115:0/1334929182 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac04dcc0 con 0x560d2223ef60 2023-07-27T14:35:07.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6b9effd700 1 -- 172.21.15.115:0/1334929182 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac078ba0 con 0x560d2223ef60 2023-07-27T14:35:07.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/1334929182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223ef60 msgr2=0x560d2228b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/1334929182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223ef60 0x560d2228b1b0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f6bac04f7a0 tx=0x7f6bac010000).stop 2023-07-27T14:35:07.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/1334929182 shutdown_connections 2023-07-27T14:35:07.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/1334929182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223ef60 0x560d2228b1b0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/1334929182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223c5c0 0x560d2223c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:07.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/1334929182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d22264830 0x560d2228acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:07.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/1334929182 >> 172.21.15.115:0/1334929182 conn(0x560d220a7940 msgr2=0x560d222856f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:07.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/1334929182 shutdown_connections 2023-07-27T14:35:07.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.612+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/1334929182 wait complete. 2023-07-27T14:35:07.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.613+0000 7f6bd34fdb80 1 -- start start 2023-07-27T14:35:07.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.613+0000 7f6bd34fdb80 1 Processor -- start 2023-07-27T14:35:07.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.614+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d222826e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.614+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 0x560d22262280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.614+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d22262770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.614+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d22262c60 con 0x560d2223c5c0 2023-07-27T14:35:07.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.614+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d222919b0 con 0x560d2226a550 2023-07-27T14:35:07.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.614+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d2226a970 con 0x560d2223ef60 2023-07-27T14:35:07.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.614+0000 7f6bd34fdb80 10 client.0 ll_register_callbacks cb 0x560d221414a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:35:07.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d222826e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d222826e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38226/0 (socket says 172.21.15.115:38226) 2023-07-27T14:35:07.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/775249351 learned_addr learned my addr 172.21.15.115:0/775249351 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:07.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bba79c700 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d22262770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb979a700 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 0x560d22262280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/775249351 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 msgr2=0x560d22262280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 0x560d22262280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/775249351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 msgr2=0x560d22262770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d22262770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/775249351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4152ad0 con 0x560d2223c5c0 2023-07-27T14:35:07.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d222826e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f6bb000b650 tx=0x7f6bb001d000).ready entity=mon.0 client_cookie=602b3dc1ed1b8952 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6b93fff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:35:07.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6b93fff700 1 -- 172.21.15.115:0/775249351 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0006970 con 0x560d2223c5c0 2023-07-27T14:35:07.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.615+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/775249351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d22236d50 con 0x560d2223c5c0 2023-07-27T14:35:07.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6b93fff700 1 -- 172.21.15.115:0/775249351 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6bb0027430 con 0x560d2223c5c0 2023-07-27T14:35:07.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6b93fff700 1 -- 172.21.15.115:0/775249351 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bb000bee0 con 0x560d2223c5c0 2023-07-27T14:35:07.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bd34fdb80 10 client.8397 fetch_fsmap learned FSMap version 76 2023-07-27T14:35:07.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/775249351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x560d22183190 con 0x560d2223c5c0 2023-07-27T14:35:07.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6b93fff700 1 -- 172.21.15.115:0/775249351 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d22236d50 con 0x560d2223c5c0 2023-07-27T14:35:07.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6b93fff700 1 -- 172.21.15.115:0/775249351 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 76) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6bb0027800 con 0x560d2223c5c0 2023-07-27T14:35:07.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bd34fdb80 10 client.8397 fetch_fsmap finished waiting for FSMap version 76 2023-07-27T14:35:07.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bd34fdb80 10 client.8397 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:35:07.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bd34fdb80 20 client.8397 populate_metadata read hostname 'smithi115' 2023-07-27T14:35:07.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] conn(0x560d22262e70 0x560d22263250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bd34fdb80 4 client.8397 mds_command: new command op to 8247 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:35:07.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/775249351 --> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d21ff7ef0 con 0x560d22262e70 2023-07-27T14:35:07.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.616+0000 7f6bb979a700 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] conn(0x560d22262e70 0x560d22263250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.617+0000 7f6bb979a700 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] conn(0x560d22262e70 0x560d22263250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=14f7b3aed08cd4bf server_cookie=590e9d02b8934dd1 in_seq=0 out_seq=0 2023-07-27T14:35:07.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.617+0000 7f6b93fff700 10 client.8397 ms_handle_connect on v2:172.21.15.115:6835/2708675397 2023-07-27T14:35:07.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6b93fff700 1 -- 172.21.15.115:0/775249351 <== mds.0 v2:172.21.15.115:6835/2708675397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x560d21ff7ef0 con 0x560d22262e70 2023-07-27T14:35:07.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6b93fff700 10 client.8397 handle_command_reply: tid=0 2023-07-27T14:35:07.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 client.8397 shutdown 2023-07-27T14:35:07.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/775249351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 msgr2=0x560d222826e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d222826e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f6bb000b650 tx=0x7f6bb001d000).stop 2023-07-27T14:35:07.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/775249351 shutdown_connections 2023-07-27T14:35:07.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] conn(0x560d22262e70 0x560d22263250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d22262770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6b93fff700 0 client.8397 ms_handle_reset on v2:172.21.15.115:6835/2708675397 2023-07-27T14:35:07.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d222826e0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/775249351 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 0x560d22262280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/775249351 >> 172.21.15.115:0/775249351 conn(0x560d220a7940 msgr2=0x560d2223ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:07.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/775249351 shutdown_connections 2023-07-27T14:35:07.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/775249351 wait complete. 2023-07-27T14:35:07.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.618+0000 7f6bd34fdb80 20 client.8397 trim_cache size 0 max 16384 2023-07-27T14:35:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.635+0000 7f6bd34fdb80 1 Processor -- start 2023-07-27T14:35:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.635+0000 7f6bd34fdb80 1 -- start start 2023-07-27T14:35:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223c5c0 0x560d222911a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223ef60 0x560d22263420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2226a550 0x560d22261b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d22239740 con 0x560d2226a550 2023-07-27T14:35:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d22281640 con 0x560d2223ef60 2023-07-27T14:35:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d22284500 con 0x560d2223c5c0 2023-07-27T14:35:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2226a550 0x560d22261b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2226a550 0x560d22261b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38236/0 (socket says 172.21.15.115:38236) 2023-07-27T14:35:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 -- 172.21.15.115:0/2336015938 learned_addr learned my addr 172.21.15.115:0/2336015938 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bb979a700 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223ef60 0x560d22263420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223c5c0 0x560d222911a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 -- 172.21.15.115:0/2336015938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223c5c0 msgr2=0x560d222911a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223c5c0 0x560d222911a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 -- 172.21.15.115:0/2336015938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223ef60 msgr2=0x560d22263420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223ef60 0x560d22263420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 -- 172.21.15.115:0/2336015938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d22182ee0 con 0x560d2226a550 2023-07-27T14:35:07.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.636+0000 7f6bba79c700 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2226a550 0x560d22261b50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f6bac00d8a0 tx=0x7f6bac05c000).ready entity=mon.0 client_cookie=34ae2e65dc1854d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6b9f7fe700 1 -- 172.21.15.115:0/2336015938 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac04df20 con 0x560d2226a550 2023-07-27T14:35:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6b9f7fe700 1 -- 172.21.15.115:0/2336015938 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac078ba0 con 0x560d2226a550 2023-07-27T14:35:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6b9f7fe700 1 -- 172.21.15.115:0/2336015938 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac013e50 con 0x560d2226a550 2023-07-27T14:35:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/2336015938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2226a550 msgr2=0x560d22261b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2226a550 0x560d22261b50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f6bac00d8a0 tx=0x7f6bac05c000).stop 2023-07-27T14:35:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/2336015938 shutdown_connections 2023-07-27T14:35:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2226a550 0x560d22261b50 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223c5c0 0x560d222911a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/2336015938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2223ef60 0x560d22263420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/2336015938 >> 172.21.15.115:0/2336015938 conn(0x560d220a7940 msgr2=0x560d2227bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/2336015938 shutdown_connections 2023-07-27T14:35:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.637+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/2336015938 wait complete. 2023-07-27T14:35:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.638+0000 7f6bd34fdb80 1 -- start start 2023-07-27T14:35:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.638+0000 7f6bd34fdb80 1 Processor -- start 2023-07-27T14:35:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d2223d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 0x560d222d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bd34fdb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d222d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d222d12d0 con 0x560d2223c5c0 2023-07-27T14:35:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d22286df0 con 0x560d2226a550 2023-07-27T14:35:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bd34fdb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d22289510 con 0x560d2223ef60 2023-07-27T14:35:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bd34fdb80 10 client.0 ll_register_callbacks cb 0x560d221414a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:35:07.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bb9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d2223d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bb9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d2223d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38248/0 (socket says 172.21.15.115:38248) 2023-07-27T14:35:07.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.639+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/4094710706 learned_addr learned my addr 172.21.15.115:0/4094710706 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:07.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bba79c700 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d222d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bb979a700 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 0x560d222d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 msgr2=0x560d222d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 0x560d222d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 msgr2=0x560d222d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d222d0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bb9f9b700 1 -- 172.21.15.115:0/4094710706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d221879a0 con 0x560d2223c5c0 2023-07-27T14:35:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bba79c700 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d222d0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bb9f9b700 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d2223d1e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f6bb00274b0 tx=0x7f6bb0026000).ready entity=mon.0 client_cookie=6c07c506b412fe6f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6b93fff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:35:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6b93fff700 1 -- 172.21.15.115:0/4094710706 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb001cb30 con 0x560d2223c5c0 2023-07-27T14:35:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/4094710706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6bac04dcc0 con 0x560d2223c5c0 2023-07-27T14:35:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6b93fff700 1 -- 172.21.15.115:0/4094710706 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6bb0027800 con 0x560d2223c5c0 2023-07-27T14:35:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6b93fff700 1 -- 172.21.15.115:0/4094710706 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bb0011610 con 0x560d2223c5c0 2023-07-27T14:35:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bd34fdb80 10 client.8403 fetch_fsmap learned FSMap version 76 2023-07-27T14:35:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.640+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/4094710706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x560d21ffd1d0 con 0x560d2223c5c0 2023-07-27T14:35:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6b93fff700 1 -- 172.21.15.115:0/4094710706 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac04dcc0 con 0x560d2223c5c0 2023-07-27T14:35:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6b93fff700 1 -- 172.21.15.115:0/4094710706 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 76) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6bb0011770 con 0x560d2223c5c0 2023-07-27T14:35:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6bd34fdb80 10 client.8403 fetch_fsmap finished waiting for FSMap version 76 2023-07-27T14:35:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6bd34fdb80 10 client.8403 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:35:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6bd34fdb80 20 client.8403 populate_metadata read hostname 'smithi115' 2023-07-27T14:35:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] conn(0x560d22281db0 0x560d22282190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6bd34fdb80 4 client.8403 mds_command: new command op to 8247 tid=0[{"prefix": "status"}] 2023-07-27T14:35:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/4094710706 --> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560d2202d040 con 0x560d22281db0 2023-07-27T14:35:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6bb979a700 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] conn(0x560d22281db0 0x560d22282190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6bb979a700 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] conn(0x560d22281db0 0x560d22282190 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4fd96fa358fd909 server_cookie=30c03626f3465194 in_seq=0 out_seq=0 2023-07-27T14:35:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.641+0000 7f6b93fff700 10 client.8403 ms_handle_connect on v2:172.21.15.115:6835/2708675397 2023-07-27T14:35:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6b93fff700 1 -- 172.21.15.115:0/4094710706 <== mds.0 v2:172.21.15.115:6835/2708675397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x560d2202d040 con 0x560d22281db0 2023-07-27T14:35:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6b93fff700 10 client.8403 handle_command_reply: tid=0 2023-07-27T14:35:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 client.8403 shutdown 2023-07-27T14:35:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/4094710706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 msgr2=0x560d2223d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d2223d1e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f6bb00274b0 tx=0x7f6bb0026000).stop 2023-07-27T14:35:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/4094710706 shutdown_connections 2023-07-27T14:35:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.115:6835/2708675397,v1:172.21.15.115:6837/2708675397] conn(0x560d22281db0 0x560d22282190 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560d2226a550 0x560d222d0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560d2223c5c0 0x560d2223d1e0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 --2- 172.21.15.115:0/4094710706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x560d2223ef60 0x560d222d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/4094710706 >> 172.21.15.115:0/4094710706 conn(0x560d220a7940 msgr2=0x560d22269160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6b93fff700 0 client.8403 ms_handle_reset on v2:172.21.15.115:6835/2708675397 2023-07-27T14:35:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/4094710706 shutdown_connections 2023-07-27T14:35:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 1 -- 172.21.15.115:0/4094710706 wait complete. 2023-07-27T14:35:07.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.642+0000 7f6bd34fdb80 20 client.8403 trim_cache size 0 max 16384 2023-07-27T14:35:07.695 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:35:07.695 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:35:07.695 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:35:07.695 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 8247, 2023-07-27T14:35:07.695 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:35:07.695 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:35:07.696 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:35:07.696 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.281175857, 2023-07-27T14:35:07.696 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 76, 2023-07-27T14:35:07.696 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 142, 2023-07-27T14:35:07.696 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 142, 2023-07-27T14:35:07.696 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.494766192 2023-07-27T14:35:07.696 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:35:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9805f6f0 msgr2=0x7f6b98061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9805f6f0 0x7f6b98061bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f6bb0009130 tx=0x7f6bb0017000).stop 2023-07-27T14:35:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 msgr2=0x7f6bb414bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb414bab0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f6bac00d150 tx=0x7f6bac009a50).stop 2023-07-27T14:35:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/4259632356 shutdown_connections 2023-07-27T14:35:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9805f6f0 0x7f6b98061bb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb4153ec0 0x7f6bb414bab0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb40aa050 0x7f6bb414c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 --2- 172.21.15.115:0/4259632356 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb40aaa40 0x7f6bb41501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/4259632356 >> 172.21.15.115:0/4259632356 conn(0x7f6bb40cb610 msgr2=0x7f6bb40ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/4259632356 shutdown_connections 2023-07-27T14:35:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.643+0000 7f6bbc1ff700 1 -- 172.21.15.115:0/4259632356 wait complete. 2023-07-27T14:35:07.703 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:35:07.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.817+0000 7f8bf0bff700 1 Processor -- start 2023-07-27T14:35:07.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.817+0000 7f8bf0bff700 1 -- start start 2023-07-27T14:35:07.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.818+0000 7f8bf0bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8bec154190 0x7f8bec0a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.818+0000 7f8bf0bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8bec0648e0 0x7f8bec154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.818+0000 7f8bf0bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec158e00 con 0x7f8bec0c64b0 2023-07-27T14:35:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.818+0000 7f8bf0bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0aa640 con 0x7f8bec154190 2023-07-27T14:35:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.818+0000 7f8bf0bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec158040 con 0x7f8bec0648e0 2023-07-27T14:35:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.818+0000 7f8bea59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8bec154190 0x7f8bec0a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8bea59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8bec154190 0x7f8bec0a9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38258/0 (socket says 172.21.15.115:38258) 2023-07-27T14:35:07.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8bea59c700 1 -- 172.21.15.115:0/3018327826 learned_addr learned my addr 172.21.15.115:0/3018327826 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:07.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8bead9d700 1 --2- 172.21.15.115:0/3018327826 >> v2:172.21.15.159:3300/0 conn(0x7f8bec0648e0 0x7f8bec154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8bea59c700 1 -- 172.21.15.115:0/3018327826 >> v2:172.21.15.159:3300/0 conn(0x7f8bec0648e0 msgr2=0x7f8bec154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8bea59c700 1 --2- 172.21.15.115:0/3018327826 >> v2:172.21.15.159:3300/0 conn(0x7f8bec0648e0 0x7f8bec154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8bea59c700 1 -- 172.21.15.115:0/3018327826 >> v1:172.21.15.159:6789/0 conn(0x7f8bec0c64b0 legacy=0x7f8bec0641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8bea59c700 1 -- 172.21.15.115:0/3018327826 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec158320 con 0x7f8bec154190 2023-07-27T14:35:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8bea59c700 1 --2- 172.21.15.115:0/3018327826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec154190 0x7f8bec0a9d60 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f8bec084510 tx=0x7f8bdc0090f0).ready entity=mon.0 client_cookie=1d01628917d337a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8be959a700 1 -- 172.21.15.115:0/3018327826 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00b520 con 0x7f8bec154190 2023-07-27T14:35:07.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8be959a700 1 -- 172.21.15.115:0/3018327826 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc00b680 con 0x7f8bec154190 2023-07-27T14:35:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.819+0000 7f8be959a700 1 -- 172.21.15.115:0/3018327826 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00ba20 con 0x7f8bec154190 2023-07-27T14:35:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.820+0000 7f8bf0bff700 1 -- 172.21.15.115:0/3018327826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec154190 msgr2=0x7f8bec0a9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.820+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/3018327826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec154190 0x7f8bec0a9d60 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f8bec084510 tx=0x7f8bdc0090f0).stop 2023-07-27T14:35:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.820+0000 7f8bf0bff700 1 -- 172.21.15.115:0/3018327826 shutdown_connections 2023-07-27T14:35:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.820+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/3018327826 >> v2:172.21.15.159:3300/0 conn(0x7f8bec0648e0 0x7f8bec154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.820+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/3018327826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec154190 0x7f8bec0a9d60 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.820+0000 7f8bf0bff700 1 -- 172.21.15.115:0/3018327826 >> 172.21.15.115:0/3018327826 conn(0x7f8bec0cb730 msgr2=0x7f8bec0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:07.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.820+0000 7f8bf0bff700 1 -- 172.21.15.115:0/3018327826 shutdown_connections 2023-07-27T14:35:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.820+0000 7f8bf0bff700 1 -- 172.21.15.115:0/3018327826 wait complete. 2023-07-27T14:35:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.822+0000 7f8bf0bff700 1 Processor -- start 2023-07-27T14:35:07.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.822+0000 7f8bf0bff700 1 -- start start 2023-07-27T14:35:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.823+0000 7f8bf0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec0648e0 0x7f8bec0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8bf0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec0c64b0 0x7f8bec0c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8bf0bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec154190 0x7f8bec152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8bf0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec165740 con 0x7f8bec0c64b0 2023-07-27T14:35:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8bf0bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec164900 con 0x7f8bec154190 2023-07-27T14:35:07.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8bf0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec164b70 con 0x7f8bec0648e0 2023-07-27T14:35:07.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec0c64b0 0x7f8bec0c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec0c64b0 0x7f8bec0c2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38264/0 (socket says 172.21.15.115:38264) 2023-07-27T14:35:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 -- 172.21.15.115:0/404045241 learned_addr learned my addr 172.21.15.115:0/404045241 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8bead9d700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec154190 0x7f8bec152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8bea59c700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec0648e0 0x7f8bec0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 -- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec0648e0 msgr2=0x7f8bec0c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec0648e0 0x7f8bec0c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 -- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec154190 msgr2=0x7f8bec152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:07.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec154190 0x7f8bec152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:07.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 -- 172.21.15.115:0/404045241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc009370 con 0x7f8bec0c64b0 2023-07-27T14:35:07.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8bead9d700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec154190 0x7f8bec152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:07.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.824+0000 7f8be9d9b700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec0c64b0 0x7f8bec0c2d10 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f8be000c440 tx=0x7f8be0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.825+0000 7f8bda7fc700 1 -- 172.21.15.115:0/404045241 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000f470 con 0x7f8bec0c64b0 2023-07-27T14:35:07.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.825+0000 7f8bda7fc700 1 -- 172.21.15.115:0/404045241 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be000f5d0 con 0x7f8bec0c64b0 2023-07-27T14:35:07.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.825+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec1534c0 con 0x7f8bec0c64b0 2023-07-27T14:35:07.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.825+0000 7f8bda7fc700 1 -- 172.21.15.115:0/404045241 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000f970 con 0x7f8bec0c64b0 2023-07-27T14:35:07.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.825+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec1650f0 con 0x7f8bec0c64b0 2023-07-27T14:35:07.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.826+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec05f0c0 con 0x7f8bec0c64b0 2023-07-27T14:35:07.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.826+0000 7f8bda7fc700 1 -- 172.21.15.115:0/404045241 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f8be0019030 con 0x7f8bec0c64b0 2023-07-27T14:35:07.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.827+0000 7f8bda7fc700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bcc05f750 0x7f8bcc061c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:07.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.827+0000 7f8bda7fc700 1 -- 172.21.15.115:0/404045241 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8be0079e90 con 0x7f8bec0c64b0 2023-07-27T14:35:07.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.828+0000 7f8bea59c700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bcc05f750 0x7f8bcc061c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:07.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.828+0000 7f8bea59c700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bcc05f750 0x7f8bcc061c10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f8bdc00b2e0 tx=0x7f8bdc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:07.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:07.831+0000 7f8bda7fc700 1 -- 172.21.15.115:0/404045241 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8be00488f0 con 0x7f8bec0c64b0 2023-07-27T14:35:08.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.045+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8bec165880 con 0x7f8bec0c64b0 2023-07-27T14:35:08.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.045+0000 7f8bda7fc700 1 -- 172.21.15.115:0/404045241 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8bec165880 con 0x7f8bec0c64b0 2023-07-27T14:35:08.089 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:35:08.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bcc05f750 msgr2=0x7f8bcc061c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:08.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bcc05f750 0x7f8bcc061c10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f8bdc00b2e0 tx=0x7f8bdc017000).stop 2023-07-27T14:35:08.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec0c64b0 msgr2=0x7f8bec0c2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:08.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec0c64b0 0x7f8bec0c2d10 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f8be000c440 tx=0x7f8be0007dc0).stop 2023-07-27T14:35:08.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 shutdown_connections 2023-07-27T14:35:08.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bcc05f750 0x7f8bcc061c10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:08.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec154190 0x7f8bec152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:08.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec0648e0 0x7f8bec0c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:08.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 --2- 172.21.15.115:0/404045241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec0c64b0 0x7f8bec0c2d10 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:08.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 >> 172.21.15.115:0/404045241 conn(0x7f8bec0cb730 msgr2=0x7f8bec0c5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:08.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 shutdown_connections 2023-07-27T14:35:08.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:08.047+0000 7f8bf0bff700 1 -- 172.21.15.115:0/404045241 wait complete. 2023-07-27T14:35:08.106 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:35:08.106 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:35:08.107 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:35:08.107 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:35:08.107 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:35:08.107 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:35:08.107 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:35:08.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:35:08.108 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:35:08.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:08.109 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:35:08.156 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:35:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:35:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:35:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:35:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:08.158 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:35:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:35:08.158 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:35:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:35:08.158 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:35:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:08.159 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:35:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:35:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41493sec preferred_lft 41493sec 2023-07-27T14:35:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:35:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:08.159 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:35:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:35:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:35:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:08.160 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:35:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:35:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:35:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:08.161 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:35:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:35:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:35:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:08.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:08.162 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:35:08.264 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:35:08.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:08.268 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:35:08.316 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:35:08.316 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:35:08.316 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:35:08.316 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:35:08.317 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:35:08.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:08.318 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:35:08.318 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:35:08.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:35:08.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:35:08.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:35:08.319 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:35:08.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:08.488 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:35:08.534 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:35:08.534 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:35:08.535 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:35:08.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:08.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:35:08.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:08.647 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:35:08.693 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:35:08.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:35:08.830 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:35:08.831 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:35:08.857 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:35:08.857 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:35:08.862 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:35:08.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:08.863 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:35:08.932 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:35:09.103 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.060+0000 7fd4859ff700 1 Processor -- start 2023-07-27T14:35:09.104 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.060+0000 7fd4859ff700 1 -- start start 2023-07-27T14:35:09.105 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.061+0000 7fd4859ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd480154350 0x7fd4800c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:09.105 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.061+0000 7fd4859ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4800630a0 con 0x7fd4800bc070 2023-07-27T14:35:09.105 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd4859ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd480062490 con 0x7fd480153f70 2023-07-27T14:35:09.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd4859ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd480154780 con 0x7fd480154350 2023-07-27T14:35:09.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd47effd700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fd480153f70 0x7fd4800bcf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:41152/0 (socket says 172.21.15.159:41152) 2023-07-27T14:35:09.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd47effd700 1 -- 172.21.15.159:0/3044436294 learned_addr learned my addr 172.21.15.159:0/3044436294 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:35:09.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd47f7fe700 1 --2- 172.21.15.159:0/3044436294 >> v2:172.21.15.115:3300/0 conn(0x7fd480154350 0x7fd4800c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:09.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597595159 0 0) 0x7fd480062490 con 0x7fd480153f70 2023-07-27T14:35:09.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4680033f0 con 0x7fd480153f70 2023-07-27T14:35:09.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 <== mon.1 v1:172.21.15.159:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4080932347 0 0) 0x7fd4680033f0 con 0x7fd480153f70 2023-07-27T14:35:09.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 >> v2:172.21.15.115:3300/0 conn(0x7fd480154350 msgr2=0x7fd4800c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:09.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.062+0000 7fd47dffb700 1 --2- 172.21.15.159:0/3044436294 >> v2:172.21.15.115:3300/0 conn(0x7fd480154350 0x7fd4800c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 >> v1:172.21.15.115:6789/0 conn(0x7fd4800bc070 legacy=0x7fd480063530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:09.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 --> v1:172.21.15.159:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd480062770 con 0x7fd480153f70 2023-07-27T14:35:09.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 <== mon.1 v1:172.21.15.159:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fd470001470 con 0x7fd480153f70 2023-07-27T14:35:09.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 >> v1:172.21.15.159:6789/0 conn(0x7fd480153f70 legacy=0x7fd4800bcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:09.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4680038e0 0x7fd468003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:09.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd468004690 0x7fd468004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:09.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd468005000 0x7fd46800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:09.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480154780 con 0x7fd468004690 2023-07-27T14:35:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46800beb0 con 0x7fd468005000 2023-07-27T14:35:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46800c070 con 0x7fd4680038e0 2023-07-27T14:35:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47f7fe700 1 --2- 172.21.15.159:0/3044436294 >> v2:172.21.15.115:3300/0 conn(0x7fd480154350 0x7fd4800c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:35:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47effd700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4680038e0 0x7fd468003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47e7fc700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd468004690 0x7fd468004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47f7fe700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd468005000 0x7fd46800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47effd700 1 -- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd468005000 msgr2=0x7fd46800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47effd700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd468005000 0x7fd46800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47effd700 1 -- 172.21.15.159:0/3044436294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd468004690 msgr2=0x7fd468004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47effd700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd468004690 0x7fd468004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.063+0000 7fd47effd700 1 -- 172.21.15.159:0/3044436294 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680033f0 con 0x7fd4680038e0 2023-07-27T14:35:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.064+0000 7fd47f7fe700 1 -- 172.21.15.159:0/3044436294 reap_dead start 2023-07-27T14:35:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.064+0000 7fd47effd700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4680038e0 0x7fd468003cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fd47000c1e0 tx=0x7fd480063010).ready entity=mon.2 client_cookie=303cfd8fa7626ec2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.064+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470007a60 con 0x7fd4680038e0 2023-07-27T14:35:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.064+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47000cab0 con 0x7fd4680038e0 2023-07-27T14:35:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.064+0000 7fd47dffb700 1 -- 172.21.15.159:0/3044436294 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47000ce70 con 0x7fd4680038e0 2023-07-27T14:35:09.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.064+0000 7fd4859ff700 1 -- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4680038e0 msgr2=0x7fd468003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:09.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.064+0000 7fd4859ff700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4680038e0 0x7fd468003cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fd47000c1e0 tx=0x7fd480063010).stop 2023-07-27T14:35:09.114 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.064+0000 7fd4859ff700 1 -- 172.21.15.159:0/3044436294 shutdown_connections 2023-07-27T14:35:09.114 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.065+0000 7fd4859ff700 1 --2- 172.21.15.159:0/3044436294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd4680038e0 0x7fd468003cc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.114 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.065+0000 7fd4859ff700 1 -- 172.21.15.159:0/3044436294 >> 172.21.15.159:0/3044436294 conn(0x7fd4800c3bb0 msgr2=0x7fd4800c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:09.114 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.065+0000 7fd4859ff700 1 -- 172.21.15.159:0/3044436294 shutdown_connections 2023-07-27T14:35:09.114 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.065+0000 7fd4859ff700 1 -- 172.21.15.159:0/3044436294 wait complete. 2023-07-27T14:35:09.114 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.066+0000 7fd4859ff700 1 Processor -- start 2023-07-27T14:35:09.114 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.066+0000 7fd4859ff700 1 -- start start 2023-07-27T14:35:09.115 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.067+0000 7fd4859ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680038e0 0x7fd4800a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:09.115 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.067+0000 7fd4859ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4800a8d40 0x7fd4800a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:09.115 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.067+0000 7fd4859ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd48013cc40 0x7fd48013d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:09.115 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.067+0000 7fd4859ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800a88b0 con 0x7fd4680038e0 2023-07-27T14:35:09.115 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.067+0000 7fd4859ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48013d550 con 0x7fd4800a8d40 2023-07-27T14:35:09.115 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.067+0000 7fd4859ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd480154bc0 con 0x7fd48013cc40 2023-07-27T14:35:09.115 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.067+0000 7fd47e7fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4800a8d40 0x7fd4800a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:09.115 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.067+0000 7fd47e7fc700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4800a8d40 0x7fd4800a91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55694/0 (socket says 172.21.15.159:55694) 2023-07-27T14:35:09.116 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47e7fc700 1 -- 172.21.15.159:0/1638227312 learned_addr learned my addr 172.21.15.159:0/1638227312 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:35:09.116 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47f7fe700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd48013cc40 0x7fd48013d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:09.116 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47effd700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680038e0 0x7fd4800a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:09.116 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47e7fc700 1 -- 172.21.15.159:0/1638227312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd48013cc40 msgr2=0x7fd48013d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:09.116 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47e7fc700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd48013cc40 0x7fd48013d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.116 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47e7fc700 1 -- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680038e0 msgr2=0x7fd4800a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:09.116 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47e7fc700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680038e0 0x7fd4800a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.117 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47e7fc700 1 -- 172.21.15.159:0/1638227312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4801503c0 con 0x7fd4800a8d40 2023-07-27T14:35:09.117 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd47e7fc700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4800a8d40 0x7fd4800a91a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fd4740029b0 tx=0x7fd474007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:09.117 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd466ffd700 1 -- 172.21.15.159:0/1638227312 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47400f670 con 0x7fd4800a8d40 2023-07-27T14:35:09.117 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd466ffd700 1 -- 172.21.15.159:0/1638227312 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47400f7d0 con 0x7fd4800a8d40 2023-07-27T14:35:09.117 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd466ffd700 1 -- 172.21.15.159:0/1638227312 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47400fb70 con 0x7fd4800a8d40 2023-07-27T14:35:09.117 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4800a8260 con 0x7fd4800a8d40 2023-07-27T14:35:09.117 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.068+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4800a7210 con 0x7fd4800a8d40 2023-07-27T14:35:09.117 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.069+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4800a8a60 con 0x7fd4800a8d40 2023-07-27T14:35:09.118 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.070+0000 7fd466ffd700 1 -- 172.21.15.159:0/1638227312 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7fd47401b030 con 0x7fd4800a8d40 2023-07-27T14:35:09.118 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.071+0000 7fd466ffd700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd46c05f6f0 0x7fd46c061bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:09.118 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.071+0000 7fd466ffd700 1 -- 172.21.15.159:0/1638227312 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd47407a5d0 con 0x7fd4800a8d40 2023-07-27T14:35:09.119 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.071+0000 7fd47effd700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd46c05f6f0 0x7fd46c061bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:09.119 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.072+0000 7fd47effd700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd46c05f6f0 0x7fd46c061bb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fd470001120 tx=0x7fd470015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:09.119 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.076+0000 7fd466ffd700 1 -- 172.21.15.159:0/1638227312 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd47404a8f0 con 0x7fd4800a8d40 2023-07-27T14:35:09.333 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.290+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd48006bb50 con 0x7fd4800a8d40 2023-07-27T14:35:09.334 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.290+0000 7fd466ffd700 1 -- 172.21.15.159:0/1638227312 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd4800a8a60 con 0x7fd4800a8d40 2023-07-27T14:35:09.334 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:35:09.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd46c05f6f0 msgr2=0x7fd46c061bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:09.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd46c05f6f0 0x7fd46c061bb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fd470001120 tx=0x7fd470015000).stop 2023-07-27T14:35:09.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4800a8d40 msgr2=0x7fd4800a91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:09.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4800a8d40 0x7fd4800a91a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fd4740029b0 tx=0x7fd474007b90).stop 2023-07-27T14:35:09.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 shutdown_connections 2023-07-27T14:35:09.336 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd46c05f6f0 0x7fd46c061bb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd48013cc40 0x7fd48013d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4680038e0 0x7fd4800a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 --2- 172.21.15.159:0/1638227312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd4800a8d40 0x7fd4800a91a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:09.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 >> 172.21.15.159:0/1638227312 conn(0x7fd4800c3bb0 msgr2=0x7fd4800689f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:09.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 shutdown_connections 2023-07-27T14:35:09.337 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:35:09.292+0000 7fd4859ff700 1 -- 172.21.15.159:0/1638227312 wait complete. 2023-07-27T14:35:09.351 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:35:09.351 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:35:09.351 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:35:09.352 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:35:09.352 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:35:09.352 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:35:09.352 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:35:09.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:35:09.353 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:35:09.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:09.354 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:35:09.400 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:35:09.400 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:35:09.400 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:35:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:35:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:09.401 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:35:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:35:09.401 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:35:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:35:09.402 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:35:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:09.402 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:35:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:35:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41487sec preferred_lft 41487sec 2023-07-27T14:35:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:35:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:09.403 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:35:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:35:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:35:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:35:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:09.404 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:35:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:35:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:35:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:09.404 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:35:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:35:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:35:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:35:09.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:09.406 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:35:09.475 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:35:09.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:09.479 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:35:09.527 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:35:09.527 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:35:09.527 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:35:09.528 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:35:09.528 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:35:09.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:09.529 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:35:09.529 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:35:09.530 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:35:09.530 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:35:09.530 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:35:09.530 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:35:09.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:09.702 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:35:09.748 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:35:09.748 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:35:09.749 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:35:09.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:09.750 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:35:09.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:09.861 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:35:09.907 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:35:09.908 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:35:10.045 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:35:10.046 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:35:10.072 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:35:10.072 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:35:10.077 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:35:10.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:35:10.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:35:10.148 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:35:10.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.304+0000 7f32d91ff700 1 Processor -- start 2023-07-27T14:35:10.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.305+0000 7f32d91ff700 1 -- start start 2023-07-27T14:35:10.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.306+0000 7f32d91ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f32d413a350 0x7f32d4065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:10.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.306+0000 7f32d91ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d40bd9a0 con 0x7f32d40c36b0 2023-07-27T14:35:10.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.306+0000 7f32d91ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d4066610 con 0x7f32d413a730 2023-07-27T14:35:10.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.306+0000 7f32d91ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d4066400 con 0x7f32d413a350 2023-07-27T14:35:10.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.306+0000 7f32d2d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f32d413a350 0x7f32d4065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:10.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.306+0000 7f32d2d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f32d413a350 0x7f32d4065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38268/0 (socket says 172.21.15.115:38268) 2023-07-27T14:35:10.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.306+0000 7f32d359e700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f32d40c36b0 0x7f32d40be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46722/0 (socket says 172.21.15.115:46722) 2023-07-27T14:35:10.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.306+0000 7f32d2d9d700 1 -- 172.21.15.115:0/2201895669 learned_addr learned my addr 172.21.15.115:0/2201895669 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:10.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d2d9d700 1 -- 172.21.15.115:0/2201895669 >> v1:172.21.15.159:6789/0 conn(0x7f32d413a730 legacy=0x7f32d40c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:10.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d2d9d700 1 -- 172.21.15.115:0/2201895669 >> v1:172.21.15.115:6789/0 conn(0x7f32d40c36b0 legacy=0x7f32d40be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:10.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d2d9d700 1 -- 172.21.15.115:0/2201895669 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40bdc10 con 0x7f32d413a350 2023-07-27T14:35:10.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d1d9b700 1 -- 172.21.15.115:0/2201895669 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378342429 0 0) 0x7f32d40bd9a0 con 0x7f32d40c36b0 2023-07-27T14:35:10.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d2d9d700 1 --2- 172.21.15.115:0/2201895669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4065f10 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f32c4006fd0 tx=0x7f32c40090f0).ready entity=mon.0 client_cookie=c3e20741c90ff6d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:10.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d1d9b700 1 -- 172.21.15.115:0/2201895669 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400b600 con 0x7f32d413a350 2023-07-27T14:35:10.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d1d9b700 1 -- 172.21.15.115:0/2201895669 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c400b760 con 0x7f32d413a350 2023-07-27T14:35:10.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d1d9b700 1 -- 172.21.15.115:0/2201895669 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400bae0 con 0x7f32d413a350 2023-07-27T14:35:10.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d91ff700 1 -- 172.21.15.115:0/2201895669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 msgr2=0x7f32d4065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:10.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.307+0000 7f32d91ff700 1 --2- 172.21.15.115:0/2201895669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4065f10 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f32c4006fd0 tx=0x7f32c40090f0).stop 2023-07-27T14:35:10.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.308+0000 7f32d91ff700 1 -- 172.21.15.115:0/2201895669 shutdown_connections 2023-07-27T14:35:10.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.308+0000 7f32d91ff700 1 --2- 172.21.15.115:0/2201895669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4065f10 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:10.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.308+0000 7f32d91ff700 1 -- 172.21.15.115:0/2201895669 >> 172.21.15.115:0/2201895669 conn(0x7f32d405e8f0 msgr2=0x7f32d40c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:10.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.308+0000 7f32d91ff700 1 -- 172.21.15.115:0/2201895669 shutdown_connections 2023-07-27T14:35:10.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.308+0000 7f32d91ff700 1 -- 172.21.15.115:0/2201895669 wait complete. 2023-07-27T14:35:10.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.309+0000 7f32d91ff700 1 Processor -- start 2023-07-27T14:35:10.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.309+0000 7f32d91ff700 1 -- start start 2023-07-27T14:35:10.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d91ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32d40c36b0 0x7f32d40c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:10.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d91ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:10.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d91ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d413a730 0x7f32d4153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:10.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d91ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d41552d0 con 0x7f32d413a350 2023-07-27T14:35:10.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d91ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40c83b0 con 0x7f32d413a730 2023-07-27T14:35:10.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d91ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40c74c0 con 0x7f32d40c36b0 2023-07-27T14:35:10.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:10.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38278/0 (socket says 172.21.15.115:38278) 2023-07-27T14:35:10.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d259c700 1 -- 172.21.15.115:0/1961897070 learned_addr learned my addr 172.21.15.115:0/1961897070 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:10.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.310+0000 7f32d2d9d700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32d40c36b0 0x7f32d40c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:10.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d359e700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d413a730 0x7f32d4153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:10.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d259c700 1 -- 172.21.15.115:0/1961897070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32d40c36b0 msgr2=0x7f32d40c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:10.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d259c700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32d40c36b0 0x7f32d40c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:10.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d259c700 1 -- 172.21.15.115:0/1961897070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d413a730 msgr2=0x7f32d4153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:10.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d259c700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d413a730 0x7f32d4153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:10.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d259c700 1 -- 172.21.15.115:0/1961897070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c4009370 con 0x7f32d413a350 2023-07-27T14:35:10.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d259c700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4156da0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f32c800c440 tx=0x7f32c8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:10.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32baffd700 1 -- 172.21.15.115:0/1961897070 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8007020 con 0x7f32d413a350 2023-07-27T14:35:10.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32baffd700 1 -- 172.21.15.115:0/1961897070 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8007180 con 0x7f32d413a350 2023-07-27T14:35:10.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d40c77a0 con 0x7f32d413a350 2023-07-27T14:35:10.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32baffd700 1 -- 172.21.15.115:0/1961897070 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8007520 con 0x7f32d413a350 2023-07-27T14:35:10.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.311+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d40c7d60 con 0x7f32d413a350 2023-07-27T14:35:10.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.312+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d406c470 con 0x7f32d413a350 2023-07-27T14:35:10.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.313+0000 7f32baffd700 1 -- 172.21.15.115:0/1961897070 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f32c8010070 con 0x7f32d413a350 2023-07-27T14:35:10.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.314+0000 7f32baffd700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f32c005f720 0x7f32c0061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:10.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.314+0000 7f32baffd700 1 -- 172.21.15.115:0/1961897070 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f32c8079a40 con 0x7f32d413a350 2023-07-27T14:35:10.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.314+0000 7f32d2d9d700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f32c005f720 0x7f32c0061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:10.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.315+0000 7f32d2d9d700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f32c005f720 0x7f32c0061be0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f32c4009130 tx=0x7f32c4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:10.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.318+0000 7f32baffd700 1 -- 172.21.15.115:0/1961897070 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f32c80478f0 con 0x7f32d413a350 2023-07-27T14:35:10.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:10.535+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f32d40bdef0 con 0x7f32d413a350 2023-07-27T14:35:11.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.408+0000 7f32baffd700 1 -- 172.21.15.115:0/1961897070 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 136+0+0 (secure 0 0 0) 0x7f32c804a650 con 0x7f32d413a350 2023-07-27T14:35:11.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f32c005f720 msgr2=0x7f32c0061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:11.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f32c005f720 0x7f32c0061be0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f32c4009130 tx=0x7f32c4017000).stop 2023-07-27T14:35:11.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 msgr2=0x7f32d4156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:11.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4156da0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f32c800c440 tx=0x7f32c8007e00).stop 2023-07-27T14:35:11.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 shutdown_connections 2023-07-27T14:35:11.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f32c005f720 0x7f32c0061be0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32d413a730 0x7f32d4153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f32d40c36b0 0x7f32d40c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 --2- 172.21.15.115:0/1961897070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d413a350 0x7f32d4156da0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 >> 172.21.15.115:0/1961897070 conn(0x7f32d405e8f0 msgr2=0x7f32d40633b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:11.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 shutdown_connections 2023-07-27T14:35:11.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.411+0000 7f32d91ff700 1 -- 172.21.15.115:0/1961897070 wait complete. 2023-07-27T14:35:11.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:35:11.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.624+0000 7f29249ff700 1 Processor -- start 2023-07-27T14:35:11.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.624+0000 7f29249ff700 1 -- start start 2023-07-27T14:35:11.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f29249ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2920153ec0 0x7f29200a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f29249ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200aaa40 0x7f29200c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f29249ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29200aa4d0 con 0x7f29200aa050 2023-07-27T14:35:11.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f29249ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29200c05c0 con 0x7f2920153ec0 2023-07-27T14:35:11.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f29249ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29200bfc90 con 0x7f29200aaa40 2023-07-27T14:35:11.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f291dd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f29200aa050 0x7f29200640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46734/0 (socket says 172.21.15.115:46734) 2023-07-27T14:35:11.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f291dd9b700 1 -- 172.21.15.115:0/2312158556 learned_addr learned my addr 172.21.15.115:0/2312158556 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:11.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f291e59c700 1 --2- 172.21.15.115:0/2312158556 >> v2:172.21.15.159:3300/0 conn(0x7f2920153ec0 0x7f29200a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f291ed9d700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200aaa40 0x7f29200c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.626+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612635515 0 0) 0x7f2914001110 con 0x7f29200aa050 2023-07-27T14:35:11.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29080033f0 con 0x7f29200aa050 2023-07-27T14:35:11.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1817287191 0 0) 0x7f29080033f0 con 0x7f29200aa050 2023-07-27T14:35:11.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200aaa40 msgr2=0x7f29200c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:11.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200aaa40 0x7f29200c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 >> v2:172.21.15.159:3300/0 conn(0x7f2920153ec0 msgr2=0x7f29200a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:11.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 --2- 172.21.15.115:0/2312158556 >> v2:172.21.15.159:3300/0 conn(0x7f2920153ec0 0x7f29200a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200bff70 con 0x7f29200aa050 2023-07-27T14:35:11.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f2914001600 con 0x7f29200aa050 2023-07-27T14:35:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 >> v1:172.21.15.115:6789/0 conn(0x7f29200aa050 legacy=0x7f29200640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f2908003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2908004690 0x7f2908004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2908005000 0x7f290800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200c05c0 con 0x7f29080038e0 2023-07-27T14:35:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200bfc90 con 0x7f2908004690 2023-07-27T14:35:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290800bdd0 con 0x7f2908005000 2023-07-27T14:35:11.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291e59c700 1 --2- 172.21.15.115:0/2312158556 >> v2:172.21.15.159:3300/0 conn(0x7f2920153ec0 0x7f29200a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:35:11.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291ed9d700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200aaa40 0x7f29200c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:35:11.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291e59c700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f2908003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291dd9b700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2908004690 0x7f2908004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.627+0000 7f291ed9d700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2908005000 0x7f290800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291e59c700 1 -- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2908005000 msgr2=0x7f290800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:11.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291e59c700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2908005000 0x7f290800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291e59c700 1 -- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2908004690 msgr2=0x7f2908004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291e59c700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2908004690 0x7f2908004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291e59c700 1 -- 172.21.15.115:0/2312158556 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080033f0 con 0x7f29080038e0 2023-07-27T14:35:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291e59c700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f2908003d00 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f2910009c60 tx=0x7f2910009060).ready entity=mon.0 client_cookie=316f5595c2fb355e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100095c0 con 0x7f29080038e0 2023-07-27T14:35:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291000e710 con 0x7f29080038e0 2023-07-27T14:35:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.628+0000 7f291d59a700 1 -- 172.21.15.115:0/2312158556 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000ea90 con 0x7f29080038e0 2023-07-27T14:35:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.629+0000 7f29249ff700 1 -- 172.21.15.115:0/2312158556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 msgr2=0x7f2908003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:11.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.629+0000 7f29249ff700 1 --2- 172.21.15.115:0/2312158556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f2908003d00 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f2910009c60 tx=0x7f2910009060).stop 2023-07-27T14:35:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.629+0000 7f291ed9d700 1 -- 172.21.15.115:0/2312158556 reap_dead start 2023-07-27T14:35:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.629+0000 7f29249ff700 1 -- 172.21.15.115:0/2312158556 shutdown_connections 2023-07-27T14:35:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.629+0000 7f29249ff700 1 -- 172.21.15.115:0/2312158556 >> 172.21.15.115:0/2312158556 conn(0x7f29200cb610 msgr2=0x7f29200c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.629+0000 7f29249ff700 1 -- 172.21.15.115:0/2312158556 shutdown_connections 2023-07-27T14:35:11.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.629+0000 7f29249ff700 1 -- 172.21.15.115:0/2312158556 wait complete. 2023-07-27T14:35:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.631+0000 7f29249ff700 1 Processor -- start 2023-07-27T14:35:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.631+0000 7f29249ff700 1 -- start start 2023-07-27T14:35:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f29249ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f29200afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f29249ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200c1c30 0x7f29200c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f29249ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200c3710 0x7f29200c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f29249ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200c2d90 con 0x7f29080038e0 2023-07-27T14:35:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f29249ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200c2180 con 0x7f29200c3710 2023-07-27T14:35:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f29249ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29200c2460 con 0x7f29200c1c30 2023-07-27T14:35:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f291e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f29200afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f291e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f29200afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38288/0 (socket says 172.21.15.115:38288) 2023-07-27T14:35:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.632+0000 7f291e59c700 1 -- 172.21.15.115:0/346114525 learned_addr learned my addr 172.21.15.115:0/346114525 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291dd9b700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200c1c30 0x7f29200c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291ed9d700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200c3710 0x7f29200c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291e59c700 1 -- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200c1c30 msgr2=0x7f29200c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291e59c700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200c1c30 0x7f29200c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291e59c700 1 -- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200c3710 msgr2=0x7f29200c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291e59c700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200c3710 0x7f29200c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291e59c700 1 -- 172.21.15.115:0/346114525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200c2740 con 0x7f29080038e0 2023-07-27T14:35:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291ed9d700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200c3710 0x7f29200c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f291e59c700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f29200afe10 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f291000a010 tx=0x7f2910019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:11.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f290e7fc700 1 -- 172.21.15.115:0/346114525 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000ea90 con 0x7f29080038e0 2023-07-27T14:35:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f290e7fc700 1 -- 172.21.15.115:0/346114525 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291000eed0 con 0x7f29080038e0 2023-07-27T14:35:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29200c2a20 con 0x7f29080038e0 2023-07-27T14:35:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.633+0000 7f290e7fc700 1 -- 172.21.15.115:0/346114525 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910026670 con 0x7f29080038e0 2023-07-27T14:35:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.634+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29200b04c0 con 0x7f29080038e0 2023-07-27T14:35:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.635+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292006c470 con 0x7f29080038e0 2023-07-27T14:35:11.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.635+0000 7f290e7fc700 1 -- 172.21.15.115:0/346114525 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f291002c020 con 0x7f29080038e0 2023-07-27T14:35:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.637+0000 7f290e7fc700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f290005f720 0x7f2900061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.637+0000 7f290e7fc700 1 -- 172.21.15.115:0/346114525 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f291007c540 con 0x7f29080038e0 2023-07-27T14:35:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.637+0000 7f291dd9b700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f290005f720 0x7f2900061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.637+0000 7f291dd9b700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f290005f720 0x7f2900061be0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f29200a9e70 tx=0x7f2914007900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.641+0000 7f290e7fc700 1 -- 172.21.15.115:0/346114525 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f291004d3b0 con 0x7f29080038e0 2023-07-27T14:35:11.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.836+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f29200c2ed0 con 0x7f290005f720 2023-07-27T14:35:11.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.837+0000 7f290e7fc700 1 -- 172.21.15.115:0/346114525 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2914004800 con 0x7f290005f720 2023-07-27T14:35:11.881 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:35:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:35:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:35:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:35:11.882 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:35:11.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f290005f720 msgr2=0x7f2900061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:11.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f290005f720 0x7f2900061be0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f29200a9e70 tx=0x7f2914007900).stop 2023-07-27T14:35:11.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 msgr2=0x7f29200afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:11.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f29200afe10 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f291000a010 tx=0x7f2910019000).stop 2023-07-27T14:35:11.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 shutdown_connections 2023-07-27T14:35:11.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f290005f720 0x7f2900061be0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29200c3710 0x7f29200c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29080038e0 0x7f29200afe10 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 --2- 172.21.15.115:0/346114525 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f29200c1c30 0x7f29200c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:11.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.839+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 >> 172.21.15.115:0/346114525 conn(0x7f29200cb610 msgr2=0x7f29200c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:11.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.840+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 shutdown_connections 2023-07-27T14:35:11.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:11.840+0000 7f29249ff700 1 -- 172.21.15.115:0/346114525 wait complete. 2023-07-27T14:35:11.901 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:35:12.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.048+0000 7f00449ff700 1 Processor -- start 2023-07-27T14:35:12.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.048+0000 7f00449ff700 1 -- start start 2023-07-27T14:35:12.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.049+0000 7f00449ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f004014b1e0 0x7f0040154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.049+0000 7f00449ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00401553f0 con 0x7f004014ae00 2023-07-27T14:35:12.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.049+0000 7f00449ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0040157a50 con 0x7f0040063260 2023-07-27T14:35:12.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.049+0000 7f00449ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0040157d10 con 0x7f004014b1e0 2023-07-27T14:35:12.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003e59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f004014ae00 0x7f0040062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:46750/0 (socket says 172.21.15.115:46750) 2023-07-27T14:35:12.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003e59c700 1 -- 172.21.15.115:0/2874688325 learned_addr learned my addr 172.21.15.115:0/2874688325 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:12.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003ed9d700 1 --2- 172.21.15.115:0/2874688325 >> v2:172.21.15.159:3300/0 conn(0x7f004014b1e0 0x7f0040154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270054898 0 0) 0x7f00401553f0 con 0x7f004014ae00 2023-07-27T14:35:12.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00280033f0 con 0x7f004014ae00 2023-07-27T14:35:12.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144363097 0 0) 0x7f00280033f0 con 0x7f004014ae00 2023-07-27T14:35:12.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 >> v2:172.21.15.159:3300/0 conn(0x7f004014b1e0 msgr2=0x7f0040154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:12.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003d59a700 1 --2- 172.21.15.115:0/2874688325 >> v2:172.21.15.159:3300/0 conn(0x7f004014b1e0 0x7f0040154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 >> v1:172.21.15.159:6789/0 conn(0x7f0040063260 legacy=0x7f00400a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040157ff0 con 0x7f004014ae00 2023-07-27T14:35:12.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.050+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f0030001470 con 0x7f004014ae00 2023-07-27T14:35:12.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 >> v1:172.21.15.115:6789/0 conn(0x7f004014ae00 legacy=0x7f0040062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003d59a700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00280038e0 0x7f0028003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003d59a700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0028004240 0x7f00280046f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003d59a700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f002800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0040157d10 con 0x7f0028004ea0 2023-07-27T14:35:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002800be30 con 0x7f0028004240 2023-07-27T14:35:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002800bff0 con 0x7f00280038e0 2023-07-27T14:35:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003ed9d700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f002800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003e59c700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00280038e0 0x7f0028003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003dd9b700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0028004240 0x7f00280046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003ed9d700 1 -- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00280038e0 msgr2=0x7f0028003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:12.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003ed9d700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00280038e0 0x7f0028003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003ed9d700 1 -- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0028004240 msgr2=0x7f00280046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003ed9d700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0028004240 0x7f00280046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003ed9d700 1 -- 172.21.15.115:0/2874688325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00280033f0 con 0x7f0028004ea0 2023-07-27T14:35:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003dd9b700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0028004240 0x7f00280046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003e59c700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00280038e0 0x7f0028003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003ed9d700 1 -- 172.21.15.115:0/2874688325 reap_dead start 2023-07-27T14:35:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.051+0000 7f003ed9d700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f002800b8e0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f00380094d0 tx=0x7f003800b040).ready entity=mon.0 client_cookie=6809ce8717867afc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038009b00 con 0x7f0028004ea0 2023-07-27T14:35:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800f040 con 0x7f0028004ea0 2023-07-27T14:35:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f003d59a700 1 -- 172.21.15.115:0/2874688325 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800ec70 con 0x7f0028004ea0 2023-07-27T14:35:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f00449ff700 1 -- 172.21.15.115:0/2874688325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 msgr2=0x7f002800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f00449ff700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f002800b8e0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f00380094d0 tx=0x7f003800b040).stop 2023-07-27T14:35:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f00449ff700 1 -- 172.21.15.115:0/2874688325 shutdown_connections 2023-07-27T14:35:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f00449ff700 1 --2- 172.21.15.115:0/2874688325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f002800b8e0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f00449ff700 1 -- 172.21.15.115:0/2874688325 >> 172.21.15.115:0/2874688325 conn(0x7f004005e940 msgr2=0x7f00400cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:12.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f00449ff700 1 -- 172.21.15.115:0/2874688325 shutdown_connections 2023-07-27T14:35:12.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.052+0000 7f00449ff700 1 -- 172.21.15.115:0/2874688325 wait complete. 2023-07-27T14:35:12.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.054+0000 7f00449ff700 1 Processor -- start 2023-07-27T14:35:12.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.054+0000 7f00449ff700 1 -- start start 2023-07-27T14:35:12.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f00449ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f0040149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f00449ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00401551c0 0x7f0040155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f00449ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0040150ea0 0x7f0040151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f00449ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0040156a90 con 0x7f0028004ea0 2023-07-27T14:35:12.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f00449ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0040155e80 con 0x7f0040150ea0 2023-07-27T14:35:12.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f00449ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0040156160 con 0x7f00401551c0 2023-07-27T14:35:12.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f003e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f0040149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f003e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f0040149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38296/0 (socket says 172.21.15.115:38296) 2023-07-27T14:35:12.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f003e59c700 1 -- 172.21.15.115:0/3099787164 learned_addr learned my addr 172.21.15.115:0/3099787164 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:12.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f003e59c700 1 -- 172.21.15.115:0/3099787164 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00401551c0 msgr2=0x7f0040155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f003e59c700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00401551c0 0x7f0040155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:12.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f003e59c700 1 -- 172.21.15.115:0/3099787164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0040150ea0 msgr2=0x7f0040151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f003e59c700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0040150ea0 0x7f0040151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:12.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.055+0000 7f003e59c700 1 -- 172.21.15.115:0/3099787164 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040156440 con 0x7f0028004ea0 2023-07-27T14:35:12.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.056+0000 7f003e59c700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f0040149fb0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f0030008fa0 tx=0x7f003000d040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.056+0000 7f002e7fc700 1 -- 172.21.15.115:0/3099787164 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030010040 con 0x7f0028004ea0 2023-07-27T14:35:12.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.056+0000 7f002e7fc700 1 -- 172.21.15.115:0/3099787164 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003000e580 con 0x7f0028004ea0 2023-07-27T14:35:12.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.056+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040156720 con 0x7f0028004ea0 2023-07-27T14:35:12.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.056+0000 7f002e7fc700 1 -- 172.21.15.115:0/3099787164 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000e920 con 0x7f0028004ea0 2023-07-27T14:35:12.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.056+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0040155b30 con 0x7f0028004ea0 2023-07-27T14:35:12.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.057+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004006c470 con 0x7f0028004ea0 2023-07-27T14:35:12.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.058+0000 7f002e7fc700 1 -- 172.21.15.115:0/3099787164 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f003000ecd0 con 0x7f0028004ea0 2023-07-27T14:35:12.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.058+0000 7f002e7fc700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002005f720 0x7f0020061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.059+0000 7f002e7fc700 1 -- 172.21.15.115:0/3099787164 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f003007a650 con 0x7f0028004ea0 2023-07-27T14:35:12.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.059+0000 7f003dd9b700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002005f720 0x7f0020061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.059+0000 7f003dd9b700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002005f720 0x7f0020061be0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f0034000c00 tx=0x7f0034009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.063+0000 7f002e7fc700 1 -- 172.21.15.115:0/3099787164 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f003004b260 con 0x7f0028004ea0 2023-07-27T14:35:12.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.234+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0040063970 con 0x7f0028004ea0 2023-07-27T14:35:12.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.234+0000 7f002e7fc700 1 -- 172.21.15.115:0/3099787164 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f003004e880 con 0x7f0028004ea0 2023-07-27T14:35:12.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.236+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002005f720 msgr2=0x7f0020061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.236+0000 7f00449ff700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002005f720 0x7f0020061be0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f0034000c00 tx=0x7f0034009040).stop 2023-07-27T14:35:12.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.236+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 msgr2=0x7f0040149fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.236+0000 7f00449ff700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f0040149fb0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7f0030008fa0 tx=0x7f003000d040).stop 2023-07-27T14:35:12.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.237+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 shutdown_connections 2023-07-27T14:35:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.237+0000 7f00449ff700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f002005f720 0x7f0020061be0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.237+0000 7f00449ff700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0040150ea0 0x7f0040151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.237+0000 7f00449ff700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0028004ea0 0x7f0040149fb0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.237+0000 7f00449ff700 1 --2- 172.21.15.115:0/3099787164 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f00401551c0 0x7f0040155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.237+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 >> 172.21.15.115:0/3099787164 conn(0x7f004005e940 msgr2=0x7f00401544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.237+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 shutdown_connections 2023-07-27T14:35:12.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.237+0000 7f00449ff700 1 -- 172.21.15.115:0/3099787164 wait complete. 2023-07-27T14:35:12.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000034197 --mode=777 2023-07-27T14:35:12.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.446+0000 7f6e357ff700 1 Processor -- start 2023-07-27T14:35:12.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.446+0000 7f6e357ff700 1 -- start start 2023-07-27T14:35:12.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.447+0000 7f6e357ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6e30063260 0x7f6e30154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.447+0000 7f6e357ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e3014b1e0 0x7f6e300a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e357ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e301553f0 con 0x7f6e3014ae00 2023-07-27T14:35:12.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e357ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e30157a50 con 0x7f6e3014b1e0 2023-07-27T14:35:12.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e357ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e30157d10 con 0x7f6e30063260 2023-07-27T14:35:12.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e2f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e3014b1e0 0x7f6e300a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e2f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e3014b1e0 0x7f6e300a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38298/0 (socket says 172.21.15.115:38298) 2023-07-27T14:35:12.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e2f7fe700 1 -- 172.21.15.115:0/3780115566 learned_addr learned my addr 172.21.15.115:0/3780115566 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:12.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e27fff700 1 --2- 172.21.15.115:0/3780115566 >> v2:172.21.15.159:3300/0 conn(0x7f6e30063260 0x7f6e30154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e2f7fe700 1 -- 172.21.15.115:0/3780115566 >> v2:172.21.15.159:3300/0 conn(0x7f6e30063260 msgr2=0x7f6e30154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:12.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e2f7fe700 1 --2- 172.21.15.115:0/3780115566 >> v2:172.21.15.159:3300/0 conn(0x7f6e30063260 0x7f6e30154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e2f7fe700 1 -- 172.21.15.115:0/3780115566 >> v1:172.21.15.159:6789/0 conn(0x7f6e3014ae00 legacy=0x7f6e30062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:12.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e2f7fe700 1 -- 172.21.15.115:0/3780115566 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30157ff0 con 0x7f6e3014b1e0 2023-07-27T14:35:12.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.448+0000 7f6e2f7fe700 1 --2- 172.21.15.115:0/3780115566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014b1e0 0x7f6e300a98c0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f6e300cbc00 tx=0x7f6e28009840).ready entity=mon.0 client_cookie=5dc771f4aaf8b69d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e2e7fc700 1 -- 172.21.15.115:0/3780115566 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800e070 con 0x7f6e3014b1e0 2023-07-27T14:35:12.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e2e7fc700 1 -- 172.21.15.115:0/3780115566 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2800ba10 con 0x7f6e3014b1e0 2023-07-27T14:35:12.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e2e7fc700 1 -- 172.21.15.115:0/3780115566 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800bd90 con 0x7f6e3014b1e0 2023-07-27T14:35:12.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e357ff700 1 -- 172.21.15.115:0/3780115566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014b1e0 msgr2=0x7f6e300a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e357ff700 1 --2- 172.21.15.115:0/3780115566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014b1e0 0x7f6e300a98c0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f6e300cbc00 tx=0x7f6e28009840).stop 2023-07-27T14:35:12.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e357ff700 1 -- 172.21.15.115:0/3780115566 shutdown_connections 2023-07-27T14:35:12.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e357ff700 1 --2- 172.21.15.115:0/3780115566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014b1e0 0x7f6e300a98c0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e357ff700 1 --2- 172.21.15.115:0/3780115566 >> v2:172.21.15.159:3300/0 conn(0x7f6e30063260 0x7f6e30154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e357ff700 1 -- 172.21.15.115:0/3780115566 >> 172.21.15.115:0/3780115566 conn(0x7f6e3005e940 msgr2=0x7f6e300cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:12.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e357ff700 1 -- 172.21.15.115:0/3780115566 shutdown_connections 2023-07-27T14:35:12.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.449+0000 7f6e357ff700 1 -- 172.21.15.115:0/3780115566 wait complete. 2023-07-27T14:35:12.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.451+0000 7f6e357ff700 1 Processor -- start 2023-07-27T14:35:12.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.451+0000 7f6e357ff700 1 -- start start 2023-07-27T14:35:12.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e357ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e30063260 0x7f6e3014d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e357ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014ae00 0x7f6e301677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e357ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e3014b1e0 0x7f6e30167cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e357ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e301681a0 con 0x7f6e3014ae00 2023-07-27T14:35:12.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e357ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3014d320 con 0x7f6e30063260 2023-07-27T14:35:12.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e357ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3014c710 con 0x7f6e3014b1e0 2023-07-27T14:35:12.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e27fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014ae00 0x7f6e301677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e27fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014ae00 0x7f6e301677c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38312/0 (socket says 172.21.15.115:38312) 2023-07-27T14:35:12.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e27fff700 1 -- 172.21.15.115:0/2345492896 learned_addr learned my addr 172.21.15.115:0/2345492896 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:12.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e2effd700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e30063260 0x7f6e3014d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.452+0000 7f6e2f7fe700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e3014b1e0 0x7f6e30167cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e27fff700 1 -- 172.21.15.115:0/2345492896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e3014b1e0 msgr2=0x7f6e30167cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e27fff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e3014b1e0 0x7f6e30167cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e27fff700 1 -- 172.21.15.115:0/2345492896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e30063260 msgr2=0x7f6e3014d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e27fff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e30063260 0x7f6e3014d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e27fff700 1 -- 172.21.15.115:0/2345492896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28009ae0 con 0x7f6e3014ae00 2023-07-27T14:35:12.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e27fff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014ae00 0x7f6e301677c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f6e1800d860 tx=0x7f6e18008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e26ffd700 1 -- 172.21.15.115:0/2345492896 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18011590 con 0x7f6e3014ae00 2023-07-27T14:35:12.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e26ffd700 1 -- 172.21.15.115:0/2345492896 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e180116f0 con 0x7f6e3014ae00 2023-07-27T14:35:12.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3014c9f0 con 0x7f6e3014ae00 2023-07-27T14:35:12.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e26ffd700 1 -- 172.21.15.115:0/2345492896 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18011a70 con 0x7f6e3014ae00 2023-07-27T14:35:12.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.453+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3014cfb0 con 0x7f6e3014ae00 2023-07-27T14:35:12.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.454+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3014d4b0 con 0x7f6e3014ae00 2023-07-27T14:35:12.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.455+0000 7f6e26ffd700 1 -- 172.21.15.115:0/2345492896 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f6e18012420 con 0x7f6e3014ae00 2023-07-27T14:35:12.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.456+0000 7f6e26ffd700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6e1005f720 0x7f6e10061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.456+0000 7f6e26ffd700 1 -- 172.21.15.115:0/2345492896 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6e1807a590 con 0x7f6e3014ae00 2023-07-27T14:35:12.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.456+0000 7f6e2effd700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6e1005f720 0x7f6e10061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.457+0000 7f6e2effd700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6e1005f720 0x7f6e10061be0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f6e300c7f20 tx=0x7f6e20007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.460+0000 7f6e26ffd700 1 -- 172.21.15.115:0/2345492896 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6e1804b030 con 0x7f6e3014ae00 2023-07-27T14:35:12.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.660+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000034197", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e300c39e0 con 0x7f6e1005f720 2023-07-27T14:35:12.710 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:12.666+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:12.711 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:12.666+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:12.711 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:12.666+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:12.711 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:12.666+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:12.711 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:12.666+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:12.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.699+0000 7f6e26ffd700 1 -- 172.21.15.115:0/2345492896 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6e300c39e0 con 0x7f6e1005f720 2023-07-27T14:35:12.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6e1005f720 msgr2=0x7f6e10061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6e1005f720 0x7f6e10061be0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f6e300c7f20 tx=0x7f6e20007d20).stop 2023-07-27T14:35:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014ae00 msgr2=0x7f6e301677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014ae00 0x7f6e301677c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f6e1800d860 tx=0x7f6e18008040).stop 2023-07-27T14:35:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 shutdown_connections 2023-07-27T14:35:12.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6e1005f720 0x7f6e10061be0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6e3014b1e0 0x7f6e30167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e30063260 0x7f6e3014d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 --2- 172.21.15.115:0/2345492896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e3014ae00 0x7f6e301677c0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.701+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 >> 172.21.15.115:0/2345492896 conn(0x7f6e3005e940 msgr2=0x7f6e300ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:12.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.702+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 shutdown_connections 2023-07-27T14:35:12.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.702+0000 7f6e357ff700 1 -- 172.21.15.115:0/2345492896 wait complete. 2023-07-27T14:35:12.764 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000034197 2023-07-27T14:35:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.912+0000 7f73affff700 1 Processor -- start 2023-07-27T14:35:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.912+0000 7f73affff700 1 -- start start 2023-07-27T14:35:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.913+0000 7f73affff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73a814ae00 0x7f73a8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.913+0000 7f73affff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814b1e0 0x7f73a8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.913+0000 7f73affff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a81553f0 con 0x7f73a80c5c50 2023-07-27T14:35:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.913+0000 7f73affff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a8157a50 con 0x7f73a814ae00 2023-07-27T14:35:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.913+0000 7f73affff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a8157d10 con 0x7f73a814b1e0 2023-07-27T14:35:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.913+0000 7f73add9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73a814ae00 0x7f73a8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.913+0000 7f73add9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73a814ae00 0x7f73a8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38334/0 (socket says 172.21.15.115:38334) 2023-07-27T14:35:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.913+0000 7f73add9b700 1 -- 172.21.15.115:0/3516965975 learned_addr learned my addr 172.21.15.115:0/3516965975 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73ad59a700 1 --2- 172.21.15.115:0/3516965975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814b1e0 0x7f73a8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73add9b700 1 -- 172.21.15.115:0/3516965975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814b1e0 msgr2=0x7f73a8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73add9b700 1 --2- 172.21.15.115:0/3516965975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814b1e0 0x7f73a8062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73add9b700 1 -- 172.21.15.115:0/3516965975 >> v1:172.21.15.159:6789/0 conn(0x7f73a80c5c50 legacy=0x7f73a80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73add9b700 1 -- 172.21.15.115:0/3516965975 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a8157ff0 con 0x7f73a814ae00 2023-07-27T14:35:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73add9b700 1 --2- 172.21.15.115:0/3516965975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a814ae00 0x7f73a8154f00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f73a4006fd0 tx=0x7f73a40090f0).ready entity=mon.0 client_cookie=49a1458d4f3693e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73acd99700 1 -- 172.21.15.115:0/3516965975 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a400b600 con 0x7f73a814ae00 2023-07-27T14:35:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73acd99700 1 -- 172.21.15.115:0/3516965975 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a400b760 con 0x7f73a814ae00 2023-07-27T14:35:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.914+0000 7f73acd99700 1 -- 172.21.15.115:0/3516965975 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a400bae0 con 0x7f73a814ae00 2023-07-27T14:35:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.915+0000 7f73affff700 1 -- 172.21.15.115:0/3516965975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a814ae00 msgr2=0x7f73a8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.915+0000 7f73affff700 1 --2- 172.21.15.115:0/3516965975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a814ae00 0x7f73a8154f00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f73a4006fd0 tx=0x7f73a40090f0).stop 2023-07-27T14:35:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.915+0000 7f73affff700 1 -- 172.21.15.115:0/3516965975 shutdown_connections 2023-07-27T14:35:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.915+0000 7f73affff700 1 --2- 172.21.15.115:0/3516965975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a814ae00 0x7f73a8154f00 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.915+0000 7f73affff700 1 --2- 172.21.15.115:0/3516965975 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814b1e0 0x7f73a8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.915+0000 7f73affff700 1 -- 172.21.15.115:0/3516965975 >> 172.21.15.115:0/3516965975 conn(0x7f73a805e940 msgr2=0x7f73a80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:12.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.915+0000 7f73affff700 1 -- 172.21.15.115:0/3516965975 shutdown_connections 2023-07-27T14:35:12.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.915+0000 7f73affff700 1 -- 172.21.15.115:0/3516965975 wait complete. 2023-07-27T14:35:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.916+0000 7f73affff700 1 Processor -- start 2023-07-27T14:35:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.916+0000 7f73affff700 1 -- start start 2023-07-27T14:35:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.917+0000 7f73affff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a80c5c50 0x7f73a80b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.917+0000 7f73affff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814ae00 0x7f73a80c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.917+0000 7f73affff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a814b1e0 0x7f73a80ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.917+0000 7f73affff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80ca520 con 0x7f73a80c5c50 2023-07-27T14:35:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.917+0000 7f73affff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80b0260 con 0x7f73a814b1e0 2023-07-27T14:35:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.917+0000 7f73affff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80af650 con 0x7f73a814ae00 2023-07-27T14:35:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.917+0000 7f73add9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a80c5c50 0x7f73a80b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73add9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a80c5c50 0x7f73a80b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38346/0 (socket says 172.21.15.115:38346) 2023-07-27T14:35:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73add9b700 1 -- 172.21.15.115:0/3053782335 learned_addr learned my addr 172.21.15.115:0/3053782335 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73ae59c700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a814b1e0 0x7f73a80ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73ad59a700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814ae00 0x7f73a80c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73add9b700 1 -- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814ae00 msgr2=0x7f73a80c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73add9b700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814ae00 0x7f73a80c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73add9b700 1 -- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a814b1e0 msgr2=0x7f73a80ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73add9b700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a814b1e0 0x7f73a80ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73add9b700 1 -- 172.21.15.115:0/3053782335 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4009370 con 0x7f73a80c5c50 2023-07-27T14:35:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73ae59c700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a814b1e0 0x7f73a80ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73add9b700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a80c5c50 0x7f73a80b06f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f73a4009f50 tx=0x7f73a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f739dffb700 1 -- 172.21.15.115:0/3053782335 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a400b8d0 con 0x7f73a80c5c50 2023-07-27T14:35:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f739dffb700 1 -- 172.21.15.115:0/3053782335 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a400ba30 con 0x7f73a80c5c50 2023-07-27T14:35:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a80af930 con 0x7f73a80c5c50 2023-07-27T14:35:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.918+0000 7f739dffb700 1 -- 172.21.15.115:0/3053782335 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a401c670 con 0x7f73a80c5c50 2023-07-27T14:35:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.919+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a80afef0 con 0x7f73a80c5c50 2023-07-27T14:35:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.919+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a8158600 con 0x7f73a80c5c50 2023-07-27T14:35:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.920+0000 7f739dffb700 1 -- 172.21.15.115:0/3053782335 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 76602+0+0 (secure 0 0 0) 0x7f73a400f070 con 0x7f73a80c5c50 2023-07-27T14:35:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.921+0000 7f739dffb700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f738c05f720 0x7f738c061be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.921+0000 7f739dffb700 1 -- 172.21.15.115:0/3053782335 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f73a407be50 con 0x7f73a80c5c50 2023-07-27T14:35:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.922+0000 7f73ad59a700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f738c05f720 0x7f738c061be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:12.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.922+0000 7f73ad59a700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f738c05f720 0x7f738c061be0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f7398006fd0 tx=0x7f7398008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:12.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:12.926+0000 7f739dffb700 1 -- 172.21.15.115:0/3053782335 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73a404cd70 con 0x7f73a80c5c50 2023-07-27T14:35:13.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.126+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000034197", "target": ["mon-mgr", ""]}) v1 -- 0x7f73a806c470 con 0x7f738c05f720 2023-07-27T14:35:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.130+0000 7f739dffb700 1 -- 172.21.15.115:0/3053782335 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f73a806c470 con 0x7f738c05f720 2023-07-27T14:35:13.175 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11 2023-07-27T14:35:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.132+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f738c05f720 msgr2=0x7f738c061be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f738c05f720 0x7f738c061be0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f7398006fd0 tx=0x7f7398008040).stop 2023-07-27T14:35:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a80c5c50 msgr2=0x7f73a80b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a80c5c50 0x7f73a80b06f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f73a4009f50 tx=0x7f73a4017000).stop 2023-07-27T14:35:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 shutdown_connections 2023-07-27T14:35:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f738c05f720 0x7f738c061be0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73a814b1e0 0x7f73a80ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a80c5c50 0x7f73a80b06f0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 --2- 172.21.15.115:0/3053782335 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73a814ae00 0x7f73a80c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 >> 172.21.15.115:0/3053782335 conn(0x7f73a805e940 msgr2=0x7f73a814a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 shutdown_connections 2023-07-27T14:35:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:13.133+0000 7f73affff700 1 -- 172.21.15.115:0/3053782335 wait complete. 2023-07-27T14:35:13.194 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000034197 with 64 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11 2023-07-27T14:35:13.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.195 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.266 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.267 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.267 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174798 s, 60.0 MB/s 2023-07-27T14:35:13.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.269 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.340 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.340 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.341 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235256 s, 44.6 MB/s 2023-07-27T14:35:13.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.342 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.403 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.403 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.404 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014813 s, 70.8 MB/s 2023-07-27T14:35:13.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.405 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144687 s, 72.5 MB/s 2023-07-27T14:35:13.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.468 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.530 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.530 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.530 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151511 s, 69.2 MB/s 2023-07-27T14:35:13.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.532 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.595 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.595 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.595 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167626 s, 62.6 MB/s 2023-07-27T14:35:13.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.597 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.656 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.657 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.657 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134333 s, 78.1 MB/s 2023-07-27T14:35:13.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.658 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.718 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.719 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.719 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137714 s, 76.1 MB/s 2023-07-27T14:35:13.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.720 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.780 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013626 s, 77.0 MB/s 2023-07-27T14:35:13.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.782 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.843 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.844 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.844 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150201 s, 69.8 MB/s 2023-07-27T14:35:13.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.845 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.906 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.907 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.907 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014834 s, 70.7 MB/s 2023-07-27T14:35:13.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.908 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:13.968 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125896 s, 83.3 MB/s 2023-07-27T14:35:13.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:13.969 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141513 s, 74.1 MB/s 2023-07-27T14:35:14.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.031 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.094 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.095 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.095 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173467 s, 60.4 MB/s 2023-07-27T14:35:14.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.096 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.156 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.157 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.157 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133326 s, 78.6 MB/s 2023-07-27T14:35:14.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.158 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.218 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.218 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.218 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136686 s, 76.7 MB/s 2023-07-27T14:35:14.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.220 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.281 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.281 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.281 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150302 s, 69.8 MB/s 2023-07-27T14:35:14.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.283 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.342 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.342 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.342 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133964 s, 78.3 MB/s 2023-07-27T14:35:14.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.343 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.408 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.408 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.408 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180557 s, 58.1 MB/s 2023-07-27T14:35:14.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.410 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.475 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.476 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.476 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191222 s, 54.8 MB/s 2023-07-27T14:35:14.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.478 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.538 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.539 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.539 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145735 s, 72.0 MB/s 2023-07-27T14:35:14.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.540 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.604 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.604 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.604 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017389 s, 60.3 MB/s 2023-07-27T14:35:14.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.606 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.669 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.669 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.670 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169959 s, 61.7 MB/s 2023-07-27T14:35:14.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.671 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.731 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.732 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143887 s, 72.9 MB/s 2023-07-27T14:35:14.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.733 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.795 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.795 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.795 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151799 s, 69.1 MB/s 2023-07-27T14:35:14.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.797 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.857 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.857 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.857 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142466 s, 73.6 MB/s 2023-07-27T14:35:14.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.858 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.918 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.918 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.919 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129025 s, 81.3 MB/s 2023-07-27T14:35:14.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.920 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:14.980 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:14.981 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:14.981 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013921 s, 75.3 MB/s 2023-07-27T14:35:14.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:14.982 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137407 s, 76.3 MB/s 2023-07-27T14:35:15.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.044 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.106 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.106 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.106 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154188 s, 68.0 MB/s 2023-07-27T14:35:15.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.108 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.169 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.170 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.170 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158234 s, 66.3 MB/s 2023-07-27T14:35:15.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.171 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139271 s, 75.3 MB/s 2023-07-27T14:35:15.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.234 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.294 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.294 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.294 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132985 s, 78.8 MB/s 2023-07-27T14:35:15.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.296 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.357 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.358 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.358 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153932 s, 68.1 MB/s 2023-07-27T14:35:15.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.359 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.420 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.420 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.420 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139381 s, 75.2 MB/s 2023-07-27T14:35:15.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.421 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.481 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.481 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.481 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132411 s, 79.2 MB/s 2023-07-27T14:35:15.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.483 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.547 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.547 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.547 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017155 s, 61.1 MB/s 2023-07-27T14:35:15.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.549 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.610 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.611 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.611 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141184 s, 74.3 MB/s 2023-07-27T14:35:15.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.612 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.676 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.676 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.676 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170065 s, 61.7 MB/s 2023-07-27T14:35:15.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.678 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.742 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01832 s, 57.2 MB/s 2023-07-27T14:35:15.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.744 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.804 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.805 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.805 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141821 s, 73.9 MB/s 2023-07-27T14:35:15.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.806 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.868 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.869 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.869 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152085 s, 68.9 MB/s 2023-07-27T14:35:15.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.870 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.929 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.929 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.929 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127967 s, 81.9 MB/s 2023-07-27T14:35:15.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.931 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:15.991 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:15.991 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:15.991 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141275 s, 74.2 MB/s 2023-07-27T14:35:15.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:15.992 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.053 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145755 s, 71.9 MB/s 2023-07-27T14:35:16.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.055 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.113 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.114 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.114 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129922 s, 80.7 MB/s 2023-07-27T14:35:16.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.115 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.177 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.177 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.177 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153029 s, 68.5 MB/s 2023-07-27T14:35:16.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.180 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.243 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.243 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.243 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150887 s, 69.5 MB/s 2023-07-27T14:35:16.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.245 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.309 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.309 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.309 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183516 s, 57.1 MB/s 2023-07-27T14:35:16.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.310 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.370 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.370 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.370 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139038 s, 75.4 MB/s 2023-07-27T14:35:16.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.372 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.434 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.434 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.434 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169717 s, 61.8 MB/s 2023-07-27T14:35:16.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.436 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.496 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.499 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.500 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144175 s, 72.7 MB/s 2023-07-27T14:35:16.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.502 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.567 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.567 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.567 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181485 s, 57.8 MB/s 2023-07-27T14:35:16.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.568 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.630 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.631 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.631 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156792 s, 66.9 MB/s 2023-07-27T14:35:16.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.632 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.698 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195522 s, 53.6 MB/s 2023-07-27T14:35:16.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.700 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.760 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.760 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.761 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138972 s, 75.5 MB/s 2023-07-27T14:35:16.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.762 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.826 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.826 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.826 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169474 s, 61.9 MB/s 2023-07-27T14:35:16.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.828 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.889 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.889 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.890 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141093 s, 74.3 MB/s 2023-07-27T14:35:16.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.892 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:16.953 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:16.954 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:16.954 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132603 s, 79.1 MB/s 2023-07-27T14:35:16.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:16.955 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118357 s, 88.6 MB/s 2023-07-27T14:35:17.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:17.017 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:17.078 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:17.078 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:17.079 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145605 s, 72.0 MB/s 2023-07-27T14:35:17.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:17.080 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:17.139 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:17.139 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:17.139 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129593 s, 80.9 MB/s 2023-07-27T14:35:17.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:17.141 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:17.201 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:17.201 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:17.201 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133193 s, 78.7 MB/s 2023-07-27T14:35:17.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:17.203 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:35:17.263 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:35:17.263 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:35:17.263 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136396 s, 76.9 MB/s 2023-07-27T14:35:17.264 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000034197 snapshot_0000000000402213 2023-07-27T14:35:17.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.415+0000 7f5ee23ff700 1 Processor -- start 2023-07-27T14:35:17.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.415+0000 7f5ee23ff700 1 -- start start 2023-07-27T14:35:17.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.416+0000 7f5ee23ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc063260 0x7f5edc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5ee23ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc1553f0 con 0x7f5edc14ae00 2023-07-27T14:35:17.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5ee23ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc157a50 con 0x7f5edc14b1e0 2023-07-27T14:35:17.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5ee23ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc157d10 con 0x7f5edc063260 2023-07-27T14:35:17.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5edbfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5edc14ae00 0x7f5edc062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36600/0 (socket says 172.21.15.115:36600) 2023-07-27T14:35:17.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5edbfff700 1 -- 172.21.15.115:0/3098607518 learned_addr learned my addr 172.21.15.115:0/3098607518 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:17.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073090457 0 0) 0x7f5edc1553f0 con 0x7f5edc14ae00 2023-07-27T14:35:17.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5edb7fe700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc063260 0x7f5edc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec40033f0 con 0x7f5edc14ae00 2023-07-27T14:35:17.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979375871 0 0) 0x7f5ec40033f0 con 0x7f5edc14ae00 2023-07-27T14:35:17.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc063260 msgr2=0x7f5edc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:17.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.417+0000 7f5edaffd700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc063260 0x7f5edc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 >> v1:172.21.15.159:6789/0 conn(0x7f5edc14b1e0 legacy=0x7f5edc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc157ff0 con 0x7f5edc14ae00 2023-07-27T14:35:17.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f5ecc001470 con 0x7f5edc14ae00 2023-07-27T14:35:17.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 >> v1:172.21.15.115:6789/0 conn(0x7f5edc14ae00 legacy=0x7f5edc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec4003910 0x7f5ec4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4004690 0x7f5ec4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc063260 0x7f5ec4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc157d10 con 0x7f5ec4003910 2023-07-27T14:35:17.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec400b910 con 0x7f5ec4004690 2023-07-27T14:35:17.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec400bad0 con 0x7f5edc063260 2023-07-27T14:35:17.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edbfff700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec4003910 0x7f5ec4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edb7fe700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4004690 0x7f5ec4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5ee099c700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc063260 0x7f5ec4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edbfff700 1 -- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc063260 msgr2=0x7f5ec4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:17.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edbfff700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc063260 0x7f5ec4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edbfff700 1 -- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4004690 msgr2=0x7f5ec4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:17.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edbfff700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4004690 0x7f5ec4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.418+0000 7f5edbfff700 1 -- 172.21.15.115:0/3098607518 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40033f0 con 0x7f5ec4003910 2023-07-27T14:35:17.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5edbfff700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec4003910 0x7f5ec4003d30 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f5ecc00c160 tx=0x7f5edc14eb20).ready entity=mon.0 client_cookie=405332772ae0c3fa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:17.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00ca90 con 0x7f5ec4003910 2023-07-27T14:35:17.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc00cbf0 con 0x7f5ec4003910 2023-07-27T14:35:17.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5edaffd700 1 -- 172.21.15.115:0/3098607518 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0070d0 con 0x7f5ec4003910 2023-07-27T14:35:17.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3098607518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec4003910 msgr2=0x7f5ec4003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5ee23ff700 1 --2- 172.21.15.115:0/3098607518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ec4003910 0x7f5ec4003d30 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f5ecc00c160 tx=0x7f5edc14eb20).stop 2023-07-27T14:35:17.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5ee099c700 1 -- 172.21.15.115:0/3098607518 reap_dead start 2023-07-27T14:35:17.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3098607518 shutdown_connections 2023-07-27T14:35:17.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3098607518 >> 172.21.15.115:0/3098607518 conn(0x7f5edc05e940 msgr2=0x7f5edc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:17.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3098607518 shutdown_connections 2023-07-27T14:35:17.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.419+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3098607518 wait complete. 2023-07-27T14:35:17.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.421+0000 7f5ee23ff700 1 Processor -- start 2023-07-27T14:35:17.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.421+0000 7f5ee23ff700 1 -- start start 2023-07-27T14:35:17.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5ee23ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4003910 0x7f5edc0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5ee23ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5edc168320 0x7f5edc0c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5ee23ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc150a50 0x7f5edc0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5ee23ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc167880 con 0x7f5edc168320 2023-07-27T14:35:17.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5ee23ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0c2e20 con 0x7f5ec4003910 2023-07-27T14:35:17.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5ee23ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc167b20 con 0x7f5edc150a50 2023-07-27T14:35:17.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5edb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5edc168320 0x7f5edc0c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5edb7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5edc168320 0x7f5edc0c25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37586/0 (socket says 172.21.15.115:37586) 2023-07-27T14:35:17.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5edb7fe700 1 -- 172.21.15.115:0/3565386334 learned_addr learned my addr 172.21.15.115:0/3565386334 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:17.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5ee099c700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc150a50 0x7f5edc0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.422+0000 7f5edbfff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4003910 0x7f5edc0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5edb7fe700 1 -- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc150a50 msgr2=0x7f5edc0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5edb7fe700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc150a50 0x7f5edc0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5edb7fe700 1 -- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4003910 msgr2=0x7f5edc0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5edb7fe700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4003910 0x7f5edc0c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5edb7fe700 1 -- 172.21.15.115:0/3565386334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc167e00 con 0x7f5edc168320 2023-07-27T14:35:17.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5ee099c700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc150a50 0x7f5edc0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:17.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5edb7fe700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5edc168320 0x7f5edc0c25d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f5ed00119f0 tx=0x7f5ed0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:17.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5ec3fff700 1 -- 172.21.15.115:0/3565386334 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0009520 con 0x7f5edc168320 2023-07-27T14:35:17.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5ec3fff700 1 -- 172.21.15.115:0/3565386334 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000f940 con 0x7f5edc168320 2023-07-27T14:35:17.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5ec3fff700 1 -- 172.21.15.115:0/3565386334 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000fcc0 con 0x7f5edc168320 2023-07-27T14:35:17.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc0c3100 con 0x7f5edc168320 2023-07-27T14:35:17.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.423+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc150ed0 con 0x7f5edc168320 2023-07-27T14:35:17.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.424+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc168170 con 0x7f5edc168320 2023-07-27T14:35:17.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.425+0000 7f5ec3fff700 1 -- 172.21.15.115:0/3565386334 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 76642+0+0 (secure 0 0 0) 0x7f5ed0024070 con 0x7f5edc168320 2023-07-27T14:35:17.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.426+0000 7f5ec3fff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ec805f760 0x7f5ec8061c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.426+0000 7f5ec3fff700 1 -- 172.21.15.115:0/3565386334 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ed007b110 con 0x7f5edc168320 2023-07-27T14:35:17.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.426+0000 7f5edbfff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ec805f760 0x7f5ec8061c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.426+0000 7f5edbfff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ec805f760 0x7f5ec8061c20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f5ecc007e70 tx=0x7f5ecc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:17.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.430+0000 7f5ec3fff700 1 -- 172.21.15.115:0/3565386334 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ed004fa10 con 0x7f5edc168320 2023-07-27T14:35:17.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.637+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000034197", "snap_name": "snapshot_0000000000402213", "target": ["mon-mgr", ""]}) v1 -- 0x7f5edc167f90 con 0x7f5ec805f760 2023-07-27T14:35:17.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.658+0000 7f5ec3fff700 1 -- 172.21.15.115:0/3565386334 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5edc167f90 con 0x7f5ec805f760 2023-07-27T14:35:17.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ec805f760 msgr2=0x7f5ec8061c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ec805f760 0x7f5ec8061c20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f5ecc007e70 tx=0x7f5ecc015000).stop 2023-07-27T14:35:17.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5edc168320 msgr2=0x7f5edc0c25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5edc168320 0x7f5edc0c25d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f5ed00119f0 tx=0x7f5ed0009060).stop 2023-07-27T14:35:17.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 shutdown_connections 2023-07-27T14:35:17.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ec805f760 0x7f5ec8061c20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5edc150a50 0x7f5edc0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ec4003910 0x7f5edc0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 --2- 172.21.15.115:0/3565386334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5edc168320 0x7f5edc0c25d0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.661+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 >> 172.21.15.115:0/3565386334 conn(0x7f5edc05e940 msgr2=0x7f5edc0640b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:17.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.662+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 shutdown_connections 2023-07-27T14:35:17.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.662+0000 7f5ee23ff700 1 -- 172.21.15.115:0/3565386334 wait complete. 2023-07-27T14:35:17.733 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 2 2023-07-27T14:35:17.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.878+0000 7f1d76fff700 1 Processor -- start 2023-07-27T14:35:17.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.879+0000 7f1d76fff700 1 -- start start 2023-07-27T14:35:17.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d76fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d70151330 0x7f1d700c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d76fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1d700c3480 0x7f1d700c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d76fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700c2e70 con 0x7f1d701340b0 2023-07-27T14:35:17.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d76fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7014b890 con 0x7f1d700c3480 2023-07-27T14:35:17.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d76fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700c68e0 con 0x7f1d70151330 2023-07-27T14:35:17.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d74d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1d701340b0 0x7f1d700660e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36614/0 (socket says 172.21.15.115:36614) 2023-07-27T14:35:17.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d74d9b700 1 -- 172.21.15.115:0/1000771599 learned_addr learned my addr 172.21.15.115:0/1000771599 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:17.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929900085 0 0) 0x7f1d64001290 con 0x7f1d701340b0 2023-07-27T14:35:17.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d600033f0 con 0x7f1d701340b0 2023-07-27T14:35:17.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d7559c700 1 --2- 172.21.15.115:0/1000771599 >> v2:172.21.15.159:3300/0 conn(0x7f1d700c3480 0x7f1d700c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.880+0000 7f1d6ffff700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d70151330 0x7f1d700c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4232838473 0 0) 0x7f1d600033f0 con 0x7f1d701340b0 2023-07-27T14:35:17.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d70151330 msgr2=0x7f1d700c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:17.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d70151330 0x7f1d700c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 >> v2:172.21.15.159:3300/0 conn(0x7f1d700c3480 msgr2=0x7f1d700c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:17.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 --2- 172.21.15.115:0/1000771599 >> v2:172.21.15.159:3300/0 conn(0x7f1d700c3480 0x7f1d700c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d701517b0 con 0x7f1d701340b0 2023-07-27T14:35:17.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1d64001780 con 0x7f1d701340b0 2023-07-27T14:35:17.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d7559c700 1 --2- 172.21.15.115:0/1000771599 >> v2:172.21.15.159:3300/0 conn(0x7f1d700c3480 0x7f1d700c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:17.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 >> v1:172.21.15.115:6789/0 conn(0x7f1d701340b0 legacy=0x7f1d700660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d600038e0 0x7f1d60003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d60004690 0x7f1d60004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d70151330 0x7f1d60005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7014b890 con 0x7f1d600038e0 2023-07-27T14:35:17.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700c68e0 con 0x7f1d60004690 2023-07-27T14:35:17.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6000b8e0 con 0x7f1d70151330 2023-07-27T14:35:17.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d74d9b700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d600038e0 0x7f1d60003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d6ffff700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d60004690 0x7f1d60004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.881+0000 7f1d7559c700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d70151330 0x7f1d60005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d74d9b700 1 -- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d70151330 msgr2=0x7f1d60005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:17.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d74d9b700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d70151330 0x7f1d60005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d74d9b700 1 -- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d60004690 msgr2=0x7f1d60004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:17.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d74d9b700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d60004690 0x7f1d60004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d74d9b700 1 -- 172.21.15.115:0/1000771599 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d600033f0 con 0x7f1d600038e0 2023-07-27T14:35:17.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d74d9b700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d600038e0 0x7f1d60003d00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f1d6400c3c0 tx=0x7f1d64007930).ready entity=mon.0 client_cookie=38334c497ede66b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:17.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64007b60 con 0x7f1d600038e0 2023-07-27T14:35:17.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6400cc30 con 0x7f1d600038e0 2023-07-27T14:35:17.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d6f7fe700 1 -- 172.21.15.115:0/1000771599 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640070d0 con 0x7f1d600038e0 2023-07-27T14:35:17.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d76fff700 1 -- 172.21.15.115:0/1000771599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d600038e0 msgr2=0x7f1d60003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d76fff700 1 --2- 172.21.15.115:0/1000771599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d600038e0 0x7f1d60003d00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f1d6400c3c0 tx=0x7f1d64007930).stop 2023-07-27T14:35:17.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.882+0000 7f1d7559c700 1 -- 172.21.15.115:0/1000771599 reap_dead start 2023-07-27T14:35:17.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.883+0000 7f1d76fff700 1 -- 172.21.15.115:0/1000771599 shutdown_connections 2023-07-27T14:35:17.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.883+0000 7f1d76fff700 1 -- 172.21.15.115:0/1000771599 >> 172.21.15.115:0/1000771599 conn(0x7f1d700c79a0 msgr2=0x7f1d700c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:17.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.883+0000 7f1d76fff700 1 -- 172.21.15.115:0/1000771599 shutdown_connections 2023-07-27T14:35:17.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.883+0000 7f1d76fff700 1 -- 172.21.15.115:0/1000771599 wait complete. 2023-07-27T14:35:17.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.884+0000 7f1d76fff700 1 Processor -- start 2023-07-27T14:35:17.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.884+0000 7f1d76fff700 1 -- start start 2023-07-27T14:35:17.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.885+0000 7f1d76fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d600038e0 0x7f1d700aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.885+0000 7f1d76fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d701347e0 0x7f1d70163c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.885+0000 7f1d76fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d701499c0 0x7f1d70149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.885+0000 7f1d76fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701350d0 con 0x7f1d701499c0 2023-07-27T14:35:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.885+0000 7f1d76fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70135690 con 0x7f1d600038e0 2023-07-27T14:35:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.885+0000 7f1d76fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7014a310 con 0x7f1d701347e0 2023-07-27T14:35:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d701499c0 0x7f1d70149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d701499c0 0x7f1d70149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37608/0 (socket says 172.21.15.115:37608) 2023-07-27T14:35:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 -- 172.21.15.115:0/4187550962 learned_addr learned my addr 172.21.15.115:0/4187550962 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d74d9b700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d600038e0 0x7f1d700aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d6ffff700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d701347e0 0x7f1d70163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 -- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d701347e0 msgr2=0x7f1d70163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d701347e0 0x7f1d70163c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 -- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d600038e0 msgr2=0x7f1d700aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:17.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d600038e0 0x7f1d700aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:17.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 -- 172.21.15.115:0/4187550962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700ad4a0 con 0x7f1d701499c0 2023-07-27T14:35:17.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d74d9b700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d600038e0 0x7f1d700aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:17.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d7559c700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d701499c0 0x7f1d70149e20 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f1d7014ef30 tx=0x7f1d680097d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:17.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d6cff9700 1 -- 172.21.15.115:0/4187550962 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68010bf0 con 0x7f1d701499c0 2023-07-27T14:35:17.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d6cff9700 1 -- 172.21.15.115:0/4187550962 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d68010d50 con 0x7f1d701499c0 2023-07-27T14:35:17.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d6cff9700 1 -- 172.21.15.115:0/4187550962 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68015650 con 0x7f1d701499c0 2023-07-27T14:35:17.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.886+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d700ad780 con 0x7f1d701499c0 2023-07-27T14:35:17.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.887+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d70164100 con 0x7f1d701499c0 2023-07-27T14:35:17.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.887+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d70135820 con 0x7f1d701499c0 2023-07-27T14:35:17.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.888+0000 7f1d6cff9700 1 -- 172.21.15.115:0/4187550962 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 76642+0+0 (secure 0 0 0) 0x7f1d68015a00 con 0x7f1d701499c0 2023-07-27T14:35:17.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.890+0000 7f1d6cff9700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d5405f760 0x7f1d54061c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:17.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.890+0000 7f1d6cff9700 1 -- 172.21.15.115:0/4187550962 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1d6807b3e0 con 0x7f1d701499c0 2023-07-27T14:35:17.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.890+0000 7f1d74d9b700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d5405f760 0x7f1d54061c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:17.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.891+0000 7f1d74d9b700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d5405f760 0x7f1d54061c20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f1d6400cfd0 tx=0x7f1d64015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:17.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:17.894+0000 7f1d6cff9700 1 -- 172.21.15.115:0/4187550962 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d6804bea0 con 0x7f1d701499c0 2023-07-27T14:35:18.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.063+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f1d7006c470 con 0x7f1d701499c0 2023-07-27T14:35:18.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.067+0000 7f1d6cff9700 1 -- 172.21.15.115:0/4187550962 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v27)=0 v27) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1d6804f4c0 con 0x7f1d701499c0 2023-07-27T14:35:18.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d5405f760 msgr2=0x7f1d54061c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d5405f760 0x7f1d54061c20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f1d6400cfd0 tx=0x7f1d64015000).stop 2023-07-27T14:35:18.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d701499c0 msgr2=0x7f1d70149e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d701499c0 0x7f1d70149e20 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f1d7014ef30 tx=0x7f1d680097d0).stop 2023-07-27T14:35:18.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 shutdown_connections 2023-07-27T14:35:18.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d5405f760 0x7f1d54061c20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d701499c0 0x7f1d70149e20 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d600038e0 0x7f1d700aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 --2- 172.21.15.115:0/4187550962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d701347e0 0x7f1d70163c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.069+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 >> 172.21.15.115:0/4187550962 conn(0x7f1d700c79a0 msgr2=0x7f1d7014adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:18.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.070+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 shutdown_connections 2023-07-27T14:35:18.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.070+0000 7f1d76fff700 1 -- 172.21.15.115:0/4187550962 wait complete. 2023-07-27T14:35:18.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000034197 snapshot_0000000000402213 clone_0000000000185025 2023-07-27T14:35:18.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.281+0000 7fbe997ff700 1 Processor -- start 2023-07-27T14:35:18.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.281+0000 7fbe997ff700 1 -- start start 2023-07-27T14:35:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe997ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe9413a730 0x7fbe94065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe997ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbe940c36b0 0x7fbe941585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe997ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe940bd9a0 con 0x7fbe9413a350 2023-07-27T14:35:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe997ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe94066400 con 0x7fbe9413a730 2023-07-27T14:35:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe997ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe94158ae0 con 0x7fbe940c36b0 2023-07-27T14:35:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe927fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe9413a730 0x7fbe94065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe92ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbe9413a350 0x7fbe940c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36620/0 (socket says 172.21.15.115:36620) 2023-07-27T14:35:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe927fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe9413a730 0x7fbe94065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37618/0 (socket says 172.21.15.115:37618) 2023-07-27T14:35:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.282+0000 7fbe92ffd700 1 -- 172.21.15.115:0/2688962541 learned_addr learned my addr 172.21.15.115:0/2688962541 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:18.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe937fe700 1 --2- 172.21.15.115:0/2688962541 >> v2:172.21.15.159:3300/0 conn(0x7fbe940c36b0 0x7fbe941585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe927fc700 1 -- 172.21.15.115:0/2688962541 >> v2:172.21.15.159:3300/0 conn(0x7fbe940c36b0 msgr2=0x7fbe941585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:18.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe927fc700 1 --2- 172.21.15.115:0/2688962541 >> v2:172.21.15.159:3300/0 conn(0x7fbe940c36b0 0x7fbe941585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe91ffb700 1 -- 172.21.15.115:0/2688962541 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531660096 0 0) 0x7fbe940bd9a0 con 0x7fbe9413a350 2023-07-27T14:35:18.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe927fc700 1 -- 172.21.15.115:0/2688962541 >> v1:172.21.15.115:6789/0 conn(0x7fbe9413a350 legacy=0x7fbe940c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe927fc700 1 -- 172.21.15.115:0/2688962541 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe94066610 con 0x7fbe9413a730 2023-07-27T14:35:18.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe937fe700 1 --2- 172.21.15.115:0/2688962541 >> v2:172.21.15.159:3300/0 conn(0x7fbe940c36b0 0x7fbe941585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:18.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe927fc700 1 --2- 172.21.15.115:0/2688962541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94065f10 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fbe94066f80 tx=0x7fbe88009060).ready entity=mon.0 client_cookie=5b284081f2a68fae server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe91ffb700 1 -- 172.21.15.115:0/2688962541 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800b580 con 0x7fbe9413a730 2023-07-27T14:35:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe91ffb700 1 -- 172.21.15.115:0/2688962541 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800b6e0 con 0x7fbe9413a730 2023-07-27T14:35:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.283+0000 7fbe91ffb700 1 -- 172.21.15.115:0/2688962541 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800ba60 con 0x7fbe9413a730 2023-07-27T14:35:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.284+0000 7fbe997ff700 1 -- 172.21.15.115:0/2688962541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 msgr2=0x7fbe94065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.284+0000 7fbe997ff700 1 --2- 172.21.15.115:0/2688962541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94065f10 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fbe94066f80 tx=0x7fbe88009060).stop 2023-07-27T14:35:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.284+0000 7fbe997ff700 1 -- 172.21.15.115:0/2688962541 shutdown_connections 2023-07-27T14:35:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.284+0000 7fbe997ff700 1 --2- 172.21.15.115:0/2688962541 >> v2:172.21.15.159:3300/0 conn(0x7fbe940c36b0 0x7fbe941585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.284+0000 7fbe997ff700 1 --2- 172.21.15.115:0/2688962541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94065f10 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.284+0000 7fbe997ff700 1 -- 172.21.15.115:0/2688962541 >> 172.21.15.115:0/2688962541 conn(0x7fbe9405e8f0 msgr2=0x7fbe940c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:18.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.284+0000 7fbe997ff700 1 -- 172.21.15.115:0/2688962541 shutdown_connections 2023-07-27T14:35:18.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.284+0000 7fbe997ff700 1 -- 172.21.15.115:0/2688962541 wait complete. 2023-07-27T14:35:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.285+0000 7fbe997ff700 1 Processor -- start 2023-07-27T14:35:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.286+0000 7fbe997ff700 1 -- start start 2023-07-27T14:35:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.286+0000 7fbe997ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe940c36b0 0x7fbe940c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.286+0000 7fbe997ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9413a350 0x7fbe940c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.286+0000 7fbe997ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.286+0000 7fbe997ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940c7150 con 0x7fbe9413a730 2023-07-27T14:35:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.286+0000 7fbe997ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94146180 con 0x7fbe940c36b0 2023-07-27T14:35:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.286+0000 7fbe997ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94146460 con 0x7fbe9413a350 2023-07-27T14:35:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94167c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37632/0 (socket says 172.21.15.115:37632) 2023-07-27T14:35:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 -- 172.21.15.115:0/3975038837 learned_addr learned my addr 172.21.15.115:0/3975038837 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe927fc700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9413a350 0x7fbe940c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe92ffd700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe940c36b0 0x7fbe940c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 -- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9413a350 msgr2=0x7fbe940c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9413a350 0x7fbe940c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 -- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe940c36b0 msgr2=0x7fbe940c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe940c36b0 0x7fbe940c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 -- 172.21.15.115:0/3975038837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880092a0 con 0x7fbe9413a730 2023-07-27T14:35:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe92ffd700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe940c36b0 0x7fbe940c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:35:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.287+0000 7fbe937fe700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94167c70 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fbe8c00d150 tx=0x7fbe8c009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.288+0000 7fbe7affd700 1 -- 172.21.15.115:0/3975038837 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00dce0 con 0x7fbe9413a730 2023-07-27T14:35:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.288+0000 7fbe7affd700 1 -- 172.21.15.115:0/3975038837 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c00f040 con 0x7fbe9413a730 2023-07-27T14:35:18.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.288+0000 7fbe7affd700 1 -- 172.21.15.115:0/3975038837 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c013600 con 0x7fbe9413a730 2023-07-27T14:35:18.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.288+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe94146740 con 0x7fbe9413a730 2023-07-27T14:35:18.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.288+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe94146d00 con 0x7fbe9413a730 2023-07-27T14:35:18.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.289+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9406c470 con 0x7fbe9413a730 2023-07-27T14:35:18.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.290+0000 7fbe7affd700 1 -- 172.21.15.115:0/3975038837 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 76642+0+0 (secure 0 0 0) 0x7fbe8c0139f0 con 0x7fbe9413a730 2023-07-27T14:35:18.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.291+0000 7fbe7affd700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe8005f760 0x7fbe80061c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.291+0000 7fbe7affd700 1 -- 172.21.15.115:0/3975038837 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbe8c07b3d0 con 0x7fbe9413a730 2023-07-27T14:35:18.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.291+0000 7fbe92ffd700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe8005f760 0x7fbe80061c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.291+0000 7fbe92ffd700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe8005f760 0x7fbe80061c20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fbe84007fd0 tx=0x7fbe84009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:18.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.294+0000 7fbe7affd700 1 -- 172.21.15.115:0/3975038837 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe8c04be90 con 0x7fbe9413a730 2023-07-27T14:35:18.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.500+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000034197", "snap_name": "snapshot_0000000000402213", "target_sub_name": "clone_0000000000185025", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe940bdc10 con 0x7fbe8005f760 2023-07-27T14:35:18.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.576+0000 7fbe7affd700 1 -- 172.21.15.115:0/3975038837 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbe940bdc10 con 0x7fbe8005f760 2023-07-27T14:35:18.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe8005f760 msgr2=0x7fbe80061c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe8005f760 0x7fbe80061c20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fbe84007fd0 tx=0x7fbe84009040).stop 2023-07-27T14:35:18.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 msgr2=0x7fbe94167c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94167c70 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fbe8c00d150 tx=0x7fbe8c009a50).stop 2023-07-27T14:35:18.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 shutdown_connections 2023-07-27T14:35:18.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe8005f760 0x7fbe80061c20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9413a730 0x7fbe94167c70 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe940c36b0 0x7fbe940c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 --2- 172.21.15.115:0/3975038837 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9413a350 0x7fbe940c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 >> 172.21.15.115:0/3975038837 conn(0x7fbe9405e8f0 msgr2=0x7fbe940c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:18.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 shutdown_connections 2023-07-27T14:35:18.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.578+0000 7fbe997ff700 1 -- 172.21.15.115:0/3975038837 wait complete. 2023-07-27T14:35:18.625 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.580+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.625 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.580+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.625 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.580+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.626 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.580+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.626 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.580+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.642 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.597+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.643 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.597+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.643 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.597+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.643 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.597+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.643 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:18.597+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:35:18.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000034197 snapshot_0000000000402213 2023-07-27T14:35:18.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.796+0000 7fd252fff700 1 Processor -- start 2023-07-27T14:35:18.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.796+0000 7fd252fff700 1 -- start start 2023-07-27T14:35:18.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.797+0000 7fd252fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd24c13a350 0x7fd24c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.797+0000 7fd252fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c0c36b0 0x7fd24c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.797+0000 7fd252fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0bd9a0 con 0x7fd24c13a730 2023-07-27T14:35:18.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.797+0000 7fd252fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c066400 con 0x7fd24c13a350 2023-07-27T14:35:18.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.797+0000 7fd252fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c158ae0 con 0x7fd24c0c36b0 2023-07-27T14:35:18.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd25159c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c0c36b0 0x7fd24c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd25159c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c0c36b0 0x7fd24c1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:39390/0 (socket says 172.21.15.115:39390) 2023-07-27T14:35:18.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd25159c700 1 -- 172.21.15.115:0/3195868932 learned_addr learned my addr 172.21.15.115:0/3195868932 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:18.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd250d9b700 1 --2- 172.21.15.115:0/3195868932 >> v2:172.21.15.159:3300/0 conn(0x7fd24c13a350 0x7fd24c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd25159c700 1 -- 172.21.15.115:0/3195868932 >> v2:172.21.15.159:3300/0 conn(0x7fd24c13a350 msgr2=0x7fd24c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:18.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd25159c700 1 --2- 172.21.15.115:0/3195868932 >> v2:172.21.15.159:3300/0 conn(0x7fd24c13a350 0x7fd24c065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd25159c700 1 -- 172.21.15.115:0/3195868932 >> v1:172.21.15.159:6789/0 conn(0x7fd24c13a730 legacy=0x7fd24c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd25159c700 1 -- 172.21.15.115:0/3195868932 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c066610 con 0x7fd24c0c36b0 2023-07-27T14:35:18.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.798+0000 7fd25159c700 1 --2- 172.21.15.115:0/3195868932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c0c36b0 0x7fd24c1585f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fd244009f20 tx=0x7fd244009840).ready entity=mon.2 client_cookie=ab36f3c41ca27f78 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd24b7fe700 1 -- 172.21.15.115:0/3195868932 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24400e070 con 0x7fd24c0c36b0 2023-07-27T14:35:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd24b7fe700 1 -- 172.21.15.115:0/3195868932 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24400b9d0 con 0x7fd24c0c36b0 2023-07-27T14:35:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd24b7fe700 1 -- 172.21.15.115:0/3195868932 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24400bd50 con 0x7fd24c0c36b0 2023-07-27T14:35:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd252fff700 1 -- 172.21.15.115:0/3195868932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c0c36b0 msgr2=0x7fd24c1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd252fff700 1 --2- 172.21.15.115:0/3195868932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c0c36b0 0x7fd24c1585f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fd244009f20 tx=0x7fd244009840).stop 2023-07-27T14:35:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd252fff700 1 -- 172.21.15.115:0/3195868932 shutdown_connections 2023-07-27T14:35:18.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd252fff700 1 --2- 172.21.15.115:0/3195868932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c0c36b0 0x7fd24c1585f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd252fff700 1 --2- 172.21.15.115:0/3195868932 >> v2:172.21.15.159:3300/0 conn(0x7fd24c13a350 0x7fd24c065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd252fff700 1 -- 172.21.15.115:0/3195868932 >> 172.21.15.115:0/3195868932 conn(0x7fd24c05e8f0 msgr2=0x7fd24c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:18.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd252fff700 1 -- 172.21.15.115:0/3195868932 shutdown_connections 2023-07-27T14:35:18.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.799+0000 7fd252fff700 1 -- 172.21.15.115:0/3195868932 wait complete. 2023-07-27T14:35:18.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.801+0000 7fd252fff700 1 Processor -- start 2023-07-27T14:35:18.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.801+0000 7fd252fff700 1 -- start start 2023-07-27T14:35:18.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd252fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd24c0c36b0 0x7fd24c0a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd252fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd24c13a350 0x7fd24c0aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd252fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c13a730 0x7fd24c0645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd252fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0aa3b0 con 0x7fd24c0c36b0 2023-07-27T14:35:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd252fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0c1db0 con 0x7fd24c13a350 2023-07-27T14:35:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd252fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0c11a0 con 0x7fd24c13a730 2023-07-27T14:35:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd250d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd24c0c36b0 0x7fd24c0a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd250d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd24c0c36b0 0x7fd24c0a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37672/0 (socket says 172.21.15.115:37672) 2023-07-27T14:35:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd250d9b700 1 -- 172.21.15.115:0/1552366337 learned_addr learned my addr 172.21.15.115:0/1552366337 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd25159c700 1 --2- 172.21.15.115:0/1552366337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c13a730 0x7fd24c0645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.802+0000 7fd24bfff700 1 --2- 172.21.15.115:0/1552366337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd24c13a350 0x7fd24c0aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd250d9b700 1 -- 172.21.15.115:0/1552366337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c13a730 msgr2=0x7fd24c0645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd250d9b700 1 --2- 172.21.15.115:0/1552366337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd24c13a730 0x7fd24c0645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd250d9b700 1 -- 172.21.15.115:0/1552366337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd24c13a350 msgr2=0x7fd24c0aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd250d9b700 1 --2- 172.21.15.115:0/1552366337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd24c13a350 0x7fd24c0aa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd250d9b700 1 -- 172.21.15.115:0/1552366337 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244009ae0 con 0x7fd24c0c36b0 2023-07-27T14:35:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd250d9b700 1 --2- 172.21.15.115:0/1552366337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd24c0c36b0 0x7fd24c0a9ec0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fd24000e930 tx=0x7fd240009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd248ff9700 1 -- 172.21.15.115:0/1552366337 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240012600 con 0x7fd24c0c36b0 2023-07-27T14:35:18.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd248ff9700 1 -- 172.21.15.115:0/1552366337 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240012760 con 0x7fd24c0c36b0 2023-07-27T14:35:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd252fff700 1 -- 172.21.15.115:0/1552366337 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c0c1480 con 0x7fd24c0c36b0 2023-07-27T14:35:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd248ff9700 1 -- 172.21.15.115:0/1552366337 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240012ae0 con 0x7fd24c0c36b0 2023-07-27T14:35:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.803+0000 7fd252fff700 1 -- 172.21.15.115:0/1552366337 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c0c1a40 con 0x7fd24c0c36b0 2023-07-27T14:35:18.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.804+0000 7fd252fff700 1 -- 172.21.15.115:0/1552366337 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c06c470 con 0x7fd24c0c36b0 2023-07-27T14:35:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.805+0000 7fd248ff9700 1 -- 172.21.15.115:0/1552366337 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 76642+0+0 (secure 0 0 0) 0x7fd240022070 con 0x7fd24c0c36b0 2023-07-27T14:35:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.806+0000 7fd248ff9700 1 --2- 172.21.15.115:0/1552366337 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd23005f760 0x7fd230061c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.806+0000 7fd248ff9700 1 -- 172.21.15.115:0/1552366337 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd24007aa50 con 0x7fd24c0c36b0 2023-07-27T14:35:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.806+0000 7fd24bfff700 1 --2- 172.21.15.115:0/1552366337 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd23005f760 0x7fd230061c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:18.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.807+0000 7fd24bfff700 1 --2- 172.21.15.115:0/1552366337 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd23005f760 0x7fd230061c20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fd24c0c3100 tx=0x7fd238007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:18.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:18.810+0000 7fd248ff9700 1 -- 172.21.15.115:0/1552366337 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd24004b9a0 con 0x7fd24c0c36b0 2023-07-27T14:35:19.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.015+0000 7fd252fff700 1 -- 172.21.15.115:0/1552366337 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000034197", "snap_name": "snapshot_0000000000402213", "target": ["mon-mgr", ""]}) v1 -- 0x7fd24c0c2090 con 0x7fd23005f760 2023-07-27T14:35:19.067 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:35:19.023+0000 7fa7af9f9700 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'snapshot_0000000000402213' has pending clones 2023-07-27T14:35:19.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.023+0000 7fd248ff9700 1 -- 172.21.15.115:0/1552366337 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: -11 snapshot 'snapshot_0000000000402213' has pending clones) v1 ==== 63+0+0 (secure 0 0 0) 0x7fd24c0c2090 con 0x7fd23005f760 2023-07-27T14:35:19.069 INFO:teuthology.orchestra.run.smithi115.stderr:Error EAGAIN: snapshot 'snapshot_0000000000402213' has pending clones 2023-07-27T14:35:19.076 DEBUG:teuthology.orchestra.run:got remote process result: 11 2023-07-27T14:35:19.078 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000185025 2023-07-27T14:35:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.223+0000 7f2edf1ff700 1 Processor -- start 2023-07-27T14:35:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.223+0000 7f2edf1ff700 1 -- start start 2023-07-27T14:35:19.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edf1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ed814ae00 0x7f2ed8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edf1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814b1e0 0x7f2ed8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edf1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed81553f0 con 0x7f2ed80c5c50 2023-07-27T14:35:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edf1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed8157a50 con 0x7f2ed814ae00 2023-07-27T14:35:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edf1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8157d10 con 0x7f2ed814b1e0 2023-07-27T14:35:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edcf9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ed814ae00 0x7f2ed8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edd79c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2ed80c5c50 0x7f2ed80a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36632/0 (socket says 172.21.15.115:36632) 2023-07-27T14:35:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edd79c700 1 -- 172.21.15.115:0/1469782246 learned_addr learned my addr 172.21.15.115:0/1469782246 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edcf9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ed814ae00 0x7f2ed8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37688/0 (socket says 172.21.15.115:37688) 2023-07-27T14:35:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2ed7fff700 1 --2- 172.21.15.115:0/1469782246 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814b1e0 0x7f2ed8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edcf9b700 1 -- 172.21.15.115:0/1469782246 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814b1e0 msgr2=0x7f2ed8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edcf9b700 1 --2- 172.21.15.115:0/1469782246 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814b1e0 0x7f2ed8062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2edcf9b700 1 -- 172.21.15.115:0/1469782246 >> v1:172.21.15.115:6789/0 conn(0x7f2ed80c5c50 legacy=0x7f2ed80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.225+0000 7f2ed77fe700 1 -- 172.21.15.115:0/1469782246 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555267088 0 0) 0x7f2ed81553f0 con 0x7f2ed80c5c50 2023-07-27T14:35:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2edcf9b700 1 -- 172.21.15.115:0/1469782246 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8157ff0 con 0x7f2ed814ae00 2023-07-27T14:35:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2edcf9b700 1 --2- 172.21.15.115:0/1469782246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed814ae00 0x7f2ed8154f00 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f2ecc009760 tx=0x7f2ecc009060).ready entity=mon.0 client_cookie=64116c59d77eda8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2ed77fe700 1 -- 172.21.15.115:0/1469782246 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00b580 con 0x7f2ed814ae00 2023-07-27T14:35:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2ed77fe700 1 -- 172.21.15.115:0/1469782246 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00b6e0 con 0x7f2ed814ae00 2023-07-27T14:35:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2ed77fe700 1 -- 172.21.15.115:0/1469782246 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00ba60 con 0x7f2ed814ae00 2023-07-27T14:35:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2edf1ff700 1 -- 172.21.15.115:0/1469782246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed814ae00 msgr2=0x7f2ed8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/1469782246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed814ae00 0x7f2ed8154f00 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f2ecc009760 tx=0x7f2ecc009060).stop 2023-07-27T14:35:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2edf1ff700 1 -- 172.21.15.115:0/1469782246 shutdown_connections 2023-07-27T14:35:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.226+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/1469782246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed814ae00 0x7f2ed8154f00 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.227+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/1469782246 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814b1e0 0x7f2ed8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.227+0000 7f2edf1ff700 1 -- 172.21.15.115:0/1469782246 >> 172.21.15.115:0/1469782246 conn(0x7f2ed805e940 msgr2=0x7f2ed80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:19.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.227+0000 7f2edf1ff700 1 -- 172.21.15.115:0/1469782246 shutdown_connections 2023-07-27T14:35:19.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.227+0000 7f2edf1ff700 1 -- 172.21.15.115:0/1469782246 wait complete. 2023-07-27T14:35:19.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.228+0000 7f2edf1ff700 1 Processor -- start 2023-07-27T14:35:19.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.228+0000 7f2edf1ff700 1 -- start start 2023-07-27T14:35:19.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edf1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed80c5c50 0x7f2ed8164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:19.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edf1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814ae00 0x7f2ed8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:19.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edf1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed814b1e0 0x7f2ed8156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:19.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edf1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80aec90 con 0x7f2ed80c5c50 2023-07-27T14:35:19.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edf1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80aee70 con 0x7f2ed814b1e0 2023-07-27T14:35:19.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edf1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80af150 con 0x7f2ed814ae00 2023-07-27T14:35:19.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edcf9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed80c5c50 0x7f2ed8164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:19.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edcf9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed80c5c50 0x7f2ed8164310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37704/0 (socket says 172.21.15.115:37704) 2023-07-27T14:35:19.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.229+0000 7f2edcf9b700 1 -- 172.21.15.115:0/4272024369 learned_addr learned my addr 172.21.15.115:0/4272024369 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:19.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2ed7fff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814ae00 0x7f2ed8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:19.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edd79c700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed814b1e0 0x7f2ed8156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:19.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edcf9b700 1 -- 172.21.15.115:0/4272024369 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814ae00 msgr2=0x7f2ed8151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:19.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edcf9b700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814ae00 0x7f2ed8151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edcf9b700 1 -- 172.21.15.115:0/4272024369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed814b1e0 msgr2=0x7f2ed8156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:19.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edcf9b700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed814b1e0 0x7f2ed8156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edcf9b700 1 -- 172.21.15.115:0/4272024369 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc0092a0 con 0x7f2ed80c5c50 2023-07-27T14:35:19.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edcf9b700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed80c5c50 0x7f2ed8164310 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f2ed8155580 tx=0x7f2ecc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:19.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2ed4ff9700 1 -- 172.21.15.115:0/4272024369 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc000bc0 con 0x7f2ed80c5c50 2023-07-27T14:35:19.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2ed4ff9700 1 -- 172.21.15.115:0/4272024369 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00b850 con 0x7f2ed80c5c50 2023-07-27T14:35:19.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed80af430 con 0x7f2ed80c5c50 2023-07-27T14:35:19.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2ed4ff9700 1 -- 172.21.15.115:0/4272024369 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc000d20 con 0x7f2ed80c5c50 2023-07-27T14:35:19.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.230+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed80af9f0 con 0x7f2ed80c5c50 2023-07-27T14:35:19.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.231+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed80afc10 con 0x7f2ed80c5c50 2023-07-27T14:35:19.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.232+0000 7f2ed4ff9700 1 -- 172.21.15.115:0/4272024369 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 76642+0+0 (secure 0 0 0) 0x7f2ecc02b070 con 0x7f2ed80c5c50 2023-07-27T14:35:19.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.233+0000 7f2ed4ff9700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ebc05f730 0x7f2ebc061bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:19.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.233+0000 7f2ed4ff9700 1 -- 172.21.15.115:0/4272024369 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2ecc07c2e0 con 0x7f2ed80c5c50 2023-07-27T14:35:19.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.234+0000 7f2ed7fff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ebc05f730 0x7f2ebc061bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:19.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.234+0000 7f2ed7fff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ebc05f730 0x7f2ebc061bf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f2ed80acdb0 tx=0x7f2ec4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:19.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.237+0000 7f2ed4ff9700 1 -- 172.21.15.115:0/4272024369 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ecc04d230 con 0x7f2ed80c5c50 2023-07-27T14:35:19.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.445+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000185025", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ed806c470 con 0x7f2ebc05f730 2023-07-27T14:35:19.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.452+0000 7f2ed4ff9700 1 -- 172.21.15.115:0/4272024369 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f2ed806c470 con 0x7f2ebc05f730 2023-07-27T14:35:19.496 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:35:19.497 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:35:19.497 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:35:19.497 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:35:19.497 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:35:19.497 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000034197", 2023-07-27T14:35:19.497 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000402213" 2023-07-27T14:35:19.498 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:35:19.498 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:35:19.498 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:35:19.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ebc05f730 msgr2=0x7f2ebc061bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:19.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ebc05f730 0x7f2ebc061bf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f2ed80acdb0 tx=0x7f2ec4008040).stop 2023-07-27T14:35:19.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed80c5c50 msgr2=0x7f2ed8164310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:19.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed80c5c50 0x7f2ed8164310 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f2ed8155580 tx=0x7f2ecc017000).stop 2023-07-27T14:35:19.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 shutdown_connections 2023-07-27T14:35:19.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ebc05f730 0x7f2ebc061bf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ed814b1e0 0x7f2ed8156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed80c5c50 0x7f2ed8164310 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 --2- 172.21.15.115:0/4272024369 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2ed814ae00 0x7f2ed8151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:19.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 >> 172.21.15.115:0/4272024369 conn(0x7f2ed805e940 msgr2=0x7f2ed80c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:19.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 shutdown_connections 2023-07-27T14:35:19.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:19.454+0000 7f2edf1ff700 1 -- 172.21.15.115:0/4272024369 wait complete. 2023-07-27T14:35:20.516 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000185025 2023-07-27T14:35:20.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.679+0000 7f99687ff700 1 Processor -- start 2023-07-27T14:35:20.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.680+0000 7f99687ff700 1 -- start start 2023-07-27T14:35:20.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.681+0000 7f99687ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f996013a730 0x7f9960065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:20.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.681+0000 7f99687ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99600bd9a0 con 0x7f99600c36b0 2023-07-27T14:35:20.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f99687ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9960066610 con 0x7f996013a350 2023-07-27T14:35:20.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f99687ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9960066400 con 0x7f996013a730 2023-07-27T14:35:20.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f9966d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f99600c36b0 0x7f99600be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36634/0 (socket says 172.21.15.115:36634) 2023-07-27T14:35:20.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f9966d9c700 1 -- 172.21.15.115:0/1512315364 learned_addr learned my addr 172.21.15.115:0/1512315364 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:20.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f9965d9a700 1 --2- 172.21.15.115:0/1512315364 >> v2:172.21.15.159:3300/0 conn(0x7f996013a730 0x7f9960065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:20.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649443251 0 0) 0x7f99600bd9a0 con 0x7f99600c36b0 2023-07-27T14:35:20.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f994c0033f0 con 0x7f99600c36b0 2023-07-27T14:35:20.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060810150 0 0) 0x7f9960066610 con 0x7f996013a350 2023-07-27T14:35:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.682+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99600bd9a0 con 0x7f996013a350 2023-07-27T14:35:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951878207 0 0) 0x7f994c0033f0 con 0x7f99600c36b0 2023-07-27T14:35:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 >> v2:172.21.15.159:3300/0 conn(0x7f996013a730 msgr2=0x7f9960065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 --2- 172.21.15.115:0/1512315364 >> v2:172.21.15.159:3300/0 conn(0x7f996013a730 0x7f9960065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 >> v1:172.21.15.159:6789/0 conn(0x7f996013a350 legacy=0x7f99600c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600bdc10 con 0x7f99600c36b0 2023-07-27T14:35:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f99580017f0 con 0x7f99600c36b0 2023-07-27T14:35:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 >> v1:172.21.15.115:6789/0 conn(0x7f99600c36b0 legacy=0x7f99600be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f994c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f994c004690 0x7f994c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:20.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c005000 0x7f994c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:20.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960066400 con 0x7f994c003a70 2023-07-27T14:35:20.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c00bf60 con 0x7f994c005000 2023-07-27T14:35:20.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c00c0d0 con 0x7f994c004690 2023-07-27T14:35:20.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965d9a700 1 --2- 172.21.15.115:0/1512315364 >> v2:172.21.15.159:3300/0 conn(0x7f996013a730 0x7f9960065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:35:20.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f996659b700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f994c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9966d9c700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c005000 0x7f994c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9965d9a700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f994c004690 0x7f994c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f996659b700 1 -- 172.21.15.115:0/1512315364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f994c004690 msgr2=0x7f994c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f996659b700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f994c004690 0x7f994c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f996659b700 1 -- 172.21.15.115:0/1512315364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c005000 msgr2=0x7f994c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f996659b700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c005000 0x7f994c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f996659b700 1 -- 172.21.15.115:0/1512315364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0033f0 con 0x7f994c003a70 2023-07-27T14:35:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.683+0000 7f9966d9c700 1 -- 172.21.15.115:0/1512315364 reap_dead start 2023-07-27T14:35:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f996659b700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f994c003e70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f995c001890 tx=0x7f995c007bb0).ready entity=mon.0 client_cookie=69c8c9aa533dfde4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c007020 con 0x7f994c003a70 2023-07-27T14:35:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c007180 con 0x7f994c003a70 2023-07-27T14:35:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f9965599700 1 -- 172.21.15.115:0/1512315364 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c007500 con 0x7f994c003a70 2023-07-27T14:35:20.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f99687ff700 1 -- 172.21.15.115:0/1512315364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 msgr2=0x7f994c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:20.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f99687ff700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f994c003e70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f995c001890 tx=0x7f995c007bb0).stop 2023-07-27T14:35:20.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f99687ff700 1 -- 172.21.15.115:0/1512315364 shutdown_connections 2023-07-27T14:35:20.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f99687ff700 1 --2- 172.21.15.115:0/1512315364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f994c003e70 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:20.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f99687ff700 1 -- 172.21.15.115:0/1512315364 >> 172.21.15.115:0/1512315364 conn(0x7f996005e8f0 msgr2=0x7f99600c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:20.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f99687ff700 1 -- 172.21.15.115:0/1512315364 shutdown_connections 2023-07-27T14:35:20.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.684+0000 7f99687ff700 1 -- 172.21.15.115:0/1512315364 wait complete. 2023-07-27T14:35:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.686+0000 7f99687ff700 1 Processor -- start 2023-07-27T14:35:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.687+0000 7f99687ff700 1 -- start start 2023-07-27T14:35:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f99687ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f99600c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f99687ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99600c18f0 0x7f9960163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f99687ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99600a9aa0 0x7f99600c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f99687ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960164710 con 0x7f994c003a70 2023-07-27T14:35:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f99687ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99601649f0 con 0x7f99600c18f0 2023-07-27T14:35:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f99687ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9960164cd0 con 0x7f99600a9aa0 2023-07-27T14:35:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f996659b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f99600c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f996659b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f99600c2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37724/0 (socket says 172.21.15.115:37724) 2023-07-27T14:35:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f996659b700 1 -- 172.21.15.115:0/638327583 learned_addr learned my addr 172.21.15.115:0/638327583 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f9966d9c700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99600a9aa0 0x7f99600c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.688+0000 7f9965d9a700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99600c18f0 0x7f9960163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f996659b700 1 -- 172.21.15.115:0/638327583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99600a9aa0 msgr2=0x7f99600c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f996659b700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99600a9aa0 0x7f99600c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f996659b700 1 -- 172.21.15.115:0/638327583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99600c18f0 msgr2=0x7f9960163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f996659b700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99600c18f0 0x7f9960163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f996659b700 1 -- 172.21.15.115:0/638327583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600a92a0 con 0x7f994c003a70 2023-07-27T14:35:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f996659b700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f99600c2300 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f995c001e80 tx=0x7f995c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f99567fc700 1 -- 172.21.15.115:0/638327583 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c018030 con 0x7f994c003a70 2023-07-27T14:35:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f99567fc700 1 -- 172.21.15.115:0/638327583 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c006fc0 con 0x7f994c003a70 2023-07-27T14:35:20.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99600a9580 con 0x7f994c003a70 2023-07-27T14:35:20.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f99567fc700 1 -- 172.21.15.115:0/638327583 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c013880 con 0x7f994c003a70 2023-07-27T14:35:20.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.689+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99600a9f00 con 0x7f994c003a70 2023-07-27T14:35:20.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.690+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9960062ed0 con 0x7f994c003a70 2023-07-27T14:35:20.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.691+0000 7f99567fc700 1 -- 172.21.15.115:0/638327583 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7f995c01d070 con 0x7f994c003a70 2023-07-27T14:35:20.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.692+0000 7f99567fc700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994405f7f0 0x7f9944061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:20.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.692+0000 7f99567fc700 1 -- 172.21.15.115:0/638327583 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f995c07ae90 con 0x7f994c003a70 2023-07-27T14:35:20.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.692+0000 7f9965d9a700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994405f7f0 0x7f9944061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:20.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.692+0000 7f9965d9a700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994405f7f0 0x7f9944061cb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f9950009270 tx=0x7f9950008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:20.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.696+0000 7f99567fc700 1 -- 172.21.15.115:0/638327583 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f995c04b8c0 con 0x7f994c003a70 2023-07-27T14:35:20.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:20.909+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000185025", "target": ["mon-mgr", ""]}) v1 -- 0x7f9960164b60 con 0x7f994405f7f0 2023-07-27T14:35:21.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.164+0000 7f99567fc700 1 -- 172.21.15.115:0/638327583 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f9960164b60 con 0x7f994405f7f0 2023-07-27T14:35:21.209 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:35:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:35:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:35:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:35:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:35:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000034197", 2023-07-27T14:35:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000402213" 2023-07-27T14:35:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:35:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:35:21.210 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:35:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994405f7f0 msgr2=0x7f9944061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994405f7f0 0x7f9944061cb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f9950009270 tx=0x7f9950008040).stop 2023-07-27T14:35:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 msgr2=0x7f99600c2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:21.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f99600c2300 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f995c001e80 tx=0x7f995c015000).stop 2023-07-27T14:35:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 shutdown_connections 2023-07-27T14:35:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f994405f7f0 0x7f9944061cb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f99600a9aa0 0x7f99600c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f994c003a70 0x7f99600c2300 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 --2- 172.21.15.115:0/638327583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99600c18f0 0x7f9960163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 >> 172.21.15.115:0/638327583 conn(0x7f996005e8f0 msgr2=0x7f99600ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 shutdown_connections 2023-07-27T14:35:21.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:21.166+0000 7f99687ff700 1 -- 172.21.15.115:0/638327583 wait complete. 2023-07-27T14:35:22.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000185025 2023-07-27T14:35:22.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.411+0000 7f2721fff700 1 Processor -- start 2023-07-27T14:35:22.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.411+0000 7f2721fff700 1 -- start start 2023-07-27T14:35:22.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.412+0000 7f2721fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f271c0c0ea0 0x7f271c150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:22.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.412+0000 7f2721fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f271c065220 0x7f271c0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:22.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.412+0000 7f2721fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271c068bb0 con 0x7f271c150220 2023-07-27T14:35:22.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.412+0000 7f2721fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c0656b0 con 0x7f271c065220 2023-07-27T14:35:22.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.412+0000 7f2721fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c06a250 con 0x7f271c0c0ea0 2023-07-27T14:35:22.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.412+0000 7f271b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f271c150220 0x7f271c069040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36636/0 (socket says 172.21.15.115:36636) 2023-07-27T14:35:22.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.412+0000 7f271b7fe700 1 -- 172.21.15.115:0/3146691472 learned_addr learned my addr 172.21.15.115:0/3146691472 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:22.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.412+0000 7f271bfff700 1 --2- 172.21.15.115:0/3146691472 >> v2:172.21.15.115:3300/0 conn(0x7f271c065220 0x7f271c0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:22.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271affd700 1 --2- 172.21.15.115:0/3146691472 >> v2:172.21.15.159:3300/0 conn(0x7f271c0c0ea0 0x7f271c150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:22.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271bfff700 1 -- 172.21.15.115:0/3146691472 >> v2:172.21.15.159:3300/0 conn(0x7f271c0c0ea0 msgr2=0x7f271c150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:22.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271bfff700 1 --2- 172.21.15.115:0/3146691472 >> v2:172.21.15.159:3300/0 conn(0x7f271c0c0ea0 0x7f271c150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:22.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271bfff700 1 -- 172.21.15.115:0/3146691472 >> v1:172.21.15.115:6789/0 conn(0x7f271c150220 legacy=0x7f271c069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:22.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271bfff700 1 -- 172.21.15.115:0/3146691472 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0c1380 con 0x7f271c065220 2023-07-27T14:35:22.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271a7fc700 1 -- 172.21.15.115:0/3146691472 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409111958 0 0) 0x7f271c068bb0 con 0x7f271c150220 2023-07-27T14:35:22.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271bfff700 1 --2- 172.21.15.115:0/3146691472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c065220 0x7f271c0c1770 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f2714009e60 tx=0x7f2714009780).ready entity=mon.0 client_cookie=a7d7429fab5399f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:22.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271a7fc700 1 -- 172.21.15.115:0/3146691472 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271400e070 con 0x7f271c065220 2023-07-27T14:35:22.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271a7fc700 1 -- 172.21.15.115:0/3146691472 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271400bbf0 con 0x7f271c065220 2023-07-27T14:35:22.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.413+0000 7f271a7fc700 1 -- 172.21.15.115:0/3146691472 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714012410 con 0x7f271c065220 2023-07-27T14:35:22.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.414+0000 7f2721fff700 1 -- 172.21.15.115:0/3146691472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c065220 msgr2=0x7f271c0c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:22.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.414+0000 7f2721fff700 1 --2- 172.21.15.115:0/3146691472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c065220 0x7f271c0c1770 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f2714009e60 tx=0x7f2714009780).stop 2023-07-27T14:35:22.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.414+0000 7f2721fff700 1 -- 172.21.15.115:0/3146691472 shutdown_connections 2023-07-27T14:35:22.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.414+0000 7f2721fff700 1 --2- 172.21.15.115:0/3146691472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c065220 0x7f271c0c1770 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:22.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.414+0000 7f2721fff700 1 --2- 172.21.15.115:0/3146691472 >> v2:172.21.15.159:3300/0 conn(0x7f271c0c0ea0 0x7f271c150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:22.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.414+0000 7f2721fff700 1 -- 172.21.15.115:0/3146691472 >> 172.21.15.115:0/3146691472 conn(0x7f271c062320 msgr2=0x7f271c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:22.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.414+0000 7f2721fff700 1 -- 172.21.15.115:0/3146691472 shutdown_connections 2023-07-27T14:35:22.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.414+0000 7f2721fff700 1 -- 172.21.15.115:0/3146691472 wait complete. 2023-07-27T14:35:22.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.415+0000 7f2721fff700 1 Processor -- start 2023-07-27T14:35:22.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.416+0000 7f2721fff700 1 -- start start 2023-07-27T14:35:22.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.416+0000 7f2721fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f271c065220 0x7f271c0be210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:22.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.416+0000 7f2721fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c0c0ea0 0x7f271c0be700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:22.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.416+0000 7f2721fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f271c150220 0x7f271c15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:22.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.416+0000 7f2721fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0a77f0 con 0x7f271c0c0ea0 2023-07-27T14:35:22.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.416+0000 7f2721fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0bef40 con 0x7f271c150220 2023-07-27T14:35:22.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.416+0000 7f2721fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0bf220 con 0x7f271c065220 2023-07-27T14:35:22.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c0c0ea0 0x7f271c0be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:22.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c0c0ea0 0x7f271c0be700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37732/0 (socket says 172.21.15.115:37732) 2023-07-27T14:35:22.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 -- 172.21.15.115:0/2228471129 learned_addr learned my addr 172.21.15.115:0/2228471129 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:22.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271b7fe700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f271c065220 0x7f271c0be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:22.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271bfff700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f271c150220 0x7f271c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:22.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 -- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f271c065220 msgr2=0x7f271c0be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:22.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f271c065220 0x7f271c0be210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:22.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 -- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f271c150220 msgr2=0x7f271c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:22.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f271c150220 0x7f271c15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:22.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 -- 172.21.15.115:0/2228471129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714009a20 con 0x7f271c0c0ea0 2023-07-27T14:35:22.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271b7fe700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f271c065220 0x7f271c0be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:22.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.417+0000 7f271affd700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c0c0ea0 0x7f271c0be700 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f271000d890 tx=0x7f2710008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:22.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.418+0000 7f27037fe700 1 -- 172.21.15.115:0/2228471129 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100125f0 con 0x7f271c0c0ea0 2023-07-27T14:35:22.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.418+0000 7f27037fe700 1 -- 172.21.15.115:0/2228471129 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710012750 con 0x7f271c0c0ea0 2023-07-27T14:35:22.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.418+0000 7f27037fe700 1 -- 172.21.15.115:0/2228471129 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710012ad0 con 0x7f271c0c0ea0 2023-07-27T14:35:22.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.418+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c0bf500 con 0x7f271c0c0ea0 2023-07-27T14:35:22.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.418+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271c0bebf0 con 0x7f271c0c0ea0 2023-07-27T14:35:22.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.419+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271c0a79a0 con 0x7f271c0c0ea0 2023-07-27T14:35:22.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.419+0000 7f27037fe700 1 -- 172.21.15.115:0/2228471129 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7f2710013480 con 0x7f271c0c0ea0 2023-07-27T14:35:22.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.420+0000 7f27037fe700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f270805f7f0 0x7f2708061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:22.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.420+0000 7f27037fe700 1 -- 172.21.15.115:0/2228471129 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f271007af10 con 0x7f271c0c0ea0 2023-07-27T14:35:22.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.420+0000 7f271b7fe700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f270805f7f0 0x7f2708061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:22.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.421+0000 7f271b7fe700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f270805f7f0 0x7f2708061cb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f271c0c0e00 tx=0x7f270c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:22.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.425+0000 7f27037fe700 1 -- 172.21.15.115:0/2228471129 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f271c0a79a0 con 0x7f271c0c0ea0 2023-07-27T14:35:22.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:22.638+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000185025", "target": ["mon-mgr", ""]}) v1 -- 0x7f271c0a79a0 con 0x7f270805f7f0 2023-07-27T14:35:23.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.406+0000 7f27037fe700 1 -- 172.21.15.115:0/2228471129 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f271c0a79a0 con 0x7f270805f7f0 2023-07-27T14:35:23.451 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:35:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:35:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:35:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:35:23.452 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:35:23.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.408+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f270805f7f0 msgr2=0x7f2708061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.408+0000 7f2721fff700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f270805f7f0 0x7f2708061cb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f271c0c0e00 tx=0x7f270c009040).stop 2023-07-27T14:35:23.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c0c0ea0 msgr2=0x7f271c0be700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c0c0ea0 0x7f271c0be700 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f271000d890 tx=0x7f2710008040).stop 2023-07-27T14:35:23.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 shutdown_connections 2023-07-27T14:35:23.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f270805f7f0 0x7f2708061cb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f271c150220 0x7f271c15fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f271c065220 0x7f271c0be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 --2- 172.21.15.115:0/2228471129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f271c0c0ea0 0x7f271c0be700 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 >> 172.21.15.115:0/2228471129 conn(0x7f271c062320 msgr2=0x7f271c062700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:23.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 shutdown_connections 2023-07-27T14:35:23.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.409+0000 7f2721fff700 1 -- 172.21.15.115:0/2228471129 wait complete. 2023-07-27T14:35:23.472 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000185025 2023-07-27T14:35:23.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.622+0000 7ff9c0bff700 1 Processor -- start 2023-07-27T14:35:23.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.622+0000 7ff9c0bff700 1 -- start start 2023-07-27T14:35:23.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.623+0000 7ff9c0bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff9bc14ae00 0x7ff9bc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:23.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.623+0000 7ff9c0bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc1553f0 con 0x7ff9bc063260 2023-07-27T14:35:23.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.623+0000 7ff9c0bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc157a50 con 0x7ff9bc14b1e0 2023-07-27T14:35:23.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.623+0000 7ff9c0bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc157d10 con 0x7ff9bc14ae00 2023-07-27T14:35:23.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9bad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff9bc063260 0x7ff9bc0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60314/0 (socket says 172.21.15.115:60314) 2023-07-27T14:35:23.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9bad9d700 1 -- 172.21.15.115:0/1057230252 learned_addr learned my addr 172.21.15.115:0/1057230252 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:23.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9ba59c700 1 --2- 172.21.15.115:0/1057230252 >> v2:172.21.15.159:3300/0 conn(0x7ff9bc14ae00 0x7ff9bc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:23.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861318085 0 0) 0x7ff9bc1553f0 con 0x7ff9bc063260 2023-07-27T14:35:23.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a40033f0 con 0x7ff9bc063260 2023-07-27T14:35:23.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3691515166 0 0) 0x7ff9a40033f0 con 0x7ff9bc063260 2023-07-27T14:35:23.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 >> v2:172.21.15.159:3300/0 conn(0x7ff9bc14ae00 msgr2=0x7ff9bc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:23.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 --2- 172.21.15.115:0/1057230252 >> v2:172.21.15.159:3300/0 conn(0x7ff9bc14ae00 0x7ff9bc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 >> v1:172.21.15.159:6789/0 conn(0x7ff9bc14b1e0 legacy=0x7ff9bc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc157ff0 con 0x7ff9bc063260 2023-07-27T14:35:23.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7ff9b40017f0 con 0x7ff9bc063260 2023-07-27T14:35:23.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 >> v1:172.21.15.115:6789/0 conn(0x7ff9bc063260 legacy=0x7ff9bc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a40038e0 0x7ff9a4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:23.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9a4004690 0x7ff9a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:23.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9a4005000 0x7ff9a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:23.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc157d10 con 0x7ff9a4005000 2023-07-27T14:35:23.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400beb0 con 0x7ff9a4004690 2023-07-27T14:35:23.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.624+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400c070 con 0x7ff9a40038e0 2023-07-27T14:35:23.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9bad9d700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9a4005000 0x7ff9a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:23.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9ba59c700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a40038e0 0x7ff9a4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:23.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9b9d9b700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9a4004690 0x7ff9a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:23.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9bad9d700 1 -- 172.21.15.115:0/1057230252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a40038e0 msgr2=0x7ff9a4003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:23.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9bad9d700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a40038e0 0x7ff9a4003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9bad9d700 1 -- 172.21.15.115:0/1057230252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9a4004690 msgr2=0x7ff9a4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:23.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9bad9d700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9a4004690 0x7ff9a4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9bad9d700 1 -- 172.21.15.115:0/1057230252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40033f0 con 0x7ff9a4005000 2023-07-27T14:35:23.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9bad9d700 1 -- 172.21.15.115:0/1057230252 reap_dead start 2023-07-27T14:35:23.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9bad9d700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9a4005000 0x7ff9a400b8e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7ff9b400c5c0 tx=0x7ff9b4001d90).ready entity=mon.0 client_cookie=6fe37935bec924fa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:23.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400ce90 con 0x7ff9a4005000 2023-07-27T14:35:23.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4001fc0 con 0x7ff9a4005000 2023-07-27T14:35:23.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.625+0000 7ff9b959a700 1 -- 172.21.15.115:0/1057230252 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4005d70 con 0x7ff9a4005000 2023-07-27T14:35:23.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.626+0000 7ff9c0bff700 1 -- 172.21.15.115:0/1057230252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9a4005000 msgr2=0x7ff9a400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.626+0000 7ff9c0bff700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9a4005000 0x7ff9a400b8e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7ff9b400c5c0 tx=0x7ff9b4001d90).stop 2023-07-27T14:35:23.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.626+0000 7ff9c0bff700 1 -- 172.21.15.115:0/1057230252 shutdown_connections 2023-07-27T14:35:23.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.626+0000 7ff9c0bff700 1 --2- 172.21.15.115:0/1057230252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9a4005000 0x7ff9a400b8e0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.626+0000 7ff9c0bff700 1 -- 172.21.15.115:0/1057230252 >> 172.21.15.115:0/1057230252 conn(0x7ff9bc05e940 msgr2=0x7ff9bc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:23.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.626+0000 7ff9c0bff700 1 -- 172.21.15.115:0/1057230252 shutdown_connections 2023-07-27T14:35:23.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.626+0000 7ff9c0bff700 1 -- 172.21.15.115:0/1057230252 wait complete. 2023-07-27T14:35:23.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.628+0000 7ff9c0bff700 1 Processor -- start 2023-07-27T14:35:23.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.628+0000 7ff9c0bff700 1 -- start start 2023-07-27T14:35:23.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9c0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a4005000 0x7ff9bc1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:23.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9c0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9bc0ac270 0x7ff9bc1499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:23.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9c0bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0ac6f0 0x7ff9bc149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:23.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9c0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0afaa0 con 0x7ff9bc0ac270 2023-07-27T14:35:23.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9c0bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc154c30 con 0x7ff9bc0ac6f0 2023-07-27T14:35:23.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9c0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc14a380 con 0x7ff9a4005000 2023-07-27T14:35:23.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9bc0ac270 0x7ff9bc1499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:23.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9bc0ac270 0x7ff9bc1499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40912/0 (socket says 172.21.15.115:40912) 2023-07-27T14:35:23.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 -- 172.21.15.115:0/899300791 learned_addr learned my addr 172.21.15.115:0/899300791 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:23.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9ba59c700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a4005000 0x7ff9bc1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:23.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9bad9d700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0ac6f0 0x7ff9bc149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:23.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 -- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a4005000 msgr2=0x7ff9bc1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a4005000 0x7ff9bc1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 -- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0ac6f0 msgr2=0x7ff9bc149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0ac6f0 0x7ff9bc149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 -- 172.21.15.115:0/899300791 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0af7c0 con 0x7ff9bc0ac270 2023-07-27T14:35:23.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9bad9d700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0ac6f0 0x7ff9bc149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:23.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.629+0000 7ff9b9d9b700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9bc0ac270 0x7ff9bc1499a0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7ff9b0002a00 tx=0x7ff9b0007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:23.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.630+0000 7ff9aa7fc700 1 -- 172.21.15.115:0/899300791 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000f8d0 con 0x7ff9bc0ac270 2023-07-27T14:35:23.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.630+0000 7ff9aa7fc700 1 -- 172.21.15.115:0/899300791 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b000fa30 con 0x7ff9bc0ac270 2023-07-27T14:35:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.630+0000 7ff9aa7fc700 1 -- 172.21.15.115:0/899300791 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000fdd0 con 0x7ff9bc0ac270 2023-07-27T14:35:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.630+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc1545e0 con 0x7ff9bc0ac270 2023-07-27T14:35:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.630+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc1555b0 con 0x7ff9bc0ac270 2023-07-27T14:35:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.631+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc154da0 con 0x7ff9bc0ac270 2023-07-27T14:35:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.632+0000 7ff9aa7fc700 1 -- 172.21.15.115:0/899300791 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7ff9b001b030 con 0x7ff9bc0ac270 2023-07-27T14:35:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.632+0000 7ff9aa7fc700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff99c05f7f0 0x7ff99c061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.632+0000 7ff9aa7fc700 1 -- 172.21.15.115:0/899300791 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff9b007aaf0 con 0x7ff9bc0ac270 2023-07-27T14:35:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.633+0000 7ff9ba59c700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff99c05f7f0 0x7ff99c061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:23.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.633+0000 7ff9ba59c700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff99c05f7f0 0x7ff99c061cb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7ff9bc157640 tx=0x7ff9ac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:23.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.636+0000 7ff9aa7fc700 1 -- 172.21.15.115:0/899300791 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9b004b520 con 0x7ff9bc0ac270 2023-07-27T14:35:23.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.841+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000185025", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9bc06c470 con 0x7ff99c05f7f0 2023-07-27T14:35:23.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.846+0000 7ff9aa7fc700 1 -- 172.21.15.115:0/899300791 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7ff9bc06c470 con 0x7ff99c05f7f0 2023-07-27T14:35:23.891 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a 2023-07-27T14:35:23.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff99c05f7f0 msgr2=0x7ff99c061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff99c05f7f0 0x7ff99c061cb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7ff9bc157640 tx=0x7ff9ac008040).stop 2023-07-27T14:35:23.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9bc0ac270 msgr2=0x7ff9bc1499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9bc0ac270 0x7ff9bc1499a0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7ff9b0002a00 tx=0x7ff9b0007b90).stop 2023-07-27T14:35:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 shutdown_connections 2023-07-27T14:35:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff99c05f7f0 0x7ff99c061cb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9bc0ac6f0 0x7ff9bc149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9a4005000 0x7ff9bc1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 --2- 172.21.15.115:0/899300791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9bc0ac270 0x7ff9bc1499a0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 >> 172.21.15.115:0/899300791 conn(0x7ff9bc05e940 msgr2=0x7ff9bc153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 shutdown_connections 2023-07-27T14:35:23.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:23.848+0000 7ff9c0bff700 1 -- 172.21.15.115:0/899300791 wait complete. 2023-07-27T14:35:23.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000034197 2023-07-27T14:35:24.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.056+0000 7fea5cbff700 1 Processor -- start 2023-07-27T14:35:24.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.056+0000 7fea5cbff700 1 -- start start 2023-07-27T14:35:24.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5cbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fea58063260 0x7fea58154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5cbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea5814b1e0 0x7fea580a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5cbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea581553f0 con 0x7fea5814ae00 2023-07-27T14:35:24.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5cbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea58157a50 con 0x7fea58063260 2023-07-27T14:35:24.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5cbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea58157d10 con 0x7fea5814b1e0 2023-07-27T14:35:24.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fea5814ae00 0x7fea58062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60324/0 (socket says 172.21.15.115:60324) 2023-07-27T14:35:24.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5659c700 1 -- 172.21.15.115:0/961979506 learned_addr learned my addr 172.21.15.115:0/961979506 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:24.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea56d9d700 1 --2- 172.21.15.115:0/961979506 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea5814b1e0 0x7fea580a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea55d9b700 1 --2- 172.21.15.115:0/961979506 >> v2:172.21.15.159:3300/0 conn(0x7fea58063260 0x7fea58154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5559a700 1 -- 172.21.15.115:0/961979506 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184398424 0 0) 0x7fea581553f0 con 0x7fea5814ae00 2023-07-27T14:35:24.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.058+0000 7fea5559a700 1 -- 172.21.15.115:0/961979506 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea400033f0 con 0x7fea5814ae00 2023-07-27T14:35:24.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea56d9d700 1 -- 172.21.15.115:0/961979506 >> v2:172.21.15.159:3300/0 conn(0x7fea58063260 msgr2=0x7fea58154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:24.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea56d9d700 1 --2- 172.21.15.115:0/961979506 >> v2:172.21.15.159:3300/0 conn(0x7fea58063260 0x7fea58154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea56d9d700 1 -- 172.21.15.115:0/961979506 >> v1:172.21.15.115:6789/0 conn(0x7fea5814ae00 legacy=0x7fea58062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea56d9d700 1 -- 172.21.15.115:0/961979506 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58157ff0 con 0x7fea5814b1e0 2023-07-27T14:35:24.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea5559a700 1 -- 172.21.15.115:0/961979506 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3850683247 0 0) 0x7fea400033f0 con 0x7fea5814ae00 2023-07-27T14:35:24.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea55d9b700 1 --2- 172.21.15.115:0/961979506 >> v2:172.21.15.159:3300/0 conn(0x7fea58063260 0x7fea58154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:35:24.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea56d9d700 1 --2- 172.21.15.115:0/961979506 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea5814b1e0 0x7fea580a98c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fea50009e60 tx=0x7fea50009780).ready entity=mon.2 client_cookie=5754e0512d53ec3d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:24.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea5559a700 1 -- 172.21.15.115:0/961979506 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000e070 con 0x7fea5814b1e0 2023-07-27T14:35:24.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea5559a700 1 -- 172.21.15.115:0/961979506 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5000bab0 con 0x7fea5814b1e0 2023-07-27T14:35:24.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.059+0000 7fea5559a700 1 -- 172.21.15.115:0/961979506 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000be30 con 0x7fea5814b1e0 2023-07-27T14:35:24.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.060+0000 7fea5cbff700 1 -- 172.21.15.115:0/961979506 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea5814b1e0 msgr2=0x7fea580a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.060+0000 7fea5cbff700 1 --2- 172.21.15.115:0/961979506 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea5814b1e0 0x7fea580a98c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fea50009e60 tx=0x7fea50009780).stop 2023-07-27T14:35:24.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.060+0000 7fea5cbff700 1 -- 172.21.15.115:0/961979506 shutdown_connections 2023-07-27T14:35:24.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.060+0000 7fea5cbff700 1 --2- 172.21.15.115:0/961979506 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea5814b1e0 0x7fea580a98c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.060+0000 7fea5cbff700 1 --2- 172.21.15.115:0/961979506 >> v2:172.21.15.159:3300/0 conn(0x7fea58063260 0x7fea58154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.060+0000 7fea5cbff700 1 -- 172.21.15.115:0/961979506 >> 172.21.15.115:0/961979506 conn(0x7fea5805e940 msgr2=0x7fea580cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:24.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.060+0000 7fea5cbff700 1 -- 172.21.15.115:0/961979506 shutdown_connections 2023-07-27T14:35:24.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.060+0000 7fea5cbff700 1 -- 172.21.15.115:0/961979506 wait complete. 2023-07-27T14:35:24.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.061+0000 7fea5cbff700 1 Processor -- start 2023-07-27T14:35:24.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.061+0000 7fea5cbff700 1 -- start start 2023-07-27T14:35:24.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.062+0000 7fea5cbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea58063260 0x7fea58136e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.062+0000 7fea5cbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea5814ae00 0x7fea580adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.062+0000 7fea5cbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5814b1e0 0x7fea580af800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.062+0000 7fea5cbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea58139070 con 0x7fea5814ae00 2023-07-27T14:35:24.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.062+0000 7fea5cbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea58139350 con 0x7fea5814b1e0 2023-07-27T14:35:24.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.062+0000 7fea5cbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea58139630 con 0x7fea58063260 2023-07-27T14:35:24.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea5814ae00 0x7fea580adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea5814ae00 0x7fea580adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40926/0 (socket says 172.21.15.115:40926) 2023-07-27T14:35:24.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 -- 172.21.15.115:0/4289973086 learned_addr learned my addr 172.21.15.115:0/4289973086 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:24.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea56d9d700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5814b1e0 0x7fea580af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea5659c700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea58063260 0x7fea58136e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 -- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea58063260 msgr2=0x7fea58136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea58063260 0x7fea58136e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 -- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5814b1e0 msgr2=0x7fea580af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5814b1e0 0x7fea580af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 -- 172.21.15.115:0/4289973086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0092a0 con 0x7fea5814ae00 2023-07-27T14:35:24.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea56d9d700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5814b1e0 0x7fea580af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:24.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea5659c700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea58063260 0x7fea58136e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:24.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea55d9b700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea5814ae00 0x7fea580adb60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fea4c00e980 tx=0x7fea4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:24.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea467fc700 1 -- 172.21.15.115:0/4289973086 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00c7f0 con 0x7fea5814ae00 2023-07-27T14:35:24.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea467fc700 1 -- 172.21.15.115:0/4289973086 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00c950 con 0x7fea5814ae00 2023-07-27T14:35:24.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea50009a20 con 0x7fea5814ae00 2023-07-27T14:35:24.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.063+0000 7fea467fc700 1 -- 172.21.15.115:0/4289973086 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00ccd0 con 0x7fea5814ae00 2023-07-27T14:35:24.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.064+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea581399c0 con 0x7fea5814ae00 2023-07-27T14:35:24.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.064+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea58138e10 con 0x7fea5814ae00 2023-07-27T14:35:24.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.065+0000 7fea467fc700 1 -- 172.21.15.115:0/4289973086 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7fea4c022070 con 0x7fea5814ae00 2023-07-27T14:35:24.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.066+0000 7fea467fc700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea3805f7f0 0x7fea38061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.066+0000 7fea467fc700 1 -- 172.21.15.115:0/4289973086 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fea4c07afe0 con 0x7fea5814ae00 2023-07-27T14:35:24.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.066+0000 7fea5659c700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea3805f7f0 0x7fea38061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.067+0000 7fea5659c700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea3805f7f0 0x7fea38061cb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fea48001770 tx=0x7fea48009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:24.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.070+0000 7fea467fc700 1 -- 172.21.15.115:0/4289973086 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea4c04ba50 con 0x7fea5814ae00 2023-07-27T14:35:24.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.271+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000034197", "target": ["mon-mgr", ""]}) v1 -- 0x7fea581397f0 con 0x7fea3805f7f0 2023-07-27T14:35:24.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.280+0000 7fea467fc700 1 -- 172.21.15.115:0/4289973086 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fea48007170 con 0x7fea3805f7f0 2023-07-27T14:35:24.325 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000034197/f696872a-21ea-42de-9f5d-9fb8bb58eb11 2023-07-27T14:35:24.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea3805f7f0 msgr2=0x7fea38061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea3805f7f0 0x7fea38061cb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fea48001770 tx=0x7fea48009040).stop 2023-07-27T14:35:24.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea5814ae00 msgr2=0x7fea580adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea5814ae00 0x7fea580adb60 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fea4c00e980 tx=0x7fea4c009060).stop 2023-07-27T14:35:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 shutdown_connections 2023-07-27T14:35:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea3805f7f0 0x7fea38061cb0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea5814b1e0 0x7fea580af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea58063260 0x7fea58136e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 --2- 172.21.15.115:0/4289973086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea5814ae00 0x7fea580adb60 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 >> 172.21.15.115:0/4289973086 conn(0x7fea5805e940 msgr2=0x7fea580c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:24.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 shutdown_connections 2023-07-27T14:35:24.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.282+0000 7fea5cbff700 1 -- 172.21.15.115:0/4289973086 wait complete. 2023-07-27T14:35:24.344 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000185025 2023-07-27T14:35:24.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.490+0000 7f124bfff700 1 Processor -- start 2023-07-27T14:35:24.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.491+0000 7f124bfff700 1 -- start start 2023-07-27T14:35:24.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.492+0000 7f124bfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f124414ae00 0x7f1244154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.492+0000 7f124bfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12441553f0 con 0x7f1244063260 2023-07-27T14:35:24.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.492+0000 7f124bfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1244157a50 con 0x7f124414b1e0 2023-07-27T14:35:24.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.492+0000 7f124bfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1244157d10 con 0x7f124414ae00 2023-07-27T14:35:24.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.492+0000 7f124a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1244063260 0x7f12440a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60332/0 (socket says 172.21.15.115:60332) 2023-07-27T14:35:24.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.492+0000 7f124a59c700 1 -- 172.21.15.115:0/1588330006 learned_addr learned my addr 172.21.15.115:0/1588330006 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:35:24.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.492+0000 7f1249d9b700 1 --2- 172.21.15.115:0/1588330006 >> v2:172.21.15.159:3300/0 conn(0x7f124414ae00 0x7f1244154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1248d99700 1 -- 172.21.15.115:0/1588330006 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467102377 0 0) 0x7f12441553f0 con 0x7f1244063260 2023-07-27T14:35:24.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1248d99700 1 -- 172.21.15.115:0/1588330006 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12300033f0 con 0x7f1244063260 2023-07-27T14:35:24.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1248d99700 1 -- 172.21.15.115:0/1588330006 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331629641 0 0) 0x7f12300033f0 con 0x7f1244063260 2023-07-27T14:35:24.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1249d9b700 1 -- 172.21.15.115:0/1588330006 >> v1:172.21.15.159:6789/0 conn(0x7f124414b1e0 legacy=0x7f1244062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1249d9b700 1 -- 172.21.15.115:0/1588330006 >> v1:172.21.15.115:6789/0 conn(0x7f1244063260 legacy=0x7f12440a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1249d9b700 1 -- 172.21.15.115:0/1588330006 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244157ff0 con 0x7f124414ae00 2023-07-27T14:35:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1249d9b700 1 --2- 172.21.15.115:0/1588330006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f124414ae00 0x7f1244154f00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1240009760 tx=0x7f1240009060).ready entity=mon.1 client_cookie=90e6b964739264ba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1248d99700 1 -- 172.21.15.115:0/1588330006 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0017f0 con 0x7f124414ae00 2023-07-27T14:35:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1248d99700 1 -- 172.21.15.115:0/1588330006 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1240011400 con 0x7f124414ae00 2023-07-27T14:35:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.493+0000 7f1248d99700 1 -- 172.21.15.115:0/1588330006 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240011780 con 0x7f124414ae00 2023-07-27T14:35:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.494+0000 7f124bfff700 1 -- 172.21.15.115:0/1588330006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f124414ae00 msgr2=0x7f1244154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.494+0000 7f124bfff700 1 --2- 172.21.15.115:0/1588330006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f124414ae00 0x7f1244154f00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1240009760 tx=0x7f1240009060).stop 2023-07-27T14:35:24.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.494+0000 7f124bfff700 1 -- 172.21.15.115:0/1588330006 shutdown_connections 2023-07-27T14:35:24.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.494+0000 7f124bfff700 1 --2- 172.21.15.115:0/1588330006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f124414ae00 0x7f1244154f00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.494+0000 7f124bfff700 1 -- 172.21.15.115:0/1588330006 >> 172.21.15.115:0/1588330006 conn(0x7f124405e940 msgr2=0x7f12440cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:24.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.494+0000 7f124bfff700 1 -- 172.21.15.115:0/1588330006 shutdown_connections 2023-07-27T14:35:24.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.494+0000 7f124bfff700 1 -- 172.21.15.115:0/1588330006 wait complete. 2023-07-27T14:35:24.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.495+0000 7f124bfff700 1 Processor -- start 2023-07-27T14:35:24.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.496+0000 7f124bfff700 1 -- start start 2023-07-27T14:35:24.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.496+0000 7f124bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1244063260 0x7f12440c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.496+0000 7f124bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f124414ae00 0x7f124414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.496+0000 7f124bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f124414b1e0 0x7f1244149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.496+0000 7f124bfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440c9880 con 0x7f124414ae00 2023-07-27T14:35:24.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.496+0000 7f124bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124414de90 con 0x7f1244063260 2023-07-27T14:35:24.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.496+0000 7f124bfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124414d020 con 0x7f124414b1e0 2023-07-27T14:35:24.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f124414ae00 0x7f124414cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f124414ae00 0x7f124414cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40934/0 (socket says 172.21.15.115:40934) 2023-07-27T14:35:24.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 -- 172.21.15.115:0/1711914811 learned_addr learned my addr 172.21.15.115:0/1711914811 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:24.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 -- 172.21.15.115:0/1711914811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f124414b1e0 msgr2=0x7f1244149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f1249d9b700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1244063260 0x7f12440c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f124414b1e0 0x7f1244149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:24.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 -- 172.21.15.115:0/1711914811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1244063260 msgr2=0x7f12440c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1244063260 0x7f12440c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 -- 172.21.15.115:0/1711914811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400092a0 con 0x7f124414ae00 2023-07-27T14:35:24.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f1249d9b700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1244063260 0x7f12440c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:24.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.497+0000 7f124959a700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f124414ae00 0x7f124414cb30 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f123400c4c0 tx=0x7f1234007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:24.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.498+0000 7f1239ffb700 1 -- 172.21.15.115:0/1711914811 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234007020 con 0x7f124414ae00 2023-07-27T14:35:24.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.498+0000 7f1239ffb700 1 -- 172.21.15.115:0/1711914811 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1234007180 con 0x7f124414ae00 2023-07-27T14:35:24.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.498+0000 7f1239ffb700 1 -- 172.21.15.115:0/1711914811 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234007520 con 0x7f124414ae00 2023-07-27T14:35:24.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.498+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1244149d20 con 0x7f124414ae00 2023-07-27T14:35:24.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.498+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124414d560 con 0x7f124414ae00 2023-07-27T14:35:24.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.499+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124406c470 con 0x7f124414ae00 2023-07-27T14:35:24.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.499+0000 7f1239ffb700 1 -- 172.21.15.115:0/1711914811 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7f1234010070 con 0x7f124414ae00 2023-07-27T14:35:24.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.500+0000 7f1239ffb700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f122805f7f0 0x7f1228061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:24.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.500+0000 7f1239ffb700 1 -- 172.21.15.115:0/1711914811 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1234079f20 con 0x7f124414ae00 2023-07-27T14:35:24.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.500+0000 7f1249d9b700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f122805f7f0 0x7f1228061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:24.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.501+0000 7f1249d9b700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f122805f7f0 0x7f1228061cb0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1240000e10 tx=0x7f1240014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:24.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.504+0000 7f1239ffb700 1 -- 172.21.15.115:0/1711914811 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12340478f0 con 0x7f124414ae00 2023-07-27T14:35:24.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.706+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000185025", "target": ["mon-mgr", ""]}) v1 -- 0x7f1244064150 con 0x7f122805f7f0 2023-07-27T14:35:24.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.712+0000 7f1239ffb700 1 -- 172.21.15.115:0/1711914811 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f1244064150 con 0x7f122805f7f0 2023-07-27T14:35:24.757 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a 2023-07-27T14:35:24.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f122805f7f0 msgr2=0x7f1228061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f122805f7f0 0x7f1228061cb0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1240000e10 tx=0x7f1240014000).stop 2023-07-27T14:35:24.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f124414ae00 msgr2=0x7f124414cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:24.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f124414ae00 0x7f124414cb30 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f123400c4c0 tx=0x7f1234007dd0).stop 2023-07-27T14:35:24.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 shutdown_connections 2023-07-27T14:35:24.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f122805f7f0 0x7f1228061cb0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f124414b1e0 0x7f1244149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:35:24.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1244063260 0x7f12440c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 --2- 172.21.15.115:0/1711914811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f124414ae00 0x7f124414cb30 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:24.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 >> 172.21.15.115:0/1711914811 conn(0x7f124405e940 msgr2=0x7f1244064950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:24.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 shutdown_connections 2023-07-27T14:35:24.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:24.714+0000 7f124bfff700 1 -- 172.21.15.115:0/1711914811 wait complete. 2023-07-27T14:35:24.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:24.776 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:24.824 INFO:teuthology.orchestra.run.smithi115.stdout:65 2023-07-27T14:35:24.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:24.825 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a) 2023-07-27T14:35:24.872 INFO:teuthology.orchestra.run.smithi115.stdout:65 2023-07-27T14:35:24.873 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs clone_0000000000185025 2023-07-27T14:35:25.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.020+0000 7f580bbff700 1 Processor -- start 2023-07-27T14:35:25.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.021+0000 7f580bbff700 1 -- start start 2023-07-27T14:35:25.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580bbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5804153e00 0x7f58040c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:25.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804065de0 0x7f5804062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:25.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580bbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5804064a80 con 0x7f5804064230 2023-07-27T14:35:25.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580bbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5804062320 con 0x7f5804153e00 2023-07-27T14:35:25.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5804064d60 con 0x7f5804065de0 2023-07-27T14:35:25.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580999b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5804153e00 0x7f58040c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:25.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580999b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5804153e00 0x7f58040c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40940/0 (socket says 172.21.15.115:40940) 2023-07-27T14:35:25.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580999b700 1 -- 172.21.15.115:0/1147879570 learned_addr learned my addr 172.21.15.115:0/1147879570 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:25.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580a19c700 1 --2- 172.21.15.115:0/1147879570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804065de0 0x7f5804062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:25.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580999b700 1 -- 172.21.15.115:0/1147879570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804065de0 msgr2=0x7f5804062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:25.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.022+0000 7f580999b700 1 --2- 172.21.15.115:0/1147879570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804065de0 0x7f5804062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f580999b700 1 -- 172.21.15.115:0/1147879570 >> v1:172.21.15.159:6789/0 conn(0x7f5804064230 legacy=0x7f58040656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:35:25.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f580999b700 1 -- 172.21.15.115:0/1147879570 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804065040 con 0x7f5804153e00 2023-07-27T14:35:25.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f580a19c700 1 --2- 172.21.15.115:0/1147879570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804065de0 0x7f5804062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:35:25.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f580999b700 1 --2- 172.21.15.115:0/1147879570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f58040c6b70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f5800006fd0 tx=0x7f58000090f0).ready entity=mon.0 client_cookie=3b7eae4085ca2078 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:25.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f5808999700 1 -- 172.21.15.115:0/1147879570 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000b600 con 0x7f5804153e00 2023-07-27T14:35:25.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f5808999700 1 -- 172.21.15.115:0/1147879570 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580000b760 con 0x7f5804153e00 2023-07-27T14:35:25.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f5808999700 1 -- 172.21.15.115:0/1147879570 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000bae0 con 0x7f5804153e00 2023-07-27T14:35:25.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f580bbff700 1 -- 172.21.15.115:0/1147879570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 msgr2=0x7f58040c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:25.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f580bbff700 1 --2- 172.21.15.115:0/1147879570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f58040c6b70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f5800006fd0 tx=0x7f58000090f0).stop 2023-07-27T14:35:25.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f580bbff700 1 -- 172.21.15.115:0/1147879570 shutdown_connections 2023-07-27T14:35:25.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.023+0000 7f580bbff700 1 --2- 172.21.15.115:0/1147879570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804065de0 0x7f5804062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.024+0000 7f580bbff700 1 --2- 172.21.15.115:0/1147879570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f58040c6b70 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.024+0000 7f580bbff700 1 -- 172.21.15.115:0/1147879570 >> 172.21.15.115:0/1147879570 conn(0x7f58040c7b90 msgr2=0x7f58040c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:25.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.024+0000 7f580bbff700 1 -- 172.21.15.115:0/1147879570 shutdown_connections 2023-07-27T14:35:25.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.024+0000 7f580bbff700 1 -- 172.21.15.115:0/1147879570 wait complete. 2023-07-27T14:35:25.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.026+0000 7f580bbff700 1 Processor -- start 2023-07-27T14:35:25.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.026+0000 7f580bbff700 1 -- start start 2023-07-27T14:35:25.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804064230 0x7f58040a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:25.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580bbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5804065de0 0x7f58041481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:25.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580bbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f5804150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:25.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580bbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040a7e90 con 0x7f5804153e00 2023-07-27T14:35:25.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580bbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040a8170 con 0x7f5804065de0 2023-07-27T14:35:25.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58040a8450 con 0x7f5804064230 2023-07-27T14:35:25.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580a19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f5804150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:25.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580a19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f5804150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40946/0 (socket says 172.21.15.115:40946) 2023-07-27T14:35:25.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580a19c700 1 -- 172.21.15.115:0/3383018778 learned_addr learned my addr 172.21.15.115:0/3383018778 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:35:25.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580999b700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804064230 0x7f58040a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:25.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.027+0000 7f580919a700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5804065de0 0x7f58041481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:25.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f580a19c700 1 -- 172.21.15.115:0/3383018778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804064230 msgr2=0x7f58040a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:25.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f580a19c700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804064230 0x7f58040a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f580a19c700 1 -- 172.21.15.115:0/3383018778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5804065de0 msgr2=0x7f58041481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f580a19c700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5804065de0 0x7f58041481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f580a19c700 1 -- 172.21.15.115:0/3383018778 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800009370 con 0x7f5804153e00 2023-07-27T14:35:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f580a19c700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f5804150620 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f57fc00a380 tx=0x7f57fc007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f57f9ffb700 1 -- 172.21.15.115:0/3383018778 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc016470 con 0x7f5804153e00 2023-07-27T14:35:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f57f9ffb700 1 -- 172.21.15.115:0/3383018778 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc0165d0 con 0x7f5804153e00 2023-07-27T14:35:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58040a8730 con 0x7f5804153e00 2023-07-27T14:35:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f57f9ffb700 1 -- 172.21.15.115:0/3383018778 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc016950 con 0x7f5804153e00 2023-07-27T14:35:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.028+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58041486c0 con 0x7f5804153e00 2023-07-27T14:35:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.029+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58040a8c50 con 0x7f5804153e00 2023-07-27T14:35:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.030+0000 7f57f9ffb700 1 -- 172.21.15.115:0/3383018778 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7f57fc01d060 con 0x7f5804153e00 2023-07-27T14:35:25.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.031+0000 7f57f9ffb700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57e805f7f0 0x7f57e8061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:35:25.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.031+0000 7f57f9ffb700 1 -- 172.21.15.115:0/3383018778 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f57fc07b5c0 con 0x7f5804153e00 2023-07-27T14:35:25.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.031+0000 7f580999b700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57e805f7f0 0x7f57e8061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:35:25.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.032+0000 7f580999b700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57e805f7f0 0x7f57e8061cb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5800009130 tx=0x7f5800017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:35:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.035+0000 7f57f9ffb700 1 -- 172.21.15.115:0/3383018778 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57fc04c100 con 0x7f5804153e00 2023-07-27T14:35:25.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.234+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "clone_0000000000185025", "target": ["mon-mgr", ""]}) v1 -- 0x7f5804148940 con 0x7f57e805f7f0 2023-07-27T14:35:25.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.241+0000 7f57f9ffb700 1 -- 172.21.15.115:0/3383018778 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+714 (secure 0 0 0) 0x7f5804148940 con 0x7f57e805f7f0 2023-07-27T14:35:25.286 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:35:25.287 INFO:teuthology.orchestra.run.smithi115.stdout: "atime": "2023-07-27 14:35:12", 2023-07-27T14:35:25.287 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_pcent": "undefined", 2023-07-27T14:35:25.287 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_quota": "infinite", 2023-07-27T14:35:25.287 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_used": 67108864, 2023-07-27T14:35:25.287 INFO:teuthology.orchestra.run.smithi115.stdout: "created_at": "2023-07-27 14:35:18", 2023-07-27T14:35:25.287 INFO:teuthology.orchestra.run.smithi115.stdout: "ctime": "2023-07-27 14:35:22", 2023-07-27T14:35:25.288 INFO:teuthology.orchestra.run.smithi115.stdout: "data_pool": "cephfs_data", 2023-07-27T14:35:25.288 INFO:teuthology.orchestra.run.smithi115.stdout: "features": [ 2023-07-27T14:35:25.288 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-clone", 2023-07-27T14:35:25.288 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-autoprotect", 2023-07-27T14:35:25.288 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-retention" 2023-07-27T14:35:25.288 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:35:25.288 INFO:teuthology.orchestra.run.smithi115.stdout: "gid": 0, 2023-07-27T14:35:25.289 INFO:teuthology.orchestra.run.smithi115.stdout: "mode": 16895, 2023-07-27T14:35:25.289 INFO:teuthology.orchestra.run.smithi115.stdout: "mon_addrs": [ 2023-07-27T14:35:25.289 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.115:6789", 2023-07-27T14:35:25.289 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6789", 2023-07-27T14:35:25.289 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6790" 2023-07-27T14:35:25.289 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:35:25.289 INFO:teuthology.orchestra.run.smithi115.stdout: "mtime": "2023-07-27 14:35:17", 2023-07-27T14:35:25.289 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a", 2023-07-27T14:35:25.290 INFO:teuthology.orchestra.run.smithi115.stdout: "pool_namespace": "", 2023-07-27T14:35:25.290 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete", 2023-07-27T14:35:25.290 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "clone", 2023-07-27T14:35:25.290 INFO:teuthology.orchestra.run.smithi115.stdout: "uid": 0 2023-07-27T14:35:25.290 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:35:25.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.243+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57e805f7f0 msgr2=0x7f57e8061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:25.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.243+0000 7f580bbff700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57e805f7f0 0x7f57e8061cb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5800009130 tx=0x7f5800017000).stop 2023-07-27T14:35:25.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.243+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 msgr2=0x7f5804150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:35:25.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.243+0000 7f580bbff700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f5804150620 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f57fc00a380 tx=0x7f57fc007900).stop 2023-07-27T14:35:25.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.244+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 shutdown_connections 2023-07-27T14:35:25.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.244+0000 7f580bbff700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f57e805f7f0 0x7f57e8061cb0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.244+0000 7f580bbff700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5804153e00 0x7f5804150620 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.244+0000 7f580bbff700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5804064230 0x7f58040a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.244+0000 7f580bbff700 1 --2- 172.21.15.115:0/3383018778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5804065de0 0x7f58041481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:35:25.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.244+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 >> 172.21.15.115:0/3383018778 conn(0x7f58040c7b90 msgr2=0x7f58040c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:35:25.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.244+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 shutdown_connections 2023-07-27T14:35:25.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:35:25.244+0000 7f580bbff700 1 -- 172.21.15.115:0/3383018778 wait complete. 2023-07-27T14:35:25.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.306 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11: ceph.quota.max_bytes: No such attribute 2023-07-27T14:35:25.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:35:25.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.354 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:25.442 INFO:teuthology.orchestra.run.smithi115.stdout:cephfs_data 2023-07-27T14:35:25.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.443 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:25.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.492 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:25.580 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11 2023-07-27T14:35:25.580 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.49 2023-07-27T14:35:25.581 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.22 2023-07-27T14:35:25.581 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.20 2023-07-27T14:35:25.581 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.34 2023-07-27T14:35:25.581 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.55 2023-07-27T14:35:25.581 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.2 2023-07-27T14:35:25.581 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.35 2023-07-27T14:35:25.581 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.30 2023-07-27T14:35:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.14 2023-07-27T14:35:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.26 2023-07-27T14:35:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.51 2023-07-27T14:35:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.50 2023-07-27T14:35:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.13 2023-07-27T14:35:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.10 2023-07-27T14:35:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.47 2023-07-27T14:35:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.5 2023-07-27T14:35:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.37 2023-07-27T14:35:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.39 2023-07-27T14:35:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.54 2023-07-27T14:35:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.36 2023-07-27T14:35:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.18 2023-07-27T14:35:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.17 2023-07-27T14:35:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.4 2023-07-27T14:35:25.583 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.58 2023-07-27T14:35:25.584 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.29 2023-07-27T14:35:25.584 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.38 2023-07-27T14:35:25.584 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.19 2023-07-27T14:35:25.584 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.7 2023-07-27T14:35:25.584 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.48 2023-07-27T14:35:25.584 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.57 2023-07-27T14:35:25.584 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.6 2023-07-27T14:35:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.53 2023-07-27T14:35:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.40 2023-07-27T14:35:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.42 2023-07-27T14:35:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.0 2023-07-27T14:35:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.27 2023-07-27T14:35:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.25 2023-07-27T14:35:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.32 2023-07-27T14:35:25.586 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.28 2023-07-27T14:35:25.586 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.21 2023-07-27T14:35:25.586 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.9 2023-07-27T14:35:25.586 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.23 2023-07-27T14:35:25.586 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.15 2023-07-27T14:35:25.587 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.8 2023-07-27T14:35:25.587 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.46 2023-07-27T14:35:25.587 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.33 2023-07-27T14:35:25.587 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.45 2023-07-27T14:35:25.587 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.61 2023-07-27T14:35:25.587 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.62 2023-07-27T14:35:25.587 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.52 2023-07-27T14:35:25.588 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.11 2023-07-27T14:35:25.588 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.44 2023-07-27T14:35:25.588 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.3 2023-07-27T14:35:25.588 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.24 2023-07-27T14:35:25.588 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.56 2023-07-27T14:35:25.588 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.63 2023-07-27T14:35:25.588 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.59 2023-07-27T14:35:25.588 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.41 2023-07-27T14:35:25.589 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.12 2023-07-27T14:35:25.589 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.43 2023-07-27T14:35:25.589 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.16 2023-07-27T14:35:25.589 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.31 2023-07-27T14:35:25.589 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.1 2023-07-27T14:35:25.589 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.60 2023-07-27T14:35:25.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.591 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:25.636 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:35:25.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.638 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/) 2023-07-27T14:35:25.684 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:35:25.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.685 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:25.770 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:35:25.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.772 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/) 2023-07-27T14:35:25.857 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:35:25.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.859 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:25.904 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:35:25.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.905 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/) 2023-07-27T14:35:25.990 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:35:25.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:25.992 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11) 2023-07-27T14:35:26.037 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:35:26.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.039 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/) 2023-07-27T14:35:26.124 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:35:26.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.126 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.49) 2023-07-27T14:35:26.211 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:26.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.213 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.49) 2023-07-27T14:35:26.263 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:26.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.264 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.49) 2023-07-27T14:35:26.310 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:26.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.313 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.49) 2023-07-27T14:35:26.359 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:26.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.360 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.49) 2023-07-27T14:35:26.445 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:26.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.446 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.49) 2023-07-27T14:35:26.532 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:26.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.533 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.49) 2023-07-27T14:35:26.618 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:26.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.620 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.49) 2023-07-27T14:35:26.666 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:26.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.668 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.22) 2023-07-27T14:35:26.714 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:26.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.716 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.22) 2023-07-27T14:35:26.789 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:26.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.791 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.22) 2023-07-27T14:35:26.837 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:26.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.839 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.22) 2023-07-27T14:35:26.924 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:26.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:26.926 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.22) 2023-07-27T14:35:27.011 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:27.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.013 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.22) 2023-07-27T14:35:27.058 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:27.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.059 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.22) 2023-07-27T14:35:27.145 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:27.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.146 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.22) 2023-07-27T14:35:27.232 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:27.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.234 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.20) 2023-07-27T14:35:27.279 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:27.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.281 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.20) 2023-07-27T14:35:27.327 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:27.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.328 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.20) 2023-07-27T14:35:27.373 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:27.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.375 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.20) 2023-07-27T14:35:27.459 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:27.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.461 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.20) 2023-07-27T14:35:27.506 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:27.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.507 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.20) 2023-07-27T14:35:27.594 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:27.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.595 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.20) 2023-07-27T14:35:27.681 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:27.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.683 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.20) 2023-07-27T14:35:27.728 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:27.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.730 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.34) 2023-07-27T14:35:27.775 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:27.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.776 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.34) 2023-07-27T14:35:27.863 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:27.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.865 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.34) 2023-07-27T14:35:27.910 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:27.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.911 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.34) 2023-07-27T14:35:27.996 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:27.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:27.998 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.34) 2023-07-27T14:35:28.083 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:28.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.085 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.34) 2023-07-27T14:35:28.170 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:28.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.171 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.34) 2023-07-27T14:35:28.257 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:28.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.260 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.34) 2023-07-27T14:35:28.344 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:28.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.346 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.55) 2023-07-27T14:35:28.391 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:28.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.393 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.55) 2023-07-27T14:35:28.479 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:28.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.480 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.55) 2023-07-27T14:35:28.525 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:28.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.527 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.55) 2023-07-27T14:35:28.612 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:28.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.614 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.55) 2023-07-27T14:35:28.699 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:28.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.701 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.55) 2023-07-27T14:35:28.787 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:28.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.788 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.55) 2023-07-27T14:35:28.873 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:28.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.874 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.55) 2023-07-27T14:35:28.959 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:28.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:28.960 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.2) 2023-07-27T14:35:29.045 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:29.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.047 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.2) 2023-07-27T14:35:29.132 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:29.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.134 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.2) 2023-07-27T14:35:29.179 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:29.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.180 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.2) 2023-07-27T14:35:29.225 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:29.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.227 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.2) 2023-07-27T14:35:29.272 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:29.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.274 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.2) 2023-07-27T14:35:29.360 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:29.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.361 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.2) 2023-07-27T14:35:29.447 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:29.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.448 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.2) 2023-07-27T14:35:29.493 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:29.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.495 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.35) 2023-07-27T14:35:29.540 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:29.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.542 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.35) 2023-07-27T14:35:29.628 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:29.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.629 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.35) 2023-07-27T14:35:29.674 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:29.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.676 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.35) 2023-07-27T14:35:29.761 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:29.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.762 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.35) 2023-07-27T14:35:29.807 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:29.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.809 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.35) 2023-07-27T14:35:29.854 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:29.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.855 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.35) 2023-07-27T14:35:29.942 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:29.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.943 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.35) 2023-07-27T14:35:29.989 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:29.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:29.990 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.30) 2023-07-27T14:35:30.035 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:30.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.037 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.30) 2023-07-27T14:35:30.122 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:30.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.124 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.30) 2023-07-27T14:35:30.209 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:30.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.210 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.30) 2023-07-27T14:35:30.296 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:30.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.297 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.30) 2023-07-27T14:35:30.382 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:30.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.384 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.30) 2023-07-27T14:35:30.429 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:30.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.430 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.30) 2023-07-27T14:35:30.516 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:30.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.518 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.30) 2023-07-27T14:35:30.603 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:30.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.604 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.14) 2023-07-27T14:35:30.650 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:30.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.652 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.14) 2023-07-27T14:35:30.738 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:30.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.739 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.14) 2023-07-27T14:35:30.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:35:30.786 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:35:30.826 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:30.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.827 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.14) 2023-07-27T14:35:30.913 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:30.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:30.914 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.14) 2023-07-27T14:35:30.999 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:31.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.001 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.14) 2023-07-27T14:35:31.086 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:31.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.088 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.14) 2023-07-27T14:35:31.173 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:31.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.175 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.14) 2023-07-27T14:35:31.261 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:31.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.262 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.26) 2023-07-27T14:35:31.307 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:31.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.309 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.26) 2023-07-27T14:35:31.395 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:31.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.397 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.26) 2023-07-27T14:35:31.482 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:31.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.484 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.26) 2023-07-27T14:35:31.569 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:31.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.570 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.26) 2023-07-27T14:35:31.656 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:31.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.657 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.26) 2023-07-27T14:35:31.702 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:31.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.703 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.26) 2023-07-27T14:35:31.789 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:31.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.790 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.26) 2023-07-27T14:35:31.835 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:31.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.837 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.51) 2023-07-27T14:35:31.884 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:31.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.885 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.51) 2023-07-27T14:35:31.931 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:31.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.933 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.51) 2023-07-27T14:35:31.979 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:31.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:31.981 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.51) 2023-07-27T14:35:32.026 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:32.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.027 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.51) 2023-07-27T14:35:32.072 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:32.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.074 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.51) 2023-07-27T14:35:32.159 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:32.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.161 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.51) 2023-07-27T14:35:32.247 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:32.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.248 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.51) 2023-07-27T14:35:32.294 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:32.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.295 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.50) 2023-07-27T14:35:32.342 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:32.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.342 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.50) 2023-07-27T14:35:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:32.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.429 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.50) 2023-07-27T14:35:32.515 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:32.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.516 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.50) 2023-07-27T14:35:32.562 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:32.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.563 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.50) 2023-07-27T14:35:32.609 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:32.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.611 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.50) 2023-07-27T14:35:32.656 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:32.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.658 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.50) 2023-07-27T14:35:32.703 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:32.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.704 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.50) 2023-07-27T14:35:32.789 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:32.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.791 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.13) 2023-07-27T14:35:32.876 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:32.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.878 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.13) 2023-07-27T14:35:32.967 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:32.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:32.968 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.13) 2023-07-27T14:35:33.014 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:33.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.015 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.13) 2023-07-27T14:35:33.061 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:33.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.062 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.13) 2023-07-27T14:35:33.107 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:33.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.109 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.13) 2023-07-27T14:35:33.195 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:33.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.196 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.13) 2023-07-27T14:35:33.281 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:33.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.282 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.13) 2023-07-27T14:35:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:33.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.369 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.10) 2023-07-27T14:35:33.456 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:33.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.457 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.10) 2023-07-27T14:35:33.503 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:33.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.505 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.10) 2023-07-27T14:35:33.550 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:33.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.552 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.10) 2023-07-27T14:35:33.638 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:33.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.10) 2023-07-27T14:35:33.725 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:33.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.726 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.10) 2023-07-27T14:35:33.773 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:33.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.774 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.10) 2023-07-27T14:35:33.859 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:33.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.860 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.10) 2023-07-27T14:35:33.906 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:33.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.907 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.47) 2023-07-27T14:35:33.952 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:33.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:33.954 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.47) 2023-07-27T14:35:34.040 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:34.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.042 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.47) 2023-07-27T14:35:34.087 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:34.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.089 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.47) 2023-07-27T14:35:34.135 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:34.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.137 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.47) 2023-07-27T14:35:34.183 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:34.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.185 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.47) 2023-07-27T14:35:34.231 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:34.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.232 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.47) 2023-07-27T14:35:34.278 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:34.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.279 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.47) 2023-07-27T14:35:34.364 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:34.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.366 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.5) 2023-07-27T14:35:34.451 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:34.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.452 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.5) 2023-07-27T14:35:34.498 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:34.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.500 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.5) 2023-07-27T14:35:34.544 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:34.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.546 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.5) 2023-07-27T14:35:34.632 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:34.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.633 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.5) 2023-07-27T14:35:34.719 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:34.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.720 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.5) 2023-07-27T14:35:34.766 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:34.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.768 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.5) 2023-07-27T14:35:34.814 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:34.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.815 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.5) 2023-07-27T14:35:34.860 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:34.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.862 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.37) 2023-07-27T14:35:34.948 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:34.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.949 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.37) 2023-07-27T14:35:34.995 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:34.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:34.997 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.37) 2023-07-27T14:35:35.082 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:35.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.084 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.37) 2023-07-27T14:35:35.169 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:35.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.171 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.37) 2023-07-27T14:35:35.256 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:35.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.257 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.37) 2023-07-27T14:35:35.342 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:35.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.344 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.37) 2023-07-27T14:35:35.430 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:35.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.431 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.37) 2023-07-27T14:35:35.517 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:35.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.518 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.39) 2023-07-27T14:35:35.604 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:35.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.606 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.39) 2023-07-27T14:35:35.692 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:35.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.694 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.39) 2023-07-27T14:35:35.740 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:35.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.742 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.39) 2023-07-27T14:35:35.788 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:35.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.790 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.39) 2023-07-27T14:35:35.874 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:35.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.875 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.39) 2023-07-27T14:35:35.961 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:35.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:35.962 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.39) 2023-07-27T14:35:36.008 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:36.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.009 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.39) 2023-07-27T14:35:36.054 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:36.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.056 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.54) 2023-07-27T14:35:36.142 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:36.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.143 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.54) 2023-07-27T14:35:36.229 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:36.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.230 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.54) 2023-07-27T14:35:36.316 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:36.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.318 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.54) 2023-07-27T14:35:36.364 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:36.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.366 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.54) 2023-07-27T14:35:36.451 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:36.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.453 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.54) 2023-07-27T14:35:36.538 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:36.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.540 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.54) 2023-07-27T14:35:36.625 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:36.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.627 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.54) 2023-07-27T14:35:36.712 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:36.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.714 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.36) 2023-07-27T14:35:36.759 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:36.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.761 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.36) 2023-07-27T14:35:36.848 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:36.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.849 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.36) 2023-07-27T14:35:36.895 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:36.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.896 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.36) 2023-07-27T14:35:36.942 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:36.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.944 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.36) 2023-07-27T14:35:36.993 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:36.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:36.995 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.36) 2023-07-27T14:35:37.040 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:37.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.042 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.36) 2023-07-27T14:35:37.127 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:37.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.129 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.36) 2023-07-27T14:35:37.215 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:37.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.217 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.18) 2023-07-27T14:35:37.262 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:37.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.263 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.18) 2023-07-27T14:35:37.349 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:37.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.351 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.18) 2023-07-27T14:35:37.436 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:37.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.438 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.18) 2023-07-27T14:35:37.524 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:37.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.525 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.18) 2023-07-27T14:35:37.571 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:37.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.575 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.18) 2023-07-27T14:35:37.659 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:37.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.661 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.18) 2023-07-27T14:35:37.706 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:37.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.708 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.18) 2023-07-27T14:35:37.793 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:37.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.795 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.17) 2023-07-27T14:35:37.840 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:37.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.842 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.17) 2023-07-27T14:35:37.888 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:37.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.890 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.17) 2023-07-27T14:35:37.935 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:37.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:37.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.17) 2023-07-27T14:35:38.021 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:38.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.023 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.17) 2023-07-27T14:35:38.109 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:38.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.110 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.17) 2023-07-27T14:35:38.155 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:38.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.156 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.17) 2023-07-27T14:35:38.242 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:38.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.243 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.17) 2023-07-27T14:35:38.289 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:38.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.290 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.4) 2023-07-27T14:35:38.376 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:38.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.377 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.4) 2023-07-27T14:35:38.463 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:38.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.465 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.4) 2023-07-27T14:35:38.510 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:38.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.512 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.4) 2023-07-27T14:35:38.597 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:38.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.598 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.4) 2023-07-27T14:35:38.644 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:38.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.646 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.4) 2023-07-27T14:35:38.691 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:38.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.692 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.4) 2023-07-27T14:35:38.778 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:38.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.779 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.4) 2023-07-27T14:35:38.824 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:38.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.826 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.58) 2023-07-27T14:35:38.911 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:38.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.913 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.58) 2023-07-27T14:35:38.961 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:38.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:38.962 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.58) 2023-07-27T14:35:39.048 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:39.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.049 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.58) 2023-07-27T14:35:39.095 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:39.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.097 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.58) 2023-07-27T14:35:39.143 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:39.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.144 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.58) 2023-07-27T14:35:39.229 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:39.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.231 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.58) 2023-07-27T14:35:39.316 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:39.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.317 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.58) 2023-07-27T14:35:39.403 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:39.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.405 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.29) 2023-07-27T14:35:39.490 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:39.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.491 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.29) 2023-07-27T14:35:39.537 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:39.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.539 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.29) 2023-07-27T14:35:39.584 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:39.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.586 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.29) 2023-07-27T14:35:39.671 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:39.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.672 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.29) 2023-07-27T14:35:39.758 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:39.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.760 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.29) 2023-07-27T14:35:39.845 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:39.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.847 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.29) 2023-07-27T14:35:39.932 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:39.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:39.934 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.29) 2023-07-27T14:35:40.020 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:40.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.021 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.38) 2023-07-27T14:35:40.067 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:40.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.068 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.38) 2023-07-27T14:35:40.155 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:40.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.156 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.38) 2023-07-27T14:35:40.241 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:40.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.243 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.38) 2023-07-27T14:35:40.328 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:40.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.330 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.38) 2023-07-27T14:35:40.415 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:40.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.416 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.38) 2023-07-27T14:35:40.503 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:40.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.504 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.38) 2023-07-27T14:35:40.550 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:40.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.551 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.38) 2023-07-27T14:35:40.637 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:40.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.19) 2023-07-27T14:35:40.684 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:40.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.687 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.19) 2023-07-27T14:35:40.734 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:40.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.735 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.19) 2023-07-27T14:35:40.781 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:40.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.783 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.19) 2023-07-27T14:35:40.870 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:40.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.871 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.19) 2023-07-27T14:35:40.920 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:40.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:40.921 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.19) 2023-07-27T14:35:41.008 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:41.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.009 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.19) 2023-07-27T14:35:41.056 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:41.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.058 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.19) 2023-07-27T14:35:41.142 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:41.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.144 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.7) 2023-07-27T14:35:41.229 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:41.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.231 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.7) 2023-07-27T14:35:41.317 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:41.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.319 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.7) 2023-07-27T14:35:41.364 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:41.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.366 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.7) 2023-07-27T14:35:41.452 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:41.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.454 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.7) 2023-07-27T14:35:41.499 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:41.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.501 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.7) 2023-07-27T14:35:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:41.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.587 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.7) 2023-07-27T14:35:41.673 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:41.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.674 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.7) 2023-07-27T14:35:41.760 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:41.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.761 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.48) 2023-07-27T14:35:41.847 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:41.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.848 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.48) 2023-07-27T14:35:41.935 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:41.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.936 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.48) 2023-07-27T14:35:41.982 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:41.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:41.983 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.48) 2023-07-27T14:35:42.070 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:42.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.114 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.48) 2023-07-27T14:35:42.159 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:42.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.161 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.48) 2023-07-27T14:35:42.246 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:42.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.247 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.48) 2023-07-27T14:35:42.332 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:42.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.334 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.48) 2023-07-27T14:35:42.419 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:42.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.420 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.57) 2023-07-27T14:35:42.505 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:42.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.507 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.57) 2023-07-27T14:35:42.592 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:42.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.594 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.57) 2023-07-27T14:35:42.639 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:42.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.641 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.57) 2023-07-27T14:35:42.687 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:42.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.689 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.57) 2023-07-27T14:35:42.774 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:42.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.775 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.57) 2023-07-27T14:35:42.861 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:42.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.863 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.57) 2023-07-27T14:35:42.909 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:42.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.911 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.57) 2023-07-27T14:35:42.956 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:42.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:42.958 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.6) 2023-07-27T14:35:43.042 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:43.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.044 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.6) 2023-07-27T14:35:43.130 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:43.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.131 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.6) 2023-07-27T14:35:43.177 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:43.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.178 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.6) 2023-07-27T14:35:43.224 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:43.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.225 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.6) 2023-07-27T14:35:43.271 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:43.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.272 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.6) 2023-07-27T14:35:43.357 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:43.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.359 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.6) 2023-07-27T14:35:43.444 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:43.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.446 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.6) 2023-07-27T14:35:43.491 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:43.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.492 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.53) 2023-07-27T14:35:43.577 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:43.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.579 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.53) 2023-07-27T14:35:43.665 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:43.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.666 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.53) 2023-07-27T14:35:43.752 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:43.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.753 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.53) 2023-07-27T14:35:43.839 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:43.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.841 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.53) 2023-07-27T14:35:43.886 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:43.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.888 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.53) 2023-07-27T14:35:43.934 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:43.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:43.936 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.53) 2023-07-27T14:35:44.021 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:44.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.023 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.53) 2023-07-27T14:35:44.069 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:44.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.070 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.40) 2023-07-27T14:35:44.156 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:44.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.157 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.40) 2023-07-27T14:35:44.244 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:44.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.245 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.40) 2023-07-27T14:35:44.331 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:44.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.333 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.40) 2023-07-27T14:35:44.378 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:44.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.379 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.40) 2023-07-27T14:35:44.425 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:44.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.426 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.40) 2023-07-27T14:35:44.511 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:44.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.512 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.40) 2023-07-27T14:35:44.597 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:44.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.599 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.40) 2023-07-27T14:35:44.683 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:44.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.685 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.42) 2023-07-27T14:35:44.771 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:44.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.772 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.42) 2023-07-27T14:35:44.818 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:44.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.819 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.42) 2023-07-27T14:35:44.865 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:44.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.866 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.42) 2023-07-27T14:35:44.952 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:44.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:44.954 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.42) 2023-07-27T14:35:44.999 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:45.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.001 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.42) 2023-07-27T14:35:45.086 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:45.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.088 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.42) 2023-07-27T14:35:45.173 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:45.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.175 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.42) 2023-07-27T14:35:45.260 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:45.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.261 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.0) 2023-07-27T14:35:45.347 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:45.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.348 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.0) 2023-07-27T14:35:45.435 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:45.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.437 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.0) 2023-07-27T14:35:45.483 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:45.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.484 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.0) 2023-07-27T14:35:45.530 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:45.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.533 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.0) 2023-07-27T14:35:45.578 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:45.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.580 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.0) 2023-07-27T14:35:45.665 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:45.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.667 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.0) 2023-07-27T14:35:45.712 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:45.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.713 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.0) 2023-07-27T14:35:45.799 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:45.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.801 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.27) 2023-07-27T14:35:45.845 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:45.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.847 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.27) 2023-07-27T14:35:45.933 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:45.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.934 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.27) 2023-07-27T14:35:45.979 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:45.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:45.981 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.27) 2023-07-27T14:35:46.026 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:46.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.028 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.27) 2023-07-27T14:35:46.073 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:46.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.074 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.27) 2023-07-27T14:35:46.159 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:46.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.161 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.27) 2023-07-27T14:35:46.246 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:46.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.247 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.27) 2023-07-27T14:35:46.333 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:46.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.335 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.25) 2023-07-27T14:35:46.381 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:46.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.382 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.25) 2023-07-27T14:35:46.468 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:46.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.470 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.25) 2023-07-27T14:35:46.555 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:46.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.557 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.25) 2023-07-27T14:35:46.602 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:46.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.603 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.25) 2023-07-27T14:35:46.688 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:46.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.690 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.25) 2023-07-27T14:35:46.775 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:46.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.777 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.25) 2023-07-27T14:35:46.822 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:46.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.824 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.25) 2023-07-27T14:35:46.909 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:46.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.910 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.32) 2023-07-27T14:35:46.996 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:46.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:46.997 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.32) 2023-07-27T14:35:47.083 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:47.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.084 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.32) 2023-07-27T14:35:47.170 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:47.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.172 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.32) 2023-07-27T14:35:47.217 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:47.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.218 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.32) 2023-07-27T14:35:47.303 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:47.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.304 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.32) 2023-07-27T14:35:47.389 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:47.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.390 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.32) 2023-07-27T14:35:47.476 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:47.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.478 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.32) 2023-07-27T14:35:47.564 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:47.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.565 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.28) 2023-07-27T14:35:47.611 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:47.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.613 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.28) 2023-07-27T14:35:47.660 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:47.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.661 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.28) 2023-07-27T14:35:47.706 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:47.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.708 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.28) 2023-07-27T14:35:47.793 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:47.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.794 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.28) 2023-07-27T14:35:47.880 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:47.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.882 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.28) 2023-07-27T14:35:47.928 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:47.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.929 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.28) 2023-07-27T14:35:47.974 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:47.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:47.976 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.28) 2023-07-27T14:35:48.021 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:48.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.023 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.21) 2023-07-27T14:35:48.068 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:48.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.070 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.21) 2023-07-27T14:35:48.156 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:48.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.157 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.21) 2023-07-27T14:35:48.203 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:48.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.204 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.21) 2023-07-27T14:35:48.290 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:48.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.292 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.21) 2023-07-27T14:35:48.377 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:48.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.379 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.21) 2023-07-27T14:35:48.464 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:48.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.466 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.21) 2023-07-27T14:35:48.551 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:48.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.553 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.21) 2023-07-27T14:35:48.640 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:48.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.641 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.9) 2023-07-27T14:35:48.687 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:48.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.688 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.9) 2023-07-27T14:35:48.734 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:48.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.736 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.9) 2023-07-27T14:35:48.781 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:48.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.782 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.9) 2023-07-27T14:35:48.868 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:48.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.870 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.9) 2023-07-27T14:35:48.915 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:48.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:48.916 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.9) 2023-07-27T14:35:49.004 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:49.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.005 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.9) 2023-07-27T14:35:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:49.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.052 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.9) 2023-07-27T14:35:49.097 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:49.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.099 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.23) 2023-07-27T14:35:49.144 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:49.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.146 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.23) 2023-07-27T14:35:49.192 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:49.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.193 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.23) 2023-07-27T14:35:49.239 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:49.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.240 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.23) 2023-07-27T14:35:49.285 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:49.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.287 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.23) 2023-07-27T14:35:49.372 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:49.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.374 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.23) 2023-07-27T14:35:49.461 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:49.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.463 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.23) 2023-07-27T14:35:49.508 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:49.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.510 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.23) 2023-07-27T14:35:49.595 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:49.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.596 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.15) 2023-07-27T14:35:49.682 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:49.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.684 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.15) 2023-07-27T14:35:49.730 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:49.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.731 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.15) 2023-07-27T14:35:49.821 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:49.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.823 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.15) 2023-07-27T14:35:49.869 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:49.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.871 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.15) 2023-07-27T14:35:49.917 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:49.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.918 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.15) 2023-07-27T14:35:49.964 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:49.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:49.965 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.15) 2023-07-27T14:35:50.010 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:50.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.012 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.15) 2023-07-27T14:35:50.097 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:50.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.099 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.8) 2023-07-27T14:35:50.184 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:50.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.186 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.8) 2023-07-27T14:35:50.232 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:50.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.233 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.8) 2023-07-27T14:35:50.279 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:50.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.281 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.8) 2023-07-27T14:35:50.365 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:50.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.367 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.8) 2023-07-27T14:35:50.453 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:50.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.454 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.8) 2023-07-27T14:35:50.500 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:50.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.501 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.8) 2023-07-27T14:35:50.547 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:50.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.548 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.8) 2023-07-27T14:35:50.633 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:50.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.634 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.46) 2023-07-27T14:35:50.720 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:50.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.721 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.46) 2023-07-27T14:35:50.809 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:50.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.811 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.46) 2023-07-27T14:35:50.857 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:50.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.858 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.46) 2023-07-27T14:35:50.943 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:50.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:50.945 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.46) 2023-07-27T14:35:51.030 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:51.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.032 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.46) 2023-07-27T14:35:51.117 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:51.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.118 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.46) 2023-07-27T14:35:51.204 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:51.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.205 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.46) 2023-07-27T14:35:51.291 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:51.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.293 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.33) 2023-07-27T14:35:51.378 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:51.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.380 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.33) 2023-07-27T14:35:51.465 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:51.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.467 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.33) 2023-07-27T14:35:51.552 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:51.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.554 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.33) 2023-07-27T14:35:51.640 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:51.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.641 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.33) 2023-07-27T14:35:51.730 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:51.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.731 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.33) 2023-07-27T14:35:51.816 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:51.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.818 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.33) 2023-07-27T14:35:51.903 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:51.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.905 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.33) 2023-07-27T14:35:51.990 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:51.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:51.992 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.45) 2023-07-27T14:35:52.037 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:52.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.039 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.45) 2023-07-27T14:35:52.124 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:52.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.126 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.45) 2023-07-27T14:35:52.171 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:52.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.173 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.45) 2023-07-27T14:35:52.258 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:52.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.260 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.45) 2023-07-27T14:35:52.306 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:52.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.307 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.45) 2023-07-27T14:35:52.352 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:52.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.354 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.45) 2023-07-27T14:35:52.440 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:52.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.441 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.45) 2023-07-27T14:35:52.487 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:52.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.489 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.61) 2023-07-27T14:35:52.573 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:52.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.574 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.61) 2023-07-27T14:35:52.660 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:52.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.661 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.61) 2023-07-27T14:35:52.709 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:52.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.711 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.61) 2023-07-27T14:35:52.758 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:52.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.759 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.61) 2023-07-27T14:35:52.805 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:52.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.806 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.61) 2023-07-27T14:35:52.891 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:52.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.893 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.61) 2023-07-27T14:35:52.978 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:35:52.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:52.980 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.61) 2023-07-27T14:35:53.066 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:35:53.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.068 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.62) 2023-07-27T14:35:53.153 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:53.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.154 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.62) 2023-07-27T14:35:53.200 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:53.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.202 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.62) 2023-07-27T14:35:53.288 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:53.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.289 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.62) 2023-07-27T14:35:53.375 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:53.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.376 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.62) 2023-07-27T14:35:53.422 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:53.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.423 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.62) 2023-07-27T14:35:53.508 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:53.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.510 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.62) 2023-07-27T14:35:53.596 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:35:53.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.597 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.62) 2023-07-27T14:35:53.683 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:35:53.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.685 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.52) 2023-07-27T14:35:53.735 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:53.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.736 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.52) 2023-07-27T14:35:53.782 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:53.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.784 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.52) 2023-07-27T14:35:53.831 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:53.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.832 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.52) 2023-07-27T14:35:53.878 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:53.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.879 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.52) 2023-07-27T14:35:53.964 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:53.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:53.966 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.52) 2023-07-27T14:35:54.052 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:54.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.053 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.52) 2023-07-27T14:35:54.138 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:54.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.139 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.52) 2023-07-27T14:35:54.224 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:54.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.225 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.11) 2023-07-27T14:35:54.310 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:54.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.312 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.11) 2023-07-27T14:35:54.398 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:54.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.400 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.11) 2023-07-27T14:35:54.445 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:54.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.446 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.11) 2023-07-27T14:35:54.491 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:54.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.493 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.11) 2023-07-27T14:35:54.579 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:54.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.580 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.11) 2023-07-27T14:35:54.626 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:54.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.627 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.11) 2023-07-27T14:35:54.674 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:54.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.675 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.11) 2023-07-27T14:35:54.721 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:54.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.722 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.44) 2023-07-27T14:35:54.768 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:54.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.769 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.44) 2023-07-27T14:35:54.815 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:54.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.817 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.44) 2023-07-27T14:35:54.863 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:54.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.865 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.44) 2023-07-27T14:35:54.912 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:54.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:54.914 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.44) 2023-07-27T14:35:54.999 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:55.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.001 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.44) 2023-07-27T14:35:55.087 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:55.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.088 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.44) 2023-07-27T14:35:55.174 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:55.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.175 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.44) 2023-07-27T14:35:55.261 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:55.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.262 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.3) 2023-07-27T14:35:55.308 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:55.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.309 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.3) 2023-07-27T14:35:55.355 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:55.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.357 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.3) 2023-07-27T14:35:55.402 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:55.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.403 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.3) 2023-07-27T14:35:55.449 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:55.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.450 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.3) 2023-07-27T14:35:55.496 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:55.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.497 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.3) 2023-07-27T14:35:55.542 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:55.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.543 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.3) 2023-07-27T14:35:55.629 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:55.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.630 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.3) 2023-07-27T14:35:55.715 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:55.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.717 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.24) 2023-07-27T14:35:55.802 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:55.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.803 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.24) 2023-07-27T14:35:55.851 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:55.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.852 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.24) 2023-07-27T14:35:55.898 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:55.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.899 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.24) 2023-07-27T14:35:55.984 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:55.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:55.986 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.24) 2023-07-27T14:35:56.071 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:56.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.073 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.24) 2023-07-27T14:35:56.157 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:56.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.159 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.24) 2023-07-27T14:35:56.245 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:56.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.246 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.24) 2023-07-27T14:35:56.292 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:56.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.293 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.56) 2023-07-27T14:35:56.378 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:56.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.379 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.56) 2023-07-27T14:35:56.425 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:56.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.426 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.56) 2023-07-27T14:35:56.512 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:56.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.513 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.56) 2023-07-27T14:35:56.558 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:56.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.559 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.56) 2023-07-27T14:35:56.605 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:56.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.606 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.56) 2023-07-27T14:35:56.692 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:56.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.693 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.56) 2023-07-27T14:35:56.779 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:56.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.780 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.56) 2023-07-27T14:35:56.826 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:56.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.827 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.63) 2023-07-27T14:35:56.872 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:56.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.873 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.63) 2023-07-27T14:35:56.958 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:56.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:56.960 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.63) 2023-07-27T14:35:57.006 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:57.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.007 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.63) 2023-07-27T14:35:57.053 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:57.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.054 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.63) 2023-07-27T14:35:57.100 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:57.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.101 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.63) 2023-07-27T14:35:57.147 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:57.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.148 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.63) 2023-07-27T14:35:57.233 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:35:57.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.234 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.63) 2023-07-27T14:35:57.319 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:35:57.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.320 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.59) 2023-07-27T14:35:57.405 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:57.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.406 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.59) 2023-07-27T14:35:57.492 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:57.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.494 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.59) 2023-07-27T14:35:57.539 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:57.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.540 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.59) 2023-07-27T14:35:57.585 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:57.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.587 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.59) 2023-07-27T14:35:57.673 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:57.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.674 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.59) 2023-07-27T14:35:57.720 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:57.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.721 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.59) 2023-07-27T14:35:57.766 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:57.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.768 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.59) 2023-07-27T14:35:57.813 INFO:teuthology.orchestra.run.smithi115.stdout:1690468516 2023-07-27T14:35:57.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.814 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.41) 2023-07-27T14:35:57.900 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:57.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.902 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.41) 2023-07-27T14:35:57.948 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:57.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.949 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.41) 2023-07-27T14:35:57.995 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:57.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:57.996 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.41) 2023-07-27T14:35:58.081 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:58.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.083 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.41) 2023-07-27T14:35:58.169 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:58.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.170 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.41) 2023-07-27T14:35:58.216 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:58.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.218 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.41) 2023-07-27T14:35:58.263 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:58.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.264 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.41) 2023-07-27T14:35:58.350 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:58.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.351 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.12) 2023-07-27T14:35:58.397 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:58.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.399 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.12) 2023-07-27T14:35:58.445 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:58.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.446 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.12) 2023-07-27T14:35:58.492 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:58.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.495 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.12) 2023-07-27T14:35:58.541 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:58.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.542 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.12) 2023-07-27T14:35:58.588 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:58.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.590 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.12) 2023-07-27T14:35:58.674 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:58.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.676 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.12) 2023-07-27T14:35:58.762 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:58.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.764 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.12) 2023-07-27T14:35:58.809 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:35:58.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.811 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.43) 2023-07-27T14:35:58.897 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:58.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.899 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.43) 2023-07-27T14:35:58.944 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:58.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:58.946 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.43) 2023-07-27T14:35:59.031 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:59.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.033 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.43) 2023-07-27T14:35:59.078 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:59.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.079 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.43) 2023-07-27T14:35:59.125 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:59.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.126 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.43) 2023-07-27T14:35:59.171 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:59.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.173 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.43) 2023-07-27T14:35:59.257 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:59.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.259 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.43) 2023-07-27T14:35:59.345 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:35:59.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.346 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.16) 2023-07-27T14:35:59.392 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:59.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.393 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.16) 2023-07-27T14:35:59.479 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:35:59.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.481 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.16) 2023-07-27T14:35:59.565 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:59.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.567 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.16) 2023-07-27T14:35:59.651 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:35:59.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.653 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.16) 2023-07-27T14:35:59.739 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:59.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.741 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.16) 2023-07-27T14:35:59.786 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:35:59.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.787 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.16) 2023-07-27T14:35:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:59.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.875 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.16) 2023-07-27T14:35:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:1690468514 2023-07-27T14:35:59.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:35:59.924 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.31) 2023-07-27T14:36:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:00.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.010 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.31) 2023-07-27T14:36:00.097 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:00.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.099 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.31) 2023-07-27T14:36:00.144 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:00.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.146 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.31) 2023-07-27T14:36:00.231 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:00.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.233 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.31) 2023-07-27T14:36:00.278 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:00.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.279 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.31) 2023-07-27T14:36:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:00.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.366 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.31) 2023-07-27T14:36:00.451 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:36:00.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.453 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.31) 2023-07-27T14:36:00.538 INFO:teuthology.orchestra.run.smithi115.stdout:1690468515 2023-07-27T14:36:00.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.540 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.1) 2023-07-27T14:36:00.585 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:00.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.586 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.1) 2023-07-27T14:36:00.673 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:00.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.675 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.1) 2023-07-27T14:36:00.761 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:00.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.763 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.1) 2023-07-27T14:36:00.810 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:00.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.812 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.1) 2023-07-27T14:36:00.896 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:36:00.898 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:00.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.899 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.1) 2023-07-27T14:36:00.901 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:36:00.947 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:00.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:00.948 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.1) 2023-07-27T14:36:01.034 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:36:01.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.035 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.1) 2023-07-27T14:36:01.121 INFO:teuthology.orchestra.run.smithi115.stdout:1690468513 2023-07-27T14:36:01.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.122 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.60) 2023-07-27T14:36:01.168 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:01.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.169 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.60) 2023-07-27T14:36:01.215 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:01.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.216 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.60) 2023-07-27T14:36:01.301 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:01.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.303 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.60) 2023-07-27T14:36:01.387 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:01.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.389 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.60) 2023-07-27T14:36:01.474 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:01.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.475 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.60) 2023-07-27T14:36:01.561 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:01.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.562 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000034197/.snap/snapshot_0000000000402213/f696872a-21ea-42de-9f5d-9fb8bb58eb11/subvolume_file.60) 2023-07-27T14:36:01.608 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:36:01.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:01.609 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000185025/df5cf618-985e-4dd1-a4c0-418e5023024a/subvolume_file.60) 2023-07-27T14:36:01.694 INFO:teuthology.orchestra.run.smithi115.stdout:1690468517 2023-07-27T14:36:01.695 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000034197 snapshot_0000000000402213 2023-07-27T14:36:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.882+0000 7f14f31ff700 1 Processor -- start 2023-07-27T14:36:01.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.882+0000 7f14f31ff700 1 -- start start 2023-07-27T14:36:01.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.883+0000 7f14f31ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f14ec14ae00 0x7f14ec154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:01.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f31ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14ec063260 0x7f14ec0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:01.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f31ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec1553f0 con 0x7f14ec14b1e0 2023-07-27T14:36:01.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f31ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec157a50 con 0x7f14ec063260 2023-07-27T14:36:01.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f31ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec157d10 con 0x7f14ec14ae00 2023-07-27T14:36:01.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f179c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14ec063260 0x7f14ec0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:01.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f179c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14ec063260 0x7f14ec0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46172/0 (socket says 172.21.15.115:46172) 2023-07-27T14:36:01.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f179c700 1 -- 172.21.15.115:0/797920653 learned_addr learned my addr 172.21.15.115:0/797920653 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:01.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f0f9b700 1 --2- 172.21.15.115:0/797920653 >> v2:172.21.15.159:3300/0 conn(0x7f14ec14ae00 0x7f14ec154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:01.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f179c700 1 -- 172.21.15.115:0/797920653 >> v2:172.21.15.159:3300/0 conn(0x7f14ec14ae00 msgr2=0x7f14ec154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:01.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f179c700 1 --2- 172.21.15.115:0/797920653 >> v2:172.21.15.159:3300/0 conn(0x7f14ec14ae00 0x7f14ec154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:01.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f179c700 1 -- 172.21.15.115:0/797920653 >> v1:172.21.15.159:6789/0 conn(0x7f14ec14b1e0 legacy=0x7f14ec062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:01.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f179c700 1 -- 172.21.15.115:0/797920653 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec157ff0 con 0x7f14ec063260 2023-07-27T14:36:01.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f0f9b700 1 --2- 172.21.15.115:0/797920653 >> v2:172.21.15.159:3300/0 conn(0x7f14ec14ae00 0x7f14ec154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:01.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.884+0000 7f14f179c700 1 --2- 172.21.15.115:0/797920653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec0a98c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f14ec0caaf0 tx=0x7f14e4009840).ready entity=mon.0 client_cookie=4ca205c10fc8c1fe server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:01.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14eb7fe700 1 -- 172.21.15.115:0/797920653 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400e070 con 0x7f14ec063260 2023-07-27T14:36:01.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14eb7fe700 1 -- 172.21.15.115:0/797920653 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e400ba10 con 0x7f14ec063260 2023-07-27T14:36:01.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14eb7fe700 1 -- 172.21.15.115:0/797920653 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400bd90 con 0x7f14ec063260 2023-07-27T14:36:01.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14f31ff700 1 -- 172.21.15.115:0/797920653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 msgr2=0x7f14ec0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:01.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14f31ff700 1 --2- 172.21.15.115:0/797920653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec0a98c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f14ec0caaf0 tx=0x7f14e4009840).stop 2023-07-27T14:36:01.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14f31ff700 1 -- 172.21.15.115:0/797920653 shutdown_connections 2023-07-27T14:36:01.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14f31ff700 1 --2- 172.21.15.115:0/797920653 >> v2:172.21.15.159:3300/0 conn(0x7f14ec14ae00 0x7f14ec154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:01.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14f31ff700 1 --2- 172.21.15.115:0/797920653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec0a98c0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:01.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14f31ff700 1 -- 172.21.15.115:0/797920653 >> 172.21.15.115:0/797920653 conn(0x7f14ec05e940 msgr2=0x7f14ec0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:01.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14f31ff700 1 -- 172.21.15.115:0/797920653 shutdown_connections 2023-07-27T14:36:01.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.885+0000 7f14f31ff700 1 -- 172.21.15.115:0/797920653 wait complete. 2023-07-27T14:36:01.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.887+0000 7f14f31ff700 1 Processor -- start 2023-07-27T14:36:01.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.887+0000 7f14f31ff700 1 -- start start 2023-07-27T14:36:01.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f31ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec1648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:01.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f31ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14ec14ae00 0x7f14ec0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:01.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f31ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14ec14b1e0 0x7f14ec0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:01.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f31ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec14a380 con 0x7f14ec063260 2023-07-27T14:36:01.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f31ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec167f90 con 0x7f14ec14b1e0 2023-07-27T14:36:01.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f31ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1673c0 con 0x7f14ec14ae00 2023-07-27T14:36:01.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f0f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec1648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:01.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f0f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec1648b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46188/0 (socket says 172.21.15.115:46188) 2023-07-27T14:36:01.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f0f9b700 1 -- 172.21.15.115:0/3307303241 learned_addr learned my addr 172.21.15.115:0/3307303241 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:01.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14f179c700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14ec14b1e0 0x7f14ec0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:01.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.888+0000 7f14ebfff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14ec14ae00 0x7f14ec0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:01.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14f0f9b700 1 -- 172.21.15.115:0/3307303241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14ec14ae00 msgr2=0x7f14ec0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:01.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14f0f9b700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14ec14ae00 0x7f14ec0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:01.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14f0f9b700 1 -- 172.21.15.115:0/3307303241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14ec14b1e0 msgr2=0x7f14ec0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:01.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14f0f9b700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14ec14b1e0 0x7f14ec0b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:01.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14f0f9b700 1 -- 172.21.15.115:0/3307303241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4009ae0 con 0x7f14ec063260 2023-07-27T14:36:01.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14f0f9b700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec1648b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f14e000c880 tx=0x7f14e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:01.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14e8ff9700 1 -- 172.21.15.115:0/3307303241 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e0010580 con 0x7f14ec063260 2023-07-27T14:36:01.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14e8ff9700 1 -- 172.21.15.115:0/3307303241 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e00106e0 con 0x7f14ec063260 2023-07-27T14:36:01.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec167660 con 0x7f14ec063260 2023-07-27T14:36:01.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14e8ff9700 1 -- 172.21.15.115:0/3307303241 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e0010a60 con 0x7f14ec063260 2023-07-27T14:36:01.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.889+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec167c20 con 0x7f14ec063260 2023-07-27T14:36:01.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.890+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec0ac9a0 con 0x7f14ec063260 2023-07-27T14:36:01.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.891+0000 7f14e8ff9700 1 -- 172.21.15.115:0/3307303241 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7f14e001b460 con 0x7f14ec063260 2023-07-27T14:36:01.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.892+0000 7f14e8ff9700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14d005f7f0 0x7f14d0061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:01.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.892+0000 7f14e8ff9700 1 -- 172.21.15.115:0/3307303241 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f14e007ad40 con 0x7f14ec063260 2023-07-27T14:36:01.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.892+0000 7f14ebfff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14d005f7f0 0x7f14d0061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:01.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.893+0000 7f14ebfff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14d005f7f0 0x7f14d0061cb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f14ec0c13d0 tx=0x7f14d8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:01.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:01.896+0000 7f14e8ff9700 1 -- 172.21.15.115:0/3307303241 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f14e004b6d0 con 0x7f14ec063260 2023-07-27T14:36:02.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.101+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000034197", "snap_name": "snapshot_0000000000402213", "target": ["mon-mgr", ""]}) v1 -- 0x7f14ec06c470 con 0x7f14d005f7f0 2023-07-27T14:36:02.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.130+0000 7f14e8ff9700 1 -- 172.21.15.115:0/3307303241 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f14ec06c470 con 0x7f14d005f7f0 2023-07-27T14:36:02.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14d005f7f0 msgr2=0x7f14d0061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14d005f7f0 0x7f14d0061cb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f14ec0c13d0 tx=0x7f14d8008040).stop 2023-07-27T14:36:02.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 msgr2=0x7f14ec1648b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec1648b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f14e000c880 tx=0x7f14e0008040).stop 2023-07-27T14:36:02.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 shutdown_connections 2023-07-27T14:36:02.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f14d005f7f0 0x7f14d0061cb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14ec14b1e0 0x7f14ec0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14ec063260 0x7f14ec1648b0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 --2- 172.21.15.115:0/3307303241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f14ec14ae00 0x7f14ec0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 >> 172.21.15.115:0/3307303241 conn(0x7f14ec05e940 msgr2=0x7f14ec0ac290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:02.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 shutdown_connections 2023-07-27T14:36:02.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.133+0000 7f14f31ff700 1 -- 172.21.15.115:0/3307303241 wait complete. 2023-07-27T14:36:02.196 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000034197 2023-07-27T14:36:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.340+0000 7f2e09dff700 1 Processor -- start 2023-07-27T14:36:02.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.340+0000 7f2e09dff700 1 -- start start 2023-07-27T14:36:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.341+0000 7f2e09dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e04063260 0x7f2e04154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.341+0000 7f2e09dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e0414b1e0 0x7f2e040a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.341+0000 7f2e09dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e041553f0 con 0x7f2e0414ae00 2023-07-27T14:36:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.341+0000 7f2e09dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e04157a50 con 0x7f2e04063260 2023-07-27T14:36:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.341+0000 7f2e09dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04157d10 con 0x7f2e0414b1e0 2023-07-27T14:36:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e037fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2e0414ae00 0x7f2e04062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:48284/0 (socket says 172.21.15.115:48284) 2023-07-27T14:36:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e037fe700 1 -- 172.21.15.115:0/3444173195 learned_addr learned my addr 172.21.15.115:0/3444173195 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e02ffd700 1 --2- 172.21.15.115:0/3444173195 >> v2:172.21.15.115:3300/0 conn(0x7f2e04063260 0x7f2e04154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e03fff700 1 --2- 172.21.15.115:0/3444173195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e0414b1e0 0x7f2e040a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e02ffd700 1 -- 172.21.15.115:0/3444173195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e0414b1e0 msgr2=0x7f2e040a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e02ffd700 1 --2- 172.21.15.115:0/3444173195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e0414b1e0 0x7f2e040a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e02ffd700 1 -- 172.21.15.115:0/3444173195 >> v1:172.21.15.115:6789/0 conn(0x7f2e0414ae00 legacy=0x7f2e04062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e02ffd700 1 -- 172.21.15.115:0/3444173195 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04157ff0 con 0x7f2e04063260 2023-07-27T14:36:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e02ffd700 1 --2- 172.21.15.115:0/3444173195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e04063260 0x7f2e04154f00 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f2df8009760 tx=0x7f2df8009060).ready entity=mon.0 client_cookie=1af931edd095961e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e027fc700 1 -- 172.21.15.115:0/3444173195 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800b580 con 0x7f2e04063260 2023-07-27T14:36:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e027fc700 1 -- 172.21.15.115:0/3444173195 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df800b6e0 con 0x7f2e04063260 2023-07-27T14:36:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.342+0000 7f2e027fc700 1 -- 172.21.15.115:0/3444173195 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800ba60 con 0x7f2e04063260 2023-07-27T14:36:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.343+0000 7f2e09dff700 1 -- 172.21.15.115:0/3444173195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e04063260 msgr2=0x7f2e04154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.343+0000 7f2e09dff700 1 --2- 172.21.15.115:0/3444173195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e04063260 0x7f2e04154f00 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f2df8009760 tx=0x7f2df8009060).stop 2023-07-27T14:36:02.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.343+0000 7f2e09dff700 1 -- 172.21.15.115:0/3444173195 shutdown_connections 2023-07-27T14:36:02.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.343+0000 7f2e09dff700 1 --2- 172.21.15.115:0/3444173195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e0414b1e0 0x7f2e040a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.343+0000 7f2e09dff700 1 --2- 172.21.15.115:0/3444173195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e04063260 0x7f2e04154f00 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.343+0000 7f2e09dff700 1 -- 172.21.15.115:0/3444173195 >> 172.21.15.115:0/3444173195 conn(0x7f2e0405e940 msgr2=0x7f2e040cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:02.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.343+0000 7f2e09dff700 1 -- 172.21.15.115:0/3444173195 shutdown_connections 2023-07-27T14:36:02.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.343+0000 7f2e09dff700 1 -- 172.21.15.115:0/3444173195 wait complete. 2023-07-27T14:36:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.345+0000 7f2e09dff700 1 Processor -- start 2023-07-27T14:36:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.345+0000 7f2e09dff700 1 -- start start 2023-07-27T14:36:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e09dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e04063260 0x7f2e040c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e09dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e0414ae00 0x7f2e041646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e09dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e0414b1e0 0x7f2e040a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e09dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04167e90 con 0x7f2e0414ae00 2023-07-27T14:36:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e09dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041656c0 con 0x7f2e0414b1e0 2023-07-27T14:36:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e09dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040c2460 con 0x7f2e04063260 2023-07-27T14:36:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e02ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e0414ae00 0x7f2e041646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e02ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e0414ae00 0x7f2e041646b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46220/0 (socket says 172.21.15.115:46220) 2023-07-27T14:36:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e02ffd700 1 -- 172.21.15.115:0/793263647 learned_addr learned my addr 172.21.15.115:0/793263647 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:02.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e037fe700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e04063260 0x7f2e040c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e03fff700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e0414b1e0 0x7f2e040a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e02ffd700 1 -- 172.21.15.115:0/793263647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e04063260 msgr2=0x7f2e040c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e02ffd700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e04063260 0x7f2e040c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e02ffd700 1 -- 172.21.15.115:0/793263647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e0414b1e0 msgr2=0x7f2e040a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e02ffd700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e0414b1e0 0x7f2e040a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.346+0000 7f2e02ffd700 1 -- 172.21.15.115:0/793263647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80092a0 con 0x7f2e0414ae00 2023-07-27T14:36:02.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.347+0000 7f2e02ffd700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e0414ae00 0x7f2e041646b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f2df8009eb0 tx=0x7f2df8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:02.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.347+0000 7f2deb7fe700 1 -- 172.21.15.115:0/793263647 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800b850 con 0x7f2e0414ae00 2023-07-27T14:36:02.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.347+0000 7f2deb7fe700 1 -- 172.21.15.115:0/793263647 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df800b9b0 con 0x7f2e0414ae00 2023-07-27T14:36:02.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.347+0000 7f2deb7fe700 1 -- 172.21.15.115:0/793263647 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df801b650 con 0x7f2e0414ae00 2023-07-27T14:36:02.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.347+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e04164ba0 con 0x7f2e0414ae00 2023-07-27T14:36:02.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.347+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e04165100 con 0x7f2e0414ae00 2023-07-27T14:36:02.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.348+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04168000 con 0x7f2e0414ae00 2023-07-27T14:36:02.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.349+0000 7f2deb7fe700 1 -- 172.21.15.115:0/793263647 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7f2df802a070 con 0x7f2e0414ae00 2023-07-27T14:36:02.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.349+0000 7f2deb7fe700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2df005f7f0 0x7f2df0061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.350+0000 7f2deb7fe700 1 -- 172.21.15.115:0/793263647 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f2df807c270 con 0x7f2e0414ae00 2023-07-27T14:36:02.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.350+0000 7f2e037fe700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2df005f7f0 0x7f2df0061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.350+0000 7f2e037fe700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2df005f7f0 0x7f2df0061cb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f2df40016a0 tx=0x7f2df4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:02.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.353+0000 7f2deb7fe700 1 -- 172.21.15.115:0/793263647 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e04168000 con 0x7f2e0414ae00 2023-07-27T14:36:02.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.553+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000034197", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e040c8340 con 0x7f2df005f7f0 2023-07-27T14:36:02.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.569+0000 7f2deb7fe700 1 -- 172.21.15.115:0/793263647 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2e040c8340 con 0x7f2df005f7f0 2023-07-27T14:36:02.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.571+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2df005f7f0 msgr2=0x7f2df0061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.571+0000 7f2e09dff700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2df005f7f0 0x7f2df0061cb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f2df40016a0 tx=0x7f2df4009040).stop 2023-07-27T14:36:02.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.571+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e0414ae00 msgr2=0x7f2e041646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.571+0000 7f2e09dff700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e0414ae00 0x7f2e041646b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f2df8009eb0 tx=0x7f2df8017000).stop 2023-07-27T14:36:02.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.572+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 shutdown_connections 2023-07-27T14:36:02.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.572+0000 7f2e09dff700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2df005f7f0 0x7f2df0061cb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.572+0000 7f2e09dff700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e0414b1e0 0x7f2e040a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.572+0000 7f2e09dff700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e04063260 0x7f2e040c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.572+0000 7f2e09dff700 1 --2- 172.21.15.115:0/793263647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e0414ae00 0x7f2e041646b0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.572+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 >> 172.21.15.115:0/793263647 conn(0x7f2e0405e940 msgr2=0x7f2e041544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:02.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.572+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 shutdown_connections 2023-07-27T14:36:02.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.572+0000 7f2e09dff700 1 -- 172.21.15.115:0/793263647 wait complete. 2023-07-27T14:36:02.620 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.573+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.620 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.573+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.620 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.573+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.621 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.573+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.621 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.573+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.637 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.590+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.637 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.590+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.637 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.590+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.637 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.590+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.637 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:02.590+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:02.640 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000185025 2023-07-27T14:36:02.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.832+0000 7fa46a7ff700 1 Processor -- start 2023-07-27T14:36:02.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.832+0000 7fa46a7ff700 1 -- start start 2023-07-27T14:36:02.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.834+0000 7fa46a7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa46414ae00 0x7fa464154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.834+0000 7fa46a7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4641553f0 con 0x7fa464063260 2023-07-27T14:36:02.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.834+0000 7fa46a7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa464157a50 con 0x7fa46414b1e0 2023-07-27T14:36:02.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.834+0000 7fa46a7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa464157d10 con 0x7fa46414ae00 2023-07-27T14:36:02.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.834+0000 7fa463fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa46414ae00 0x7fa464154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.835+0000 7fa463fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa46414ae00 0x7fa464154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46252/0 (socket says 172.21.15.115:46252) 2023-07-27T14:36:02.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.835+0000 7fa463fff700 1 -- 172.21.15.115:0/4177999199 learned_addr learned my addr 172.21.15.115:0/4177999199 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:02.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.835+0000 7fa463fff700 1 -- 172.21.15.115:0/4177999199 >> v1:172.21.15.159:6789/0 conn(0x7fa46414b1e0 legacy=0x7fa464062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.835+0000 7fa463fff700 1 -- 172.21.15.115:0/4177999199 >> v1:172.21.15.115:6789/0 conn(0x7fa464063260 legacy=0x7fa4640a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.835+0000 7fa463fff700 1 -- 172.21.15.115:0/4177999199 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464157ff0 con 0x7fa46414ae00 2023-07-27T14:36:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.835+0000 7fa463fff700 1 --2- 172.21.15.115:0/4177999199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46414ae00 0x7fa464154f00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fa454006fd0 tx=0x7fa4540090f0).ready entity=mon.0 client_cookie=b10c813693bf000d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.836+0000 7fa462ffd700 1 -- 172.21.15.115:0/4177999199 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400f510 con 0x7fa46414ae00 2023-07-27T14:36:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.836+0000 7fa462ffd700 1 -- 172.21.15.115:0/4177999199 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45400f670 con 0x7fa46414ae00 2023-07-27T14:36:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.836+0000 7fa462ffd700 1 -- 172.21.15.115:0/4177999199 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400fa10 con 0x7fa46414ae00 2023-07-27T14:36:02.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.836+0000 7fa46a7ff700 1 -- 172.21.15.115:0/4177999199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46414ae00 msgr2=0x7fa464154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.836+0000 7fa46a7ff700 1 --2- 172.21.15.115:0/4177999199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46414ae00 0x7fa464154f00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fa454006fd0 tx=0x7fa4540090f0).stop 2023-07-27T14:36:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.836+0000 7fa46a7ff700 1 -- 172.21.15.115:0/4177999199 shutdown_connections 2023-07-27T14:36:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.836+0000 7fa46a7ff700 1 --2- 172.21.15.115:0/4177999199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa46414ae00 0x7fa464154f00 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.836+0000 7fa46a7ff700 1 -- 172.21.15.115:0/4177999199 >> 172.21.15.115:0/4177999199 conn(0x7fa46405e940 msgr2=0x7fa4640cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.837+0000 7fa46a7ff700 1 -- 172.21.15.115:0/4177999199 shutdown_connections 2023-07-27T14:36:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.837+0000 7fa46a7ff700 1 -- 172.21.15.115:0/4177999199 wait complete. 2023-07-27T14:36:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.838+0000 7fa46a7ff700 1 Processor -- start 2023-07-27T14:36:02.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.839+0000 7fa46a7ff700 1 -- start start 2023-07-27T14:36:02.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa46a7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa464063260 0x7fa4640c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa46a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa46414ae00 0x7fa4640c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa46a7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46414b1e0 0x7fa464149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa46a7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640b0010 con 0x7fa464063260 2023-07-27T14:36:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa46a7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640c3590 con 0x7fa46414b1e0 2023-07-27T14:36:02.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa46a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640c22c0 con 0x7fa46414ae00 2023-07-27T14:36:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa463fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa464063260 0x7fa4640c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa463fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa464063260 0x7fa4640c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46266/0 (socket says 172.21.15.115:46266) 2023-07-27T14:36:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.840+0000 7fa463fff700 1 -- 172.21.15.115:0/1244095699 learned_addr learned my addr 172.21.15.115:0/1244095699 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa4637fe700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa46414ae00 0x7fa4640c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa468d9c700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46414b1e0 0x7fa464149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa463fff700 1 -- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa46414ae00 msgr2=0x7fa4640c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa463fff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa46414ae00 0x7fa4640c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa463fff700 1 -- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46414b1e0 msgr2=0x7fa464149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:02.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa463fff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46414b1e0 0x7fa464149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa463fff700 1 -- 172.21.15.115:0/1244095699 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454009370 con 0x7fa464063260 2023-07-27T14:36:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa468d9c700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46414b1e0 0x7fa464149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.841+0000 7fa463fff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa464063260 0x7fa4640c1d00 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fa454009f50 tx=0x7fa454017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.842+0000 7fa44bfff700 1 -- 172.21.15.115:0/1244095699 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400fea0 con 0x7fa464063260 2023-07-27T14:36:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.842+0000 7fa44bfff700 1 -- 172.21.15.115:0/1244095699 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454006950 con 0x7fa464063260 2023-07-27T14:36:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.842+0000 7fa44bfff700 1 -- 172.21.15.115:0/1244095699 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400f7e0 con 0x7fa464063260 2023-07-27T14:36:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.842+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4640af9c0 con 0x7fa464063260 2023-07-27T14:36:02.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.842+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4640af5e0 con 0x7fa464063260 2023-07-27T14:36:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.843+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4640af800 con 0x7fa464063260 2023-07-27T14:36:02.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.844+0000 7fa44bfff700 1 -- 172.21.15.115:0/1244095699 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) v1 ==== 76722+0+0 (secure 0 0 0) 0x7fa45402c070 con 0x7fa464063260 2023-07-27T14:36:02.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.845+0000 7fa44bfff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa45005f7f0 0x7fa450061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:02.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.845+0000 7fa44bfff700 1 -- 172.21.15.115:0/1244095699 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fa45407c660 con 0x7fa464063260 2023-07-27T14:36:02.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.845+0000 7fa4637fe700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa45005f7f0 0x7fa450061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:02.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.846+0000 7fa4637fe700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa45005f7f0 0x7fa450061cb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa4640c21f0 tx=0x7fa458007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:02.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:02.849+0000 7fa44bfff700 1 -- 172.21.15.115:0/1244095699 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa45404d050 con 0x7fa464063260 2023-07-27T14:36:03.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.049+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000185025", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4640b0150 con 0x7fa45005f7f0 2023-07-27T14:36:03.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.067+0000 7fa44bfff700 1 -- 172.21.15.115:0/1244095699 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa458003590 con 0x7fa45005f7f0 2023-07-27T14:36:03.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa45005f7f0 msgr2=0x7fa450061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:03.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa45005f7f0 0x7fa450061cb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa4640c21f0 tx=0x7fa458007d40).stop 2023-07-27T14:36:03.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa464063260 msgr2=0x7fa4640c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:03.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa464063260 0x7fa4640c1d00 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fa454009f50 tx=0x7fa454017000).stop 2023-07-27T14:36:03.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 shutdown_connections 2023-07-27T14:36:03.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa45005f7f0 0x7fa450061cb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:03.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46414b1e0 0x7fa464149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:03.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa464063260 0x7fa4640c1d00 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:03.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 --2- 172.21.15.115:0/1244095699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa46414ae00 0x7fa4640c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:03.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 >> 172.21.15.115:0/1244095699 conn(0x7fa46405e940 msgr2=0x7fa4640c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:03.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 shutdown_connections 2023-07-27T14:36:03.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:03.069+0000 7fa46a7ff700 1 -- 172.21.15.115:0/1244095699 wait complete. 2023-07-27T14:36:03.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:03.136 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:36:03.235 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-07-27T14:36:08.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:08.238 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:36:08.332 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:36:08.333 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:36:08.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:36:08.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:36:08.538 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:36:08.539 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:36:08.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:08.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:36:08.649 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:36:08.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:08.650 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:36:08.698 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:36:08.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:08.699 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:36:08.786 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:36:08.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:08.787 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:36:08.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:36:09.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.975+0000 7ff7e53ff700 1 Processor -- start 2023-07-27T14:36:09.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.975+0000 7ff7e53ff700 1 -- start start 2023-07-27T14:36:09.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7e53ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0151d70 0x7ff7e0155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7e53ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff7e0066b80 0x7ff7e0067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7e53ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e0067080 con 0x7ff7e0065ff0 2023-07-27T14:36:09.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7e53ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e0063a90 con 0x7ff7e0066b80 2023-07-27T14:36:09.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7e53ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e00634d0 con 0x7ff7e0151d70 2023-07-27T14:36:09.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7de7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff7e0065ff0 0x7ff7e0066470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:32900/0 (socket says 172.21.15.115:32900) 2023-07-27T14:36:09.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7de7fc700 1 -- 172.21.15.115:0/3099215471 learned_addr learned my addr 172.21.15.115:0/3099215471 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:09.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7df7fe700 1 --2- 172.21.15.115:0/3099215471 >> v2:172.21.15.115:3300/0 conn(0x7ff7e0066b80 0x7ff7e0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7deffd700 1 --2- 172.21.15.115:0/3099215471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0151d70 0x7ff7e0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7df7fe700 1 -- 172.21.15.115:0/3099215471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0151d70 msgr2=0x7ff7e0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:09.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7df7fe700 1 --2- 172.21.15.115:0/3099215471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0151d70 0x7ff7e0155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7df7fe700 1 -- 172.21.15.115:0/3099215471 >> v1:172.21.15.115:6789/0 conn(0x7ff7e0065ff0 legacy=0x7ff7e0066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.978+0000 7ff7df7fe700 1 -- 172.21.15.115:0/3099215471 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e00637b0 con 0x7ff7e0066b80 2023-07-27T14:36:09.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.977+0000 7ff7ddffb700 1 -- 172.21.15.115:0/3099215471 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632501454 0 0) 0x7ff7e0067080 con 0x7ff7e0065ff0 2023-07-27T14:36:09.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.978+0000 7ff7df7fe700 1 --2- 172.21.15.115:0/3099215471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0066b80 0x7ff7e0067560 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7ff7d8009e60 tx=0x7ff7d8009780).ready entity=mon.0 client_cookie=464c654c69ecbc52 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.978+0000 7ff7ddffb700 1 -- 172.21.15.115:0/3099215471 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800e070 con 0x7ff7e0066b80 2023-07-27T14:36:09.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.978+0000 7ff7ddffb700 1 -- 172.21.15.115:0/3099215471 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d800bb60 con 0x7ff7e0066b80 2023-07-27T14:36:09.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.978+0000 7ff7ddffb700 1 -- 172.21.15.115:0/3099215471 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8012410 con 0x7ff7e0066b80 2023-07-27T14:36:09.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.978+0000 7ff7e53ff700 1 -- 172.21.15.115:0/3099215471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0066b80 msgr2=0x7ff7e0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.978+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/3099215471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0066b80 0x7ff7e0067560 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7ff7d8009e60 tx=0x7ff7d8009780).stop 2023-07-27T14:36:09.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.979+0000 7ff7e53ff700 1 -- 172.21.15.115:0/3099215471 shutdown_connections 2023-07-27T14:36:09.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.979+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/3099215471 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0151d70 0x7ff7e0155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.979+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/3099215471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0066b80 0x7ff7e0067560 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.979+0000 7ff7e53ff700 1 -- 172.21.15.115:0/3099215471 >> 172.21.15.115:0/3099215471 conn(0x7ff7e00c89a0 msgr2=0x7ff7e00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:09.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.979+0000 7ff7e53ff700 1 -- 172.21.15.115:0/3099215471 shutdown_connections 2023-07-27T14:36:09.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.979+0000 7ff7e53ff700 1 -- 172.21.15.115:0/3099215471 wait complete. 2023-07-27T14:36:09.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.981+0000 7ff7e53ff700 1 Processor -- start 2023-07-27T14:36:09.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.981+0000 7ff7e53ff700 1 -- start start 2023-07-27T14:36:09.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7e53ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7e0065ff0 0x7ff7e00c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7e53ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0066b80 0x7ff7e0167250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7e53ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0151d70 0x7ff7e0167740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7e53ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0167c30 con 0x7ff7e0151d70 2023-07-27T14:36:09.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7e53ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e00c51d0 con 0x7ff7e0065ff0 2023-07-27T14:36:09.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7e53ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e00c45c0 con 0x7ff7e0066b80 2023-07-27T14:36:09.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7df7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0151d70 0x7ff7e0167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7df7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0151d70 0x7ff7e0167740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52102/0 (socket says 172.21.15.115:52102) 2023-07-27T14:36:09.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.982+0000 7ff7df7fe700 1 -- 172.21.15.115:0/1652027477 learned_addr learned my addr 172.21.15.115:0/1652027477 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:09.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7deffd700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7e0065ff0 0x7ff7e00c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7de7fc700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0066b80 0x7ff7e0167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7df7fe700 1 -- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0066b80 msgr2=0x7ff7e0167250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7df7fe700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0066b80 0x7ff7e0167250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7df7fe700 1 -- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7e0065ff0 msgr2=0x7ff7e00c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7df7fe700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7e0065ff0 0x7ff7e00c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7df7fe700 1 -- 172.21.15.115:0/1652027477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8009a20 con 0x7ff7e0151d70 2023-07-27T14:36:09.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7deffd700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7e0065ff0 0x7ff7e00c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:09.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7df7fe700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0151d70 0x7ff7e0167740 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7ff7e0060790 tx=0x7ff7d8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7c6ffd700 1 -- 172.21.15.115:0/1652027477 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d801d630 con 0x7ff7e0151d70 2023-07-27T14:36:09.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7c6ffd700 1 -- 172.21.15.115:0/1652027477 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d801d790 con 0x7ff7e0151d70 2023-07-27T14:36:09.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e00c48a0 con 0x7ff7e0151d70 2023-07-27T14:36:09.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7c6ffd700 1 -- 172.21.15.115:0/1652027477 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d801db50 con 0x7ff7e0151d70 2023-07-27T14:36:09.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.983+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e00c4e60 con 0x7ff7e0151d70 2023-07-27T14:36:09.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.984+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e0164db0 con 0x7ff7e0151d70 2023-07-27T14:36:09.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.985+0000 7ff7c6ffd700 1 -- 172.21.15.115:0/1652027477 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7ff7d8026410 con 0x7ff7e0151d70 2023-07-27T14:36:09.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.986+0000 7ff7c6ffd700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7cc05f880 0x7ff7cc061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.986+0000 7ff7c6ffd700 1 -- 172.21.15.115:0/1652027477 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6235+0+0 (secure 0 0 0) 0x7ff7d807cd80 con 0x7ff7e0151d70 2023-07-27T14:36:09.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.986+0000 7ff7deffd700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7cc05f880 0x7ff7cc061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.987+0000 7ff7deffd700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7cc05f880 0x7ff7cc061d40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7ff7d0009c00 tx=0x7ff7d0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:08.991+0000 7ff7c6ffd700 1 -- 172.21.15.115:0/1652027477 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7e0164db0 con 0x7ff7e0151d70 2023-07-27T14:36:09.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.198+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7e0164d90 con 0x7ff7e0151d70 2023-07-27T14:36:09.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.198+0000 7ff7c6ffd700 1 -- 172.21.15.115:0/1652027477 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4500 (secure 0 0 0) 0x7ff7d807e070 con 0x7ff7e0151d70 2023-07-27T14:36:09.245 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:09.246 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/231954123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":231954123},{"type":"v1","addr":"172.21.15.159:6834","nonce":231954123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7432,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3337360418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3337360418},{"type":"v1","addr":"172.21.15.159:6835","nonce":3337360418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2630769428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2630769428},{"type":"v1","addr":"172.21.15.115:6836","nonce":2630769428}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:35:01.359343+0000","modified":"2023-07-27T14:35:04.371738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2708675397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2708675397},{"type":"v1","addr":"172.21.15.115:6837","nonce":2708675397}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-07-27T14:36:09.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7cc05f880 msgr2=0x7ff7cc061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7cc05f880 0x7ff7cc061d40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7ff7d0009c00 tx=0x7ff7d0008040).stop 2023-07-27T14:36:09.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0151d70 msgr2=0x7ff7e0167740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0151d70 0x7ff7e0167740 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7ff7e0060790 tx=0x7ff7d8009780).stop 2023-07-27T14:36:09.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 shutdown_connections 2023-07-27T14:36:09.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff7cc05f880 0x7ff7cc061d40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7e0151d70 0x7ff7e0167740 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7e0065ff0 0x7ff7e00c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 --2- 172.21.15.115:0/1652027477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff7e0066b80 0x7ff7e0167250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 >> 172.21.15.115:0/1652027477 conn(0x7ff7e00c89a0 msgr2=0x7ff7e015a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:09.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 shutdown_connections 2023-07-27T14:36:09.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.200+0000 7ff7e53ff700 1 -- 172.21.15.115:0/1652027477 wait complete. 2023-07-27T14:36:09.249 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 77 2023-07-27T14:36:09.264 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:36:09.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.405+0000 7f476adff700 1 Processor -- start 2023-07-27T14:36:09.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.405+0000 7f476adff700 1 -- start start 2023-07-27T14:36:09.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f476adff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4764151d70 0x7f4764155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f476adff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4764065ff0 0x7f4764066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f476adff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764066960 0x7f4764157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f476adff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4764063a90 con 0x7f4764065ff0 2023-07-27T14:36:09.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f476adff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4764067080 con 0x7f4764151d70 2023-07-27T14:36:09.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f476adff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4764066df0 con 0x7f4764066960 2023-07-27T14:36:09.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f4763fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4764065ff0 0x7f4764066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f4763fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4764065ff0 0x7f4764066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52114/0 (socket says 172.21.15.115:52114) 2023-07-27T14:36:09.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f4763fff700 1 -- 172.21.15.115:0/1476366675 learned_addr learned my addr 172.21.15.115:0/1476366675 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:09.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f4763fff700 1 -- 172.21.15.115:0/1476366675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764066960 msgr2=0x7f4764157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:09.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f476939c700 1 --2- 172.21.15.115:0/1476366675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764066960 0x7f4764157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.407+0000 7f4768b9b700 1 --2- 172.21.15.115:0/1476366675 >> v2:172.21.15.159:3300/0 conn(0x7f4764151d70 0x7f4764155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f4763fff700 1 --2- 172.21.15.115:0/1476366675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764066960 0x7f4764157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f4763fff700 1 -- 172.21.15.115:0/1476366675 >> v2:172.21.15.159:3300/0 conn(0x7f4764151d70 msgr2=0x7f4764155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:09.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f4763fff700 1 --2- 172.21.15.115:0/1476366675 >> v2:172.21.15.159:3300/0 conn(0x7f4764151d70 0x7f4764155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f4763fff700 1 -- 172.21.15.115:0/1476366675 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640634d0 con 0x7f4764065ff0 2023-07-27T14:36:09.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f476939c700 1 --2- 172.21.15.115:0/1476366675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764066960 0x7f4764157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:09.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f4768b9b700 1 --2- 172.21.15.115:0/1476366675 >> v2:172.21.15.159:3300/0 conn(0x7f4764151d70 0x7f4764155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:09.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f4763fff700 1 --2- 172.21.15.115:0/1476366675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f4764066470 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f47640c88b0 tx=0x7f47500090f0).ready entity=mon.0 client_cookie=74a009871b2495e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f47637fe700 1 -- 172.21.15.115:0/1476366675 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000b600 con 0x7f4764065ff0 2023-07-27T14:36:09.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f47637fe700 1 -- 172.21.15.115:0/1476366675 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475000b760 con 0x7f4764065ff0 2023-07-27T14:36:09.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f47637fe700 1 -- 172.21.15.115:0/1476366675 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000bae0 con 0x7f4764065ff0 2023-07-27T14:36:09.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f476adff700 1 -- 172.21.15.115:0/1476366675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 msgr2=0x7f4764066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f476adff700 1 --2- 172.21.15.115:0/1476366675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f4764066470 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f47640c88b0 tx=0x7f47500090f0).stop 2023-07-27T14:36:09.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f476adff700 1 -- 172.21.15.115:0/1476366675 shutdown_connections 2023-07-27T14:36:09.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f476adff700 1 --2- 172.21.15.115:0/1476366675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764066960 0x7f4764157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f476adff700 1 --2- 172.21.15.115:0/1476366675 >> v2:172.21.15.159:3300/0 conn(0x7f4764151d70 0x7f4764155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f476adff700 1 --2- 172.21.15.115:0/1476366675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f4764066470 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.408+0000 7f476adff700 1 -- 172.21.15.115:0/1476366675 >> 172.21.15.115:0/1476366675 conn(0x7f47640c89a0 msgr2=0x7f47640c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:09.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.409+0000 7f476adff700 1 -- 172.21.15.115:0/1476366675 shutdown_connections 2023-07-27T14:36:09.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.409+0000 7f476adff700 1 -- 172.21.15.115:0/1476366675 wait complete. 2023-07-27T14:36:09.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.411+0000 7f476adff700 1 Processor -- start 2023-07-27T14:36:09.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.411+0000 7f476adff700 1 -- start start 2023-07-27T14:36:09.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f476adff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f47640ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f476adff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4764066960 0x7f47640ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f476adff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764151d70 0x7f476414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f476adff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47640ad8c0 con 0x7f4764065ff0 2023-07-27T14:36:09.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f476adff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47640ae1a0 con 0x7f4764066960 2023-07-27T14:36:09.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f476adff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47640ace10 con 0x7f4764151d70 2023-07-27T14:36:09.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f4768b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f47640ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f4768b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f47640ae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52116/0 (socket says 172.21.15.115:52116) 2023-07-27T14:36:09.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f4768b9b700 1 -- 172.21.15.115:0/1829973149 learned_addr learned my addr 172.21.15.115:0/1829973149 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:09.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f4763fff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4764066960 0x7f47640ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.412+0000 7f476939c700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764151d70 0x7f476414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4768b9b700 1 -- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764151d70 msgr2=0x7f476414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4768b9b700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764151d70 0x7f476414a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4768b9b700 1 -- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4764066960 msgr2=0x7f47640ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4768b9b700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4764066960 0x7f47640ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4768b9b700 1 -- 172.21.15.115:0/1829973149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750009370 con 0x7f4764065ff0 2023-07-27T14:36:09.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4763fff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4764066960 0x7f47640ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:09.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4768b9b700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f47640ae5b0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f475800c880 tx=0x7f4758008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4760ff9700 1 -- 172.21.15.115:0/1829973149 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758010580 con 0x7f4764065ff0 2023-07-27T14:36:09.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4760ff9700 1 -- 172.21.15.115:0/1829973149 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47580106e0 con 0x7f4764065ff0 2023-07-27T14:36:09.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f4760ff9700 1 -- 172.21.15.115:0/1829973149 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758010a60 con 0x7f4764065ff0 2023-07-27T14:36:09.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47640a52c0 con 0x7f4764065ff0 2023-07-27T14:36:09.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.413+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47640ad5e0 con 0x7f4764065ff0 2023-07-27T14:36:09.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.414+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47640ad080 con 0x7f4764065ff0 2023-07-27T14:36:09.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.415+0000 7f4760ff9700 1 -- 172.21.15.115:0/1829973149 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f475801b460 con 0x7f4764065ff0 2023-07-27T14:36:09.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.416+0000 7f4760ff9700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f474805f880 0x7f4748061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.416+0000 7f4760ff9700 1 -- 172.21.15.115:0/1829973149 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f475807ad70 con 0x7f4764065ff0 2023-07-27T14:36:09.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.416+0000 7f4763fff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f474805f880 0x7f4748061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.417+0000 7f4763fff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f474805f880 0x7f4748061d40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f4750009130 tx=0x7f4750017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.420+0000 7f4760ff9700 1 -- 172.21.15.115:0/1829973149 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f475804b640 con 0x7f4764065ff0 2023-07-27T14:36:09.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.588+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f476406c470 con 0x7f4764065ff0 2023-07-27T14:36:09.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.589+0000 7f4760ff9700 1 -- 172.21.15.115:0/1829973149 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17295 (secure 0 0 0) 0x7f475804ec60 con 0x7f4764065ff0 2023-07-27T14:36:09.636 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:09.636 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":145,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:36:06.697226+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:34:59.767019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-27T14:35:00.338085+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.33","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":20,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:36:09.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f474805f880 msgr2=0x7f4748061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f474805f880 0x7f4748061d40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f4750009130 tx=0x7f4750017000).stop 2023-07-27T14:36:09.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 msgr2=0x7f47640ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f47640ae5b0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f475800c880 tx=0x7f4758008040).stop 2023-07-27T14:36:09.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 shutdown_connections 2023-07-27T14:36:09.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f474805f880 0x7f4748061d40 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4764151d70 0x7f476414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4764065ff0 0x7f47640ae5b0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 --2- 172.21.15.115:0/1829973149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4764066960 0x7f47640ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 >> 172.21.15.115:0/1829973149 conn(0x7f47640c89a0 msgr2=0x7f4764152e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:09.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 shutdown_connections 2023-07-27T14:36:09.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.591+0000 7f476adff700 1 -- 172.21.15.115:0/1829973149 wait complete. 2023-07-27T14:36:09.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:34:59.767019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:35:00.338085+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 145, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:36:09.656 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:36:09.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.802+0000 7f7ea03ff700 1 Processor -- start 2023-07-27T14:36:09.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.803+0000 7f7ea03ff700 1 -- start start 2023-07-27T14:36:09.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.804+0000 7f7ea03ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7e98063260 0x7f7e98154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.804+0000 7f7ea03ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7e9814b1e0 0x7f7e980a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.804+0000 7f7ea03ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e981553f0 con 0x7f7e9814ae00 2023-07-27T14:36:09.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.804+0000 7f7ea03ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e98157a50 con 0x7f7e9814b1e0 2023-07-27T14:36:09.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.804+0000 7f7ea03ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e98157d10 con 0x7f7e98063260 2023-07-27T14:36:09.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.804+0000 7f7e9e19b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7e9814ae00 0x7f7e98062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:32904/0 (socket says 172.21.15.115:32904) 2023-07-27T14:36:09.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.804+0000 7f7e9e19b700 1 -- 172.21.15.115:0/1631884438 learned_addr learned my addr 172.21.15.115:0/1631884438 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:09.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.804+0000 7f7e9e99c700 1 --2- 172.21.15.115:0/1631884438 >> v2:172.21.15.115:3300/0 conn(0x7f7e9814b1e0 0x7f7e980a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9d99a700 1 --2- 172.21.15.115:0/1631884438 >> v2:172.21.15.159:3300/0 conn(0x7f7e98063260 0x7f7e98154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9e99c700 1 -- 172.21.15.115:0/1631884438 >> v2:172.21.15.159:3300/0 conn(0x7f7e98063260 msgr2=0x7f7e98154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:09.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9e99c700 1 --2- 172.21.15.115:0/1631884438 >> v2:172.21.15.159:3300/0 conn(0x7f7e98063260 0x7f7e98154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9e99c700 1 -- 172.21.15.115:0/1631884438 >> v1:172.21.15.115:6789/0 conn(0x7f7e9814ae00 legacy=0x7f7e98062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9e99c700 1 -- 172.21.15.115:0/1631884438 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98157ff0 con 0x7f7e9814b1e0 2023-07-27T14:36:09.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9d199700 1 -- 172.21.15.115:0/1631884438 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418242574 0 0) 0x7f7e981553f0 con 0x7f7e9814ae00 2023-07-27T14:36:09.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9e99c700 1 --2- 172.21.15.115:0/1631884438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e980a98c0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f7e980cbc00 tx=0x7f7e90009780).ready entity=mon.0 client_cookie=e0eccf05b26760f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9d199700 1 -- 172.21.15.115:0/1631884438 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000e070 con 0x7f7e9814b1e0 2023-07-27T14:36:09.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9d199700 1 -- 172.21.15.115:0/1631884438 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9000bc30 con 0x7f7e9814b1e0 2023-07-27T14:36:09.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.805+0000 7f7e9d199700 1 -- 172.21.15.115:0/1631884438 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90012410 con 0x7f7e9814b1e0 2023-07-27T14:36:09.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.806+0000 7f7ea03ff700 1 -- 172.21.15.115:0/1631884438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 msgr2=0x7f7e980a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.806+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/1631884438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e980a98c0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f7e980cbc00 tx=0x7f7e90009780).stop 2023-07-27T14:36:09.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.806+0000 7f7ea03ff700 1 -- 172.21.15.115:0/1631884438 shutdown_connections 2023-07-27T14:36:09.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.806+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/1631884438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e980a98c0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.806+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/1631884438 >> v2:172.21.15.159:3300/0 conn(0x7f7e98063260 0x7f7e98154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.806+0000 7f7ea03ff700 1 -- 172.21.15.115:0/1631884438 >> 172.21.15.115:0/1631884438 conn(0x7f7e9805e940 msgr2=0x7f7e980cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:09.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.806+0000 7f7ea03ff700 1 -- 172.21.15.115:0/1631884438 shutdown_connections 2023-07-27T14:36:09.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.806+0000 7f7ea03ff700 1 -- 172.21.15.115:0/1631884438 wait complete. 2023-07-27T14:36:09.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.807+0000 7f7ea03ff700 1 Processor -- start 2023-07-27T14:36:09.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.807+0000 7f7ea03ff700 1 -- start start 2023-07-27T14:36:09.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.808+0000 7f7ea03ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e98063260 0x7f7e98167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.808+0000 7f7ea03ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9814ae00 0x7f7e980c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.808+0000 7f7ea03ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e9813e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.808+0000 7f7ea03ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e981681b0 con 0x7f7e9814b1e0 2023-07-27T14:36:09.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.808+0000 7f7ea03ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9814cbe0 con 0x7f7e9814ae00 2023-07-27T14:36:09.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.808+0000 7f7ea03ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c31f0 con 0x7f7e98063260 2023-07-27T14:36:09.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e9813e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e9813e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52148/0 (socket says 172.21.15.115:52148) 2023-07-27T14:36:09.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 -- 172.21.15.115:0/8584580 learned_addr learned my addr 172.21.15.115:0/8584580 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:09.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9d99a700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9814ae00 0x7f7e980c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e19b700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e98063260 0x7f7e98167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 -- 172.21.15.115:0/8584580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e98063260 msgr2=0x7f7e98167cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e98063260 0x7f7e98167cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 -- 172.21.15.115:0/8584580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9814ae00 msgr2=0x7f7e980c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:09.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9814ae00 0x7f7e980c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:09.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 -- 172.21.15.115:0/8584580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009a20 con 0x7f7e9814b1e0 2023-07-27T14:36:09.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e9e99c700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e9813e420 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f7e98155580 tx=0x7f7e9814eb20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e8e7fc700 1 -- 172.21.15.115:0/8584580 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e900116d0 con 0x7f7e9814b1e0 2023-07-27T14:36:09.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e8e7fc700 1 -- 172.21.15.115:0/8584580 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e90011830 con 0x7f7e9814b1e0 2023-07-27T14:36:09.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.809+0000 7f7e8e7fc700 1 -- 172.21.15.115:0/8584580 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90011bf0 con 0x7f7e9814b1e0 2023-07-27T14:36:09.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.810+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980c29b0 con 0x7f7e9814b1e0 2023-07-27T14:36:09.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.810+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980c2f10 con 0x7f7e9814b1e0 2023-07-27T14:36:09.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.811+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9814cd90 con 0x7f7e9814b1e0 2023-07-27T14:36:09.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.811+0000 7f7e8e7fc700 1 -- 172.21.15.115:0/8584580 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f7e90027460 con 0x7f7e9814b1e0 2023-07-27T14:36:09.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.812+0000 7f7e8e7fc700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7e7c05f880 0x7f7e7c061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:09.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.812+0000 7f7e8e7fc700 1 -- 172.21.15.115:0/8584580 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f7e9007cfe0 con 0x7f7e9814b1e0 2023-07-27T14:36:09.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.812+0000 7f7e9e19b700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7e7c05f880 0x7f7e7c061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:09.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.813+0000 7f7e9e19b700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7e7c05f880 0x7f7e7c061d40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f7e940011e0 tx=0x7f7e94009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:09.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.816+0000 7f7e8e7fc700 1 -- 172.21.15.115:0/8584580 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e900ab8f0 con 0x7f7e9814b1e0 2023-07-27T14:36:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.985+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7e9806c470 con 0x7f7e9814b1e0 2023-07-27T14:36:10.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.985+0000 7f7e8e7fc700 1 -- 172.21.15.115:0/8584580 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v145) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7e9814cd90 con 0x7f7e9814b1e0 2023-07-27T14:36:10.033 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:36:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.987+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7e7c05f880 msgr2=0x7f7e7c061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.987+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7e7c05f880 0x7f7e7c061d40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f7e940011e0 tx=0x7f7e94009040).stop 2023-07-27T14:36:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.987+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 msgr2=0x7f7e9813e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.987+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e9813e420 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f7e98155580 tx=0x7f7e9814eb20).stop 2023-07-27T14:36:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.987+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 shutdown_connections 2023-07-27T14:36:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.987+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7e7c05f880 0x7f7e7c061d40 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.987+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e9814b1e0 0x7f7e9813e420 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.988+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7e98063260 0x7f7e98167cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.988+0000 7f7ea03ff700 1 --2- 172.21.15.115:0/8584580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e9814ae00 0x7f7e980c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.988+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 >> 172.21.15.115:0/8584580 conn(0x7f7e9805e940 msgr2=0x7f7e9814a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.988+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 shutdown_connections 2023-07-27T14:36:10.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:09.988+0000 7f7ea03ff700 1 -- 172.21.15.115:0/8584580 wait complete. 2023-07-27T14:36:10.051 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:36:10.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.194+0000 7fed84dff700 1 Processor -- start 2023-07-27T14:36:10.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.195+0000 7fed84dff700 1 -- start start 2023-07-27T14:36:10.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed84dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fed80153f30 0x7fed800a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed84dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed800c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed84dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed800c60a0 con 0x7fed800c0610 2023-07-27T14:36:10.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed84dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed800c5d70 con 0x7fed80153f30 2023-07-27T14:36:10.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed84dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed800a7e30 con 0x7fed800bfb50 2023-07-27T14:36:10.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed7e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fed80153f30 0x7fed800a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed7e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fed80153f30 0x7fed800a7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52156/0 (socket says 172.21.15.115:52156) 2023-07-27T14:36:10.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed7e59c700 1 -- 172.21.15.115:0/2777028377 learned_addr learned my addr 172.21.15.115:0/2777028377 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:10.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.196+0000 7fed7dd9b700 1 --2- 172.21.15.115:0/2777028377 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed800c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed7e59c700 1 -- 172.21.15.115:0/2777028377 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 msgr2=0x7fed800c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:10.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed7e59c700 1 --2- 172.21.15.115:0/2777028377 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed800c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed7e59c700 1 -- 172.21.15.115:0/2777028377 >> v1:172.21.15.115:6789/0 conn(0x7fed800c0610 legacy=0x7fed800c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed7e59c700 1 -- 172.21.15.115:0/2777028377 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed800c7d80 con 0x7fed80153f30 2023-07-27T14:36:10.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed7e59c700 1 --2- 172.21.15.115:0/2777028377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed80153f30 0x7fed800a7940 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fed70006fd0 tx=0x7fed700090f0).ready entity=mon.0 client_cookie=7048e621c2d7a740 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:10.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed7d59a700 1 -- 172.21.15.115:0/2777028377 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7000b600 con 0x7fed80153f30 2023-07-27T14:36:10.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed7d59a700 1 -- 172.21.15.115:0/2777028377 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7000b760 con 0x7fed80153f30 2023-07-27T14:36:10.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed7d59a700 1 -- 172.21.15.115:0/2777028377 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7000bae0 con 0x7fed80153f30 2023-07-27T14:36:10.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed84dff700 1 -- 172.21.15.115:0/2777028377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed80153f30 msgr2=0x7fed800a7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.197+0000 7fed84dff700 1 --2- 172.21.15.115:0/2777028377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed80153f30 0x7fed800a7940 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fed70006fd0 tx=0x7fed700090f0).stop 2023-07-27T14:36:10.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.198+0000 7fed84dff700 1 -- 172.21.15.115:0/2777028377 shutdown_connections 2023-07-27T14:36:10.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.198+0000 7fed84dff700 1 --2- 172.21.15.115:0/2777028377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed80153f30 0x7fed800a7940 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.198+0000 7fed84dff700 1 --2- 172.21.15.115:0/2777028377 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed800c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.198+0000 7fed84dff700 1 -- 172.21.15.115:0/2777028377 >> 172.21.15.115:0/2777028377 conn(0x7fed80094280 msgr2=0x7fed8005e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:10.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.198+0000 7fed84dff700 1 -- 172.21.15.115:0/2777028377 shutdown_connections 2023-07-27T14:36:10.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.198+0000 7fed84dff700 1 -- 172.21.15.115:0/2777028377 wait complete. 2023-07-27T14:36:10.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.200+0000 7fed84dff700 1 Processor -- start 2023-07-27T14:36:10.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.200+0000 7fed84dff700 1 -- start start 2023-07-27T14:36:10.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.201+0000 7fed84dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed80163a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.201+0000 7fed84dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed800c0610 0x7fed800ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.201+0000 7fed84dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed80153f30 0x7fed800abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.201+0000 7fed84dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed80163f10 con 0x7fed800c0610 2023-07-27T14:36:10.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.201+0000 7fed84dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed800cb6c0 con 0x7fed80153f30 2023-07-27T14:36:10.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.201+0000 7fed84dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed800cb9a0 con 0x7fed800bfb50 2023-07-27T14:36:10.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.201+0000 7fed7dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed800c0610 0x7fed800ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7e59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed80163a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7e59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed80163a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:54026/0 (socket says 172.21.15.115:54026) 2023-07-27T14:36:10.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed800c0610 0x7fed800ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52172/0 (socket says 172.21.15.115:52172) 2023-07-27T14:36:10.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7e59c700 1 -- 172.21.15.115:0/3358568863 learned_addr learned my addr 172.21.15.115:0/3358568863 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:10.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7ed9d700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed80153f30 0x7fed800abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7dd9b700 1 -- 172.21.15.115:0/3358568863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 msgr2=0x7fed80163a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7dd9b700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed80163a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7dd9b700 1 -- 172.21.15.115:0/3358568863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed80153f30 msgr2=0x7fed800abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7dd9b700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed80153f30 0x7fed800abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7dd9b700 1 -- 172.21.15.115:0/3358568863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed70009370 con 0x7fed800c0610 2023-07-27T14:36:10.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed7dd9b700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed800c0610 0x7fed800ab6a0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fed7400d890 tx=0x7fed74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:10.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed6e7fc700 1 -- 172.21.15.115:0/3358568863 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74011590 con 0x7fed800c0610 2023-07-27T14:36:10.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed6e7fc700 1 -- 172.21.15.115:0/3358568863 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed740116f0 con 0x7fed800c0610 2023-07-27T14:36:10.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed6e7fc700 1 -- 172.21.15.115:0/3358568863 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74011a70 con 0x7fed800c0610 2023-07-27T14:36:10.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.202+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed800ae1f0 con 0x7fed800c0610 2023-07-27T14:36:10.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.203+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed800ae7b0 con 0x7fed800c0610 2023-07-27T14:36:10.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.204+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed800ae970 con 0x7fed800c0610 2023-07-27T14:36:10.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.204+0000 7fed6e7fc700 1 -- 172.21.15.115:0/3358568863 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fed74012420 con 0x7fed800c0610 2023-07-27T14:36:10.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.205+0000 7fed6e7fc700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed6005f880 0x7fed60061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.205+0000 7fed6e7fc700 1 -- 172.21.15.115:0/3358568863 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fed7407a790 con 0x7fed800c0610 2023-07-27T14:36:10.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.205+0000 7fed7e59c700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed6005f880 0x7fed60061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.206+0000 7fed7e59c700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed6005f880 0x7fed60061d40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fed7000b730 tx=0x7fed70017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:10.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.209+0000 7fed6e7fc700 1 -- 172.21.15.115:0/3358568863 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed7404b060 con 0x7fed800c0610 2023-07-27T14:36:10.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.375+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fed8006c470 con 0x7fed800c0610 2023-07-27T14:36:10.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.375+0000 7fed6e7fc700 1 -- 172.21.15.115:0/3358568863 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed7404e680 con 0x7fed800c0610 2023-07-27T14:36:10.422 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:36:10.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed6005f880 msgr2=0x7fed60061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed6005f880 0x7fed60061d40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fed7000b730 tx=0x7fed70017000).stop 2023-07-27T14:36:10.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed800c0610 msgr2=0x7fed800ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed800c0610 0x7fed800ab6a0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fed7400d890 tx=0x7fed74008040).stop 2023-07-27T14:36:10.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 shutdown_connections 2023-07-27T14:36:10.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed6005f880 0x7fed60061d40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed80153f30 0x7fed800abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fed800bfb50 0x7fed80163a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 --2- 172.21.15.115:0/3358568863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed800c0610 0x7fed800ab6a0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 >> 172.21.15.115:0/3358568863 conn(0x7fed80094280 msgr2=0x7fed800c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:10.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 shutdown_connections 2023-07-27T14:36:10.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.377+0000 7fed84dff700 1 -- 172.21.15.115:0/3358568863 wait complete. 2023-07-27T14:36:10.441 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:36:10.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.584+0000 7f5b075ff700 1 Processor -- start 2023-07-27T14:36:10.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.584+0000 7f5b075ff700 1 -- start start 2023-07-27T14:36:10.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.585+0000 7f5b075ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b001509b0 0x7f5b000c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.585+0000 7f5b075ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b000c0ea0 con 0x7f5b00150d90 2023-07-27T14:36:10.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.585+0000 7f5b075ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b00068e10 con 0x7f5b000c3100 2023-07-27T14:36:10.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.585+0000 7f5b075ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00155190 con 0x7f5b001509b0 2023-07-27T14:36:10.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.585+0000 7f5b04b9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5b00150d90 0x7f5b00154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:32914/0 (socket says 172.21.15.115:32914) 2023-07-27T14:36:10.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5b04b9a700 1 -- 172.21.15.115:0/1362125269 learned_addr learned my addr 172.21.15.115:0/1362125269 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:10.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5b0539b700 1 --2- 172.21.15.115:0/1362125269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b001509b0 0x7f5b000c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5af7fff700 1 -- 172.21.15.115:0/1362125269 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970622130 0 0) 0x7f5b000c0ea0 con 0x7f5b00150d90 2023-07-27T14:36:10.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5af7fff700 1 -- 172.21.15.115:0/1362125269 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aec0033f0 con 0x7f5b00150d90 2023-07-27T14:36:10.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5b0539b700 1 -- 172.21.15.115:0/1362125269 >> v1:172.21.15.159:6789/0 conn(0x7f5b000c3100 legacy=0x7f5b000c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5af7fff700 1 -- 172.21.15.115:0/1362125269 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161467114 0 0) 0x7f5b00068e10 con 0x7f5b000c3100 2023-07-27T14:36:10.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5b0539b700 1 -- 172.21.15.115:0/1362125269 >> v1:172.21.15.115:6789/0 conn(0x7f5b00150d90 legacy=0x7f5b00154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5b0539b700 1 -- 172.21.15.115:0/1362125269 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b00155470 con 0x7f5b001509b0 2023-07-27T14:36:10.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.586+0000 7f5b0539b700 1 --2- 172.21.15.115:0/1362125269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b001509b0 0x7f5b000c58d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f5afc009790 tx=0x7f5afc009060).ready entity=mon.2 client_cookie=9b5779a22a89bb5c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:10.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5af7fff700 1 -- 172.21.15.115:0/1362125269 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0001470 con 0x7f5b001509b0 2023-07-27T14:36:10.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5af7fff700 1 -- 172.21.15.115:0/1362125269 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc012410 con 0x7f5b001509b0 2023-07-27T14:36:10.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5af7fff700 1 -- 172.21.15.115:0/1362125269 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc012790 con 0x7f5b001509b0 2023-07-27T14:36:10.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5b075ff700 1 -- 172.21.15.115:0/1362125269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b001509b0 msgr2=0x7f5b000c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5b075ff700 1 --2- 172.21.15.115:0/1362125269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b001509b0 0x7f5b000c58d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f5afc009790 tx=0x7f5afc009060).stop 2023-07-27T14:36:10.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5b075ff700 1 -- 172.21.15.115:0/1362125269 shutdown_connections 2023-07-27T14:36:10.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5b075ff700 1 --2- 172.21.15.115:0/1362125269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b001509b0 0x7f5b000c58d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5b075ff700 1 -- 172.21.15.115:0/1362125269 >> 172.21.15.115:0/1362125269 conn(0x7f5b00062320 msgr2=0x7f5b00062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:10.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5b075ff700 1 -- 172.21.15.115:0/1362125269 shutdown_connections 2023-07-27T14:36:10.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.587+0000 7f5b075ff700 1 -- 172.21.15.115:0/1362125269 wait complete. 2023-07-27T14:36:10.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.589+0000 7f5b075ff700 1 Processor -- start 2023-07-27T14:36:10.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.589+0000 7f5b075ff700 1 -- start start 2023-07-27T14:36:10.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b075ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b000c3100 0x7f5b0014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b075ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b001509b0 0x7f5b0014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b075ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b00150d90 0x7f5b0014c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b075ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0014cb20 con 0x7f5b001509b0 2023-07-27T14:36:10.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b075ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000a6420 con 0x7f5b00150d90 2023-07-27T14:36:10.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b075ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000a6700 con 0x7f5b000c3100 2023-07-27T14:36:10.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b04b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b001509b0 0x7f5b0014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b04b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b001509b0 0x7f5b0014c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52182/0 (socket says 172.21.15.115:52182) 2023-07-27T14:36:10.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b04b9a700 1 -- 172.21.15.115:0/518683150 learned_addr learned my addr 172.21.15.115:0/518683150 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:10.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b0539b700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b000c3100 0x7f5b0014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.590+0000 7f5b05b9c700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b00150d90 0x7f5b0014c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5b04b9a700 1 -- 172.21.15.115:0/518683150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b000c3100 msgr2=0x7f5b0014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5b04b9a700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b000c3100 0x7f5b0014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5b04b9a700 1 -- 172.21.15.115:0/518683150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b00150d90 msgr2=0x7f5b0014c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5b04b9a700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b00150d90 0x7f5b0014c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5b04b9a700 1 -- 172.21.15.115:0/518683150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc0092a0 con 0x7f5b001509b0 2023-07-27T14:36:10.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5b04b9a700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b001509b0 0x7f5b0014c140 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f5af000c7e0 tx=0x7f5af0001af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:10.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5af57fa700 1 -- 172.21.15.115:0/518683150 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0007170 con 0x7f5b001509b0 2023-07-27T14:36:10.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5af57fa700 1 -- 172.21.15.115:0/518683150 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af00072d0 con 0x7f5b001509b0 2023-07-27T14:36:10.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5af57fa700 1 -- 172.21.15.115:0/518683150 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00048c0 con 0x7f5b001509b0 2023-07-27T14:36:10.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0014fac0 con 0x7f5b001509b0 2023-07-27T14:36:10.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.591+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00150080 con 0x7f5b001509b0 2023-07-27T14:36:10.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.592+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b000a68b0 con 0x7f5b001509b0 2023-07-27T14:36:10.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.593+0000 7f5af57fa700 1 -- 172.21.15.115:0/518683150 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f5af0004c70 con 0x7f5b001509b0 2023-07-27T14:36:10.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.594+0000 7f5af57fa700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ae405f880 0x7f5ae4061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:10.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.594+0000 7f5af57fa700 1 -- 172.21.15.115:0/518683150 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6235+0+0 (secure 0 0 0) 0x7f5af007a810 con 0x7f5b001509b0 2023-07-27T14:36:10.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.594+0000 7f5b0539b700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ae405f880 0x7f5ae4061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:10.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.595+0000 7f5b0539b700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ae405f880 0x7f5ae4061d40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f5b000ac210 tx=0x7f5b00068d80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:10.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.598+0000 7f5af57fa700 1 -- 172.21.15.115:0/518683150 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5af004b300 con 0x7f5b001509b0 2023-07-27T14:36:10.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.769+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b00155750 con 0x7f5b001509b0 2023-07-27T14:36:10.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.770+0000 7f5af57fa700 1 -- 172.21.15.115:0/518683150 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5af004e920 con 0x7f5b001509b0 2023-07-27T14:36:10.817 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:36:10.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ae405f880 msgr2=0x7f5ae4061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ae405f880 0x7f5ae4061d40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f5b000ac210 tx=0x7f5b00068d80).stop 2023-07-27T14:36:10.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b001509b0 msgr2=0x7f5b0014c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:10.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b001509b0 0x7f5b0014c140 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f5af000c7e0 tx=0x7f5af0001af0).stop 2023-07-27T14:36:10.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 shutdown_connections 2023-07-27T14:36:10.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ae405f880 0x7f5ae4061d40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b00150d90 0x7f5b0014c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b000c3100 0x7f5b0014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 --2- 172.21.15.115:0/518683150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b001509b0 0x7f5b0014c140 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 >> 172.21.15.115:0/518683150 conn(0x7f5b00062320 msgr2=0x7f5b000bc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 shutdown_connections 2023-07-27T14:36:10.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.772+0000 7f5b075ff700 1 -- 172.21.15.115:0/518683150 wait complete. 2023-07-27T14:36:10.837 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:36:11.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.979+0000 7fd9ff9ff700 1 Processor -- start 2023-07-27T14:36:11.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.979+0000 7fd9ff9ff700 1 -- start start 2023-07-27T14:36:11.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9ff9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd9f8063260 0x7fd9f8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9ff9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9f814b1e0 0x7fd9f80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9ff9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f81553f0 con 0x7fd9f814ae00 2023-07-27T14:36:11.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9ff9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f8157a50 con 0x7fd9f814b1e0 2023-07-27T14:36:11.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9ff9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f8157d10 con 0x7fd9f8063260 2023-07-27T14:36:11.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fdf9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9f814b1e0 0x7fd9f80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fdf9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9f814b1e0 0x7fd9f80a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52190/0 (socket says 172.21.15.115:52190) 2023-07-27T14:36:11.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fdf9c700 1 -- 172.21.15.115:0/2956688492 learned_addr learned my addr 172.21.15.115:0/2956688492 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:11.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fdf9c700 1 -- 172.21.15.115:0/2956688492 >> v2:172.21.15.159:3300/0 conn(0x7fd9f8063260 msgr2=0x7fd9f8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:11.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fcf9a700 1 --2- 172.21.15.115:0/2956688492 >> v2:172.21.15.159:3300/0 conn(0x7fd9f8063260 0x7fd9f8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fdf9c700 1 --2- 172.21.15.115:0/2956688492 >> v2:172.21.15.159:3300/0 conn(0x7fd9f8063260 0x7fd9f8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fdf9c700 1 -- 172.21.15.115:0/2956688492 >> v1:172.21.15.159:6789/0 conn(0x7fd9f814ae00 legacy=0x7fd9f8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:11.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fdf9c700 1 -- 172.21.15.115:0/2956688492 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8157ff0 con 0x7fd9f814b1e0 2023-07-27T14:36:11.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.981+0000 7fd9fcf9a700 1 --2- 172.21.15.115:0/2956688492 >> v2:172.21.15.159:3300/0 conn(0x7fd9f8063260 0x7fd9f8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:11.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9fdf9c700 1 --2- 172.21.15.115:0/2956688492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80a98c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fd9f80cbc00 tx=0x7fd9f0009840).ready entity=mon.0 client_cookie=49de0081f4720b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9effff700 1 -- 172.21.15.115:0/2956688492 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000e070 con 0x7fd9f814b1e0 2023-07-27T14:36:11.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9effff700 1 -- 172.21.15.115:0/2956688492 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f000ba10 con 0x7fd9f814b1e0 2023-07-27T14:36:11.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9effff700 1 -- 172.21.15.115:0/2956688492 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000bd90 con 0x7fd9f814b1e0 2023-07-27T14:36:11.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2956688492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 msgr2=0x7fd9f80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2956688492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80a98c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fd9f80cbc00 tx=0x7fd9f0009840).stop 2023-07-27T14:36:11.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2956688492 shutdown_connections 2023-07-27T14:36:11.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2956688492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80a98c0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2956688492 >> v2:172.21.15.159:3300/0 conn(0x7fd9f8063260 0x7fd9f8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.982+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2956688492 >> 172.21.15.115:0/2956688492 conn(0x7fd9f805e940 msgr2=0x7fd9f80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:11.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.983+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2956688492 shutdown_connections 2023-07-27T14:36:11.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.983+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2956688492 wait complete. 2023-07-27T14:36:11.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.984+0000 7fd9ff9ff700 1 Processor -- start 2023-07-27T14:36:11.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.984+0000 7fd9ff9ff700 1 -- start start 2023-07-27T14:36:11.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.985+0000 7fd9ff9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9f8063260 0x7fd9f80c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.985+0000 7fd9ff9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9f814ae00 0x7fd9f80c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.985+0000 7fd9ff9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.985+0000 7fd9ff9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f814c9f0 con 0x7fd9f814b1e0 2023-07-27T14:36:11.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.985+0000 7fd9ff9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f80c4c70 con 0x7fd9f8063260 2023-07-27T14:36:11.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.985+0000 7fd9ff9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f80c4f50 con 0x7fd9f814ae00 2023-07-27T14:36:11.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.985+0000 7fd9fdf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fdf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52198/0 (socket says 172.21.15.115:52198) 2023-07-27T14:36:11.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fdf9c700 1 -- 172.21.15.115:0/2302003049 learned_addr learned my addr 172.21.15.115:0/2302003049 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:11.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fcf9a700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9f814ae00 0x7fd9f80c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fd79b700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9f8063260 0x7fd9f80c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fdf9c700 1 -- 172.21.15.115:0/2302003049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9f814ae00 msgr2=0x7fd9f80c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fdf9c700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9f814ae00 0x7fd9f80c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fdf9c700 1 -- 172.21.15.115:0/2302003049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9f8063260 msgr2=0x7fd9f80c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fdf9c700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9f8063260 0x7fd9f80c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fdf9c700 1 -- 172.21.15.115:0/2302003049 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0009ae0 con 0x7fd9f814b1e0 2023-07-27T14:36:11.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9fdf9c700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80b0590 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fd9f0009540 tx=0x7fd9f814eb20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9ed7fa700 1 -- 172.21.15.115:0/2302003049 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0013e80 con 0x7fd9f814b1e0 2023-07-27T14:36:11.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9ed7fa700 1 -- 172.21.15.115:0/2302003049 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f001d410 con 0x7fd9f814b1e0 2023-07-27T14:36:11.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f80c5230 con 0x7fd9f814b1e0 2023-07-27T14:36:11.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.986+0000 7fd9ed7fa700 1 -- 172.21.15.115:0/2302003049 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f001d7b0 con 0x7fd9f814b1e0 2023-07-27T14:36:11.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.987+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f80c48d0 con 0x7fd9f814b1e0 2023-07-27T14:36:11.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.987+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f814cb60 con 0x7fd9f814b1e0 2023-07-27T14:36:11.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.989+0000 7fd9ed7fa700 1 -- 172.21.15.115:0/2302003049 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fd9f001b040 con 0x7fd9f814b1e0 2023-07-27T14:36:11.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.989+0000 7fd9ed7fa700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9dc05f880 0x7fd9dc061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.990+0000 7fd9ed7fa700 1 -- 172.21.15.115:0/2302003049 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fd9f007c840 con 0x7fd9f814b1e0 2023-07-27T14:36:11.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.990+0000 7fd9fd79b700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9dc05f880 0x7fd9dc061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.990+0000 7fd9fd79b700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9dc05f880 0x7fd9dc061d40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fd9f40038b0 tx=0x7fd9f4007d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:10.993+0000 7fd9ed7fa700 1 -- 172.21.15.115:0/2302003049 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9f004d170 con 0x7fd9f814b1e0 2023-07-27T14:36:11.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.162+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9f814cb30 con 0x7fd9f814b1e0 2023-07-27T14:36:11.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.162+0000 7fd9ed7fa700 1 -- 172.21.15.115:0/2302003049 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd9f0050790 con 0x7fd9f814b1e0 2023-07-27T14:36:11.209 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:36:11.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9dc05f880 msgr2=0x7fd9dc061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9dc05f880 0x7fd9dc061d40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fd9f40038b0 tx=0x7fd9f4007d20).stop 2023-07-27T14:36:11.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 msgr2=0x7fd9f80b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80b0590 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fd9f0009540 tx=0x7fd9f814eb20).stop 2023-07-27T14:36:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 shutdown_connections 2023-07-27T14:36:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9dc05f880 0x7fd9dc061d40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9f814b1e0 0x7fd9f80b0590 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9f8063260 0x7fd9f80c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 --2- 172.21.15.115:0/2302003049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9f814ae00 0x7fd9f80c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 >> 172.21.15.115:0/2302003049 conn(0x7fd9f805e940 msgr2=0x7fd9f80ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:11.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 shutdown_connections 2023-07-27T14:36:11.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.164+0000 7fd9ff9ff700 1 -- 172.21.15.115:0/2302003049 wait complete. 2023-07-27T14:36:11.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:36:11.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.369+0000 7fa14efff700 1 Processor -- start 2023-07-27T14:36:11.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.369+0000 7fa14efff700 1 -- start start 2023-07-27T14:36:11.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.370+0000 7fa14efff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa148151d70 0x7fa148155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.370+0000 7fa14efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148066b80 0x7fa148067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.370+0000 7fa14efff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa148067080 con 0x7fa148065ff0 2023-07-27T14:36:11.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.370+0000 7fa14efff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa148063a90 con 0x7fa148151d70 2023-07-27T14:36:11.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.370+0000 7fa14efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480634d0 con 0x7fa148066b80 2023-07-27T14:36:11.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.370+0000 7fa14cd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa148151d70 0x7fa148155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.370+0000 7fa14cd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa148151d70 0x7fa148155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52200/0 (socket says 172.21.15.115:52200) 2023-07-27T14:36:11.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.370+0000 7fa14cd9b700 1 -- 172.21.15.115:0/3691600973 learned_addr learned my addr 172.21.15.115:0/3691600973 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:11.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa14d59c700 1 --2- 172.21.15.115:0/3691600973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148066b80 0x7fa148067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa14cd9b700 1 -- 172.21.15.115:0/3691600973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148066b80 msgr2=0x7fa148067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:11.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa14cd9b700 1 --2- 172.21.15.115:0/3691600973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148066b80 0x7fa148067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa14cd9b700 1 -- 172.21.15.115:0/3691600973 >> v1:172.21.15.115:6789/0 conn(0x7fa148065ff0 legacy=0x7fa148066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa14cd9b700 1 -- 172.21.15.115:0/3691600973 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480637b0 con 0x7fa148151d70 2023-07-27T14:36:11.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa14cd9b700 1 --2- 172.21.15.115:0/3691600973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148151d70 0x7fa148155060 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fa13c006fd0 tx=0x7fa13c0090f0).ready entity=mon.0 client_cookie=ef46f6407a89f7b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa1477fe700 1 -- 172.21.15.115:0/3691600973 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13c00b600 con 0x7fa148151d70 2023-07-27T14:36:11.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa1477fe700 1 -- 172.21.15.115:0/3691600973 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13c00b760 con 0x7fa148151d70 2023-07-27T14:36:11.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.371+0000 7fa1477fe700 1 -- 172.21.15.115:0/3691600973 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13c00bae0 con 0x7fa148151d70 2023-07-27T14:36:11.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.372+0000 7fa14efff700 1 -- 172.21.15.115:0/3691600973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148151d70 msgr2=0x7fa148155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.372+0000 7fa14efff700 1 --2- 172.21.15.115:0/3691600973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148151d70 0x7fa148155060 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fa13c006fd0 tx=0x7fa13c0090f0).stop 2023-07-27T14:36:11.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.372+0000 7fa14efff700 1 -- 172.21.15.115:0/3691600973 shutdown_connections 2023-07-27T14:36:11.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.372+0000 7fa14efff700 1 --2- 172.21.15.115:0/3691600973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148066b80 0x7fa148067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.372+0000 7fa14efff700 1 --2- 172.21.15.115:0/3691600973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148151d70 0x7fa148155060 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.372+0000 7fa14efff700 1 -- 172.21.15.115:0/3691600973 >> 172.21.15.115:0/3691600973 conn(0x7fa1480c89a0 msgr2=0x7fa1480c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:11.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.372+0000 7fa14efff700 1 -- 172.21.15.115:0/3691600973 shutdown_connections 2023-07-27T14:36:11.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.372+0000 7fa14efff700 1 -- 172.21.15.115:0/3691600973 wait complete. 2023-07-27T14:36:11.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.373+0000 7fa14efff700 1 Processor -- start 2023-07-27T14:36:11.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.374+0000 7fa14efff700 1 -- start start 2023-07-27T14:36:11.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.374+0000 7fa14efff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa148065ff0 0x7fa1480c2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.374+0000 7fa14efff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148066b80 0x7fa1481464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.374+0000 7fa14efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148151d70 0x7fa1480a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.374+0000 7fa14efff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480c28e0 con 0x7fa148066b80 2023-07-27T14:36:11.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.374+0000 7fa14efff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148154d20 con 0x7fa148065ff0 2023-07-27T14:36:11.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.374+0000 7fa14efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa148155000 con 0x7fa148151d70 2023-07-27T14:36:11.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148066b80 0x7fa1481464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148066b80 0x7fa1481464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52214/0 (socket says 172.21.15.115:52214) 2023-07-27T14:36:11.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 -- 172.21.15.115:0/3284529014 learned_addr learned my addr 172.21.15.115:0/3284529014 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:11.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa14cd9b700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa148065ff0 0x7fa1480c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa14d59c700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148151d70 0x7fa1480a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 -- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148151d70 msgr2=0x7fa1480a8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148151d70 0x7fa1480a8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 -- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa148065ff0 msgr2=0x7fa1480c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa148065ff0 0x7fa1480c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 -- 172.21.15.115:0/3284529014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c009370 con 0x7fa148066b80 2023-07-27T14:36:11.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa14cd9b700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa148065ff0 0x7fa1480c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:11.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa14d59c700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148151d70 0x7fa1480a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:11.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa147fff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148066b80 0x7fa1481464c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fa13400c4c0 tx=0x7fa134007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.375+0000 7fa144ff9700 1 -- 172.21.15.115:0/3284529014 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa134007020 con 0x7fa148066b80 2023-07-27T14:36:11.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.376+0000 7fa144ff9700 1 -- 172.21.15.115:0/3284529014 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa134001e90 con 0x7fa148066b80 2023-07-27T14:36:11.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.376+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1481552e0 con 0x7fa148066b80 2023-07-27T14:36:11.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.376+0000 7fa144ff9700 1 -- 172.21.15.115:0/3284529014 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1340073b0 con 0x7fa148066b80 2023-07-27T14:36:11.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.376+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1480c2540 con 0x7fa148066b80 2023-07-27T14:36:11.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.377+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa148155800 con 0x7fa148066b80 2023-07-27T14:36:11.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.378+0000 7fa144ff9700 1 -- 172.21.15.115:0/3284529014 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fa134010070 con 0x7fa148066b80 2023-07-27T14:36:11.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.379+0000 7fa144ff9700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12c05f880 0x7fa12c061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.379+0000 7fa144ff9700 1 -- 172.21.15.115:0/3284529014 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fa13407a4e0 con 0x7fa148066b80 2023-07-27T14:36:11.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.379+0000 7fa14cd9b700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12c05f880 0x7fa12c061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.379+0000 7fa14cd9b700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12c05f880 0x7fa12c061d40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fa13c009130 tx=0x7fa13c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.383+0000 7fa144ff9700 1 -- 172.21.15.115:0/3284529014 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa148155800 con 0x7fa148066b80 2023-07-27T14:36:11.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.591+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa148155800 con 0x7fa148066b80 2023-07-27T14:36:11.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.592+0000 7fa144ff9700 1 -- 172.21.15.115:0/3284529014 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fa148155800 con 0x7fa148066b80 2023-07-27T14:36:11.639 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:11.639 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/231954123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":231954123},{"type":"v1","addr":"172.21.15.159:6834","nonce":231954123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7432,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3337360418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3337360418},{"type":"v1","addr":"172.21.15.159:6835","nonce":3337360418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2630769428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2630769428},{"type":"v1","addr":"172.21.15.115:6836","nonce":2630769428}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:35:01.359343+0000","modified":"2023-07-27T14:35:04.371738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2708675397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2708675397},{"type":"v1","addr":"172.21.15.115:6837","nonce":2708675397}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-07-27T14:36:11.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12c05f880 msgr2=0x7fa12c061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12c05f880 0x7fa12c061d40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fa13c009130 tx=0x7fa13c017000).stop 2023-07-27T14:36:11.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148066b80 msgr2=0x7fa1481464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148066b80 0x7fa1481464c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fa13400c4c0 tx=0x7fa134007e00).stop 2023-07-27T14:36:11.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 shutdown_connections 2023-07-27T14:36:11.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa12c05f880 0x7fa12c061d40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa148151d70 0x7fa1480a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa148065ff0 0x7fa1480c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 --2- 172.21.15.115:0/3284529014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa148066b80 0x7fa1481464c0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 >> 172.21.15.115:0/3284529014 conn(0x7fa1480c89a0 msgr2=0x7fa148152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:11.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 shutdown_connections 2023-07-27T14:36:11.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.594+0000 7fa14efff700 1 -- 172.21.15.115:0/3284529014 wait complete. 2023-07-27T14:36:11.643 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 77 2023-07-27T14:36:11.659 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:36:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.804+0000 7f2a087ff700 1 Processor -- start 2023-07-27T14:36:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.804+0000 7f2a087ff700 1 -- start start 2023-07-27T14:36:11.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.805+0000 7f2a087ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a00153ec0 0x7f2a000a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.805+0000 7f2a087ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2a000aa050 0x7f2a000640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.805+0000 7f2a087ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a000aa4d0 con 0x7f2a000aaa40 2023-07-27T14:36:11.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.805+0000 7f2a087ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a000c05c0 con 0x7f2a000aa050 2023-07-27T14:36:11.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.805+0000 7f2a087ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000c1a60 con 0x7f2a00153ec0 2023-07-27T14:36:11.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.806+0000 7f2a0659b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a00153ec0 0x7f2a000a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.806+0000 7f2a0659b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a00153ec0 0x7f2a000a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:54082/0 (socket says 172.21.15.115:54082) 2023-07-27T14:36:11.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.806+0000 7f2a0659b700 1 -- 172.21.15.115:0/3571971776 learned_addr learned my addr 172.21.15.115:0/3571971776 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:11.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.806+0000 7f2a05d9a700 1 --2- 172.21.15.115:0/3571971776 >> v2:172.21.15.159:3300/0 conn(0x7f2a000aa050 0x7f2a000640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.806+0000 7f2a06d9c700 1 --1- 172.21.15.115:0/3571971776 >> v1:172.21.15.159:6789/0 conn(0x7f2a000aaa40 0x7f2a00157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:39100/0 (socket says 172.21.15.115:39100) 2023-07-27T14:36:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.806+0000 7f2a0659b700 1 -- 172.21.15.115:0/3571971776 >> v2:172.21.15.159:3300/0 conn(0x7f2a000aa050 msgr2=0x7f2a000640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.806+0000 7f2a0659b700 1 --2- 172.21.15.115:0/3571971776 >> v2:172.21.15.159:3300/0 conn(0x7f2a000aa050 0x7f2a000640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.806+0000 7f2a0659b700 1 -- 172.21.15.115:0/3571971776 >> v1:172.21.15.159:6789/0 conn(0x7f2a000aaa40 legacy=0x7f2a00157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a0659b700 1 -- 172.21.15.115:0/3571971776 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a000bfc90 con 0x7f2a00153ec0 2023-07-27T14:36:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a05d9a700 1 --2- 172.21.15.115:0/3571971776 >> v2:172.21.15.159:3300/0 conn(0x7f2a000aa050 0x7f2a000640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a05599700 1 -- 172.21.15.115:0/3571971776 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758600552 0 0) 0x7f29f8001490 con 0x7f2a000aaa40 2023-07-27T14:36:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a0659b700 1 --2- 172.21.15.115:0/3571971776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a00153ec0 0x7f2a000a9b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f29fc006fd0 tx=0x7f29fc0090f0).ready entity=mon.2 client_cookie=f518d9a190905aba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a05599700 1 -- 172.21.15.115:0/3571971776 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00b580 con 0x7f2a00153ec0 2023-07-27T14:36:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a05599700 1 -- 172.21.15.115:0/3571971776 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc00b6e0 con 0x7f2a00153ec0 2023-07-27T14:36:11.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a05599700 1 -- 172.21.15.115:0/3571971776 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00ba60 con 0x7f2a00153ec0 2023-07-27T14:36:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a087ff700 1 -- 172.21.15.115:0/3571971776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a00153ec0 msgr2=0x7f2a000a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.807+0000 7f2a087ff700 1 --2- 172.21.15.115:0/3571971776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a00153ec0 0x7f2a000a9b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f29fc006fd0 tx=0x7f29fc0090f0).stop 2023-07-27T14:36:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.808+0000 7f2a087ff700 1 -- 172.21.15.115:0/3571971776 shutdown_connections 2023-07-27T14:36:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.808+0000 7f2a087ff700 1 --2- 172.21.15.115:0/3571971776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a00153ec0 0x7f2a000a9b60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.808+0000 7f2a087ff700 1 --2- 172.21.15.115:0/3571971776 >> v2:172.21.15.159:3300/0 conn(0x7f2a000aa050 0x7f2a000640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.808+0000 7f2a087ff700 1 -- 172.21.15.115:0/3571971776 >> 172.21.15.115:0/3571971776 conn(0x7f2a000cb610 msgr2=0x7f2a000c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.808+0000 7f2a087ff700 1 -- 172.21.15.115:0/3571971776 shutdown_connections 2023-07-27T14:36:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.808+0000 7f2a087ff700 1 -- 172.21.15.115:0/3571971776 wait complete. 2023-07-27T14:36:11.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.809+0000 7f2a087ff700 1 Processor -- start 2023-07-27T14:36:11.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.809+0000 7f2a087ff700 1 -- start start 2023-07-27T14:36:11.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.810+0000 7f2a087ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a000aa050 0x7f2a0014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.810+0000 7f2a087ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a000aaa40 0x7f2a000c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.810+0000 7f2a087ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a00153ec0 0x7f2a0014e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.810+0000 7f2a087ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000c2bb0 con 0x7f2a00153ec0 2023-07-27T14:36:11.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.810+0000 7f2a087ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000c3460 con 0x7f2a000aa050 2023-07-27T14:36:11.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.810+0000 7f2a087ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000c25f0 con 0x7f2a000aaa40 2023-07-27T14:36:11.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.810+0000 7f2a06d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a00153ec0 0x7f2a0014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a06d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a00153ec0 0x7f2a0014e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52222/0 (socket says 172.21.15.115:52222) 2023-07-27T14:36:11.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a06d9c700 1 -- 172.21.15.115:0/878812785 learned_addr learned my addr 172.21.15.115:0/878812785 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:11.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a05d9a700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a000aaa40 0x7f2a000c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a0659b700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a000aa050 0x7f2a0014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a06d9c700 1 -- 172.21.15.115:0/878812785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a000aaa40 msgr2=0x7f2a000c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a06d9c700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a000aaa40 0x7f2a000c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a06d9c700 1 -- 172.21.15.115:0/878812785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a000aa050 msgr2=0x7f2a0014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:11.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a06d9c700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a000aa050 0x7f2a0014ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:11.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a06d9c700 1 -- 172.21.15.115:0/878812785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00092a0 con 0x7f2a00153ec0 2023-07-27T14:36:11.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a06d9c700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a00153ec0 0x7f2a0014e210 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f29f800c810 tx=0x7f29f8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f29f67fc700 1 -- 172.21.15.115:0/878812785 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8005c70 con 0x7f2a00153ec0 2023-07-27T14:36:11.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f29f67fc700 1 -- 172.21.15.115:0/878812785 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8005dd0 con 0x7f2a00153ec0 2023-07-27T14:36:11.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.811+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc009370 con 0x7f2a00153ec0 2023-07-27T14:36:11.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.812+0000 7f29f67fc700 1 -- 172.21.15.115:0/878812785 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8007340 con 0x7f2a00153ec0 2023-07-27T14:36:11.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.812+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a000c30f0 con 0x7f2a00153ec0 2023-07-27T14:36:11.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.813+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a000c35d0 con 0x7f2a00153ec0 2023-07-27T14:36:11.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.814+0000 7f29f67fc700 1 -- 172.21.15.115:0/878812785 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f29f8010030 con 0x7f2a00153ec0 2023-07-27T14:36:11.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.814+0000 7f29f67fc700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f29e405f850 0x7f29e4061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:11.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.814+0000 7f29f67fc700 1 -- 172.21.15.115:0/878812785 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f29f807a5a0 con 0x7f2a00153ec0 2023-07-27T14:36:11.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.815+0000 7f2a0659b700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f29e405f850 0x7f29e4061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:11.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.815+0000 7f2a0659b700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f29e405f850 0x7f29e4061d10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f29fc009130 tx=0x7f29fc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:11.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.819+0000 7f29f67fc700 1 -- 172.21.15.115:0/878812785 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29f804b2d0 con 0x7f2a00153ec0 2023-07-27T14:36:12.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.992+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a000aa4d0 con 0x7f2a00153ec0 2023-07-27T14:36:12.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.993+0000 7f29f67fc700 1 -- 172.21.15.115:0/878812785 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+17251 (secure 0 0 0) 0x7f2a000aa4d0 con 0x7f2a00153ec0 2023-07-27T14:36:12.040 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:12.040 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":146,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:36:11.656996+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:34:59.767019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-27T14:35:00.338085+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.33","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":20,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:36:12.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f29e405f850 msgr2=0x7f29e4061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f29e405f850 0x7f29e4061d10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f29fc009130 tx=0x7f29fc017000).stop 2023-07-27T14:36:12.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a00153ec0 msgr2=0x7f2a0014e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a00153ec0 0x7f2a0014e210 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f29f800c810 tx=0x7f29f8007d70).stop 2023-07-27T14:36:12.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 shutdown_connections 2023-07-27T14:36:12.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f29e405f850 0x7f29e4061d10 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a00153ec0 0x7f2a0014e210 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a000aa050 0x7f2a0014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 --2- 172.21.15.115:0/878812785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a000aaa40 0x7f2a000c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 >> 172.21.15.115:0/878812785 conn(0x7f2a000cb610 msgr2=0x7f2a000640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:12.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 shutdown_connections 2023-07-27T14:36:12.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:11.995+0000 7f2a087ff700 1 -- 172.21.15.115:0/878812785 wait complete. 2023-07-27T14:36:12.060 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:36:12.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:36:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.204+0000 7f981b7ff700 1 Processor -- start 2023-07-27T14:36:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.204+0000 7f981b7ff700 1 -- start start 2023-07-27T14:36:12.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.205+0000 7f981b7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f98140aaa40 0x7f98140640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.205+0000 7f981b7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f98141542a0 0x7f98140645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.205+0000 7f981b7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98140aa4d0 con 0x7f9814153ec0 2023-07-27T14:36:12.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.205+0000 7f981b7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9814064ad0 con 0x7f98141542a0 2023-07-27T14:36:12.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.205+0000 7f981b7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140c05c0 con 0x7f98140aaa40 2023-07-27T14:36:12.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9819d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f98141542a0 0x7f98140645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9819d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f98141542a0 0x7f98140645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52232/0 (socket says 172.21.15.115:52232) 2023-07-27T14:36:12.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9819d9c700 1 -- 172.21.15.115:0/3778370106 learned_addr learned my addr 172.21.15.115:0/3778370106 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:12.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9818d9a700 1 --2- 172.21.15.115:0/3778370106 >> v2:172.21.15.159:3300/0 conn(0x7f98140aaa40 0x7f98140640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9819d9c700 1 -- 172.21.15.115:0/3778370106 >> v2:172.21.15.159:3300/0 conn(0x7f98140aaa40 msgr2=0x7f98140640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:12.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9819d9c700 1 --2- 172.21.15.115:0/3778370106 >> v2:172.21.15.159:3300/0 conn(0x7f98140aaa40 0x7f98140640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9819d9c700 1 -- 172.21.15.115:0/3778370106 >> v1:172.21.15.159:6789/0 conn(0x7f9814153ec0 legacy=0x7f98140a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9819d9c700 1 -- 172.21.15.115:0/3778370106 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140c1a60 con 0x7f98141542a0 2023-07-27T14:36:12.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f9819d9c700 1 --2- 172.21.15.115:0/3778370106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f98140645e0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f981406c0d0 tx=0x7f980c009840).ready entity=mon.0 client_cookie=384543f3b5cdc78 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:12.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f980bfff700 1 -- 172.21.15.115:0/3778370106 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c00e070 con 0x7f98141542a0 2023-07-27T14:36:12.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f980bfff700 1 -- 172.21.15.115:0/3778370106 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c00ba50 con 0x7f98141542a0 2023-07-27T14:36:12.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.206+0000 7f980bfff700 1 -- 172.21.15.115:0/3778370106 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c00bdd0 con 0x7f98141542a0 2023-07-27T14:36:12.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.207+0000 7f981b7ff700 1 -- 172.21.15.115:0/3778370106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 msgr2=0x7f98140645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.207+0000 7f981b7ff700 1 --2- 172.21.15.115:0/3778370106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f98140645e0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f981406c0d0 tx=0x7f980c009840).stop 2023-07-27T14:36:12.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.207+0000 7f981b7ff700 1 -- 172.21.15.115:0/3778370106 shutdown_connections 2023-07-27T14:36:12.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.207+0000 7f981b7ff700 1 --2- 172.21.15.115:0/3778370106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f98140645e0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.207+0000 7f981b7ff700 1 --2- 172.21.15.115:0/3778370106 >> v2:172.21.15.159:3300/0 conn(0x7f98140aaa40 0x7f98140640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.207+0000 7f981b7ff700 1 -- 172.21.15.115:0/3778370106 >> 172.21.15.115:0/3778370106 conn(0x7f98140cb610 msgr2=0x7f98140c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:12.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.207+0000 7f981b7ff700 1 -- 172.21.15.115:0/3778370106 shutdown_connections 2023-07-27T14:36:12.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.207+0000 7f981b7ff700 1 -- 172.21.15.115:0/3778370106 wait complete. 2023-07-27T14:36:12.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.209+0000 7f981b7ff700 1 Processor -- start 2023-07-27T14:36:12.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.209+0000 7f981b7ff700 1 -- start start 2023-07-27T14:36:12.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f981b7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98140aaa40 0x7f98141524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f981b7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9814153ec0 0x7f9814150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f981b7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f9814062ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f981b7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140b0070 con 0x7f98141542a0 2023-07-27T14:36:12.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f981b7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140c3790 con 0x7f98140aaa40 2023-07-27T14:36:12.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f981b7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140c2130 con 0x7f9814153ec0 2023-07-27T14:36:12.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9819d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f9814062ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9819d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f9814062ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52234/0 (socket says 172.21.15.115:52234) 2023-07-27T14:36:12.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9819d9c700 1 -- 172.21.15.115:0/534611719 learned_addr learned my addr 172.21.15.115:0/534611719 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:12.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f981959b700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98140aaa40 0x7f98141524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9818d9a700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9814153ec0 0x7f9814150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9819d9c700 1 -- 172.21.15.115:0/534611719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9814153ec0 msgr2=0x7f9814150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9819d9c700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9814153ec0 0x7f9814150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9819d9c700 1 -- 172.21.15.115:0/534611719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98140aaa40 msgr2=0x7f98141524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9819d9c700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98140aaa40 0x7f98141524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.210+0000 7f9819d9c700 1 -- 172.21.15.115:0/534611719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c009ae0 con 0x7f98141542a0 2023-07-27T14:36:12.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.211+0000 7f9819d9c700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f9814062ac0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f980c010000 tx=0x7f98140c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:12.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.211+0000 7f98097fa700 1 -- 172.21.15.115:0/534611719 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c00bdd0 con 0x7f98141542a0 2023-07-27T14:36:12.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.211+0000 7f98097fa700 1 -- 172.21.15.115:0/534611719 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c0092e0 con 0x7f98141542a0 2023-07-27T14:36:12.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.211+0000 7f98097fa700 1 -- 172.21.15.115:0/534611719 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c01c610 con 0x7f98141542a0 2023-07-27T14:36:12.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.211+0000 7f981b7ff700 1 -- 172.21.15.115:0/534611719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98140aece0 con 0x7f98141542a0 2023-07-27T14:36:12.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.211+0000 7f981b7ff700 1 -- 172.21.15.115:0/534611719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98140ae9c0 con 0x7f98141542a0 2023-07-27T14:36:12.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.212+0000 7f97feffd700 1 -- 172.21.15.115:0/534611719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec005120 con 0x7f98141542a0 2023-07-27T14:36:12.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.213+0000 7f98097fa700 1 -- 172.21.15.115:0/534611719 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f980c01ca00 con 0x7f98141542a0 2023-07-27T14:36:12.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.214+0000 7f98097fa700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f805f880 0x7f97f8061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.214+0000 7f98097fa700 1 -- 172.21.15.115:0/534611719 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f980c07c710 con 0x7f98141542a0 2023-07-27T14:36:12.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.214+0000 7f981959b700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f805f880 0x7f97f8061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.215+0000 7f981959b700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f805f880 0x7f97f8061d40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f9810003900 tx=0x7f9810007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:12.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.218+0000 7f98097fa700 1 -- 172.21.15.115:0/534611719 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f980c04d060 con 0x7f98141542a0 2023-07-27T14:36:12.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.427+0000 7f97feffd700 1 -- 172.21.15.115:0/534611719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97ec005d70 con 0x7f98141542a0 2023-07-27T14:36:12.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.427+0000 7f98097fa700 1 -- 172.21.15.115:0/534611719 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f980c050680 con 0x7f98141542a0 2023-07-27T14:36:12.474 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:12.475 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/231954123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":231954123},{"type":"v1","addr":"172.21.15.159:6834","nonce":231954123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7432,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3337360418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3337360418},{"type":"v1","addr":"172.21.15.159:6835","nonce":3337360418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2630769428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2630769428},{"type":"v1","addr":"172.21.15.115:6836","nonce":2630769428}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:35:01.359343+0000","modified":"2023-07-27T14:35:04.371738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2708675397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2708675397},{"type":"v1","addr":"172.21.15.115:6837","nonce":2708675397}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-07-27T14:36:12.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.429+0000 7f97feffd700 1 -- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f805f880 msgr2=0x7f97f8061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.429+0000 7f97feffd700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f805f880 0x7f97f8061d40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f9810003900 tx=0x7f9810007d40).stop 2023-07-27T14:36:12.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.429+0000 7f97feffd700 1 -- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 msgr2=0x7f9814062ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.429+0000 7f97feffd700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f9814062ac0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f980c010000 tx=0x7f98140c0530).stop 2023-07-27T14:36:12.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.429+0000 7f97feffd700 1 -- 172.21.15.115:0/534611719 shutdown_connections 2023-07-27T14:36:12.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.430+0000 7f97feffd700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97f805f880 0x7f97f8061d40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.430+0000 7f97feffd700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98141542a0 0x7f9814062ac0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.430+0000 7f97feffd700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98140aaa40 0x7f98141524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.430+0000 7f97feffd700 1 --2- 172.21.15.115:0/534611719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9814153ec0 0x7f9814150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.430+0000 7f97feffd700 1 -- 172.21.15.115:0/534611719 >> 172.21.15.115:0/534611719 conn(0x7f98140cb610 msgr2=0x7f98140ac470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:12.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.430+0000 7f97feffd700 1 -- 172.21.15.115:0/534611719 shutdown_connections 2023-07-27T14:36:12.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.430+0000 7f97feffd700 1 -- 172.21.15.115:0/534611719 wait complete. 2023-07-27T14:36:12.479 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 77 2023-07-27T14:36:12.494 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:36:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.635+0000 7fd2eabff700 1 Processor -- start 2023-07-27T14:36:12.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.635+0000 7fd2eabff700 1 -- start start 2023-07-27T14:36:12.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2eabff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e40aaa40 0x7fd2e40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2eabff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e40aa4d0 con 0x7fd2e41542a0 2023-07-27T14:36:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2eabff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e40c05c0 con 0x7fd2e4153ec0 2023-07-27T14:36:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2eabff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40aa270 con 0x7fd2e40aaa40 2023-07-27T14:36:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2e919c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd2e41542a0 0x7fd2e40c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:32924/0 (socket says 172.21.15.115:32924) 2023-07-27T14:36:12.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2e919c700 1 -- 172.21.15.115:0/745187729 learned_addr learned my addr 172.21.15.115:0/745187729 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:12.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2e3fff700 1 --2- 172.21.15.115:0/745187729 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e40aaa40 0x7fd2e40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2e37fe700 1 -- 172.21.15.115:0/745187729 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193468054 0 0) 0x7fd2dc001490 con 0x7fd2e41542a0 2023-07-27T14:36:12.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2e37fe700 1 -- 172.21.15.115:0/745187729 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d40033f0 con 0x7fd2e41542a0 2023-07-27T14:36:12.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.637+0000 7fd2e37fe700 1 -- 172.21.15.115:0/745187729 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362702454 0 0) 0x7fd2e40c05c0 con 0x7fd2e4153ec0 2023-07-27T14:36:12.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2e37fe700 1 -- 172.21.15.115:0/745187729 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2dc001490 con 0x7fd2e4153ec0 2023-07-27T14:36:12.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2e3fff700 1 -- 172.21.15.115:0/745187729 >> v1:172.21.15.159:6789/0 conn(0x7fd2e4153ec0 legacy=0x7fd2e40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2e3fff700 1 -- 172.21.15.115:0/745187729 >> v1:172.21.15.115:6789/0 conn(0x7fd2e41542a0 legacy=0x7fd2e40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2e3fff700 1 -- 172.21.15.115:0/745187729 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e40bfc90 con 0x7fd2e40aaa40 2023-07-27T14:36:12.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2e3fff700 1 --2- 172.21.15.115:0/745187729 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e40aaa40 0x7fd2e40640f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd2d0009790 tx=0x7fd2d0009060).ready entity=mon.2 client_cookie=6c711f3dbbb137c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:12.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2e37fe700 1 -- 172.21.15.115:0/745187729 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000f510 con 0x7fd2e40aaa40 2023-07-27T14:36:12.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2e37fe700 1 -- 172.21.15.115:0/745187729 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000f670 con 0x7fd2e40aaa40 2023-07-27T14:36:12.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2e37fe700 1 -- 172.21.15.115:0/745187729 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000f9f0 con 0x7fd2e40aaa40 2023-07-27T14:36:12.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2eabff700 1 -- 172.21.15.115:0/745187729 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e40aaa40 msgr2=0x7fd2e40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.638+0000 7fd2eabff700 1 --2- 172.21.15.115:0/745187729 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e40aaa40 0x7fd2e40640f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd2d0009790 tx=0x7fd2d0009060).stop 2023-07-27T14:36:12.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.639+0000 7fd2eabff700 1 -- 172.21.15.115:0/745187729 shutdown_connections 2023-07-27T14:36:12.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.639+0000 7fd2eabff700 1 --2- 172.21.15.115:0/745187729 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e40aaa40 0x7fd2e40640f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.639+0000 7fd2eabff700 1 -- 172.21.15.115:0/745187729 >> 172.21.15.115:0/745187729 conn(0x7fd2e40cb610 msgr2=0x7fd2e40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:12.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.639+0000 7fd2eabff700 1 -- 172.21.15.115:0/745187729 shutdown_connections 2023-07-27T14:36:12.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.639+0000 7fd2eabff700 1 -- 172.21.15.115:0/745187729 wait complete. 2023-07-27T14:36:12.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.640+0000 7fd2eabff700 1 Processor -- start 2023-07-27T14:36:12.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.640+0000 7fd2eabff700 1 -- start start 2023-07-27T14:36:12.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2eabff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2e40aaa40 0x7fd2e4140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2eabff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e4153ec0 0x7fd2e4154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2eabff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2e41542a0 0x7fd2e4154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2eabff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e414ea90 con 0x7fd2e40aaa40 2023-07-27T14:36:12.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2eabff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4155be0 con 0x7fd2e41542a0 2023-07-27T14:36:12.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2eabff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4155ec0 con 0x7fd2e4153ec0 2023-07-27T14:36:12.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2e899b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2e40aaa40 0x7fd2e4140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2e899b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2e40aaa40 0x7fd2e4140790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52240/0 (socket says 172.21.15.115:52240) 2023-07-27T14:36:12.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.641+0000 7fd2e899b700 1 -- 172.21.15.115:0/1573569238 learned_addr learned my addr 172.21.15.115:0/1573569238 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:12.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e899b700 1 -- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e4153ec0 msgr2=0x7fd2e4154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e3fff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e4153ec0 0x7fd2e4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e919c700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2e41542a0 0x7fd2e4154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e899b700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e4153ec0 0x7fd2e4154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e899b700 1 -- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2e41542a0 msgr2=0x7fd2e4154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e899b700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2e41542a0 0x7fd2e4154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e899b700 1 -- 172.21.15.115:0/1573569238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00092a0 con 0x7fd2e40aaa40 2023-07-27T14:36:12.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e3fff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e4153ec0 0x7fd2e4154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:12.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e919c700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2e41542a0 0x7fd2e4154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:12.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e899b700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2e40aaa40 0x7fd2e4140790 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fd2d800c490 tx=0x7fd2d8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:12.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e0ff9700 1 -- 172.21.15.115:0/1573569238 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d800f470 con 0x7fd2e40aaa40 2023-07-27T14:36:12.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e0ff9700 1 -- 172.21.15.115:0/1573569238 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d800f5d0 con 0x7fd2e40aaa40 2023-07-27T14:36:12.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2e0ff9700 1 -- 172.21.15.115:0/1573569238 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d800f990 con 0x7fd2e40aaa40 2023-07-27T14:36:12.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e414e440 con 0x7fd2e40aaa40 2023-07-27T14:36:12.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.642+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e414db90 con 0x7fd2e40aaa40 2023-07-27T14:36:12.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.643+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e406c470 con 0x7fd2e40aaa40 2023-07-27T14:36:12.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.644+0000 7fd2e0ff9700 1 -- 172.21.15.115:0/1573569238 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fd2d8019030 con 0x7fd2e40aaa40 2023-07-27T14:36:12.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.645+0000 7fd2e0ff9700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2c805f850 0x7fd2c8061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:12.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.645+0000 7fd2e0ff9700 1 -- 172.21.15.115:0/1573569238 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd2d8079dd0 con 0x7fd2e40aaa40 2023-07-27T14:36:12.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.645+0000 7fd2e3fff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2c805f850 0x7fd2c8061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:12.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.646+0000 7fd2e3fff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2c805f850 0x7fd2c8061d10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fd2e40aae20 tx=0x7fd2d0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:12.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.649+0000 7fd2e0ff9700 1 -- 172.21.15.115:0/1573569238 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd2d80488f0 con 0x7fd2e40aaa40 2023-07-27T14:36:12.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.858+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2e40bff70 con 0x7fd2e40aaa40 2023-07-27T14:36:12.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.859+0000 7fd2e0ff9700 1 -- 172.21.15.115:0/1573569238 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fd2d804abb0 con 0x7fd2e40aaa40 2023-07-27T14:36:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:12.906 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/231954123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":231954123},{"type":"v1","addr":"172.21.15.159:6834","nonce":231954123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7432,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3337360418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3337360418},{"type":"v1","addr":"172.21.15.159:6835","nonce":3337360418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2630769428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2630769428},{"type":"v1","addr":"172.21.15.115:6836","nonce":2630769428}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:35:01.359343+0000","modified":"2023-07-27T14:35:04.371738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6837/2708675397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2708675397},{"type":"v1","addr":"172.21.15.115:6837","nonce":2708675397}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-07-27T14:36:12.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2c805f850 msgr2=0x7fd2c8061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2c805f850 0x7fd2c8061d10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fd2e40aae20 tx=0x7fd2d0017000).stop 2023-07-27T14:36:12.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2e40aaa40 msgr2=0x7fd2e4140790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:12.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2e40aaa40 0x7fd2e4140790 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fd2d800c490 tx=0x7fd2d8007c40).stop 2023-07-27T14:36:12.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 shutdown_connections 2023-07-27T14:36:12.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd2c805f850 0x7fd2c8061d10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2e41542a0 0x7fd2e4154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2e40aaa40 0x7fd2e4140790 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 --2- 172.21.15.115:0/1573569238 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd2e4153ec0 0x7fd2e4154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:12.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 >> 172.21.15.115:0/1573569238 conn(0x7fd2e40cb610 msgr2=0x7fd2e40b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:12.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 shutdown_connections 2023-07-27T14:36:12.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:12.861+0000 7fd2eabff700 1 -- 172.21.15.115:0/1573569238 wait complete. 2023-07-27T14:36:12.910 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 77 2023-07-27T14:36:12.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:36:13.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.067+0000 7f6c0f3ff700 1 Processor -- start 2023-07-27T14:36:13.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.067+0000 7f6c0f3ff700 1 -- start start 2023-07-27T14:36:13.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.069+0000 7f6c0f3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c080aaa40 0x7f6c080640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.069+0000 7f6c0f3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6c081542a0 0x7f6c080645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.069+0000 7f6c0f3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c080aa4d0 con 0x7f6c08153ec0 2023-07-27T14:36:13.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.069+0000 7f6c0f3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c08064ad0 con 0x7f6c081542a0 2023-07-27T14:36:13.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.069+0000 7f6c0f3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080c05c0 con 0x7f6c080aaa40 2023-07-27T14:36:13.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.069+0000 7f6c0d19b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f6c08153ec0 0x7f6c080a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:39128/0 (socket says 172.21.15.115:39128) 2023-07-27T14:36:13.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.069+0000 7f6c0d19b700 1 -- 172.21.15.115:0/2628851254 learned_addr learned my addr 172.21.15.115:0/2628851254 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:13.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.069+0000 7f6c0c99a700 1 --2- 172.21.15.115:0/2628851254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c080aaa40 0x7f6c080640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.070+0000 7f6c0d99c700 1 --2- 172.21.15.115:0/2628851254 >> v2:172.21.15.159:3300/0 conn(0x7f6c081542a0 0x7f6c080645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.070+0000 7f6bfffff700 1 -- 172.21.15.115:0/2628851254 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554576901 0 0) 0x7f6c04001110 con 0x7f6c08153ec0 2023-07-27T14:36:13.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.070+0000 7f6bfffff700 1 -- 172.21.15.115:0/2628851254 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf40033f0 con 0x7f6c08153ec0 2023-07-27T14:36:13.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.070+0000 7f6c0c99a700 1 -- 172.21.15.115:0/2628851254 >> v2:172.21.15.159:3300/0 conn(0x7f6c081542a0 msgr2=0x7f6c080645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:13.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.070+0000 7f6c0c99a700 1 --2- 172.21.15.115:0/2628851254 >> v2:172.21.15.159:3300/0 conn(0x7f6c081542a0 0x7f6c080645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.070+0000 7f6c0c99a700 1 -- 172.21.15.115:0/2628851254 >> v1:172.21.15.159:6789/0 conn(0x7f6c08153ec0 legacy=0x7f6c080a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.070+0000 7f6c0c99a700 1 -- 172.21.15.115:0/2628851254 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c080c1a60 con 0x7f6c080aaa40 2023-07-27T14:36:13.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.070+0000 7f6c0c99a700 1 --2- 172.21.15.115:0/2628851254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c080aaa40 0x7f6c080640f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6bf8009760 tx=0x7f6bf8009060).ready entity=mon.2 client_cookie=c166ec5512b32671 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:13.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6bfffff700 1 -- 172.21.15.115:0/2628851254 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf800d4a0 con 0x7f6c080aaa40 2023-07-27T14:36:13.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6bfffff700 1 -- 172.21.15.115:0/2628851254 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf800d600 con 0x7f6c080aaa40 2023-07-27T14:36:13.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6bfffff700 1 -- 172.21.15.115:0/2628851254 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf800d980 con 0x7f6c080aaa40 2023-07-27T14:36:13.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/2628851254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c080aaa40 msgr2=0x7f6c080640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/2628851254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c080aaa40 0x7f6c080640f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6bf8009760 tx=0x7f6bf8009060).stop 2023-07-27T14:36:13.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/2628851254 shutdown_connections 2023-07-27T14:36:13.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/2628851254 >> v2:172.21.15.159:3300/0 conn(0x7f6c081542a0 0x7f6c080645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/2628851254 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c080aaa40 0x7f6c080640f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/2628851254 >> 172.21.15.115:0/2628851254 conn(0x7f6c080cb610 msgr2=0x7f6c080c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:13.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/2628851254 shutdown_connections 2023-07-27T14:36:13.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.071+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/2628851254 wait complete. 2023-07-27T14:36:13.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.073+0000 7f6c0f3ff700 1 Processor -- start 2023-07-27T14:36:13.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.073+0000 7f6c0f3ff700 1 -- start start 2023-07-27T14:36:13.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0f3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080aaa40 0x7f6c0814ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0f3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c08153ec0 0x7f6c08152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0f3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c081542a0 0x7f6c081511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0f3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08150d50 con 0x7f6c08153ec0 2023-07-27T14:36:13.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0f3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0814ef70 con 0x7f6c080aaa40 2023-07-27T14:36:13.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0f3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08150140 con 0x7f6c081542a0 2023-07-27T14:36:13.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0c99a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c08153ec0 0x7f6c08152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0c99a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c08153ec0 0x7f6c08152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52248/0 (socket says 172.21.15.115:52248) 2023-07-27T14:36:13.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0c99a700 1 -- 172.21.15.115:0/484115641 learned_addr learned my addr 172.21.15.115:0/484115641 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:13.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0d99c700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c081542a0 0x7f6c081511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0d19b700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080aaa40 0x7f6c0814ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0c99a700 1 -- 172.21.15.115:0/484115641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c081542a0 msgr2=0x7f6c081511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0c99a700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c081542a0 0x7f6c081511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0c99a700 1 -- 172.21.15.115:0/484115641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080aaa40 msgr2=0x7f6c0814ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0c99a700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080aaa40 0x7f6c0814ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.074+0000 7f6c0c99a700 1 -- 172.21.15.115:0/484115641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf80092a0 con 0x7f6c08153ec0 2023-07-27T14:36:13.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.075+0000 7f6c0c99a700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c08153ec0 0x7f6c08152d50 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f6c080c0700 tx=0x7f6bf8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:13.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.075+0000 7f6bfd7fa700 1 -- 172.21.15.115:0/484115641 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf800dd30 con 0x7f6c08153ec0 2023-07-27T14:36:13.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.075+0000 7f6bfd7fa700 1 -- 172.21.15.115:0/484115641 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf800de90 con 0x7f6c08153ec0 2023-07-27T14:36:13.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.075+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c08150420 con 0x7f6c08153ec0 2023-07-27T14:36:13.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.075+0000 7f6bfd7fa700 1 -- 172.21.15.115:0/484115641 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf800d980 con 0x7f6c08153ec0 2023-07-27T14:36:13.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.075+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c081509e0 con 0x7f6c08153ec0 2023-07-27T14:36:13.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.076+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0806c470 con 0x7f6c08153ec0 2023-07-27T14:36:13.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.077+0000 7f6bfd7fa700 1 -- 172.21.15.115:0/484115641 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f6bf800f070 con 0x7f6c08153ec0 2023-07-27T14:36:13.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.078+0000 7f6bfd7fa700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bec05f880 0x7f6bec061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.078+0000 7f6bfd7fa700 1 -- 172.21.15.115:0/484115641 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f6bf807c2b0 con 0x7f6c08153ec0 2023-07-27T14:36:13.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.078+0000 7f6c0d19b700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bec05f880 0x7f6bec061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.079+0000 7f6c0d19b700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bec05f880 0x7f6bec061d40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f6c080afd40 tx=0x7f6c04007a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:13.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.082+0000 7f6bfd7fa700 1 -- 172.21.15.115:0/484115641 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bf804cc00 con 0x7f6c08153ec0 2023-07-27T14:36:13.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.252+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c080c8230 con 0x7f6c08153ec0 2023-07-27T14:36:13.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.253+0000 7f6bfd7fa700 1 -- 172.21.15.115:0/484115641 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+17251 (secure 0 0 0) 0x7f6bf8050220 con 0x7f6c08153ec0 2023-07-27T14:36:13.301 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:13.301 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":146,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:36:11.656996+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:34:59.767019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-27T14:35:00.338085+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.33","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":20,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:36:13.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bec05f880 msgr2=0x7f6bec061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bec05f880 0x7f6bec061d40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f6c080afd40 tx=0x7f6c04007a70).stop 2023-07-27T14:36:13.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c08153ec0 msgr2=0x7f6c08152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c08153ec0 0x7f6c08152d50 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f6c080c0700 tx=0x7f6bf8016000).stop 2023-07-27T14:36:13.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 shutdown_connections 2023-07-27T14:36:13.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bec05f880 0x7f6bec061d40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c081542a0 0x7f6c081511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c080aaa40 0x7f6c0814ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 --2- 172.21.15.115:0/484115641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c08153ec0 0x7f6c08152d50 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 >> 172.21.15.115:0/484115641 conn(0x7f6c080cb610 msgr2=0x7f6c080c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:13.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 shutdown_connections 2023-07-27T14:36:13.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.255+0000 7f6c0f3ff700 1 -- 172.21.15.115:0/484115641 wait complete. 2023-07-27T14:36:13.320 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:36:13.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.466+0000 7fedbebff700 1 Processor -- start 2023-07-27T14:36:13.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.466+0000 7fedbebff700 1 -- start start 2023-07-27T14:36:13.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.467+0000 7fedbebff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fedb8153ec0 0x7fedb80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.467+0000 7fedbebff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fedb80aa050 0x7fedb80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.467+0000 7fedbebff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80aa4d0 con 0x7fedb80aaa40 2023-07-27T14:36:13.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.467+0000 7fedbebff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80c05c0 con 0x7fedb80aa050 2023-07-27T14:36:13.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.467+0000 7fedbebff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80c1a60 con 0x7fedb8153ec0 2023-07-27T14:36:13.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.467+0000 7fedb7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fedb80aa050 0x7fedb80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.467+0000 7fedb7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fedb80aa050 0x7fedb80640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52262/0 (socket says 172.21.15.115:52262) 2023-07-27T14:36:13.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.467+0000 7fedb7fff700 1 -- 172.21.15.115:0/1717074903 learned_addr learned my addr 172.21.15.115:0/1717074903 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:13.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedbc99b700 1 --2- 172.21.15.115:0/1717074903 >> v2:172.21.15.159:3300/0 conn(0x7fedb8153ec0 0x7fedb80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedb7fff700 1 -- 172.21.15.115:0/1717074903 >> v2:172.21.15.159:3300/0 conn(0x7fedb8153ec0 msgr2=0x7fedb80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:13.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedb7fff700 1 --2- 172.21.15.115:0/1717074903 >> v2:172.21.15.159:3300/0 conn(0x7fedb8153ec0 0x7fedb80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedb7fff700 1 -- 172.21.15.115:0/1717074903 >> v1:172.21.15.115:6789/0 conn(0x7fedb80aaa40 legacy=0x7fedb8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedb7fff700 1 -- 172.21.15.115:0/1717074903 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80bfc90 con 0x7fedb80aa050 2023-07-27T14:36:13.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedb7fff700 1 --2- 172.21.15.115:0/1717074903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80640f0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fedb8083e30 tx=0x7feda40090f0).ready entity=mon.0 client_cookie=cce7ab5c47aaff43 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:13.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedb77fe700 1 -- 172.21.15.115:0/1717074903 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda400b600 con 0x7fedb80aa050 2023-07-27T14:36:13.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedb77fe700 1 -- 172.21.15.115:0/1717074903 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda400b760 con 0x7fedb80aa050 2023-07-27T14:36:13.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.468+0000 7fedb77fe700 1 -- 172.21.15.115:0/1717074903 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda400bae0 con 0x7fedb80aa050 2023-07-27T14:36:13.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.469+0000 7fedbebff700 1 -- 172.21.15.115:0/1717074903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 msgr2=0x7fedb80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.469+0000 7fedbebff700 1 --2- 172.21.15.115:0/1717074903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80640f0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fedb8083e30 tx=0x7feda40090f0).stop 2023-07-27T14:36:13.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.469+0000 7fedbebff700 1 -- 172.21.15.115:0/1717074903 shutdown_connections 2023-07-27T14:36:13.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.469+0000 7fedbebff700 1 --2- 172.21.15.115:0/1717074903 >> v2:172.21.15.159:3300/0 conn(0x7fedb8153ec0 0x7fedb80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.469+0000 7fedbebff700 1 --2- 172.21.15.115:0/1717074903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80640f0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.469+0000 7fedbebff700 1 -- 172.21.15.115:0/1717074903 >> 172.21.15.115:0/1717074903 conn(0x7fedb80cb610 msgr2=0x7fedb80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:13.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.469+0000 7fedbebff700 1 -- 172.21.15.115:0/1717074903 shutdown_connections 2023-07-27T14:36:13.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.469+0000 7fedbebff700 1 -- 172.21.15.115:0/1717074903 wait complete. 2023-07-27T14:36:13.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.470+0000 7fedbebff700 1 Processor -- start 2023-07-27T14:36:13.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.471+0000 7fedbebff700 1 -- start start 2023-07-27T14:36:13.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.471+0000 7fedbebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.471+0000 7fedbebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb80aaa40 0x7fedb814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.471+0000 7fedbebff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb8153ec0 0x7fedb8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.471+0000 7fedbebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c4060 con 0x7fedb80aa050 2023-07-27T14:36:13.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.471+0000 7fedbebff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c3450 con 0x7fedb8153ec0 2023-07-27T14:36:13.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.471+0000 7fedbebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c3730 con 0x7fedb80aaa40 2023-07-27T14:36:13.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52266/0 (socket says 172.21.15.115:52266) 2023-07-27T14:36:13.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 -- 172.21.15.115:0/2801338769 learned_addr learned my addr 172.21.15.115:0/2801338769 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:13.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedb7fff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb80aaa40 0x7fedb814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbd19c700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb8153ec0 0x7fedb8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 -- 172.21.15.115:0/2801338769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb80aaa40 msgr2=0x7fedb814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb80aaa40 0x7fedb814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 -- 172.21.15.115:0/2801338769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb8153ec0 msgr2=0x7fedb8152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb8153ec0 0x7fedb8152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 -- 172.21.15.115:0/2801338769 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda4009370 con 0x7fedb80aa050 2023-07-27T14:36:13.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.472+0000 7fedbc99b700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80c44f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7fedac00d890 tx=0x7fedac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:13.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.473+0000 7fedb4ff9700 1 -- 172.21.15.115:0/2801338769 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac011590 con 0x7fedb80aa050 2023-07-27T14:36:13.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.473+0000 7fedb4ff9700 1 -- 172.21.15.115:0/2801338769 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0116f0 con 0x7fedb80aa050 2023-07-27T14:36:13.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.473+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb80c3a10 con 0x7fedb80aa050 2023-07-27T14:36:13.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.473+0000 7fedb4ff9700 1 -- 172.21.15.115:0/2801338769 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac011a70 con 0x7fedb80aa050 2023-07-27T14:36:13.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.473+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80c49e0 con 0x7fedb80aa050 2023-07-27T14:36:13.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.474+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb806c470 con 0x7fedb80aa050 2023-07-27T14:36:13.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.475+0000 7fedb4ff9700 1 -- 172.21.15.115:0/2801338769 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fedac012420 con 0x7fedb80aa050 2023-07-27T14:36:13.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.476+0000 7fedb4ff9700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed9c05f880 0x7fed9c061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.476+0000 7fedb4ff9700 1 -- 172.21.15.115:0/2801338769 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fedac07a690 con 0x7fedb80aa050 2023-07-27T14:36:13.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.476+0000 7fedb7fff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed9c05f880 0x7fed9c061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.476+0000 7fedb7fff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed9c05f880 0x7fed9c061d40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7feda4009fd0 tx=0x7feda4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:13.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.480+0000 7fedb4ff9700 1 -- 172.21.15.115:0/2801338769 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fedac04b090 con 0x7fedb80aa050 2023-07-27T14:36:13.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.696+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fedb80bff70 con 0x7fedb80aa050 2023-07-27T14:36:13.774 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:36:13.727+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:36:13.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.730+0000 7fedb4ff9700 1 -- 172.21.15.115:0/2801338769 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) v1 ==== 161+0+0 (secure 0 0 0) 0x7fedac011e60 con 0x7fedb80aa050 2023-07-27T14:36:13.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed9c05f880 msgr2=0x7fed9c061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed9c05f880 0x7fed9c061d40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7feda4009fd0 tx=0x7feda4017000).stop 2023-07-27T14:36:13.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 msgr2=0x7fedb80c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80c44f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7fedac00d890 tx=0x7fedac008040).stop 2023-07-27T14:36:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 shutdown_connections 2023-07-27T14:36:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fed9c05f880 0x7fed9c061d40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fedb8153ec0 0x7fedb8152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedb80aa050 0x7fedb80c44f0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 --2- 172.21.15.115:0/2801338769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fedb80aaa40 0x7fedb814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 >> 172.21.15.115:0/2801338769 conn(0x7fedb80cb610 msgr2=0x7fedb80acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 shutdown_connections 2023-07-27T14:36:13.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.733+0000 7fedbebff700 1 -- 172.21.15.115:0/2801338769 wait complete. 2023-07-27T14:36:13.782 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:36:13.798 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:36:13.838 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:36:13.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.943+0000 7f9e725ff700 1 Processor -- start 2023-07-27T14:36:13.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.943+0000 7f9e725ff700 1 -- start start 2023-07-27T14:36:13.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.944+0000 7f9e725ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e6c14ae00 0x7f9e6c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.944+0000 7f9e725ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c1553f0 con 0x7f9e6c063260 2023-07-27T14:36:13.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.944+0000 7f9e725ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c157a50 con 0x7f9e6c14b1e0 2023-07-27T14:36:13.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.944+0000 7f9e725ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c157d10 con 0x7f9e6c14ae00 2023-07-27T14:36:13.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.944+0000 7f9e70b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9e6c063260 0x7f9e6c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59362/0 (socket says 172.21.15.115:59362) 2023-07-27T14:36:13.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e70b9c700 1 -- 172.21.15.115:0/1480142012 learned_addr learned my addr 172.21.15.115:0/1480142012 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:13.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e6bfff700 1 --2- 172.21.15.115:0/1480142012 >> v2:172.21.15.115:3300/0 conn(0x7f9e6c14ae00 0x7f9e6c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e6affd700 1 -- 172.21.15.115:0/1480142012 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73538132 0 0) 0x7f9e6c1553f0 con 0x7f9e6c063260 2023-07-27T14:36:13.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e6affd700 1 -- 172.21.15.115:0/1480142012 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e540033f0 con 0x7f9e6c063260 2023-07-27T14:36:13.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e6bfff700 1 -- 172.21.15.115:0/1480142012 >> v1:172.21.15.159:6789/0 conn(0x7f9e6c14b1e0 legacy=0x7f9e6c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e6bfff700 1 -- 172.21.15.115:0/1480142012 >> v1:172.21.15.115:6789/0 conn(0x7f9e6c063260 legacy=0x7f9e6c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e6bfff700 1 -- 172.21.15.115:0/1480142012 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c157ff0 con 0x7f9e6c14ae00 2023-07-27T14:36:13.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e6bfff700 1 --2- 172.21.15.115:0/1480142012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c154f00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f9e5c009760 tx=0x7f9e5c009060).ready entity=mon.0 client_cookie=50fc675891dc54f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:13.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.945+0000 7f9e6affd700 1 -- 172.21.15.115:0/1480142012 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00f510 con 0x7f9e6c14ae00 2023-07-27T14:36:13.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e6affd700 1 -- 172.21.15.115:0/1480142012 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c00f670 con 0x7f9e6c14ae00 2023-07-27T14:36:13.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e6affd700 1 -- 172.21.15.115:0/1480142012 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00f9f0 con 0x7f9e6c14ae00 2023-07-27T14:36:13.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e725ff700 1 -- 172.21.15.115:0/1480142012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 msgr2=0x7f9e6c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e725ff700 1 --2- 172.21.15.115:0/1480142012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c154f00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f9e5c009760 tx=0x7f9e5c009060).stop 2023-07-27T14:36:13.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e725ff700 1 -- 172.21.15.115:0/1480142012 shutdown_connections 2023-07-27T14:36:13.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e725ff700 1 --2- 172.21.15.115:0/1480142012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c154f00 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e725ff700 1 -- 172.21.15.115:0/1480142012 >> 172.21.15.115:0/1480142012 conn(0x7f9e6c05e940 msgr2=0x7f9e6c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:13.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e725ff700 1 -- 172.21.15.115:0/1480142012 shutdown_connections 2023-07-27T14:36:13.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.946+0000 7f9e725ff700 1 -- 172.21.15.115:0/1480142012 wait complete. 2023-07-27T14:36:13.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.948+0000 7f9e725ff700 1 Processor -- start 2023-07-27T14:36:13.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.948+0000 7f9e725ff700 1 -- start start 2023-07-27T14:36:13.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e725ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c063260 0x7f9e6c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e725ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c14a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e725ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c14b1e0 0x7f9e6c0ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:13.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e725ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c167d20 con 0x7f9e6c14ae00 2023-07-27T14:36:13.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e725ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c14c490 con 0x7f9e6c063260 2023-07-27T14:36:13.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e725ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c1673f0 con 0x7f9e6c14b1e0 2023-07-27T14:36:13.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c14a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c14a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57326/0 (socket says 172.21.15.115:57326) 2023-07-27T14:36:13.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 -- 172.21.15.115:0/725919929 learned_addr learned my addr 172.21.15.115:0/725919929 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:13.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6bfff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c063260 0x7f9e6c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e70b9c700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c14b1e0 0x7f9e6c0ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:13.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 -- 172.21.15.115:0/725919929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c14b1e0 msgr2=0x7f9e6c0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c14b1e0 0x7f9e6c0ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 -- 172.21.15.115:0/725919929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c063260 msgr2=0x7f9e6c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:13.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c063260 0x7f9e6c14bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:13.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 -- 172.21.15.115:0/725919929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c0092a0 con 0x7f9e6c14ae00 2023-07-27T14:36:13.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.949+0000 7f9e6b7fe700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c14a6a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f9e6000c4c0 tx=0x7f9e60007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:13.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.950+0000 7f9e53fff700 1 -- 172.21.15.115:0/725919929 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60007020 con 0x7f9e6c14ae00 2023-07-27T14:36:14.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.950+0000 7f9e53fff700 1 -- 172.21.15.115:0/725919929 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e60007180 con 0x7f9e6c14ae00 2023-07-27T14:36:14.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.950+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c1676d0 con 0x7f9e6c14ae00 2023-07-27T14:36:14.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.950+0000 7f9e53fff700 1 -- 172.21.15.115:0/725919929 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60007520 con 0x7f9e6c14ae00 2023-07-27T14:36:14.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.950+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c14ab90 con 0x7f9e6c14ae00 2023-07-27T14:36:14.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.951+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c06c470 con 0x7f9e6c14ae00 2023-07-27T14:36:14.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.952+0000 7f9e53fff700 1 -- 172.21.15.115:0/725919929 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f9e60010070 con 0x7f9e6c14ae00 2023-07-27T14:36:14.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.952+0000 7f9e53fff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e5805f880 0x7f9e58061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:14.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.953+0000 7f9e53fff700 1 -- 172.21.15.115:0/725919929 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f9e60079f50 con 0x7f9e6c14ae00 2023-07-27T14:36:14.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.953+0000 7f9e6bfff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e5805f880 0x7f9e58061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:14.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.953+0000 7f9e6bfff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e5805f880 0x7f9e58061d40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f9e5c00f640 tx=0x7f9e5c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:14.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:13.956+0000 7f9e53fff700 1 -- 172.21.15.115:0/725919929 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e600478f0 con 0x7f9e6c14ae00 2023-07-27T14:36:14.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.165+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9e6c0ab260 con 0x7f9e6c14ae00 2023-07-27T14:36:14.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.739+0000 7f9e53fff700 1 -- 172.21.15.115:0/725919929 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9e6004a970 con 0x7f9e6c14ae00 2023-07-27T14:36:14.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.741+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e5805f880 msgr2=0x7f9e58061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.741+0000 7f9e725ff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e5805f880 0x7f9e58061d40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f9e5c00f640 tx=0x7f9e5c017000).stop 2023-07-27T14:36:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.741+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 msgr2=0x7f9e6c14a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.741+0000 7f9e725ff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c14a6a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f9e6000c4c0 tx=0x7f9e60007dd0).stop 2023-07-27T14:36:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.742+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 shutdown_connections 2023-07-27T14:36:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.742+0000 7f9e725ff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e5805f880 0x7f9e58061d40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:14.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.742+0000 7f9e725ff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c14b1e0 0x7f9e6c0ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:14.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.742+0000 7f9e725ff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c063260 0x7f9e6c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:14.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.742+0000 7f9e725ff700 1 --2- 172.21.15.115:0/725919929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e6c14ae00 0x7f9e6c14a6a0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:14.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.742+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 >> 172.21.15.115:0/725919929 conn(0x7f9e6c05e940 msgr2=0x7f9e6c0642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:14.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.742+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 shutdown_connections 2023-07-27T14:36:14.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.742+0000 7f9e725ff700 1 -- 172.21.15.115:0/725919929 wait complete. 2023-07-27T14:36:14.808 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:36:15.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.992+0000 7fb2aa1ff700 1 Processor -- start 2023-07-27T14:36:15.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.993+0000 7fb2aa1ff700 1 -- start start 2023-07-27T14:36:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.994+0000 7fb2aa1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb2a4153e00 0x7fb2a40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.994+0000 7fb2aa1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4065de0 0x7fb2a4062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.994+0000 7fb2aa1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a4064a80 con 0x7fb2a4064230 2023-07-27T14:36:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.994+0000 7fb2aa1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a4062320 con 0x7fb2a4153e00 2023-07-27T14:36:15.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.994+0000 7fb2aa1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4064d60 con 0x7fb2a4065de0 2023-07-27T14:36:15.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a3fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4065de0 0x7fb2a4062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:15.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a37fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb2a4153e00 0x7fb2a40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:15.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a2ffd700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fb2a4064230 0x7fb2a40656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:40582/0 (socket says 172.21.15.115:40582) 2023-07-27T14:36:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a3fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4065de0 0x7fb2a4062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:34020/0 (socket says 172.21.15.115:34020) 2023-07-27T14:36:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a2ffd700 1 -- 172.21.15.115:0/1877581674 learned_addr learned my addr 172.21.15.115:0/1877581674 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a37fe700 1 -- 172.21.15.115:0/1877581674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4065de0 msgr2=0x7fb2a4062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a37fe700 1 --2- 172.21.15.115:0/1877581674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4065de0 0x7fb2a4062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a37fe700 1 -- 172.21.15.115:0/1877581674 >> v1:172.21.15.159:6789/0 conn(0x7fb2a4064230 legacy=0x7fb2a40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.995+0000 7fb2a37fe700 1 -- 172.21.15.115:0/1877581674 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4065040 con 0x7fb2a4153e00 2023-07-27T14:36:15.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2a37fe700 1 --2- 172.21.15.115:0/1877581674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 0x7fb2a40c6b70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fb294009760 tx=0x7fb294009060).ready entity=mon.1 client_cookie=8b3a6f08a5b7cc50 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:15.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2a27fc700 1 -- 172.21.15.115:0/1877581674 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400f510 con 0x7fb2a4153e00 2023-07-27T14:36:15.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2a27fc700 1 -- 172.21.15.115:0/1877581674 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29400f670 con 0x7fb2a4153e00 2023-07-27T14:36:15.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2a27fc700 1 -- 172.21.15.115:0/1877581674 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400f9f0 con 0x7fb2a4153e00 2023-07-27T14:36:15.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/1877581674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 msgr2=0x7fb2a40c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:15.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/1877581674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 0x7fb2a40c6b70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fb294009760 tx=0x7fb294009060).stop 2023-07-27T14:36:15.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/1877581674 shutdown_connections 2023-07-27T14:36:15.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/1877581674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4065de0 0x7fb2a4062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/1877581674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 0x7fb2a40c6b70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/1877581674 >> 172.21.15.115:0/1877581674 conn(0x7fb2a40c7b90 msgr2=0x7fb2a40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:15.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/1877581674 shutdown_connections 2023-07-27T14:36:15.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.996+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/1877581674 wait complete. 2023-07-27T14:36:15.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.998+0000 7fb2aa1ff700 1 Processor -- start 2023-07-27T14:36:15.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.998+0000 7fb2aa1ff700 1 -- start start 2023-07-27T14:36:15.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2aa1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4064230 0x7fb2a414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:15.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2aa1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a4065de0 0x7fb2a4093800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:15.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2aa1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 0x7fb2a4152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:15.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2aa1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a414f6d0 con 0x7fb2a4065de0 2023-07-27T14:36:15.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2aa1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4093cf0 con 0x7fb2a4153e00 2023-07-27T14:36:15.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2aa1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a41656e0 con 0x7fb2a4064230 2023-07-27T14:36:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2a2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a4065de0 0x7fb2a4093800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2a2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a4065de0 0x7fb2a4093800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57328/0 (socket says 172.21.15.115:57328) 2023-07-27T14:36:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2a2ffd700 1 -- 172.21.15.115:0/3046423099 learned_addr learned my addr 172.21.15.115:0/3046423099 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2a3fff700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 0x7fb2a4152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:14.999+0000 7fb2a37fe700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4064230 0x7fb2a414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2a2ffd700 1 -- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4064230 msgr2=0x7fb2a414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2a2ffd700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4064230 0x7fb2a414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2a2ffd700 1 -- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 msgr2=0x7fb2a4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2a2ffd700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 0x7fb2a4152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2a2ffd700 1 -- 172.21.15.115:0/3046423099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940092a0 con 0x7fb2a4065de0 2023-07-27T14:36:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2a37fe700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4064230 0x7fb2a414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2a2ffd700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a4065de0 0x7fb2a4093800 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fb29800c490 tx=0x7fb298007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb28b7fe700 1 -- 172.21.15.115:0/3046423099 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2980072e0 con 0x7fb2a4065de0 2023-07-27T14:36:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb28b7fe700 1 -- 172.21.15.115:0/3046423099 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb298007440 con 0x7fb2a4065de0 2023-07-27T14:36:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a4092a40 con 0x7fb2a4065de0 2023-07-27T14:36:15.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb28b7fe700 1 -- 172.21.15.115:0/3046423099 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2980057a0 con 0x7fb2a4065de0 2023-07-27T14:36:15.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.000+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a4093000 con 0x7fb2a4065de0 2023-07-27T14:36:15.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.001+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a406c470 con 0x7fb2a4065de0 2023-07-27T14:36:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.002+0000 7fb28b7fe700 1 -- 172.21.15.115:0/3046423099 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fb29801a060 con 0x7fb2a4065de0 2023-07-27T14:36:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.003+0000 7fb28b7fe700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29005f880 0x7fb290061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.003+0000 7fb28b7fe700 1 -- 172.21.15.115:0/3046423099 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fb298079b40 con 0x7fb2a4065de0 2023-07-27T14:36:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.003+0000 7fb2a37fe700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29005f880 0x7fb290061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:15.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.004+0000 7fb2a37fe700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29005f880 0x7fb290061d40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fb294009fd0 tx=0x7fb294017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:15.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.007+0000 7fb28b7fe700 1 -- 172.21.15.115:0/3046423099 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb29804a940 con 0x7fb2a4065de0 2023-07-27T14:36:15.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.176+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb2a4065320 con 0x7fb2a4065de0 2023-07-27T14:36:15.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.744+0000 7fb28b7fe700 1 -- 172.21.15.115:0/3046423099 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v148) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb298018070 con 0x7fb2a4065de0 2023-07-27T14:36:15.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29005f880 msgr2=0x7fb290061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:15.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29005f880 0x7fb290061d40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fb294009fd0 tx=0x7fb294017000).stop 2023-07-27T14:36:15.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a4065de0 msgr2=0x7fb2a4093800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:15.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a4065de0 0x7fb2a4093800 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fb29800c490 tx=0x7fb298007df0).stop 2023-07-27T14:36:15.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 shutdown_connections 2023-07-27T14:36:15.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb29005f880 0x7fb290061d40 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2a4153e00 0x7fb2a4152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2a4064230 0x7fb2a414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 --2- 172.21.15.115:0/3046423099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2a4065de0 0x7fb2a4093800 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:15.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.749+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 >> 172.21.15.115:0/3046423099 conn(0x7fb2a40c7b90 msgr2=0x7fb2a40bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:15.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.750+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 shutdown_connections 2023-07-27T14:36:15.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.750+0000 7fb2aa1ff700 1 -- 172.21.15.115:0/3046423099 wait complete. 2023-07-27T14:36:15.801 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:36:15.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:36:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.964+0000 7f83e67ff700 1 Processor -- start 2023-07-27T14:36:16.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.964+0000 7f83e67ff700 1 -- start start 2023-07-27T14:36:16.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.965+0000 7f83e67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 0x7f83e0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.965+0000 7f83e67ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f83e014b1e0 0x7f83e00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.965+0000 7f83e67ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e01553f0 con 0x7f83e014ae00 2023-07-27T14:36:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.965+0000 7f83e67ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e0157a50 con 0x7f83e014b1e0 2023-07-27T14:36:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.965+0000 7f83e67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0157d10 con 0x7f83e0063260 2023-07-27T14:36:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83dffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f83e014ae00 0x7f83e0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59372/0 (socket says 172.21.15.115:59372) 2023-07-27T14:36:16.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83dffff700 1 -- 172.21.15.115:0/3663725511 learned_addr learned my addr 172.21.15.115:0/3663725511 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:16.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83df7fe700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 0x7f83e0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83e4d9c700 1 --2- 172.21.15.115:0/3663725511 >> v2:172.21.15.159:3300/0 conn(0x7f83e014b1e0 0x7f83e00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792046148 0 0) 0x7f83e01553f0 con 0x7f83e014ae00 2023-07-27T14:36:16.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c80033f0 con 0x7f83e014ae00 2023-07-27T14:36:16.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233970495 0 0) 0x7f83c80033f0 con 0x7f83e014ae00 2023-07-27T14:36:16.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 msgr2=0x7f83e0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:16.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 0x7f83e0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 >> v2:172.21.15.159:3300/0 conn(0x7f83e014b1e0 msgr2=0x7f83e00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 --2- 172.21.15.115:0/3663725511 >> v2:172.21.15.159:3300/0 conn(0x7f83e014b1e0 0x7f83e00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0157ff0 con 0x7f83e014ae00 2023-07-27T14:36:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.966+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f83d0001470 con 0x7f83e014ae00 2023-07-27T14:36:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 >> v1:172.21.15.115:6789/0 conn(0x7f83e014ae00 legacy=0x7f83e0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83deffd700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c80038e0 0x7f83c8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83deffd700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83deffd700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 0x7f83c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0157a50 con 0x7f83c8004690 2023-07-27T14:36:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0157d10 con 0x7f83c80038e0 2023-07-27T14:36:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c800b8e0 con 0x7f83e0063260 2023-07-27T14:36:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83df7fe700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83dffff700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c80038e0 0x7f83c8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83e4d9c700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 0x7f83c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83df7fe700 1 -- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 msgr2=0x7f83c8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83df7fe700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 0x7f83c8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83df7fe700 1 -- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c80038e0 msgr2=0x7f83c8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83df7fe700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c80038e0 0x7f83c8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83df7fe700 1 -- 172.21.15.115:0/3663725511 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80033f0 con 0x7f83c8004690 2023-07-27T14:36:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83e4d9c700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0063260 0x7f83c8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.967+0000 7f83df7fe700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f83e0063660 tx=0x7f83d4009060).ready entity=mon.0 client_cookie=ce3570d5f43383de server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4009e90 con 0x7f83c8004690 2023-07-27T14:36:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4009430 con 0x7f83c8004690 2023-07-27T14:36:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83deffd700 1 -- 172.21.15.115:0/3663725511 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d400e850 con 0x7f83c8004690 2023-07-27T14:36:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83e67ff700 1 -- 172.21.15.115:0/3663725511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83c8004690 msgr2=0x7f83c8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83e67ff700 1 --2- 172.21.15.115:0/3663725511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83c8004690 0x7f83c8004b10 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f83e0063660 tx=0x7f83d4009060).stop 2023-07-27T14:36:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83e4d9c700 1 -- 172.21.15.115:0/3663725511 reap_dead start 2023-07-27T14:36:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83e67ff700 1 -- 172.21.15.115:0/3663725511 shutdown_connections 2023-07-27T14:36:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83e67ff700 1 -- 172.21.15.115:0/3663725511 >> 172.21.15.115:0/3663725511 conn(0x7f83e005e940 msgr2=0x7f83e00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83e67ff700 1 -- 172.21.15.115:0/3663725511 shutdown_connections 2023-07-27T14:36:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.968+0000 7f83e67ff700 1 -- 172.21.15.115:0/3663725511 wait complete. 2023-07-27T14:36:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.970+0000 7f83e67ff700 1 Processor -- start 2023-07-27T14:36:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.970+0000 7f83e67ff700 1 -- start start 2023-07-27T14:36:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e67ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8004690 0x7f83e00adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0157430 0x7f83e0148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e67ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83e00645c0 0x7f83e0064a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e67ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0163e30 con 0x7f83e00645c0 2023-07-27T14:36:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e67ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e00aefc0 con 0x7f83c8004690 2023-07-27T14:36:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0064f30 con 0x7f83e0157430 2023-07-27T14:36:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e4d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83e00645c0 0x7f83e0064a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e4d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83e00645c0 0x7f83e0064a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57344/0 (socket says 172.21.15.115:57344) 2023-07-27T14:36:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83e4d9c700 1 -- 172.21.15.115:0/1909225 learned_addr learned my addr 172.21.15.115:0/1909225 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83df7fe700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0157430 0x7f83e0148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.971+0000 7f83dffff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8004690 0x7f83e00adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83e4d9c700 1 -- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0157430 msgr2=0x7f83e0148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:16.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83e4d9c700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0157430 0x7f83e0148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83e4d9c700 1 -- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8004690 msgr2=0x7f83e00adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:16.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83e4d9c700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8004690 0x7f83e00adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83e4d9c700 1 -- 172.21.15.115:0/1909225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00ae3b0 con 0x7f83e00645c0 2023-07-27T14:36:16.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83dffff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8004690 0x7f83e00adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:16.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83e4d9c700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83e00645c0 0x7f83e0064a40 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f83d8009f80 tx=0x7f83d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:16.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83c7fff700 1 -- 172.21.15.115:0/1909225 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d800e030 con 0x7f83e00645c0 2023-07-27T14:36:16.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83c7fff700 1 -- 172.21.15.115:0/1909225 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d800f040 con 0x7f83e00645c0 2023-07-27T14:36:16.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e00ae690 con 0x7f83e00645c0 2023-07-27T14:36:16.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83c7fff700 1 -- 172.21.15.115:0/1909225 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8010e80 con 0x7f83e00645c0 2023-07-27T14:36:16.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.972+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e00aec50 con 0x7f83e00645c0 2023-07-27T14:36:16.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.973+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e00af150 con 0x7f83e00645c0 2023-07-27T14:36:16.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.974+0000 7f83c7fff700 1 -- 172.21.15.115:0/1909225 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f83d8015690 con 0x7f83e00645c0 2023-07-27T14:36:16.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.975+0000 7f83c7fff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83cc05f850 0x7f83cc061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:16.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.975+0000 7f83c7fff700 1 -- 172.21.15.115:0/1909225 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f83d807b040 con 0x7f83e00645c0 2023-07-27T14:36:16.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.976+0000 7f83dffff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83cc05f850 0x7f83cc061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:16.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.976+0000 7f83dffff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83cc05f850 0x7f83cc061d10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f83d0007d90 tx=0x7f83d0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:16.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:15.980+0000 7f83c7fff700 1 -- 172.21.15.115:0/1909225 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83d804c030 con 0x7f83e00645c0 2023-07-27T14:36:16.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.150+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f83e006c470 con 0x7f83e00645c0 2023-07-27T14:36:16.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.753+0000 7f83c7fff700 1 -- 172.21.15.115:0/1909225 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v149) v1 ==== 169+0+0 (secure 0 0 0) 0x7f83d804f650 con 0x7f83e00645c0 2023-07-27T14:36:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83cc05f850 msgr2=0x7f83cc061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83cc05f850 0x7f83cc061d10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f83d0007d90 tx=0x7f83d0009040).stop 2023-07-27T14:36:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83e00645c0 msgr2=0x7f83e0064a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83e00645c0 0x7f83e0064a40 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f83d8009f80 tx=0x7f83d800b040).stop 2023-07-27T14:36:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 shutdown_connections 2023-07-27T14:36:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f83cc05f850 0x7f83cc061d10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83e00645c0 0x7f83e0064a40 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8004690 0x7f83e00adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 --2- 172.21.15.115:0/1909225 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f83e0157430 0x7f83e0148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.757+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 >> 172.21.15.115:0/1909225 conn(0x7f83e005e940 msgr2=0x7f83e00c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.758+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 shutdown_connections 2023-07-27T14:36:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.758+0000 7f83e67ff700 1 -- 172.21.15.115:0/1909225 wait complete. 2023-07-27T14:36:16.807 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:36:16.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-07-27T14:36:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.972+0000 7f13497ff700 1 Processor -- start 2023-07-27T14:36:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.972+0000 7f13497ff700 1 -- start start 2023-07-27T14:36:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.974+0000 7f13497ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f134413a350 0x7f1344065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.974+0000 7f13497ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13440bd9a0 con 0x7f13440c36b0 2023-07-27T14:36:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.974+0000 7f13497ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1344066610 con 0x7f134413a730 2023-07-27T14:36:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.974+0000 7f13497ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1344066400 con 0x7f134413a350 2023-07-27T14:36:17.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.974+0000 7f13437fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f13440c36b0 0x7f13440be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59388/0 (socket says 172.21.15.115:59388) 2023-07-27T14:36:17.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.974+0000 7f13437fe700 1 -- 172.21.15.115:0/575226555 learned_addr learned my addr 172.21.15.115:0/575226555 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.974+0000 7f1342ffd700 1 --2- 172.21.15.115:0/575226555 >> v2:172.21.15.159:3300/0 conn(0x7f134413a350 0x7f1344065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990633539 0 0) 0x7f13440bd9a0 con 0x7f13440c36b0 2023-07-27T14:36:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f132c0033f0 con 0x7f13440c36b0 2023-07-27T14:36:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8617258 0 0) 0x7f1344066610 con 0x7f134413a730 2023-07-27T14:36:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13440bd9a0 con 0x7f134413a730 2023-07-27T14:36:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1490142207 0 0) 0x7f132c0033f0 con 0x7f13440c36b0 2023-07-27T14:36:17.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 >> v2:172.21.15.159:3300/0 conn(0x7f134413a350 msgr2=0x7f1344065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 --2- 172.21.15.115:0/575226555 >> v2:172.21.15.159:3300/0 conn(0x7f134413a350 0x7f1344065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 >> v1:172.21.15.159:6789/0 conn(0x7f134413a730 legacy=0x7f13440c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13440bdc10 con 0x7f13440c36b0 2023-07-27T14:36:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f133c0017f0 con 0x7f13440c36b0 2023-07-27T14:36:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 >> v1:172.21.15.115:6789/0 conn(0x7f13440c36b0 legacy=0x7f13440be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f132c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f132c004690 0x7f132c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f132c005000 0x7f132c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1344066400 con 0x7f132c003a70 2023-07-27T14:36:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c00bf60 con 0x7f132c005000 2023-07-27T14:36:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.975+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c00c0d0 con 0x7f132c004690 2023-07-27T14:36:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1342ffd700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f132c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f13427fc700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f132c004690 0x7f132c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f13437fe700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f132c005000 0x7f132c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1342ffd700 1 -- 172.21.15.115:0/575226555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f132c004690 msgr2=0x7f132c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1342ffd700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f132c004690 0x7f132c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1342ffd700 1 -- 172.21.15.115:0/575226555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f132c005000 msgr2=0x7f132c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1342ffd700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f132c005000 0x7f132c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1342ffd700 1 -- 172.21.15.115:0/575226555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0033f0 con 0x7f132c003a70 2023-07-27T14:36:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f13437fe700 1 -- 172.21.15.115:0/575226555 reap_dead start 2023-07-27T14:36:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1342ffd700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f132c003e70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f1334009a80 tx=0x7f1334009060).ready entity=mon.0 client_cookie=cdce414d890cec7f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334009430 con 0x7f132c003a70 2023-07-27T14:36:17.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400e640 con 0x7f132c003a70 2023-07-27T14:36:17.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.976+0000 7f1341ffb700 1 -- 172.21.15.115:0/575226555 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400e9c0 con 0x7f132c003a70 2023-07-27T14:36:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.977+0000 7f13497ff700 1 -- 172.21.15.115:0/575226555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 msgr2=0x7f132c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.977+0000 7f13497ff700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f132c003e70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f1334009a80 tx=0x7f1334009060).stop 2023-07-27T14:36:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.977+0000 7f13497ff700 1 -- 172.21.15.115:0/575226555 shutdown_connections 2023-07-27T14:36:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.977+0000 7f13497ff700 1 --2- 172.21.15.115:0/575226555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f132c003e70 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.977+0000 7f13497ff700 1 -- 172.21.15.115:0/575226555 >> 172.21.15.115:0/575226555 conn(0x7f134405e8f0 msgr2=0x7f13440c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:17.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.977+0000 7f13497ff700 1 -- 172.21.15.115:0/575226555 shutdown_connections 2023-07-27T14:36:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.977+0000 7f13497ff700 1 -- 172.21.15.115:0/575226555 wait complete. 2023-07-27T14:36:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.978+0000 7f13497ff700 1 Processor -- start 2023-07-27T14:36:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.979+0000 7f13497ff700 1 -- start start 2023-07-27T14:36:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.979+0000 7f13497ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f1344159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.979+0000 7f13497ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1344158460 0x7f13441538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.979+0000 7f13497ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13440c6410 0x7f13440c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.979+0000 7f13497ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13441588e0 con 0x7f132c003a70 2023-07-27T14:36:17.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.979+0000 7f13497ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1344153de0 con 0x7f13440c6410 2023-07-27T14:36:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.979+0000 7f13497ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1344159a40 con 0x7f1344158460 2023-07-27T14:36:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f1344159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f1344159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57352/0 (socket says 172.21.15.115:57352) 2023-07-27T14:36:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 -- 172.21.15.115:0/1819862450 learned_addr learned my addr 172.21.15.115:0/1819862450 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 -- 172.21.15.115:0/1819862450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1344158460 msgr2=0x7f13441538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1344158460 0x7f13441538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:17.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 -- 172.21.15.115:0/1819862450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13440c6410 msgr2=0x7f13440c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13440c6410 0x7f13440c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 -- 172.21.15.115:0/1819862450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13441536f0 con 0x7f132c003a70 2023-07-27T14:36:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f1342ffd700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f1344159ed0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f1334006d50 tx=0x7f133401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f132affd700 1 -- 172.21.15.115:0/1819862450 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400ed70 con 0x7f132c003a70 2023-07-27T14:36:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f132affd700 1 -- 172.21.15.115:0/1819862450 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400eed0 con 0x7f132c003a70 2023-07-27T14:36:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.980+0000 7f132affd700 1 -- 172.21.15.115:0/1819862450 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400ea00 con 0x7f132c003a70 2023-07-27T14:36:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.981+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1344159440 con 0x7f132c003a70 2023-07-27T14:36:17.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.981+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13440a4bc0 con 0x7f132c003a70 2023-07-27T14:36:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.982+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134406c470 con 0x7f132c003a70 2023-07-27T14:36:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.983+0000 7f132affd700 1 -- 172.21.15.115:0/1819862450 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f133402b030 con 0x7f132c003a70 2023-07-27T14:36:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.984+0000 7f132affd700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f133005f880 0x7f1330061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.984+0000 7f132affd700 1 -- 172.21.15.115:0/1819862450 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f133407bbe0 con 0x7f132c003a70 2023-07-27T14:36:17.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.984+0000 7f13427fc700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f133005f880 0x7f1330061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.985+0000 7f13427fc700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f133005f880 0x7f1330061d40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f13380010e0 tx=0x7f1338009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:16.988+0000 7f132affd700 1 -- 172.21.15.115:0/1819862450 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f133404cc80 con 0x7f132c003a70 2023-07-27T14:36:17.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.163+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f13440a4db0 con 0x7f132c003a70 2023-07-27T14:36:17.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.167+0000 7f132affd700 1 -- 172.21.15.115:0/1819862450 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v28) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1334016020 con 0x7f132c003a70 2023-07-27T14:36:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.169+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f133005f880 msgr2=0x7f1330061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.169+0000 7f13497ff700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f133005f880 0x7f1330061d40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f13380010e0 tx=0x7f1338009040).stop 2023-07-27T14:36:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.169+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 msgr2=0x7f1344159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.169+0000 7f13497ff700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f1344159ed0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f1334006d50 tx=0x7f133401a000).stop 2023-07-27T14:36:17.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.170+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 shutdown_connections 2023-07-27T14:36:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.170+0000 7f13497ff700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f133005f880 0x7f1330061d40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.170+0000 7f13497ff700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13440c6410 0x7f13440c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.170+0000 7f13497ff700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f132c003a70 0x7f1344159ed0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.170+0000 7f13497ff700 1 --2- 172.21.15.115:0/1819862450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1344158460 0x7f13441538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.170+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 >> 172.21.15.115:0/1819862450 conn(0x7f134405e8f0 msgr2=0x7f13440aa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.170+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 shutdown_connections 2023-07-27T14:36:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.170+0000 7f13497ff700 1 -- 172.21.15.115:0/1819862450 wait complete. 2023-07-27T14:36:17.235 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:36:17.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.377+0000 7fc739dff700 1 Processor -- start 2023-07-27T14:36:17.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.378+0000 7fc739dff700 1 -- start start 2023-07-27T14:36:17.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc739dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc7340c36b0 0x7fc734065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc739dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7340bd9a0 con 0x7fc73413a350 2023-07-27T14:36:17.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc739dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc734066610 con 0x7fc73413a730 2023-07-27T14:36:17.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc739dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc734066400 con 0x7fc7340c36b0 2023-07-27T14:36:17.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc7337fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc73413a350 0x7fc7340c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59396/0 (socket says 172.21.15.115:59396) 2023-07-27T14:36:17.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc7337fe700 1 -- 172.21.15.115:0/4090700941 learned_addr learned my addr 172.21.15.115:0/4090700941 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc733fff700 1 --2- 172.21.15.115:0/4090700941 >> v2:172.21.15.159:3300/0 conn(0x7fc7340c36b0 0x7fc734065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561593411 0 0) 0x7fc7340bd9a0 con 0x7fc73413a350 2023-07-27T14:36:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.379+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc71c0033f0 con 0x7fc73413a350 2023-07-27T14:36:17.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082283111 0 0) 0x7fc734066610 con 0x7fc73413a730 2023-07-27T14:36:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7340bd9a0 con 0x7fc73413a730 2023-07-27T14:36:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1639320806 0 0) 0x7fc71c0033f0 con 0x7fc73413a350 2023-07-27T14:36:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 >> v2:172.21.15.159:3300/0 conn(0x7fc7340c36b0 msgr2=0x7fc734065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 --2- 172.21.15.115:0/4090700941 >> v2:172.21.15.159:3300/0 conn(0x7fc7340c36b0 0x7fc734065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 >> v1:172.21.15.159:6789/0 conn(0x7fc73413a730 legacy=0x7fc7340be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340bdc10 con 0x7fc73413a350 2023-07-27T14:36:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fc724001470 con 0x7fc73413a350 2023-07-27T14:36:17.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 >> v1:172.21.15.115:6789/0 conn(0x7fc73413a350 legacy=0x7fc7340c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c003a70 0x7fc71c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c004690 0x7fc71c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc71c005000 0x7fc71c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc734066400 con 0x7fc71c005000 2023-07-27T14:36:17.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c00bf60 con 0x7fc71c004690 2023-07-27T14:36:17.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c00c0d0 con 0x7fc71c003a70 2023-07-27T14:36:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc733fff700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc71c005000 0x7fc71c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc7337fe700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c003a70 0x7fc71c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.380+0000 7fc732ffd700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c004690 0x7fc71c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc733fff700 1 -- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c003a70 msgr2=0x7fc71c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc733fff700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c003a70 0x7fc71c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc733fff700 1 -- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c004690 msgr2=0x7fc71c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc733fff700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c004690 0x7fc71c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc733fff700 1 -- 172.21.15.115:0/4090700941 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0033f0 con 0x7fc71c005000 2023-07-27T14:36:17.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc732ffd700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc71c004690 0x7fc71c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:17.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc733fff700 1 -- 172.21.15.115:0/4090700941 reap_dead start 2023-07-27T14:36:17.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc733fff700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc71c005000 0x7fc71c00b8e0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fc734069eb0 tx=0x7fc72c00b040).ready entity=mon.0 client_cookie=b0058a23b74cda81 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c017070 con 0x7fc71c005000 2023-07-27T14:36:17.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c00f040 con 0x7fc71c005000 2023-07-27T14:36:17.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc7327fc700 1 -- 172.21.15.115:0/4090700941 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00ecb0 con 0x7fc71c005000 2023-07-27T14:36:17.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc739dff700 1 -- 172.21.15.115:0/4090700941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc71c005000 msgr2=0x7fc71c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.381+0000 7fc739dff700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc71c005000 0x7fc71c00b8e0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fc734069eb0 tx=0x7fc72c00b040).stop 2023-07-27T14:36:17.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.382+0000 7fc739dff700 1 -- 172.21.15.115:0/4090700941 shutdown_connections 2023-07-27T14:36:17.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.382+0000 7fc739dff700 1 --2- 172.21.15.115:0/4090700941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc71c005000 0x7fc71c00b8e0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.382+0000 7fc739dff700 1 -- 172.21.15.115:0/4090700941 >> 172.21.15.115:0/4090700941 conn(0x7fc73405e8f0 msgr2=0x7fc7340c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:17.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.382+0000 7fc739dff700 1 -- 172.21.15.115:0/4090700941 shutdown_connections 2023-07-27T14:36:17.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.382+0000 7fc739dff700 1 -- 172.21.15.115:0/4090700941 wait complete. 2023-07-27T14:36:17.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.383+0000 7fc739dff700 1 Processor -- start 2023-07-27T14:36:17.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.383+0000 7fc739dff700 1 -- start start 2023-07-27T14:36:17.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc739dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c005000 0x7fc7340c0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc739dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7341393a0 0x7fc734163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc739dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340a6990 0x7fc7340a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc739dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340a9af0 con 0x7fc7340a6990 2023-07-27T14:36:17.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc739dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340c0950 con 0x7fc7341393a0 2023-07-27T14:36:17.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc739dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340a72e0 con 0x7fc71c005000 2023-07-27T14:36:17.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc733fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340a6990 0x7fc7340a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc733fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340a6990 0x7fc7340a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57380/0 (socket says 172.21.15.115:57380) 2023-07-27T14:36:17.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.384+0000 7fc733fff700 1 -- 172.21.15.115:0/3088393853 learned_addr learned my addr 172.21.15.115:0/3088393853 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:17.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc732ffd700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7341393a0 0x7fc734163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc7337fe700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c005000 0x7fc7340c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc733fff700 1 -- 172.21.15.115:0/3088393853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c005000 msgr2=0x7fc7340c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc733fff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c005000 0x7fc7340c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc733fff700 1 -- 172.21.15.115:0/3088393853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7341393a0 msgr2=0x7fc734163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc733fff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7341393a0 0x7fc734163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc733fff700 1 -- 172.21.15.115:0/3088393853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc734164610 con 0x7fc7340a6990 2023-07-27T14:36:17.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc733fff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340a6990 0x7fc7340a6df0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fc72c00afd0 tx=0x7fc72c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc71b7fe700 1 -- 172.21.15.115:0/3088393853 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c009ac0 con 0x7fc7340a6990 2023-07-27T14:36:17.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc71b7fe700 1 -- 172.21.15.115:0/3088393853 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c01e430 con 0x7fc7340a6990 2023-07-27T14:36:17.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc71b7fe700 1 -- 172.21.15.115:0/3088393853 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c01e7d0 con 0x7fc7340a6990 2023-07-27T14:36:17.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7341648f0 con 0x7fc7340a6990 2023-07-27T14:36:17.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.385+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7340a9cd0 con 0x7fc7340a6990 2023-07-27T14:36:17.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.386+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7340a9af0 con 0x7fc7340a6990 2023-07-27T14:36:17.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.387+0000 7fc71b7fe700 1 -- 172.21.15.115:0/3088393853 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fc72c02e070 con 0x7fc7340a6990 2023-07-27T14:36:17.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.388+0000 7fc71b7fe700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc72005f850 0x7fc720061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.388+0000 7fc71b7fe700 1 -- 172.21.15.115:0/3088393853 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fc72c07c690 con 0x7fc7340a6990 2023-07-27T14:36:17.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.388+0000 7fc7337fe700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc72005f850 0x7fc720061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.389+0000 7fc7337fe700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc72005f850 0x7fc720061d10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fc724001120 tx=0x7fc724009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.392+0000 7fc71b7fe700 1 -- 172.21.15.115:0/3088393853 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc72c04d710 con 0x7fc7340a6990 2023-07-27T14:36:17.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.563+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc73406c470 con 0x7fc7340a6990 2023-07-27T14:36:17.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.568+0000 7fc71b7fe700 1 -- 172.21.15.115:0/3088393853 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc72c02c020 con 0x7fc7340a6990 2023-07-27T14:36:17.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc72005f850 msgr2=0x7fc720061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc72005f850 0x7fc720061d10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fc724001120 tx=0x7fc724009040).stop 2023-07-27T14:36:17.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340a6990 msgr2=0x7fc7340a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340a6990 0x7fc7340a6df0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fc72c00afd0 tx=0x7fc72c019000).stop 2023-07-27T14:36:17.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 shutdown_connections 2023-07-27T14:36:17.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc72005f850 0x7fc720061d10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7340a6990 0x7fc7340a6df0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc71c005000 0x7fc7340c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 --2- 172.21.15.115:0/3088393853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7341393a0 0x7fc734163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 >> 172.21.15.115:0/3088393853 conn(0x7fc73405e8f0 msgr2=0x7fc7340c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:17.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 shutdown_connections 2023-07-27T14:36:17.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.571+0000 7fc739dff700 1 -- 172.21.15.115:0/3088393853 wait complete. 2023-07-27T14:36:17.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_snapshot_rm' 2023-07-27T14:36:17.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.785+0000 7f1c5e3ff700 1 Processor -- start 2023-07-27T14:36:17.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.786+0000 7f1c5e3ff700 1 -- start start 2023-07-27T14:36:17.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.787+0000 7f1c5e3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1c58150af0 0x7f1c58150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.787+0000 7f1c5e3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5806a440 con 0x7f1c580c0e80 2023-07-27T14:36:17.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.787+0000 7f1c5e3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c580bbc80 con 0x7f1c580a5e40 2023-07-27T14:36:17.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.787+0000 7f1c5e3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c58069e80 con 0x7f1c58150af0 2023-07-27T14:36:17.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.787+0000 7f1c577fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1c580c0e80 0x7f1c580a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59400/0 (socket says 172.21.15.115:59400) 2023-07-27T14:36:17.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.787+0000 7f1c577fe700 1 -- 172.21.15.115:0/3322736763 learned_addr learned my addr 172.21.15.115:0/3322736763 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:17.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262890620 0 0) 0x7f1c5806a440 con 0x7f1c580c0e80 2023-07-27T14:36:17.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c57fff700 1 --2- 172.21.15.115:0/3322736763 >> v2:172.21.15.159:3300/0 conn(0x7f1c58150af0 0x7f1c58150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c400033f0 con 0x7f1c580c0e80 2023-07-27T14:36:17.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116041731 0 0) 0x7f1c400033f0 con 0x7f1c580c0e80 2023-07-27T14:36:17.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 >> v2:172.21.15.159:3300/0 conn(0x7f1c58150af0 msgr2=0x7f1c58150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 --2- 172.21.15.115:0/3322736763 >> v2:172.21.15.159:3300/0 conn(0x7f1c58150af0 0x7f1c58150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 >> v1:172.21.15.159:6789/0 conn(0x7f1c580a5e40 legacy=0x7f1c580bc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5806a160 con 0x7f1c580c0e80 2023-07-27T14:36:17.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1c4c001470 con 0x7f1c580c0e80 2023-07-27T14:36:17.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 >> v1:172.21.15.115:6789/0 conn(0x7f1c580c0e80 legacy=0x7f1c580a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c400038e0 0x7f1c40003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c40004690 0x7f1c40004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c40005000 0x7f1c4000daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c58069e80 con 0x7f1c40004690 2023-07-27T14:36:17.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4000e170 con 0x7f1c400038e0 2023-07-27T14:36:17.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4000e300 con 0x7f1c40005000 2023-07-27T14:36:17.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.788+0000 7f1c577fe700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c40004690 0x7f1c40004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c57fff700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c400038e0 0x7f1c40003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c5c99c700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c40005000 0x7f1c4000daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c577fe700 1 -- 172.21.15.115:0/3322736763 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c40005000 msgr2=0x7f1c4000daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c577fe700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c40005000 0x7f1c4000daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c577fe700 1 -- 172.21.15.115:0/3322736763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c400038e0 msgr2=0x7f1c40003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:17.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c577fe700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c400038e0 0x7f1c40003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c577fe700 1 -- 172.21.15.115:0/3322736763 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400033f0 con 0x7f1c40004690 2023-07-27T14:36:17.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c5c99c700 1 -- 172.21.15.115:0/3322736763 reap_dead start 2023-07-27T14:36:17.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c577fe700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c40004690 0x7f1c40004b10 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f1c4c00c160 tx=0x7f1c4c001e50).ready entity=mon.0 client_cookie=27ec97eb1c21d72e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c007a20 con 0x7f1c40004690 2023-07-27T14:36:17.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00ca90 con 0x7f1c40004690 2023-07-27T14:36:17.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.789+0000 7f1c56ffd700 1 -- 172.21.15.115:0/3322736763 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00ce10 con 0x7f1c40004690 2023-07-27T14:36:17.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.790+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3322736763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c40004690 msgr2=0x7f1c40004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.790+0000 7f1c5e3ff700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c40004690 0x7f1c40004b10 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f1c4c00c160 tx=0x7f1c4c001e50).stop 2023-07-27T14:36:17.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.790+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3322736763 shutdown_connections 2023-07-27T14:36:17.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.790+0000 7f1c5e3ff700 1 --2- 172.21.15.115:0/3322736763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c40004690 0x7f1c40004b10 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.790+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3322736763 >> 172.21.15.115:0/3322736763 conn(0x7f1c58062320 msgr2=0x7f1c58062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:17.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.790+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3322736763 shutdown_connections 2023-07-27T14:36:17.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.790+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3322736763 wait complete. 2023-07-27T14:36:17.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.791+0000 7f1c5e3ff700 1 Processor -- start 2023-07-27T14:36:17.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.791+0000 7f1c5e3ff700 1 -- start start 2023-07-27T14:36:17.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.792+0000 7f1c5e3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c40004690 0x7f1c580be9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.792+0000 7f1c5e3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580beeb0 0x7f1c580c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.792+0000 7f1c5e3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c580c5d10 0x7f1c580bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.792+0000 7f1c5e3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580be530 con 0x7f1c580beeb0 2023-07-27T14:36:17.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.792+0000 7f1c5e3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580bd920 con 0x7f1c40004690 2023-07-27T14:36:17.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.792+0000 7f1c5e3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580bdc00 con 0x7f1c580c5d10 2023-07-27T14:36:17.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580beeb0 0x7f1c580c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580beeb0 0x7f1c580c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57394/0 (socket says 172.21.15.115:57394) 2023-07-27T14:36:17.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 -- 172.21.15.115:0/3596520215 learned_addr learned my addr 172.21.15.115:0/3596520215 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:17.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 -- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c580c5d10 msgr2=0x7f1c580bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c5c99c700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c580c5d10 0x7f1c580bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c57fff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c40004690 0x7f1c580be9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c580c5d10 0x7f1c580bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 -- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c40004690 msgr2=0x7f1c580be9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:17.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c40004690 0x7f1c580be9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:17.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 -- 172.21.15.115:0/3596520215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c580bdee0 con 0x7f1c580beeb0 2023-07-27T14:36:17.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c57fff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c40004690 0x7f1c580be9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:17.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c577fe700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580beeb0 0x7f1c580c5820 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f1c4c001ed0 tx=0x7f1c4c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c3ffff700 1 -- 172.21.15.115:0/3596520215 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c007430 con 0x7f1c580beeb0 2023-07-27T14:36:17.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c3ffff700 1 -- 172.21.15.115:0/3596520215 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c007590 con 0x7f1c580beeb0 2023-07-27T14:36:17.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c580be1c0 con 0x7f1c580beeb0 2023-07-27T14:36:17.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.793+0000 7f1c3ffff700 1 -- 172.21.15.115:0/3596520215 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0048c0 con 0x7f1c580beeb0 2023-07-27T14:36:17.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.794+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c580c0380 con 0x7f1c580beeb0 2023-07-27T14:36:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.795+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5806c470 con 0x7f1c580beeb0 2023-07-27T14:36:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.795+0000 7f1c3ffff700 1 -- 172.21.15.115:0/3596520215 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f1c4c010070 con 0x7f1c580beeb0 2023-07-27T14:36:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.796+0000 7f1c3ffff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c4405f880 0x7f1c44061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.796+0000 7f1c3ffff700 1 -- 172.21.15.115:0/3596520215 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f1c4c07ae50 con 0x7f1c580beeb0 2023-07-27T14:36:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.796+0000 7f1c57fff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c4405f880 0x7f1c44061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:17.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.797+0000 7f1c57fff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c4405f880 0x7f1c44061d40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f1c48009270 tx=0x7f1c48008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:17.800+0000 7f1c3ffff700 1 -- 172.21.15.115:0/3596520215 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c4c04bfe0 con 0x7f1c580beeb0 2023-07-27T14:36:18.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.032+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_snapshot_rm"]} v 0) v1 -- 0x7f1c580be670 con 0x7f1c580beeb0 2023-07-27T14:36:18.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.758+0000 7f1c3ffff700 1 -- 172.21.15.115:0/3596520215 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_snapshot_rm"]}]=0 v479) v1 ==== 177+0+0 (secure 0 0 0) 0x7f1c4c024030 con 0x7f1c580beeb0 2023-07-27T14:36:18.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.760+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c4405f880 msgr2=0x7f1c44061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:18.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.760+0000 7f1c5e3ff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c4405f880 0x7f1c44061d40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f1c48009270 tx=0x7f1c48008040).stop 2023-07-27T14:36:18.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.760+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580beeb0 msgr2=0x7f1c580c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:18.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.760+0000 7f1c5e3ff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580beeb0 0x7f1c580c5820 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f1c4c001ed0 tx=0x7f1c4c015000).stop 2023-07-27T14:36:18.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.761+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 shutdown_connections 2023-07-27T14:36:18.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.761+0000 7f1c5e3ff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1c4405f880 0x7f1c44061d40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:18.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.761+0000 7f1c5e3ff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1c580c5d10 0x7f1c580bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:18.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.761+0000 7f1c5e3ff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c40004690 0x7f1c580be9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:18.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.761+0000 7f1c5e3ff700 1 --2- 172.21.15.115:0/3596520215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c580beeb0 0x7f1c580c5820 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:18.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.761+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 >> 172.21.15.115:0/3596520215 conn(0x7f1c58062320 msgr2=0x7f1c580c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:18.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.761+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 shutdown_connections 2023-07-27T14:36:18.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.761+0000 7f1c5e3ff700 1 -- 172.21.15.115:0/3596520215 wait complete. 2023-07-27T14:36:18.828 INFO:tasks.cephfs_test_runner:test_subvolume_clone_in_progress_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:36:18.829 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_clone_in_progress_source (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:36:18.829 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_source' 2023-07-27T14:36:19.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.974+0000 7f416ddff700 1 Processor -- start 2023-07-27T14:36:19.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.974+0000 7f416ddff700 1 -- start start 2023-07-27T14:36:19.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f416ddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41681542a0 0x7f416815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:19.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f416ddff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41680aa4d0 con 0x7f4168153ec0 2023-07-27T14:36:19.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f416ddff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41680c05c0 con 0x7f41680aaa40 2023-07-27T14:36:19.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f416ddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41680c1a60 con 0x7f41681542a0 2023-07-27T14:36:19.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f41677fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4168153ec0 0x7f41680a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59412/0 (socket says 172.21.15.115:59412) 2023-07-27T14:36:19.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f41677fe700 1 -- 172.21.15.115:0/3156801961 learned_addr learned my addr 172.21.15.115:0/3156801961 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:19.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f4167fff700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41681542a0 0x7f416815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:19.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680481261 0 0) 0x7f4158001110 con 0x7f4168153ec0 2023-07-27T14:36:19.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.976+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41500033f0 con 0x7f4168153ec0 2023-07-27T14:36:19.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3043264545 0 0) 0x7f41500033f0 con 0x7f4168153ec0 2023-07-27T14:36:19.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41681542a0 msgr2=0x7f416815efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:19.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41681542a0 0x7f416815efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 >> v1:172.21.15.159:6789/0 conn(0x7f41680aaa40 legacy=0x7f41680640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:19.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680aa270 con 0x7f4168153ec0 2023-07-27T14:36:19.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4158001600 con 0x7f4168153ec0 2023-07-27T14:36:19.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 >> v1:172.21.15.115:6789/0 conn(0x7f4168153ec0 legacy=0x7f41680a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:19.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4150003910 0x7f4150003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:19.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150004690 0x7f4150004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:19.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41681542a0 0x7f4150005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:19.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680c1a60 con 0x7f4150003910 2023-07-27T14:36:19.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415000b940 con 0x7f4150004690 2023-07-27T14:36:19.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415000bb00 con 0x7f41681542a0 2023-07-27T14:36:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41677fe700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4150003910 0x7f4150003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f4167fff700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41681542a0 0x7f4150005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f4166ffd700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150004690 0x7f4150004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41677fe700 1 -- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41681542a0 msgr2=0x7f4150005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41677fe700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41681542a0 0x7f4150005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41677fe700 1 -- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150004690 msgr2=0x7f4150004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41677fe700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150004690 0x7f4150004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.977+0000 7f41677fe700 1 -- 172.21.15.115:0/3156801961 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500033f0 con 0x7f4150003910 2023-07-27T14:36:19.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f41677fe700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4150003910 0x7f4150003d30 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f415800c390 tx=0x7f41580078d0).ready entity=mon.0 client_cookie=75d440bc2c7ced19 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:19.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415800cc60 con 0x7f4150003910 2023-07-27T14:36:19.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415800cdc0 con 0x7f4150003910 2023-07-27T14:36:19.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f41667fc700 1 -- 172.21.15.115:0/3156801961 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580072e0 con 0x7f4150003910 2023-07-27T14:36:19.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f416ddff700 1 -- 172.21.15.115:0/3156801961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4150003910 msgr2=0x7f4150003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:19.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f416ddff700 1 --2- 172.21.15.115:0/3156801961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4150003910 0x7f4150003d30 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f415800c390 tx=0x7f41580078d0).stop 2023-07-27T14:36:19.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f4167fff700 1 -- 172.21.15.115:0/3156801961 reap_dead start 2023-07-27T14:36:19.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f416ddff700 1 -- 172.21.15.115:0/3156801961 shutdown_connections 2023-07-27T14:36:19.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f416ddff700 1 -- 172.21.15.115:0/3156801961 >> 172.21.15.115:0/3156801961 conn(0x7f41680cb610 msgr2=0x7f41680c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:19.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f416ddff700 1 -- 172.21.15.115:0/3156801961 shutdown_connections 2023-07-27T14:36:19.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.978+0000 7f416ddff700 1 -- 172.21.15.115:0/3156801961 wait complete. 2023-07-27T14:36:19.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.980+0000 7f416ddff700 1 Processor -- start 2023-07-27T14:36:19.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.980+0000 7f416ddff700 1 -- start start 2023-07-27T14:36:19.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f416ddff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150003910 0x7f4168164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:19.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f416ddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41680b0300 0x7f41680acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:19.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f416ddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f416814e5b0 0x7f416814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f416ddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680ad5d0 con 0x7f41680b0300 2023-07-27T14:36:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f416ddff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680afe70 con 0x7f4150003910 2023-07-27T14:36:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f416ddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41680af540 con 0x7f416814e5b0 2023-07-27T14:36:19.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f4166ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41680b0300 0x7f41680acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f4166ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41680b0300 0x7f41680acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57412/0 (socket says 172.21.15.115:57412) 2023-07-27T14:36:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f4166ffd700 1 -- 172.21.15.115:0/1150319321 learned_addr learned my addr 172.21.15.115:0/1150319321 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.981+0000 7f4167fff700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f416814e5b0 0x7f416814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f4166ffd700 1 -- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f416814e5b0 msgr2=0x7f416814ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f4166ffd700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f416814e5b0 0x7f416814ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f4166ffd700 1 -- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150003910 msgr2=0x7f4168164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:19.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f41677fe700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150003910 0x7f4168164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:19.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f4166ffd700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150003910 0x7f4168164eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f4166ffd700 1 -- 172.21.15.115:0/1150319321 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680af820 con 0x7f41680b0300 2023-07-27T14:36:19.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f4167fff700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f416814e5b0 0x7f416814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:19.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f41677fe700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150003910 0x7f4168164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:19.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f4166ffd700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41680b0300 0x7f41680acd60 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f415c00e540 tx=0x7f415c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:19.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f414f7fe700 1 -- 172.21.15.115:0/1150319321 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c010450 con 0x7f41680b0300 2023-07-27T14:36:19.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f414f7fe700 1 -- 172.21.15.115:0/1150319321 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c0105b0 con 0x7f41680b0300 2023-07-27T14:36:19.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41680afb00 con 0x7f41680b0300 2023-07-27T14:36:19.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f414f7fe700 1 -- 172.21.15.115:0/1150319321 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c010930 con 0x7f41680b0300 2023-07-27T14:36:19.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.982+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41680adb40 con 0x7f41680b0300 2023-07-27T14:36:19.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.983+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41680b0000 con 0x7f41680b0300 2023-07-27T14:36:19.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.984+0000 7f414f7fe700 1 -- 172.21.15.115:0/1150319321 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f415c010d20 con 0x7f41680b0300 2023-07-27T14:36:19.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.985+0000 7f414f7fe700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f415405f850 0x7f4154061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:19.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.985+0000 7f414f7fe700 1 -- 172.21.15.115:0/1150319321 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f415c07a6b0 con 0x7f41680b0300 2023-07-27T14:36:19.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.985+0000 7f41677fe700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f415405f850 0x7f4154061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:19.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.986+0000 7f41677fe700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f415405f850 0x7f4154061d10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f415800c1a0 tx=0x7f4158015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:19.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:18.989+0000 7f414f7fe700 1 -- 172.21.15.115:0/1150319321 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f415c0498f0 con 0x7f41680b0300 2023-07-27T14:36:19.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.222+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_source"]} v 0) v1 -- 0x7f416806c470 con 0x7f41680b0300 2023-07-27T14:36:19.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.763+0000 7f414f7fe700 1 -- 172.21.15.115:0/1150319321 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_source"]}]=0 v480) v1 ==== 175+0+0 (secure 0 0 0) 0x7f415c04b2f0 con 0x7f41680b0300 2023-07-27T14:36:19.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f415405f850 msgr2=0x7f4154061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:19.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f415405f850 0x7f4154061d10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f415800c1a0 tx=0x7f4158015000).stop 2023-07-27T14:36:19.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41680b0300 msgr2=0x7f41680acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:19.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41680b0300 0x7f41680acd60 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f415c00e540 tx=0x7f415c009040).stop 2023-07-27T14:36:19.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 shutdown_connections 2023-07-27T14:36:19.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f415405f850 0x7f4154061d10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f416814e5b0 0x7f416814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4150003910 0x7f4168164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 --2- 172.21.15.115:0/1150319321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41680b0300 0x7f41680acd60 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:19.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 >> 172.21.15.115:0/1150319321 conn(0x7f41680cb610 msgr2=0x7f4168153230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:19.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 shutdown_connections 2023-07-27T14:36:19.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.766+0000 7f416ddff700 1 -- 172.21.15.115:0/1150319321 wait complete. 2023-07-27T14:36:19.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:36:20.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.980+0000 7f20f6bff700 1 Processor -- start 2023-07-27T14:36:20.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.980+0000 7f20f6bff700 1 -- start start 2023-07-27T14:36:20.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.981+0000 7f20f6bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20f014ae00 0x7f20f0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.981+0000 7f20f6bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f01553f0 con 0x7f20f014b1e0 2023-07-27T14:36:20.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.981+0000 7f20f6bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f0157a50 con 0x7f20f0063260 2023-07-27T14:36:20.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.981+0000 7f20f6bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f0157d10 con 0x7f20f014ae00 2023-07-27T14:36:20.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20f499b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20f014ae00 0x7f20f0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20effff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f20f014b1e0 0x7f20f0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59422/0 (socket says 172.21.15.115:59422) 2023-07-27T14:36:20.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20effff700 1 -- 172.21.15.115:0/4291280579 learned_addr learned my addr 172.21.15.115:0/4291280579 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:20.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20f499b700 1 -- 172.21.15.115:0/4291280579 >> v1:172.21.15.159:6789/0 conn(0x7f20f0063260 legacy=0x7f20f00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:20.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20f499b700 1 -- 172.21.15.115:0/4291280579 >> v1:172.21.15.115:6789/0 conn(0x7f20f014b1e0 legacy=0x7f20f0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20f499b700 1 -- 172.21.15.115:0/4291280579 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0157ff0 con 0x7f20f014ae00 2023-07-27T14:36:20.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20ef7fe700 1 -- 172.21.15.115:0/4291280579 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936702352 0 0) 0x7f20f01553f0 con 0x7f20f014b1e0 2023-07-27T14:36:20.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20f499b700 1 --2- 172.21.15.115:0/4291280579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0154f00 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f20e4009760 tx=0x7f20e4009060).ready entity=mon.0 client_cookie=6219f87825a8e78f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:20.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.982+0000 7f20ef7fe700 1 -- 172.21.15.115:0/4291280579 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400b580 con 0x7f20f014ae00 2023-07-27T14:36:20.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20ef7fe700 1 -- 172.21.15.115:0/4291280579 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e400b6e0 con 0x7f20f014ae00 2023-07-27T14:36:20.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20ef7fe700 1 -- 172.21.15.115:0/4291280579 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400ba60 con 0x7f20f014ae00 2023-07-27T14:36:20.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20f6bff700 1 -- 172.21.15.115:0/4291280579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 msgr2=0x7f20f0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20f6bff700 1 --2- 172.21.15.115:0/4291280579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0154f00 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f20e4009760 tx=0x7f20e4009060).stop 2023-07-27T14:36:20.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20f6bff700 1 -- 172.21.15.115:0/4291280579 shutdown_connections 2023-07-27T14:36:20.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20f6bff700 1 --2- 172.21.15.115:0/4291280579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0154f00 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20f6bff700 1 -- 172.21.15.115:0/4291280579 >> 172.21.15.115:0/4291280579 conn(0x7f20f005e940 msgr2=0x7f20f00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:20.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20f6bff700 1 -- 172.21.15.115:0/4291280579 shutdown_connections 2023-07-27T14:36:20.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.983+0000 7f20f6bff700 1 -- 172.21.15.115:0/4291280579 wait complete. 2023-07-27T14:36:20.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.985+0000 7f20f6bff700 1 Processor -- start 2023-07-27T14:36:20.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.985+0000 7f20f6bff700 1 -- start start 2023-07-27T14:36:20.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f6bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20f0063260 0x7f20f0164d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f6bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0167650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f6bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20f014b1e0 0x7f20f00c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f6bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00c34b0 con 0x7f20f014ae00 2023-07-27T14:36:20.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f6bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00c3790 con 0x7f20f014b1e0 2023-07-27T14:36:20.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f6bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0167e60 con 0x7f20f0063260 2023-07-27T14:36:20.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20effff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20effff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0167650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57422/0 (socket says 172.21.15.115:57422) 2023-07-27T14:36:20.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20effff700 1 -- 172.21.15.115:0/933937610 learned_addr learned my addr 172.21.15.115:0/933937610 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f499b700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20f0063260 0x7f20f0164d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f519c700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20f014b1e0 0x7f20f00c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20effff700 1 -- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20f0063260 msgr2=0x7f20f0164d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20effff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20f0063260 0x7f20f0164d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20effff700 1 -- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20f014b1e0 msgr2=0x7f20f00c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20effff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20f014b1e0 0x7f20f00c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20effff700 1 -- 172.21.15.115:0/933937610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40092a0 con 0x7f20f014ae00 2023-07-27T14:36:20.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.986+0000 7f20f519c700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20f014b1e0 0x7f20f00c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:20.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.987+0000 7f20effff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0167650 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f20dc00c4e0 tx=0x7f20dc007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:20.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.987+0000 7f20ecff9700 1 -- 172.21.15.115:0/933937610 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00cea0 con 0x7f20f014ae00 2023-07-27T14:36:20.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.987+0000 7f20ecff9700 1 -- 172.21.15.115:0/933937610 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0072e0 con 0x7f20f014ae00 2023-07-27T14:36:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.987+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f0168140 con 0x7f20f014ae00 2023-07-27T14:36:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.987+0000 7f20ecff9700 1 -- 172.21.15.115:0/933937610 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0057a0 con 0x7f20f014ae00 2023-07-27T14:36:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.987+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f0167b40 con 0x7f20f014ae00 2023-07-27T14:36:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.988+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f00c3920 con 0x7f20f014ae00 2023-07-27T14:36:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.989+0000 7f20ecff9700 1 -- 172.21.15.115:0/933937610 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f20dc010070 con 0x7f20f014ae00 2023-07-27T14:36:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.989+0000 7f20ecff9700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d405f850 0x7f20d4061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.990+0000 7f20ecff9700 1 -- 172.21.15.115:0/933937610 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f20dc079c30 con 0x7f20f014ae00 2023-07-27T14:36:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.990+0000 7f20f499b700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d405f850 0x7f20d4061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.990+0000 7f20f499b700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d405f850 0x7f20d4061d10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f20e400b340 tx=0x7f20e4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:20.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:19.993+0000 7f20ecff9700 1 -- 172.21.15.115:0/933937610 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20dc04acb0 con 0x7f20f014ae00 2023-07-27T14:36:20.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.166+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f20f006c470 con 0x7f20f014ae00 2023-07-27T14:36:20.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.170+0000 7f20ecff9700 1 -- 172.21.15.115:0/933937610 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f20dc04e2d0 con 0x7f20f014ae00 2023-07-27T14:36:20.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.172+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d405f850 msgr2=0x7f20d4061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.172+0000 7f20f6bff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d405f850 0x7f20d4061d10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f20e400b340 tx=0x7f20e4017000).stop 2023-07-27T14:36:20.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.172+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 msgr2=0x7f20f0167650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.172+0000 7f20f6bff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0167650 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f20dc00c4e0 tx=0x7f20dc007bf0).stop 2023-07-27T14:36:20.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.173+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 shutdown_connections 2023-07-27T14:36:20.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.173+0000 7f20f6bff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f20d405f850 0x7f20d4061d10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.173+0000 7f20f6bff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20f014b1e0 0x7f20f00c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.173+0000 7f20f6bff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20f0063260 0x7f20f0164d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.173+0000 7f20f6bff700 1 --2- 172.21.15.115:0/933937610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20f014ae00 0x7f20f0167650 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.173+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 >> 172.21.15.115:0/933937610 conn(0x7f20f005e940 msgr2=0x7f20f014a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:20.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.173+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 shutdown_connections 2023-07-27T14:36:20.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.173+0000 7f20f6bff700 1 -- 172.21.15.115:0/933937610 wait complete. 2023-07-27T14:36:20.237 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:36:20.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:36:20.333 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:36:20.435 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:36:20.435 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:36:20.436 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:36:20.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.577+0000 7f546c1ff700 1 Processor -- start 2023-07-27T14:36:20.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.577+0000 7f546c1ff700 1 -- start start 2023-07-27T14:36:20.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.578+0000 7f546c1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5464150af0 0x7f5464150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.578+0000 7f546c1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546406a440 con 0x7f54640c0e80 2023-07-27T14:36:20.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.578+0000 7f546c1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54640bbc80 con 0x7f54640a5e40 2023-07-27T14:36:20.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.578+0000 7f546c1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5464069e80 con 0x7f5464150af0 2023-07-27T14:36:20.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f546979a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f54640c0e80 0x7f54640a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59428/0 (socket says 172.21.15.115:59428) 2023-07-27T14:36:20.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f546979a700 1 -- 172.21.15.115:0/3556869385 learned_addr learned my addr 172.21.15.115:0/3556869385 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:20.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5469f9b700 1 --2- 172.21.15.115:0/3556869385 >> v2:172.21.15.159:3300/0 conn(0x7f5464150af0 0x7f5464150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026011646 0 0) 0x7f546406a440 con 0x7f54640c0e80 2023-07-27T14:36:20.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54500033f0 con 0x7f54640c0e80 2023-07-27T14:36:20.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326860228 0 0) 0x7f54640bbc80 con 0x7f54640a5e40 2023-07-27T14:36:20.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f546406a440 con 0x7f54640a5e40 2023-07-27T14:36:20.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69969604 0 0) 0x7f54500033f0 con 0x7f54640c0e80 2023-07-27T14:36:20.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 >> v2:172.21.15.159:3300/0 conn(0x7f5464150af0 msgr2=0x7f5464150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:20.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 --2- 172.21.15.115:0/3556869385 >> v2:172.21.15.159:3300/0 conn(0x7f5464150af0 0x7f5464150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 >> v1:172.21.15.159:6789/0 conn(0x7f54640a5e40 legacy=0x7f54640bc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546406a160 con 0x7f54640c0e80 2023-07-27T14:36:20.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f5454001470 con 0x7f54640c0e80 2023-07-27T14:36:20.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.579+0000 7f5469f9b700 1 --2- 172.21.15.115:0/3556869385 >> v2:172.21.15.159:3300/0 conn(0x7f5464150af0 0x7f5464150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:20.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 >> v1:172.21.15.115:6789/0 conn(0x7f54640c0e80 legacy=0x7f54640a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f5468f99700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450003a70 0x7f5450003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f5468f99700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450004690 0x7f5450004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f5468f99700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5450005000 0x7f545000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5464069e80 con 0x7f5450004690 2023-07-27T14:36:20.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545000bf60 con 0x7f5450003a70 2023-07-27T14:36:20.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545000c0d0 con 0x7f5450005000 2023-07-27T14:36:20.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f546979a700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450004690 0x7f5450004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f546a79c700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5450005000 0x7f545000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f5469f9b700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450003a70 0x7f5450003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f546979a700 1 -- 172.21.15.115:0/3556869385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5450005000 msgr2=0x7f545000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:20.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f546979a700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5450005000 0x7f545000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f546979a700 1 -- 172.21.15.115:0/3556869385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450003a70 msgr2=0x7f5450003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:20.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f546979a700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450003a70 0x7f5450003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f546979a700 1 -- 172.21.15.115:0/3556869385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54500033f0 con 0x7f5450004690 2023-07-27T14:36:20.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.580+0000 7f546a79c700 1 -- 172.21.15.115:0/3556869385 reap_dead start 2023-07-27T14:36:20.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f546979a700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450004690 0x7f5450004b10 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f545400c0e0 tx=0x7f5454001e10).ready entity=mon.0 client_cookie=1b2a6b300f1ce964 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:20.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545400ca10 con 0x7f5450004690 2023-07-27T14:36:20.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545400cb70 con 0x7f5450004690 2023-07-27T14:36:20.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f5468f99700 1 -- 172.21.15.115:0/3556869385 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540070d0 con 0x7f5450004690 2023-07-27T14:36:20.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f546c1ff700 1 -- 172.21.15.115:0/3556869385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450004690 msgr2=0x7f5450004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f546c1ff700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450004690 0x7f5450004b10 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f545400c0e0 tx=0x7f5454001e10).stop 2023-07-27T14:36:20.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f546c1ff700 1 -- 172.21.15.115:0/3556869385 shutdown_connections 2023-07-27T14:36:20.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f546c1ff700 1 --2- 172.21.15.115:0/3556869385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5450004690 0x7f5450004b10 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f546c1ff700 1 -- 172.21.15.115:0/3556869385 >> 172.21.15.115:0/3556869385 conn(0x7f5464062320 msgr2=0x7f5464062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:20.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.581+0000 7f546c1ff700 1 -- 172.21.15.115:0/3556869385 shutdown_connections 2023-07-27T14:36:20.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.582+0000 7f546c1ff700 1 -- 172.21.15.115:0/3556869385 wait complete. 2023-07-27T14:36:20.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.583+0000 7f546c1ff700 1 Processor -- start 2023-07-27T14:36:20.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.583+0000 7f546c1ff700 1 -- start start 2023-07-27T14:36:20.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546c1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450004690 0x7f546414c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546c1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5464151730 0x7f5464151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546c1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54640a7b90 0x7f54640a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546c1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640bf4c0 con 0x7f5464151730 2023-07-27T14:36:20.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546c1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54641520a0 con 0x7f5450004690 2023-07-27T14:36:20.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546c1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5464160770 con 0x7f54640a7b90 2023-07-27T14:36:20.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546979a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5464151730 0x7f5464151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546979a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5464151730 0x7f5464151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57452/0 (socket says 172.21.15.115:57452) 2023-07-27T14:36:20.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546979a700 1 -- 172.21.15.115:0/2415796166 learned_addr learned my addr 172.21.15.115:0/2415796166 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:20.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f546a79c700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54640a7b90 0x7f54640a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.584+0000 7f5469f9b700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450004690 0x7f546414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f546979a700 1 -- 172.21.15.115:0/2415796166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54640a7b90 msgr2=0x7f54640a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f546979a700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54640a7b90 0x7f54640a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f546979a700 1 -- 172.21.15.115:0/2415796166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450004690 msgr2=0x7f546414c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f546979a700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450004690 0x7f546414c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f546979a700 1 -- 172.21.15.115:0/2415796166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54640a84e0 con 0x7f5464151730 2023-07-27T14:36:20.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f546979a700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5464151730 0x7f5464151bb0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f54500045c0 tx=0x7f5454015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:20.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f5459ffb700 1 -- 172.21.15.115:0/2415796166 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454000c90 con 0x7f5464151730 2023-07-27T14:36:20.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f5459ffb700 1 -- 172.21.15.115:0/2415796166 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54540046b0 con 0x7f5464151730 2023-07-27T14:36:20.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5464152310 con 0x7f5464151730 2023-07-27T14:36:20.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f5459ffb700 1 -- 172.21.15.115:0/2415796166 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454004a50 con 0x7f5464151730 2023-07-27T14:36:20.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.585+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54641528d0 con 0x7f5464151730 2023-07-27T14:36:20.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.586+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54640bf670 con 0x7f5464151730 2023-07-27T14:36:20.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.587+0000 7f5459ffb700 1 -- 172.21.15.115:0/2415796166 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f545401d070 con 0x7f5464151730 2023-07-27T14:36:20.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.588+0000 7f5459ffb700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544805f880 0x7f5448061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:20.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.588+0000 7f5459ffb700 1 -- 172.21.15.115:0/2415796166 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f545407b170 con 0x7f5464151730 2023-07-27T14:36:20.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.588+0000 7f5469f9b700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544805f880 0x7f5448061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:20.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.589+0000 7f5469f9b700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544805f880 0x7f5448061d40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f546406ad00 tx=0x7f5460009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:20.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.592+0000 7f5459ffb700 1 -- 172.21.15.115:0/2415796166 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54640bf670 con 0x7f5464151730 2023-07-27T14:36:20.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.802+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54640bf670 con 0x7f5464151730 2023-07-27T14:36:20.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.802+0000 7f5459ffb700 1 -- 172.21.15.115:0/2415796166 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f54640bf670 con 0x7f5464151730 2023-07-27T14:36:20.850 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:20.850 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/231954123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":231954123},{"type":"v1","addr":"172.21.15.159:6834","nonce":231954123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7432,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3337360418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3337360418},{"type":"v1","addr":"172.21.15.159:6835","nonce":3337360418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/2630769428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2630769428},{"type":"v1","addr":"172.21.15.115:6836","nonce":2630769428}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":8670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2143166168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":2143166168},{"type":"v1","addr":"172.21.15.115:6837","nonce":2143166168}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[]} 2023-07-27T14:36:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.804+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544805f880 msgr2=0x7f5448061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.804+0000 7f546c1ff700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544805f880 0x7f5448061d40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f546406ad00 tx=0x7f5460009060).stop 2023-07-27T14:36:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.804+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5464151730 msgr2=0x7f5464151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.804+0000 7f546c1ff700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5464151730 0x7f5464151bb0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f54500045c0 tx=0x7f5454015000).stop 2023-07-27T14:36:20.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.804+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 shutdown_connections 2023-07-27T14:36:20.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.805+0000 7f546c1ff700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544805f880 0x7f5448061d40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.805+0000 7f546c1ff700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54640a7b90 0x7f54640a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.805+0000 7f546c1ff700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5450004690 0x7f546414c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.805+0000 7f546c1ff700 1 --2- 172.21.15.115:0/2415796166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5464151730 0x7f5464151bb0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:20.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.805+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 >> 172.21.15.115:0/2415796166 conn(0x7f5464062320 msgr2=0x7f54640ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:20.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.805+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 shutdown_connections 2023-07-27T14:36:20.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:20.805+0000 7f546c1ff700 1 -- 172.21.15.115:0/2415796166 wait complete. 2023-07-27T14:36:20.854 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 79 2023-07-27T14:36:20.869 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:36:20.869 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:36:20.870 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:36:20.870 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:36:20.870 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:36:20.870 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:36:20.870 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:36:20.871 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:36:20.871 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:36:20.871 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:36:20.871 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:36:20.872 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:36:20.872 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:36:20.872 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:36:20.872 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:36:20.872 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:36:20.883 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:36:20.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:36:20.884 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:36:20.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:36:20.889 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:36:20.889 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:36:20.890 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:36:20.890 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:36:20.929 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:36:20.929 DEBUG:teuthology.parallel:result is None 2023-07-27T14:36:20.932 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:36:20.933 DEBUG:teuthology.parallel:result is None 2023-07-27T14:36:20.934 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:36:20.935 DEBUG:teuthology.parallel:result is None 2023-07-27T14:36:20.938 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:36:20.938 DEBUG:teuthology.parallel:result is None 2023-07-27T14:36:20.939 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:36:21.072 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:36:21.073 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:36:21.087 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:36:21.088 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:36:21.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.098+0000 7f4b599ff700 1 Processor -- start 2023-07-27T14:36:21.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.098+0000 7f4b599ff700 1 -- start start 2023-07-27T14:36:21.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b599ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4b54153ec0 0x7f4b540a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:21.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b599ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540aa050 0x7f4b540640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:21.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b599ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b540aa4d0 con 0x7f4b540aaa40 2023-07-27T14:36:21.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b599ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b540c05c0 con 0x7f4b54153ec0 2023-07-27T14:36:21.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b599ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540c1a60 con 0x7f4b540aa050 2023-07-27T14:36:21.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b52ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4b54153ec0 0x7f4b540a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:21.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540aa050 0x7f4b540640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:21.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b52ffd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4b54153ec0 0x7f4b540a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:44504/0 (socket says 172.21.15.115:44504) 2023-07-27T14:36:21.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b52ffd700 1 -- 172.21.15.115:0/3469295551 learned_addr learned my addr 172.21.15.115:0/3469295551 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:21.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540aa050 0x7f4b540640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:34206/0 (socket says 172.21.15.115:34206) 2023-07-27T14:36:21.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.100+0000 7f4b537fe700 1 --1- 172.21.15.115:0/3469295551 >> v1:172.21.15.159:6789/0 conn(0x7f4b540aaa40 0x7f4b54157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:40668/0 (socket says 172.21.15.115:40668) 2023-07-27T14:36:21.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b52ffd700 1 -- 172.21.15.115:0/3469295551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540aa050 msgr2=0x7f4b540640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:21.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b52ffd700 1 --2- 172.21.15.115:0/3469295551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540aa050 0x7f4b540640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:21.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b52ffd700 1 -- 172.21.15.115:0/3469295551 >> v1:172.21.15.159:6789/0 conn(0x7f4b540aaa40 legacy=0x7f4b54157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:21.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b527fc700 1 -- 172.21.15.115:0/3469295551 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128104745 0 0) 0x7f4b4c001490 con 0x7f4b540aaa40 2023-07-27T14:36:21.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b52ffd700 1 -- 172.21.15.115:0/3469295551 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b540bfc90 con 0x7f4b54153ec0 2023-07-27T14:36:21.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b4bfff700 1 --2- 172.21.15.115:0/3469295551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540aa050 0x7f4b540640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:21.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b52ffd700 1 --2- 172.21.15.115:0/3469295551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b54153ec0 0x7f4b540a9b60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f4b44006fd0 tx=0x7f4b440090f0).ready entity=mon.1 client_cookie=1efc992cb766af72 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:21.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b527fc700 1 -- 172.21.15.115:0/3469295551 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400b580 con 0x7f4b54153ec0 2023-07-27T14:36:21.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b527fc700 1 -- 172.21.15.115:0/3469295551 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400b6e0 con 0x7f4b54153ec0 2023-07-27T14:36:21.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.101+0000 7f4b527fc700 1 -- 172.21.15.115:0/3469295551 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400ba60 con 0x7f4b54153ec0 2023-07-27T14:36:21.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.102+0000 7f4b599ff700 1 -- 172.21.15.115:0/3469295551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b54153ec0 msgr2=0x7f4b540a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:21.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.102+0000 7f4b599ff700 1 --2- 172.21.15.115:0/3469295551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b54153ec0 0x7f4b540a9b60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f4b44006fd0 tx=0x7f4b440090f0).stop 2023-07-27T14:36:21.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.102+0000 7f4b599ff700 1 -- 172.21.15.115:0/3469295551 shutdown_connections 2023-07-27T14:36:21.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.102+0000 7f4b599ff700 1 --2- 172.21.15.115:0/3469295551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b54153ec0 0x7f4b540a9b60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:21.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.102+0000 7f4b599ff700 1 --2- 172.21.15.115:0/3469295551 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540aa050 0x7f4b540640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:21.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.102+0000 7f4b599ff700 1 -- 172.21.15.115:0/3469295551 >> 172.21.15.115:0/3469295551 conn(0x7f4b540cb610 msgr2=0x7f4b540c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:21.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.102+0000 7f4b599ff700 1 -- 172.21.15.115:0/3469295551 shutdown_connections 2023-07-27T14:36:21.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.102+0000 7f4b599ff700 1 -- 172.21.15.115:0/3469295551 wait complete. 2023-07-27T14:36:21.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.103+0000 7f4b599ff700 1 Processor -- start 2023-07-27T14:36:21.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.103+0000 7f4b599ff700 1 -- start start 2023-07-27T14:36:21.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.104+0000 7f4b599ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b540aa050 0x7f4b54150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:21.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.104+0000 7f4b599ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b540aaa40 0x7f4b54141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:21.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.104+0000 7f4b599ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b54153ec0 0x7f4b54150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:21.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.104+0000 7f4b599ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541537b0 con 0x7f4b540aa050 2023-07-27T14:36:21.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.104+0000 7f4b599ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541534d0 con 0x7f4b540aaa40 2023-07-27T14:36:21.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.104+0000 7f4b599ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54151c20 con 0x7f4b54153ec0 2023-07-27T14:36:21.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.104+0000 7f4b52ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b540aa050 0x7f4b54150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:21.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b52ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b540aa050 0x7f4b54150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57496/0 (socket says 172.21.15.115:57496) 2023-07-27T14:36:21.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b52ffd700 1 -- 172.21.15.115:0/4025023706 learned_addr learned my addr 172.21.15.115:0/4025023706 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:21.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b537fe700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b54153ec0 0x7f4b54150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:21.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b4bfff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b540aaa40 0x7f4b54141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:21.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b52ffd700 1 -- 172.21.15.115:0/4025023706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b54153ec0 msgr2=0x7f4b54150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:21.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b52ffd700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b54153ec0 0x7f4b54150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:21.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b52ffd700 1 -- 172.21.15.115:0/4025023706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b540aaa40 msgr2=0x7f4b54141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:21.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b52ffd700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b540aaa40 0x7f4b54141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:21.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b52ffd700 1 -- 172.21.15.115:0/4025023706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0092a0 con 0x7f4b540aa050 2023-07-27T14:36:21.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b52ffd700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b540aa050 0x7f4b54150700 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f4b44006df0 tx=0x7f4b44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:21.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b4affd700 1 -- 172.21.15.115:0/4025023706 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44000bc0 con 0x7f4b540aa050 2023-07-27T14:36:21.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b4affd700 1 -- 172.21.15.115:0/4025023706 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400b850 con 0x7f4b540aa050 2023-07-27T14:36:21.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.105+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b44009370 con 0x7f4b540aa050 2023-07-27T14:36:21.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.106+0000 7f4b4affd700 1 -- 172.21.15.115:0/4025023706 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44000d20 con 0x7f4b540aa050 2023-07-27T14:36:21.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.106+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b541521e0 con 0x7f4b540aa050 2023-07-27T14:36:21.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.106+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54152550 con 0x7f4b540aa050 2023-07-27T14:36:21.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.107+0000 7f4b4affd700 1 -- 172.21.15.115:0/4025023706 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f4b4402b070 con 0x7f4b540aa050 2023-07-27T14:36:21.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.108+0000 7f4b4affd700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3405f850 0x7f4b34061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:21.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.108+0000 7f4b4affd700 1 -- 172.21.15.115:0/4025023706 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4b4407be10 con 0x7f4b540aa050 2023-07-27T14:36:21.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.108+0000 7f4b4bfff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3405f850 0x7f4b34061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:21.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.109+0000 7f4b4bfff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3405f850 0x7f4b34061d10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f4b541556e0 tx=0x7f4b3c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:21.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.112+0000 7f4b4affd700 1 -- 172.21.15.115:0/4025023706 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b4407f030 con 0x7f4b540aa050 2023-07-27T14:36:21.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:21.294+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4b5406c470 con 0x7f4b540aa050 2023-07-27T14:36:22.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.071+0000 7f4b4affd700 1 -- 172.21.15.115:0/4025023706 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v154) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4b4401f070 con 0x7f4b540aa050 2023-07-27T14:36:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3405f850 msgr2=0x7f4b34061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3405f850 0x7f4b34061d10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f4b541556e0 tx=0x7f4b3c009060).stop 2023-07-27T14:36:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b540aa050 msgr2=0x7f4b54150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b540aa050 0x7f4b54150700 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f4b44006df0 tx=0x7f4b44017000).stop 2023-07-27T14:36:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 shutdown_connections 2023-07-27T14:36:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3405f850 0x7f4b34061d10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b54153ec0 0x7f4b54150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b540aa050 0x7f4b54150700 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 --2- 172.21.15.115:0/4025023706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b540aaa40 0x7f4b54141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 >> 172.21.15.115:0/4025023706 conn(0x7f4b540cb610 msgr2=0x7f4b540ab410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 shutdown_connections 2023-07-27T14:36:22.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.074+0000 7f4b599ff700 1 -- 172.21.15.115:0/4025023706 wait complete. 2023-07-27T14:36:22.123 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:36:22.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:36:22.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.284+0000 7f78cdfff700 1 Processor -- start 2023-07-27T14:36:22.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.284+0000 7f78cdfff700 1 -- start start 2023-07-27T14:36:22.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.285+0000 7f78cdfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f78c80a4840 0x7f78c80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.285+0000 7f78cdfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f78c80bc050 0x7f78c80bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.285+0000 7f78cdfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c80639d0 con 0x7f78c8151bd0 2023-07-27T14:36:22.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.285+0000 7f78cdfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c8137610 con 0x7f78c80bc050 2023-07-27T14:36:22.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.285+0000 7f78cdfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c80a51b0 con 0x7f78c80a4840 2023-07-27T14:36:22.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f78c8151bd0 0x7f78c8062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59452/0 (socket says 172.21.15.115:59452) 2023-07-27T14:36:22.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c77fe700 1 -- 172.21.15.115:0/4078622521 learned_addr learned my addr 172.21.15.115:0/4078622521 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:22.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c7fff700 1 --2- 172.21.15.115:0/4078622521 >> v2:172.21.15.115:3300/0 conn(0x7f78c80bc050 0x7f78c80bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c6ffd700 1 --2- 172.21.15.115:0/4078622521 >> v2:172.21.15.159:3300/0 conn(0x7f78c80a4840 0x7f78c80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c67fc700 1 -- 172.21.15.115:0/4078622521 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602510448 0 0) 0x7f78c80639d0 con 0x7f78c8151bd0 2023-07-27T14:36:22.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c7fff700 1 -- 172.21.15.115:0/4078622521 >> v2:172.21.15.159:3300/0 conn(0x7f78c80a4840 msgr2=0x7f78c80a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:22.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c7fff700 1 --2- 172.21.15.115:0/4078622521 >> v2:172.21.15.159:3300/0 conn(0x7f78c80a4840 0x7f78c80a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c7fff700 1 -- 172.21.15.115:0/4078622521 >> v1:172.21.15.115:6789/0 conn(0x7f78c8151bd0 legacy=0x7f78c8062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c7fff700 1 -- 172.21.15.115:0/4078622521 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8062dc0 con 0x7f78c80bc050 2023-07-27T14:36:22.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.286+0000 7f78c7fff700 1 --2- 172.21.15.115:0/4078622521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80bc050 0x7f78c80bc4e0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f78c80be140 tx=0x7f78c0009780).ready entity=mon.0 client_cookie=3b1452b5fa33ca82 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:22.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78c67fc700 1 -- 172.21.15.115:0/4078622521 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c000e070 con 0x7f78c80bc050 2023-07-27T14:36:22.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78c67fc700 1 -- 172.21.15.115:0/4078622521 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c000bb60 con 0x7f78c80bc050 2023-07-27T14:36:22.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78c67fc700 1 -- 172.21.15.115:0/4078622521 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0012410 con 0x7f78c80bc050 2023-07-27T14:36:22.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78cdfff700 1 -- 172.21.15.115:0/4078622521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80bc050 msgr2=0x7f78c80bc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78cdfff700 1 --2- 172.21.15.115:0/4078622521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80bc050 0x7f78c80bc4e0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f78c80be140 tx=0x7f78c0009780).stop 2023-07-27T14:36:22.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78cdfff700 1 -- 172.21.15.115:0/4078622521 shutdown_connections 2023-07-27T14:36:22.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78cdfff700 1 --2- 172.21.15.115:0/4078622521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80bc050 0x7f78c80bc4e0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78cdfff700 1 --2- 172.21.15.115:0/4078622521 >> v2:172.21.15.159:3300/0 conn(0x7f78c80a4840 0x7f78c80a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78cdfff700 1 -- 172.21.15.115:0/4078622521 >> 172.21.15.115:0/4078622521 conn(0x7f78c8064700 msgr2=0x7f78c8064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:22.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78cdfff700 1 -- 172.21.15.115:0/4078622521 shutdown_connections 2023-07-27T14:36:22.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.287+0000 7f78cdfff700 1 -- 172.21.15.115:0/4078622521 wait complete. 2023-07-27T14:36:22.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.289+0000 7f78cdfff700 1 Processor -- start 2023-07-27T14:36:22.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.289+0000 7f78cdfff700 1 -- start start 2023-07-27T14:36:22.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78cdfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80a4840 0x7f78c813d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78cdfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78c80bc050 0x7f78c8137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78cdfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78c8151bd0 0x7f78c8138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78cdfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c813dc00 con 0x7f78c80a4840 2023-07-27T14:36:22.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78cdfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8137c50 con 0x7f78c8151bd0 2023-07-27T14:36:22.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78cdfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8137ed0 con 0x7f78c80bc050 2023-07-27T14:36:22.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78c77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80a4840 0x7f78c813d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78c77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80a4840 0x7f78c813d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57520/0 (socket says 172.21.15.115:57520) 2023-07-27T14:36:22.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78c77fe700 1 -- 172.21.15.115:0/2239977984 learned_addr learned my addr 172.21.15.115:0/2239977984 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:22.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78c7fff700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78c8151bd0 0x7f78c8138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.290+0000 7f78c6ffd700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78c80bc050 0x7f78c8137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78c77fe700 1 -- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78c80bc050 msgr2=0x7f78c8137760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78c77fe700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78c80bc050 0x7f78c8137760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78c77fe700 1 -- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78c8151bd0 msgr2=0x7f78c8138f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78c77fe700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78c8151bd0 0x7f78c8138f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78c77fe700 1 -- 172.21.15.115:0/2239977984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0009a20 con 0x7f78c80a4840 2023-07-27T14:36:22.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78c7fff700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78c8151bd0 0x7f78c8138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:22.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78c77fe700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80a4840 0x7f78c813d710 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f78b800c4e0 tx=0x7f78b8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:22.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78af7fe700 1 -- 172.21.15.115:0/2239977984 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80072e0 con 0x7f78c80a4840 2023-07-27T14:36:22.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78af7fe700 1 -- 172.21.15.115:0/2239977984 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b8007440 con 0x7f78c80a4840 2023-07-27T14:36:22.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c81381b0 con 0x7f78c80a4840 2023-07-27T14:36:22.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78af7fe700 1 -- 172.21.15.115:0/2239977984 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80057a0 con 0x7f78c80a4840 2023-07-27T14:36:22.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.291+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c8138a50 con 0x7f78c80a4840 2023-07-27T14:36:22.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.292+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c81383a0 con 0x7f78c80a4840 2023-07-27T14:36:22.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.293+0000 7f78af7fe700 1 -- 172.21.15.115:0/2239977984 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f78b8010070 con 0x7f78c80a4840 2023-07-27T14:36:22.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.294+0000 7f78af7fe700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78b405f880 0x7f78b4061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.294+0000 7f78af7fe700 1 -- 172.21.15.115:0/2239977984 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f78b8079d50 con 0x7f78c80a4840 2023-07-27T14:36:22.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.294+0000 7f78c6ffd700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78b405f880 0x7f78b4061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.294+0000 7f78c6ffd700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78b405f880 0x7f78b4061d40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f78c806a3d0 tx=0x7f78bc009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:22.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.298+0000 7f78af7fe700 1 -- 172.21.15.115:0/2239977984 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78b804ae20 con 0x7f78c80a4840 2023-07-27T14:36:22.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.527+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f78c81385a0 con 0x7f78c80a4840 2023-07-27T14:36:22.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.528+0000 7f78af7fe700 1 -- 172.21.15.115:0/2239977984 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f78b804e440 con 0x7f78c80a4840 2023-07-27T14:36:22.576 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:22.576 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:36:22.576 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:36:22.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.576 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:36:22.576 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:36:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:36:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:36:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:36:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:36:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:36:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:36:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:36:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:36:22.578 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.579 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.579 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:36:22.579 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:36:22.579 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.579 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:36:22.579 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:36:22.580 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:36:22.580 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.580 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:36:22.580 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:36:22.581 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.581 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:36:22.581 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:36:22.581 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:36:22.581 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.582 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:36:22.582 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:36:22.582 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.582 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:36:22.582 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:36:22.582 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.583 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:36:22.583 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:36:22.583 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.583 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:36:22.583 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:36:22.583 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.583 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:36:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:36:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:36:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:36:22.585 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.585 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:36:22.585 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:36:22.585 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.586 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:36:22.586 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:36:22.586 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.586 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:36:22.586 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:36:22.587 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.587 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:36:22.587 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:36:22.587 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.587 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.587 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:36:22.588 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:36:22.588 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.588 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:36:22.588 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:36:22.588 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.588 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.589 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:36:22.589 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:36:22.589 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.589 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:36:22.589 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:36:22.589 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.589 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.590 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:36:22.590 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:36:22.590 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.590 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:36:22.590 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:36:22.590 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.591 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:36:22.591 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:36:22.591 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.591 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:36:22.591 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:36:22.591 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:36:22.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.592 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:36:22.592 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:36:22.592 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.592 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:36:22.593 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:36:22.593 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:36:22.593 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:36:22.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.593 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:36:22.593 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:36:22.594 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.594 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:36:22.594 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:36:22.594 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:36:22.594 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:36:22.594 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.595 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:36:22.595 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:36:22.595 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.595 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:36:22.595 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:36:22.595 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:36:22.595 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:36:22.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.596 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:36:22.596 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:36:22.596 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.596 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:36:22.596 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:36:22.596 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:36:22.597 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.597 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.597 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:36:22.597 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:36:22.597 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.597 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:36:22.598 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:36:22.598 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.598 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:22.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:22.598 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:36:22.598 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:36:22.598 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:36:22.599 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:36:22.599 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:36:22.599 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:36:22.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:22.599 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:36:22.599 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:36:22.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78b405f880 msgr2=0x7f78b4061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78b405f880 0x7f78b4061d40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f78c806a3d0 tx=0x7f78bc009060).stop 2023-07-27T14:36:22.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80a4840 msgr2=0x7f78c813d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80a4840 0x7f78c813d710 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f78b800c4e0 tx=0x7f78b8007c70).stop 2023-07-27T14:36:22.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 shutdown_connections 2023-07-27T14:36:22.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f78b405f880 0x7f78b4061d40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78c8151bd0 0x7f78c8138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78c80a4840 0x7f78c813d710 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 --2- 172.21.15.115:0/2239977984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78c80bc050 0x7f78c8137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 >> 172.21.15.115:0/2239977984 conn(0x7f78c8064700 msgr2=0x7f78c8153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:22.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 shutdown_connections 2023-07-27T14:36:22.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.530+0000 7f78cdfff700 1 -- 172.21.15.115:0/2239977984 wait complete. 2023-07-27T14:36:22.603 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:36:22.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.744+0000 7f3f6d1ff700 1 Processor -- start 2023-07-27T14:36:22.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.744+0000 7f3f6d1ff700 1 -- start start 2023-07-27T14:36:22.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.745+0000 7f3f6d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f68153ec0 0x7f3f680a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.745+0000 7f3f6d1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680aa4d0 con 0x7f3f680aa050 2023-07-27T14:36:22.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.745+0000 7f3f6d1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680c05c0 con 0x7f3f680aaa40 2023-07-27T14:36:22.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.745+0000 7f3f6d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680bfc90 con 0x7f3f68153ec0 2023-07-27T14:36:22.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.745+0000 7f3f6659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3f680aa050 0x7f3f680640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59464/0 (socket says 172.21.15.115:59464) 2023-07-27T14:36:22.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.745+0000 7f3f6659c700 1 -- 172.21.15.115:0/2688883103 learned_addr learned my addr 172.21.15.115:0/2688883103 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:22.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f66d9d700 1 --2- 172.21.15.115:0/2688883103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f68153ec0 0x7f3f680a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f65d9b700 1 -- 172.21.15.115:0/2688883103 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368237653 0 0) 0x7f3f5c001110 con 0x7f3f680aa050 2023-07-27T14:36:22.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f65d9b700 1 -- 172.21.15.115:0/2688883103 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f500033f0 con 0x7f3f680aa050 2023-07-27T14:36:22.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f65d9b700 1 -- 172.21.15.115:0/2688883103 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893688475 0 0) 0x7f3f680c05c0 con 0x7f3f680aaa40 2023-07-27T14:36:22.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f65d9b700 1 -- 172.21.15.115:0/2688883103 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c001110 con 0x7f3f680aaa40 2023-07-27T14:36:22.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f65d9b700 1 -- 172.21.15.115:0/2688883103 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810883646 0 0) 0x7f3f500033f0 con 0x7f3f680aa050 2023-07-27T14:36:22.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f66d9d700 1 -- 172.21.15.115:0/2688883103 >> v1:172.21.15.159:6789/0 conn(0x7f3f680aaa40 legacy=0x7f3f680c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f66d9d700 1 -- 172.21.15.115:0/2688883103 >> v1:172.21.15.115:6789/0 conn(0x7f3f680aa050 legacy=0x7f3f680640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f66d9d700 1 -- 172.21.15.115:0/2688883103 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680bff70 con 0x7f3f68153ec0 2023-07-27T14:36:22.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.746+0000 7f3f66d9d700 1 --2- 172.21.15.115:0/2688883103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f68153ec0 0x7f3f680a9b60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3f58009790 tx=0x7f3f58009060).ready entity=mon.2 client_cookie=bc01f4a8d8c601e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:22.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f65d9b700 1 -- 172.21.15.115:0/2688883103 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c001600 con 0x7f3f68153ec0 2023-07-27T14:36:22.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f65d9b700 1 -- 172.21.15.115:0/2688883103 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58011400 con 0x7f3f68153ec0 2023-07-27T14:36:22.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f65d9b700 1 -- 172.21.15.115:0/2688883103 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011780 con 0x7f3f68153ec0 2023-07-27T14:36:22.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/2688883103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f68153ec0 msgr2=0x7f3f680a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f6d1ff700 1 --2- 172.21.15.115:0/2688883103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f68153ec0 0x7f3f680a9b60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3f58009790 tx=0x7f3f58009060).stop 2023-07-27T14:36:22.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/2688883103 shutdown_connections 2023-07-27T14:36:22.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f6d1ff700 1 --2- 172.21.15.115:0/2688883103 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f68153ec0 0x7f3f680a9b60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/2688883103 >> 172.21.15.115:0/2688883103 conn(0x7f3f680cb610 msgr2=0x7f3f680c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:22.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/2688883103 shutdown_connections 2023-07-27T14:36:22.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.747+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/2688883103 wait complete. 2023-07-27T14:36:22.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.749+0000 7f3f6d1ff700 1 Processor -- start 2023-07-27T14:36:22.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.749+0000 7f3f6d1ff700 1 -- start start 2023-07-27T14:36:22.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f680aa050 0x7f3f6814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6d1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f680aaa40 0x7f3f681509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6d1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f68153ec0 0x7f3f68150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6d1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f681513b0 con 0x7f3f680aaa40 2023-07-27T14:36:22.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6d1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680af7d0 con 0x7f3f68153ec0 2023-07-27T14:36:22.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680aebc0 con 0x7f3f680aa050 2023-07-27T14:36:22.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f680aaa40 0x7f3f681509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f680aaa40 0x7f3f681509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57530/0 (socket says 172.21.15.115:57530) 2023-07-27T14:36:22.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.750+0000 7f3f6659c700 1 -- 172.21.15.115:0/1784650174 learned_addr learned my addr 172.21.15.115:0/1784650174 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:22.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f66d9d700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f680aa050 0x7f3f6814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6759e700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f68153ec0 0x7f3f68150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6659c700 1 -- 172.21.15.115:0/1784650174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f680aa050 msgr2=0x7f3f6814c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6659c700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f680aa050 0x7f3f6814c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6659c700 1 -- 172.21.15.115:0/1784650174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f68153ec0 msgr2=0x7f3f68150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6659c700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f68153ec0 0x7f3f68150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6659c700 1 -- 172.21.15.115:0/1784650174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580092a0 con 0x7f3f680aaa40 2023-07-27T14:36:22.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6659c700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f680aaa40 0x7f3f681509d0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f3f68083010 tx=0x7f3f5c0016f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:22.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f4effd700 1 -- 172.21.15.115:0/1784650174 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00ce40 con 0x7f3f680aaa40 2023-07-27T14:36:22.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f4effd700 1 -- 172.21.15.115:0/1784650174 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c007320 con 0x7f3f680aaa40 2023-07-27T14:36:22.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f4effd700 1 -- 172.21.15.115:0/1784650174 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c005740 con 0x7f3f680aaa40 2023-07-27T14:36:22.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f680aeea0 con 0x7f3f680aaa40 2023-07-27T14:36:22.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.751+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f680af460 con 0x7f3f680aaa40 2023-07-27T14:36:22.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.752+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f680a9b60 con 0x7f3f680aaa40 2023-07-27T14:36:22.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.753+0000 7f3f4effd700 1 -- 172.21.15.115:0/1784650174 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f3f5c010030 con 0x7f3f680aaa40 2023-07-27T14:36:22.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.754+0000 7f3f4effd700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f5405f850 0x7f3f54061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:22.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.754+0000 7f3f4effd700 1 -- 172.21.15.115:0/1784650174 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3f5c07a330 con 0x7f3f680aaa40 2023-07-27T14:36:22.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.754+0000 7f3f66d9d700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f5405f850 0x7f3f54061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:22.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.755+0000 7f3f66d9d700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f5405f850 0x7f3f54061d10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f3f580096e0 tx=0x7f3f58016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:22.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.758+0000 7f3f4effd700 1 -- 172.21.15.115:0/1784650174 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f5c04b510 con 0x7f3f680aaa40 2023-07-27T14:36:22.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.932+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f6806c470 con 0x7f3f680aaa40 2023-07-27T14:36:22.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.933+0000 7f3f4effd700 1 -- 172.21.15.115:0/1784650174 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+13866 (secure 0 0 0) 0x7f3f5c04eb30 con 0x7f3f680aaa40 2023-07-27T14:36:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:22.981 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":154,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:36:22.066491+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:36:22.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f5405f850 msgr2=0x7f3f54061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f5405f850 0x7f3f54061d10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f3f580096e0 tx=0x7f3f58016000).stop 2023-07-27T14:36:22.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f680aaa40 msgr2=0x7f3f681509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:22.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f680aaa40 0x7f3f681509d0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f3f68083010 tx=0x7f3f5c0016f0).stop 2023-07-27T14:36:22.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 shutdown_connections 2023-07-27T14:36:22.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3f5405f850 0x7f3f54061d10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f68153ec0 0x7f3f68150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3f680aa050 0x7f3f6814c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 --2- 172.21.15.115:0/1784650174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f680aaa40 0x7f3f681509d0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:22.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 >> 172.21.15.115:0/1784650174 conn(0x7f3f680cb610 msgr2=0x7f3f680ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:22.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 shutdown_connections 2023-07-27T14:36:22.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:22.935+0000 7f3f6d1ff700 1 -- 172.21.15.115:0/1784650174 wait complete. 2023-07-27T14:36:23.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:36:23.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:36:23.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.142+0000 7f33963ff700 1 Processor -- start 2023-07-27T14:36:23.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.143+0000 7f33963ff700 1 -- start start 2023-07-27T14:36:23.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.144+0000 7f33963ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f33900c6b70 0x7f33900656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.144+0000 7f33963ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3390065bc0 0x7f3390062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.144+0000 7f33963ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3390066050 con 0x7f3390153e00 2023-07-27T14:36:23.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.144+0000 7f33963ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3390062320 con 0x7f3390065bc0 2023-07-27T14:36:23.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.144+0000 7f33963ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3390064a80 con 0x7f33900c6b70 2023-07-27T14:36:23.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.144+0000 7f339499c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3390065bc0 0x7f3390062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.144+0000 7f338ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3390153e00 0x7f3390064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59468/0 (socket says 172.21.15.115:59468) 2023-07-27T14:36:23.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.144+0000 7f338ffff700 1 -- 172.21.15.115:0/3899318772 learned_addr learned my addr 172.21.15.115:0/3899318772 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:23.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f338f7fe700 1 --2- 172.21.15.115:0/3899318772 >> v2:172.21.15.159:3300/0 conn(0x7f33900c6b70 0x7f33900656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f339499c700 1 -- 172.21.15.115:0/3899318772 >> v2:172.21.15.159:3300/0 conn(0x7f33900c6b70 msgr2=0x7f33900656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:23.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f339499c700 1 --2- 172.21.15.115:0/3899318772 >> v2:172.21.15.159:3300/0 conn(0x7f33900c6b70 0x7f33900656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f339499c700 1 -- 172.21.15.115:0/3899318772 >> v1:172.21.15.115:6789/0 conn(0x7f3390153e00 legacy=0x7f3390064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f339499c700 1 -- 172.21.15.115:0/3899318772 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390064d60 con 0x7f3390065bc0 2023-07-27T14:36:23.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f338f7fe700 1 --2- 172.21.15.115:0/3899318772 >> v2:172.21.15.159:3300/0 conn(0x7f33900c6b70 0x7f33900656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:23.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f339499c700 1 --2- 172.21.15.115:0/3899318772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390062770 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f33900c3b80 tx=0x7f3388009780).ready entity=mon.0 client_cookie=370506acf9df30be server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f338effd700 1 -- 172.21.15.115:0/3899318772 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800e070 con 0x7f3390065bc0 2023-07-27T14:36:23.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f338effd700 1 -- 172.21.15.115:0/3899318772 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800bc30 con 0x7f3390065bc0 2023-07-27T14:36:23.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.145+0000 7f338effd700 1 -- 172.21.15.115:0/3899318772 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388012410 con 0x7f3390065bc0 2023-07-27T14:36:23.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.146+0000 7f33963ff700 1 -- 172.21.15.115:0/3899318772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 msgr2=0x7f3390062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.146+0000 7f33963ff700 1 --2- 172.21.15.115:0/3899318772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390062770 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f33900c3b80 tx=0x7f3388009780).stop 2023-07-27T14:36:23.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.146+0000 7f33963ff700 1 -- 172.21.15.115:0/3899318772 shutdown_connections 2023-07-27T14:36:23.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.146+0000 7f33963ff700 1 --2- 172.21.15.115:0/3899318772 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390062770 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.146+0000 7f33963ff700 1 --2- 172.21.15.115:0/3899318772 >> v2:172.21.15.159:3300/0 conn(0x7f33900c6b70 0x7f33900656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.146+0000 7f33963ff700 1 -- 172.21.15.115:0/3899318772 >> 172.21.15.115:0/3899318772 conn(0x7f33900c7b90 msgr2=0x7f33900c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:23.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.146+0000 7f33963ff700 1 -- 172.21.15.115:0/3899318772 shutdown_connections 2023-07-27T14:36:23.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.146+0000 7f33963ff700 1 -- 172.21.15.115:0/3899318772 wait complete. 2023-07-27T14:36:23.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.148+0000 7f33963ff700 1 Processor -- start 2023-07-27T14:36:23.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.148+0000 7f33963ff700 1 -- start start 2023-07-27T14:36:23.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.149+0000 7f33963ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.149+0000 7f33963ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33900c6b70 0x7f33900a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.149+0000 7f33963ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3390153e00 0x7f33900a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.149+0000 7f33963ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33900a4920 con 0x7f3390065bc0 2023-07-27T14:36:23.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f33963ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3390092610 con 0x7f3390153e00 2023-07-27T14:36:23.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f33963ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900a8800 con 0x7f33900c6b70 2023-07-27T14:36:23.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57556/0 (socket says 172.21.15.115:57556) 2023-07-27T14:36:23.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 -- 172.21.15.115:0/2224320655 learned_addr learned my addr 172.21.15.115:0/2224320655 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:23.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f339499c700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3390153e00 0x7f33900a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338f7fe700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33900c6b70 0x7f33900a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 -- 172.21.15.115:0/2224320655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33900c6b70 msgr2=0x7f33900a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33900c6b70 0x7f33900a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 -- 172.21.15.115:0/2224320655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3390153e00 msgr2=0x7f33900a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3390153e00 0x7f33900a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 -- 172.21.15.115:0/2224320655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388009a20 con 0x7f3390065bc0 2023-07-27T14:36:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.150+0000 7f338ffff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390152100 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f3380001eb0 tx=0x7f3380007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.151+0000 7f3377fff700 1 -- 172.21.15.115:0/2224320655 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800072e0 con 0x7f3390065bc0 2023-07-27T14:36:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.151+0000 7f3377fff700 1 -- 172.21.15.115:0/2224320655 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380007440 con 0x7f3390065bc0 2023-07-27T14:36:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.151+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33900c0770 con 0x7f3390065bc0 2023-07-27T14:36:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.151+0000 7f3377fff700 1 -- 172.21.15.115:0/2224320655 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800057a0 con 0x7f3390065bc0 2023-07-27T14:36:23.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.151+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33900c0d30 con 0x7f3390065bc0 2023-07-27T14:36:23.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.152+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339006c470 con 0x7f3390065bc0 2023-07-27T14:36:23.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.152+0000 7f3377fff700 1 -- 172.21.15.115:0/2224320655 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f3380010070 con 0x7f3390065bc0 2023-07-27T14:36:23.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.153+0000 7f3377fff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f337c05f8b0 0x7f337c061d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.153+0000 7f3377fff700 1 -- 172.21.15.115:0/2224320655 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3380079b30 con 0x7f3390065bc0 2023-07-27T14:36:23.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.153+0000 7f338f7fe700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f337c05f8b0 0x7f337c061d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.154+0000 7f338f7fe700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f337c05f8b0 0x7f337c061d70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f33900c4070 tx=0x7f3384008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.157+0000 7f3377fff700 1 -- 172.21.15.115:0/2224320655 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f338004ad10 con 0x7f3390065bc0 2023-07-27T14:36:23.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.323+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f33900c0f50 con 0x7f3390065bc0 2023-07-27T14:36:23.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.324+0000 7f3377fff700 1 -- 172.21.15.115:0/2224320655 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v154) v1 ==== 110+0+10 (secure 0 0 0) 0x7f338004e330 con 0x7f3390065bc0 2023-07-27T14:36:23.372 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:36:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f337c05f8b0 msgr2=0x7f337c061d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f337c05f8b0 0x7f337c061d70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f33900c4070 tx=0x7f3384008040).stop 2023-07-27T14:36:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 msgr2=0x7f3390152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390152100 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f3380001eb0 tx=0x7f3380007e50).stop 2023-07-27T14:36:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 shutdown_connections 2023-07-27T14:36:23.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f337c05f8b0 0x7f337c061d70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3390153e00 0x7f33900a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3390065bc0 0x7f3390152100 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 --2- 172.21.15.115:0/2224320655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33900c6b70 0x7f33900a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 >> 172.21.15.115:0/2224320655 conn(0x7f33900c7b90 msgr2=0x7f33900c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 shutdown_connections 2023-07-27T14:36:23.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.326+0000 7f33963ff700 1 -- 172.21.15.115:0/2224320655 wait complete. 2023-07-27T14:36:23.391 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:36:23.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.535+0000 7f255d9ff700 1 Processor -- start 2023-07-27T14:36:23.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.535+0000 7f255d9ff700 1 -- start start 2023-07-27T14:36:23.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.536+0000 7f255d9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f255814ae00 0x7f2558154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.536+0000 7f255d9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f255814b1e0 0x7f2558062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.536+0000 7f255d9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25581553f0 con 0x7f25580c5c50 2023-07-27T14:36:23.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.536+0000 7f255d9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2558157a50 con 0x7f255814b1e0 2023-07-27T14:36:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.536+0000 7f255d9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2558157d10 con 0x7f255814ae00 2023-07-27T14:36:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f25567fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f255814b1e0 0x7f2558062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f25567fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f255814b1e0 0x7f2558062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49534/0 (socket says 172.21.15.115:49534) 2023-07-27T14:36:23.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f25567fc700 1 -- 172.21.15.115:0/454135382 learned_addr learned my addr 172.21.15.115:0/454135382 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f2556ffd700 1 --2- 172.21.15.115:0/454135382 >> v2:172.21.15.159:3300/0 conn(0x7f255814ae00 0x7f2558154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f25567fc700 1 -- 172.21.15.115:0/454135382 >> v2:172.21.15.159:3300/0 conn(0x7f255814ae00 msgr2=0x7f2558154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:23.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f25567fc700 1 --2- 172.21.15.115:0/454135382 >> v2:172.21.15.159:3300/0 conn(0x7f255814ae00 0x7f2558154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f25567fc700 1 -- 172.21.15.115:0/454135382 >> v1:172.21.15.159:6789/0 conn(0x7f25580c5c50 legacy=0x7f25580a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f25567fc700 1 -- 172.21.15.115:0/454135382 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558157ff0 con 0x7f255814b1e0 2023-07-27T14:36:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f2556ffd700 1 --2- 172.21.15.115:0/454135382 >> v2:172.21.15.159:3300/0 conn(0x7f255814ae00 0x7f2558154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.537+0000 7f25567fc700 1 --2- 172.21.15.115:0/454135382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814b1e0 0x7f2558062b50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f2558155580 tx=0x7f254c0090f0).ready entity=mon.0 client_cookie=ecd314fbf8c4c9e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f2555ffb700 1 -- 172.21.15.115:0/454135382 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00b600 con 0x7f255814b1e0 2023-07-27T14:36:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f2555ffb700 1 -- 172.21.15.115:0/454135382 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c00b760 con 0x7f255814b1e0 2023-07-27T14:36:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f2555ffb700 1 -- 172.21.15.115:0/454135382 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00bae0 con 0x7f255814b1e0 2023-07-27T14:36:23.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f255d9ff700 1 -- 172.21.15.115:0/454135382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814b1e0 msgr2=0x7f2558062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f255d9ff700 1 --2- 172.21.15.115:0/454135382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814b1e0 0x7f2558062b50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f2558155580 tx=0x7f254c0090f0).stop 2023-07-27T14:36:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f255d9ff700 1 -- 172.21.15.115:0/454135382 shutdown_connections 2023-07-27T14:36:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f255d9ff700 1 --2- 172.21.15.115:0/454135382 >> v2:172.21.15.159:3300/0 conn(0x7f255814ae00 0x7f2558154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f255d9ff700 1 --2- 172.21.15.115:0/454135382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814b1e0 0x7f2558062b50 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f255d9ff700 1 -- 172.21.15.115:0/454135382 >> 172.21.15.115:0/454135382 conn(0x7f255805e940 msgr2=0x7f25580cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f255d9ff700 1 -- 172.21.15.115:0/454135382 shutdown_connections 2023-07-27T14:36:23.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.538+0000 7f255d9ff700 1 -- 172.21.15.115:0/454135382 wait complete. 2023-07-27T14:36:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.540+0000 7f255d9ff700 1 Processor -- start 2023-07-27T14:36:23.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.540+0000 7f255d9ff700 1 -- start start 2023-07-27T14:36:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f255d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 0x7f25580c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f255d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f255813e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f255d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 0x7f25580b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f255d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580b0ce0 con 0x7f255814ae00 2023-07-27T14:36:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f255d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580c46c0 con 0x7f25580c5c50 2023-07-27T14:36:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f255d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580c3d90 con 0x7f255814b1e0 2023-07-27T14:36:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f25567fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f255813e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f25567fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f255813e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49548/0 (socket says 172.21.15.115:49548) 2023-07-27T14:36:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f25567fc700 1 -- 172.21.15.115:0/1117520375 learned_addr learned my addr 172.21.15.115:0/1117520375 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f2556ffd700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 0x7f25580c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f25577fe700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 0x7f25580b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f25567fc700 1 -- 172.21.15.115:0/1117520375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 msgr2=0x7f25580b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f25567fc700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 0x7f25580b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.541+0000 7f25567fc700 1 -- 172.21.15.115:0/1117520375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 msgr2=0x7f25580c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.542+0000 7f25567fc700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 0x7f25580c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.542+0000 7f25567fc700 1 -- 172.21.15.115:0/1117520375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c009370 con 0x7f255814ae00 2023-07-27T14:36:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.542+0000 7f25567fc700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f255813e780 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f25580caaf0 tx=0x7f254c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.542+0000 7f253effd700 1 -- 172.21.15.115:0/1117520375 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00bae0 con 0x7f255814ae00 2023-07-27T14:36:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.542+0000 7f253effd700 1 -- 172.21.15.115:0/1117520375 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c000cb0 con 0x7f255814ae00 2023-07-27T14:36:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.542+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25580c4070 con 0x7f255814ae00 2023-07-27T14:36:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.542+0000 7f253effd700 1 -- 172.21.15.115:0/1117520375 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c01b640 con 0x7f255814ae00 2023-07-27T14:36:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.542+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255813ec70 con 0x7f255814ae00 2023-07-27T14:36:23.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.543+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25580c3b60 con 0x7f255814ae00 2023-07-27T14:36:23.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.544+0000 7f253effd700 1 -- 172.21.15.115:0/1117520375 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f254c023030 con 0x7f255814ae00 2023-07-27T14:36:23.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.544+0000 7f253effd700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f254405f880 0x7f2544061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.545+0000 7f253effd700 1 -- 172.21.15.115:0/1117520375 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f254c07b450 con 0x7f255814ae00 2023-07-27T14:36:23.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.545+0000 7f2556ffd700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f254405f880 0x7f2544061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.545+0000 7f2556ffd700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f254405f880 0x7f2544061d40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f2548006fd0 tx=0x7f2548008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.549+0000 7f253effd700 1 -- 172.21.15.115:0/1117520375 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f254c04c520 con 0x7f255814ae00 2023-07-27T14:36:23.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.721+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f255806c470 con 0x7f255814ae00 2023-07-27T14:36:23.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.721+0000 7f253effd700 1 -- 172.21.15.115:0/1117520375 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v154) v1 ==== 92+0+10 (secure 0 0 0) 0x7f254c0210a0 con 0x7f255814ae00 2023-07-27T14:36:23.769 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:36:23.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f254405f880 msgr2=0x7f2544061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f254405f880 0x7f2544061d40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f2548006fd0 tx=0x7f2548008040).stop 2023-07-27T14:36:23.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 msgr2=0x7f255813e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f255813e780 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f25580caaf0 tx=0x7f254c017000).stop 2023-07-27T14:36:23.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 shutdown_connections 2023-07-27T14:36:23.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f254405f880 0x7f2544061d40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f255814b1e0 0x7f25580b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25580c5c50 0x7f25580c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 --2- 172.21.15.115:0/1117520375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f255814ae00 0x7f255813e780 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 >> 172.21.15.115:0/1117520375 conn(0x7f255805e940 msgr2=0x7f2558152f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:23.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 shutdown_connections 2023-07-27T14:36:23.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.724+0000 7f255d9ff700 1 -- 172.21.15.115:0/1117520375 wait complete. 2023-07-27T14:36:23.789 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:36:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.929+0000 7f1974dff700 1 Processor -- start 2023-07-27T14:36:23.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.929+0000 7f1974dff700 1 -- start start 2023-07-27T14:36:23.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f1974dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1970153ec0 0x7f19700a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f1974dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19700aa050 0x7f19700640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f1974dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f1974dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1970064ad0 con 0x7f19700aa050 2023-07-27T14:36:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f1974dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19700aa4d0 con 0x7f1970153ec0 2023-07-27T14:36:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f1974dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19700c05c0 con 0x7f19700aaa40 2023-07-27T14:36:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19700aa050 0x7f19700640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196dd9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19700aa050 0x7f19700640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49550/0 (socket says 172.21.15.115:49550) 2023-07-27T14:36:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196dd9b700 1 -- 172.21.15.115:0/390762250 learned_addr learned my addr 172.21.15.115:0/390762250 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196ed9d700 1 --2- 172.21.15.115:0/390762250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196e59c700 1 --2- 172.21.15.115:0/390762250 >> v2:172.21.15.159:3300/0 conn(0x7f1970153ec0 0x7f19700a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196dd9b700 1 -- 172.21.15.115:0/390762250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 msgr2=0x7f19700645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196dd9b700 1 --2- 172.21.15.115:0/390762250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196dd9b700 1 -- 172.21.15.115:0/390762250 >> v2:172.21.15.159:3300/0 conn(0x7f1970153ec0 msgr2=0x7f19700a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:23.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196dd9b700 1 --2- 172.21.15.115:0/390762250 >> v2:172.21.15.159:3300/0 conn(0x7f1970153ec0 0x7f19700a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196dd9b700 1 -- 172.21.15.115:0/390762250 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700bfc90 con 0x7f19700aa050 2023-07-27T14:36:23.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196e59c700 1 --2- 172.21.15.115:0/390762250 >> v2:172.21.15.159:3300/0 conn(0x7f1970153ec0 0x7f19700a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:23.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.931+0000 7f196ed9d700 1 --2- 172.21.15.115:0/390762250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:23.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f196dd9b700 1 --2- 172.21.15.115:0/390762250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aa050 0x7f19700640f0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f1970083e30 tx=0x7f19640090f0).ready entity=mon.0 client_cookie=7fac77a6291694d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f196d59a700 1 -- 172.21.15.115:0/390762250 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400b600 con 0x7f19700aa050 2023-07-27T14:36:23.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f196d59a700 1 -- 172.21.15.115:0/390762250 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196400b760 con 0x7f19700aa050 2023-07-27T14:36:23.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f196d59a700 1 -- 172.21.15.115:0/390762250 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400bae0 con 0x7f19700aa050 2023-07-27T14:36:23.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 -- 172.21.15.115:0/390762250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aa050 msgr2=0x7f19700640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 --2- 172.21.15.115:0/390762250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aa050 0x7f19700640f0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f1970083e30 tx=0x7f19640090f0).stop 2023-07-27T14:36:23.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 -- 172.21.15.115:0/390762250 shutdown_connections 2023-07-27T14:36:23.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 --2- 172.21.15.115:0/390762250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 --2- 172.21.15.115:0/390762250 >> v2:172.21.15.159:3300/0 conn(0x7f1970153ec0 0x7f19700a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 --2- 172.21.15.115:0/390762250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aa050 0x7f19700640f0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 -- 172.21.15.115:0/390762250 >> 172.21.15.115:0/390762250 conn(0x7f19700cb610 msgr2=0x7f19700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:23.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 -- 172.21.15.115:0/390762250 shutdown_connections 2023-07-27T14:36:23.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.932+0000 7f1974dff700 1 -- 172.21.15.115:0/390762250 wait complete. 2023-07-27T14:36:23.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.934+0000 7f1974dff700 1 Processor -- start 2023-07-27T14:36:23.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.934+0000 7f1974dff700 1 -- start start 2023-07-27T14:36:23.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f1974dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19700aa050 0x7f19701500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f1974dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f1974dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1970153ec0 0x7f19700c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f1974dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19700b0220 con 0x7f1970153ec0 2023-07-27T14:36:23.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f1974dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19700c3ce0 con 0x7f19700aa050 2023-07-27T14:36:23.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f1974dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197014c6f0 con 0x7f19700aaa40 2023-07-27T14:36:23.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f196ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1970153ec0 0x7f19700c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f196ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1970153ec0 0x7f19700c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49562/0 (socket says 172.21.15.115:49562) 2023-07-27T14:36:23.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f196ed9d700 1 -- 172.21.15.115:0/26753843 learned_addr learned my addr 172.21.15.115:0/26753843 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:23.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f196e59c700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19700aa050 0x7f19701500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.935+0000 7f196dd9b700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f196ed9d700 1 -- 172.21.15.115:0/26753843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 msgr2=0x7f19700c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f196ed9d700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f196ed9d700 1 -- 172.21.15.115:0/26753843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19700aa050 msgr2=0x7f19701500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:23.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f196ed9d700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19700aa050 0x7f19701500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:23.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f196ed9d700 1 -- 172.21.15.115:0/26753843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009370 con 0x7f1970153ec0 2023-07-27T14:36:23.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f196ed9d700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1970153ec0 0x7f19700c2f00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f196800cf90 tx=0x7f19680078a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f195e7fc700 1 -- 172.21.15.115:0/26753843 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968016470 con 0x7f1970153ec0 2023-07-27T14:36:23.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f195e7fc700 1 -- 172.21.15.115:0/26753843 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19680165d0 con 0x7f1970153ec0 2023-07-27T14:36:23.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19700c2600 con 0x7f1970153ec0 2023-07-27T14:36:23.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f195e7fc700 1 -- 172.21.15.115:0/26753843 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968016970 con 0x7f1970153ec0 2023-07-27T14:36:23.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.936+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19700afeb0 con 0x7f1970153ec0 2023-07-27T14:36:23.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.937+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19700afa30 con 0x7f1970153ec0 2023-07-27T14:36:23.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.938+0000 7f195e7fc700 1 -- 172.21.15.115:0/26753843 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f1968016d60 con 0x7f1970153ec0 2023-07-27T14:36:23.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.939+0000 7f195e7fc700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195005f880 0x7f1950061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:23.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.939+0000 7f195e7fc700 1 -- 172.21.15.115:0/26753843 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f196807b5f0 con 0x7f1970153ec0 2023-07-27T14:36:23.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.939+0000 7f196e59c700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195005f880 0x7f1950061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:23.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.940+0000 7f196e59c700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195005f880 0x7f1950061d40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f196000ab40 tx=0x7f1960008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:23.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:23.943+0000 7f195e7fc700 1 -- 172.21.15.115:0/26753843 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19700afa30 con 0x7f1970153ec0 2023-07-27T14:36:24.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.113+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f197006c470 con 0x7f1970153ec0 2023-07-27T14:36:24.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.113+0000 7f195e7fc700 1 -- 172.21.15.115:0/26753843 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) v1 ==== 84+0+143 (secure 0 0 0) 0x7f196804c4a0 con 0x7f1970153ec0 2023-07-27T14:36:24.161 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:24.161 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:36:24.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:24.161 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:36:24.162 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:36:24.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:36:24.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:24.162 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:36:24.162 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:36:24.162 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:24.162 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:36:24.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195005f880 msgr2=0x7f1950061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:24.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195005f880 0x7f1950061d40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f196000ab40 tx=0x7f1960008040).stop 2023-07-27T14:36:24.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1970153ec0 msgr2=0x7f19700c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:24.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1970153ec0 0x7f19700c2f00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f196800cf90 tx=0x7f19680078a0).stop 2023-07-27T14:36:24.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 shutdown_connections 2023-07-27T14:36:24.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195005f880 0x7f1950061d40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1970153ec0 0x7f19700c2f00 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19700aa050 0x7f19701500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 --2- 172.21.15.115:0/26753843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19700aaa40 0x7f19700c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 >> 172.21.15.115:0/26753843 conn(0x7f19700cb610 msgr2=0x7f19700c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:24.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 shutdown_connections 2023-07-27T14:36:24.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.115+0000 7f1974dff700 1 -- 172.21.15.115:0/26753843 wait complete. 2023-07-27T14:36:24.180 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:36:24.181 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:36:24.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.325+0000 7fb0a89ff700 1 Processor -- start 2023-07-27T14:36:24.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.325+0000 7fb0a89ff700 1 -- start start 2023-07-27T14:36:24.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a89ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a414ae00 0x7fb0a4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:24.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a89ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb0a414b1e0 0x7fb0a4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:24.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a89ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb0a40c5c50 0x7fb0a4063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:24.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a89ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a4063530 con 0x7fb0a414b1e0 2023-07-27T14:36:24.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a89ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a41553f0 con 0x7fb0a40c5c50 2023-07-27T14:36:24.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a89ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4157a50 con 0x7fb0a414ae00 2023-07-27T14:36:24.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a1d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb0a414b1e0 0x7fb0a4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:24.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a1d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb0a414b1e0 0x7fb0a4062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49576/0 (socket says 172.21.15.115:49576) 2023-07-27T14:36:24.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.326+0000 7fb0a1d9b700 1 -- 172.21.15.115:0/3727739327 learned_addr learned my addr 172.21.15.115:0/3727739327 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:24.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a2d9d700 1 --2- 172.21.15.115:0/3727739327 >> v2:172.21.15.159:3300/0 conn(0x7fb0a40c5c50 0x7fb0a4063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:24.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a259c700 1 --2- 172.21.15.115:0/3727739327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a414ae00 0x7fb0a4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:24.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a1d9b700 1 -- 172.21.15.115:0/3727739327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a414ae00 msgr2=0x7fb0a4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:24.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a1d9b700 1 --2- 172.21.15.115:0/3727739327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a414ae00 0x7fb0a4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a1d9b700 1 -- 172.21.15.115:0/3727739327 >> v2:172.21.15.159:3300/0 conn(0x7fb0a40c5c50 msgr2=0x7fb0a4063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:24.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a1d9b700 1 --2- 172.21.15.115:0/3727739327 >> v2:172.21.15.159:3300/0 conn(0x7fb0a40c5c50 0x7fb0a4063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a1d9b700 1 -- 172.21.15.115:0/3727739327 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4157d10 con 0x7fb0a414b1e0 2023-07-27T14:36:24.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a259c700 1 --2- 172.21.15.115:0/3727739327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a414ae00 0x7fb0a4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:24.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a1d9b700 1 --2- 172.21.15.115:0/3727739327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414b1e0 0x7fb0a4062b50 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fb0a405fbe0 tx=0x7fb0980090f0).ready entity=mon.0 client_cookie=c489c46ccf59a6f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:24.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a159a700 1 -- 172.21.15.115:0/3727739327 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800b520 con 0x7fb0a414b1e0 2023-07-27T14:36:24.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a159a700 1 -- 172.21.15.115:0/3727739327 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800b680 con 0x7fb0a414b1e0 2023-07-27T14:36:24.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.327+0000 7fb0a159a700 1 -- 172.21.15.115:0/3727739327 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800ba00 con 0x7fb0a414b1e0 2023-07-27T14:36:24.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 -- 172.21.15.115:0/3727739327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414b1e0 msgr2=0x7fb0a4062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:24.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/3727739327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414b1e0 0x7fb0a4062b50 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fb0a405fbe0 tx=0x7fb0980090f0).stop 2023-07-27T14:36:24.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 -- 172.21.15.115:0/3727739327 shutdown_connections 2023-07-27T14:36:24.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/3727739327 >> v2:172.21.15.159:3300/0 conn(0x7fb0a40c5c50 0x7fb0a4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/3727739327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a414ae00 0x7fb0a4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/3727739327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414b1e0 0x7fb0a4062b50 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 -- 172.21.15.115:0/3727739327 >> 172.21.15.115:0/3727739327 conn(0x7fb0a405e940 msgr2=0x7fb0a40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:24.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 -- 172.21.15.115:0/3727739327 shutdown_connections 2023-07-27T14:36:24.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.328+0000 7fb0a89ff700 1 -- 172.21.15.115:0/3727739327 wait complete. 2023-07-27T14:36:24.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.329+0000 7fb0a89ff700 1 Processor -- start 2023-07-27T14:36:24.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.329+0000 7fb0a89ff700 1 -- start start 2023-07-27T14:36:24.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.330+0000 7fb0a89ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a40c5c50 0x7fb0a41494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:24.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.330+0000 7fb0a89ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414ae00 0x7fb0a40c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:24.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.330+0000 7fb0a89ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a414b1e0 0x7fb0a40c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:24.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.330+0000 7fb0a89ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40a1840 con 0x7fb0a414ae00 2023-07-27T14:36:24.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.330+0000 7fb0a89ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4149f30 con 0x7fb0a414b1e0 2023-07-27T14:36:24.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.330+0000 7fb0a89ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c2810 con 0x7fb0a40c5c50 2023-07-27T14:36:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414ae00 0x7fb0a40c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414ae00 0x7fb0a40c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49582/0 (socket says 172.21.15.115:49582) 2023-07-27T14:36:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 -- 172.21.15.115:0/412507457 learned_addr learned my addr 172.21.15.115:0/412507457 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 -- 172.21.15.115:0/412507457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a40c5c50 msgr2=0x7fb0a41494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a40c5c50 0x7fb0a41494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 -- 172.21.15.115:0/412507457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a414b1e0 msgr2=0x7fb0a40c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a2d9d700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a414b1e0 0x7fb0a40c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a414b1e0 0x7fb0a40c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 -- 172.21.15.115:0/412507457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009370 con 0x7fb0a414ae00 2023-07-27T14:36:24.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a2d9d700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a414b1e0 0x7fb0a40c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:24.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0a1d9b700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414ae00 0x7fb0a40c38b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fb098011000 tx=0x7fb098017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:24.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.331+0000 7fb0927fc700 1 -- 172.21.15.115:0/412507457 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800b7f0 con 0x7fb0a414ae00 2023-07-27T14:36:24.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.332+0000 7fb0927fc700 1 -- 172.21.15.115:0/412507457 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800b950 con 0x7fb0a414ae00 2023-07-27T14:36:24.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.332+0000 7fb0927fc700 1 -- 172.21.15.115:0/412507457 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09801b660 con 0x7fb0a414ae00 2023-07-27T14:36:24.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.332+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40c2af0 con 0x7fb0a414ae00 2023-07-27T14:36:24.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.332+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a40c30b0 con 0x7fb0a414ae00 2023-07-27T14:36:24.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.333+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a406c470 con 0x7fb0a414ae00 2023-07-27T14:36:24.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.333+0000 7fb0927fc700 1 -- 172.21.15.115:0/412507457 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fb09800f070 con 0x7fb0a414ae00 2023-07-27T14:36:24.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.334+0000 7fb0927fc700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb08405f880 0x7fb084061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:24.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.334+0000 7fb0927fc700 1 -- 172.21.15.115:0/412507457 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb09807bf60 con 0x7fb0a414ae00 2023-07-27T14:36:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.334+0000 7fb0a259c700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb08405f880 0x7fb084061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.335+0000 7fb0a259c700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb08405f880 0x7fb084061d40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fb094006d80 tx=0x7fb094008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.338+0000 7fb0927fc700 1 -- 172.21.15.115:0/412507457 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb09804ce10 con 0x7fb0a414ae00 2023-07-27T14:36:24.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.503+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fb0a40c64f0 con 0x7fb0a414ae00 2023-07-27T14:36:24.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.785+0000 7fb0927fc700 1 -- 172.21.15.115:0/412507457 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v155) v1 ==== 152+0+0 (secure 0 0 0) 0x7fb098050430 con 0x7fb0a414ae00 2023-07-27T14:36:24.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb08405f880 msgr2=0x7fb084061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:24.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb08405f880 0x7fb084061d40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fb094006d80 tx=0x7fb094008040).stop 2023-07-27T14:36:24.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414ae00 msgr2=0x7fb0a40c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:24.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414ae00 0x7fb0a40c38b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fb098011000 tx=0x7fb098017000).stop 2023-07-27T14:36:24.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 shutdown_connections 2023-07-27T14:36:24.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb08405f880 0x7fb084061d40 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0a414b1e0 0x7fb0a40c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0a40c5c50 0x7fb0a41494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:24.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 --2- 172.21.15.115:0/412507457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0a414ae00 0x7fb0a40c38b0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:24.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 >> 172.21.15.115:0/412507457 conn(0x7fb0a405e940 msgr2=0x7fb0a4062af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:24.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 shutdown_connections 2023-07-27T14:36:24.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:24.788+0000 7fb0a89ff700 1 -- 172.21.15.115:0/412507457 wait complete. 2023-07-27T14:36:24.838 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:36:24.858 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:36:25.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.005+0000 7f49ba9ff700 1 Processor -- start 2023-07-27T14:36:25.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.005+0000 7f49ba9ff700 1 -- start start 2023-07-27T14:36:25.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.006+0000 7f49ba9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49b40c0ce0 0x7f49b415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:25.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49ba9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40c7ad0 con 0x7f49b4157400 2023-07-27T14:36:25.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49ba9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40c7db0 con 0x7f49b40a7940 2023-07-27T14:36:25.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49ba9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b40c5590 con 0x7f49b40c0ce0 2023-07-27T14:36:25.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49b3fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f49b4157400 0x7f49b40c05d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38680/0 (socket says 172.21.15.115:38680) 2023-07-27T14:36:25.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49b3fff700 1 -- 172.21.15.115:0/1413637887 learned_addr learned my addr 172.21.15.115:0/1413637887 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:25.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49b37fe700 1 --2- 172.21.15.115:0/1413637887 >> v2:172.21.15.115:3300/0 conn(0x7f49b40c0ce0 0x7f49b415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:25.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49b2ffd700 1 -- 172.21.15.115:0/1413637887 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034196107 0 0) 0x7f49b40c7ad0 con 0x7f49b4157400 2023-07-27T14:36:25.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49b2ffd700 1 -- 172.21.15.115:0/1413637887 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f499c0033f0 con 0x7f49b4157400 2023-07-27T14:36:25.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49b37fe700 1 -- 172.21.15.115:0/1413637887 >> v1:172.21.15.159:6789/0 conn(0x7f49b40a7940 legacy=0x7f49b415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:25.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49b37fe700 1 -- 172.21.15.115:0/1413637887 >> v1:172.21.15.115:6789/0 conn(0x7f49b4157400 legacy=0x7f49b40c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:25.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.007+0000 7f49b37fe700 1 -- 172.21.15.115:0/1413637887 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40c8090 con 0x7f49b40c0ce0 2023-07-27T14:36:25.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49b37fe700 1 --2- 172.21.15.115:0/1413637887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b415bbc0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f49a8009760 tx=0x7f49a8009060).ready entity=mon.0 client_cookie=dd908a0e8270c773 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:25.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49b2ffd700 1 -- 172.21.15.115:0/1413637887 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a80090d0 con 0x7f49b40c0ce0 2023-07-27T14:36:25.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49b2ffd700 1 -- 172.21.15.115:0/1413637887 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a800f510 con 0x7f49b40c0ce0 2023-07-27T14:36:25.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49b2ffd700 1 -- 172.21.15.115:0/1413637887 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a800f890 con 0x7f49b40c0ce0 2023-07-27T14:36:25.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1413637887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 msgr2=0x7f49b415bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:25.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49ba9ff700 1 --2- 172.21.15.115:0/1413637887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b415bbc0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f49a8009760 tx=0x7f49a8009060).stop 2023-07-27T14:36:25.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1413637887 shutdown_connections 2023-07-27T14:36:25.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49ba9ff700 1 --2- 172.21.15.115:0/1413637887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b415bbc0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:25.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1413637887 >> 172.21.15.115:0/1413637887 conn(0x7f49b4094280 msgr2=0x7f49b405e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:25.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.008+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1413637887 shutdown_connections 2023-07-27T14:36:25.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.009+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1413637887 wait complete. 2023-07-27T14:36:25.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.010+0000 7f49ba9ff700 1 Processor -- start 2023-07-27T14:36:25.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.010+0000 7f49ba9ff700 1 -- start start 2023-07-27T14:36:25.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49ba9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b40a7940 0x7f49b414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:25.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49ba9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b40c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:25.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49ba9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b4157400 0x7f49b414f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:25.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49ba9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40b0bb0 con 0x7f49b40c0ce0 2023-07-27T14:36:25.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49ba9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40c3770 con 0x7f49b40a7940 2023-07-27T14:36:25.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49ba9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40c2ed0 con 0x7f49b4157400 2023-07-27T14:36:25.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49b37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b40c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:25.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49b37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b40c26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49588/0 (socket says 172.21.15.115:49588) 2023-07-27T14:36:25.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.011+0000 7f49b37fe700 1 -- 172.21.15.115:0/1636559557 learned_addr learned my addr 172.21.15.115:0/1636559557 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:25.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b3fff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b40a7940 0x7f49b414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:25.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b37fe700 1 -- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b4157400 msgr2=0x7f49b414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:25.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b8f9c700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b4157400 0x7f49b414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:25.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b37fe700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b4157400 0x7f49b414f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:25.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b37fe700 1 -- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b40a7940 msgr2=0x7f49b414c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:25.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b37fe700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b40a7940 0x7f49b414c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:25.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b37fe700 1 -- 172.21.15.115:0/1636559557 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80092a0 con 0x7f49b40c0ce0 2023-07-27T14:36:25.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b3fff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b40a7940 0x7f49b414c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:25.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b8f9c700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b4157400 0x7f49b414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:25.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49b37fe700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b40c26a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f49b405edc0 tx=0x7f49a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:25.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f499bfff700 1 -- 172.21.15.115:0/1636559557 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8006cd0 con 0x7f49b40c0ce0 2023-07-27T14:36:25.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f499bfff700 1 -- 172.21.15.115:0/1636559557 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a8011ca0 con 0x7f49b40c0ce0 2023-07-27T14:36:25.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b40c31b0 con 0x7f49b40c0ce0 2023-07-27T14:36:25.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f499bfff700 1 -- 172.21.15.115:0/1636559557 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a801b640 con 0x7f49b40c0ce0 2023-07-27T14:36:25.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.012+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b40ae5a0 con 0x7f49b40c0ce0 2023-07-27T14:36:25.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.013+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b40ae400 con 0x7f49b40c0ce0 2023-07-27T14:36:25.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.015+0000 7f499bfff700 1 -- 172.21.15.115:0/1636559557 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f49a8021030 con 0x7f49b40c0ce0 2023-07-27T14:36:25.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.016+0000 7f499bfff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a005f880 0x7f49a0061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:25.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.016+0000 7f499bfff700 1 -- 172.21.15.115:0/1636559557 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f49a807c370 con 0x7f49b40c0ce0 2023-07-27T14:36:25.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.016+0000 7f49b3fff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a005f880 0x7f49a0061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:25.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.017+0000 7f49b3fff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a005f880 0x7f49a0061d40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f49a4005750 tx=0x7f49a4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:25.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.020+0000 7f499bfff700 1 -- 172.21.15.115:0/1636559557 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49a804d460 con 0x7f49b40c0ce0 2023-07-27T14:36:25.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.191+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f49b40ae400 con 0x7f49b40c0ce0 2023-07-27T14:36:25.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.795+0000 7f499bfff700 1 -- 172.21.15.115:0/1636559557 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v156) v1 ==== 170+0+0 (secure 0 0 0) 0x7f49b40ae400 con 0x7f49b40c0ce0 2023-07-27T14:36:25.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.804+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a005f880 msgr2=0x7f49a0061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:25.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.804+0000 7f49ba9ff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a005f880 0x7f49a0061d40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f49a4005750 tx=0x7f49a4009040).stop 2023-07-27T14:36:25.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.804+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 msgr2=0x7f49b40c26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:25.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.804+0000 7f49ba9ff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b40c26a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f49b405edc0 tx=0x7f49a8017000).stop 2023-07-27T14:36:25.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.806+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 shutdown_connections 2023-07-27T14:36:25.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.806+0000 7f49ba9ff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f49a005f880 0x7f49a0061d40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:25.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.806+0000 7f49ba9ff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b4157400 0x7f49b414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:25.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.806+0000 7f49ba9ff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b40a7940 0x7f49b414c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:25.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.806+0000 7f49ba9ff700 1 --2- 172.21.15.115:0/1636559557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b40c0ce0 0x7f49b40c26a0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:25.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.807+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 >> 172.21.15.115:0/1636559557 conn(0x7f49b4094280 msgr2=0x7f49b40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:25.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.809+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 shutdown_connections 2023-07-27T14:36:25.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:25.811+0000 7f49ba9ff700 1 -- 172.21.15.115:0/1636559557 wait complete. 2023-07-27T14:36:25.867 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:36:25.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:36:26.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.034+0000 7fe575fff700 1 Processor -- start 2023-07-27T14:36:26.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.034+0000 7fe575fff700 1 -- start start 2023-07-27T14:36:26.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.035+0000 7fe575fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe570065de0 0x7fe57015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.035+0000 7fe575fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe570064a80 con 0x7fe5700c6b70 2023-07-27T14:36:26.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.035+0000 7fe575fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe570064d60 con 0x7fe570153e00 2023-07-27T14:36:26.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.035+0000 7fe575fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe570062320 con 0x7fe570065de0 2023-07-27T14:36:26.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe5700c6b70 0x7fe5700656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38690/0 (socket says 172.21.15.115:38690) 2023-07-27T14:36:26.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56effd700 1 -- 172.21.15.115:0/2182340443 learned_addr learned my addr 172.21.15.115:0/2182340443 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:26.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56ffff700 1 --2- 172.21.15.115:0/2182340443 >> v2:172.21.15.115:3300/0 conn(0x7fe570065de0 0x7fe57015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56e7fc700 1 -- 172.21.15.115:0/2182340443 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104519892 0 0) 0x7fe570064a80 con 0x7fe5700c6b70 2023-07-27T14:36:26.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56e7fc700 1 -- 172.21.15.115:0/2182340443 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5580033f0 con 0x7fe5700c6b70 2023-07-27T14:36:26.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56ffff700 1 -- 172.21.15.115:0/2182340443 >> v1:172.21.15.159:6789/0 conn(0x7fe570153e00 legacy=0x7fe570064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56ffff700 1 -- 172.21.15.115:0/2182340443 >> v1:172.21.15.115:6789/0 conn(0x7fe5700c6b70 legacy=0x7fe5700656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56ffff700 1 -- 172.21.15.115:0/2182340443 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe570065040 con 0x7fe570065de0 2023-07-27T14:36:26.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.036+0000 7fe56ffff700 1 --2- 172.21.15.115:0/2182340443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe57015edc0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fe568009e60 tx=0x7fe568009780).ready entity=mon.0 client_cookie=8560198e3add6166 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe56e7fc700 1 -- 172.21.15.115:0/2182340443 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800e070 con 0x7fe570065de0 2023-07-27T14:36:26.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe56e7fc700 1 -- 172.21.15.115:0/2182340443 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800bb60 con 0x7fe570065de0 2023-07-27T14:36:26.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe56e7fc700 1 -- 172.21.15.115:0/2182340443 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568012410 con 0x7fe570065de0 2023-07-27T14:36:26.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe575fff700 1 -- 172.21.15.115:0/2182340443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 msgr2=0x7fe57015edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe575fff700 1 --2- 172.21.15.115:0/2182340443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe57015edc0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7fe568009e60 tx=0x7fe568009780).stop 2023-07-27T14:36:26.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe575fff700 1 -- 172.21.15.115:0/2182340443 shutdown_connections 2023-07-27T14:36:26.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe575fff700 1 --2- 172.21.15.115:0/2182340443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe57015edc0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe575fff700 1 -- 172.21.15.115:0/2182340443 >> 172.21.15.115:0/2182340443 conn(0x7fe5700c7b90 msgr2=0x7fe5700c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:26.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe575fff700 1 -- 172.21.15.115:0/2182340443 shutdown_connections 2023-07-27T14:36:26.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.037+0000 7fe575fff700 1 -- 172.21.15.115:0/2182340443 wait complete. 2023-07-27T14:36:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.039+0000 7fe575fff700 1 Processor -- start 2023-07-27T14:36:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.039+0000 7fe575fff700 1 -- start start 2023-07-27T14:36:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe575fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe570068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe575fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5700c6b70 0x7fe57014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe575fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe570153e00 0x7fe5701503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe575fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe570069fa0 con 0x7fe570065de0 2023-07-27T14:36:26.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe575fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe570069390 con 0x7fe570153e00 2023-07-27T14:36:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe575fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe570069670 con 0x7fe5700c6b70 2023-07-27T14:36:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe570068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe570068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49612/0 (socket says 172.21.15.115:49612) 2023-07-27T14:36:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56f7fe700 1 -- 172.21.15.115:0/2803433784 learned_addr learned my addr 172.21.15.115:0/2803433784 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56effd700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5700c6b70 0x7fe57014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56ffff700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe570153e00 0x7fe5701503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56f7fe700 1 -- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5700c6b70 msgr2=0x7fe57014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56f7fe700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5700c6b70 0x7fe57014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56f7fe700 1 -- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe570153e00 msgr2=0x7fe5701503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56f7fe700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe570153e00 0x7fe5701503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56f7fe700 1 -- 172.21.15.115:0/2803433784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568009a20 con 0x7fe570065de0 2023-07-27T14:36:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.040+0000 7fe56ffff700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe570153e00 0x7fe5701503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.041+0000 7fe56f7fe700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe570068b30 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fe56000c440 tx=0x7fe560007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.041+0000 7fe5577fe700 1 -- 172.21.15.115:0/2803433784 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000cea0 con 0x7fe570065de0 2023-07-27T14:36:26.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.041+0000 7fe5577fe700 1 -- 172.21.15.115:0/2803433784 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000f470 con 0x7fe570065de0 2023-07-27T14:36:26.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.041+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe570069950 con 0x7fe570065de0 2023-07-27T14:36:26.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.041+0000 7fe5577fe700 1 -- 172.21.15.115:0/2803433784 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000f810 con 0x7fe570065de0 2023-07-27T14:36:26.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.041+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe570069020 con 0x7fe570065de0 2023-07-27T14:36:26.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.042+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57006c470 con 0x7fe570065de0 2023-07-27T14:36:26.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.043+0000 7fe5577fe700 1 -- 172.21.15.115:0/2803433784 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fe560019030 con 0x7fe570065de0 2023-07-27T14:36:26.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.043+0000 7fe5577fe700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe55c05f880 0x7fe55c061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.044+0000 7fe5577fe700 1 -- 172.21.15.115:0/2803433784 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fe560079c50 con 0x7fe570065de0 2023-07-27T14:36:26.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.044+0000 7fe56effd700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe55c05f880 0x7fe55c061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.044+0000 7fe56effd700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe55c05f880 0x7fe55c061d40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fe570167590 tx=0x7fe564009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.048+0000 7fe5577fe700 1 -- 172.21.15.115:0/2803433784 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe56004aa60 con 0x7fe570065de0 2023-07-27T14:36:26.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.256+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe570150ce0 con 0x7fe570065de0 2023-07-27T14:36:26.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.262+0000 7fe5577fe700 1 -- 172.21.15.115:0/2803433784 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe56004e080 con 0x7fe570065de0 2023-07-27T14:36:26.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe55c05f880 msgr2=0x7fe55c061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe55c05f880 0x7fe55c061d40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fe570167590 tx=0x7fe564009040).stop 2023-07-27T14:36:26.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 msgr2=0x7fe570068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe570068b30 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fe56000c440 tx=0x7fe560007db0).stop 2023-07-27T14:36:26.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 shutdown_connections 2023-07-27T14:36:26.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe55c05f880 0x7fe55c061d40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe570153e00 0x7fe5701503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe570065de0 0x7fe570068b30 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 --2- 172.21.15.115:0/2803433784 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5700c6b70 0x7fe57014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.267+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 >> 172.21.15.115:0/2803433784 conn(0x7fe5700c7b90 msgr2=0x7fe5700bc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:26.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.268+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 shutdown_connections 2023-07-27T14:36:26.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.268+0000 7fe575fff700 1 -- 172.21.15.115:0/2803433784 wait complete. 2023-07-27T14:36:26.325 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 21 and data pool 22 2023-07-27T14:36:26.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:36:26.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.487+0000 7fc4f7fff700 1 Processor -- start 2023-07-27T14:36:26.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.487+0000 7fc4f7fff700 1 -- start start 2023-07-27T14:36:26.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.488+0000 7fc4f7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4f0153ec0 0x7fc4f00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.488+0000 7fc4f7fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc4f00aaa40 0x7fc4f00c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.488+0000 7fc4f7fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f00aa4d0 con 0x7fc4f00aa050 2023-07-27T14:36:26.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.488+0000 7fc4f7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f00c05c0 con 0x7fc4f0153ec0 2023-07-27T14:36:26.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.488+0000 7fc4f7fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f00bfc90 con 0x7fc4f00aaa40 2023-07-27T14:36:26.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4f0153ec0 0x7fc4f00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4f0153ec0 0x7fc4f00a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49624/0 (socket says 172.21.15.115:49624) 2023-07-27T14:36:26.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f5d9b700 1 -- 172.21.15.115:0/3768454884 learned_addr learned my addr 172.21.15.115:0/3768454884 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:26.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f5d9b700 1 -- 172.21.15.115:0/3768454884 >> v2:172.21.15.159:3300/0 conn(0x7fc4f00aaa40 msgr2=0x7fc4f00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:26.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f5d9b700 1 --2- 172.21.15.115:0/3768454884 >> v2:172.21.15.159:3300/0 conn(0x7fc4f00aaa40 0x7fc4f00c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:26.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f5d9b700 1 -- 172.21.15.115:0/3768454884 >> v1:172.21.15.159:6789/0 conn(0x7fc4f00aa050 legacy=0x7fc4f00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:26.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f5d9b700 1 -- 172.21.15.115:0/3768454884 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00bff70 con 0x7fc4f0153ec0 2023-07-27T14:36:26.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f5d9b700 1 --2- 172.21.15.115:0/3768454884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f00a9b60 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fc4f00c5470 tx=0x7fc4ec0090f0).ready entity=mon.0 client_cookie=1b3b14d91abfb0f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.489+0000 7fc4f4d99700 1 -- 172.21.15.115:0/3768454884 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00b5a0 con 0x7fc4f0153ec0 2023-07-27T14:36:26.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f4d99700 1 -- 172.21.15.115:0/3768454884 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec00b700 con 0x7fc4f0153ec0 2023-07-27T14:36:26.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f4d99700 1 -- 172.21.15.115:0/3768454884 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00ba80 con 0x7fc4f0153ec0 2023-07-27T14:36:26.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3768454884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 msgr2=0x7fc4f00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3768454884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f00a9b60 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fc4f00c5470 tx=0x7fc4ec0090f0).stop 2023-07-27T14:36:26.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3768454884 shutdown_connections 2023-07-27T14:36:26.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3768454884 >> v2:172.21.15.159:3300/0 conn(0x7fc4f00aaa40 0x7fc4f00c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:26.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3768454884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f00a9b60 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3768454884 >> 172.21.15.115:0/3768454884 conn(0x7fc4f00cb610 msgr2=0x7fc4f00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:26.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3768454884 shutdown_connections 2023-07-27T14:36:26.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.490+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3768454884 wait complete. 2023-07-27T14:36:26.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.492+0000 7fc4f7fff700 1 Processor -- start 2023-07-27T14:36:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.492+0000 7fc4f7fff700 1 -- start start 2023-07-27T14:36:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4f00aa050 0x7fc4f01504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f00aaa40 0x7fc4f0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f01530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f01535c0 con 0x7fc4f0153ec0 2023-07-27T14:36:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f0151970 con 0x7fc4f00aaa40 2023-07-27T14:36:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f0150dd0 con 0x7fc4f00aa050 2023-07-27T14:36:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f01530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f01530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49636/0 (socket says 172.21.15.115:49636) 2023-07-27T14:36:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f659c700 1 -- 172.21.15.115:0/3297355059 learned_addr learned my addr 172.21.15.115:0/3297355059 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f559a700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f00aaa40 0x7fc4f0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.493+0000 7fc4f5d9b700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4f00aa050 0x7fc4f01504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4f659c700 1 -- 172.21.15.115:0/3297355059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4f00aa050 msgr2=0x7fc4f01504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4f659c700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4f00aa050 0x7fc4f01504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4f659c700 1 -- 172.21.15.115:0/3297355059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f00aaa40 msgr2=0x7fc4f0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4f659c700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f00aaa40 0x7fc4f0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4f659c700 1 -- 172.21.15.115:0/3297355059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec009370 con 0x7fc4f0153ec0 2023-07-27T14:36:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4f659c700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f01530d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7fc4e800bb90 tx=0x7fc4e8009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4e5ffb700 1 -- 172.21.15.115:0/3297355059 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800c7e0 con 0x7fc4f0153ec0 2023-07-27T14:36:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4e5ffb700 1 -- 172.21.15.115:0/3297355059 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e800c960 con 0x7fc4f0153ec0 2023-07-27T14:36:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f0151040 con 0x7fc4f0153ec0 2023-07-27T14:36:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4e5ffb700 1 -- 172.21.15.115:0/3297355059 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800cb10 con 0x7fc4f0153ec0 2023-07-27T14:36:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.494+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f0151600 con 0x7fc4f0153ec0 2023-07-27T14:36:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.495+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f0151b20 con 0x7fc4f0153ec0 2023-07-27T14:36:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.496+0000 7fc4e5ffb700 1 -- 172.21.15.115:0/3297355059 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fc4e801c070 con 0x7fc4f0153ec0 2023-07-27T14:36:26.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.497+0000 7fc4e5ffb700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4d405f850 0x7fc4d4061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.497+0000 7fc4e5ffb700 1 -- 172.21.15.115:0/3297355059 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc4e807a560 con 0x7fc4f0153ec0 2023-07-27T14:36:26.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.498+0000 7fc4f5d9b700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4d405f850 0x7fc4d4061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.498+0000 7fc4f5d9b700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4d405f850 0x7fc4d4061d10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fc4ec009130 tx=0x7fc4ec015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.501+0000 7fc4e5ffb700 1 -- 172.21.15.115:0/3297355059 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4f0151b20 con 0x7fc4f0153ec0 2023-07-27T14:36:26.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.674+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f006c470 con 0x7fc4f0153ec0 2023-07-27T14:36:26.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.675+0000 7fc4e5ffb700 1 -- 172.21.15.115:0/3297355059 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+17099 (secure 0 0 0) 0x7fc4e801a070 con 0x7fc4f0153ec0 2023-07-27T14:36:26.723 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:26.724 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":157,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:36:26.258030+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:36:24.547249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-27T14:36:25.235805+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:36:26.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4d405f850 msgr2=0x7fc4d4061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4d405f850 0x7fc4d4061d10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fc4ec009130 tx=0x7fc4ec015000).stop 2023-07-27T14:36:26.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 msgr2=0x7fc4f01530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f01530d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7fc4e800bb90 tx=0x7fc4e8009810).stop 2023-07-27T14:36:26.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 shutdown_connections 2023-07-27T14:36:26.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc4d405f850 0x7fc4d4061d10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4f0153ec0 0x7fc4f01530d0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc4f00aa050 0x7fc4f01504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 --2- 172.21.15.115:0/3297355059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4f00aaa40 0x7fc4f0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.677+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 >> 172.21.15.115:0/3297355059 conn(0x7fc4f00cb610 msgr2=0x7fc4f00c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:26.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.678+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 shutdown_connections 2023-07-27T14:36:26.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.678+0000 7fc4f7fff700 1 -- 172.21.15.115:0/3297355059 wait complete. 2023-07-27T14:36:26.742 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:36:26.822 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-07-27T14:36:26.775+0000 7f9a089f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:36:26.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.885+0000 7f77f71ff700 1 Processor -- start 2023-07-27T14:36:26.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.885+0000 7f77f71ff700 1 -- start start 2023-07-27T14:36:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.886+0000 7f77f71ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f77f00aaa40 0x7f77f00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.886+0000 7f77f71ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f01542a0 0x7f77f00645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.886+0000 7f77f71ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f00aa4d0 con 0x7f77f0153ec0 2023-07-27T14:36:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.886+0000 7f77f71ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f0064ad0 con 0x7f77f00aaa40 2023-07-27T14:36:26.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.886+0000 7f77f71ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00c05c0 con 0x7f77f01542a0 2023-07-27T14:36:26.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77f4f9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f77f0153ec0 0x7f77f00a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38692/0 (socket says 172.21.15.115:38692) 2023-07-27T14:36:26.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77f4f9b700 1 -- 172.21.15.115:0/2251927122 learned_addr learned my addr 172.21.15.115:0/2251927122 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:26.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77effff700 1 --2- 172.21.15.115:0/2251927122 >> v2:172.21.15.115:3300/0 conn(0x7f77f00aaa40 0x7f77f00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77ef7fe700 1 -- 172.21.15.115:0/2251927122 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623538716 0 0) 0x7f77e4001110 con 0x7f77f0153ec0 2023-07-27T14:36:26.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77ef7fe700 1 -- 172.21.15.115:0/2251927122 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e00033f0 con 0x7f77f0153ec0 2023-07-27T14:36:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77f579c700 1 --2- 172.21.15.115:0/2251927122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f01542a0 0x7f77f00645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77effff700 1 -- 172.21.15.115:0/2251927122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f01542a0 msgr2=0x7f77f00645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77effff700 1 --2- 172.21.15.115:0/2251927122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f01542a0 0x7f77f00645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77effff700 1 -- 172.21.15.115:0/2251927122 >> v1:172.21.15.115:6789/0 conn(0x7f77f0153ec0 legacy=0x7f77f00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77effff700 1 -- 172.21.15.115:0/2251927122 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00c1a60 con 0x7f77f00aaa40 2023-07-27T14:36:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77effff700 1 --2- 172.21.15.115:0/2251927122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f00aaa40 0x7f77f00640f0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f77dc009760 tx=0x7f77dc009060).ready entity=mon.0 client_cookie=7ece7fc9d31718b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77ef7fe700 1 -- 172.21.15.115:0/2251927122 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00f510 con 0x7f77f00aaa40 2023-07-27T14:36:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.887+0000 7f77ef7fe700 1 -- 172.21.15.115:0/2251927122 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00f670 con 0x7f77f00aaa40 2023-07-27T14:36:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77ef7fe700 1 -- 172.21.15.115:0/2251927122 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00f9f0 con 0x7f77f00aaa40 2023-07-27T14:36:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77f71ff700 1 -- 172.21.15.115:0/2251927122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f00aaa40 msgr2=0x7f77f00640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2251927122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f00aaa40 0x7f77f00640f0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7f77dc009760 tx=0x7f77dc009060).stop 2023-07-27T14:36:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77f71ff700 1 -- 172.21.15.115:0/2251927122 shutdown_connections 2023-07-27T14:36:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2251927122 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f01542a0 0x7f77f00645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2251927122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f00aaa40 0x7f77f00640f0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77f71ff700 1 -- 172.21.15.115:0/2251927122 >> 172.21.15.115:0/2251927122 conn(0x7f77f00cb610 msgr2=0x7f77f00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77f71ff700 1 -- 172.21.15.115:0/2251927122 shutdown_connections 2023-07-27T14:36:26.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.888+0000 7f77f71ff700 1 -- 172.21.15.115:0/2251927122 wait complete. 2023-07-27T14:36:26.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.890+0000 7f77f71ff700 1 Processor -- start 2023-07-27T14:36:26.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.890+0000 7f77f71ff700 1 -- start start 2023-07-27T14:36:26.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f71ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f00aaa40 0x7f77f00c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f71ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f0153ec0 0x7f77f014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f71ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f01542a0 0x7f77f014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f71ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00c34d0 con 0x7f77f01542a0 2023-07-27T14:36:26.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f71ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00af960 con 0x7f77f0153ec0 2023-07-27T14:36:26.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f71ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0164aa0 con 0x7f77f00aaa40 2023-07-27T14:36:26.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f579c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f01542a0 0x7f77f014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f579c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f01542a0 0x7f77f014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49650/0 (socket says 172.21.15.115:49650) 2023-07-27T14:36:26.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f579c700 1 -- 172.21.15.115:0/2292080719 learned_addr learned my addr 172.21.15.115:0/2292080719 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:26.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f4f9b700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f00aaa40 0x7f77f00c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77effff700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f0153ec0 0x7f77f014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f579c700 1 -- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f00aaa40 msgr2=0x7f77f00c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f579c700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f00aaa40 0x7f77f00c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f579c700 1 -- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f0153ec0 msgr2=0x7f77f014ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:26.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.891+0000 7f77f579c700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f0153ec0 0x7f77f014ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:26.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77f579c700 1 -- 172.21.15.115:0/2292080719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0092a0 con 0x7f77f01542a0 2023-07-27T14:36:26.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77effff700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f0153ec0 0x7f77f014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:26.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77f4f9b700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f00aaa40 0x7f77f00c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:26.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77f579c700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f01542a0 0x7f77f014f670 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f77e800cd30 tx=0x7f77e8007790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77ecff9700 1 -- 172.21.15.115:0/2292080719 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e800aac0 con 0x7f77f01542a0 2023-07-27T14:36:26.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77ecff9700 1 -- 172.21.15.115:0/2292080719 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e800ac20 con 0x7f77f01542a0 2023-07-27T14:36:26.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77ecff9700 1 -- 172.21.15.115:0/2292080719 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e800f400 con 0x7f77f01542a0 2023-07-27T14:36:26.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f00ae750 con 0x7f77f01542a0 2023-07-27T14:36:26.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.892+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f00aed10 con 0x7f77f01542a0 2023-07-27T14:36:26.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.893+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f00af730 con 0x7f77f01542a0 2023-07-27T14:36:26.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.894+0000 7f77ecff9700 1 -- 172.21.15.115:0/2292080719 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f77e801f070 con 0x7f77f01542a0 2023-07-27T14:36:26.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.895+0000 7f77ecff9700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77d405f850 0x7f77d4061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:26.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.895+0000 7f77ecff9700 1 -- 172.21.15.115:0/2292080719 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f77e807ab20 con 0x7f77f01542a0 2023-07-27T14:36:26.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.895+0000 7f77f4f9b700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77d405f850 0x7f77d4061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:26.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.896+0000 7f77f4f9b700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77d405f850 0x7f77d4061d10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f77e4007fd0 tx=0x7f77e4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:26.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:26.899+0000 7f77ecff9700 1 -- 172.21.15.115:0/2292080719 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77f00af730 con 0x7f77f01542a0 2023-07-27T14:36:27.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.069+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77f00af730 con 0x7f77f01542a0 2023-07-27T14:36:27.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.070+0000 7f77ecff9700 1 -- 172.21.15.115:0/2292080719 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+17099 (secure 0 0 0) 0x7f77f00af730 con 0x7f77f01542a0 2023-07-27T14:36:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:27.118 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":157,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:36:26.258030+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:36:24.547249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-27T14:36:25.235805+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:36:27.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77d405f850 msgr2=0x7f77d4061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:27.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77d405f850 0x7f77d4061d10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f77e4007fd0 tx=0x7f77e4009040).stop 2023-07-27T14:36:27.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f01542a0 msgr2=0x7f77f014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:27.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f01542a0 0x7f77f014f670 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7f77e800cd30 tx=0x7f77e8007790).stop 2023-07-27T14:36:27.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 shutdown_connections 2023-07-27T14:36:27.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77d405f850 0x7f77d4061d10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77f01542a0 0x7f77f014f670 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77f00aaa40 0x7f77f00c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 --2- 172.21.15.115:0/2292080719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f0153ec0 0x7f77f014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.072+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 >> 172.21.15.115:0/2292080719 conn(0x7f77f00cb610 msgr2=0x7f77f00aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:27.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.073+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 shutdown_connections 2023-07-27T14:36:27.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.073+0000 7f77f71ff700 1 -- 172.21.15.115:0/2292080719 wait complete. 2023-07-27T14:36:27.137 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:36:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.280+0000 7fa2643ff700 1 Processor -- start 2023-07-27T14:36:27.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.281+0000 7fa2643ff700 1 -- start start 2023-07-27T14:36:27.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.282+0000 7fa2643ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa25c14ae00 0x7fa25c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:27.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.282+0000 7fa2643ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c1553f0 con 0x7fa25c14b1e0 2023-07-27T14:36:27.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.282+0000 7fa2643ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c157a50 con 0x7fa25c063260 2023-07-27T14:36:27.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.282+0000 7fa2643ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c157d10 con 0x7fa25c14ae00 2023-07-27T14:36:27.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.282+0000 7fa26199a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa25c14b1e0 0x7fa25c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38708/0 (socket says 172.21.15.115:38708) 2023-07-27T14:36:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.282+0000 7fa26199a700 1 -- 172.21.15.115:0/4175795463 learned_addr learned my addr 172.21.15.115:0/4175795463 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.282+0000 7fa26219b700 1 --2- 172.21.15.115:0/4175795463 >> v2:172.21.15.159:3300/0 conn(0x7fa25c14ae00 0x7fa25c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.282+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123552511 0 0) 0x7fa25c1553f0 con 0x7fa25c14b1e0 2023-07-27T14:36:27.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2480033f0 con 0x7fa25c14b1e0 2023-07-27T14:36:27.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360164293 0 0) 0x7fa2480033f0 con 0x7fa25c14b1e0 2023-07-27T14:36:27.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 >> v2:172.21.15.159:3300/0 conn(0x7fa25c14ae00 msgr2=0x7fa25c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:27.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 --2- 172.21.15.115:0/4175795463 >> v2:172.21.15.159:3300/0 conn(0x7fa25c14ae00 0x7fa25c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 >> v1:172.21.15.159:6789/0 conn(0x7fa25c063260 legacy=0x7fa25c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:27.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c157ff0 con 0x7fa25c14b1e0 2023-07-27T14:36:27.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fa24c001470 con 0x7fa25c14b1e0 2023-07-27T14:36:27.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 >> v1:172.21.15.115:6789/0 conn(0x7fa25c14b1e0 legacy=0x7fa25c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:27.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa248003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:27.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa248004690 0x7fa248004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:27.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa248005000 0x7fa24800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:27.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c157d10 con 0x7fa2480038e0 2023-07-27T14:36:27.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24800beb0 con 0x7fa248005000 2023-07-27T14:36:27.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24800c070 con 0x7fa248004690 2023-07-27T14:36:27.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa26219b700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa248003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:27.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa26199a700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa248004690 0x7fa248004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:27.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.283+0000 7fa26299c700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa248005000 0x7fa24800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:27.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa26219b700 1 -- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa248004690 msgr2=0x7fa248004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:27.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa26219b700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa248004690 0x7fa248004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa26219b700 1 -- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa248005000 msgr2=0x7fa24800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:27.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa26219b700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa248005000 0x7fa24800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa26219b700 1 -- 172.21.15.115:0/4175795463 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480033f0 con 0x7fa2480038e0 2023-07-27T14:36:27.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa26299c700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa248005000 0x7fa24800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:27.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa26299c700 1 -- 172.21.15.115:0/4175795463 reap_dead start 2023-07-27T14:36:27.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa26219b700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa248003cc0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fa258009a80 tx=0x7fa258009060).ready entity=mon.0 client_cookie=eb8c81d97d13991f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:27.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258009430 con 0x7fa2480038e0 2023-07-27T14:36:27.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800e640 con 0x7fa2480038e0 2023-07-27T14:36:27.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa261199700 1 -- 172.21.15.115:0/4175795463 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800e9c0 con 0x7fa2480038e0 2023-07-27T14:36:27.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.284+0000 7fa2643ff700 1 -- 172.21.15.115:0/4175795463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 msgr2=0x7fa248003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:27.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.285+0000 7fa2643ff700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa248003cc0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fa258009a80 tx=0x7fa258009060).stop 2023-07-27T14:36:27.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.285+0000 7fa2643ff700 1 -- 172.21.15.115:0/4175795463 shutdown_connections 2023-07-27T14:36:27.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.285+0000 7fa2643ff700 1 --2- 172.21.15.115:0/4175795463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa248003cc0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.285+0000 7fa2643ff700 1 -- 172.21.15.115:0/4175795463 >> 172.21.15.115:0/4175795463 conn(0x7fa25c05e940 msgr2=0x7fa25c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:27.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.285+0000 7fa2643ff700 1 -- 172.21.15.115:0/4175795463 shutdown_connections 2023-07-27T14:36:27.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.285+0000 7fa2643ff700 1 -- 172.21.15.115:0/4175795463 wait complete. 2023-07-27T14:36:27.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.286+0000 7fa2643ff700 1 Processor -- start 2023-07-27T14:36:27.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.286+0000 7fa2643ff700 1 -- start start 2023-07-27T14:36:27.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.287+0000 7fa2643ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa25c149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:27.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.287+0000 7fa2643ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa25c0adb60 0x7fa25c158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:27.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.287+0000 7fa2643ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c0adfe0 0x7fa25c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:27.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.287+0000 7fa2643ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c159490 con 0x7fa2480038e0 2023-07-27T14:36:27.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.287+0000 7fa2643ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c1568f0 con 0x7fa25c0adfe0 2023-07-27T14:36:27.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.287+0000 7fa2643ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c155ce0 con 0x7fa25c0adb60 2023-07-27T14:36:27.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.287+0000 7fa26219b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa25c149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:27.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26219b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa25c149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49676/0 (socket says 172.21.15.115:49676) 2023-07-27T14:36:27.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26219b700 1 -- 172.21.15.115:0/1199674976 learned_addr learned my addr 172.21.15.115:0/1199674976 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:27.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26199a700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa25c0adb60 0x7fa25c158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:27.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26299c700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c0adfe0 0x7fa25c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:27.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26219b700 1 -- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa25c0adb60 msgr2=0x7fa25c158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:27.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26219b700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa25c0adb60 0x7fa25c158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26219b700 1 -- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c0adfe0 msgr2=0x7fa25c158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:27.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26219b700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c0adfe0 0x7fa25c158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:27.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26219b700 1 -- 172.21.15.115:0/1199674976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c155fc0 con 0x7fa2480038e0 2023-07-27T14:36:27.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26199a700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa25c0adb60 0x7fa25c158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:27.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa26219b700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa25c149a00 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7fa258006d50 tx=0x7fa25801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:27.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa2527fc700 1 -- 172.21.15.115:0/1199674976 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800ed70 con 0x7fa2480038e0 2023-07-27T14:36:27.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa2527fc700 1 -- 172.21.15.115:0/1199674976 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800eed0 con 0x7fa2480038e0 2023-07-27T14:36:27.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.288+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c1562a0 con 0x7fa2480038e0 2023-07-27T14:36:27.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.289+0000 7fa2527fc700 1 -- 172.21.15.115:0/1199674976 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800ea00 con 0x7fa2480038e0 2023-07-27T14:36:27.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.289+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c149ef0 con 0x7fa2480038e0 2023-07-27T14:36:27.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.290+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c06c470 con 0x7fa2480038e0 2023-07-27T14:36:27.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.290+0000 7fa2527fc700 1 -- 172.21.15.115:0/1199674976 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fa25802b030 con 0x7fa2480038e0 2023-07-27T14:36:27.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.291+0000 7fa2527fc700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa24005f880 0x7fa240061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:27.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.291+0000 7fa2527fc700 1 -- 172.21.15.115:0/1199674976 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa25807b990 con 0x7fa2480038e0 2023-07-27T14:36:27.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.291+0000 7fa26199a700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa24005f880 0x7fa240061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:27.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.292+0000 7fa26199a700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa24005f880 0x7fa240061d40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fa25c0c1ab0 tx=0x7fa24c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:27.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.295+0000 7fa2527fc700 1 -- 172.21.15.115:0/1199674976 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa25804c8d0 con 0x7fa2480038e0 2023-07-27T14:36:27.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:27.503+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa25c06b3b0 con 0x7fa2480038e0 2023-07-27T14:36:28.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.273+0000 7fa2527fc700 1 -- 172.21.15.115:0/1199674976 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa258029020 con 0x7fa2480038e0 2023-07-27T14:36:28.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa24005f880 msgr2=0x7fa240061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:28.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa24005f880 0x7fa240061d40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fa25c0c1ab0 tx=0x7fa24c009040).stop 2023-07-27T14:36:28.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 msgr2=0x7fa25c149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:28.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa25c149a00 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7fa258006d50 tx=0x7fa25801a000).stop 2023-07-27T14:36:28.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 shutdown_connections 2023-07-27T14:36:28.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa24005f880 0x7fa240061d40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa25c0adfe0 0x7fa25c158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2480038e0 0x7fa25c149a00 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 --2- 172.21.15.115:0/1199674976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa25c0adb60 0x7fa25c158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 >> 172.21.15.115:0/1199674976 conn(0x7fa25c05e940 msgr2=0x7fa25c153950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:28.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 shutdown_connections 2023-07-27T14:36:28.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.276+0000 7fa2643ff700 1 -- 172.21.15.115:0/1199674976 wait complete. 2023-07-27T14:36:28.342 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:36:28.342 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:36:28.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.486+0000 7fc58bbff700 1 Processor -- start 2023-07-27T14:36:28.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.486+0000 7fc58bbff700 1 -- start start 2023-07-27T14:36:28.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.487+0000 7fc58bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840bfb50 0x7fc5840c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:28.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.487+0000 7fc58bbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc5840c0610 0x7fc5840c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:28.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.487+0000 7fc58bbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840c60a0 con 0x7fc584153f30 2023-07-27T14:36:28.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.487+0000 7fc58bbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5840c0f90 con 0x7fc5840c0610 2023-07-27T14:36:28.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.487+0000 7fc58bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840c5d70 con 0x7fc5840bfb50 2023-07-27T14:36:28.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.487+0000 7fc58999b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc584153f30 0x7fc5840a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38714/0 (socket says 172.21.15.115:38714) 2023-07-27T14:36:28.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.487+0000 7fc58999b700 1 -- 172.21.15.115:0/2393990133 learned_addr learned my addr 172.21.15.115:0/2393990133 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:28.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc58a19c700 1 --2- 172.21.15.115:0/2393990133 >> v2:172.21.15.115:3300/0 conn(0x7fc5840c0610 0x7fc5840c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:28.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc58919a700 1 --2- 172.21.15.115:0/2393990133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840bfb50 0x7fc5840c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:28.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc588999700 1 -- 172.21.15.115:0/2393990133 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828998674 0 0) 0x7fc5840c60a0 con 0x7fc584153f30 2023-07-27T14:36:28.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc588999700 1 -- 172.21.15.115:0/2393990133 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5700033f0 con 0x7fc584153f30 2023-07-27T14:36:28.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc58a19c700 1 -- 172.21.15.115:0/2393990133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840bfb50 msgr2=0x7fc5840c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:28.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc58a19c700 1 --2- 172.21.15.115:0/2393990133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840bfb50 0x7fc5840c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc58a19c700 1 -- 172.21.15.115:0/2393990133 >> v1:172.21.15.115:6789/0 conn(0x7fc584153f30 legacy=0x7fc5840a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc58a19c700 1 -- 172.21.15.115:0/2393990133 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840c7d80 con 0x7fc5840c0610 2023-07-27T14:36:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc58a19c700 1 --2- 172.21.15.115:0/2393990133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840c0610 0x7fc5840c0aa0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7fc57c009e60 tx=0x7fc57c009780).ready entity=mon.0 client_cookie=6451ef4f6d2648fb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc588999700 1 -- 172.21.15.115:0/2393990133 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00e070 con 0x7fc5840c0610 2023-07-27T14:36:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc588999700 1 -- 172.21.15.115:0/2393990133 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c00bab0 con 0x7fc5840c0610 2023-07-27T14:36:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.488+0000 7fc588999700 1 -- 172.21.15.115:0/2393990133 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00be30 con 0x7fc5840c0610 2023-07-27T14:36:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.489+0000 7fc58bbff700 1 -- 172.21.15.115:0/2393990133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840c0610 msgr2=0x7fc5840c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.489+0000 7fc58bbff700 1 --2- 172.21.15.115:0/2393990133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840c0610 0x7fc5840c0aa0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7fc57c009e60 tx=0x7fc57c009780).stop 2023-07-27T14:36:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.489+0000 7fc58bbff700 1 -- 172.21.15.115:0/2393990133 shutdown_connections 2023-07-27T14:36:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.489+0000 7fc58bbff700 1 --2- 172.21.15.115:0/2393990133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840c0610 0x7fc5840c0aa0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.489+0000 7fc58bbff700 1 --2- 172.21.15.115:0/2393990133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840bfb50 0x7fc5840c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.489+0000 7fc58bbff700 1 -- 172.21.15.115:0/2393990133 >> 172.21.15.115:0/2393990133 conn(0x7fc584094280 msgr2=0x7fc58405e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:28.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.489+0000 7fc58bbff700 1 -- 172.21.15.115:0/2393990133 shutdown_connections 2023-07-27T14:36:28.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.489+0000 7fc58bbff700 1 -- 172.21.15.115:0/2393990133 wait complete. 2023-07-27T14:36:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.491+0000 7fc58bbff700 1 Processor -- start 2023-07-27T14:36:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.491+0000 7fc58bbff700 1 -- start start 2023-07-27T14:36:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58bbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840bfb50 0x7fc5840cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840c0610 0x7fc5841528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58bbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc584153f30 0x7fc5840633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:28.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58bbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840cb810 con 0x7fc5840bfb50 2023-07-27T14:36:28.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58bbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584153490 con 0x7fc584153f30 2023-07-27T14:36:28.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5841531b0 con 0x7fc5840c0610 2023-07-27T14:36:28.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840bfb50 0x7fc5840cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:28.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840bfb50 0x7fc5840cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49700/0 (socket says 172.21.15.115:49700) 2023-07-27T14:36:28.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 -- 172.21.15.115:0/3099067190 learned_addr learned my addr 172.21.15.115:0/3099067190 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:28.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58a19c700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc584153f30 0x7fc5840633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:28.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58919a700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840c0610 0x7fc5841528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:28.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 -- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840c0610 msgr2=0x7fc5841528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:28.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840c0610 0x7fc5841528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 -- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc584153f30 msgr2=0x7fc5840633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:28.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc584153f30 0x7fc5840633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:28.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 -- 172.21.15.115:0/3099067190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c009a20 con 0x7fc5840bfb50 2023-07-27T14:36:28.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58919a700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840c0610 0x7fc5841528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:28.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58a19c700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc584153f30 0x7fc5840633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:28.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.492+0000 7fc58999b700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840bfb50 0x7fc5840cb320 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7fc58000c450 tx=0x7fc580007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:28.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.493+0000 7fc579ffb700 1 -- 172.21.15.115:0/3099067190 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800072e0 con 0x7fc5840bfb50 2023-07-27T14:36:28.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.493+0000 7fc579ffb700 1 -- 172.21.15.115:0/3099067190 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580007440 con 0x7fc5840bfb50 2023-07-27T14:36:28.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.493+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5840c8a50 con 0x7fc5840bfb50 2023-07-27T14:36:28.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.493+0000 7fc579ffb700 1 -- 172.21.15.115:0/3099067190 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800057a0 con 0x7fc5840bfb50 2023-07-27T14:36:28.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.493+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5840c9010 con 0x7fc5840bfb50 2023-07-27T14:36:28.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.494+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5840c9230 con 0x7fc5840bfb50 2023-07-27T14:36:28.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.495+0000 7fc579ffb700 1 -- 172.21.15.115:0/3099067190 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fc58001a060 con 0x7fc5840bfb50 2023-07-27T14:36:28.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.495+0000 7fc579ffb700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc56805f880 0x7fc568061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:28.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.495+0000 7fc579ffb700 1 -- 172.21.15.115:0/3099067190 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc580079cf0 con 0x7fc5840bfb50 2023-07-27T14:36:28.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.496+0000 7fc58919a700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc56805f880 0x7fc568061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:28.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.496+0000 7fc58919a700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc56805f880 0x7fc568061d40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fc574006d80 tx=0x7fc574008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:28.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.499+0000 7fc579ffb700 1 -- 172.21.15.115:0/3099067190 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc58004aa70 con 0x7fc5840bfb50 2023-07-27T14:36:28.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:28.709+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc58406c470 con 0x7fc5840bfb50 2023-07-27T14:36:29.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.276+0000 7fc579ffb700 1 -- 172.21.15.115:0/3099067190 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc580018070 con 0x7fc5840bfb50 2023-07-27T14:36:29.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc56805f880 msgr2=0x7fc568061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc56805f880 0x7fc568061d40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fc574006d80 tx=0x7fc574008040).stop 2023-07-27T14:36:29.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840bfb50 msgr2=0x7fc5840cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840bfb50 0x7fc5840cb320 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7fc58000c450 tx=0x7fc580007c80).stop 2023-07-27T14:36:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 shutdown_connections 2023-07-27T14:36:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc56805f880 0x7fc568061d40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc584153f30 0x7fc5840633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5840bfb50 0x7fc5840cb320 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 --2- 172.21.15.115:0/3099067190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc5840c0610 0x7fc5841528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.278+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 >> 172.21.15.115:0/3099067190 conn(0x7fc584094280 msgr2=0x7fc5840c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:29.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.279+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 shutdown_connections 2023-07-27T14:36:29.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.279+0000 7fc58bbff700 1 -- 172.21.15.115:0/3099067190 wait complete. 2023-07-27T14:36:29.344 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:36:29.345 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:36:29.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.485+0000 7fa01fdff700 1 Processor -- start 2023-07-27T14:36:29.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.485+0000 7fa01fdff700 1 -- start start 2023-07-27T14:36:29.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01fdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa018153ec0 0x7fa0180a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01fdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa0180aaa40 0x7fa0180c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01fdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0180aa4d0 con 0x7fa0180aa050 2023-07-27T14:36:29.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01fdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180c05c0 con 0x7fa018153ec0 2023-07-27T14:36:29.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01fdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180bfc90 con 0x7fa0180aaa40 2023-07-27T14:36:29.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01db9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa018153ec0 0x7fa0180a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01d39a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa0180aa050 0x7fa0180640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38730/0 (socket says 172.21.15.115:38730) 2023-07-27T14:36:29.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01d39a700 1 -- 172.21.15.115:0/3313751720 learned_addr learned my addr 172.21.15.115:0/3313751720 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:29.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.487+0000 7fa01e39c700 1 --2- 172.21.15.115:0/3313751720 >> v2:172.21.15.159:3300/0 conn(0x7fa0180aaa40 0x7fa0180c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01cb99700 1 -- 172.21.15.115:0/3313751720 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655443483 0 0) 0x7fa008001110 con 0x7fa0180aa050 2023-07-27T14:36:29.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01db9b700 1 -- 172.21.15.115:0/3313751720 >> v2:172.21.15.159:3300/0 conn(0x7fa0180aaa40 msgr2=0x7fa0180c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:29.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01db9b700 1 --2- 172.21.15.115:0/3313751720 >> v2:172.21.15.159:3300/0 conn(0x7fa0180aaa40 0x7fa0180c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01db9b700 1 -- 172.21.15.115:0/3313751720 >> v1:172.21.15.115:6789/0 conn(0x7fa0180aa050 legacy=0x7fa0180640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01db9b700 1 -- 172.21.15.115:0/3313751720 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180bff70 con 0x7fa018153ec0 2023-07-27T14:36:29.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01e39c700 1 --2- 172.21.15.115:0/3313751720 >> v2:172.21.15.159:3300/0 conn(0x7fa0180aaa40 0x7fa0180c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:29.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01db9b700 1 --2- 172.21.15.115:0/3313751720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa0180a9b60 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fa0180c5470 tx=0x7fa014009060).ready entity=mon.0 client_cookie=5d17c673936e1f9f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:29.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01cb99700 1 -- 172.21.15.115:0/3313751720 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400b580 con 0x7fa018153ec0 2023-07-27T14:36:29.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01cb99700 1 -- 172.21.15.115:0/3313751720 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01400b6e0 con 0x7fa018153ec0 2023-07-27T14:36:29.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.488+0000 7fa01cb99700 1 -- 172.21.15.115:0/3313751720 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400ba60 con 0x7fa018153ec0 2023-07-27T14:36:29.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.489+0000 7fa01fdff700 1 -- 172.21.15.115:0/3313751720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 msgr2=0x7fa0180a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.489+0000 7fa01fdff700 1 --2- 172.21.15.115:0/3313751720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa0180a9b60 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7fa0180c5470 tx=0x7fa014009060).stop 2023-07-27T14:36:29.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.489+0000 7fa01fdff700 1 -- 172.21.15.115:0/3313751720 shutdown_connections 2023-07-27T14:36:29.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.489+0000 7fa01fdff700 1 --2- 172.21.15.115:0/3313751720 >> v2:172.21.15.159:3300/0 conn(0x7fa0180aaa40 0x7fa0180c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.489+0000 7fa01fdff700 1 --2- 172.21.15.115:0/3313751720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa018153ec0 0x7fa0180a9b60 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.489+0000 7fa01fdff700 1 -- 172.21.15.115:0/3313751720 >> 172.21.15.115:0/3313751720 conn(0x7fa0180cb610 msgr2=0x7fa0180c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:29.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.489+0000 7fa01fdff700 1 -- 172.21.15.115:0/3313751720 shutdown_connections 2023-07-27T14:36:29.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.489+0000 7fa01fdff700 1 -- 172.21.15.115:0/3313751720 wait complete. 2023-07-27T14:36:29.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.491+0000 7fa01fdff700 1 Processor -- start 2023-07-27T14:36:29.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.491+0000 7fa01fdff700 1 -- start start 2023-07-27T14:36:29.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.492+0000 7fa01fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0180aa050 0x7fa01813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.492+0000 7fa01fdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa018152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.492+0000 7fa01fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa018153ec0 0x7fa018151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.492+0000 7fa01fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01813f4f0 con 0x7fa0180aa050 2023-07-27T14:36:29.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.492+0000 7fa01fdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0181515e0 con 0x7fa0180aaa40 2023-07-27T14:36:29.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.492+0000 7fa01fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01814f370 con 0x7fa018153ec0 2023-07-27T14:36:29.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.492+0000 7fa01db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0180aa050 0x7fa01813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0180aa050 0x7fa01813f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49726/0 (socket says 172.21.15.115:49726) 2023-07-27T14:36:29.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01db9b700 1 -- 172.21.15.115:0/1569522151 learned_addr learned my addr 172.21.15.115:0/1569522151 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:29.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01d39a700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa018152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01e39c700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa018153ec0 0x7fa018151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01db9b700 1 -- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa018153ec0 msgr2=0x7fa018151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01db9b700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa018153ec0 0x7fa018151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01db9b700 1 -- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 msgr2=0x7fa018152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01db9b700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa018152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01db9b700 1 -- 172.21.15.115:0/1569522151 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140092a0 con 0x7fa0180aa050 2023-07-27T14:36:29.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01d39a700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa018152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:29.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01e39c700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa018153ec0 0x7fa018151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:29.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01db9b700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0180aa050 0x7fa01813f000 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7fa014009fd0 tx=0x7fa014017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:29.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa00dffb700 1 -- 172.21.15.115:0/1569522151 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400b850 con 0x7fa0180aa050 2023-07-27T14:36:29.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa00dffb700 1 -- 172.21.15.115:0/1569522151 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01400b9b0 con 0x7fa0180aa050 2023-07-27T14:36:29.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa018153300 con 0x7fa0180aa050 2023-07-27T14:36:29.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.493+0000 7fa00dffb700 1 -- 172.21.15.115:0/1569522151 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01401b670 con 0x7fa0180aa050 2023-07-27T14:36:29.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.494+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa018150cb0 con 0x7fa0180aa050 2023-07-27T14:36:29.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.495+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01806c470 con 0x7fa0180aa050 2023-07-27T14:36:29.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.495+0000 7fa00dffb700 1 -- 172.21.15.115:0/1569522151 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fa01402a070 con 0x7fa0180aa050 2023-07-27T14:36:29.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.496+0000 7fa00dffb700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9ffc05f880 0x7f9ffc061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.496+0000 7fa00dffb700 1 -- 172.21.15.115:0/1569522151 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa01407c230 con 0x7fa0180aa050 2023-07-27T14:36:29.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.496+0000 7fa01d39a700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9ffc05f880 0x7f9ffc061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.497+0000 7fa01d39a700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9ffc05f880 0x7f9ffc061d40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fa0180c4870 tx=0x7fa008009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:29.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.500+0000 7fa00dffb700 1 -- 172.21.15.115:0/1569522151 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa01404cce0 con 0x7fa0180aa050 2023-07-27T14:36:29.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.709+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0181518c0 con 0x7fa0180aa050 2023-07-27T14:36:29.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.710+0000 7fa00dffb700 1 -- 172.21.15.115:0/1569522151 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fa014028090 con 0x7fa0180aa050 2023-07-27T14:36:29.758 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:29.758 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2898407097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2898407097},{"type":"v1","addr":"172.21.15.115:6837","nonce":2898407097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6929,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/112108246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":112108246},{"type":"v1","addr":"172.21.15.159:6835","nonce":112108246}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/680715955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":680715955},{"type":"v1","addr":"172.21.15.115:6836","nonce":680715955}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:36:26.258376+0000","modified":"2023-07-27T14:36:29.273687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7807},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7807":{"gid":7807,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/3102980678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3102980678},{"type":"v1","addr":"172.21.15.159:6834","nonce":3102980678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-07-27T14:36:29.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9ffc05f880 msgr2=0x7f9ffc061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9ffc05f880 0x7f9ffc061d40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fa0180c4870 tx=0x7fa008009040).stop 2023-07-27T14:36:29.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0180aa050 msgr2=0x7fa01813f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0180aa050 0x7fa01813f000 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7fa014009fd0 tx=0x7fa014017000).stop 2023-07-27T14:36:29.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 shutdown_connections 2023-07-27T14:36:29.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9ffc05f880 0x7f9ffc061d40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa018153ec0 0x7fa018151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0180aa050 0x7fa01813f000 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 --2- 172.21.15.115:0/1569522151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0180aaa40 0x7fa018152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 >> 172.21.15.115:0/1569522151 conn(0x7fa0180cb610 msgr2=0x7fa0180c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:29.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 shutdown_connections 2023-07-27T14:36:29.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.712+0000 7fa01fdff700 1 -- 172.21.15.115:0/1569522151 wait complete. 2023-07-27T14:36:29.762 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 84 2023-07-27T14:36:29.777 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:36:29.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.917+0000 7f84a9dff700 1 Processor -- start 2023-07-27T14:36:29.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.917+0000 7f84a9dff700 1 -- start start 2023-07-27T14:36:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a9dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84a4153ec0 0x7f84a40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a9dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f84a40aa050 0x7f84a40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a9dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a40aaa40 0x7f84a40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a9dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a4064ad0 con 0x7f84a4153ec0 2023-07-27T14:36:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a9dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a40aa4d0 con 0x7f84a40aa050 2023-07-27T14:36:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a9dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40c05c0 con 0x7f84a40aaa40 2023-07-27T14:36:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84a4153ec0 0x7f84a40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84a4153ec0 0x7f84a40a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49734/0 (socket says 172.21.15.115:49734) 2023-07-27T14:36:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a37fe700 1 -- 172.21.15.115:0/2583850862 learned_addr learned my addr 172.21.15.115:0/2583850862 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a3fff700 1 --2- 172.21.15.115:0/2583850862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a40aaa40 0x7f84a40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a2ffd700 1 --2- 172.21.15.115:0/2583850862 >> v2:172.21.15.159:3300/0 conn(0x7f84a40aa050 0x7f84a40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a37fe700 1 -- 172.21.15.115:0/2583850862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a40aaa40 msgr2=0x7f84a40645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a37fe700 1 --2- 172.21.15.115:0/2583850862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a40aaa40 0x7f84a40645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a37fe700 1 -- 172.21.15.115:0/2583850862 >> v2:172.21.15.159:3300/0 conn(0x7f84a40aa050 msgr2=0x7f84a40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a37fe700 1 --2- 172.21.15.115:0/2583850862 >> v2:172.21.15.159:3300/0 conn(0x7f84a40aa050 0x7f84a40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a37fe700 1 -- 172.21.15.115:0/2583850862 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a40bfc90 con 0x7f84a4153ec0 2023-07-27T14:36:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.919+0000 7f84a2ffd700 1 --2- 172.21.15.115:0/2583850862 >> v2:172.21.15.159:3300/0 conn(0x7f84a40aa050 0x7f84a40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a37fe700 1 --2- 172.21.15.115:0/2583850862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a4153ec0 0x7f84a40a9b60 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f84a406c0d0 tx=0x7f84940090f0).ready entity=mon.0 client_cookie=80c0ed6c714534d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a27fc700 1 -- 172.21.15.115:0/2583850862 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400b520 con 0x7f84a4153ec0 2023-07-27T14:36:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a27fc700 1 -- 172.21.15.115:0/2583850862 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849400b680 con 0x7f84a4153ec0 2023-07-27T14:36:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a27fc700 1 -- 172.21.15.115:0/2583850862 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400ba00 con 0x7f84a4153ec0 2023-07-27T14:36:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a9dff700 1 -- 172.21.15.115:0/2583850862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a4153ec0 msgr2=0x7f84a40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a9dff700 1 --2- 172.21.15.115:0/2583850862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a4153ec0 0x7f84a40a9b60 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f84a406c0d0 tx=0x7f84940090f0).stop 2023-07-27T14:36:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a9dff700 1 -- 172.21.15.115:0/2583850862 shutdown_connections 2023-07-27T14:36:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a9dff700 1 --2- 172.21.15.115:0/2583850862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a40aaa40 0x7f84a40645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a9dff700 1 --2- 172.21.15.115:0/2583850862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a4153ec0 0x7f84a40a9b60 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a9dff700 1 --2- 172.21.15.115:0/2583850862 >> v2:172.21.15.159:3300/0 conn(0x7f84a40aa050 0x7f84a40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.920+0000 7f84a9dff700 1 -- 172.21.15.115:0/2583850862 >> 172.21.15.115:0/2583850862 conn(0x7f84a40cb610 msgr2=0x7f84a40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.921+0000 7f84a9dff700 1 -- 172.21.15.115:0/2583850862 shutdown_connections 2023-07-27T14:36:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.921+0000 7f84a9dff700 1 -- 172.21.15.115:0/2583850862 wait complete. 2023-07-27T14:36:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.922+0000 7f84a9dff700 1 Processor -- start 2023-07-27T14:36:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.922+0000 7f84a9dff700 1 -- start start 2023-07-27T14:36:29.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a9dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84a40aa050 0x7f84a41530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a9dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a40aaa40 0x7f84a40c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a9dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a4153ec0 0x7f84a41487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a9dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40c3f40 con 0x7f84a40aaa40 2023-07-27T14:36:29.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a9dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a414f210 con 0x7f84a40aa050 2023-07-27T14:36:29.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a9dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40c48c0 con 0x7f84a4153ec0 2023-07-27T14:36:29.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a40aaa40 0x7f84a40c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a40aaa40 0x7f84a40c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49748/0 (socket says 172.21.15.115:49748) 2023-07-27T14:36:29.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a2ffd700 1 -- 172.21.15.115:0/3760983692 learned_addr learned my addr 172.21.15.115:0/3760983692 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:29.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a37fe700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84a40aa050 0x7f84a41530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.923+0000 7f84a3fff700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a4153ec0 0x7f84a41487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f84a2ffd700 1 -- 172.21.15.115:0/3760983692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a4153ec0 msgr2=0x7f84a41487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f84a2ffd700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a4153ec0 0x7f84a41487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f84a2ffd700 1 -- 172.21.15.115:0/3760983692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84a40aa050 msgr2=0x7f84a41530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:29.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f84a2ffd700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84a40aa050 0x7f84a41530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:29.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f84a2ffd700 1 -- 172.21.15.115:0/3760983692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009370 con 0x7f84a40aaa40 2023-07-27T14:36:29.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f84a2ffd700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a40aaa40 0x7f84a40c43d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f849800d860 tx=0x7f8498008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:29.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f848b7fe700 1 -- 172.21.15.115:0/3760983692 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800f520 con 0x7f84a40aaa40 2023-07-27T14:36:29.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f848b7fe700 1 -- 172.21.15.115:0/3760983692 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849800f680 con 0x7f84a40aaa40 2023-07-27T14:36:29.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f848b7fe700 1 -- 172.21.15.115:0/3760983692 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800fa00 con 0x7f84a40aaa40 2023-07-27T14:36:29.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a4153690 con 0x7f84a40aaa40 2023-07-27T14:36:29.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.924+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a40c3bd0 con 0x7f84a40aaa40 2023-07-27T14:36:29.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.925+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a40c40b0 con 0x7f84a40aaa40 2023-07-27T14:36:29.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.926+0000 7f848b7fe700 1 -- 172.21.15.115:0/3760983692 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f849801a030 con 0x7f84a40aaa40 2023-07-27T14:36:29.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.927+0000 7f848b7fe700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f849005f880 0x7f8490061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:29.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.927+0000 7f848b7fe700 1 -- 172.21.15.115:0/3760983692 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f849807a2b0 con 0x7f84a40aaa40 2023-07-27T14:36:29.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.927+0000 7f84a37fe700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f849005f880 0x7f8490061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:29.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.928+0000 7f84a37fe700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f849005f880 0x7f8490061d40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f8494009130 tx=0x7f8494017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:29.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:29.931+0000 7f848b7fe700 1 -- 172.21.15.115:0/3760983692 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f849804b140 con 0x7f84a40aaa40 2023-07-27T14:36:30.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.103+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84a40bff70 con 0x7f84a40aaa40 2023-07-27T14:36:30.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.104+0000 7f848b7fe700 1 -- 172.21.15.115:0/3760983692 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+17086 (secure 0 0 0) 0x7f849804e760 con 0x7f84a40aaa40 2023-07-27T14:36:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:30.152 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":158,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:36:27.260337+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:36:24.547249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-27T14:36:25.235805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:36:30.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f849005f880 msgr2=0x7f8490061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f849005f880 0x7f8490061d40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f8494009130 tx=0x7f8494017000).stop 2023-07-27T14:36:30.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a40aaa40 msgr2=0x7f84a40c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a40aaa40 0x7f84a40c43d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f849800d860 tx=0x7f8498008040).stop 2023-07-27T14:36:30.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 shutdown_connections 2023-07-27T14:36:30.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f849005f880 0x7f8490061d40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84a4153ec0 0x7f84a41487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84a40aa050 0x7f84a41530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 --2- 172.21.15.115:0/3760983692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a40aaa40 0x7f84a40c43d0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 >> 172.21.15.115:0/3760983692 conn(0x7f84a40cb610 msgr2=0x7f84a40ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:30.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 shutdown_connections 2023-07-27T14:36:30.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.106+0000 7f84a9dff700 1 -- 172.21.15.115:0/3760983692 wait complete. 2023-07-27T14:36:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:36:30.171 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:36:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.312+0000 7f921c3ff700 1 Processor -- start 2023-07-27T14:36:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.312+0000 7f921c3ff700 1 -- start start 2023-07-27T14:36:30.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.313+0000 7f921c3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9214150320 0x7f9214150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.313+0000 7f921c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92140c0e80 0x7f9214069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.313+0000 7f921c3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9214068380 con 0x7f9214065020 2023-07-27T14:36:30.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.313+0000 7f921c3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9214065790 con 0x7f9214150320 2023-07-27T14:36:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.313+0000 7f921c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9214068ee0 con 0x7f92140c0e80 2023-07-27T14:36:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921a99c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9214065020 0x7f92140c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38732/0 (socket says 172.21.15.115:38732) 2023-07-27T14:36:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9214150320 0x7f9214150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921a99c700 1 -- 172.21.15.115:0/2600809697 learned_addr learned my addr 172.21.15.115:0/2600809697 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921999a700 1 --2- 172.21.15.115:0/2600809697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92140c0e80 0x7f9214069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921a19b700 1 -- 172.21.15.115:0/2600809697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92140c0e80 msgr2=0x7f9214069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921a19b700 1 --2- 172.21.15.115:0/2600809697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92140c0e80 0x7f9214069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921a19b700 1 -- 172.21.15.115:0/2600809697 >> v1:172.21.15.115:6789/0 conn(0x7f9214065020 legacy=0x7f92140c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921a19b700 1 -- 172.21.15.115:0/2600809697 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140685b0 con 0x7f9214150320 2023-07-27T14:36:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f9219199700 1 -- 172.21.15.115:0/2600809697 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927397444 0 0) 0x7f9214068380 con 0x7f9214065020 2023-07-27T14:36:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f921a19b700 1 --2- 172.21.15.115:0/2600809697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9214150320 0x7f9214150700 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f9210009760 tx=0x7f9210009060).ready entity=mon.0 client_cookie=7f2b0dbf4a7cc28b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f9219199700 1 -- 172.21.15.115:0/2600809697 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000b580 con 0x7f9214150320 2023-07-27T14:36:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f9219199700 1 -- 172.21.15.115:0/2600809697 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921000b6e0 con 0x7f9214150320 2023-07-27T14:36:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.314+0000 7f9219199700 1 -- 172.21.15.115:0/2600809697 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000ba60 con 0x7f9214150320 2023-07-27T14:36:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.315+0000 7f921c3ff700 1 -- 172.21.15.115:0/2600809697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9214150320 msgr2=0x7f9214150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.315+0000 7f921c3ff700 1 --2- 172.21.15.115:0/2600809697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9214150320 0x7f9214150700 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f9210009760 tx=0x7f9210009060).stop 2023-07-27T14:36:30.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.315+0000 7f921c3ff700 1 -- 172.21.15.115:0/2600809697 shutdown_connections 2023-07-27T14:36:30.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.315+0000 7f921c3ff700 1 --2- 172.21.15.115:0/2600809697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9214150320 0x7f9214150700 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.315+0000 7f921c3ff700 1 --2- 172.21.15.115:0/2600809697 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f92140c0e80 0x7f9214069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.315+0000 7f921c3ff700 1 -- 172.21.15.115:0/2600809697 >> 172.21.15.115:0/2600809697 conn(0x7f9214062320 msgr2=0x7f9214062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:30.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.315+0000 7f921c3ff700 1 -- 172.21.15.115:0/2600809697 shutdown_connections 2023-07-27T14:36:30.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.315+0000 7f921c3ff700 1 -- 172.21.15.115:0/2600809697 wait complete. 2023-07-27T14:36:30.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.317+0000 7f921c3ff700 1 Processor -- start 2023-07-27T14:36:30.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.317+0000 7f921c3ff700 1 -- start start 2023-07-27T14:36:30.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9214065020 0x7f9214156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921c3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92140c0e80 0x7f92140abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921c3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9214150320 0x7f92140ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921c3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92140aa6e0 con 0x7f92140c0e80 2023-07-27T14:36:30.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921c3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214152110 con 0x7f9214150320 2023-07-27T14:36:30.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92141517e0 con 0x7f9214065020 2023-07-27T14:36:30.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92140c0e80 0x7f92140abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92140c0e80 0x7f92140abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49772/0 (socket says 172.21.15.115:49772) 2023-07-27T14:36:30.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921999a700 1 -- 172.21.15.115:0/3775261661 learned_addr learned my addr 172.21.15.115:0/3775261661 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:30.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921999a700 1 -- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9214065020 msgr2=0x7f9214156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921a19b700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9214065020 0x7f9214156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921a99c700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9214150320 0x7f92140ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921999a700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9214065020 0x7f9214156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921999a700 1 -- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9214150320 msgr2=0x7f92140ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921999a700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9214150320 0x7f92140ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921999a700 1 -- 172.21.15.115:0/3775261661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100092a0 con 0x7f92140c0e80 2023-07-27T14:36:30.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921a19b700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9214065020 0x7f9214156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:30.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.318+0000 7f921a99c700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9214150320 0x7f92140ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:30.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.319+0000 7f921999a700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92140c0e80 0x7f92140abb90 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f920400d990 tx=0x7f9204008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:30.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.319+0000 7f920a7fc700 1 -- 172.21.15.115:0/3775261661 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400de00 con 0x7f92140c0e80 2023-07-27T14:36:30.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.319+0000 7f920a7fc700 1 -- 172.21.15.115:0/3775261661 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920400a7d0 con 0x7f92140c0e80 2023-07-27T14:36:30.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.319+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9214151ac0 con 0x7f92140c0e80 2023-07-27T14:36:30.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.319+0000 7f920a7fc700 1 -- 172.21.15.115:0/3775261661 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400ab50 con 0x7f92140c0e80 2023-07-27T14:36:30.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.319+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92140ac570 con 0x7f92140c0e80 2023-07-27T14:36:30.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.320+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921406c470 con 0x7f92140c0e80 2023-07-27T14:36:30.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.321+0000 7f920a7fc700 1 -- 172.21.15.115:0/3775261661 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f920400e040 con 0x7f92140c0e80 2023-07-27T14:36:30.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.321+0000 7f920a7fc700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f805f880 0x7f91f8061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.322+0000 7f920a7fc700 1 -- 172.21.15.115:0/3775261661 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f920407a700 con 0x7f92140c0e80 2023-07-27T14:36:30.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.322+0000 7f921a19b700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f805f880 0x7f91f8061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.322+0000 7f921a19b700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f805f880 0x7f91f8061d40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f921000b340 tx=0x7f9210017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:30.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.325+0000 7f920a7fc700 1 -- 172.21.15.115:0/3775261661 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f920404b590 con 0x7f92140c0e80 2023-07-27T14:36:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.490+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9214064bd0 con 0x7f91f805f880 2023-07-27T14:36:30.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.500+0000 7f920a7fc700 1 -- 172.21.15.115:0/3775261661 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361721 (secure 0 0 0) 0x7f9214064bd0 con 0x7f91f805f880 2023-07-27T14:36:30.552 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:30.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f805f880 msgr2=0x7f91f8061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f805f880 0x7f91f8061d40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f921000b340 tx=0x7f9210017000).stop 2023-07-27T14:36:30.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92140c0e80 msgr2=0x7f92140abb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92140c0e80 0x7f92140abb90 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f920400d990 tx=0x7f9204008040).stop 2023-07-27T14:36:30.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 shutdown_connections 2023-07-27T14:36:30.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91f805f880 0x7f91f8061d40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9214150320 0x7f92140ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9214065020 0x7f9214156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.504+0000 7f921c3ff700 1 --2- 172.21.15.115:0/3775261661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92140c0e80 0x7f92140abb90 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.505+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 >> 172.21.15.115:0/3775261661 conn(0x7f9214062320 msgr2=0x7f92140bc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:30.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.505+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 shutdown_connections 2023-07-27T14:36:30.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.505+0000 7f921c3ff700 1 -- 172.21.15.115:0/3775261661 wait complete. 2023-07-27T14:36:30.556 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:36:30.569 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2023-07-27T14:36:29.566065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":250,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":158464,"kb_used_data":15488,"kb_used_omap":0,"kb_used_meta":142912,"kb_avail":754816256,"statfs":{"total":773094113280,"available":772931846144,"internally_reserved":0,"allocated":15859712,"data_stored":7454812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146341888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1912440,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-79,"num_read_kb":-65563,"num_write":-553,"num_write_kb":-133038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":-27,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.189561"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286591+0000","last_change":"2023-07-27T14:36:26.283564+0000","last_active":"2023-07-27T14:36:26.286591+0000","last_peered":"2023-07-27T14:36:26.286591+0000","last_clean":"2023-07-27T14:36:26.286591+0000","last_became_active":"2023-07-27T14:36:26.283299+0000","last_became_peered":"2023-07-27T14:36:26.283299+0000","last_unstale":"2023-07-27T14:36:26.286591+0000","last_undegraded":"2023-07-27T14:36:26.286591+0000","last_fullsized":"2023-07-27T14:36:26.286591+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"157'3","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.290919+0000","last_change":"2023-07-27T14:36:25.810123+0000","last_active":"2023-07-27T14:36:26.290919+0000","last_peered":"2023-07-27T14:36:26.290919+0000","last_clean":"2023-07-27T14:36:26.290919+0000","last_became_active":"2023-07-27T14:36:25.809817+0000","last_became_peered":"2023-07-27T14:36:25.809817+0000","last_unstale":"2023-07-27T14:36:26.290919+0000","last_undegraded":"2023-07-27T14:36:26.290919+0000","last_fullsized":"2023-07-27T14:36:26.290919+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.300803+0000","last_change":"2023-07-27T14:36:26.296420+0000","last_active":"2023-07-27T14:36:26.300803+0000","last_peered":"2023-07-27T14:36:26.300803+0000","last_clean":"2023-07-27T14:36:26.300803+0000","last_became_active":"2023-07-27T14:36:26.296201+0000","last_became_peered":"2023-07-27T14:36:26.296201+0000","last_unstale":"2023-07-27T14:36:26.300803+0000","last_undegraded":"2023-07-27T14:36:26.300803+0000","last_fullsized":"2023-07-27T14:36:26.300803+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266639+0000","last_change":"2023-07-27T14:36:25.811669+0000","last_active":"2023-07-27T14:36:26.266639+0000","last_peered":"2023-07-27T14:36:26.266639+0000","last_clean":"2023-07-27T14:36:26.266639+0000","last_became_active":"2023-07-27T14:36:25.811409+0000","last_became_peered":"2023-07-27T14:36:25.811409+0000","last_unstale":"2023-07-27T14:36:26.266639+0000","last_undegraded":"2023-07-27T14:36:26.266639+0000","last_fullsized":"2023-07-27T14:36:26.266639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.284722+0000","last_change":"2023-07-27T14:36:26.283320+0000","last_active":"2023-07-27T14:36:26.284722+0000","last_peered":"2023-07-27T14:36:26.284722+0000","last_clean":"2023-07-27T14:36:26.284722+0000","last_became_active":"2023-07-27T14:36:26.283006+0000","last_became_peered":"2023-07-27T14:36:26.283006+0000","last_unstale":"2023-07-27T14:36:26.284722+0000","last_undegraded":"2023-07-27T14:36:26.284722+0000","last_fullsized":"2023-07-27T14:36:26.284722+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277667+0000","last_change":"2023-07-27T14:36:25.810238+0000","last_active":"2023-07-27T14:36:26.277667+0000","last_peered":"2023-07-27T14:36:26.277667+0000","last_clean":"2023-07-27T14:36:26.277667+0000","last_became_active":"2023-07-27T14:36:25.809837+0000","last_became_peered":"2023-07-27T14:36:25.809837+0000","last_unstale":"2023-07-27T14:36:26.277667+0000","last_undegraded":"2023-07-27T14:36:26.277667+0000","last_fullsized":"2023-07-27T14:36:26.277667+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288657+0000","last_change":"2023-07-27T14:36:26.286216+0000","last_active":"2023-07-27T14:36:26.288657+0000","last_peered":"2023-07-27T14:36:26.288657+0000","last_clean":"2023-07-27T14:36:26.288657+0000","last_became_active":"2023-07-27T14:36:26.285883+0000","last_became_peered":"2023-07-27T14:36:26.285883+0000","last_unstale":"2023-07-27T14:36:26.288657+0000","last_undegraded":"2023-07-27T14:36:26.288657+0000","last_fullsized":"2023-07-27T14:36:26.288657+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.293146+0000","last_change":"2023-07-27T14:36:25.825388+0000","last_active":"2023-07-27T14:36:26.293146+0000","last_peered":"2023-07-27T14:36:26.293146+0000","last_clean":"2023-07-27T14:36:26.293146+0000","last_became_active":"2023-07-27T14:36:25.825046+0000","last_became_peered":"2023-07-27T14:36:25.825046+0000","last_unstale":"2023-07-27T14:36:26.293146+0000","last_undegraded":"2023-07-27T14:36:26.293146+0000","last_fullsized":"2023-07-27T14:36:26.293146+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295809+0000","last_change":"2023-07-27T14:36:26.287546+0000","last_active":"2023-07-27T14:36:26.295809+0000","last_peered":"2023-07-27T14:36:26.295809+0000","last_clean":"2023-07-27T14:36:26.295809+0000","last_became_active":"2023-07-27T14:36:26.287133+0000","last_became_peered":"2023-07-27T14:36:26.287133+0000","last_unstale":"2023-07-27T14:36:26.295809+0000","last_undegraded":"2023-07-27T14:36:26.295809+0000","last_fullsized":"2023-07-27T14:36:26.295809+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.289298+0000","last_change":"2023-07-27T14:36:25.817577+0000","last_active":"2023-07-27T14:36:26.289298+0000","last_peered":"2023-07-27T14:36:26.289298+0000","last_clean":"2023-07-27T14:36:26.289298+0000","last_became_active":"2023-07-27T14:36:25.816680+0000","last_became_peered":"2023-07-27T14:36:25.816680+0000","last_unstale":"2023-07-27T14:36:26.289298+0000","last_undegraded":"2023-07-27T14:36:26.289298+0000","last_fullsized":"2023-07-27T14:36:26.289298+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291673+0000","last_change":"2023-07-27T14:36:26.289462+0000","last_active":"2023-07-27T14:36:26.291673+0000","last_peered":"2023-07-27T14:36:26.291673+0000","last_clean":"2023-07-27T14:36:26.291673+0000","last_became_active":"2023-07-27T14:36:26.289127+0000","last_became_peered":"2023-07-27T14:36:26.289127+0000","last_unstale":"2023-07-27T14:36:26.291673+0000","last_undegraded":"2023-07-27T14:36:26.291673+0000","last_fullsized":"2023-07-27T14:36:26.291673+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.287129+0000","last_change":"2023-07-27T14:36:25.815477+0000","last_active":"2023-07-27T14:36:26.287129+0000","last_peered":"2023-07-27T14:36:26.287129+0000","last_clean":"2023-07-27T14:36:26.287129+0000","last_became_active":"2023-07-27T14:36:25.815158+0000","last_became_peered":"2023-07-27T14:36:25.815158+0000","last_unstale":"2023-07-27T14:36:26.287129+0000","last_undegraded":"2023-07-27T14:36:26.287129+0000","last_fullsized":"2023-07-27T14:36:26.287129+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279141+0000","last_change":"2023-07-27T14:36:26.273627+0000","last_active":"2023-07-27T14:36:26.279141+0000","last_peered":"2023-07-27T14:36:26.279141+0000","last_clean":"2023-07-27T14:36:26.279141+0000","last_became_active":"2023-07-27T14:36:26.272932+0000","last_became_peered":"2023-07-27T14:36:26.272932+0000","last_unstale":"2023-07-27T14:36:26.279141+0000","last_undegraded":"2023-07-27T14:36:26.279141+0000","last_fullsized":"2023-07-27T14:36:26.279141+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265497+0000","last_change":"2023-07-27T14:36:25.826798+0000","last_active":"2023-07-27T14:36:26.265497+0000","last_peered":"2023-07-27T14:36:26.265497+0000","last_clean":"2023-07-27T14:36:26.265497+0000","last_became_active":"2023-07-27T14:36:25.826503+0000","last_became_peered":"2023-07-27T14:36:25.826503+0000","last_unstale":"2023-07-27T14:36:26.265497+0000","last_undegraded":"2023-07-27T14:36:26.265497+0000","last_fullsized":"2023-07-27T14:36:26.265497+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277235+0000","last_change":"2023-07-27T14:36:26.273552+0000","last_active":"2023-07-27T14:36:26.277235+0000","last_peered":"2023-07-27T14:36:26.277235+0000","last_clean":"2023-07-27T14:36:26.277235+0000","last_became_active":"2023-07-27T14:36:26.273296+0000","last_became_peered":"2023-07-27T14:36:26.273296+0000","last_unstale":"2023-07-27T14:36:26.277235+0000","last_undegraded":"2023-07-27T14:36:26.277235+0000","last_fullsized":"2023-07-27T14:36:26.277235+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265310+0000","last_change":"2023-07-27T14:36:25.812627+0000","last_active":"2023-07-27T14:36:26.265310+0000","last_peered":"2023-07-27T14:36:26.265310+0000","last_clean":"2023-07-27T14:36:26.265310+0000","last_became_active":"2023-07-27T14:36:25.812260+0000","last_became_peered":"2023-07-27T14:36:25.812260+0000","last_unstale":"2023-07-27T14:36:26.265310+0000","last_undegraded":"2023-07-27T14:36:26.265310+0000","last_fullsized":"2023-07-27T14:36:26.265310+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286608+0000","last_change":"2023-07-27T14:36:26.283686+0000","last_active":"2023-07-27T14:36:26.286608+0000","last_peered":"2023-07-27T14:36:26.286608+0000","last_clean":"2023-07-27T14:36:26.286608+0000","last_became_active":"2023-07-27T14:36:26.283430+0000","last_became_peered":"2023-07-27T14:36:26.283430+0000","last_unstale":"2023-07-27T14:36:26.286608+0000","last_undegraded":"2023-07-27T14:36:26.286608+0000","last_fullsized":"2023-07-27T14:36:26.286608+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266366+0000","last_change":"2023-07-27T14:36:25.816271+0000","last_active":"2023-07-27T14:36:26.266366+0000","last_peered":"2023-07-27T14:36:26.266366+0000","last_clean":"2023-07-27T14:36:26.266366+0000","last_became_active":"2023-07-27T14:36:25.815933+0000","last_became_peered":"2023-07-27T14:36:25.815933+0000","last_unstale":"2023-07-27T14:36:26.266366+0000","last_undegraded":"2023-07-27T14:36:26.266366+0000","last_fullsized":"2023-07-27T14:36:26.266366+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296343+0000","last_change":"2023-07-27T14:36:26.294835+0000","last_active":"2023-07-27T14:36:26.296343+0000","last_peered":"2023-07-27T14:36:26.296343+0000","last_clean":"2023-07-27T14:36:26.296343+0000","last_became_active":"2023-07-27T14:36:26.294545+0000","last_became_peered":"2023-07-27T14:36:26.294545+0000","last_unstale":"2023-07-27T14:36:26.296343+0000","last_undegraded":"2023-07-27T14:36:26.296343+0000","last_fullsized":"2023-07-27T14:36:26.296343+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.274705+0000","last_change":"2023-07-27T14:36:25.829637+0000","last_active":"2023-07-27T14:36:26.274705+0000","last_peered":"2023-07-27T14:36:26.274705+0000","last_clean":"2023-07-27T14:36:26.274705+0000","last_became_active":"2023-07-27T14:36:25.829178+0000","last_became_peered":"2023-07-27T14:36:25.829178+0000","last_unstale":"2023-07-27T14:36:26.274705+0000","last_undegraded":"2023-07-27T14:36:26.274705+0000","last_fullsized":"2023-07-27T14:36:26.274705+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275886+0000","last_change":"2023-07-27T14:36:26.271607+0000","last_active":"2023-07-27T14:36:26.275886+0000","last_peered":"2023-07-27T14:36:26.275886+0000","last_clean":"2023-07-27T14:36:26.275886+0000","last_became_active":"2023-07-27T14:36:26.271329+0000","last_became_peered":"2023-07-27T14:36:26.271329+0000","last_unstale":"2023-07-27T14:36:26.275886+0000","last_undegraded":"2023-07-27T14:36:26.275886+0000","last_fullsized":"2023-07-27T14:36:26.275886+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267596+0000","last_change":"2023-07-27T14:36:25.814318+0000","last_active":"2023-07-27T14:36:26.267596+0000","last_peered":"2023-07-27T14:36:26.267596+0000","last_clean":"2023-07-27T14:36:26.267596+0000","last_became_active":"2023-07-27T14:36:25.813978+0000","last_became_peered":"2023-07-27T14:36:25.813978+0000","last_unstale":"2023-07-27T14:36:26.267596+0000","last_undegraded":"2023-07-27T14:36:26.267596+0000","last_fullsized":"2023-07-27T14:36:26.267596+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295511+0000","last_change":"2023-07-27T14:36:26.292466+0000","last_active":"2023-07-27T14:36:26.295511+0000","last_peered":"2023-07-27T14:36:26.295511+0000","last_clean":"2023-07-27T14:36:26.295511+0000","last_became_active":"2023-07-27T14:36:26.292179+0000","last_became_peered":"2023-07-27T14:36:26.292179+0000","last_unstale":"2023-07-27T14:36:26.295511+0000","last_undegraded":"2023-07-27T14:36:26.295511+0000","last_fullsized":"2023-07-27T14:36:26.295511+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"157'4","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.300149+0000","last_change":"2023-07-27T14:36:25.815821+0000","last_active":"2023-07-27T14:36:26.300149+0000","last_peered":"2023-07-27T14:36:26.300149+0000","last_clean":"2023-07-27T14:36:26.300149+0000","last_became_active":"2023-07-27T14:36:25.815448+0000","last_became_peered":"2023-07-27T14:36:25.815448+0000","last_unstale":"2023-07-27T14:36:26.300149+0000","last_undegraded":"2023-07-27T14:36:26.300149+0000","last_fullsized":"2023-07-27T14:36:26.300149+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.289290+0000","last_change":"2023-07-27T14:36:26.285766+0000","last_active":"2023-07-27T14:36:26.289290+0000","last_peered":"2023-07-27T14:36:26.289290+0000","last_clean":"2023-07-27T14:36:26.289290+0000","last_became_active":"2023-07-27T14:36:26.285485+0000","last_became_peered":"2023-07-27T14:36:26.285485+0000","last_unstale":"2023-07-27T14:36:26.289290+0000","last_undegraded":"2023-07-27T14:36:26.289290+0000","last_fullsized":"2023-07-27T14:36:26.289290+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.289203+0000","last_change":"2023-07-27T14:36:25.811775+0000","last_active":"2023-07-27T14:36:26.289203+0000","last_peered":"2023-07-27T14:36:26.289203+0000","last_clean":"2023-07-27T14:36:26.289203+0000","last_became_active":"2023-07-27T14:36:25.811487+0000","last_became_peered":"2023-07-27T14:36:25.811487+0000","last_unstale":"2023-07-27T14:36:26.289203+0000","last_undegraded":"2023-07-27T14:36:26.289203+0000","last_fullsized":"2023-07-27T14:36:26.289203+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291087+0000","last_change":"2023-07-27T14:36:26.287951+0000","last_active":"2023-07-27T14:36:26.291087+0000","last_peered":"2023-07-27T14:36:26.291087+0000","last_clean":"2023-07-27T14:36:26.291087+0000","last_became_active":"2023-07-27T14:36:26.287498+0000","last_became_peered":"2023-07-27T14:36:26.287498+0000","last_unstale":"2023-07-27T14:36:26.291087+0000","last_undegraded":"2023-07-27T14:36:26.291087+0000","last_fullsized":"2023-07-27T14:36:26.291087+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279313+0000","last_change":"2023-07-27T14:36:25.828397+0000","last_active":"2023-07-27T14:36:26.279313+0000","last_peered":"2023-07-27T14:36:26.279313+0000","last_clean":"2023-07-27T14:36:26.279313+0000","last_became_active":"2023-07-27T14:36:25.828097+0000","last_became_peered":"2023-07-27T14:36:25.828097+0000","last_unstale":"2023-07-27T14:36:26.279313+0000","last_undegraded":"2023-07-27T14:36:26.279313+0000","last_fullsized":"2023-07-27T14:36:26.279313+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286353+0000","last_change":"2023-07-27T14:36:26.277472+0000","last_active":"2023-07-27T14:36:26.286353+0000","last_peered":"2023-07-27T14:36:26.286353+0000","last_clean":"2023-07-27T14:36:26.286353+0000","last_became_active":"2023-07-27T14:36:26.277147+0000","last_became_peered":"2023-07-27T14:36:26.277147+0000","last_unstale":"2023-07-27T14:36:26.286353+0000","last_undegraded":"2023-07-27T14:36:26.286353+0000","last_fullsized":"2023-07-27T14:36:26.286353+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277609+0000","last_change":"2023-07-27T14:36:25.822485+0000","last_active":"2023-07-27T14:36:26.277609+0000","last_peered":"2023-07-27T14:36:26.277609+0000","last_clean":"2023-07-27T14:36:26.277609+0000","last_became_active":"2023-07-27T14:36:25.822156+0000","last_became_peered":"2023-07-27T14:36:25.822156+0000","last_unstale":"2023-07-27T14:36:26.277609+0000","last_undegraded":"2023-07-27T14:36:26.277609+0000","last_fullsized":"2023-07-27T14:36:26.277609+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281845+0000","last_change":"2023-07-27T14:36:26.277085+0000","last_active":"2023-07-27T14:36:26.281845+0000","last_peered":"2023-07-27T14:36:26.281845+0000","last_clean":"2023-07-27T14:36:26.281845+0000","last_became_active":"2023-07-27T14:36:26.276757+0000","last_became_peered":"2023-07-27T14:36:26.276757+0000","last_unstale":"2023-07-27T14:36:26.281845+0000","last_undegraded":"2023-07-27T14:36:26.281845+0000","last_fullsized":"2023-07-27T14:36:26.281845+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"157'4","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.292741+0000","last_change":"2023-07-27T14:36:25.820460+0000","last_active":"2023-07-27T14:36:26.292741+0000","last_peered":"2023-07-27T14:36:26.292741+0000","last_clean":"2023-07-27T14:36:26.292741+0000","last_became_active":"2023-07-27T14:36:25.819922+0000","last_became_peered":"2023-07-27T14:36:25.819922+0000","last_unstale":"2023-07-27T14:36:26.292741+0000","last_undegraded":"2023-07-27T14:36:26.292741+0000","last_fullsized":"2023-07-27T14:36:26.292741+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277163+0000","last_change":"2023-07-27T14:36:26.275862+0000","last_active":"2023-07-27T14:36:26.277163+0000","last_peered":"2023-07-27T14:36:26.277163+0000","last_clean":"2023-07-27T14:36:26.277163+0000","last_became_active":"2023-07-27T14:36:26.275610+0000","last_became_peered":"2023-07-27T14:36:26.275610+0000","last_unstale":"2023-07-27T14:36:26.277163+0000","last_undegraded":"2023-07-27T14:36:26.277163+0000","last_fullsized":"2023-07-27T14:36:26.277163+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281799+0000","last_change":"2023-07-27T14:36:25.815690+0000","last_active":"2023-07-27T14:36:26.281799+0000","last_peered":"2023-07-27T14:36:26.281799+0000","last_clean":"2023-07-27T14:36:26.281799+0000","last_became_active":"2023-07-27T14:36:25.815368+0000","last_became_peered":"2023-07-27T14:36:25.815368+0000","last_unstale":"2023-07-27T14:36:26.281799+0000","last_undegraded":"2023-07-27T14:36:26.281799+0000","last_fullsized":"2023-07-27T14:36:26.281799+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298184+0000","last_change":"2023-07-27T14:36:26.295072+0000","last_active":"2023-07-27T14:36:26.298184+0000","last_peered":"2023-07-27T14:36:26.298184+0000","last_clean":"2023-07-27T14:36:26.298184+0000","last_became_active":"2023-07-27T14:36:26.294492+0000","last_became_peered":"2023-07-27T14:36:26.294492+0000","last_unstale":"2023-07-27T14:36:26.298184+0000","last_undegraded":"2023-07-27T14:36:26.298184+0000","last_fullsized":"2023-07-27T14:36:26.298184+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.272544+0000","last_change":"2023-07-27T14:36:25.813865+0000","last_active":"2023-07-27T14:36:26.272544+0000","last_peered":"2023-07-27T14:36:26.272544+0000","last_clean":"2023-07-27T14:36:26.272544+0000","last_became_active":"2023-07-27T14:36:25.813512+0000","last_became_peered":"2023-07-27T14:36:25.813512+0000","last_unstale":"2023-07-27T14:36:26.272544+0000","last_undegraded":"2023-07-27T14:36:26.272544+0000","last_fullsized":"2023-07-27T14:36:26.272544+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291903+0000","last_change":"2023-07-27T14:36:26.290796+0000","last_active":"2023-07-27T14:36:26.291903+0000","last_peered":"2023-07-27T14:36:26.291903+0000","last_clean":"2023-07-27T14:36:26.291903+0000","last_became_active":"2023-07-27T14:36:26.290517+0000","last_became_peered":"2023-07-27T14:36:26.290517+0000","last_unstale":"2023-07-27T14:36:26.291903+0000","last_undegraded":"2023-07-27T14:36:26.291903+0000","last_fullsized":"2023-07-27T14:36:26.291903+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.282451+0000","last_change":"2023-07-27T14:36:25.822237+0000","last_active":"2023-07-27T14:36:26.282451+0000","last_peered":"2023-07-27T14:36:26.282451+0000","last_clean":"2023-07-27T14:36:26.282451+0000","last_became_active":"2023-07-27T14:36:25.821952+0000","last_became_peered":"2023-07-27T14:36:25.821952+0000","last_unstale":"2023-07-27T14:36:26.282451+0000","last_undegraded":"2023-07-27T14:36:26.282451+0000","last_fullsized":"2023-07-27T14:36:26.282451+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286637+0000","last_change":"2023-07-27T14:36:26.281874+0000","last_active":"2023-07-27T14:36:26.286637+0000","last_peered":"2023-07-27T14:36:26.286637+0000","last_clean":"2023-07-27T14:36:26.286637+0000","last_became_active":"2023-07-27T14:36:26.281419+0000","last_became_peered":"2023-07-27T14:36:26.281419+0000","last_unstale":"2023-07-27T14:36:26.286637+0000","last_undegraded":"2023-07-27T14:36:26.286637+0000","last_fullsized":"2023-07-27T14:36:26.286637+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.271682+0000","last_change":"2023-07-27T14:36:25.814731+0000","last_active":"2023-07-27T14:36:26.271682+0000","last_peered":"2023-07-27T14:36:26.271682+0000","last_clean":"2023-07-27T14:36:26.271682+0000","last_became_active":"2023-07-27T14:36:25.814401+0000","last_became_peered":"2023-07-27T14:36:25.814401+0000","last_unstale":"2023-07-27T14:36:26.271682+0000","last_undegraded":"2023-07-27T14:36:26.271682+0000","last_fullsized":"2023-07-27T14:36:26.271682+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281526+0000","last_change":"2023-07-27T14:36:26.278921+0000","last_active":"2023-07-27T14:36:26.281526+0000","last_peered":"2023-07-27T14:36:26.281526+0000","last_clean":"2023-07-27T14:36:26.281526+0000","last_became_active":"2023-07-27T14:36:26.278430+0000","last_became_peered":"2023-07-27T14:36:26.278430+0000","last_unstale":"2023-07-27T14:36:26.281526+0000","last_undegraded":"2023-07-27T14:36:26.281526+0000","last_fullsized":"2023-07-27T14:36:26.281526+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298096+0000","last_change":"2023-07-27T14:36:25.828481+0000","last_active":"2023-07-27T14:36:26.298096+0000","last_peered":"2023-07-27T14:36:26.298096+0000","last_clean":"2023-07-27T14:36:26.298096+0000","last_became_active":"2023-07-27T14:36:25.828193+0000","last_became_peered":"2023-07-27T14:36:25.828193+0000","last_unstale":"2023-07-27T14:36:26.298096+0000","last_undegraded":"2023-07-27T14:36:26.298096+0000","last_fullsized":"2023-07-27T14:36:26.298096+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295830+0000","last_change":"2023-07-27T14:36:26.291317+0000","last_active":"2023-07-27T14:36:26.295830+0000","last_peered":"2023-07-27T14:36:26.295830+0000","last_clean":"2023-07-27T14:36:26.295830+0000","last_became_active":"2023-07-27T14:36:26.291062+0000","last_became_peered":"2023-07-27T14:36:26.291062+0000","last_unstale":"2023-07-27T14:36:26.295830+0000","last_undegraded":"2023-07-27T14:36:26.295830+0000","last_fullsized":"2023-07-27T14:36:26.295830+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279405+0000","last_change":"2023-07-27T14:36:25.827397+0000","last_active":"2023-07-27T14:36:26.279405+0000","last_peered":"2023-07-27T14:36:26.279405+0000","last_clean":"2023-07-27T14:36:26.279405+0000","last_became_active":"2023-07-27T14:36:25.826819+0000","last_became_peered":"2023-07-27T14:36:25.826819+0000","last_unstale":"2023-07-27T14:36:26.279405+0000","last_undegraded":"2023-07-27T14:36:26.279405+0000","last_fullsized":"2023-07-27T14:36:26.279405+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295580+0000","last_change":"2023-07-27T14:36:26.291158+0000","last_active":"2023-07-27T14:36:26.295580+0000","last_peered":"2023-07-27T14:36:26.295580+0000","last_clean":"2023-07-27T14:36:26.295580+0000","last_became_active":"2023-07-27T14:36:26.290782+0000","last_became_peered":"2023-07-27T14:36:26.290782+0000","last_unstale":"2023-07-27T14:36:26.295580+0000","last_undegraded":"2023-07-27T14:36:26.295580+0000","last_fullsized":"2023-07-27T14:36:26.295580+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275169+0000","last_change":"2023-07-27T14:36:25.828565+0000","last_active":"2023-07-27T14:36:26.275169+0000","last_peered":"2023-07-27T14:36:26.275169+0000","last_clean":"2023-07-27T14:36:26.275169+0000","last_became_active":"2023-07-27T14:36:25.828126+0000","last_became_peered":"2023-07-27T14:36:25.828126+0000","last_unstale":"2023-07-27T14:36:26.275169+0000","last_undegraded":"2023-07-27T14:36:26.275169+0000","last_fullsized":"2023-07-27T14:36:26.275169+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295640+0000","last_change":"2023-07-27T14:36:26.292429+0000","last_active":"2023-07-27T14:36:26.295640+0000","last_peered":"2023-07-27T14:36:26.295640+0000","last_clean":"2023-07-27T14:36:26.295640+0000","last_became_active":"2023-07-27T14:36:26.291806+0000","last_became_peered":"2023-07-27T14:36:26.291806+0000","last_unstale":"2023-07-27T14:36:26.295640+0000","last_undegraded":"2023-07-27T14:36:26.295640+0000","last_fullsized":"2023-07-27T14:36:26.295640+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277166+0000","last_change":"2023-07-27T14:36:25.830547+0000","last_active":"2023-07-27T14:36:26.277166+0000","last_peered":"2023-07-27T14:36:26.277166+0000","last_clean":"2023-07-27T14:36:26.277166+0000","last_became_active":"2023-07-27T14:36:25.829438+0000","last_became_peered":"2023-07-27T14:36:25.829438+0000","last_unstale":"2023-07-27T14:36:26.277166+0000","last_undegraded":"2023-07-27T14:36:26.277166+0000","last_fullsized":"2023-07-27T14:36:26.277166+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281312+0000","last_change":"2023-07-27T14:36:26.278417+0000","last_active":"2023-07-27T14:36:26.281312+0000","last_peered":"2023-07-27T14:36:26.281312+0000","last_clean":"2023-07-27T14:36:26.281312+0000","last_became_active":"2023-07-27T14:36:26.278142+0000","last_became_peered":"2023-07-27T14:36:26.278142+0000","last_unstale":"2023-07-27T14:36:26.281312+0000","last_undegraded":"2023-07-27T14:36:26.281312+0000","last_fullsized":"2023-07-27T14:36:26.281312+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.271546+0000","last_change":"2023-07-27T14:36:25.817663+0000","last_active":"2023-07-27T14:36:26.271546+0000","last_peered":"2023-07-27T14:36:26.271546+0000","last_clean":"2023-07-27T14:36:26.271546+0000","last_became_active":"2023-07-27T14:36:25.817240+0000","last_became_peered":"2023-07-27T14:36:25.817240+0000","last_unstale":"2023-07-27T14:36:26.271546+0000","last_undegraded":"2023-07-27T14:36:26.271546+0000","last_fullsized":"2023-07-27T14:36:26.271546+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.300715+0000","last_change":"2023-07-27T14:36:26.295592+0000","last_active":"2023-07-27T14:36:26.300715+0000","last_peered":"2023-07-27T14:36:26.300715+0000","last_clean":"2023-07-27T14:36:26.300715+0000","last_became_active":"2023-07-27T14:36:26.295205+0000","last_became_peered":"2023-07-27T14:36:26.295205+0000","last_unstale":"2023-07-27T14:36:26.300715+0000","last_undegraded":"2023-07-27T14:36:26.300715+0000","last_fullsized":"2023-07-27T14:36:26.300715+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267478+0000","last_change":"2023-07-27T14:36:25.818032+0000","last_active":"2023-07-27T14:36:26.267478+0000","last_peered":"2023-07-27T14:36:26.267478+0000","last_clean":"2023-07-27T14:36:26.267478+0000","last_became_active":"2023-07-27T14:36:25.817748+0000","last_became_peered":"2023-07-27T14:36:25.817748+0000","last_unstale":"2023-07-27T14:36:26.267478+0000","last_undegraded":"2023-07-27T14:36:26.267478+0000","last_fullsized":"2023-07-27T14:36:26.267478+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288586+0000","last_change":"2023-07-27T14:36:26.283067+0000","last_active":"2023-07-27T14:36:26.288586+0000","last_peered":"2023-07-27T14:36:26.288586+0000","last_clean":"2023-07-27T14:36:26.288586+0000","last_became_active":"2023-07-27T14:36:26.282794+0000","last_became_peered":"2023-07-27T14:36:26.282794+0000","last_unstale":"2023-07-27T14:36:26.288586+0000","last_undegraded":"2023-07-27T14:36:26.288586+0000","last_fullsized":"2023-07-27T14:36:26.288586+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.272998+0000","last_change":"2023-07-27T14:36:25.821397+0000","last_active":"2023-07-27T14:36:26.272998+0000","last_peered":"2023-07-27T14:36:26.272998+0000","last_clean":"2023-07-27T14:36:26.272998+0000","last_became_active":"2023-07-27T14:36:25.819651+0000","last_became_peered":"2023-07-27T14:36:25.819651+0000","last_unstale":"2023-07-27T14:36:26.272998+0000","last_undegraded":"2023-07-27T14:36:26.272998+0000","last_fullsized":"2023-07-27T14:36:26.272998+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277972+0000","last_change":"2023-07-27T14:36:26.276425+0000","last_active":"2023-07-27T14:36:26.277972+0000","last_peered":"2023-07-27T14:36:26.277972+0000","last_clean":"2023-07-27T14:36:26.277972+0000","last_became_active":"2023-07-27T14:36:26.275622+0000","last_became_peered":"2023-07-27T14:36:26.275622+0000","last_unstale":"2023-07-27T14:36:26.277972+0000","last_undegraded":"2023-07-27T14:36:26.277972+0000","last_fullsized":"2023-07-27T14:36:26.277972+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265180+0000","last_change":"2023-07-27T14:36:25.814242+0000","last_active":"2023-07-27T14:36:26.265180+0000","last_peered":"2023-07-27T14:36:26.265180+0000","last_clean":"2023-07-27T14:36:26.265180+0000","last_became_active":"2023-07-27T14:36:25.813934+0000","last_became_peered":"2023-07-27T14:36:25.813934+0000","last_unstale":"2023-07-27T14:36:26.265180+0000","last_undegraded":"2023-07-27T14:36:26.265180+0000","last_fullsized":"2023-07-27T14:36:26.265180+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295834+0000","last_change":"2023-07-27T14:36:26.289538+0000","last_active":"2023-07-27T14:36:26.295834+0000","last_peered":"2023-07-27T14:36:26.295834+0000","last_clean":"2023-07-27T14:36:26.295834+0000","last_became_active":"2023-07-27T14:36:26.289273+0000","last_became_peered":"2023-07-27T14:36:26.289273+0000","last_unstale":"2023-07-27T14:36:26.295834+0000","last_undegraded":"2023-07-27T14:36:26.295834+0000","last_fullsized":"2023-07-27T14:36:26.295834+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267941+0000","last_change":"2023-07-27T14:36:25.813908+0000","last_active":"2023-07-27T14:36:26.267941+0000","last_peered":"2023-07-27T14:36:26.267941+0000","last_clean":"2023-07-27T14:36:26.267941+0000","last_became_active":"2023-07-27T14:36:25.813593+0000","last_became_peered":"2023-07-27T14:36:25.813593+0000","last_unstale":"2023-07-27T14:36:26.267941+0000","last_undegraded":"2023-07-27T14:36:26.267941+0000","last_fullsized":"2023-07-27T14:36:26.267941+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291442+0000","last_change":"2023-07-27T14:36:26.285693+0000","last_active":"2023-07-27T14:36:26.291442+0000","last_peered":"2023-07-27T14:36:26.291442+0000","last_clean":"2023-07-27T14:36:26.291442+0000","last_became_active":"2023-07-27T14:36:26.285423+0000","last_became_peered":"2023-07-27T14:36:26.285423+0000","last_unstale":"2023-07-27T14:36:26.291442+0000","last_undegraded":"2023-07-27T14:36:26.291442+0000","last_fullsized":"2023-07-27T14:36:26.291442+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279497+0000","last_change":"2023-07-27T14:36:25.827354+0000","last_active":"2023-07-27T14:36:26.279497+0000","last_peered":"2023-07-27T14:36:26.279497+0000","last_clean":"2023-07-27T14:36:26.279497+0000","last_became_active":"2023-07-27T14:36:25.826629+0000","last_became_peered":"2023-07-27T14:36:25.826629+0000","last_unstale":"2023-07-27T14:36:26.279497+0000","last_undegraded":"2023-07-27T14:36:26.279497+0000","last_fullsized":"2023-07-27T14:36:26.279497+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.285918+0000","last_change":"2023-07-27T14:36:26.284218+0000","last_active":"2023-07-27T14:36:26.285918+0000","last_peered":"2023-07-27T14:36:26.285918+0000","last_clean":"2023-07-27T14:36:26.285918+0000","last_became_active":"2023-07-27T14:36:26.283939+0000","last_became_peered":"2023-07-27T14:36:26.283939+0000","last_unstale":"2023-07-27T14:36:26.285918+0000","last_undegraded":"2023-07-27T14:36:26.285918+0000","last_fullsized":"2023-07-27T14:36:26.285918+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265145+0000","last_change":"2023-07-27T14:36:25.810693+0000","last_active":"2023-07-27T14:36:26.265145+0000","last_peered":"2023-07-27T14:36:26.265145+0000","last_clean":"2023-07-27T14:36:26.265145+0000","last_became_active":"2023-07-27T14:36:25.810172+0000","last_became_peered":"2023-07-27T14:36:25.810172+0000","last_unstale":"2023-07-27T14:36:26.265145+0000","last_undegraded":"2023-07-27T14:36:26.265145+0000","last_fullsized":"2023-07-27T14:36:26.265145+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295802+0000","last_change":"2023-07-27T14:36:26.288066+0000","last_active":"2023-07-27T14:36:26.295802+0000","last_peered":"2023-07-27T14:36:26.295802+0000","last_clean":"2023-07-27T14:36:26.295802+0000","last_became_active":"2023-07-27T14:36:26.287730+0000","last_became_peered":"2023-07-27T14:36:26.287730+0000","last_unstale":"2023-07-27T14:36:26.295802+0000","last_undegraded":"2023-07-27T14:36:26.295802+0000","last_fullsized":"2023-07-27T14:36:26.295802+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.271632+0000","last_change":"2023-07-27T14:36:25.820263+0000","last_active":"2023-07-27T14:36:26.271632+0000","last_peered":"2023-07-27T14:36:26.271632+0000","last_clean":"2023-07-27T14:36:26.271632+0000","last_became_active":"2023-07-27T14:36:25.819290+0000","last_became_peered":"2023-07-27T14:36:25.819290+0000","last_unstale":"2023-07-27T14:36:26.271632+0000","last_undegraded":"2023-07-27T14:36:26.271632+0000","last_fullsized":"2023-07-27T14:36:26.271632+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298296+0000","last_change":"2023-07-27T14:36:26.293955+0000","last_active":"2023-07-27T14:36:26.298296+0000","last_peered":"2023-07-27T14:36:26.298296+0000","last_clean":"2023-07-27T14:36:26.298296+0000","last_became_active":"2023-07-27T14:36:26.293702+0000","last_became_peered":"2023-07-27T14:36:26.293702+0000","last_unstale":"2023-07-27T14:36:26.298296+0000","last_undegraded":"2023-07-27T14:36:26.298296+0000","last_fullsized":"2023-07-27T14:36:26.298296+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.293729+0000","last_change":"2023-07-27T14:36:25.811749+0000","last_active":"2023-07-27T14:36:26.293729+0000","last_peered":"2023-07-27T14:36:26.293729+0000","last_clean":"2023-07-27T14:36:26.293729+0000","last_became_active":"2023-07-27T14:36:25.811489+0000","last_became_peered":"2023-07-27T14:36:25.811489+0000","last_unstale":"2023-07-27T14:36:26.293729+0000","last_undegraded":"2023-07-27T14:36:26.293729+0000","last_fullsized":"2023-07-27T14:36:26.293729+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.285045+0000","last_change":"2023-07-27T14:36:26.283400+0000","last_active":"2023-07-27T14:36:26.285045+0000","last_peered":"2023-07-27T14:36:26.285045+0000","last_clean":"2023-07-27T14:36:26.285045+0000","last_became_active":"2023-07-27T14:36:26.283122+0000","last_became_peered":"2023-07-27T14:36:26.283122+0000","last_unstale":"2023-07-27T14:36:26.285045+0000","last_undegraded":"2023-07-27T14:36:26.285045+0000","last_fullsized":"2023-07-27T14:36:26.285045+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297456+0000","last_change":"2023-07-27T14:36:25.816279+0000","last_active":"2023-07-27T14:36:26.297456+0000","last_peered":"2023-07-27T14:36:26.297456+0000","last_clean":"2023-07-27T14:36:26.297456+0000","last_became_active":"2023-07-27T14:36:25.815077+0000","last_became_peered":"2023-07-27T14:36:25.815077+0000","last_unstale":"2023-07-27T14:36:26.297456+0000","last_undegraded":"2023-07-27T14:36:26.297456+0000","last_fullsized":"2023-07-27T14:36:26.297456+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296363+0000","last_change":"2023-07-27T14:36:26.293557+0000","last_active":"2023-07-27T14:36:26.296363+0000","last_peered":"2023-07-27T14:36:26.296363+0000","last_clean":"2023-07-27T14:36:26.296363+0000","last_became_active":"2023-07-27T14:36:26.293109+0000","last_became_peered":"2023-07-27T14:36:26.293109+0000","last_unstale":"2023-07-27T14:36:26.296363+0000","last_undegraded":"2023-07-27T14:36:26.296363+0000","last_fullsized":"2023-07-27T14:36:26.296363+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298291+0000","last_change":"2023-07-27T14:36:25.812595+0000","last_active":"2023-07-27T14:36:26.298291+0000","last_peered":"2023-07-27T14:36:26.298291+0000","last_clean":"2023-07-27T14:36:26.298291+0000","last_became_active":"2023-07-27T14:36:25.812290+0000","last_became_peered":"2023-07-27T14:36:25.812290+0000","last_unstale":"2023-07-27T14:36:26.298291+0000","last_undegraded":"2023-07-27T14:36:26.298291+0000","last_fullsized":"2023-07-27T14:36:26.298291+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297614+0000","last_change":"2023-07-27T14:36:26.289971+0000","last_active":"2023-07-27T14:36:26.297614+0000","last_peered":"2023-07-27T14:36:26.297614+0000","last_clean":"2023-07-27T14:36:26.297614+0000","last_became_active":"2023-07-27T14:36:26.289642+0000","last_became_peered":"2023-07-27T14:36:26.289642+0000","last_unstale":"2023-07-27T14:36:26.297614+0000","last_undegraded":"2023-07-27T14:36:26.297614+0000","last_fullsized":"2023-07-27T14:36:26.297614+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267742+0000","last_change":"2023-07-27T14:36:25.825789+0000","last_active":"2023-07-27T14:36:26.267742+0000","last_peered":"2023-07-27T14:36:26.267742+0000","last_clean":"2023-07-27T14:36:26.267742+0000","last_became_active":"2023-07-27T14:36:25.825448+0000","last_became_peered":"2023-07-27T14:36:25.825448+0000","last_unstale":"2023-07-27T14:36:26.267742+0000","last_undegraded":"2023-07-27T14:36:26.267742+0000","last_fullsized":"2023-07-27T14:36:26.267742+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279287+0000","last_change":"2023-07-27T14:36:26.277183+0000","last_active":"2023-07-27T14:36:26.279287+0000","last_peered":"2023-07-27T14:36:26.279287+0000","last_clean":"2023-07-27T14:36:26.279287+0000","last_became_active":"2023-07-27T14:36:26.276912+0000","last_became_peered":"2023-07-27T14:36:26.276912+0000","last_unstale":"2023-07-27T14:36:26.279287+0000","last_undegraded":"2023-07-27T14:36:26.279287+0000","last_fullsized":"2023-07-27T14:36:26.279287+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.273896+0000","last_change":"2023-07-27T14:36:25.826677+0000","last_active":"2023-07-27T14:36:26.273896+0000","last_peered":"2023-07-27T14:36:26.273896+0000","last_clean":"2023-07-27T14:36:26.273896+0000","last_became_active":"2023-07-27T14:36:25.826307+0000","last_became_peered":"2023-07-27T14:36:25.826307+0000","last_unstale":"2023-07-27T14:36:26.273896+0000","last_undegraded":"2023-07-27T14:36:26.273896+0000","last_fullsized":"2023-07-27T14:36:26.273896+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286505+0000","last_change":"2023-07-27T14:36:26.281902+0000","last_active":"2023-07-27T14:36:26.286505+0000","last_peered":"2023-07-27T14:36:26.286505+0000","last_clean":"2023-07-27T14:36:26.286505+0000","last_became_active":"2023-07-27T14:36:26.281593+0000","last_became_peered":"2023-07-27T14:36:26.281593+0000","last_unstale":"2023-07-27T14:36:26.286505+0000","last_undegraded":"2023-07-27T14:36:26.286505+0000","last_fullsized":"2023-07-27T14:36:26.286505+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266652+0000","last_change":"2023-07-27T14:36:25.815728+0000","last_active":"2023-07-27T14:36:26.266652+0000","last_peered":"2023-07-27T14:36:26.266652+0000","last_clean":"2023-07-27T14:36:26.266652+0000","last_became_active":"2023-07-27T14:36:25.815176+0000","last_became_peered":"2023-07-27T14:36:25.815176+0000","last_unstale":"2023-07-27T14:36:26.266652+0000","last_undegraded":"2023-07-27T14:36:26.266652+0000","last_fullsized":"2023-07-27T14:36:26.266652+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.274690+0000","last_change":"2023-07-27T14:36:26.271036+0000","last_active":"2023-07-27T14:36:26.274690+0000","last_peered":"2023-07-27T14:36:26.274690+0000","last_clean":"2023-07-27T14:36:26.274690+0000","last_became_active":"2023-07-27T14:36:26.270739+0000","last_became_peered":"2023-07-27T14:36:26.270739+0000","last_unstale":"2023-07-27T14:36:26.274690+0000","last_undegraded":"2023-07-27T14:36:26.274690+0000","last_fullsized":"2023-07-27T14:36:26.274690+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.264487+0000","last_change":"2023-07-27T14:36:25.813815+0000","last_active":"2023-07-27T14:36:26.264487+0000","last_peered":"2023-07-27T14:36:26.264487+0000","last_clean":"2023-07-27T14:36:26.264487+0000","last_became_active":"2023-07-27T14:36:25.813492+0000","last_became_peered":"2023-07-27T14:36:25.813492+0000","last_unstale":"2023-07-27T14:36:26.264487+0000","last_undegraded":"2023-07-27T14:36:26.264487+0000","last_fullsized":"2023-07-27T14:36:26.264487+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288782+0000","last_change":"2023-07-27T14:36:26.284855+0000","last_active":"2023-07-27T14:36:26.288782+0000","last_peered":"2023-07-27T14:36:26.288782+0000","last_clean":"2023-07-27T14:36:26.288782+0000","last_became_active":"2023-07-27T14:36:26.284512+0000","last_became_peered":"2023-07-27T14:36:26.284512+0000","last_unstale":"2023-07-27T14:36:26.288782+0000","last_undegraded":"2023-07-27T14:36:26.288782+0000","last_fullsized":"2023-07-27T14:36:26.288782+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.264665+0000","last_change":"2023-07-27T14:36:25.816504+0000","last_active":"2023-07-27T14:36:26.264665+0000","last_peered":"2023-07-27T14:36:26.264665+0000","last_clean":"2023-07-27T14:36:26.264665+0000","last_became_active":"2023-07-27T14:36:25.816226+0000","last_became_peered":"2023-07-27T14:36:25.816226+0000","last_unstale":"2023-07-27T14:36:26.264665+0000","last_undegraded":"2023-07-27T14:36:26.264665+0000","last_fullsized":"2023-07-27T14:36:26.264665+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297735+0000","last_change":"2023-07-27T14:36:26.292087+0000","last_active":"2023-07-27T14:36:26.297735+0000","last_peered":"2023-07-27T14:36:26.297735+0000","last_clean":"2023-07-27T14:36:26.297735+0000","last_became_active":"2023-07-27T14:36:26.291722+0000","last_became_peered":"2023-07-27T14:36:26.291722+0000","last_unstale":"2023-07-27T14:36:26.297735+0000","last_undegraded":"2023-07-27T14:36:26.297735+0000","last_fullsized":"2023-07-27T14:36:26.297735+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.299120+0000","last_change":"2023-07-27T14:36:25.822338+0000","last_active":"2023-07-27T14:36:26.299120+0000","last_peered":"2023-07-27T14:36:26.299120+0000","last_clean":"2023-07-27T14:36:26.299120+0000","last_became_active":"2023-07-27T14:36:25.820072+0000","last_became_peered":"2023-07-27T14:36:25.820072+0000","last_unstale":"2023-07-27T14:36:26.299120+0000","last_undegraded":"2023-07-27T14:36:26.299120+0000","last_fullsized":"2023-07-27T14:36:26.299120+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298166+0000","last_change":"2023-07-27T14:36:26.294864+0000","last_active":"2023-07-27T14:36:26.298166+0000","last_peered":"2023-07-27T14:36:26.298166+0000","last_clean":"2023-07-27T14:36:26.298166+0000","last_became_active":"2023-07-27T14:36:26.294151+0000","last_became_peered":"2023-07-27T14:36:26.294151+0000","last_unstale":"2023-07-27T14:36:26.298166+0000","last_undegraded":"2023-07-27T14:36:26.298166+0000","last_fullsized":"2023-07-27T14:36:26.298166+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297398+0000","last_change":"2023-07-27T14:36:25.815897+0000","last_active":"2023-07-27T14:36:26.297398+0000","last_peered":"2023-07-27T14:36:26.297398+0000","last_clean":"2023-07-27T14:36:26.297398+0000","last_became_active":"2023-07-27T14:36:25.815499+0000","last_became_peered":"2023-07-27T14:36:25.815499+0000","last_unstale":"2023-07-27T14:36:26.297398+0000","last_undegraded":"2023-07-27T14:36:26.297398+0000","last_fullsized":"2023-07-27T14:36:26.297398+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.273089+0000","last_change":"2023-07-27T14:36:26.271322+0000","last_active":"2023-07-27T14:36:26.273089+0000","last_peered":"2023-07-27T14:36:26.273089+0000","last_clean":"2023-07-27T14:36:26.273089+0000","last_became_active":"2023-07-27T14:36:26.271010+0000","last_became_peered":"2023-07-27T14:36:26.271010+0000","last_unstale":"2023-07-27T14:36:26.273089+0000","last_undegraded":"2023-07-27T14:36:26.273089+0000","last_fullsized":"2023-07-27T14:36:26.273089+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267800+0000","last_change":"2023-07-27T14:36:25.813575+0000","last_active":"2023-07-27T14:36:26.267800+0000","last_peered":"2023-07-27T14:36:26.267800+0000","last_clean":"2023-07-27T14:36:26.267800+0000","last_became_active":"2023-07-27T14:36:25.813300+0000","last_became_peered":"2023-07-27T14:36:25.813300+0000","last_unstale":"2023-07-27T14:36:26.267800+0000","last_undegraded":"2023-07-27T14:36:26.267800+0000","last_fullsized":"2023-07-27T14:36:26.267800+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288674+0000","last_change":"2023-07-27T14:36:26.286777+0000","last_active":"2023-07-27T14:36:26.288674+0000","last_peered":"2023-07-27T14:36:26.288674+0000","last_clean":"2023-07-27T14:36:26.288674+0000","last_became_active":"2023-07-27T14:36:26.286270+0000","last_became_peered":"2023-07-27T14:36:26.286270+0000","last_unstale":"2023-07-27T14:36:26.288674+0000","last_undegraded":"2023-07-27T14:36:26.288674+0000","last_fullsized":"2023-07-27T14:36:26.288674+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.272505+0000","last_change":"2023-07-27T14:36:25.829217+0000","last_active":"2023-07-27T14:36:26.272505+0000","last_peered":"2023-07-27T14:36:26.272505+0000","last_clean":"2023-07-27T14:36:26.272505+0000","last_became_active":"2023-07-27T14:36:25.827607+0000","last_became_peered":"2023-07-27T14:36:25.827607+0000","last_unstale":"2023-07-27T14:36:26.272505+0000","last_undegraded":"2023-07-27T14:36:26.272505+0000","last_fullsized":"2023-07-27T14:36:26.272505+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297913+0000","last_change":"2023-07-27T14:36:26.294332+0000","last_active":"2023-07-27T14:36:26.297913+0000","last_peered":"2023-07-27T14:36:26.297913+0000","last_clean":"2023-07-27T14:36:26.297913+0000","last_became_active":"2023-07-27T14:36:26.293865+0000","last_became_peered":"2023-07-27T14:36:26.293865+0000","last_unstale":"2023-07-27T14:36:26.297913+0000","last_undegraded":"2023-07-27T14:36:26.297913+0000","last_fullsized":"2023-07-27T14:36:26.297913+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291282+0000","last_change":"2023-07-27T14:36:25.828616+0000","last_active":"2023-07-27T14:36:26.291282+0000","last_peered":"2023-07-27T14:36:26.291282+0000","last_clean":"2023-07-27T14:36:26.291282+0000","last_became_active":"2023-07-27T14:36:25.828266+0000","last_became_peered":"2023-07-27T14:36:25.828266+0000","last_unstale":"2023-07-27T14:36:26.291282+0000","last_undegraded":"2023-07-27T14:36:26.291282+0000","last_fullsized":"2023-07-27T14:36:26.291282+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275507+0000","last_change":"2023-07-27T14:36:26.271447+0000","last_active":"2023-07-27T14:36:26.275507+0000","last_peered":"2023-07-27T14:36:26.275507+0000","last_clean":"2023-07-27T14:36:26.275507+0000","last_became_active":"2023-07-27T14:36:26.271150+0000","last_became_peered":"2023-07-27T14:36:26.271150+0000","last_unstale":"2023-07-27T14:36:26.275507+0000","last_undegraded":"2023-07-27T14:36:26.275507+0000","last_fullsized":"2023-07-27T14:36:26.275507+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279588+0000","last_change":"2023-07-27T14:36:25.826968+0000","last_active":"2023-07-27T14:36:26.279588+0000","last_peered":"2023-07-27T14:36:26.279588+0000","last_clean":"2023-07-27T14:36:26.279588+0000","last_became_active":"2023-07-27T14:36:25.826495+0000","last_became_peered":"2023-07-27T14:36:25.826495+0000","last_unstale":"2023-07-27T14:36:26.279588+0000","last_undegraded":"2023-07-27T14:36:26.279588+0000","last_fullsized":"2023-07-27T14:36:26.279588+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297496+0000","last_change":"2023-07-27T14:36:26.290333+0000","last_active":"2023-07-27T14:36:26.297496+0000","last_peered":"2023-07-27T14:36:26.297496+0000","last_clean":"2023-07-27T14:36:26.297496+0000","last_became_active":"2023-07-27T14:36:26.290024+0000","last_became_peered":"2023-07-27T14:36:26.290024+0000","last_unstale":"2023-07-27T14:36:26.297496+0000","last_undegraded":"2023-07-27T14:36:26.297496+0000","last_fullsized":"2023-07-27T14:36:26.297496+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265583+0000","last_change":"2023-07-27T14:36:25.826716+0000","last_active":"2023-07-27T14:36:26.265583+0000","last_peered":"2023-07-27T14:36:26.265583+0000","last_clean":"2023-07-27T14:36:26.265583+0000","last_became_active":"2023-07-27T14:36:25.826472+0000","last_became_peered":"2023-07-27T14:36:25.826472+0000","last_unstale":"2023-07-27T14:36:26.265583+0000","last_undegraded":"2023-07-27T14:36:26.265583+0000","last_fullsized":"2023-07-27T14:36:26.265583+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.290284+0000","last_change":"2023-07-27T14:36:26.287503+0000","last_active":"2023-07-27T14:36:26.290284+0000","last_peered":"2023-07-27T14:36:26.290284+0000","last_clean":"2023-07-27T14:36:26.290284+0000","last_became_active":"2023-07-27T14:36:26.287239+0000","last_became_peered":"2023-07-27T14:36:26.287239+0000","last_unstale":"2023-07-27T14:36:26.290284+0000","last_undegraded":"2023-07-27T14:36:26.290284+0000","last_fullsized":"2023-07-27T14:36:26.290284+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.274513+0000","last_change":"2023-07-27T14:36:25.824728+0000","last_active":"2023-07-27T14:36:26.274513+0000","last_peered":"2023-07-27T14:36:26.274513+0000","last_clean":"2023-07-27T14:36:26.274513+0000","last_became_active":"2023-07-27T14:36:25.824423+0000","last_became_peered":"2023-07-27T14:36:25.824423+0000","last_unstale":"2023-07-27T14:36:26.274513+0000","last_undegraded":"2023-07-27T14:36:26.274513+0000","last_fullsized":"2023-07-27T14:36:26.274513+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275914+0000","last_change":"2023-07-27T14:36:26.272211+0000","last_active":"2023-07-27T14:36:26.275914+0000","last_peered":"2023-07-27T14:36:26.275914+0000","last_clean":"2023-07-27T14:36:26.275914+0000","last_became_active":"2023-07-27T14:36:26.271892+0000","last_became_peered":"2023-07-27T14:36:26.271892+0000","last_unstale":"2023-07-27T14:36:26.275914+0000","last_undegraded":"2023-07-27T14:36:26.275914+0000","last_fullsized":"2023-07-27T14:36:26.275914+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.294839+0000","last_change":"2023-07-27T14:36:25.828191+0000","last_active":"2023-07-27T14:36:26.294839+0000","last_peered":"2023-07-27T14:36:26.294839+0000","last_clean":"2023-07-27T14:36:26.294839+0000","last_became_active":"2023-07-27T14:36:25.827718+0000","last_became_peered":"2023-07-27T14:36:25.827718+0000","last_unstale":"2023-07-27T14:36:26.294839+0000","last_undegraded":"2023-07-27T14:36:26.294839+0000","last_fullsized":"2023-07-27T14:36:26.294839+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286508+0000","last_change":"2023-07-27T14:36:26.281498+0000","last_active":"2023-07-27T14:36:26.286508+0000","last_peered":"2023-07-27T14:36:26.286508+0000","last_clean":"2023-07-27T14:36:26.286508+0000","last_became_active":"2023-07-27T14:36:26.281129+0000","last_became_peered":"2023-07-27T14:36:26.281129+0000","last_unstale":"2023-07-27T14:36:26.286508+0000","last_undegraded":"2023-07-27T14:36:26.286508+0000","last_fullsized":"2023-07-27T14:36:26.286508+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265286+0000","last_change":"2023-07-27T14:36:25.821788+0000","last_active":"2023-07-27T14:36:26.265286+0000","last_peered":"2023-07-27T14:36:26.265286+0000","last_clean":"2023-07-27T14:36:26.265286+0000","last_became_active":"2023-07-27T14:36:25.821433+0000","last_became_peered":"2023-07-27T14:36:25.821433+0000","last_unstale":"2023-07-27T14:36:26.265286+0000","last_undegraded":"2023-07-27T14:36:26.265286+0000","last_fullsized":"2023-07-27T14:36:26.265286+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288607+0000","last_change":"2023-07-27T14:36:26.285501+0000","last_active":"2023-07-27T14:36:26.288607+0000","last_peered":"2023-07-27T14:36:26.288607+0000","last_clean":"2023-07-27T14:36:26.288607+0000","last_became_active":"2023-07-27T14:36:26.285224+0000","last_became_peered":"2023-07-27T14:36:26.285224+0000","last_unstale":"2023-07-27T14:36:26.288607+0000","last_undegraded":"2023-07-27T14:36:26.288607+0000","last_fullsized":"2023-07-27T14:36:26.288607+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267892+0000","last_change":"2023-07-27T14:36:25.827585+0000","last_active":"2023-07-27T14:36:26.267892+0000","last_peered":"2023-07-27T14:36:26.267892+0000","last_clean":"2023-07-27T14:36:26.267892+0000","last_became_active":"2023-07-27T14:36:25.827306+0000","last_became_peered":"2023-07-27T14:36:25.827306+0000","last_unstale":"2023-07-27T14:36:26.267892+0000","last_undegraded":"2023-07-27T14:36:26.267892+0000","last_fullsized":"2023-07-27T14:36:26.267892+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.289257+0000","last_change":"2023-07-27T14:36:26.282839+0000","last_active":"2023-07-27T14:36:26.289257+0000","last_peered":"2023-07-27T14:36:26.289257+0000","last_clean":"2023-07-27T14:36:26.289257+0000","last_became_active":"2023-07-27T14:36:26.282557+0000","last_became_peered":"2023-07-27T14:36:26.282557+0000","last_unstale":"2023-07-27T14:36:26.289257+0000","last_undegraded":"2023-07-27T14:36:26.289257+0000","last_fullsized":"2023-07-27T14:36:26.289257+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266608+0000","last_change":"2023-07-27T14:36:25.828257+0000","last_active":"2023-07-27T14:36:26.266608+0000","last_peered":"2023-07-27T14:36:26.266608+0000","last_clean":"2023-07-27T14:36:26.266608+0000","last_became_active":"2023-07-27T14:36:25.827526+0000","last_became_peered":"2023-07-27T14:36:25.827526+0000","last_unstale":"2023-07-27T14:36:26.266608+0000","last_undegraded":"2023-07-27T14:36:26.266608+0000","last_fullsized":"2023-07-27T14:36:26.266608+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296658+0000","last_change":"2023-07-27T14:36:26.291786+0000","last_active":"2023-07-27T14:36:26.296658+0000","last_peered":"2023-07-27T14:36:26.296658+0000","last_clean":"2023-07-27T14:36:26.296658+0000","last_became_active":"2023-07-27T14:36:26.291518+0000","last_became_peered":"2023-07-27T14:36:26.291518+0000","last_unstale":"2023-07-27T14:36:26.296658+0000","last_undegraded":"2023-07-27T14:36:26.296658+0000","last_fullsized":"2023-07-27T14:36:26.296658+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266707+0000","last_change":"2023-07-27T14:36:25.814373+0000","last_active":"2023-07-27T14:36:26.266707+0000","last_peered":"2023-07-27T14:36:26.266707+0000","last_clean":"2023-07-27T14:36:26.266707+0000","last_became_active":"2023-07-27T14:36:25.814101+0000","last_became_peered":"2023-07-27T14:36:25.814101+0000","last_unstale":"2023-07-27T14:36:26.266707+0000","last_undegraded":"2023-07-27T14:36:26.266707+0000","last_fullsized":"2023-07-27T14:36:26.266707+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286479+0000","last_change":"2023-07-27T14:36:26.281349+0000","last_active":"2023-07-27T14:36:26.286479+0000","last_peered":"2023-07-27T14:36:26.286479+0000","last_clean":"2023-07-27T14:36:26.286479+0000","last_became_active":"2023-07-27T14:36:26.280843+0000","last_became_peered":"2023-07-27T14:36:26.280843+0000","last_unstale":"2023-07-27T14:36:26.286479+0000","last_undegraded":"2023-07-27T14:36:26.286479+0000","last_fullsized":"2023-07-27T14:36:26.286479+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.273373+0000","last_change":"2023-07-27T14:36:25.828410+0000","last_active":"2023-07-27T14:36:26.273373+0000","last_peered":"2023-07-27T14:36:26.273373+0000","last_clean":"2023-07-27T14:36:26.273373+0000","last_became_active":"2023-07-27T14:36:25.828099+0000","last_became_peered":"2023-07-27T14:36:25.828099+0000","last_unstale":"2023-07-27T14:36:26.273373+0000","last_undegraded":"2023-07-27T14:36:26.273373+0000","last_fullsized":"2023-07-27T14:36:26.273373+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298290+0000","last_change":"2023-07-27T14:36:26.293489+0000","last_active":"2023-07-27T14:36:26.298290+0000","last_peered":"2023-07-27T14:36:26.298290+0000","last_clean":"2023-07-27T14:36:26.298290+0000","last_became_active":"2023-07-27T14:36:26.293244+0000","last_became_peered":"2023-07-27T14:36:26.293244+0000","last_unstale":"2023-07-27T14:36:26.298290+0000","last_undegraded":"2023-07-27T14:36:26.298290+0000","last_fullsized":"2023-07-27T14:36:26.298290+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.264597+0000","last_change":"2023-07-27T14:36:25.822367+0000","last_active":"2023-07-27T14:36:26.264597+0000","last_peered":"2023-07-27T14:36:26.264597+0000","last_clean":"2023-07-27T14:36:26.264597+0000","last_became_active":"2023-07-27T14:36:25.820423+0000","last_became_peered":"2023-07-27T14:36:25.820423+0000","last_unstale":"2023-07-27T14:36:26.264597+0000","last_undegraded":"2023-07-27T14:36:26.264597+0000","last_fullsized":"2023-07-27T14:36:26.264597+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.292166+0000","last_change":"2023-07-27T14:36:26.286283+0000","last_active":"2023-07-27T14:36:26.292166+0000","last_peered":"2023-07-27T14:36:26.292166+0000","last_clean":"2023-07-27T14:36:26.292166+0000","last_became_active":"2023-07-27T14:36:26.285949+0000","last_became_peered":"2023-07-27T14:36:26.285949+0000","last_unstale":"2023-07-27T14:36:26.292166+0000","last_undegraded":"2023-07-27T14:36:26.292166+0000","last_fullsized":"2023-07-27T14:36:26.292166+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277489+0000","last_change":"2023-07-27T14:36:25.822513+0000","last_active":"2023-07-27T14:36:26.277489+0000","last_peered":"2023-07-27T14:36:26.277489+0000","last_clean":"2023-07-27T14:36:26.277489+0000","last_became_active":"2023-07-27T14:36:25.822307+0000","last_became_peered":"2023-07-27T14:36:25.822307+0000","last_unstale":"2023-07-27T14:36:26.277489+0000","last_undegraded":"2023-07-27T14:36:26.277489+0000","last_fullsized":"2023-07-27T14:36:26.277489+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296677+0000","last_change":"2023-07-27T14:36:26.294659+0000","last_active":"2023-07-27T14:36:26.296677+0000","last_peered":"2023-07-27T14:36:26.296677+0000","last_clean":"2023-07-27T14:36:26.296677+0000","last_became_active":"2023-07-27T14:36:26.294352+0000","last_became_peered":"2023-07-27T14:36:26.294352+0000","last_unstale":"2023-07-27T14:36:26.296677+0000","last_undegraded":"2023-07-27T14:36:26.296677+0000","last_fullsized":"2023-07-27T14:36:26.296677+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.292605+0000","last_change":"2023-07-27T14:36:25.812277+0000","last_active":"2023-07-27T14:36:26.292605+0000","last_peered":"2023-07-27T14:36:26.292605+0000","last_clean":"2023-07-27T14:36:26.292605+0000","last_became_active":"2023-07-27T14:36:25.811935+0000","last_became_peered":"2023-07-27T14:36:25.811935+0000","last_unstale":"2023-07-27T14:36:26.292605+0000","last_undegraded":"2023-07-27T14:36:26.292605+0000","last_fullsized":"2023-07-27T14:36:26.292605+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267822+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:36:26.267822+0000","last_peered":"2023-07-27T14:36:26.267822+0000","last_clean":"2023-07-27T14:36:26.267822+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:36:26.267822+0000","last_undegraded":"2023-07-27T14:36:26.267822+0000","last_fullsized":"2023-07-27T14:36:26.267822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291884+0000","last_change":"2023-07-27T14:36:26.290670+0000","last_active":"2023-07-27T14:36:26.291884+0000","last_peered":"2023-07-27T14:36:26.291884+0000","last_clean":"2023-07-27T14:36:26.291884+0000","last_became_active":"2023-07-27T14:36:26.290339+0000","last_became_peered":"2023-07-27T14:36:26.290339+0000","last_unstale":"2023-07-27T14:36:26.291884+0000","last_undegraded":"2023-07-27T14:36:26.291884+0000","last_fullsized":"2023-07-27T14:36:26.291884+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"157'3","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.294027+0000","last_change":"2023-07-27T14:36:25.818717+0000","last_active":"2023-07-27T14:36:26.294027+0000","last_peered":"2023-07-27T14:36:26.294027+0000","last_clean":"2023-07-27T14:36:26.294027+0000","last_became_active":"2023-07-27T14:36:25.818437+0000","last_became_peered":"2023-07-27T14:36:25.818437+0000","last_unstale":"2023-07-27T14:36:26.294027+0000","last_undegraded":"2023-07-27T14:36:26.294027+0000","last_fullsized":"2023-07-27T14:36:26.294027+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.264879+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:36:26.264879+0000","last_peered":"2023-07-27T14:36:26.264879+0000","last_clean":"2023-07-27T14:36:26.264879+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:36:26.264879+0000","last_undegraded":"2023-07-27T14:36:26.264879+0000","last_fullsized":"2023-07-27T14:36:26.264879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296324+0000","last_change":"2023-07-27T14:36:26.294935+0000","last_active":"2023-07-27T14:36:26.296324+0000","last_peered":"2023-07-27T14:36:26.296324+0000","last_clean":"2023-07-27T14:36:26.296324+0000","last_became_active":"2023-07-27T14:36:26.294550+0000","last_became_peered":"2023-07-27T14:36:26.294550+0000","last_unstale":"2023-07-27T14:36:26.296324+0000","last_undegraded":"2023-07-27T14:36:26.296324+0000","last_fullsized":"2023-07-27T14:36:26.296324+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265414+0000","last_change":"2023-07-27T14:36:25.818707+0000","last_active":"2023-07-27T14:36:26.265414+0000","last_peered":"2023-07-27T14:36:26.265414+0000","last_clean":"2023-07-27T14:36:26.265414+0000","last_became_active":"2023-07-27T14:36:25.818099+0000","last_became_peered":"2023-07-27T14:36:25.818099+0000","last_unstale":"2023-07-27T14:36:26.265414+0000","last_undegraded":"2023-07-27T14:36:26.265414+0000","last_fullsized":"2023-07-27T14:36:26.265414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.271511+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:36:26.271511+0000","last_peered":"2023-07-27T14:36:26.271511+0000","last_clean":"2023-07-27T14:36:26.271511+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:36:26.271511+0000","last_undegraded":"2023-07-27T14:36:26.271511+0000","last_fullsized":"2023-07-27T14:36:26.271511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295765+0000","last_change":"2023-07-27T14:36:26.287452+0000","last_active":"2023-07-27T14:36:26.295765+0000","last_peered":"2023-07-27T14:36:26.295765+0000","last_clean":"2023-07-27T14:36:26.295765+0000","last_became_active":"2023-07-27T14:36:26.287193+0000","last_became_peered":"2023-07-27T14:36:26.287193+0000","last_unstale":"2023-07-27T14:36:26.295765+0000","last_undegraded":"2023-07-27T14:36:26.295765+0000","last_fullsized":"2023-07-27T14:36:26.295765+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295956+0000","last_change":"2023-07-27T14:36:25.828394+0000","last_active":"2023-07-27T14:36:26.295956+0000","last_peered":"2023-07-27T14:36:26.295956+0000","last_clean":"2023-07-27T14:36:26.295956+0000","last_became_active":"2023-07-27T14:36:25.828103+0000","last_became_peered":"2023-07-27T14:36:25.828103+0000","last_unstale":"2023-07-27T14:36:26.295956+0000","last_undegraded":"2023-07-27T14:36:26.295956+0000","last_fullsized":"2023-07-27T14:36:26.295956+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266526+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:36:26.266526+0000","last_peered":"2023-07-27T14:36:26.266526+0000","last_clean":"2023-07-27T14:36:26.266526+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:36:26.266526+0000","last_undegraded":"2023-07-27T14:36:26.266526+0000","last_fullsized":"2023-07-27T14:36:26.266526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277356+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:36:26.277356+0000","last_peered":"2023-07-27T14:36:26.277356+0000","last_clean":"2023-07-27T14:36:26.277356+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:36:26.277356+0000","last_undegraded":"2023-07-27T14:36:26.277356+0000","last_fullsized":"2023-07-27T14:36:26.277356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.299733+0000","last_change":"2023-07-27T14:36:26.298809+0000","last_active":"2023-07-27T14:36:26.299733+0000","last_peered":"2023-07-27T14:36:26.299733+0000","last_clean":"2023-07-27T14:36:26.299733+0000","last_became_active":"2023-07-27T14:36:26.298461+0000","last_became_peered":"2023-07-27T14:36:26.298461+0000","last_unstale":"2023-07-27T14:36:26.299733+0000","last_undegraded":"2023-07-27T14:36:26.299733+0000","last_fullsized":"2023-07-27T14:36:26.299733+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281912+0000","last_change":"2023-07-27T14:36:25.820796+0000","last_active":"2023-07-27T14:36:26.281912+0000","last_peered":"2023-07-27T14:36:26.281912+0000","last_clean":"2023-07-27T14:36:26.281912+0000","last_became_active":"2023-07-27T14:36:25.820428+0000","last_became_peered":"2023-07-27T14:36:25.820428+0000","last_unstale":"2023-07-27T14:36:26.281912+0000","last_undegraded":"2023-07-27T14:36:26.281912+0000","last_fullsized":"2023-07-27T14:36:26.281912+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277455+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:36:26.277455+0000","last_peered":"2023-07-27T14:36:26.277455+0000","last_clean":"2023-07-27T14:36:26.277455+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:36:26.277455+0000","last_undegraded":"2023-07-27T14:36:26.277455+0000","last_fullsized":"2023-07-27T14:36:26.277455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.290159+0000","last_change":"2023-07-27T14:36:26.287770+0000","last_active":"2023-07-27T14:36:26.290159+0000","last_peered":"2023-07-27T14:36:26.290159+0000","last_clean":"2023-07-27T14:36:26.290159+0000","last_became_active":"2023-07-27T14:36:26.287124+0000","last_became_peered":"2023-07-27T14:36:26.287124+0000","last_unstale":"2023-07-27T14:36:26.290159+0000","last_undegraded":"2023-07-27T14:36:26.290159+0000","last_fullsized":"2023-07-27T14:36:26.290159+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.276954+0000","last_change":"2023-07-27T14:36:25.828800+0000","last_active":"2023-07-27T14:36:26.276954+0000","last_peered":"2023-07-27T14:36:26.276954+0000","last_clean":"2023-07-27T14:36:26.276954+0000","last_became_active":"2023-07-27T14:36:25.828465+0000","last_became_peered":"2023-07-27T14:36:25.828465+0000","last_unstale":"2023-07-27T14:36:26.276954+0000","last_undegraded":"2023-07-27T14:36:26.276954+0000","last_fullsized":"2023-07-27T14:36:26.276954+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.276963+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:36:26.276963+0000","last_peered":"2023-07-27T14:36:26.276963+0000","last_clean":"2023-07-27T14:36:26.276963+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:36:26.276963+0000","last_undegraded":"2023-07-27T14:36:26.276963+0000","last_fullsized":"2023-07-27T14:36:26.276963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.283518+0000","last_change":"2023-07-27T14:36:26.281382+0000","last_active":"2023-07-27T14:36:26.283518+0000","last_peered":"2023-07-27T14:36:26.283518+0000","last_clean":"2023-07-27T14:36:26.283518+0000","last_became_active":"2023-07-27T14:36:26.281114+0000","last_became_peered":"2023-07-27T14:36:26.281114+0000","last_unstale":"2023-07-27T14:36:26.283518+0000","last_undegraded":"2023-07-27T14:36:26.283518+0000","last_fullsized":"2023-07-27T14:36:26.283518+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.276729+0000","last_change":"2023-07-27T14:36:25.822266+0000","last_active":"2023-07-27T14:36:26.276729+0000","last_peered":"2023-07-27T14:36:26.276729+0000","last_clean":"2023-07-27T14:36:26.276729+0000","last_became_active":"2023-07-27T14:36:25.821453+0000","last_became_peered":"2023-07-27T14:36:25.821453+0000","last_unstale":"2023-07-27T14:36:26.276729+0000","last_undegraded":"2023-07-27T14:36:26.276729+0000","last_fullsized":"2023-07-27T14:36:26.276729+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267556+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:36:26.267556+0000","last_peered":"2023-07-27T14:36:26.267556+0000","last_clean":"2023-07-27T14:36:26.267556+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:36:26.267556+0000","last_undegraded":"2023-07-27T14:36:26.267556+0000","last_fullsized":"2023-07-27T14:36:26.267556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275705+0000","last_change":"2023-07-27T14:36:26.272588+0000","last_active":"2023-07-27T14:36:26.275705+0000","last_peered":"2023-07-27T14:36:26.275705+0000","last_clean":"2023-07-27T14:36:26.275705+0000","last_became_active":"2023-07-27T14:36:26.272325+0000","last_became_peered":"2023-07-27T14:36:26.272325+0000","last_unstale":"2023-07-27T14:36:26.275705+0000","last_undegraded":"2023-07-27T14:36:26.275705+0000","last_fullsized":"2023-07-27T14:36:26.275705+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"157'4","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.290005+0000","last_change":"2023-07-27T14:36:25.822181+0000","last_active":"2023-07-27T14:36:26.290005+0000","last_peered":"2023-07-27T14:36:26.290005+0000","last_clean":"2023-07-27T14:36:26.290005+0000","last_became_active":"2023-07-27T14:36:25.821903+0000","last_became_peered":"2023-07-27T14:36:25.821903+0000","last_unstale":"2023-07-27T14:36:26.290005+0000","last_undegraded":"2023-07-27T14:36:26.290005+0000","last_fullsized":"2023-07-27T14:36:26.290005+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":123,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.274142+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:36:26.274142+0000","last_peered":"2023-07-27T14:36:26.274142+0000","last_clean":"2023-07-27T14:36:26.274142+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:36:26.274142+0000","last_undegraded":"2023-07-27T14:36:26.274142+0000","last_fullsized":"2023-07-27T14:36:26.274142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17116,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":15168,"kb_avail":94354724,"statfs":{"total":96636764160,"available":96619237376,"internally_reserved":0,"allocated":1986560,"data_stored":932743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15532032},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.64700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83199999999999996,"5min":0.996,"15min":1.133},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.85199999999999998,"5min":0.92800000000000005,"15min":1.1180000000000001},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.879,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":0.96999999999999997,"15min":1.1459999999999999},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66300000000000003,"15min":0.69299999999999995},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.88900000000000001,"5min":0.96499999999999997,"15min":1.119},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65900000000000003,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.69499999999999995,"15min":0.69999999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.165},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66000000000000003,"15min":0.64300000000000002},"min":{"1min":0.55800000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.47999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68700000000000006,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":1.202,"15min":1.202},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.58599999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98999999999999999,"5min":1.101,"15min":1.101},"last":0.94999999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76000000000000001,"15min":0.753},"min":{"1min":0.64800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.03,"5min":1.056,"15min":1.056},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.71899999999999997},"min":{"1min":0.52900000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18000,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94353840,"statfs":{"total":96636764160,"available":96618332160,"internally_reserved":0,"allocated":1974272,"data_stored":931275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93899999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.47599999999999998,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.996},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.45600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.94399999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.441,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90700000000000003,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84399999999999997,"5min":1.01,"15min":1.01},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.61099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83999999999999997,"5min":0.92900000000000005,"15min":1.2},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.55800000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.88500000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.51100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.94399999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64600000000000002,"15min":0.66700000000000004},"min":{"1min":0.53000000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78400000000000003,"5min":0.98999999999999999,"15min":1.079},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.871,"5min":0.98899999999999999,"15min":1.198},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92200000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.58899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.044,"5min":1.054,"15min":1.1000000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1040000000000001,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23192,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":21248,"kb_avail":94348648,"statfs":{"total":96636764160,"available":96613015552,"internally_reserved":0,"allocated":1982464,"data_stored":931899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21757952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38700000000000001,"15min":0.47499999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":0.55600000000000005,"5min":0.61499999999999999,"15min":4.75},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42099999999999999,"15min":0.58999999999999997},"min":{"1min":0.30099999999999999,"5min":0.26900000000000002,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.70199999999999996,"15min":9.3100000000000005},"last":0.622}]},{"osd":2,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":3.7210000000000001},"last":0.505},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.51500000000000001},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.63,"5min":0.79700000000000004,"15min":2.7160000000000002},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47199999999999998,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.32800000000000001},"max":{"1min":0.57899999999999996,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.53600000000000003},"min":{"1min":0.33900000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.54000000000000004,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.44}]},{"osd":4,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.42799999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.111,"5min":1.1639999999999999,"15min":2.181},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.014,"5min":1.014,"15min":2.4180000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.47999999999999998,"15min":0.46600000000000003},"max":{"1min":0.997,"5min":1.0980000000000001,"15min":3.7440000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.52500000000000002,"5min":0.48599999999999999,"15min":0.45400000000000001},"max":{"1min":1.0449999999999999,"5min":1.131,"15min":2.149},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.085,"5min":1.085,"15min":2.052},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.80500000000000005},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":6.1980000000000004},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.74199999999999999},"min":{"1min":0.57199999999999995,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":2.016},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76300000000000001,"15min":0.82499999999999996},"min":{"1min":0.56799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":3.7799999999999998},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17760,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354080,"statfs":{"total":96636764160,"available":96618577920,"internally_reserved":0,"allocated":1990656,"data_stored":932043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.54300000000000004,"5min":0.57499999999999996,"15min":0.79500000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.33700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.69099999999999995,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.314,"15min":0.309},"max":{"1min":0.57099999999999995,"5min":0.71699999999999997,"15min":0.73699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.54400000000000004,"5min":0.59899999999999998,"15min":0.77800000000000002},"last":0.434}]},{"osd":4,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":0.96499999999999997,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.748},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97699999999999998,"5min":1.085,"15min":1.28},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.25},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93500000000000005,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.034,"5min":1.034,"15min":1.2030000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.997,"5min":0.997,"15min":1.22},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.244},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.74199999999999999},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.2370000000000001},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25372,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":23424,"kb_avail":94346468,"statfs":{"total":96636764160,"available":96610783232,"internally_reserved":0,"allocated":1986560,"data_stored":931457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23986176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39200000000000002,"15min":0.40999999999999998},"min":{"1min":0.27900000000000003,"5min":0.24199999999999999,"15min":0.23799999999999999},"max":{"1min":0.51800000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.502},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.26700000000000002},"max":{"1min":0.60999999999999999,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.47499999999999998},"min":{"1min":0.33600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.96399999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51700000000000002,"15min":0.49099999999999999},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.626,"5min":5.601,"15min":5.601},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.443,"15min":0.47099999999999997},"min":{"1min":0.35999999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.59899999999999998,"5min":0.70799999999999996,"15min":0.83499999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.41199999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.002,"5min":1.353,"15min":1.353},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83499999999999996,"5min":1.849,"15min":1.849},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76200000000000001,"15min":0.71599999999999997},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70099999999999996,"15min":0.72199999999999998},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71199999999999997,"15min":0.73799999999999999},"min":{"1min":0.58399999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":1.772,"15min":1.772},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.439,"15min":0.42499999999999999},"max":{"1min":0.878,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.105,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.60499999999999998,"5min":0.55000000000000004,"15min":0.53700000000000003},"max":{"1min":0.91000000000000003,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.57399999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"max":{"1min":0.86299999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17364,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94354476,"statfs":{"total":96636764160,"available":96618983424,"internally_reserved":0,"allocated":1978368,"data_stored":931309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.51200000000000001,"5min":1.202,"15min":1.202},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.435},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60399999999999998,"5min":1.302,"15min":1.302},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41899999999999998,"15min":0.439},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57599999999999996,"5min":0.748,"15min":0.88900000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.64200000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.372,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68899999999999995,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.69299999999999995},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":0.83099999999999996,"5min":0.96299999999999997,"15min":1.149},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.71499999999999997},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":1.232,"15min":1.232},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.52600000000000002,"5min":0.50800000000000001,"15min":0.45200000000000001},"max":{"1min":0.86299999999999999,"5min":1.121,"15min":1.298},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70499999999999996,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":0.98299999999999998,"5min":1.343,"15min":1.343},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.93700000000000006,"5min":2.048,"15min":2.048},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.67000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16344,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":14400,"kb_avail":94355496,"statfs":{"total":96636764160,"available":96620027904,"internally_reserved":0,"allocated":1982464,"data_stored":931919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14745600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.65600000000000003},"min":{"1min":0.43099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68500000000000005,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.505,"5min":0.45800000000000002,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.46999999999999997,"5min":0.434,"15min":0.39500000000000002},"max":{"1min":0.749,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65600000000000003},"min":{"1min":0.441,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.49099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76300000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.38800000000000001},"max":{"1min":0.755,"5min":4.476,"15min":4.476},"last":0.622}]},{"osd":3,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.51300000000000001,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.86399999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69699999999999995,"15min":0.68400000000000005},"min":{"1min":0.55200000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.74199999999999999,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.753}]},{"osd":5,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65400000000000003,"15min":0.623},"min":{"1min":0.45000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79600000000000004,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83799999999999997,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.66000000000000003},"min":{"1min":0.52700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82399999999999995,"5min":5.194,"15min":5.194},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77700000000000002,"15min":0.75600000000000001},"min":{"1min":0.63,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85799999999999998,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.58499999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90400000000000003,"5min":2.819,"15min":2.819},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.624,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94399999999999995,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.71999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94348524,"statfs":{"total":96636764160,"available":96612888576,"internally_reserved":0,"allocated":1978368,"data_stored":932167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.43099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.379},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59999999999999998,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.81399999999999995,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66100000000000003,"15min":0.69499999999999995},"min":{"1min":0.496,"5min":0.377,"15min":0.377},"max":{"1min":0.80700000000000005,"5min":1.026,"15min":6.7489999999999997},"last":0.443},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.68000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.77200000000000002,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.80200000000000005,"5min":0.98799999999999999,"15min":1.581},"last":0.622},{"interface":"front","average":{"1min":0.628,"5min":0.68000000000000005,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84599999999999997,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.68400000000000005},"min":{"1min":0.40699999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":9.6920000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.77700000000000002},"min":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91100000000000003,"5min":1.0660000000000001,"15min":9.4299999999999997},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":1.121,"15min":1.978},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66800000000000004,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.38600000000000001},"max":{"1min":0.92300000000000004,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.39200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83099999999999996,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.44900000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":1.0960000000000001,"15min":1.7629999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69399999999999995,"15min":0.68100000000000005},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89100000000000001,"5min":1.115,"15min":1.9419999999999999},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:36:30.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:36:30.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.766+0000 7fc2069ff700 1 Processor -- start 2023-07-27T14:36:30.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.766+0000 7fc2069ff700 1 -- start start 2023-07-27T14:36:30.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc2069ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc200065ff0 0x7fc200066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc2069ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc200066960 0x7fc200067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc2069ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc200067080 con 0x7fc200151d70 2023-07-27T14:36:30.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc2069ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc200063a90 con 0x7fc200065ff0 2023-07-27T14:36:30.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc2069ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc200066df0 con 0x7fc200066960 2023-07-27T14:36:30.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc1fffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc200151d70 0x7fc200155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38738/0 (socket says 172.21.15.115:38738) 2023-07-27T14:36:30.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc1fffff700 1 -- 172.21.15.115:0/334979903 learned_addr learned my addr 172.21.15.115:0/334979903 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:30.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/334979903 >> v2:172.21.15.159:3300/0 conn(0x7fc200065ff0 0x7fc200066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc204f9c700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc200066960 0x7fc200067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338132658 0 0) 0x7fc200067080 con 0x7fc200151d70 2023-07-27T14:36:30.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.768+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e80033f0 con 0x7fc200151d70 2023-07-27T14:36:30.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893551726 0 0) 0x7fc1e80033f0 con 0x7fc200151d70 2023-07-27T14:36:30.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc200066960 msgr2=0x7fc200067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:30.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc200066960 0x7fc200067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 >> v2:172.21.15.159:3300/0 conn(0x7fc200065ff0 msgr2=0x7fc200066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:30.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 --2- 172.21.15.115:0/334979903 >> v2:172.21.15.159:3300/0 conn(0x7fc200065ff0 0x7fc200066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000634d0 con 0x7fc200151d70 2023-07-27T14:36:30.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fc1f0001470 con 0x7fc200151d70 2023-07-27T14:36:30.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/334979903 >> v2:172.21.15.159:3300/0 conn(0x7fc200065ff0 0x7fc200066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:30.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 >> v1:172.21.15.115:6789/0 conn(0x7fc200151d70 legacy=0x7fc200155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80038e0 0x7fc1e8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc1e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc200066960 0x7fc1e8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200063a90 con 0x7fc1e8004690 2023-07-27T14:36:30.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200066df0 con 0x7fc1e80038e0 2023-07-27T14:36:30.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e800b8e0 con 0x7fc200066960 2023-07-27T14:36:30.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc1e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1fffff700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80038e0 0x7fc1e8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc204f9c700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc200066960 0x7fc1e8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1ff7fe700 1 -- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc200066960 msgr2=0x7fc1e8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:30.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc200066960 0x7fc1e8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1ff7fe700 1 -- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80038e0 msgr2=0x7fc1e8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:30.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80038e0 0x7fc1e8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.769+0000 7fc1ff7fe700 1 -- 172.21.15.115:0/334979903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80033f0 con 0x7fc1e8004690 2023-07-27T14:36:30.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc1e8004b10 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7fc1f4009c70 tx=0x7fc1f4009060).ready entity=mon.0 client_cookie=5a371d34c7e1f375 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:30.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f40095c0 con 0x7fc1e8004690 2023-07-27T14:36:30.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f400e6f0 con 0x7fc1e8004690 2023-07-27T14:36:30.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc1feffd700 1 -- 172.21.15.115:0/334979903 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400ea70 con 0x7fc1e8004690 2023-07-27T14:36:30.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc2069ff700 1 -- 172.21.15.115:0/334979903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 msgr2=0x7fc1e8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc2069ff700 1 --2- 172.21.15.115:0/334979903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc1e8004b10 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7fc1f4009c70 tx=0x7fc1f4009060).stop 2023-07-27T14:36:30.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc204f9c700 1 -- 172.21.15.115:0/334979903 reap_dead start 2023-07-27T14:36:30.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc2069ff700 1 -- 172.21.15.115:0/334979903 shutdown_connections 2023-07-27T14:36:30.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc2069ff700 1 -- 172.21.15.115:0/334979903 >> 172.21.15.115:0/334979903 conn(0x7fc2000c89a0 msgr2=0x7fc2000c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:30.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.770+0000 7fc2069ff700 1 -- 172.21.15.115:0/334979903 shutdown_connections 2023-07-27T14:36:30.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.771+0000 7fc2069ff700 1 -- 172.21.15.115:0/334979903 wait complete. 2023-07-27T14:36:30.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.772+0000 7fc2069ff700 1 Processor -- start 2023-07-27T14:36:30.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.772+0000 7fc2069ff700 1 -- start start 2023-07-27T14:36:30.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc2069ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc2000a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc2069ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000ac090 0x7fc20014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc2069ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc2000adda0 0x7fc2000ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc2069ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000a9e00 con 0x7fc1e8004690 2023-07-27T14:36:30.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc2069ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000ac8e0 con 0x7fc2000ac090 2023-07-27T14:36:30.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc2069ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000ac600 con 0x7fc2000adda0 2023-07-27T14:36:30.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc1fffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc2000a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc1fffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc2000a8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49788/0 (socket says 172.21.15.115:49788) 2023-07-27T14:36:30.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc1fffff700 1 -- 172.21.15.115:0/1625965894 learned_addr learned my addr 172.21.15.115:0/1625965894 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:30.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000ac090 0x7fc20014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc204f9c700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc2000adda0 0x7fc2000ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.773+0000 7fc1fffff700 1 -- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc2000adda0 msgr2=0x7fc2000ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1fffff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc2000adda0 0x7fc2000ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1fffff700 1 -- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000ac090 msgr2=0x7fc20014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:30.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1fffff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000ac090 0x7fc20014c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:30.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1fffff700 1 -- 172.21.15.115:0/1625965894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000a9fe0 con 0x7fc1e8004690 2023-07-27T14:36:30.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000ac090 0x7fc20014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:30.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1fffff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc2000a8c00 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7fc1f0004960 tx=0x7fc1f0001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:30.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1e7fff700 1 -- 172.21.15.115:0/1625965894 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0004ea0 con 0x7fc1e8004690 2023-07-27T14:36:30.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1e7fff700 1 -- 172.21.15.115:0/1625965894 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f000f850 con 0x7fc1e8004690 2023-07-27T14:36:30.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc1e7fff700 1 -- 172.21.15.115:0/1625965894 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000fbd0 con 0x7fc1e8004690 2023-07-27T14:36:30.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2000aa2c0 con 0x7fc1e8004690 2023-07-27T14:36:30.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.774+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2000a90f0 con 0x7fc1e8004690 2023-07-27T14:36:30.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.775+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20006c470 con 0x7fc1e8004690 2023-07-27T14:36:30.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.776+0000 7fc1e7fff700 1 -- 172.21.15.115:0/1625965894 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fc1f001b030 con 0x7fc1e8004690 2023-07-27T14:36:30.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.776+0000 7fc1e7fff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1ec05f850 0x7fc1ec061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:30.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.777+0000 7fc1e7fff700 1 -- 172.21.15.115:0/1625965894 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc1f007a100 con 0x7fc1e8004690 2023-07-27T14:36:30.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.777+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1ec05f850 0x7fc1ec061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:30.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.777+0000 7fc1ff7fe700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1ec05f850 0x7fc1ec061d10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fc2000a7e00 tx=0x7fc1f401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:30.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.780+0000 7fc1e7fff700 1 -- 172.21.15.115:0/1625965894 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1f004a8f0 con 0x7fc1e8004690 2023-07-27T14:36:30.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.945+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc200152310 con 0x7fc1ec05f850 2023-07-27T14:36:31.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.955+0000 7fc1e7fff700 1 -- 172.21.15.115:0/1625965894 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361721 (secure 0 0 0) 0x7fc200152310 con 0x7fc1ec05f850 2023-07-27T14:36:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:31.012 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:36:31.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1ec05f850 msgr2=0x7fc1ec061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1ec05f850 0x7fc1ec061d10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fc2000a7e00 tx=0x7fc1f401a000).stop 2023-07-27T14:36:31.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 msgr2=0x7fc2000a8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc2000a8c00 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7fc1f0004960 tx=0x7fc1f0001e90).stop 2023-07-27T14:36:31.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 shutdown_connections 2023-07-27T14:36:31.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1ec05f850 0x7fc1ec061d10 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc2000adda0 0x7fc2000ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e8004690 0x7fc2000a8c00 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 --2- 172.21.15.115:0/1625965894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2000ac090 0x7fc20014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 >> 172.21.15.115:0/1625965894 conn(0x7fc2000c89a0 msgr2=0x7fc200067560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:31.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 shutdown_connections 2023-07-27T14:36:31.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:30.960+0000 7fc2069ff700 1 -- 172.21.15.115:0/1625965894 wait complete. 2023-07-27T14:36:31.017 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:36:31.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:36:31.025 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2023-07-27T14:36:29.566065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":250,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":158464,"kb_used_data":15488,"kb_used_omap":0,"kb_used_meta":142912,"kb_avail":754816256,"statfs":{"total":773094113280,"available":772931846144,"internally_reserved":0,"allocated":15859712,"data_stored":7454812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":146341888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1912440,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-79,"num_read_kb":-65563,"num_write":-553,"num_write_kb":-133038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":0,"num_keys_recovered":-27,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.189561"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286591+0000","last_change":"2023-07-27T14:36:26.283564+0000","last_active":"2023-07-27T14:36:26.286591+0000","last_peered":"2023-07-27T14:36:26.286591+0000","last_clean":"2023-07-27T14:36:26.286591+0000","last_became_active":"2023-07-27T14:36:26.283299+0000","last_became_peered":"2023-07-27T14:36:26.283299+0000","last_unstale":"2023-07-27T14:36:26.286591+0000","last_undegraded":"2023-07-27T14:36:26.286591+0000","last_fullsized":"2023-07-27T14:36:26.286591+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"157'3","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.290919+0000","last_change":"2023-07-27T14:36:25.810123+0000","last_active":"2023-07-27T14:36:26.290919+0000","last_peered":"2023-07-27T14:36:26.290919+0000","last_clean":"2023-07-27T14:36:26.290919+0000","last_became_active":"2023-07-27T14:36:25.809817+0000","last_became_peered":"2023-07-27T14:36:25.809817+0000","last_unstale":"2023-07-27T14:36:26.290919+0000","last_undegraded":"2023-07-27T14:36:26.290919+0000","last_fullsized":"2023-07-27T14:36:26.290919+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.300803+0000","last_change":"2023-07-27T14:36:26.296420+0000","last_active":"2023-07-27T14:36:26.300803+0000","last_peered":"2023-07-27T14:36:26.300803+0000","last_clean":"2023-07-27T14:36:26.300803+0000","last_became_active":"2023-07-27T14:36:26.296201+0000","last_became_peered":"2023-07-27T14:36:26.296201+0000","last_unstale":"2023-07-27T14:36:26.300803+0000","last_undegraded":"2023-07-27T14:36:26.300803+0000","last_fullsized":"2023-07-27T14:36:26.300803+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266639+0000","last_change":"2023-07-27T14:36:25.811669+0000","last_active":"2023-07-27T14:36:26.266639+0000","last_peered":"2023-07-27T14:36:26.266639+0000","last_clean":"2023-07-27T14:36:26.266639+0000","last_became_active":"2023-07-27T14:36:25.811409+0000","last_became_peered":"2023-07-27T14:36:25.811409+0000","last_unstale":"2023-07-27T14:36:26.266639+0000","last_undegraded":"2023-07-27T14:36:26.266639+0000","last_fullsized":"2023-07-27T14:36:26.266639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.284722+0000","last_change":"2023-07-27T14:36:26.283320+0000","last_active":"2023-07-27T14:36:26.284722+0000","last_peered":"2023-07-27T14:36:26.284722+0000","last_clean":"2023-07-27T14:36:26.284722+0000","last_became_active":"2023-07-27T14:36:26.283006+0000","last_became_peered":"2023-07-27T14:36:26.283006+0000","last_unstale":"2023-07-27T14:36:26.284722+0000","last_undegraded":"2023-07-27T14:36:26.284722+0000","last_fullsized":"2023-07-27T14:36:26.284722+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277667+0000","last_change":"2023-07-27T14:36:25.810238+0000","last_active":"2023-07-27T14:36:26.277667+0000","last_peered":"2023-07-27T14:36:26.277667+0000","last_clean":"2023-07-27T14:36:26.277667+0000","last_became_active":"2023-07-27T14:36:25.809837+0000","last_became_peered":"2023-07-27T14:36:25.809837+0000","last_unstale":"2023-07-27T14:36:26.277667+0000","last_undegraded":"2023-07-27T14:36:26.277667+0000","last_fullsized":"2023-07-27T14:36:26.277667+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288657+0000","last_change":"2023-07-27T14:36:26.286216+0000","last_active":"2023-07-27T14:36:26.288657+0000","last_peered":"2023-07-27T14:36:26.288657+0000","last_clean":"2023-07-27T14:36:26.288657+0000","last_became_active":"2023-07-27T14:36:26.285883+0000","last_became_peered":"2023-07-27T14:36:26.285883+0000","last_unstale":"2023-07-27T14:36:26.288657+0000","last_undegraded":"2023-07-27T14:36:26.288657+0000","last_fullsized":"2023-07-27T14:36:26.288657+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.293146+0000","last_change":"2023-07-27T14:36:25.825388+0000","last_active":"2023-07-27T14:36:26.293146+0000","last_peered":"2023-07-27T14:36:26.293146+0000","last_clean":"2023-07-27T14:36:26.293146+0000","last_became_active":"2023-07-27T14:36:25.825046+0000","last_became_peered":"2023-07-27T14:36:25.825046+0000","last_unstale":"2023-07-27T14:36:26.293146+0000","last_undegraded":"2023-07-27T14:36:26.293146+0000","last_fullsized":"2023-07-27T14:36:26.293146+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295809+0000","last_change":"2023-07-27T14:36:26.287546+0000","last_active":"2023-07-27T14:36:26.295809+0000","last_peered":"2023-07-27T14:36:26.295809+0000","last_clean":"2023-07-27T14:36:26.295809+0000","last_became_active":"2023-07-27T14:36:26.287133+0000","last_became_peered":"2023-07-27T14:36:26.287133+0000","last_unstale":"2023-07-27T14:36:26.295809+0000","last_undegraded":"2023-07-27T14:36:26.295809+0000","last_fullsized":"2023-07-27T14:36:26.295809+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.289298+0000","last_change":"2023-07-27T14:36:25.817577+0000","last_active":"2023-07-27T14:36:26.289298+0000","last_peered":"2023-07-27T14:36:26.289298+0000","last_clean":"2023-07-27T14:36:26.289298+0000","last_became_active":"2023-07-27T14:36:25.816680+0000","last_became_peered":"2023-07-27T14:36:25.816680+0000","last_unstale":"2023-07-27T14:36:26.289298+0000","last_undegraded":"2023-07-27T14:36:26.289298+0000","last_fullsized":"2023-07-27T14:36:26.289298+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291673+0000","last_change":"2023-07-27T14:36:26.289462+0000","last_active":"2023-07-27T14:36:26.291673+0000","last_peered":"2023-07-27T14:36:26.291673+0000","last_clean":"2023-07-27T14:36:26.291673+0000","last_became_active":"2023-07-27T14:36:26.289127+0000","last_became_peered":"2023-07-27T14:36:26.289127+0000","last_unstale":"2023-07-27T14:36:26.291673+0000","last_undegraded":"2023-07-27T14:36:26.291673+0000","last_fullsized":"2023-07-27T14:36:26.291673+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.287129+0000","last_change":"2023-07-27T14:36:25.815477+0000","last_active":"2023-07-27T14:36:26.287129+0000","last_peered":"2023-07-27T14:36:26.287129+0000","last_clean":"2023-07-27T14:36:26.287129+0000","last_became_active":"2023-07-27T14:36:25.815158+0000","last_became_peered":"2023-07-27T14:36:25.815158+0000","last_unstale":"2023-07-27T14:36:26.287129+0000","last_undegraded":"2023-07-27T14:36:26.287129+0000","last_fullsized":"2023-07-27T14:36:26.287129+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279141+0000","last_change":"2023-07-27T14:36:26.273627+0000","last_active":"2023-07-27T14:36:26.279141+0000","last_peered":"2023-07-27T14:36:26.279141+0000","last_clean":"2023-07-27T14:36:26.279141+0000","last_became_active":"2023-07-27T14:36:26.272932+0000","last_became_peered":"2023-07-27T14:36:26.272932+0000","last_unstale":"2023-07-27T14:36:26.279141+0000","last_undegraded":"2023-07-27T14:36:26.279141+0000","last_fullsized":"2023-07-27T14:36:26.279141+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265497+0000","last_change":"2023-07-27T14:36:25.826798+0000","last_active":"2023-07-27T14:36:26.265497+0000","last_peered":"2023-07-27T14:36:26.265497+0000","last_clean":"2023-07-27T14:36:26.265497+0000","last_became_active":"2023-07-27T14:36:25.826503+0000","last_became_peered":"2023-07-27T14:36:25.826503+0000","last_unstale":"2023-07-27T14:36:26.265497+0000","last_undegraded":"2023-07-27T14:36:26.265497+0000","last_fullsized":"2023-07-27T14:36:26.265497+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277235+0000","last_change":"2023-07-27T14:36:26.273552+0000","last_active":"2023-07-27T14:36:26.277235+0000","last_peered":"2023-07-27T14:36:26.277235+0000","last_clean":"2023-07-27T14:36:26.277235+0000","last_became_active":"2023-07-27T14:36:26.273296+0000","last_became_peered":"2023-07-27T14:36:26.273296+0000","last_unstale":"2023-07-27T14:36:26.277235+0000","last_undegraded":"2023-07-27T14:36:26.277235+0000","last_fullsized":"2023-07-27T14:36:26.277235+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265310+0000","last_change":"2023-07-27T14:36:25.812627+0000","last_active":"2023-07-27T14:36:26.265310+0000","last_peered":"2023-07-27T14:36:26.265310+0000","last_clean":"2023-07-27T14:36:26.265310+0000","last_became_active":"2023-07-27T14:36:25.812260+0000","last_became_peered":"2023-07-27T14:36:25.812260+0000","last_unstale":"2023-07-27T14:36:26.265310+0000","last_undegraded":"2023-07-27T14:36:26.265310+0000","last_fullsized":"2023-07-27T14:36:26.265310+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286608+0000","last_change":"2023-07-27T14:36:26.283686+0000","last_active":"2023-07-27T14:36:26.286608+0000","last_peered":"2023-07-27T14:36:26.286608+0000","last_clean":"2023-07-27T14:36:26.286608+0000","last_became_active":"2023-07-27T14:36:26.283430+0000","last_became_peered":"2023-07-27T14:36:26.283430+0000","last_unstale":"2023-07-27T14:36:26.286608+0000","last_undegraded":"2023-07-27T14:36:26.286608+0000","last_fullsized":"2023-07-27T14:36:26.286608+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266366+0000","last_change":"2023-07-27T14:36:25.816271+0000","last_active":"2023-07-27T14:36:26.266366+0000","last_peered":"2023-07-27T14:36:26.266366+0000","last_clean":"2023-07-27T14:36:26.266366+0000","last_became_active":"2023-07-27T14:36:25.815933+0000","last_became_peered":"2023-07-27T14:36:25.815933+0000","last_unstale":"2023-07-27T14:36:26.266366+0000","last_undegraded":"2023-07-27T14:36:26.266366+0000","last_fullsized":"2023-07-27T14:36:26.266366+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296343+0000","last_change":"2023-07-27T14:36:26.294835+0000","last_active":"2023-07-27T14:36:26.296343+0000","last_peered":"2023-07-27T14:36:26.296343+0000","last_clean":"2023-07-27T14:36:26.296343+0000","last_became_active":"2023-07-27T14:36:26.294545+0000","last_became_peered":"2023-07-27T14:36:26.294545+0000","last_unstale":"2023-07-27T14:36:26.296343+0000","last_undegraded":"2023-07-27T14:36:26.296343+0000","last_fullsized":"2023-07-27T14:36:26.296343+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.274705+0000","last_change":"2023-07-27T14:36:25.829637+0000","last_active":"2023-07-27T14:36:26.274705+0000","last_peered":"2023-07-27T14:36:26.274705+0000","last_clean":"2023-07-27T14:36:26.274705+0000","last_became_active":"2023-07-27T14:36:25.829178+0000","last_became_peered":"2023-07-27T14:36:25.829178+0000","last_unstale":"2023-07-27T14:36:26.274705+0000","last_undegraded":"2023-07-27T14:36:26.274705+0000","last_fullsized":"2023-07-27T14:36:26.274705+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275886+0000","last_change":"2023-07-27T14:36:26.271607+0000","last_active":"2023-07-27T14:36:26.275886+0000","last_peered":"2023-07-27T14:36:26.275886+0000","last_clean":"2023-07-27T14:36:26.275886+0000","last_became_active":"2023-07-27T14:36:26.271329+0000","last_became_peered":"2023-07-27T14:36:26.271329+0000","last_unstale":"2023-07-27T14:36:26.275886+0000","last_undegraded":"2023-07-27T14:36:26.275886+0000","last_fullsized":"2023-07-27T14:36:26.275886+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267596+0000","last_change":"2023-07-27T14:36:25.814318+0000","last_active":"2023-07-27T14:36:26.267596+0000","last_peered":"2023-07-27T14:36:26.267596+0000","last_clean":"2023-07-27T14:36:26.267596+0000","last_became_active":"2023-07-27T14:36:25.813978+0000","last_became_peered":"2023-07-27T14:36:25.813978+0000","last_unstale":"2023-07-27T14:36:26.267596+0000","last_undegraded":"2023-07-27T14:36:26.267596+0000","last_fullsized":"2023-07-27T14:36:26.267596+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295511+0000","last_change":"2023-07-27T14:36:26.292466+0000","last_active":"2023-07-27T14:36:26.295511+0000","last_peered":"2023-07-27T14:36:26.295511+0000","last_clean":"2023-07-27T14:36:26.295511+0000","last_became_active":"2023-07-27T14:36:26.292179+0000","last_became_peered":"2023-07-27T14:36:26.292179+0000","last_unstale":"2023-07-27T14:36:26.295511+0000","last_undegraded":"2023-07-27T14:36:26.295511+0000","last_fullsized":"2023-07-27T14:36:26.295511+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"157'4","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.300149+0000","last_change":"2023-07-27T14:36:25.815821+0000","last_active":"2023-07-27T14:36:26.300149+0000","last_peered":"2023-07-27T14:36:26.300149+0000","last_clean":"2023-07-27T14:36:26.300149+0000","last_became_active":"2023-07-27T14:36:25.815448+0000","last_became_peered":"2023-07-27T14:36:25.815448+0000","last_unstale":"2023-07-27T14:36:26.300149+0000","last_undegraded":"2023-07-27T14:36:26.300149+0000","last_fullsized":"2023-07-27T14:36:26.300149+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.289290+0000","last_change":"2023-07-27T14:36:26.285766+0000","last_active":"2023-07-27T14:36:26.289290+0000","last_peered":"2023-07-27T14:36:26.289290+0000","last_clean":"2023-07-27T14:36:26.289290+0000","last_became_active":"2023-07-27T14:36:26.285485+0000","last_became_peered":"2023-07-27T14:36:26.285485+0000","last_unstale":"2023-07-27T14:36:26.289290+0000","last_undegraded":"2023-07-27T14:36:26.289290+0000","last_fullsized":"2023-07-27T14:36:26.289290+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.289203+0000","last_change":"2023-07-27T14:36:25.811775+0000","last_active":"2023-07-27T14:36:26.289203+0000","last_peered":"2023-07-27T14:36:26.289203+0000","last_clean":"2023-07-27T14:36:26.289203+0000","last_became_active":"2023-07-27T14:36:25.811487+0000","last_became_peered":"2023-07-27T14:36:25.811487+0000","last_unstale":"2023-07-27T14:36:26.289203+0000","last_undegraded":"2023-07-27T14:36:26.289203+0000","last_fullsized":"2023-07-27T14:36:26.289203+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291087+0000","last_change":"2023-07-27T14:36:26.287951+0000","last_active":"2023-07-27T14:36:26.291087+0000","last_peered":"2023-07-27T14:36:26.291087+0000","last_clean":"2023-07-27T14:36:26.291087+0000","last_became_active":"2023-07-27T14:36:26.287498+0000","last_became_peered":"2023-07-27T14:36:26.287498+0000","last_unstale":"2023-07-27T14:36:26.291087+0000","last_undegraded":"2023-07-27T14:36:26.291087+0000","last_fullsized":"2023-07-27T14:36:26.291087+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279313+0000","last_change":"2023-07-27T14:36:25.828397+0000","last_active":"2023-07-27T14:36:26.279313+0000","last_peered":"2023-07-27T14:36:26.279313+0000","last_clean":"2023-07-27T14:36:26.279313+0000","last_became_active":"2023-07-27T14:36:25.828097+0000","last_became_peered":"2023-07-27T14:36:25.828097+0000","last_unstale":"2023-07-27T14:36:26.279313+0000","last_undegraded":"2023-07-27T14:36:26.279313+0000","last_fullsized":"2023-07-27T14:36:26.279313+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286353+0000","last_change":"2023-07-27T14:36:26.277472+0000","last_active":"2023-07-27T14:36:26.286353+0000","last_peered":"2023-07-27T14:36:26.286353+0000","last_clean":"2023-07-27T14:36:26.286353+0000","last_became_active":"2023-07-27T14:36:26.277147+0000","last_became_peered":"2023-07-27T14:36:26.277147+0000","last_unstale":"2023-07-27T14:36:26.286353+0000","last_undegraded":"2023-07-27T14:36:26.286353+0000","last_fullsized":"2023-07-27T14:36:26.286353+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277609+0000","last_change":"2023-07-27T14:36:25.822485+0000","last_active":"2023-07-27T14:36:26.277609+0000","last_peered":"2023-07-27T14:36:26.277609+0000","last_clean":"2023-07-27T14:36:26.277609+0000","last_became_active":"2023-07-27T14:36:25.822156+0000","last_became_peered":"2023-07-27T14:36:25.822156+0000","last_unstale":"2023-07-27T14:36:26.277609+0000","last_undegraded":"2023-07-27T14:36:26.277609+0000","last_fullsized":"2023-07-27T14:36:26.277609+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281845+0000","last_change":"2023-07-27T14:36:26.277085+0000","last_active":"2023-07-27T14:36:26.281845+0000","last_peered":"2023-07-27T14:36:26.281845+0000","last_clean":"2023-07-27T14:36:26.281845+0000","last_became_active":"2023-07-27T14:36:26.276757+0000","last_became_peered":"2023-07-27T14:36:26.276757+0000","last_unstale":"2023-07-27T14:36:26.281845+0000","last_undegraded":"2023-07-27T14:36:26.281845+0000","last_fullsized":"2023-07-27T14:36:26.281845+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"157'4","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.292741+0000","last_change":"2023-07-27T14:36:25.820460+0000","last_active":"2023-07-27T14:36:26.292741+0000","last_peered":"2023-07-27T14:36:26.292741+0000","last_clean":"2023-07-27T14:36:26.292741+0000","last_became_active":"2023-07-27T14:36:25.819922+0000","last_became_peered":"2023-07-27T14:36:25.819922+0000","last_unstale":"2023-07-27T14:36:26.292741+0000","last_undegraded":"2023-07-27T14:36:26.292741+0000","last_fullsized":"2023-07-27T14:36:26.292741+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277163+0000","last_change":"2023-07-27T14:36:26.275862+0000","last_active":"2023-07-27T14:36:26.277163+0000","last_peered":"2023-07-27T14:36:26.277163+0000","last_clean":"2023-07-27T14:36:26.277163+0000","last_became_active":"2023-07-27T14:36:26.275610+0000","last_became_peered":"2023-07-27T14:36:26.275610+0000","last_unstale":"2023-07-27T14:36:26.277163+0000","last_undegraded":"2023-07-27T14:36:26.277163+0000","last_fullsized":"2023-07-27T14:36:26.277163+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281799+0000","last_change":"2023-07-27T14:36:25.815690+0000","last_active":"2023-07-27T14:36:26.281799+0000","last_peered":"2023-07-27T14:36:26.281799+0000","last_clean":"2023-07-27T14:36:26.281799+0000","last_became_active":"2023-07-27T14:36:25.815368+0000","last_became_peered":"2023-07-27T14:36:25.815368+0000","last_unstale":"2023-07-27T14:36:26.281799+0000","last_undegraded":"2023-07-27T14:36:26.281799+0000","last_fullsized":"2023-07-27T14:36:26.281799+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298184+0000","last_change":"2023-07-27T14:36:26.295072+0000","last_active":"2023-07-27T14:36:26.298184+0000","last_peered":"2023-07-27T14:36:26.298184+0000","last_clean":"2023-07-27T14:36:26.298184+0000","last_became_active":"2023-07-27T14:36:26.294492+0000","last_became_peered":"2023-07-27T14:36:26.294492+0000","last_unstale":"2023-07-27T14:36:26.298184+0000","last_undegraded":"2023-07-27T14:36:26.298184+0000","last_fullsized":"2023-07-27T14:36:26.298184+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.272544+0000","last_change":"2023-07-27T14:36:25.813865+0000","last_active":"2023-07-27T14:36:26.272544+0000","last_peered":"2023-07-27T14:36:26.272544+0000","last_clean":"2023-07-27T14:36:26.272544+0000","last_became_active":"2023-07-27T14:36:25.813512+0000","last_became_peered":"2023-07-27T14:36:25.813512+0000","last_unstale":"2023-07-27T14:36:26.272544+0000","last_undegraded":"2023-07-27T14:36:26.272544+0000","last_fullsized":"2023-07-27T14:36:26.272544+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291903+0000","last_change":"2023-07-27T14:36:26.290796+0000","last_active":"2023-07-27T14:36:26.291903+0000","last_peered":"2023-07-27T14:36:26.291903+0000","last_clean":"2023-07-27T14:36:26.291903+0000","last_became_active":"2023-07-27T14:36:26.290517+0000","last_became_peered":"2023-07-27T14:36:26.290517+0000","last_unstale":"2023-07-27T14:36:26.291903+0000","last_undegraded":"2023-07-27T14:36:26.291903+0000","last_fullsized":"2023-07-27T14:36:26.291903+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.282451+0000","last_change":"2023-07-27T14:36:25.822237+0000","last_active":"2023-07-27T14:36:26.282451+0000","last_peered":"2023-07-27T14:36:26.282451+0000","last_clean":"2023-07-27T14:36:26.282451+0000","last_became_active":"2023-07-27T14:36:25.821952+0000","last_became_peered":"2023-07-27T14:36:25.821952+0000","last_unstale":"2023-07-27T14:36:26.282451+0000","last_undegraded":"2023-07-27T14:36:26.282451+0000","last_fullsized":"2023-07-27T14:36:26.282451+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286637+0000","last_change":"2023-07-27T14:36:26.281874+0000","last_active":"2023-07-27T14:36:26.286637+0000","last_peered":"2023-07-27T14:36:26.286637+0000","last_clean":"2023-07-27T14:36:26.286637+0000","last_became_active":"2023-07-27T14:36:26.281419+0000","last_became_peered":"2023-07-27T14:36:26.281419+0000","last_unstale":"2023-07-27T14:36:26.286637+0000","last_undegraded":"2023-07-27T14:36:26.286637+0000","last_fullsized":"2023-07-27T14:36:26.286637+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.271682+0000","last_change":"2023-07-27T14:36:25.814731+0000","last_active":"2023-07-27T14:36:26.271682+0000","last_peered":"2023-07-27T14:36:26.271682+0000","last_clean":"2023-07-27T14:36:26.271682+0000","last_became_active":"2023-07-27T14:36:25.814401+0000","last_became_peered":"2023-07-27T14:36:25.814401+0000","last_unstale":"2023-07-27T14:36:26.271682+0000","last_undegraded":"2023-07-27T14:36:26.271682+0000","last_fullsized":"2023-07-27T14:36:26.271682+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281526+0000","last_change":"2023-07-27T14:36:26.278921+0000","last_active":"2023-07-27T14:36:26.281526+0000","last_peered":"2023-07-27T14:36:26.281526+0000","last_clean":"2023-07-27T14:36:26.281526+0000","last_became_active":"2023-07-27T14:36:26.278430+0000","last_became_peered":"2023-07-27T14:36:26.278430+0000","last_unstale":"2023-07-27T14:36:26.281526+0000","last_undegraded":"2023-07-27T14:36:26.281526+0000","last_fullsized":"2023-07-27T14:36:26.281526+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298096+0000","last_change":"2023-07-27T14:36:25.828481+0000","last_active":"2023-07-27T14:36:26.298096+0000","last_peered":"2023-07-27T14:36:26.298096+0000","last_clean":"2023-07-27T14:36:26.298096+0000","last_became_active":"2023-07-27T14:36:25.828193+0000","last_became_peered":"2023-07-27T14:36:25.828193+0000","last_unstale":"2023-07-27T14:36:26.298096+0000","last_undegraded":"2023-07-27T14:36:26.298096+0000","last_fullsized":"2023-07-27T14:36:26.298096+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295830+0000","last_change":"2023-07-27T14:36:26.291317+0000","last_active":"2023-07-27T14:36:26.295830+0000","last_peered":"2023-07-27T14:36:26.295830+0000","last_clean":"2023-07-27T14:36:26.295830+0000","last_became_active":"2023-07-27T14:36:26.291062+0000","last_became_peered":"2023-07-27T14:36:26.291062+0000","last_unstale":"2023-07-27T14:36:26.295830+0000","last_undegraded":"2023-07-27T14:36:26.295830+0000","last_fullsized":"2023-07-27T14:36:26.295830+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279405+0000","last_change":"2023-07-27T14:36:25.827397+0000","last_active":"2023-07-27T14:36:26.279405+0000","last_peered":"2023-07-27T14:36:26.279405+0000","last_clean":"2023-07-27T14:36:26.279405+0000","last_became_active":"2023-07-27T14:36:25.826819+0000","last_became_peered":"2023-07-27T14:36:25.826819+0000","last_unstale":"2023-07-27T14:36:26.279405+0000","last_undegraded":"2023-07-27T14:36:26.279405+0000","last_fullsized":"2023-07-27T14:36:26.279405+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295580+0000","last_change":"2023-07-27T14:36:26.291158+0000","last_active":"2023-07-27T14:36:26.295580+0000","last_peered":"2023-07-27T14:36:26.295580+0000","last_clean":"2023-07-27T14:36:26.295580+0000","last_became_active":"2023-07-27T14:36:26.290782+0000","last_became_peered":"2023-07-27T14:36:26.290782+0000","last_unstale":"2023-07-27T14:36:26.295580+0000","last_undegraded":"2023-07-27T14:36:26.295580+0000","last_fullsized":"2023-07-27T14:36:26.295580+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275169+0000","last_change":"2023-07-27T14:36:25.828565+0000","last_active":"2023-07-27T14:36:26.275169+0000","last_peered":"2023-07-27T14:36:26.275169+0000","last_clean":"2023-07-27T14:36:26.275169+0000","last_became_active":"2023-07-27T14:36:25.828126+0000","last_became_peered":"2023-07-27T14:36:25.828126+0000","last_unstale":"2023-07-27T14:36:26.275169+0000","last_undegraded":"2023-07-27T14:36:26.275169+0000","last_fullsized":"2023-07-27T14:36:26.275169+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295640+0000","last_change":"2023-07-27T14:36:26.292429+0000","last_active":"2023-07-27T14:36:26.295640+0000","last_peered":"2023-07-27T14:36:26.295640+0000","last_clean":"2023-07-27T14:36:26.295640+0000","last_became_active":"2023-07-27T14:36:26.291806+0000","last_became_peered":"2023-07-27T14:36:26.291806+0000","last_unstale":"2023-07-27T14:36:26.295640+0000","last_undegraded":"2023-07-27T14:36:26.295640+0000","last_fullsized":"2023-07-27T14:36:26.295640+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277166+0000","last_change":"2023-07-27T14:36:25.830547+0000","last_active":"2023-07-27T14:36:26.277166+0000","last_peered":"2023-07-27T14:36:26.277166+0000","last_clean":"2023-07-27T14:36:26.277166+0000","last_became_active":"2023-07-27T14:36:25.829438+0000","last_became_peered":"2023-07-27T14:36:25.829438+0000","last_unstale":"2023-07-27T14:36:26.277166+0000","last_undegraded":"2023-07-27T14:36:26.277166+0000","last_fullsized":"2023-07-27T14:36:26.277166+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281312+0000","last_change":"2023-07-27T14:36:26.278417+0000","last_active":"2023-07-27T14:36:26.281312+0000","last_peered":"2023-07-27T14:36:26.281312+0000","last_clean":"2023-07-27T14:36:26.281312+0000","last_became_active":"2023-07-27T14:36:26.278142+0000","last_became_peered":"2023-07-27T14:36:26.278142+0000","last_unstale":"2023-07-27T14:36:26.281312+0000","last_undegraded":"2023-07-27T14:36:26.281312+0000","last_fullsized":"2023-07-27T14:36:26.281312+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.271546+0000","last_change":"2023-07-27T14:36:25.817663+0000","last_active":"2023-07-27T14:36:26.271546+0000","last_peered":"2023-07-27T14:36:26.271546+0000","last_clean":"2023-07-27T14:36:26.271546+0000","last_became_active":"2023-07-27T14:36:25.817240+0000","last_became_peered":"2023-07-27T14:36:25.817240+0000","last_unstale":"2023-07-27T14:36:26.271546+0000","last_undegraded":"2023-07-27T14:36:26.271546+0000","last_fullsized":"2023-07-27T14:36:26.271546+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.300715+0000","last_change":"2023-07-27T14:36:26.295592+0000","last_active":"2023-07-27T14:36:26.300715+0000","last_peered":"2023-07-27T14:36:26.300715+0000","last_clean":"2023-07-27T14:36:26.300715+0000","last_became_active":"2023-07-27T14:36:26.295205+0000","last_became_peered":"2023-07-27T14:36:26.295205+0000","last_unstale":"2023-07-27T14:36:26.300715+0000","last_undegraded":"2023-07-27T14:36:26.300715+0000","last_fullsized":"2023-07-27T14:36:26.300715+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267478+0000","last_change":"2023-07-27T14:36:25.818032+0000","last_active":"2023-07-27T14:36:26.267478+0000","last_peered":"2023-07-27T14:36:26.267478+0000","last_clean":"2023-07-27T14:36:26.267478+0000","last_became_active":"2023-07-27T14:36:25.817748+0000","last_became_peered":"2023-07-27T14:36:25.817748+0000","last_unstale":"2023-07-27T14:36:26.267478+0000","last_undegraded":"2023-07-27T14:36:26.267478+0000","last_fullsized":"2023-07-27T14:36:26.267478+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288586+0000","last_change":"2023-07-27T14:36:26.283067+0000","last_active":"2023-07-27T14:36:26.288586+0000","last_peered":"2023-07-27T14:36:26.288586+0000","last_clean":"2023-07-27T14:36:26.288586+0000","last_became_active":"2023-07-27T14:36:26.282794+0000","last_became_peered":"2023-07-27T14:36:26.282794+0000","last_unstale":"2023-07-27T14:36:26.288586+0000","last_undegraded":"2023-07-27T14:36:26.288586+0000","last_fullsized":"2023-07-27T14:36:26.288586+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.272998+0000","last_change":"2023-07-27T14:36:25.821397+0000","last_active":"2023-07-27T14:36:26.272998+0000","last_peered":"2023-07-27T14:36:26.272998+0000","last_clean":"2023-07-27T14:36:26.272998+0000","last_became_active":"2023-07-27T14:36:25.819651+0000","last_became_peered":"2023-07-27T14:36:25.819651+0000","last_unstale":"2023-07-27T14:36:26.272998+0000","last_undegraded":"2023-07-27T14:36:26.272998+0000","last_fullsized":"2023-07-27T14:36:26.272998+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277972+0000","last_change":"2023-07-27T14:36:26.276425+0000","last_active":"2023-07-27T14:36:26.277972+0000","last_peered":"2023-07-27T14:36:26.277972+0000","last_clean":"2023-07-27T14:36:26.277972+0000","last_became_active":"2023-07-27T14:36:26.275622+0000","last_became_peered":"2023-07-27T14:36:26.275622+0000","last_unstale":"2023-07-27T14:36:26.277972+0000","last_undegraded":"2023-07-27T14:36:26.277972+0000","last_fullsized":"2023-07-27T14:36:26.277972+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265180+0000","last_change":"2023-07-27T14:36:25.814242+0000","last_active":"2023-07-27T14:36:26.265180+0000","last_peered":"2023-07-27T14:36:26.265180+0000","last_clean":"2023-07-27T14:36:26.265180+0000","last_became_active":"2023-07-27T14:36:25.813934+0000","last_became_peered":"2023-07-27T14:36:25.813934+0000","last_unstale":"2023-07-27T14:36:26.265180+0000","last_undegraded":"2023-07-27T14:36:26.265180+0000","last_fullsized":"2023-07-27T14:36:26.265180+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295834+0000","last_change":"2023-07-27T14:36:26.289538+0000","last_active":"2023-07-27T14:36:26.295834+0000","last_peered":"2023-07-27T14:36:26.295834+0000","last_clean":"2023-07-27T14:36:26.295834+0000","last_became_active":"2023-07-27T14:36:26.289273+0000","last_became_peered":"2023-07-27T14:36:26.289273+0000","last_unstale":"2023-07-27T14:36:26.295834+0000","last_undegraded":"2023-07-27T14:36:26.295834+0000","last_fullsized":"2023-07-27T14:36:26.295834+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267941+0000","last_change":"2023-07-27T14:36:25.813908+0000","last_active":"2023-07-27T14:36:26.267941+0000","last_peered":"2023-07-27T14:36:26.267941+0000","last_clean":"2023-07-27T14:36:26.267941+0000","last_became_active":"2023-07-27T14:36:25.813593+0000","last_became_peered":"2023-07-27T14:36:25.813593+0000","last_unstale":"2023-07-27T14:36:26.267941+0000","last_undegraded":"2023-07-27T14:36:26.267941+0000","last_fullsized":"2023-07-27T14:36:26.267941+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291442+0000","last_change":"2023-07-27T14:36:26.285693+0000","last_active":"2023-07-27T14:36:26.291442+0000","last_peered":"2023-07-27T14:36:26.291442+0000","last_clean":"2023-07-27T14:36:26.291442+0000","last_became_active":"2023-07-27T14:36:26.285423+0000","last_became_peered":"2023-07-27T14:36:26.285423+0000","last_unstale":"2023-07-27T14:36:26.291442+0000","last_undegraded":"2023-07-27T14:36:26.291442+0000","last_fullsized":"2023-07-27T14:36:26.291442+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279497+0000","last_change":"2023-07-27T14:36:25.827354+0000","last_active":"2023-07-27T14:36:26.279497+0000","last_peered":"2023-07-27T14:36:26.279497+0000","last_clean":"2023-07-27T14:36:26.279497+0000","last_became_active":"2023-07-27T14:36:25.826629+0000","last_became_peered":"2023-07-27T14:36:25.826629+0000","last_unstale":"2023-07-27T14:36:26.279497+0000","last_undegraded":"2023-07-27T14:36:26.279497+0000","last_fullsized":"2023-07-27T14:36:26.279497+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.285918+0000","last_change":"2023-07-27T14:36:26.284218+0000","last_active":"2023-07-27T14:36:26.285918+0000","last_peered":"2023-07-27T14:36:26.285918+0000","last_clean":"2023-07-27T14:36:26.285918+0000","last_became_active":"2023-07-27T14:36:26.283939+0000","last_became_peered":"2023-07-27T14:36:26.283939+0000","last_unstale":"2023-07-27T14:36:26.285918+0000","last_undegraded":"2023-07-27T14:36:26.285918+0000","last_fullsized":"2023-07-27T14:36:26.285918+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265145+0000","last_change":"2023-07-27T14:36:25.810693+0000","last_active":"2023-07-27T14:36:26.265145+0000","last_peered":"2023-07-27T14:36:26.265145+0000","last_clean":"2023-07-27T14:36:26.265145+0000","last_became_active":"2023-07-27T14:36:25.810172+0000","last_became_peered":"2023-07-27T14:36:25.810172+0000","last_unstale":"2023-07-27T14:36:26.265145+0000","last_undegraded":"2023-07-27T14:36:26.265145+0000","last_fullsized":"2023-07-27T14:36:26.265145+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295802+0000","last_change":"2023-07-27T14:36:26.288066+0000","last_active":"2023-07-27T14:36:26.295802+0000","last_peered":"2023-07-27T14:36:26.295802+0000","last_clean":"2023-07-27T14:36:26.295802+0000","last_became_active":"2023-07-27T14:36:26.287730+0000","last_became_peered":"2023-07-27T14:36:26.287730+0000","last_unstale":"2023-07-27T14:36:26.295802+0000","last_undegraded":"2023-07-27T14:36:26.295802+0000","last_fullsized":"2023-07-27T14:36:26.295802+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.271632+0000","last_change":"2023-07-27T14:36:25.820263+0000","last_active":"2023-07-27T14:36:26.271632+0000","last_peered":"2023-07-27T14:36:26.271632+0000","last_clean":"2023-07-27T14:36:26.271632+0000","last_became_active":"2023-07-27T14:36:25.819290+0000","last_became_peered":"2023-07-27T14:36:25.819290+0000","last_unstale":"2023-07-27T14:36:26.271632+0000","last_undegraded":"2023-07-27T14:36:26.271632+0000","last_fullsized":"2023-07-27T14:36:26.271632+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298296+0000","last_change":"2023-07-27T14:36:26.293955+0000","last_active":"2023-07-27T14:36:26.298296+0000","last_peered":"2023-07-27T14:36:26.298296+0000","last_clean":"2023-07-27T14:36:26.298296+0000","last_became_active":"2023-07-27T14:36:26.293702+0000","last_became_peered":"2023-07-27T14:36:26.293702+0000","last_unstale":"2023-07-27T14:36:26.298296+0000","last_undegraded":"2023-07-27T14:36:26.298296+0000","last_fullsized":"2023-07-27T14:36:26.298296+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.293729+0000","last_change":"2023-07-27T14:36:25.811749+0000","last_active":"2023-07-27T14:36:26.293729+0000","last_peered":"2023-07-27T14:36:26.293729+0000","last_clean":"2023-07-27T14:36:26.293729+0000","last_became_active":"2023-07-27T14:36:25.811489+0000","last_became_peered":"2023-07-27T14:36:25.811489+0000","last_unstale":"2023-07-27T14:36:26.293729+0000","last_undegraded":"2023-07-27T14:36:26.293729+0000","last_fullsized":"2023-07-27T14:36:26.293729+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.285045+0000","last_change":"2023-07-27T14:36:26.283400+0000","last_active":"2023-07-27T14:36:26.285045+0000","last_peered":"2023-07-27T14:36:26.285045+0000","last_clean":"2023-07-27T14:36:26.285045+0000","last_became_active":"2023-07-27T14:36:26.283122+0000","last_became_peered":"2023-07-27T14:36:26.283122+0000","last_unstale":"2023-07-27T14:36:26.285045+0000","last_undegraded":"2023-07-27T14:36:26.285045+0000","last_fullsized":"2023-07-27T14:36:26.285045+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297456+0000","last_change":"2023-07-27T14:36:25.816279+0000","last_active":"2023-07-27T14:36:26.297456+0000","last_peered":"2023-07-27T14:36:26.297456+0000","last_clean":"2023-07-27T14:36:26.297456+0000","last_became_active":"2023-07-27T14:36:25.815077+0000","last_became_peered":"2023-07-27T14:36:25.815077+0000","last_unstale":"2023-07-27T14:36:26.297456+0000","last_undegraded":"2023-07-27T14:36:26.297456+0000","last_fullsized":"2023-07-27T14:36:26.297456+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296363+0000","last_change":"2023-07-27T14:36:26.293557+0000","last_active":"2023-07-27T14:36:26.296363+0000","last_peered":"2023-07-27T14:36:26.296363+0000","last_clean":"2023-07-27T14:36:26.296363+0000","last_became_active":"2023-07-27T14:36:26.293109+0000","last_became_peered":"2023-07-27T14:36:26.293109+0000","last_unstale":"2023-07-27T14:36:26.296363+0000","last_undegraded":"2023-07-27T14:36:26.296363+0000","last_fullsized":"2023-07-27T14:36:26.296363+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298291+0000","last_change":"2023-07-27T14:36:25.812595+0000","last_active":"2023-07-27T14:36:26.298291+0000","last_peered":"2023-07-27T14:36:26.298291+0000","last_clean":"2023-07-27T14:36:26.298291+0000","last_became_active":"2023-07-27T14:36:25.812290+0000","last_became_peered":"2023-07-27T14:36:25.812290+0000","last_unstale":"2023-07-27T14:36:26.298291+0000","last_undegraded":"2023-07-27T14:36:26.298291+0000","last_fullsized":"2023-07-27T14:36:26.298291+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297614+0000","last_change":"2023-07-27T14:36:26.289971+0000","last_active":"2023-07-27T14:36:26.297614+0000","last_peered":"2023-07-27T14:36:26.297614+0000","last_clean":"2023-07-27T14:36:26.297614+0000","last_became_active":"2023-07-27T14:36:26.289642+0000","last_became_peered":"2023-07-27T14:36:26.289642+0000","last_unstale":"2023-07-27T14:36:26.297614+0000","last_undegraded":"2023-07-27T14:36:26.297614+0000","last_fullsized":"2023-07-27T14:36:26.297614+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267742+0000","last_change":"2023-07-27T14:36:25.825789+0000","last_active":"2023-07-27T14:36:26.267742+0000","last_peered":"2023-07-27T14:36:26.267742+0000","last_clean":"2023-07-27T14:36:26.267742+0000","last_became_active":"2023-07-27T14:36:25.825448+0000","last_became_peered":"2023-07-27T14:36:25.825448+0000","last_unstale":"2023-07-27T14:36:26.267742+0000","last_undegraded":"2023-07-27T14:36:26.267742+0000","last_fullsized":"2023-07-27T14:36:26.267742+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279287+0000","last_change":"2023-07-27T14:36:26.277183+0000","last_active":"2023-07-27T14:36:26.279287+0000","last_peered":"2023-07-27T14:36:26.279287+0000","last_clean":"2023-07-27T14:36:26.279287+0000","last_became_active":"2023-07-27T14:36:26.276912+0000","last_became_peered":"2023-07-27T14:36:26.276912+0000","last_unstale":"2023-07-27T14:36:26.279287+0000","last_undegraded":"2023-07-27T14:36:26.279287+0000","last_fullsized":"2023-07-27T14:36:26.279287+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.273896+0000","last_change":"2023-07-27T14:36:25.826677+0000","last_active":"2023-07-27T14:36:26.273896+0000","last_peered":"2023-07-27T14:36:26.273896+0000","last_clean":"2023-07-27T14:36:26.273896+0000","last_became_active":"2023-07-27T14:36:25.826307+0000","last_became_peered":"2023-07-27T14:36:25.826307+0000","last_unstale":"2023-07-27T14:36:26.273896+0000","last_undegraded":"2023-07-27T14:36:26.273896+0000","last_fullsized":"2023-07-27T14:36:26.273896+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286505+0000","last_change":"2023-07-27T14:36:26.281902+0000","last_active":"2023-07-27T14:36:26.286505+0000","last_peered":"2023-07-27T14:36:26.286505+0000","last_clean":"2023-07-27T14:36:26.286505+0000","last_became_active":"2023-07-27T14:36:26.281593+0000","last_became_peered":"2023-07-27T14:36:26.281593+0000","last_unstale":"2023-07-27T14:36:26.286505+0000","last_undegraded":"2023-07-27T14:36:26.286505+0000","last_fullsized":"2023-07-27T14:36:26.286505+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266652+0000","last_change":"2023-07-27T14:36:25.815728+0000","last_active":"2023-07-27T14:36:26.266652+0000","last_peered":"2023-07-27T14:36:26.266652+0000","last_clean":"2023-07-27T14:36:26.266652+0000","last_became_active":"2023-07-27T14:36:25.815176+0000","last_became_peered":"2023-07-27T14:36:25.815176+0000","last_unstale":"2023-07-27T14:36:26.266652+0000","last_undegraded":"2023-07-27T14:36:26.266652+0000","last_fullsized":"2023-07-27T14:36:26.266652+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.274690+0000","last_change":"2023-07-27T14:36:26.271036+0000","last_active":"2023-07-27T14:36:26.274690+0000","last_peered":"2023-07-27T14:36:26.274690+0000","last_clean":"2023-07-27T14:36:26.274690+0000","last_became_active":"2023-07-27T14:36:26.270739+0000","last_became_peered":"2023-07-27T14:36:26.270739+0000","last_unstale":"2023-07-27T14:36:26.274690+0000","last_undegraded":"2023-07-27T14:36:26.274690+0000","last_fullsized":"2023-07-27T14:36:26.274690+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.264487+0000","last_change":"2023-07-27T14:36:25.813815+0000","last_active":"2023-07-27T14:36:26.264487+0000","last_peered":"2023-07-27T14:36:26.264487+0000","last_clean":"2023-07-27T14:36:26.264487+0000","last_became_active":"2023-07-27T14:36:25.813492+0000","last_became_peered":"2023-07-27T14:36:25.813492+0000","last_unstale":"2023-07-27T14:36:26.264487+0000","last_undegraded":"2023-07-27T14:36:26.264487+0000","last_fullsized":"2023-07-27T14:36:26.264487+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288782+0000","last_change":"2023-07-27T14:36:26.284855+0000","last_active":"2023-07-27T14:36:26.288782+0000","last_peered":"2023-07-27T14:36:26.288782+0000","last_clean":"2023-07-27T14:36:26.288782+0000","last_became_active":"2023-07-27T14:36:26.284512+0000","last_became_peered":"2023-07-27T14:36:26.284512+0000","last_unstale":"2023-07-27T14:36:26.288782+0000","last_undegraded":"2023-07-27T14:36:26.288782+0000","last_fullsized":"2023-07-27T14:36:26.288782+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.264665+0000","last_change":"2023-07-27T14:36:25.816504+0000","last_active":"2023-07-27T14:36:26.264665+0000","last_peered":"2023-07-27T14:36:26.264665+0000","last_clean":"2023-07-27T14:36:26.264665+0000","last_became_active":"2023-07-27T14:36:25.816226+0000","last_became_peered":"2023-07-27T14:36:25.816226+0000","last_unstale":"2023-07-27T14:36:26.264665+0000","last_undegraded":"2023-07-27T14:36:26.264665+0000","last_fullsized":"2023-07-27T14:36:26.264665+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297735+0000","last_change":"2023-07-27T14:36:26.292087+0000","last_active":"2023-07-27T14:36:26.297735+0000","last_peered":"2023-07-27T14:36:26.297735+0000","last_clean":"2023-07-27T14:36:26.297735+0000","last_became_active":"2023-07-27T14:36:26.291722+0000","last_became_peered":"2023-07-27T14:36:26.291722+0000","last_unstale":"2023-07-27T14:36:26.297735+0000","last_undegraded":"2023-07-27T14:36:26.297735+0000","last_fullsized":"2023-07-27T14:36:26.297735+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.299120+0000","last_change":"2023-07-27T14:36:25.822338+0000","last_active":"2023-07-27T14:36:26.299120+0000","last_peered":"2023-07-27T14:36:26.299120+0000","last_clean":"2023-07-27T14:36:26.299120+0000","last_became_active":"2023-07-27T14:36:25.820072+0000","last_became_peered":"2023-07-27T14:36:25.820072+0000","last_unstale":"2023-07-27T14:36:26.299120+0000","last_undegraded":"2023-07-27T14:36:26.299120+0000","last_fullsized":"2023-07-27T14:36:26.299120+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298166+0000","last_change":"2023-07-27T14:36:26.294864+0000","last_active":"2023-07-27T14:36:26.298166+0000","last_peered":"2023-07-27T14:36:26.298166+0000","last_clean":"2023-07-27T14:36:26.298166+0000","last_became_active":"2023-07-27T14:36:26.294151+0000","last_became_peered":"2023-07-27T14:36:26.294151+0000","last_unstale":"2023-07-27T14:36:26.298166+0000","last_undegraded":"2023-07-27T14:36:26.298166+0000","last_fullsized":"2023-07-27T14:36:26.298166+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297398+0000","last_change":"2023-07-27T14:36:25.815897+0000","last_active":"2023-07-27T14:36:26.297398+0000","last_peered":"2023-07-27T14:36:26.297398+0000","last_clean":"2023-07-27T14:36:26.297398+0000","last_became_active":"2023-07-27T14:36:25.815499+0000","last_became_peered":"2023-07-27T14:36:25.815499+0000","last_unstale":"2023-07-27T14:36:26.297398+0000","last_undegraded":"2023-07-27T14:36:26.297398+0000","last_fullsized":"2023-07-27T14:36:26.297398+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.273089+0000","last_change":"2023-07-27T14:36:26.271322+0000","last_active":"2023-07-27T14:36:26.273089+0000","last_peered":"2023-07-27T14:36:26.273089+0000","last_clean":"2023-07-27T14:36:26.273089+0000","last_became_active":"2023-07-27T14:36:26.271010+0000","last_became_peered":"2023-07-27T14:36:26.271010+0000","last_unstale":"2023-07-27T14:36:26.273089+0000","last_undegraded":"2023-07-27T14:36:26.273089+0000","last_fullsized":"2023-07-27T14:36:26.273089+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267800+0000","last_change":"2023-07-27T14:36:25.813575+0000","last_active":"2023-07-27T14:36:26.267800+0000","last_peered":"2023-07-27T14:36:26.267800+0000","last_clean":"2023-07-27T14:36:26.267800+0000","last_became_active":"2023-07-27T14:36:25.813300+0000","last_became_peered":"2023-07-27T14:36:25.813300+0000","last_unstale":"2023-07-27T14:36:26.267800+0000","last_undegraded":"2023-07-27T14:36:26.267800+0000","last_fullsized":"2023-07-27T14:36:26.267800+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288674+0000","last_change":"2023-07-27T14:36:26.286777+0000","last_active":"2023-07-27T14:36:26.288674+0000","last_peered":"2023-07-27T14:36:26.288674+0000","last_clean":"2023-07-27T14:36:26.288674+0000","last_became_active":"2023-07-27T14:36:26.286270+0000","last_became_peered":"2023-07-27T14:36:26.286270+0000","last_unstale":"2023-07-27T14:36:26.288674+0000","last_undegraded":"2023-07-27T14:36:26.288674+0000","last_fullsized":"2023-07-27T14:36:26.288674+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.272505+0000","last_change":"2023-07-27T14:36:25.829217+0000","last_active":"2023-07-27T14:36:26.272505+0000","last_peered":"2023-07-27T14:36:26.272505+0000","last_clean":"2023-07-27T14:36:26.272505+0000","last_became_active":"2023-07-27T14:36:25.827607+0000","last_became_peered":"2023-07-27T14:36:25.827607+0000","last_unstale":"2023-07-27T14:36:26.272505+0000","last_undegraded":"2023-07-27T14:36:26.272505+0000","last_fullsized":"2023-07-27T14:36:26.272505+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297913+0000","last_change":"2023-07-27T14:36:26.294332+0000","last_active":"2023-07-27T14:36:26.297913+0000","last_peered":"2023-07-27T14:36:26.297913+0000","last_clean":"2023-07-27T14:36:26.297913+0000","last_became_active":"2023-07-27T14:36:26.293865+0000","last_became_peered":"2023-07-27T14:36:26.293865+0000","last_unstale":"2023-07-27T14:36:26.297913+0000","last_undegraded":"2023-07-27T14:36:26.297913+0000","last_fullsized":"2023-07-27T14:36:26.297913+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291282+0000","last_change":"2023-07-27T14:36:25.828616+0000","last_active":"2023-07-27T14:36:26.291282+0000","last_peered":"2023-07-27T14:36:26.291282+0000","last_clean":"2023-07-27T14:36:26.291282+0000","last_became_active":"2023-07-27T14:36:25.828266+0000","last_became_peered":"2023-07-27T14:36:25.828266+0000","last_unstale":"2023-07-27T14:36:26.291282+0000","last_undegraded":"2023-07-27T14:36:26.291282+0000","last_fullsized":"2023-07-27T14:36:26.291282+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275507+0000","last_change":"2023-07-27T14:36:26.271447+0000","last_active":"2023-07-27T14:36:26.275507+0000","last_peered":"2023-07-27T14:36:26.275507+0000","last_clean":"2023-07-27T14:36:26.275507+0000","last_became_active":"2023-07-27T14:36:26.271150+0000","last_became_peered":"2023-07-27T14:36:26.271150+0000","last_unstale":"2023-07-27T14:36:26.275507+0000","last_undegraded":"2023-07-27T14:36:26.275507+0000","last_fullsized":"2023-07-27T14:36:26.275507+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.279588+0000","last_change":"2023-07-27T14:36:25.826968+0000","last_active":"2023-07-27T14:36:26.279588+0000","last_peered":"2023-07-27T14:36:26.279588+0000","last_clean":"2023-07-27T14:36:26.279588+0000","last_became_active":"2023-07-27T14:36:25.826495+0000","last_became_peered":"2023-07-27T14:36:25.826495+0000","last_unstale":"2023-07-27T14:36:26.279588+0000","last_undegraded":"2023-07-27T14:36:26.279588+0000","last_fullsized":"2023-07-27T14:36:26.279588+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.297496+0000","last_change":"2023-07-27T14:36:26.290333+0000","last_active":"2023-07-27T14:36:26.297496+0000","last_peered":"2023-07-27T14:36:26.297496+0000","last_clean":"2023-07-27T14:36:26.297496+0000","last_became_active":"2023-07-27T14:36:26.290024+0000","last_became_peered":"2023-07-27T14:36:26.290024+0000","last_unstale":"2023-07-27T14:36:26.297496+0000","last_undegraded":"2023-07-27T14:36:26.297496+0000","last_fullsized":"2023-07-27T14:36:26.297496+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265583+0000","last_change":"2023-07-27T14:36:25.826716+0000","last_active":"2023-07-27T14:36:26.265583+0000","last_peered":"2023-07-27T14:36:26.265583+0000","last_clean":"2023-07-27T14:36:26.265583+0000","last_became_active":"2023-07-27T14:36:25.826472+0000","last_became_peered":"2023-07-27T14:36:25.826472+0000","last_unstale":"2023-07-27T14:36:26.265583+0000","last_undegraded":"2023-07-27T14:36:26.265583+0000","last_fullsized":"2023-07-27T14:36:26.265583+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.290284+0000","last_change":"2023-07-27T14:36:26.287503+0000","last_active":"2023-07-27T14:36:26.290284+0000","last_peered":"2023-07-27T14:36:26.290284+0000","last_clean":"2023-07-27T14:36:26.290284+0000","last_became_active":"2023-07-27T14:36:26.287239+0000","last_became_peered":"2023-07-27T14:36:26.287239+0000","last_unstale":"2023-07-27T14:36:26.290284+0000","last_undegraded":"2023-07-27T14:36:26.290284+0000","last_fullsized":"2023-07-27T14:36:26.290284+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.274513+0000","last_change":"2023-07-27T14:36:25.824728+0000","last_active":"2023-07-27T14:36:26.274513+0000","last_peered":"2023-07-27T14:36:26.274513+0000","last_clean":"2023-07-27T14:36:26.274513+0000","last_became_active":"2023-07-27T14:36:25.824423+0000","last_became_peered":"2023-07-27T14:36:25.824423+0000","last_unstale":"2023-07-27T14:36:26.274513+0000","last_undegraded":"2023-07-27T14:36:26.274513+0000","last_fullsized":"2023-07-27T14:36:26.274513+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275914+0000","last_change":"2023-07-27T14:36:26.272211+0000","last_active":"2023-07-27T14:36:26.275914+0000","last_peered":"2023-07-27T14:36:26.275914+0000","last_clean":"2023-07-27T14:36:26.275914+0000","last_became_active":"2023-07-27T14:36:26.271892+0000","last_became_peered":"2023-07-27T14:36:26.271892+0000","last_unstale":"2023-07-27T14:36:26.275914+0000","last_undegraded":"2023-07-27T14:36:26.275914+0000","last_fullsized":"2023-07-27T14:36:26.275914+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.294839+0000","last_change":"2023-07-27T14:36:25.828191+0000","last_active":"2023-07-27T14:36:26.294839+0000","last_peered":"2023-07-27T14:36:26.294839+0000","last_clean":"2023-07-27T14:36:26.294839+0000","last_became_active":"2023-07-27T14:36:25.827718+0000","last_became_peered":"2023-07-27T14:36:25.827718+0000","last_unstale":"2023-07-27T14:36:26.294839+0000","last_undegraded":"2023-07-27T14:36:26.294839+0000","last_fullsized":"2023-07-27T14:36:26.294839+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286508+0000","last_change":"2023-07-27T14:36:26.281498+0000","last_active":"2023-07-27T14:36:26.286508+0000","last_peered":"2023-07-27T14:36:26.286508+0000","last_clean":"2023-07-27T14:36:26.286508+0000","last_became_active":"2023-07-27T14:36:26.281129+0000","last_became_peered":"2023-07-27T14:36:26.281129+0000","last_unstale":"2023-07-27T14:36:26.286508+0000","last_undegraded":"2023-07-27T14:36:26.286508+0000","last_fullsized":"2023-07-27T14:36:26.286508+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265286+0000","last_change":"2023-07-27T14:36:25.821788+0000","last_active":"2023-07-27T14:36:26.265286+0000","last_peered":"2023-07-27T14:36:26.265286+0000","last_clean":"2023-07-27T14:36:26.265286+0000","last_became_active":"2023-07-27T14:36:25.821433+0000","last_became_peered":"2023-07-27T14:36:25.821433+0000","last_unstale":"2023-07-27T14:36:26.265286+0000","last_undegraded":"2023-07-27T14:36:26.265286+0000","last_fullsized":"2023-07-27T14:36:26.265286+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.288607+0000","last_change":"2023-07-27T14:36:26.285501+0000","last_active":"2023-07-27T14:36:26.288607+0000","last_peered":"2023-07-27T14:36:26.288607+0000","last_clean":"2023-07-27T14:36:26.288607+0000","last_became_active":"2023-07-27T14:36:26.285224+0000","last_became_peered":"2023-07-27T14:36:26.285224+0000","last_unstale":"2023-07-27T14:36:26.288607+0000","last_undegraded":"2023-07-27T14:36:26.288607+0000","last_fullsized":"2023-07-27T14:36:26.288607+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267892+0000","last_change":"2023-07-27T14:36:25.827585+0000","last_active":"2023-07-27T14:36:26.267892+0000","last_peered":"2023-07-27T14:36:26.267892+0000","last_clean":"2023-07-27T14:36:26.267892+0000","last_became_active":"2023-07-27T14:36:25.827306+0000","last_became_peered":"2023-07-27T14:36:25.827306+0000","last_unstale":"2023-07-27T14:36:26.267892+0000","last_undegraded":"2023-07-27T14:36:26.267892+0000","last_fullsized":"2023-07-27T14:36:26.267892+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.289257+0000","last_change":"2023-07-27T14:36:26.282839+0000","last_active":"2023-07-27T14:36:26.289257+0000","last_peered":"2023-07-27T14:36:26.289257+0000","last_clean":"2023-07-27T14:36:26.289257+0000","last_became_active":"2023-07-27T14:36:26.282557+0000","last_became_peered":"2023-07-27T14:36:26.282557+0000","last_unstale":"2023-07-27T14:36:26.289257+0000","last_undegraded":"2023-07-27T14:36:26.289257+0000","last_fullsized":"2023-07-27T14:36:26.289257+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266608+0000","last_change":"2023-07-27T14:36:25.828257+0000","last_active":"2023-07-27T14:36:26.266608+0000","last_peered":"2023-07-27T14:36:26.266608+0000","last_clean":"2023-07-27T14:36:26.266608+0000","last_became_active":"2023-07-27T14:36:25.827526+0000","last_became_peered":"2023-07-27T14:36:25.827526+0000","last_unstale":"2023-07-27T14:36:26.266608+0000","last_undegraded":"2023-07-27T14:36:26.266608+0000","last_fullsized":"2023-07-27T14:36:26.266608+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296658+0000","last_change":"2023-07-27T14:36:26.291786+0000","last_active":"2023-07-27T14:36:26.296658+0000","last_peered":"2023-07-27T14:36:26.296658+0000","last_clean":"2023-07-27T14:36:26.296658+0000","last_became_active":"2023-07-27T14:36:26.291518+0000","last_became_peered":"2023-07-27T14:36:26.291518+0000","last_unstale":"2023-07-27T14:36:26.296658+0000","last_undegraded":"2023-07-27T14:36:26.296658+0000","last_fullsized":"2023-07-27T14:36:26.296658+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266707+0000","last_change":"2023-07-27T14:36:25.814373+0000","last_active":"2023-07-27T14:36:26.266707+0000","last_peered":"2023-07-27T14:36:26.266707+0000","last_clean":"2023-07-27T14:36:26.266707+0000","last_became_active":"2023-07-27T14:36:25.814101+0000","last_became_peered":"2023-07-27T14:36:25.814101+0000","last_unstale":"2023-07-27T14:36:26.266707+0000","last_undegraded":"2023-07-27T14:36:26.266707+0000","last_fullsized":"2023-07-27T14:36:26.266707+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.286479+0000","last_change":"2023-07-27T14:36:26.281349+0000","last_active":"2023-07-27T14:36:26.286479+0000","last_peered":"2023-07-27T14:36:26.286479+0000","last_clean":"2023-07-27T14:36:26.286479+0000","last_became_active":"2023-07-27T14:36:26.280843+0000","last_became_peered":"2023-07-27T14:36:26.280843+0000","last_unstale":"2023-07-27T14:36:26.286479+0000","last_undegraded":"2023-07-27T14:36:26.286479+0000","last_fullsized":"2023-07-27T14:36:26.286479+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.273373+0000","last_change":"2023-07-27T14:36:25.828410+0000","last_active":"2023-07-27T14:36:26.273373+0000","last_peered":"2023-07-27T14:36:26.273373+0000","last_clean":"2023-07-27T14:36:26.273373+0000","last_became_active":"2023-07-27T14:36:25.828099+0000","last_became_peered":"2023-07-27T14:36:25.828099+0000","last_unstale":"2023-07-27T14:36:26.273373+0000","last_undegraded":"2023-07-27T14:36:26.273373+0000","last_fullsized":"2023-07-27T14:36:26.273373+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.298290+0000","last_change":"2023-07-27T14:36:26.293489+0000","last_active":"2023-07-27T14:36:26.298290+0000","last_peered":"2023-07-27T14:36:26.298290+0000","last_clean":"2023-07-27T14:36:26.298290+0000","last_became_active":"2023-07-27T14:36:26.293244+0000","last_became_peered":"2023-07-27T14:36:26.293244+0000","last_unstale":"2023-07-27T14:36:26.298290+0000","last_undegraded":"2023-07-27T14:36:26.298290+0000","last_fullsized":"2023-07-27T14:36:26.298290+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.264597+0000","last_change":"2023-07-27T14:36:25.822367+0000","last_active":"2023-07-27T14:36:26.264597+0000","last_peered":"2023-07-27T14:36:26.264597+0000","last_clean":"2023-07-27T14:36:26.264597+0000","last_became_active":"2023-07-27T14:36:25.820423+0000","last_became_peered":"2023-07-27T14:36:25.820423+0000","last_unstale":"2023-07-27T14:36:26.264597+0000","last_undegraded":"2023-07-27T14:36:26.264597+0000","last_fullsized":"2023-07-27T14:36:26.264597+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.292166+0000","last_change":"2023-07-27T14:36:26.286283+0000","last_active":"2023-07-27T14:36:26.292166+0000","last_peered":"2023-07-27T14:36:26.292166+0000","last_clean":"2023-07-27T14:36:26.292166+0000","last_became_active":"2023-07-27T14:36:26.285949+0000","last_became_peered":"2023-07-27T14:36:26.285949+0000","last_unstale":"2023-07-27T14:36:26.292166+0000","last_undegraded":"2023-07-27T14:36:26.292166+0000","last_fullsized":"2023-07-27T14:36:26.292166+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277489+0000","last_change":"2023-07-27T14:36:25.822513+0000","last_active":"2023-07-27T14:36:26.277489+0000","last_peered":"2023-07-27T14:36:26.277489+0000","last_clean":"2023-07-27T14:36:26.277489+0000","last_became_active":"2023-07-27T14:36:25.822307+0000","last_became_peered":"2023-07-27T14:36:25.822307+0000","last_unstale":"2023-07-27T14:36:26.277489+0000","last_undegraded":"2023-07-27T14:36:26.277489+0000","last_fullsized":"2023-07-27T14:36:26.277489+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296677+0000","last_change":"2023-07-27T14:36:26.294659+0000","last_active":"2023-07-27T14:36:26.296677+0000","last_peered":"2023-07-27T14:36:26.296677+0000","last_clean":"2023-07-27T14:36:26.296677+0000","last_became_active":"2023-07-27T14:36:26.294352+0000","last_became_peered":"2023-07-27T14:36:26.294352+0000","last_unstale":"2023-07-27T14:36:26.296677+0000","last_undegraded":"2023-07-27T14:36:26.296677+0000","last_fullsized":"2023-07-27T14:36:26.296677+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"157'1","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.292605+0000","last_change":"2023-07-27T14:36:25.812277+0000","last_active":"2023-07-27T14:36:26.292605+0000","last_peered":"2023-07-27T14:36:26.292605+0000","last_clean":"2023-07-27T14:36:26.292605+0000","last_became_active":"2023-07-27T14:36:25.811935+0000","last_became_peered":"2023-07-27T14:36:25.811935+0000","last_unstale":"2023-07-27T14:36:26.292605+0000","last_undegraded":"2023-07-27T14:36:26.292605+0000","last_fullsized":"2023-07-27T14:36:26.292605+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267822+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:36:26.267822+0000","last_peered":"2023-07-27T14:36:26.267822+0000","last_clean":"2023-07-27T14:36:26.267822+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:36:26.267822+0000","last_undegraded":"2023-07-27T14:36:26.267822+0000","last_fullsized":"2023-07-27T14:36:26.267822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.291884+0000","last_change":"2023-07-27T14:36:26.290670+0000","last_active":"2023-07-27T14:36:26.291884+0000","last_peered":"2023-07-27T14:36:26.291884+0000","last_clean":"2023-07-27T14:36:26.291884+0000","last_became_active":"2023-07-27T14:36:26.290339+0000","last_became_peered":"2023-07-27T14:36:26.290339+0000","last_unstale":"2023-07-27T14:36:26.291884+0000","last_undegraded":"2023-07-27T14:36:26.291884+0000","last_fullsized":"2023-07-27T14:36:26.291884+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"157'3","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.294027+0000","last_change":"2023-07-27T14:36:25.818717+0000","last_active":"2023-07-27T14:36:26.294027+0000","last_peered":"2023-07-27T14:36:26.294027+0000","last_clean":"2023-07-27T14:36:26.294027+0000","last_became_active":"2023-07-27T14:36:25.818437+0000","last_became_peered":"2023-07-27T14:36:25.818437+0000","last_unstale":"2023-07-27T14:36:26.294027+0000","last_undegraded":"2023-07-27T14:36:26.294027+0000","last_fullsized":"2023-07-27T14:36:26.294027+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.264879+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:36:26.264879+0000","last_peered":"2023-07-27T14:36:26.264879+0000","last_clean":"2023-07-27T14:36:26.264879+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:36:26.264879+0000","last_undegraded":"2023-07-27T14:36:26.264879+0000","last_fullsized":"2023-07-27T14:36:26.264879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.296324+0000","last_change":"2023-07-27T14:36:26.294935+0000","last_active":"2023-07-27T14:36:26.296324+0000","last_peered":"2023-07-27T14:36:26.296324+0000","last_clean":"2023-07-27T14:36:26.296324+0000","last_became_active":"2023-07-27T14:36:26.294550+0000","last_became_peered":"2023-07-27T14:36:26.294550+0000","last_unstale":"2023-07-27T14:36:26.296324+0000","last_undegraded":"2023-07-27T14:36:26.296324+0000","last_fullsized":"2023-07-27T14:36:26.296324+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.265414+0000","last_change":"2023-07-27T14:36:25.818707+0000","last_active":"2023-07-27T14:36:26.265414+0000","last_peered":"2023-07-27T14:36:26.265414+0000","last_clean":"2023-07-27T14:36:26.265414+0000","last_became_active":"2023-07-27T14:36:25.818099+0000","last_became_peered":"2023-07-27T14:36:25.818099+0000","last_unstale":"2023-07-27T14:36:26.265414+0000","last_undegraded":"2023-07-27T14:36:26.265414+0000","last_fullsized":"2023-07-27T14:36:26.265414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.271511+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:36:26.271511+0000","last_peered":"2023-07-27T14:36:26.271511+0000","last_clean":"2023-07-27T14:36:26.271511+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:36:26.271511+0000","last_undegraded":"2023-07-27T14:36:26.271511+0000","last_fullsized":"2023-07-27T14:36:26.271511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295765+0000","last_change":"2023-07-27T14:36:26.287452+0000","last_active":"2023-07-27T14:36:26.295765+0000","last_peered":"2023-07-27T14:36:26.295765+0000","last_clean":"2023-07-27T14:36:26.295765+0000","last_became_active":"2023-07-27T14:36:26.287193+0000","last_became_peered":"2023-07-27T14:36:26.287193+0000","last_unstale":"2023-07-27T14:36:26.295765+0000","last_undegraded":"2023-07-27T14:36:26.295765+0000","last_fullsized":"2023-07-27T14:36:26.295765+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"157'2","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.295956+0000","last_change":"2023-07-27T14:36:25.828394+0000","last_active":"2023-07-27T14:36:26.295956+0000","last_peered":"2023-07-27T14:36:26.295956+0000","last_clean":"2023-07-27T14:36:26.295956+0000","last_became_active":"2023-07-27T14:36:25.828103+0000","last_became_peered":"2023-07-27T14:36:25.828103+0000","last_unstale":"2023-07-27T14:36:26.295956+0000","last_undegraded":"2023-07-27T14:36:26.295956+0000","last_fullsized":"2023-07-27T14:36:26.295956+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.266526+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:36:26.266526+0000","last_peered":"2023-07-27T14:36:26.266526+0000","last_clean":"2023-07-27T14:36:26.266526+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:36:26.266526+0000","last_undegraded":"2023-07-27T14:36:26.266526+0000","last_fullsized":"2023-07-27T14:36:26.266526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":136,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277356+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:36:26.277356+0000","last_peered":"2023-07-27T14:36:26.277356+0000","last_clean":"2023-07-27T14:36:26.277356+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:36:26.277356+0000","last_undegraded":"2023-07-27T14:36:26.277356+0000","last_fullsized":"2023-07-27T14:36:26.277356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.299733+0000","last_change":"2023-07-27T14:36:26.298809+0000","last_active":"2023-07-27T14:36:26.299733+0000","last_peered":"2023-07-27T14:36:26.299733+0000","last_clean":"2023-07-27T14:36:26.299733+0000","last_became_active":"2023-07-27T14:36:26.298461+0000","last_became_peered":"2023-07-27T14:36:26.298461+0000","last_unstale":"2023-07-27T14:36:26.299733+0000","last_undegraded":"2023-07-27T14:36:26.299733+0000","last_fullsized":"2023-07-27T14:36:26.299733+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.281912+0000","last_change":"2023-07-27T14:36:25.820796+0000","last_active":"2023-07-27T14:36:26.281912+0000","last_peered":"2023-07-27T14:36:26.281912+0000","last_clean":"2023-07-27T14:36:26.281912+0000","last_became_active":"2023-07-27T14:36:25.820428+0000","last_became_peered":"2023-07-27T14:36:25.820428+0000","last_unstale":"2023-07-27T14:36:26.281912+0000","last_undegraded":"2023-07-27T14:36:26.281912+0000","last_fullsized":"2023-07-27T14:36:26.281912+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.277455+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:36:26.277455+0000","last_peered":"2023-07-27T14:36:26.277455+0000","last_clean":"2023-07-27T14:36:26.277455+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:36:26.277455+0000","last_undegraded":"2023-07-27T14:36:26.277455+0000","last_fullsized":"2023-07-27T14:36:26.277455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.290159+0000","last_change":"2023-07-27T14:36:26.287770+0000","last_active":"2023-07-27T14:36:26.290159+0000","last_peered":"2023-07-27T14:36:26.290159+0000","last_clean":"2023-07-27T14:36:26.290159+0000","last_became_active":"2023-07-27T14:36:26.287124+0000","last_became_peered":"2023-07-27T14:36:26.287124+0000","last_unstale":"2023-07-27T14:36:26.290159+0000","last_undegraded":"2023-07-27T14:36:26.290159+0000","last_fullsized":"2023-07-27T14:36:26.290159+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.276954+0000","last_change":"2023-07-27T14:36:25.828800+0000","last_active":"2023-07-27T14:36:26.276954+0000","last_peered":"2023-07-27T14:36:26.276954+0000","last_clean":"2023-07-27T14:36:26.276954+0000","last_became_active":"2023-07-27T14:36:25.828465+0000","last_became_peered":"2023-07-27T14:36:25.828465+0000","last_unstale":"2023-07-27T14:36:26.276954+0000","last_undegraded":"2023-07-27T14:36:26.276954+0000","last_fullsized":"2023-07-27T14:36:26.276954+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":135,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.276963+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:36:26.276963+0000","last_peered":"2023-07-27T14:36:26.276963+0000","last_clean":"2023-07-27T14:36:26.276963+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:36:26.276963+0000","last_undegraded":"2023-07-27T14:36:26.276963+0000","last_fullsized":"2023-07-27T14:36:26.276963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.283518+0000","last_change":"2023-07-27T14:36:26.281382+0000","last_active":"2023-07-27T14:36:26.283518+0000","last_peered":"2023-07-27T14:36:26.283518+0000","last_clean":"2023-07-27T14:36:26.283518+0000","last_became_active":"2023-07-27T14:36:26.281114+0000","last_became_peered":"2023-07-27T14:36:26.281114+0000","last_unstale":"2023-07-27T14:36:26.283518+0000","last_undegraded":"2023-07-27T14:36:26.283518+0000","last_fullsized":"2023-07-27T14:36:26.283518+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.276729+0000","last_change":"2023-07-27T14:36:25.822266+0000","last_active":"2023-07-27T14:36:26.276729+0000","last_peered":"2023-07-27T14:36:26.276729+0000","last_clean":"2023-07-27T14:36:26.276729+0000","last_became_active":"2023-07-27T14:36:25.821453+0000","last_became_peered":"2023-07-27T14:36:25.821453+0000","last_unstale":"2023-07-27T14:36:26.276729+0000","last_undegraded":"2023-07-27T14:36:26.276729+0000","last_fullsized":"2023-07-27T14:36:26.276729+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.267556+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:36:26.267556+0000","last_peered":"2023-07-27T14:36:26.267556+0000","last_clean":"2023-07-27T14:36:26.267556+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:36:26.267556+0000","last_undegraded":"2023-07-27T14:36:26.267556+0000","last_fullsized":"2023-07-27T14:36:26.267556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.275705+0000","last_change":"2023-07-27T14:36:26.272588+0000","last_active":"2023-07-27T14:36:26.275705+0000","last_peered":"2023-07-27T14:36:26.275705+0000","last_clean":"2023-07-27T14:36:26.275705+0000","last_became_active":"2023-07-27T14:36:26.272325+0000","last_became_peered":"2023-07-27T14:36:26.272325+0000","last_unstale":"2023-07-27T14:36:26.275705+0000","last_undegraded":"2023-07-27T14:36:26.275705+0000","last_fullsized":"2023-07-27T14:36:26.275705+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:25.786397+0000","last_clean_scrub_stamp":"2023-07-27T14:36:25.786397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"157'4","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.290005+0000","last_change":"2023-07-27T14:36:25.822181+0000","last_active":"2023-07-27T14:36:26.290005+0000","last_peered":"2023-07-27T14:36:26.290005+0000","last_clean":"2023-07-27T14:36:26.290005+0000","last_became_active":"2023-07-27T14:36:25.821903+0000","last_became_peered":"2023-07-27T14:36:25.821903+0000","last_unstale":"2023-07-27T14:36:26.290005+0000","last_undegraded":"2023-07-27T14:36:26.290005+0000","last_fullsized":"2023-07-27T14:36:26.290005+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:36:24.779862+0000","last_clean_scrub_stamp":"2023-07-27T14:36:24.779862+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":123,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-27T14:36:26.274142+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:36:26.274142+0000","last_peered":"2023-07-27T14:36:26.274142+0000","last_clean":"2023-07-27T14:36:26.274142+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:36:26.274142+0000","last_undegraded":"2023-07-27T14:36:26.274142+0000","last_fullsized":"2023-07-27T14:36:26.274142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17116,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":15168,"kb_avail":94354724,"statfs":{"total":96636764160,"available":96619237376,"internally_reserved":0,"allocated":1986560,"data_stored":932743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15532032},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61599999999999999,"15min":0.64700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83199999999999996,"5min":0.996,"15min":1.133},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.85199999999999998,"5min":0.92800000000000005,"15min":1.1180000000000001},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.69899999999999995},"min":{"1min":0.48299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.879,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":0.96999999999999997,"15min":1.1459999999999999},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.52100000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.89600000000000002,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66300000000000003,"15min":0.69299999999999995},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.88900000000000001,"5min":0.96499999999999997,"15min":1.119},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65900000000000003,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.69499999999999995,"15min":0.69999999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.165},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66000000000000003,"15min":0.64300000000000002},"min":{"1min":0.55800000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.94599999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.47999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68700000000000006,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":1.202,"15min":1.202},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.58599999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98999999999999999,"5min":1.101,"15min":1.101},"last":0.94999999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76000000000000001,"15min":0.753},"min":{"1min":0.64800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.03,"5min":1.056,"15min":1.056},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.71899999999999997},"min":{"1min":0.52900000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18000,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94353840,"statfs":{"total":96636764160,"available":96618332160,"internally_reserved":0,"allocated":1974272,"data_stored":931275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93899999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.47599999999999998,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.996},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.45600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.94399999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.441,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90700000000000003,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84399999999999997,"5min":1.01,"15min":1.01},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.61099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83999999999999997,"5min":0.92900000000000005,"15min":1.2},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.55800000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.88500000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.51100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.94399999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64600000000000002,"15min":0.66700000000000004},"min":{"1min":0.53000000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78400000000000003,"5min":0.98999999999999999,"15min":1.079},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.67300000000000004},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.871,"5min":0.98899999999999999,"15min":1.198},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92200000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.58899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.044,"5min":1.054,"15min":1.1000000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1040000000000001,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23192,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":21248,"kb_avail":94348648,"statfs":{"total":96636764160,"available":96613015552,"internally_reserved":0,"allocated":1982464,"data_stored":931899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21757952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38700000000000001,"15min":0.47499999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":0.55600000000000005,"5min":0.61499999999999999,"15min":4.75},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42099999999999999,"15min":0.58999999999999997},"min":{"1min":0.30099999999999999,"5min":0.26900000000000002,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.70199999999999996,"15min":9.3100000000000005},"last":0.622}]},{"osd":2,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.60599999999999998,"5min":0.67500000000000004,"15min":3.7210000000000001},"last":0.505},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.51500000000000001},"min":{"1min":0.33400000000000002,"5min":0.33100000000000002,"15min":0.318},"max":{"1min":0.63,"5min":0.79700000000000004,"15min":2.7160000000000002},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47199999999999998,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.32800000000000001},"max":{"1min":0.57899999999999996,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.53600000000000003},"min":{"1min":0.33900000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.54000000000000004,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.44}]},{"osd":4,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.42799999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.111,"5min":1.1639999999999999,"15min":2.181},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.014,"5min":1.014,"15min":2.4180000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.47999999999999998,"15min":0.46600000000000003},"max":{"1min":0.997,"5min":1.0980000000000001,"15min":3.7440000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.52500000000000002,"5min":0.48599999999999999,"15min":0.45400000000000001},"max":{"1min":1.0449999999999999,"5min":1.131,"15min":2.149},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.085,"5min":1.085,"15min":2.052},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.80500000000000005},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":6.1980000000000004},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.74199999999999999},"min":{"1min":0.57199999999999995,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":2.016},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76300000000000001,"15min":0.82499999999999996},"min":{"1min":0.56799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":3.7799999999999998},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17760,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":15808,"kb_avail":94354080,"statfs":{"total":96636764160,"available":96618577920,"internally_reserved":0,"allocated":1990656,"data_stored":932043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16187392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.27700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.54300000000000004,"5min":0.57499999999999996,"15min":0.79500000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41599999999999998,"15min":0.42199999999999999},"min":{"1min":0.33700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.69099999999999995,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.314,"15min":0.309},"max":{"1min":0.57099999999999995,"5min":0.71699999999999997,"15min":0.73699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.54400000000000004,"5min":0.59899999999999998,"15min":0.77800000000000002},"last":0.434}]},{"osd":4,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.51300000000000001,"5min":0.44700000000000001,"15min":0.38600000000000001},"max":{"1min":0.96499999999999997,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.748},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97699999999999998,"5min":1.085,"15min":1.28},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.25},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93500000000000005,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.034,"5min":1.034,"15min":1.2030000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.997,"5min":0.997,"15min":1.22},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.244},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.74199999999999999},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.2370000000000001},"last":0.65700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25372,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":23424,"kb_avail":94346468,"statfs":{"total":96636764160,"available":96610783232,"internally_reserved":0,"allocated":1986560,"data_stored":931457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23986176},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39200000000000002,"15min":0.40999999999999998},"min":{"1min":0.27900000000000003,"5min":0.24199999999999999,"15min":0.23799999999999999},"max":{"1min":0.51800000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.502},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.26700000000000002},"max":{"1min":0.60999999999999999,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.47499999999999998},"min":{"1min":0.33600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.96399999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51700000000000002,"15min":0.49099999999999999},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.626,"5min":5.601,"15min":5.601},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.443,"15min":0.47099999999999997},"min":{"1min":0.35999999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.59899999999999998,"5min":0.70799999999999996,"15min":0.83499999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.41199999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.002,"5min":1.353,"15min":1.353},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.51500000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83499999999999996,"5min":1.849,"15min":1.849},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76200000000000001,"15min":0.71599999999999997},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94499999999999995,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70099999999999996,"15min":0.72199999999999998},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71199999999999997,"15min":0.73799999999999999},"min":{"1min":0.58399999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":1.772,"15min":1.772},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.71399999999999997,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.439,"15min":0.42499999999999999},"max":{"1min":0.878,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.105,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.60499999999999998,"5min":0.55000000000000004,"15min":0.53700000000000003},"max":{"1min":0.91000000000000003,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.57399999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"max":{"1min":0.86299999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17364,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94354476,"statfs":{"total":96636764160,"available":96618983424,"internally_reserved":0,"allocated":1978368,"data_stored":931309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.51200000000000001,"5min":1.202,"15min":1.202},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.435},"min":{"1min":0.311,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60399999999999998,"5min":1.302,"15min":1.302},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41899999999999998,"15min":0.439},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57599999999999996,"5min":0.748,"15min":0.88900000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.64200000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.372,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68899999999999995,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.69299999999999995},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":0.83099999999999996,"5min":0.96299999999999997,"15min":1.149},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":5.1059999999999999,"15min":5.1059999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69299999999999995,"15min":0.71499999999999997},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":1.232,"15min":1.232},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.52600000000000002,"5min":0.50800000000000001,"15min":0.45200000000000001},"max":{"1min":0.86299999999999999,"5min":1.121,"15min":1.298},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70499999999999996,"15min":0.73399999999999999},"min":{"1min":0.51700000000000002,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":0.98299999999999998,"5min":1.343,"15min":1.343},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.93700000000000006,"5min":2.048,"15min":2.048},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.753,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.67000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16344,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":14400,"kb_avail":94355496,"statfs":{"total":96636764160,"available":96620027904,"internally_reserved":0,"allocated":1982464,"data_stored":931919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14745600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.65600000000000003},"min":{"1min":0.43099999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68500000000000005,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.505,"5min":0.45800000000000002,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.46999999999999997,"5min":0.434,"15min":0.39500000000000002},"max":{"1min":0.749,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.64700000000000002,"15min":0.65600000000000003},"min":{"1min":0.441,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.49099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76300000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.67900000000000005,"15min":0.67400000000000004},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.38800000000000001},"max":{"1min":0.755,"5min":4.476,"15min":4.476},"last":0.622}]},{"osd":3,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.51300000000000001,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.86399999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69699999999999995,"15min":0.68400000000000005},"min":{"1min":0.55200000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.74199999999999999,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.753}]},{"osd":5,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65400000000000003,"15min":0.623},"min":{"1min":0.45000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79600000000000004,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83799999999999997,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.66000000000000003},"min":{"1min":0.52700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82399999999999995,"5min":5.194,"15min":5.194},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77700000000000002,"15min":0.75600000000000001},"min":{"1min":0.63,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85799999999999998,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72399999999999998,"15min":0.71799999999999997},"min":{"1min":0.58499999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90400000000000003,"5min":2.819,"15min":2.819},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.624,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94399999999999995,"5min":2.7829999999999999,"15min":2.7829999999999999},"last":0.71999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94348524,"statfs":{"total":96636764160,"available":96612888576,"internally_reserved":0,"allocated":1978368,"data_stored":932167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.43099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.379},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59999999999999998,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.81399999999999995,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66100000000000003,"15min":0.69499999999999995},"min":{"1min":0.496,"5min":0.377,"15min":0.377},"max":{"1min":0.80700000000000005,"5min":1.026,"15min":6.7489999999999997},"last":0.443},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.68000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.77200000000000002,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.80200000000000005,"5min":0.98799999999999999,"15min":1.581},"last":0.622},{"interface":"front","average":{"1min":0.628,"5min":0.68000000000000005,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84599999999999997,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.68400000000000005},"min":{"1min":0.40699999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":9.6920000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.77700000000000002},"min":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91100000000000003,"5min":1.0660000000000001,"15min":9.4299999999999997},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.36699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92500000000000004,"5min":1.121,"15min":1.978},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66800000000000004,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.41499999999999998,"15min":0.38600000000000001},"max":{"1min":0.92300000000000004,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.39200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83099999999999996,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.44900000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":1.0960000000000001,"15min":1.7629999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jul 27 14:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69399999999999995,"15min":0.68100000000000005},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89100000000000001,"5min":1.115,"15min":1.9419999999999999},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:36:31.034 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:36:31.034 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:36:31.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.212+0000 7fc6be3ff700 1 Processor -- start 2023-07-27T14:36:31.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.212+0000 7fc6be3ff700 1 -- start start 2023-07-27T14:36:31.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6be3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b8157400 0x7fc6b80c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6be3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc6b80a7940 0x7fc6b80c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6be3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b80c7ad0 con 0x7fc6b80c7550 2023-07-27T14:36:31.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6be3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b80c5590 con 0x7fc6b80a7940 2023-07-27T14:36:31.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6be3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80c0fb0 con 0x7fc6b8157400 2023-07-27T14:36:31.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6b7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b8157400 0x7fc6b80c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6b77fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc6b80a7940 0x7fc6b80c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6b7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b8157400 0x7fc6b80c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:36534/0 (socket says 172.21.15.115:36534) 2023-07-27T14:36:31.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.214+0000 7fc6b7fff700 1 -- 172.21.15.115:0/177577115 learned_addr learned my addr 172.21.15.115:0/177577115 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:31.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.215+0000 7fc6b7fff700 1 -- 172.21.15.115:0/177577115 >> v2:172.21.15.159:3300/0 conn(0x7fc6b80a7940 msgr2=0x7fc6b80c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:31.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.215+0000 7fc6b7fff700 1 --2- 172.21.15.115:0/177577115 >> v2:172.21.15.159:3300/0 conn(0x7fc6b80a7940 0x7fc6b80c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.215+0000 7fc6b7fff700 1 -- 172.21.15.115:0/177577115 >> v1:172.21.15.159:6789/0 conn(0x7fc6b80c7550 legacy=0x7fc6b80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.215+0000 7fc6b7fff700 1 -- 172.21.15.115:0/177577115 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b80c7db0 con 0x7fc6b8157400 2023-07-27T14:36:31.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.215+0000 7fc6b7fff700 1 --2- 172.21.15.115:0/177577115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b8157400 0x7fc6b80c05d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fc6a8006fd0 tx=0x7fc6a80090f0).ready entity=mon.2 client_cookie=578d8d4f3e3be7e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:31.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.215+0000 7fc6b6ffd700 1 -- 172.21.15.115:0/177577115 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800b580 con 0x7fc6b8157400 2023-07-27T14:36:31.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.215+0000 7fc6b6ffd700 1 -- 172.21.15.115:0/177577115 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800b6e0 con 0x7fc6b8157400 2023-07-27T14:36:31.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.215+0000 7fc6b6ffd700 1 -- 172.21.15.115:0/177577115 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800ba60 con 0x7fc6b8157400 2023-07-27T14:36:31.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.216+0000 7fc6be3ff700 1 -- 172.21.15.115:0/177577115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b8157400 msgr2=0x7fc6b80c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.216+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/177577115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b8157400 0x7fc6b80c05d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fc6a8006fd0 tx=0x7fc6a80090f0).stop 2023-07-27T14:36:31.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.216+0000 7fc6be3ff700 1 -- 172.21.15.115:0/177577115 shutdown_connections 2023-07-27T14:36:31.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.216+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/177577115 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b8157400 0x7fc6b80c05d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.216+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/177577115 >> v2:172.21.15.159:3300/0 conn(0x7fc6b80a7940 0x7fc6b80c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.216+0000 7fc6be3ff700 1 -- 172.21.15.115:0/177577115 >> 172.21.15.115:0/177577115 conn(0x7fc6b8094280 msgr2=0x7fc6b805e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:31.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.216+0000 7fc6be3ff700 1 -- 172.21.15.115:0/177577115 shutdown_connections 2023-07-27T14:36:31.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.216+0000 7fc6be3ff700 1 -- 172.21.15.115:0/177577115 wait complete. 2023-07-27T14:36:31.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.217+0000 7fc6be3ff700 1 Processor -- start 2023-07-27T14:36:31.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.218+0000 7fc6be3ff700 1 -- start start 2023-07-27T14:36:31.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.218+0000 7fc6be3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b80a7940 0x7fc6b80abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.218+0000 7fc6be3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b80c7550 0x7fc6b814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.218+0000 7fc6be3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b8157400 0x7fc6b80caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.218+0000 7fc6be3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80ad3c0 con 0x7fc6b8157400 2023-07-27T14:36:31.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.218+0000 7fc6be3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80ac320 con 0x7fc6b80a7940 2023-07-27T14:36:31.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.218+0000 7fc6be3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80ac600 con 0x7fc6b80c7550 2023-07-27T14:36:31.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b8157400 0x7fc6b80caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b8157400 0x7fc6b80caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49800/0 (socket says 172.21.15.115:49800) 2023-07-27T14:36:31.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 -- 172.21.15.115:0/2276759999 learned_addr learned my addr 172.21.15.115:0/2276759999 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:31.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6b7fff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b80a7940 0x7fc6b80abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6b77fe700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b80c7550 0x7fc6b814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 -- 172.21.15.115:0/2276759999 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b80c7550 msgr2=0x7fc6b814ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b80c7550 0x7fc6b814ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 -- 172.21.15.115:0/2276759999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b80a7940 msgr2=0x7fc6b80abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b80a7940 0x7fc6b80abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 -- 172.21.15.115:0/2276759999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009370 con 0x7fc6b8157400 2023-07-27T14:36:31.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.219+0000 7fc6bc99c700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b8157400 0x7fc6b80caab0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7fc6b000c7c0 tx=0x7fc6b0001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:31.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.220+0000 7fc69ffff700 1 -- 172.21.15.115:0/2276759999 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000e4a0 con 0x7fc6b8157400 2023-07-27T14:36:31.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.220+0000 7fc69ffff700 1 -- 172.21.15.115:0/2276759999 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000e600 con 0x7fc6b8157400 2023-07-27T14:36:31.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.220+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b80ac8e0 con 0x7fc6b8157400 2023-07-27T14:36:31.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.220+0000 7fc69ffff700 1 -- 172.21.15.115:0/2276759999 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000e980 con 0x7fc6b8157400 2023-07-27T14:36:31.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.220+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b80acea0 con 0x7fc6b8157400 2023-07-27T14:36:31.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.221+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b80ad0c0 con 0x7fc6b8157400 2023-07-27T14:36:31.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.222+0000 7fc69ffff700 1 -- 172.21.15.115:0/2276759999 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fc6b0019030 con 0x7fc6b8157400 2023-07-27T14:36:31.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.222+0000 7fc69ffff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a405f880 0x7fc6a4061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.222+0000 7fc69ffff700 1 -- 172.21.15.115:0/2276759999 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc6b0079d30 con 0x7fc6b8157400 2023-07-27T14:36:31.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.223+0000 7fc6b7fff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a405f880 0x7fc6a4061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.223+0000 7fc6b7fff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a405f880 0x7fc6a4061d40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fc6a8009130 tx=0x7fc6a8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:31.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.226+0000 7fc69ffff700 1 -- 172.21.15.115:0/2276759999 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6b00488f0 con 0x7fc6b8157400 2023-07-27T14:36:31.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.459+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc6b806c470 con 0x7fc6b8157400 2023-07-27T14:36:31.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.463+0000 7fc69ffff700 1 -- 172.21.15.115:0/2276759999 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc6b004e6a0 con 0x7fc6b8157400 2023-07-27T14:36:31.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a405f880 msgr2=0x7fc6a4061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a405f880 0x7fc6a4061d40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fc6a8009130 tx=0x7fc6a8017000).stop 2023-07-27T14:36:31.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b8157400 msgr2=0x7fc6b80caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b8157400 0x7fc6b80caab0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7fc6b000c7c0 tx=0x7fc6b0001560).stop 2023-07-27T14:36:31.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 shutdown_connections 2023-07-27T14:36:31.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc6a405f880 0x7fc6a4061d40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b8157400 0x7fc6b80caab0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6b80a7940 0x7fc6b80abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 --2- 172.21.15.115:0/2276759999 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6b80c7550 0x7fc6b814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 >> 172.21.15.115:0/2276759999 conn(0x7fc6b8094280 msgr2=0x7fc6b80c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:31.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 shutdown_connections 2023-07-27T14:36:31.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.465+0000 7fc6be3ff700 1 -- 172.21.15.115:0/2276759999 wait complete. 2023-07-27T14:36:31.515 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:36:31.530 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:36:31.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.673+0000 7f1d057ff700 1 Processor -- start 2023-07-27T14:36:31.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.673+0000 7f1d057ff700 1 -- start start 2023-07-27T14:36:31.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.674+0000 7f1d057ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1d00150320 0x7f1d00150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.674+0000 7f1d057ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 0x7f1d00069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.674+0000 7f1d057ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d00068380 con 0x7f1d00065020 2023-07-27T14:36:31.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.674+0000 7f1d057ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d00065790 con 0x7f1d00150320 2023-07-27T14:36:31.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.674+0000 7f1d057ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00068ee0 con 0x7f1d000c0e80 2023-07-27T14:36:31.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cff7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1d00065020 0x7f1d000c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38742/0 (socket says 172.21.15.115:38742) 2023-07-27T14:36:31.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cff7fe700 1 -- 172.21.15.115:0/2773266874 learned_addr learned my addr 172.21.15.115:0/2773266874 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:31.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfe7fc700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 0x7f1d00069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfeffd700 1 --2- 172.21.15.115:0/2773266874 >> v2:172.21.15.159:3300/0 conn(0x7f1d00150320 0x7f1d00150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154484483 0 0) 0x7f1d00068380 con 0x7f1d00065020 2023-07-27T14:36:31.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce8004500 con 0x7f1d00065020 2023-07-27T14:36:31.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3741041033 0 0) 0x7f1ce8004500 con 0x7f1d00065020 2023-07-27T14:36:31.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 msgr2=0x7f1d00069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:31.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 0x7f1d00069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 >> v2:172.21.15.159:3300/0 conn(0x7f1d00150320 msgr2=0x7f1d00150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:31.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 --2- 172.21.15.115:0/2773266874 >> v2:172.21.15.159:3300/0 conn(0x7f1d00150320 0x7f1d00150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000685b0 con 0x7f1d00065020 2023-07-27T14:36:31.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1cf80017f0 con 0x7f1d00065020 2023-07-27T14:36:31.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 >> v1:172.21.15.115:6789/0 conn(0x7f1d00065020 legacy=0x7f1d000c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80049f0 0x7f1ce8004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce80057a0 0x7f1ce8005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 0x7f1ce8006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00065790 con 0x7f1ce80057a0 2023-07-27T14:36:31.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00068ee0 con 0x7f1ce80049f0 2023-07-27T14:36:31.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.675+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8003310 con 0x7f1d000c0e80 2023-07-27T14:36:31.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfe7fc700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce80057a0 0x7f1ce8005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfeffd700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80049f0 0x7f1ce8004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cff7fe700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 0x7f1ce8006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfe7fc700 1 -- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 msgr2=0x7f1ce8006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfe7fc700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 0x7f1ce8006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfe7fc700 1 -- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80049f0 msgr2=0x7f1ce8004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfe7fc700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80049f0 0x7f1ce8004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfe7fc700 1 -- 172.21.15.115:0/2773266874 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8004500 con 0x7f1ce80057a0 2023-07-27T14:36:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cff7fe700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d000c0e80 0x7f1ce8006110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfe7fc700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce80057a0 0x7f1ce8005c20 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f1cf4009a80 tx=0x7f1cf4009060).ready entity=mon.0 client_cookie=47ef5e79c88acc01 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4009430 con 0x7f1ce80057a0 2023-07-27T14:36:31.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400e640 con 0x7f1ce80057a0 2023-07-27T14:36:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.676+0000 7f1cfdffb700 1 -- 172.21.15.115:0/2773266874 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400e9c0 con 0x7f1ce80057a0 2023-07-27T14:36:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.677+0000 7f1d057ff700 1 -- 172.21.15.115:0/2773266874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce80057a0 msgr2=0x7f1ce8005c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.677+0000 7f1d057ff700 1 --2- 172.21.15.115:0/2773266874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce80057a0 0x7f1ce8005c20 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f1cf4009a80 tx=0x7f1cf4009060).stop 2023-07-27T14:36:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.677+0000 7f1cff7fe700 1 -- 172.21.15.115:0/2773266874 reap_dead start 2023-07-27T14:36:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.677+0000 7f1d057ff700 1 -- 172.21.15.115:0/2773266874 shutdown_connections 2023-07-27T14:36:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.677+0000 7f1d057ff700 1 -- 172.21.15.115:0/2773266874 >> 172.21.15.115:0/2773266874 conn(0x7f1d00062320 msgr2=0x7f1d00062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:31.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.677+0000 7f1d057ff700 1 -- 172.21.15.115:0/2773266874 shutdown_connections 2023-07-27T14:36:31.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.677+0000 7f1d057ff700 1 -- 172.21.15.115:0/2773266874 wait complete. 2023-07-27T14:36:31.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.679+0000 7f1d057ff700 1 Processor -- start 2023-07-27T14:36:31.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.679+0000 7f1d057ff700 1 -- start start 2023-07-27T14:36:31.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1d057ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80057a0 0x7f1d000a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1d057ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d0014f500 0x7f1d000a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1d057ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d000a8620 0x7f1d00142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1d057ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00152b20 con 0x7f1d000a8620 2023-07-27T14:36:31.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1d057ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0014fa70 con 0x7f1ce80057a0 2023-07-27T14:36:31.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1d057ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d001524d0 con 0x7f1d0014f500 2023-07-27T14:36:31.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d000a8620 0x7f1d00142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d000a8620 0x7f1d00142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49816/0 (socket says 172.21.15.115:49816) 2023-07-27T14:36:31.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 -- 172.21.15.115:0/704268735 learned_addr learned my addr 172.21.15.115:0/704268735 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:31.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cfe7fc700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d0014f500 0x7f1d000a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cfeffd700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80057a0 0x7f1d000a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 -- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d0014f500 msgr2=0x7f1d000a8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d0014f500 0x7f1d000a8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 -- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80057a0 msgr2=0x7f1d000a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80057a0 0x7f1d000a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 -- 172.21.15.115:0/704268735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d001527b0 con 0x7f1d000a8620 2023-07-27T14:36:31.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cfe7fc700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d0014f500 0x7f1d000a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:31.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cfeffd700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80057a0 0x7f1d000a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:31.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.680+0000 7f1cff7fe700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d000a8620 0x7f1d00142520 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f1cf8000f80 tx=0x7f1cf80014c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:31.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.681+0000 7f1ce6ffd700 1 -- 172.21.15.115:0/704268735 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800e830 con 0x7f1d000a8620 2023-07-27T14:36:31.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.681+0000 7f1ce6ffd700 1 -- 172.21.15.115:0/704268735 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf800e9b0 con 0x7f1d000a8620 2023-07-27T14:36:31.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.681+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d000a5700 con 0x7f1d000a8620 2023-07-27T14:36:31.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.681+0000 7f1ce6ffd700 1 -- 172.21.15.115:0/704268735 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800ed70 con 0x7f1d000a8620 2023-07-27T14:36:31.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.681+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d000bde80 con 0x7f1d000a8620 2023-07-27T14:36:31.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.682+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d000be070 con 0x7f1d000a8620 2023-07-27T14:36:31.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.683+0000 7f1ce6ffd700 1 -- 172.21.15.115:0/704268735 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f1cf8014640 con 0x7f1d000a8620 2023-07-27T14:36:31.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.683+0000 7f1ce6ffd700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1cec05f880 0x7f1cec061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:31.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.684+0000 7f1ce6ffd700 1 -- 172.21.15.115:0/704268735 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1cf807a9e0 con 0x7f1d000a8620 2023-07-27T14:36:31.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.684+0000 7f1cfeffd700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1cec05f880 0x7f1cec061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:31.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.684+0000 7f1cfeffd700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1cec05f880 0x7f1cec061d40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f1cf0009270 tx=0x7f1cf0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:31.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.688+0000 7f1ce6ffd700 1 -- 172.21.15.115:0/704268735 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1cf80498f0 con 0x7f1d000a8620 2023-07-27T14:36:31.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.899+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d00152340 con 0x7f1d000a8620 2023-07-27T14:36:31.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.900+0000 7f1ce6ffd700 1 -- 172.21.15.115:0/704268735 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f1cf804b760 con 0x7f1d000a8620 2023-07-27T14:36:31.949 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:36:31.949 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2898407097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2898407097},{"type":"v1","addr":"172.21.15.115:6837","nonce":2898407097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6929,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/112108246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":112108246},{"type":"v1","addr":"172.21.15.159:6835","nonce":112108246}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/680715955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":680715955},{"type":"v1","addr":"172.21.15.115:6836","nonce":680715955}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:36:26.258376+0000","modified":"2023-07-27T14:36:29.273687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7807},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7807":{"gid":7807,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/3102980678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3102980678},{"type":"v1","addr":"172.21.15.159:6834","nonce":3102980678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-07-27T14:36:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1cec05f880 msgr2=0x7f1cec061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1cec05f880 0x7f1cec061d40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f1cf0009270 tx=0x7f1cf0008040).stop 2023-07-27T14:36:31.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d000a8620 msgr2=0x7f1d00142520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:31.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d000a8620 0x7f1d00142520 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7f1cf8000f80 tx=0x7f1cf80014c0).stop 2023-07-27T14:36:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 shutdown_connections 2023-07-27T14:36:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1cec05f880 0x7f1cec061d40 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d000a8620 0x7f1d00142520 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ce80057a0 0x7f1d000a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 --2- 172.21.15.115:0/704268735 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d0014f500 0x7f1d000a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 >> 172.21.15.115:0/704268735 conn(0x7f1d00062320 msgr2=0x7f1d000a9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 shutdown_connections 2023-07-27T14:36:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:31.902+0000 7f1d057ff700 1 -- 172.21.15.115:0/704268735 wait complete. 2023-07-27T14:36:31.954 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 84 2023-07-27T14:36:32.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:36:26.258376+0000', 'modified': '2023-07-27T14:36:29.273687+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7807}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7807': {'gid': 7807, 'name': 'b', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6834/3102980678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6832', 'nonce': 3102980678}, {'type': 'v1', 'addr': '172.21.15.159:6834', 'nonce': 3102980678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:36:32.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:36:32.370 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-27T14:36:32.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.511+0000 7f80b5fff700 1 Processor -- start 2023-07-27T14:36:32.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.511+0000 7f80b5fff700 1 -- start start 2023-07-27T14:36:32.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.512+0000 7f80b5fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f80b0153ec0 0x7f80b00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.512+0000 7f80b5fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b00aaa40 0x7f80b00c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.512+0000 7f80b5fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b00aa4d0 con 0x7f80b00aa050 2023-07-27T14:36:32.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.512+0000 7f80b5fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b00c05c0 con 0x7f80b0153ec0 2023-07-27T14:36:32.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.512+0000 7f80b5fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00bfc90 con 0x7f80b00aaa40 2023-07-27T14:36:32.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80af7fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f80b0153ec0 0x7f80b00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80affff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b00aaa40 0x7f80b00c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80af7fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f80b0153ec0 0x7f80b00a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:57218/0 (socket says 172.21.15.115:57218) 2023-07-27T14:36:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80af7fe700 1 -- 172.21.15.115:0/822413897 learned_addr learned my addr 172.21.15.115:0/822413897 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80ae7fc700 1 -- 172.21.15.115:0/822413897 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144248649 0 0) 0x7f80a4001110 con 0x7f80b00aa050 2023-07-27T14:36:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80ae7fc700 1 -- 172.21.15.115:0/822413897 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80980033f0 con 0x7f80b00aa050 2023-07-27T14:36:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80af7fe700 1 -- 172.21.15.115:0/822413897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b00aaa40 msgr2=0x7f80b00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80af7fe700 1 --2- 172.21.15.115:0/822413897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b00aaa40 0x7f80b00c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80af7fe700 1 -- 172.21.15.115:0/822413897 >> v1:172.21.15.159:6789/0 conn(0x7f80b00aa050 legacy=0x7f80b00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80af7fe700 1 -- 172.21.15.115:0/822413897 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b00bff70 con 0x7f80b0153ec0 2023-07-27T14:36:32.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.513+0000 7f80affff700 1 --2- 172.21.15.115:0/822413897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b00aaa40 0x7f80b00c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:32.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.514+0000 7f80af7fe700 1 --2- 172.21.15.115:0/822413897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b0153ec0 0x7f80b00a9b60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f80a0006fd0 tx=0x7f80a00090f0).ready entity=mon.1 client_cookie=5c3ce74753f5d661 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.514+0000 7f80ae7fc700 1 -- 172.21.15.115:0/822413897 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000f510 con 0x7f80b0153ec0 2023-07-27T14:36:32.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.514+0000 7f80ae7fc700 1 -- 172.21.15.115:0/822413897 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a000f670 con 0x7f80b0153ec0 2023-07-27T14:36:32.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.514+0000 7f80ae7fc700 1 -- 172.21.15.115:0/822413897 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000f9f0 con 0x7f80b0153ec0 2023-07-27T14:36:32.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.514+0000 7f80b5fff700 1 -- 172.21.15.115:0/822413897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b0153ec0 msgr2=0x7f80b00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.514+0000 7f80b5fff700 1 --2- 172.21.15.115:0/822413897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b0153ec0 0x7f80b00a9b60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f80a0006fd0 tx=0x7f80a00090f0).stop 2023-07-27T14:36:32.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.514+0000 7f80b5fff700 1 -- 172.21.15.115:0/822413897 shutdown_connections 2023-07-27T14:36:32.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.514+0000 7f80b5fff700 1 --2- 172.21.15.115:0/822413897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b00aaa40 0x7f80b00c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.515+0000 7f80b5fff700 1 --2- 172.21.15.115:0/822413897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b0153ec0 0x7f80b00a9b60 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.515+0000 7f80b5fff700 1 -- 172.21.15.115:0/822413897 >> 172.21.15.115:0/822413897 conn(0x7f80b00cb610 msgr2=0x7f80b00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:32.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.515+0000 7f80b5fff700 1 -- 172.21.15.115:0/822413897 shutdown_connections 2023-07-27T14:36:32.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.515+0000 7f80b5fff700 1 -- 172.21.15.115:0/822413897 wait complete. 2023-07-27T14:36:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.516+0000 7f80b5fff700 1 Processor -- start 2023-07-27T14:36:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.516+0000 7f80b5fff700 1 -- start start 2023-07-27T14:36:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80b5fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00aa050 0x7f80b015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80b5fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b00aaa40 0x7f80b01530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80b5fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b0153ec0 0x7f80b01679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80b5fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b015b560 con 0x7f80b00aaa40 2023-07-27T14:36:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80b5fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0168800 con 0x7f80b00aa050 2023-07-27T14:36:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80b5fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00c3940 con 0x7f80b0153ec0 2023-07-27T14:36:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b00aaa40 0x7f80b01530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b00aaa40 0x7f80b01530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49818/0 (socket says 172.21.15.115:49818) 2023-07-27T14:36:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80aeffd700 1 -- 172.21.15.115:0/3908226913 learned_addr learned my addr 172.21.15.115:0/3908226913 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80af7fe700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00aa050 0x7f80b015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.517+0000 7f80affff700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b0153ec0 0x7f80b01679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80aeffd700 1 -- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b0153ec0 msgr2=0x7f80b01679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80aeffd700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b0153ec0 0x7f80b01679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80aeffd700 1 -- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00aa050 msgr2=0x7f80b015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80aeffd700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00aa050 0x7f80b015b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80aeffd700 1 -- 172.21.15.115:0/3908226913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8009a20 con 0x7f80b00aaa40 2023-07-27T14:36:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80af7fe700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00aa050 0x7f80b015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80aeffd700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b00aaa40 0x7f80b01530c0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f80a400c4a0 tx=0x7f80a4007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80977fe700 1 -- 172.21.15.115:0/3908226913 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a400f470 con 0x7f80b00aaa40 2023-07-27T14:36:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80977fe700 1 -- 172.21.15.115:0/3908226913 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a400f5d0 con 0x7f80b00aaa40 2023-07-27T14:36:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80b5fff700 1 -- 172.21.15.115:0/3908226913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a0009370 con 0x7f80b00aaa40 2023-07-27T14:36:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80977fe700 1 -- 172.21.15.115:0/3908226913 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a400f970 con 0x7f80b00aaa40 2023-07-27T14:36:32.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.518+0000 7f80b5fff700 1 -- 172.21.15.115:0/3908226913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b00c3f00 con 0x7f80b00aaa40 2023-07-27T14:36:32.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.520+0000 7f80977fe700 1 -- 172.21.15.115:0/3908226913 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f80a4019030 con 0x7f80b00aaa40 2023-07-27T14:36:32.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.521+0000 7f80977fe700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f809c05f850 0x7f809c061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.521+0000 7f80977fe700 1 -- 172.21.15.115:0/3908226913 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f80a4079b90 con 0x7f80b00aaa40 2023-07-27T14:36:32.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.521+0000 7f80af7fe700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f809c05f850 0x7f809c061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.522+0000 7f80af7fe700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f809c05f850 0x7f809c061d10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f80a0009130 tx=0x7f80a0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.523+0000 7f80cd333b80 1 Processor -- start 2023-07-27T14:36:32.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.523+0000 7f80cd333b80 1 -- start start 2023-07-27T14:36:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.524+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 0x556d3e7509a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.524+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e778830 0x556d3e79ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.524+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e79f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.524+0000 7f80cd333b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3e68d9c0 con 0x556d3e778830 2023-07-27T14:36:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.524+0000 7f80cd333b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3e6a2cc0 con 0x556d3e752f60 2023-07-27T14:36:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.524+0000 7f80cd333b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3e669e10 con 0x556d3e7505c0 2023-07-27T14:36:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e778830 0x556d3e79ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e778830 0x556d3e79ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49820/0 (socket says 172.21.15.115:49820) 2023-07-27T14:36:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 -- 172.21.15.115:0/3426635032 learned_addr learned my addr 172.21.15.115:0/3426635032 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 -- 172.21.15.115:0/3426635032 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 msgr2=0x556d3e7509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 --2- 172.21.15.115:0/3426635032 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 0x556d3e7509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:32.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 -- 172.21.15.115:0/3426635032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 msgr2=0x556d3e79f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 --2- 172.21.15.115:0/3426635032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e79f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 -- 172.21.15.115:0/3426635032 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d3e69b9a0 con 0x556d3e778830 2023-07-27T14:36:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f80aeffd700 1 --2- 172.21.15.115:0/3426635032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e778830 0x556d3e79ecc0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f80a404e120 tx=0x7f80a400f000).ready entity=mon.0 client_cookie=4a9700efd52226d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f8094ff9700 1 -- 172.21.15.115:0/3426635032 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a404c900 con 0x556d3e778830 2023-07-27T14:36:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f8094ff9700 1 -- 172.21.15.115:0/3426635032 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4052070 con 0x556d3e778830 2023-07-27T14:36:32.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.525+0000 7f8094ff9700 1 -- 172.21.15.115:0/3426635032 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4077700 con 0x556d3e778830 2023-07-27T14:36:32.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 -- 172.21.15.115:0/3426635032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e778830 msgr2=0x556d3e79ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 --2- 172.21.15.115:0/3426635032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e778830 0x556d3e79ecc0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f80a404e120 tx=0x7f80a400f000).stop 2023-07-27T14:36:32.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 -- 172.21.15.115:0/3426635032 shutdown_connections 2023-07-27T14:36:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 --2- 172.21.15.115:0/3426635032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e79f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 --2- 172.21.15.115:0/3426635032 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 0x556d3e7509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 --2- 172.21.15.115:0/3426635032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e778830 0x556d3e79ecc0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 -- 172.21.15.115:0/3426635032 >> 172.21.15.115:0/3426635032 conn(0x556d3e5bb940 msgr2=0x556d3e7996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 -- 172.21.15.115:0/3426635032 shutdown_connections 2023-07-27T14:36:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.526+0000 7f80cd333b80 1 -- 172.21.15.115:0/3426635032 wait complete. 2023-07-27T14:36:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.527+0000 7f80cd333b80 1 -- start start 2023-07-27T14:36:32.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.527+0000 7f80cd333b80 1 Processor -- start 2023-07-27T14:36:32.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 0x556d3e772840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e752f60 0x556d3e772d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e77d880 0x556d3e794b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80cd333b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3e773220 con 0x556d3e752f60 2023-07-27T14:36:32.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80cd333b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3e77dff0 con 0x556d3e77d880 2023-07-27T14:36:32.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80cd333b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3e793890 con 0x556d3e7505c0 2023-07-27T14:36:32.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80cd333b80 10 client.0 ll_register_callbacks cb 0x556d3e6554a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:36:32.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e752f60 0x556d3e772d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e752f60 0x556d3e772d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49828/0 (socket says 172.21.15.115:49828) 2023-07-27T14:36:32.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80aeffd700 1 -- 172.21.15.115:0/139732822 learned_addr learned my addr 172.21.15.115:0/139732822 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:32.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80af7fe700 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 0x556d3e772840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80affff700 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e77d880 0x556d3e794b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80aeffd700 1 -- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 msgr2=0x556d3e772840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.528+0000 7f80aeffd700 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 0x556d3e772840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80aeffd700 1 -- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e77d880 msgr2=0x556d3e794b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80aeffd700 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e77d880 0x556d3e794b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80aeffd700 1 -- 172.21.15.115:0/139732822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b00c3f00 con 0x556d3e752f60 2023-07-27T14:36:32.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80aeffd700 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e752f60 0x556d3e772d30 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f80a404e390 tx=0x7f80a4058000).ready entity=mon.0 client_cookie=5cc46a6fd33f7a21 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f808dffb700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:36:32.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f808dffb700 1 -- 172.21.15.115:0/139732822 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a404a4d0 con 0x556d3e752f60 2023-07-27T14:36:32.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 1 -- 172.21.15.115:0/139732822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d3e74ad50 con 0x556d3e752f60 2023-07-27T14:36:32.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f808dffb700 1 -- 172.21.15.115:0/139732822 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f80a404a630 con 0x556d3e752f60 2023-07-27T14:36:32.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f808dffb700 1 -- 172.21.15.115:0/139732822 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80a405de90 con 0x556d3e752f60 2023-07-27T14:36:32.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 10 client.8892 fetch_fsmap learned FSMap version 84 2023-07-27T14:36:32.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 1 -- 172.21.15.115:0/139732822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x556d3e697190 con 0x556d3e752f60 2023-07-27T14:36:32.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f808dffb700 1 -- 172.21.15.115:0/139732822 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d3e74ad50 con 0x556d3e752f60 2023-07-27T14:36:32.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f808dffb700 1 -- 172.21.15.115:0/139732822 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 84) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f80a4063020 con 0x556d3e752f60 2023-07-27T14:36:32.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 10 client.8892 fetch_fsmap finished waiting for FSMap version 84 2023-07-27T14:36:32.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 10 client.8892 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T14:36:32.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 20 client.8892 populate_metadata read hostname 'smithi115' 2023-07-27T14:36:32.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] conn(0x556d3e771d10 0x556d3e7720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 4 client.8892 mds_command: new command op to 7807 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:36:32.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.529+0000 7f80cd333b80 1 -- 172.21.15.115:0/139732822 --> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d3e50bef0 con 0x556d3e771d10 2023-07-27T14:36:32.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.530+0000 7f80af7fe700 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] conn(0x556d3e771d10 0x556d3e7720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.530+0000 7f80af7fe700 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] conn(0x556d3e771d10 0x556d3e7720f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b6748b8161166047 server_cookie=55bb92c644555f6b in_seq=0 out_seq=0 2023-07-27T14:36:32.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.530+0000 7f808dffb700 10 client.8892 ms_handle_connect on v2:172.21.15.159:6832/3102980678 2023-07-27T14:36:32.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.531+0000 7f808dffb700 1 -- 172.21.15.115:0/139732822 <== mds.0 v2:172.21.15.159:6832/3102980678 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x556d3e50bef0 con 0x556d3e771d10 2023-07-27T14:36:32.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.531+0000 7f808dffb700 10 client.8892 handle_command_reply: tid=0 2023-07-27T14:36:32.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.531+0000 7f80cd333b80 1 client.8892 shutdown 2023-07-27T14:36:32.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 -- 172.21.15.115:0/139732822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e752f60 msgr2=0x556d3e772d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e752f60 0x556d3e772d30 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f80a404e390 tx=0x7f80a4058000).stop 2023-07-27T14:36:32.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 -- 172.21.15.115:0/139732822 shutdown_connections 2023-07-27T14:36:32.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] conn(0x556d3e771d10 0x556d3e7720f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e77d880 0x556d3e794b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e7505c0 0x556d3e772840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f808dffb700 0 client.8892 ms_handle_reset on v2:172.21.15.159:6832/3102980678 2023-07-27T14:36:32.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 --2- 172.21.15.115:0/139732822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e752f60 0x556d3e772d30 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 -- 172.21.15.115:0/139732822 >> 172.21.15.115:0/139732822 conn(0x556d3e5bb940 msgr2=0x556d3e799560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:32.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 -- 172.21.15.115:0/139732822 shutdown_connections 2023-07-27T14:36:32.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 1 -- 172.21.15.115:0/139732822 wait complete. 2023-07-27T14:36:32.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.532+0000 7f80cd333b80 20 client.8892 trim_cache size 0 max 16384 2023-07-27T14:36:32.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.549+0000 7f80cd333b80 1 Processor -- start 2023-07-27T14:36:32.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.549+0000 7f80cd333b80 1 -- start start 2023-07-27T14:36:32.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.549+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e7a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 0x556d3e74b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80cd333b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3e7949b0 con 0x556d3e7505c0 2023-07-27T14:36:32.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80cd333b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3e751cb0 con 0x556d3e752f60 2023-07-27T14:36:32.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80cd333b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3e74e970 con 0x556d3e77d880 2023-07-27T14:36:32.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49836/0 (socket says 172.21.15.115:49836) 2023-07-27T14:36:32.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 -- 172.21.15.115:0/3493466906 learned_addr learned my addr 172.21.15.115:0/3493466906 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:32.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80aeffd700 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e7a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 -- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 msgr2=0x556d3e74b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80affff700 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 0x556d3e74b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 0x556d3e74b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 -- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 msgr2=0x556d3e7a7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e7a7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 -- 172.21.15.115:0/3493466906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d3e696ee0 con 0x556d3e7505c0 2023-07-27T14:36:32.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80aeffd700 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e7a7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:32.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80af7fe700 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7a75d0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f80b0060760 tx=0x7f80a001e040).ready entity=mon.0 client_cookie=cdcc324c7ac71333 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.550+0000 7f80957fa700 1 -- 172.21.15.115:0/3493466906 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0011a10 con 0x556d3e7505c0 2023-07-27T14:36:32.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80957fa700 1 -- 172.21.15.115:0/3493466906 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a0011b70 con 0x556d3e7505c0 2023-07-27T14:36:32.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80957fa700 1 -- 172.21.15.115:0/3493466906 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0011ce0 con 0x556d3e7505c0 2023-07-27T14:36:32.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 -- 172.21.15.115:0/3493466906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 msgr2=0x556d3e7a75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7a75d0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f80b0060760 tx=0x7f80a001e040).stop 2023-07-27T14:36:32.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 -- 172.21.15.115:0/3493466906 shutdown_connections 2023-07-27T14:36:32.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 0x556d3e74b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7a75d0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 --2- 172.21.15.115:0/3493466906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e7a7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 -- 172.21.15.115:0/3493466906 >> 172.21.15.115:0/3493466906 conn(0x556d3e5bb940 msgr2=0x556d3e77cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:32.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 -- 172.21.15.115:0/3493466906 shutdown_connections 2023-07-27T14:36:32.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.551+0000 7f80cd333b80 1 -- 172.21.15.115:0/3493466906 wait complete. 2023-07-27T14:36:32.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.552+0000 7f80cd333b80 1 -- start start 2023-07-27T14:36:32.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.552+0000 7f80cd333b80 1 Processor -- start 2023-07-27T14:36:32.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7fae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e77e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80cd333b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 0x556d3e77e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80cd333b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3e74d8a0 con 0x556d3e7505c0 2023-07-27T14:36:32.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80cd333b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3e77ad60 con 0x556d3e752f60 2023-07-27T14:36:32.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80cd333b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3e74e640 con 0x556d3e77d880 2023-07-27T14:36:32.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80cd333b80 10 client.0 ll_register_callbacks cb 0x556d3e6554a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:36:32.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7fae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49844/0 (socket says 172.21.15.115:49844) 2023-07-27T14:36:32.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80af7fe700 1 -- 172.21.15.115:0/1937366422 learned_addr learned my addr 172.21.15.115:0/1937366422 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:32.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80aeffd700 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e77e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.554+0000 7f80affff700 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 0x556d3e77e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80af7fe700 1 -- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 msgr2=0x556d3e77e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80af7fe700 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 0x556d3e77e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80af7fe700 1 -- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 msgr2=0x556d3e77e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80af7fe700 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e77e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80af7fe700 1 -- 172.21.15.115:0/1937366422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b00bff70 con 0x556d3e7505c0 2023-07-27T14:36:32.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80aeffd700 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e77e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:32.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80af7fe700 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7fae30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f80a0008000 tx=0x7f80a002b040).ready entity=mon.0 client_cookie=ef5966fa6f8dbb8f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f808dffb700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:36:32.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f808dffb700 1 -- 172.21.15.115:0/1937366422 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0028990 con 0x556d3e7505c0 2023-07-27T14:36:32.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f808dffb700 1 -- 172.21.15.115:0/1937366422 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f80a0028af0 con 0x556d3e7505c0 2023-07-27T14:36:32.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80cd333b80 1 -- 172.21.15.115:0/1937366422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80a4052070 con 0x556d3e7505c0 2023-07-27T14:36:32.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f808dffb700 1 -- 172.21.15.115:0/1937366422 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80a001c420 con 0x556d3e7505c0 2023-07-27T14:36:32.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80cd333b80 10 client.8898 fetch_fsmap learned FSMap version 84 2023-07-27T14:36:32.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80cd333b80 1 -- 172.21.15.115:0/1937366422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x556d3e5111d0 con 0x556d3e7505c0 2023-07-27T14:36:32.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f808dffb700 1 -- 172.21.15.115:0/1937366422 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4052070 con 0x556d3e7505c0 2023-07-27T14:36:32.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f808dffb700 1 -- 172.21.15.115:0/1937366422 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 84) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f80a001c580 con 0x556d3e7505c0 2023-07-27T14:36:32.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80cd333b80 10 client.8898 fetch_fsmap finished waiting for FSMap version 84 2023-07-27T14:36:32.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80cd333b80 10 client.8898 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-27T14:36:32.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.555+0000 7f80cd333b80 20 client.8898 populate_metadata read hostname 'smithi115' 2023-07-27T14:36:32.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.556+0000 7f80cd333b80 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] conn(0x556d3e791d90 0x556d3e792170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.556+0000 7f80cd333b80 4 client.8898 mds_command: new command op to 7807 tid=0[{"prefix": "status"}] 2023-07-27T14:36:32.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.556+0000 7f80cd333b80 1 -- 172.21.15.115:0/1937366422 --> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556d3e541040 con 0x556d3e791d90 2023-07-27T14:36:32.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.556+0000 7f80aeffd700 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] conn(0x556d3e791d90 0x556d3e792170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.556+0000 7f808dffb700 10 client.8898 ms_handle_connect on v2:172.21.15.159:6832/3102980678 2023-07-27T14:36:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.556+0000 7f80aeffd700 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] conn(0x556d3e791d90 0x556d3e792170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=dd13ec9999d8a5c7 server_cookie=f6a214063b1cec80 in_seq=0 out_seq=0 2023-07-27T14:36:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f808dffb700 1 -- 172.21.15.115:0/1937366422 <== mds.0 v2:172.21.15.159:6832/3102980678 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x556d3e541040 con 0x556d3e791d90 2023-07-27T14:36:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f808dffb700 10 client.8898 handle_command_reply: tid=0 2023-07-27T14:36:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 client.8898 shutdown 2023-07-27T14:36:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 -- 172.21.15.115:0/1937366422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 msgr2=0x556d3e7fae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7fae30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f80a0008000 tx=0x7f80a002b040).stop 2023-07-27T14:36:32.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 -- 172.21.15.115:0/1937366422 shutdown_connections 2023-07-27T14:36:32.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x556d3e77d880 0x556d3e77e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d3e7505c0 0x556d3e7fae30 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:6832/3102980678,v1:172.21.15.159:6834/3102980678] conn(0x556d3e791d90 0x556d3e792170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 --2- 172.21.15.115:0/1937366422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556d3e752f60 0x556d3e77e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 -- 172.21.15.115:0/1937366422 >> 172.21.15.115:0/1937366422 conn(0x556d3e5bb940 msgr2=0x556d3e7a75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:32.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f808dffb700 0 client.8898 ms_handle_reset on v2:172.21.15.159:6832/3102980678 2023-07-27T14:36:32.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 -- 172.21.15.115:0/1937366422 shutdown_connections 2023-07-27T14:36:32.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 1 -- 172.21.15.115:0/1937366422 wait complete. 2023-07-27T14:36:32.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.557+0000 7f80cd333b80 20 client.8898 trim_cache size 0 max 16384 2023-07-27T14:36:32.627 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:36:32.628 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:36:32.628 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:36:32.628 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 7807, 2023-07-27T14:36:32.628 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:36:32.628 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:36:32.628 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:36:32.628 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2957461800000001, 2023-07-27T14:36:32.629 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 84, 2023-07-27T14:36:32.629 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 158, 2023-07-27T14:36:32.629 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 158, 2023-07-27T14:36:32.629 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.510954529999999 2023-07-27T14:36:32.629 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:36:32.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 -- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f809c05f850 msgr2=0x7f809c061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f809c05f850 0x7f809c061d10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f80a0009130 tx=0x7f80a0017000).stop 2023-07-27T14:36:32.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 -- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b00aaa40 msgr2=0x7f80b01530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b00aaa40 0x7f80b01530c0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f80a400c4a0 tx=0x7f80a4007b00).stop 2023-07-27T14:36:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 -- 172.21.15.115:0/3908226913 shutdown_connections 2023-07-27T14:36:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f809c05f850 0x7f809c061d10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80b0153ec0 0x7f80b01679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80b00aa050 0x7f80b015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 --2- 172.21.15.115:0/3908226913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b00aaa40 0x7f80b01530c0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 -- 172.21.15.115:0/3908226913 >> 172.21.15.115:0/3908226913 conn(0x7f80b00cb610 msgr2=0x7f80b00ab160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:32.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 -- 172.21.15.115:0/3908226913 shutdown_connections 2023-07-27T14:36:32.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.558+0000 7f80b5fff700 1 -- 172.21.15.115:0/3908226913 wait complete. 2023-07-27T14:36:32.632 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:36:32.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.742+0000 7fbb5d7ff700 1 Processor -- start 2023-07-27T14:36:32.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.742+0000 7fbb5d7ff700 1 -- start start 2023-07-27T14:36:32.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.743+0000 7fbb5d7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbb580c64b0 0x7fbb580641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.743+0000 7fbb5d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.743+0000 7fbb5d7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb58064b50 con 0x7fbb58154190 2023-07-27T14:36:32.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.743+0000 7fbb5d7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580aa640 con 0x7fbb580c64b0 2023-07-27T14:36:32.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.743+0000 7fbb5d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58158e00 con 0x7fbb580646c0 2023-07-27T14:36:32.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb56ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbb58154190 0x7fbb580a9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:38748/0 (socket says 172.21.15.115:38748) 2023-07-27T14:36:32.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb56ffd700 1 -- 172.21.15.115:0/1116098765 learned_addr learned my addr 172.21.15.115:0/1116098765 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:32.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb577fe700 1 --2- 172.21.15.115:0/1116098765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb567fc700 1 --2- 172.21.15.115:0/1116098765 >> v2:172.21.15.159:3300/0 conn(0x7fbb580c64b0 0x7fbb580641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb55ffb700 1 -- 172.21.15.115:0/1116098765 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270206509 0 0) 0x7fbb58064b50 con 0x7fbb58154190 2023-07-27T14:36:32.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb55ffb700 1 -- 172.21.15.115:0/1116098765 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb400033f0 con 0x7fbb58154190 2023-07-27T14:36:32.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb577fe700 1 -- 172.21.15.115:0/1116098765 >> v2:172.21.15.159:3300/0 conn(0x7fbb580c64b0 msgr2=0x7fbb580641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:32.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb577fe700 1 --2- 172.21.15.115:0/1116098765 >> v2:172.21.15.159:3300/0 conn(0x7fbb580c64b0 0x7fbb580641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb577fe700 1 -- 172.21.15.115:0/1116098765 >> v1:172.21.15.115:6789/0 conn(0x7fbb58154190 legacy=0x7fbb580a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb55ffb700 1 -- 172.21.15.115:0/1116098765 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084064199 0 0) 0x7fbb400033f0 con 0x7fbb58154190 2023-07-27T14:36:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.744+0000 7fbb577fe700 1 -- 172.21.15.115:0/1116098765 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58158040 con 0x7fbb580646c0 2023-07-27T14:36:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb577fe700 1 --2- 172.21.15.115:0/1116098765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58154570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fbb50009e60 tx=0x7fbb50009780).ready entity=mon.2 client_cookie=76e5fdac8f4c5b91 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb55ffb700 1 -- 172.21.15.115:0/1116098765 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000e070 con 0x7fbb580646c0 2023-07-27T14:36:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb55ffb700 1 -- 172.21.15.115:0/1116098765 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5000b7a0 con 0x7fbb580646c0 2023-07-27T14:36:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb55ffb700 1 -- 172.21.15.115:0/1116098765 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48001470 con 0x7fbb580646c0 2023-07-27T14:36:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/1116098765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 msgr2=0x7fbb58154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/1116098765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58154570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fbb50009e60 tx=0x7fbb50009780).stop 2023-07-27T14:36:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/1116098765 shutdown_connections 2023-07-27T14:36:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/1116098765 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58154570 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/1116098765 >> v2:172.21.15.159:3300/0 conn(0x7fbb580c64b0 0x7fbb580641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/1116098765 >> 172.21.15.115:0/1116098765 conn(0x7fbb580cb730 msgr2=0x7fbb580c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.745+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/1116098765 shutdown_connections 2023-07-27T14:36:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.746+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/1116098765 wait complete. 2023-07-27T14:36:32.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.747+0000 7fbb5d7ff700 1 Processor -- start 2023-07-27T14:36:32.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.747+0000 7fbb5d7ff700 1 -- start start 2023-07-27T14:36:32.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb5d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb5d7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb580c64b0 0x7fbb580c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb5d7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb58154190 0x7fbb5814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb5d7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581532b0 con 0x7fbb580c64b0 2023-07-27T14:36:32.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb5d7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580c52c0 con 0x7fbb58154190 2023-07-27T14:36:32.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb5d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5814fe80 con 0x7fbb580646c0 2023-07-27T14:36:32.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb567fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb580c64b0 0x7fbb580c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb567fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb580c64b0 0x7fbb580c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49846/0 (socket says 172.21.15.115:49846) 2023-07-27T14:36:32.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb567fc700 1 -- 172.21.15.115:0/2900883553 learned_addr learned my addr 172.21.15.115:0/2900883553 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:32.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb56ffd700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.748+0000 7fbb577fe700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb58154190 0x7fbb5814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb567fc700 1 -- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 msgr2=0x7fbb58151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb567fc700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb567fc700 1 -- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb58154190 msgr2=0x7fbb5814f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:32.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb567fc700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb58154190 0x7fbb5814f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:32.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb567fc700 1 -- 172.21.15.115:0/2900883553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009a20 con 0x7fbb580c64b0 2023-07-27T14:36:32.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb577fe700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb58154190 0x7fbb5814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:32.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb567fc700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb580c64b0 0x7fbb580c4dd0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fbb4c00e930 tx=0x7fbb4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb3effd700 1 -- 172.21.15.115:0/2900883553 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00c670 con 0x7fbb580c64b0 2023-07-27T14:36:32.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb3effd700 1 -- 172.21.15.115:0/2900883553 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c00c7d0 con 0x7fbb580c64b0 2023-07-27T14:36:32.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb3effd700 1 -- 172.21.15.115:0/2900883553 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00cb50 con 0x7fbb580c64b0 2023-07-27T14:36:32.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb580b08d0 con 0x7fbb580c64b0 2023-07-27T14:36:32.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.749+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb58152cf0 con 0x7fbb580c64b0 2023-07-27T14:36:32.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.750+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb581514b0 con 0x7fbb580c64b0 2023-07-27T14:36:32.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.751+0000 7fbb3effd700 1 -- 172.21.15.115:0/2900883553 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fbb4c022070 con 0x7fbb580c64b0 2023-07-27T14:36:32.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.752+0000 7fbb3effd700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbb4405f850 0x7fbb44061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:32.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.752+0000 7fbb3effd700 1 -- 172.21.15.115:0/2900883553 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbb4c07acb0 con 0x7fbb580c64b0 2023-07-27T14:36:32.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.752+0000 7fbb56ffd700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbb4405f850 0x7fbb44061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:32.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.753+0000 7fbb56ffd700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbb4405f850 0x7fbb44061d10 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fbb480011e0 tx=0x7fbb48001aa0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:32.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.756+0000 7fbb3effd700 1 -- 172.21.15.115:0/2900883553 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb4c04ba30 con 0x7fbb580c64b0 2023-07-27T14:36:33.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.966+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb5805f0c0 con 0x7fbb580c64b0 2023-07-27T14:36:33.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.967+0000 7fbb3effd700 1 -- 172.21.15.115:0/2900883553 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbb4c04f050 con 0x7fbb580c64b0 2023-07-27T14:36:33.015 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:36:33.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.968+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbb4405f850 msgr2=0x7fbb44061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:33.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.968+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbb4405f850 0x7fbb44061d10 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fbb480011e0 tx=0x7fbb48001aa0).stop 2023-07-27T14:36:33.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.968+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb580c64b0 msgr2=0x7fbb580c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:33.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.968+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb580c64b0 0x7fbb580c4dd0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7fbb4c00e930 tx=0x7fbb4c009060).stop 2023-07-27T14:36:33.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.969+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 shutdown_connections 2023-07-27T14:36:33.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.969+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbb4405f850 0x7fbb44061d10 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:33.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.969+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb58154190 0x7fbb5814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:33.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.969+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb580646c0 0x7fbb58151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:33.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.969+0000 7fbb5d7ff700 1 --2- 172.21.15.115:0/2900883553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb580c64b0 0x7fbb580c4dd0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:33.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.969+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 >> 172.21.15.115:0/2900883553 conn(0x7fbb580cb730 msgr2=0x7fbb580c0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:33.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.969+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 shutdown_connections 2023-07-27T14:36:33.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:32.969+0000 7fbb5d7ff700 1 -- 172.21.15.115:0/2900883553 wait complete. 2023-07-27T14:36:33.031 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:36:33.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:36:33.032 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:36:33.032 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:36:33.032 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:36:33.032 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:36:33.033 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:36:33.033 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:36:33.033 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:36:33.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:33.034 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:36:33.080 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:36:33.081 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:36:33.081 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:36:33.081 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:33.081 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:36:33.081 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:33.081 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:36:33.082 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:33.082 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:36:33.082 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:36:33.082 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:33.083 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:36:33.083 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:36:33.083 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:33.083 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:36:33.083 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:33.083 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:36:33.083 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41408sec preferred_lft 41408sec 2023-07-27T14:36:33.084 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:36:33.084 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:33.084 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:36:33.084 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:33.084 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:36:33.084 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:33.084 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:36:33.084 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:33.085 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:36:33.085 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:36:33.085 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:36:33.086 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:33.086 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:36:33.086 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:36:33.086 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:36:33.086 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:33.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:33.088 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:36:33.194 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:36:33.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:33.198 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:36:33.247 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:36:33.247 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:36:33.247 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:36:33.248 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:36:33.248 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:36:33.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:33.249 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:36:33.249 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:36:33.249 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:36:33.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:36:33.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:36:33.250 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:36:33.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:33.419 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:36:33.465 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:36:33.465 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:36:33.466 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:36:33.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:33.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:36:33.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:33.581 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:36:33.634 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:36:33.634 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:36:33.772 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:36:33.773 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:36:33.799 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:36:33.800 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:36:33.805 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:36:33.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:33.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:36:33.883 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:36:34.052 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.004+0000 7fb19d1ff700 1 Processor -- start 2023-07-27T14:36:34.053 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.004+0000 7fb19d1ff700 1 -- start start 2023-07-27T14:36:34.054 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.005+0000 7fb19d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb1980bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:34.054 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.005+0000 7fb19d1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1980a8f00 0x7fb1980bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:34.054 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.005+0000 7fb19d1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb198064580 con 0x7fb198067dd0 2023-07-27T14:36:34.055 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.005+0000 7fb19d1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19806a140 con 0x7fb1980a8f00 2023-07-27T14:36:34.055 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.005+0000 7fb19d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980bcbc0 con 0x7fb1980a8b20 2023-07-27T14:36:34.055 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb196d9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb1980bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:34.055 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb196d9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb1980bc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:37282/0 (socket says 172.21.15.159:37282) 2023-07-27T14:36:34.055 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb196d9d700 1 -- 172.21.15.159:0/2192373183 learned_addr learned my addr 172.21.15.159:0/2192373183 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:36:34.055 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb19659c700 1 --2- 172.21.15.159:0/2192373183 >> v2:172.21.15.115:3300/0 conn(0x7fb1980a8f00 0x7fb1980bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:34.056 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb196d9d700 1 -- 172.21.15.159:0/2192373183 >> v2:172.21.15.115:3300/0 conn(0x7fb1980a8f00 msgr2=0x7fb1980bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:34.057 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb196d9d700 1 --2- 172.21.15.159:0/2192373183 >> v2:172.21.15.115:3300/0 conn(0x7fb1980a8f00 0x7fb1980bc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.057 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb196d9d700 1 -- 172.21.15.159:0/2192373183 >> v1:172.21.15.115:6789/0 conn(0x7fb198067dd0 legacy=0x7fb198068200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:34.057 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb196d9d700 1 -- 172.21.15.159:0/2192373183 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198063f70 con 0x7fb1980a8b20 2023-07-27T14:36:34.057 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.006+0000 7fb196d9d700 1 --2- 172.21.15.159:0/2192373183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb1980bc1e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb188006fd0 tx=0x7fb1880090f0).ready entity=mon.2 client_cookie=64f3c1a66a8f9bc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:34.057 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb195d9b700 1 -- 172.21.15.159:0/2192373183 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18800b600 con 0x7fb1980a8b20 2023-07-27T14:36:34.058 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb195d9b700 1 -- 172.21.15.159:0/2192373183 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18800b760 con 0x7fb1980a8b20 2023-07-27T14:36:34.058 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb195d9b700 1 -- 172.21.15.159:0/2192373183 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18800bae0 con 0x7fb1980a8b20 2023-07-27T14:36:34.058 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb19d1ff700 1 -- 172.21.15.159:0/2192373183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 msgr2=0x7fb1980bc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:34.058 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/2192373183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb1980bc1e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb188006fd0 tx=0x7fb1880090f0).stop 2023-07-27T14:36:34.058 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb19d1ff700 1 -- 172.21.15.159:0/2192373183 shutdown_connections 2023-07-27T14:36:34.059 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/2192373183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb1980bc1e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.059 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/2192373183 >> v2:172.21.15.115:3300/0 conn(0x7fb1980a8f00 0x7fb1980bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.059 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb19d1ff700 1 -- 172.21.15.159:0/2192373183 >> 172.21.15.159:0/2192373183 conn(0x7fb198062ec0 msgr2=0x7fb1980c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:34.059 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb19d1ff700 1 -- 172.21.15.159:0/2192373183 shutdown_connections 2023-07-27T14:36:34.059 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.007+0000 7fb19d1ff700 1 -- 172.21.15.159:0/2192373183 wait complete. 2023-07-27T14:36:34.061 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.009+0000 7fb19d1ff700 1 Processor -- start 2023-07-27T14:36:34.061 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.009+0000 7fb19d1ff700 1 -- start start 2023-07-27T14:36:34.061 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19d1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb198067dd0 0x7fb1980bed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:34.062 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19d1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb198139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:34.062 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19d1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980a8f00 0x7fb1980ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:34.062 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19d1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198168a60 con 0x7fb1980a8f00 2023-07-27T14:36:34.062 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19d1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980bf210 con 0x7fb198067dd0 2023-07-27T14:36:34.062 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19d1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb198167b70 con 0x7fb1980a8b20 2023-07-27T14:36:34.062 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb196d9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb198067dd0 0x7fb1980bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:34.063 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19659c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb198139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:34.063 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19659c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb198139340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:37286/0 (socket says 172.21.15.159:37286) 2023-07-27T14:36:34.063 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb196d9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb198067dd0 0x7fb1980bed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42748/0 (socket says 172.21.15.159:42748) 2023-07-27T14:36:34.063 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19659c700 1 -- 172.21.15.159:0/1624383101 learned_addr learned my addr 172.21.15.159:0/1624383101 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:36:34.063 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19659c700 1 -- 172.21.15.159:0/1624383101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb198067dd0 msgr2=0x7fb1980bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:34.063 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19659c700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb198067dd0 0x7fb1980bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.063 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19659c700 1 -- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980a8f00 msgr2=0x7fb1980ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:34.064 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19759e700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980a8f00 0x7fb1980ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:34.064 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19659c700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980a8f00 0x7fb1980ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.064 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19659c700 1 -- 172.21.15.159:0/1624383101 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb188009370 con 0x7fb1980a8b20 2023-07-27T14:36:34.064 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.010+0000 7fb19759e700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980a8f00 0x7fb1980ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:34.065 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.011+0000 7fb19659c700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb198139340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fb18c00d5b0 tx=0x7fb18c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:34.065 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.011+0000 7fb17effd700 1 -- 172.21.15.159:0/1624383101 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c011590 con 0x7fb1980a8b20 2023-07-27T14:36:34.065 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.011+0000 7fb17effd700 1 -- 172.21.15.159:0/1624383101 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c0116f0 con 0x7fb1980a8b20 2023-07-27T14:36:34.065 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.011+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb198167e50 con 0x7fb1980a8b20 2023-07-27T14:36:34.065 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.011+0000 7fb17effd700 1 -- 172.21.15.159:0/1624383101 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c011a70 con 0x7fb1980a8b20 2023-07-27T14:36:34.065 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.011+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb198168410 con 0x7fb1980a8b20 2023-07-27T14:36:34.066 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.012+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1980bca30 con 0x7fb1980a8b20 2023-07-27T14:36:34.066 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.013+0000 7fb17effd700 1 -- 172.21.15.159:0/1624383101 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7fb18c012420 con 0x7fb1980a8b20 2023-07-27T14:36:34.066 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.014+0000 7fb17effd700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb18405f880 0x7fb184061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.014+0000 7fb17effd700 1 -- 172.21.15.159:0/1624383101 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb18c07a750 con 0x7fb1980a8b20 2023-07-27T14:36:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.014+0000 7fb196d9d700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb18405f880 0x7fb184061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.015+0000 7fb196d9d700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb18405f880 0x7fb184061d40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fb188009130 tx=0x7fb188017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.019+0000 7fb17effd700 1 -- 172.21.15.159:0/1624383101 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb18c04b090 con 0x7fb1980a8b20 2023-07-27T14:36:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.228+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb19805f0c0 con 0x7fb1980a8b20 2023-07-27T14:36:34.277 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.228+0000 7fb17effd700 1 -- 172.21.15.159:0/1624383101 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb18c04e6b0 con 0x7fb1980a8b20 2023-07-27T14:36:34.277 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:36:34.279 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb18405f880 msgr2=0x7fb184061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:34.280 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb18405f880 0x7fb184061d40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fb188009130 tx=0x7fb188017000).stop 2023-07-27T14:36:34.280 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 msgr2=0x7fb198139340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:34.280 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb198139340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fb18c00d5b0 tx=0x7fb18c008040).stop 2023-07-27T14:36:34.280 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 shutdown_connections 2023-07-27T14:36:34.281 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb18405f880 0x7fb184061d40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.281 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980a8f00 0x7fb1980ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.281 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb198067dd0 0x7fb1980bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.281 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 --2- 172.21.15.159:0/1624383101 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1980a8b20 0x7fb198139340 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:34.281 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 >> 172.21.15.159:0/1624383101 conn(0x7fb198062ec0 msgr2=0x7fb198065aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:34.282 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.230+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 shutdown_connections 2023-07-27T14:36:34.282 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:36:34.231+0000 7fb19d1ff700 1 -- 172.21.15.159:0/1624383101 wait complete. 2023-07-27T14:36:34.293 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:36:34.294 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:36:34.295 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:36:34.295 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:36:34.295 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:36:34.296 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:36:34.297 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:36:34.297 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:36:34.297 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:36:34.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:34.299 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:36:34.349 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:36:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:36:34.349 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:36:34.350 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:34.350 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:36:34.350 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:34.351 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:36:34.351 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:34.351 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:36:34.352 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:36:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:34.352 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:36:34.352 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:36:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:34.353 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:36:34.353 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:36:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41402sec preferred_lft 41402sec 2023-07-27T14:36:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:36:34.354 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:34.355 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:36:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:36:34.355 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:36:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:36:34.356 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:34.357 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:36:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:36:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:36:34.357 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:34.358 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:36:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:36:34.358 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:36:34.359 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:36:34.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:34.360 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:36:34.428 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:36:34.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:34.431 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:36:34.481 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:36:34.481 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:36:34.482 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:36:34.482 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:36:34.482 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:36:34.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:34.483 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:36:34.484 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:36:34.485 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:36:34.485 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:36:34.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:36:34.487 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:36:34.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:34.658 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:36:34.704 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:36:34.705 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:36:34.705 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:36:34.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:34.706 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:36:34.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:34.817 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:36:34.863 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:36:34.863 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:36:35.002 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:36:35.002 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:36:35.027 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:36:35.028 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:36:35.031 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:36:35.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:36:35.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:36:35.102 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:36:35.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.254+0000 7f2d3d7ff700 1 Processor -- start 2023-07-27T14:36:35.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.254+0000 7f2d3d7ff700 1 -- start start 2023-07-27T14:36:35.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d3d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d38063260 0x7f2d38154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d3d7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d381553f0 con 0x7f2d3814b1e0 2023-07-27T14:36:35.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d3d7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d38157a50 con 0x7f2d3814ae00 2023-07-27T14:36:35.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d3d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38157d10 con 0x7f2d38063260 2023-07-27T14:36:35.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d377fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2d3814b1e0 0x7f2d380a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43716/0 (socket says 172.21.15.115:43716) 2023-07-27T14:36:35.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d377fe700 1 -- 172.21.15.115:0/2934491460 learned_addr learned my addr 172.21.15.115:0/2934491460 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:35.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d2ffff700 1 --2- 172.21.15.115:0/2934491460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d38063260 0x7f2d38154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d367fc700 1 -- 172.21.15.115:0/2934491460 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173702007 0 0) 0x7f2d381553f0 con 0x7f2d3814b1e0 2023-07-27T14:36:35.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d367fc700 1 -- 172.21.15.115:0/2934491460 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d240033f0 con 0x7f2d3814b1e0 2023-07-27T14:36:35.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d367fc700 1 -- 172.21.15.115:0/2934491460 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644211692 0 0) 0x7f2d38157a50 con 0x7f2d3814ae00 2023-07-27T14:36:35.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.256+0000 7f2d367fc700 1 -- 172.21.15.115:0/2934491460 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d381553f0 con 0x7f2d3814ae00 2023-07-27T14:36:35.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.257+0000 7f2d2ffff700 1 -- 172.21.15.115:0/2934491460 >> v1:172.21.15.159:6789/0 conn(0x7f2d3814ae00 legacy=0x7f2d38062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.257+0000 7f2d2ffff700 1 -- 172.21.15.115:0/2934491460 >> v1:172.21.15.115:6789/0 conn(0x7f2d3814b1e0 legacy=0x7f2d380a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.257+0000 7f2d2ffff700 1 -- 172.21.15.115:0/2934491460 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d38157ff0 con 0x7f2d38063260 2023-07-27T14:36:35.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.257+0000 7f2d2ffff700 1 --2- 172.21.15.115:0/2934491460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d38063260 0x7f2d38154f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2d20009790 tx=0x7f2d20009060).ready entity=mon.2 client_cookie=78b1299f0b842901 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:35.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.257+0000 7f2d367fc700 1 -- 172.21.15.115:0/2934491460 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000f510 con 0x7f2d38063260 2023-07-27T14:36:35.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.257+0000 7f2d367fc700 1 -- 172.21.15.115:0/2934491460 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000f670 con 0x7f2d38063260 2023-07-27T14:36:35.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.257+0000 7f2d367fc700 1 -- 172.21.15.115:0/2934491460 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000f9f0 con 0x7f2d38063260 2023-07-27T14:36:35.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.258+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/2934491460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d38063260 msgr2=0x7f2d38154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.258+0000 7f2d3d7ff700 1 --2- 172.21.15.115:0/2934491460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d38063260 0x7f2d38154f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2d20009790 tx=0x7f2d20009060).stop 2023-07-27T14:36:35.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.258+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/2934491460 shutdown_connections 2023-07-27T14:36:35.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.258+0000 7f2d3d7ff700 1 --2- 172.21.15.115:0/2934491460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d38063260 0x7f2d38154f00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.258+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/2934491460 >> 172.21.15.115:0/2934491460 conn(0x7f2d3805e940 msgr2=0x7f2d380cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:35.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.258+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/2934491460 shutdown_connections 2023-07-27T14:36:35.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.258+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/2934491460 wait complete. 2023-07-27T14:36:35.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.259+0000 7f2d3d7ff700 1 Processor -- start 2023-07-27T14:36:35.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.259+0000 7f2d3d7ff700 1 -- start start 2023-07-27T14:36:35.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.260+0000 7f2d3d7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d38063260 0x7f2d380adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.260+0000 7f2d3d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d3814ae00 0x7f2d3813e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.260+0000 7f2d3d7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3814b1e0 0x7f2d380c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.260+0000 7f2d3d7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c3070 con 0x7f2d38063260 2023-07-27T14:36:35.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.260+0000 7f2d3d7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c32c0 con 0x7f2d3814b1e0 2023-07-27T14:36:35.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.260+0000 7f2d3d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c35a0 con 0x7f2d3814ae00 2023-07-27T14:36:35.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d38063260 0x7f2d380adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d38063260 0x7f2d380adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37374/0 (socket says 172.21.15.115:37374) 2023-07-27T14:36:35.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 -- 172.21.15.115:0/1193614876 learned_addr learned my addr 172.21.15.115:0/1193614876 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:35.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d377fe700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3814b1e0 0x7f2d380c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d2ffff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d3814ae00 0x7f2d3813e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 -- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d3814ae00 msgr2=0x7f2d3813e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d3814ae00 0x7f2d3813e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 -- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3814b1e0 msgr2=0x7f2d380c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3814b1e0 0x7f2d380c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 -- 172.21.15.115:0/1193614876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d200092a0 con 0x7f2d38063260 2023-07-27T14:36:35.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d2ffff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d3814ae00 0x7f2d3813e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:35.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d36ffd700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d38063260 0x7f2d380adb60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f2d2800c490 tx=0x7f2d28007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:35.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d2effd700 1 -- 172.21.15.115:0/1193614876 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800f470 con 0x7f2d38063260 2023-07-27T14:36:35.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d2effd700 1 -- 172.21.15.115:0/1193614876 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2800f5d0 con 0x7f2d38063260 2023-07-27T14:36:35.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d2effd700 1 -- 172.21.15.115:0/1193614876 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800f970 con 0x7f2d38063260 2023-07-27T14:36:35.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.261+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d380c3880 con 0x7f2d38063260 2023-07-27T14:36:35.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.262+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d380c3e40 con 0x7f2d38063260 2023-07-27T14:36:35.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.263+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3806c470 con 0x7f2d38063260 2023-07-27T14:36:35.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.263+0000 7f2d2effd700 1 -- 172.21.15.115:0/1193614876 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f2d28019030 con 0x7f2d38063260 2023-07-27T14:36:35.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.264+0000 7f2d2effd700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d1805f880 0x7f2d18061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.264+0000 7f2d2effd700 1 -- 172.21.15.115:0/1193614876 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2d28079cd0 con 0x7f2d38063260 2023-07-27T14:36:35.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.265+0000 7f2d2ffff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d1805f880 0x7f2d18061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.265+0000 7f2d2ffff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d1805f880 0x7f2d18061d40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f2d38063660 tx=0x7f2d20017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:35.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.268+0000 7f2d2effd700 1 -- 172.21.15.115:0/1193614876 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d2804ab60 con 0x7f2d38063260 2023-07-27T14:36:35.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.480+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2d380ca2a0 con 0x7f2d38063260 2023-07-27T14:36:35.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.534+0000 7f2d2effd700 1 -- 172.21.15.115:0/1193614876 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 136+0+0 (secure 0 0 0) 0x7f2d2804e180 con 0x7f2d38063260 2023-07-27T14:36:35.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d1805f880 msgr2=0x7f2d18061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d1805f880 0x7f2d18061d40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f2d38063660 tx=0x7f2d20017000).stop 2023-07-27T14:36:35.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d38063260 msgr2=0x7f2d380adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d38063260 0x7f2d380adb60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f2d2800c490 tx=0x7f2d28007c90).stop 2023-07-27T14:36:35.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 shutdown_connections 2023-07-27T14:36:35.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2d1805f880 0x7f2d18061d40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d3814b1e0 0x7f2d380c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d38063260 0x7f2d380adb60 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 --2- 172.21.15.115:0/1193614876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d3814ae00 0x7f2d3813e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 >> 172.21.15.115:0/1193614876 conn(0x7f2d3805e940 msgr2=0x7f2d380a9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:35.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 shutdown_connections 2023-07-27T14:36:35.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.536+0000 7f2d3d7ff700 1 -- 172.21.15.115:0/1193614876 wait complete. 2023-07-27T14:36:35.601 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:36:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.743+0000 7f448d3ff700 1 Processor -- start 2023-07-27T14:36:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.743+0000 7f448d3ff700 1 -- start start 2023-07-27T14:36:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.744+0000 7f448d3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 0x7f44880a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.744+0000 7f448d3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f44880aaa40 0x7f44880c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.744+0000 7f448d3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44880aa4d0 con 0x7f44880aa050 2023-07-27T14:36:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.744+0000 7f448d3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44880c05c0 con 0x7f44880aaa40 2023-07-27T14:36:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.744+0000 7f448d3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44880bfc90 con 0x7f4488153ec0 2023-07-27T14:36:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.744+0000 7f44877fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f44880aaa40 0x7f44880c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.744+0000 7f44877fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f44880aaa40 0x7f44880c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37384/0 (socket says 172.21.15.115:37384) 2023-07-27T14:36:35.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.744+0000 7f44877fe700 1 -- 172.21.15.115:0/376221017 learned_addr learned my addr 172.21.15.115:0/376221017 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:35.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f4486ffd700 1 --2- 172.21.15.115:0/376221017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 0x7f44880a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f44877fe700 1 -- 172.21.15.115:0/376221017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 msgr2=0x7f44880a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:35.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f44877fe700 1 --2- 172.21.15.115:0/376221017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 0x7f44880a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f44877fe700 1 -- 172.21.15.115:0/376221017 >> v1:172.21.15.159:6789/0 conn(0x7f44880aa050 legacy=0x7f44880640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f44877fe700 1 -- 172.21.15.115:0/376221017 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44880bff70 con 0x7f44880aaa40 2023-07-27T14:36:35.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f44877fe700 1 --2- 172.21.15.115:0/376221017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aaa40 0x7f44880c0a50 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f4480009f20 tx=0x7f4480009840).ready entity=mon.0 client_cookie=d46c3da24ad762db server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:35.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f4485ffb700 1 -- 172.21.15.115:0/376221017 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448000e070 con 0x7f44880aaa40 2023-07-27T14:36:35.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f4485ffb700 1 -- 172.21.15.115:0/376221017 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448000ba80 con 0x7f44880aaa40 2023-07-27T14:36:35.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.745+0000 7f4485ffb700 1 -- 172.21.15.115:0/376221017 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448000be00 con 0x7f44880aaa40 2023-07-27T14:36:35.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.746+0000 7f448d3ff700 1 -- 172.21.15.115:0/376221017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aaa40 msgr2=0x7f44880c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.746+0000 7f448d3ff700 1 --2- 172.21.15.115:0/376221017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aaa40 0x7f44880c0a50 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f4480009f20 tx=0x7f4480009840).stop 2023-07-27T14:36:35.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.746+0000 7f448d3ff700 1 -- 172.21.15.115:0/376221017 shutdown_connections 2023-07-27T14:36:35.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.746+0000 7f448d3ff700 1 --2- 172.21.15.115:0/376221017 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 0x7f44880a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.746+0000 7f448d3ff700 1 --2- 172.21.15.115:0/376221017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aaa40 0x7f44880c0a50 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:35.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.746+0000 7f448d3ff700 1 -- 172.21.15.115:0/376221017 >> 172.21.15.115:0/376221017 conn(0x7f44880cb610 msgr2=0x7f44880c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:35.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.746+0000 7f448d3ff700 1 -- 172.21.15.115:0/376221017 shutdown_connections 2023-07-27T14:36:35.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.746+0000 7f448d3ff700 1 -- 172.21.15.115:0/376221017 wait complete. 2023-07-27T14:36:35.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.747+0000 7f448d3ff700 1 Processor -- start 2023-07-27T14:36:35.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.748+0000 7f448d3ff700 1 -- start start 2023-07-27T14:36:35.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.748+0000 7f448d3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aa050 0x7f448814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.748+0000 7f448d3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44880aaa40 0x7f448814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.748+0000 7f448d3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 0x7f4488152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.748+0000 7f448d3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881513b0 con 0x7f44880aa050 2023-07-27T14:36:35.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.748+0000 7f448d3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881507a0 con 0x7f44880aaa40 2023-07-27T14:36:35.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.748+0000 7f448d3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4488150a80 con 0x7f4488153ec0 2023-07-27T14:36:35.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aa050 0x7f448814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aa050 0x7f448814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37400/0 (socket says 172.21.15.115:37400) 2023-07-27T14:36:35.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 -- 172.21.15.115:0/4222769269 learned_addr learned my addr 172.21.15.115:0/4222769269 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:35.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 -- 172.21.15.115:0/4222769269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 msgr2=0x7f4488152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 0x7f4488152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:35.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 -- 172.21.15.115:0/4222769269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44880aaa40 msgr2=0x7f448814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:35.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44880aaa40 0x7f448814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:35.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 -- 172.21.15.115:0/4222769269 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480009ae0 con 0x7f44880aa050 2023-07-27T14:36:35.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f4486ffd700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aa050 0x7f448814ff50 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f447800d860 tx=0x7f4478008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:35.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f446effd700 1 -- 172.21.15.115:0/4222769269 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478011590 con 0x7f44880aa050 2023-07-27T14:36:35.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.749+0000 7f446effd700 1 -- 172.21.15.115:0/4222769269 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44780116f0 con 0x7f44880aa050 2023-07-27T14:36:35.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.750+0000 7f446effd700 1 -- 172.21.15.115:0/4222769269 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478011a70 con 0x7f44880aa050 2023-07-27T14:36:35.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.750+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4488150d60 con 0x7f44880aa050 2023-07-27T14:36:35.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.750+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4488150440 con 0x7f44880aa050 2023-07-27T14:36:35.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.751+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44880a9e90 con 0x7f44880aa050 2023-07-27T14:36:35.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.751+0000 7f446effd700 1 -- 172.21.15.115:0/4222769269 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f4478012420 con 0x7f44880aa050 2023-07-27T14:36:35.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.753+0000 7f446effd700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f447405f850 0x7f4474061d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:35.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.753+0000 7f446effd700 1 -- 172.21.15.115:0/4222769269 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f447807a950 con 0x7f44880aa050 2023-07-27T14:36:35.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.753+0000 7f44867fc700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f447405f850 0x7f4474061d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:35.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.753+0000 7f44867fc700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f447405f850 0x7f4474061d10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f4488161cc0 tx=0x7f447c0079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:35.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.757+0000 7f446effd700 1 -- 172.21.15.115:0/4222769269 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f447804b290 con 0x7f44880aa050 2023-07-27T14:36:35.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.951+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f448806c470 con 0x7f447405f850 2023-07-27T14:36:35.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.952+0000 7f446effd700 1 -- 172.21.15.115:0/4222769269 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f448806c470 con 0x7f447405f850 2023-07-27T14:36:36.000 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:36:36.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:36:36.000 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:36:36.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:36.001 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:36:36.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.954+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f447405f850 msgr2=0x7f4474061d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.954+0000 7f448d3ff700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f447405f850 0x7f4474061d10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f4488161cc0 tx=0x7f447c0079c0).stop 2023-07-27T14:36:36.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.954+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aa050 msgr2=0x7f448814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.954+0000 7f448d3ff700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aa050 0x7f448814ff50 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f447800d860 tx=0x7f4478008040).stop 2023-07-27T14:36:36.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.955+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 shutdown_connections 2023-07-27T14:36:36.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.955+0000 7f448d3ff700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f447405f850 0x7f4474061d10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.955+0000 7f448d3ff700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4488153ec0 0x7f4488152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:36.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.955+0000 7f448d3ff700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44880aa050 0x7f448814ff50 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.955+0000 7f448d3ff700 1 --2- 172.21.15.115:0/4222769269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44880aaa40 0x7f448814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:36:36.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.955+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 >> 172.21.15.115:0/4222769269 conn(0x7f44880cb610 msgr2=0x7f44880c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:36.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.955+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 shutdown_connections 2023-07-27T14:36:36.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:35.955+0000 7f448d3ff700 1 -- 172.21.15.115:0/4222769269 wait complete. 2023-07-27T14:36:36.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:36:36.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.161+0000 7f4b5adff700 1 Processor -- start 2023-07-27T14:36:36.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.162+0000 7f4b5adff700 1 -- start start 2023-07-27T14:36:36.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b5adff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4b5414ae00 0x7f4b54154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b5adff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b5414b1e0 0x7f4b54062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b5adff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b541553f0 con 0x7f4b540c5c50 2023-07-27T14:36:36.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b5adff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b54157a50 con 0x7f4b5414ae00 2023-07-27T14:36:36.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b5adff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54157d10 con 0x7f4b5414b1e0 2023-07-27T14:36:36.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b58b9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4b5414ae00 0x7f4b54154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b53fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b5414b1e0 0x7f4b54062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b5939c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f4b540c5c50 0x7f4b540a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:33980/0 (socket says 172.21.15.115:33980) 2023-07-27T14:36:36.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.163+0000 7f4b5939c700 1 -- 172.21.15.115:0/605210132 learned_addr learned my addr 172.21.15.115:0/605210132 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:36.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.164+0000 7f4b58b9b700 1 -- 172.21.15.115:0/605210132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b5414b1e0 msgr2=0x7f4b54062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:36.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.164+0000 7f4b58b9b700 1 --2- 172.21.15.115:0/605210132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b5414b1e0 0x7f4b54062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.164+0000 7f4b58b9b700 1 -- 172.21.15.115:0/605210132 >> v1:172.21.15.159:6789/0 conn(0x7f4b540c5c50 legacy=0x7f4b540a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.164+0000 7f4b58b9b700 1 -- 172.21.15.115:0/605210132 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b54157ff0 con 0x7f4b5414ae00 2023-07-27T14:36:36.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.164+0000 7f4b58b9b700 1 --2- 172.21.15.115:0/605210132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 0x7f4b54154f00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f4b48009e60 tx=0x7f4b48009780).ready entity=mon.1 client_cookie=1deb633e19d40be9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:36.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.164+0000 7f4b537fe700 1 -- 172.21.15.115:0/605210132 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800e070 con 0x7f4b5414ae00 2023-07-27T14:36:36.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.164+0000 7f4b537fe700 1 -- 172.21.15.115:0/605210132 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4800bb60 con 0x7f4b5414ae00 2023-07-27T14:36:36.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.164+0000 7f4b537fe700 1 -- 172.21.15.115:0/605210132 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48012410 con 0x7f4b5414ae00 2023-07-27T14:36:36.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.165+0000 7f4b5adff700 1 -- 172.21.15.115:0/605210132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 msgr2=0x7f4b54154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.165+0000 7f4b5adff700 1 --2- 172.21.15.115:0/605210132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 0x7f4b54154f00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f4b48009e60 tx=0x7f4b48009780).stop 2023-07-27T14:36:36.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.165+0000 7f4b5adff700 1 -- 172.21.15.115:0/605210132 shutdown_connections 2023-07-27T14:36:36.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.165+0000 7f4b5adff700 1 --2- 172.21.15.115:0/605210132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 0x7f4b54154f00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.165+0000 7f4b5adff700 1 --2- 172.21.15.115:0/605210132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b5414b1e0 0x7f4b54062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.165+0000 7f4b5adff700 1 -- 172.21.15.115:0/605210132 >> 172.21.15.115:0/605210132 conn(0x7f4b5405e940 msgr2=0x7f4b540cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:36.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.165+0000 7f4b5adff700 1 -- 172.21.15.115:0/605210132 shutdown_connections 2023-07-27T14:36:36.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.165+0000 7f4b5adff700 1 -- 172.21.15.115:0/605210132 wait complete. 2023-07-27T14:36:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.166+0000 7f4b5adff700 1 Processor -- start 2023-07-27T14:36:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.167+0000 7f4b5adff700 1 -- start start 2023-07-27T14:36:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.167+0000 7f4b5adff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540c5c50 0x7f4b54149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5adff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 0x7f4b54152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5adff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b5414b1e0 0x7f4b54152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5adff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54152e60 con 0x7f4b5414b1e0 2023-07-27T14:36:36.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5adff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540c1db0 con 0x7f4b5414ae00 2023-07-27T14:36:36.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5adff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540c4990 con 0x7f4b540c5c50 2023-07-27T14:36:36.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5939c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b5414b1e0 0x7f4b54152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b53fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 0x7f4b54152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5939c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b5414b1e0 0x7f4b54152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37412/0 (socket says 172.21.15.115:37412) 2023-07-27T14:36:36.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5939c700 1 -- 172.21.15.115:0/541008388 learned_addr learned my addr 172.21.15.115:0/541008388 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:36.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b58b9b700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540c5c50 0x7f4b54149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5939c700 1 -- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540c5c50 msgr2=0x7f4b54149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5939c700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540c5c50 0x7f4b54149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5939c700 1 -- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 msgr2=0x7f4b54152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5939c700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 0x7f4b54152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b5939c700 1 -- 172.21.15.115:0/541008388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48009a20 con 0x7f4b5414b1e0 2023-07-27T14:36:36.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b53fff700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 0x7f4b54152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:36.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.168+0000 7f4b58b9b700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540c5c50 0x7f4b54149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:36.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.169+0000 7f4b5939c700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b5414b1e0 0x7f4b54152970 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f4b4c00c410 tx=0x7f4b4c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:36.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.169+0000 7f4b50ff9700 1 -- 172.21.15.115:0/541008388 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0070d0 con 0x7f4b5414b1e0 2023-07-27T14:36:36.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.169+0000 7f4b50ff9700 1 -- 172.21.15.115:0/541008388 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c007230 con 0x7f4b5414b1e0 2023-07-27T14:36:36.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.169+0000 7f4b50ff9700 1 -- 172.21.15.115:0/541008388 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0075b0 con 0x7f4b5414b1e0 2023-07-27T14:36:36.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.169+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b540c1fc0 con 0x7f4b5414b1e0 2023-07-27T14:36:36.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.169+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b540c2580 con 0x7f4b5414b1e0 2023-07-27T14:36:36.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.170+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5406c470 con 0x7f4b5414b1e0 2023-07-27T14:36:36.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.171+0000 7f4b50ff9700 1 -- 172.21.15.115:0/541008388 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f4b4c010070 con 0x7f4b5414b1e0 2023-07-27T14:36:36.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.172+0000 7f4b50ff9700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3805f880 0x7f4b38061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.172+0000 7f4b50ff9700 1 -- 172.21.15.115:0/541008388 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4b4c079e90 con 0x7f4b5414b1e0 2023-07-27T14:36:36.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.172+0000 7f4b58b9b700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3805f880 0x7f4b38061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.172+0000 7f4b58b9b700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3805f880 0x7f4b38061d40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f4b48009e60 tx=0x7f4b48009780).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:36.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.175+0000 7f4b50ff9700 1 -- 172.21.15.115:0/541008388 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b4c04ac10 con 0x7f4b5414b1e0 2023-07-27T14:36:36.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.345+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4b54152240 con 0x7f4b5414b1e0 2023-07-27T14:36:36.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.346+0000 7f4b50ff9700 1 -- 172.21.15.115:0/541008388 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b4c04e230 con 0x7f4b5414b1e0 2023-07-27T14:36:36.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3805f880 msgr2=0x7f4b38061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3805f880 0x7f4b38061d40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f4b48009e60 tx=0x7f4b48009780).stop 2023-07-27T14:36:36.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b5414b1e0 msgr2=0x7f4b54152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b5414b1e0 0x7f4b54152970 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f4b4c00c410 tx=0x7f4b4c007d70).stop 2023-07-27T14:36:36.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 shutdown_connections 2023-07-27T14:36:36.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4b3805f880 0x7f4b38061d40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b5414b1e0 0x7f4b54152970 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b540c5c50 0x7f4b54149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 --2- 172.21.15.115:0/541008388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b5414ae00 0x7f4b54152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 >> 172.21.15.115:0/541008388 conn(0x7f4b5405e940 msgr2=0x7f4b540c09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:36.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 shutdown_connections 2023-07-27T14:36:36.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.348+0000 7f4b5adff700 1 -- 172.21.15.115:0/541008388 wait complete. 2023-07-27T14:36:36.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000016345 --mode=777 2023-07-27T14:36:36.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.558+0000 7f099fdff700 1 Processor -- start 2023-07-27T14:36:36.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.558+0000 7f099fdff700 1 -- start start 2023-07-27T14:36:36.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.559+0000 7f099fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a350 0x7f0998065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.559+0000 7f099fdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f09980c36b0 0x7f09981585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.559+0000 7f099fdff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980bd9a0 con 0x7f099813a730 2023-07-27T14:36:36.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.559+0000 7f099fdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0998066400 con 0x7f09980c36b0 2023-07-27T14:36:36.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.559+0000 7f099fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0998158ae0 con 0x7f099813a350 2023-07-27T14:36:36.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.560+0000 7f099db9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a350 0x7f0998065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.560+0000 7f099e39c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f09980c36b0 0x7f09981585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.560+0000 7f099db9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a350 0x7f0998065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:36166/0 (socket says 172.21.15.115:36166) 2023-07-27T14:36:36.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.560+0000 7f099e39c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f09980c36b0 0x7f09981585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:44488/0 (socket says 172.21.15.115:44488) 2023-07-27T14:36:36.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.560+0000 7f099d39a700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f099813a730 0x7f09980c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:33984/0 (socket says 172.21.15.115:33984) 2023-07-27T14:36:36.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.560+0000 7f099db9b700 1 -- 172.21.15.115:0/2910203302 learned_addr learned my addr 172.21.15.115:0/2910203302 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:36.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099db9b700 1 -- 172.21.15.115:0/2910203302 >> v2:172.21.15.159:3300/0 conn(0x7f09980c36b0 msgr2=0x7f09981585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:36.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099db9b700 1 --2- 172.21.15.115:0/2910203302 >> v2:172.21.15.159:3300/0 conn(0x7f09980c36b0 0x7f09981585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099db9b700 1 -- 172.21.15.115:0/2910203302 >> v1:172.21.15.159:6789/0 conn(0x7f099813a730 legacy=0x7f09980c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099db9b700 1 -- 172.21.15.115:0/2910203302 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0998066610 con 0x7f099813a350 2023-07-27T14:36:36.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099cb99700 1 -- 172.21.15.115:0/2910203302 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025747593 0 0) 0x7f09980bd9a0 con 0x7f099813a730 2023-07-27T14:36:36.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099e39c700 1 --2- 172.21.15.115:0/2910203302 >> v2:172.21.15.159:3300/0 conn(0x7f09980c36b0 0x7f09981585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:36.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099db9b700 1 --2- 172.21.15.115:0/2910203302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a350 0x7f0998065f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0994006fd0 tx=0x7f09940090f0).ready entity=mon.2 client_cookie=f2e55640117179c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:36.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099cb99700 1 -- 172.21.15.115:0/2910203302 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400b580 con 0x7f099813a350 2023-07-27T14:36:36.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099cb99700 1 -- 172.21.15.115:0/2910203302 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400b6e0 con 0x7f099813a350 2023-07-27T14:36:36.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.561+0000 7f099cb99700 1 -- 172.21.15.115:0/2910203302 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400ba60 con 0x7f099813a350 2023-07-27T14:36:36.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.562+0000 7f099fdff700 1 -- 172.21.15.115:0/2910203302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a350 msgr2=0x7f0998065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.562+0000 7f099fdff700 1 --2- 172.21.15.115:0/2910203302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a350 0x7f0998065f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0994006fd0 tx=0x7f09940090f0).stop 2023-07-27T14:36:36.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.562+0000 7f099fdff700 1 -- 172.21.15.115:0/2910203302 shutdown_connections 2023-07-27T14:36:36.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.562+0000 7f099fdff700 1 --2- 172.21.15.115:0/2910203302 >> v2:172.21.15.159:3300/0 conn(0x7f09980c36b0 0x7f09981585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.562+0000 7f099fdff700 1 --2- 172.21.15.115:0/2910203302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a350 0x7f0998065f10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.562+0000 7f099fdff700 1 -- 172.21.15.115:0/2910203302 >> 172.21.15.115:0/2910203302 conn(0x7f099805e8f0 msgr2=0x7f09980c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:36.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.562+0000 7f099fdff700 1 -- 172.21.15.115:0/2910203302 shutdown_connections 2023-07-27T14:36:36.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.562+0000 7f099fdff700 1 -- 172.21.15.115:0/2910203302 wait complete. 2023-07-27T14:36:36.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.563+0000 7f099fdff700 1 Processor -- start 2023-07-27T14:36:36.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.563+0000 7f099fdff700 1 -- start start 2023-07-27T14:36:36.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.564+0000 7f099fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c36b0 0x7f09981524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.564+0000 7f099fdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f099813a350 0x7f0998156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.564+0000 7f099fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a730 0x7f0998157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.564+0000 7f099fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0998165730 con 0x7f09980c36b0 2023-07-27T14:36:36.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.564+0000 7f099fdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0998157630 con 0x7f099813a350 2023-07-27T14:36:36.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.564+0000 7f099fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09980c6c60 con 0x7f099813a730 2023-07-27T14:36:36.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c36b0 0x7f09981524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c36b0 0x7f09981524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37414/0 (socket says 172.21.15.115:37414) 2023-07-27T14:36:36.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 -- 172.21.15.115:0/1274522365 learned_addr learned my addr 172.21.15.115:0/1274522365 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:36.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099e39c700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a730 0x7f0998157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099d39a700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f099813a350 0x7f0998156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 -- 172.21.15.115:0/1274522365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a730 msgr2=0x7f0998157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a730 0x7f0998157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 -- 172.21.15.115:0/1274522365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f099813a350 msgr2=0x7f0998156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f099813a350 0x7f0998156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 -- 172.21.15.115:0/1274522365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990009a20 con 0x7f09980c36b0 2023-07-27T14:36:36.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f099db9b700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c36b0 0x7f09981524f0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f0994009130 tx=0x7f0994017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:36.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f098dffb700 1 -- 172.21.15.115:0/1274522365 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400b850 con 0x7f09980c36b0 2023-07-27T14:36:36.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.565+0000 7f098dffb700 1 -- 172.21.15.115:0/1274522365 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400b9b0 con 0x7f09980c36b0 2023-07-27T14:36:36.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.566+0000 7f098dffb700 1 -- 172.21.15.115:0/1274522365 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099401c670 con 0x7f09980c36b0 2023-07-27T14:36:36.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.566+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0994009370 con 0x7f09980c36b0 2023-07-27T14:36:36.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.566+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09980c7220 con 0x7f09980c36b0 2023-07-27T14:36:36.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.566+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099806c470 con 0x7f09980c36b0 2023-07-27T14:36:36.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.567+0000 7f098dffb700 1 -- 172.21.15.115:0/1274522365 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f099402c070 con 0x7f09980c36b0 2023-07-27T14:36:36.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.568+0000 7f098dffb700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097c05f880 0x7f097c061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:36.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.568+0000 7f098dffb700 1 -- 172.21.15.115:0/1274522365 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f099407c570 con 0x7f09980c36b0 2023-07-27T14:36:36.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.568+0000 7f099d39a700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097c05f880 0x7f097c061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:36.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.569+0000 7f099d39a700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097c05f880 0x7f097c061d40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f0998068850 tx=0x7f0988009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:36.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.572+0000 7f098dffb700 1 -- 172.21.15.115:0/1274522365 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f099404d2f0 con 0x7f09980c36b0 2023-07-27T14:36:36.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.771+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000016345", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f09980bdc10 con 0x7f097c05f880 2023-07-27T14:36:36.825 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:36.778+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:36.826 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:36.778+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:36.826 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:36.778+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:36.826 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:36.778+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:36.826 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:36.778+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:36.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.816+0000 7f098dffb700 1 -- 172.21.15.115:0/1274522365 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f09980bdc10 con 0x7f097c05f880 2023-07-27T14:36:36.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097c05f880 msgr2=0x7f097c061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097c05f880 0x7f097c061d40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f0998068850 tx=0x7f0988009040).stop 2023-07-27T14:36:36.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c36b0 msgr2=0x7f09981524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:36.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c36b0 0x7f09981524f0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f0994009130 tx=0x7f0994017000).stop 2023-07-27T14:36:36.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 shutdown_connections 2023-07-27T14:36:36.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097c05f880 0x7f097c061d40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f099813a730 0x7f0998157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09980c36b0 0x7f09981524f0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 --2- 172.21.15.115:0/1274522365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f099813a350 0x7f0998156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:36.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.818+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 >> 172.21.15.115:0/1274522365 conn(0x7f099805e8f0 msgr2=0x7f09980ac630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:36.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.819+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 shutdown_connections 2023-07-27T14:36:36.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:36.819+0000 7f099fdff700 1 -- 172.21.15.115:0/1274522365 wait complete. 2023-07-27T14:36:36.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000016345 2023-07-27T14:36:37.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.027+0000 7f08e95ff700 1 Processor -- start 2023-07-27T14:36:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.027+0000 7f08e95ff700 1 -- start start 2023-07-27T14:36:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e95ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f08e414ae00 0x7f08e4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e95ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08e414b1e0 0x7f08e4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e95ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e41553f0 con 0x7f08e40c5c50 2023-07-27T14:36:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e95ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e4157a50 con 0x7f08e414b1e0 2023-07-27T14:36:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e95ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e4157d10 con 0x7f08e414ae00 2023-07-27T14:36:37.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e27fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08e414b1e0 0x7f08e4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:37.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f08e40c5c50 0x7f08e40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43724/0 (socket says 172.21.15.115:43724) 2023-07-27T14:36:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e37fe700 1 -- 172.21.15.115:0/681013339 learned_addr learned my addr 172.21.15.115:0/681013339 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e2ffd700 1 --2- 172.21.15.115:0/681013339 >> v2:172.21.15.159:3300/0 conn(0x7f08e414ae00 0x7f08e4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e27fc700 1 -- 172.21.15.115:0/681013339 >> v2:172.21.15.159:3300/0 conn(0x7f08e414ae00 msgr2=0x7f08e4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e27fc700 1 --2- 172.21.15.115:0/681013339 >> v2:172.21.15.159:3300/0 conn(0x7f08e414ae00 0x7f08e4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e27fc700 1 -- 172.21.15.115:0/681013339 >> v1:172.21.15.115:6789/0 conn(0x7f08e40c5c50 legacy=0x7f08e40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e27fc700 1 -- 172.21.15.115:0/681013339 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4157ff0 con 0x7f08e414b1e0 2023-07-27T14:36:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.029+0000 7f08e1ffb700 1 -- 172.21.15.115:0/681013339 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400686470 0 0) 0x7f08e41553f0 con 0x7f08e40c5c50 2023-07-27T14:36:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e27fc700 1 --2- 172.21.15.115:0/681013339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e4062b50 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f08e4155580 tx=0x7f08d8009060).ready entity=mon.0 client_cookie=b807a50b9bad61c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e1ffb700 1 -- 172.21.15.115:0/681013339 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800f510 con 0x7f08e414b1e0 2023-07-27T14:36:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e1ffb700 1 -- 172.21.15.115:0/681013339 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800f670 con 0x7f08e414b1e0 2023-07-27T14:36:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e1ffb700 1 -- 172.21.15.115:0/681013339 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800f9f0 con 0x7f08e414b1e0 2023-07-27T14:36:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e95ff700 1 -- 172.21.15.115:0/681013339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 msgr2=0x7f08e4062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e95ff700 1 --2- 172.21.15.115:0/681013339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e4062b50 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f08e4155580 tx=0x7f08d8009060).stop 2023-07-27T14:36:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e95ff700 1 -- 172.21.15.115:0/681013339 shutdown_connections 2023-07-27T14:36:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e95ff700 1 --2- 172.21.15.115:0/681013339 >> v2:172.21.15.159:3300/0 conn(0x7f08e414ae00 0x7f08e4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e95ff700 1 --2- 172.21.15.115:0/681013339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e4062b50 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e95ff700 1 -- 172.21.15.115:0/681013339 >> 172.21.15.115:0/681013339 conn(0x7f08e405e940 msgr2=0x7f08e40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e95ff700 1 -- 172.21.15.115:0/681013339 shutdown_connections 2023-07-27T14:36:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.030+0000 7f08e95ff700 1 -- 172.21.15.115:0/681013339 wait complete. 2023-07-27T14:36:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.032+0000 7f08e95ff700 1 Processor -- start 2023-07-27T14:36:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.032+0000 7f08e95ff700 1 -- start start 2023-07-27T14:36:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e95ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e40c5c50 0x7f08e4137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e95ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08e414ae00 0x7f08e40c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e95ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:37.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e95ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e40ca370 con 0x7f08e414b1e0 2023-07-27T14:36:37.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e95ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e40abd60 con 0x7f08e40c5c50 2023-07-27T14:36:37.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e95ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e41651d0 con 0x7f08e414ae00 2023-07-27T14:36:37.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:37.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e40c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37446/0 (socket says 172.21.15.115:37446) 2023-07-27T14:36:37.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e37fe700 1 -- 172.21.15.115:0/1561435029 learned_addr learned my addr 172.21.15.115:0/1561435029 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:37.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.033+0000 7f08e2ffd700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e40c5c50 0x7f08e4137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:37.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e27fc700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08e414ae00 0x7f08e40c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:37.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e37fe700 1 -- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08e414ae00 msgr2=0x7f08e40c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:37.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e37fe700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08e414ae00 0x7f08e40c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e37fe700 1 -- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e40c5c50 msgr2=0x7f08e4137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:37.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e37fe700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e40c5c50 0x7f08e4137da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e37fe700 1 -- 172.21.15.115:0/1561435029 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80092a0 con 0x7f08e414b1e0 2023-07-27T14:36:37.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e2ffd700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e40c5c50 0x7f08e4137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:37.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e37fe700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e40c9e80 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f08dc00c810 tx=0x7f08dc007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:37.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08caffd700 1 -- 172.21.15.115:0/1561435029 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc005d30 con 0x7f08e414b1e0 2023-07-27T14:36:37.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08caffd700 1 -- 172.21.15.115:0/1561435029 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc007110 con 0x7f08e414b1e0 2023-07-27T14:36:37.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e40aba80 con 0x7f08e414b1e0 2023-07-27T14:36:37.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08caffd700 1 -- 172.21.15.115:0/1561435029 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0074d0 con 0x7f08e414b1e0 2023-07-27T14:36:37.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.034+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e4165750 con 0x7f08e414b1e0 2023-07-27T14:36:37.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.035+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e4165970 con 0x7f08e414b1e0 2023-07-27T14:36:37.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.037+0000 7f08caffd700 1 -- 172.21.15.115:0/1561435029 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 27) v1 ==== 76802+0+0 (secure 0 0 0) 0x7f08dc010030 con 0x7f08e414b1e0 2023-07-27T14:36:37.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.037+0000 7f08caffd700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f08d005f880 0x7f08d0061d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:37.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.037+0000 7f08caffd700 1 -- 172.21.15.115:0/1561435029 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f08dc07a720 con 0x7f08e414b1e0 2023-07-27T14:36:37.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.038+0000 7f08e2ffd700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f08d005f880 0x7f08d0061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:37.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.038+0000 7f08e2ffd700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f08d005f880 0x7f08d0061d40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f08e40ac720 tx=0x7f08d4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:37.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.042+0000 7f08caffd700 1 -- 172.21.15.115:0/1561435029 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f08dc04b5b0 con 0x7f08e414b1e0 2023-07-27T14:36:37.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.239+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000016345", "target": ["mon-mgr", ""]}) v1 -- 0x7f08e406c470 con 0x7f08d005f880 2023-07-27T14:36:37.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.244+0000 7f08caffd700 1 -- 172.21.15.115:0/1561435029 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f08e406c470 con 0x7f08d005f880 2023-07-27T14:36:37.291 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8 2023-07-27T14:36:37.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f08d005f880 msgr2=0x7f08d0061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:37.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f08d005f880 0x7f08d0061d40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f08e40ac720 tx=0x7f08d4008040).stop 2023-07-27T14:36:37.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 msgr2=0x7f08e40c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:37.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e40c9e80 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f08dc00c810 tx=0x7f08dc007f30).stop 2023-07-27T14:36:37.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 shutdown_connections 2023-07-27T14:36:37.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f08d005f880 0x7f08d0061d40 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e414b1e0 0x7f08e40c9e80 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08e40c5c50 0x7f08e4137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 --2- 172.21.15.115:0/1561435029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08e414ae00 0x7f08e40c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:37.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 >> 172.21.15.115:0/1561435029 conn(0x7f08e405e940 msgr2=0x7f08e40a9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:37.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 shutdown_connections 2023-07-27T14:36:37.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:37.246+0000 7f08e95ff700 1 -- 172.21.15.115:0/1561435029 wait complete. 2023-07-27T14:36:37.310 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000016345 with 64 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8 2023-07-27T14:36:37.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.311 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176842 s, 59.3 MB/s 2023-07-27T14:36:37.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.388 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.453 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.454 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176733 s, 59.3 MB/s 2023-07-27T14:36:37.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.455 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.521 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.521 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.521 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179503 s, 58.4 MB/s 2023-07-27T14:36:37.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.522 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.582 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.583 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.583 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01351 s, 77.6 MB/s 2023-07-27T14:36:37.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.584 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.648 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.648 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.648 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169917 s, 61.7 MB/s 2023-07-27T14:36:37.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.650 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.710 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.710 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.710 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140197 s, 74.8 MB/s 2023-07-27T14:36:37.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.712 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.773 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.773 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.773 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125596 s, 83.5 MB/s 2023-07-27T14:36:37.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.775 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.836 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.836 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.837 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146019 s, 71.8 MB/s 2023-07-27T14:36:37.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.838 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.903 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.904 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.904 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177933 s, 58.9 MB/s 2023-07-27T14:36:37.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.905 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:37.968 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:37.968 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:37.969 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016109 s, 65.1 MB/s 2023-07-27T14:36:37.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:37.970 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.031 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.032 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.032 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150703 s, 69.6 MB/s 2023-07-27T14:36:38.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.033 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.095 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.096 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.096 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152534 s, 68.7 MB/s 2023-07-27T14:36:38.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.097 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150433 s, 69.7 MB/s 2023-07-27T14:36:38.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.161 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.222 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.222 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.222 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145976 s, 71.8 MB/s 2023-07-27T14:36:38.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.223 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.283 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.284 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.284 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127757 s, 82.1 MB/s 2023-07-27T14:36:38.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.285 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.346 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.346 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.346 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146201 s, 71.7 MB/s 2023-07-27T14:36:38.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.348 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.413 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.414 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.414 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175882 s, 59.6 MB/s 2023-07-27T14:36:38.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.416 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.477 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.478 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.478 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134746 s, 77.8 MB/s 2023-07-27T14:36:38.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.479 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159016 s, 65.9 MB/s 2023-07-27T14:36:38.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.545 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.608 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.608 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.609 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150756 s, 69.6 MB/s 2023-07-27T14:36:38.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.610 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.672 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.673 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.673 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144585 s, 72.5 MB/s 2023-07-27T14:36:38.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.674 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.739 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.739 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.740 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173276 s, 60.5 MB/s 2023-07-27T14:36:38.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.741 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.801 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.802 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.802 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136435 s, 76.9 MB/s 2023-07-27T14:36:38.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.803 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.865 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.866 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.866 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145785 s, 71.9 MB/s 2023-07-27T14:36:38.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.867 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.929 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.930 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.930 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134679 s, 77.9 MB/s 2023-07-27T14:36:38.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.931 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:38.992 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:38.992 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:38.993 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013912 s, 75.4 MB/s 2023-07-27T14:36:38.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:38.994 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.057 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155077 s, 67.6 MB/s 2023-07-27T14:36:39.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.060 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.121 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.122 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.122 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155668 s, 67.4 MB/s 2023-07-27T14:36:39.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.123 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.190 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.190 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.190 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192009 s, 54.6 MB/s 2023-07-27T14:36:39.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.192 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012854 s, 81.6 MB/s 2023-07-27T14:36:39.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.253 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.312 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.312 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.313 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125091 s, 83.8 MB/s 2023-07-27T14:36:39.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.314 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.377 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.378 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.378 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169227 s, 62.0 MB/s 2023-07-27T14:36:39.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.379 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.440 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146471 s, 71.6 MB/s 2023-07-27T14:36:39.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.442 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.502 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.502 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.502 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01324 s, 79.2 MB/s 2023-07-27T14:36:39.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.504 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.566 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.566 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.566 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150832 s, 69.5 MB/s 2023-07-27T14:36:39.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.568 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.630 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.631 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.631 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150028 s, 69.9 MB/s 2023-07-27T14:36:39.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.632 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.697 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.698 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173861 s, 60.3 MB/s 2023-07-27T14:36:39.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.699 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.762 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.762 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.762 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153836 s, 68.2 MB/s 2023-07-27T14:36:39.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.764 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.824 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.825 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.825 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135574 s, 77.3 MB/s 2023-07-27T14:36:39.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.826 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129764 s, 80.8 MB/s 2023-07-27T14:36:39.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.888 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:39.952 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:39.953 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:39.953 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167456 s, 62.6 MB/s 2023-07-27T14:36:39.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:39.954 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.021 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.022 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.022 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019342 s, 54.2 MB/s 2023-07-27T14:36:40.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.023 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.085 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.086 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.086 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015255 s, 68.7 MB/s 2023-07-27T14:36:40.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.087 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.147 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.147 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.148 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124111 s, 84.5 MB/s 2023-07-27T14:36:40.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.149 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.213 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.214 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.214 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175146 s, 59.9 MB/s 2023-07-27T14:36:40.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.215 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.282 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.282 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.282 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019315 s, 54.3 MB/s 2023-07-27T14:36:40.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.284 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.344 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.345 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.345 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138844 s, 75.5 MB/s 2023-07-27T14:36:40.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.346 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.408 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148528 s, 70.6 MB/s 2023-07-27T14:36:40.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.410 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.470 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.470 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.470 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126627 s, 82.8 MB/s 2023-07-27T14:36:40.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.472 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.534 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.535 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.535 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151632 s, 69.2 MB/s 2023-07-27T14:36:40.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.536 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.599 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.599 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.599 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144049 s, 72.8 MB/s 2023-07-27T14:36:40.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.600 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126655 s, 82.8 MB/s 2023-07-27T14:36:40.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.662 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.727 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.728 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.728 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185856 s, 56.4 MB/s 2023-07-27T14:36:40.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.729 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.789 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.790 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.790 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132286 s, 79.3 MB/s 2023-07-27T14:36:40.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.791 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.853 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.853 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.854 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146708 s, 71.5 MB/s 2023-07-27T14:36:40.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.855 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.917 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.917 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.917 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148623 s, 70.6 MB/s 2023-07-27T14:36:40.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.919 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:40.985 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:40.985 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:40.985 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182285 s, 57.5 MB/s 2023-07-27T14:36:40.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:40.987 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:41.053 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:41.053 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:41.053 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179011 s, 58.6 MB/s 2023-07-27T14:36:41.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:41.054 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:41.119 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185086 s, 56.7 MB/s 2023-07-27T14:36:41.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:41.121 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:41.182 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:41.182 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:41.183 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142742 s, 73.5 MB/s 2023-07-27T14:36:41.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:41.184 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:41.244 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:41.245 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:41.245 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141448 s, 74.1 MB/s 2023-07-27T14:36:41.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:41.246 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:41.309 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:41.309 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:41.309 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151134 s, 69.4 MB/s 2023-07-27T14:36:41.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:41.310 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:41.371 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:41.371 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:41.371 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147338 s, 71.2 MB/s 2023-07-27T14:36:41.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:41.373 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:36:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:36:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:36:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016561 s, 63.3 MB/s 2023-07-27T14:36:41.438 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000016345 snapshot_0000000000060173 2023-07-27T14:36:41.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.582+0000 7fc661dff700 1 Processor -- start 2023-07-27T14:36:41.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.583+0000 7fc661dff700 1 -- start start 2023-07-27T14:36:41.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.584+0000 7fc661dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:41.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.584+0000 7fc661dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc65c14b1e0 0x7fc65c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:41.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.584+0000 7fc661dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c1553f0 con 0x7fc65c0c5c50 2023-07-27T14:36:41.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.584+0000 7fc661dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c157a50 con 0x7fc65c14b1e0 2023-07-27T14:36:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.584+0000 7fc661dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c157d10 con 0x7fc65c14ae00 2023-07-27T14:36:41.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65bfff700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fc65c0c5c50 0x7fc65c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:33988/0 (socket says 172.21.15.115:33988) 2023-07-27T14:36:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65bfff700 1 -- 172.21.15.115:0/4166668889 learned_addr learned my addr 172.21.15.115:0/4166668889 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65affd700 1 --2- 172.21.15.115:0/4166668889 >> v2:172.21.15.159:3300/0 conn(0x7fc65c14b1e0 0x7fc65c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65b7fe700 1 --2- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65a7fc700 1 -- 172.21.15.115:0/4166668889 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397162671 0 0) 0x7fc65c1553f0 con 0x7fc65c0c5c50 2023-07-27T14:36:41.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65a7fc700 1 -- 172.21.15.115:0/4166668889 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6440033f0 con 0x7fc65c0c5c50 2023-07-27T14:36:41.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65affd700 1 -- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 msgr2=0x7fc65c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:41.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65affd700 1 --2- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65affd700 1 -- 172.21.15.115:0/4166668889 >> v1:172.21.15.159:6789/0 conn(0x7fc65c0c5c50 legacy=0x7fc65c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:41.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65affd700 1 -- 172.21.15.115:0/4166668889 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c157ff0 con 0x7fc65c14b1e0 2023-07-27T14:36:41.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65b7fe700 1 --2- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:36:41.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.585+0000 7fc65affd700 1 --2- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 0x7fc65c062b50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fc650009760 tx=0x7fc650009060).ready entity=mon.1 client_cookie=a552988a0df16ca9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:41.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc65a7fc700 1 -- 172.21.15.115:0/4166668889 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000d4a0 con 0x7fc65c14b1e0 2023-07-27T14:36:41.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc65a7fc700 1 -- 172.21.15.115:0/4166668889 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65000d600 con 0x7fc65c14b1e0 2023-07-27T14:36:41.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc65a7fc700 1 -- 172.21.15.115:0/4166668889 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000d980 con 0x7fc65c14b1e0 2023-07-27T14:36:41.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc661dff700 1 -- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 msgr2=0x7fc65c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:41.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc661dff700 1 --2- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 0x7fc65c062b50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fc650009760 tx=0x7fc650009060).stop 2023-07-27T14:36:41.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc661dff700 1 -- 172.21.15.115:0/4166668889 shutdown_connections 2023-07-27T14:36:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc661dff700 1 --2- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc661dff700 1 --2- 172.21.15.115:0/4166668889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 0x7fc65c062b50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc661dff700 1 -- 172.21.15.115:0/4166668889 >> 172.21.15.115:0/4166668889 conn(0x7fc65c05e940 msgr2=0x7fc65c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc661dff700 1 -- 172.21.15.115:0/4166668889 shutdown_connections 2023-07-27T14:36:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.586+0000 7fc661dff700 1 -- 172.21.15.115:0/4166668889 wait complete. 2023-07-27T14:36:41.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.588+0000 7fc661dff700 1 Processor -- start 2023-07-27T14:36:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.588+0000 7fc661dff700 1 -- start start 2023-07-27T14:36:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc661dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc65c0c5c50 0x7fc65c149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc661dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc661dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 0x7fc65c13e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc661dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0af150 con 0x7fc65c0c5c50 2023-07-27T14:36:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc661dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0ae050 con 0x7fc65c14b1e0 2023-07-27T14:36:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc661dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0ae2b0 con 0x7fc65c14ae00 2023-07-27T14:36:41.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc65c0c5c50 0x7fc65c149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc65c0c5c50 0x7fc65c149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37462/0 (socket says 172.21.15.115:37462) 2023-07-27T14:36:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65b7fe700 1 -- 172.21.15.115:0/737280006 learned_addr learned my addr 172.21.15.115:0/737280006 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65bfff700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 0x7fc65c13e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65affd700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65b7fe700 1 -- 172.21.15.115:0/737280006 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 msgr2=0x7fc65c0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65b7fe700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65b7fe700 1 -- 172.21.15.115:0/737280006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 msgr2=0x7fc65c13e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65b7fe700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 0x7fc65c13e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.589+0000 7fc65b7fe700 1 -- 172.21.15.115:0/737280006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0092a0 con 0x7fc65c0c5c50 2023-07-27T14:36:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.590+0000 7fc65b7fe700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc65c0c5c50 0x7fc65c149990 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7fc64c00ea20 tx=0x7fc64c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.590+0000 7fc6437fe700 1 -- 172.21.15.115:0/737280006 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00ee60 con 0x7fc65c0c5c50 2023-07-27T14:36:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.590+0000 7fc6437fe700 1 -- 172.21.15.115:0/737280006 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c00c850 con 0x7fc65c0c5c50 2023-07-27T14:36:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.590+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6500092a0 con 0x7fc65c0c5c50 2023-07-27T14:36:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.590+0000 7fc6437fe700 1 -- 172.21.15.115:0/737280006 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00cbd0 con 0x7fc65c0c5c50 2023-07-27T14:36:41.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.590+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c0ae870 con 0x7fc65c0c5c50 2023-07-27T14:36:41.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.591+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c0af430 con 0x7fc65c0c5c50 2023-07-27T14:36:41.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.592+0000 7fc6437fe700 1 -- 172.21.15.115:0/737280006 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 28) v1 ==== 76842+0+0 (secure 0 0 0) 0x7fc64c022070 con 0x7fc65c0c5c50 2023-07-27T14:36:41.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.593+0000 7fc6437fe700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc64805f8d0 0x7fc648061d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.593+0000 7fc6437fe700 1 -- 172.21.15.115:0/737280006 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc64c07b050 con 0x7fc65c0c5c50 2023-07-27T14:36:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.593+0000 7fc65affd700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc64805f8d0 0x7fc648061d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.593+0000 7fc65affd700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc64805f8d0 0x7fc648061d90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fc65c0c1c00 tx=0x7fc650016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:41.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.597+0000 7fc6437fe700 1 -- 172.21.15.115:0/737280006 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc64c04bab0 con 0x7fc65c0c5c50 2023-07-27T14:36:41.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.802+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000016345", "snap_name": "snapshot_0000000000060173", "target": ["mon-mgr", ""]}) v1 -- 0x7fc65c0af290 con 0x7fc64805f8d0 2023-07-27T14:36:41.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.820+0000 7fc6437fe700 1 -- 172.21.15.115:0/737280006 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc65000de50 con 0x7fc64805f8d0 2023-07-27T14:36:41.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc64805f8d0 msgr2=0x7fc648061d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:41.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc64805f8d0 0x7fc648061d90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fc65c0c1c00 tx=0x7fc650016000).stop 2023-07-27T14:36:41.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc65c0c5c50 msgr2=0x7fc65c149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:41.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc65c0c5c50 0x7fc65c149990 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7fc64c00ea20 tx=0x7fc64c009060).stop 2023-07-27T14:36:41.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 shutdown_connections 2023-07-27T14:36:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc64805f8d0 0x7fc648061d90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc65c14b1e0 0x7fc65c13e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc65c0c5c50 0x7fc65c149990 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 --2- 172.21.15.115:0/737280006 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc65c14ae00 0x7fc65c0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 >> 172.21.15.115:0/737280006 conn(0x7fc65c05e940 msgr2=0x7fc65c156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 shutdown_connections 2023-07-27T14:36:41.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:41.822+0000 7fc661dff700 1 -- 172.21.15.115:0/737280006 wait complete. 2023-07-27T14:36:41.887 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 2 2023-07-27T14:36:42.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.030+0000 7f7432bff700 1 Processor -- start 2023-07-27T14:36:42.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.030+0000 7f7432bff700 1 -- start start 2023-07-27T14:36:42.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.031+0000 7f7432bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f742c14ae00 0x7f742c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f7432bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 0x7f742c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f7432bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f742c0c5c50 0x7f742c063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f7432bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c063530 con 0x7f742c0c5c50 2023-07-27T14:36:42.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f7432bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c1553f0 con 0x7f742c14ae00 2023-07-27T14:36:42.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f7432bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c157a50 con 0x7f742c14b1e0 2023-07-27T14:36:42.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f742c0c5c50 0x7f742c063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f742c0c5c50 0x7f742c063040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37476/0 (socket says 172.21.15.115:37476) 2023-07-27T14:36:42.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 -- 172.21.15.115:0/522136902 learned_addr learned my addr 172.21.15.115:0/522136902 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:42.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743099b700 1 --2- 172.21.15.115:0/522136902 >> v2:172.21.15.159:3300/0 conn(0x7f742c14ae00 0x7f742c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f742bfff700 1 --2- 172.21.15.115:0/522136902 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 0x7f742c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 -- 172.21.15.115:0/522136902 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 msgr2=0x7f742c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:42.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 --2- 172.21.15.115:0/522136902 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 0x7f742c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 -- 172.21.15.115:0/522136902 >> v2:172.21.15.159:3300/0 conn(0x7f742c14ae00 msgr2=0x7f742c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:42.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 --2- 172.21.15.115:0/522136902 >> v2:172.21.15.159:3300/0 conn(0x7f742c14ae00 0x7f742c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 -- 172.21.15.115:0/522136902 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c157d10 con 0x7f742c0c5c50 2023-07-27T14:36:42.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743099b700 1 --2- 172.21.15.115:0/522136902 >> v2:172.21.15.159:3300/0 conn(0x7f742c14ae00 0x7f742c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:42.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.032+0000 7f743119c700 1 --2- 172.21.15.115:0/522136902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c063040 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f742c0caaf0 tx=0x7f7424009840).ready entity=mon.0 client_cookie=886b0c58b645328e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:42.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f742b7fe700 1 -- 172.21.15.115:0/522136902 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400e070 con 0x7f742c0c5c50 2023-07-27T14:36:42.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f742b7fe700 1 -- 172.21.15.115:0/522136902 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400ba50 con 0x7f742c0c5c50 2023-07-27T14:36:42.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f742b7fe700 1 -- 172.21.15.115:0/522136902 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400bdd0 con 0x7f742c0c5c50 2023-07-27T14:36:42.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 -- 172.21.15.115:0/522136902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 msgr2=0x7f742c063040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 --2- 172.21.15.115:0/522136902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c063040 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f742c0caaf0 tx=0x7f7424009840).stop 2023-07-27T14:36:42.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 -- 172.21.15.115:0/522136902 shutdown_connections 2023-07-27T14:36:42.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 --2- 172.21.15.115:0/522136902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c063040 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 --2- 172.21.15.115:0/522136902 >> v2:172.21.15.159:3300/0 conn(0x7f742c14ae00 0x7f742c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 --2- 172.21.15.115:0/522136902 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 0x7f742c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 -- 172.21.15.115:0/522136902 >> 172.21.15.115:0/522136902 conn(0x7f742c05e940 msgr2=0x7f742c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:42.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 -- 172.21.15.115:0/522136902 shutdown_connections 2023-07-27T14:36:42.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.033+0000 7f7432bff700 1 -- 172.21.15.115:0/522136902 wait complete. 2023-07-27T14:36:42.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.035+0000 7f7432bff700 1 Processor -- start 2023-07-27T14:36:42.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.035+0000 7f7432bff700 1 -- start start 2023-07-27T14:36:42.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f7432bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f7432bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c14ae00 0x7f742c0c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f7432bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 0x7f742c155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f7432bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c0afe10 con 0x7f742c0c5c50 2023-07-27T14:36:42.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f7432bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c0c3370 con 0x7f742c14ae00 2023-07-27T14:36:42.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f7432bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c0c2210 con 0x7f742c14b1e0 2023-07-27T14:36:42.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743099b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743099b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c0c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37480/0 (socket says 172.21.15.115:37480) 2023-07-27T14:36:42.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743099b700 1 -- 172.21.15.115:0/1094300264 learned_addr learned my addr 172.21.15.115:0/1094300264 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:42.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743119c700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 0x7f742c155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f742bfff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c14ae00 0x7f742c0c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743099b700 1 -- 172.21.15.115:0/1094300264 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 msgr2=0x7f742c155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743099b700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 0x7f742c155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743099b700 1 -- 172.21.15.115:0/1094300264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c14ae00 msgr2=0x7f742c0c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743099b700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c14ae00 0x7f742c0c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.036+0000 7f743099b700 1 -- 172.21.15.115:0/1094300264 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009ae0 con 0x7f742c0c5c50 2023-07-27T14:36:42.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.037+0000 7f743099b700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c0c1c50 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f742000d860 tx=0x7f7420008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:42.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.037+0000 7f7428ff9700 1 -- 172.21.15.115:0/1094300264 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420011590 con 0x7f742c0c5c50 2023-07-27T14:36:42.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.037+0000 7f7428ff9700 1 -- 172.21.15.115:0/1094300264 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200116f0 con 0x7f742c0c5c50 2023-07-27T14:36:42.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.037+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c0af4e0 con 0x7f742c0c5c50 2023-07-27T14:36:42.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.037+0000 7f7428ff9700 1 -- 172.21.15.115:0/1094300264 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420011a70 con 0x7f742c0c5c50 2023-07-27T14:36:42.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.037+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c0afaa0 con 0x7f742c0c5c50 2023-07-27T14:36:42.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.038+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c06c470 con 0x7f742c0c5c50 2023-07-27T14:36:42.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.039+0000 7f7428ff9700 1 -- 172.21.15.115:0/1094300264 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 28) v1 ==== 76842+0+0 (secure 0 0 0) 0x7f7420012420 con 0x7f742c0c5c50 2023-07-27T14:36:42.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.040+0000 7f7428ff9700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f741005f8d0 0x7f7410061d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.040+0000 7f7428ff9700 1 -- 172.21.15.115:0/1094300264 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f742007aa00 con 0x7f742c0c5c50 2023-07-27T14:36:42.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.040+0000 7f742bfff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f741005f8d0 0x7f7410061d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.041+0000 7f742bfff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f741005f8d0 0x7f7410061d90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f742c0c2140 tx=0x7f7418008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:42.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.044+0000 7f7428ff9700 1 -- 172.21.15.115:0/1094300264 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f742004b2f0 con 0x7f742c0c5c50 2023-07-27T14:36:42.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.215+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f742c06b9c0 con 0x7f742c0c5c50 2023-07-27T14:36:42.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.221+0000 7f7428ff9700 1 -- 172.21.15.115:0/1094300264 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v31)=0 v31) v1 ==== 130+0+0 (secure 0 0 0) 0x7f742004e910 con 0x7f742c0c5c50 2023-07-27T14:36:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.223+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f741005f8d0 msgr2=0x7f7410061d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.223+0000 7f7432bff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f741005f8d0 0x7f7410061d90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f742c0c2140 tx=0x7f7418008040).stop 2023-07-27T14:36:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.223+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 msgr2=0x7f742c0c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.223+0000 7f7432bff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c0c1c50 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f742000d860 tx=0x7f7420008040).stop 2023-07-27T14:36:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.224+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 shutdown_connections 2023-07-27T14:36:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.224+0000 7f7432bff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f741005f8d0 0x7f7410061d90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.224+0000 7f7432bff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f742c14b1e0 0x7f742c155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.224+0000 7f7432bff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f742c0c5c50 0x7f742c0c1c50 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.224+0000 7f7432bff700 1 --2- 172.21.15.115:0/1094300264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c14ae00 0x7f742c0c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.224+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 >> 172.21.15.115:0/1094300264 conn(0x7f742c05e940 msgr2=0x7f742c062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.224+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 shutdown_connections 2023-07-27T14:36:42.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.224+0000 7f7432bff700 1 -- 172.21.15.115:0/1094300264 wait complete. 2023-07-27T14:36:42.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000016345 snapshot_0000000000060173 clone_0000000000769971 2023-07-27T14:36:42.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.436+0000 7f79651ff700 1 Processor -- start 2023-07-27T14:36:42.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.436+0000 7f79651ff700 1 -- start start 2023-07-27T14:36:42.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.437+0000 7f79651ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f796014ae00 0x7f7960154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.437+0000 7f79651ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f796014b1e0 0x7f7960062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.437+0000 7f79651ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79601553f0 con 0x7f79600c5c50 2023-07-27T14:36:42.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.437+0000 7f79651ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7960157a50 con 0x7f796014b1e0 2023-07-27T14:36:42.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.437+0000 7f79651ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7960157d10 con 0x7f796014ae00 2023-07-27T14:36:42.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f796014b1e0 0x7f7960062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f796014b1e0 0x7f7960062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37488/0 (socket says 172.21.15.115:37488) 2023-07-27T14:36:42.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795e59c700 1 -- 172.21.15.115:0/111637910 learned_addr learned my addr 172.21.15.115:0/111637910 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:42.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795ed9d700 1 --2- 172.21.15.115:0/111637910 >> v2:172.21.15.159:3300/0 conn(0x7f796014ae00 0x7f7960154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795e59c700 1 -- 172.21.15.115:0/111637910 >> v2:172.21.15.159:3300/0 conn(0x7f796014ae00 msgr2=0x7f7960154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:42.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795e59c700 1 --2- 172.21.15.115:0/111637910 >> v2:172.21.15.159:3300/0 conn(0x7f796014ae00 0x7f7960154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795e59c700 1 -- 172.21.15.115:0/111637910 >> v1:172.21.15.115:6789/0 conn(0x7f79600c5c50 legacy=0x7f79600a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795dd9b700 1 -- 172.21.15.115:0/111637910 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156394458 0 0) 0x7f79601553f0 con 0x7f79600c5c50 2023-07-27T14:36:42.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795e59c700 1 -- 172.21.15.115:0/111637910 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960157ff0 con 0x7f796014b1e0 2023-07-27T14:36:42.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.438+0000 7f795e59c700 1 --2- 172.21.15.115:0/111637910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960062b50 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f7960155580 tx=0x7f79540090f0).ready entity=mon.0 client_cookie=478e07d6dd12577f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:42.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f795dd9b700 1 -- 172.21.15.115:0/111637910 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400b520 con 0x7f796014b1e0 2023-07-27T14:36:42.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f795dd9b700 1 -- 172.21.15.115:0/111637910 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795400b680 con 0x7f796014b1e0 2023-07-27T14:36:42.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f795dd9b700 1 -- 172.21.15.115:0/111637910 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400ba00 con 0x7f796014b1e0 2023-07-27T14:36:42.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f79651ff700 1 -- 172.21.15.115:0/111637910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 msgr2=0x7f7960062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f79651ff700 1 --2- 172.21.15.115:0/111637910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960062b50 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f7960155580 tx=0x7f79540090f0).stop 2023-07-27T14:36:42.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f79651ff700 1 -- 172.21.15.115:0/111637910 shutdown_connections 2023-07-27T14:36:42.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f79651ff700 1 --2- 172.21.15.115:0/111637910 >> v2:172.21.15.159:3300/0 conn(0x7f796014ae00 0x7f7960154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f79651ff700 1 --2- 172.21.15.115:0/111637910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960062b50 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f79651ff700 1 -- 172.21.15.115:0/111637910 >> 172.21.15.115:0/111637910 conn(0x7f796005e940 msgr2=0x7f79600cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:42.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f79651ff700 1 -- 172.21.15.115:0/111637910 shutdown_connections 2023-07-27T14:36:42.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.439+0000 7f79651ff700 1 -- 172.21.15.115:0/111637910 wait complete. 2023-07-27T14:36:42.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.441+0000 7f79651ff700 1 Processor -- start 2023-07-27T14:36:42.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.441+0000 7f79651ff700 1 -- start start 2023-07-27T14:36:42.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f79651ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79600c5c50 0x7f79600c2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f79651ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f796014ae00 0x7f796014a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f79651ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f79651ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600c2a10 con 0x7f796014b1e0 2023-07-27T14:36:42.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f79651ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600c3210 con 0x7f796014ae00 2023-07-27T14:36:42.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f79651ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7960157790 con 0x7f79600c5c50 2023-07-27T14:36:42.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f795f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f795f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37500/0 (socket says 172.21.15.115:37500) 2023-07-27T14:36:42.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f795f59e700 1 -- 172.21.15.115:0/1953479596 learned_addr learned my addr 172.21.15.115:0/1953479596 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:42.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f795ed9d700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79600c5c50 0x7f79600c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f795e59c700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f796014ae00 0x7f796014a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f795f59e700 1 -- 172.21.15.115:0/1953479596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79600c5c50 msgr2=0x7f79600c2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.442+0000 7f795f59e700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79600c5c50 0x7f79600c2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f795f59e700 1 -- 172.21.15.115:0/1953479596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f796014ae00 msgr2=0x7f796014a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f795f59e700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f796014ae00 0x7f796014a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f795f59e700 1 -- 172.21.15.115:0/1953479596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954009370 con 0x7f796014b1e0 2023-07-27T14:36:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f795f59e700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960156580 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f7958001560 tx=0x7f7958007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f7946ffd700 1 -- 172.21.15.115:0/1953479596 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958010510 con 0x7f796014b1e0 2023-07-27T14:36:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f7946ffd700 1 -- 172.21.15.115:0/1953479596 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958010670 con 0x7f796014b1e0 2023-07-27T14:36:42.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79600aef50 con 0x7f796014b1e0 2023-07-27T14:36:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f7946ffd700 1 -- 172.21.15.115:0/1953479596 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958010a30 con 0x7f796014b1e0 2023-07-27T14:36:42.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.443+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79600c4fa0 con 0x7f796014b1e0 2023-07-27T14:36:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.444+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79600af0e0 con 0x7f796014b1e0 2023-07-27T14:36:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.445+0000 7f7946ffd700 1 -- 172.21.15.115:0/1953479596 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 28) v1 ==== 76842+0+0 (secure 0 0 0) 0x7f7958003020 con 0x7f796014b1e0 2023-07-27T14:36:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.445+0000 7f7946ffd700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f794c05f8d0 0x7f794c061d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.446+0000 7f7946ffd700 1 -- 172.21.15.115:0/1953479596 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f795807aa60 con 0x7f796014b1e0 2023-07-27T14:36:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.446+0000 7f795ed9d700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f794c05f8d0 0x7f794c061d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:42.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.446+0000 7f795ed9d700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f794c05f8d0 0x7f794c061d90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f7950009bc0 tx=0x7f7950008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:42.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.450+0000 7f7946ffd700 1 -- 172.21.15.115:0/1953479596 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f795804b4c0 con 0x7f796014b1e0 2023-07-27T14:36:42.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.658+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000016345", "snap_name": "snapshot_0000000000060173", "target_sub_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7f796006c470 con 0x7f794c05f8d0 2023-07-27T14:36:42.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.742+0000 7f7946ffd700 1 -- 172.21.15.115:0/1953479596 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f796006c470 con 0x7f794c05f8d0 2023-07-27T14:36:42.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f794c05f8d0 msgr2=0x7f794c061d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f794c05f8d0 0x7f794c061d90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f7950009bc0 tx=0x7f7950008040).stop 2023-07-27T14:36:42.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 msgr2=0x7f7960156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960156580 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f7958001560 tx=0x7f7958007f40).stop 2023-07-27T14:36:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 shutdown_connections 2023-07-27T14:36:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f794c05f8d0 0x7f794c061d90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f796014b1e0 0x7f7960156580 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79600c5c50 0x7f79600c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 --2- 172.21.15.115:0/1953479596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f796014ae00 0x7f796014a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 >> 172.21.15.115:0/1953479596 conn(0x7f796005e940 msgr2=0x7f79601523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:42.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 shutdown_connections 2023-07-27T14:36:42.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.745+0000 7f79651ff700 1 -- 172.21.15.115:0/1953479596 wait complete. 2023-07-27T14:36:42.798 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.751+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.798 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.751+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.798 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.751+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.798 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.751+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.798 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.751+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.813 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000769971 2023-07-27T14:36:42.818 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.769+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.818 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.769+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.818 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.769+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.818 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.769+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:42.819 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:36:42.769+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:36:43.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.957+0000 7ff6a51ff700 1 Processor -- start 2023-07-27T14:36:43.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.957+0000 7ff6a51ff700 1 -- start start 2023-07-27T14:36:43.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff6a51ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff6a01509b0 0x7ff6a00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff6a51ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a00c0ea0 con 0x7ff6a0150d90 2023-07-27T14:36:43.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff6a51ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a0068e10 con 0x7ff6a00c3100 2023-07-27T14:36:43.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff6a51ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a0155190 con 0x7ff6a01509b0 2023-07-27T14:36:43.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff69e59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff6a0150d90 0x7ff6a0154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43730/0 (socket says 172.21.15.115:43730) 2023-07-27T14:36:43.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff69e59c700 1 -- 172.21.15.115:0/3225165096 learned_addr learned my addr 172.21.15.115:0/3225165096 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:43.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff69ed9d700 1 --2- 172.21.15.115:0/3225165096 >> v2:172.21.15.159:3300/0 conn(0x7ff6a01509b0 0x7ff6a00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff69dd9b700 1 -- 172.21.15.115:0/3225165096 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289574145 0 0) 0x7ff6a00c0ea0 con 0x7ff6a0150d90 2023-07-27T14:36:43.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.959+0000 7ff69dd9b700 1 -- 172.21.15.115:0/3225165096 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6880033f0 con 0x7ff6a0150d90 2023-07-27T14:36:43.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff69ed9d700 1 -- 172.21.15.115:0/3225165096 >> v1:172.21.15.159:6789/0 conn(0x7ff6a00c3100 legacy=0x7ff6a00c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff69ed9d700 1 -- 172.21.15.115:0/3225165096 >> v1:172.21.15.115:6789/0 conn(0x7ff6a0150d90 legacy=0x7ff6a0154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff69ed9d700 1 -- 172.21.15.115:0/3225165096 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0155470 con 0x7ff6a01509b0 2023-07-27T14:36:43.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff69ed9d700 1 --2- 172.21.15.115:0/3225165096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a01509b0 0x7ff6a00c58d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7ff690009760 tx=0x7ff690009060).ready entity=mon.1 client_cookie=d41a07bd217f5daf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:43.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff69dd9b700 1 -- 172.21.15.115:0/3225165096 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000f510 con 0x7ff6a01509b0 2023-07-27T14:36:43.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff69dd9b700 1 -- 172.21.15.115:0/3225165096 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69000f670 con 0x7ff6a01509b0 2023-07-27T14:36:43.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff69dd9b700 1 -- 172.21.15.115:0/3225165096 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000f9f0 con 0x7ff6a01509b0 2023-07-27T14:36:43.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff6a51ff700 1 -- 172.21.15.115:0/3225165096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a01509b0 msgr2=0x7ff6a00c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.960+0000 7ff6a51ff700 1 --2- 172.21.15.115:0/3225165096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a01509b0 0x7ff6a00c58d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7ff690009760 tx=0x7ff690009060).stop 2023-07-27T14:36:43.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.961+0000 7ff6a51ff700 1 -- 172.21.15.115:0/3225165096 shutdown_connections 2023-07-27T14:36:43.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.961+0000 7ff6a51ff700 1 --2- 172.21.15.115:0/3225165096 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a01509b0 0x7ff6a00c58d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.961+0000 7ff6a51ff700 1 -- 172.21.15.115:0/3225165096 >> 172.21.15.115:0/3225165096 conn(0x7ff6a0062320 msgr2=0x7ff6a0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:43.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.961+0000 7ff6a51ff700 1 -- 172.21.15.115:0/3225165096 shutdown_connections 2023-07-27T14:36:43.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.961+0000 7ff6a51ff700 1 -- 172.21.15.115:0/3225165096 wait complete. 2023-07-27T14:36:43.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.962+0000 7ff6a51ff700 1 Processor -- start 2023-07-27T14:36:43.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.962+0000 7ff6a51ff700 1 -- start start 2023-07-27T14:36:43.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.963+0000 7ff6a51ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6a00c3100 0x7ff6a00a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.963+0000 7ff6a51ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6a01509b0 0x7ff6a00bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.963+0000 7ff6a51ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a0150d90 0x7ff6a014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.963+0000 7ff6a51ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a014eb80 con 0x7ff6a00c3100 2023-07-27T14:36:43.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.963+0000 7ff6a51ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a00bf230 con 0x7ff6a0150d90 2023-07-27T14:36:43.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.963+0000 7ff6a51ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a00bfa90 con 0x7ff6a01509b0 2023-07-27T14:36:43.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.963+0000 7ff69ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6a00c3100 0x7ff6a00a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6a00c3100 0x7ff6a00a8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37538/0 (socket says 172.21.15.115:37538) 2023-07-27T14:36:43.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69ed9d700 1 -- 172.21.15.115:0/1015403255 learned_addr learned my addr 172.21.15.115:0/1015403255 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:43.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69e59c700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6a01509b0 0x7ff6a00bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69f59e700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a0150d90 0x7ff6a014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69ed9d700 1 -- 172.21.15.115:0/1015403255 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6a01509b0 msgr2=0x7ff6a00bff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69ed9d700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6a01509b0 0x7ff6a00bff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69ed9d700 1 -- 172.21.15.115:0/1015403255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a0150d90 msgr2=0x7ff6a014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69ed9d700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a0150d90 0x7ff6a014e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69ed9d700 1 -- 172.21.15.115:0/1015403255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900092a0 con 0x7ff6a00c3100 2023-07-27T14:36:43.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff69ed9d700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6a00c3100 0x7ff6a00a8a60 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7ff690009e00 tx=0x7ff690017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:43.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff686ffd700 1 -- 172.21.15.115:0/1015403255 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000f7e0 con 0x7ff6a00c3100 2023-07-27T14:36:43.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff686ffd700 1 -- 172.21.15.115:0/1015403255 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69000f940 con 0x7ff6a00c3100 2023-07-27T14:36:43.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff686ffd700 1 -- 172.21.15.115:0/1015403255 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69001b660 con 0x7ff6a00c3100 2023-07-27T14:36:43.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.964+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a00a9000 con 0x7ff6a00c3100 2023-07-27T14:36:43.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.965+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a00bf720 con 0x7ff6a00c3100 2023-07-27T14:36:43.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.966+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a00bfd70 con 0x7ff6a00c3100 2023-07-27T14:36:43.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.966+0000 7ff686ffd700 1 -- 172.21.15.115:0/1015403255 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 28) v1 ==== 76842+0+0 (secure 0 0 0) 0x7ff69000f070 con 0x7ff6a00c3100 2023-07-27T14:36:43.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.967+0000 7ff686ffd700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff68c05f8d0 0x7ff68c061d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.967+0000 7ff686ffd700 1 -- 172.21.15.115:0/1015403255 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff69007c5d0 con 0x7ff6a00c3100 2023-07-27T14:36:43.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.967+0000 7ff69e59c700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff68c05f8d0 0x7ff68c061d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.968+0000 7ff69e59c700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff68c05f8d0 0x7ff68c061d90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7ff694007fd0 tx=0x7ff694009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:43.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:42.971+0000 7ff686ffd700 1 -- 172.21.15.115:0/1015403255 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff69004cf20 con 0x7ff6a00c3100 2023-07-27T14:36:43.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.183+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6a006c470 con 0x7ff68c05f8d0 2023-07-27T14:36:43.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.190+0000 7ff686ffd700 1 -- 172.21.15.115:0/1015403255 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7ff6a006c470 con 0x7ff68c05f8d0 2023-07-27T14:36:43.238 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:36:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:36:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:36:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:36:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:36:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000016345", 2023-07-27T14:36:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000060173" 2023-07-27T14:36:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:43.239 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:36:43.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff68c05f8d0 msgr2=0x7ff68c061d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff68c05f8d0 0x7ff68c061d90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7ff694007fd0 tx=0x7ff694009040).stop 2023-07-27T14:36:43.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6a00c3100 msgr2=0x7ff6a00a8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6a00c3100 0x7ff6a00a8a60 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7ff690009e00 tx=0x7ff690017000).stop 2023-07-27T14:36:43.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 shutdown_connections 2023-07-27T14:36:43.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff68c05f8d0 0x7ff68c061d90 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a0150d90 0x7ff6a014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6a00c3100 0x7ff6a00a8a60 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 --2- 172.21.15.115:0/1015403255 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6a01509b0 0x7ff6a00bff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 >> 172.21.15.115:0/1015403255 conn(0x7ff6a0062320 msgr2=0x7ff6a014fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:43.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 shutdown_connections 2023-07-27T14:36:43.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.193+0000 7ff6a51ff700 1 -- 172.21.15.115:0/1015403255 wait complete. 2023-07-27T14:36:43.257 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000769971 2023-07-27T14:36:43.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.400+0000 7f92011ff700 1 Processor -- start 2023-07-27T14:36:43.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.400+0000 7f92011ff700 1 -- start start 2023-07-27T14:36:43.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.401+0000 7f92011ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f91fc13a350 0x7f91fc065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.401+0000 7f92011ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.401+0000 7f92011ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc0bd9a0 con 0x7f91fc0c2fa0 2023-07-27T14:36:43.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.401+0000 7f92011ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc066400 con 0x7f91fc13a350 2023-07-27T14:36:43.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.401+0000 7f92011ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc158ae0 con 0x7f91fc13a730 2023-07-27T14:36:43.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.401+0000 7f91fad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f91fc13a350 0x7f91fc065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f91fc13a350 0x7f91fc065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37546/0 (socket says 172.21.15.115:37546) 2023-07-27T14:36:43.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fad9d700 1 -- 172.21.15.115:0/2270460074 learned_addr learned my addr 172.21.15.115:0/2270460074 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:43.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fad9d700 1 -- 172.21.15.115:0/2270460074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 msgr2=0x7f91fc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:43.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fa59c700 1 --2- 172.21.15.115:0/2270460074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fad9d700 1 --2- 172.21.15.115:0/2270460074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fad9d700 1 -- 172.21.15.115:0/2270460074 >> v1:172.21.15.159:6789/0 conn(0x7f91fc0c2fa0 legacy=0x7f91fc067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:43.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fad9d700 1 -- 172.21.15.115:0/2270460074 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc066610 con 0x7f91fc13a350 2023-07-27T14:36:43.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fa59c700 1 --2- 172.21.15.115:0/2270460074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:43.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91fad9d700 1 --2- 172.21.15.115:0/2270460074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc065f10 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f91ec006fd0 tx=0x7f91ec0090f0).ready entity=mon.0 client_cookie=1eb3b802571cd95e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:43.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91f9d9b700 1 -- 172.21.15.115:0/2270460074 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00b600 con 0x7f91fc13a350 2023-07-27T14:36:43.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91f9d9b700 1 -- 172.21.15.115:0/2270460074 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec00b760 con 0x7f91fc13a350 2023-07-27T14:36:43.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.402+0000 7f91f9d9b700 1 -- 172.21.15.115:0/2270460074 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00bae0 con 0x7f91fc13a350 2023-07-27T14:36:43.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.403+0000 7f92011ff700 1 -- 172.21.15.115:0/2270460074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 msgr2=0x7f91fc065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.403+0000 7f92011ff700 1 --2- 172.21.15.115:0/2270460074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc065f10 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f91ec006fd0 tx=0x7f91ec0090f0).stop 2023-07-27T14:36:43.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.403+0000 7f92011ff700 1 -- 172.21.15.115:0/2270460074 shutdown_connections 2023-07-27T14:36:43.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.403+0000 7f92011ff700 1 --2- 172.21.15.115:0/2270460074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc065f10 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.403+0000 7f92011ff700 1 --2- 172.21.15.115:0/2270460074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.403+0000 7f92011ff700 1 -- 172.21.15.115:0/2270460074 >> 172.21.15.115:0/2270460074 conn(0x7f91fc05e8f0 msgr2=0x7f91fc0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:43.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.403+0000 7f92011ff700 1 -- 172.21.15.115:0/2270460074 shutdown_connections 2023-07-27T14:36:43.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.403+0000 7f92011ff700 1 -- 172.21.15.115:0/2270460074 wait complete. 2023-07-27T14:36:43.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.404+0000 7f92011ff700 1 Processor -- start 2023-07-27T14:36:43.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.405+0000 7f92011ff700 1 -- start start 2023-07-27T14:36:43.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.405+0000 7f92011ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91fc0c2fa0 0x7f91fc1392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.405+0000 7f92011ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc0c0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.405+0000 7f92011ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f92011ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc156540 con 0x7f91fc13a350 2023-07-27T14:36:43.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f92011ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc155930 con 0x7f91fc0c2fa0 2023-07-27T14:36:43.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f92011ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc155c10 con 0x7f91fc13a730 2023-07-27T14:36:43.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc0c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc0c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37562/0 (socket says 172.21.15.115:37562) 2023-07-27T14:36:43.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 -- 172.21.15.115:0/359176247 learned_addr learned my addr 172.21.15.115:0/359176247 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:43.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fad9d700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91fc0c2fa0 0x7f91fc1392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fb59e700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 -- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 msgr2=0x7f91fc0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc0a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 -- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91fc0c2fa0 msgr2=0x7f91fc1392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91fc0c2fa0 0x7f91fc1392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 -- 172.21.15.115:0/359176247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009370 con 0x7f91fc13a350 2023-07-27T14:36:43.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fb59e700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:43.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91fa59c700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc0c0610 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f91f000c880 tx=0x7f91f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:43.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.406+0000 7f91e2ffd700 1 -- 172.21.15.115:0/359176247 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0010580 con 0x7f91fc13a350 2023-07-27T14:36:43.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.407+0000 7f91e2ffd700 1 -- 172.21.15.115:0/359176247 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f00106e0 con 0x7f91fc13a350 2023-07-27T14:36:43.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.407+0000 7f91e2ffd700 1 -- 172.21.15.115:0/359176247 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0010a60 con 0x7f91fc13a350 2023-07-27T14:36:43.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.407+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc155ef0 con 0x7f91fc13a350 2023-07-27T14:36:43.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.407+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc1397c0 con 0x7f91fc13a350 2023-07-27T14:36:43.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.408+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc06c470 con 0x7f91fc13a350 2023-07-27T14:36:43.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.409+0000 7f91e2ffd700 1 -- 172.21.15.115:0/359176247 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 28) v1 ==== 76842+0+0 (secure 0 0 0) 0x7f91f001b460 con 0x7f91fc13a350 2023-07-27T14:36:43.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.410+0000 7f91e2ffd700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91e805f8d0 0x7f91e8061d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:43.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.410+0000 7f91e2ffd700 1 -- 172.21.15.115:0/359176247 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f91f007af40 con 0x7f91fc13a350 2023-07-27T14:36:43.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.410+0000 7f91fad9d700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91e805f8d0 0x7f91e8061d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:43.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.410+0000 7f91fad9d700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91e805f8d0 0x7f91e8061d90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f91ec009130 tx=0x7f91ec017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:43.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.414+0000 7f91e2ffd700 1 -- 172.21.15.115:0/359176247 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91f004b830 con 0x7f91fc13a350 2023-07-27T14:36:43.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.624+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7f91fc0bdc10 con 0x7f91e805f8d0 2023-07-27T14:36:43.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.631+0000 7f91e2ffd700 1 -- 172.21.15.115:0/359176247 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f91fc0bdc10 con 0x7f91e805f8d0 2023-07-27T14:36:43.678 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:36:43.678 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:36:43.679 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:36:43.679 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:36:43.679 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:36:43.679 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000016345", 2023-07-27T14:36:43.679 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000060173" 2023-07-27T14:36:43.679 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:43.679 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:43.680 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:36:43.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91e805f8d0 msgr2=0x7f91e8061d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91e805f8d0 0x7f91e8061d90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f91ec009130 tx=0x7f91ec017000).stop 2023-07-27T14:36:43.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 msgr2=0x7f91fc0c0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:43.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc0c0610 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f91f000c880 tx=0x7f91f0008040).stop 2023-07-27T14:36:43.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 shutdown_connections 2023-07-27T14:36:43.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f91e805f8d0 0x7f91e8061d90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f91fc13a730 0x7f91fc0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91fc0c2fa0 0x7f91fc1392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 --2- 172.21.15.115:0/359176247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91fc13a350 0x7f91fc0c0610 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:43.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 >> 172.21.15.115:0/359176247 conn(0x7f91fc05e8f0 msgr2=0x7f91fc0ac2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:43.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 shutdown_connections 2023-07-27T14:36:43.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:43.633+0000 7f92011ff700 1 -- 172.21.15.115:0/359176247 wait complete. 2023-07-27T14:36:44.697 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000769971 2023-07-27T14:36:44.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.856+0000 7fd1f73ff700 1 Processor -- start 2023-07-27T14:36:44.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.856+0000 7fd1f73ff700 1 -- start start 2023-07-27T14:36:44.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f73ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1f014ae00 0x7fd1f0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:44.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f73ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd1f014b1e0 0x7fd1f0062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:44.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:44.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f73ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f0063530 con 0x7fd1f014ae00 2023-07-27T14:36:44.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f73ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f01553f0 con 0x7fd1f014b1e0 2023-07-27T14:36:44.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0157a50 con 0x7fd1f00c5c50 2023-07-27T14:36:44.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f519b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1f014ae00 0x7fd1f0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:44.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f519b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1f014ae00 0x7fd1f0154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44888/0 (socket says 172.21.15.115:44888) 2023-07-27T14:36:44.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f519b700 1 -- 172.21.15.115:0/2023719840 learned_addr learned my addr 172.21.15.115:0/2023719840 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:44.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f499a700 1 --2- 172.21.15.115:0/2023719840 >> v2:172.21.15.159:3300/0 conn(0x7fd1f014b1e0 0x7fd1f0062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:44.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f599c700 1 --2- 172.21.15.115:0/2023719840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:44.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f519b700 1 -- 172.21.15.115:0/2023719840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 msgr2=0x7fd1f0063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:44.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f519b700 1 --2- 172.21.15.115:0/2023719840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:44.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f519b700 1 -- 172.21.15.115:0/2023719840 >> v2:172.21.15.159:3300/0 conn(0x7fd1f014b1e0 msgr2=0x7fd1f0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:44.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f519b700 1 --2- 172.21.15.115:0/2023719840 >> v2:172.21.15.159:3300/0 conn(0x7fd1f014b1e0 0x7fd1f0062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:44.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f519b700 1 -- 172.21.15.115:0/2023719840 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0157d10 con 0x7fd1f014ae00 2023-07-27T14:36:44.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f499a700 1 --2- 172.21.15.115:0/2023719840 >> v2:172.21.15.159:3300/0 conn(0x7fd1f014b1e0 0x7fd1f0062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:44.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.858+0000 7fd1f599c700 1 --2- 172.21.15.115:0/2023719840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:44.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1f519b700 1 --2- 172.21.15.115:0/2023719840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014ae00 0x7fd1f0154f00 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fd1f00cbc00 tx=0x7fd1ec0090f0).ready entity=mon.0 client_cookie=6617e8373ebef5dd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:44.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1e7fff700 1 -- 172.21.15.115:0/2023719840 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00b600 con 0x7fd1f014ae00 2023-07-27T14:36:44.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1e7fff700 1 -- 172.21.15.115:0/2023719840 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec00b760 con 0x7fd1f014ae00 2023-07-27T14:36:44.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1e7fff700 1 -- 172.21.15.115:0/2023719840 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec00bae0 con 0x7fd1f014ae00 2023-07-27T14:36:44.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1f73ff700 1 -- 172.21.15.115:0/2023719840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014ae00 msgr2=0x7fd1f0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:44.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/2023719840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014ae00 0x7fd1f0154f00 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fd1f00cbc00 tx=0x7fd1ec0090f0).stop 2023-07-27T14:36:44.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1f73ff700 1 -- 172.21.15.115:0/2023719840 shutdown_connections 2023-07-27T14:36:44.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/2023719840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:44.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.859+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/2023719840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014ae00 0x7fd1f0154f00 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:44.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.860+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/2023719840 >> v2:172.21.15.159:3300/0 conn(0x7fd1f014b1e0 0x7fd1f0062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:44.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.860+0000 7fd1f73ff700 1 -- 172.21.15.115:0/2023719840 >> 172.21.15.115:0/2023719840 conn(0x7fd1f005e940 msgr2=0x7fd1f00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:44.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.860+0000 7fd1f73ff700 1 -- 172.21.15.115:0/2023719840 shutdown_connections 2023-07-27T14:36:44.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.860+0000 7fd1f73ff700 1 -- 172.21.15.115:0/2023719840 wait complete. 2023-07-27T14:36:44.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.861+0000 7fd1f73ff700 1 Processor -- start 2023-07-27T14:36:44.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.861+0000 7fd1f73ff700 1 -- start start 2023-07-27T14:36:44.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f73ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0167370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:44.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f73ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f014ae00 0x7fd1f00ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:44.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f73ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014b1e0 0x7fd1f0156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:44.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f73ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00c1fc0 con 0x7fd1f014b1e0 2023-07-27T14:36:44.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f73ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0167ba0 con 0x7fd1f014ae00 2023-07-27T14:36:44.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f73ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0167e80 con 0x7fd1f00c5c50 2023-07-27T14:36:44.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f519b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0167370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f599c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014b1e0 0x7fd1f0156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f519b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0167370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:48964/0 (socket says 172.21.15.115:48964) 2023-07-27T14:36:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f519b700 1 -- 172.21.15.115:0/3106214490 learned_addr learned my addr 172.21.15.115:0/3106214490 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.862+0000 7fd1f499a700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f014ae00 0x7fd1f00ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1f599c700 1 -- 172.21.15.115:0/3106214490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 msgr2=0x7fd1f0167370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1f599c700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0167370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1f599c700 1 -- 172.21.15.115:0/3106214490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f014ae00 msgr2=0x7fd1f00ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1f599c700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f014ae00 0x7fd1f00ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:44.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1f599c700 1 -- 172.21.15.115:0/3106214490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec009370 con 0x7fd1f014b1e0 2023-07-27T14:36:44.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1f599c700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014b1e0 0x7fd1f0156560 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7fd1e800cf00 tx=0x7fd1e8007840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:44.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1e57fa700 1 -- 172.21.15.115:0/3106214490 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8016470 con 0x7fd1f014b1e0 2023-07-27T14:36:44.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f0168160 con 0x7fd1f014b1e0 2023-07-27T14:36:44.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1e57fa700 1 -- 172.21.15.115:0/3106214490 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e80165d0 con 0x7fd1f014b1e0 2023-07-27T14:36:44.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1e57fa700 1 -- 172.21.15.115:0/3106214490 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8016950 con 0x7fd1f014b1e0 2023-07-27T14:36:44.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.863+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f0167860 con 0x7fd1f014b1e0 2023-07-27T14:36:44.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.864+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f006c470 con 0x7fd1f014b1e0 2023-07-27T14:36:44.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.865+0000 7fd1e57fa700 1 -- 172.21.15.115:0/3106214490 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7fd1e800d440 con 0x7fd1f014b1e0 2023-07-27T14:36:44.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.866+0000 7fd1e57fa700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd1d405f960 0x7fd1d4061e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:44.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.866+0000 7fd1e57fa700 1 -- 172.21.15.115:0/3106214490 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd1e807bf90 con 0x7fd1f014b1e0 2023-07-27T14:36:44.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.866+0000 7fd1f519b700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd1d405f960 0x7fd1d4061e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:44.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.867+0000 7fd1f519b700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd1d405f960 0x7fd1d4061e20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fd1ec00b3c0 tx=0x7fd1ec017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:44.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:44.870+0000 7fd1e57fa700 1 -- 172.21.15.115:0/3106214490 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd1e804c7f0 con 0x7fd1f014b1e0 2023-07-27T14:36:45.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:45.079+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1f00c2100 con 0x7fd1d405f960 2023-07-27T14:36:46.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.065+0000 7fd1e57fa700 1 -- 172.21.15.115:0/3106214490 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fd1f00c2100 con 0x7fd1d405f960 2023-07-27T14:36:46.114 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:36:46.115 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:36:46.115 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:36:46.115 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:36:46.115 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:36:46.115 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000016345", 2023-07-27T14:36:46.116 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000060173" 2023-07-27T14:36:46.116 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:46.116 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:46.116 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:36:46.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.068+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd1d405f960 msgr2=0x7fd1d4061e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:46.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.068+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd1d405f960 0x7fd1d4061e20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fd1ec00b3c0 tx=0x7fd1ec017000).stop 2023-07-27T14:36:46.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.068+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014b1e0 msgr2=0x7fd1f0156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:46.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.068+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014b1e0 0x7fd1f0156560 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7fd1e800cf00 tx=0x7fd1e8007840).stop 2023-07-27T14:36:46.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.069+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 shutdown_connections 2023-07-27T14:36:46.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.069+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd1d405f960 0x7fd1d4061e20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:46.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.069+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f014b1e0 0x7fd1f0156560 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:46.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.069+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1f00c5c50 0x7fd1f0167370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:46.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.069+0000 7fd1f73ff700 1 --2- 172.21.15.115:0/3106214490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1f014ae00 0x7fd1f00ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:46.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.069+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 >> 172.21.15.115:0/3106214490 conn(0x7fd1f005e940 msgr2=0x7fd1f00c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:46.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.069+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 shutdown_connections 2023-07-27T14:36:46.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:46.069+0000 7fd1f73ff700 1 -- 172.21.15.115:0/3106214490 wait complete. 2023-07-27T14:36:47.140 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000769971 2023-07-27T14:36:47.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.306+0000 7f2d159ff700 1 Processor -- start 2023-07-27T14:36:47.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.306+0000 7f2d159ff700 1 -- start start 2023-07-27T14:36:47.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.307+0000 7f2d159ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2d10153e00 0x7f2d100c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:47.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.307+0000 7f2d159ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d10064a80 con 0x7f2d10064230 2023-07-27T14:36:47.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.307+0000 7f2d159ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d10064d60 con 0x7f2d10065de0 2023-07-27T14:36:47.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.307+0000 7f2d159ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d10062320 con 0x7f2d10153e00 2023-07-27T14:36:47.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.307+0000 7f2d0e7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2d10064230 0x7f2d100656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49504/0 (socket says 172.21.15.115:49504) 2023-07-27T14:36:47.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.307+0000 7f2d0e7fc700 1 -- 172.21.15.115:0/2740696745 learned_addr learned my addr 172.21.15.115:0/2740696745 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:47.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0effd700 1 --2- 172.21.15.115:0/2740696745 >> v2:172.21.15.159:3300/0 conn(0x7f2d10153e00 0x7f2d100c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:47.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0dffb700 1 -- 172.21.15.115:0/2740696745 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731434723 0 0) 0x7f2d10064a80 con 0x7f2d10064230 2023-07-27T14:36:47.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0dffb700 1 -- 172.21.15.115:0/2740696745 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf80033f0 con 0x7f2d10064230 2023-07-27T14:36:47.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0dffb700 1 -- 172.21.15.115:0/2740696745 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661197972 0 0) 0x7f2d10064d60 con 0x7f2d10065de0 2023-07-27T14:36:47.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0dffb700 1 -- 172.21.15.115:0/2740696745 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d10064a80 con 0x7f2d10065de0 2023-07-27T14:36:47.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0effd700 1 -- 172.21.15.115:0/2740696745 >> v1:172.21.15.159:6789/0 conn(0x7f2d10065de0 legacy=0x7f2d10062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:47.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0effd700 1 -- 172.21.15.115:0/2740696745 >> v1:172.21.15.115:6789/0 conn(0x7f2d10064230 legacy=0x7f2d100656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:47.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0effd700 1 -- 172.21.15.115:0/2740696745 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10065040 con 0x7f2d10153e00 2023-07-27T14:36:47.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0effd700 1 --2- 172.21.15.115:0/2740696745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10153e00 0x7f2d100c6b70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f2d00009760 tx=0x7f2d00009060).ready entity=mon.1 client_cookie=6d27b904e12ac2a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:47.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0dffb700 1 -- 172.21.15.115:0/2740696745 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000d4a0 con 0x7f2d10153e00 2023-07-27T14:36:47.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0dffb700 1 -- 172.21.15.115:0/2740696745 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0000d600 con 0x7f2d10153e00 2023-07-27T14:36:47.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.308+0000 7f2d0dffb700 1 -- 172.21.15.115:0/2740696745 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000d980 con 0x7f2d10153e00 2023-07-27T14:36:47.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.309+0000 7f2d159ff700 1 -- 172.21.15.115:0/2740696745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10153e00 msgr2=0x7f2d100c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:47.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.309+0000 7f2d159ff700 1 --2- 172.21.15.115:0/2740696745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10153e00 0x7f2d100c6b70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f2d00009760 tx=0x7f2d00009060).stop 2023-07-27T14:36:47.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.309+0000 7f2d159ff700 1 -- 172.21.15.115:0/2740696745 shutdown_connections 2023-07-27T14:36:47.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.309+0000 7f2d159ff700 1 --2- 172.21.15.115:0/2740696745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10153e00 0x7f2d100c6b70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:47.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.309+0000 7f2d159ff700 1 -- 172.21.15.115:0/2740696745 >> 172.21.15.115:0/2740696745 conn(0x7f2d100c7b90 msgr2=0x7f2d100c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:47.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.309+0000 7f2d159ff700 1 -- 172.21.15.115:0/2740696745 shutdown_connections 2023-07-27T14:36:47.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.309+0000 7f2d159ff700 1 -- 172.21.15.115:0/2740696745 wait complete. 2023-07-27T14:36:47.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.311+0000 7f2d159ff700 1 Processor -- start 2023-07-27T14:36:47.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.311+0000 7f2d159ff700 1 -- start start 2023-07-27T14:36:47.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d159ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10064230 0x7f2d10156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:47.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d159ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d10065de0 0x7f2d10165330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:47.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d159ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10153e00 0x7f2d10093cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:47.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d159ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10164720 con 0x7f2d10153e00 2023-07-27T14:36:47.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d159ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10164a00 con 0x7f2d10064230 2023-07-27T14:36:47.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d159ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10164ce0 con 0x7f2d10065de0 2023-07-27T14:36:47.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10064230 0x7f2d10156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:47.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d0f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10153e00 0x7f2d10093cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:47.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10064230 0x7f2d10156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:44432/0 (socket says 172.21.15.115:44432) 2023-07-27T14:36:47.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d0effd700 1 -- 172.21.15.115:0/1479194782 learned_addr learned my addr 172.21.15.115:0/1479194782 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:47.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.312+0000 7f2d0e7fc700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d10065de0 0x7f2d10165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:47.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2d0effd700 1 -- 172.21.15.115:0/1479194782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d10065de0 msgr2=0x7f2d10165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:47.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2d0effd700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d10065de0 0x7f2d10165330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:47.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2d0effd700 1 -- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10153e00 msgr2=0x7f2d10093cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:47.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2d0effd700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10153e00 0x7f2d10093cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:47.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2d0effd700 1 -- 172.21.15.115:0/1479194782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d000092a0 con 0x7f2d10064230 2023-07-27T14:36:47.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2d0effd700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10064230 0x7f2d10156c60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f2d00009d50 tx=0x7f2d00016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:47.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2cf6ffd700 1 -- 172.21.15.115:0/1479194782 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000dcf0 con 0x7f2d10064230 2023-07-27T14:36:47.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2cf6ffd700 1 -- 172.21.15.115:0/1479194782 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0000de50 con 0x7f2d10064230 2023-07-27T14:36:47.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2cf6ffd700 1 -- 172.21.15.115:0/1479194782 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000d980 con 0x7f2d10064230 2023-07-27T14:36:47.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d10164fc0 con 0x7f2d10064230 2023-07-27T14:36:47.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.313+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d101644b0 con 0x7f2d10064230 2023-07-27T14:36:47.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.314+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1006c470 con 0x7f2d10064230 2023-07-27T14:36:47.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.315+0000 7f2cf6ffd700 1 -- 172.21.15.115:0/1479194782 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7f2d0000f070 con 0x7f2d10064230 2023-07-27T14:36:47.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.316+0000 7f2cf6ffd700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2cfc05f960 0x7f2cfc061e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:47.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.316+0000 7f2cf6ffd700 1 -- 172.21.15.115:0/1479194782 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2d0007c3b0 con 0x7f2d10064230 2023-07-27T14:36:47.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.316+0000 7f2d0e7fc700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2cfc05f960 0x7f2cfc061e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:47.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.317+0000 7f2d0e7fc700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2cfc05f960 0x7f2cfc061e20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f2d100a55a0 tx=0x7f2d04009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:47.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.321+0000 7f2cf6ffd700 1 -- 172.21.15.115:0/1479194782 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d0004cc70 con 0x7f2d10064230 2023-07-27T14:36:47.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:47.533+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d10065320 con 0x7f2cfc05f960 2023-07-27T14:36:48.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.328+0000 7f2cf6ffd700 1 -- 172.21.15.115:0/1479194782 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f2d10065320 con 0x7f2cfc05f960 2023-07-27T14:36:48.377 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:36:48.377 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:36:48.377 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:36:48.378 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:36:48.378 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:36:48.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.330+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2cfc05f960 msgr2=0x7f2cfc061e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2cfc05f960 0x7f2cfc061e20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f2d100a55a0 tx=0x7f2d04009040).stop 2023-07-27T14:36:48.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10064230 msgr2=0x7f2d10156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10064230 0x7f2d10156c60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f2d00009d50 tx=0x7f2d00016000).stop 2023-07-27T14:36:48.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 shutdown_connections 2023-07-27T14:36:48.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2cfc05f960 0x7f2cfc061e20 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10153e00 0x7f2d10093cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2d10064230 0x7f2d10156c60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 --2- 172.21.15.115:0/1479194782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2d10065de0 0x7f2d10165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 >> 172.21.15.115:0/1479194782 conn(0x7f2d100c7b90 msgr2=0x7f2d10152190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:48.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 shutdown_connections 2023-07-27T14:36:48.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.331+0000 7f2d159ff700 1 -- 172.21.15.115:0/1479194782 wait complete. 2023-07-27T14:36:48.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000769971 2023-07-27T14:36:48.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.543+0000 7f234bdff700 1 Processor -- start 2023-07-27T14:36:48.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.543+0000 7f234bdff700 1 -- start start 2023-07-27T14:36:48.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.544+0000 7f234bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23440bfb50 0x7f23440c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:48.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.544+0000 7f234bdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440c60a0 con 0x7f2344153f30 2023-07-27T14:36:48.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.544+0000 7f234bdff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440c5d70 con 0x7f23440c0610 2023-07-27T14:36:48.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.544+0000 7f234bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c7d80 con 0x7f23440bfb50 2023-07-27T14:36:48.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.544+0000 7f2349b9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2344153f30 0x7f23440a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49516/0 (socket says 172.21.15.115:49516) 2023-07-27T14:36:48.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2349b9b700 1 -- 172.21.15.115:0/2172888620 learned_addr learned my addr 172.21.15.115:0/2172888620 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:36:48.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f234939a700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23440bfb50 0x7f23440c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:48.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196911173 0 0) 0x7f23440c60a0 con 0x7f2344153f30 2023-07-27T14:36:48.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23300033f0 con 0x7f2344153f30 2023-07-27T14:36:48.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498645610 0 0) 0x7f23440c5d70 con 0x7f23440c0610 2023-07-27T14:36:48.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23440c60a0 con 0x7f23440c0610 2023-07-27T14:36:48.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416344969 0 0) 0x7f23300033f0 con 0x7f2344153f30 2023-07-27T14:36:48.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23440bfb50 msgr2=0x7f23440c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:48.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23440bfb50 0x7f23440c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 >> v1:172.21.15.159:6789/0 conn(0x7f23440c0610 legacy=0x7f23440c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440c8060 con 0x7f2344153f30 2023-07-27T14:36:48.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f2340001470 con 0x7f2344153f30 2023-07-27T14:36:48.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 >> v1:172.21.15.115:6789/0 conn(0x7f2344153f30 legacy=0x7f23440a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23440bfb50 0x7f2330003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:48.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2330004000 0x7f2330004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:48.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f2330005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:48.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c7d80 con 0x7f2330004b80 2023-07-27T14:36:48.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233000b9c0 con 0x7f2330004000 2023-07-27T14:36:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.545+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233000bb80 con 0x7f23440bfb50 2023-07-27T14:36:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f234a39c700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f2330005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f2349b9b700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23440bfb50 0x7f2330003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f234939a700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2330004000 0x7f2330004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f234a39c700 1 -- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23440bfb50 msgr2=0x7f2330003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f234a39c700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23440bfb50 0x7f2330003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f234a39c700 1 -- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2330004000 msgr2=0x7f2330004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:48.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f234a39c700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2330004000 0x7f2330004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f234a39c700 1 -- 172.21.15.115:0/2172888620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23300033f0 con 0x7f2330004b80 2023-07-27T14:36:48.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f234a39c700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f2330005000 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f233c001f60 tx=0x7f233c007f30).ready entity=mon.0 client_cookie=7051b83448e3d822 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:48.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.546+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0020c0 con 0x7f2330004b80 2023-07-27T14:36:48.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c006a20 con 0x7f2330004b80 2023-07-27T14:36:48.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f2348b99700 1 -- 172.21.15.115:0/2172888620 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c006de0 con 0x7f2330004b80 2023-07-27T14:36:48.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f234bdff700 1 -- 172.21.15.115:0/2172888620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 msgr2=0x7f2330005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f234bdff700 1 --2- 172.21.15.115:0/2172888620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f2330005000 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f233c001f60 tx=0x7f233c007f30).stop 2023-07-27T14:36:48.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f234a39c700 1 -- 172.21.15.115:0/2172888620 reap_dead start 2023-07-27T14:36:48.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f234bdff700 1 -- 172.21.15.115:0/2172888620 shutdown_connections 2023-07-27T14:36:48.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f234bdff700 1 -- 172.21.15.115:0/2172888620 >> 172.21.15.115:0/2172888620 conn(0x7f2344094280 msgr2=0x7f234405e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:48.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f234bdff700 1 -- 172.21.15.115:0/2172888620 shutdown_connections 2023-07-27T14:36:48.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.547+0000 7f234bdff700 1 -- 172.21.15.115:0/2172888620 wait complete. 2023-07-27T14:36:48.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.549+0000 7f234bdff700 1 Processor -- start 2023-07-27T14:36:48.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.549+0000 7f234bdff700 1 -- start start 2023-07-27T14:36:48.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f234bdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f23440c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:48.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f234bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f234414dda0 0x7f23440c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:48.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f234bdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23440acb90 0x7f23440acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:48.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f234bdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c3010 con 0x7f2330004b80 2023-07-27T14:36:48.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f234bdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440ad4e0 con 0x7f23440acb90 2023-07-27T14:36:48.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f234bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c3220 con 0x7f234414dda0 2023-07-27T14:36:48.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f23440c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:48.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f23440c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44924/0 (socket says 172.21.15.115:44924) 2023-07-27T14:36:48.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 -- 172.21.15.115:0/1164376703 learned_addr learned my addr 172.21.15.115:0/1164376703 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:48.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f234a39c700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23440acb90 0x7f23440acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:48.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f234939a700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f234414dda0 0x7f23440c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:48.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 -- 172.21.15.115:0/1164376703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f234414dda0 msgr2=0x7f23440c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f234414dda0 0x7f23440c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 -- 172.21.15.115:0/1164376703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23440acb90 msgr2=0x7f23440acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23440acb90 0x7f23440acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 -- 172.21.15.115:0/1164376703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440c3500 con 0x7f2330004b80 2023-07-27T14:36:48.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.550+0000 7f2349b9b700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f23440c42c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f2340007710 tx=0x7f2340001d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:48.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.551+0000 7f2339ffb700 1 -- 172.21.15.115:0/1164376703 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340011590 con 0x7f2330004b80 2023-07-27T14:36:48.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.551+0000 7f2339ffb700 1 -- 172.21.15.115:0/1164376703 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23400116f0 con 0x7f2330004b80 2023-07-27T14:36:48.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.551+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440c37e0 con 0x7f2330004b80 2023-07-27T14:36:48.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.551+0000 7f2339ffb700 1 -- 172.21.15.115:0/1164376703 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340011a90 con 0x7f2330004b80 2023-07-27T14:36:48.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.551+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23440c3da0 con 0x7f2330004b80 2023-07-27T14:36:48.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.552+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23440c3f90 con 0x7f2330004b80 2023-07-27T14:36:48.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.552+0000 7f2339ffb700 1 -- 172.21.15.115:0/1164376703 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7f234001b030 con 0x7f2330004b80 2023-07-27T14:36:48.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.553+0000 7f2339ffb700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f232805f960 0x7f2328061e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:48.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.553+0000 7f2339ffb700 1 -- 172.21.15.115:0/1164376703 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f234007a580 con 0x7f2330004b80 2023-07-27T14:36:48.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.553+0000 7f234939a700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f232805f960 0x7f2328061e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:48.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.554+0000 7f234939a700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f232805f960 0x7f2328061e20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f2334006d50 tx=0x7f2334008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:48.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.558+0000 7f2339ffb700 1 -- 172.21.15.115:0/1164376703 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f234004aef0 con 0x7f2330004b80 2023-07-27T14:36:48.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.759+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7f234406c470 con 0x7f232805f960 2023-07-27T14:36:48.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.766+0000 7f2339ffb700 1 -- 172.21.15.115:0/1164376703 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f234406c470 con 0x7f232805f960 2023-07-27T14:36:48.815 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7 2023-07-27T14:36:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f232805f960 msgr2=0x7f2328061e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f232805f960 0x7f2328061e20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f2334006d50 tx=0x7f2334008040).stop 2023-07-27T14:36:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 msgr2=0x7f23440c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:48.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f23440c42c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f2340007710 tx=0x7f2340001d40).stop 2023-07-27T14:36:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 shutdown_connections 2023-07-27T14:36:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f232805f960 0x7f2328061e20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23440acb90 0x7f23440acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2330004b80 0x7f23440c42c0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.768+0000 7f234bdff700 1 --2- 172.21.15.115:0/1164376703 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f234414dda0 0x7f23440c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.769+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 >> 172.21.15.115:0/1164376703 conn(0x7f2344094280 msgr2=0x7f23440c09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:48.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.769+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 shutdown_connections 2023-07-27T14:36:48.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.769+0000 7f234bdff700 1 -- 172.21.15.115:0/1164376703 wait complete. 2023-07-27T14:36:48.834 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000016345 2023-07-27T14:36:49.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.975+0000 7f0b841ff700 1 Processor -- start 2023-07-27T14:36:49.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.975+0000 7f0b841ff700 1 -- start start 2023-07-27T14:36:49.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b841ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c14ae00 0x7f0b7c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b841ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0b7c14b1e0 0x7f0b7c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b841ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b7c0c5c50 0x7f0b7c063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b841ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c063530 con 0x7f0b7c0c5c50 2023-07-27T14:36:49.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b841ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c1553f0 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b841ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c157a50 con 0x7f0b7c14ae00 2023-07-27T14:36:49.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b8279c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b7c0c5c50 0x7f0b7c063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b8279c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0b7c0c5c50 0x7f0b7c063040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44930/0 (socket says 172.21.15.115:44930) 2023-07-27T14:36:49.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b8279c700 1 -- 172.21.15.115:0/4032213847 learned_addr learned my addr 172.21.15.115:0/4032213847 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:49.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b8279c700 1 -- 172.21.15.115:0/4032213847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c14ae00 msgr2=0x7f0b7c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:49.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b81f9b700 1 --2- 172.21.15.115:0/4032213847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c14ae00 0x7f0b7c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.977+0000 7f0b8179a700 1 --2- 172.21.15.115:0/4032213847 >> v2:172.21.15.159:3300/0 conn(0x7f0b7c14b1e0 0x7f0b7c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b8279c700 1 --2- 172.21.15.115:0/4032213847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c14ae00 0x7f0b7c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b8279c700 1 -- 172.21.15.115:0/4032213847 >> v2:172.21.15.159:3300/0 conn(0x7f0b7c14b1e0 msgr2=0x7f0b7c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:49.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b8279c700 1 --2- 172.21.15.115:0/4032213847 >> v2:172.21.15.159:3300/0 conn(0x7f0b7c14b1e0 0x7f0b7c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b8279c700 1 -- 172.21.15.115:0/4032213847 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c157d10 con 0x7f0b7c0c5c50 2023-07-27T14:36:49.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b8179a700 1 --2- 172.21.15.115:0/4032213847 >> v2:172.21.15.159:3300/0 conn(0x7f0b7c14b1e0 0x7f0b7c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:49.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b81f9b700 1 --2- 172.21.15.115:0/4032213847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c14ae00 0x7f0b7c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:49.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b8279c700 1 --2- 172.21.15.115:0/4032213847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c0c5c50 0x7f0b7c063040 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f0b7c0cb6f0 tx=0x7f0b74009840).ready entity=mon.0 client_cookie=f0d70be0a9411992 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:49.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b80f99700 1 -- 172.21.15.115:0/4032213847 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400e070 con 0x7f0b7c0c5c50 2023-07-27T14:36:49.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b80f99700 1 -- 172.21.15.115:0/4032213847 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7400ba50 con 0x7f0b7c0c5c50 2023-07-27T14:36:49.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b80f99700 1 -- 172.21.15.115:0/4032213847 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400bdd0 con 0x7f0b7c0c5c50 2023-07-27T14:36:49.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b841ff700 1 -- 172.21.15.115:0/4032213847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c0c5c50 msgr2=0x7f0b7c063040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b841ff700 1 --2- 172.21.15.115:0/4032213847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c0c5c50 0x7f0b7c063040 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7f0b7c0cb6f0 tx=0x7f0b74009840).stop 2023-07-27T14:36:49.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b841ff700 1 -- 172.21.15.115:0/4032213847 shutdown_connections 2023-07-27T14:36:49.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b841ff700 1 --2- 172.21.15.115:0/4032213847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c0c5c50 0x7f0b7c063040 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b841ff700 1 --2- 172.21.15.115:0/4032213847 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c14ae00 0x7f0b7c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b841ff700 1 --2- 172.21.15.115:0/4032213847 >> v2:172.21.15.159:3300/0 conn(0x7f0b7c14b1e0 0x7f0b7c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.978+0000 7f0b841ff700 1 -- 172.21.15.115:0/4032213847 >> 172.21.15.115:0/4032213847 conn(0x7f0b7c05e940 msgr2=0x7f0b7c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:49.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.979+0000 7f0b841ff700 1 -- 172.21.15.115:0/4032213847 shutdown_connections 2023-07-27T14:36:49.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.979+0000 7f0b841ff700 1 -- 172.21.15.115:0/4032213847 wait complete. 2023-07-27T14:36:49.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.980+0000 7f0b841ff700 1 Processor -- start 2023-07-27T14:36:49.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.980+0000 7f0b841ff700 1 -- start start 2023-07-27T14:36:49.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b841ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c0c5c50 0x7f0b7c1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b841ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b7c14ae00 0x7f0b7c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b841ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c14b1e0 0x7f0b7c13e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b841ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c149db0 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b841ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c156a50 con 0x7f0b7c14ae00 2023-07-27T14:36:49.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b841ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c2d70 con 0x7f0b7c0c5c50 2023-07-27T14:36:49.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b8279c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c14b1e0 0x7f0b7c13e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b8279c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c14b1e0 0x7f0b7c13e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44938/0 (socket says 172.21.15.115:44938) 2023-07-27T14:36:49.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b8279c700 1 -- 172.21.15.115:0/2049656206 learned_addr learned my addr 172.21.15.115:0/2049656206 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:49.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b81f9b700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c0c5c50 0x7f0b7c1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.981+0000 7f0b8179a700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b7c14ae00 0x7f0b7c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b8279c700 1 -- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c0c5c50 msgr2=0x7f0b7c1498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b8279c700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c0c5c50 0x7f0b7c1498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b8279c700 1 -- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b7c14ae00 msgr2=0x7f0b7c156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b8279c700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b7c14ae00 0x7f0b7c156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b8279c700 1 -- 172.21.15.115:0/2049656206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74009ae0 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b8179a700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b7c14ae00 0x7f0b7c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:49.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b8279c700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c14b1e0 0x7f0b7c13e420 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f0b74009fd0 tx=0x7f0b74009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:49.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b71ffb700 1 -- 172.21.15.115:0/2049656206 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74013e60 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b71ffb700 1 -- 172.21.15.115:0/2049656206 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7401e470 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c156c60 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b71ffb700 1 -- 172.21.15.115:0/2049656206 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7401e830 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.982+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c157220 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.983+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c06c470 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.984+0000 7f0b71ffb700 1 -- 172.21.15.115:0/2049656206 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7f0b74025030 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.985+0000 7f0b71ffb700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b6005f960 0x7f0b60061e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.985+0000 7f0b71ffb700 1 -- 172.21.15.115:0/2049656206 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b7407c760 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.985+0000 7f0b81f9b700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b6005f960 0x7f0b60061e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.986+0000 7f0b81f9b700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b6005f960 0x7f0b60061e20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f0b7c152e00 tx=0x7f0b78008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:49.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:48.989+0000 7f0b71ffb700 1 -- 172.21.15.115:0/2049656206 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b7404d020 con 0x7f0b7c14b1e0 2023-07-27T14:36:49.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.188+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000016345", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b7c0650b0 con 0x7f0b6005f960 2023-07-27T14:36:49.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.200+0000 7f0b71ffb700 1 -- 172.21.15.115:0/2049656206 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f0b7c0650b0 con 0x7f0b6005f960 2023-07-27T14:36:49.249 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000016345/e5d8b453-5025-4cea-87a5-e052dbd36bd8 2023-07-27T14:36:49.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b6005f960 msgr2=0x7f0b60061e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b6005f960 0x7f0b60061e20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f0b7c152e00 tx=0x7f0b78008040).stop 2023-07-27T14:36:49.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c14b1e0 msgr2=0x7f0b7c13e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c14b1e0 0x7f0b7c13e420 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f0b74009fd0 tx=0x7f0b74009840).stop 2023-07-27T14:36:49.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 shutdown_connections 2023-07-27T14:36:49.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0b6005f960 0x7f0b60061e20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b7c14b1e0 0x7f0b7c13e420 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b7c0c5c50 0x7f0b7c1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 --2- 172.21.15.115:0/2049656206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b7c14ae00 0x7f0b7c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 >> 172.21.15.115:0/2049656206 conn(0x7f0b7c05e940 msgr2=0x7f0b7c14a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:49.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 shutdown_connections 2023-07-27T14:36:49.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.202+0000 7f0b841ff700 1 -- 172.21.15.115:0/2049656206 wait complete. 2023-07-27T14:36:49.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000769971 2023-07-27T14:36:49.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.411+0000 7f13415ff700 1 Processor -- start 2023-07-27T14:36:49.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.411+0000 7f13415ff700 1 -- start start 2023-07-27T14:36:49.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.412+0000 7f13415ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f133c14ae00 0x7f133c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.412+0000 7f13415ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14b1e0 0x7f133c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.412+0000 7f13415ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f133c0c5c50 0x7f133c063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.412+0000 7f13415ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c063530 con 0x7f133c14ae00 2023-07-27T14:36:49.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.412+0000 7f13415ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c1553f0 con 0x7f133c0c5c50 2023-07-27T14:36:49.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.412+0000 7f13415ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c157a50 con 0x7f133c14b1e0 2023-07-27T14:36:49.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f133c14ae00 0x7f133c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f133c14ae00 0x7f133c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44944/0 (socket says 172.21.15.115:44944) 2023-07-27T14:36:49.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 -- 172.21.15.115:0/1904498527 learned_addr learned my addr 172.21.15.115:0/1904498527 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:49.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133b7fe700 1 --2- 172.21.15.115:0/1904498527 >> v2:172.21.15.159:3300/0 conn(0x7f133c0c5c50 0x7f133c063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133a7fc700 1 --2- 172.21.15.115:0/1904498527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14b1e0 0x7f133c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 -- 172.21.15.115:0/1904498527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14b1e0 msgr2=0x7f133c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:49.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 --2- 172.21.15.115:0/1904498527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14b1e0 0x7f133c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 -- 172.21.15.115:0/1904498527 >> v2:172.21.15.159:3300/0 conn(0x7f133c0c5c50 msgr2=0x7f133c063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:49.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 --2- 172.21.15.115:0/1904498527 >> v2:172.21.15.159:3300/0 conn(0x7f133c0c5c50 0x7f133c063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 -- 172.21.15.115:0/1904498527 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c157d10 con 0x7f133c14ae00 2023-07-27T14:36:49.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f133affd700 1 --2- 172.21.15.115:0/1904498527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c14ae00 0x7f133c154f00 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f133c084190 tx=0x7f132c0090f0).ready entity=mon.0 client_cookie=3d5c599efe8f0733 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:49.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.413+0000 7f1339ffb700 1 -- 172.21.15.115:0/1904498527 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00b520 con 0x7f133c14ae00 2023-07-27T14:36:49.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f1339ffb700 1 -- 172.21.15.115:0/1904498527 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c00b680 con 0x7f133c14ae00 2023-07-27T14:36:49.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f1339ffb700 1 -- 172.21.15.115:0/1904498527 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00ba00 con 0x7f133c14ae00 2023-07-27T14:36:49.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 -- 172.21.15.115:0/1904498527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c14ae00 msgr2=0x7f133c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 --2- 172.21.15.115:0/1904498527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c14ae00 0x7f133c154f00 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f133c084190 tx=0x7f132c0090f0).stop 2023-07-27T14:36:49.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 -- 172.21.15.115:0/1904498527 shutdown_connections 2023-07-27T14:36:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 --2- 172.21.15.115:0/1904498527 >> v2:172.21.15.159:3300/0 conn(0x7f133c0c5c50 0x7f133c063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 --2- 172.21.15.115:0/1904498527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c14ae00 0x7f133c154f00 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 --2- 172.21.15.115:0/1904498527 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14b1e0 0x7f133c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 -- 172.21.15.115:0/1904498527 >> 172.21.15.115:0/1904498527 conn(0x7f133c05e940 msgr2=0x7f133c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 -- 172.21.15.115:0/1904498527 shutdown_connections 2023-07-27T14:36:49.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.414+0000 7f13415ff700 1 -- 172.21.15.115:0/1904498527 wait complete. 2023-07-27T14:36:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.416+0000 7f13415ff700 1 Processor -- start 2023-07-27T14:36:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.416+0000 7f13415ff700 1 -- start start 2023-07-27T14:36:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f13415ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c0c5c50 0x7f133c166e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f13415ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14ae00 0x7f133c0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f13415ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c14b1e0 0x7f133c0c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f13415ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0c3320 con 0x7f133c0c5c50 2023-07-27T14:36:49.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f13415ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c167330 con 0x7f133c14b1e0 2023-07-27T14:36:49.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f13415ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0c2710 con 0x7f133c14ae00 2023-07-27T14:36:49.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c0c5c50 0x7f133c166e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c0c5c50 0x7f133c166e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44958/0 (socket says 172.21.15.115:44958) 2023-07-27T14:36:49.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133affd700 1 -- 172.21.15.115:0/1245903993 learned_addr learned my addr 172.21.15.115:0/1245903993 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:49.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133a7fc700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14ae00 0x7f133c0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133b7fe700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c14b1e0 0x7f133c0c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133affd700 1 -- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14ae00 msgr2=0x7f133c0c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133affd700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14ae00 0x7f133c0c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133affd700 1 -- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c14b1e0 msgr2=0x7f133c0c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133affd700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c14b1e0 0x7f133c0c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133affd700 1 -- 172.21.15.115:0/1245903993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009370 con 0x7f133c0c5c50 2023-07-27T14:36:49.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.418+0000 7f133b7fe700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c14b1e0 0x7f133c0c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:36:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.419+0000 7f133affd700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c0c5c50 0x7f133c166e40 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f133c0caac0 tx=0x7f132c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.419+0000 7f1322ffd700 1 -- 172.21.15.115:0/1245903993 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c006a40 con 0x7f133c0c5c50 2023-07-27T14:36:49.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.419+0000 7f1322ffd700 1 -- 172.21.15.115:0/1245903993 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c000bc0 con 0x7f133c0c5c50 2023-07-27T14:36:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.419+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c0c29f0 con 0x7f133c0c5c50 2023-07-27T14:36:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.419+0000 7f1322ffd700 1 -- 172.21.15.115:0/1245903993 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c01c420 con 0x7f133c0c5c50 2023-07-27T14:36:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.419+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c0c2fb0 con 0x7f133c0c5c50 2023-07-27T14:36:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.420+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c06c470 con 0x7f133c0c5c50 2023-07-27T14:36:49.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.421+0000 7f1322ffd700 1 -- 172.21.15.115:0/1245903993 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7f132c02c070 con 0x7f133c0c5c50 2023-07-27T14:36:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.421+0000 7f1322ffd700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f132805f960 0x7f1328061e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.421+0000 7f1322ffd700 1 -- 172.21.15.115:0/1245903993 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f132c07c8a0 con 0x7f133c0c5c50 2023-07-27T14:36:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.422+0000 7f133a7fc700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f132805f960 0x7f1328061e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.422+0000 7f133a7fc700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f132805f960 0x7f1328061e20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f133c14b5e0 tx=0x7f1330008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:49.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.426+0000 7f1322ffd700 1 -- 172.21.15.115:0/1245903993 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f132c04d160 con 0x7f133c0c5c50 2023-07-27T14:36:49.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.628+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7f133c0c03a0 con 0x7f132805f960 2023-07-27T14:36:49.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.634+0000 7f1322ffd700 1 -- 172.21.15.115:0/1245903993 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f133c0c03a0 con 0x7f132805f960 2023-07-27T14:36:49.683 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7 2023-07-27T14:36:49.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f132805f960 msgr2=0x7f1328061e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f132805f960 0x7f1328061e20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f133c14b5e0 tx=0x7f1330008040).stop 2023-07-27T14:36:49.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c0c5c50 msgr2=0x7f133c166e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:49.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c0c5c50 0x7f133c166e40 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f133c0caac0 tx=0x7f132c017000).stop 2023-07-27T14:36:49.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 shutdown_connections 2023-07-27T14:36:49.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f132805f960 0x7f1328061e20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f133c14b1e0 0x7f133c0c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f133c0c5c50 0x7f133c166e40 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 --2- 172.21.15.115:0/1245903993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f133c14ae00 0x7f133c0c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:49.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 >> 172.21.15.115:0/1245903993 conn(0x7f133c05e940 msgr2=0x7f133c14a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:49.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.636+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 shutdown_connections 2023-07-27T14:36:49.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.637+0000 7f13415ff700 1 -- 172.21.15.115:0/1245903993 wait complete. 2023-07-27T14:36:49.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:49.703 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:49.753 INFO:teuthology.orchestra.run.smithi115.stdout:65 2023-07-27T14:36:49.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:49.754 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7) 2023-07-27T14:36:49.805 INFO:teuthology.orchestra.run.smithi115.stdout:65 2023-07-27T14:36:49.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs clone_0000000000769971 2023-07-27T14:36:49.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.950+0000 7f8ee9dff700 1 Processor -- start 2023-07-27T14:36:49.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.950+0000 7f8ee9dff700 1 -- start start 2023-07-27T14:36:50.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.951+0000 7f8ee9dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ee4063260 0x7f8ee4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:50.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.951+0000 7f8ee9dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee414b1e0 0x7f8ee40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:50.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.951+0000 7f8ee9dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee41553f0 con 0x7f8ee414ae00 2023-07-27T14:36:50.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.951+0000 7f8ee9dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee4157a50 con 0x7f8ee4063260 2023-07-27T14:36:50.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.951+0000 7f8ee9dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4157d10 con 0x7f8ee414b1e0 2023-07-27T14:36:50.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.951+0000 7f8ee2ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ee4063260 0x7f8ee4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:50.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee2ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ee4063260 0x7f8ee4154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44962/0 (socket says 172.21.15.115:44962) 2023-07-27T14:36:50.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee2ffd700 1 -- 172.21.15.115:0/866488536 learned_addr learned my addr 172.21.15.115:0/866488536 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:50.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee3fff700 1 --2- 172.21.15.115:0/866488536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee414b1e0 0x7f8ee40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee2ffd700 1 -- 172.21.15.115:0/866488536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee414b1e0 msgr2=0x7f8ee40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee2ffd700 1 --2- 172.21.15.115:0/866488536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee414b1e0 0x7f8ee40a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee2ffd700 1 -- 172.21.15.115:0/866488536 >> v1:172.21.15.159:6789/0 conn(0x7f8ee414ae00 legacy=0x7f8ee4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:36:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee2ffd700 1 -- 172.21.15.115:0/866488536 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4157ff0 con 0x7f8ee4063260 2023-07-27T14:36:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee3fff700 1 --2- 172.21.15.115:0/866488536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee414b1e0 0x7f8ee40a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:36:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee2ffd700 1 --2- 172.21.15.115:0/866488536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee4063260 0x7f8ee4154f00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f8ed8006fd0 tx=0x7f8ed80090f0).ready entity=mon.0 client_cookie=689ab36a66890fd4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:50.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee27fc700 1 -- 172.21.15.115:0/866488536 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800b600 con 0x7f8ee4063260 2023-07-27T14:36:50.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee27fc700 1 -- 172.21.15.115:0/866488536 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800b760 con 0x7f8ee4063260 2023-07-27T14:36:50.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.952+0000 7f8ee27fc700 1 -- 172.21.15.115:0/866488536 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800bae0 con 0x7f8ee4063260 2023-07-27T14:36:50.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.953+0000 7f8ee9dff700 1 -- 172.21.15.115:0/866488536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee4063260 msgr2=0x7f8ee4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:50.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.953+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/866488536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee4063260 0x7f8ee4154f00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f8ed8006fd0 tx=0x7f8ed80090f0).stop 2023-07-27T14:36:50.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.953+0000 7f8ee9dff700 1 -- 172.21.15.115:0/866488536 shutdown_connections 2023-07-27T14:36:50.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.953+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/866488536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee414b1e0 0x7f8ee40a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.953+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/866488536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee4063260 0x7f8ee4154f00 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.953+0000 7f8ee9dff700 1 -- 172.21.15.115:0/866488536 >> 172.21.15.115:0/866488536 conn(0x7f8ee405e940 msgr2=0x7f8ee40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:50.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.953+0000 7f8ee9dff700 1 -- 172.21.15.115:0/866488536 shutdown_connections 2023-07-27T14:36:50.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.953+0000 7f8ee9dff700 1 -- 172.21.15.115:0/866488536 wait complete. 2023-07-27T14:36:50.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.954+0000 7f8ee9dff700 1 Processor -- start 2023-07-27T14:36:50.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.955+0000 7f8ee9dff700 1 -- start start 2023-07-27T14:36:50.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.955+0000 7f8ee9dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee4063260 0x7f8ee4164030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:50.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.955+0000 7f8ee9dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee414ae00 0x7f8ee41651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:50.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.955+0000 7f8ee9dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee414b1e0 0x7f8ee40ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:50.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.955+0000 7f8ee9dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40c41c0 con 0x7f8ee414b1e0 2023-07-27T14:36:50.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.955+0000 7f8ee9dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40aef40 con 0x7f8ee414ae00 2023-07-27T14:36:50.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.955+0000 7f8ee9dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40aea20 con 0x7f8ee4063260 2023-07-27T14:36:50.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee414b1e0 0x7f8ee40ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:50.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee414b1e0 0x7f8ee40ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44976/0 (socket says 172.21.15.115:44976) 2023-07-27T14:36:50.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 -- 172.21.15.115:0/4056490773 learned_addr learned my addr 172.21.15.115:0/4056490773 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:36:50.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee37fe700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee4063260 0x7f8ee4164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:50.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee2ffd700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee414ae00 0x7f8ee41651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:50.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 -- 172.21.15.115:0/4056490773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee4063260 msgr2=0x7f8ee4164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:50.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee4063260 0x7f8ee4164030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 -- 172.21.15.115:0/4056490773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee414ae00 msgr2=0x7f8ee41651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:50.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee414ae00 0x7f8ee41651e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 -- 172.21.15.115:0/4056490773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8009370 con 0x7f8ee414b1e0 2023-07-27T14:36:50.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ee3fff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee414b1e0 0x7f8ee40ae530 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f8edc00a380 tx=0x7f8edc0078d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:50.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.956+0000 7f8ecb7fe700 1 -- 172.21.15.115:0/4056490773 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00ae10 con 0x7f8ee414b1e0 2023-07-27T14:36:50.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.957+0000 7f8ecb7fe700 1 -- 172.21.15.115:0/4056490773 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc00d650 con 0x7f8ee414b1e0 2023-07-27T14:36:50.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.957+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee41645f0 con 0x7f8ee414b1e0 2023-07-27T14:36:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.957+0000 7f8ecb7fe700 1 -- 172.21.15.115:0/4056490773 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00d9f0 con 0x7f8ee414b1e0 2023-07-27T14:36:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.957+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee4164bb0 con 0x7f8ee414b1e0 2023-07-27T14:36:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.958+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee40af0f0 con 0x7f8ee414b1e0 2023-07-27T14:36:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.959+0000 7f8ecb7fe700 1 -- 172.21.15.115:0/4056490773 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7f8edc016470 con 0x7f8ee414b1e0 2023-07-27T14:36:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.959+0000 7f8ecb7fe700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ed005f960 0x7f8ed0061e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:36:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.959+0000 7f8ecb7fe700 1 -- 172.21.15.115:0/4056490773 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8edc07bb40 con 0x7f8ee414b1e0 2023-07-27T14:36:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.960+0000 7f8ee37fe700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ed005f960 0x7f8ed0061e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:36:50.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.960+0000 7f8ee37fe700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ed005f960 0x7f8ed0061e20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f8ed40036e0 tx=0x7f8ed4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:36:50.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:49.963+0000 7f8ecb7fe700 1 -- 172.21.15.115:0/4056490773 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ee40af0f0 con 0x7f8ee414b1e0 2023-07-27T14:36:50.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.163+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ee40af0f0 con 0x7f8ed005f960 2023-07-27T14:36:50.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.174+0000 7f8ecb7fe700 1 -- 172.21.15.115:0/4056490773 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+714 (secure 0 0 0) 0x7f8ee40af0f0 con 0x7f8ed005f960 2023-07-27T14:36:50.223 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:36:50.223 INFO:teuthology.orchestra.run.smithi115.stdout: "atime": "2023-07-27 14:36:36", 2023-07-27T14:36:50.223 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_pcent": "undefined", 2023-07-27T14:36:50.224 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_quota": "infinite", 2023-07-27T14:36:50.224 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_used": 67108864, 2023-07-27T14:36:50.224 INFO:teuthology.orchestra.run.smithi115.stdout: "created_at": "2023-07-27 14:36:42", 2023-07-27T14:36:50.224 INFO:teuthology.orchestra.run.smithi115.stdout: "ctime": "2023-07-27 14:36:47", 2023-07-27T14:36:50.224 INFO:teuthology.orchestra.run.smithi115.stdout: "data_pool": "cephfs_data", 2023-07-27T14:36:50.224 INFO:teuthology.orchestra.run.smithi115.stdout: "features": [ 2023-07-27T14:36:50.224 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-clone", 2023-07-27T14:36:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-autoprotect", 2023-07-27T14:36:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-retention" 2023-07-27T14:36:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:36:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: "gid": 0, 2023-07-27T14:36:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: "mode": 16895, 2023-07-27T14:36:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: "mon_addrs": [ 2023-07-27T14:36:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.115:6789", 2023-07-27T14:36:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6789", 2023-07-27T14:36:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6790" 2023-07-27T14:36:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:36:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: "mtime": "2023-07-27 14:36:41", 2023-07-27T14:36:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7", 2023-07-27T14:36:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: "pool_namespace": "", 2023-07-27T14:36:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete", 2023-07-27T14:36:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "clone", 2023-07-27T14:36:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: "uid": 0 2023-07-27T14:36:50.227 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:36:50.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ed005f960 msgr2=0x7f8ed0061e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:50.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ed005f960 0x7f8ed0061e20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f8ed40036e0 tx=0x7f8ed4009040).stop 2023-07-27T14:36:50.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee414b1e0 msgr2=0x7f8ee40ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:36:50.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee414b1e0 0x7f8ee40ae530 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f8edc00a380 tx=0x7f8edc0078d0).stop 2023-07-27T14:36:50.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 shutdown_connections 2023-07-27T14:36:50.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ed005f960 0x7f8ed0061e20 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ee414b1e0 0x7f8ee40ae530 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8ee4063260 0x7f8ee4164030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 --2- 172.21.15.115:0/4056490773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ee414ae00 0x7f8ee41651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:36:50.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 >> 172.21.15.115:0/4056490773 conn(0x7f8ee405e940 msgr2=0x7f8ee40ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:36:50.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.176+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 shutdown_connections 2023-07-27T14:36:50.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:36:50.177+0000 7f8ee9dff700 1 -- 172.21.15.115:0/4056490773 wait complete. 2023-07-27T14:36:50.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.242 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:50.288 INFO:teuthology.orchestra.run.smithi115.stderr:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8: ceph.quota.max_bytes: No such attribute 2023-07-27T14:36:50.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:36:50.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.291 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:50.377 INFO:teuthology.orchestra.run.smithi115.stdout:cephfs_data 2023-07-27T14:36:50.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.378 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:50.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.426 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:50.477 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8 2023-07-27T14:36:50.478 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.49 2023-07-27T14:36:50.479 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.22 2023-07-27T14:36:50.479 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.20 2023-07-27T14:36:50.479 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.34 2023-07-27T14:36:50.480 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.55 2023-07-27T14:36:50.480 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.2 2023-07-27T14:36:50.480 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.35 2023-07-27T14:36:50.480 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.30 2023-07-27T14:36:50.481 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.14 2023-07-27T14:36:50.481 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.26 2023-07-27T14:36:50.481 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.51 2023-07-27T14:36:50.482 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.50 2023-07-27T14:36:50.482 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.13 2023-07-27T14:36:50.482 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.10 2023-07-27T14:36:50.482 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.47 2023-07-27T14:36:50.483 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.5 2023-07-27T14:36:50.483 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.37 2023-07-27T14:36:50.483 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.39 2023-07-27T14:36:50.483 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.54 2023-07-27T14:36:50.484 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.36 2023-07-27T14:36:50.484 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.18 2023-07-27T14:36:50.484 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.17 2023-07-27T14:36:50.484 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.4 2023-07-27T14:36:50.484 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.58 2023-07-27T14:36:50.485 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.29 2023-07-27T14:36:50.485 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.38 2023-07-27T14:36:50.485 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.19 2023-07-27T14:36:50.485 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.7 2023-07-27T14:36:50.485 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.48 2023-07-27T14:36:50.485 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.57 2023-07-27T14:36:50.485 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.6 2023-07-27T14:36:50.485 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.53 2023-07-27T14:36:50.486 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.40 2023-07-27T14:36:50.486 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.42 2023-07-27T14:36:50.486 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.0 2023-07-27T14:36:50.486 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.27 2023-07-27T14:36:50.486 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.25 2023-07-27T14:36:50.486 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.32 2023-07-27T14:36:50.486 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.28 2023-07-27T14:36:50.487 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.21 2023-07-27T14:36:50.487 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.9 2023-07-27T14:36:50.487 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.23 2023-07-27T14:36:50.487 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.15 2023-07-27T14:36:50.487 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.8 2023-07-27T14:36:50.487 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.46 2023-07-27T14:36:50.487 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.33 2023-07-27T14:36:50.488 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.45 2023-07-27T14:36:50.488 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.61 2023-07-27T14:36:50.488 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.62 2023-07-27T14:36:50.488 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.52 2023-07-27T14:36:50.489 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.11 2023-07-27T14:36:50.489 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.44 2023-07-27T14:36:50.489 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.3 2023-07-27T14:36:50.489 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.24 2023-07-27T14:36:50.490 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.56 2023-07-27T14:36:50.490 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.63 2023-07-27T14:36:50.490 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.59 2023-07-27T14:36:50.490 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.41 2023-07-27T14:36:50.491 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.12 2023-07-27T14:36:50.491 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.43 2023-07-27T14:36:50.491 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.16 2023-07-27T14:36:50.491 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.31 2023-07-27T14:36:50.491 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.1 2023-07-27T14:36:50.491 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.60 2023-07-27T14:36:50.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.493 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:50.538 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:36:50.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.539 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/) 2023-07-27T14:36:50.624 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:36:50.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.626 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:50.712 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:36:50.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.713 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/) 2023-07-27T14:36:50.799 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:36:50.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.801 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:50.846 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:36:50.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.847 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/) 2023-07-27T14:36:50.933 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:36:50.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:50.934 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8) 2023-07-27T14:36:51.020 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:36:51.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.021 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/) 2023-07-27T14:36:51.107 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:36:51.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.109 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.49) 2023-07-27T14:36:51.194 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:51.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.196 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.49) 2023-07-27T14:36:51.286 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:51.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.287 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.49) 2023-07-27T14:36:51.333 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:51.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.335 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.49) 2023-07-27T14:36:51.419 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:51.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.421 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.49) 2023-07-27T14:36:51.506 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:51.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.508 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.49) 2023-07-27T14:36:51.594 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:51.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.595 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.49) 2023-07-27T14:36:51.681 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:51.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.683 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.49) 2023-07-27T14:36:51.729 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:51.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.731 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.22) 2023-07-27T14:36:51.777 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:51.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.779 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.22) 2023-07-27T14:36:51.829 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:51.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.831 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.22) 2023-07-27T14:36:51.878 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:51.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.878 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.22) 2023-07-27T14:36:51.965 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:51.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:51.966 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.22) 2023-07-27T14:36:52.051 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:52.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.053 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.22) 2023-07-27T14:36:52.138 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:52.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.140 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.22) 2023-07-27T14:36:52.225 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:36:52.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.226 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.22) 2023-07-27T14:36:52.313 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:36:52.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.314 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.20) 2023-07-27T14:36:52.360 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:52.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.362 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.20) 2023-07-27T14:36:52.448 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:52.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.450 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.20) 2023-07-27T14:36:52.495 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:52.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.496 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.20) 2023-07-27T14:36:52.581 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:52.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.584 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.20) 2023-07-27T14:36:52.669 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:52.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.670 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.20) 2023-07-27T14:36:52.716 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:52.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.718 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.20) 2023-07-27T14:36:52.808 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:36:52.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.810 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.20) 2023-07-27T14:36:52.855 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:36:52.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.857 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.34) 2023-07-27T14:36:52.942 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:52.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:52.944 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.34) 2023-07-27T14:36:53.029 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:53.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.031 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.34) 2023-07-27T14:36:53.116 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:53.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.118 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.34) 2023-07-27T14:36:53.164 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:53.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.165 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.34) 2023-07-27T14:36:53.251 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:53.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.252 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.34) 2023-07-27T14:36:53.338 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:53.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.339 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.34) 2023-07-27T14:36:53.425 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:36:53.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.427 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.34) 2023-07-27T14:36:53.512 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:36:53.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.514 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.55) 2023-07-27T14:36:53.599 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:53.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.601 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.55) 2023-07-27T14:36:53.688 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:53.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.690 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.55) 2023-07-27T14:36:53.735 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:53.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.737 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.55) 2023-07-27T14:36:53.829 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:53.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.831 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.55) 2023-07-27T14:36:53.876 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:53.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.878 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.55) 2023-07-27T14:36:53.923 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:53.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:53.925 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.55) 2023-07-27T14:36:54.010 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:54.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.013 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.55) 2023-07-27T14:36:54.098 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:54.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.099 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.2) 2023-07-27T14:36:54.185 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:54.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.187 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.2) 2023-07-27T14:36:54.274 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:54.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.275 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.2) 2023-07-27T14:36:54.321 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:54.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.323 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.2) 2023-07-27T14:36:54.368 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:54.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.370 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.2) 2023-07-27T14:36:54.455 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:54.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.457 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.2) 2023-07-27T14:36:54.504 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:54.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.505 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.2) 2023-07-27T14:36:54.591 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:36:54.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.592 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.2) 2023-07-27T14:36:54.678 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:36:54.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.679 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.35) 2023-07-27T14:36:54.764 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:54.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.765 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.35) 2023-07-27T14:36:54.853 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:54.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.854 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.35) 2023-07-27T14:36:54.899 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:54.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.901 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.35) 2023-07-27T14:36:54.986 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:54.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:54.987 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.35) 2023-07-27T14:36:55.073 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:55.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.074 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.35) 2023-07-27T14:36:55.120 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:55.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.122 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.35) 2023-07-27T14:36:55.167 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:36:55.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.169 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.35) 2023-07-27T14:36:55.254 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:36:55.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.255 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.30) 2023-07-27T14:36:55.340 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:55.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.342 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.30) 2023-07-27T14:36:55.428 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:55.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.430 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.30) 2023-07-27T14:36:55.475 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:55.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.476 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.30) 2023-07-27T14:36:55.563 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:55.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.564 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.30) 2023-07-27T14:36:55.649 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:55.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.651 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.30) 2023-07-27T14:36:55.736 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:55.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.738 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.30) 2023-07-27T14:36:55.783 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:36:55.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.785 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.30) 2023-07-27T14:36:55.830 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:36:55.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.832 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.14) 2023-07-27T14:36:55.917 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:55.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:55.918 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.14) 2023-07-27T14:36:56.006 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:56.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.007 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.14) 2023-07-27T14:36:56.052 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:56.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.054 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.14) 2023-07-27T14:36:56.099 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:56.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.100 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.14) 2023-07-27T14:36:56.186 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:56.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.188 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.14) 2023-07-27T14:36:56.233 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:56.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.235 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.14) 2023-07-27T14:36:56.280 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:36:56.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.282 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.14) 2023-07-27T14:36:56.327 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:36:56.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.329 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.26) 2023-07-27T14:36:56.414 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:56.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.416 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.26) 2023-07-27T14:36:56.502 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:56.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.504 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.26) 2023-07-27T14:36:56.550 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:56.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.552 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.26) 2023-07-27T14:36:56.637 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:56.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.26) 2023-07-27T14:36:56.684 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:56.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.686 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.26) 2023-07-27T14:36:56.732 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:56.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.733 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.26) 2023-07-27T14:36:56.778 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:36:56.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.780 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.26) 2023-07-27T14:36:56.825 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:36:56.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.827 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.51) 2023-07-27T14:36:56.913 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:56.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:56.915 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.51) 2023-07-27T14:36:57.001 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:57.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.004 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.51) 2023-07-27T14:36:57.049 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:57.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.052 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.51) 2023-07-27T14:36:57.137 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:57.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.139 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.51) 2023-07-27T14:36:57.184 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:57.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.186 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.51) 2023-07-27T14:36:57.272 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:57.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.274 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.51) 2023-07-27T14:36:57.359 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:57.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.360 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.51) 2023-07-27T14:36:57.445 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:57.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.447 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.50) 2023-07-27T14:36:57.531 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:57.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.533 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.50) 2023-07-27T14:36:57.619 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:57.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.620 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.50) 2023-07-27T14:36:57.666 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:57.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.669 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.50) 2023-07-27T14:36:57.715 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:57.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.717 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.50) 2023-07-27T14:36:57.803 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:57.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.805 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.50) 2023-07-27T14:36:57.850 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:57.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.852 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.50) 2023-07-27T14:36:57.938 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:57.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.939 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.50) 2023-07-27T14:36:57.985 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:57.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:57.987 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.13) 2023-07-27T14:36:58.072 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:58.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.074 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.13) 2023-07-27T14:36:58.121 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:58.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.122 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.13) 2023-07-27T14:36:58.167 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:58.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.169 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.13) 2023-07-27T14:36:58.254 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:58.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.256 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.13) 2023-07-27T14:36:58.301 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:58.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.303 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.13) 2023-07-27T14:36:58.388 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:58.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.390 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.13) 2023-07-27T14:36:58.435 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:36:58.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.437 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.13) 2023-07-27T14:36:58.482 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:36:58.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.484 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.10) 2023-07-27T14:36:58.569 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:58.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.572 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.10) 2023-07-27T14:36:58.657 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:58.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.659 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.10) 2023-07-27T14:36:58.705 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:58.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.707 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.10) 2023-07-27T14:36:58.792 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:58.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.794 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.10) 2023-07-27T14:36:58.840 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:58.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.842 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.10) 2023-07-27T14:36:58.887 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:58.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.890 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.10) 2023-07-27T14:36:58.935 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:36:58.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:58.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.10) 2023-07-27T14:36:59.022 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:36:59.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.023 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.47) 2023-07-27T14:36:59.108 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:59.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.109 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.47) 2023-07-27T14:36:59.197 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:59.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.198 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.47) 2023-07-27T14:36:59.244 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:59.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.246 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.47) 2023-07-27T14:36:59.331 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:59.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.334 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.47) 2023-07-27T14:36:59.380 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:59.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.382 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.47) 2023-07-27T14:36:59.467 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:36:59.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.469 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.47) 2023-07-27T14:36:59.554 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:59.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.555 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.47) 2023-07-27T14:36:59.640 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:36:59.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.641 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.5) 2023-07-27T14:36:59.728 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:59.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.730 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.5) 2023-07-27T14:36:59.820 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:36:59.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.822 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.5) 2023-07-27T14:36:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:59.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.871 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.5) 2023-07-27T14:36:59.924 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:36:59.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:36:59.927 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.5) 2023-07-27T14:37:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:00.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.024 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.5) 2023-07-27T14:37:00.115 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:00.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.116 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.5) 2023-07-27T14:37:00.204 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:00.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.205 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.5) 2023-07-27T14:37:00.296 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:00.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.298 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.37) 2023-07-27T14:37:00.346 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:00.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.348 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.37) 2023-07-27T14:37:00.437 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:00.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.438 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.37) 2023-07-27T14:37:00.484 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:00.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.486 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.37) 2023-07-27T14:37:00.571 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:00.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.573 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.37) 2023-07-27T14:37:00.658 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:00.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.660 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.37) 2023-07-27T14:37:00.745 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:00.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.747 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.37) 2023-07-27T14:37:00.832 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:00.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.834 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.37) 2023-07-27T14:37:00.920 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:00.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.921 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.39) 2023-07-27T14:37:00.967 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:00.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:00.969 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.39) 2023-07-27T14:37:01.016 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:01.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.018 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.39) 2023-07-27T14:37:01.063 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:01.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.065 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.39) 2023-07-27T14:37:01.111 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:01.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.113 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.39) 2023-07-27T14:37:01.158 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:01.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.160 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.39) 2023-07-27T14:37:01.246 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:01.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.247 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.39) 2023-07-27T14:37:01.292 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:01.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.294 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.39) 2023-07-27T14:37:01.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:37:01.341 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:01.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.342 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.54) 2023-07-27T14:37:01.344 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:37:01.389 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:01.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.391 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.54) 2023-07-27T14:37:01.478 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:01.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.479 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.54) 2023-07-27T14:37:01.564 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:01.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.565 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.54) 2023-07-27T14:37:01.651 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:01.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.652 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.54) 2023-07-27T14:37:01.738 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:01.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.740 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.54) 2023-07-27T14:37:01.785 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:01.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.787 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.54) 2023-07-27T14:37:01.873 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:01.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.874 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.54) 2023-07-27T14:37:01.920 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:01.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:01.921 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.36) 2023-07-27T14:37:02.006 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:02.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.008 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.36) 2023-07-27T14:37:02.055 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:02.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.056 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.36) 2023-07-27T14:37:02.102 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:02.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.104 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.36) 2023-07-27T14:37:02.189 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:02.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.191 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.36) 2023-07-27T14:37:02.276 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:02.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.278 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.36) 2023-07-27T14:37:02.363 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:02.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.364 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.36) 2023-07-27T14:37:02.449 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:02.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.451 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.36) 2023-07-27T14:37:02.541 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:02.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.542 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.18) 2023-07-27T14:37:02.627 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:02.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.628 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.18) 2023-07-27T14:37:02.714 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:02.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.716 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.18) 2023-07-27T14:37:02.761 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:02.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.762 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.18) 2023-07-27T14:37:02.847 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:02.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.849 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.18) 2023-07-27T14:37:02.894 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:02.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.895 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.18) 2023-07-27T14:37:02.981 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:02.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:02.983 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.18) 2023-07-27T14:37:03.068 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:03.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.071 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.18) 2023-07-27T14:37:03.156 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:03.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.157 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.17) 2023-07-27T14:37:03.242 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:03.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.244 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.17) 2023-07-27T14:37:03.331 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:03.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.332 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.17) 2023-07-27T14:37:03.377 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:03.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.379 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.17) 2023-07-27T14:37:03.465 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:03.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.466 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.17) 2023-07-27T14:37:03.512 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:03.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.513 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.17) 2023-07-27T14:37:03.559 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:03.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.561 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.17) 2023-07-27T14:37:03.645 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:03.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.646 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.17) 2023-07-27T14:37:03.732 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:03.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.735 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.4) 2023-07-27T14:37:03.781 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:03.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.782 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.4) 2023-07-27T14:37:03.869 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:03.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.870 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.4) 2023-07-27T14:37:03.916 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:03.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:03.917 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.4) 2023-07-27T14:37:04.002 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:04.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.003 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.4) 2023-07-27T14:37:04.088 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:04.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.089 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.4) 2023-07-27T14:37:04.174 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:04.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.176 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.4) 2023-07-27T14:37:04.222 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:04.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.224 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.4) 2023-07-27T14:37:04.309 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:04.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.311 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.58) 2023-07-27T14:37:04.356 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:04.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.357 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.58) 2023-07-27T14:37:04.443 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:04.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.446 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.58) 2023-07-27T14:37:04.492 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:04.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.493 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.58) 2023-07-27T14:37:04.539 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:04.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.540 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.58) 2023-07-27T14:37:04.586 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:04.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.588 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.58) 2023-07-27T14:37:04.634 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:04.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.636 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.58) 2023-07-27T14:37:04.722 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:04.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.724 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.58) 2023-07-27T14:37:04.809 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:04.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.811 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.29) 2023-07-27T14:37:04.897 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:04.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.899 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.29) 2023-07-27T14:37:04.946 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:04.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.947 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.29) 2023-07-27T14:37:04.993 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:04.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:04.994 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.29) 2023-07-27T14:37:05.080 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:05.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.082 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.29) 2023-07-27T14:37:05.128 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:05.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.130 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.29) 2023-07-27T14:37:05.215 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:05.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.217 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.29) 2023-07-27T14:37:05.301 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:05.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.303 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.29) 2023-07-27T14:37:05.389 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:05.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.390 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.38) 2023-07-27T14:37:05.436 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:05.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.438 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.38) 2023-07-27T14:37:05.525 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:05.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.526 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.38) 2023-07-27T14:37:05.572 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:05.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.573 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.38) 2023-07-27T14:37:05.659 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:05.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.662 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.38) 2023-07-27T14:37:05.747 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:05.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.749 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.38) 2023-07-27T14:37:05.794 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:05.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.796 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.38) 2023-07-27T14:37:05.883 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:05.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.885 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.38) 2023-07-27T14:37:05.931 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:05.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:05.932 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.19) 2023-07-27T14:37:06.018 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:06.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.019 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.19) 2023-07-27T14:37:06.066 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:06.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.068 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.19) 2023-07-27T14:37:06.114 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:06.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.117 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.19) 2023-07-27T14:37:06.203 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:06.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.205 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.19) 2023-07-27T14:37:06.291 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:06.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.293 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.19) 2023-07-27T14:37:06.379 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:06.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.380 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.19) 2023-07-27T14:37:06.426 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:06.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.427 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.19) 2023-07-27T14:37:06.473 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:06.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.475 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.7) 2023-07-27T14:37:06.560 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:06.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.561 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.7) 2023-07-27T14:37:06.648 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:06.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.649 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.7) 2023-07-27T14:37:06.695 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:06.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.696 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.7) 2023-07-27T14:37:06.742 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:06.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.744 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.7) 2023-07-27T14:37:06.790 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:06.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.792 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.7) 2023-07-27T14:37:06.878 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:06.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.880 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.7) 2023-07-27T14:37:06.965 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:06.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:06.967 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.7) 2023-07-27T14:37:07.013 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:07.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.015 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.48) 2023-07-27T14:37:07.061 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:07.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.062 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.48) 2023-07-27T14:37:07.110 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:07.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.112 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.48) 2023-07-27T14:37:07.158 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:07.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.160 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.48) 2023-07-27T14:37:07.244 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:07.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.246 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.48) 2023-07-27T14:37:07.332 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:07.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.333 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.48) 2023-07-27T14:37:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:07.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.420 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.48) 2023-07-27T14:37:07.507 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:07.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.509 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.48) 2023-07-27T14:37:07.555 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:07.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.557 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.57) 2023-07-27T14:37:07.640 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:07.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.642 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.57) 2023-07-27T14:37:07.728 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:07.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.730 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.57) 2023-07-27T14:37:07.775 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:07.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.777 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.57) 2023-07-27T14:37:07.863 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:07.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.867 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.57) 2023-07-27T14:37:07.912 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:07.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:07.914 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.57) 2023-07-27T14:37:08.000 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:08.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.002 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.57) 2023-07-27T14:37:08.087 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:08.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.088 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.57) 2023-07-27T14:37:08.173 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:08.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.175 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.6) 2023-07-27T14:37:08.261 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:08.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.263 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.6) 2023-07-27T14:37:08.309 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:08.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.311 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.6) 2023-07-27T14:37:08.357 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:08.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.358 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.6) 2023-07-27T14:37:08.443 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:08.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.445 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.6) 2023-07-27T14:37:08.530 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:08.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.532 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.6) 2023-07-27T14:37:08.616 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:08.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.618 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.6) 2023-07-27T14:37:08.704 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:08.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.705 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.6) 2023-07-27T14:37:08.751 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:08.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.753 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.53) 2023-07-27T14:37:08.839 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:08.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.840 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.53) 2023-07-27T14:37:08.926 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:08.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.928 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.53) 2023-07-27T14:37:08.974 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:08.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:08.975 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.53) 2023-07-27T14:37:09.061 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:09.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.062 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.53) 2023-07-27T14:37:09.147 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:09.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.148 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.53) 2023-07-27T14:37:09.234 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:09.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.235 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.53) 2023-07-27T14:37:09.321 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:09.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.322 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.53) 2023-07-27T14:37:09.367 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:09.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.369 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.40) 2023-07-27T14:37:09.454 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:09.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.456 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.40) 2023-07-27T14:37:09.541 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:09.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.543 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.40) 2023-07-27T14:37:09.588 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:09.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.590 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.40) 2023-07-27T14:37:09.675 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:09.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.677 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.40) 2023-07-27T14:37:09.722 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:09.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.725 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.40) 2023-07-27T14:37:09.811 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:09.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.813 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.40) 2023-07-27T14:37:09.858 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:09.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.859 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.40) 2023-07-27T14:37:09.945 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:09.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.946 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.42) 2023-07-27T14:37:09.991 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:09.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:09.993 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.42) 2023-07-27T14:37:10.080 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:10.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.081 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.42) 2023-07-27T14:37:10.127 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:10.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.128 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.42) 2023-07-27T14:37:10.177 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:10.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.178 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.42) 2023-07-27T14:37:10.262 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:10.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.264 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.42) 2023-07-27T14:37:10.350 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:10.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.352 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.42) 2023-07-27T14:37:10.399 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:10.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.400 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.42) 2023-07-27T14:37:10.487 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:10.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.488 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.0) 2023-07-27T14:37:10.573 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:10.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.574 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.0) 2023-07-27T14:37:10.621 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:10.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.622 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.0) 2023-07-27T14:37:10.667 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:10.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.669 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.0) 2023-07-27T14:37:10.755 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:10.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.756 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.0) 2023-07-27T14:37:10.842 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:10.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.843 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.0) 2023-07-27T14:37:10.888 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:10.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.890 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.0) 2023-07-27T14:37:10.975 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:10.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:10.976 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.0) 2023-07-27T14:37:11.022 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:11.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.023 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.27) 2023-07-27T14:37:11.069 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:11.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.070 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.27) 2023-07-27T14:37:11.158 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:11.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.160 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.27) 2023-07-27T14:37:11.205 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:11.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.206 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.27) 2023-07-27T14:37:11.252 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:11.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.254 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.27) 2023-07-27T14:37:11.340 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:11.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.341 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.27) 2023-07-27T14:37:11.387 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:11.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.390 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.27) 2023-07-27T14:37:11.436 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:11.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.437 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.27) 2023-07-27T14:37:11.523 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:11.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.524 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.25) 2023-07-27T14:37:11.610 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:11.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.611 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.25) 2023-07-27T14:37:11.700 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:11.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.701 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.25) 2023-07-27T14:37:11.748 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:11.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.749 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.25) 2023-07-27T14:37:11.835 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:11.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.837 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.25) 2023-07-27T14:37:11.882 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:11.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.884 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.25) 2023-07-27T14:37:11.970 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:11.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:11.971 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.25) 2023-07-27T14:37:12.057 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:12.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.058 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.25) 2023-07-27T14:37:12.104 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:12.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.106 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.32) 2023-07-27T14:37:12.192 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:12.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.193 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.32) 2023-07-27T14:37:12.280 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:12.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.281 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.32) 2023-07-27T14:37:12.327 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:12.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.328 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.32) 2023-07-27T14:37:12.414 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:12.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.416 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.32) 2023-07-27T14:37:12.461 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:12.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.463 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.32) 2023-07-27T14:37:12.509 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:12.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.511 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.32) 2023-07-27T14:37:12.595 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:12.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.597 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.32) 2023-07-27T14:37:12.683 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:12.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.684 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.28) 2023-07-27T14:37:12.769 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:12.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.770 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.28) 2023-07-27T14:37:12.858 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:12.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.861 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.28) 2023-07-27T14:37:12.908 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:12.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.910 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.28) 2023-07-27T14:37:12.995 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:12.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:12.996 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.28) 2023-07-27T14:37:13.081 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:13.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.083 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.28) 2023-07-27T14:37:13.169 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:13.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.171 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.28) 2023-07-27T14:37:13.216 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:13.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.218 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.28) 2023-07-27T14:37:13.302 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:13.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.304 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.21) 2023-07-27T14:37:13.389 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:13.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.390 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.21) 2023-07-27T14:37:13.478 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:13.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.479 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.21) 2023-07-27T14:37:13.524 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:13.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.526 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.21) 2023-07-27T14:37:13.610 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:13.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.612 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.21) 2023-07-27T14:37:13.698 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:13.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.700 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.21) 2023-07-27T14:37:13.785 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:13.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.787 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.21) 2023-07-27T14:37:13.874 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:13.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.876 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.21) 2023-07-27T14:37:13.923 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:13.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:13.924 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.9) 2023-07-27T14:37:14.009 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:14.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.010 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.9) 2023-07-27T14:37:14.056 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:14.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.058 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.9) 2023-07-27T14:37:14.142 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:14.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.144 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.9) 2023-07-27T14:37:14.229 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:14.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.231 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.9) 2023-07-27T14:37:14.316 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:14.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.318 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.9) 2023-07-27T14:37:14.403 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:14.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.405 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.9) 2023-07-27T14:37:14.451 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:14.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.452 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.9) 2023-07-27T14:37:14.498 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:14.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.499 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.23) 2023-07-27T14:37:14.585 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:14.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.588 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.23) 2023-07-27T14:37:14.635 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:14.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.637 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.23) 2023-07-27T14:37:14.683 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:14.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.684 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.23) 2023-07-27T14:37:14.773 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:14.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.774 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.23) 2023-07-27T14:37:14.860 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:14.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.862 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.23) 2023-07-27T14:37:14.908 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:14.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.911 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.23) 2023-07-27T14:37:14.957 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:14.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:14.959 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.23) 2023-07-27T14:37:15.004 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:15.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.006 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.15) 2023-07-27T14:37:15.091 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:15.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.093 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.15) 2023-07-27T14:37:15.179 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:15.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.180 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.15) 2023-07-27T14:37:15.225 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:15.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.227 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.15) 2023-07-27T14:37:15.314 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:15.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.442 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.15) 2023-07-27T14:37:15.488 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:15.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.490 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.15) 2023-07-27T14:37:15.579 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:15.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.582 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.15) 2023-07-27T14:37:15.674 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:15.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.676 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.15) 2023-07-27T14:37:15.763 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:15.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.765 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.8) 2023-07-27T14:37:15.852 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:15.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.854 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.8) 2023-07-27T14:37:15.900 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:15.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.902 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.8) 2023-07-27T14:37:15.948 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:15.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.949 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.8) 2023-07-27T14:37:15.995 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:15.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:15.997 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.8) 2023-07-27T14:37:16.082 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:16.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.083 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.8) 2023-07-27T14:37:16.169 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:16.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.170 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.8) 2023-07-27T14:37:16.256 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:16.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.258 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.8) 2023-07-27T14:37:16.343 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:16.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.345 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.46) 2023-07-27T14:37:16.390 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:16.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.392 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.46) 2023-07-27T14:37:16.480 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:16.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.482 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.46) 2023-07-27T14:37:16.528 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:16.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.530 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.46) 2023-07-27T14:37:16.616 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:16.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.617 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.46) 2023-07-27T14:37:16.702 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:16.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.703 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.46) 2023-07-27T14:37:16.788 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:16.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.790 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.46) 2023-07-27T14:37:16.875 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:16.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.876 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.46) 2023-07-27T14:37:16.962 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:16.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:16.964 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.33) 2023-07-27T14:37:17.009 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:17.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.010 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.33) 2023-07-27T14:37:17.057 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:17.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.059 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.33) 2023-07-27T14:37:17.104 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:17.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.106 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.33) 2023-07-27T14:37:17.151 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:17.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.152 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.33) 2023-07-27T14:37:17.197 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:17.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.199 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.33) 2023-07-27T14:37:17.283 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:17.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.285 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.33) 2023-07-27T14:37:17.370 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:17.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.371 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.33) 2023-07-27T14:37:17.417 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:17.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.419 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.45) 2023-07-27T14:37:17.464 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:17.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.466 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.45) 2023-07-27T14:37:17.512 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:17.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.513 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.45) 2023-07-27T14:37:17.598 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:17.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.601 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.45) 2023-07-27T14:37:17.686 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:17.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.688 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.45) 2023-07-27T14:37:17.734 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:17.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.736 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.45) 2023-07-27T14:37:17.782 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:17.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.784 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.45) 2023-07-27T14:37:17.869 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:17.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.870 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.45) 2023-07-27T14:37:17.956 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:17.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:17.958 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.61) 2023-07-27T14:37:18.003 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:18.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.004 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.61) 2023-07-27T14:37:18.091 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:18.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.093 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.61) 2023-07-27T14:37:18.179 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:18.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.182 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.61) 2023-07-27T14:37:18.265 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:18.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.268 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.61) 2023-07-27T14:37:18.312 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:18.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.314 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.61) 2023-07-27T14:37:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:18.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.404 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.61) 2023-07-27T14:37:18.489 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:18.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.490 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.61) 2023-07-27T14:37:18.576 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:18.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.578 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.62) 2023-07-27T14:37:18.624 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:18.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.626 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.62) 2023-07-27T14:37:18.712 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:18.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.714 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.62) 2023-07-27T14:37:18.760 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:18.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.761 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.62) 2023-07-27T14:37:18.848 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:18.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.850 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.62) 2023-07-27T14:37:18.895 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:18.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.897 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.62) 2023-07-27T14:37:18.982 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:18.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:18.985 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.62) 2023-07-27T14:37:19.070 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:19.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.071 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.62) 2023-07-27T14:37:19.156 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:19.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.157 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.52) 2023-07-27T14:37:19.242 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:19.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.244 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.52) 2023-07-27T14:37:19.290 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:19.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.292 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.52) 2023-07-27T14:37:19.376 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:19.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.378 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.52) 2023-07-27T14:37:19.463 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:19.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.465 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.52) 2023-07-27T14:37:19.550 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:19.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.552 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.52) 2023-07-27T14:37:19.637 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:19.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.52) 2023-07-27T14:37:19.684 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:19.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.686 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.52) 2023-07-27T14:37:19.731 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:19.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.733 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.11) 2023-07-27T14:37:19.818 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:19.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.820 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.11) 2023-07-27T14:37:19.867 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:19.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.869 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.11) 2023-07-27T14:37:19.915 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:19.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:19.917 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.11) 2023-07-27T14:37:20.002 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:20.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.004 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.11) 2023-07-27T14:37:20.049 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:20.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.051 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.11) 2023-07-27T14:37:20.136 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:20.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.138 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.11) 2023-07-27T14:37:20.223 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:20.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.224 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.11) 2023-07-27T14:37:20.310 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:20.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.313 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.44) 2023-07-27T14:37:20.397 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:20.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.399 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.44) 2023-07-27T14:37:20.447 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:20.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.449 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.44) 2023-07-27T14:37:20.494 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:20.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.496 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.44) 2023-07-27T14:37:20.582 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:20.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.583 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.44) 2023-07-27T14:37:20.629 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:20.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.631 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.44) 2023-07-27T14:37:20.716 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:20.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.718 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.44) 2023-07-27T14:37:20.763 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:20.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.765 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.44) 2023-07-27T14:37:20.851 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:20.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.853 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.3) 2023-07-27T14:37:20.899 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:20.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.900 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.3) 2023-07-27T14:37:20.988 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:20.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:20.989 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.3) 2023-07-27T14:37:21.073 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:21.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.075 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.3) 2023-07-27T14:37:21.160 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:21.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.162 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.3) 2023-07-27T14:37:21.207 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:21.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.209 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.3) 2023-07-27T14:37:21.294 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:21.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.295 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.3) 2023-07-27T14:37:21.381 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:21.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.382 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.3) 2023-07-27T14:37:21.467 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:21.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.469 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.24) 2023-07-27T14:37:21.555 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:21.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.556 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.24) 2023-07-27T14:37:21.642 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:21.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.644 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.24) 2023-07-27T14:37:21.689 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:21.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.692 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.24) 2023-07-27T14:37:21.777 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:21.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.779 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.24) 2023-07-27T14:37:21.866 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:21.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.868 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.24) 2023-07-27T14:37:21.915 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:21.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:21.916 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.24) 2023-07-27T14:37:22.001 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:22.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.003 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.24) 2023-07-27T14:37:22.048 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:22.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.051 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.56) 2023-07-27T14:37:22.134 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:22.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.136 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.56) 2023-07-27T14:37:22.222 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:22.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.224 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.56) 2023-07-27T14:37:22.269 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:22.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.271 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.56) 2023-07-27T14:37:22.357 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:22.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.359 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.56) 2023-07-27T14:37:22.405 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:22.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.407 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.56) 2023-07-27T14:37:22.491 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:22.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.493 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.56) 2023-07-27T14:37:22.578 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:22.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.579 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.56) 2023-07-27T14:37:22.665 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:22.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.667 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.63) 2023-07-27T14:37:22.712 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:22.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.715 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.63) 2023-07-27T14:37:22.801 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:22.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.803 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.63) 2023-07-27T14:37:22.849 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:22.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.852 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.63) 2023-07-27T14:37:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:22.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.899 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.63) 2023-07-27T14:37:22.984 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:22.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:22.986 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.63) 2023-07-27T14:37:23.031 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:23.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.033 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.63) 2023-07-27T14:37:23.078 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:23.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.080 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.63) 2023-07-27T14:37:23.126 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:23.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.128 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.59) 2023-07-27T14:37:23.213 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:23.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.216 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.59) 2023-07-27T14:37:23.263 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:23.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.265 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.59) 2023-07-27T14:37:23.310 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:23.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.312 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.59) 2023-07-27T14:37:23.357 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:23.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.359 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.59) 2023-07-27T14:37:23.405 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:23.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.407 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.59) 2023-07-27T14:37:23.492 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:23.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.494 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.59) 2023-07-27T14:37:23.578 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:23.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.580 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.59) 2023-07-27T14:37:23.625 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:23.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.627 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.41) 2023-07-27T14:37:23.673 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:23.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.674 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.41) 2023-07-27T14:37:23.722 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:23.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.723 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.41) 2023-07-27T14:37:23.809 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:23.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.811 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.41) 2023-07-27T14:37:23.896 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:23.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.898 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.41) 2023-07-27T14:37:23.985 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:23.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:23.986 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.41) 2023-07-27T14:37:24.034 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:24.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.035 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.41) 2023-07-27T14:37:24.121 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:24.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.122 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.41) 2023-07-27T14:37:24.168 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:24.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.171 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.12) 2023-07-27T14:37:24.255 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:24.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.257 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.12) 2023-07-27T14:37:24.303 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:24.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.305 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.12) 2023-07-27T14:37:24.351 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:24.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.352 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.12) 2023-07-27T14:37:24.402 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:24.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.404 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.12) 2023-07-27T14:37:24.489 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:24.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.491 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.12) 2023-07-27T14:37:24.538 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:24.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.540 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.12) 2023-07-27T14:37:24.586 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:24.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.588 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.12) 2023-07-27T14:37:24.673 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:24.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.675 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.43) 2023-07-27T14:37:24.721 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:24.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.722 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.43) 2023-07-27T14:37:24.808 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:24.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.810 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.43) 2023-07-27T14:37:24.857 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:24.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.858 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.43) 2023-07-27T14:37:24.905 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:24.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.906 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.43) 2023-07-27T14:37:24.991 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:24.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:24.993 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.43) 2023-07-27T14:37:25.039 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:25.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.040 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.43) 2023-07-27T14:37:25.125 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:25.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.127 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.43) 2023-07-27T14:37:25.172 INFO:teuthology.orchestra.run.smithi115.stdout:1690468600 2023-07-27T14:37:25.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.174 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.16) 2023-07-27T14:37:25.219 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:25.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.221 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.16) 2023-07-27T14:37:25.268 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:25.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.269 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.16) 2023-07-27T14:37:25.314 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:25.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.316 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.16) 2023-07-27T14:37:25.401 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:25.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.403 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.16) 2023-07-27T14:37:25.488 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:25.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.490 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.16) 2023-07-27T14:37:25.582 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:25.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.583 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.16) 2023-07-27T14:37:25.671 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:25.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.674 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.16) 2023-07-27T14:37:25.770 INFO:teuthology.orchestra.run.smithi115.stdout:1690468598 2023-07-27T14:37:25.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.772 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.31) 2023-07-27T14:37:25.864 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:25.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.866 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.31) 2023-07-27T14:37:25.958 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:25.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:25.961 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.31) 2023-07-27T14:37:26.007 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:26.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.010 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.31) 2023-07-27T14:37:26.099 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:26.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.101 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.31) 2023-07-27T14:37:26.190 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:26.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.191 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.31) 2023-07-27T14:37:26.281 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:26.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.282 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.31) 2023-07-27T14:37:26.331 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:26.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.333 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.31) 2023-07-27T14:37:26.422 INFO:teuthology.orchestra.run.smithi115.stdout:1690468599 2023-07-27T14:37:26.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.424 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.1) 2023-07-27T14:37:26.509 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:26.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.511 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.1) 2023-07-27T14:37:26.597 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:26.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.599 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.1) 2023-07-27T14:37:26.644 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:26.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.646 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.1) 2023-07-27T14:37:26.731 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:26.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.733 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.1) 2023-07-27T14:37:26.779 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:26.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.780 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.1) 2023-07-27T14:37:26.866 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:26.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.868 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.1) 2023-07-27T14:37:26.954 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:26.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:26.956 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.1) 2023-07-27T14:37:27.002 INFO:teuthology.orchestra.run.smithi115.stdout:1690468597 2023-07-27T14:37:27.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:27.004 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.60) 2023-07-27T14:37:27.050 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:27.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:27.052 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.60) 2023-07-27T14:37:27.138 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:37:27.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:27.141 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.60) 2023-07-27T14:37:27.187 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:27.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:27.189 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.60) 2023-07-27T14:37:27.274 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:37:27.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:27.276 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.60) 2023-07-27T14:37:27.362 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:27.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:27.365 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.60) 2023-07-27T14:37:27.411 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:37:27.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:27.414 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000016345/.snap/snapshot_0000000000060173/e5d8b453-5025-4cea-87a5-e052dbd36bd8/subvolume_file.60) 2023-07-27T14:37:27.498 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:27.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:27.500 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000769971/776fd6da-2289-4503-ace7-abbb599fccb7/subvolume_file.60) 2023-07-27T14:37:27.585 INFO:teuthology.orchestra.run.smithi115.stdout:1690468601 2023-07-27T14:37:27.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000016345 snapshot_0000000000060173 2023-07-27T14:37:27.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.769+0000 7f0462b9d700 1 Processor -- start 2023-07-27T14:37:27.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.769+0000 7f0462b9d700 1 -- start start 2023-07-27T14:37:27.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.770+0000 7f0462b9d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f045c0640f0 0x7f045c0644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:27.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.770+0000 7f0462b9d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c154500 con 0x7f045c0c5990 2023-07-27T14:37:27.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.770+0000 7f0462b9d700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c1547e0 con 0x7f045c14e610 2023-07-27T14:37:27.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.770+0000 7f0462b9d700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c154ac0 con 0x7f045c0640f0 2023-07-27T14:37:27.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.770+0000 7f046139a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f045c0c5990 0x7f045c14df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60972/0 (socket says 172.21.15.115:60972) 2023-07-27T14:37:27.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.770+0000 7f046139a700 1 -- 172.21.15.115:0/2977773767 learned_addr learned my addr 172.21.15.115:0/2977773767 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:27.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.770+0000 7f0461b9b700 1 --2- 172.21.15.115:0/2977773767 >> v2:172.21.15.159:3300/0 conn(0x7f045c0640f0 0x7f045c0644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:27.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147552049 0 0) 0x7f045c154500 con 0x7f045c0c5990 2023-07-27T14:37:27.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04480033f0 con 0x7f045c0c5990 2023-07-27T14:37:27.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353001084 0 0) 0x7f045c1547e0 con 0x7f045c14e610 2023-07-27T14:37:27.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f045c154500 con 0x7f045c14e610 2023-07-27T14:37:27.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1712814829 0 0) 0x7f04480033f0 con 0x7f045c0c5990 2023-07-27T14:37:27.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 >> v2:172.21.15.159:3300/0 conn(0x7f045c0640f0 msgr2=0x7f045c0644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:27.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 --2- 172.21.15.115:0/2977773767 >> v2:172.21.15.159:3300/0 conn(0x7f045c0640f0 0x7f045c0644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:27.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 >> v1:172.21.15.159:6789/0 conn(0x7f045c14e610 legacy=0x7f045c15dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:27.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c154da0 con 0x7f045c0c5990 2023-07-27T14:37:27.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f044c001470 con 0x7f045c0c5990 2023-07-27T14:37:27.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 >> v1:172.21.15.115:6789/0 conn(0x7f045c0c5990 legacy=0x7f045c14df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:27.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448003a70 0x7f0448003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:27.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0448004690 0x7f0448004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:27.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0448005000 0x7f044800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:27.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c154ac0 con 0x7f0448004690 2023-07-27T14:37:27.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044800be80 con 0x7f0448005000 2023-07-27T14:37:27.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044800c040 con 0x7f0448003a70 2023-07-27T14:37:27.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.771+0000 7f046139a700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0448004690 0x7f0448004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:27.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f046239c700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0448005000 0x7f044800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:27.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f0461b9b700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448003a70 0x7f0448003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:27.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f046139a700 1 -- 172.21.15.115:0/2977773767 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448003a70 msgr2=0x7f0448003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:27.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f046139a700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448003a70 0x7f0448003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:27.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f046139a700 1 -- 172.21.15.115:0/2977773767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0448005000 msgr2=0x7f044800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:27.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f046139a700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0448005000 0x7f044800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:27.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f046239c700 1 -- 172.21.15.115:0/2977773767 reap_dead start 2023-07-27T14:37:27.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f046139a700 1 -- 172.21.15.115:0/2977773767 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480033f0 con 0x7f0448004690 2023-07-27T14:37:27.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f046139a700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0448004690 0x7f0448004b10 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f044c00c160 tx=0x7f044c001e10).ready entity=mon.0 client_cookie=45da1c194d6e3879 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:27.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00c9d0 con 0x7f0448004690 2023-07-27T14:37:27.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c00cb30 con 0x7f0448004690 2023-07-27T14:37:27.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.772+0000 7f0460b99700 1 -- 172.21.15.115:0/2977773767 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0070d0 con 0x7f0448004690 2023-07-27T14:37:27.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.773+0000 7f0462b9d700 1 -- 172.21.15.115:0/2977773767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0448004690 msgr2=0x7f0448004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:27.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.773+0000 7f0462b9d700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0448004690 0x7f0448004b10 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f044c00c160 tx=0x7f044c001e10).stop 2023-07-27T14:37:27.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.773+0000 7f0462b9d700 1 -- 172.21.15.115:0/2977773767 shutdown_connections 2023-07-27T14:37:27.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.773+0000 7f0462b9d700 1 --2- 172.21.15.115:0/2977773767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0448004690 0x7f0448004b10 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:27.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.773+0000 7f0462b9d700 1 -- 172.21.15.115:0/2977773767 >> 172.21.15.115:0/2977773767 conn(0x7f045c0cb480 msgr2=0x7f045c0c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:27.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.773+0000 7f0462b9d700 1 -- 172.21.15.115:0/2977773767 shutdown_connections 2023-07-27T14:37:27.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.773+0000 7f0462b9d700 1 -- 172.21.15.115:0/2977773767 wait complete. 2023-07-27T14:37:27.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.774+0000 7f0462b9d700 1 Processor -- start 2023-07-27T14:37:27.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.774+0000 7f0462b9d700 1 -- start start 2023-07-27T14:37:27.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.775+0000 7f0462b9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448004690 0x7f045c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:27.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.775+0000 7f0462b9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f045c0ad960 0x7f045c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:27.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.775+0000 7f0462b9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f045c0c4020 0x7f045c0c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:27.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.775+0000 7f0462b9d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0aeda0 con 0x7f045c0c4020 2023-07-27T14:37:27.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.775+0000 7f0462b9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0ae190 con 0x7f045c0ad960 2023-07-27T14:37:27.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.775+0000 7f0462b9d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0ae470 con 0x7f0448004690 2023-07-27T14:37:27.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f045c0c4020 0x7f045c0c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:27.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f045c0c4020 0x7f045c0c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45126/0 (socket says 172.21.15.115:45126) 2023-07-27T14:37:27.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 -- 172.21.15.115:0/175878010 learned_addr learned my addr 172.21.15.115:0/175878010 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:27.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f0461b9b700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448004690 0x7f045c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:27.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046139a700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f045c0ad960 0x7f045c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:27.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 -- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448004690 msgr2=0x7f045c0c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:27.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448004690 0x7f045c0c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:27.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 -- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f045c0ad960 msgr2=0x7f045c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:27.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f045c0ad960 0x7f045c14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:27.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 -- 172.21.15.115:0/175878010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0ae750 con 0x7f045c0c4020 2023-07-27T14:37:27.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046139a700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f045c0ad960 0x7f045c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:27.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f046239c700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f045c0c4020 0x7f045c0c4460 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f04540012e0 tx=0x7f0454009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:27.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f0451ffb700 1 -- 172.21.15.115:0/175878010 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04540030d0 con 0x7f045c0c4020 2023-07-27T14:37:27.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f0451ffb700 1 -- 172.21.15.115:0/175878010 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0454003230 con 0x7f045c0c4020 2023-07-27T14:37:27.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c0aea30 con 0x7f045c0c4020 2023-07-27T14:37:27.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.776+0000 7f0451ffb700 1 -- 172.21.15.115:0/175878010 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04540018f0 con 0x7f045c0c4020 2023-07-27T14:37:27.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.777+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c0c4950 con 0x7f045c0c4020 2023-07-27T14:37:27.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.778+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c0aef50 con 0x7f045c0c4020 2023-07-27T14:37:27.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.778+0000 7f0451ffb700 1 -- 172.21.15.115:0/175878010 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7f045401c060 con 0x7f045c0c4020 2023-07-27T14:37:27.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.779+0000 7f0451ffb700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f044005f960 0x7f0440061e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:27.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.779+0000 7f0451ffb700 1 -- 172.21.15.115:0/175878010 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f045407a7b0 con 0x7f045c0c4020 2023-07-27T14:37:27.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.779+0000 7f0461b9b700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f044005f960 0x7f0440061e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:27.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.780+0000 7f0461b9b700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f044005f960 0x7f0440061e20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f045c061a00 tx=0x7f0458008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:27.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:27.784+0000 7f0451ffb700 1 -- 172.21.15.115:0/175878010 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f045c0aef50 con 0x7f045c0c4020 2023-07-27T14:37:28.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.011+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000016345", "snap_name": "snapshot_0000000000060173", "target": ["mon-mgr", ""]}) v1 -- 0x7f045c0831c0 con 0x7f044005f960 2023-07-27T14:37:28.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.047+0000 7f0451ffb700 1 -- 172.21.15.115:0/175878010 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f045c0831c0 con 0x7f044005f960 2023-07-27T14:37:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f044005f960 msgr2=0x7f0440061e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f044005f960 0x7f0440061e20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f045c061a00 tx=0x7f0458008040).stop 2023-07-27T14:37:28.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f045c0c4020 msgr2=0x7f045c0c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f045c0c4020 0x7f045c0c4460 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f04540012e0 tx=0x7f0454009040).stop 2023-07-27T14:37:28.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 shutdown_connections 2023-07-27T14:37:28.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f044005f960 0x7f0440061e20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f045c0c4020 0x7f045c0c4460 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0448004690 0x7f045c0c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 --2- 172.21.15.115:0/175878010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f045c0ad960 0x7f045c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 >> 172.21.15.115:0/175878010 conn(0x7f045c0cb480 msgr2=0x7f045c0c06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:28.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 shutdown_connections 2023-07-27T14:37:28.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.049+0000 7f0462b9d700 1 -- 172.21.15.115:0/175878010 wait complete. 2023-07-27T14:37:28.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000016345 2023-07-27T14:37:28.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.259+0000 7f1461fff700 1 Processor -- start 2023-07-27T14:37:28.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.259+0000 7f1461fff700 1 -- start start 2023-07-27T14:37:28.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.260+0000 7f1461fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f145c14ae00 0x7f145c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.260+0000 7f1461fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c1553f0 con 0x7f145c063260 2023-07-27T14:37:28.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.260+0000 7f1461fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c157a50 con 0x7f145c14b1e0 2023-07-27T14:37:28.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.260+0000 7f1461fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c157d10 con 0x7f145c14ae00 2023-07-27T14:37:28.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.260+0000 7f145b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f145c14ae00 0x7f145c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.260+0000 7f145b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f145c14ae00 0x7f145c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45130/0 (socket says 172.21.15.115:45130) 2023-07-27T14:37:28.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.260+0000 7f145b7fe700 1 -- 172.21.15.115:0/181820591 learned_addr learned my addr 172.21.15.115:0/181820591 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:28.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.260+0000 7f145bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f145c063260 0x7f145c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60978/0 (socket says 172.21.15.115:60978) 2023-07-27T14:37:28.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.261+0000 7f145b7fe700 1 -- 172.21.15.115:0/181820591 >> v1:172.21.15.159:6789/0 conn(0x7f145c14b1e0 legacy=0x7f145c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.261+0000 7f145b7fe700 1 -- 172.21.15.115:0/181820591 >> v1:172.21.15.115:6789/0 conn(0x7f145c063260 legacy=0x7f145c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.261+0000 7f145b7fe700 1 -- 172.21.15.115:0/181820591 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c157ff0 con 0x7f145c14ae00 2023-07-27T14:37:28.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.261+0000 7f145b7fe700 1 --2- 172.21.15.115:0/181820591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14ae00 0x7f145c154f00 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f144c006fd0 tx=0x7f144c0090f0).ready entity=mon.0 client_cookie=38999040f135b325 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:28.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.261+0000 7f145a7fc700 1 -- 172.21.15.115:0/181820591 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00b600 con 0x7f145c14ae00 2023-07-27T14:37:28.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.261+0000 7f145a7fc700 1 -- 172.21.15.115:0/181820591 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c00b760 con 0x7f145c14ae00 2023-07-27T14:37:28.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.261+0000 7f145a7fc700 1 -- 172.21.15.115:0/181820591 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00bae0 con 0x7f145c14ae00 2023-07-27T14:37:28.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.262+0000 7f1461fff700 1 -- 172.21.15.115:0/181820591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14ae00 msgr2=0x7f145c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.262+0000 7f1461fff700 1 --2- 172.21.15.115:0/181820591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14ae00 0x7f145c154f00 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f144c006fd0 tx=0x7f144c0090f0).stop 2023-07-27T14:37:28.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.262+0000 7f1461fff700 1 -- 172.21.15.115:0/181820591 shutdown_connections 2023-07-27T14:37:28.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.262+0000 7f1461fff700 1 --2- 172.21.15.115:0/181820591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14ae00 0x7f145c154f00 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.262+0000 7f1461fff700 1 -- 172.21.15.115:0/181820591 >> 172.21.15.115:0/181820591 conn(0x7f145c05e940 msgr2=0x7f145c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:28.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.262+0000 7f1461fff700 1 -- 172.21.15.115:0/181820591 shutdown_connections 2023-07-27T14:37:28.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.262+0000 7f1461fff700 1 -- 172.21.15.115:0/181820591 wait complete. 2023-07-27T14:37:28.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.263+0000 7f1461fff700 1 Processor -- start 2023-07-27T14:37:28.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.263+0000 7f1461fff700 1 -- start start 2023-07-27T14:37:28.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.264+0000 7f1461fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f145c063260 0x7f145c1497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.264+0000 7f1461fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f145c14ae00 0x7f145c0c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.264+0000 7f1461fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14b1e0 0x7f145c0c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.264+0000 7f1461fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0c6090 con 0x7f145c14b1e0 2023-07-27T14:37:28.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.264+0000 7f1461fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0aecc0 con 0x7f145c14ae00 2023-07-27T14:37:28.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.264+0000 7f1461fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0afb00 con 0x7f145c063260 2023-07-27T14:37:28.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14b1e0 0x7f145c0c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14b1e0 0x7f145c0c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45146/0 (socket says 172.21.15.115:45146) 2023-07-27T14:37:28.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 -- 172.21.15.115:0/1946014133 learned_addr learned my addr 172.21.15.115:0/1946014133 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:28.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145b7fe700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f145c063260 0x7f145c1497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145affd700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f145c14ae00 0x7f145c0c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 -- 172.21.15.115:0/1946014133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f145c063260 msgr2=0x7f145c1497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f145c063260 0x7f145c1497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 -- 172.21.15.115:0/1946014133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f145c14ae00 msgr2=0x7f145c0c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f145c14ae00 0x7f145c0c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 -- 172.21.15.115:0/1946014133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c009370 con 0x7f145c14b1e0 2023-07-27T14:37:28.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f145bfff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14b1e0 0x7f145c0c5ba0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f145400c7c0 tx=0x7f14540014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:28.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f14437fe700 1 -- 172.21.15.115:0/1946014133 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1454005c70 con 0x7f145c14b1e0 2023-07-27T14:37:28.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f14437fe700 1 -- 172.21.15.115:0/1946014133 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1454005dd0 con 0x7f145c14b1e0 2023-07-27T14:37:28.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c0ac9a0 con 0x7f145c14b1e0 2023-07-27T14:37:28.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.265+0000 7f14437fe700 1 -- 172.21.15.115:0/1946014133 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14540072e0 con 0x7f145c14b1e0 2023-07-27T14:37:28.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.266+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c0af4b0 con 0x7f145c14b1e0 2023-07-27T14:37:28.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.267+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c06c470 con 0x7f145c14b1e0 2023-07-27T14:37:28.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.267+0000 7f14437fe700 1 -- 172.21.15.115:0/1946014133 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7f1454010070 con 0x7f145c14b1e0 2023-07-27T14:37:28.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.268+0000 7f14437fe700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f144805f930 0x7f1448061df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.268+0000 7f14437fe700 1 -- 172.21.15.115:0/1946014133 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f145407a640 con 0x7f145c14b1e0 2023-07-27T14:37:28.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.268+0000 7f145b7fe700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f144805f930 0x7f1448061df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.269+0000 7f145b7fe700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f144805f930 0x7f1448061df0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f144c009130 tx=0x7f144c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:28.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.272+0000 7f14437fe700 1 -- 172.21.15.115:0/1946014133 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f145404ae90 con 0x7f145c14b1e0 2023-07-27T14:37:28.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.471+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000016345", "target": ["mon-mgr", ""]}) v1 -- 0x7f145c0afc40 con 0x7f144805f930 2023-07-27T14:37:28.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.491+0000 7f14437fe700 1 -- 172.21.15.115:0/1946014133 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f145c0afc40 con 0x7f144805f930 2023-07-27T14:37:28.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f144805f930 msgr2=0x7f1448061df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f144805f930 0x7f1448061df0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f144c009130 tx=0x7f144c017000).stop 2023-07-27T14:37:28.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14b1e0 msgr2=0x7f145c0c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14b1e0 0x7f145c0c5ba0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f145400c7c0 tx=0x7f14540014e0).stop 2023-07-27T14:37:28.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 shutdown_connections 2023-07-27T14:37:28.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f144805f930 0x7f1448061df0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f145c14b1e0 0x7f145c0c5ba0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f145c063260 0x7f145c1497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 --2- 172.21.15.115:0/1946014133 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f145c14ae00 0x7f145c0c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 >> 172.21.15.115:0/1946014133 conn(0x7f145c05e940 msgr2=0x7f145c0c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 shutdown_connections 2023-07-27T14:37:28.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.493+0000 7f1461fff700 1 -- 172.21.15.115:0/1946014133 wait complete. 2023-07-27T14:37:28.545 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.495+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.545 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.495+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.545 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.495+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.546 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.495+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.546 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.495+0000 7fa785115700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000769971 2023-07-27T14:37:28.563 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.513+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.563 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.513+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.563 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.513+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.563 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.513+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.563 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:37:28.513+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:37:28.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.717+0000 7fb1b4fff700 1 Processor -- start 2023-07-27T14:37:28.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.717+0000 7fb1b4fff700 1 -- start start 2023-07-27T14:37:28.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1b4fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1b014f740 0x7fb1b014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1b4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b00a5850 0x7fb1b00a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1b4fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb1b00c31e0 0x7fb1b00c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1b4fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b0069f70 con 0x7fb1b014f740 2023-07-27T14:37:28.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1b4fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b01530d0 con 0x7fb1b00c31e0 2023-07-27T14:37:28.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1b4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00a61c0 con 0x7fb1b00a5850 2023-07-27T14:37:28.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1ae59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1b014f740 0x7fb1b014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1ae59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1b014f740 0x7fb1b014fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45212/0 (socket says 172.21.15.115:45212) 2023-07-27T14:37:28.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1ae59c700 1 -- 172.21.15.115:0/1098250817 learned_addr learned my addr 172.21.15.115:0/1098250817 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:28.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1add9b700 1 --2- 172.21.15.115:0/1098250817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b00a5850 0x7fb1b00a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1aed9d700 1 --2- 172.21.15.115:0/1098250817 >> v2:172.21.15.159:3300/0 conn(0x7fb1b00c31e0 0x7fb1b00c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1ae59c700 1 -- 172.21.15.115:0/1098250817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b00a5850 msgr2=0x7fb1b00a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:28.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1ae59c700 1 --2- 172.21.15.115:0/1098250817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b00a5850 0x7fb1b00a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1ae59c700 1 -- 172.21.15.115:0/1098250817 >> v2:172.21.15.159:3300/0 conn(0x7fb1b00c31e0 msgr2=0x7fb1b00c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.719+0000 7fb1ae59c700 1 --2- 172.21.15.115:0/1098250817 >> v2:172.21.15.159:3300/0 conn(0x7fb1b00c31e0 0x7fb1b00c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.720+0000 7fb1ae59c700 1 -- 172.21.15.115:0/1098250817 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00c3b60 con 0x7fb1b014f740 2023-07-27T14:37:28.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.720+0000 7fb1ae59c700 1 --2- 172.21.15.115:0/1098250817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b014f740 0x7fb1b014fb20 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fb1b00c43b0 tx=0x7fb1a00090f0).ready entity=mon.0 client_cookie=62b8c377157012e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:28.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.720+0000 7fb1ad59a700 1 -- 172.21.15.115:0/1098250817 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000f510 con 0x7fb1b014f740 2023-07-27T14:37:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.720+0000 7fb1ad59a700 1 -- 172.21.15.115:0/1098250817 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a000f670 con 0x7fb1b014f740 2023-07-27T14:37:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.720+0000 7fb1ad59a700 1 -- 172.21.15.115:0/1098250817 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000fa10 con 0x7fb1b014f740 2023-07-27T14:37:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.720+0000 7fb1b4fff700 1 -- 172.21.15.115:0/1098250817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b014f740 msgr2=0x7fb1b014fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.720+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/1098250817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b014f740 0x7fb1b014fb20 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fb1b00c43b0 tx=0x7fb1a00090f0).stop 2023-07-27T14:37:28.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.721+0000 7fb1b4fff700 1 -- 172.21.15.115:0/1098250817 shutdown_connections 2023-07-27T14:37:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.721+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/1098250817 >> v2:172.21.15.159:3300/0 conn(0x7fb1b00c31e0 0x7fb1b00c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.721+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/1098250817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b014f740 0x7fb1b014fb20 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.721+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/1098250817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b00a5850 0x7fb1b00a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.721+0000 7fb1b4fff700 1 -- 172.21.15.115:0/1098250817 >> 172.21.15.115:0/1098250817 conn(0x7fb1b0062320 msgr2=0x7fb1b0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.721+0000 7fb1b4fff700 1 -- 172.21.15.115:0/1098250817 shutdown_connections 2023-07-27T14:37:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.721+0000 7fb1b4fff700 1 -- 172.21.15.115:0/1098250817 wait complete. 2023-07-27T14:37:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.722+0000 7fb1b4fff700 1 Processor -- start 2023-07-27T14:37:28.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.722+0000 7fb1b4fff700 1 -- start start 2023-07-27T14:37:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.723+0000 7fb1b4fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1b00a5850 0x7fb1b0143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.723+0000 7fb1b4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b00c31e0 0x7fb1b00c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.723+0000 7fb1b4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b014f740 0x7fb1b00c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.723+0000 7fb1b4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00c1db0 con 0x7fb1b00c31e0 2023-07-27T14:37:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.723+0000 7fb1b4fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0143af0 con 0x7fb1b00a5850 2023-07-27T14:37:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.723+0000 7fb1b4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00c2730 con 0x7fb1b014f740 2023-07-27T14:37:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.723+0000 7fb1add9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b00c31e0 0x7fb1b00c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1b00a5850 0x7fb1b0143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1aed9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b014f740 0x7fb1b00c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1add9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b00c31e0 0x7fb1b00c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45218/0 (socket says 172.21.15.115:45218) 2023-07-27T14:37:28.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1add9b700 1 -- 172.21.15.115:0/3548108701 learned_addr learned my addr 172.21.15.115:0/3548108701 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:28.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1b00a5850 0x7fb1b0143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:37970/0 (socket says 172.21.15.115:37970) 2023-07-27T14:37:28.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1add9b700 1 -- 172.21.15.115:0/3548108701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b014f740 msgr2=0x7fb1b00c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1add9b700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b014f740 0x7fb1b00c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1add9b700 1 -- 172.21.15.115:0/3548108701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1b00a5850 msgr2=0x7fb1b0143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:28.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1add9b700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1b00a5850 0x7fb1b0143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:28.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1add9b700 1 -- 172.21.15.115:0/3548108701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0009370 con 0x7fb1b00c31e0 2023-07-27T14:37:28.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1aed9d700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b014f740 0x7fb1b00c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:37:28.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1add9b700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b00c31e0 0x7fb1b00c2240 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fb1a400e930 tx=0x7fb1a4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:28.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb19e7fc700 1 -- 172.21.15.115:0/3548108701 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4012600 con 0x7fb1b00c31e0 2023-07-27T14:37:28.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb19e7fc700 1 -- 172.21.15.115:0/3548108701 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4012760 con 0x7fb1b00c31e0 2023-07-27T14:37:28.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b00c11a0 con 0x7fb1b00c31e0 2023-07-27T14:37:28.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.724+0000 7fb19e7fc700 1 -- 172.21.15.115:0/3548108701 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4012ae0 con 0x7fb1b00c31e0 2023-07-27T14:37:28.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.725+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b00c1760 con 0x7fb1b00c31e0 2023-07-27T14:37:28.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.726+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b00c1f20 con 0x7fb1b00c31e0 2023-07-27T14:37:28.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.726+0000 7fb19e7fc700 1 -- 172.21.15.115:0/3548108701 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 29) v1 ==== 76922+0+0 (secure 0 0 0) 0x7fb1a4022070 con 0x7fb1b00c31e0 2023-07-27T14:37:28.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.727+0000 7fb19e7fc700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb19005f930 0x7fb190061df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:28.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.727+0000 7fb19e7fc700 1 -- 172.21.15.115:0/3548108701 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fb1a407b260 con 0x7fb1b00c31e0 2023-07-27T14:37:28.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.728+0000 7fb1ae59c700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb19005f930 0x7fb190061df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:28.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.728+0000 7fb1ae59c700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb19005f930 0x7fb190061df0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fb1b00c43b0 tx=0x7fb1a0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:28.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.732+0000 7fb19e7fc700 1 -- 172.21.15.115:0/3548108701 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb1a404bab0 con 0x7fb1b00c31e0 2023-07-27T14:37:28.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.947+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000769971", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1b0065270 con 0x7fb19005f930 2023-07-27T14:37:29.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.966+0000 7fb19e7fc700 1 -- 172.21.15.115:0/3548108701 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb1b0065270 con 0x7fb19005f930 2023-07-27T14:37:29.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb19005f930 msgr2=0x7fb190061df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:29.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb19005f930 0x7fb190061df0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fb1b00c43b0 tx=0x7fb1a0016000).stop 2023-07-27T14:37:29.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b00c31e0 msgr2=0x7fb1b00c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:29.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b00c31e0 0x7fb1b00c2240 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fb1a400e930 tx=0x7fb1a4009060).stop 2023-07-27T14:37:29.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 shutdown_connections 2023-07-27T14:37:29.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb19005f930 0x7fb190061df0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:29.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1b014f740 0x7fb1b00c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:29.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1b00a5850 0x7fb1b0143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:29.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 --2- 172.21.15.115:0/3548108701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b00c31e0 0x7fb1b00c2240 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:29.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 >> 172.21.15.115:0/3548108701 conn(0x7fb1b0062320 msgr2=0x7fb1b0154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:29.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 shutdown_connections 2023-07-27T14:37:29.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:28.969+0000 7fb1b4fff700 1 -- 172.21.15.115:0/3548108701 wait complete. 2023-07-27T14:37:29.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:29.037 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:37:29.129 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-07-27T14:37:31.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:37:31.456 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:37:34.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:34.131 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:37:34.228 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:37:34.229 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:37:34.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:37:34.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:37:34.436 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:37:34.436 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:37:34.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:34.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:37:34.554 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:37:34.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:34.555 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:37:34.605 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:37:34.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:37:34.606 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:37:34.693 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:37:34.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:34.694 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:37:34.741 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:37:34.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.882+0000 7fa3547ff700 1 Processor -- start 2023-07-27T14:37:34.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.882+0000 7fa3547ff700 1 -- start start 2023-07-27T14:37:34.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.884+0000 7fa3547ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa34c1542a0 0x7fa34c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.884+0000 7fa3547ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34c0aa4d0 con 0x7fa34c0aaa40 2023-07-27T14:37:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.884+0000 7fa3547ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34c0c05c0 con 0x7fa34c153ec0 2023-07-27T14:37:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.884+0000 7fa3547ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34c0c1a60 con 0x7fa34c1542a0 2023-07-27T14:37:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.884+0000 7fa351d9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa34c0aaa40 0x7fa34c0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41638/0 (socket says 172.21.15.115:41638) 2023-07-27T14:37:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.884+0000 7fa351d9a700 1 -- 172.21.15.115:0/2266306430 learned_addr learned my addr 172.21.15.115:0/2266306430 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.884+0000 7fa352d9c700 1 --2- 172.21.15.115:0/2266306430 >> v2:172.21.15.115:3300/0 conn(0x7fa34c1542a0 0x7fa34c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:34.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa351599700 1 -- 172.21.15.115:0/2266306430 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167210469 0 0) 0x7fa33c001110 con 0x7fa34c0aaa40 2023-07-27T14:37:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa351599700 1 -- 172.21.15.115:0/2266306430 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3380033f0 con 0x7fa34c0aaa40 2023-07-27T14:37:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa352d9c700 1 -- 172.21.15.115:0/2266306430 >> v1:172.21.15.159:6789/0 conn(0x7fa34c153ec0 legacy=0x7fa34c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa352d9c700 1 -- 172.21.15.115:0/2266306430 >> v1:172.21.15.115:6789/0 conn(0x7fa34c0aaa40 legacy=0x7fa34c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa352d9c700 1 -- 172.21.15.115:0/2266306430 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c0aa270 con 0x7fa34c1542a0 2023-07-27T14:37:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa352d9c700 1 --2- 172.21.15.115:0/2266306430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c15efc0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7fa344009e60 tx=0x7fa344009780).ready entity=mon.0 client_cookie=ce237881bcee7dde server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:34.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa351599700 1 -- 172.21.15.115:0/2266306430 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400e070 con 0x7fa34c1542a0 2023-07-27T14:37:34.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa351599700 1 -- 172.21.15.115:0/2266306430 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34400bb60 con 0x7fa34c1542a0 2023-07-27T14:37:34.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.885+0000 7fa351599700 1 -- 172.21.15.115:0/2266306430 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344012410 con 0x7fa34c1542a0 2023-07-27T14:37:34.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.886+0000 7fa3547ff700 1 -- 172.21.15.115:0/2266306430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 msgr2=0x7fa34c15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:34.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.886+0000 7fa3547ff700 1 --2- 172.21.15.115:0/2266306430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c15efc0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7fa344009e60 tx=0x7fa344009780).stop 2023-07-27T14:37:34.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.886+0000 7fa3547ff700 1 -- 172.21.15.115:0/2266306430 shutdown_connections 2023-07-27T14:37:34.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.886+0000 7fa3547ff700 1 --2- 172.21.15.115:0/2266306430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c15efc0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:34.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.886+0000 7fa3547ff700 1 -- 172.21.15.115:0/2266306430 >> 172.21.15.115:0/2266306430 conn(0x7fa34c0cb610 msgr2=0x7fa34c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:34.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.886+0000 7fa3547ff700 1 -- 172.21.15.115:0/2266306430 shutdown_connections 2023-07-27T14:37:34.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.886+0000 7fa3547ff700 1 -- 172.21.15.115:0/2266306430 wait complete. 2023-07-27T14:37:34.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.887+0000 7fa3547ff700 1 Processor -- start 2023-07-27T14:37:34.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.887+0000 7fa3547ff700 1 -- start start 2023-07-27T14:37:34.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.888+0000 7fa3547ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa34c0aaa40 0x7fa34c13aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:34.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.888+0000 7fa3547ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa34c153ec0 0x7fa34c0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:34.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.888+0000 7fa3547ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:34.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.888+0000 7fa3547ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c0c4d50 con 0x7fa34c1542a0 2023-07-27T14:37:34.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.888+0000 7fa3547ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c0c42b0 con 0x7fa34c153ec0 2023-07-27T14:37:34.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.888+0000 7fa3547ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c0c1f80 con 0x7fa34c0aaa40 2023-07-27T14:37:34.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa352d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa352d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c0c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52140/0 (socket says 172.21.15.115:52140) 2023-07-27T14:37:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa352d9c700 1 -- 172.21.15.115:0/2074489718 learned_addr learned my addr 172.21.15.115:0/2074489718 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa351d9a700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa34c153ec0 0x7fa34c0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa35259b700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa34c0aaa40 0x7fa34c13aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa352d9c700 1 -- 172.21.15.115:0/2074489718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa34c0aaa40 msgr2=0x7fa34c13aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa352d9c700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa34c0aaa40 0x7fa34c13aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:34.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa352d9c700 1 -- 172.21.15.115:0/2074489718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa34c153ec0 msgr2=0x7fa34c0c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:34.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa352d9c700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa34c153ec0 0x7fa34c0c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:34.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.889+0000 7fa352d9c700 1 -- 172.21.15.115:0/2074489718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa344009a20 con 0x7fa34c1542a0 2023-07-27T14:37:34.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.890+0000 7fa352d9c700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c0c3dc0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7fa344011000 tx=0x7fa34c0c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:34.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.890+0000 7fa3427fc700 1 -- 172.21.15.115:0/2074489718 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34401d630 con 0x7fa34c1542a0 2023-07-27T14:37:34.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.890+0000 7fa3427fc700 1 -- 172.21.15.115:0/2074489718 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34401d790 con 0x7fa34c1542a0 2023-07-27T14:37:34.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.890+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34c0c44b0 con 0x7fa34c1542a0 2023-07-27T14:37:34.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.890+0000 7fa3427fc700 1 -- 172.21.15.115:0/2074489718 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34401db10 con 0x7fa34c1542a0 2023-07-27T14:37:34.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.890+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34c0c4a70 con 0x7fa34c1542a0 2023-07-27T14:37:34.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.891+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34c06c470 con 0x7fa34c1542a0 2023-07-27T14:37:34.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.892+0000 7fa3427fc700 1 -- 172.21.15.115:0/2074489718 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fa344027460 con 0x7fa34c1542a0 2023-07-27T14:37:34.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.892+0000 7fa3427fc700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33005f9f0 0x7fa330061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:34.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.893+0000 7fa3427fc700 1 -- 172.21.15.115:0/2074489718 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa34407cf60 con 0x7fa34c1542a0 2023-07-27T14:37:34.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.893+0000 7fa35259b700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33005f9f0 0x7fa330061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:34.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.893+0000 7fa35259b700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33005f9f0 0x7fa330061eb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fa3480036d0 tx=0x7fa348009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:34.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:34.897+0000 7fa3427fc700 1 -- 172.21.15.115:0/2074489718 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3440510b0 con 0x7fa34c1542a0 2023-07-27T14:37:35.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.105+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa34c0bfc90 con 0x7fa34c1542a0 2023-07-27T14:37:35.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.105+0000 7fa3427fc700 1 -- 172.21.15.115:0/2074489718 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fa344050ca0 con 0x7fa34c1542a0 2023-07-27T14:37:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:35.156 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2898407097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2898407097},{"type":"v1","addr":"172.21.15.115:6837","nonce":2898407097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6929,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/112108246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":112108246},{"type":"v1","addr":"172.21.15.159:6835","nonce":112108246}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/680715955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":680715955},{"type":"v1","addr":"172.21.15.115:6836","nonce":680715955}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:36:26.258376+0000","modified":"2023-07-27T14:36:29.273687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7807},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7807":{"gid":7807,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/3102980678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3102980678},{"type":"v1","addr":"172.21.15.159:6834","nonce":3102980678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-07-27T14:37:35.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.107+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33005f9f0 msgr2=0x7fa330061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.107+0000 7fa3547ff700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33005f9f0 0x7fa330061eb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fa3480036d0 tx=0x7fa348009040).stop 2023-07-27T14:37:35.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.107+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 msgr2=0x7fa34c0c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.107+0000 7fa3547ff700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c0c3dc0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7fa344011000 tx=0x7fa34c0c0530).stop 2023-07-27T14:37:35.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.108+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 shutdown_connections 2023-07-27T14:37:35.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.108+0000 7fa3547ff700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33005f9f0 0x7fa330061eb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.108+0000 7fa3547ff700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa34c1542a0 0x7fa34c0c3dc0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.108+0000 7fa3547ff700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa34c0aaa40 0x7fa34c13aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.108+0000 7fa3547ff700 1 --2- 172.21.15.115:0/2074489718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa34c153ec0 0x7fa34c0c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.108+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 >> 172.21.15.115:0/2074489718 conn(0x7fa34c0cb610 msgr2=0x7fa34c0ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:35.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.108+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 shutdown_connections 2023-07-27T14:37:35.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.108+0000 7fa3547ff700 1 -- 172.21.15.115:0/2074489718 wait complete. 2023-07-27T14:37:35.161 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 85 2023-07-27T14:37:35.175 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:37:35.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.313+0000 7f49bf9ff700 1 Processor -- start 2023-07-27T14:37:35.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.314+0000 7f49bf9ff700 1 -- start start 2023-07-27T14:37:35.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bf9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49b80aaa40 0x7f49b80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bf9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f49b81542a0 0x7f49b80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bf9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b80aa4d0 con 0x7f49b8153ec0 2023-07-27T14:37:35.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bf9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b8064ad0 con 0x7f49b80aaa40 2023-07-27T14:37:35.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bf9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b80c05c0 con 0x7f49b81542a0 2023-07-27T14:37:35.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bcf9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49b80aaa40 0x7f49b80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bcf9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49b80aaa40 0x7f49b80640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52156/0 (socket says 172.21.15.115:52156) 2023-07-27T14:37:35.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bcf9a700 1 -- 172.21.15.115:0/2697261142 learned_addr learned my addr 172.21.15.115:0/2697261142 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:35.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bdf9c700 1 --2- 172.21.15.115:0/2697261142 >> v2:172.21.15.159:3300/0 conn(0x7f49b81542a0 0x7f49b80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bcf9a700 1 -- 172.21.15.115:0/2697261142 >> v2:172.21.15.159:3300/0 conn(0x7f49b81542a0 msgr2=0x7f49b80645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:35.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.315+0000 7f49bcf9a700 1 --2- 172.21.15.115:0/2697261142 >> v2:172.21.15.159:3300/0 conn(0x7f49b81542a0 0x7f49b80645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.316+0000 7f49bcf9a700 1 -- 172.21.15.115:0/2697261142 >> v1:172.21.15.159:6789/0 conn(0x7f49b8153ec0 legacy=0x7f49b80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:35.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.316+0000 7f49bcf9a700 1 -- 172.21.15.115:0/2697261142 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80c1a60 con 0x7f49b80aaa40 2023-07-27T14:37:35.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.316+0000 7f49bcf9a700 1 --2- 172.21.15.115:0/2697261142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80640f0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f49b80c5470 tx=0x7f49a80090f0).ready entity=mon.0 client_cookie=d6808334444d3731 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:35.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.316+0000 7f49affff700 1 -- 172.21.15.115:0/2697261142 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a800b5a0 con 0x7f49b80aaa40 2023-07-27T14:37:35.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.316+0000 7f49affff700 1 -- 172.21.15.115:0/2697261142 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a800b700 con 0x7f49b80aaa40 2023-07-27T14:37:35.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.316+0000 7f49affff700 1 -- 172.21.15.115:0/2697261142 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a800ba80 con 0x7f49b80aaa40 2023-07-27T14:37:35.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.316+0000 7f49bf9ff700 1 -- 172.21.15.115:0/2697261142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 msgr2=0x7f49b80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.316+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/2697261142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80640f0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f49b80c5470 tx=0x7f49a80090f0).stop 2023-07-27T14:37:35.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.317+0000 7f49bf9ff700 1 -- 172.21.15.115:0/2697261142 shutdown_connections 2023-07-27T14:37:35.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.317+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/2697261142 >> v2:172.21.15.159:3300/0 conn(0x7f49b81542a0 0x7f49b80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.317+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/2697261142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80640f0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.317+0000 7f49bf9ff700 1 -- 172.21.15.115:0/2697261142 >> 172.21.15.115:0/2697261142 conn(0x7f49b80cb610 msgr2=0x7f49b80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:35.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.317+0000 7f49bf9ff700 1 -- 172.21.15.115:0/2697261142 shutdown_connections 2023-07-27T14:37:35.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.317+0000 7f49bf9ff700 1 -- 172.21.15.115:0/2697261142 wait complete. 2023-07-27T14:37:35.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.318+0000 7f49bf9ff700 1 Processor -- start 2023-07-27T14:37:35.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.318+0000 7f49bf9ff700 1 -- start start 2023-07-27T14:37:35.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bf9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bf9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b81674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bf9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b81542a0 0x7f49b81679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bf9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8167ea0 con 0x7f49b80aaa40 2023-07-27T14:37:35.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bf9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b814d8f0 con 0x7f49b8153ec0 2023-07-27T14:37:35.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bf9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8159be0 con 0x7f49b81542a0 2023-07-27T14:37:35.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bd79b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bd79b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52164/0 (socket says 172.21.15.115:52164) 2023-07-27T14:37:35.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.319+0000 7f49bd79b700 1 -- 172.21.15.115:0/3578950634 learned_addr learned my addr 172.21.15.115:0/3578950634 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:35.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bdf9c700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b81542a0 0x7f49b81679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bcf9a700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b81674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bd79b700 1 -- 172.21.15.115:0/3578950634 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b81542a0 msgr2=0x7f49b81679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bd79b700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b81542a0 0x7f49b81679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bd79b700 1 -- 172.21.15.115:0/3578950634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 msgr2=0x7f49b81674c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bd79b700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b81674c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bd79b700 1 -- 172.21.15.115:0/3578950634 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8009370 con 0x7f49b80aaa40 2023-07-27T14:37:35.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bd79b700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80b05a0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f49b400c440 tx=0x7f49b4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:35.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49ad7fa700 1 -- 172.21.15.115:0/3578950634 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4012400 con 0x7f49b80aaa40 2023-07-27T14:37:35.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49ad7fa700 1 -- 172.21.15.115:0/3578950634 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4012580 con 0x7f49b80aaa40 2023-07-27T14:37:35.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49ad7fa700 1 -- 172.21.15.115:0/3578950634 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4012940 con 0x7f49b80aaa40 2023-07-27T14:37:35.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b8159900 con 0x7f49b80aaa40 2023-07-27T14:37:35.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.320+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b814d580 con 0x7f49b80aaa40 2023-07-27T14:37:35.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.321+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b806c470 con 0x7f49b80aaa40 2023-07-27T14:37:35.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.322+0000 7f49ad7fa700 1 -- 172.21.15.115:0/3578950634 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f49b4019030 con 0x7f49b80aaa40 2023-07-27T14:37:35.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.323+0000 7f49ad7fa700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f499c05f9c0 0x7f499c061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.323+0000 7f49ad7fa700 1 -- 172.21.15.115:0/3578950634 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f49b407a2a0 con 0x7f49b80aaa40 2023-07-27T14:37:35.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.323+0000 7f49bcf9a700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f499c05f9c0 0x7f499c061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.324+0000 7f49bcf9a700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f499c05f9c0 0x7f499c061e80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f49b80aae20 tx=0x7f49a8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:35.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.327+0000 7f49ad7fa700 1 -- 172.21.15.115:0/3578950634 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49b40488f0 con 0x7f49b80aaa40 2023-07-27T14:37:35.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.496+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49b8062540 con 0x7f49b80aaa40 2023-07-27T14:37:35.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.497+0000 7f49ad7fa700 1 -- 172.21.15.115:0/3578950634 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+17389 (secure 0 0 0) 0x7f49b404aad0 con 0x7f49b80aaa40 2023-07-27T14:37:35.546 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:35.547 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":161,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:37:31.807701+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:36:24.547249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-27T14:36:25.235805+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]},{"pgid":"22.1","mappings":[{"from":3,"to":0}]},{"pgid":"22.e","mappings":[{"from":3,"to":1}]},{"pgid":"22.25","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":22,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:37:35.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f499c05f9c0 msgr2=0x7f499c061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f499c05f9c0 0x7f499c061e80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f49b80aae20 tx=0x7f49a8015000).stop 2023-07-27T14:37:35.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 msgr2=0x7f49b80b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80b05a0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f49b400c440 tx=0x7f49b4007de0).stop 2023-07-27T14:37:35.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 shutdown_connections 2023-07-27T14:37:35.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f499c05f9c0 0x7f499c061e80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49b81542a0 0x7f49b81679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49b80aaa40 0x7f49b80b05a0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 --2- 172.21.15.115:0/3578950634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b8153ec0 0x7f49b81674c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 >> 172.21.15.115:0/3578950634 conn(0x7f49b80cb610 msgr2=0x7f49b80abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:35.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 shutdown_connections 2023-07-27T14:37:35.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.499+0000 7f49bf9ff700 1 -- 172.21.15.115:0/3578950634 wait complete. 2023-07-27T14:37:35.565 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:36:24.547249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:36:25.235805+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 161, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:37:35.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:37:35.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.709+0000 7f37bd7ff700 1 Processor -- start 2023-07-27T14:37:35.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.710+0000 7f37bd7ff700 1 -- start start 2023-07-27T14:37:35.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37bd7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f37b8063260 0x7f37b8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37bd7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37bd7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b81553f0 con 0x7f37b814ae00 2023-07-27T14:37:35.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37bd7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b8157a50 con 0x7f37b8063260 2023-07-27T14:37:35.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37bd7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b8157d10 con 0x7f37b814b1e0 2023-07-27T14:37:35.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37b6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f37b814ae00 0x7f37b8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41646/0 (socket says 172.21.15.115:41646) 2023-07-27T14:37:35.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37b6ffd700 1 -- 172.21.15.115:0/185245503 learned_addr learned my addr 172.21.15.115:0/185245503 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:35.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37b77fe700 1 --2- 172.21.15.115:0/185245503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37b67fc700 1 --2- 172.21.15.115:0/185245503 >> v2:172.21.15.159:3300/0 conn(0x7f37b8063260 0x7f37b8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.711+0000 7f37b5ffb700 1 -- 172.21.15.115:0/185245503 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809434868 0 0) 0x7f37b81553f0 con 0x7f37b814ae00 2023-07-27T14:37:35.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b5ffb700 1 -- 172.21.15.115:0/185245503 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a00033f0 con 0x7f37b814ae00 2023-07-27T14:37:35.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b77fe700 1 -- 172.21.15.115:0/185245503 >> v2:172.21.15.159:3300/0 conn(0x7f37b8063260 msgr2=0x7f37b8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:35.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b77fe700 1 --2- 172.21.15.115:0/185245503 >> v2:172.21.15.159:3300/0 conn(0x7f37b8063260 0x7f37b8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b77fe700 1 -- 172.21.15.115:0/185245503 >> v1:172.21.15.115:6789/0 conn(0x7f37b814ae00 legacy=0x7f37b8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b77fe700 1 -- 172.21.15.115:0/185245503 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8157ff0 con 0x7f37b814b1e0 2023-07-27T14:37:35.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b77fe700 1 --2- 172.21.15.115:0/185245503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b80a98c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f37b0009e60 tx=0x7f37b0009780).ready entity=mon.2 client_cookie=ebf1b30e6281f1d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:35.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b5ffb700 1 -- 172.21.15.115:0/185245503 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b000e070 con 0x7f37b814b1e0 2023-07-27T14:37:35.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b5ffb700 1 -- 172.21.15.115:0/185245503 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b000bab0 con 0x7f37b814b1e0 2023-07-27T14:37:35.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.712+0000 7f37b5ffb700 1 -- 172.21.15.115:0/185245503 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b000be30 con 0x7f37b814b1e0 2023-07-27T14:37:35.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.713+0000 7f37bd7ff700 1 -- 172.21.15.115:0/185245503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 msgr2=0x7f37b80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.713+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/185245503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b80a98c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f37b0009e60 tx=0x7f37b0009780).stop 2023-07-27T14:37:35.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.713+0000 7f37bd7ff700 1 -- 172.21.15.115:0/185245503 shutdown_connections 2023-07-27T14:37:35.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.713+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/185245503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b80a98c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.713+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/185245503 >> v2:172.21.15.159:3300/0 conn(0x7f37b8063260 0x7f37b8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.713+0000 7f37bd7ff700 1 -- 172.21.15.115:0/185245503 >> 172.21.15.115:0/185245503 conn(0x7f37b805e940 msgr2=0x7f37b80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:35.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.713+0000 7f37bd7ff700 1 -- 172.21.15.115:0/185245503 shutdown_connections 2023-07-27T14:37:35.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.713+0000 7f37bd7ff700 1 -- 172.21.15.115:0/185245503 wait complete. 2023-07-27T14:37:35.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.714+0000 7f37bd7ff700 1 Processor -- start 2023-07-27T14:37:35.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.714+0000 7f37bd7ff700 1 -- start start 2023-07-27T14:37:35.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.715+0000 7f37bd7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37b8063260 0x7f37b80c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.715+0000 7f37bd7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37b814ae00 0x7f37b81671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.715+0000 7f37bd7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.715+0000 7f37bd7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80b0400 con 0x7f37b8063260 2023-07-27T14:37:35.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.715+0000 7f37bd7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80af570 con 0x7f37b814ae00 2023-07-27T14:37:35.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.715+0000 7f37bd7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80af7f0 con 0x7f37b814b1e0 2023-07-27T14:37:35.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37b8063260 0x7f37b80c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37b8063260 0x7f37b80c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52170/0 (socket says 172.21.15.115:52170) 2023-07-27T14:37:35.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 -- 172.21.15.115:0/2580135860 learned_addr learned my addr 172.21.15.115:0/2580135860 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:35.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b77fe700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b67fc700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37b814ae00 0x7f37b81671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 -- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 msgr2=0x7f37b814a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b814a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 -- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37b814ae00 msgr2=0x7f37b81671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37b814ae00 0x7f37b81671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 -- 172.21.15.115:0/2580135860 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0009a20 con 0x7f37b8063260 2023-07-27T14:37:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b77fe700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37b6ffd700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37b8063260 0x7f37b80c1c50 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f37a800c590 tx=0x7f37a8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f379effd700 1 -- 172.21.15.115:0/2580135860 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80072e0 con 0x7f37b8063260 2023-07-27T14:37:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f379effd700 1 -- 172.21.15.115:0/2580135860 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8007440 con 0x7f37b8063260 2023-07-27T14:37:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f379effd700 1 -- 172.21.15.115:0/2580135860 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80057a0 con 0x7f37b8063260 2023-07-27T14:37:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.716+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b80afad0 con 0x7f37b8063260 2023-07-27T14:37:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.717+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b80b0090 con 0x7f37b8063260 2023-07-27T14:37:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.718+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b806c470 con 0x7f37b8063260 2023-07-27T14:37:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.718+0000 7f379effd700 1 -- 172.21.15.115:0/2580135860 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f37a8010070 con 0x7f37b8063260 2023-07-27T14:37:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.719+0000 7f379effd700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37a405f9f0 0x7f37a4061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.720+0000 7f379effd700 1 -- 172.21.15.115:0/2580135860 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f37a807a6c0 con 0x7f37b8063260 2023-07-27T14:37:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.720+0000 7f37b67fc700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37a405f9f0 0x7f37a4061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.720+0000 7f37b67fc700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37a405f9f0 0x7f37a4061eb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f37b8063660 tx=0x7f37ac009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:35.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.724+0000 7f379effd700 1 -- 172.21.15.115:0/2580135860 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37a804ae40 con 0x7f37b8063260 2023-07-27T14:37:35.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.901+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f37b80a9fc0 con 0x7f37b8063260 2023-07-27T14:37:35.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.901+0000 7f379effd700 1 -- 172.21.15.115:0/2580135860 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v161) v1 ==== 110+0+10 (secure 0 0 0) 0x7f37a804e460 con 0x7f37b8063260 2023-07-27T14:37:35.951 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:37:35.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37a405f9f0 msgr2=0x7f37a4061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37a405f9f0 0x7f37a4061eb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f37b8063660 tx=0x7f37ac009060).stop 2023-07-27T14:37:35.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37b8063260 msgr2=0x7f37b80c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:35.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37b8063260 0x7f37b80c1c50 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 rx=0x7f37a800c590 tx=0x7f37a8007c80).stop 2023-07-27T14:37:35.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 shutdown_connections 2023-07-27T14:37:35.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f37a405f9f0 0x7f37a4061eb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37b814b1e0 0x7f37b814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37b8063260 0x7f37b80c1c50 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 --2- 172.21.15.115:0/2580135860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37b814ae00 0x7f37b81671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:35.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.903+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 >> 172.21.15.115:0/2580135860 conn(0x7f37b805e940 msgr2=0x7f37b80c0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:35.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.904+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 shutdown_connections 2023-07-27T14:37:35.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:35.904+0000 7f37bd7ff700 1 -- 172.21.15.115:0/2580135860 wait complete. 2023-07-27T14:37:35.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:37:36.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.112+0000 7f2af7fff700 1 Processor -- start 2023-07-27T14:37:36.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.112+0000 7f2af7fff700 1 -- start start 2023-07-27T14:37:36.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.113+0000 7f2af7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2af014ae00 0x7f2af0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.113+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af0063260 0x7f2af00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.113+0000 7f2af7fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af01553f0 con 0x7f2af014b1e0 2023-07-27T14:37:36.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.113+0000 7f2af7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af0157a50 con 0x7f2af014ae00 2023-07-27T14:37:36.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.113+0000 7f2af7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0157d10 con 0x7f2af0063260 2023-07-27T14:37:36.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2af014ae00 0x7f2af0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2af014ae00 0x7f2af0154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52176/0 (socket says 172.21.15.115:52176) 2023-07-27T14:37:36.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af5d9b700 1 -- 172.21.15.115:0/4160175412 learned_addr learned my addr 172.21.15.115:0/4160175412 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:36.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af659c700 1 --2- 172.21.15.115:0/4160175412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af0063260 0x7f2af00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af5d9b700 1 -- 172.21.15.115:0/4160175412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af0063260 msgr2=0x7f2af00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:36.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af5d9b700 1 --2- 172.21.15.115:0/4160175412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af0063260 0x7f2af00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af5d9b700 1 -- 172.21.15.115:0/4160175412 >> v1:172.21.15.159:6789/0 conn(0x7f2af014b1e0 legacy=0x7f2af0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af5d9b700 1 -- 172.21.15.115:0/4160175412 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0157ff0 con 0x7f2af014ae00 2023-07-27T14:37:36.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.114+0000 7f2af5d9b700 1 --2- 172.21.15.115:0/4160175412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af014ae00 0x7f2af0154f00 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f2aec006fd0 tx=0x7f2aec0090f0).ready entity=mon.0 client_cookie=610f2cdcd259790a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af4d99700 1 -- 172.21.15.115:0/4160175412 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00b600 con 0x7f2af014ae00 2023-07-27T14:37:36.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af4d99700 1 -- 172.21.15.115:0/4160175412 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00b760 con 0x7f2af014ae00 2023-07-27T14:37:36.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af4d99700 1 -- 172.21.15.115:0/4160175412 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00bae0 con 0x7f2af014ae00 2023-07-27T14:37:36.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af7fff700 1 -- 172.21.15.115:0/4160175412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af014ae00 msgr2=0x7f2af0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af7fff700 1 --2- 172.21.15.115:0/4160175412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af014ae00 0x7f2af0154f00 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7f2aec006fd0 tx=0x7f2aec0090f0).stop 2023-07-27T14:37:36.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af7fff700 1 -- 172.21.15.115:0/4160175412 shutdown_connections 2023-07-27T14:37:36.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af7fff700 1 --2- 172.21.15.115:0/4160175412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af0063260 0x7f2af00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af7fff700 1 --2- 172.21.15.115:0/4160175412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af014ae00 0x7f2af0154f00 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af7fff700 1 -- 172.21.15.115:0/4160175412 >> 172.21.15.115:0/4160175412 conn(0x7f2af005e940 msgr2=0x7f2af00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:36.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af7fff700 1 -- 172.21.15.115:0/4160175412 shutdown_connections 2023-07-27T14:37:36.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.115+0000 7f2af7fff700 1 -- 172.21.15.115:0/4160175412 wait complete. 2023-07-27T14:37:36.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.117+0000 7f2af7fff700 1 Processor -- start 2023-07-27T14:37:36.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.117+0000 7f2af7fff700 1 -- start start 2023-07-27T14:37:36.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af0063260 0x7f2af0149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af014ae00 0x7f2af0164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af014b1e0 0x7f2af00c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af00c3610 con 0x7f2af0063260 2023-07-27T14:37:36.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af7fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0149930 con 0x7f2af014b1e0 2023-07-27T14:37:36.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af7fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af01650a0 con 0x7f2af014ae00 2023-07-27T14:37:36.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af0063260 0x7f2af0149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af0063260 0x7f2af0149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52192/0 (socket says 172.21.15.115:52192) 2023-07-27T14:37:36.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.118+0000 7f2af5d9b700 1 -- 172.21.15.115:0/655624912 learned_addr learned my addr 172.21.15.115:0/655624912 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:36.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af659c700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af014b1e0 0x7f2af00c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af559a700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af014ae00 0x7f2af0164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af5d9b700 1 -- 172.21.15.115:0/655624912 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af014ae00 msgr2=0x7f2af0164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af5d9b700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af014ae00 0x7f2af0164bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af5d9b700 1 -- 172.21.15.115:0/655624912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af014b1e0 msgr2=0x7f2af00c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af5d9b700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af014b1e0 0x7f2af00c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af5d9b700 1 -- 172.21.15.115:0/655624912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec009370 con 0x7f2af0063260 2023-07-27T14:37:36.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af5d9b700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af0063260 0x7f2af0149440 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f2af00c53b0 tx=0x7f2aec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2ae5ffb700 1 -- 172.21.15.115:0/655624912 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00b8d0 con 0x7f2af0063260 2023-07-27T14:37:36.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2ae5ffb700 1 -- 172.21.15.115:0/655624912 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00ba30 con 0x7f2af0063260 2023-07-27T14:37:36.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2ae5ffb700 1 -- 172.21.15.115:0/655624912 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec01c670 con 0x7f2af0063260 2023-07-27T14:37:36.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af00caf20 con 0x7f2af0063260 2023-07-27T14:37:36.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.119+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af00c32a0 con 0x7f2af0063260 2023-07-27T14:37:36.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.120+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af00c38f0 con 0x7f2af0063260 2023-07-27T14:37:36.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.121+0000 7f2ae5ffb700 1 -- 172.21.15.115:0/655624912 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f2aec02c070 con 0x7f2af0063260 2023-07-27T14:37:36.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.122+0000 7f2ae5ffb700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ad405f9c0 0x7f2ad4061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.122+0000 7f2ae5ffb700 1 -- 172.21.15.115:0/655624912 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2aec07cd30 con 0x7f2af0063260 2023-07-27T14:37:36.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.122+0000 7f2af559a700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ad405f9c0 0x7f2ad4061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.122+0000 7f2af559a700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ad405f9c0 0x7f2ad4061e80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f2af00c4520 tx=0x7f2ae0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.126+0000 7f2ae5ffb700 1 -- 172.21.15.115:0/655624912 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2aec04d4b0 con 0x7f2af0063260 2023-07-27T14:37:36.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.290+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2af006c470 con 0x7f2af0063260 2023-07-27T14:37:36.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.291+0000 7f2ae5ffb700 1 -- 172.21.15.115:0/655624912 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v161) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2aec020070 con 0x7f2af0063260 2023-07-27T14:37:36.341 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:37:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ad405f9c0 msgr2=0x7f2ad4061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ad405f9c0 0x7f2ad4061e80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f2af00c4520 tx=0x7f2ae0009040).stop 2023-07-27T14:37:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af0063260 msgr2=0x7f2af0149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af0063260 0x7f2af0149440 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7f2af00c53b0 tx=0x7f2aec017000).stop 2023-07-27T14:37:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 shutdown_connections 2023-07-27T14:37:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2ad405f9c0 0x7f2ad4061e80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af014b1e0 0x7f2af00c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af0063260 0x7f2af0149440 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 --2- 172.21.15.115:0/655624912 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2af014ae00 0x7f2af0164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 >> 172.21.15.115:0/655624912 conn(0x7f2af005e940 msgr2=0x7f2af00a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 shutdown_connections 2023-07-27T14:37:36.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.293+0000 7f2af7fff700 1 -- 172.21.15.115:0/655624912 wait complete. 2023-07-27T14:37:36.360 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:37:36.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.501+0000 7fa2fab9d700 1 Processor -- start 2023-07-27T14:37:36.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.501+0000 7fa2fab9d700 1 -- start start 2023-07-27T14:37:36.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.502+0000 7fa2fab9d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa2f40640f0 0x7fa2f40644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.502+0000 7fa2fab9d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f4154500 con 0x7fa2f40c5990 2023-07-27T14:37:36.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.502+0000 7fa2fab9d700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f41547e0 con 0x7fa2f414e610 2023-07-27T14:37:36.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.502+0000 7fa2fab9d700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f4154ac0 con 0x7fa2f40640f0 2023-07-27T14:37:36.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.502+0000 7fa2f939a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa2f40c5990 0x7fa2f414df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41660/0 (socket says 172.21.15.115:41660) 2023-07-27T14:37:36.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.502+0000 7fa2f939a700 1 -- 172.21.15.115:0/2929392634 learned_addr learned my addr 172.21.15.115:0/2929392634 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:36.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.503+0000 7fa2f9b9b700 1 --2- 172.21.15.115:0/2929392634 >> v2:172.21.15.159:3300/0 conn(0x7fa2f40640f0 0x7fa2f40644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.503+0000 7fa2f8b99700 1 -- 172.21.15.115:0/2929392634 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026189156 0 0) 0x7fa2f4154500 con 0x7fa2f40c5990 2023-07-27T14:37:36.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.503+0000 7fa2f8b99700 1 -- 172.21.15.115:0/2929392634 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e00033f0 con 0x7fa2f40c5990 2023-07-27T14:37:36.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.503+0000 7fa2f9b9b700 1 -- 172.21.15.115:0/2929392634 >> v1:172.21.15.159:6789/0 conn(0x7fa2f414e610 legacy=0x7fa2f415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.503+0000 7fa2f9b9b700 1 -- 172.21.15.115:0/2929392634 >> v1:172.21.15.115:6789/0 conn(0x7fa2f40c5990 legacy=0x7fa2f414df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.503+0000 7fa2f9b9b700 1 -- 172.21.15.115:0/2929392634 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4154da0 con 0x7fa2f40640f0 2023-07-27T14:37:36.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.503+0000 7fa2f9b9b700 1 --2- 172.21.15.115:0/2929392634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 0x7fa2f40644d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa2f0009760 tx=0x7fa2f0009060).ready entity=mon.1 client_cookie=c26cebe9f03805ea server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2f8b99700 1 -- 172.21.15.115:0/2929392634 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000f510 con 0x7fa2f40640f0 2023-07-27T14:37:36.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2f8b99700 1 -- 172.21.15.115:0/2929392634 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000f670 con 0x7fa2f40640f0 2023-07-27T14:37:36.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2f8b99700 1 -- 172.21.15.115:0/2929392634 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000f9f0 con 0x7fa2f40640f0 2023-07-27T14:37:36.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2fab9d700 1 -- 172.21.15.115:0/2929392634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 msgr2=0x7fa2f40644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2fab9d700 1 --2- 172.21.15.115:0/2929392634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 0x7fa2f40644d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa2f0009760 tx=0x7fa2f0009060).stop 2023-07-27T14:37:36.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2fab9d700 1 -- 172.21.15.115:0/2929392634 shutdown_connections 2023-07-27T14:37:36.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2fab9d700 1 --2- 172.21.15.115:0/2929392634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 0x7fa2f40644d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2fab9d700 1 -- 172.21.15.115:0/2929392634 >> 172.21.15.115:0/2929392634 conn(0x7fa2f40cb480 msgr2=0x7fa2f40c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:36.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2fab9d700 1 -- 172.21.15.115:0/2929392634 shutdown_connections 2023-07-27T14:37:36.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.504+0000 7fa2fab9d700 1 -- 172.21.15.115:0/2929392634 wait complete. 2023-07-27T14:37:36.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.506+0000 7fa2fab9d700 1 Processor -- start 2023-07-27T14:37:36.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.506+0000 7fa2fab9d700 1 -- start start 2023-07-27T14:37:36.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2fab9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 0x7fa2f4164160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2fab9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f40c5990 0x7fa2f4164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2fab9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f414e610 0x7fa2f40c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2fab9d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40c3f40 con 0x7fa2f40c5990 2023-07-27T14:37:36.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2fab9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4165190 con 0x7fa2f40640f0 2023-07-27T14:37:36.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2fab9d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40c3330 con 0x7fa2f414e610 2023-07-27T14:37:36.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2f939a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f40c5990 0x7fa2f4164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2f939a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f40c5990 0x7fa2f4164ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52194/0 (socket says 172.21.15.115:52194) 2023-07-27T14:37:36.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2f939a700 1 -- 172.21.15.115:0/1535981710 learned_addr learned my addr 172.21.15.115:0/1535981710 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:36.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2f9b9b700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 0x7fa2f4164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.507+0000 7fa2fa39c700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f414e610 0x7fa2f40c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2f939a700 1 -- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f414e610 msgr2=0x7fa2f40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2f939a700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f414e610 0x7fa2f40c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2f939a700 1 -- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 msgr2=0x7fa2f4164160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2f939a700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 0x7fa2f4164160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2f939a700 1 -- 172.21.15.115:0/1535981710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00092a0 con 0x7fa2f40c5990 2023-07-27T14:37:36.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2f9b9b700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 0x7fa2f4164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:36.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2f939a700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f40c5990 0x7fa2f4164ca0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fa2e400c590 tx=0x7fa2e4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2e9ffb700 1 -- 172.21.15.115:0/1535981710 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4007e40 con 0x7fa2f40c5990 2023-07-27T14:37:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2e9ffb700 1 -- 172.21.15.115:0/1535981710 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40072e0 con 0x7fa2f40c5990 2023-07-27T14:37:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f40c3610 con 0x7fa2f40c5990 2023-07-27T14:37:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2e9ffb700 1 -- 172.21.15.115:0/1535981710 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40057a0 con 0x7fa2f40c5990 2023-07-27T14:37:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.508+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f40c3bd0 con 0x7fa2f40c5990 2023-07-27T14:37:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.509+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f40831c0 con 0x7fa2f40c5990 2023-07-27T14:37:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.510+0000 7fa2e9ffb700 1 -- 172.21.15.115:0/1535981710 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fa2e4010070 con 0x7fa2f40c5990 2023-07-27T14:37:36.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.511+0000 7fa2e9ffb700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2d805f9f0 0x7fa2d8061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.511+0000 7fa2e9ffb700 1 -- 172.21.15.115:0/1535981710 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa2e407a700 con 0x7fa2f40c5990 2023-07-27T14:37:36.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.511+0000 7fa2f9b9b700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2d805f9f0 0x7fa2d8061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.512+0000 7fa2f9b9b700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2d805f9f0 0x7fa2d8061eb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fa2f0009760 tx=0x7fa2f0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.515+0000 7fa2e9ffb700 1 -- 172.21.15.115:0/1535981710 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2e404af90 con 0x7fa2f40c5990 2023-07-27T14:37:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.683+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2f4047270 con 0x7fa2f40c5990 2023-07-27T14:37:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.684+0000 7fa2e9ffb700 1 -- 172.21.15.115:0/1535981710 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2e404e5b0 con 0x7fa2f40c5990 2023-07-27T14:37:36.733 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:37:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2d805f9f0 msgr2=0x7fa2d8061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2d805f9f0 0x7fa2d8061eb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fa2f0009760 tx=0x7fa2f0017000).stop 2023-07-27T14:37:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f40c5990 msgr2=0x7fa2f4164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f40c5990 0x7fa2f4164ca0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fa2e400c590 tx=0x7fa2e4007c80).stop 2023-07-27T14:37:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 shutdown_connections 2023-07-27T14:37:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2d805f9f0 0x7fa2d8061eb0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f414e610 0x7fa2f40c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f40640f0 0x7fa2f4164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 --2- 172.21.15.115:0/1535981710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f40c5990 0x7fa2f4164ca0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 >> 172.21.15.115:0/1535981710 conn(0x7fa2f40cb480 msgr2=0x7fa2f4063360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:36.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 shutdown_connections 2023-07-27T14:37:36.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.687+0000 7fa2fab9d700 1 -- 172.21.15.115:0/1535981710 wait complete. 2023-07-27T14:37:36.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:37:36.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.897+0000 7ff97c1ff700 1 Processor -- start 2023-07-27T14:37:36.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.897+0000 7ff97c1ff700 1 -- start start 2023-07-27T14:37:36.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff97c1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff97413a350 0x7ff974065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff97c1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff97413a730 0x7ff9741585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff97c1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9740bd9a0 con 0x7ff9740c2fa0 2023-07-27T14:37:36.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff97c1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff974066400 con 0x7ff97413a350 2023-07-27T14:37:36.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff97c1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff974158ae0 con 0x7ff97413a730 2023-07-27T14:37:36.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff97979a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff97413a730 0x7ff9741585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff97979a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff97413a730 0x7ff9741585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:52556/0 (socket says 172.21.15.115:52556) 2023-07-27T14:37:36.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff97979a700 1 -- 172.21.15.115:0/3740686618 learned_addr learned my addr 172.21.15.115:0/3740686618 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:36.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.899+0000 7ff979f9b700 1 --2- 172.21.15.115:0/3740686618 >> v2:172.21.15.159:3300/0 conn(0x7ff97413a350 0x7ff974065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff979f9b700 1 -- 172.21.15.115:0/3740686618 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff97413a730 msgr2=0x7ff9741585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:36.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff979f9b700 1 --2- 172.21.15.115:0/3740686618 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff97413a730 0x7ff9741585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff979f9b700 1 -- 172.21.15.115:0/3740686618 >> v1:172.21.15.159:6789/0 conn(0x7ff9740c2fa0 legacy=0x7ff974067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff979f9b700 1 -- 172.21.15.115:0/3740686618 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974066610 con 0x7ff97413a350 2023-07-27T14:37:36.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff97979a700 1 --2- 172.21.15.115:0/3740686618 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff97413a730 0x7ff9741585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:37:36.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff979f9b700 1 --2- 172.21.15.115:0/3740686618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a350 0x7ff974065f10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7ff970009760 tx=0x7ff970009060).ready entity=mon.1 client_cookie=bf2530c148b5edb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff978f99700 1 -- 172.21.15.115:0/3740686618 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000f510 con 0x7ff97413a350 2023-07-27T14:37:36.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff978f99700 1 -- 172.21.15.115:0/3740686618 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97000f670 con 0x7ff97413a350 2023-07-27T14:37:36.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.900+0000 7ff978f99700 1 -- 172.21.15.115:0/3740686618 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000f9f0 con 0x7ff97413a350 2023-07-27T14:37:36.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.901+0000 7ff97c1ff700 1 -- 172.21.15.115:0/3740686618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a350 msgr2=0x7ff974065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.901+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/3740686618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a350 0x7ff974065f10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7ff970009760 tx=0x7ff970009060).stop 2023-07-27T14:37:36.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.901+0000 7ff97c1ff700 1 -- 172.21.15.115:0/3740686618 shutdown_connections 2023-07-27T14:37:36.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.901+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/3740686618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a350 0x7ff974065f10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.901+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/3740686618 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff97413a730 0x7ff9741585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.901+0000 7ff97c1ff700 1 -- 172.21.15.115:0/3740686618 >> 172.21.15.115:0/3740686618 conn(0x7ff97405e8f0 msgr2=0x7ff9740c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:36.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.901+0000 7ff97c1ff700 1 -- 172.21.15.115:0/3740686618 shutdown_connections 2023-07-27T14:37:36.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.901+0000 7ff97c1ff700 1 -- 172.21.15.115:0/3740686618 wait complete. 2023-07-27T14:37:36.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.903+0000 7ff97c1ff700 1 Processor -- start 2023-07-27T14:37:36.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.903+0000 7ff97c1ff700 1 -- start start 2023-07-27T14:37:36.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97c1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9740c2fa0 0x7ff9740c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97c1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff97413a350 0x7ff9740a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97c1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a730 0x7ff9740aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97c1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740c2970 con 0x7ff97413a350 2023-07-27T14:37:36.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97c1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740c0730 con 0x7ff97413a730 2023-07-27T14:37:36.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97c1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740c0410 con 0x7ff9740c2fa0 2023-07-27T14:37:36.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97979a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff97413a350 0x7ff9740a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97979a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff97413a350 0x7ff9740a9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52200/0 (socket says 172.21.15.115:52200) 2023-07-27T14:37:36.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97979a700 1 -- 172.21.15.115:0/1365994473 learned_addr learned my addr 172.21.15.115:0/1365994473 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:36.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff979f9b700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9740c2fa0 0x7ff9740c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97a79c700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a730 0x7ff9740aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97979a700 1 -- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9740c2fa0 msgr2=0x7ff9740c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97979a700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9740c2fa0 0x7ff9740c2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97979a700 1 -- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a730 msgr2=0x7ff9740aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:36.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97979a700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a730 0x7ff9740aa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:36.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97979a700 1 -- 172.21.15.115:0/1365994473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964009370 con 0x7ff97413a350 2023-07-27T14:37:36.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.904+0000 7ff97a79c700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a730 0x7ff9740aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.905+0000 7ff97979a700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff97413a350 0x7ff9740a9f10 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7ff964006d00 tx=0x7ff9640090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.905+0000 7ff969ffb700 1 -- 172.21.15.115:0/1365994473 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400eee0 con 0x7ff97413a350 2023-07-27T14:37:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.905+0000 7ff969ffb700 1 -- 172.21.15.115:0/1365994473 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9640095b0 con 0x7ff97413a350 2023-07-27T14:37:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.905+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9700092a0 con 0x7ff97413a350 2023-07-27T14:37:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.905+0000 7ff969ffb700 1 -- 172.21.15.115:0/1365994473 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400ca60 con 0x7ff97413a350 2023-07-27T14:37:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.905+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9740a8570 con 0x7ff97413a350 2023-07-27T14:37:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.906+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97406c470 con 0x7ff97413a350 2023-07-27T14:37:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.907+0000 7ff969ffb700 1 -- 172.21.15.115:0/1365994473 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7ff964022070 con 0x7ff97413a350 2023-07-27T14:37:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.908+0000 7ff969ffb700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff95805f9f0 0x7ff958061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.908+0000 7ff969ffb700 1 -- 172.21.15.115:0/1365994473 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6265+0+0 (secure 0 0 0) 0x7ff96407b440 con 0x7ff97413a350 2023-07-27T14:37:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.908+0000 7ff979f9b700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff95805f9f0 0x7ff958061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.908+0000 7ff979f9b700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff95805f9f0 0x7ff958061eb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7ff970009760 tx=0x7ff970017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:36.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:36.912+0000 7ff969ffb700 1 -- 172.21.15.115:0/1365994473 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff96404bbe0 con 0x7ff97413a350 2023-07-27T14:37:37.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.083+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9740bdc10 con 0x7ff97413a350 2023-07-27T14:37:37.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.084+0000 7ff969ffb700 1 -- 172.21.15.115:0/1365994473 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff964016020 con 0x7ff97413a350 2023-07-27T14:37:37.134 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:37:37.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff95805f9f0 msgr2=0x7ff958061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff95805f9f0 0x7ff958061eb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7ff970009760 tx=0x7ff970017000).stop 2023-07-27T14:37:37.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff97413a350 msgr2=0x7ff9740a9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff97413a350 0x7ff9740a9f10 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7ff964006d00 tx=0x7ff9640090f0).stop 2023-07-27T14:37:37.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 shutdown_connections 2023-07-27T14:37:37.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff95805f9f0 0x7ff958061eb0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff97413a730 0x7ff9740aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff9740c2fa0 0x7ff9740c2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 --2- 172.21.15.115:0/1365994473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff97413a350 0x7ff9740a9f10 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 >> 172.21.15.115:0/1365994473 conn(0x7ff97405e8f0 msgr2=0x7ff974153660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:37.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 shutdown_connections 2023-07-27T14:37:37.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.086+0000 7ff97c1ff700 1 -- 172.21.15.115:0/1365994473 wait complete. 2023-07-27T14:37:37.154 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:37:37.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.294+0000 7fb7b5bff700 1 Processor -- start 2023-07-27T14:37:37.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.294+0000 7fb7b5bff700 1 -- start start 2023-07-27T14:37:37.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.295+0000 7fb7b5bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b0150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.295+0000 7fb7b5bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb7b00c1f70 0x7fb7b0069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.295+0000 7fb7b5bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b0068380 con 0x7fb7b00c0e80 2023-07-27T14:37:37.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.295+0000 7fb7b5bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b0065790 con 0x7fb7b00c1f70 2023-07-27T14:37:37.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.295+0000 7fb7b5bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b0068ee0 con 0x7fb7b0150320 2023-07-27T14:37:37.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7aeffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb7b00c0e80 0x7fb7b00c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41662/0 (socket says 172.21.15.115:41662) 2023-07-27T14:37:37.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7aeffd700 1 -- 172.21.15.115:0/1645069078 learned_addr learned my addr 172.21.15.115:0/1645069078 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:37.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7affff700 1 --2- 172.21.15.115:0/1645069078 >> v2:172.21.15.115:3300/0 conn(0x7fb7b00c1f70 0x7fb7b0069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7ae7fc700 1 -- 172.21.15.115:0/1645069078 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963374100 0 0) 0x7fb7b0068380 con 0x7fb7b00c0e80 2023-07-27T14:37:37.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7af7fe700 1 --2- 172.21.15.115:0/1645069078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b0150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7ae7fc700 1 -- 172.21.15.115:0/1645069078 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7980033f0 con 0x7fb7b00c0e80 2023-07-27T14:37:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7affff700 1 -- 172.21.15.115:0/1645069078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 msgr2=0x7fb7b0150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7affff700 1 --2- 172.21.15.115:0/1645069078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b0150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7affff700 1 -- 172.21.15.115:0/1645069078 >> v1:172.21.15.115:6789/0 conn(0x7fb7b00c0e80 legacy=0x7fb7b00c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7affff700 1 -- 172.21.15.115:0/1645069078 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b00685b0 con 0x7fb7b00c1f70 2023-07-27T14:37:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.296+0000 7fb7affff700 1 --2- 172.21.15.115:0/1645069078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b0069370 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fb7a8009e60 tx=0x7fb7a8009780).ready entity=mon.0 client_cookie=b7bc0457d2951318 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7ae7fc700 1 -- 172.21.15.115:0/1645069078 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800e070 con 0x7fb7b00c1f70 2023-07-27T14:37:37.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7ae7fc700 1 -- 172.21.15.115:0/1645069078 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800bb60 con 0x7fb7b00c1f70 2023-07-27T14:37:37.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7ae7fc700 1 -- 172.21.15.115:0/1645069078 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8012410 con 0x7fb7b00c1f70 2023-07-27T14:37:37.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7b5bff700 1 -- 172.21.15.115:0/1645069078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 msgr2=0x7fb7b0069370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/1645069078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b0069370 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fb7a8009e60 tx=0x7fb7a8009780).stop 2023-07-27T14:37:37.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7b5bff700 1 -- 172.21.15.115:0/1645069078 shutdown_connections 2023-07-27T14:37:37.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/1645069078 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b0150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/1645069078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b0069370 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7b5bff700 1 -- 172.21.15.115:0/1645069078 >> 172.21.15.115:0/1645069078 conn(0x7fb7b0062320 msgr2=0x7fb7b0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:37.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7b5bff700 1 -- 172.21.15.115:0/1645069078 shutdown_connections 2023-07-27T14:37:37.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.297+0000 7fb7b5bff700 1 -- 172.21.15.115:0/1645069078 wait complete. 2023-07-27T14:37:37.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.299+0000 7fb7b5bff700 1 Processor -- start 2023-07-27T14:37:37.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.299+0000 7fb7b5bff700 1 -- start start 2023-07-27T14:37:37.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7b5bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b00c0e80 0x7fb7b00beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7b5bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b00c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7b5bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b00c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7b5bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00bd920 con 0x7fb7b00c1f70 2023-07-27T14:37:37.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7b5bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00bdea0 con 0x7fb7b00c0e80 2023-07-27T14:37:37.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7b5bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00aace0 con 0x7fb7b0150320 2023-07-27T14:37:37.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7aeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b00c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7aeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b00c04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52218/0 (socket says 172.21.15.115:52218) 2023-07-27T14:37:37.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7aeffd700 1 -- 172.21.15.115:0/293779498 learned_addr learned my addr 172.21.15.115:0/293779498 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:37.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7affff700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b00c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7af7fe700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b00c0e80 0x7fb7b00beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7aeffd700 1 -- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 msgr2=0x7fb7b00c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7aeffd700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b00c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7aeffd700 1 -- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b00c0e80 msgr2=0x7fb7b00beaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7aeffd700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b00c0e80 0x7fb7b00beaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7aeffd700 1 -- 172.21.15.115:0/293779498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009a20 con 0x7fb7b00c1f70 2023-07-27T14:37:37.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.300+0000 7fb7affff700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b00c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:37.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.301+0000 7fb7aeffd700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b00c04e0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fb7a400c4c0 tx=0x7fb7a4007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:37.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.301+0000 7fb7977fe700 1 -- 172.21.15.115:0/293779498 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40072e0 con 0x7fb7b00c1f70 2023-07-27T14:37:37.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.301+0000 7fb7977fe700 1 -- 172.21.15.115:0/293779498 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4007440 con 0x7fb7b00c1f70 2023-07-27T14:37:37.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.301+0000 7fb7977fe700 1 -- 172.21.15.115:0/293779498 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40057a0 con 0x7fb7b00c1f70 2023-07-27T14:37:37.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.301+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b00aaf80 con 0x7fb7b00c1f70 2023-07-27T14:37:37.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.301+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b00bdb30 con 0x7fb7b00c1f70 2023-07-27T14:37:37.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.302+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b006c470 con 0x7fb7b00c1f70 2023-07-27T14:37:37.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.303+0000 7fb7977fe700 1 -- 172.21.15.115:0/293779498 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fb7a4010070 con 0x7fb7b00c1f70 2023-07-27T14:37:37.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.304+0000 7fb7977fe700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb79c05fa20 0x7fb79c061ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.304+0000 7fb7977fe700 1 -- 172.21.15.115:0/293779498 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fb7a407a5f0 con 0x7fb7b00c1f70 2023-07-27T14:37:37.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.304+0000 7fb7af7fe700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb79c05fa20 0x7fb79c061ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.305+0000 7fb7af7fe700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb79c05fa20 0x7fb79c061ee0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fb7a000de20 tx=0x7fb7a000d430).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:37.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.308+0000 7fb7977fe700 1 -- 172.21.15.115:0/293779498 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7a404ad90 con 0x7fb7b00c1f70 2023-07-27T14:37:37.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.517+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7b00c3060 con 0x7fb7b00c1f70 2023-07-27T14:37:37.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.518+0000 7fb7977fe700 1 -- 172.21.15.115:0/293779498 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fb7a4007d90 con 0x7fb7b00c1f70 2023-07-27T14:37:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:37.569 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2898407097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2898407097},{"type":"v1","addr":"172.21.15.115:6837","nonce":2898407097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6929,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/112108246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":112108246},{"type":"v1","addr":"172.21.15.159:6835","nonce":112108246}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/680715955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":680715955},{"type":"v1","addr":"172.21.15.115:6836","nonce":680715955}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:36:26.258376+0000","modified":"2023-07-27T14:36:29.273687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7807},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7807":{"gid":7807,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/3102980678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3102980678},{"type":"v1","addr":"172.21.15.159:6834","nonce":3102980678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-07-27T14:37:37.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb79c05fa20 msgr2=0x7fb79c061ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb79c05fa20 0x7fb79c061ee0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fb7a000de20 tx=0x7fb7a000d430).stop 2023-07-27T14:37:37.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 msgr2=0x7fb7b00c04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b00c04e0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fb7a400c4c0 tx=0x7fb7a4007c50).stop 2023-07-27T14:37:37.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 shutdown_connections 2023-07-27T14:37:37.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb79c05fa20 0x7fb79c061ee0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b0150320 0x7fb7b00c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b00c0e80 0x7fb7b00beaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 --2- 172.21.15.115:0/293779498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7b00c1f70 0x7fb7b00c04e0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 >> 172.21.15.115:0/293779498 conn(0x7fb7b0062320 msgr2=0x7fb7b0063df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:37.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 shutdown_connections 2023-07-27T14:37:37.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.520+0000 7fb7b5bff700 1 -- 172.21.15.115:0/293779498 wait complete. 2023-07-27T14:37:37.573 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 85 2023-07-27T14:37:37.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:37:37.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.725+0000 7f7d05bff700 1 Processor -- start 2023-07-27T14:37:37.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.725+0000 7f7d05bff700 1 -- start start 2023-07-27T14:37:37.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.726+0000 7f7d05bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d00153ec0 0x7f7d000a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.726+0000 7f7d05bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7d000aa050 0x7f7d000640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7d05bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 0x7f7d000645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7d05bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d00064ad0 con 0x7f7d00153ec0 2023-07-27T14:37:37.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7d05bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d000aa4d0 con 0x7f7d000aa050 2023-07-27T14:37:37.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7d05bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000c05c0 con 0x7f7d000aaa40 2023-07-27T14:37:37.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d00153ec0 0x7f7d000a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d00153ec0 0x7f7d000a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52222/0 (socket says 172.21.15.115:52222) 2023-07-27T14:37:37.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 -- 172.21.15.115:0/2686580124 learned_addr learned my addr 172.21.15.115:0/2686580124 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:37.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cfeffd700 1 --2- 172.21.15.115:0/2686580124 >> v2:172.21.15.159:3300/0 conn(0x7f7d000aa050 0x7f7d000640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cfffff700 1 --2- 172.21.15.115:0/2686580124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 0x7f7d000645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 -- 172.21.15.115:0/2686580124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 msgr2=0x7f7d000645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:37.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 --2- 172.21.15.115:0/2686580124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 0x7f7d000645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 -- 172.21.15.115:0/2686580124 >> v2:172.21.15.159:3300/0 conn(0x7f7d000aa050 msgr2=0x7f7d000640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:37.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 --2- 172.21.15.115:0/2686580124 >> v2:172.21.15.159:3300/0 conn(0x7f7d000aa050 0x7f7d000640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 -- 172.21.15.115:0/2686580124 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000bfc90 con 0x7f7d00153ec0 2023-07-27T14:37:37.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.727+0000 7f7cff7fe700 1 --2- 172.21.15.115:0/2686580124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000a9b60 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f7d0006c0d0 tx=0x7f7cf00090f0).ready entity=mon.0 client_cookie=ae8f7bffe1f0983f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:37.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7cfe7fc700 1 -- 172.21.15.115:0/2686580124 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000b600 con 0x7f7d00153ec0 2023-07-27T14:37:37.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7cfe7fc700 1 -- 172.21.15.115:0/2686580124 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf000b760 con 0x7f7d00153ec0 2023-07-27T14:37:37.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7cfe7fc700 1 -- 172.21.15.115:0/2686580124 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000bae0 con 0x7f7d00153ec0 2023-07-27T14:37:37.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 -- 172.21.15.115:0/2686580124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 msgr2=0x7f7d000a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 --2- 172.21.15.115:0/2686580124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000a9b60 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f7d0006c0d0 tx=0x7f7cf00090f0).stop 2023-07-27T14:37:37.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 -- 172.21.15.115:0/2686580124 shutdown_connections 2023-07-27T14:37:37.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 --2- 172.21.15.115:0/2686580124 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 0x7f7d000645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 --2- 172.21.15.115:0/2686580124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000a9b60 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 --2- 172.21.15.115:0/2686580124 >> v2:172.21.15.159:3300/0 conn(0x7f7d000aa050 0x7f7d000640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 -- 172.21.15.115:0/2686580124 >> 172.21.15.115:0/2686580124 conn(0x7f7d000cb610 msgr2=0x7f7d000c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:37.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 -- 172.21.15.115:0/2686580124 shutdown_connections 2023-07-27T14:37:37.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.728+0000 7f7d05bff700 1 -- 172.21.15.115:0/2686580124 wait complete. 2023-07-27T14:37:37.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.730+0000 7f7d05bff700 1 Processor -- start 2023-07-27T14:37:37.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.731+0000 7f7d05bff700 1 -- start start 2023-07-27T14:37:37.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7d05bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d000aa050 0x7f7d0014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7d05bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 0x7f7d000aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7d05bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7d05bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0014d0a0 con 0x7f7d00153ec0 2023-07-27T14:37:37.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7d05bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000af4f0 con 0x7f7d000aa050 2023-07-27T14:37:37.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7d05bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000c1c30 con 0x7f7d000aaa40 2023-07-27T14:37:37.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7cfffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7cfffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52236/0 (socket says 172.21.15.115:52236) 2023-07-27T14:37:37.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7cfffff700 1 -- 172.21.15.115:0/1474422921 learned_addr learned my addr 172.21.15.115:0/1474422921 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:37.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7cfeffd700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 0x7f7d000aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.732+0000 7f7cff7fe700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d000aa050 0x7f7d0014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7cfffff700 1 -- 172.21.15.115:0/1474422921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 msgr2=0x7f7d000aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7cfffff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 0x7f7d000aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7cfffff700 1 -- 172.21.15.115:0/1474422921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d000aa050 msgr2=0x7f7d0014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7cfffff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d000aa050 0x7f7d0014cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7cfffff700 1 -- 172.21.15.115:0/1474422921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0009370 con 0x7f7d00153ec0 2023-07-27T14:37:37.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7cfffff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000af000 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f7cf8007f20 tx=0x7f7cf80098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:37.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7ce77fe700 1 -- 172.21.15.115:0/1474422921 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800eb90 con 0x7f7d00153ec0 2023-07-27T14:37:37.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7ce77fe700 1 -- 172.21.15.115:0/1474422921 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf800ecf0 con 0x7f7d00153ec0 2023-07-27T14:37:37.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7ce77fe700 1 -- 172.21.15.115:0/1474422921 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8014610 con 0x7f7d00153ec0 2023-07-27T14:37:37.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d000c1ed0 con 0x7f7d00153ec0 2023-07-27T14:37:37.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.733+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d000c2490 con 0x7f7d00153ec0 2023-07-27T14:37:37.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.734+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0006c470 con 0x7f7d00153ec0 2023-07-27T14:37:37.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.735+0000 7f7ce77fe700 1 -- 172.21.15.115:0/1474422921 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f7cf801b030 con 0x7f7d00153ec0 2023-07-27T14:37:37.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.737+0000 7f7ce77fe700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cec05fa40 0x7f7cec061f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:37.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.737+0000 7f7ce77fe700 1 -- 172.21.15.115:0/1474422921 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f7cf807b280 con 0x7f7d00153ec0 2023-07-27T14:37:37.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.737+0000 7f7cff7fe700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cec05fa40 0x7f7cec061f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:37.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.737+0000 7f7cff7fe700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cec05fa40 0x7f7cec061f00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f7cf0009130 tx=0x7f7cf0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:37.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.741+0000 7f7ce77fe700 1 -- 172.21.15.115:0/1474422921 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7cf804baa0 con 0x7f7d00153ec0 2023-07-27T14:37:37.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.920+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d0014f550 con 0x7f7d00153ec0 2023-07-27T14:37:37.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.921+0000 7f7ce77fe700 1 -- 172.21.15.115:0/1474422921 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+17345 (secure 0 0 0) 0x7f7cf800ee60 con 0x7f7d00153ec0 2023-07-27T14:37:37.974 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:37.974 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":162,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:37:36.676068+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:36:24.547249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-27T14:36:25.235805+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]},{"pgid":"22.1","mappings":[{"from":3,"to":0}]},{"pgid":"22.e","mappings":[{"from":3,"to":1}]},{"pgid":"22.25","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":22,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:37:37.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cec05fa40 msgr2=0x7f7cec061f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cec05fa40 0x7f7cec061f00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f7cf0009130 tx=0x7f7cf0017000).stop 2023-07-27T14:37:37.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 msgr2=0x7f7d000af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:37.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000af000 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f7cf8007f20 tx=0x7f7cf80098a0).stop 2023-07-27T14:37:37.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 shutdown_connections 2023-07-27T14:37:37.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7cec05fa40 0x7f7cec061f00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d00153ec0 0x7f7d000af000 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d000aa050 0x7f7d0014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 --2- 172.21.15.115:0/1474422921 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d000aaa40 0x7f7d000aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 >> 172.21.15.115:0/1474422921 conn(0x7f7d000cb610 msgr2=0x7f7d000ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 shutdown_connections 2023-07-27T14:37:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:37.923+0000 7f7d05bff700 1 -- 172.21.15.115:0/1474422921 wait complete. 2023-07-27T14:37:37.991 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:37:37.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:37:38.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.129+0000 7faca51ff700 1 Processor -- start 2023-07-27T14:37:38.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.129+0000 7faca51ff700 1 -- start start 2023-07-27T14:37:38.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.130+0000 7faca51ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca0150af0 0x7faca0150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.130+0000 7faca51ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faca00c0e80 0x7faca00c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.130+0000 7faca51ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faca00696f0 0x7faca00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.130+0000 7faca51ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca006a440 con 0x7faca00c0e80 2023-07-27T14:37:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.130+0000 7faca51ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca00bbc80 con 0x7faca00696f0 2023-07-27T14:37:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.130+0000 7faca51ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca0069e80 con 0x7faca0150af0 2023-07-27T14:37:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faca00c0e80 0x7faca00c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faca00c0e80 0x7faca00c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52244/0 (socket says 172.21.15.115:52244) 2023-07-27T14:37:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 -- 172.21.15.115:0/3976291068 learned_addr learned my addr 172.21.15.115:0/3976291068 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9ed9d700 1 --2- 172.21.15.115:0/3976291068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca0150af0 0x7faca0150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9f59e700 1 --2- 172.21.15.115:0/3976291068 >> v2:172.21.15.159:3300/0 conn(0x7faca00696f0 0x7faca00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 -- 172.21.15.115:0/3976291068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca0150af0 msgr2=0x7faca0150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 --2- 172.21.15.115:0/3976291068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca0150af0 0x7faca0150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 -- 172.21.15.115:0/3976291068 >> v2:172.21.15.159:3300/0 conn(0x7faca00696f0 msgr2=0x7faca00a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 --2- 172.21.15.115:0/3976291068 >> v2:172.21.15.159:3300/0 conn(0x7faca00696f0 0x7faca00a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 -- 172.21.15.115:0/3976291068 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca006a160 con 0x7faca00c0e80 2023-07-27T14:37:38.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9ed9d700 1 --2- 172.21.15.115:0/3976291068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca0150af0 0x7faca0150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9e59c700 1 --2- 172.21.15.115:0/3976291068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00c0e80 0x7faca00c3960 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7faca0063530 tx=0x7fac940090f0).ready entity=mon.0 client_cookie=bd4bfb351985cd54 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.131+0000 7fac9dd9b700 1 -- 172.21.15.115:0/3976291068 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400b600 con 0x7faca00c0e80 2023-07-27T14:37:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7fac9dd9b700 1 -- 172.21.15.115:0/3976291068 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9400b760 con 0x7faca00c0e80 2023-07-27T14:37:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7fac9dd9b700 1 -- 172.21.15.115:0/3976291068 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400bae0 con 0x7faca00c0e80 2023-07-27T14:37:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 -- 172.21.15.115:0/3976291068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00c0e80 msgr2=0x7faca00c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 --2- 172.21.15.115:0/3976291068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00c0e80 0x7faca00c3960 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7faca0063530 tx=0x7fac940090f0).stop 2023-07-27T14:37:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 -- 172.21.15.115:0/3976291068 shutdown_connections 2023-07-27T14:37:38.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 --2- 172.21.15.115:0/3976291068 >> v2:172.21.15.159:3300/0 conn(0x7faca00696f0 0x7faca00a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 --2- 172.21.15.115:0/3976291068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca0150af0 0x7faca0150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 --2- 172.21.15.115:0/3976291068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00c0e80 0x7faca00c3960 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 -- 172.21.15.115:0/3976291068 >> 172.21.15.115:0/3976291068 conn(0x7faca0062320 msgr2=0x7faca0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:38.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 -- 172.21.15.115:0/3976291068 shutdown_connections 2023-07-27T14:37:38.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.132+0000 7faca51ff700 1 -- 172.21.15.115:0/3976291068 wait complete. 2023-07-27T14:37:38.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.134+0000 7faca51ff700 1 Processor -- start 2023-07-27T14:37:38.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.134+0000 7faca51ff700 1 -- start start 2023-07-27T14:37:38.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7faca51ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00696f0 0x7faca014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7faca51ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca00c0e80 0x7faca0137fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7faca51ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0150af0 0x7faca014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7faca51ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca01384d0 con 0x7faca00696f0 2023-07-27T14:37:38.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7faca51ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca01542a0 con 0x7faca0150af0 2023-07-27T14:37:38.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7faca51ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca014ed60 con 0x7faca00c0e80 2023-07-27T14:37:38.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00696f0 0x7faca014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00696f0 0x7faca014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52248/0 (socket says 172.21.15.115:52248) 2023-07-27T14:37:38.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 -- 172.21.15.115:0/522467629 learned_addr learned my addr 172.21.15.115:0/522467629 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:38.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 -- 172.21.15.115:0/522467629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca00c0e80 msgr2=0x7faca0137fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca00c0e80 0x7faca0137fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:38.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 -- 172.21.15.115:0/522467629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0150af0 msgr2=0x7faca014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0150af0 0x7faca014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:38.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 -- 172.21.15.115:0/522467629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac94009370 con 0x7faca00696f0 2023-07-27T14:37:38.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.135+0000 7fac9ed9d700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00696f0 0x7faca014aa70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7fac9000d890 tx=0x7fac90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:38.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.136+0000 7fac86ffd700 1 -- 172.21.15.115:0/522467629 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90011590 con 0x7faca00696f0 2023-07-27T14:37:38.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.136+0000 7fac86ffd700 1 -- 172.21.15.115:0/522467629 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac900116f0 con 0x7faca00696f0 2023-07-27T14:37:38.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.136+0000 7fac86ffd700 1 -- 172.21.15.115:0/522467629 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90011a70 con 0x7faca00696f0 2023-07-27T14:37:38.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.136+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca00c0430 con 0x7faca00696f0 2023-07-27T14:37:38.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.136+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca0164300 con 0x7faca00696f0 2023-07-27T14:37:38.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.137+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca006c470 con 0x7faca00696f0 2023-07-27T14:37:38.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.138+0000 7fac86ffd700 1 -- 172.21.15.115:0/522467629 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fac9001c460 con 0x7faca00696f0 2023-07-27T14:37:38.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.138+0000 7fac86ffd700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac8c05fa20 0x7fac8c061ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.138+0000 7fac86ffd700 1 -- 172.21.15.115:0/522467629 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fac9007aff0 con 0x7faca00696f0 2023-07-27T14:37:38.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.139+0000 7fac9e59c700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac8c05fa20 0x7fac8c061ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.139+0000 7fac9e59c700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac8c05fa20 0x7fac8c061ee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7faca0067bd0 tx=0x7fac94017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:38.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.142+0000 7fac86ffd700 1 -- 172.21.15.115:0/522467629 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac9004b790 con 0x7faca00696f0 2023-07-27T14:37:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.353+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faca0063880 con 0x7faca00696f0 2023-07-27T14:37:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.354+0000 7fac86ffd700 1 -- 172.21.15.115:0/522467629 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fac9004edb0 con 0x7faca00696f0 2023-07-27T14:37:38.405 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:38.405 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2898407097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2898407097},{"type":"v1","addr":"172.21.15.115:6837","nonce":2898407097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6929,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/112108246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":112108246},{"type":"v1","addr":"172.21.15.159:6835","nonce":112108246}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/680715955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":680715955},{"type":"v1","addr":"172.21.15.115:6836","nonce":680715955}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:36:26.258376+0000","modified":"2023-07-27T14:36:29.273687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7807},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7807":{"gid":7807,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/3102980678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3102980678},{"type":"v1","addr":"172.21.15.159:6834","nonce":3102980678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-07-27T14:37:38.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac8c05fa20 msgr2=0x7fac8c061ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac8c05fa20 0x7fac8c061ee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7faca0067bd0 tx=0x7fac94017000).stop 2023-07-27T14:37:38.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00696f0 msgr2=0x7faca014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00696f0 0x7faca014aa70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7fac9000d890 tx=0x7fac90008040).stop 2023-07-27T14:37:38.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 shutdown_connections 2023-07-27T14:37:38.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fac8c05fa20 0x7fac8c061ee0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0150af0 0x7faca014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:38.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faca00696f0 0x7faca014aa70 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 --2- 172.21.15.115:0/522467629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faca00c0e80 0x7faca0137fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:38.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 >> 172.21.15.115:0/522467629 conn(0x7faca0062320 msgr2=0x7faca00c2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:38.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 shutdown_connections 2023-07-27T14:37:38.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.356+0000 7faca51ff700 1 -- 172.21.15.115:0/522467629 wait complete. 2023-07-27T14:37:38.409 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 85 2023-07-27T14:37:38.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:37:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.561+0000 7f632e5ff700 1 Processor -- start 2023-07-27T14:37:38.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.561+0000 7f632e5ff700 1 -- start start 2023-07-27T14:37:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f632e5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6328153ec0 0x7f63280a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f632e5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f63280aa050 0x7f63280640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f632e5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aaa40 0x7f63280645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f632e5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6328064ad0 con 0x7f6328153ec0 2023-07-27T14:37:38.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f632e5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63280aa4d0 con 0x7f63280aa050 2023-07-27T14:37:38.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f632e5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c05c0 con 0x7f63280aaa40 2023-07-27T14:37:38.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f6327fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6328153ec0 0x7f63280a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f6327fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6328153ec0 0x7f63280a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52258/0 (socket says 172.21.15.115:52258) 2023-07-27T14:37:38.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f6327fff700 1 -- 172.21.15.115:0/171948696 learned_addr learned my addr 172.21.15.115:0/171948696 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:38.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f632cb9c700 1 --2- 172.21.15.115:0/171948696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aaa40 0x7f63280645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f63277fe700 1 --2- 172.21.15.115:0/171948696 >> v2:172.21.15.159:3300/0 conn(0x7f63280aa050 0x7f63280640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f6327fff700 1 -- 172.21.15.115:0/171948696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aaa40 msgr2=0x7f63280645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:38.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f6327fff700 1 --2- 172.21.15.115:0/171948696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aaa40 0x7f63280645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f6327fff700 1 -- 172.21.15.115:0/171948696 >> v2:172.21.15.159:3300/0 conn(0x7f63280aa050 msgr2=0x7f63280640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:38.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f6327fff700 1 --2- 172.21.15.115:0/171948696 >> v2:172.21.15.159:3300/0 conn(0x7f63280aa050 0x7f63280640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.563+0000 7f6327fff700 1 -- 172.21.15.115:0/171948696 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280bfc90 con 0x7f6328153ec0 2023-07-27T14:37:38.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f6327fff700 1 --2- 172.21.15.115:0/171948696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328153ec0 0x7f63280a9b60 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f632806c0d0 tx=0x7f63180090f0).ready entity=mon.0 client_cookie=c8225cecef7f8149 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:38.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f6326ffd700 1 -- 172.21.15.115:0/171948696 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800b600 con 0x7f6328153ec0 2023-07-27T14:37:38.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f6326ffd700 1 -- 172.21.15.115:0/171948696 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631800b760 con 0x7f6328153ec0 2023-07-27T14:37:38.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f6326ffd700 1 -- 172.21.15.115:0/171948696 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800bae0 con 0x7f6328153ec0 2023-07-27T14:37:38.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f632e5ff700 1 -- 172.21.15.115:0/171948696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328153ec0 msgr2=0x7f63280a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f632e5ff700 1 --2- 172.21.15.115:0/171948696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328153ec0 0x7f63280a9b60 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f632806c0d0 tx=0x7f63180090f0).stop 2023-07-27T14:37:38.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f632e5ff700 1 -- 172.21.15.115:0/171948696 shutdown_connections 2023-07-27T14:37:38.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f632e5ff700 1 --2- 172.21.15.115:0/171948696 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aaa40 0x7f63280645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f632e5ff700 1 --2- 172.21.15.115:0/171948696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328153ec0 0x7f63280a9b60 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f632e5ff700 1 --2- 172.21.15.115:0/171948696 >> v2:172.21.15.159:3300/0 conn(0x7f63280aa050 0x7f63280640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f632e5ff700 1 -- 172.21.15.115:0/171948696 >> 172.21.15.115:0/171948696 conn(0x7f63280cb610 msgr2=0x7f63280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:38.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.564+0000 7f632e5ff700 1 -- 172.21.15.115:0/171948696 shutdown_connections 2023-07-27T14:37:38.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.565+0000 7f632e5ff700 1 -- 172.21.15.115:0/171948696 wait complete. 2023-07-27T14:37:38.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.566+0000 7f632e5ff700 1 Processor -- start 2023-07-27T14:37:38.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.566+0000 7f632e5ff700 1 -- start start 2023-07-27T14:37:38.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f632e5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aa050 0x7f6328151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f632e5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280aaa40 0x7f63281504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f632e5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6328153ec0 0x7f6328141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f632e5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c2220 con 0x7f63280aaa40 2023-07-27T14:37:38.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f632e5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c2500 con 0x7f6328153ec0 2023-07-27T14:37:38.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f632e5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c27e0 con 0x7f63280aa050 2023-07-27T14:37:38.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f63277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280aaa40 0x7f63281504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f63277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280aaa40 0x7f63281504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52262/0 (socket says 172.21.15.115:52262) 2023-07-27T14:37:38.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f63277fe700 1 -- 172.21.15.115:0/3042710611 learned_addr learned my addr 172.21.15.115:0/3042710611 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:38.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f6327fff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aa050 0x7f6328151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.567+0000 7f632cb9c700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6328153ec0 0x7f6328141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f63277fe700 1 -- 172.21.15.115:0/3042710611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aa050 msgr2=0x7f6328151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f63277fe700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aa050 0x7f6328151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f63277fe700 1 -- 172.21.15.115:0/3042710611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6328153ec0 msgr2=0x7f6328141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f63277fe700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6328153ec0 0x7f6328141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f63277fe700 1 -- 172.21.15.115:0/3042710611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318009370 con 0x7f63280aaa40 2023-07-27T14:37:38.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f63277fe700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280aaa40 0x7f63281504f0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f631c00d890 tx=0x7f631c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:38.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f630ffff700 1 -- 172.21.15.115:0/3042710611 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c011590 con 0x7f63280aaa40 2023-07-27T14:37:38.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f630ffff700 1 -- 172.21.15.115:0/3042710611 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c0116f0 con 0x7f63280aaa40 2023-07-27T14:37:38.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f630ffff700 1 -- 172.21.15.115:0/3042710611 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c011a70 con 0x7f63280aaa40 2023-07-27T14:37:38.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63280c2ac0 con 0x7f63280aaa40 2023-07-27T14:37:38.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.568+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63281509e0 con 0x7f63280aaa40 2023-07-27T14:37:38.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.569+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632806c470 con 0x7f63280aaa40 2023-07-27T14:37:38.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.570+0000 7f630ffff700 1 -- 172.21.15.115:0/3042710611 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f631c01c460 con 0x7f63280aaa40 2023-07-27T14:37:38.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.571+0000 7f630ffff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405f9f0 0x7f6314061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:38.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.571+0000 7f630ffff700 1 -- 172.21.15.115:0/3042710611 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f631c07b840 con 0x7f63280aaa40 2023-07-27T14:37:38.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.571+0000 7f6327fff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405f9f0 0x7f6314061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:38.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.572+0000 7f6327fff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405f9f0 0x7f6314061eb0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f6318009130 tx=0x7f6318017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:38.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.574+0000 7f630ffff700 1 -- 172.21.15.115:0/3042710611 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f631c04c000 con 0x7f63280aaa40 2023-07-27T14:37:38.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.784+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63280c8230 con 0x7f63280aaa40 2023-07-27T14:37:38.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.784+0000 7f630ffff700 1 -- 172.21.15.115:0/3042710611 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f631c011e60 con 0x7f63280aaa40 2023-07-27T14:37:38.836 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:38.836 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2898407097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2898407097},{"type":"v1","addr":"172.21.15.115:6837","nonce":2898407097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6929,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/112108246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":112108246},{"type":"v1","addr":"172.21.15.159:6835","nonce":112108246}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/680715955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":680715955},{"type":"v1","addr":"172.21.15.115:6836","nonce":680715955}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:36:26.258376+0000","modified":"2023-07-27T14:36:29.273687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7807},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7807":{"gid":7807,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/3102980678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3102980678},{"type":"v1","addr":"172.21.15.159:6834","nonce":3102980678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-07-27T14:37:38.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.786+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405f9f0 msgr2=0x7f6314061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.786+0000 7f632e5ff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405f9f0 0x7f6314061eb0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f6318009130 tx=0x7f6318017000).stop 2023-07-27T14:37:38.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.786+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280aaa40 msgr2=0x7f63281504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:38.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.786+0000 7f632e5ff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280aaa40 0x7f63281504f0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f631c00d890 tx=0x7f631c008040).stop 2023-07-27T14:37:38.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.787+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 shutdown_connections 2023-07-27T14:37:38.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.787+0000 7f632e5ff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405f9f0 0x7f6314061eb0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.787+0000 7f632e5ff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6328153ec0 0x7f6328141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.787+0000 7f632e5ff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63280aa050 0x7f6328151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.787+0000 7f632e5ff700 1 --2- 172.21.15.115:0/3042710611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280aaa40 0x7f63281504f0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:38.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.787+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 >> 172.21.15.115:0/3042710611 conn(0x7f63280cb610 msgr2=0x7f63280ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:38.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.787+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 shutdown_connections 2023-07-27T14:37:38.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.787+0000 7f632e5ff700 1 -- 172.21.15.115:0/3042710611 wait complete. 2023-07-27T14:37:38.841 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 85 2023-07-27T14:37:38.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:37:39.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.992+0000 7fea66fff700 1 Processor -- start 2023-07-27T14:37:39.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.992+0000 7fea66fff700 1 -- start start 2023-07-27T14:37:39.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.993+0000 7fea66fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea60153ec0 0x7fea600a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.993+0000 7fea66fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fea600aaa40 0x7fea600c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.993+0000 7fea66fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea600aa4d0 con 0x7fea600aa050 2023-07-27T14:37:39.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.993+0000 7fea66fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600c05c0 con 0x7fea600aaa40 2023-07-27T14:37:39.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.993+0000 7fea66fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600bfc90 con 0x7fea60153ec0 2023-07-27T14:37:39.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea5ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fea600aa050 0x7fea600640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41668/0 (socket says 172.21.15.115:41668) 2023-07-27T14:37:39.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea5ffff700 1 -- 172.21.15.115:0/1942585392 learned_addr learned my addr 172.21.15.115:0/1942585392 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:39.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea64d9b700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea60153ec0 0x7fea600a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea6559c700 1 --2- 172.21.15.115:0/1942585392 >> v2:172.21.15.159:3300/0 conn(0x7fea600aaa40 0x7fea600c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158812062 0 0) 0x7fea4c001110 con 0x7fea600aa050 2023-07-27T14:37:39.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea500033f0 con 0x7fea600aa050 2023-07-27T14:37:39.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366565744 0 0) 0x7fea500033f0 con 0x7fea600aa050 2023-07-27T14:37:39.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea60153ec0 msgr2=0x7fea600a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:39.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.994+0000 7fea5f7fe700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea60153ec0 0x7fea600a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 >> v2:172.21.15.159:3300/0 conn(0x7fea600aaa40 msgr2=0x7fea600c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:39.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 --2- 172.21.15.115:0/1942585392 >> v2:172.21.15.159:3300/0 conn(0x7fea600aaa40 0x7fea600c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600bff70 con 0x7fea600aa050 2023-07-27T14:37:39.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fea4c001600 con 0x7fea600aa050 2023-07-27T14:37:39.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 >> v1:172.21.15.115:6789/0 conn(0x7fea600aa050 legacy=0x7fea600640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea500038e0 0x7fea50003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea60153ec0 0x7fea50004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea50004b80 0x7fea50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600c05c0 con 0x7fea500038e0 2023-07-27T14:37:39.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600bfc90 con 0x7fea50004b80 2023-07-27T14:37:39.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5000b8e0 con 0x7fea60153ec0 2023-07-27T14:37:39.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea64d9b700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea500038e0 0x7fea50003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea6559c700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea50004b80 0x7fea50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea5ffff700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea60153ec0 0x7fea50004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea64d9b700 1 -- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea60153ec0 msgr2=0x7fea50004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:39.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea64d9b700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea60153ec0 0x7fea50004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea64d9b700 1 -- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea50004b80 msgr2=0x7fea50005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:39.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea64d9b700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea50004b80 0x7fea50005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea64d9b700 1 -- 172.21.15.115:0/1942585392 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea500033f0 con 0x7fea500038e0 2023-07-27T14:37:39.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea6559c700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea50004b80 0x7fea50005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:39.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.995+0000 7fea64d9b700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea500038e0 0x7fea50003d00 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7fea54009a80 tx=0x7fea54009060).ready entity=mon.0 client_cookie=58b7a0979c46a96 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:39.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54009430 con 0x7fea500038e0 2023-07-27T14:37:39.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5400e640 con 0x7fea500038e0 2023-07-27T14:37:39.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea5f7fe700 1 -- 172.21.15.115:0/1942585392 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400e9c0 con 0x7fea500038e0 2023-07-27T14:37:39.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea66fff700 1 -- 172.21.15.115:0/1942585392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea500038e0 msgr2=0x7fea50003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea66fff700 1 --2- 172.21.15.115:0/1942585392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea500038e0 0x7fea50003d00 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7fea54009a80 tx=0x7fea54009060).stop 2023-07-27T14:37:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea6559c700 1 -- 172.21.15.115:0/1942585392 reap_dead start 2023-07-27T14:37:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea66fff700 1 -- 172.21.15.115:0/1942585392 shutdown_connections 2023-07-27T14:37:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea66fff700 1 -- 172.21.15.115:0/1942585392 >> 172.21.15.115:0/1942585392 conn(0x7fea600cb610 msgr2=0x7fea600c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea66fff700 1 -- 172.21.15.115:0/1942585392 shutdown_connections 2023-07-27T14:37:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.996+0000 7fea66fff700 1 -- 172.21.15.115:0/1942585392 wait complete. 2023-07-27T14:37:39.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.998+0000 7fea66fff700 1 Processor -- start 2023-07-27T14:37:39.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.998+0000 7fea66fff700 1 -- start start 2023-07-27T14:37:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea66fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea500038e0 0x7fea600c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea66fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea600c25d0 0x7fea60153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea66fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea6014c140 0x7fea600aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea66fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6014cff0 con 0x7fea600c25d0 2023-07-27T14:37:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea66fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600c2a50 con 0x7fea6014c140 2023-07-27T14:37:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea66fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600c2140 con 0x7fea500038e0 2023-07-27T14:37:39.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea5ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea600c25d0 0x7fea60153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea5ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea600c25d0 0x7fea60153220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52280/0 (socket says 172.21.15.115:52280) 2023-07-27T14:37:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea5ffff700 1 -- 172.21.15.115:0/1152065690 learned_addr learned my addr 172.21.15.115:0/1152065690 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea64d9b700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea500038e0 0x7fea600c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea6559c700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea6014c140 0x7fea600aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea5ffff700 1 -- 172.21.15.115:0/1152065690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea500038e0 msgr2=0x7fea600c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:38.999+0000 7fea5ffff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea500038e0 0x7fea600c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea5ffff700 1 -- 172.21.15.115:0/1152065690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea6014c140 msgr2=0x7fea600aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea5ffff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea6014c140 0x7fea600aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea5ffff700 1 -- 172.21.15.115:0/1152065690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60153710 con 0x7fea600c25d0 2023-07-27T14:37:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea5ffff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea600c25d0 0x7fea60153220 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7fea4c00e830 tx=0x7fea4c000f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea5cff9700 1 -- 172.21.15.115:0/1152065690 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c010520 con 0x7fea600c25d0 2023-07-27T14:37:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea5cff9700 1 -- 172.21.15.115:0/1152065690 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c010680 con 0x7fea600c25d0 2023-07-27T14:37:39.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6014ca30 con 0x7fea600c25d0 2023-07-27T14:37:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea5cff9700 1 -- 172.21.15.115:0/1152065690 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c010a00 con 0x7fea600c25d0 2023-07-27T14:37:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.000+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea600c1dd0 con 0x7fea600c25d0 2023-07-27T14:37:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.001+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea600c1c10 con 0x7fea600c25d0 2023-07-27T14:37:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.002+0000 7fea5cff9700 1 -- 172.21.15.115:0/1152065690 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fea4c010d70 con 0x7fea600c25d0 2023-07-27T14:37:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.003+0000 7fea5cff9700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea4405f9c0 0x7fea44061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.003+0000 7fea5cff9700 1 -- 172.21.15.115:0/1152065690 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fea4c07afd0 con 0x7fea600c25d0 2023-07-27T14:37:39.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.003+0000 7fea64d9b700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea4405f9c0 0x7fea44061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.004+0000 7fea64d9b700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea4405f9c0 0x7fea44061e80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fea600c3c50 tx=0x7fea5401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:39.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.007+0000 7fea5cff9700 1 -- 172.21.15.115:0/1152065690 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea4c04b770 con 0x7fea600c25d0 2023-07-27T14:37:39.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.177+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea600aa4d0 con 0x7fea600c25d0 2023-07-27T14:37:39.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.178+0000 7fea5cff9700 1 -- 172.21.15.115:0/1152065690 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+17345 (secure 0 0 0) 0x7fea600aa4d0 con 0x7fea600c25d0 2023-07-27T14:37:39.229 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:39.229 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":162,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:37:36.676068+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:36:24.547249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-27T14:36:25.235805+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]},{"pgid":"22.1","mappings":[{"from":3,"to":0}]},{"pgid":"22.e","mappings":[{"from":3,"to":1}]},{"pgid":"22.25","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":22,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:37:39.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.180+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea4405f9c0 msgr2=0x7fea44061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.180+0000 7fea66fff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea4405f9c0 0x7fea44061e80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fea600c3c50 tx=0x7fea5401a000).stop 2023-07-27T14:37:39.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.180+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea600c25d0 msgr2=0x7fea60153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.180+0000 7fea66fff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea600c25d0 0x7fea60153220 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7fea4c00e830 tx=0x7fea4c000f50).stop 2023-07-27T14:37:39.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.181+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 shutdown_connections 2023-07-27T14:37:39.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.181+0000 7fea66fff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fea4405f9c0 0x7fea44061e80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.181+0000 7fea66fff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea6014c140 0x7fea600aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.181+0000 7fea66fff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea500038e0 0x7fea600c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.181+0000 7fea66fff700 1 --2- 172.21.15.115:0/1152065690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea600c25d0 0x7fea60153220 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.181+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 >> 172.21.15.115:0/1152065690 conn(0x7fea600cb610 msgr2=0x7fea600c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:39.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.181+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 shutdown_connections 2023-07-27T14:37:39.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.181+0000 7fea66fff700 1 -- 172.21.15.115:0/1152065690 wait complete. 2023-07-27T14:37:39.249 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:37:39.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.385+0000 7f1880fff700 1 Processor -- start 2023-07-27T14:37:39.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.386+0000 7f1880fff700 1 -- start start 2023-07-27T14:37:39.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f1880fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c151bd0 0x7f187c062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f1880fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f187c062810 0x7f187c0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f1880fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c0639d0 con 0x7f187c0a4d30 2023-07-27T14:37:39.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f1880fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c137610 con 0x7f187c062810 2023-07-27T14:37:39.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f1880fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0a51e0 con 0x7f187c151bd0 2023-07-27T14:37:39.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f187a59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c151bd0 0x7f187c062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f187a59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c151bd0 0x7f187c062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:52686/0 (socket says 172.21.15.115:52686) 2023-07-27T14:37:39.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f187a59c700 1 -- 172.21.15.115:0/2682656504 learned_addr learned my addr 172.21.15.115:0/2682656504 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:39.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f1879d9b700 1 --2- 172.21.15.115:0/2682656504 >> v2:172.21.15.159:3300/0 conn(0x7f187c062810 0x7f187c0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.387+0000 7f187ad9d700 1 --1- 172.21.15.115:0/2682656504 >> v1:172.21.15.159:6789/0 conn(0x7f187c0a4d30 0x7f187c157ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:43642/0 (socket says 172.21.15.115:43642) 2023-07-27T14:37:39.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187a59c700 1 -- 172.21.15.115:0/2682656504 >> v2:172.21.15.159:3300/0 conn(0x7f187c062810 msgr2=0x7f187c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187a59c700 1 --2- 172.21.15.115:0/2682656504 >> v2:172.21.15.159:3300/0 conn(0x7f187c062810 0x7f187c0a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187a59c700 1 -- 172.21.15.115:0/2682656504 >> v1:172.21.15.159:6789/0 conn(0x7f187c0a4d30 legacy=0x7f187c157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187a59c700 1 -- 172.21.15.115:0/2682656504 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c062dc0 con 0x7f187c151bd0 2023-07-27T14:37:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187959a700 1 -- 172.21.15.115:0/2682656504 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18715582 0 0) 0x7f187c0639d0 con 0x7f187c0a4d30 2023-07-27T14:37:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187a59c700 1 --2- 172.21.15.115:0/2682656504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c151bd0 0x7f187c062320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f186c006fd0 tx=0x7f186c0090f0).ready entity=mon.2 client_cookie=d31a1ffae3ee1895 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187959a700 1 -- 172.21.15.115:0/2682656504 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c00b580 con 0x7f187c151bd0 2023-07-27T14:37:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187959a700 1 -- 172.21.15.115:0/2682656504 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c00b6e0 con 0x7f187c151bd0 2023-07-27T14:37:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.388+0000 7f187959a700 1 -- 172.21.15.115:0/2682656504 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c00ba60 con 0x7f187c151bd0 2023-07-27T14:37:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.389+0000 7f1880fff700 1 -- 172.21.15.115:0/2682656504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c151bd0 msgr2=0x7f187c062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.389+0000 7f1880fff700 1 --2- 172.21.15.115:0/2682656504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c151bd0 0x7f187c062320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f186c006fd0 tx=0x7f186c0090f0).stop 2023-07-27T14:37:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.389+0000 7f1880fff700 1 -- 172.21.15.115:0/2682656504 shutdown_connections 2023-07-27T14:37:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.389+0000 7f1880fff700 1 --2- 172.21.15.115:0/2682656504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c151bd0 0x7f187c062320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.389+0000 7f1880fff700 1 --2- 172.21.15.115:0/2682656504 >> v2:172.21.15.159:3300/0 conn(0x7f187c062810 0x7f187c0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.389+0000 7f1880fff700 1 -- 172.21.15.115:0/2682656504 >> 172.21.15.115:0/2682656504 conn(0x7f187c064700 msgr2=0x7f187c064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.389+0000 7f1880fff700 1 -- 172.21.15.115:0/2682656504 shutdown_connections 2023-07-27T14:37:39.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.389+0000 7f1880fff700 1 -- 172.21.15.115:0/2682656504 wait complete. 2023-07-27T14:37:39.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.391+0000 7f1880fff700 1 Processor -- start 2023-07-27T14:37:39.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.391+0000 7f1880fff700 1 -- start start 2023-07-27T14:37:39.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f1880fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c062810 0x7f187c0aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f1880fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f187c0a4d30 0x7f187c164750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f1880fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f187c151bd0 0x7f187c135330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f1880fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0abf20 con 0x7f187c151bd0 2023-07-27T14:37:39.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f1880fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0acd20 con 0x7f187c0a4d30 2023-07-27T14:37:39.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f1880fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c164c40 con 0x7f187c062810 2023-07-27T14:37:39.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f187c151bd0 0x7f187c135330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f187c151bd0 0x7f187c135330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52284/0 (socket says 172.21.15.115:52284) 2023-07-27T14:37:39.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187ad9d700 1 -- 172.21.15.115:0/1046830037 learned_addr learned my addr 172.21.15.115:0/1046830037 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:39.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f1879d9b700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f187c0a4d30 0x7f187c164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187a59c700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c062810 0x7f187c0aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187ad9d700 1 -- 172.21.15.115:0/1046830037 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c062810 msgr2=0x7f187c0aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187ad9d700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c062810 0x7f187c0aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187ad9d700 1 -- 172.21.15.115:0/1046830037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f187c0a4d30 msgr2=0x7f187c164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187ad9d700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f187c0a4d30 0x7f187c164750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.392+0000 7f187ad9d700 1 -- 172.21.15.115:0/1046830037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009370 con 0x7f187c151bd0 2023-07-27T14:37:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.393+0000 7f187ad9d700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f187c151bd0 0x7f187c135330 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f187400c730 tx=0x7f1874001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.393+0000 7f186a7fc700 1 -- 172.21.15.115:0/1046830037 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874005c70 con 0x7f187c151bd0 2023-07-27T14:37:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.393+0000 7f186a7fc700 1 -- 172.21.15.115:0/1046830037 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1874005dd0 con 0x7f187c151bd0 2023-07-27T14:37:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.393+0000 7f186a7fc700 1 -- 172.21.15.115:0/1046830037 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874007340 con 0x7f187c151bd0 2023-07-27T14:37:39.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.393+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c0ac110 con 0x7f187c151bd0 2023-07-27T14:37:39.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.393+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c0ac6d0 con 0x7f187c151bd0 2023-07-27T14:37:39.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.394+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187c06c470 con 0x7f187c151bd0 2023-07-27T14:37:39.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.395+0000 7f186a7fc700 1 -- 172.21.15.115:0/1046830037 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f1874010030 con 0x7f187c151bd0 2023-07-27T14:37:39.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.395+0000 7f186a7fc700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f185c05f9f0 0x7f185c061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:39.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.396+0000 7f186a7fc700 1 -- 172.21.15.115:0/1046830037 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f187407ad50 con 0x7f187c151bd0 2023-07-27T14:37:39.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.396+0000 7f187a59c700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f185c05f9f0 0x7f185c061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:39.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.396+0000 7f187a59c700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f185c05f9f0 0x7f185c061eb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f186c009130 tx=0x7f186c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:39.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.399+0000 7f186a7fc700 1 -- 172.21.15.115:0/1046830037 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f187404b600 con 0x7f187c151bd0 2023-07-27T14:37:39.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.607+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f187c136fb0 con 0x7f187c151bd0 2023-07-27T14:37:39.884 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:37:39.834+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:37:39.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.841+0000 7f186a7fc700 1 -- 172.21.15.115:0/1046830037 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7f187404ec20 con 0x7f187c151bd0 2023-07-27T14:37:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f185c05f9f0 msgr2=0x7f185c061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f185c05f9f0 0x7f185c061eb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f186c009130 tx=0x7f186c017000).stop 2023-07-27T14:37:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f187c151bd0 msgr2=0x7f187c135330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f187c151bd0 0x7f187c135330 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7f187400c730 tx=0x7f1874001520).stop 2023-07-27T14:37:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 shutdown_connections 2023-07-27T14:37:39.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f185c05f9f0 0x7f185c061eb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f187c151bd0 0x7f187c135330 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f187c062810 0x7f187c0aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 --2- 172.21.15.115:0/1046830037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f187c0a4d30 0x7f187c164750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 >> 172.21.15.115:0/1046830037 conn(0x7f187c064700 msgr2=0x7f187c153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 shutdown_connections 2023-07-27T14:37:39.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:39.843+0000 7f1880fff700 1 -- 172.21.15.115:0/1046830037 wait complete. 2023-07-27T14:37:39.896 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:37:39.912 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:37:39.956 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:37:40.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.052+0000 7fac0c1ff700 1 Processor -- start 2023-07-27T14:37:40.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.052+0000 7fac0c1ff700 1 -- start start 2023-07-27T14:37:40.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.053+0000 7fac0c1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fac040c58d0 0x7fac04150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:40.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.053+0000 7fac0c1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fac040c3100 0x7fac040c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:40.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.053+0000 7fac0c1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac040c0ea0 con 0x7fac041509b0 2023-07-27T14:37:40.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.053+0000 7fac0c1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac04068e10 con 0x7fac040c58d0 2023-07-27T14:37:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.053+0000 7fac0c1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac04151280 con 0x7fac040c3100 2023-07-27T14:37:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.053+0000 7fac0979a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fac040c58d0 0x7fac04150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.053+0000 7fac0979a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fac040c58d0 0x7fac04150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52286/0 (socket says 172.21.15.115:52286) 2023-07-27T14:37:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.053+0000 7fac0979a700 1 -- 172.21.15.115:0/2244099854 learned_addr learned my addr 172.21.15.115:0/2244099854 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:40.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac0a79c700 1 --2- 172.21.15.115:0/2244099854 >> v2:172.21.15.159:3300/0 conn(0x7fac040c3100 0x7fac040c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:40.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac0979a700 1 -- 172.21.15.115:0/2244099854 >> v2:172.21.15.159:3300/0 conn(0x7fac040c3100 msgr2=0x7fac040c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:40.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac0979a700 1 --2- 172.21.15.115:0/2244099854 >> v2:172.21.15.159:3300/0 conn(0x7fac040c3100 0x7fac040c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac0979a700 1 -- 172.21.15.115:0/2244099854 >> v1:172.21.15.159:6789/0 conn(0x7fac041509b0 legacy=0x7fac04154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:40.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac0979a700 1 -- 172.21.15.115:0/2244099854 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac04155190 con 0x7fac040c58d0 2023-07-27T14:37:40.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac0979a700 1 --2- 172.21.15.115:0/2244099854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c58d0 0x7fac04150d90 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fac040a63f0 tx=0x7fabf40090f0).ready entity=mon.0 client_cookie=d6d1f003868456c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:40.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac08f99700 1 -- 172.21.15.115:0/2244099854 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400b600 con 0x7fac040c58d0 2023-07-27T14:37:40.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac08f99700 1 -- 172.21.15.115:0/2244099854 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400b760 con 0x7fac040c58d0 2023-07-27T14:37:40.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.054+0000 7fac08f99700 1 -- 172.21.15.115:0/2244099854 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400bae0 con 0x7fac040c58d0 2023-07-27T14:37:40.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.055+0000 7fac0c1ff700 1 -- 172.21.15.115:0/2244099854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c58d0 msgr2=0x7fac04150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:40.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.055+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/2244099854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c58d0 0x7fac04150d90 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7fac040a63f0 tx=0x7fabf40090f0).stop 2023-07-27T14:37:40.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.055+0000 7fac0c1ff700 1 -- 172.21.15.115:0/2244099854 shutdown_connections 2023-07-27T14:37:40.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.055+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/2244099854 >> v2:172.21.15.159:3300/0 conn(0x7fac040c3100 0x7fac040c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.055+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/2244099854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c58d0 0x7fac04150d90 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.055+0000 7fac0c1ff700 1 -- 172.21.15.115:0/2244099854 >> 172.21.15.115:0/2244099854 conn(0x7fac04062320 msgr2=0x7fac04062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:40.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.055+0000 7fac0c1ff700 1 -- 172.21.15.115:0/2244099854 shutdown_connections 2023-07-27T14:37:40.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.055+0000 7fac0c1ff700 1 -- 172.21.15.115:0/2244099854 wait complete. 2023-07-27T14:37:40.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.056+0000 7fac0c1ff700 1 Processor -- start 2023-07-27T14:37:40.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.056+0000 7fac0c1ff700 1 -- start start 2023-07-27T14:37:40.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.057+0000 7fac0c1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c3100 0x7fac04149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:40.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.057+0000 7fac0c1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040c58d0 0x7fac041513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:40.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.057+0000 7fac0c1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac041509b0 0x7fac041518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:40.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.057+0000 7fac0c1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04151e80 con 0x7fac040c3100 2023-07-27T14:37:40.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.057+0000 7fac0c1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04152160 con 0x7fac040c58d0 2023-07-27T14:37:40.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.057+0000 7fac0c1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac04152440 con 0x7fac041509b0 2023-07-27T14:37:40.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c3100 0x7fac04149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:40.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c3100 0x7fac04149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52288/0 (socket says 172.21.15.115:52288) 2023-07-27T14:37:40.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 -- 172.21.15.115:0/1472884070 learned_addr learned my addr 172.21.15.115:0/1472884070 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:40.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac0a79c700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac041509b0 0x7fac041518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:40.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac0979a700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040c58d0 0x7fac041513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:40.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 -- 172.21.15.115:0/1472884070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac041509b0 msgr2=0x7fac041518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:40.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac041509b0 0x7fac041518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 -- 172.21.15.115:0/1472884070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040c58d0 msgr2=0x7fac041513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:40.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040c58d0 0x7fac041513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 -- 172.21.15.115:0/1472884070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4009370 con 0x7fac040c3100 2023-07-27T14:37:40.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fac09f9b700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c3100 0x7fac04149770 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fac0000c440 tx=0x7fac00007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:40.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fabf9ffb700 1 -- 172.21.15.115:0/1472884070 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00007020 con 0x7fac040c3100 2023-07-27T14:37:40.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fabf9ffb700 1 -- 172.21.15.115:0/1472884070 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00007180 con 0x7fac040c3100 2023-07-27T14:37:40.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.058+0000 7fabf9ffb700 1 -- 172.21.15.115:0/1472884070 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00007520 con 0x7fac040c3100 2023-07-27T14:37:40.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.059+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac04152720 con 0x7fac040c3100 2023-07-27T14:37:40.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.059+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac04149c60 con 0x7fac040c3100 2023-07-27T14:37:40.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.060+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac040a7a00 con 0x7fac040c3100 2023-07-27T14:37:40.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.060+0000 7fabf9ffb700 1 -- 172.21.15.115:0/1472884070 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fac00010070 con 0x7fac040c3100 2023-07-27T14:37:40.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.061+0000 7fabf9ffb700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fabe805f9f0 0x7fabe8061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:40.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.061+0000 7fabf9ffb700 1 -- 172.21.15.115:0/1472884070 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6323+0+0 (secure 0 0 0) 0x7fac0007a000 con 0x7fac040c3100 2023-07-27T14:37:40.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.061+0000 7fac0979a700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fabe805f9f0 0x7fabe8061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:40.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.062+0000 7fac0979a700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fabe805f9f0 0x7fabe8061eb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fabf4009130 tx=0x7fabf4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:40.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.065+0000 7fabf9ffb700 1 -- 172.21.15.115:0/1472884070 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac000478f0 con 0x7fac040c3100 2023-07-27T14:37:40.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.275+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fac0406c470 con 0x7fac040c3100 2023-07-27T14:37:40.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.847+0000 7fabf9ffb700 1 -- 172.21.15.115:0/1472884070 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7fac0004a870 con 0x7fac040c3100 2023-07-27T14:37:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fabe805f9f0 msgr2=0x7fabe8061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fabe805f9f0 0x7fabe8061eb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fabf4009130 tx=0x7fabf4017000).stop 2023-07-27T14:37:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c3100 msgr2=0x7fac04149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:40.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c3100 0x7fac04149770 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fac0000c440 tx=0x7fac00007e00).stop 2023-07-27T14:37:40.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 shutdown_connections 2023-07-27T14:37:40.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fabe805f9f0 0x7fabe8061eb0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fac041509b0 0x7fac041518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fac040c3100 0x7fac04149770 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 --2- 172.21.15.115:0/1472884070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac040c58d0 0x7fac041513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:40.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 >> 172.21.15.115:0/1472884070 conn(0x7fac04062320 msgr2=0x7fac040c1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:40.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.849+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 shutdown_connections 2023-07-27T14:37:40.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:40.850+0000 7fac0c1ff700 1 -- 172.21.15.115:0/1472884070 wait complete. 2023-07-27T14:37:40.919 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:37:41.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.060+0000 7fce6a7ff700 1 Processor -- start 2023-07-27T14:37:41.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.061+0000 7fce6a7ff700 1 -- start start 2023-07-27T14:37:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce6a7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fce64063260 0x7fce64154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce6a7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce641553f0 con 0x7fce6414ae00 2023-07-27T14:37:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce6a7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce64157a50 con 0x7fce6414b1e0 2023-07-27T14:37:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce6a7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce64157d10 con 0x7fce64063260 2023-07-27T14:37:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce63fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fce6414ae00 0x7fce64062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41684/0 (socket says 172.21.15.115:41684) 2023-07-27T14:37:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce63fff700 1 -- 172.21.15.115:0/4187103519 learned_addr learned my addr 172.21.15.115:0/4187103519 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357126872 0 0) 0x7fce641553f0 con 0x7fce6414ae00 2023-07-27T14:37:41.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce5bfff700 1 --2- 172.21.15.115:0/4187103519 >> v2:172.21.15.159:3300/0 conn(0x7fce64063260 0x7fce64154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:41.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.062+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce500033f0 con 0x7fce6414ae00 2023-07-27T14:37:41.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1648737570 0 0) 0x7fce500033f0 con 0x7fce6414ae00 2023-07-27T14:37:41.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 >> v2:172.21.15.159:3300/0 conn(0x7fce64063260 msgr2=0x7fce64154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:41.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 --2- 172.21.15.115:0/4187103519 >> v2:172.21.15.159:3300/0 conn(0x7fce64063260 0x7fce64154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 >> v1:172.21.15.159:6789/0 conn(0x7fce6414b1e0 legacy=0x7fce640a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:41.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64157ff0 con 0x7fce6414ae00 2023-07-27T14:37:41.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fce54001470 con 0x7fce6414ae00 2023-07-27T14:37:41.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 >> v1:172.21.15.115:6789/0 conn(0x7fce6414ae00 legacy=0x7fce64062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:41.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce500038e0 0x7fce50003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce50004690 0x7fce50004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce50005000 0x7fce5000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64157d10 con 0x7fce500038e0 2023-07-27T14:37:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5000bf60 con 0x7fce50004690 2023-07-27T14:37:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5000c0f0 con 0x7fce50005000 2023-07-27T14:37:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce63fff700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce500038e0 0x7fce50003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:41.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce5bfff700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce50004690 0x7fce50004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce68d9c700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce50005000 0x7fce5000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce63fff700 1 -- 172.21.15.115:0/4187103519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce50005000 msgr2=0x7fce5000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce63fff700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce50005000 0x7fce5000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce63fff700 1 -- 172.21.15.115:0/4187103519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce50004690 msgr2=0x7fce50004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce63fff700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce50004690 0x7fce50004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.063+0000 7fce63fff700 1 -- 172.21.15.115:0/4187103519 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce500033f0 con 0x7fce500038e0 2023-07-27T14:37:41.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce68d9c700 1 -- 172.21.15.115:0/4187103519 reap_dead start 2023-07-27T14:37:41.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce63fff700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce500038e0 0x7fce50003d00 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7fce5400c190 tx=0x7fce54001e50).ready entity=mon.0 client_cookie=1d0547fa175eede server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:41.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54007a20 con 0x7fce500038e0 2023-07-27T14:37:41.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5400cac0 con 0x7fce500038e0 2023-07-27T14:37:41.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce637fe700 1 -- 172.21.15.115:0/4187103519 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5400ce40 con 0x7fce500038e0 2023-07-27T14:37:41.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce6a7ff700 1 -- 172.21.15.115:0/4187103519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce500038e0 msgr2=0x7fce50003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:41.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce6a7ff700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce500038e0 0x7fce50003d00 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7fce5400c190 tx=0x7fce54001e50).stop 2023-07-27T14:37:41.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce6a7ff700 1 -- 172.21.15.115:0/4187103519 shutdown_connections 2023-07-27T14:37:41.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce6a7ff700 1 --2- 172.21.15.115:0/4187103519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce500038e0 0x7fce50003d00 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce6a7ff700 1 -- 172.21.15.115:0/4187103519 >> 172.21.15.115:0/4187103519 conn(0x7fce6405e940 msgr2=0x7fce640cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:41.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce6a7ff700 1 -- 172.21.15.115:0/4187103519 shutdown_connections 2023-07-27T14:37:41.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.064+0000 7fce6a7ff700 1 -- 172.21.15.115:0/4187103519 wait complete. 2023-07-27T14:37:41.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.066+0000 7fce6a7ff700 1 Processor -- start 2023-07-27T14:37:41.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.066+0000 7fce6a7ff700 1 -- start start 2023-07-27T14:37:41.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce6a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce500038e0 0x7fce6414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:41.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce6a7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64164100 0x7fce641491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:41.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce6a7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6414b7a0 0x7fce640c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:41.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce6a7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64165140 con 0x7fce6414b7a0 2023-07-27T14:37:41.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce6a7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6414e4a0 con 0x7fce64164100 2023-07-27T14:37:41.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce6a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce641496c0 con 0x7fce500038e0 2023-07-27T14:37:41.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce68d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6414b7a0 0x7fce640c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:41.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce68d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6414b7a0 0x7fce640c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52296/0 (socket says 172.21.15.115:52296) 2023-07-27T14:37:41.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce68d9c700 1 -- 172.21.15.115:0/3158279650 learned_addr learned my addr 172.21.15.115:0/3158279650 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:41.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce5bfff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64164100 0x7fce641491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:41.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.067+0000 7fce63fff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce500038e0 0x7fce6414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:41.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce68d9c700 1 -- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce500038e0 msgr2=0x7fce6414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:41.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce68d9c700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce500038e0 0x7fce6414dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce68d9c700 1 -- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64164100 msgr2=0x7fce641491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:41.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce68d9c700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64164100 0x7fce641491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce68d9c700 1 -- 172.21.15.115:0/3158279650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce640c37b0 con 0x7fce6414b7a0 2023-07-27T14:37:41.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce63fff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce500038e0 0x7fce6414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:41.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce68d9c700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6414b7a0 0x7fce640c9460 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7fce6405fbb0 tx=0x7fce5c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:41.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce60ff9700 1 -- 172.21.15.115:0/3158279650 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c003030 con 0x7fce6414b7a0 2023-07-27T14:37:41.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce60ff9700 1 -- 172.21.15.115:0/3158279650 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c003190 con 0x7fce6414b7a0 2023-07-27T14:37:41.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce641645c0 con 0x7fce6414b7a0 2023-07-27T14:37:41.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce60ff9700 1 -- 172.21.15.115:0/3158279650 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c001790 con 0x7fce6414b7a0 2023-07-27T14:37:41.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.068+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce64164b80 con 0x7fce6414b7a0 2023-07-27T14:37:41.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.069+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6406c470 con 0x7fce6414b7a0 2023-07-27T14:37:41.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.070+0000 7fce60ff9700 1 -- 172.21.15.115:0/3158279650 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fce5c001b40 con 0x7fce6414b7a0 2023-07-27T14:37:41.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.071+0000 7fce60ff9700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce4405f9f0 0x7fce44061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:41.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.071+0000 7fce60ff9700 1 -- 172.21.15.115:0/3158279650 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6323+0+0 (secure 0 0 0) 0x7fce5c07a120 con 0x7fce6414b7a0 2023-07-27T14:37:41.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.071+0000 7fce63fff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce4405f9f0 0x7fce44061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:41.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.071+0000 7fce63fff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce4405f9f0 0x7fce44061eb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fce6414b730 tx=0x7fce54015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:41.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.074+0000 7fce60ff9700 1 -- 172.21.15.115:0/3158279650 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce5c04a990 con 0x7fce6414b7a0 2023-07-27T14:37:41.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.246+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fce640ca8a0 con 0x7fce6414b7a0 2023-07-27T14:37:41.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.851+0000 7fce60ff9700 1 -- 172.21.15.115:0/3158279650 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v164) v1 ==== 181+0+0 (secure 0 0 0) 0x7fce5c01c070 con 0x7fce6414b7a0 2023-07-27T14:37:41.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce4405f9f0 msgr2=0x7fce44061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:41.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce4405f9f0 0x7fce44061eb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fce6414b730 tx=0x7fce54015000).stop 2023-07-27T14:37:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6414b7a0 msgr2=0x7fce640c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6414b7a0 0x7fce640c9460 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7fce6405fbb0 tx=0x7fce5c009040).stop 2023-07-27T14:37:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 shutdown_connections 2023-07-27T14:37:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce4405f9f0 0x7fce44061eb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce6414b7a0 0x7fce640c9460 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce500038e0 0x7fce6414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 --2- 172.21.15.115:0/3158279650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce64164100 0x7fce641491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:41.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 >> 172.21.15.115:0/3158279650 conn(0x7fce6405e940 msgr2=0x7fce641537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:41.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 shutdown_connections 2023-07-27T14:37:41.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:41.853+0000 7fce6a7ff700 1 -- 172.21.15.115:0/3158279650 wait complete. 2023-07-27T14:37:41.906 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:37:41.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:37:42.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.065+0000 7f1e12bff700 1 Processor -- start 2023-07-27T14:37:42.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.065+0000 7f1e12bff700 1 -- start start 2023-07-27T14:37:42.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.066+0000 7f1e12bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e0c14ae00 0x7f1e0c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:42.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e12bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1e0c063260 0x7f1e0c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:42.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e12bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0c1553f0 con 0x7f1e0c14b1e0 2023-07-27T14:37:42.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e12bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0c157a50 con 0x7f1e0c14ae00 2023-07-27T14:37:42.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e12bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0c157d10 con 0x7f1e0c063260 2023-07-27T14:37:42.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e0bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1e0c14b1e0 0x7f1e0c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41696/0 (socket says 172.21.15.115:41696) 2023-07-27T14:37:42.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e1099b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1e0c14ae00 0x7f1e0c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:42.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e0bfff700 1 -- 172.21.15.115:0/3916644786 learned_addr learned my addr 172.21.15.115:0/3916644786 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:42.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e1119c700 1 --2- 172.21.15.115:0/3916644786 >> v2:172.21.15.159:3300/0 conn(0x7f1e0c063260 0x7f1e0c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:42.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e0b7fe700 1 -- 172.21.15.115:0/3916644786 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708303433 0 0) 0x7f1e0c1553f0 con 0x7f1e0c14b1e0 2023-07-27T14:37:42.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e0b7fe700 1 -- 172.21.15.115:0/3916644786 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dfc0033f0 con 0x7f1e0c14b1e0 2023-07-27T14:37:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e1099b700 1 -- 172.21.15.115:0/3916644786 >> v2:172.21.15.159:3300/0 conn(0x7f1e0c063260 msgr2=0x7f1e0c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e1099b700 1 --2- 172.21.15.115:0/3916644786 >> v2:172.21.15.159:3300/0 conn(0x7f1e0c063260 0x7f1e0c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e1099b700 1 -- 172.21.15.115:0/3916644786 >> v1:172.21.15.115:6789/0 conn(0x7f1e0c14b1e0 legacy=0x7f1e0c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.067+0000 7f1e1099b700 1 -- 172.21.15.115:0/3916644786 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c157ff0 con 0x7f1e0c14ae00 2023-07-27T14:37:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e1099b700 1 --2- 172.21.15.115:0/3916644786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c14ae00 0x7f1e0c154f00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f1e0c083430 tx=0x7f1e00009060).ready entity=mon.0 client_cookie=d1a84b13b91415ae server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e0b7fe700 1 -- 172.21.15.115:0/3916644786 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000d4a0 con 0x7f1e0c14ae00 2023-07-27T14:37:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e0b7fe700 1 -- 172.21.15.115:0/3916644786 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000d600 con 0x7f1e0c14ae00 2023-07-27T14:37:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e0b7fe700 1 -- 172.21.15.115:0/3916644786 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000d980 con 0x7f1e0c14ae00 2023-07-27T14:37:42.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e12bff700 1 -- 172.21.15.115:0/3916644786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c14ae00 msgr2=0x7f1e0c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:42.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3916644786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c14ae00 0x7f1e0c154f00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f1e0c083430 tx=0x7f1e00009060).stop 2023-07-27T14:37:42.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e12bff700 1 -- 172.21.15.115:0/3916644786 shutdown_connections 2023-07-27T14:37:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3916644786 >> v2:172.21.15.159:3300/0 conn(0x7f1e0c063260 0x7f1e0c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3916644786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c14ae00 0x7f1e0c154f00 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.068+0000 7f1e12bff700 1 -- 172.21.15.115:0/3916644786 >> 172.21.15.115:0/3916644786 conn(0x7f1e0c05e940 msgr2=0x7f1e0c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:42.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.069+0000 7f1e12bff700 1 -- 172.21.15.115:0/3916644786 shutdown_connections 2023-07-27T14:37:42.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.069+0000 7f1e12bff700 1 -- 172.21.15.115:0/3916644786 wait complete. 2023-07-27T14:37:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.071+0000 7f1e12bff700 1 Processor -- start 2023-07-27T14:37:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.071+0000 7f1e12bff700 1 -- start start 2023-07-27T14:37:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e12bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c063260 0x7f1e0c0c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:42.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e12bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e0c14ae00 0x7f1e0c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e12bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e0c14b1e0 0x7f1e0c0ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e12bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0c3fc0 con 0x7f1e0c063260 2023-07-27T14:37:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e12bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0c20e0 con 0x7f1e0c14ae00 2023-07-27T14:37:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e12bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0c23c0 con 0x7f1e0c14b1e0 2023-07-27T14:37:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e1099b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c063260 0x7f1e0c0c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e1099b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c063260 0x7f1e0c0c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52324/0 (socket says 172.21.15.115:52324) 2023-07-27T14:37:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.072+0000 7f1e1099b700 1 -- 172.21.15.115:0/3063612362 learned_addr learned my addr 172.21.15.115:0/3063612362 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e0bfff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e0c14ae00 0x7f1e0c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e1119c700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e0c14b1e0 0x7f1e0c0ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e1099b700 1 -- 172.21.15.115:0/3063612362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e0c14b1e0 msgr2=0x7f1e0c0ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e1099b700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e0c14b1e0 0x7f1e0c0ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e1099b700 1 -- 172.21.15.115:0/3063612362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e0c14ae00 msgr2=0x7f1e0c149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e1099b700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e0c14ae00 0x7f1e0c149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e1099b700 1 -- 172.21.15.115:0/3063612362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000092a0 con 0x7f1e0c063260 2023-07-27T14:37:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e1099b700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c063260 0x7f1e0c0c3ad0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f1e0c155580 tx=0x7f1e00016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e08ff9700 1 -- 172.21.15.115:0/3063612362 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00000c90 con 0x7f1e0c063260 2023-07-27T14:37:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e08ff9700 1 -- 172.21.15.115:0/3063612362 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000d770 con 0x7f1e0c063260 2023-07-27T14:37:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c0c26a0 con 0x7f1e0c063260 2023-07-27T14:37:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e08ff9700 1 -- 172.21.15.115:0/3063612362 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0001d430 con 0x7f1e0c063260 2023-07-27T14:37:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.073+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0c0c3660 con 0x7f1e0c063260 2023-07-27T14:37:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.074+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0c06c470 con 0x7f1e0c063260 2023-07-27T14:37:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.075+0000 7f1e08ff9700 1 -- 172.21.15.115:0/3063612362 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f1e00024030 con 0x7f1e0c063260 2023-07-27T14:37:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.076+0000 7f1e08ff9700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1df005f9c0 0x7f1df0061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.077+0000 7f1e08ff9700 1 -- 172.21.15.115:0/3063612362 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f1e0007bd70 con 0x7f1e0c063260 2023-07-27T14:37:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.077+0000 7f1e0bfff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1df005f9c0 0x7f1df0061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.077+0000 7f1e0bfff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1df005f9c0 0x7f1df0061e80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f1e0c0cb090 tx=0x7f1df8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:42.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.081+0000 7f1e08ff9700 1 -- 172.21.15.115:0/3063612362 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e0004c6d0 con 0x7f1e0c063260 2023-07-27T14:37:42.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.250+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e0c0641d0 con 0x7f1e0c063260 2023-07-27T14:37:42.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.858+0000 7f1e08ff9700 1 -- 172.21.15.115:0/3063612362 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v165) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1e00022070 con 0x7f1e0c063260 2023-07-27T14:37:42.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1df005f9c0 msgr2=0x7f1df0061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:42.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1df005f9c0 0x7f1df0061e80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f1e0c0cb090 tx=0x7f1df8009040).stop 2023-07-27T14:37:42.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c063260 msgr2=0x7f1e0c0c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:42.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c063260 0x7f1e0c0c3ad0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f1e0c155580 tx=0x7f1e00016000).stop 2023-07-27T14:37:42.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 shutdown_connections 2023-07-27T14:37:42.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1df005f9c0 0x7f1df0061e80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e0c14b1e0 0x7f1e0c0ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e0c063260 0x7f1e0c0c3ad0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 --2- 172.21.15.115:0/3063612362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e0c14ae00 0x7f1e0c149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:42.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 >> 172.21.15.115:0/3063612362 conn(0x7f1e0c05e940 msgr2=0x7f1e0c152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:42.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 shutdown_connections 2023-07-27T14:37:42.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:42.861+0000 7f1e12bff700 1 -- 172.21.15.115:0/3063612362 wait complete. 2023-07-27T14:37:42.914 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:37:42.935 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-07-27T14:37:43.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.077+0000 7f80d7bff700 1 Processor -- start 2023-07-27T14:37:43.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.077+0000 7f80d7bff700 1 -- start start 2023-07-27T14:37:43.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.079+0000 7f80d7bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80d014b1e0 0x7f80d0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.079+0000 7f80d7bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d01553f0 con 0x7f80d0063260 2023-07-27T14:37:43.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.079+0000 7f80d7bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0157a50 con 0x7f80d014ae00 2023-07-27T14:37:43.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.079+0000 7f80d7bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d0157d10 con 0x7f80d014b1e0 2023-07-27T14:37:43.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.079+0000 7f80d619c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80d014b1e0 0x7f80d0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.079+0000 7f80d519a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f80d0063260 0x7f80d00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41704/0 (socket says 172.21.15.115:41704) 2023-07-27T14:37:43.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.079+0000 7f80d519a700 1 -- 172.21.15.115:0/427386529 learned_addr learned my addr 172.21.15.115:0/427386529 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:43.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.079+0000 7f80d4999700 1 -- 172.21.15.115:0/427386529 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202389042 0 0) 0x7f80d01553f0 con 0x7f80d0063260 2023-07-27T14:37:43.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d619c700 1 -- 172.21.15.115:0/427386529 >> v1:172.21.15.159:6789/0 conn(0x7f80d014ae00 legacy=0x7f80d0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d619c700 1 -- 172.21.15.115:0/427386529 >> v1:172.21.15.115:6789/0 conn(0x7f80d0063260 legacy=0x7f80d00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d619c700 1 -- 172.21.15.115:0/427386529 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0157ff0 con 0x7f80d014b1e0 2023-07-27T14:37:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d619c700 1 --2- 172.21.15.115:0/427386529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d014b1e0 0x7f80d0154f00 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f80c8009e60 tx=0x7f80c8009780).ready entity=mon.0 client_cookie=4d3655311f50998 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d4999700 1 -- 172.21.15.115:0/427386529 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800e070 con 0x7f80d014b1e0 2023-07-27T14:37:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d4999700 1 -- 172.21.15.115:0/427386529 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c800bc30 con 0x7f80d014b1e0 2023-07-27T14:37:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d4999700 1 -- 172.21.15.115:0/427386529 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8012410 con 0x7f80d014b1e0 2023-07-27T14:37:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d7bff700 1 -- 172.21.15.115:0/427386529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d014b1e0 msgr2=0x7f80d0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.080+0000 7f80d7bff700 1 --2- 172.21.15.115:0/427386529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d014b1e0 0x7f80d0154f00 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f80c8009e60 tx=0x7f80c8009780).stop 2023-07-27T14:37:43.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.081+0000 7f80d7bff700 1 -- 172.21.15.115:0/427386529 shutdown_connections 2023-07-27T14:37:43.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.081+0000 7f80d7bff700 1 --2- 172.21.15.115:0/427386529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d014b1e0 0x7f80d0154f00 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.081+0000 7f80d7bff700 1 -- 172.21.15.115:0/427386529 >> 172.21.15.115:0/427386529 conn(0x7f80d005e940 msgr2=0x7f80d00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.081+0000 7f80d7bff700 1 -- 172.21.15.115:0/427386529 shutdown_connections 2023-07-27T14:37:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.081+0000 7f80d7bff700 1 -- 172.21.15.115:0/427386529 wait complete. 2023-07-27T14:37:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.082+0000 7f80d7bff700 1 Processor -- start 2023-07-27T14:37:43.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.082+0000 7f80d7bff700 1 -- start start 2023-07-27T14:37:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.083+0000 7f80d7bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d0063260 0x7f80d014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.083+0000 7f80d7bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80d014ae00 0x7f80d00c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.083+0000 7f80d7bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d014b1e0 0x7f80d00c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.083+0000 7f80d7bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d014a1c0 con 0x7f80d0063260 2023-07-27T14:37:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.083+0000 7f80d7bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00adb60 con 0x7f80d014b1e0 2023-07-27T14:37:43.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.083+0000 7f80d7bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00ade00 con 0x7f80d014ae00 2023-07-27T14:37:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d0063260 0x7f80d014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d0063260 0x7f80d014bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52336/0 (socket says 172.21.15.115:52336) 2023-07-27T14:37:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 -- 172.21.15.115:0/3463423145 learned_addr learned my addr 172.21.15.115:0/3463423145 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d519a700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80d014ae00 0x7f80d00c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d619c700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d014b1e0 0x7f80d00c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 -- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80d014ae00 msgr2=0x7f80d00c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80d014ae00 0x7f80d00c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 -- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d014b1e0 msgr2=0x7f80d00c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d014b1e0 0x7f80d00c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 -- 172.21.15.115:0/3463423145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8009a20 con 0x7f80d0063260 2023-07-27T14:37:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d619c700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d014b1e0 0x7f80d00c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d599b700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d0063260 0x7f80d014bf60 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f80cc00c4c0 tx=0x7f80cc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80c5ffb700 1 -- 172.21.15.115:0/3463423145 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc007020 con 0x7f80d0063260 2023-07-27T14:37:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80c5ffb700 1 -- 172.21.15.115:0/3463423145 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc001e90 con 0x7f80d0063260 2023-07-27T14:37:43.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d00ae0e0 con 0x7f80d0063260 2023-07-27T14:37:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.084+0000 7f80c5ffb700 1 -- 172.21.15.115:0/3463423145 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0073b0 con 0x7f80d0063260 2023-07-27T14:37:43.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.085+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d00ae6a0 con 0x7f80d0063260 2023-07-27T14:37:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.086+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d00c8550 con 0x7f80d0063260 2023-07-27T14:37:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.086+0000 7f80c5ffb700 1 -- 172.21.15.115:0/3463423145 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f80cc010070 con 0x7f80d0063260 2023-07-27T14:37:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.087+0000 7f80c5ffb700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80b405f9f0 0x7f80b4061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.087+0000 7f80c5ffb700 1 -- 172.21.15.115:0/3463423145 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f80cc07a430 con 0x7f80d0063260 2023-07-27T14:37:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.087+0000 7f80d519a700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80b405f9f0 0x7f80b4061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.088+0000 7f80d519a700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80b405f9f0 0x7f80b4061eb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f80d00c2c30 tx=0x7f80c0007db0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.091+0000 7f80c5ffb700 1 -- 172.21.15.115:0/3463423145 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f80cc04aff0 con 0x7f80d0063260 2023-07-27T14:37:43.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.266+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f80d006c470 con 0x7f80d0063260 2023-07-27T14:37:43.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.270+0000 7f80c5ffb700 1 -- 172.21.15.115:0/3463423145 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v32) v1 ==== 115+0+0 (secure 0 0 0) 0x7f80cc04e610 con 0x7f80d0063260 2023-07-27T14:37:43.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.272+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80b405f9f0 msgr2=0x7f80b4061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.272+0000 7f80d7bff700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80b405f9f0 0x7f80b4061eb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f80d00c2c30 tx=0x7f80c0007db0).stop 2023-07-27T14:37:43.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.272+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d0063260 msgr2=0x7f80d014bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.272+0000 7f80d7bff700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d0063260 0x7f80d014bf60 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f80cc00c4c0 tx=0x7f80cc007e00).stop 2023-07-27T14:37:43.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.273+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 shutdown_connections 2023-07-27T14:37:43.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.273+0000 7f80d7bff700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f80b405f9f0 0x7f80b4061eb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.273+0000 7f80d7bff700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d014b1e0 0x7f80d00c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.273+0000 7f80d7bff700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80d0063260 0x7f80d014bf60 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.273+0000 7f80d7bff700 1 --2- 172.21.15.115:0/3463423145 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f80d014ae00 0x7f80d00c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.273+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 >> 172.21.15.115:0/3463423145 conn(0x7f80d005e940 msgr2=0x7f80d014a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:43.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.273+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 shutdown_connections 2023-07-27T14:37:43.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.273+0000 7f80d7bff700 1 -- 172.21.15.115:0/3463423145 wait complete. 2023-07-27T14:37:43.341 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:37:43.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.483+0000 7f11ae1ff700 1 Processor -- start 2023-07-27T14:37:43.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.483+0000 7f11ae1ff700 1 -- start start 2023-07-27T14:37:43.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.484+0000 7f11ae1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f11a8063260 0x7f11a8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.484+0000 7f11ae1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a81553f0 con 0x7f11a814ae00 2023-07-27T14:37:43.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.484+0000 7f11ae1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a8157a50 con 0x7f11a814b1e0 2023-07-27T14:37:43.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.484+0000 7f11ae1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a8157d10 con 0x7f11a8063260 2023-07-27T14:37:43.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f11a8063260 0x7f11a8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f11a814ae00 0x7f11a8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41718/0 (socket says 172.21.15.115:41718) 2023-07-27T14:37:43.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a77fe700 1 -- 172.21.15.115:0/1139335838 learned_addr learned my addr 172.21.15.115:0/1139335838 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a6ffd700 1 -- 172.21.15.115:0/1139335838 >> v1:172.21.15.159:6789/0 conn(0x7f11a814b1e0 legacy=0x7f11a80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a6ffd700 1 -- 172.21.15.115:0/1139335838 >> v1:172.21.15.115:6789/0 conn(0x7f11a814ae00 legacy=0x7f11a8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a6ffd700 1 -- 172.21.15.115:0/1139335838 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8157ff0 con 0x7f11a8063260 2023-07-27T14:37:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a67fc700 1 -- 172.21.15.115:0/1139335838 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766978114 0 0) 0x7f11a81553f0 con 0x7f11a814ae00 2023-07-27T14:37:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a6ffd700 1 --2- 172.21.15.115:0/1139335838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a8063260 0x7f11a8154f00 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f119c009760 tx=0x7f119c009060).ready entity=mon.0 client_cookie=31b0940238c884d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.485+0000 7f11a67fc700 1 -- 172.21.15.115:0/1139335838 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00b520 con 0x7f11a8063260 2023-07-27T14:37:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11a67fc700 1 -- 172.21.15.115:0/1139335838 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00b680 con 0x7f11a8063260 2023-07-27T14:37:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11a67fc700 1 -- 172.21.15.115:0/1139335838 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00ba00 con 0x7f11a8063260 2023-07-27T14:37:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11ae1ff700 1 -- 172.21.15.115:0/1139335838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a8063260 msgr2=0x7f11a8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11ae1ff700 1 --2- 172.21.15.115:0/1139335838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a8063260 0x7f11a8154f00 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f119c009760 tx=0x7f119c009060).stop 2023-07-27T14:37:43.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11ae1ff700 1 -- 172.21.15.115:0/1139335838 shutdown_connections 2023-07-27T14:37:43.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11ae1ff700 1 --2- 172.21.15.115:0/1139335838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a8063260 0x7f11a8154f00 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11ae1ff700 1 -- 172.21.15.115:0/1139335838 >> 172.21.15.115:0/1139335838 conn(0x7f11a805e940 msgr2=0x7f11a80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:43.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11ae1ff700 1 -- 172.21.15.115:0/1139335838 shutdown_connections 2023-07-27T14:37:43.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.486+0000 7f11ae1ff700 1 -- 172.21.15.115:0/1139335838 wait complete. 2023-07-27T14:37:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.488+0000 7f11ae1ff700 1 Processor -- start 2023-07-27T14:37:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.488+0000 7f11ae1ff700 1 -- start start 2023-07-27T14:37:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11ae1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a8063260 0x7f11a813cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11ae1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a814ae00 0x7f11a80b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11ae1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11a814b1e0 0x7f11a814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11ae1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a814c5e0 con 0x7f11a814ae00 2023-07-27T14:37:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11ae1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a814c830 con 0x7f11a8063260 2023-07-27T14:37:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11ae1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a814cb10 con 0x7f11a814b1e0 2023-07-27T14:37:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a814ae00 0x7f11a80b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a814ae00 0x7f11a80b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52354/0 (socket says 172.21.15.115:52354) 2023-07-27T14:37:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a6ffd700 1 -- 172.21.15.115:0/2587144121 learned_addr learned my addr 172.21.15.115:0/2587144121 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a77fe700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a8063260 0x7f11a813cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a7fff700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11a814b1e0 0x7f11a814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a6ffd700 1 -- 172.21.15.115:0/2587144121 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11a814b1e0 msgr2=0x7f11a814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a6ffd700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11a814b1e0 0x7f11a814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a6ffd700 1 -- 172.21.15.115:0/2587144121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a8063260 msgr2=0x7f11a813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.490+0000 7f11a6ffd700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a8063260 0x7f11a813cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.491+0000 7f11a6ffd700 1 -- 172.21.15.115:0/2587144121 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c0092a0 con 0x7f11a814ae00 2023-07-27T14:37:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.491+0000 7f11a6ffd700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a814ae00 0x7f11a80b0410 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f11a8155580 tx=0x7f119c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.491+0000 7f118f7fe700 1 -- 172.21.15.115:0/2587144121 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00be90 con 0x7f11a814ae00 2023-07-27T14:37:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.491+0000 7f118f7fe700 1 -- 172.21.15.115:0/2587144121 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00b7f0 con 0x7f11a814ae00 2023-07-27T14:37:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.491+0000 7f118f7fe700 1 -- 172.21.15.115:0/2587144121 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c01b650 con 0x7f11a814ae00 2023-07-27T14:37:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.491+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a814cdf0 con 0x7f11a814ae00 2023-07-27T14:37:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.491+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a813d2e0 con 0x7f11a814ae00 2023-07-27T14:37:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.492+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a814d310 con 0x7f11a814ae00 2023-07-27T14:37:43.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.493+0000 7f118f7fe700 1 -- 172.21.15.115:0/2587144121 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f119c02a070 con 0x7f11a814ae00 2023-07-27T14:37:43.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.494+0000 7f118f7fe700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f119405f9f0 0x7f1194061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.494+0000 7f118f7fe700 1 -- 172.21.15.115:0/2587144121 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f119c07c230 con 0x7f11a814ae00 2023-07-27T14:37:43.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.494+0000 7f11a77fe700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f119405f9f0 0x7f1194061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.494+0000 7f11a77fe700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f119405f9f0 0x7f1194061eb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f11980011e0 tx=0x7f1198007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.498+0000 7f118f7fe700 1 -- 172.21.15.115:0/2587144121 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11a814d310 con 0x7f11a814ae00 2023-07-27T14:37:43.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.669+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f11a814d310 con 0x7f11a814ae00 2023-07-27T14:37:43.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.673+0000 7f118f7fe700 1 -- 172.21.15.115:0/2587144121 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f11a814d310 con 0x7f11a814ae00 2023-07-27T14:37:43.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f119405f9f0 msgr2=0x7f1194061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f119405f9f0 0x7f1194061eb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f11980011e0 tx=0x7f1198007bb0).stop 2023-07-27T14:37:43.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a814ae00 msgr2=0x7f11a80b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a814ae00 0x7f11a80b0410 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f11a8155580 tx=0x7f119c017000).stop 2023-07-27T14:37:43.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 shutdown_connections 2023-07-27T14:37:43.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f119405f9f0 0x7f1194061eb0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f11a814b1e0 0x7f11a814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11a8063260 0x7f11a813cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 --2- 172.21.15.115:0/2587144121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11a814ae00 0x7f11a80b0410 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 >> 172.21.15.115:0/2587144121 conn(0x7f11a805e940 msgr2=0x7f11a80ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:43.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 shutdown_connections 2023-07-27T14:37:43.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.675+0000 7f11ae1ff700 1 -- 172.21.15.115:0/2587144121 wait complete. 2023-07-27T14:37:43.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_source' 2023-07-27T14:37:43.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.885+0000 7f6bcc1ff700 1 Processor -- start 2023-07-27T14:37:43.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.885+0000 7f6bcc1ff700 1 -- start start 2023-07-27T14:37:43.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.886+0000 7f6bcc1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6bc4153ec0 0x7f6bc40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bcc1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6bc40aaa40 0x7f6bc40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bcc1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40aa4d0 con 0x7f6bc40aa050 2023-07-27T14:37:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bcc1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40c05c0 con 0x7f6bc4153ec0 2023-07-27T14:37:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bcc1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40bfc90 con 0x7f6bc40aaa40 2023-07-27T14:37:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc979a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6bc40aa050 0x7f6bc40640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41546/0 (socket says 172.21.15.115:41546) 2023-07-27T14:37:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc979a700 1 -- 172.21.15.115:0/2225121890 learned_addr learned my addr 172.21.15.115:0/2225121890 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc9f9b700 1 --2- 172.21.15.115:0/2225121890 >> v2:172.21.15.115:3300/0 conn(0x7f6bc4153ec0 0x7f6bc40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bca79c700 1 --2- 172.21.15.115:0/2225121890 >> v2:172.21.15.159:3300/0 conn(0x7f6bc40aaa40 0x7f6bc40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc8f99700 1 -- 172.21.15.115:0/2225121890 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410453823 0 0) 0x7f6bb4001110 con 0x7f6bc40aa050 2023-07-27T14:37:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc9f9b700 1 -- 172.21.15.115:0/2225121890 >> v2:172.21.15.159:3300/0 conn(0x7f6bc40aaa40 msgr2=0x7f6bc40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc9f9b700 1 --2- 172.21.15.115:0/2225121890 >> v2:172.21.15.159:3300/0 conn(0x7f6bc40aaa40 0x7f6bc40c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc9f9b700 1 -- 172.21.15.115:0/2225121890 >> v1:172.21.15.115:6789/0 conn(0x7f6bc40aa050 legacy=0x7f6bc40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc9f9b700 1 -- 172.21.15.115:0/2225121890 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40bff70 con 0x7f6bc4153ec0 2023-07-27T14:37:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.887+0000 7f6bc9f9b700 1 --2- 172.21.15.115:0/2225121890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc4153ec0 0x7f6bc40a9b60 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f6bc40c5470 tx=0x7f6bc0009060).ready entity=mon.0 client_cookie=4b60d22a5589d3b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bc8f99700 1 -- 172.21.15.115:0/2225121890 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000b580 con 0x7f6bc4153ec0 2023-07-27T14:37:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bc8f99700 1 -- 172.21.15.115:0/2225121890 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000b6e0 con 0x7f6bc4153ec0 2023-07-27T14:37:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bc8f99700 1 -- 172.21.15.115:0/2225121890 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000ba60 con 0x7f6bc4153ec0 2023-07-27T14:37:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/2225121890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc4153ec0 msgr2=0x7f6bc40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/2225121890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc4153ec0 0x7f6bc40a9b60 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f6bc40c5470 tx=0x7f6bc0009060).stop 2023-07-27T14:37:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/2225121890 shutdown_connections 2023-07-27T14:37:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/2225121890 >> v2:172.21.15.159:3300/0 conn(0x7f6bc40aaa40 0x7f6bc40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/2225121890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc4153ec0 0x7f6bc40a9b60 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/2225121890 >> 172.21.15.115:0/2225121890 conn(0x7f6bc40cb610 msgr2=0x7f6bc40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/2225121890 shutdown_connections 2023-07-27T14:37:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.888+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/2225121890 wait complete. 2023-07-27T14:37:43.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.890+0000 7f6bcc1ff700 1 Processor -- start 2023-07-27T14:37:43.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.890+0000 7f6bcc1ff700 1 -- start start 2023-07-27T14:37:43.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bcc1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc40aa050 0x7f6bc414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bcc1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc40aaa40 0x7f6bc414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bcc1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bc4153ec0 0x7f6bc4152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bcc1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc414eca0 con 0x7f6bc40aa050 2023-07-27T14:37:43.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bcc1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc414e090 con 0x7f6bc40aaa40 2023-07-27T14:37:43.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bcc1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc414e370 con 0x7f6bc4153ec0 2023-07-27T14:37:43.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bc9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc40aa050 0x7f6bc414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bc9f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc40aa050 0x7f6bc414d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32802/0 (socket says 172.21.15.115:32802) 2023-07-27T14:37:43.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bc9f9b700 1 -- 172.21.15.115:0/226475004 learned_addr learned my addr 172.21.15.115:0/226475004 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:43.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bc9f9b700 1 -- 172.21.15.115:0/226475004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bc4153ec0 msgr2=0x7f6bc4152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bc979a700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc40aaa40 0x7f6bc414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bc9f9b700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bc4153ec0 0x7f6bc4152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.891+0000 7f6bc9f9b700 1 -- 172.21.15.115:0/226475004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc40aaa40 msgr2=0x7f6bc414cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bc9f9b700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc40aaa40 0x7f6bc414cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bc9f9b700 1 -- 172.21.15.115:0/226475004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00092a0 con 0x7f6bc40aa050 2023-07-27T14:37:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bc979a700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc40aaa40 0x7f6bc414cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:43.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bc9f9b700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc40aa050 0x7f6bc414d8b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f6bc0009fd0 tx=0x7f6bc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bb9ffb700 1 -- 172.21.15.115:0/226475004 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000b850 con 0x7f6bc40aa050 2023-07-27T14:37:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bb9ffb700 1 -- 172.21.15.115:0/226475004 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000b9b0 con 0x7f6bc40aa050 2023-07-27T14:37:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc414e650 con 0x7f6bc40aa050 2023-07-27T14:37:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bb9ffb700 1 -- 172.21.15.115:0/226475004 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc001b690 con 0x7f6bc40aa050 2023-07-27T14:37:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.892+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc414dda0 con 0x7f6bc40aa050 2023-07-27T14:37:43.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.893+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc406c470 con 0x7f6bc40aa050 2023-07-27T14:37:43.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.894+0000 7f6bb9ffb700 1 -- 172.21.15.115:0/226475004 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f6bc000f070 con 0x7f6bc40aa050 2023-07-27T14:37:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.895+0000 7f6bb9ffb700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6ba805f9c0 0x7f6ba8061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.895+0000 7f6bb9ffb700 1 -- 172.21.15.115:0/226475004 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f6bc007c460 con 0x7f6bc40aa050 2023-07-27T14:37:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.895+0000 7f6bc979a700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6ba805f9c0 0x7f6ba8061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.896+0000 7f6bc979a700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6ba805f9c0 0x7f6ba8061e80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f6bc414f6f0 tx=0x7f6bb4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:43.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:43.899+0000 7f6bb9ffb700 1 -- 172.21.15.115:0/226475004 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bc004cf90 con 0x7f6bc40aa050 2023-07-27T14:37:44.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.134+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_source"]} v 0) v1 -- 0x7f6bc40c0250 con 0x7f6bc40aa050 2023-07-27T14:37:44.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.862+0000 7f6bb9ffb700 1 -- 172.21.15.115:0/226475004 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_in_progress_source"]}]=0 v541) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6bc00505b0 con 0x7f6bc40aa050 2023-07-27T14:37:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6ba805f9c0 msgr2=0x7f6ba8061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6ba805f9c0 0x7f6ba8061e80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f6bc414f6f0 tx=0x7f6bb4009040).stop 2023-07-27T14:37:44.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc40aa050 msgr2=0x7f6bc414d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc40aa050 0x7f6bc414d8b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f6bc0009fd0 tx=0x7f6bc0017000).stop 2023-07-27T14:37:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 shutdown_connections 2023-07-27T14:37:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6ba805f9c0 0x7f6ba8061e80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bc4153ec0 0x7f6bc4152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bc40aa050 0x7f6bc414d8b0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 --2- 172.21.15.115:0/226475004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc40aaa40 0x7f6bc414cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:44.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 >> 172.21.15.115:0/226475004 conn(0x7f6bc40cb610 msgr2=0x7f6bc40acec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:44.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 shutdown_connections 2023-07-27T14:37:44.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:44.865+0000 7f6bcc1ff700 1 -- 172.21.15.115:0/226475004 wait complete. 2023-07-27T14:37:44.936 INFO:tasks.cephfs_test_runner:test_subvolume_clone_in_progress_source (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:37:44.937 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_clone_inherit_quota_attrs (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:37:44.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_quota_attrs' 2023-07-27T14:37:45.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.078+0000 7fb4833ff700 1 Processor -- start 2023-07-27T14:37:45.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.078+0000 7fb4833ff700 1 -- start start 2023-07-27T14:37:45.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb4833ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb47c151bd0 0x7fb47c062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:45.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb4833ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb47c062810 0x7fb47c0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:45.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb4833ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47c0639d0 con 0x7fb47c0a4d30 2023-07-27T14:37:45.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb4833ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c137610 con 0x7fb47c151bd0 2023-07-27T14:37:45.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb4833ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47c0a51c0 con 0x7fb47c062810 2023-07-27T14:37:45.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb48119b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb47c151bd0 0x7fb47c062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:45.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb48119b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb47c151bd0 0x7fb47c062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32808/0 (socket says 172.21.15.115:32808) 2023-07-27T14:37:45.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb48119b700 1 -- 172.21.15.115:0/176456853 learned_addr learned my addr 172.21.15.115:0/176456853 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:45.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb48099a700 1 --2- 172.21.15.115:0/176456853 >> v2:172.21.15.159:3300/0 conn(0x7fb47c062810 0x7fb47c0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:45.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb48119b700 1 -- 172.21.15.115:0/176456853 >> v2:172.21.15.159:3300/0 conn(0x7fb47c062810 msgr2=0x7fb47c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:45.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb48119b700 1 --2- 172.21.15.115:0/176456853 >> v2:172.21.15.159:3300/0 conn(0x7fb47c062810 0x7fb47c0a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.080+0000 7fb48119b700 1 -- 172.21.15.115:0/176456853 >> v1:172.21.15.159:6789/0 conn(0x7fb47c0a4d30 legacy=0x7fb47c157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:45.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb48119b700 1 -- 172.21.15.115:0/176456853 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c062dc0 con 0x7fb47c151bd0 2023-07-27T14:37:45.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb48119b700 1 --2- 172.21.15.115:0/176456853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c151bd0 0x7fb47c062320 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fb47c0be140 tx=0x7fb4780090f0).ready entity=mon.0 client_cookie=48a052fb88d0004b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:45.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb473fff700 1 -- 172.21.15.115:0/176456853 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800b600 con 0x7fb47c151bd0 2023-07-27T14:37:45.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb473fff700 1 -- 172.21.15.115:0/176456853 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800b760 con 0x7fb47c151bd0 2023-07-27T14:37:45.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb473fff700 1 -- 172.21.15.115:0/176456853 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800bae0 con 0x7fb47c151bd0 2023-07-27T14:37:45.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb4833ff700 1 -- 172.21.15.115:0/176456853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c151bd0 msgr2=0x7fb47c062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:45.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb4833ff700 1 --2- 172.21.15.115:0/176456853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c151bd0 0x7fb47c062320 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fb47c0be140 tx=0x7fb4780090f0).stop 2023-07-27T14:37:45.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb4833ff700 1 -- 172.21.15.115:0/176456853 shutdown_connections 2023-07-27T14:37:45.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb4833ff700 1 --2- 172.21.15.115:0/176456853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c151bd0 0x7fb47c062320 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.081+0000 7fb4833ff700 1 --2- 172.21.15.115:0/176456853 >> v2:172.21.15.159:3300/0 conn(0x7fb47c062810 0x7fb47c0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.082+0000 7fb4833ff700 1 -- 172.21.15.115:0/176456853 >> 172.21.15.115:0/176456853 conn(0x7fb47c064700 msgr2=0x7fb47c064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:45.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.082+0000 7fb4833ff700 1 -- 172.21.15.115:0/176456853 shutdown_connections 2023-07-27T14:37:45.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.082+0000 7fb4833ff700 1 -- 172.21.15.115:0/176456853 wait complete. 2023-07-27T14:37:45.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.083+0000 7fb4833ff700 1 Processor -- start 2023-07-27T14:37:45.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.083+0000 7fb4833ff700 1 -- start start 2023-07-27T14:37:45.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.084+0000 7fb4833ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47c062810 0x7fb47c1383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:45.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.084+0000 7fb4833ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c0a4d30 0x7fb47c0a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:45.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.084+0000 7fb4833ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47c151bd0 0x7fb47c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:45.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.084+0000 7fb4833ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c13ad70 con 0x7fb47c0a4d30 2023-07-27T14:37:45.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.084+0000 7fb4833ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c13b050 con 0x7fb47c151bd0 2023-07-27T14:37:45.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.084+0000 7fb4833ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c13b330 con 0x7fb47c062810 2023-07-27T14:37:45.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.084+0000 7fb48099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c0a4d30 0x7fb47c0a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:45.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.084+0000 7fb48099a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c0a4d30 0x7fb47c0a7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32818/0 (socket says 172.21.15.115:32818) 2023-07-27T14:37:45.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48099a700 1 -- 172.21.15.115:0/3717196882 learned_addr learned my addr 172.21.15.115:0/3717196882 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:45.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48119b700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47c062810 0x7fb47c1383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:45.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48199c700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47c151bd0 0x7fb47c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:45.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48099a700 1 -- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47c062810 msgr2=0x7fb47c1383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48099a700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47c062810 0x7fb47c1383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48099a700 1 -- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47c151bd0 msgr2=0x7fb47c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48099a700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47c151bd0 0x7fb47c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48099a700 1 -- 172.21.15.115:0/3717196882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478009370 con 0x7fb47c0a4d30 2023-07-27T14:37:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48119b700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47c062810 0x7fb47c1383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48199c700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47c151bd0 0x7fb47c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb48099a700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c0a4d30 0x7fb47c0a7910 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fb46c00d890 tx=0x7fb46c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb4717fa700 1 -- 172.21.15.115:0/3717196882 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0125f0 con 0x7fb47c0a4d30 2023-07-27T14:37:45.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb4717fa700 1 -- 172.21.15.115:0/3717196882 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c012750 con 0x7fb47c0a4d30 2023-07-27T14:37:45.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c13b610 con 0x7fb47c0a4d30 2023-07-27T14:37:45.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb4717fa700 1 -- 172.21.15.115:0/3717196882 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c012ad0 con 0x7fb47c0a4d30 2023-07-27T14:37:45.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.085+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c13a050 con 0x7fb47c0a4d30 2023-07-27T14:37:45.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.086+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c13bc60 con 0x7fb47c0a4d30 2023-07-27T14:37:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.087+0000 7fb4717fa700 1 -- 172.21.15.115:0/3717196882 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fb46c013480 con 0x7fb47c0a4d30 2023-07-27T14:37:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.088+0000 7fb4717fa700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb46005f9f0 0x7fb460061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.088+0000 7fb4717fa700 1 -- 172.21.15.115:0/3717196882 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fb46c07ab50 con 0x7fb47c0a4d30 2023-07-27T14:37:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.088+0000 7fb48119b700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb46005f9f0 0x7fb460061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.089+0000 7fb48119b700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb46005f9f0 0x7fb460061eb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fb478009fd0 tx=0x7fb478017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.092+0000 7fb4717fa700 1 -- 172.21.15.115:0/3717196882 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb46c04b620 con 0x7fb47c0a4d30 2023-07-27T14:37:45.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.327+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_quota_attrs"]} v 0) v1 -- 0x7fb47c06c470 con 0x7fb47c0a4d30 2023-07-27T14:37:45.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.867+0000 7fb4717fa700 1 -- 172.21.15.115:0/3717196882 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_quota_attrs"]}]=0 v542) v1 ==== 176+0+0 (secure 0 0 0) 0x7fb46c04ec40 con 0x7fb47c0a4d30 2023-07-27T14:37:45.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb46005f9f0 msgr2=0x7fb460061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:45.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb46005f9f0 0x7fb460061eb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fb478009fd0 tx=0x7fb478017000).stop 2023-07-27T14:37:45.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c0a4d30 msgr2=0x7fb47c0a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:45.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c0a4d30 0x7fb47c0a7910 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fb46c00d890 tx=0x7fb46c008040).stop 2023-07-27T14:37:45.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 shutdown_connections 2023-07-27T14:37:45.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb46005f9f0 0x7fb460061eb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47c151bd0 0x7fb47c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47c062810 0x7fb47c1383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 --2- 172.21.15.115:0/3717196882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb47c0a4d30 0x7fb47c0a7910 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:45.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 >> 172.21.15.115:0/3717196882 conn(0x7fb47c064700 msgr2=0x7fb47c068b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:45.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 shutdown_connections 2023-07-27T14:37:45.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:45.870+0000 7fb4833ff700 1 -- 172.21.15.115:0/3717196882 wait complete. 2023-07-27T14:37:45.941 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:37:46.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.084+0000 7f55fdbff700 1 Processor -- start 2023-07-27T14:37:46.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.085+0000 7f55fdbff700 1 -- start start 2023-07-27T14:37:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.086+0000 7f55fdbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55f814b1e0 0x7f55f8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.086+0000 7f55fdbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f81553f0 con 0x7f55f8063260 2023-07-27T14:37:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.086+0000 7f55fdbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f8157a50 con 0x7f55f814ae00 2023-07-27T14:37:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.086+0000 7f55fdbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f8157d10 con 0x7f55f814b1e0 2023-07-27T14:37:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.086+0000 7f55f6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f55f8063260 0x7f55f80a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41552/0 (socket says 172.21.15.115:41552) 2023-07-27T14:37:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.086+0000 7f55f6ffd700 1 -- 172.21.15.115:0/1908934135 learned_addr learned my addr 172.21.15.115:0/1908934135 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.086+0000 7f55f7fff700 1 --2- 172.21.15.115:0/1908934135 >> v2:172.21.15.115:3300/0 conn(0x7f55f814b1e0 0x7f55f8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f67fc700 1 -- 172.21.15.115:0/1908934135 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155082044 0 0) 0x7f55f81553f0 con 0x7f55f8063260 2023-07-27T14:37:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f67fc700 1 -- 172.21.15.115:0/1908934135 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e00033f0 con 0x7f55f8063260 2023-07-27T14:37:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f67fc700 1 -- 172.21.15.115:0/1908934135 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761412641 0 0) 0x7f55f8157a50 con 0x7f55f814ae00 2023-07-27T14:37:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f7fff700 1 -- 172.21.15.115:0/1908934135 >> v1:172.21.15.159:6789/0 conn(0x7f55f814ae00 legacy=0x7f55f8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f7fff700 1 -- 172.21.15.115:0/1908934135 >> v1:172.21.15.115:6789/0 conn(0x7f55f8063260 legacy=0x7f55f80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f7fff700 1 -- 172.21.15.115:0/1908934135 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8157ff0 con 0x7f55f814b1e0 2023-07-27T14:37:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f7fff700 1 --2- 172.21.15.115:0/1908934135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f814b1e0 0x7f55f8154f00 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f55f0009e60 tx=0x7f55f0009780).ready entity=mon.0 client_cookie=735a564092443f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f67fc700 1 -- 172.21.15.115:0/1908934135 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000e070 con 0x7f55f814b1e0 2023-07-27T14:37:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f67fc700 1 -- 172.21.15.115:0/1908934135 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f000bb60 con 0x7f55f814b1e0 2023-07-27T14:37:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.087+0000 7f55f67fc700 1 -- 172.21.15.115:0/1908934135 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000bee0 con 0x7f55f814b1e0 2023-07-27T14:37:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.088+0000 7f55fdbff700 1 -- 172.21.15.115:0/1908934135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f814b1e0 msgr2=0x7f55f8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.088+0000 7f55fdbff700 1 --2- 172.21.15.115:0/1908934135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f814b1e0 0x7f55f8154f00 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f55f0009e60 tx=0x7f55f0009780).stop 2023-07-27T14:37:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.088+0000 7f55fdbff700 1 -- 172.21.15.115:0/1908934135 shutdown_connections 2023-07-27T14:37:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.088+0000 7f55fdbff700 1 --2- 172.21.15.115:0/1908934135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f814b1e0 0x7f55f8154f00 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.088+0000 7f55fdbff700 1 -- 172.21.15.115:0/1908934135 >> 172.21.15.115:0/1908934135 conn(0x7f55f805e940 msgr2=0x7f55f80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.088+0000 7f55fdbff700 1 -- 172.21.15.115:0/1908934135 shutdown_connections 2023-07-27T14:37:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.088+0000 7f55fdbff700 1 -- 172.21.15.115:0/1908934135 wait complete. 2023-07-27T14:37:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.089+0000 7f55fdbff700 1 Processor -- start 2023-07-27T14:37:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.090+0000 7f55fdbff700 1 -- start start 2023-07-27T14:37:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.090+0000 7f55fdbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8063260 0x7f55f814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.090+0000 7f55fdbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f814ae00 0x7f55f8166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55fdbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f814b1e0 0x7f55f80c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55fdbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80c3e80 con 0x7f55f8063260 2023-07-27T14:37:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55fdbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8167490 con 0x7f55f814ae00 2023-07-27T14:37:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55fdbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8167710 con 0x7f55f814b1e0 2023-07-27T14:37:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8063260 0x7f55f814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8063260 0x7f55f814bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32844/0 (socket says 172.21.15.115:32844) 2023-07-27T14:37:46.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 -- 172.21.15.115:0/3419094890 learned_addr learned my addr 172.21.15.115:0/3419094890 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:46.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 -- 172.21.15.115:0/3419094890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f814b1e0 msgr2=0x7f55f80c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f814b1e0 0x7f55f80c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:46.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 -- 172.21.15.115:0/3419094890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f814ae00 msgr2=0x7f55f8166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f814ae00 0x7f55f8166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:46.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 -- 172.21.15.115:0/3419094890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0009a20 con 0x7f55f8063260 2023-07-27T14:37:46.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55f77fe700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8063260 0x7f55f814bd30 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f55e8001eb0 tx=0x7f55e8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:46.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.091+0000 7f55df7fe700 1 -- 172.21.15.115:0/3419094890 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800f470 con 0x7f55f8063260 2023-07-27T14:37:46.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.092+0000 7f55df7fe700 1 -- 172.21.15.115:0/3419094890 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800f5f0 con 0x7f55f8063260 2023-07-27T14:37:46.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.092+0000 7f55df7fe700 1 -- 172.21.15.115:0/3419094890 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800f9b0 con 0x7f55f8063260 2023-07-27T14:37:46.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.092+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f81679f0 con 0x7f55f8063260 2023-07-27T14:37:46.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.092+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f80c3ac0 con 0x7f55f8063260 2023-07-27T14:37:46.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.093+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f806c470 con 0x7f55f8063260 2023-07-27T14:37:46.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.094+0000 7f55df7fe700 1 -- 172.21.15.115:0/3419094890 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f55e8019030 con 0x7f55f8063260 2023-07-27T14:37:46.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.094+0000 7f55df7fe700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55e405f9f0 0x7f55e4061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.094+0000 7f55df7fe700 1 -- 172.21.15.115:0/3419094890 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f55e8079e90 con 0x7f55f8063260 2023-07-27T14:37:46.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.095+0000 7f55f6ffd700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55e405f9f0 0x7f55e4061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.095+0000 7f55f6ffd700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55e405f9f0 0x7f55e4061eb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f55ec005750 tx=0x7f55ec007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:46.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.098+0000 7f55df7fe700 1 -- 172.21.15.115:0/3419094890 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55e80488f0 con 0x7f55f8063260 2023-07-27T14:37:46.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.269+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f55f80caf70 con 0x7f55f8063260 2023-07-27T14:37:46.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.273+0000 7f55df7fe700 1 -- 172.21.15.115:0/3419094890 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f55e804e5b0 con 0x7f55f8063260 2023-07-27T14:37:46.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.275+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55e405f9f0 msgr2=0x7f55e4061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.275+0000 7f55fdbff700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55e405f9f0 0x7f55e4061eb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f55ec005750 tx=0x7f55ec007850).stop 2023-07-27T14:37:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.275+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8063260 msgr2=0x7f55f814bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.275+0000 7f55fdbff700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8063260 0x7f55f814bd30 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f55e8001eb0 tx=0x7f55e8007c70).stop 2023-07-27T14:37:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.276+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 shutdown_connections 2023-07-27T14:37:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.276+0000 7f55fdbff700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55e405f9f0 0x7f55e4061eb0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.276+0000 7f55fdbff700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f814b1e0 0x7f55f80c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:46.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.276+0000 7f55fdbff700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8063260 0x7f55f814bd30 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.276+0000 7f55fdbff700 1 --2- 172.21.15.115:0/3419094890 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f814ae00 0x7f55f8166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:46.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.276+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 >> 172.21.15.115:0/3419094890 conn(0x7f55f805e940 msgr2=0x7f55f80ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:46.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.276+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 shutdown_connections 2023-07-27T14:37:46.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.276+0000 7f55fdbff700 1 -- 172.21.15.115:0/3419094890 wait complete. 2023-07-27T14:37:46.344 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:37:46.344 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:37:46.447 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:37:46.555 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:37:46.556 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:37:46.556 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:37:46.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.693+0000 7f82fc5ff700 1 Processor -- start 2023-07-27T14:37:46.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.693+0000 7f82fc5ff700 1 -- start start 2023-07-27T14:37:46.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.694+0000 7f82fc5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f82f4153ec0 0x7f82f40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.694+0000 7f82fc5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aa050 0x7f82f40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.694+0000 7f82fc5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f40aa4d0 con 0x7f82f40aaa40 2023-07-27T14:37:46.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.694+0000 7f82fc5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f40c05c0 con 0x7f82f4153ec0 2023-07-27T14:37:46.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.694+0000 7f82fc5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f40c1a60 con 0x7f82f40aa050 2023-07-27T14:37:46.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82fa39b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f82f4153ec0 0x7f82f40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82fab9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f82f40aaa40 0x7f82f4157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41554/0 (socket says 172.21.15.115:41554) 2023-07-27T14:37:46.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82fab9c700 1 -- 172.21.15.115:0/582509336 learned_addr learned my addr 172.21.15.115:0/582509336 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:46.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82f9b9a700 1 --2- 172.21.15.115:0/582509336 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aa050 0x7f82f40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82fa39b700 1 -- 172.21.15.115:0/582509336 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aa050 msgr2=0x7f82f40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:46.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82fa39b700 1 --2- 172.21.15.115:0/582509336 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aa050 0x7f82f40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82f9399700 1 -- 172.21.15.115:0/582509336 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477766435 0 0) 0x7f82ec001490 con 0x7f82f40aaa40 2023-07-27T14:37:46.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82fa39b700 1 -- 172.21.15.115:0/582509336 >> v1:172.21.15.115:6789/0 conn(0x7f82f40aaa40 legacy=0x7f82f4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82fa39b700 1 -- 172.21.15.115:0/582509336 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f40bfc90 con 0x7f82f4153ec0 2023-07-27T14:37:46.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82fa39b700 1 --2- 172.21.15.115:0/582509336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f4153ec0 0x7f82f40a9b60 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f82f0009760 tx=0x7f82f0009060).ready entity=mon.0 client_cookie=87631956d89eeceb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:46.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82f9399700 1 -- 172.21.15.115:0/582509336 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000b580 con 0x7f82f4153ec0 2023-07-27T14:37:46.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82f9399700 1 -- 172.21.15.115:0/582509336 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000b6e0 con 0x7f82f4153ec0 2023-07-27T14:37:46.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.695+0000 7f82f9399700 1 -- 172.21.15.115:0/582509336 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000ba60 con 0x7f82f4153ec0 2023-07-27T14:37:46.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.696+0000 7f82fc5ff700 1 -- 172.21.15.115:0/582509336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f4153ec0 msgr2=0x7f82f40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.696+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/582509336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f4153ec0 0x7f82f40a9b60 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f82f0009760 tx=0x7f82f0009060).stop 2023-07-27T14:37:46.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.696+0000 7f82fc5ff700 1 -- 172.21.15.115:0/582509336 shutdown_connections 2023-07-27T14:37:46.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.696+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/582509336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f4153ec0 0x7f82f40a9b60 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.696+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/582509336 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aa050 0x7f82f40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.696+0000 7f82fc5ff700 1 -- 172.21.15.115:0/582509336 >> 172.21.15.115:0/582509336 conn(0x7f82f40cb610 msgr2=0x7f82f40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:46.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.696+0000 7f82fc5ff700 1 -- 172.21.15.115:0/582509336 shutdown_connections 2023-07-27T14:37:46.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.696+0000 7f82fc5ff700 1 -- 172.21.15.115:0/582509336 wait complete. 2023-07-27T14:37:46.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.698+0000 7f82fc5ff700 1 Processor -- start 2023-07-27T14:37:46.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.698+0000 7f82fc5ff700 1 -- start start 2023-07-27T14:37:46.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fc5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f40aa050 0x7f82f414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fc5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aaa40 0x7f82f4163f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fc5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f4153ec0 0x7f82f40c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fc5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f40c2fd0 con 0x7f82f40aa050 2023-07-27T14:37:46.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fc5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f40c2ca0 con 0x7f82f4153ec0 2023-07-27T14:37:46.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fc5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f41648a0 con 0x7f82f40aaa40 2023-07-27T14:37:46.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f40aa050 0x7f82f414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f40aa050 0x7f82f414e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32856/0 (socket says 172.21.15.115:32856) 2023-07-27T14:37:46.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 -- 172.21.15.115:0/2681725460 learned_addr learned my addr 172.21.15.115:0/2681725460 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:46.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 -- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aaa40 msgr2=0x7f82f4163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82f9b9a700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aaa40 0x7f82f4163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fab9c700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f4153ec0 0x7f82f40c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aaa40 0x7f82f4163f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 -- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f4153ec0 msgr2=0x7f82f40c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f4153ec0 0x7f82f40c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 -- 172.21.15.115:0/2681725460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00092a0 con 0x7f82f40aa050 2023-07-27T14:37:46.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82f9b9a700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aaa40 0x7f82f4163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:46.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fab9c700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f4153ec0 0x7f82f40c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:46.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.699+0000 7f82fa39b700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f40aa050 0x7f82f414e940 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7f82f0006d30 tx=0x7f82f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:46.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.700+0000 7f82ea7fc700 1 -- 172.21.15.115:0/2681725460 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000b850 con 0x7f82f40aa050 2023-07-27T14:37:46.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.700+0000 7f82ea7fc700 1 -- 172.21.15.115:0/2681725460 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000b9b0 con 0x7f82f40aa050 2023-07-27T14:37:46.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.700+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f4164b80 con 0x7f82f40aa050 2023-07-27T14:37:46.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.700+0000 7f82ea7fc700 1 -- 172.21.15.115:0/2681725460 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f001b690 con 0x7f82f40aa050 2023-07-27T14:37:46.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.700+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f414ee30 con 0x7f82f40aa050 2023-07-27T14:37:46.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.701+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f406c470 con 0x7f82f40aa050 2023-07-27T14:37:46.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.702+0000 7f82ea7fc700 1 -- 172.21.15.115:0/2681725460 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f82f002a070 con 0x7f82f40aa050 2023-07-27T14:37:46.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.702+0000 7f82ea7fc700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d805f9c0 0x7f82d8061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:46.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.702+0000 7f82ea7fc700 1 -- 172.21.15.115:0/2681725460 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f82f007c240 con 0x7f82f40aa050 2023-07-27T14:37:46.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.703+0000 7f82f9b9a700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d805f9c0 0x7f82d8061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:46.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.703+0000 7f82f9b9a700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d805f9c0 0x7f82d8061e80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f82f4152290 tx=0x7f82e4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:46.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.707+0000 7f82ea7fc700 1 -- 172.21.15.115:0/2681725460 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82f004ce80 con 0x7f82f40aa050 2023-07-27T14:37:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.916+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82f40c32b0 con 0x7f82f40aa050 2023-07-27T14:37:46.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.917+0000 7f82ea7fc700 1 -- 172.21.15.115:0/2681725460 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f82f0028090 con 0x7f82f40aa050 2023-07-27T14:37:46.968 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:46.968 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2898407097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2898407097},{"type":"v1","addr":"172.21.15.115:6837","nonce":2898407097}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6929,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/112108246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":112108246},{"type":"v1","addr":"172.21.15.159:6835","nonce":112108246}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/680715955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":680715955},{"type":"v1","addr":"172.21.15.115:6836","nonce":680715955}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1478892043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1478892043},{"type":"v1","addr":"172.21.15.159:6834","nonce":1478892043}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-07-27T14:37:46.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.919+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d805f9c0 msgr2=0x7f82d8061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.919+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d805f9c0 0x7f82d8061e80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f82f4152290 tx=0x7f82e4008040).stop 2023-07-27T14:37:46.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.919+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f40aa050 msgr2=0x7f82f414e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:46.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.919+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f40aa050 0x7f82f414e940 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7f82f0006d30 tx=0x7f82f0017000).stop 2023-07-27T14:37:46.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.919+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 shutdown_connections 2023-07-27T14:37:46.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.920+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f82d805f9c0 0x7f82d8061e80 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.920+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82f4153ec0 0x7f82f40c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.920+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82f40aa050 0x7f82f414e940 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.920+0000 7f82fc5ff700 1 --2- 172.21.15.115:0/2681725460 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f82f40aaa40 0x7f82f4163f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:46.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.920+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 >> 172.21.15.115:0/2681725460 conn(0x7f82f40cb610 msgr2=0x7f82f40ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:46.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.920+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 shutdown_connections 2023-07-27T14:37:46.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:46.920+0000 7f82fc5ff700 1 -- 172.21.15.115:0/2681725460 wait complete. 2023-07-27T14:37:46.973 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 87 2023-07-27T14:37:46.988 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:37:46.989 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:37:46.989 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:37:46.990 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:37:46.990 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:37:46.990 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:37:46.991 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:37:46.991 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:37:46.992 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:37:46.992 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:37:46.993 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:37:46.993 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:37:46.993 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:37:46.994 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:37:46.994 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:37:46.994 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:37:47.003 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:37:47.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:37:47.005 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:37:47.005 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:37:47.011 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:37:47.011 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:37:47.012 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:37:47.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:37:47.049 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:37:47.049 DEBUG:teuthology.parallel:result is None 2023-07-27T14:37:47.052 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:37:47.052 DEBUG:teuthology.parallel:result is None 2023-07-27T14:37:47.057 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:37:47.057 DEBUG:teuthology.parallel:result is None 2023-07-27T14:37:47.060 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:37:47.061 DEBUG:teuthology.parallel:result is None 2023-07-27T14:37:47.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:37:47.193 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:37:47.194 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:37:47.194 INFO:tasks.ceph.mds.c.smithi115.stderr:2023-07-27T14:37:47.144+0000 7f1d099fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-07-27T14:37:47.206 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:37:47.210 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:37:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.212+0000 7f82133ff700 1 Processor -- start 2023-07-27T14:37:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.212+0000 7f82133ff700 1 -- start start 2023-07-27T14:37:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.213+0000 7f82133ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c0aaa40 0x7f820c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.213+0000 7f82133ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f820c1542a0 0x7f820c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.213+0000 7f82133ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0aa4d0 con 0x7f820c153ec0 2023-07-27T14:37:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.213+0000 7f82133ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c064ad0 con 0x7f820c1542a0 2023-07-27T14:37:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.213+0000 7f82133ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0c05c0 con 0x7f820c0aaa40 2023-07-27T14:37:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821099a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c0aaa40 0x7f820c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821099a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c0aaa40 0x7f820c0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:53742/0 (socket says 172.21.15.115:53742) 2023-07-27T14:37:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821099a700 1 -- 172.21.15.115:0/1630981149 learned_addr learned my addr 172.21.15.115:0/1630981149 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821119b700 1 --1- 172.21.15.115:0/1630981149 >> v1:172.21.15.159:6789/0 conn(0x7f820c153ec0 0x7f820c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:43712/0 (socket says 172.21.15.115:43712) 2023-07-27T14:37:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821199c700 1 --2- 172.21.15.115:0/1630981149 >> v2:172.21.15.159:3300/0 conn(0x7f820c1542a0 0x7f820c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821099a700 1 -- 172.21.15.115:0/1630981149 >> v2:172.21.15.159:3300/0 conn(0x7f820c1542a0 msgr2=0x7f820c0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821099a700 1 --2- 172.21.15.115:0/1630981149 >> v2:172.21.15.159:3300/0 conn(0x7f820c1542a0 0x7f820c0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821099a700 1 -- 172.21.15.115:0/1630981149 >> v1:172.21.15.159:6789/0 conn(0x7f820c153ec0 legacy=0x7f820c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821099a700 1 -- 172.21.15.115:0/1630981149 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0c1a60 con 0x7f820c0aaa40 2023-07-27T14:37:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f8203fff700 1 -- 172.21.15.115:0/1630981149 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740786484 0 0) 0x7f8208001110 con 0x7f820c153ec0 2023-07-27T14:37:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.214+0000 7f821099a700 1 --2- 172.21.15.115:0/1630981149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c0aaa40 0x7f820c0640f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f81fc006fd0 tx=0x7f81fc0090f0).ready entity=mon.2 client_cookie=1ee2577ac0319be3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f8203fff700 1 -- 172.21.15.115:0/1630981149 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc00b580 con 0x7f820c0aaa40 2023-07-27T14:37:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f8203fff700 1 -- 172.21.15.115:0/1630981149 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc00b6e0 con 0x7f820c0aaa40 2023-07-27T14:37:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f8203fff700 1 -- 172.21.15.115:0/1630981149 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc00ba60 con 0x7f820c0aaa40 2023-07-27T14:37:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f82133ff700 1 -- 172.21.15.115:0/1630981149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c0aaa40 msgr2=0x7f820c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f82133ff700 1 --2- 172.21.15.115:0/1630981149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c0aaa40 0x7f820c0640f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f81fc006fd0 tx=0x7f81fc0090f0).stop 2023-07-27T14:37:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f82133ff700 1 -- 172.21.15.115:0/1630981149 shutdown_connections 2023-07-27T14:37:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f82133ff700 1 --2- 172.21.15.115:0/1630981149 >> v2:172.21.15.159:3300/0 conn(0x7f820c1542a0 0x7f820c0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f82133ff700 1 --2- 172.21.15.115:0/1630981149 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c0aaa40 0x7f820c0640f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:47.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f82133ff700 1 -- 172.21.15.115:0/1630981149 >> 172.21.15.115:0/1630981149 conn(0x7f820c0cb610 msgr2=0x7f820c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:47.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f82133ff700 1 -- 172.21.15.115:0/1630981149 shutdown_connections 2023-07-27T14:37:47.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.215+0000 7f82133ff700 1 -- 172.21.15.115:0/1630981149 wait complete. 2023-07-27T14:37:47.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.217+0000 7f82133ff700 1 Processor -- start 2023-07-27T14:37:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.217+0000 7f82133ff700 1 -- start start 2023-07-27T14:37:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f82133ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f820c0aaa40 0x7f820c1451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f82133ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f820c153ec0 0x7f820c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f82133ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c1542a0 0x7f820c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f82133ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c150bf0 con 0x7f820c0aaa40 2023-07-27T14:37:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f82133ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0afbd0 con 0x7f820c153ec0 2023-07-27T14:37:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f82133ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0af8f0 con 0x7f820c1542a0 2023-07-27T14:37:47.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f820c0aaa40 0x7f820c1451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:47.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f820c0aaa40 0x7f820c1451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32910/0 (socket says 172.21.15.115:32910) 2023-07-27T14:37:47.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 -- 172.21.15.115:0/4205891972 learned_addr learned my addr 172.21.15.115:0/4205891972 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:47.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821199c700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c1542a0 0x7f820c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:47.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821099a700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f820c153ec0 0x7f820c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:47.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 -- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c1542a0 msgr2=0x7f820c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:47.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c1542a0 0x7f820c0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:47.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 -- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f820c153ec0 msgr2=0x7f820c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:47.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f820c153ec0 0x7f820c152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:47.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 -- 172.21.15.115:0/4205891972 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc009370 con 0x7f820c0aaa40 2023-07-27T14:37:47.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821099a700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f820c153ec0 0x7f820c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:47.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821199c700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c1542a0 0x7f820c0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:47.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.218+0000 7f821119b700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f820c0aaa40 0x7f820c1451a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f820800c510 tx=0x7f8208007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:47.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.219+0000 7f82017fa700 1 -- 172.21.15.115:0/4205891972 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080072e0 con 0x7f820c0aaa40 2023-07-27T14:37:47.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.219+0000 7f82017fa700 1 -- 172.21.15.115:0/4205891972 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208007440 con 0x7f820c0aaa40 2023-07-27T14:37:47.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.219+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c150530 con 0x7f820c0aaa40 2023-07-27T14:37:47.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.219+0000 7f82017fa700 1 -- 172.21.15.115:0/4205891972 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080058f0 con 0x7f820c0aaa40 2023-07-27T14:37:47.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.219+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c152d00 con 0x7f820c0aaa40 2023-07-27T14:37:47.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.220+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c1509d0 con 0x7f820c0aaa40 2023-07-27T14:37:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.220+0000 7f82017fa700 1 -- 172.21.15.115:0/4205891972 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f820801a060 con 0x7f820c0aaa40 2023-07-27T14:37:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.221+0000 7f82017fa700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81f005f9f0 0x7f81f0061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.222+0000 7f82017fa700 1 -- 172.21.15.115:0/4205891972 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f820807a2e0 con 0x7f820c0aaa40 2023-07-27T14:37:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.222+0000 7f821099a700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81f005f9f0 0x7f81f0061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.222+0000 7f821099a700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81f005f9f0 0x7f81f0061eb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f820c0aae20 tx=0x7f81fc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:47.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.225+0000 7f82017fa700 1 -- 172.21.15.115:0/4205891972 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f820804ae10 con 0x7f820c0aaa40 2023-07-27T14:37:47.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:47.407+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f820c0aa4d0 con 0x7f820c0aaa40 2023-07-27T14:37:48.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.191+0000 7f82017fa700 1 -- 172.21.15.115:0/4205891972 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v170) v1 ==== 97+0+0 (secure 0 0 0) 0x7f820c0aa4d0 con 0x7f820c0aaa40 2023-07-27T14:37:48.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81f005f9f0 msgr2=0x7f81f0061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81f005f9f0 0x7f81f0061eb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f820c0aae20 tx=0x7f81fc017000).stop 2023-07-27T14:37:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f820c0aaa40 msgr2=0x7f820c1451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f820c0aaa40 0x7f820c1451a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f820800c510 tx=0x7f8208007ad0).stop 2023-07-27T14:37:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 shutdown_connections 2023-07-27T14:37:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81f005f9f0 0x7f81f0061eb0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f820c1542a0 0x7f820c0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f820c0aaa40 0x7f820c1451a0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.194+0000 7f82133ff700 1 --2- 172.21.15.115:0/4205891972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f820c153ec0 0x7f820c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.195+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 >> 172.21.15.115:0/4205891972 conn(0x7f820c0cb610 msgr2=0x7f820c0ab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:48.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.195+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 shutdown_connections 2023-07-27T14:37:48.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.195+0000 7f82133ff700 1 -- 172.21.15.115:0/4205891972 wait complete. 2023-07-27T14:37:48.247 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:37:48.266 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:37:48.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.406+0000 7f091a7ff700 1 Processor -- start 2023-07-27T14:37:48.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.406+0000 7f091a7ff700 1 -- start start 2023-07-27T14:37:48.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f091a7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f091414e850 0x7f0914062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f091a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 0x7f09140a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f091a7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140a4840 con 0x7f091414e470 2023-07-27T14:37:48.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f091a7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0914062c80 con 0x7f091414e850 2023-07-27T14:37:48.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f091a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140a6ed0 con 0x7f0914062810 2023-07-27T14:37:48.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f09137fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f091414e850 0x7f0914062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f09137fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f091414e850 0x7f0914062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32914/0 (socket says 172.21.15.115:32914) 2023-07-27T14:37:48.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f09137fe700 1 -- 172.21.15.115:0/1614407776 learned_addr learned my addr 172.21.15.115:0/1614407776 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:48.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f0918d9c700 1 --2- 172.21.15.115:0/1614407776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 0x7f09140a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f09137fe700 1 -- 172.21.15.115:0/1614407776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 msgr2=0x7f09140a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:48.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f09137fe700 1 --2- 172.21.15.115:0/1614407776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 0x7f09140a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f09137fe700 1 -- 172.21.15.115:0/1614407776 >> v1:172.21.15.159:6789/0 conn(0x7f091414e470 legacy=0x7f0914155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.408+0000 7f09137fe700 1 -- 172.21.15.115:0/1614407776 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140a71b0 con 0x7f091414e850 2023-07-27T14:37:48.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f09137fe700 1 --2- 172.21.15.115:0/1614407776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f0914062320 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7f0908006fd0 tx=0x7f09080090f0).ready entity=mon.0 client_cookie=c8d72322252dec54 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:48.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f0912ffd700 1 -- 172.21.15.115:0/1614407776 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800b600 con 0x7f091414e850 2023-07-27T14:37:48.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f0912ffd700 1 -- 172.21.15.115:0/1614407776 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090800b760 con 0x7f091414e850 2023-07-27T14:37:48.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f0912ffd700 1 -- 172.21.15.115:0/1614407776 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800bae0 con 0x7f091414e850 2023-07-27T14:37:48.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f091a7ff700 1 -- 172.21.15.115:0/1614407776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 msgr2=0x7f0914062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f091a7ff700 1 --2- 172.21.15.115:0/1614407776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f0914062320 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7f0908006fd0 tx=0x7f09080090f0).stop 2023-07-27T14:37:48.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f091a7ff700 1 -- 172.21.15.115:0/1614407776 shutdown_connections 2023-07-27T14:37:48.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f091a7ff700 1 --2- 172.21.15.115:0/1614407776 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 0x7f09140a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f091a7ff700 1 --2- 172.21.15.115:0/1614407776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f0914062320 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.409+0000 7f091a7ff700 1 -- 172.21.15.115:0/1614407776 >> 172.21.15.115:0/1614407776 conn(0x7f09140c7990 msgr2=0x7f09140c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:48.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.410+0000 7f091a7ff700 1 -- 172.21.15.115:0/1614407776 shutdown_connections 2023-07-27T14:37:48.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.410+0000 7f091a7ff700 1 -- 172.21.15.115:0/1614407776 wait complete. 2023-07-27T14:37:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.411+0000 7f091a7ff700 1 Processor -- start 2023-07-27T14:37:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.411+0000 7f091a7ff700 1 -- start start 2023-07-27T14:37:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f091a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 0x7f091414a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f091a7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091414e470 0x7f09140beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f091a7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f091414c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f091a7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091414f810 con 0x7f091414e850 2023-07-27T14:37:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f091a7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140bf500 con 0x7f091414e470 2023-07-27T14:37:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f091a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140bf7e0 con 0x7f0914062810 2023-07-27T14:37:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f0918d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f091414c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f0918d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f091414c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32922/0 (socket says 172.21.15.115:32922) 2023-07-27T14:37:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f0918d9c700 1 -- 172.21.15.115:0/3888469331 learned_addr learned my addr 172.21.15.115:0/3888469331 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f09137fe700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091414e470 0x7f09140beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.412+0000 7f0913fff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 0x7f091414a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f0918d9c700 1 -- 172.21.15.115:0/3888469331 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 msgr2=0x7f091414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f0918d9c700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 0x7f091414a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f0918d9c700 1 -- 172.21.15.115:0/3888469331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091414e470 msgr2=0x7f09140beab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f0918d9c700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091414e470 0x7f09140beab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f0918d9c700 1 -- 172.21.15.115:0/3888469331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0908009370 con 0x7f091414e850 2023-07-27T14:37:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f0918d9c700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f091414c020 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f090c009fa0 tx=0x7f090c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f08fbfff700 1 -- 172.21.15.115:0/3888469331 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00ebc0 con 0x7f091414e850 2023-07-27T14:37:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f08fbfff700 1 -- 172.21.15.115:0/3888469331 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c00ed20 con 0x7f091414e850 2023-07-27T14:37:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09140bfac0 con 0x7f091414e850 2023-07-27T14:37:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f08fbfff700 1 -- 172.21.15.115:0/3888469331 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c014610 con 0x7f091414e850 2023-07-27T14:37:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.413+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914066bf0 con 0x7f091414e850 2023-07-27T14:37:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.414+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091414f980 con 0x7f091414e850 2023-07-27T14:37:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.415+0000 7f08fbfff700 1 -- 172.21.15.115:0/3888469331 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f090c01b030 con 0x7f091414e850 2023-07-27T14:37:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.416+0000 7f08fbfff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f090005f9f0 0x7f0900061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.416+0000 7f08fbfff700 1 -- 172.21.15.115:0/3888469331 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f090c07aee0 con 0x7f091414e850 2023-07-27T14:37:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.416+0000 7f0913fff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f090005f9f0 0x7f0900061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.417+0000 7f0913fff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f090005f9f0 0x7f0900061eb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f09140c4ec0 tx=0x7f0904009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:48.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.420+0000 7f08fbfff700 1 -- 172.21.15.115:0/3888469331 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f090c04ba90 con 0x7f091414e850 2023-07-27T14:37:48.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.656+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f091406c470 con 0x7f091414e850 2023-07-27T14:37:48.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.657+0000 7f08fbfff700 1 -- 172.21.15.115:0/3888469331 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f090c04f0b0 con 0x7f091414e850 2023-07-27T14:37:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:48.708 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:37:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:37:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:37:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:37:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:37:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:37:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:37:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:37:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:37:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:37:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:37:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:37:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:37:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:37:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:37:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:37:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:37:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:37:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:37:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:37:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:37:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:37:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:37:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:37:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:37:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:37:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:37:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:37:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:37:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:37:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:37:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:37:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:37:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:37:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:37:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:37:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:37:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:37:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:37:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:37:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:37:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:37:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:37:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:37:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:37:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:37:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:37:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:37:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:37:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:37:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:37:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:37:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:37:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:37:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:37:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:37:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:37:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:37:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:37:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:37:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:37:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:37:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:37:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:37:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:37:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:37:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:37:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:37:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:37:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:37:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:37:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:37:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:37:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:37:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:37:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:37:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:37:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:37:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:37:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:37:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:37:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:37:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:37:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:37:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:37:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:37:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:37:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:37:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:37:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:37:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:37:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:37:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:37:48.740 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:37:48.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f090005f9f0 msgr2=0x7f0900061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f090005f9f0 0x7f0900061eb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f09140c4ec0 tx=0x7f0904009040).stop 2023-07-27T14:37:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 msgr2=0x7f091414c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f091414c020 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f090c009fa0 tx=0x7f090c009900).stop 2023-07-27T14:37:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 shutdown_connections 2023-07-27T14:37:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f090005f9f0 0x7f0900061eb0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f091414e850 0x7f091414c020 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0914062810 0x7f091414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 --2- 172.21.15.115:0/3888469331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091414e470 0x7f09140beab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 >> 172.21.15.115:0/3888469331 conn(0x7f09140c7990 msgr2=0x7f09140be120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 shutdown_connections 2023-07-27T14:37:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.659+0000 7f091a7ff700 1 -- 172.21.15.115:0/3888469331 wait complete. 2023-07-27T14:37:48.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:37:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.881+0000 7f24d8bff700 1 Processor -- start 2023-07-27T14:37:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.881+0000 7f24d8bff700 1 -- start start 2023-07-27T14:37:48.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.882+0000 7f24d8bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f24d4154060 0x7f24d40bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.882+0000 7f24d8bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f24d40a5390 0x7f24d40bc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.882+0000 7f24d8bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d40c2ed0 con 0x7f24d4154440 2023-07-27T14:37:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.882+0000 7f24d8bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d40bc720 con 0x7f24d4154060 2023-07-27T14:37:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.882+0000 7f24d8bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d40a58d0 con 0x7f24d40a5390 2023-07-27T14:37:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.882+0000 7f24d259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f24d4154060 0x7f24d40bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.882+0000 7f24d259c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f24d4154060 0x7f24d40bbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32936/0 (socket says 172.21.15.115:32936) 2023-07-27T14:37:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.882+0000 7f24d259c700 1 -- 172.21.15.115:0/2776485940 learned_addr learned my addr 172.21.15.115:0/2776485940 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d2d9d700 1 --2- 172.21.15.115:0/2776485940 >> v2:172.21.15.159:3300/0 conn(0x7f24d40a5390 0x7f24d40bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d259c700 1 -- 172.21.15.115:0/2776485940 >> v2:172.21.15.159:3300/0 conn(0x7f24d40a5390 msgr2=0x7f24d40bc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d259c700 1 --2- 172.21.15.115:0/2776485940 >> v2:172.21.15.159:3300/0 conn(0x7f24d40a5390 0x7f24d40bc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d259c700 1 -- 172.21.15.115:0/2776485940 >> v1:172.21.15.159:6789/0 conn(0x7f24d4154440 legacy=0x7f24d40a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d259c700 1 -- 172.21.15.115:0/2776485940 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d40a5bb0 con 0x7f24d4154060 2023-07-27T14:37:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d2d9d700 1 --2- 172.21.15.115:0/2776485940 >> v2:172.21.15.159:3300/0 conn(0x7f24d40a5390 0x7f24d40bc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d259c700 1 --2- 172.21.15.115:0/2776485940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40bbd40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f24d40c48f0 tx=0x7f24c40090f0).ready entity=mon.0 client_cookie=3e922532df489d39 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d159a700 1 -- 172.21.15.115:0/2776485940 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c400b5a0 con 0x7f24d4154060 2023-07-27T14:37:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d159a700 1 -- 172.21.15.115:0/2776485940 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c400b700 con 0x7f24d4154060 2023-07-27T14:37:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.883+0000 7f24d159a700 1 -- 172.21.15.115:0/2776485940 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c400ba80 con 0x7f24d4154060 2023-07-27T14:37:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.884+0000 7f24d8bff700 1 -- 172.21.15.115:0/2776485940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 msgr2=0x7f24d40bbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.884+0000 7f24d8bff700 1 --2- 172.21.15.115:0/2776485940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40bbd40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f24d40c48f0 tx=0x7f24c40090f0).stop 2023-07-27T14:37:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.884+0000 7f24d8bff700 1 -- 172.21.15.115:0/2776485940 shutdown_connections 2023-07-27T14:37:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.884+0000 7f24d8bff700 1 --2- 172.21.15.115:0/2776485940 >> v2:172.21.15.159:3300/0 conn(0x7f24d40a5390 0x7f24d40bc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.884+0000 7f24d8bff700 1 --2- 172.21.15.115:0/2776485940 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40bbd40 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.884+0000 7f24d8bff700 1 -- 172.21.15.115:0/2776485940 >> 172.21.15.115:0/2776485940 conn(0x7f24d4062320 msgr2=0x7f24d4062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.884+0000 7f24d8bff700 1 -- 172.21.15.115:0/2776485940 shutdown_connections 2023-07-27T14:37:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.884+0000 7f24d8bff700 1 -- 172.21.15.115:0/2776485940 wait complete. 2023-07-27T14:37:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.886+0000 7f24d8bff700 1 Processor -- start 2023-07-27T14:37:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.886+0000 7f24d8bff700 1 -- start start 2023-07-27T14:37:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.887+0000 7f24d8bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24d40a5390 0x7f24d40ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.887+0000 7f24d8bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.887+0000 7f24d8bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4154440 0x7f24d4147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d8bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41548b0 con 0x7f24d4154060 2023-07-27T14:37:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d8bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4154b50 con 0x7f24d4154440 2023-07-27T14:37:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d8bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40aada0 con 0x7f24d40a5390 2023-07-27T14:37:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32948/0 (socket says 172.21.15.115:32948) 2023-07-27T14:37:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 -- 172.21.15.115:0/3715249277 learned_addr learned my addr 172.21.15.115:0/3715249277 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d259c700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24d40a5390 0x7f24d40ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d2d9d700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4154440 0x7f24d4147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 -- 172.21.15.115:0/3715249277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24d40a5390 msgr2=0x7f24d40ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24d40a5390 0x7f24d40ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 -- 172.21.15.115:0/3715249277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4154440 msgr2=0x7f24d4147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:48.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4154440 0x7f24d4147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:48.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 -- 172.21.15.115:0/3715249277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4009370 con 0x7f24d4154060 2023-07-27T14:37:48.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.888+0000 7f24d1d9b700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40a9d90 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f24c800b490 tx=0x7f24c8006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:48.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.889+0000 7f24c27fc700 1 -- 172.21.15.115:0/3715249277 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8012410 con 0x7f24d4154060 2023-07-27T14:37:48.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.889+0000 7f24c27fc700 1 -- 172.21.15.115:0/3715249277 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c8012590 con 0x7f24d4154060 2023-07-27T14:37:48.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.889+0000 7f24c27fc700 1 -- 172.21.15.115:0/3715249277 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8012950 con 0x7f24d4154060 2023-07-27T14:37:48.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.889+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d40aa280 con 0x7f24d4154060 2023-07-27T14:37:48.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.889+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d40aa7e0 con 0x7f24d4154060 2023-07-27T14:37:48.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.890+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d406c470 con 0x7f24d4154060 2023-07-27T14:37:48.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.891+0000 7f24c27fc700 1 -- 172.21.15.115:0/3715249277 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f24c800f030 con 0x7f24d4154060 2023-07-27T14:37:48.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.891+0000 7f24c27fc700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24b405f9f0 0x7f24b4061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:48.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.892+0000 7f24c27fc700 1 -- 172.21.15.115:0/3715249277 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f24c807a910 con 0x7f24d4154060 2023-07-27T14:37:48.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.892+0000 7f24d259c700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24b405f9f0 0x7f24b4061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:48.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.892+0000 7f24d259c700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24b405f9f0 0x7f24b4061eb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f24c4009130 tx=0x7f24c4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:48.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:48.895+0000 7f24c27fc700 1 -- 172.21.15.115:0/3715249277 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f24c804b490 con 0x7f24d4154060 2023-07-27T14:37:49.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.064+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24d4063d80 con 0x7f24d4154060 2023-07-27T14:37:49.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.065+0000 7f24c27fc700 1 -- 172.21.15.115:0/3715249277 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+13866 (secure 0 0 0) 0x7f24c804eab0 con 0x7f24d4154060 2023-07-27T14:37:49.116 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:49.117 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":170,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:37:48.180593+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:37:49.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.067+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24b405f9f0 msgr2=0x7f24b4061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.067+0000 7f24d8bff700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24b405f9f0 0x7f24b4061eb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f24c4009130 tx=0x7f24c4015000).stop 2023-07-27T14:37:49.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.067+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 msgr2=0x7f24d40a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.067+0000 7f24d8bff700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40a9d90 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f24c800b490 tx=0x7f24c8006f20).stop 2023-07-27T14:37:49.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.068+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 shutdown_connections 2023-07-27T14:37:49.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.068+0000 7f24d8bff700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f24b405f9f0 0x7f24b4061eb0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.068+0000 7f24d8bff700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4154440 0x7f24d4147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.068+0000 7f24d8bff700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f24d40a5390 0x7f24d40ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.068+0000 7f24d8bff700 1 --2- 172.21.15.115:0/3715249277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24d4154060 0x7f24d40a9d90 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.068+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 >> 172.21.15.115:0/3715249277 conn(0x7f24d4062320 msgr2=0x7f24d4063fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:49.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.068+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 shutdown_connections 2023-07-27T14:37:49.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.068+0000 7f24d8bff700 1 -- 172.21.15.115:0/3715249277 wait complete. 2023-07-27T14:37:49.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:37:49.137 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:37:49.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.277+0000 7f5eb95ff700 1 Processor -- start 2023-07-27T14:37:49.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.277+0000 7f5eb95ff700 1 -- start start 2023-07-27T14:37:49.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.278+0000 7f5eb95ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb414ae00 0x7f5eb4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.278+0000 7f5eb95ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb41553f0 con 0x7f5eb414b1e0 2023-07-27T14:37:49.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.278+0000 7f5eb95ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb4157a50 con 0x7f5eb4063260 2023-07-27T14:37:49.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.278+0000 7f5eb95ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4157d10 con 0x7f5eb414ae00 2023-07-27T14:37:49.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb27fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5eb414b1e0 0x7f5eb4062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41590/0 (socket says 172.21.15.115:41590) 2023-07-27T14:37:49.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb27fc700 1 -- 172.21.15.115:0/3804795699 learned_addr learned my addr 172.21.15.115:0/3804795699 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb2ffd700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb414ae00 0x7f5eb4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741046954 0 0) 0x7f5eb41553f0 con 0x7f5eb414b1e0 2023-07-27T14:37:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e9c0033f0 con 0x7f5eb414b1e0 2023-07-27T14:37:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4195401776 0 0) 0x7f5e9c0033f0 con 0x7f5eb414b1e0 2023-07-27T14:37:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb414ae00 msgr2=0x7f5eb4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb414ae00 0x7f5eb4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 >> v1:172.21.15.159:6789/0 conn(0x7f5eb4063260 legacy=0x7f5eb40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb4157ff0 con 0x7f5eb414b1e0 2023-07-27T14:37:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f5ea8001470 con 0x7f5eb414b1e0 2023-07-27T14:37:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 >> v1:172.21.15.115:6789/0 conn(0x7f5eb414b1e0 legacy=0x7f5eb4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb414ae00 0x7f5e9c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5e9c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c004b80 0x7f5e9c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4157d10 con 0x7f5e9c003e40 2023-07-27T14:37:49.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c00b990 con 0x7f5e9c004b80 2023-07-27T14:37:49.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.279+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c00bb50 con 0x7f5eb414ae00 2023-07-27T14:37:49.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb27fc700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5e9c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb2ffd700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb414ae00 0x7f5e9c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb37fe700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c004b80 0x7f5e9c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb27fc700 1 -- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb414ae00 msgr2=0x7f5e9c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:49.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb27fc700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb414ae00 0x7f5e9c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb27fc700 1 -- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c004b80 msgr2=0x7f5e9c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:49.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb27fc700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c004b80 0x7f5e9c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb27fc700 1 -- 172.21.15.115:0/3804795699 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0033f0 con 0x7f5e9c003e40 2023-07-27T14:37:49.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb37fe700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e9c004b80 0x7f5e9c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:49.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb27fc700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5e9c004690 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f5eb40cbc00 tx=0x7f5ea8001e70).ready entity=mon.0 client_cookie=5b2bdd91cd112652 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:49.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.280+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8007a40 con 0x7f5e9c003e40 2023-07-27T14:37:49.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea800ca30 con 0x7f5e9c003e40 2023-07-27T14:37:49.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb1ffb700 1 -- 172.21.15.115:0/3804795699 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800cdb0 con 0x7f5e9c003e40 2023-07-27T14:37:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb95ff700 1 -- 172.21.15.115:0/3804795699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 msgr2=0x7f5e9c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb95ff700 1 --2- 172.21.15.115:0/3804795699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5e9c004690 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f5eb40cbc00 tx=0x7f5ea8001e70).stop 2023-07-27T14:37:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb37fe700 1 -- 172.21.15.115:0/3804795699 reap_dead start 2023-07-27T14:37:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb95ff700 1 -- 172.21.15.115:0/3804795699 shutdown_connections 2023-07-27T14:37:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb95ff700 1 -- 172.21.15.115:0/3804795699 >> 172.21.15.115:0/3804795699 conn(0x7f5eb405e940 msgr2=0x7f5eb40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb95ff700 1 -- 172.21.15.115:0/3804795699 shutdown_connections 2023-07-27T14:37:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.281+0000 7f5eb95ff700 1 -- 172.21.15.115:0/3804795699 wait complete. 2023-07-27T14:37:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.283+0000 7f5eb95ff700 1 Processor -- start 2023-07-27T14:37:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.283+0000 7f5eb95ff700 1 -- start start 2023-07-27T14:37:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb95ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5eb4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb95ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb4156d50 0x7f5eb40c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb95ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb40c29c0 0x7f5eb4148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb95ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb40c4b00 con 0x7f5e9c003e40 2023-07-27T14:37:49.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb95ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4147280 con 0x7f5eb4156d50 2023-07-27T14:37:49.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb95ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb40c2e40 con 0x7f5eb40c29c0 2023-07-27T14:37:49.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5eb4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5eb4155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32968/0 (socket says 172.21.15.115:32968) 2023-07-27T14:37:49.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb2ffd700 1 -- 172.21.15.115:0/2017531917 learned_addr learned my addr 172.21.15.115:0/2017531917 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:49.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb37fe700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb40c29c0 0x7f5eb4148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb27fc700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb4156d50 0x7f5eb40c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb2ffd700 1 -- 172.21.15.115:0/2017531917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb40c29c0 msgr2=0x7f5eb4148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb2ffd700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb40c29c0 0x7f5eb4148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb2ffd700 1 -- 172.21.15.115:0/2017531917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb4156d50 msgr2=0x7f5eb40c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb2ffd700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb4156d50 0x7f5eb40c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.284+0000 7f5eb2ffd700 1 -- 172.21.15.115:0/2017531917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb4146950 con 0x7f5e9c003e40 2023-07-27T14:37:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.285+0000 7f5eb2ffd700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5eb4155d30 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f5ea40119f0 tx=0x7f5ea4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.285+0000 7f5e9affd700 1 -- 172.21.15.115:0/2017531917 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400f940 con 0x7f5e9c003e40 2023-07-27T14:37:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.285+0000 7f5e9affd700 1 -- 172.21.15.115:0/2017531917 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea400faa0 con 0x7f5e9c003e40 2023-07-27T14:37:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.285+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb4146c30 con 0x7f5e9c003e40 2023-07-27T14:37:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.285+0000 7f5e9affd700 1 -- 172.21.15.115:0/2017531917 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400fe20 con 0x7f5e9c003e40 2023-07-27T14:37:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.285+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb41575d0 con 0x7f5e9c003e40 2023-07-27T14:37:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.286+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb4147560 con 0x7f5e9c003e40 2023-07-27T14:37:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.287+0000 7f5e9affd700 1 -- 172.21.15.115:0/2017531917 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f5ea4024070 con 0x7f5e9c003e40 2023-07-27T14:37:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.288+0000 7f5e9affd700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ea005f9c0 0x7f5ea0061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.288+0000 7f5e9affd700 1 -- 172.21.15.115:0/2017531917 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5ea407b780 con 0x7f5e9c003e40 2023-07-27T14:37:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.288+0000 7f5eb27fc700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ea005f9c0 0x7f5ea0061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.288+0000 7f5eb27fc700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ea005f9c0 0x7f5ea0061e80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f5eb40cbc00 tx=0x7f5ea8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:49.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.292+0000 7f5e9affd700 1 -- 172.21.15.115:0/2017531917 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ea404c300 con 0x7f5e9c003e40 2023-07-27T14:37:49.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.461+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5eb406c470 con 0x7f5e9c003e40 2023-07-27T14:37:49.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.461+0000 7f5e9affd700 1 -- 172.21.15.115:0/2017531917 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v170) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5ea404f920 con 0x7f5e9c003e40 2023-07-27T14:37:49.512 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:37:49.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ea005f9c0 msgr2=0x7f5ea0061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ea005f9c0 0x7f5ea0061e80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f5eb40cbc00 tx=0x7f5ea8015000).stop 2023-07-27T14:37:49.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 msgr2=0x7f5eb4155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5eb4155d30 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f5ea40119f0 tx=0x7f5ea4009060).stop 2023-07-27T14:37:49.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 shutdown_connections 2023-07-27T14:37:49.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5ea005f9c0 0x7f5ea0061e80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5eb40c29c0 0x7f5eb4148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e9c003e40 0x7f5eb4155d30 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 --2- 172.21.15.115:0/2017531917 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5eb4156d50 0x7f5eb40c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 >> 172.21.15.115:0/2017531917 conn(0x7f5eb405e940 msgr2=0x7f5eb4152030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:49.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 shutdown_connections 2023-07-27T14:37:49.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.463+0000 7f5eb95ff700 1 -- 172.21.15.115:0/2017531917 wait complete. 2023-07-27T14:37:49.531 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:37:49.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.672+0000 7f861fdff700 1 Processor -- start 2023-07-27T14:37:49.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.672+0000 7f861fdff700 1 -- start start 2023-07-27T14:37:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861fdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f861814ae00 0x7f8618154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861fdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f861814b1e0 0x7f8618062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861fdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86181553f0 con 0x7f86180c5c50 2023-07-27T14:37:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861fdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8618157a50 con 0x7f861814ae00 2023-07-27T14:37:49.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861fdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8618157d10 con 0x7f861814b1e0 2023-07-27T14:37:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861db9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f861814ae00 0x7f8618154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861db9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f861814ae00 0x7f8618154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32972/0 (socket says 172.21.15.115:32972) 2023-07-27T14:37:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861db9b700 1 -- 172.21.15.115:0/3536888969 learned_addr learned my addr 172.21.15.115:0/3536888969 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861e39c700 1 --1- 172.21.15.115:0/3536888969 >> v1:172.21.15.115:6789/0 conn(0x7f86180c5c50 0x7f86180a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41596/0 (socket says 172.21.15.115:41596) 2023-07-27T14:37:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.673+0000 7f861d39a700 1 --2- 172.21.15.115:0/3536888969 >> v2:172.21.15.159:3300/0 conn(0x7f861814b1e0 0x7f8618062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861db9b700 1 -- 172.21.15.115:0/3536888969 >> v2:172.21.15.159:3300/0 conn(0x7f861814b1e0 msgr2=0x7f8618062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:49.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861db9b700 1 --2- 172.21.15.115:0/3536888969 >> v2:172.21.15.159:3300/0 conn(0x7f861814b1e0 0x7f8618062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861db9b700 1 -- 172.21.15.115:0/3536888969 >> v1:172.21.15.115:6789/0 conn(0x7f86180c5c50 legacy=0x7f86180a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861cb99700 1 -- 172.21.15.115:0/3536888969 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628054876 0 0) 0x7f86181553f0 con 0x7f86180c5c50 2023-07-27T14:37:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861db9b700 1 -- 172.21.15.115:0/3536888969 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8618157ff0 con 0x7f861814ae00 2023-07-27T14:37:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861db9b700 1 --2- 172.21.15.115:0/3536888969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f8618154f00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f8618155580 tx=0x7f86140090f0).ready entity=mon.0 client_cookie=95cd41d2d6066532 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861cb99700 1 -- 172.21.15.115:0/3536888969 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400b520 con 0x7f861814ae00 2023-07-27T14:37:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861cb99700 1 -- 172.21.15.115:0/3536888969 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861400b680 con 0x7f861814ae00 2023-07-27T14:37:49.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.674+0000 7f861cb99700 1 -- 172.21.15.115:0/3536888969 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400ba00 con 0x7f861814ae00 2023-07-27T14:37:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.675+0000 7f861fdff700 1 -- 172.21.15.115:0/3536888969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 msgr2=0x7f8618154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.675+0000 7f861fdff700 1 --2- 172.21.15.115:0/3536888969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f8618154f00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f8618155580 tx=0x7f86140090f0).stop 2023-07-27T14:37:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.675+0000 7f861fdff700 1 -- 172.21.15.115:0/3536888969 shutdown_connections 2023-07-27T14:37:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.675+0000 7f861fdff700 1 --2- 172.21.15.115:0/3536888969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f8618154f00 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.675+0000 7f861fdff700 1 --2- 172.21.15.115:0/3536888969 >> v2:172.21.15.159:3300/0 conn(0x7f861814b1e0 0x7f8618062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.675+0000 7f861fdff700 1 -- 172.21.15.115:0/3536888969 >> 172.21.15.115:0/3536888969 conn(0x7f861805e940 msgr2=0x7f86180cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.675+0000 7f861fdff700 1 -- 172.21.15.115:0/3536888969 shutdown_connections 2023-07-27T14:37:49.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.675+0000 7f861fdff700 1 -- 172.21.15.115:0/3536888969 wait complete. 2023-07-27T14:37:49.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.676+0000 7f861fdff700 1 Processor -- start 2023-07-27T14:37:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.677+0000 7f861fdff700 1 -- start start 2023-07-27T14:37:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.677+0000 7f861fdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86180c5c50 0x7f86180c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.677+0000 7f861fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f86180b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.677+0000 7f861fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f861814b1e0 0x7f86180c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.677+0000 7f861fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86180c4b30 con 0x7f861814ae00 2023-07-27T14:37:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861fdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8618164970 con 0x7f86180c5c50 2023-07-27T14:37:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86180ae8a0 con 0x7f861814b1e0 2023-07-27T14:37:49.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f86180b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f86180b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32984/0 (socket says 172.21.15.115:32984) 2023-07-27T14:37:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 -- 172.21.15.115:0/3126031730 learned_addr learned my addr 172.21.15.115:0/3126031730 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861db9b700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86180c5c50 0x7f86180c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861e39c700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f861814b1e0 0x7f86180c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 -- 172.21.15.115:0/3126031730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f861814b1e0 msgr2=0x7f86180c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f861814b1e0 0x7f86180c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 -- 172.21.15.115:0/3126031730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86180c5c50 msgr2=0x7f86180c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86180c5c50 0x7f86180c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 -- 172.21.15.115:0/3126031730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614009370 con 0x7f861814ae00 2023-07-27T14:37:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f861d39a700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f86180b0560 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f860800e8d0 tx=0x7f8608009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.678+0000 7f860dffb700 1 -- 172.21.15.115:0/3126031730 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860800c640 con 0x7f861814ae00 2023-07-27T14:37:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.679+0000 7f860dffb700 1 -- 172.21.15.115:0/3126031730 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860800c7a0 con 0x7f861814ae00 2023-07-27T14:37:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.679+0000 7f860dffb700 1 -- 172.21.15.115:0/3126031730 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860800cb20 con 0x7f861814ae00 2023-07-27T14:37:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.679+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8618164320 con 0x7f861814ae00 2023-07-27T14:37:49.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.679+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8618163fa0 con 0x7f861814ae00 2023-07-27T14:37:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.680+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861806c470 con 0x7f861814ae00 2023-07-27T14:37:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.681+0000 7f860dffb700 1 -- 172.21.15.115:0/3126031730 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f8608022070 con 0x7f861814ae00 2023-07-27T14:37:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.681+0000 7f860dffb700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85fc05f9f0 0x7f85fc061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.681+0000 7f860dffb700 1 -- 172.21.15.115:0/3126031730 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f860807ae00 con 0x7f861814ae00 2023-07-27T14:37:49.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.682+0000 7f861db9b700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85fc05f9f0 0x7f85fc061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.682+0000 7f861db9b700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85fc05f9f0 0x7f85fc061eb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f8618155580 tx=0x7f8614017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:49.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.685+0000 7f860dffb700 1 -- 172.21.15.115:0/3126031730 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f860804ba90 con 0x7f861814ae00 2023-07-27T14:37:49.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.853+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86181585a0 con 0x7f861814ae00 2023-07-27T14:37:49.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.853+0000 7f860dffb700 1 -- 172.21.15.115:0/3126031730 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7f860804f0b0 con 0x7f861814ae00 2023-07-27T14:37:49.904 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:37:49.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85fc05f9f0 msgr2=0x7f85fc061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85fc05f9f0 0x7f85fc061eb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f8618155580 tx=0x7f8614017000).stop 2023-07-27T14:37:49.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 msgr2=0x7f86180b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:49.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f86180b0560 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7f860800e8d0 tx=0x7f8608009060).stop 2023-07-27T14:37:49.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 shutdown_connections 2023-07-27T14:37:49.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f85fc05f9f0 0x7f85fc061eb0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f861814b1e0 0x7f86180c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86180c5c50 0x7f86180c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 --2- 172.21.15.115:0/3126031730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f861814ae00 0x7f86180b0560 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:49.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 >> 172.21.15.115:0/3126031730 conn(0x7f861805e940 msgr2=0x7f8618152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:49.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 shutdown_connections 2023-07-27T14:37:49.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:49.855+0000 7f861fdff700 1 -- 172.21.15.115:0/3126031730 wait complete. 2023-07-27T14:37:49.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:37:50.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.060+0000 7fb67b1ff700 1 Processor -- start 2023-07-27T14:37:50.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.061+0000 7fb67b1ff700 1 -- start start 2023-07-27T14:37:50.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb67b1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb674151bd0 0x7fb674062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb67b1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb674062810 0x7fb6740a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb67b1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740639d0 con 0x7fb6740a4d30 2023-07-27T14:37:50.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb67b1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb674137610 con 0x7fb674151bd0 2023-07-27T14:37:50.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb67b1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6740a51c0 con 0x7fb674062810 2023-07-27T14:37:50.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb678f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb674151bd0 0x7fb674062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb678f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb674151bd0 0x7fb674062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32986/0 (socket says 172.21.15.115:32986) 2023-07-27T14:37:50.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb678f9b700 1 -- 172.21.15.115:0/2754129856 learned_addr learned my addr 172.21.15.115:0/2754129856 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:50.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.062+0000 7fb67979c700 1 --1- 172.21.15.115:0/2754129856 >> v1:172.21.15.115:6789/0 conn(0x7fb6740a4d30 0x7fb674157ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41600/0 (socket says 172.21.15.115:41600) 2023-07-27T14:37:50.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb673fff700 1 --2- 172.21.15.115:0/2754129856 >> v2:172.21.15.159:3300/0 conn(0x7fb674062810 0x7fb6740a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb678f9b700 1 -- 172.21.15.115:0/2754129856 >> v2:172.21.15.159:3300/0 conn(0x7fb674062810 msgr2=0x7fb6740a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:50.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb678f9b700 1 --2- 172.21.15.115:0/2754129856 >> v2:172.21.15.159:3300/0 conn(0x7fb674062810 0x7fb6740a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb678f9b700 1 -- 172.21.15.115:0/2754129856 >> v1:172.21.15.115:6789/0 conn(0x7fb6740a4d30 legacy=0x7fb674157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb678f9b700 1 -- 172.21.15.115:0/2754129856 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb674062dc0 con 0x7fb674151bd0 2023-07-27T14:37:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb6737fe700 1 -- 172.21.15.115:0/2754129856 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309011506 0 0) 0x7fb6740639d0 con 0x7fb6740a4d30 2023-07-27T14:37:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb678f9b700 1 --2- 172.21.15.115:0/2754129856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674062320 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fb6740be140 tx=0x7fb6680090f0).ready entity=mon.0 client_cookie=75839a10cfe2fcb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb6737fe700 1 -- 172.21.15.115:0/2754129856 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800b600 con 0x7fb674151bd0 2023-07-27T14:37:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb6737fe700 1 -- 172.21.15.115:0/2754129856 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800b760 con 0x7fb674151bd0 2023-07-27T14:37:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.063+0000 7fb6737fe700 1 -- 172.21.15.115:0/2754129856 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800bae0 con 0x7fb674151bd0 2023-07-27T14:37:50.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.064+0000 7fb67b1ff700 1 -- 172.21.15.115:0/2754129856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 msgr2=0x7fb674062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.064+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/2754129856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674062320 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fb6740be140 tx=0x7fb6680090f0).stop 2023-07-27T14:37:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.064+0000 7fb67b1ff700 1 -- 172.21.15.115:0/2754129856 shutdown_connections 2023-07-27T14:37:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.064+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/2754129856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674062320 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.064+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/2754129856 >> v2:172.21.15.159:3300/0 conn(0x7fb674062810 0x7fb6740a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.064+0000 7fb67b1ff700 1 -- 172.21.15.115:0/2754129856 >> 172.21.15.115:0/2754129856 conn(0x7fb674064700 msgr2=0x7fb674064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.064+0000 7fb67b1ff700 1 -- 172.21.15.115:0/2754129856 shutdown_connections 2023-07-27T14:37:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.064+0000 7fb67b1ff700 1 -- 172.21.15.115:0/2754129856 wait complete. 2023-07-27T14:37:50.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.065+0000 7fb67b1ff700 1 Processor -- start 2023-07-27T14:37:50.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.065+0000 7fb67b1ff700 1 -- start start 2023-07-27T14:37:50.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.066+0000 7fb67b1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674062810 0x7fb674153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.066+0000 7fb67b1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740a4d30 0x7fb674137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.066+0000 7fb67b1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.066+0000 7fb67b1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb674154ce0 con 0x7fb674151bd0 2023-07-27T14:37:50.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.066+0000 7fb67b1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67413be20 con 0x7fb6740a4d30 2023-07-27T14:37:50.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.066+0000 7fb67b1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb674154720 con 0x7fb674062810 2023-07-27T14:37:50.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674137c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33002/0 (socket says 172.21.15.115:33002) 2023-07-27T14:37:50.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 -- 172.21.15.115:0/1696428230 learned_addr learned my addr 172.21.15.115:0/1696428230 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:50.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb673fff700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740a4d30 0x7fb674137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb678f9b700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674062810 0x7fb674153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 -- 172.21.15.115:0/1696428230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674062810 msgr2=0x7fb674153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674062810 0x7fb674153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 -- 172.21.15.115:0/1696428230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740a4d30 msgr2=0x7fb674137760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740a4d30 0x7fb674137760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 -- 172.21.15.115:0/1696428230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668009370 con 0x7fb674151bd0 2023-07-27T14:37:50.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.067+0000 7fb67979c700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674137c50 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7fb66c00c730 tx=0x7fb66c001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:50.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.068+0000 7fb670ff9700 1 -- 172.21.15.115:0/1696428230 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c005c70 con 0x7fb674151bd0 2023-07-27T14:37:50.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.068+0000 7fb670ff9700 1 -- 172.21.15.115:0/1696428230 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c005dd0 con 0x7fb674151bd0 2023-07-27T14:37:50.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.068+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb674154a00 con 0x7fb674151bd0 2023-07-27T14:37:50.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.068+0000 7fb670ff9700 1 -- 172.21.15.115:0/1696428230 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c007320 con 0x7fb674151bd0 2023-07-27T14:37:50.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.068+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6741388c0 con 0x7fb674151bd0 2023-07-27T14:37:50.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.069+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67406c470 con 0x7fb674151bd0 2023-07-27T14:37:50.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.070+0000 7fb670ff9700 1 -- 172.21.15.115:0/1696428230 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fb66c010070 con 0x7fb674151bd0 2023-07-27T14:37:50.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.071+0000 7fb670ff9700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb65805f9f0 0x7fb658061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.071+0000 7fb670ff9700 1 -- 172.21.15.115:0/1696428230 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb66c07a230 con 0x7fb674151bd0 2023-07-27T14:37:50.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.071+0000 7fb678f9b700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb65805f9f0 0x7fb658061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.071+0000 7fb678f9b700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb65805f9f0 0x7fb658061eb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fb668009130 tx=0x7fb668017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:50.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.075+0000 7fb670ff9700 1 -- 172.21.15.115:0/1696428230 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb66c04af70 con 0x7fb674151bd0 2023-07-27T14:37:50.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.244+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb67413c280 con 0x7fb674151bd0 2023-07-27T14:37:50.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.244+0000 7fb670ff9700 1 -- 172.21.15.115:0/1696428230 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v170) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb66c04e590 con 0x7fb674151bd0 2023-07-27T14:37:50.296 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:50.297 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:37:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:37:50.297 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:37:50.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:37:50.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:37:50.298 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:37:50.298 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:37:50.299 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:37:50.299 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:37:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb65805f9f0 msgr2=0x7fb658061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb65805f9f0 0x7fb658061eb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fb668009130 tx=0x7fb668017000).stop 2023-07-27T14:37:50.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 msgr2=0x7fb674137c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674137c50 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7fb66c00c730 tx=0x7fb66c001520).stop 2023-07-27T14:37:50.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 shutdown_connections 2023-07-27T14:37:50.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb65805f9f0 0x7fb658061eb0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb674151bd0 0x7fb674137c50 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674062810 0x7fb674153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.246+0000 7fb67b1ff700 1 --2- 172.21.15.115:0/1696428230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740a4d30 0x7fb674137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.247+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 >> 172.21.15.115:0/1696428230 conn(0x7fb674064700 msgr2=0x7fb674068f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:50.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.247+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 shutdown_connections 2023-07-27T14:37:50.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.247+0000 7fb67b1ff700 1 -- 172.21.15.115:0/1696428230 wait complete. 2023-07-27T14:37:50.315 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:37:50.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:37:50.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.456+0000 7f8c6e1ff700 1 Processor -- start 2023-07-27T14:37:50.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.456+0000 7f8c6e1ff700 1 -- start start 2023-07-27T14:37:50.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c6e1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c68063260 0x7f8c68154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c6e1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c681553f0 con 0x7f8c6814ae00 2023-07-27T14:37:50.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c6e1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c68157a50 con 0x7f8c6814b1e0 2023-07-27T14:37:50.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c6e1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68157d10 con 0x7f8c68063260 2023-07-27T14:37:50.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c677fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8c6814ae00 0x7f8c68062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41612/0 (socket says 172.21.15.115:41612) 2023-07-27T14:37:50.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c677fe700 1 -- 172.21.15.115:0/2405471857 learned_addr learned my addr 172.21.15.115:0/2405471857 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:50.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c66ffd700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c68063260 0x7f8c68154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983720164 0 0) 0x7f8c681553f0 con 0x7f8c6814ae00 2023-07-27T14:37:50.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.458+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c500033f0 con 0x7f8c6814ae00 2023-07-27T14:37:50.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043353009 0 0) 0x7f8c68157a50 con 0x7f8c6814b1e0 2023-07-27T14:37:50.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c681553f0 con 0x7f8c6814b1e0 2023-07-27T14:37:50.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 622522000 0 0) 0x7f8c500033f0 con 0x7f8c6814ae00 2023-07-27T14:37:50.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c68063260 msgr2=0x7f8c68154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:50.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c68063260 0x7f8c68154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 >> v1:172.21.15.159:6789/0 conn(0x7f8c6814b1e0 legacy=0x7f8c680a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68157ff0 con 0x7f8c6814ae00 2023-07-27T14:37:50.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f8c58001470 con 0x7f8c6814ae00 2023-07-27T14:37:50.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 >> v1:172.21.15.115:6789/0 conn(0x7f8c6814ae00 legacy=0x7f8c68062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50003aa0 0x7f8c50003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c68063260 0x7f8c50004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c50004b80 0x7f8c50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68157d10 con 0x7f8c50004b80 2023-07-27T14:37:50.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5000b910 con 0x7f8c50003aa0 2023-07-27T14:37:50.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5000bad0 con 0x7f8c68063260 2023-07-27T14:37:50.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c67fff700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c50004b80 0x7f8c50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c677fe700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50003aa0 0x7f8c50003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c66ffd700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c68063260 0x7f8c50004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c67fff700 1 -- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c68063260 msgr2=0x7f8c50004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:50.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c67fff700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c68063260 0x7f8c50004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c67fff700 1 -- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50003aa0 msgr2=0x7f8c50003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:50.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c67fff700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50003aa0 0x7f8c50003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.459+0000 7f8c67fff700 1 -- 172.21.15.115:0/2405471857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c500033f0 con 0x7f8c50004b80 2023-07-27T14:37:50.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c67fff700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c50004b80 0x7f8c50005000 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f8c60001f90 tx=0x7f8c60007f30).ready entity=mon.0 client_cookie=d2d61b1181c13050 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:50.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600020f0 con 0x7f8c50004b80 2023-07-27T14:37:50.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60006a20 con 0x7f8c50004b80 2023-07-27T14:37:50.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c667fc700 1 -- 172.21.15.115:0/2405471857 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60006dc0 con 0x7f8c50004b80 2023-07-27T14:37:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/2405471857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c50004b80 msgr2=0x7f8c50005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c6e1ff700 1 --2- 172.21.15.115:0/2405471857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c50004b80 0x7f8c50005000 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f8c60001f90 tx=0x7f8c60007f30).stop 2023-07-27T14:37:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c67fff700 1 -- 172.21.15.115:0/2405471857 reap_dead start 2023-07-27T14:37:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/2405471857 shutdown_connections 2023-07-27T14:37:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/2405471857 >> 172.21.15.115:0/2405471857 conn(0x7f8c6805e940 msgr2=0x7f8c680cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.460+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/2405471857 shutdown_connections 2023-07-27T14:37:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.461+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/2405471857 wait complete. 2023-07-27T14:37:50.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.462+0000 7f8c6e1ff700 1 Processor -- start 2023-07-27T14:37:50.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.462+0000 7f8c6e1ff700 1 -- start start 2023-07-27T14:37:50.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c6e1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50004b80 0x7f8c6814db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c6e1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c6814c5e0 0x7f8c6814e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c6e1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c68148cc0 0x7f8c68064200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c6e1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6814d680 con 0x7f8c68148cc0 2023-07-27T14:37:50.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c6e1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6814ca70 con 0x7f8c50004b80 2023-07-27T14:37:50.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c6e1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6814cd50 con 0x7f8c6814c5e0 2023-07-27T14:37:50.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c67fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c68148cc0 0x7f8c68064200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c67fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c68148cc0 0x7f8c68064200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33020/0 (socket says 172.21.15.115:33020) 2023-07-27T14:37:50.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c67fff700 1 -- 172.21.15.115:0/966120120 learned_addr learned my addr 172.21.15.115:0/966120120 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:50.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c66ffd700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c6814c5e0 0x7f8c6814e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.463+0000 7f8c677fe700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50004b80 0x7f8c6814db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c67fff700 1 -- 172.21.15.115:0/966120120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c6814c5e0 msgr2=0x7f8c6814e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c67fff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c6814c5e0 0x7f8c6814e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c67fff700 1 -- 172.21.15.115:0/966120120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50004b80 msgr2=0x7f8c6814db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c67fff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50004b80 0x7f8c6814db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c67fff700 1 -- 172.21.15.115:0/966120120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6814d030 con 0x7f8c68148cc0 2023-07-27T14:37:50.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c67fff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c68148cc0 0x7f8c68064200 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f8c60001760 tx=0x7f8c60016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:50.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c4f7fe700 1 -- 172.21.15.115:0/966120120 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60012610 con 0x7f8c68148cc0 2023-07-27T14:37:50.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c4f7fe700 1 -- 172.21.15.115:0/966120120 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60012770 con 0x7f8c68148cc0 2023-07-27T14:37:50.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6814d310 con 0x7f8c68148cc0 2023-07-27T14:37:50.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c4f7fe700 1 -- 172.21.15.115:0/966120120 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60012b10 con 0x7f8c68148cc0 2023-07-27T14:37:50.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.464+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c68149100 con 0x7f8c68148cc0 2023-07-27T14:37:50.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.465+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6814d830 con 0x7f8c68148cc0 2023-07-27T14:37:50.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.466+0000 7f8c4f7fe700 1 -- 172.21.15.115:0/966120120 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f8c60025030 con 0x7f8c68148cc0 2023-07-27T14:37:50.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.467+0000 7f8c4f7fe700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c5405f9f0 0x7f8c54061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:50.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.467+0000 7f8c4f7fe700 1 -- 172.21.15.115:0/966120120 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8c6007b8a0 con 0x7f8c68148cc0 2023-07-27T14:37:50.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.467+0000 7f8c677fe700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c5405f9f0 0x7f8c54061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:50.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.468+0000 7f8c677fe700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c5405f9f0 0x7f8c54061eb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f8c58001200 tx=0x7f8c6814eb20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:50.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.471+0000 7f8c4f7fe700 1 -- 172.21.15.115:0/966120120 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8c6814d830 con 0x7f8c68148cc0 2023-07-27T14:37:50.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.640+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8c6806c470 con 0x7f8c68148cc0 2023-07-27T14:37:50.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.885+0000 7f8c4f7fe700 1 -- 172.21.15.115:0/966120120 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v171) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8c60023030 con 0x7f8c68148cc0 2023-07-27T14:37:50.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c5405f9f0 msgr2=0x7f8c54061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c5405f9f0 0x7f8c54061eb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f8c58001200 tx=0x7f8c6814eb20).stop 2023-07-27T14:37:50.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c68148cc0 msgr2=0x7f8c68064200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:50.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c68148cc0 0x7f8c68064200 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f8c60001760 tx=0x7f8c60016000).stop 2023-07-27T14:37:50.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 shutdown_connections 2023-07-27T14:37:50.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8c5405f9f0 0x7f8c54061eb0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c68148cc0 0x7f8c68064200 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c50004b80 0x7f8c6814db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 --2- 172.21.15.115:0/966120120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c6814c5e0 0x7f8c6814e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:50.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.889+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 >> 172.21.15.115:0/966120120 conn(0x7f8c6805e940 msgr2=0x7f8c680c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:50.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.890+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 shutdown_connections 2023-07-27T14:37:50.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:50.892+0000 7f8c6e1ff700 1 -- 172.21.15.115:0/966120120 wait complete. 2023-07-27T14:37:50.947 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:37:50.964 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:37:51.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.109+0000 7f45187ff700 1 Processor -- start 2023-07-27T14:37:51.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.110+0000 7f45187ff700 1 -- start start 2023-07-27T14:37:51.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.111+0000 7f45187ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4510153d50 0x7f4510154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:51.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.111+0000 7f45187ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f45100c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:51.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.111+0000 7f45187ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4510157b90 con 0x7f45100c6ba0 2023-07-27T14:37:51.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.111+0000 7f45187ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45101589f0 con 0x7f4510153d50 2023-07-27T14:37:51.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.111+0000 7f45187ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4510157de0 con 0x7f45100bd9f0 2023-07-27T14:37:51.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.111+0000 7f4516d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f45100c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:51.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f4516d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f45100c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:53864/0 (socket says 172.21.15.115:53864) 2023-07-27T14:37:51.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f4516d9c700 1 -- 172.21.15.115:0/1680592705 learned_addr learned my addr 172.21.15.115:0/1680592705 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:51.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f451659b700 1 --2- 172.21.15.115:0/1680592705 >> v2:172.21.15.159:3300/0 conn(0x7f4510153d50 0x7f4510154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:51.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f4516d9c700 1 -- 172.21.15.115:0/1680592705 >> v2:172.21.15.159:3300/0 conn(0x7f4510153d50 msgr2=0x7f4510154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:51.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f4516d9c700 1 --2- 172.21.15.115:0/1680592705 >> v2:172.21.15.159:3300/0 conn(0x7f4510153d50 0x7f4510154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f4516d9c700 1 -- 172.21.15.115:0/1680592705 >> v1:172.21.15.159:6789/0 conn(0x7f45100c6ba0 legacy=0x7f45100bd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:51.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f4516d9c700 1 -- 172.21.15.115:0/1680592705 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45101580c0 con 0x7f45100bd9f0 2023-07-27T14:37:51.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f4516d9c700 1 --2- 172.21.15.115:0/1680592705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f45100c4600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f4508009f20 tx=0x7f4508009840).ready entity=mon.2 client_cookie=1917a1745873a491 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:51.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.112+0000 7f4515599700 1 -- 172.21.15.115:0/1680592705 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800e070 con 0x7f45100bd9f0 2023-07-27T14:37:51.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f4515599700 1 -- 172.21.15.115:0/1680592705 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450800b9d0 con 0x7f45100bd9f0 2023-07-27T14:37:51.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f4515599700 1 -- 172.21.15.115:0/1680592705 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800bd50 con 0x7f45100bd9f0 2023-07-27T14:37:51.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f45187ff700 1 -- 172.21.15.115:0/1680592705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 msgr2=0x7f45100c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:51.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f45187ff700 1 --2- 172.21.15.115:0/1680592705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f45100c4600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f4508009f20 tx=0x7f4508009840).stop 2023-07-27T14:37:51.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f45187ff700 1 -- 172.21.15.115:0/1680592705 shutdown_connections 2023-07-27T14:37:51.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f45187ff700 1 --2- 172.21.15.115:0/1680592705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f45100c4600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f45187ff700 1 --2- 172.21.15.115:0/1680592705 >> v2:172.21.15.159:3300/0 conn(0x7f4510153d50 0x7f4510154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f45187ff700 1 -- 172.21.15.115:0/1680592705 >> 172.21.15.115:0/1680592705 conn(0x7f45100c7c30 msgr2=0x7f45100c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:51.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f45187ff700 1 -- 172.21.15.115:0/1680592705 shutdown_connections 2023-07-27T14:37:51.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.113+0000 7f45187ff700 1 -- 172.21.15.115:0/1680592705 wait complete. 2023-07-27T14:37:51.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.115+0000 7f45187ff700 1 Processor -- start 2023-07-27T14:37:51.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.115+0000 7f45187ff700 1 -- start start 2023-07-27T14:37:51.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f45187ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f4510091b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:51.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f45187ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45100c6ba0 0x7f4510145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:51.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f45187ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510153d50 0x7f4510093530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:51.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f45187ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100a76b0 con 0x7f4510153d50 2023-07-27T14:37:51.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f45187ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510092010 con 0x7f45100c6ba0 2023-07-27T14:37:51.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f45187ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4510145550 con 0x7f45100bd9f0 2023-07-27T14:37:51.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f4516d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510153d50 0x7f4510093530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:51.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f4516d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510153d50 0x7f4510093530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33032/0 (socket says 172.21.15.115:33032) 2023-07-27T14:37:51.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f4516d9c700 1 -- 172.21.15.115:0/61179424 learned_addr learned my addr 172.21.15.115:0/61179424 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:51.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f451659b700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f4510091b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:51.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.116+0000 7f4515d9a700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45100c6ba0 0x7f4510145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:51.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f4516d9c700 1 -- 172.21.15.115:0/61179424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 msgr2=0x7f4510091b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:51.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f4516d9c700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f4510091b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f4516d9c700 1 -- 172.21.15.115:0/61179424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45100c6ba0 msgr2=0x7f4510145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:51.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f4516d9c700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45100c6ba0 0x7f4510145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f4516d9c700 1 -- 172.21.15.115:0/61179424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508009ae0 con 0x7f4510153d50 2023-07-27T14:37:51.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f4516d9c700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510153d50 0x7f4510093530 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f4508009540 tx=0x7f4508009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:51.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f45067fc700 1 -- 172.21.15.115:0/61179424 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508013ea0 con 0x7f4510153d50 2023-07-27T14:37:51.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f45067fc700 1 -- 172.21.15.115:0/61179424 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508007170 con 0x7f4510153d50 2023-07-27T14:37:51.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f45187ff700 1 -- 172.21.15.115:0/61179424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45100ac760 con 0x7f4510153d50 2023-07-27T14:37:51.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f45067fc700 1 -- 172.21.15.115:0/61179424 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450801d640 con 0x7f4510153d50 2023-07-27T14:37:51.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.117+0000 7f45187ff700 1 -- 172.21.15.115:0/61179424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45100a7060 con 0x7f4510153d50 2023-07-27T14:37:51.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.119+0000 7f44f3fff700 1 -- 172.21.15.115:0/61179424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ec005120 con 0x7f4510153d50 2023-07-27T14:37:51.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.120+0000 7f45067fc700 1 -- 172.21.15.115:0/61179424 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f450801b040 con 0x7f4510153d50 2023-07-27T14:37:51.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.120+0000 7f45067fc700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44f405f9f0 0x7f44f4061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:51.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.120+0000 7f45067fc700 1 -- 172.21.15.115:0/61179424 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f450807c840 con 0x7f4510153d50 2023-07-27T14:37:51.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.121+0000 7f451659b700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44f405f9f0 0x7f44f4061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:51.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.121+0000 7f451659b700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44f405f9f0 0x7f44f4061eb0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f4510065e30 tx=0x7f450c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:51.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.125+0000 7f45067fc700 1 -- 172.21.15.115:0/61179424 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f450804d250 con 0x7f4510153d50 2023-07-27T14:37:51.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.296+0000 7f44f3fff700 1 -- 172.21.15.115:0/61179424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f44ec0057f0 con 0x7f4510153d50 2023-07-27T14:37:51.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.895+0000 7f45067fc700 1 -- 172.21.15.115:0/61179424 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v172) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4508050870 con 0x7f4510153d50 2023-07-27T14:37:51.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.907+0000 7f44f3fff700 1 -- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44f405f9f0 msgr2=0x7f44f4061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:51.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.907+0000 7f44f3fff700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44f405f9f0 0x7f44f4061eb0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f4510065e30 tx=0x7f450c009060).stop 2023-07-27T14:37:51.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.907+0000 7f44f3fff700 1 -- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510153d50 msgr2=0x7f4510093530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:51.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.907+0000 7f44f3fff700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510153d50 0x7f4510093530 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f4508009540 tx=0x7f4508009840).stop 2023-07-27T14:37:51.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.911+0000 7f44f3fff700 1 -- 172.21.15.115:0/61179424 shutdown_connections 2023-07-27T14:37:51.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.911+0000 7f44f3fff700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f44f405f9f0 0x7f44f4061eb0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.911+0000 7f44f3fff700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4510153d50 0x7f4510093530 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.911+0000 7f44f3fff700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45100bd9f0 0x7f4510091b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.911+0000 7f44f3fff700 1 --2- 172.21.15.115:0/61179424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45100c6ba0 0x7f4510145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:51.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.911+0000 7f44f3fff700 1 -- 172.21.15.115:0/61179424 >> 172.21.15.115:0/61179424 conn(0x7f45100c7c30 msgr2=0x7f4510064eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:51.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.912+0000 7f44f3fff700 1 -- 172.21.15.115:0/61179424 shutdown_connections 2023-07-27T14:37:51.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:51.913+0000 7f44f3fff700 1 -- 172.21.15.115:0/61179424 wait complete. 2023-07-27T14:37:51.969 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:37:51.990 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:37:52.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.131+0000 7f7816dff700 1 Processor -- start 2023-07-27T14:37:52.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.131+0000 7f7816dff700 1 -- start start 2023-07-27T14:37:52.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.132+0000 7f7816dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781014ae00 0x7f7810154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.132+0000 7f7816dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f781014b1e0 0x7f7810062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.132+0000 7f7816dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78101553f0 con 0x7f78100c5c50 2023-07-27T14:37:52.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.132+0000 7f7816dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7810157a50 con 0x7f781014b1e0 2023-07-27T14:37:52.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.132+0000 7f7816dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7810157d10 con 0x7f781014ae00 2023-07-27T14:37:52.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f781539c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f78100c5c50 0x7f78100a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41620/0 (socket says 172.21.15.115:41620) 2023-07-27T14:37:52.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f781539c700 1 -- 172.21.15.115:0/484103855 learned_addr learned my addr 172.21.15.115:0/484103855 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:52.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f7814b9b700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781014ae00 0x7f7810154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780ffff700 1 --2- 172.21.15.115:0/484103855 >> v2:172.21.15.159:3300/0 conn(0x7f781014b1e0 0x7f7810062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225063786 0 0) 0x7f78101553f0 con 0x7f78100c5c50 2023-07-27T14:37:52.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78000033f0 con 0x7f78100c5c50 2023-07-27T14:37:52.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3513922702 0 0) 0x7f78000033f0 con 0x7f78100c5c50 2023-07-27T14:37:52.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781014ae00 msgr2=0x7f7810154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:52.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781014ae00 0x7f7810154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 >> v2:172.21.15.159:3300/0 conn(0x7f781014b1e0 msgr2=0x7f7810062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:52.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 --2- 172.21.15.115:0/484103855 >> v2:172.21.15.159:3300/0 conn(0x7f781014b1e0 0x7f7810062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7810157ff0 con 0x7f78100c5c50 2023-07-27T14:37:52.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f78080017f0 con 0x7f78100c5c50 2023-07-27T14:37:52.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.133+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 >> v1:172.21.15.115:6789/0 conn(0x7f78100c5c50 legacy=0x7f78100a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780f7fe700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781014ae00 0x7f78000038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780f7fe700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7800004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780f7fe700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800004b80 0x7f7800005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810157a50 con 0x7f7800003e10 2023-07-27T14:37:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810157d10 con 0x7f7800004b80 2023-07-27T14:37:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780000b8e0 con 0x7f781014ae00 2023-07-27T14:37:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780ffff700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7800004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f7814b9b700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781014ae00 0x7f78000038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f781539c700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800004b80 0x7f7800005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780ffff700 1 -- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781014ae00 msgr2=0x7f78000038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780ffff700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781014ae00 0x7f78000038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780ffff700 1 -- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800004b80 msgr2=0x7f7800005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780ffff700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800004b80 0x7f7800005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780ffff700 1 -- 172.21.15.115:0/484103855 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78000033f0 con 0x7f7800003e10 2023-07-27T14:37:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.134+0000 7f780ffff700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7800004690 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f78100cbc00 tx=0x7f77fc009060).ready entity=mon.0 client_cookie=4feffecfeac570b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:52.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc009e90 con 0x7f7800003e10 2023-07-27T14:37:52.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc009430 con 0x7f7800003e10 2023-07-27T14:37:52.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f780f7fe700 1 -- 172.21.15.115:0/484103855 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00e820 con 0x7f7800003e10 2023-07-27T14:37:52.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f7816dff700 1 -- 172.21.15.115:0/484103855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 msgr2=0x7f7800004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f7816dff700 1 --2- 172.21.15.115:0/484103855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7800004690 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f78100cbc00 tx=0x7f77fc009060).stop 2023-07-27T14:37:52.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f781539c700 1 -- 172.21.15.115:0/484103855 reap_dead start 2023-07-27T14:37:52.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f7816dff700 1 -- 172.21.15.115:0/484103855 shutdown_connections 2023-07-27T14:37:52.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f7816dff700 1 -- 172.21.15.115:0/484103855 >> 172.21.15.115:0/484103855 conn(0x7f781005e940 msgr2=0x7f78100cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:52.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f7816dff700 1 -- 172.21.15.115:0/484103855 shutdown_connections 2023-07-27T14:37:52.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.135+0000 7f7816dff700 1 -- 172.21.15.115:0/484103855 wait complete. 2023-07-27T14:37:52.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.137+0000 7f7816dff700 1 Processor -- start 2023-07-27T14:37:52.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.137+0000 7f7816dff700 1 -- start start 2023-07-27T14:37:52.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7816dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7810163a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7816dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7810163f50 0x7f78100c03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7816dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78100c0890 0x7f78100afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7816dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c0d10 con 0x7f7800003e10 2023-07-27T14:37:52.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7816dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100b0c70 con 0x7f78100c0890 2023-07-27T14:37:52.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7816dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c1da0 con 0x7f7810163f50 2023-07-27T14:37:52.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7814b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7810163a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7814b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7810163a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33056/0 (socket says 172.21.15.115:33056) 2023-07-27T14:37:52.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7814b9b700 1 -- 172.21.15.115:0/1620616010 learned_addr learned my addr 172.21.15.115:0/1620616010 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:52.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f781539c700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78100c0890 0x7f78100afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7814b9b700 1 -- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7810163f50 msgr2=0x7f78100c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f780ffff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7810163f50 0x7f78100c03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7814b9b700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7810163f50 0x7f78100c03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7814b9b700 1 -- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78100c0890 msgr2=0x7f78100afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7814b9b700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78100c0890 0x7f78100afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f7814b9b700 1 -- 172.21.15.115:0/1620616010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100c2080 con 0x7f7800003e10 2023-07-27T14:37:52.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f781539c700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78100c0890 0x7f78100afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:52.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.138+0000 7f780ffff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7810163f50 0x7f78100c03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:52.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.139+0000 7f7814b9b700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7810163a60 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f78040119f0 tx=0x7f7804009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:52.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.139+0000 7f780cff9700 1 -- 172.21.15.115:0/1620616010 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400f940 con 0x7f7800003e10 2023-07-27T14:37:52.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.139+0000 7f780cff9700 1 -- 172.21.15.115:0/1620616010 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400faa0 con 0x7f7800003e10 2023-07-27T14:37:52.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.139+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78100c2360 con 0x7f7800003e10 2023-07-27T14:37:52.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.139+0000 7f780cff9700 1 -- 172.21.15.115:0/1620616010 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400fe20 con 0x7f7800003e10 2023-07-27T14:37:52.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.139+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78100b0370 con 0x7f7800003e10 2023-07-27T14:37:52.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.140+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781006c470 con 0x7f7800003e10 2023-07-27T14:37:52.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.141+0000 7f780cff9700 1 -- 172.21.15.115:0/1620616010 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f7804024070 con 0x7f7800003e10 2023-07-27T14:37:52.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.142+0000 7f780cff9700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77f405f9f0 0x7f77f4061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.142+0000 7f780cff9700 1 -- 172.21.15.115:0/1620616010 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f780407b9c0 con 0x7f7800003e10 2023-07-27T14:37:52.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.142+0000 7f780ffff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77f405f9f0 0x7f77f4061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.143+0000 7f780ffff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77f405f9f0 0x7f77f4061eb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f78100cbc00 tx=0x7f77fc01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:52.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.146+0000 7f780cff9700 1 -- 172.21.15.115:0/1620616010 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f780404c250 con 0x7f7800003e10 2023-07-27T14:37:52.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.355+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7810153670 con 0x7f7800003e10 2023-07-27T14:37:52.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.363+0000 7f780cff9700 1 -- 172.21.15.115:0/1620616010 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v89) v1 ==== 174+0+0 (secure 0 0 0) 0x7f780404f870 con 0x7f7800003e10 2023-07-27T14:37:52.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77f405f9f0 msgr2=0x7f77f4061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77f405f9f0 0x7f77f4061eb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f78100cbc00 tx=0x7f77fc01a000).stop 2023-07-27T14:37:52.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 msgr2=0x7f7810163a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7810163a60 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f78040119f0 tx=0x7f7804009060).stop 2023-07-27T14:37:52.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 shutdown_connections 2023-07-27T14:37:52.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77f405f9f0 0x7f77f4061eb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f78100c0890 0x7f78100afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7800003e10 0x7f7810163a60 secure :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0x7f78040119f0 tx=0x7f7804009060).stop 2023-07-27T14:37:52.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.372+0000 7f7816dff700 1 --2- 172.21.15.115:0/1620616010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7810163f50 0x7f78100c03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.373+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 >> 172.21.15.115:0/1620616010 conn(0x7f781005e940 msgr2=0x7f781014a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:52.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.374+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 shutdown_connections 2023-07-27T14:37:52.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.378+0000 7f7816dff700 1 -- 172.21.15.115:0/1620616010 wait complete. 2023-07-27T14:37:52.440 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 23 and data pool 24 2023-07-27T14:37:52.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:37:52.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.594+0000 7f4ad93ff700 1 Processor -- start 2023-07-27T14:37:52.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.594+0000 7f4ad93ff700 1 -- start start 2023-07-27T14:37:52.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.595+0000 7f4ad93ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ad4153ec0 0x7f4ad40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.595+0000 7f4ad93ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4ad40aaa40 0x7f4ad40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.595+0000 7f4ad93ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad40aa4d0 con 0x7f4ad40aa050 2023-07-27T14:37:52.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.595+0000 7f4ad93ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40c05c0 con 0x7f4ad4153ec0 2023-07-27T14:37:52.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.595+0000 7f4ad93ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40bfc90 con 0x7f4ad40aaa40 2023-07-27T14:37:52.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad2ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ad4153ec0 0x7f4ad40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad2ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ad4153ec0 0x7f4ad40a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33058/0 (socket says 172.21.15.115:33058) 2023-07-27T14:37:52.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad2ffd700 1 -- 172.21.15.115:0/3645890824 learned_addr learned my addr 172.21.15.115:0/3645890824 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:52.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad37fe700 1 --2- 172.21.15.115:0/3645890824 >> v2:172.21.15.159:3300/0 conn(0x7f4ad40aaa40 0x7f4ad40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad2ffd700 1 -- 172.21.15.115:0/3645890824 >> v2:172.21.15.159:3300/0 conn(0x7f4ad40aaa40 msgr2=0x7f4ad40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:52.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad2ffd700 1 --2- 172.21.15.115:0/3645890824 >> v2:172.21.15.159:3300/0 conn(0x7f4ad40aaa40 0x7f4ad40c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad2ffd700 1 -- 172.21.15.115:0/3645890824 >> v1:172.21.15.159:6789/0 conn(0x7f4ad40aa050 legacy=0x7f4ad40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:52.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad2ffd700 1 -- 172.21.15.115:0/3645890824 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40bff70 con 0x7f4ad4153ec0 2023-07-27T14:37:52.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad2ffd700 1 --2- 172.21.15.115:0/3645890824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad4153ec0 0x7f4ad40a9b60 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f4ad40c5470 tx=0x7f4ac40090f0).ready entity=mon.0 client_cookie=8a1653c05751ceaf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:52.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.596+0000 7f4ad1ffb700 1 -- 172.21.15.115:0/3645890824 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400b5a0 con 0x7f4ad4153ec0 2023-07-27T14:37:52.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad1ffb700 1 -- 172.21.15.115:0/3645890824 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac400b700 con 0x7f4ad4153ec0 2023-07-27T14:37:52.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad1ffb700 1 -- 172.21.15.115:0/3645890824 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400ba80 con 0x7f4ad4153ec0 2023-07-27T14:37:52.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3645890824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad4153ec0 msgr2=0x7f4ad40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3645890824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad4153ec0 0x7f4ad40a9b60 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f4ad40c5470 tx=0x7f4ac40090f0).stop 2023-07-27T14:37:52.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3645890824 shutdown_connections 2023-07-27T14:37:52.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3645890824 >> v2:172.21.15.159:3300/0 conn(0x7f4ad40aaa40 0x7f4ad40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3645890824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad4153ec0 0x7f4ad40a9b60 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3645890824 >> 172.21.15.115:0/3645890824 conn(0x7f4ad40cb610 msgr2=0x7f4ad40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:52.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3645890824 shutdown_connections 2023-07-27T14:37:52.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.597+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3645890824 wait complete. 2023-07-27T14:37:52.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.599+0000 7f4ad93ff700 1 Processor -- start 2023-07-27T14:37:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.599+0000 7f4ad93ff700 1 -- start start 2023-07-27T14:37:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad93ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ad40aa050 0x7f4ad41542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad93ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad40aaa40 0x7f4ad413b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad93ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ad4153ec0 0x7f4ad4167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad93ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4150c00 con 0x7f4ad40aaa40 2023-07-27T14:37:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad93ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4168c10 con 0x7f4ad40aa050 2023-07-27T14:37:52.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad93ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4150e50 con 0x7f4ad4153ec0 2023-07-27T14:37:52.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad40aaa40 0x7f4ad413b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad40aaa40 0x7f4ad413b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33062/0 (socket says 172.21.15.115:33062) 2023-07-27T14:37:52.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 -- 172.21.15.115:0/3579318429 learned_addr learned my addr 172.21.15.115:0/3579318429 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:52.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad2ffd700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ad40aa050 0x7f4ad41542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad37fe700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ad4153ec0 0x7f4ad4167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 -- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ad4153ec0 msgr2=0x7f4ad4167df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ad4153ec0 0x7f4ad4167df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 -- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ad40aa050 msgr2=0x7f4ad41542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ad40aa050 0x7f4ad41542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 -- 172.21.15.115:0/3579318429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4009370 con 0x7f4ad40aaa40 2023-07-27T14:37:52.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad37fe700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ad4153ec0 0x7f4ad4167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:52.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad2ffd700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ad40aa050 0x7f4ad41542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:52.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.600+0000 7f4ad27fc700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad40aaa40 0x7f4ad413b2e0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f4ac800b490 tx=0x7f4ac8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:52.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.601+0000 7f4abaffd700 1 -- 172.21.15.115:0/3579318429 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8012410 con 0x7f4ad40aaa40 2023-07-27T14:37:52.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.601+0000 7f4abaffd700 1 -- 172.21.15.115:0/3579318429 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac80125b0 con 0x7f4ad40aaa40 2023-07-27T14:37:52.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.601+0000 7f4abaffd700 1 -- 172.21.15.115:0/3579318429 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8012970 con 0x7f4ad40aaa40 2023-07-27T14:37:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.601+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad4151130 con 0x7f4ad40aaa40 2023-07-27T14:37:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.601+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad41516f0 con 0x7f4ad40aaa40 2023-07-27T14:37:52.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.602+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad406c470 con 0x7f4ad40aaa40 2023-07-27T14:37:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.603+0000 7f4abaffd700 1 -- 172.21.15.115:0/3579318429 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f4ac800f030 con 0x7f4ad40aaa40 2023-07-27T14:37:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.604+0000 7f4abaffd700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac005f9f0 0x7f4ac0061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.604+0000 7f4abaffd700 1 -- 172.21.15.115:0/3579318429 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4ac807ac70 con 0x7f4ad40aaa40 2023-07-27T14:37:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.604+0000 7f4ad2ffd700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac005f9f0 0x7f4ac0061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:52.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.605+0000 7f4ad2ffd700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac005f9f0 0x7f4ac0061eb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f4ac4006b80 tx=0x7f4ac4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:52.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.608+0000 7f4abaffd700 1 -- 172.21.15.115:0/3579318429 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ac804b4a0 con 0x7f4ad40aaa40 2023-07-27T14:37:52.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.778+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad40c8230 con 0x7f4ad40aaa40 2023-07-27T14:37:52.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.779+0000 7f4abaffd700 1 -- 172.21.15.115:0/3579318429 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+17099 (secure 0 0 0) 0x7f4ac804eac0 con 0x7f4ad40aaa40 2023-07-27T14:37:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:52.831 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":173,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:37:52.356638+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:37:50.684543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-27T14:37:51.340294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:37:52.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac005f9f0 msgr2=0x7f4ac0061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac005f9f0 0x7f4ac0061eb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f4ac4006b80 tx=0x7f4ac4015000).stop 2023-07-27T14:37:52.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad40aaa40 msgr2=0x7f4ad413b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:52.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad40aaa40 0x7f4ad413b2e0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f4ac800b490 tx=0x7f4ac8009060).stop 2023-07-27T14:37:52.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 shutdown_connections 2023-07-27T14:37:52.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ac005f9f0 0x7f4ac0061eb0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ad4153ec0 0x7f4ad4167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ad40aa050 0x7f4ad41542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 --2- 172.21.15.115:0/3579318429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad40aaa40 0x7f4ad413b2e0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:52.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.781+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 >> 172.21.15.115:0/3579318429 conn(0x7f4ad40cb610 msgr2=0x7f4ad40640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:52.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.782+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 shutdown_connections 2023-07-27T14:37:52.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.782+0000 7f4ad93ff700 1 -- 172.21.15.115:0/3579318429 wait complete. 2023-07-27T14:37:52.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:37:53.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.988+0000 7f9c2d9ff700 1 Processor -- start 2023-07-27T14:37:53.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.988+0000 7f9c2d9ff700 1 -- start start 2023-07-27T14:37:53.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.989+0000 7f9c2d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c28153ec0 0x7f9c280a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.989+0000 7f9c2d9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c280aa4d0 con 0x7f9c280aaa40 2023-07-27T14:37:53.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.989+0000 7f9c2d9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c280c05c0 con 0x7f9c280aa050 2023-07-27T14:37:53.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.989+0000 7f9c2d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280bfc90 con 0x7f9c28153ec0 2023-07-27T14:37:53.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.990+0000 7f9c277fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9c280aaa40 0x7f9c280c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41624/0 (socket says 172.21.15.115:41624) 2023-07-27T14:37:53.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.990+0000 7f9c277fe700 1 -- 172.21.15.115:0/3313027242 learned_addr learned my addr 172.21.15.115:0/3313027242 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:53.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.990+0000 7f9c26ffd700 1 --2- 172.21.15.115:0/3313027242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c28153ec0 0x7f9c280a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.990+0000 7f9c25ffb700 1 -- 172.21.15.115:0/3313027242 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494335271 0 0) 0x7f9c280c05c0 con 0x7f9c280aa050 2023-07-27T14:37:53.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.990+0000 7f9c25ffb700 1 -- 172.21.15.115:0/3313027242 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c100033f0 con 0x7f9c280aa050 2023-07-27T14:37:53.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c25ffb700 1 -- 172.21.15.115:0/3313027242 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107075349 0 0) 0x7f9c20001490 con 0x7f9c280aaa40 2023-07-27T14:37:53.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c25ffb700 1 -- 172.21.15.115:0/3313027242 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c280c05c0 con 0x7f9c280aaa40 2023-07-27T14:37:53.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c26ffd700 1 -- 172.21.15.115:0/3313027242 >> v1:172.21.15.159:6789/0 conn(0x7f9c280aa050 legacy=0x7f9c280640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c26ffd700 1 -- 172.21.15.115:0/3313027242 >> v1:172.21.15.115:6789/0 conn(0x7f9c280aaa40 legacy=0x7f9c280c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c26ffd700 1 -- 172.21.15.115:0/3313027242 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280bff70 con 0x7f9c28153ec0 2023-07-27T14:37:53.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c26ffd700 1 --2- 172.21.15.115:0/3313027242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c28153ec0 0x7f9c280a9b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f9c18009790 tx=0x7f9c18009060).ready entity=mon.2 client_cookie=5f6557a9ef28bd97 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:53.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c25ffb700 1 -- 172.21.15.115:0/3313027242 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800f510 con 0x7f9c28153ec0 2023-07-27T14:37:53.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c25ffb700 1 -- 172.21.15.115:0/3313027242 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1800f670 con 0x7f9c28153ec0 2023-07-27T14:37:53.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.991+0000 7f9c25ffb700 1 -- 172.21.15.115:0/3313027242 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800f9f0 con 0x7f9c28153ec0 2023-07-27T14:37:53.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.992+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/3313027242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c28153ec0 msgr2=0x7f9c280a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.992+0000 7f9c2d9ff700 1 --2- 172.21.15.115:0/3313027242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c28153ec0 0x7f9c280a9b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f9c18009790 tx=0x7f9c18009060).stop 2023-07-27T14:37:53.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.992+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/3313027242 shutdown_connections 2023-07-27T14:37:53.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.992+0000 7f9c2d9ff700 1 --2- 172.21.15.115:0/3313027242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c28153ec0 0x7f9c280a9b60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.992+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/3313027242 >> 172.21.15.115:0/3313027242 conn(0x7f9c280cb610 msgr2=0x7f9c280c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:53.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.992+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/3313027242 shutdown_connections 2023-07-27T14:37:53.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.992+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/3313027242 wait complete. 2023-07-27T14:37:53.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.993+0000 7f9c2d9ff700 1 Processor -- start 2023-07-27T14:37:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.993+0000 7f9c2d9ff700 1 -- start start 2023-07-27T14:37:53.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.994+0000 7f9c2d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c280aa050 0x7f9c2813b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.994+0000 7f9c2d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c280aaa40 0x7f9c28167c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.994+0000 7f9c2d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c28153ec0 0x7f9c28168100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.994+0000 7f9c2d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c281685f0 con 0x7f9c28153ec0 2023-07-27T14:37:53.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.994+0000 7f9c2d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28152c70 con 0x7f9c280aa050 2023-07-27T14:37:53.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.994+0000 7f9c2d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2813b7d0 con 0x7f9c280aaa40 2023-07-27T14:37:53.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.994+0000 7f9c277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c28153ec0 0x7f9c28168100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c28153ec0 0x7f9c28168100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33066/0 (socket says 172.21.15.115:33066) 2023-07-27T14:37:53.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c277fe700 1 -- 172.21.15.115:0/2787975997 learned_addr learned my addr 172.21.15.115:0/2787975997 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:53.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c26ffd700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c280aa050 0x7f9c2813b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c267fc700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c280aaa40 0x7f9c28167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c277fe700 1 -- 172.21.15.115:0/2787975997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c280aaa40 msgr2=0x7f9c28167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c277fe700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c280aaa40 0x7f9c28167c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c277fe700 1 -- 172.21.15.115:0/2787975997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c280aa050 msgr2=0x7f9c2813b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c277fe700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c280aa050 0x7f9c2813b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c277fe700 1 -- 172.21.15.115:0/2787975997 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180092a0 con 0x7f9c28153ec0 2023-07-27T14:37:53.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c277fe700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c28153ec0 0x7f9c28168100 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f9c20002250 tx=0x7f9c20007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:53.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c0effd700 1 -- 172.21.15.115:0/2787975997 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20005d30 con 0x7f9c28153ec0 2023-07-27T14:37:53.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c0effd700 1 -- 172.21.15.115:0/2787975997 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c20005e90 con 0x7f9c28153ec0 2023-07-27T14:37:53.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c0effd700 1 -- 172.21.15.115:0/2787975997 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c200072e0 con 0x7f9c28153ec0 2023-07-27T14:37:53.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.995+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c28152060 con 0x7f9c28153ec0 2023-07-27T14:37:53.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.996+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c28152620 con 0x7f9c28153ec0 2023-07-27T14:37:53.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.997+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c28152e00 con 0x7f9c28153ec0 2023-07-27T14:37:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.998+0000 7f9c0effd700 1 -- 172.21.15.115:0/2787975997 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f9c20010070 con 0x7f9c28153ec0 2023-07-27T14:37:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.998+0000 7f9c0effd700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c1405fa20 0x7f9c14061ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.998+0000 7f9c0effd700 1 -- 172.21.15.115:0/2787975997 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9c2007a580 con 0x7f9c28153ec0 2023-07-27T14:37:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.999+0000 7f9c26ffd700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c1405fa20 0x7f9c14061ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:52.999+0000 7f9c26ffd700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c1405fa20 0x7f9c14061ee0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f9c18009fd0 tx=0x7f9c18017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:53.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.003+0000 7f9c0effd700 1 -- 172.21.15.115:0/2787975997 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c2004e8f0 con 0x7f9c28153ec0 2023-07-27T14:37:53.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.172+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c280aa4d0 con 0x7f9c28153ec0 2023-07-27T14:37:53.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.173+0000 7f9c0effd700 1 -- 172.21.15.115:0/2787975997 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+17099 (secure 0 0 0) 0x7f9c280aa4d0 con 0x7f9c28153ec0 2023-07-27T14:37:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:53.224 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":173,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:37:52.356638+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:37:50.684543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-27T14:37:51.340294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:37:53.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c1405fa20 msgr2=0x7f9c14061ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c1405fa20 0x7f9c14061ee0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f9c18009fd0 tx=0x7f9c18017000).stop 2023-07-27T14:37:53.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c28153ec0 msgr2=0x7f9c28168100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c28153ec0 0x7f9c28168100 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f9c20002250 tx=0x7f9c20007dd0).stop 2023-07-27T14:37:53.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 shutdown_connections 2023-07-27T14:37:53.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c1405fa20 0x7f9c14061ee0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c28153ec0 0x7f9c28168100 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c280aa050 0x7f9c2813b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 --2- 172.21.15.115:0/2787975997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c280aaa40 0x7f9c28167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 >> 172.21.15.115:0/2787975997 conn(0x7f9c280cb610 msgr2=0x7f9c280afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:53.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 shutdown_connections 2023-07-27T14:37:53.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.175+0000 7f9c2d9ff700 1 -- 172.21.15.115:0/2787975997 wait complete. 2023-07-27T14:37:53.244 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:37:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.386+0000 7f19729ff700 1 Processor -- start 2023-07-27T14:37:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.386+0000 7f19729ff700 1 -- start start 2023-07-27T14:37:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f19729ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f196c063260 0x7f196c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f19729ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c14b1e0 0x7f196c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f19729ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c1553f0 con 0x7f196c14ae00 2023-07-27T14:37:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f19729ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c157a50 con 0x7f196c063260 2023-07-27T14:37:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f19729ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c157d10 con 0x7f196c14b1e0 2023-07-27T14:37:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f196b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f196c063260 0x7f196c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f196b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f196c063260 0x7f196c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33072/0 (socket says 172.21.15.115:33072) 2023-07-27T14:37:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f196b7fe700 1 -- 172.21.15.115:0/3498045044 learned_addr learned my addr 172.21.15.115:0/3498045044 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:53.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f1970f9c700 1 --2- 172.21.15.115:0/3498045044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c14b1e0 0x7f196c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f196b7fe700 1 -- 172.21.15.115:0/3498045044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c14b1e0 msgr2=0x7f196c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:53.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f196b7fe700 1 --2- 172.21.15.115:0/3498045044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c14b1e0 0x7f196c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f196b7fe700 1 -- 172.21.15.115:0/3498045044 >> v1:172.21.15.159:6789/0 conn(0x7f196c14ae00 legacy=0x7f196c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f196b7fe700 1 -- 172.21.15.115:0/3498045044 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c157ff0 con 0x7f196c063260 2023-07-27T14:37:53.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.388+0000 7f196b7fe700 1 --2- 172.21.15.115:0/3498045044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c063260 0x7f196c154f00 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f1960006fd0 tx=0x7f19600090f0).ready entity=mon.0 client_cookie=9fb52c52600f76b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:53.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f196affd700 1 -- 172.21.15.115:0/3498045044 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196000b600 con 0x7f196c063260 2023-07-27T14:37:53.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f196affd700 1 -- 172.21.15.115:0/3498045044 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196000b760 con 0x7f196c063260 2023-07-27T14:37:53.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f196affd700 1 -- 172.21.15.115:0/3498045044 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196000bae0 con 0x7f196c063260 2023-07-27T14:37:53.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f19729ff700 1 -- 172.21.15.115:0/3498045044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c063260 msgr2=0x7f196c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f19729ff700 1 --2- 172.21.15.115:0/3498045044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c063260 0x7f196c154f00 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f1960006fd0 tx=0x7f19600090f0).stop 2023-07-27T14:37:53.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f19729ff700 1 -- 172.21.15.115:0/3498045044 shutdown_connections 2023-07-27T14:37:53.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f19729ff700 1 --2- 172.21.15.115:0/3498045044 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c14b1e0 0x7f196c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f19729ff700 1 --2- 172.21.15.115:0/3498045044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c063260 0x7f196c154f00 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f19729ff700 1 -- 172.21.15.115:0/3498045044 >> 172.21.15.115:0/3498045044 conn(0x7f196c05e940 msgr2=0x7f196c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:53.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f19729ff700 1 -- 172.21.15.115:0/3498045044 shutdown_connections 2023-07-27T14:37:53.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.389+0000 7f19729ff700 1 -- 172.21.15.115:0/3498045044 wait complete. 2023-07-27T14:37:53.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.391+0000 7f19729ff700 1 Processor -- start 2023-07-27T14:37:53.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.391+0000 7f19729ff700 1 -- start start 2023-07-27T14:37:53.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f19729ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c063260 0x7f196c164390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f19729ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c14ae00 0x7f196c0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f19729ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c14b1e0 0x7f196c168320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f19729ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0c3ec0 con 0x7f196c14ae00 2023-07-27T14:37:53.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f19729ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0ae2c0 con 0x7f196c14b1e0 2023-07-27T14:37:53.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f19729ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c168810 con 0x7f196c063260 2023-07-27T14:37:53.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f196b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c14ae00 0x7f196c0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f196b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c14ae00 0x7f196c0c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33082/0 (socket says 172.21.15.115:33082) 2023-07-27T14:37:53.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f196b7fe700 1 -- 172.21.15.115:0/1810868544 learned_addr learned my addr 172.21.15.115:0/1810868544 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:53.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f196bfff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c063260 0x7f196c164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.392+0000 7f1970f9c700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c14b1e0 0x7f196c168320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f196b7fe700 1 -- 172.21.15.115:0/1810868544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c063260 msgr2=0x7f196c164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f196b7fe700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c063260 0x7f196c164390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f196b7fe700 1 -- 172.21.15.115:0/1810868544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c14b1e0 msgr2=0x7f196c168320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:53.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f196b7fe700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c14b1e0 0x7f196c168320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:53.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f196b7fe700 1 -- 172.21.15.115:0/1810868544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1960009370 con 0x7f196c14ae00 2023-07-27T14:37:53.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f196b7fe700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c14ae00 0x7f196c0c39d0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f1960011000 tx=0x7f1960017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:53.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f1953fff700 1 -- 172.21.15.115:0/1810868544 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196000bea0 con 0x7f196c14ae00 2023-07-27T14:37:53.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f1953fff700 1 -- 172.21.15.115:0/1810868544 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196000b8d0 con 0x7f196c14ae00 2023-07-27T14:37:53.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c0c40d0 con 0x7f196c14ae00 2023-07-27T14:37:53.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f1953fff700 1 -- 172.21.15.115:0/1810868544 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196001b660 con 0x7f196c14ae00 2023-07-27T14:37:53.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.393+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c0c4690 con 0x7f196c14ae00 2023-07-27T14:37:53.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.394+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c06c470 con 0x7f196c14ae00 2023-07-27T14:37:53.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.395+0000 7f1953fff700 1 -- 172.21.15.115:0/1810868544 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f196000f070 con 0x7f196c14ae00 2023-07-27T14:37:53.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.396+0000 7f1953fff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195805f9f0 0x7f1958061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:53.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.396+0000 7f1953fff700 1 -- 172.21.15.115:0/1810868544 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f196007cac0 con 0x7f196c14ae00 2023-07-27T14:37:53.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.396+0000 7f196bfff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195805f9f0 0x7f1958061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:53.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.397+0000 7f196bfff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195805f9f0 0x7f1958061eb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f195c003900 tx=0x7f195c007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:53.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.400+0000 7f1953fff700 1 -- 172.21.15.115:0/1810868544 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f196004cac0 con 0x7f196c14ae00 2023-07-27T14:37:53.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:53.618+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f196c0ae400 con 0x7f196c14ae00 2023-07-27T14:37:54.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.374+0000 7f1953fff700 1 -- 172.21.15.115:0/1810868544 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) v1 ==== 118+0+0 (secure 0 0 0) 0x7f196001f030 con 0x7f196c14ae00 2023-07-27T14:37:54.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195805f9f0 msgr2=0x7f1958061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195805f9f0 0x7f1958061eb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f195c003900 tx=0x7f195c007d40).stop 2023-07-27T14:37:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c14ae00 msgr2=0x7f196c0c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c14ae00 0x7f196c0c39d0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f1960011000 tx=0x7f1960017000).stop 2023-07-27T14:37:54.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 shutdown_connections 2023-07-27T14:37:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f195805f9f0 0x7f1958061eb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f196c14b1e0 0x7f196c168320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f196c063260 0x7f196c164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 --2- 172.21.15.115:0/1810868544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f196c14ae00 0x7f196c0c39d0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.376+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 >> 172.21.15.115:0/1810868544 conn(0x7f196c05e940 msgr2=0x7f196c0c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.377+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 shutdown_connections 2023-07-27T14:37:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.377+0000 7f19729ff700 1 -- 172.21.15.115:0/1810868544 wait complete. 2023-07-27T14:37:54.447 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:37:54.448 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:37:54.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.591+0000 7fb1763ff700 1 Processor -- start 2023-07-27T14:37:54.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.591+0000 7fb1763ff700 1 -- start start 2023-07-27T14:37:54.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb1763ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1700c6b70 0x7fb1700656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:54.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb1763ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb170066050 con 0x7fb170065bc0 2023-07-27T14:37:54.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb1763ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb170064a80 con 0x7fb170153e00 2023-07-27T14:37:54.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb1763ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb170062320 con 0x7fb1700c6b70 2023-07-27T14:37:54.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb16f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1700c6b70 0x7fb1700656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:54.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb17499c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb170065bc0 0x7fb170062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42090/0 (socket says 172.21.15.115:42090) 2023-07-27T14:37:54.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb17499c700 1 -- 172.21.15.115:0/1563337697 learned_addr learned my addr 172.21.15.115:0/1563337697 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:54.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb16effd700 1 -- 172.21.15.115:0/1563337697 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567131764 0 0) 0x7fb170066050 con 0x7fb170065bc0 2023-07-27T14:37:54.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb16effd700 1 -- 172.21.15.115:0/1563337697 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1580033f0 con 0x7fb170065bc0 2023-07-27T14:37:54.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb16f7fe700 1 -- 172.21.15.115:0/1563337697 >> v1:172.21.15.159:6789/0 conn(0x7fb170153e00 legacy=0x7fb170064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:54.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb16f7fe700 1 -- 172.21.15.115:0/1563337697 >> v1:172.21.15.115:6789/0 conn(0x7fb170065bc0 legacy=0x7fb170062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:54.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.593+0000 7fb16f7fe700 1 -- 172.21.15.115:0/1563337697 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170064d60 con 0x7fb1700c6b70 2023-07-27T14:37:54.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb16f7fe700 1 --2- 172.21.15.115:0/1563337697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1700c6b70 0x7fb1700656d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fb164009760 tx=0x7fb164009060).ready entity=mon.0 client_cookie=c2c181195102747c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:54.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb16effd700 1 -- 172.21.15.115:0/1563337697 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400f510 con 0x7fb1700c6b70 2023-07-27T14:37:54.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb16effd700 1 -- 172.21.15.115:0/1563337697 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16400f670 con 0x7fb1700c6b70 2023-07-27T14:37:54.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb16effd700 1 -- 172.21.15.115:0/1563337697 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400f9f0 con 0x7fb1700c6b70 2023-07-27T14:37:54.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb1763ff700 1 -- 172.21.15.115:0/1563337697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1700c6b70 msgr2=0x7fb1700656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:54.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb1763ff700 1 --2- 172.21.15.115:0/1563337697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1700c6b70 0x7fb1700656d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7fb164009760 tx=0x7fb164009060).stop 2023-07-27T14:37:54.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb1763ff700 1 -- 172.21.15.115:0/1563337697 shutdown_connections 2023-07-27T14:37:54.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb1763ff700 1 --2- 172.21.15.115:0/1563337697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1700c6b70 0x7fb1700656d0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:54.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.594+0000 7fb1763ff700 1 -- 172.21.15.115:0/1563337697 >> 172.21.15.115:0/1563337697 conn(0x7fb1700c7b90 msgr2=0x7fb1700c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:54.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.595+0000 7fb1763ff700 1 -- 172.21.15.115:0/1563337697 shutdown_connections 2023-07-27T14:37:54.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.595+0000 7fb1763ff700 1 -- 172.21.15.115:0/1563337697 wait complete. 2023-07-27T14:37:54.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.597+0000 7fb1763ff700 1 Processor -- start 2023-07-27T14:37:54.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.597+0000 7fb1763ff700 1 -- start start 2023-07-27T14:37:54.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb1763ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb170065bc0 0x7fb1700a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:54.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb1763ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1700c6b70 0x7fb170145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:54.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb1763ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb170153e00 0x7fb1700a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:54.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb1763ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700a9be0 con 0x7fb170153e00 2023-07-27T14:37:54.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb1763ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700abbb0 con 0x7fb1700c6b70 2023-07-27T14:37:54.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb1763ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700aa680 con 0x7fb170065bc0 2023-07-27T14:37:54.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb17499c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb170153e00 0x7fb1700a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:54.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb17499c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb170153e00 0x7fb1700a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43454/0 (socket says 172.21.15.115:43454) 2023-07-27T14:37:54.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb17499c700 1 -- 172.21.15.115:0/4143929803 learned_addr learned my addr 172.21.15.115:0/4143929803 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:54.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb16f7fe700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1700c6b70 0x7fb170145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:54.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.598+0000 7fb16ffff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb170065bc0 0x7fb1700a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:54.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb17499c700 1 -- 172.21.15.115:0/4143929803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb170065bc0 msgr2=0x7fb1700a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:54.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb17499c700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb170065bc0 0x7fb1700a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:54.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb17499c700 1 -- 172.21.15.115:0/4143929803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1700c6b70 msgr2=0x7fb170145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:54.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb17499c700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1700c6b70 0x7fb170145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:54.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb17499c700 1 -- 172.21.15.115:0/4143929803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640092a0 con 0x7fb170153e00 2023-07-27T14:37:54.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb17499c700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb170153e00 0x7fb1700a6bf0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fb168005ad0 tx=0x7fb168001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:54.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb157fff700 1 -- 172.21.15.115:0/4143929803 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168005d30 con 0x7fb170153e00 2023-07-27T14:37:54.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb157fff700 1 -- 172.21.15.115:0/4143929803 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168005e90 con 0x7fb170153e00 2023-07-27T14:37:54.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1700aa0c0 con 0x7fb170153e00 2023-07-27T14:37:54.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb157fff700 1 -- 172.21.15.115:0/4143929803 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168007320 con 0x7fb170153e00 2023-07-27T14:37:54.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.599+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1700abdc0 con 0x7fb170153e00 2023-07-27T14:37:54.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.600+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1700ac590 con 0x7fb170153e00 2023-07-27T14:37:54.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.601+0000 7fb157fff700 1 -- 172.21.15.115:0/4143929803 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fb168010030 con 0x7fb170153e00 2023-07-27T14:37:54.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.602+0000 7fb157fff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15c05f9f0 0x7fb15c061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:54.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.602+0000 7fb157fff700 1 -- 172.21.15.115:0/4143929803 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb16807adc0 con 0x7fb170153e00 2023-07-27T14:37:54.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.602+0000 7fb16ffff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15c05f9f0 0x7fb15c061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:54.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.602+0000 7fb16ffff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15c05f9f0 0x7fb15c061eb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fb160003860 tx=0x7fb160007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:54.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.606+0000 7fb157fff700 1 -- 172.21.15.115:0/4143929803 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb16804b6a0 con 0x7fb170153e00 2023-07-27T14:37:54.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:54.818+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb17006c470 con 0x7fb170153e00 2023-07-27T14:37:55.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.381+0000 7fb157fff700 1 -- 172.21.15.115:0/4143929803 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb16804ecc0 con 0x7fb170153e00 2023-07-27T14:37:55.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15c05f9f0 msgr2=0x7fb15c061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:55.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15c05f9f0 0x7fb15c061eb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fb160003860 tx=0x7fb160007d40).stop 2023-07-27T14:37:55.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb170153e00 msgr2=0x7fb1700a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:55.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb170153e00 0x7fb1700a6bf0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7fb168005ad0 tx=0x7fb168001650).stop 2023-07-27T14:37:55.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 shutdown_connections 2023-07-27T14:37:55.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb15c05f9f0 0x7fb15c061eb0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb170153e00 0x7fb1700a6bf0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb170065bc0 0x7fb1700a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 --2- 172.21.15.115:0/4143929803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb1700c6b70 0x7fb170145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 >> 172.21.15.115:0/4143929803 conn(0x7fb1700c7b90 msgr2=0x7fb1701521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:55.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 shutdown_connections 2023-07-27T14:37:55.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.384+0000 7fb1763ff700 1 -- 172.21.15.115:0/4143929803 wait complete. 2023-07-27T14:37:55.454 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:37:55.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:37:55.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.594+0000 7f20aa1ff700 1 Processor -- start 2023-07-27T14:37:55.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.594+0000 7f20aa1ff700 1 -- start start 2023-07-27T14:37:55.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.595+0000 7f20aa1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20a4151bd0 0x7f20a4062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:55.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.595+0000 7f20aa1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f20a40a4f50 0x7f20a40bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:55.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.595+0000 7f20aa1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a40639d0 con 0x7f20a4062810 2023-07-27T14:37:55.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.595+0000 7f20aa1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a4137610 con 0x7f20a4151bd0 2023-07-27T14:37:55.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.595+0000 7f20aa1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a4062dc0 con 0x7f20a40a4f50 2023-07-27T14:37:55.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.595+0000 7f20a37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20a4151bd0 0x7f20a4062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:55.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f20a4151bd0 0x7f20a4062320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43456/0 (socket says 172.21.15.115:43456) 2023-07-27T14:37:55.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a37fe700 1 -- 172.21.15.115:0/3351326784 learned_addr learned my addr 172.21.15.115:0/3351326784 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:55.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a3fff700 1 --2- 172.21.15.115:0/3351326784 >> v2:172.21.15.159:3300/0 conn(0x7f20a40a4f50 0x7f20a40bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:55.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a37fe700 1 -- 172.21.15.115:0/3351326784 >> v2:172.21.15.159:3300/0 conn(0x7f20a40a4f50 msgr2=0x7f20a40bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:55.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a37fe700 1 --2- 172.21.15.115:0/3351326784 >> v2:172.21.15.159:3300/0 conn(0x7f20a40a4f50 0x7f20a40bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a37fe700 1 -- 172.21.15.115:0/3351326784 >> v1:172.21.15.115:6789/0 conn(0x7f20a4062810 legacy=0x7f20a40a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:55.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a37fe700 1 -- 172.21.15.115:0/3351326784 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40630a0 con 0x7f20a4151bd0 2023-07-27T14:37:55.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a27fc700 1 -- 172.21.15.115:0/3351326784 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470391918 0 0) 0x7f20a40639d0 con 0x7f20a4062810 2023-07-27T14:37:55.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a3fff700 1 --2- 172.21.15.115:0/3351326784 >> v2:172.21.15.159:3300/0 conn(0x7f20a40a4f50 0x7f20a40bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:55.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a37fe700 1 --2- 172.21.15.115:0/3351326784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a4151bd0 0x7f20a4062320 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f20a40a9df0 tx=0x7f20940090f0).ready entity=mon.0 client_cookie=f93d71aafcf12e39 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:55.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a27fc700 1 -- 172.21.15.115:0/3351326784 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209400b600 con 0x7f20a4151bd0 2023-07-27T14:37:55.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a27fc700 1 -- 172.21.15.115:0/3351326784 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209400b760 con 0x7f20a4151bd0 2023-07-27T14:37:55.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.596+0000 7f20a27fc700 1 -- 172.21.15.115:0/3351326784 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209400bae0 con 0x7f20a4151bd0 2023-07-27T14:37:55.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.597+0000 7f20aa1ff700 1 -- 172.21.15.115:0/3351326784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a4151bd0 msgr2=0x7f20a4062320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:55.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.597+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/3351326784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a4151bd0 0x7f20a4062320 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f20a40a9df0 tx=0x7f20940090f0).stop 2023-07-27T14:37:55.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.597+0000 7f20aa1ff700 1 -- 172.21.15.115:0/3351326784 shutdown_connections 2023-07-27T14:37:55.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.597+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/3351326784 >> v2:172.21.15.159:3300/0 conn(0x7f20a40a4f50 0x7f20a40bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.597+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/3351326784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a4151bd0 0x7f20a4062320 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.597+0000 7f20aa1ff700 1 -- 172.21.15.115:0/3351326784 >> 172.21.15.115:0/3351326784 conn(0x7f20a4064700 msgr2=0x7f20a4064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:55.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.597+0000 7f20aa1ff700 1 -- 172.21.15.115:0/3351326784 shutdown_connections 2023-07-27T14:37:55.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.597+0000 7f20aa1ff700 1 -- 172.21.15.115:0/3351326784 wait complete. 2023-07-27T14:37:55.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.598+0000 7f20aa1ff700 1 Processor -- start 2023-07-27T14:37:55.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.599+0000 7f20aa1ff700 1 -- start start 2023-07-27T14:37:55.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.599+0000 7f20aa1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20a4062810 0x7f20a4163f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:55.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.599+0000 7f20aa1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a40a4f50 0x7f20a40aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:55.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.599+0000 7f20aa1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a4151bd0 0x7f20a40aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:55.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.599+0000 7f20aa1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40aaa80 con 0x7f20a40a4f50 2023-07-27T14:37:55.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.599+0000 7f20aa1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a4164430 con 0x7f20a4151bd0 2023-07-27T14:37:55.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.599+0000 7f20aa1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a4153d10 con 0x7f20a4062810 2023-07-27T14:37:55.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a40a4f50 0x7f20a40aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:55.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a40a4f50 0x7f20a40aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43462/0 (socket says 172.21.15.115:43462) 2023-07-27T14:37:55.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 -- 172.21.15.115:0/1775303303 learned_addr learned my addr 172.21.15.115:0/1775303303 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:55.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a3fff700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a4151bd0 0x7f20a40aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:55.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a37fe700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20a4062810 0x7f20a4163f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:55.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 -- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20a4062810 msgr2=0x7f20a4163f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:55.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20a4062810 0x7f20a4163f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 -- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a4151bd0 msgr2=0x7f20a40aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:55.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a4151bd0 0x7f20a40aa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 -- 172.21.15.115:0/1775303303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2094009370 con 0x7f20a40a4f50 2023-07-27T14:37:55.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a3fff700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a4151bd0 0x7f20a40aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:55.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.600+0000 7f20a2ffd700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a40a4f50 0x7f20a40aa0a0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f209800c440 tx=0x7f2098007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:55.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.601+0000 7f208b7fe700 1 -- 172.21.15.115:0/1775303303 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098007020 con 0x7f20a40a4f50 2023-07-27T14:37:55.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.601+0000 7f208b7fe700 1 -- 172.21.15.115:0/1775303303 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20980071a0 con 0x7f20a40a4f50 2023-07-27T14:37:55.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.601+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a4153ff0 con 0x7f20a40a4f50 2023-07-27T14:37:55.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.601+0000 7f208b7fe700 1 -- 172.21.15.115:0/1775303303 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098007560 con 0x7f20a40a4f50 2023-07-27T14:37:55.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.601+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a41545b0 con 0x7f20a40a4f50 2023-07-27T14:37:55.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.602+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a413b850 con 0x7f20a40a4f50 2023-07-27T14:37:55.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.603+0000 7f208b7fe700 1 -- 172.21.15.115:0/1775303303 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f2098010070 con 0x7f20a40a4f50 2023-07-27T14:37:55.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.603+0000 7f208b7fe700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f209005f9f0 0x7f2090061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:55.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.603+0000 7f208b7fe700 1 -- 172.21.15.115:0/1775303303 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f209807a180 con 0x7f20a40a4f50 2023-07-27T14:37:55.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.604+0000 7f20a37fe700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f209005f9f0 0x7f2090061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:55.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.604+0000 7f20a37fe700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f209005f9f0 0x7f2090061eb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f2094009fd0 tx=0x7f2094017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:55.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.608+0000 7f208b7fe700 1 -- 172.21.15.115:0/1775303303 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20980478f0 con 0x7f20a40a4f50 2023-07-27T14:37:55.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.818+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20a41548e0 con 0x7f20a40a4f50 2023-07-27T14:37:55.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.819+0000 7f208b7fe700 1 -- 172.21.15.115:0/1775303303 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f209804aac0 con 0x7f20a40a4f50 2023-07-27T14:37:55.870 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:55.870 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3836371},{"type":"v1","addr":"172.21.15.159:6833","nonce":3836371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1315171707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1315171707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1315171707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1825044502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1825044502},{"type":"v1","addr":"172.21.15.159:6835","nonce":1825044502}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:37:52.356956+0000","modified":"2023-07-27T14:37:55.374238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9222":{"gid":9222,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/991393631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":991393631},{"type":"v1","addr":"172.21.15.115:6836","nonce":991393631}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-07-27T14:37:55.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f209005f9f0 msgr2=0x7f2090061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:55.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f209005f9f0 0x7f2090061eb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f2094009fd0 tx=0x7f2094017000).stop 2023-07-27T14:37:55.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a40a4f50 msgr2=0x7f20a40aa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:55.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a40a4f50 0x7f20a40aa0a0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7f209800c440 tx=0x7f2098007e00).stop 2023-07-27T14:37:55.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 shutdown_connections 2023-07-27T14:37:55.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f209005f9f0 0x7f2090061eb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20a4151bd0 0x7f20a40aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20a4062810 0x7f20a4163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 --2- 172.21.15.115:0/1775303303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a40a4f50 0x7f20a40aa0a0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:55.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 >> 172.21.15.115:0/1775303303 conn(0x7f20a4064700 msgr2=0x7f20a4139770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:55.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 shutdown_connections 2023-07-27T14:37:55.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:55.821+0000 7f20aa1ff700 1 -- 172.21.15.115:0/1775303303 wait complete. 2023-07-27T14:37:55.874 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 93 2023-07-27T14:37:55.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:37:56.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.026+0000 7fbda1dff700 1 Processor -- start 2023-07-27T14:37:56.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.026+0000 7fbda1dff700 1 -- start start 2023-07-27T14:37:56.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.027+0000 7fbda1dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbd9c153ec0 0x7fbd9c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbda1dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c0aa4d0 con 0x7fbd9c0aaa40 2023-07-27T14:37:56.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbda1dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c0c05c0 con 0x7fbd9c0aa050 2023-07-27T14:37:56.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbda1dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9c0bfc90 con 0x7fbd9c153ec0 2023-07-27T14:37:56.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbd9b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbd9c153ec0 0x7fbd9c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbd9b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbd9c153ec0 0x7fbd9c0a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43466/0 (socket says 172.21.15.115:43466) 2023-07-27T14:37:56.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbd9b7fe700 1 -- 172.21.15.115:0/1019868546 learned_addr learned my addr 172.21.15.115:0/1019868546 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:56.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbd9bfff700 1 --1- 172.21.15.115:0/1019868546 >> v1:172.21.15.115:6789/0 conn(0x7fbd9c0aaa40 0x7fbd9c0c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42114/0 (socket says 172.21.15.115:42114) 2023-07-27T14:37:56.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbd9b7fe700 1 -- 172.21.15.115:0/1019868546 >> v1:172.21.15.159:6789/0 conn(0x7fbd9c0aa050 legacy=0x7fbd9c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:56.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbd9b7fe700 1 -- 172.21.15.115:0/1019868546 >> v1:172.21.15.115:6789/0 conn(0x7fbd9c0aaa40 legacy=0x7fbd9c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbd9b7fe700 1 -- 172.21.15.115:0/1019868546 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0bff70 con 0x7fbd9c153ec0 2023-07-27T14:37:56.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.028+0000 7fbd9b7fe700 1 --2- 172.21.15.115:0/1019868546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c153ec0 0x7fbd9c0a9b60 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fbd8c006fd0 tx=0x7fbd8c0090f0).ready entity=mon.0 client_cookie=76c382ece084e193 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbd9affd700 1 -- 172.21.15.115:0/1019868546 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00b600 con 0x7fbd9c153ec0 2023-07-27T14:37:56.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbd9affd700 1 -- 172.21.15.115:0/1019868546 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c00b760 con 0x7fbd9c153ec0 2023-07-27T14:37:56.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbd9affd700 1 -- 172.21.15.115:0/1019868546 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00bae0 con 0x7fbd9c153ec0 2023-07-27T14:37:56.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbda1dff700 1 -- 172.21.15.115:0/1019868546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c153ec0 msgr2=0x7fbd9c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbda1dff700 1 --2- 172.21.15.115:0/1019868546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c153ec0 0x7fbd9c0a9b60 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fbd8c006fd0 tx=0x7fbd8c0090f0).stop 2023-07-27T14:37:56.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbda1dff700 1 -- 172.21.15.115:0/1019868546 shutdown_connections 2023-07-27T14:37:56.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbda1dff700 1 --2- 172.21.15.115:0/1019868546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c153ec0 0x7fbd9c0a9b60 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbda1dff700 1 -- 172.21.15.115:0/1019868546 >> 172.21.15.115:0/1019868546 conn(0x7fbd9c0cb610 msgr2=0x7fbd9c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:56.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbda1dff700 1 -- 172.21.15.115:0/1019868546 shutdown_connections 2023-07-27T14:37:56.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.029+0000 7fbda1dff700 1 -- 172.21.15.115:0/1019868546 wait complete. 2023-07-27T14:37:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.031+0000 7fbda1dff700 1 Processor -- start 2023-07-27T14:37:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.031+0000 7fbda1dff700 1 -- start start 2023-07-27T14:37:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbda1dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c0aa050 0x7fbd9c152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbda1dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd9c0aaa40 0x7fbd9c14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbda1dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9c153ec0 0x7fbd9c164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbda1dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0c3150 con 0x7fbd9c0aa050 2023-07-27T14:37:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbda1dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0c3430 con 0x7fbd9c153ec0 2023-07-27T14:37:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbda1dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c164cd0 con 0x7fbd9c0aaa40 2023-07-27T14:37:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c0aa050 0x7fbd9c152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c0aa050 0x7fbd9c152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43468/0 (socket says 172.21.15.115:43468) 2023-07-27T14:37:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9b7fe700 1 -- 172.21.15.115:0/1687276674 learned_addr learned my addr 172.21.15.115:0/1687276674 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9bfff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9c153ec0 0x7fbd9c164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd93fff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd9c0aaa40 0x7fbd9c14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9b7fe700 1 -- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd9c0aaa40 msgr2=0x7fbd9c14ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9b7fe700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd9c0aaa40 0x7fbd9c14ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9b7fe700 1 -- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9c153ec0 msgr2=0x7fbd9c164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9b7fe700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9c153ec0 0x7fbd9c164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd9b7fe700 1 -- 172.21.15.115:0/1687276674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c009370 con 0x7fbd9c0aa050 2023-07-27T14:37:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.032+0000 7fbd93fff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd9c0aaa40 0x7fbd9c14ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:56.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.033+0000 7fbd9b7fe700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c0aa050 0x7fbd9c152d00 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fbd8c009f50 tx=0x7fbd8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.033+0000 7fbd937fe700 1 -- 172.21.15.115:0/1687276674 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00bae0 con 0x7fbd9c0aa050 2023-07-27T14:37:56.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.033+0000 7fbd937fe700 1 -- 172.21.15.115:0/1687276674 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c000c90 con 0x7fbd9c0aa050 2023-07-27T14:37:56.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.033+0000 7fbd937fe700 1 -- 172.21.15.115:0/1687276674 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c01b660 con 0x7fbd9c0aa050 2023-07-27T14:37:56.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.033+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c164fb0 con 0x7fbd9c0aa050 2023-07-27T14:37:56.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.033+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c14cf40 con 0x7fbd9c0aa050 2023-07-27T14:37:56.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.034+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9c06c470 con 0x7fbd9c0aa050 2023-07-27T14:37:56.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.035+0000 7fbd937fe700 1 -- 172.21.15.115:0/1687276674 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fbd8c02b070 con 0x7fbd9c0aa050 2023-07-27T14:37:56.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.036+0000 7fbd937fe700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd7c05f9c0 0x7fbd7c061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.036+0000 7fbd937fe700 1 -- 172.21.15.115:0/1687276674 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbd8c07ca00 con 0x7fbd9c0aa050 2023-07-27T14:37:56.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.036+0000 7fbd93fff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd7c05f9c0 0x7fbd7c061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.036+0000 7fbd93fff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd7c05f9c0 0x7fbd7c061e80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fbd9c0af6c0 tx=0x7fbd84009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.040+0000 7fbd937fe700 1 -- 172.21.15.115:0/1687276674 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd8c04d230 con 0x7fbd9c0aa050 2023-07-27T14:37:56.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.209+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd9c0c0250 con 0x7fbd9c0aa050 2023-07-27T14:37:56.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.210+0000 7fbd937fe700 1 -- 172.21.15.115:0/1687276674 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17086 (secure 0 0 0) 0x7fbd8c01f070 con 0x7fbd9c0aa050 2023-07-27T14:37:56.262 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:56.262 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":174,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:37:53.359401+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:37:50.684543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-27T14:37:51.340294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:37:56.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd7c05f9c0 msgr2=0x7fbd7c061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd7c05f9c0 0x7fbd7c061e80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fbd9c0af6c0 tx=0x7fbd84009040).stop 2023-07-27T14:37:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c0aa050 msgr2=0x7fbd9c152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c0aa050 0x7fbd9c152d00 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fbd8c009f50 tx=0x7fbd8c017000).stop 2023-07-27T14:37:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 shutdown_connections 2023-07-27T14:37:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbd7c05f9c0 0x7fbd7c061e80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9c153ec0 0x7fbd9c164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd9c0aa050 0x7fbd9c152d00 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 --2- 172.21.15.115:0/1687276674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd9c0aaa40 0x7fbd9c14ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 >> 172.21.15.115:0/1687276674 conn(0x7fbd9c0cb610 msgr2=0x7fbd9c0c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 shutdown_connections 2023-07-27T14:37:56.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.212+0000 7fbda1dff700 1 -- 172.21.15.115:0/1687276674 wait complete. 2023-07-27T14:37:56.281 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:37:56.281 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:37:56.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.422+0000 7fda75bff700 1 Processor -- start 2023-07-27T14:37:56.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.422+0000 7fda75bff700 1 -- start start 2023-07-27T14:37:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.423+0000 7fda75bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fda70150af0 0x7fda70150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.423+0000 7fda75bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda700c0e80 0x7fda700c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.423+0000 7fda75bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7006a440 con 0x7fda700696f0 2023-07-27T14:37:56.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.423+0000 7fda75bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda700bbc80 con 0x7fda70150af0 2023-07-27T14:37:56.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.423+0000 7fda75bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda70069e80 con 0x7fda700c0e80 2023-07-27T14:37:56.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6effd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda700c0e80 0x7fda700c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6effd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda700c0e80 0x7fda700c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:33212/0 (socket says 172.21.15.115:33212) 2023-07-27T14:37:56.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6f7fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fda70150af0 0x7fda70150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6effd700 1 -- 172.21.15.115:0/3753452667 learned_addr learned my addr 172.21.15.115:0/3753452667 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:56.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6effd700 1 -- 172.21.15.115:0/3753452667 >> v2:172.21.15.159:3300/0 conn(0x7fda70150af0 msgr2=0x7fda70150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:56.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6effd700 1 --2- 172.21.15.115:0/3753452667 >> v2:172.21.15.159:3300/0 conn(0x7fda70150af0 0x7fda70150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6effd700 1 -- 172.21.15.115:0/3753452667 >> v1:172.21.15.159:6789/0 conn(0x7fda700696f0 legacy=0x7fda700a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6effd700 1 -- 172.21.15.115:0/3753452667 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7006a160 con 0x7fda700c0e80 2023-07-27T14:37:56.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6e7fc700 1 -- 172.21.15.115:0/3753452667 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47565726 0 0) 0x7fda7006a440 con 0x7fda700696f0 2023-07-27T14:37:56.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.424+0000 7fda6f7fe700 1 --2- 172.21.15.115:0/3753452667 >> v2:172.21.15.159:3300/0 conn(0x7fda70150af0 0x7fda70150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:37:56.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda6effd700 1 --2- 172.21.15.115:0/3753452667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda700c0e80 0x7fda700c3960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fda64006fd0 tx=0x7fda640090f0).ready entity=mon.2 client_cookie=4238d553b998af29 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda6e7fc700 1 -- 172.21.15.115:0/3753452667 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6400b580 con 0x7fda700c0e80 2023-07-27T14:37:56.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda6e7fc700 1 -- 172.21.15.115:0/3753452667 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6400b6e0 con 0x7fda700c0e80 2023-07-27T14:37:56.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda6e7fc700 1 -- 172.21.15.115:0/3753452667 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6400ba60 con 0x7fda700c0e80 2023-07-27T14:37:56.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda75bff700 1 -- 172.21.15.115:0/3753452667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda700c0e80 msgr2=0x7fda700c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda75bff700 1 --2- 172.21.15.115:0/3753452667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda700c0e80 0x7fda700c3960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fda64006fd0 tx=0x7fda640090f0).stop 2023-07-27T14:37:56.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda75bff700 1 -- 172.21.15.115:0/3753452667 shutdown_connections 2023-07-27T14:37:56.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda75bff700 1 --2- 172.21.15.115:0/3753452667 >> v2:172.21.15.159:3300/0 conn(0x7fda70150af0 0x7fda70150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda75bff700 1 --2- 172.21.15.115:0/3753452667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda700c0e80 0x7fda700c3960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.425+0000 7fda75bff700 1 -- 172.21.15.115:0/3753452667 >> 172.21.15.115:0/3753452667 conn(0x7fda70062320 msgr2=0x7fda70062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:56.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.426+0000 7fda75bff700 1 -- 172.21.15.115:0/3753452667 shutdown_connections 2023-07-27T14:37:56.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.426+0000 7fda75bff700 1 -- 172.21.15.115:0/3753452667 wait complete. 2023-07-27T14:37:56.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.427+0000 7fda75bff700 1 Processor -- start 2023-07-27T14:37:56.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.427+0000 7fda75bff700 1 -- start start 2023-07-27T14:37:56.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.428+0000 7fda75bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda700696f0 0x7fda7014b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.428+0000 7fda75bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda700c0e80 0x7fda700aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.428+0000 7fda75bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda70150af0 0x7fda700beb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.428+0000 7fda75bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda700bdac0 con 0x7fda700c0e80 2023-07-27T14:37:56.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.428+0000 7fda75bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda700bdda0 con 0x7fda700696f0 2023-07-27T14:37:56.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.428+0000 7fda75bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda700be080 con 0x7fda70150af0 2023-07-27T14:37:56.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.428+0000 7fda6effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda700c0e80 0x7fda700aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda700c0e80 0x7fda700aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43480/0 (socket says 172.21.15.115:43480) 2023-07-27T14:37:56.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6effd700 1 -- 172.21.15.115:0/3704576571 learned_addr learned my addr 172.21.15.115:0/3704576571 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:56.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6f7fe700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda700696f0 0x7fda7014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6ffff700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda70150af0 0x7fda700beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6f7fe700 1 -- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda70150af0 msgr2=0x7fda700beb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6f7fe700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda70150af0 0x7fda700beb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6f7fe700 1 -- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda700c0e80 msgr2=0x7fda700aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6f7fe700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda700c0e80 0x7fda700aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6f7fe700 1 -- 172.21.15.115:0/3704576571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600092a0 con 0x7fda700696f0 2023-07-27T14:37:56.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6effd700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda700c0e80 0x7fda700aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:37:56.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda6f7fe700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda700696f0 0x7fda7014b940 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fda6000e880 tx=0x7fda60009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.429+0000 7fda577fe700 1 -- 172.21.15.115:0/3704576571 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60012600 con 0x7fda700696f0 2023-07-27T14:37:56.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.430+0000 7fda577fe700 1 -- 172.21.15.115:0/3704576571 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda60012760 con 0x7fda700696f0 2023-07-27T14:37:56.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.430+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda64009370 con 0x7fda700696f0 2023-07-27T14:37:56.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.430+0000 7fda577fe700 1 -- 172.21.15.115:0/3704576571 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60012ae0 con 0x7fda700696f0 2023-07-27T14:37:56.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.430+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda700be640 con 0x7fda700696f0 2023-07-27T14:37:56.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.431+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7006c470 con 0x7fda700696f0 2023-07-27T14:37:56.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.431+0000 7fda577fe700 1 -- 172.21.15.115:0/3704576571 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fda60022070 con 0x7fda700696f0 2023-07-27T14:37:56.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.432+0000 7fda577fe700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda5c05f9c0 0x7fda5c061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.432+0000 7fda577fe700 1 -- 172.21.15.115:0/3704576571 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fda6007b180 con 0x7fda700696f0 2023-07-27T14:37:56.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.432+0000 7fda6effd700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda5c05f9c0 0x7fda5c061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.433+0000 7fda6effd700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda5c05f9c0 0x7fda5c061e80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fda700ac9f0 tx=0x7fda64017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.437+0000 7fda577fe700 1 -- 172.21.15.115:0/3704576571 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda6004b9b0 con 0x7fda700696f0 2023-07-27T14:37:56.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.602+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda70063880 con 0x7fda5c05f9c0 2023-07-27T14:37:56.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.612+0000 7fda577fe700 1 -- 172.21.15.115:0/3704576571 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361725 (secure 0 0 0) 0x7fda70063880 con 0x7fda5c05f9c0 2023-07-27T14:37:56.667 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:56.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda5c05f9c0 msgr2=0x7fda5c061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda5c05f9c0 0x7fda5c061e80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fda700ac9f0 tx=0x7fda64017000).stop 2023-07-27T14:37:56.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda700696f0 msgr2=0x7fda7014b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda700696f0 0x7fda7014b940 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fda6000e880 tx=0x7fda60009060).stop 2023-07-27T14:37:56.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 shutdown_connections 2023-07-27T14:37:56.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fda5c05f9c0 0x7fda5c061e80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda70150af0 0x7fda700beb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda700696f0 0x7fda7014b940 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 --2- 172.21.15.115:0/3704576571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda700c0e80 0x7fda700aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 >> 172.21.15.115:0/3704576571 conn(0x7fda70062320 msgr2=0x7fda700c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:56.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 shutdown_connections 2023-07-27T14:37:56.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.617+0000 7fda75bff700 1 -- 172.21.15.115:0/3704576571 wait complete. 2023-07-27T14:37:56.671 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:37:56.685 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2023-07-27T14:37:55.585830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":179832,"kb_used_data":17016,"kb_used_omap":0,"kb_used_meta":162752,"kb_avail":754794888,"statfs":{"total":773094113280,"available":772909965312,"internally_reserved":0,"allocated":17424384,"data_stored":8214820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":166658048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1816509,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-78,"num_read_kb":-65562,"num_write":-551,"num_write_kb":-132942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-6,"num_bytes_recovered":-5242880,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.177720"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390595+0000","last_change":"2023-07-27T14:37:52.387322+0000","last_active":"2023-07-27T14:37:52.390595+0000","last_peered":"2023-07-27T14:37:52.390595+0000","last_clean":"2023-07-27T14:37:52.390595+0000","last_became_active":"2023-07-27T14:37:52.387049+0000","last_became_peered":"2023-07-27T14:37:52.387049+0000","last_unstale":"2023-07-27T14:37:52.390595+0000","last_undegraded":"2023-07-27T14:37:52.390595+0000","last_fullsized":"2023-07-27T14:37:52.390595+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"173'3","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389953+0000","last_change":"2023-07-27T14:37:51.923519+0000","last_active":"2023-07-27T14:37:52.389953+0000","last_peered":"2023-07-27T14:37:52.389953+0000","last_clean":"2023-07-27T14:37:52.389953+0000","last_became_active":"2023-07-27T14:37:51.923088+0000","last_became_peered":"2023-07-27T14:37:51.923088+0000","last_unstale":"2023-07-27T14:37:52.389953+0000","last_undegraded":"2023-07-27T14:37:52.389953+0000","last_fullsized":"2023-07-27T14:37:52.389953+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.379370+0000","last_change":"2023-07-27T14:37:52.375268+0000","last_active":"2023-07-27T14:37:52.379370+0000","last_peered":"2023-07-27T14:37:52.379370+0000","last_clean":"2023-07-27T14:37:52.379370+0000","last_became_active":"2023-07-27T14:37:52.374954+0000","last_became_peered":"2023-07-27T14:37:52.374954+0000","last_unstale":"2023-07-27T14:37:52.379370+0000","last_undegraded":"2023-07-27T14:37:52.379370+0000","last_fullsized":"2023-07-27T14:37:52.379370+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370500+0000","last_change":"2023-07-27T14:37:51.921514+0000","last_active":"2023-07-27T14:37:52.370500+0000","last_peered":"2023-07-27T14:37:52.370500+0000","last_clean":"2023-07-27T14:37:52.370500+0000","last_became_active":"2023-07-27T14:37:51.921254+0000","last_became_peered":"2023-07-27T14:37:51.921254+0000","last_unstale":"2023-07-27T14:37:52.370500+0000","last_undegraded":"2023-07-27T14:37:52.370500+0000","last_fullsized":"2023-07-27T14:37:52.370500+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390408+0000","last_change":"2023-07-27T14:37:52.385619+0000","last_active":"2023-07-27T14:37:52.390408+0000","last_peered":"2023-07-27T14:37:52.390408+0000","last_clean":"2023-07-27T14:37:52.390408+0000","last_became_active":"2023-07-27T14:37:52.385282+0000","last_became_peered":"2023-07-27T14:37:52.385282+0000","last_unstale":"2023-07-27T14:37:52.390408+0000","last_undegraded":"2023-07-27T14:37:52.390408+0000","last_fullsized":"2023-07-27T14:37:52.390408+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367154+0000","last_change":"2023-07-27T14:37:51.921628+0000","last_active":"2023-07-27T14:37:52.367154+0000","last_peered":"2023-07-27T14:37:52.367154+0000","last_clean":"2023-07-27T14:37:52.367154+0000","last_became_active":"2023-07-27T14:37:51.921164+0000","last_became_peered":"2023-07-27T14:37:51.921164+0000","last_unstale":"2023-07-27T14:37:52.367154+0000","last_undegraded":"2023-07-27T14:37:52.367154+0000","last_fullsized":"2023-07-27T14:37:52.367154+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.384208+0000","last_change":"2023-07-27T14:37:52.381627+0000","last_active":"2023-07-27T14:37:52.384208+0000","last_peered":"2023-07-27T14:37:52.384208+0000","last_clean":"2023-07-27T14:37:52.384208+0000","last_became_active":"2023-07-27T14:37:52.381397+0000","last_became_peered":"2023-07-27T14:37:52.381397+0000","last_unstale":"2023-07-27T14:37:52.384208+0000","last_undegraded":"2023-07-27T14:37:52.384208+0000","last_fullsized":"2023-07-27T14:37:52.384208+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392060+0000","last_change":"2023-07-27T14:37:51.912620+0000","last_active":"2023-07-27T14:37:52.392060+0000","last_peered":"2023-07-27T14:37:52.392060+0000","last_clean":"2023-07-27T14:37:52.392060+0000","last_became_active":"2023-07-27T14:37:51.912335+0000","last_became_peered":"2023-07-27T14:37:51.912335+0000","last_unstale":"2023-07-27T14:37:52.392060+0000","last_undegraded":"2023-07-27T14:37:52.392060+0000","last_fullsized":"2023-07-27T14:37:52.392060+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391268+0000","last_change":"2023-07-27T14:37:52.388887+0000","last_active":"2023-07-27T14:37:52.391268+0000","last_peered":"2023-07-27T14:37:52.391268+0000","last_clean":"2023-07-27T14:37:52.391268+0000","last_became_active":"2023-07-27T14:37:52.388542+0000","last_became_peered":"2023-07-27T14:37:52.388542+0000","last_unstale":"2023-07-27T14:37:52.391268+0000","last_undegraded":"2023-07-27T14:37:52.391268+0000","last_fullsized":"2023-07-27T14:37:52.391268+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389569+0000","last_change":"2023-07-27T14:37:51.924787+0000","last_active":"2023-07-27T14:37:52.389569+0000","last_peered":"2023-07-27T14:37:52.389569+0000","last_clean":"2023-07-27T14:37:52.389569+0000","last_became_active":"2023-07-27T14:37:51.924435+0000","last_became_peered":"2023-07-27T14:37:51.924435+0000","last_unstale":"2023-07-27T14:37:52.389569+0000","last_undegraded":"2023-07-27T14:37:52.389569+0000","last_fullsized":"2023-07-27T14:37:52.389569+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388306+0000","last_change":"2023-07-27T14:37:52.384944+0000","last_active":"2023-07-27T14:37:52.388306+0000","last_peered":"2023-07-27T14:37:52.388306+0000","last_clean":"2023-07-27T14:37:52.388306+0000","last_became_active":"2023-07-27T14:37:52.384653+0000","last_became_peered":"2023-07-27T14:37:52.384653+0000","last_unstale":"2023-07-27T14:37:52.388306+0000","last_undegraded":"2023-07-27T14:37:52.388306+0000","last_fullsized":"2023-07-27T14:37:52.388306+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393074+0000","last_change":"2023-07-27T14:37:51.924720+0000","last_active":"2023-07-27T14:37:52.393074+0000","last_peered":"2023-07-27T14:37:52.393074+0000","last_clean":"2023-07-27T14:37:52.393074+0000","last_became_active":"2023-07-27T14:37:51.924420+0000","last_became_peered":"2023-07-27T14:37:51.924420+0000","last_unstale":"2023-07-27T14:37:52.393074+0000","last_undegraded":"2023-07-27T14:37:52.393074+0000","last_fullsized":"2023-07-27T14:37:52.393074+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392566+0000","last_change":"2023-07-27T14:37:52.384875+0000","last_active":"2023-07-27T14:37:52.392566+0000","last_peered":"2023-07-27T14:37:52.392566+0000","last_clean":"2023-07-27T14:37:52.392566+0000","last_became_active":"2023-07-27T14:37:52.384614+0000","last_became_peered":"2023-07-27T14:37:52.384614+0000","last_unstale":"2023-07-27T14:37:52.392566+0000","last_undegraded":"2023-07-27T14:37:52.392566+0000","last_fullsized":"2023-07-27T14:37:52.392566+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368278+0000","last_change":"2023-07-27T14:37:51.920499+0000","last_active":"2023-07-27T14:37:52.368278+0000","last_peered":"2023-07-27T14:37:52.368278+0000","last_clean":"2023-07-27T14:37:52.368278+0000","last_became_active":"2023-07-27T14:37:51.920128+0000","last_became_peered":"2023-07-27T14:37:51.920128+0000","last_unstale":"2023-07-27T14:37:52.368278+0000","last_undegraded":"2023-07-27T14:37:52.368278+0000","last_fullsized":"2023-07-27T14:37:52.368278+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.387427+0000","last_change":"2023-07-27T14:37:52.379805+0000","last_active":"2023-07-27T14:37:52.387427+0000","last_peered":"2023-07-27T14:37:52.387427+0000","last_clean":"2023-07-27T14:37:52.387427+0000","last_became_active":"2023-07-27T14:37:52.379521+0000","last_became_peered":"2023-07-27T14:37:52.379521+0000","last_unstale":"2023-07-27T14:37:52.387427+0000","last_undegraded":"2023-07-27T14:37:52.387427+0000","last_fullsized":"2023-07-27T14:37:52.387427+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368498+0000","last_change":"2023-07-27T14:37:51.925909+0000","last_active":"2023-07-27T14:37:52.368498+0000","last_peered":"2023-07-27T14:37:52.368498+0000","last_clean":"2023-07-27T14:37:52.368498+0000","last_became_active":"2023-07-27T14:37:51.925620+0000","last_became_peered":"2023-07-27T14:37:51.925620+0000","last_unstale":"2023-07-27T14:37:52.368498+0000","last_undegraded":"2023-07-27T14:37:52.368498+0000","last_fullsized":"2023-07-27T14:37:52.368498+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392177+0000","last_change":"2023-07-27T14:37:52.384838+0000","last_active":"2023-07-27T14:37:52.392177+0000","last_peered":"2023-07-27T14:37:52.392177+0000","last_clean":"2023-07-27T14:37:52.392177+0000","last_became_active":"2023-07-27T14:37:52.384554+0000","last_became_peered":"2023-07-27T14:37:52.384554+0000","last_unstale":"2023-07-27T14:37:52.392177+0000","last_undegraded":"2023-07-27T14:37:52.392177+0000","last_fullsized":"2023-07-27T14:37:52.392177+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372238+0000","last_change":"2023-07-27T14:37:51.924799+0000","last_active":"2023-07-27T14:37:52.372238+0000","last_peered":"2023-07-27T14:37:52.372238+0000","last_clean":"2023-07-27T14:37:52.372238+0000","last_became_active":"2023-07-27T14:37:51.924443+0000","last_became_peered":"2023-07-27T14:37:51.924443+0000","last_unstale":"2023-07-27T14:37:52.372238+0000","last_undegraded":"2023-07-27T14:37:52.372238+0000","last_fullsized":"2023-07-27T14:37:52.372238+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.379914+0000","last_change":"2023-07-27T14:37:52.375026+0000","last_active":"2023-07-27T14:37:52.379914+0000","last_peered":"2023-07-27T14:37:52.379914+0000","last_clean":"2023-07-27T14:37:52.379914+0000","last_became_active":"2023-07-27T14:37:52.374393+0000","last_became_peered":"2023-07-27T14:37:52.374393+0000","last_unstale":"2023-07-27T14:37:52.379914+0000","last_undegraded":"2023-07-27T14:37:52.379914+0000","last_fullsized":"2023-07-27T14:37:52.379914+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370604+0000","last_change":"2023-07-27T14:37:51.918789+0000","last_active":"2023-07-27T14:37:52.370604+0000","last_peered":"2023-07-27T14:37:52.370604+0000","last_clean":"2023-07-27T14:37:52.370604+0000","last_became_active":"2023-07-27T14:37:51.918469+0000","last_became_peered":"2023-07-27T14:37:51.918469+0000","last_unstale":"2023-07-27T14:37:52.370604+0000","last_undegraded":"2023-07-27T14:37:52.370604+0000","last_fullsized":"2023-07-27T14:37:52.370604+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391153+0000","last_change":"2023-07-27T14:37:52.387486+0000","last_active":"2023-07-27T14:37:52.391153+0000","last_peered":"2023-07-27T14:37:52.391153+0000","last_clean":"2023-07-27T14:37:52.391153+0000","last_became_active":"2023-07-27T14:37:52.387170+0000","last_became_peered":"2023-07-27T14:37:52.387170+0000","last_unstale":"2023-07-27T14:37:52.391153+0000","last_undegraded":"2023-07-27T14:37:52.391153+0000","last_fullsized":"2023-07-27T14:37:52.391153+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.369646+0000","last_change":"2023-07-27T14:37:51.921578+0000","last_active":"2023-07-27T14:37:52.369646+0000","last_peered":"2023-07-27T14:37:52.369646+0000","last_clean":"2023-07-27T14:37:52.369646+0000","last_became_active":"2023-07-27T14:37:51.921294+0000","last_became_peered":"2023-07-27T14:37:51.921294+0000","last_unstale":"2023-07-27T14:37:52.369646+0000","last_undegraded":"2023-07-27T14:37:52.369646+0000","last_fullsized":"2023-07-27T14:37:52.369646+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390532+0000","last_change":"2023-07-27T14:37:52.386646+0000","last_active":"2023-07-27T14:37:52.390532+0000","last_peered":"2023-07-27T14:37:52.390532+0000","last_clean":"2023-07-27T14:37:52.390532+0000","last_became_active":"2023-07-27T14:37:52.386366+0000","last_became_peered":"2023-07-27T14:37:52.386366+0000","last_unstale":"2023-07-27T14:37:52.390532+0000","last_undegraded":"2023-07-27T14:37:52.390532+0000","last_fullsized":"2023-07-27T14:37:52.390532+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"173'4","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394906+0000","last_change":"2023-07-27T14:37:51.923415+0000","last_active":"2023-07-27T14:37:52.394906+0000","last_peered":"2023-07-27T14:37:52.394906+0000","last_clean":"2023-07-27T14:37:52.394906+0000","last_became_active":"2023-07-27T14:37:51.923106+0000","last_became_peered":"2023-07-27T14:37:51.923106+0000","last_unstale":"2023-07-27T14:37:52.394906+0000","last_undegraded":"2023-07-27T14:37:52.394906+0000","last_fullsized":"2023-07-27T14:37:52.394906+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390547+0000","last_change":"2023-07-27T14:37:52.387282+0000","last_active":"2023-07-27T14:37:52.390547+0000","last_peered":"2023-07-27T14:37:52.390547+0000","last_clean":"2023-07-27T14:37:52.390547+0000","last_became_active":"2023-07-27T14:37:52.386974+0000","last_became_peered":"2023-07-27T14:37:52.386974+0000","last_unstale":"2023-07-27T14:37:52.390547+0000","last_undegraded":"2023-07-27T14:37:52.390547+0000","last_fullsized":"2023-07-27T14:37:52.390547+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391277+0000","last_change":"2023-07-27T14:37:51.913070+0000","last_active":"2023-07-27T14:37:52.391277+0000","last_peered":"2023-07-27T14:37:52.391277+0000","last_clean":"2023-07-27T14:37:52.391277+0000","last_became_active":"2023-07-27T14:37:51.912786+0000","last_became_peered":"2023-07-27T14:37:51.912786+0000","last_unstale":"2023-07-27T14:37:52.391277+0000","last_undegraded":"2023-07-27T14:37:52.391277+0000","last_fullsized":"2023-07-27T14:37:52.391277+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388683+0000","last_change":"2023-07-27T14:37:52.384839+0000","last_active":"2023-07-27T14:37:52.388683+0000","last_peered":"2023-07-27T14:37:52.388683+0000","last_clean":"2023-07-27T14:37:52.388683+0000","last_became_active":"2023-07-27T14:37:52.384531+0000","last_became_peered":"2023-07-27T14:37:52.384531+0000","last_unstale":"2023-07-27T14:37:52.388683+0000","last_undegraded":"2023-07-27T14:37:52.388683+0000","last_fullsized":"2023-07-27T14:37:52.388683+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.365696+0000","last_change":"2023-07-27T14:37:51.918283+0000","last_active":"2023-07-27T14:37:52.365696+0000","last_peered":"2023-07-27T14:37:52.365696+0000","last_clean":"2023-07-27T14:37:52.365696+0000","last_became_active":"2023-07-27T14:37:51.918000+0000","last_became_peered":"2023-07-27T14:37:51.918000+0000","last_unstale":"2023-07-27T14:37:52.365696+0000","last_undegraded":"2023-07-27T14:37:52.365696+0000","last_fullsized":"2023-07-27T14:37:52.365696+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.381933+0000","last_change":"2023-07-27T14:37:52.377186+0000","last_active":"2023-07-27T14:37:52.381933+0000","last_peered":"2023-07-27T14:37:52.381933+0000","last_clean":"2023-07-27T14:37:52.381933+0000","last_became_active":"2023-07-27T14:37:52.376843+0000","last_became_peered":"2023-07-27T14:37:52.376843+0000","last_unstale":"2023-07-27T14:37:52.381933+0000","last_undegraded":"2023-07-27T14:37:52.381933+0000","last_fullsized":"2023-07-27T14:37:52.381933+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370264+0000","last_change":"2023-07-27T14:37:51.923025+0000","last_active":"2023-07-27T14:37:52.370264+0000","last_peered":"2023-07-27T14:37:52.370264+0000","last_clean":"2023-07-27T14:37:52.370264+0000","last_became_active":"2023-07-27T14:37:51.922690+0000","last_became_peered":"2023-07-27T14:37:51.922690+0000","last_unstale":"2023-07-27T14:37:52.370264+0000","last_undegraded":"2023-07-27T14:37:52.370264+0000","last_fullsized":"2023-07-27T14:37:52.370264+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394767+0000","last_change":"2023-07-27T14:37:52.392691+0000","last_active":"2023-07-27T14:37:52.394767+0000","last_peered":"2023-07-27T14:37:52.394767+0000","last_clean":"2023-07-27T14:37:52.394767+0000","last_became_active":"2023-07-27T14:37:52.391701+0000","last_became_peered":"2023-07-27T14:37:52.391701+0000","last_unstale":"2023-07-27T14:37:52.394767+0000","last_undegraded":"2023-07-27T14:37:52.394767+0000","last_fullsized":"2023-07-27T14:37:52.394767+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"173'4","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393018+0000","last_change":"2023-07-27T14:37:51.919810+0000","last_active":"2023-07-27T14:37:52.393018+0000","last_peered":"2023-07-27T14:37:52.393018+0000","last_clean":"2023-07-27T14:37:52.393018+0000","last_became_active":"2023-07-27T14:37:51.919545+0000","last_became_peered":"2023-07-27T14:37:51.919545+0000","last_unstale":"2023-07-27T14:37:52.393018+0000","last_undegraded":"2023-07-27T14:37:52.393018+0000","last_fullsized":"2023-07-27T14:37:52.393018+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.384904+0000","last_change":"2023-07-27T14:37:52.378183+0000","last_active":"2023-07-27T14:37:52.384904+0000","last_peered":"2023-07-27T14:37:52.384904+0000","last_clean":"2023-07-27T14:37:52.384904+0000","last_became_active":"2023-07-27T14:37:52.377845+0000","last_became_peered":"2023-07-27T14:37:52.377845+0000","last_unstale":"2023-07-27T14:37:52.384904+0000","last_undegraded":"2023-07-27T14:37:52.384904+0000","last_fullsized":"2023-07-27T14:37:52.384904+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.365481+0000","last_change":"2023-07-27T14:37:51.927103+0000","last_active":"2023-07-27T14:37:52.365481+0000","last_peered":"2023-07-27T14:37:52.365481+0000","last_clean":"2023-07-27T14:37:52.365481+0000","last_became_active":"2023-07-27T14:37:51.926156+0000","last_became_peered":"2023-07-27T14:37:51.926156+0000","last_unstale":"2023-07-27T14:37:52.365481+0000","last_undegraded":"2023-07-27T14:37:52.365481+0000","last_fullsized":"2023-07-27T14:37:52.365481+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.383137+0000","last_change":"2023-07-27T14:37:52.379718+0000","last_active":"2023-07-27T14:37:52.383137+0000","last_peered":"2023-07-27T14:37:52.383137+0000","last_clean":"2023-07-27T14:37:52.383137+0000","last_became_active":"2023-07-27T14:37:52.379029+0000","last_became_peered":"2023-07-27T14:37:52.379029+0000","last_unstale":"2023-07-27T14:37:52.383137+0000","last_undegraded":"2023-07-27T14:37:52.383137+0000","last_fullsized":"2023-07-27T14:37:52.383137+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.371921+0000","last_change":"2023-07-27T14:37:51.919740+0000","last_active":"2023-07-27T14:37:52.371921+0000","last_peered":"2023-07-27T14:37:52.371921+0000","last_clean":"2023-07-27T14:37:52.371921+0000","last_became_active":"2023-07-27T14:37:51.919081+0000","last_became_peered":"2023-07-27T14:37:51.919081+0000","last_unstale":"2023-07-27T14:37:52.371921+0000","last_undegraded":"2023-07-27T14:37:52.371921+0000","last_fullsized":"2023-07-27T14:37:52.371921+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389610+0000","last_change":"2023-07-27T14:37:52.382040+0000","last_active":"2023-07-27T14:37:52.389610+0000","last_peered":"2023-07-27T14:37:52.389610+0000","last_clean":"2023-07-27T14:37:52.389610+0000","last_became_active":"2023-07-27T14:37:52.381692+0000","last_became_peered":"2023-07-27T14:37:52.381692+0000","last_unstale":"2023-07-27T14:37:52.389610+0000","last_undegraded":"2023-07-27T14:37:52.389610+0000","last_fullsized":"2023-07-27T14:37:52.389610+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394079+0000","last_change":"2023-07-27T14:37:51.928539+0000","last_active":"2023-07-27T14:37:52.394079+0000","last_peered":"2023-07-27T14:37:52.394079+0000","last_clean":"2023-07-27T14:37:52.394079+0000","last_became_active":"2023-07-27T14:37:51.928274+0000","last_became_peered":"2023-07-27T14:37:51.928274+0000","last_unstale":"2023-07-27T14:37:52.394079+0000","last_undegraded":"2023-07-27T14:37:52.394079+0000","last_fullsized":"2023-07-27T14:37:52.394079+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.379832+0000","last_change":"2023-07-27T14:37:52.373316+0000","last_active":"2023-07-27T14:37:52.379832+0000","last_peered":"2023-07-27T14:37:52.379832+0000","last_clean":"2023-07-27T14:37:52.379832+0000","last_became_active":"2023-07-27T14:37:52.373013+0000","last_became_peered":"2023-07-27T14:37:52.373013+0000","last_unstale":"2023-07-27T14:37:52.379832+0000","last_undegraded":"2023-07-27T14:37:52.379832+0000","last_fullsized":"2023-07-27T14:37:52.379832+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366378+0000","last_change":"2023-07-27T14:37:51.922317+0000","last_active":"2023-07-27T14:37:52.366378+0000","last_peered":"2023-07-27T14:37:52.366378+0000","last_clean":"2023-07-27T14:37:52.366378+0000","last_became_active":"2023-07-27T14:37:51.922031+0000","last_became_peered":"2023-07-27T14:37:51.922031+0000","last_unstale":"2023-07-27T14:37:52.366378+0000","last_undegraded":"2023-07-27T14:37:52.366378+0000","last_fullsized":"2023-07-27T14:37:52.366378+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392286+0000","last_change":"2023-07-27T14:37:52.389773+0000","last_active":"2023-07-27T14:37:52.392286+0000","last_peered":"2023-07-27T14:37:52.392286+0000","last_clean":"2023-07-27T14:37:52.392286+0000","last_became_active":"2023-07-27T14:37:52.389428+0000","last_became_peered":"2023-07-27T14:37:52.389428+0000","last_unstale":"2023-07-27T14:37:52.392286+0000","last_undegraded":"2023-07-27T14:37:52.392286+0000","last_fullsized":"2023-07-27T14:37:52.392286+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391732+0000","last_change":"2023-07-27T14:37:51.926647+0000","last_active":"2023-07-27T14:37:52.391732+0000","last_peered":"2023-07-27T14:37:52.391732+0000","last_clean":"2023-07-27T14:37:52.391732+0000","last_became_active":"2023-07-27T14:37:51.926283+0000","last_became_peered":"2023-07-27T14:37:51.926283+0000","last_unstale":"2023-07-27T14:37:52.391732+0000","last_undegraded":"2023-07-27T14:37:52.391732+0000","last_fullsized":"2023-07-27T14:37:52.391732+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390367+0000","last_change":"2023-07-27T14:37:52.382450+0000","last_active":"2023-07-27T14:37:52.390367+0000","last_peered":"2023-07-27T14:37:52.390367+0000","last_clean":"2023-07-27T14:37:52.390367+0000","last_became_active":"2023-07-27T14:37:52.382164+0000","last_became_peered":"2023-07-27T14:37:52.382164+0000","last_unstale":"2023-07-27T14:37:52.390367+0000","last_undegraded":"2023-07-27T14:37:52.390367+0000","last_fullsized":"2023-07-27T14:37:52.390367+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.369990+0000","last_change":"2023-07-27T14:37:51.921844+0000","last_active":"2023-07-27T14:37:52.369990+0000","last_peered":"2023-07-27T14:37:52.369990+0000","last_clean":"2023-07-27T14:37:52.369990+0000","last_became_active":"2023-07-27T14:37:51.920648+0000","last_became_peered":"2023-07-27T14:37:51.920648+0000","last_unstale":"2023-07-27T14:37:52.369990+0000","last_undegraded":"2023-07-27T14:37:52.369990+0000","last_fullsized":"2023-07-27T14:37:52.369990+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390873+0000","last_change":"2023-07-27T14:37:52.386811+0000","last_active":"2023-07-27T14:37:52.390873+0000","last_peered":"2023-07-27T14:37:52.390873+0000","last_clean":"2023-07-27T14:37:52.390873+0000","last_became_active":"2023-07-27T14:37:52.386504+0000","last_became_peered":"2023-07-27T14:37:52.386504+0000","last_unstale":"2023-07-27T14:37:52.390873+0000","last_undegraded":"2023-07-27T14:37:52.390873+0000","last_fullsized":"2023-07-27T14:37:52.390873+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366639+0000","last_change":"2023-07-27T14:37:51.916064+0000","last_active":"2023-07-27T14:37:52.366639+0000","last_peered":"2023-07-27T14:37:52.366639+0000","last_clean":"2023-07-27T14:37:52.366639+0000","last_became_active":"2023-07-27T14:37:51.915488+0000","last_became_peered":"2023-07-27T14:37:51.915488+0000","last_unstale":"2023-07-27T14:37:52.366639+0000","last_undegraded":"2023-07-27T14:37:52.366639+0000","last_fullsized":"2023-07-27T14:37:52.366639+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389927+0000","last_change":"2023-07-27T14:37:52.385713+0000","last_active":"2023-07-27T14:37:52.389927+0000","last_peered":"2023-07-27T14:37:52.389927+0000","last_clean":"2023-07-27T14:37:52.389927+0000","last_became_active":"2023-07-27T14:37:52.385420+0000","last_became_peered":"2023-07-27T14:37:52.385420+0000","last_unstale":"2023-07-27T14:37:52.389927+0000","last_undegraded":"2023-07-27T14:37:52.389927+0000","last_fullsized":"2023-07-27T14:37:52.389927+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368605+0000","last_change":"2023-07-27T14:37:51.915223+0000","last_active":"2023-07-27T14:37:52.368605+0000","last_peered":"2023-07-27T14:37:52.368605+0000","last_clean":"2023-07-27T14:37:52.368605+0000","last_became_active":"2023-07-27T14:37:51.914836+0000","last_became_peered":"2023-07-27T14:37:51.914836+0000","last_unstale":"2023-07-27T14:37:52.368605+0000","last_undegraded":"2023-07-27T14:37:52.368605+0000","last_fullsized":"2023-07-27T14:37:52.368605+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390576+0000","last_change":"2023-07-27T14:37:52.387154+0000","last_active":"2023-07-27T14:37:52.390576+0000","last_peered":"2023-07-27T14:37:52.390576+0000","last_clean":"2023-07-27T14:37:52.390576+0000","last_became_active":"2023-07-27T14:37:52.386785+0000","last_became_peered":"2023-07-27T14:37:52.386785+0000","last_unstale":"2023-07-27T14:37:52.390576+0000","last_undegraded":"2023-07-27T14:37:52.390576+0000","last_fullsized":"2023-07-27T14:37:52.390576+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368178+0000","last_change":"2023-07-27T14:37:51.920491+0000","last_active":"2023-07-27T14:37:52.368178+0000","last_peered":"2023-07-27T14:37:52.368178+0000","last_clean":"2023-07-27T14:37:52.368178+0000","last_became_active":"2023-07-27T14:37:51.920207+0000","last_became_peered":"2023-07-27T14:37:51.920207+0000","last_unstale":"2023-07-27T14:37:52.368178+0000","last_undegraded":"2023-07-27T14:37:52.368178+0000","last_fullsized":"2023-07-27T14:37:52.368178+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388883+0000","last_change":"2023-07-27T14:37:52.381572+0000","last_active":"2023-07-27T14:37:52.388883+0000","last_peered":"2023-07-27T14:37:52.388883+0000","last_clean":"2023-07-27T14:37:52.388883+0000","last_became_active":"2023-07-27T14:37:52.381327+0000","last_became_peered":"2023-07-27T14:37:52.381327+0000","last_unstale":"2023-07-27T14:37:52.388883+0000","last_undegraded":"2023-07-27T14:37:52.388883+0000","last_fullsized":"2023-07-27T14:37:52.388883+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.371220+0000","last_change":"2023-07-27T14:37:51.919001+0000","last_active":"2023-07-27T14:37:52.371220+0000","last_peered":"2023-07-27T14:37:52.371220+0000","last_clean":"2023-07-27T14:37:52.371220+0000","last_became_active":"2023-07-27T14:37:51.918245+0000","last_became_peered":"2023-07-27T14:37:51.918245+0000","last_unstale":"2023-07-27T14:37:52.371220+0000","last_undegraded":"2023-07-27T14:37:52.371220+0000","last_fullsized":"2023-07-27T14:37:52.371220+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390332+0000","last_change":"2023-07-27T14:37:52.381641+0000","last_active":"2023-07-27T14:37:52.390332+0000","last_peered":"2023-07-27T14:37:52.390332+0000","last_clean":"2023-07-27T14:37:52.390332+0000","last_became_active":"2023-07-27T14:37:52.381357+0000","last_became_peered":"2023-07-27T14:37:52.381357+0000","last_unstale":"2023-07-27T14:37:52.390332+0000","last_undegraded":"2023-07-27T14:37:52.390332+0000","last_fullsized":"2023-07-27T14:37:52.390332+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367269+0000","last_change":"2023-07-27T14:37:51.907999+0000","last_active":"2023-07-27T14:37:52.367269+0000","last_peered":"2023-07-27T14:37:52.367269+0000","last_clean":"2023-07-27T14:37:52.367269+0000","last_became_active":"2023-07-27T14:37:51.907695+0000","last_became_peered":"2023-07-27T14:37:51.907695+0000","last_unstale":"2023-07-27T14:37:52.367269+0000","last_undegraded":"2023-07-27T14:37:52.367269+0000","last_fullsized":"2023-07-27T14:37:52.367269+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391855+0000","last_change":"2023-07-27T14:37:52.388537+0000","last_active":"2023-07-27T14:37:52.391855+0000","last_peered":"2023-07-27T14:37:52.391855+0000","last_clean":"2023-07-27T14:37:52.391855+0000","last_became_active":"2023-07-27T14:37:52.388288+0000","last_became_peered":"2023-07-27T14:37:52.388288+0000","last_unstale":"2023-07-27T14:37:52.391855+0000","last_undegraded":"2023-07-27T14:37:52.391855+0000","last_fullsized":"2023-07-27T14:37:52.391855+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.362701+0000","last_change":"2023-07-27T14:37:51.916790+0000","last_active":"2023-07-27T14:37:52.362701+0000","last_peered":"2023-07-27T14:37:52.362701+0000","last_clean":"2023-07-27T14:37:52.362701+0000","last_became_active":"2023-07-27T14:37:51.916484+0000","last_became_peered":"2023-07-27T14:37:51.916484+0000","last_unstale":"2023-07-27T14:37:52.362701+0000","last_undegraded":"2023-07-27T14:37:52.362701+0000","last_fullsized":"2023-07-27T14:37:52.362701+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393091+0000","last_change":"2023-07-27T14:37:52.390672+0000","last_active":"2023-07-27T14:37:52.393091+0000","last_peered":"2023-07-27T14:37:52.393091+0000","last_clean":"2023-07-27T14:37:52.393091+0000","last_became_active":"2023-07-27T14:37:52.387991+0000","last_became_peered":"2023-07-27T14:37:52.387991+0000","last_unstale":"2023-07-27T14:37:52.393091+0000","last_undegraded":"2023-07-27T14:37:52.393091+0000","last_fullsized":"2023-07-27T14:37:52.393091+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366965+0000","last_change":"2023-07-27T14:37:51.908666+0000","last_active":"2023-07-27T14:37:52.366965+0000","last_peered":"2023-07-27T14:37:52.366965+0000","last_clean":"2023-07-27T14:37:52.366965+0000","last_became_active":"2023-07-27T14:37:51.908315+0000","last_became_peered":"2023-07-27T14:37:51.908315+0000","last_unstale":"2023-07-27T14:37:52.366965+0000","last_undegraded":"2023-07-27T14:37:52.366965+0000","last_fullsized":"2023-07-27T14:37:52.366965+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.378319+0000","last_change":"2023-07-27T14:37:52.375263+0000","last_active":"2023-07-27T14:37:52.378319+0000","last_peered":"2023-07-27T14:37:52.378319+0000","last_clean":"2023-07-27T14:37:52.378319+0000","last_became_active":"2023-07-27T14:37:52.374934+0000","last_became_peered":"2023-07-27T14:37:52.374934+0000","last_unstale":"2023-07-27T14:37:52.378319+0000","last_undegraded":"2023-07-27T14:37:52.378319+0000","last_fullsized":"2023-07-27T14:37:52.378319+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372550+0000","last_change":"2023-07-27T14:37:51.919067+0000","last_active":"2023-07-27T14:37:52.372550+0000","last_peered":"2023-07-27T14:37:52.372550+0000","last_clean":"2023-07-27T14:37:52.372550+0000","last_became_active":"2023-07-27T14:37:51.918734+0000","last_became_peered":"2023-07-27T14:37:51.918734+0000","last_unstale":"2023-07-27T14:37:52.372550+0000","last_undegraded":"2023-07-27T14:37:52.372550+0000","last_fullsized":"2023-07-27T14:37:52.372550+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.375463+0000","last_change":"2023-07-27T14:37:52.374438+0000","last_active":"2023-07-27T14:37:52.375463+0000","last_peered":"2023-07-27T14:37:52.375463+0000","last_clean":"2023-07-27T14:37:52.375463+0000","last_became_active":"2023-07-27T14:37:52.374098+0000","last_became_peered":"2023-07-27T14:37:52.374098+0000","last_unstale":"2023-07-27T14:37:52.375463+0000","last_undegraded":"2023-07-27T14:37:52.375463+0000","last_fullsized":"2023-07-27T14:37:52.375463+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372788+0000","last_change":"2023-07-27T14:37:51.914099+0000","last_active":"2023-07-27T14:37:52.372788+0000","last_peered":"2023-07-27T14:37:52.372788+0000","last_clean":"2023-07-27T14:37:52.372788+0000","last_became_active":"2023-07-27T14:37:51.913799+0000","last_became_peered":"2023-07-27T14:37:51.913799+0000","last_unstale":"2023-07-27T14:37:52.372788+0000","last_undegraded":"2023-07-27T14:37:52.372788+0000","last_fullsized":"2023-07-27T14:37:52.372788+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.376367+0000","last_change":"2023-07-27T14:37:52.374883+0000","last_active":"2023-07-27T14:37:52.376367+0000","last_peered":"2023-07-27T14:37:52.376367+0000","last_clean":"2023-07-27T14:37:52.376367+0000","last_became_active":"2023-07-27T14:37:52.374605+0000","last_became_peered":"2023-07-27T14:37:52.374605+0000","last_unstale":"2023-07-27T14:37:52.376367+0000","last_undegraded":"2023-07-27T14:37:52.376367+0000","last_fullsized":"2023-07-27T14:37:52.376367+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368657+0000","last_change":"2023-07-27T14:37:51.918941+0000","last_active":"2023-07-27T14:37:52.368657+0000","last_peered":"2023-07-27T14:37:52.368657+0000","last_clean":"2023-07-27T14:37:52.368657+0000","last_became_active":"2023-07-27T14:37:51.918605+0000","last_became_peered":"2023-07-27T14:37:51.918605+0000","last_unstale":"2023-07-27T14:37:52.368657+0000","last_undegraded":"2023-07-27T14:37:52.368657+0000","last_fullsized":"2023-07-27T14:37:52.368657+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.385564+0000","last_change":"2023-07-27T14:37:52.378698+0000","last_active":"2023-07-27T14:37:52.385564+0000","last_peered":"2023-07-27T14:37:52.385564+0000","last_clean":"2023-07-27T14:37:52.385564+0000","last_became_active":"2023-07-27T14:37:52.377539+0000","last_became_peered":"2023-07-27T14:37:52.377539+0000","last_unstale":"2023-07-27T14:37:52.385564+0000","last_undegraded":"2023-07-27T14:37:52.385564+0000","last_fullsized":"2023-07-27T14:37:52.385564+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.395078+0000","last_change":"2023-07-27T14:37:51.916506+0000","last_active":"2023-07-27T14:37:52.395078+0000","last_peered":"2023-07-27T14:37:52.395078+0000","last_clean":"2023-07-27T14:37:52.395078+0000","last_became_active":"2023-07-27T14:37:51.916163+0000","last_became_peered":"2023-07-27T14:37:51.916163+0000","last_unstale":"2023-07-27T14:37:52.395078+0000","last_undegraded":"2023-07-27T14:37:52.395078+0000","last_fullsized":"2023-07-27T14:37:52.395078+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391235+0000","last_change":"2023-07-27T14:37:52.386696+0000","last_active":"2023-07-27T14:37:52.391235+0000","last_peered":"2023-07-27T14:37:52.391235+0000","last_clean":"2023-07-27T14:37:52.391235+0000","last_became_active":"2023-07-27T14:37:52.386449+0000","last_became_peered":"2023-07-27T14:37:52.386449+0000","last_unstale":"2023-07-27T14:37:52.391235+0000","last_undegraded":"2023-07-27T14:37:52.391235+0000","last_fullsized":"2023-07-27T14:37:52.391235+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393707+0000","last_change":"2023-07-27T14:37:51.919233+0000","last_active":"2023-07-27T14:37:52.393707+0000","last_peered":"2023-07-27T14:37:52.393707+0000","last_clean":"2023-07-27T14:37:52.393707+0000","last_became_active":"2023-07-27T14:37:51.918656+0000","last_became_peered":"2023-07-27T14:37:51.918656+0000","last_unstale":"2023-07-27T14:37:52.393707+0000","last_undegraded":"2023-07-27T14:37:52.393707+0000","last_fullsized":"2023-07-27T14:37:52.393707+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390428+0000","last_change":"2023-07-27T14:37:52.385705+0000","last_active":"2023-07-27T14:37:52.390428+0000","last_peered":"2023-07-27T14:37:52.390428+0000","last_clean":"2023-07-27T14:37:52.390428+0000","last_became_active":"2023-07-27T14:37:52.385272+0000","last_became_peered":"2023-07-27T14:37:52.385272+0000","last_unstale":"2023-07-27T14:37:52.390428+0000","last_undegraded":"2023-07-27T14:37:52.390428+0000","last_fullsized":"2023-07-27T14:37:52.390428+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392786+0000","last_change":"2023-07-27T14:37:51.915052+0000","last_active":"2023-07-27T14:37:52.392786+0000","last_peered":"2023-07-27T14:37:52.392786+0000","last_clean":"2023-07-27T14:37:52.392786+0000","last_became_active":"2023-07-27T14:37:51.914723+0000","last_became_peered":"2023-07-27T14:37:51.914723+0000","last_unstale":"2023-07-27T14:37:52.392786+0000","last_undegraded":"2023-07-27T14:37:52.392786+0000","last_fullsized":"2023-07-27T14:37:52.392786+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.380915+0000","last_change":"2023-07-27T14:37:52.376407+0000","last_active":"2023-07-27T14:37:52.380915+0000","last_peered":"2023-07-27T14:37:52.380915+0000","last_clean":"2023-07-27T14:37:52.380915+0000","last_became_active":"2023-07-27T14:37:52.376109+0000","last_became_peered":"2023-07-27T14:37:52.376109+0000","last_unstale":"2023-07-27T14:37:52.380915+0000","last_undegraded":"2023-07-27T14:37:52.380915+0000","last_fullsized":"2023-07-27T14:37:52.380915+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.364143+0000","last_change":"2023-07-27T14:37:51.923575+0000","last_active":"2023-07-27T14:37:52.364143+0000","last_peered":"2023-07-27T14:37:52.364143+0000","last_clean":"2023-07-27T14:37:52.364143+0000","last_became_active":"2023-07-27T14:37:51.923292+0000","last_became_peered":"2023-07-27T14:37:51.923292+0000","last_unstale":"2023-07-27T14:37:52.364143+0000","last_undegraded":"2023-07-27T14:37:52.364143+0000","last_fullsized":"2023-07-27T14:37:52.364143+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393404+0000","last_change":"2023-07-27T14:37:52.389697+0000","last_active":"2023-07-27T14:37:52.393404+0000","last_peered":"2023-07-27T14:37:52.393404+0000","last_clean":"2023-07-27T14:37:52.393404+0000","last_became_active":"2023-07-27T14:37:52.389373+0000","last_became_peered":"2023-07-27T14:37:52.389373+0000","last_unstale":"2023-07-27T14:37:52.393404+0000","last_undegraded":"2023-07-27T14:37:52.393404+0000","last_fullsized":"2023-07-27T14:37:52.393404+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.363556+0000","last_change":"2023-07-27T14:37:51.909397+0000","last_active":"2023-07-27T14:37:52.363556+0000","last_peered":"2023-07-27T14:37:52.363556+0000","last_clean":"2023-07-27T14:37:52.363556+0000","last_became_active":"2023-07-27T14:37:51.908974+0000","last_became_peered":"2023-07-27T14:37:51.908974+0000","last_unstale":"2023-07-27T14:37:52.363556+0000","last_undegraded":"2023-07-27T14:37:52.363556+0000","last_fullsized":"2023-07-27T14:37:52.363556+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.377709+0000","last_change":"2023-07-27T14:37:52.375888+0000","last_active":"2023-07-27T14:37:52.377709+0000","last_peered":"2023-07-27T14:37:52.377709+0000","last_clean":"2023-07-27T14:37:52.377709+0000","last_became_active":"2023-07-27T14:37:52.375630+0000","last_became_peered":"2023-07-27T14:37:52.375630+0000","last_unstale":"2023-07-27T14:37:52.377709+0000","last_undegraded":"2023-07-27T14:37:52.377709+0000","last_fullsized":"2023-07-27T14:37:52.377709+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368929+0000","last_change":"2023-07-27T14:37:51.913681+0000","last_active":"2023-07-27T14:37:52.368929+0000","last_peered":"2023-07-27T14:37:52.368929+0000","last_clean":"2023-07-27T14:37:52.368929+0000","last_became_active":"2023-07-27T14:37:51.913257+0000","last_became_peered":"2023-07-27T14:37:51.913257+0000","last_unstale":"2023-07-27T14:37:52.368929+0000","last_undegraded":"2023-07-27T14:37:52.368929+0000","last_fullsized":"2023-07-27T14:37:52.368929+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.382304+0000","last_change":"2023-07-27T14:37:52.378760+0000","last_active":"2023-07-27T14:37:52.382304+0000","last_peered":"2023-07-27T14:37:52.382304+0000","last_clean":"2023-07-27T14:37:52.382304+0000","last_became_active":"2023-07-27T14:37:52.378485+0000","last_became_peered":"2023-07-27T14:37:52.378485+0000","last_unstale":"2023-07-27T14:37:52.382304+0000","last_undegraded":"2023-07-27T14:37:52.382304+0000","last_fullsized":"2023-07-27T14:37:52.382304+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366552+0000","last_change":"2023-07-27T14:37:51.928626+0000","last_active":"2023-07-27T14:37:52.366552+0000","last_peered":"2023-07-27T14:37:52.366552+0000","last_clean":"2023-07-27T14:37:52.366552+0000","last_became_active":"2023-07-27T14:37:51.928348+0000","last_became_peered":"2023-07-27T14:37:51.928348+0000","last_unstale":"2023-07-27T14:37:52.366552+0000","last_undegraded":"2023-07-27T14:37:52.366552+0000","last_fullsized":"2023-07-27T14:37:52.366552+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391947+0000","last_change":"2023-07-27T14:37:52.386018+0000","last_active":"2023-07-27T14:37:52.391947+0000","last_peered":"2023-07-27T14:37:52.391947+0000","last_clean":"2023-07-27T14:37:52.391947+0000","last_became_active":"2023-07-27T14:37:52.385723+0000","last_became_peered":"2023-07-27T14:37:52.385723+0000","last_unstale":"2023-07-27T14:37:52.391947+0000","last_undegraded":"2023-07-27T14:37:52.391947+0000","last_fullsized":"2023-07-27T14:37:52.391947+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.362459+0000","last_change":"2023-07-27T14:37:51.921265+0000","last_active":"2023-07-27T14:37:52.362459+0000","last_peered":"2023-07-27T14:37:52.362459+0000","last_clean":"2023-07-27T14:37:52.362459+0000","last_became_active":"2023-07-27T14:37:51.920995+0000","last_became_peered":"2023-07-27T14:37:51.920995+0000","last_unstale":"2023-07-27T14:37:52.362459+0000","last_undegraded":"2023-07-27T14:37:52.362459+0000","last_fullsized":"2023-07-27T14:37:52.362459+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.383000+0000","last_change":"2023-07-27T14:37:52.378882+0000","last_active":"2023-07-27T14:37:52.383000+0000","last_peered":"2023-07-27T14:37:52.383000+0000","last_clean":"2023-07-27T14:37:52.383000+0000","last_became_active":"2023-07-27T14:37:52.376865+0000","last_became_peered":"2023-07-27T14:37:52.376865+0000","last_unstale":"2023-07-27T14:37:52.383000+0000","last_undegraded":"2023-07-27T14:37:52.383000+0000","last_fullsized":"2023-07-27T14:37:52.383000+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388211+0000","last_change":"2023-07-27T14:37:51.923074+0000","last_active":"2023-07-27T14:37:52.388211+0000","last_peered":"2023-07-27T14:37:52.388211+0000","last_clean":"2023-07-27T14:37:52.388211+0000","last_became_active":"2023-07-27T14:37:51.922811+0000","last_became_peered":"2023-07-27T14:37:51.922811+0000","last_unstale":"2023-07-27T14:37:52.388211+0000","last_undegraded":"2023-07-27T14:37:52.388211+0000","last_fullsized":"2023-07-27T14:37:52.388211+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389490+0000","last_change":"2023-07-27T14:37:52.378534+0000","last_active":"2023-07-27T14:37:52.389490+0000","last_peered":"2023-07-27T14:37:52.389490+0000","last_clean":"2023-07-27T14:37:52.389490+0000","last_became_active":"2023-07-27T14:37:52.378150+0000","last_became_peered":"2023-07-27T14:37:52.378150+0000","last_unstale":"2023-07-27T14:37:52.389490+0000","last_undegraded":"2023-07-27T14:37:52.389490+0000","last_fullsized":"2023-07-27T14:37:52.389490+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392506+0000","last_change":"2023-07-27T14:37:51.917208+0000","last_active":"2023-07-27T14:37:52.392506+0000","last_peered":"2023-07-27T14:37:52.392506+0000","last_clean":"2023-07-27T14:37:52.392506+0000","last_became_active":"2023-07-27T14:37:51.916638+0000","last_became_peered":"2023-07-27T14:37:51.916638+0000","last_unstale":"2023-07-27T14:37:52.392506+0000","last_undegraded":"2023-07-27T14:37:52.392506+0000","last_fullsized":"2023-07-27T14:37:52.392506+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388427+0000","last_change":"2023-07-27T14:37:52.386208+0000","last_active":"2023-07-27T14:37:52.388427+0000","last_peered":"2023-07-27T14:37:52.388427+0000","last_clean":"2023-07-27T14:37:52.388427+0000","last_became_active":"2023-07-27T14:37:52.385849+0000","last_became_peered":"2023-07-27T14:37:52.385849+0000","last_unstale":"2023-07-27T14:37:52.388427+0000","last_undegraded":"2023-07-27T14:37:52.388427+0000","last_fullsized":"2023-07-27T14:37:52.388427+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370750+0000","last_change":"2023-07-27T14:37:51.922708+0000","last_active":"2023-07-27T14:37:52.370750+0000","last_peered":"2023-07-27T14:37:52.370750+0000","last_clean":"2023-07-27T14:37:52.370750+0000","last_became_active":"2023-07-27T14:37:51.922302+0000","last_became_peered":"2023-07-27T14:37:51.922302+0000","last_unstale":"2023-07-27T14:37:52.370750+0000","last_undegraded":"2023-07-27T14:37:52.370750+0000","last_fullsized":"2023-07-27T14:37:52.370750+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.383808+0000","last_change":"2023-07-27T14:37:52.382041+0000","last_active":"2023-07-27T14:37:52.383808+0000","last_peered":"2023-07-27T14:37:52.383808+0000","last_clean":"2023-07-27T14:37:52.383808+0000","last_became_active":"2023-07-27T14:37:52.381729+0000","last_became_peered":"2023-07-27T14:37:52.381729+0000","last_unstale":"2023-07-27T14:37:52.383808+0000","last_undegraded":"2023-07-27T14:37:52.383808+0000","last_fullsized":"2023-07-27T14:37:52.383808+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.362812+0000","last_change":"2023-07-27T14:37:51.911390+0000","last_active":"2023-07-27T14:37:52.362812+0000","last_peered":"2023-07-27T14:37:52.362812+0000","last_clean":"2023-07-27T14:37:52.362812+0000","last_became_active":"2023-07-27T14:37:51.911099+0000","last_became_peered":"2023-07-27T14:37:51.911099+0000","last_unstale":"2023-07-27T14:37:52.362812+0000","last_undegraded":"2023-07-27T14:37:52.362812+0000","last_fullsized":"2023-07-27T14:37:52.362812+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392322+0000","last_change":"2023-07-27T14:37:52.390114+0000","last_active":"2023-07-27T14:37:52.392322+0000","last_peered":"2023-07-27T14:37:52.392322+0000","last_clean":"2023-07-27T14:37:52.392322+0000","last_became_active":"2023-07-27T14:37:52.389772+0000","last_became_peered":"2023-07-27T14:37:52.389772+0000","last_unstale":"2023-07-27T14:37:52.392322+0000","last_undegraded":"2023-07-27T14:37:52.392322+0000","last_fullsized":"2023-07-27T14:37:52.392322+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391464+0000","last_change":"2023-07-27T14:37:51.918939+0000","last_active":"2023-07-27T14:37:52.391464+0000","last_peered":"2023-07-27T14:37:52.391464+0000","last_clean":"2023-07-27T14:37:52.391464+0000","last_became_active":"2023-07-27T14:37:51.918649+0000","last_became_peered":"2023-07-27T14:37:51.918649+0000","last_unstale":"2023-07-27T14:37:52.391464+0000","last_undegraded":"2023-07-27T14:37:52.391464+0000","last_fullsized":"2023-07-27T14:37:52.391464+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.387575+0000","last_change":"2023-07-27T14:37:52.379965+0000","last_active":"2023-07-27T14:37:52.387575+0000","last_peered":"2023-07-27T14:37:52.387575+0000","last_clean":"2023-07-27T14:37:52.387575+0000","last_became_active":"2023-07-27T14:37:52.379642+0000","last_became_peered":"2023-07-27T14:37:52.379642+0000","last_unstale":"2023-07-27T14:37:52.387575+0000","last_undegraded":"2023-07-27T14:37:52.387575+0000","last_fullsized":"2023-07-27T14:37:52.387575+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.365825+0000","last_change":"2023-07-27T14:37:51.912765+0000","last_active":"2023-07-27T14:37:52.365825+0000","last_peered":"2023-07-27T14:37:52.365825+0000","last_clean":"2023-07-27T14:37:52.365825+0000","last_became_active":"2023-07-27T14:37:51.912391+0000","last_became_peered":"2023-07-27T14:37:51.912391+0000","last_unstale":"2023-07-27T14:37:52.365825+0000","last_undegraded":"2023-07-27T14:37:52.365825+0000","last_fullsized":"2023-07-27T14:37:52.365825+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388847+0000","last_change":"2023-07-27T14:37:52.380773+0000","last_active":"2023-07-27T14:37:52.388847+0000","last_peered":"2023-07-27T14:37:52.388847+0000","last_clean":"2023-07-27T14:37:52.388847+0000","last_became_active":"2023-07-27T14:37:52.380529+0000","last_became_peered":"2023-07-27T14:37:52.380529+0000","last_unstale":"2023-07-27T14:37:52.388847+0000","last_undegraded":"2023-07-27T14:37:52.388847+0000","last_fullsized":"2023-07-27T14:37:52.388847+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366464+0000","last_change":"2023-07-27T14:37:51.915878+0000","last_active":"2023-07-27T14:37:52.366464+0000","last_peered":"2023-07-27T14:37:52.366464+0000","last_clean":"2023-07-27T14:37:52.366464+0000","last_became_active":"2023-07-27T14:37:51.915169+0000","last_became_peered":"2023-07-27T14:37:51.915169+0000","last_unstale":"2023-07-27T14:37:52.366464+0000","last_undegraded":"2023-07-27T14:37:52.366464+0000","last_fullsized":"2023-07-27T14:37:52.366464+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390258+0000","last_change":"2023-07-27T14:37:52.383729+0000","last_active":"2023-07-27T14:37:52.390258+0000","last_peered":"2023-07-27T14:37:52.390258+0000","last_clean":"2023-07-27T14:37:52.390258+0000","last_became_active":"2023-07-27T14:37:52.383436+0000","last_became_peered":"2023-07-27T14:37:52.383436+0000","last_unstale":"2023-07-27T14:37:52.390258+0000","last_undegraded":"2023-07-27T14:37:52.390258+0000","last_fullsized":"2023-07-27T14:37:52.390258+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367710+0000","last_change":"2023-07-27T14:37:51.918605+0000","last_active":"2023-07-27T14:37:52.367710+0000","last_peered":"2023-07-27T14:37:52.367710+0000","last_clean":"2023-07-27T14:37:52.367710+0000","last_became_active":"2023-07-27T14:37:51.918336+0000","last_became_peered":"2023-07-27T14:37:51.918336+0000","last_unstale":"2023-07-27T14:37:52.367710+0000","last_undegraded":"2023-07-27T14:37:52.367710+0000","last_fullsized":"2023-07-27T14:37:52.367710+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.381320+0000","last_change":"2023-07-27T14:37:52.378718+0000","last_active":"2023-07-27T14:37:52.381320+0000","last_peered":"2023-07-27T14:37:52.381320+0000","last_clean":"2023-07-27T14:37:52.381320+0000","last_became_active":"2023-07-27T14:37:52.378442+0000","last_became_peered":"2023-07-27T14:37:52.378442+0000","last_unstale":"2023-07-27T14:37:52.381320+0000","last_undegraded":"2023-07-27T14:37:52.381320+0000","last_fullsized":"2023-07-27T14:37:52.381320+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390144+0000","last_change":"2023-07-27T14:37:51.918370+0000","last_active":"2023-07-27T14:37:52.390144+0000","last_peered":"2023-07-27T14:37:52.390144+0000","last_clean":"2023-07-27T14:37:52.390144+0000","last_became_active":"2023-07-27T14:37:51.918064+0000","last_became_peered":"2023-07-27T14:37:51.918064+0000","last_unstale":"2023-07-27T14:37:52.390144+0000","last_undegraded":"2023-07-27T14:37:52.390144+0000","last_fullsized":"2023-07-27T14:37:52.390144+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.379932+0000","last_change":"2023-07-27T14:37:52.375199+0000","last_active":"2023-07-27T14:37:52.379932+0000","last_peered":"2023-07-27T14:37:52.379932+0000","last_clean":"2023-07-27T14:37:52.379932+0000","last_became_active":"2023-07-27T14:37:52.374773+0000","last_became_peered":"2023-07-27T14:37:52.374773+0000","last_unstale":"2023-07-27T14:37:52.379932+0000","last_undegraded":"2023-07-27T14:37:52.379932+0000","last_fullsized":"2023-07-27T14:37:52.379932+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372118+0000","last_change":"2023-07-27T14:37:51.919407+0000","last_active":"2023-07-27T14:37:52.372118+0000","last_peered":"2023-07-27T14:37:52.372118+0000","last_clean":"2023-07-27T14:37:52.372118+0000","last_became_active":"2023-07-27T14:37:51.918262+0000","last_became_peered":"2023-07-27T14:37:51.918262+0000","last_unstale":"2023-07-27T14:37:52.372118+0000","last_undegraded":"2023-07-27T14:37:52.372118+0000","last_fullsized":"2023-07-27T14:37:52.372118+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.382269+0000","last_change":"2023-07-27T14:37:52.378766+0000","last_active":"2023-07-27T14:37:52.382269+0000","last_peered":"2023-07-27T14:37:52.382269+0000","last_clean":"2023-07-27T14:37:52.382269+0000","last_became_active":"2023-07-27T14:37:52.378473+0000","last_became_peered":"2023-07-27T14:37:52.378473+0000","last_unstale":"2023-07-27T14:37:52.382269+0000","last_undegraded":"2023-07-27T14:37:52.382269+0000","last_fullsized":"2023-07-27T14:37:52.382269+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.371713+0000","last_change":"2023-07-27T14:37:51.924281+0000","last_active":"2023-07-27T14:37:52.371713+0000","last_peered":"2023-07-27T14:37:52.371713+0000","last_clean":"2023-07-27T14:37:52.371713+0000","last_became_active":"2023-07-27T14:37:51.924005+0000","last_became_peered":"2023-07-27T14:37:51.924005+0000","last_unstale":"2023-07-27T14:37:52.371713+0000","last_undegraded":"2023-07-27T14:37:52.371713+0000","last_fullsized":"2023-07-27T14:37:52.371713+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.380250+0000","last_change":"2023-07-27T14:37:52.376763+0000","last_active":"2023-07-27T14:37:52.380250+0000","last_peered":"2023-07-27T14:37:52.380250+0000","last_clean":"2023-07-27T14:37:52.380250+0000","last_became_active":"2023-07-27T14:37:52.376429+0000","last_became_peered":"2023-07-27T14:37:52.376429+0000","last_unstale":"2023-07-27T14:37:52.380250+0000","last_undegraded":"2023-07-27T14:37:52.380250+0000","last_fullsized":"2023-07-27T14:37:52.380250+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.364245+0000","last_change":"2023-07-27T14:37:51.919149+0000","last_active":"2023-07-27T14:37:52.364245+0000","last_peered":"2023-07-27T14:37:52.364245+0000","last_clean":"2023-07-27T14:37:52.364245+0000","last_became_active":"2023-07-27T14:37:51.918923+0000","last_became_peered":"2023-07-27T14:37:51.918923+0000","last_unstale":"2023-07-27T14:37:52.364245+0000","last_undegraded":"2023-07-27T14:37:52.364245+0000","last_fullsized":"2023-07-27T14:37:52.364245+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390418+0000","last_change":"2023-07-27T14:37:52.385385+0000","last_active":"2023-07-27T14:37:52.390418+0000","last_peered":"2023-07-27T14:37:52.390418+0000","last_clean":"2023-07-27T14:37:52.390418+0000","last_became_active":"2023-07-27T14:37:52.385075+0000","last_became_peered":"2023-07-27T14:37:52.385075+0000","last_unstale":"2023-07-27T14:37:52.390418+0000","last_undegraded":"2023-07-27T14:37:52.390418+0000","last_fullsized":"2023-07-27T14:37:52.390418+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.374730+0000","last_change":"2023-07-27T14:37:51.928175+0000","last_active":"2023-07-27T14:37:52.374730+0000","last_peered":"2023-07-27T14:37:52.374730+0000","last_clean":"2023-07-27T14:37:52.374730+0000","last_became_active":"2023-07-27T14:37:51.927856+0000","last_became_peered":"2023-07-27T14:37:51.927856+0000","last_unstale":"2023-07-27T14:37:52.374730+0000","last_undegraded":"2023-07-27T14:37:52.374730+0000","last_fullsized":"2023-07-27T14:37:52.374730+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.386002+0000","last_change":"2023-07-27T14:37:52.377370+0000","last_active":"2023-07-27T14:37:52.386002+0000","last_peered":"2023-07-27T14:37:52.386002+0000","last_clean":"2023-07-27T14:37:52.386002+0000","last_became_active":"2023-07-27T14:37:52.377061+0000","last_became_peered":"2023-07-27T14:37:52.377061+0000","last_unstale":"2023-07-27T14:37:52.386002+0000","last_undegraded":"2023-07-27T14:37:52.386002+0000","last_fullsized":"2023-07-27T14:37:52.386002+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.369047+0000","last_change":"2023-07-27T14:37:51.926828+0000","last_active":"2023-07-27T14:37:52.369047+0000","last_peered":"2023-07-27T14:37:52.369047+0000","last_clean":"2023-07-27T14:37:52.369047+0000","last_became_active":"2023-07-27T14:37:51.924896+0000","last_became_peered":"2023-07-27T14:37:51.924896+0000","last_unstale":"2023-07-27T14:37:52.369047+0000","last_undegraded":"2023-07-27T14:37:52.369047+0000","last_fullsized":"2023-07-27T14:37:52.369047+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392684+0000","last_change":"2023-07-27T14:37:52.390479+0000","last_active":"2023-07-27T14:37:52.392684+0000","last_peered":"2023-07-27T14:37:52.392684+0000","last_clean":"2023-07-27T14:37:52.392684+0000","last_became_active":"2023-07-27T14:37:52.388963+0000","last_became_peered":"2023-07-27T14:37:52.388963+0000","last_unstale":"2023-07-27T14:37:52.392684+0000","last_undegraded":"2023-07-27T14:37:52.392684+0000","last_fullsized":"2023-07-27T14:37:52.392684+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366884+0000","last_change":"2023-07-27T14:37:51.917028+0000","last_active":"2023-07-27T14:37:52.366884+0000","last_peered":"2023-07-27T14:37:52.366884+0000","last_clean":"2023-07-27T14:37:52.366884+0000","last_became_active":"2023-07-27T14:37:51.914837+0000","last_became_peered":"2023-07-27T14:37:51.914837+0000","last_unstale":"2023-07-27T14:37:52.366884+0000","last_undegraded":"2023-07-27T14:37:52.366884+0000","last_fullsized":"2023-07-27T14:37:52.366884+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393540+0000","last_change":"2023-07-27T14:37:52.390334+0000","last_active":"2023-07-27T14:37:52.393540+0000","last_peered":"2023-07-27T14:37:52.393540+0000","last_clean":"2023-07-27T14:37:52.393540+0000","last_became_active":"2023-07-27T14:37:52.387829+0000","last_became_peered":"2023-07-27T14:37:52.387829+0000","last_unstale":"2023-07-27T14:37:52.393540+0000","last_undegraded":"2023-07-27T14:37:52.393540+0000","last_fullsized":"2023-07-27T14:37:52.393540+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370895+0000","last_change":"2023-07-27T14:37:51.919747+0000","last_active":"2023-07-27T14:37:52.370895+0000","last_peered":"2023-07-27T14:37:52.370895+0000","last_clean":"2023-07-27T14:37:52.370895+0000","last_became_active":"2023-07-27T14:37:51.919491+0000","last_became_peered":"2023-07-27T14:37:51.919491+0000","last_unstale":"2023-07-27T14:37:52.370895+0000","last_undegraded":"2023-07-27T14:37:52.370895+0000","last_fullsized":"2023-07-27T14:37:52.370895+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.382754+0000","last_change":"2023-07-27T14:37:52.379473+0000","last_active":"2023-07-27T14:37:52.382754+0000","last_peered":"2023-07-27T14:37:52.382754+0000","last_clean":"2023-07-27T14:37:52.382754+0000","last_became_active":"2023-07-27T14:37:52.377710+0000","last_became_peered":"2023-07-27T14:37:52.377710+0000","last_unstale":"2023-07-27T14:37:52.382754+0000","last_undegraded":"2023-07-27T14:37:52.382754+0000","last_fullsized":"2023-07-27T14:37:52.382754+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366737+0000","last_change":"2023-07-27T14:37:51.912510+0000","last_active":"2023-07-27T14:37:52.366737+0000","last_peered":"2023-07-27T14:37:52.366737+0000","last_clean":"2023-07-27T14:37:52.366737+0000","last_became_active":"2023-07-27T14:37:51.912177+0000","last_became_peered":"2023-07-27T14:37:51.912177+0000","last_unstale":"2023-07-27T14:37:52.366737+0000","last_undegraded":"2023-07-27T14:37:52.366737+0000","last_fullsized":"2023-07-27T14:37:52.366737+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.362887+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:37:52.362887+0000","last_peered":"2023-07-27T14:37:52.362887+0000","last_clean":"2023-07-27T14:37:52.362887+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:37:52.362887+0000","last_undegraded":"2023-07-27T14:37:52.362887+0000","last_fullsized":"2023-07-27T14:37:52.362887+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.385512+0000","last_change":"2023-07-27T14:37:52.377528+0000","last_active":"2023-07-27T14:37:52.385512+0000","last_peered":"2023-07-27T14:37:52.385512+0000","last_clean":"2023-07-27T14:37:52.385512+0000","last_became_active":"2023-07-27T14:37:52.377227+0000","last_became_peered":"2023-07-27T14:37:52.377227+0000","last_unstale":"2023-07-27T14:37:52.385512+0000","last_undegraded":"2023-07-27T14:37:52.385512+0000","last_fullsized":"2023-07-27T14:37:52.385512+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.369960+0000","last_change":"2023-07-27T14:37:51.912927+0000","last_active":"2023-07-27T14:37:52.369960+0000","last_peered":"2023-07-27T14:37:52.369960+0000","last_clean":"2023-07-27T14:37:52.369960+0000","last_became_active":"2023-07-27T14:37:51.912589+0000","last_became_peered":"2023-07-27T14:37:51.912589+0000","last_unstale":"2023-07-27T14:37:52.369960+0000","last_undegraded":"2023-07-27T14:37:52.369960+0000","last_fullsized":"2023-07-27T14:37:52.369960+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":147,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.365914+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:37:52.365914+0000","last_peered":"2023-07-27T14:37:52.365914+0000","last_clean":"2023-07-27T14:37:52.365914+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:37:52.365914+0000","last_undegraded":"2023-07-27T14:37:52.365914+0000","last_fullsized":"2023-07-27T14:37:52.365914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393035+0000","last_change":"2023-07-27T14:37:52.387896+0000","last_active":"2023-07-27T14:37:52.393035+0000","last_peered":"2023-07-27T14:37:52.393035+0000","last_clean":"2023-07-27T14:37:52.393035+0000","last_became_active":"2023-07-27T14:37:52.387638+0000","last_became_peered":"2023-07-27T14:37:52.387638+0000","last_unstale":"2023-07-27T14:37:52.393035+0000","last_undegraded":"2023-07-27T14:37:52.393035+0000","last_fullsized":"2023-07-27T14:37:52.393035+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392756+0000","last_change":"2023-07-27T14:37:51.923494+0000","last_active":"2023-07-27T14:37:52.392756+0000","last_peered":"2023-07-27T14:37:52.392756+0000","last_clean":"2023-07-27T14:37:52.392756+0000","last_became_active":"2023-07-27T14:37:51.921290+0000","last_became_peered":"2023-07-27T14:37:51.921290+0000","last_unstale":"2023-07-27T14:37:52.392756+0000","last_undegraded":"2023-07-27T14:37:52.392756+0000","last_fullsized":"2023-07-27T14:37:52.392756+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":148,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366376+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:37:52.366376+0000","last_peered":"2023-07-27T14:37:52.366376+0000","last_clean":"2023-07-27T14:37:52.366376+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:37:52.366376+0000","last_undegraded":"2023-07-27T14:37:52.366376+0000","last_fullsized":"2023-07-27T14:37:52.366376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.386534+0000","last_change":"2023-07-27T14:37:52.379274+0000","last_active":"2023-07-27T14:37:52.386534+0000","last_peered":"2023-07-27T14:37:52.386534+0000","last_clean":"2023-07-27T14:37:52.386534+0000","last_became_active":"2023-07-27T14:37:52.378939+0000","last_became_peered":"2023-07-27T14:37:52.378939+0000","last_unstale":"2023-07-27T14:37:52.386534+0000","last_undegraded":"2023-07-27T14:37:52.386534+0000","last_fullsized":"2023-07-27T14:37:52.386534+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372025+0000","last_change":"2023-07-27T14:37:51.919566+0000","last_active":"2023-07-27T14:37:52.372025+0000","last_peered":"2023-07-27T14:37:52.372025+0000","last_clean":"2023-07-27T14:37:52.372025+0000","last_became_active":"2023-07-27T14:37:51.918692+0000","last_became_peered":"2023-07-27T14:37:51.918692+0000","last_unstale":"2023-07-27T14:37:52.372025+0000","last_undegraded":"2023-07-27T14:37:52.372025+0000","last_fullsized":"2023-07-27T14:37:52.372025+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":147,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367079+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:37:52.367079+0000","last_peered":"2023-07-27T14:37:52.367079+0000","last_clean":"2023-07-27T14:37:52.367079+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:37:52.367079+0000","last_undegraded":"2023-07-27T14:37:52.367079+0000","last_fullsized":"2023-07-27T14:37:52.367079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367712+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:37:52.367712+0000","last_peered":"2023-07-27T14:37:52.367712+0000","last_clean":"2023-07-27T14:37:52.367712+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:37:52.367712+0000","last_undegraded":"2023-07-27T14:37:52.367712+0000","last_fullsized":"2023-07-27T14:37:52.367712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.383456+0000","last_change":"2023-07-27T14:37:52.379369+0000","last_active":"2023-07-27T14:37:52.383456+0000","last_peered":"2023-07-27T14:37:52.383456+0000","last_clean":"2023-07-27T14:37:52.383456+0000","last_became_active":"2023-07-27T14:37:52.379108+0000","last_became_peered":"2023-07-27T14:37:52.379108+0000","last_unstale":"2023-07-27T14:37:52.383456+0000","last_undegraded":"2023-07-27T14:37:52.383456+0000","last_fullsized":"2023-07-27T14:37:52.383456+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"173'3","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394795+0000","last_change":"2023-07-27T14:37:51.919982+0000","last_active":"2023-07-27T14:37:52.394795+0000","last_peered":"2023-07-27T14:37:52.394795+0000","last_clean":"2023-07-27T14:37:52.394795+0000","last_became_active":"2023-07-27T14:37:51.919661+0000","last_became_peered":"2023-07-27T14:37:51.919661+0000","last_unstale":"2023-07-27T14:37:52.394795+0000","last_undegraded":"2023-07-27T14:37:52.394795+0000","last_fullsized":"2023-07-27T14:37:52.394795+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367821+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:37:52.367821+0000","last_peered":"2023-07-27T14:37:52.367821+0000","last_clean":"2023-07-27T14:37:52.367821+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:37:52.367821+0000","last_undegraded":"2023-07-27T14:37:52.367821+0000","last_fullsized":"2023-07-27T14:37:52.367821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394921+0000","last_change":"2023-07-27T14:37:52.391332+0000","last_active":"2023-07-27T14:37:52.394921+0000","last_peered":"2023-07-27T14:37:52.394921+0000","last_clean":"2023-07-27T14:37:52.394921+0000","last_became_active":"2023-07-27T14:37:52.391083+0000","last_became_peered":"2023-07-27T14:37:52.391083+0000","last_unstale":"2023-07-27T14:37:52.394921+0000","last_undegraded":"2023-07-27T14:37:52.394921+0000","last_fullsized":"2023-07-27T14:37:52.394921+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"173'4","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392130+0000","last_change":"2023-07-27T14:37:51.916990+0000","last_active":"2023-07-27T14:37:52.392130+0000","last_peered":"2023-07-27T14:37:52.392130+0000","last_clean":"2023-07-27T14:37:52.392130+0000","last_became_active":"2023-07-27T14:37:51.916713+0000","last_became_peered":"2023-07-27T14:37:51.916713+0000","last_unstale":"2023-07-27T14:37:52.392130+0000","last_undegraded":"2023-07-27T14:37:52.392130+0000","last_fullsized":"2023-07-27T14:37:52.392130+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":149,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370667+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:37:52.370667+0000","last_peered":"2023-07-27T14:37:52.370667+0000","last_clean":"2023-07-27T14:37:52.370667+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:37:52.370667+0000","last_undegraded":"2023-07-27T14:37:52.370667+0000","last_fullsized":"2023-07-27T14:37:52.370667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.387891+0000","last_change":"2023-07-27T14:37:52.378390+0000","last_active":"2023-07-27T14:37:52.387891+0000","last_peered":"2023-07-27T14:37:52.387891+0000","last_clean":"2023-07-27T14:37:52.387891+0000","last_became_active":"2023-07-27T14:37:52.378042+0000","last_became_peered":"2023-07-27T14:37:52.378042+0000","last_unstale":"2023-07-27T14:37:52.387891+0000","last_undegraded":"2023-07-27T14:37:52.387891+0000","last_fullsized":"2023-07-27T14:37:52.387891+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388975+0000","last_change":"2023-07-27T14:37:51.907137+0000","last_active":"2023-07-27T14:37:52.388975+0000","last_peered":"2023-07-27T14:37:52.388975+0000","last_clean":"2023-07-27T14:37:52.388975+0000","last_became_active":"2023-07-27T14:37:51.904611+0000","last_became_peered":"2023-07-27T14:37:51.904611+0000","last_unstale":"2023-07-27T14:37:52.388975+0000","last_undegraded":"2023-07-27T14:37:52.388975+0000","last_fullsized":"2023-07-27T14:37:52.388975+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.363474+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:37:52.363474+0000","last_peered":"2023-07-27T14:37:52.363474+0000","last_clean":"2023-07-27T14:37:52.363474+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:37:52.363474+0000","last_undegraded":"2023-07-27T14:37:52.363474+0000","last_fullsized":"2023-07-27T14:37:52.363474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392005+0000","last_change":"2023-07-27T14:37:52.383362+0000","last_active":"2023-07-27T14:37:52.392005+0000","last_peered":"2023-07-27T14:37:52.392005+0000","last_clean":"2023-07-27T14:37:52.392005+0000","last_became_active":"2023-07-27T14:37:52.383099+0000","last_became_peered":"2023-07-27T14:37:52.383099+0000","last_unstale":"2023-07-27T14:37:52.392005+0000","last_undegraded":"2023-07-27T14:37:52.392005+0000","last_fullsized":"2023-07-27T14:37:52.392005+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368961+0000","last_change":"2023-07-27T14:37:51.920283+0000","last_active":"2023-07-27T14:37:52.368961+0000","last_peered":"2023-07-27T14:37:52.368961+0000","last_clean":"2023-07-27T14:37:52.368961+0000","last_became_active":"2023-07-27T14:37:51.920021+0000","last_became_peered":"2023-07-27T14:37:51.920021+0000","last_unstale":"2023-07-27T14:37:52.368961+0000","last_undegraded":"2023-07-27T14:37:52.368961+0000","last_fullsized":"2023-07-27T14:37:52.368961+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372006+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:37:52.372006+0000","last_peered":"2023-07-27T14:37:52.372006+0000","last_clean":"2023-07-27T14:37:52.372006+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:37:52.372006+0000","last_undegraded":"2023-07-27T14:37:52.372006+0000","last_fullsized":"2023-07-27T14:37:52.372006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23252,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":21120,"kb_avail":94348588,"statfs":{"total":96636764160,"available":96612954112,"internally_reserved":0,"allocated":2174976,"data_stored":1026046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21626880},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60799999999999998,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80800000000000005,"5min":0.996,"15min":1.133},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.85399999999999998,"5min":0.92800000000000005,"15min":1.1180000000000001},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83499999999999996,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.70499999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85099999999999998,"5min":0.92500000000000004,"15min":1.1459999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.745,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65900000000000003,"15min":0.68999999999999995},"min":{"1min":0.53100000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.89300000000000002,"5min":0.96499999999999997,"15min":1.119},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.68000000000000005},"min":{"1min":0.495,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82199999999999995,"5min":0.97899999999999998,"15min":1.165},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.318},"max":{"1min":0.89800000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67800000000000005,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95499999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.67300000000000004},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.875,"5min":1.105,"15min":1.202},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.70499999999999996},"min":{"1min":0.53900000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94999999999999996,"5min":1.101,"15min":1.101},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.61399999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0049999999999999,"5min":1.056,"15min":1.056},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.71899999999999997},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.032,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22940,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94348900,"statfs":{"total":96636764160,"available":96613273600,"internally_reserved":0,"allocated":2183168,"data_stored":1032196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.83099999999999996,"5min":0.996,"15min":0.996},"last":0.621}]},{"osd":1,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46200000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.88100000000000001,"15min":0.94399999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.46200000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86499999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":1.01,"15min":1.01},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.66600000000000004},"min":{"1min":0.52900000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":1.2},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.88600000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.45000000000000001,"5min":0.38600000000000001,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.079},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.40400000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.198},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.54400000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93899999999999995,"5min":1.054,"15min":1.1000000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75,"15min":0.76100000000000001},"min":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":1.036,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":0.82099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24020,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":21888,"kb_avail":94347820,"statfs":{"total":96636764160,"available":96612167680,"internally_reserved":0,"allocated":2174976,"data_stored":1025244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22413312},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38200000000000001,"15min":0.46200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23699999999999999},"max":{"1min":0.53400000000000003,"5min":0.61499999999999999,"15min":4.75},"last":0.376},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41499999999999998,"15min":0.56499999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":9.3100000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59799999999999998,"5min":0.64700000000000002,"15min":3.7210000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46000000000000002,"15min":0.50700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.58399999999999996,"5min":0.64300000000000002,"15min":2.7160000000000002},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46500000000000002,"15min":0.502},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":0.55900000000000005,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45700000000000002,"15min":0.52500000000000002},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57099999999999995,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.1639999999999999,"15min":2.181},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.86299999999999999,"5min":1.014,"15min":2.4180000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.74099999999999999},"min":{"1min":0.53200000000000003,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":0.82499999999999996,"5min":1.0980000000000001,"15min":3.7440000000000002},"last":0.627},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45400000000000001},"max":{"1min":0.93999999999999995,"5min":1.131,"15min":2.149},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":1.085,"15min":2.052},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69799999999999995,"15min":0.79000000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88300000000000001,"5min":1.0620000000000001,"15min":6.1980000000000004},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":0.878,"5min":1.1419999999999999,"15min":2.016},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75900000000000001,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91200000000000003,"5min":1.1830000000000001,"15min":3.7799999999999998},"last":0.82299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22544,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":20416,"kb_avail":94349296,"statfs":{"total":96636764160,"available":96613679104,"internally_reserved":0,"allocated":2170880,"data_stored":1024634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20905984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.245},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.55700000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.60999999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.495}]},{"osd":4,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.38600000000000001},"max":{"1min":1.0800000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.998,"5min":1.0489999999999999,"15min":1.25},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":1.0089999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.51200000000000001,"5min":0.498,"15min":0.498},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.22},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.58199999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.57499999999999996,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.2370000000000001},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26192,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":24064,"kb_avail":94345648,"statfs":{"total":96636764160,"available":96609943552,"internally_reserved":0,"allocated":2170880,"data_stored":1024670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24641536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.23799999999999999},"max":{"1min":0.65400000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.436,"15min":0.46100000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.56200000000000006,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.96399999999999997},"last":0.437},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61799999999999999,"5min":5.601,"15min":5.601},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56899999999999995,"5min":0.70799999999999996,"15min":0.83499999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64500000000000002,"5min":1.353,"15min":1.353},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69199999999999995,"15min":0.71599999999999997},"min":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":1.849,"15min":1.849},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.76700000000000002,"15min":0.71699999999999997},"min":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.434},"max":{"1min":0.95499999999999996,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69199999999999995,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":1.006,"5min":1.163,"15min":1.163},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70999999999999996,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.772,"15min":1.772},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73699999999999999,"15min":0.77000000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":0.91500000000000004,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18328,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94353512,"statfs":{"total":96636764160,"available":96617996288,"internally_reserved":0,"allocated":2179072,"data_stored":1025266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.314,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.58199999999999996,"5min":1.202,"15min":1.202},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.432},"min":{"1min":0.32100000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58599999999999997,"5min":0.71199999999999997,"15min":1.302},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41399999999999998,"15min":0.435},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54400000000000004,"5min":0.59299999999999997,"15min":0.88900000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.45400000000000001,"15min":0.44800000000000001},"min":{"1min":0.35199999999999998,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.52800000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.37}]},{"osd":2,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66100000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.499,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":1.2749999999999999,"15min":1.8029999999999999},"last":0.495}]},{"osd":4,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.149},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.49399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.85599999999999998,"5min":1.111,"15min":5.1059999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.232},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92300000000000004,"5min":1.1639999999999999,"15min":2.3959999999999999},"last":0.627}]},{"osd":6,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.96799999999999997,"5min":1.121,"15min":1.298},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":0.94499999999999995,"5min":1.0209999999999999,"15min":1.343},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.77100000000000002},"min":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":1.115,"5min":1.115,"15min":2.048},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.76700000000000002},"min":{"1min":0.54100000000000004,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17176,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":15040,"kb_avail":94354664,"statfs":{"total":96636764160,"available":96619175936,"internally_reserved":0,"allocated":2179072,"data_stored":1024782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15400960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.63600000000000001,"15min":0.66100000000000003},"min":{"1min":0.40699999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67800000000000005,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39500000000000002},"max":{"1min":3.419,"5min":3.419,"15min":4.4409999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.41999999999999998,"15min":0.34899999999999998},"max":{"1min":3.3279999999999998,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.441,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.435,"15min":0.38800000000000001},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":4.476},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.48699999999999999,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":3.3639999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.46700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.7559999999999998,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.48,"5min":3.48,"15min":4.3949999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.67400000000000004,"15min":0.67100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":5.194},"last":1.042},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.387,"5min":2.387,"15min":5.5990000000000002},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.73099999999999998,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.0960000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25380,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":23232,"kb_avail":94346460,"statfs":{"total":96636764160,"available":96610775040,"internally_reserved":0,"allocated":2191360,"data_stored":1031982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23789568},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.76400000000000001,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59399999999999997,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65300000000000002,"15min":0.69199999999999995},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.377},"max":{"1min":0.94299999999999995,"5min":1.026,"15min":6.7489999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.871,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.75700000000000001,"5min":0.98799999999999999,"15min":1.581},"last":0.629},{"interface":"front","average":{"1min":0.627,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.46899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81100000000000005,"5min":0.98999999999999999,"15min":3.8220000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63600000000000001,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.93100000000000005,"15min":9.6920000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71399999999999997,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89700000000000002,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85299999999999998,"5min":0.96099999999999997,"15min":1.978},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38600000000000001},"max":{"1min":0.85399999999999998,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98199999999999998,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69199999999999995,"15min":0.68200000000000005},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72599999999999998},"min":{"1min":0.503,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93100000000000005,"5min":1.115,"15min":1.9419999999999999},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:37:56.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:37:56.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.864+0000 7ff0eedff700 1 Processor -- start 2023-07-27T14:37:56.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.864+0000 7ff0eedff700 1 -- start start 2023-07-27T14:37:56.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.865+0000 7ff0eedff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0e81542a0 0x7ff0e815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.865+0000 7ff0eedff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80aa4d0 con 0x7ff0e80aaa40 2023-07-27T14:37:56.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.865+0000 7ff0eedff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80c05c0 con 0x7ff0e8153ec0 2023-07-27T14:37:56.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0eedff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e80c1a60 con 0x7ff0e81542a0 2023-07-27T14:37:56.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0e7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff0e80aaa40 0x7ff0e80640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42122/0 (socket says 172.21.15.115:42122) 2023-07-27T14:37:56.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0e7fff700 1 -- 172.21.15.115:0/781428622 learned_addr learned my addr 172.21.15.115:0/781428622 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:56.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0ed39c700 1 --2- 172.21.15.115:0/781428622 >> v2:172.21.15.115:3300/0 conn(0x7ff0e81542a0 0x7ff0e815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0e77fe700 1 -- 172.21.15.115:0/781428622 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815263799 0 0) 0x7ff0d4001110 con 0x7ff0e80aaa40 2023-07-27T14:37:56.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0e77fe700 1 -- 172.21.15.115:0/781428622 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d80033f0 con 0x7ff0e80aaa40 2023-07-27T14:37:56.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0ed39c700 1 -- 172.21.15.115:0/781428622 >> v1:172.21.15.159:6789/0 conn(0x7ff0e8153ec0 legacy=0x7ff0e80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:56.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0ed39c700 1 -- 172.21.15.115:0/781428622 >> v1:172.21.15.115:6789/0 conn(0x7ff0e80aaa40 legacy=0x7ff0e80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0ed39c700 1 -- 172.21.15.115:0/781428622 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80aa270 con 0x7ff0e81542a0 2023-07-27T14:37:56.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.866+0000 7ff0ed39c700 1 --2- 172.21.15.115:0/781428622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e81542a0 0x7ff0e815efc0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7ff0e0009e60 tx=0x7ff0e0009780).ready entity=mon.0 client_cookie=7a7b84889c88307c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0e77fe700 1 -- 172.21.15.115:0/781428622 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000e070 con 0x7ff0e81542a0 2023-07-27T14:37:56.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0e77fe700 1 -- 172.21.15.115:0/781428622 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e000bb20 con 0x7ff0e81542a0 2023-07-27T14:37:56.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0e77fe700 1 -- 172.21.15.115:0/781428622 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000bea0 con 0x7ff0e81542a0 2023-07-27T14:37:56.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0eedff700 1 -- 172.21.15.115:0/781428622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e81542a0 msgr2=0x7ff0e815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0eedff700 1 --2- 172.21.15.115:0/781428622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e81542a0 0x7ff0e815efc0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7ff0e0009e60 tx=0x7ff0e0009780).stop 2023-07-27T14:37:56.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0eedff700 1 -- 172.21.15.115:0/781428622 shutdown_connections 2023-07-27T14:37:56.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0eedff700 1 --2- 172.21.15.115:0/781428622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e81542a0 0x7ff0e815efc0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0eedff700 1 -- 172.21.15.115:0/781428622 >> 172.21.15.115:0/781428622 conn(0x7ff0e80cb610 msgr2=0x7ff0e80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:56.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0eedff700 1 -- 172.21.15.115:0/781428622 shutdown_connections 2023-07-27T14:37:56.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.867+0000 7ff0eedff700 1 -- 172.21.15.115:0/781428622 wait complete. 2023-07-27T14:37:56.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.869+0000 7ff0eedff700 1 Processor -- start 2023-07-27T14:37:56.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.869+0000 7ff0eedff700 1 -- start start 2023-07-27T14:37:56.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0eedff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e80aaa40 0x7ff0e8157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0eedff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e8153ec0 0x7ff0e8158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0eedff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e81542a0 0x7ff0e8159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0eedff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e8157e60 con 0x7ff0e8153ec0 2023-07-27T14:37:56.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0eedff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81687c0 con 0x7ff0e80aaa40 2023-07-27T14:37:56.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0eedff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e8167bb0 con 0x7ff0e81542a0 2023-07-27T14:37:56.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0e7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e8153ec0 0x7ff0e8158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0e7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e8153ec0 0x7ff0e8158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43498/0 (socket says 172.21.15.115:43498) 2023-07-27T14:37:56.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0e7fff700 1 -- 172.21.15.115:0/4028382214 learned_addr learned my addr 172.21.15.115:0/4028382214 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:56.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0ed39c700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e81542a0 0x7ff0e8159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0ecb9b700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e80aaa40 0x7ff0e8157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0e7fff700 1 -- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e81542a0 msgr2=0x7ff0e8159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0e7fff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e81542a0 0x7ff0e8159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0e7fff700 1 -- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e80aaa40 msgr2=0x7ff0e8157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:56.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0e7fff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e80aaa40 0x7ff0e8157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:56.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0e7fff700 1 -- 172.21.15.115:0/4028382214 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0009a20 con 0x7ff0e8153ec0 2023-07-27T14:37:56.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.870+0000 7ff0ecb9b700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e80aaa40 0x7ff0e8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:56.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.871+0000 7ff0e7fff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e8153ec0 0x7ff0e8158670 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7ff0d400c470 tx=0x7ff0d4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.871+0000 7ff0e4ff9700 1 -- 172.21.15.115:0/4028382214 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40072e0 con 0x7ff0e8153ec0 2023-07-27T14:37:56.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.871+0000 7ff0e4ff9700 1 -- 172.21.15.115:0/4028382214 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d4007440 con 0x7ff0e8153ec0 2023-07-27T14:37:56.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.871+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e8167e90 con 0x7ff0e8153ec0 2023-07-27T14:37:56.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.871+0000 7ff0e4ff9700 1 -- 172.21.15.115:0/4028382214 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40057a0 con 0x7ff0e8153ec0 2023-07-27T14:37:56.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.871+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e8168450 con 0x7ff0e8153ec0 2023-07-27T14:37:56.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.872+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e806c470 con 0x7ff0e8153ec0 2023-07-27T14:37:56.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.873+0000 7ff0e4ff9700 1 -- 172.21.15.115:0/4028382214 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7ff0d401a060 con 0x7ff0e8153ec0 2023-07-27T14:37:56.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.874+0000 7ff0e4ff9700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0cc05f9f0 0x7ff0cc061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:56.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.874+0000 7ff0e4ff9700 1 -- 172.21.15.115:0/4028382214 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff0d407a5c0 con 0x7ff0e8153ec0 2023-07-27T14:37:56.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.874+0000 7ff0ecb9b700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0cc05f9f0 0x7ff0cc061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:56.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.874+0000 7ff0ecb9b700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0cc05f9f0 0x7ff0cc061eb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7ff0dc0026f0 tx=0x7ff0dc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:56.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:56.878+0000 7ff0e4ff9700 1 -- 172.21.15.115:0/4028382214 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0d404adf0 con 0x7ff0e8153ec0 2023-07-27T14:37:57.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.042+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0e80aa4d0 con 0x7ff0cc05f9f0 2023-07-27T14:37:57.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.052+0000 7ff0e4ff9700 1 -- 172.21.15.115:0/4028382214 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361725 (secure 0 0 0) 0x7ff0e80aa4d0 con 0x7ff0cc05f9f0 2023-07-27T14:37:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0cc05f9f0 msgr2=0x7ff0cc061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0cc05f9f0 0x7ff0cc061eb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7ff0dc0026f0 tx=0x7ff0dc009040).stop 2023-07-27T14:37:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e8153ec0 msgr2=0x7ff0e8158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e8153ec0 0x7ff0e8158670 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7ff0d400c470 tx=0x7ff0d4007ad0).stop 2023-07-27T14:37:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 shutdown_connections 2023-07-27T14:37:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0cc05f9f0 0x7ff0cc061eb0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0e81542a0 0x7ff0e8159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0e80aaa40 0x7ff0e8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 --2- 172.21.15.115:0/4028382214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0e8153ec0 0x7ff0e8158670 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 >> 172.21.15.115:0/4028382214 conn(0x7ff0e80cb610 msgr2=0x7ff0e814f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 shutdown_connections 2023-07-27T14:37:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.057+0000 7ff0eedff700 1 -- 172.21.15.115:0/4028382214 wait complete. 2023-07-27T14:37:57.112 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:37:57.125 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2023-07-27T14:37:55.585830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":179832,"kb_used_data":17016,"kb_used_omap":0,"kb_used_meta":162752,"kb_avail":754794888,"statfs":{"total":773094113280,"available":772909965312,"internally_reserved":0,"allocated":17424384,"data_stored":8214820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":166658048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1816509,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-78,"num_read_kb":-65562,"num_write":-551,"num_write_kb":-132942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-6,"num_bytes_recovered":-5242880,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.177720"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390595+0000","last_change":"2023-07-27T14:37:52.387322+0000","last_active":"2023-07-27T14:37:52.390595+0000","last_peered":"2023-07-27T14:37:52.390595+0000","last_clean":"2023-07-27T14:37:52.390595+0000","last_became_active":"2023-07-27T14:37:52.387049+0000","last_became_peered":"2023-07-27T14:37:52.387049+0000","last_unstale":"2023-07-27T14:37:52.390595+0000","last_undegraded":"2023-07-27T14:37:52.390595+0000","last_fullsized":"2023-07-27T14:37:52.390595+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"173'3","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389953+0000","last_change":"2023-07-27T14:37:51.923519+0000","last_active":"2023-07-27T14:37:52.389953+0000","last_peered":"2023-07-27T14:37:52.389953+0000","last_clean":"2023-07-27T14:37:52.389953+0000","last_became_active":"2023-07-27T14:37:51.923088+0000","last_became_peered":"2023-07-27T14:37:51.923088+0000","last_unstale":"2023-07-27T14:37:52.389953+0000","last_undegraded":"2023-07-27T14:37:52.389953+0000","last_fullsized":"2023-07-27T14:37:52.389953+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.379370+0000","last_change":"2023-07-27T14:37:52.375268+0000","last_active":"2023-07-27T14:37:52.379370+0000","last_peered":"2023-07-27T14:37:52.379370+0000","last_clean":"2023-07-27T14:37:52.379370+0000","last_became_active":"2023-07-27T14:37:52.374954+0000","last_became_peered":"2023-07-27T14:37:52.374954+0000","last_unstale":"2023-07-27T14:37:52.379370+0000","last_undegraded":"2023-07-27T14:37:52.379370+0000","last_fullsized":"2023-07-27T14:37:52.379370+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370500+0000","last_change":"2023-07-27T14:37:51.921514+0000","last_active":"2023-07-27T14:37:52.370500+0000","last_peered":"2023-07-27T14:37:52.370500+0000","last_clean":"2023-07-27T14:37:52.370500+0000","last_became_active":"2023-07-27T14:37:51.921254+0000","last_became_peered":"2023-07-27T14:37:51.921254+0000","last_unstale":"2023-07-27T14:37:52.370500+0000","last_undegraded":"2023-07-27T14:37:52.370500+0000","last_fullsized":"2023-07-27T14:37:52.370500+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390408+0000","last_change":"2023-07-27T14:37:52.385619+0000","last_active":"2023-07-27T14:37:52.390408+0000","last_peered":"2023-07-27T14:37:52.390408+0000","last_clean":"2023-07-27T14:37:52.390408+0000","last_became_active":"2023-07-27T14:37:52.385282+0000","last_became_peered":"2023-07-27T14:37:52.385282+0000","last_unstale":"2023-07-27T14:37:52.390408+0000","last_undegraded":"2023-07-27T14:37:52.390408+0000","last_fullsized":"2023-07-27T14:37:52.390408+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367154+0000","last_change":"2023-07-27T14:37:51.921628+0000","last_active":"2023-07-27T14:37:52.367154+0000","last_peered":"2023-07-27T14:37:52.367154+0000","last_clean":"2023-07-27T14:37:52.367154+0000","last_became_active":"2023-07-27T14:37:51.921164+0000","last_became_peered":"2023-07-27T14:37:51.921164+0000","last_unstale":"2023-07-27T14:37:52.367154+0000","last_undegraded":"2023-07-27T14:37:52.367154+0000","last_fullsized":"2023-07-27T14:37:52.367154+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.384208+0000","last_change":"2023-07-27T14:37:52.381627+0000","last_active":"2023-07-27T14:37:52.384208+0000","last_peered":"2023-07-27T14:37:52.384208+0000","last_clean":"2023-07-27T14:37:52.384208+0000","last_became_active":"2023-07-27T14:37:52.381397+0000","last_became_peered":"2023-07-27T14:37:52.381397+0000","last_unstale":"2023-07-27T14:37:52.384208+0000","last_undegraded":"2023-07-27T14:37:52.384208+0000","last_fullsized":"2023-07-27T14:37:52.384208+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392060+0000","last_change":"2023-07-27T14:37:51.912620+0000","last_active":"2023-07-27T14:37:52.392060+0000","last_peered":"2023-07-27T14:37:52.392060+0000","last_clean":"2023-07-27T14:37:52.392060+0000","last_became_active":"2023-07-27T14:37:51.912335+0000","last_became_peered":"2023-07-27T14:37:51.912335+0000","last_unstale":"2023-07-27T14:37:52.392060+0000","last_undegraded":"2023-07-27T14:37:52.392060+0000","last_fullsized":"2023-07-27T14:37:52.392060+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391268+0000","last_change":"2023-07-27T14:37:52.388887+0000","last_active":"2023-07-27T14:37:52.391268+0000","last_peered":"2023-07-27T14:37:52.391268+0000","last_clean":"2023-07-27T14:37:52.391268+0000","last_became_active":"2023-07-27T14:37:52.388542+0000","last_became_peered":"2023-07-27T14:37:52.388542+0000","last_unstale":"2023-07-27T14:37:52.391268+0000","last_undegraded":"2023-07-27T14:37:52.391268+0000","last_fullsized":"2023-07-27T14:37:52.391268+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389569+0000","last_change":"2023-07-27T14:37:51.924787+0000","last_active":"2023-07-27T14:37:52.389569+0000","last_peered":"2023-07-27T14:37:52.389569+0000","last_clean":"2023-07-27T14:37:52.389569+0000","last_became_active":"2023-07-27T14:37:51.924435+0000","last_became_peered":"2023-07-27T14:37:51.924435+0000","last_unstale":"2023-07-27T14:37:52.389569+0000","last_undegraded":"2023-07-27T14:37:52.389569+0000","last_fullsized":"2023-07-27T14:37:52.389569+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388306+0000","last_change":"2023-07-27T14:37:52.384944+0000","last_active":"2023-07-27T14:37:52.388306+0000","last_peered":"2023-07-27T14:37:52.388306+0000","last_clean":"2023-07-27T14:37:52.388306+0000","last_became_active":"2023-07-27T14:37:52.384653+0000","last_became_peered":"2023-07-27T14:37:52.384653+0000","last_unstale":"2023-07-27T14:37:52.388306+0000","last_undegraded":"2023-07-27T14:37:52.388306+0000","last_fullsized":"2023-07-27T14:37:52.388306+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393074+0000","last_change":"2023-07-27T14:37:51.924720+0000","last_active":"2023-07-27T14:37:52.393074+0000","last_peered":"2023-07-27T14:37:52.393074+0000","last_clean":"2023-07-27T14:37:52.393074+0000","last_became_active":"2023-07-27T14:37:51.924420+0000","last_became_peered":"2023-07-27T14:37:51.924420+0000","last_unstale":"2023-07-27T14:37:52.393074+0000","last_undegraded":"2023-07-27T14:37:52.393074+0000","last_fullsized":"2023-07-27T14:37:52.393074+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392566+0000","last_change":"2023-07-27T14:37:52.384875+0000","last_active":"2023-07-27T14:37:52.392566+0000","last_peered":"2023-07-27T14:37:52.392566+0000","last_clean":"2023-07-27T14:37:52.392566+0000","last_became_active":"2023-07-27T14:37:52.384614+0000","last_became_peered":"2023-07-27T14:37:52.384614+0000","last_unstale":"2023-07-27T14:37:52.392566+0000","last_undegraded":"2023-07-27T14:37:52.392566+0000","last_fullsized":"2023-07-27T14:37:52.392566+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368278+0000","last_change":"2023-07-27T14:37:51.920499+0000","last_active":"2023-07-27T14:37:52.368278+0000","last_peered":"2023-07-27T14:37:52.368278+0000","last_clean":"2023-07-27T14:37:52.368278+0000","last_became_active":"2023-07-27T14:37:51.920128+0000","last_became_peered":"2023-07-27T14:37:51.920128+0000","last_unstale":"2023-07-27T14:37:52.368278+0000","last_undegraded":"2023-07-27T14:37:52.368278+0000","last_fullsized":"2023-07-27T14:37:52.368278+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.387427+0000","last_change":"2023-07-27T14:37:52.379805+0000","last_active":"2023-07-27T14:37:52.387427+0000","last_peered":"2023-07-27T14:37:52.387427+0000","last_clean":"2023-07-27T14:37:52.387427+0000","last_became_active":"2023-07-27T14:37:52.379521+0000","last_became_peered":"2023-07-27T14:37:52.379521+0000","last_unstale":"2023-07-27T14:37:52.387427+0000","last_undegraded":"2023-07-27T14:37:52.387427+0000","last_fullsized":"2023-07-27T14:37:52.387427+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368498+0000","last_change":"2023-07-27T14:37:51.925909+0000","last_active":"2023-07-27T14:37:52.368498+0000","last_peered":"2023-07-27T14:37:52.368498+0000","last_clean":"2023-07-27T14:37:52.368498+0000","last_became_active":"2023-07-27T14:37:51.925620+0000","last_became_peered":"2023-07-27T14:37:51.925620+0000","last_unstale":"2023-07-27T14:37:52.368498+0000","last_undegraded":"2023-07-27T14:37:52.368498+0000","last_fullsized":"2023-07-27T14:37:52.368498+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392177+0000","last_change":"2023-07-27T14:37:52.384838+0000","last_active":"2023-07-27T14:37:52.392177+0000","last_peered":"2023-07-27T14:37:52.392177+0000","last_clean":"2023-07-27T14:37:52.392177+0000","last_became_active":"2023-07-27T14:37:52.384554+0000","last_became_peered":"2023-07-27T14:37:52.384554+0000","last_unstale":"2023-07-27T14:37:52.392177+0000","last_undegraded":"2023-07-27T14:37:52.392177+0000","last_fullsized":"2023-07-27T14:37:52.392177+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372238+0000","last_change":"2023-07-27T14:37:51.924799+0000","last_active":"2023-07-27T14:37:52.372238+0000","last_peered":"2023-07-27T14:37:52.372238+0000","last_clean":"2023-07-27T14:37:52.372238+0000","last_became_active":"2023-07-27T14:37:51.924443+0000","last_became_peered":"2023-07-27T14:37:51.924443+0000","last_unstale":"2023-07-27T14:37:52.372238+0000","last_undegraded":"2023-07-27T14:37:52.372238+0000","last_fullsized":"2023-07-27T14:37:52.372238+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.379914+0000","last_change":"2023-07-27T14:37:52.375026+0000","last_active":"2023-07-27T14:37:52.379914+0000","last_peered":"2023-07-27T14:37:52.379914+0000","last_clean":"2023-07-27T14:37:52.379914+0000","last_became_active":"2023-07-27T14:37:52.374393+0000","last_became_peered":"2023-07-27T14:37:52.374393+0000","last_unstale":"2023-07-27T14:37:52.379914+0000","last_undegraded":"2023-07-27T14:37:52.379914+0000","last_fullsized":"2023-07-27T14:37:52.379914+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370604+0000","last_change":"2023-07-27T14:37:51.918789+0000","last_active":"2023-07-27T14:37:52.370604+0000","last_peered":"2023-07-27T14:37:52.370604+0000","last_clean":"2023-07-27T14:37:52.370604+0000","last_became_active":"2023-07-27T14:37:51.918469+0000","last_became_peered":"2023-07-27T14:37:51.918469+0000","last_unstale":"2023-07-27T14:37:52.370604+0000","last_undegraded":"2023-07-27T14:37:52.370604+0000","last_fullsized":"2023-07-27T14:37:52.370604+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391153+0000","last_change":"2023-07-27T14:37:52.387486+0000","last_active":"2023-07-27T14:37:52.391153+0000","last_peered":"2023-07-27T14:37:52.391153+0000","last_clean":"2023-07-27T14:37:52.391153+0000","last_became_active":"2023-07-27T14:37:52.387170+0000","last_became_peered":"2023-07-27T14:37:52.387170+0000","last_unstale":"2023-07-27T14:37:52.391153+0000","last_undegraded":"2023-07-27T14:37:52.391153+0000","last_fullsized":"2023-07-27T14:37:52.391153+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.369646+0000","last_change":"2023-07-27T14:37:51.921578+0000","last_active":"2023-07-27T14:37:52.369646+0000","last_peered":"2023-07-27T14:37:52.369646+0000","last_clean":"2023-07-27T14:37:52.369646+0000","last_became_active":"2023-07-27T14:37:51.921294+0000","last_became_peered":"2023-07-27T14:37:51.921294+0000","last_unstale":"2023-07-27T14:37:52.369646+0000","last_undegraded":"2023-07-27T14:37:52.369646+0000","last_fullsized":"2023-07-27T14:37:52.369646+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390532+0000","last_change":"2023-07-27T14:37:52.386646+0000","last_active":"2023-07-27T14:37:52.390532+0000","last_peered":"2023-07-27T14:37:52.390532+0000","last_clean":"2023-07-27T14:37:52.390532+0000","last_became_active":"2023-07-27T14:37:52.386366+0000","last_became_peered":"2023-07-27T14:37:52.386366+0000","last_unstale":"2023-07-27T14:37:52.390532+0000","last_undegraded":"2023-07-27T14:37:52.390532+0000","last_fullsized":"2023-07-27T14:37:52.390532+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"173'4","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394906+0000","last_change":"2023-07-27T14:37:51.923415+0000","last_active":"2023-07-27T14:37:52.394906+0000","last_peered":"2023-07-27T14:37:52.394906+0000","last_clean":"2023-07-27T14:37:52.394906+0000","last_became_active":"2023-07-27T14:37:51.923106+0000","last_became_peered":"2023-07-27T14:37:51.923106+0000","last_unstale":"2023-07-27T14:37:52.394906+0000","last_undegraded":"2023-07-27T14:37:52.394906+0000","last_fullsized":"2023-07-27T14:37:52.394906+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390547+0000","last_change":"2023-07-27T14:37:52.387282+0000","last_active":"2023-07-27T14:37:52.390547+0000","last_peered":"2023-07-27T14:37:52.390547+0000","last_clean":"2023-07-27T14:37:52.390547+0000","last_became_active":"2023-07-27T14:37:52.386974+0000","last_became_peered":"2023-07-27T14:37:52.386974+0000","last_unstale":"2023-07-27T14:37:52.390547+0000","last_undegraded":"2023-07-27T14:37:52.390547+0000","last_fullsized":"2023-07-27T14:37:52.390547+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391277+0000","last_change":"2023-07-27T14:37:51.913070+0000","last_active":"2023-07-27T14:37:52.391277+0000","last_peered":"2023-07-27T14:37:52.391277+0000","last_clean":"2023-07-27T14:37:52.391277+0000","last_became_active":"2023-07-27T14:37:51.912786+0000","last_became_peered":"2023-07-27T14:37:51.912786+0000","last_unstale":"2023-07-27T14:37:52.391277+0000","last_undegraded":"2023-07-27T14:37:52.391277+0000","last_fullsized":"2023-07-27T14:37:52.391277+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388683+0000","last_change":"2023-07-27T14:37:52.384839+0000","last_active":"2023-07-27T14:37:52.388683+0000","last_peered":"2023-07-27T14:37:52.388683+0000","last_clean":"2023-07-27T14:37:52.388683+0000","last_became_active":"2023-07-27T14:37:52.384531+0000","last_became_peered":"2023-07-27T14:37:52.384531+0000","last_unstale":"2023-07-27T14:37:52.388683+0000","last_undegraded":"2023-07-27T14:37:52.388683+0000","last_fullsized":"2023-07-27T14:37:52.388683+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.365696+0000","last_change":"2023-07-27T14:37:51.918283+0000","last_active":"2023-07-27T14:37:52.365696+0000","last_peered":"2023-07-27T14:37:52.365696+0000","last_clean":"2023-07-27T14:37:52.365696+0000","last_became_active":"2023-07-27T14:37:51.918000+0000","last_became_peered":"2023-07-27T14:37:51.918000+0000","last_unstale":"2023-07-27T14:37:52.365696+0000","last_undegraded":"2023-07-27T14:37:52.365696+0000","last_fullsized":"2023-07-27T14:37:52.365696+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.381933+0000","last_change":"2023-07-27T14:37:52.377186+0000","last_active":"2023-07-27T14:37:52.381933+0000","last_peered":"2023-07-27T14:37:52.381933+0000","last_clean":"2023-07-27T14:37:52.381933+0000","last_became_active":"2023-07-27T14:37:52.376843+0000","last_became_peered":"2023-07-27T14:37:52.376843+0000","last_unstale":"2023-07-27T14:37:52.381933+0000","last_undegraded":"2023-07-27T14:37:52.381933+0000","last_fullsized":"2023-07-27T14:37:52.381933+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370264+0000","last_change":"2023-07-27T14:37:51.923025+0000","last_active":"2023-07-27T14:37:52.370264+0000","last_peered":"2023-07-27T14:37:52.370264+0000","last_clean":"2023-07-27T14:37:52.370264+0000","last_became_active":"2023-07-27T14:37:51.922690+0000","last_became_peered":"2023-07-27T14:37:51.922690+0000","last_unstale":"2023-07-27T14:37:52.370264+0000","last_undegraded":"2023-07-27T14:37:52.370264+0000","last_fullsized":"2023-07-27T14:37:52.370264+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394767+0000","last_change":"2023-07-27T14:37:52.392691+0000","last_active":"2023-07-27T14:37:52.394767+0000","last_peered":"2023-07-27T14:37:52.394767+0000","last_clean":"2023-07-27T14:37:52.394767+0000","last_became_active":"2023-07-27T14:37:52.391701+0000","last_became_peered":"2023-07-27T14:37:52.391701+0000","last_unstale":"2023-07-27T14:37:52.394767+0000","last_undegraded":"2023-07-27T14:37:52.394767+0000","last_fullsized":"2023-07-27T14:37:52.394767+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"173'4","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393018+0000","last_change":"2023-07-27T14:37:51.919810+0000","last_active":"2023-07-27T14:37:52.393018+0000","last_peered":"2023-07-27T14:37:52.393018+0000","last_clean":"2023-07-27T14:37:52.393018+0000","last_became_active":"2023-07-27T14:37:51.919545+0000","last_became_peered":"2023-07-27T14:37:51.919545+0000","last_unstale":"2023-07-27T14:37:52.393018+0000","last_undegraded":"2023-07-27T14:37:52.393018+0000","last_fullsized":"2023-07-27T14:37:52.393018+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.384904+0000","last_change":"2023-07-27T14:37:52.378183+0000","last_active":"2023-07-27T14:37:52.384904+0000","last_peered":"2023-07-27T14:37:52.384904+0000","last_clean":"2023-07-27T14:37:52.384904+0000","last_became_active":"2023-07-27T14:37:52.377845+0000","last_became_peered":"2023-07-27T14:37:52.377845+0000","last_unstale":"2023-07-27T14:37:52.384904+0000","last_undegraded":"2023-07-27T14:37:52.384904+0000","last_fullsized":"2023-07-27T14:37:52.384904+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.365481+0000","last_change":"2023-07-27T14:37:51.927103+0000","last_active":"2023-07-27T14:37:52.365481+0000","last_peered":"2023-07-27T14:37:52.365481+0000","last_clean":"2023-07-27T14:37:52.365481+0000","last_became_active":"2023-07-27T14:37:51.926156+0000","last_became_peered":"2023-07-27T14:37:51.926156+0000","last_unstale":"2023-07-27T14:37:52.365481+0000","last_undegraded":"2023-07-27T14:37:52.365481+0000","last_fullsized":"2023-07-27T14:37:52.365481+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.383137+0000","last_change":"2023-07-27T14:37:52.379718+0000","last_active":"2023-07-27T14:37:52.383137+0000","last_peered":"2023-07-27T14:37:52.383137+0000","last_clean":"2023-07-27T14:37:52.383137+0000","last_became_active":"2023-07-27T14:37:52.379029+0000","last_became_peered":"2023-07-27T14:37:52.379029+0000","last_unstale":"2023-07-27T14:37:52.383137+0000","last_undegraded":"2023-07-27T14:37:52.383137+0000","last_fullsized":"2023-07-27T14:37:52.383137+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.371921+0000","last_change":"2023-07-27T14:37:51.919740+0000","last_active":"2023-07-27T14:37:52.371921+0000","last_peered":"2023-07-27T14:37:52.371921+0000","last_clean":"2023-07-27T14:37:52.371921+0000","last_became_active":"2023-07-27T14:37:51.919081+0000","last_became_peered":"2023-07-27T14:37:51.919081+0000","last_unstale":"2023-07-27T14:37:52.371921+0000","last_undegraded":"2023-07-27T14:37:52.371921+0000","last_fullsized":"2023-07-27T14:37:52.371921+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389610+0000","last_change":"2023-07-27T14:37:52.382040+0000","last_active":"2023-07-27T14:37:52.389610+0000","last_peered":"2023-07-27T14:37:52.389610+0000","last_clean":"2023-07-27T14:37:52.389610+0000","last_became_active":"2023-07-27T14:37:52.381692+0000","last_became_peered":"2023-07-27T14:37:52.381692+0000","last_unstale":"2023-07-27T14:37:52.389610+0000","last_undegraded":"2023-07-27T14:37:52.389610+0000","last_fullsized":"2023-07-27T14:37:52.389610+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394079+0000","last_change":"2023-07-27T14:37:51.928539+0000","last_active":"2023-07-27T14:37:52.394079+0000","last_peered":"2023-07-27T14:37:52.394079+0000","last_clean":"2023-07-27T14:37:52.394079+0000","last_became_active":"2023-07-27T14:37:51.928274+0000","last_became_peered":"2023-07-27T14:37:51.928274+0000","last_unstale":"2023-07-27T14:37:52.394079+0000","last_undegraded":"2023-07-27T14:37:52.394079+0000","last_fullsized":"2023-07-27T14:37:52.394079+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.379832+0000","last_change":"2023-07-27T14:37:52.373316+0000","last_active":"2023-07-27T14:37:52.379832+0000","last_peered":"2023-07-27T14:37:52.379832+0000","last_clean":"2023-07-27T14:37:52.379832+0000","last_became_active":"2023-07-27T14:37:52.373013+0000","last_became_peered":"2023-07-27T14:37:52.373013+0000","last_unstale":"2023-07-27T14:37:52.379832+0000","last_undegraded":"2023-07-27T14:37:52.379832+0000","last_fullsized":"2023-07-27T14:37:52.379832+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366378+0000","last_change":"2023-07-27T14:37:51.922317+0000","last_active":"2023-07-27T14:37:52.366378+0000","last_peered":"2023-07-27T14:37:52.366378+0000","last_clean":"2023-07-27T14:37:52.366378+0000","last_became_active":"2023-07-27T14:37:51.922031+0000","last_became_peered":"2023-07-27T14:37:51.922031+0000","last_unstale":"2023-07-27T14:37:52.366378+0000","last_undegraded":"2023-07-27T14:37:52.366378+0000","last_fullsized":"2023-07-27T14:37:52.366378+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392286+0000","last_change":"2023-07-27T14:37:52.389773+0000","last_active":"2023-07-27T14:37:52.392286+0000","last_peered":"2023-07-27T14:37:52.392286+0000","last_clean":"2023-07-27T14:37:52.392286+0000","last_became_active":"2023-07-27T14:37:52.389428+0000","last_became_peered":"2023-07-27T14:37:52.389428+0000","last_unstale":"2023-07-27T14:37:52.392286+0000","last_undegraded":"2023-07-27T14:37:52.392286+0000","last_fullsized":"2023-07-27T14:37:52.392286+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391732+0000","last_change":"2023-07-27T14:37:51.926647+0000","last_active":"2023-07-27T14:37:52.391732+0000","last_peered":"2023-07-27T14:37:52.391732+0000","last_clean":"2023-07-27T14:37:52.391732+0000","last_became_active":"2023-07-27T14:37:51.926283+0000","last_became_peered":"2023-07-27T14:37:51.926283+0000","last_unstale":"2023-07-27T14:37:52.391732+0000","last_undegraded":"2023-07-27T14:37:52.391732+0000","last_fullsized":"2023-07-27T14:37:52.391732+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390367+0000","last_change":"2023-07-27T14:37:52.382450+0000","last_active":"2023-07-27T14:37:52.390367+0000","last_peered":"2023-07-27T14:37:52.390367+0000","last_clean":"2023-07-27T14:37:52.390367+0000","last_became_active":"2023-07-27T14:37:52.382164+0000","last_became_peered":"2023-07-27T14:37:52.382164+0000","last_unstale":"2023-07-27T14:37:52.390367+0000","last_undegraded":"2023-07-27T14:37:52.390367+0000","last_fullsized":"2023-07-27T14:37:52.390367+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.369990+0000","last_change":"2023-07-27T14:37:51.921844+0000","last_active":"2023-07-27T14:37:52.369990+0000","last_peered":"2023-07-27T14:37:52.369990+0000","last_clean":"2023-07-27T14:37:52.369990+0000","last_became_active":"2023-07-27T14:37:51.920648+0000","last_became_peered":"2023-07-27T14:37:51.920648+0000","last_unstale":"2023-07-27T14:37:52.369990+0000","last_undegraded":"2023-07-27T14:37:52.369990+0000","last_fullsized":"2023-07-27T14:37:52.369990+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390873+0000","last_change":"2023-07-27T14:37:52.386811+0000","last_active":"2023-07-27T14:37:52.390873+0000","last_peered":"2023-07-27T14:37:52.390873+0000","last_clean":"2023-07-27T14:37:52.390873+0000","last_became_active":"2023-07-27T14:37:52.386504+0000","last_became_peered":"2023-07-27T14:37:52.386504+0000","last_unstale":"2023-07-27T14:37:52.390873+0000","last_undegraded":"2023-07-27T14:37:52.390873+0000","last_fullsized":"2023-07-27T14:37:52.390873+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366639+0000","last_change":"2023-07-27T14:37:51.916064+0000","last_active":"2023-07-27T14:37:52.366639+0000","last_peered":"2023-07-27T14:37:52.366639+0000","last_clean":"2023-07-27T14:37:52.366639+0000","last_became_active":"2023-07-27T14:37:51.915488+0000","last_became_peered":"2023-07-27T14:37:51.915488+0000","last_unstale":"2023-07-27T14:37:52.366639+0000","last_undegraded":"2023-07-27T14:37:52.366639+0000","last_fullsized":"2023-07-27T14:37:52.366639+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389927+0000","last_change":"2023-07-27T14:37:52.385713+0000","last_active":"2023-07-27T14:37:52.389927+0000","last_peered":"2023-07-27T14:37:52.389927+0000","last_clean":"2023-07-27T14:37:52.389927+0000","last_became_active":"2023-07-27T14:37:52.385420+0000","last_became_peered":"2023-07-27T14:37:52.385420+0000","last_unstale":"2023-07-27T14:37:52.389927+0000","last_undegraded":"2023-07-27T14:37:52.389927+0000","last_fullsized":"2023-07-27T14:37:52.389927+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368605+0000","last_change":"2023-07-27T14:37:51.915223+0000","last_active":"2023-07-27T14:37:52.368605+0000","last_peered":"2023-07-27T14:37:52.368605+0000","last_clean":"2023-07-27T14:37:52.368605+0000","last_became_active":"2023-07-27T14:37:51.914836+0000","last_became_peered":"2023-07-27T14:37:51.914836+0000","last_unstale":"2023-07-27T14:37:52.368605+0000","last_undegraded":"2023-07-27T14:37:52.368605+0000","last_fullsized":"2023-07-27T14:37:52.368605+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390576+0000","last_change":"2023-07-27T14:37:52.387154+0000","last_active":"2023-07-27T14:37:52.390576+0000","last_peered":"2023-07-27T14:37:52.390576+0000","last_clean":"2023-07-27T14:37:52.390576+0000","last_became_active":"2023-07-27T14:37:52.386785+0000","last_became_peered":"2023-07-27T14:37:52.386785+0000","last_unstale":"2023-07-27T14:37:52.390576+0000","last_undegraded":"2023-07-27T14:37:52.390576+0000","last_fullsized":"2023-07-27T14:37:52.390576+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368178+0000","last_change":"2023-07-27T14:37:51.920491+0000","last_active":"2023-07-27T14:37:52.368178+0000","last_peered":"2023-07-27T14:37:52.368178+0000","last_clean":"2023-07-27T14:37:52.368178+0000","last_became_active":"2023-07-27T14:37:51.920207+0000","last_became_peered":"2023-07-27T14:37:51.920207+0000","last_unstale":"2023-07-27T14:37:52.368178+0000","last_undegraded":"2023-07-27T14:37:52.368178+0000","last_fullsized":"2023-07-27T14:37:52.368178+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388883+0000","last_change":"2023-07-27T14:37:52.381572+0000","last_active":"2023-07-27T14:37:52.388883+0000","last_peered":"2023-07-27T14:37:52.388883+0000","last_clean":"2023-07-27T14:37:52.388883+0000","last_became_active":"2023-07-27T14:37:52.381327+0000","last_became_peered":"2023-07-27T14:37:52.381327+0000","last_unstale":"2023-07-27T14:37:52.388883+0000","last_undegraded":"2023-07-27T14:37:52.388883+0000","last_fullsized":"2023-07-27T14:37:52.388883+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.371220+0000","last_change":"2023-07-27T14:37:51.919001+0000","last_active":"2023-07-27T14:37:52.371220+0000","last_peered":"2023-07-27T14:37:52.371220+0000","last_clean":"2023-07-27T14:37:52.371220+0000","last_became_active":"2023-07-27T14:37:51.918245+0000","last_became_peered":"2023-07-27T14:37:51.918245+0000","last_unstale":"2023-07-27T14:37:52.371220+0000","last_undegraded":"2023-07-27T14:37:52.371220+0000","last_fullsized":"2023-07-27T14:37:52.371220+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390332+0000","last_change":"2023-07-27T14:37:52.381641+0000","last_active":"2023-07-27T14:37:52.390332+0000","last_peered":"2023-07-27T14:37:52.390332+0000","last_clean":"2023-07-27T14:37:52.390332+0000","last_became_active":"2023-07-27T14:37:52.381357+0000","last_became_peered":"2023-07-27T14:37:52.381357+0000","last_unstale":"2023-07-27T14:37:52.390332+0000","last_undegraded":"2023-07-27T14:37:52.390332+0000","last_fullsized":"2023-07-27T14:37:52.390332+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367269+0000","last_change":"2023-07-27T14:37:51.907999+0000","last_active":"2023-07-27T14:37:52.367269+0000","last_peered":"2023-07-27T14:37:52.367269+0000","last_clean":"2023-07-27T14:37:52.367269+0000","last_became_active":"2023-07-27T14:37:51.907695+0000","last_became_peered":"2023-07-27T14:37:51.907695+0000","last_unstale":"2023-07-27T14:37:52.367269+0000","last_undegraded":"2023-07-27T14:37:52.367269+0000","last_fullsized":"2023-07-27T14:37:52.367269+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391855+0000","last_change":"2023-07-27T14:37:52.388537+0000","last_active":"2023-07-27T14:37:52.391855+0000","last_peered":"2023-07-27T14:37:52.391855+0000","last_clean":"2023-07-27T14:37:52.391855+0000","last_became_active":"2023-07-27T14:37:52.388288+0000","last_became_peered":"2023-07-27T14:37:52.388288+0000","last_unstale":"2023-07-27T14:37:52.391855+0000","last_undegraded":"2023-07-27T14:37:52.391855+0000","last_fullsized":"2023-07-27T14:37:52.391855+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.362701+0000","last_change":"2023-07-27T14:37:51.916790+0000","last_active":"2023-07-27T14:37:52.362701+0000","last_peered":"2023-07-27T14:37:52.362701+0000","last_clean":"2023-07-27T14:37:52.362701+0000","last_became_active":"2023-07-27T14:37:51.916484+0000","last_became_peered":"2023-07-27T14:37:51.916484+0000","last_unstale":"2023-07-27T14:37:52.362701+0000","last_undegraded":"2023-07-27T14:37:52.362701+0000","last_fullsized":"2023-07-27T14:37:52.362701+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393091+0000","last_change":"2023-07-27T14:37:52.390672+0000","last_active":"2023-07-27T14:37:52.393091+0000","last_peered":"2023-07-27T14:37:52.393091+0000","last_clean":"2023-07-27T14:37:52.393091+0000","last_became_active":"2023-07-27T14:37:52.387991+0000","last_became_peered":"2023-07-27T14:37:52.387991+0000","last_unstale":"2023-07-27T14:37:52.393091+0000","last_undegraded":"2023-07-27T14:37:52.393091+0000","last_fullsized":"2023-07-27T14:37:52.393091+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366965+0000","last_change":"2023-07-27T14:37:51.908666+0000","last_active":"2023-07-27T14:37:52.366965+0000","last_peered":"2023-07-27T14:37:52.366965+0000","last_clean":"2023-07-27T14:37:52.366965+0000","last_became_active":"2023-07-27T14:37:51.908315+0000","last_became_peered":"2023-07-27T14:37:51.908315+0000","last_unstale":"2023-07-27T14:37:52.366965+0000","last_undegraded":"2023-07-27T14:37:52.366965+0000","last_fullsized":"2023-07-27T14:37:52.366965+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.378319+0000","last_change":"2023-07-27T14:37:52.375263+0000","last_active":"2023-07-27T14:37:52.378319+0000","last_peered":"2023-07-27T14:37:52.378319+0000","last_clean":"2023-07-27T14:37:52.378319+0000","last_became_active":"2023-07-27T14:37:52.374934+0000","last_became_peered":"2023-07-27T14:37:52.374934+0000","last_unstale":"2023-07-27T14:37:52.378319+0000","last_undegraded":"2023-07-27T14:37:52.378319+0000","last_fullsized":"2023-07-27T14:37:52.378319+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372550+0000","last_change":"2023-07-27T14:37:51.919067+0000","last_active":"2023-07-27T14:37:52.372550+0000","last_peered":"2023-07-27T14:37:52.372550+0000","last_clean":"2023-07-27T14:37:52.372550+0000","last_became_active":"2023-07-27T14:37:51.918734+0000","last_became_peered":"2023-07-27T14:37:51.918734+0000","last_unstale":"2023-07-27T14:37:52.372550+0000","last_undegraded":"2023-07-27T14:37:52.372550+0000","last_fullsized":"2023-07-27T14:37:52.372550+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.375463+0000","last_change":"2023-07-27T14:37:52.374438+0000","last_active":"2023-07-27T14:37:52.375463+0000","last_peered":"2023-07-27T14:37:52.375463+0000","last_clean":"2023-07-27T14:37:52.375463+0000","last_became_active":"2023-07-27T14:37:52.374098+0000","last_became_peered":"2023-07-27T14:37:52.374098+0000","last_unstale":"2023-07-27T14:37:52.375463+0000","last_undegraded":"2023-07-27T14:37:52.375463+0000","last_fullsized":"2023-07-27T14:37:52.375463+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372788+0000","last_change":"2023-07-27T14:37:51.914099+0000","last_active":"2023-07-27T14:37:52.372788+0000","last_peered":"2023-07-27T14:37:52.372788+0000","last_clean":"2023-07-27T14:37:52.372788+0000","last_became_active":"2023-07-27T14:37:51.913799+0000","last_became_peered":"2023-07-27T14:37:51.913799+0000","last_unstale":"2023-07-27T14:37:52.372788+0000","last_undegraded":"2023-07-27T14:37:52.372788+0000","last_fullsized":"2023-07-27T14:37:52.372788+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.376367+0000","last_change":"2023-07-27T14:37:52.374883+0000","last_active":"2023-07-27T14:37:52.376367+0000","last_peered":"2023-07-27T14:37:52.376367+0000","last_clean":"2023-07-27T14:37:52.376367+0000","last_became_active":"2023-07-27T14:37:52.374605+0000","last_became_peered":"2023-07-27T14:37:52.374605+0000","last_unstale":"2023-07-27T14:37:52.376367+0000","last_undegraded":"2023-07-27T14:37:52.376367+0000","last_fullsized":"2023-07-27T14:37:52.376367+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368657+0000","last_change":"2023-07-27T14:37:51.918941+0000","last_active":"2023-07-27T14:37:52.368657+0000","last_peered":"2023-07-27T14:37:52.368657+0000","last_clean":"2023-07-27T14:37:52.368657+0000","last_became_active":"2023-07-27T14:37:51.918605+0000","last_became_peered":"2023-07-27T14:37:51.918605+0000","last_unstale":"2023-07-27T14:37:52.368657+0000","last_undegraded":"2023-07-27T14:37:52.368657+0000","last_fullsized":"2023-07-27T14:37:52.368657+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.385564+0000","last_change":"2023-07-27T14:37:52.378698+0000","last_active":"2023-07-27T14:37:52.385564+0000","last_peered":"2023-07-27T14:37:52.385564+0000","last_clean":"2023-07-27T14:37:52.385564+0000","last_became_active":"2023-07-27T14:37:52.377539+0000","last_became_peered":"2023-07-27T14:37:52.377539+0000","last_unstale":"2023-07-27T14:37:52.385564+0000","last_undegraded":"2023-07-27T14:37:52.385564+0000","last_fullsized":"2023-07-27T14:37:52.385564+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.395078+0000","last_change":"2023-07-27T14:37:51.916506+0000","last_active":"2023-07-27T14:37:52.395078+0000","last_peered":"2023-07-27T14:37:52.395078+0000","last_clean":"2023-07-27T14:37:52.395078+0000","last_became_active":"2023-07-27T14:37:51.916163+0000","last_became_peered":"2023-07-27T14:37:51.916163+0000","last_unstale":"2023-07-27T14:37:52.395078+0000","last_undegraded":"2023-07-27T14:37:52.395078+0000","last_fullsized":"2023-07-27T14:37:52.395078+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391235+0000","last_change":"2023-07-27T14:37:52.386696+0000","last_active":"2023-07-27T14:37:52.391235+0000","last_peered":"2023-07-27T14:37:52.391235+0000","last_clean":"2023-07-27T14:37:52.391235+0000","last_became_active":"2023-07-27T14:37:52.386449+0000","last_became_peered":"2023-07-27T14:37:52.386449+0000","last_unstale":"2023-07-27T14:37:52.391235+0000","last_undegraded":"2023-07-27T14:37:52.391235+0000","last_fullsized":"2023-07-27T14:37:52.391235+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393707+0000","last_change":"2023-07-27T14:37:51.919233+0000","last_active":"2023-07-27T14:37:52.393707+0000","last_peered":"2023-07-27T14:37:52.393707+0000","last_clean":"2023-07-27T14:37:52.393707+0000","last_became_active":"2023-07-27T14:37:51.918656+0000","last_became_peered":"2023-07-27T14:37:51.918656+0000","last_unstale":"2023-07-27T14:37:52.393707+0000","last_undegraded":"2023-07-27T14:37:52.393707+0000","last_fullsized":"2023-07-27T14:37:52.393707+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390428+0000","last_change":"2023-07-27T14:37:52.385705+0000","last_active":"2023-07-27T14:37:52.390428+0000","last_peered":"2023-07-27T14:37:52.390428+0000","last_clean":"2023-07-27T14:37:52.390428+0000","last_became_active":"2023-07-27T14:37:52.385272+0000","last_became_peered":"2023-07-27T14:37:52.385272+0000","last_unstale":"2023-07-27T14:37:52.390428+0000","last_undegraded":"2023-07-27T14:37:52.390428+0000","last_fullsized":"2023-07-27T14:37:52.390428+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392786+0000","last_change":"2023-07-27T14:37:51.915052+0000","last_active":"2023-07-27T14:37:52.392786+0000","last_peered":"2023-07-27T14:37:52.392786+0000","last_clean":"2023-07-27T14:37:52.392786+0000","last_became_active":"2023-07-27T14:37:51.914723+0000","last_became_peered":"2023-07-27T14:37:51.914723+0000","last_unstale":"2023-07-27T14:37:52.392786+0000","last_undegraded":"2023-07-27T14:37:52.392786+0000","last_fullsized":"2023-07-27T14:37:52.392786+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.380915+0000","last_change":"2023-07-27T14:37:52.376407+0000","last_active":"2023-07-27T14:37:52.380915+0000","last_peered":"2023-07-27T14:37:52.380915+0000","last_clean":"2023-07-27T14:37:52.380915+0000","last_became_active":"2023-07-27T14:37:52.376109+0000","last_became_peered":"2023-07-27T14:37:52.376109+0000","last_unstale":"2023-07-27T14:37:52.380915+0000","last_undegraded":"2023-07-27T14:37:52.380915+0000","last_fullsized":"2023-07-27T14:37:52.380915+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.364143+0000","last_change":"2023-07-27T14:37:51.923575+0000","last_active":"2023-07-27T14:37:52.364143+0000","last_peered":"2023-07-27T14:37:52.364143+0000","last_clean":"2023-07-27T14:37:52.364143+0000","last_became_active":"2023-07-27T14:37:51.923292+0000","last_became_peered":"2023-07-27T14:37:51.923292+0000","last_unstale":"2023-07-27T14:37:52.364143+0000","last_undegraded":"2023-07-27T14:37:52.364143+0000","last_fullsized":"2023-07-27T14:37:52.364143+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393404+0000","last_change":"2023-07-27T14:37:52.389697+0000","last_active":"2023-07-27T14:37:52.393404+0000","last_peered":"2023-07-27T14:37:52.393404+0000","last_clean":"2023-07-27T14:37:52.393404+0000","last_became_active":"2023-07-27T14:37:52.389373+0000","last_became_peered":"2023-07-27T14:37:52.389373+0000","last_unstale":"2023-07-27T14:37:52.393404+0000","last_undegraded":"2023-07-27T14:37:52.393404+0000","last_fullsized":"2023-07-27T14:37:52.393404+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.363556+0000","last_change":"2023-07-27T14:37:51.909397+0000","last_active":"2023-07-27T14:37:52.363556+0000","last_peered":"2023-07-27T14:37:52.363556+0000","last_clean":"2023-07-27T14:37:52.363556+0000","last_became_active":"2023-07-27T14:37:51.908974+0000","last_became_peered":"2023-07-27T14:37:51.908974+0000","last_unstale":"2023-07-27T14:37:52.363556+0000","last_undegraded":"2023-07-27T14:37:52.363556+0000","last_fullsized":"2023-07-27T14:37:52.363556+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.377709+0000","last_change":"2023-07-27T14:37:52.375888+0000","last_active":"2023-07-27T14:37:52.377709+0000","last_peered":"2023-07-27T14:37:52.377709+0000","last_clean":"2023-07-27T14:37:52.377709+0000","last_became_active":"2023-07-27T14:37:52.375630+0000","last_became_peered":"2023-07-27T14:37:52.375630+0000","last_unstale":"2023-07-27T14:37:52.377709+0000","last_undegraded":"2023-07-27T14:37:52.377709+0000","last_fullsized":"2023-07-27T14:37:52.377709+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368929+0000","last_change":"2023-07-27T14:37:51.913681+0000","last_active":"2023-07-27T14:37:52.368929+0000","last_peered":"2023-07-27T14:37:52.368929+0000","last_clean":"2023-07-27T14:37:52.368929+0000","last_became_active":"2023-07-27T14:37:51.913257+0000","last_became_peered":"2023-07-27T14:37:51.913257+0000","last_unstale":"2023-07-27T14:37:52.368929+0000","last_undegraded":"2023-07-27T14:37:52.368929+0000","last_fullsized":"2023-07-27T14:37:52.368929+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.382304+0000","last_change":"2023-07-27T14:37:52.378760+0000","last_active":"2023-07-27T14:37:52.382304+0000","last_peered":"2023-07-27T14:37:52.382304+0000","last_clean":"2023-07-27T14:37:52.382304+0000","last_became_active":"2023-07-27T14:37:52.378485+0000","last_became_peered":"2023-07-27T14:37:52.378485+0000","last_unstale":"2023-07-27T14:37:52.382304+0000","last_undegraded":"2023-07-27T14:37:52.382304+0000","last_fullsized":"2023-07-27T14:37:52.382304+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366552+0000","last_change":"2023-07-27T14:37:51.928626+0000","last_active":"2023-07-27T14:37:52.366552+0000","last_peered":"2023-07-27T14:37:52.366552+0000","last_clean":"2023-07-27T14:37:52.366552+0000","last_became_active":"2023-07-27T14:37:51.928348+0000","last_became_peered":"2023-07-27T14:37:51.928348+0000","last_unstale":"2023-07-27T14:37:52.366552+0000","last_undegraded":"2023-07-27T14:37:52.366552+0000","last_fullsized":"2023-07-27T14:37:52.366552+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391947+0000","last_change":"2023-07-27T14:37:52.386018+0000","last_active":"2023-07-27T14:37:52.391947+0000","last_peered":"2023-07-27T14:37:52.391947+0000","last_clean":"2023-07-27T14:37:52.391947+0000","last_became_active":"2023-07-27T14:37:52.385723+0000","last_became_peered":"2023-07-27T14:37:52.385723+0000","last_unstale":"2023-07-27T14:37:52.391947+0000","last_undegraded":"2023-07-27T14:37:52.391947+0000","last_fullsized":"2023-07-27T14:37:52.391947+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.362459+0000","last_change":"2023-07-27T14:37:51.921265+0000","last_active":"2023-07-27T14:37:52.362459+0000","last_peered":"2023-07-27T14:37:52.362459+0000","last_clean":"2023-07-27T14:37:52.362459+0000","last_became_active":"2023-07-27T14:37:51.920995+0000","last_became_peered":"2023-07-27T14:37:51.920995+0000","last_unstale":"2023-07-27T14:37:52.362459+0000","last_undegraded":"2023-07-27T14:37:52.362459+0000","last_fullsized":"2023-07-27T14:37:52.362459+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.383000+0000","last_change":"2023-07-27T14:37:52.378882+0000","last_active":"2023-07-27T14:37:52.383000+0000","last_peered":"2023-07-27T14:37:52.383000+0000","last_clean":"2023-07-27T14:37:52.383000+0000","last_became_active":"2023-07-27T14:37:52.376865+0000","last_became_peered":"2023-07-27T14:37:52.376865+0000","last_unstale":"2023-07-27T14:37:52.383000+0000","last_undegraded":"2023-07-27T14:37:52.383000+0000","last_fullsized":"2023-07-27T14:37:52.383000+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388211+0000","last_change":"2023-07-27T14:37:51.923074+0000","last_active":"2023-07-27T14:37:52.388211+0000","last_peered":"2023-07-27T14:37:52.388211+0000","last_clean":"2023-07-27T14:37:52.388211+0000","last_became_active":"2023-07-27T14:37:51.922811+0000","last_became_peered":"2023-07-27T14:37:51.922811+0000","last_unstale":"2023-07-27T14:37:52.388211+0000","last_undegraded":"2023-07-27T14:37:52.388211+0000","last_fullsized":"2023-07-27T14:37:52.388211+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.389490+0000","last_change":"2023-07-27T14:37:52.378534+0000","last_active":"2023-07-27T14:37:52.389490+0000","last_peered":"2023-07-27T14:37:52.389490+0000","last_clean":"2023-07-27T14:37:52.389490+0000","last_became_active":"2023-07-27T14:37:52.378150+0000","last_became_peered":"2023-07-27T14:37:52.378150+0000","last_unstale":"2023-07-27T14:37:52.389490+0000","last_undegraded":"2023-07-27T14:37:52.389490+0000","last_fullsized":"2023-07-27T14:37:52.389490+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392506+0000","last_change":"2023-07-27T14:37:51.917208+0000","last_active":"2023-07-27T14:37:52.392506+0000","last_peered":"2023-07-27T14:37:52.392506+0000","last_clean":"2023-07-27T14:37:52.392506+0000","last_became_active":"2023-07-27T14:37:51.916638+0000","last_became_peered":"2023-07-27T14:37:51.916638+0000","last_unstale":"2023-07-27T14:37:52.392506+0000","last_undegraded":"2023-07-27T14:37:52.392506+0000","last_fullsized":"2023-07-27T14:37:52.392506+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388427+0000","last_change":"2023-07-27T14:37:52.386208+0000","last_active":"2023-07-27T14:37:52.388427+0000","last_peered":"2023-07-27T14:37:52.388427+0000","last_clean":"2023-07-27T14:37:52.388427+0000","last_became_active":"2023-07-27T14:37:52.385849+0000","last_became_peered":"2023-07-27T14:37:52.385849+0000","last_unstale":"2023-07-27T14:37:52.388427+0000","last_undegraded":"2023-07-27T14:37:52.388427+0000","last_fullsized":"2023-07-27T14:37:52.388427+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370750+0000","last_change":"2023-07-27T14:37:51.922708+0000","last_active":"2023-07-27T14:37:52.370750+0000","last_peered":"2023-07-27T14:37:52.370750+0000","last_clean":"2023-07-27T14:37:52.370750+0000","last_became_active":"2023-07-27T14:37:51.922302+0000","last_became_peered":"2023-07-27T14:37:51.922302+0000","last_unstale":"2023-07-27T14:37:52.370750+0000","last_undegraded":"2023-07-27T14:37:52.370750+0000","last_fullsized":"2023-07-27T14:37:52.370750+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.383808+0000","last_change":"2023-07-27T14:37:52.382041+0000","last_active":"2023-07-27T14:37:52.383808+0000","last_peered":"2023-07-27T14:37:52.383808+0000","last_clean":"2023-07-27T14:37:52.383808+0000","last_became_active":"2023-07-27T14:37:52.381729+0000","last_became_peered":"2023-07-27T14:37:52.381729+0000","last_unstale":"2023-07-27T14:37:52.383808+0000","last_undegraded":"2023-07-27T14:37:52.383808+0000","last_fullsized":"2023-07-27T14:37:52.383808+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.362812+0000","last_change":"2023-07-27T14:37:51.911390+0000","last_active":"2023-07-27T14:37:52.362812+0000","last_peered":"2023-07-27T14:37:52.362812+0000","last_clean":"2023-07-27T14:37:52.362812+0000","last_became_active":"2023-07-27T14:37:51.911099+0000","last_became_peered":"2023-07-27T14:37:51.911099+0000","last_unstale":"2023-07-27T14:37:52.362812+0000","last_undegraded":"2023-07-27T14:37:52.362812+0000","last_fullsized":"2023-07-27T14:37:52.362812+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392322+0000","last_change":"2023-07-27T14:37:52.390114+0000","last_active":"2023-07-27T14:37:52.392322+0000","last_peered":"2023-07-27T14:37:52.392322+0000","last_clean":"2023-07-27T14:37:52.392322+0000","last_became_active":"2023-07-27T14:37:52.389772+0000","last_became_peered":"2023-07-27T14:37:52.389772+0000","last_unstale":"2023-07-27T14:37:52.392322+0000","last_undegraded":"2023-07-27T14:37:52.392322+0000","last_fullsized":"2023-07-27T14:37:52.392322+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.391464+0000","last_change":"2023-07-27T14:37:51.918939+0000","last_active":"2023-07-27T14:37:52.391464+0000","last_peered":"2023-07-27T14:37:52.391464+0000","last_clean":"2023-07-27T14:37:52.391464+0000","last_became_active":"2023-07-27T14:37:51.918649+0000","last_became_peered":"2023-07-27T14:37:51.918649+0000","last_unstale":"2023-07-27T14:37:52.391464+0000","last_undegraded":"2023-07-27T14:37:52.391464+0000","last_fullsized":"2023-07-27T14:37:52.391464+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.387575+0000","last_change":"2023-07-27T14:37:52.379965+0000","last_active":"2023-07-27T14:37:52.387575+0000","last_peered":"2023-07-27T14:37:52.387575+0000","last_clean":"2023-07-27T14:37:52.387575+0000","last_became_active":"2023-07-27T14:37:52.379642+0000","last_became_peered":"2023-07-27T14:37:52.379642+0000","last_unstale":"2023-07-27T14:37:52.387575+0000","last_undegraded":"2023-07-27T14:37:52.387575+0000","last_fullsized":"2023-07-27T14:37:52.387575+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.365825+0000","last_change":"2023-07-27T14:37:51.912765+0000","last_active":"2023-07-27T14:37:52.365825+0000","last_peered":"2023-07-27T14:37:52.365825+0000","last_clean":"2023-07-27T14:37:52.365825+0000","last_became_active":"2023-07-27T14:37:51.912391+0000","last_became_peered":"2023-07-27T14:37:51.912391+0000","last_unstale":"2023-07-27T14:37:52.365825+0000","last_undegraded":"2023-07-27T14:37:52.365825+0000","last_fullsized":"2023-07-27T14:37:52.365825+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388847+0000","last_change":"2023-07-27T14:37:52.380773+0000","last_active":"2023-07-27T14:37:52.388847+0000","last_peered":"2023-07-27T14:37:52.388847+0000","last_clean":"2023-07-27T14:37:52.388847+0000","last_became_active":"2023-07-27T14:37:52.380529+0000","last_became_peered":"2023-07-27T14:37:52.380529+0000","last_unstale":"2023-07-27T14:37:52.388847+0000","last_undegraded":"2023-07-27T14:37:52.388847+0000","last_fullsized":"2023-07-27T14:37:52.388847+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366464+0000","last_change":"2023-07-27T14:37:51.915878+0000","last_active":"2023-07-27T14:37:52.366464+0000","last_peered":"2023-07-27T14:37:52.366464+0000","last_clean":"2023-07-27T14:37:52.366464+0000","last_became_active":"2023-07-27T14:37:51.915169+0000","last_became_peered":"2023-07-27T14:37:51.915169+0000","last_unstale":"2023-07-27T14:37:52.366464+0000","last_undegraded":"2023-07-27T14:37:52.366464+0000","last_fullsized":"2023-07-27T14:37:52.366464+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390258+0000","last_change":"2023-07-27T14:37:52.383729+0000","last_active":"2023-07-27T14:37:52.390258+0000","last_peered":"2023-07-27T14:37:52.390258+0000","last_clean":"2023-07-27T14:37:52.390258+0000","last_became_active":"2023-07-27T14:37:52.383436+0000","last_became_peered":"2023-07-27T14:37:52.383436+0000","last_unstale":"2023-07-27T14:37:52.390258+0000","last_undegraded":"2023-07-27T14:37:52.390258+0000","last_fullsized":"2023-07-27T14:37:52.390258+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367710+0000","last_change":"2023-07-27T14:37:51.918605+0000","last_active":"2023-07-27T14:37:52.367710+0000","last_peered":"2023-07-27T14:37:52.367710+0000","last_clean":"2023-07-27T14:37:52.367710+0000","last_became_active":"2023-07-27T14:37:51.918336+0000","last_became_peered":"2023-07-27T14:37:51.918336+0000","last_unstale":"2023-07-27T14:37:52.367710+0000","last_undegraded":"2023-07-27T14:37:52.367710+0000","last_fullsized":"2023-07-27T14:37:52.367710+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.381320+0000","last_change":"2023-07-27T14:37:52.378718+0000","last_active":"2023-07-27T14:37:52.381320+0000","last_peered":"2023-07-27T14:37:52.381320+0000","last_clean":"2023-07-27T14:37:52.381320+0000","last_became_active":"2023-07-27T14:37:52.378442+0000","last_became_peered":"2023-07-27T14:37:52.378442+0000","last_unstale":"2023-07-27T14:37:52.381320+0000","last_undegraded":"2023-07-27T14:37:52.381320+0000","last_fullsized":"2023-07-27T14:37:52.381320+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390144+0000","last_change":"2023-07-27T14:37:51.918370+0000","last_active":"2023-07-27T14:37:52.390144+0000","last_peered":"2023-07-27T14:37:52.390144+0000","last_clean":"2023-07-27T14:37:52.390144+0000","last_became_active":"2023-07-27T14:37:51.918064+0000","last_became_peered":"2023-07-27T14:37:51.918064+0000","last_unstale":"2023-07-27T14:37:52.390144+0000","last_undegraded":"2023-07-27T14:37:52.390144+0000","last_fullsized":"2023-07-27T14:37:52.390144+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.379932+0000","last_change":"2023-07-27T14:37:52.375199+0000","last_active":"2023-07-27T14:37:52.379932+0000","last_peered":"2023-07-27T14:37:52.379932+0000","last_clean":"2023-07-27T14:37:52.379932+0000","last_became_active":"2023-07-27T14:37:52.374773+0000","last_became_peered":"2023-07-27T14:37:52.374773+0000","last_unstale":"2023-07-27T14:37:52.379932+0000","last_undegraded":"2023-07-27T14:37:52.379932+0000","last_fullsized":"2023-07-27T14:37:52.379932+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372118+0000","last_change":"2023-07-27T14:37:51.919407+0000","last_active":"2023-07-27T14:37:52.372118+0000","last_peered":"2023-07-27T14:37:52.372118+0000","last_clean":"2023-07-27T14:37:52.372118+0000","last_became_active":"2023-07-27T14:37:51.918262+0000","last_became_peered":"2023-07-27T14:37:51.918262+0000","last_unstale":"2023-07-27T14:37:52.372118+0000","last_undegraded":"2023-07-27T14:37:52.372118+0000","last_fullsized":"2023-07-27T14:37:52.372118+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.382269+0000","last_change":"2023-07-27T14:37:52.378766+0000","last_active":"2023-07-27T14:37:52.382269+0000","last_peered":"2023-07-27T14:37:52.382269+0000","last_clean":"2023-07-27T14:37:52.382269+0000","last_became_active":"2023-07-27T14:37:52.378473+0000","last_became_peered":"2023-07-27T14:37:52.378473+0000","last_unstale":"2023-07-27T14:37:52.382269+0000","last_undegraded":"2023-07-27T14:37:52.382269+0000","last_fullsized":"2023-07-27T14:37:52.382269+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.371713+0000","last_change":"2023-07-27T14:37:51.924281+0000","last_active":"2023-07-27T14:37:52.371713+0000","last_peered":"2023-07-27T14:37:52.371713+0000","last_clean":"2023-07-27T14:37:52.371713+0000","last_became_active":"2023-07-27T14:37:51.924005+0000","last_became_peered":"2023-07-27T14:37:51.924005+0000","last_unstale":"2023-07-27T14:37:52.371713+0000","last_undegraded":"2023-07-27T14:37:52.371713+0000","last_fullsized":"2023-07-27T14:37:52.371713+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.380250+0000","last_change":"2023-07-27T14:37:52.376763+0000","last_active":"2023-07-27T14:37:52.380250+0000","last_peered":"2023-07-27T14:37:52.380250+0000","last_clean":"2023-07-27T14:37:52.380250+0000","last_became_active":"2023-07-27T14:37:52.376429+0000","last_became_peered":"2023-07-27T14:37:52.376429+0000","last_unstale":"2023-07-27T14:37:52.380250+0000","last_undegraded":"2023-07-27T14:37:52.380250+0000","last_fullsized":"2023-07-27T14:37:52.380250+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.364245+0000","last_change":"2023-07-27T14:37:51.919149+0000","last_active":"2023-07-27T14:37:52.364245+0000","last_peered":"2023-07-27T14:37:52.364245+0000","last_clean":"2023-07-27T14:37:52.364245+0000","last_became_active":"2023-07-27T14:37:51.918923+0000","last_became_peered":"2023-07-27T14:37:51.918923+0000","last_unstale":"2023-07-27T14:37:52.364245+0000","last_undegraded":"2023-07-27T14:37:52.364245+0000","last_fullsized":"2023-07-27T14:37:52.364245+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.390418+0000","last_change":"2023-07-27T14:37:52.385385+0000","last_active":"2023-07-27T14:37:52.390418+0000","last_peered":"2023-07-27T14:37:52.390418+0000","last_clean":"2023-07-27T14:37:52.390418+0000","last_became_active":"2023-07-27T14:37:52.385075+0000","last_became_peered":"2023-07-27T14:37:52.385075+0000","last_unstale":"2023-07-27T14:37:52.390418+0000","last_undegraded":"2023-07-27T14:37:52.390418+0000","last_fullsized":"2023-07-27T14:37:52.390418+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.374730+0000","last_change":"2023-07-27T14:37:51.928175+0000","last_active":"2023-07-27T14:37:52.374730+0000","last_peered":"2023-07-27T14:37:52.374730+0000","last_clean":"2023-07-27T14:37:52.374730+0000","last_became_active":"2023-07-27T14:37:51.927856+0000","last_became_peered":"2023-07-27T14:37:51.927856+0000","last_unstale":"2023-07-27T14:37:52.374730+0000","last_undegraded":"2023-07-27T14:37:52.374730+0000","last_fullsized":"2023-07-27T14:37:52.374730+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.386002+0000","last_change":"2023-07-27T14:37:52.377370+0000","last_active":"2023-07-27T14:37:52.386002+0000","last_peered":"2023-07-27T14:37:52.386002+0000","last_clean":"2023-07-27T14:37:52.386002+0000","last_became_active":"2023-07-27T14:37:52.377061+0000","last_became_peered":"2023-07-27T14:37:52.377061+0000","last_unstale":"2023-07-27T14:37:52.386002+0000","last_undegraded":"2023-07-27T14:37:52.386002+0000","last_fullsized":"2023-07-27T14:37:52.386002+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.369047+0000","last_change":"2023-07-27T14:37:51.926828+0000","last_active":"2023-07-27T14:37:52.369047+0000","last_peered":"2023-07-27T14:37:52.369047+0000","last_clean":"2023-07-27T14:37:52.369047+0000","last_became_active":"2023-07-27T14:37:51.924896+0000","last_became_peered":"2023-07-27T14:37:51.924896+0000","last_unstale":"2023-07-27T14:37:52.369047+0000","last_undegraded":"2023-07-27T14:37:52.369047+0000","last_fullsized":"2023-07-27T14:37:52.369047+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392684+0000","last_change":"2023-07-27T14:37:52.390479+0000","last_active":"2023-07-27T14:37:52.392684+0000","last_peered":"2023-07-27T14:37:52.392684+0000","last_clean":"2023-07-27T14:37:52.392684+0000","last_became_active":"2023-07-27T14:37:52.388963+0000","last_became_peered":"2023-07-27T14:37:52.388963+0000","last_unstale":"2023-07-27T14:37:52.392684+0000","last_undegraded":"2023-07-27T14:37:52.392684+0000","last_fullsized":"2023-07-27T14:37:52.392684+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366884+0000","last_change":"2023-07-27T14:37:51.917028+0000","last_active":"2023-07-27T14:37:52.366884+0000","last_peered":"2023-07-27T14:37:52.366884+0000","last_clean":"2023-07-27T14:37:52.366884+0000","last_became_active":"2023-07-27T14:37:51.914837+0000","last_became_peered":"2023-07-27T14:37:51.914837+0000","last_unstale":"2023-07-27T14:37:52.366884+0000","last_undegraded":"2023-07-27T14:37:52.366884+0000","last_fullsized":"2023-07-27T14:37:52.366884+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393540+0000","last_change":"2023-07-27T14:37:52.390334+0000","last_active":"2023-07-27T14:37:52.393540+0000","last_peered":"2023-07-27T14:37:52.393540+0000","last_clean":"2023-07-27T14:37:52.393540+0000","last_became_active":"2023-07-27T14:37:52.387829+0000","last_became_peered":"2023-07-27T14:37:52.387829+0000","last_unstale":"2023-07-27T14:37:52.393540+0000","last_undegraded":"2023-07-27T14:37:52.393540+0000","last_fullsized":"2023-07-27T14:37:52.393540+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370895+0000","last_change":"2023-07-27T14:37:51.919747+0000","last_active":"2023-07-27T14:37:52.370895+0000","last_peered":"2023-07-27T14:37:52.370895+0000","last_clean":"2023-07-27T14:37:52.370895+0000","last_became_active":"2023-07-27T14:37:51.919491+0000","last_became_peered":"2023-07-27T14:37:51.919491+0000","last_unstale":"2023-07-27T14:37:52.370895+0000","last_undegraded":"2023-07-27T14:37:52.370895+0000","last_fullsized":"2023-07-27T14:37:52.370895+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.382754+0000","last_change":"2023-07-27T14:37:52.379473+0000","last_active":"2023-07-27T14:37:52.382754+0000","last_peered":"2023-07-27T14:37:52.382754+0000","last_clean":"2023-07-27T14:37:52.382754+0000","last_became_active":"2023-07-27T14:37:52.377710+0000","last_became_peered":"2023-07-27T14:37:52.377710+0000","last_unstale":"2023-07-27T14:37:52.382754+0000","last_undegraded":"2023-07-27T14:37:52.382754+0000","last_fullsized":"2023-07-27T14:37:52.382754+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366737+0000","last_change":"2023-07-27T14:37:51.912510+0000","last_active":"2023-07-27T14:37:52.366737+0000","last_peered":"2023-07-27T14:37:52.366737+0000","last_clean":"2023-07-27T14:37:52.366737+0000","last_became_active":"2023-07-27T14:37:51.912177+0000","last_became_peered":"2023-07-27T14:37:51.912177+0000","last_unstale":"2023-07-27T14:37:52.366737+0000","last_undegraded":"2023-07-27T14:37:52.366737+0000","last_fullsized":"2023-07-27T14:37:52.366737+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.362887+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:37:52.362887+0000","last_peered":"2023-07-27T14:37:52.362887+0000","last_clean":"2023-07-27T14:37:52.362887+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:37:52.362887+0000","last_undegraded":"2023-07-27T14:37:52.362887+0000","last_fullsized":"2023-07-27T14:37:52.362887+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.385512+0000","last_change":"2023-07-27T14:37:52.377528+0000","last_active":"2023-07-27T14:37:52.385512+0000","last_peered":"2023-07-27T14:37:52.385512+0000","last_clean":"2023-07-27T14:37:52.385512+0000","last_became_active":"2023-07-27T14:37:52.377227+0000","last_became_peered":"2023-07-27T14:37:52.377227+0000","last_unstale":"2023-07-27T14:37:52.385512+0000","last_undegraded":"2023-07-27T14:37:52.385512+0000","last_fullsized":"2023-07-27T14:37:52.385512+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.369960+0000","last_change":"2023-07-27T14:37:51.912927+0000","last_active":"2023-07-27T14:37:52.369960+0000","last_peered":"2023-07-27T14:37:52.369960+0000","last_clean":"2023-07-27T14:37:52.369960+0000","last_became_active":"2023-07-27T14:37:51.912589+0000","last_became_peered":"2023-07-27T14:37:51.912589+0000","last_unstale":"2023-07-27T14:37:52.369960+0000","last_undegraded":"2023-07-27T14:37:52.369960+0000","last_fullsized":"2023-07-27T14:37:52.369960+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":147,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.365914+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:37:52.365914+0000","last_peered":"2023-07-27T14:37:52.365914+0000","last_clean":"2023-07-27T14:37:52.365914+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:37:52.365914+0000","last_undegraded":"2023-07-27T14:37:52.365914+0000","last_fullsized":"2023-07-27T14:37:52.365914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.393035+0000","last_change":"2023-07-27T14:37:52.387896+0000","last_active":"2023-07-27T14:37:52.393035+0000","last_peered":"2023-07-27T14:37:52.393035+0000","last_clean":"2023-07-27T14:37:52.393035+0000","last_became_active":"2023-07-27T14:37:52.387638+0000","last_became_peered":"2023-07-27T14:37:52.387638+0000","last_unstale":"2023-07-27T14:37:52.393035+0000","last_undegraded":"2023-07-27T14:37:52.393035+0000","last_fullsized":"2023-07-27T14:37:52.393035+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"173'2","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392756+0000","last_change":"2023-07-27T14:37:51.923494+0000","last_active":"2023-07-27T14:37:52.392756+0000","last_peered":"2023-07-27T14:37:52.392756+0000","last_clean":"2023-07-27T14:37:52.392756+0000","last_became_active":"2023-07-27T14:37:51.921290+0000","last_became_peered":"2023-07-27T14:37:51.921290+0000","last_unstale":"2023-07-27T14:37:52.392756+0000","last_undegraded":"2023-07-27T14:37:52.392756+0000","last_fullsized":"2023-07-27T14:37:52.392756+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":148,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.366376+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:37:52.366376+0000","last_peered":"2023-07-27T14:37:52.366376+0000","last_clean":"2023-07-27T14:37:52.366376+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:37:52.366376+0000","last_undegraded":"2023-07-27T14:37:52.366376+0000","last_fullsized":"2023-07-27T14:37:52.366376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.386534+0000","last_change":"2023-07-27T14:37:52.379274+0000","last_active":"2023-07-27T14:37:52.386534+0000","last_peered":"2023-07-27T14:37:52.386534+0000","last_clean":"2023-07-27T14:37:52.386534+0000","last_became_active":"2023-07-27T14:37:52.378939+0000","last_became_peered":"2023-07-27T14:37:52.378939+0000","last_unstale":"2023-07-27T14:37:52.386534+0000","last_undegraded":"2023-07-27T14:37:52.386534+0000","last_fullsized":"2023-07-27T14:37:52.386534+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372025+0000","last_change":"2023-07-27T14:37:51.919566+0000","last_active":"2023-07-27T14:37:52.372025+0000","last_peered":"2023-07-27T14:37:52.372025+0000","last_clean":"2023-07-27T14:37:52.372025+0000","last_became_active":"2023-07-27T14:37:51.918692+0000","last_became_peered":"2023-07-27T14:37:51.918692+0000","last_unstale":"2023-07-27T14:37:52.372025+0000","last_undegraded":"2023-07-27T14:37:52.372025+0000","last_fullsized":"2023-07-27T14:37:52.372025+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":147,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367079+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:37:52.367079+0000","last_peered":"2023-07-27T14:37:52.367079+0000","last_clean":"2023-07-27T14:37:52.367079+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:37:52.367079+0000","last_undegraded":"2023-07-27T14:37:52.367079+0000","last_fullsized":"2023-07-27T14:37:52.367079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":150,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367712+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:37:52.367712+0000","last_peered":"2023-07-27T14:37:52.367712+0000","last_clean":"2023-07-27T14:37:52.367712+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:37:52.367712+0000","last_undegraded":"2023-07-27T14:37:52.367712+0000","last_fullsized":"2023-07-27T14:37:52.367712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.383456+0000","last_change":"2023-07-27T14:37:52.379369+0000","last_active":"2023-07-27T14:37:52.383456+0000","last_peered":"2023-07-27T14:37:52.383456+0000","last_clean":"2023-07-27T14:37:52.383456+0000","last_became_active":"2023-07-27T14:37:52.379108+0000","last_became_peered":"2023-07-27T14:37:52.379108+0000","last_unstale":"2023-07-27T14:37:52.383456+0000","last_undegraded":"2023-07-27T14:37:52.383456+0000","last_fullsized":"2023-07-27T14:37:52.383456+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"173'3","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394795+0000","last_change":"2023-07-27T14:37:51.919982+0000","last_active":"2023-07-27T14:37:52.394795+0000","last_peered":"2023-07-27T14:37:52.394795+0000","last_clean":"2023-07-27T14:37:52.394795+0000","last_became_active":"2023-07-27T14:37:51.919661+0000","last_became_peered":"2023-07-27T14:37:51.919661+0000","last_unstale":"2023-07-27T14:37:52.394795+0000","last_undegraded":"2023-07-27T14:37:52.394795+0000","last_fullsized":"2023-07-27T14:37:52.394795+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.367821+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:37:52.367821+0000","last_peered":"2023-07-27T14:37:52.367821+0000","last_clean":"2023-07-27T14:37:52.367821+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:37:52.367821+0000","last_undegraded":"2023-07-27T14:37:52.367821+0000","last_fullsized":"2023-07-27T14:37:52.367821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.394921+0000","last_change":"2023-07-27T14:37:52.391332+0000","last_active":"2023-07-27T14:37:52.394921+0000","last_peered":"2023-07-27T14:37:52.394921+0000","last_clean":"2023-07-27T14:37:52.394921+0000","last_became_active":"2023-07-27T14:37:52.391083+0000","last_became_peered":"2023-07-27T14:37:52.391083+0000","last_unstale":"2023-07-27T14:37:52.394921+0000","last_undegraded":"2023-07-27T14:37:52.394921+0000","last_fullsized":"2023-07-27T14:37:52.394921+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"173'4","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392130+0000","last_change":"2023-07-27T14:37:51.916990+0000","last_active":"2023-07-27T14:37:52.392130+0000","last_peered":"2023-07-27T14:37:52.392130+0000","last_clean":"2023-07-27T14:37:52.392130+0000","last_became_active":"2023-07-27T14:37:51.916713+0000","last_became_peered":"2023-07-27T14:37:51.916713+0000","last_unstale":"2023-07-27T14:37:52.392130+0000","last_undegraded":"2023-07-27T14:37:52.392130+0000","last_fullsized":"2023-07-27T14:37:52.392130+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":149,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.370667+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:37:52.370667+0000","last_peered":"2023-07-27T14:37:52.370667+0000","last_clean":"2023-07-27T14:37:52.370667+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:37:52.370667+0000","last_undegraded":"2023-07-27T14:37:52.370667+0000","last_fullsized":"2023-07-27T14:37:52.370667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.387891+0000","last_change":"2023-07-27T14:37:52.378390+0000","last_active":"2023-07-27T14:37:52.387891+0000","last_peered":"2023-07-27T14:37:52.387891+0000","last_clean":"2023-07-27T14:37:52.387891+0000","last_became_active":"2023-07-27T14:37:52.378042+0000","last_became_peered":"2023-07-27T14:37:52.378042+0000","last_unstale":"2023-07-27T14:37:52.387891+0000","last_undegraded":"2023-07-27T14:37:52.387891+0000","last_fullsized":"2023-07-27T14:37:52.387891+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"173'1","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.388975+0000","last_change":"2023-07-27T14:37:51.907137+0000","last_active":"2023-07-27T14:37:52.388975+0000","last_peered":"2023-07-27T14:37:52.388975+0000","last_clean":"2023-07-27T14:37:52.388975+0000","last_became_active":"2023-07-27T14:37:51.904611+0000","last_became_peered":"2023-07-27T14:37:51.904611+0000","last_unstale":"2023-07-27T14:37:52.388975+0000","last_undegraded":"2023-07-27T14:37:52.388975+0000","last_fullsized":"2023-07-27T14:37:52.388975+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.363474+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:37:52.363474+0000","last_peered":"2023-07-27T14:37:52.363474+0000","last_clean":"2023-07-27T14:37:52.363474+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:37:52.363474+0000","last_undegraded":"2023-07-27T14:37:52.363474+0000","last_fullsized":"2023-07-27T14:37:52.363474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.392005+0000","last_change":"2023-07-27T14:37:52.383362+0000","last_active":"2023-07-27T14:37:52.392005+0000","last_peered":"2023-07-27T14:37:52.392005+0000","last_clean":"2023-07-27T14:37:52.392005+0000","last_became_active":"2023-07-27T14:37:52.383099+0000","last_became_peered":"2023-07-27T14:37:52.383099+0000","last_unstale":"2023-07-27T14:37:52.392005+0000","last_undegraded":"2023-07-27T14:37:52.392005+0000","last_fullsized":"2023-07-27T14:37:52.392005+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:51.885884+0000","last_clean_scrub_stamp":"2023-07-27T14:37:51.885884+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.368961+0000","last_change":"2023-07-27T14:37:51.920283+0000","last_active":"2023-07-27T14:37:52.368961+0000","last_peered":"2023-07-27T14:37:52.368961+0000","last_clean":"2023-07-27T14:37:52.368961+0000","last_became_active":"2023-07-27T14:37:51.920021+0000","last_became_peered":"2023-07-27T14:37:51.920021+0000","last_unstale":"2023-07-27T14:37:52.368961+0000","last_undegraded":"2023-07-27T14:37:52.368961+0000","last_fullsized":"2023-07-27T14:37:52.368961+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:37:50.883389+0000","last_clean_scrub_stamp":"2023-07-27T14:37:50.883389+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-07-27T14:37:52.372006+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:37:52.372006+0000","last_peered":"2023-07-27T14:37:52.372006+0000","last_clean":"2023-07-27T14:37:52.372006+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:37:52.372006+0000","last_undegraded":"2023-07-27T14:37:52.372006+0000","last_fullsized":"2023-07-27T14:37:52.372006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23252,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":21120,"kb_avail":94348588,"statfs":{"total":96636764160,"available":96612954112,"internally_reserved":0,"allocated":2174976,"data_stored":1026046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21626880},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60799999999999998,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80800000000000005,"5min":0.996,"15min":1.133},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.85399999999999998,"5min":0.92800000000000005,"15min":1.1180000000000001},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83499999999999996,"5min":0.97699999999999998,"15min":1.1759999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.70499999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85099999999999998,"5min":0.92500000000000004,"15min":1.1459999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.745,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65900000000000003,"15min":0.68999999999999995},"min":{"1min":0.53100000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.89300000000000002,"5min":0.96499999999999997,"15min":1.119},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.68000000000000005},"min":{"1min":0.495,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82199999999999995,"5min":0.97899999999999998,"15min":1.165},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.318},"max":{"1min":0.89800000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67800000000000005,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95499999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68400000000000005,"15min":0.67300000000000004},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.875,"5min":1.105,"15min":1.202},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.70499999999999996},"min":{"1min":0.53900000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94999999999999996,"5min":1.101,"15min":1.101},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75800000000000001,"15min":0.752},"min":{"1min":0.61399999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0049999999999999,"5min":1.056,"15min":1.056},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.71899999999999997},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.032,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22940,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94348900,"statfs":{"total":96636764160,"available":96613273600,"internally_reserved":0,"allocated":2183168,"data_stored":1032196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.83099999999999996,"5min":0.996,"15min":0.996},"last":0.621}]},{"osd":1,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46200000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.88100000000000001,"15min":0.94399999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.46200000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86499999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79600000000000004,"5min":0.93200000000000005,"15min":1.0169999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":1.01,"15min":1.01},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.66600000000000004},"min":{"1min":0.52900000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":1.2},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.88600000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.45000000000000001,"5min":0.38600000000000001,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.079},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.40400000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.198},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.54400000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72799999999999998,"15min":0.74099999999999999},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93899999999999995,"5min":1.054,"15min":1.1000000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75,"15min":0.76100000000000001},"min":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":1.036,"5min":1.1160000000000001,"15min":1.1399999999999999},"last":0.82099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24020,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":21888,"kb_avail":94347820,"statfs":{"total":96636764160,"available":96612167680,"internally_reserved":0,"allocated":2174976,"data_stored":1025244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22413312},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38200000000000001,"15min":0.46200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23699999999999999},"max":{"1min":0.53400000000000003,"5min":0.61499999999999999,"15min":4.75},"last":0.376},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41499999999999998,"15min":0.56499999999999995},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":9.3100000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.59799999999999998,"5min":0.64700000000000002,"15min":3.7210000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46000000000000002,"15min":0.50700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.58399999999999996,"5min":0.64300000000000002,"15min":2.7160000000000002},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46500000000000002,"15min":0.502},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":0.55900000000000005,"5min":0.90900000000000003,"15min":2.4809999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45700000000000002,"15min":0.52500000000000002},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57099999999999995,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.1639999999999999,"15min":2.181},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.51300000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.86299999999999999,"5min":1.014,"15min":2.4180000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69399999999999995,"15min":0.74099999999999999},"min":{"1min":0.53200000000000003,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":0.82499999999999996,"5min":1.0980000000000001,"15min":3.7440000000000002},"last":0.627},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45400000000000001},"max":{"1min":0.93999999999999995,"5min":1.131,"15min":2.149},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":1.085,"15min":2.052},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69799999999999995,"15min":0.79000000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88300000000000001,"5min":1.0620000000000001,"15min":6.1980000000000004},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":0.878,"5min":1.1419999999999999,"15min":2.016},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75900000000000001,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91200000000000003,"5min":1.1830000000000001,"15min":3.7799999999999998},"last":0.82299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22544,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":20416,"kb_avail":94349296,"statfs":{"total":96636764160,"available":96613679104,"internally_reserved":0,"allocated":2170880,"data_stored":1024634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":20905984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.245},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.55700000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.315,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.53100000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.60999999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.495}]},{"osd":4,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.38600000000000001},"max":{"1min":1.0800000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.998,"5min":1.0489999999999999,"15min":1.25},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":1.0089999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.51200000000000001,"5min":0.498,"15min":0.498},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.22},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.58199999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72399999999999998,"15min":0.74099999999999999},"min":{"1min":0.57499999999999996,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.2370000000000001},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26192,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":24064,"kb_avail":94345648,"statfs":{"total":96636764160,"available":96609943552,"internally_reserved":0,"allocated":2170880,"data_stored":1024670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24641536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.23799999999999999},"max":{"1min":0.65400000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.436,"15min":0.46100000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.56200000000000006,"5min":0.89700000000000002,"15min":1.1899999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.96399999999999997},"last":0.437},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61799999999999999,"5min":5.601,"15min":5.601},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56899999999999995,"5min":0.70799999999999996,"15min":0.83499999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64500000000000002,"5min":1.353,"15min":1.353},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69199999999999995,"15min":0.71599999999999997},"min":{"1min":0.45200000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86799999999999999,"5min":1.849,"15min":1.849},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.76700000000000002,"15min":0.71699999999999997},"min":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.434},"max":{"1min":0.95499999999999996,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69199999999999995,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":1.006,"5min":1.163,"15min":1.163},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70999999999999996,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.772,"15min":1.772},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":3.1600000000000001,"15min":3.1600000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.76200000000000001,"15min":0.78100000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73699999999999999,"15min":0.77000000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":0.91500000000000004,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18328,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94353512,"statfs":{"total":96636764160,"available":96617996288,"internally_reserved":0,"allocated":2179072,"data_stored":1025266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.314,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.58199999999999996,"5min":1.202,"15min":1.202},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.432},"min":{"1min":0.32100000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58599999999999997,"5min":0.71199999999999997,"15min":1.302},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41399999999999998,"15min":0.435},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54400000000000004,"5min":0.59299999999999997,"15min":0.88900000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.45400000000000001,"15min":0.44800000000000001},"min":{"1min":0.35199999999999998,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.52800000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.37}]},{"osd":2,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.48799999999999999},"min":{"1min":0.36799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66100000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.499,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":1.2749999999999999,"15min":1.8029999999999999},"last":0.495}]},{"osd":4,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.149},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.49399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.85599999999999998,"5min":1.111,"15min":5.1059999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68899999999999995,"15min":0.71399999999999997},"min":{"1min":0.54300000000000004,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.232},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92300000000000004,"5min":1.1639999999999999,"15min":2.3959999999999999},"last":0.627}]},{"osd":6,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.96799999999999997,"5min":1.121,"15min":1.298},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.44},"max":{"1min":0.94499999999999995,"5min":1.0209999999999999,"15min":1.343},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.77100000000000002},"min":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":1.115,"5min":1.115,"15min":2.048},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.76700000000000002},"min":{"1min":0.54100000000000004,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17176,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":15040,"kb_avail":94354664,"statfs":{"total":96636764160,"available":96619175936,"internally_reserved":0,"allocated":2179072,"data_stored":1024782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15400960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.63600000000000001,"15min":0.66100000000000003},"min":{"1min":0.40699999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67800000000000005,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39500000000000002},"max":{"1min":3.419,"5min":3.419,"15min":4.4409999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.41999999999999998,"15min":0.34899999999999998},"max":{"1min":3.3279999999999998,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.441,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.435,"15min":0.38800000000000001},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":4.476},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.48699999999999999,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":3.3639999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.46700000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":3.7559999999999998,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.48,"5min":3.48,"15min":4.3949999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.67400000000000004,"15min":0.67100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":5.194},"last":1.042},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53600000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.387,"5min":2.387,"15min":5.5990000000000002},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.73099999999999998,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.0960000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25380,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":23232,"kb_avail":94346460,"statfs":{"total":96636764160,"available":96610775040,"internally_reserved":0,"allocated":2191360,"data_stored":1031982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23789568},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.317,"15min":0.317},"max":{"1min":0.76400000000000001,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59399999999999997,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65300000000000002,"15min":0.69199999999999995},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.377},"max":{"1min":0.94299999999999995,"5min":1.026,"15min":6.7489999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.871,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.39600000000000002},"max":{"1min":0.75700000000000001,"5min":0.98799999999999999,"15min":1.581},"last":0.629},{"interface":"front","average":{"1min":0.627,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.46899999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81100000000000005,"5min":0.98999999999999999,"15min":3.8220000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63600000000000001,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.80600000000000005,"5min":0.93100000000000005,"15min":9.6920000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71399999999999997,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89700000000000002,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85299999999999998,"5min":0.96099999999999997,"15min":1.978},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38600000000000001},"max":{"1min":0.85399999999999998,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.879,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98199999999999998,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69199999999999995,"15min":0.68200000000000005},"min":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72599999999999998},"min":{"1min":0.503,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93100000000000005,"5min":1.115,"15min":1.9419999999999999},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:37:57.134 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:37:57.135 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:37:57.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.309+0000 7fd92abff700 1 Processor -- start 2023-07-27T14:37:57.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.309+0000 7fd92abff700 1 -- start start 2023-07-27T14:37:57.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92abff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924068f00 0x7fd9240692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92abff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd924151270 0x7fd924151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92abff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9240c0f60 con 0x7fd924154850 2023-07-27T14:37:57.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92abff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd924154dc0 con 0x7fd924151270 2023-07-27T14:37:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92abff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9241550a0 con 0x7fd924068f00 2023-07-27T14:37:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92919c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd924151270 0x7fd924151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92919c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd924151270 0x7fd924151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43506/0 (socket says 172.21.15.115:43506) 2023-07-27T14:37:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92919c700 1 -- 172.21.15.115:0/3619194250 learned_addr learned my addr 172.21.15.115:0/3619194250 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92899b700 1 --2- 172.21.15.115:0/3619194250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924068f00 0x7fd9240692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92919c700 1 -- 172.21.15.115:0/3619194250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924068f00 msgr2=0x7fd9240692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:57.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92919c700 1 --2- 172.21.15.115:0/3619194250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924068f00 0x7fd9240692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92919c700 1 -- 172.21.15.115:0/3619194250 >> v1:172.21.15.159:6789/0 conn(0x7fd924154850 legacy=0x7fd924068520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.311+0000 7fd92919c700 1 -- 172.21.15.115:0/3619194250 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd924155380 con 0x7fd924151270 2023-07-27T14:37:57.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd92919c700 1 --2- 172.21.15.115:0/3619194250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd924151700 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7fd91c009f20 tx=0x7fd91c009840).ready entity=mon.0 client_cookie=b683656d7ee5228e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:57.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd9237fe700 1 -- 172.21.15.115:0/3619194250 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00e070 con 0x7fd924151270 2023-07-27T14:37:57.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd9237fe700 1 -- 172.21.15.115:0/3619194250 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c00ba80 con 0x7fd924151270 2023-07-27T14:37:57.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd9237fe700 1 -- 172.21.15.115:0/3619194250 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00be00 con 0x7fd924151270 2023-07-27T14:37:57.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd92abff700 1 -- 172.21.15.115:0/3619194250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 msgr2=0x7fd924151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd92abff700 1 --2- 172.21.15.115:0/3619194250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd924151700 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7fd91c009f20 tx=0x7fd91c009840).stop 2023-07-27T14:37:57.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd92abff700 1 -- 172.21.15.115:0/3619194250 shutdown_connections 2023-07-27T14:37:57.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd92abff700 1 --2- 172.21.15.115:0/3619194250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924068f00 0x7fd9240692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd92abff700 1 --2- 172.21.15.115:0/3619194250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd924151700 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.312+0000 7fd92abff700 1 -- 172.21.15.115:0/3619194250 >> 172.21.15.115:0/3619194250 conn(0x7fd924062df0 msgr2=0x7fd9240c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:57.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.313+0000 7fd92abff700 1 -- 172.21.15.115:0/3619194250 shutdown_connections 2023-07-27T14:37:57.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.313+0000 7fd92abff700 1 -- 172.21.15.115:0/3619194250 wait complete. 2023-07-27T14:37:57.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.314+0000 7fd92abff700 1 Processor -- start 2023-07-27T14:37:57.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.314+0000 7fd92abff700 1 -- start start 2023-07-27T14:37:57.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.315+0000 7fd92abff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd924068f00 0x7fd924152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.315+0000 7fd92abff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd9240c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.315+0000 7fd92abff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924154850 0x7fd9241405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.315+0000 7fd92abff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd924152b30 con 0x7fd924151270 2023-07-27T14:37:57.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.315+0000 7fd92abff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240a9a80 con 0x7fd924068f00 2023-07-27T14:37:57.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.315+0000 7fd92abff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9241447d0 con 0x7fd924154850 2023-07-27T14:37:57.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.315+0000 7fd923fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd9240c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.315+0000 7fd923fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd9240c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43518/0 (socket says 172.21.15.115:43518) 2023-07-27T14:37:57.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd923fff700 1 -- 172.21.15.115:0/719923166 learned_addr learned my addr 172.21.15.115:0/719923166 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:57.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd92899b700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd924068f00 0x7fd924152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd92919c700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924154850 0x7fd9241405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd923fff700 1 -- 172.21.15.115:0/719923166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924154850 msgr2=0x7fd9241405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd923fff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924154850 0x7fd9241405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd923fff700 1 -- 172.21.15.115:0/719923166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd924068f00 msgr2=0x7fd924152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd923fff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd924068f00 0x7fd924152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd923fff700 1 -- 172.21.15.115:0/719923166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c009ae0 con 0x7fd924151270 2023-07-27T14:37:57.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd923fff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd9240c6aa0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7fd91000c470 tx=0x7fd910007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:57.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd920ff9700 1 -- 172.21.15.115:0/719923166 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910007020 con 0x7fd924151270 2023-07-27T14:37:57.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd920ff9700 1 -- 172.21.15.115:0/719923166 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910007180 con 0x7fd924151270 2023-07-27T14:37:57.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd920ff9700 1 -- 172.21.15.115:0/719923166 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910007520 con 0x7fd924151270 2023-07-27T14:37:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9240c6f90 con 0x7fd924151270 2023-07-27T14:37:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.316+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd924152d90 con 0x7fd924151270 2023-07-27T14:37:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.317+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd924144960 con 0x7fd924151270 2023-07-27T14:37:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.318+0000 7fd920ff9700 1 -- 172.21.15.115:0/719923166 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fd910010070 con 0x7fd924151270 2023-07-27T14:37:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.319+0000 7fd920ff9700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd90805f9f0 0x7fd908061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.319+0000 7fd920ff9700 1 -- 172.21.15.115:0/719923166 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd91007a310 con 0x7fd924151270 2023-07-27T14:37:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.319+0000 7fd92899b700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd90805f9f0 0x7fd908061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.320+0000 7fd92899b700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd90805f9f0 0x7fd908061eb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fd91800bbc0 tx=0x7fd918008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:57.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.323+0000 7fd920ff9700 1 -- 172.21.15.115:0/719923166 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9100478f0 con 0x7fd924151270 2023-07-27T14:37:57.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.557+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd92406c470 con 0x7fd924151270 2023-07-27T14:37:57.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.561+0000 7fd920ff9700 1 -- 172.21.15.115:0/719923166 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd91004e570 con 0x7fd924151270 2023-07-27T14:37:57.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd90805f9f0 msgr2=0x7fd908061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd90805f9f0 0x7fd908061eb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fd91800bbc0 tx=0x7fd918008040).stop 2023-07-27T14:37:57.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 msgr2=0x7fd9240c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd9240c6aa0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7fd91000c470 tx=0x7fd910007dd0).stop 2023-07-27T14:37:57.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 shutdown_connections 2023-07-27T14:37:57.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd90805f9f0 0x7fd908061eb0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd924154850 0x7fd9241405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd924068f00 0x7fd924152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 --2- 172.21.15.115:0/719923166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd924151270 0x7fd9240c6aa0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 >> 172.21.15.115:0/719923166 conn(0x7fd924062df0 msgr2=0x7fd9240c1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:57.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 shutdown_connections 2023-07-27T14:37:57.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.564+0000 7fd92abff700 1 -- 172.21.15.115:0/719923166 wait complete. 2023-07-27T14:37:57.617 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:37:57.632 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:37:57.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.771+0000 7f62e9dff700 1 Processor -- start 2023-07-27T14:37:57.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.771+0000 7f62e9dff700 1 -- start start 2023-07-27T14:37:57.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.772+0000 7f62e9dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 0x7f62e40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.772+0000 7f62e9dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62e41542a0 0x7f62e40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.772+0000 7f62e9dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e40aa4d0 con 0x7f62e4153ec0 2023-07-27T14:37:57.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.772+0000 7f62e9dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e4064ad0 con 0x7f62e41542a0 2023-07-27T14:37:57.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.772+0000 7f62e9dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40c05c0 con 0x7f62e40aaa40 2023-07-27T14:37:57.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62e41542a0 0x7f62e40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62e41542a0 0x7f62e40645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43528/0 (socket says 172.21.15.115:43528) 2023-07-27T14:37:57.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e3fff700 1 -- 172.21.15.115:0/4109010807 learned_addr learned my addr 172.21.15.115:0/4109010807 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:57.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e37fe700 1 --1- 172.21.15.115:0/4109010807 >> v1:172.21.15.115:6789/0 conn(0x7f62e4153ec0 0x7f62e40a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42132/0 (socket says 172.21.15.115:42132) 2023-07-27T14:37:57.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e2ffd700 1 --2- 172.21.15.115:0/4109010807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 0x7f62e40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e3fff700 1 -- 172.21.15.115:0/4109010807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 msgr2=0x7f62e40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:57.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e3fff700 1 --2- 172.21.15.115:0/4109010807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 0x7f62e40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e3fff700 1 -- 172.21.15.115:0/4109010807 >> v1:172.21.15.115:6789/0 conn(0x7f62e4153ec0 legacy=0x7f62e40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e3fff700 1 -- 172.21.15.115:0/4109010807 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e40c1a60 con 0x7f62e41542a0 2023-07-27T14:37:57.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e27fc700 1 -- 172.21.15.115:0/4109010807 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490212318 0 0) 0x7f62d4001110 con 0x7f62e4153ec0 2023-07-27T14:37:57.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e3fff700 1 --2- 172.21.15.115:0/4109010807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e40645e0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f62dc009f20 tx=0x7f62dc009840).ready entity=mon.0 client_cookie=d0ad6e1411797452 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:57.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.773+0000 7f62e27fc700 1 -- 172.21.15.115:0/4109010807 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc00e070 con 0x7f62e41542a0 2023-07-27T14:37:57.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e27fc700 1 -- 172.21.15.115:0/4109010807 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc00ba80 con 0x7f62e41542a0 2023-07-27T14:37:57.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e27fc700 1 -- 172.21.15.115:0/4109010807 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc00be00 con 0x7f62e41542a0 2023-07-27T14:37:57.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e9dff700 1 -- 172.21.15.115:0/4109010807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 msgr2=0x7f62e40645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e9dff700 1 --2- 172.21.15.115:0/4109010807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e40645e0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f62dc009f20 tx=0x7f62dc009840).stop 2023-07-27T14:37:57.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e9dff700 1 -- 172.21.15.115:0/4109010807 shutdown_connections 2023-07-27T14:37:57.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e9dff700 1 --2- 172.21.15.115:0/4109010807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e40645e0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e9dff700 1 --2- 172.21.15.115:0/4109010807 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 0x7f62e40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e9dff700 1 -- 172.21.15.115:0/4109010807 >> 172.21.15.115:0/4109010807 conn(0x7f62e40cb610 msgr2=0x7f62e40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:57.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e9dff700 1 -- 172.21.15.115:0/4109010807 shutdown_connections 2023-07-27T14:37:57.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.774+0000 7f62e9dff700 1 -- 172.21.15.115:0/4109010807 wait complete. 2023-07-27T14:37:57.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.776+0000 7f62e9dff700 1 Processor -- start 2023-07-27T14:37:57.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.776+0000 7f62e9dff700 1 -- start start 2023-07-27T14:37:57.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e9dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 0x7f62e40c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e9dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e4153ec0 0x7f62e4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e9dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e4144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e9dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4159720 con 0x7f62e41542a0 2023-07-27T14:37:57.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e9dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40adb40 con 0x7f62e4153ec0 2023-07-27T14:37:57.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e9dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40c28c0 con 0x7f62e40aaa40 2023-07-27T14:37:57.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e4144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e4144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43544/0 (socket says 172.21.15.115:43544) 2023-07-27T14:37:57.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e3fff700 1 -- 172.21.15.115:0/3610491065 learned_addr learned my addr 172.21.15.115:0/3610491065 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:57.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e2ffd700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e4153ec0 0x7f62e4158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e37fe700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 0x7f62e40c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e3fff700 1 -- 172.21.15.115:0/3610491065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 msgr2=0x7f62e40c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e3fff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 0x7f62e40c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e3fff700 1 -- 172.21.15.115:0/3610491065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e4153ec0 msgr2=0x7f62e4158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:57.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e3fff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e4153ec0 0x7f62e4158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:57.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.778+0000 7f62e3fff700 1 -- 172.21.15.115:0/3610491065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc009ae0 con 0x7f62e41542a0 2023-07-27T14:37:57.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.779+0000 7f62e3fff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e4144760 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f62e4060760 tx=0x7f62dc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:57.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.779+0000 7f62cb7fe700 1 -- 172.21.15.115:0/3610491065 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc009500 con 0x7f62e41542a0 2023-07-27T14:37:57.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.779+0000 7f62cb7fe700 1 -- 172.21.15.115:0/3610491065 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc013e80 con 0x7f62e41542a0 2023-07-27T14:37:57.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.779+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e4167720 con 0x7f62e41542a0 2023-07-27T14:37:57.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.779+0000 7f62cb7fe700 1 -- 172.21.15.115:0/3610491065 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc007840 con 0x7f62e41542a0 2023-07-27T14:37:57.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.779+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e4167ce0 con 0x7f62e41542a0 2023-07-27T14:37:57.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.780+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e40adc80 con 0x7f62e41542a0 2023-07-27T14:37:57.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.781+0000 7f62cb7fe700 1 -- 172.21.15.115:0/3610491065 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f62dc025030 con 0x7f62e41542a0 2023-07-27T14:37:57.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.782+0000 7f62cb7fe700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62d005f9f0 0x7f62d0061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:57.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.782+0000 7f62cb7fe700 1 -- 172.21.15.115:0/3610491065 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f62dc07c9d0 con 0x7f62e41542a0 2023-07-27T14:37:57.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.782+0000 7f62e37fe700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62d005f9f0 0x7f62d0061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:57.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.782+0000 7f62e37fe700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62d005f9f0 0x7f62d0061eb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f62d4007520 tx=0x7f62d4007a10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:57.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.786+0000 7f62cb7fe700 1 -- 172.21.15.115:0/3610491065 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f62e40adc80 con 0x7f62e41542a0 2023-07-27T14:37:57.928 INFO:tasks.ceph.mds.a.smithi115.stderr:2023-07-27T14:37:57.877+0000 7f4bbc9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:37:58.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:57.999+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62e40adc80 con 0x7f62e41542a0 2023-07-27T14:37:58.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.000+0000 7f62cb7fe700 1 -- 172.21.15.115:0/3610491065 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f62e40adc80 con 0x7f62e41542a0 2023-07-27T14:37:58.051 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:37:58.051 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":93,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3836371},{"type":"v1","addr":"172.21.15.159:6833","nonce":3836371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1315171707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1315171707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1315171707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1825044502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1825044502},{"type":"v1","addr":"172.21.15.159:6835","nonce":1825044502}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:37:52.356956+0000","modified":"2023-07-27T14:37:55.374238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9222":{"gid":9222,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/991393631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":991393631},{"type":"v1","addr":"172.21.15.115:6836","nonce":991393631}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-07-27T14:37:58.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62d005f9f0 msgr2=0x7f62d0061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62d005f9f0 0x7f62d0061eb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f62d4007520 tx=0x7f62d4007a10).stop 2023-07-27T14:37:58.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 msgr2=0x7f62e4144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e4144760 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f62e4060760 tx=0x7f62dc009840).stop 2023-07-27T14:37:58.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 shutdown_connections 2023-07-27T14:37:58.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f62d005f9f0 0x7f62d0061eb0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62e41542a0 0x7f62e4144760 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f62e40aaa40 0x7f62e40c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 --2- 172.21.15.115:0/3610491065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e4153ec0 0x7f62e4158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 >> 172.21.15.115:0/3610491065 conn(0x7f62e40cb610 msgr2=0x7f62e40ab780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:58.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 shutdown_connections 2023-07-27T14:37:58.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.002+0000 7f62e9dff700 1 -- 172.21.15.115:0/3610491065 wait complete. 2023-07-27T14:37:58.055 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 93 2023-07-27T14:37:58.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:37:52.356956+0000', 'modified': '2023-07-27T14:37:55.374238+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9222}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9222': {'gid': 9222, 'name': 'a', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6836/991393631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 991393631}, {'type': 'v1', 'addr': '172.21.15.115:6836', 'nonce': 991393631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:37:58.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:37:58.474 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-27T14:37:58.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.613+0000 7f2b0ef9d700 1 Processor -- start 2023-07-27T14:37:58.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.613+0000 7f2b0ef9d700 1 -- start start 2023-07-27T14:37:58.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.614+0000 7f2b0ef9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b08153a60 0x7f2b080c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.614+0000 7f2b0ef9d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b080c9e40 con 0x7f2b08153e40 2023-07-27T14:37:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.614+0000 7f2b0ef9d700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b080c9230 con 0x7f2b080c8c80 2023-07-27T14:37:58.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.614+0000 7f2b0ef9d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080c9510 con 0x7f2b08153a60 2023-07-27T14:37:58.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0d79a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2b08153e40 0x7f2b080c8570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42144/0 (socket says 172.21.15.115:42144) 2023-07-27T14:37:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0d79a700 1 -- 172.21.15.115:0/178500080 learned_addr learned my addr 172.21.15.115:0/178500080 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:37:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b08153a60 0x7f2b080c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671612421 0 0) 0x7f2b080c9e40 con 0x7f2b08153e40 2023-07-27T14:37:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af40033f0 con 0x7f2b08153e40 2023-07-27T14:37:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211366251 0 0) 0x7f2af40033f0 con 0x7f2b08153e40 2023-07-27T14:37:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b08153a60 msgr2=0x7f2b080c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b08153a60 0x7f2b080c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 >> v1:172.21.15.159:6789/0 conn(0x7f2b080c8c80 legacy=0x7f2b080aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080c97f0 con 0x7f2b08153e40 2023-07-27T14:37:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f2af8001470 con 0x7f2b08153e40 2023-07-27T14:37:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 >> v1:172.21.15.115:6789/0 conn(0x7f2b08153e40 legacy=0x7f2b080c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b08153a60 0x7f2af4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2af4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af4004b80 0x7f2af4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080c9510 con 0x7f2af4003e40 2023-07-27T14:37:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af400b990 con 0x7f2af4004b80 2023-07-27T14:37:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.615+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af400bb50 con 0x7f2b08153a60 2023-07-27T14:37:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2af4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b08153a60 0x7f2af4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af4004b80 0x7f2af4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0d79a700 1 -- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b08153a60 msgr2=0x7f2af4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b08153a60 0x7f2af4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0d79a700 1 -- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af4004b80 msgr2=0x7f2af4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2af4004b80 0x7f2af4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0d79a700 1 -- 172.21.15.115:0/178500080 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40033f0 con 0x7f2af4003e40 2023-07-27T14:37:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2af4004690 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f2b0806aa20 tx=0x7f2af8001e70).ready entity=mon.0 client_cookie=7250ff8d7e3104e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8007a40 con 0x7f2af4003e40 2023-07-27T14:37:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800c9d0 con 0x7f2af4003e40 2023-07-27T14:37:58.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.616+0000 7f2b0cf99700 1 -- 172.21.15.115:0/178500080 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800cd70 con 0x7f2af4003e40 2023-07-27T14:37:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.617+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/178500080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 msgr2=0x7f2af4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.617+0000 7f2b0ef9d700 1 --2- 172.21.15.115:0/178500080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2af4004690 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f2b0806aa20 tx=0x7f2af8001e70).stop 2023-07-27T14:37:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.617+0000 7f2b0e79c700 1 -- 172.21.15.115:0/178500080 reap_dead start 2023-07-27T14:37:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.617+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/178500080 shutdown_connections 2023-07-27T14:37:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.617+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/178500080 >> 172.21.15.115:0/178500080 conn(0x7f2b080c7f80 msgr2=0x7f2b0805de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:58.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.617+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/178500080 shutdown_connections 2023-07-27T14:37:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.617+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/178500080 wait complete. 2023-07-27T14:37:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.619+0000 7f2b0ef9d700 1 Processor -- start 2023-07-27T14:37:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.619+0000 7f2b0ef9d700 1 -- start start 2023-07-27T14:37:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0ef9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2b080c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0ef9d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0814e8f0 0x7f2b080af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0ef9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b080af9b0 0x7f2b080ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0ef9d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08167250 con 0x7f2af4003e40 2023-07-27T14:37:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0ef9d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080c30e0 con 0x7f2b0814e8f0 2023-07-27T14:37:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0ef9d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08168070 con 0x7f2b080af9b0 2023-07-27T14:37:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2b080c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2b080c2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43554/0 (socket says 172.21.15.115:43554) 2023-07-27T14:37:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 -- 172.21.15.115:0/1368741705 learned_addr learned my addr 172.21.15.115:0/1368741705 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b080af9b0 0x7f2b080ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0814e8f0 0x7f2b080af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 -- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b080af9b0 msgr2=0x7f2b080ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b080af9b0 0x7f2b080ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 -- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0814e8f0 msgr2=0x7f2b080af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0814e8f0 0x7f2b080af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 -- 172.21.15.115:0/1368741705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b08167460 con 0x7f2af4003e40 2023-07-27T14:37:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0814e8f0 0x7f2b080af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.620+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2b080c2bf0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f2b040119f0 tx=0x7f2b04009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.621+0000 7f2afdffb700 1 -- 172.21.15.115:0/1368741705 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400f8e0 con 0x7f2af4003e40 2023-07-27T14:37:58.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.621+0000 7f2afdffb700 1 -- 172.21.15.115:0/1368741705 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400fa40 con 0x7f2af4003e40 2023-07-27T14:37:58.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.621+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/1368741705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b08167740 con 0x7f2af4003e40 2023-07-27T14:37:58.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.621+0000 7f2afdffb700 1 -- 172.21.15.115:0/1368741705 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400fdc0 con 0x7f2af4003e40 2023-07-27T14:37:58.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.621+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/1368741705 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b08167d00 con 0x7f2af4003e40 2023-07-27T14:37:58.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.623+0000 7f2afdffb700 1 -- 172.21.15.115:0/1368741705 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f2b04024070 con 0x7f2af4003e40 2023-07-27T14:37:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.624+0000 7f2afdffb700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2aec05f9f0 0x7f2aec061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.624+0000 7f2afdffb700 1 -- 172.21.15.115:0/1368741705 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2b0407bb00 con 0x7f2af4003e40 2023-07-27T14:37:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.624+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2aec05f9f0 0x7f2aec061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.625+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2aec05f9f0 0x7f2aec061eb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f2b0806aa20 tx=0x7f2af8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.626+0000 7f2b27551b80 1 Processor -- start 2023-07-27T14:37:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.626+0000 7f2b27551b80 1 -- start start 2023-07-27T14:37:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d3770 0x559b427d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427fb9e0 0x559b42821e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b427d6110 0x559b42822360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b27551b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b427109c0 con 0x559b427d6110 2023-07-27T14:37:58.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b27551b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b42725cc0 con 0x559b427d3770 2023-07-27T14:37:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b27551b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b426ece10 con 0x559b427fb9e0 2023-07-27T14:37:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b0e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b427d6110 0x559b42822360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b0e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b427d6110 0x559b42822360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43556/0 (socket says 172.21.15.115:43556) 2023-07-27T14:37:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b0e79c700 1 -- 172.21.15.115:0/286091412 learned_addr learned my addr 172.21.15.115:0/286091412 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d3770 0x559b427d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.627+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427fb9e0 0x559b42821e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2b0e79c700 1 -- 172.21.15.115:0/286091412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427fb9e0 msgr2=0x559b42821e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427fb9e0 0x559b42821e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2b0e79c700 1 -- 172.21.15.115:0/286091412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d3770 msgr2=0x559b427d3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d3770 0x559b427d3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2b0e79c700 1 -- 172.21.15.115:0/286091412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b4271e9a0 con 0x559b427d6110 2023-07-27T14:37:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b427d6110 0x559b42822360 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f2b000028f0 tx=0x7f2b00007f30).ready entity=mon.0 client_cookie=6d9dbc59e6fc38b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2af2ffd700 1 -- 172.21.15.115:0/286091412 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00006a20 con 0x559b427d6110 2023-07-27T14:37:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2af2ffd700 1 -- 172.21.15.115:0/286091412 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00002e90 con 0x559b427d6110 2023-07-27T14:37:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.628+0000 7f2af2ffd700 1 -- 172.21.15.115:0/286091412 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00006d90 con 0x559b427d6110 2023-07-27T14:37:58.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 -- 172.21.15.115:0/286091412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b427d6110 msgr2=0x559b42822360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b427d6110 0x559b42822360 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f2b000028f0 tx=0x7f2b00007f30).stop 2023-07-27T14:37:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 -- 172.21.15.115:0/286091412 shutdown_connections 2023-07-27T14:37:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b427d6110 0x559b42822360 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d3770 0x559b427d3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 --2- 172.21.15.115:0/286091412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427fb9e0 0x559b42821e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 -- 172.21.15.115:0/286091412 >> 172.21.15.115:0/286091412 conn(0x559b4263e940 msgr2=0x559b4281c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:58.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 -- 172.21.15.115:0/286091412 shutdown_connections 2023-07-27T14:37:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 -- 172.21.15.115:0/286091412 wait complete. 2023-07-27T14:37:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.629+0000 7f2b27551b80 1 -- start start 2023-07-27T14:37:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.630+0000 7f2b27551b80 1 Processor -- start 2023-07-27T14:37:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b27551b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b427f41d0 con 0x559b42816a40 2023-07-27T14:37:58.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b27551b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b42816ef0 con 0x559b427d6110 2023-07-27T14:37:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b27551b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b42817d50 con 0x559b427d3770 2023-07-27T14:37:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b27551b80 10 client.0 ll_register_callbacks cb 0x559b426d84a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:37:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43562/0 (socket says 172.21.15.115:43562) 2023-07-27T14:37:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0e79c700 1 -- 172.21.15.115:0/449584873 learned_addr learned my addr 172.21.15.115:0/449584873 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0e79c700 1 -- 172.21.15.115:0/449584873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 msgr2=0x559b427f8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0e79c700 1 -- 172.21.15.115:0/449584873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 msgr2=0x559b427f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.631+0000 7f2b0e79c700 1 -- 172.21.15.115:0/449584873 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0000f040 con 0x559b42816a40 2023-07-27T14:37:58.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427f5b40 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f2b00000f80 tx=0x7f2b00019000).ready entity=mon.0 client_cookie=409a34b7158e2ac3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2ae7fff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:37:58.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2ae7fff700 1 -- 172.21.15.115:0/449584873 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00010d70 con 0x559b42816a40 2023-07-27T14:37:58.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 1 -- 172.21.15.115:0/449584873 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b427cdd50 con 0x559b42816a40 2023-07-27T14:37:58.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2ae7fff700 1 -- 172.21.15.115:0/449584873 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2b00007040 con 0x559b42816a40 2023-07-27T14:37:58.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2ae7fff700 1 -- 172.21.15.115:0/449584873 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b00010ed0 con 0x559b42816a40 2023-07-27T14:37:58.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 10 client.9375 fetch_fsmap learned FSMap version 93 2023-07-27T14:37:58.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 1 -- 172.21.15.115:0/449584873 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x559b4271a190 con 0x559b42816a40 2023-07-27T14:37:58.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2ae7fff700 1 -- 172.21.15.115:0/449584873 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b427cdd50 con 0x559b42816a40 2023-07-27T14:37:58.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2ae7fff700 1 -- 172.21.15.115:0/449584873 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2b00007410 con 0x559b42816a40 2023-07-27T14:37:58.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 10 client.9375 fetch_fsmap finished waiting for FSMap version 93 2023-07-27T14:37:58.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 10 client.9375 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:37:58.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 20 client.9375 populate_metadata read hostname 'smithi115' 2023-07-27T14:37:58.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] conn(0x559b427f38b0 0x559b427f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 4 client.9375 mds_command: new command op to 9222 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:37:58.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.632+0000 7f2b27551b80 1 -- 172.21.15.115:0/449584873 --> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b4258eef0 con 0x559b427f38b0 2023-07-27T14:37:58.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.633+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] conn(0x559b427f38b0 0x559b427f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.633+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] conn(0x559b427f38b0 0x559b427f3c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9997f0e2a63233b6 server_cookie=d8955f330ae80c7 in_seq=0 out_seq=0 2023-07-27T14:37:58.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.633+0000 7f2ae7fff700 10 client.9375 ms_handle_connect on v2:172.21.15.115:6834/991393631 2023-07-27T14:37:58.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2ae7fff700 1 -- 172.21.15.115:0/449584873 <== mds.0 v2:172.21.15.115:6834/991393631 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x559b4258eef0 con 0x559b427f38b0 2023-07-27T14:37:58.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2ae7fff700 10 client.9375 handle_command_reply: tid=0 2023-07-27T14:37:58.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 client.9375 shutdown 2023-07-27T14:37:58.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 -- 172.21.15.115:0/449584873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 msgr2=0x559b427f5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427f5b40 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f2b00000f80 tx=0x7f2b00019000).stop 2023-07-27T14:37:58.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 -- 172.21.15.115:0/449584873 shutdown_connections 2023-07-27T14:37:58.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427f5b40 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] conn(0x559b427f38b0 0x559b427f3c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 --2- 172.21.15.115:0/449584873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 -- 172.21.15.115:0/449584873 >> 172.21.15.115:0/449584873 conn(0x559b4263e940 msgr2=0x559b427d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:58.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2ae7fff700 0 client.9375 ms_handle_reset on v2:172.21.15.115:6834/991393631 2023-07-27T14:37:58.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 -- 172.21.15.115:0/449584873 shutdown_connections 2023-07-27T14:37:58.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 1 -- 172.21.15.115:0/449584873 wait complete. 2023-07-27T14:37:58.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.634+0000 7f2b27551b80 20 client.9375 trim_cache size 0 max 16384 2023-07-27T14:37:58.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.651+0000 7f2b27551b80 1 Processor -- start 2023-07-27T14:37:58.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.651+0000 7f2b27551b80 1 -- start start 2023-07-27T14:37:58.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b27551b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b427d24a0 con 0x559b42816a40 2023-07-27T14:37:58.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b27551b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b427cd110 con 0x559b427d6110 2023-07-27T14:37:58.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b27551b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b427f3c90 con 0x559b427d3770 2023-07-27T14:37:58.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b0e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b0e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43574/0 (socket says 172.21.15.115:43574) 2023-07-27T14:37:58.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b0e79c700 1 -- 172.21.15.115:0/2231560828 learned_addr learned my addr 172.21.15.115:0/2231560828 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:58.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.652+0000 7f2b0e79c700 1 -- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 msgr2=0x559b427f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b0e79c700 1 -- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 msgr2=0x559b427f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b0e79c700 1 -- 172.21.15.115:0/2231560828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b427f3ff0 con 0x559b42816a40 2023-07-27T14:37:58.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:58.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b0d79a700 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:37:58.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0fe0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f2b00001600 tx=0x7f2b0001e000).ready entity=mon.0 client_cookie=cfd9ebb0189c9691 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2af37fe700 1 -- 172.21.15.115:0/2231560828 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00010910 con 0x559b42816a40 2023-07-27T14:37:58.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2af37fe700 1 -- 172.21.15.115:0/2231560828 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00007040 con 0x559b42816a40 2023-07-27T14:37:58.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2af37fe700 1 -- 172.21.15.115:0/2231560828 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00010d70 con 0x559b42816a40 2023-07-27T14:37:58.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b27551b80 1 -- 172.21.15.115:0/2231560828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 msgr2=0x559b427d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b27551b80 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0fe0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f2b00001600 tx=0x7f2b0001e000).stop 2023-07-27T14:37:58.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.653+0000 7f2b27551b80 1 -- 172.21.15.115:0/2231560828 shutdown_connections 2023-07-27T14:37:58.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.654+0000 7f2b27551b80 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0fe0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.654+0000 7f2b27551b80 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b427f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.654+0000 7f2b27551b80 1 --2- 172.21.15.115:0/2231560828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b427f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.654+0000 7f2b27551b80 1 -- 172.21.15.115:0/2231560828 >> 172.21.15.115:0/2231560828 conn(0x559b4263e940 msgr2=0x559b427f2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:58.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.654+0000 7f2b27551b80 1 -- 172.21.15.115:0/2231560828 shutdown_connections 2023-07-27T14:37:58.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.654+0000 7f2b27551b80 1 -- 172.21.15.115:0/2231560828 wait complete. 2023-07-27T14:37:58.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.654+0000 7f2b27551b80 1 -- start start 2023-07-27T14:37:58.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.654+0000 7f2b27551b80 1 Processor -- start 2023-07-27T14:37:58.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.655+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b4287db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.655+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b4282ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.655+0000 7f2b27551b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.655+0000 7f2b27551b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b428327f0 con 0x559b42816a40 2023-07-27T14:37:58.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.655+0000 7f2b27551b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b42831820 con 0x559b427d6110 2023-07-27T14:37:58.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.655+0000 7f2b27551b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b4287f810 con 0x559b427d3770 2023-07-27T14:37:58.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.655+0000 7f2b27551b80 10 client.0 ll_register_callbacks cb 0x559b426d84a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:37:58.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43576/0 (socket says 172.21.15.115:43576) 2023-07-27T14:37:58.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 -- 172.21.15.115:0/4043071559 learned_addr learned my addr 172.21.15.115:0/4043071559 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:58.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 -- 172.21.15.115:0/4043071559 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 msgr2=0x559b4287db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b4287db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:58.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 -- 172.21.15.115:0/4043071559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 msgr2=0x559b4282ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b4282ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:58.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 -- 172.21.15.115:0/4043071559 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b4271a190 con 0x559b42816a40 2023-07-27T14:37:58.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b0e79c700 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0f70 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f2b000071d0 tx=0x7f2b00016040).ready entity=mon.0 client_cookie=97849109228c3036 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2ae7fff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:37:58.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2ae7fff700 1 -- 172.21.15.115:0/4043071559 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0001eb60 con 0x559b42816a40 2023-07-27T14:37:58.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2ae7fff700 1 -- 172.21.15.115:0/4043071559 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2b0001ecc0 con 0x559b42816a40 2023-07-27T14:37:58.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.656+0000 7f2b27551b80 1 -- 172.21.15.115:0/4043071559 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b00002e90 con 0x559b42816a40 2023-07-27T14:37:58.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2ae7fff700 1 -- 172.21.15.115:0/4043071559 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b0001ee80 con 0x559b42816a40 2023-07-27T14:37:58.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b27551b80 10 client.9381 fetch_fsmap learned FSMap version 93 2023-07-27T14:37:58.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b27551b80 1 -- 172.21.15.115:0/4043071559 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x559b42719ee0 con 0x559b42816a40 2023-07-27T14:37:58.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2ae7fff700 1 -- 172.21.15.115:0/4043071559 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00002e90 con 0x559b42816a40 2023-07-27T14:37:58.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2ae7fff700 1 -- 172.21.15.115:0/4043071559 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2b00010910 con 0x559b42816a40 2023-07-27T14:37:58.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b27551b80 10 client.9381 fetch_fsmap finished waiting for FSMap version 93 2023-07-27T14:37:58.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b27551b80 10 client.9381 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:37:58.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b27551b80 20 client.9381 populate_metadata read hostname 'smithi115' 2023-07-27T14:37:58.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b27551b80 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] conn(0x559b427f4310 0x559b427f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b27551b80 4 client.9381 mds_command: new command op to 9222 tid=0[{"prefix": "status"}] 2023-07-27T14:37:58.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b27551b80 1 -- 172.21.15.115:0/4043071559 --> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559b425c4040 con 0x559b427f4310 2023-07-27T14:37:58.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.657+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] conn(0x559b427f4310 0x559b427f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2ae7fff700 10 client.9381 ms_handle_connect on v2:172.21.15.115:6834/991393631 2023-07-27T14:37:58.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b0df9b700 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] conn(0x559b427f4310 0x559b427f46f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a079ecae475e2618 server_cookie=ca746278140b3ed8 in_seq=0 out_seq=0 2023-07-27T14:37:58.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2ae7fff700 1 -- 172.21.15.115:0/4043071559 <== mds.0 v2:172.21.15.115:6834/991393631 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x559b425c4040 con 0x559b427f4310 2023-07-27T14:37:58.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2ae7fff700 10 client.9381 handle_command_reply: tid=0 2023-07-27T14:37:58.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 client.9381 shutdown 2023-07-27T14:37:58.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 -- 172.21.15.115:0/4043071559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 msgr2=0x559b427d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0f70 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f2b000071d0 tx=0x7f2b00016040).stop 2023-07-27T14:37:58.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 -- 172.21.15.115:0/4043071559 shutdown_connections 2023-07-27T14:37:58.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559b42816a40 0x559b427d0f70 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x559b427d3770 0x559b4287db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:58.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.115:6834/991393631,v1:172.21.15.115:6836/991393631] conn(0x559b427f4310 0x559b427f46f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 --2- 172.21.15.115:0/4043071559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559b427d6110 0x559b4282ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:37:58.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2ae7fff700 0 client.9381 ms_handle_reset on v2:172.21.15.115:6834/991393631 2023-07-27T14:37:58.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 -- 172.21.15.115:0/4043071559 >> 172.21.15.115:0/4043071559 conn(0x559b4263e940 msgr2=0x559b427f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:58.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 -- 172.21.15.115:0/4043071559 shutdown_connections 2023-07-27T14:37:58.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 1 -- 172.21.15.115:0/4043071559 wait complete. 2023-07-27T14:37:58.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.658+0000 7f2b27551b80 20 client.9381 trim_cache size 0 max 16384 2023-07-27T14:37:58.719 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:37:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:37:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:37:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 9222, 2023-07-27T14:37:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:37:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:37:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:37:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2996421140000001, 2023-07-27T14:37:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 93, 2023-07-27T14:37:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 174, 2023-07-27T14:37:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 174, 2023-07-27T14:37:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 11.512468950000001 2023-07-27T14:37:58.721 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:37:58.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2aec05f9f0 msgr2=0x7f2aec061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2aec05f9f0 0x7f2aec061eb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f2b0806aa20 tx=0x7f2af8015000).stop 2023-07-27T14:37:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 msgr2=0x7f2b080c2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2b080c2bf0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f2b040119f0 tx=0x7f2b04009060).stop 2023-07-27T14:37:58.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/1368741705 shutdown_connections 2023-07-27T14:37:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2aec05f9f0 0x7f2aec061eb0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b080af9b0 0x7f2b080ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2af4003e40 0x7f2b080c2bf0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 --2- 172.21.15.115:0/1368741705 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b0814e8f0 0x7f2b080af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/1368741705 >> 172.21.15.115:0/1368741705 conn(0x7f2b080c7f80 msgr2=0x7f2b080c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/1368741705 shutdown_connections 2023-07-27T14:37:58.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.659+0000 7f2b0ef9d700 1 -- 172.21.15.115:0/1368741705 wait complete. 2023-07-27T14:37:58.728 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:37:58.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.835+0000 7faacb1ff700 1 Processor -- start 2023-07-27T14:37:58.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.835+0000 7faacb1ff700 1 -- start start 2023-07-27T14:37:58.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faacb1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faac40aac40 0x7faac4154350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faacb1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faac40c5bf0 0x7faac40c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faacb1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac40c0750 con 0x7faac4153f70 2023-07-27T14:37:58.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faacb1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac40bfc10 con 0x7faac40aac40 2023-07-27T14:37:58.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faacb1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac40c6550 con 0x7faac40c5bf0 2023-07-27T14:37:58.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faac3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faac40aac40 0x7faac4154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faac3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faac40aac40 0x7faac4154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43590/0 (socket says 172.21.15.115:43590) 2023-07-27T14:37:58.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faac3fff700 1 -- 172.21.15.115:0/3019507279 learned_addr learned my addr 172.21.15.115:0/3019507279 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:58.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.836+0000 7faac8f9b700 1 --1- 172.21.15.115:0/3019507279 >> v1:172.21.15.115:6789/0 conn(0x7faac4153f70 0x7faac40a9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42154/0 (socket says 172.21.15.115:42154) 2023-07-27T14:37:58.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac979c700 1 --2- 172.21.15.115:0/3019507279 >> v2:172.21.15.159:3300/0 conn(0x7faac40c5bf0 0x7faac40c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac3fff700 1 -- 172.21.15.115:0/3019507279 >> v2:172.21.15.159:3300/0 conn(0x7faac40c5bf0 msgr2=0x7faac40c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:37:58.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac3fff700 1 --2- 172.21.15.115:0/3019507279 >> v2:172.21.15.159:3300/0 conn(0x7faac40c5bf0 0x7faac40c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac3fff700 1 -- 172.21.15.115:0/3019507279 >> v1:172.21.15.115:6789/0 conn(0x7faac4153f70 legacy=0x7faac40a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac3fff700 1 -- 172.21.15.115:0/3019507279 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40bfe20 con 0x7faac40aac40 2023-07-27T14:37:58.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac37fe700 1 -- 172.21.15.115:0/3019507279 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997539221 0 0) 0x7faac40c0750 con 0x7faac4153f70 2023-07-27T14:37:58.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac3fff700 1 --2- 172.21.15.115:0/3019507279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40aac40 0x7faac4154350 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7faac40c88c0 tx=0x7faab00090f0).ready entity=mon.0 client_cookie=2be949c5923013ee server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac37fe700 1 -- 172.21.15.115:0/3019507279 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000b520 con 0x7faac40aac40 2023-07-27T14:37:58.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac37fe700 1 -- 172.21.15.115:0/3019507279 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab000b680 con 0x7faac40aac40 2023-07-27T14:37:58.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.837+0000 7faac37fe700 1 -- 172.21.15.115:0/3019507279 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000ba20 con 0x7faac40aac40 2023-07-27T14:37:58.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.838+0000 7faacb1ff700 1 -- 172.21.15.115:0/3019507279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40aac40 msgr2=0x7faac4154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.838+0000 7faacb1ff700 1 --2- 172.21.15.115:0/3019507279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40aac40 0x7faac4154350 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7faac40c88c0 tx=0x7faab00090f0).stop 2023-07-27T14:37:58.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.838+0000 7faacb1ff700 1 -- 172.21.15.115:0/3019507279 shutdown_connections 2023-07-27T14:37:58.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.838+0000 7faacb1ff700 1 --2- 172.21.15.115:0/3019507279 >> v2:172.21.15.159:3300/0 conn(0x7faac40c5bf0 0x7faac40c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.838+0000 7faacb1ff700 1 --2- 172.21.15.115:0/3019507279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40aac40 0x7faac4154350 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.838+0000 7faacb1ff700 1 -- 172.21.15.115:0/3019507279 >> 172.21.15.115:0/3019507279 conn(0x7faac40cb780 msgr2=0x7faac40c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:58.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.838+0000 7faacb1ff700 1 -- 172.21.15.115:0/3019507279 shutdown_connections 2023-07-27T14:37:58.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.838+0000 7faacb1ff700 1 -- 172.21.15.115:0/3019507279 wait complete. 2023-07-27T14:37:58.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.840+0000 7faacb1ff700 1 Processor -- start 2023-07-27T14:37:58.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.840+0000 7faacb1ff700 1 -- start start 2023-07-27T14:37:58.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.841+0000 7faacb1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac40aac40 0x7faac4167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.841+0000 7faacb1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40c5bf0 0x7faac41596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.841+0000 7faacb1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac4153f70 0x7faac40c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faacb1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac414e290 con 0x7faac40c5bf0 2023-07-27T14:37:58.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faacb1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac40c2af0 con 0x7faac40aac40 2023-07-27T14:37:58.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faacb1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac40c4b60 con 0x7faac4153f70 2023-07-27T14:37:58.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40c5bf0 0x7faac41596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40c5bf0 0x7faac41596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43594/0 (socket says 172.21.15.115:43594) 2023-07-27T14:37:58.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 -- 172.21.15.115:0/1346378027 learned_addr learned my addr 172.21.15.115:0/1346378027 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:37:58.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac8f9b700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac40aac40 0x7faac4167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac979c700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac4153f70 0x7faac40c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 -- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac4153f70 msgr2=0x7faac40c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac4153f70 0x7faac40c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 -- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac40aac40 msgr2=0x7faac4167c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:58.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac40aac40 0x7faac4167c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:58.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 -- 172.21.15.115:0/1346378027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0009370 con 0x7faac40c5bf0 2023-07-27T14:37:58.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac979c700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac4153f70 0x7faac40c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:37:58.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.842+0000 7faac3fff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40c5bf0 0x7faac41596c0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7faab0011000 tx=0x7faab0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.843+0000 7faac0ff9700 1 -- 172.21.15.115:0/1346378027 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0000bc0 con 0x7faac40c5bf0 2023-07-27T14:37:58.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.843+0000 7faac0ff9700 1 -- 172.21.15.115:0/1346378027 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab000b7f0 con 0x7faac40c5bf0 2023-07-27T14:37:58.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.843+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac40c4230 con 0x7faac40c5bf0 2023-07-27T14:37:58.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.843+0000 7faac0ff9700 1 -- 172.21.15.115:0/1346378027 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0000d20 con 0x7faac40c5bf0 2023-07-27T14:37:58.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.843+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac40c47f0 con 0x7faac40c5bf0 2023-07-27T14:37:58.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.844+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac405f0c0 con 0x7faac40c5bf0 2023-07-27T14:37:58.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.845+0000 7faac0ff9700 1 -- 172.21.15.115:0/1346378027 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7faab002c070 con 0x7faac40c5bf0 2023-07-27T14:37:58.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.846+0000 7faac0ff9700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faaa805f9f0 0x7faaa8061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:37:58.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.846+0000 7faac0ff9700 1 -- 172.21.15.115:0/1346378027 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faab007c9e0 con 0x7faac40c5bf0 2023-07-27T14:37:58.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.847+0000 7faac8f9b700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faaa805f9f0 0x7faaa8061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:37:58.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.847+0000 7faac8f9b700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faaa805f9f0 0x7faaa8061eb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7faab8007750 tx=0x7faab8007c90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:37:58.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:58.850+0000 7faac0ff9700 1 -- 172.21.15.115:0/1346378027 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faab004d320 con 0x7faac40c5bf0 2023-07-27T14:37:59.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.063+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faac40c4ca0 con 0x7faac40c5bf0 2023-07-27T14:37:59.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.063+0000 7faac0ff9700 1 -- 172.21.15.115:0/1346378027 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7faac40c4ca0 con 0x7faac40c5bf0 2023-07-27T14:37:59.115 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:37:59.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faaa805f9f0 msgr2=0x7faaa8061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:59.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faaa805f9f0 0x7faaa8061eb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7faab8007750 tx=0x7faab8007c90).stop 2023-07-27T14:37:59.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40c5bf0 msgr2=0x7faac41596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:37:59.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40c5bf0 0x7faac41596c0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7faab0011000 tx=0x7faab0017000).stop 2023-07-27T14:37:59.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 shutdown_connections 2023-07-27T14:37:59.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faaa805f9f0 0x7faaa8061eb0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:59.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faac4153f70 0x7faac40c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:59.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faac40aac40 0x7faac4167c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:59.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 --2- 172.21.15.115:0/1346378027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faac40c5bf0 0x7faac41596c0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:37:59.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 >> 172.21.15.115:0/1346378027 conn(0x7faac40cb780 msgr2=0x7faac40ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:37:59.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 shutdown_connections 2023-07-27T14:37:59.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:37:59.065+0000 7faacb1ff700 1 -- 172.21.15.115:0/1346378027 wait complete. 2023-07-27T14:37:59.131 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:37:59.132 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:37:59.132 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:37:59.132 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:37:59.132 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:37:59.133 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:37:59.133 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:37:59.133 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:37:59.134 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:37:59.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:59.134 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:37:59.181 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:37:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:37:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:37:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:37:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:37:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:37:59.182 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:37:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:37:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:37:59.182 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:37:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:37:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:37:59.183 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:37:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:37:59.183 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:37:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:37:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:37:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41322sec preferred_lft 41322sec 2023-07-27T14:37:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:37:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:37:59.184 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:37:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:37:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:37:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:37:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:37:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:37:59.185 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:37:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:37:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:37:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:37:59.185 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:37:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:37:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:37:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:37:59.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:59.187 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:37:59.254 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:37:59.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:59.258 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:37:59.307 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:37:59.308 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:37:59.308 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:37:59.308 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:37:59.308 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:37:59.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:59.309 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:37:59.310 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:37:59.310 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:37:59.310 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:37:59.311 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:37:59.311 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:37:59.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:59.481 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:37:59.528 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:37:59.528 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:37:59.528 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:37:59.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:59.529 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:37:59.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:59.639 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:37:59.686 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:37:59.687 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:37:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:37:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:37:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:37:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:37:59.854 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:37:59.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:37:59.855 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:37:59.925 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:38:00.096 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.045+0000 7f028ebff700 1 Processor -- start 2023-07-27T14:38:00.097 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.046+0000 7f028ebff700 1 -- start start 2023-07-27T14:38:00.100 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028ebff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0288153f70 0x7f0288154350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:00.100 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028ebff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0288063530 0x7f0288063960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:00.101 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028ebff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880630a0 con 0x7f02880bc070 2023-07-27T14:38:00.101 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028ebff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0288062490 con 0x7f0288063530 2023-07-27T14:38:00.101 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028ebff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0288062770 con 0x7f0288153f70 2023-07-27T14:38:00.102 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028c99b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0288153f70 0x7f0288154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:00.102 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028c99b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0288153f70 0x7f0288154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54904/0 (socket says 172.21.15.159:54904) 2023-07-27T14:38:00.102 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028c99b700 1 -- 172.21.15.159:0/996820753 learned_addr learned my addr 172.21.15.159:0/996820753 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:38:00.102 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.047+0000 7f028d19c700 1 --2- 172.21.15.159:0/996820753 >> v2:172.21.15.115:3300/0 conn(0x7f0288063530 0x7f0288063960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:00.103 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f028c99b700 1 -- 172.21.15.159:0/996820753 >> v2:172.21.15.115:3300/0 conn(0x7f0288063530 msgr2=0x7f0288063960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:00.103 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f028c99b700 1 --2- 172.21.15.159:0/996820753 >> v2:172.21.15.115:3300/0 conn(0x7f0288063530 0x7f0288063960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.103 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f028c99b700 1 -- 172.21.15.159:0/996820753 >> v1:172.21.15.159:6789/0 conn(0x7f02880bc070 legacy=0x7f02880bcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:00.103 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f028c99b700 1 -- 172.21.15.159:0/996820753 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288062a50 con 0x7f0288153f70 2023-07-27T14:38:00.104 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f02877fe700 1 -- 172.21.15.159:0/996820753 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449162524 0 0) 0x7f02880630a0 con 0x7f02880bc070 2023-07-27T14:38:00.104 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f028c99b700 1 --2- 172.21.15.159:0/996820753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 0x7f0288154350 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f0288067870 tx=0x7f027c0090f0).ready entity=mon.1 client_cookie=7c7fcd9263252bcc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:00.104 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f02877fe700 1 -- 172.21.15.159:0/996820753 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00b520 con 0x7f0288153f70 2023-07-27T14:38:00.104 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f02877fe700 1 -- 172.21.15.159:0/996820753 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c00b680 con 0x7f0288153f70 2023-07-27T14:38:00.105 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.048+0000 7f02877fe700 1 -- 172.21.15.159:0/996820753 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00ba00 con 0x7f0288153f70 2023-07-27T14:38:00.105 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.049+0000 7f028ebff700 1 -- 172.21.15.159:0/996820753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 msgr2=0x7f0288154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:00.105 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.049+0000 7f028ebff700 1 --2- 172.21.15.159:0/996820753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 0x7f0288154350 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f0288067870 tx=0x7f027c0090f0).stop 2023-07-27T14:38:00.105 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.049+0000 7f028ebff700 1 -- 172.21.15.159:0/996820753 shutdown_connections 2023-07-27T14:38:00.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.049+0000 7f028ebff700 1 --2- 172.21.15.159:0/996820753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 0x7f0288154350 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.049+0000 7f028ebff700 1 --2- 172.21.15.159:0/996820753 >> v2:172.21.15.115:3300/0 conn(0x7f0288063530 0x7f0288063960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.049+0000 7f028ebff700 1 -- 172.21.15.159:0/996820753 >> 172.21.15.159:0/996820753 conn(0x7f02880c3bb0 msgr2=0x7f02880c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:00.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.049+0000 7f028ebff700 1 -- 172.21.15.159:0/996820753 shutdown_connections 2023-07-27T14:38:00.106 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.049+0000 7f028ebff700 1 -- 172.21.15.159:0/996820753 wait complete. 2023-07-27T14:38:00.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.050+0000 7f028ebff700 1 Processor -- start 2023-07-27T14:38:00.108 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.051+0000 7f028ebff700 1 -- start start 2023-07-27T14:38:00.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.051+0000 7f028ebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0288063530 0x7f02880a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:00.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.051+0000 7f028ebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880bc070 0x7f0288144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:00.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.051+0000 7f028ebff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 0x7f02880aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:00.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.051+0000 7f028ebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880a8390 con 0x7f02880bc070 2023-07-27T14:38:00.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.051+0000 7f028ebff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880a91d0 con 0x7f0288153f70 2023-07-27T14:38:00.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.051+0000 7f028ebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880a85c0 con 0x7f0288063530 2023-07-27T14:38:00.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028c99b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0288063530 0x7f02880a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:00.109 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028d19c700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 0x7f02880aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:00.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028c99b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0288063530 0x7f02880a9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:39506/0 (socket says 172.21.15.159:39506) 2023-07-27T14:38:00.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028c99b700 1 -- 172.21.15.159:0/3715254077 learned_addr learned my addr 172.21.15.159:0/3715254077 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:38:00.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f0287fff700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880bc070 0x7f0288144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:00.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028d19c700 1 -- 172.21.15.159:0/3715254077 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0288063530 msgr2=0x7f02880a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:00.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028d19c700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0288063530 0x7f02880a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028d19c700 1 -- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880bc070 msgr2=0x7f0288144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:00.110 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028d19c700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880bc070 0x7f0288144e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028d19c700 1 -- 172.21.15.159:0/3715254077 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c009370 con 0x7f0288153f70 2023-07-27T14:38:00.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.052+0000 7f028d19c700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 0x7f02880aba40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f0280009e50 tx=0x7f028000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:00.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.053+0000 7f0284ff9700 1 -- 172.21.15.159:0/3715254077 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000caa0 con 0x7f0288153f70 2023-07-27T14:38:00.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.053+0000 7f0284ff9700 1 -- 172.21.15.159:0/3715254077 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028000f040 con 0x7f0288153f70 2023-07-27T14:38:00.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.053+0000 7f0284ff9700 1 -- 172.21.15.159:0/3715254077 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000ce10 con 0x7f0288153f70 2023-07-27T14:38:00.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.053+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02880a88a0 con 0x7f0288153f70 2023-07-27T14:38:00.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.053+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02880a8e60 con 0x7f0288153f70 2023-07-27T14:38:00.111 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.054+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028806bb50 con 0x7f0288153f70 2023-07-27T14:38:00.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.054+0000 7f0284ff9700 1 -- 172.21.15.159:0/3715254077 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f0280013610 con 0x7f0288153f70 2023-07-27T14:38:00.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.056+0000 7f0284ff9700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f026c05f9f0 0x7f026c061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:00.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.056+0000 7f0284ff9700 1 -- 172.21.15.159:0/3715254077 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f028007b760 con 0x7f0288153f70 2023-07-27T14:38:00.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.057+0000 7f028c99b700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f026c05f9f0 0x7f026c061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:00.112 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.057+0000 7f028c99b700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f026c05f9f0 0x7f026c061eb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f027c00b2e0 tx=0x7f027c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:00.113 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.061+0000 7f0284ff9700 1 -- 172.21.15.159:0/3715254077 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f028004c0a0 con 0x7f0288153f70 2023-07-27T14:38:00.320 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.269+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0288062d30 con 0x7f0288153f70 2023-07-27T14:38:00.320 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.269+0000 7f0284ff9700 1 -- 172.21.15.159:0/3715254077 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7f028004f6c0 con 0x7f0288153f70 2023-07-27T14:38:00.321 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:38:00.322 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.271+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f026c05f9f0 msgr2=0x7f026c061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:00.323 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.271+0000 7f028ebff700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f026c05f9f0 0x7f026c061eb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f027c00b2e0 tx=0x7f027c017000).stop 2023-07-27T14:38:00.323 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.271+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 msgr2=0x7f02880aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:00.323 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.271+0000 7f028ebff700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 0x7f02880aba40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f0280009e50 tx=0x7f028000b040).stop 2023-07-27T14:38:00.323 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.272+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 shutdown_connections 2023-07-27T14:38:00.324 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.272+0000 7f028ebff700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f026c05f9f0 0x7f026c061eb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.324 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.272+0000 7f028ebff700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0288153f70 0x7f02880aba40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.324 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.272+0000 7f028ebff700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0288063530 0x7f02880a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.324 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.272+0000 7f028ebff700 1 --2- 172.21.15.159:0/3715254077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02880bc070 0x7f0288144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:00.324 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.272+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 >> 172.21.15.159:0/3715254077 conn(0x7f02880c3bb0 msgr2=0x7f02880c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:00.324 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.272+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 shutdown_connections 2023-07-27T14:38:00.324 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:38:00.272+0000 7f028ebff700 1 -- 172.21.15.159:0/3715254077 wait complete. 2023-07-27T14:38:00.337 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:38:00.337 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:38:00.337 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:38:00.338 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:38:00.338 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:38:00.338 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:38:00.338 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:38:00.339 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:38:00.339 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:38:00.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:00.340 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:38:00.386 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:38:00.386 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:38:00.386 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:38:00.387 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:38:00.387 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:38:00.387 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:38:00.387 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:38:00.387 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:38:00.387 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:38:00.387 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:38:00.388 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:38:00.388 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:38:00.388 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:38:00.388 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:38:00.388 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:38:00.388 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:38:00.388 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:38:00.389 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41316sec preferred_lft 41316sec 2023-07-27T14:38:00.389 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:38:00.389 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:38:00.389 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:38:00.389 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:38:00.389 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:38:00.389 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:38:00.389 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:38:00.390 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:38:00.390 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:38:00.390 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:38:00.390 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:38:00.390 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:38:00.390 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:38:00.390 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:38:00.390 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:38:00.391 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:38:00.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:00.392 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:38:00.501 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:38:00.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:00.504 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:38:00.552 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:38:00.553 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:38:00.553 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:38:00.553 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:38:00.553 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:38:00.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:00.555 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:38:00.555 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:38:00.555 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:38:00.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:38:00.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:38:00.556 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:38:00.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:00.726 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:38:00.772 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:38:00.773 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:38:00.773 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:38:00.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:00.774 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:38:00.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:00.845 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:38:00.891 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:38:00.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:38:01.030 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:38:01.030 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:38:01.055 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:38:01.056 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:38:01.060 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:38:01.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:01.061 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:38:01.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:38:01.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.281+0000 7f7aff1ff700 1 Processor -- start 2023-07-27T14:38:01.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.281+0000 7f7aff1ff700 1 -- start start 2023-07-27T14:38:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7aff1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7aff1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7af80c36b0 0x7f7af81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7aff1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af80bd9a0 con 0x7f7af813a730 2023-07-27T14:38:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7aff1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af8066400 con 0x7f7af80c36b0 2023-07-27T14:38:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7aff1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8158ae0 con 0x7f7af813a350 2023-07-27T14:38:01.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7af7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7af813a730 0x7f7af80c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42160/0 (socket says 172.21.15.115:42160) 2023-07-27T14:38:01.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7af7fff700 1 -- 172.21.15.115:0/101727556 learned_addr learned my addr 172.21.15.115:0/101727556 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:01.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7afd79c700 1 --2- 172.21.15.115:0/101727556 >> v2:172.21.15.159:3300/0 conn(0x7f7af80c36b0 0x7f7af81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:01.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7afcf9b700 1 --2- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:01.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7af77fe700 1 -- 172.21.15.115:0/101727556 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357001040 0 0) 0x7f7af80bd9a0 con 0x7f7af813a730 2023-07-27T14:38:01.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.283+0000 7f7af77fe700 1 -- 172.21.15.115:0/101727556 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ae80033f0 con 0x7f7af813a730 2023-07-27T14:38:01.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7afd79c700 1 -- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 msgr2=0x7f7af8065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:01.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7afd79c700 1 --2- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af8065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7afd79c700 1 -- 172.21.15.115:0/101727556 >> v1:172.21.15.115:6789/0 conn(0x7f7af813a730 legacy=0x7f7af80c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:01.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7afd79c700 1 -- 172.21.15.115:0/101727556 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8066610 con 0x7f7af80c36b0 2023-07-27T14:38:01.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7afcf9b700 1 --2- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af8065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:01.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7afd79c700 1 --2- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 0x7f7af81585f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7af0009e60 tx=0x7f7af0009780).ready entity=mon.1 client_cookie=fda2aecb107c7fa1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:01.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7af77fe700 1 -- 172.21.15.115:0/101727556 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af000e070 con 0x7f7af80c36b0 2023-07-27T14:38:01.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7af77fe700 1 -- 172.21.15.115:0/101727556 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af000bab0 con 0x7f7af80c36b0 2023-07-27T14:38:01.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7af77fe700 1 -- 172.21.15.115:0/101727556 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af000be30 con 0x7f7af80c36b0 2023-07-27T14:38:01.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7aff1ff700 1 -- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 msgr2=0x7f7af81585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:01.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.284+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 0x7f7af81585f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7af0009e60 tx=0x7f7af0009780).stop 2023-07-27T14:38:01.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.285+0000 7f7aff1ff700 1 -- 172.21.15.115:0/101727556 shutdown_connections 2023-07-27T14:38:01.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.285+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 0x7f7af81585f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.285+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/101727556 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af8065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.285+0000 7f7aff1ff700 1 -- 172.21.15.115:0/101727556 >> 172.21.15.115:0/101727556 conn(0x7f7af805e8f0 msgr2=0x7f7af80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:01.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.285+0000 7f7aff1ff700 1 -- 172.21.15.115:0/101727556 shutdown_connections 2023-07-27T14:38:01.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.285+0000 7f7aff1ff700 1 -- 172.21.15.115:0/101727556 wait complete. 2023-07-27T14:38:01.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.286+0000 7f7aff1ff700 1 Processor -- start 2023-07-27T14:38:01.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.287+0000 7f7aff1ff700 1 -- start start 2023-07-27T14:38:01.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.287+0000 7f7aff1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 0x7f7af81527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:01.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.287+0000 7f7aff1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af80c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:01.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7aff1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af813a730 0x7f7af80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:01.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7aff1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80c0540 con 0x7f7af813a730 2023-07-27T14:38:01.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7aff1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8152cd0 con 0x7f7af80c36b0 2023-07-27T14:38:01.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7aff1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80c7400 con 0x7f7af813a350 2023-07-27T14:38:01.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af813a730 0x7f7af80c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:01.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af813a730 0x7f7af80c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43596/0 (socket says 172.21.15.115:43596) 2023-07-27T14:38:01.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 -- 172.21.15.115:0/2467499035 learned_addr learned my addr 172.21.15.115:0/2467499035 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:01.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afcf9b700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 0x7f7af81527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:01.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7af7fff700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af80c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:01.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 -- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 msgr2=0x7f7af80c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:01.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af80c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 -- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 msgr2=0x7f7af81527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:01.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 0x7f7af81527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 -- 172.21.15.115:0/2467499035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec0092a0 con 0x7f7af813a730 2023-07-27T14:38:01.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afcf9b700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 0x7f7af81527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:01.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7af7fff700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af80c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:01.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.288+0000 7f7afd79c700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af813a730 0x7f7af80c6f10 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f7af0009480 tx=0x7f7af0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:01.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.289+0000 7f7af4ff9700 1 -- 172.21.15.115:0/2467499035 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af001d630 con 0x7f7af813a730 2023-07-27T14:38:01.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.289+0000 7f7af4ff9700 1 -- 172.21.15.115:0/2467499035 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af001d790 con 0x7f7af813a730 2023-07-27T14:38:01.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.289+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af0009a20 con 0x7f7af813a730 2023-07-27T14:38:01.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.289+0000 7f7af4ff9700 1 -- 172.21.15.115:0/2467499035 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af001db50 con 0x7f7af813a730 2023-07-27T14:38:01.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.289+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af80c1a90 con 0x7f7af813a730 2023-07-27T14:38:01.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.290+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af8066120 con 0x7f7af813a730 2023-07-27T14:38:01.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.291+0000 7f7af4ff9700 1 -- 172.21.15.115:0/2467499035 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f7af0026410 con 0x7f7af813a730 2023-07-27T14:38:01.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.291+0000 7f7af4ff9700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7adc05f9f0 0x7f7adc061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:01.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.292+0000 7f7af4ff9700 1 -- 172.21.15.115:0/2467499035 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7af007d240 con 0x7f7af813a730 2023-07-27T14:38:01.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.292+0000 7f7afcf9b700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7adc05f9f0 0x7f7adc061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:01.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.292+0000 7f7afcf9b700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7adc05f9f0 0x7f7adc061eb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f7aec009270 tx=0x7f7aec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:01.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.295+0000 7f7af4ff9700 1 -- 172.21.15.115:0/2467499035 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7af004da10 con 0x7f7af813a730 2023-07-27T14:38:01.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:38:01.571 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:38:01.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.522+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7af806c470 con 0x7f7af813a730 2023-07-27T14:38:01.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.700+0000 7f7af4ff9700 1 -- 172.21.15.115:0/2467499035 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 136+0+0 (secure 0 0 0) 0x7f7af0051030 con 0x7f7af813a730 2023-07-27T14:38:01.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7adc05f9f0 msgr2=0x7f7adc061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:01.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7adc05f9f0 0x7f7adc061eb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f7aec009270 tx=0x7f7aec008040).stop 2023-07-27T14:38:01.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af813a730 msgr2=0x7f7af80c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:01.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af813a730 0x7f7af80c6f10 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f7af0009480 tx=0x7f7af0009780).stop 2023-07-27T14:38:01.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 shutdown_connections 2023-07-27T14:38:01.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7adc05f9f0 0x7f7adc061eb0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af813a730 0x7f7af80c6f10 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7af80c36b0 0x7f7af81527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 --2- 172.21.15.115:0/2467499035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7af813a350 0x7f7af80c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:01.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 >> 172.21.15.115:0/2467499035 conn(0x7f7af805e8f0 msgr2=0x7f7af8153730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:01.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 shutdown_connections 2023-07-27T14:38:01.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.702+0000 7f7aff1ff700 1 -- 172.21.15.115:0/2467499035 wait complete. 2023-07-27T14:38:01.772 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:38:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.949+0000 7f09917ff700 1 Processor -- start 2023-07-27T14:38:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.950+0000 7f09917ff700 1 -- start start 2023-07-27T14:38:02.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f09917ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f098c151bd0 0x7f098c062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f09917ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f09917ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f098c0a4d30 0x7f098c157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f09917ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c137610 con 0x7f098c0a4d30 2023-07-27T14:38:02.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f09917ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c0639d0 con 0x7f098c151bd0 2023-07-27T14:38:02.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f09917ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0a51c0 con 0x7f098c062810 2023-07-27T14:38:02.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f098b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f098c0a4d30 0x7f098c157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f098b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f098c0a4d30 0x7f098c157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43602/0 (socket says 172.21.15.115:43602) 2023-07-27T14:38:02.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f098b7fe700 1 -- 172.21.15.115:0/728412571 learned_addr learned my addr 172.21.15.115:0/728412571 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:02.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f098affd700 1 --2- 172.21.15.115:0/728412571 >> v2:172.21.15.159:3300/0 conn(0x7f098c151bd0 0x7f098c062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.951+0000 7f098a7fc700 1 --2- 172.21.15.115:0/728412571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f098b7fe700 1 -- 172.21.15.115:0/728412571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 msgr2=0x7f098c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:02.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f098b7fe700 1 --2- 172.21.15.115:0/728412571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f098b7fe700 1 -- 172.21.15.115:0/728412571 >> v2:172.21.15.159:3300/0 conn(0x7f098c151bd0 msgr2=0x7f098c062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:02.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f098b7fe700 1 --2- 172.21.15.115:0/728412571 >> v2:172.21.15.159:3300/0 conn(0x7f098c151bd0 0x7f098c062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f098b7fe700 1 -- 172.21.15.115:0/728412571 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c062dc0 con 0x7f098c0a4d30 2023-07-27T14:38:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f098b7fe700 1 --2- 172.21.15.115:0/728412571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c157ae0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f098c066fb0 tx=0x7f0984009840).ready entity=mon.0 client_cookie=9ef71a6ee5f6dfb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f0989ffb700 1 -- 172.21.15.115:0/728412571 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400e070 con 0x7f098c0a4d30 2023-07-27T14:38:02.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f0989ffb700 1 -- 172.21.15.115:0/728412571 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098400ba50 con 0x7f098c0a4d30 2023-07-27T14:38:02.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f0989ffb700 1 -- 172.21.15.115:0/728412571 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400bdd0 con 0x7f098c0a4d30 2023-07-27T14:38:02.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f09917ff700 1 -- 172.21.15.115:0/728412571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 msgr2=0x7f098c157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.952+0000 7f09917ff700 1 --2- 172.21.15.115:0/728412571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c157ae0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f098c066fb0 tx=0x7f0984009840).stop 2023-07-27T14:38:02.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.953+0000 7f09917ff700 1 -- 172.21.15.115:0/728412571 shutdown_connections 2023-07-27T14:38:02.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.953+0000 7f09917ff700 1 --2- 172.21.15.115:0/728412571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c157ae0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.953+0000 7f09917ff700 1 --2- 172.21.15.115:0/728412571 >> v2:172.21.15.159:3300/0 conn(0x7f098c151bd0 0x7f098c062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.953+0000 7f09917ff700 1 --2- 172.21.15.115:0/728412571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.953+0000 7f09917ff700 1 -- 172.21.15.115:0/728412571 >> 172.21.15.115:0/728412571 conn(0x7f098c064700 msgr2=0x7f098c064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:02.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.953+0000 7f09917ff700 1 -- 172.21.15.115:0/728412571 shutdown_connections 2023-07-27T14:38:02.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.953+0000 7f09917ff700 1 -- 172.21.15.115:0/728412571 wait complete. 2023-07-27T14:38:02.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.954+0000 7f09917ff700 1 Processor -- start 2023-07-27T14:38:02.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.954+0000 7f09917ff700 1 -- start start 2023-07-27T14:38:02.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.955+0000 7f09917ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.955+0000 7f09917ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c0bd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.955+0000 7f09917ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f098c151bd0 0x7f098c135750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.955+0000 7f09917ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c153090 con 0x7f098c0a4d30 2023-07-27T14:38:02.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.955+0000 7f09917ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c153650 con 0x7f098c151bd0 2023-07-27T14:38:02.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.955+0000 7f09917ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0bf5a0 con 0x7f098c062810 2023-07-27T14:38:02.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.955+0000 7f098a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c0bd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c0bd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43606/0 (socket says 172.21.15.115:43606) 2023-07-27T14:38:02.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098a7fc700 1 -- 172.21.15.115:0/3914632932 learned_addr learned my addr 172.21.15.115:0/3914632932 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:02.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098affd700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098b7fe700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f098c151bd0 0x7f098c135750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098a7fc700 1 -- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 msgr2=0x7f098c0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098a7fc700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098a7fc700 1 -- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f098c151bd0 msgr2=0x7f098c135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098a7fc700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f098c151bd0 0x7f098c135750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098a7fc700 1 -- 172.21.15.115:0/3914632932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984009ae0 con 0x7f098c0a4d30 2023-07-27T14:38:02.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098affd700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:02.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f098a7fc700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c0bd4c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f098000d8c0 tx=0x7f0980008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f0972ffd700 1 -- 172.21.15.115:0/3914632932 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09800095b0 con 0x7f098c0a4d30 2023-07-27T14:38:02.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f0972ffd700 1 -- 172.21.15.115:0/3914632932 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0980009710 con 0x7f098c0a4d30 2023-07-27T14:38:02.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c0bf820 con 0x7f098c0a4d30 2023-07-27T14:38:02.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.956+0000 7f0972ffd700 1 -- 172.21.15.115:0/3914632932 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980009a90 con 0x7f098c0a4d30 2023-07-27T14:38:02.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.957+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c1532e0 con 0x7f098c0a4d30 2023-07-27T14:38:02.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.957+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c153800 con 0x7f098c0a4d30 2023-07-27T14:38:02.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.958+0000 7f0972ffd700 1 -- 172.21.15.115:0/3914632932 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f0980013480 con 0x7f098c0a4d30 2023-07-27T14:38:02.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.959+0000 7f0972ffd700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097805f9f0 0x7f0978061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.959+0000 7f0972ffd700 1 -- 172.21.15.115:0/3914632932 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f098007ad80 con 0x7f098c0a4d30 2023-07-27T14:38:02.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.959+0000 7f098affd700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097805f9f0 0x7f0978061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.960+0000 7f098affd700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097805f9f0 0x7f0978061eb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f097c006fd0 tx=0x7f097c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:01.963+0000 7f0972ffd700 1 -- 172.21.15.115:0/3914632932 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f098c153800 con 0x7f098c0a4d30 2023-07-27T14:38:02.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.158+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f098c153800 con 0x7f097805f9f0 2023-07-27T14:38:02.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.159+0000 7f0972ffd700 1 -- 172.21.15.115:0/3914632932 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f098c153800 con 0x7f097805f9f0 2023-07-27T14:38:02.211 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:38:02.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:02.212 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:38:02.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:02.212 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:38:02.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097805f9f0 msgr2=0x7f0978061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097805f9f0 0x7f0978061eb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f097c006fd0 tx=0x7f097c008040).stop 2023-07-27T14:38:02.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 msgr2=0x7f098c0bd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c0bd4c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f098000d8c0 tx=0x7f0980008040).stop 2023-07-27T14:38:02.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 shutdown_connections 2023-07-27T14:38:02.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097805f9f0 0x7f0978061eb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f098c151bd0 0x7f098c135750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098c062810 0x7f098c0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.161+0000 7f09917ff700 1 --2- 172.21.15.115:0/3914632932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f098c0a4d30 0x7f098c0bd4c0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.162+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 >> 172.21.15.115:0/3914632932 conn(0x7f098c064700 msgr2=0x7f098c0bc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:02.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.162+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 shutdown_connections 2023-07-27T14:38:02.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.162+0000 7f09917ff700 1 -- 172.21.15.115:0/3914632932 wait complete. 2023-07-27T14:38:02.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:38:02.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.371+0000 7f9e43bff700 1 Processor -- start 2023-07-27T14:38:02.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.371+0000 7f9e43bff700 1 -- start start 2023-07-27T14:38:02.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.372+0000 7f9e43bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c063260 0x7f9e3c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.372+0000 7f9e43bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9e3c14b1e0 0x7f9e3c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.372+0000 7f9e43bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c1553f0 con 0x7f9e3c14ae00 2023-07-27T14:38:02.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.372+0000 7f9e43bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c157a50 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.372+0000 7f9e43bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c157d10 con 0x7f9e3c063260 2023-07-27T14:38:02.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4119a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c063260 0x7f9e3c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4119a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c063260 0x7f9e3c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:33382/0 (socket says 172.21.15.115:33382) 2023-07-27T14:38:02.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4119a700 1 -- 172.21.15.115:0/1858362657 learned_addr learned my addr 172.21.15.115:0/1858362657 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:02.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4219c700 1 --2- 172.21.15.115:0/1858362657 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c14b1e0 0x7f9e3c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4119a700 1 -- 172.21.15.115:0/1858362657 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c14b1e0 msgr2=0x7f9e3c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:02.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4119a700 1 --2- 172.21.15.115:0/1858362657 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c14b1e0 0x7f9e3c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4119a700 1 -- 172.21.15.115:0/1858362657 >> v1:172.21.15.159:6789/0 conn(0x7f9e3c14ae00 legacy=0x7f9e3c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4119a700 1 -- 172.21.15.115:0/1858362657 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c157ff0 con 0x7f9e3c063260 2023-07-27T14:38:02.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.373+0000 7f9e4119a700 1 --2- 172.21.15.115:0/1858362657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c063260 0x7f9e3c154f00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9e2c006fd0 tx=0x7f9e2c0090f0).ready entity=mon.2 client_cookie=8f1bfe8eb15cdf07 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e40999700 1 -- 172.21.15.115:0/1858362657 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00b580 con 0x7f9e3c063260 2023-07-27T14:38:02.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e40999700 1 -- 172.21.15.115:0/1858362657 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c00b6e0 con 0x7f9e3c063260 2023-07-27T14:38:02.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e40999700 1 -- 172.21.15.115:0/1858362657 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00ba60 con 0x7f9e3c063260 2023-07-27T14:38:02.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e43bff700 1 -- 172.21.15.115:0/1858362657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c063260 msgr2=0x7f9e3c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e43bff700 1 --2- 172.21.15.115:0/1858362657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c063260 0x7f9e3c154f00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9e2c006fd0 tx=0x7f9e2c0090f0).stop 2023-07-27T14:38:02.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e43bff700 1 -- 172.21.15.115:0/1858362657 shutdown_connections 2023-07-27T14:38:02.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e43bff700 1 --2- 172.21.15.115:0/1858362657 >> v2:172.21.15.159:3300/0 conn(0x7f9e3c14b1e0 0x7f9e3c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e43bff700 1 --2- 172.21.15.115:0/1858362657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c063260 0x7f9e3c154f00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e43bff700 1 -- 172.21.15.115:0/1858362657 >> 172.21.15.115:0/1858362657 conn(0x7f9e3c05e940 msgr2=0x7f9e3c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:02.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e43bff700 1 -- 172.21.15.115:0/1858362657 shutdown_connections 2023-07-27T14:38:02.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.374+0000 7f9e43bff700 1 -- 172.21.15.115:0/1858362657 wait complete. 2023-07-27T14:38:02.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.376+0000 7f9e43bff700 1 Processor -- start 2023-07-27T14:38:02.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.376+0000 7f9e43bff700 1 -- start start 2023-07-27T14:38:02.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e43bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c063260 0x7f9e3c0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e43bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c14ae00 0x7f9e3c0a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e43bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c14b1e0 0x7f9e3c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e43bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0c4a80 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e43bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0ae470 con 0x7f9e3c063260 2023-07-27T14:38:02.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e43bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0ae6e0 con 0x7f9e3c14ae00 2023-07-27T14:38:02.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4219c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c14b1e0 0x7f9e3c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4219c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c14b1e0 0x7f9e3c150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43618/0 (socket says 172.21.15.115:43618) 2023-07-27T14:38:02.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4219c700 1 -- 172.21.15.115:0/3621714813 learned_addr learned my addr 172.21.15.115:0/3621714813 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:02.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4119a700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c14ae00 0x7f9e3c0a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4199b700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c063260 0x7f9e3c0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4219c700 1 -- 172.21.15.115:0/3621714813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c14ae00 msgr2=0x7f9e3c0a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4219c700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c14ae00 0x7f9e3c0a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4219c700 1 -- 172.21.15.115:0/3621714813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c063260 msgr2=0x7f9e3c0c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4219c700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c063260 0x7f9e3c0c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.377+0000 7f9e4219c700 1 -- 172.21.15.115:0/3621714813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c009370 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.378+0000 7f9e4219c700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c14b1e0 0x7f9e3c150c50 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f9e34009df0 tx=0x7f9e3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.378+0000 7f9e31ffb700 1 -- 172.21.15.115:0/3621714813 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400cb50 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.378+0000 7f9e31ffb700 1 -- 172.21.15.115:0/3621714813 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3400f040 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.378+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c0ae9c0 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.378+0000 7f9e31ffb700 1 -- 172.21.15.115:0/3621714813 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400cec0 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.378+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c148200 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.379+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c06c470 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.380+0000 7f9e31ffb700 1 -- 172.21.15.115:0/3621714813 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f9e34013610 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.380+0000 7f9e31ffb700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2005f9f0 0x7f9e20061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.380+0000 7f9e31ffb700 1 -- 172.21.15.115:0/3621714813 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9e3407b890 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.381+0000 7f9e4199b700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2005f9f0 0x7f9e20061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.381+0000 7f9e4199b700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2005f9f0 0x7f9e20061eb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f9e380036d0 tx=0x7f9e38009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.385+0000 7f9e31ffb700 1 -- 172.21.15.115:0/3621714813 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e3404c0c0 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.556+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9e3c0c5120 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.556+0000 7f9e31ffb700 1 -- 172.21.15.115:0/3621714813 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9e3404f6e0 con 0x7f9e3c14b1e0 2023-07-27T14:38:02.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.558+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2005f9f0 msgr2=0x7f9e20061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.558+0000 7f9e43bff700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2005f9f0 0x7f9e20061eb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f9e380036d0 tx=0x7f9e38009040).stop 2023-07-27T14:38:02.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.558+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c14b1e0 msgr2=0x7f9e3c150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.558+0000 7f9e43bff700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c14b1e0 0x7f9e3c150c50 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f9e34009df0 tx=0x7f9e3400b040).stop 2023-07-27T14:38:02.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.559+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 shutdown_connections 2023-07-27T14:38:02.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.559+0000 7f9e43bff700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e2005f9f0 0x7f9e20061eb0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.559+0000 7f9e43bff700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e3c14b1e0 0x7f9e3c150c50 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.559+0000 7f9e43bff700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e3c063260 0x7f9e3c0c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.559+0000 7f9e43bff700 1 --2- 172.21.15.115:0/3621714813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e3c14ae00 0x7f9e3c0a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.559+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 >> 172.21.15.115:0/3621714813 conn(0x7f9e3c05e940 msgr2=0x7f9e3c0c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:02.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.559+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 shutdown_connections 2023-07-27T14:38:02.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.559+0000 7f9e43bff700 1 -- 172.21.15.115:0/3621714813 wait complete. 2023-07-27T14:38:02.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000595276 --mode=777 --size 12582912 2023-07-27T14:38:02.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.771+0000 7f086f9ff700 1 Processor -- start 2023-07-27T14:38:02.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.771+0000 7f086f9ff700 1 -- start start 2023-07-27T14:38:02.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086f9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f086814f740 0x7f086814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086f9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f08680a5850 0x7f08680a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086f9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08681530d0 con 0x7f08680c31e0 2023-07-27T14:38:02.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086f9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0868069f70 con 0x7f086814f740 2023-07-27T14:38:02.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086f9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680a61c0 con 0x7f08680a5850 2023-07-27T14:38:02.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086d79b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f086814f740 0x7f086814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086d79b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f086814f740 0x7f086814fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43624/0 (socket says 172.21.15.115:43624) 2023-07-27T14:38:02.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086d79b700 1 -- 172.21.15.115:0/1972416730 learned_addr learned my addr 172.21.15.115:0/1972416730 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:02.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.772+0000 7f086df9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f08680c31e0 0x7f08680c3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42174/0 (socket says 172.21.15.115:42174) 2023-07-27T14:38:02.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f086cf9a700 1 --2- 172.21.15.115:0/1972416730 >> v2:172.21.15.159:3300/0 conn(0x7f08680a5850 0x7f08680a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f086d79b700 1 -- 172.21.15.115:0/1972416730 >> v2:172.21.15.159:3300/0 conn(0x7f08680a5850 msgr2=0x7f08680a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:02.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f086d79b700 1 --2- 172.21.15.115:0/1972416730 >> v2:172.21.15.159:3300/0 conn(0x7f08680a5850 0x7f08680a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f086d79b700 1 -- 172.21.15.115:0/1972416730 >> v1:172.21.15.115:6789/0 conn(0x7f08680c31e0 legacy=0x7f08680c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f086d79b700 1 -- 172.21.15.115:0/1972416730 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08681527a0 con 0x7f086814f740 2023-07-27T14:38:02.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f086d79b700 1 --2- 172.21.15.115:0/1972416730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f086814fb20 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f0868069900 tx=0x7f08640090f0).ready entity=mon.0 client_cookie=192e859b95d18cee server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f085ffff700 1 -- 172.21.15.115:0/1972416730 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400b600 con 0x7f086814f740 2023-07-27T14:38:02.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f085ffff700 1 -- 172.21.15.115:0/1972416730 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400b760 con 0x7f086814f740 2023-07-27T14:38:02.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.773+0000 7f085ffff700 1 -- 172.21.15.115:0/1972416730 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400bae0 con 0x7f086814f740 2023-07-27T14:38:02.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.774+0000 7f086f9ff700 1 -- 172.21.15.115:0/1972416730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 msgr2=0x7f086814fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.774+0000 7f086f9ff700 1 --2- 172.21.15.115:0/1972416730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f086814fb20 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f0868069900 tx=0x7f08640090f0).stop 2023-07-27T14:38:02.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.774+0000 7f086f9ff700 1 -- 172.21.15.115:0/1972416730 shutdown_connections 2023-07-27T14:38:02.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.774+0000 7f086f9ff700 1 --2- 172.21.15.115:0/1972416730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f086814fb20 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.774+0000 7f086f9ff700 1 --2- 172.21.15.115:0/1972416730 >> v2:172.21.15.159:3300/0 conn(0x7f08680a5850 0x7f08680a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.774+0000 7f086f9ff700 1 -- 172.21.15.115:0/1972416730 >> 172.21.15.115:0/1972416730 conn(0x7f0868062320 msgr2=0x7f0868062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:02.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.774+0000 7f086f9ff700 1 -- 172.21.15.115:0/1972416730 shutdown_connections 2023-07-27T14:38:02.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.774+0000 7f086f9ff700 1 -- 172.21.15.115:0/1972416730 wait complete. 2023-07-27T14:38:02.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.775+0000 7f086f9ff700 1 Processor -- start 2023-07-27T14:38:02.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.776+0000 7f086f9ff700 1 -- start start 2023-07-27T14:38:02.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.776+0000 7f086f9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08680a5850 0x7f086814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.776+0000 7f086f9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08680c31e0 0x7f08680be430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.776+0000 7f086f9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f08680beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.776+0000 7f086f9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680befa0 con 0x7f086814f740 2023-07-27T14:38:02.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.776+0000 7f086f9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680bf220 con 0x7f08680c31e0 2023-07-27T14:38:02.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.776+0000 7f086f9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08680bf500 con 0x7f08680a5850 2023-07-27T14:38:02.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f08680beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f08680beab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43630/0 (socket says 172.21.15.115:43630) 2023-07-27T14:38:02.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 -- 172.21.15.115:0/2568496421 learned_addr learned my addr 172.21.15.115:0/2568496421 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086d79b700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08680a5850 0x7f086814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086cf9a700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08680c31e0 0x7f08680be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 -- 172.21.15.115:0/2568496421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08680a5850 msgr2=0x7f086814cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08680a5850 0x7f086814cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 -- 172.21.15.115:0/2568496421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08680c31e0 msgr2=0x7f08680be430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08680c31e0 0x7f08680be430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 -- 172.21.15.115:0/2568496421 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864009370 con 0x7f086814f740 2023-07-27T14:38:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.777+0000 7f086df9c700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f08680beab0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f086000c790 tx=0x7f08600015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.778+0000 7f085d7fa700 1 -- 172.21.15.115:0/2568496421 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860005c70 con 0x7f086814f740 2023-07-27T14:38:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.778+0000 7f085d7fa700 1 -- 172.21.15.115:0/2568496421 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860005dd0 con 0x7f086814f740 2023-07-27T14:38:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.778+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08680c44a0 con 0x7f086814f740 2023-07-27T14:38:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.778+0000 7f085d7fa700 1 -- 172.21.15.115:0/2568496421 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860007320 con 0x7f086814f740 2023-07-27T14:38:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.778+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08680c4a60 con 0x7f086814f740 2023-07-27T14:38:02.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.779+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08680c4c80 con 0x7f086814f740 2023-07-27T14:38:02.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.779+0000 7f085d7fa700 1 -- 172.21.15.115:0/2568496421 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7f0860010030 con 0x7f086814f740 2023-07-27T14:38:02.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.780+0000 7f085d7fa700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f084c05f9f0 0x7f084c061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:02.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.780+0000 7f085d7fa700 1 -- 172.21.15.115:0/2568496421 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f086007ae70 con 0x7f086814f740 2023-07-27T14:38:02.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.780+0000 7f086d79b700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f084c05f9f0 0x7f084c061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:02.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.781+0000 7f086d79b700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f084c05f9f0 0x7f084c061eb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f0864009130 tx=0x7f0864017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:02.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.784+0000 7f085d7fa700 1 -- 172.21.15.115:0/2568496421 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f086004b6a0 con 0x7f086814f740 2023-07-27T14:38:03.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:02.982+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000595276", "mode": "777", "size": 12582912, "target": ["mon-mgr", ""]}) v1 -- 0x7f086806c470 con 0x7f084c05f9f0 2023-07-27T14:38:03.039 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:02.988+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:03.040 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:02.988+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:03.040 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:02.988+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:03.040 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:02.988+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:03.040 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:02.988+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:03.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.025+0000 7f085d7fa700 1 -- 172.21.15.115:0/2568496421 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f086806c470 con 0x7f084c05f9f0 2023-07-27T14:38:03.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f084c05f9f0 msgr2=0x7f084c061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:03.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f084c05f9f0 0x7f084c061eb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f0864009130 tx=0x7f0864017000).stop 2023-07-27T14:38:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 msgr2=0x7f08680beab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f08680beab0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7f086000c790 tx=0x7f08600015e0).stop 2023-07-27T14:38:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 shutdown_connections 2023-07-27T14:38:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f084c05f9f0 0x7f084c061eb0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086814f740 0x7f08680beab0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08680a5850 0x7f086814cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 --2- 172.21.15.115:0/2568496421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08680c31e0 0x7f08680be430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 >> 172.21.15.115:0/2568496421 conn(0x7f0868062320 msgr2=0x7f08680bce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:03.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 shutdown_connections 2023-07-27T14:38:03.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.027+0000 7f086f9ff700 1 -- 172.21.15.115:0/2568496421 wait complete. 2023-07-27T14:38:03.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000595276 2023-07-27T14:38:03.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.234+0000 7fdddcbff700 1 Processor -- start 2023-07-27T14:38:03.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.234+0000 7fdddcbff700 1 -- start start 2023-07-27T14:38:03.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.235+0000 7fdddcbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 0x7fddd8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:03.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.235+0000 7fdddcbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fddd8063260 0x7fddd80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:03.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.235+0000 7fdddcbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd81553f0 con 0x7fddd814b1e0 2023-07-27T14:38:03.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.235+0000 7fdddcbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd8157a50 con 0x7fddd8063260 2023-07-27T14:38:03.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.235+0000 7fdddcbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8157d10 con 0x7fddd814ae00 2023-07-27T14:38:03.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd5d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fddd814b1e0 0x7fddd8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42178/0 (socket says 172.21.15.115:42178) 2023-07-27T14:38:03.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd5d9b700 1 -- 172.21.15.115:0/31934081 learned_addr learned my addr 172.21.15.115:0/31934081 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:03.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd6d9d700 1 --2- 172.21.15.115:0/31934081 >> v2:172.21.15.115:3300/0 conn(0x7fddd8063260 0x7fddd80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:03.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd659c700 1 --2- 172.21.15.115:0/31934081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 0x7fddd8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:03.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd559a700 1 -- 172.21.15.115:0/31934081 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503276474 0 0) 0x7fddd81553f0 con 0x7fddd814b1e0 2023-07-27T14:38:03.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd559a700 1 -- 172.21.15.115:0/31934081 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc00033f0 con 0x7fddd814b1e0 2023-07-27T14:38:03.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd6d9d700 1 -- 172.21.15.115:0/31934081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 msgr2=0x7fddd8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:03.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd6d9d700 1 --2- 172.21.15.115:0/31934081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 0x7fddd8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd6d9d700 1 -- 172.21.15.115:0/31934081 >> v1:172.21.15.115:6789/0 conn(0x7fddd814b1e0 legacy=0x7fddd8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:03.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd6d9d700 1 -- 172.21.15.115:0/31934081 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8157ff0 con 0x7fddd8063260 2023-07-27T14:38:03.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd6d9d700 1 --2- 172.21.15.115:0/31934081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8063260 0x7fddd80a98c0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fddd0009e60 tx=0x7fddd0009780).ready entity=mon.0 client_cookie=ce459542bb8190cb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:03.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.236+0000 7fddd559a700 1 -- 172.21.15.115:0/31934081 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000e070 con 0x7fddd8063260 2023-07-27T14:38:03.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fddd559a700 1 -- 172.21.15.115:0/31934081 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000bab0 con 0x7fddd8063260 2023-07-27T14:38:03.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fddd559a700 1 -- 172.21.15.115:0/31934081 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000be30 con 0x7fddd8063260 2023-07-27T14:38:03.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fdddcbff700 1 -- 172.21.15.115:0/31934081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8063260 msgr2=0x7fddd80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:03.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fdddcbff700 1 --2- 172.21.15.115:0/31934081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8063260 0x7fddd80a98c0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fddd0009e60 tx=0x7fddd0009780).stop 2023-07-27T14:38:03.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fdddcbff700 1 -- 172.21.15.115:0/31934081 shutdown_connections 2023-07-27T14:38:03.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fdddcbff700 1 --2- 172.21.15.115:0/31934081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 0x7fddd8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fdddcbff700 1 --2- 172.21.15.115:0/31934081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8063260 0x7fddd80a98c0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fdddcbff700 1 -- 172.21.15.115:0/31934081 >> 172.21.15.115:0/31934081 conn(0x7fddd805e940 msgr2=0x7fddd80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:03.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fdddcbff700 1 -- 172.21.15.115:0/31934081 shutdown_connections 2023-07-27T14:38:03.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.237+0000 7fdddcbff700 1 -- 172.21.15.115:0/31934081 wait complete. 2023-07-27T14:38:03.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.239+0000 7fdddcbff700 1 Processor -- start 2023-07-27T14:38:03.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.239+0000 7fdddcbff700 1 -- start start 2023-07-27T14:38:03.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fdddcbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8063260 0x7fddd80c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:03.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fdddcbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 0x7fddd80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:03.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fdddcbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd814b1e0 0x7fddd813f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:03.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fdddcbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80c4780 con 0x7fddd814b1e0 2023-07-27T14:38:03.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fdddcbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80ae050 con 0x7fddd8063260 2023-07-27T14:38:03.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fdddcbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80c4450 con 0x7fddd814ae00 2023-07-27T14:38:03.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd6d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd814b1e0 0x7fddd813f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:03.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd6d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd814b1e0 0x7fddd813f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43656/0 (socket says 172.21.15.115:43656) 2023-07-27T14:38:03.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd6d9d700 1 -- 172.21.15.115:0/2258716104 learned_addr learned my addr 172.21.15.115:0/2258716104 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:03.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd5d9b700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 0x7fddd80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:03.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd659c700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8063260 0x7fddd80c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:03.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd6d9d700 1 -- 172.21.15.115:0/2258716104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 msgr2=0x7fddd80adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:03.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd6d9d700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 0x7fddd80adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd6d9d700 1 -- 172.21.15.115:0/2258716104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8063260 msgr2=0x7fddd80c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:03.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd6d9d700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8063260 0x7fddd80c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.240+0000 7fddd6d9d700 1 -- 172.21.15.115:0/2258716104 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0009a20 con 0x7fddd814b1e0 2023-07-27T14:38:03.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.241+0000 7fddd6d9d700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd814b1e0 0x7fddd813f490 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fddd0013ca0 tx=0x7fddd0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:03.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.241+0000 7fddc67fc700 1 -- 172.21.15.115:0/2258716104 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd001d630 con 0x7fddd814b1e0 2023-07-27T14:38:03.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.241+0000 7fddc67fc700 1 -- 172.21.15.115:0/2258716104 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd001d790 con 0x7fddd814b1e0 2023-07-27T14:38:03.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.241+0000 7fddc67fc700 1 -- 172.21.15.115:0/2258716104 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd001db50 con 0x7fddd814b1e0 2023-07-27T14:38:03.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.241+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd80caa40 con 0x7fddd814b1e0 2023-07-27T14:38:03.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.241+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd8167e70 con 0x7fddd814b1e0 2023-07-27T14:38:03.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.242+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd80c48c0 con 0x7fddd814b1e0 2023-07-27T14:38:03.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.243+0000 7fddc67fc700 1 -- 172.21.15.115:0/2258716104 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 77002+0+0 (secure 0 0 0) 0x7fddd0026410 con 0x7fddd814b1e0 2023-07-27T14:38:03.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.243+0000 7fddc67fc700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddb805f9c0 0x7fddb8061e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:03.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.244+0000 7fddc67fc700 1 -- 172.21.15.115:0/2258716104 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fddd007d0f0 con 0x7fddd814b1e0 2023-07-27T14:38:03.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.244+0000 7fddd659c700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddb805f9c0 0x7fddb8061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:03.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.244+0000 7fddd659c700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddb805f9c0 0x7fddb8061e80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fddc8009bc0 tx=0x7fddc8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:03.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.248+0000 7fddc67fc700 1 -- 172.21.15.115:0/2258716104 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fddd80c48c0 con 0x7fddd814b1e0 2023-07-27T14:38:03.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.447+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000595276", "target": ["mon-mgr", ""]}) v1 -- 0x7fddd80c48c0 con 0x7fddb805f9c0 2023-07-27T14:38:03.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.452+0000 7fddc67fc700 1 -- 172.21.15.115:0/2258716104 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fddd80c48c0 con 0x7fddb805f9c0 2023-07-27T14:38:03.504 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280 2023-07-27T14:38:03.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddb805f9c0 msgr2=0x7fddb8061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:03.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddb805f9c0 0x7fddb8061e80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fddc8009bc0 tx=0x7fddc8008040).stop 2023-07-27T14:38:03.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd814b1e0 msgr2=0x7fddd813f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:03.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd814b1e0 0x7fddd813f490 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fddd0013ca0 tx=0x7fddd0009780).stop 2023-07-27T14:38:03.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 shutdown_connections 2023-07-27T14:38:03.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fddb805f9c0 0x7fddb8061e80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd814b1e0 0x7fddd813f490 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8063260 0x7fddd80c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 --2- 172.21.15.115:0/2258716104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd814ae00 0x7fddd80adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:03.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 >> 172.21.15.115:0/2258716104 conn(0x7fddd805e940 msgr2=0x7fddd80a9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:03.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 shutdown_connections 2023-07-27T14:38:03.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:03.454+0000 7fdddcbff700 1 -- 172.21.15.115:0/2258716104 wait complete. 2023-07-27T14:38:03.523 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000595276 with 8 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280 2023-07-27T14:38:03.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:03.524 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:38:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:38:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:38:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197024 s, 53.2 MB/s 2023-07-27T14:38:03.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:03.602 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:38:03.663 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:38:03.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:38:03.664 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152111 s, 68.9 MB/s 2023-07-27T14:38:03.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:03.665 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:38:03.729 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:38:03.729 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:38:03.729 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169943 s, 61.7 MB/s 2023-07-27T14:38:03.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:03.731 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:38:03.795 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:38:03.795 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:38:03.795 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144049 s, 72.8 MB/s 2023-07-27T14:38:03.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:03.797 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:38:03.865 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:38:03.866 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:38:03.866 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211074 s, 49.7 MB/s 2023-07-27T14:38:03.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:03.868 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:38:03.929 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:38:03.930 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:38:03.930 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145489 s, 72.1 MB/s 2023-07-27T14:38:03.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:03.931 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:38:03.991 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:38:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:38:03.992 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137779 s, 76.1 MB/s 2023-07-27T14:38:03.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:03.993 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:38:04.056 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:38:04.056 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:38:04.056 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160813 s, 65.2 MB/s 2023-07-27T14:38:04.057 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000595276 2023-07-27T14:38:04.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.197+0000 7f8206dff700 1 Processor -- start 2023-07-27T14:38:04.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.197+0000 7f8206dff700 1 -- start start 2023-07-27T14:38:04.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.198+0000 7f8206dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f82000c58d0 0x7f8200150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.198+0000 7f8206dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82000c0ea0 con 0x7f82000c3100 2023-07-27T14:38:04.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.198+0000 7f8206dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8200068e10 con 0x7f82001509b0 2023-07-27T14:38:04.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.198+0000 7f8206dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8200151280 con 0x7f82000c58d0 2023-07-27T14:38:04.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f820539c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f82000c3100 0x7f82000c3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:45240/0 (socket says 172.21.15.115:45240) 2023-07-27T14:38:04.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f820539c700 1 -- 172.21.15.115:0/3789384031 learned_addr learned my addr 172.21.15.115:0/3789384031 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:04.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886685085 0 0) 0x7f82000c0ea0 con 0x7f82000c3100 2023-07-27T14:38:04.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f00033f0 con 0x7f82000c3100 2023-07-27T14:38:04.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81fffff700 1 --2- 172.21.15.115:0/3789384031 >> v2:172.21.15.159:3300/0 conn(0x7f82000c58d0 0x7f8200150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1133344033 0 0) 0x7f81f00033f0 con 0x7f82000c3100 2023-07-27T14:38:04.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 >> v2:172.21.15.159:3300/0 conn(0x7f82000c58d0 msgr2=0x7f8200150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:04.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 --2- 172.21.15.115:0/3789384031 >> v2:172.21.15.159:3300/0 conn(0x7f82000c58d0 0x7f8200150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 >> v1:172.21.15.159:6789/0 conn(0x7f82001509b0 legacy=0x7f8200154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:04.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200155190 con 0x7f82000c3100 2023-07-27T14:38:04.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f81f80017f0 con 0x7f82000c3100 2023-07-27T14:38:04.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.199+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 >> v1:172.21.15.115:6789/0 conn(0x7f82000c3100 legacy=0x7f82000c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f81ff7fe700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f00038e0 0x7f81f0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f81ff7fe700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f0004690 0x7f81f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f81ff7fe700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f0005050 0x7f81f000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8200151280 con 0x7f81f00038e0 2023-07-27T14:38:04.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f000bfe0 con 0x7f81f0005050 2023-07-27T14:38:04.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f000e3b0 con 0x7f81f0004690 2023-07-27T14:38:04.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f8204b9b700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f00038e0 0x7f81f0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f81fffff700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f0004690 0x7f81f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f820539c700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f0005050 0x7f81f000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f8204b9b700 1 -- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f0004690 msgr2=0x7f81f0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:04.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f8204b9b700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f0004690 0x7f81f0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f8204b9b700 1 -- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f0005050 msgr2=0x7f81f000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:04.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f8204b9b700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f0005050 0x7f81f000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f8204b9b700 1 -- 172.21.15.115:0/3789384031 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f00033f0 con 0x7f81f00038e0 2023-07-27T14:38:04.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f81fffff700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f0004690 0x7f81f0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:04.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f820539c700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f0005050 0x7f81f000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:04.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f820539c700 1 -- 172.21.15.115:0/3789384031 reap_dead start 2023-07-27T14:38:04.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.200+0000 7f8204b9b700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f00038e0 0x7f81f0003d00 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f81f4001730 tx=0x7f81f4007bb0).ready entity=mon.0 client_cookie=e74e8cb48eb8c913 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:04.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4007020 con 0x7f81f00038e0 2023-07-27T14:38:04.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4007180 con 0x7f81f00038e0 2023-07-27T14:38:04.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f81ff7fe700 1 -- 172.21.15.115:0/3789384031 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4007520 con 0x7f81f00038e0 2023-07-27T14:38:04.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f8206dff700 1 -- 172.21.15.115:0/3789384031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f00038e0 msgr2=0x7f81f0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f8206dff700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f00038e0 0x7f81f0003d00 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f81f4001730 tx=0x7f81f4007bb0).stop 2023-07-27T14:38:04.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f8206dff700 1 -- 172.21.15.115:0/3789384031 shutdown_connections 2023-07-27T14:38:04.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f8206dff700 1 --2- 172.21.15.115:0/3789384031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f00038e0 0x7f81f0003d00 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f8206dff700 1 -- 172.21.15.115:0/3789384031 >> 172.21.15.115:0/3789384031 conn(0x7f8200062320 msgr2=0x7f8200062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:04.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f8206dff700 1 -- 172.21.15.115:0/3789384031 shutdown_connections 2023-07-27T14:38:04.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.201+0000 7f8206dff700 1 -- 172.21.15.115:0/3789384031 wait complete. 2023-07-27T14:38:04.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.203+0000 7f8206dff700 1 Processor -- start 2023-07-27T14:38:04.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.204+0000 7f8206dff700 1 -- start start 2023-07-27T14:38:04.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f8206dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f00038e0 0x7f820015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f8206dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8200151d40 0x7f820014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f8206dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82000a7260 0x7f82001539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f8206dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8200152520 con 0x7f82000a7260 2023-07-27T14:38:04.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f8206dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820014e650 con 0x7f8200151d40 2023-07-27T14:38:04.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f8206dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820014c080 con 0x7f81f00038e0 2023-07-27T14:38:04.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f820539c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82000a7260 0x7f82001539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f820539c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82000a7260 0x7f82001539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60490/0 (socket says 172.21.15.115:60490) 2023-07-27T14:38:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f820539c700 1 -- 172.21.15.115:0/1880696929 learned_addr learned my addr 172.21.15.115:0/1880696929 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f8204b9b700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f00038e0 0x7f820015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f81fffff700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8200151d40 0x7f820014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f820539c700 1 -- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f00038e0 msgr2=0x7f820015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f820539c700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f00038e0 0x7f820015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f820539c700 1 -- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8200151d40 msgr2=0x7f820014bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f820539c700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8200151d40 0x7f820014bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.205+0000 7f820539c700 1 -- 172.21.15.115:0/1880696929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200152240 con 0x7f82000a7260 2023-07-27T14:38:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.206+0000 7f81fffff700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8200151d40 0x7f820014bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.206+0000 7f820539c700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82000a7260 0x7f82001539d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f82000661b0 tx=0x7f81f8007cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.206+0000 7f81fcff9700 1 -- 172.21.15.115:0/1880696929 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80017e0 con 0x7f82000a7260 2023-07-27T14:38:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.206+0000 7f81fcff9700 1 -- 172.21.15.115:0/1880696929 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f800e830 con 0x7f82000a7260 2023-07-27T14:38:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.206+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820014e000 con 0x7f82000a7260 2023-07-27T14:38:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.206+0000 7f81fcff9700 1 -- 172.21.15.115:0/1880696929 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f800ebb0 con 0x7f82000a7260 2023-07-27T14:38:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.206+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82000a76c0 con 0x7f82000a7260 2023-07-27T14:38:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.207+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820014de60 con 0x7f82000a7260 2023-07-27T14:38:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.208+0000 7f81fcff9700 1 -- 172.21.15.115:0/1880696929 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 77042+0+0 (secure 0 0 0) 0x7f81f8014430 con 0x7f82000a7260 2023-07-27T14:38:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.209+0000 7f81fcff9700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81e405fa30 0x7f81e4061ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.209+0000 7f81fcff9700 1 -- 172.21.15.115:0/1880696929 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f81f807aef0 con 0x7f82000a7260 2023-07-27T14:38:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.209+0000 7f8204b9b700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81e405fa30 0x7f81e4061ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.209+0000 7f8204b9b700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81e405fa30 0x7f81e4061ef0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f81f4001510 tx=0x7f81f4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.213+0000 7f81fcff9700 1 -- 172.21.15.115:0/1880696929 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f81f80498f0 con 0x7f82000a7260 2023-07-27T14:38:04.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.414+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000595276", "target": ["mon-mgr", ""]}) v1 -- 0x7f820014e7e0 con 0x7f81e405fa30 2023-07-27T14:38:04.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.424+0000 7f81fcff9700 1 -- 172.21.15.115:0/1880696929 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f820014e7e0 con 0x7f81e405fa30 2023-07-27T14:38:04.476 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280 2023-07-27T14:38:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81e405fa30 msgr2=0x7f81e4061ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81e405fa30 0x7f81e4061ef0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f81f4001510 tx=0x7f81f4015000).stop 2023-07-27T14:38:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82000a7260 msgr2=0x7f82001539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82000a7260 0x7f82001539d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f82000661b0 tx=0x7f81f8007cd0).stop 2023-07-27T14:38:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 shutdown_connections 2023-07-27T14:38:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f81e405fa30 0x7f81e4061ef0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82000a7260 0x7f82001539d0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f81f00038e0 0x7f820015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 --2- 172.21.15.115:0/1880696929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8200151d40 0x7f820014bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 >> 172.21.15.115:0/1880696929 conn(0x7f8200062320 msgr2=0x7f820014c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 shutdown_connections 2023-07-27T14:38:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.426+0000 7f8206dff700 1 -- 172.21.15.115:0/1880696929 wait complete. 2023-07-27T14:38:04.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:04.495 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.quota.max_files -v 20 volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:04.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000595276 snapshot_0000000000656954 2023-07-27T14:38:04.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.717+0000 7ff6c39ff700 1 Processor -- start 2023-07-27T14:38:04.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.717+0000 7ff6c39ff700 1 -- start start 2023-07-27T14:38:04.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c39ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc14ae00 0x7ff6bc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c39ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff6bc063260 0x7ff6bc0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c39ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc1553f0 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c39ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc157a50 con 0x7ff6bc063260 2023-07-27T14:38:04.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c39ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc157d10 con 0x7ff6bc14ae00 2023-07-27T14:38:04.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c0f9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff6bc14b1e0 0x7ff6bc062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:45254/0 (socket says 172.21.15.115:45254) 2023-07-27T14:38:04.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c0f9a700 1 -- 172.21.15.115:0/2472277074 learned_addr learned my addr 172.21.15.115:0/2472277074 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:04.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c1f9c700 1 --2- 172.21.15.115:0/2472277074 >> v2:172.21.15.115:3300/0 conn(0x7ff6bc063260 0x7ff6bc0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c179b700 1 --2- 172.21.15.115:0/2472277074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc14ae00 0x7ff6bc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6b3fff700 1 -- 172.21.15.115:0/2472277074 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189178554 0 0) 0x7ff6bc1553f0 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6b3fff700 1 -- 172.21.15.115:0/2472277074 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a80033f0 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.719+0000 7ff6c1f9c700 1 -- 172.21.15.115:0/2472277074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc14ae00 msgr2=0x7ff6bc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:04.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6c1f9c700 1 --2- 172.21.15.115:0/2472277074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc14ae00 0x7ff6bc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6c1f9c700 1 -- 172.21.15.115:0/2472277074 >> v1:172.21.15.115:6789/0 conn(0x7ff6bc14b1e0 legacy=0x7ff6bc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6c1f9c700 1 -- 172.21.15.115:0/2472277074 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc157ff0 con 0x7ff6bc063260 2023-07-27T14:38:04.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6c1f9c700 1 --2- 172.21.15.115:0/2472277074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc063260 0x7ff6bc0a98c0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7ff6b4009e60 tx=0x7ff6b4009780).ready entity=mon.0 client_cookie=f47a986b6772de7c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:04.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6b3fff700 1 -- 172.21.15.115:0/2472277074 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400e070 con 0x7ff6bc063260 2023-07-27T14:38:04.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6b3fff700 1 -- 172.21.15.115:0/2472277074 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b400bab0 con 0x7ff6bc063260 2023-07-27T14:38:04.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6b3fff700 1 -- 172.21.15.115:0/2472277074 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400be30 con 0x7ff6bc063260 2023-07-27T14:38:04.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2472277074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc063260 msgr2=0x7ff6bc0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.720+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2472277074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc063260 0x7ff6bc0a98c0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7ff6b4009e60 tx=0x7ff6b4009780).stop 2023-07-27T14:38:04.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.721+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2472277074 shutdown_connections 2023-07-27T14:38:04.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.721+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2472277074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc14ae00 0x7ff6bc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.721+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2472277074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc063260 0x7ff6bc0a98c0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.721+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2472277074 >> 172.21.15.115:0/2472277074 conn(0x7ff6bc05e940 msgr2=0x7ff6bc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:04.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.721+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2472277074 shutdown_connections 2023-07-27T14:38:04.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.721+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2472277074 wait complete. 2023-07-27T14:38:04.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.722+0000 7ff6c39ff700 1 Processor -- start 2023-07-27T14:38:04.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.722+0000 7ff6c39ff700 1 -- start start 2023-07-27T14:38:04.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c39ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc063260 0x7ff6bc0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c39ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6bc14ae00 0x7ff6bc0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c39ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc14b1e0 0x7ff6bc13f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c39ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0c4780 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c39ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0ae050 con 0x7ff6bc14ae00 2023-07-27T14:38:04.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c39ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0c4450 con 0x7ff6bc063260 2023-07-27T14:38:04.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c1f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc14b1e0 0x7ff6bc13f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c1f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc14b1e0 0x7ff6bc13f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60522/0 (socket says 172.21.15.115:60522) 2023-07-27T14:38:04.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c1f9c700 1 -- 172.21.15.115:0/2368782690 learned_addr learned my addr 172.21.15.115:0/2368782690 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:04.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.723+0000 7ff6c179b700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc063260 0x7ff6bc0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c0f9a700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6bc14ae00 0x7ff6bc0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c1f9c700 1 -- 172.21.15.115:0/2368782690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc063260 msgr2=0x7ff6bc0c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c1f9c700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc063260 0x7ff6bc0c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c1f9c700 1 -- 172.21.15.115:0/2368782690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6bc14ae00 msgr2=0x7ff6bc0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:04.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c1f9c700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6bc14ae00 0x7ff6bc0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:04.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c1f9c700 1 -- 172.21.15.115:0/2368782690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4009a20 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c1f9c700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc14b1e0 0x7ff6bc13f490 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7ff6b4013ca0 tx=0x7ff6b4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:04.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6b17fa700 1 -- 172.21.15.115:0/2368782690 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4013e80 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6b17fa700 1 -- 172.21.15.115:0/2368782690 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b401d630 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6b17fa700 1 -- 172.21.15.115:0/2368782690 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b401d9d0 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc0caa40 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.724+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc167e70 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.725+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc0c48c0 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.726+0000 7ff6b17fa700 1 -- 172.21.15.115:0/2368782690 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 77042+0+0 (secure 0 0 0) 0x7ff6b401dd40 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.727+0000 7ff6b17fa700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff6a005fa00 0x7ff6a0061ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:04.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.727+0000 7ff6b17fa700 1 -- 172.21.15.115:0/2368782690 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff6b407d0d0 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.727+0000 7ff6c179b700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff6a005fa00 0x7ff6a0061ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:04.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.728+0000 7ff6c179b700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff6a005fa00 0x7ff6a0061ec0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7ff6b8009c30 tx=0x7ff6b8009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:04.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.731+0000 7ff6b17fa700 1 -- 172.21.15.115:0/2368782690 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6bc0c48c0 con 0x7ff6bc14b1e0 2023-07-27T14:38:04.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.934+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000595276", "snap_name": "snapshot_0000000000656954", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6bc0c48c0 con 0x7ff6a005fa00 2023-07-27T14:38:04.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.948+0000 7ff6b17fa700 1 -- 172.21.15.115:0/2368782690 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff6bc0c48c0 con 0x7ff6a005fa00 2023-07-27T14:38:05.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff6a005fa00 msgr2=0x7ff6a0061ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff6a005fa00 0x7ff6a0061ec0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7ff6b8009c30 tx=0x7ff6b8009060).stop 2023-07-27T14:38:05.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc14b1e0 msgr2=0x7ff6bc13f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc14b1e0 0x7ff6bc13f490 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7ff6b4013ca0 tx=0x7ff6b4009780).stop 2023-07-27T14:38:05.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 shutdown_connections 2023-07-27T14:38:05.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff6a005fa00 0x7ff6a0061ec0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6bc14b1e0 0x7ff6bc13f490 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6bc063260 0x7ff6bc0c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 --2- 172.21.15.115:0/2368782690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6bc14ae00 0x7ff6bc0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 >> 172.21.15.115:0/2368782690 conn(0x7ff6bc05e940 msgr2=0x7ff6bc0a9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:05.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 shutdown_connections 2023-07-27T14:38:05.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:04.950+0000 7ff6c39ff700 1 -- 172.21.15.115:0/2368782690 wait complete. 2023-07-27T14:38:05.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000595276 snapshot_0000000000656954 clone_0000000000355225 2023-07-27T14:38:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.160+0000 7f47ecbff700 1 Processor -- start 2023-07-27T14:38:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.160+0000 7f47ecbff700 1 -- start start 2023-07-27T14:38:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.161+0000 7f47ecbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f47e80c0610 0x7f47e80c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.161+0000 7f47ecbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80c60a0 con 0x7f47e8153f30 2023-07-27T14:38:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.161+0000 7f47ecbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80c0f90 con 0x7f47e80bfb50 2023-07-27T14:38:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.161+0000 7f47ecbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80c5d70 con 0x7f47e80c0610 2023-07-27T14:38:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f47e8153f30 0x7f47e80a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:45260/0 (socket says 172.21.15.115:45260) 2023-07-27T14:38:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e659c700 1 -- 172.21.15.115:0/333433077 learned_addr learned my addr 172.21.15.115:0/333433077 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e6d9d700 1 --2- 172.21.15.115:0/333433077 >> v2:172.21.15.115:3300/0 conn(0x7f47e80c0610 0x7f47e80c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e559a700 1 -- 172.21.15.115:0/333433077 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428548992 0 0) 0x7f47e80c60a0 con 0x7f47e8153f30 2023-07-27T14:38:05.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e559a700 1 -- 172.21.15.115:0/333433077 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d00033f0 con 0x7f47e8153f30 2023-07-27T14:38:05.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e6d9d700 1 -- 172.21.15.115:0/333433077 >> v1:172.21.15.159:6789/0 conn(0x7f47e80bfb50 legacy=0x7f47e80c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e6d9d700 1 -- 172.21.15.115:0/333433077 >> v1:172.21.15.115:6789/0 conn(0x7f47e8153f30 legacy=0x7f47e80a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e6d9d700 1 -- 172.21.15.115:0/333433077 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80c7d80 con 0x7f47e80c0610 2023-07-27T14:38:05.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.162+0000 7f47e6d9d700 1 --2- 172.21.15.115:0/333433077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80c0610 0x7f47e80c0aa0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f47e0009e60 tx=0x7f47e0009780).ready entity=mon.0 client_cookie=88f5b471525e53b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:05.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47e559a700 1 -- 172.21.15.115:0/333433077 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000e070 con 0x7f47e80c0610 2023-07-27T14:38:05.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47e559a700 1 -- 172.21.15.115:0/333433077 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e000bb60 con 0x7f47e80c0610 2023-07-27T14:38:05.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47e559a700 1 -- 172.21.15.115:0/333433077 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0012410 con 0x7f47e80c0610 2023-07-27T14:38:05.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47ecbff700 1 -- 172.21.15.115:0/333433077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80c0610 msgr2=0x7f47e80c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47ecbff700 1 --2- 172.21.15.115:0/333433077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80c0610 0x7f47e80c0aa0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f47e0009e60 tx=0x7f47e0009780).stop 2023-07-27T14:38:05.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47ecbff700 1 -- 172.21.15.115:0/333433077 shutdown_connections 2023-07-27T14:38:05.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47ecbff700 1 --2- 172.21.15.115:0/333433077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80c0610 0x7f47e80c0aa0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47ecbff700 1 -- 172.21.15.115:0/333433077 >> 172.21.15.115:0/333433077 conn(0x7f47e8094280 msgr2=0x7f47e805e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:05.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47ecbff700 1 -- 172.21.15.115:0/333433077 shutdown_connections 2023-07-27T14:38:05.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.163+0000 7f47ecbff700 1 -- 172.21.15.115:0/333433077 wait complete. 2023-07-27T14:38:05.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.165+0000 7f47ecbff700 1 Processor -- start 2023-07-27T14:38:05.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.165+0000 7f47ecbff700 1 -- start start 2023-07-27T14:38:05.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47ecbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80bfb50 0x7f47e81637b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47ecbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e80c0610 0x7f47e8153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47ecbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47e8153f30 0x7f47e80ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47ecbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e814f400 con 0x7f47e80bfb50 2023-07-27T14:38:05.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47ecbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8166ec0 con 0x7f47e80c0610 2023-07-27T14:38:05.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47ecbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8163e30 con 0x7f47e8153f30 2023-07-27T14:38:05.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80bfb50 0x7f47e81637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80bfb50 0x7f47e81637b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60550/0 (socket says 172.21.15.115:60550) 2023-07-27T14:38:05.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 -- 172.21.15.115:0/1715924726 learned_addr learned my addr 172.21.15.115:0/1715924726 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:05.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e6d9d700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47e8153f30 0x7f47e80ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e5d9b700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e80c0610 0x7f47e8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 -- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47e8153f30 msgr2=0x7f47e80ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47e8153f30 0x7f47e80ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 -- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e80c0610 msgr2=0x7f47e8153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e80c0610 0x7f47e8153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 -- 172.21.15.115:0/1715924726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0009a20 con 0x7f47e80bfb50 2023-07-27T14:38:05.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e6d9d700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47e8153f30 0x7f47e80ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:05.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e5d9b700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e80c0610 0x7f47e8153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:05.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.166+0000 7f47e659c700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80bfb50 0x7f47e81637b0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f47d800c420 tx=0x7f47d8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:05.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.167+0000 7f47d67fc700 1 -- 172.21.15.115:0/1715924726 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80072e0 con 0x7f47e80bfb50 2023-07-27T14:38:05.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.167+0000 7f47d67fc700 1 -- 172.21.15.115:0/1715924726 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8007440 con 0x7f47e80bfb50 2023-07-27T14:38:05.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.167+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8164110 con 0x7f47e80bfb50 2023-07-27T14:38:05.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.167+0000 7f47d67fc700 1 -- 172.21.15.115:0/1715924726 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80057a0 con 0x7f47e80bfb50 2023-07-27T14:38:05.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.167+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81646d0 con 0x7f47e80bfb50 2023-07-27T14:38:05.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.168+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e806c470 con 0x7f47e80bfb50 2023-07-27T14:38:05.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.169+0000 7f47d67fc700 1 -- 172.21.15.115:0/1715924726 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 77042+0+0 (secure 0 0 0) 0x7f47d801a060 con 0x7f47e80bfb50 2023-07-27T14:38:05.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.169+0000 7f47d67fc700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f47c805fa30 0x7f47c8061ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.169+0000 7f47d67fc700 1 -- 172.21.15.115:0/1715924726 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f47d807a230 con 0x7f47e80bfb50 2023-07-27T14:38:05.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.170+0000 7f47e5d9b700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f47c805fa30 0x7f47c8061ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.170+0000 7f47e5d9b700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f47c805fa30 0x7f47c8061ef0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f47e8166cf0 tx=0x7f47dc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:05.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.173+0000 7f47d67fc700 1 -- 172.21.15.115:0/1715924726 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f47d804ab30 con 0x7f47e80bfb50 2023-07-27T14:38:05.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.380+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000595276", "snap_name": "snapshot_0000000000656954", "target_sub_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f47e80c8060 con 0x7f47c805fa30 2023-07-27T14:38:05.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.440+0000 7f47d67fc700 1 -- 172.21.15.115:0/1715924726 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f47e80c8060 con 0x7f47c805fa30 2023-07-27T14:38:05.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f47c805fa30 msgr2=0x7f47c8061ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f47c805fa30 0x7f47c8061ef0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f47e8166cf0 tx=0x7f47dc009040).stop 2023-07-27T14:38:05.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80bfb50 msgr2=0x7f47e81637b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80bfb50 0x7f47e81637b0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f47d800c420 tx=0x7f47d8007c80).stop 2023-07-27T14:38:05.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 shutdown_connections 2023-07-27T14:38:05.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f47c805fa30 0x7f47c8061ef0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47e8153f30 0x7f47e80ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47e80bfb50 0x7f47e81637b0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 --2- 172.21.15.115:0/1715924726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47e80c0610 0x7f47e8153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 >> 172.21.15.115:0/1715924726 conn(0x7f47e8094280 msgr2=0x7f47e80636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:05.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 shutdown_connections 2023-07-27T14:38:05.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.443+0000 7f47ecbff700 1 -- 172.21.15.115:0/1715924726 wait complete. 2023-07-27T14:38:05.498 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.447+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.498 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.447+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.498 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.447+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.499 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.447+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.499 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.447+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:05.521 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.466+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.522 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.466+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.522 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.466+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.522 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.466+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.522 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:05.466+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:05.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.659+0000 7fec2d9ff700 1 Processor -- start 2023-07-27T14:38:05.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.660+0000 7fec2d9ff700 1 -- start start 2023-07-27T14:38:05.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec2d9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fec2814ae00 0x7fec28154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec2d9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec2814b1e0 0x7fec28062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec2d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec280c5c50 0x7fec28063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec2d9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec28063530 con 0x7fec2814b1e0 2023-07-27T14:38:05.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec2d9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec281553f0 con 0x7fec2814ae00 2023-07-27T14:38:05.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec2d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec28157a50 con 0x7fec280c5c50 2023-07-27T14:38:05.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec267fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec2814b1e0 0x7fec28062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec267fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec2814b1e0 0x7fec28062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60594/0 (socket says 172.21.15.115:60594) 2023-07-27T14:38:05.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.661+0000 7fec267fc700 1 -- 172.21.15.115:0/2700719523 learned_addr learned my addr 172.21.15.115:0/2700719523 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:05.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec26ffd700 1 --2- 172.21.15.115:0/2700719523 >> v2:172.21.15.159:3300/0 conn(0x7fec2814ae00 0x7fec28154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec277fe700 1 --2- 172.21.15.115:0/2700719523 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec280c5c50 0x7fec28063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec267fc700 1 -- 172.21.15.115:0/2700719523 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec280c5c50 msgr2=0x7fec28063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:05.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec267fc700 1 --2- 172.21.15.115:0/2700719523 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec280c5c50 0x7fec28063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec267fc700 1 -- 172.21.15.115:0/2700719523 >> v2:172.21.15.159:3300/0 conn(0x7fec2814ae00 msgr2=0x7fec28154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:05.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec267fc700 1 --2- 172.21.15.115:0/2700719523 >> v2:172.21.15.159:3300/0 conn(0x7fec2814ae00 0x7fec28154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec267fc700 1 -- 172.21.15.115:0/2700719523 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec28157d10 con 0x7fec2814b1e0 2023-07-27T14:38:05.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec267fc700 1 --2- 172.21.15.115:0/2700719523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec28062b50 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7fec280caaf0 tx=0x7fec1c0090f0).ready entity=mon.0 client_cookie=37c78cc13cb670f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:05.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec25ffb700 1 -- 172.21.15.115:0/2700719523 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00b600 con 0x7fec2814b1e0 2023-07-27T14:38:05.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec25ffb700 1 -- 172.21.15.115:0/2700719523 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c00b760 con 0x7fec2814b1e0 2023-07-27T14:38:05.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.662+0000 7fec25ffb700 1 -- 172.21.15.115:0/2700719523 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00bae0 con 0x7fec2814b1e0 2023-07-27T14:38:05.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 -- 172.21.15.115:0/2700719523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 msgr2=0x7fec28062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/2700719523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec28062b50 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7fec280caaf0 tx=0x7fec1c0090f0).stop 2023-07-27T14:38:05.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 -- 172.21.15.115:0/2700719523 shutdown_connections 2023-07-27T14:38:05.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/2700719523 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec280c5c50 0x7fec28063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/2700719523 >> v2:172.21.15.159:3300/0 conn(0x7fec2814ae00 0x7fec28154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/2700719523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec28062b50 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 -- 172.21.15.115:0/2700719523 >> 172.21.15.115:0/2700719523 conn(0x7fec2805e940 msgr2=0x7fec280cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:05.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 -- 172.21.15.115:0/2700719523 shutdown_connections 2023-07-27T14:38:05.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.663+0000 7fec2d9ff700 1 -- 172.21.15.115:0/2700719523 wait complete. 2023-07-27T14:38:05.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.664+0000 7fec2d9ff700 1 Processor -- start 2023-07-27T14:38:05.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.664+0000 7fec2d9ff700 1 -- start start 2023-07-27T14:38:05.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.665+0000 7fec2d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280c5c50 0x7fec281498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.665+0000 7fec2d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec2814ae00 0x7fec280c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.665+0000 7fec2d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec280c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.665+0000 7fec2d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec28149d90 con 0x7fec2814b1e0 2023-07-27T14:38:05.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.665+0000 7fec2d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec280aee50 con 0x7fec280c5c50 2023-07-27T14:38:05.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.665+0000 7fec2d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec280adfa0 con 0x7fec2814ae00 2023-07-27T14:38:05.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec280c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec280c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60610/0 (socket says 172.21.15.115:60610) 2023-07-27T14:38:05.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 -- 172.21.15.115:0/3916195862 learned_addr learned my addr 172.21.15.115:0/3916195862 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:05.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec26ffd700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280c5c50 0x7fec281498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec267fc700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec2814ae00 0x7fec280c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 -- 172.21.15.115:0/3916195862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec2814ae00 msgr2=0x7fec280c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec2814ae00 0x7fec280c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 -- 172.21.15.115:0/3916195862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280c5c50 msgr2=0x7fec281498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280c5c50 0x7fec281498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 -- 172.21.15.115:0/3916195862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c009370 con 0x7fec2814b1e0 2023-07-27T14:38:05.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec277fe700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec280c34f0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fec20007f30 tx=0x7fec200098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:05.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec0effd700 1 -- 172.21.15.115:0/3916195862 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2000ecf0 con 0x7fec2814b1e0 2023-07-27T14:38:05.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec0effd700 1 -- 172.21.15.115:0/3916195862 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2000ee50 con 0x7fec2814b1e0 2023-07-27T14:38:05.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.666+0000 7fec0effd700 1 -- 172.21.15.115:0/3916195862 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20014630 con 0x7fec2814b1e0 2023-07-27T14:38:05.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.667+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec280ae240 con 0x7fec2814b1e0 2023-07-27T14:38:05.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.667+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec280ae800 con 0x7fec2814b1e0 2023-07-27T14:38:05.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.668+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2806c470 con 0x7fec2814b1e0 2023-07-27T14:38:05.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.669+0000 7fec0effd700 1 -- 172.21.15.115:0/3916195862 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 77042+0+0 (secure 0 0 0) 0x7fec2001b030 con 0x7fec2814b1e0 2023-07-27T14:38:05.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.669+0000 7fec0effd700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec1405fa30 0x7fec14061ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:05.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.669+0000 7fec0effd700 1 -- 172.21.15.115:0/3916195862 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fec2007b1e0 con 0x7fec2814b1e0 2023-07-27T14:38:05.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.670+0000 7fec26ffd700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec1405fa30 0x7fec14061ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:05.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.670+0000 7fec26ffd700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec1405fa30 0x7fec14061ef0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fec1800bb20 tx=0x7fec18008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:05.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.673+0000 7fec0effd700 1 -- 172.21.15.115:0/3916195862 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec2004f510 con 0x7fec2814b1e0 2023-07-27T14:38:05.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.719+0000 7fec0effd700 1 -- 172.21.15.115:0/3916195862 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fec20012070 con 0x7fec2814b1e0 2023-07-27T14:38:05.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.884+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7fec28062c00 con 0x7fec1405fa30 2023-07-27T14:38:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.891+0000 7fec0effd700 1 -- 172.21.15.115:0/3916195862 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7fec28062c00 con 0x7fec1405fa30 2023-07-27T14:38:05.942 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:38:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:05.944 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:05.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec1405fa30 msgr2=0x7fec14061ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec1405fa30 0x7fec14061ef0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fec1800bb20 tx=0x7fec18008040).stop 2023-07-27T14:38:05.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 msgr2=0x7fec280c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:05.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec280c34f0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7fec20007f30 tx=0x7fec200098e0).stop 2023-07-27T14:38:05.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 shutdown_connections 2023-07-27T14:38:05.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec1405fa30 0x7fec14061ef0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2814b1e0 0x7fec280c34f0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec280c5c50 0x7fec281498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 --2- 172.21.15.115:0/3916195862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec2814ae00 0x7fec280c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:05.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 >> 172.21.15.115:0/3916195862 conn(0x7fec2805e940 msgr2=0x7fec2814a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:05.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 shutdown_connections 2023-07-27T14:38:05.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:05.893+0000 7fec2d9ff700 1 -- 172.21.15.115:0/3916195862 wait complete. 2023-07-27T14:38:06.962 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:07.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.111+0000 7f72ebfff700 1 Processor -- start 2023-07-27T14:38:07.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.111+0000 7f72ebfff700 1 -- start start 2023-07-27T14:38:07.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.112+0000 7f72ebfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f72e4151d20 0x7f72e40c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:07.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.112+0000 7f72ebfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e41553f0 0x7f72e4062b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:07.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.112+0000 7f72ebfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e4154f60 con 0x7f72e40cb210 2023-07-27T14:38:07.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.112+0000 7f72ebfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e40cba60 con 0x7f72e4151d20 2023-07-27T14:38:07.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.112+0000 7f72ebfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4154720 con 0x7f72e41553f0 2023-07-27T14:38:07.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.113+0000 7f72e959a700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e41553f0 0x7f72e4062b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:07.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.113+0000 7f72e9d9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f72e4151d20 0x7f72e40c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:07.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.113+0000 7f72e9d9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f72e4151d20 0x7f72e40c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:41392/0 (socket says 172.21.15.115:41392) 2023-07-27T14:38:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.113+0000 7f72e9d9b700 1 -- 172.21.15.115:0/3613719843 learned_addr learned my addr 172.21.15.115:0/3613719843 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e9d9b700 1 -- 172.21.15.115:0/3613719843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e41553f0 msgr2=0x7f72e4062b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e9d9b700 1 --2- 172.21.15.115:0/3613719843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e41553f0 0x7f72e4062b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e9d9b700 1 -- 172.21.15.115:0/3613719843 >> v1:172.21.15.159:6789/0 conn(0x7f72e40cb210 legacy=0x7f72e40bfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e9d9b700 1 -- 172.21.15.115:0/3613719843 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e40cb780 con 0x7f72e4151d20 2023-07-27T14:38:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e959a700 1 --2- 172.21.15.115:0/3613719843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e41553f0 0x7f72e4062b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e9d9b700 1 --2- 172.21.15.115:0/3613719843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e4151d20 0x7f72e40c5100 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f72e0006fd0 tx=0x7f72e00090f0).ready entity=mon.1 client_cookie=96d80364242f8d2d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:07.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e8d99700 1 -- 172.21.15.115:0/3613719843 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000b580 con 0x7f72e4151d20 2023-07-27T14:38:07.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e8d99700 1 -- 172.21.15.115:0/3613719843 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e000b6e0 con 0x7f72e4151d20 2023-07-27T14:38:07.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.114+0000 7f72e8d99700 1 -- 172.21.15.115:0/3613719843 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000ba60 con 0x7f72e4151d20 2023-07-27T14:38:07.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.115+0000 7f72ebfff700 1 -- 172.21.15.115:0/3613719843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e4151d20 msgr2=0x7f72e40c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:07.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.115+0000 7f72ebfff700 1 --2- 172.21.15.115:0/3613719843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e4151d20 0x7f72e40c5100 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f72e0006fd0 tx=0x7f72e00090f0).stop 2023-07-27T14:38:07.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.115+0000 7f72ebfff700 1 -- 172.21.15.115:0/3613719843 shutdown_connections 2023-07-27T14:38:07.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.115+0000 7f72ebfff700 1 --2- 172.21.15.115:0/3613719843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e4151d20 0x7f72e40c5100 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.115+0000 7f72ebfff700 1 --2- 172.21.15.115:0/3613719843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e41553f0 0x7f72e4062b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.115+0000 7f72ebfff700 1 -- 172.21.15.115:0/3613719843 >> 172.21.15.115:0/3613719843 conn(0x7f72e405e940 msgr2=0x7f72e40cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:07.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.115+0000 7f72ebfff700 1 -- 172.21.15.115:0/3613719843 shutdown_connections 2023-07-27T14:38:07.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.115+0000 7f72ebfff700 1 -- 172.21.15.115:0/3613719843 wait complete. 2023-07-27T14:38:07.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.116+0000 7f72ebfff700 1 Processor -- start 2023-07-27T14:38:07.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.116+0000 7f72ebfff700 1 -- start start 2023-07-27T14:38:07.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.117+0000 7f72ebfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e40cb210 0x7f72e40ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:07.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.117+0000 7f72ebfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e4151d20 0x7f72e413be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:07.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.117+0000 7f72ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e41553f0 0x7f72e413c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:07.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.117+0000 7f72ebfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40b0460 con 0x7f72e41553f0 2023-07-27T14:38:07.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.117+0000 7f72ebfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40af570 con 0x7f72e40cb210 2023-07-27T14:38:07.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.117+0000 7f72ebfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40af850 con 0x7f72e4151d20 2023-07-27T14:38:07.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e41553f0 0x7f72e413c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e41553f0 0x7f72e413c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60616/0 (socket says 172.21.15.115:60616) 2023-07-27T14:38:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 -- 172.21.15.115:0/1170677790 learned_addr learned my addr 172.21.15.115:0/1170677790 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72e9d9b700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e40cb210 0x7f72e40ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72e959a700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e4151d20 0x7f72e413be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 -- 172.21.15.115:0/1170677790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e4151d20 msgr2=0x7f72e413be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e4151d20 0x7f72e413be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 -- 172.21.15.115:0/1170677790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e40cb210 msgr2=0x7f72e40ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e40cb210 0x7f72e40ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 -- 172.21.15.115:0/1170677790 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40092a0 con 0x7f72e41553f0 2023-07-27T14:38:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ea59c700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e41553f0 0x7f72e413c380 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f72dc002230 tx=0x7f72dc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72d9ffb700 1 -- 172.21.15.115:0/1170677790 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc010510 con 0x7f72e41553f0 2023-07-27T14:38:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72d9ffb700 1 -- 172.21.15.115:0/1170677790 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc010670 con 0x7f72e41553f0 2023-07-27T14:38:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e0009370 con 0x7f72e41553f0 2023-07-27T14:38:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.118+0000 7f72d9ffb700 1 -- 172.21.15.115:0/1170677790 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0109f0 con 0x7f72e41553f0 2023-07-27T14:38:07.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.119+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e40afe10 con 0x7f72e41553f0 2023-07-27T14:38:07.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.119+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e40b0610 con 0x7f72e41553f0 2023-07-27T14:38:07.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.120+0000 7f72d9ffb700 1 -- 172.21.15.115:0/1170677790 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f72dc010070 con 0x7f72e41553f0 2023-07-27T14:38:07.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.121+0000 7f72d9ffb700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72c805fac0 0x7f72c8061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:07.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.121+0000 7f72d9ffb700 1 -- 172.21.15.115:0/1170677790 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f72dc07ad40 con 0x7f72e41553f0 2023-07-27T14:38:07.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.121+0000 7f72e9d9b700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72c805fac0 0x7f72c8061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:07.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.122+0000 7f72e9d9b700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72c805fac0 0x7f72c8061f80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f72e0009130 tx=0x7f72e0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:07.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.125+0000 7f72d9ffb700 1 -- 172.21.15.115:0/1170677790 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72e40b0610 con 0x7f72e41553f0 2023-07-27T14:38:07.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.334+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f72e406c470 con 0x7f72c805fac0 2023-07-27T14:38:07.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.340+0000 7f72d9ffb700 1 -- 172.21.15.115:0/1170677790 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f72e406c470 con 0x7f72c805fac0 2023-07-27T14:38:07.393 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:38:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:07.394 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:07.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.342+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72c805fac0 msgr2=0x7f72c8061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.342+0000 7f72ebfff700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72c805fac0 0x7f72c8061f80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f72e0009130 tx=0x7f72e0017000).stop 2023-07-27T14:38:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.342+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e41553f0 msgr2=0x7f72e413c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.342+0000 7f72ebfff700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e41553f0 0x7f72e413c380 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f72dc002230 tx=0x7f72dc0015e0).stop 2023-07-27T14:38:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.342+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 shutdown_connections 2023-07-27T14:38:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.343+0000 7f72ebfff700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72c805fac0 0x7f72c8061f80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.343+0000 7f72ebfff700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72e41553f0 0x7f72e413c380 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.343+0000 7f72ebfff700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72e40cb210 0x7f72e40ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.343+0000 7f72ebfff700 1 --2- 172.21.15.115:0/1170677790 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72e4151d20 0x7f72e413be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:07.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.343+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 >> 172.21.15.115:0/1170677790 conn(0x7f72e405e940 msgr2=0x7f72e40c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:07.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.343+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 shutdown_connections 2023-07-27T14:38:07.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:07.343+0000 7f72ebfff700 1 -- 172.21.15.115:0/1170677790 wait complete. 2023-07-27T14:38:08.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.562+0000 7f65d75ff700 1 Processor -- start 2023-07-27T14:38:08.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.562+0000 7f65d75ff700 1 -- start start 2023-07-27T14:38:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.563+0000 7f65d75ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f65d013a350 0x7f65d0065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.563+0000 7f65d75ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d00c36b0 0x7f65d01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.563+0000 7f65d75ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d00bd9a0 con 0x7f65d013a730 2023-07-27T14:38:08.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.563+0000 7f65d75ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d0066400 con 0x7f65d013a350 2023-07-27T14:38:08.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.563+0000 7f65d75ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0158ae0 con 0x7f65d00c36b0 2023-07-27T14:38:08.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65d4b9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f65d013a730 0x7f65d00c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:45264/0 (socket says 172.21.15.115:45264) 2023-07-27T14:38:08.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65d4b9a700 1 -- 172.21.15.115:0/3746330079 learned_addr learned my addr 172.21.15.115:0/3746330079 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65d5b9c700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d00c36b0 0x7f65d01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65d539b700 1 --2- 172.21.15.115:0/3746330079 >> v2:172.21.15.159:3300/0 conn(0x7f65d013a350 0x7f65d0065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213821802 0 0) 0x7f65d00bd9a0 con 0x7f65d013a730 2023-07-27T14:38:08.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65bc0033f0 con 0x7f65d013a730 2023-07-27T14:38:08.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2555373199 0 0) 0x7f65bc0033f0 con 0x7f65d013a730 2023-07-27T14:38:08.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d00c36b0 msgr2=0x7f65d01585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:08.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d00c36b0 0x7f65d01585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:08.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 >> v2:172.21.15.159:3300/0 conn(0x7f65d013a350 msgr2=0x7f65d0065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:08.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 --2- 172.21.15.115:0/3746330079 >> v2:172.21.15.159:3300/0 conn(0x7f65d013a350 0x7f65d0065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:08.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0066610 con 0x7f65d013a730 2023-07-27T14:38:08.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.564+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f65c0001470 con 0x7f65d013a730 2023-07-27T14:38:08.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 >> v1:172.21.15.115:6789/0 conn(0x7f65d013a730 legacy=0x7f65d00c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:08.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65c7fff700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65bc0038e0 0x7f65bc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65c7fff700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d00c36b0 0x7f65bc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65c7fff700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc004b80 0x7f65bc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0066400 con 0x7f65bc0038e0 2023-07-27T14:38:08.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0158ae0 con 0x7f65bc004b80 2023-07-27T14:38:08.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc00b8e0 con 0x7f65d00c36b0 2023-07-27T14:38:08.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d539b700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65bc0038e0 0x7f65bc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d4b9a700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d00c36b0 0x7f65bc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d5b9c700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc004b80 0x7f65bc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d539b700 1 -- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d00c36b0 msgr2=0x7f65bc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:08.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d539b700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d00c36b0 0x7f65bc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:08.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d539b700 1 -- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc004b80 msgr2=0x7f65bc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:08.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d539b700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc004b80 0x7f65bc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:08.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d539b700 1 -- 172.21.15.115:0/3746330079 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0033f0 con 0x7f65bc0038e0 2023-07-27T14:38:08.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.565+0000 7f65d539b700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65bc0038e0 0x7f65bc003d00 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f65cc009a80 tx=0x7f65cc009060).ready entity=mon.0 client_cookie=63d42846ebf16685 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:08.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc009430 con 0x7f65bc0038e0 2023-07-27T14:38:08.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc00e640 con 0x7f65bc0038e0 2023-07-27T14:38:08.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65c7fff700 1 -- 172.21.15.115:0/3746330079 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00e9c0 con 0x7f65bc0038e0 2023-07-27T14:38:08.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65d75ff700 1 -- 172.21.15.115:0/3746330079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65bc0038e0 msgr2=0x7f65bc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:08.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65d75ff700 1 --2- 172.21.15.115:0/3746330079 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65bc0038e0 0x7f65bc003d00 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f65cc009a80 tx=0x7f65cc009060).stop 2023-07-27T14:38:08.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65d5b9c700 1 -- 172.21.15.115:0/3746330079 reap_dead start 2023-07-27T14:38:08.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65d75ff700 1 -- 172.21.15.115:0/3746330079 shutdown_connections 2023-07-27T14:38:08.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65d75ff700 1 -- 172.21.15.115:0/3746330079 >> 172.21.15.115:0/3746330079 conn(0x7f65d005e8f0 msgr2=0x7f65d00c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:08.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65d75ff700 1 -- 172.21.15.115:0/3746330079 shutdown_connections 2023-07-27T14:38:08.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.566+0000 7f65d75ff700 1 -- 172.21.15.115:0/3746330079 wait complete. 2023-07-27T14:38:08.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.568+0000 7f65d75ff700 1 Processor -- start 2023-07-27T14:38:08.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.568+0000 7f65d75ff700 1 -- start start 2023-07-27T14:38:08.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d75ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc0038e0 0x7f65d0138630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d75ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d0155540 0x7f65d00aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d75ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d00aad50 0x7f65d00c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d75ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d00c56f0 con 0x7f65d00aad50 2023-07-27T14:38:08.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d75ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d00c5f90 con 0x7f65bc0038e0 2023-07-27T14:38:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d75ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d00ab360 con 0x7f65d0155540 2023-07-27T14:38:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d5b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d00aad50 0x7f65d00c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d5b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d00aad50 0x7f65d00c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60628/0 (socket says 172.21.15.115:60628) 2023-07-27T14:38:08.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d5b9c700 1 -- 172.21.15.115:0/1355996580 learned_addr learned my addr 172.21.15.115:0/1355996580 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:08.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d539b700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc0038e0 0x7f65d0138630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d4b9a700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d0155540 0x7f65d00aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d5b9c700 1 -- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d0155540 msgr2=0x7f65d00aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d5b9c700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d0155540 0x7f65d00aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d5b9c700 1 -- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc0038e0 msgr2=0x7f65d0138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:08.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d5b9c700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc0038e0 0x7f65d0138630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d5b9c700 1 -- 172.21.15.115:0/1355996580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d00c5940 con 0x7f65d00aad50 2023-07-27T14:38:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.569+0000 7f65d539b700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc0038e0 0x7f65d0138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.570+0000 7f65d5b9c700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d00aad50 0x7f65d00c78b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f65d0066fa0 tx=0x7f65c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:08.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.570+0000 7f65c57fa700 1 -- 172.21.15.115:0/1355996580 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c800e070 con 0x7f65d00aad50 2023-07-27T14:38:08.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.570+0000 7f65c57fa700 1 -- 172.21.15.115:0/1355996580 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c8011c30 con 0x7f65d00aad50 2023-07-27T14:38:08.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.570+0000 7f65c57fa700 1 -- 172.21.15.115:0/1355996580 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c8016450 con 0x7f65d00aad50 2023-07-27T14:38:08.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.570+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d00c5c20 con 0x7f65d00aad50 2023-07-27T14:38:08.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.570+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d00a8430 con 0x7f65d00aad50 2023-07-27T14:38:08.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.571+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d006c470 con 0x7f65d00aad50 2023-07-27T14:38:08.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.572+0000 7f65c57fa700 1 -- 172.21.15.115:0/1355996580 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f65c801d030 con 0x7f65d00aad50 2023-07-27T14:38:08.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.573+0000 7f65c57fa700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f65b405fac0 0x7f65b4061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:08.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.573+0000 7f65c57fa700 1 -- 172.21.15.115:0/1355996580 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f65c807b520 con 0x7f65d00aad50 2023-07-27T14:38:08.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.573+0000 7f65d539b700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f65b405fac0 0x7f65b4061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:08.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.573+0000 7f65d539b700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f65b405fac0 0x7f65b4061f80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f65cc006d50 tx=0x7f65cc01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:08.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.576+0000 7f65c57fa700 1 -- 172.21.15.115:0/1355996580 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f65c804bc80 con 0x7f65d00aad50 2023-07-27T14:38:08.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:08.786+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f65d00bdc10 con 0x7f65b405fac0 2023-07-27T14:38:12.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.164+0000 7f65c57fa700 1 -- 172.21.15.115:0/1355996580 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f65d00bdc10 con 0x7f65b405fac0 2023-07-27T14:38:12.216 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:12.216 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:12.217 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:12.217 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:12.217 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:12.217 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:12.218 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:12.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:12.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:12.218 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:12.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f65b405fac0 msgr2=0x7f65b4061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:12.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f65b405fac0 0x7f65b4061f80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f65cc006d50 tx=0x7f65cc01a000).stop 2023-07-27T14:38:12.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d00aad50 msgr2=0x7f65d00c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:12.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d00aad50 0x7f65d00c78b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f65d0066fa0 tx=0x7f65c800b040).stop 2023-07-27T14:38:12.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 shutdown_connections 2023-07-27T14:38:12.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f65b405fac0 0x7f65b4061f80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:12.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d00aad50 0x7f65d00c78b0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:12.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65bc0038e0 0x7f65d0138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:12.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 --2- 172.21.15.115:0/1355996580 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65d0155540 0x7f65d00aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:12.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 >> 172.21.15.115:0/1355996580 conn(0x7f65d005e8f0 msgr2=0x7f65d0153780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:12.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 shutdown_connections 2023-07-27T14:38:12.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:12.167+0000 7f65d75ff700 1 -- 172.21.15.115:0/1355996580 wait complete. 2023-07-27T14:38:13.241 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:13.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.392+0000 7fd7fefff700 1 Processor -- start 2023-07-27T14:38:13.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.392+0000 7fd7fefff700 1 -- start start 2023-07-27T14:38:13.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.393+0000 7fd7fefff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd7f80c36b0 0x7fd7f8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:13.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.393+0000 7fd7fefff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80bd9a0 con 0x7fd7f813a350 2023-07-27T14:38:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.393+0000 7fd7fefff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f8066610 con 0x7fd7f813a730 2023-07-27T14:38:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.393+0000 7fd7fefff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f8066400 con 0x7fd7f80c36b0 2023-07-27T14:38:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7fd59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd7f80c36b0 0x7fd7f8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:13.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7fcd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd7f813a350 0x7fd7f80c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:45272/0 (socket says 172.21.15.115:45272) 2023-07-27T14:38:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7fcd9b700 1 -- 172.21.15.115:0/552726633 learned_addr learned my addr 172.21.15.115:0/552726633 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7fd59c700 1 -- 172.21.15.115:0/552726633 >> v1:172.21.15.159:6789/0 conn(0x7fd7f813a730 legacy=0x7fd7f80be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:13.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7fd59c700 1 -- 172.21.15.115:0/552726633 >> v1:172.21.15.115:6789/0 conn(0x7fd7f813a350 legacy=0x7fd7f80c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:13.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7f77fe700 1 -- 172.21.15.115:0/552726633 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914449786 0 0) 0x7fd7f80bd9a0 con 0x7fd7f813a350 2023-07-27T14:38:13.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7fd59c700 1 -- 172.21.15.115:0/552726633 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80bdc10 con 0x7fd7f80c36b0 2023-07-27T14:38:13.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7fd59c700 1 --2- 172.21.15.115:0/552726633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8065f10 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7fd7f0009e60 tx=0x7fd7f0009780).ready entity=mon.0 client_cookie=7ec766a12f2a1979 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:13.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7f77fe700 1 -- 172.21.15.115:0/552726633 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000e070 con 0x7fd7f80c36b0 2023-07-27T14:38:13.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7f77fe700 1 -- 172.21.15.115:0/552726633 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000bbf0 con 0x7fd7f80c36b0 2023-07-27T14:38:13.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.394+0000 7fd7f77fe700 1 -- 172.21.15.115:0/552726633 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0012410 con 0x7fd7f80c36b0 2023-07-27T14:38:13.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.395+0000 7fd7fefff700 1 -- 172.21.15.115:0/552726633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 msgr2=0x7fd7f8065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:13.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.395+0000 7fd7fefff700 1 --2- 172.21.15.115:0/552726633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8065f10 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7fd7f0009e60 tx=0x7fd7f0009780).stop 2023-07-27T14:38:13.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.395+0000 7fd7fefff700 1 -- 172.21.15.115:0/552726633 shutdown_connections 2023-07-27T14:38:13.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.395+0000 7fd7fefff700 1 --2- 172.21.15.115:0/552726633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8065f10 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.395+0000 7fd7fefff700 1 -- 172.21.15.115:0/552726633 >> 172.21.15.115:0/552726633 conn(0x7fd7f805e8f0 msgr2=0x7fd7f80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.395+0000 7fd7fefff700 1 -- 172.21.15.115:0/552726633 shutdown_connections 2023-07-27T14:38:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.395+0000 7fd7fefff700 1 -- 172.21.15.115:0/552726633 wait complete. 2023-07-27T14:38:13.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.397+0000 7fd7fefff700 1 Processor -- start 2023-07-27T14:38:13.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.397+0000 7fd7fefff700 1 -- start start 2023-07-27T14:38:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.398+0000 7fd7fefff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8164e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.398+0000 7fd7fefff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7f813a350 0x7fd7f8165390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.398+0000 7fd7fefff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7f813a730 0x7fd7f8139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:13.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.398+0000 7fd7fefff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8165880 con 0x7fd7f80c36b0 2023-07-27T14:38:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.398+0000 7fd7fefff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80c5550 con 0x7fd7f813a730 2023-07-27T14:38:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.398+0000 7fd7fefff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8139900 con 0x7fd7f813a350 2023-07-27T14:38:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8164e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8164e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60636/0 (socket says 172.21.15.115:60636) 2023-07-27T14:38:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 -- 172.21.15.115:0/1698384042 learned_addr learned my addr 172.21.15.115:0/1698384042 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:13.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 -- 172.21.15.115:0/1698384042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7f813a350 msgr2=0x7fd7f8165390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7f813a350 0x7fd7f8165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 -- 172.21.15.115:0/1698384042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7f813a730 msgr2=0x7fd7f8139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7f813a730 0x7fd7f8139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 -- 172.21.15.115:0/1698384042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0009a20 con 0x7fd7f80c36b0 2023-07-27T14:38:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fcd9b700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8164e00 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7fd7ec00c4e0 tx=0x7fd7ec007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7f4ff9700 1 -- 172.21.15.115:0/1698384042 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec0072e0 con 0x7fd7f80c36b0 2023-07-27T14:38:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7f4ff9700 1 -- 172.21.15.115:0/1698384042 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec007440 con 0x7fd7f80c36b0 2023-07-27T14:38:13.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.399+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f80a5450 con 0x7fd7f80c36b0 2023-07-27T14:38:13.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.400+0000 7fd7f4ff9700 1 -- 172.21.15.115:0/1698384042 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec0057a0 con 0x7fd7f80c36b0 2023-07-27T14:38:13.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.400+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f80a4e00 con 0x7fd7f80c36b0 2023-07-27T14:38:13.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.400+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f806c470 con 0x7fd7f80c36b0 2023-07-27T14:38:13.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.401+0000 7fd7f4ff9700 1 -- 172.21.15.115:0/1698384042 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fd7ec01a060 con 0x7fd7f80c36b0 2023-07-27T14:38:13.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.402+0000 7fd7f4ff9700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7dc05fac0 0x7fd7dc061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:13.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.402+0000 7fd7f4ff9700 1 -- 172.21.15.115:0/1698384042 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd7ec07a990 con 0x7fd7f80c36b0 2023-07-27T14:38:13.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.403+0000 7fd7f7fff700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7dc05fac0 0x7fd7dc061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:13.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.403+0000 7fd7f7fff700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7dc05fac0 0x7fd7dc061f80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fd7f8153680 tx=0x7fd7e4006ae0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:13.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.406+0000 7fd7f4ff9700 1 -- 172.21.15.115:0/1698384042 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7ec04b0f0 con 0x7fd7f80c36b0 2023-07-27T14:38:13.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.619+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f80bdef0 con 0x7fd7dc05fac0 2023-07-27T14:38:13.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.625+0000 7fd7f4ff9700 1 -- 172.21.15.115:0/1698384042 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fd7f80bdef0 con 0x7fd7dc05fac0 2023-07-27T14:38:13.677 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:13.677 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:13.677 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:13.677 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:13.677 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:13.678 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:13.678 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:13.678 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:13.678 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:13.678 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:13.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7dc05fac0 msgr2=0x7fd7dc061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:13.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7dc05fac0 0x7fd7dc061f80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fd7f8153680 tx=0x7fd7e4006ae0).stop 2023-07-27T14:38:13.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 msgr2=0x7fd7f8164e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:13.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8164e00 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7fd7ec00c4e0 tx=0x7fd7ec007c70).stop 2023-07-27T14:38:13.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 shutdown_connections 2023-07-27T14:38:13.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7dc05fac0 0x7fd7dc061f80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:13.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7f813a730 0x7fd7f8139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:13.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7f80c36b0 0x7fd7f8164e00 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:13.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 --2- 172.21.15.115:0/1698384042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7f813a350 0x7fd7f8165390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:13.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 >> 172.21.15.115:0/1698384042 conn(0x7fd7f805e8f0 msgr2=0x7fd7f80acb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:13.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 shutdown_connections 2023-07-27T14:38:13.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:13.627+0000 7fd7fefff700 1 -- 172.21.15.115:0/1698384042 wait complete. 2023-07-27T14:38:14.697 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:14.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.846+0000 7fad525ff700 1 Processor -- start 2023-07-27T14:38:14.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.846+0000 7fad525ff700 1 -- start start 2023-07-27T14:38:14.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.847+0000 7fad525ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:14.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.847+0000 7fad525ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4c1553f0 con 0x7fad4c14b1e0 2023-07-27T14:38:14.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.847+0000 7fad525ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4c157a50 con 0x7fad4c063260 2023-07-27T14:38:14.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.847+0000 7fad525ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c157d10 con 0x7fad4c14ae00 2023-07-27T14:38:14.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fad4c14b1e0 0x7fad4c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59594/0 (socket says 172.21.15.115:59594) 2023-07-27T14:38:14.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4b7fe700 1 -- 172.21.15.115:0/1850163680 learned_addr learned my addr 172.21.15.115:0/1850163680 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:14.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4bfff700 1 --2- 172.21.15.115:0/1850163680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:14.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4affd700 1 -- 172.21.15.115:0/1850163680 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358800188 0 0) 0x7fad4c1553f0 con 0x7fad4c14b1e0 2023-07-27T14:38:14.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4affd700 1 -- 172.21.15.115:0/1850163680 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad340033f0 con 0x7fad4c14b1e0 2023-07-27T14:38:14.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4affd700 1 -- 172.21.15.115:0/1850163680 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490784266 0 0) 0x7fad4c157a50 con 0x7fad4c063260 2023-07-27T14:38:14.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4affd700 1 -- 172.21.15.115:0/1850163680 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c1553f0 con 0x7fad4c063260 2023-07-27T14:38:14.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4bfff700 1 -- 172.21.15.115:0/1850163680 >> v1:172.21.15.159:6789/0 conn(0x7fad4c063260 legacy=0x7fad4c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:14.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4bfff700 1 -- 172.21.15.115:0/1850163680 >> v1:172.21.15.115:6789/0 conn(0x7fad4c14b1e0 legacy=0x7fad4c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:14.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.848+0000 7fad4bfff700 1 -- 172.21.15.115:0/1850163680 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c157ff0 con 0x7fad4c14ae00 2023-07-27T14:38:14.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad4bfff700 1 --2- 172.21.15.115:0/1850163680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c154f00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fad3c009790 tx=0x7fad3c009060).ready entity=mon.2 client_cookie=3353d45b3be6ece6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:14.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad4affd700 1 -- 172.21.15.115:0/1850163680 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00f510 con 0x7fad4c14ae00 2023-07-27T14:38:14.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad4affd700 1 -- 172.21.15.115:0/1850163680 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c00f670 con 0x7fad4c14ae00 2023-07-27T14:38:14.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad4affd700 1 -- 172.21.15.115:0/1850163680 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00f9f0 con 0x7fad4c14ae00 2023-07-27T14:38:14.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad525ff700 1 -- 172.21.15.115:0/1850163680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 msgr2=0x7fad4c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:14.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad525ff700 1 --2- 172.21.15.115:0/1850163680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c154f00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fad3c009790 tx=0x7fad3c009060).stop 2023-07-27T14:38:14.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad525ff700 1 -- 172.21.15.115:0/1850163680 shutdown_connections 2023-07-27T14:38:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad525ff700 1 --2- 172.21.15.115:0/1850163680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c154f00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad525ff700 1 -- 172.21.15.115:0/1850163680 >> 172.21.15.115:0/1850163680 conn(0x7fad4c05e940 msgr2=0x7fad4c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.849+0000 7fad525ff700 1 -- 172.21.15.115:0/1850163680 shutdown_connections 2023-07-27T14:38:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.850+0000 7fad525ff700 1 -- 172.21.15.115:0/1850163680 wait complete. 2023-07-27T14:38:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.851+0000 7fad525ff700 1 Processor -- start 2023-07-27T14:38:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.851+0000 7fad525ff700 1 -- start start 2023-07-27T14:38:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad525ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad4c063260 0x7fad4c14c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad525ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad525ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad4c14b1e0 0x7fad4c0c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad525ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0c4a40 con 0x7fad4c14b1e0 2023-07-27T14:38:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad525ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0c1e10 con 0x7fad4c063260 2023-07-27T14:38:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad525ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0c41a0 con 0x7fad4c14ae00 2023-07-27T14:38:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad50b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad4c14b1e0 0x7fad4c0c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad50b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad4c14b1e0 0x7fad4c0c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39464/0 (socket says 172.21.15.115:39464) 2023-07-27T14:38:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad50b9c700 1 -- 172.21.15.115:0/2351905538 learned_addr learned my addr 172.21.15.115:0/2351905538 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad4b7fe700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.852+0000 7fad4bfff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad4c063260 0x7fad4c14c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad50b9c700 1 -- 172.21.15.115:0/2351905538 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 msgr2=0x7fad4c149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad50b9c700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad50b9c700 1 -- 172.21.15.115:0/2351905538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad4c063260 msgr2=0x7fad4c14c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad50b9c700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad4c063260 0x7fad4c14c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad50b9c700 1 -- 172.21.15.115:0/2351905538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0092a0 con 0x7fad4c14b1e0 2023-07-27T14:38:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad50b9c700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad4c14b1e0 0x7fad4c0c3750 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7fad4400c740 tx=0x7fad4400ca50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad33fff700 1 -- 172.21.15.115:0/2351905538 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400e4a0 con 0x7fad4c14b1e0 2023-07-27T14:38:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad33fff700 1 -- 172.21.15.115:0/2351905538 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4400e600 con 0x7fad4c14b1e0 2023-07-27T14:38:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad33fff700 1 -- 172.21.15.115:0/2351905538 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400e980 con 0x7fad4c14b1e0 2023-07-27T14:38:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4c0c4480 con 0x7fad4c14b1e0 2023-07-27T14:38:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.853+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c14cd60 con 0x7fad4c14b1e0 2023-07-27T14:38:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.854+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c0c1fa0 con 0x7fad4c14b1e0 2023-07-27T14:38:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.855+0000 7fad33fff700 1 -- 172.21.15.115:0/2351905538 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fad44019030 con 0x7fad4c14b1e0 2023-07-27T14:38:14.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.856+0000 7fad33fff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad3805fac0 0x7fad38061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:14.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.856+0000 7fad33fff700 1 -- 172.21.15.115:0/2351905538 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fad4407a630 con 0x7fad4c14b1e0 2023-07-27T14:38:14.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.856+0000 7fad4bfff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad3805fac0 0x7fad38061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:14.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.857+0000 7fad4bfff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad3805fac0 0x7fad38061f80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fad3c009fd0 tx=0x7fad3c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:14.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:14.860+0000 7fad33fff700 1 -- 172.21.15.115:0/2351905538 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad440488f0 con 0x7fad4c14b1e0 2023-07-27T14:38:15.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.069+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7fad4c06c470 con 0x7fad3805fac0 2023-07-27T14:38:15.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.074+0000 7fad33fff700 1 -- 172.21.15.115:0/2351905538 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fad4c06c470 con 0x7fad3805fac0 2023-07-27T14:38:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:15.127 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:15.127 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:15.127 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:15.127 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:15.128 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:15.128 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:15.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:15.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:15.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad3805fac0 msgr2=0x7fad38061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:15.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad3805fac0 0x7fad38061f80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fad3c009fd0 tx=0x7fad3c017000).stop 2023-07-27T14:38:15.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad4c14b1e0 msgr2=0x7fad4c0c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:15.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad4c14b1e0 0x7fad4c0c3750 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7fad4400c740 tx=0x7fad4400ca50).stop 2023-07-27T14:38:15.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 shutdown_connections 2023-07-27T14:38:15.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad3805fac0 0x7fad38061f80 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:15.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad4c14b1e0 0x7fad4c0c3750 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:15.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad4c063260 0x7fad4c14c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:15.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 --2- 172.21.15.115:0/2351905538 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad4c14ae00 0x7fad4c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:15.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 >> 172.21.15.115:0/2351905538 conn(0x7fad4c05e940 msgr2=0x7fad4c152030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:15.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 shutdown_connections 2023-07-27T14:38:15.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:15.076+0000 7fad525ff700 1 -- 172.21.15.115:0/2351905538 wait complete. 2023-07-27T14:38:16.146 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:16.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.295+0000 7f73cf3ff700 1 Processor -- start 2023-07-27T14:38:16.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.295+0000 7f73cf3ff700 1 -- start start 2023-07-27T14:38:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73cf3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73c814b1e0 0x7f73c8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73cf3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c81553f0 con 0x7f73c8063260 2023-07-27T14:38:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73cf3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c8157a50 con 0x7f73c814ae00 2023-07-27T14:38:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73cf3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c8157d10 con 0x7f73c814b1e0 2023-07-27T14:38:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73cc99a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f73c8063260 0x7f73c80a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59596/0 (socket says 172.21.15.115:59596) 2023-07-27T14:38:16.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73cc99a700 1 -- 172.21.15.115:0/1886594088 learned_addr learned my addr 172.21.15.115:0/1886594088 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:16.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73cd99c700 1 --2- 172.21.15.115:0/1886594088 >> v2:172.21.15.159:3300/0 conn(0x7f73c814b1e0 0x7f73c8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380605845 0 0) 0x7f73c81553f0 con 0x7f73c8063260 2023-07-27T14:38:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.297+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b40033f0 con 0x7f73c8063260 2023-07-27T14:38:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 137141452 0 0) 0x7f73b40033f0 con 0x7f73c8063260 2023-07-27T14:38:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 >> v2:172.21.15.159:3300/0 conn(0x7f73c814b1e0 msgr2=0x7f73c8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 --2- 172.21.15.115:0/1886594088 >> v2:172.21.15.159:3300/0 conn(0x7f73c814b1e0 0x7f73c8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 >> v1:172.21.15.159:6789/0 conn(0x7f73c814ae00 legacy=0x7f73c8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:16.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8157ff0 con 0x7f73c8063260 2023-07-27T14:38:16.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f73b8001470 con 0x7f73c8063260 2023-07-27T14:38:16.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 >> v1:172.21.15.115:6789/0 conn(0x7f73c8063260 legacy=0x7f73c80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:16.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b40038e0 0x7f73b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:16.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73b4004690 0x7f73b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:16.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73b4005000 0x7f73b400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:16.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c8157d10 con 0x7f73b4004690 2023-07-27T14:38:16.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b400bf60 con 0x7f73b4005000 2023-07-27T14:38:16.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b400c0f0 con 0x7f73b40038e0 2023-07-27T14:38:16.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73cc99a700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73b4004690 0x7f73b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:16.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73cd99c700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73b4005000 0x7f73b400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:16.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.298+0000 7f73cd19b700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b40038e0 0x7f73b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:16.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cc99a700 1 -- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b40038e0 msgr2=0x7f73b4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:16.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cc99a700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b40038e0 0x7f73b4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cc99a700 1 -- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73b4005000 msgr2=0x7f73b400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:16.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cc99a700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73b4005000 0x7f73b400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cc99a700 1 -- 172.21.15.115:0/1886594088 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b40033f0 con 0x7f73b4004690 2023-07-27T14:38:16.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cd99c700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73b4005000 0x7f73b400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:16.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cd99c700 1 -- 172.21.15.115:0/1886594088 reap_dead start 2023-07-27T14:38:16.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cc99a700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73b4004690 0x7f73b4004b10 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f73b800c160 tx=0x7f73b8001e50).ready entity=mon.0 client_cookie=c2691eab7d17f7fb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:16.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8007a20 con 0x7f73b4004690 2023-07-27T14:38:16.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800ca90 con 0x7f73b4004690 2023-07-27T14:38:16.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73bffff700 1 -- 172.21.15.115:0/1886594088 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800ce10 con 0x7f73b4004690 2023-07-27T14:38:16.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cf3ff700 1 -- 172.21.15.115:0/1886594088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73b4004690 msgr2=0x7f73b4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:16.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.299+0000 7f73cf3ff700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73b4004690 0x7f73b4004b10 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f73b800c160 tx=0x7f73b8001e50).stop 2023-07-27T14:38:16.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.300+0000 7f73cf3ff700 1 -- 172.21.15.115:0/1886594088 shutdown_connections 2023-07-27T14:38:16.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.300+0000 7f73cf3ff700 1 --2- 172.21.15.115:0/1886594088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73b4004690 0x7f73b4004b10 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.300+0000 7f73cf3ff700 1 -- 172.21.15.115:0/1886594088 >> 172.21.15.115:0/1886594088 conn(0x7f73c805e940 msgr2=0x7f73c80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:16.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.300+0000 7f73cf3ff700 1 -- 172.21.15.115:0/1886594088 shutdown_connections 2023-07-27T14:38:16.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.300+0000 7f73cf3ff700 1 -- 172.21.15.115:0/1886594088 wait complete. 2023-07-27T14:38:16.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.301+0000 7f73cf3ff700 1 Processor -- start 2023-07-27T14:38:16.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.301+0000 7f73cf3ff700 1 -- start start 2023-07-27T14:38:16.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cf3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b4004690 0x7f73c80c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:16.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cf3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73c8149830 0x7f73c80c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:16.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cf3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73c8064490 0x7f73c8064910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:16.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cf3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80c48d0 con 0x7f73c8064490 2023-07-27T14:38:16.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cf3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c8149cb0 con 0x7f73c8149830 2023-07-27T14:38:16.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cf3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c8064e00 con 0x7f73b4004690 2023-07-27T14:38:16.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cd99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73c8064490 0x7f73c8064910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:16.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cd99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73c8064490 0x7f73c8064910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39494/0 (socket says 172.21.15.115:39494) 2023-07-27T14:38:16.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cd99c700 1 -- 172.21.15.115:0/340229381 learned_addr learned my addr 172.21.15.115:0/340229381 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:16.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.302+0000 7f73cd19b700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b4004690 0x7f73c80c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:16.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cc99a700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73c8149830 0x7f73c80c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:16.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cd99c700 1 -- 172.21.15.115:0/340229381 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b4004690 msgr2=0x7f73c80c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:16.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cd99c700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b4004690 0x7f73c80c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cd99c700 1 -- 172.21.15.115:0/340229381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73c8149830 msgr2=0x7f73c80c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:16.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cd99c700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73c8149830 0x7f73c80c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cd99c700 1 -- 172.21.15.115:0/340229381 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80c3cc0 con 0x7f73c8064490 2023-07-27T14:38:16.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cd99c700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73c8064490 0x7f73c8064910 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f73c0009fd0 tx=0x7f73c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:16.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73bd7fa700 1 -- 172.21.15.115:0/340229381 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000e030 con 0x7f73c8064490 2023-07-27T14:38:16.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73bd7fa700 1 -- 172.21.15.115:0/340229381 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c000f040 con 0x7f73c8064490 2023-07-27T14:38:16.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73bd7fa700 1 -- 172.21.15.115:0/340229381 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c0010d50 con 0x7f73c8064490 2023-07-27T14:38:16.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c80c3fa0 con 0x7f73c8064490 2023-07-27T14:38:16.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.303+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c80c4560 con 0x7f73c8064490 2023-07-27T14:38:16.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.304+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c80c4a80 con 0x7f73c8064490 2023-07-27T14:38:16.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.305+0000 7f73bd7fa700 1 -- 172.21.15.115:0/340229381 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f73c0015690 con 0x7f73c8064490 2023-07-27T14:38:16.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.306+0000 7f73bd7fa700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73ac05fac0 0x7f73ac061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:16.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.306+0000 7f73bd7fa700 1 -- 172.21.15.115:0/340229381 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f73c007ba40 con 0x7f73c8064490 2023-07-27T14:38:16.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.306+0000 7f73cd19b700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73ac05fac0 0x7f73ac061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:16.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.307+0000 7f73cd19b700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73ac05fac0 0x7f73ac061f80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f73c4000c00 tx=0x7f73c4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:16.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.310+0000 7f73bd7fa700 1 -- 172.21.15.115:0/340229381 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73c80c4a80 con 0x7f73c8064490 2023-07-27T14:38:16.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.523+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f73c80c4a80 con 0x7f73ac05fac0 2023-07-27T14:38:16.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.529+0000 7f73bd7fa700 1 -- 172.21.15.115:0/340229381 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f73c80c4a80 con 0x7f73ac05fac0 2023-07-27T14:38:16.581 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:16.581 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:16.581 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:16.582 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:16.582 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:16.582 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:16.582 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:16.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:16.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:16.582 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:16.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73ac05fac0 msgr2=0x7f73ac061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:16.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73ac05fac0 0x7f73ac061f80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f73c4000c00 tx=0x7f73c4009040).stop 2023-07-27T14:38:16.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73c8064490 msgr2=0x7f73c8064910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:16.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73c8064490 0x7f73c8064910 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f73c0009fd0 tx=0x7f73c000b040).stop 2023-07-27T14:38:16.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 shutdown_connections 2023-07-27T14:38:16.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73ac05fac0 0x7f73ac061f80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73c8064490 0x7f73c8064910 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73b4004690 0x7f73c80c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 --2- 172.21.15.115:0/340229381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73c8149830 0x7f73c80c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:16.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 >> 172.21.15.115:0/340229381 conn(0x7f73c805e940 msgr2=0x7f73c81538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:16.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 shutdown_connections 2023-07-27T14:38:16.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:16.531+0000 7f73cf3ff700 1 -- 172.21.15.115:0/340229381 wait complete. 2023-07-27T14:38:17.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:17.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.747+0000 7faa6f1ff700 1 Processor -- start 2023-07-27T14:38:17.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.747+0000 7faa6f1ff700 1 -- start start 2023-07-27T14:38:17.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.748+0000 7faa6f1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6813a350 0x7faa68065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:17.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.748+0000 7faa6f1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faa6813a730 0x7faa681585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:17.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.748+0000 7faa6f1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7faa680c2fa0 0x7faa680c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:17.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.748+0000 7faa6f1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa68066400 con 0x7faa6813a730 2023-07-27T14:38:17.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.748+0000 7faa6f1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa68158ae0 con 0x7faa680c2fa0 2023-07-27T14:38:17.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.748+0000 7faa6f1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c3920 con 0x7faa6813a350 2023-07-27T14:38:17.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.748+0000 7faa67fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faa6813a730 0x7faa681585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:17.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa67fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faa6813a730 0x7faa681585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39510/0 (socket says 172.21.15.115:39510) 2023-07-27T14:38:17.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa67fff700 1 -- 172.21.15.115:0/2290943595 learned_addr learned my addr 172.21.15.115:0/2290943595 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:17.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa6d79c700 1 --2- 172.21.15.115:0/2290943595 >> v2:172.21.15.159:3300/0 conn(0x7faa680c2fa0 0x7faa680c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:17.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa6cf9b700 1 --2- 172.21.15.115:0/2290943595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6813a350 0x7faa68065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:17.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa67fff700 1 -- 172.21.15.115:0/2290943595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6813a350 msgr2=0x7faa68065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:17.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa67fff700 1 --2- 172.21.15.115:0/2290943595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6813a350 0x7faa68065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:17.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa67fff700 1 -- 172.21.15.115:0/2290943595 >> v2:172.21.15.159:3300/0 conn(0x7faa680c2fa0 msgr2=0x7faa680c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:17.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa67fff700 1 --2- 172.21.15.115:0/2290943595 >> v2:172.21.15.159:3300/0 conn(0x7faa680c2fa0 0x7faa680c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:17.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa67fff700 1 -- 172.21.15.115:0/2290943595 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680bd9a0 con 0x7faa6813a730 2023-07-27T14:38:17.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa6d79c700 1 --2- 172.21.15.115:0/2290943595 >> v2:172.21.15.159:3300/0 conn(0x7faa680c2fa0 0x7faa680c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:17.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa67fff700 1 --2- 172.21.15.115:0/2290943595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a730 0x7faa681585f0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7faa68066f80 tx=0x7faa540090f0).ready entity=mon.0 client_cookie=e2133ab3b09c8c6b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:17.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa677fe700 1 -- 172.21.15.115:0/2290943595 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5400b600 con 0x7faa6813a730 2023-07-27T14:38:17.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa677fe700 1 -- 172.21.15.115:0/2290943595 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5400b760 con 0x7faa6813a730 2023-07-27T14:38:17.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.749+0000 7faa677fe700 1 -- 172.21.15.115:0/2290943595 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5400bae0 con 0x7faa6813a730 2023-07-27T14:38:17.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 -- 172.21.15.115:0/2290943595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a730 msgr2=0x7faa681585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:17.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 --2- 172.21.15.115:0/2290943595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a730 0x7faa681585f0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7faa68066f80 tx=0x7faa540090f0).stop 2023-07-27T14:38:17.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 -- 172.21.15.115:0/2290943595 shutdown_connections 2023-07-27T14:38:17.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 --2- 172.21.15.115:0/2290943595 >> v2:172.21.15.159:3300/0 conn(0x7faa680c2fa0 0x7faa680c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:17.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 --2- 172.21.15.115:0/2290943595 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa6813a350 0x7faa68065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:17.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 --2- 172.21.15.115:0/2290943595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a730 0x7faa681585f0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:17.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 -- 172.21.15.115:0/2290943595 >> 172.21.15.115:0/2290943595 conn(0x7faa6805e8f0 msgr2=0x7faa680c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:17.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 -- 172.21.15.115:0/2290943595 shutdown_connections 2023-07-27T14:38:17.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.750+0000 7faa6f1ff700 1 -- 172.21.15.115:0/2290943595 wait complete. 2023-07-27T14:38:17.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.752+0000 7faa6f1ff700 1 Processor -- start 2023-07-27T14:38:17.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.752+0000 7faa6f1ff700 1 -- start start 2023-07-27T14:38:17.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6f1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa680c2fa0 0x7faa681537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:17.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6f1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a350 0x7faa68154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:17.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6f1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6813a730 0x7faa681552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:17.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6f1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c2380 con 0x7faa6813a350 2023-07-27T14:38:17.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6f1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c1770 con 0x7faa6813a730 2023-07-27T14:38:17.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6f1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c1a50 con 0x7faa680c2fa0 2023-07-27T14:38:17.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa67fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a350 0x7faa68154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:17.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa67fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a350 0x7faa68154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39518/0 (socket says 172.21.15.115:39518) 2023-07-27T14:38:17.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa67fff700 1 -- 172.21.15.115:0/1973460537 learned_addr learned my addr 172.21.15.115:0/1973460537 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:17.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6d79c700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6813a730 0x7faa681552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:17.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6cf9b700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa680c2fa0 0x7faa681537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:17.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa67fff700 1 -- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa680c2fa0 msgr2=0x7faa681537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:17.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa67fff700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa680c2fa0 0x7faa681537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:17.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa67fff700 1 -- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6813a730 msgr2=0x7faa681552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:17.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa67fff700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6813a730 0x7faa681552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:17.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa67fff700 1 -- 172.21.15.115:0/1973460537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009370 con 0x7faa6813a350 2023-07-27T14:38:17.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.753+0000 7faa6d79c700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6813a730 0x7faa681552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:17.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.754+0000 7faa67fff700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a350 0x7faa68154970 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7faa54009fd0 tx=0x7faa54017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:17.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.754+0000 7faa64ff9700 1 -- 172.21.15.115:0/1973460537 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5400b8d0 con 0x7faa6813a350 2023-07-27T14:38:17.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.754+0000 7faa64ff9700 1 -- 172.21.15.115:0/1973460537 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5400ba30 con 0x7faa6813a350 2023-07-27T14:38:17.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.754+0000 7faa6f1ff700 1 -- 172.21.15.115:0/1973460537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa680c1d30 con 0x7faa6813a350 2023-07-27T14:38:17.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.754+0000 7faa64ff9700 1 -- 172.21.15.115:0/1973460537 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5401b620 con 0x7faa6813a350 2023-07-27T14:38:17.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.754+0000 7faa6f1ff700 1 -- 172.21.15.115:0/1973460537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa680c13e0 con 0x7faa6813a350 2023-07-27T14:38:17.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.755+0000 7faa527fc700 1 -- 172.21.15.115:0/1973460537 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6806c470 con 0x7faa6813a350 2023-07-27T14:38:17.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.756+0000 7faa64ff9700 1 -- 172.21.15.115:0/1973460537 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7faa54021020 con 0x7faa6813a350 2023-07-27T14:38:17.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.757+0000 7faa64ff9700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faa4c05fac0 0x7faa4c061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:17.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.757+0000 7faa64ff9700 1 -- 172.21.15.115:0/1973460537 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa5407c640 con 0x7faa6813a350 2023-07-27T14:38:17.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.757+0000 7faa6cf9b700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faa4c05fac0 0x7faa4c061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:17.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.758+0000 7faa6cf9b700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faa4c05fac0 0x7faa4c061f80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7faa5c00bb20 tx=0x7faa5c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:17.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.761+0000 7faa64ff9700 1 -- 172.21.15.115:0/1973460537 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa5404cf30 con 0x7faa6813a350 2023-07-27T14:38:18.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.971+0000 7faa527fc700 1 -- 172.21.15.115:0/1973460537 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7faa68066610 con 0x7faa4c05fac0 2023-07-27T14:38:18.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.977+0000 7faa64ff9700 1 -- 172.21.15.115:0/1973460537 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7faa68066610 con 0x7faa4c05fac0 2023-07-27T14:38:18.029 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:18.029 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:18.030 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:18.030 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:18.030 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:18.030 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:18.030 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:18.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:18.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:18.031 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:18.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 -- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faa4c05fac0 msgr2=0x7faa4c061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:18.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faa4c05fac0 0x7faa4c061f80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7faa5c00bb20 tx=0x7faa5c008040).stop 2023-07-27T14:38:18.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 -- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a350 msgr2=0x7faa68154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:18.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a350 0x7faa68154970 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7faa54009fd0 tx=0x7faa54017000).stop 2023-07-27T14:38:18.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 -- 172.21.15.115:0/1973460537 shutdown_connections 2023-07-27T14:38:18.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7faa4c05fac0 0x7faa4c061f80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:18.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa6813a730 0x7faa681552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:18.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7faa680c2fa0 0x7faa681537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:18.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 --2- 172.21.15.115:0/1973460537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6813a350 0x7faa68154970 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:18.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.979+0000 7faa527fc700 1 -- 172.21.15.115:0/1973460537 >> 172.21.15.115:0/1973460537 conn(0x7faa6805e8f0 msgr2=0x7faa680aca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:18.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.980+0000 7faa527fc700 1 -- 172.21.15.115:0/1973460537 shutdown_connections 2023-07-27T14:38:18.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:17.980+0000 7faa527fc700 1 -- 172.21.15.115:0/1973460537 wait complete. 2023-07-27T14:38:19.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:19.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.203+0000 7fa0e2dff700 1 Processor -- start 2023-07-27T14:38:19.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.203+0000 7fa0e2dff700 1 -- start start 2023-07-27T14:38:19.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.204+0000 7fa0e2dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa0dc063260 0x7fa0dc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.204+0000 7fa0e2dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc14b1e0 0x7fa0dc0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.204+0000 7fa0e2dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc1553f0 con 0x7fa0dc14ae00 2023-07-27T14:38:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.204+0000 7fa0e2dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc157a50 con 0x7fa0dc063260 2023-07-27T14:38:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.204+0000 7fa0e2dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc157d10 con 0x7fa0dc14b1e0 2023-07-27T14:38:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0e0b9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa0dc14ae00 0x7fa0dc062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59610/0 (socket says 172.21.15.115:59610) 2023-07-27T14:38:19.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0e0b9b700 1 -- 172.21.15.115:0/3028480496 learned_addr learned my addr 172.21.15.115:0/3028480496 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:19.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559382395 0 0) 0x7fa0dc1553f0 con 0x7fa0dc14ae00 2023-07-27T14:38:19.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0cc0033f0 con 0x7fa0dc14ae00 2023-07-27T14:38:19.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0dbfff700 1 --2- 172.21.15.115:0/3028480496 >> v2:172.21.15.159:3300/0 conn(0x7fa0dc063260 0x7fa0dc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0e139c700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc14b1e0 0x7fa0dc0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 942103630 0 0) 0x7fa0cc0033f0 con 0x7fa0dc14ae00 2023-07-27T14:38:19.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc14b1e0 msgr2=0x7fa0dc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc14b1e0 0x7fa0dc0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 >> v2:172.21.15.159:3300/0 conn(0x7fa0dc063260 msgr2=0x7fa0dc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 --2- 172.21.15.115:0/3028480496 >> v2:172.21.15.159:3300/0 conn(0x7fa0dc063260 0x7fa0dc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc157ff0 con 0x7fa0dc14ae00 2023-07-27T14:38:19.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fa0d0001470 con 0x7fa0dc14ae00 2023-07-27T14:38:19.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 >> v1:172.21.15.115:6789/0 conn(0x7fa0dc14ae00 legacy=0x7fa0dc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:19.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc14b1e0 0x7fa0cc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc003ec0 0x7fa0cc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc004b80 0x7fa0cc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc157a50 con 0x7fa0cc003ec0 2023-07-27T14:38:19.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc157d10 con 0x7fa0cc004b80 2023-07-27T14:38:19.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.205+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc00b990 con 0x7fa0dc14b1e0 2023-07-27T14:38:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0dbfff700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc003ec0 0x7fa0cc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0e0b9b700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc14b1e0 0x7fa0cc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0e139c700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc004b80 0x7fa0cc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0dbfff700 1 -- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc14b1e0 msgr2=0x7fa0cc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0dbfff700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc14b1e0 0x7fa0cc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0dbfff700 1 -- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc004b80 msgr2=0x7fa0cc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:19.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0dbfff700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc004b80 0x7fa0cc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0dbfff700 1 -- 172.21.15.115:0/3028480496 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0033f0 con 0x7fa0cc003ec0 2023-07-27T14:38:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0dbfff700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc003ec0 0x7fa0cc004690 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7fa0c800b9d0 tx=0x7fa0c8008040).ready entity=mon.0 client_cookie=39095ef9484fde6d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800b340 con 0x7fa0cc003ec0 2023-07-27T14:38:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8013480 con 0x7fa0cc003ec0 2023-07-27T14:38:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.206+0000 7fa0db7fe700 1 -- 172.21.15.115:0/3028480496 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8013800 con 0x7fa0cc003ec0 2023-07-27T14:38:19.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.207+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3028480496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc003ec0 msgr2=0x7fa0cc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:19.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.207+0000 7fa0e2dff700 1 --2- 172.21.15.115:0/3028480496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc003ec0 0x7fa0cc004690 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7fa0c800b9d0 tx=0x7fa0c8008040).stop 2023-07-27T14:38:19.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.207+0000 7fa0e139c700 1 -- 172.21.15.115:0/3028480496 reap_dead start 2023-07-27T14:38:19.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.207+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3028480496 shutdown_connections 2023-07-27T14:38:19.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.207+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3028480496 >> 172.21.15.115:0/3028480496 conn(0x7fa0dc05e940 msgr2=0x7fa0dc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.207+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3028480496 shutdown_connections 2023-07-27T14:38:19.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.207+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3028480496 wait complete. 2023-07-27T14:38:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.209+0000 7fa0e2dff700 1 Processor -- start 2023-07-27T14:38:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.209+0000 7fa0e2dff700 1 -- start start 2023-07-27T14:38:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.210+0000 7fa0e2dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc003ec0 0x7fa0dc0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.210+0000 7fa0e2dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc0adb60 0x7fa0dc0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.210+0000 7fa0e2dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0dc0adfe0 0x7fa0dc0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.210+0000 7fa0e2dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0c9de0 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.210+0000 7fa0e2dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0aea20 con 0x7fa0cc003ec0 2023-07-27T14:38:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.210+0000 7fa0e2dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0ae460 con 0x7fa0dc0adb60 2023-07-27T14:38:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0dc0adfe0 0x7fa0dc0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0dc0adfe0 0x7fa0dc0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39528/0 (socket says 172.21.15.115:39528) 2023-07-27T14:38:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 -- 172.21.15.115:0/3596257881 learned_addr learned my addr 172.21.15.115:0/3596257881 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:19.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e0b9b700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc003ec0 0x7fa0dc0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0dbfff700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc0adb60 0x7fa0dc0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 -- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc0adb60 msgr2=0x7fa0dc0c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc0adb60 0x7fa0dc0c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 -- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc003ec0 msgr2=0x7fa0dc0c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc003ec0 0x7fa0dc0c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 -- 172.21.15.115:0/3596257881 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0ae740 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e0b9b700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc003ec0 0x7fa0dc0c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e139c700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0dc0adfe0 0x7fa0dc0c98f0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7fa0dc05fbb0 tx=0x7fa0d4009870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0d8ff9700 1 -- 172.21.15.115:0/3596257881 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4002ce0 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0d8ff9700 1 -- 172.21.15.115:0/3596257881 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d400f030 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc0af650 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.211+0000 7fa0d8ff9700 1 -- 172.21.15.115:0/3596257881 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4015650 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.212+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc0afe50 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.213+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc06c470 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.213+0000 7fa0d8ff9700 1 -- 172.21.15.115:0/3596257881 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fa0d40159c0 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.214+0000 7fa0d8ff9700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa0c005fac0 0x7fa0c0061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.214+0000 7fa0d8ff9700 1 -- 172.21.15.115:0/3596257881 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa0d407b9d0 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.214+0000 7fa0e0b9b700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa0c005fac0 0x7fa0c0061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.215+0000 7fa0e0b9b700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa0c005fac0 0x7fa0c0061f80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fa0d0000f60 tx=0x7fa0d0000cc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:19.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.218+0000 7fa0d8ff9700 1 -- 172.21.15.115:0/3596257881 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa0d404c130 con 0x7fa0dc0adfe0 2023-07-27T14:38:19.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.425+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0dc0acb90 con 0x7fa0c005fac0 2023-07-27T14:38:19.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.431+0000 7fa0d8ff9700 1 -- 172.21.15.115:0/3596257881 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fa0dc0acb90 con 0x7fa0c005fac0 2023-07-27T14:38:19.482 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:19.483 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:19.483 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:19.483 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:19.483 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:19.483 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:19.483 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:19.483 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:19.484 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:19.484 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:19.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa0c005fac0 msgr2=0x7fa0c0061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:19.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa0c005fac0 0x7fa0c0061f80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fa0d0000f60 tx=0x7fa0d0000cc0).stop 2023-07-27T14:38:19.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0dc0adfe0 msgr2=0x7fa0dc0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:19.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0dc0adfe0 0x7fa0dc0c98f0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7fa0dc05fbb0 tx=0x7fa0d4009870).stop 2023-07-27T14:38:19.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 shutdown_connections 2023-07-27T14:38:19.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa0c005fac0 0x7fa0c0061f80 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0dc0adfe0 0x7fa0dc0c98f0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0cc003ec0 0x7fa0dc0c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 --2- 172.21.15.115:0/3596257881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa0dc0adb60 0x7fa0dc0c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:19.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.433+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 >> 172.21.15.115:0/3596257881 conn(0x7fa0dc05e940 msgr2=0x7fa0dc156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:19.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.434+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 shutdown_connections 2023-07-27T14:38:19.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:19.434+0000 7fa0e2dff700 1 -- 172.21.15.115:0/3596257881 wait complete. 2023-07-27T14:38:20.506 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:20.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.656+0000 7fa1afbff700 1 Processor -- start 2023-07-27T14:38:20.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.656+0000 7fa1afbff700 1 -- start start 2023-07-27T14:38:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.657+0000 7fa1afbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.657+0000 7fa1afbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa1a80c36b0 0x7fa1a81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.657+0000 7fa1afbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a80bd9a0 con 0x7fa1a813a350 2023-07-27T14:38:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.657+0000 7fa1afbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a8066400 con 0x7fa1a80c36b0 2023-07-27T14:38:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.657+0000 7fa1afbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8158ae0 con 0x7fa1a813a730 2023-07-27T14:38:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ad99b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa1a813a350 0x7fa1a80c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59624/0 (socket says 172.21.15.115:59624) 2023-07-27T14:38:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ad99b700 1 -- 172.21.15.115:0/3265467715 learned_addr learned my addr 172.21.15.115:0/3265467715 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:20.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ae19c700 1 --2- 172.21.15.115:0/3265467715 >> v2:172.21.15.159:3300/0 conn(0x7fa1a80c36b0 0x7fa1a81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:20.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ad19a700 1 --2- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:20.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ac999700 1 -- 172.21.15.115:0/3265467715 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098525338 0 0) 0x7fa1a80bd9a0 con 0x7fa1a813a350 2023-07-27T14:38:20.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ac999700 1 -- 172.21.15.115:0/3265467715 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1940033f0 con 0x7fa1a813a350 2023-07-27T14:38:20.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ae19c700 1 -- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 msgr2=0x7fa1a8065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:20.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ae19c700 1 --2- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ae19c700 1 -- 172.21.15.115:0/3265467715 >> v1:172.21.15.115:6789/0 conn(0x7fa1a813a350 legacy=0x7fa1a80c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:20.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ac999700 1 -- 172.21.15.115:0/3265467715 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1680925397 0 0) 0x7fa1940033f0 con 0x7fa1a813a350 2023-07-27T14:38:20.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ae19c700 1 -- 172.21.15.115:0/3265467715 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a8066610 con 0x7fa1a80c36b0 2023-07-27T14:38:20.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.658+0000 7fa1ad19a700 1 --2- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:20.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1ae19c700 1 --2- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a80c36b0 0x7fa1a81585f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fa1a0009e60 tx=0x7fa1a0009780).ready entity=mon.1 client_cookie=bae3c8cb959b3bdd server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:20.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1ac999700 1 -- 172.21.15.115:0/3265467715 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000e070 con 0x7fa1a80c36b0 2023-07-27T14:38:20.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1ac999700 1 -- 172.21.15.115:0/3265467715 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a000bab0 con 0x7fa1a80c36b0 2023-07-27T14:38:20.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1ac999700 1 -- 172.21.15.115:0/3265467715 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000be30 con 0x7fa1a80c36b0 2023-07-27T14:38:20.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1afbff700 1 -- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a80c36b0 msgr2=0x7fa1a81585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:20.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1afbff700 1 --2- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a80c36b0 0x7fa1a81585f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fa1a0009e60 tx=0x7fa1a0009780).stop 2023-07-27T14:38:20.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1afbff700 1 -- 172.21.15.115:0/3265467715 shutdown_connections 2023-07-27T14:38:20.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1afbff700 1 --2- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a80c36b0 0x7fa1a81585f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1afbff700 1 --2- 172.21.15.115:0/3265467715 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1afbff700 1 -- 172.21.15.115:0/3265467715 >> 172.21.15.115:0/3265467715 conn(0x7fa1a805e8f0 msgr2=0x7fa1a80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:20.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.659+0000 7fa1afbff700 1 -- 172.21.15.115:0/3265467715 shutdown_connections 2023-07-27T14:38:20.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.660+0000 7fa1afbff700 1 -- 172.21.15.115:0/3265467715 wait complete. 2023-07-27T14:38:20.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.661+0000 7fa1afbff700 1 Processor -- start 2023-07-27T14:38:20.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.661+0000 7fa1afbff700 1 -- start start 2023-07-27T14:38:20.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1afbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1a80c36b0 0x7fa1a80c1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:20.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1afbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a813a350 0x7fa1a80a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:20.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1afbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:20.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1afbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80c1760 con 0x7fa1a80c36b0 2023-07-27T14:38:20.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1afbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80a9b00 con 0x7fa1a813a350 2023-07-27T14:38:20.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1afbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a81556e0 con 0x7fa1a813a730 2023-07-27T14:38:20.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1ad99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1a80c36b0 0x7fa1a80c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1ad99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1a80c36b0 0x7fa1a80c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39544/0 (socket says 172.21.15.115:39544) 2023-07-27T14:38:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1ad99b700 1 -- 172.21.15.115:0/4005510903 learned_addr learned my addr 172.21.15.115:0/4005510903 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1ad19a700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a813a350 0x7fa1a80a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.662+0000 7fa1ae19c700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1ad99b700 1 -- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 msgr2=0x7fa1a8167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1ad99b700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1ad99b700 1 -- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a813a350 msgr2=0x7fa1a80a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:20.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1ad99b700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a813a350 0x7fa1a80a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1ad99b700 1 -- 172.21.15.115:0/4005510903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980092a0 con 0x7fa1a80c36b0 2023-07-27T14:38:20.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1ae19c700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:20.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1ad99b700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1a80c36b0 0x7fa1a80c1270 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7fa1a400c4f0 tx=0x7fa1a4007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:20.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa19dffb700 1 -- 172.21.15.115:0/4005510903 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4007170 con 0x7fa1a80c36b0 2023-07-27T14:38:20.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa19dffb700 1 -- 172.21.15.115:0/4005510903 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a40072f0 con 0x7fa1a80c36b0 2023-07-27T14:38:20.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a0009a20 con 0x7fa1a80c36b0 2023-07-27T14:38:20.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa19dffb700 1 -- 172.21.15.115:0/4005510903 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40048c0 con 0x7fa1a80c36b0 2023-07-27T14:38:20.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.663+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a8155ca0 con 0x7fa1a80c36b0 2023-07-27T14:38:20.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.664+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a8155540 con 0x7fa1a80c36b0 2023-07-27T14:38:20.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.665+0000 7fa19dffb700 1 -- 172.21.15.115:0/4005510903 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fa1a4004c70 con 0x7fa1a80c36b0 2023-07-27T14:38:20.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.666+0000 7fa19dffb700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa18c05fa90 0x7fa18c061f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:20.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.666+0000 7fa19dffb700 1 -- 172.21.15.115:0/4005510903 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa1a407a9d0 con 0x7fa1a80c36b0 2023-07-27T14:38:20.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.666+0000 7fa1ad19a700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa18c05fa90 0x7fa18c061f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:20.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.667+0000 7fa1ad19a700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa18c05fa90 0x7fa18c061f50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fa198009dc0 tx=0x7fa198009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:20.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.670+0000 7fa19dffb700 1 -- 172.21.15.115:0/4005510903 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa1a8155540 con 0x7fa1a80c36b0 2023-07-27T14:38:20.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.880+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1a8155540 con 0x7fa18c05fa90 2023-07-27T14:38:20.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.888+0000 7fa19dffb700 1 -- 172.21.15.115:0/4005510903 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fa1a8155540 con 0x7fa18c05fa90 2023-07-27T14:38:20.939 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:20.939 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:20.939 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:20.940 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:20.940 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:20.940 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:20.940 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:20.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:20.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:20.940 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:20.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa18c05fa90 msgr2=0x7fa18c061f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:20.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa18c05fa90 0x7fa18c061f50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fa198009dc0 tx=0x7fa198009060).stop 2023-07-27T14:38:20.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1a80c36b0 msgr2=0x7fa1a80c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:20.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1a80c36b0 0x7fa1a80c1270 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7fa1a400c4f0 tx=0x7fa1a4007a30).stop 2023-07-27T14:38:20.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 shutdown_connections 2023-07-27T14:38:20.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa18c05fa90 0x7fa18c061f50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa1a813a730 0x7fa1a8167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1a80c36b0 0x7fa1a80c1270 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 --2- 172.21.15.115:0/4005510903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1a813a350 0x7fa1a80a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:20.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 >> 172.21.15.115:0/4005510903 conn(0x7fa1a805e8f0 msgr2=0x7fa1a80c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:20.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 shutdown_connections 2023-07-27T14:38:20.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:20.890+0000 7fa1afbff700 1 -- 172.21.15.115:0/4005510903 wait complete. 2023-07-27T14:38:21.961 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.106+0000 7f6bbf1ff700 1 Processor -- start 2023-07-27T14:38:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.106+0000 7f6bbf1ff700 1 -- start start 2023-07-27T14:38:22.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.107+0000 7f6bbf1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6bb814ae00 0x7f6bb8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:22.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.107+0000 7f6bbf1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:22.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.107+0000 7f6bbf1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb81553f0 con 0x7f6bb814b1e0 2023-07-27T14:38:22.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.107+0000 7f6bbf1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb8157a50 con 0x7f6bb814ae00 2023-07-27T14:38:22.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.107+0000 7f6bbf1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8157d10 con 0x7f6bb8063260 2023-07-27T14:38:22.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.108+0000 7f6bbcf9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6bb814ae00 0x7f6bb8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:22.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.108+0000 7f6bbcf9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6bb814ae00 0x7f6bb8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:35104/0 (socket says 172.21.15.115:35104) 2023-07-27T14:38:22.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.108+0000 7f6bbd79c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:22.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.108+0000 7f6bbcf9b700 1 -- 172.21.15.115:0/635242641 learned_addr learned my addr 172.21.15.115:0/635242641 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:22.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.108+0000 7f6bbd79c700 1 -- 172.21.15.115:0/635242641 >> v2:172.21.15.159:3300/0 conn(0x7f6bb814ae00 msgr2=0x7f6bb8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:22.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.108+0000 7f6bbd79c700 1 --2- 172.21.15.115:0/635242641 >> v2:172.21.15.159:3300/0 conn(0x7f6bb814ae00 0x7f6bb8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.108+0000 7f6bbd79c700 1 -- 172.21.15.115:0/635242641 >> v1:172.21.15.159:6789/0 conn(0x7f6bb814b1e0 legacy=0x7f6bb8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:22.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.108+0000 7f6bbd79c700 1 -- 172.21.15.115:0/635242641 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8157ff0 con 0x7f6bb8063260 2023-07-27T14:38:22.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.109+0000 7f6bbd79c700 1 --2- 172.21.15.115:0/635242641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb80a98c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6bb0009e60 tx=0x7f6bb0009780).ready entity=mon.2 client_cookie=92fcef35eb8829ed server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:22.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.109+0000 7f6bb77fe700 1 -- 172.21.15.115:0/635242641 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000e070 con 0x7f6bb8063260 2023-07-27T14:38:22.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.109+0000 7f6bb77fe700 1 -- 172.21.15.115:0/635242641 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000bb60 con 0x7f6bb8063260 2023-07-27T14:38:22.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.109+0000 7f6bb77fe700 1 -- 172.21.15.115:0/635242641 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0012410 con 0x7f6bb8063260 2023-07-27T14:38:22.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.109+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/635242641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 msgr2=0x7f6bb80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:22.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.109+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/635242641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb80a98c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6bb0009e60 tx=0x7f6bb0009780).stop 2023-07-27T14:38:22.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.110+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/635242641 shutdown_connections 2023-07-27T14:38:22.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.110+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/635242641 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb80a98c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.110+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/635242641 >> v2:172.21.15.159:3300/0 conn(0x7f6bb814ae00 0x7f6bb8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.110+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/635242641 >> 172.21.15.115:0/635242641 conn(0x7f6bb805e940 msgr2=0x7f6bb80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:22.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.110+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/635242641 shutdown_connections 2023-07-27T14:38:22.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.110+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/635242641 wait complete. 2023-07-27T14:38:22.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.111+0000 7f6bbf1ff700 1 Processor -- start 2023-07-27T14:38:22.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.111+0000 7f6bbf1ff700 1 -- start start 2023-07-27T14:38:22.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbf1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb81649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:22.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbf1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb814ae00 0x7f6bb81497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:22.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbf1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb814b1e0 0x7f6bb8165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:22.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbf1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8164fb0 con 0x7f6bb814b1e0 2023-07-27T14:38:22.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbf1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8156050 con 0x7f6bb814ae00 2023-07-27T14:38:22.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbf1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8155720 con 0x7f6bb8063260 2023-07-27T14:38:22.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbd79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb814b1e0 0x7f6bb8165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbcf9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb81649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbd79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb814b1e0 0x7f6bb8165120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39550/0 (socket says 172.21.15.115:39550) 2023-07-27T14:38:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bbd79c700 1 -- 172.21.15.115:0/1388997186 learned_addr learned my addr 172.21.15.115:0/1388997186 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:22.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.112+0000 7f6bb7fff700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb814ae00 0x7f6bb81497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:22.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bbd79c700 1 -- 172.21.15.115:0/1388997186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 msgr2=0x7f6bb81649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:22.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bbd79c700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb81649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bbd79c700 1 -- 172.21.15.115:0/1388997186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb814ae00 msgr2=0x7f6bb81497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bbd79c700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb814ae00 0x7f6bb81497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bbd79c700 1 -- 172.21.15.115:0/1388997186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0009a20 con 0x7f6bb814b1e0 2023-07-27T14:38:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bb7fff700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb814ae00 0x7f6bb81497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:22.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bbd79c700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb814b1e0 0x7f6bb8165120 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f6bb80caac0 tx=0x7f6bb0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bb4ff9700 1 -- 172.21.15.115:0/1388997186 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0012410 con 0x7f6bb814b1e0 2023-07-27T14:38:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bb4ff9700 1 -- 172.21.15.115:0/1388997186 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb001d630 con 0x7f6bb814b1e0 2023-07-27T14:38:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb8155a00 con 0x7f6bb814b1e0 2023-07-27T14:38:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.113+0000 7f6bb4ff9700 1 -- 172.21.15.115:0/1388997186 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb001d9d0 con 0x7f6bb814b1e0 2023-07-27T14:38:22.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.114+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb81591d0 con 0x7f6bb814b1e0 2023-07-27T14:38:22.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.114+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb81561e0 con 0x7f6bb814b1e0 2023-07-27T14:38:22.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.115+0000 7f6bb4ff9700 1 -- 172.21.15.115:0/1388997186 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f6bb0026410 con 0x7f6bb814b1e0 2023-07-27T14:38:22.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.116+0000 7f6bb4ff9700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9c05fac0 0x7f6b9c061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:22.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.116+0000 7f6bb4ff9700 1 -- 172.21.15.115:0/1388997186 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6bb007d1f0 con 0x7f6bb814b1e0 2023-07-27T14:38:22.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.117+0000 7f6bbcf9b700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9c05fac0 0x7f6b9c061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:22.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.117+0000 7f6bbcf9b700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9c05fac0 0x7f6b9c061f80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f6bac006bc0 tx=0x7f6bac0090f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:22.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.120+0000 7f6bb4ff9700 1 -- 172.21.15.115:0/1388997186 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bb004d8f0 con 0x7f6bb814b1e0 2023-07-27T14:38:22.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.334+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bb806c470 con 0x7f6b9c05fac0 2023-07-27T14:38:22.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.341+0000 7f6bb4ff9700 1 -- 172.21.15.115:0/1388997186 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f6bb806c470 con 0x7f6b9c05fac0 2023-07-27T14:38:22.392 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:22.394 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:22.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9c05fac0 msgr2=0x7f6b9c061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:22.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9c05fac0 0x7f6b9c061f80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f6bac006bc0 tx=0x7f6bac0090f0).stop 2023-07-27T14:38:22.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb814b1e0 msgr2=0x7f6bb8165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:22.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb814b1e0 0x7f6bb8165120 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f6bb80caac0 tx=0x7f6bb0009780).stop 2023-07-27T14:38:22.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 shutdown_connections 2023-07-27T14:38:22.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6b9c05fac0 0x7f6b9c061f80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6bb814b1e0 0x7f6bb8165120 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6bb8063260 0x7f6bb81649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 --2- 172.21.15.115:0/1388997186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bb814ae00 0x7f6bb81497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:22.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 >> 172.21.15.115:0/1388997186 conn(0x7f6bb805e940 msgr2=0x7f6bb8152970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:22.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 shutdown_connections 2023-07-27T14:38:22.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:22.343+0000 7f6bbf1ff700 1 -- 172.21.15.115:0/1388997186 wait complete. 2023-07-27T14:38:23.415 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:23.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.566+0000 7fb4769ff700 1 Processor -- start 2023-07-27T14:38:23.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.566+0000 7fb4769ff700 1 -- start start 2023-07-27T14:38:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb4769ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb470063260 0x7fb470154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb4769ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb47014b1e0 0x7fb4700a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb4769ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4701553f0 con 0x7fb47014ae00 2023-07-27T14:38:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb4769ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb470157a50 con 0x7fb470063260 2023-07-27T14:38:23.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb4769ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb470157d10 con 0x7fb47014b1e0 2023-07-27T14:38:23.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb46f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb470063260 0x7fb470154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:23.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb46f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb470063260 0x7fb470154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46148/0 (socket says 172.21.15.115:46148) 2023-07-27T14:38:23.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb46f7fe700 1 -- 172.21.15.115:0/2968837047 learned_addr learned my addr 172.21.15.115:0/2968837047 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:23.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb474f9c700 1 --2- 172.21.15.115:0/2968837047 >> v2:172.21.15.159:3300/0 conn(0x7fb47014b1e0 0x7fb4700a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb46f7fe700 1 -- 172.21.15.115:0/2968837047 >> v2:172.21.15.159:3300/0 conn(0x7fb47014b1e0 msgr2=0x7fb4700a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb46f7fe700 1 --2- 172.21.15.115:0/2968837047 >> v2:172.21.15.159:3300/0 conn(0x7fb47014b1e0 0x7fb4700a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb46f7fe700 1 -- 172.21.15.115:0/2968837047 >> v1:172.21.15.159:6789/0 conn(0x7fb47014ae00 legacy=0x7fb470062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.568+0000 7fb46f7fe700 1 -- 172.21.15.115:0/2968837047 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb470157ff0 con 0x7fb470063260 2023-07-27T14:38:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb46f7fe700 1 --2- 172.21.15.115:0/2968837047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470154f00 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7fb470083430 tx=0x7fb4640090f0).ready entity=mon.0 client_cookie=dd84083b9864890e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:23.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb46effd700 1 -- 172.21.15.115:0/2968837047 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400b5a0 con 0x7fb470063260 2023-07-27T14:38:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb46effd700 1 -- 172.21.15.115:0/2968837047 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400b700 con 0x7fb470063260 2023-07-27T14:38:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb46effd700 1 -- 172.21.15.115:0/2968837047 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400ba80 con 0x7fb470063260 2023-07-27T14:38:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb4769ff700 1 -- 172.21.15.115:0/2968837047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 msgr2=0x7fb470154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb4769ff700 1 --2- 172.21.15.115:0/2968837047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470154f00 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7fb470083430 tx=0x7fb4640090f0).stop 2023-07-27T14:38:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb4769ff700 1 -- 172.21.15.115:0/2968837047 shutdown_connections 2023-07-27T14:38:23.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb4769ff700 1 --2- 172.21.15.115:0/2968837047 >> v2:172.21.15.159:3300/0 conn(0x7fb47014b1e0 0x7fb4700a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb4769ff700 1 --2- 172.21.15.115:0/2968837047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470154f00 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb4769ff700 1 -- 172.21.15.115:0/2968837047 >> 172.21.15.115:0/2968837047 conn(0x7fb47005e940 msgr2=0x7fb4700cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb4769ff700 1 -- 172.21.15.115:0/2968837047 shutdown_connections 2023-07-27T14:38:23.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.569+0000 7fb4769ff700 1 -- 172.21.15.115:0/2968837047 wait complete. 2023-07-27T14:38:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.571+0000 7fb4769ff700 1 Processor -- start 2023-07-27T14:38:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.571+0000 7fb4769ff700 1 -- start start 2023-07-27T14:38:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb4769ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb4769ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47014ae00 0x7fb4700aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:23.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb4769ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47014b1e0 0x7fb4700c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb4769ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4700b00b0 con 0x7fb470063260 2023-07-27T14:38:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb4769ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4700af4a0 con 0x7fb47014ae00 2023-07-27T14:38:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb4769ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4700af780 con 0x7fb47014b1e0 2023-07-27T14:38:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb46ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb46ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46158/0 (socket says 172.21.15.115:46158) 2023-07-27T14:38:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb46ffff700 1 -- 172.21.15.115:0/996186628 learned_addr learned my addr 172.21.15.115:0/996186628 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb46f7fe700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47014ae00 0x7fb4700aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:23.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.572+0000 7fb474f9c700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47014b1e0 0x7fb4700c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb46ffff700 1 -- 172.21.15.115:0/996186628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47014b1e0 msgr2=0x7fb4700c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb46ffff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47014b1e0 0x7fb4700c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb46ffff700 1 -- 172.21.15.115:0/996186628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47014ae00 msgr2=0x7fb4700aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb46ffff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47014ae00 0x7fb4700aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb46ffff700 1 -- 172.21.15.115:0/996186628 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464009370 con 0x7fb470063260 2023-07-27T14:38:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb46ffff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470149510 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fb46000c440 tx=0x7fb460007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:23.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb457fff700 1 -- 172.21.15.115:0/996186628 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460012400 con 0x7fb470063260 2023-07-27T14:38:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb457fff700 1 -- 172.21.15.115:0/996186628 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460012580 con 0x7fb470063260 2023-07-27T14:38:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4700afa60 con 0x7fb470063260 2023-07-27T14:38:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb457fff700 1 -- 172.21.15.115:0/996186628 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460012940 con 0x7fb470063260 2023-07-27T14:38:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.573+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb470149a00 con 0x7fb470063260 2023-07-27T14:38:23.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.574+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47006c470 con 0x7fb470063260 2023-07-27T14:38:23.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.575+0000 7fb457fff700 1 -- 172.21.15.115:0/996186628 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fb460019030 con 0x7fb470063260 2023-07-27T14:38:23.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.576+0000 7fb457fff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb45c05fac0 0x7fb45c061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:23.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.576+0000 7fb457fff700 1 -- 172.21.15.115:0/996186628 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb46007a3b0 con 0x7fb470063260 2023-07-27T14:38:23.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.576+0000 7fb46f7fe700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb45c05fac0 0x7fb45c061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:23.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.577+0000 7fb46f7fe700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb45c05fac0 0x7fb45c061f80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fb470063660 tx=0x7fb464015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:23.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.580+0000 7fb457fff700 1 -- 172.21.15.115:0/996186628 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4600488f0 con 0x7fb470063260 2023-07-27T14:38:23.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.795+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4700ca450 con 0x7fb45c05fac0 2023-07-27T14:38:23.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.802+0000 7fb457fff700 1 -- 172.21.15.115:0/996186628 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fb4700ca450 con 0x7fb45c05fac0 2023-07-27T14:38:23.854 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:23.856 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:23.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb45c05fac0 msgr2=0x7fb45c061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:23.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb45c05fac0 0x7fb45c061f80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fb470063660 tx=0x7fb464015000).stop 2023-07-27T14:38:23.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 msgr2=0x7fb470149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:23.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470149510 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fb46000c440 tx=0x7fb460007de0).stop 2023-07-27T14:38:23.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 shutdown_connections 2023-07-27T14:38:23.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb45c05fac0 0x7fb45c061f80 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb47014b1e0 0x7fb4700c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb470063260 0x7fb470149510 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 --2- 172.21.15.115:0/996186628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb47014ae00 0x7fb4700aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:23.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 >> 172.21.15.115:0/996186628 conn(0x7fb47005e940 msgr2=0x7fb47014a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:23.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 shutdown_connections 2023-07-27T14:38:23.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:23.805+0000 7fb4769ff700 1 -- 172.21.15.115:0/996186628 wait complete. 2023-07-27T14:38:24.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.027+0000 7fe0877ff700 1 Processor -- start 2023-07-27T14:38:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.028+0000 7fe0877ff700 1 -- start start 2023-07-27T14:38:25.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe0877ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe08013a350 0x7fe080065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:25.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe0877ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe08013a730 0x7fe0801585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe0877ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe0800c2fa0 0x7fe0800c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe0877ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe080066400 con 0x7fe0800c2fa0 2023-07-27T14:38:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe0877ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe080158ae0 con 0x7fe08013a730 2023-07-27T14:38:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe0877ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c3920 con 0x7fe08013a350 2023-07-27T14:38:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe085d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe0800c2fa0 0x7fe0800c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe085d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe0800c2fa0 0x7fe0800c3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46172/0 (socket says 172.21.15.115:46172) 2023-07-27T14:38:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.029+0000 7fe085d9c700 1 -- 172.21.15.115:0/3552707042 learned_addr learned my addr 172.21.15.115:0/3552707042 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe084d9a700 1 --2- 172.21.15.115:0/3552707042 >> v2:172.21.15.159:3300/0 conn(0x7fe08013a730 0x7fe0801585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe08559b700 1 --2- 172.21.15.115:0/3552707042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe08013a350 0x7fe080065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:25.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe085d9c700 1 -- 172.21.15.115:0/3552707042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe08013a350 msgr2=0x7fe080065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe085d9c700 1 --2- 172.21.15.115:0/3552707042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe08013a350 0x7fe080065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe085d9c700 1 -- 172.21.15.115:0/3552707042 >> v2:172.21.15.159:3300/0 conn(0x7fe08013a730 msgr2=0x7fe0801585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe085d9c700 1 --2- 172.21.15.115:0/3552707042 >> v2:172.21.15.159:3300/0 conn(0x7fe08013a730 0x7fe0801585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe085d9c700 1 -- 172.21.15.115:0/3552707042 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800bd9a0 con 0x7fe0800c2fa0 2023-07-27T14:38:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe084d9a700 1 --2- 172.21.15.115:0/3552707042 >> v2:172.21.15.159:3300/0 conn(0x7fe08013a730 0x7fe0801585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe08559b700 1 --2- 172.21.15.115:0/3552707042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe08013a350 0x7fe080065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe085d9c700 1 --2- 172.21.15.115:0/3552707042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0800c2fa0 0x7fe0800c3430 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fe080067180 tx=0x7fe078009840).ready entity=mon.0 client_cookie=dc464873a367bff8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe077fff700 1 -- 172.21.15.115:0/3552707042 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800e070 con 0x7fe0800c2fa0 2023-07-27T14:38:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe077fff700 1 -- 172.21.15.115:0/3552707042 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800ba50 con 0x7fe0800c2fa0 2023-07-27T14:38:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.030+0000 7fe077fff700 1 -- 172.21.15.115:0/3552707042 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800bdd0 con 0x7fe0800c2fa0 2023-07-27T14:38:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 -- 172.21.15.115:0/3552707042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0800c2fa0 msgr2=0x7fe0800c3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 --2- 172.21.15.115:0/3552707042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0800c2fa0 0x7fe0800c3430 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fe080067180 tx=0x7fe078009840).stop 2023-07-27T14:38:25.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 -- 172.21.15.115:0/3552707042 shutdown_connections 2023-07-27T14:38:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 --2- 172.21.15.115:0/3552707042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0800c2fa0 0x7fe0800c3430 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 --2- 172.21.15.115:0/3552707042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe08013a350 0x7fe080065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 --2- 172.21.15.115:0/3552707042 >> v2:172.21.15.159:3300/0 conn(0x7fe08013a730 0x7fe0801585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 -- 172.21.15.115:0/3552707042 >> 172.21.15.115:0/3552707042 conn(0x7fe08005e8f0 msgr2=0x7fe0800c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 -- 172.21.15.115:0/3552707042 shutdown_connections 2023-07-27T14:38:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.031+0000 7fe0877ff700 1 -- 172.21.15.115:0/3552707042 wait complete. 2023-07-27T14:38:25.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.032+0000 7fe0877ff700 1 Processor -- start 2023-07-27T14:38:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.032+0000 7fe0877ff700 1 -- start start 2023-07-27T14:38:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.033+0000 7fe0877ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe0800c2fa0 0x7fe0801394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.033+0000 7fe0877ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe08013a350 0x7fe0800c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.033+0000 7fe0877ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08013a730 0x7fe0800bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.033+0000 7fe0877ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c8040 con 0x7fe08013a730 2023-07-27T14:38:25.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.033+0000 7fe0877ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c7430 con 0x7fe08013a350 2023-07-27T14:38:25.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.033+0000 7fe0877ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c7710 con 0x7fe0800c2fa0 2023-07-27T14:38:25.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08013a730 0x7fe0800bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:25.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08013a730 0x7fe0800bfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46182/0 (socket says 172.21.15.115:46182) 2023-07-27T14:38:25.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 -- 172.21.15.115:0/1079749914 learned_addr learned my addr 172.21.15.115:0/1079749914 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:25.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe084d9a700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe08013a350 0x7fe0800c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe08559b700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe0800c2fa0 0x7fe0801394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 -- 172.21.15.115:0/1079749914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe0800c2fa0 msgr2=0x7fe0801394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe0800c2fa0 0x7fe0801394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 -- 172.21.15.115:0/1079749914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe08013a350 msgr2=0x7fe0800c05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe08013a350 0x7fe0800c05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 -- 172.21.15.115:0/1079749914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe078009ae0 con 0x7fe08013a730 2023-07-27T14:38:25.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe085d9c700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08013a730 0x7fe0800bfa40 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7fe078009fd0 tx=0x7fe078009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.034+0000 7fe0757fa700 1 -- 172.21.15.115:0/1079749914 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0780092e0 con 0x7fe08013a730 2023-07-27T14:38:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.035+0000 7fe0757fa700 1 -- 172.21.15.115:0/1079749914 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07801e470 con 0x7fe08013a730 2023-07-27T14:38:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.035+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0800c79f0 con 0x7fe08013a730 2023-07-27T14:38:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.035+0000 7fe0757fa700 1 -- 172.21.15.115:0/1079749914 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07801e7f0 con 0x7fe08013a730 2023-07-27T14:38:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.035+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0801399a0 con 0x7fe08013a730 2023-07-27T14:38:25.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.036+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08006c470 con 0x7fe08013a730 2023-07-27T14:38:25.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.036+0000 7fe0757fa700 1 -- 172.21.15.115:0/1079749914 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fe078025030 con 0x7fe08013a730 2023-07-27T14:38:25.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.037+0000 7fe0757fa700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe06405fac0 0x7fe064061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:25.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.038+0000 7fe0757fa700 1 -- 172.21.15.115:0/1079749914 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe07807c8e0 con 0x7fe08013a730 2023-07-27T14:38:25.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.038+0000 7fe08559b700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe06405fac0 0x7fe064061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:25.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.038+0000 7fe08559b700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe06405fac0 0x7fe064061f80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fe07c00aa70 tx=0x7fe07c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:25.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.041+0000 7fe0757fa700 1 -- 172.21.15.115:0/1079749914 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe07804d0f0 con 0x7fe08013a730 2023-07-27T14:38:25.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.253+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7fe080066610 con 0x7fe06405fac0 2023-07-27T14:38:25.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.261+0000 7fe0757fa700 1 -- 172.21.15.115:0/1079749914 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fe080066610 con 0x7fe06405fac0 2023-07-27T14:38:25.312 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:25.313 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:25.313 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:38:25.313 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:38:25.313 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:38:25.313 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000595276", 2023-07-27T14:38:25.313 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000656954" 2023-07-27T14:38:25.314 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:25.314 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:25.314 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:25.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe06405fac0 msgr2=0x7fe064061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:25.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe06405fac0 0x7fe064061f80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fe07c00aa70 tx=0x7fe07c008040).stop 2023-07-27T14:38:25.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08013a730 msgr2=0x7fe0800bfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:25.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08013a730 0x7fe0800bfa40 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7fe078009fd0 tx=0x7fe078009840).stop 2023-07-27T14:38:25.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 shutdown_connections 2023-07-27T14:38:25.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe06405fac0 0x7fe064061f80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe08013a730 0x7fe0800bfa40 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe0800c2fa0 0x7fe0801394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 --2- 172.21.15.115:0/1079749914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe08013a350 0x7fe0800c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:25.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 >> 172.21.15.115:0/1079749914 conn(0x7fe08005e8f0 msgr2=0x7fe0800abf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:25.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 shutdown_connections 2023-07-27T14:38:25.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:25.263+0000 7fe0877ff700 1 -- 172.21.15.115:0/1079749914 wait complete. 2023-07-27T14:38:26.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000355225 2023-07-27T14:38:26.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.487+0000 7f05a41ff700 1 Processor -- start 2023-07-27T14:38:26.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.487+0000 7f05a41ff700 1 -- start start 2023-07-27T14:38:26.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.488+0000 7f05a41ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f059c065de0 0x7f059c15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:26.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.488+0000 7f05a41ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c064a80 con 0x7f059c0c6b70 2023-07-27T14:38:26.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.488+0000 7f05a41ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c064d60 con 0x7f059c153e00 2023-07-27T14:38:26.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.488+0000 7f05a41ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c062320 con 0x7f059c065de0 2023-07-27T14:38:26.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.488+0000 7f05a179a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f059c0c6b70 0x7f059c0656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57308/0 (socket says 172.21.15.115:57308) 2023-07-27T14:38:26.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.488+0000 7f05a179a700 1 -- 172.21.15.115:0/2099180283 learned_addr learned my addr 172.21.15.115:0/2099180283 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:26.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341574015 0 0) 0x7f059c064a80 con 0x7f059c0c6b70 2023-07-27T14:38:26.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05880033f0 con 0x7f059c0c6b70 2023-07-27T14:38:26.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a279c700 1 --2- 172.21.15.115:0/2099180283 >> v2:172.21.15.159:3300/0 conn(0x7f059c065de0 0x7f059c15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:26.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1815242980 0 0) 0x7f05880033f0 con 0x7f059c0c6b70 2023-07-27T14:38:26.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 >> v2:172.21.15.159:3300/0 conn(0x7f059c065de0 msgr2=0x7f059c15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:26.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 --2- 172.21.15.115:0/2099180283 >> v2:172.21.15.159:3300/0 conn(0x7f059c065de0 0x7f059c15edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:26.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 >> v1:172.21.15.159:6789/0 conn(0x7f059c153e00 legacy=0x7f059c064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:26.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c065040 con 0x7f059c0c6b70 2023-07-27T14:38:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f058c001470 con 0x7f059c0c6b70 2023-07-27T14:38:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 >> v1:172.21.15.115:6789/0 conn(0x7f059c0c6b70 legacy=0x7f059c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880038e0 0x7f0588003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0588004690 0x7f0588004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:26.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588005000 0x7f058800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058800be80 con 0x7f0588004690 2023-07-27T14:38:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058800bff0 con 0x7f0588005000 2023-07-27T14:38:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.489+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058800c1b0 con 0x7f05880038e0 2023-07-27T14:38:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a179a700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0588004690 0x7f0588004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a1f9b700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880038e0 0x7f0588003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a279c700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588005000 0x7f058800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a179a700 1 -- 172.21.15.115:0/2099180283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880038e0 msgr2=0x7f0588003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:26.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a179a700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05880038e0 0x7f0588003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a179a700 1 -- 172.21.15.115:0/2099180283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588005000 msgr2=0x7f058800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a179a700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588005000 0x7f058800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a179a700 1 -- 172.21.15.115:0/2099180283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05880033f0 con 0x7f0588004690 2023-07-27T14:38:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a279c700 1 -- 172.21.15.115:0/2099180283 reap_dead start 2023-07-27T14:38:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a179a700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0588004690 0x7f0588004b10 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f058c00c190 tx=0x7f058c001e50).ready entity=mon.0 client_cookie=be082a879c22b36e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:26.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c007a20 con 0x7f0588004690 2023-07-27T14:38:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00ca40 con 0x7f0588004690 2023-07-27T14:38:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.490+0000 7f05a0f99700 1 -- 172.21.15.115:0/2099180283 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00cdc0 con 0x7f0588004690 2023-07-27T14:38:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.491+0000 7f05a41ff700 1 -- 172.21.15.115:0/2099180283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0588004690 msgr2=0x7f0588004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.491+0000 7f05a41ff700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0588004690 0x7f0588004b10 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f058c00c190 tx=0x7f058c001e50).stop 2023-07-27T14:38:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.491+0000 7f05a41ff700 1 -- 172.21.15.115:0/2099180283 shutdown_connections 2023-07-27T14:38:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.491+0000 7f05a41ff700 1 --2- 172.21.15.115:0/2099180283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0588004690 0x7f0588004b10 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.491+0000 7f05a41ff700 1 -- 172.21.15.115:0/2099180283 >> 172.21.15.115:0/2099180283 conn(0x7f059c0c7b90 msgr2=0x7f059c0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:26.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.491+0000 7f05a41ff700 1 -- 172.21.15.115:0/2099180283 shutdown_connections 2023-07-27T14:38:26.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.491+0000 7f05a41ff700 1 -- 172.21.15.115:0/2099180283 wait complete. 2023-07-27T14:38:26.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.492+0000 7f05a41ff700 1 Processor -- start 2023-07-27T14:38:26.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.493+0000 7f05a41ff700 1 -- start start 2023-07-27T14:38:26.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.493+0000 7f05a41ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588004690 0x7f059c163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:26.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.493+0000 7f05a41ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c1640c0 0x7f059c0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a41ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c0ac9c0 0x7f059c0a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a41ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c164b50 con 0x7f059c1640c0 2023-07-27T14:38:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a41ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c158b80 con 0x7f0588004690 2023-07-27T14:38:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a41ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c092460 con 0x7f059c0ac9c0 2023-07-27T14:38:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c1640c0 0x7f059c0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c1640c0 0x7f059c0ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46198/0 (socket says 172.21.15.115:46198) 2023-07-27T14:38:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 -- 172.21.15.115:0/1701749317 learned_addr learned my addr 172.21.15.115:0/1701749317 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:26.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a1f9b700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588004690 0x7f059c163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a279c700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c0ac9c0 0x7f059c0a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 -- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c0ac9c0 msgr2=0x7f059c0a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c0ac9c0 0x7f059c0a8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 -- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588004690 msgr2=0x7f059c163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588004690 0x7f059c163bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 -- 172.21.15.115:0/1701749317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c164590 con 0x7f059c1640c0 2023-07-27T14:38:26.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a279c700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c0ac9c0 0x7f059c0a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:26.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.494+0000 7f05a179a700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c1640c0 0x7f059c0ac4d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f058c001ed0 tx=0x7f058c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:26.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.495+0000 7f0591ffb700 1 -- 172.21.15.115:0/1701749317 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c0074b0 con 0x7f059c1640c0 2023-07-27T14:38:26.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.495+0000 7f0591ffb700 1 -- 172.21.15.115:0/1701749317 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c007610 con 0x7f059c1640c0 2023-07-27T14:38:26.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.495+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c164870 con 0x7f059c1640c0 2023-07-27T14:38:26.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.495+0000 7f0591ffb700 1 -- 172.21.15.115:0/1701749317 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c0048e0 con 0x7f059c1640c0 2023-07-27T14:38:26.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.495+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c0a76d0 con 0x7f059c1640c0 2023-07-27T14:38:26.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.496+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c0928c0 con 0x7f059c1640c0 2023-07-27T14:38:26.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.497+0000 7f0591ffb700 1 -- 172.21.15.115:0/1701749317 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f058c026070 con 0x7f059c1640c0 2023-07-27T14:38:26.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.497+0000 7f0591ffb700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005fac0 0x7f0580061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:26.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.497+0000 7f0591ffb700 1 -- 172.21.15.115:0/1701749317 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f058c07b610 con 0x7f059c1640c0 2023-07-27T14:38:26.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.498+0000 7f05a1f9b700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005fac0 0x7f0580061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:26.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.498+0000 7f05a1f9b700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005fac0 0x7f0580061f80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f0598000c00 tx=0x7f0598009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:26.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.501+0000 7f0591ffb700 1 -- 172.21.15.115:0/1701749317 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f058c04bd70 con 0x7f059c1640c0 2023-07-27T14:38:26.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:26.712+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f059c065320 con 0x7f058005fac0 2023-07-27T14:38:27.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.161+0000 7f0591ffb700 1 -- 172.21.15.115:0/1701749317 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f059c065320 con 0x7f058005fac0 2023-07-27T14:38:27.213 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:27.213 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:38:27.213 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:38:27.213 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:27.213 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005fac0 msgr2=0x7f0580061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005fac0 0x7f0580061f80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f0598000c00 tx=0x7f0598009040).stop 2023-07-27T14:38:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c1640c0 msgr2=0x7f059c0ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c1640c0 0x7f059c0ac4d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f058c001ed0 tx=0x7f058c015000).stop 2023-07-27T14:38:27.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 shutdown_connections 2023-07-27T14:38:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f058005fac0 0x7f0580061f80 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f059c0ac9c0 0x7f059c0a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0588004690 0x7f059c163bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.163+0000 7f05a41ff700 1 --2- 172.21.15.115:0/1701749317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f059c1640c0 0x7f059c0ac4d0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.164+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 >> 172.21.15.115:0/1701749317 conn(0x7f059c0c7b90 msgr2=0x7f059c152a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.164+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 shutdown_connections 2023-07-27T14:38:27.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.164+0000 7f05a41ff700 1 -- 172.21.15.115:0/1701749317 wait complete. 2023-07-27T14:38:27.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000595276 2023-07-27T14:38:27.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.374+0000 7fc222dff700 1 Processor -- start 2023-07-27T14:38:27.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.375+0000 7fc222dff700 1 -- start start 2023-07-27T14:38:27.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc222dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc21c14ae00 0x7fc21c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc222dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc21c14b1e0 0x7fc21c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc222dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c1553f0 con 0x7fc21c0c5c50 2023-07-27T14:38:27.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc222dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c157a50 con 0x7fc21c14ae00 2023-07-27T14:38:27.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc222dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c157d10 con 0x7fc21c14b1e0 2023-07-27T14:38:27.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc220b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc21c14ae00 0x7fc21c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc220b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc21c14ae00 0x7fc21c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46214/0 (socket says 172.21.15.115:46214) 2023-07-27T14:38:27.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc220b9b700 1 -- 172.21.15.115:0/543083120 learned_addr learned my addr 172.21.15.115:0/543083120 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:27.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.376+0000 7fc21bfff700 1 --2- 172.21.15.115:0/543083120 >> v2:172.21.15.159:3300/0 conn(0x7fc21c14b1e0 0x7fc21c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc220b9b700 1 -- 172.21.15.115:0/543083120 >> v2:172.21.15.159:3300/0 conn(0x7fc21c14b1e0 msgr2=0x7fc21c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:27.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc220b9b700 1 --2- 172.21.15.115:0/543083120 >> v2:172.21.15.159:3300/0 conn(0x7fc21c14b1e0 0x7fc21c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc220b9b700 1 -- 172.21.15.115:0/543083120 >> v1:172.21.15.159:6789/0 conn(0x7fc21c0c5c50 legacy=0x7fc21c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:27.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc220b9b700 1 -- 172.21.15.115:0/543083120 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c157ff0 con 0x7fc21c14ae00 2023-07-27T14:38:27.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc220b9b700 1 --2- 172.21.15.115:0/543083120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c14ae00 0x7fc21c154f00 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7fc21c155580 tx=0x7fc2100090f0).ready entity=mon.0 client_cookie=9b915729579fd99d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:27.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc21b7fe700 1 -- 172.21.15.115:0/543083120 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000b5a0 con 0x7fc21c14ae00 2023-07-27T14:38:27.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc21b7fe700 1 -- 172.21.15.115:0/543083120 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21000b700 con 0x7fc21c14ae00 2023-07-27T14:38:27.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc21b7fe700 1 -- 172.21.15.115:0/543083120 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000ba80 con 0x7fc21c14ae00 2023-07-27T14:38:27.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc222dff700 1 -- 172.21.15.115:0/543083120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c14ae00 msgr2=0x7fc21c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.377+0000 7fc222dff700 1 --2- 172.21.15.115:0/543083120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c14ae00 0x7fc21c154f00 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7fc21c155580 tx=0x7fc2100090f0).stop 2023-07-27T14:38:27.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.378+0000 7fc222dff700 1 -- 172.21.15.115:0/543083120 shutdown_connections 2023-07-27T14:38:27.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.378+0000 7fc222dff700 1 --2- 172.21.15.115:0/543083120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c14ae00 0x7fc21c154f00 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.378+0000 7fc222dff700 1 --2- 172.21.15.115:0/543083120 >> v2:172.21.15.159:3300/0 conn(0x7fc21c14b1e0 0x7fc21c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.378+0000 7fc222dff700 1 -- 172.21.15.115:0/543083120 >> 172.21.15.115:0/543083120 conn(0x7fc21c05e940 msgr2=0x7fc21c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:27.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.378+0000 7fc222dff700 1 -- 172.21.15.115:0/543083120 shutdown_connections 2023-07-27T14:38:27.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.378+0000 7fc222dff700 1 -- 172.21.15.115:0/543083120 wait complete. 2023-07-27T14:38:27.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.379+0000 7fc222dff700 1 Processor -- start 2023-07-27T14:38:27.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.379+0000 7fc222dff700 1 -- start start 2023-07-27T14:38:27.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc222dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c0c5c50 0x7fc21c0af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc222dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c14ae00 0x7fc21c0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc222dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc21c14b1e0 0x7fc21c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc222dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0affa0 con 0x7fc21c0c5c50 2023-07-27T14:38:27.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc222dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0b0280 con 0x7fc21c14ae00 2023-07-27T14:38:27.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc222dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0b0560 con 0x7fc21c14b1e0 2023-07-27T14:38:27.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc220b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c0c5c50 0x7fc21c0af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc220b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c0c5c50 0x7fc21c0af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46228/0 (socket says 172.21.15.115:46228) 2023-07-27T14:38:27.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.380+0000 7fc220b9b700 1 -- 172.21.15.115:0/2765549594 learned_addr learned my addr 172.21.15.115:0/2765549594 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:27.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc21bfff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c14ae00 0x7fc21c0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc22139c700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc21c14b1e0 0x7fc21c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc220b9b700 1 -- 172.21.15.115:0/2765549594 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc21c14b1e0 msgr2=0x7fc21c0c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc220b9b700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc21c14b1e0 0x7fc21c0c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc220b9b700 1 -- 172.21.15.115:0/2765549594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c14ae00 msgr2=0x7fc21c0c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc220b9b700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c14ae00 0x7fc21c0c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc220b9b700 1 -- 172.21.15.115:0/2765549594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009370 con 0x7fc21c0c5c50 2023-07-27T14:38:27.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc220b9b700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c0c5c50 0x7fc21c0af9e0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7fc210006df0 tx=0x7fc210015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:27.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc218ff9700 1 -- 172.21.15.115:0/2765549594 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000b870 con 0x7fc21c0c5c50 2023-07-27T14:38:27.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc218ff9700 1 -- 172.21.15.115:0/2765549594 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21000b9d0 con 0x7fc21c0c5c50 2023-07-27T14:38:27.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0c8a60 con 0x7fc21c0c5c50 2023-07-27T14:38:27.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc218ff9700 1 -- 172.21.15.115:0/2765549594 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100246c0 con 0x7fc21c0c5c50 2023-07-27T14:38:27.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.381+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c0c1ec0 con 0x7fc21c0c5c50 2023-07-27T14:38:27.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.382+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c0c8f60 con 0x7fc21c0c5c50 2023-07-27T14:38:27.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.383+0000 7fc218ff9700 1 -- 172.21.15.115:0/2765549594 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fc21000f070 con 0x7fc21c0c5c50 2023-07-27T14:38:27.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.384+0000 7fc218ff9700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20005fac0 0x7fc200061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.384+0000 7fc218ff9700 1 -- 172.21.15.115:0/2765549594 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc21007ce10 con 0x7fc21c0c5c50 2023-07-27T14:38:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.384+0000 7fc21bfff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20005fac0 0x7fc200061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.385+0000 7fc21bfff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20005fac0 0x7fc200061f80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fc208006fd0 tx=0x7fc208008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:27.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.388+0000 7fc218ff9700 1 -- 172.21.15.115:0/2765549594 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc210080030 con 0x7fc21c0c5c50 2023-07-27T14:38:27.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.593+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000595276", "target": ["mon-mgr", ""]}) v1 -- 0x7fc21c06c470 con 0x7fc20005fac0 2023-07-27T14:38:27.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.602+0000 7fc218ff9700 1 -- 172.21.15.115:0/2765549594 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fc21c06c470 con 0x7fc20005fac0 2023-07-27T14:38:27.654 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280 2023-07-27T14:38:27.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20005fac0 msgr2=0x7fc200061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20005fac0 0x7fc200061f80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fc208006fd0 tx=0x7fc208008040).stop 2023-07-27T14:38:27.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c0c5c50 msgr2=0x7fc21c0af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c0c5c50 0x7fc21c0af9e0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7fc210006df0 tx=0x7fc210015000).stop 2023-07-27T14:38:27.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 shutdown_connections 2023-07-27T14:38:27.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc20005fac0 0x7fc200061f80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc21c14b1e0 0x7fc21c0c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc21c0c5c50 0x7fc21c0af9e0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 --2- 172.21.15.115:0/2765549594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c14ae00 0x7fc21c0c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 >> 172.21.15.115:0/2765549594 conn(0x7fc21c05e940 msgr2=0x7fc21c153170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 shutdown_connections 2023-07-27T14:38:27.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.604+0000 7fc222dff700 1 -- 172.21.15.115:0/2765549594 wait complete. 2023-07-27T14:38:27.672 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000355225 2023-07-27T14:38:27.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.813+0000 7fb23ebff700 1 Processor -- start 2023-07-27T14:38:27.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.813+0000 7fb23ebff700 1 -- start start 2023-07-27T14:38:27.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.814+0000 7fb23ebff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb2381509b0 0x7fb2380c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.814+0000 7fb23ebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 0x7fb238154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.814+0000 7fb23ebff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2380c0ea0 con 0x7fb2380c3100 2023-07-27T14:38:27.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.814+0000 7fb23ebff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb238068e10 con 0x7fb2381509b0 2023-07-27T14:38:27.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.814+0000 7fb23ebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb238155190 con 0x7fb238150d90 2023-07-27T14:38:27.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb23d19c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb2380c3100 0x7fb2380c3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57310/0 (socket says 172.21.15.115:57310) 2023-07-27T14:38:27.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb23d19c700 1 -- 172.21.15.115:0/1785087400 learned_addr learned my addr 172.21.15.115:0/1785087400 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:27.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb237fff700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 0x7fb238154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb23c99b700 1 --2- 172.21.15.115:0/1785087400 >> v2:172.21.15.159:3300/0 conn(0x7fb2381509b0 0x7fb2380c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580824424 0 0) 0x7fb2380c0ea0 con 0x7fb2380c3100 2023-07-27T14:38:27.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2280033f0 con 0x7fb2380c3100 2023-07-27T14:38:27.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158559917 0 0) 0x7fb2280033f0 con 0x7fb2380c3100 2023-07-27T14:38:27.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 msgr2=0x7fb238154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:27.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 0x7fb238154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 >> v2:172.21.15.159:3300/0 conn(0x7fb2381509b0 msgr2=0x7fb2380c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:27.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 --2- 172.21.15.115:0/1785087400 >> v2:172.21.15.159:3300/0 conn(0x7fb2381509b0 0x7fb2380c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238155470 con 0x7fb2380c3100 2023-07-27T14:38:27.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb2300017f0 con 0x7fb2380c3100 2023-07-27T14:38:27.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 >> v1:172.21.15.115:6789/0 conn(0x7fb2380c3100 legacy=0x7fb2380c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.815+0000 7fb2377fe700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2280038e0 0x7fb228003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb2377fe700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb228004690 0x7fb228004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb2377fe700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 0x7fb228005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb238068e10 con 0x7fb2280038e0 2023-07-27T14:38:27.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb238155190 con 0x7fb228004690 2023-07-27T14:38:27.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22800daf0 con 0x7fb238150d90 2023-07-27T14:38:27.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23c99b700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2280038e0 0x7fb228003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb237fff700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb228004690 0x7fb228004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23d19c700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 0x7fb228005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23c99b700 1 -- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 msgr2=0x7fb228005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:27.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23c99b700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 0x7fb228005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23c99b700 1 -- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb228004690 msgr2=0x7fb228004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:27.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23c99b700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb228004690 0x7fb228004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23c99b700 1 -- 172.21.15.115:0/1785087400 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280033f0 con 0x7fb2280038e0 2023-07-27T14:38:27.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23d19c700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb238150d90 0x7fb228005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:27.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.816+0000 7fb23c99b700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2280038e0 0x7fb228003d00 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7fb22c009a80 tx=0x7fb22c009060).ready entity=mon.0 client_cookie=9755ab211557c150 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:27.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c009430 con 0x7fb2280038e0 2023-07-27T14:38:27.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00e640 con 0x7fb2280038e0 2023-07-27T14:38:27.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb2377fe700 1 -- 172.21.15.115:0/1785087400 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00e9c0 con 0x7fb2280038e0 2023-07-27T14:38:27.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb23ebff700 1 -- 172.21.15.115:0/1785087400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2280038e0 msgr2=0x7fb228003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb23ebff700 1 --2- 172.21.15.115:0/1785087400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2280038e0 0x7fb228003d00 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7fb22c009a80 tx=0x7fb22c009060).stop 2023-07-27T14:38:27.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb23d19c700 1 -- 172.21.15.115:0/1785087400 reap_dead start 2023-07-27T14:38:27.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb23ebff700 1 -- 172.21.15.115:0/1785087400 shutdown_connections 2023-07-27T14:38:27.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb23ebff700 1 -- 172.21.15.115:0/1785087400 >> 172.21.15.115:0/1785087400 conn(0x7fb238062320 msgr2=0x7fb238062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:27.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb23ebff700 1 -- 172.21.15.115:0/1785087400 shutdown_connections 2023-07-27T14:38:27.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.817+0000 7fb23ebff700 1 -- 172.21.15.115:0/1785087400 wait complete. 2023-07-27T14:38:27.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.819+0000 7fb23ebff700 1 Processor -- start 2023-07-27T14:38:27.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.819+0000 7fb23ebff700 1 -- start start 2023-07-27T14:38:27.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23ebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2280038e0 0x7fb238154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23ebff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2380a6420 0x7fb238165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23ebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2380a7c20 0x7fb2380a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23ebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb238154750 con 0x7fb2380a7c20 2023-07-27T14:38:27.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23ebff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380a8590 con 0x7fb2380a6420 2023-07-27T14:38:27.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23ebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb238165570 con 0x7fb2280038e0 2023-07-27T14:38:27.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23d19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2380a7c20 0x7fb2380a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23d19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2380a7c20 0x7fb2380a80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46242/0 (socket says 172.21.15.115:46242) 2023-07-27T14:38:27.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23d19c700 1 -- 172.21.15.115:0/3102726573 learned_addr learned my addr 172.21.15.115:0/3102726573 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:27.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb23c99b700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2280038e0 0x7fb238154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.820+0000 7fb237fff700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2380a6420 0x7fb238165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb23d19c700 1 -- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2280038e0 msgr2=0x7fb238154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb23d19c700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2280038e0 0x7fb238154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb23d19c700 1 -- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2380a6420 msgr2=0x7fb238165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:27.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb23d19c700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2380a6420 0x7fb238165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:27.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb23d19c700 1 -- 172.21.15.115:0/3102726573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2380a6920 con 0x7fb2380a7c20 2023-07-27T14:38:27.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb237fff700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2380a6420 0x7fb238165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:27.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb23d19c700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2380a7c20 0x7fb2380a80a0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7fb238062ef0 tx=0x7fb238068d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:27.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb234ff9700 1 -- 172.21.15.115:0/3102726573 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000c7b0 con 0x7fb2380a7c20 2023-07-27T14:38:27.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb234ff9700 1 -- 172.21.15.115:0/3102726573 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23000c930 con 0x7fb2380a7c20 2023-07-27T14:38:27.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2380a6c00 con 0x7fb2380a7c20 2023-07-27T14:38:27.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb234ff9700 1 -- 172.21.15.115:0/3102726573 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000ccf0 con 0x7fb2380a7c20 2023-07-27T14:38:27.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.821+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2380a71c0 con 0x7fb2380a7c20 2023-07-27T14:38:27.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.822+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23806c470 con 0x7fb2380a7c20 2023-07-27T14:38:27.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.823+0000 7fb234ff9700 1 -- 172.21.15.115:0/3102726573 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fb23001d450 con 0x7fb2380a7c20 2023-07-27T14:38:27.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.824+0000 7fb234ff9700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb21c05fac0 0x7fb21c061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:27.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.824+0000 7fb234ff9700 1 -- 172.21.15.115:0/3102726573 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb23007af30 con 0x7fb2380a7c20 2023-07-27T14:38:27.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.824+0000 7fb23c99b700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb21c05fac0 0x7fb21c061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:27.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.825+0000 7fb23c99b700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb21c05fac0 0x7fb21c061f80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fb22c006d50 tx=0x7fb22c01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:27.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:27.828+0000 7fb234ff9700 1 -- 172.21.15.115:0/3102726573 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb23004b630 con 0x7fb2380a7c20 2023-07-27T14:38:28.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.031+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7fb238150200 con 0x7fb21c05fac0 2023-07-27T14:38:28.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.037+0000 7fb234ff9700 1 -- 172.21.15.115:0/3102726573 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7fb238150200 con 0x7fb21c05fac0 2023-07-27T14:38:28.088 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160 2023-07-27T14:38:28.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb21c05fac0 msgr2=0x7fb21c061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:28.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb21c05fac0 0x7fb21c061f80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fb22c006d50 tx=0x7fb22c01a000).stop 2023-07-27T14:38:28.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2380a7c20 msgr2=0x7fb2380a80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:28.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2380a7c20 0x7fb2380a80a0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7fb238062ef0 tx=0x7fb238068d80).stop 2023-07-27T14:38:28.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 shutdown_connections 2023-07-27T14:38:28.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb21c05fac0 0x7fb21c061f80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2380a7c20 0x7fb2380a80a0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb2280038e0 0x7fb238154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 --2- 172.21.15.115:0/3102726573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2380a6420 0x7fb238165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 >> 172.21.15.115:0/3102726573 conn(0x7fb238062320 msgr2=0x7fb2380bc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:28.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 shutdown_connections 2023-07-27T14:38:28.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.039+0000 7fb23ebff700 1 -- 172.21.15.115:0/3102726573 wait complete. 2023-07-27T14:38:28.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.108 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:28.156 INFO:teuthology.orchestra.run.smithi115.stdout:9 2023-07-27T14:38:28.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.156 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160) 2023-07-27T14:38:28.204 INFO:teuthology.orchestra.run.smithi115.stdout:9 2023-07-27T14:38:28.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs clone_0000000000355225 2023-07-27T14:38:28.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.344+0000 7f1df13ff700 1 Processor -- start 2023-07-27T14:38:28.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.344+0000 7f1df13ff700 1 -- start start 2023-07-27T14:38:28.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.345+0000 7f1df13ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1dec14f740 0x7f1dec14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:28.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.345+0000 7f1df13ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec0c38f0 0x7f1dec0a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:28.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.345+0000 7f1df13ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec1530d0 con 0x7f1dec0a5850 2023-07-27T14:38:28.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.345+0000 7f1df13ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dec069f70 con 0x7f1dec14f740 2023-07-27T14:38:28.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.345+0000 7f1df13ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0a61c0 con 0x7f1dec0c38f0 2023-07-27T14:38:28.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.345+0000 7f1dea7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1dec0a5850 0x7f1dec0c31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57324/0 (socket says 172.21.15.115:57324) 2023-07-27T14:38:28.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.345+0000 7f1dea7fc700 1 -- 172.21.15.115:0/1794374270 learned_addr learned my addr 172.21.15.115:0/1794374270 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:28.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1deaffd700 1 --2- 172.21.15.115:0/1794374270 >> v2:172.21.15.159:3300/0 conn(0x7f1dec14f740 0x7f1dec14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:28.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1deb7fe700 1 --2- 172.21.15.115:0/1794374270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec0c38f0 0x7f1dec0a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:28.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1de9ffb700 1 -- 172.21.15.115:0/1794374270 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087241954 0 0) 0x7f1dec1530d0 con 0x7f1dec0a5850 2023-07-27T14:38:28.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1de9ffb700 1 -- 172.21.15.115:0/1794374270 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd40033f0 con 0x7f1dec0a5850 2023-07-27T14:38:28.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1deaffd700 1 -- 172.21.15.115:0/1794374270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec0c38f0 msgr2=0x7f1dec0a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:28.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1deaffd700 1 --2- 172.21.15.115:0/1794374270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec0c38f0 0x7f1dec0a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1deaffd700 1 -- 172.21.15.115:0/1794374270 >> v1:172.21.15.115:6789/0 conn(0x7f1dec0a5850 legacy=0x7f1dec0c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:28.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1deaffd700 1 -- 172.21.15.115:0/1794374270 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec1527a0 con 0x7f1dec14f740 2023-07-27T14:38:28.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.346+0000 7f1deaffd700 1 --2- 172.21.15.115:0/1794374270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec14f740 0x7f1dec14fb20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1ddc009760 tx=0x7f1ddc009060).ready entity=mon.1 client_cookie=ef97a9e1ddc9893a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:28.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1de9ffb700 1 -- 172.21.15.115:0/1794374270 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0090d0 con 0x7f1dec14f740 2023-07-27T14:38:28.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1de9ffb700 1 -- 172.21.15.115:0/1794374270 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00d4a0 con 0x7f1dec14f740 2023-07-27T14:38:28.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1de9ffb700 1 -- 172.21.15.115:0/1794374270 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00d820 con 0x7f1dec14f740 2023-07-27T14:38:28.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1df13ff700 1 -- 172.21.15.115:0/1794374270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec14f740 msgr2=0x7f1dec14fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:28.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1df13ff700 1 --2- 172.21.15.115:0/1794374270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec14f740 0x7f1dec14fb20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1ddc009760 tx=0x7f1ddc009060).stop 2023-07-27T14:38:28.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1df13ff700 1 -- 172.21.15.115:0/1794374270 shutdown_connections 2023-07-27T14:38:28.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1df13ff700 1 --2- 172.21.15.115:0/1794374270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec0c38f0 0x7f1dec0a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1df13ff700 1 --2- 172.21.15.115:0/1794374270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec14f740 0x7f1dec14fb20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1df13ff700 1 -- 172.21.15.115:0/1794374270 >> 172.21.15.115:0/1794374270 conn(0x7f1dec062320 msgr2=0x7f1dec062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:28.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1df13ff700 1 -- 172.21.15.115:0/1794374270 shutdown_connections 2023-07-27T14:38:28.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.347+0000 7f1df13ff700 1 -- 172.21.15.115:0/1794374270 wait complete. 2023-07-27T14:38:28.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.349+0000 7f1df13ff700 1 Processor -- start 2023-07-27T14:38:28.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.349+0000 7f1df13ff700 1 -- start start 2023-07-27T14:38:28.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1df13ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dec0a5850 0x7f1dec0aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:28.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1df13ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec0c38f0 0x7f1dec0abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:28.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1df13ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec14f740 0x7f1dec0a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:28.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1df13ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec14ca60 con 0x7f1dec0a5850 2023-07-27T14:38:28.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1df13ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0aa9d0 con 0x7f1dec0c38f0 2023-07-27T14:38:28.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1df13ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0a9dc0 con 0x7f1dec14f740 2023-07-27T14:38:28.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dec0a5850 0x7f1dec0aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:28.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dec0a5850 0x7f1dec0aae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46256/0 (socket says 172.21.15.115:46256) 2023-07-27T14:38:28.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deaffd700 1 -- 172.21.15.115:0/4006719850 learned_addr learned my addr 172.21.15.115:0/4006719850 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:28.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1dea7fc700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec0c38f0 0x7f1dec0abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:28.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deb7fe700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec14f740 0x7f1dec0a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:28.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deaffd700 1 -- 172.21.15.115:0/4006719850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec14f740 msgr2=0x7f1dec0a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:28.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deaffd700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec14f740 0x7f1dec0a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deaffd700 1 -- 172.21.15.115:0/4006719850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec0c38f0 msgr2=0x7f1dec0abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:28.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deaffd700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec0c38f0 0x7f1dec0abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.350+0000 7f1deaffd700 1 -- 172.21.15.115:0/4006719850 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0092a0 con 0x7f1dec0a5850 2023-07-27T14:38:28.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.351+0000 7f1deaffd700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dec0a5850 0x7f1dec0aae60 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7f1ddc009d50 tx=0x7f1ddc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:28.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.351+0000 7f1dd2ffd700 1 -- 172.21.15.115:0/4006719850 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0127f0 con 0x7f1dec0a5850 2023-07-27T14:38:28.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.351+0000 7f1dd2ffd700 1 -- 172.21.15.115:0/4006719850 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc012950 con 0x7f1dec0a5850 2023-07-27T14:38:28.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.351+0000 7f1dd2ffd700 1 -- 172.21.15.115:0/4006719850 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc012cf0 con 0x7f1dec0a5850 2023-07-27T14:38:28.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.351+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dec0aa0a0 con 0x7f1dec0a5850 2023-07-27T14:38:28.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.351+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec0aa660 con 0x7f1dec0a5850 2023-07-27T14:38:28.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.352+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec0aacb0 con 0x7f1dec0a5850 2023-07-27T14:38:28.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.353+0000 7f1dd2ffd700 1 -- 172.21.15.115:0/4006719850 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f1ddc00f070 con 0x7f1dec0a5850 2023-07-27T14:38:28.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.353+0000 7f1dd2ffd700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1dd805fac0 0x7f1dd8061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:28.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.354+0000 7f1dd2ffd700 1 -- 172.21.15.115:0/4006719850 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ddc07c470 con 0x7f1dec0a5850 2023-07-27T14:38:28.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.354+0000 7f1dea7fc700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1dd805fac0 0x7f1dd8061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:28.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.354+0000 7f1dea7fc700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1dd805fac0 0x7f1dd8061f80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f1dec14d2d0 tx=0x7f1de0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:28.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.358+0000 7f1dd2ffd700 1 -- 172.21.15.115:0/4006719850 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ddc04cce0 con 0x7f1dec0a5850 2023-07-27T14:38:28.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.559+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dec0ab350 con 0x7f1dd805fac0 2023-07-27T14:38:28.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.567+0000 7f1dd2ffd700 1 -- 172.21.15.115:0/4006719850 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+707 (secure 0 0 0) 0x7f1dec0ab350 con 0x7f1dd805fac0 2023-07-27T14:38:28.619 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:28.619 INFO:teuthology.orchestra.run.smithi115.stdout: "atime": "2023-07-27 14:38:03", 2023-07-27T14:38:28.619 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_pcent": "66.67", 2023-07-27T14:38:28.619 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_quota": 12582912, 2023-07-27T14:38:28.620 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_used": 8388608, 2023-07-27T14:38:28.620 INFO:teuthology.orchestra.run.smithi115.stdout: "created_at": "2023-07-27 14:38:05", 2023-07-27T14:38:28.620 INFO:teuthology.orchestra.run.smithi115.stdout: "ctime": "2023-07-27 14:38:25", 2023-07-27T14:38:28.621 INFO:teuthology.orchestra.run.smithi115.stdout: "data_pool": "cephfs_data", 2023-07-27T14:38:28.621 INFO:teuthology.orchestra.run.smithi115.stdout: "features": [ 2023-07-27T14:38:28.621 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-clone", 2023-07-27T14:38:28.621 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-autoprotect", 2023-07-27T14:38:28.622 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-retention" 2023-07-27T14:38:28.622 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:38:28.622 INFO:teuthology.orchestra.run.smithi115.stdout: "gid": 0, 2023-07-27T14:38:28.622 INFO:teuthology.orchestra.run.smithi115.stdout: "mode": 16895, 2023-07-27T14:38:28.623 INFO:teuthology.orchestra.run.smithi115.stdout: "mon_addrs": [ 2023-07-27T14:38:28.623 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.115:6789", 2023-07-27T14:38:28.623 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6789", 2023-07-27T14:38:28.623 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6790" 2023-07-27T14:38:28.624 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:38:28.624 INFO:teuthology.orchestra.run.smithi115.stdout: "mtime": "2023-07-27 14:38:03", 2023-07-27T14:38:28.624 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160", 2023-07-27T14:38:28.625 INFO:teuthology.orchestra.run.smithi115.stdout: "pool_namespace": "", 2023-07-27T14:38:28.625 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete", 2023-07-27T14:38:28.625 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "clone", 2023-07-27T14:38:28.626 INFO:teuthology.orchestra.run.smithi115.stdout: "uid": 0 2023-07-27T14:38:28.626 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:28.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1dd805fac0 msgr2=0x7f1dd8061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:28.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1dd805fac0 0x7f1dd8061f80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f1dec14d2d0 tx=0x7f1de0009040).stop 2023-07-27T14:38:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dec0a5850 msgr2=0x7f1dec0aae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dec0a5850 0x7f1dec0aae60 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7f1ddc009d50 tx=0x7f1ddc016000).stop 2023-07-27T14:38:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 shutdown_connections 2023-07-27T14:38:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1dd805fac0 0x7f1dd8061f80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1dec14f740 0x7f1dec0a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dec0a5850 0x7f1dec0aae60 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 --2- 172.21.15.115:0/4006719850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dec0c38f0 0x7f1dec0abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.569+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 >> 172.21.15.115:0/4006719850 conn(0x7f1dec062320 msgr2=0x7f1dec14d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.570+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 shutdown_connections 2023-07-27T14:38:28.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:28.570+0000 7f1df13ff700 1 -- 172.21.15.115:0/4006719850 wait complete. 2023-07-27T14:38:28.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.638 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:28.685 INFO:teuthology.orchestra.run.smithi115.stderr:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280: ceph.quota.max_bytes: No such attribute 2023-07-27T14:38:28.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:38:28.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.687 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:28.734 INFO:teuthology.orchestra.run.smithi115.stdout:cephfs_data 2023-07-27T14:38:28.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.735 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:28.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.782 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:28.828 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280 2023-07-27T14:38:28.829 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.2 2023-07-27T14:38:28.829 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.5 2023-07-27T14:38:28.829 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.4 2023-07-27T14:38:28.830 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.7 2023-07-27T14:38:28.830 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.6 2023-07-27T14:38:28.830 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.0 2023-07-27T14:38:28.830 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.3 2023-07-27T14:38:28.831 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.1 2023-07-27T14:38:28.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.833 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:28.880 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:38:28.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.882 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/) 2023-07-27T14:38:28.967 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:38:28.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:28.968 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:29.013 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:38:29.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.015 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/) 2023-07-27T14:38:29.101 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:38:29.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.103 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:29.149 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:38:29.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.151 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/) 2023-07-27T14:38:29.196 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:38:29.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.197 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:29.283 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:29.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.284 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/) 2023-07-27T14:38:29.369 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:29.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.372 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.2) 2023-07-27T14:38:29.457 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:29.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.459 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.2) 2023-07-27T14:38:29.506 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:29.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.507 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.2) 2023-07-27T14:38:29.553 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:29.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.555 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.2) 2023-07-27T14:38:29.600 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:29.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.602 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.2) 2023-07-27T14:38:29.648 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:29.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.650 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.2) 2023-07-27T14:38:29.735 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:29.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.737 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.2) 2023-07-27T14:38:29.822 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:29.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.823 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.2) 2023-07-27T14:38:29.909 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:29.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.911 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.5) 2023-07-27T14:38:29.957 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:29.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:29.959 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.5) 2023-07-27T14:38:30.045 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:30.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.046 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.5) 2023-07-27T14:38:30.092 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:30.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.093 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.5) 2023-07-27T14:38:30.179 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:30.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.180 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.5) 2023-07-27T14:38:30.226 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:30.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.228 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.5) 2023-07-27T14:38:30.313 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:30.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.314 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.5) 2023-07-27T14:38:30.399 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:30.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.401 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.5) 2023-07-27T14:38:30.487 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:30.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.488 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.4) 2023-07-27T14:38:30.574 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:30.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.576 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.4) 2023-07-27T14:38:30.622 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:30.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.623 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.4) 2023-07-27T14:38:30.669 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:30.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.670 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.4) 2023-07-27T14:38:30.756 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:30.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.758 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.4) 2023-07-27T14:38:30.803 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:30.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.805 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.4) 2023-07-27T14:38:30.891 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:30.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.892 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.4) 2023-07-27T14:38:30.978 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:30.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:30.979 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.4) 2023-07-27T14:38:31.025 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:31.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.028 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.7) 2023-07-27T14:38:31.074 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:31.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.076 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.7) 2023-07-27T14:38:31.163 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:31.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.164 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.7) 2023-07-27T14:38:31.210 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:31.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.212 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.7) 2023-07-27T14:38:31.297 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:31.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.298 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.7) 2023-07-27T14:38:31.383 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:31.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.385 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.7) 2023-07-27T14:38:31.471 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:31.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.473 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.7) 2023-07-27T14:38:31.558 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:31.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.559 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.7) 2023-07-27T14:38:31.605 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:31.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.607 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.6) 2023-07-27T14:38:31.694 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:31.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.696 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.6) 2023-07-27T14:38:31.714 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:38:31.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:38:31.748 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:31.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.749 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.6) 2023-07-27T14:38:31.834 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:31.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.837 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.6) 2023-07-27T14:38:31.922 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:31.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.923 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.6) 2023-07-27T14:38:31.970 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:31.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:31.972 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.6) 2023-07-27T14:38:32.018 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:32.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.020 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.6) 2023-07-27T14:38:32.105 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:32.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.107 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.6) 2023-07-27T14:38:32.152 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:32.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.154 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.0) 2023-07-27T14:38:32.200 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:32.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.201 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.0) 2023-07-27T14:38:32.248 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:32.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.249 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.0) 2023-07-27T14:38:32.294 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:32.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.296 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.0) 2023-07-27T14:38:32.341 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:32.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.342 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.0) 2023-07-27T14:38:32.388 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:32.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.389 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.0) 2023-07-27T14:38:32.436 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:32.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.438 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.0) 2023-07-27T14:38:32.484 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:32.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.486 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.0) 2023-07-27T14:38:32.572 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:32.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.573 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.3) 2023-07-27T14:38:32.660 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:32.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.663 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.3) 2023-07-27T14:38:32.709 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:32.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.711 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.3) 2023-07-27T14:38:32.756 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:32.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.758 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.3) 2023-07-27T14:38:32.803 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:32.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.805 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.3) 2023-07-27T14:38:32.890 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:32.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.892 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.3) 2023-07-27T14:38:32.978 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:32.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:32.979 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.3) 2023-07-27T14:38:33.064 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:33.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.066 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.3) 2023-07-27T14:38:33.151 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:33.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.153 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.1) 2023-07-27T14:38:33.238 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:33.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.240 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.1) 2023-07-27T14:38:33.287 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:38:33.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.288 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.1) 2023-07-27T14:38:33.334 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:33.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.336 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.1) 2023-07-27T14:38:33.421 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:38:33.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.422 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.1) 2023-07-27T14:38:33.468 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:33.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.469 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.1) 2023-07-27T14:38:33.555 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:38:33.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.557 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000595276/.snap/snapshot_0000000000656954/bb77a20a-c171-4853-a6d5-4af399717280/subvolume_file.1) 2023-07-27T14:38:33.602 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:33.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:33.604 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160/subvolume_file.1) 2023-07-27T14:38:33.650 INFO:teuthology.orchestra.run.smithi115.stdout:1690468683 2023-07-27T14:38:33.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000355225 2023-07-27T14:38:33.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.790+0000 7f70f1fff700 1 Processor -- start 2023-07-27T14:38:33.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.791+0000 7f70f1fff700 1 -- start start 2023-07-27T14:38:33.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70f1fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 0x7f70ec15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:33.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70f1fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec064a80 con 0x7f70ec153e00 2023-07-27T14:38:33.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70f1fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec064d60 con 0x7f70ec0c6b70 2023-07-27T14:38:33.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70f1fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec062320 con 0x7f70ec065de0 2023-07-27T14:38:33.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70eb7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f70ec153e00 0x7f70ec064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53894/0 (socket says 172.21.15.115:53894) 2023-07-27T14:38:33.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70eb7fe700 1 -- 172.21.15.115:0/773031288 learned_addr learned my addr 172.21.15.115:0/773031288 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:33.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70ebfff700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 0x7f70ec15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:33.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039919686 0 0) 0x7f70ec064a80 con 0x7f70ec153e00 2023-07-27T14:38:33.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.792+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d40033f0 con 0x7f70ec153e00 2023-07-27T14:38:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531648484 0 0) 0x7f70ec064d60 con 0x7f70ec0c6b70 2023-07-27T14:38:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec064a80 con 0x7f70ec0c6b70 2023-07-27T14:38:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3731358220 0 0) 0x7f70d40033f0 con 0x7f70ec153e00 2023-07-27T14:38:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 msgr2=0x7f70ec15edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 0x7f70ec15edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 >> v1:172.21.15.159:6789/0 conn(0x7f70ec0c6b70 legacy=0x7f70ec0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec065040 con 0x7f70ec153e00 2023-07-27T14:38:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f70dc001470 con 0x7f70ec153e00 2023-07-27T14:38:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 >> v1:172.21.15.115:6789/0 conn(0x7f70ec153e00 legacy=0x7f70ec064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 0x7f70d4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70d4003fb0 0x7f70d4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d4004b80 0x7f70d4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d400b990 con 0x7f70d4003fb0 2023-07-27T14:38:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d400bad0 con 0x7f70d4004b80 2023-07-27T14:38:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d400bc90 con 0x7f70ec065de0 2023-07-27T14:38:33.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70eaffd700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70d4003fb0 0x7f70d4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:33.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70eb7fe700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 0x7f70d4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:33.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.793+0000 7f70ebfff700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d4004b80 0x7f70d4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:33.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70eaffd700 1 -- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 msgr2=0x7f70d4003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:33.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70eaffd700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 0x7f70d4003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:33.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70eaffd700 1 -- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d4004b80 msgr2=0x7f70d4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:33.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70eaffd700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70d4004b80 0x7f70d4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:33.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70eaffd700 1 -- 172.21.15.115:0/773031288 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d40033f0 con 0x7f70d4003fb0 2023-07-27T14:38:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70eb7fe700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70ec065de0 0x7f70d4003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70eaffd700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70d4003fb0 0x7f70d4004690 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f70e00018d0 tx=0x7f70e0007bb0).ready entity=mon.0 client_cookie=453e4af9e460a63e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007020 con 0x7f70d4003fb0 2023-07-27T14:38:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0007180 con 0x7f70d4003fb0 2023-07-27T14:38:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70ea7fc700 1 -- 172.21.15.115:0/773031288 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007500 con 0x7f70d4003fb0 2023-07-27T14:38:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70f1fff700 1 -- 172.21.15.115:0/773031288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70d4003fb0 msgr2=0x7f70d4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70f1fff700 1 --2- 172.21.15.115:0/773031288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70d4003fb0 0x7f70d4004690 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 rx=0x7f70e00018d0 tx=0x7f70e0007bb0).stop 2023-07-27T14:38:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.794+0000 7f70ebfff700 1 -- 172.21.15.115:0/773031288 reap_dead start 2023-07-27T14:38:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.795+0000 7f70f1fff700 1 -- 172.21.15.115:0/773031288 shutdown_connections 2023-07-27T14:38:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.795+0000 7f70f1fff700 1 -- 172.21.15.115:0/773031288 >> 172.21.15.115:0/773031288 conn(0x7f70ec0c7b90 msgr2=0x7f70ec0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.795+0000 7f70f1fff700 1 -- 172.21.15.115:0/773031288 shutdown_connections 2023-07-27T14:38:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.795+0000 7f70f1fff700 1 -- 172.21.15.115:0/773031288 wait complete. 2023-07-27T14:38:33.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.796+0000 7f70f1fff700 1 Processor -- start 2023-07-27T14:38:33.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.796+0000 7f70f1fff700 1 -- start start 2023-07-27T14:38:33.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.797+0000 7f70f1fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70d4003fb0 0x7f70ec0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:33.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.797+0000 7f70f1fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec151e60 0x7f70ec092b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:33.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.797+0000 7f70f1fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70ec093d00 0x7f70ec094180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:33.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.797+0000 7f70f1fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0a9cd0 con 0x7f70ec151e60 2023-07-27T14:38:33.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.797+0000 7f70f1fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0627f0 con 0x7f70ec093d00 2023-07-27T14:38:33.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.797+0000 7f70f1fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec094670 con 0x7f70d4003fb0 2023-07-27T14:38:33.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.797+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec151e60 0x7f70ec092b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:33.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec151e60 0x7f70ec092b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56470/0 (socket says 172.21.15.115:56470) 2023-07-27T14:38:33.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eaffd700 1 -- 172.21.15.115:0/1316863474 learned_addr learned my addr 172.21.15.115:0/1316863474 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:33.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eb7fe700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70d4003fb0 0x7f70ec0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:33.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70ebfff700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70ec093d00 0x7f70ec094180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:33.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eaffd700 1 -- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70d4003fb0 msgr2=0x7f70ec0a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:33.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eaffd700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70d4003fb0 0x7f70ec0a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:33.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eaffd700 1 -- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70ec093d00 msgr2=0x7f70ec094180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:33.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eaffd700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70ec093d00 0x7f70ec094180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:33.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eaffd700 1 -- 172.21.15.115:0/1316863474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec1522e0 con 0x7f70ec151e60 2023-07-27T14:38:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70ebfff700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70ec093d00 0x7f70ec094180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70eaffd700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec151e60 0x7f70ec092b90 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f70e0006f90 tx=0x7f70e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70d37fe700 1 -- 172.21.15.115:0/1316863474 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007020 con 0x7f70ec151e60 2023-07-27T14:38:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70d37fe700 1 -- 172.21.15.115:0/1316863474 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0012610 con 0x7f70ec151e60 2023-07-27T14:38:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70d37fe700 1 -- 172.21.15.115:0/1316863474 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0012990 con 0x7f70ec151e60 2023-07-27T14:38:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec0a9430 con 0x7f70ec151e60 2023-07-27T14:38:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.798+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec0a99f0 con 0x7f70ec151e60 2023-07-27T14:38:33.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.799+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec0625a0 con 0x7f70ec151e60 2023-07-27T14:38:33.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.800+0000 7f70d37fe700 1 -- 172.21.15.115:0/1316863474 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f70e0024030 con 0x7f70ec151e60 2023-07-27T14:38:33.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.801+0000 7f70d37fe700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f70d805fac0 0x7f70d8061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:33.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.801+0000 7f70d37fe700 1 -- 172.21.15.115:0/1316863474 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f70e007bd10 con 0x7f70ec151e60 2023-07-27T14:38:33.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.801+0000 7f70eb7fe700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f70d805fac0 0x7f70d8061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:33.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.802+0000 7f70eb7fe700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f70d805fac0 0x7f70d8061f80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f70dc001c80 tx=0x7f70dc001df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:33.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:33.806+0000 7f70d37fe700 1 -- 172.21.15.115:0/1316863474 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f70e0081020 con 0x7f70ec151e60 2023-07-27T14:38:34.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.006+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f70ec065320 con 0x7f70d805fac0 2023-07-27T14:38:34.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.012+0000 7f70d37fe700 1 -- 172.21.15.115:0/1316863474 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f70ec065320 con 0x7f70d805fac0 2023-07-27T14:38:34.065 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160 2023-07-27T14:38:34.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f70d805fac0 msgr2=0x7f70d8061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f70d805fac0 0x7f70d8061f80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f70dc001c80 tx=0x7f70dc001df0).stop 2023-07-27T14:38:34.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec151e60 msgr2=0x7f70ec092b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec151e60 0x7f70ec092b90 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f70e0006f90 tx=0x7f70e0016000).stop 2023-07-27T14:38:34.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 shutdown_connections 2023-07-27T14:38:34.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f70d805fac0 0x7f70d8061f80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70ec093d00 0x7f70ec094180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70d4003fb0 0x7f70ec0a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 --2- 172.21.15.115:0/1316863474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ec151e60 0x7f70ec092b90 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.014+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 >> 172.21.15.115:0/1316863474 conn(0x7f70ec0c7b90 msgr2=0x7f70ec06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:34.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.015+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 shutdown_connections 2023-07-27T14:38:34.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.015+0000 7f70f1fff700 1 -- 172.21.15.115:0/1316863474 wait complete. 2023-07-27T14:38:34.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:34.084 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files volumes/_nogroup/subvolume_0000000000595276/bb77a20a-c171-4853-a6d5-4af399717280) 2023-07-27T14:38:34.132 INFO:teuthology.orchestra.run.smithi115.stdout:20 2023-07-27T14:38:34.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:34.133 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files volumes/_nogroup/clone_0000000000355225/c0fd5ee4-89dd-445e-9d73-bfb7be06c160) 2023-07-27T14:38:34.181 INFO:teuthology.orchestra.run.smithi115.stdout:20 2023-07-27T14:38:34.181 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000595276 snapshot_0000000000656954 2023-07-27T14:38:34.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.322+0000 7fe2117ff700 1 Processor -- start 2023-07-27T14:38:34.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.322+0000 7fe2117ff700 1 -- start start 2023-07-27T14:38:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.323+0000 7fe2117ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe20c063260 0x7fe20c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.323+0000 7fe2117ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c1553f0 con 0x7fe20c14ae00 2023-07-27T14:38:34.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.323+0000 7fe2117ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c157a50 con 0x7fe20c14b1e0 2023-07-27T14:38:34.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.323+0000 7fe2117ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c157d10 con 0x7fe20c063260 2023-07-27T14:38:34.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.324+0000 7fe20affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe20c14ae00 0x7fe20c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53902/0 (socket says 172.21.15.115:53902) 2023-07-27T14:38:34.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.324+0000 7fe20a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe20c063260 0x7fe20c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.324+0000 7fe20affd700 1 -- 172.21.15.115:0/1232803472 learned_addr learned my addr 172.21.15.115:0/1232803472 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:34.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.324+0000 7fe20a7fc700 1 -- 172.21.15.115:0/1232803472 >> v1:172.21.15.159:6789/0 conn(0x7fe20c14b1e0 legacy=0x7fe20c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.324+0000 7fe20a7fc700 1 -- 172.21.15.115:0/1232803472 >> v1:172.21.15.115:6789/0 conn(0x7fe20c14ae00 legacy=0x7fe20c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.324+0000 7fe20a7fc700 1 -- 172.21.15.115:0/1232803472 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c157ff0 con 0x7fe20c063260 2023-07-27T14:38:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.324+0000 7fe209ffb700 1 -- 172.21.15.115:0/1232803472 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668919589 0 0) 0x7fe20c1553f0 con 0x7fe20c14ae00 2023-07-27T14:38:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.324+0000 7fe20a7fc700 1 --2- 172.21.15.115:0/1232803472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c154f00 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fe200009760 tx=0x7fe200009060).ready entity=mon.0 client_cookie=bd6e935657617c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe209ffb700 1 -- 172.21.15.115:0/1232803472 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000b580 con 0x7fe20c063260 2023-07-27T14:38:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe209ffb700 1 -- 172.21.15.115:0/1232803472 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20000b6e0 con 0x7fe20c063260 2023-07-27T14:38:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe209ffb700 1 -- 172.21.15.115:0/1232803472 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000ba60 con 0x7fe20c063260 2023-07-27T14:38:34.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe2117ff700 1 -- 172.21.15.115:0/1232803472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 msgr2=0x7fe20c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe2117ff700 1 --2- 172.21.15.115:0/1232803472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c154f00 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fe200009760 tx=0x7fe200009060).stop 2023-07-27T14:38:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe2117ff700 1 -- 172.21.15.115:0/1232803472 shutdown_connections 2023-07-27T14:38:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe2117ff700 1 --2- 172.21.15.115:0/1232803472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c154f00 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe2117ff700 1 -- 172.21.15.115:0/1232803472 >> 172.21.15.115:0/1232803472 conn(0x7fe20c05e940 msgr2=0x7fe20c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe2117ff700 1 -- 172.21.15.115:0/1232803472 shutdown_connections 2023-07-27T14:38:34.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.325+0000 7fe2117ff700 1 -- 172.21.15.115:0/1232803472 wait complete. 2023-07-27T14:38:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.327+0000 7fe2117ff700 1 Processor -- start 2023-07-27T14:38:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.327+0000 7fe2117ff700 1 -- start start 2023-07-27T14:38:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe2117ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c165620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe2117ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe20c14ae00 0x7fe20c149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe2117ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe20c14b1e0 0x7fe20c14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe2117ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0b0330 con 0x7fe20c063260 2023-07-27T14:38:34.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe2117ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c14bd90 con 0x7fe20c14b1e0 2023-07-27T14:38:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe2117ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0b0050 con 0x7fe20c14ae00 2023-07-27T14:38:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c165620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56488/0 (socket says 172.21.15.115:56488) 2023-07-27T14:38:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20affd700 1 -- 172.21.15.115:0/2474985612 learned_addr learned my addr 172.21.15.115:0/2474985612 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20a7fc700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe20c14ae00 0x7fe20c149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20b7fe700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe20c14b1e0 0x7fe20c14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20affd700 1 -- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe20c14ae00 msgr2=0x7fe20c149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20affd700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe20c14ae00 0x7fe20c149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20affd700 1 -- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe20c14b1e0 msgr2=0x7fe20c14d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20affd700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe20c14b1e0 0x7fe20c14d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.328+0000 7fe20affd700 1 -- 172.21.15.115:0/2474985612 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000092a0 con 0x7fe20c063260 2023-07-27T14:38:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.329+0000 7fe20a7fc700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe20c14ae00 0x7fe20c149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.329+0000 7fe20b7fe700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe20c14b1e0 0x7fe20c14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.329+0000 7fe20affd700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c165620 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fe1fc00c4f0 tx=0x7fe1fc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:34.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.329+0000 7fe1f2ffd700 1 -- 172.21.15.115:0/2474985612 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0072e0 con 0x7fe20c063260 2023-07-27T14:38:34.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.329+0000 7fe1f2ffd700 1 -- 172.21.15.115:0/2474985612 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc007440 con 0x7fe20c063260 2023-07-27T14:38:34.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.329+0000 7fe1f2ffd700 1 -- 172.21.15.115:0/2474985612 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0057a0 con 0x7fe20c063260 2023-07-27T14:38:34.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.329+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c14b740 con 0x7fe20c063260 2023-07-27T14:38:34.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.329+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c149bf0 con 0x7fe20c063260 2023-07-27T14:38:34.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.330+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c06c470 con 0x7fe20c063260 2023-07-27T14:38:34.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.331+0000 7fe1f2ffd700 1 -- 172.21.15.115:0/2474985612 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7fe1fc010070 con 0x7fe20c063260 2023-07-27T14:38:34.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.332+0000 7fe1f2ffd700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1f805fac0 0x7fe1f8061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.332+0000 7fe1f2ffd700 1 -- 172.21.15.115:0/2474985612 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe1fc07a740 con 0x7fe20c063260 2023-07-27T14:38:34.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.332+0000 7fe20a7fc700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1f805fac0 0x7fe1f8061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.332+0000 7fe20a7fc700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1f805fac0 0x7fe1f8061f80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fe20c063660 tx=0x7fe200017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:34.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.336+0000 7fe1f2ffd700 1 -- 172.21.15.115:0/2474985612 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1fc04aea0 con 0x7fe20c063260 2023-07-27T14:38:34.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.544+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000595276", "snap_name": "snapshot_0000000000656954", "target": ["mon-mgr", ""]}) v1 -- 0x7fe20c1585a0 con 0x7fe1f805fac0 2023-07-27T14:38:34.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.572+0000 7fe1f2ffd700 1 -- 172.21.15.115:0/2474985612 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe20c1585a0 con 0x7fe1f805fac0 2023-07-27T14:38:34.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1f805fac0 msgr2=0x7fe1f8061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1f805fac0 0x7fe1f8061f80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fe20c063660 tx=0x7fe200017000).stop 2023-07-27T14:38:34.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 msgr2=0x7fe20c165620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c165620 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fe1fc00c4f0 tx=0x7fe1fc007c10).stop 2023-07-27T14:38:34.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 shutdown_connections 2023-07-27T14:38:34.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe1f805fac0 0x7fe1f8061f80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe20c14b1e0 0x7fe20c14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe20c063260 0x7fe20c165620 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 --2- 172.21.15.115:0/2474985612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe20c14ae00 0x7fe20c149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 >> 172.21.15.115:0/2474985612 conn(0x7fe20c05e940 msgr2=0x7fe20c1544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:34.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 shutdown_connections 2023-07-27T14:38:34.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.574+0000 7fe2117ff700 1 -- 172.21.15.115:0/2474985612 wait complete. 2023-07-27T14:38:34.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000595276 2023-07-27T14:38:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.781+0000 7f02b47ff700 1 Processor -- start 2023-07-27T14:38:34.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.782+0000 7f02b47ff700 1 -- start start 2023-07-27T14:38:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b47ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac14ae00 0x7f02ac154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b47ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f02ac063260 0x7f02ac0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b47ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ac1553f0 con 0x7f02ac14b1e0 2023-07-27T14:38:34.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b47ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ac157a50 con 0x7f02ac063260 2023-07-27T14:38:34.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b47ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac157d10 con 0x7f02ac14ae00 2023-07-27T14:38:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b259b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac14ae00 0x7f02ac154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b2d9c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f02ac063260 0x7f02ac0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b259b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac14ae00 0x7f02ac154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:46692/0 (socket says 172.21.15.115:46692) 2023-07-27T14:38:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.783+0000 7f02b259b700 1 -- 172.21.15.115:0/3048335878 learned_addr learned my addr 172.21.15.115:0/3048335878 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.784+0000 7f02b259b700 1 -- 172.21.15.115:0/3048335878 >> v2:172.21.15.159:3300/0 conn(0x7f02ac063260 msgr2=0x7f02ac0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:34.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.784+0000 7f02b259b700 1 --2- 172.21.15.115:0/3048335878 >> v2:172.21.15.159:3300/0 conn(0x7f02ac063260 0x7f02ac0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.784+0000 7f02b259b700 1 -- 172.21.15.115:0/3048335878 >> v1:172.21.15.159:6789/0 conn(0x7f02ac14b1e0 legacy=0x7f02ac062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.784+0000 7f02b259b700 1 -- 172.21.15.115:0/3048335878 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac157ff0 con 0x7f02ac14ae00 2023-07-27T14:38:34.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.784+0000 7f02b259b700 1 --2- 172.21.15.115:0/3048335878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac14ae00 0x7f02ac154f00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f02a8006fd0 tx=0x7f02a80090f0).ready entity=mon.2 client_cookie=7e54f91680084dd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:34.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.784+0000 7f02b1599700 1 -- 172.21.15.115:0/3048335878 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800b580 con 0x7f02ac14ae00 2023-07-27T14:38:34.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.784+0000 7f02b1599700 1 -- 172.21.15.115:0/3048335878 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800b6e0 con 0x7f02ac14ae00 2023-07-27T14:38:34.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.784+0000 7f02b1599700 1 -- 172.21.15.115:0/3048335878 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800ba60 con 0x7f02ac14ae00 2023-07-27T14:38:34.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.785+0000 7f02b47ff700 1 -- 172.21.15.115:0/3048335878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac14ae00 msgr2=0x7f02ac154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.785+0000 7f02b47ff700 1 --2- 172.21.15.115:0/3048335878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac14ae00 0x7f02ac154f00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f02a8006fd0 tx=0x7f02a80090f0).stop 2023-07-27T14:38:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.785+0000 7f02b47ff700 1 -- 172.21.15.115:0/3048335878 shutdown_connections 2023-07-27T14:38:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.785+0000 7f02b47ff700 1 --2- 172.21.15.115:0/3048335878 >> v2:172.21.15.159:3300/0 conn(0x7f02ac063260 0x7f02ac0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.785+0000 7f02b47ff700 1 --2- 172.21.15.115:0/3048335878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac14ae00 0x7f02ac154f00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.785+0000 7f02b47ff700 1 -- 172.21.15.115:0/3048335878 >> 172.21.15.115:0/3048335878 conn(0x7f02ac05e940 msgr2=0x7f02ac0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.785+0000 7f02b47ff700 1 -- 172.21.15.115:0/3048335878 shutdown_connections 2023-07-27T14:38:34.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.785+0000 7f02b47ff700 1 -- 172.21.15.115:0/3048335878 wait complete. 2023-07-27T14:38:34.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.786+0000 7f02b47ff700 1 Processor -- start 2023-07-27T14:38:34.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.787+0000 7f02b47ff700 1 -- start start 2023-07-27T14:38:34.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.787+0000 7f02b47ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac063260 0x7f02ac0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.787+0000 7f02b47ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02ac14ae00 0x7f02ac164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.787+0000 7f02b47ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac14b1e0 0x7f02ac0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.787+0000 7f02b47ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0b0640 con 0x7f02ac14ae00 2023-07-27T14:38:34.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.787+0000 7f02b47ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0c4a60 con 0x7f02ac14b1e0 2023-07-27T14:38:34.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.787+0000 7f02b47ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac164e60 con 0x7f02ac063260 2023-07-27T14:38:34.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02ac14ae00 0x7f02ac164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02ac14ae00 0x7f02ac164970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56498/0 (socket says 172.21.15.115:56498) 2023-07-27T14:38:34.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 -- 172.21.15.115:0/1500696532 learned_addr learned my addr 172.21.15.115:0/1500696532 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:34.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b259b700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac063260 0x7f02ac0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b2d9c700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac14b1e0 0x7f02ac0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 -- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac063260 msgr2=0x7f02ac0c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac063260 0x7f02ac0c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 -- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac14b1e0 msgr2=0x7f02ac0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:34.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac14b1e0 0x7f02ac0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:34.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 -- 172.21.15.115:0/1500696532 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8009370 con 0x7f02ac14ae00 2023-07-27T14:38:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b2d9c700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac14b1e0 0x7f02ac0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.788+0000 7f02b1d9a700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02ac14ae00 0x7f02ac164970 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f029c00c410 tx=0x7f029c007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.789+0000 7f02a27fc700 1 -- 172.21.15.115:0/1500696532 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c012400 con 0x7f02ac14ae00 2023-07-27T14:38:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.789+0000 7f02a27fc700 1 -- 172.21.15.115:0/1500696532 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c012560 con 0x7f02ac14ae00 2023-07-27T14:38:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.789+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac0afa30 con 0x7f02ac14ae00 2023-07-27T14:38:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.789+0000 7f02a27fc700 1 -- 172.21.15.115:0/1500696532 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c012900 con 0x7f02ac14ae00 2023-07-27T14:38:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.789+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac0afff0 con 0x7f02ac14ae00 2023-07-27T14:38:34.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.790+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac06c470 con 0x7f02ac14ae00 2023-07-27T14:38:34.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.791+0000 7f02a27fc700 1 -- 172.21.15.115:0/1500696532 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f029c010070 con 0x7f02ac14ae00 2023-07-27T14:38:34.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.791+0000 7f02a27fc700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f029005fac0 0x7f0290061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:34.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.791+0000 7f02a27fc700 1 -- 172.21.15.115:0/1500696532 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f029c07a280 con 0x7f02ac14ae00 2023-07-27T14:38:34.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.792+0000 7f02b259b700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f029005fac0 0x7f0290061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:34.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.792+0000 7f02b259b700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f029005fac0 0x7f0290061f80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f02a8009130 tx=0x7f02a8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:34.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.795+0000 7f02a27fc700 1 -- 172.21.15.115:0/1500696532 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f029c0478f0 con 0x7f02ac14ae00 2023-07-27T14:38:35.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:34.995+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000595276", "target": ["mon-mgr", ""]}) v1 -- 0x7f02ac152280 con 0x7f029005fac0 2023-07-27T14:38:35.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.011+0000 7f02a27fc700 1 -- 172.21.15.115:0/1500696532 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f02ac152280 con 0x7f029005fac0 2023-07-27T14:38:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f029005fac0 msgr2=0x7f0290061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f029005fac0 0x7f0290061f80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f02a8009130 tx=0x7f02a8017000).stop 2023-07-27T14:38:35.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02ac14ae00 msgr2=0x7f02ac164970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02ac14ae00 0x7f02ac164970 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f029c00c410 tx=0x7f029c007d20).stop 2023-07-27T14:38:35.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 shutdown_connections 2023-07-27T14:38:35.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f029005fac0 0x7f0290061f80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02ac14b1e0 0x7f02ac0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02ac063260 0x7f02ac0c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 --2- 172.21.15.115:0/1500696532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02ac14ae00 0x7f02ac164970 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 >> 172.21.15.115:0/1500696532 conn(0x7f02ac05e940 msgr2=0x7f02ac0c0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:35.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 shutdown_connections 2023-07-27T14:38:35.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.013+0000 7f02b47ff700 1 -- 172.21.15.115:0/1500696532 wait complete. 2023-07-27T14:38:35.070 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.018+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.071 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.018+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.071 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.018+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.071 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.018+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.071 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.018+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.087 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000355225 2023-07-27T14:38:35.089 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.036+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.089 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.036+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.089 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.036+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.090 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.036+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.090 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:38:35.036+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:38:35.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.234+0000 7f2e9f3ff700 1 Processor -- start 2023-07-27T14:38:35.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.234+0000 7f2e9f3ff700 1 -- start start 2023-07-27T14:38:35.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.235+0000 7f2e9f3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e98063260 0x7f2e98154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.235+0000 7f2e9f3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e981553f0 con 0x7f2e9814ae00 2023-07-27T14:38:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.235+0000 7f2e9f3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e98157a50 con 0x7f2e9814b1e0 2023-07-27T14:38:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.235+0000 7f2e9f3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e98157d10 con 0x7f2e98063260 2023-07-27T14:38:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.235+0000 7f2e9c99a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e98063260 0x7f2e98154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e9c99a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e98063260 0x7f2e98154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56548/0 (socket says 172.21.15.115:56548) 2023-07-27T14:38:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e9c99a700 1 -- 172.21.15.115:0/3698843983 learned_addr learned my addr 172.21.15.115:0/3698843983 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:35.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e9d19b700 1 --1- 172.21.15.115:0/3698843983 >> v1:172.21.15.115:6789/0 conn(0x7f2e9814ae00 0x7f2e98062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53904/0 (socket says 172.21.15.115:53904) 2023-07-27T14:38:35.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e9c99a700 1 -- 172.21.15.115:0/3698843983 >> v1:172.21.15.159:6789/0 conn(0x7f2e9814b1e0 legacy=0x7f2e980a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e9c99a700 1 -- 172.21.15.115:0/3698843983 >> v1:172.21.15.115:6789/0 conn(0x7f2e9814ae00 legacy=0x7f2e98062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e9c99a700 1 -- 172.21.15.115:0/3698843983 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98157ff0 con 0x7f2e98063260 2023-07-27T14:38:35.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e8ffff700 1 -- 172.21.15.115:0/3698843983 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808273910 0 0) 0x7f2e981553f0 con 0x7f2e9814ae00 2023-07-27T14:38:35.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e9c99a700 1 --2- 172.21.15.115:0/3698843983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e98154f00 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f2e88006fd0 tx=0x7f2e880090f0).ready entity=mon.0 client_cookie=b49b95d7d2abac2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:35.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e8ffff700 1 -- 172.21.15.115:0/3698843983 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800b600 con 0x7f2e98063260 2023-07-27T14:38:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e8ffff700 1 -- 172.21.15.115:0/3698843983 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8800b760 con 0x7f2e98063260 2023-07-27T14:38:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.236+0000 7f2e8ffff700 1 -- 172.21.15.115:0/3698843983 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800bae0 con 0x7f2e98063260 2023-07-27T14:38:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.237+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/3698843983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 msgr2=0x7f2e98154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.237+0000 7f2e9f3ff700 1 --2- 172.21.15.115:0/3698843983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e98154f00 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f2e88006fd0 tx=0x7f2e880090f0).stop 2023-07-27T14:38:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.237+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/3698843983 shutdown_connections 2023-07-27T14:38:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.237+0000 7f2e9f3ff700 1 --2- 172.21.15.115:0/3698843983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e98154f00 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.237+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/3698843983 >> 172.21.15.115:0/3698843983 conn(0x7f2e9805e940 msgr2=0x7f2e980cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.237+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/3698843983 shutdown_connections 2023-07-27T14:38:35.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.237+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/3698843983 wait complete. 2023-07-27T14:38:35.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.238+0000 7f2e9f3ff700 1 Processor -- start 2023-07-27T14:38:35.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.239+0000 7f2e9f3ff700 1 -- start start 2023-07-27T14:38:35.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.239+0000 7f2e9f3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e980c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:35.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.239+0000 7f2e9f3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e9814ae00 0x7f2e98149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:35.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.239+0000 7f2e9f3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e9814b1e0 0x7f2e981672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:35.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.239+0000 7f2e9f3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9814b9e0 con 0x7f2e98063260 2023-07-27T14:38:35.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.239+0000 7f2e9f3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9814b6b0 con 0x7f2e9814ae00 2023-07-27T14:38:35.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.239+0000 7f2e9f3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98167be0 con 0x7f2e9814b1e0 2023-07-27T14:38:35.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e980c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e980c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56562/0 (socket says 172.21.15.115:56562) 2023-07-27T14:38:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 -- 172.21.15.115:0/2078381458 learned_addr learned my addr 172.21.15.115:0/2078381458 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d99c700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e9814b1e0 0x7f2e981672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 -- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e9814b1e0 msgr2=0x7f2e981672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9c99a700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e9814ae00 0x7f2e98149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e9814b1e0 0x7f2e981672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 -- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e9814ae00 msgr2=0x7f2e98149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e9814ae00 0x7f2e98149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 -- 172.21.15.115:0/2078381458 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009370 con 0x7f2e98063260 2023-07-27T14:38:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9c99a700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e9814ae00 0x7f2e98149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.240+0000 7f2e9d19b700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e980c2480 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f2e9400c4c0 tx=0x7f2e94007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.241+0000 7f2e8d7fa700 1 -- 172.21.15.115:0/2078381458 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940072e0 con 0x7f2e98063260 2023-07-27T14:38:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.241+0000 7f2e8d7fa700 1 -- 172.21.15.115:0/2078381458 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e94007440 con 0x7f2e98063260 2023-07-27T14:38:35.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.241+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e98167ec0 con 0x7f2e98063260 2023-07-27T14:38:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.241+0000 7f2e8d7fa700 1 -- 172.21.15.115:0/2078381458 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94005930 con 0x7f2e98063260 2023-07-27T14:38:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.241+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e98149b80 con 0x7f2e98063260 2023-07-27T14:38:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.242+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9806c470 con 0x7f2e98063260 2023-07-27T14:38:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.242+0000 7f2e8d7fa700 1 -- 172.21.15.115:0/2078381458 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 32) v1 ==== 77122+0+0 (secure 0 0 0) 0x7f2e94010070 con 0x7f2e98063260 2023-07-27T14:38:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.243+0000 7f2e8d7fa700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e7c05fac0 0x7f2e7c061f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.243+0000 7f2e8d7fa700 1 -- 172.21.15.115:0/2078381458 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2e9407a7f0 con 0x7f2e98063260 2023-07-27T14:38:35.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.244+0000 7f2e9c99a700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e7c05fac0 0x7f2e7c061f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:35.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.244+0000 7f2e9c99a700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e7c05fac0 0x7f2e7c061f80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f2e98063660 tx=0x7f2e88017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:35.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.247+0000 7f2e8d7fa700 1 -- 172.21.15.115:0/2078381458 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e9404af50 con 0x7f2e98063260 2023-07-27T14:38:35.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.445+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000355225", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e9814bb20 con 0x7f2e7c05fac0 2023-07-27T14:38:35.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.464+0000 7f2e8d7fa700 1 -- 172.21.15.115:0/2078381458 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2e8800b8d0 con 0x7f2e7c05fac0 2023-07-27T14:38:35.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e7c05fac0 msgr2=0x7f2e7c061f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e7c05fac0 0x7f2e7c061f80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f2e98063660 tx=0x7f2e88017000).stop 2023-07-27T14:38:35.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 msgr2=0x7f2e980c2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:35.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e980c2480 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f2e9400c4c0 tx=0x7f2e94007c10).stop 2023-07-27T14:38:35.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 shutdown_connections 2023-07-27T14:38:35.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2e7c05fac0 0x7f2e7c061f80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2e9814b1e0 0x7f2e981672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e98063260 0x7f2e980c2480 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 --2- 172.21.15.115:0/2078381458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e9814ae00 0x7f2e98149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:35.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 >> 172.21.15.115:0/2078381458 conn(0x7f2e9805e940 msgr2=0x7f2e980c0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:35.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 shutdown_connections 2023-07-27T14:38:35.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:35.466+0000 7f2e9f3ff700 1 -- 172.21.15.115:0/2078381458 wait complete. 2023-07-27T14:38:35.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:35.543 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:38:35.640 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:38:35.642 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:38:35.643 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:38:35.740 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:38:35.844 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:38:35.845 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:38:35.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:35.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:38:35.957 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:38:35.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:35.958 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:38:36.005 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:38:36.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:38:36.006 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:38:36.102 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:38:36.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:38:36.103 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:38:36.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:38:36.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.285+0000 7f98ed9ff700 1 Processor -- start 2023-07-27T14:38:36.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.285+0000 7f98ed9ff700 1 -- start start 2023-07-27T14:38:36.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.286+0000 7f98ed9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f98e8153ec0 0x7f98e80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.286+0000 7f98ed9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e80aa4d0 con 0x7f98e80aa050 2023-07-27T14:38:36.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.286+0000 7f98ed9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e80c05c0 con 0x7f98e80aaa40 2023-07-27T14:38:36.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.286+0000 7f98ed9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e80bfc90 con 0x7f98e8153ec0 2023-07-27T14:38:36.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.286+0000 7f98e67fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f98e80aa050 0x7f98e80640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53906/0 (socket says 172.21.15.115:53906) 2023-07-27T14:38:36.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.286+0000 7f98e67fc700 1 -- 172.21.15.115:0/2073896364 learned_addr learned my addr 172.21.15.115:0/2073896364 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:36.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e6ffd700 1 --2- 172.21.15.115:0/2073896364 >> v2:172.21.15.159:3300/0 conn(0x7f98e8153ec0 0x7f98e80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598443739 0 0) 0x7f98dc001110 con 0x7f98e80aa050 2023-07-27T14:38:36.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d00033f0 con 0x7f98e80aa050 2023-07-27T14:38:36.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097970629 0 0) 0x7f98e80c05c0 con 0x7f98e80aaa40 2023-07-27T14:38:36.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98dc001110 con 0x7f98e80aaa40 2023-07-27T14:38:36.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910256576 0 0) 0x7f98d00033f0 con 0x7f98e80aa050 2023-07-27T14:38:36.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 >> v2:172.21.15.159:3300/0 conn(0x7f98e8153ec0 msgr2=0x7f98e80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:36.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 --2- 172.21.15.115:0/2073896364 >> v2:172.21.15.159:3300/0 conn(0x7f98e8153ec0 0x7f98e80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 >> v1:172.21.15.159:6789/0 conn(0x7f98e80aaa40 legacy=0x7f98e80c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80bff70 con 0x7f98e80aa050 2023-07-27T14:38:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f98dc001600 con 0x7f98e80aa050 2023-07-27T14:38:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 >> v1:172.21.15.115:6789/0 conn(0x7f98e80aa050 legacy=0x7f98e80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98d0003a70 0x7f98d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0004690 0x7f98d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d0005000 0x7f98d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80bfc90 con 0x7f98d0005000 2023-07-27T14:38:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d000bf60 con 0x7f98d0004690 2023-07-27T14:38:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d000c0d0 con 0x7f98d0003a70 2023-07-27T14:38:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e77fe700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d0005000 0x7f98d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.287+0000 7f98e67fc700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0004690 0x7f98d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e6ffd700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98d0003a70 0x7f98d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e77fe700 1 -- 172.21.15.115:0/2073896364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98d0003a70 msgr2=0x7f98d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:36.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e77fe700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98d0003a70 0x7f98d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e77fe700 1 -- 172.21.15.115:0/2073896364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0004690 msgr2=0x7f98d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:36.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e77fe700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0004690 0x7f98d0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e77fe700 1 -- 172.21.15.115:0/2073896364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00033f0 con 0x7f98d0005000 2023-07-27T14:38:36.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e77fe700 1 -- 172.21.15.115:0/2073896364 reap_dead start 2023-07-27T14:38:36.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e77fe700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d0005000 0x7f98d000b8e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f98e0001f60 tx=0x7f98e0007f30).ready entity=mon.0 client_cookie=a40a1d3817e2cfa4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:36.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0003120 con 0x7f98d0005000 2023-07-27T14:38:36.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0006a20 con 0x7f98d0005000 2023-07-27T14:38:36.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.288+0000 7f98e5ffb700 1 -- 172.21.15.115:0/2073896364 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0006dc0 con 0x7f98d0005000 2023-07-27T14:38:36.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.289+0000 7f98ed9ff700 1 -- 172.21.15.115:0/2073896364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d0005000 msgr2=0x7f98d000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.289+0000 7f98ed9ff700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d0005000 0x7f98d000b8e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f98e0001f60 tx=0x7f98e0007f30).stop 2023-07-27T14:38:36.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.289+0000 7f98ed9ff700 1 -- 172.21.15.115:0/2073896364 shutdown_connections 2023-07-27T14:38:36.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.289+0000 7f98ed9ff700 1 --2- 172.21.15.115:0/2073896364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d0005000 0x7f98d000b8e0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.289+0000 7f98ed9ff700 1 -- 172.21.15.115:0/2073896364 >> 172.21.15.115:0/2073896364 conn(0x7f98e80cb610 msgr2=0x7f98e80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:36.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.289+0000 7f98ed9ff700 1 -- 172.21.15.115:0/2073896364 shutdown_connections 2023-07-27T14:38:36.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.289+0000 7f98ed9ff700 1 -- 172.21.15.115:0/2073896364 wait complete. 2023-07-27T14:38:36.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.290+0000 7f98ed9ff700 1 Processor -- start 2023-07-27T14:38:36.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.290+0000 7f98ed9ff700 1 -- start start 2023-07-27T14:38:36.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.291+0000 7f98ed9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0005000 0x7f98e81651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.291+0000 7f98ed9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98e80a18d0 0x7f98e8141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.291+0000 7f98ed9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98e80c3d80 0x7f98e80c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.291+0000 7f98ed9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e81660e0 con 0x7f98e80a18d0 2023-07-27T14:38:36.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.291+0000 7f98ed9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e814eaf0 con 0x7f98d0005000 2023-07-27T14:38:36.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.291+0000 7f98ed9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80c46d0 con 0x7f98e80c3d80 2023-07-27T14:38:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98e80a18d0 0x7f98e8141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98e80a18d0 0x7f98e8141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56582/0 (socket says 172.21.15.115:56582) 2023-07-27T14:38:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 -- 172.21.15.115:0/112768538 learned_addr learned my addr 172.21.15.115:0/112768538 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e6ffd700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0005000 0x7f98e81651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e77fe700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98e80c3d80 0x7f98e80c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 -- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98e80c3d80 msgr2=0x7f98e80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98e80c3d80 0x7f98e80c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 -- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0005000 msgr2=0x7f98e81651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0005000 0x7f98e81651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 -- 172.21.15.115:0/112768538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e81656e0 con 0x7f98e80a18d0 2023-07-27T14:38:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e6ffd700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0005000 0x7f98e81651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98e67fc700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98e80a18d0 0x7f98e8141f60 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f98dc001d50 tx=0x7f98e80c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98ceffd700 1 -- 172.21.15.115:0/112768538 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc004e20 con 0x7f98e80a18d0 2023-07-27T14:38:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98ceffd700 1 -- 172.21.15.115:0/112768538 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc00f870 con 0x7f98e80a18d0 2023-07-27T14:38:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e80a1d70 con 0x7f98e80a18d0 2023-07-27T14:38:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.292+0000 7f98ceffd700 1 -- 172.21.15.115:0/112768538 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00fbf0 con 0x7f98e80a18d0 2023-07-27T14:38:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.293+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e8165d70 con 0x7f98e80a18d0 2023-07-27T14:38:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.293+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e806c470 con 0x7f98e80a18d0 2023-07-27T14:38:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.294+0000 7f98ceffd700 1 -- 172.21.15.115:0/112768538 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f98dc01c360 con 0x7f98e80a18d0 2023-07-27T14:38:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.295+0000 7f98ceffd700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f98d405fb50 0x7f98d4062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.296+0000 7f98ceffd700 1 -- 172.21.15.115:0/112768538 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f98dc07a850 con 0x7f98e80a18d0 2023-07-27T14:38:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.296+0000 7f98e6ffd700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f98d405fb50 0x7f98d4062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.296+0000 7f98e6ffd700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f98d405fb50 0x7f98d4062010 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f98d8006d80 tx=0x7f98d8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:36.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.299+0000 7f98ceffd700 1 -- 172.21.15.115:0/112768538 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f98dc04aec0 con 0x7f98e80a18d0 2023-07-27T14:38:36.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.507+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98e80aa4d0 con 0x7f98e80a18d0 2023-07-27T14:38:36.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.508+0000 7f98ceffd700 1 -- 172.21.15.115:0/112768538 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f98e80aa4d0 con 0x7f98e80a18d0 2023-07-27T14:38:36.560 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:36.561 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":94,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3836371},{"type":"v1","addr":"172.21.15.159:6833","nonce":3836371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1315171707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1315171707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1315171707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1825044502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1825044502},{"type":"v1","addr":"172.21.15.159:6835","nonce":1825044502}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:37:52.356956+0000","modified":"2023-07-27T14:37:55.374238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9222":{"gid":9222,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/991393631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":991393631},{"type":"v1","addr":"172.21.15.115:6836","nonce":991393631}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-07-27T14:38:36.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f98d405fb50 msgr2=0x7f98d4062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f98d405fb50 0x7f98d4062010 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f98d8006d80 tx=0x7f98d8008040).stop 2023-07-27T14:38:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98e80a18d0 msgr2=0x7f98e8141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98e80a18d0 0x7f98e8141f60 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f98dc001d50 tx=0x7f98e80c0530).stop 2023-07-27T14:38:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 shutdown_connections 2023-07-27T14:38:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f98d405fb50 0x7f98d4062010 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98e80c3d80 0x7f98e80c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98d0005000 0x7f98e81651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 --2- 172.21.15.115:0/112768538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98e80a18d0 0x7f98e8141f60 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 >> 172.21.15.115:0/112768538 conn(0x7f98e80cb610 msgr2=0x7f98e80ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:36.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 shutdown_connections 2023-07-27T14:38:36.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.510+0000 7f98ed9ff700 1 -- 172.21.15.115:0/112768538 wait complete. 2023-07-27T14:38:36.564 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 94 2023-07-27T14:38:36.580 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:38:36.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.718+0000 7f26ac5ff700 1 Processor -- start 2023-07-27T14:38:36.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.718+0000 7f26ac5ff700 1 -- start start 2023-07-27T14:38:36.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26ac5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f26a40aaa40 0x7f26a40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26ac5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a41542a0 0x7f26a40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26ac5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a40aa4d0 con 0x7f26a4153ec0 2023-07-27T14:38:36.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26ac5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a4064ad0 con 0x7f26a40aaa40 2023-07-27T14:38:36.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26ac5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40c05c0 con 0x7f26a41542a0 2023-07-27T14:38:36.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26a9b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f26a40aaa40 0x7f26a40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26a9b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f26a40aaa40 0x7f26a40640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56596/0 (socket says 172.21.15.115:56596) 2023-07-27T14:38:36.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26a9b9a700 1 -- 172.21.15.115:0/3177979348 learned_addr learned my addr 172.21.15.115:0/3177979348 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:36.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.719+0000 7f26aa39b700 1 --1- 172.21.15.115:0/3177979348 >> v1:172.21.15.115:6789/0 conn(0x7f26a4153ec0 0x7f26a40a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53910/0 (socket says 172.21.15.115:53910) 2023-07-27T14:38:36.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26aab9c700 1 --2- 172.21.15.115:0/3177979348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a41542a0 0x7f26a40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9b9a700 1 -- 172.21.15.115:0/3177979348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a41542a0 msgr2=0x7f26a40645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:36.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9b9a700 1 --2- 172.21.15.115:0/3177979348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a41542a0 0x7f26a40645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9b9a700 1 -- 172.21.15.115:0/3177979348 >> v1:172.21.15.115:6789/0 conn(0x7f26a4153ec0 legacy=0x7f26a40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9b9a700 1 -- 172.21.15.115:0/3177979348 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a40c1a60 con 0x7f26a40aaa40 2023-07-27T14:38:36.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9399700 1 -- 172.21.15.115:0/3177979348 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684028008 0 0) 0x7f26a0001110 con 0x7f26a4153ec0 2023-07-27T14:38:36.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9b9a700 1 --2- 172.21.15.115:0/3177979348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a40aaa40 0x7f26a40640f0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f2694006fd0 tx=0x7f26940090f0).ready entity=mon.0 client_cookie=e51ddc8e02822833 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:36.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9399700 1 -- 172.21.15.115:0/3177979348 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400b580 con 0x7f26a40aaa40 2023-07-27T14:38:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9399700 1 -- 172.21.15.115:0/3177979348 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400b6e0 con 0x7f26a40aaa40 2023-07-27T14:38:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.720+0000 7f26a9399700 1 -- 172.21.15.115:0/3177979348 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400ba60 con 0x7f26a40aaa40 2023-07-27T14:38:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.721+0000 7f26ac5ff700 1 -- 172.21.15.115:0/3177979348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a40aaa40 msgr2=0x7f26a40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.721+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/3177979348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a40aaa40 0x7f26a40640f0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f2694006fd0 tx=0x7f26940090f0).stop 2023-07-27T14:38:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.721+0000 7f26ac5ff700 1 -- 172.21.15.115:0/3177979348 shutdown_connections 2023-07-27T14:38:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.721+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/3177979348 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a41542a0 0x7f26a40645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.721+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/3177979348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a40aaa40 0x7f26a40640f0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.721+0000 7f26ac5ff700 1 -- 172.21.15.115:0/3177979348 >> 172.21.15.115:0/3177979348 conn(0x7f26a40cb610 msgr2=0x7f26a40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:36.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.721+0000 7f26ac5ff700 1 -- 172.21.15.115:0/3177979348 shutdown_connections 2023-07-27T14:38:36.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.721+0000 7f26ac5ff700 1 -- 172.21.15.115:0/3177979348 wait complete. 2023-07-27T14:38:36.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.723+0000 7f26ac5ff700 1 Processor -- start 2023-07-27T14:38:36.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.723+0000 7f26ac5ff700 1 -- start start 2023-07-27T14:38:36.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26ac5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40aaa40 0x7f26a41572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26ac5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a4153ec0 0x7f26a4159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26ac5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a41542a0 0x7f26a4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26ac5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40c4cd0 con 0x7f26a41542a0 2023-07-27T14:38:36.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26ac5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40c4110 con 0x7f26a40aaa40 2023-07-27T14:38:36.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26ac5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40c43a0 con 0x7f26a4153ec0 2023-07-27T14:38:36.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aab9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a41542a0 0x7f26a4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aab9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a41542a0 0x7f26a4157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56608/0 (socket says 172.21.15.115:56608) 2023-07-27T14:38:36.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aab9c700 1 -- 172.21.15.115:0/1424836035 learned_addr learned my addr 172.21.15.115:0/1424836035 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:36.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aa39b700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40aaa40 0x7f26a41572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26a9b9a700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a4153ec0 0x7f26a4159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aab9c700 1 -- 172.21.15.115:0/1424836035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a4153ec0 msgr2=0x7f26a4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aab9c700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a4153ec0 0x7f26a4159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aab9c700 1 -- 172.21.15.115:0/1424836035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40aaa40 msgr2=0x7f26a41572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aab9c700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40aaa40 0x7f26a41572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.724+0000 7f26aab9c700 1 -- 172.21.15.115:0/1424836035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694009370 con 0x7f26a41542a0 2023-07-27T14:38:36.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.725+0000 7f26aab9c700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a41542a0 0x7f26a4157810 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f269c009d40 tx=0x7f269c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:36.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.725+0000 7f269a7fc700 1 -- 172.21.15.115:0/1424836035 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00cb50 con 0x7f26a41542a0 2023-07-27T14:38:36.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.725+0000 7f269a7fc700 1 -- 172.21.15.115:0/1424836035 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c00f040 con 0x7f26a41542a0 2023-07-27T14:38:36.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.725+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a40c4680 con 0x7f26a41542a0 2023-07-27T14:38:36.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.725+0000 7f269a7fc700 1 -- 172.21.15.115:0/1424836035 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c013400 con 0x7f26a41542a0 2023-07-27T14:38:36.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.725+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a4159b20 con 0x7f26a41542a0 2023-07-27T14:38:36.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.726+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a40c4e40 con 0x7f26a41542a0 2023-07-27T14:38:36.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.727+0000 7f269a7fc700 1 -- 172.21.15.115:0/1424836035 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f269c013770 con 0x7f26a41542a0 2023-07-27T14:38:36.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.727+0000 7f269a7fc700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268805fb50 0x7f2688062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:36.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.728+0000 7f269a7fc700 1 -- 172.21.15.115:0/1424836035 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f269c07bb10 con 0x7f26a41542a0 2023-07-27T14:38:36.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.728+0000 7f26aa39b700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268805fb50 0x7f2688062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:36.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.728+0000 7f26aa39b700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268805fb50 0x7f2688062010 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f26a0007d50 tx=0x7f26a0007180).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:36.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.732+0000 7f269a7fc700 1 -- 172.21.15.115:0/1424836035 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f269c04c1e0 con 0x7f26a41542a0 2023-07-27T14:38:36.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.903+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26a40c8230 con 0x7f26a41542a0 2023-07-27T14:38:36.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.904+0000 7f269a7fc700 1 -- 172.21.15.115:0/1424836035 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17086 (secure 0 0 0) 0x7f269c04f800 con 0x7f26a41542a0 2023-07-27T14:38:36.957 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:36.957 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":174,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:37:53.359401+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:37:50.684543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-27T14:37:51.340294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:38:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268805fb50 msgr2=0x7f2688062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268805fb50 0x7f2688062010 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f26a0007d50 tx=0x7f26a0007180).stop 2023-07-27T14:38:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a41542a0 msgr2=0x7f26a4157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a41542a0 0x7f26a4157810 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f269c009d40 tx=0x7f269c00b040).stop 2023-07-27T14:38:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 shutdown_connections 2023-07-27T14:38:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f268805fb50 0x7f2688062010 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a41542a0 0x7f26a4157810 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26a40aaa40 0x7f26a41572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 --2- 172.21.15.115:0/1424836035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26a4153ec0 0x7f26a4159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 >> 172.21.15.115:0/1424836035 conn(0x7f26a40cb610 msgr2=0x7f26a40ab540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 shutdown_connections 2023-07-27T14:38:36.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:36.906+0000 7f26ac5ff700 1 -- 172.21.15.115:0/1424836035 wait complete. 2023-07-27T14:38:36.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:37:50.684543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:37:51.340294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:38:36.977 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:38:37.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.115+0000 7f4ef2fff700 1 Processor -- start 2023-07-27T14:38:37.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.115+0000 7f4ef2fff700 1 -- start start 2023-07-27T14:38:37.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.116+0000 7f4ef2fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4eec153e00 0x7f4eec0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.116+0000 7f4ef2fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec065de0 0x7f4eec062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.116+0000 7f4ef2fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec064a80 con 0x7f4eec064230 2023-07-27T14:38:37.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.116+0000 7f4ef2fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec062320 con 0x7f4eec153e00 2023-07-27T14:38:37.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.116+0000 7f4ef2fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec064d60 con 0x7f4eec065de0 2023-07-27T14:38:37.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef0d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4eec153e00 0x7f4eec0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef0d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4eec153e00 0x7f4eec0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56620/0 (socket says 172.21.15.115:56620) 2023-07-27T14:38:37.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef0d9b700 1 -- 172.21.15.115:0/3623243891 learned_addr learned my addr 172.21.15.115:0/3623243891 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:37.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef159c700 1 --2- 172.21.15.115:0/3623243891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec065de0 0x7f4eec062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef0d9b700 1 -- 172.21.15.115:0/3623243891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec065de0 msgr2=0x7f4eec062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:37.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef0d9b700 1 --2- 172.21.15.115:0/3623243891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec065de0 0x7f4eec062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef0d9b700 1 -- 172.21.15.115:0/3623243891 >> v1:172.21.15.159:6789/0 conn(0x7f4eec064230 legacy=0x7f4eec0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef0d9b700 1 -- 172.21.15.115:0/3623243891 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec065040 con 0x7f4eec153e00 2023-07-27T14:38:37.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.117+0000 7f4ef0d9b700 1 --2- 172.21.15.115:0/3623243891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec0c6b70 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f4ee0006fd0 tx=0x7f4ee00090f0).ready entity=mon.0 client_cookie=17321dc4d9b8c364 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:37.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4eeb7fe700 1 -- 172.21.15.115:0/3623243891 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000b600 con 0x7f4eec153e00 2023-07-27T14:38:37.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4eeb7fe700 1 -- 172.21.15.115:0/3623243891 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee000b760 con 0x7f4eec153e00 2023-07-27T14:38:37.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4eeb7fe700 1 -- 172.21.15.115:0/3623243891 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000bae0 con 0x7f4eec153e00 2023-07-27T14:38:37.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4ef2fff700 1 -- 172.21.15.115:0/3623243891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 msgr2=0x7f4eec0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/3623243891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec0c6b70 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f4ee0006fd0 tx=0x7f4ee00090f0).stop 2023-07-27T14:38:37.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4ef2fff700 1 -- 172.21.15.115:0/3623243891 shutdown_connections 2023-07-27T14:38:37.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/3623243891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec065de0 0x7f4eec062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/3623243891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec0c6b70 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4ef2fff700 1 -- 172.21.15.115:0/3623243891 >> 172.21.15.115:0/3623243891 conn(0x7f4eec0c7b90 msgr2=0x7f4eec0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:37.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4ef2fff700 1 -- 172.21.15.115:0/3623243891 shutdown_connections 2023-07-27T14:38:37.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.118+0000 7f4ef2fff700 1 -- 172.21.15.115:0/3623243891 wait complete. 2023-07-27T14:38:37.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.120+0000 7f4ef2fff700 1 Processor -- start 2023-07-27T14:38:37.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.120+0000 7f4ef2fff700 1 -- start start 2023-07-27T14:38:37.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef2fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec064230 0x7f4eec167490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef2fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec065de0 0x7f4eec0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef2fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef2fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec165640 con 0x7f4eec153e00 2023-07-27T14:38:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef2fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec167980 con 0x7f4eec065de0 2023-07-27T14:38:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef2fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec164a30 con 0x7f4eec064230 2023-07-27T14:38:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef159c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef159c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56636/0 (socket says 172.21.15.115:56636) 2023-07-27T14:38:37.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef159c700 1 -- 172.21.15.115:0/4189561081 learned_addr learned my addr 172.21.15.115:0/4189561081 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:37.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4eebfff700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec065de0 0x7f4eec0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef0d9b700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec064230 0x7f4eec167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef159c700 1 -- 172.21.15.115:0/4189561081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec064230 msgr2=0x7f4eec167490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef159c700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec064230 0x7f4eec167490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef159c700 1 -- 172.21.15.115:0/4189561081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec065de0 msgr2=0x7f4eec0aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef159c700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec065de0 0x7f4eec0aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.121+0000 7f4ef159c700 1 -- 172.21.15.115:0/4189561081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0009370 con 0x7f4eec153e00 2023-07-27T14:38:37.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.122+0000 7f4ef159c700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec152da0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f4ee4009fa0 tx=0x7f4ee4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:37.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.122+0000 7f4ee8ff9700 1 -- 172.21.15.115:0/4189561081 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400ed20 con 0x7f4eec153e00 2023-07-27T14:38:37.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.122+0000 7f4ee8ff9700 1 -- 172.21.15.115:0/4189561081 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee400ee80 con 0x7f4eec153e00 2023-07-27T14:38:37.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.122+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec164d10 con 0x7f4eec153e00 2023-07-27T14:38:37.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.122+0000 7f4ee8ff9700 1 -- 172.21.15.115:0/4189561081 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4014610 con 0x7f4eec153e00 2023-07-27T14:38:37.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.122+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec1652d0 con 0x7f4eec153e00 2023-07-27T14:38:37.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.123+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec165820 con 0x7f4eec153e00 2023-07-27T14:38:37.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.124+0000 7f4ee8ff9700 1 -- 172.21.15.115:0/4189561081 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f4ee401b030 con 0x7f4eec153e00 2023-07-27T14:38:37.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.125+0000 7f4ee8ff9700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005fb50 0x7f4ed0062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.125+0000 7f4ee8ff9700 1 -- 172.21.15.115:0/4189561081 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4ee407b5e0 con 0x7f4eec153e00 2023-07-27T14:38:37.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.125+0000 7f4ef0d9b700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005fb50 0x7f4ed0062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.125+0000 7f4ef0d9b700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005fb50 0x7f4ed0062010 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f4ee0009130 tx=0x7f4ee0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:37.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.128+0000 7f4ee8ff9700 1 -- 172.21.15.115:0/4189561081 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4eec165820 con 0x7f4eec153e00 2023-07-27T14:38:37.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.299+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4eec06c470 con 0x7f4eec153e00 2023-07-27T14:38:37.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.299+0000 7f4ee8ff9700 1 -- 172.21.15.115:0/4189561081 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v174) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4ee404bc50 con 0x7f4eec153e00 2023-07-27T14:38:37.352 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:38:37.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005fb50 msgr2=0x7f4ed0062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005fb50 0x7f4ed0062010 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f4ee0009130 tx=0x7f4ee0017000).stop 2023-07-27T14:38:37.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 msgr2=0x7f4eec152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec152da0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f4ee4009fa0 tx=0x7f4ee4009900).stop 2023-07-27T14:38:37.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 shutdown_connections 2023-07-27T14:38:37.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ed005fb50 0x7f4ed0062010 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4eec153e00 0x7f4eec152da0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4eec064230 0x7f4eec167490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 --2- 172.21.15.115:0/4189561081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4eec065de0 0x7f4eec0aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 >> 172.21.15.115:0/4189561081 conn(0x7f4eec0c7b90 msgr2=0x7f4eec152450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:37.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 shutdown_connections 2023-07-27T14:38:37.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.301+0000 7f4ef2fff700 1 -- 172.21.15.115:0/4189561081 wait complete. 2023-07-27T14:38:37.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:38:37.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.512+0000 7eff0dfff700 1 Processor -- start 2023-07-27T14:38:37.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.513+0000 7eff0dfff700 1 -- start start 2023-07-27T14:38:37.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff0dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814ae00 0x7eff08154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff0dfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff0814b1e0 0x7eff08062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff0dfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff081553f0 con 0x7eff080c5c50 2023-07-27T14:38:37.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff0dfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff08157a50 con 0x7eff0814b1e0 2023-07-27T14:38:37.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff0dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff08157d10 con 0x7eff0814ae00 2023-07-27T14:38:37.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff06ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff0814b1e0 0x7eff08062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff06ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff0814b1e0 0x7eff08062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56648/0 (socket says 172.21.15.115:56648) 2023-07-27T14:38:37.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff06ffd700 1 -- 172.21.15.115:0/1431567368 learned_addr learned my addr 172.21.15.115:0/1431567368 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:37.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff07fff700 1 --1- 172.21.15.115:0/1431567368 >> v1:172.21.15.115:6789/0 conn(0x7eff080c5c50 0x7eff080a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53918/0 (socket says 172.21.15.115:53918) 2023-07-27T14:38:37.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.514+0000 7eff077fe700 1 --2- 172.21.15.115:0/1431567368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814ae00 0x7eff08154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff06ffd700 1 -- 172.21.15.115:0/1431567368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814ae00 msgr2=0x7eff08154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:37.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff06ffd700 1 --2- 172.21.15.115:0/1431567368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814ae00 0x7eff08154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff06ffd700 1 -- 172.21.15.115:0/1431567368 >> v1:172.21.15.115:6789/0 conn(0x7eff080c5c50 legacy=0x7eff080a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff067fc700 1 -- 172.21.15.115:0/1431567368 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075928476 0 0) 0x7eff081553f0 con 0x7eff080c5c50 2023-07-27T14:38:37.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff06ffd700 1 -- 172.21.15.115:0/1431567368 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08157ff0 con 0x7eff0814b1e0 2023-07-27T14:38:37.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff06ffd700 1 --2- 172.21.15.115:0/1431567368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814b1e0 0x7eff08062b50 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7efefc006fd0 tx=0x7efefc0090f0).ready entity=mon.0 client_cookie=2cbf07adb026b1d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:37.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff067fc700 1 -- 172.21.15.115:0/1431567368 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00b600 con 0x7eff0814b1e0 2023-07-27T14:38:37.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff067fc700 1 -- 172.21.15.115:0/1431567368 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00b760 con 0x7eff0814b1e0 2023-07-27T14:38:37.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.515+0000 7eff067fc700 1 -- 172.21.15.115:0/1431567368 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00bae0 con 0x7eff0814b1e0 2023-07-27T14:38:37.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.516+0000 7eff0dfff700 1 -- 172.21.15.115:0/1431567368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814b1e0 msgr2=0x7eff08062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.516+0000 7eff0dfff700 1 --2- 172.21.15.115:0/1431567368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814b1e0 0x7eff08062b50 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7efefc006fd0 tx=0x7efefc0090f0).stop 2023-07-27T14:38:37.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.516+0000 7eff0dfff700 1 -- 172.21.15.115:0/1431567368 shutdown_connections 2023-07-27T14:38:37.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.516+0000 7eff0dfff700 1 --2- 172.21.15.115:0/1431567368 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814ae00 0x7eff08154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.516+0000 7eff0dfff700 1 --2- 172.21.15.115:0/1431567368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814b1e0 0x7eff08062b50 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.516+0000 7eff0dfff700 1 -- 172.21.15.115:0/1431567368 >> 172.21.15.115:0/1431567368 conn(0x7eff0805e940 msgr2=0x7eff080cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:37.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.516+0000 7eff0dfff700 1 -- 172.21.15.115:0/1431567368 shutdown_connections 2023-07-27T14:38:37.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.516+0000 7eff0dfff700 1 -- 172.21.15.115:0/1431567368 wait complete. 2023-07-27T14:38:37.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.517+0000 7eff0dfff700 1 Processor -- start 2023-07-27T14:38:37.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.517+0000 7eff0dfff700 1 -- start start 2023-07-27T14:38:37.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.518+0000 7eff0dfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff080c5c50 0x7eff0814a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.518+0000 7eff0dfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814ae00 0x7eff08149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.518+0000 7eff0dfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814b1e0 0x7eff08155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.518+0000 7eff0dfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0814abe0 con 0x7eff0814ae00 2023-07-27T14:38:37.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.518+0000 7eff0dfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff080c1c50 con 0x7eff080c5c50 2023-07-27T14:38:37.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.518+0000 7eff0dfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff080c1f30 con 0x7eff0814b1e0 2023-07-27T14:38:37.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814ae00 0x7eff08149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814ae00 0x7eff08149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56654/0 (socket says 172.21.15.115:56654) 2023-07-27T14:38:37.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 -- 172.21.15.115:0/3930593128 learned_addr learned my addr 172.21.15.115:0/3930593128 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:37.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff077fe700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff080c5c50 0x7eff0814a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff07fff700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814b1e0 0x7eff08155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 -- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814b1e0 msgr2=0x7eff08155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814b1e0 0x7eff08155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 -- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff080c5c50 msgr2=0x7eff0814a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff080c5c50 0x7eff0814a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 -- 172.21.15.115:0/3930593128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc009370 con 0x7eff0814ae00 2023-07-27T14:38:37.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff07fff700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814b1e0 0x7eff08155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:37.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7eff06ffd700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814ae00 0x7eff08149e60 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7efefc011000 tx=0x7efefc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:37.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.519+0000 7efeef7fe700 1 -- 172.21.15.115:0/3930593128 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00b8d0 con 0x7eff0814ae00 2023-07-27T14:38:37.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.520+0000 7efeef7fe700 1 -- 172.21.15.115:0/3930593128 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00ba30 con 0x7eff0814ae00 2023-07-27T14:38:37.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.520+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff080c2210 con 0x7eff0814ae00 2023-07-27T14:38:37.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.520+0000 7efeef7fe700 1 -- 172.21.15.115:0/3930593128 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc01d680 con 0x7eff0814ae00 2023-07-27T14:38:37.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.520+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff080c27d0 con 0x7eff0814ae00 2023-07-27T14:38:37.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.521+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0806c470 con 0x7eff0814ae00 2023-07-27T14:38:37.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.522+0000 7efeef7fe700 1 -- 172.21.15.115:0/3930593128 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7efefc00f070 con 0x7eff0814ae00 2023-07-27T14:38:37.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.522+0000 7efeef7fe700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efef405fb50 0x7efef4062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.522+0000 7efeef7fe700 1 -- 172.21.15.115:0/3930593128 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efefc07cde0 con 0x7eff0814ae00 2023-07-27T14:38:37.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.523+0000 7eff077fe700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efef405fb50 0x7efef4062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.523+0000 7eff077fe700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efef405fb50 0x7efef4062010 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7efef800bb20 tx=0x7efef8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:37.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.526+0000 7efeef7fe700 1 -- 172.21.15.115:0/3930593128 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efefc04d560 con 0x7eff0814ae00 2023-07-27T14:38:37.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.700+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff08153eb0 con 0x7eff0814ae00 2023-07-27T14:38:37.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.700+0000 7efeef7fe700 1 -- 172.21.15.115:0/3930593128 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v174) v1 ==== 92+0+10 (secure 0 0 0) 0x7efefc021070 con 0x7eff0814ae00 2023-07-27T14:38:37.754 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:38:37.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.702+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efef405fb50 msgr2=0x7efef4062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.702+0000 7eff0dfff700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efef405fb50 0x7efef4062010 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7efef800bb20 tx=0x7efef8008040).stop 2023-07-27T14:38:37.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.702+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814ae00 msgr2=0x7eff08149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.702+0000 7eff0dfff700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814ae00 0x7eff08149e60 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7efefc011000 tx=0x7efefc017000).stop 2023-07-27T14:38:37.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.703+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 shutdown_connections 2023-07-27T14:38:37.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.703+0000 7eff0dfff700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efef405fb50 0x7efef4062010 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.703+0000 7eff0dfff700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7eff0814b1e0 0x7eff08155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.703+0000 7eff0dfff700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff080c5c50 0x7eff0814a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.703+0000 7eff0dfff700 1 --2- 172.21.15.115:0/3930593128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0814ae00 0x7eff08149e60 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.703+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 >> 172.21.15.115:0/3930593128 conn(0x7eff0805e940 msgr2=0x7eff080aac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:37.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.703+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 shutdown_connections 2023-07-27T14:38:37.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.703+0000 7eff0dfff700 1 -- 172.21.15.115:0/3930593128 wait complete. 2023-07-27T14:38:37.772 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:38:37.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.917+0000 7fbdf93ff700 1 Processor -- start 2023-07-27T14:38:37.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.917+0000 7fbdf93ff700 1 -- start start 2023-07-27T14:38:37.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.918+0000 7fbdf93ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbdf414b1e0 0x7fbdf4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.918+0000 7fbdf93ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf41553f0 con 0x7fbdf414ae00 2023-07-27T14:38:37.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.918+0000 7fbdf93ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf4157a50 con 0x7fbdf4063260 2023-07-27T14:38:37.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.918+0000 7fbdf93ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf4157d10 con 0x7fbdf414b1e0 2023-07-27T14:38:37.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbdf414ae00 0x7fbdf4062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53922/0 (socket says 172.21.15.115:53922) 2023-07-27T14:38:37.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf2ffd700 1 -- 172.21.15.115:0/702615410 learned_addr learned my addr 172.21.15.115:0/702615410 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:37.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf37fe700 1 --2- 172.21.15.115:0/702615410 >> v2:172.21.15.159:3300/0 conn(0x7fbdf414b1e0 0x7fbdf4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80505572 0 0) 0x7fbdf41553f0 con 0x7fbdf414ae00 2023-07-27T14:38:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbddc0033f0 con 0x7fbdf414ae00 2023-07-27T14:38:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858201100 0 0) 0x7fbdf4157a50 con 0x7fbdf4063260 2023-07-27T14:38:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf41553f0 con 0x7fbdf4063260 2023-07-27T14:38:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3585418812 0 0) 0x7fbddc0033f0 con 0x7fbdf414ae00 2023-07-27T14:38:37.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 >> v2:172.21.15.159:3300/0 conn(0x7fbdf414b1e0 msgr2=0x7fbdf4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 --2- 172.21.15.115:0/702615410 >> v2:172.21.15.159:3300/0 conn(0x7fbdf414b1e0 0x7fbdf4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 >> v1:172.21.15.159:6789/0 conn(0x7fbdf4063260 legacy=0x7fbdf40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4157ff0 con 0x7fbdf414ae00 2023-07-27T14:38:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fbde4001470 con 0x7fbdf414ae00 2023-07-27T14:38:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 >> v1:172.21.15.115:6789/0 conn(0x7fbdf414ae00 legacy=0x7fbdf4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.919+0000 7fbdf1ffb700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc003a70 0x7fbddc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf1ffb700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbddc004690 0x7fbddc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf1ffb700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbddc005000 0x7fbddc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4157d10 con 0x7fbddc005000 2023-07-27T14:38:37.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00bf60 con 0x7fbddc003a70 2023-07-27T14:38:37.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc00c0d0 con 0x7fbddc004690 2023-07-27T14:38:37.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf37fe700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbddc005000 0x7fbddc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf2ffd700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc003a70 0x7fbddc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf27fc700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbddc004690 0x7fbddc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf37fe700 1 -- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbddc004690 msgr2=0x7fbddc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:37.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf37fe700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbddc004690 0x7fbddc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf37fe700 1 -- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc003a70 msgr2=0x7fbddc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:37.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf37fe700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc003a70 0x7fbddc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf37fe700 1 -- 172.21.15.115:0/702615410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc0033f0 con 0x7fbddc005000 2023-07-27T14:38:37.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf27fc700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbddc004690 0x7fbddc004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:37.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf37fe700 1 -- 172.21.15.115:0/702615410 reap_dead start 2023-07-27T14:38:37.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.920+0000 7fbdf37fe700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbddc005000 0x7fbddc00b8e0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fbdf414b5e0 tx=0x7fbdec00b040).ready entity=mon.0 client_cookie=3327c9a6a5b13566 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:37.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec009ac0 con 0x7fbddc005000 2023-07-27T14:38:37.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec00f040 con 0x7fbddc005000 2023-07-27T14:38:37.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf1ffb700 1 -- 172.21.15.115:0/702615410 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00eca0 con 0x7fbddc005000 2023-07-27T14:38:37.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf93ff700 1 -- 172.21.15.115:0/702615410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbddc005000 msgr2=0x7fbddc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf93ff700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbddc005000 0x7fbddc00b8e0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fbdf414b5e0 tx=0x7fbdec00b040).stop 2023-07-27T14:38:37.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf93ff700 1 -- 172.21.15.115:0/702615410 shutdown_connections 2023-07-27T14:38:37.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf93ff700 1 --2- 172.21.15.115:0/702615410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbddc005000 0x7fbddc00b8e0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf93ff700 1 -- 172.21.15.115:0/702615410 >> 172.21.15.115:0/702615410 conn(0x7fbdf405e940 msgr2=0x7fbdf40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:37.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf93ff700 1 -- 172.21.15.115:0/702615410 shutdown_connections 2023-07-27T14:38:37.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.921+0000 7fbdf93ff700 1 -- 172.21.15.115:0/702615410 wait complete. 2023-07-27T14:38:37.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.923+0000 7fbdf93ff700 1 Processor -- start 2023-07-27T14:38:37.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.923+0000 7fbdf93ff700 1 -- start start 2023-07-27T14:38:37.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf93ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc005000 0x7fbdf414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf93ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf414fc00 0x7fbdf40b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf93ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdf4156550 0x7fbdf41569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:37.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf93ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf41517d0 con 0x7fbdf414fc00 2023-07-27T14:38:37.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf93ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf414ac20 con 0x7fbddc005000 2023-07-27T14:38:37.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf93ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4150ef0 con 0x7fbdf4156550 2023-07-27T14:38:37.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf414fc00 0x7fbdf40b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf414fc00 0x7fbdf40b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56684/0 (socket says 172.21.15.115:56684) 2023-07-27T14:38:37.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf27fc700 1 -- 172.21.15.115:0/3642544908 learned_addr learned my addr 172.21.15.115:0/3642544908 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:37.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf2ffd700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc005000 0x7fbdf414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf37fe700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdf4156550 0x7fbdf41569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:37.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf27fc700 1 -- 172.21.15.115:0/3642544908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdf4156550 msgr2=0x7fbdf41569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf27fc700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdf4156550 0x7fbdf41569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf27fc700 1 -- 172.21.15.115:0/3642544908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc005000 msgr2=0x7fbdf414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf27fc700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc005000 0x7fbdf414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.925+0000 7fbdf27fc700 1 -- 172.21.15.115:0/3642544908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4156ea0 con 0x7fbdf414fc00 2023-07-27T14:38:37.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.926+0000 7fbdf27fc700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf414fc00 0x7fbdf40b0480 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fbde800e480 tx=0x7fbde8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:37.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.926+0000 7fbddaffd700 1 -- 172.21.15.115:0/3642544908 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800ee60 con 0x7fbdf414fc00 2023-07-27T14:38:37.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.926+0000 7fbddaffd700 1 -- 172.21.15.115:0/3642544908 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde8010040 con 0x7fbdf414fc00 2023-07-27T14:38:37.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.926+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf41500e0 con 0x7fbdf414fc00 2023-07-27T14:38:37.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.926+0000 7fbddaffd700 1 -- 172.21.15.115:0/3642544908 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80017a0 con 0x7fbdf414fc00 2023-07-27T14:38:37.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.926+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf4151460 con 0x7fbdf414fc00 2023-07-27T14:38:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.927+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf406c470 con 0x7fbdf414fc00 2023-07-27T14:38:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.928+0000 7fbddaffd700 1 -- 172.21.15.115:0/3642544908 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fbde8001b50 con 0x7fbdf414fc00 2023-07-27T14:38:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.928+0000 7fbddaffd700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbde005fb50 0x7fbde0062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.929+0000 7fbddaffd700 1 -- 172.21.15.115:0/3642544908 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fbde807b040 con 0x7fbdf414fc00 2023-07-27T14:38:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.929+0000 7fbdf2ffd700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbde005fb50 0x7fbde0062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.929+0000 7fbdf2ffd700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbde005fb50 0x7fbde0062010 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fbde4001ca0 tx=0x7fbde4001e10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:38.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:37.932+0000 7fbddaffd700 1 -- 172.21.15.115:0/3642544908 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbde804f210 con 0x7fbdf414fc00 2023-07-27T14:38:38.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.100+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdf40c12c0 con 0x7fbdf414fc00 2023-07-27T14:38:38.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.101+0000 7fbddaffd700 1 -- 172.21.15.115:0/3642544908 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v175) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbde8007cf0 con 0x7fbdf414fc00 2023-07-27T14:38:38.154 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:38:38.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbde005fb50 msgr2=0x7fbde0062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbde005fb50 0x7fbde0062010 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fbde4001ca0 tx=0x7fbde4001e10).stop 2023-07-27T14:38:38.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf414fc00 msgr2=0x7fbdf40b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf414fc00 0x7fbdf40b0480 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fbde800e480 tx=0x7fbde8009040).stop 2023-07-27T14:38:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 shutdown_connections 2023-07-27T14:38:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbde005fb50 0x7fbde0062010 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbdf4156550 0x7fbdf41569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc005000 0x7fbdf414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 --2- 172.21.15.115:0/3642544908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf414fc00 0x7fbdf40b0480 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 >> 172.21.15.115:0/3642544908 conn(0x7fbdf405e940 msgr2=0x7fbdf4152760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 shutdown_connections 2023-07-27T14:38:38.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.103+0000 7fbdf93ff700 1 -- 172.21.15.115:0/3642544908 wait complete. 2023-07-27T14:38:38.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:38:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.312+0000 7f4545fff700 1 Processor -- start 2023-07-27T14:38:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.313+0000 7f4545fff700 1 -- start start 2023-07-27T14:38:38.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f4545fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014ae00 0x7f4540154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f4545fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4540063260 0x7f45400a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f4545fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45401553f0 con 0x7f454014b1e0 2023-07-27T14:38:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f4545fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540157a50 con 0x7f4540063260 2023-07-27T14:38:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f4545fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4540157d10 con 0x7f454014ae00 2023-07-27T14:38:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f453effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f454014b1e0 0x7f4540062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53936/0 (socket says 172.21.15.115:53936) 2023-07-27T14:38:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f453effd700 1 -- 172.21.15.115:0/4222621452 learned_addr learned my addr 172.21.15.115:0/4222621452 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:38.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f453ffff700 1 --2- 172.21.15.115:0/4222621452 >> v2:172.21.15.115:3300/0 conn(0x7f4540063260 0x7f45400a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f453f7fe700 1 --2- 172.21.15.115:0/4222621452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014ae00 0x7f4540154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.314+0000 7f453e7fc700 1 -- 172.21.15.115:0/4222621452 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294422375 0 0) 0x7f45401553f0 con 0x7f454014b1e0 2023-07-27T14:38:38.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453e7fc700 1 -- 172.21.15.115:0/4222621452 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45280033f0 con 0x7f454014b1e0 2023-07-27T14:38:38.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453ffff700 1 -- 172.21.15.115:0/4222621452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014ae00 msgr2=0x7f4540154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:38.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453ffff700 1 --2- 172.21.15.115:0/4222621452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014ae00 0x7f4540154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453ffff700 1 -- 172.21.15.115:0/4222621452 >> v1:172.21.15.115:6789/0 conn(0x7f454014b1e0 legacy=0x7f4540062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453ffff700 1 -- 172.21.15.115:0/4222621452 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540157ff0 con 0x7f4540063260 2023-07-27T14:38:38.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453ffff700 1 --2- 172.21.15.115:0/4222621452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4540063260 0x7f45400a98c0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f4538009e60 tx=0x7f4538009780).ready entity=mon.0 client_cookie=78aa4b2185ada033 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:38.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453e7fc700 1 -- 172.21.15.115:0/4222621452 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800e070 con 0x7f4540063260 2023-07-27T14:38:38.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453e7fc700 1 -- 172.21.15.115:0/4222621452 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800bab0 con 0x7f4540063260 2023-07-27T14:38:38.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.315+0000 7f453e7fc700 1 -- 172.21.15.115:0/4222621452 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800be30 con 0x7f4540063260 2023-07-27T14:38:38.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.316+0000 7f4545fff700 1 -- 172.21.15.115:0/4222621452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4540063260 msgr2=0x7f45400a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.316+0000 7f4545fff700 1 --2- 172.21.15.115:0/4222621452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4540063260 0x7f45400a98c0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f4538009e60 tx=0x7f4538009780).stop 2023-07-27T14:38:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.316+0000 7f4545fff700 1 -- 172.21.15.115:0/4222621452 shutdown_connections 2023-07-27T14:38:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.316+0000 7f4545fff700 1 --2- 172.21.15.115:0/4222621452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014ae00 0x7f4540154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.316+0000 7f4545fff700 1 --2- 172.21.15.115:0/4222621452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4540063260 0x7f45400a98c0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.316+0000 7f4545fff700 1 -- 172.21.15.115:0/4222621452 >> 172.21.15.115:0/4222621452 conn(0x7f454005e940 msgr2=0x7f45400cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.316+0000 7f4545fff700 1 -- 172.21.15.115:0/4222621452 shutdown_connections 2023-07-27T14:38:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.316+0000 7f4545fff700 1 -- 172.21.15.115:0/4222621452 wait complete. 2023-07-27T14:38:38.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.317+0000 7f4545fff700 1 Processor -- start 2023-07-27T14:38:38.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.317+0000 7f4545fff700 1 -- start start 2023-07-27T14:38:38.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.318+0000 7f4545fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540063260 0x7f45400c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.318+0000 7f4545fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f454014ae00 0x7f45400adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.318+0000 7f4545fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014b1e0 0x7f454013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.318+0000 7f4545fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400c4780 con 0x7f454014ae00 2023-07-27T14:38:38.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.318+0000 7f4545fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400ae050 con 0x7f4540063260 2023-07-27T14:38:38.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.318+0000 7f4545fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400c4450 con 0x7f454014b1e0 2023-07-27T14:38:38.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f454014ae00 0x7f45400adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f454014ae00 0x7f45400adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56696/0 (socket says 172.21.15.115:56696) 2023-07-27T14:38:38.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 -- 172.21.15.115:0/3128629808 learned_addr learned my addr 172.21.15.115:0/3128629808 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:38.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453ffff700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014b1e0 0x7f454013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453f7fe700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540063260 0x7f45400c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 -- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014b1e0 msgr2=0x7f454013f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014b1e0 0x7f454013f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 -- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540063260 msgr2=0x7f45400c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540063260 0x7f45400c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 -- 172.21.15.115:0/3128629808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4538009a20 con 0x7f454014ae00 2023-07-27T14:38:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453f7fe700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540063260 0x7f45400c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f453effd700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f454014ae00 0x7f45400adb60 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f453400c440 tx=0x7f4534007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:38.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f45277fe700 1 -- 172.21.15.115:0/3128629808 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45340072e0 con 0x7f454014ae00 2023-07-27T14:38:38.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f45277fe700 1 -- 172.21.15.115:0/3128629808 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4534007440 con 0x7f454014ae00 2023-07-27T14:38:38.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f45277fe700 1 -- 172.21.15.115:0/3128629808 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45340057a0 con 0x7f454014ae00 2023-07-27T14:38:38.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.319+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45400caa40 con 0x7f454014ae00 2023-07-27T14:38:38.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.320+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4540167e70 con 0x7f454014ae00 2023-07-27T14:38:38.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.321+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45400c48c0 con 0x7f454014ae00 2023-07-27T14:38:38.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.321+0000 7f45277fe700 1 -- 172.21.15.115:0/3128629808 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f4534010070 con 0x7f454014ae00 2023-07-27T14:38:38.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.323+0000 7f45277fe700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05fb20 0x7f452c061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.323+0000 7f45277fe700 1 -- 172.21.15.115:0/3128629808 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f453407a670 con 0x7f454014ae00 2023-07-27T14:38:38.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.323+0000 7f453f7fe700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05fb20 0x7f452c061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.323+0000 7f453f7fe700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05fb20 0x7f452c061fe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f4530006d80 tx=0x7f4530008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:38.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.327+0000 7f45277fe700 1 -- 172.21.15.115:0/3128629808 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45400c48c0 con 0x7f454014ae00 2023-07-27T14:38:38.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.508+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45400c48c0 con 0x7f454014ae00 2023-07-27T14:38:38.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.508+0000 7f45277fe700 1 -- 172.21.15.115:0/3128629808 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v175) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45400c48c0 con 0x7f454014ae00 2023-07-27T14:38:38.562 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:38:38.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05fb20 msgr2=0x7f452c061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05fb20 0x7f452c061fe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f4530006d80 tx=0x7f4530008040).stop 2023-07-27T14:38:38.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f454014ae00 msgr2=0x7f45400adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f454014ae00 0x7f45400adb60 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f453400c440 tx=0x7f4534007bd0).stop 2023-07-27T14:38:38.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 shutdown_connections 2023-07-27T14:38:38.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f452c05fb20 0x7f452c061fe0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f454014b1e0 0x7f454013f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4540063260 0x7f45400c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 --2- 172.21.15.115:0/3128629808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f454014ae00 0x7f45400adb60 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.510+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 >> 172.21.15.115:0/3128629808 conn(0x7f454005e940 msgr2=0x7f45400a9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.511+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 shutdown_connections 2023-07-27T14:38:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.511+0000 7f4545fff700 1 -- 172.21.15.115:0/3128629808 wait complete. 2023-07-27T14:38:38.581 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:38:38.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.717+0000 7f39237ff700 1 Processor -- start 2023-07-27T14:38:38.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.717+0000 7f39237ff700 1 -- start start 2023-07-27T14:38:38.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.718+0000 7f39237ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f391c151d70 0x7f391c155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.718+0000 7f39237ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f391c066b80 0x7f391c067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.718+0000 7f39237ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c067080 con 0x7f391c065ff0 2023-07-27T14:38:38.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.718+0000 7f39237ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c063a90 con 0x7f391c066b80 2023-07-27T14:38:38.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.718+0000 7f39237ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0634d0 con 0x7f391c151d70 2023-07-27T14:38:38.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3921d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f391c066b80 0x7f391c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3920d9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f391c065ff0 0x7f391c066470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53946/0 (socket says 172.21.15.115:53946) 2023-07-27T14:38:38.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3920d9a700 1 -- 172.21.15.115:0/112960190 learned_addr learned my addr 172.21.15.115:0/112960190 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:38.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3921d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f391c066b80 0x7f391c067560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56698/0 (socket says 172.21.15.115:56698) 2023-07-27T14:38:38.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f392159b700 1 --2- 172.21.15.115:0/112960190 >> v2:172.21.15.159:3300/0 conn(0x7f391c151d70 0x7f391c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3921d9c700 1 -- 172.21.15.115:0/112960190 >> v2:172.21.15.159:3300/0 conn(0x7f391c151d70 msgr2=0x7f391c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:38.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3921d9c700 1 --2- 172.21.15.115:0/112960190 >> v2:172.21.15.159:3300/0 conn(0x7f391c151d70 0x7f391c155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3921d9c700 1 -- 172.21.15.115:0/112960190 >> v1:172.21.15.115:6789/0 conn(0x7f391c065ff0 legacy=0x7f391c066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3921d9c700 1 -- 172.21.15.115:0/112960190 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0637b0 con 0x7f391c066b80 2023-07-27T14:38:38.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3913fff700 1 -- 172.21.15.115:0/112960190 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243418046 0 0) 0x7f391c067080 con 0x7f391c065ff0 2023-07-27T14:38:38.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.719+0000 7f3921d9c700 1 --2- 172.21.15.115:0/112960190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c066b80 0x7f391c067560 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f391c0c88b0 tx=0x7f3914009780).ready entity=mon.0 client_cookie=ddbd5d637f8a5d33 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:38.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f3913fff700 1 -- 172.21.15.115:0/112960190 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400e070 con 0x7f391c066b80 2023-07-27T14:38:38.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f3913fff700 1 -- 172.21.15.115:0/112960190 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391400bc30 con 0x7f391c066b80 2023-07-27T14:38:38.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f3913fff700 1 -- 172.21.15.115:0/112960190 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914012410 con 0x7f391c066b80 2023-07-27T14:38:38.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f39237ff700 1 -- 172.21.15.115:0/112960190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c066b80 msgr2=0x7f391c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f39237ff700 1 --2- 172.21.15.115:0/112960190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c066b80 0x7f391c067560 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f391c0c88b0 tx=0x7f3914009780).stop 2023-07-27T14:38:38.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f39237ff700 1 -- 172.21.15.115:0/112960190 shutdown_connections 2023-07-27T14:38:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f39237ff700 1 --2- 172.21.15.115:0/112960190 >> v2:172.21.15.159:3300/0 conn(0x7f391c151d70 0x7f391c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f39237ff700 1 --2- 172.21.15.115:0/112960190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c066b80 0x7f391c067560 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f39237ff700 1 -- 172.21.15.115:0/112960190 >> 172.21.15.115:0/112960190 conn(0x7f391c0c89a0 msgr2=0x7f391c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f39237ff700 1 -- 172.21.15.115:0/112960190 shutdown_connections 2023-07-27T14:38:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.720+0000 7f39237ff700 1 -- 172.21.15.115:0/112960190 wait complete. 2023-07-27T14:38:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.722+0000 7f39237ff700 1 Processor -- start 2023-07-27T14:38:38.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.722+0000 7f39237ff700 1 -- start start 2023-07-27T14:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f39237ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391c065ff0 0x7f391c163e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f39237ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f391c066b80 0x7f391c0c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f39237ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c151d70 0x7f391c1649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f39237ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c0dc0 con 0x7f391c151d70 2023-07-27T14:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f39237ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c01b0 con 0x7f391c065ff0 2023-07-27T14:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f39237ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c0490 con 0x7f391c066b80 2023-07-27T14:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c151d70 0x7f391c1649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c151d70 0x7f391c1649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56700/0 (socket says 172.21.15.115:56700) 2023-07-27T14:38:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 -- 172.21.15.115:0/486469985 learned_addr learned my addr 172.21.15.115:0/486469985 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3920d9a700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f391c066b80 0x7f391c0c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f392159b700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391c065ff0 0x7f391c163e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 -- 172.21.15.115:0/486469985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f391c066b80 msgr2=0x7f391c0c1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f391c066b80 0x7f391c0c1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 -- 172.21.15.115:0/486469985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391c065ff0 msgr2=0x7f391c163e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391c065ff0 0x7f391c163e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 -- 172.21.15.115:0/486469985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914009a20 con 0x7f391c151d70 2023-07-27T14:38:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.723+0000 7f3921d9c700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c151d70 0x7f391c1649d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f3914011000 tx=0x7f3914009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.724+0000 7f39117fa700 1 -- 172.21.15.115:0/486469985 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140116d0 con 0x7f391c151d70 2023-07-27T14:38:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.724+0000 7f39117fa700 1 -- 172.21.15.115:0/486469985 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3914011830 con 0x7f391c151d70 2023-07-27T14:38:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.724+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0c0770 con 0x7f391c151d70 2023-07-27T14:38:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.724+0000 7f39117fa700 1 -- 172.21.15.115:0/486469985 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914011bf0 con 0x7f391c151d70 2023-07-27T14:38:38.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.724+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c0bfa40 con 0x7f391c151d70 2023-07-27T14:38:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.725+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c063fd0 con 0x7f391c151d70 2023-07-27T14:38:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.726+0000 7f39117fa700 1 -- 172.21.15.115:0/486469985 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f3914011d50 con 0x7f391c151d70 2023-07-27T14:38:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.726+0000 7f39117fa700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f390005fb50 0x7f3900062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.727+0000 7f39117fa700 1 -- 172.21.15.115:0/486469985 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f391407d4f0 con 0x7f391c151d70 2023-07-27T14:38:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.727+0000 7f392159b700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f390005fb50 0x7f3900062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:38.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.727+0000 7f392159b700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f390005fb50 0x7f3900062010 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f3918006fd0 tx=0x7f3918008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:38.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.730+0000 7f39117fa700 1 -- 172.21.15.115:0/486469985 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f391404dc90 con 0x7f391c151d70 2023-07-27T14:38:38.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.941+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f391c06c470 con 0x7f391c151d70 2023-07-27T14:38:38.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.942+0000 7f39117fa700 1 -- 172.21.15.115:0/486469985 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f39140512b0 con 0x7f391c151d70 2023-07-27T14:38:38.995 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:38.996 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":94,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3836371},{"type":"v1","addr":"172.21.15.159:6833","nonce":3836371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1315171707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1315171707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1315171707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1825044502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1825044502},{"type":"v1","addr":"172.21.15.159:6835","nonce":1825044502}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:37:52.356956+0000","modified":"2023-07-27T14:37:55.374238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9222":{"gid":9222,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/991393631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":991393631},{"type":"v1","addr":"172.21.15.115:6836","nonce":991393631}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-07-27T14:38:38.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f390005fb50 msgr2=0x7f3900062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f390005fb50 0x7f3900062010 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f3918006fd0 tx=0x7f3918008040).stop 2023-07-27T14:38:38.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c151d70 msgr2=0x7f391c1649d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:38.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c151d70 0x7f391c1649d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f3914011000 tx=0x7f3914009780).stop 2023-07-27T14:38:38.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 shutdown_connections 2023-07-27T14:38:38.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f390005fb50 0x7f3900062010 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f391c151d70 0x7f391c1649d0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f391c065ff0 0x7f391c163e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 --2- 172.21.15.115:0/486469985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f391c066b80 0x7f391c0c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 >> 172.21.15.115:0/486469985 conn(0x7f391c0c89a0 msgr2=0x7f391c067560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 shutdown_connections 2023-07-27T14:38:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:38.944+0000 7f39237ff700 1 -- 172.21.15.115:0/486469985 wait complete. 2023-07-27T14:38:38.999 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 94 2023-07-27T14:38:39.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:38:39.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.152+0000 7f39f2dff700 1 Processor -- start 2023-07-27T14:38:39.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.152+0000 7f39f2dff700 1 -- start start 2023-07-27T14:38:39.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.153+0000 7f39f2dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec153ec0 0x7f39ec0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.153+0000 7f39f2dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f39ec0aa050 0x7f39ec0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.153+0000 7f39f2dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ec0aa4d0 con 0x7f39ec0aaa40 2023-07-27T14:38:39.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.153+0000 7f39f2dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ec0c05c0 con 0x7f39ec0aa050 2023-07-27T14:38:39.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.153+0000 7f39f2dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0c1a60 con 0x7f39ec153ec0 2023-07-27T14:38:39.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.153+0000 7f39ebfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f39ec0aa050 0x7f39ec0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39ebfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f39ec0aa050 0x7f39ec0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56712/0 (socket says 172.21.15.115:56712) 2023-07-27T14:38:39.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39ebfff700 1 -- 172.21.15.115:0/3698681338 learned_addr learned my addr 172.21.15.115:0/3698681338 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:39.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39f139c700 1 --1- 172.21.15.115:0/3698681338 >> v1:172.21.15.115:6789/0 conn(0x7f39ec0aaa40 0x7f39ec157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53960/0 (socket says 172.21.15.115:53960) 2023-07-27T14:38:39.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39f0b9b700 1 --2- 172.21.15.115:0/3698681338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec153ec0 0x7f39ec0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39ebfff700 1 -- 172.21.15.115:0/3698681338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec153ec0 msgr2=0x7f39ec0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:39.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39ebfff700 1 --2- 172.21.15.115:0/3698681338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec153ec0 0x7f39ec0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39eb7fe700 1 -- 172.21.15.115:0/3698681338 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161648313 0 0) 0x7f39e4001490 con 0x7f39ec0aaa40 2023-07-27T14:38:39.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39ebfff700 1 -- 172.21.15.115:0/3698681338 >> v1:172.21.15.115:6789/0 conn(0x7f39ec0aaa40 legacy=0x7f39ec157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39ebfff700 1 -- 172.21.15.115:0/3698681338 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec0bfc90 con 0x7f39ec0aa050 2023-07-27T14:38:39.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39f0b9b700 1 --2- 172.21.15.115:0/3698681338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec153ec0 0x7f39ec0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:39.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39ebfff700 1 --2- 172.21.15.115:0/3698681338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec0aa050 0x7f39ec0640f0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f39d8006fd0 tx=0x7f39d80090f0).ready entity=mon.0 client_cookie=5d371b2da4d7cb83 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:39.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39eb7fe700 1 -- 172.21.15.115:0/3698681338 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d800b600 con 0x7f39ec0aa050 2023-07-27T14:38:39.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39eb7fe700 1 -- 172.21.15.115:0/3698681338 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d800b760 con 0x7f39ec0aa050 2023-07-27T14:38:39.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.154+0000 7f39eb7fe700 1 -- 172.21.15.115:0/3698681338 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d800bae0 con 0x7f39ec0aa050 2023-07-27T14:38:39.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.155+0000 7f39f2dff700 1 -- 172.21.15.115:0/3698681338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec0aa050 msgr2=0x7f39ec0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.155+0000 7f39f2dff700 1 --2- 172.21.15.115:0/3698681338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec0aa050 0x7f39ec0640f0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f39d8006fd0 tx=0x7f39d80090f0).stop 2023-07-27T14:38:39.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.155+0000 7f39f2dff700 1 -- 172.21.15.115:0/3698681338 shutdown_connections 2023-07-27T14:38:39.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.155+0000 7f39f2dff700 1 --2- 172.21.15.115:0/3698681338 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec153ec0 0x7f39ec0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.155+0000 7f39f2dff700 1 --2- 172.21.15.115:0/3698681338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec0aa050 0x7f39ec0640f0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.155+0000 7f39f2dff700 1 -- 172.21.15.115:0/3698681338 >> 172.21.15.115:0/3698681338 conn(0x7f39ec0cb610 msgr2=0x7f39ec0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:39.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.155+0000 7f39f2dff700 1 -- 172.21.15.115:0/3698681338 shutdown_connections 2023-07-27T14:38:39.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.155+0000 7f39f2dff700 1 -- 172.21.15.115:0/3698681338 wait complete. 2023-07-27T14:38:39.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.156+0000 7f39f2dff700 1 Processor -- start 2023-07-27T14:38:39.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.157+0000 7f39f2dff700 1 -- start start 2023-07-27T14:38:39.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.157+0000 7f39f2dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39ec0aa050 0x7f39ec15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f2dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec0aaa40 0x7f39ec0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f2dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec153ec0 0x7f39ec0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f2dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0af4f0 con 0x7f39ec153ec0 2023-07-27T14:38:39.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f2dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec14d1b0 con 0x7f39ec0aa050 2023-07-27T14:38:39.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f2dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec164f20 con 0x7f39ec0aaa40 2023-07-27T14:38:39.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec153ec0 0x7f39ec0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec153ec0 0x7f39ec0af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56722/0 (socket says 172.21.15.115:56722) 2023-07-27T14:38:39.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 -- 172.21.15.115:0/14090591 learned_addr learned my addr 172.21.15.115:0/14090591 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:39.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39ebfff700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec0aaa40 0x7f39ec0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f0b9b700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39ec0aa050 0x7f39ec15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 -- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec0aaa40 msgr2=0x7f39ec0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec0aaa40 0x7f39ec0aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 -- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39ec0aa050 msgr2=0x7f39ec15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39ec0aa050 0x7f39ec15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 -- 172.21.15.115:0/14090591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d8009370 con 0x7f39ec153ec0 2023-07-27T14:38:39.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f0b9b700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39ec0aa050 0x7f39ec15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:39.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.158+0000 7f39f139c700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec153ec0 0x7f39ec0af000 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f39e400c810 tx=0x7f39e4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:39.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.159+0000 7f39e8ff9700 1 -- 172.21.15.115:0/14090591 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4005c70 con 0x7f39ec153ec0 2023-07-27T14:38:39.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.159+0000 7f39e8ff9700 1 -- 172.21.15.115:0/14090591 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e4005dd0 con 0x7f39ec153ec0 2023-07-27T14:38:39.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.159+0000 7f39e8ff9700 1 -- 172.21.15.115:0/14090591 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4007320 con 0x7f39ec153ec0 2023-07-27T14:38:39.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.159+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ec164330 con 0x7f39ec153ec0 2023-07-27T14:38:39.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.159+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec1648d0 con 0x7f39ec153ec0 2023-07-27T14:38:39.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.160+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ec165090 con 0x7f39ec153ec0 2023-07-27T14:38:39.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.161+0000 7f39e8ff9700 1 -- 172.21.15.115:0/14090591 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f39e4010030 con 0x7f39ec153ec0 2023-07-27T14:38:39.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.162+0000 7f39e8ff9700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f39d005fb20 0x7f39d0061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.162+0000 7f39e8ff9700 1 -- 172.21.15.115:0/14090591 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f39e407aea0 con 0x7f39ec153ec0 2023-07-27T14:38:39.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.162+0000 7f39f0b9b700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f39d005fb20 0x7f39d0061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.162+0000 7f39f0b9b700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f39d005fb20 0x7f39d0061fe0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f39e0006fd0 tx=0x7f39e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:39.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.165+0000 7f39e8ff9700 1 -- 172.21.15.115:0/14090591 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39e404b530 con 0x7f39ec153ec0 2023-07-27T14:38:39.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.342+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39ec0aa4d0 con 0x7f39ec153ec0 2023-07-27T14:38:39.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.343+0000 7f39e8ff9700 1 -- 172.21.15.115:0/14090591 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+17197 (secure 0 0 0) 0x7f39ec0aa4d0 con 0x7f39ec153ec0 2023-07-27T14:38:39.396 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:39.396 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":175,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:38:37.821500+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:37:50.684543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-27T14:37:51.340294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":175,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":24,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:38:39.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f39d005fb20 msgr2=0x7f39d0061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f39d005fb20 0x7f39d0061fe0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f39e0006fd0 tx=0x7f39e0008040).stop 2023-07-27T14:38:39.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec153ec0 msgr2=0x7f39ec0af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec153ec0 0x7f39ec0af000 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f39e400c810 tx=0x7f39e4007d70).stop 2023-07-27T14:38:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 shutdown_connections 2023-07-27T14:38:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f39d005fb20 0x7f39d0061fe0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec153ec0 0x7f39ec0af000 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f39ec0aa050 0x7f39ec15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 --2- 172.21.15.115:0/14090591 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39ec0aaa40 0x7f39ec0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 >> 172.21.15.115:0/14090591 conn(0x7f39ec0cb610 msgr2=0x7f39ec0ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:39.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 shutdown_connections 2023-07-27T14:38:39.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.345+0000 7f39f2dff700 1 -- 172.21.15.115:0/14090591 wait complete. 2023-07-27T14:38:39.415 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:38:39.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:38:39.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.550+0000 7f6be9dff700 1 Processor -- start 2023-07-27T14:38:39.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.550+0000 7f6be9dff700 1 -- start start 2023-07-27T14:38:39.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.551+0000 7f6be9dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6be41542a0 0x7f6be415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.551+0000 7f6be9dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be40aa4d0 con 0x7f6be4153ec0 2023-07-27T14:38:39.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.551+0000 7f6be9dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be40c05c0 con 0x7f6be40aaa40 2023-07-27T14:38:39.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.551+0000 7f6be9dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be40c1a60 con 0x7f6be41542a0 2023-07-27T14:38:39.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.551+0000 7f6be3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6be41542a0 0x7f6be415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6be41542a0 0x7f6be415efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56732/0 (socket says 172.21.15.115:56732) 2023-07-27T14:38:39.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be3fff700 1 -- 172.21.15.115:0/597324200 learned_addr learned my addr 172.21.15.115:0/597324200 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:39.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be3fff700 1 -- 172.21.15.115:0/597324200 >> v1:172.21.15.159:6789/0 conn(0x7f6be40aaa40 legacy=0x7f6be40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be3fff700 1 -- 172.21.15.115:0/597324200 >> v1:172.21.15.115:6789/0 conn(0x7f6be4153ec0 legacy=0x7f6be40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be3fff700 1 -- 172.21.15.115:0/597324200 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40aa270 con 0x7f6be41542a0 2023-07-27T14:38:39.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be3fff700 1 --2- 172.21.15.115:0/597324200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be415efc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f6bdc009f20 tx=0x7f6bdc009840).ready entity=mon.0 client_cookie=5f575171bdec4959 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:39.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be27fc700 1 -- 172.21.15.115:0/597324200 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00e070 con 0x7f6be41542a0 2023-07-27T14:38:39.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be27fc700 1 -- 172.21.15.115:0/597324200 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc00ba80 con 0x7f6be41542a0 2023-07-27T14:38:39.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.552+0000 7f6be27fc700 1 -- 172.21.15.115:0/597324200 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00be00 con 0x7f6be41542a0 2023-07-27T14:38:39.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.553+0000 7f6be9dff700 1 -- 172.21.15.115:0/597324200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 msgr2=0x7f6be415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.553+0000 7f6be9dff700 1 --2- 172.21.15.115:0/597324200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be415efc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f6bdc009f20 tx=0x7f6bdc009840).stop 2023-07-27T14:38:39.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.553+0000 7f6be9dff700 1 -- 172.21.15.115:0/597324200 shutdown_connections 2023-07-27T14:38:39.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.553+0000 7f6be9dff700 1 --2- 172.21.15.115:0/597324200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be415efc0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.553+0000 7f6be9dff700 1 -- 172.21.15.115:0/597324200 >> 172.21.15.115:0/597324200 conn(0x7f6be40cb610 msgr2=0x7f6be40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.553+0000 7f6be9dff700 1 -- 172.21.15.115:0/597324200 shutdown_connections 2023-07-27T14:38:39.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.553+0000 7f6be9dff700 1 -- 172.21.15.115:0/597324200 wait complete. 2023-07-27T14:38:39.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.554+0000 7f6be9dff700 1 Processor -- start 2023-07-27T14:38:39.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.555+0000 7f6be9dff700 1 -- start start 2023-07-27T14:38:39.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.555+0000 7f6be9dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40aaa40 0x7f6be4159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.555+0000 7f6be9dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6be4153ec0 0x7f6be4156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be9dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be4164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be9dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4158210 con 0x7f6be41542a0 2023-07-27T14:38:39.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be9dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4157170 con 0x7f6be40aaa40 2023-07-27T14:38:39.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be9dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4157450 con 0x7f6be4153ec0 2023-07-27T14:38:39.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be4164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be4164410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56740/0 (socket says 172.21.15.115:56740) 2023-07-27T14:38:39.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 -- 172.21.15.115:0/3903832913 learned_addr learned my addr 172.21.15.115:0/3903832913 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:39.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be37fe700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40aaa40 0x7f6be4159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be2ffd700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6be4153ec0 0x7f6be4156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 -- 172.21.15.115:0/3903832913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6be4153ec0 msgr2=0x7f6be4156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6be4153ec0 0x7f6be4156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 -- 172.21.15.115:0/3903832913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40aaa40 msgr2=0x7f6be4159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40aaa40 0x7f6be4159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 -- 172.21.15.115:0/3903832913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc009ae0 con 0x7f6be41542a0 2023-07-27T14:38:39.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.556+0000 7f6be3fff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be4164410 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f6bdc009590 tx=0x7f6be40c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:39.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.557+0000 7f6bcb7fe700 1 -- 172.21.15.115:0/3903832913 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc01d410 con 0x7f6be41542a0 2023-07-27T14:38:39.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.557+0000 7f6bcb7fe700 1 -- 172.21.15.115:0/3903832913 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc01d570 con 0x7f6be41542a0 2023-07-27T14:38:39.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.557+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be4157730 con 0x7f6be41542a0 2023-07-27T14:38:39.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.557+0000 7f6bcb7fe700 1 -- 172.21.15.115:0/3903832913 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc01d910 con 0x7f6be41542a0 2023-07-27T14:38:39.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.557+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be4157cf0 con 0x7f6be41542a0 2023-07-27T14:38:39.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.558+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be406c470 con 0x7f6be41542a0 2023-07-27T14:38:39.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.559+0000 7f6bcb7fe700 1 -- 172.21.15.115:0/3903832913 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f6bdc01b040 con 0x7f6be41542a0 2023-07-27T14:38:39.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.559+0000 7f6bcb7fe700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bd005fb50 0x7f6bd0062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:39.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.559+0000 7f6bcb7fe700 1 -- 172.21.15.115:0/3903832913 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f6bdc07ce80 con 0x7f6be41542a0 2023-07-27T14:38:39.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.560+0000 7f6be37fe700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bd005fb50 0x7f6bd0062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:39.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.560+0000 7f6be37fe700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bd005fb50 0x7f6bd0062010 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f6be4152840 tx=0x7f6bd4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:39.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.564+0000 7f6bcb7fe700 1 -- 172.21.15.115:0/3903832913 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6bdc04d510 con 0x7f6be41542a0 2023-07-27T14:38:39.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.776+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6be40bfc90 con 0x7f6be41542a0 2023-07-27T14:38:39.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.776+0000 7f6bcb7fe700 1 -- 172.21.15.115:0/3903832913 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f6bdc024310 con 0x7f6be41542a0 2023-07-27T14:38:39.829 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:39.829 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":94,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3836371},{"type":"v1","addr":"172.21.15.159:6833","nonce":3836371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1315171707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1315171707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1315171707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1825044502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1825044502},{"type":"v1","addr":"172.21.15.159:6835","nonce":1825044502}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:37:52.356956+0000","modified":"2023-07-27T14:37:55.374238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9222":{"gid":9222,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/991393631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":991393631},{"type":"v1","addr":"172.21.15.115:6836","nonce":991393631}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-07-27T14:38:39.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bd005fb50 msgr2=0x7f6bd0062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bd005fb50 0x7f6bd0062010 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f6be4152840 tx=0x7f6bd4009040).stop 2023-07-27T14:38:39.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 msgr2=0x7f6be4164410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:39.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be4164410 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f6bdc009590 tx=0x7f6be40c0530).stop 2023-07-27T14:38:39.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 shutdown_connections 2023-07-27T14:38:39.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6bd005fb50 0x7f6bd0062010 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6be41542a0 0x7f6be4164410 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be40aaa40 0x7f6be4159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 --2- 172.21.15.115:0/3903832913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6be4153ec0 0x7f6be4156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:39.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.778+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 >> 172.21.15.115:0/3903832913 conn(0x7f6be40cb610 msgr2=0x7f6be4153090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:39.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.779+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 shutdown_connections 2023-07-27T14:38:39.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.779+0000 7f6be9dff700 1 -- 172.21.15.115:0/3903832913 wait complete. 2023-07-27T14:38:39.833 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 94 2023-07-27T14:38:39.848 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:38:40.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.990+0000 7f9ead3ff700 1 Processor -- start 2023-07-27T14:38:40.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.990+0000 7f9ead3ff700 1 -- start start 2023-07-27T14:38:40.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.991+0000 7f9ead3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9ea8065ff0 0x7f9ea8066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.991+0000 7f9ead3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea8067080 con 0x7f9ea8151d70 2023-07-27T14:38:40.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.991+0000 7f9ead3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea8066df0 con 0x7f9ea8066960 2023-07-27T14:38:40.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.991+0000 7f9ead3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea8063a90 con 0x7f9ea8065ff0 2023-07-27T14:38:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.991+0000 7f9ea6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9ea8151d70 0x7f9ea8155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53984/0 (socket says 172.21.15.115:53984) 2023-07-27T14:38:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.991+0000 7f9ea6ffd700 1 -- 172.21.15.115:0/2376420656 learned_addr learned my addr 172.21.15.115:0/2376420656 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea67fc700 1 --2- 172.21.15.115:0/2376420656 >> v2:172.21.15.159:3300/0 conn(0x7f9ea8065ff0 0x7f9ea8066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739344927 0 0) 0x7f9ea8067080 con 0x7f9ea8151d70 2023-07-27T14:38:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e900033f0 con 0x7f9ea8151d70 2023-07-27T14:38:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4237913783 0 0) 0x7f9e900033f0 con 0x7f9ea8151d70 2023-07-27T14:38:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 >> v2:172.21.15.159:3300/0 conn(0x7f9ea8065ff0 msgr2=0x7f9ea8066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 --2- 172.21.15.115:0/2376420656 >> v2:172.21.15.159:3300/0 conn(0x7f9ea8065ff0 0x7f9ea8066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 >> v1:172.21.15.159:6789/0 conn(0x7f9ea8066960 legacy=0x7f9ea8067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80634d0 con 0x7f9ea8151d70 2023-07-27T14:38:40.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f9e98001470 con 0x7f9ea8151d70 2023-07-27T14:38:40.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 >> v1:172.21.15.115:6789/0 conn(0x7f9ea8151d70 legacy=0x7f9ea8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e900038e0 0x7f9e90003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90004690 0x7f9e90004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9e9000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8063a90 con 0x7f9e90005000 2023-07-27T14:38:40.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9000be00 con 0x7f9e900038e0 2023-07-27T14:38:40.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.992+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9000bfc0 con 0x7f9e90004690 2023-07-27T14:38:40.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea77fe700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9e9000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea6ffd700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e900038e0 0x7f9e90003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea67fc700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90004690 0x7f9e90004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea77fe700 1 -- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90004690 msgr2=0x7f9e90004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:40.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea77fe700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e90004690 0x7f9e90004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea77fe700 1 -- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e900038e0 msgr2=0x7f9e90003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:40.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea77fe700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e900038e0 0x7f9e90003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea77fe700 1 -- 172.21.15.115:0/2376420656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900033f0 con 0x7f9e90005000 2023-07-27T14:38:40.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea6ffd700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e900038e0 0x7f9e90003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:40.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea77fe700 1 -- 172.21.15.115:0/2376420656 reap_dead start 2023-07-27T14:38:40.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea77fe700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9e9000b8e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f9ea0001fe0 tx=0x7f9ea0007f30).ready entity=mon.0 client_cookie=a8626d638a70432c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000c870 con 0x7f9e90005000 2023-07-27T14:38:40.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0003030 con 0x7f9e90005000 2023-07-27T14:38:40.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.993+0000 7f9ea5ffb700 1 -- 172.21.15.115:0/2376420656 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000cc40 con 0x7f9e90005000 2023-07-27T14:38:40.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.994+0000 7f9ead3ff700 1 -- 172.21.15.115:0/2376420656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 msgr2=0x7f9e9000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.994+0000 7f9ead3ff700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9e9000b8e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f9ea0001fe0 tx=0x7f9ea0007f30).stop 2023-07-27T14:38:40.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.994+0000 7f9ead3ff700 1 -- 172.21.15.115:0/2376420656 shutdown_connections 2023-07-27T14:38:40.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.994+0000 7f9ead3ff700 1 --2- 172.21.15.115:0/2376420656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9e9000b8e0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.994+0000 7f9ead3ff700 1 -- 172.21.15.115:0/2376420656 >> 172.21.15.115:0/2376420656 conn(0x7f9ea80c89a0 msgr2=0x7f9ea80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:40.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.994+0000 7f9ead3ff700 1 -- 172.21.15.115:0/2376420656 shutdown_connections 2023-07-27T14:38:40.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.994+0000 7f9ead3ff700 1 -- 172.21.15.115:0/2376420656 wait complete. 2023-07-27T14:38:40.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.995+0000 7f9ead3ff700 1 Processor -- start 2023-07-27T14:38:40.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.996+0000 7f9ead3ff700 1 -- start start 2023-07-27T14:38:40.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.996+0000 7f9ead3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9ea80a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.996+0000 7f9ead3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80a6050 0x7f9ea81505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.996+0000 7f9ead3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ea8150ad0 0x7f9ea80aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.996+0000 7f9ead3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80a64d0 con 0x7f9e90005000 2023-07-27T14:38:40.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.996+0000 7f9ead3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8150150 con 0x7f9ea80a6050 2023-07-27T14:38:40.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.996+0000 7f9ead3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8150f50 con 0x7f9ea8150ad0 2023-07-27T14:38:40.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9ea80a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9ea80a5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56770/0 (socket says 172.21.15.115:56770) 2023-07-27T14:38:40.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 -- 172.21.15.115:0/292387805 learned_addr learned my addr 172.21.15.115:0/292387805 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:40.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea77fe700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ea8150ad0 0x7f9ea80aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea67fc700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80a6050 0x7f9ea81505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 -- 172.21.15.115:0/292387805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ea8150ad0 msgr2=0x7f9ea80aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ea8150ad0 0x7f9ea80aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 -- 172.21.15.115:0/292387805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80a6050 msgr2=0x7f9ea81505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80a6050 0x7f9ea81505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 -- 172.21.15.115:0/292387805 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea814f540 con 0x7f9e90005000 2023-07-27T14:38:40.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ea6ffd700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9ea80a5b60 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7f9e9800e780 tx=0x7f9e98000d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9e8effd700 1 -- 172.21.15.115:0/292387805 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98010490 con 0x7f9e90005000 2023-07-27T14:38:40.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9e8effd700 1 -- 172.21.15.115:0/292387805 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98010040 con 0x7f9e90005000 2023-07-27T14:38:40.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9e8effd700 1 -- 172.21.15.115:0/292387805 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98010800 con 0x7f9e90005000 2023-07-27T14:38:40.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.997+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea814f820 con 0x7f9e90005000 2023-07-27T14:38:40.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.998+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea814fde0 con 0x7f9e90005000 2023-07-27T14:38:40.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.999+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea806c470 con 0x7f9e90005000 2023-07-27T14:38:40.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:39.999+0000 7f9e8effd700 1 -- 172.21.15.115:0/292387805 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f9e98010b70 con 0x7f9e90005000 2023-07-27T14:38:40.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.000+0000 7f9e8effd700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e9405fb50 0x7f9e94062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.000+0000 7f9e8effd700 1 -- 172.21.15.115:0/292387805 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f9e9807aa30 con 0x7f9e90005000 2023-07-27T14:38:40.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.000+0000 7f9ea67fc700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e9405fb50 0x7f9e94062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.001+0000 7f9ea67fc700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e9405fb50 0x7f9e94062010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f9e9c006b00 tx=0x7f9e9c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.004+0000 7f9e8effd700 1 -- 172.21.15.115:0/292387805 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e9804b060 con 0x7f9e90005000 2023-07-27T14:38:40.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.216+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ea8150430 con 0x7f9e90005000 2023-07-27T14:38:40.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.217+0000 7f9e8effd700 1 -- 172.21.15.115:0/292387805 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4493 (secure 0 0 0) 0x7f9e9801a030 con 0x7f9e90005000 2023-07-27T14:38:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:40.270 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":94,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3836371},{"type":"v1","addr":"172.21.15.159:6833","nonce":3836371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1315171707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1315171707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1315171707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1825044502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1825044502},{"type":"v1","addr":"172.21.15.159:6835","nonce":1825044502}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:37:52.356956+0000","modified":"2023-07-27T14:37:55.374238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9222":{"gid":9222,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/991393631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":991393631},{"type":"v1","addr":"172.21.15.115:6836","nonce":991393631}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-07-27T14:38:40.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e9405fb50 msgr2=0x7f9e94062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e9405fb50 0x7f9e94062010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f9e9c006b00 tx=0x7f9e9c008040).stop 2023-07-27T14:38:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 msgr2=0x7f9ea80a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9ea80a5b60 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7f9e9800e780 tx=0x7f9e98000d20).stop 2023-07-27T14:38:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 shutdown_connections 2023-07-27T14:38:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e9405fb50 0x7f9e94062010 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9ea8150ad0 0x7f9ea80aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e90005000 0x7f9ea80a5b60 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 --2- 172.21.15.115:0/292387805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ea80a6050 0x7f9ea81505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 >> 172.21.15.115:0/292387805 conn(0x7f9ea80c89a0 msgr2=0x7f9ea80c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:40.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.219+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 shutdown_connections 2023-07-27T14:38:40.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.220+0000 7f9ead3ff700 1 -- 172.21.15.115:0/292387805 wait complete. 2023-07-27T14:38:40.274 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 94 2023-07-27T14:38:40.289 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:38:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.428+0000 7f64b13ff700 1 Processor -- start 2023-07-27T14:38:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.428+0000 7f64b13ff700 1 -- start start 2023-07-27T14:38:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.429+0000 7f64b13ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac0aaa40 0x7f64ac0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.429+0000 7f64b13ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f64ac1542a0 0x7f64ac0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.429+0000 7f64b13ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac0aa4d0 con 0x7f64ac153ec0 2023-07-27T14:38:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.429+0000 7f64b13ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac064ad0 con 0x7f64ac1542a0 2023-07-27T14:38:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.429+0000 7f64b13ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c05c0 con 0x7f64ac0aaa40 2023-07-27T14:38:40.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64aa7fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac0aaa40 0x7f64ac0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64aaffd700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f64ac153ec0 0x7f64ac0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:56694/0 (socket says 172.21.15.115:56694) 2023-07-27T14:38:40.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64aaffd700 1 -- 172.21.15.115:0/3643278509 learned_addr learned my addr 172.21.15.115:0/3643278509 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:40.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64ab7fe700 1 --2- 172.21.15.115:0/3643278509 >> v2:172.21.15.159:3300/0 conn(0x7f64ac1542a0 0x7f64ac0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64aa7fc700 1 -- 172.21.15.115:0/3643278509 >> v2:172.21.15.159:3300/0 conn(0x7f64ac1542a0 msgr2=0x7f64ac0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:40.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64aa7fc700 1 --2- 172.21.15.115:0/3643278509 >> v2:172.21.15.159:3300/0 conn(0x7f64ac1542a0 0x7f64ac0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64aa7fc700 1 -- 172.21.15.115:0/3643278509 >> v1:172.21.15.159:6789/0 conn(0x7f64ac153ec0 legacy=0x7f64ac0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64aa7fc700 1 -- 172.21.15.115:0/3643278509 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0c1a60 con 0x7f64ac0aaa40 2023-07-27T14:38:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64a9ffb700 1 -- 172.21.15.115:0/3643278509 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743418294 0 0) 0x7f649c001110 con 0x7f64ac153ec0 2023-07-27T14:38:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.430+0000 7f64aa7fc700 1 --2- 172.21.15.115:0/3643278509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac0aaa40 0x7f64ac0640f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f64a0009760 tx=0x7f64a0009060).ready entity=mon.2 client_cookie=1360bcba9a8a52f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64a9ffb700 1 -- 172.21.15.115:0/3643278509 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000f510 con 0x7f64ac0aaa40 2023-07-27T14:38:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64a9ffb700 1 -- 172.21.15.115:0/3643278509 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a000f670 con 0x7f64ac0aaa40 2023-07-27T14:38:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64a9ffb700 1 -- 172.21.15.115:0/3643278509 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000f9f0 con 0x7f64ac0aaa40 2023-07-27T14:38:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64b13ff700 1 -- 172.21.15.115:0/3643278509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac0aaa40 msgr2=0x7f64ac0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64b13ff700 1 --2- 172.21.15.115:0/3643278509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac0aaa40 0x7f64ac0640f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f64a0009760 tx=0x7f64a0009060).stop 2023-07-27T14:38:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64b13ff700 1 -- 172.21.15.115:0/3643278509 shutdown_connections 2023-07-27T14:38:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64b13ff700 1 --2- 172.21.15.115:0/3643278509 >> v2:172.21.15.159:3300/0 conn(0x7f64ac1542a0 0x7f64ac0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64b13ff700 1 --2- 172.21.15.115:0/3643278509 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac0aaa40 0x7f64ac0640f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64b13ff700 1 -- 172.21.15.115:0/3643278509 >> 172.21.15.115:0/3643278509 conn(0x7f64ac0cb610 msgr2=0x7f64ac0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:40.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64b13ff700 1 -- 172.21.15.115:0/3643278509 shutdown_connections 2023-07-27T14:38:40.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.431+0000 7f64b13ff700 1 -- 172.21.15.115:0/3643278509 wait complete. 2023-07-27T14:38:40.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.433+0000 7f64b13ff700 1 Processor -- start 2023-07-27T14:38:40.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.433+0000 7f64b13ff700 1 -- start start 2023-07-27T14:38:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64b13ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64ac0aaa40 0x7f64ac144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64b13ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac153ec0 0x7f64ac0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64b13ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ac1542a0 0x7f64ac0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64b13ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0ca720 con 0x7f64ac0aaa40 2023-07-27T14:38:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64b13ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac148330 con 0x7f64ac1542a0 2023-07-27T14:38:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64b13ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac147720 con 0x7f64ac153ec0 2023-07-27T14:38:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64aaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64ac0aaa40 0x7f64ac144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64aaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64ac0aaa40 0x7f64ac144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56778/0 (socket says 172.21.15.115:56778) 2023-07-27T14:38:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64aa7fc700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac153ec0 0x7f64ac0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64aaffd700 1 -- 172.21.15.115:0/216721897 learned_addr learned my addr 172.21.15.115:0/216721897 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.434+0000 7f64ab7fe700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ac1542a0 0x7f64ac0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f64aa7fc700 1 -- 172.21.15.115:0/216721897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ac1542a0 msgr2=0x7f64ac0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f64aa7fc700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ac1542a0 0x7f64ac0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f64aa7fc700 1 -- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64ac0aaa40 msgr2=0x7f64ac144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f64aa7fc700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64ac0aaa40 0x7f64ac144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f64aa7fc700 1 -- 172.21.15.115:0/216721897 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a00092a0 con 0x7f64ac153ec0 2023-07-27T14:38:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f64aa7fc700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac153ec0 0x7f64ac0c9d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f64ac083e30 tx=0x7f64a0017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f6492ffd700 1 -- 172.21.15.115:0/216721897 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000fe80 con 0x7f64ac153ec0 2023-07-27T14:38:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f6492ffd700 1 -- 172.21.15.115:0/216721897 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a000f7e0 con 0x7f64ac153ec0 2023-07-27T14:38:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f6492ffd700 1 -- 172.21.15.115:0/216721897 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a001b690 con 0x7f64ac153ec0 2023-07-27T14:38:40.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac147a00 con 0x7f64ac153ec0 2023-07-27T14:38:40.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.435+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac147fc0 con 0x7f64ac153ec0 2023-07-27T14:38:40.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.436+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac06c470 con 0x7f64ac153ec0 2023-07-27T14:38:40.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.437+0000 7f6492ffd700 1 -- 172.21.15.115:0/216721897 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f64a002a070 con 0x7f64ac153ec0 2023-07-27T14:38:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.438+0000 7f6492ffd700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f649805fb20 0x7f6498061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.438+0000 7f6492ffd700 1 -- 172.21.15.115:0/216721897 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f64a0040020 con 0x7f64ac153ec0 2023-07-27T14:38:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.438+0000 7f64aaffd700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f649805fb20 0x7f6498061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.439+0000 7f64aaffd700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f649805fb20 0x7f6498061fe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f649c007620 tx=0x7f649c007ad0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.442+0000 7f6492ffd700 1 -- 172.21.15.115:0/216721897 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f64a004d0b0 con 0x7f64ac153ec0 2023-07-27T14:38:40.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.612+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64ac0c8230 con 0x7f64ac153ec0 2023-07-27T14:38:40.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.613+0000 7f6492ffd700 1 -- 172.21.15.115:0/216721897 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+17197 (secure 0 0 0) 0x7f64a0028020 con 0x7f64ac153ec0 2023-07-27T14:38:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:40.667 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":175,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:38:37.821500+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:37:50.684543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-27T14:37:51.340294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":175,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":24,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:38:40.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f649805fb20 msgr2=0x7f6498061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f649805fb20 0x7f6498061fe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f649c007620 tx=0x7f649c007ad0).stop 2023-07-27T14:38:40.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac153ec0 msgr2=0x7f64ac0c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac153ec0 0x7f64ac0c9d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f64ac083e30 tx=0x7f64a0017000).stop 2023-07-27T14:38:40.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 shutdown_connections 2023-07-27T14:38:40.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f649805fb20 0x7f6498061fe0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64ac1542a0 0x7f64ac0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64ac0aaa40 0x7f64ac144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 --2- 172.21.15.115:0/216721897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64ac153ec0 0x7f64ac0c9d40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 >> 172.21.15.115:0/216721897 conn(0x7f64ac0cb610 msgr2=0x7f64ac0ab210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:40.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.615+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 shutdown_connections 2023-07-27T14:38:40.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.616+0000 7f64b13ff700 1 -- 172.21.15.115:0/216721897 wait complete. 2023-07-27T14:38:40.685 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:38:40.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.821+0000 7f8f0b9ff700 1 Processor -- start 2023-07-27T14:38:40.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.821+0000 7f8f0b9ff700 1 -- start start 2023-07-27T14:38:40.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.822+0000 7f8f0b9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f04153ec0 0x7f8f040a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f0b9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f040aaa40 0x7f8f040c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f0b9ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f040aa4d0 con 0x7f8f040aa050 2023-07-27T14:38:40.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f0b9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f040c05c0 con 0x7f8f040aaa40 2023-07-27T14:38:40.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f0b9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040bfc90 con 0x7f8f04153ec0 2023-07-27T14:38:40.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f09f9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f040aaa40 0x7f8f040c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f09f9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f040aaa40 0x7f8f040c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56790/0 (socket says 172.21.15.115:56790) 2023-07-27T14:38:40.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f09f9c700 1 -- 172.21.15.115:0/1293946698 learned_addr learned my addr 172.21.15.115:0/1293946698 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f09f9c700 1 -- 172.21.15.115:0/1293946698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f04153ec0 msgr2=0x7f8f040a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f0979b700 1 --2- 172.21.15.115:0/1293946698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f04153ec0 0x7f8f040a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f09f9c700 1 --2- 172.21.15.115:0/1293946698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f04153ec0 0x7f8f040a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f09f9c700 1 -- 172.21.15.115:0/1293946698 >> v1:172.21.15.159:6789/0 conn(0x7f8f040aa050 legacy=0x7f8f040640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f09f9c700 1 -- 172.21.15.115:0/1293946698 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040bff70 con 0x7f8f040aaa40 2023-07-27T14:38:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.823+0000 7f8f0979b700 1 --2- 172.21.15.115:0/1293946698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f04153ec0 0x7f8f040a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f09f9c700 1 --2- 172.21.15.115:0/1293946698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aaa40 0x7f8f040c0a50 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7f8efc009f20 tx=0x7f8efc009840).ready entity=mon.0 client_cookie=69896f8d55d11a41 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8efbfff700 1 -- 172.21.15.115:0/1293946698 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00e070 con 0x7f8f040aaa40 2023-07-27T14:38:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8efbfff700 1 -- 172.21.15.115:0/1293946698 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc00ba40 con 0x7f8f040aaa40 2023-07-27T14:38:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8efbfff700 1 -- 172.21.15.115:0/1293946698 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00bdc0 con 0x7f8f040aaa40 2023-07-27T14:38:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1293946698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aaa40 msgr2=0x7f8f040c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1293946698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aaa40 0x7f8f040c0a50 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7f8efc009f20 tx=0x7f8efc009840).stop 2023-07-27T14:38:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1293946698 shutdown_connections 2023-07-27T14:38:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1293946698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f04153ec0 0x7f8f040a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1293946698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aaa40 0x7f8f040c0a50 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1293946698 >> 172.21.15.115:0/1293946698 conn(0x7f8f040cb610 msgr2=0x7f8f040c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1293946698 shutdown_connections 2023-07-27T14:38:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.824+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1293946698 wait complete. 2023-07-27T14:38:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.826+0000 7f8f0b9ff700 1 Processor -- start 2023-07-27T14:38:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.826+0000 7f8f0b9ff700 1 -- start start 2023-07-27T14:38:40.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0b9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aa050 0x7f8f041528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0b9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f040aaa40 0x7f8f04152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0b9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f04153ec0 0x7f8f04167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0b9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04153290 con 0x7f8f040aa050 2023-07-27T14:38:40.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0b9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0414ffc0 con 0x7f8f04153ec0 2023-07-27T14:38:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0b9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04150210 con 0x7f8f040aaa40 2023-07-27T14:38:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0979b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aa050 0x7f8f041528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0979b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aa050 0x7f8f041528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56802/0 (socket says 172.21.15.115:56802) 2023-07-27T14:38:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0979b700 1 -- 172.21.15.115:0/1862862074 learned_addr learned my addr 172.21.15.115:0/1862862074 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:40.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0979b700 1 -- 172.21.15.115:0/1862862074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f040aaa40 msgr2=0x7f8f04152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0979b700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f040aaa40 0x7f8f04152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0979b700 1 -- 172.21.15.115:0/1862862074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f04153ec0 msgr2=0x7f8f04167bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0979b700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f04153ec0 0x7f8f04167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.827+0000 7f8f0979b700 1 -- 172.21.15.115:0/1862862074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009ae0 con 0x7f8f040aa050 2023-07-27T14:38:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.828+0000 7f8f0979b700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aa050 0x7f8f041528b0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f8f0000c880 tx=0x7f8f00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.828+0000 7f8ef97fa700 1 -- 172.21.15.115:0/1862862074 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00010580 con 0x7f8f040aa050 2023-07-27T14:38:40.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.828+0000 7f8ef97fa700 1 -- 172.21.15.115:0/1862862074 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000106e0 con 0x7f8f040aa050 2023-07-27T14:38:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.828+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f041504f0 con 0x7f8f040aa050 2023-07-27T14:38:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.828+0000 7f8ef97fa700 1 -- 172.21.15.115:0/1862862074 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00010a80 con 0x7f8f040aa050 2023-07-27T14:38:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.828+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f04150ab0 con 0x7f8f040aa050 2023-07-27T14:38:40.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.829+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0406c470 con 0x7f8f040aa050 2023-07-27T14:38:40.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.830+0000 7f8ef97fa700 1 -- 172.21.15.115:0/1862862074 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f8f0001b460 con 0x7f8f040aa050 2023-07-27T14:38:40.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.831+0000 7f8ef97fa700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ee805fb50 0x7f8ee8062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:40.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.832+0000 7f8ef97fa700 1 -- 172.21.15.115:0/1862862074 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f8f0007b1f0 con 0x7f8f040aa050 2023-07-27T14:38:40.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.832+0000 7f8f08f9a700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ee805fb50 0x7f8ee8062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:40.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.832+0000 7f8f08f9a700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ee805fb50 0x7f8ee8062010 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f8f040c6410 tx=0x7f8ef40079a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:40.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:40.835+0000 7f8ef97fa700 1 -- 172.21.15.115:0/1862862074 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f0004b910 con 0x7f8f040aa050 2023-07-27T14:38:41.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.049+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8f040c4ef0 con 0x7f8f040aa050 2023-07-27T14:38:41.891 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:38:41.838+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:38:41.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.847+0000 7f8ef97fa700 1 -- 172.21.15.115:0/1862862074 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8f0004ef30 con 0x7f8f040aa050 2023-07-27T14:38:41.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ee805fb50 msgr2=0x7f8ee8062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:41.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ee805fb50 0x7f8ee8062010 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f8f040c6410 tx=0x7f8ef40079a0).stop 2023-07-27T14:38:41.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aa050 msgr2=0x7f8f041528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:41.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aa050 0x7f8f041528b0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f8f0000c880 tx=0x7f8f00008040).stop 2023-07-27T14:38:41.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 shutdown_connections 2023-07-27T14:38:41.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8ee805fb50 0x7f8ee8062010 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:41.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f04153ec0 0x7f8f04167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:41.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f040aa050 0x7f8f041528b0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:41.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 --2- 172.21.15.115:0/1862862074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f040aaa40 0x7f8f04152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 >> 172.21.15.115:0/1862862074 conn(0x7f8f040cb610 msgr2=0x7f8f040afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 shutdown_connections 2023-07-27T14:38:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:41.850+0000 7f8f0b9ff700 1 -- 172.21.15.115:0/1862862074 wait complete. 2023-07-27T14:38:41.905 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:38:41.924 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:38:41.969 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:38:42.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.068+0000 7fadcc5ff700 1 Processor -- start 2023-07-27T14:38:42.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.068+0000 7fadcc5ff700 1 -- start start 2023-07-27T14:38:42.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcc5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fadc4063260 0x7fadc4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:42.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcc5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadc414b1e0 0x7fadc40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:42.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcc5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc41553f0 con 0x7fadc414ae00 2023-07-27T14:38:42.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcc5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc4157a50 con 0x7fadc414b1e0 2023-07-27T14:38:42.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcc5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc4157d10 con 0x7fadc4063260 2023-07-27T14:38:42.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcab9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fadc414b1e0 0x7fadc40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:42.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadca39b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fadc414ae00 0x7fadc4062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54006/0 (socket says 172.21.15.115:54006) 2023-07-27T14:38:42.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadca39b700 1 -- 172.21.15.115:0/2227656122 learned_addr learned my addr 172.21.15.115:0/2227656122 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadc9b9a700 1 --2- 172.21.15.115:0/2227656122 >> v2:172.21.15.159:3300/0 conn(0x7fadc4063260 0x7fadc4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcab9c700 1 -- 172.21.15.115:0/2227656122 >> v2:172.21.15.159:3300/0 conn(0x7fadc4063260 msgr2=0x7fadc4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcab9c700 1 --2- 172.21.15.115:0/2227656122 >> v2:172.21.15.159:3300/0 conn(0x7fadc4063260 0x7fadc4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.070+0000 7fadcab9c700 1 -- 172.21.15.115:0/2227656122 >> v1:172.21.15.115:6789/0 conn(0x7fadc414ae00 legacy=0x7fadc4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.071+0000 7fadcab9c700 1 -- 172.21.15.115:0/2227656122 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4157ff0 con 0x7fadc414b1e0 2023-07-27T14:38:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.071+0000 7fadc9399700 1 -- 172.21.15.115:0/2227656122 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438404544 0 0) 0x7fadc41553f0 con 0x7fadc414ae00 2023-07-27T14:38:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.071+0000 7fadcab9c700 1 --2- 172.21.15.115:0/2227656122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414b1e0 0x7fadc40a98c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fadc40cbc00 tx=0x7fadbc009780).ready entity=mon.0 client_cookie=f4fc1af452aeb59b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.071+0000 7fadc9399700 1 -- 172.21.15.115:0/2227656122 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc00e070 con 0x7fadc414b1e0 2023-07-27T14:38:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.071+0000 7fadc9399700 1 -- 172.21.15.115:0/2227656122 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc00bc30 con 0x7fadc414b1e0 2023-07-27T14:38:42.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.071+0000 7fadc9399700 1 -- 172.21.15.115:0/2227656122 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc012410 con 0x7fadc414b1e0 2023-07-27T14:38:42.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.071+0000 7fadcc5ff700 1 -- 172.21.15.115:0/2227656122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414b1e0 msgr2=0x7fadc40a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:42.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.071+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/2227656122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414b1e0 0x7fadc40a98c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fadc40cbc00 tx=0x7fadbc009780).stop 2023-07-27T14:38:42.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.072+0000 7fadcc5ff700 1 -- 172.21.15.115:0/2227656122 shutdown_connections 2023-07-27T14:38:42.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.072+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/2227656122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414b1e0 0x7fadc40a98c0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.072+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/2227656122 >> v2:172.21.15.159:3300/0 conn(0x7fadc4063260 0x7fadc4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.072+0000 7fadcc5ff700 1 -- 172.21.15.115:0/2227656122 >> 172.21.15.115:0/2227656122 conn(0x7fadc405e940 msgr2=0x7fadc40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.072+0000 7fadcc5ff700 1 -- 172.21.15.115:0/2227656122 shutdown_connections 2023-07-27T14:38:42.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.072+0000 7fadcc5ff700 1 -- 172.21.15.115:0/2227656122 wait complete. 2023-07-27T14:38:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.073+0000 7fadcc5ff700 1 Processor -- start 2023-07-27T14:38:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.073+0000 7fadcc5ff700 1 -- start start 2023-07-27T14:38:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.074+0000 7fadcc5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc4063260 0x7fadc41495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.074+0000 7fadcc5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414ae00 0x7fadc40aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.074+0000 7fadcc5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc414b1e0 0x7fadc40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:42.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.074+0000 7fadcc5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc40ab620 con 0x7fadc414ae00 2023-07-27T14:38:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.074+0000 7fadcc5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc414c6e0 con 0x7fadc414b1e0 2023-07-27T14:38:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.074+0000 7fadcc5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc414bad0 con 0x7fadc4063260 2023-07-27T14:38:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.074+0000 7fadc9b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414ae00 0x7fadc40aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadc9b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414ae00 0x7fadc40aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56842/0 (socket says 172.21.15.115:56842) 2023-07-27T14:38:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadc9b9a700 1 -- 172.21.15.115:0/1414581541 learned_addr learned my addr 172.21.15.115:0/1414581541 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:42.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadca39b700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc4063260 0x7fadc41495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadcab9c700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc414b1e0 0x7fadc40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadc9b9a700 1 -- 172.21.15.115:0/1414581541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc4063260 msgr2=0x7fadc41495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadc9b9a700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc4063260 0x7fadc41495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadc9b9a700 1 -- 172.21.15.115:0/1414581541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc414b1e0 msgr2=0x7fadc40ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadc9b9a700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc414b1e0 0x7fadc40ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadc9b9a700 1 -- 172.21.15.115:0/1414581541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc009a20 con 0x7fadc414ae00 2023-07-27T14:38:42.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadc9b9a700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414ae00 0x7fadc40aac40 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7fadb400d860 tx=0x7fadb4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadba7fc700 1 -- 172.21.15.115:0/1414581541 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40125f0 con 0x7fadc414ae00 2023-07-27T14:38:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadba7fc700 1 -- 172.21.15.115:0/1414581541 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb4012750 con 0x7fadc414ae00 2023-07-27T14:38:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc414bdb0 con 0x7fadc414ae00 2023-07-27T14:38:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.075+0000 7fadba7fc700 1 -- 172.21.15.115:0/1414581541 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4012ad0 con 0x7fadc414ae00 2023-07-27T14:38:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.076+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc414c370 con 0x7fadc414ae00 2023-07-27T14:38:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.076+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc414c870 con 0x7fadc414ae00 2023-07-27T14:38:42.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.077+0000 7fadba7fc700 1 -- 172.21.15.115:0/1414581541 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fadb4013480 con 0x7fadc414ae00 2023-07-27T14:38:42.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.078+0000 7fadba7fc700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada805fb50 0x7fada8062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:42.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.078+0000 7fadba7fc700 1 -- 172.21.15.115:0/1414581541 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fadb407b4d0 con 0x7fadc414ae00 2023-07-27T14:38:42.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.078+0000 7fadca39b700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada805fb50 0x7fada8062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:42.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.079+0000 7fadca39b700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada805fb50 0x7fada8062010 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fadc00011e0 tx=0x7fadc0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:42.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.082+0000 7fadba7fc700 1 -- 172.21.15.115:0/1414581541 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fadb404bad0 con 0x7fadc414ae00 2023-07-27T14:38:42.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.293+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fadc406c470 con 0x7fadc414ae00 2023-07-27T14:38:42.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.848+0000 7fadba7fc700 1 -- 172.21.15.115:0/1414581541 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v96) v1 ==== 104+0+0 (secure 0 0 0) 0x7fadb404f0f0 con 0x7fadc414ae00 2023-07-27T14:38:42.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada805fb50 msgr2=0x7fada8062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:42.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada805fb50 0x7fada8062010 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fadc00011e0 tx=0x7fadc0009040).stop 2023-07-27T14:38:42.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414ae00 msgr2=0x7fadc40aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:42.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414ae00 0x7fadc40aac40 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7fadb400d860 tx=0x7fadb4008040).stop 2023-07-27T14:38:42.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 shutdown_connections 2023-07-27T14:38:42.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fada805fb50 0x7fada8062010 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadc414b1e0 0x7fadc40ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fadc4063260 0x7fadc41495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 --2- 172.21.15.115:0/1414581541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadc414ae00 0x7fadc40aac40 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:42.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 >> 172.21.15.115:0/1414581541 conn(0x7fadc405e940 msgr2=0x7fadc40c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:42.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 shutdown_connections 2023-07-27T14:38:42.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:42.851+0000 7fadcc5ff700 1 -- 172.21.15.115:0/1414581541 wait complete. 2023-07-27T14:38:42.922 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:38:43.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.101+0000 7fca249ff700 1 Processor -- start 2023-07-27T14:38:43.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.101+0000 7fca249ff700 1 -- start start 2023-07-27T14:38:43.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.102+0000 7fca249ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fca2014ae00 0x7fca20154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:43.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.102+0000 7fca249ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca2014b1e0 0x7fca20062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:43.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.102+0000 7fca249ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca201553f0 con 0x7fca200c5c50 2023-07-27T14:38:43.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.102+0000 7fca249ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca20157a50 con 0x7fca2014ae00 2023-07-27T14:38:43.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.102+0000 7fca249ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca20157d10 con 0x7fca2014b1e0 2023-07-27T14:38:43.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.103+0000 7fca1dd9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca2014b1e0 0x7fca20062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:43.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.103+0000 7fca1e59c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fca2014ae00 0x7fca20154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:43.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.103+0000 7fca1ed9d700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fca200c5c50 0x7fca200a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:56708/0 (socket says 172.21.15.115:56708) 2023-07-27T14:38:43.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.103+0000 7fca1ed9d700 1 -- 172.21.15.115:0/2723230933 learned_addr learned my addr 172.21.15.115:0/2723230933 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.103+0000 7fca1d59a700 1 -- 172.21.15.115:0/2723230933 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970871047 0 0) 0x7fca201553f0 con 0x7fca200c5c50 2023-07-27T14:38:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.103+0000 7fca1d59a700 1 -- 172.21.15.115:0/2723230933 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca080033f0 con 0x7fca200c5c50 2023-07-27T14:38:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.103+0000 7fca1dd9b700 1 -- 172.21.15.115:0/2723230933 >> v2:172.21.15.159:3300/0 conn(0x7fca2014ae00 msgr2=0x7fca20154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.103+0000 7fca1dd9b700 1 --2- 172.21.15.115:0/2723230933 >> v2:172.21.15.159:3300/0 conn(0x7fca2014ae00 0x7fca20154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca1dd9b700 1 -- 172.21.15.115:0/2723230933 >> v1:172.21.15.159:6789/0 conn(0x7fca200c5c50 legacy=0x7fca200a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:43.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca1dd9b700 1 -- 172.21.15.115:0/2723230933 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20157ff0 con 0x7fca2014b1e0 2023-07-27T14:38:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca1e59c700 1 --2- 172.21.15.115:0/2723230933 >> v2:172.21.15.159:3300/0 conn(0x7fca2014ae00 0x7fca20154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca1dd9b700 1 --2- 172.21.15.115:0/2723230933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca2014b1e0 0x7fca20062b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fca14009760 tx=0x7fca14009060).ready entity=mon.2 client_cookie=f457c5590b5f637f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca1d59a700 1 -- 172.21.15.115:0/2723230933 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1400d4a0 con 0x7fca2014b1e0 2023-07-27T14:38:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca1d59a700 1 -- 172.21.15.115:0/2723230933 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1400d600 con 0x7fca2014b1e0 2023-07-27T14:38:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca1d59a700 1 -- 172.21.15.115:0/2723230933 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1400d980 con 0x7fca2014b1e0 2023-07-27T14:38:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca249ff700 1 -- 172.21.15.115:0/2723230933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca2014b1e0 msgr2=0x7fca20062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:43.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.104+0000 7fca249ff700 1 --2- 172.21.15.115:0/2723230933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca2014b1e0 0x7fca20062b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fca14009760 tx=0x7fca14009060).stop 2023-07-27T14:38:43.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.105+0000 7fca249ff700 1 -- 172.21.15.115:0/2723230933 shutdown_connections 2023-07-27T14:38:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.105+0000 7fca249ff700 1 --2- 172.21.15.115:0/2723230933 >> v2:172.21.15.159:3300/0 conn(0x7fca2014ae00 0x7fca20154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.105+0000 7fca249ff700 1 --2- 172.21.15.115:0/2723230933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca2014b1e0 0x7fca20062b50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.105+0000 7fca249ff700 1 -- 172.21.15.115:0/2723230933 >> 172.21.15.115:0/2723230933 conn(0x7fca2005e940 msgr2=0x7fca200cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.105+0000 7fca249ff700 1 -- 172.21.15.115:0/2723230933 shutdown_connections 2023-07-27T14:38:43.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.105+0000 7fca249ff700 1 -- 172.21.15.115:0/2723230933 wait complete. 2023-07-27T14:38:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.106+0000 7fca249ff700 1 Processor -- start 2023-07-27T14:38:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.106+0000 7fca249ff700 1 -- start start 2023-07-27T14:38:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.107+0000 7fca249ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca200c5c50 0x7fca2013e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.107+0000 7fca249ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca2014ae00 0x7fca200adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.107+0000 7fca249ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca2014b1e0 0x7fca200ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.107+0000 7fca249ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200ae540 con 0x7fca2014b1e0 2023-07-27T14:38:43.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.107+0000 7fca249ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200c27d0 con 0x7fca2014ae00 2023-07-27T14:38:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.107+0000 7fca249ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca201573a0 con 0x7fca200c5c50 2023-07-27T14:38:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca2014b1e0 0x7fca200ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca2014b1e0 0x7fca200ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56854/0 (socket says 172.21.15.115:56854) 2023-07-27T14:38:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 -- 172.21.15.115:0/969075165 learned_addr learned my addr 172.21.15.115:0/969075165 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1e59c700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca200c5c50 0x7fca2013e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1dd9b700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca2014ae00 0x7fca200adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:43.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 -- 172.21.15.115:0/969075165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca200c5c50 msgr2=0x7fca2013e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:43.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca200c5c50 0x7fca2013e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 -- 172.21.15.115:0/969075165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca2014ae00 msgr2=0x7fca200adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:43.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca2014ae00 0x7fca200adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 -- 172.21.15.115:0/969075165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca100092a0 con 0x7fca2014b1e0 2023-07-27T14:38:43.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca1ed9d700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca2014b1e0 0x7fca200ae050 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7fca18005ad0 tx=0x7fca18001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:43.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca0e7fc700 1 -- 172.21.15.115:0/969075165 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18005d30 con 0x7fca2014b1e0 2023-07-27T14:38:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca0e7fc700 1 -- 172.21.15.115:0/969075165 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca18005e90 con 0x7fca2014b1e0 2023-07-27T14:38:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca0e7fc700 1 -- 172.21.15.115:0/969075165 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18007320 con 0x7fca2014b1e0 2023-07-27T14:38:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.108+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca140092a0 con 0x7fca2014b1e0 2023-07-27T14:38:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.109+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca200aea20 con 0x7fca2014b1e0 2023-07-27T14:38:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.109+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca200c2990 con 0x7fca2014b1e0 2023-07-27T14:38:43.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.110+0000 7fca0e7fc700 1 -- 172.21.15.115:0/969075165 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fca18010030 con 0x7fca2014b1e0 2023-07-27T14:38:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.111+0000 7fca0e7fc700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca0005fb50 0x7fca00062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.111+0000 7fca0e7fc700 1 -- 172.21.15.115:0/969075165 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6235+0+0 (secure 0 0 0) 0x7fca1807b200 con 0x7fca2014b1e0 2023-07-27T14:38:43.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.111+0000 7fca1e59c700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca0005fb50 0x7fca00062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:43.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.112+0000 7fca1e59c700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca0005fb50 0x7fca00062010 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fca10009270 tx=0x7fca10008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:43.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.115+0000 7fca0e7fc700 1 -- 172.21.15.115:0/969075165 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca1804b860 con 0x7fca2014b1e0 2023-07-27T14:38:43.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.285+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca2006c470 con 0x7fca2014b1e0 2023-07-27T14:38:43.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.854+0000 7fca0e7fc700 1 -- 172.21.15.115:0/969075165 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v178) v1 ==== 181+0+0 (secure 0 0 0) 0x7fca1804ee80 con 0x7fca2014b1e0 2023-07-27T14:38:43.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca0005fb50 msgr2=0x7fca00062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:43.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca0005fb50 0x7fca00062010 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fca10009270 tx=0x7fca10008040).stop 2023-07-27T14:38:43.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca2014b1e0 msgr2=0x7fca200ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:43.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca2014b1e0 0x7fca200ae050 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7fca18005ad0 tx=0x7fca18001650).stop 2023-07-27T14:38:43.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 shutdown_connections 2023-07-27T14:38:43.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fca0005fb50 0x7fca00062010 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca2014b1e0 0x7fca200ae050 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fca200c5c50 0x7fca2013e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 --2- 172.21.15.115:0/969075165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca2014ae00 0x7fca200adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:43.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.858+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 >> 172.21.15.115:0/969075165 conn(0x7fca2005e940 msgr2=0x7fca20152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:43.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.860+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 shutdown_connections 2023-07-27T14:38:43.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:43.860+0000 7fca249ff700 1 -- 172.21.15.115:0/969075165 wait complete. 2023-07-27T14:38:43.915 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:38:43.935 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:38:44.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.074+0000 7f8a171ff700 1 Processor -- start 2023-07-27T14:38:44.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.075+0000 7f8a171ff700 1 -- start start 2023-07-27T14:38:44.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.076+0000 7f8a171ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8a10153e00 0x7f8a100c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:44.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.076+0000 7f8a171ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8a10064230 0x7f8a100656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:44.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a171ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10065bc0 0x7f8a10157a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:44.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a171ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a10062320 con 0x7f8a10153e00 2023-07-27T14:38:44.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a171ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a10066050 con 0x7f8a10064230 2023-07-27T14:38:44.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a171ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10064a80 con 0x7f8a10065bc0 2023-07-27T14:38:44.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a14f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8a10153e00 0x7f8a100c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:44.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a14f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8a10153e00 0x7f8a100c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35052/0 (socket says 172.21.15.115:35052) 2023-07-27T14:38:44.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a14f9b700 1 -- 172.21.15.115:0/3229541660 learned_addr learned my addr 172.21.15.115:0/3229541660 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:44.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a1579c700 1 --2- 172.21.15.115:0/3229541660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10065bc0 0x7f8a10157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:44.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a14f9b700 1 -- 172.21.15.115:0/3229541660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10065bc0 msgr2=0x7f8a10157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:44.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a0ffff700 1 --2- 172.21.15.115:0/3229541660 >> v2:172.21.15.159:3300/0 conn(0x7f8a10064230 0x7f8a100656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:44.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a14f9b700 1 --2- 172.21.15.115:0/3229541660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10065bc0 0x7f8a10157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a14f9b700 1 -- 172.21.15.115:0/3229541660 >> v2:172.21.15.159:3300/0 conn(0x7f8a10064230 msgr2=0x7f8a100656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:44.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a14f9b700 1 --2- 172.21.15.115:0/3229541660 >> v2:172.21.15.159:3300/0 conn(0x7f8a10064230 0x7f8a100656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a14f9b700 1 -- 172.21.15.115:0/3229541660 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10064d60 con 0x7f8a10153e00 2023-07-27T14:38:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a1579c700 1 --2- 172.21.15.115:0/3229541660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10065bc0 0x7f8a10157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.077+0000 7f8a0ffff700 1 --2- 172.21.15.115:0/3229541660 >> v2:172.21.15.159:3300/0 conn(0x7f8a10064230 0x7f8a100656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a14f9b700 1 --2- 172.21.15.115:0/3229541660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10153e00 0x7f8a100c6b70 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f8a100c3b80 tx=0x7f8a040090f0).ready entity=mon.0 client_cookie=424d10381994a2cb server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a0f7fe700 1 -- 172.21.15.115:0/3229541660 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400b600 con 0x7f8a10153e00 2023-07-27T14:38:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a0f7fe700 1 -- 172.21.15.115:0/3229541660 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0400b760 con 0x7f8a10153e00 2023-07-27T14:38:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a0f7fe700 1 -- 172.21.15.115:0/3229541660 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400bae0 con 0x7f8a10153e00 2023-07-27T14:38:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 -- 172.21.15.115:0/3229541660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10153e00 msgr2=0x7f8a100c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3229541660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10153e00 0x7f8a100c6b70 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f8a100c3b80 tx=0x7f8a040090f0).stop 2023-07-27T14:38:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 -- 172.21.15.115:0/3229541660 shutdown_connections 2023-07-27T14:38:44.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3229541660 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10065bc0 0x7f8a10157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3229541660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10153e00 0x7f8a100c6b70 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3229541660 >> v2:172.21.15.159:3300/0 conn(0x7f8a10064230 0x7f8a100656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 -- 172.21.15.115:0/3229541660 >> 172.21.15.115:0/3229541660 conn(0x7f8a100c7b90 msgr2=0x7f8a100c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:44.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 -- 172.21.15.115:0/3229541660 shutdown_connections 2023-07-27T14:38:44.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.078+0000 7f8a171ff700 1 -- 172.21.15.115:0/3229541660 wait complete. 2023-07-27T14:38:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.080+0000 7f8a171ff700 1 Processor -- start 2023-07-27T14:38:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.081+0000 7f8a171ff700 1 -- start start 2023-07-27T14:38:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a171ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a10064230 0x7f8a10093580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a171ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10065bc0 0x7f8a101514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a171ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10153e00 0x7f8a10069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a171ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10094710 con 0x7f8a10065bc0 2023-07-27T14:38:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a171ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10093a70 con 0x7f8a10064230 2023-07-27T14:38:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a171ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10091ed0 con 0x7f8a10153e00 2023-07-27T14:38:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a0ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10065bc0 0x7f8a101514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a0ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10065bc0 0x7f8a101514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35054/0 (socket says 172.21.15.115:35054) 2023-07-27T14:38:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a0ffff700 1 -- 172.21.15.115:0/3128663128 learned_addr learned my addr 172.21.15.115:0/3128663128 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a14f9b700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a10064230 0x7f8a10093580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.082+0000 7f8a1579c700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10153e00 0x7f8a10069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0ffff700 1 -- 172.21.15.115:0/3128663128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10153e00 msgr2=0x7f8a10069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0ffff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10153e00 0x7f8a10069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0ffff700 1 -- 172.21.15.115:0/3128663128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a10064230 msgr2=0x7f8a10093580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0ffff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a10064230 0x7f8a10093580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0ffff700 1 -- 172.21.15.115:0/3128663128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04009370 con 0x7f8a10065bc0 2023-07-27T14:38:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0ffff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10065bc0 0x7f8a101514c0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7f89fc00c880 tx=0x7f89fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0cff9700 1 -- 172.21.15.115:0/3128663128 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010580 con 0x7f8a10065bc0 2023-07-27T14:38:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0cff9700 1 -- 172.21.15.115:0/3128663128 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0106e0 con 0x7f8a10065bc0 2023-07-27T14:38:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a0cff9700 1 -- 172.21.15.115:0/3128663128 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010a60 con 0x7f8a10065bc0 2023-07-27T14:38:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a100921b0 con 0x7f8a10065bc0 2023-07-27T14:38:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.083+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a10092770 con 0x7f8a10065bc0 2023-07-27T14:38:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.084+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1006c470 con 0x7f8a10065bc0 2023-07-27T14:38:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.085+0000 7f8a0cff9700 1 -- 172.21.15.115:0/3128663128 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f89fc01b460 con 0x7f8a10065bc0 2023-07-27T14:38:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.086+0000 7f8a0cff9700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f89f405fb50 0x7f89f4062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.086+0000 7f8a0cff9700 1 -- 172.21.15.115:0/3128663128 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f89fc07afd0 con 0x7f8a10065bc0 2023-07-27T14:38:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.086+0000 7f8a14f9b700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f89f405fb50 0x7f89f4062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.087+0000 7f8a14f9b700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f89f405fb50 0x7f89f4062010 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f8a04009130 tx=0x7f8a04017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.090+0000 7f8a0cff9700 1 -- 172.21.15.115:0/3128663128 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89fc04b8b0 con 0x7f8a10065bc0 2023-07-27T14:38:44.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.259+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a100c1490 con 0x7f8a10065bc0 2023-07-27T14:38:44.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.870+0000 7f8a0cff9700 1 -- 172.21.15.115:0/3128663128 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v179) v1 ==== 169+0+0 (secure 0 0 0) 0x7f89fc04eed0 con 0x7f8a10065bc0 2023-07-27T14:38:44.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f89f405fb50 msgr2=0x7f89f4062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:44.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f89f405fb50 0x7f89f4062010 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f8a04009130 tx=0x7f8a04017000).stop 2023-07-27T14:38:44.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10065bc0 msgr2=0x7f8a101514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:44.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10065bc0 0x7f8a101514c0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7f89fc00c880 tx=0x7f89fc008040).stop 2023-07-27T14:38:44.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 shutdown_connections 2023-07-27T14:38:44.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f89f405fb50 0x7f89f4062010 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a10153e00 0x7f8a10069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a10064230 0x7f8a10093580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 --2- 172.21.15.115:0/3128663128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a10065bc0 0x7f8a101514c0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:44.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 >> 172.21.15.115:0/3128663128 conn(0x7f8a100c7b90 msgr2=0x7f8a101522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:44.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 shutdown_connections 2023-07-27T14:38:44.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:44.873+0000 7f8a171ff700 1 -- 172.21.15.115:0/3128663128 wait complete. 2023-07-27T14:38:44.929 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:38:44.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:38:45.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.087+0000 7f607c9ff700 1 Processor -- start 2023-07-27T14:38:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.088+0000 7f607c9ff700 1 -- start start 2023-07-27T14:38:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f607c9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f60780a5f60 0x7f607814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f607c9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60780c31e0 0x7f60780c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f607c9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60781530d0 con 0x7f607814f740 2023-07-27T14:38:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f607c9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6078069f70 con 0x7f60780a5f60 2023-07-27T14:38:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f607c9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60780c3b80 con 0x7f60780c31e0 2023-07-27T14:38:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f607659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f607814f740 0x7f60780a5850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58050/0 (socket says 172.21.15.115:58050) 2023-07-27T14:38:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f607659c700 1 -- 172.21.15.115:0/1431192614 learned_addr learned my addr 172.21.15.115:0/1431192614 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f6076d9d700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60780c31e0 0x7f60780c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f6075d9b700 1 --2- 172.21.15.115:0/1431192614 >> v2:172.21.15.159:3300/0 conn(0x7f60780a5f60 0x7f607814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.089+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343442458 0 0) 0x7f60781530d0 con 0x7f607814f740 2023-07-27T14:38:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60600033f0 con 0x7f607814f740 2023-07-27T14:38:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623600031 0 0) 0x7f60600033f0 con 0x7f607814f740 2023-07-27T14:38:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60780c31e0 msgr2=0x7f60780c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60780c31e0 0x7f60780c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 >> v2:172.21.15.159:3300/0 conn(0x7f60780a5f60 msgr2=0x7f607814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 --2- 172.21.15.115:0/1431192614 >> v2:172.21.15.159:3300/0 conn(0x7f60780a5f60 0x7f607814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60781527a0 con 0x7f607814f740 2023-07-27T14:38:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f6068001470 con 0x7f607814f740 2023-07-27T14:38:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 >> v1:172.21.15.115:6789/0 conn(0x7f607814f740 legacy=0x7f60780a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60600038e0 0x7f6060003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60780c31e0 0x7f6060004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f6060005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60780c3b80 con 0x7f6060004b80 2023-07-27T14:38:45.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606000b8e0 con 0x7f60600038e0 2023-07-27T14:38:45.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606000ba20 con 0x7f60780c31e0 2023-07-27T14:38:45.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f6076d9d700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f6060005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f607659c700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60600038e0 0x7f6060003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.090+0000 7f6075d9b700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60780c31e0 0x7f6060004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f6076d9d700 1 -- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60780c31e0 msgr2=0x7f6060004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f6076d9d700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f60780c31e0 0x7f6060004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f6076d9d700 1 -- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60600038e0 msgr2=0x7f6060003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f6076d9d700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60600038e0 0x7f6060003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f6076d9d700 1 -- 172.21.15.115:0/1431192614 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600033f0 con 0x7f6060004b80 2023-07-27T14:38:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f6076d9d700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f6060005000 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f607000e210 tx=0x7f607000b040).ready entity=mon.0 client_cookie=7dd1017ad22e27db server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070009ac0 con 0x7f6060004b80 2023-07-27T14:38:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000f040 con 0x7f6060004b80 2023-07-27T14:38:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.091+0000 7f607559a700 1 -- 172.21.15.115:0/1431192614 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000ecd0 con 0x7f6060004b80 2023-07-27T14:38:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.092+0000 7f607c9ff700 1 -- 172.21.15.115:0/1431192614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 msgr2=0x7f6060005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.092+0000 7f607c9ff700 1 --2- 172.21.15.115:0/1431192614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f6060005000 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f607000e210 tx=0x7f607000b040).stop 2023-07-27T14:38:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.092+0000 7f6076d9d700 1 -- 172.21.15.115:0/1431192614 reap_dead start 2023-07-27T14:38:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.092+0000 7f607c9ff700 1 -- 172.21.15.115:0/1431192614 shutdown_connections 2023-07-27T14:38:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.092+0000 7f607c9ff700 1 -- 172.21.15.115:0/1431192614 >> 172.21.15.115:0/1431192614 conn(0x7f6078062320 msgr2=0x7f6078062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.092+0000 7f607c9ff700 1 -- 172.21.15.115:0/1431192614 shutdown_connections 2023-07-27T14:38:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.092+0000 7f607c9ff700 1 -- 172.21.15.115:0/1431192614 wait complete. 2023-07-27T14:38:45.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.093+0000 7f607c9ff700 1 Processor -- start 2023-07-27T14:38:45.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.093+0000 7f607c9ff700 1 -- start start 2023-07-27T14:38:45.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607c9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f60780c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607c9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6078157650 0x7f607814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607c9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60780a4a00 0x7f60780a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607c9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60780c48f0 con 0x7f6060004b80 2023-07-27T14:38:45.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607c9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078151130 con 0x7f60780a4a00 2023-07-27T14:38:45.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607c9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6078157ab0 con 0x7f6078157650 2023-07-27T14:38:45.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f60780c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f60780c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35064/0 (socket says 172.21.15.115:35064) 2023-07-27T14:38:45.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.094+0000 7f607659c700 1 -- 172.21.15.115:0/936539962 learned_addr learned my addr 172.21.15.115:0/936539962 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:45.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f6075d9b700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6078157650 0x7f607814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f6076d9d700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60780a4a00 0x7f60780a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f607659c700 1 -- 172.21.15.115:0/936539962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6078157650 msgr2=0x7f607814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f607659c700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6078157650 0x7f607814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f607659c700 1 -- 172.21.15.115:0/936539962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60780a4a00 msgr2=0x7f60780a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f607659c700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60780a4a00 0x7f60780a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f607659c700 1 -- 172.21.15.115:0/936539962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607814bb90 con 0x7f6060004b80 2023-07-27T14:38:45.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f607659c700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f60780c4400 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7f6068001d20 tx=0x7f6068001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:45.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f60667fc700 1 -- 172.21.15.115:0/936539962 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068001470 con 0x7f6060004b80 2023-07-27T14:38:45.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f60667fc700 1 -- 172.21.15.115:0/936539962 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6068011590 con 0x7f6060004b80 2023-07-27T14:38:45.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f60667fc700 1 -- 172.21.15.115:0/936539962 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068011930 con 0x7f6060004b80 2023-07-27T14:38:45.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6078157d80 con 0x7f6060004b80 2023-07-27T14:38:45.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.095+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6078158340 con 0x7f6060004b80 2023-07-27T14:38:45.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.097+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607814ef50 con 0x7f6060004b80 2023-07-27T14:38:45.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.097+0000 7f60667fc700 1 -- 172.21.15.115:0/936539962 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f606801b030 con 0x7f6060004b80 2023-07-27T14:38:45.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.099+0000 7f60667fc700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805fb80 0x7f6058062040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.099+0000 7f60667fc700 1 -- 172.21.15.115:0/936539962 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f606807a6e0 con 0x7f6060004b80 2023-07-27T14:38:45.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.099+0000 7f6075d9b700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805fb80 0x7f6058062040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.099+0000 7f6075d9b700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805fb80 0x7f6058062040 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f6078153200 tx=0x7f606c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:45.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.103+0000 7f60667fc700 1 -- 172.21.15.115:0/936539962 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f606804b160 con 0x7f6060004b80 2023-07-27T14:38:45.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.272+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6078152a80 con 0x7f6060004b80 2023-07-27T14:38:45.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.276+0000 7f60667fc700 1 -- 172.21.15.115:0/936539962 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6068019030 con 0x7f6060004b80 2023-07-27T14:38:45.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805fb80 msgr2=0x7f6058062040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805fb80 0x7f6058062040 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f6078153200 tx=0x7f606c008040).stop 2023-07-27T14:38:45.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 msgr2=0x7f60780c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f60780c4400 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7f6068001d20 tx=0x7f6068001e90).stop 2023-07-27T14:38:45.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 shutdown_connections 2023-07-27T14:38:45.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f605805fb80 0x7f6058062040 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60780a4a00 0x7f60780a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6060004b80 0x7f60780c4400 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 --2- 172.21.15.115:0/936539962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6078157650 0x7f607814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 >> 172.21.15.115:0/936539962 conn(0x7f6078062320 msgr2=0x7f60780bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:45.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 shutdown_connections 2023-07-27T14:38:45.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.279+0000 7f607c9ff700 1 -- 172.21.15.115:0/936539962 wait complete. 2023-07-27T14:38:45.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_quota_attrs' 2023-07-27T14:38:45.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.483+0000 7f0bc4fff700 1 Processor -- start 2023-07-27T14:38:45.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.484+0000 7f0bc4fff700 1 -- start start 2023-07-27T14:38:45.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.485+0000 7f0bc4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 0x7f0bc015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.485+0000 7f0bc4fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00aa4d0 con 0x7f0bc0153ec0 2023-07-27T14:38:45.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.485+0000 7f0bc4fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00c05c0 con 0x7f0bc00aaa40 2023-07-27T14:38:45.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.485+0000 7f0bc4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c1a60 con 0x7f0bc01542a0 2023-07-27T14:38:45.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.485+0000 7f0bbe59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0bc0153ec0 0x7f0bc00a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58066/0 (socket says 172.21.15.115:58066) 2023-07-27T14:38:45.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.485+0000 7f0bbe59c700 1 -- 172.21.15.115:0/4191790183 learned_addr learned my addr 172.21.15.115:0/4191790183 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:45.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.485+0000 7f0bbed9d700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 0x7f0bc015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262420059 0 0) 0x7f0bb0001110 con 0x7f0bc0153ec0 2023-07-27T14:38:45.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba80033f0 con 0x7f0bc0153ec0 2023-07-27T14:38:45.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484746871 0 0) 0x7f0bc00c05c0 con 0x7f0bc00aaa40 2023-07-27T14:38:45.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb0001110 con 0x7f0bc00aaa40 2023-07-27T14:38:45.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1582226296 0 0) 0x7f0ba80033f0 con 0x7f0bc0153ec0 2023-07-27T14:38:45.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 msgr2=0x7f0bc015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:45.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 0x7f0bc015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 >> v1:172.21.15.159:6789/0 conn(0x7f0bc00aaa40 legacy=0x7f0bc00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00aa270 con 0x7f0bc0153ec0 2023-07-27T14:38:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f0bb0001600 con 0x7f0bc0153ec0 2023-07-27T14:38:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbed9d700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 0x7f0bc015efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 >> v1:172.21.15.115:6789/0 conn(0x7f0bc0153ec0 legacy=0x7f0bc00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0ba8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 0x7f0ba8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba8004b80 0x7f0ba8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c1a60 con 0x7f0ba8003aa0 2023-07-27T14:38:45.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba800b8e0 con 0x7f0ba8004b80 2023-07-27T14:38:45.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba800baa0 con 0x7f0bc01542a0 2023-07-27T14:38:45.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.486+0000 7f0bbe59c700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0ba8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbdd9b700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 0x7f0ba8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbed9d700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba8004b80 0x7f0ba8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbe59c700 1 -- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 msgr2=0x7f0ba8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:45.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbe59c700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc01542a0 0x7f0ba8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbe59c700 1 -- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba8004b80 msgr2=0x7f0ba8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:45.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbe59c700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba8004b80 0x7f0ba8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbe59c700 1 -- 172.21.15.115:0/4191790183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8009a20 con 0x7f0ba8003aa0 2023-07-27T14:38:45.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbed9d700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ba8004b80 0x7f0ba8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:45.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbe59c700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0ba8003ea0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f0bb000c2d0 tx=0x7f0bb0007880).ready entity=mon.0 client_cookie=65e70d7bb0b1c8f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:45.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0007b70 con 0x7f0ba8003aa0 2023-07-27T14:38:45.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb000cc00 con 0x7f0ba8003aa0 2023-07-27T14:38:45.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.487+0000 7f0bbd59a700 1 -- 172.21.15.115:0/4191790183 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00070d0 con 0x7f0ba8003aa0 2023-07-27T14:38:45.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.488+0000 7f0bc4fff700 1 -- 172.21.15.115:0/4191790183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 msgr2=0x7f0ba8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.488+0000 7f0bc4fff700 1 --2- 172.21.15.115:0/4191790183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0ba8003ea0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f0bb000c2d0 tx=0x7f0bb0007880).stop 2023-07-27T14:38:45.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.488+0000 7f0bbed9d700 1 -- 172.21.15.115:0/4191790183 reap_dead start 2023-07-27T14:38:45.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.488+0000 7f0bc4fff700 1 -- 172.21.15.115:0/4191790183 shutdown_connections 2023-07-27T14:38:45.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.488+0000 7f0bc4fff700 1 -- 172.21.15.115:0/4191790183 >> 172.21.15.115:0/4191790183 conn(0x7f0bc00cb610 msgr2=0x7f0bc00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:45.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.488+0000 7f0bc4fff700 1 -- 172.21.15.115:0/4191790183 shutdown_connections 2023-07-27T14:38:45.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.488+0000 7f0bc4fff700 1 -- 172.21.15.115:0/4191790183 wait complete. 2023-07-27T14:38:45.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.489+0000 7f0bc4fff700 1 Processor -- start 2023-07-27T14:38:45.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.489+0000 7f0bc4fff700 1 -- start start 2023-07-27T14:38:45.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.490+0000 7f0bc4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0bc0151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.490+0000 7f0bc4fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc01446d0 0x7f0bc0157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.490+0000 7f0bc4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc0144b50 0x7f0bc01578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.490+0000 7f0bc4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0152280 con 0x7f0ba8003aa0 2023-07-27T14:38:45.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.490+0000 7f0bc4fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c9e00 con 0x7f0bc01446d0 2023-07-27T14:38:45.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.490+0000 7f0bc4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0151900 con 0x7f0bc0144b50 2023-07-27T14:38:45.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.490+0000 7f0bbe59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0bc0151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbe59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0bc0151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35072/0 (socket says 172.21.15.115:35072) 2023-07-27T14:38:45.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbe59c700 1 -- 172.21.15.115:0/3195528158 learned_addr learned my addr 172.21.15.115:0/3195528158 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:45.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbdd9b700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc01446d0 0x7f0bc0157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbed9d700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc0144b50 0x7f0bc01578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbe59c700 1 -- 172.21.15.115:0/3195528158 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc0144b50 msgr2=0x7f0bc01578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbe59c700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc0144b50 0x7f0bc01578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbe59c700 1 -- 172.21.15.115:0/3195528158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc01446d0 msgr2=0x7f0bc0157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbe59c700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc01446d0 0x7f0bc0157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbe59c700 1 -- 172.21.15.115:0/3195528158 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc0150d30 con 0x7f0ba8003aa0 2023-07-27T14:38:45.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bbe59c700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0bc0151d90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f0bb000c8c0 tx=0x7f0bb0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:45.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bae7fc700 1 -- 172.21.15.115:0/3195528158 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00046b0 con 0x7f0ba8003aa0 2023-07-27T14:38:45.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bae7fc700 1 -- 172.21.15.115:0/3195528158 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0004810 con 0x7f0ba8003aa0 2023-07-27T14:38:45.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bae7fc700 1 -- 172.21.15.115:0/3195528158 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0004bb0 con 0x7f0ba8003aa0 2023-07-27T14:38:45.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc0150fd0 con 0x7f0ba8003aa0 2023-07-27T14:38:45.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.491+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc0151590 con 0x7f0ba8003aa0 2023-07-27T14:38:45.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.492+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc006c470 con 0x7f0ba8003aa0 2023-07-27T14:38:45.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.493+0000 7f0bae7fc700 1 -- 172.21.15.115:0/3195528158 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f0bb001d070 con 0x7f0ba8003aa0 2023-07-27T14:38:45.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.494+0000 7f0bae7fc700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ba005fb50 0x7f0ba0062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:45.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.494+0000 7f0bae7fc700 1 -- 172.21.15.115:0/3195528158 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0bb007b8d0 con 0x7f0ba8003aa0 2023-07-27T14:38:45.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.494+0000 7f0bbdd9b700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ba005fb50 0x7f0ba0062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:45.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.495+0000 7f0bbdd9b700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ba005fb50 0x7f0ba0062010 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f0bc00c50c0 tx=0x7f0bb4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:45.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.498+0000 7f0bae7fc700 1 -- 172.21.15.115:0/3195528158 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0bb004c3b0 con 0x7f0ba8003aa0 2023-07-27T14:38:45.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.745+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_quota_attrs"]} v 0) v1 -- 0x7f0bc00aa4d0 con 0x7f0ba8003aa0 2023-07-27T14:38:45.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.871+0000 7f0bae7fc700 1 -- 172.21.15.115:0/3195528158 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_quota_attrs"]}]=0 v595) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0bc00aa4d0 con 0x7f0ba8003aa0 2023-07-27T14:38:45.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ba005fb50 msgr2=0x7f0ba0062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ba005fb50 0x7f0ba0062010 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f0bc00c50c0 tx=0x7f0bb4009040).stop 2023-07-27T14:38:45.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 msgr2=0x7f0bc0151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:45.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0bc0151d90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f0bb000c8c0 tx=0x7f0bb0015000).stop 2023-07-27T14:38:45.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 shutdown_connections 2023-07-27T14:38:45.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ba005fb50 0x7f0ba0062010 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0bc0144b50 0x7f0bc01578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba8003aa0 0x7f0bc0151d90 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 --2- 172.21.15.115:0/3195528158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bc01446d0 0x7f0bc0157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:45.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 >> 172.21.15.115:0/3195528158 conn(0x7f0bc00cb610 msgr2=0x7f0bc0154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:45.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 shutdown_connections 2023-07-27T14:38:45.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:45.873+0000 7f0bc4fff700 1 -- 172.21.15.115:0/3195528158 wait complete. 2023-07-27T14:38:45.943 INFO:tasks.cephfs_test_runner:test_subvolume_clone_inherit_quota_attrs (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:38:45.943 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_clone_inherit_snapshot_namespace_and_size (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:38:45.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_snapshot_namespace_and_size' 2023-07-27T14:38:46.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.078+0000 7f0fce1ff700 1 Processor -- start 2023-07-27T14:38:46.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.078+0000 7f0fce1ff700 1 -- start start 2023-07-27T14:38:46.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fce1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0fc8150320 0x7f0fc8150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:46.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fce1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc80c0e80 0x7f0fc8069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:46.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fce1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0fc8065020 0x7f0fc80c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:46.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fce1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc8065790 con 0x7f0fc8065020 2023-07-27T14:38:46.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fce1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc8068380 con 0x7f0fc8150320 2023-07-27T14:38:46.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fce1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8068ee0 con 0x7f0fc80c0e80 2023-07-27T14:38:46.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fc7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0fc8065020 0x7f0fc80c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:46.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fc7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0fc8065020 0x7f0fc80c1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35080/0 (socket says 172.21.15.115:35080) 2023-07-27T14:38:46.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fc7fff700 1 -- 172.21.15.115:0/3436143976 learned_addr learned my addr 172.21.15.115:0/3436143976 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:46.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fc77fe700 1 --2- 172.21.15.115:0/3436143976 >> v2:172.21.15.159:3300/0 conn(0x7f0fc8150320 0x7f0fc8150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:46.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.080+0000 7f0fc6ffd700 1 --2- 172.21.15.115:0/3436143976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc80c0e80 0x7f0fc8069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:46.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc7fff700 1 -- 172.21.15.115:0/3436143976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc80c0e80 msgr2=0x7f0fc8069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:46.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc7fff700 1 --2- 172.21.15.115:0/3436143976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc80c0e80 0x7f0fc8069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc7fff700 1 -- 172.21.15.115:0/3436143976 >> v2:172.21.15.159:3300/0 conn(0x7f0fc8150320 msgr2=0x7f0fc8150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:46.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc7fff700 1 --2- 172.21.15.115:0/3436143976 >> v2:172.21.15.159:3300/0 conn(0x7f0fc8150320 0x7f0fc8150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc7fff700 1 -- 172.21.15.115:0/3436143976 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc80685b0 con 0x7f0fc8065020 2023-07-27T14:38:46.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc6ffd700 1 --2- 172.21.15.115:0/3436143976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc80c0e80 0x7f0fc8069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:46.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc77fe700 1 --2- 172.21.15.115:0/3436143976 >> v2:172.21.15.159:3300/0 conn(0x7f0fc8150320 0x7f0fc8150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc7fff700 1 --2- 172.21.15.115:0/3436143976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc80c1860 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f0fc80c3280 tx=0x7f0fc0009840).ready entity=mon.0 client_cookie=6ee4fe8c3c74f276 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc67fc700 1 -- 172.21.15.115:0/3436143976 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000ba50 con 0x7f0fc8065020 2023-07-27T14:38:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc67fc700 1 -- 172.21.15.115:0/3436143976 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000bbb0 con 0x7f0fc8065020 2023-07-27T14:38:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fc67fc700 1 -- 172.21.15.115:0/3436143976 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0011480 con 0x7f0fc8065020 2023-07-27T14:38:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fce1ff700 1 -- 172.21.15.115:0/3436143976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 msgr2=0x7f0fc80c1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.081+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/3436143976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc80c1860 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f0fc80c3280 tx=0x7f0fc0009840).stop 2023-07-27T14:38:46.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.082+0000 7f0fce1ff700 1 -- 172.21.15.115:0/3436143976 shutdown_connections 2023-07-27T14:38:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.082+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/3436143976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc80c1860 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.082+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/3436143976 >> v2:172.21.15.159:3300/0 conn(0x7f0fc8150320 0x7f0fc8150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.082+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/3436143976 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc80c0e80 0x7f0fc8069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.082+0000 7f0fce1ff700 1 -- 172.21.15.115:0/3436143976 >> 172.21.15.115:0/3436143976 conn(0x7f0fc8062320 msgr2=0x7f0fc8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.082+0000 7f0fce1ff700 1 -- 172.21.15.115:0/3436143976 shutdown_connections 2023-07-27T14:38:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.082+0000 7f0fce1ff700 1 -- 172.21.15.115:0/3436143976 wait complete. 2023-07-27T14:38:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.083+0000 7f0fce1ff700 1 Processor -- start 2023-07-27T14:38:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.083+0000 7f0fce1ff700 1 -- start start 2023-07-27T14:38:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fce1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc8153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fce1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80c0e80 0x7f0fc80bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fce1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc8150320 0x7f0fc80bd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fce1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8160050 con 0x7f0fc8065020 2023-07-27T14:38:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fce1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8153550 con 0x7f0fc80c0e80 2023-07-27T14:38:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fce1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80bf510 con 0x7f0fc8150320 2023-07-27T14:38:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc8153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc8153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35084/0 (socket says 172.21.15.115:35084) 2023-07-27T14:38:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.084+0000 7f0fc77fe700 1 -- 172.21.15.115:0/1728220249 learned_addr learned my addr 172.21.15.115:0/1728220249 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fc7fff700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc8150320 0x7f0fc80bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fc6ffd700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80c0e80 0x7f0fc80bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fc77fe700 1 -- 172.21.15.115:0/1728220249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc8150320 msgr2=0x7f0fc80bd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fc77fe700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc8150320 0x7f0fc80bd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fc77fe700 1 -- 172.21.15.115:0/1728220249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80c0e80 msgr2=0x7f0fc80bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fc77fe700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80c0e80 0x7f0fc80bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fc77fe700 1 -- 172.21.15.115:0/1728220249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0009ae0 con 0x7f0fc8065020 2023-07-27T14:38:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fc77fe700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc8153060 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f0fb800d830 tx=0x7f0fb8006af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0faf7fe700 1 -- 172.21.15.115:0/1728220249 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8005a90 con 0x7f0fc8065020 2023-07-27T14:38:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0faf7fe700 1 -- 172.21.15.115:0/1728220249 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8005bf0 con 0x7f0fc8065020 2023-07-27T14:38:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc81639e0 con 0x7f0fc8065020 2023-07-27T14:38:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0faf7fe700 1 -- 172.21.15.115:0/1728220249 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8006030 con 0x7f0fc8065020 2023-07-27T14:38:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.085+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc8163fa0 con 0x7f0fc8065020 2023-07-27T14:38:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.086+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc81602d0 con 0x7f0fc8065020 2023-07-27T14:38:46.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.087+0000 7f0faf7fe700 1 -- 172.21.15.115:0/1728220249 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f0fb8006460 con 0x7f0fc8065020 2023-07-27T14:38:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.088+0000 7f0faf7fe700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fb405fb50 0x7f0fb4062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.088+0000 7f0faf7fe700 1 -- 172.21.15.115:0/1728220249 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0fb807a8b0 con 0x7f0fc8065020 2023-07-27T14:38:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.088+0000 7f0fc6ffd700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fb405fb50 0x7f0fb4062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:46.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.089+0000 7f0fc6ffd700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fb405fb50 0x7f0fb4062010 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f0fbc006fd0 tx=0x7f0fbc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:46.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.092+0000 7f0faf7fe700 1 -- 172.21.15.115:0/1728220249 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fb80488f0 con 0x7f0fc8065020 2023-07-27T14:38:46.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.325+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_snapshot_namespace_and_size"]} v 0) v1 -- 0x7f0fc806c470 con 0x7f0fc8065020 2023-07-27T14:38:46.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.872+0000 7f0faf7fe700 1 -- 172.21.15.115:0/1728220249 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_snapshot_namespace_and_size"]}]=0 v596) v1 ==== 192+0+0 (secure 0 0 0) 0x7f0fb804edc0 con 0x7f0fc8065020 2023-07-27T14:38:46.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fb405fb50 msgr2=0x7f0fb4062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:46.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fb405fb50 0x7f0fb4062010 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f0fbc006fd0 tx=0x7f0fbc008040).stop 2023-07-27T14:38:46.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 msgr2=0x7f0fc8153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:46.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc8153060 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f0fb800d830 tx=0x7f0fb8006af0).stop 2023-07-27T14:38:46.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 shutdown_connections 2023-07-27T14:38:46.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fb405fb50 0x7f0fb4062010 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc8150320 0x7f0fc80bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc8065020 0x7f0fc8153060 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 --2- 172.21.15.115:0/1728220249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc80c0e80 0x7f0fc80bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:46.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.874+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 >> 172.21.15.115:0/1728220249 conn(0x7f0fc8062320 msgr2=0x7f0fc80bcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:46.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.875+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 shutdown_connections 2023-07-27T14:38:46.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:46.875+0000 7f0fce1ff700 1 -- 172.21.15.115:0/1728220249 wait complete. 2023-07-27T14:38:46.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:38:47.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.084+0000 7f0434fff700 1 Processor -- start 2023-07-27T14:38:47.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.084+0000 7f0434fff700 1 -- start start 2023-07-27T14:38:47.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.085+0000 7f0434fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f043013a350 0x7f0430065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.085+0000 7f0434fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.085+0000 7f0434fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04300bd9a0 con 0x7f043013a730 2023-07-27T14:38:47.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.085+0000 7f0434fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0430066400 con 0x7f043013a350 2023-07-27T14:38:47.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.085+0000 7f0434fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0430158ae0 con 0x7f04300c36b0 2023-07-27T14:38:47.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.085+0000 7f042e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f043013a350 0x7f0430065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f043013a350 0x7f0430065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35096/0 (socket says 172.21.15.115:35096) 2023-07-27T14:38:47.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042e59c700 1 -- 172.21.15.115:0/3343034853 learned_addr learned my addr 172.21.15.115:0/3343034853 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:47.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042ed9d700 1 --2- 172.21.15.115:0/3343034853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042e59c700 1 -- 172.21.15.115:0/3343034853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 msgr2=0x7f04301585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:47.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042e59c700 1 --2- 172.21.15.115:0/3343034853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042e59c700 1 -- 172.21.15.115:0/3343034853 >> v1:172.21.15.159:6789/0 conn(0x7f043013a730 legacy=0x7f04300c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042e59c700 1 -- 172.21.15.115:0/3343034853 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430066610 con 0x7f043013a350 2023-07-27T14:38:47.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042e59c700 1 --2- 172.21.15.115:0/3343034853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f0430065f10 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f0420006fd0 tx=0x7f04200090f0).ready entity=mon.0 client_cookie=2403deebe4319ad0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:47.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042d59a700 1 -- 172.21.15.115:0/3343034853 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042000b580 con 0x7f043013a350 2023-07-27T14:38:47.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042d59a700 1 -- 172.21.15.115:0/3343034853 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042000b6e0 con 0x7f043013a350 2023-07-27T14:38:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.086+0000 7f042d59a700 1 -- 172.21.15.115:0/3343034853 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042000ba60 con 0x7f043013a350 2023-07-27T14:38:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.087+0000 7f0434fff700 1 -- 172.21.15.115:0/3343034853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 msgr2=0x7f0430065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.087+0000 7f0434fff700 1 --2- 172.21.15.115:0/3343034853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f0430065f10 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f0420006fd0 tx=0x7f04200090f0).stop 2023-07-27T14:38:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.087+0000 7f0434fff700 1 -- 172.21.15.115:0/3343034853 shutdown_connections 2023-07-27T14:38:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.087+0000 7f0434fff700 1 --2- 172.21.15.115:0/3343034853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.087+0000 7f0434fff700 1 --2- 172.21.15.115:0/3343034853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f0430065f10 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.087+0000 7f0434fff700 1 -- 172.21.15.115:0/3343034853 >> 172.21.15.115:0/3343034853 conn(0x7f043005e8f0 msgr2=0x7f04300c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:47.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.087+0000 7f0434fff700 1 -- 172.21.15.115:0/3343034853 shutdown_connections 2023-07-27T14:38:47.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.087+0000 7f0434fff700 1 -- 172.21.15.115:0/3343034853 wait complete. 2023-07-27T14:38:47.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.088+0000 7f0434fff700 1 Processor -- start 2023-07-27T14:38:47.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.089+0000 7f0434fff700 1 -- start start 2023-07-27T14:38:47.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f0434fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f0434fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f04300aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f0434fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f043013a730 0x7f04300a8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f0434fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04301399a0 con 0x7f043013a350 2023-07-27T14:38:47.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f0434fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04300634e0 con 0x7f043013a730 2023-07-27T14:38:47.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f0434fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0430157350 con 0x7f04300c36b0 2023-07-27T14:38:47.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f04300aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f04300aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35102/0 (socket says 172.21.15.115:35102) 2023-07-27T14:38:47.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 -- 172.21.15.115:0/355296800 learned_addr learned my addr 172.21.15.115:0/355296800 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:47.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042e59c700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042ed9d700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f043013a730 0x7f04300a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 -- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 msgr2=0x7f04301394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 -- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f043013a730 msgr2=0x7f04300a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f043013a730 0x7f04300a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 -- 172.21.15.115:0/355296800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420009370 con 0x7f043013a350 2023-07-27T14:38:47.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042e59c700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:47.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.090+0000 7f042dd9b700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f04300aab50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f042400c440 tx=0x7f0424007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:47.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.091+0000 7f041e7fc700 1 -- 172.21.15.115:0/355296800 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424007020 con 0x7f043013a350 2023-07-27T14:38:47.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.091+0000 7f041e7fc700 1 -- 172.21.15.115:0/355296800 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424007180 con 0x7f043013a350 2023-07-27T14:38:47.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.091+0000 7f041e7fc700 1 -- 172.21.15.115:0/355296800 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424007520 con 0x7f043013a350 2023-07-27T14:38:47.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.091+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0430156ab0 con 0x7f043013a350 2023-07-27T14:38:47.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.091+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0430157070 con 0x7f043013a350 2023-07-27T14:38:47.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.092+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043006c470 con 0x7f043013a350 2023-07-27T14:38:47.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.093+0000 7f041e7fc700 1 -- 172.21.15.115:0/355296800 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f0424010070 con 0x7f043013a350 2023-07-27T14:38:47.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.093+0000 7f041e7fc700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f041005fb20 0x7f0410061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.093+0000 7f041e7fc700 1 -- 172.21.15.115:0/355296800 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f042407a0c0 con 0x7f043013a350 2023-07-27T14:38:47.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.094+0000 7f042e59c700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f041005fb20 0x7f0410061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.094+0000 7f042e59c700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f041005fb20 0x7f0410061fe0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f0420009fd0 tx=0x7f0420017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:47.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.098+0000 7f041e7fc700 1 -- 172.21.15.115:0/355296800 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f04240478f0 con 0x7f043013a350 2023-07-27T14:38:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.268+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f04300bdc10 con 0x7f043013a350 2023-07-27T14:38:47.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.272+0000 7f041e7fc700 1 -- 172.21.15.115:0/355296800 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f042404aa90 con 0x7f043013a350 2023-07-27T14:38:47.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f041005fb20 msgr2=0x7f0410061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f041005fb20 0x7f0410061fe0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f0420009fd0 tx=0x7f0420017000).stop 2023-07-27T14:38:47.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 msgr2=0x7f04300aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f04300aab50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f042400c440 tx=0x7f0424007e00).stop 2023-07-27T14:38:47.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 shutdown_connections 2023-07-27T14:38:47.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f041005fb20 0x7f0410061fe0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f043013a730 0x7f04300a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f04300c36b0 0x7f04301394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 --2- 172.21.15.115:0/355296800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f043013a350 0x7f04300aab50 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.274+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 >> 172.21.15.115:0/355296800 conn(0x7f043005e8f0 msgr2=0x7f0430065110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:47.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.275+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 shutdown_connections 2023-07-27T14:38:47.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.275+0000 7f0434fff700 1 -- 172.21.15.115:0/355296800 wait complete. 2023-07-27T14:38:47.345 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:38:47.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:38:47.460 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:38:47.564 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:38:47.565 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:38:47.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:38:47.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.702+0000 7f587e9ff700 1 Processor -- start 2023-07-27T14:38:47.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.702+0000 7f587e9ff700 1 -- start start 2023-07-27T14:38:47.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.703+0000 7f587e9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5878150af0 0x7f5878150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.703+0000 7f587e9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 0x7f58780c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.703+0000 7f587e9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587806a440 con 0x7f58780696f0 2023-07-27T14:38:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.703+0000 7f587e9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58780bbc80 con 0x7f5878150af0 2023-07-27T14:38:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.703+0000 7f587e9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5878069e80 con 0x7f58780c0e80 2023-07-27T14:38:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5877fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5878150af0 0x7f5878150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5877fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5878150af0 0x7f5878150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35106/0 (socket says 172.21.15.115:35106) 2023-07-27T14:38:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5877fff700 1 -- 172.21.15.115:0/751054151 learned_addr learned my addr 172.21.15.115:0/751054151 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f587cf9c700 1 --1- 172.21.15.115:0/751054151 >> v1:172.21.15.115:6789/0 conn(0x7f58780696f0 0x7f58780a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58082/0 (socket says 172.21.15.115:58082) 2023-07-27T14:38:47.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f58777fe700 1 --2- 172.21.15.115:0/751054151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 0x7f58780c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5877fff700 1 -- 172.21.15.115:0/751054151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 msgr2=0x7f58780c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:47.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5877fff700 1 --2- 172.21.15.115:0/751054151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 0x7f58780c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5877fff700 1 -- 172.21.15.115:0/751054151 >> v1:172.21.15.115:6789/0 conn(0x7f58780696f0 legacy=0x7f58780a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5877fff700 1 -- 172.21.15.115:0/751054151 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587806a160 con 0x7f5878150af0 2023-07-27T14:38:47.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5876ffd700 1 -- 172.21.15.115:0/751054151 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610192161 0 0) 0x7f587806a440 con 0x7f58780696f0 2023-07-27T14:38:47.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.704+0000 7f5877fff700 1 --2- 172.21.15.115:0/751054151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f5878150ed0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f5868006fd0 tx=0x7f586800b3b0).ready entity=mon.0 client_cookie=341009874183d05f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:47.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f5876ffd700 1 -- 172.21.15.115:0/751054151 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800da70 con 0x7f5878150af0 2023-07-27T14:38:47.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f5876ffd700 1 -- 172.21.15.115:0/751054151 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800dbd0 con 0x7f5878150af0 2023-07-27T14:38:47.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f5876ffd700 1 -- 172.21.15.115:0/751054151 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868010470 con 0x7f5878150af0 2023-07-27T14:38:47.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f587e9ff700 1 -- 172.21.15.115:0/751054151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 msgr2=0x7f5878150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f587e9ff700 1 --2- 172.21.15.115:0/751054151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f5878150ed0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f5868006fd0 tx=0x7f586800b3b0).stop 2023-07-27T14:38:47.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f587e9ff700 1 -- 172.21.15.115:0/751054151 shutdown_connections 2023-07-27T14:38:47.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f587e9ff700 1 --2- 172.21.15.115:0/751054151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f5878150ed0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f587e9ff700 1 --2- 172.21.15.115:0/751054151 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 0x7f58780c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f587e9ff700 1 -- 172.21.15.115:0/751054151 >> 172.21.15.115:0/751054151 conn(0x7f5878062320 msgr2=0x7f5878062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:47.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f587e9ff700 1 -- 172.21.15.115:0/751054151 shutdown_connections 2023-07-27T14:38:47.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.705+0000 7f587e9ff700 1 -- 172.21.15.115:0/751054151 wait complete. 2023-07-27T14:38:47.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.707+0000 7f587e9ff700 1 Processor -- start 2023-07-27T14:38:47.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.707+0000 7f587e9ff700 1 -- start start 2023-07-27T14:38:47.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587e9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780696f0 0x7f5878144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587e9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 0x7f58780bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587e9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f587814f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587e9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587814c7b0 con 0x7f5878150af0 2023-07-27T14:38:47.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587e9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587814c990 con 0x7f58780696f0 2023-07-27T14:38:47.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587e9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587814cc70 con 0x7f58780c0e80 2023-07-27T14:38:47.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587cf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f587814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587cf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f587814f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35118/0 (socket says 172.21.15.115:35118) 2023-07-27T14:38:47.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f587cf9c700 1 -- 172.21.15.115:0/3245655256 learned_addr learned my addr 172.21.15.115:0/3245655256 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:47.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f58777fe700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 0x7f58780bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.708+0000 7f5877fff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780696f0 0x7f5878144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f587cf9c700 1 -- 172.21.15.115:0/3245655256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 msgr2=0x7f58780bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f587cf9c700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 0x7f58780bdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f587cf9c700 1 -- 172.21.15.115:0/3245655256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780696f0 msgr2=0x7f5878144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f587cf9c700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780696f0 0x7f5878144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f587cf9c700 1 -- 172.21.15.115:0/3245655256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586800b610 con 0x7f5878150af0 2023-07-27T14:38:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f587cf9c700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f587814f840 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f587000c7e0 tx=0x7f5870007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f585ffff700 1 -- 172.21.15.115:0/3245655256 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870005c70 con 0x7f5878150af0 2023-07-27T14:38:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f585ffff700 1 -- 172.21.15.115:0/3245655256 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870005dd0 con 0x7f5878150af0 2023-07-27T14:38:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587814f040 con 0x7f5878150af0 2023-07-27T14:38:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f585ffff700 1 -- 172.21.15.115:0/3245655256 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870007320 con 0x7f5878150af0 2023-07-27T14:38:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.709+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587814cf50 con 0x7f5878150af0 2023-07-27T14:38:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.710+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587814f560 con 0x7f5878150af0 2023-07-27T14:38:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.711+0000 7f585ffff700 1 -- 172.21.15.115:0/3245655256 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f5870010030 con 0x7f5878150af0 2023-07-27T14:38:47.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.712+0000 7f585ffff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f586405fb50 0x7f5864062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:47.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.712+0000 7f585ffff700 1 -- 172.21.15.115:0/3245655256 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f587007ac90 con 0x7f5878150af0 2023-07-27T14:38:47.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.712+0000 7f5877fff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f586405fb50 0x7f5864062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:47.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.713+0000 7f5877fff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f586405fb50 0x7f5864062010 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f586800bfd0 tx=0x7f586800b3b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:47.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.716+0000 7f585ffff700 1 -- 172.21.15.115:0/3245655256 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f587004b600 con 0x7f5878150af0 2023-07-27T14:38:47.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.929+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5878063880 con 0x7f5878150af0 2023-07-27T14:38:47.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.929+0000 7f585ffff700 1 -- 172.21.15.115:0/3245655256 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f587004ec20 con 0x7f5878150af0 2023-07-27T14:38:47.983 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:47.984 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":96,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3836371},{"type":"v1","addr":"172.21.15.159:6833","nonce":3836371}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1315171707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":1315171707},{"type":"v1","addr":"172.21.15.115:6837","nonce":1315171707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1825044502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1825044502},{"type":"v1","addr":"172.21.15.159:6835","nonce":1825044502}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9702,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/1093612277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":1093612277},{"type":"v1","addr":"172.21.15.115:6836","nonce":1093612277}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[]} 2023-07-27T14:38:47.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f586405fb50 msgr2=0x7f5864062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f586405fb50 0x7f5864062010 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f586800bfd0 tx=0x7f586800b3b0).stop 2023-07-27T14:38:47.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 msgr2=0x7f587814f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:47.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f587814f840 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f587000c7e0 tx=0x7f5870007f60).stop 2023-07-27T14:38:47.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 shutdown_connections 2023-07-27T14:38:47.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f586405fb50 0x7f5864062010 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5878150af0 0x7f587814f840 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58780696f0 0x7f5878144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 --2- 172.21.15.115:0/3245655256 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58780c0e80 0x7f58780bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:47.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.931+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 >> 172.21.15.115:0/3245655256 conn(0x7f5878062320 msgr2=0x7f58781534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:47.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.932+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 shutdown_connections 2023-07-27T14:38:47.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:47.932+0000 7f587e9ff700 1 -- 172.21.15.115:0/3245655256 wait complete. 2023-07-27T14:38:47.989 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 96 2023-07-27T14:38:48.002 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:38:48.003 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:38:48.003 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:38:48.003 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:38:48.003 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:38:48.004 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:38:48.004 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:38:48.004 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:38:48.004 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:38:48.004 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:38:48.005 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:38:48.005 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:38:48.005 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:38:48.005 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:38:48.006 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:38:48.006 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:38:48.017 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:38:48.018 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:38:48.019 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:38:48.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:38:48.020 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:38:48.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:38:48.021 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:38:48.022 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:38:48.062 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:38:48.063 DEBUG:teuthology.parallel:result is None 2023-07-27T14:38:48.065 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:38:48.066 DEBUG:teuthology.parallel:result is None 2023-07-27T14:38:48.067 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:38:48.067 DEBUG:teuthology.parallel:result is None 2023-07-27T14:38:48.069 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:38:48.069 DEBUG:teuthology.parallel:result is None 2023-07-27T14:38:48.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:38:48.205 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:38:48.206 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:38:48.206 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:38:48.207 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:38:48.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.219+0000 7fd9f05ff700 1 Processor -- start 2023-07-27T14:38:48.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.219+0000 7fd9f05ff700 1 -- start start 2023-07-27T14:38:48.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.220+0000 7fd9f05ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd9e8153ec0 0x7fd9e80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:48.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.220+0000 7fd9f05ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e80c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:48.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.220+0000 7fd9f05ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80aa4d0 con 0x7fd9e80aa050 2023-07-27T14:38:48.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.220+0000 7fd9f05ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e80c05c0 con 0x7fd9e8153ec0 2023-07-27T14:38:48.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.220+0000 7fd9f05ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80bfc90 con 0x7fd9e80aaa40 2023-07-27T14:38:48.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.220+0000 7fd9edb9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd9e80aa050 0x7fd9e80640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58096/0 (socket says 172.21.15.115:58096) 2023-07-27T14:38:48.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.220+0000 7fd9edb9a700 1 -- 172.21.15.115:0/174936004 learned_addr learned my addr 172.21.15.115:0/174936004 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:48.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9eeb9c700 1 --2- 172.21.15.115:0/174936004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e80c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:48.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9ee39b700 1 --2- 172.21.15.115:0/174936004 >> v2:172.21.15.159:3300/0 conn(0x7fd9e8153ec0 0x7fd9e80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:48.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9ed399700 1 -- 172.21.15.115:0/174936004 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698161181 0 0) 0x7fd9d8001110 con 0x7fd9e80aa050 2023-07-27T14:38:48.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9ed399700 1 -- 172.21.15.115:0/174936004 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d40033f0 con 0x7fd9e80aa050 2023-07-27T14:38:48.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9eeb9c700 1 -- 172.21.15.115:0/174936004 >> v2:172.21.15.159:3300/0 conn(0x7fd9e8153ec0 msgr2=0x7fd9e80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:48.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9eeb9c700 1 --2- 172.21.15.115:0/174936004 >> v2:172.21.15.159:3300/0 conn(0x7fd9e8153ec0 0x7fd9e80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:48.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9eeb9c700 1 -- 172.21.15.115:0/174936004 >> v1:172.21.15.115:6789/0 conn(0x7fd9e80aa050 legacy=0x7fd9e80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:48.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9eeb9c700 1 -- 172.21.15.115:0/174936004 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80bff70 con 0x7fd9e80aaa40 2023-07-27T14:38:48.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9eeb9c700 1 --2- 172.21.15.115:0/174936004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e80c0a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fd9e0009e60 tx=0x7fd9e0009780).ready entity=mon.2 client_cookie=9c4622e810257c8d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:48.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9ed399700 1 -- 172.21.15.115:0/174936004 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000e070 con 0x7fd9e80aaa40 2023-07-27T14:38:48.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.221+0000 7fd9ed399700 1 -- 172.21.15.115:0/174936004 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e000bab0 con 0x7fd9e80aaa40 2023-07-27T14:38:48.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9ed399700 1 -- 172.21.15.115:0/174936004 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000be30 con 0x7fd9e80aaa40 2023-07-27T14:38:48.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9f05ff700 1 -- 172.21.15.115:0/174936004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 msgr2=0x7fd9e80c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:48.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/174936004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e80c0a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fd9e0009e60 tx=0x7fd9e0009780).stop 2023-07-27T14:38:48.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9f05ff700 1 -- 172.21.15.115:0/174936004 shutdown_connections 2023-07-27T14:38:48.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/174936004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e80c0a50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:48.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/174936004 >> v2:172.21.15.159:3300/0 conn(0x7fd9e8153ec0 0x7fd9e80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:48.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9f05ff700 1 -- 172.21.15.115:0/174936004 >> 172.21.15.115:0/174936004 conn(0x7fd9e80cb610 msgr2=0x7fd9e80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:48.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9f05ff700 1 -- 172.21.15.115:0/174936004 shutdown_connections 2023-07-27T14:38:48.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.222+0000 7fd9f05ff700 1 -- 172.21.15.115:0/174936004 wait complete. 2023-07-27T14:38:48.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.224+0000 7fd9f05ff700 1 Processor -- start 2023-07-27T14:38:48.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.224+0000 7fd9f05ff700 1 -- start start 2023-07-27T14:38:48.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9f05ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e80aa050 0x7fd9e8147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:48.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9f05ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e81520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:48.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9f05ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e8153ec0 0x7fd9e8152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:48.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9f05ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8152a80 con 0x7fd9e8153ec0 2023-07-27T14:38:48.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9f05ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8150970 con 0x7fd9e80aa050 2023-07-27T14:38:48.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9f05ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8150080 con 0x7fd9e80aaa40 2023-07-27T14:38:48.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e8153ec0 0x7fd9e8152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:48.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e8153ec0 0x7fd9e8152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35156/0 (socket says 172.21.15.115:35156) 2023-07-27T14:38:48.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 -- 172.21.15.115:0/3957946446 learned_addr learned my addr 172.21.15.115:0/3957946446 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:48.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9ee39b700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e80aa050 0x7fd9e8147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:48.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9edb9a700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e81520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:48.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 -- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 msgr2=0x7fd9e81520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:48.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e81520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:48.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 -- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e80aa050 msgr2=0x7fd9e8147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:48.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e80aa050 0x7fd9e8147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 -- 172.21.15.115:0/3957946446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0009a20 con 0x7fd9e8153ec0 2023-07-27T14:38:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9edb9a700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e81520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.225+0000 7fd9eeb9c700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e8153ec0 0x7fd9e8152590 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7fd9e80bfdd0 tx=0x7fd9e0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.226+0000 7fd9de7fc700 1 -- 172.21.15.115:0/3957946446 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e001d630 con 0x7fd9e8153ec0 2023-07-27T14:38:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.226+0000 7fd9de7fc700 1 -- 172.21.15.115:0/3957946446 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e001d790 con 0x7fd9e8153ec0 2023-07-27T14:38:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.226+0000 7fd9de7fc700 1 -- 172.21.15.115:0/3957946446 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e001db50 con 0x7fd9e8153ec0 2023-07-27T14:38:48.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.226+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e8150320 con 0x7fd9e8153ec0 2023-07-27T14:38:48.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.226+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e81482b0 con 0x7fd9e8153ec0 2023-07-27T14:38:48.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.227+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e806c470 con 0x7fd9e8153ec0 2023-07-27T14:38:48.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.228+0000 7fd9de7fc700 1 -- 172.21.15.115:0/3957946446 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fd9e0026410 con 0x7fd9e8153ec0 2023-07-27T14:38:48.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.228+0000 7fd9de7fc700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9cc05fb50 0x7fd9cc062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:48.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.228+0000 7fd9de7fc700 1 -- 172.21.15.115:0/3957946446 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd9e007cf10 con 0x7fd9e8153ec0 2023-07-27T14:38:48.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.229+0000 7fd9ee39b700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9cc05fb50 0x7fd9cc062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:48.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.229+0000 7fd9ee39b700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9cc05fb50 0x7fd9cc062010 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fd9e80b0d60 tx=0x7fd9e4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:48.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.232+0000 7fd9de7fc700 1 -- 172.21.15.115:0/3957946446 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9e004d990 con 0x7fd9e8153ec0 2023-07-27T14:38:48.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:48.419+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd9e80c0250 con 0x7fd9e8153ec0 2023-07-27T14:38:49.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.276+0000 7fd9de7fc700 1 -- 172.21.15.115:0/3957946446 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v184) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd9e0050fb0 con 0x7fd9e8153ec0 2023-07-27T14:38:49.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9cc05fb50 msgr2=0x7fd9cc062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:49.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9cc05fb50 0x7fd9cc062010 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fd9e80b0d60 tx=0x7fd9e4009060).stop 2023-07-27T14:38:49.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e8153ec0 msgr2=0x7fd9e8152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e8153ec0 0x7fd9e8152590 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7fd9e80bfdd0 tx=0x7fd9e0009780).stop 2023-07-27T14:38:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 shutdown_connections 2023-07-27T14:38:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd9cc05fb50 0x7fd9cc062010 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9e8153ec0 0x7fd9e8152590 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9e80aa050 0x7fd9e8147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 --2- 172.21.15.115:0/3957946446 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9e80aaa40 0x7fd9e81520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 >> 172.21.15.115:0/3957946446 conn(0x7fd9e80cb610 msgr2=0x7fd9e80c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 shutdown_connections 2023-07-27T14:38:49.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.279+0000 7fd9f05ff700 1 -- 172.21.15.115:0/3957946446 wait complete. 2023-07-27T14:38:49.334 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:38:49.353 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:38:49.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.490+0000 7fe6c97ff700 1 Processor -- start 2023-07-27T14:38:49.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.490+0000 7fe6c97ff700 1 -- start start 2023-07-27T14:38:49.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.491+0000 7fe6c97ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe6c40aaa40 0x7fe6c40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:49.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.491+0000 7fe6c97ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6c41542a0 0x7fe6c40645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:49.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.491+0000 7fe6c97ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c40aa4d0 con 0x7fe6c4153ec0 2023-07-27T14:38:49.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.491+0000 7fe6c97ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c4064ad0 con 0x7fe6c41542a0 2023-07-27T14:38:49.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.491+0000 7fe6c97ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c40c05c0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.491+0000 7fe6c2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe6c4153ec0 0x7fe6c40a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58098/0 (socket says 172.21.15.115:58098) 2023-07-27T14:38:49.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.491+0000 7fe6c2ffd700 1 -- 172.21.15.115:0/1877822510 learned_addr learned my addr 172.21.15.115:0/1877822510 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:49.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.491+0000 7fe6c37fe700 1 --2- 172.21.15.115:0/1877822510 >> v2:172.21.15.115:3300/0 conn(0x7fe6c41542a0 0x7fe6c40645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:49.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c1ffb700 1 -- 172.21.15.115:0/1877822510 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516115195 0 0) 0x7fe6b4001110 con 0x7fe6c4153ec0 2023-07-27T14:38:49.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c27fc700 1 --2- 172.21.15.115:0/1877822510 >> v2:172.21.15.159:3300/0 conn(0x7fe6c40aaa40 0x7fe6c40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:49.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c1ffb700 1 -- 172.21.15.115:0/1877822510 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6ac0033f0 con 0x7fe6c4153ec0 2023-07-27T14:38:49.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c37fe700 1 -- 172.21.15.115:0/1877822510 >> v2:172.21.15.159:3300/0 conn(0x7fe6c40aaa40 msgr2=0x7fe6c40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:49.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c37fe700 1 --2- 172.21.15.115:0/1877822510 >> v2:172.21.15.159:3300/0 conn(0x7fe6c40aaa40 0x7fe6c40640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c37fe700 1 -- 172.21.15.115:0/1877822510 >> v1:172.21.15.115:6789/0 conn(0x7fe6c4153ec0 legacy=0x7fe6c40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:49.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c37fe700 1 -- 172.21.15.115:0/1877822510 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40c1a60 con 0x7fe6c41542a0 2023-07-27T14:38:49.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c37fe700 1 --2- 172.21.15.115:0/1877822510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c41542a0 0x7fe6c40645e0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7fe6c406c0d0 tx=0x7fe6bc009780).ready entity=mon.0 client_cookie=f4a2a625f20d460e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:49.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c1ffb700 1 -- 172.21.15.115:0/1877822510 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00e070 con 0x7fe6c41542a0 2023-07-27T14:38:49.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c1ffb700 1 -- 172.21.15.115:0/1877822510 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc00bb60 con 0x7fe6c41542a0 2023-07-27T14:38:49.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.492+0000 7fe6c1ffb700 1 -- 172.21.15.115:0/1877822510 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc012410 con 0x7fe6c41542a0 2023-07-27T14:38:49.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.493+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1877822510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c41542a0 msgr2=0x7fe6c40645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:49.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.493+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1877822510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c41542a0 0x7fe6c40645e0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7fe6c406c0d0 tx=0x7fe6bc009780).stop 2023-07-27T14:38:49.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.493+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1877822510 shutdown_connections 2023-07-27T14:38:49.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.493+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1877822510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c41542a0 0x7fe6c40645e0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.493+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1877822510 >> v2:172.21.15.159:3300/0 conn(0x7fe6c40aaa40 0x7fe6c40640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.493+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1877822510 >> 172.21.15.115:0/1877822510 conn(0x7fe6c40cb610 msgr2=0x7fe6c40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:49.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.493+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1877822510 shutdown_connections 2023-07-27T14:38:49.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.493+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1877822510 wait complete. 2023-07-27T14:38:49.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.494+0000 7fe6c97ff700 1 Processor -- start 2023-07-27T14:38:49.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.495+0000 7fe6c97ff700 1 -- start start 2023-07-27T14:38:49.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.495+0000 7fe6c97ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c40aaa40 0x7fe6c4142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:49.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c97ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6c4153ec0 0x7fe6c4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:49.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c97ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6c41542a0 0x7fe6c40c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:49.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c97ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40c48a0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c97ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4164060 con 0x7fe6c4153ec0 2023-07-27T14:38:49.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c97ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4152110 con 0x7fe6c41542a0 2023-07-27T14:38:49.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c40aaa40 0x7fe6c4142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:49.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c40aaa40 0x7fe6c4142a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35170/0 (socket says 172.21.15.115:35170) 2023-07-27T14:38:49.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 -- 172.21.15.115:0/1168970242 learned_addr learned my addr 172.21.15.115:0/1168970242 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:49.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c27fc700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6c4153ec0 0x7fe6c4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:49.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c37fe700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6c41542a0 0x7fe6c40c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:49.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 -- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6c41542a0 msgr2=0x7fe6c40c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:49.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6c41542a0 0x7fe6c40c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 -- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6c4153ec0 msgr2=0x7fe6c4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:49.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6c4153ec0 0x7fe6c4152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 -- 172.21.15.115:0/1168970242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc009a20 con 0x7fe6c40aaa40 2023-07-27T14:38:49.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c37fe700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6c41542a0 0x7fe6c40c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:49.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.496+0000 7fe6c2ffd700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c40aaa40 0x7fe6c4142a20 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7fe6b400c4a0 tx=0x7fe6b4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:49.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.497+0000 7fe6aaffd700 1 -- 172.21.15.115:0/1168970242 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40072e0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.497+0000 7fe6aaffd700 1 -- 172.21.15.115:0/1168970242 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b4007440 con 0x7fe6c40aaa40 2023-07-27T14:38:49.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.497+0000 7fe6aaffd700 1 -- 172.21.15.115:0/1168970242 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40057a0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.497+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c4151500 con 0x7fe6c40aaa40 2023-07-27T14:38:49.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.497+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c4151ac0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.498+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c41523f0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.498+0000 7fe6aaffd700 1 -- 172.21.15.115:0/1168970242 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fe6b4010070 con 0x7fe6c40aaa40 2023-07-27T14:38:49.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.499+0000 7fe6aaffd700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6b005fb50 0x7fe6b0062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:49.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.499+0000 7fe6aaffd700 1 -- 172.21.15.115:0/1168970242 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe6b407a3c0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.500+0000 7fe6c27fc700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6b005fb50 0x7fe6b0062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:49.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.500+0000 7fe6c27fc700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6b005fb50 0x7fe6b0062010 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fe6c4153390 tx=0x7fe6b8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:49.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.503+0000 7fe6aaffd700 1 -- 172.21.15.115:0/1168970242 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe6b404ade0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.734+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe6c40aa4d0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.734+0000 7fe6aaffd700 1 -- 172.21.15.115:0/1168970242 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe6c40aa4d0 con 0x7fe6c40aaa40 2023-07-27T14:38:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:49.788 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:38:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:38:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:38:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:38:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:38:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:38:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:38:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:38:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:38:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:38:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:38:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:38:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:38:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:38:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:38:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:38:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:38:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:38:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:38:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:38:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:38:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:38:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:38:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:38:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:38:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:38:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:38:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:38:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:38:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:38:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:38:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:38:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:38:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:38:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:38:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:38:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:38:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:38:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:38:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:38:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:38:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:38:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:38:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:38:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:38:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:38:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:38:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:38:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:38:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:38:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:38:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:38:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:38:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:38:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:38:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:38:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:38:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:38:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:38:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:38:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:38:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:38:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:38:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:38:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:38:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:38:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:38:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:38:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:38:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:38:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:38:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:38:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:38:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:38:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:38:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:38:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:38:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:38:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:38:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:38:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:38:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:38:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:38:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:38:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:38:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:38:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:38:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:38:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:38:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:38:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:38:49.819 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:38:49.819 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.819 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:49.819 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:38:49.819 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:38:49.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6b005fb50 msgr2=0x7fe6b0062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:49.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6b005fb50 0x7fe6b0062010 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fe6c4153390 tx=0x7fe6b8008040).stop 2023-07-27T14:38:49.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c40aaa40 msgr2=0x7fe6c4142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:49.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c40aaa40 0x7fe6c4142a20 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7fe6b400c4a0 tx=0x7fe6b4007af0).stop 2023-07-27T14:38:49.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 shutdown_connections 2023-07-27T14:38:49.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe6b005fb50 0x7fe6b0062010 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6c41542a0 0x7fe6c40c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6c40aaa40 0x7fe6c4142a20 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 --2- 172.21.15.115:0/1168970242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6c4153ec0 0x7fe6c4152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:49.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 >> 172.21.15.115:0/1168970242 conn(0x7fe6c40cb610 msgr2=0x7fe6c40ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:49.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 shutdown_connections 2023-07-27T14:38:49.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.736+0000 7fe6c97ff700 1 -- 172.21.15.115:0/1168970242 wait complete. 2023-07-27T14:38:49.823 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:38:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.960+0000 7f190cfff700 1 Processor -- start 2023-07-27T14:38:50.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.960+0000 7f190cfff700 1 -- start start 2023-07-27T14:38:50.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.961+0000 7f190cfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19081542a0 0x7f190815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.961+0000 7f190cfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19080aa4d0 con 0x7f1908153ec0 2023-07-27T14:38:50.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.961+0000 7f190cfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19080c05c0 con 0x7f19080aaa40 2023-07-27T14:38:50.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.961+0000 7f190cfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080c1a60 con 0x7f19081542a0 2023-07-27T14:38:50.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.961+0000 7f190659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1908153ec0 0x7f19080a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58100/0 (socket says 172.21.15.115:58100) 2023-07-27T14:38:50.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.961+0000 7f190659c700 1 -- 172.21.15.115:0/479586392 learned_addr learned my addr 172.21.15.115:0/479586392 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:50.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.962+0000 7f1906d9d700 1 --2- 172.21.15.115:0/479586392 >> v2:172.21.15.115:3300/0 conn(0x7f19081542a0 0x7f190815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.962+0000 7f190559a700 1 -- 172.21.15.115:0/479586392 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419022319 0 0) 0x7f18f8001110 con 0x7f1908153ec0 2023-07-27T14:38:50.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.962+0000 7f190559a700 1 -- 172.21.15.115:0/479586392 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f00033f0 con 0x7f1908153ec0 2023-07-27T14:38:50.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.962+0000 7f1906d9d700 1 -- 172.21.15.115:0/479586392 >> v1:172.21.15.159:6789/0 conn(0x7f19080aaa40 legacy=0x7f19080640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.962+0000 7f1906d9d700 1 -- 172.21.15.115:0/479586392 >> v1:172.21.15.115:6789/0 conn(0x7f1908153ec0 legacy=0x7f19080a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.962+0000 7f1906d9d700 1 -- 172.21.15.115:0/479586392 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080aa270 con 0x7f19081542a0 2023-07-27T14:38:50.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.962+0000 7f1906d9d700 1 --2- 172.21.15.115:0/479586392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f190815efc0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f1900009e60 tx=0x7f1900009780).ready entity=mon.0 client_cookie=935d9384fb8c1626 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.962+0000 7f190559a700 1 -- 172.21.15.115:0/479586392 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190000e070 con 0x7f19081542a0 2023-07-27T14:38:50.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190559a700 1 -- 172.21.15.115:0/479586392 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190000bb60 con 0x7f19081542a0 2023-07-27T14:38:50.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190559a700 1 -- 172.21.15.115:0/479586392 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900012410 con 0x7f19081542a0 2023-07-27T14:38:50.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190cfff700 1 -- 172.21.15.115:0/479586392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 msgr2=0x7f190815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190cfff700 1 --2- 172.21.15.115:0/479586392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f190815efc0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f1900009e60 tx=0x7f1900009780).stop 2023-07-27T14:38:50.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190cfff700 1 -- 172.21.15.115:0/479586392 shutdown_connections 2023-07-27T14:38:50.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190cfff700 1 --2- 172.21.15.115:0/479586392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f190815efc0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190cfff700 1 -- 172.21.15.115:0/479586392 >> 172.21.15.115:0/479586392 conn(0x7f19080cb610 msgr2=0x7f19080c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:50.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190cfff700 1 -- 172.21.15.115:0/479586392 shutdown_connections 2023-07-27T14:38:50.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.963+0000 7f190cfff700 1 -- 172.21.15.115:0/479586392 wait complete. 2023-07-27T14:38:50.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.965+0000 7f190cfff700 1 Processor -- start 2023-07-27T14:38:50.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.965+0000 7f190cfff700 1 -- start start 2023-07-27T14:38:50.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f190cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080aaa40 0x7f1908153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f190cfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1908153ec0 0x7f190814cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f190cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f1908062ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f190cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908167450 con 0x7f19081542a0 2023-07-27T14:38:50.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f190cfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908167cb0 con 0x7f1908153ec0 2023-07-27T14:38:50.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f190cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1908153610 con 0x7f19080aaa40 2023-07-27T14:38:50.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1906d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f1908062ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1906d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f1908062ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35182/0 (socket says 172.21.15.115:35182) 2023-07-27T14:38:50.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1906d9d700 1 -- 172.21.15.115:0/1484899658 learned_addr learned my addr 172.21.15.115:0/1484899658 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:50.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1905d9b700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1908153ec0 0x7f190814cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f190659c700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080aaa40 0x7f1908153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1906d9d700 1 -- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080aaa40 msgr2=0x7f1908153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1906d9d700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080aaa40 0x7f1908153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1906d9d700 1 -- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1908153ec0 msgr2=0x7f190814cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1906d9d700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1908153ec0 0x7f190814cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1906d9d700 1 -- 172.21.15.115:0/1484899658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900009a20 con 0x7f19081542a0 2023-07-27T14:38:50.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.967+0000 7f1905d9b700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1908153ec0 0x7f190814cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:50.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.968+0000 7f1906d9d700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f1908062ac0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f19000094d0 tx=0x7f19080c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.968+0000 7f18f67fc700 1 -- 172.21.15.115:0/1484899658 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190001c660 con 0x7f19081542a0 2023-07-27T14:38:50.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.968+0000 7f18f67fc700 1 -- 172.21.15.115:0/1484899658 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190001c7c0 con 0x7f19081542a0 2023-07-27T14:38:50.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.968+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1908167660 con 0x7f19081542a0 2023-07-27T14:38:50.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.968+0000 7f18f67fc700 1 -- 172.21.15.115:0/1484899658 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190001cb60 con 0x7f19081542a0 2023-07-27T14:38:50.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.968+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190814d110 con 0x7f19081542a0 2023-07-27T14:38:50.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.969+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1908167e20 con 0x7f19081542a0 2023-07-27T14:38:50.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.970+0000 7f18f67fc700 1 -- 172.21.15.115:0/1484899658 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f1900027460 con 0x7f19081542a0 2023-07-27T14:38:50.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.970+0000 7f18f67fc700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18e805fb20 0x7f18e8061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.970+0000 7f18f67fc700 1 -- 172.21.15.115:0/1484899658 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f190007d170 con 0x7f19081542a0 2023-07-27T14:38:50.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.971+0000 7f190659c700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18e805fb20 0x7f18e8061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.971+0000 7f190659c700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18e805fb20 0x7f18e8061fe0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f18f8001270 tx=0x7f18f8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:49.974+0000 7f18f67fc700 1 -- 172.21.15.115:0/1484899658 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f190004dbe0 con 0x7f19081542a0 2023-07-27T14:38:50.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.144+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f190806c470 con 0x7f19081542a0 2023-07-27T14:38:50.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.145+0000 7f18f67fc700 1 -- 172.21.15.115:0/1484899658 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+13866 (secure 0 0 0) 0x7f1900051200 con 0x7f19081542a0 2023-07-27T14:38:50.200 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:50.200 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":184,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:38:49.273263+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:38:50.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18e805fb20 msgr2=0x7f18e8061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18e805fb20 0x7f18e8061fe0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f18f8001270 tx=0x7f18f8009040).stop 2023-07-27T14:38:50.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 msgr2=0x7f1908062ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f1908062ac0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f19000094d0 tx=0x7f19080c0530).stop 2023-07-27T14:38:50.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 shutdown_connections 2023-07-27T14:38:50.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f18e805fb20 0x7f18e8061fe0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19081542a0 0x7f1908062ac0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19080aaa40 0x7f1908153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 --2- 172.21.15.115:0/1484899658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1908153ec0 0x7f190814cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 >> 172.21.15.115:0/1484899658 conn(0x7f19080cb610 msgr2=0x7f19080ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:50.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 shutdown_connections 2023-07-27T14:38:50.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.147+0000 7f190cfff700 1 -- 172.21.15.115:0/1484899658 wait complete. 2023-07-27T14:38:50.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:38:50.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:38:50.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.358+0000 7f389edff700 1 Processor -- start 2023-07-27T14:38:50.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.358+0000 7f389edff700 1 -- start start 2023-07-27T14:38:50.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.359+0000 7f389edff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f389813a350 0x7f3898065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.359+0000 7f389edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389813a730 0x7f38981585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.359+0000 7f389edff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980bd9a0 con 0x7f38980c2fa0 2023-07-27T14:38:50.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.359+0000 7f389edff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3898066400 con 0x7f389813a350 2023-07-27T14:38:50.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.359+0000 7f389edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3898158ae0 con 0x7f389813a730 2023-07-27T14:38:50.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.359+0000 7f389cb9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f389813a350 0x7f3898065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f389d39c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f38980c2fa0 0x7f3898067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58110/0 (socket says 172.21.15.115:58110) 2023-07-27T14:38:50.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f389d39c700 1 -- 172.21.15.115:0/2128006850 learned_addr learned my addr 172.21.15.115:0/2128006850 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:50.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f3897fff700 1 --2- 172.21.15.115:0/2128006850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389813a730 0x7f38981585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f389cb9b700 1 -- 172.21.15.115:0/2128006850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389813a730 msgr2=0x7f38981585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:50.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f389cb9b700 1 --2- 172.21.15.115:0/2128006850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389813a730 0x7f38981585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f389cb9b700 1 -- 172.21.15.115:0/2128006850 >> v1:172.21.15.115:6789/0 conn(0x7f38980c2fa0 legacy=0x7f3898067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f389cb9b700 1 -- 172.21.15.115:0/2128006850 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898066610 con 0x7f389813a350 2023-07-27T14:38:50.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f38977fe700 1 -- 172.21.15.115:0/2128006850 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994062967 0 0) 0x7f38980bd9a0 con 0x7f38980c2fa0 2023-07-27T14:38:50.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f389cb9b700 1 --2- 172.21.15.115:0/2128006850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a350 0x7f3898065f10 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f388c009760 tx=0x7f388c009060).ready entity=mon.0 client_cookie=e4caa515d5117588 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f38977fe700 1 -- 172.21.15.115:0/2128006850 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00b580 con 0x7f389813a350 2023-07-27T14:38:50.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f38977fe700 1 -- 172.21.15.115:0/2128006850 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00b6e0 con 0x7f389813a350 2023-07-27T14:38:50.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.360+0000 7f38977fe700 1 -- 172.21.15.115:0/2128006850 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00ba60 con 0x7f389813a350 2023-07-27T14:38:50.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.361+0000 7f389edff700 1 -- 172.21.15.115:0/2128006850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a350 msgr2=0x7f3898065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.361+0000 7f389edff700 1 --2- 172.21.15.115:0/2128006850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a350 0x7f3898065f10 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f388c009760 tx=0x7f388c009060).stop 2023-07-27T14:38:50.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.361+0000 7f389edff700 1 -- 172.21.15.115:0/2128006850 shutdown_connections 2023-07-27T14:38:50.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.361+0000 7f389edff700 1 --2- 172.21.15.115:0/2128006850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a350 0x7f3898065f10 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.361+0000 7f389edff700 1 --2- 172.21.15.115:0/2128006850 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f389813a730 0x7f38981585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.361+0000 7f389edff700 1 -- 172.21.15.115:0/2128006850 >> 172.21.15.115:0/2128006850 conn(0x7f389805e8f0 msgr2=0x7f38980c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:50.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.361+0000 7f389edff700 1 -- 172.21.15.115:0/2128006850 shutdown_connections 2023-07-27T14:38:50.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.361+0000 7f389edff700 1 -- 172.21.15.115:0/2128006850 wait complete. 2023-07-27T14:38:50.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.362+0000 7f389edff700 1 Processor -- start 2023-07-27T14:38:50.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.363+0000 7f389edff700 1 -- start start 2023-07-27T14:38:50.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.363+0000 7f389edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38980c2fa0 0x7f38981673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389edff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389813a350 0x7f38980a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389edff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a730 0x7f38980a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389edff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981678a0 con 0x7f389813a730 2023-07-27T14:38:50.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389edff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980a9820 con 0x7f389813a350 2023-07-27T14:38:50.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980c6b00 con 0x7f38980c2fa0 2023-07-27T14:38:50.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a730 0x7f38980a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a730 0x7f38980a9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35210/0 (socket says 172.21.15.115:35210) 2023-07-27T14:38:50.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 -- 172.21.15.115:0/2610973325 learned_addr learned my addr 172.21.15.115:0/2610973325 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:50.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f3897fff700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389813a350 0x7f38980a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389cb9b700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38980c2fa0 0x7f38981673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 -- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38980c2fa0 msgr2=0x7f38981673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38980c2fa0 0x7f38981673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 -- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389813a350 msgr2=0x7f38980a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389813a350 0x7f38980a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 -- 172.21.15.115:0/2610973325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0092a0 con 0x7f389813a730 2023-07-27T14:38:50.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f3897fff700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389813a350 0x7f38980a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:50.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389cb9b700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38980c2fa0 0x7f38981673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:50.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.364+0000 7f389d39c700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a730 0x7f38980a9330 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f389000c7e0 tx=0x7f3890007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.365+0000 7f3894ff9700 1 -- 172.21.15.115:0/2610973325 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890005d30 con 0x7f389813a730 2023-07-27T14:38:50.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.365+0000 7f3894ff9700 1 -- 172.21.15.115:0/2610973325 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890005e90 con 0x7f389813a730 2023-07-27T14:38:50.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.365+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38980c5ef0 con 0x7f389813a730 2023-07-27T14:38:50.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.365+0000 7f3894ff9700 1 -- 172.21.15.115:0/2610973325 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890007320 con 0x7f389813a730 2023-07-27T14:38:50.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.365+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38980c64b0 con 0x7f389813a730 2023-07-27T14:38:50.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.366+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980c6cb0 con 0x7f389813a730 2023-07-27T14:38:50.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.367+0000 7f3894ff9700 1 -- 172.21.15.115:0/2610973325 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f3890010030 con 0x7f389813a730 2023-07-27T14:38:50.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.367+0000 7f3894ff9700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05fb50 0x7f387c062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.368+0000 7f3894ff9700 1 -- 172.21.15.115:0/2610973325 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f389007ac40 con 0x7f389813a730 2023-07-27T14:38:50.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.368+0000 7f389cb9b700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05fb50 0x7f387c062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.368+0000 7f389cb9b700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05fb50 0x7f387c062010 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f388c00b340 tx=0x7f388c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.371+0000 7f3894ff9700 1 -- 172.21.15.115:0/2610973325 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f38980c6cb0 con 0x7f389813a730 2023-07-27T14:38:50.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.538+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f38980c6c70 con 0x7f389813a730 2023-07-27T14:38:50.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.539+0000 7f3894ff9700 1 -- 172.21.15.115:0/2610973325 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v184) v1 ==== 110+0+10 (secure 0 0 0) 0x7f389004b770 con 0x7f389813a730 2023-07-27T14:38:50.593 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:38:50.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05fb50 msgr2=0x7f387c062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05fb50 0x7f387c062010 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f388c00b340 tx=0x7f388c017000).stop 2023-07-27T14:38:50.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a730 msgr2=0x7f38980a9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a730 0x7f38980a9330 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f389000c7e0 tx=0x7f3890007f90).stop 2023-07-27T14:38:50.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 shutdown_connections 2023-07-27T14:38:50.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f387c05fb50 0x7f387c062010 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f389813a730 0x7f38980a9330 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38980c2fa0 0x7f38981673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 --2- 172.21.15.115:0/2610973325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f389813a350 0x7f38980a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 >> 172.21.15.115:0/2610973325 conn(0x7f389805e8f0 msgr2=0x7f38980ac430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:50.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 shutdown_connections 2023-07-27T14:38:50.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.541+0000 7f389edff700 1 -- 172.21.15.115:0/2610973325 wait complete. 2023-07-27T14:38:50.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:38:50.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.749+0000 7f75defff700 1 Processor -- start 2023-07-27T14:38:50.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.749+0000 7f75defff700 1 -- start start 2023-07-27T14:38:50.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.750+0000 7f75defff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75d813a350 0x7f75d8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.750+0000 7f75defff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d80bd9a0 con 0x7f75d813a730 2023-07-27T14:38:50.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.750+0000 7f75defff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d8066610 con 0x7f75d80c36b0 2023-07-27T14:38:50.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.750+0000 7f75defff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d8066400 con 0x7f75d813a350 2023-07-27T14:38:50.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.751+0000 7f75d7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f75d813a730 0x7f75d80c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58124/0 (socket says 172.21.15.115:58124) 2023-07-27T14:38:50.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.751+0000 7f75d7fff700 1 -- 172.21.15.115:0/3398694451 learned_addr learned my addr 172.21.15.115:0/3398694451 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:50.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.751+0000 7f75dcd9b700 1 --2- 172.21.15.115:0/3398694451 >> v2:172.21.15.115:3300/0 conn(0x7f75d813a350 0x7f75d8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.751+0000 7f75dcd9b700 1 -- 172.21.15.115:0/3398694451 >> v1:172.21.15.159:6789/0 conn(0x7f75d80c36b0 legacy=0x7f75d80be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.751+0000 7f75dcd9b700 1 -- 172.21.15.115:0/3398694451 >> v1:172.21.15.115:6789/0 conn(0x7f75d813a730 legacy=0x7f75d80c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.751+0000 7f75dcd9b700 1 -- 172.21.15.115:0/3398694451 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d80bdc10 con 0x7f75d813a350 2023-07-27T14:38:50.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.751+0000 7f75d77fe700 1 -- 172.21.15.115:0/3398694451 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959544166 0 0) 0x7f75d80bd9a0 con 0x7f75d813a730 2023-07-27T14:38:50.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.751+0000 7f75dcd9b700 1 --2- 172.21.15.115:0/3398694451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8065f10 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f75cc009760 tx=0x7f75cc009060).ready entity=mon.0 client_cookie=86dfb7f3f7cf5e6c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75d77fe700 1 -- 172.21.15.115:0/3398694451 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00b580 con 0x7f75d813a350 2023-07-27T14:38:50.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75d77fe700 1 -- 172.21.15.115:0/3398694451 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00b6e0 con 0x7f75d813a350 2023-07-27T14:38:50.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75d77fe700 1 -- 172.21.15.115:0/3398694451 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00ba60 con 0x7f75d813a350 2023-07-27T14:38:50.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75defff700 1 -- 172.21.15.115:0/3398694451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 msgr2=0x7f75d8065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75defff700 1 --2- 172.21.15.115:0/3398694451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8065f10 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f75cc009760 tx=0x7f75cc009060).stop 2023-07-27T14:38:50.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75defff700 1 -- 172.21.15.115:0/3398694451 shutdown_connections 2023-07-27T14:38:50.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75defff700 1 --2- 172.21.15.115:0/3398694451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8065f10 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75defff700 1 -- 172.21.15.115:0/3398694451 >> 172.21.15.115:0/3398694451 conn(0x7f75d805e8f0 msgr2=0x7f75d80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:50.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75defff700 1 -- 172.21.15.115:0/3398694451 shutdown_connections 2023-07-27T14:38:50.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.752+0000 7f75defff700 1 -- 172.21.15.115:0/3398694451 wait complete. 2023-07-27T14:38:50.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.754+0000 7f75defff700 1 Processor -- start 2023-07-27T14:38:50.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.754+0000 7f75defff700 1 -- start start 2023-07-27T14:38:50.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75defff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75d80c36b0 0x7f75d8158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75defff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75defff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75d813a730 0x7f75d8156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75defff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8156260 con 0x7f75d813a350 2023-07-27T14:38:50.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75defff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80c0530 con 0x7f75d813a730 2023-07-27T14:38:50.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75defff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d81555e0 con 0x7f75d80c36b0 2023-07-27T14:38:50.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75d7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75d7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35218/0 (socket says 172.21.15.115:35218) 2023-07-27T14:38:50.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75d7fff700 1 -- 172.21.15.115:0/798712265 learned_addr learned my addr 172.21.15.115:0/798712265 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:50.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75dd59c700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75d813a730 0x7f75d8156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.755+0000 7f75dcd9b700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75d80c36b0 0x7f75d8158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d7fff700 1 -- 172.21.15.115:0/798712265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75d80c36b0 msgr2=0x7f75d8158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d7fff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75d80c36b0 0x7f75d8158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d7fff700 1 -- 172.21.15.115:0/798712265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75d813a730 msgr2=0x7f75d8156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d7fff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75d813a730 0x7f75d8156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d7fff700 1 -- 172.21.15.115:0/798712265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0092a0 con 0x7f75d813a350 2023-07-27T14:38:50.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d7fff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8156680 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f75c400c4c0 tx=0x7f75c4007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d4ff9700 1 -- 172.21.15.115:0/798712265 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40072e0 con 0x7f75d813a350 2023-07-27T14:38:50.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d4ff9700 1 -- 172.21.15.115:0/798712265 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c4007440 con 0x7f75d813a350 2023-07-27T14:38:50.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75d4ff9700 1 -- 172.21.15.115:0/798712265 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40057a0 con 0x7f75d813a350 2023-07-27T14:38:50.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d81558c0 con 0x7f75d813a350 2023-07-27T14:38:50.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.756+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8155e80 con 0x7f75d813a350 2023-07-27T14:38:50.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.757+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d81563a0 con 0x7f75d813a350 2023-07-27T14:38:50.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.758+0000 7f75d4ff9700 1 -- 172.21.15.115:0/798712265 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f75c4010070 con 0x7f75d813a350 2023-07-27T14:38:50.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.759+0000 7f75d4ff9700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75bc05fb50 0x7f75bc062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:50.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.759+0000 7f75d4ff9700 1 -- 172.21.15.115:0/798712265 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f75c407a360 con 0x7f75d813a350 2023-07-27T14:38:50.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.759+0000 7f75dcd9b700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75bc05fb50 0x7f75bc062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:50.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.760+0000 7f75dcd9b700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75bc05fb50 0x7f75bc062010 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f75cc009630 tx=0x7f75cc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:50.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.763+0000 7f75d4ff9700 1 -- 172.21.15.115:0/798712265 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75c404ae90 con 0x7f75d813a350 2023-07-27T14:38:50.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.931+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75d806c470 con 0x7f75d813a350 2023-07-27T14:38:50.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.932+0000 7f75d4ff9700 1 -- 172.21.15.115:0/798712265 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v184) v1 ==== 92+0+10 (secure 0 0 0) 0x7f75c404e4b0 con 0x7f75d813a350 2023-07-27T14:38:50.985 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:38:50.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75bc05fb50 msgr2=0x7f75bc062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75bc05fb50 0x7f75bc062010 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f75cc009630 tx=0x7f75cc017000).stop 2023-07-27T14:38:50.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 msgr2=0x7f75d8156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:50.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8156680 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f75c400c4c0 tx=0x7f75c4007e40).stop 2023-07-27T14:38:50.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 shutdown_connections 2023-07-27T14:38:50.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f75bc05fb50 0x7f75bc062010 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75d813a730 0x7f75d8156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f75d80c36b0 0x7f75d8158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 --2- 172.21.15.115:0/798712265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75d813a350 0x7f75d8156680 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:50.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 >> 172.21.15.115:0/798712265 conn(0x7f75d805e8f0 msgr2=0x7f75d80acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:50.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 shutdown_connections 2023-07-27T14:38:50.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:50.934+0000 7f75defff700 1 -- 172.21.15.115:0/798712265 wait complete. 2023-07-27T14:38:51.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:38:51.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.138+0000 7fe8f57ff700 1 Processor -- start 2023-07-27T14:38:51.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.138+0000 7fe8f57ff700 1 -- start start 2023-07-27T14:38:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.139+0000 7fe8f57ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00aaa40 0x7fe8f00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.140+0000 7fe8f57ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f00aa4d0 con 0x7fe8f0153ec0 2023-07-27T14:38:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.140+0000 7fe8f57ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f00c05c0 con 0x7fe8f01542a0 2023-07-27T14:38:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.140+0000 7fe8f57ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00aa270 con 0x7fe8f00aaa40 2023-07-27T14:38:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.140+0000 7fe8eeffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe8f0153ec0 0x7fe8f00a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58138/0 (socket says 172.21.15.115:58138) 2023-07-27T14:38:51.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.140+0000 7fe8eeffd700 1 -- 172.21.15.115:0/2237419528 learned_addr learned my addr 172.21.15.115:0/2237419528 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:51.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.140+0000 7fe8ee7fc700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00aaa40 0x7fe8f00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.140+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176218976 0 0) 0x7fe8e0001110 con 0x7fe8f0153ec0 2023-07-27T14:38:51.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.140+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d80033f0 con 0x7fe8f0153ec0 2023-07-27T14:38:51.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518527491 0 0) 0x7fe8d80033f0 con 0x7fe8f0153ec0 2023-07-27T14:38:51.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00aaa40 msgr2=0x7fe8f00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:51.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00aaa40 0x7fe8f00640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 >> v1:172.21.15.159:6789/0 conn(0x7fe8f01542a0 legacy=0x7fe8f00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00bfc90 con 0x7fe8f0153ec0 2023-07-27T14:38:51.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fe8e0001600 con 0x7fe8f0153ec0 2023-07-27T14:38:51.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 >> v1:172.21.15.115:6789/0 conn(0x7fe8f0153ec0 legacy=0x7fe8f00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8d8003910 0x7fe8d8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00aaa40 0x7fe8d8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8d8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00aa270 con 0x7fe8d8004b80 2023-07-27T14:38:51.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d800b8e0 con 0x7fe8d8003910 2023-07-27T14:38:51.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d800ba50 con 0x7fe8f00aaa40 2023-07-27T14:38:51.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8ef7fe700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8d8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8eeffd700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8d8003910 0x7fe8d8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8ee7fc700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00aaa40 0x7fe8d8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.141+0000 7fe8ef7fe700 1 -- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00aaa40 msgr2=0x7fe8d8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:51.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8ef7fe700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00aaa40 0x7fe8d8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8ef7fe700 1 -- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8d8003910 msgr2=0x7fe8d8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:51.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8ef7fe700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8d8003910 0x7fe8d8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8ef7fe700 1 -- 172.21.15.115:0/2237419528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80033f0 con 0x7fe8d8004b80 2023-07-27T14:38:51.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8ef7fe700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8d8005000 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7fe8f00843d0 tx=0x7fe8e8007f30).ready entity=mon.0 client_cookie=93b56be708aac8d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:51.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800c7e0 con 0x7fe8d8004b80 2023-07-27T14:38:51.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e800c940 con 0x7fe8d8004b80 2023-07-27T14:38:51.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8edffb700 1 -- 172.21.15.115:0/2237419528 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800cd00 con 0x7fe8d8004b80 2023-07-27T14:38:51.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8f57ff700 1 -- 172.21.15.115:0/2237419528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 msgr2=0x7fe8d8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8f57ff700 1 --2- 172.21.15.115:0/2237419528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8d8005000 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7fe8f00843d0 tx=0x7fe8e8007f30).stop 2023-07-27T14:38:51.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.142+0000 7fe8ef7fe700 1 -- 172.21.15.115:0/2237419528 reap_dead start 2023-07-27T14:38:51.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.143+0000 7fe8f57ff700 1 -- 172.21.15.115:0/2237419528 shutdown_connections 2023-07-27T14:38:51.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.143+0000 7fe8f57ff700 1 -- 172.21.15.115:0/2237419528 >> 172.21.15.115:0/2237419528 conn(0x7fe8f00cb610 msgr2=0x7fe8f00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:51.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.143+0000 7fe8f57ff700 1 -- 172.21.15.115:0/2237419528 shutdown_connections 2023-07-27T14:38:51.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.143+0000 7fe8f57ff700 1 -- 172.21.15.115:0/2237419528 wait complete. 2023-07-27T14:38:51.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.144+0000 7fe8f57ff700 1 Processor -- start 2023-07-27T14:38:51.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.144+0000 7fe8f57ff700 1 -- start start 2023-07-27T14:38:51.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8f57ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8f0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8f57ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00c1c30 0x7fe8f00c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8f57ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8f00c3d10 0x7fe8f0164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8f57ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00a9de0 con 0x7fe8d8004b80 2023-07-27T14:38:51.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8f57ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00c4190 con 0x7fe8f00c3d10 2023-07-27T14:38:51.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8f57ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00c21d0 con 0x7fe8f00c1c30 2023-07-27T14:38:51.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8eeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8f0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8eeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8f0153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35232/0 (socket says 172.21.15.115:35232) 2023-07-27T14:38:51.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.145+0000 7fe8eeffd700 1 -- 172.21.15.115:0/108795630 learned_addr learned my addr 172.21.15.115:0/108795630 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:51.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8ee7fc700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00c1c30 0x7fe8f00c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8ef7fe700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8f00c3d10 0x7fe8f0164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8eeffd700 1 -- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00c1c30 msgr2=0x7fe8f00c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8eeffd700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00c1c30 0x7fe8f00c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8eeffd700 1 -- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8f00c3d10 msgr2=0x7fe8f0164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8eeffd700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8f00c3d10 0x7fe8f0164700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8eeffd700 1 -- 172.21.15.115:0/108795630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00c24b0 con 0x7fe8d8004b80 2023-07-27T14:38:51.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8ef7fe700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8f00c3d10 0x7fe8f0164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:51.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8eeffd700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8f0153460 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7fe8e0007fb0 tx=0x7fe8e0007850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:51.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8d6ffd700 1 -- 172.21.15.115:0/108795630 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0011580 con 0x7fe8d8004b80 2023-07-27T14:38:51.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8d6ffd700 1 -- 172.21.15.115:0/108795630 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00116e0 con 0x7fe8d8004b80 2023-07-27T14:38:51.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f00c2790 con 0x7fe8d8004b80 2023-07-27T14:38:51.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8d6ffd700 1 -- 172.21.15.115:0/108795630 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0011a60 con 0x7fe8d8004b80 2023-07-27T14:38:51.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.146+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f0164bf0 con 0x7fe8d8004b80 2023-07-27T14:38:51.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.147+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f006c470 con 0x7fe8d8004b80 2023-07-27T14:38:51.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.148+0000 7fe8d6ffd700 1 -- 172.21.15.115:0/108795630 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fe8e001b030 con 0x7fe8d8004b80 2023-07-27T14:38:51.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.149+0000 7fe8d6ffd700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe8dc05fb20 0x7fe8dc061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.149+0000 7fe8d6ffd700 1 -- 172.21.15.115:0/108795630 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe8e007a440 con 0x7fe8d8004b80 2023-07-27T14:38:51.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.149+0000 7fe8ee7fc700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe8dc05fb20 0x7fe8dc061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.150+0000 7fe8ee7fc700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe8dc05fb20 0x7fe8dc061fe0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fe8f00ad390 tx=0x7fe8e4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:51.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.153+0000 7fe8d6ffd700 1 -- 172.21.15.115:0/108795630 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe8e004af10 con 0x7fe8d8004b80 2023-07-27T14:38:51.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.323+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe8f00aa4d0 con 0x7fe8d8004b80 2023-07-27T14:38:51.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.324+0000 7fe8d6ffd700 1 -- 172.21.15.115:0/108795630 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v184) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe8f00aa4d0 con 0x7fe8d8004b80 2023-07-27T14:38:51.377 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:51.377 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:38:51.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:51.378 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:38:51.378 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:38:51.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:38:51.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:38:51.378 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:38:51.378 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:38:51.378 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:38:51.378 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:38:51.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.325+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe8dc05fb20 msgr2=0x7fe8dc061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.325+0000 7fe8f57ff700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe8dc05fb20 0x7fe8dc061fe0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fe8f00ad390 tx=0x7fe8e4008040).stop 2023-07-27T14:38:51.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 msgr2=0x7fe8f0153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8f0153460 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7fe8e0007fb0 tx=0x7fe8e0007850).stop 2023-07-27T14:38:51.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 shutdown_connections 2023-07-27T14:38:51.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe8dc05fb20 0x7fe8dc061fe0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8f00c3d10 0x7fe8f0164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d8004b80 0x7fe8f0153460 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 --2- 172.21.15.115:0/108795630 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8f00c1c30 0x7fe8f00c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 >> 172.21.15.115:0/108795630 conn(0x7fe8f00cb610 msgr2=0x7fe8f00afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:51.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 shutdown_connections 2023-07-27T14:38:51.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.326+0000 7fe8f57ff700 1 -- 172.21.15.115:0/108795630 wait complete. 2023-07-27T14:38:51.396 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:38:51.397 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:38:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.537+0000 7f08361ff700 1 Processor -- start 2023-07-27T14:38:51.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.537+0000 7f08361ff700 1 -- start start 2023-07-27T14:38:51.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.538+0000 7f08361ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0830063260 0x7f0830154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.538+0000 7f08361ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f083014b1e0 0x7f08300a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.538+0000 7f08361ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08301553f0 con 0x7f083014ae00 2023-07-27T14:38:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.538+0000 7f08361ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0830157a50 con 0x7f0830063260 2023-07-27T14:38:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.538+0000 7f08361ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0830157d10 con 0x7f083014b1e0 2023-07-27T14:38:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f083014ae00 0x7f0830062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58146/0 (socket says 172.21.15.115:58146) 2023-07-27T14:38:51.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082f7fe700 1 -- 172.21.15.115:0/3062872183 learned_addr learned my addr 172.21.15.115:0/3062872183 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:51.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082effd700 1 --2- 172.21.15.115:0/3062872183 >> v2:172.21.15.159:3300/0 conn(0x7f0830063260 0x7f0830154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082ffff700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f083014b1e0 0x7f08300a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560277163 0 0) 0x7f08301553f0 con 0x7f083014ae00 2023-07-27T14:38:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08180033f0 con 0x7f083014ae00 2023-07-27T14:38:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3684618303 0 0) 0x7f08180033f0 con 0x7f083014ae00 2023-07-27T14:38:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f083014b1e0 msgr2=0x7f08300a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f083014b1e0 0x7f08300a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 >> v2:172.21.15.159:3300/0 conn(0x7f0830063260 msgr2=0x7f0830154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 --2- 172.21.15.115:0/3062872183 >> v2:172.21.15.159:3300/0 conn(0x7f0830063260 0x7f0830154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830157ff0 con 0x7f083014ae00 2023-07-27T14:38:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f0820001470 con 0x7f083014ae00 2023-07-27T14:38:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 >> v1:172.21.15.115:6789/0 conn(0x7f083014ae00 legacy=0x7f0830062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.539+0000 7f082e7fc700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08180038e0 0x7f0818003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082e7fc700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818004690 0x7f0818004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082e7fc700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0818005000 0x7f081800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830157a50 con 0x7f0818005000 2023-07-27T14:38:51.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830157d10 con 0x7f0818004690 2023-07-27T14:38:51.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081800bdd0 con 0x7f08180038e0 2023-07-27T14:38:51.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082effd700 1 --2- 172.21.15.115:0/3062872183 >> v2:172.21.15.159:3300/0 conn(0x7f0830063260 0x7f0830154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:51.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082ffff700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f083014b1e0 0x7f08300a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:51.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082ffff700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0818005000 0x7f081800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082f7fe700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08180038e0 0x7f0818003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082effd700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818004690 0x7f0818004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082ffff700 1 -- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08180038e0 msgr2=0x7f0818003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:51.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082ffff700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f08180038e0 0x7f0818003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082ffff700 1 -- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818004690 msgr2=0x7f0818004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:51.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082ffff700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818004690 0x7f0818004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082ffff700 1 -- 172.21.15.115:0/3062872183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08180033f0 con 0x7f0818005000 2023-07-27T14:38:51.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.540+0000 7f082ffff700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0818005000 0x7f081800b8e0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f082800e280 tx=0x7f082800b040).ready entity=mon.0 client_cookie=a1c9c0e9020d3b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:51.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082800ead0 con 0x7f0818005000 2023-07-27T14:38:51.598 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082800f040 con 0x7f0818005000 2023-07-27T14:38:51.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f082e7fc700 1 -- 172.21.15.115:0/3062872183 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082800ee60 con 0x7f0818005000 2023-07-27T14:38:51.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f08361ff700 1 -- 172.21.15.115:0/3062872183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0818005000 msgr2=0x7f081800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f08361ff700 1 --2- 172.21.15.115:0/3062872183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0818005000 0x7f081800b8e0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f082800e280 tx=0x7f082800b040).stop 2023-07-27T14:38:51.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f082ffff700 1 -- 172.21.15.115:0/3062872183 reap_dead start 2023-07-27T14:38:51.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f08361ff700 1 -- 172.21.15.115:0/3062872183 shutdown_connections 2023-07-27T14:38:51.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f08361ff700 1 -- 172.21.15.115:0/3062872183 >> 172.21.15.115:0/3062872183 conn(0x7f083005e940 msgr2=0x7f08300cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:51.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f08361ff700 1 -- 172.21.15.115:0/3062872183 shutdown_connections 2023-07-27T14:38:51.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.541+0000 7f08361ff700 1 -- 172.21.15.115:0/3062872183 wait complete. 2023-07-27T14:38:51.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.543+0000 7f08361ff700 1 Processor -- start 2023-07-27T14:38:51.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.543+0000 7f08361ff700 1 -- start start 2023-07-27T14:38:51.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f08361ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818005000 0x7f08300c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f08361ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08300c3e00 0x7f08301587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f08361ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0830158ce0 0x7f0830159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f08361ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300c5270 con 0x7f08300c3e00 2023-07-27T14:38:51.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f08361ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830159630 con 0x7f0818005000 2023-07-27T14:38:51.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f08361ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08300c4660 con 0x7f0830158ce0 2023-07-27T14:38:51.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f082effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08300c3e00 0x7f08301587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f082effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08300c3e00 0x7f08301587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35260/0 (socket says 172.21.15.115:35260) 2023-07-27T14:38:51.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f082effd700 1 -- 172.21.15.115:0/2982173012 learned_addr learned my addr 172.21.15.115:0/2982173012 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:51.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f082f7fe700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818005000 0x7f08300c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f082ffff700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0830158ce0 0x7f0830159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f082effd700 1 -- 172.21.15.115:0/2982173012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0830158ce0 msgr2=0x7f0830159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.544+0000 7f082effd700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0830158ce0 0x7f0830159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f082effd700 1 -- 172.21.15.115:0/2982173012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818005000 msgr2=0x7f08300c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:51.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f082effd700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818005000 0x7f08300c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:51.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f082effd700 1 -- 172.21.15.115:0/2982173012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300c4940 con 0x7f08300c3e00 2023-07-27T14:38:51.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f082effd700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08300c3e00 0x7f08301587f0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f0824011a70 tx=0x7f0824009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:51.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f08177fe700 1 -- 172.21.15.115:0/2982173012 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082400f940 con 0x7f08300c3e00 2023-07-27T14:38:51.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f08177fe700 1 -- 172.21.15.115:0/2982173012 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082400faa0 con 0x7f08300c3e00 2023-07-27T14:38:51.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f08177fe700 1 -- 172.21.15.115:0/2982173012 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082400fe20 con 0x7f08300c3e00 2023-07-27T14:38:51.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08300c4c20 con 0x7f08300c3e00 2023-07-27T14:38:51.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.545+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08301370b0 con 0x7f08300c3e00 2023-07-27T14:38:51.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.546+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08300c53e0 con 0x7f08300c3e00 2023-07-27T14:38:51.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.547+0000 7f08177fe700 1 -- 172.21.15.115:0/2982173012 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f0824024070 con 0x7f08300c3e00 2023-07-27T14:38:51.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.548+0000 7f08177fe700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081c05fb50 0x7f081c062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:51.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.548+0000 7f08177fe700 1 -- 172.21.15.115:0/2982173012 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f082407b840 con 0x7f08300c3e00 2023-07-27T14:38:51.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.548+0000 7f082f7fe700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081c05fb50 0x7f081c062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:51.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.548+0000 7f082f7fe700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081c05fb50 0x7f081c062010 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f0820007860 tx=0x7f0820001e90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:51.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.552+0000 7f08177fe700 1 -- 172.21.15.115:0/2982173012 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f082404c3b0 con 0x7f08300c3e00 2023-07-27T14:38:51.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:51.722+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f083006c470 con 0x7f08300c3e00 2023-07-27T14:38:52.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.700+0000 7f08177fe700 1 -- 172.21.15.115:0/2982173012 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v185) v1 ==== 152+0+0 (secure 0 0 0) 0x7f0824018070 con 0x7f08300c3e00 2023-07-27T14:38:52.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.705+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081c05fb50 msgr2=0x7f081c062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:52.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.705+0000 7f08361ff700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081c05fb50 0x7f081c062010 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f0820007860 tx=0x7f0820001e90).stop 2023-07-27T14:38:52.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.705+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08300c3e00 msgr2=0x7f08301587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:52.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.705+0000 7f08361ff700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08300c3e00 0x7f08301587f0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f0824011a70 tx=0x7f0824009060).stop 2023-07-27T14:38:52.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.706+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 shutdown_connections 2023-07-27T14:38:52.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.706+0000 7f08361ff700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f081c05fb50 0x7f081c062010 secure :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0x7f0820007860 tx=0x7f0820001e90).stop 2023-07-27T14:38:52.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.706+0000 7f08361ff700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0830158ce0 0x7f0830159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:52.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.706+0000 7f08361ff700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0818005000 0x7f08300c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:52.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.706+0000 7f08361ff700 1 --2- 172.21.15.115:0/2982173012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08300c3e00 0x7f08301587f0 secure :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0x7f0824011a70 tx=0x7f0824009060).stop 2023-07-27T14:38:52.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.706+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 >> 172.21.15.115:0/2982173012 conn(0x7f083005e940 msgr2=0x7f0830064830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:52.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.710+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 shutdown_connections 2023-07-27T14:38:52.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.710+0000 7f08361ff700 1 -- 172.21.15.115:0/2982173012 wait complete. 2023-07-27T14:38:52.766 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:38:52.785 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:38:52.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.931+0000 7f1d263ff700 1 Processor -- start 2023-07-27T14:38:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.931+0000 7f1d263ff700 1 -- start start 2023-07-27T14:38:52.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.932+0000 7f1d263ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d20153e20 0x7f1d20154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:52.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.933+0000 7f1d263ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d20063ef0 con 0x7f1d20158820 2023-07-27T14:38:52.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.933+0000 7f1d263ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d200641d0 con 0x7f1d20158310 2023-07-27T14:38:52.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.933+0000 7f1d263ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200644b0 con 0x7f1d20153e20 2023-07-27T14:38:52.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.933+0000 7f1d1f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1d20158820 0x7f1d20157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58148/0 (socket says 172.21.15.115:58148) 2023-07-27T14:38:52.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.933+0000 7f1d1f7fe700 1 -- 172.21.15.115:0/655938483 learned_addr learned my addr 172.21.15.115:0/655938483 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.933+0000 7f1d1ffff700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d20153e20 0x7f1d20154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.933+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540040379 0 0) 0x7f1d20063ef0 con 0x7f1d20158820 2023-07-27T14:38:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.933+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d080033f0 con 0x7f1d20158820 2023-07-27T14:38:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804312136 0 0) 0x7f1d080033f0 con 0x7f1d20158820 2023-07-27T14:38:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d20153e20 msgr2=0x7f1d20154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d20153e20 0x7f1d20154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 >> v1:172.21.15.159:6789/0 conn(0x7f1d20158310 legacy=0x7f1d200bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:52.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20064790 con 0x7f1d20158820 2023-07-27T14:38:52.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1d14001470 con 0x7f1d20158820 2023-07-27T14:38:52.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 >> v1:172.21.15.115:6789/0 conn(0x7f1d20158820 legacy=0x7f1d20157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:52.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d08003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:52.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d08004690 0x7f1d08004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:52.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d20153e20 0x7f1d08005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:52.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200644b0 con 0x7f1d08003910 2023-07-27T14:38:52.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0800b910 con 0x7f1d08004690 2023-07-27T14:38:52.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0800bad0 con 0x7f1d20153e20 2023-07-27T14:38:52.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1ffff700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d08003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:52.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1f7fe700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d08004690 0x7f1d08004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:52.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d2499c700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d20153e20 0x7f1d08005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1ffff700 1 -- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d20153e20 msgr2=0x7f1d08005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.934+0000 7f1d1ffff700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d20153e20 0x7f1d08005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d1ffff700 1 -- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d08004690 msgr2=0x7f1d08004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d1ffff700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d08004690 0x7f1d08004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d1ffff700 1 -- 172.21.15.115:0/655938483 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080033f0 con 0x7f1d08003910 2023-07-27T14:38:52.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d1ffff700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d08003d30 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f1d10009a80 tx=0x7f1d10009060).ready entity=mon.0 client_cookie=9c930e6302e13dc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10009430 con 0x7f1d08003910 2023-07-27T14:38:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000e640 con 0x7f1d08003910 2023-07-27T14:38:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d1effd700 1 -- 172.21.15.115:0/655938483 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000e9c0 con 0x7f1d08003910 2023-07-27T14:38:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d263ff700 1 -- 172.21.15.115:0/655938483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 msgr2=0x7f1d08003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d263ff700 1 --2- 172.21.15.115:0/655938483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d08003d30 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f1d10009a80 tx=0x7f1d10009060).stop 2023-07-27T14:38:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.935+0000 7f1d2499c700 1 -- 172.21.15.115:0/655938483 reap_dead start 2023-07-27T14:38:52.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.936+0000 7f1d263ff700 1 -- 172.21.15.115:0/655938483 shutdown_connections 2023-07-27T14:38:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.936+0000 7f1d263ff700 1 -- 172.21.15.115:0/655938483 >> 172.21.15.115:0/655938483 conn(0x7f1d200920a0 msgr2=0x7f1d2005e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.936+0000 7f1d263ff700 1 -- 172.21.15.115:0/655938483 shutdown_connections 2023-07-27T14:38:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.936+0000 7f1d263ff700 1 -- 172.21.15.115:0/655938483 wait complete. 2023-07-27T14:38:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.938+0000 7f1d263ff700 1 Processor -- start 2023-07-27T14:38:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.938+0000 7f1d263ff700 1 -- start start 2023-07-27T14:38:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d263ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d201560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:52.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d263ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2014e7a0 0x7f1d20067190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d263ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d2014ec20 0x7f1d20067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d263ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d20067b70 con 0x7f1d08003910 2023-07-27T14:38:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d263ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200adbb0 con 0x7f1d2014e7a0 2023-07-27T14:38:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d263ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d201565c0 con 0x7f1d2014ec20 2023-07-27T14:38:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d201560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d201560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35290/0 (socket says 172.21.15.115:35290) 2023-07-27T14:38:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.939+0000 7f1d1ffff700 1 -- 172.21.15.115:0/448527340 learned_addr learned my addr 172.21.15.115:0/448527340 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:52.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d1f7fe700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2014e7a0 0x7f1d20067190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d2499c700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d2014ec20 0x7f1d20067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d1ffff700 1 -- 172.21.15.115:0/448527340 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d2014ec20 msgr2=0x7f1d20067680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d1ffff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d2014ec20 0x7f1d20067680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d1ffff700 1 -- 172.21.15.115:0/448527340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2014e7a0 msgr2=0x7f1d20067190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d1ffff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2014e7a0 0x7f1d20067190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d1ffff700 1 -- 172.21.15.115:0/448527340 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200acfa0 con 0x7f1d08003910 2023-07-27T14:38:52.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d1ffff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d201560d0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f1d0800b8e0 tx=0x7f1d1001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d07fff700 1 -- 172.21.15.115:0/448527340 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10000cb0 con 0x7f1d08003910 2023-07-27T14:38:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d07fff700 1 -- 172.21.15.115:0/448527340 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000e7b0 con 0x7f1d08003910 2023-07-27T14:38:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d07fff700 1 -- 172.21.15.115:0/448527340 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1001b6a0 con 0x7f1d08003910 2023-07-27T14:38:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.940+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d200ad280 con 0x7f1d08003910 2023-07-27T14:38:52.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.941+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d200ad840 con 0x7f1d08003910 2023-07-27T14:38:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.941+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2006c470 con 0x7f1d08003910 2023-07-27T14:38:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.943+0000 7f1d07fff700 1 -- 172.21.15.115:0/448527340 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f1d1001ba50 con 0x7f1d08003910 2023-07-27T14:38:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.943+0000 7f1d07fff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d0c05fb50 0x7f1d0c062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:53.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.943+0000 7f1d07fff700 1 -- 172.21.15.115:0/448527340 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f1d1007cdf0 con 0x7f1d08003910 2023-07-27T14:38:53.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.944+0000 7f1d1f7fe700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d0c05fb50 0x7f1d0c062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:53.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.944+0000 7f1d1f7fe700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d0c05fb50 0x7f1d0c062010 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f1d14001120 tx=0x7f1d14009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:53.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:52.947+0000 7f1d07fff700 1 -- 172.21.15.115:0/448527340 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d10051150 con 0x7f1d08003910 2023-07-27T14:38:53.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.117+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1d20064a70 con 0x7f1d08003910 2023-07-27T14:38:53.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.705+0000 7f1d07fff700 1 -- 172.21.15.115:0/448527340 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v186) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1d1002b070 con 0x7f1d08003910 2023-07-27T14:38:53.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.715+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d0c05fb50 msgr2=0x7f1d0c062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:53.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.715+0000 7f1d263ff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d0c05fb50 0x7f1d0c062010 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f1d14001120 tx=0x7f1d14009040).stop 2023-07-27T14:38:53.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.715+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 msgr2=0x7f1d201560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:53.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.715+0000 7f1d263ff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d201560d0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f1d0800b8e0 tx=0x7f1d1001a000).stop 2023-07-27T14:38:53.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.722+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 shutdown_connections 2023-07-27T14:38:53.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.722+0000 7f1d263ff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1d0c05fb50 0x7f1d0c062010 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:53.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.722+0000 7f1d263ff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d2014ec20 0x7f1d20067680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:53.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.722+0000 7f1d263ff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d08003910 0x7f1d201560d0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:53.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.722+0000 7f1d263ff700 1 --2- 172.21.15.115:0/448527340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d2014e7a0 0x7f1d20067190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:53.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.722+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 >> 172.21.15.115:0/448527340 conn(0x7f1d200920a0 msgr2=0x7f1d200a6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:53.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.724+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 shutdown_connections 2023-07-27T14:38:53.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.725+0000 7f1d263ff700 1 -- 172.21.15.115:0/448527340 wait complete. 2023-07-27T14:38:53.783 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:38:53.803 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:38:53.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.941+0000 7f5fe4fff700 1 Processor -- start 2023-07-27T14:38:53.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.941+0000 7f5fe4fff700 1 -- start start 2023-07-27T14:38:53.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fe4fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5fe014ae00 0x7f5fe0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:53.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fe4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:53.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fe4fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe01553f0 con 0x7f5fe014b1e0 2023-07-27T14:38:53.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fe4fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe0157a50 con 0x7f5fe014ae00 2023-07-27T14:38:53.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fe4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0157d10 con 0x7f5fe0063260 2023-07-27T14:38:53.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fded9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:53.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fde59c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5fe014ae00 0x7f5fe0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:53.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fded9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:49588/0 (socket says 172.21.15.115:49588) 2023-07-27T14:38:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.943+0000 7f5fded9d700 1 -- 172.21.15.115:0/1174613407 learned_addr learned my addr 172.21.15.115:0/1174613407 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.944+0000 7f5fde59c700 1 -- 172.21.15.115:0/1174613407 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 msgr2=0x7f5fe00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.944+0000 7f5fde59c700 1 --2- 172.21.15.115:0/1174613407 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.944+0000 7f5fde59c700 1 -- 172.21.15.115:0/1174613407 >> v1:172.21.15.159:6789/0 conn(0x7f5fe014b1e0 legacy=0x7f5fe0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.944+0000 7f5fde59c700 1 -- 172.21.15.115:0/1174613407 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0157ff0 con 0x7f5fe014ae00 2023-07-27T14:38:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.944+0000 7f5fde59c700 1 --2- 172.21.15.115:0/1174613407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014ae00 0x7f5fe0154f00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f5fd0009760 tx=0x7f5fd0009060).ready entity=mon.1 client_cookie=a41fcd7237556e7e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.944+0000 7f5fdd59a700 1 -- 172.21.15.115:0/1174613407 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000f510 con 0x7f5fe014ae00 2023-07-27T14:38:54.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.944+0000 7f5fdd59a700 1 -- 172.21.15.115:0/1174613407 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd000f670 con 0x7f5fe014ae00 2023-07-27T14:38:54.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.944+0000 7f5fdd59a700 1 -- 172.21.15.115:0/1174613407 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000f9f0 con 0x7f5fe014ae00 2023-07-27T14:38:54.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.945+0000 7f5fe4fff700 1 -- 172.21.15.115:0/1174613407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014ae00 msgr2=0x7f5fe0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.945+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/1174613407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014ae00 0x7f5fe0154f00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f5fd0009760 tx=0x7f5fd0009060).stop 2023-07-27T14:38:54.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.945+0000 7f5fe4fff700 1 -- 172.21.15.115:0/1174613407 shutdown_connections 2023-07-27T14:38:54.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.945+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/1174613407 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.945+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/1174613407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014ae00 0x7f5fe0154f00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.945+0000 7f5fe4fff700 1 -- 172.21.15.115:0/1174613407 >> 172.21.15.115:0/1174613407 conn(0x7f5fe005e940 msgr2=0x7f5fe00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:54.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.945+0000 7f5fe4fff700 1 -- 172.21.15.115:0/1174613407 shutdown_connections 2023-07-27T14:38:54.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.945+0000 7f5fe4fff700 1 -- 172.21.15.115:0/1174613407 wait complete. 2023-07-27T14:38:54.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.946+0000 7f5fe4fff700 1 Processor -- start 2023-07-27T14:38:54.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.947+0000 7f5fe4fff700 1 -- start start 2023-07-27T14:38:54.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.947+0000 7f5fe4fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.947+0000 7f5fe4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe014ae00 0x7f5fe00c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.947+0000 7f5fe4fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014b1e0 0x7f5fe00c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.947+0000 7f5fe4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00aecc0 con 0x7f5fe014ae00 2023-07-27T14:38:54.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.947+0000 7f5fe4fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c2720 con 0x7f5fe014b1e0 2023-07-27T14:38:54.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.947+0000 7f5fe4fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c2bb0 con 0x7f5fe0063260 2023-07-27T14:38:54.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe014ae00 0x7f5fe00c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fde59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe014ae00 0x7f5fe00c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35688/0 (socket says 172.21.15.115:35688) 2023-07-27T14:38:54.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fde59c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:49590/0 (socket says 172.21.15.115:49590) 2023-07-27T14:38:54.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 -- 172.21.15.115:0/3353517869 learned_addr learned my addr 172.21.15.115:0/3353517869 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:54.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fded9d700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014b1e0 0x7f5fe00c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 -- 172.21.15.115:0/3353517869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 msgr2=0x7f5fe00ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 -- 172.21.15.115:0/3353517869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014b1e0 msgr2=0x7f5fe00c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014b1e0 0x7f5fe00c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 -- 172.21.15.115:0/3353517869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00092a0 con 0x7f5fe014ae00 2023-07-27T14:38:54.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.948+0000 7f5fddd9b700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe014ae00 0x7f5fe00c4450 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f5fd400c4c0 tx=0x7f5fd4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:54.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.949+0000 7f5fce7fc700 1 -- 172.21.15.115:0/3353517869 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400ce10 con 0x7f5fe014ae00 2023-07-27T14:38:54.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.949+0000 7f5fce7fc700 1 -- 172.21.15.115:0/3353517869 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd4007020 con 0x7f5fe014ae00 2023-07-27T14:38:54.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.949+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00c1df0 con 0x7f5fe014ae00 2023-07-27T14:38:54.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.949+0000 7f5fce7fc700 1 -- 172.21.15.115:0/3353517869 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40073c0 con 0x7f5fe014ae00 2023-07-27T14:38:54.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.949+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe00c23b0 con 0x7f5fe014ae00 2023-07-27T14:38:54.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.950+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe00c28b0 con 0x7f5fe014ae00 2023-07-27T14:38:54.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.951+0000 7f5fce7fc700 1 -- 172.21.15.115:0/3353517869 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f5fd4010070 con 0x7f5fe014ae00 2023-07-27T14:38:54.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.952+0000 7f5fce7fc700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc005fb50 0x7f5fc0062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.952+0000 7f5fce7fc700 1 -- 172.21.15.115:0/3353517869 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f5fd407a2f0 con 0x7f5fe014ae00 2023-07-27T14:38:54.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.952+0000 7f5fde59c700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc005fb50 0x7f5fc0062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.953+0000 7f5fde59c700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc005fb50 0x7f5fc0062010 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f5fd0009fd0 tx=0x7f5fd0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:54.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:53.956+0000 7f5fce7fc700 1 -- 172.21.15.115:0/3353517869 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fd40478f0 con 0x7f5fe014ae00 2023-07-27T14:38:54.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.163+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5fe006c470 con 0x7f5fe014ae00 2023-07-27T14:38:54.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.169+0000 7f5fce7fc700 1 -- 172.21.15.115:0/3353517869 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v98) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5fd404e4e0 con 0x7f5fe014ae00 2023-07-27T14:38:54.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.177+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc005fb50 msgr2=0x7f5fc0062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.177+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc005fb50 0x7f5fc0062010 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f5fd0009fd0 tx=0x7f5fd0017000).stop 2023-07-27T14:38:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.177+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe014ae00 msgr2=0x7f5fe00c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.177+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe014ae00 0x7f5fe00c4450 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f5fd400c4c0 tx=0x7f5fd4007dd0).stop 2023-07-27T14:38:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.178+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 shutdown_connections 2023-07-27T14:38:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.178+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5fc005fb50 0x7f5fc0062010 secure :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0x7f5fd0009fd0 tx=0x7f5fd0017000).stop 2023-07-27T14:38:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.178+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe014b1e0 0x7f5fe00c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.178+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5fe0063260 0x7f5fe00ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.178+0000 7f5fe4fff700 1 --2- 172.21.15.115:0/3353517869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fe014ae00 0x7f5fe00c4450 secure :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0x7f5fd400c4c0 tx=0x7f5fd4007dd0).stop 2023-07-27T14:38:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.178+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 >> 172.21.15.115:0/3353517869 conn(0x7f5fe005e940 msgr2=0x7f5fe00c10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.184+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 shutdown_connections 2023-07-27T14:38:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.184+0000 7f5fe4fff700 1 -- 172.21.15.115:0/3353517869 wait complete. 2023-07-27T14:38:54.248 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 25 and data pool 26 2023-07-27T14:38:54.266 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:38:54.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.401+0000 7f9d589ff700 1 Processor -- start 2023-07-27T14:38:54.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.401+0000 7f9d589ff700 1 -- start start 2023-07-27T14:38:54.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.402+0000 7f9d589ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d540c0e80 0x7f9d54150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.402+0000 7f9d589ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d54068380 con 0x7f9d54150320 2023-07-27T14:38:54.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.402+0000 7f9d589ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d54068ee0 con 0x7f9d540c1f70 2023-07-27T14:38:54.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.402+0000 7f9d589ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d54065790 con 0x7f9d540c0e80 2023-07-27T14:38:54.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d5259c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9d54150320 0x7f9d540c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47358/0 (socket says 172.21.15.115:47358) 2023-07-27T14:38:54.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d5259c700 1 -- 172.21.15.115:0/2903632538 learned_addr learned my addr 172.21.15.115:0/2903632538 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:54.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d52d9d700 1 --2- 172.21.15.115:0/2903632538 >> v2:172.21.15.115:3300/0 conn(0x7f9d540c0e80 0x7f9d54150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d5159a700 1 -- 172.21.15.115:0/2903632538 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340754364 0 0) 0x7f9d54068380 con 0x7f9d54150320 2023-07-27T14:38:54.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d5159a700 1 -- 172.21.15.115:0/2903632538 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d3c0033f0 con 0x7f9d54150320 2023-07-27T14:38:54.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d52d9d700 1 -- 172.21.15.115:0/2903632538 >> v1:172.21.15.159:6789/0 conn(0x7f9d540c1f70 legacy=0x7f9d540bb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d52d9d700 1 -- 172.21.15.115:0/2903632538 >> v1:172.21.15.115:6789/0 conn(0x7f9d54150320 legacy=0x7f9d540c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d52d9d700 1 -- 172.21.15.115:0/2903632538 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540685b0 con 0x7f9d540c0e80 2023-07-27T14:38:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.403+0000 7f9d52d9d700 1 --2- 172.21.15.115:0/2903632538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d540c0e80 0x7f9d54150700 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7f9d4c00af70 tx=0x7f9d4c00a890).ready entity=mon.0 client_cookie=161fdb45326a4af0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d5159a700 1 -- 172.21.15.115:0/2903632538 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00f070 con 0x7f9d540c0e80 2023-07-27T14:38:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d5159a700 1 -- 172.21.15.115:0/2903632538 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c00a2e0 con 0x7f9d540c0e80 2023-07-27T14:38:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d5159a700 1 -- 172.21.15.115:0/2903632538 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00cc30 con 0x7f9d540c0e80 2023-07-27T14:38:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d589ff700 1 -- 172.21.15.115:0/2903632538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d540c0e80 msgr2=0x7f9d54150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d589ff700 1 --2- 172.21.15.115:0/2903632538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d540c0e80 0x7f9d54150700 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7f9d4c00af70 tx=0x7f9d4c00a890).stop 2023-07-27T14:38:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d589ff700 1 -- 172.21.15.115:0/2903632538 shutdown_connections 2023-07-27T14:38:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d589ff700 1 --2- 172.21.15.115:0/2903632538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d540c0e80 0x7f9d54150700 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d589ff700 1 -- 172.21.15.115:0/2903632538 >> 172.21.15.115:0/2903632538 conn(0x7f9d54062320 msgr2=0x7f9d54062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d589ff700 1 -- 172.21.15.115:0/2903632538 shutdown_connections 2023-07-27T14:38:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.404+0000 7f9d589ff700 1 -- 172.21.15.115:0/2903632538 wait complete. 2023-07-27T14:38:54.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.406+0000 7f9d589ff700 1 Processor -- start 2023-07-27T14:38:54.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.406+0000 7f9d589ff700 1 -- start start 2023-07-27T14:38:54.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d589ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d540c0e80 0x7f9d54161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d589ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d540c1f70 0x7f9d540c0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d589ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d54150320 0x7f9d5414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d589ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54150cc0 con 0x7f9d54150320 2023-07-27T14:38:54.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d589ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54162560 con 0x7f9d540c1f70 2023-07-27T14:38:54.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d589ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54162840 con 0x7f9d540c0e80 2023-07-27T14:38:54.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d52d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d54150320 0x7f9d5414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d52d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d54150320 0x7f9d5414f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35712/0 (socket says 172.21.15.115:35712) 2023-07-27T14:38:54.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d52d9d700 1 -- 172.21.15.115:0/2361831548 learned_addr learned my addr 172.21.15.115:0/2361831548 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:54.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d51d9b700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d540c1f70 0x7f9d540c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.407+0000 7f9d5259c700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d540c0e80 0x7f9d54161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d52d9d700 1 -- 172.21.15.115:0/2361831548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d540c0e80 msgr2=0x7f9d54161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d52d9d700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d540c0e80 0x7f9d54161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d52d9d700 1 -- 172.21.15.115:0/2361831548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d540c1f70 msgr2=0x7f9d540c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d52d9d700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d540c1f70 0x7f9d540c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d52d9d700 1 -- 172.21.15.115:0/2361831548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c00ab30 con 0x7f9d54150320 2023-07-27T14:38:54.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d52d9d700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d54150320 0x7f9d5414f610 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f9d4c00a5e0 tx=0x7f9d54068e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:54.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d427fc700 1 -- 172.21.15.115:0/2361831548 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c009e80 con 0x7f9d54150320 2023-07-27T14:38:54.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d427fc700 1 -- 172.21.15.115:0/2361831548 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c014420 con 0x7f9d54150320 2023-07-27T14:38:54.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d54162b20 con 0x7f9d54150320 2023-07-27T14:38:54.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d427fc700 1 -- 172.21.15.115:0/2361831548 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0147a0 con 0x7f9d54150320 2023-07-27T14:38:54.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.408+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d540c06f0 con 0x7f9d54150320 2023-07-27T14:38:54.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.409+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d54150e30 con 0x7f9d54150320 2023-07-27T14:38:54.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.410+0000 7f9d427fc700 1 -- 172.21.15.115:0/2361831548 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f9d4c014bd0 con 0x7f9d54150320 2023-07-27T14:38:54.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.411+0000 7f9d427fc700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9d3405fb50 0x7f9d34062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.411+0000 7f9d427fc700 1 -- 172.21.15.115:0/2361831548 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9d4c07d050 con 0x7f9d54150320 2023-07-27T14:38:54.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.411+0000 7f9d5259c700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9d3405fb50 0x7f9d34062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.412+0000 7f9d5259c700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9d3405fb50 0x7f9d34062010 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f9d44007fd0 tx=0x7f9d44009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:54.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.415+0000 7f9d427fc700 1 -- 172.21.15.115:0/2361831548 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9d4c04d830 con 0x7f9d54150320 2023-07-27T14:38:54.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.583+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d540c3060 con 0x7f9d54150320 2023-07-27T14:38:54.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.584+0000 7f9d427fc700 1 -- 172.21.15.115:0/2361831548 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+17099 (secure 0 0 0) 0x7f9d4c014e60 con 0x7f9d54150320 2023-07-27T14:38:54.638 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:54.638 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":187,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:38:54.164858+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:38:51.766720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-27T14:38:53.161829+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:38:54.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.586+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9d3405fb50 msgr2=0x7f9d34062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.586+0000 7f9d589ff700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9d3405fb50 0x7f9d34062010 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f9d44007fd0 tx=0x7f9d44009040).stop 2023-07-27T14:38:54.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.586+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d54150320 msgr2=0x7f9d5414f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.586+0000 7f9d589ff700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d54150320 0x7f9d5414f610 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f9d4c00a5e0 tx=0x7f9d54068e50).stop 2023-07-27T14:38:54.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.586+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 shutdown_connections 2023-07-27T14:38:54.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.587+0000 7f9d589ff700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9d3405fb50 0x7f9d34062010 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.587+0000 7f9d589ff700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d54150320 0x7f9d5414f610 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.587+0000 7f9d589ff700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9d540c0e80 0x7f9d54161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.587+0000 7f9d589ff700 1 --2- 172.21.15.115:0/2361831548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d540c1f70 0x7f9d540c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.587+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 >> 172.21.15.115:0/2361831548 conn(0x7f9d54062320 msgr2=0x7f9d54063df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:54.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.587+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 shutdown_connections 2023-07-27T14:38:54.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.587+0000 7f9d589ff700 1 -- 172.21.15.115:0/2361831548 wait complete. 2023-07-27T14:38:54.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:38:54.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.793+0000 7f5be8bff700 1 Processor -- start 2023-07-27T14:38:54.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.793+0000 7f5be8bff700 1 -- start start 2023-07-27T14:38:54.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.794+0000 7f5be8bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 0x7f5be40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.794+0000 7f5be8bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5be40aa050 0x7f5be40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.794+0000 7f5be8bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40aa4d0 con 0x7f5be40aaa40 2023-07-27T14:38:54.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.794+0000 7f5be8bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40c05c0 con 0x7f5be40aa050 2023-07-27T14:38:54.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.794+0000 7f5be8bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c1a60 con 0x7f5be4153ec0 2023-07-27T14:38:54.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.794+0000 7f5be1d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5be40aa050 0x7f5be40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.794+0000 7f5be2d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5be40aaa40 0x7f5be4157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47362/0 (socket says 172.21.15.115:47362) 2023-07-27T14:38:54.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.794+0000 7f5be2d9d700 1 -- 172.21.15.115:0/3390997119 learned_addr learned my addr 172.21.15.115:0/3390997119 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:54.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be259c700 1 --2- 172.21.15.115:0/3390997119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 0x7f5be40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be159a700 1 -- 172.21.15.115:0/3390997119 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826544052 0 0) 0x7f5bdc001490 con 0x7f5be40aaa40 2023-07-27T14:38:54.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be159a700 1 -- 172.21.15.115:0/3390997119 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bcc0033f0 con 0x7f5be40aaa40 2023-07-27T14:38:54.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be1d9b700 1 -- 172.21.15.115:0/3390997119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 msgr2=0x7f5be40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:54.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be1d9b700 1 --2- 172.21.15.115:0/3390997119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 0x7f5be40a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be1d9b700 1 -- 172.21.15.115:0/3390997119 >> v1:172.21.15.115:6789/0 conn(0x7f5be40aaa40 legacy=0x7f5be4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be1d9b700 1 -- 172.21.15.115:0/3390997119 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40bfc90 con 0x7f5be40aa050 2023-07-27T14:38:54.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be1d9b700 1 --2- 172.21.15.115:0/3390997119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aa050 0x7f5be40640f0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7f5bd8009760 tx=0x7f5bd8009060).ready entity=mon.0 client_cookie=118ac234137d12ad server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:54.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be159a700 1 -- 172.21.15.115:0/3390997119 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800d4a0 con 0x7f5be40aa050 2023-07-27T14:38:54.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be159a700 1 -- 172.21.15.115:0/3390997119 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800d600 con 0x7f5be40aa050 2023-07-27T14:38:54.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.795+0000 7f5be159a700 1 -- 172.21.15.115:0/3390997119 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800d980 con 0x7f5be40aa050 2023-07-27T14:38:54.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.796+0000 7f5be8bff700 1 -- 172.21.15.115:0/3390997119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aa050 msgr2=0x7f5be40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.796+0000 7f5be8bff700 1 --2- 172.21.15.115:0/3390997119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aa050 0x7f5be40640f0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7f5bd8009760 tx=0x7f5bd8009060).stop 2023-07-27T14:38:54.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.796+0000 7f5be8bff700 1 -- 172.21.15.115:0/3390997119 shutdown_connections 2023-07-27T14:38:54.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.796+0000 7f5be8bff700 1 --2- 172.21.15.115:0/3390997119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 0x7f5be40a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.796+0000 7f5be8bff700 1 --2- 172.21.15.115:0/3390997119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aa050 0x7f5be40640f0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:54.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.796+0000 7f5be8bff700 1 -- 172.21.15.115:0/3390997119 >> 172.21.15.115:0/3390997119 conn(0x7f5be40cb610 msgr2=0x7f5be40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:54.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.796+0000 7f5be8bff700 1 -- 172.21.15.115:0/3390997119 shutdown_connections 2023-07-27T14:38:54.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.796+0000 7f5be8bff700 1 -- 172.21.15.115:0/3390997119 wait complete. 2023-07-27T14:38:54.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.797+0000 7f5be8bff700 1 Processor -- start 2023-07-27T14:38:54.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.798+0000 7f5be8bff700 1 -- start start 2023-07-27T14:38:54.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.798+0000 7f5be8bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be40aa050 0x7f5be40c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.798+0000 7f5be8bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aaa40 0x7f5be40c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be8bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 0x7f5be40c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be8bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4164450 con 0x7f5be40aaa40 2023-07-27T14:38:54.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be8bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4150450 con 0x7f5be40aa050 2023-07-27T14:38:54.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be8bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41506f0 con 0x7f5be4153ec0 2023-07-27T14:38:54.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aaa40 0x7f5be40c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aaa40 0x7f5be40c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35738/0 (socket says 172.21.15.115:35738) 2023-07-27T14:38:54.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 -- 172.21.15.115:0/1234243206 learned_addr learned my addr 172.21.15.115:0/1234243206 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:54.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 -- 172.21.15.115:0/1234243206 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 msgr2=0x7f5be40c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 0x7f5be40c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:54.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 -- 172.21.15.115:0/1234243206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be40aa050 msgr2=0x7f5be40c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:54.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be40aa050 0x7f5be40c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:54.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 -- 172.21.15.115:0/1234243206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80092a0 con 0x7f5be40aaa40 2023-07-27T14:38:54.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.799+0000 7f5be1d9b700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aaa40 0x7f5be40c43a0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f5be405fc60 tx=0x7f5bd8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:54.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.800+0000 7f5bd27fc700 1 -- 172.21.15.115:0/1234243206 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8000c90 con 0x7f5be40aaa40 2023-07-27T14:38:54.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.800+0000 7f5bd27fc700 1 -- 172.21.15.115:0/1234243206 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800d770 con 0x7f5be40aaa40 2023-07-27T14:38:54.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.800+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be41509d0 con 0x7f5be40aaa40 2023-07-27T14:38:54.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.800+0000 7f5bd27fc700 1 -- 172.21.15.115:0/1234243206 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd801d640 con 0x7f5be40aaa40 2023-07-27T14:38:54.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.800+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be4150f90 con 0x7f5be40aaa40 2023-07-27T14:38:54.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.801+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be406c470 con 0x7f5be40aaa40 2023-07-27T14:38:54.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.802+0000 7f5bd27fc700 1 -- 172.21.15.115:0/1234243206 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f5bd800f070 con 0x7f5be40aaa40 2023-07-27T14:38:54.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.802+0000 7f5bd27fc700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bc405fb20 0x7f5bc4061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:54.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.802+0000 7f5bd27fc700 1 -- 172.21.15.115:0/1234243206 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5bd807c6b0 con 0x7f5be40aaa40 2023-07-27T14:38:54.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.803+0000 7f5be259c700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bc405fb20 0x7f5bc4061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:54.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.803+0000 7f5be259c700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bc405fb20 0x7f5bc4061fe0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f5bd4009990 tx=0x7f5bd4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:54.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.807+0000 7f5bd27fc700 1 -- 172.21.15.115:0/1234243206 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5bd804ce90 con 0x7f5be40aaa40 2023-07-27T14:38:55.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.976+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5be40c8230 con 0x7f5be40aaa40 2023-07-27T14:38:55.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.977+0000 7f5bd27fc700 1 -- 172.21.15.115:0/1234243206 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+17099 (secure 0 0 0) 0x7f5bd80504b0 con 0x7f5be40aaa40 2023-07-27T14:38:55.031 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:55.031 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":187,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:38:54.164858+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:38:51.766720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-27T14:38:53.161829+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:38:55.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bc405fb20 msgr2=0x7f5bc4061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bc405fb20 0x7f5bc4061fe0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f5bd4009990 tx=0x7f5bd4009060).stop 2023-07-27T14:38:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aaa40 msgr2=0x7f5be40c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aaa40 0x7f5be40c43a0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7f5be405fc60 tx=0x7f5bd8016000).stop 2023-07-27T14:38:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 shutdown_connections 2023-07-27T14:38:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5bc405fb20 0x7f5bc4061fe0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5be4153ec0 0x7f5be40c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5be40aa050 0x7f5be40c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 --2- 172.21.15.115:0/1234243206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5be40aaa40 0x7f5be40c43a0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:55.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 >> 172.21.15.115:0/1234243206 conn(0x7f5be40cb610 msgr2=0x7f5be40afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:55.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 shutdown_connections 2023-07-27T14:38:55.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:54.979+0000 7f5be8bff700 1 -- 172.21.15.115:0/1234243206 wait complete. 2023-07-27T14:38:55.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:38:55.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.191+0000 7f02055ff700 1 Processor -- start 2023-07-27T14:38:55.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.191+0000 7f02055ff700 1 -- start start 2023-07-27T14:38:55.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.192+0000 7f02055ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f02000a5f60 0x7f020014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:55.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.192+0000 7f02055ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02000c31e0 0x7f02000c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:55.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.192+0000 7f02055ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02001530d0 con 0x7f020014f740 2023-07-27T14:38:55.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.192+0000 7f02055ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0200069f70 con 0x7f02000a5f60 2023-07-27T14:38:55.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.192+0000 7f02055ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02000c3b80 con 0x7f02000c31e0 2023-07-27T14:38:55.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.192+0000 7f01fe7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f02000a5f60 0x7f020014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:55.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fe7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f02000a5f60 0x7f020014fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35754/0 (socket says 172.21.15.115:35754) 2023-07-27T14:38:55.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fe7fc700 1 -- 172.21.15.115:0/854089049 learned_addr learned my addr 172.21.15.115:0/854089049 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:55.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01ff7fe700 1 --2- 172.21.15.115:0/854089049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02000c31e0 0x7f02000c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:55.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fe7fc700 1 -- 172.21.15.115:0/854089049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02000c31e0 msgr2=0x7f02000c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:55.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fe7fc700 1 --2- 172.21.15.115:0/854089049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02000c31e0 0x7f02000c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:55.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fe7fc700 1 -- 172.21.15.115:0/854089049 >> v1:172.21.15.159:6789/0 conn(0x7f020014f740 legacy=0x7f02000a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:55.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fe7fc700 1 -- 172.21.15.115:0/854089049 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02001527a0 con 0x7f02000a5f60 2023-07-27T14:38:55.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01ff7fe700 1 --2- 172.21.15.115:0/854089049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02000c31e0 0x7f02000c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:55.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fe7fc700 1 --2- 172.21.15.115:0/854089049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f020014fb20 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f01f4006fd0 tx=0x7f01f40090f0).ready entity=mon.0 client_cookie=38b0404813d82a42 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:55.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fdffb700 1 -- 172.21.15.115:0/854089049 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f400b600 con 0x7f02000a5f60 2023-07-27T14:38:55.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fdffb700 1 -- 172.21.15.115:0/854089049 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f400b760 con 0x7f02000a5f60 2023-07-27T14:38:55.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.193+0000 7f01fdffb700 1 -- 172.21.15.115:0/854089049 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f400bb00 con 0x7f02000a5f60 2023-07-27T14:38:55.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.194+0000 7f02055ff700 1 -- 172.21.15.115:0/854089049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 msgr2=0x7f020014fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:55.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.194+0000 7f02055ff700 1 --2- 172.21.15.115:0/854089049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f020014fb20 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7f01f4006fd0 tx=0x7f01f40090f0).stop 2023-07-27T14:38:55.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.194+0000 7f02055ff700 1 -- 172.21.15.115:0/854089049 shutdown_connections 2023-07-27T14:38:55.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.194+0000 7f02055ff700 1 --2- 172.21.15.115:0/854089049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02000c31e0 0x7f02000c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:55.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.194+0000 7f02055ff700 1 --2- 172.21.15.115:0/854089049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f020014fb20 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:55.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.194+0000 7f02055ff700 1 -- 172.21.15.115:0/854089049 >> 172.21.15.115:0/854089049 conn(0x7f0200062320 msgr2=0x7f0200062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:55.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.194+0000 7f02055ff700 1 -- 172.21.15.115:0/854089049 shutdown_connections 2023-07-27T14:38:55.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.194+0000 7f02055ff700 1 -- 172.21.15.115:0/854089049 wait complete. 2023-07-27T14:38:55.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.196+0000 7f02055ff700 1 Processor -- start 2023-07-27T14:38:55.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.196+0000 7f02055ff700 1 -- start start 2023-07-27T14:38:55.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.197+0000 7f02055ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f0200162b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:55.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.197+0000 7f02055ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02000c31e0 0x7f0200142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:55.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f02055ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f020014f740 0x7f0200063da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:55.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f02055ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0200163050 con 0x7f02000a5f60 2023-07-27T14:38:55.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f02055ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0200165ae0 con 0x7f02000c31e0 2023-07-27T14:38:55.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f02055ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0200165dc0 con 0x7f020014f740 2023-07-27T14:38:55.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f0200162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:55.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f0200162b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35770/0 (socket says 172.21.15.115:35770) 2023-07-27T14:38:55.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 -- 172.21.15.115:0/542124993 learned_addr learned my addr 172.21.15.115:0/542124993 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:55.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01ff7fe700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f020014f740 0x7f0200063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:55.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01fe7fc700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02000c31e0 0x7f0200142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:55.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 -- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f020014f740 msgr2=0x7f0200063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:55.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f020014f740 0x7f0200063da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:55.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 -- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02000c31e0 msgr2=0x7f0200142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:55.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02000c31e0 0x7f0200142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:55.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 -- 172.21.15.115:0/542124993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f4009370 con 0x7f02000a5f60 2023-07-27T14:38:55.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01ff7fe700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f020014f740 0x7f0200063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:55.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.198+0000 7f01feffd700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f0200162b60 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7f01f000c4c0 tx=0x7f01f0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:55.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.199+0000 7f01e6ffd700 1 -- 172.21.15.115:0/542124993 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0007020 con 0x7f02000a5f60 2023-07-27T14:38:55.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.199+0000 7f01e6ffd700 1 -- 172.21.15.115:0/542124993 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0001e90 con 0x7f02000a5f60 2023-07-27T14:38:55.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.199+0000 7f01e6ffd700 1 -- 172.21.15.115:0/542124993 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f00073b0 con 0x7f02000a5f60 2023-07-27T14:38:55.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.199+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02001660a0 con 0x7f02000a5f60 2023-07-27T14:38:55.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.199+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02000ac680 con 0x7f02000a5f60 2023-07-27T14:38:55.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.200+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020006c470 con 0x7f02000a5f60 2023-07-27T14:38:55.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.201+0000 7f01e6ffd700 1 -- 172.21.15.115:0/542124993 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f01f0010070 con 0x7f02000a5f60 2023-07-27T14:38:55.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.201+0000 7f01e6ffd700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f01ec05fb50 0x7f01ec062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:55.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.201+0000 7f01e6ffd700 1 -- 172.21.15.115:0/542124993 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f01f007a900 con 0x7f02000a5f60 2023-07-27T14:38:55.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.202+0000 7f01fe7fc700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f01ec05fb50 0x7f01ec062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:55.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.202+0000 7f01fe7fc700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f01ec05fb50 0x7f01ec062010 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f02000a6360 tx=0x7f01f4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:55.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.205+0000 7f01e6ffd700 1 -- 172.21.15.115:0/542124993 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f01f004b0e0 con 0x7f02000a5f60 2023-07-27T14:38:55.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:55.413+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f02000a7ae0 con 0x7f02000a5f60 2023-07-27T14:38:56.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.194+0000 7f01e6ffd700 1 -- 172.21.15.115:0/542124993 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v101) v1 ==== 118+0+0 (secure 0 0 0) 0x7f01f004e700 con 0x7f02000a5f60 2023-07-27T14:38:56.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f01ec05fb50 msgr2=0x7f01ec062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:56.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f01ec05fb50 0x7f01ec062010 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f02000a6360 tx=0x7f01f4017000).stop 2023-07-27T14:38:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 msgr2=0x7f0200162b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f0200162b60 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7f01f000c4c0 tx=0x7f01f0007e00).stop 2023-07-27T14:38:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 shutdown_connections 2023-07-27T14:38:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f01ec05fb50 0x7f01ec062010 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f020014f740 0x7f0200063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02000a5f60 0x7f0200162b60 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 --2- 172.21.15.115:0/542124993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02000c31e0 0x7f0200142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 >> 172.21.15.115:0/542124993 conn(0x7f0200062320 msgr2=0x7f0200067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:56.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 shutdown_connections 2023-07-27T14:38:56.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.196+0000 7f02055ff700 1 -- 172.21.15.115:0/542124993 wait complete. 2023-07-27T14:38:56.267 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:38:56.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:38:56.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.406+0000 7f63ef5ff700 1 Processor -- start 2023-07-27T14:38:56.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.406+0000 7f63ef5ff700 1 -- start start 2023-07-27T14:38:56.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.407+0000 7f63ef5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63e813a350 0x7f63e8065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:56.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.407+0000 7f63ef5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f63e813a730 0x7f63e81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:56.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.407+0000 7f63ef5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e80c2fa0 0x7f63e80c3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:56.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.407+0000 7f63ef5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e8066400 con 0x7f63e813a350 2023-07-27T14:38:56.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.407+0000 7f63ef5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e8158ae0 con 0x7f63e813a730 2023-07-27T14:38:56.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.407+0000 7f63ef5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80c3940 con 0x7f63e80c2fa0 2023-07-27T14:38:56.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63e813a350 0x7f63e8065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:56.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63e813a350 0x7f63e8065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35780/0 (socket says 172.21.15.115:35780) 2023-07-27T14:38:56.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 -- 172.21.15.115:0/859039997 learned_addr learned my addr 172.21.15.115:0/859039997 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:56.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ecb9a700 1 --2- 172.21.15.115:0/859039997 >> v2:172.21.15.159:3300/0 conn(0x7f63e813a730 0x7f63e81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:56.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63edb9c700 1 --2- 172.21.15.115:0/859039997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e80c2fa0 0x7f63e80c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:56.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 -- 172.21.15.115:0/859039997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e80c2fa0 msgr2=0x7f63e80c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:56.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 --2- 172.21.15.115:0/859039997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e80c2fa0 0x7f63e80c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 -- 172.21.15.115:0/859039997 >> v2:172.21.15.159:3300/0 conn(0x7f63e813a730 msgr2=0x7f63e81585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:56.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 --2- 172.21.15.115:0/859039997 >> v2:172.21.15.159:3300/0 conn(0x7f63e813a730 0x7f63e81585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 -- 172.21.15.115:0/859039997 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80bd9a0 con 0x7f63e813a350 2023-07-27T14:38:56.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63ed39b700 1 --2- 172.21.15.115:0/859039997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e8065f10 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f63e8069070 tx=0x7f63e40090f0).ready entity=mon.0 client_cookie=ada2c188fa17cbe6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:56.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63dffff700 1 -- 172.21.15.115:0/859039997 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400b600 con 0x7f63e813a350 2023-07-27T14:38:56.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63dffff700 1 -- 172.21.15.115:0/859039997 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400b760 con 0x7f63e813a350 2023-07-27T14:38:56.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.408+0000 7f63dffff700 1 -- 172.21.15.115:0/859039997 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400bae0 con 0x7f63e813a350 2023-07-27T14:38:56.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 -- 172.21.15.115:0/859039997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 msgr2=0x7f63e8065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:56.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/859039997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e8065f10 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f63e8069070 tx=0x7f63e40090f0).stop 2023-07-27T14:38:56.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 -- 172.21.15.115:0/859039997 shutdown_connections 2023-07-27T14:38:56.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/859039997 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e80c2fa0 0x7f63e80c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/859039997 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e8065f10 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/859039997 >> v2:172.21.15.159:3300/0 conn(0x7f63e813a730 0x7f63e81585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 -- 172.21.15.115:0/859039997 >> 172.21.15.115:0/859039997 conn(0x7f63e805e8f0 msgr2=0x7f63e80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:56.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 -- 172.21.15.115:0/859039997 shutdown_connections 2023-07-27T14:38:56.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.409+0000 7f63ef5ff700 1 -- 172.21.15.115:0/859039997 wait complete. 2023-07-27T14:38:56.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.410+0000 7f63ef5ff700 1 Processor -- start 2023-07-27T14:38:56.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.411+0000 7f63ef5ff700 1 -- start start 2023-07-27T14:38:56.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.411+0000 7f63ef5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63e80c2fa0 0x7f63e80a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:56.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.411+0000 7f63ef5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e80c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:56.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ef5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e813a730 0x7f63e8152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:56.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ef5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80a5e90 con 0x7f63e813a350 2023-07-27T14:38:56.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ef5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80a5250 con 0x7f63e80c2fa0 2023-07-27T14:38:56.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ef5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80a54f0 con 0x7f63e813a730 2023-07-27T14:38:56.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e80c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:56.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e80c21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35796/0 (socket says 172.21.15.115:35796) 2023-07-27T14:38:56.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 -- 172.21.15.115:0/2067411852 learned_addr learned my addr 172.21.15.115:0/2067411852 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:56.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ed39b700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63e80c2fa0 0x7f63e80a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:56.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63edb9c700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e813a730 0x7f63e8152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:56.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 -- 172.21.15.115:0/2067411852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e813a730 msgr2=0x7f63e8152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:56.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e813a730 0x7f63e8152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 -- 172.21.15.115:0/2067411852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63e80c2fa0 msgr2=0x7f63e80a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:56.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63e80c2fa0 0x7f63e80a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:56.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 -- 172.21.15.115:0/2067411852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009370 con 0x7f63e813a350 2023-07-27T14:38:56.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.412+0000 7f63ecb9a700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e80c21a0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f63d800d890 tx=0x7f63d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:56.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.413+0000 7f63dd7fa700 1 -- 172.21.15.115:0/2067411852 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80125f0 con 0x7f63e813a350 2023-07-27T14:38:56.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.413+0000 7f63dd7fa700 1 -- 172.21.15.115:0/2067411852 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8012750 con 0x7f63e813a350 2023-07-27T14:38:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.413+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e80a57d0 con 0x7f63e813a350 2023-07-27T14:38:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.413+0000 7f63dd7fa700 1 -- 172.21.15.115:0/2067411852 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8012ad0 con 0x7f63e813a350 2023-07-27T14:38:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.413+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e80c2690 con 0x7f63e813a350 2023-07-27T14:38:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.414+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e80a5fd0 con 0x7f63e813a350 2023-07-27T14:38:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.414+0000 7f63dd7fa700 1 -- 172.21.15.115:0/2067411852 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f63d8013480 con 0x7f63e813a350 2023-07-27T14:38:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.415+0000 7f63dd7fa700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63cc05fb50 0x7f63cc062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:56.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.416+0000 7f63dd7fa700 1 -- 172.21.15.115:0/2067411852 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f63d807afe0 con 0x7f63e813a350 2023-07-27T14:38:56.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.416+0000 7f63ed39b700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63cc05fb50 0x7f63cc062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:56.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.416+0000 7f63ed39b700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63cc05fb50 0x7f63cc062010 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f63e4009130 tx=0x7f63e4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:56.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.419+0000 7f63dd7fa700 1 -- 172.21.15.115:0/2067411852 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63d804b690 con 0x7f63e813a350 2023-07-27T14:38:56.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:56.632+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f63e806c470 con 0x7f63e813a350 2023-07-27T14:38:57.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.200+0000 7f63dd7fa700 1 -- 172.21.15.115:0/2067411852 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v102) v1 ==== 122+0+0 (secure 0 0 0) 0x7f63d804ecb0 con 0x7f63e813a350 2023-07-27T14:38:57.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63cc05fb50 msgr2=0x7f63cc062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63cc05fb50 0x7f63cc062010 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f63e4009130 tx=0x7f63e4017000).stop 2023-07-27T14:38:57.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 msgr2=0x7f63e80c21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e80c21a0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f63d800d890 tx=0x7f63d8008040).stop 2023-07-27T14:38:57.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 shutdown_connections 2023-07-27T14:38:57.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f63cc05fb50 0x7f63cc062010 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63e813a730 0x7f63e8152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63e80c2fa0 0x7f63e80a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 --2- 172.21.15.115:0/2067411852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63e813a350 0x7f63e80c21a0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 >> 172.21.15.115:0/2067411852 conn(0x7f63e805e8f0 msgr2=0x7f63e80abad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:57.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 shutdown_connections 2023-07-27T14:38:57.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.203+0000 7f63ef5ff700 1 -- 172.21.15.115:0/2067411852 wait complete. 2023-07-27T14:38:57.276 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:38:57.276 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:38:57.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.414+0000 7f350bbff700 1 Processor -- start 2023-07-27T14:38:57.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.414+0000 7f350bbff700 1 -- start start 2023-07-27T14:38:57.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.415+0000 7f350bbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3504153ec0 0x7f35040a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040aaa40 0x7f35040c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350bbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35040aa4d0 con 0x7f35040aa050 2023-07-27T14:38:57.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350bbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35040c05c0 con 0x7f3504153ec0 2023-07-27T14:38:57.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35040bfc90 con 0x7f35040aaa40 2023-07-27T14:38:57.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350999b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3504153ec0 0x7f35040a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350999b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3504153ec0 0x7f35040a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35810/0 (socket says 172.21.15.115:35810) 2023-07-27T14:38:57.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350999b700 1 -- 172.21.15.115:0/3918661655 learned_addr learned my addr 172.21.15.115:0/3918661655 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:57.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350a19c700 1 --2- 172.21.15.115:0/3918661655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040aaa40 0x7f35040c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350999b700 1 -- 172.21.15.115:0/3918661655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040aaa40 msgr2=0x7f35040c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:57.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350999b700 1 --2- 172.21.15.115:0/3918661655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040aaa40 0x7f35040c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350999b700 1 -- 172.21.15.115:0/3918661655 >> v1:172.21.15.159:6789/0 conn(0x7f35040aa050 legacy=0x7f35040640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:57.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350999b700 1 -- 172.21.15.115:0/3918661655 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35040bff70 con 0x7f3504153ec0 2023-07-27T14:38:57.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.416+0000 7f350a19c700 1 --2- 172.21.15.115:0/3918661655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040aaa40 0x7f35040c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:57.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350999b700 1 --2- 172.21.15.115:0/3918661655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3504153ec0 0x7f35040a9b60 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7f3500006fd0 tx=0x7f35000090f0).ready entity=mon.0 client_cookie=5f5d5c80d75428b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:57.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f3508999700 1 -- 172.21.15.115:0/3918661655 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000b600 con 0x7f3504153ec0 2023-07-27T14:38:57.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f3508999700 1 -- 172.21.15.115:0/3918661655 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000b760 con 0x7f3504153ec0 2023-07-27T14:38:57.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f3508999700 1 -- 172.21.15.115:0/3918661655 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000bae0 con 0x7f3504153ec0 2023-07-27T14:38:57.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350bbff700 1 -- 172.21.15.115:0/3918661655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3504153ec0 msgr2=0x7f35040a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350bbff700 1 --2- 172.21.15.115:0/3918661655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3504153ec0 0x7f35040a9b60 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7f3500006fd0 tx=0x7f35000090f0).stop 2023-07-27T14:38:57.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350bbff700 1 -- 172.21.15.115:0/3918661655 shutdown_connections 2023-07-27T14:38:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350bbff700 1 --2- 172.21.15.115:0/3918661655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040aaa40 0x7f35040c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350bbff700 1 --2- 172.21.15.115:0/3918661655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3504153ec0 0x7f35040a9b60 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350bbff700 1 -- 172.21.15.115:0/3918661655 >> 172.21.15.115:0/3918661655 conn(0x7f35040cb610 msgr2=0x7f35040c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350bbff700 1 -- 172.21.15.115:0/3918661655 shutdown_connections 2023-07-27T14:38:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.417+0000 7f350bbff700 1 -- 172.21.15.115:0/3918661655 wait complete. 2023-07-27T14:38:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.419+0000 7f350bbff700 1 Processor -- start 2023-07-27T14:38:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.419+0000 7f350bbff700 1 -- start start 2023-07-27T14:38:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350bbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35040aa050 0x7f3504167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350bbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040aaa40 0x7f35040c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350bbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3504153ec0 0x7f3504164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350bbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35041644d0 con 0x7f35040aa050 2023-07-27T14:38:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350bbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3504167f80 con 0x7f35040aaa40 2023-07-27T14:38:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350bbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3504168260 con 0x7f3504153ec0 2023-07-27T14:38:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35040aa050 0x7f3504167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35040aa050 0x7f3504167750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35820/0 (socket says 172.21.15.115:35820) 2023-07-27T14:38:57.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350999b700 1 -- 172.21.15.115:0/2288181004 learned_addr learned my addr 172.21.15.115:0/2288181004 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:57.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350999b700 1 -- 172.21.15.115:0/2288181004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3504153ec0 msgr2=0x7f3504164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350999b700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3504153ec0 0x7f3504164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:57.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350999b700 1 -- 172.21.15.115:0/2288181004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040aaa40 msgr2=0x7f35040c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350999b700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040aaa40 0x7f35040c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:57.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.420+0000 7f350999b700 1 -- 172.21.15.115:0/2288181004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3500009370 con 0x7f35040aa050 2023-07-27T14:38:57.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.421+0000 7f350999b700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35040aa050 0x7f3504167750 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f3500009f50 tx=0x7f3500017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:57.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.421+0000 7f34f9ffb700 1 -- 172.21.15.115:0/2288181004 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000b8d0 con 0x7f35040aa050 2023-07-27T14:38:57.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.421+0000 7f34f9ffb700 1 -- 172.21.15.115:0/2288181004 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000ba30 con 0x7f35040aa050 2023-07-27T14:38:57.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.421+0000 7f34f9ffb700 1 -- 172.21.15.115:0/2288181004 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350001b620 con 0x7f35040aa050 2023-07-27T14:38:57.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.421+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3504168540 con 0x7f35040aa050 2023-07-27T14:38:57.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.421+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3504167c40 con 0x7f35040aa050 2023-07-27T14:38:57.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.422+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350406c470 con 0x7f35040aa050 2023-07-27T14:38:57.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.423+0000 7f34f9ffb700 1 -- 172.21.15.115:0/2288181004 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f350002b070 con 0x7f35040aa050 2023-07-27T14:38:57.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.423+0000 7f34f9ffb700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34e805fb50 0x7f34e8062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.424+0000 7f34f9ffb700 1 -- 172.21.15.115:0/2288181004 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f350007c870 con 0x7f35040aa050 2023-07-27T14:38:57.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.424+0000 7f350919a700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34e805fb50 0x7f34e8062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.424+0000 7f350919a700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34e805fb50 0x7f34e8062010 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f350415a6e0 tx=0x7f34f40079a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:57.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.428+0000 7f34f9ffb700 1 -- 172.21.15.115:0/2288181004 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f350004d050 con 0x7f35040aa050 2023-07-27T14:38:57.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.638+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35040aa4d0 con 0x7f35040aa050 2023-07-27T14:38:57.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.638+0000 7f34f9ffb700 1 -- 172.21.15.115:0/2288181004 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4504 (secure 0 0 0) 0x7f35040aa4d0 con 0x7f35040aa050 2023-07-27T14:38:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:57.692 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":102,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2746189426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2746189426},{"type":"v1","addr":"172.21.15.159:6835","nonce":2746189426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/131117331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":131117331},{"type":"v1","addr":"172.21.15.115:6837","nonce":131117331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":8608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3669259360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3669259360},{"type":"v1","addr":"172.21.15.159:6834","nonce":3669259360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:38:54.165239+0000","modified":"2023-07-27T14:38:57.194631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2564907842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2564907842},{"type":"v1","addr":"172.21.15.115:6836","nonce":2564907842}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-07-27T14:38:57.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34e805fb50 msgr2=0x7f34e8062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34e805fb50 0x7f34e8062010 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f350415a6e0 tx=0x7f34f40079a0).stop 2023-07-27T14:38:57.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35040aa050 msgr2=0x7f3504167750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35040aa050 0x7f3504167750 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f3500009f50 tx=0x7f3500017000).stop 2023-07-27T14:38:57.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 shutdown_connections 2023-07-27T14:38:57.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34e805fb50 0x7f34e8062010 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3504153ec0 0x7f3504164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:57.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35040aa050 0x7f3504167750 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 --2- 172.21.15.115:0/2288181004 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040aaa40 0x7f35040c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:38:57.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 >> 172.21.15.115:0/2288181004 conn(0x7f35040cb610 msgr2=0x7f35040abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:57.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 shutdown_connections 2023-07-27T14:38:57.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.641+0000 7f350bbff700 1 -- 172.21.15.115:0/2288181004 wait complete. 2023-07-27T14:38:57.698 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 102 2023-07-27T14:38:57.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:38:57.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.847+0000 7fbf70fff700 1 Processor -- start 2023-07-27T14:38:57.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.848+0000 7fbf70fff700 1 -- start start 2023-07-27T14:38:57.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf70fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c151bd0 0x7fbf6c062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf70fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbf6c0a4f50 0x7fbf6c0bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf70fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c0639d0 con 0x7fbf6c062810 2023-07-27T14:38:57.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf70fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6c137610 con 0x7fbf6c0a4f50 2023-07-27T14:38:57.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf70fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c062dc0 con 0x7fbf6c151bd0 2023-07-27T14:38:57.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf69d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbf6c062810 0x7fbf6c0a4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47366/0 (socket says 172.21.15.115:47366) 2023-07-27T14:38:57.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf69d9b700 1 -- 172.21.15.115:0/3685446200 learned_addr learned my addr 172.21.15.115:0/3685446200 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:57.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf6ad9d700 1 --2- 172.21.15.115:0/3685446200 >> v2:172.21.15.159:3300/0 conn(0x7fbf6c0a4f50 0x7fbf6c0bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.849+0000 7fbf6a59c700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c151bd0 0x7fbf6c062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824453424 0 0) 0x7fbf6c0639d0 con 0x7fbf6c062810 2023-07-27T14:38:57.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf540033f0 con 0x7fbf6c062810 2023-07-27T14:38:57.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389406717 0 0) 0x7fbf540033f0 con 0x7fbf6c062810 2023-07-27T14:38:57.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c151bd0 msgr2=0x7fbf6c062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:57.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c151bd0 0x7fbf6c062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 >> v2:172.21.15.159:3300/0 conn(0x7fbf6c0a4f50 msgr2=0x7fbf6c0bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:57.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 --2- 172.21.15.115:0/3685446200 >> v2:172.21.15.159:3300/0 conn(0x7fbf6c0a4f50 0x7fbf6c0bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c0630a0 con 0x7fbf6c062810 2023-07-27T14:38:57.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fbf60001470 con 0x7fbf6c062810 2023-07-27T14:38:57.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 >> v1:172.21.15.115:6789/0 conn(0x7fbf6c062810 legacy=0x7fbf6c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c151bd0 0x7fbf540038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf54003e10 0x7fbf54004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54004b80 0x7fbf54005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c062dc0 con 0x7fbf54003e10 2023-07-27T14:38:57.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5400b8e0 con 0x7fbf54004b80 2023-07-27T14:38:57.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5400ba20 con 0x7fbf6c151bd0 2023-07-27T14:38:57.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf69d9b700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf54003e10 0x7fbf54004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6a59c700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c151bd0 0x7fbf540038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.850+0000 7fbf6ad9d700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54004b80 0x7fbf54005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf69d9b700 1 -- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c151bd0 msgr2=0x7fbf540038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:57.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf69d9b700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c151bd0 0x7fbf540038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf69d9b700 1 -- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54004b80 msgr2=0x7fbf54005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:57.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf69d9b700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54004b80 0x7fbf54005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf69d9b700 1 -- 172.21.15.115:0/3685446200 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf540033f0 con 0x7fbf54003e10 2023-07-27T14:38:57.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf69d9b700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf54003e10 0x7fbf54004690 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7fbf6000c210 tx=0x7fbf60001e90).ready entity=mon.0 client_cookie=1c01729a56108e8a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:57.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60007a60 con 0x7fbf54003e10 2023-07-27T14:38:57.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6000caa0 con 0x7fbf54003e10 2023-07-27T14:38:57.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.851+0000 7fbf6959a700 1 -- 172.21.15.115:0/3685446200 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6000ce40 con 0x7fbf54003e10 2023-07-27T14:38:57.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.852+0000 7fbf70fff700 1 -- 172.21.15.115:0/3685446200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf54003e10 msgr2=0x7fbf54004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.852+0000 7fbf70fff700 1 --2- 172.21.15.115:0/3685446200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf54003e10 0x7fbf54004690 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7fbf6000c210 tx=0x7fbf60001e90).stop 2023-07-27T14:38:57.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.852+0000 7fbf6ad9d700 1 -- 172.21.15.115:0/3685446200 reap_dead start 2023-07-27T14:38:57.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.852+0000 7fbf70fff700 1 -- 172.21.15.115:0/3685446200 shutdown_connections 2023-07-27T14:38:57.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.852+0000 7fbf70fff700 1 -- 172.21.15.115:0/3685446200 >> 172.21.15.115:0/3685446200 conn(0x7fbf6c064700 msgr2=0x7fbf6c064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:57.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.852+0000 7fbf70fff700 1 -- 172.21.15.115:0/3685446200 shutdown_connections 2023-07-27T14:38:57.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.852+0000 7fbf70fff700 1 -- 172.21.15.115:0/3685446200 wait complete. 2023-07-27T14:38:57.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.853+0000 7fbf70fff700 1 Processor -- start 2023-07-27T14:38:57.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.853+0000 7fbf70fff700 1 -- start start 2023-07-27T14:38:57.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.854+0000 7fbf70fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54003e10 0x7fbf6c135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.854+0000 7fbf70fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c13b690 0x7fbf6c0a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.854+0000 7fbf70fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf6c1364c0 0x7fbf6c136940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.854+0000 7fbf70fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0a77f0 con 0x7fbf6c1364c0 2023-07-27T14:38:57.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.854+0000 7fbf70fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c136e30 con 0x7fbf54003e10 2023-07-27T14:38:57.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.854+0000 7fbf70fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c13bb10 con 0x7fbf6c13b690 2023-07-27T14:38:57.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf6c1364c0 0x7fbf6c136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf6c1364c0 0x7fbf6c136940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35832/0 (socket says 172.21.15.115:35832) 2023-07-27T14:38:57.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 -- 172.21.15.115:0/3924328047 learned_addr learned my addr 172.21.15.115:0/3924328047 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:57.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6a59c700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54003e10 0x7fbf6c135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf69d9b700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c13b690 0x7fbf6c0a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 -- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c13b690 msgr2=0x7fbf6c0a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c13b690 0x7fbf6c0a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 -- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54003e10 msgr2=0x7fbf6c135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:57.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54003e10 0x7fbf6c135db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:57.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 -- 172.21.15.115:0/3924328047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c0a6be0 con 0x7fbf6c1364c0 2023-07-27T14:38:57.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf69d9b700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c13b690 0x7fbf6c0a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:57.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6a59c700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54003e10 0x7fbf6c135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:57.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf6ad9d700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf6c1364c0 0x7fbf6c136940 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7fbf6c0652d0 tx=0x7fbf6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:57.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf5a7fc700 1 -- 172.21.15.115:0/3924328047 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6400e040 con 0x7fbf6c1364c0 2023-07-27T14:38:57.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf5a7fc700 1 -- 172.21.15.115:0/3924328047 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6400f040 con 0x7fbf6c1364c0 2023-07-27T14:38:57.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf5a7fc700 1 -- 172.21.15.115:0/3924328047 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6400fe50 con 0x7fbf6c1364c0 2023-07-27T14:38:57.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.855+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c0a6ec0 con 0x7fbf6c1364c0 2023-07-27T14:38:57.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.856+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c0a7480 con 0x7fbf6c1364c0 2023-07-27T14:38:57.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.857+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c06c470 con 0x7fbf6c1364c0 2023-07-27T14:38:57.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.857+0000 7fbf5a7fc700 1 -- 172.21.15.115:0/3924328047 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fbf64015660 con 0x7fbf6c1364c0 2023-07-27T14:38:57.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.858+0000 7fbf5a7fc700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf4c05fb50 0x7fbf4c062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:57.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.858+0000 7fbf5a7fc700 1 -- 172.21.15.115:0/3924328047 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbf6407bde0 con 0x7fbf6c1364c0 2023-07-27T14:38:57.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.858+0000 7fbf6a59c700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf4c05fb50 0x7fbf4c062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:57.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.859+0000 7fbf6a59c700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf4c05fb50 0x7fbf4c062010 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fbf5c006c40 tx=0x7fbf5c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:57.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:57.862+0000 7fbf5a7fc700 1 -- 172.21.15.115:0/3924328047 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbf6404c450 con 0x7fbf6c1364c0 2023-07-27T14:38:58.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.032+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf6c0a7930 con 0x7fbf6c1364c0 2023-07-27T14:38:58.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.033+0000 7fbf5a7fc700 1 -- 172.21.15.115:0/3924328047 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+17086 (secure 0 0 0) 0x7fbf6c0a7930 con 0x7fbf6c1364c0 2023-07-27T14:38:58.087 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:58.088 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":188,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:38:55.167144+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:38:51.766720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-27T14:38:53.161829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:38:58.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf4c05fb50 msgr2=0x7fbf4c062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf4c05fb50 0x7fbf4c062010 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fbf5c006c40 tx=0x7fbf5c008040).stop 2023-07-27T14:38:58.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf6c1364c0 msgr2=0x7fbf6c136940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf6c1364c0 0x7fbf6c136940 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7fbf6c0652d0 tx=0x7fbf6400b040).stop 2023-07-27T14:38:58.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 shutdown_connections 2023-07-27T14:38:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf4c05fb50 0x7fbf4c062010 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf6c1364c0 0x7fbf6c136940 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf54003e10 0x7fbf6c135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 --2- 172.21.15.115:0/3924328047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c13b690 0x7fbf6c0a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 >> 172.21.15.115:0/3924328047 conn(0x7fbf6c064700 msgr2=0x7fbf6c152830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 shutdown_connections 2023-07-27T14:38:58.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.036+0000 7fbf70fff700 1 -- 172.21.15.115:0/3924328047 wait complete. 2023-07-27T14:38:58.107 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:38:58.107 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:38:58.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.244+0000 7f68093ff700 1 Processor -- start 2023-07-27T14:38:58.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.244+0000 7f68093ff700 1 -- start start 2023-07-27T14:38:58.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.246+0000 7f68093ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f6804155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.246+0000 7f68093ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6804067080 con 0x7f6804066b80 2023-07-27T14:38:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.246+0000 7f68093ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040634d0 con 0x7f6804065ff0 2023-07-27T14:38:58.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.246+0000 7f68093ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6804063a90 con 0x7f6804151d70 2023-07-27T14:38:58.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.246+0000 7f68037fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6804066b80 0x7f6804067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47370/0 (socket says 172.21.15.115:47370) 2023-07-27T14:38:58.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.246+0000 7f68037fe700 1 -- 172.21.15.115:0/4185353549 learned_addr learned my addr 172.21.15.115:0/4185353549 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:58.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6802ffd700 1 --2- 172.21.15.115:0/4185353549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f6804155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6801ffb700 1 -- 172.21.15.115:0/4185353549 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182433862 0 0) 0x7f6804067080 con 0x7f6804066b80 2023-07-27T14:38:58.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6801ffb700 1 -- 172.21.15.115:0/4185353549 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67ec0033f0 con 0x7f6804066b80 2023-07-27T14:38:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6801ffb700 1 -- 172.21.15.115:0/4185353549 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900037654 0 0) 0x7f68040634d0 con 0x7f6804065ff0 2023-07-27T14:38:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6801ffb700 1 -- 172.21.15.115:0/4185353549 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6804067080 con 0x7f6804065ff0 2023-07-27T14:38:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6801ffb700 1 -- 172.21.15.115:0/4185353549 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3597961812 0 0) 0x7f67ec0033f0 con 0x7f6804066b80 2023-07-27T14:38:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6802ffd700 1 -- 172.21.15.115:0/4185353549 >> v1:172.21.15.159:6789/0 conn(0x7f6804065ff0 legacy=0x7f6804066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6802ffd700 1 -- 172.21.15.115:0/4185353549 >> v1:172.21.15.115:6789/0 conn(0x7f6804066b80 legacy=0x7f6804067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6802ffd700 1 -- 172.21.15.115:0/4185353549 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040637b0 con 0x7f6804151d70 2023-07-27T14:38:58.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.247+0000 7f6802ffd700 1 --2- 172.21.15.115:0/4185353549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f6804155060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f67f4009790 tx=0x7f67f4009060).ready entity=mon.2 client_cookie=e6ab1aafbc2143f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f6801ffb700 1 -- 172.21.15.115:0/4185353549 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc0017f0 con 0x7f6804151d70 2023-07-27T14:38:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f6801ffb700 1 -- 172.21.15.115:0/4185353549 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f4011400 con 0x7f6804151d70 2023-07-27T14:38:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f6801ffb700 1 -- 172.21.15.115:0/4185353549 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4011780 con 0x7f6804151d70 2023-07-27T14:38:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f68093ff700 1 -- 172.21.15.115:0/4185353549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 msgr2=0x7f6804155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f68093ff700 1 --2- 172.21.15.115:0/4185353549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f6804155060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f67f4009790 tx=0x7f67f4009060).stop 2023-07-27T14:38:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f68093ff700 1 -- 172.21.15.115:0/4185353549 shutdown_connections 2023-07-27T14:38:58.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f68093ff700 1 --2- 172.21.15.115:0/4185353549 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f6804155060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f68093ff700 1 -- 172.21.15.115:0/4185353549 >> 172.21.15.115:0/4185353549 conn(0x7f68040c89a0 msgr2=0x7f68040c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:58.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f68093ff700 1 -- 172.21.15.115:0/4185353549 shutdown_connections 2023-07-27T14:38:58.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.248+0000 7f68093ff700 1 -- 172.21.15.115:0/4185353549 wait complete. 2023-07-27T14:38:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.250+0000 7f68093ff700 1 Processor -- start 2023-07-27T14:38:58.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.251+0000 7f68093ff700 1 -- start start 2023-07-27T14:38:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68093ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6804065ff0 0x7f68041639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68093ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6804066b80 0x7f68040c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68093ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f68040c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68093ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680414f2c0 con 0x7f6804066b80 2023-07-27T14:38:58.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68093ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804163ea0 con 0x7f6804065ff0 2023-07-27T14:38:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68093ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040c4350 con 0x7f6804151d70 2023-07-27T14:38:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68027fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6804066b80 0x7f68040c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68027fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6804066b80 0x7f68040c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35834/0 (socket says 172.21.15.115:35834) 2023-07-27T14:38:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68027fc700 1 -- 172.21.15.115:0/1246855309 learned_addr learned my addr 172.21.15.115:0/1246855309 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f6802ffd700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6804065ff0 0x7f68041639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68037fe700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f68040c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68027fc700 1 -- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 msgr2=0x7f68040c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.252+0000 7f68027fc700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f68040c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f68027fc700 1 -- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6804065ff0 msgr2=0x7f68041639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f68027fc700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6804065ff0 0x7f68041639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f68027fc700 1 -- 172.21.15.115:0/1246855309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40092a0 con 0x7f6804066b80 2023-07-27T14:38:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f6802ffd700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6804065ff0 0x7f68041639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f68037fe700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f68040c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:38:58.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f68027fc700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6804066b80 0x7f68040c3970 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f67f800c490 tx=0x7f67f8007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:58.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f67eaffd700 1 -- 172.21.15.115:0/1246855309 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f800f470 con 0x7f6804066b80 2023-07-27T14:38:58.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f67eaffd700 1 -- 172.21.15.115:0/1246855309 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f800f5d0 con 0x7f6804066b80 2023-07-27T14:38:58.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f67eaffd700 1 -- 172.21.15.115:0/1246855309 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f800f990 con 0x7f6804066b80 2023-07-27T14:38:58.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68040c05f0 con 0x7f6804066b80 2023-07-27T14:38:58.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.253+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68040c4830 con 0x7f6804066b80 2023-07-27T14:38:58.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.254+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680406c470 con 0x7f6804066b80 2023-07-27T14:38:58.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.255+0000 7f67eaffd700 1 -- 172.21.15.115:0/1246855309 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f67f8019030 con 0x7f6804066b80 2023-07-27T14:38:58.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.256+0000 7f67eaffd700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67f005fb50 0x7f67f0062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.256+0000 7f67eaffd700 1 -- 172.21.15.115:0/1246855309 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f67f807a5e0 con 0x7f6804066b80 2023-07-27T14:38:58.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.256+0000 7f6802ffd700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67f005fb50 0x7f67f0062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.256+0000 7f6802ffd700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67f005fb50 0x7f67f0062010 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f67f40096e0 tx=0x7f67f4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:58.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.260+0000 7f67eaffd700 1 -- 172.21.15.115:0/1246855309 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f67f804adc0 con 0x7f6804066b80 2023-07-27T14:38:58.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.425+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6804068720 con 0x7f67f005fb50 2023-07-27T14:38:58.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.435+0000 7f67eaffd700 1 -- 172.21.15.115:0/1246855309 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353161 (secure 0 0 0) 0x7f6804068720 con 0x7f67f005fb50 2023-07-27T14:38:58.494 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:58.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67f005fb50 msgr2=0x7f67f0062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67f005fb50 0x7f67f0062010 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f67f40096e0 tx=0x7f67f4016000).stop 2023-07-27T14:38:58.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6804066b80 msgr2=0x7f68040c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6804066b80 0x7f68040c3970 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f67f800c490 tx=0x7f67f8007c60).stop 2023-07-27T14:38:58.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 shutdown_connections 2023-07-27T14:38:58.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f67f005fb50 0x7f67f0062010 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6804151d70 0x7f68040c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6804065ff0 0x7f68041639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 --2- 172.21.15.115:0/1246855309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6804066b80 0x7f68040c3970 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 >> 172.21.15.115:0/1246855309 conn(0x7f68040c89a0 msgr2=0x7f68040bf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:58.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 shutdown_connections 2023-07-27T14:38:58.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.439+0000 7f68093ff700 1 -- 172.21.15.115:0/1246855309 wait complete. 2023-07-27T14:38:58.499 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:38:58.510 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2023-07-27T14:38:57.600680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":188756,"kb_used_data":18132,"kb_used_omap":0,"kb_used_meta":170560,"kb_avail":754785964,"statfs":{"total":773094113280,"available":772900827136,"internally_reserved":0,"allocated":18567168,"data_stored":8772787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":174653440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-516379,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-22,"num_read_kb":-8206,"num_write":-232,"num_write_kb":-16981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.273618"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707322+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706426+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.704032+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706993+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705659+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703875+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.712778+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707431+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.710549+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707676+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711681+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705844+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706759+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708330+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705783+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707008+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705904+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706787+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706586+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705705+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705238+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709432+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703229+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706595+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707600+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711457+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702729+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705249+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705987+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706884+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702653+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705166+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707064+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703643+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706095+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711467+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.712282+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702699+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707525+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708990+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709445+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707100+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706241+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706855+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711855+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708671+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706484+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706527+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707898+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705628+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706444+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708171+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706644+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707793+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706056+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705836+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708337+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549169+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:38:50.549169+0000","last_peered":"2023-07-27T14:38:50.549169+0000","last_clean":"2023-07-27T14:38:50.549169+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:38:50.549169+0000","last_undegraded":"2023-07-27T14:38:50.549169+0000","last_fullsized":"2023-07-27T14:38:50.549169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711379+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.132553+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:38:50.132553+0000","last_peered":"2023-07-27T14:38:50.132553+0000","last_clean":"2023-07-27T14:38:50.132553+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:38:50.132553+0000","last_undegraded":"2023-07-27T14:38:50.132553+0000","last_fullsized":"2023-07-27T14:38:50.132553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709038+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549221+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:38:50.549221+0000","last_peered":"2023-07-27T14:38:50.549221+0000","last_clean":"2023-07-27T14:38:50.549221+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:38:50.549221+0000","last_undegraded":"2023-07-27T14:38:50.549221+0000","last_fullsized":"2023-07-27T14:38:50.549221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706104+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.132543+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:38:50.132543+0000","last_peered":"2023-07-27T14:38:50.132543+0000","last_clean":"2023-07-27T14:38:50.132543+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:38:50.132543+0000","last_undegraded":"2023-07-27T14:38:50.132543+0000","last_fullsized":"2023-07-27T14:38:50.132543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549320+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:38:50.549320+0000","last_peered":"2023-07-27T14:38:50.549320+0000","last_clean":"2023-07-27T14:38:50.549320+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:38:50.549320+0000","last_undegraded":"2023-07-27T14:38:50.549320+0000","last_fullsized":"2023-07-27T14:38:50.549320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707645+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549327+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:38:50.549327+0000","last_peered":"2023-07-27T14:38:50.549327+0000","last_clean":"2023-07-27T14:38:50.549327+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:38:50.549327+0000","last_undegraded":"2023-07-27T14:38:50.549327+0000","last_fullsized":"2023-07-27T14:38:50.549327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707526+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549325+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:38:50.549325+0000","last_peered":"2023-07-27T14:38:50.549325+0000","last_clean":"2023-07-27T14:38:50.549325+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:38:50.549325+0000","last_undegraded":"2023-07-27T14:38:50.549325+0000","last_fullsized":"2023-07-27T14:38:50.549325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708044+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549213+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:38:50.549213+0000","last_peered":"2023-07-27T14:38:50.549213+0000","last_clean":"2023-07-27T14:38:50.549213+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:38:50.549213+0000","last_undegraded":"2023-07-27T14:38:50.549213+0000","last_fullsized":"2023-07-27T14:38:50.549213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711965+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:49.316857+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:38:49.316857+0000","last_peered":"2023-07-27T14:38:49.316857+0000","last_clean":"2023-07-27T14:38:49.316857+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:38:49.316857+0000","last_undegraded":"2023-07-27T14:38:49.316857+0000","last_fullsized":"2023-07-27T14:38:49.316857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24228,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94347612,"statfs":{"total":96636764160,"available":96611954688,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.996,"15min":1.133},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.89900000000000002,"15min":1.1180000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64600000000000002,"15min":0.68700000000000006},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86299999999999999,"5min":0.879,"15min":1.1759999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.70099999999999996},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.92500000000000004,"15min":1.1459999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.66700000000000004},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78400000000000003,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.77100000000000002,"5min":0.89300000000000002,"15min":1.119},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.54400000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78800000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":1.165},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.0129999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.627}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":1.105,"15min":1.202},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":0.83099999999999996,"5min":1.0069999999999999,"15min":1.101},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.752,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":0.92100000000000004,"5min":1.03,"15min":1.056},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90200000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23908,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":21632,"kb_avail":94347932,"statfs":{"total":96636764160,"available":96612282368,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22151168},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.68600000000000005,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.8940000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.67700000000000005,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":6.6980000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":0.748,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.975,"5min":13.975,"15min":13.975},"last":0.626},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.70999999999999996,"15min":0.66500000000000004},"min":{"1min":0.53000000000000003,"5min":0.44,"15min":0.36699999999999999},"max":{"1min":7.8440000000000003,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.323,"5min":0.78400000000000003,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":14.018000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.55500000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.9530000000000003,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.038,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":0.78200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.36399999999999999},"max":{"1min":15.638999999999999,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.72399999999999998,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":8.0169999999999995,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":0.83499999999999996,"15min":0.73799999999999999},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":15.461,"5min":15.461,"15min":15.461},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.78400000000000003,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":5.5499999999999998,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.87},{"interface":"front","average":{"1min":1.117,"5min":0.82799999999999996,"15min":0.78500000000000003},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":8.0670000000000002,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24484,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":94347356,"statfs":{"total":96636764160,"available":96611692544,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.44900000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.23699999999999999},"max":{"1min":0.53700000000000003,"5min":0.61499999999999999,"15min":4.75},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41599999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":9.3100000000000005},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":2.7160000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.496},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45900000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57599999999999996,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.94499999999999995,"5min":1.1639999999999999,"15min":2.181},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.70799999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.92400000000000004,"5min":1.014,"15min":2.4180000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.45400000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.55300000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95999999999999996,"5min":1.085,"15min":2.052},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.77500000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95699999999999996,"5min":1.1419999999999999,"15min":2.016},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.59899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23076,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94348764,"statfs":{"total":96636764160,"available":96613134336,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.245},"max":{"1min":0.56399999999999995,"5min":1.954,"15min":1.954},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41099999999999998,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45900000000000002,"15min":0.46500000000000002},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52000000000000002,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.57699999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.624}]},{"osd":4,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.55000000000000004,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71599999999999997},"min":{"1min":0.59199999999999997,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":1.034,"5min":1.0489999999999999,"15min":1.25},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.6020000000000001},"last":1.0149999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.498},"max":{"1min":0.88700000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.22},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.109,"5min":2.141,"15min":2.141},"last":1.004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.63700000000000001,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":0.93999999999999995,"5min":1.125,"15min":1.2370000000000001},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26660,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":24384,"kb_avail":94345180,"statfs":{"total":96636764160,"available":96609464320,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24969216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.77100000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.42499999999999999,"15min":0.45800000000000002},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57199999999999995,"5min":0.60999999999999999,"15min":1.1899999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.624,"5min":0.64700000000000002,"15min":0.96399999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.68999999999999995,"15min":5.601},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.83499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":1.002,"15min":1.353},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.42999999999999999},"max":{"1min":0.78800000000000003,"5min":0.90600000000000003,"15min":1.849},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":0.95399999999999996,"5min":0.95499999999999996,"15min":6.9660000000000002},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.57299999999999995,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":1.163,"15min":1.163},"last":0.751},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.58199999999999996,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":1.04,"15min":1.772},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.58099999999999996,"5min":0.48199999999999998,"15min":0.42499999999999999},"max":{"1min":0.84799999999999998,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72399999999999998,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":1.105,"15min":3.1360000000000001},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.024,"5min":1.024,"15min":1.8089999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":1.0569999999999999,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.94999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":20608,"kb_avail":94348956,"statfs":{"total":96636764160,"available":96613330944,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21102592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.52300000000000002,"5min":0.66800000000000004,"15min":1.202},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.42999999999999999},"min":{"1min":0.32700000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":1.302},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.371},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":0.64300000000000002,"15min":1.2390000000000001},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.626,"5min":0.69199999999999995,"15min":1.8029999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68899999999999995},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":0.97399999999999998,"15min":1.149},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.85899999999999999,"5min":0.94099999999999995,"15min":5.1059999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.59999999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":1.232},"last":0.63},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.298},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.55000000000000004,"5min":0.501,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.343},"last":0.504}]},{"osd":7,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.94199999999999995,"5min":1.115,"15min":2.048},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.93100000000000005,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17688,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94354152,"statfs":{"total":96636764160,"available":96618651648,"internally_reserved":0,"allocated":2310144,"data_stored":1091155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.5,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.876,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":3.419,"15min":4.4409999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":2.3010000000000002,"15min":4.476},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94099999999999995,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85099999999999998,"5min":3.48,"15min":4.3949999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.40600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79000000000000004,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":3.8620000000000001,"15min":5.194},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.56000000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":2.387,"15min":5.5990000000000002},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.59299999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0960000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25828,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":23552,"kb_avail":94346012,"statfs":{"total":96636764160,"available":96610316288,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24117248},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.443,"5min":0.35499999999999998,"15min":0.317},"max":{"1min":0.874,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58599999999999997,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84099999999999997,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.747}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.69099999999999995},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.377},"max":{"1min":0.94599999999999995,"5min":1.026,"15min":6.7489999999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.878,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":0.81699999999999995,"5min":0.98799999999999999,"15min":1.581},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.66100000000000003},"min":{"1min":0.51800000000000002,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":0.92500000000000004,"5min":0.98999999999999999,"15min":3.8220000000000001},"last":0.877}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.67400000000000004},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.77200000000000002,"5min":0.89800000000000002,"15min":9.6920000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":1.978},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.86299999999999999,"5min":1.115,"15min":1.9419999999999999},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:38:58.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:38:58.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.685+0000 7f0fe09ff700 1 Processor -- start 2023-07-27T14:38:58.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.685+0000 7f0fe09ff700 1 -- start start 2023-07-27T14:38:58.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.686+0000 7f0fe09ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0fdc0aaa40 0x7f0fdc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.686+0000 7f0fe09ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc0aa4d0 con 0x7f0fdc1542a0 2023-07-27T14:38:58.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.686+0000 7f0fe09ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc0c05c0 con 0x7f0fdc153ec0 2023-07-27T14:38:58.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.686+0000 7f0fe09ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fdc0aa270 con 0x7f0fdc0aaa40 2023-07-27T14:38:58.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fdad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0fdc1542a0 0x7f0fdc0c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47374/0 (socket says 172.21.15.115:47374) 2023-07-27T14:38:58.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fdad9d700 1 -- 172.21.15.115:0/2259320295 learned_addr learned my addr 172.21.15.115:0/2259320295 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:58.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd9d9b700 1 --2- 172.21.15.115:0/2259320295 >> v2:172.21.15.159:3300/0 conn(0x7f0fdc0aaa40 0x7f0fdc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073035123 0 0) 0x7f0fd4001490 con 0x7f0fdc1542a0 2023-07-27T14:38:58.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc40033f0 con 0x7f0fdc1542a0 2023-07-27T14:38:58.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748560400 0 0) 0x7f0fc40033f0 con 0x7f0fdc1542a0 2023-07-27T14:38:58.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 >> v2:172.21.15.159:3300/0 conn(0x7f0fdc0aaa40 msgr2=0x7f0fdc0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:58.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd959a700 1 --2- 172.21.15.115:0/2259320295 >> v2:172.21.15.159:3300/0 conn(0x7f0fdc0aaa40 0x7f0fdc0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 >> v1:172.21.15.159:6789/0 conn(0x7f0fdc153ec0 legacy=0x7f0fdc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0bfc90 con 0x7f0fdc1542a0 2023-07-27T14:38:58.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f0fd4001980 con 0x7f0fdc1542a0 2023-07-27T14:38:58.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.687+0000 7f0fd9d9b700 1 --2- 172.21.15.115:0/2259320295 >> v2:172.21.15.159:3300/0 conn(0x7f0fdc0aaa40 0x7f0fdc0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:58.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 >> v1:172.21.15.115:6789/0 conn(0x7f0fdc1542a0 legacy=0x7f0fdc0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fd959a700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fc4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fd959a700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc4004690 0x7f0fc4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fd959a700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc4005000 0x7f0fc400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0aa270 con 0x7f0fc40038e0 2023-07-27T14:38:58.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc400bf60 con 0x7f0fc4004690 2023-07-27T14:38:58.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc400c0f0 con 0x7f0fc4005000 2023-07-27T14:38:58.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fda59c700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fc4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fd9d9b700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc4004690 0x7f0fc4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fdad9d700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc4005000 0x7f0fc400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fda59c700 1 -- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc4005000 msgr2=0x7f0fc400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fda59c700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc4005000 0x7f0fc400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fda59c700 1 -- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc4004690 msgr2=0x7f0fc4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fda59c700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fc4004690 0x7f0fc4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fda59c700 1 -- 172.21.15.115:0/2259320295 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40033f0 con 0x7f0fc40038e0 2023-07-27T14:38:58.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fdad9d700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fc4005000 0x7f0fc400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:58.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fdad9d700 1 -- 172.21.15.115:0/2259320295 reap_dead start 2023-07-27T14:38:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.688+0000 7f0fda59c700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fc4003d00 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f0fcc001730 tx=0x7f0fcc007bb0).ready entity=mon.0 client_cookie=c4ceac6025f64e1d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc007020 con 0x7f0fc40038e0 2023-07-27T14:38:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc007180 con 0x7f0fc40038e0 2023-07-27T14:38:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fd959a700 1 -- 172.21.15.115:0/2259320295 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc007520 con 0x7f0fc40038e0 2023-07-27T14:38:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2259320295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 msgr2=0x7f0fc4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fe09ff700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fc4003d00 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f0fcc001730 tx=0x7f0fcc007bb0).stop 2023-07-27T14:38:58.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2259320295 shutdown_connections 2023-07-27T14:38:58.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fe09ff700 1 --2- 172.21.15.115:0/2259320295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fc4003d00 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2259320295 >> 172.21.15.115:0/2259320295 conn(0x7f0fdc0cb610 msgr2=0x7f0fdc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:58.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2259320295 shutdown_connections 2023-07-27T14:38:58.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.689+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2259320295 wait complete. 2023-07-27T14:38:58.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.691+0000 7f0fe09ff700 1 Processor -- start 2023-07-27T14:38:58.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.691+0000 7f0fe09ff700 1 -- start start 2023-07-27T14:38:58.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fe09ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fdc14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fe09ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fdc14fc80 0x7f0fdc0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fe09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fdc0c5c80 0x7f0fdc0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fe09ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0c60e0 con 0x7f0fc40038e0 2023-07-27T14:38:58.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fe09ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc150470 con 0x7f0fdc14fc80 2023-07-27T14:38:58.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fe09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc150750 con 0x7f0fdc0c5c80 2023-07-27T14:38:58.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fda59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fdc14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fda59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fdc14f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35852/0 (socket says 172.21.15.115:35852) 2023-07-27T14:38:58.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fda59c700 1 -- 172.21.15.115:0/2530673239 learned_addr learned my addr 172.21.15.115:0/2530673239 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:58.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fd9d9b700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fdc14fc80 0x7f0fdc0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fdad9d700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fdc0c5c80 0x7f0fdc0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fda59c700 1 -- 172.21.15.115:0/2530673239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fdc0c5c80 msgr2=0x7f0fdc0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fda59c700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fdc0c5c80 0x7f0fdc0c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fda59c700 1 -- 172.21.15.115:0/2530673239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fdc14fc80 msgr2=0x7f0fdc0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fda59c700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fdc14fc80 0x7f0fdc0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.692+0000 7f0fda59c700 1 -- 172.21.15.115:0/2530673239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc150a30 con 0x7f0fc40038e0 2023-07-27T14:38:58.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.693+0000 7f0fda59c700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fdc14f790 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f0fc4005640 tx=0x7f0fcc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:58.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.693+0000 7f0fca7fc700 1 -- 172.21.15.115:0/2530673239 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc006ff0 con 0x7f0fc40038e0 2023-07-27T14:38:58.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.693+0000 7f0fca7fc700 1 -- 172.21.15.115:0/2530673239 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc013670 con 0x7f0fc40038e0 2023-07-27T14:38:58.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.693+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc150d10 con 0x7f0fc40038e0 2023-07-27T14:38:58.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.693+0000 7f0fca7fc700 1 -- 172.21.15.115:0/2530673239 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc013a30 con 0x7f0fc40038e0 2023-07-27T14:38:58.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.693+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc0c4910 con 0x7f0fc40038e0 2023-07-27T14:38:58.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.694+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc0c6060 con 0x7f0fc40038e0 2023-07-27T14:38:58.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.695+0000 7f0fca7fc700 1 -- 172.21.15.115:0/2530673239 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f0fcc010030 con 0x7f0fc40038e0 2023-07-27T14:38:58.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.696+0000 7f0fca7fc700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fbc05fb20 0x7f0fbc061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:58.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.696+0000 7f0fca7fc700 1 -- 172.21.15.115:0/2530673239 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0fcc07b9f0 con 0x7f0fc40038e0 2023-07-27T14:38:58.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.696+0000 7f0fd9d9b700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fbc05fb20 0x7f0fbc061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:58.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.697+0000 7f0fd9d9b700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fbc05fb20 0x7f0fbc061fe0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f0fdc150080 tx=0x7f0fd0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:58.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.700+0000 7f0fca7fc700 1 -- 172.21.15.115:0/2530673239 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fcc07de60 con 0x7f0fc40038e0 2023-07-27T14:38:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.864+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fdc06c470 con 0x7f0fbc05fb20 2023-07-27T14:38:58.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.873+0000 7f0fca7fc700 1 -- 172.21.15.115:0/2530673239 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353161 (secure 0 0 0) 0x7f0fdc06c470 con 0x7f0fbc05fb20 2023-07-27T14:38:58.933 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:58.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fbc05fb20 msgr2=0x7f0fbc061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fbc05fb20 0x7f0fbc061fe0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f0fdc150080 tx=0x7f0fd0008040).stop 2023-07-27T14:38:58.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 msgr2=0x7f0fdc14f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:58.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fdc14f790 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f0fc4005640 tx=0x7f0fcc015000).stop 2023-07-27T14:38:58.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 shutdown_connections 2023-07-27T14:38:58.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0fbc05fb20 0x7f0fbc061fe0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0fdc0c5c80 0x7f0fdc0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0fc40038e0 0x7f0fdc14f790 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 --2- 172.21.15.115:0/2530673239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fdc14fc80 0x7f0fdc0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:58.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 >> 172.21.15.115:0/2530673239 conn(0x7f0fdc0cb610 msgr2=0x7f0fdc0acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:58.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 shutdown_connections 2023-07-27T14:38:58.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:58.878+0000 7f0fe09ff700 1 -- 172.21.15.115:0/2530673239 wait complete. 2023-07-27T14:38:58.938 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:38:58.939 INFO:tasks.ceph.mds.a.smithi115.stderr:2023-07-27T14:38:58.885+0000 7f142eff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:38:58.951 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2023-07-27T14:38:57.600680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":188756,"kb_used_data":18132,"kb_used_omap":0,"kb_used_meta":170560,"kb_avail":754785964,"statfs":{"total":773094113280,"available":772900827136,"internally_reserved":0,"allocated":18567168,"data_stored":8772787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":174653440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-516379,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-22,"num_read_kb":-8206,"num_write":-232,"num_write_kb":-16981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.273618"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707322+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706426+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.704032+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706993+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705659+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703875+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.712778+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707431+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.710549+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707676+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711681+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705844+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706759+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708330+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705783+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707008+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705904+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706787+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706586+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705705+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705238+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709432+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703229+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706595+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707600+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711457+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702729+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705249+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705987+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706884+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702653+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705166+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707064+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703643+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706095+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711467+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.712282+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702699+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707525+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708990+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709445+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707100+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706241+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706855+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711855+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708671+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706484+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706527+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707898+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705628+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706444+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708171+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706644+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707793+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706056+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705836+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708337+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549169+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:38:50.549169+0000","last_peered":"2023-07-27T14:38:50.549169+0000","last_clean":"2023-07-27T14:38:50.549169+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:38:50.549169+0000","last_undegraded":"2023-07-27T14:38:50.549169+0000","last_fullsized":"2023-07-27T14:38:50.549169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711379+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.132553+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:38:50.132553+0000","last_peered":"2023-07-27T14:38:50.132553+0000","last_clean":"2023-07-27T14:38:50.132553+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:38:50.132553+0000","last_undegraded":"2023-07-27T14:38:50.132553+0000","last_fullsized":"2023-07-27T14:38:50.132553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709038+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549221+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:38:50.549221+0000","last_peered":"2023-07-27T14:38:50.549221+0000","last_clean":"2023-07-27T14:38:50.549221+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:38:50.549221+0000","last_undegraded":"2023-07-27T14:38:50.549221+0000","last_fullsized":"2023-07-27T14:38:50.549221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706104+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.132543+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:38:50.132543+0000","last_peered":"2023-07-27T14:38:50.132543+0000","last_clean":"2023-07-27T14:38:50.132543+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:38:50.132543+0000","last_undegraded":"2023-07-27T14:38:50.132543+0000","last_fullsized":"2023-07-27T14:38:50.132543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549320+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:38:50.549320+0000","last_peered":"2023-07-27T14:38:50.549320+0000","last_clean":"2023-07-27T14:38:50.549320+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:38:50.549320+0000","last_undegraded":"2023-07-27T14:38:50.549320+0000","last_fullsized":"2023-07-27T14:38:50.549320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707645+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549327+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:38:50.549327+0000","last_peered":"2023-07-27T14:38:50.549327+0000","last_clean":"2023-07-27T14:38:50.549327+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:38:50.549327+0000","last_undegraded":"2023-07-27T14:38:50.549327+0000","last_fullsized":"2023-07-27T14:38:50.549327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707526+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549325+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:38:50.549325+0000","last_peered":"2023-07-27T14:38:50.549325+0000","last_clean":"2023-07-27T14:38:50.549325+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:38:50.549325+0000","last_undegraded":"2023-07-27T14:38:50.549325+0000","last_fullsized":"2023-07-27T14:38:50.549325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708044+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549213+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:38:50.549213+0000","last_peered":"2023-07-27T14:38:50.549213+0000","last_clean":"2023-07-27T14:38:50.549213+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:38:50.549213+0000","last_undegraded":"2023-07-27T14:38:50.549213+0000","last_fullsized":"2023-07-27T14:38:50.549213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711965+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:49.316857+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:38:49.316857+0000","last_peered":"2023-07-27T14:38:49.316857+0000","last_clean":"2023-07-27T14:38:49.316857+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:38:49.316857+0000","last_undegraded":"2023-07-27T14:38:49.316857+0000","last_fullsized":"2023-07-27T14:38:49.316857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24228,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94347612,"statfs":{"total":96636764160,"available":96611954688,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.996,"15min":1.133},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.89900000000000002,"15min":1.1180000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64600000000000002,"15min":0.68700000000000006},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86299999999999999,"5min":0.879,"15min":1.1759999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.70099999999999996},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.92500000000000004,"15min":1.1459999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.66700000000000004},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78400000000000003,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.77100000000000002,"5min":0.89300000000000002,"15min":1.119},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.54400000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78800000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":1.165},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.0129999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.627}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":1.105,"15min":1.202},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":0.83099999999999996,"5min":1.0069999999999999,"15min":1.101},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.752,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":0.92100000000000004,"5min":1.03,"15min":1.056},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90200000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23908,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":21632,"kb_avail":94347932,"statfs":{"total":96636764160,"available":96612282368,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22151168},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.68600000000000005,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.8940000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.67700000000000005,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":6.6980000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":0.748,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.975,"5min":13.975,"15min":13.975},"last":0.626},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.70999999999999996,"15min":0.66500000000000004},"min":{"1min":0.53000000000000003,"5min":0.44,"15min":0.36699999999999999},"max":{"1min":7.8440000000000003,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.323,"5min":0.78400000000000003,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":14.018000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.55500000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.9530000000000003,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.038,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":0.78200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.36399999999999999},"max":{"1min":15.638999999999999,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.72399999999999998,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":8.0169999999999995,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":0.83499999999999996,"15min":0.73799999999999999},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":15.461,"5min":15.461,"15min":15.461},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.78400000000000003,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":5.5499999999999998,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.87},{"interface":"front","average":{"1min":1.117,"5min":0.82799999999999996,"15min":0.78500000000000003},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":8.0670000000000002,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24484,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":94347356,"statfs":{"total":96636764160,"available":96611692544,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.44900000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.23699999999999999},"max":{"1min":0.53700000000000003,"5min":0.61499999999999999,"15min":4.75},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41599999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":9.3100000000000005},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":2.7160000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.496},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45900000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57599999999999996,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.94499999999999995,"5min":1.1639999999999999,"15min":2.181},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.70799999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.92400000000000004,"5min":1.014,"15min":2.4180000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.45400000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.55300000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95999999999999996,"5min":1.085,"15min":2.052},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.77500000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95699999999999996,"5min":1.1419999999999999,"15min":2.016},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.59899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23076,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94348764,"statfs":{"total":96636764160,"available":96613134336,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.245},"max":{"1min":0.56399999999999995,"5min":1.954,"15min":1.954},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41099999999999998,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45900000000000002,"15min":0.46500000000000002},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52000000000000002,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.57699999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.624}]},{"osd":4,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.55000000000000004,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71599999999999997},"min":{"1min":0.59199999999999997,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":1.034,"5min":1.0489999999999999,"15min":1.25},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.6020000000000001},"last":1.0149999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.498},"max":{"1min":0.88700000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.22},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.109,"5min":2.141,"15min":2.141},"last":1.004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.63700000000000001,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":0.93999999999999995,"5min":1.125,"15min":1.2370000000000001},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26660,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":24384,"kb_avail":94345180,"statfs":{"total":96636764160,"available":96609464320,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24969216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.77100000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.42499999999999999,"15min":0.45800000000000002},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57199999999999995,"5min":0.60999999999999999,"15min":1.1899999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.624,"5min":0.64700000000000002,"15min":0.96399999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.68999999999999995,"15min":5.601},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.83499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":1.002,"15min":1.353},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.42999999999999999},"max":{"1min":0.78800000000000003,"5min":0.90600000000000003,"15min":1.849},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":0.95399999999999996,"5min":0.95499999999999996,"15min":6.9660000000000002},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.57299999999999995,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":1.163,"15min":1.163},"last":0.751},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.58199999999999996,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":1.04,"15min":1.772},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.58099999999999996,"5min":0.48199999999999998,"15min":0.42499999999999999},"max":{"1min":0.84799999999999998,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72399999999999998,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":1.105,"15min":3.1360000000000001},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.024,"5min":1.024,"15min":1.8089999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":1.0569999999999999,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.94999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":20608,"kb_avail":94348956,"statfs":{"total":96636764160,"available":96613330944,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21102592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.52300000000000002,"5min":0.66800000000000004,"15min":1.202},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.42999999999999999},"min":{"1min":0.32700000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":1.302},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.371},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":0.64300000000000002,"15min":1.2390000000000001},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.626,"5min":0.69199999999999995,"15min":1.8029999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68899999999999995},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":0.97399999999999998,"15min":1.149},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.85899999999999999,"5min":0.94099999999999995,"15min":5.1059999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.59999999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":1.232},"last":0.63},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.298},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.55000000000000004,"5min":0.501,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.343},"last":0.504}]},{"osd":7,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.94199999999999995,"5min":1.115,"15min":2.048},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.93100000000000005,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17688,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94354152,"statfs":{"total":96636764160,"available":96618651648,"internally_reserved":0,"allocated":2310144,"data_stored":1091155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.5,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.876,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":3.419,"15min":4.4409999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":2.3010000000000002,"15min":4.476},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94099999999999995,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85099999999999998,"5min":3.48,"15min":4.3949999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.40600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79000000000000004,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":3.8620000000000001,"15min":5.194},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.56000000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":2.387,"15min":5.5990000000000002},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.59299999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0960000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25828,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":23552,"kb_avail":94346012,"statfs":{"total":96636764160,"available":96610316288,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24117248},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.443,"5min":0.35499999999999998,"15min":0.317},"max":{"1min":0.874,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58599999999999997,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84099999999999997,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.747}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.69099999999999995},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.377},"max":{"1min":0.94599999999999995,"5min":1.026,"15min":6.7489999999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.878,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":0.81699999999999995,"5min":0.98799999999999999,"15min":1.581},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.66100000000000003},"min":{"1min":0.51800000000000002,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":0.92500000000000004,"5min":0.98999999999999999,"15min":3.8220000000000001},"last":0.877}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.67400000000000004},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.77200000000000002,"5min":0.89800000000000002,"15min":9.6920000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":1.978},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.86299999999999999,"5min":1.115,"15min":1.9419999999999999},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:38:58.965 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:38:59.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.128+0000 7f23ea7ff700 1 Processor -- start 2023-07-27T14:38:59.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.129+0000 7f23ea7ff700 1 -- start start 2023-07-27T14:38:59.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.130+0000 7f23ea7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f23e4153ec0 0x7f23e40a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.130+0000 7f23ea7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e40aaa40 0x7f23e40c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.130+0000 7f23ea7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e40aa4d0 con 0x7f23e40aa050 2023-07-27T14:38:59.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.130+0000 7f23ea7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e40c05c0 con 0x7f23e4153ec0 2023-07-27T14:38:59.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.130+0000 7f23ea7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40bfc90 con 0x7f23e40aaa40 2023-07-27T14:38:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.130+0000 7f23e37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f23e40aa050 0x7f23e40640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47380/0 (socket says 172.21.15.115:47380) 2023-07-27T14:38:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.130+0000 7f23e37fe700 1 -- 172.21.15.115:0/2558034217 learned_addr learned my addr 172.21.15.115:0/2558034217 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:38:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e3fff700 1 --2- 172.21.15.115:0/2558034217 >> v2:172.21.15.159:3300/0 conn(0x7f23e4153ec0 0x7f23e40a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e8d9c700 1 --2- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e40aaa40 0x7f23e40c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e2ffd700 1 -- 172.21.15.115:0/2558034217 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106969310 0 0) 0x7f23d8001110 con 0x7f23e40aa050 2023-07-27T14:38:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e2ffd700 1 -- 172.21.15.115:0/2558034217 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23cc0033f0 con 0x7f23e40aa050 2023-07-27T14:38:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e3fff700 1 -- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e40aaa40 msgr2=0x7f23e40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:59.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e2ffd700 1 -- 172.21.15.115:0/2558034217 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3091034561 0 0) 0x7f23cc0033f0 con 0x7f23e40aa050 2023-07-27T14:38:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e3fff700 1 --2- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e40aaa40 0x7f23e40c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e3fff700 1 -- 172.21.15.115:0/2558034217 >> v1:172.21.15.115:6789/0 conn(0x7f23e40aa050 legacy=0x7f23e40640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e3fff700 1 -- 172.21.15.115:0/2558034217 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e40bff70 con 0x7f23e4153ec0 2023-07-27T14:38:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e8d9c700 1 --2- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e40aaa40 0x7f23e40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:38:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.131+0000 7f23e3fff700 1 --2- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e4153ec0 0x7f23e40a9b60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f23d4009760 tx=0x7f23d4009060).ready entity=mon.1 client_cookie=e9a21e027e3bb602 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23e2ffd700 1 -- 172.21.15.115:0/2558034217 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8001600 con 0x7f23e4153ec0 2023-07-27T14:38:59.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23e2ffd700 1 -- 172.21.15.115:0/2558034217 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4011400 con 0x7f23e4153ec0 2023-07-27T14:38:59.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23e2ffd700 1 -- 172.21.15.115:0/2558034217 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4011780 con 0x7f23e4153ec0 2023-07-27T14:38:59.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23ea7ff700 1 -- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e4153ec0 msgr2=0x7f23e40a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e4153ec0 0x7f23e40a9b60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f23d4009760 tx=0x7f23d4009060).stop 2023-07-27T14:38:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23ea7ff700 1 -- 172.21.15.115:0/2558034217 shutdown_connections 2023-07-27T14:38:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e40aaa40 0x7f23e40c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/2558034217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e4153ec0 0x7f23e40a9b60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23ea7ff700 1 -- 172.21.15.115:0/2558034217 >> 172.21.15.115:0/2558034217 conn(0x7f23e40cb610 msgr2=0x7f23e40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23ea7ff700 1 -- 172.21.15.115:0/2558034217 shutdown_connections 2023-07-27T14:38:59.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.132+0000 7f23ea7ff700 1 -- 172.21.15.115:0/2558034217 wait complete. 2023-07-27T14:38:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.134+0000 7f23ea7ff700 1 Processor -- start 2023-07-27T14:38:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.134+0000 7f23ea7ff700 1 -- start start 2023-07-27T14:38:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23ea7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e40aa050 0x7f23e4146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23ea7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23e40aaa40 0x7f23e4150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23ea7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e4153ec0 0x7f23e41510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23ea7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4151750 con 0x7f23e40aaa40 2023-07-27T14:38:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23ea7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4168940 con 0x7f23e40aa050 2023-07-27T14:38:59.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23ea7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e41684b0 con 0x7f23e4153ec0 2023-07-27T14:38:59.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23e40aaa40 0x7f23e4150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23e40aaa40 0x7f23e4150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35860/0 (socket says 172.21.15.115:35860) 2023-07-27T14:38:59.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e37fe700 1 -- 172.21.15.115:0/929790182 learned_addr learned my addr 172.21.15.115:0/929790182 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:59.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e3fff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e40aa050 0x7f23e4146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e8d9c700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e4153ec0 0x7f23e41510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e37fe700 1 -- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e4153ec0 msgr2=0x7f23e41510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e37fe700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e4153ec0 0x7f23e41510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e37fe700 1 -- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e40aa050 msgr2=0x7f23e4146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e37fe700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e40aa050 0x7f23e4146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e37fe700 1 -- 172.21.15.115:0/929790182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc009a20 con 0x7f23e40aaa40 2023-07-27T14:38:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.135+0000 7f23e8d9c700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e4153ec0 0x7f23e41510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:38:59.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.136+0000 7f23e37fe700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23e40aaa40 0x7f23e4150be0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f23d800c840 tx=0x7f23d8001450).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.136+0000 7f23cbfff700 1 -- 172.21.15.115:0/929790182 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80014e0 con 0x7f23e40aaa40 2023-07-27T14:38:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.136+0000 7f23cbfff700 1 -- 172.21.15.115:0/929790182 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d8007170 con 0x7f23e40aaa40 2023-07-27T14:38:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.136+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d40092a0 con 0x7f23e40aaa40 2023-07-27T14:38:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.136+0000 7f23cbfff700 1 -- 172.21.15.115:0/929790182 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8007530 con 0x7f23e40aaa40 2023-07-27T14:38:59.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.136+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e4167b80 con 0x7f23e40aaa40 2023-07-27T14:38:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.137+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e406c470 con 0x7f23e40aaa40 2023-07-27T14:38:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.138+0000 7f23cbfff700 1 -- 172.21.15.115:0/929790182 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f23d8010070 con 0x7f23e40aaa40 2023-07-27T14:38:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.138+0000 7f23cbfff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23d005fb20 0x7f23d0061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.139+0000 7f23cbfff700 1 -- 172.21.15.115:0/929790182 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f23d807a8d0 con 0x7f23e40aaa40 2023-07-27T14:38:59.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.139+0000 7f23e3fff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23d005fb20 0x7f23d0061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.139+0000 7f23e3fff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23d005fb20 0x7f23d0061fe0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f23d4009270 tx=0x7f23d4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:59.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.142+0000 7f23cbfff700 1 -- 172.21.15.115:0/929790182 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f23d804b0b0 con 0x7f23e40aaa40 2023-07-27T14:38:59.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.311+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23e40aa4d0 con 0x7f23d005fb20 2023-07-27T14:38:59.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.320+0000 7f23cbfff700 1 -- 172.21.15.115:0/929790182 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353161 (secure 0 0 0) 0x7f23e40aa4d0 con 0x7f23d005fb20 2023-07-27T14:38:59.377 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:59.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23d005fb20 msgr2=0x7f23d0061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23d005fb20 0x7f23d0061fe0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f23d4009270 tx=0x7f23d4016000).stop 2023-07-27T14:38:59.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23e40aaa40 msgr2=0x7f23e4150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23e40aaa40 0x7f23e4150be0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f23d800c840 tx=0x7f23d8001450).stop 2023-07-27T14:38:59.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 shutdown_connections 2023-07-27T14:38:59.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23d005fb20 0x7f23d0061fe0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23e4153ec0 0x7f23e41510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23e40aa050 0x7f23e4146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 --2- 172.21.15.115:0/929790182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23e40aaa40 0x7f23e4150be0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 >> 172.21.15.115:0/929790182 conn(0x7f23e40cb610 msgr2=0x7f23e40640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:59.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 shutdown_connections 2023-07-27T14:38:59.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.325+0000 7f23ea7ff700 1 -- 172.21.15.115:0/929790182 wait complete. 2023-07-27T14:38:59.384 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:38:59.396 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2023-07-27T14:38:57.600680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":188756,"kb_used_data":18132,"kb_used_omap":0,"kb_used_meta":170560,"kb_avail":754785964,"statfs":{"total":773094113280,"available":772900827136,"internally_reserved":0,"allocated":18567168,"data_stored":8772787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":174653440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-516379,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-22,"num_read_kb":-8206,"num_write":-232,"num_write_kb":-16981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.273618"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707322+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706426+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.704032+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706993+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705659+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703875+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.712778+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707431+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.710549+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707676+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711681+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705844+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706759+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708330+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705783+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707008+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705904+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706787+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706586+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705705+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705238+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709432+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703229+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706595+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707600+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711457+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702729+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705249+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705987+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706884+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702653+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705166+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707064+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.703643+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706095+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711467+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.712282+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.702699+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707525+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708990+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709445+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707100+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706241+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706855+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711855+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708671+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706484+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706527+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707898+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705628+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706444+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708171+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706644+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707793+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706056+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.705836+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708337+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549169+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:38:50.549169+0000","last_peered":"2023-07-27T14:38:50.549169+0000","last_clean":"2023-07-27T14:38:50.549169+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:38:50.549169+0000","last_undegraded":"2023-07-27T14:38:50.549169+0000","last_fullsized":"2023-07-27T14:38:50.549169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711379+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.132553+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:38:50.132553+0000","last_peered":"2023-07-27T14:38:50.132553+0000","last_clean":"2023-07-27T14:38:50.132553+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:38:50.132553+0000","last_undegraded":"2023-07-27T14:38:50.132553+0000","last_fullsized":"2023-07-27T14:38:50.132553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.709038+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549221+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:38:50.549221+0000","last_peered":"2023-07-27T14:38:50.549221+0000","last_clean":"2023-07-27T14:38:50.549221+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:38:50.549221+0000","last_undegraded":"2023-07-27T14:38:50.549221+0000","last_fullsized":"2023-07-27T14:38:50.549221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.706104+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.132543+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:38:50.132543+0000","last_peered":"2023-07-27T14:38:50.132543+0000","last_clean":"2023-07-27T14:38:50.132543+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:38:50.132543+0000","last_undegraded":"2023-07-27T14:38:50.132543+0000","last_fullsized":"2023-07-27T14:38:50.132543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":156,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549320+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:38:50.549320+0000","last_peered":"2023-07-27T14:38:50.549320+0000","last_clean":"2023-07-27T14:38:50.549320+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:38:50.549320+0000","last_undegraded":"2023-07-27T14:38:50.549320+0000","last_fullsized":"2023-07-27T14:38:50.549320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707645+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549327+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:38:50.549327+0000","last_peered":"2023-07-27T14:38:50.549327+0000","last_clean":"2023-07-27T14:38:50.549327+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:38:50.549327+0000","last_undegraded":"2023-07-27T14:38:50.549327+0000","last_fullsized":"2023-07-27T14:38:50.549327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.707526+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549325+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:38:50.549325+0000","last_peered":"2023-07-27T14:38:50.549325+0000","last_clean":"2023-07-27T14:38:50.549325+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:38:50.549325+0000","last_undegraded":"2023-07-27T14:38:50.549325+0000","last_fullsized":"2023-07-27T14:38:50.549325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.708044+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":146,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:50.549213+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:38:50.549213+0000","last_peered":"2023-07-27T14:38:50.549213+0000","last_clean":"2023-07-27T14:38:50.549213+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:38:50.549213+0000","last_undegraded":"2023-07-27T14:38:50.549213+0000","last_fullsized":"2023-07-27T14:38:50.549213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:38:53.698957+0000","last_change":"2023-07-27T14:38:53.698957+0000","last_active":"2023-07-27T14:38:53.698957+0000","last_peered":"2023-07-27T14:38:53.698957+0000","last_clean":"2023-07-27T14:38:53.698957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:53.698957+0000","last_undegraded":"2023-07-27T14:38:53.698957+0000","last_fullsized":"2023-07-27T14:38:53.698957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-07-27T14:38:52.696298+0000","last_change":"2023-07-27T14:38:52.711965+0000","last_active":"2023-07-27T14:38:52.696298+0000","last_peered":"2023-07-27T14:38:52.696298+0000","last_clean":"2023-07-27T14:38:52.696298+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:38:52.696298+0000","last_undegraded":"2023-07-27T14:38:52.696298+0000","last_fullsized":"2023-07-27T14:38:52.696298+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-07-27T14:38:49.316857+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:38:49.316857+0000","last_peered":"2023-07-27T14:38:49.316857+0000","last_clean":"2023-07-27T14:38:49.316857+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:38:49.316857+0000","last_undegraded":"2023-07-27T14:38:49.316857+0000","last_fullsized":"2023-07-27T14:38:49.316857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24228,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94347612,"statfs":{"total":96636764160,"available":96611954688,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.996,"15min":1.133},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.89900000000000002,"15min":1.1180000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64600000000000002,"15min":0.68700000000000006},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86299999999999999,"5min":0.879,"15min":1.1759999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.70099999999999996},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.92500000000000004,"15min":1.1459999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.66700000000000004},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78400000000000003,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.77100000000000002,"5min":0.89300000000000002,"15min":1.119},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.54400000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78800000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":1.165},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.0129999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.627}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":1.105,"15min":1.202},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":0.83099999999999996,"5min":1.0069999999999999,"15min":1.101},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.752,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":0.92100000000000004,"5min":1.03,"15min":1.056},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90200000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23908,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":21632,"kb_avail":94347932,"statfs":{"total":96636764160,"available":96612282368,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22151168},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.68600000000000005,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.8940000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.67700000000000005,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":6.6980000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":0.748,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.975,"5min":13.975,"15min":13.975},"last":0.626},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.70999999999999996,"15min":0.66500000000000004},"min":{"1min":0.53000000000000003,"5min":0.44,"15min":0.36699999999999999},"max":{"1min":7.8440000000000003,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.323,"5min":0.78400000000000003,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":14.018000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.55500000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.9530000000000003,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.038,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":0.78200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.36399999999999999},"max":{"1min":15.638999999999999,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.72399999999999998,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":8.0169999999999995,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":0.83499999999999996,"15min":0.73799999999999999},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":15.461,"5min":15.461,"15min":15.461},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.78400000000000003,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":5.5499999999999998,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.87},{"interface":"front","average":{"1min":1.117,"5min":0.82799999999999996,"15min":0.78500000000000003},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":8.0670000000000002,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24484,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":22208,"kb_avail":94347356,"statfs":{"total":96636764160,"available":96611692544,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22740992},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.44900000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.23699999999999999},"max":{"1min":0.53700000000000003,"5min":0.61499999999999999,"15min":4.75},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41599999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":9.3100000000000005},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":2.7160000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.496},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45900000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57599999999999996,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.94499999999999995,"5min":1.1639999999999999,"15min":2.181},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.70799999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.92400000000000004,"5min":1.014,"15min":2.4180000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.45400000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.55300000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95999999999999996,"5min":1.085,"15min":2.052},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.77500000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95699999999999996,"5min":1.1419999999999999,"15min":2.016},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.59899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23076,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94348764,"statfs":{"total":96636764160,"available":96613134336,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.245},"max":{"1min":0.56399999999999995,"5min":1.954,"15min":1.954},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41099999999999998,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45900000000000002,"15min":0.46500000000000002},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52000000000000002,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.57699999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.624}]},{"osd":4,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.55000000000000004,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71599999999999997},"min":{"1min":0.59199999999999997,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":1.034,"5min":1.0489999999999999,"15min":1.25},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.6020000000000001},"last":1.0149999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.498},"max":{"1min":0.88700000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.22},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.109,"5min":2.141,"15min":2.141},"last":1.004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.63700000000000001,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":0.93999999999999995,"5min":1.125,"15min":1.2370000000000001},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26660,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":24384,"kb_avail":94345180,"statfs":{"total":96636764160,"available":96609464320,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24969216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.77100000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.42499999999999999,"15min":0.45800000000000002},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57199999999999995,"5min":0.60999999999999999,"15min":1.1899999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.624,"5min":0.64700000000000002,"15min":0.96399999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.68999999999999995,"15min":5.601},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.83499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":1.002,"15min":1.353},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.42999999999999999},"max":{"1min":0.78800000000000003,"5min":0.90600000000000003,"15min":1.849},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":0.95399999999999996,"5min":0.95499999999999996,"15min":6.9660000000000002},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.57299999999999995,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":1.163,"15min":1.163},"last":0.751},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.58199999999999996,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":1.04,"15min":1.772},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.58099999999999996,"5min":0.48199999999999998,"15min":0.42499999999999999},"max":{"1min":0.84799999999999998,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72399999999999998,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":1.105,"15min":3.1360000000000001},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.024,"5min":1.024,"15min":1.8089999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":1.0569999999999999,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.94999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":20608,"kb_avail":94348956,"statfs":{"total":96636764160,"available":96613330944,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21102592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.52300000000000002,"5min":0.66800000000000004,"15min":1.202},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.42999999999999999},"min":{"1min":0.32700000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":1.302},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.371},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":0.64300000000000002,"15min":1.2390000000000001},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.626,"5min":0.69199999999999995,"15min":1.8029999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68899999999999995},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":0.97399999999999998,"15min":1.149},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.85899999999999999,"5min":0.94099999999999995,"15min":5.1059999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.59999999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":1.232},"last":0.63},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.298},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.55000000000000004,"5min":0.501,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.343},"last":0.504}]},{"osd":7,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.94199999999999995,"5min":1.115,"15min":2.048},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.93100000000000005,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17688,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":15424,"kb_avail":94354152,"statfs":{"total":96636764160,"available":96618651648,"internally_reserved":0,"allocated":2310144,"data_stored":1091155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15794176},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.5,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.876,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":3.419,"15min":4.4409999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":2.3010000000000002,"15min":4.476},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94099999999999995,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85099999999999998,"5min":3.48,"15min":4.3949999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.40600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79000000000000004,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":3.8620000000000001,"15min":5.194},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.56000000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":2.387,"15min":5.5990000000000002},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.59299999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0960000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25828,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":23552,"kb_avail":94346012,"statfs":{"total":96636764160,"available":96610316288,"internally_reserved":0,"allocated":2322432,"data_stored":1097376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24117248},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.443,"5min":0.35499999999999998,"15min":0.317},"max":{"1min":0.874,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58599999999999997,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84099999999999997,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.747}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.69099999999999995},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.377},"max":{"1min":0.94599999999999995,"5min":1.026,"15min":6.7489999999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.878,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":0.81699999999999995,"5min":0.98799999999999999,"15min":1.581},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.66100000000000003},"min":{"1min":0.51800000000000002,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":0.92500000000000004,"5min":0.98999999999999999,"15min":3.8220000000000001},"last":0.877}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.67400000000000004},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.77200000000000002,"5min":0.89800000000000002,"15min":9.6920000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":1.978},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.86299999999999999,"5min":1.115,"15min":1.9419999999999999},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:38:59.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3c is not active+clean 2023-07-27T14:38:59.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3f is not active+clean 2023-07-27T14:38:59.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707322+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T14:38:59.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3d is not active+clean 2023-07-27T14:38:59.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2023-07-27T14:38:59.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706426+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3e is not active+clean 2023-07-27T14:38:59.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3d is not active+clean 2023-07-27T14:38:59.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.704032+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T14:38:59.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3f is not active+clean 2023-07-27T14:38:59.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2023-07-27T14:38:59.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706993+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.38 is not active+clean 2023-07-27T14:38:59.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3b is not active+clean 2023-07-27T14:38:59.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705659+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.39 is not active+clean 2023-07-27T14:38:59.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3a is not active+clean 2023-07-27T14:38:59.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.703875+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T14:38:59.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3a is not active+clean 2023-07-27T14:38:59.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.39 is not active+clean 2023-07-27T14:38:59.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.712778+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T14:38:59.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3b is not active+clean 2023-07-27T14:38:59.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.38 is not active+clean 2023-07-27T14:38:59.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707431+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T14:38:59.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.34 is not active+clean 2023-07-27T14:38:59.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2023-07-27T14:38:59.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.710549+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T14:38:59.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.35 is not active+clean 2023-07-27T14:38:59.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.36 is not active+clean 2023-07-27T14:38:59.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707676+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.36 is not active+clean 2023-07-27T14:38:59.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.35 is not active+clean 2023-07-27T14:38:59.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.711681+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T14:38:59.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.37 is not active+clean 2023-07-27T14:38:59.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2023-07-27T14:38:59.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705844+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.30 is not active+clean 2023-07-27T14:38:59.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2023-07-27T14:38:59.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706759+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.31 is not active+clean 2023-07-27T14:38:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2023-07-27T14:38:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.708330+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T14:38:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.32 is not active+clean 2023-07-27T14:38:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2023-07-27T14:38:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705783+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.33 is not active+clean 2023-07-27T14:38:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.30 is not active+clean 2023-07-27T14:38:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707008+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T14:38:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2c is not active+clean 2023-07-27T14:38:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2f is not active+clean 2023-07-27T14:38:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705904+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2d is not active+clean 2023-07-27T14:38:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2e is not active+clean 2023-07-27T14:38:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706787+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T14:38:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2e is not active+clean 2023-07-27T14:38:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2d is not active+clean 2023-07-27T14:38:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706586+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2f is not active+clean 2023-07-27T14:38:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2c is not active+clean 2023-07-27T14:38:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705705+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.28 is not active+clean 2023-07-27T14:38:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2b is not active+clean 2023-07-27T14:38:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705238+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.29 is not active+clean 2023-07-27T14:38:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2a is not active+clean 2023-07-27T14:38:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.709432+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2a is not active+clean 2023-07-27T14:38:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.29 is not active+clean 2023-07-27T14:38:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.703229+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T14:38:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2b is not active+clean 2023-07-27T14:38:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.28 is not active+clean 2023-07-27T14:38:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706595+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T14:38:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.24 is not active+clean 2023-07-27T14:38:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2023-07-27T14:38:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707600+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.25 is not active+clean 2023-07-27T14:38:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.26 is not active+clean 2023-07-27T14:38:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.711457+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T14:38:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.26 is not active+clean 2023-07-27T14:38:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.25 is not active+clean 2023-07-27T14:38:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.702729+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T14:38:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.27 is not active+clean 2023-07-27T14:38:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.24 is not active+clean 2023-07-27T14:38:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705249+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.20 is not active+clean 2023-07-27T14:38:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2023-07-27T14:38:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705987+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.21 is not active+clean 2023-07-27T14:38:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2023-07-27T14:38:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706884+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T14:38:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.22 is not active+clean 2023-07-27T14:38:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.21 is not active+clean 2023-07-27T14:38:59.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.702653+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T14:38:59.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.23 is not active+clean 2023-07-27T14:38:59.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.20 is not active+clean 2023-07-27T14:38:59.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705166+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.14 is not active+clean 2023-07-27T14:38:59.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.17 is not active+clean 2023-07-27T14:38:59.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707064+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T14:38:59.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.15 is not active+clean 2023-07-27T14:38:59.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.16 is not active+clean 2023-07-27T14:38:59.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.703643+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T14:38:59.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.16 is not active+clean 2023-07-27T14:38:59.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.15 is not active+clean 2023-07-27T14:38:59.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706095+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.17 is not active+clean 2023-07-27T14:38:59.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.14 is not active+clean 2023-07-27T14:38:59.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.711467+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T14:38:59.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.10 is not active+clean 2023-07-27T14:38:59.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.13 is not active+clean 2023-07-27T14:38:59.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.712282+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T14:38:59.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.11 is not active+clean 2023-07-27T14:38:59.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.12 is not active+clean 2023-07-27T14:38:59.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.702699+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-27T14:38:59.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.12 is not active+clean 2023-07-27T14:38:59.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.11 is not active+clean 2023-07-27T14:38:59.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707525+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.13 is not active+clean 2023-07-27T14:38:59.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2023-07-27T14:38:59.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.708990+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T14:38:59.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.c is not active+clean 2023-07-27T14:38:59.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2023-07-27T14:38:59.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.709445+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T14:38:59.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.d is not active+clean 2023-07-27T14:38:59.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.e is not active+clean 2023-07-27T14:38:59.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707100+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.e is not active+clean 2023-07-27T14:38:59.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2023-07-27T14:38:59.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706241+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.f is not active+clean 2023-07-27T14:38:59.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2023-07-27T14:38:59.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706855+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T14:38:59.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.8 is not active+clean 2023-07-27T14:38:59.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.b is not active+clean 2023-07-27T14:38:59.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.711855+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T14:38:59.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.9 is not active+clean 2023-07-27T14:38:59.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.a is not active+clean 2023-07-27T14:38:59.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.708671+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.a is not active+clean 2023-07-27T14:38:59.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.9 is not active+clean 2023-07-27T14:38:59.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706484+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.b is not active+clean 2023-07-27T14:38:59.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2023-07-27T14:38:59.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706527+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.4 is not active+clean 2023-07-27T14:38:59.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.7 is not active+clean 2023-07-27T14:38:59.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707898+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.5 is not active+clean 2023-07-27T14:38:59.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.6 is not active+clean 2023-07-27T14:38:59.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705628+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.6 is not active+clean 2023-07-27T14:38:59.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.5 is not active+clean 2023-07-27T14:38:59.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706444+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T14:38:59.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.7 is not active+clean 2023-07-27T14:38:59.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.4 is not active+clean 2023-07-27T14:38:59.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.708171+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T14:38:59.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.0 is not active+clean 2023-07-27T14:38:59.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3 is not active+clean 2023-07-27T14:38:59.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706644+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T14:38:59.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1 is not active+clean 2023-07-27T14:38:59.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2 is not active+clean 2023-07-27T14:38:59.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707793+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-27T14:38:59.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2 is not active+clean 2023-07-27T14:38:59.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1 is not active+clean 2023-07-27T14:38:59.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706056+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-27T14:38:59.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3 is not active+clean 2023-07-27T14:38:59.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2023-07-27T14:38:59.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.705836+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-27T14:38:59.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1c is not active+clean 2023-07-27T14:38:59.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1f is not active+clean 2023-07-27T14:38:59.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.708337+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1a is not active+clean 2023-07-27T14:38:59.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.19 is not active+clean 2023-07-27T14:38:59.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.711379+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T14:38:59.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.19 is not active+clean 2023-07-27T14:38:59.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1a is not active+clean 2023-07-27T14:38:59.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.709038+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1b is not active+clean 2023-07-27T14:38:59.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.18 is not active+clean 2023-07-27T14:38:59.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.706104+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-27T14:38:59.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.18 is not active+clean 2023-07-27T14:38:59.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1b is not active+clean 2023-07-27T14:38:59.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707645+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T14:38:59.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1d is not active+clean 2023-07-27T14:38:59.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1e is not active+clean 2023-07-27T14:38:59.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.707526+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-27T14:38:59.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1e is not active+clean 2023-07-27T14:38:59.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2023-07-27T14:38:59.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.708044+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-27T14:38:59.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1f is not active+clean 2023-07-27T14:38:59.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:38:53.698957+0000', 'last_change': '2023-07-27T14:38:53.698957+0000', 'last_active': '2023-07-27T14:38:53.698957+0000', 'last_peered': '2023-07-27T14:38:53.698957+0000', 'last_clean': '2023-07-27T14:38:53.698957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:53.698957+0000', 'last_undegraded': '2023-07-27T14:38:53.698957+0000', 'last_fullsized': '2023-07-27T14:38:53.698957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:53.698957+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:38:59.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1c is not active+clean 2023-07-27T14:38:59.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-07-27T14:38:52.696298+0000', 'last_change': '2023-07-27T14:38:52.711965+0000', 'last_active': '2023-07-27T14:38:52.696298+0000', 'last_peered': '2023-07-27T14:38:52.696298+0000', 'last_clean': '2023-07-27T14:38:52.696298+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:38:52.696298+0000', 'last_undegraded': '2023-07-27T14:38:52.696298+0000', 'last_fullsized': '2023-07-27T14:38:52.696298+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'last_clean_scrub_stamp': '2023-07-27T14:38:52.696298+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-27T14:38:59.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-27T14:38:59.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.628+0000 7f5e311ff700 1 Processor -- start 2023-07-27T14:38:59.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.629+0000 7f5e311ff700 1 -- start start 2023-07-27T14:38:59.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.630+0000 7f5e311ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c1540e0 0x7f5e2c0a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.630+0000 7f5e311ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5e2c0c5d80 0x7f5e2c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.630+0000 7f5e311ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c0c9a80 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.630+0000 7f5e311ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c8e70 con 0x7f5e2c0c5d80 2023-07-27T14:38:59.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.630+0000 7f5e311ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c9150 con 0x7f5e2c1540e0 2023-07-27T14:38:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e2a59c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5e2c0c5d80 0x7f5e2c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e2a59c700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5e2c0c5d80 0x7f5e2c0c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:36978/0 (socket says 172.21.15.115:36978) 2023-07-27T14:38:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e2b59e700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f5e2c0c9f10 0x7f5e2c0ca390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:50952/0 (socket says 172.21.15.115:50952) 2023-07-27T14:38:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e2ad9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c1540e0 0x7f5e2c0a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e2a59c700 1 -- 172.21.15.115:0/1831176913 learned_addr learned my addr 172.21.15.115:0/1831176913 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e2a59c700 1 -- 172.21.15.115:0/1831176913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c1540e0 msgr2=0x7f5e2c0a79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:38:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e2a59c700 1 --2- 172.21.15.115:0/1831176913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c1540e0 0x7f5e2c0a79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e2a59c700 1 -- 172.21.15.115:0/1831176913 >> v1:172.21.15.159:6789/0 conn(0x7f5e2c0c9f10 legacy=0x7f5e2c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.631+0000 7f5e29d9b700 1 -- 172.21.15.115:0/1831176913 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007304642 0 0) 0x7f5e2c0c9a80 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.632+0000 7f5e2a59c700 1 -- 172.21.15.115:0/1831176913 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0c9430 con 0x7f5e2c0c5d80 2023-07-27T14:38:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.632+0000 7f5e2a59c700 1 --2- 172.21.15.115:0/1831176913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c0c5d80 0x7f5e2c0c61e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f5e20006fd0 tx=0x7f5e200090f0).ready entity=mon.1 client_cookie=1f0298384aa54b4b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:59.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.632+0000 7f5e29d9b700 1 -- 172.21.15.115:0/1831176913 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000b580 con 0x7f5e2c0c5d80 2023-07-27T14:38:59.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.632+0000 7f5e29d9b700 1 -- 172.21.15.115:0/1831176913 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000b6e0 con 0x7f5e2c0c5d80 2023-07-27T14:38:59.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.632+0000 7f5e29d9b700 1 -- 172.21.15.115:0/1831176913 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000ba60 con 0x7f5e2c0c5d80 2023-07-27T14:38:59.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.632+0000 7f5e311ff700 1 -- 172.21.15.115:0/1831176913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c0c5d80 msgr2=0x7f5e2c0c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.632+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1831176913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c0c5d80 0x7f5e2c0c61e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f5e20006fd0 tx=0x7f5e200090f0).stop 2023-07-27T14:38:59.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.633+0000 7f5e311ff700 1 -- 172.21.15.115:0/1831176913 shutdown_connections 2023-07-27T14:38:59.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.633+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1831176913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c1540e0 0x7f5e2c0a79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.633+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1831176913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c0c5d80 0x7f5e2c0c61e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.633+0000 7f5e311ff700 1 -- 172.21.15.115:0/1831176913 >> 172.21.15.115:0/1831176913 conn(0x7f5e2c05e650 msgr2=0x7f5e2c0cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.633+0000 7f5e311ff700 1 -- 172.21.15.115:0/1831176913 shutdown_connections 2023-07-27T14:38:59.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.633+0000 7f5e311ff700 1 -- 172.21.15.115:0/1831176913 wait complete. 2023-07-27T14:38:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.634+0000 7f5e311ff700 1 Processor -- start 2023-07-27T14:38:59.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.634+0000 7f5e311ff700 1 -- start start 2023-07-27T14:38:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e311ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c0c5d80 0x7f5e2c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e311ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e2c0c9f10 0x7f5e2c0c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e311ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c1540e0 0x7f5e2c14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e311ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0aed80 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e311ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0ae4e0 con 0x7f5e2c1540e0 2023-07-27T14:38:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e311ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0ae7c0 con 0x7f5e2c0c5d80 2023-07-27T14:38:59.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e2a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e2c0c9f10 0x7f5e2c0c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e2a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e2c0c9f10 0x7f5e2c0c07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35866/0 (socket says 172.21.15.115:35866) 2023-07-27T14:38:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.635+0000 7f5e2a59c700 1 -- 172.21.15.115:0/1739116866 learned_addr learned my addr 172.21.15.115:0/1739116866 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:38:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e2ad9d700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c0c5d80 0x7f5e2c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e2b59e700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c1540e0 0x7f5e2c14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e2a59c700 1 -- 172.21.15.115:0/1739116866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c0c5d80 msgr2=0x7f5e2c0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e2a59c700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c0c5d80 0x7f5e2c0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e2a59c700 1 -- 172.21.15.115:0/1739116866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c1540e0 msgr2=0x7f5e2c14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e2a59c700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c1540e0 0x7f5e2c14e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e2a59c700 1 -- 172.21.15.115:0/1739116866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20009370 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e2a59c700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e2c0c9f10 0x7f5e2c0c07c0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f5e20009130 tx=0x7f5e20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e12ffd700 1 -- 172.21.15.115:0/1739116866 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000b850 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e12ffd700 1 -- 172.21.15.115:0/1739116866 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000b9d0 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2c0aeaa0 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.636+0000 7f5e12ffd700 1 -- 172.21.15.115:0/1739116866 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2001c670 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.637+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c0ae0a0 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.638+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2c154720 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.639+0000 7f5e12ffd700 1 -- 172.21.15.115:0/1739116866 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f5e2002c070 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.639+0000 7f5e12ffd700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e1805fb50 0x7f5e18062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:38:59.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.639+0000 7f5e12ffd700 1 -- 172.21.15.115:0/1739116866 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5e2007cba0 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.640+0000 7f5e2ad9d700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e1805fb50 0x7f5e18062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:38:59.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.640+0000 7f5e2ad9d700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e1805fb50 0x7f5e18062010 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f5e1c009b90 tx=0x7f5e1c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:38:59.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.643+0000 7f5e12ffd700 1 -- 172.21.15.115:0/1739116866 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5e2004d380 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.880+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5e2c06c470 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.881+0000 7f5e12ffd700 1 -- 172.21.15.115:0/1739116866 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1112 (secure 0 0 0) 0x7f5e2002a020 con 0x7f5e2c0c9f10 2023-07-27T14:38:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:38:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:{"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":738,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":188,"num_osds":8,"num_up_osds":8,"osd_up_since":1690468012,"num_in_osds":8,"osd_in_since":1690468005,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":193286144,"bytes_avail":772900827136,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":102,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"a","status":"up:active","gid":9780}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-07-27T14:37:33.581548+0000","services":{}},"progress_events":{}} 2023-07-27T14:38:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e1805fb50 msgr2=0x7f5e18062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e1805fb50 0x7f5e18062010 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f5e1c009b90 tx=0x7f5e1c009060).stop 2023-07-27T14:38:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e2c0c9f10 msgr2=0x7f5e2c0c07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:38:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e2c0c9f10 0x7f5e2c0c07c0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f5e20009130 tx=0x7f5e20017000).stop 2023-07-27T14:38:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 shutdown_connections 2023-07-27T14:38:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e1805fb50 0x7f5e18062010 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e2c1540e0 0x7f5e2c14e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e2c0c5d80 0x7f5e2c0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 --2- 172.21.15.115:0/1739116866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e2c0c9f10 0x7f5e2c0c07c0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:38:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 >> 172.21.15.115:0/1739116866 conn(0x7f5e2c05e650 msgr2=0x7f5e2c1520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:38:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 shutdown_connections 2023-07-27T14:38:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:38:59.883+0000 7f5e311ff700 1 -- 172.21.15.115:0/1739116866 wait complete. 2023-07-27T14:38:59.954 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-27T14:38:59.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:39:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.089+0000 7f576cfff700 1 Processor -- start 2023-07-27T14:39:00.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.090+0000 7f576cfff700 1 -- start start 2023-07-27T14:39:00.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.091+0000 7f576cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f57680a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:00.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.091+0000 7f576cfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57680aaa40 0x7f57680c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:00.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.091+0000 7f576cfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57680aa4d0 con 0x7f57680aa050 2023-07-27T14:39:00.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.091+0000 7f576cfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57680c05c0 con 0x7f57680aaa40 2023-07-27T14:39:00.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.091+0000 7f576cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680bfc90 con 0x7f5768153ec0 2023-07-27T14:39:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.091+0000 7f5766d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57680aaa40 0x7f57680c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.091+0000 7f5766d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57680aaa40 0x7f57680c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35880/0 (socket says 172.21.15.115:35880) 2023-07-27T14:39:00.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.091+0000 7f5766d9d700 1 -- 172.21.15.115:0/463269659 learned_addr learned my addr 172.21.15.115:0/463269659 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f5766d9d700 1 -- 172.21.15.115:0/463269659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 msgr2=0x7f57680a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f576659c700 1 --2- 172.21.15.115:0/463269659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f57680a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f5766d9d700 1 --2- 172.21.15.115:0/463269659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f57680a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f5766d9d700 1 -- 172.21.15.115:0/463269659 >> v1:172.21.15.159:6789/0 conn(0x7f57680aa050 legacy=0x7f57680640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f5766d9d700 1 -- 172.21.15.115:0/463269659 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680bff70 con 0x7f57680aaa40 2023-07-27T14:39:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f576659c700 1 --2- 172.21.15.115:0/463269659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f57680a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f5766d9d700 1 --2- 172.21.15.115:0/463269659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aaa40 0x7f57680c0a50 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f5760009f20 tx=0x7f5760009840).ready entity=mon.0 client_cookie=280158a6c0c17ff6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:00.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f576559a700 1 -- 172.21.15.115:0/463269659 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000e070 con 0x7f57680aaa40 2023-07-27T14:39:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f576559a700 1 -- 172.21.15.115:0/463269659 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576000ba40 con 0x7f57680aaa40 2023-07-27T14:39:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f576559a700 1 -- 172.21.15.115:0/463269659 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000bdc0 con 0x7f57680aaa40 2023-07-27T14:39:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f576cfff700 1 -- 172.21.15.115:0/463269659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aaa40 msgr2=0x7f57680c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.092+0000 7f576cfff700 1 --2- 172.21.15.115:0/463269659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aaa40 0x7f57680c0a50 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f5760009f20 tx=0x7f5760009840).stop 2023-07-27T14:39:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.093+0000 7f576cfff700 1 -- 172.21.15.115:0/463269659 shutdown_connections 2023-07-27T14:39:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.093+0000 7f576cfff700 1 --2- 172.21.15.115:0/463269659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f57680a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.093+0000 7f576cfff700 1 --2- 172.21.15.115:0/463269659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aaa40 0x7f57680c0a50 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.093+0000 7f576cfff700 1 -- 172.21.15.115:0/463269659 >> 172.21.15.115:0/463269659 conn(0x7f57680cb610 msgr2=0x7f57680c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:00.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.093+0000 7f576cfff700 1 -- 172.21.15.115:0/463269659 shutdown_connections 2023-07-27T14:39:00.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.093+0000 7f576cfff700 1 -- 172.21.15.115:0/463269659 wait complete. 2023-07-27T14:39:00.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.094+0000 7f576cfff700 1 Processor -- start 2023-07-27T14:39:00.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.094+0000 7f576cfff700 1 -- start start 2023-07-27T14:39:00.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aa050 0x7f57680c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576cfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57680aaa40 0x7f57680c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576cfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f5768150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680c3dd0 con 0x7f57680aa050 2023-07-27T14:39:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576cfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576814f1d0 con 0x7f57680aaa40 2023-07-27T14:39:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576cfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680c31c0 con 0x7f5768153ec0 2023-07-27T14:39:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aa050 0x7f57680c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aa050 0x7f57680c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35886/0 (socket says 172.21.15.115:35886) 2023-07-27T14:39:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f576659c700 1 -- 172.21.15.115:0/325194053 learned_addr learned my addr 172.21.15.115:0/325194053 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f5766d9d700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f5768150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.095+0000 7f5765d9b700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57680aaa40 0x7f57680c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f576659c700 1 -- 172.21.15.115:0/325194053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 msgr2=0x7f5768150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f576659c700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f5768150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f576659c700 1 -- 172.21.15.115:0/325194053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57680aaa40 msgr2=0x7f57680c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f576659c700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57680aaa40 0x7f57680c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f576659c700 1 -- 172.21.15.115:0/325194053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760009ae0 con 0x7f57680aa050 2023-07-27T14:39:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f576659c700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aa050 0x7f57680c4260 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f575800c880 tx=0x7f5758008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f57567fc700 1 -- 172.21.15.115:0/325194053 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758010580 con 0x7f57680aa050 2023-07-27T14:39:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f57567fc700 1 -- 172.21.15.115:0/325194053 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57580106e0 con 0x7f57680aa050 2023-07-27T14:39:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57680c34a0 con 0x7f57680aa050 2023-07-27T14:39:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f57567fc700 1 -- 172.21.15.115:0/325194053 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758010a60 con 0x7f57680aa050 2023-07-27T14:39:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.096+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57680c3a60 con 0x7f57680aa050 2023-07-27T14:39:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.097+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5768083e60 con 0x7f57680aa050 2023-07-27T14:39:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.098+0000 7f57567fc700 1 -- 172.21.15.115:0/325194053 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f575801b460 con 0x7f57680aa050 2023-07-27T14:39:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.099+0000 7f57567fc700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f574805fb50 0x7f5748062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.099+0000 7f57567fc700 1 -- 172.21.15.115:0/325194053 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f575807b040 con 0x7f57680aa050 2023-07-27T14:39:00.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.099+0000 7f5765d9b700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f574805fb50 0x7f5748062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:00.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.100+0000 7f5765d9b700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f574805fb50 0x7f5748062010 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f576815b220 tx=0x7f575c007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:00.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.103+0000 7f57567fc700 1 -- 172.21.15.115:0/325194053 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f575804b7c0 con 0x7f57680aa050 2023-07-27T14:39:00.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.269+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57680c4f90 con 0x7f574805fb50 2023-07-27T14:39:00.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.279+0000 7f57567fc700 1 -- 172.21.15.115:0/325194053 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361970 (secure 0 0 0) 0x7f575c0034f0 con 0x7f574805fb50 2023-07-27T14:39:00.340 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:00.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f574805fb50 msgr2=0x7f5748062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:00.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f574805fb50 0x7f5748062010 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f576815b220 tx=0x7f575c007d40).stop 2023-07-27T14:39:00.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aa050 msgr2=0x7f57680c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:00.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aa050 0x7f57680c4260 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f575800c880 tx=0x7f5758008040).stop 2023-07-27T14:39:00.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 shutdown_connections 2023-07-27T14:39:00.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f574805fb50 0x7f5748062010 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5768153ec0 0x7f5768150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57680aa050 0x7f57680c4260 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 --2- 172.21.15.115:0/325194053 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57680aaa40 0x7f57680c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:00.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 >> 172.21.15.115:0/325194053 conn(0x7f57680cb610 msgr2=0x7f57680c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:00.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 shutdown_connections 2023-07-27T14:39:00.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:00.284+0000 7f576cfff700 1 -- 172.21.15.115:0/325194053 wait complete. 2023-07-27T14:39:00.347 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:39:00.355 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2023-07-27T14:38:59.601033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":247,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":190528,"kb_used_data":18496,"kb_used_omap":0,"kb_used_meta":171968,"kb_avail":754784192,"statfs":{"total":773094113280,"available":772899012608,"internally_reserved":0,"allocated":18939904,"data_stored":8948116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":176095232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-516379,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-22,"num_read_kb":-8206,"num_write":-232,"num_write_kb":-16981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.273618"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183911+0000","last_change":"2023-07-27T14:38:54.179389+0000","last_active":"2023-07-27T14:38:54.183911+0000","last_peered":"2023-07-27T14:38:54.183911+0000","last_clean":"2023-07-27T14:38:54.183911+0000","last_became_active":"2023-07-27T14:38:54.179115+0000","last_became_peered":"2023-07-27T14:38:54.179115+0000","last_unstale":"2023-07-27T14:38:54.183911+0000","last_undegraded":"2023-07-27T14:38:54.183911+0000","last_fullsized":"2023-07-27T14:38:54.183911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"187'3","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201685+0000","last_change":"2023-07-27T14:38:53.718050+0000","last_active":"2023-07-27T14:38:54.201685+0000","last_peered":"2023-07-27T14:38:54.201685+0000","last_clean":"2023-07-27T14:38:54.201685+0000","last_became_active":"2023-07-27T14:38:53.717750+0000","last_became_peered":"2023-07-27T14:38:53.717750+0000","last_unstale":"2023-07-27T14:38:54.201685+0000","last_undegraded":"2023-07-27T14:38:54.201685+0000","last_fullsized":"2023-07-27T14:38:54.201685+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198066+0000","last_change":"2023-07-27T14:38:54.196191+0000","last_active":"2023-07-27T14:38:54.198066+0000","last_peered":"2023-07-27T14:38:54.198066+0000","last_clean":"2023-07-27T14:38:54.198066+0000","last_became_active":"2023-07-27T14:38:54.195678+0000","last_became_peered":"2023-07-27T14:38:54.195678+0000","last_unstale":"2023-07-27T14:38:54.198066+0000","last_undegraded":"2023-07-27T14:38:54.198066+0000","last_fullsized":"2023-07-27T14:38:54.198066+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183320+0000","last_change":"2023-07-27T14:38:53.736258+0000","last_active":"2023-07-27T14:38:54.183320+0000","last_peered":"2023-07-27T14:38:54.183320+0000","last_clean":"2023-07-27T14:38:54.183320+0000","last_became_active":"2023-07-27T14:38:53.735931+0000","last_became_peered":"2023-07-27T14:38:53.735931+0000","last_unstale":"2023-07-27T14:38:54.183320+0000","last_undegraded":"2023-07-27T14:38:54.183320+0000","last_fullsized":"2023-07-27T14:38:54.183320+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199773+0000","last_change":"2023-07-27T14:38:54.195098+0000","last_active":"2023-07-27T14:38:54.199773+0000","last_peered":"2023-07-27T14:38:54.199773+0000","last_clean":"2023-07-27T14:38:54.199773+0000","last_became_active":"2023-07-27T14:38:54.194834+0000","last_became_peered":"2023-07-27T14:38:54.194834+0000","last_unstale":"2023-07-27T14:38:54.199773+0000","last_undegraded":"2023-07-27T14:38:54.199773+0000","last_fullsized":"2023-07-27T14:38:54.199773+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176779+0000","last_change":"2023-07-27T14:38:53.722691+0000","last_active":"2023-07-27T14:38:54.176779+0000","last_peered":"2023-07-27T14:38:54.176779+0000","last_clean":"2023-07-27T14:38:54.176779+0000","last_became_active":"2023-07-27T14:38:53.722417+0000","last_became_peered":"2023-07-27T14:38:53.722417+0000","last_unstale":"2023-07-27T14:38:54.176779+0000","last_undegraded":"2023-07-27T14:38:54.176779+0000","last_fullsized":"2023-07-27T14:38:54.176779+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198944+0000","last_change":"2023-07-27T14:38:54.192767+0000","last_active":"2023-07-27T14:38:54.198944+0000","last_peered":"2023-07-27T14:38:54.198944+0000","last_clean":"2023-07-27T14:38:54.198944+0000","last_became_active":"2023-07-27T14:38:54.192461+0000","last_became_peered":"2023-07-27T14:38:54.192461+0000","last_unstale":"2023-07-27T14:38:54.198944+0000","last_undegraded":"2023-07-27T14:38:54.198944+0000","last_fullsized":"2023-07-27T14:38:54.198944+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.191821+0000","last_change":"2023-07-27T14:38:53.737308+0000","last_active":"2023-07-27T14:38:54.191821+0000","last_peered":"2023-07-27T14:38:54.191821+0000","last_clean":"2023-07-27T14:38:54.191821+0000","last_became_active":"2023-07-27T14:38:53.737082+0000","last_became_peered":"2023-07-27T14:38:53.737082+0000","last_unstale":"2023-07-27T14:38:54.191821+0000","last_undegraded":"2023-07-27T14:38:54.191821+0000","last_fullsized":"2023-07-27T14:38:54.191821+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.203919+0000","last_change":"2023-07-27T14:38:54.202994+0000","last_active":"2023-07-27T14:38:54.203919+0000","last_peered":"2023-07-27T14:38:54.203919+0000","last_clean":"2023-07-27T14:38:54.203919+0000","last_became_active":"2023-07-27T14:38:54.202700+0000","last_became_peered":"2023-07-27T14:38:54.202700+0000","last_unstale":"2023-07-27T14:38:54.203919+0000","last_undegraded":"2023-07-27T14:38:54.203919+0000","last_fullsized":"2023-07-27T14:38:54.203919+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201633+0000","last_change":"2023-07-27T14:38:53.721630+0000","last_active":"2023-07-27T14:38:54.201633+0000","last_peered":"2023-07-27T14:38:54.201633+0000","last_clean":"2023-07-27T14:38:54.201633+0000","last_became_active":"2023-07-27T14:38:53.721159+0000","last_became_peered":"2023-07-27T14:38:53.721159+0000","last_unstale":"2023-07-27T14:38:54.201633+0000","last_undegraded":"2023-07-27T14:38:54.201633+0000","last_fullsized":"2023-07-27T14:38:54.201633+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201104+0000","last_change":"2023-07-27T14:38:54.199834+0000","last_active":"2023-07-27T14:38:54.201104+0000","last_peered":"2023-07-27T14:38:54.201104+0000","last_clean":"2023-07-27T14:38:54.201104+0000","last_became_active":"2023-07-27T14:38:54.199566+0000","last_became_peered":"2023-07-27T14:38:54.199566+0000","last_unstale":"2023-07-27T14:38:54.201104+0000","last_undegraded":"2023-07-27T14:38:54.201104+0000","last_fullsized":"2023-07-27T14:38:54.201104+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199099+0000","last_change":"2023-07-27T14:38:53.727159+0000","last_active":"2023-07-27T14:38:54.199099+0000","last_peered":"2023-07-27T14:38:54.199099+0000","last_clean":"2023-07-27T14:38:54.199099+0000","last_became_active":"2023-07-27T14:38:53.726889+0000","last_became_peered":"2023-07-27T14:38:53.726889+0000","last_unstale":"2023-07-27T14:38:54.199099+0000","last_undegraded":"2023-07-27T14:38:54.199099+0000","last_fullsized":"2023-07-27T14:38:54.199099+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199969+0000","last_change":"2023-07-27T14:38:54.191435+0000","last_active":"2023-07-27T14:38:54.199969+0000","last_peered":"2023-07-27T14:38:54.199969+0000","last_clean":"2023-07-27T14:38:54.199969+0000","last_became_active":"2023-07-27T14:38:54.191101+0000","last_became_peered":"2023-07-27T14:38:54.191101+0000","last_unstale":"2023-07-27T14:38:54.199969+0000","last_undegraded":"2023-07-27T14:38:54.199969+0000","last_fullsized":"2023-07-27T14:38:54.199969+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.173841+0000","last_change":"2023-07-27T14:38:53.723397+0000","last_active":"2023-07-27T14:38:54.173841+0000","last_peered":"2023-07-27T14:38:54.173841+0000","last_clean":"2023-07-27T14:38:54.173841+0000","last_became_active":"2023-07-27T14:38:53.723124+0000","last_became_peered":"2023-07-27T14:38:53.723124+0000","last_unstale":"2023-07-27T14:38:54.173841+0000","last_undegraded":"2023-07-27T14:38:54.173841+0000","last_fullsized":"2023-07-27T14:38:54.173841+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197370+0000","last_change":"2023-07-27T14:38:54.191335+0000","last_active":"2023-07-27T14:38:54.197370+0000","last_peered":"2023-07-27T14:38:54.197370+0000","last_clean":"2023-07-27T14:38:54.197370+0000","last_became_active":"2023-07-27T14:38:54.190891+0000","last_became_peered":"2023-07-27T14:38:54.190891+0000","last_unstale":"2023-07-27T14:38:54.197370+0000","last_undegraded":"2023-07-27T14:38:54.197370+0000","last_fullsized":"2023-07-27T14:38:54.197370+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175404+0000","last_change":"2023-07-27T14:38:53.734570+0000","last_active":"2023-07-27T14:38:54.175404+0000","last_peered":"2023-07-27T14:38:54.175404+0000","last_clean":"2023-07-27T14:38:54.175404+0000","last_became_active":"2023-07-27T14:38:53.734032+0000","last_became_peered":"2023-07-27T14:38:53.734032+0000","last_unstale":"2023-07-27T14:38:54.175404+0000","last_undegraded":"2023-07-27T14:38:54.175404+0000","last_fullsized":"2023-07-27T14:38:54.175404+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198864+0000","last_change":"2023-07-27T14:38:54.196698+0000","last_active":"2023-07-27T14:38:54.198864+0000","last_peered":"2023-07-27T14:38:54.198864+0000","last_clean":"2023-07-27T14:38:54.198864+0000","last_became_active":"2023-07-27T14:38:54.196473+0000","last_became_peered":"2023-07-27T14:38:54.196473+0000","last_unstale":"2023-07-27T14:38:54.198864+0000","last_undegraded":"2023-07-27T14:38:54.198864+0000","last_fullsized":"2023-07-27T14:38:54.198864+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175867+0000","last_change":"2023-07-27T14:38:53.725422+0000","last_active":"2023-07-27T14:38:54.175867+0000","last_peered":"2023-07-27T14:38:54.175867+0000","last_clean":"2023-07-27T14:38:54.175867+0000","last_became_active":"2023-07-27T14:38:53.725145+0000","last_became_peered":"2023-07-27T14:38:53.725145+0000","last_unstale":"2023-07-27T14:38:54.175867+0000","last_undegraded":"2023-07-27T14:38:54.175867+0000","last_fullsized":"2023-07-27T14:38:54.175867+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201851+0000","last_change":"2023-07-27T14:38:54.190341+0000","last_active":"2023-07-27T14:38:54.201851+0000","last_peered":"2023-07-27T14:38:54.201851+0000","last_clean":"2023-07-27T14:38:54.201851+0000","last_became_active":"2023-07-27T14:38:54.190078+0000","last_became_peered":"2023-07-27T14:38:54.190078+0000","last_unstale":"2023-07-27T14:38:54.201851+0000","last_undegraded":"2023-07-27T14:38:54.201851+0000","last_fullsized":"2023-07-27T14:38:54.201851+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.171251+0000","last_change":"2023-07-27T14:38:53.726135+0000","last_active":"2023-07-27T14:38:54.171251+0000","last_peered":"2023-07-27T14:38:54.171251+0000","last_clean":"2023-07-27T14:38:54.171251+0000","last_became_active":"2023-07-27T14:38:53.725769+0000","last_became_peered":"2023-07-27T14:38:53.725769+0000","last_unstale":"2023-07-27T14:38:54.171251+0000","last_undegraded":"2023-07-27T14:38:54.171251+0000","last_fullsized":"2023-07-27T14:38:54.171251+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198625+0000","last_change":"2023-07-27T14:38:54.196902+0000","last_active":"2023-07-27T14:38:54.198625+0000","last_peered":"2023-07-27T14:38:54.198625+0000","last_clean":"2023-07-27T14:38:54.198625+0000","last_became_active":"2023-07-27T14:38:54.196639+0000","last_became_peered":"2023-07-27T14:38:54.196639+0000","last_unstale":"2023-07-27T14:38:54.198625+0000","last_undegraded":"2023-07-27T14:38:54.198625+0000","last_fullsized":"2023-07-27T14:38:54.198625+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.172804+0000","last_change":"2023-07-27T14:38:53.720515+0000","last_active":"2023-07-27T14:38:54.172804+0000","last_peered":"2023-07-27T14:38:54.172804+0000","last_clean":"2023-07-27T14:38:54.172804+0000","last_became_active":"2023-07-27T14:38:53.720211+0000","last_became_peered":"2023-07-27T14:38:53.720211+0000","last_unstale":"2023-07-27T14:38:54.172804+0000","last_undegraded":"2023-07-27T14:38:54.172804+0000","last_fullsized":"2023-07-27T14:38:54.172804+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199802+0000","last_change":"2023-07-27T14:38:54.196536+0000","last_active":"2023-07-27T14:38:54.199802+0000","last_peered":"2023-07-27T14:38:54.199802+0000","last_clean":"2023-07-27T14:38:54.199802+0000","last_became_active":"2023-07-27T14:38:54.196339+0000","last_became_peered":"2023-07-27T14:38:54.196339+0000","last_unstale":"2023-07-27T14:38:54.199802+0000","last_undegraded":"2023-07-27T14:38:54.199802+0000","last_fullsized":"2023-07-27T14:38:54.199802+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"187'4","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.204542+0000","last_change":"2023-07-27T14:38:53.730098+0000","last_active":"2023-07-27T14:38:54.204542+0000","last_peered":"2023-07-27T14:38:54.204542+0000","last_clean":"2023-07-27T14:38:54.204542+0000","last_became_active":"2023-07-27T14:38:53.728964+0000","last_became_peered":"2023-07-27T14:38:53.728964+0000","last_unstale":"2023-07-27T14:38:54.204542+0000","last_undegraded":"2023-07-27T14:38:54.204542+0000","last_fullsized":"2023-07-27T14:38:54.204542+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198571+0000","last_change":"2023-07-27T14:38:54.196134+0000","last_active":"2023-07-27T14:38:54.198571+0000","last_peered":"2023-07-27T14:38:54.198571+0000","last_clean":"2023-07-27T14:38:54.198571+0000","last_became_active":"2023-07-27T14:38:54.195819+0000","last_became_peered":"2023-07-27T14:38:54.195819+0000","last_unstale":"2023-07-27T14:38:54.198571+0000","last_undegraded":"2023-07-27T14:38:54.198571+0000","last_fullsized":"2023-07-27T14:38:54.198571+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.195494+0000","last_change":"2023-07-27T14:38:53.727979+0000","last_active":"2023-07-27T14:38:54.195494+0000","last_peered":"2023-07-27T14:38:54.195494+0000","last_clean":"2023-07-27T14:38:54.195494+0000","last_became_active":"2023-07-27T14:38:53.727659+0000","last_became_peered":"2023-07-27T14:38:53.727659+0000","last_unstale":"2023-07-27T14:38:54.195494+0000","last_undegraded":"2023-07-27T14:38:54.195494+0000","last_fullsized":"2023-07-27T14:38:54.195494+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.192246+0000","last_change":"2023-07-27T14:38:54.190090+0000","last_active":"2023-07-27T14:38:54.192246+0000","last_peered":"2023-07-27T14:38:54.192246+0000","last_clean":"2023-07-27T14:38:54.192246+0000","last_became_active":"2023-07-27T14:38:54.188628+0000","last_became_peered":"2023-07-27T14:38:54.188628+0000","last_unstale":"2023-07-27T14:38:54.192246+0000","last_undegraded":"2023-07-27T14:38:54.192246+0000","last_fullsized":"2023-07-27T14:38:54.192246+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176184+0000","last_change":"2023-07-27T14:38:53.728406+0000","last_active":"2023-07-27T14:38:54.176184+0000","last_peered":"2023-07-27T14:38:54.176184+0000","last_clean":"2023-07-27T14:38:54.176184+0000","last_became_active":"2023-07-27T14:38:53.728126+0000","last_became_peered":"2023-07-27T14:38:53.728126+0000","last_unstale":"2023-07-27T14:38:54.176184+0000","last_undegraded":"2023-07-27T14:38:54.176184+0000","last_fullsized":"2023-07-27T14:38:54.176184+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197691+0000","last_change":"2023-07-27T14:38:54.193276+0000","last_active":"2023-07-27T14:38:54.197691+0000","last_peered":"2023-07-27T14:38:54.197691+0000","last_clean":"2023-07-27T14:38:54.197691+0000","last_became_active":"2023-07-27T14:38:54.193003+0000","last_became_peered":"2023-07-27T14:38:54.193003+0000","last_unstale":"2023-07-27T14:38:54.197691+0000","last_undegraded":"2023-07-27T14:38:54.197691+0000","last_fullsized":"2023-07-27T14:38:54.197691+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.189907+0000","last_change":"2023-07-27T14:38:53.724548+0000","last_active":"2023-07-27T14:38:54.189907+0000","last_peered":"2023-07-27T14:38:54.189907+0000","last_clean":"2023-07-27T14:38:54.189907+0000","last_became_active":"2023-07-27T14:38:53.724190+0000","last_became_peered":"2023-07-27T14:38:53.724190+0000","last_unstale":"2023-07-27T14:38:54.189907+0000","last_undegraded":"2023-07-27T14:38:54.189907+0000","last_fullsized":"2023-07-27T14:38:54.189907+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.186733+0000","last_change":"2023-07-27T14:38:54.178691+0000","last_active":"2023-07-27T14:38:54.186733+0000","last_peered":"2023-07-27T14:38:54.186733+0000","last_clean":"2023-07-27T14:38:54.186733+0000","last_became_active":"2023-07-27T14:38:54.178356+0000","last_became_peered":"2023-07-27T14:38:54.178356+0000","last_unstale":"2023-07-27T14:38:54.186733+0000","last_undegraded":"2023-07-27T14:38:54.186733+0000","last_fullsized":"2023-07-27T14:38:54.186733+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"187'4","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202034+0000","last_change":"2023-07-27T14:38:53.734743+0000","last_active":"2023-07-27T14:38:54.202034+0000","last_peered":"2023-07-27T14:38:54.202034+0000","last_clean":"2023-07-27T14:38:54.202034+0000","last_became_active":"2023-07-27T14:38:53.734316+0000","last_became_peered":"2023-07-27T14:38:53.734316+0000","last_unstale":"2023-07-27T14:38:54.202034+0000","last_undegraded":"2023-07-27T14:38:54.202034+0000","last_fullsized":"2023-07-27T14:38:54.202034+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198558+0000","last_change":"2023-07-27T14:38:54.194313+0000","last_active":"2023-07-27T14:38:54.198558+0000","last_peered":"2023-07-27T14:38:54.198558+0000","last_clean":"2023-07-27T14:38:54.198558+0000","last_became_active":"2023-07-27T14:38:54.193989+0000","last_became_peered":"2023-07-27T14:38:54.193989+0000","last_unstale":"2023-07-27T14:38:54.198558+0000","last_undegraded":"2023-07-27T14:38:54.198558+0000","last_fullsized":"2023-07-27T14:38:54.198558+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.185755+0000","last_change":"2023-07-27T14:38:53.726099+0000","last_active":"2023-07-27T14:38:54.185755+0000","last_peered":"2023-07-27T14:38:54.185755+0000","last_clean":"2023-07-27T14:38:54.185755+0000","last_became_active":"2023-07-27T14:38:53.725627+0000","last_became_peered":"2023-07-27T14:38:53.725627+0000","last_unstale":"2023-07-27T14:38:54.185755+0000","last_undegraded":"2023-07-27T14:38:54.185755+0000","last_fullsized":"2023-07-27T14:38:54.185755+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197985+0000","last_change":"2023-07-27T14:38:54.194787+0000","last_active":"2023-07-27T14:38:54.197985+0000","last_peered":"2023-07-27T14:38:54.197985+0000","last_clean":"2023-07-27T14:38:54.197985+0000","last_became_active":"2023-07-27T14:38:54.194476+0000","last_became_peered":"2023-07-27T14:38:54.194476+0000","last_unstale":"2023-07-27T14:38:54.197985+0000","last_undegraded":"2023-07-27T14:38:54.197985+0000","last_fullsized":"2023-07-27T14:38:54.197985+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.185117+0000","last_change":"2023-07-27T14:38:53.720133+0000","last_active":"2023-07-27T14:38:54.185117+0000","last_peered":"2023-07-27T14:38:54.185117+0000","last_clean":"2023-07-27T14:38:54.185117+0000","last_became_active":"2023-07-27T14:38:53.719831+0000","last_became_peered":"2023-07-27T14:38:53.719831+0000","last_unstale":"2023-07-27T14:38:54.185117+0000","last_undegraded":"2023-07-27T14:38:54.185117+0000","last_fullsized":"2023-07-27T14:38:54.185117+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199390+0000","last_change":"2023-07-27T14:38:54.197237+0000","last_active":"2023-07-27T14:38:54.199390+0000","last_peered":"2023-07-27T14:38:54.199390+0000","last_clean":"2023-07-27T14:38:54.199390+0000","last_became_active":"2023-07-27T14:38:54.196866+0000","last_became_peered":"2023-07-27T14:38:54.196866+0000","last_unstale":"2023-07-27T14:38:54.199390+0000","last_undegraded":"2023-07-27T14:38:54.199390+0000","last_fullsized":"2023-07-27T14:38:54.199390+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202672+0000","last_change":"2023-07-27T14:38:53.723980+0000","last_active":"2023-07-27T14:38:54.202672+0000","last_peered":"2023-07-27T14:38:54.202672+0000","last_clean":"2023-07-27T14:38:54.202672+0000","last_became_active":"2023-07-27T14:38:53.723686+0000","last_became_peered":"2023-07-27T14:38:53.723686+0000","last_unstale":"2023-07-27T14:38:54.202672+0000","last_undegraded":"2023-07-27T14:38:54.202672+0000","last_fullsized":"2023-07-27T14:38:54.202672+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198921+0000","last_change":"2023-07-27T14:38:54.196772+0000","last_active":"2023-07-27T14:38:54.198921+0000","last_peered":"2023-07-27T14:38:54.198921+0000","last_clean":"2023-07-27T14:38:54.198921+0000","last_became_active":"2023-07-27T14:38:54.196369+0000","last_became_peered":"2023-07-27T14:38:54.196369+0000","last_unstale":"2023-07-27T14:38:54.198921+0000","last_undegraded":"2023-07-27T14:38:54.198921+0000","last_fullsized":"2023-07-27T14:38:54.198921+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.185639+0000","last_change":"2023-07-27T14:38:53.730747+0000","last_active":"2023-07-27T14:38:54.185639+0000","last_peered":"2023-07-27T14:38:54.185639+0000","last_clean":"2023-07-27T14:38:54.185639+0000","last_became_active":"2023-07-27T14:38:53.730472+0000","last_became_peered":"2023-07-27T14:38:53.730472+0000","last_unstale":"2023-07-27T14:38:54.185639+0000","last_undegraded":"2023-07-27T14:38:54.185639+0000","last_fullsized":"2023-07-27T14:38:54.185639+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199408+0000","last_change":"2023-07-27T14:38:54.193269+0000","last_active":"2023-07-27T14:38:54.199408+0000","last_peered":"2023-07-27T14:38:54.199408+0000","last_clean":"2023-07-27T14:38:54.199408+0000","last_became_active":"2023-07-27T14:38:54.193016+0000","last_became_peered":"2023-07-27T14:38:54.193016+0000","last_unstale":"2023-07-27T14:38:54.199408+0000","last_undegraded":"2023-07-27T14:38:54.199408+0000","last_fullsized":"2023-07-27T14:38:54.199408+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201744+0000","last_change":"2023-07-27T14:38:53.721457+0000","last_active":"2023-07-27T14:38:54.201744+0000","last_peered":"2023-07-27T14:38:54.201744+0000","last_clean":"2023-07-27T14:38:54.201744+0000","last_became_active":"2023-07-27T14:38:53.720809+0000","last_became_peered":"2023-07-27T14:38:53.720809+0000","last_unstale":"2023-07-27T14:38:54.201744+0000","last_undegraded":"2023-07-27T14:38:54.201744+0000","last_fullsized":"2023-07-27T14:38:54.201744+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201875+0000","last_change":"2023-07-27T14:38:54.198519+0000","last_active":"2023-07-27T14:38:54.201875+0000","last_peered":"2023-07-27T14:38:54.201875+0000","last_clean":"2023-07-27T14:38:54.201875+0000","last_became_active":"2023-07-27T14:38:54.198219+0000","last_became_peered":"2023-07-27T14:38:54.198219+0000","last_unstale":"2023-07-27T14:38:54.201875+0000","last_undegraded":"2023-07-27T14:38:54.201875+0000","last_fullsized":"2023-07-27T14:38:54.201875+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.171102+0000","last_change":"2023-07-27T14:38:53.735592+0000","last_active":"2023-07-27T14:38:54.171102+0000","last_peered":"2023-07-27T14:38:54.171102+0000","last_clean":"2023-07-27T14:38:54.171102+0000","last_became_active":"2023-07-27T14:38:53.735327+0000","last_became_peered":"2023-07-27T14:38:53.735327+0000","last_unstale":"2023-07-27T14:38:54.171102+0000","last_undegraded":"2023-07-27T14:38:54.171102+0000","last_fullsized":"2023-07-27T14:38:54.171102+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.190651+0000","last_change":"2023-07-27T14:38:54.188705+0000","last_active":"2023-07-27T14:38:54.190651+0000","last_peered":"2023-07-27T14:38:54.190651+0000","last_clean":"2023-07-27T14:38:54.190651+0000","last_became_active":"2023-07-27T14:38:54.188414+0000","last_became_peered":"2023-07-27T14:38:54.188414+0000","last_unstale":"2023-07-27T14:38:54.190651+0000","last_undegraded":"2023-07-27T14:38:54.190651+0000","last_fullsized":"2023-07-27T14:38:54.190651+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.177793+0000","last_change":"2023-07-27T14:38:53.716745+0000","last_active":"2023-07-27T14:38:54.177793+0000","last_peered":"2023-07-27T14:38:54.177793+0000","last_clean":"2023-07-27T14:38:54.177793+0000","last_became_active":"2023-07-27T14:38:53.716486+0000","last_became_peered":"2023-07-27T14:38:53.716486+0000","last_unstale":"2023-07-27T14:38:54.177793+0000","last_undegraded":"2023-07-27T14:38:54.177793+0000","last_fullsized":"2023-07-27T14:38:54.177793+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.193405+0000","last_change":"2023-07-27T14:38:54.189641+0000","last_active":"2023-07-27T14:38:54.193405+0000","last_peered":"2023-07-27T14:38:54.193405+0000","last_clean":"2023-07-27T14:38:54.193405+0000","last_became_active":"2023-07-27T14:38:54.188756+0000","last_became_peered":"2023-07-27T14:38:54.188756+0000","last_unstale":"2023-07-27T14:38:54.193405+0000","last_undegraded":"2023-07-27T14:38:54.193405+0000","last_fullsized":"2023-07-27T14:38:54.193405+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175540+0000","last_change":"2023-07-27T14:38:53.735274+0000","last_active":"2023-07-27T14:38:54.175540+0000","last_peered":"2023-07-27T14:38:54.175540+0000","last_clean":"2023-07-27T14:38:54.175540+0000","last_became_active":"2023-07-27T14:38:53.733467+0000","last_became_peered":"2023-07-27T14:38:53.733467+0000","last_unstale":"2023-07-27T14:38:54.175540+0000","last_undegraded":"2023-07-27T14:38:54.175540+0000","last_fullsized":"2023-07-27T14:38:54.175540+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.203563+0000","last_change":"2023-07-27T14:38:54.202640+0000","last_active":"2023-07-27T14:38:54.203563+0000","last_peered":"2023-07-27T14:38:54.203563+0000","last_clean":"2023-07-27T14:38:54.203563+0000","last_became_active":"2023-07-27T14:38:54.202087+0000","last_became_peered":"2023-07-27T14:38:54.202087+0000","last_unstale":"2023-07-27T14:38:54.203563+0000","last_undegraded":"2023-07-27T14:38:54.203563+0000","last_fullsized":"2023-07-27T14:38:54.203563+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183957+0000","last_change":"2023-07-27T14:38:53.731504+0000","last_active":"2023-07-27T14:38:54.183957+0000","last_peered":"2023-07-27T14:38:54.183957+0000","last_clean":"2023-07-27T14:38:54.183957+0000","last_became_active":"2023-07-27T14:38:53.731192+0000","last_became_peered":"2023-07-27T14:38:53.731192+0000","last_unstale":"2023-07-27T14:38:54.183957+0000","last_undegraded":"2023-07-27T14:38:54.183957+0000","last_fullsized":"2023-07-27T14:38:54.183957+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199879+0000","last_change":"2023-07-27T14:38:54.194771+0000","last_active":"2023-07-27T14:38:54.199879+0000","last_peered":"2023-07-27T14:38:54.199879+0000","last_clean":"2023-07-27T14:38:54.199879+0000","last_became_active":"2023-07-27T14:38:54.194093+0000","last_became_peered":"2023-07-27T14:38:54.194093+0000","last_unstale":"2023-07-27T14:38:54.199879+0000","last_undegraded":"2023-07-27T14:38:54.199879+0000","last_fullsized":"2023-07-27T14:38:54.199879+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"188'1","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-27T14:38:55.174511+0000","last_change":"2023-07-27T14:38:53.722762+0000","last_active":"2023-07-27T14:38:55.174511+0000","last_peered":"2023-07-27T14:38:55.174511+0000","last_clean":"2023-07-27T14:38:55.174511+0000","last_became_active":"2023-07-27T14:38:53.722382+0000","last_became_peered":"2023-07-27T14:38:53.722382+0000","last_unstale":"2023-07-27T14:38:55.174511+0000","last_undegraded":"2023-07-27T14:38:55.174511+0000","last_fullsized":"2023-07-27T14:38:55.174511+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201692+0000","last_change":"2023-07-27T14:38:54.192545+0000","last_active":"2023-07-27T14:38:54.201692+0000","last_peered":"2023-07-27T14:38:54.201692+0000","last_clean":"2023-07-27T14:38:54.201692+0000","last_became_active":"2023-07-27T14:38:54.192090+0000","last_became_peered":"2023-07-27T14:38:54.192090+0000","last_unstale":"2023-07-27T14:38:54.201692+0000","last_undegraded":"2023-07-27T14:38:54.201692+0000","last_fullsized":"2023-07-27T14:38:54.201692+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176900+0000","last_change":"2023-07-27T14:38:53.719681+0000","last_active":"2023-07-27T14:38:54.176900+0000","last_peered":"2023-07-27T14:38:54.176900+0000","last_clean":"2023-07-27T14:38:54.176900+0000","last_became_active":"2023-07-27T14:38:53.719392+0000","last_became_peered":"2023-07-27T14:38:53.719392+0000","last_unstale":"2023-07-27T14:38:54.176900+0000","last_undegraded":"2023-07-27T14:38:54.176900+0000","last_fullsized":"2023-07-27T14:38:54.176900+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.196652+0000","last_change":"2023-07-27T14:38:54.191385+0000","last_active":"2023-07-27T14:38:54.196652+0000","last_peered":"2023-07-27T14:38:54.196652+0000","last_clean":"2023-07-27T14:38:54.196652+0000","last_became_active":"2023-07-27T14:38:54.191111+0000","last_became_peered":"2023-07-27T14:38:54.191111+0000","last_unstale":"2023-07-27T14:38:54.196652+0000","last_undegraded":"2023-07-27T14:38:54.196652+0000","last_fullsized":"2023-07-27T14:38:54.196652+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.185769+0000","last_change":"2023-07-27T14:38:53.726603+0000","last_active":"2023-07-27T14:38:54.185769+0000","last_peered":"2023-07-27T14:38:54.185769+0000","last_clean":"2023-07-27T14:38:54.185769+0000","last_became_active":"2023-07-27T14:38:53.726330+0000","last_became_peered":"2023-07-27T14:38:53.726330+0000","last_unstale":"2023-07-27T14:38:54.185769+0000","last_undegraded":"2023-07-27T14:38:54.185769+0000","last_fullsized":"2023-07-27T14:38:54.185769+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.189819+0000","last_change":"2023-07-27T14:38:54.188208+0000","last_active":"2023-07-27T14:38:54.189819+0000","last_peered":"2023-07-27T14:38:54.189819+0000","last_clean":"2023-07-27T14:38:54.189819+0000","last_became_active":"2023-07-27T14:38:54.187931+0000","last_became_peered":"2023-07-27T14:38:54.187931+0000","last_unstale":"2023-07-27T14:38:54.189819+0000","last_undegraded":"2023-07-27T14:38:54.189819+0000","last_fullsized":"2023-07-27T14:38:54.189819+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184928+0000","last_change":"2023-07-27T14:38:53.727098+0000","last_active":"2023-07-27T14:38:54.184928+0000","last_peered":"2023-07-27T14:38:54.184928+0000","last_clean":"2023-07-27T14:38:54.184928+0000","last_became_active":"2023-07-27T14:38:53.726800+0000","last_became_peered":"2023-07-27T14:38:53.726800+0000","last_unstale":"2023-07-27T14:38:54.184928+0000","last_undegraded":"2023-07-27T14:38:54.184928+0000","last_fullsized":"2023-07-27T14:38:54.184928+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.200599+0000","last_change":"2023-07-27T14:38:54.196850+0000","last_active":"2023-07-27T14:38:54.200599+0000","last_peered":"2023-07-27T14:38:54.200599+0000","last_clean":"2023-07-27T14:38:54.200599+0000","last_became_active":"2023-07-27T14:38:54.196468+0000","last_became_peered":"2023-07-27T14:38:54.196468+0000","last_unstale":"2023-07-27T14:38:54.200599+0000","last_undegraded":"2023-07-27T14:38:54.200599+0000","last_fullsized":"2023-07-27T14:38:54.200599+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176294+0000","last_change":"2023-07-27T14:38:53.723543+0000","last_active":"2023-07-27T14:38:54.176294+0000","last_peered":"2023-07-27T14:38:54.176294+0000","last_clean":"2023-07-27T14:38:54.176294+0000","last_became_active":"2023-07-27T14:38:53.723278+0000","last_became_peered":"2023-07-27T14:38:53.723278+0000","last_unstale":"2023-07-27T14:38:54.176294+0000","last_undegraded":"2023-07-27T14:38:54.176294+0000","last_fullsized":"2023-07-27T14:38:54.176294+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202203+0000","last_change":"2023-07-27T14:38:54.193362+0000","last_active":"2023-07-27T14:38:54.202203+0000","last_peered":"2023-07-27T14:38:54.202203+0000","last_clean":"2023-07-27T14:38:54.202203+0000","last_became_active":"2023-07-27T14:38:54.193062+0000","last_became_peered":"2023-07-27T14:38:54.193062+0000","last_unstale":"2023-07-27T14:38:54.202203+0000","last_undegraded":"2023-07-27T14:38:54.202203+0000","last_fullsized":"2023-07-27T14:38:54.202203+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.177700+0000","last_change":"2023-07-27T14:38:53.732118+0000","last_active":"2023-07-27T14:38:54.177700+0000","last_peered":"2023-07-27T14:38:54.177700+0000","last_clean":"2023-07-27T14:38:54.177700+0000","last_became_active":"2023-07-27T14:38:53.731832+0000","last_became_peered":"2023-07-27T14:38:53.731832+0000","last_unstale":"2023-07-27T14:38:54.177700+0000","last_undegraded":"2023-07-27T14:38:54.177700+0000","last_fullsized":"2023-07-27T14:38:54.177700+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202337+0000","last_change":"2023-07-27T14:38:54.193284+0000","last_active":"2023-07-27T14:38:54.202337+0000","last_peered":"2023-07-27T14:38:54.202337+0000","last_clean":"2023-07-27T14:38:54.202337+0000","last_became_active":"2023-07-27T14:38:54.192919+0000","last_became_peered":"2023-07-27T14:38:54.192919+0000","last_unstale":"2023-07-27T14:38:54.202337+0000","last_undegraded":"2023-07-27T14:38:54.202337+0000","last_fullsized":"2023-07-27T14:38:54.202337+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.182565+0000","last_change":"2023-07-27T14:38:53.725223+0000","last_active":"2023-07-27T14:38:54.182565+0000","last_peered":"2023-07-27T14:38:54.182565+0000","last_clean":"2023-07-27T14:38:54.182565+0000","last_became_active":"2023-07-27T14:38:53.724955+0000","last_became_peered":"2023-07-27T14:38:53.724955+0000","last_unstale":"2023-07-27T14:38:54.182565+0000","last_undegraded":"2023-07-27T14:38:54.182565+0000","last_fullsized":"2023-07-27T14:38:54.182565+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.200019+0000","last_change":"2023-07-27T14:38:54.194946+0000","last_active":"2023-07-27T14:38:54.200019+0000","last_peered":"2023-07-27T14:38:54.200019+0000","last_clean":"2023-07-27T14:38:54.200019+0000","last_became_active":"2023-07-27T14:38:54.194600+0000","last_became_peered":"2023-07-27T14:38:54.194600+0000","last_unstale":"2023-07-27T14:38:54.200019+0000","last_undegraded":"2023-07-27T14:38:54.200019+0000","last_fullsized":"2023-07-27T14:38:54.200019+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175791+0000","last_change":"2023-07-27T14:38:53.731289+0000","last_active":"2023-07-27T14:38:54.175791+0000","last_peered":"2023-07-27T14:38:54.175791+0000","last_clean":"2023-07-27T14:38:54.175791+0000","last_became_active":"2023-07-27T14:38:53.730951+0000","last_became_peered":"2023-07-27T14:38:53.730951+0000","last_unstale":"2023-07-27T14:38:54.175791+0000","last_undegraded":"2023-07-27T14:38:54.175791+0000","last_fullsized":"2023-07-27T14:38:54.175791+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184777+0000","last_change":"2023-07-27T14:38:54.183618+0000","last_active":"2023-07-27T14:38:54.184777+0000","last_peered":"2023-07-27T14:38:54.184777+0000","last_clean":"2023-07-27T14:38:54.184777+0000","last_became_active":"2023-07-27T14:38:54.182950+0000","last_became_peered":"2023-07-27T14:38:54.182950+0000","last_unstale":"2023-07-27T14:38:54.184777+0000","last_undegraded":"2023-07-27T14:38:54.184777+0000","last_fullsized":"2023-07-27T14:38:54.184777+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.178245+0000","last_change":"2023-07-27T14:38:53.733651+0000","last_active":"2023-07-27T14:38:54.178245+0000","last_peered":"2023-07-27T14:38:54.178245+0000","last_clean":"2023-07-27T14:38:54.178245+0000","last_became_active":"2023-07-27T14:38:53.733400+0000","last_became_peered":"2023-07-27T14:38:53.733400+0000","last_unstale":"2023-07-27T14:38:54.178245+0000","last_undegraded":"2023-07-27T14:38:54.178245+0000","last_fullsized":"2023-07-27T14:38:54.178245+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197075+0000","last_change":"2023-07-27T14:38:54.194067+0000","last_active":"2023-07-27T14:38:54.197075+0000","last_peered":"2023-07-27T14:38:54.197075+0000","last_clean":"2023-07-27T14:38:54.197075+0000","last_became_active":"2023-07-27T14:38:54.193741+0000","last_became_peered":"2023-07-27T14:38:54.193741+0000","last_unstale":"2023-07-27T14:38:54.197075+0000","last_undegraded":"2023-07-27T14:38:54.197075+0000","last_fullsized":"2023-07-27T14:38:54.197075+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"187'3","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.190252+0000","last_change":"2023-07-27T14:38:53.732810+0000","last_active":"2023-07-27T14:38:54.190252+0000","last_peered":"2023-07-27T14:38:54.190252+0000","last_clean":"2023-07-27T14:38:54.190252+0000","last_became_active":"2023-07-27T14:38:53.732496+0000","last_became_peered":"2023-07-27T14:38:53.732496+0000","last_unstale":"2023-07-27T14:38:54.190252+0000","last_undegraded":"2023-07-27T14:38:54.190252+0000","last_fullsized":"2023-07-27T14:38:54.190252+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199035+0000","last_change":"2023-07-27T14:38:54.194671+0000","last_active":"2023-07-27T14:38:54.199035+0000","last_peered":"2023-07-27T14:38:54.199035+0000","last_clean":"2023-07-27T14:38:54.199035+0000","last_became_active":"2023-07-27T14:38:54.194447+0000","last_became_peered":"2023-07-27T14:38:54.194447+0000","last_unstale":"2023-07-27T14:38:54.199035+0000","last_undegraded":"2023-07-27T14:38:54.199035+0000","last_fullsized":"2023-07-27T14:38:54.199035+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202264+0000","last_change":"2023-07-27T14:38:53.728041+0000","last_active":"2023-07-27T14:38:54.202264+0000","last_peered":"2023-07-27T14:38:54.202264+0000","last_clean":"2023-07-27T14:38:54.202264+0000","last_became_active":"2023-07-27T14:38:53.727769+0000","last_became_peered":"2023-07-27T14:38:53.727769+0000","last_unstale":"2023-07-27T14:38:54.202264+0000","last_undegraded":"2023-07-27T14:38:54.202264+0000","last_fullsized":"2023-07-27T14:38:54.202264+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202482+0000","last_change":"2023-07-27T14:38:54.200743+0000","last_active":"2023-07-27T14:38:54.202482+0000","last_peered":"2023-07-27T14:38:54.202482+0000","last_clean":"2023-07-27T14:38:54.202482+0000","last_became_active":"2023-07-27T14:38:54.200475+0000","last_became_peered":"2023-07-27T14:38:54.200475+0000","last_unstale":"2023-07-27T14:38:54.202482+0000","last_undegraded":"2023-07-27T14:38:54.202482+0000","last_fullsized":"2023-07-27T14:38:54.202482+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.187249+0000","last_change":"2023-07-27T14:38:53.721600+0000","last_active":"2023-07-27T14:38:54.187249+0000","last_peered":"2023-07-27T14:38:54.187249+0000","last_clean":"2023-07-27T14:38:54.187249+0000","last_became_active":"2023-07-27T14:38:53.721265+0000","last_became_peered":"2023-07-27T14:38:53.721265+0000","last_unstale":"2023-07-27T14:38:54.187249+0000","last_undegraded":"2023-07-27T14:38:54.187249+0000","last_fullsized":"2023-07-27T14:38:54.187249+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198378+0000","last_change":"2023-07-27T14:38:54.192417+0000","last_active":"2023-07-27T14:38:54.198378+0000","last_peered":"2023-07-27T14:38:54.198378+0000","last_clean":"2023-07-27T14:38:54.198378+0000","last_became_active":"2023-07-27T14:38:54.192131+0000","last_became_peered":"2023-07-27T14:38:54.192131+0000","last_unstale":"2023-07-27T14:38:54.198378+0000","last_undegraded":"2023-07-27T14:38:54.198378+0000","last_fullsized":"2023-07-27T14:38:54.198378+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.177658+0000","last_change":"2023-07-27T14:38:53.717938+0000","last_active":"2023-07-27T14:38:54.177658+0000","last_peered":"2023-07-27T14:38:54.177658+0000","last_clean":"2023-07-27T14:38:54.177658+0000","last_became_active":"2023-07-27T14:38:53.717640+0000","last_became_peered":"2023-07-27T14:38:53.717640+0000","last_unstale":"2023-07-27T14:38:54.177658+0000","last_undegraded":"2023-07-27T14:38:54.177658+0000","last_fullsized":"2023-07-27T14:38:54.177658+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.192014+0000","last_change":"2023-07-27T14:38:54.183558+0000","last_active":"2023-07-27T14:38:54.192014+0000","last_peered":"2023-07-27T14:38:54.192014+0000","last_clean":"2023-07-27T14:38:54.192014+0000","last_became_active":"2023-07-27T14:38:54.182029+0000","last_became_peered":"2023-07-27T14:38:54.182029+0000","last_unstale":"2023-07-27T14:38:54.192014+0000","last_undegraded":"2023-07-27T14:38:54.192014+0000","last_fullsized":"2023-07-27T14:38:54.192014+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.170242+0000","last_change":"2023-07-27T14:38:53.721246+0000","last_active":"2023-07-27T14:38:54.170242+0000","last_peered":"2023-07-27T14:38:54.170242+0000","last_clean":"2023-07-27T14:38:54.170242+0000","last_became_active":"2023-07-27T14:38:53.720474+0000","last_became_peered":"2023-07-27T14:38:53.720474+0000","last_unstale":"2023-07-27T14:38:54.170242+0000","last_undegraded":"2023-07-27T14:38:54.170242+0000","last_fullsized":"2023-07-27T14:38:54.170242+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.196226+0000","last_change":"2023-07-27T14:38:54.193316+0000","last_active":"2023-07-27T14:38:54.196226+0000","last_peered":"2023-07-27T14:38:54.196226+0000","last_clean":"2023-07-27T14:38:54.196226+0000","last_became_active":"2023-07-27T14:38:54.192566+0000","last_became_peered":"2023-07-27T14:38:54.192566+0000","last_unstale":"2023-07-27T14:38:54.196226+0000","last_undegraded":"2023-07-27T14:38:54.196226+0000","last_fullsized":"2023-07-27T14:38:54.196226+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"187'4","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.195805+0000","last_change":"2023-07-27T14:38:53.728434+0000","last_active":"2023-07-27T14:38:54.195805+0000","last_peered":"2023-07-27T14:38:54.195805+0000","last_clean":"2023-07-27T14:38:54.195805+0000","last_became_active":"2023-07-27T14:38:53.728147+0000","last_became_peered":"2023-07-27T14:38:53.728147+0000","last_unstale":"2023-07-27T14:38:54.195805+0000","last_undegraded":"2023-07-27T14:38:54.195805+0000","last_fullsized":"2023-07-27T14:38:54.195805+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.196201+0000","last_change":"2023-07-27T14:38:54.191596+0000","last_active":"2023-07-27T14:38:54.196201+0000","last_peered":"2023-07-27T14:38:54.196201+0000","last_clean":"2023-07-27T14:38:54.196201+0000","last_became_active":"2023-07-27T14:38:54.191291+0000","last_became_peered":"2023-07-27T14:38:54.191291+0000","last_unstale":"2023-07-27T14:38:54.196201+0000","last_undegraded":"2023-07-27T14:38:54.196201+0000","last_fullsized":"2023-07-27T14:38:54.196201+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201587+0000","last_change":"2023-07-27T14:38:53.728447+0000","last_active":"2023-07-27T14:38:54.201587+0000","last_peered":"2023-07-27T14:38:54.201587+0000","last_clean":"2023-07-27T14:38:54.201587+0000","last_became_active":"2023-07-27T14:38:53.728171+0000","last_became_peered":"2023-07-27T14:38:53.728171+0000","last_unstale":"2023-07-27T14:38:54.201587+0000","last_undegraded":"2023-07-27T14:38:54.201587+0000","last_fullsized":"2023-07-27T14:38:54.201587+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.187360+0000","last_change":"2023-07-27T14:38:54.186356+0000","last_active":"2023-07-27T14:38:54.187360+0000","last_peered":"2023-07-27T14:38:54.187360+0000","last_clean":"2023-07-27T14:38:54.187360+0000","last_became_active":"2023-07-27T14:38:54.186094+0000","last_became_peered":"2023-07-27T14:38:54.186094+0000","last_unstale":"2023-07-27T14:38:54.187360+0000","last_undegraded":"2023-07-27T14:38:54.187360+0000","last_fullsized":"2023-07-27T14:38:54.187360+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.194725+0000","last_change":"2023-07-27T14:38:53.721607+0000","last_active":"2023-07-27T14:38:54.194725+0000","last_peered":"2023-07-27T14:38:54.194725+0000","last_clean":"2023-07-27T14:38:54.194725+0000","last_became_active":"2023-07-27T14:38:53.720342+0000","last_became_peered":"2023-07-27T14:38:53.720342+0000","last_unstale":"2023-07-27T14:38:54.194725+0000","last_undegraded":"2023-07-27T14:38:54.194725+0000","last_fullsized":"2023-07-27T14:38:54.194725+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201672+0000","last_change":"2023-07-27T14:38:54.192373+0000","last_active":"2023-07-27T14:38:54.201672+0000","last_peered":"2023-07-27T14:38:54.201672+0000","last_clean":"2023-07-27T14:38:54.201672+0000","last_became_active":"2023-07-27T14:38:54.191708+0000","last_became_peered":"2023-07-27T14:38:54.191708+0000","last_unstale":"2023-07-27T14:38:54.201672+0000","last_undegraded":"2023-07-27T14:38:54.201672+0000","last_fullsized":"2023-07-27T14:38:54.201672+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183590+0000","last_change":"2023-07-27T14:38:53.733768+0000","last_active":"2023-07-27T14:38:54.183590+0000","last_peered":"2023-07-27T14:38:54.183590+0000","last_clean":"2023-07-27T14:38:54.183590+0000","last_became_active":"2023-07-27T14:38:53.733488+0000","last_became_peered":"2023-07-27T14:38:53.733488+0000","last_unstale":"2023-07-27T14:38:54.183590+0000","last_undegraded":"2023-07-27T14:38:54.183590+0000","last_fullsized":"2023-07-27T14:38:54.183590+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198919+0000","last_change":"2023-07-27T14:38:54.192222+0000","last_active":"2023-07-27T14:38:54.198919+0000","last_peered":"2023-07-27T14:38:54.198919+0000","last_clean":"2023-07-27T14:38:54.198919+0000","last_became_active":"2023-07-27T14:38:54.190412+0000","last_became_peered":"2023-07-27T14:38:54.190412+0000","last_unstale":"2023-07-27T14:38:54.198919+0000","last_undegraded":"2023-07-27T14:38:54.198919+0000","last_fullsized":"2023-07-27T14:38:54.198919+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176764+0000","last_change":"2023-07-27T14:38:53.724123+0000","last_active":"2023-07-27T14:38:54.176764+0000","last_peered":"2023-07-27T14:38:54.176764+0000","last_clean":"2023-07-27T14:38:54.176764+0000","last_became_active":"2023-07-27T14:38:53.723861+0000","last_became_peered":"2023-07-27T14:38:53.723861+0000","last_unstale":"2023-07-27T14:38:54.176764+0000","last_undegraded":"2023-07-27T14:38:54.176764+0000","last_fullsized":"2023-07-27T14:38:54.176764+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.193597+0000","last_change":"2023-07-27T14:38:54.190261+0000","last_active":"2023-07-27T14:38:54.193597+0000","last_peered":"2023-07-27T14:38:54.193597+0000","last_clean":"2023-07-27T14:38:54.193597+0000","last_became_active":"2023-07-27T14:38:54.189966+0000","last_became_peered":"2023-07-27T14:38:54.189966+0000","last_unstale":"2023-07-27T14:38:54.193597+0000","last_undegraded":"2023-07-27T14:38:54.193597+0000","last_fullsized":"2023-07-27T14:38:54.193597+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.186807+0000","last_change":"2023-07-27T14:38:53.733334+0000","last_active":"2023-07-27T14:38:54.186807+0000","last_peered":"2023-07-27T14:38:54.186807+0000","last_clean":"2023-07-27T14:38:54.186807+0000","last_became_active":"2023-07-27T14:38:53.732989+0000","last_became_peered":"2023-07-27T14:38:53.732989+0000","last_unstale":"2023-07-27T14:38:54.186807+0000","last_undegraded":"2023-07-27T14:38:54.186807+0000","last_fullsized":"2023-07-27T14:38:54.186807+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183966+0000","last_change":"2023-07-27T14:38:54.180101+0000","last_active":"2023-07-27T14:38:54.183966+0000","last_peered":"2023-07-27T14:38:54.183966+0000","last_clean":"2023-07-27T14:38:54.183966+0000","last_became_active":"2023-07-27T14:38:54.179786+0000","last_became_peered":"2023-07-27T14:38:54.179786+0000","last_unstale":"2023-07-27T14:38:54.183966+0000","last_undegraded":"2023-07-27T14:38:54.183966+0000","last_fullsized":"2023-07-27T14:38:54.183966+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.171279+0000","last_change":"2023-07-27T14:38:53.722501+0000","last_active":"2023-07-27T14:38:54.171279+0000","last_peered":"2023-07-27T14:38:54.171279+0000","last_clean":"2023-07-27T14:38:54.171279+0000","last_became_active":"2023-07-27T14:38:53.722206+0000","last_became_peered":"2023-07-27T14:38:53.722206+0000","last_unstale":"2023-07-27T14:38:54.171279+0000","last_undegraded":"2023-07-27T14:38:54.171279+0000","last_fullsized":"2023-07-27T14:38:54.171279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.189211+0000","last_change":"2023-07-27T14:38:54.184541+0000","last_active":"2023-07-27T14:38:54.189211+0000","last_peered":"2023-07-27T14:38:54.189211+0000","last_clean":"2023-07-27T14:38:54.189211+0000","last_became_active":"2023-07-27T14:38:54.184246+0000","last_became_peered":"2023-07-27T14:38:54.184246+0000","last_unstale":"2023-07-27T14:38:54.189211+0000","last_undegraded":"2023-07-27T14:38:54.189211+0000","last_fullsized":"2023-07-27T14:38:54.189211+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183539+0000","last_change":"2023-07-27T14:38:53.721005+0000","last_active":"2023-07-27T14:38:54.183539+0000","last_peered":"2023-07-27T14:38:54.183539+0000","last_clean":"2023-07-27T14:38:54.183539+0000","last_became_active":"2023-07-27T14:38:53.720725+0000","last_became_peered":"2023-07-27T14:38:53.720725+0000","last_unstale":"2023-07-27T14:38:54.183539+0000","last_undegraded":"2023-07-27T14:38:54.183539+0000","last_fullsized":"2023-07-27T14:38:54.183539+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197351+0000","last_change":"2023-07-27T14:38:54.189561+0000","last_active":"2023-07-27T14:38:54.197351+0000","last_peered":"2023-07-27T14:38:54.197351+0000","last_clean":"2023-07-27T14:38:54.197351+0000","last_became_active":"2023-07-27T14:38:54.189289+0000","last_became_peered":"2023-07-27T14:38:54.189289+0000","last_unstale":"2023-07-27T14:38:54.197351+0000","last_undegraded":"2023-07-27T14:38:54.197351+0000","last_fullsized":"2023-07-27T14:38:54.197351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.182121+0000","last_change":"2023-07-27T14:38:53.729371+0000","last_active":"2023-07-27T14:38:54.182121+0000","last_peered":"2023-07-27T14:38:54.182121+0000","last_clean":"2023-07-27T14:38:54.182121+0000","last_became_active":"2023-07-27T14:38:53.729056+0000","last_became_peered":"2023-07-27T14:38:53.729056+0000","last_unstale":"2023-07-27T14:38:54.182121+0000","last_undegraded":"2023-07-27T14:38:54.182121+0000","last_fullsized":"2023-07-27T14:38:54.182121+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.203664+0000","last_change":"2023-07-27T14:38:54.202395+0000","last_active":"2023-07-27T14:38:54.203664+0000","last_peered":"2023-07-27T14:38:54.203664+0000","last_clean":"2023-07-27T14:38:54.203664+0000","last_became_active":"2023-07-27T14:38:54.202183+0000","last_became_peered":"2023-07-27T14:38:54.202183+0000","last_unstale":"2023-07-27T14:38:54.203664+0000","last_undegraded":"2023-07-27T14:38:54.203664+0000","last_fullsized":"2023-07-27T14:38:54.203664+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.200060+0000","last_change":"2023-07-27T14:38:53.710828+0000","last_active":"2023-07-27T14:38:54.200060+0000","last_peered":"2023-07-27T14:38:54.200060+0000","last_clean":"2023-07-27T14:38:54.200060+0000","last_became_active":"2023-07-27T14:38:53.710539+0000","last_became_peered":"2023-07-27T14:38:53.710539+0000","last_unstale":"2023-07-27T14:38:54.200060+0000","last_undegraded":"2023-07-27T14:38:54.200060+0000","last_fullsized":"2023-07-27T14:38:54.200060+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.192834+0000","last_change":"2023-07-27T14:38:54.189407+0000","last_active":"2023-07-27T14:38:54.192834+0000","last_peered":"2023-07-27T14:38:54.192834+0000","last_clean":"2023-07-27T14:38:54.192834+0000","last_became_active":"2023-07-27T14:38:54.189147+0000","last_became_peered":"2023-07-27T14:38:54.189147+0000","last_unstale":"2023-07-27T14:38:54.192834+0000","last_undegraded":"2023-07-27T14:38:54.192834+0000","last_fullsized":"2023-07-27T14:38:54.192834+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.182059+0000","last_change":"2023-07-27T14:38:53.725053+0000","last_active":"2023-07-27T14:38:54.182059+0000","last_peered":"2023-07-27T14:38:54.182059+0000","last_clean":"2023-07-27T14:38:54.182059+0000","last_became_active":"2023-07-27T14:38:53.724778+0000","last_became_peered":"2023-07-27T14:38:53.724778+0000","last_unstale":"2023-07-27T14:38:54.182059+0000","last_undegraded":"2023-07-27T14:38:54.182059+0000","last_fullsized":"2023-07-27T14:38:54.182059+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201156+0000","last_change":"2023-07-27T14:38:54.196847+0000","last_active":"2023-07-27T14:38:54.201156+0000","last_peered":"2023-07-27T14:38:54.201156+0000","last_clean":"2023-07-27T14:38:54.201156+0000","last_became_active":"2023-07-27T14:38:54.196547+0000","last_became_peered":"2023-07-27T14:38:54.196547+0000","last_unstale":"2023-07-27T14:38:54.201156+0000","last_undegraded":"2023-07-27T14:38:54.201156+0000","last_fullsized":"2023-07-27T14:38:54.201156+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176389+0000","last_change":"2023-07-27T14:38:53.733516+0000","last_active":"2023-07-27T14:38:54.176389+0000","last_peered":"2023-07-27T14:38:54.176389+0000","last_clean":"2023-07-27T14:38:54.176389+0000","last_became_active":"2023-07-27T14:38:53.732608+0000","last_became_peered":"2023-07-27T14:38:53.732608+0000","last_unstale":"2023-07-27T14:38:54.176389+0000","last_undegraded":"2023-07-27T14:38:54.176389+0000","last_fullsized":"2023-07-27T14:38:54.176389+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.204075+0000","last_change":"2023-07-27T14:38:54.203309+0000","last_active":"2023-07-27T14:38:54.204075+0000","last_peered":"2023-07-27T14:38:54.204075+0000","last_clean":"2023-07-27T14:38:54.204075+0000","last_became_active":"2023-07-27T14:38:54.202433+0000","last_became_peered":"2023-07-27T14:38:54.202433+0000","last_unstale":"2023-07-27T14:38:54.204075+0000","last_undegraded":"2023-07-27T14:38:54.204075+0000","last_fullsized":"2023-07-27T14:38:54.204075+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176483+0000","last_change":"2023-07-27T14:38:53.734950+0000","last_active":"2023-07-27T14:38:54.176483+0000","last_peered":"2023-07-27T14:38:54.176483+0000","last_clean":"2023-07-27T14:38:54.176483+0000","last_became_active":"2023-07-27T14:38:53.734612+0000","last_became_peered":"2023-07-27T14:38:53.734612+0000","last_unstale":"2023-07-27T14:38:54.176483+0000","last_undegraded":"2023-07-27T14:38:54.176483+0000","last_fullsized":"2023-07-27T14:38:54.176483+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184640+0000","last_change":"2023-07-27T14:38:54.181963+0000","last_active":"2023-07-27T14:38:54.184640+0000","last_peered":"2023-07-27T14:38:54.184640+0000","last_clean":"2023-07-27T14:38:54.184640+0000","last_became_active":"2023-07-27T14:38:54.181650+0000","last_became_peered":"2023-07-27T14:38:54.181650+0000","last_unstale":"2023-07-27T14:38:54.184640+0000","last_undegraded":"2023-07-27T14:38:54.184640+0000","last_fullsized":"2023-07-27T14:38:54.184640+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.182881+0000","last_change":"2023-07-27T14:38:53.720978+0000","last_active":"2023-07-27T14:38:54.182881+0000","last_peered":"2023-07-27T14:38:54.182881+0000","last_clean":"2023-07-27T14:38:54.182881+0000","last_became_active":"2023-07-27T14:38:53.720696+0000","last_became_peered":"2023-07-27T14:38:53.720696+0000","last_unstale":"2023-07-27T14:38:54.182881+0000","last_undegraded":"2023-07-27T14:38:54.182881+0000","last_fullsized":"2023-07-27T14:38:54.182881+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.186298+0000","last_change":"2023-07-27T14:38:54.179195+0000","last_active":"2023-07-27T14:38:54.186298+0000","last_peered":"2023-07-27T14:38:54.186298+0000","last_clean":"2023-07-27T14:38:54.186298+0000","last_became_active":"2023-07-27T14:38:54.178383+0000","last_became_peered":"2023-07-27T14:38:54.178383+0000","last_unstale":"2023-07-27T14:38:54.186298+0000","last_undegraded":"2023-07-27T14:38:54.186298+0000","last_fullsized":"2023-07-27T14:38:54.186298+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183137+0000","last_change":"2023-07-27T14:38:53.733825+0000","last_active":"2023-07-27T14:38:54.183137+0000","last_peered":"2023-07-27T14:38:54.183137+0000","last_clean":"2023-07-27T14:38:54.183137+0000","last_became_active":"2023-07-27T14:38:53.733545+0000","last_became_peered":"2023-07-27T14:38:53.733545+0000","last_unstale":"2023-07-27T14:38:54.183137+0000","last_undegraded":"2023-07-27T14:38:54.183137+0000","last_fullsized":"2023-07-27T14:38:54.183137+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.190634+0000","last_change":"2023-07-27T14:38:54.188524+0000","last_active":"2023-07-27T14:38:54.190634+0000","last_peered":"2023-07-27T14:38:54.190634+0000","last_clean":"2023-07-27T14:38:54.190634+0000","last_became_active":"2023-07-27T14:38:54.188215+0000","last_became_peered":"2023-07-27T14:38:54.188215+0000","last_unstale":"2023-07-27T14:38:54.190634+0000","last_undegraded":"2023-07-27T14:38:54.190634+0000","last_fullsized":"2023-07-27T14:38:54.190634+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183636+0000","last_change":"2023-07-27T14:38:53.725917+0000","last_active":"2023-07-27T14:38:54.183636+0000","last_peered":"2023-07-27T14:38:54.183636+0000","last_clean":"2023-07-27T14:38:54.183636+0000","last_became_active":"2023-07-27T14:38:53.725309+0000","last_became_peered":"2023-07-27T14:38:53.725309+0000","last_unstale":"2023-07-27T14:38:54.183636+0000","last_undegraded":"2023-07-27T14:38:54.183636+0000","last_fullsized":"2023-07-27T14:38:54.183636+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.194461+0000","last_change":"2023-07-27T14:38:54.191580+0000","last_active":"2023-07-27T14:38:54.194461+0000","last_peered":"2023-07-27T14:38:54.194461+0000","last_clean":"2023-07-27T14:38:54.194461+0000","last_became_active":"2023-07-27T14:38:54.191305+0000","last_became_peered":"2023-07-27T14:38:54.191305+0000","last_unstale":"2023-07-27T14:38:54.194461+0000","last_undegraded":"2023-07-27T14:38:54.194461+0000","last_fullsized":"2023-07-27T14:38:54.194461+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.181403+0000","last_change":"2023-07-27T14:38:53.725242+0000","last_active":"2023-07-27T14:38:54.181403+0000","last_peered":"2023-07-27T14:38:54.181403+0000","last_clean":"2023-07-27T14:38:54.181403+0000","last_became_active":"2023-07-27T14:38:53.724808+0000","last_became_peered":"2023-07-27T14:38:53.724808+0000","last_unstale":"2023-07-27T14:38:54.181403+0000","last_undegraded":"2023-07-27T14:38:54.181403+0000","last_fullsized":"2023-07-27T14:38:54.181403+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202351+0000","last_change":"2023-07-27T14:38:54.200933+0000","last_active":"2023-07-27T14:38:54.202351+0000","last_peered":"2023-07-27T14:38:54.202351+0000","last_clean":"2023-07-27T14:38:54.202351+0000","last_became_active":"2023-07-27T14:38:54.200638+0000","last_became_peered":"2023-07-27T14:38:54.200638+0000","last_unstale":"2023-07-27T14:38:54.202351+0000","last_undegraded":"2023-07-27T14:38:54.202351+0000","last_fullsized":"2023-07-27T14:38:54.202351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.191734+0000","last_change":"2023-07-27T14:38:53.722597+0000","last_active":"2023-07-27T14:38:54.191734+0000","last_peered":"2023-07-27T14:38:54.191734+0000","last_clean":"2023-07-27T14:38:54.191734+0000","last_became_active":"2023-07-27T14:38:53.722317+0000","last_became_peered":"2023-07-27T14:38:53.722317+0000","last_unstale":"2023-07-27T14:38:54.191734+0000","last_undegraded":"2023-07-27T14:38:54.191734+0000","last_fullsized":"2023-07-27T14:38:54.191734+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176282+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:38:54.176282+0000","last_peered":"2023-07-27T14:38:54.176282+0000","last_clean":"2023-07-27T14:38:54.176282+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:38:54.176282+0000","last_undegraded":"2023-07-27T14:38:54.176282+0000","last_fullsized":"2023-07-27T14:38:54.176282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198975+0000","last_change":"2023-07-27T14:38:54.194572+0000","last_active":"2023-07-27T14:38:54.198975+0000","last_peered":"2023-07-27T14:38:54.198975+0000","last_clean":"2023-07-27T14:38:54.198975+0000","last_became_active":"2023-07-27T14:38:54.194183+0000","last_became_peered":"2023-07-27T14:38:54.194183+0000","last_unstale":"2023-07-27T14:38:54.198975+0000","last_undegraded":"2023-07-27T14:38:54.198975+0000","last_fullsized":"2023-07-27T14:38:54.198975+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.173794+0000","last_change":"2023-07-27T14:38:53.720536+0000","last_active":"2023-07-27T14:38:54.173794+0000","last_peered":"2023-07-27T14:38:54.173794+0000","last_clean":"2023-07-27T14:38:54.173794+0000","last_became_active":"2023-07-27T14:38:53.720166+0000","last_became_peered":"2023-07-27T14:38:53.720166+0000","last_unstale":"2023-07-27T14:38:54.173794+0000","last_undegraded":"2023-07-27T14:38:54.173794+0000","last_fullsized":"2023-07-27T14:38:54.173794+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":159,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176386+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:38:54.176386+0000","last_peered":"2023-07-27T14:38:54.176386+0000","last_clean":"2023-07-27T14:38:54.176386+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:38:54.176386+0000","last_undegraded":"2023-07-27T14:38:54.176386+0000","last_fullsized":"2023-07-27T14:38:54.176386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.195603+0000","last_change":"2023-07-27T14:38:54.191138+0000","last_active":"2023-07-27T14:38:54.195603+0000","last_peered":"2023-07-27T14:38:54.195603+0000","last_clean":"2023-07-27T14:38:54.195603+0000","last_became_active":"2023-07-27T14:38:54.190874+0000","last_became_peered":"2023-07-27T14:38:54.190874+0000","last_unstale":"2023-07-27T14:38:54.195603+0000","last_undegraded":"2023-07-27T14:38:54.195603+0000","last_fullsized":"2023-07-27T14:38:54.195603+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.171186+0000","last_change":"2023-07-27T14:38:53.734741+0000","last_active":"2023-07-27T14:38:54.171186+0000","last_peered":"2023-07-27T14:38:54.171186+0000","last_clean":"2023-07-27T14:38:54.171186+0000","last_became_active":"2023-07-27T14:38:53.734366+0000","last_became_peered":"2023-07-27T14:38:53.734366+0000","last_unstale":"2023-07-27T14:38:54.171186+0000","last_undegraded":"2023-07-27T14:38:54.171186+0000","last_fullsized":"2023-07-27T14:38:54.171186+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183714+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:38:54.183714+0000","last_peered":"2023-07-27T14:38:54.183714+0000","last_clean":"2023-07-27T14:38:54.183714+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:38:54.183714+0000","last_undegraded":"2023-07-27T14:38:54.183714+0000","last_fullsized":"2023-07-27T14:38:54.183714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.195030+0000","last_change":"2023-07-27T14:38:54.188490+0000","last_active":"2023-07-27T14:38:54.195030+0000","last_peered":"2023-07-27T14:38:54.195030+0000","last_clean":"2023-07-27T14:38:54.195030+0000","last_became_active":"2023-07-27T14:38:54.187179+0000","last_became_peered":"2023-07-27T14:38:54.187179+0000","last_unstale":"2023-07-27T14:38:54.195030+0000","last_undegraded":"2023-07-27T14:38:54.195030+0000","last_fullsized":"2023-07-27T14:38:54.195030+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.170079+0000","last_change":"2023-07-27T14:38:53.724780+0000","last_active":"2023-07-27T14:38:54.170079+0000","last_peered":"2023-07-27T14:38:54.170079+0000","last_clean":"2023-07-27T14:38:54.170079+0000","last_became_active":"2023-07-27T14:38:53.724458+0000","last_became_peered":"2023-07-27T14:38:53.724458+0000","last_unstale":"2023-07-27T14:38:54.170079+0000","last_undegraded":"2023-07-27T14:38:54.170079+0000","last_fullsized":"2023-07-27T14:38:54.170079+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":159,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175976+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:38:54.175976+0000","last_peered":"2023-07-27T14:38:54.175976+0000","last_clean":"2023-07-27T14:38:54.175976+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:38:54.175976+0000","last_undegraded":"2023-07-27T14:38:54.175976+0000","last_fullsized":"2023-07-27T14:38:54.175976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.188462+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:38:54.188462+0000","last_peered":"2023-07-27T14:38:54.188462+0000","last_clean":"2023-07-27T14:38:54.188462+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:38:54.188462+0000","last_undegraded":"2023-07-27T14:38:54.188462+0000","last_fullsized":"2023-07-27T14:38:54.188462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.188192+0000","last_change":"2023-07-27T14:38:54.186283+0000","last_active":"2023-07-27T14:38:54.188192+0000","last_peered":"2023-07-27T14:38:54.188192+0000","last_clean":"2023-07-27T14:38:54.188192+0000","last_became_active":"2023-07-27T14:38:54.185986+0000","last_became_peered":"2023-07-27T14:38:54.185986+0000","last_unstale":"2023-07-27T14:38:54.188192+0000","last_undegraded":"2023-07-27T14:38:54.188192+0000","last_fullsized":"2023-07-27T14:38:54.188192+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175104+0000","last_change":"2023-07-27T14:38:53.731790+0000","last_active":"2023-07-27T14:38:54.175104+0000","last_peered":"2023-07-27T14:38:54.175104+0000","last_clean":"2023-07-27T14:38:54.175104+0000","last_became_active":"2023-07-27T14:38:53.731534+0000","last_became_peered":"2023-07-27T14:38:53.731534+0000","last_unstale":"2023-07-27T14:38:54.175104+0000","last_undegraded":"2023-07-27T14:38:54.175104+0000","last_fullsized":"2023-07-27T14:38:54.175104+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":158,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.188549+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:38:54.188549+0000","last_peered":"2023-07-27T14:38:54.188549+0000","last_clean":"2023-07-27T14:38:54.188549+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:38:54.188549+0000","last_undegraded":"2023-07-27T14:38:54.188549+0000","last_fullsized":"2023-07-27T14:38:54.188549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.200728+0000","last_change":"2023-07-27T14:38:54.198059+0000","last_active":"2023-07-27T14:38:54.200728+0000","last_peered":"2023-07-27T14:38:54.200728+0000","last_clean":"2023-07-27T14:38:54.200728+0000","last_became_active":"2023-07-27T14:38:54.197571+0000","last_became_peered":"2023-07-27T14:38:54.197571+0000","last_unstale":"2023-07-27T14:38:54.200728+0000","last_undegraded":"2023-07-27T14:38:54.200728+0000","last_fullsized":"2023-07-27T14:38:54.200728+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201804+0000","last_change":"2023-07-27T14:38:53.731529+0000","last_active":"2023-07-27T14:38:54.201804+0000","last_peered":"2023-07-27T14:38:54.201804+0000","last_clean":"2023-07-27T14:38:54.201804+0000","last_became_active":"2023-07-27T14:38:53.731207+0000","last_became_peered":"2023-07-27T14:38:53.731207+0000","last_unstale":"2023-07-27T14:38:54.201804+0000","last_undegraded":"2023-07-27T14:38:54.201804+0000","last_fullsized":"2023-07-27T14:38:54.201804+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184173+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:38:54.184173+0000","last_peered":"2023-07-27T14:38:54.184173+0000","last_clean":"2023-07-27T14:38:54.184173+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:38:54.184173+0000","last_undegraded":"2023-07-27T14:38:54.184173+0000","last_fullsized":"2023-07-27T14:38:54.184173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202351+0000","last_change":"2023-07-27T14:38:54.194837+0000","last_active":"2023-07-27T14:38:54.202351+0000","last_peered":"2023-07-27T14:38:54.202351+0000","last_clean":"2023-07-27T14:38:54.202351+0000","last_became_active":"2023-07-27T14:38:54.194527+0000","last_became_peered":"2023-07-27T14:38:54.194527+0000","last_unstale":"2023-07-27T14:38:54.202351+0000","last_undegraded":"2023-07-27T14:38:54.202351+0000","last_fullsized":"2023-07-27T14:38:54.202351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201804+0000","last_change":"2023-07-27T14:38:53.725451+0000","last_active":"2023-07-27T14:38:54.201804+0000","last_peered":"2023-07-27T14:38:54.201804+0000","last_clean":"2023-07-27T14:38:54.201804+0000","last_became_active":"2023-07-27T14:38:53.725075+0000","last_became_peered":"2023-07-27T14:38:53.725075+0000","last_unstale":"2023-07-27T14:38:54.201804+0000","last_undegraded":"2023-07-27T14:38:54.201804+0000","last_fullsized":"2023-07-27T14:38:54.201804+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.178325+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:38:54.178325+0000","last_peered":"2023-07-27T14:38:54.178325+0000","last_clean":"2023-07-27T14:38:54.178325+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:38:54.178325+0000","last_undegraded":"2023-07-27T14:38:54.178325+0000","last_fullsized":"2023-07-27T14:38:54.178325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.196775+0000","last_change":"2023-07-27T14:38:54.190802+0000","last_active":"2023-07-27T14:38:54.196775+0000","last_peered":"2023-07-27T14:38:54.196775+0000","last_clean":"2023-07-27T14:38:54.196775+0000","last_became_active":"2023-07-27T14:38:54.190507+0000","last_became_peered":"2023-07-27T14:38:54.190507+0000","last_unstale":"2023-07-27T14:38:54.196775+0000","last_undegraded":"2023-07-27T14:38:54.196775+0000","last_fullsized":"2023-07-27T14:38:54.196775+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.172204+0000","last_change":"2023-07-27T14:38:53.727221+0000","last_active":"2023-07-27T14:38:54.172204+0000","last_peered":"2023-07-27T14:38:54.172204+0000","last_clean":"2023-07-27T14:38:54.172204+0000","last_became_active":"2023-07-27T14:38:53.726895+0000","last_became_peered":"2023-07-27T14:38:53.726895+0000","last_unstale":"2023-07-27T14:38:54.172204+0000","last_undegraded":"2023-07-27T14:38:54.172204+0000","last_fullsized":"2023-07-27T14:38:54.172204+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184077+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:38:54.184077+0000","last_peered":"2023-07-27T14:38:54.184077+0000","last_clean":"2023-07-27T14:38:54.184077+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:38:54.184077+0000","last_undegraded":"2023-07-27T14:38:54.184077+0000","last_fullsized":"2023-07-27T14:38:54.184077+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24464,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":22144,"kb_avail":94347376,"statfs":{"total":96636764160,"available":96611713024,"internally_reserved":0,"allocated":2367488,"data_stored":1119384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22675456},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.996,"15min":1.133},"last":0.624},{"interface":"front","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.89900000000000002,"15min":1.1180000000000001},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64600000000000002,"15min":0.68700000000000006},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86299999999999999,"5min":0.879,"15min":1.1759999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.70099999999999996},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.92500000000000004,"15min":1.1459999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.66700000000000004},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78400000000000003,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.77100000000000002,"5min":0.89300000000000002,"15min":1.119},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.54400000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78800000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":1.165},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.0129999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":1.105,"15min":1.202},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":0.83099999999999996,"5min":1.0069999999999999,"15min":1.101},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.752,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":0.92100000000000004,"5min":1.03,"15min":1.056},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90200000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.81399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24076,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":21760,"kb_avail":94347764,"statfs":{"total":96636764160,"available":96612110336,"internally_reserved":0,"allocated":2363392,"data_stored":1118830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22282240},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.68600000000000005,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.8940000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.67700000000000005,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":6.6980000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":0.748,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.975,"5min":13.975,"15min":13.975},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.70999999999999996,"15min":0.66500000000000004},"min":{"1min":0.53000000000000003,"5min":0.44,"15min":0.36699999999999999},"max":{"1min":7.8440000000000003,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.323,"5min":0.78400000000000003,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":14.018000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.55500000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.9530000000000003,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.038,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":0.78200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.36399999999999999},"max":{"1min":15.638999999999999,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.72399999999999998,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":8.0169999999999995,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.503},{"interface":"front","average":{"1min":1.4159999999999999,"5min":0.83499999999999996,"15min":0.73799999999999999},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":15.461,"5min":15.461,"15min":15.461},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.78400000000000003,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":5.5499999999999998,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.117,"5min":0.82799999999999996,"15min":0.78500000000000003},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":8.0670000000000002,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.749}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24712,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":22400,"kb_avail":94347128,"statfs":{"total":96636764160,"available":96611459072,"internally_reserved":0,"allocated":2359296,"data_stored":1117938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22937600},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.44900000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.23699999999999999},"max":{"1min":0.53700000000000003,"5min":0.61499999999999999,"15min":4.75},"last":0.377},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41599999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":9.3100000000000005},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":2.7160000000000002},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.496},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45900000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57599999999999996,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.94499999999999995,"5min":1.1639999999999999,"15min":2.181},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.70799999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.92400000000000004,"5min":1.014,"15min":2.4180000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.621},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.45400000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.55300000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95999999999999996,"5min":1.085,"15min":2.052},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.77500000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95699999999999996,"5min":1.1419999999999999,"15min":2.016},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.59899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.629}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23324,"kb_used_data":2324,"kb_used_omap":0,"kb_used_meta":20992,"kb_avail":94348516,"statfs":{"total":96636764160,"available":96612880384,"internally_reserved":0,"allocated":2379776,"data_stored":1118708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21495808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.245},"max":{"1min":0.56399999999999995,"5min":1.954,"15min":1.954},"last":0.315},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41099999999999998,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.443},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45900000000000002,"15min":0.46500000000000002},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52000000000000002,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.57699999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.55000000000000004,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71599999999999997},"min":{"1min":0.59199999999999997,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":1.034,"5min":1.0489999999999999,"15min":1.25},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.6020000000000001},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.498},"max":{"1min":0.88700000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.22},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.109,"5min":2.141,"15min":2.141},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.63700000000000001,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":0.93999999999999995,"5min":1.125,"15min":1.2370000000000001},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26824,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":24512,"kb_avail":94345016,"statfs":{"total":96636764160,"available":96609296384,"internally_reserved":0,"allocated":2359296,"data_stored":1117938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25100288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.77100000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.42499999999999999,"15min":0.45800000000000002},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57199999999999995,"5min":0.60999999999999999,"15min":1.1899999999999999},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.624,"5min":0.64700000000000002,"15min":0.96399999999999997},"last":0.502},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.68999999999999995,"15min":5.601},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.83499999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":1.002,"15min":1.353},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.42999999999999999},"max":{"1min":0.78800000000000003,"5min":0.90600000000000003,"15min":1.849},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":0.95399999999999996,"5min":0.95499999999999996,"15min":6.9660000000000002},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.57299999999999995,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":1.163,"15min":1.163},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.58199999999999996,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":1.04,"15min":1.772},"last":0.622}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.58099999999999996,"5min":0.48199999999999998,"15min":0.42499999999999999},"max":{"1min":0.84799999999999998,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.749},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72399999999999998,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":1.105,"15min":3.1360000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.024,"5min":1.024,"15min":1.8089999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":1.0569999999999999,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23116,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94348724,"statfs":{"total":96636764160,"available":96613093376,"internally_reserved":0,"allocated":2363392,"data_stored":1118028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.52300000000000002,"5min":0.66800000000000004,"15min":1.202},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.42999999999999999},"min":{"1min":0.32700000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":1.302},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":0.64300000000000002,"15min":1.2390000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.626,"5min":0.69199999999999995,"15min":1.8029999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68899999999999995},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":0.97399999999999998,"15min":1.149},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.85899999999999999,"5min":0.94099999999999995,"15min":5.1059999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.59999999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":1.232},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.298},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.55000000000000004,"5min":0.501,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.343},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.94199999999999995,"5min":1.115,"15min":2.048},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.93100000000000005,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.77400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17940,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94353900,"statfs":{"total":96636764160,"available":96618393600,"internally_reserved":0,"allocated":2371584,"data_stored":1118616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.5,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.876,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":3.419,"15min":4.4409999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":2.3010000000000002,"15min":4.476},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94099999999999995,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85099999999999998,"5min":3.48,"15min":4.3949999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.40600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79000000000000004,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":3.8620000000000001,"15min":5.194},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.56000000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":2.387,"15min":5.5990000000000002},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.59299999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0960000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574996,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26072,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":23744,"kb_avail":94345768,"statfs":{"total":96636764160,"available":96610066432,"internally_reserved":0,"allocated":2375680,"data_stored":1118674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24313856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.443,"5min":0.35499999999999998,"15min":0.317},"max":{"1min":0.874,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58599999999999997,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84099999999999997,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.747}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.69099999999999995},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.377},"max":{"1min":0.94599999999999995,"5min":1.026,"15min":6.7489999999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.878,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":0.81699999999999995,"5min":0.98799999999999999,"15min":1.581},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.66100000000000003},"min":{"1min":0.51800000000000002,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":0.92500000000000004,"5min":0.98999999999999999,"15min":3.8220000000000001},"last":0.877}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.67400000000000004},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.77200000000000002,"5min":0.89800000000000002,"15min":9.6920000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":1.978},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.86299999999999999,"5min":1.115,"15min":1.9419999999999999},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:39:01.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:39:01.852 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:39:03.365 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:39:03.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.509+0000 7f71a19ff700 1 Processor -- start 2023-07-27T14:39:03.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.510+0000 7f71a19ff700 1 -- start start 2023-07-27T14:39:03.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f71a19ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f719c151d70 0x7f719c155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:03.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f71a19ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 0x7f719c066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:03.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f71a19ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f719c066960 0x7f719c157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:03.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f71a19ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c063a90 con 0x7f719c151d70 2023-07-27T14:39:03.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f71a19ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c067080 con 0x7f719c066960 2023-07-27T14:39:03.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f71a19ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c066df0 con 0x7f719c065ff0 2023-07-27T14:39:03.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f719affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f719c151d70 0x7f719c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:03.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f719affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f719c151d70 0x7f719c155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57850/0 (socket says 172.21.15.115:57850) 2023-07-27T14:39:03.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f719affd700 1 -- 172.21.15.115:0/1641665658 learned_addr learned my addr 172.21.15.115:0/1641665658 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:03.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f719b7fe700 1 --2- 172.21.15.115:0/1641665658 >> v2:172.21.15.159:3300/0 conn(0x7f719c066960 0x7f719c157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:03.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.511+0000 7f719a7fc700 1 --2- 172.21.15.115:0/1641665658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 0x7f719c066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:03.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f719affd700 1 -- 172.21.15.115:0/1641665658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 msgr2=0x7f719c066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:03.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f719affd700 1 --2- 172.21.15.115:0/1641665658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 0x7f719c066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f719affd700 1 -- 172.21.15.115:0/1641665658 >> v2:172.21.15.159:3300/0 conn(0x7f719c066960 msgr2=0x7f719c157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:03.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f719affd700 1 --2- 172.21.15.115:0/1641665658 >> v2:172.21.15.159:3300/0 conn(0x7f719c066960 0x7f719c157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f719affd700 1 -- 172.21.15.115:0/1641665658 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0634d0 con 0x7f719c151d70 2023-07-27T14:39:03.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f719affd700 1 --2- 172.21.15.115:0/1641665658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c155060 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f719c069f70 tx=0x7f718c0090f0).ready entity=mon.0 client_cookie=71063a9edbd160a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:03.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f7199ffb700 1 -- 172.21.15.115:0/1641665658 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00b600 con 0x7f719c151d70 2023-07-27T14:39:03.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f7199ffb700 1 -- 172.21.15.115:0/1641665658 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c00b760 con 0x7f719c151d70 2023-07-27T14:39:03.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f7199ffb700 1 -- 172.21.15.115:0/1641665658 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00bae0 con 0x7f719c151d70 2023-07-27T14:39:03.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f71a19ff700 1 -- 172.21.15.115:0/1641665658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 msgr2=0x7f719c155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:03.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.512+0000 7f71a19ff700 1 --2- 172.21.15.115:0/1641665658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c155060 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f719c069f70 tx=0x7f718c0090f0).stop 2023-07-27T14:39:03.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.513+0000 7f71a19ff700 1 -- 172.21.15.115:0/1641665658 shutdown_connections 2023-07-27T14:39:03.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.513+0000 7f71a19ff700 1 --2- 172.21.15.115:0/1641665658 >> v2:172.21.15.159:3300/0 conn(0x7f719c066960 0x7f719c157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.513+0000 7f71a19ff700 1 --2- 172.21.15.115:0/1641665658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c155060 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.513+0000 7f71a19ff700 1 --2- 172.21.15.115:0/1641665658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 0x7f719c066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.513+0000 7f71a19ff700 1 -- 172.21.15.115:0/1641665658 >> 172.21.15.115:0/1641665658 conn(0x7f719c0c89a0 msgr2=0x7f719c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:03.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.513+0000 7f71a19ff700 1 -- 172.21.15.115:0/1641665658 shutdown_connections 2023-07-27T14:39:03.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.513+0000 7f71a19ff700 1 -- 172.21.15.115:0/1641665658 wait complete. 2023-07-27T14:39:03.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.514+0000 7f71a19ff700 1 Processor -- start 2023-07-27T14:39:03.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.514+0000 7f71a19ff700 1 -- start start 2023-07-27T14:39:03.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.515+0000 7f71a19ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 0x7f719c164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:03.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.515+0000 7f71a19ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c066960 0x7f719c14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:03.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.515+0000 7f71a19ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c0ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:03.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.515+0000 7f71a19ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c14e970 con 0x7f719c151d70 2023-07-27T14:39:03.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.515+0000 7f71a19ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0ae140 con 0x7f719c066960 2023-07-27T14:39:03.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.515+0000 7f71a19ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c155e10 con 0x7f719c065ff0 2023-07-27T14:39:03.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c0ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:03.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c0ac230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57862/0 (socket says 172.21.15.115:57862) 2023-07-27T14:39:03.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 -- 172.21.15.115:0/248101782 learned_addr learned my addr 172.21.15.115:0/248101782 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:03.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719affd700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 0x7f719c164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:03.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719a7fc700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c066960 0x7f719c14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:03.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 -- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 msgr2=0x7f719c164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:03.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 0x7f719c164f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 -- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c066960 msgr2=0x7f719c14a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:03.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c066960 0x7f719c14a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 -- 172.21.15.115:0/248101782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c009370 con 0x7f719c151d70 2023-07-27T14:39:03.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719a7fc700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c066960 0x7f719c14a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:03.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f719b7fe700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c0ac230 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f7194009fa0 tx=0x7f7194009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:03.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f7182ffd700 1 -- 172.21.15.115:0/248101782 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400ec70 con 0x7f719c151d70 2023-07-27T14:39:03.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f7182ffd700 1 -- 172.21.15.115:0/248101782 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719400edd0 con 0x7f719c151d70 2023-07-27T14:39:03.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c165430 con 0x7f719c151d70 2023-07-27T14:39:03.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.516+0000 7f7182ffd700 1 -- 172.21.15.115:0/248101782 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194014610 con 0x7f719c151d70 2023-07-27T14:39:03.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.517+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c0ae650 con 0x7f719c151d70 2023-07-27T14:39:03.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.517+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c06c470 con 0x7f719c151d70 2023-07-27T14:39:03.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.519+0000 7f7182ffd700 1 -- 172.21.15.115:0/248101782 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f719401b030 con 0x7f719c151d70 2023-07-27T14:39:03.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.519+0000 7f7182ffd700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805fb50 0x7f7188062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:03.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.519+0000 7f7182ffd700 1 -- 172.21.15.115:0/248101782 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f719407b4e0 con 0x7f719c151d70 2023-07-27T14:39:03.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.520+0000 7f719affd700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805fb50 0x7f7188062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:03.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.520+0000 7f719affd700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805fb50 0x7f7188062010 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f718c009130 tx=0x7f718c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:03.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.524+0000 7f7182ffd700 1 -- 172.21.15.115:0/248101782 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f719404bb50 con 0x7f719c151d70 2023-07-27T14:39:03.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.691+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f719c068720 con 0x7f718805fb50 2023-07-27T14:39:03.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.702+0000 7f7182ffd700 1 -- 172.21.15.115:0/248101782 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361970 (secure 0 0 0) 0x7f719c068720 con 0x7f718805fb50 2023-07-27T14:39:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:03.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805fb50 msgr2=0x7f7188062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:03.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805fb50 0x7f7188062010 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f718c009130 tx=0x7f718c017000).stop 2023-07-27T14:39:03.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 msgr2=0x7f719c0ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:03.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c0ac230 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f7194009fa0 tx=0x7f7194009900).stop 2023-07-27T14:39:03.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 shutdown_connections 2023-07-27T14:39:03.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f718805fb50 0x7f7188062010 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f719c151d70 0x7f719c0ac230 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f719c065ff0 0x7f719c164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 --2- 172.21.15.115:0/248101782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f719c066960 0x7f719c14a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:03.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 >> 172.21.15.115:0/248101782 conn(0x7f719c0c89a0 msgr2=0x7f719c152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:03.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 shutdown_connections 2023-07-27T14:39:03.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.706+0000 7f71a19ff700 1 -- 172.21.15.115:0/248101782 wait complete. 2023-07-27T14:39:03.765 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:39:03.777 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2023-07-27T14:39:03.602100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":247,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":190528,"kb_used_data":18496,"kb_used_omap":0,"kb_used_meta":171968,"kb_avail":754784192,"statfs":{"total":773094113280,"available":772899012608,"internally_reserved":0,"allocated":18939904,"data_stored":8948116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":176095232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-516379,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-22,"num_read_kb":-8206,"num_write":-232,"num_write_kb":-16981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.273978"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183911+0000","last_change":"2023-07-27T14:38:54.179389+0000","last_active":"2023-07-27T14:38:54.183911+0000","last_peered":"2023-07-27T14:38:54.183911+0000","last_clean":"2023-07-27T14:38:54.183911+0000","last_became_active":"2023-07-27T14:38:54.179115+0000","last_became_peered":"2023-07-27T14:38:54.179115+0000","last_unstale":"2023-07-27T14:38:54.183911+0000","last_undegraded":"2023-07-27T14:38:54.183911+0000","last_fullsized":"2023-07-27T14:38:54.183911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"187'3","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201685+0000","last_change":"2023-07-27T14:38:53.718050+0000","last_active":"2023-07-27T14:38:54.201685+0000","last_peered":"2023-07-27T14:38:54.201685+0000","last_clean":"2023-07-27T14:38:54.201685+0000","last_became_active":"2023-07-27T14:38:53.717750+0000","last_became_peered":"2023-07-27T14:38:53.717750+0000","last_unstale":"2023-07-27T14:38:54.201685+0000","last_undegraded":"2023-07-27T14:38:54.201685+0000","last_fullsized":"2023-07-27T14:38:54.201685+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198066+0000","last_change":"2023-07-27T14:38:54.196191+0000","last_active":"2023-07-27T14:38:54.198066+0000","last_peered":"2023-07-27T14:38:54.198066+0000","last_clean":"2023-07-27T14:38:54.198066+0000","last_became_active":"2023-07-27T14:38:54.195678+0000","last_became_peered":"2023-07-27T14:38:54.195678+0000","last_unstale":"2023-07-27T14:38:54.198066+0000","last_undegraded":"2023-07-27T14:38:54.198066+0000","last_fullsized":"2023-07-27T14:38:54.198066+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183320+0000","last_change":"2023-07-27T14:38:53.736258+0000","last_active":"2023-07-27T14:38:54.183320+0000","last_peered":"2023-07-27T14:38:54.183320+0000","last_clean":"2023-07-27T14:38:54.183320+0000","last_became_active":"2023-07-27T14:38:53.735931+0000","last_became_peered":"2023-07-27T14:38:53.735931+0000","last_unstale":"2023-07-27T14:38:54.183320+0000","last_undegraded":"2023-07-27T14:38:54.183320+0000","last_fullsized":"2023-07-27T14:38:54.183320+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199773+0000","last_change":"2023-07-27T14:38:54.195098+0000","last_active":"2023-07-27T14:38:54.199773+0000","last_peered":"2023-07-27T14:38:54.199773+0000","last_clean":"2023-07-27T14:38:54.199773+0000","last_became_active":"2023-07-27T14:38:54.194834+0000","last_became_peered":"2023-07-27T14:38:54.194834+0000","last_unstale":"2023-07-27T14:38:54.199773+0000","last_undegraded":"2023-07-27T14:38:54.199773+0000","last_fullsized":"2023-07-27T14:38:54.199773+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176779+0000","last_change":"2023-07-27T14:38:53.722691+0000","last_active":"2023-07-27T14:38:54.176779+0000","last_peered":"2023-07-27T14:38:54.176779+0000","last_clean":"2023-07-27T14:38:54.176779+0000","last_became_active":"2023-07-27T14:38:53.722417+0000","last_became_peered":"2023-07-27T14:38:53.722417+0000","last_unstale":"2023-07-27T14:38:54.176779+0000","last_undegraded":"2023-07-27T14:38:54.176779+0000","last_fullsized":"2023-07-27T14:38:54.176779+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198944+0000","last_change":"2023-07-27T14:38:54.192767+0000","last_active":"2023-07-27T14:38:54.198944+0000","last_peered":"2023-07-27T14:38:54.198944+0000","last_clean":"2023-07-27T14:38:54.198944+0000","last_became_active":"2023-07-27T14:38:54.192461+0000","last_became_peered":"2023-07-27T14:38:54.192461+0000","last_unstale":"2023-07-27T14:38:54.198944+0000","last_undegraded":"2023-07-27T14:38:54.198944+0000","last_fullsized":"2023-07-27T14:38:54.198944+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.191821+0000","last_change":"2023-07-27T14:38:53.737308+0000","last_active":"2023-07-27T14:38:54.191821+0000","last_peered":"2023-07-27T14:38:54.191821+0000","last_clean":"2023-07-27T14:38:54.191821+0000","last_became_active":"2023-07-27T14:38:53.737082+0000","last_became_peered":"2023-07-27T14:38:53.737082+0000","last_unstale":"2023-07-27T14:38:54.191821+0000","last_undegraded":"2023-07-27T14:38:54.191821+0000","last_fullsized":"2023-07-27T14:38:54.191821+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.203919+0000","last_change":"2023-07-27T14:38:54.202994+0000","last_active":"2023-07-27T14:38:54.203919+0000","last_peered":"2023-07-27T14:38:54.203919+0000","last_clean":"2023-07-27T14:38:54.203919+0000","last_became_active":"2023-07-27T14:38:54.202700+0000","last_became_peered":"2023-07-27T14:38:54.202700+0000","last_unstale":"2023-07-27T14:38:54.203919+0000","last_undegraded":"2023-07-27T14:38:54.203919+0000","last_fullsized":"2023-07-27T14:38:54.203919+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201633+0000","last_change":"2023-07-27T14:38:53.721630+0000","last_active":"2023-07-27T14:38:54.201633+0000","last_peered":"2023-07-27T14:38:54.201633+0000","last_clean":"2023-07-27T14:38:54.201633+0000","last_became_active":"2023-07-27T14:38:53.721159+0000","last_became_peered":"2023-07-27T14:38:53.721159+0000","last_unstale":"2023-07-27T14:38:54.201633+0000","last_undegraded":"2023-07-27T14:38:54.201633+0000","last_fullsized":"2023-07-27T14:38:54.201633+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201104+0000","last_change":"2023-07-27T14:38:54.199834+0000","last_active":"2023-07-27T14:38:54.201104+0000","last_peered":"2023-07-27T14:38:54.201104+0000","last_clean":"2023-07-27T14:38:54.201104+0000","last_became_active":"2023-07-27T14:38:54.199566+0000","last_became_peered":"2023-07-27T14:38:54.199566+0000","last_unstale":"2023-07-27T14:38:54.201104+0000","last_undegraded":"2023-07-27T14:38:54.201104+0000","last_fullsized":"2023-07-27T14:38:54.201104+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199099+0000","last_change":"2023-07-27T14:38:53.727159+0000","last_active":"2023-07-27T14:38:54.199099+0000","last_peered":"2023-07-27T14:38:54.199099+0000","last_clean":"2023-07-27T14:38:54.199099+0000","last_became_active":"2023-07-27T14:38:53.726889+0000","last_became_peered":"2023-07-27T14:38:53.726889+0000","last_unstale":"2023-07-27T14:38:54.199099+0000","last_undegraded":"2023-07-27T14:38:54.199099+0000","last_fullsized":"2023-07-27T14:38:54.199099+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199969+0000","last_change":"2023-07-27T14:38:54.191435+0000","last_active":"2023-07-27T14:38:54.199969+0000","last_peered":"2023-07-27T14:38:54.199969+0000","last_clean":"2023-07-27T14:38:54.199969+0000","last_became_active":"2023-07-27T14:38:54.191101+0000","last_became_peered":"2023-07-27T14:38:54.191101+0000","last_unstale":"2023-07-27T14:38:54.199969+0000","last_undegraded":"2023-07-27T14:38:54.199969+0000","last_fullsized":"2023-07-27T14:38:54.199969+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.173841+0000","last_change":"2023-07-27T14:38:53.723397+0000","last_active":"2023-07-27T14:38:54.173841+0000","last_peered":"2023-07-27T14:38:54.173841+0000","last_clean":"2023-07-27T14:38:54.173841+0000","last_became_active":"2023-07-27T14:38:53.723124+0000","last_became_peered":"2023-07-27T14:38:53.723124+0000","last_unstale":"2023-07-27T14:38:54.173841+0000","last_undegraded":"2023-07-27T14:38:54.173841+0000","last_fullsized":"2023-07-27T14:38:54.173841+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197370+0000","last_change":"2023-07-27T14:38:54.191335+0000","last_active":"2023-07-27T14:38:54.197370+0000","last_peered":"2023-07-27T14:38:54.197370+0000","last_clean":"2023-07-27T14:38:54.197370+0000","last_became_active":"2023-07-27T14:38:54.190891+0000","last_became_peered":"2023-07-27T14:38:54.190891+0000","last_unstale":"2023-07-27T14:38:54.197370+0000","last_undegraded":"2023-07-27T14:38:54.197370+0000","last_fullsized":"2023-07-27T14:38:54.197370+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175404+0000","last_change":"2023-07-27T14:38:53.734570+0000","last_active":"2023-07-27T14:38:54.175404+0000","last_peered":"2023-07-27T14:38:54.175404+0000","last_clean":"2023-07-27T14:38:54.175404+0000","last_became_active":"2023-07-27T14:38:53.734032+0000","last_became_peered":"2023-07-27T14:38:53.734032+0000","last_unstale":"2023-07-27T14:38:54.175404+0000","last_undegraded":"2023-07-27T14:38:54.175404+0000","last_fullsized":"2023-07-27T14:38:54.175404+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198864+0000","last_change":"2023-07-27T14:38:54.196698+0000","last_active":"2023-07-27T14:38:54.198864+0000","last_peered":"2023-07-27T14:38:54.198864+0000","last_clean":"2023-07-27T14:38:54.198864+0000","last_became_active":"2023-07-27T14:38:54.196473+0000","last_became_peered":"2023-07-27T14:38:54.196473+0000","last_unstale":"2023-07-27T14:38:54.198864+0000","last_undegraded":"2023-07-27T14:38:54.198864+0000","last_fullsized":"2023-07-27T14:38:54.198864+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175867+0000","last_change":"2023-07-27T14:38:53.725422+0000","last_active":"2023-07-27T14:38:54.175867+0000","last_peered":"2023-07-27T14:38:54.175867+0000","last_clean":"2023-07-27T14:38:54.175867+0000","last_became_active":"2023-07-27T14:38:53.725145+0000","last_became_peered":"2023-07-27T14:38:53.725145+0000","last_unstale":"2023-07-27T14:38:54.175867+0000","last_undegraded":"2023-07-27T14:38:54.175867+0000","last_fullsized":"2023-07-27T14:38:54.175867+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201851+0000","last_change":"2023-07-27T14:38:54.190341+0000","last_active":"2023-07-27T14:38:54.201851+0000","last_peered":"2023-07-27T14:38:54.201851+0000","last_clean":"2023-07-27T14:38:54.201851+0000","last_became_active":"2023-07-27T14:38:54.190078+0000","last_became_peered":"2023-07-27T14:38:54.190078+0000","last_unstale":"2023-07-27T14:38:54.201851+0000","last_undegraded":"2023-07-27T14:38:54.201851+0000","last_fullsized":"2023-07-27T14:38:54.201851+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.171251+0000","last_change":"2023-07-27T14:38:53.726135+0000","last_active":"2023-07-27T14:38:54.171251+0000","last_peered":"2023-07-27T14:38:54.171251+0000","last_clean":"2023-07-27T14:38:54.171251+0000","last_became_active":"2023-07-27T14:38:53.725769+0000","last_became_peered":"2023-07-27T14:38:53.725769+0000","last_unstale":"2023-07-27T14:38:54.171251+0000","last_undegraded":"2023-07-27T14:38:54.171251+0000","last_fullsized":"2023-07-27T14:38:54.171251+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198625+0000","last_change":"2023-07-27T14:38:54.196902+0000","last_active":"2023-07-27T14:38:54.198625+0000","last_peered":"2023-07-27T14:38:54.198625+0000","last_clean":"2023-07-27T14:38:54.198625+0000","last_became_active":"2023-07-27T14:38:54.196639+0000","last_became_peered":"2023-07-27T14:38:54.196639+0000","last_unstale":"2023-07-27T14:38:54.198625+0000","last_undegraded":"2023-07-27T14:38:54.198625+0000","last_fullsized":"2023-07-27T14:38:54.198625+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.172804+0000","last_change":"2023-07-27T14:38:53.720515+0000","last_active":"2023-07-27T14:38:54.172804+0000","last_peered":"2023-07-27T14:38:54.172804+0000","last_clean":"2023-07-27T14:38:54.172804+0000","last_became_active":"2023-07-27T14:38:53.720211+0000","last_became_peered":"2023-07-27T14:38:53.720211+0000","last_unstale":"2023-07-27T14:38:54.172804+0000","last_undegraded":"2023-07-27T14:38:54.172804+0000","last_fullsized":"2023-07-27T14:38:54.172804+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199802+0000","last_change":"2023-07-27T14:38:54.196536+0000","last_active":"2023-07-27T14:38:54.199802+0000","last_peered":"2023-07-27T14:38:54.199802+0000","last_clean":"2023-07-27T14:38:54.199802+0000","last_became_active":"2023-07-27T14:38:54.196339+0000","last_became_peered":"2023-07-27T14:38:54.196339+0000","last_unstale":"2023-07-27T14:38:54.199802+0000","last_undegraded":"2023-07-27T14:38:54.199802+0000","last_fullsized":"2023-07-27T14:38:54.199802+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"187'4","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.204542+0000","last_change":"2023-07-27T14:38:53.730098+0000","last_active":"2023-07-27T14:38:54.204542+0000","last_peered":"2023-07-27T14:38:54.204542+0000","last_clean":"2023-07-27T14:38:54.204542+0000","last_became_active":"2023-07-27T14:38:53.728964+0000","last_became_peered":"2023-07-27T14:38:53.728964+0000","last_unstale":"2023-07-27T14:38:54.204542+0000","last_undegraded":"2023-07-27T14:38:54.204542+0000","last_fullsized":"2023-07-27T14:38:54.204542+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198571+0000","last_change":"2023-07-27T14:38:54.196134+0000","last_active":"2023-07-27T14:38:54.198571+0000","last_peered":"2023-07-27T14:38:54.198571+0000","last_clean":"2023-07-27T14:38:54.198571+0000","last_became_active":"2023-07-27T14:38:54.195819+0000","last_became_peered":"2023-07-27T14:38:54.195819+0000","last_unstale":"2023-07-27T14:38:54.198571+0000","last_undegraded":"2023-07-27T14:38:54.198571+0000","last_fullsized":"2023-07-27T14:38:54.198571+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.195494+0000","last_change":"2023-07-27T14:38:53.727979+0000","last_active":"2023-07-27T14:38:54.195494+0000","last_peered":"2023-07-27T14:38:54.195494+0000","last_clean":"2023-07-27T14:38:54.195494+0000","last_became_active":"2023-07-27T14:38:53.727659+0000","last_became_peered":"2023-07-27T14:38:53.727659+0000","last_unstale":"2023-07-27T14:38:54.195494+0000","last_undegraded":"2023-07-27T14:38:54.195494+0000","last_fullsized":"2023-07-27T14:38:54.195494+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.192246+0000","last_change":"2023-07-27T14:38:54.190090+0000","last_active":"2023-07-27T14:38:54.192246+0000","last_peered":"2023-07-27T14:38:54.192246+0000","last_clean":"2023-07-27T14:38:54.192246+0000","last_became_active":"2023-07-27T14:38:54.188628+0000","last_became_peered":"2023-07-27T14:38:54.188628+0000","last_unstale":"2023-07-27T14:38:54.192246+0000","last_undegraded":"2023-07-27T14:38:54.192246+0000","last_fullsized":"2023-07-27T14:38:54.192246+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176184+0000","last_change":"2023-07-27T14:38:53.728406+0000","last_active":"2023-07-27T14:38:54.176184+0000","last_peered":"2023-07-27T14:38:54.176184+0000","last_clean":"2023-07-27T14:38:54.176184+0000","last_became_active":"2023-07-27T14:38:53.728126+0000","last_became_peered":"2023-07-27T14:38:53.728126+0000","last_unstale":"2023-07-27T14:38:54.176184+0000","last_undegraded":"2023-07-27T14:38:54.176184+0000","last_fullsized":"2023-07-27T14:38:54.176184+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197691+0000","last_change":"2023-07-27T14:38:54.193276+0000","last_active":"2023-07-27T14:38:54.197691+0000","last_peered":"2023-07-27T14:38:54.197691+0000","last_clean":"2023-07-27T14:38:54.197691+0000","last_became_active":"2023-07-27T14:38:54.193003+0000","last_became_peered":"2023-07-27T14:38:54.193003+0000","last_unstale":"2023-07-27T14:38:54.197691+0000","last_undegraded":"2023-07-27T14:38:54.197691+0000","last_fullsized":"2023-07-27T14:38:54.197691+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.189907+0000","last_change":"2023-07-27T14:38:53.724548+0000","last_active":"2023-07-27T14:38:54.189907+0000","last_peered":"2023-07-27T14:38:54.189907+0000","last_clean":"2023-07-27T14:38:54.189907+0000","last_became_active":"2023-07-27T14:38:53.724190+0000","last_became_peered":"2023-07-27T14:38:53.724190+0000","last_unstale":"2023-07-27T14:38:54.189907+0000","last_undegraded":"2023-07-27T14:38:54.189907+0000","last_fullsized":"2023-07-27T14:38:54.189907+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.186733+0000","last_change":"2023-07-27T14:38:54.178691+0000","last_active":"2023-07-27T14:38:54.186733+0000","last_peered":"2023-07-27T14:38:54.186733+0000","last_clean":"2023-07-27T14:38:54.186733+0000","last_became_active":"2023-07-27T14:38:54.178356+0000","last_became_peered":"2023-07-27T14:38:54.178356+0000","last_unstale":"2023-07-27T14:38:54.186733+0000","last_undegraded":"2023-07-27T14:38:54.186733+0000","last_fullsized":"2023-07-27T14:38:54.186733+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"187'4","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202034+0000","last_change":"2023-07-27T14:38:53.734743+0000","last_active":"2023-07-27T14:38:54.202034+0000","last_peered":"2023-07-27T14:38:54.202034+0000","last_clean":"2023-07-27T14:38:54.202034+0000","last_became_active":"2023-07-27T14:38:53.734316+0000","last_became_peered":"2023-07-27T14:38:53.734316+0000","last_unstale":"2023-07-27T14:38:54.202034+0000","last_undegraded":"2023-07-27T14:38:54.202034+0000","last_fullsized":"2023-07-27T14:38:54.202034+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198558+0000","last_change":"2023-07-27T14:38:54.194313+0000","last_active":"2023-07-27T14:38:54.198558+0000","last_peered":"2023-07-27T14:38:54.198558+0000","last_clean":"2023-07-27T14:38:54.198558+0000","last_became_active":"2023-07-27T14:38:54.193989+0000","last_became_peered":"2023-07-27T14:38:54.193989+0000","last_unstale":"2023-07-27T14:38:54.198558+0000","last_undegraded":"2023-07-27T14:38:54.198558+0000","last_fullsized":"2023-07-27T14:38:54.198558+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.185755+0000","last_change":"2023-07-27T14:38:53.726099+0000","last_active":"2023-07-27T14:38:54.185755+0000","last_peered":"2023-07-27T14:38:54.185755+0000","last_clean":"2023-07-27T14:38:54.185755+0000","last_became_active":"2023-07-27T14:38:53.725627+0000","last_became_peered":"2023-07-27T14:38:53.725627+0000","last_unstale":"2023-07-27T14:38:54.185755+0000","last_undegraded":"2023-07-27T14:38:54.185755+0000","last_fullsized":"2023-07-27T14:38:54.185755+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197985+0000","last_change":"2023-07-27T14:38:54.194787+0000","last_active":"2023-07-27T14:38:54.197985+0000","last_peered":"2023-07-27T14:38:54.197985+0000","last_clean":"2023-07-27T14:38:54.197985+0000","last_became_active":"2023-07-27T14:38:54.194476+0000","last_became_peered":"2023-07-27T14:38:54.194476+0000","last_unstale":"2023-07-27T14:38:54.197985+0000","last_undegraded":"2023-07-27T14:38:54.197985+0000","last_fullsized":"2023-07-27T14:38:54.197985+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.185117+0000","last_change":"2023-07-27T14:38:53.720133+0000","last_active":"2023-07-27T14:38:54.185117+0000","last_peered":"2023-07-27T14:38:54.185117+0000","last_clean":"2023-07-27T14:38:54.185117+0000","last_became_active":"2023-07-27T14:38:53.719831+0000","last_became_peered":"2023-07-27T14:38:53.719831+0000","last_unstale":"2023-07-27T14:38:54.185117+0000","last_undegraded":"2023-07-27T14:38:54.185117+0000","last_fullsized":"2023-07-27T14:38:54.185117+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199390+0000","last_change":"2023-07-27T14:38:54.197237+0000","last_active":"2023-07-27T14:38:54.199390+0000","last_peered":"2023-07-27T14:38:54.199390+0000","last_clean":"2023-07-27T14:38:54.199390+0000","last_became_active":"2023-07-27T14:38:54.196866+0000","last_became_peered":"2023-07-27T14:38:54.196866+0000","last_unstale":"2023-07-27T14:38:54.199390+0000","last_undegraded":"2023-07-27T14:38:54.199390+0000","last_fullsized":"2023-07-27T14:38:54.199390+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202672+0000","last_change":"2023-07-27T14:38:53.723980+0000","last_active":"2023-07-27T14:38:54.202672+0000","last_peered":"2023-07-27T14:38:54.202672+0000","last_clean":"2023-07-27T14:38:54.202672+0000","last_became_active":"2023-07-27T14:38:53.723686+0000","last_became_peered":"2023-07-27T14:38:53.723686+0000","last_unstale":"2023-07-27T14:38:54.202672+0000","last_undegraded":"2023-07-27T14:38:54.202672+0000","last_fullsized":"2023-07-27T14:38:54.202672+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198921+0000","last_change":"2023-07-27T14:38:54.196772+0000","last_active":"2023-07-27T14:38:54.198921+0000","last_peered":"2023-07-27T14:38:54.198921+0000","last_clean":"2023-07-27T14:38:54.198921+0000","last_became_active":"2023-07-27T14:38:54.196369+0000","last_became_peered":"2023-07-27T14:38:54.196369+0000","last_unstale":"2023-07-27T14:38:54.198921+0000","last_undegraded":"2023-07-27T14:38:54.198921+0000","last_fullsized":"2023-07-27T14:38:54.198921+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.185639+0000","last_change":"2023-07-27T14:38:53.730747+0000","last_active":"2023-07-27T14:38:54.185639+0000","last_peered":"2023-07-27T14:38:54.185639+0000","last_clean":"2023-07-27T14:38:54.185639+0000","last_became_active":"2023-07-27T14:38:53.730472+0000","last_became_peered":"2023-07-27T14:38:53.730472+0000","last_unstale":"2023-07-27T14:38:54.185639+0000","last_undegraded":"2023-07-27T14:38:54.185639+0000","last_fullsized":"2023-07-27T14:38:54.185639+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199408+0000","last_change":"2023-07-27T14:38:54.193269+0000","last_active":"2023-07-27T14:38:54.199408+0000","last_peered":"2023-07-27T14:38:54.199408+0000","last_clean":"2023-07-27T14:38:54.199408+0000","last_became_active":"2023-07-27T14:38:54.193016+0000","last_became_peered":"2023-07-27T14:38:54.193016+0000","last_unstale":"2023-07-27T14:38:54.199408+0000","last_undegraded":"2023-07-27T14:38:54.199408+0000","last_fullsized":"2023-07-27T14:38:54.199408+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201744+0000","last_change":"2023-07-27T14:38:53.721457+0000","last_active":"2023-07-27T14:38:54.201744+0000","last_peered":"2023-07-27T14:38:54.201744+0000","last_clean":"2023-07-27T14:38:54.201744+0000","last_became_active":"2023-07-27T14:38:53.720809+0000","last_became_peered":"2023-07-27T14:38:53.720809+0000","last_unstale":"2023-07-27T14:38:54.201744+0000","last_undegraded":"2023-07-27T14:38:54.201744+0000","last_fullsized":"2023-07-27T14:38:54.201744+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201875+0000","last_change":"2023-07-27T14:38:54.198519+0000","last_active":"2023-07-27T14:38:54.201875+0000","last_peered":"2023-07-27T14:38:54.201875+0000","last_clean":"2023-07-27T14:38:54.201875+0000","last_became_active":"2023-07-27T14:38:54.198219+0000","last_became_peered":"2023-07-27T14:38:54.198219+0000","last_unstale":"2023-07-27T14:38:54.201875+0000","last_undegraded":"2023-07-27T14:38:54.201875+0000","last_fullsized":"2023-07-27T14:38:54.201875+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.171102+0000","last_change":"2023-07-27T14:38:53.735592+0000","last_active":"2023-07-27T14:38:54.171102+0000","last_peered":"2023-07-27T14:38:54.171102+0000","last_clean":"2023-07-27T14:38:54.171102+0000","last_became_active":"2023-07-27T14:38:53.735327+0000","last_became_peered":"2023-07-27T14:38:53.735327+0000","last_unstale":"2023-07-27T14:38:54.171102+0000","last_undegraded":"2023-07-27T14:38:54.171102+0000","last_fullsized":"2023-07-27T14:38:54.171102+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.190651+0000","last_change":"2023-07-27T14:38:54.188705+0000","last_active":"2023-07-27T14:38:54.190651+0000","last_peered":"2023-07-27T14:38:54.190651+0000","last_clean":"2023-07-27T14:38:54.190651+0000","last_became_active":"2023-07-27T14:38:54.188414+0000","last_became_peered":"2023-07-27T14:38:54.188414+0000","last_unstale":"2023-07-27T14:38:54.190651+0000","last_undegraded":"2023-07-27T14:38:54.190651+0000","last_fullsized":"2023-07-27T14:38:54.190651+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.177793+0000","last_change":"2023-07-27T14:38:53.716745+0000","last_active":"2023-07-27T14:38:54.177793+0000","last_peered":"2023-07-27T14:38:54.177793+0000","last_clean":"2023-07-27T14:38:54.177793+0000","last_became_active":"2023-07-27T14:38:53.716486+0000","last_became_peered":"2023-07-27T14:38:53.716486+0000","last_unstale":"2023-07-27T14:38:54.177793+0000","last_undegraded":"2023-07-27T14:38:54.177793+0000","last_fullsized":"2023-07-27T14:38:54.177793+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.193405+0000","last_change":"2023-07-27T14:38:54.189641+0000","last_active":"2023-07-27T14:38:54.193405+0000","last_peered":"2023-07-27T14:38:54.193405+0000","last_clean":"2023-07-27T14:38:54.193405+0000","last_became_active":"2023-07-27T14:38:54.188756+0000","last_became_peered":"2023-07-27T14:38:54.188756+0000","last_unstale":"2023-07-27T14:38:54.193405+0000","last_undegraded":"2023-07-27T14:38:54.193405+0000","last_fullsized":"2023-07-27T14:38:54.193405+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175540+0000","last_change":"2023-07-27T14:38:53.735274+0000","last_active":"2023-07-27T14:38:54.175540+0000","last_peered":"2023-07-27T14:38:54.175540+0000","last_clean":"2023-07-27T14:38:54.175540+0000","last_became_active":"2023-07-27T14:38:53.733467+0000","last_became_peered":"2023-07-27T14:38:53.733467+0000","last_unstale":"2023-07-27T14:38:54.175540+0000","last_undegraded":"2023-07-27T14:38:54.175540+0000","last_fullsized":"2023-07-27T14:38:54.175540+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.203563+0000","last_change":"2023-07-27T14:38:54.202640+0000","last_active":"2023-07-27T14:38:54.203563+0000","last_peered":"2023-07-27T14:38:54.203563+0000","last_clean":"2023-07-27T14:38:54.203563+0000","last_became_active":"2023-07-27T14:38:54.202087+0000","last_became_peered":"2023-07-27T14:38:54.202087+0000","last_unstale":"2023-07-27T14:38:54.203563+0000","last_undegraded":"2023-07-27T14:38:54.203563+0000","last_fullsized":"2023-07-27T14:38:54.203563+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183957+0000","last_change":"2023-07-27T14:38:53.731504+0000","last_active":"2023-07-27T14:38:54.183957+0000","last_peered":"2023-07-27T14:38:54.183957+0000","last_clean":"2023-07-27T14:38:54.183957+0000","last_became_active":"2023-07-27T14:38:53.731192+0000","last_became_peered":"2023-07-27T14:38:53.731192+0000","last_unstale":"2023-07-27T14:38:54.183957+0000","last_undegraded":"2023-07-27T14:38:54.183957+0000","last_fullsized":"2023-07-27T14:38:54.183957+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199879+0000","last_change":"2023-07-27T14:38:54.194771+0000","last_active":"2023-07-27T14:38:54.199879+0000","last_peered":"2023-07-27T14:38:54.199879+0000","last_clean":"2023-07-27T14:38:54.199879+0000","last_became_active":"2023-07-27T14:38:54.194093+0000","last_became_peered":"2023-07-27T14:38:54.194093+0000","last_unstale":"2023-07-27T14:38:54.199879+0000","last_undegraded":"2023-07-27T14:38:54.199879+0000","last_fullsized":"2023-07-27T14:38:54.199879+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"188'1","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-27T14:38:55.174511+0000","last_change":"2023-07-27T14:38:53.722762+0000","last_active":"2023-07-27T14:38:55.174511+0000","last_peered":"2023-07-27T14:38:55.174511+0000","last_clean":"2023-07-27T14:38:55.174511+0000","last_became_active":"2023-07-27T14:38:53.722382+0000","last_became_peered":"2023-07-27T14:38:53.722382+0000","last_unstale":"2023-07-27T14:38:55.174511+0000","last_undegraded":"2023-07-27T14:38:55.174511+0000","last_fullsized":"2023-07-27T14:38:55.174511+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201692+0000","last_change":"2023-07-27T14:38:54.192545+0000","last_active":"2023-07-27T14:38:54.201692+0000","last_peered":"2023-07-27T14:38:54.201692+0000","last_clean":"2023-07-27T14:38:54.201692+0000","last_became_active":"2023-07-27T14:38:54.192090+0000","last_became_peered":"2023-07-27T14:38:54.192090+0000","last_unstale":"2023-07-27T14:38:54.201692+0000","last_undegraded":"2023-07-27T14:38:54.201692+0000","last_fullsized":"2023-07-27T14:38:54.201692+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176900+0000","last_change":"2023-07-27T14:38:53.719681+0000","last_active":"2023-07-27T14:38:54.176900+0000","last_peered":"2023-07-27T14:38:54.176900+0000","last_clean":"2023-07-27T14:38:54.176900+0000","last_became_active":"2023-07-27T14:38:53.719392+0000","last_became_peered":"2023-07-27T14:38:53.719392+0000","last_unstale":"2023-07-27T14:38:54.176900+0000","last_undegraded":"2023-07-27T14:38:54.176900+0000","last_fullsized":"2023-07-27T14:38:54.176900+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.196652+0000","last_change":"2023-07-27T14:38:54.191385+0000","last_active":"2023-07-27T14:38:54.196652+0000","last_peered":"2023-07-27T14:38:54.196652+0000","last_clean":"2023-07-27T14:38:54.196652+0000","last_became_active":"2023-07-27T14:38:54.191111+0000","last_became_peered":"2023-07-27T14:38:54.191111+0000","last_unstale":"2023-07-27T14:38:54.196652+0000","last_undegraded":"2023-07-27T14:38:54.196652+0000","last_fullsized":"2023-07-27T14:38:54.196652+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.185769+0000","last_change":"2023-07-27T14:38:53.726603+0000","last_active":"2023-07-27T14:38:54.185769+0000","last_peered":"2023-07-27T14:38:54.185769+0000","last_clean":"2023-07-27T14:38:54.185769+0000","last_became_active":"2023-07-27T14:38:53.726330+0000","last_became_peered":"2023-07-27T14:38:53.726330+0000","last_unstale":"2023-07-27T14:38:54.185769+0000","last_undegraded":"2023-07-27T14:38:54.185769+0000","last_fullsized":"2023-07-27T14:38:54.185769+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.189819+0000","last_change":"2023-07-27T14:38:54.188208+0000","last_active":"2023-07-27T14:38:54.189819+0000","last_peered":"2023-07-27T14:38:54.189819+0000","last_clean":"2023-07-27T14:38:54.189819+0000","last_became_active":"2023-07-27T14:38:54.187931+0000","last_became_peered":"2023-07-27T14:38:54.187931+0000","last_unstale":"2023-07-27T14:38:54.189819+0000","last_undegraded":"2023-07-27T14:38:54.189819+0000","last_fullsized":"2023-07-27T14:38:54.189819+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184928+0000","last_change":"2023-07-27T14:38:53.727098+0000","last_active":"2023-07-27T14:38:54.184928+0000","last_peered":"2023-07-27T14:38:54.184928+0000","last_clean":"2023-07-27T14:38:54.184928+0000","last_became_active":"2023-07-27T14:38:53.726800+0000","last_became_peered":"2023-07-27T14:38:53.726800+0000","last_unstale":"2023-07-27T14:38:54.184928+0000","last_undegraded":"2023-07-27T14:38:54.184928+0000","last_fullsized":"2023-07-27T14:38:54.184928+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.200599+0000","last_change":"2023-07-27T14:38:54.196850+0000","last_active":"2023-07-27T14:38:54.200599+0000","last_peered":"2023-07-27T14:38:54.200599+0000","last_clean":"2023-07-27T14:38:54.200599+0000","last_became_active":"2023-07-27T14:38:54.196468+0000","last_became_peered":"2023-07-27T14:38:54.196468+0000","last_unstale":"2023-07-27T14:38:54.200599+0000","last_undegraded":"2023-07-27T14:38:54.200599+0000","last_fullsized":"2023-07-27T14:38:54.200599+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176294+0000","last_change":"2023-07-27T14:38:53.723543+0000","last_active":"2023-07-27T14:38:54.176294+0000","last_peered":"2023-07-27T14:38:54.176294+0000","last_clean":"2023-07-27T14:38:54.176294+0000","last_became_active":"2023-07-27T14:38:53.723278+0000","last_became_peered":"2023-07-27T14:38:53.723278+0000","last_unstale":"2023-07-27T14:38:54.176294+0000","last_undegraded":"2023-07-27T14:38:54.176294+0000","last_fullsized":"2023-07-27T14:38:54.176294+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202203+0000","last_change":"2023-07-27T14:38:54.193362+0000","last_active":"2023-07-27T14:38:54.202203+0000","last_peered":"2023-07-27T14:38:54.202203+0000","last_clean":"2023-07-27T14:38:54.202203+0000","last_became_active":"2023-07-27T14:38:54.193062+0000","last_became_peered":"2023-07-27T14:38:54.193062+0000","last_unstale":"2023-07-27T14:38:54.202203+0000","last_undegraded":"2023-07-27T14:38:54.202203+0000","last_fullsized":"2023-07-27T14:38:54.202203+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.177700+0000","last_change":"2023-07-27T14:38:53.732118+0000","last_active":"2023-07-27T14:38:54.177700+0000","last_peered":"2023-07-27T14:38:54.177700+0000","last_clean":"2023-07-27T14:38:54.177700+0000","last_became_active":"2023-07-27T14:38:53.731832+0000","last_became_peered":"2023-07-27T14:38:53.731832+0000","last_unstale":"2023-07-27T14:38:54.177700+0000","last_undegraded":"2023-07-27T14:38:54.177700+0000","last_fullsized":"2023-07-27T14:38:54.177700+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202337+0000","last_change":"2023-07-27T14:38:54.193284+0000","last_active":"2023-07-27T14:38:54.202337+0000","last_peered":"2023-07-27T14:38:54.202337+0000","last_clean":"2023-07-27T14:38:54.202337+0000","last_became_active":"2023-07-27T14:38:54.192919+0000","last_became_peered":"2023-07-27T14:38:54.192919+0000","last_unstale":"2023-07-27T14:38:54.202337+0000","last_undegraded":"2023-07-27T14:38:54.202337+0000","last_fullsized":"2023-07-27T14:38:54.202337+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.182565+0000","last_change":"2023-07-27T14:38:53.725223+0000","last_active":"2023-07-27T14:38:54.182565+0000","last_peered":"2023-07-27T14:38:54.182565+0000","last_clean":"2023-07-27T14:38:54.182565+0000","last_became_active":"2023-07-27T14:38:53.724955+0000","last_became_peered":"2023-07-27T14:38:53.724955+0000","last_unstale":"2023-07-27T14:38:54.182565+0000","last_undegraded":"2023-07-27T14:38:54.182565+0000","last_fullsized":"2023-07-27T14:38:54.182565+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.200019+0000","last_change":"2023-07-27T14:38:54.194946+0000","last_active":"2023-07-27T14:38:54.200019+0000","last_peered":"2023-07-27T14:38:54.200019+0000","last_clean":"2023-07-27T14:38:54.200019+0000","last_became_active":"2023-07-27T14:38:54.194600+0000","last_became_peered":"2023-07-27T14:38:54.194600+0000","last_unstale":"2023-07-27T14:38:54.200019+0000","last_undegraded":"2023-07-27T14:38:54.200019+0000","last_fullsized":"2023-07-27T14:38:54.200019+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175791+0000","last_change":"2023-07-27T14:38:53.731289+0000","last_active":"2023-07-27T14:38:54.175791+0000","last_peered":"2023-07-27T14:38:54.175791+0000","last_clean":"2023-07-27T14:38:54.175791+0000","last_became_active":"2023-07-27T14:38:53.730951+0000","last_became_peered":"2023-07-27T14:38:53.730951+0000","last_unstale":"2023-07-27T14:38:54.175791+0000","last_undegraded":"2023-07-27T14:38:54.175791+0000","last_fullsized":"2023-07-27T14:38:54.175791+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184777+0000","last_change":"2023-07-27T14:38:54.183618+0000","last_active":"2023-07-27T14:38:54.184777+0000","last_peered":"2023-07-27T14:38:54.184777+0000","last_clean":"2023-07-27T14:38:54.184777+0000","last_became_active":"2023-07-27T14:38:54.182950+0000","last_became_peered":"2023-07-27T14:38:54.182950+0000","last_unstale":"2023-07-27T14:38:54.184777+0000","last_undegraded":"2023-07-27T14:38:54.184777+0000","last_fullsized":"2023-07-27T14:38:54.184777+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.178245+0000","last_change":"2023-07-27T14:38:53.733651+0000","last_active":"2023-07-27T14:38:54.178245+0000","last_peered":"2023-07-27T14:38:54.178245+0000","last_clean":"2023-07-27T14:38:54.178245+0000","last_became_active":"2023-07-27T14:38:53.733400+0000","last_became_peered":"2023-07-27T14:38:53.733400+0000","last_unstale":"2023-07-27T14:38:54.178245+0000","last_undegraded":"2023-07-27T14:38:54.178245+0000","last_fullsized":"2023-07-27T14:38:54.178245+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197075+0000","last_change":"2023-07-27T14:38:54.194067+0000","last_active":"2023-07-27T14:38:54.197075+0000","last_peered":"2023-07-27T14:38:54.197075+0000","last_clean":"2023-07-27T14:38:54.197075+0000","last_became_active":"2023-07-27T14:38:54.193741+0000","last_became_peered":"2023-07-27T14:38:54.193741+0000","last_unstale":"2023-07-27T14:38:54.197075+0000","last_undegraded":"2023-07-27T14:38:54.197075+0000","last_fullsized":"2023-07-27T14:38:54.197075+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"187'3","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.190252+0000","last_change":"2023-07-27T14:38:53.732810+0000","last_active":"2023-07-27T14:38:54.190252+0000","last_peered":"2023-07-27T14:38:54.190252+0000","last_clean":"2023-07-27T14:38:54.190252+0000","last_became_active":"2023-07-27T14:38:53.732496+0000","last_became_peered":"2023-07-27T14:38:53.732496+0000","last_unstale":"2023-07-27T14:38:54.190252+0000","last_undegraded":"2023-07-27T14:38:54.190252+0000","last_fullsized":"2023-07-27T14:38:54.190252+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.199035+0000","last_change":"2023-07-27T14:38:54.194671+0000","last_active":"2023-07-27T14:38:54.199035+0000","last_peered":"2023-07-27T14:38:54.199035+0000","last_clean":"2023-07-27T14:38:54.199035+0000","last_became_active":"2023-07-27T14:38:54.194447+0000","last_became_peered":"2023-07-27T14:38:54.194447+0000","last_unstale":"2023-07-27T14:38:54.199035+0000","last_undegraded":"2023-07-27T14:38:54.199035+0000","last_fullsized":"2023-07-27T14:38:54.199035+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202264+0000","last_change":"2023-07-27T14:38:53.728041+0000","last_active":"2023-07-27T14:38:54.202264+0000","last_peered":"2023-07-27T14:38:54.202264+0000","last_clean":"2023-07-27T14:38:54.202264+0000","last_became_active":"2023-07-27T14:38:53.727769+0000","last_became_peered":"2023-07-27T14:38:53.727769+0000","last_unstale":"2023-07-27T14:38:54.202264+0000","last_undegraded":"2023-07-27T14:38:54.202264+0000","last_fullsized":"2023-07-27T14:38:54.202264+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202482+0000","last_change":"2023-07-27T14:38:54.200743+0000","last_active":"2023-07-27T14:38:54.202482+0000","last_peered":"2023-07-27T14:38:54.202482+0000","last_clean":"2023-07-27T14:38:54.202482+0000","last_became_active":"2023-07-27T14:38:54.200475+0000","last_became_peered":"2023-07-27T14:38:54.200475+0000","last_unstale":"2023-07-27T14:38:54.202482+0000","last_undegraded":"2023-07-27T14:38:54.202482+0000","last_fullsized":"2023-07-27T14:38:54.202482+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.187249+0000","last_change":"2023-07-27T14:38:53.721600+0000","last_active":"2023-07-27T14:38:54.187249+0000","last_peered":"2023-07-27T14:38:54.187249+0000","last_clean":"2023-07-27T14:38:54.187249+0000","last_became_active":"2023-07-27T14:38:53.721265+0000","last_became_peered":"2023-07-27T14:38:53.721265+0000","last_unstale":"2023-07-27T14:38:54.187249+0000","last_undegraded":"2023-07-27T14:38:54.187249+0000","last_fullsized":"2023-07-27T14:38:54.187249+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198378+0000","last_change":"2023-07-27T14:38:54.192417+0000","last_active":"2023-07-27T14:38:54.198378+0000","last_peered":"2023-07-27T14:38:54.198378+0000","last_clean":"2023-07-27T14:38:54.198378+0000","last_became_active":"2023-07-27T14:38:54.192131+0000","last_became_peered":"2023-07-27T14:38:54.192131+0000","last_unstale":"2023-07-27T14:38:54.198378+0000","last_undegraded":"2023-07-27T14:38:54.198378+0000","last_fullsized":"2023-07-27T14:38:54.198378+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.177658+0000","last_change":"2023-07-27T14:38:53.717938+0000","last_active":"2023-07-27T14:38:54.177658+0000","last_peered":"2023-07-27T14:38:54.177658+0000","last_clean":"2023-07-27T14:38:54.177658+0000","last_became_active":"2023-07-27T14:38:53.717640+0000","last_became_peered":"2023-07-27T14:38:53.717640+0000","last_unstale":"2023-07-27T14:38:54.177658+0000","last_undegraded":"2023-07-27T14:38:54.177658+0000","last_fullsized":"2023-07-27T14:38:54.177658+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.192014+0000","last_change":"2023-07-27T14:38:54.183558+0000","last_active":"2023-07-27T14:38:54.192014+0000","last_peered":"2023-07-27T14:38:54.192014+0000","last_clean":"2023-07-27T14:38:54.192014+0000","last_became_active":"2023-07-27T14:38:54.182029+0000","last_became_peered":"2023-07-27T14:38:54.182029+0000","last_unstale":"2023-07-27T14:38:54.192014+0000","last_undegraded":"2023-07-27T14:38:54.192014+0000","last_fullsized":"2023-07-27T14:38:54.192014+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.170242+0000","last_change":"2023-07-27T14:38:53.721246+0000","last_active":"2023-07-27T14:38:54.170242+0000","last_peered":"2023-07-27T14:38:54.170242+0000","last_clean":"2023-07-27T14:38:54.170242+0000","last_became_active":"2023-07-27T14:38:53.720474+0000","last_became_peered":"2023-07-27T14:38:53.720474+0000","last_unstale":"2023-07-27T14:38:54.170242+0000","last_undegraded":"2023-07-27T14:38:54.170242+0000","last_fullsized":"2023-07-27T14:38:54.170242+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.196226+0000","last_change":"2023-07-27T14:38:54.193316+0000","last_active":"2023-07-27T14:38:54.196226+0000","last_peered":"2023-07-27T14:38:54.196226+0000","last_clean":"2023-07-27T14:38:54.196226+0000","last_became_active":"2023-07-27T14:38:54.192566+0000","last_became_peered":"2023-07-27T14:38:54.192566+0000","last_unstale":"2023-07-27T14:38:54.196226+0000","last_undegraded":"2023-07-27T14:38:54.196226+0000","last_fullsized":"2023-07-27T14:38:54.196226+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"187'4","reported_seq":14,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.195805+0000","last_change":"2023-07-27T14:38:53.728434+0000","last_active":"2023-07-27T14:38:54.195805+0000","last_peered":"2023-07-27T14:38:54.195805+0000","last_clean":"2023-07-27T14:38:54.195805+0000","last_became_active":"2023-07-27T14:38:53.728147+0000","last_became_peered":"2023-07-27T14:38:53.728147+0000","last_unstale":"2023-07-27T14:38:54.195805+0000","last_undegraded":"2023-07-27T14:38:54.195805+0000","last_fullsized":"2023-07-27T14:38:54.195805+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.196201+0000","last_change":"2023-07-27T14:38:54.191596+0000","last_active":"2023-07-27T14:38:54.196201+0000","last_peered":"2023-07-27T14:38:54.196201+0000","last_clean":"2023-07-27T14:38:54.196201+0000","last_became_active":"2023-07-27T14:38:54.191291+0000","last_became_peered":"2023-07-27T14:38:54.191291+0000","last_unstale":"2023-07-27T14:38:54.196201+0000","last_undegraded":"2023-07-27T14:38:54.196201+0000","last_fullsized":"2023-07-27T14:38:54.196201+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201587+0000","last_change":"2023-07-27T14:38:53.728447+0000","last_active":"2023-07-27T14:38:54.201587+0000","last_peered":"2023-07-27T14:38:54.201587+0000","last_clean":"2023-07-27T14:38:54.201587+0000","last_became_active":"2023-07-27T14:38:53.728171+0000","last_became_peered":"2023-07-27T14:38:53.728171+0000","last_unstale":"2023-07-27T14:38:54.201587+0000","last_undegraded":"2023-07-27T14:38:54.201587+0000","last_fullsized":"2023-07-27T14:38:54.201587+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.187360+0000","last_change":"2023-07-27T14:38:54.186356+0000","last_active":"2023-07-27T14:38:54.187360+0000","last_peered":"2023-07-27T14:38:54.187360+0000","last_clean":"2023-07-27T14:38:54.187360+0000","last_became_active":"2023-07-27T14:38:54.186094+0000","last_became_peered":"2023-07-27T14:38:54.186094+0000","last_unstale":"2023-07-27T14:38:54.187360+0000","last_undegraded":"2023-07-27T14:38:54.187360+0000","last_fullsized":"2023-07-27T14:38:54.187360+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.194725+0000","last_change":"2023-07-27T14:38:53.721607+0000","last_active":"2023-07-27T14:38:54.194725+0000","last_peered":"2023-07-27T14:38:54.194725+0000","last_clean":"2023-07-27T14:38:54.194725+0000","last_became_active":"2023-07-27T14:38:53.720342+0000","last_became_peered":"2023-07-27T14:38:53.720342+0000","last_unstale":"2023-07-27T14:38:54.194725+0000","last_undegraded":"2023-07-27T14:38:54.194725+0000","last_fullsized":"2023-07-27T14:38:54.194725+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201672+0000","last_change":"2023-07-27T14:38:54.192373+0000","last_active":"2023-07-27T14:38:54.201672+0000","last_peered":"2023-07-27T14:38:54.201672+0000","last_clean":"2023-07-27T14:38:54.201672+0000","last_became_active":"2023-07-27T14:38:54.191708+0000","last_became_peered":"2023-07-27T14:38:54.191708+0000","last_unstale":"2023-07-27T14:38:54.201672+0000","last_undegraded":"2023-07-27T14:38:54.201672+0000","last_fullsized":"2023-07-27T14:38:54.201672+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183590+0000","last_change":"2023-07-27T14:38:53.733768+0000","last_active":"2023-07-27T14:38:54.183590+0000","last_peered":"2023-07-27T14:38:54.183590+0000","last_clean":"2023-07-27T14:38:54.183590+0000","last_became_active":"2023-07-27T14:38:53.733488+0000","last_became_peered":"2023-07-27T14:38:53.733488+0000","last_unstale":"2023-07-27T14:38:54.183590+0000","last_undegraded":"2023-07-27T14:38:54.183590+0000","last_fullsized":"2023-07-27T14:38:54.183590+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198919+0000","last_change":"2023-07-27T14:38:54.192222+0000","last_active":"2023-07-27T14:38:54.198919+0000","last_peered":"2023-07-27T14:38:54.198919+0000","last_clean":"2023-07-27T14:38:54.198919+0000","last_became_active":"2023-07-27T14:38:54.190412+0000","last_became_peered":"2023-07-27T14:38:54.190412+0000","last_unstale":"2023-07-27T14:38:54.198919+0000","last_undegraded":"2023-07-27T14:38:54.198919+0000","last_fullsized":"2023-07-27T14:38:54.198919+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176764+0000","last_change":"2023-07-27T14:38:53.724123+0000","last_active":"2023-07-27T14:38:54.176764+0000","last_peered":"2023-07-27T14:38:54.176764+0000","last_clean":"2023-07-27T14:38:54.176764+0000","last_became_active":"2023-07-27T14:38:53.723861+0000","last_became_peered":"2023-07-27T14:38:53.723861+0000","last_unstale":"2023-07-27T14:38:54.176764+0000","last_undegraded":"2023-07-27T14:38:54.176764+0000","last_fullsized":"2023-07-27T14:38:54.176764+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.193597+0000","last_change":"2023-07-27T14:38:54.190261+0000","last_active":"2023-07-27T14:38:54.193597+0000","last_peered":"2023-07-27T14:38:54.193597+0000","last_clean":"2023-07-27T14:38:54.193597+0000","last_became_active":"2023-07-27T14:38:54.189966+0000","last_became_peered":"2023-07-27T14:38:54.189966+0000","last_unstale":"2023-07-27T14:38:54.193597+0000","last_undegraded":"2023-07-27T14:38:54.193597+0000","last_fullsized":"2023-07-27T14:38:54.193597+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.186807+0000","last_change":"2023-07-27T14:38:53.733334+0000","last_active":"2023-07-27T14:38:54.186807+0000","last_peered":"2023-07-27T14:38:54.186807+0000","last_clean":"2023-07-27T14:38:54.186807+0000","last_became_active":"2023-07-27T14:38:53.732989+0000","last_became_peered":"2023-07-27T14:38:53.732989+0000","last_unstale":"2023-07-27T14:38:54.186807+0000","last_undegraded":"2023-07-27T14:38:54.186807+0000","last_fullsized":"2023-07-27T14:38:54.186807+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183966+0000","last_change":"2023-07-27T14:38:54.180101+0000","last_active":"2023-07-27T14:38:54.183966+0000","last_peered":"2023-07-27T14:38:54.183966+0000","last_clean":"2023-07-27T14:38:54.183966+0000","last_became_active":"2023-07-27T14:38:54.179786+0000","last_became_peered":"2023-07-27T14:38:54.179786+0000","last_unstale":"2023-07-27T14:38:54.183966+0000","last_undegraded":"2023-07-27T14:38:54.183966+0000","last_fullsized":"2023-07-27T14:38:54.183966+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.171279+0000","last_change":"2023-07-27T14:38:53.722501+0000","last_active":"2023-07-27T14:38:54.171279+0000","last_peered":"2023-07-27T14:38:54.171279+0000","last_clean":"2023-07-27T14:38:54.171279+0000","last_became_active":"2023-07-27T14:38:53.722206+0000","last_became_peered":"2023-07-27T14:38:53.722206+0000","last_unstale":"2023-07-27T14:38:54.171279+0000","last_undegraded":"2023-07-27T14:38:54.171279+0000","last_fullsized":"2023-07-27T14:38:54.171279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.189211+0000","last_change":"2023-07-27T14:38:54.184541+0000","last_active":"2023-07-27T14:38:54.189211+0000","last_peered":"2023-07-27T14:38:54.189211+0000","last_clean":"2023-07-27T14:38:54.189211+0000","last_became_active":"2023-07-27T14:38:54.184246+0000","last_became_peered":"2023-07-27T14:38:54.184246+0000","last_unstale":"2023-07-27T14:38:54.189211+0000","last_undegraded":"2023-07-27T14:38:54.189211+0000","last_fullsized":"2023-07-27T14:38:54.189211+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183539+0000","last_change":"2023-07-27T14:38:53.721005+0000","last_active":"2023-07-27T14:38:54.183539+0000","last_peered":"2023-07-27T14:38:54.183539+0000","last_clean":"2023-07-27T14:38:54.183539+0000","last_became_active":"2023-07-27T14:38:53.720725+0000","last_became_peered":"2023-07-27T14:38:53.720725+0000","last_unstale":"2023-07-27T14:38:54.183539+0000","last_undegraded":"2023-07-27T14:38:54.183539+0000","last_fullsized":"2023-07-27T14:38:54.183539+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.197351+0000","last_change":"2023-07-27T14:38:54.189561+0000","last_active":"2023-07-27T14:38:54.197351+0000","last_peered":"2023-07-27T14:38:54.197351+0000","last_clean":"2023-07-27T14:38:54.197351+0000","last_became_active":"2023-07-27T14:38:54.189289+0000","last_became_peered":"2023-07-27T14:38:54.189289+0000","last_unstale":"2023-07-27T14:38:54.197351+0000","last_undegraded":"2023-07-27T14:38:54.197351+0000","last_fullsized":"2023-07-27T14:38:54.197351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.182121+0000","last_change":"2023-07-27T14:38:53.729371+0000","last_active":"2023-07-27T14:38:54.182121+0000","last_peered":"2023-07-27T14:38:54.182121+0000","last_clean":"2023-07-27T14:38:54.182121+0000","last_became_active":"2023-07-27T14:38:53.729056+0000","last_became_peered":"2023-07-27T14:38:53.729056+0000","last_unstale":"2023-07-27T14:38:54.182121+0000","last_undegraded":"2023-07-27T14:38:54.182121+0000","last_fullsized":"2023-07-27T14:38:54.182121+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.203664+0000","last_change":"2023-07-27T14:38:54.202395+0000","last_active":"2023-07-27T14:38:54.203664+0000","last_peered":"2023-07-27T14:38:54.203664+0000","last_clean":"2023-07-27T14:38:54.203664+0000","last_became_active":"2023-07-27T14:38:54.202183+0000","last_became_peered":"2023-07-27T14:38:54.202183+0000","last_unstale":"2023-07-27T14:38:54.203664+0000","last_undegraded":"2023-07-27T14:38:54.203664+0000","last_fullsized":"2023-07-27T14:38:54.203664+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.200060+0000","last_change":"2023-07-27T14:38:53.710828+0000","last_active":"2023-07-27T14:38:54.200060+0000","last_peered":"2023-07-27T14:38:54.200060+0000","last_clean":"2023-07-27T14:38:54.200060+0000","last_became_active":"2023-07-27T14:38:53.710539+0000","last_became_peered":"2023-07-27T14:38:53.710539+0000","last_unstale":"2023-07-27T14:38:54.200060+0000","last_undegraded":"2023-07-27T14:38:54.200060+0000","last_fullsized":"2023-07-27T14:38:54.200060+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.192834+0000","last_change":"2023-07-27T14:38:54.189407+0000","last_active":"2023-07-27T14:38:54.192834+0000","last_peered":"2023-07-27T14:38:54.192834+0000","last_clean":"2023-07-27T14:38:54.192834+0000","last_became_active":"2023-07-27T14:38:54.189147+0000","last_became_peered":"2023-07-27T14:38:54.189147+0000","last_unstale":"2023-07-27T14:38:54.192834+0000","last_undegraded":"2023-07-27T14:38:54.192834+0000","last_fullsized":"2023-07-27T14:38:54.192834+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.182059+0000","last_change":"2023-07-27T14:38:53.725053+0000","last_active":"2023-07-27T14:38:54.182059+0000","last_peered":"2023-07-27T14:38:54.182059+0000","last_clean":"2023-07-27T14:38:54.182059+0000","last_became_active":"2023-07-27T14:38:53.724778+0000","last_became_peered":"2023-07-27T14:38:53.724778+0000","last_unstale":"2023-07-27T14:38:54.182059+0000","last_undegraded":"2023-07-27T14:38:54.182059+0000","last_fullsized":"2023-07-27T14:38:54.182059+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201156+0000","last_change":"2023-07-27T14:38:54.196847+0000","last_active":"2023-07-27T14:38:54.201156+0000","last_peered":"2023-07-27T14:38:54.201156+0000","last_clean":"2023-07-27T14:38:54.201156+0000","last_became_active":"2023-07-27T14:38:54.196547+0000","last_became_peered":"2023-07-27T14:38:54.196547+0000","last_unstale":"2023-07-27T14:38:54.201156+0000","last_undegraded":"2023-07-27T14:38:54.201156+0000","last_fullsized":"2023-07-27T14:38:54.201156+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176389+0000","last_change":"2023-07-27T14:38:53.733516+0000","last_active":"2023-07-27T14:38:54.176389+0000","last_peered":"2023-07-27T14:38:54.176389+0000","last_clean":"2023-07-27T14:38:54.176389+0000","last_became_active":"2023-07-27T14:38:53.732608+0000","last_became_peered":"2023-07-27T14:38:53.732608+0000","last_unstale":"2023-07-27T14:38:54.176389+0000","last_undegraded":"2023-07-27T14:38:54.176389+0000","last_fullsized":"2023-07-27T14:38:54.176389+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.204075+0000","last_change":"2023-07-27T14:38:54.203309+0000","last_active":"2023-07-27T14:38:54.204075+0000","last_peered":"2023-07-27T14:38:54.204075+0000","last_clean":"2023-07-27T14:38:54.204075+0000","last_became_active":"2023-07-27T14:38:54.202433+0000","last_became_peered":"2023-07-27T14:38:54.202433+0000","last_unstale":"2023-07-27T14:38:54.204075+0000","last_undegraded":"2023-07-27T14:38:54.204075+0000","last_fullsized":"2023-07-27T14:38:54.204075+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176483+0000","last_change":"2023-07-27T14:38:53.734950+0000","last_active":"2023-07-27T14:38:54.176483+0000","last_peered":"2023-07-27T14:38:54.176483+0000","last_clean":"2023-07-27T14:38:54.176483+0000","last_became_active":"2023-07-27T14:38:53.734612+0000","last_became_peered":"2023-07-27T14:38:53.734612+0000","last_unstale":"2023-07-27T14:38:54.176483+0000","last_undegraded":"2023-07-27T14:38:54.176483+0000","last_fullsized":"2023-07-27T14:38:54.176483+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184640+0000","last_change":"2023-07-27T14:38:54.181963+0000","last_active":"2023-07-27T14:38:54.184640+0000","last_peered":"2023-07-27T14:38:54.184640+0000","last_clean":"2023-07-27T14:38:54.184640+0000","last_became_active":"2023-07-27T14:38:54.181650+0000","last_became_peered":"2023-07-27T14:38:54.181650+0000","last_unstale":"2023-07-27T14:38:54.184640+0000","last_undegraded":"2023-07-27T14:38:54.184640+0000","last_fullsized":"2023-07-27T14:38:54.184640+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.182881+0000","last_change":"2023-07-27T14:38:53.720978+0000","last_active":"2023-07-27T14:38:54.182881+0000","last_peered":"2023-07-27T14:38:54.182881+0000","last_clean":"2023-07-27T14:38:54.182881+0000","last_became_active":"2023-07-27T14:38:53.720696+0000","last_became_peered":"2023-07-27T14:38:53.720696+0000","last_unstale":"2023-07-27T14:38:54.182881+0000","last_undegraded":"2023-07-27T14:38:54.182881+0000","last_fullsized":"2023-07-27T14:38:54.182881+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.186298+0000","last_change":"2023-07-27T14:38:54.179195+0000","last_active":"2023-07-27T14:38:54.186298+0000","last_peered":"2023-07-27T14:38:54.186298+0000","last_clean":"2023-07-27T14:38:54.186298+0000","last_became_active":"2023-07-27T14:38:54.178383+0000","last_became_peered":"2023-07-27T14:38:54.178383+0000","last_unstale":"2023-07-27T14:38:54.186298+0000","last_undegraded":"2023-07-27T14:38:54.186298+0000","last_fullsized":"2023-07-27T14:38:54.186298+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183137+0000","last_change":"2023-07-27T14:38:53.733825+0000","last_active":"2023-07-27T14:38:54.183137+0000","last_peered":"2023-07-27T14:38:54.183137+0000","last_clean":"2023-07-27T14:38:54.183137+0000","last_became_active":"2023-07-27T14:38:53.733545+0000","last_became_peered":"2023-07-27T14:38:53.733545+0000","last_unstale":"2023-07-27T14:38:54.183137+0000","last_undegraded":"2023-07-27T14:38:54.183137+0000","last_fullsized":"2023-07-27T14:38:54.183137+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.190634+0000","last_change":"2023-07-27T14:38:54.188524+0000","last_active":"2023-07-27T14:38:54.190634+0000","last_peered":"2023-07-27T14:38:54.190634+0000","last_clean":"2023-07-27T14:38:54.190634+0000","last_became_active":"2023-07-27T14:38:54.188215+0000","last_became_peered":"2023-07-27T14:38:54.188215+0000","last_unstale":"2023-07-27T14:38:54.190634+0000","last_undegraded":"2023-07-27T14:38:54.190634+0000","last_fullsized":"2023-07-27T14:38:54.190634+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183636+0000","last_change":"2023-07-27T14:38:53.725917+0000","last_active":"2023-07-27T14:38:54.183636+0000","last_peered":"2023-07-27T14:38:54.183636+0000","last_clean":"2023-07-27T14:38:54.183636+0000","last_became_active":"2023-07-27T14:38:53.725309+0000","last_became_peered":"2023-07-27T14:38:53.725309+0000","last_unstale":"2023-07-27T14:38:54.183636+0000","last_undegraded":"2023-07-27T14:38:54.183636+0000","last_fullsized":"2023-07-27T14:38:54.183636+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.194461+0000","last_change":"2023-07-27T14:38:54.191580+0000","last_active":"2023-07-27T14:38:54.194461+0000","last_peered":"2023-07-27T14:38:54.194461+0000","last_clean":"2023-07-27T14:38:54.194461+0000","last_became_active":"2023-07-27T14:38:54.191305+0000","last_became_peered":"2023-07-27T14:38:54.191305+0000","last_unstale":"2023-07-27T14:38:54.194461+0000","last_undegraded":"2023-07-27T14:38:54.194461+0000","last_fullsized":"2023-07-27T14:38:54.194461+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.181403+0000","last_change":"2023-07-27T14:38:53.725242+0000","last_active":"2023-07-27T14:38:54.181403+0000","last_peered":"2023-07-27T14:38:54.181403+0000","last_clean":"2023-07-27T14:38:54.181403+0000","last_became_active":"2023-07-27T14:38:53.724808+0000","last_became_peered":"2023-07-27T14:38:53.724808+0000","last_unstale":"2023-07-27T14:38:54.181403+0000","last_undegraded":"2023-07-27T14:38:54.181403+0000","last_fullsized":"2023-07-27T14:38:54.181403+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202351+0000","last_change":"2023-07-27T14:38:54.200933+0000","last_active":"2023-07-27T14:38:54.202351+0000","last_peered":"2023-07-27T14:38:54.202351+0000","last_clean":"2023-07-27T14:38:54.202351+0000","last_became_active":"2023-07-27T14:38:54.200638+0000","last_became_peered":"2023-07-27T14:38:54.200638+0000","last_unstale":"2023-07-27T14:38:54.202351+0000","last_undegraded":"2023-07-27T14:38:54.202351+0000","last_fullsized":"2023-07-27T14:38:54.202351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.191734+0000","last_change":"2023-07-27T14:38:53.722597+0000","last_active":"2023-07-27T14:38:54.191734+0000","last_peered":"2023-07-27T14:38:54.191734+0000","last_clean":"2023-07-27T14:38:54.191734+0000","last_became_active":"2023-07-27T14:38:53.722317+0000","last_became_peered":"2023-07-27T14:38:53.722317+0000","last_unstale":"2023-07-27T14:38:54.191734+0000","last_undegraded":"2023-07-27T14:38:54.191734+0000","last_fullsized":"2023-07-27T14:38:54.191734+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176282+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:38:54.176282+0000","last_peered":"2023-07-27T14:38:54.176282+0000","last_clean":"2023-07-27T14:38:54.176282+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:38:54.176282+0000","last_undegraded":"2023-07-27T14:38:54.176282+0000","last_fullsized":"2023-07-27T14:38:54.176282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.198975+0000","last_change":"2023-07-27T14:38:54.194572+0000","last_active":"2023-07-27T14:38:54.198975+0000","last_peered":"2023-07-27T14:38:54.198975+0000","last_clean":"2023-07-27T14:38:54.198975+0000","last_became_active":"2023-07-27T14:38:54.194183+0000","last_became_peered":"2023-07-27T14:38:54.194183+0000","last_unstale":"2023-07-27T14:38:54.198975+0000","last_undegraded":"2023-07-27T14:38:54.198975+0000","last_fullsized":"2023-07-27T14:38:54.198975+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.173794+0000","last_change":"2023-07-27T14:38:53.720536+0000","last_active":"2023-07-27T14:38:54.173794+0000","last_peered":"2023-07-27T14:38:54.173794+0000","last_clean":"2023-07-27T14:38:54.173794+0000","last_became_active":"2023-07-27T14:38:53.720166+0000","last_became_peered":"2023-07-27T14:38:53.720166+0000","last_unstale":"2023-07-27T14:38:54.173794+0000","last_undegraded":"2023-07-27T14:38:54.173794+0000","last_fullsized":"2023-07-27T14:38:54.173794+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":159,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.176386+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:38:54.176386+0000","last_peered":"2023-07-27T14:38:54.176386+0000","last_clean":"2023-07-27T14:38:54.176386+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:38:54.176386+0000","last_undegraded":"2023-07-27T14:38:54.176386+0000","last_fullsized":"2023-07-27T14:38:54.176386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.195603+0000","last_change":"2023-07-27T14:38:54.191138+0000","last_active":"2023-07-27T14:38:54.195603+0000","last_peered":"2023-07-27T14:38:54.195603+0000","last_clean":"2023-07-27T14:38:54.195603+0000","last_became_active":"2023-07-27T14:38:54.190874+0000","last_became_peered":"2023-07-27T14:38:54.190874+0000","last_unstale":"2023-07-27T14:38:54.195603+0000","last_undegraded":"2023-07-27T14:38:54.195603+0000","last_fullsized":"2023-07-27T14:38:54.195603+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.171186+0000","last_change":"2023-07-27T14:38:53.734741+0000","last_active":"2023-07-27T14:38:54.171186+0000","last_peered":"2023-07-27T14:38:54.171186+0000","last_clean":"2023-07-27T14:38:54.171186+0000","last_became_active":"2023-07-27T14:38:53.734366+0000","last_became_peered":"2023-07-27T14:38:53.734366+0000","last_unstale":"2023-07-27T14:38:54.171186+0000","last_undegraded":"2023-07-27T14:38:54.171186+0000","last_fullsized":"2023-07-27T14:38:54.171186+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.183714+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:38:54.183714+0000","last_peered":"2023-07-27T14:38:54.183714+0000","last_clean":"2023-07-27T14:38:54.183714+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:38:54.183714+0000","last_undegraded":"2023-07-27T14:38:54.183714+0000","last_fullsized":"2023-07-27T14:38:54.183714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.195030+0000","last_change":"2023-07-27T14:38:54.188490+0000","last_active":"2023-07-27T14:38:54.195030+0000","last_peered":"2023-07-27T14:38:54.195030+0000","last_clean":"2023-07-27T14:38:54.195030+0000","last_became_active":"2023-07-27T14:38:54.187179+0000","last_became_peered":"2023-07-27T14:38:54.187179+0000","last_unstale":"2023-07-27T14:38:54.195030+0000","last_undegraded":"2023-07-27T14:38:54.195030+0000","last_fullsized":"2023-07-27T14:38:54.195030+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.170079+0000","last_change":"2023-07-27T14:38:53.724780+0000","last_active":"2023-07-27T14:38:54.170079+0000","last_peered":"2023-07-27T14:38:54.170079+0000","last_clean":"2023-07-27T14:38:54.170079+0000","last_became_active":"2023-07-27T14:38:53.724458+0000","last_became_peered":"2023-07-27T14:38:53.724458+0000","last_unstale":"2023-07-27T14:38:54.170079+0000","last_undegraded":"2023-07-27T14:38:54.170079+0000","last_fullsized":"2023-07-27T14:38:54.170079+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":159,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175976+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:38:54.175976+0000","last_peered":"2023-07-27T14:38:54.175976+0000","last_clean":"2023-07-27T14:38:54.175976+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:38:54.175976+0000","last_undegraded":"2023-07-27T14:38:54.175976+0000","last_fullsized":"2023-07-27T14:38:54.175976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.188462+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:38:54.188462+0000","last_peered":"2023-07-27T14:38:54.188462+0000","last_clean":"2023-07-27T14:38:54.188462+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:38:54.188462+0000","last_undegraded":"2023-07-27T14:38:54.188462+0000","last_fullsized":"2023-07-27T14:38:54.188462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.188192+0000","last_change":"2023-07-27T14:38:54.186283+0000","last_active":"2023-07-27T14:38:54.188192+0000","last_peered":"2023-07-27T14:38:54.188192+0000","last_clean":"2023-07-27T14:38:54.188192+0000","last_became_active":"2023-07-27T14:38:54.185986+0000","last_became_peered":"2023-07-27T14:38:54.185986+0000","last_unstale":"2023-07-27T14:38:54.188192+0000","last_undegraded":"2023-07-27T14:38:54.188192+0000","last_fullsized":"2023-07-27T14:38:54.188192+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.175104+0000","last_change":"2023-07-27T14:38:53.731790+0000","last_active":"2023-07-27T14:38:54.175104+0000","last_peered":"2023-07-27T14:38:54.175104+0000","last_clean":"2023-07-27T14:38:54.175104+0000","last_became_active":"2023-07-27T14:38:53.731534+0000","last_became_peered":"2023-07-27T14:38:53.731534+0000","last_unstale":"2023-07-27T14:38:54.175104+0000","last_undegraded":"2023-07-27T14:38:54.175104+0000","last_fullsized":"2023-07-27T14:38:54.175104+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":158,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.188549+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:38:54.188549+0000","last_peered":"2023-07-27T14:38:54.188549+0000","last_clean":"2023-07-27T14:38:54.188549+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:38:54.188549+0000","last_undegraded":"2023-07-27T14:38:54.188549+0000","last_fullsized":"2023-07-27T14:38:54.188549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.200728+0000","last_change":"2023-07-27T14:38:54.198059+0000","last_active":"2023-07-27T14:38:54.200728+0000","last_peered":"2023-07-27T14:38:54.200728+0000","last_clean":"2023-07-27T14:38:54.200728+0000","last_became_active":"2023-07-27T14:38:54.197571+0000","last_became_peered":"2023-07-27T14:38:54.197571+0000","last_unstale":"2023-07-27T14:38:54.200728+0000","last_undegraded":"2023-07-27T14:38:54.200728+0000","last_fullsized":"2023-07-27T14:38:54.200728+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"187'1","reported_seq":11,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201804+0000","last_change":"2023-07-27T14:38:53.731529+0000","last_active":"2023-07-27T14:38:54.201804+0000","last_peered":"2023-07-27T14:38:54.201804+0000","last_clean":"2023-07-27T14:38:54.201804+0000","last_became_active":"2023-07-27T14:38:53.731207+0000","last_became_peered":"2023-07-27T14:38:53.731207+0000","last_unstale":"2023-07-27T14:38:54.201804+0000","last_undegraded":"2023-07-27T14:38:54.201804+0000","last_fullsized":"2023-07-27T14:38:54.201804+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184173+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:38:54.184173+0000","last_peered":"2023-07-27T14:38:54.184173+0000","last_clean":"2023-07-27T14:38:54.184173+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:38:54.184173+0000","last_undegraded":"2023-07-27T14:38:54.184173+0000","last_fullsized":"2023-07-27T14:38:54.184173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.202351+0000","last_change":"2023-07-27T14:38:54.194837+0000","last_active":"2023-07-27T14:38:54.202351+0000","last_peered":"2023-07-27T14:38:54.202351+0000","last_clean":"2023-07-27T14:38:54.202351+0000","last_became_active":"2023-07-27T14:38:54.194527+0000","last_became_peered":"2023-07-27T14:38:54.194527+0000","last_unstale":"2023-07-27T14:38:54.202351+0000","last_undegraded":"2023-07-27T14:38:54.202351+0000","last_fullsized":"2023-07-27T14:38:54.202351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"187'2","reported_seq":12,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.201804+0000","last_change":"2023-07-27T14:38:53.725451+0000","last_active":"2023-07-27T14:38:54.201804+0000","last_peered":"2023-07-27T14:38:54.201804+0000","last_clean":"2023-07-27T14:38:54.201804+0000","last_became_active":"2023-07-27T14:38:53.725075+0000","last_became_peered":"2023-07-27T14:38:53.725075+0000","last_unstale":"2023-07-27T14:38:54.201804+0000","last_undegraded":"2023-07-27T14:38:54.201804+0000","last_fullsized":"2023-07-27T14:38:54.201804+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.178325+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:38:54.178325+0000","last_peered":"2023-07-27T14:38:54.178325+0000","last_clean":"2023-07-27T14:38:54.178325+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:38:54.178325+0000","last_undegraded":"2023-07-27T14:38:54.178325+0000","last_fullsized":"2023-07-27T14:38:54.178325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.196775+0000","last_change":"2023-07-27T14:38:54.190802+0000","last_active":"2023-07-27T14:38:54.196775+0000","last_peered":"2023-07-27T14:38:54.196775+0000","last_clean":"2023-07-27T14:38:54.196775+0000","last_became_active":"2023-07-27T14:38:54.190507+0000","last_became_peered":"2023-07-27T14:38:54.190507+0000","last_unstale":"2023-07-27T14:38:54.196775+0000","last_undegraded":"2023-07-27T14:38:54.196775+0000","last_fullsized":"2023-07-27T14:38:54.196775+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:53.698957+0000","last_clean_scrub_stamp":"2023-07-27T14:38:53.698957+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.172204+0000","last_change":"2023-07-27T14:38:53.727221+0000","last_active":"2023-07-27T14:38:54.172204+0000","last_peered":"2023-07-27T14:38:54.172204+0000","last_clean":"2023-07-27T14:38:54.172204+0000","last_became_active":"2023-07-27T14:38:53.726895+0000","last_became_peered":"2023-07-27T14:38:53.726895+0000","last_unstale":"2023-07-27T14:38:54.172204+0000","last_undegraded":"2023-07-27T14:38:54.172204+0000","last_fullsized":"2023-07-27T14:38:54.172204+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:38:52.696298+0000","last_clean_scrub_stamp":"2023-07-27T14:38:52.696298+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-27T14:38:54.184077+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:38:54.184077+0000","last_peered":"2023-07-27T14:38:54.184077+0000","last_clean":"2023-07-27T14:38:54.184077+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:38:54.184077+0000","last_undegraded":"2023-07-27T14:38:54.184077+0000","last_fullsized":"2023-07-27T14:38:54.184077+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24464,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":22144,"kb_avail":94347376,"statfs":{"total":96636764160,"available":96611713024,"internally_reserved":0,"allocated":2367488,"data_stored":1119384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22675456},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.63300000000000001},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":0.996,"15min":1.133},"last":0.624},{"interface":"front","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.64800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.74099999999999999,"5min":0.89900000000000002,"15min":1.1180000000000001},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64600000000000002,"15min":0.68700000000000006},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86299999999999999,"5min":0.879,"15min":1.1759999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.70099999999999996},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82199999999999995,"5min":0.92500000000000004,"15min":1.1459999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.66700000000000004},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78400000000000003,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.77100000000000002,"5min":0.89300000000000002,"15min":1.119},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.54400000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78800000000000003,"5min":0.99399999999999999,"15min":1.069},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67400000000000004,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.878,"5min":0.97899999999999998,"15min":1.165},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.0129999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":0.84499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":1.105,"15min":1.202},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":0.83099999999999996,"5min":1.0069999999999999,"15min":1.101},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.752,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":0.92100000000000004,"5min":1.03,"15min":1.056},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90200000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.81399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24076,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":21760,"kb_avail":94347764,"statfs":{"total":96636764160,"available":96612110336,"internally_reserved":0,"allocated":2363392,"data_stored":1118830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22282240},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.68600000000000005,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.8940000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.67700000000000005,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":6.6980000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":0.748,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":13.975,"5min":13.975,"15min":13.975},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.70999999999999996,"15min":0.66500000000000004},"min":{"1min":0.53000000000000003,"5min":0.44,"15min":0.36699999999999999},"max":{"1min":7.8440000000000003,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.323,"5min":0.78400000000000003,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":14.018000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.55500000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.9530000000000003,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.038,"5min":0.74399999999999999,"15min":0.69499999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.433},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":0.78200000000000003,"15min":0.67300000000000004},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.36399999999999999},"max":{"1min":15.638999999999999,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.39900000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.72399999999999998,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":8.0169999999999995,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.503},{"interface":"front","average":{"1min":1.4159999999999999,"5min":0.83499999999999996,"15min":0.73799999999999999},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":15.461,"5min":15.461,"15min":15.461},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.78400000000000003,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":5.5499999999999998,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.117,"5min":0.82799999999999996,"15min":0.78500000000000003},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":8.0670000000000002,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.749}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24712,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":22400,"kb_avail":94347128,"statfs":{"total":96636764160,"available":96611459072,"internally_reserved":0,"allocated":2359296,"data_stored":1117938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22937600},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.44900000000000001},"min":{"1min":0.28199999999999997,"5min":0.26300000000000001,"15min":0.23699999999999999},"max":{"1min":0.53700000000000003,"5min":0.61499999999999999,"15min":4.75},"last":0.377},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41599999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":9.3100000000000005},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46500000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":2.7160000000000002},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.496},"min":{"1min":0.373,"5min":0.36899999999999999,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45900000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57599999999999996,"5min":0.61299999999999999,"15min":3.8580000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41699999999999998},"max":{"1min":0.94499999999999995,"5min":1.1639999999999999,"15min":2.181},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.70799999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.92400000000000004,"5min":1.014,"15min":2.4180000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69599999999999995,"15min":0.73399999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.621},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.45400000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.55300000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95999999999999996,"5min":1.085,"15min":2.052},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.77500000000000002},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95699999999999996,"5min":1.1419999999999999,"15min":2.016},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.59899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.629}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23324,"kb_used_data":2324,"kb_used_omap":0,"kb_used_meta":20992,"kb_avail":94348516,"statfs":{"total":96636764160,"available":96612880384,"internally_reserved":0,"allocated":2379776,"data_stored":1118708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21495808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.253,"15min":0.245},"max":{"1min":0.56399999999999995,"5min":1.954,"15min":1.954},"last":0.315},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41099999999999998,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.443},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45900000000000002,"15min":0.46500000000000002},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52000000000000002,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46200000000000002,"15min":0.47399999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.57699999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":0.85899999999999999,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.55000000000000004,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.98999999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71599999999999997},"min":{"1min":0.59199999999999997,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":1.034,"5min":1.0489999999999999,"15min":1.25},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.6020000000000001},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.498},"max":{"1min":0.88700000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44,"15min":0.44},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.22},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.109,"5min":2.141,"15min":2.141},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.63700000000000001,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":0.93999999999999995,"5min":1.125,"15min":1.2370000000000001},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26824,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":24512,"kb_avail":94345016,"statfs":{"total":96636764160,"available":96609296384,"internally_reserved":0,"allocated":2359296,"data_stored":1117938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25100288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.29399999999999998,"5min":0.27200000000000002,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.77100000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.42499999999999999,"15min":0.45800000000000002},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57199999999999995,"5min":0.60999999999999999,"15min":1.1899999999999999},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46899999999999997},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.624,"5min":0.64700000000000002,"15min":0.96399999999999997},"last":0.502},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.48599999999999999},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.68999999999999995,"15min":5.601},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.46600000000000003},"min":{"1min":0.33700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.83499999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.498,"15min":0.51600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":1.002,"15min":1.353},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.71099999999999997},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.42999999999999999},"max":{"1min":0.78800000000000003,"5min":0.90600000000000003,"15min":1.849},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":0.95399999999999996,"5min":0.95499999999999996,"15min":6.9660000000000002},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.57299999999999995,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":1.163,"15min":1.163},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.58199999999999996,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":1.04,"15min":1.772},"last":0.622}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.58099999999999996,"5min":0.48199999999999998,"15min":0.42499999999999999},"max":{"1min":0.84799999999999998,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.749},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72399999999999998,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":1.105,"15min":3.1360000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.024,"5min":1.024,"15min":1.8089999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.76600000000000001},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":1.0569999999999999,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23116,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":20800,"kb_avail":94348724,"statfs":{"total":96636764160,"available":96613093376,"internally_reserved":0,"allocated":2363392,"data_stored":1118028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21299200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.52300000000000002,"5min":0.66800000000000004,"15min":1.202},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.42999999999999999},"min":{"1min":0.32700000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.54600000000000004,"5min":0.71199999999999997,"15min":1.302},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.41499999999999998,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.439,"15min":0.44800000000000001},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.30399999999999999},"max":{"1min":0.56200000000000006,"5min":0.64300000000000002,"15min":1.2390000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.626,"5min":0.69199999999999995,"15min":1.8029999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67000000000000004,"15min":0.68899999999999995},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":0.97399999999999998,"15min":1.149},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.71799999999999997},"min":{"1min":0.51600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.85899999999999999,"5min":0.94099999999999995,"15min":5.1059999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.59999999999999998,"5min":0.47499999999999998,"15min":0.46000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":1.232},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69399999999999995,"15min":0.72699999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.298},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.55000000000000004,"5min":0.501,"15min":0.44},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.343},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jul 27 14:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73899999999999999,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.94199999999999995,"5min":1.115,"15min":2.048},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.93100000000000005,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.77400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17940,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":15616,"kb_avail":94353900,"statfs":{"total":96636764160,"available":96618393600,"internally_reserved":0,"allocated":2371584,"data_stored":1118616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15990784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.5,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.876,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63700000000000001,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.78900000000000003,"5min":3.419,"15min":4.4409999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.67700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.86399999999999999,"5min":2.3010000000000002,"15min":4.476},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69499999999999995},"min":{"1min":0.52600000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94099999999999995,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85099999999999998,"5min":3.48,"15min":4.3949999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.40600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79000000000000004,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":3.8620000000000001,"15min":5.194},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.56000000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":2.387,"15min":5.5990000000000002},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:38:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.59299999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0960000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574996,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26072,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":23744,"kb_avail":94345768,"statfs":{"total":96636764160,"available":96610066432,"internally_reserved":0,"allocated":2375680,"data_stored":1118674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24313856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.443,"5min":0.35499999999999998,"15min":0.317},"max":{"1min":0.874,"5min":0.92800000000000005,"15min":1.5209999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58599999999999997,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84099999999999997,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.747}]},{"osd":1,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66200000000000003,"15min":0.69099999999999995},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.377},"max":{"1min":0.94599999999999995,"5min":1.026,"15min":6.7489999999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.878,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":0.81699999999999995,"5min":0.98799999999999999,"15min":1.581},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.66100000000000003},"min":{"1min":0.51800000000000002,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":0.92500000000000004,"5min":0.98999999999999999,"15min":3.8220000000000001},"last":0.877}]},{"osd":3,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.626,"15min":0.67400000000000004},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.77200000000000002,"5min":0.89800000000000002,"15min":9.6920000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.77000000000000002},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.91900000000000004,"5min":0.92500000000000004,"15min":1.978},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.95799999999999996,"15min":2.4129999999999998},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.48999999999999999,"5min":0.46800000000000003,"15min":0.45900000000000002},"max":{"1min":0.85299999999999998,"5min":0.97799999999999998,"15min":2.3719999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.86299999999999999,"5min":1.115,"15min":1.9419999999999999},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:39:03.785 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:39:03.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:39:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.959+0000 7fece41ff700 1 Processor -- start 2023-07-27T14:39:04.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.959+0000 7fece41ff700 1 -- start start 2023-07-27T14:39:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.960+0000 7fece41ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 0x7fecdc0c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.960+0000 7fece41ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecdc0a7940 0x7fecdc0c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece41ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc0c7ad0 con 0x7fecdc0c7550 2023-07-27T14:39:04.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece41ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecdc0c5590 con 0x7fecdc0a7940 2023-07-27T14:39:04.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece41ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0c0fb0 con 0x7fecdc157400 2023-07-27T14:39:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece179a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecdc0a7940 0x7fecdc0c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece279c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fecdc0c7550 0x7fecdc0c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54420/0 (socket says 172.21.15.115:54420) 2023-07-27T14:39:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece279c700 1 -- 172.21.15.115:0/1707089110 learned_addr learned my addr 172.21.15.115:0/1707089110 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece1f9b700 1 --2- 172.21.15.115:0/1707089110 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 0x7fecdc0c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece179a700 1 -- 172.21.15.115:0/1707089110 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 msgr2=0x7fecdc0c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece179a700 1 --2- 172.21.15.115:0/1707089110 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 0x7fecdc0c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece179a700 1 -- 172.21.15.115:0/1707089110 >> v1:172.21.15.115:6789/0 conn(0x7fecdc0c7550 legacy=0x7fecdc0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece179a700 1 -- 172.21.15.115:0/1707089110 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0c7db0 con 0x7fecdc0a7940 2023-07-27T14:39:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.961+0000 7fece0f99700 1 -- 172.21.15.115:0/1707089110 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765789986 0 0) 0x7fecdc0c7ad0 con 0x7fecdc0c7550 2023-07-27T14:39:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece179a700 1 --2- 172.21.15.115:0/1707089110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0a7940 0x7fecdc0c0ac0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7feccc009760 tx=0x7feccc009060).ready entity=mon.0 client_cookie=4ba0c86aa309c275 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece0f99700 1 -- 172.21.15.115:0/1707089110 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00f510 con 0x7fecdc0a7940 2023-07-27T14:39:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece0f99700 1 -- 172.21.15.115:0/1707089110 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc00f670 con 0x7fecdc0a7940 2023-07-27T14:39:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece0f99700 1 -- 172.21.15.115:0/1707089110 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00f9f0 con 0x7fecdc0a7940 2023-07-27T14:39:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece41ff700 1 -- 172.21.15.115:0/1707089110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0a7940 msgr2=0x7fecdc0c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece41ff700 1 --2- 172.21.15.115:0/1707089110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0a7940 0x7fecdc0c0ac0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7feccc009760 tx=0x7feccc009060).stop 2023-07-27T14:39:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece41ff700 1 -- 172.21.15.115:0/1707089110 shutdown_connections 2023-07-27T14:39:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece41ff700 1 --2- 172.21.15.115:0/1707089110 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 0x7fecdc0c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece41ff700 1 --2- 172.21.15.115:0/1707089110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0a7940 0x7fecdc0c0ac0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.962+0000 7fece41ff700 1 -- 172.21.15.115:0/1707089110 >> 172.21.15.115:0/1707089110 conn(0x7fecdc094280 msgr2=0x7fecdc05e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:04.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.963+0000 7fece41ff700 1 -- 172.21.15.115:0/1707089110 shutdown_connections 2023-07-27T14:39:04.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.963+0000 7fece41ff700 1 -- 172.21.15.115:0/1707089110 wait complete. 2023-07-27T14:39:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.964+0000 7fece41ff700 1 Processor -- start 2023-07-27T14:39:04.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.964+0000 7fece41ff700 1 -- start start 2023-07-27T14:39:04.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece41ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecdc0a7940 0x7fecdc1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece41ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0c7550 0x7fecdc152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece41ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 0x7fecdc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece41ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1530c0 con 0x7fecdc0c7550 2023-07-27T14:39:04.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece41ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0c3230 con 0x7fecdc0a7940 2023-07-27T14:39:04.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece41ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0c2660 con 0x7fecdc157400 2023-07-27T14:39:04.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0c7550 0x7fecdc152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0c7550 0x7fecdc152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57878/0 (socket says 172.21.15.115:57878) 2023-07-27T14:39:04.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.965+0000 7fece179a700 1 -- 172.21.15.115:0/1525500555 learned_addr learned my addr 172.21.15.115:0/1525500555 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:04.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece1f9b700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecdc0a7940 0x7fecdc1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece279c700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 0x7fecdc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece179a700 1 -- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 msgr2=0x7fecdc155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece179a700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 0x7fecdc155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece179a700 1 -- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecdc0a7940 msgr2=0x7fecdc1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece179a700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecdc0a7940 0x7fecdc1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece179a700 1 -- 172.21.15.115:0/1525500555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0092a0 con 0x7fecdc0c7550 2023-07-27T14:39:04.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece1f9b700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecdc0a7940 0x7fecdc1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:04.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece179a700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0c7550 0x7fecdc152bd0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7fecdc05edc0 tx=0x7feccc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:04.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fecd1ffb700 1 -- 172.21.15.115:0/1525500555 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00f7e0 con 0x7fecdc0c7550 2023-07-27T14:39:04.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fecd1ffb700 1 -- 172.21.15.115:0/1525500555 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc00f980 con 0x7fecdc0c7550 2023-07-27T14:39:04.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc0c2900 con 0x7fecdc0c7550 2023-07-27T14:39:04.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fecd1ffb700 1 -- 172.21.15.115:0/1525500555 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc01b690 con 0x7fecdc0c7550 2023-07-27T14:39:04.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.966+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc0c2ec0 con 0x7fecdc0c7550 2023-07-27T14:39:04.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.967+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc06c470 con 0x7fecdc0c7550 2023-07-27T14:39:04.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.968+0000 7fecd1ffb700 1 -- 172.21.15.115:0/1525500555 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7feccc02a070 con 0x7fecdc0c7550 2023-07-27T14:39:04.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.969+0000 7fecd1ffb700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fecc005fb20 0x7fecc0061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.969+0000 7fecd1ffb700 1 -- 172.21.15.115:0/1525500555 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feccc07c720 con 0x7fecdc0c7550 2023-07-27T14:39:04.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.969+0000 7fece1f9b700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fecc005fb20 0x7fecc0061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.970+0000 7fece1f9b700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fecc005fb20 0x7fecc0061fe0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fecd8009c00 tx=0x7fecd8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:03.973+0000 7fecd1ffb700 1 -- 172.21.15.115:0/1525500555 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feccc04cdf0 con 0x7fecdc0c7550 2023-07-27T14:39:04.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.204+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fecdc0c0950 con 0x7fecdc0c7550 2023-07-27T14:39:04.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.209+0000 7fecd1ffb700 1 -- 172.21.15.115:0/1525500555 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7feccc0280e0 con 0x7fecdc0c7550 2023-07-27T14:39:04.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fecc005fb20 msgr2=0x7fecc0061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fecc005fb20 0x7fecc0061fe0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fecd8009c00 tx=0x7fecd8008040).stop 2023-07-27T14:39:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0c7550 msgr2=0x7fecdc152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0c7550 0x7fecdc152bd0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7fecdc05edc0 tx=0x7feccc017000).stop 2023-07-27T14:39:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 shutdown_connections 2023-07-27T14:39:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fecc005fb20 0x7fecc0061fe0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fecdc157400 0x7fecdc155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fecdc0a7940 0x7fecdc1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 --2- 172.21.15.115:0/1525500555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecdc0c7550 0x7fecdc152bd0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 >> 172.21.15.115:0/1525500555 conn(0x7fecdc094280 msgr2=0x7fecdc0a8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 shutdown_connections 2023-07-27T14:39:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.211+0000 7fece41ff700 1 -- 172.21.15.115:0/1525500555 wait complete. 2023-07-27T14:39:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:39:04.282 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:39:04.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.417+0000 7fc2685ff700 1 Processor -- start 2023-07-27T14:39:04.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.418+0000 7fc2685ff700 1 -- start start 2023-07-27T14:39:04.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc2685ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc260153ec0 0x7fc2600a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc2685ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc2600aa050 0x7fc2600640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc2685ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2600aa4d0 con 0x7fc2600aaa40 2023-07-27T14:39:04.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc2685ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2600c05c0 con 0x7fc260153ec0 2023-07-27T14:39:04.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc2685ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2600c1a60 con 0x7fc2600aa050 2023-07-27T14:39:04.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc26639b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc260153ec0 0x7fc2600a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc26639b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc260153ec0 0x7fc2600a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57882/0 (socket says 172.21.15.115:57882) 2023-07-27T14:39:04.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc26639b700 1 -- 172.21.15.115:0/4002678857 learned_addr learned my addr 172.21.15.115:0/4002678857 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:04.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc265b9a700 1 --2- 172.21.15.115:0/4002678857 >> v2:172.21.15.159:3300/0 conn(0x7fc2600aa050 0x7fc2600640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc26639b700 1 -- 172.21.15.115:0/4002678857 >> v2:172.21.15.159:3300/0 conn(0x7fc2600aa050 msgr2=0x7fc2600640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc26639b700 1 --2- 172.21.15.115:0/4002678857 >> v2:172.21.15.159:3300/0 conn(0x7fc2600aa050 0x7fc2600640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.419+0000 7fc26639b700 1 -- 172.21.15.115:0/4002678857 >> v1:172.21.15.159:6789/0 conn(0x7fc2600aaa40 legacy=0x7fc260157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.420+0000 7fc26639b700 1 -- 172.21.15.115:0/4002678857 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2600bfc90 con 0x7fc260153ec0 2023-07-27T14:39:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.420+0000 7fc265b9a700 1 --2- 172.21.15.115:0/4002678857 >> v2:172.21.15.159:3300/0 conn(0x7fc2600aa050 0x7fc2600640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:04.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.420+0000 7fc26639b700 1 --2- 172.21.15.115:0/4002678857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc260153ec0 0x7fc2600a9b60 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7fc26006c0d0 tx=0x7fc25c0090f0).ready entity=mon.0 client_cookie=61ef1424a66c2cc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.420+0000 7fc265399700 1 -- 172.21.15.115:0/4002678857 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00b5a0 con 0x7fc260153ec0 2023-07-27T14:39:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.420+0000 7fc265399700 1 -- 172.21.15.115:0/4002678857 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c00b700 con 0x7fc260153ec0 2023-07-27T14:39:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.420+0000 7fc265399700 1 -- 172.21.15.115:0/4002678857 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00ba80 con 0x7fc260153ec0 2023-07-27T14:39:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.420+0000 7fc2685ff700 1 -- 172.21.15.115:0/4002678857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc260153ec0 msgr2=0x7fc2600a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.420+0000 7fc2685ff700 1 --2- 172.21.15.115:0/4002678857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc260153ec0 0x7fc2600a9b60 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7fc26006c0d0 tx=0x7fc25c0090f0).stop 2023-07-27T14:39:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.421+0000 7fc2685ff700 1 -- 172.21.15.115:0/4002678857 shutdown_connections 2023-07-27T14:39:04.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.421+0000 7fc2685ff700 1 --2- 172.21.15.115:0/4002678857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc260153ec0 0x7fc2600a9b60 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.421+0000 7fc2685ff700 1 --2- 172.21.15.115:0/4002678857 >> v2:172.21.15.159:3300/0 conn(0x7fc2600aa050 0x7fc2600640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.421+0000 7fc2685ff700 1 -- 172.21.15.115:0/4002678857 >> 172.21.15.115:0/4002678857 conn(0x7fc2600cb610 msgr2=0x7fc2600c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:04.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.421+0000 7fc2685ff700 1 -- 172.21.15.115:0/4002678857 shutdown_connections 2023-07-27T14:39:04.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.421+0000 7fc2685ff700 1 -- 172.21.15.115:0/4002678857 wait complete. 2023-07-27T14:39:04.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.422+0000 7fc2685ff700 1 Processor -- start 2023-07-27T14:39:04.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.422+0000 7fc2685ff700 1 -- start start 2023-07-27T14:39:04.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc2685ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600aa050 0x7fc26014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc2685ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2600aaa40 0x7fc260140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc2685ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc260153ec0 0x7fc2600c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc2685ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2600c2600 con 0x7fc2600aaa40 2023-07-27T14:39:04.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc2685ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2600c4a40 con 0x7fc2600aa050 2023-07-27T14:39:04.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc2685ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2600c3110 con 0x7fc260153ec0 2023-07-27T14:39:04.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc265b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2600aaa40 0x7fc260140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc265b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2600aaa40 0x7fc260140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57886/0 (socket says 172.21.15.115:57886) 2023-07-27T14:39:04.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.423+0000 7fc265b9a700 1 -- 172.21.15.115:0/2785387606 learned_addr learned my addr 172.21.15.115:0/2785387606 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:04.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc26639b700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600aa050 0x7fc26014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc266b9c700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc260153ec0 0x7fc2600c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc265b9a700 1 -- 172.21.15.115:0/2785387606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc260153ec0 msgr2=0x7fc2600c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc265b9a700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc260153ec0 0x7fc2600c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc265b9a700 1 -- 172.21.15.115:0/2785387606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600aa050 msgr2=0x7fc26014f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc265b9a700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600aa050 0x7fc26014f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc265b9a700 1 -- 172.21.15.115:0/2785387606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c009370 con 0x7fc2600aaa40 2023-07-27T14:39:04.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc265b9a700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2600aaa40 0x7fc260140990 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fc25000c880 tx=0x7fc250008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:04.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc2567fc700 1 -- 172.21.15.115:0/2785387606 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250010580 con 0x7fc2600aaa40 2023-07-27T14:39:04.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc2567fc700 1 -- 172.21.15.115:0/2785387606 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2500106e0 con 0x7fc2600aaa40 2023-07-27T14:39:04.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc260140e80 con 0x7fc2600aaa40 2023-07-27T14:39:04.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc2567fc700 1 -- 172.21.15.115:0/2785387606 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250010a60 con 0x7fc2600aaa40 2023-07-27T14:39:04.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.424+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2600c2ac0 con 0x7fc2600aaa40 2023-07-27T14:39:04.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.425+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26006c470 con 0x7fc2600aaa40 2023-07-27T14:39:04.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.426+0000 7fc2567fc700 1 -- 172.21.15.115:0/2785387606 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fc25001b460 con 0x7fc2600aaa40 2023-07-27T14:39:04.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.427+0000 7fc2567fc700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc24405fb50 0x7fc244062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:04.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.427+0000 7fc2567fc700 1 -- 172.21.15.115:0/2785387606 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc25007b280 con 0x7fc2600aaa40 2023-07-27T14:39:04.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.427+0000 7fc26639b700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc24405fb50 0x7fc244062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:04.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.428+0000 7fc26639b700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc24405fb50 0x7fc244062010 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fc25c009130 tx=0x7fc25c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:04.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.431+0000 7fc2567fc700 1 -- 172.21.15.115:0/2785387606 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc25004b8f0 con 0x7fc2600aaa40 2023-07-27T14:39:04.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.638+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc260069e60 con 0x7fc2600aaa40 2023-07-27T14:39:04.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.639+0000 7fc2567fc700 1 -- 172.21.15.115:0/2785387606 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4504 (secure 0 0 0) 0x7fc25004ef10 con 0x7fc2600aaa40 2023-07-27T14:39:04.693 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:04.694 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":102,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2746189426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2746189426},{"type":"v1","addr":"172.21.15.159:6835","nonce":2746189426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/131117331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":131117331},{"type":"v1","addr":"172.21.15.115:6837","nonce":131117331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":8608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3669259360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3669259360},{"type":"v1","addr":"172.21.15.159:6834","nonce":3669259360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:38:54.165239+0000","modified":"2023-07-27T14:38:57.194631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2564907842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2564907842},{"type":"v1","addr":"172.21.15.115:6836","nonce":2564907842}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-07-27T14:39:04.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc24405fb50 msgr2=0x7fc244062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc24405fb50 0x7fc244062010 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fc25c009130 tx=0x7fc25c015000).stop 2023-07-27T14:39:04.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2600aaa40 msgr2=0x7fc260140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:04.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2600aaa40 0x7fc260140990 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7fc25000c880 tx=0x7fc250008040).stop 2023-07-27T14:39:04.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 shutdown_connections 2023-07-27T14:39:04.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc24405fb50 0x7fc244062010 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc260153ec0 0x7fc2600c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2600aa050 0x7fc26014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 --2- 172.21.15.115:0/2785387606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2600aaa40 0x7fc260140990 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:04.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 >> 172.21.15.115:0/2785387606 conn(0x7fc2600cb610 msgr2=0x7fc2600ab9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:04.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 shutdown_connections 2023-07-27T14:39:04.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:04.641+0000 7fc2685ff700 1 -- 172.21.15.115:0/2785387606 wait complete. 2023-07-27T14:39:04.699 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 102 2023-07-27T14:39:05.114 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:38:54.165239+0000', 'modified': '2023-07-27T14:38:57.194631+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9780}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9780': {'gid': 9780, 'name': 'a', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6836/2564907842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 2564907842}, {'type': 'v1', 'addr': '172.21.15.115:6836', 'nonce': 2564907842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:39:05.115 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:39:05.115 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-27T14:39:05.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.250+0000 7f19881ff700 1 Processor -- start 2023-07-27T14:39:05.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.250+0000 7f19881ff700 1 -- start start 2023-07-27T14:39:05.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f19881ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19800aaa40 0x7f19800640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f19881ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19800aa4d0 con 0x7f19801542a0 2023-07-27T14:39:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f19881ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19800c05c0 con 0x7f1980153ec0 2023-07-27T14:39:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f19881ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19800aa270 con 0x7f19800aaa40 2023-07-27T14:39:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f198579a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f19800aaa40 0x7f19800640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f198679c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f19801542a0 0x7f19800c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54434/0 (socket says 172.21.15.115:54434) 2023-07-27T14:39:05.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f198679c700 1 -- 172.21.15.115:0/4235755700 learned_addr learned my addr 172.21.15.115:0/4235755700 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f198579a700 1 -- 172.21.15.115:0/4235755700 >> v1:172.21.15.159:6789/0 conn(0x7f1980153ec0 legacy=0x7f19800a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.252+0000 7f198579a700 1 -- 172.21.15.115:0/4235755700 >> v1:172.21.15.115:6789/0 conn(0x7f19801542a0 legacy=0x7f19800c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.253+0000 7f198579a700 1 -- 172.21.15.115:0/4235755700 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800bfc90 con 0x7f19800aaa40 2023-07-27T14:39:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.253+0000 7f1984f99700 1 -- 172.21.15.115:0/4235755700 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636010895 0 0) 0x7f1978001490 con 0x7f19801542a0 2023-07-27T14:39:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.253+0000 7f198579a700 1 --2- 172.21.15.115:0/4235755700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800aaa40 0x7f19800640f0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7f1970009760 tx=0x7f1970009060).ready entity=mon.0 client_cookie=ae569775b48ba87b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.253+0000 7f1984f99700 1 -- 172.21.15.115:0/4235755700 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000b580 con 0x7f19800aaa40 2023-07-27T14:39:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.253+0000 7f1984f99700 1 -- 172.21.15.115:0/4235755700 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197000b6e0 con 0x7f19800aaa40 2023-07-27T14:39:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.253+0000 7f1984f99700 1 -- 172.21.15.115:0/4235755700 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000ba60 con 0x7f19800aaa40 2023-07-27T14:39:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.253+0000 7f19881ff700 1 -- 172.21.15.115:0/4235755700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800aaa40 msgr2=0x7f19800640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.253+0000 7f19881ff700 1 --2- 172.21.15.115:0/4235755700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800aaa40 0x7f19800640f0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7f1970009760 tx=0x7f1970009060).stop 2023-07-27T14:39:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.254+0000 7f19881ff700 1 -- 172.21.15.115:0/4235755700 shutdown_connections 2023-07-27T14:39:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.254+0000 7f19881ff700 1 --2- 172.21.15.115:0/4235755700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800aaa40 0x7f19800640f0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.254+0000 7f19881ff700 1 -- 172.21.15.115:0/4235755700 >> 172.21.15.115:0/4235755700 conn(0x7f19800cb610 msgr2=0x7f19800c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:05.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.254+0000 7f19881ff700 1 -- 172.21.15.115:0/4235755700 shutdown_connections 2023-07-27T14:39:05.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.254+0000 7f19881ff700 1 -- 172.21.15.115:0/4235755700 wait complete. 2023-07-27T14:39:05.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.255+0000 7f19881ff700 1 Processor -- start 2023-07-27T14:39:05.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.255+0000 7f19881ff700 1 -- start start 2023-07-27T14:39:05.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f19881ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19800aaa40 0x7f198014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f19881ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1980153ec0 0x7f19800c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f19881ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19801542a0 0x7f19800c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f19881ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1980159000 con 0x7f1980153ec0 2023-07-27T14:39:05.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f19881ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19801592e0 con 0x7f19801542a0 2023-07-27T14:39:05.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f19881ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19800add00 con 0x7f19800aaa40 2023-07-27T14:39:05.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f198579a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1980153ec0 0x7f19800c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f198579a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1980153ec0 0x7f19800c2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57892/0 (socket says 172.21.15.115:57892) 2023-07-27T14:39:05.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f198579a700 1 -- 172.21.15.115:0/2370539933 learned_addr learned my addr 172.21.15.115:0/2370539933 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:05.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.256+0000 7f1985f9b700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19800aaa40 0x7f198014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f198679c700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19801542a0 0x7f19800c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f198579a700 1 -- 172.21.15.115:0/2370539933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19800aaa40 msgr2=0x7f198014f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f198579a700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19800aaa40 0x7f198014f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f198579a700 1 -- 172.21.15.115:0/2370539933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19801542a0 msgr2=0x7f19800c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f198579a700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19801542a0 0x7f19800c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f198579a700 1 -- 172.21.15.115:0/2370539933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700092a0 con 0x7f1980153ec0 2023-07-27T14:39:05.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f198579a700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1980153ec0 0x7f19800c2730 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7f198005fc60 tx=0x7f1970017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f1975ffb700 1 -- 172.21.15.115:0/2370539933 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000b850 con 0x7f1980153ec0 2023-07-27T14:39:05.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f1975ffb700 1 -- 172.21.15.115:0/2370539933 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197000b9b0 con 0x7f1980153ec0 2023-07-27T14:39:05.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f19881ff700 1 -- 172.21.15.115:0/2370539933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19800adfe0 con 0x7f1980153ec0 2023-07-27T14:39:05.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f1975ffb700 1 -- 172.21.15.115:0/2370539933 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197001b660 con 0x7f1980153ec0 2023-07-27T14:39:05.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.257+0000 7f19881ff700 1 -- 172.21.15.115:0/2370539933 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198014fdd0 con 0x7f1980153ec0 2023-07-27T14:39:05.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.260+0000 7f1975ffb700 1 -- 172.21.15.115:0/2370539933 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f197000f070 con 0x7f1980153ec0 2023-07-27T14:39:05.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.261+0000 7f1975ffb700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f196405fb20 0x7f1964061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.261+0000 7f1975ffb700 1 -- 172.21.15.115:0/2370539933 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f197007cb00 con 0x7f1980153ec0 2023-07-27T14:39:05.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.261+0000 7f1985f9b700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f196405fb20 0x7f1964061fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.261+0000 7f1985f9b700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f196405fb20 0x7f1964061fe0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f197c003900 tx=0x7f197c007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.263+0000 7f199f428b80 1 Processor -- start 2023-07-27T14:39:05.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.263+0000 7f199f428b80 1 -- start start 2023-07-27T14:39:05.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.263+0000 7f199f428b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x5649592579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f199f428b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56495927f830 0x5649592a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f199f428b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564959259f60 0x5649592a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f199f428b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649591949c0 con 0x564959259f60 2023-07-27T14:39:05.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f199f428b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649591a9cc0 con 0x56495927f830 2023-07-27T14:39:05.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f199f428b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x564959170e10 con 0x5649592575c0 2023-07-27T14:39:05.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564959259f60 0x5649592a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564959259f60 0x5649592a61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57894/0 (socket says 172.21.15.115:57894) 2023-07-27T14:39:05.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 -- 172.21.15.115:0/841376568 learned_addr learned my addr 172.21.15.115:0/841376568 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:05.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f1985f9b700 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x5649592579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198579a700 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56495927f830 0x5649592a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 -- 172.21.15.115:0/841376568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 msgr2=0x5649592579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:05.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x5649592579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 -- 172.21.15.115:0/841376568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56495927f830 msgr2=0x5649592a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:05.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56495927f830 0x5649592a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 -- 172.21.15.115:0/841376568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649591a29a0 con 0x564959259f60 2023-07-27T14:39:05.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.264+0000 7f198679c700 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564959259f60 0x5649592a61b0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7f197800c930 tx=0x7f1978009040).ready entity=mon.0 client_cookie=37c0e0bbd0c1e6d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f196affd700 1 -- 172.21.15.115:0/841376568 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800ced0 con 0x564959259f60 2023-07-27T14:39:05.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f196affd700 1 -- 172.21.15.115:0/841376568 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978005d10 con 0x564959259f60 2023-07-27T14:39:05.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f196affd700 1 -- 172.21.15.115:0/841376568 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978004c60 con 0x564959259f60 2023-07-27T14:39:05.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 -- 172.21.15.115:0/841376568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564959259f60 msgr2=0x5649592a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564959259f60 0x5649592a61b0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7f197800c930 tx=0x7f1978009040).stop 2023-07-27T14:39:05.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 -- 172.21.15.115:0/841376568 shutdown_connections 2023-07-27T14:39:05.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564959259f60 0x5649592a61b0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x5649592579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 --2- 172.21.15.115:0/841376568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56495927f830 0x5649592a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 -- 172.21.15.115:0/841376568 >> 172.21.15.115:0/841376568 conn(0x5649590c2940 msgr2=0x5649592a06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:05.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 -- 172.21.15.115:0/841376568 shutdown_connections 2023-07-27T14:39:05.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.265+0000 7f199f428b80 1 -- 172.21.15.115:0/841376568 wait complete. 2023-07-27T14:39:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.266+0000 7f199f428b80 1 -- start start 2023-07-27T14:39:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.266+0000 7f199f428b80 1 Processor -- start 2023-07-27T14:39:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.267+0000 7f199f428b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x56495929fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.267+0000 7f199f428b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 0x56495927bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.267+0000 7f199f428b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.267+0000 7f199f428b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649592ac260 con 0x56495929e300 2023-07-27T14:39:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f199f428b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x56495929e890 con 0x564959259f60 2023-07-27T14:39:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f199f428b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x56495929f0a0 con 0x5649592575c0 2023-07-27T14:39:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f199f428b80 10 client.0 ll_register_callbacks cb 0x56495915c4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:39:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57904/0 (socket says 172.21.15.115:57904) 2023-07-27T14:39:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 -- 172.21.15.115:0/943459878 learned_addr learned my addr 172.21.15.115:0/943459878 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f1985f9b700 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x56495929fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198579a700 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 0x56495927bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 -- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 msgr2=0x56495929fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x56495929fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 -- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 msgr2=0x56495927bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 0x56495927bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 -- 172.21.15.115:0/943459878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197800f040 con 0x56495929e300 2023-07-27T14:39:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f1985f9b700 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x56495929fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f198679c700 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927c130 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f1978012000 tx=0x7f1978009040).ready entity=mon.0 client_cookie=ab3b3270c9f0ae7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.268+0000 7f195ffff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:39:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f195ffff700 1 -- 172.21.15.115:0/943459878 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800eb40 con 0x56495929e300 2023-07-27T14:39:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f195ffff700 1 -- 172.21.15.115:0/943459878 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f197800eca0 con 0x56495929e300 2023-07-27T14:39:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 1 -- 172.21.15.115:0/943459878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564959251d50 con 0x56495929e300 2023-07-27T14:39:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f195ffff700 1 -- 172.21.15.115:0/943459878 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f197800ee60 con 0x56495929e300 2023-07-27T14:39:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 10 client.9948 fetch_fsmap learned FSMap version 102 2023-07-27T14:39:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 1 -- 172.21.15.115:0/943459878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x56495919e190 con 0x56495929e300 2023-07-27T14:39:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f195ffff700 1 -- 172.21.15.115:0/943459878 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564959251d50 con 0x56495929e300 2023-07-27T14:39:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f195ffff700 1 -- 172.21.15.115:0/943459878 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 102) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1978007320 con 0x56495929e300 2023-07-27T14:39:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 10 client.9948 fetch_fsmap finished waiting for FSMap version 102 2023-07-27T14:39:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 10 client.9948 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:39:05.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 20 client.9948 populate_metadata read hostname 'smithi115' 2023-07-27T14:39:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] conn(0x564959284fe0 0x5649592b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 4 client.9948 mds_command: new command op to 9780 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:39:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.269+0000 7f199f428b80 1 -- 172.21.15.115:0/943459878 --> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564959012ef0 con 0x564959284fe0 2023-07-27T14:39:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.270+0000 7f1985f9b700 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] conn(0x564959284fe0 0x5649592b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.270+0000 7f1985f9b700 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] conn(0x564959284fe0 0x5649592b99b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eb4b2411f73166b1 server_cookie=de4598795d27b41b in_seq=0 out_seq=0 2023-07-27T14:39:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.270+0000 7f195ffff700 10 client.9948 ms_handle_connect on v2:172.21.15.115:6834/2564907842 2023-07-27T14:39:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f195ffff700 1 -- 172.21.15.115:0/943459878 <== mds.0 v2:172.21.15.115:6834/2564907842 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x564959012ef0 con 0x564959284fe0 2023-07-27T14:39:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f195ffff700 10 client.9948 handle_command_reply: tid=0 2023-07-27T14:39:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 client.9948 shutdown 2023-07-27T14:39:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 -- 172.21.15.115:0/943459878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 msgr2=0x56495927c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927c130 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f1978012000 tx=0x7f1978009040).stop 2023-07-27T14:39:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 -- 172.21.15.115:0/943459878 shutdown_connections 2023-07-27T14:39:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927c130 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5649592575c0 0x56495929fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] conn(0x564959284fe0 0x5649592b99b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 --2- 172.21.15.115:0/943459878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 0x56495927bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f195ffff700 0 client.9948 ms_handle_reset on v2:172.21.15.115:6834/2564907842 2023-07-27T14:39:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 -- 172.21.15.115:0/943459878 >> 172.21.15.115:0/943459878 conn(0x5649590c2940 msgr2=0x5649592a0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 -- 172.21.15.115:0/943459878 shutdown_connections 2023-07-27T14:39:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 1 -- 172.21.15.115:0/943459878 wait complete. 2023-07-27T14:39:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.271+0000 7f199f428b80 20 client.9948 trim_cache size 0 max 16384 2023-07-27T14:39:05.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.288+0000 7f199f428b80 1 Processor -- start 2023-07-27T14:39:05.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.288+0000 7f199f428b80 1 -- start start 2023-07-27T14:39:05.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f199f428b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5649592575c0 0x564959253730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f199f428b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x564959259f60 0x56495927ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f199f428b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f199f428b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x564959286300 con 0x56495929e300 2023-07-27T14:39:05.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f199f428b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649592ab430 con 0x5649592575c0 2023-07-27T14:39:05.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f199f428b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x56495927c3e0 con 0x564959259f60 2023-07-27T14:39:05.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f198679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f198679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57910/0 (socket says 172.21.15.115:57910) 2023-07-27T14:39:05.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f198679c700 1 -- 172.21.15.115:0/679141985 learned_addr learned my addr 172.21.15.115:0/679141985 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:05.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f1985f9b700 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5649592575c0 0x564959253730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.289+0000 7f198579a700 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x564959259f60 0x56495927ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f198679c700 1 -- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x564959259f60 msgr2=0x56495927ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:05.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f198679c700 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x564959259f60 0x56495927ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f198679c700 1 -- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5649592575c0 msgr2=0x564959253730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:05.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f198679c700 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5649592575c0 0x564959253730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f198679c700 1 -- 172.21.15.115:0/679141985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56495919dee0 con 0x56495929e300 2023-07-27T14:39:05.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f1985f9b700 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5649592575c0 0x564959253730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:05.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f198679c700 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927bef0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f1978001260 tx=0x7f197801d000).ready entity=mon.0 client_cookie=ea387bbc9ba8fc60 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f196b7fe700 1 -- 172.21.15.115:0/679141985 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978007880 con 0x56495929e300 2023-07-27T14:39:05.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f196b7fe700 1 -- 172.21.15.115:0/679141985 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978007a90 con 0x56495929e300 2023-07-27T14:39:05.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f196b7fe700 1 -- 172.21.15.115:0/679141985 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978007320 con 0x56495929e300 2023-07-27T14:39:05.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f199f428b80 1 -- 172.21.15.115:0/679141985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 msgr2=0x56495927bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.290+0000 7f199f428b80 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927bef0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f1978001260 tx=0x7f197801d000).stop 2023-07-27T14:39:05.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.291+0000 7f199f428b80 1 -- 172.21.15.115:0/679141985 shutdown_connections 2023-07-27T14:39:05.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.291+0000 7f199f428b80 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56495929e300 0x56495927bef0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.291+0000 7f199f428b80 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5649592575c0 0x564959253730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.291+0000 7f199f428b80 1 --2- 172.21.15.115:0/679141985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x564959259f60 0x56495927ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.291+0000 7f199f428b80 1 -- 172.21.15.115:0/679141985 >> 172.21.15.115:0/679141985 conn(0x5649590c2940 msgr2=0x5649592546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:05.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.291+0000 7f199f428b80 1 -- 172.21.15.115:0/679141985 shutdown_connections 2023-07-27T14:39:05.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.291+0000 7f199f428b80 1 -- 172.21.15.115:0/679141985 wait complete. 2023-07-27T14:39:05.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.291+0000 7f199f428b80 1 -- start start 2023-07-27T14:39:05.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.292+0000 7f199f428b80 1 Processor -- start 2023-07-27T14:39:05.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f199f428b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649592575c0 0x56495927bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f199f428b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 0x564959300d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f199f428b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56495929e300 0x564959257c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f199f428b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x56495927de00 con 0x5649592575c0 2023-07-27T14:39:05.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f199f428b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x56495927c250 con 0x564959259f60 2023-07-27T14:39:05.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f199f428b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x564959258520 con 0x56495929e300 2023-07-27T14:39:05.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f199f428b80 10 client.0 ll_register_callbacks cb 0x56495915c4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:39:05.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649592575c0 0x56495927bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649592575c0 0x56495927bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57918/0 (socket says 172.21.15.115:57918) 2023-07-27T14:39:05.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 -- 172.21.15.115:0/2416527836 learned_addr learned my addr 172.21.15.115:0/2416527836 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:05.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f198679c700 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56495929e300 0x564959257c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f198579a700 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 0x564959300d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 -- 172.21.15.115:0/2416527836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56495929e300 msgr2=0x564959257c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:05.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56495929e300 0x564959257c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 -- 172.21.15.115:0/2416527836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 msgr2=0x564959300d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:05.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 0x564959300d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 -- 172.21.15.115:0/2416527836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56495919e190 con 0x5649592575c0 2023-07-27T14:39:05.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f1985f9b700 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649592575c0 0x56495927bd60 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x564959285760 tx=0x7f197c019040).ready entity=mon.0 client_cookie=6d823eef4ddc784e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.293+0000 7f195ffff700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:39:05.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f195ffff700 1 -- 172.21.15.115:0/2416527836 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c003040 con 0x5649592575c0 2023-07-27T14:39:05.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 1 -- 172.21.15.115:0/2416527836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1978005d10 con 0x5649592575c0 2023-07-27T14:39:05.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f195ffff700 1 -- 172.21.15.115:0/2416527836 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f197c017ba0 con 0x5649592575c0 2023-07-27T14:39:05.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f195ffff700 1 -- 172.21.15.115:0/2416527836 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f197c026450 con 0x5649592575c0 2023-07-27T14:39:05.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 10 client.9954 fetch_fsmap learned FSMap version 102 2023-07-27T14:39:05.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 1 -- 172.21.15.115:0/2416527836 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x5649590181d0 con 0x5649592575c0 2023-07-27T14:39:05.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f195ffff700 1 -- 172.21.15.115:0/2416527836 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978005d10 con 0x5649592575c0 2023-07-27T14:39:05.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f195ffff700 1 -- 172.21.15.115:0/2416527836 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 102) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f197c02f400 con 0x5649592575c0 2023-07-27T14:39:05.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 10 client.9954 fetch_fsmap finished waiting for FSMap version 102 2023-07-27T14:39:05.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 10 client.9954 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-27T14:39:05.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 20 client.9954 populate_metadata read hostname 'smithi115' 2023-07-27T14:39:05.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] conn(0x5649592546a0 0x564959254a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 4 client.9954 mds_command: new command op to 9780 tid=0[{"prefix": "status"}] 2023-07-27T14:39:05.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.294+0000 7f199f428b80 1 -- 172.21.15.115:0/2416527836 --> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564959048040 con 0x5649592546a0 2023-07-27T14:39:05.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f198579a700 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] conn(0x5649592546a0 0x564959254a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f198579a700 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] conn(0x5649592546a0 0x564959254a80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=163ad9d50a7b4f06 server_cookie=5d3e7409e9721c6 in_seq=0 out_seq=0 2023-07-27T14:39:05.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f195ffff700 10 client.9954 ms_handle_connect on v2:172.21.15.115:6834/2564907842 2023-07-27T14:39:05.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f195ffff700 1 -- 172.21.15.115:0/2416527836 <== mds.0 v2:172.21.15.115:6834/2564907842 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x564959048040 con 0x5649592546a0 2023-07-27T14:39:05.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f195ffff700 10 client.9954 handle_command_reply: tid=0 2023-07-27T14:39:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 client.9954 shutdown 2023-07-27T14:39:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 -- 172.21.15.115:0/2416527836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649592575c0 msgr2=0x56495927bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649592575c0 0x56495927bd60 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x564959285760 tx=0x7f197c019040).stop 2023-07-27T14:39:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 -- 172.21.15.115:0/2416527836 shutdown_connections 2023-07-27T14:39:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x56495929e300 0x564959257c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5649592575c0 0x56495927bd60 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.115:6834/2564907842,v1:172.21.15.115:6836/2564907842] conn(0x5649592546a0 0x564959254a80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 --2- 172.21.15.115:0/2416527836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564959259f60 0x564959300d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f199f428b80 1 -- 172.21.15.115:0/2416527836 >> 172.21.15.115:0/2416527836 conn(0x5649590c2940 msgr2=0x5649592ab290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:05.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.295+0000 7f195ffff700 0 client.9954 ms_handle_reset on v2:172.21.15.115:6834/2564907842 2023-07-27T14:39:05.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f199f428b80 1 -- 172.21.15.115:0/2416527836 shutdown_connections 2023-07-27T14:39:05.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f199f428b80 1 -- 172.21.15.115:0/2416527836 wait complete. 2023-07-27T14:39:05.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f199f428b80 20 client.9954 trim_cache size 0 max 16384 2023-07-27T14:39:05.358 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:05.358 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:39:05.358 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:39:05.358 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 9780, 2023-07-27T14:39:05.358 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:39:05.358 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:39:05.358 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:39:05.359 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 11.128841906, 2023-07-27T14:39:05.359 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 102, 2023-07-27T14:39:05.359 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 188, 2023-07-27T14:39:05.359 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 188, 2023-07-27T14:39:05.359 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 17.137777215 2023-07-27T14:39:05.359 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:05.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 -- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f196405fb20 msgr2=0x7f1964061fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f196405fb20 0x7f1964061fe0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f197c003900 tx=0x7f197c007d40).stop 2023-07-27T14:39:05.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 -- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1980153ec0 msgr2=0x7f19800c2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1980153ec0 0x7f19800c2730 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7f198005fc60 tx=0x7f1970017000).stop 2023-07-27T14:39:05.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 -- 172.21.15.115:0/2370539933 shutdown_connections 2023-07-27T14:39:05.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f196405fb20 0x7f1964061fe0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19801542a0 0x7f19800c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f19800aaa40 0x7f198014f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 --2- 172.21.15.115:0/2370539933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1980153ec0 0x7f19800c2730 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 -- 172.21.15.115:0/2370539933 >> 172.21.15.115:0/2370539933 conn(0x7f19800cb610 msgr2=0x7f1980156990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:05.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.296+0000 7f19881ff700 1 -- 172.21.15.115:0/2370539933 shutdown_connections 2023-07-27T14:39:05.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.297+0000 7f19881ff700 1 -- 172.21.15.115:0/2370539933 wait complete. 2023-07-27T14:39:05.366 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:39:05.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.470+0000 7f245adff700 1 Processor -- start 2023-07-27T14:39:05.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.470+0000 7f245adff700 1 -- start start 2023-07-27T14:39:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f245adff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2454155580 0x7f245415f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f245adff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2454158e00 con 0x7f2454154190 2023-07-27T14:39:05.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f245adff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2454158040 con 0x7f24540c64b0 2023-07-27T14:39:05.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f245adff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24540aa640 con 0x7f2454155580 2023-07-27T14:39:05.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f2458b9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2454154190 0x7f24540a9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54440/0 (socket says 172.21.15.115:54440) 2023-07-27T14:39:05.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f2458b9b700 1 -- 172.21.15.115:0/952370201 learned_addr learned my addr 172.21.15.115:0/952370201 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:05.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f245939c700 1 --2- 172.21.15.115:0/952370201 >> v2:172.21.15.159:3300/0 conn(0x7f2454155580 0x7f245415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f24537fe700 1 -- 172.21.15.115:0/952370201 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031206872 0 0) 0x7f2454158e00 con 0x7f2454154190 2023-07-27T14:39:05.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f24537fe700 1 -- 172.21.15.115:0/952370201 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24440033f0 con 0x7f2454154190 2023-07-27T14:39:05.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f24537fe700 1 -- 172.21.15.115:0/952370201 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067678315 0 0) 0x7f2454158040 con 0x7f24540c64b0 2023-07-27T14:39:05.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f24537fe700 1 -- 172.21.15.115:0/952370201 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2454158e00 con 0x7f24540c64b0 2023-07-27T14:39:05.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.472+0000 7f24537fe700 1 -- 172.21.15.115:0/952370201 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2053355221 0 0) 0x7f24440033f0 con 0x7f2454154190 2023-07-27T14:39:05.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f245939c700 1 -- 172.21.15.115:0/952370201 >> v1:172.21.15.159:6789/0 conn(0x7f24540c64b0 legacy=0x7f24540641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f245939c700 1 -- 172.21.15.115:0/952370201 >> v1:172.21.15.115:6789/0 conn(0x7f2454154190 legacy=0x7f24540a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f245939c700 1 -- 172.21.15.115:0/952370201 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454158320 con 0x7f2454155580 2023-07-27T14:39:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f245939c700 1 --2- 172.21.15.115:0/952370201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454155580 0x7f245415f240 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f244c009e60 tx=0x7f244c009780).ready entity=mon.1 client_cookie=a51edee486fe121d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f24537fe700 1 -- 172.21.15.115:0/952370201 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00e070 con 0x7f2454155580 2023-07-27T14:39:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f24537fe700 1 -- 172.21.15.115:0/952370201 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00b7a0 con 0x7f2454155580 2023-07-27T14:39:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f24537fe700 1 -- 172.21.15.115:0/952370201 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448001470 con 0x7f2454155580 2023-07-27T14:39:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f245adff700 1 -- 172.21.15.115:0/952370201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454155580 msgr2=0x7f245415f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.473+0000 7f245adff700 1 --2- 172.21.15.115:0/952370201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454155580 0x7f245415f240 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f244c009e60 tx=0x7f244c009780).stop 2023-07-27T14:39:05.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.474+0000 7f245adff700 1 -- 172.21.15.115:0/952370201 shutdown_connections 2023-07-27T14:39:05.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.474+0000 7f245adff700 1 --2- 172.21.15.115:0/952370201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2454155580 0x7f245415f240 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.474+0000 7f245adff700 1 -- 172.21.15.115:0/952370201 >> 172.21.15.115:0/952370201 conn(0x7f24540cb730 msgr2=0x7f24540c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:05.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.474+0000 7f245adff700 1 -- 172.21.15.115:0/952370201 shutdown_connections 2023-07-27T14:39:05.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.474+0000 7f245adff700 1 -- 172.21.15.115:0/952370201 wait complete. 2023-07-27T14:39:05.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.475+0000 7f245adff700 1 Processor -- start 2023-07-27T14:39:05.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.475+0000 7f245adff700 1 -- start start 2023-07-27T14:39:05.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.476+0000 7f245adff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24540c64b0 0x7f245414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.476+0000 7f245adff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2454154190 0x7f24540c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.476+0000 7f245adff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24541510a0 0x7f24541681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.476+0000 7f245adff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2454150c10 con 0x7f24540c64b0 2023-07-27T14:39:05.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.476+0000 7f245adff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2454150000 con 0x7f24541510a0 2023-07-27T14:39:05.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.476+0000 7f245adff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24541502e0 con 0x7f2454154190 2023-07-27T14:39:05.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.476+0000 7f2458b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24540c64b0 0x7f245414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.476+0000 7f2458b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24540c64b0 0x7f245414fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57920/0 (socket says 172.21.15.115:57920) 2023-07-27T14:39:05.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2458b9b700 1 -- 172.21.15.115:0/2666044521 learned_addr learned my addr 172.21.15.115:0/2666044521 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:05.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f245939c700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24541510a0 0x7f24541681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2453fff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2454154190 0x7f24540c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2458b9b700 1 -- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2454154190 msgr2=0x7f24540c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2458b9b700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2454154190 0x7f24540c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2458b9b700 1 -- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24541510a0 msgr2=0x7f24541681f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2458b9b700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24541510a0 0x7f24541681f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2458b9b700 1 -- 172.21.15.115:0/2666044521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c009a20 con 0x7f24540c64b0 2023-07-27T14:39:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2453fff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2454154190 0x7f24540c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2458b9b700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24540c64b0 0x7f245414fa40 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f244800c800 tx=0x7f2448001a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2450ff9700 1 -- 172.21.15.115:0/2666044521 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448007170 con 0x7f24540c64b0 2023-07-27T14:39:05.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2450ff9700 1 -- 172.21.15.115:0/2666044521 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480072d0 con 0x7f24540c64b0 2023-07-27T14:39:05.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24541505c0 con 0x7f24540c64b0 2023-07-27T14:39:05.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.477+0000 7f2450ff9700 1 -- 172.21.15.115:0/2666044521 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480048c0 con 0x7f24540c64b0 2023-07-27T14:39:05.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.478+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24540c31d0 con 0x7f24540c64b0 2023-07-27T14:39:05.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.478+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245405f0c0 con 0x7f24540c64b0 2023-07-27T14:39:05.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.479+0000 7f2450ff9700 1 -- 172.21.15.115:0/2666044521 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f2448004c70 con 0x7f24540c64b0 2023-07-27T14:39:05.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.480+0000 7f2450ff9700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f243805fb50 0x7f2438062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:05.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.480+0000 7f2450ff9700 1 -- 172.21.15.115:0/2666044521 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f244807ac20 con 0x7f24540c64b0 2023-07-27T14:39:05.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.481+0000 7f2453fff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f243805fb50 0x7f2438062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:05.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.481+0000 7f2453fff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f243805fb50 0x7f2438062010 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f2440007fd0 tx=0x7f2440009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:05.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.484+0000 7f2450ff9700 1 -- 172.21.15.115:0/2666044521 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f244804b4b0 con 0x7f24540c64b0 2023-07-27T14:39:05.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.696+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f24540c0e70 con 0x7f24540c64b0 2023-07-27T14:39:05.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.696+0000 7f2450ff9700 1 -- 172.21.15.115:0/2666044521 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) v1 ==== 53+0+73 (secure 0 0 0) 0x7f244804ead0 con 0x7f24540c64b0 2023-07-27T14:39:05.750 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:39:05.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.698+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f243805fb50 msgr2=0x7f2438062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.698+0000 7f245adff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f243805fb50 0x7f2438062010 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f2440007fd0 tx=0x7f2440009040).stop 2023-07-27T14:39:05.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.698+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24540c64b0 msgr2=0x7f245414fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:05.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.698+0000 7f245adff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24540c64b0 0x7f245414fa40 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f244800c800 tx=0x7f2448001a20).stop 2023-07-27T14:39:05.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.698+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 shutdown_connections 2023-07-27T14:39:05.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.699+0000 7f245adff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f243805fb50 0x7f2438062010 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.699+0000 7f245adff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24541510a0 0x7f24541681f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.699+0000 7f245adff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24540c64b0 0x7f245414fa40 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.699+0000 7f245adff700 1 --2- 172.21.15.115:0/2666044521 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2454154190 0x7f24540c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:05.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.699+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 >> 172.21.15.115:0/2666044521 conn(0x7f24540cb730 msgr2=0x7f245414ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:05.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.699+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 shutdown_connections 2023-07-27T14:39:05.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:05.699+0000 7f245adff700 1 -- 172.21.15.115:0/2666044521 wait complete. 2023-07-27T14:39:05.767 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:39:05.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:39:05.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:39:05.768 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:39:05.768 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:39:05.769 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:39:05.769 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:39:05.769 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:39:05.769 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:39:05.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:05.770 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:39:05.817 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:39:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:39:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:39:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:39:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:05.818 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:39:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:39:05.818 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:39:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:39:05.818 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:39:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:05.819 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:39:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:39:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41256sec preferred_lft 41256sec 2023-07-27T14:39:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:39:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:05.819 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:39:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:39:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:39:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:05.820 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:39:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:39:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:39:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:05.821 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:39:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:39:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:39:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:05.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:05.823 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:39:05.890 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:39:05.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:05.894 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:39:05.944 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:39:05.944 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:39:05.944 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:39:05.944 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:39:05.945 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:39:05.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:05.945 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:39:05.946 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:39:05.946 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:39:05.946 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:39:05.947 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:39:05.947 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:39:06.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:06.116 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:39:06.164 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:39:06.164 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:39:06.164 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:39:06.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:06.166 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:39:06.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:06.274 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:39:06.320 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:39:06.325 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:39:06.457 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:39:06.457 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:39:06.484 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:39:06.484 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:39:06.489 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:39:06.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:06.490 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:39:06.560 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:39:06.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.676+0000 7f8645bff700 1 Processor -- start 2023-07-27T14:39:06.731 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.677+0000 7f8645bff700 1 -- start start 2023-07-27T14:39:06.732 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f8645bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8640154190 0x7f86400a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:06.733 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f8645bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400648e0 0x7f8640154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:06.733 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f8645bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8640158e00 con 0x7f86400c64b0 2023-07-27T14:39:06.733 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f8645bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86400aa640 con 0x7f8640154190 2023-07-27T14:39:06.733 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f8645bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8640158040 con 0x7f86400648e0 2023-07-27T14:39:06.733 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f863ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400648e0 0x7f8640154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:06.733 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f863effd700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f86400c64b0 0x7f86400641d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:39076/0 (socket says 172.21.15.159:39076) 2023-07-27T14:39:06.733 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f863effd700 1 -- 172.21.15.159:0/562071068 learned_addr learned my addr 172.21.15.159:0/562071068 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:39:06.734 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.678+0000 7f863f7fe700 1 --2- 172.21.15.159:0/562071068 >> v2:172.21.15.115:3300/0 conn(0x7f8640154190 0x7f86400a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:06.735 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863ffff700 1 -- 172.21.15.159:0/562071068 >> v2:172.21.15.115:3300/0 conn(0x7f8640154190 msgr2=0x7f86400a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:06.735 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863ffff700 1 --2- 172.21.15.159:0/562071068 >> v2:172.21.15.115:3300/0 conn(0x7f8640154190 0x7f86400a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.736 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863e7fc700 1 -- 172.21.15.159:0/562071068 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366049050 0 0) 0x7f8640158e00 con 0x7f86400c64b0 2023-07-27T14:39:06.736 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863ffff700 1 -- 172.21.15.159:0/562071068 >> v1:172.21.15.159:6789/0 conn(0x7f86400c64b0 legacy=0x7f86400641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:06.736 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863ffff700 1 -- 172.21.15.159:0/562071068 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8640158320 con 0x7f86400648e0 2023-07-27T14:39:06.737 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863ffff700 1 --2- 172.21.15.159:0/562071068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400648e0 0x7f8640154570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8638009e60 tx=0x7f8638009780).ready entity=mon.2 client_cookie=e4f1407021b9ad59 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:06.737 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863e7fc700 1 -- 172.21.15.159:0/562071068 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863800e070 con 0x7f86400648e0 2023-07-27T14:39:06.737 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863e7fc700 1 -- 172.21.15.159:0/562071068 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863800bb60 con 0x7f86400648e0 2023-07-27T14:39:06.737 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.679+0000 7f863e7fc700 1 -- 172.21.15.159:0/562071068 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638012410 con 0x7f86400648e0 2023-07-27T14:39:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.680+0000 7f8645bff700 1 -- 172.21.15.159:0/562071068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400648e0 msgr2=0x7f8640154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.680+0000 7f8645bff700 1 --2- 172.21.15.159:0/562071068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400648e0 0x7f8640154570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8638009e60 tx=0x7f8638009780).stop 2023-07-27T14:39:06.738 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.680+0000 7f8645bff700 1 -- 172.21.15.159:0/562071068 shutdown_connections 2023-07-27T14:39:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.680+0000 7f8645bff700 1 --2- 172.21.15.159:0/562071068 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400648e0 0x7f8640154570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.680+0000 7f8645bff700 1 --2- 172.21.15.159:0/562071068 >> v2:172.21.15.115:3300/0 conn(0x7f8640154190 0x7f86400a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.680+0000 7f8645bff700 1 -- 172.21.15.159:0/562071068 >> 172.21.15.159:0/562071068 conn(0x7f86400cb730 msgr2=0x7f86400c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:06.739 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.680+0000 7f8645bff700 1 -- 172.21.15.159:0/562071068 shutdown_connections 2023-07-27T14:39:06.740 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.680+0000 7f8645bff700 1 -- 172.21.15.159:0/562071068 wait complete. 2023-07-27T14:39:06.742 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.681+0000 7f8645bff700 1 Processor -- start 2023-07-27T14:39:06.742 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.682+0000 7f8645bff700 1 -- start start 2023-07-27T14:39:06.742 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.682+0000 7f8645bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86400648e0 0x7f8640150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:06.742 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.682+0000 7f8645bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400c64b0 0x7f8640151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:06.743 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.682+0000 7f8645bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8640154190 0x7f86400abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:06.743 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f8645bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86400b0940 con 0x7f8640154190 2023-07-27T14:39:06.743 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f8645bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640167900 con 0x7f86400648e0 2023-07-27T14:39:06.743 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f8645bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8640167be0 con 0x7f86400c64b0 2023-07-27T14:39:06.743 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86400648e0 0x7f8640150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:06.743 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863effd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400c64b0 0x7f8640151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:06.743 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86400648e0 0x7f8640150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57140/0 (socket says 172.21.15.159:57140) 2023-07-27T14:39:06.743 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 -- 172.21.15.159:0/996070188 learned_addr learned my addr 172.21.15.159:0/996070188 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:39:06.744 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863ffff700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8640154190 0x7f86400abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:06.744 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 -- 172.21.15.159:0/996070188 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400c64b0 msgr2=0x7f8640151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:06.744 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400c64b0 0x7f8640151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.744 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 -- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8640154190 msgr2=0x7f86400abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:06.744 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8640154190 0x7f86400abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.744 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 -- 172.21.15.159:0/996070188 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8638009a20 con 0x7f86400648e0 2023-07-27T14:39:06.745 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863ffff700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8640154190 0x7f86400abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:06.745 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.683+0000 7f863f7fe700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86400648e0 0x7f8640150ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f863000e900 tx=0x7f8630009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:06.745 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.684+0000 7f86277fe700 1 -- 172.21.15.159:0/996070188 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630012600 con 0x7f86400648e0 2023-07-27T14:39:06.745 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.684+0000 7f86277fe700 1 -- 172.21.15.159:0/996070188 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8630012760 con 0x7f86400648e0 2023-07-27T14:39:06.745 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.684+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8640167ec0 con 0x7f86400648e0 2023-07-27T14:39:06.745 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.684+0000 7f86277fe700 1 -- 172.21.15.159:0/996070188 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630012ae0 con 0x7f86400648e0 2023-07-27T14:39:06.746 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.684+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8640168480 con 0x7f86400648e0 2023-07-27T14:39:06.746 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.685+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86401652e0 con 0x7f86400648e0 2023-07-27T14:39:06.746 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.685+0000 7f86277fe700 1 -- 172.21.15.159:0/996070188 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f8630022070 con 0x7f86400648e0 2023-07-27T14:39:06.746 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.686+0000 7f86277fe700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f862c05fb50 0x7f862c062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:06.746 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.686+0000 7f86277fe700 1 -- 172.21.15.159:0/996070188 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f863007b3c0 con 0x7f86400648e0 2023-07-27T14:39:06.746 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.687+0000 7f863effd700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f862c05fb50 0x7f862c062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:06.746 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.687+0000 7f863effd700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f862c05fb50 0x7f862c062010 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f86400a9ec0 tx=0x7f8634007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:06.747 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.691+0000 7f86277fe700 1 -- 172.21.15.159:0/996070188 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f863004ba90 con 0x7f86400648e0 2023-07-27T14:39:06.960 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.906+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f864005f0c0 con 0x7f86400648e0 2023-07-27T14:39:06.961 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.907+0000 7f86277fe700 1 -- 172.21.15.159:0/996070188 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) v1 ==== 53+0+73 (secure 0 0 0) 0x7f863004f0b0 con 0x7f86400648e0 2023-07-27T14:39:06.961 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:39:06.963 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f862c05fb50 msgr2=0x7f862c062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:06.963 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f862c05fb50 0x7f862c062010 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f86400a9ec0 tx=0x7f8634007bb0).stop 2023-07-27T14:39:06.963 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86400648e0 msgr2=0x7f8640150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:06.963 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86400648e0 0x7f8640150ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f863000e900 tx=0x7f8630009060).stop 2023-07-27T14:39:06.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 shutdown_connections 2023-07-27T14:39:06.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f862c05fb50 0x7f862c062010 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8640154190 0x7f86400abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86400648e0 0x7f8640150ed0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 --2- 172.21.15.159:0/996070188 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86400c64b0 0x7f8640151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:06.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 >> 172.21.15.159:0/996070188 conn(0x7f86400cb730 msgr2=0x7f86400c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:06.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 shutdown_connections 2023-07-27T14:39:06.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:39:06.909+0000 7f8645bff700 1 -- 172.21.15.159:0/996070188 wait complete. 2023-07-27T14:39:06.977 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:39:06.978 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:39:06.978 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:39:06.978 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:39:06.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:39:06.979 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:39:06.979 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:39:06.979 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:39:06.980 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:39:06.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:06.981 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:39:07.030 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:39:07.030 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:39:07.030 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:39:07.031 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:07.031 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:39:07.031 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:07.031 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:39:07.031 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:07.031 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:39:07.031 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:39:07.032 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:07.032 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:39:07.032 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:39:07.032 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:07.032 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:39:07.032 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:07.032 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:39:07.032 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41250sec preferred_lft 41250sec 2023-07-27T14:39:07.033 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:39:07.033 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:07.033 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:39:07.033 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:39:07.033 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:39:07.033 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:07.033 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:39:07.034 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:07.034 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:39:07.034 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:39:07.034 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:39:07.034 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:07.034 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:39:07.034 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:39:07.034 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:39:07.035 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:39:07.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:07.035 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:39:07.103 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:39:07.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:07.106 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:39:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:39:07.155 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:39:07.156 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:39:07.156 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:39:07.156 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:39:07.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:07.158 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:39:07.159 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:39:07.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:39:07.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:39:07.161 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:39:07.161 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:39:07.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:07.331 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:39:07.378 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:39:07.378 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:39:07.379 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:39:07.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:07.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:39:07.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:07.491 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:39:07.539 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:39:07.539 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:39:07.677 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:39:07.677 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:39:07.704 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:39:07.704 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:39:07.709 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:39:07.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:07.710 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:39:07.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:39:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.931+0000 7f25d07ff700 1 Processor -- start 2023-07-27T14:39:07.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.931+0000 7f25d07ff700 1 -- start start 2023-07-27T14:39:07.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.932+0000 7f25d07ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f25c8063260 0x7f25c8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25d07ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25c814b1e0 0x7f25c80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25d07ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c81553f0 con 0x7f25c814ae00 2023-07-27T14:39:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25d07ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c8157a50 con 0x7f25c814b1e0 2023-07-27T14:39:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25d07ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c8157d10 con 0x7f25c8063260 2023-07-27T14:39:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25ce59b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f25c814ae00 0x7f25c8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54454/0 (socket says 172.21.15.115:54454) 2023-07-27T14:39:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25ce59b700 1 -- 172.21.15.115:0/184634226 learned_addr learned my addr 172.21.15.115:0/184634226 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25ced9c700 1 --2- 172.21.15.115:0/184634226 >> v2:172.21.15.115:3300/0 conn(0x7f25c814b1e0 0x7f25c80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:07.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25cdd9a700 1 --2- 172.21.15.115:0/184634226 >> v2:172.21.15.159:3300/0 conn(0x7f25c8063260 0x7f25c8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25cd599700 1 -- 172.21.15.115:0/184634226 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463351575 0 0) 0x7f25c81553f0 con 0x7f25c814ae00 2023-07-27T14:39:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25cd599700 1 -- 172.21.15.115:0/184634226 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b40033f0 con 0x7f25c814ae00 2023-07-27T14:39:07.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25ced9c700 1 -- 172.21.15.115:0/184634226 >> v2:172.21.15.159:3300/0 conn(0x7f25c8063260 msgr2=0x7f25c8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:07.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25ced9c700 1 --2- 172.21.15.115:0/184634226 >> v2:172.21.15.159:3300/0 conn(0x7f25c8063260 0x7f25c8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:07.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25ced9c700 1 -- 172.21.15.115:0/184634226 >> v1:172.21.15.115:6789/0 conn(0x7f25c814ae00 legacy=0x7f25c8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:07.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25ced9c700 1 -- 172.21.15.115:0/184634226 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8157ff0 con 0x7f25c814b1e0 2023-07-27T14:39:07.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.933+0000 7f25cdd9a700 1 --2- 172.21.15.115:0/184634226 >> v2:172.21.15.159:3300/0 conn(0x7f25c8063260 0x7f25c8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:07.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25ced9c700 1 --2- 172.21.15.115:0/184634226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814b1e0 0x7f25c80a98c0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7f25c80cbc00 tx=0x7f25c0009780).ready entity=mon.0 client_cookie=9abbb8444990bb90 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:07.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25cd599700 1 -- 172.21.15.115:0/184634226 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000e070 con 0x7f25c814b1e0 2023-07-27T14:39:07.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25cd599700 1 -- 172.21.15.115:0/184634226 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000bab0 con 0x7f25c814b1e0 2023-07-27T14:39:07.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25cd599700 1 -- 172.21.15.115:0/184634226 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000be30 con 0x7f25c814b1e0 2023-07-27T14:39:07.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25d07ff700 1 -- 172.21.15.115:0/184634226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814b1e0 msgr2=0x7f25c80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:07.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25d07ff700 1 --2- 172.21.15.115:0/184634226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814b1e0 0x7f25c80a98c0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7f25c80cbc00 tx=0x7f25c0009780).stop 2023-07-27T14:39:07.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25d07ff700 1 -- 172.21.15.115:0/184634226 shutdown_connections 2023-07-27T14:39:07.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25d07ff700 1 --2- 172.21.15.115:0/184634226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814b1e0 0x7f25c80a98c0 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:07.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25d07ff700 1 --2- 172.21.15.115:0/184634226 >> v2:172.21.15.159:3300/0 conn(0x7f25c8063260 0x7f25c8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:07.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.934+0000 7f25d07ff700 1 -- 172.21.15.115:0/184634226 >> 172.21.15.115:0/184634226 conn(0x7f25c805e940 msgr2=0x7f25c80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:07.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.935+0000 7f25d07ff700 1 -- 172.21.15.115:0/184634226 shutdown_connections 2023-07-27T14:39:07.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.935+0000 7f25d07ff700 1 -- 172.21.15.115:0/184634226 wait complete. 2023-07-27T14:39:07.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.936+0000 7f25d07ff700 1 Processor -- start 2023-07-27T14:39:07.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.937+0000 7f25d07ff700 1 -- start start 2023-07-27T14:39:07.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25d07ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25c8063260 0x7f25c80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:07.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25d07ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814ae00 0x7f25c80ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:07.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25d07ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c814b1e0 0x7f25c80ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:07.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25d07ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80aece0 con 0x7f25c814ae00 2023-07-27T14:39:07.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25d07ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80c1c50 con 0x7f25c814b1e0 2023-07-27T14:39:07.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25d07ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80abc80 con 0x7f25c8063260 2023-07-27T14:39:07.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25cdd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814ae00 0x7f25c80ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:07.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25cdd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814ae00 0x7f25c80ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57938/0 (socket says 172.21.15.115:57938) 2023-07-27T14:39:07.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25cdd9a700 1 -- 172.21.15.115:0/4262726857 learned_addr learned my addr 172.21.15.115:0/4262726857 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:07.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25ce59b700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25c8063260 0x7f25c80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:07.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25ced9c700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c814b1e0 0x7f25c80ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25cdd9a700 1 -- 172.21.15.115:0/4262726857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25c8063260 msgr2=0x7f25c80adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25cdd9a700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25c8063260 0x7f25c80adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25cdd9a700 1 -- 172.21.15.115:0/4262726857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c814b1e0 msgr2=0x7f25c80ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25cdd9a700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c814b1e0 0x7f25c80ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.938+0000 7f25cdd9a700 1 -- 172.21.15.115:0/4262726857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80092a0 con 0x7f25c814ae00 2023-07-27T14:39:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.939+0000 7f25cdd9a700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814ae00 0x7f25c80ab2a0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7f25b800ea50 tx=0x7f25b8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:07.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.939+0000 7f25be7fc700 1 -- 172.21.15.115:0/4262726857 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800c850 con 0x7f25c814ae00 2023-07-27T14:39:07.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.939+0000 7f25be7fc700 1 -- 172.21.15.115:0/4262726857 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b800c9b0 con 0x7f25c814ae00 2023-07-27T14:39:07.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.939+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c0009a20 con 0x7f25c814ae00 2023-07-27T14:39:07.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.939+0000 7f25be7fc700 1 -- 172.21.15.115:0/4262726857 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800cd30 con 0x7f25c814ae00 2023-07-27T14:39:07.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.939+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c814ce20 con 0x7f25c814ae00 2023-07-27T14:39:07.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.940+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c806c470 con 0x7f25c814ae00 2023-07-27T14:39:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.941+0000 7f25be7fc700 1 -- 172.21.15.115:0/4262726857 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f25b8012600 con 0x7f25c814ae00 2023-07-27T14:39:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.941+0000 7f25be7fc700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f25ac05fb50 0x7f25ac062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.942+0000 7f25be7fc700 1 -- 172.21.15.115:0/4262726857 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f25b807b290 con 0x7f25c814ae00 2023-07-27T14:39:07.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.942+0000 7f25ce59b700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f25ac05fb50 0x7f25ac062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:07.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.942+0000 7f25ce59b700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f25ac05fb50 0x7f25ac062010 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f25c4005750 tx=0x7f25c4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:07.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:07.946+0000 7f25be7fc700 1 -- 172.21.15.115:0/4262726857 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f25b804b960 con 0x7f25c814ae00 2023-07-27T14:39:08.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.160+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f25c80acf70 con 0x7f25c814ae00 2023-07-27T14:39:08.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.722+0000 7f25be7fc700 1 -- 172.21.15.115:0/4262726857 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v103) v1 ==== 136+0+0 (secure 0 0 0) 0x7f25b804ef80 con 0x7f25c814ae00 2023-07-27T14:39:08.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f25ac05fb50 msgr2=0x7f25ac062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f25ac05fb50 0x7f25ac062010 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f25c4005750 tx=0x7f25c4009040).stop 2023-07-27T14:39:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814ae00 msgr2=0x7f25c80ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814ae00 0x7f25c80ab2a0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7f25b800ea50 tx=0x7f25b8009060).stop 2023-07-27T14:39:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 shutdown_connections 2023-07-27T14:39:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f25ac05fb50 0x7f25ac062010 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:08.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c814b1e0 0x7f25c80ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:08.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25c8063260 0x7f25c80adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:08.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 --2- 172.21.15.115:0/4262726857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c814ae00 0x7f25c80ab2a0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:08.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 >> 172.21.15.115:0/4262726857 conn(0x7f25c805e940 msgr2=0x7f25c80648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:08.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 shutdown_connections 2023-07-27T14:39:08.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.725+0000 7f25d07ff700 1 -- 172.21.15.115:0/4262726857 wait complete. 2023-07-27T14:39:08.798 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:39:08.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.936+0000 7f9c8fbff700 1 Processor -- start 2023-07-27T14:39:08.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.937+0000 7f9c8fbff700 1 -- start start 2023-07-27T14:39:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.938+0000 7f9c8fbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9c880c0e80 0x7f9c880c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.938+0000 7f9c8fbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c880c1800 con 0x7f9c88152a40 2023-07-27T14:39:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.938+0000 7f9c8fbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c88158f70 con 0x7f9c88152e20 2023-07-27T14:39:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.938+0000 7f9c8fbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c88159250 con 0x7f9c880c0e80 2023-07-27T14:39:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.938+0000 7f9c8d99b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9c88152a40 0x7f9c880bb7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54470/0 (socket says 172.21.15.115:54470) 2023-07-27T14:39:08.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.938+0000 7f9c8d99b700 1 -- 172.21.15.115:0/1028946948 learned_addr learned my addr 172.21.15.115:0/1028946948 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:08.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.938+0000 7f9c8e19c700 1 --2- 172.21.15.115:0/1028946948 >> v2:172.21.15.115:3300/0 conn(0x7f9c880c0e80 0x7f9c880c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:08.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.938+0000 7f9c8c999700 1 -- 172.21.15.115:0/1028946948 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79695482 0 0) 0x7f9c880c1800 con 0x7f9c88152a40 2023-07-27T14:39:08.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8c999700 1 -- 172.21.15.115:0/1028946948 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c740033f0 con 0x7f9c88152a40 2023-07-27T14:39:08.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8e19c700 1 -- 172.21.15.115:0/1028946948 >> v1:172.21.15.159:6789/0 conn(0x7f9c88152e20 legacy=0x7f9c880a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:08.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8e19c700 1 -- 172.21.15.115:0/1028946948 >> v1:172.21.15.115:6789/0 conn(0x7f9c88152a40 legacy=0x7f9c880bb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8e19c700 1 -- 172.21.15.115:0/1028946948 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88159530 con 0x7f9c880c0e80 2023-07-27T14:39:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8e19c700 1 --2- 172.21.15.115:0/1028946948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c880c0e80 0x7f9c880c1310 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f9c80009e60 tx=0x7f9c80009780).ready entity=mon.0 client_cookie=1e1bcd18ee00ca4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8c999700 1 -- 172.21.15.115:0/1028946948 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000e070 con 0x7f9c880c0e80 2023-07-27T14:39:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8c999700 1 -- 172.21.15.115:0/1028946948 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8000bb60 con 0x7f9c880c0e80 2023-07-27T14:39:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8c999700 1 -- 172.21.15.115:0/1028946948 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80012410 con 0x7f9c880c0e80 2023-07-27T14:39:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8fbff700 1 -- 172.21.15.115:0/1028946948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c880c0e80 msgr2=0x7f9c880c1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:08.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.939+0000 7f9c8fbff700 1 --2- 172.21.15.115:0/1028946948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c880c0e80 0x7f9c880c1310 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f9c80009e60 tx=0x7f9c80009780).stop 2023-07-27T14:39:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.940+0000 7f9c8fbff700 1 -- 172.21.15.115:0/1028946948 shutdown_connections 2023-07-27T14:39:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.940+0000 7f9c8fbff700 1 --2- 172.21.15.115:0/1028946948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c880c0e80 0x7f9c880c1310 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.940+0000 7f9c8fbff700 1 -- 172.21.15.115:0/1028946948 >> 172.21.15.115:0/1028946948 conn(0x7f9c88062320 msgr2=0x7f9c88062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.940+0000 7f9c8fbff700 1 -- 172.21.15.115:0/1028946948 shutdown_connections 2023-07-27T14:39:08.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.940+0000 7f9c8fbff700 1 -- 172.21.15.115:0/1028946948 wait complete. 2023-07-27T14:39:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.941+0000 7f9c8fbff700 1 Processor -- start 2023-07-27T14:39:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.941+0000 7f9c8fbff700 1 -- start start 2023-07-27T14:39:08.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8fbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c880c0e80 0x7f9c880ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8fbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c88152a40 0x7f9c88151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8fbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c88152e20 0x7f9c880692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8fbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880c02c0 con 0x7f9c88152e20 2023-07-27T14:39:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8fbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88168670 con 0x7f9c880c0e80 2023-07-27T14:39:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8fbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88169480 con 0x7f9c88152a40 2023-07-27T14:39:08.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8e19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c88152e20 0x7f9c880692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8e19c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c88152e20 0x7f9c880692c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57950/0 (socket says 172.21.15.115:57950) 2023-07-27T14:39:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8e19c700 1 -- 172.21.15.115:0/3407329828 learned_addr learned my addr 172.21.15.115:0/3407329828 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.942+0000 7f9c8d99b700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c880c0e80 0x7f9c880ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8d19a700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c88152a40 0x7f9c88151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8e19c700 1 -- 172.21.15.115:0/3407329828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c88152a40 msgr2=0x7f9c88151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8e19c700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c88152a40 0x7f9c88151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8e19c700 1 -- 172.21.15.115:0/3407329828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c880c0e80 msgr2=0x7f9c880ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8e19c700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c880c0e80 0x7f9c880ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8e19c700 1 -- 172.21.15.115:0/3407329828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009a20 con 0x7f9c88152e20 2023-07-27T14:39:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8e19c700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c88152e20 0x7f9c880692c0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f9c8805ed00 tx=0x7f9c80009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c7dffb700 1 -- 172.21.15.115:0/3407329828 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80012410 con 0x7f9c88152e20 2023-07-27T14:39:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c7dffb700 1 -- 172.21.15.115:0/3407329828 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8001d630 con 0x7f9c88152e20 2023-07-27T14:39:09.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c7dffb700 1 -- 172.21.15.115:0/3407329828 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8001d9f0 con 0x7f9c88152e20 2023-07-27T14:39:09.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c88168870 con 0x7f9c88152e20 2023-07-27T14:39:09.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.943+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c88168e30 con 0x7f9c88152e20 2023-07-27T14:39:09.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.945+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8806c470 con 0x7f9c88152e20 2023-07-27T14:39:09.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.945+0000 7f9c7dffb700 1 -- 172.21.15.115:0/3407329828 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f9c8001dd60 con 0x7f9c88152e20 2023-07-27T14:39:09.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.946+0000 7f9c7dffb700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6c05fb50 0x7f9c6c062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.946+0000 7f9c7dffb700 1 -- 172.21.15.115:0/3407329828 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9c8007cff0 con 0x7f9c88152e20 2023-07-27T14:39:09.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.946+0000 7f9c8d99b700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6c05fb50 0x7f9c6c062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.947+0000 7f9c8d99b700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6c05fb50 0x7f9c6c062010 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f9c84007fd0 tx=0x7f9c84009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:09.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:08.950+0000 7f9c7dffb700 1 -- 172.21.15.115:0/3407329828 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c800ab8f0 con 0x7f9c88152e20 2023-07-27T14:39:09.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.146+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c880c1770 con 0x7f9c6c05fb50 2023-07-27T14:39:09.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.147+0000 7f9c7dffb700 1 -- 172.21.15.115:0/3407329828 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9c880c1770 con 0x7f9c6c05fb50 2023-07-27T14:39:09.201 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:39:09.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:09.201 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:39:09.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:09.201 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:39:09.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6c05fb50 msgr2=0x7f9c6c062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6c05fb50 0x7f9c6c062010 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f9c84007fd0 tx=0x7f9c84009040).stop 2023-07-27T14:39:09.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c88152e20 msgr2=0x7f9c880692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c88152e20 0x7f9c880692c0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f9c8805ed00 tx=0x7f9c80009780).stop 2023-07-27T14:39:09.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 shutdown_connections 2023-07-27T14:39:09.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6c05fb50 0x7f9c6c062010 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c88152e20 0x7f9c880692c0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c880c0e80 0x7f9c880ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 --2- 172.21.15.115:0/3407329828 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c88152a40 0x7f9c88151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 >> 172.21.15.115:0/3407329828 conn(0x7f9c88062320 msgr2=0x7f9c880a8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:09.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 shutdown_connections 2023-07-27T14:39:09.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.149+0000 7f9c8fbff700 1 -- 172.21.15.115:0/3407329828 wait complete. 2023-07-27T14:39:09.220 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:39:09.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.356+0000 7f98325ff700 1 Processor -- start 2023-07-27T14:39:09.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.357+0000 7f98325ff700 1 -- start start 2023-07-27T14:39:09.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.358+0000 7f98325ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f982c13a730 0x7f982c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.358+0000 7f98325ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c0bd9a0 con 0x7f982c0c36b0 2023-07-27T14:39:09.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.358+0000 7f98325ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c066610 con 0x7f982c13a350 2023-07-27T14:39:09.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.358+0000 7f98325ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c066400 con 0x7f982c13a730 2023-07-27T14:39:09.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.358+0000 7f9830b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f982c0c36b0 0x7f982c0be410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54484/0 (socket says 172.21.15.115:54484) 2023-07-27T14:39:09.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.358+0000 7f9830b9c700 1 -- 172.21.15.115:0/1419222149 learned_addr learned my addr 172.21.15.115:0/1419222149 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:09.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982b7fe700 1 --2- 172.21.15.115:0/1419222149 >> v2:172.21.15.159:3300/0 conn(0x7f982c13a730 0x7f982c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982affd700 1 -- 172.21.15.115:0/1419222149 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489337890 0 0) 0x7f982c0bd9a0 con 0x7f982c0c36b0 2023-07-27T14:39:09.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982affd700 1 -- 172.21.15.115:0/1419222149 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98140033f0 con 0x7f982c0c36b0 2023-07-27T14:39:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982affd700 1 -- 172.21.15.115:0/1419222149 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971661062 0 0) 0x7f982c066610 con 0x7f982c13a350 2023-07-27T14:39:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982affd700 1 -- 172.21.15.115:0/1419222149 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f982c0bd9a0 con 0x7f982c13a350 2023-07-27T14:39:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982b7fe700 1 -- 172.21.15.115:0/1419222149 >> v1:172.21.15.159:6789/0 conn(0x7f982c13a350 legacy=0x7f982c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982b7fe700 1 -- 172.21.15.115:0/1419222149 >> v1:172.21.15.115:6789/0 conn(0x7f982c0c36b0 legacy=0x7f982c0be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982b7fe700 1 -- 172.21.15.115:0/1419222149 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0bdc10 con 0x7f982c13a730 2023-07-27T14:39:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982b7fe700 1 --2- 172.21.15.115:0/1419222149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c13a730 0x7f982c065f10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f9820009760 tx=0x7f9820009060).ready entity=mon.1 client_cookie=72cdfd4c182ad9f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.359+0000 7f982affd700 1 -- 172.21.15.115:0/1419222149 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000d4a0 con 0x7f982c13a730 2023-07-27T14:39:09.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f982affd700 1 -- 172.21.15.115:0/1419222149 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000d600 con 0x7f982c13a730 2023-07-27T14:39:09.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f982affd700 1 -- 172.21.15.115:0/1419222149 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000d980 con 0x7f982c13a730 2023-07-27T14:39:09.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f98325ff700 1 -- 172.21.15.115:0/1419222149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c13a730 msgr2=0x7f982c065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f98325ff700 1 --2- 172.21.15.115:0/1419222149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c13a730 0x7f982c065f10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f9820009760 tx=0x7f9820009060).stop 2023-07-27T14:39:09.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f98325ff700 1 -- 172.21.15.115:0/1419222149 shutdown_connections 2023-07-27T14:39:09.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f98325ff700 1 --2- 172.21.15.115:0/1419222149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c13a730 0x7f982c065f10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f98325ff700 1 -- 172.21.15.115:0/1419222149 >> 172.21.15.115:0/1419222149 conn(0x7f982c05e8f0 msgr2=0x7f982c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:09.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f98325ff700 1 -- 172.21.15.115:0/1419222149 shutdown_connections 2023-07-27T14:39:09.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.360+0000 7f98325ff700 1 -- 172.21.15.115:0/1419222149 wait complete. 2023-07-27T14:39:09.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.362+0000 7f98325ff700 1 Processor -- start 2023-07-27T14:39:09.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.362+0000 7f98325ff700 1 -- start start 2023-07-27T14:39:09.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f98325ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c0c36b0 0x7f982c0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f98325ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f982c13a350 0x7f982c163e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f98325ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c13a730 0x7f982c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f98325ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0c6df0 con 0x7f982c13a730 2023-07-27T14:39:09.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f98325ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0c70d0 con 0x7f982c0c36b0 2023-07-27T14:39:09.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f98325ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0c73b0 con 0x7f982c13a350 2023-07-27T14:39:09.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c13a730 0x7f982c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c13a730 0x7f982c1556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57966/0 (socket says 172.21.15.115:57966) 2023-07-27T14:39:09.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 -- 172.21.15.115:0/823443680 learned_addr learned my addr 172.21.15.115:0/823443680 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:09.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f982b7fe700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f982c13a350 0x7f982c163e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f982bfff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c0c36b0 0x7f982c0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 -- 172.21.15.115:0/823443680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f982c13a350 msgr2=0x7f982c163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f982c13a350 0x7f982c163e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 -- 172.21.15.115:0/823443680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c0c36b0 msgr2=0x7f982c0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c0c36b0 0x7f982c0c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 -- 172.21.15.115:0/823443680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200092a0 con 0x7f982c13a730 2023-07-27T14:39:09.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.363+0000 7f9830b9c700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c13a730 0x7f982c1556d0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f982400c790 tx=0x7f9824007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:09.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.364+0000 7f9813fff700 1 -- 172.21.15.115:0/823443680 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824005d30 con 0x7f982c13a730 2023-07-27T14:39:09.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.364+0000 7f9813fff700 1 -- 172.21.15.115:0/823443680 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824005e90 con 0x7f982c13a730 2023-07-27T14:39:09.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.364+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c0c7690 con 0x7f982c13a730 2023-07-27T14:39:09.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.364+0000 7f9813fff700 1 -- 172.21.15.115:0/823443680 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824007320 con 0x7f982c13a730 2023-07-27T14:39:09.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.364+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c0c8380 con 0x7f982c13a730 2023-07-27T14:39:09.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.365+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c0c7bb0 con 0x7f982c13a730 2023-07-27T14:39:09.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.366+0000 7f9813fff700 1 -- 172.21.15.115:0/823443680 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f9824010030 con 0x7f982c13a730 2023-07-27T14:39:09.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.366+0000 7f9813fff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f981805fb50 0x7f9818062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.366+0000 7f9813fff700 1 -- 172.21.15.115:0/823443680 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f982407b0b0 con 0x7f982c13a730 2023-07-27T14:39:09.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.367+0000 7f982bfff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f981805fb50 0x7f9818062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.367+0000 7f982bfff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f981805fb50 0x7f9818062010 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f981c003700 tx=0x7f981c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:09.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.370+0000 7f9813fff700 1 -- 172.21.15.115:0/823443680 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f982c0c7bb0 con 0x7f982c13a730 2023-07-27T14:39:09.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.537+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f982c0c7bb0 con 0x7f982c13a730 2023-07-27T14:39:09.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.538+0000 7f9813fff700 1 -- 172.21.15.115:0/823443680 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f982c0c7bb0 con 0x7f982c13a730 2023-07-27T14:39:09.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.539+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f981805fb50 msgr2=0x7f9818062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.539+0000 7f98325ff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f981805fb50 0x7f9818062010 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f981c003700 tx=0x7f981c009040).stop 2023-07-27T14:39:09.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.539+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c13a730 msgr2=0x7f982c1556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.539+0000 7f98325ff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c13a730 0x7f982c1556d0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f982400c790 tx=0x7f9824007f70).stop 2023-07-27T14:39:09.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.540+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 shutdown_connections 2023-07-27T14:39:09.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.540+0000 7f98325ff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f981805fb50 0x7f9818062010 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.540+0000 7f98325ff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982c13a730 0x7f982c1556d0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.540+0000 7f98325ff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f982c0c36b0 0x7f982c0c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.540+0000 7f98325ff700 1 --2- 172.21.15.115:0/823443680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f982c13a350 0x7f982c163e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.540+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 >> 172.21.15.115:0/823443680 conn(0x7f982c05e8f0 msgr2=0x7f982c0ac760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:09.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.540+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 shutdown_connections 2023-07-27T14:39:09.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.540+0000 7f98325ff700 1 -- 172.21.15.115:0/823443680 wait complete. 2023-07-27T14:39:09.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000883025 --namespace-isolated --size 12582912 --mode=777 2023-07-27T14:39:09.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.756+0000 7fa3157ff700 1 Processor -- start 2023-07-27T14:39:09.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.756+0000 7fa3157ff700 1 -- start start 2023-07-27T14:39:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.757+0000 7fa3157ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa310153e20 0x7fa310154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.757+0000 7fa3157ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310158310 0x7fa3100bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.757+0000 7fa3157ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa310063ef0 con 0x7fa310158820 2023-07-27T14:39:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.757+0000 7fa3157ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3100641d0 con 0x7fa310153e20 2023-07-27T14:39:09.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.757+0000 7fa3157ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100644b0 con 0x7fa310158310 2023-07-27T14:39:09.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30e7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa310158820 0x7fa310157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54500/0 (socket says 172.21.15.115:54500) 2023-07-27T14:39:09.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30e7fc700 1 -- 172.21.15.115:0/1850439197 learned_addr learned my addr 172.21.15.115:0/1850439197 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:09.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30effd700 1 --2- 172.21.15.115:0/1850439197 >> v2:172.21.15.159:3300/0 conn(0x7fa310153e20 0x7fa310154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30f7fe700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310158310 0x7fa3100bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789202739 0 0) 0x7fa310063ef0 con 0x7fa310158820 2023-07-27T14:39:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f80033f0 con 0x7fa310158820 2023-07-27T14:39:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4031330822 0 0) 0x7fa2f80033f0 con 0x7fa310158820 2023-07-27T14:39:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310158310 msgr2=0x7fa3100bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310158310 0x7fa3100bdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 >> v2:172.21.15.159:3300/0 conn(0x7fa310153e20 msgr2=0x7fa310154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 --2- 172.21.15.115:0/1850439197 >> v2:172.21.15.159:3300/0 conn(0x7fa310153e20 0x7fa310154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310064790 con 0x7fa310158820 2023-07-27T14:39:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.758+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fa304001470 con 0x7fa310158820 2023-07-27T14:39:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 >> v1:172.21.15.115:6789/0 conn(0x7fa310158820 legacy=0x7fa310157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30dffb700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f80038e0 0x7fa2f8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30dffb700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f8004690 0x7fa2f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30dffb700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa2f800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100641d0 con 0x7fa2f8005000 2023-07-27T14:39:09.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100644b0 con 0x7fa2f8004690 2023-07-27T14:39:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f800bdd0 con 0x7fa2f80038e0 2023-07-27T14:39:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30effd700 1 --2- 172.21.15.115:0/1850439197 >> v2:172.21.15.159:3300/0 conn(0x7fa310153e20 0x7fa310154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30f7fe700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310158310 0x7fa3100bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30f7fe700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa2f800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30e7fc700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f8004690 0x7fa2f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30effd700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f80038e0 0x7fa2f8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30f7fe700 1 -- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f80038e0 msgr2=0x7fa2f8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:09.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30f7fe700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa2f80038e0 0x7fa2f8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30f7fe700 1 -- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f8004690 msgr2=0x7fa2f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:09.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30f7fe700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2f8004690 0x7fa2f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30f7fe700 1 -- 172.21.15.115:0/1850439197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f80033f0 con 0x7fa2f8005000 2023-07-27T14:39:09.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.759+0000 7fa30f7fe700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa2f800b8e0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fa30800e280 tx=0x7fa30800b040).ready entity=mon.0 client_cookie=d0932a2c19221b27 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:09.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800ead0 con 0x7fa2f8005000 2023-07-27T14:39:09.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30800f040 con 0x7fa2f8005000 2023-07-27T14:39:09.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa30dffb700 1 -- 172.21.15.115:0/1850439197 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800ee60 con 0x7fa2f8005000 2023-07-27T14:39:09.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa3157ff700 1 -- 172.21.15.115:0/1850439197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 msgr2=0x7fa2f800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa3157ff700 1 --2- 172.21.15.115:0/1850439197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa2f800b8e0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fa30800e280 tx=0x7fa30800b040).stop 2023-07-27T14:39:09.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa30f7fe700 1 -- 172.21.15.115:0/1850439197 reap_dead start 2023-07-27T14:39:09.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa3157ff700 1 -- 172.21.15.115:0/1850439197 shutdown_connections 2023-07-27T14:39:09.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa3157ff700 1 -- 172.21.15.115:0/1850439197 >> 172.21.15.115:0/1850439197 conn(0x7fa3100920a0 msgr2=0x7fa31005e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:09.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa3157ff700 1 -- 172.21.15.115:0/1850439197 shutdown_connections 2023-07-27T14:39:09.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.760+0000 7fa3157ff700 1 -- 172.21.15.115:0/1850439197 wait complete. 2023-07-27T14:39:09.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.762+0000 7fa3157ff700 1 Processor -- start 2023-07-27T14:39:09.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.762+0000 7fa3157ff700 1 -- start start 2023-07-27T14:39:09.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa3157ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa3100a8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa3157ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100c8d70 0x7fa3100ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa3157ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310067220 0x7fa3100676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa3157ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100c91f0 con 0x7fa2f8005000 2023-07-27T14:39:09.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa3157ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31014d1e0 con 0x7fa3100c8d70 2023-07-27T14:39:09.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa3157ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100a94c0 con 0x7fa310067220 2023-07-27T14:39:09.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa3100a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa3100a8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57972/0 (socket says 172.21.15.115:57972) 2023-07-27T14:39:09.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30effd700 1 -- 172.21.15.115:0/826110326 learned_addr learned my addr 172.21.15.115:0/826110326 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:09.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30e7fc700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100c8d70 0x7fa3100ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30f7fe700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310067220 0x7fa3100676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30effd700 1 -- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310067220 msgr2=0x7fa3100676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30effd700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310067220 0x7fa3100676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30effd700 1 -- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100c8d70 msgr2=0x7fa3100ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:09.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30effd700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100c8d70 0x7fa3100ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:09.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.763+0000 7fa30effd700 1 -- 172.21.15.115:0/826110326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310067b90 con 0x7fa2f8005000 2023-07-27T14:39:09.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.764+0000 7fa30f7fe700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310067220 0x7fa3100676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:09.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.764+0000 7fa30effd700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa3100a8220 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7fa300011b40 tx=0x7fa300009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:09.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.764+0000 7fa2f6ffd700 1 -- 172.21.15.115:0/826110326 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000fa70 con 0x7fa2f8005000 2023-07-27T14:39:09.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.764+0000 7fa2f6ffd700 1 -- 172.21.15.115:0/826110326 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000fbd0 con 0x7fa2f8005000 2023-07-27T14:39:09.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.764+0000 7fa2f6ffd700 1 -- 172.21.15.115:0/826110326 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300014440 con 0x7fa2f8005000 2023-07-27T14:39:09.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.764+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3100a8800 con 0x7fa2f8005000 2023-07-27T14:39:09.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.764+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3100a8dc0 con 0x7fa2f8005000 2023-07-27T14:39:09.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.765+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31006c470 con 0x7fa2f8005000 2023-07-27T14:39:09.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.766+0000 7fa2f6ffd700 1 -- 172.21.15.115:0/826110326 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fa300024070 con 0x7fa2f8005000 2023-07-27T14:39:09.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.767+0000 7fa2f6ffd700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2fc05fb50 0x7fa2fc062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:09.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.767+0000 7fa2f6ffd700 1 -- 172.21.15.115:0/826110326 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa30007be00 con 0x7fa2f8005000 2023-07-27T14:39:09.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.767+0000 7fa30e7fc700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2fc05fb50 0x7fa2fc062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:09.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.767+0000 7fa30e7fc700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2fc05fb50 0x7fa2fc062010 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fa304000e10 tx=0x7fa304009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:09.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.771+0000 7fa2f6ffd700 1 -- 172.21.15.115:0/826110326 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa30004c4d0 con 0x7fa2f8005000 2023-07-27T14:39:10.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:09.970+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "namespace_isolated": true, "size": 12582912, "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3100a9600 con 0x7fa2fc05fb50 2023-07-27T14:39:10.030 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:09.976+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:10.030 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:09.976+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:10.030 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:09.976+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:10.031 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:09.976+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:10.031 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:09.976+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:10.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.011+0000 7fa2f6ffd700 1 -- 172.21.15.115:0/826110326 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa3040048a0 con 0x7fa2fc05fb50 2023-07-27T14:39:10.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2fc05fb50 msgr2=0x7fa2fc062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:10.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2fc05fb50 0x7fa2fc062010 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fa304000e10 tx=0x7fa304009040).stop 2023-07-27T14:39:10.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 msgr2=0x7fa3100a8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:10.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa3100a8220 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7fa300011b40 tx=0x7fa300009060).stop 2023-07-27T14:39:10.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 shutdown_connections 2023-07-27T14:39:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa2fc05fb50 0x7fa2fc062010 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa310067220 0x7fa3100676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2f8005000 0x7fa3100a8220 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 --2- 172.21.15.115:0/826110326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3100c8d70 0x7fa3100ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.013+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 >> 172.21.15.115:0/826110326 conn(0x7fa3100920a0 msgr2=0x7fa31014d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.014+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 shutdown_connections 2023-07-27T14:39:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.014+0000 7fa3157ff700 1 -- 172.21.15.115:0/826110326 wait complete. 2023-07-27T14:39:10.085 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000883025 2023-07-27T14:39:10.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.226+0000 7effe95ff700 1 Processor -- start 2023-07-27T14:39:10.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.226+0000 7effe95ff700 1 -- start start 2023-07-27T14:39:10.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.227+0000 7effe95ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effe41553f0 0x7effe4062b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:10.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.227+0000 7effe95ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe4154f60 con 0x7effe40cb210 2023-07-27T14:39:10.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.227+0000 7effe95ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe40cb780 con 0x7effe4151d20 2023-07-27T14:39:10.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.227+0000 7effe95ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe40cba60 con 0x7effe41553f0 2023-07-27T14:39:10.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.227+0000 7effe27fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effe41553f0 0x7effe4062b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:10.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.227+0000 7effe27fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effe41553f0 0x7effe4062b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57998/0 (socket says 172.21.15.115:57998) 2023-07-27T14:39:10.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.227+0000 7effe27fc700 1 -- 172.21.15.115:0/3620496070 learned_addr learned my addr 172.21.15.115:0/3620496070 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:10.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.228+0000 7effe27fc700 1 -- 172.21.15.115:0/3620496070 >> v1:172.21.15.159:6789/0 conn(0x7effe4151d20 legacy=0x7effe40c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:10.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.228+0000 7effe27fc700 1 -- 172.21.15.115:0/3620496070 >> v1:172.21.15.115:6789/0 conn(0x7effe40cb210 legacy=0x7effe415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:10.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.228+0000 7effe27fc700 1 -- 172.21.15.115:0/3620496070 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4154910 con 0x7effe41553f0 2023-07-27T14:39:10.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.228+0000 7effe1ffb700 1 -- 172.21.15.115:0/3620496070 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859038937 0 0) 0x7effe4154f60 con 0x7effe40cb210 2023-07-27T14:39:10.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.228+0000 7effe27fc700 1 --2- 172.21.15.115:0/3620496070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe41553f0 0x7effe4062b10 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7effd8006fd0 tx=0x7effd80090f0).ready entity=mon.0 client_cookie=4782622063e84ed8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:10.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.228+0000 7effe1ffb700 1 -- 172.21.15.115:0/3620496070 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800b600 con 0x7effe41553f0 2023-07-27T14:39:10.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.228+0000 7effe1ffb700 1 -- 172.21.15.115:0/3620496070 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd800b760 con 0x7effe41553f0 2023-07-27T14:39:10.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.228+0000 7effe1ffb700 1 -- 172.21.15.115:0/3620496070 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800bae0 con 0x7effe41553f0 2023-07-27T14:39:10.284 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.229+0000 7effe95ff700 1 -- 172.21.15.115:0/3620496070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe41553f0 msgr2=0x7effe4062b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.229+0000 7effe95ff700 1 --2- 172.21.15.115:0/3620496070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe41553f0 0x7effe4062b10 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7effd8006fd0 tx=0x7effd80090f0).stop 2023-07-27T14:39:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.229+0000 7effe95ff700 1 -- 172.21.15.115:0/3620496070 shutdown_connections 2023-07-27T14:39:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.229+0000 7effe95ff700 1 --2- 172.21.15.115:0/3620496070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe41553f0 0x7effe4062b10 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.229+0000 7effe95ff700 1 -- 172.21.15.115:0/3620496070 >> 172.21.15.115:0/3620496070 conn(0x7effe405e940 msgr2=0x7effe40cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.229+0000 7effe95ff700 1 -- 172.21.15.115:0/3620496070 shutdown_connections 2023-07-27T14:39:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.229+0000 7effe95ff700 1 -- 172.21.15.115:0/3620496070 wait complete. 2023-07-27T14:39:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.230+0000 7effe95ff700 1 Processor -- start 2023-07-27T14:39:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.230+0000 7effe95ff700 1 -- start start 2023-07-27T14:39:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.231+0000 7effe95ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe40cb210 0x7effe40c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.231+0000 7effe95ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe4151d20 0x7effe414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.231+0000 7effe95ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe41553f0 0x7effe41590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.231+0000 7effe95ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe40c9650 con 0x7effe40cb210 2023-07-27T14:39:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.231+0000 7effe95ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe40c9dc0 con 0x7effe4151d20 2023-07-27T14:39:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.231+0000 7effe95ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe414e810 con 0x7effe41553f0 2023-07-27T14:39:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe40cb210 0x7effe40c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe40cb210 0x7effe40c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58002/0 (socket says 172.21.15.115:58002) 2023-07-27T14:39:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 -- 172.21.15.115:0/3126264357 learned_addr learned my addr 172.21.15.115:0/3126264357 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe27fc700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe4151d20 0x7effe414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe37fe700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe41553f0 0x7effe41590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 -- 172.21.15.115:0/3126264357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe41553f0 msgr2=0x7effe41590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe41553f0 0x7effe41590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 -- 172.21.15.115:0/3126264357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe4151d20 msgr2=0x7effe414b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe4151d20 0x7effe414b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 -- 172.21.15.115:0/3126264357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8009370 con 0x7effe40cb210 2023-07-27T14:39:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effe2ffd700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe40cb210 0x7effe40c9160 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7effd400c4c0 tx=0x7effd4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.232+0000 7effcaffd700 1 -- 172.21.15.115:0/3126264357 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4007020 con 0x7effe40cb210 2023-07-27T14:39:10.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.233+0000 7effcaffd700 1 -- 172.21.15.115:0/3126264357 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4001e90 con 0x7effe40cb210 2023-07-27T14:39:10.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.233+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe40ca010 con 0x7effe40cb210 2023-07-27T14:39:10.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.233+0000 7effcaffd700 1 -- 172.21.15.115:0/3126264357 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40073b0 con 0x7effe40cb210 2023-07-27T14:39:10.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.233+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe414e1c0 con 0x7effe40cb210 2023-07-27T14:39:10.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.234+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe4060610 con 0x7effe40cb210 2023-07-27T14:39:10.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.235+0000 7effcaffd700 1 -- 172.21.15.115:0/3126264357 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7effd4010070 con 0x7effe40cb210 2023-07-27T14:39:10.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.235+0000 7effcaffd700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effd005fb50 0x7effd0062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:10.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.235+0000 7effcaffd700 1 -- 172.21.15.115:0/3126264357 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7effd407a840 con 0x7effe40cb210 2023-07-27T14:39:10.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.236+0000 7effe27fc700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effd005fb50 0x7effd0062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:10.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.236+0000 7effe27fc700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effd005fb50 0x7effd0062010 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7effe4155850 tx=0x7effd8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:10.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.239+0000 7effcaffd700 1 -- 172.21.15.115:0/3126264357 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7effd404b020 con 0x7effe40cb210 2023-07-27T14:39:10.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.438+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "target": ["mon-mgr", ""]}) v1 -- 0x7effe40a9f20 con 0x7effd005fb50 2023-07-27T14:39:10.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.443+0000 7effcaffd700 1 -- 172.21.15.115:0/3126264357 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7effe40a9f20 con 0x7effd005fb50 2023-07-27T14:39:10.497 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3 2023-07-27T14:39:10.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effd005fb50 msgr2=0x7effd0062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:10.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effd005fb50 0x7effd0062010 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7effe4155850 tx=0x7effd8017000).stop 2023-07-27T14:39:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe40cb210 msgr2=0x7effe40c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe40cb210 0x7effe40c9160 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7effd400c4c0 tx=0x7effd4007e00).stop 2023-07-27T14:39:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 shutdown_connections 2023-07-27T14:39:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7effd005fb50 0x7effd0062010 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7effe41553f0 0x7effe41590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effe40cb210 0x7effe40c9160 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 --2- 172.21.15.115:0/3126264357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effe4151d20 0x7effe414b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.445+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 >> 172.21.15.115:0/3126264357 conn(0x7effe405e940 msgr2=0x7effe4155880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.446+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 shutdown_connections 2023-07-27T14:39:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:10.446+0000 7effe95ff700 1 -- 172.21.15.115:0/3126264357 wait complete. 2023-07-27T14:39:10.517 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000883025 with 8 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3 2023-07-27T14:39:10.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:10.518 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:39:10.591 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:39:10.592 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:39:10.592 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177687 s, 59.0 MB/s 2023-07-27T14:39:10.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:10.593 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:39:10.655 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:39:10.656 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:39:10.656 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145151 s, 72.2 MB/s 2023-07-27T14:39:10.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:10.657 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:39:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:39:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:39:10.719 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160726 s, 65.2 MB/s 2023-07-27T14:39:10.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:10.721 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:39:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:39:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:39:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180466 s, 58.1 MB/s 2023-07-27T14:39:10.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:10.787 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:39:10.851 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:39:10.851 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:39:10.851 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01758 s, 59.6 MB/s 2023-07-27T14:39:10.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:10.852 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:39:10.914 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:39:10.914 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:39:10.914 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144923 s, 72.4 MB/s 2023-07-27T14:39:10.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:10.915 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:39:10.979 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:39:10.979 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:39:10.979 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175142 s, 59.9 MB/s 2023-07-27T14:39:10.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:10.981 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:39:11.044 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:39:11.045 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:39:11.045 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173559 s, 60.4 MB/s 2023-07-27T14:39:11.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000883025 snapshot_0000000001037341 2023-07-27T14:39:11.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.184+0000 7f262c3ff700 1 Processor -- start 2023-07-27T14:39:11.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.184+0000 7f262c3ff700 1 -- start start 2023-07-27T14:39:11.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.185+0000 7f262c3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f262413a350 0x7f2624065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.185+0000 7f262c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262413a730 0x7f26241585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.185+0000 7f262c3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f26240c2fa0 0x7f26240c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.185+0000 7f262c3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2624066400 con 0x7f262413a350 2023-07-27T14:39:11.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.185+0000 7f262c3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2624158ae0 con 0x7f26240c2fa0 2023-07-27T14:39:11.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.185+0000 7f262c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26240bd9a0 con 0x7f262413a730 2023-07-27T14:39:11.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f262413a350 0x7f2624065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f262413a350 0x7f2624065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58004/0 (socket says 172.21.15.115:58004) 2023-07-27T14:39:11.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 -- 172.21.15.115:0/487302762 learned_addr learned my addr 172.21.15.115:0/487302762 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:11.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262999a700 1 --2- 172.21.15.115:0/487302762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262413a730 0x7f26241585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 -- 172.21.15.115:0/487302762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262413a730 msgr2=0x7f26241585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:11.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a99c700 1 --2- 172.21.15.115:0/487302762 >> v2:172.21.15.159:3300/0 conn(0x7f26240c2fa0 0x7f26240c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 --2- 172.21.15.115:0/487302762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262413a730 0x7f26241585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 -- 172.21.15.115:0/487302762 >> v2:172.21.15.159:3300/0 conn(0x7f26240c2fa0 msgr2=0x7f26240c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:11.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 --2- 172.21.15.115:0/487302762 >> v2:172.21.15.159:3300/0 conn(0x7f26240c2fa0 0x7f26240c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 -- 172.21.15.115:0/487302762 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240c3910 con 0x7f262413a350 2023-07-27T14:39:11.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262999a700 1 --2- 172.21.15.115:0/487302762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262413a730 0x7f26241585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:11.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a99c700 1 --2- 172.21.15.115:0/487302762 >> v2:172.21.15.159:3300/0 conn(0x7f26240c2fa0 0x7f26240c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:11.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f262a19b700 1 --2- 172.21.15.115:0/487302762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a350 0x7f2624065f10 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f26240c5410 tx=0x7f26200090f0).ready entity=mon.0 client_cookie=cace642b3cee55f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:11.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.186+0000 7f2629199700 1 -- 172.21.15.115:0/487302762 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000b600 con 0x7f262413a350 2023-07-27T14:39:11.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f2629199700 1 -- 172.21.15.115:0/487302762 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000b760 con 0x7f262413a350 2023-07-27T14:39:11.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f2629199700 1 -- 172.21.15.115:0/487302762 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000bae0 con 0x7f262413a350 2023-07-27T14:39:11.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 -- 172.21.15.115:0/487302762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a350 msgr2=0x7f2624065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 --2- 172.21.15.115:0/487302762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a350 0x7f2624065f10 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f26240c5410 tx=0x7f26200090f0).stop 2023-07-27T14:39:11.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 -- 172.21.15.115:0/487302762 shutdown_connections 2023-07-27T14:39:11.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 --2- 172.21.15.115:0/487302762 >> v2:172.21.15.159:3300/0 conn(0x7f26240c2fa0 0x7f26240c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 --2- 172.21.15.115:0/487302762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a350 0x7f2624065f10 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 --2- 172.21.15.115:0/487302762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f262413a730 0x7f26241585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 -- 172.21.15.115:0/487302762 >> 172.21.15.115:0/487302762 conn(0x7f262405e8f0 msgr2=0x7f26240c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:11.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 -- 172.21.15.115:0/487302762 shutdown_connections 2023-07-27T14:39:11.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.187+0000 7f262c3ff700 1 -- 172.21.15.115:0/487302762 wait complete. 2023-07-27T14:39:11.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.189+0000 7f262c3ff700 1 Processor -- start 2023-07-27T14:39:11.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.189+0000 7f262c3ff700 1 -- start start 2023-07-27T14:39:11.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26240c2fa0 0x7f26240c0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262c3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262413a350 0x7f26240c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262c3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a730 0x7f26240c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262c3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240a8990 con 0x7f262413a730 2023-07-27T14:39:11.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262c3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240c1460 con 0x7f262413a350 2023-07-27T14:39:11.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26240c1180 con 0x7f26240c2fa0 2023-07-27T14:39:11.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a730 0x7f26240c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a730 0x7f26240c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58018/0 (socket says 172.21.15.115:58018) 2023-07-27T14:39:11.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a99c700 1 -- 172.21.15.115:0/209285969 learned_addr learned my addr 172.21.15.115:0/209285969 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:11.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262999a700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262413a350 0x7f26240c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a19b700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26240c2fa0 0x7f26240c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a99c700 1 -- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26240c2fa0 msgr2=0x7f26240c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a99c700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26240c2fa0 0x7f26240c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a99c700 1 -- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262413a350 msgr2=0x7f26240c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a99c700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262413a350 0x7f26240c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a99c700 1 -- 172.21.15.115:0/209285969 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620009370 con 0x7f262413a730 2023-07-27T14:39:11.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262999a700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262413a350 0x7f26240c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:11.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.190+0000 7f262a19b700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26240c2fa0 0x7f26240c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:11.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.191+0000 7f262a99c700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a730 0x7f26240c6510 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f261c00a380 tx=0x7f261c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:11.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.191+0000 7f261a7fc700 1 -- 172.21.15.115:0/209285969 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00ae10 con 0x7f262413a730 2023-07-27T14:39:11.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.191+0000 7f261a7fc700 1 -- 172.21.15.115:0/209285969 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c00d650 con 0x7f262413a730 2023-07-27T14:39:11.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.191+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26240a8340 con 0x7f262413a730 2023-07-27T14:39:11.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.191+0000 7f261a7fc700 1 -- 172.21.15.115:0/209285969 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00d9d0 con 0x7f262413a730 2023-07-27T14:39:11.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.191+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26240c0df0 con 0x7f262413a730 2023-07-27T14:39:11.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.192+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26240a8b40 con 0x7f262413a730 2023-07-27T14:39:11.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.193+0000 7f261a7fc700 1 -- 172.21.15.115:0/209285969 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7f261c0203f0 con 0x7f262413a730 2023-07-27T14:39:11.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.193+0000 7f261a7fc700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f260805fb50 0x7f2608062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.194+0000 7f261a7fc700 1 -- 172.21.15.115:0/209285969 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f261c07bff0 con 0x7f262413a730 2023-07-27T14:39:11.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.194+0000 7f262a19b700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f260805fb50 0x7f2608062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.194+0000 7f262a19b700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f260805fb50 0x7f2608062010 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f262000b3c0 tx=0x7f2620017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:11.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.197+0000 7f261a7fc700 1 -- 172.21.15.115:0/209285969 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f26240a8b40 con 0x7f262413a730 2023-07-27T14:39:11.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.402+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "snap_name": "snapshot_0000000001037341", "target": ["mon-mgr", ""]}) v1 -- 0x7f26240a8ad0 con 0x7f260805fb50 2023-07-27T14:39:11.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.419+0000 7f261a7fc700 1 -- 172.21.15.115:0/209285969 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f26240a8ad0 con 0x7f260805fb50 2023-07-27T14:39:11.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f260805fb50 msgr2=0x7f2608062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f260805fb50 0x7f2608062010 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f262000b3c0 tx=0x7f2620017000).stop 2023-07-27T14:39:11.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a730 msgr2=0x7f26240c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a730 0x7f26240c6510 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f261c00a380 tx=0x7f261c007900).stop 2023-07-27T14:39:11.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 shutdown_connections 2023-07-27T14:39:11.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f260805fb50 0x7f2608062010 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f262413a730 0x7f26240c6510 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f26240c2fa0 0x7f26240c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 --2- 172.21.15.115:0/209285969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f262413a350 0x7f26240c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 >> 172.21.15.115:0/209285969 conn(0x7f262405e8f0 msgr2=0x7f26240be310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:11.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 shutdown_connections 2023-07-27T14:39:11.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.422+0000 7f262c3ff700 1 -- 172.21.15.115:0/209285969 wait complete. 2023-07-27T14:39:11.492 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000883025 2023-07-27T14:39:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.631+0000 7fb7e67ff700 1 Processor -- start 2023-07-27T14:39:11.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.631+0000 7fb7e67ff700 1 -- start start 2023-07-27T14:39:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.632+0000 7fb7e67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0063260 0x7fb7e0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7e67ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e01553f0 con 0x7fb7e014ae00 2023-07-27T14:39:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7e67ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0157a50 con 0x7fb7e014b1e0 2023-07-27T14:39:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7e67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0157d10 con 0x7fb7e0063260 2023-07-27T14:39:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7dffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb7e014ae00 0x7fb7e0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54514/0 (socket says 172.21.15.115:54514) 2023-07-27T14:39:11.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7dffff700 1 -- 172.21.15.115:0/1533112011 learned_addr learned my addr 172.21.15.115:0/1533112011 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:11.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649475434 0 0) 0x7fb7e01553f0 con 0x7fb7e014ae00 2023-07-27T14:39:11.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c80033f0 con 0x7fb7e014ae00 2023-07-27T14:39:11.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0063260 0x7fb7e0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 337915459 0 0) 0x7fb7c80033f0 con 0x7fb7e014ae00 2023-07-27T14:39:11.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0063260 msgr2=0x7fb7e0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:11.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7deffd700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0063260 0x7fb7e0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 >> v1:172.21.15.159:6789/0 conn(0x7fb7e014b1e0 legacy=0x7fb7e00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.633+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0157ff0 con 0x7fb7e014ae00 2023-07-27T14:39:11.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fb7d0001470 con 0x7fb7e014ae00 2023-07-27T14:39:11.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 >> v1:172.21.15.115:6789/0 conn(0x7fb7e014ae00 legacy=0x7fb7e0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7deffd700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8003910 0x7fb7c8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7deffd700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7deffd700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0063260 0x7fb7c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0157d10 con 0x7fb7c8004690 2023-07-27T14:39:11.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c800b910 con 0x7fb7c8003910 2023-07-27T14:39:11.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c800bad0 con 0x7fb7e0063260 2023-07-27T14:39:11.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7dffff700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8003910 0x7fb7c8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7e4d9c700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0063260 0x7fb7c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7df7fe700 1 -- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0063260 msgr2=0x7fb7c8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:11.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0063260 0x7fb7c8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7df7fe700 1 -- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8003910 msgr2=0x7fb7c8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:11.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8003910 0x7fb7c8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.634+0000 7fb7df7fe700 1 -- 172.21.15.115:0/1533112011 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c80033f0 con 0x7fb7c8004690 2023-07-27T14:39:11.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7c8004b10 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7fb7e0063660 tx=0x7fb7d4009060).ready entity=mon.0 client_cookie=1a8d87e09971c6ee server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:11.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4009e90 con 0x7fb7c8004690 2023-07-27T14:39:11.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4009430 con 0x7fb7c8004690 2023-07-27T14:39:11.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7deffd700 1 -- 172.21.15.115:0/1533112011 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400e850 con 0x7fb7c8004690 2023-07-27T14:39:11.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7e67ff700 1 -- 172.21.15.115:0/1533112011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 msgr2=0x7fb7c8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7e67ff700 1 --2- 172.21.15.115:0/1533112011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7c8004b10 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7fb7e0063660 tx=0x7fb7d4009060).stop 2023-07-27T14:39:11.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7e4d9c700 1 -- 172.21.15.115:0/1533112011 reap_dead start 2023-07-27T14:39:11.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7e67ff700 1 -- 172.21.15.115:0/1533112011 shutdown_connections 2023-07-27T14:39:11.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7e67ff700 1 -- 172.21.15.115:0/1533112011 >> 172.21.15.115:0/1533112011 conn(0x7fb7e005e940 msgr2=0x7fb7e00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:11.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.635+0000 7fb7e67ff700 1 -- 172.21.15.115:0/1533112011 shutdown_connections 2023-07-27T14:39:11.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.636+0000 7fb7e67ff700 1 -- 172.21.15.115:0/1533112011 wait complete. 2023-07-27T14:39:11.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.637+0000 7fb7e67ff700 1 Processor -- start 2023-07-27T14:39:11.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.637+0000 7fb7e67ff700 1 -- start start 2023-07-27T14:39:11.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7e67ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7e00c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7e67ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7e00c1c50 0x7fb7e00b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7e67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0163dc0 0x7fb7e0164240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7e67ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0167420 con 0x7fb7c8004690 2023-07-27T14:39:11.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7e67ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00c4110 con 0x7fb7e00c1c50 2023-07-27T14:39:11.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7e67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00c2110 con 0x7fb7e0163dc0 2023-07-27T14:39:11.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7dffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7e00c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7dffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7e00c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58024/0 (socket says 172.21.15.115:58024) 2023-07-27T14:39:11.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.638+0000 7fb7dffff700 1 -- 172.21.15.115:0/2598157013 learned_addr learned my addr 172.21.15.115:0/2598157013 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:11.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7e00c1c50 0x7fb7e00b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7e4d9c700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0163dc0 0x7fb7e0164240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7dffff700 1 -- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0163dc0 msgr2=0x7fb7e0164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7dffff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0163dc0 0x7fb7e0164240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7dffff700 1 -- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7e00c1c50 msgr2=0x7fb7e00b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7dffff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7e00c1c50 0x7fb7e00b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7dffff700 1 -- 172.21.15.115:0/2598157013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00c23f0 con 0x7fb7c8004690 2023-07-27T14:39:11.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7e00c1c50 0x7fb7e00b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:11.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7e4d9c700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0163dc0 0x7fb7e0164240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:11.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7dffff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7e00c3c20 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7fb7d00047e0 tx=0x7fb7e014eb20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:11.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7c7fff700 1 -- 172.21.15.115:0/2598157013 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000f670 con 0x7fb7c8004690 2023-07-27T14:39:11.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7c7fff700 1 -- 172.21.15.115:0/2598157013 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000f7d0 con 0x7fb7c8004690 2023-07-27T14:39:11.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00c26d0 con 0x7fb7c8004690 2023-07-27T14:39:11.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7c7fff700 1 -- 172.21.15.115:0/2598157013 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000fb70 con 0x7fb7c8004690 2023-07-27T14:39:11.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.639+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e00c36d0 con 0x7fb7c8004690 2023-07-27T14:39:11.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.640+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e006c470 con 0x7fb7c8004690 2023-07-27T14:39:11.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.641+0000 7fb7c7fff700 1 -- 172.21.15.115:0/2598157013 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 33) v1 ==== 77202+0+0 (secure 0 0 0) 0x7fb7d001b030 con 0x7fb7c8004690 2023-07-27T14:39:11.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.642+0000 7fb7c7fff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb7cc05fb50 0x7fb7cc062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:11.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.642+0000 7fb7c7fff700 1 -- 172.21.15.115:0/2598157013 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb7d007a9e0 con 0x7fb7c8004690 2023-07-27T14:39:11.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.642+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb7cc05fb50 0x7fb7cc062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:11.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.643+0000 7fb7df7fe700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb7cc05fb50 0x7fb7cc062010 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fb7d40095a0 tx=0x7fb7d401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:11.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.646+0000 7fb7c7fff700 1 -- 172.21.15.115:0/2598157013 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7d004b1c0 con 0x7fb7c8004690 2023-07-27T14:39:11.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.742+0000 7fb7c7fff700 1 -- 172.21.15.115:0/2598157013 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 34) v1 ==== 77242+0+0 (secure 0 0 0) 0x7fb7d0077b20 con 0x7fb7c8004690 2023-07-27T14:39:11.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.853+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7e00641e0 con 0x7fb7cc05fb50 2023-07-27T14:39:11.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.859+0000 7fb7c7fff700 1 -- 172.21.15.115:0/2598157013 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fb7e00641e0 con 0x7fb7cc05fb50 2023-07-27T14:39:11.912 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3 2023-07-27T14:39:11.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb7cc05fb50 msgr2=0x7fb7cc062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb7cc05fb50 0x7fb7cc062010 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fb7d40095a0 tx=0x7fb7d401a000).stop 2023-07-27T14:39:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 msgr2=0x7fb7e00c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7e00c3c20 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7fb7d00047e0 tx=0x7fb7e014eb20).stop 2023-07-27T14:39:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 shutdown_connections 2023-07-27T14:39:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb7cc05fb50 0x7fb7cc062010 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7e0163dc0 0x7fb7e0164240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7c8004690 0x7fb7e00c3c20 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 --2- 172.21.15.115:0/2598157013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7e00c1c50 0x7fb7e00b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:11.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 >> 172.21.15.115:0/2598157013 conn(0x7fb7e005e940 msgr2=0x7fb7e014a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:11.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 shutdown_connections 2023-07-27T14:39:11.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:11.861+0000 7fb7e67ff700 1 -- 172.21.15.115:0/2598157013 wait complete. 2023-07-27T14:39:11.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:11.932 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:11.980 INFO:teuthology.orchestra.run.smithi115.stdout:cephfs_data 2023-07-27T14:39:11.981 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create new_pool --pg_num_min 64 2023-07-27T14:39:12.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.119+0000 7f4c3a5ff700 1 Processor -- start 2023-07-27T14:39:12.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.120+0000 7f4c3a5ff700 1 -- start start 2023-07-27T14:39:12.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.121+0000 7f4c3a5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4c34063260 0x7f4c34154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:12.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.121+0000 7f4c3a5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414b1e0 0x7f4c340a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:12.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.121+0000 7f4c3a5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c341553f0 con 0x7f4c3414ae00 2023-07-27T14:39:12.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.121+0000 7f4c3a5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c34157a50 con 0x7f4c34063260 2023-07-27T14:39:12.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.121+0000 7f4c3a5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34157d10 con 0x7f4c3414b1e0 2023-07-27T14:39:12.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.121+0000 7f4c33fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4c3414ae00 0x7f4c34062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54516/0 (socket says 172.21.15.115:54516) 2023-07-27T14:39:12.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.121+0000 7f4c33fff700 1 -- 172.21.15.115:0/403873901 learned_addr learned my addr 172.21.15.115:0/403873901 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:12.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c337fe700 1 --2- 172.21.15.115:0/403873901 >> v2:172.21.15.159:3300/0 conn(0x7f4c34063260 0x7f4c34154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:12.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c38b9c700 1 --2- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414b1e0 0x7f4c340a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:12.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c32ffd700 1 -- 172.21.15.115:0/403873901 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125938302 0 0) 0x7f4c341553f0 con 0x7f4c3414ae00 2023-07-27T14:39:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c32ffd700 1 -- 172.21.15.115:0/403873901 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c1c0033f0 con 0x7f4c3414ae00 2023-07-27T14:39:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c337fe700 1 -- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414b1e0 msgr2=0x7f4c340a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c337fe700 1 --2- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414b1e0 0x7f4c340a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c337fe700 1 -- 172.21.15.115:0/403873901 >> v1:172.21.15.115:6789/0 conn(0x7f4c3414ae00 legacy=0x7f4c34062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:12.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c337fe700 1 -- 172.21.15.115:0/403873901 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34157ff0 con 0x7f4c34063260 2023-07-27T14:39:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c38b9c700 1 --2- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414b1e0 0x7f4c340a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.122+0000 7f4c337fe700 1 --2- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c34063260 0x7f4c34154f00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f4c28009760 tx=0x7f4c28009060).ready entity=mon.1 client_cookie=e9d0dd5977a88a58 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c32ffd700 1 -- 172.21.15.115:0/403873901 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2800d4a0 con 0x7f4c34063260 2023-07-27T14:39:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c32ffd700 1 -- 172.21.15.115:0/403873901 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2800d600 con 0x7f4c34063260 2023-07-27T14:39:12.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c32ffd700 1 -- 172.21.15.115:0/403873901 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2800d980 con 0x7f4c34063260 2023-07-27T14:39:12.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c34063260 msgr2=0x7f4c34154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:12.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c34063260 0x7f4c34154f00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f4c28009760 tx=0x7f4c28009060).stop 2023-07-27T14:39:12.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/403873901 shutdown_connections 2023-07-27T14:39:12.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414b1e0 0x7f4c340a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/403873901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c34063260 0x7f4c34154f00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/403873901 >> 172.21.15.115:0/403873901 conn(0x7f4c3405e940 msgr2=0x7f4c340cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:12.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/403873901 shutdown_connections 2023-07-27T14:39:12.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.123+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/403873901 wait complete. 2023-07-27T14:39:12.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.125+0000 7f4c3a5ff700 1 Processor -- start 2023-07-27T14:39:12.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.125+0000 7f4c3a5ff700 1 -- start start 2023-07-27T14:39:12.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c3a5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c34063260 0x7f4c34135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:12.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c3a5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414ae00 0x7f4c340ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:12.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c3a5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c3414b1e0 0x7f4c3414a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:12.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c3a5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34168140 con 0x7f4c34063260 2023-07-27T14:39:12.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c3a5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341672e0 con 0x7f4c3414b1e0 2023-07-27T14:39:12.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c3a5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34147d10 con 0x7f4c3414ae00 2023-07-27T14:39:12.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c34063260 0x7f4c34135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:12.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c34063260 0x7f4c34135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58026/0 (socket says 172.21.15.115:58026) 2023-07-27T14:39:12.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c33fff700 1 -- 172.21.15.115:0/2233178148 learned_addr learned my addr 172.21.15.115:0/2233178148 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:12.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c337fe700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414ae00 0x7f4c340ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:12.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c38b9c700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c3414b1e0 0x7f4c3414a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:12.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c33fff700 1 -- 172.21.15.115:0/2233178148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414ae00 msgr2=0x7f4c340ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:12.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c33fff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414ae00 0x7f4c340ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c33fff700 1 -- 172.21.15.115:0/2233178148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c3414b1e0 msgr2=0x7f4c3414a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:12.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c33fff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c3414b1e0 0x7f4c3414a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.126+0000 7f4c33fff700 1 -- 172.21.15.115:0/2233178148 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c009a20 con 0x7f4c34063260 2023-07-27T14:39:12.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.127+0000 7f4c33fff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c34063260 0x7f4c34135cb0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f4c2400c590 tx=0x7f4c24007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:12.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.127+0000 7f4c1bfff700 1 -- 172.21.15.115:0/2233178148 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24007e40 con 0x7f4c34063260 2023-07-27T14:39:12.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.127+0000 7f4c1bfff700 1 -- 172.21.15.115:0/2233178148 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c240072e0 con 0x7f4c34063260 2023-07-27T14:39:12.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.127+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c280092a0 con 0x7f4c34063260 2023-07-27T14:39:12.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.127+0000 7f4c1bfff700 1 -- 172.21.15.115:0/2233178148 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240057a0 con 0x7f4c34063260 2023-07-27T14:39:12.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.127+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c34167810 con 0x7f4c34063260 2023-07-27T14:39:12.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.128+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3406c470 con 0x7f4c34063260 2023-07-27T14:39:12.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.129+0000 7f4c1bfff700 1 -- 172.21.15.115:0/2233178148 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 34) v1 ==== 77242+0+0 (secure 0 0 0) 0x7f4c24010070 con 0x7f4c34063260 2023-07-27T14:39:12.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.129+0000 7f4c1bfff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4c2005fba0 0x7f4c20062060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:12.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.130+0000 7f4c1bfff700 1 -- 172.21.15.115:0/2233178148 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4c2407a960 con 0x7f4c34063260 2023-07-27T14:39:12.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.130+0000 7f4c337fe700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4c2005fba0 0x7f4c20062060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:12.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.130+0000 7f4c337fe700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4c2005fba0 0x7f4c20062060 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f4c34063660 tx=0x7f4c28016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:12.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.134+0000 7f4c1bfff700 1 -- 172.21.15.115:0/2233178148 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c2404afe0 con 0x7f4c34063260 2023-07-27T14:39:12.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.306+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "new_pool", "pg_num_min": 64} v 0) v1 -- 0x7f4c34154db0 con 0x7f4c34063260 2023-07-27T14:39:12.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.747+0000 7f4c1bfff700 1 -- 172.21.15.115:0/2233178148 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "new_pool", "pg_num_min": 64}]=0 pool 'new_pool' created v189) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4c2404e600 con 0x7f4c34063260 2023-07-27T14:39:12.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.750+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4c2005fba0 msgr2=0x7f4c20062060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:12.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.750+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4c2005fba0 0x7f4c20062060 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f4c34063660 tx=0x7f4c28016000).stop 2023-07-27T14:39:12.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.750+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c34063260 msgr2=0x7f4c34135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:12.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.750+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c34063260 0x7f4c34135cb0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f4c2400c590 tx=0x7f4c24007c80).stop 2023-07-27T14:39:12.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.751+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 shutdown_connections 2023-07-27T14:39:12.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.751+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4c2005fba0 0x7f4c20062060 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.751+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c3414b1e0 0x7f4c3414a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.751+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c34063260 0x7f4c34135cb0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.751+0000 7f4c3a5ff700 1 --2- 172.21.15.115:0/2233178148 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4c3414ae00 0x7f4c340ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:12.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.751+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 >> 172.21.15.115:0/2233178148 conn(0x7f4c3405e940 msgr2=0x7f4c340c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:12.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.751+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 shutdown_connections 2023-07-27T14:39:12.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.751+0000 7f4c3a5ff700 1 -- 172.21.15.115:0/2233178148 wait complete. 2023-07-27T14:39:12.808 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'new_pool' created 2023-07-27T14:39:12.825 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs new_pool 2023-07-27T14:39:13.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.961+0000 7ff65c1ff700 1 Processor -- start 2023-07-27T14:39:13.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.961+0000 7ff65c1ff700 1 -- start start 2023-07-27T14:39:13.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.962+0000 7ff65c1ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff654063260 0x7ff654154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.962+0000 7ff65c1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6541553f0 con 0x7ff65414b1e0 2023-07-27T14:39:13.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.962+0000 7ff65c1ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff654157a50 con 0x7ff65414ae00 2023-07-27T14:39:13.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.962+0000 7ff65c1ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff654157d10 con 0x7ff654063260 2023-07-27T14:39:13.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff65a79c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff65414b1e0 0x7ff6540a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54522/0 (socket says 172.21.15.115:54522) 2023-07-27T14:39:13.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff65a79c700 1 -- 172.21.15.115:0/2705825288 learned_addr learned my addr 172.21.15.115:0/2705825288 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:13.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff65979a700 1 --2- 172.21.15.115:0/2705825288 >> v2:172.21.15.159:3300/0 conn(0x7ff654063260 0x7ff654154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356754958 0 0) 0x7ff6541553f0 con 0x7ff65414b1e0 2023-07-27T14:39:13.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6400033f0 con 0x7ff65414b1e0 2023-07-27T14:39:13.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307631448 0 0) 0x7ff654157a50 con 0x7ff65414ae00 2023-07-27T14:39:13.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6541553f0 con 0x7ff65414ae00 2023-07-27T14:39:13.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609554160 0 0) 0x7ff6400033f0 con 0x7ff65414b1e0 2023-07-27T14:39:13.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 >> v2:172.21.15.159:3300/0 conn(0x7ff654063260 msgr2=0x7ff654154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:13.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 --2- 172.21.15.115:0/2705825288 >> v2:172.21.15.159:3300/0 conn(0x7ff654063260 0x7ff654154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 >> v1:172.21.15.159:6789/0 conn(0x7ff65414ae00 legacy=0x7ff654062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.963+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654157ff0 con 0x7ff65414b1e0 2023-07-27T14:39:13.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7ff64c0017f0 con 0x7ff65414b1e0 2023-07-27T14:39:13.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 >> v1:172.21.15.115:6789/0 conn(0x7ff65414b1e0 legacy=0x7ff6540a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff658f99700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff640003a70 0x7ff640003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff658f99700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff640004690 0x7ff640004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff658f99700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640005000 0x7ff64000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff654157d10 con 0x7ff640004690 2023-07-27T14:39:13.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64000bf60 con 0x7ff640005000 2023-07-27T14:39:13.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64000c0d0 con 0x7ff640003a70 2023-07-27T14:39:13.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65979a700 1 --2- 172.21.15.115:0/2705825288 >> v2:172.21.15.159:3300/0 conn(0x7ff654063260 0x7ff654154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:13.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff659f9b700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff640003a70 0x7ff640003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65979a700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff640004690 0x7ff640004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65a79c700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640005000 0x7ff64000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65979a700 1 -- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff640003a70 msgr2=0x7ff640003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:13.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65979a700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff640003a70 0x7ff640003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65979a700 1 -- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640005000 msgr2=0x7ff64000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:13.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65979a700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640005000 0x7ff64000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65979a700 1 -- 172.21.15.115:0/2705825288 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400033f0 con 0x7ff640004690 2023-07-27T14:39:13.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff65a79c700 1 -- 172.21.15.115:0/2705825288 reap_dead start 2023-07-27T14:39:13.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.964+0000 7ff659f9b700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff640003a70 0x7ff640003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:13.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.965+0000 7ff65979a700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff640004690 0x7ff640004b10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7ff654063660 tx=0x7ff644009060).ready entity=mon.0 client_cookie=b3be8adff6278a50 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.965+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6440095c0 con 0x7ff640004690 2023-07-27T14:39:13.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.965+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64400e710 con 0x7ff640004690 2023-07-27T14:39:13.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.965+0000 7ff658f99700 1 -- 172.21.15.115:0/2705825288 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64400ea90 con 0x7ff640004690 2023-07-27T14:39:13.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.965+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2705825288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff640004690 msgr2=0x7ff640004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.965+0000 7ff65c1ff700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff640004690 0x7ff640004b10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7ff654063660 tx=0x7ff644009060).stop 2023-07-27T14:39:13.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.965+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2705825288 shutdown_connections 2023-07-27T14:39:13.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.965+0000 7ff65c1ff700 1 --2- 172.21.15.115:0/2705825288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff640004690 0x7ff640004b10 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.966+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2705825288 >> 172.21.15.115:0/2705825288 conn(0x7ff65405e940 msgr2=0x7ff6540cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:13.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.966+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2705825288 shutdown_connections 2023-07-27T14:39:13.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.966+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2705825288 wait complete. 2023-07-27T14:39:13.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.967+0000 7ff65c1ff700 1 Processor -- start 2023-07-27T14:39:13.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.967+0000 7ff65c1ff700 1 -- start start 2023-07-27T14:39:13.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65c1ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640004690 0x7ff65414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65c1ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff65414eb60 0x7ff6541503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65c1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6540c9b40 0x7ff6540c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65c1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65414abb0 con 0x7ff6540c9b40 2023-07-27T14:39:13.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65c1ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65414fb70 con 0x7ff640004690 2023-07-27T14:39:13.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65c1ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540ca4b0 con 0x7ff65414eb60 2023-07-27T14:39:13.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65a79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6540c9b40 0x7ff6540c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65a79c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6540c9b40 0x7ff6540c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58050/0 (socket says 172.21.15.115:58050) 2023-07-27T14:39:13.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff65a79c700 1 -- 172.21.15.115:0/2691809162 learned_addr learned my addr 172.21.15.115:0/2691809162 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:13.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.968+0000 7ff659f9b700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640004690 0x7ff65414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65979a700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff65414eb60 0x7ff6541503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65a79c700 1 -- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff65414eb60 msgr2=0x7ff6541503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65a79c700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff65414eb60 0x7ff6541503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65a79c700 1 -- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640004690 msgr2=0x7ff65414a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65a79c700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640004690 0x7ff65414a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65a79c700 1 -- 172.21.15.115:0/2691809162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65414f2d0 con 0x7ff6540c9b40 2023-07-27T14:39:13.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65979a700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff65414eb60 0x7ff6541503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:13.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65a79c700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6540c9b40 0x7ff6540c9fc0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7ff65414b5e0 tx=0x7ff64c007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff649ffb700 1 -- 172.21.15.115:0/2691809162 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00f920 con 0x7ff6540c9b40 2023-07-27T14:39:13.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff649ffb700 1 -- 172.21.15.115:0/2691809162 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00fa80 con 0x7ff6540c9b40 2023-07-27T14:39:13.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff649ffb700 1 -- 172.21.15.115:0/2691809162 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00fe20 con 0x7ff6540c9b40 2023-07-27T14:39:13.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65414f5b0 con 0x7ff6540c9b40 2023-07-27T14:39:13.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.969+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65414b9e0 con 0x7ff6540c9b40 2023-07-27T14:39:13.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.970+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65414bba0 con 0x7ff6540c9b40 2023-07-27T14:39:13.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.971+0000 7ff649ffb700 1 -- 172.21.15.115:0/2691809162 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 34) v1 ==== 77242+0+0 (secure 0 0 0) 0x7ff64c01f070 con 0x7ff6540c9b40 2023-07-27T14:39:13.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.972+0000 7ff649ffb700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff63805fba0 0x7ff638062060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.972+0000 7ff649ffb700 1 -- 172.21.15.115:0/2691809162 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6484+0+0 (secure 0 0 0) 0x7ff64c07ac40 con 0x7ff6540c9b40 2023-07-27T14:39:13.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.972+0000 7ff659f9b700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff63805fba0 0x7ff638062060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.973+0000 7ff659f9b700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff63805fba0 0x7ff638062060 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7ff650000c00 tx=0x7ff650007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:12.977+0000 7ff649ffb700 1 -- 172.21.15.115:0/2691809162 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff64c04b150 con 0x7ff6540c9b40 2023-07-27T14:39:13.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.189+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "new_pool"} v 0) v1 -- 0x7ff65406c470 con 0x7ff6540c9b40 2023-07-27T14:39:13.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.196+0000 7ff649ffb700 1 -- 172.21.15.115:0/2691809162 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "new_pool"}]=0 added data pool 27 to fsmap v104) v1 ==== 132+0+0 (secure 0 0 0) 0x7ff64c01d030 con 0x7ff6540c9b40 2023-07-27T14:39:13.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.199+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff63805fba0 msgr2=0x7ff638062060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.199+0000 7ff65c1ff700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff63805fba0 0x7ff638062060 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7ff650000c00 tx=0x7ff650007b90).stop 2023-07-27T14:39:13.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.199+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6540c9b40 msgr2=0x7ff6540c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.199+0000 7ff65c1ff700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6540c9b40 0x7ff6540c9fc0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7ff65414b5e0 tx=0x7ff64c007f20).stop 2023-07-27T14:39:13.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.200+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 shutdown_connections 2023-07-27T14:39:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.200+0000 7ff65c1ff700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff63805fba0 0x7ff638062060 secure :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0x7ff650000c00 tx=0x7ff650007b90).stop 2023-07-27T14:39:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.200+0000 7ff65c1ff700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff6540c9b40 0x7ff6540c9fc0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.200+0000 7ff65c1ff700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff640004690 0x7ff65414a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.200+0000 7ff65c1ff700 1 --2- 172.21.15.115:0/2691809162 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff65414eb60 0x7ff6541503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.200+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 >> 172.21.15.115:0/2691809162 conn(0x7ff65405e940 msgr2=0x7ff6540c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:13.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.204+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 shutdown_connections 2023-07-27T14:39:13.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.204+0000 7ff65c1ff700 1 -- 172.21.15.115:0/2691809162 wait complete. 2023-07-27T14:39:13.262 INFO:teuthology.orchestra.run.smithi115.stderr:added data pool 27 to fsmap 2023-07-27T14:39:13.280 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:39:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.418+0000 7f5b67fff700 1 Processor -- start 2023-07-27T14:39:13.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.418+0000 7f5b67fff700 1 -- start start 2023-07-27T14:39:13.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.419+0000 7f5b67fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601542a0 0x7f5b6015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.419+0000 7f5b67fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b600aa4d0 con 0x7f5b600aaa40 2023-07-27T14:39:13.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.419+0000 7f5b67fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b600c05c0 con 0x7f5b60153ec0 2023-07-27T14:39:13.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.419+0000 7f5b67fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600c1a60 con 0x7f5b601542a0 2023-07-27T14:39:13.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b6559a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5b600aaa40 0x7f5b600640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54536/0 (socket says 172.21.15.115:54536) 2023-07-27T14:39:13.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b6559a700 1 -- 172.21.15.115:0/3682583270 learned_addr learned my addr 172.21.15.115:0/3682583270 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:13.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b6659c700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601542a0 0x7f5b6015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466116933 0 0) 0x7f5b50001110 con 0x7f5b600aaa40 2023-07-27T14:39:13.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b4c0033f0 con 0x7f5b600aaa40 2023-07-27T14:39:13.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3051868783 0 0) 0x7f5b4c0033f0 con 0x7f5b600aaa40 2023-07-27T14:39:13.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601542a0 msgr2=0x7f5b6015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:13.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601542a0 0x7f5b6015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 >> v1:172.21.15.159:6789/0 conn(0x7f5b60153ec0 legacy=0x7f5b600a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600aa270 con 0x7f5b600aaa40 2023-07-27T14:39:13.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f5b50001600 con 0x7f5b600aaa40 2023-07-27T14:39:13.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 >> v1:172.21.15.115:6789/0 conn(0x7f5b600aaa40 legacy=0x7f5b600640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b4c003910 0x7f5b4c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601542a0 0x7f5b4c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c004b80 0x7f5b4c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600c1a60 con 0x7f5b4c003910 2023-07-27T14:39:13.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c00b940 con 0x7f5b4c004b80 2023-07-27T14:39:13.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.420+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c00bb00 con 0x7f5b601542a0 2023-07-27T14:39:13.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b65d9b700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b4c003910 0x7f5b4c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b6559a700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601542a0 0x7f5b4c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b6659c700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c004b80 0x7f5b4c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b65d9b700 1 -- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601542a0 msgr2=0x7f5b4c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b65d9b700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601542a0 0x7f5b4c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b65d9b700 1 -- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c004b80 msgr2=0x7f5b4c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b65d9b700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c004b80 0x7f5b4c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b65d9b700 1 -- 172.21.15.115:0/3682583270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0033f0 con 0x7f5b4c003910 2023-07-27T14:39:13.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b65d9b700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b4c003910 0x7f5b4c003d30 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f5b5c001730 tx=0x7f5b5c007bb0).ready entity=mon.0 client_cookie=ab5ca279efee223b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c007020 con 0x7f5b4c003910 2023-07-27T14:39:13.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c007180 con 0x7f5b4c003910 2023-07-27T14:39:13.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.421+0000 7f5b64d99700 1 -- 172.21.15.115:0/3682583270 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c007500 con 0x7f5b4c003910 2023-07-27T14:39:13.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.422+0000 7f5b67fff700 1 -- 172.21.15.115:0/3682583270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b4c003910 msgr2=0x7f5b4c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.422+0000 7f5b67fff700 1 --2- 172.21.15.115:0/3682583270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b4c003910 0x7f5b4c003d30 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7f5b5c001730 tx=0x7f5b5c007bb0).stop 2023-07-27T14:39:13.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.422+0000 7f5b6659c700 1 -- 172.21.15.115:0/3682583270 reap_dead start 2023-07-27T14:39:13.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.422+0000 7f5b67fff700 1 -- 172.21.15.115:0/3682583270 shutdown_connections 2023-07-27T14:39:13.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.422+0000 7f5b67fff700 1 -- 172.21.15.115:0/3682583270 >> 172.21.15.115:0/3682583270 conn(0x7f5b600cb610 msgr2=0x7f5b600c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:13.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.422+0000 7f5b67fff700 1 -- 172.21.15.115:0/3682583270 shutdown_connections 2023-07-27T14:39:13.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.422+0000 7f5b67fff700 1 -- 172.21.15.115:0/3682583270 wait complete. 2023-07-27T14:39:13.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.424+0000 7f5b67fff700 1 Processor -- start 2023-07-27T14:39:13.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.424+0000 7f5b67fff700 1 -- start start 2023-07-27T14:39:13.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b67fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c003910 0x7f5b60165700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b67fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b600c25e0 0x7f5b601569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b67fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601595f0 0x7f5b600aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b67fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60165ce0 con 0x7f5b600c25e0 2023-07-27T14:39:13.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b67fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60165fc0 con 0x7f5b4c003910 2023-07-27T14:39:13.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b67fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b601662a0 con 0x7f5b601595f0 2023-07-27T14:39:13.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b600c25e0 0x7f5b601569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b600c25e0 0x7f5b601569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58074/0 (socket says 172.21.15.115:58074) 2023-07-27T14:39:13.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 -- 172.21.15.115:0/4185771590 learned_addr learned my addr 172.21.15.115:0/4185771590 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:13.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b65d9b700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c003910 0x7f5b60165700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6659c700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601595f0 0x7f5b600aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 -- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601595f0 msgr2=0x7f5b600aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601595f0 0x7f5b600aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 -- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c003910 msgr2=0x7f5b60165700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c003910 0x7f5b60165700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 -- 172.21.15.115:0/4185771590 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60166580 con 0x7f5b600c25e0 2023-07-27T14:39:13.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6659c700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601595f0 0x7f5b600aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:13.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b65d9b700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c003910 0x7f5b60165700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:13.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.425+0000 7f5b6559a700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b600c25e0 0x7f5b601569f0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f5b50007790 tx=0x7f5b500078d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.426+0000 7f5b55ffb700 1 -- 172.21.15.115:0/4185771590 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50011590 con 0x7f5b600c25e0 2023-07-27T14:39:13.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.426+0000 7f5b55ffb700 1 -- 172.21.15.115:0/4185771590 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b500116f0 con 0x7f5b600c25e0 2023-07-27T14:39:13.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.426+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b60166860 con 0x7f5b600c25e0 2023-07-27T14:39:13.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.426+0000 7f5b55ffb700 1 -- 172.21.15.115:0/4185771590 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50011a70 con 0x7f5b600c25e0 2023-07-27T14:39:13.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.426+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b600c4dc0 con 0x7f5b600c25e0 2023-07-27T14:39:13.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.427+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b600c4fe0 con 0x7f5b600c25e0 2023-07-27T14:39:13.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.428+0000 7f5b55ffb700 1 -- 172.21.15.115:0/4185771590 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 34) v1 ==== 77242+0+0 (secure 0 0 0) 0x7f5b5001b030 con 0x7f5b600c25e0 2023-07-27T14:39:13.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.429+0000 7f5b55ffb700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b4405fba0 0x7f5b44062060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.429+0000 7f5b55ffb700 1 -- 172.21.15.115:0/4185771590 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f5b5007a930 con 0x7f5b600c25e0 2023-07-27T14:39:13.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.429+0000 7f5b65d9b700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b4405fba0 0x7f5b44062060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.429+0000 7f5b65d9b700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b4405fba0 0x7f5b44062060 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f5b600af710 tx=0x7f5b5c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.433+0000 7f5b55ffb700 1 -- 172.21.15.115:0/4185771590 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b5004af10 con 0x7f5b600c25e0 2023-07-27T14:39:13.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.645+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b600aa4d0 con 0x7f5b600c25e0 2023-07-27T14:39:13.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.646+0000 7f5b55ffb700 1 -- 172.21.15.115:0/4185771590 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4507 (secure 0 0 0) 0x7f5b600aa4d0 con 0x7f5b600c25e0 2023-07-27T14:39:13.699 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:13.699 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2746189426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2746189426},{"type":"v1","addr":"172.21.15.159:6835","nonce":2746189426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/131117331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":131117331},{"type":"v1","addr":"172.21.15.115:6837","nonce":131117331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":8608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3669259360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3669259360},{"type":"v1","addr":"172.21.15.159:6834","nonce":3669259360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:38:54.165239+0000","modified":"2023-07-27T14:39:13.190759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2564907842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2564907842},{"type":"v1","addr":"172.21.15.115:6836","nonce":2564907842}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26,27],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-07-27T14:39:13.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b4405fba0 msgr2=0x7f5b44062060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b4405fba0 0x7f5b44062060 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f5b600af710 tx=0x7f5b5c015000).stop 2023-07-27T14:39:13.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b600c25e0 msgr2=0x7f5b601569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b600c25e0 0x7f5b601569f0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f5b50007790 tx=0x7f5b500078d0).stop 2023-07-27T14:39:13.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 shutdown_connections 2023-07-27T14:39:13.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5b4405fba0 0x7f5b44062060 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5b601595f0 0x7f5b600aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b4c003910 0x7f5b60165700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 --2- 172.21.15.115:0/4185771590 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b600c25e0 0x7f5b601569f0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 >> 172.21.15.115:0/4185771590 conn(0x7f5b600cb610 msgr2=0x7f5b60156140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:13.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 shutdown_connections 2023-07-27T14:39:13.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.648+0000 7f5b67fff700 1 -- 172.21.15.115:0/4185771590 wait complete. 2023-07-27T14:39:13.705 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 104 2023-07-27T14:39:13.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:39:13.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.853+0000 7f68bf7ff700 1 Processor -- start 2023-07-27T14:39:13.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.853+0000 7f68bf7ff700 1 -- start start 2023-07-27T14:39:13.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.854+0000 7f68bf7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f68b8151d70 0x7f68b8155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.854+0000 7f68bf7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f68b8065ff0 0x7f68b8066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.854+0000 7f68bf7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 0x7f68b8157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.854+0000 7f68bf7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b8063a90 con 0x7f68b8065ff0 2023-07-27T14:39:13.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.854+0000 7f68bf7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b8067080 con 0x7f68b8151d70 2023-07-27T14:39:13.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.854+0000 7f68bf7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8066df0 con 0x7f68b8066960 2023-07-27T14:39:13.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f68b8065ff0 0x7f68b8066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f68b8065ff0 0x7f68b8066470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42932/0 (socket says 172.21.15.115:42932) 2023-07-27T14:39:13.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 -- 172.21.15.115:0/3884329269 learned_addr learned my addr 172.21.15.115:0/3884329269 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:13.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bd59b700 1 --2- 172.21.15.115:0/3884329269 >> v2:172.21.15.159:3300/0 conn(0x7f68b8151d70 0x7f68b8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bdd9c700 1 --2- 172.21.15.115:0/3884329269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 0x7f68b8157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 -- 172.21.15.115:0/3884329269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 msgr2=0x7f68b8157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:13.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 --2- 172.21.15.115:0/3884329269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 0x7f68b8157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 -- 172.21.15.115:0/3884329269 >> v2:172.21.15.159:3300/0 conn(0x7f68b8151d70 msgr2=0x7f68b8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:13.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 --2- 172.21.15.115:0/3884329269 >> v2:172.21.15.159:3300/0 conn(0x7f68b8151d70 0x7f68b8155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 -- 172.21.15.115:0/3884329269 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80634d0 con 0x7f68b8065ff0 2023-07-27T14:39:13.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bd59b700 1 --2- 172.21.15.115:0/3884329269 >> v2:172.21.15.159:3300/0 conn(0x7f68b8151d70 0x7f68b8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:13.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.855+0000 7f68bcd9a700 1 --2- 172.21.15.115:0/3884329269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8065ff0 0x7f68b8066470 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f68b80c88b0 tx=0x7f68a80090f0).ready entity=mon.0 client_cookie=7795fd12d1dda367 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68affff700 1 -- 172.21.15.115:0/3884329269 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800b600 con 0x7f68b8065ff0 2023-07-27T14:39:13.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68affff700 1 -- 172.21.15.115:0/3884329269 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800b760 con 0x7f68b8065ff0 2023-07-27T14:39:13.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68affff700 1 -- 172.21.15.115:0/3884329269 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800bae0 con 0x7f68b8065ff0 2023-07-27T14:39:13.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 -- 172.21.15.115:0/3884329269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8065ff0 msgr2=0x7f68b8066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/3884329269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8065ff0 0x7f68b8066470 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f68b80c88b0 tx=0x7f68a80090f0).stop 2023-07-27T14:39:13.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 -- 172.21.15.115:0/3884329269 shutdown_connections 2023-07-27T14:39:13.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/3884329269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 0x7f68b8157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/3884329269 >> v2:172.21.15.159:3300/0 conn(0x7f68b8151d70 0x7f68b8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/3884329269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8065ff0 0x7f68b8066470 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 -- 172.21.15.115:0/3884329269 >> 172.21.15.115:0/3884329269 conn(0x7f68b80c89a0 msgr2=0x7f68b80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:13.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 -- 172.21.15.115:0/3884329269 shutdown_connections 2023-07-27T14:39:13.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.856+0000 7f68bf7ff700 1 -- 172.21.15.115:0/3884329269 wait complete. 2023-07-27T14:39:13.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.858+0000 7f68bf7ff700 1 Processor -- start 2023-07-27T14:39:13.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.858+0000 7f68bf7ff700 1 -- start start 2023-07-27T14:39:13.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bf7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b8065ff0 0x7f68b814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bf7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 0x7f68b8150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bf7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8151d70 0x7f68b81508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bf7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8150de0 con 0x7f68b8151d70 2023-07-27T14:39:13.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bf7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80a49e0 con 0x7f68b8065ff0 2023-07-27T14:39:13.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bf7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80a4cc0 con 0x7f68b8066960 2023-07-27T14:39:13.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bdd9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8151d70 0x7f68b81508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bdd9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8151d70 0x7f68b81508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42948/0 (socket says 172.21.15.115:42948) 2023-07-27T14:39:13.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bdd9c700 1 -- 172.21.15.115:0/2562612988 learned_addr learned my addr 172.21.15.115:0/2562612988 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:13.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bd59b700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b8065ff0 0x7f68b814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.859+0000 7f68bcd9a700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 0x7f68b8150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68bdd9c700 1 -- 172.21.15.115:0/2562612988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 msgr2=0x7f68b8150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68bdd9c700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 0x7f68b8150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68bdd9c700 1 -- 172.21.15.115:0/2562612988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b8065ff0 msgr2=0x7f68b814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:13.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68bdd9c700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b8065ff0 0x7f68b814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:13.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68bdd9c700 1 -- 172.21.15.115:0/2562612988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8009370 con 0x7f68b8151d70 2023-07-27T14:39:13.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68bdd9c700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8151d70 0x7f68b81508f0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f68b0009fa0 tx=0x7f68b0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68ad7fa700 1 -- 172.21.15.115:0/2562612988 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b000ebc0 con 0x7f68b8151d70 2023-07-27T14:39:13.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68ad7fa700 1 -- 172.21.15.115:0/2562612988 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b000ed20 con 0x7f68b8151d70 2023-07-27T14:39:13.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b80a4fa0 con 0x7f68b8151d70 2023-07-27T14:39:13.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68ad7fa700 1 -- 172.21.15.115:0/2562612988 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0014610 con 0x7f68b8151d70 2023-07-27T14:39:13.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.860+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b80a5560 con 0x7f68b8151d70 2023-07-27T14:39:13.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.861+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b80a5750 con 0x7f68b8151d70 2023-07-27T14:39:13.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.862+0000 7f68ad7fa700 1 -- 172.21.15.115:0/2562612988 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 34) v1 ==== 77242+0+0 (secure 0 0 0) 0x7f68b001b030 con 0x7f68b8151d70 2023-07-27T14:39:13.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.863+0000 7f68ad7fa700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f689c05fba0 0x7f689c062060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:13.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.864+0000 7f68ad7fa700 1 -- 172.21.15.115:0/2562612988 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f68b007b6f0 con 0x7f68b8151d70 2023-07-27T14:39:13.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.864+0000 7f68bd59b700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f689c05fba0 0x7f689c062060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:13.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.864+0000 7f68bd59b700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f689c05fba0 0x7f689c062060 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f68b4006fd0 tx=0x7f68b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:13.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:13.867+0000 7f68ad7fa700 1 -- 172.21.15.115:0/2562612988 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f68b004bb80 con 0x7f68b8151d70 2023-07-27T14:39:14.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.038+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b806c470 con 0x7f68b8151d70 2023-07-27T14:39:14.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.039+0000 7f68ad7fa700 1 -- 172.21.15.115:0/2562612988 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+18660 (secure 0 0 0) 0x7f68b004f1a0 con 0x7f68b8151d70 2023-07-27T14:39:14.096 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:14.096 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":190,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:39:13.190502+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:38:51.766720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-27T14:38:53.161829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":27,"pool_name":"new_pool","create_time":"2023-07-27T14:39:12.349824+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:39:14.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.041+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f689c05fba0 msgr2=0x7f689c062060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.041+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f689c05fba0 0x7f689c062060 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f68b4006fd0 tx=0x7f68b4008040).stop 2023-07-27T14:39:14.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.041+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8151d70 msgr2=0x7f68b81508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.041+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8151d70 0x7f68b81508f0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f68b0009fa0 tx=0x7f68b0009900).stop 2023-07-27T14:39:14.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.042+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 shutdown_connections 2023-07-27T14:39:14.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.042+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f689c05fba0 0x7f689c062060 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.042+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f68b8151d70 0x7f68b81508f0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.042+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b8065ff0 0x7f68b814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.042+0000 7f68bf7ff700 1 --2- 172.21.15.115:0/2562612988 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68b8066960 0x7f68b8150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.042+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 >> 172.21.15.115:0/2562612988 conn(0x7f68b80c89a0 msgr2=0x7f68b8064f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:14.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.042+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 shutdown_connections 2023-07-27T14:39:14.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.042+0000 7f68bf7ff700 1 -- 172.21.15.115:0/2562612988 wait complete. 2023-07-27T14:39:14.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000883025 2023-07-27T14:39:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.253+0000 7f4e271ff700 1 Processor -- start 2023-07-27T14:39:14.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.254+0000 7f4e271ff700 1 -- start start 2023-07-27T14:39:14.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e271ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4e20063260 0x7f4e20154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e271ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4e2014b1e0 0x7f4e200a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e271ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e201553f0 con 0x7f4e2014ae00 2023-07-27T14:39:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e271ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e20157a50 con 0x7f4e20063260 2023-07-27T14:39:14.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e271ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e20157d10 con 0x7f4e2014b1e0 2023-07-27T14:39:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e1ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4e20063260 0x7f4e20154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e1ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4e20063260 0x7f4e20154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42960/0 (socket says 172.21.15.115:42960) 2023-07-27T14:39:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e1ffff700 1 -- 172.21.15.115:0/407321345 learned_addr learned my addr 172.21.15.115:0/407321345 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.255+0000 7f4e2579c700 1 --2- 172.21.15.115:0/407321345 >> v2:172.21.15.159:3300/0 conn(0x7f4e2014b1e0 0x7f4e200a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1ffff700 1 -- 172.21.15.115:0/407321345 >> v2:172.21.15.159:3300/0 conn(0x7f4e2014b1e0 msgr2=0x7f4e200a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1ffff700 1 --2- 172.21.15.115:0/407321345 >> v2:172.21.15.159:3300/0 conn(0x7f4e2014b1e0 0x7f4e200a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1ffff700 1 -- 172.21.15.115:0/407321345 >> v1:172.21.15.115:6789/0 conn(0x7f4e2014ae00 legacy=0x7f4e20062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1ffff700 1 -- 172.21.15.115:0/407321345 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20157ff0 con 0x7f4e20063260 2023-07-27T14:39:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1f7fe700 1 -- 172.21.15.115:0/407321345 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941006927 0 0) 0x7f4e201553f0 con 0x7f4e2014ae00 2023-07-27T14:39:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1ffff700 1 --2- 172.21.15.115:0/407321345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e20063260 0x7f4e20154f00 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f4e20083430 tx=0x7f4e0c0090f0).ready entity=mon.0 client_cookie=da467d572a87722e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1f7fe700 1 -- 172.21.15.115:0/407321345 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00b600 con 0x7f4e20063260 2023-07-27T14:39:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1f7fe700 1 -- 172.21.15.115:0/407321345 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c00b760 con 0x7f4e20063260 2023-07-27T14:39:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e1f7fe700 1 -- 172.21.15.115:0/407321345 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00bae0 con 0x7f4e20063260 2023-07-27T14:39:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e271ff700 1 -- 172.21.15.115:0/407321345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e20063260 msgr2=0x7f4e20154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.256+0000 7f4e271ff700 1 --2- 172.21.15.115:0/407321345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e20063260 0x7f4e20154f00 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f4e20083430 tx=0x7f4e0c0090f0).stop 2023-07-27T14:39:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.257+0000 7f4e271ff700 1 -- 172.21.15.115:0/407321345 shutdown_connections 2023-07-27T14:39:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.257+0000 7f4e271ff700 1 --2- 172.21.15.115:0/407321345 >> v2:172.21.15.159:3300/0 conn(0x7f4e2014b1e0 0x7f4e200a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.257+0000 7f4e271ff700 1 --2- 172.21.15.115:0/407321345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e20063260 0x7f4e20154f00 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.257+0000 7f4e271ff700 1 -- 172.21.15.115:0/407321345 >> 172.21.15.115:0/407321345 conn(0x7f4e2005e940 msgr2=0x7f4e200cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.257+0000 7f4e271ff700 1 -- 172.21.15.115:0/407321345 shutdown_connections 2023-07-27T14:39:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.257+0000 7f4e271ff700 1 -- 172.21.15.115:0/407321345 wait complete. 2023-07-27T14:39:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.258+0000 7f4e271ff700 1 Processor -- start 2023-07-27T14:39:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.258+0000 7f4e271ff700 1 -- start start 2023-07-27T14:39:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.259+0000 7f4e271ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e20063260 0x7f4e2013d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.259+0000 7f4e271ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2014ae00 0x7f4e200c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.259+0000 7f4e271ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e2014b1e0 0x7f4e200c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.259+0000 7f4e271ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200c1fa0 con 0x7f4e2014ae00 2023-07-27T14:39:14.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.259+0000 7f4e271ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200ae810 con 0x7f4e2014b1e0 2023-07-27T14:39:14.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.259+0000 7f4e271ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200c51a0 con 0x7f4e20063260 2023-07-27T14:39:14.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.259+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2014ae00 0x7f4e200c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2014ae00 0x7f4e200c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42976/0 (socket says 172.21.15.115:42976) 2023-07-27T14:39:14.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1ffff700 1 -- 172.21.15.115:0/1223176774 learned_addr learned my addr 172.21.15.115:0/1223176774 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:14.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e24f9b700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e20063260 0x7f4e2013d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e2579c700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e2014b1e0 0x7f4e200c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1ffff700 1 -- 172.21.15.115:0/1223176774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e20063260 msgr2=0x7f4e2013d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1ffff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e20063260 0x7f4e2013d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1ffff700 1 -- 172.21.15.115:0/1223176774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e2014b1e0 msgr2=0x7f4e200c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1ffff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e2014b1e0 0x7f4e200c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1ffff700 1 -- 172.21.15.115:0/1223176774 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c009370 con 0x7f4e2014ae00 2023-07-27T14:39:14.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1ffff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2014ae00 0x7f4e200c4340 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f4e0c011000 tx=0x7f4e0c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:14.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1cff9700 1 -- 172.21.15.115:0/1223176774 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00b8d0 con 0x7f4e2014ae00 2023-07-27T14:39:14.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1cff9700 1 -- 172.21.15.115:0/1223176774 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c00ba30 con 0x7f4e2014ae00 2023-07-27T14:39:14.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e200c4ec0 con 0x7f4e2014ae00 2023-07-27T14:39:14.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e1cff9700 1 -- 172.21.15.115:0/1223176774 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c01c630 con 0x7f4e2014ae00 2023-07-27T14:39:14.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.260+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e200ae4a0 con 0x7f4e2014ae00 2023-07-27T14:39:14.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.261+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e200ae9a0 con 0x7f4e2014ae00 2023-07-27T14:39:14.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.262+0000 7f4e1cff9700 1 -- 172.21.15.115:0/1223176774 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 34) v1 ==== 77242+0+0 (secure 0 0 0) 0x7f4e0c00f070 con 0x7f4e2014ae00 2023-07-27T14:39:14.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.263+0000 7f4e1cff9700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e0405fba0 0x7f4e04062060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.263+0000 7f4e1cff9700 1 -- 172.21.15.115:0/1223176774 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f4e0c07ca90 con 0x7f4e2014ae00 2023-07-27T14:39:14.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.263+0000 7f4e24f9b700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e0405fba0 0x7f4e04062060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.264+0000 7f4e24f9b700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e0405fba0 0x7f4e04062060 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f4e140011e0 tx=0x7f4e14009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:14.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.267+0000 7f4e1cff9700 1 -- 172.21.15.115:0/1223176774 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e0c04cf80 con 0x7f4e2014ae00 2023-07-27T14:39:14.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.465+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e2006c470 con 0x7f4e0405fba0 2023-07-27T14:39:14.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.472+0000 7f4e1cff9700 1 -- 172.21.15.115:0/1223176774 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f4e2006c470 con 0x7f4e0405fba0 2023-07-27T14:39:14.525 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3 2023-07-27T14:39:14.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.473+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e0405fba0 msgr2=0x7f4e04062060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.473+0000 7f4e271ff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e0405fba0 0x7f4e04062060 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f4e140011e0 tx=0x7f4e14009040).stop 2023-07-27T14:39:14.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2014ae00 msgr2=0x7f4e200c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2014ae00 0x7f4e200c4340 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f4e0c011000 tx=0x7f4e0c017000).stop 2023-07-27T14:39:14.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 shutdown_connections 2023-07-27T14:39:14.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e0405fba0 0x7f4e04062060 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e2014b1e0 0x7f4e200c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e20063260 0x7f4e2013d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 --2- 172.21.15.115:0/1223176774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e2014ae00 0x7f4e200c4340 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 >> 172.21.15.115:0/1223176774 conn(0x7f4e2005e940 msgr2=0x7f4e201497d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:14.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 shutdown_connections 2023-07-27T14:39:14.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.474+0000 7f4e271ff700 1 -- 172.21.15.115:0/1223176774 wait complete. 2023-07-27T14:39:14.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:14.544 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v new_pool volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:14.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:14.623 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool_namespace -v '' volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:14.698 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000883025 snapshot_0000000001037341 clone_0000000000871247 2023-07-27T14:39:14.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.849+0000 7fb570fff700 1 Processor -- start 2023-07-27T14:39:14.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.849+0000 7fb570fff700 1 -- start start 2023-07-27T14:39:14.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.850+0000 7fb570fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb56c153ed0 0x7fb56c0bc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.850+0000 7fb570fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb56c0657f0 0x7fb56c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.850+0000 7fb570fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c0c2e80 0x7fb56c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.850+0000 7fb570fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56c065c50 con 0x7fb56c153ed0 2023-07-27T14:39:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.850+0000 7fb570fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56c065360 con 0x7fb56c0657f0 2023-07-27T14:39:14.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.850+0000 7fb570fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0bcbd0 con 0x7fb56c0c2e80 2023-07-27T14:39:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56a59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb56c153ed0 0x7fb56c0bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56a59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb56c153ed0 0x7fb56c0bc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42988/0 (socket says 172.21.15.115:42988) 2023-07-27T14:39:14.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56a59c700 1 -- 172.21.15.115:0/1106674191 learned_addr learned my addr 172.21.15.115:0/1106674191 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56ad9d700 1 --2- 172.21.15.115:0/1106674191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c0c2e80 0x7fb56c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb569d9b700 1 --2- 172.21.15.115:0/1106674191 >> v2:172.21.15.159:3300/0 conn(0x7fb56c0657f0 0x7fb56c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56a59c700 1 -- 172.21.15.115:0/1106674191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c0c2e80 msgr2=0x7fb56c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56a59c700 1 --2- 172.21.15.115:0/1106674191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c0c2e80 0x7fb56c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56a59c700 1 -- 172.21.15.115:0/1106674191 >> v2:172.21.15.159:3300/0 conn(0x7fb56c0657f0 msgr2=0x7fb56c1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56a59c700 1 --2- 172.21.15.115:0/1106674191 >> v2:172.21.15.159:3300/0 conn(0x7fb56c0657f0 0x7fb56c1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.851+0000 7fb56a59c700 1 -- 172.21.15.115:0/1106674191 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c064d30 con 0x7fb56c153ed0 2023-07-27T14:39:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb56a59c700 1 --2- 172.21.15.115:0/1106674191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c153ed0 0x7fb56c0bc350 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7fb56c0c1380 tx=0x7fb55c0090f0).ready entity=mon.0 client_cookie=887bfc95e61a1ce7 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb56959a700 1 -- 172.21.15.115:0/1106674191 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00f510 con 0x7fb56c153ed0 2023-07-27T14:39:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb56959a700 1 -- 172.21.15.115:0/1106674191 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c00f670 con 0x7fb56c153ed0 2023-07-27T14:39:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb56959a700 1 -- 172.21.15.115:0/1106674191 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00f9f0 con 0x7fb56c153ed0 2023-07-27T14:39:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb570fff700 1 -- 172.21.15.115:0/1106674191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c153ed0 msgr2=0x7fb56c0bc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb570fff700 1 --2- 172.21.15.115:0/1106674191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c153ed0 0x7fb56c0bc350 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7fb56c0c1380 tx=0x7fb55c0090f0).stop 2023-07-27T14:39:14.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb570fff700 1 -- 172.21.15.115:0/1106674191 shutdown_connections 2023-07-27T14:39:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb570fff700 1 --2- 172.21.15.115:0/1106674191 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c0c2e80 0x7fb56c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb570fff700 1 --2- 172.21.15.115:0/1106674191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c153ed0 0x7fb56c0bc350 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb570fff700 1 --2- 172.21.15.115:0/1106674191 >> v2:172.21.15.159:3300/0 conn(0x7fb56c0657f0 0x7fb56c1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb570fff700 1 -- 172.21.15.115:0/1106674191 >> 172.21.15.115:0/1106674191 conn(0x7fb56c062df0 msgr2=0x7fb56c0c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.852+0000 7fb570fff700 1 -- 172.21.15.115:0/1106674191 shutdown_connections 2023-07-27T14:39:14.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.853+0000 7fb570fff700 1 -- 172.21.15.115:0/1106674191 wait complete. 2023-07-27T14:39:14.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.854+0000 7fb570fff700 1 Processor -- start 2023-07-27T14:39:14.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.854+0000 7fb570fff700 1 -- start start 2023-07-27T14:39:14.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb570fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb56c0657f0 0x7fb56c0a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb570fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c0c2e80 0x7fb56c144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb570fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c153ed0 0x7fb56c0a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb570fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c144c80 con 0x7fb56c0c2e80 2023-07-27T14:39:14.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb570fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0a8ed0 con 0x7fb56c0657f0 2023-07-27T14:39:14.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb570fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0a82c0 con 0x7fb56c153ed0 2023-07-27T14:39:14.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb569d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c0c2e80 0x7fb56c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb569d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c0c2e80 0x7fb56c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42992/0 (socket says 172.21.15.115:42992) 2023-07-27T14:39:14.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.855+0000 7fb569d9b700 1 -- 172.21.15.115:0/1932472048 learned_addr learned my addr 172.21.15.115:0/1932472048 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:14.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb56a59c700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb56c0657f0 0x7fb56c0a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb56ad9d700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c153ed0 0x7fb56c0a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb569d9b700 1 -- 172.21.15.115:0/1932472048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c153ed0 msgr2=0x7fb56c0a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb569d9b700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c153ed0 0x7fb56c0a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb569d9b700 1 -- 172.21.15.115:0/1932472048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb56c0657f0 msgr2=0x7fb56c0a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:14.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb569d9b700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb56c0657f0 0x7fb56c0a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:14.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb569d9b700 1 -- 172.21.15.115:0/1932472048 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c009370 con 0x7fb56c0c2e80 2023-07-27T14:39:14.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb569d9b700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c0c2e80 0x7fb56c144790 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7fb56000e960 tx=0x7fb560009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:14.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb55a7fc700 1 -- 172.21.15.115:0/1932472048 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560012600 con 0x7fb56c0c2e80 2023-07-27T14:39:14.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb55a7fc700 1 -- 172.21.15.115:0/1932472048 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560012760 con 0x7fb56c0c2e80 2023-07-27T14:39:14.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb55a7fc700 1 -- 172.21.15.115:0/1932472048 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560012ae0 con 0x7fb56c0c2e80 2023-07-27T14:39:14.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c0a85a0 con 0x7fb56c0c2e80 2023-07-27T14:39:14.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.856+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56c0a8b60 con 0x7fb56c0c2e80 2023-07-27T14:39:14.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.858+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56c0a9060 con 0x7fb56c0c2e80 2023-07-27T14:39:14.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.858+0000 7fb55a7fc700 1 -- 172.21.15.115:0/1932472048 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 34) v1 ==== 77242+0+0 (secure 0 0 0) 0x7fb560022070 con 0x7fb56c0c2e80 2023-07-27T14:39:14.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.859+0000 7fb55a7fc700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb54c05fb70 0x7fb54c062030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:14.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.859+0000 7fb55a7fc700 1 -- 172.21.15.115:0/1932472048 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fb56007b510 con 0x7fb56c0c2e80 2023-07-27T14:39:14.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.859+0000 7fb56a59c700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb54c05fb70 0x7fb54c062030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:14.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.860+0000 7fb56a59c700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb54c05fb70 0x7fb54c062030 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fb55c009130 tx=0x7fb55c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:14.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:14.863+0000 7fb55a7fc700 1 -- 172.21.15.115:0/1932472048 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb56004bb10 con 0x7fb56c0c2e80 2023-07-27T14:39:15.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.071+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "snap_name": "snapshot_0000000001037341", "target_sub_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7fb56c0c7780 con 0x7fb54c05fb70 2023-07-27T14:39:15.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.142+0000 7fb55a7fc700 1 -- 172.21.15.115:0/1932472048 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb56c0c7780 con 0x7fb54c05fb70 2023-07-27T14:39:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.144+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb54c05fb70 msgr2=0x7fb54c062030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.144+0000 7fb570fff700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb54c05fb70 0x7fb54c062030 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7fb55c009130 tx=0x7fb55c017000).stop 2023-07-27T14:39:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.144+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c0c2e80 msgr2=0x7fb56c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.144+0000 7fb570fff700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c0c2e80 0x7fb56c144790 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7fb56000e960 tx=0x7fb560009060).stop 2023-07-27T14:39:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.145+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 shutdown_connections 2023-07-27T14:39:15.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.145+0000 7fb570fff700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb54c05fb70 0x7fb54c062030 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.145+0000 7fb570fff700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb56c153ed0 0x7fb56c0a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.145+0000 7fb570fff700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb56c0657f0 0x7fb56c0a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.145+0000 7fb570fff700 1 --2- 172.21.15.115:0/1932472048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb56c0c2e80 0x7fb56c144790 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.145+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 >> 172.21.15.115:0/1932472048 conn(0x7fb56c062df0 msgr2=0x7fb56c0642c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.145+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 shutdown_connections 2023-07-27T14:39:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.145+0000 7fb570fff700 1 -- 172.21.15.115:0/1932472048 wait complete. 2023-07-27T14:39:15.203 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.150+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.203 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.150+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.203 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.150+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.203 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.150+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.203 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.150+0000 7fa78911d700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.220 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:15.221 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.168+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.221 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.168+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.222 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.168+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.222 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.168+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.222 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:15.168+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:15.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.361+0000 7ff0af3ff700 1 Processor -- start 2023-07-27T14:39:15.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.361+0000 7ff0af3ff700 1 -- start start 2023-07-27T14:39:15.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.362+0000 7ff0af3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff0a8063260 0x7ff0a8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:15.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.362+0000 7ff0af3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:15.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.362+0000 7ff0af3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a81553f0 con 0x7ff0a814ae00 2023-07-27T14:39:15.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.362+0000 7ff0af3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a8157a50 con 0x7ff0a8063260 2023-07-27T14:39:15.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.362+0000 7ff0af3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8157d10 con 0x7ff0a814b1e0 2023-07-27T14:39:15.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ad99c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:15.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ad99c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:50752/0 (socket says 172.21.15.115:50752) 2023-07-27T14:39:15.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ad99c700 1 -- 172.21.15.115:0/94729805 learned_addr learned my addr 172.21.15.115:0/94729805 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:15.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ac99a700 1 --2- 172.21.15.115:0/94729805 >> v2:172.21.15.159:3300/0 conn(0x7ff0a8063260 0x7ff0a8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:15.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ad19b700 1 --1- 172.21.15.115:0/94729805 >> v1:172.21.15.159:6789/0 conn(0x7ff0a814ae00 0x7ff0a8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:50186/0 (socket says 172.21.15.115:50186) 2023-07-27T14:39:15.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ad99c700 1 -- 172.21.15.115:0/94729805 >> v2:172.21.15.159:3300/0 conn(0x7ff0a8063260 msgr2=0x7ff0a8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:15.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ad99c700 1 --2- 172.21.15.115:0/94729805 >> v2:172.21.15.159:3300/0 conn(0x7ff0a8063260 0x7ff0a8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ad99c700 1 -- 172.21.15.115:0/94729805 >> v1:172.21.15.159:6789/0 conn(0x7ff0a814ae00 legacy=0x7ff0a8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:15.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.363+0000 7ff0ad99c700 1 -- 172.21.15.115:0/94729805 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8157ff0 con 0x7ff0a814b1e0 2023-07-27T14:39:15.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff0ad99c700 1 --2- 172.21.15.115:0/94729805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80a98c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff0a0009f20 tx=0x7ff0a0009840).ready entity=mon.2 client_cookie=1f13781df2187433 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:15.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff09ffff700 1 -- 172.21.15.115:0/94729805 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000e070 con 0x7ff0a814b1e0 2023-07-27T14:39:15.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff09ffff700 1 -- 172.21.15.115:0/94729805 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a000b9d0 con 0x7ff0a814b1e0 2023-07-27T14:39:15.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff09ffff700 1 -- 172.21.15.115:0/94729805 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000bd50 con 0x7ff0a814b1e0 2023-07-27T14:39:15.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff0af3ff700 1 -- 172.21.15.115:0/94729805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 msgr2=0x7ff0a80a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:15.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/94729805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80a98c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff0a0009f20 tx=0x7ff0a0009840).stop 2023-07-27T14:39:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff0af3ff700 1 -- 172.21.15.115:0/94729805 shutdown_connections 2023-07-27T14:39:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/94729805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80a98c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/94729805 >> v2:172.21.15.159:3300/0 conn(0x7ff0a8063260 0x7ff0a8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.364+0000 7ff0af3ff700 1 -- 172.21.15.115:0/94729805 >> 172.21.15.115:0/94729805 conn(0x7ff0a805e940 msgr2=0x7ff0a80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:15.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.365+0000 7ff0af3ff700 1 -- 172.21.15.115:0/94729805 shutdown_connections 2023-07-27T14:39:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.365+0000 7ff0af3ff700 1 -- 172.21.15.115:0/94729805 wait complete. 2023-07-27T14:39:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.366+0000 7ff0af3ff700 1 Processor -- start 2023-07-27T14:39:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.366+0000 7ff0af3ff700 1 -- start start 2023-07-27T14:39:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0af3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a8063260 0x7ff0a80aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0af3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a814ae00 0x7ff0a80c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:15.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0af3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:15.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0af3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80c37c0 con 0x7ff0a8063260 2023-07-27T14:39:15.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0af3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8164370 con 0x7ff0a814ae00 2023-07-27T14:39:15.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0af3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8164080 con 0x7ff0a814b1e0 2023-07-27T14:39:15.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0ad19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a8063260 0x7ff0a80aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0ad19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a8063260 0x7ff0a80aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43042/0 (socket says 172.21.15.115:43042) 2023-07-27T14:39:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.367+0000 7ff0ad19b700 1 -- 172.21.15.115:0/108385775 learned_addr learned my addr 172.21.15.115:0/108385775 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ad99c700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ac99a700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a814ae00 0x7ff0a80c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:15.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ad19b700 1 -- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 msgr2=0x7ff0a80c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:15.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ad19b700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ad19b700 1 -- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a814ae00 msgr2=0x7ff0a80c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:15.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ad19b700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a814ae00 0x7ff0a80c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ad19b700 1 -- 172.21.15.115:0/108385775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a0009ae0 con 0x7ff0a8063260 2023-07-27T14:39:15.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ad99c700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:15.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ac99a700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a814ae00 0x7ff0a80c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:15.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0ad19b700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a8063260 0x7ff0a80aff00 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7ff0a4007fd0 tx=0x7ff0a4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:15.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff09d7fa700 1 -- 172.21.15.115:0/108385775 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40072e0 con 0x7ff0a8063260 2023-07-27T14:39:15.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff09d7fa700 1 -- 172.21.15.115:0/108385775 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4007440 con 0x7ff0a8063260 2023-07-27T14:39:15.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff09d7fa700 1 -- 172.21.15.115:0/108385775 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40058f0 con 0x7ff0a8063260 2023-07-27T14:39:15.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a80c2f20 con 0x7ff0a8063260 2023-07-27T14:39:15.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.368+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a80c34e0 con 0x7ff0a8063260 2023-07-27T14:39:15.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.369+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a80cb9f0 con 0x7ff0a8063260 2023-07-27T14:39:15.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.370+0000 7ff09d7fa700 1 -- 172.21.15.115:0/108385775 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 34) v1 ==== 77242+0+0 (secure 0 0 0) 0x7ff0a4010070 con 0x7ff0a8063260 2023-07-27T14:39:15.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.371+0000 7ff09d7fa700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08c05fba0 0x7ff08c062060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:15.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.371+0000 7ff09d7fa700 1 -- 172.21.15.115:0/108385775 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7ff0a407aa20 con 0x7ff0a8063260 2023-07-27T14:39:15.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.371+0000 7ff0ac99a700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08c05fba0 0x7ff08c062060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.372+0000 7ff0ac99a700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08c05fba0 0x7ff08c062060 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7ff0a80c3d30 tx=0x7ff098008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.375+0000 7ff09d7fa700 1 -- 172.21.15.115:0/108385775 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0a404af10 con 0x7ff0a8063260 2023-07-27T14:39:15.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.584+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a81644b0 con 0x7ff08c05fba0 2023-07-27T14:39:15.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.591+0000 7ff09d7fa700 1 -- 172.21.15.115:0/108385775 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7ff0980097a0 con 0x7ff08c05fba0 2023-07-27T14:39:15.644 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:15.644 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:15.644 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:39:15.645 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:15.645 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:15.645 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:15.645 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:15.645 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:15.645 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:15.645 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:15.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08c05fba0 msgr2=0x7ff08c062060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:15.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08c05fba0 0x7ff08c062060 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7ff0a80c3d30 tx=0x7ff098008040).stop 2023-07-27T14:39:15.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a8063260 msgr2=0x7ff0a80aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:15.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a8063260 0x7ff0a80aff00 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7ff0a4007fd0 tx=0x7ff0a4007df0).stop 2023-07-27T14:39:15.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 shutdown_connections 2023-07-27T14:39:15.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff08c05fba0 0x7ff08c062060 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0a814b1e0 0x7ff0a80c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0a8063260 0x7ff0a80aff00 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 --2- 172.21.15.115:0/108385775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0a814ae00 0x7ff0a80c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:15.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 >> 172.21.15.115:0/108385775 conn(0x7ff0a805e940 msgr2=0x7ff0a80c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:15.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 shutdown_connections 2023-07-27T14:39:15.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:15.593+0000 7ff0af3ff700 1 -- 172.21.15.115:0/108385775 wait complete. 2023-07-27T14:39:16.663 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:16.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.811+0000 7fc30bdff700 1 Processor -- start 2023-07-27T14:39:16.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.812+0000 7fc30bdff700 1 -- start start 2023-07-27T14:39:16.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc30bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3041509b0 0x7fc3040c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:16.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc30bdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc304150d90 0x7fc304154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:16.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc30bdff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040c0ea0 con 0x7fc3040c3100 2023-07-27T14:39:16.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc30bdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc304068e10 con 0x7fc304150d90 2023-07-27T14:39:16.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc30bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc304155190 con 0x7fc3041509b0 2023-07-27T14:39:16.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc30939a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc304150d90 0x7fc304154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:16.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc30939a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc304150d90 0x7fc304154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43050/0 (socket says 172.21.15.115:43050) 2023-07-27T14:39:16.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc30939a700 1 -- 172.21.15.115:0/2052928185 learned_addr learned my addr 172.21.15.115:0/2052928185 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:16.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.813+0000 7fc309b9b700 1 --2- 172.21.15.115:0/2052928185 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3041509b0 0x7fc3040c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:16.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc30939a700 1 -- 172.21.15.115:0/2052928185 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3041509b0 msgr2=0x7fc3040c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:16.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc30939a700 1 --2- 172.21.15.115:0/2052928185 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3041509b0 0x7fc3040c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:16.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc30939a700 1 -- 172.21.15.115:0/2052928185 >> v1:172.21.15.159:6789/0 conn(0x7fc3040c3100 legacy=0x7fc3040c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:16.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc30939a700 1 -- 172.21.15.115:0/2052928185 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304155470 con 0x7fc304150d90 2023-07-27T14:39:16.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc30939a700 1 --2- 172.21.15.115:0/2052928185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc304150d90 0x7fc304154940 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7fc2f4006fd0 tx=0x7fc2f40090f0).ready entity=mon.0 client_cookie=c97e13d3c29a54ce server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:16.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc308b99700 1 -- 172.21.15.115:0/2052928185 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400b600 con 0x7fc304150d90 2023-07-27T14:39:16.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc308b99700 1 -- 172.21.15.115:0/2052928185 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400b760 con 0x7fc304150d90 2023-07-27T14:39:16.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc308b99700 1 -- 172.21.15.115:0/2052928185 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400bae0 con 0x7fc304150d90 2023-07-27T14:39:16.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc30bdff700 1 -- 172.21.15.115:0/2052928185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc304150d90 msgr2=0x7fc304154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:16.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.814+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2052928185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc304150d90 0x7fc304154940 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7fc2f4006fd0 tx=0x7fc2f40090f0).stop 2023-07-27T14:39:16.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.815+0000 7fc30bdff700 1 -- 172.21.15.115:0/2052928185 shutdown_connections 2023-07-27T14:39:16.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.815+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2052928185 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3041509b0 0x7fc3040c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:16.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.815+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2052928185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc304150d90 0x7fc304154940 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:16.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.815+0000 7fc30bdff700 1 -- 172.21.15.115:0/2052928185 >> 172.21.15.115:0/2052928185 conn(0x7fc304062320 msgr2=0x7fc304062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:16.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.815+0000 7fc30bdff700 1 -- 172.21.15.115:0/2052928185 shutdown_connections 2023-07-27T14:39:16.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.815+0000 7fc30bdff700 1 -- 172.21.15.115:0/2052928185 wait complete. 2023-07-27T14:39:16.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.816+0000 7fc30bdff700 1 Processor -- start 2023-07-27T14:39:16.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.816+0000 7fc30bdff700 1 -- start start 2023-07-27T14:39:16.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3040c3100 0x7fc3040a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:16.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30bdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3041509b0 0x7fc3040c1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:16.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30bdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc304150d90 0x7fc3040c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:16.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30bdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040ac960 con 0x7fc3041509b0 2023-07-27T14:39:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30bdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040c21f0 con 0x7fc304150d90 2023-07-27T14:39:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30414ff90 con 0x7fc3040c3100 2023-07-27T14:39:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30939a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3041509b0 0x7fc3040c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30939a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3041509b0 0x7fc3040c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43056/0 (socket says 172.21.15.115:43056) 2023-07-27T14:39:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.817+0000 7fc30939a700 1 -- 172.21.15.115:0/2344440688 learned_addr learned my addr 172.21.15.115:0/2344440688 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc309b9b700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3040c3100 0x7fc3040a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:16.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30a39c700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc304150d90 0x7fc3040c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:16.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30939a700 1 -- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3040c3100 msgr2=0x7fc3040a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:16.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30939a700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3040c3100 0x7fc3040a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:16.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30939a700 1 -- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc304150d90 msgr2=0x7fc3040c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:16.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30939a700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc304150d90 0x7fc3040c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:16.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30939a700 1 -- 172.21.15.115:0/2344440688 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4009370 con 0x7fc3041509b0 2023-07-27T14:39:16.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30a39c700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc304150d90 0x7fc3040c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:16.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30939a700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3041509b0 0x7fc3040c1810 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7fc2f4011000 tx=0x7fc2f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:16.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc2f9ffb700 1 -- 172.21.15.115:0/2344440688 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400bae0 con 0x7fc3041509b0 2023-07-27T14:39:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc2f9ffb700 1 -- 172.21.15.115:0/2344440688 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4006a40 con 0x7fc3041509b0 2023-07-27T14:39:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc2f9ffb700 1 -- 172.21.15.115:0/2344440688 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f401c670 con 0x7fc3041509b0 2023-07-27T14:39:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3040bea10 con 0x7fc3041509b0 2023-07-27T14:39:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.818+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3040be3c0 con 0x7fc3041509b0 2023-07-27T14:39:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.819+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30406c470 con 0x7fc3041509b0 2023-07-27T14:39:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.820+0000 7fc2f9ffb700 1 -- 172.21.15.115:0/2344440688 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7fc2f400f070 con 0x7fc3041509b0 2023-07-27T14:39:16.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.821+0000 7fc2f9ffb700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc2e805fc30 0x7fc2e80620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.821+0000 7fc2f9ffb700 1 -- 172.21.15.115:0/2344440688 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fc2f407cc00 con 0x7fc3041509b0 2023-07-27T14:39:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.821+0000 7fc309b9b700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc2e805fc30 0x7fc2e80620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:16.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.822+0000 7fc309b9b700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc2e805fc30 0x7fc2e80620f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fc30000bb20 tx=0x7fc300008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:16.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:16.825+0000 7fc2f9ffb700 1 -- 172.21.15.115:0/2344440688 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc2f404d060 con 0x7fc3041509b0 2023-07-27T14:39:17.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.035+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7fc304155750 con 0x7fc2e805fc30 2023-07-27T14:39:17.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.041+0000 7fc2f9ffb700 1 -- 172.21.15.115:0/2344440688 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7fc304155750 con 0x7fc2e805fc30 2023-07-27T14:39:17.095 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:17.095 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:17.095 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:39:17.096 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:17.096 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:17.096 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:17.096 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:17.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:17.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:17.097 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:17.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.043+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc2e805fc30 msgr2=0x7fc2e80620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.043+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc2e805fc30 0x7fc2e80620f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7fc30000bb20 tx=0x7fc300008040).stop 2023-07-27T14:39:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3041509b0 msgr2=0x7fc3040c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3041509b0 0x7fc3040c1810 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7fc2f4011000 tx=0x7fc2f4017000).stop 2023-07-27T14:39:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 shutdown_connections 2023-07-27T14:39:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc2e805fc30 0x7fc2e80620f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:17.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc304150d90 0x7fc3040c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:17.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3040c3100 0x7fc3040a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:17.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 --2- 172.21.15.115:0/2344440688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3041509b0 0x7fc3040c1810 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:17.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 >> 172.21.15.115:0/2344440688 conn(0x7fc304062320 msgr2=0x7fc3040c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:17.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 shutdown_connections 2023-07-27T14:39:17.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:17.044+0000 7fc30bdff700 1 -- 172.21.15.115:0/2344440688 wait complete. 2023-07-27T14:39:18.114 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:18.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.270+0000 7f69f83ff700 1 Processor -- start 2023-07-27T14:39:18.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.270+0000 7f69f83ff700 1 -- start start 2023-07-27T14:39:18.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.271+0000 7f69f83ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f69f014ae00 0x7f69f0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:18.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.271+0000 7f69f83ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69f0063260 0x7f69f00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:18.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.271+0000 7f69f83ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f01553f0 con 0x7f69f014b1e0 2023-07-27T14:39:18.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.271+0000 7f69f83ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f0157a50 con 0x7f69f0063260 2023-07-27T14:39:18.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.271+0000 7f69f83ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f0157d10 con 0x7f69f014ae00 2023-07-27T14:39:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f699c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69f0063260 0x7f69f00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f699c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69f0063260 0x7f69f00a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43070/0 (socket says 172.21.15.115:43070) 2023-07-27T14:39:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f699c700 1 -- 172.21.15.115:0/2451473065 learned_addr learned my addr 172.21.15.115:0/2451473065 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f619b700 1 --2- 172.21.15.115:0/2451473065 >> v2:172.21.15.159:3300/0 conn(0x7f69f014ae00 0x7f69f0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f699c700 1 -- 172.21.15.115:0/2451473065 >> v2:172.21.15.159:3300/0 conn(0x7f69f014ae00 msgr2=0x7f69f0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f699c700 1 --2- 172.21.15.115:0/2451473065 >> v2:172.21.15.159:3300/0 conn(0x7f69f014ae00 0x7f69f0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f699c700 1 -- 172.21.15.115:0/2451473065 >> v1:172.21.15.115:6789/0 conn(0x7f69f014b1e0 legacy=0x7f69f0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:18.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f5199700 1 -- 172.21.15.115:0/2451473065 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587785377 0 0) 0x7f69f01553f0 con 0x7f69f014b1e0 2023-07-27T14:39:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f699c700 1 -- 172.21.15.115:0/2451473065 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0157ff0 con 0x7f69f0063260 2023-07-27T14:39:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f619b700 1 --2- 172.21.15.115:0/2451473065 >> v2:172.21.15.159:3300/0 conn(0x7f69f014ae00 0x7f69f0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.272+0000 7f69f699c700 1 --2- 172.21.15.115:0/2451473065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f0063260 0x7f69f00a98c0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f69f00caaf0 tx=0x7f69e8009840).ready entity=mon.0 client_cookie=162be1485cf790da server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f5199700 1 -- 172.21.15.115:0/2451473065 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800e070 con 0x7f69f0063260 2023-07-27T14:39:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f5199700 1 -- 172.21.15.115:0/2451473065 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800ba50 con 0x7f69f0063260 2023-07-27T14:39:18.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f5199700 1 -- 172.21.15.115:0/2451473065 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800bdd0 con 0x7f69f0063260 2023-07-27T14:39:18.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f83ff700 1 -- 172.21.15.115:0/2451473065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f0063260 msgr2=0x7f69f00a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f83ff700 1 --2- 172.21.15.115:0/2451473065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f0063260 0x7f69f00a98c0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f69f00caaf0 tx=0x7f69e8009840).stop 2023-07-27T14:39:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f83ff700 1 -- 172.21.15.115:0/2451473065 shutdown_connections 2023-07-27T14:39:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f83ff700 1 --2- 172.21.15.115:0/2451473065 >> v2:172.21.15.159:3300/0 conn(0x7f69f014ae00 0x7f69f0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f83ff700 1 --2- 172.21.15.115:0/2451473065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f0063260 0x7f69f00a98c0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f83ff700 1 -- 172.21.15.115:0/2451473065 >> 172.21.15.115:0/2451473065 conn(0x7f69f005e940 msgr2=0x7f69f00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:18.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f83ff700 1 -- 172.21.15.115:0/2451473065 shutdown_connections 2023-07-27T14:39:18.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.273+0000 7f69f83ff700 1 -- 172.21.15.115:0/2451473065 wait complete. 2023-07-27T14:39:18.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.275+0000 7f69f83ff700 1 Processor -- start 2023-07-27T14:39:18.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.275+0000 7f69f83ff700 1 -- start start 2023-07-27T14:39:18.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f83ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f0063260 0x7f69f014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:18.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f83ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f014ae00 0x7f69f014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f83ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69f014b1e0 0x7f69f00c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f83ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00c20e0 con 0x7f69f014ae00 2023-07-27T14:39:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f83ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00c23c0 con 0x7f69f0063260 2023-07-27T14:39:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f83ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00c26a0 con 0x7f69f014b1e0 2023-07-27T14:39:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f599a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f014ae00 0x7f69f014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f599a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f014ae00 0x7f69f014f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43076/0 (socket says 172.21.15.115:43076) 2023-07-27T14:39:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f599a700 1 -- 172.21.15.115:0/783528043 learned_addr learned my addr 172.21.15.115:0/783528043 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:18.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f699c700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69f014b1e0 0x7f69f00c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.276+0000 7f69f619b700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f0063260 0x7f69f014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69f599a700 1 -- 172.21.15.115:0/783528043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69f014b1e0 msgr2=0x7f69f00c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69f599a700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69f014b1e0 0x7f69f00c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69f599a700 1 -- 172.21.15.115:0/783528043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f0063260 msgr2=0x7f69f014a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69f599a700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f0063260 0x7f69f014a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69f599a700 1 -- 172.21.15.115:0/783528043 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8009ae0 con 0x7f69f014ae00 2023-07-27T14:39:18.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69f599a700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f014ae00 0x7f69f014f730 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f69e000c490 tx=0x7f69e0007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69e67fc700 1 -- 172.21.15.115:0/783528043 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0001ea0 con 0x7f69f014ae00 2023-07-27T14:39:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69e67fc700 1 -- 172.21.15.115:0/783528043 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0007020 con 0x7f69f014ae00 2023-07-27T14:39:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f0150140 con 0x7f69f014ae00 2023-07-27T14:39:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69e67fc700 1 -- 172.21.15.115:0/783528043 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00073c0 con 0x7f69f014ae00 2023-07-27T14:39:18.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.277+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f014aac0 con 0x7f69f014ae00 2023-07-27T14:39:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.278+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f006c470 con 0x7f69f014ae00 2023-07-27T14:39:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.279+0000 7f69e67fc700 1 -- 172.21.15.115:0/783528043 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f69e0010070 con 0x7f69f014ae00 2023-07-27T14:39:18.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.280+0000 7f69e67fc700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69d405fc30 0x7f69d40620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:18.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.280+0000 7f69e67fc700 1 -- 172.21.15.115:0/783528043 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f69e007ad50 con 0x7f69f014ae00 2023-07-27T14:39:18.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.280+0000 7f69f619b700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69d405fc30 0x7f69d40620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:18.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.280+0000 7f69f619b700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69d405fc30 0x7f69d40620f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f69ec00abd0 tx=0x7f69ec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:18.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.284+0000 7f69e67fc700 1 -- 172.21.15.115:0/783528043 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f69e004b1b0 con 0x7f69f014ae00 2023-07-27T14:39:18.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.492+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f69f00c10f0 con 0x7f69d405fc30 2023-07-27T14:39:18.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.502+0000 7f69e67fc700 1 -- 172.21.15.115:0/783528043 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f69f00c10f0 con 0x7f69d405fc30 2023-07-27T14:39:18.555 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:18.556 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:18.556 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:18.556 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:18.556 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:18.556 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:18.557 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:18.557 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:18.557 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:18.557 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:18.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69d405fc30 msgr2=0x7f69d40620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:18.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69d405fc30 0x7f69d40620f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f69ec00abd0 tx=0x7f69ec008040).stop 2023-07-27T14:39:18.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f014ae00 msgr2=0x7f69f014f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:18.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f014ae00 0x7f69f014f730 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f69e000c490 tx=0x7f69e0007dd0).stop 2023-07-27T14:39:18.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 shutdown_connections 2023-07-27T14:39:18.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f69d405fc30 0x7f69d40620f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f69f014b1e0 0x7f69f00c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f0063260 0x7f69f014a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 --2- 172.21.15.115:0/783528043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69f014ae00 0x7f69f014f730 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:18.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 >> 172.21.15.115:0/783528043 conn(0x7f69f005e940 msgr2=0x7f69f0152030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:18.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 shutdown_connections 2023-07-27T14:39:18.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:18.504+0000 7f69f83ff700 1 -- 172.21.15.115:0/783528043 wait complete. 2023-07-27T14:39:19.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:19.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.720+0000 7fd9721ff700 1 Processor -- start 2023-07-27T14:39:19.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.720+0000 7fd9721ff700 1 -- start start 2023-07-27T14:39:19.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.721+0000 7fd9721ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd96c063260 0x7fd96c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:19.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.721+0000 7fd9721ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd96c14b1e0 0x7fd96c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:19.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.721+0000 7fd9721ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c1553f0 con 0x7fd96c14ae00 2023-07-27T14:39:19.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.721+0000 7fd9721ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c157a50 con 0x7fd96c063260 2023-07-27T14:39:19.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.721+0000 7fd9721ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c157d10 con 0x7fd96c14b1e0 2023-07-27T14:39:19.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.721+0000 7fd96affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd96c063260 0x7fd96c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:19.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd96c063260 0x7fd96c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43090/0 (socket says 172.21.15.115:43090) 2023-07-27T14:39:19.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96affd700 1 -- 172.21.15.115:0/641509905 learned_addr learned my addr 172.21.15.115:0/641509905 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:19.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96bfff700 1 --2- 172.21.15.115:0/641509905 >> v2:172.21.15.159:3300/0 conn(0x7fd96c14b1e0 0x7fd96c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:19.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96affd700 1 -- 172.21.15.115:0/641509905 >> v2:172.21.15.159:3300/0 conn(0x7fd96c14b1e0 msgr2=0x7fd96c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:19.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96affd700 1 --2- 172.21.15.115:0/641509905 >> v2:172.21.15.159:3300/0 conn(0x7fd96c14b1e0 0x7fd96c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:19.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96affd700 1 -- 172.21.15.115:0/641509905 >> v1:172.21.15.115:6789/0 conn(0x7fd96c14ae00 legacy=0x7fd96c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:19.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96affd700 1 -- 172.21.15.115:0/641509905 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c157ff0 con 0x7fd96c063260 2023-07-27T14:39:19.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96a7fc700 1 -- 172.21.15.115:0/641509905 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996744702 0 0) 0x7fd96c1553f0 con 0x7fd96c14ae00 2023-07-27T14:39:19.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96affd700 1 --2- 172.21.15.115:0/641509905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c154f00 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7fd96c083430 tx=0x7fd9600090f0).ready entity=mon.0 client_cookie=8ede6d629e476410 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96a7fc700 1 -- 172.21.15.115:0/641509905 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000b600 con 0x7fd96c063260 2023-07-27T14:39:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96a7fc700 1 -- 172.21.15.115:0/641509905 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000b760 con 0x7fd96c063260 2023-07-27T14:39:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.722+0000 7fd96a7fc700 1 -- 172.21.15.115:0/641509905 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000bae0 con 0x7fd96c063260 2023-07-27T14:39:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.723+0000 7fd9721ff700 1 -- 172.21.15.115:0/641509905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 msgr2=0x7fd96c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.723+0000 7fd9721ff700 1 --2- 172.21.15.115:0/641509905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c154f00 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7fd96c083430 tx=0x7fd9600090f0).stop 2023-07-27T14:39:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.723+0000 7fd9721ff700 1 -- 172.21.15.115:0/641509905 shutdown_connections 2023-07-27T14:39:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.723+0000 7fd9721ff700 1 --2- 172.21.15.115:0/641509905 >> v2:172.21.15.159:3300/0 conn(0x7fd96c14b1e0 0x7fd96c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.723+0000 7fd9721ff700 1 --2- 172.21.15.115:0/641509905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c154f00 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.723+0000 7fd9721ff700 1 -- 172.21.15.115:0/641509905 >> 172.21.15.115:0/641509905 conn(0x7fd96c05e940 msgr2=0x7fd96c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.723+0000 7fd9721ff700 1 -- 172.21.15.115:0/641509905 shutdown_connections 2023-07-27T14:39:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.723+0000 7fd9721ff700 1 -- 172.21.15.115:0/641509905 wait complete. 2023-07-27T14:39:19.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.724+0000 7fd9721ff700 1 Processor -- start 2023-07-27T14:39:19.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.725+0000 7fd9721ff700 1 -- start start 2023-07-27T14:39:19.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd9721ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:19.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd9721ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd96c14ae00 0x7fd96c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:19.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd9721ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd96c14b1e0 0x7fd96c0c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:19.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd9721ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0c1fa0 con 0x7fd96c063260 2023-07-27T14:39:19.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd9721ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0ae810 con 0x7fd96c14b1e0 2023-07-27T14:39:19.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd9721ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0c51a0 con 0x7fd96c14ae00 2023-07-27T14:39:19.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:19.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c13d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43098/0 (socket says 172.21.15.115:43098) 2023-07-27T14:39:19.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 -- 172.21.15.115:0/295026908 learned_addr learned my addr 172.21.15.115:0/295026908 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:19.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96affd700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd96c14ae00 0x7fd96c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:19.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96bfff700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd96c14b1e0 0x7fd96c0c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:19.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 -- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd96c14ae00 msgr2=0x7fd96c0c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:19.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd96c14ae00 0x7fd96c0c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:19.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 -- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd96c14b1e0 msgr2=0x7fd96c0c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:19.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd96c14b1e0 0x7fd96c0c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:19.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 -- 172.21.15.115:0/295026908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960009370 con 0x7fd96c063260 2023-07-27T14:39:19.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96bfff700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd96c14b1e0 0x7fd96c0c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:19.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.726+0000 7fd96b7fe700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c13d3e0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7fd95c001eb0 tx=0x7fd95c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:19.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.727+0000 7fd9537fe700 1 -- 172.21.15.115:0/295026908 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00f470 con 0x7fd96c063260 2023-07-27T14:39:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.727+0000 7fd9537fe700 1 -- 172.21.15.115:0/295026908 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c00f5f0 con 0x7fd96c063260 2023-07-27T14:39:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.727+0000 7fd9537fe700 1 -- 172.21.15.115:0/295026908 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00f9b0 con 0x7fd96c063260 2023-07-27T14:39:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.727+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c0c4ec0 con 0x7fd96c063260 2023-07-27T14:39:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.727+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c0ae4a0 con 0x7fd96c063260 2023-07-27T14:39:19.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.728+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c0aeaf0 con 0x7fd96c063260 2023-07-27T14:39:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.729+0000 7fd9537fe700 1 -- 172.21.15.115:0/295026908 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7fd95c019030 con 0x7fd96c063260 2023-07-27T14:39:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.729+0000 7fd9537fe700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd95805fc30 0x7fd9580620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.729+0000 7fd9537fe700 1 -- 172.21.15.115:0/295026908 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fd95c07a8c0 con 0x7fd96c063260 2023-07-27T14:39:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.730+0000 7fd96affd700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd95805fc30 0x7fd9580620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:19.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.730+0000 7fd96affd700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd95805fc30 0x7fd9580620f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fd96c063660 tx=0x7fd960017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:19.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.733+0000 7fd9537fe700 1 -- 172.21.15.115:0/295026908 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd95c04ae30 con 0x7fd96c063260 2023-07-27T14:39:20.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.947+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7fd96c06c470 con 0x7fd95805fc30 2023-07-27T14:39:20.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.954+0000 7fd9537fe700 1 -- 172.21.15.115:0/295026908 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fd96c06c470 con 0x7fd95805fc30 2023-07-27T14:39:20.014 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:20.014 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:20.015 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:20.015 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:20.015 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:20.015 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:20.015 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:20.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:20.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:20.016 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:20.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd95805fc30 msgr2=0x7fd9580620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:20.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd95805fc30 0x7fd9580620f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fd96c063660 tx=0x7fd960017000).stop 2023-07-27T14:39:20.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 msgr2=0x7fd96c13d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:20.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c13d3e0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7fd95c001eb0 tx=0x7fd95c007c70).stop 2023-07-27T14:39:20.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 shutdown_connections 2023-07-27T14:39:20.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd95805fc30 0x7fd9580620f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:20.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd96c14b1e0 0x7fd96c0c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:20.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd96c063260 0x7fd96c13d3e0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:20.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 --2- 172.21.15.115:0/295026908 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd96c14ae00 0x7fd96c0c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:20.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 >> 172.21.15.115:0/295026908 conn(0x7fd96c05e940 msgr2=0x7fd96c1497d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:20.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 shutdown_connections 2023-07-27T14:39:20.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:19.956+0000 7fd9721ff700 1 -- 172.21.15.115:0/295026908 wait complete. 2023-07-27T14:39:21.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:21.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.176+0000 7fdd6f3ff700 1 Processor -- start 2023-07-27T14:39:21.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.176+0000 7fdd6f3ff700 1 -- start start 2023-07-27T14:39:21.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.177+0000 7fdd6f3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd680c58d0 0x7fdd68150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:21.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.177+0000 7fdd6f3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd680c0ea0 con 0x7fdd680c3100 2023-07-27T14:39:21.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.177+0000 7fdd6f3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd68068e10 con 0x7fdd681509b0 2023-07-27T14:39:21.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.177+0000 7fdd6f3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd68151280 con 0x7fdd680c58d0 2023-07-27T14:39:21.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd6c99a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd680c58d0 0x7fdd68150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:21.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd6d99c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdd680c3100 0x7fdd680c3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55706/0 (socket says 172.21.15.115:55706) 2023-07-27T14:39:21.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd6d99c700 1 -- 172.21.15.115:0/3462084739 learned_addr learned my addr 172.21.15.115:0/3462084739 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:21.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd6c99a700 1 --2- 172.21.15.115:0/3462084739 >> v2:172.21.15.115:3300/0 conn(0x7fdd680c58d0 0x7fdd68150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43106/0 (socket says 172.21.15.115:43106) 2023-07-27T14:39:21.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd6c99a700 1 -- 172.21.15.115:0/3462084739 >> v1:172.21.15.159:6789/0 conn(0x7fdd681509b0 legacy=0x7fdd68154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:21.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd6c99a700 1 -- 172.21.15.115:0/3462084739 >> v1:172.21.15.115:6789/0 conn(0x7fdd680c3100 legacy=0x7fdd680c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:21.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd6c99a700 1 -- 172.21.15.115:0/3462084739 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68155190 con 0x7fdd680c58d0 2023-07-27T14:39:21.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd5ffff700 1 -- 172.21.15.115:0/3462084739 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322325613 0 0) 0x7fdd680c0ea0 con 0x7fdd680c3100 2023-07-27T14:39:21.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.178+0000 7fdd6c99a700 1 --2- 172.21.15.115:0/3462084739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd68150d90 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7fdd58009760 tx=0x7fdd58009060).ready entity=mon.0 client_cookie=afa70f7dc33ab5ca server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:21.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd5ffff700 1 -- 172.21.15.115:0/3462084739 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800b580 con 0x7fdd680c58d0 2023-07-27T14:39:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd5ffff700 1 -- 172.21.15.115:0/3462084739 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5800b6e0 con 0x7fdd680c58d0 2023-07-27T14:39:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd5ffff700 1 -- 172.21.15.115:0/3462084739 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800ba60 con 0x7fdd680c58d0 2023-07-27T14:39:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/3462084739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 msgr2=0x7fdd68150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:21.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd6f3ff700 1 --2- 172.21.15.115:0/3462084739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd68150d90 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7fdd58009760 tx=0x7fdd58009060).stop 2023-07-27T14:39:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/3462084739 shutdown_connections 2023-07-27T14:39:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd6f3ff700 1 --2- 172.21.15.115:0/3462084739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd68150d90 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/3462084739 >> 172.21.15.115:0/3462084739 conn(0x7fdd68062320 msgr2=0x7fdd68062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:21.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/3462084739 shutdown_connections 2023-07-27T14:39:21.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.179+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/3462084739 wait complete. 2023-07-27T14:39:21.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.181+0000 7fdd6f3ff700 1 Processor -- start 2023-07-27T14:39:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.181+0000 7fdd6f3ff700 1 -- start start 2023-07-27T14:39:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6f3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd680c3100 0x7fdd68164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6f3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd680bc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6f3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd681509b0 0x7fdd680c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6f3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6814b1a0 con 0x7fdd680c58d0 2023-07-27T14:39:21.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6f3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6806a190 con 0x7fdd681509b0 2023-07-27T14:39:21.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6f3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68150040 con 0x7fdd680c3100 2023-07-27T14:39:21.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6c99a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd680bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:21.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6c99a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd680bc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43110/0 (socket says 172.21.15.115:43110) 2023-07-27T14:39:21.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6c99a700 1 -- 172.21.15.115:0/1905370951 learned_addr learned my addr 172.21.15.115:0/1905370951 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:21.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6d99c700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd681509b0 0x7fdd680c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:21.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.182+0000 7fdd6d19b700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd680c3100 0x7fdd68164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:21.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6c99a700 1 -- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd680c3100 msgr2=0x7fdd68164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6c99a700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd680c3100 0x7fdd68164f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6c99a700 1 -- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd681509b0 msgr2=0x7fdd680c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6c99a700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd681509b0 0x7fdd680c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6c99a700 1 -- 172.21.15.115:0/1905370951 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd580092a0 con 0x7fdd680c58d0 2023-07-27T14:39:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6d19b700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd680c3100 0x7fdd68164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6c99a700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd680bc490 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7fdd58009eb0 tx=0x7fdd58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd5d7fa700 1 -- 172.21.15.115:0/1905370951 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800ba60 con 0x7fdd680c58d0 2023-07-27T14:39:21.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd5d7fa700 1 -- 172.21.15.115:0/1905370951 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58000c90 con 0x7fdd680c58d0 2023-07-27T14:39:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd5d7fa700 1 -- 172.21.15.115:0/1905370951 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5801b640 con 0x7fdd680c58d0 2023-07-27T14:39:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd680bcc00 con 0x7fdd680c58d0 2023-07-27T14:39:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.183+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd681653f0 con 0x7fdd680c58d0 2023-07-27T14:39:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.184+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6806c470 con 0x7fdd680c58d0 2023-07-27T14:39:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.185+0000 7fdd5d7fa700 1 -- 172.21.15.115:0/1905370951 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7fdd5800f070 con 0x7fdd680c58d0 2023-07-27T14:39:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.186+0000 7fdd5d7fa700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd4c05fc30 0x7fdd4c0620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:21.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.186+0000 7fdd5d7fa700 1 -- 172.21.15.115:0/1905370951 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fdd5807ce60 con 0x7fdd680c58d0 2023-07-27T14:39:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.186+0000 7fdd6d19b700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd4c05fc30 0x7fdd4c0620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.187+0000 7fdd6d19b700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd4c05fc30 0x7fdd4c0620f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fdd64001670 tx=0x7fdd64009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:21.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.190+0000 7fdd5d7fa700 1 -- 172.21.15.115:0/1905370951 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd5804d3d0 con 0x7fdd680c58d0 2023-07-27T14:39:21.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.400+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd680655d0 con 0x7fdd4c05fc30 2023-07-27T14:39:21.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.405+0000 7fdd5d7fa700 1 -- 172.21.15.115:0/1905370951 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fdd680655d0 con 0x7fdd4c05fc30 2023-07-27T14:39:21.459 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:21.459 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:21.459 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:21.460 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:21.460 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:21.460 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:21.460 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:21.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:21.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:21.461 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd4c05fc30 msgr2=0x7fdd4c0620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd4c05fc30 0x7fdd4c0620f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fdd64001670 tx=0x7fdd64009040).stop 2023-07-27T14:39:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 msgr2=0x7fdd680bc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd680bc490 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7fdd58009eb0 tx=0x7fdd58017000).stop 2023-07-27T14:39:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 shutdown_connections 2023-07-27T14:39:21.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdd4c05fc30 0x7fdd4c0620f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd681509b0 0x7fdd680c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd680c3100 0x7fdd68164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 --2- 172.21.15.115:0/1905370951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd680c58d0 0x7fdd680bc490 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 >> 172.21.15.115:0/1905370951 conn(0x7fdd68062320 msgr2=0x7fdd68062700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 shutdown_connections 2023-07-27T14:39:21.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:21.408+0000 7fdd6f3ff700 1 -- 172.21.15.115:0/1905370951 wait complete. 2023-07-27T14:39:22.478 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:22.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.624+0000 7fa355dff700 1 Processor -- start 2023-07-27T14:39:22.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.624+0000 7fa355dff700 1 -- start start 2023-07-27T14:39:22.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa355dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa3500c6b70 0x7fa3500656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:22.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa355dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa350066050 con 0x7fa350153e00 2023-07-27T14:39:22.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa355dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa350064a80 con 0x7fa350065bc0 2023-07-27T14:39:22.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa355dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa350062320 con 0x7fa3500c6b70 2023-07-27T14:39:22.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa34f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa350153e00 0x7fa350064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:55712/0 (socket says 172.21.15.115:55712) 2023-07-27T14:39:22.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa34f7fe700 1 -- 172.21.15.115:0/3079831884 learned_addr learned my addr 172.21.15.115:0/3079831884 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:22.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa34effd700 1 --2- 172.21.15.115:0/3079831884 >> v2:172.21.15.159:3300/0 conn(0x7fa3500c6b70 0x7fa3500656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:22.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa34e7fc700 1 -- 172.21.15.115:0/3079831884 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597016884 0 0) 0x7fa350066050 con 0x7fa350153e00 2023-07-27T14:39:22.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.626+0000 7fa34e7fc700 1 -- 172.21.15.115:0/3079831884 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3380033f0 con 0x7fa350153e00 2023-07-27T14:39:22.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34e7fc700 1 -- 172.21.15.115:0/3079831884 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756402339 0 0) 0x7fa350064a80 con 0x7fa350065bc0 2023-07-27T14:39:22.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34e7fc700 1 -- 172.21.15.115:0/3079831884 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa350066050 con 0x7fa350065bc0 2023-07-27T14:39:22.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34e7fc700 1 -- 172.21.15.115:0/3079831884 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2291586528 0 0) 0x7fa3380033f0 con 0x7fa350153e00 2023-07-27T14:39:22.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34effd700 1 -- 172.21.15.115:0/3079831884 >> v1:172.21.15.159:6789/0 conn(0x7fa350065bc0 legacy=0x7fa350062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:22.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34effd700 1 -- 172.21.15.115:0/3079831884 >> v1:172.21.15.115:6789/0 conn(0x7fa350153e00 legacy=0x7fa350064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:22.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34effd700 1 -- 172.21.15.115:0/3079831884 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350064d60 con 0x7fa3500c6b70 2023-07-27T14:39:22.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34effd700 1 --2- 172.21.15.115:0/3079831884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 0x7fa3500656d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fa344009760 tx=0x7fa344009060).ready entity=mon.1 client_cookie=6b8637a4c374a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:22.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34e7fc700 1 -- 172.21.15.115:0/3079831884 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340001470 con 0x7fa3500c6b70 2023-07-27T14:39:22.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34e7fc700 1 -- 172.21.15.115:0/3079831884 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa344011400 con 0x7fa3500c6b70 2023-07-27T14:39:22.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.627+0000 7fa34e7fc700 1 -- 172.21.15.115:0/3079831884 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344011780 con 0x7fa3500c6b70 2023-07-27T14:39:22.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.628+0000 7fa355dff700 1 -- 172.21.15.115:0/3079831884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 msgr2=0x7fa3500656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:22.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.628+0000 7fa355dff700 1 --2- 172.21.15.115:0/3079831884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 0x7fa3500656d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fa344009760 tx=0x7fa344009060).stop 2023-07-27T14:39:22.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.628+0000 7fa355dff700 1 -- 172.21.15.115:0/3079831884 shutdown_connections 2023-07-27T14:39:22.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.628+0000 7fa355dff700 1 --2- 172.21.15.115:0/3079831884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 0x7fa3500656d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:22.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.628+0000 7fa355dff700 1 -- 172.21.15.115:0/3079831884 >> 172.21.15.115:0/3079831884 conn(0x7fa3500c7b90 msgr2=0x7fa3500c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:22.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.628+0000 7fa355dff700 1 -- 172.21.15.115:0/3079831884 shutdown_connections 2023-07-27T14:39:22.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.628+0000 7fa355dff700 1 -- 172.21.15.115:0/3079831884 wait complete. 2023-07-27T14:39:22.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.629+0000 7fa355dff700 1 Processor -- start 2023-07-27T14:39:22.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.630+0000 7fa355dff700 1 -- start start 2023-07-27T14:39:22.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa355dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa350065bc0 0x7fa350156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:22.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa355dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 0x7fa350144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:22.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa355dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa350153e00 0x7fa350145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:22.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa355dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa350092e30 con 0x7fa350065bc0 2023-07-27T14:39:22.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa355dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa350145570 con 0x7fa3500c6b70 2023-07-27T14:39:22.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa355dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa350092870 con 0x7fa350153e00 2023-07-27T14:39:22.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa350065bc0 0x7fa350156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:22.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa350065bc0 0x7fa350156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43114/0 (socket says 172.21.15.115:43114) 2023-07-27T14:39:22.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 -- 172.21.15.115:0/1609625398 learned_addr learned my addr 172.21.15.115:0/1609625398 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:22.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34effd700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 0x7fa350144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:22.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34ffff700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa350153e00 0x7fa350145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:22.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 -- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa350153e00 msgr2=0x7fa350145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:22.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa350153e00 0x7fa350145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:22.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 -- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 msgr2=0x7fa350144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:22.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 0x7fa350144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:22.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 -- 172.21.15.115:0/1609625398 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440092a0 con 0x7fa350065bc0 2023-07-27T14:39:22.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34ffff700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa350153e00 0x7fa350145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:22.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.631+0000 7fa34f7fe700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa350065bc0 0x7fa350156870 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7fa34000c810 tx=0x7fa340001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:22.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.632+0000 7fa3377fe700 1 -- 172.21.15.115:0/1609625398 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340007170 con 0x7fa350065bc0 2023-07-27T14:39:22.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.632+0000 7fa3377fe700 1 -- 172.21.15.115:0/1609625398 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3400072f0 con 0x7fa350065bc0 2023-07-27T14:39:22.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.632+0000 7fa3377fe700 1 -- 172.21.15.115:0/1609625398 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400048c0 con 0x7fa350065bc0 2023-07-27T14:39:22.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.632+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa350092b50 con 0x7fa350065bc0 2023-07-27T14:39:22.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.632+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa350154660 con 0x7fa350065bc0 2023-07-27T14:39:22.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.633+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35006c470 con 0x7fa350065bc0 2023-07-27T14:39:22.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.634+0000 7fa3377fe700 1 -- 172.21.15.115:0/1609625398 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7fa340010070 con 0x7fa350065bc0 2023-07-27T14:39:22.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.634+0000 7fa3377fe700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33c05fc30 0x7fa33c0620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:22.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.635+0000 7fa3377fe700 1 -- 172.21.15.115:0/1609625398 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fa34007ad10 con 0x7fa350065bc0 2023-07-27T14:39:22.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.635+0000 7fa34effd700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33c05fc30 0x7fa33c0620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:22.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.635+0000 7fa34effd700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33c05fc30 0x7fa33c0620f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fa350151d90 tx=0x7fa344016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:22.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.639+0000 7fa3377fe700 1 -- 172.21.15.115:0/1609625398 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa34004b280 con 0x7fa350065bc0 2023-07-27T14:39:22.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.849+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3500c4390 con 0x7fa33c05fc30 2023-07-27T14:39:22.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.855+0000 7fa3377fe700 1 -- 172.21.15.115:0/1609625398 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fa3500c4390 con 0x7fa33c05fc30 2023-07-27T14:39:22.909 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:22.910 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:22.910 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:22.910 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:22.910 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:22.910 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:22.910 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:22.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:22.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:22.911 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:22.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33c05fc30 msgr2=0x7fa33c0620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:22.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33c05fc30 0x7fa33c0620f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fa350151d90 tx=0x7fa344016000).stop 2023-07-27T14:39:22.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa350065bc0 msgr2=0x7fa350156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:22.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa350065bc0 0x7fa350156870 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7fa34000c810 tx=0x7fa340001ab0).stop 2023-07-27T14:39:22.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 shutdown_connections 2023-07-27T14:39:22.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa33c05fc30 0x7fa33c0620f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:22.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa350153e00 0x7fa350145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:22.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa350065bc0 0x7fa350156870 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:22.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 --2- 172.21.15.115:0/1609625398 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3500c6b70 0x7fa350144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:22.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 >> 172.21.15.115:0/1609625398 conn(0x7fa3500c7b90 msgr2=0x7fa3501510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:22.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.857+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 shutdown_connections 2023-07-27T14:39:22.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:22.858+0000 7fa355dff700 1 -- 172.21.15.115:0/1609625398 wait complete. 2023-07-27T14:39:23.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:24.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.076+0000 7fc443bff700 1 Processor -- start 2023-07-27T14:39:24.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.076+0000 7fc443bff700 1 -- start start 2023-07-27T14:39:24.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.077+0000 7fc443bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc43c14b1e0 0x7fc43c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:24.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc443bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c1553f0 con 0x7fc43c063260 2023-07-27T14:39:24.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc443bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c157a50 con 0x7fc43c14ae00 2023-07-27T14:39:24.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc443bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c157d10 con 0x7fc43c14b1e0 2023-07-27T14:39:24.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc44119a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc43c063260 0x7fc43c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:48554/0 (socket says 172.21.15.115:48554) 2023-07-27T14:39:24.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc44119a700 1 -- 172.21.15.115:0/3751707165 learned_addr learned my addr 172.21.15.115:0/3751707165 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:24.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc44219c700 1 --2- 172.21.15.115:0/3751707165 >> v2:172.21.15.159:3300/0 conn(0x7fc43c14b1e0 0x7fc43c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:24.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407005654 0 0) 0x7fc43c1553f0 con 0x7fc43c063260 2023-07-27T14:39:24.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4280033f0 con 0x7fc43c063260 2023-07-27T14:39:24.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.078+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619238060 0 0) 0x7fc43c157a50 con 0x7fc43c14ae00 2023-07-27T14:39:24.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc43c1553f0 con 0x7fc43c14ae00 2023-07-27T14:39:24.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2791874905 0 0) 0x7fc4280033f0 con 0x7fc43c063260 2023-07-27T14:39:24.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 >> v2:172.21.15.159:3300/0 conn(0x7fc43c14b1e0 msgr2=0x7fc43c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:24.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 --2- 172.21.15.115:0/3751707165 >> v2:172.21.15.159:3300/0 conn(0x7fc43c14b1e0 0x7fc43c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 >> v1:172.21.15.159:6789/0 conn(0x7fc43c14ae00 legacy=0x7fc43c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:24.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c157ff0 con 0x7fc43c063260 2023-07-27T14:39:24.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fc42c001470 con 0x7fc43c063260 2023-07-27T14:39:24.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 >> v1:172.21.15.115:6789/0 conn(0x7fc43c063260 legacy=0x7fc43c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:24.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc428003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:24.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc428004690 0x7fc428004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:24.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc428005000 0x7fc42800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:24.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c157d10 con 0x7fc428003a70 2023-07-27T14:39:24.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42800bf60 con 0x7fc428005000 2023-07-27T14:39:24.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42800c0d0 con 0x7fc428004690 2023-07-27T14:39:24.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44199b700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc428003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:24.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44119a700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc428004690 0x7fc428004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:24.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44219c700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc428005000 0x7fc42800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:24.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44199b700 1 -- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc428004690 msgr2=0x7fc428004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:24.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44199b700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc428004690 0x7fc428004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44199b700 1 -- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc428005000 msgr2=0x7fc42800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:24.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44199b700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc428005000 0x7fc42800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44199b700 1 -- 172.21.15.115:0/3751707165 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4280033f0 con 0x7fc428003a70 2023-07-27T14:39:24.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44119a700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc428004690 0x7fc428004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:24.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.079+0000 7fc44219c700 1 -- 172.21.15.115:0/3751707165 reap_dead start 2023-07-27T14:39:24.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc44199b700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc428003e70 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7fc438001890 tx=0x7fc438007bb0).ready entity=mon.0 client_cookie=4a0082ada705e128 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:24.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438007020 con 0x7fc428003a70 2023-07-27T14:39:24.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438007180 con 0x7fc428003a70 2023-07-27T14:39:24.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc440999700 1 -- 172.21.15.115:0/3751707165 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438007520 con 0x7fc428003a70 2023-07-27T14:39:24.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc443bff700 1 -- 172.21.15.115:0/3751707165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 msgr2=0x7fc428003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:24.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc443bff700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc428003e70 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7fc438001890 tx=0x7fc438007bb0).stop 2023-07-27T14:39:24.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc443bff700 1 -- 172.21.15.115:0/3751707165 shutdown_connections 2023-07-27T14:39:24.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc443bff700 1 --2- 172.21.15.115:0/3751707165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc428003e70 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.080+0000 7fc443bff700 1 -- 172.21.15.115:0/3751707165 >> 172.21.15.115:0/3751707165 conn(0x7fc43c05e940 msgr2=0x7fc43c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:24.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.081+0000 7fc443bff700 1 -- 172.21.15.115:0/3751707165 shutdown_connections 2023-07-27T14:39:24.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.081+0000 7fc443bff700 1 -- 172.21.15.115:0/3751707165 wait complete. 2023-07-27T14:39:24.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.082+0000 7fc443bff700 1 Processor -- start 2023-07-27T14:39:24.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.082+0000 7fc443bff700 1 -- start start 2023-07-27T14:39:24.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc443bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc43c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:24.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc443bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc43c0c4650 0x7fc43c0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:24.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc443bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc43c163c30 0x7fc43c1640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:24.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc443bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1555b0 con 0x7fc428003a70 2023-07-27T14:39:24.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc443bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0c4ad0 con 0x7fc43c0c4650 2023-07-27T14:39:24.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc443bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0b02e0 con 0x7fc43c163c30 2023-07-27T14:39:24.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc44199b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc43c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:24.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc44199b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc43c0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41822/0 (socket says 172.21.15.115:41822) 2023-07-27T14:39:24.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc44199b700 1 -- 172.21.15.115:0/2413719698 learned_addr learned my addr 172.21.15.115:0/2413719698 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:24.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc44219c700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc43c163c30 0x7fc43c1640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:24.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.083+0000 7fc44119a700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc43c0c4650 0x7fc43c0afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:24.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc44199b700 1 -- 172.21.15.115:0/2413719698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc43c163c30 msgr2=0x7fc43c1640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:24.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc44199b700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc43c163c30 0x7fc43c1640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc44199b700 1 -- 172.21.15.115:0/2413719698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc43c0c4650 msgr2=0x7fc43c0afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:24.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc44199b700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc43c0c4650 0x7fc43c0afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc44199b700 1 -- 172.21.15.115:0/2413719698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0b05c0 con 0x7fc428003a70 2023-07-27T14:39:24.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc44199b700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc43c0adb60 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7fc438008fd0 tx=0x7fc438015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:24.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc431ffb700 1 -- 172.21.15.115:0/2413719698 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438013460 con 0x7fc428003a70 2023-07-27T14:39:24.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc431ffb700 1 -- 172.21.15.115:0/2413719698 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4380135c0 con 0x7fc428003a70 2023-07-27T14:39:24.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c0b08a0 con 0x7fc428003a70 2023-07-27T14:39:24.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc431ffb700 1 -- 172.21.15.115:0/2413719698 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438013980 con 0x7fc428003a70 2023-07-27T14:39:24.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.084+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c0aff10 con 0x7fc428003a70 2023-07-27T14:39:24.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.085+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c155850 con 0x7fc428003a70 2023-07-27T14:39:24.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.086+0000 7fc431ffb700 1 -- 172.21.15.115:0/2413719698 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7fc438025070 con 0x7fc428003a70 2023-07-27T14:39:24.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.087+0000 7fc431ffb700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc42005fc30 0x7fc4200620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:24.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.087+0000 7fc431ffb700 1 -- 172.21.15.115:0/2413719698 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fc43807b770 con 0x7fc428003a70 2023-07-27T14:39:24.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.087+0000 7fc44119a700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc42005fc30 0x7fc4200620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:24.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.087+0000 7fc44119a700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc42005fc30 0x7fc4200620f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fc42c000f60 tx=0x7fc42c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:24.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.091+0000 7fc431ffb700 1 -- 172.21.15.115:0/2413719698 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc43804bbd0 con 0x7fc428003a70 2023-07-27T14:39:24.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.303+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7fc43c06c470 con 0x7fc42005fc30 2023-07-27T14:39:24.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.309+0000 7fc431ffb700 1 -- 172.21.15.115:0/2413719698 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7fc43c06c470 con 0x7fc42005fc30 2023-07-27T14:39:24.364 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:24.364 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:24.364 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:24.364 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:24.365 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:24.365 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:24.365 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:24.365 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:24.365 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:24.365 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:24.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.311+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc42005fc30 msgr2=0x7fc4200620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:24.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.311+0000 7fc443bff700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc42005fc30 0x7fc4200620f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fc42c000f60 tx=0x7fc42c009040).stop 2023-07-27T14:39:24.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.311+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 msgr2=0x7fc43c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:24.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.311+0000 7fc443bff700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc43c0adb60 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7fc438008fd0 tx=0x7fc438015000).stop 2023-07-27T14:39:24.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.311+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 shutdown_connections 2023-07-27T14:39:24.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.312+0000 7fc443bff700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc42005fc30 0x7fc4200620f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.312+0000 7fc443bff700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc43c163c30 0x7fc43c1640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.312+0000 7fc443bff700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc428003a70 0x7fc43c0adb60 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.312+0000 7fc443bff700 1 --2- 172.21.15.115:0/2413719698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc43c0c4650 0x7fc43c0afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:24.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.312+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 >> 172.21.15.115:0/2413719698 conn(0x7fc43c05e940 msgr2=0x7fc43c14a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:24.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.312+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 shutdown_connections 2023-07-27T14:39:24.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:24.312+0000 7fc443bff700 1 -- 172.21.15.115:0/2413719698 wait complete. 2023-07-27T14:39:25.387 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:25.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.533+0000 7f69867ff700 1 Processor -- start 2023-07-27T14:39:25.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.534+0000 7f69867ff700 1 -- start start 2023-07-27T14:39:25.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.535+0000 7f69867ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6980063260 0x7f6980154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:25.591 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.535+0000 7f69867ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 0x7f69800a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:25.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.535+0000 7f69867ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69801553f0 con 0x7f698014ae00 2023-07-27T14:39:25.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.535+0000 7f69867ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6980157a50 con 0x7f6980063260 2023-07-27T14:39:25.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.535+0000 7f69867ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6980157d10 con 0x7f698014b1e0 2023-07-27T14:39:25.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.535+0000 7f697ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f698014ae00 0x7f6980062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:48560/0 (socket says 172.21.15.115:48560) 2023-07-27T14:39:25.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.535+0000 7f697ffff700 1 -- 172.21.15.115:0/2876451727 learned_addr learned my addr 172.21.15.115:0/2876451727 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:25.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.535+0000 7f697f7fe700 1 --2- 172.21.15.115:0/2876451727 >> v2:172.21.15.115:3300/0 conn(0x7f6980063260 0x7f6980154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:25.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697f7fe700 1 -- 172.21.15.115:0/2876451727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 msgr2=0x7f69800a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:25.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697f7fe700 1 --2- 172.21.15.115:0/2876451727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 0x7f69800a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:25.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697f7fe700 1 -- 172.21.15.115:0/2876451727 >> v1:172.21.15.115:6789/0 conn(0x7f698014ae00 legacy=0x7f6980062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:25.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697f7fe700 1 -- 172.21.15.115:0/2876451727 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6980157ff0 con 0x7f6980063260 2023-07-27T14:39:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697effd700 1 -- 172.21.15.115:0/2876451727 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073179529 0 0) 0x7f69801553f0 con 0x7f698014ae00 2023-07-27T14:39:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697f7fe700 1 --2- 172.21.15.115:0/2876451727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f6980154f00 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7f6974009760 tx=0x7f6974009060).ready entity=mon.0 client_cookie=a68e92869a33e66a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697effd700 1 -- 172.21.15.115:0/2876451727 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400b580 con 0x7f6980063260 2023-07-27T14:39:25.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697effd700 1 -- 172.21.15.115:0/2876451727 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697400b6e0 con 0x7f6980063260 2023-07-27T14:39:25.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.536+0000 7f697effd700 1 -- 172.21.15.115:0/2876451727 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400ba60 con 0x7f6980063260 2023-07-27T14:39:25.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.537+0000 7f69867ff700 1 -- 172.21.15.115:0/2876451727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 msgr2=0x7f6980154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:25.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.537+0000 7f69867ff700 1 --2- 172.21.15.115:0/2876451727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f6980154f00 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7f6974009760 tx=0x7f6974009060).stop 2023-07-27T14:39:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.537+0000 7f69867ff700 1 -- 172.21.15.115:0/2876451727 shutdown_connections 2023-07-27T14:39:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.537+0000 7f69867ff700 1 --2- 172.21.15.115:0/2876451727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 0x7f69800a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.537+0000 7f69867ff700 1 --2- 172.21.15.115:0/2876451727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f6980154f00 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.537+0000 7f69867ff700 1 -- 172.21.15.115:0/2876451727 >> 172.21.15.115:0/2876451727 conn(0x7f698005e940 msgr2=0x7f69800cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.537+0000 7f69867ff700 1 -- 172.21.15.115:0/2876451727 shutdown_connections 2023-07-27T14:39:25.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.537+0000 7f69867ff700 1 -- 172.21.15.115:0/2876451727 wait complete. 2023-07-27T14:39:25.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.538+0000 7f69867ff700 1 Processor -- start 2023-07-27T14:39:25.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.538+0000 7f69867ff700 1 -- start start 2023-07-27T14:39:25.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f69867ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f69801495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f69867ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698014ae00 0x7f6980164850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f69867ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 0x7f69800c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f69867ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800ae1b0 con 0x7f6980063260 2023-07-27T14:39:25.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f69867ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800c37a0 con 0x7f698014ae00 2023-07-27T14:39:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f69867ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800c44d0 con 0x7f698014b1e0 2023-07-27T14:39:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f697ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f69801495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f697ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f69801495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41852/0 (socket says 172.21.15.115:41852) 2023-07-27T14:39:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.539+0000 7f697ffff700 1 -- 172.21.15.115:0/960105823 learned_addr learned my addr 172.21.15.115:0/960105823 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f697f7fe700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698014ae00 0x7f6980164850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f6984d9c700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 0x7f69800c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f697ffff700 1 -- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 msgr2=0x7f69800c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:25.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f697ffff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 0x7f69800c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f697ffff700 1 -- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698014ae00 msgr2=0x7f6980164850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f697ffff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698014ae00 0x7f6980164850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f697ffff700 1 -- 172.21.15.115:0/960105823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740092a0 con 0x7f6980063260 2023-07-27T14:39:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f697f7fe700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698014ae00 0x7f6980164850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f697ffff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f69801495a0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f697000c4e0 tx=0x7f6970007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f6967fff700 1 -- 172.21.15.115:0/960105823 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700072e0 con 0x7f6980063260 2023-07-27T14:39:25.603 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f6967fff700 1 -- 172.21.15.115:0/960105823 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970007440 con 0x7f6980063260 2023-07-27T14:39:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f6967fff700 1 -- 172.21.15.115:0/960105823 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700057a0 con 0x7f6980063260 2023-07-27T14:39:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.540+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69800c47b0 con 0x7f6980063260 2023-07-27T14:39:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.541+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69800ade40 con 0x7f6980063260 2023-07-27T14:39:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.542+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698006c470 con 0x7f6980063260 2023-07-27T14:39:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.542+0000 7f6967fff700 1 -- 172.21.15.115:0/960105823 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f6970010070 con 0x7f6980063260 2023-07-27T14:39:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.543+0000 7f6967fff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f696c05fc30 0x7f696c0620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:25.604 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.543+0000 7f6967fff700 1 -- 172.21.15.115:0/960105823 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f697007ac80 con 0x7f6980063260 2023-07-27T14:39:25.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.543+0000 7f697f7fe700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f696c05fc30 0x7f696c0620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:25.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.544+0000 7f697f7fe700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f696c05fc30 0x7f696c0620f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f6980063660 tx=0x7f6974017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:25.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.547+0000 7f6967fff700 1 -- 172.21.15.115:0/960105823 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f697004b0e0 con 0x7f6980063260 2023-07-27T14:39:25.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.763+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f69800ae2f0 con 0x7f696c05fc30 2023-07-27T14:39:25.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.770+0000 7f6967fff700 1 -- 172.21.15.115:0/960105823 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f697401f070 con 0x7f696c05fc30 2023-07-27T14:39:25.825 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:25.825 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:25.825 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:25.825 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:25.825 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:25.825 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:25.826 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:25.826 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:25.826 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:25.826 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:25.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f696c05fc30 msgr2=0x7f696c0620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:25.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f696c05fc30 0x7f696c0620f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f6980063660 tx=0x7f6974017000).stop 2023-07-27T14:39:25.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 msgr2=0x7f69801495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:25.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f69801495a0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f697000c4e0 tx=0x7f6970007c70).stop 2023-07-27T14:39:25.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 shutdown_connections 2023-07-27T14:39:25.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f696c05fc30 0x7f696c0620f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:25.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698014b1e0 0x7f69800c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:25.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6980063260 0x7f69801495a0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:25.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 --2- 172.21.15.115:0/960105823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698014ae00 0x7f6980164850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:25.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 >> 172.21.15.115:0/960105823 conn(0x7f698005e940 msgr2=0x7f698014a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:25.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 shutdown_connections 2023-07-27T14:39:25.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:25.773+0000 7f69867ff700 1 -- 172.21.15.115:0/960105823 wait complete. 2023-07-27T14:39:26.849 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:27.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.990+0000 7f7299bff700 1 Processor -- start 2023-07-27T14:39:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.990+0000 7f7299bff700 1 -- start start 2023-07-27T14:39:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.991+0000 7f7299bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f729414f740 0x7f729414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.991+0000 7f7299bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940a5850 0x7f72940a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.991+0000 7f7299bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72941530d0 con 0x7f72940c31e0 2023-07-27T14:39:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.991+0000 7f7299bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7294069f70 con 0x7f729414f740 2023-07-27T14:39:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.991+0000 7f7299bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940a61c0 con 0x7f72940a5850 2023-07-27T14:39:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.992+0000 7f7292ffd700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940a5850 0x7f72940a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.992+0000 7f7293fff700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f72940c31e0 0x7f72940c3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:58528/0 (socket says 172.21.15.115:58528) 2023-07-27T14:39:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.992+0000 7f7293fff700 1 -- 172.21.15.115:0/1785236889 learned_addr learned my addr 172.21.15.115:0/1785236889 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.992+0000 7f72937fe700 1 --2- 172.21.15.115:0/1785236889 >> v2:172.21.15.159:3300/0 conn(0x7f729414f740 0x7f729414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.992+0000 7f72937fe700 1 -- 172.21.15.115:0/1785236889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940a5850 msgr2=0x7f72940a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:27.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.992+0000 7f72937fe700 1 --2- 172.21.15.115:0/1785236889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940a5850 0x7f72940a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.992+0000 7f72937fe700 1 -- 172.21.15.115:0/1785236889 >> v1:172.21.15.159:6789/0 conn(0x7f72940c31e0 legacy=0x7f72940c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:27.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.993+0000 7f72937fe700 1 -- 172.21.15.115:0/1785236889 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72941527a0 con 0x7f729414f740 2023-07-27T14:39:27.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.993+0000 7f7292ffd700 1 --2- 172.21.15.115:0/1785236889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940a5850 0x7f72940a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:27.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.993+0000 7f72937fe700 1 --2- 172.21.15.115:0/1785236889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 0x7f729414fb20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f7284009760 tx=0x7f7284009060).ready entity=mon.1 client_cookie=129d8d9e81036010 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:27.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.993+0000 7f72927fc700 1 -- 172.21.15.115:0/1785236889 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840090d0 con 0x7f729414f740 2023-07-27T14:39:27.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.993+0000 7f72927fc700 1 -- 172.21.15.115:0/1785236889 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728400f510 con 0x7f729414f740 2023-07-27T14:39:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.993+0000 7f72927fc700 1 -- 172.21.15.115:0/1785236889 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400f890 con 0x7f729414f740 2023-07-27T14:39:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.993+0000 7f7299bff700 1 -- 172.21.15.115:0/1785236889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 msgr2=0x7f729414fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.993+0000 7f7299bff700 1 --2- 172.21.15.115:0/1785236889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 0x7f729414fb20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f7284009760 tx=0x7f7284009060).stop 2023-07-27T14:39:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.994+0000 7f7299bff700 1 -- 172.21.15.115:0/1785236889 shutdown_connections 2023-07-27T14:39:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.994+0000 7f7299bff700 1 --2- 172.21.15.115:0/1785236889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 0x7f729414fb20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.994+0000 7f7299bff700 1 --2- 172.21.15.115:0/1785236889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940a5850 0x7f72940a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.994+0000 7f7299bff700 1 -- 172.21.15.115:0/1785236889 >> 172.21.15.115:0/1785236889 conn(0x7f7294062320 msgr2=0x7f7294062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:27.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.994+0000 7f7299bff700 1 -- 172.21.15.115:0/1785236889 shutdown_connections 2023-07-27T14:39:27.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.994+0000 7f7299bff700 1 -- 172.21.15.115:0/1785236889 wait complete. 2023-07-27T14:39:27.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.995+0000 7f7299bff700 1 Processor -- start 2023-07-27T14:39:27.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.995+0000 7f7299bff700 1 -- start start 2023-07-27T14:39:27.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.996+0000 7f7299bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72940a5850 0x7f7294162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:27.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.996+0000 7f7299bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940c31e0 0x7f7294063da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:27.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.996+0000 7f7299bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 0x7f7294064290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:27.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.996+0000 7f7299bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294064780 con 0x7f72940a5850 2023-07-27T14:39:27.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.996+0000 7f7299bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294163440 con 0x7f729414f740 2023-07-27T14:39:27.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.996+0000 7f7299bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940bf5b0 con 0x7f72940c31e0 2023-07-27T14:39:27.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.996+0000 7f72937fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72940a5850 0x7f7294162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:27.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f72937fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72940a5850 0x7f7294162ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41854/0 (socket says 172.21.15.115:41854) 2023-07-27T14:39:27.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f72937fe700 1 -- 172.21.15.115:0/2948975954 learned_addr learned my addr 172.21.15.115:0/2948975954 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:27.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f7292ffd700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940c31e0 0x7f7294063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:27.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f7293fff700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 0x7f7294064290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:27.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f72937fe700 1 -- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940c31e0 msgr2=0x7f7294063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:27.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f72937fe700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940c31e0 0x7f7294063da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f72937fe700 1 -- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 msgr2=0x7f7294064290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f72937fe700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 0x7f7294064290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f72937fe700 1 -- 172.21.15.115:0/2948975954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880092a0 con 0x7f72940a5850 2023-07-27T14:39:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f7292ffd700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940c31e0 0x7f7294063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f72937fe700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72940a5850 0x7f7294162ae0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f7284009e00 tx=0x7f7284017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f727b7fe700 1 -- 172.21.15.115:0/2948975954 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728400f680 con 0x7f72940a5850 2023-07-27T14:39:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f727b7fe700 1 -- 172.21.15.115:0/2948975954 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728400f7e0 con 0x7f72940a5850 2023-07-27T14:39:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72840092a0 con 0x7f72940a5850 2023-07-27T14:39:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.997+0000 7f727b7fe700 1 -- 172.21.15.115:0/2948975954 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728401b690 con 0x7f72940a5850 2023-07-27T14:39:27.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.998+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72940bfb70 con 0x7f72940a5850 2023-07-27T14:39:27.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.998+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729406c470 con 0x7f72940a5850 2023-07-27T14:39:27.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:26.999+0000 7f727b7fe700 1 -- 172.21.15.115:0/2948975954 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f728402a070 con 0x7f72940a5850 2023-07-27T14:39:27.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.000+0000 7f727b7fe700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f728005fc30 0x7f72800620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:27.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.000+0000 7f727b7fe700 1 -- 172.21.15.115:0/2948975954 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f728407c940 con 0x7f72940a5850 2023-07-27T14:39:27.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.000+0000 7f7292ffd700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f728005fc30 0x7f72800620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:27.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.001+0000 7f7292ffd700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f728005fc30 0x7f72800620f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f7288009270 tx=0x7f7288008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:27.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.004+0000 7f727b7fe700 1 -- 172.21.15.115:0/2948975954 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f728404cda0 con 0x7f72940a5850 2023-07-27T14:39:27.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.214+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f7294065270 con 0x7f728005fc30 2023-07-27T14:39:27.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.220+0000 7f727b7fe700 1 -- 172.21.15.115:0/2948975954 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f7294065270 con 0x7f728005fc30 2023-07-27T14:39:27.275 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:27.277 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:27.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.222+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f728005fc30 msgr2=0x7f72800620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.222+0000 7f7299bff700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f728005fc30 0x7f72800620f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f7288009270 tx=0x7f7288008040).stop 2023-07-27T14:39:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72940a5850 msgr2=0x7f7294162ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72940a5850 0x7f7294162ae0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f7284009e00 tx=0x7f7284017000).stop 2023-07-27T14:39:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 shutdown_connections 2023-07-27T14:39:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f728005fc30 0x7f72800620f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f729414f740 0x7f7294064290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72940a5850 0x7f7294162ae0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 --2- 172.21.15.115:0/2948975954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72940c31e0 0x7f7294063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:27.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 >> 172.21.15.115:0/2948975954 conn(0x7f7294062320 msgr2=0x7f72940bbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:27.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 shutdown_connections 2023-07-27T14:39:27.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:27.223+0000 7f7299bff700 1 -- 172.21.15.115:0/2948975954 wait complete. 2023-07-27T14:39:28.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:28.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.445+0000 7f77e09ff700 1 Processor -- start 2023-07-27T14:39:28.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.445+0000 7f77e09ff700 1 -- start start 2023-07-27T14:39:28.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77e09ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f77dc14ae00 0x7f77dc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:28.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77e09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:28.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77e09ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f77dc0c5c50 0x7f77dc063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:28.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77e09ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77dc063530 con 0x7f77dc0c5c50 2023-07-27T14:39:28.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77e09ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77dc1553f0 con 0x7f77dc14ae00 2023-07-27T14:39:28.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77e09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc157a50 con 0x7f77dc14b1e0 2023-07-27T14:39:28.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77dad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f77dc0c5c50 0x7f77dc063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:28.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77dad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f77dc0c5c50 0x7f77dc063040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41868/0 (socket says 172.21.15.115:41868) 2023-07-27T14:39:28.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77dad9d700 1 -- 172.21.15.115:0/1606099043 learned_addr learned my addr 172.21.15.115:0/1606099043 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:28.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77d9d9b700 1 --2- 172.21.15.115:0/1606099043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:28.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.447+0000 7f77da59c700 1 --2- 172.21.15.115:0/1606099043 >> v2:172.21.15.159:3300/0 conn(0x7f77dc14ae00 0x7f77dc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:28.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77dad9d700 1 -- 172.21.15.115:0/1606099043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 msgr2=0x7f77dc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:28.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77dad9d700 1 --2- 172.21.15.115:0/1606099043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77dad9d700 1 -- 172.21.15.115:0/1606099043 >> v2:172.21.15.159:3300/0 conn(0x7f77dc14ae00 msgr2=0x7f77dc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:28.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77dad9d700 1 --2- 172.21.15.115:0/1606099043 >> v2:172.21.15.159:3300/0 conn(0x7f77dc14ae00 0x7f77dc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77dad9d700 1 -- 172.21.15.115:0/1606099043 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc157d10 con 0x7f77dc0c5c50 2023-07-27T14:39:28.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77da59c700 1 --2- 172.21.15.115:0/1606099043 >> v2:172.21.15.159:3300/0 conn(0x7f77dc14ae00 0x7f77dc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:28.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77dad9d700 1 --2- 172.21.15.115:0/1606099043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc0c5c50 0x7f77dc063040 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f77dc0caaf0 tx=0x7f77d4009840).ready entity=mon.0 client_cookie=3c91eb242d82677b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:28.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77d959a700 1 -- 172.21.15.115:0/1606099043 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d400e070 con 0x7f77dc0c5c50 2023-07-27T14:39:28.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77d959a700 1 -- 172.21.15.115:0/1606099043 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d400ba20 con 0x7f77dc0c5c50 2023-07-27T14:39:28.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.448+0000 7f77d959a700 1 -- 172.21.15.115:0/1606099043 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d400bda0 con 0x7f77dc0c5c50 2023-07-27T14:39:28.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 -- 172.21.15.115:0/1606099043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc0c5c50 msgr2=0x7f77dc063040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:28.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 --2- 172.21.15.115:0/1606099043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc0c5c50 0x7f77dc063040 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f77dc0caaf0 tx=0x7f77d4009840).stop 2023-07-27T14:39:28.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 -- 172.21.15.115:0/1606099043 shutdown_connections 2023-07-27T14:39:28.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 --2- 172.21.15.115:0/1606099043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc0c5c50 0x7f77dc063040 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 --2- 172.21.15.115:0/1606099043 >> v2:172.21.15.159:3300/0 conn(0x7f77dc14ae00 0x7f77dc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 --2- 172.21.15.115:0/1606099043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 -- 172.21.15.115:0/1606099043 >> 172.21.15.115:0/1606099043 conn(0x7f77dc05e940 msgr2=0x7f77dc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:28.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 -- 172.21.15.115:0/1606099043 shutdown_connections 2023-07-27T14:39:28.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.449+0000 7f77e09ff700 1 -- 172.21.15.115:0/1606099043 wait complete. 2023-07-27T14:39:28.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.450+0000 7f77e09ff700 1 Processor -- start 2023-07-27T14:39:28.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.450+0000 7f77e09ff700 1 -- start start 2023-07-27T14:39:28.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.451+0000 7f77e09ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77dc0c5c50 0x7f77dc0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:28.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.451+0000 7f77e09ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc14ae00 0x7f77dc14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:28.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.451+0000 7f77e09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:28.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.451+0000 7f77e09ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc163c00 con 0x7f77dc14ae00 2023-07-27T14:39:28.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.451+0000 7f77e09ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0ae860 con 0x7f77dc0c5c50 2023-07-27T14:39:28.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.451+0000 7f77e09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0aeb40 con 0x7f77dc14b1e0 2023-07-27T14:39:28.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc14ae00 0x7f77dc14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:28.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc14ae00 0x7f77dc14a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41880/0 (socket says 172.21.15.115:41880) 2023-07-27T14:39:28.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 -- 172.21.15.115:0/2855117300 learned_addr learned my addr 172.21.15.115:0/2855117300 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:28.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77da59c700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77dc0c5c50 0x7f77dc0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:28.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77dad9d700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:28.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 -- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 msgr2=0x7f77dc1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:28.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 -- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77dc0c5c50 msgr2=0x7f77dc0ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:28.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77dc0c5c50 0x7f77dc0ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 -- 172.21.15.115:0/2855117300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4009ae0 con 0x7f77dc14ae00 2023-07-27T14:39:28.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77da59c700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77dc0c5c50 0x7f77dc0ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:28.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77dad9d700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:28.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77d9d9b700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc14ae00 0x7f77dc14a5d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f77d000e8d0 tx=0x7f77d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:28.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77ca7fc700 1 -- 172.21.15.115:0/2855117300 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000c640 con 0x7f77dc14ae00 2023-07-27T14:39:28.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77ca7fc700 1 -- 172.21.15.115:0/2855117300 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000c7a0 con 0x7f77dc14ae00 2023-07-27T14:39:28.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc0aee20 con 0x7f77dc14ae00 2023-07-27T14:39:28.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.452+0000 7f77ca7fc700 1 -- 172.21.15.115:0/2855117300 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000cb20 con 0x7f77dc14ae00 2023-07-27T14:39:28.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.453+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc0af100 con 0x7f77dc14ae00 2023-07-27T14:39:28.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.454+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77dc06c470 con 0x7f77dc14ae00 2023-07-27T14:39:28.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.454+0000 7f77ca7fc700 1 -- 172.21.15.115:0/2855117300 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f77d0022070 con 0x7f77dc14ae00 2023-07-27T14:39:28.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.456+0000 7f77ca7fc700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77bc05fc00 0x7f77bc0620c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:28.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.456+0000 7f77ca7fc700 1 -- 172.21.15.115:0/2855117300 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f77d007b7c0 con 0x7f77dc14ae00 2023-07-27T14:39:28.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.456+0000 7f77da59c700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77bc05fc00 0x7f77bc0620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:28.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.456+0000 7f77da59c700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77bc05fc00 0x7f77bc0620c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f77cc006d80 tx=0x7f77cc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:28.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.460+0000 7f77ca7fc700 1 -- 172.21.15.115:0/2855117300 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f77d004bc20 con 0x7f77dc14ae00 2023-07-27T14:39:28.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.670+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f77dc0c89c0 con 0x7f77bc05fc00 2023-07-27T14:39:28.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.676+0000 7f77ca7fc700 1 -- 172.21.15.115:0/2855117300 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f77dc0c89c0 con 0x7f77bc05fc00 2023-07-27T14:39:28.731 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:28.732 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:28.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77bc05fc00 msgr2=0x7f77bc0620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:28.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77bc05fc00 0x7f77bc0620c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f77cc006d80 tx=0x7f77cc008040).stop 2023-07-27T14:39:28.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc14ae00 msgr2=0x7f77dc14a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:28.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc14ae00 0x7f77dc14a5d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f77d000e8d0 tx=0x7f77d0009060).stop 2023-07-27T14:39:28.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 shutdown_connections 2023-07-27T14:39:28.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f77bc05fc00 0x7f77bc0620c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f77dc14b1e0 0x7f77dc1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77dc0c5c50 0x7f77dc0ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 --2- 172.21.15.115:0/2855117300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77dc14ae00 0x7f77dc14a5d0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:28.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.678+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 >> 172.21.15.115:0/2855117300 conn(0x7f77dc05e940 msgr2=0x7f77dc0c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:28.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.679+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 shutdown_connections 2023-07-27T14:39:28.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:28.679+0000 7f77e09ff700 1 -- 172.21.15.115:0/2855117300 wait complete. 2023-07-27T14:39:29.754 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:29.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.904+0000 7f44187ff700 1 Processor -- start 2023-07-27T14:39:29.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.904+0000 7f44187ff700 1 -- start start 2023-07-27T14:39:29.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.905+0000 7f44187ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d3a0 0x7f44100c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:29.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.905+0000 7f44187ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f441013d780 0x7f4410068040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:29.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.905+0000 7f44187ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44100be080 con 0x7f4410065f10 2023-07-27T14:39:29.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.905+0000 7f44187ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44100c3490 con 0x7f441013d780 2023-07-27T14:39:29.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.905+0000 7f44187ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4410068530 con 0x7f441013d3a0 2023-07-27T14:39:29.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f4415d9a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f441013d780 0x7f4410068040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:29.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f441659b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d3a0 0x7f44100c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:29.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f4416d9c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f4410065f10 0x7f4410157b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:58534/0 (socket says 172.21.15.115:58534) 2023-07-27T14:39:29.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f4416d9c700 1 -- 172.21.15.115:0/3474600241 learned_addr learned my addr 172.21.15.115:0/3474600241 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:29.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f441659b700 1 -- 172.21.15.115:0/3474600241 >> v2:172.21.15.159:3300/0 conn(0x7f441013d780 msgr2=0x7f4410068040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:29.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f441659b700 1 --2- 172.21.15.115:0/3474600241 >> v2:172.21.15.159:3300/0 conn(0x7f441013d780 0x7f4410068040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:29.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f441659b700 1 -- 172.21.15.115:0/3474600241 >> v1:172.21.15.159:6789/0 conn(0x7f4410065f10 legacy=0x7f4410157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:29.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f441659b700 1 -- 172.21.15.115:0/3474600241 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100c36a0 con 0x7f441013d3a0 2023-07-27T14:39:29.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.906+0000 7f4415d9a700 1 --2- 172.21.15.115:0/3474600241 >> v2:172.21.15.159:3300/0 conn(0x7f441013d780 0x7f4410068040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:29.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f441659b700 1 --2- 172.21.15.115:0/3474600241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d3a0 0x7f44100c2fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f440c009760 tx=0x7f440c009060).ready entity=mon.2 client_cookie=6a1c52572a54073c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:29.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f4415599700 1 -- 172.21.15.115:0/3474600241 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00f510 con 0x7f441013d3a0 2023-07-27T14:39:29.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f4415599700 1 -- 172.21.15.115:0/3474600241 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00f670 con 0x7f441013d3a0 2023-07-27T14:39:29.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f4415599700 1 -- 172.21.15.115:0/3474600241 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00f9f0 con 0x7f441013d3a0 2023-07-27T14:39:29.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f44187ff700 1 -- 172.21.15.115:0/3474600241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d3a0 msgr2=0x7f44100c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:29.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f44187ff700 1 --2- 172.21.15.115:0/3474600241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d3a0 0x7f44100c2fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f440c009760 tx=0x7f440c009060).stop 2023-07-27T14:39:29.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f44187ff700 1 -- 172.21.15.115:0/3474600241 shutdown_connections 2023-07-27T14:39:29.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f44187ff700 1 --2- 172.21.15.115:0/3474600241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d3a0 0x7f44100c2fa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:29.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f44187ff700 1 --2- 172.21.15.115:0/3474600241 >> v2:172.21.15.159:3300/0 conn(0x7f441013d780 0x7f4410068040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:29.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f44187ff700 1 -- 172.21.15.115:0/3474600241 >> 172.21.15.115:0/3474600241 conn(0x7f441005e940 msgr2=0x7f44100c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:29.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f44187ff700 1 -- 172.21.15.115:0/3474600241 shutdown_connections 2023-07-27T14:39:29.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.907+0000 7f44187ff700 1 -- 172.21.15.115:0/3474600241 wait complete. 2023-07-27T14:39:29.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.909+0000 7f44187ff700 1 Processor -- start 2023-07-27T14:39:29.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.909+0000 7f44187ff700 1 -- start start 2023-07-27T14:39:29.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f44187ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410065f10 0x7f44100ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:29.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f44187ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441013d3a0 0x7f44100ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:29.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f44187ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d780 0x7f44100c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f44187ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44100c67d0 con 0x7f441013d3a0 2023-07-27T14:39:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f44187ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44100c6a20 con 0x7f4410065f10 2023-07-27T14:39:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f44187ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44100c6d00 con 0x7f441013d780 2023-07-27T14:39:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f4415d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441013d3a0 0x7f44100ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f4415d9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441013d3a0 0x7f44100ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41892/0 (socket says 172.21.15.115:41892) 2023-07-27T14:39:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.910+0000 7f4415d9a700 1 -- 172.21.15.115:0/1674729584 learned_addr learned my addr 172.21.15.115:0/1674729584 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f441659b700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410065f10 0x7f44100ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:29.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f4416d9c700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d780 0x7f44100c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f4415d9a700 1 -- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d780 msgr2=0x7f44100c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f4415d9a700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d780 0x7f44100c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f4415d9a700 1 -- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410065f10 msgr2=0x7f44100ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f4415d9a700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410065f10 0x7f44100ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f4415d9a700 1 -- 172.21.15.115:0/1674729584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000092a0 con 0x7f441013d3a0 2023-07-27T14:39:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f4416d9c700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d780 0x7f44100c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:29.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f4415d9a700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441013d3a0 0x7f44100ac590 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f440000e900 tx=0x7f4400009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f44067fc700 1 -- 172.21.15.115:0/1674729584 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000eea0 con 0x7f441013d3a0 2023-07-27T14:39:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f44067fc700 1 -- 172.21.15.115:0/1674729584 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440000c850 con 0x7f441013d3a0 2023-07-27T14:39:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c0092a0 con 0x7f441013d3a0 2023-07-27T14:39:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f44067fc700 1 -- 172.21.15.115:0/1674729584 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000cbd0 con 0x7f441013d3a0 2023-07-27T14:39:29.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.911+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44100c72c0 con 0x7f441013d3a0 2023-07-27T14:39:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.912+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44100c7630 con 0x7f441013d3a0 2023-07-27T14:39:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.913+0000 7f44067fc700 1 -- 172.21.15.115:0/1674729584 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f4400022070 con 0x7f441013d3a0 2023-07-27T14:39:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.914+0000 7f44067fc700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f43f405fc30 0x7f43f40620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.914+0000 7f44067fc700 1 -- 172.21.15.115:0/1674729584 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f440007b7d0 con 0x7f441013d3a0 2023-07-27T14:39:29.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.914+0000 7f441659b700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f43f405fc30 0x7f43f40620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:29.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.914+0000 7f441659b700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f43f405fc30 0x7f43f40620f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f440c009760 tx=0x7f440c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:29.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:29.918+0000 7f44067fc700 1 -- 172.21.15.115:0/1674729584 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f440004bd40 con 0x7f441013d3a0 2023-07-27T14:39:30.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.128+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f441006c470 con 0x7f43f405fc30 2023-07-27T14:39:30.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.135+0000 7f44067fc700 1 -- 172.21.15.115:0/1674729584 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f441006c470 con 0x7f43f405fc30 2023-07-27T14:39:30.190 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:30.193 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:30.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f43f405fc30 msgr2=0x7f43f40620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:30.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f43f405fc30 0x7f43f40620f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f440c009760 tx=0x7f440c017000).stop 2023-07-27T14:39:30.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441013d3a0 msgr2=0x7f44100ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:30.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441013d3a0 0x7f44100ac590 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f440000e900 tx=0x7f4400009060).stop 2023-07-27T14:39:30.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 shutdown_connections 2023-07-27T14:39:30.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f43f405fc30 0x7f43f40620f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:30.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f441013d780 0x7f44100c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:30.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4410065f10 0x7f44100ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:30.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 --2- 172.21.15.115:0/1674729584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f441013d3a0 0x7f44100ac590 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:30.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 >> 172.21.15.115:0/1674729584 conn(0x7f441005e940 msgr2=0x7f441013af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:30.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 shutdown_connections 2023-07-27T14:39:30.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:30.137+0000 7f44187ff700 1 -- 172.21.15.115:0/1674729584 wait complete. 2023-07-27T14:39:31.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:31.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.359+0000 7f711dbff700 1 Processor -- start 2023-07-27T14:39:31.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.359+0000 7f711dbff700 1 -- start start 2023-07-27T14:39:31.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.360+0000 7f711dbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f711814ae00 0x7f7118154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:31.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.360+0000 7f711dbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f711814b1e0 0x7f7118062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:31.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.360+0000 7f711dbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71181553f0 con 0x7f71180c5c50 2023-07-27T14:39:31.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.360+0000 7f711dbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7118157a50 con 0x7f711814ae00 2023-07-27T14:39:31.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.360+0000 7f711dbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7118157d10 con 0x7f711814b1e0 2023-07-27T14:39:31.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.360+0000 7f71177fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f711814ae00 0x7f7118154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:31.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.360+0000 7f7117fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f71180c5c50 0x7f71180a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:48562/0 (socket says 172.21.15.115:48562) 2023-07-27T14:39:31.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.360+0000 7f7117fff700 1 -- 172.21.15.115:0/504701340 learned_addr learned my addr 172.21.15.115:0/504701340 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:31.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f7116ffd700 1 --2- 172.21.15.115:0/504701340 >> v2:172.21.15.159:3300/0 conn(0x7f711814b1e0 0x7f7118062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:31.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71177fe700 1 -- 172.21.15.115:0/504701340 >> v2:172.21.15.159:3300/0 conn(0x7f711814b1e0 msgr2=0x7f7118062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:31.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71177fe700 1 --2- 172.21.15.115:0/504701340 >> v2:172.21.15.159:3300/0 conn(0x7f711814b1e0 0x7f7118062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71177fe700 1 -- 172.21.15.115:0/504701340 >> v1:172.21.15.115:6789/0 conn(0x7f71180c5c50 legacy=0x7f71180a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:31.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71177fe700 1 -- 172.21.15.115:0/504701340 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7118157ff0 con 0x7f711814ae00 2023-07-27T14:39:31.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71167fc700 1 -- 172.21.15.115:0/504701340 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457177931 0 0) 0x7f71181553f0 con 0x7f71180c5c50 2023-07-27T14:39:31.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71177fe700 1 --2- 172.21.15.115:0/504701340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711814ae00 0x7f7118154f00 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f7118155580 tx=0x7f7108009060).ready entity=mon.0 client_cookie=1ec4641763fd5681 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:31.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71167fc700 1 -- 172.21.15.115:0/504701340 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800f510 con 0x7f711814ae00 2023-07-27T14:39:31.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71167fc700 1 -- 172.21.15.115:0/504701340 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710800f670 con 0x7f711814ae00 2023-07-27T14:39:31.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.361+0000 7f71167fc700 1 -- 172.21.15.115:0/504701340 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800f9f0 con 0x7f711814ae00 2023-07-27T14:39:31.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.362+0000 7f711dbff700 1 -- 172.21.15.115:0/504701340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711814ae00 msgr2=0x7f7118154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:31.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.362+0000 7f711dbff700 1 --2- 172.21.15.115:0/504701340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711814ae00 0x7f7118154f00 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f7118155580 tx=0x7f7108009060).stop 2023-07-27T14:39:31.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.362+0000 7f711dbff700 1 -- 172.21.15.115:0/504701340 shutdown_connections 2023-07-27T14:39:31.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.362+0000 7f711dbff700 1 --2- 172.21.15.115:0/504701340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f711814ae00 0x7f7118154f00 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.362+0000 7f711dbff700 1 --2- 172.21.15.115:0/504701340 >> v2:172.21.15.159:3300/0 conn(0x7f711814b1e0 0x7f7118062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.362+0000 7f711dbff700 1 -- 172.21.15.115:0/504701340 >> 172.21.15.115:0/504701340 conn(0x7f711805e940 msgr2=0x7f71180cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:31.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.362+0000 7f711dbff700 1 -- 172.21.15.115:0/504701340 shutdown_connections 2023-07-27T14:39:31.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.362+0000 7f711dbff700 1 -- 172.21.15.115:0/504701340 wait complete. 2023-07-27T14:39:31.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.363+0000 7f711dbff700 1 Processor -- start 2023-07-27T14:39:31.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.364+0000 7f711dbff700 1 -- start start 2023-07-27T14:39:31.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.364+0000 7f711dbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71180c5c50 0x7f71180b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:31.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.364+0000 7f711dbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f711814ae00 0x7f71180ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:31.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.364+0000 7f711dbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f711814b1e0 0x7f71180abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:31.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.364+0000 7f711dbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7118168280 con 0x7f71180c5c50 2023-07-27T14:39:31.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.364+0000 7f711dbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7118139300 con 0x7f711814ae00 2023-07-27T14:39:31.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.364+0000 7f711dbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180ac200 con 0x7f711814b1e0 2023-07-27T14:39:31.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71180c5c50 0x7f71180b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:31.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71180c5c50 0x7f71180b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41910/0 (socket says 172.21.15.115:41910) 2023-07-27T14:39:31.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 -- 172.21.15.115:0/1862640762 learned_addr learned my addr 172.21.15.115:0/1862640762 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:31.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f7116ffd700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f711814ae00 0x7f71180ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:31.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f7117fff700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f711814b1e0 0x7f71180abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:31.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 -- 172.21.15.115:0/1862640762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f711814b1e0 msgr2=0x7f71180abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:31.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f711814b1e0 0x7f71180abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 -- 172.21.15.115:0/1862640762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f711814ae00 msgr2=0x7f71180ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:31.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f711814ae00 0x7f71180ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 -- 172.21.15.115:0/1862640762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71080092a0 con 0x7f71180c5c50 2023-07-27T14:39:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f71177fe700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71180c5c50 0x7f71180b03c0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7f71181579b0 tx=0x7f7108017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.365+0000 7f70ff7fe700 1 -- 172.21.15.115:0/1862640762 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108011760 con 0x7f71180c5c50 2023-07-27T14:39:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.366+0000 7f70ff7fe700 1 -- 172.21.15.115:0/1862640762 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71080118c0 con 0x7f71180c5c50 2023-07-27T14:39:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.366+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71180c3b60 con 0x7f71180c5c50 2023-07-27T14:39:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.366+0000 7f70ff7fe700 1 -- 172.21.15.115:0/1862640762 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108011c60 con 0x7f71180c5c50 2023-07-27T14:39:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.366+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71180c3e80 con 0x7f71180c5c50 2023-07-27T14:39:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.367+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711806c470 con 0x7f71180c5c50 2023-07-27T14:39:31.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.367+0000 7f70ff7fe700 1 -- 172.21.15.115:0/1862640762 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f710800f070 con 0x7f71180c5c50 2023-07-27T14:39:31.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.369+0000 7f70ff7fe700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f710405fc30 0x7f71040620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:31.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.369+0000 7f70ff7fe700 1 -- 172.21.15.115:0/1862640762 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f710807c830 con 0x7f71180c5c50 2023-07-27T14:39:31.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.369+0000 7f7116ffd700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f710405fc30 0x7f71040620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:31.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.369+0000 7f7116ffd700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f710405fc30 0x7f71040620f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f71180ae0e0 tx=0x7f710c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:31.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.373+0000 7f70ff7fe700 1 -- 172.21.15.115:0/1862640762 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f710804cda0 con 0x7f71180c5c50 2023-07-27T14:39:31.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.580+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f71180c0a40 con 0x7f710405fc30 2023-07-27T14:39:31.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.587+0000 7f70ff7fe700 1 -- 172.21.15.115:0/1862640762 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+193 (secure 0 0 0) 0x7f71180c0a40 con 0x7f710405fc30 2023-07-27T14:39:31.642 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "in-progress", 2023-07-27T14:39:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:39:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:39:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000883025", 2023-07-27T14:39:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000001037341" 2023-07-27T14:39:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:31.644 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:31.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.589+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f710405fc30 msgr2=0x7f71040620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:31.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.589+0000 7f711dbff700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f710405fc30 0x7f71040620f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f71180ae0e0 tx=0x7f710c008040).stop 2023-07-27T14:39:31.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.589+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71180c5c50 msgr2=0x7f71180b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:31.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.589+0000 7f711dbff700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71180c5c50 0x7f71180b03c0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7f71181579b0 tx=0x7f7108017000).stop 2023-07-27T14:39:31.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.590+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 shutdown_connections 2023-07-27T14:39:31.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.590+0000 7f711dbff700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f710405fc30 0x7f71040620f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.590+0000 7f711dbff700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f711814b1e0 0x7f71180abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.590+0000 7f711dbff700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71180c5c50 0x7f71180b03c0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.590+0000 7f711dbff700 1 --2- 172.21.15.115:0/1862640762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f711814ae00 0x7f71180ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:31.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.590+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 >> 172.21.15.115:0/1862640762 conn(0x7f711805e940 msgr2=0x7f71180c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:31.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.590+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 shutdown_connections 2023-07-27T14:39:31.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:31.590+0000 7f711dbff700 1 -- 172.21.15.115:0/1862640762 wait complete. 2023-07-27T14:39:32.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:39:32.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:39:32.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000871247 2023-07-27T14:39:32.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.802+0000 7f5e56bff700 1 Processor -- start 2023-07-27T14:39:32.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.802+0000 7f5e56bff700 1 -- start start 2023-07-27T14:39:32.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.803+0000 7f5e56bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e5014ae00 0x7f5e50154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:32.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.803+0000 7f5e56bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e50062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:32.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.803+0000 7f5e56bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e501553f0 con 0x7f5e500c5c50 2023-07-27T14:39:32.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.803+0000 7f5e56bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e50157a50 con 0x7f5e5014ae00 2023-07-27T14:39:32.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.803+0000 7f5e56bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50157d10 con 0x7f5e5014b1e0 2023-07-27T14:39:32.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e5499b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e5014ae00 0x7f5e50154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:32.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e5499b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e5014ae00 0x7f5e50154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41920/0 (socket says 172.21.15.115:41920) 2023-07-27T14:39:32.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e5499b700 1 -- 172.21.15.115:0/1478316309 learned_addr learned my addr 172.21.15.115:0/1478316309 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:32.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e4ffff700 1 --2- 172.21.15.115:0/1478316309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e50062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:32.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e5499b700 1 -- 172.21.15.115:0/1478316309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 msgr2=0x7f5e50062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:32.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e5499b700 1 --2- 172.21.15.115:0/1478316309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e50062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:32.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e5499b700 1 -- 172.21.15.115:0/1478316309 >> v1:172.21.15.159:6789/0 conn(0x7f5e500c5c50 legacy=0x7f5e500a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:32.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e5499b700 1 -- 172.21.15.115:0/1478316309 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50157ff0 con 0x7f5e5014ae00 2023-07-27T14:39:32.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e4ffff700 1 --2- 172.21.15.115:0/1478316309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e50062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:32.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e5499b700 1 --2- 172.21.15.115:0/1478316309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e50154f00 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7f5e44006fd0 tx=0x7f5e440090f0).ready entity=mon.0 client_cookie=71bf785ddbf2608 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:32.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e4f7fe700 1 -- 172.21.15.115:0/1478316309 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400b600 con 0x7f5e5014ae00 2023-07-27T14:39:32.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e4f7fe700 1 -- 172.21.15.115:0/1478316309 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400b760 con 0x7f5e5014ae00 2023-07-27T14:39:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.804+0000 7f5e4f7fe700 1 -- 172.21.15.115:0/1478316309 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400bae0 con 0x7f5e5014ae00 2023-07-27T14:39:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.805+0000 7f5e56bff700 1 -- 172.21.15.115:0/1478316309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 msgr2=0x7f5e50154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.805+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1478316309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e50154f00 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7f5e44006fd0 tx=0x7f5e440090f0).stop 2023-07-27T14:39:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.805+0000 7f5e56bff700 1 -- 172.21.15.115:0/1478316309 shutdown_connections 2023-07-27T14:39:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.805+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1478316309 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e50154f00 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.805+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1478316309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e50062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.805+0000 7f5e56bff700 1 -- 172.21.15.115:0/1478316309 >> 172.21.15.115:0/1478316309 conn(0x7f5e5005e940 msgr2=0x7f5e500cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:32.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.805+0000 7f5e56bff700 1 -- 172.21.15.115:0/1478316309 shutdown_connections 2023-07-27T14:39:32.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.805+0000 7f5e56bff700 1 -- 172.21.15.115:0/1478316309 wait complete. 2023-07-27T14:39:32.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.807+0000 7f5e56bff700 1 Processor -- start 2023-07-27T14:39:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.807+0000 7f5e56bff700 1 -- start start 2023-07-27T14:39:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e56bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500c5c50 0x7f5e50149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e56bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e500c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e56bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e500b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e56bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500afdb0 con 0x7f5e5014ae00 2023-07-27T14:39:32.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e56bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500af480 con 0x7f5e500c5c50 2023-07-27T14:39:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e56bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500af760 con 0x7f5e5014b1e0 2023-07-27T14:39:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e4ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e500c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e4ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e500c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41930/0 (socket says 172.21.15.115:41930) 2023-07-27T14:39:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e4ffff700 1 -- 172.21.15.115:0/1361585095 learned_addr learned my addr 172.21.15.115:0/1361585095 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e5499b700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500c5c50 0x7f5e50149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e5519c700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e500b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e4ffff700 1 -- 172.21.15.115:0/1361585095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 msgr2=0x7f5e500b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:32.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e4ffff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e500b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:32.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e4ffff700 1 -- 172.21.15.115:0/1361585095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500c5c50 msgr2=0x7f5e50149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:32.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e4ffff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500c5c50 0x7f5e50149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:32.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.808+0000 7f5e4ffff700 1 -- 172.21.15.115:0/1361585095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e44009370 con 0x7f5e5014ae00 2023-07-27T14:39:32.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.809+0000 7f5e4ffff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e500c4490 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7f5e3c00c670 tx=0x7f5e3c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:32.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.809+0000 7f5e4cff9700 1 -- 172.21.15.115:0/1361585095 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c015070 con 0x7f5e5014ae00 2023-07-27T14:39:32.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.809+0000 7f5e4cff9700 1 -- 172.21.15.115:0/1361585095 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c010580 con 0x7f5e5014ae00 2023-07-27T14:39:32.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.809+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e500afa40 con 0x7f5e5014ae00 2023-07-27T14:39:32.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.809+0000 7f5e4cff9700 1 -- 172.21.15.115:0/1361585095 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c010900 con 0x7f5e5014ae00 2023-07-27T14:39:32.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.809+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e50149bf0 con 0x7f5e5014ae00 2023-07-27T14:39:32.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.810+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e500aff60 con 0x7f5e5014ae00 2023-07-27T14:39:32.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.811+0000 7f5e4cff9700 1 -- 172.21.15.115:0/1361585095 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f5e3c010cf0 con 0x7f5e5014ae00 2023-07-27T14:39:32.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.812+0000 7f5e4cff9700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e3405fc00 0x7f5e340620c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:32.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.812+0000 7f5e4cff9700 1 -- 172.21.15.115:0/1361585095 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f5e3c07af80 con 0x7f5e5014ae00 2023-07-27T14:39:32.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.813+0000 7f5e5499b700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e3405fc00 0x7f5e340620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:32.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.813+0000 7f5e5499b700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e3405fc00 0x7f5e340620c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f5e44009130 tx=0x7f5e44017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:32.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:32.817+0000 7f5e4cff9700 1 -- 172.21.15.115:0/1361585095 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5e500aff60 con 0x7f5e5014ae00 2023-07-27T14:39:33.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.026+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e500aff60 con 0x7f5e3405fc00 2023-07-27T14:39:33.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.172+0000 7f5e4cff9700 1 -- 172.21.15.115:0/1361585095 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f5e500aff60 con 0x7f5e3405fc00 2023-07-27T14:39:33.227 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:33.227 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:39:33.227 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:39:33.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:33.228 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:33.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e3405fc00 msgr2=0x7f5e340620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e3405fc00 0x7f5e340620c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f5e44009130 tx=0x7f5e44017000).stop 2023-07-27T14:39:33.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 msgr2=0x7f5e500c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e500c4490 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7f5e3c00c670 tx=0x7f5e3c008040).stop 2023-07-27T14:39:33.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 shutdown_connections 2023-07-27T14:39:33.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5e3405fc00 0x7f5e340620c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5014b1e0 0x7f5e500b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500c5c50 0x7f5e50149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 --2- 172.21.15.115:0/1361585095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e5014ae00 0x7f5e500c4490 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 >> 172.21.15.115:0/1361585095 conn(0x7f5e5005e940 msgr2=0x7f5e500c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:33.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 shutdown_connections 2023-07-27T14:39:33.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.174+0000 7f5e56bff700 1 -- 172.21.15.115:0/1361585095 wait complete. 2023-07-27T14:39:33.246 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000883025 2023-07-27T14:39:33.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.383+0000 7f6c6e3ff700 1 Processor -- start 2023-07-27T14:39:33.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.383+0000 7f6c6e3ff700 1 -- start start 2023-07-27T14:39:33.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.384+0000 7f6c6e3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c68063260 0x7f6c68154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.384+0000 7f6c6e3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c681553f0 con 0x7f6c6814ae00 2023-07-27T14:39:33.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.384+0000 7f6c6e3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c68157a50 con 0x7f6c6814b1e0 2023-07-27T14:39:33.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.384+0000 7f6c6e3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c68157d10 con 0x7f6c68063260 2023-07-27T14:39:33.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c67fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6c6814ae00 0x7f6c68062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:48576/0 (socket says 172.21.15.115:48576) 2023-07-27T14:39:33.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c67fff700 1 -- 172.21.15.115:0/2574725452 learned_addr learned my addr 172.21.15.115:0/2574725452 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:33.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c677fe700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c68063260 0x7f6c68154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728160820 0 0) 0x7f6c681553f0 con 0x7f6c6814ae00 2023-07-27T14:39:33.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c500033f0 con 0x7f6c6814ae00 2023-07-27T14:39:33.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3938225113 0 0) 0x7f6c500033f0 con 0x7f6c6814ae00 2023-07-27T14:39:33.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c68063260 msgr2=0x7f6c68154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:33.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c68063260 0x7f6c68154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 >> v1:172.21.15.159:6789/0 conn(0x7f6c6814b1e0 legacy=0x7f6c680a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68157ff0 con 0x7f6c6814ae00 2023-07-27T14:39:33.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f6c58001470 con 0x7f6c6814ae00 2023-07-27T14:39:33.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 >> v1:172.21.15.115:6789/0 conn(0x7f6c6814ae00 legacy=0x7f6c68062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.385+0000 7f6c66ffd700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c68063260 0x7f6c50003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c66ffd700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50003e00 0x7f6c50004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c66ffd700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c50004b80 0x7f6c50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c68157d10 con 0x7f6c50004b80 2023-07-27T14:39:33.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5000b8e0 con 0x7f6c50003e00 2023-07-27T14:39:33.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5000baa0 con 0x7f6c68063260 2023-07-27T14:39:33.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c6c99c700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c50004b80 0x7f6c50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c67fff700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c68063260 0x7f6c50003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c677fe700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50003e00 0x7f6c50004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c6c99c700 1 -- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c68063260 msgr2=0x7f6c50003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:33.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c6c99c700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c68063260 0x7f6c50003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c6c99c700 1 -- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50003e00 msgr2=0x7f6c50004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:33.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c6c99c700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50003e00 0x7f6c50004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c6c99c700 1 -- 172.21.15.115:0/2574725452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500033f0 con 0x7f6c50004b80 2023-07-27T14:39:33.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.386+0000 7f6c6c99c700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c50004b80 0x7f6c50005000 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7f6c60001fe0 tx=0x7f6c60007f30).ready entity=mon.0 client_cookie=525274fffdb62d0a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:33.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000c870 con 0x7f6c50004b80 2023-07-27T14:39:33.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c60003030 con 0x7f6c50004b80 2023-07-27T14:39:33.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c66ffd700 1 -- 172.21.15.115:0/2574725452 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000cc20 con 0x7f6c50004b80 2023-07-27T14:39:33.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/2574725452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c50004b80 msgr2=0x7f6c50005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c6e3ff700 1 --2- 172.21.15.115:0/2574725452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c50004b80 0x7f6c50005000 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7f6c60001fe0 tx=0x7f6c60007f30).stop 2023-07-27T14:39:33.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c6c99c700 1 -- 172.21.15.115:0/2574725452 reap_dead start 2023-07-27T14:39:33.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/2574725452 shutdown_connections 2023-07-27T14:39:33.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/2574725452 >> 172.21.15.115:0/2574725452 conn(0x7f6c6805e940 msgr2=0x7f6c680cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:33.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/2574725452 shutdown_connections 2023-07-27T14:39:33.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.387+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/2574725452 wait complete. 2023-07-27T14:39:33.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.389+0000 7f6c6e3ff700 1 Processor -- start 2023-07-27T14:39:33.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.389+0000 7f6c6e3ff700 1 -- start start 2023-07-27T14:39:33.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6e3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c50004b80 0x7f6c6814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6e3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c681670b0 0x7f6c6814e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6e3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c680aee80 0x7f6c680af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6e3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c68168050 con 0x7f6c680aee80 2023-07-27T14:39:33.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6e3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6814aba0 con 0x7f6c681670b0 2023-07-27T14:39:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6e3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680c3000 con 0x7f6c50004b80 2023-07-27T14:39:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6c99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c680aee80 0x7f6c680af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6c99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c680aee80 0x7f6c680af300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41954/0 (socket says 172.21.15.115:41954) 2023-07-27T14:39:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6c99c700 1 -- 172.21.15.115:0/3346932723 learned_addr learned my addr 172.21.15.115:0/3346932723 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c677fe700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c681670b0 0x7f6c6814e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c67fff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c50004b80 0x7f6c6814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6c99c700 1 -- 172.21.15.115:0/3346932723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c50004b80 msgr2=0x7f6c6814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.390+0000 7f6c6c99c700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c50004b80 0x7f6c6814a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c6c99c700 1 -- 172.21.15.115:0/3346932723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c681670b0 msgr2=0x7f6c6814e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c6c99c700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c681670b0 0x7f6c6814e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c6c99c700 1 -- 172.21.15.115:0/3346932723 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68167530 con 0x7f6c680aee80 2023-07-27T14:39:33.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c6c99c700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c680aee80 0x7f6c680af300 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7f6c60010000 tx=0x7f6c60016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:33.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c4ffff700 1 -- 172.21.15.115:0/3346932723 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000ca80 con 0x7f6c680aee80 2023-07-27T14:39:33.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c4ffff700 1 -- 172.21.15.115:0/3346932723 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6000cbe0 con 0x7f6c680aee80 2023-07-27T14:39:33.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6814e670 con 0x7f6c680aee80 2023-07-27T14:39:33.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c4ffff700 1 -- 172.21.15.115:0/3346932723 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60006c50 con 0x7f6c680aee80 2023-07-27T14:39:33.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.391+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c68167a90 con 0x7f6c680aee80 2023-07-27T14:39:33.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.392+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c680c2dd0 con 0x7f6c680aee80 2023-07-27T14:39:33.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.393+0000 7f6c4ffff700 1 -- 172.21.15.115:0/3346932723 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f6c60010030 con 0x7f6c680aee80 2023-07-27T14:39:33.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.394+0000 7f6c4ffff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6c5405fc30 0x7f6c540620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.394+0000 7f6c4ffff700 1 -- 172.21.15.115:0/3346932723 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f6c6007c600 con 0x7f6c680aee80 2023-07-27T14:39:33.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.394+0000 7f6c67fff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6c5405fc30 0x7f6c540620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.394+0000 7f6c67fff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6c5405fc30 0x7f6c540620f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f6c680c51d0 tx=0x7f6c6814eb20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:33.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.398+0000 7f6c4ffff700 1 -- 172.21.15.115:0/3346932723 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c680c2dd0 con 0x7f6c680aee80 2023-07-27T14:39:33.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.614+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c6806c470 con 0x7f6c5405fc30 2023-07-27T14:39:33.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.624+0000 7f6c4ffff700 1 -- 172.21.15.115:0/3346932723 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f6c6806c470 con 0x7f6c5405fc30 2023-07-27T14:39:33.679 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000883025/69f9f56d-9929-4cea-a31b-79469b089fc3 2023-07-27T14:39:33.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6c5405fc30 msgr2=0x7f6c540620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6c5405fc30 0x7f6c540620f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f6c680c51d0 tx=0x7f6c6814eb20).stop 2023-07-27T14:39:33.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c680aee80 msgr2=0x7f6c680af300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c680aee80 0x7f6c680af300 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7f6c60010000 tx=0x7f6c60016000).stop 2023-07-27T14:39:33.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 shutdown_connections 2023-07-27T14:39:33.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6c5405fc30 0x7f6c540620f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c680aee80 0x7f6c680af300 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6c50004b80 0x7f6c6814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 --2- 172.21.15.115:0/3346932723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c681670b0 0x7f6c6814e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 >> 172.21.15.115:0/3346932723 conn(0x7f6c6805e940 msgr2=0x7f6c68064a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:33.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 shutdown_connections 2023-07-27T14:39:33.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.626+0000 7f6c6e3ff700 1 -- 172.21.15.115:0/3346932723 wait complete. 2023-07-27T14:39:33.699 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000871247 2023-07-27T14:39:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.839+0000 7f8dce3ff700 1 Processor -- start 2023-07-27T14:39:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.839+0000 7f8dce3ff700 1 -- start start 2023-07-27T14:39:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dce3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8dc814ae00 0x7f8dc8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dce3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc81553f0 con 0x7f8dc814b1e0 2023-07-27T14:39:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dce3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc8157a50 con 0x7f8dc8063260 2023-07-27T14:39:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dce3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc8157d10 con 0x7f8dc814ae00 2023-07-27T14:39:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dc77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8dc814b1e0 0x7f8dc8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36794/0 (socket says 172.21.15.115:36794) 2023-07-27T14:39:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dc77fe700 1 -- 172.21.15.115:0/4169948779 learned_addr learned my addr 172.21.15.115:0/4169948779 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:33.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609292597 0 0) 0x7f8dc81553f0 con 0x7f8dc814b1e0 2023-07-27T14:39:33.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db00033f0 con 0x7f8dc814b1e0 2023-07-27T14:39:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.841+0000 7f8dc7fff700 1 --2- 172.21.15.115:0/4169948779 >> v2:172.21.15.159:3300/0 conn(0x7f8dc814ae00 0x7f8dc8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659222696 0 0) 0x7f8db00033f0 con 0x7f8dc814b1e0 2023-07-27T14:39:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 >> v2:172.21.15.159:3300/0 conn(0x7f8dc814ae00 msgr2=0x7f8dc8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 --2- 172.21.15.115:0/4169948779 >> v2:172.21.15.159:3300/0 conn(0x7f8dc814ae00 0x7f8dc8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 >> v1:172.21.15.159:6789/0 conn(0x7f8dc8063260 legacy=0x7f8dc80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc8157ff0 con 0x7f8dc814b1e0 2023-07-27T14:39:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f8dbc001470 con 0x7f8dc814b1e0 2023-07-27T14:39:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 >> v1:172.21.15.115:6789/0 conn(0x7f8dc814b1e0 legacy=0x7f8dc8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db00038e0 0x7f8db0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db0004690 0x7f8db0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8db0005000 0x7f8db000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8157d10 con 0x7f8db0004690 2023-07-27T14:39:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db000bf60 con 0x7f8db0005000 2023-07-27T14:39:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db000c0f0 con 0x7f8db00038e0 2023-07-27T14:39:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc77fe700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db0004690 0x7f8db0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc7fff700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db00038e0 0x7f8db0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dcc99c700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8db0005000 0x7f8db000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc77fe700 1 -- 172.21.15.115:0/4169948779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db00038e0 msgr2=0x7f8db0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:33.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc77fe700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db00038e0 0x7f8db0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc77fe700 1 -- 172.21.15.115:0/4169948779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8db0005000 msgr2=0x7f8db000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:33.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc77fe700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8db0005000 0x7f8db000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dc77fe700 1 -- 172.21.15.115:0/4169948779 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00033f0 con 0x7f8db0004690 2023-07-27T14:39:33.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.842+0000 7f8dcc99c700 1 -- 172.21.15.115:0/4169948779 reap_dead start 2023-07-27T14:39:33.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dc77fe700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db0004690 0x7f8db0004b10 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f8dbc00c160 tx=0x7f8dbc001e50).ready entity=mon.0 client_cookie=a414597f57b09134 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:33.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc007a20 con 0x7f8db0004690 2023-07-27T14:39:33.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc00ca90 con 0x7f8db0004690 2023-07-27T14:39:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dc6ffd700 1 -- 172.21.15.115:0/4169948779 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00ce30 con 0x7f8db0004690 2023-07-27T14:39:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dce3ff700 1 -- 172.21.15.115:0/4169948779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db0004690 msgr2=0x7f8db0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dce3ff700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db0004690 0x7f8db0004b10 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f8dbc00c160 tx=0x7f8dbc001e50).stop 2023-07-27T14:39:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dce3ff700 1 -- 172.21.15.115:0/4169948779 shutdown_connections 2023-07-27T14:39:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dce3ff700 1 --2- 172.21.15.115:0/4169948779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db0004690 0x7f8db0004b10 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dce3ff700 1 -- 172.21.15.115:0/4169948779 >> 172.21.15.115:0/4169948779 conn(0x7f8dc805e940 msgr2=0x7f8dc80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:33.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.843+0000 7f8dce3ff700 1 -- 172.21.15.115:0/4169948779 shutdown_connections 2023-07-27T14:39:33.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.844+0000 7f8dce3ff700 1 -- 172.21.15.115:0/4169948779 wait complete. 2023-07-27T14:39:33.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.845+0000 7f8dce3ff700 1 Processor -- start 2023-07-27T14:39:33.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.845+0000 7f8dce3ff700 1 -- start start 2023-07-27T14:39:33.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dce3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db0004690 0x7f8dc80b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dce3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc8164b60 0x7f8dc8064550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dce3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc8064a40 0x7f8dc80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dce3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80b0c30 con 0x7f8dc8064a40 2023-07-27T14:39:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dce3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc814a950 con 0x7f8dc8164b60 2023-07-27T14:39:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dce3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc81646d0 con 0x7f8db0004690 2023-07-27T14:39:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dcc99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc8064a40 0x7f8dc80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dcc99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc8064a40 0x7f8dc80adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49548/0 (socket says 172.21.15.115:49548) 2023-07-27T14:39:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dcc99c700 1 -- 172.21.15.115:0/770947866 learned_addr learned my addr 172.21.15.115:0/770947866 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dc77fe700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc8164b60 0x7f8dc8064550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.846+0000 7f8dc7fff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db0004690 0x7f8dc80b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dcc99c700 1 -- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db0004690 msgr2=0x7f8dc80b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dcc99c700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db0004690 0x7f8dc80b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dcc99c700 1 -- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc8164b60 msgr2=0x7f8dc8064550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dcc99c700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc8164b60 0x7f8dc8064550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dcc99c700 1 -- 172.21.15.115:0/770947866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc8064ea0 con 0x7f8dc8064a40 2023-07-27T14:39:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dc7fff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db0004690 0x7f8dc80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dc77fe700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc8164b60 0x7f8dc8064550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:33.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dcc99c700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc8064a40 0x7f8dc80adb60 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f8dc80cb870 tx=0x7f8dc0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8daffff700 1 -- 172.21.15.115:0/770947866 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000eea0 con 0x7f8dc8064a40 2023-07-27T14:39:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8daffff700 1 -- 172.21.15.115:0/770947866 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc0006c30 con 0x7f8dc8064a40 2023-07-27T14:39:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8daffff700 1 -- 172.21.15.115:0/770947866 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00030d0 con 0x7f8dc8064a40 2023-07-27T14:39:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc80ae7e0 con 0x7f8dc8064a40 2023-07-27T14:39:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.847+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc8164360 con 0x7f8dc8064a40 2023-07-27T14:39:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.848+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc806c470 con 0x7f8dc8064a40 2023-07-27T14:39:33.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.849+0000 7f8daffff700 1 -- 172.21.15.115:0/770947866 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f8dc001e070 con 0x7f8dc8064a40 2023-07-27T14:39:33.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.850+0000 7f8daffff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8db405fc30 0x7f8db40620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:33.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.850+0000 7f8daffff700 1 -- 172.21.15.115:0/770947866 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f8dc007a740 con 0x7f8dc8064a40 2023-07-27T14:39:33.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.850+0000 7f8dc7fff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8db405fc30 0x7f8db40620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:33.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.850+0000 7f8dc7fff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8db405fc30 0x7f8db40620f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f8dc8157950 tx=0x7f8db8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:33.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:33.854+0000 7f8daffff700 1 -- 172.21.15.115:0/770947866 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8dc004e5d0 con 0x7f8dc8064a40 2023-07-27T14:39:34.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.053+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dc8164810 con 0x7f8db405fc30 2023-07-27T14:39:34.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.058+0000 7f8daffff700 1 -- 172.21.15.115:0/770947866 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f8dc8164810 con 0x7f8db405fc30 2023-07-27T14:39:34.114 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a 2023-07-27T14:39:34.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8db405fc30 msgr2=0x7f8db40620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:34.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8db405fc30 0x7f8db40620f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f8dc8157950 tx=0x7f8db8008040).stop 2023-07-27T14:39:34.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc8064a40 msgr2=0x7f8dc80adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:34.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc8064a40 0x7f8dc80adb60 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f8dc80cb870 tx=0x7f8dc0009040).stop 2023-07-27T14:39:34.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 shutdown_connections 2023-07-27T14:39:34.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8db405fc30 0x7f8db40620f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc8064a40 0x7f8dc80adb60 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8db0004690 0x7f8dc80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 --2- 172.21.15.115:0/770947866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dc8164b60 0x7f8dc8064550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 >> 172.21.15.115:0/770947866 conn(0x7f8dc805e940 msgr2=0x7f8dc8152030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:34.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 shutdown_connections 2023-07-27T14:39:34.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.060+0000 7f8dce3ff700 1 -- 172.21.15.115:0/770947866 wait complete. 2023-07-27T14:39:34.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:34.133 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:34.180 INFO:teuthology.orchestra.run.smithi115.stdout:9 2023-07-27T14:39:34.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:34.182 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a) 2023-07-27T14:39:34.230 INFO:teuthology.orchestra.run.smithi115.stdout:9 2023-07-27T14:39:34.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs clone_0000000000871247 2023-07-27T14:39:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.370+0000 7fc9921ff700 1 Processor -- start 2023-07-27T14:39:34.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.370+0000 7fc9921ff700 1 -- start start 2023-07-27T14:39:34.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.371+0000 7fc9921ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c0bfb50 0x7fc98c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:34.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.371+0000 7fc9921ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc98c0c0610 0x7fc98c0c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:34.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.371+0000 7fc9921ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c0c60a0 con 0x7fc98c153f30 2023-07-27T14:39:34.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.371+0000 7fc9921ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0c0f90 con 0x7fc98c0c0610 2023-07-27T14:39:34.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.371+0000 7fc9921ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0c5d70 con 0x7fc98c0bfb50 2023-07-27T14:39:34.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc98c153f30 0x7fc98c0a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36808/0 (socket says 172.21.15.115:36808) 2023-07-27T14:39:34.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98b7fe700 1 -- 172.21.15.115:0/3787793028 learned_addr learned my addr 172.21.15.115:0/3787793028 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98affd700 1 --2- 172.21.15.115:0/3787793028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c0bfb50 0x7fc98c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98bfff700 1 --2- 172.21.15.115:0/3787793028 >> v2:172.21.15.159:3300/0 conn(0x7fc98c0c0610 0x7fc98c0c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98a7fc700 1 -- 172.21.15.115:0/3787793028 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108519993 0 0) 0x7fc98c0c60a0 con 0x7fc98c153f30 2023-07-27T14:39:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98a7fc700 1 -- 172.21.15.115:0/3787793028 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9740033f0 con 0x7fc98c153f30 2023-07-27T14:39:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98a7fc700 1 -- 172.21.15.115:0/3787793028 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80027995 0 0) 0x7fc9740033f0 con 0x7fc98c153f30 2023-07-27T14:39:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98affd700 1 -- 172.21.15.115:0/3787793028 >> v2:172.21.15.159:3300/0 conn(0x7fc98c0c0610 msgr2=0x7fc98c0c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:34.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98affd700 1 --2- 172.21.15.115:0/3787793028 >> v2:172.21.15.159:3300/0 conn(0x7fc98c0c0610 0x7fc98c0c0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98affd700 1 -- 172.21.15.115:0/3787793028 >> v1:172.21.15.115:6789/0 conn(0x7fc98c153f30 legacy=0x7fc98c0a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98affd700 1 -- 172.21.15.115:0/3787793028 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0c7d80 con 0x7fc98c0bfb50 2023-07-27T14:39:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.372+0000 7fc98bfff700 1 --2- 172.21.15.115:0/3787793028 >> v2:172.21.15.159:3300/0 conn(0x7fc98c0c0610 0x7fc98c0c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.373+0000 7fc98affd700 1 --2- 172.21.15.115:0/3787793028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c0bfb50 0x7fc98c0c7550 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc980009760 tx=0x7fc980009060).ready entity=mon.2 client_cookie=397590c1c50fdc51 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.373+0000 7fc98a7fc700 1 -- 172.21.15.115:0/3787793028 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c001470 con 0x7fc98c0bfb50 2023-07-27T14:39:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.373+0000 7fc98a7fc700 1 -- 172.21.15.115:0/3787793028 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc980011400 con 0x7fc98c0bfb50 2023-07-27T14:39:34.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.373+0000 7fc98a7fc700 1 -- 172.21.15.115:0/3787793028 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980011780 con 0x7fc98c0bfb50 2023-07-27T14:39:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.373+0000 7fc9921ff700 1 -- 172.21.15.115:0/3787793028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c0bfb50 msgr2=0x7fc98c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.373+0000 7fc9921ff700 1 --2- 172.21.15.115:0/3787793028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c0bfb50 0x7fc98c0c7550 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc980009760 tx=0x7fc980009060).stop 2023-07-27T14:39:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.374+0000 7fc9921ff700 1 -- 172.21.15.115:0/3787793028 shutdown_connections 2023-07-27T14:39:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.374+0000 7fc9921ff700 1 --2- 172.21.15.115:0/3787793028 >> v2:172.21.15.159:3300/0 conn(0x7fc98c0c0610 0x7fc98c0c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.374+0000 7fc9921ff700 1 --2- 172.21.15.115:0/3787793028 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c0bfb50 0x7fc98c0c7550 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.374+0000 7fc9921ff700 1 -- 172.21.15.115:0/3787793028 >> 172.21.15.115:0/3787793028 conn(0x7fc98c094280 msgr2=0x7fc98c05e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:34.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.374+0000 7fc9921ff700 1 -- 172.21.15.115:0/3787793028 shutdown_connections 2023-07-27T14:39:34.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.374+0000 7fc9921ff700 1 -- 172.21.15.115:0/3787793028 wait complete. 2023-07-27T14:39:34.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.375+0000 7fc9921ff700 1 Processor -- start 2023-07-27T14:39:34.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.375+0000 7fc9921ff700 1 -- start start 2023-07-27T14:39:34.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc9921ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc98c0bfb50 0x7fc98c14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:34.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc9921ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc98c0c0610 0x7fc98c155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:34.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc9921ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c153f30 0x7fc98c155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:34.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc9921ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0ac970 con 0x7fc98c0c0610 2023-07-27T14:39:34.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc9921ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0cb5d0 con 0x7fc98c0bfb50 2023-07-27T14:39:34.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc9921ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c155c40 con 0x7fc98c153f30 2023-07-27T14:39:34.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc98affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc98c0c0610 0x7fc98c155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:34.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc98affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc98c0c0610 0x7fc98c155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49558/0 (socket says 172.21.15.115:49558) 2023-07-27T14:39:34.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.376+0000 7fc98affd700 1 -- 172.21.15.115:0/1662125059 learned_addr learned my addr 172.21.15.115:0/1662125059 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:34.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98b7fe700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc98c0bfb50 0x7fc98c14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:34.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98bfff700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c153f30 0x7fc98c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:34.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98affd700 1 -- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c153f30 msgr2=0x7fc98c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:34.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98affd700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c153f30 0x7fc98c155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98affd700 1 -- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc98c0bfb50 msgr2=0x7fc98c14e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:34.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98affd700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc98c0bfb50 0x7fc98c14e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98affd700 1 -- 172.21.15.115:0/1662125059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984009a20 con 0x7fc98c0c0610 2023-07-27T14:39:34.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98b7fe700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc98c0bfb50 0x7fc98c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:34.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc98affd700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc98c0c0610 0x7fc98c155260 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7fc980011880 tx=0x7fc980016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:34.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc9737fe700 1 -- 172.21.15.115:0/1662125059 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980010920 con 0x7fc98c0c0610 2023-07-27T14:39:34.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc9737fe700 1 -- 172.21.15.115:0/1662125059 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc980010a80 con 0x7fc98c0c0610 2023-07-27T14:39:34.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9800092a0 con 0x7fc98c0c0610 2023-07-27T14:39:34.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc9737fe700 1 -- 172.21.15.115:0/1662125059 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980010e00 con 0x7fc98c0c0610 2023-07-27T14:39:34.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.377+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c0ca5c0 con 0x7fc98c0c0610 2023-07-27T14:39:34.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.378+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c06c470 con 0x7fc98c0c0610 2023-07-27T14:39:34.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.379+0000 7fc9737fe700 1 -- 172.21.15.115:0/1662125059 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7fc98000f070 con 0x7fc98c0c0610 2023-07-27T14:39:34.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.380+0000 7fc9737fe700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc97805fc30 0x7fc9780620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:34.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.380+0000 7fc9737fe700 1 -- 172.21.15.115:0/1662125059 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fc98007be20 con 0x7fc98c0c0610 2023-07-27T14:39:34.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.380+0000 7fc98b7fe700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc97805fc30 0x7fc9780620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:34.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.381+0000 7fc98b7fe700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc97805fc30 0x7fc9780620f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fc98c0ca350 tx=0x7fc97c0015e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:34.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.384+0000 7fc9737fe700 1 -- 172.21.15.115:0/1662125059 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc98004c390 con 0x7fc98c0c0610 2023-07-27T14:39:34.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.586+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7fc98c0cb7c0 con 0x7fc97805fc30 2023-07-27T14:39:34.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.593+0000 7fc9737fe700 1 -- 172.21.15.115:0/1662125059 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+744 (secure 0 0 0) 0x7fc98c0cb7c0 con 0x7fc97805fc30 2023-07-27T14:39:34.649 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "atime": "2023-07-27 14:39:09", 2023-07-27T14:39:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_pcent": "66.67", 2023-07-27T14:39:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_quota": 12582912, 2023-07-27T14:39:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_used": 8388608, 2023-07-27T14:39:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "created_at": "2023-07-27 14:39:15", 2023-07-27T14:39:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "ctime": "2023-07-27 14:39:31", 2023-07-27T14:39:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "data_pool": "cephfs_data", 2023-07-27T14:39:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "features": [ 2023-07-27T14:39:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-clone", 2023-07-27T14:39:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-autoprotect", 2023-07-27T14:39:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-retention" 2023-07-27T14:39:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:39:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "gid": 0, 2023-07-27T14:39:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "mode": 16895, 2023-07-27T14:39:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "mon_addrs": [ 2023-07-27T14:39:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.115:6789", 2023-07-27T14:39:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6789", 2023-07-27T14:39:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6790" 2023-07-27T14:39:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:39:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "mtime": "2023-07-27 14:39:10", 2023-07-27T14:39:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a", 2023-07-27T14:39:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "pool_namespace": "fsvolumens_subvolume_0000000000883025", 2023-07-27T14:39:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete", 2023-07-27T14:39:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "clone", 2023-07-27T14:39:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "uid": 0 2023-07-27T14:39:34.652 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:34.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc97805fc30 msgr2=0x7fc9780620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:34.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc97805fc30 0x7fc9780620f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fc98c0ca350 tx=0x7fc97c0015e0).stop 2023-07-27T14:39:34.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc98c0c0610 msgr2=0x7fc98c155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:34.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc98c0c0610 0x7fc98c155260 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7fc980011880 tx=0x7fc980016000).stop 2023-07-27T14:39:34.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 shutdown_connections 2023-07-27T14:39:34.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc97805fc30 0x7fc9780620f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc98c153f30 0x7fc98c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc98c0bfb50 0x7fc98c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 --2- 172.21.15.115:0/1662125059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc98c0c0610 0x7fc98c155260 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:34.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 >> 172.21.15.115:0/1662125059 conn(0x7fc98c094280 msgr2=0x7fc98c0c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:34.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 shutdown_connections 2023-07-27T14:39:34.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:34.596+0000 7fc9921ff700 1 -- 172.21.15.115:0/1662125059 wait complete. 2023-07-27T14:39:34.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:34.668 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:34.714 INFO:teuthology.orchestra.run.smithi115.stderr:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3: ceph.quota.max_bytes: No such attribute 2023-07-27T14:39:34.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:39:34.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:34.716 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:34.763 INFO:teuthology.orchestra.run.smithi115.stdout:cephfs_data 2023-07-27T14:39:34.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:34.764 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:34.811 INFO:teuthology.orchestra.run.smithi115.stdout:fsvolumens_subvolume_0000000000883025 2023-07-27T14:39:34.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:34.812 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:34.899 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3 2023-07-27T14:39:34.899 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.2 2023-07-27T14:39:34.899 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.5 2023-07-27T14:39:34.899 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.4 2023-07-27T14:39:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.7 2023-07-27T14:39:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.6 2023-07-27T14:39:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.0 2023-07-27T14:39:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.3 2023-07-27T14:39:34.900 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.1 2023-07-27T14:39:34.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:34.901 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:34.947 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:39:34.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:34.949 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/) 2023-07-27T14:39:35.034 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:39:35.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.036 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:35.081 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:39:35.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.083 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/) 2023-07-27T14:39:35.169 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:39:35.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.171 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:35.217 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:39:35.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.219 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/) 2023-07-27T14:39:35.304 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:39:35.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.306 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3) 2023-07-27T14:39:35.351 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:35.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.354 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/) 2023-07-27T14:39:35.438 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:35.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.439 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.2) 2023-07-27T14:39:35.526 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:35.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.528 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.2) 2023-07-27T14:39:35.574 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:35.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.576 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.2) 2023-07-27T14:39:35.661 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:35.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.663 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.2) 2023-07-27T14:39:35.708 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:35.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.711 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.2) 2023-07-27T14:39:35.797 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:35.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.798 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.2) 2023-07-27T14:39:35.885 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:35.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.886 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.2) 2023-07-27T14:39:35.933 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:35.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:35.935 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.2) 2023-07-27T14:39:36.020 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:36.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.022 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.5) 2023-07-27T14:39:36.069 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:36.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.071 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.5) 2023-07-27T14:39:36.118 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:36.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.120 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.5) 2023-07-27T14:39:36.206 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:36.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.207 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.5) 2023-07-27T14:39:36.254 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:36.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.256 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.5) 2023-07-27T14:39:36.302 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:36.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.305 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.5) 2023-07-27T14:39:36.352 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:36.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.354 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.5) 2023-07-27T14:39:36.439 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:36.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.441 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.5) 2023-07-27T14:39:36.487 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:36.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.489 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.4) 2023-07-27T14:39:36.575 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:36.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.576 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.4) 2023-07-27T14:39:36.622 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:36.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.624 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.4) 2023-07-27T14:39:36.669 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:36.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.671 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.4) 2023-07-27T14:39:36.716 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:36.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.718 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.4) 2023-07-27T14:39:36.804 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:36.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.805 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.4) 2023-07-27T14:39:36.891 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:36.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.893 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.4) 2023-07-27T14:39:36.978 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:36.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:36.979 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.4) 2023-07-27T14:39:37.065 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:37.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.067 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.7) 2023-07-27T14:39:37.153 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:37.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.154 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.7) 2023-07-27T14:39:37.201 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:37.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.203 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.7) 2023-07-27T14:39:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:37.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.251 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.7) 2023-07-27T14:39:37.297 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:37.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.299 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.7) 2023-07-27T14:39:37.385 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:37.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.386 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.7) 2023-07-27T14:39:37.472 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:37.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.474 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.7) 2023-07-27T14:39:37.521 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:37.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.523 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.7) 2023-07-27T14:39:37.568 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:37.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.571 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.6) 2023-07-27T14:39:37.656 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:37.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.657 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.6) 2023-07-27T14:39:37.708 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:37.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.710 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.6) 2023-07-27T14:39:37.756 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:37.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.759 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.6) 2023-07-27T14:39:37.805 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:37.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.807 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.6) 2023-07-27T14:39:37.892 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:37.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.894 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.6) 2023-07-27T14:39:37.980 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:37.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:37.982 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.6) 2023-07-27T14:39:38.068 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:38.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.069 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.6) 2023-07-27T14:39:38.156 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:38.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.158 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.0) 2023-07-27T14:39:38.204 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:38.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.206 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.0) 2023-07-27T14:39:38.253 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:38.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.254 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.0) 2023-07-27T14:39:38.300 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:38.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.302 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.0) 2023-07-27T14:39:38.353 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:38.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.354 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.0) 2023-07-27T14:39:38.439 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:38.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.441 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.0) 2023-07-27T14:39:38.526 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:38.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.528 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.0) 2023-07-27T14:39:38.613 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:38.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.615 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.0) 2023-07-27T14:39:38.703 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:38.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.704 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.3) 2023-07-27T14:39:38.751 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:38.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.753 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.3) 2023-07-27T14:39:38.799 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:38.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.801 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.3) 2023-07-27T14:39:38.847 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:38.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.848 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.3) 2023-07-27T14:39:38.934 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:38.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:38.936 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.3) 2023-07-27T14:39:39.021 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:39.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.024 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.3) 2023-07-27T14:39:39.074 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:39.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.076 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.3) 2023-07-27T14:39:39.122 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:39.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.124 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.3) 2023-07-27T14:39:39.209 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:39.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.211 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.1) 2023-07-27T14:39:39.297 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:39.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.299 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.1) 2023-07-27T14:39:39.345 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:39:39.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.348 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.1) 2023-07-27T14:39:39.434 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:39.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.435 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.1) 2023-07-27T14:39:39.520 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:39:39.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.523 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.1) 2023-07-27T14:39:39.608 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:39.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.610 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.1) 2023-07-27T14:39:39.656 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:39:39.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.658 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000883025/.snap/snapshot_0000000001037341/69f9f56d-9929-4cea-a31b-79469b089fc3/subvolume_file.1) 2023-07-27T14:39:39.743 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:39.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:39.745 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000871247/abe58b30-d61f-4d8e-8f5a-ece7156f337a/subvolume_file.1) 2023-07-27T14:39:39.830 INFO:teuthology.orchestra.run.smithi115.stdout:1690468750 2023-07-27T14:39:39.831 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000883025 snapshot_0000000001037341 2023-07-27T14:39:40.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.969+0000 7f5f23dff700 1 Processor -- start 2023-07-27T14:39:40.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.970+0000 7f5f23dff700 1 -- start start 2023-07-27T14:39:40.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f23dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5f1c14ae00 0x7f5f1c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f23dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5f1c14b1e0 0x7f5f1c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f23dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c1553f0 con 0x7f5f1c0c5c50 2023-07-27T14:39:40.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f23dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c157a50 con 0x7f5f1c14ae00 2023-07-27T14:39:40.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f23dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c157d10 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f21b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5f1c14ae00 0x7f5f1c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f21b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5f1c14ae00 0x7f5f1c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49572/0 (socket says 172.21.15.115:49572) 2023-07-27T14:39:40.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f21b9b700 1 -- 172.21.15.115:0/1545335120 learned_addr learned my addr 172.21.15.115:0/1545335120 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:40.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.971+0000 7f5f2139a700 1 --2- 172.21.15.115:0/1545335120 >> v2:172.21.15.159:3300/0 conn(0x7f5f1c14b1e0 0x7f5f1c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.972+0000 7f5f21b9b700 1 -- 172.21.15.115:0/1545335120 >> v2:172.21.15.159:3300/0 conn(0x7f5f1c14b1e0 msgr2=0x7f5f1c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:40.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.972+0000 7f5f21b9b700 1 --2- 172.21.15.115:0/1545335120 >> v2:172.21.15.159:3300/0 conn(0x7f5f1c14b1e0 0x7f5f1c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.972+0000 7f5f21b9b700 1 -- 172.21.15.115:0/1545335120 >> v1:172.21.15.159:6789/0 conn(0x7f5f1c0c5c50 legacy=0x7f5f1c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.972+0000 7f5f21b9b700 1 -- 172.21.15.115:0/1545335120 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c157ff0 con 0x7f5f1c14ae00 2023-07-27T14:39:40.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.972+0000 7f5f21b9b700 1 --2- 172.21.15.115:0/1545335120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14ae00 0x7f5f1c154f00 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7f5f1c155580 tx=0x7f5f180090f0).ready entity=mon.0 client_cookie=c8c38a9d1877c6ce server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.972+0000 7f5f20b99700 1 -- 172.21.15.115:0/1545335120 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1800b600 con 0x7f5f1c14ae00 2023-07-27T14:39:40.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.972+0000 7f5f20b99700 1 -- 172.21.15.115:0/1545335120 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1800b760 con 0x7f5f1c14ae00 2023-07-27T14:39:40.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.972+0000 7f5f20b99700 1 -- 172.21.15.115:0/1545335120 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1800bae0 con 0x7f5f1c14ae00 2023-07-27T14:39:40.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.973+0000 7f5f23dff700 1 -- 172.21.15.115:0/1545335120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14ae00 msgr2=0x7f5f1c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.973+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1545335120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14ae00 0x7f5f1c154f00 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 rx=0x7f5f1c155580 tx=0x7f5f180090f0).stop 2023-07-27T14:39:40.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.973+0000 7f5f23dff700 1 -- 172.21.15.115:0/1545335120 shutdown_connections 2023-07-27T14:39:40.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.973+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1545335120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14ae00 0x7f5f1c154f00 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.973+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1545335120 >> v2:172.21.15.159:3300/0 conn(0x7f5f1c14b1e0 0x7f5f1c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.973+0000 7f5f23dff700 1 -- 172.21.15.115:0/1545335120 >> 172.21.15.115:0/1545335120 conn(0x7f5f1c05e940 msgr2=0x7f5f1c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:40.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.973+0000 7f5f23dff700 1 -- 172.21.15.115:0/1545335120 shutdown_connections 2023-07-27T14:39:40.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.973+0000 7f5f23dff700 1 -- 172.21.15.115:0/1545335120 wait complete. 2023-07-27T14:39:40.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.974+0000 7f5f23dff700 1 Processor -- start 2023-07-27T14:39:40.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.974+0000 7f5f23dff700 1 -- start start 2023-07-27T14:39:40.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.975+0000 7f5f23dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0c5c50 0x7f5f1c0c2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.975+0000 7f5f23dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f1c14ae00 0x7f5f1c0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.975+0000 7f5f23dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14b1e0 0x7f5f1c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f23dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0c8030 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f23dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0c2be0 con 0x7f5f1c0c5c50 2023-07-27T14:39:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f23dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0af0e0 con 0x7f5f1c14ae00 2023-07-27T14:39:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14b1e0 0x7f5f1c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14b1e0 0x7f5f1c0c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49574/0 (socket says 172.21.15.115:49574) 2023-07-27T14:39:40.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 -- 172.21.15.115:0/1435433531 learned_addr learned my addr 172.21.15.115:0/1435433531 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f21b9b700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0c5c50 0x7f5f1c0c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2139a700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f1c14ae00 0x7f5f1c0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 -- 172.21.15.115:0/1435433531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f1c14ae00 msgr2=0x7f5f1c0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f1c14ae00 0x7f5f1c0c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 -- 172.21.15.115:0/1435433531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0c5c50 msgr2=0x7f5f1c0c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0c5c50 0x7f5f1c0c2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 -- 172.21.15.115:0/1435433531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f18009370 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.976+0000 7f5f2239c700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14b1e0 0x7f5f1c0c7b40 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7f5f1400c7c0 tx=0x7f5f14001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.977+0000 7f5f11ffb700 1 -- 172.21.15.115:0/1435433531 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1400e4a0 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.977+0000 7f5f11ffb700 1 -- 172.21.15.115:0/1435433531 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1400e600 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.977+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c0ae7b0 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.977+0000 7f5f11ffb700 1 -- 172.21.15.115:0/1435433531 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1400e980 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.977+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c0aed70 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.978+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c06c470 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.979+0000 7f5f11ffb700 1 -- 172.21.15.115:0/1435433531 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f5f14019030 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.979+0000 7f5f11ffb700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f0005fc30 0x7f5f000620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.980+0000 7f5f11ffb700 1 -- 172.21.15.115:0/1435433531 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f5f1407a7e0 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.980+0000 7f5f21b9b700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f0005fc30 0x7f5f000620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.980+0000 7f5f21b9b700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f0005fc30 0x7f5f000620f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f5f1c155580 tx=0x7f5f18017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:39.984+0000 7f5f11ffb700 1 -- 172.21.15.115:0/1435433531 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f140488f0 con 0x7f5f1c14b1e0 2023-07-27T14:39:40.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.190+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "snap_name": "snapshot_0000000001037341", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f1c0af220 con 0x7f5f0005fc30 2023-07-27T14:39:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.219+0000 7f5f11ffb700 1 -- 172.21.15.115:0/1435433531 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5f1c0af220 con 0x7f5f0005fc30 2023-07-27T14:39:40.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f0005fc30 msgr2=0x7f5f000620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f0005fc30 0x7f5f000620f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f5f1c155580 tx=0x7f5f18017000).stop 2023-07-27T14:39:40.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14b1e0 msgr2=0x7f5f1c0c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14b1e0 0x7f5f1c0c7b40 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7f5f1400c7c0 tx=0x7f5f14001560).stop 2023-07-27T14:39:40.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 shutdown_connections 2023-07-27T14:39:40.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5f0005fc30 0x7f5f000620f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f1c14b1e0 0x7f5f1c0c7b40 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f1c0c5c50 0x7f5f1c0c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 --2- 172.21.15.115:0/1435433531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5f1c14ae00 0x7f5f1c0c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 >> 172.21.15.115:0/1435433531 conn(0x7f5f1c05e940 msgr2=0x7f5f1c1535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:40.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 shutdown_connections 2023-07-27T14:39:40.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.221+0000 7f5f23dff700 1 -- 172.21.15.115:0/1435433531 wait complete. 2023-07-27T14:39:40.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000883025 2023-07-27T14:39:40.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.428+0000 7f9853dff700 1 Processor -- start 2023-07-27T14:39:40.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.428+0000 7f9853dff700 1 -- start start 2023-07-27T14:39:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f9853dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14ae00 0x7f984c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f9853dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f984c063260 0x7f984c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f9853dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c1553f0 con 0x7f984c14b1e0 2023-07-27T14:39:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f9853dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c157a50 con 0x7f984c063260 2023-07-27T14:39:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f9853dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c157d10 con 0x7f984c14ae00 2023-07-27T14:39:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f985239c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f984c063260 0x7f984c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f985239c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f984c063260 0x7f984c0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49590/0 (socket says 172.21.15.115:49590) 2023-07-27T14:39:40.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f985239c700 1 -- 172.21.15.115:0/3482489520 learned_addr learned my addr 172.21.15.115:0/3482489520 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:40.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.430+0000 7f9851b9b700 1 --2- 172.21.15.115:0/3482489520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14ae00 0x7f984c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f985239c700 1 -- 172.21.15.115:0/3482489520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14ae00 msgr2=0x7f984c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:40.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f985239c700 1 --2- 172.21.15.115:0/3482489520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14ae00 0x7f984c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f985239c700 1 -- 172.21.15.115:0/3482489520 >> v1:172.21.15.159:6789/0 conn(0x7f984c14b1e0 legacy=0x7f984c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f985239c700 1 -- 172.21.15.115:0/3482489520 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c157ff0 con 0x7f984c063260 2023-07-27T14:39:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f9851b9b700 1 --2- 172.21.15.115:0/3482489520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14ae00 0x7f984c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f985239c700 1 --2- 172.21.15.115:0/3482489520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a98c0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7f9844009f20 tx=0x7f9844009840).ready entity=mon.0 client_cookie=9bb36202cd04491f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f9850b99700 1 -- 172.21.15.115:0/3482489520 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984400e070 con 0x7f984c063260 2023-07-27T14:39:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f9850b99700 1 -- 172.21.15.115:0/3482489520 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984400ba80 con 0x7f984c063260 2023-07-27T14:39:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f9850b99700 1 -- 172.21.15.115:0/3482489520 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984400be00 con 0x7f984c063260 2023-07-27T14:39:40.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f9853dff700 1 -- 172.21.15.115:0/3482489520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 msgr2=0x7f984c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.431+0000 7f9853dff700 1 --2- 172.21.15.115:0/3482489520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a98c0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7f9844009f20 tx=0x7f9844009840).stop 2023-07-27T14:39:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.432+0000 7f9853dff700 1 -- 172.21.15.115:0/3482489520 shutdown_connections 2023-07-27T14:39:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.432+0000 7f9853dff700 1 --2- 172.21.15.115:0/3482489520 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14ae00 0x7f984c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.432+0000 7f9853dff700 1 --2- 172.21.15.115:0/3482489520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a98c0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.432+0000 7f9853dff700 1 -- 172.21.15.115:0/3482489520 >> 172.21.15.115:0/3482489520 conn(0x7f984c05e940 msgr2=0x7f984c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.432+0000 7f9853dff700 1 -- 172.21.15.115:0/3482489520 shutdown_connections 2023-07-27T14:39:40.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.432+0000 7f9853dff700 1 -- 172.21.15.115:0/3482489520 wait complete. 2023-07-27T14:39:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.433+0000 7f9853dff700 1 Processor -- start 2023-07-27T14:39:40.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.433+0000 7f9853dff700 1 -- start start 2023-07-27T14:39:40.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9853dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9853dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984c14ae00 0x7f984c0a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9853dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14b1e0 0x7f984c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9853dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0aa3d0 con 0x7f984c063260 2023-07-27T14:39:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9853dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0c2160 con 0x7f984c14ae00 2023-07-27T14:39:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9853dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0b0630 con 0x7f984c14b1e0 2023-07-27T14:39:40.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9851b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9851b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49604/0 (socket says 172.21.15.115:49604) 2023-07-27T14:39:40.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.434+0000 7f9851b9b700 1 -- 172.21.15.115:0/3818237359 learned_addr learned my addr 172.21.15.115:0/3818237359 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:40.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9851b9b700 1 -- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14b1e0 msgr2=0x7f984c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f985139a700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984c14ae00 0x7f984c0a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f985239c700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14b1e0 0x7f984c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9851b9b700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14b1e0 0x7f984c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9851b9b700 1 -- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984c14ae00 msgr2=0x7f984c0a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9851b9b700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984c14ae00 0x7f984c0a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9851b9b700 1 -- 172.21.15.115:0/3818237359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844009ae0 con 0x7f984c063260 2023-07-27T14:39:40.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f985239c700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14b1e0 0x7f984c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:40.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f985139a700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984c14ae00 0x7f984c0a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:40.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9851b9b700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a99f0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7f984800d860 tx=0x7f9848008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9841ffb700 1 -- 172.21.15.115:0/3818237359 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848011590 con 0x7f984c063260 2023-07-27T14:39:40.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9841ffb700 1 -- 172.21.15.115:0/3818237359 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98480116f0 con 0x7f984c063260 2023-07-27T14:39:40.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c0b0910 con 0x7f984c063260 2023-07-27T14:39:40.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9841ffb700 1 -- 172.21.15.115:0/3818237359 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848011a70 con 0x7f984c063260 2023-07-27T14:39:40.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.435+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c0c4830 con 0x7f984c063260 2023-07-27T14:39:40.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.436+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c0c2440 con 0x7f984c063260 2023-07-27T14:39:40.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.437+0000 7f9841ffb700 1 -- 172.21.15.115:0/3818237359 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f9848012420 con 0x7f984c063260 2023-07-27T14:39:40.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.438+0000 7f9841ffb700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f983005fc30 0x7f98300620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.438+0000 7f9841ffb700 1 -- 172.21.15.115:0/3818237359 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f984807b080 con 0x7f984c063260 2023-07-27T14:39:40.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.438+0000 7f985139a700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f983005fc30 0x7f98300620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.438+0000 7f985139a700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f983005fc30 0x7f98300620f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f984c0c4250 tx=0x7f983c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.441+0000 7f9841ffb700 1 -- 172.21.15.115:0/3818237359 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f984804b510 con 0x7f984c063260 2023-07-27T14:39:40.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.639+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000883025", "target": ["mon-mgr", ""]}) v1 -- 0x7f984c0c1c30 con 0x7f983005fc30 2023-07-27T14:39:40.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.659+0000 7f9841ffb700 1 -- 172.21.15.115:0/3818237359 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f984c0c1c30 con 0x7f983005fc30 2023-07-27T14:39:40.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f983005fc30 msgr2=0x7f98300620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f983005fc30 0x7f98300620f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f984c0c4250 tx=0x7f983c009040).stop 2023-07-27T14:39:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 msgr2=0x7f984c0a99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a99f0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 rx=0x7f984800d860 tx=0x7f9848008040).stop 2023-07-27T14:39:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 shutdown_connections 2023-07-27T14:39:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f983005fc30 0x7f98300620f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f984c14b1e0 0x7f984c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f984c063260 0x7f984c0a99f0 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 --2- 172.21.15.115:0/3818237359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f984c14ae00 0x7f984c0a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 >> 172.21.15.115:0/3818237359 conn(0x7f984c05e940 msgr2=0x7f984c1531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:40.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.661+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 shutdown_connections 2023-07-27T14:39:40.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.662+0000 7f9853dff700 1 -- 172.21.15.115:0/3818237359 wait complete. 2023-07-27T14:39:40.721 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.666+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.721 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.666+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.721 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.666+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.721 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.666+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.722 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.666+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.740 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.685+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.740 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.685+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.740 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.685+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.741 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.685+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.741 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:39:40.685+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:39:40.742 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000871247 2023-07-27T14:39:40.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.889+0000 7f1235bff700 1 Processor -- start 2023-07-27T14:39:40.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.889+0000 7f1235bff700 1 -- start start 2023-07-27T14:39:40.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f1235bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f123014ae00 0x7f1230154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f1235bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123014b1e0 0x7f1230062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f1235bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12301553f0 con 0x7f12300c5c50 2023-07-27T14:39:40.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f1235bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1230157a50 con 0x7f123014ae00 2023-07-27T14:39:40.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f1235bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1230157d10 con 0x7f123014b1e0 2023-07-27T14:39:40.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f122ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f12300c5c50 0x7f12300a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36822/0 (socket says 172.21.15.115:36822) 2023-07-27T14:39:40.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f122ffff700 1 -- 172.21.15.115:0/4092616706 learned_addr learned my addr 172.21.15.115:0/4092616706 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:40.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999047650 0 0) 0x7f12301553f0 con 0x7f12300c5c50 2023-07-27T14:39:40.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12180033f0 con 0x7f12300c5c50 2023-07-27T14:39:40.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f122effd700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123014b1e0 0x7f1230062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.891+0000 7f122f7fe700 1 --2- 172.21.15.115:0/4092616706 >> v2:172.21.15.159:3300/0 conn(0x7f123014ae00 0x7f1230154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 400480488 0 0) 0x7f12180033f0 con 0x7f12300c5c50 2023-07-27T14:39:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123014b1e0 msgr2=0x7f1230062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123014b1e0 0x7f1230062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 >> v2:172.21.15.159:3300/0 conn(0x7f123014ae00 msgr2=0x7f1230154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 --2- 172.21.15.115:0/4092616706 >> v2:172.21.15.159:3300/0 conn(0x7f123014ae00 0x7f1230154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1230157ff0 con 0x7f12300c5c50 2023-07-27T14:39:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f12280017f0 con 0x7f12300c5c50 2023-07-27T14:39:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 >> v1:172.21.15.115:6789/0 conn(0x7f12300c5c50 legacy=0x7f12300a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12180038e0 0x7f1218003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123014b1e0 0x7f1218004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1218004b80 0x7f1218005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230157a50 con 0x7f12180038e0 2023-07-27T14:39:40.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230157d10 con 0x7f1218004b80 2023-07-27T14:39:40.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121800b8e0 con 0x7f123014b1e0 2023-07-27T14:39:40.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122f7fe700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12180038e0 0x7f1218003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122effd700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123014b1e0 0x7f1218004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122ffff700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1218004b80 0x7f1218005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122f7fe700 1 -- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123014b1e0 msgr2=0x7f1218004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:40.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122f7fe700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123014b1e0 0x7f1218004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122f7fe700 1 -- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1218004b80 msgr2=0x7f1218005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:40.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122f7fe700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1218004b80 0x7f1218005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.892+0000 7f122f7fe700 1 -- 172.21.15.115:0/4092616706 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180033f0 con 0x7f12180038e0 2023-07-27T14:39:40.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f122f7fe700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12180038e0 0x7f1218003d00 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7f1220009a80 tx=0x7f1220009060).ready entity=mon.0 client_cookie=296e0b62c9a35fc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220009430 con 0x7f12180038e0 2023-07-27T14:39:40.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122000e640 con 0x7f12180038e0 2023-07-27T14:39:40.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f122e7fc700 1 -- 172.21.15.115:0/4092616706 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000e9c0 con 0x7f12180038e0 2023-07-27T14:39:40.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f1235bff700 1 -- 172.21.15.115:0/4092616706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12180038e0 msgr2=0x7f1218003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f1235bff700 1 --2- 172.21.15.115:0/4092616706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12180038e0 0x7f1218003d00 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7f1220009a80 tx=0x7f1220009060).stop 2023-07-27T14:39:40.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f122ffff700 1 -- 172.21.15.115:0/4092616706 reap_dead start 2023-07-27T14:39:40.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f1235bff700 1 -- 172.21.15.115:0/4092616706 shutdown_connections 2023-07-27T14:39:40.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f1235bff700 1 -- 172.21.15.115:0/4092616706 >> 172.21.15.115:0/4092616706 conn(0x7f123005e940 msgr2=0x7f12300cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:40.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.893+0000 7f1235bff700 1 -- 172.21.15.115:0/4092616706 shutdown_connections 2023-07-27T14:39:40.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.894+0000 7f1235bff700 1 -- 172.21.15.115:0/4092616706 wait complete. 2023-07-27T14:39:40.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.895+0000 7f1235bff700 1 Processor -- start 2023-07-27T14:39:40.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.895+0000 7f1235bff700 1 -- start start 2023-07-27T14:39:40.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f1235bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180038e0 0x7f12300c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f1235bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12301491d0 0x7f12300c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f1235bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12300c9870 0x7f12300c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f1235bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12300ae770 con 0x7f12301491d0 2023-07-27T14:39:40.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f1235bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12300ca1c0 con 0x7f12180038e0 2023-07-27T14:39:40.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f1235bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12300adb60 con 0x7f12300c9870 2023-07-27T14:39:40.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f122effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12301491d0 0x7f12300c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f122effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12301491d0 0x7f12300c4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49674/0 (socket says 172.21.15.115:49674) 2023-07-27T14:39:40.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f122effd700 1 -- 172.21.15.115:0/1054606911 learned_addr learned my addr 172.21.15.115:0/1054606911 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:40.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f122f7fe700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180038e0 0x7f12300c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f122effd700 1 -- 172.21.15.115:0/1054606911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12300c9870 msgr2=0x7f12300c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.896+0000 7f122effd700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12300c9870 0x7f12300c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:40.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f122effd700 1 -- 172.21.15.115:0/1054606911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180038e0 msgr2=0x7f12300c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:40.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f122effd700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180038e0 0x7f12300c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:40.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f122effd700 1 -- 172.21.15.115:0/1054606911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12300ade40 con 0x7f12301491d0 2023-07-27T14:39:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f122effd700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12301491d0 0x7f12300c4b20 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f1224011660 tx=0x7f1224008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f12177fe700 1 -- 172.21.15.115:0/1054606911 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224013620 con 0x7f12301491d0 2023-07-27T14:39:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f12177fe700 1 -- 172.21.15.115:0/1054606911 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224013780 con 0x7f12301491d0 2023-07-27T14:39:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f12177fe700 1 -- 172.21.15.115:0/1054606911 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224013b20 con 0x7f12301491d0 2023-07-27T14:39:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12300ae120 con 0x7f12301491d0 2023-07-27T14:39:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.897+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12300c5010 con 0x7f12301491d0 2023-07-27T14:39:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.898+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123006c470 con 0x7f12301491d0 2023-07-27T14:39:40.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.899+0000 7f12177fe700 1 -- 172.21.15.115:0/1054606911 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 35) v1 ==== 77322+0+0 (secure 0 0 0) 0x7f1224012040 con 0x7f12301491d0 2023-07-27T14:39:40.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.900+0000 7f12177fe700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f121c05fc30 0x7f121c0620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:40.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.900+0000 7f12177fe700 1 -- 172.21.15.115:0/1054606911 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f122407bb40 con 0x7f12301491d0 2023-07-27T14:39:40.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.900+0000 7f122f7fe700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f121c05fc30 0x7f121c0620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:40.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.900+0000 7f122f7fe700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f121c05fc30 0x7f121c0620f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f123014a860 tx=0x7f122001a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:40.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:40.904+0000 7f12177fe700 1 -- 172.21.15.115:0/1054606911 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f122404bfa0 con 0x7f12301491d0 2023-07-27T14:39:41.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.103+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000871247", "target": ["mon-mgr", ""]}) v1 -- 0x7f12300ae8b0 con 0x7f121c05fc30 2023-07-27T14:39:41.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.121+0000 7f12177fe700 1 -- 172.21.15.115:0/1054606911 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f12300ae8b0 con 0x7f121c05fc30 2023-07-27T14:39:41.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f121c05fc30 msgr2=0x7f121c0620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:41.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f121c05fc30 0x7f121c0620f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f123014a860 tx=0x7f122001a000).stop 2023-07-27T14:39:41.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12301491d0 msgr2=0x7f12300c4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:41.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12301491d0 0x7f12300c4b20 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f1224011660 tx=0x7f1224008040).stop 2023-07-27T14:39:41.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 shutdown_connections 2023-07-27T14:39:41.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f121c05fc30 0x7f121c0620f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:41.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12300c9870 0x7f12300c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:41.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12180038e0 0x7f12300c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:41.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 --2- 172.21.15.115:0/1054606911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12301491d0 0x7f12300c4b20 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:41.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 >> 172.21.15.115:0/1054606911 conn(0x7f123005e940 msgr2=0x7f12300c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:41.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 shutdown_connections 2023-07-27T14:39:41.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.123+0000 7f1235bff700 1 -- 172.21.15.115:0/1054606911 wait complete. 2023-07-27T14:39:41.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:41.199 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:39:41.294 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:39:41.296 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:39:41.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:39:41.391 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:39:41.511 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:39:41.512 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:39:41.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:41.513 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:39:41.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:39:41.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:41.617 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:39:41.672 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:39:41.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:39:41.673 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:39:41.761 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:39:41.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:39:41.762 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:39:41.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:39:42.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.949+0000 7f44627ff700 1 Processor -- start 2023-07-27T14:39:42.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.949+0000 7f44627ff700 1 -- start start 2023-07-27T14:39:42.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.950+0000 7f44627ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.950+0000 7f44627ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f445c0aa050 0x7f445c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f44627ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c0aa4d0 con 0x7f445c0aaa40 2023-07-27T14:39:42.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f44627ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0c05c0 con 0x7f445c0aa050 2023-07-27T14:39:42.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f44627ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c1a60 con 0x7f445c153ec0 2023-07-27T14:39:42.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c0a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:55580/0 (socket says 172.21.15.115:55580) 2023-07-27T14:39:42.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445bfff700 1 -- 172.21.15.115:0/1076710647 learned_addr learned my addr 172.21.15.115:0/1076710647 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:42.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445b7fe700 1 --2- 172.21.15.115:0/1076710647 >> v2:172.21.15.159:3300/0 conn(0x7f445c0aa050 0x7f445c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445affd700 1 -- 172.21.15.115:0/1076710647 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403557316 0 0) 0x7f4454001490 con 0x7f445c0aaa40 2023-07-27T14:39:42.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445bfff700 1 -- 172.21.15.115:0/1076710647 >> v2:172.21.15.159:3300/0 conn(0x7f445c0aa050 msgr2=0x7f445c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:42.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445bfff700 1 --2- 172.21.15.115:0/1076710647 >> v2:172.21.15.159:3300/0 conn(0x7f445c0aa050 0x7f445c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445bfff700 1 -- 172.21.15.115:0/1076710647 >> v1:172.21.15.159:6789/0 conn(0x7f445c0aaa40 legacy=0x7f445c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.951+0000 7f445bfff700 1 -- 172.21.15.115:0/1076710647 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0bfc90 con 0x7f445c153ec0 2023-07-27T14:39:42.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f445bfff700 1 --2- 172.21.15.115:0/1076710647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c0a9b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f444c006fd0 tx=0x7f444c0090f0).ready entity=mon.2 client_cookie=8a2d0164f8bb2de server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f445affd700 1 -- 172.21.15.115:0/1076710647 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00b580 con 0x7f445c153ec0 2023-07-27T14:39:42.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f445affd700 1 -- 172.21.15.115:0/1076710647 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c00b6e0 con 0x7f445c153ec0 2023-07-27T14:39:42.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f445affd700 1 -- 172.21.15.115:0/1076710647 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00ba60 con 0x7f445c153ec0 2023-07-27T14:39:42.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f44627ff700 1 -- 172.21.15.115:0/1076710647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 msgr2=0x7f445c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f44627ff700 1 --2- 172.21.15.115:0/1076710647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c0a9b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f444c006fd0 tx=0x7f444c0090f0).stop 2023-07-27T14:39:42.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f44627ff700 1 -- 172.21.15.115:0/1076710647 shutdown_connections 2023-07-27T14:39:42.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f44627ff700 1 --2- 172.21.15.115:0/1076710647 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c0a9b60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f44627ff700 1 --2- 172.21.15.115:0/1076710647 >> v2:172.21.15.159:3300/0 conn(0x7f445c0aa050 0x7f445c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.952+0000 7f44627ff700 1 -- 172.21.15.115:0/1076710647 >> 172.21.15.115:0/1076710647 conn(0x7f445c0cb610 msgr2=0x7f445c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:42.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.953+0000 7f44627ff700 1 -- 172.21.15.115:0/1076710647 shutdown_connections 2023-07-27T14:39:42.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.953+0000 7f44627ff700 1 -- 172.21.15.115:0/1076710647 wait complete. 2023-07-27T14:39:42.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.954+0000 7f44627ff700 1 Processor -- start 2023-07-27T14:39:42.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.954+0000 7f44627ff700 1 -- start start 2023-07-27T14:39:42.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f44627ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f445c0aa050 0x7f445c14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f44627ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f445c0aaa40 0x7f445c0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f44627ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c14e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f44627ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c2bb0 con 0x7f445c0aa050 2023-07-27T14:39:42.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f44627ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c3460 con 0x7f445c0aaa40 2023-07-27T14:39:42.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f44627ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0c25f0 con 0x7f445c153ec0 2023-07-27T14:39:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f445bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f445c0aa050 0x7f445c14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f445bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f445c0aa050 0x7f445c14ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49688/0 (socket says 172.21.15.115:49688) 2023-07-27T14:39:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f445bfff700 1 -- 172.21.15.115:0/3733968336 learned_addr learned my addr 172.21.15.115:0/3733968336 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:42.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f445b7fe700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f445c0aaa40 0x7f445c0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.955+0000 7f4460d9c700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f445bfff700 1 -- 172.21.15.115:0/3733968336 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 msgr2=0x7f445c14e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f445bfff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c14e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f445bfff700 1 -- 172.21.15.115:0/3733968336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f445c0aaa40 msgr2=0x7f445c0c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f445bfff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f445c0aaa40 0x7f445c0c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f445bfff700 1 -- 172.21.15.115:0/3733968336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c009370 con 0x7f445c0aa050 2023-07-27T14:39:42.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f445bfff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f445c0aa050 0x7f445c14ca50 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f445c060760 tx=0x7f444c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f4443fff700 1 -- 172.21.15.115:0/3733968336 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c000bc0 con 0x7f445c0aa050 2023-07-27T14:39:42.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f4443fff700 1 -- 172.21.15.115:0/3733968336 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c00b850 con 0x7f445c0aa050 2023-07-27T14:39:42.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c0c28d0 con 0x7f445c0aa050 2023-07-27T14:39:42.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f4443fff700 1 -- 172.21.15.115:0/3733968336 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c000d20 con 0x7f445c0aa050 2023-07-27T14:39:42.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.956+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c14cf40 con 0x7f445c0aa050 2023-07-27T14:39:42.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.957+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c06c470 con 0x7f445c0aa050 2023-07-27T14:39:42.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.958+0000 7f4443fff700 1 -- 172.21.15.115:0/3733968336 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f444c00f070 con 0x7f445c0aa050 2023-07-27T14:39:42.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.959+0000 7f4443fff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f444805fc90 0x7f4448062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.959+0000 7f4443fff700 1 -- 172.21.15.115:0/3733968336 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f444c07c9f0 con 0x7f445c0aa050 2023-07-27T14:39:42.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.959+0000 7f445b7fe700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f444805fc90 0x7f4448062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.960+0000 7f445b7fe700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f444805fc90 0x7f4448062150 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f445c0ac3e0 tx=0x7f4450009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:41.963+0000 7f4443fff700 1 -- 172.21.15.115:0/3733968336 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f444c082020 con 0x7f445c0aa050 2023-07-27T14:39:42.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.175+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f445c0c3740 con 0x7f445c0aa050 2023-07-27T14:39:42.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.175+0000 7f4443fff700 1 -- 172.21.15.115:0/3733968336 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4507 (secure 0 0 0) 0x7f444c020020 con 0x7f445c0aa050 2023-07-27T14:39:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:42.231 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2746189426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2746189426},{"type":"v1","addr":"172.21.15.159:6835","nonce":2746189426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/131117331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":131117331},{"type":"v1","addr":"172.21.15.115:6837","nonce":131117331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":8608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3669259360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3669259360},{"type":"v1","addr":"172.21.15.159:6834","nonce":3669259360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:38:54.165239+0000","modified":"2023-07-27T14:39:13.190759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2564907842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2564907842},{"type":"v1","addr":"172.21.15.115:6836","nonce":2564907842}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26,27],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-07-27T14:39:42.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f444805fc90 msgr2=0x7f4448062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f444805fc90 0x7f4448062150 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f445c0ac3e0 tx=0x7f4450009060).stop 2023-07-27T14:39:42.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f445c0aa050 msgr2=0x7f445c14ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f445c0aa050 0x7f445c14ca50 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f445c060760 tx=0x7f444c017000).stop 2023-07-27T14:39:42.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 shutdown_connections 2023-07-27T14:39:42.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f444805fc90 0x7f4448062150 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f445c153ec0 0x7f445c14e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f445c0aa050 0x7f445c14ca50 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 --2- 172.21.15.115:0/3733968336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f445c0aaa40 0x7f445c0c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 >> 172.21.15.115:0/3733968336 conn(0x7f445c0cb610 msgr2=0x7f445c0640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:42.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 shutdown_connections 2023-07-27T14:39:42.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.178+0000 7f44627ff700 1 -- 172.21.15.115:0/3733968336 wait complete. 2023-07-27T14:39:42.234 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 104 2023-07-27T14:39:42.252 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:39:42.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.386+0000 7f50cadff700 1 Processor -- start 2023-07-27T14:39:42.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.387+0000 7f50cadff700 1 -- start start 2023-07-27T14:39:42.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50cadff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f50c414e470 0x7f50c414e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50cadff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f50c4062a30 0x7f50c40a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50cadff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c40a4840 con 0x7f50c4155110 2023-07-27T14:39:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50cadff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40a6ed0 con 0x7f50c414e470 2023-07-27T14:39:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50cadff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40a71b0 con 0x7f50c4062a30 2023-07-27T14:39:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50c3fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f50c4155110 0x7f50c4062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36838/0 (socket says 172.21.15.115:36838) 2023-07-27T14:39:42.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50c3fff700 1 -- 172.21.15.115:0/1924067627 learned_addr learned my addr 172.21.15.115:0/1924067627 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:42.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50c8b9b700 1 --2- 172.21.15.115:0/1924067627 >> v2:172.21.15.115:3300/0 conn(0x7f50c414e470 0x7f50c414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.388+0000 7f50c939c700 1 --2- 172.21.15.115:0/1924067627 >> v2:172.21.15.159:3300/0 conn(0x7f50c4062a30 0x7f50c40a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.389+0000 7f50c8b9b700 1 -- 172.21.15.115:0/1924067627 >> v2:172.21.15.159:3300/0 conn(0x7f50c4062a30 msgr2=0x7f50c40a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:42.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.389+0000 7f50c8b9b700 1 --2- 172.21.15.115:0/1924067627 >> v2:172.21.15.159:3300/0 conn(0x7f50c4062a30 0x7f50c40a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.389+0000 7f50c8b9b700 1 -- 172.21.15.115:0/1924067627 >> v1:172.21.15.115:6789/0 conn(0x7f50c4155110 legacy=0x7f50c4062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.389+0000 7f50c8b9b700 1 -- 172.21.15.115:0/1924067627 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c40a4a90 con 0x7f50c414e470 2023-07-27T14:39:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.389+0000 7f50c8b9b700 1 --2- 172.21.15.115:0/1924067627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c414e470 0x7f50c414e850 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f50c40c3d90 tx=0x7f50b8009060).ready entity=mon.0 client_cookie=4c82a8dcfa2f3bf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.389+0000 7f50c37fe700 1 -- 172.21.15.115:0/1924067627 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800f510 con 0x7f50c414e470 2023-07-27T14:39:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.389+0000 7f50c37fe700 1 -- 172.21.15.115:0/1924067627 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b800f670 con 0x7f50c414e470 2023-07-27T14:39:42.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.389+0000 7f50c37fe700 1 -- 172.21.15.115:0/1924067627 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800f9f0 con 0x7f50c414e470 2023-07-27T14:39:42.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.390+0000 7f50cadff700 1 -- 172.21.15.115:0/1924067627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c414e470 msgr2=0x7f50c414e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.390+0000 7f50cadff700 1 --2- 172.21.15.115:0/1924067627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c414e470 0x7f50c414e850 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f50c40c3d90 tx=0x7f50b8009060).stop 2023-07-27T14:39:42.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.390+0000 7f50cadff700 1 -- 172.21.15.115:0/1924067627 shutdown_connections 2023-07-27T14:39:42.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.390+0000 7f50cadff700 1 --2- 172.21.15.115:0/1924067627 >> v2:172.21.15.159:3300/0 conn(0x7f50c4062a30 0x7f50c40a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.390+0000 7f50cadff700 1 --2- 172.21.15.115:0/1924067627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c414e470 0x7f50c414e850 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.390+0000 7f50cadff700 1 -- 172.21.15.115:0/1924067627 >> 172.21.15.115:0/1924067627 conn(0x7f50c40c7990 msgr2=0x7f50c40c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:42.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.390+0000 7f50cadff700 1 -- 172.21.15.115:0/1924067627 shutdown_connections 2023-07-27T14:39:42.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.390+0000 7f50cadff700 1 -- 172.21.15.115:0/1924067627 wait complete. 2023-07-27T14:39:42.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.391+0000 7f50cadff700 1 Processor -- start 2023-07-27T14:39:42.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.391+0000 7f50cadff700 1 -- start start 2023-07-27T14:39:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.392+0000 7f50cadff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c4062a30 0x7f50c414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.392+0000 7f50cadff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50c414e470 0x7f50c40aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.392+0000 7f50cadff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50c4155110 0x7f50c4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.392+0000 7f50cadff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40ac580 con 0x7f50c4062a30 2023-07-27T14:39:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.392+0000 7f50cadff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40abac0 con 0x7f50c4155110 2023-07-27T14:39:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.392+0000 7f50cadff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c414ce70 con 0x7f50c414e470 2023-07-27T14:39:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c4062a30 0x7f50c414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c4062a30 0x7f50c414c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49706/0 (socket says 172.21.15.115:49706) 2023-07-27T14:39:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 -- 172.21.15.115:0/4087317832 learned_addr learned my addr 172.21.15.115:0/4087317832 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c3fff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50c414e470 0x7f50c40aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c939c700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50c4155110 0x7f50c4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 -- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50c414e470 msgr2=0x7f50c40aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50c414e470 0x7f50c40aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 -- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50c4155110 msgr2=0x7f50c4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50c4155110 0x7f50c4156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 -- 172.21.15.115:0/4087317832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b80092a0 con 0x7f50c4062a30 2023-07-27T14:39:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c3fff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50c414e470 0x7f50c40aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:42.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c8b9b700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c4062a30 0x7f50c414c980 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f50b8009dd0 tx=0x7f50b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c0ff9700 1 -- 172.21.15.115:0/4087317832 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800f9f0 con 0x7f50c4062a30 2023-07-27T14:39:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.393+0000 7f50c0ff9700 1 -- 172.21.15.115:0/4087317832 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b8000c90 con 0x7f50c4062a30 2023-07-27T14:39:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.394+0000 7f50c0ff9700 1 -- 172.21.15.115:0/4087317832 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b801b660 con 0x7f50c4062a30 2023-07-27T14:39:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.394+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c40aa550 con 0x7f50c4062a30 2023-07-27T14:39:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.394+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c40ab190 con 0x7f50c4062a30 2023-07-27T14:39:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.395+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c406c470 con 0x7f50c4062a30 2023-07-27T14:39:42.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.395+0000 7f50c0ff9700 1 -- 172.21.15.115:0/4087317832 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f50b802c070 con 0x7f50c4062a30 2023-07-27T14:39:42.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.396+0000 7f50c0ff9700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f50a805fcc0 0x7f50a8062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.397+0000 7f50c0ff9700 1 -- 172.21.15.115:0/4087317832 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f50b807cff0 con 0x7f50c4062a30 2023-07-27T14:39:42.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.397+0000 7f50c3fff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f50a805fcc0 0x7f50a8062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.397+0000 7f50c3fff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f50a805fcc0 0x7f50a8062180 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f50c40adbd0 tx=0x7f50b0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.401+0000 7f50c0ff9700 1 -- 172.21.15.115:0/4087317832 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50b804d3e0 con 0x7f50c4062a30 2023-07-27T14:39:42.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.568+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50c40a4d70 con 0x7f50c4062a30 2023-07-27T14:39:42.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.569+0000 7f50c0ff9700 1 -- 172.21.15.115:0/4087317832 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f50b8050a00 con 0x7f50c4062a30 2023-07-27T14:39:42.624 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:42.624 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":191,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:39:14.192799+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:38:51.766720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-27T14:38:53.161829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":27,"pool_name":"new_pool","create_time":"2023-07-27T14:39:12.349824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:39:42.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f50a805fcc0 msgr2=0x7f50a8062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f50a805fcc0 0x7f50a8062180 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f50c40adbd0 tx=0x7f50b0009040).stop 2023-07-27T14:39:42.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c4062a30 msgr2=0x7f50c414c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c4062a30 0x7f50c414c980 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f50b8009dd0 tx=0x7f50b8017000).stop 2023-07-27T14:39:42.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 shutdown_connections 2023-07-27T14:39:42.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f50a805fcc0 0x7f50a8062180 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50c4155110 0x7f50c4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50c4062a30 0x7f50c414c980 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 --2- 172.21.15.115:0/4087317832 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f50c414e470 0x7f50c40aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 >> 172.21.15.115:0/4087317832 conn(0x7f50c40c7990 msgr2=0x7f50c414d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:42.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 shutdown_connections 2023-07-27T14:39:42.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.571+0000 7f50cadff700 1 -- 172.21.15.115:0/4087317832 wait complete. 2023-07-27T14:39:42.644 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:38:51.766720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:38:53.161829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 27, 'pool_name': 'new_pool', 'create_time': '2023-07-27T14:39:12.349824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:39:42.645 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:39:42.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.783+0000 7f41ae7ff700 1 Processor -- start 2023-07-27T14:39:42.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.783+0000 7f41ae7ff700 1 -- start start 2023-07-27T14:39:42.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.784+0000 7f41ae7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f41a80c58d0 0x7f41a8150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.784+0000 7f41ae7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a80c0ea0 con 0x7f41a81509b0 2023-07-27T14:39:42.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.784+0000 7f41ae7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8068e10 con 0x7f41a80c3100 2023-07-27T14:39:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.784+0000 7f41ae7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a8151280 con 0x7f41a80c58d0 2023-07-27T14:39:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f41a81509b0 0x7f41a8154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36844/0 (socket says 172.21.15.115:36844) 2023-07-27T14:39:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a7fff700 1 -- 172.21.15.115:0/2578924518 learned_addr learned my addr 172.21.15.115:0/2578924518 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:42.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a77fe700 1 --2- 172.21.15.115:0/2578924518 >> v2:172.21.15.159:3300/0 conn(0x7f41a80c58d0 0x7f41a8150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937477625 0 0) 0x7f41a80c0ea0 con 0x7f41a81509b0 2023-07-27T14:39:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41900033f0 con 0x7f41a81509b0 2023-07-27T14:39:42.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455178006 0 0) 0x7f41a8068e10 con 0x7f41a80c3100 2023-07-27T14:39:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a80c0ea0 con 0x7f41a80c3100 2023-07-27T14:39:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1990994694 0 0) 0x7f41900033f0 con 0x7f41a81509b0 2023-07-27T14:39:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 >> v2:172.21.15.159:3300/0 conn(0x7f41a80c58d0 msgr2=0x7f41a8150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:42.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 --2- 172.21.15.115:0/2578924518 >> v2:172.21.15.159:3300/0 conn(0x7f41a80c58d0 0x7f41a8150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 >> v1:172.21.15.159:6789/0 conn(0x7f41a80c3100 legacy=0x7f41a80c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a8155190 con 0x7f41a81509b0 2023-07-27T14:39:42.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4198001470 con 0x7f41a81509b0 2023-07-27T14:39:42.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a77fe700 1 --2- 172.21.15.115:0/2578924518 >> v2:172.21.15.159:3300/0 conn(0x7f41a80c58d0 0x7f41a8150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:42.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 >> v1:172.21.15.115:6789/0 conn(0x7f41a81509b0 legacy=0x7f41a8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4190003a70 0x7f4190003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.785+0000 7f41a6ffd700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4190004690 0x7f4190004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41a6ffd700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f419000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8151280 con 0x7f4190005000 2023-07-27T14:39:42.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419000bf60 con 0x7f4190004690 2023-07-27T14:39:42.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419000c0d0 con 0x7f4190003a70 2023-07-27T14:39:42.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41acd9c700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f419000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41a7fff700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4190003a70 0x7f4190003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41a77fe700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4190004690 0x7f4190004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41acd9c700 1 -- 172.21.15.115:0/2578924518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4190003a70 msgr2=0x7f4190003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:42.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41acd9c700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4190003a70 0x7f4190003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41acd9c700 1 -- 172.21.15.115:0/2578924518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4190004690 msgr2=0x7f4190004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:42.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41acd9c700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4190004690 0x7f4190004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41acd9c700 1 -- 172.21.15.115:0/2578924518 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41900033f0 con 0x7f4190005000 2023-07-27T14:39:42.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41acd9c700 1 -- 172.21.15.115:0/2578924518 reap_dead start 2023-07-27T14:39:42.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41acd9c700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f419000b8e0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f41a0001f90 tx=0x7f41a0007f30).ready entity=mon.0 client_cookie=a1aae0f8ac86e45a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.786+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a0006a20 con 0x7f4190005000 2023-07-27T14:39:42.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a0006b80 con 0x7f4190005000 2023-07-27T14:39:42.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41a6ffd700 1 -- 172.21.15.115:0/2578924518 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a000c8b0 con 0x7f4190005000 2023-07-27T14:39:42.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41ae7ff700 1 -- 172.21.15.115:0/2578924518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 msgr2=0x7f419000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41ae7ff700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f419000b8e0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f41a0001f90 tx=0x7f41a0007f30).stop 2023-07-27T14:39:42.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41ae7ff700 1 -- 172.21.15.115:0/2578924518 shutdown_connections 2023-07-27T14:39:42.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41ae7ff700 1 --2- 172.21.15.115:0/2578924518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f419000b8e0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41ae7ff700 1 -- 172.21.15.115:0/2578924518 >> 172.21.15.115:0/2578924518 conn(0x7f41a8062320 msgr2=0x7f41a8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:42.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41ae7ff700 1 -- 172.21.15.115:0/2578924518 shutdown_connections 2023-07-27T14:39:42.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.787+0000 7f41ae7ff700 1 -- 172.21.15.115:0/2578924518 wait complete. 2023-07-27T14:39:42.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.789+0000 7f41ae7ff700 1 Processor -- start 2023-07-27T14:39:42.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.789+0000 7f41ae7ff700 1 -- start start 2023-07-27T14:39:42.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41ae7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f41a80c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41ae7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a8149820 0x7f41a80a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41ae7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41a80a91f0 0x7f41a80bcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41ae7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80c0790 con 0x7f4190005000 2023-07-27T14:39:42.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41ae7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80bdcc0 con 0x7f41a8149820 2023-07-27T14:39:42.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41ae7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80bdfa0 con 0x7f41a80a91f0 2023-07-27T14:39:42.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f41a80c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f41a80c02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49728/0 (socket says 172.21.15.115:49728) 2023-07-27T14:39:42.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a7fff700 1 -- 172.21.15.115:0/1635494042 learned_addr learned my addr 172.21.15.115:0/1635494042 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:42.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41acd9c700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41a80a91f0 0x7f41a80bcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a77fe700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a8149820 0x7f41a80a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a7fff700 1 -- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41a80a91f0 msgr2=0x7f41a80bcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a7fff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41a80a91f0 0x7f41a80bcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a7fff700 1 -- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a8149820 msgr2=0x7f41a80a8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:42.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a7fff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a8149820 0x7f41a80a8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:42.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41a7fff700 1 -- 172.21.15.115:0/1635494042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80be280 con 0x7f4190005000 2023-07-27T14:39:42.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.791+0000 7f41acd9c700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41a80a91f0 0x7f41a80bcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:42.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.792+0000 7f41a7fff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f41a80c02a0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f41980077e0 tx=0x7f4198001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.792+0000 7f418ffff700 1 -- 172.21.15.115:0/1635494042 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980114c0 con 0x7f4190005000 2023-07-27T14:39:42.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.792+0000 7f418ffff700 1 -- 172.21.15.115:0/1635494042 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4198011620 con 0x7f4190005000 2023-07-27T14:39:42.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.792+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a80be560 con 0x7f4190005000 2023-07-27T14:39:42.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.792+0000 7f418ffff700 1 -- 172.21.15.115:0/1635494042 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980119a0 con 0x7f4190005000 2023-07-27T14:39:42.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.792+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a8149ca0 con 0x7f4190005000 2023-07-27T14:39:42.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.793+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a806c470 con 0x7f4190005000 2023-07-27T14:39:42.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.794+0000 7f418ffff700 1 -- 172.21.15.115:0/1635494042 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f419801b030 con 0x7f4190005000 2023-07-27T14:39:42.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.794+0000 7f418ffff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f419405fc90 0x7f4194062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.794+0000 7f418ffff700 1 -- 172.21.15.115:0/1635494042 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f419807ac10 con 0x7f4190005000 2023-07-27T14:39:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.795+0000 7f41a77fe700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f419405fc90 0x7f4194062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:42.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.795+0000 7f41a77fe700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f419405fc90 0x7f4194062150 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f41a80bd780 tx=0x7f419c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:42.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.799+0000 7f418ffff700 1 -- 172.21.15.115:0/1635494042 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f419804a8f0 con 0x7f4190005000 2023-07-27T14:39:43.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.967+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f41a8155470 con 0x7f4190005000 2023-07-27T14:39:43.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.967+0000 7f418ffff700 1 -- 172.21.15.115:0/1635494042 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v191) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4198019070 con 0x7f4190005000 2023-07-27T14:39:43.023 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:39:43.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.969+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f419405fc90 msgr2=0x7f4194062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.969+0000 7f41ae7ff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f419405fc90 0x7f4194062150 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f41a80bd780 tx=0x7f419c009060).stop 2023-07-27T14:39:43.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.969+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 msgr2=0x7f41a80c02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.969+0000 7f41ae7ff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f41a80c02a0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f41980077e0 tx=0x7f4198001df0).stop 2023-07-27T14:39:43.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.970+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 shutdown_connections 2023-07-27T14:39:43.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.970+0000 7f41ae7ff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f419405fc90 0x7f4194062150 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.970+0000 7f41ae7ff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41a80a91f0 0x7f41a80bcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.970+0000 7f41ae7ff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4190005000 0x7f41a80c02a0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.970+0000 7f41ae7ff700 1 --2- 172.21.15.115:0/1635494042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41a8149820 0x7f41a80a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.970+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 >> 172.21.15.115:0/1635494042 conn(0x7f41a8062320 msgr2=0x7f41a80c1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:43.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.970+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 shutdown_connections 2023-07-27T14:39:43.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:42.970+0000 7f41ae7ff700 1 -- 172.21.15.115:0/1635494042 wait complete. 2023-07-27T14:39:43.042 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:39:43.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.178+0000 7fae3d7ff700 1 Processor -- start 2023-07-27T14:39:43.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.179+0000 7fae3d7ff700 1 -- start start 2023-07-27T14:39:43.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae3d7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fae3814ae00 0x7fae38154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae3d7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fae3814b1e0 0x7fae38062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae3d7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae381553f0 con 0x7fae380c5c50 2023-07-27T14:39:43.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae3d7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae38157a50 con 0x7fae3814b1e0 2023-07-27T14:39:43.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae3d7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae38157d10 con 0x7fae3814ae00 2023-07-27T14:39:43.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae367fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fae3814b1e0 0x7fae38062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae377fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fae380c5c50 0x7fae380a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36856/0 (socket says 172.21.15.115:36856) 2023-07-27T14:39:43.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae377fe700 1 -- 172.21.15.115:0/1568818131 learned_addr learned my addr 172.21.15.115:0/1568818131 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:43.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.180+0000 7fae36ffd700 1 --2- 172.21.15.115:0/1568818131 >> v2:172.21.15.159:3300/0 conn(0x7fae3814ae00 0x7fae38154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae367fc700 1 -- 172.21.15.115:0/1568818131 >> v2:172.21.15.159:3300/0 conn(0x7fae3814ae00 msgr2=0x7fae38154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:43.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae367fc700 1 --2- 172.21.15.115:0/1568818131 >> v2:172.21.15.159:3300/0 conn(0x7fae3814ae00 0x7fae38154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae367fc700 1 -- 172.21.15.115:0/1568818131 >> v1:172.21.15.115:6789/0 conn(0x7fae380c5c50 legacy=0x7fae380a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae367fc700 1 -- 172.21.15.115:0/1568818131 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38157ff0 con 0x7fae3814b1e0 2023-07-27T14:39:43.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae35ffb700 1 -- 172.21.15.115:0/1568818131 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091246348 0 0) 0x7fae381553f0 con 0x7fae380c5c50 2023-07-27T14:39:43.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae367fc700 1 --2- 172.21.15.115:0/1568818131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814b1e0 0x7fae38062b50 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7fae38155580 tx=0x7fae2c009060).ready entity=mon.0 client_cookie=8c15864b81f3cf8f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:43.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae35ffb700 1 -- 172.21.15.115:0/1568818131 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00f510 con 0x7fae3814b1e0 2023-07-27T14:39:43.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae35ffb700 1 -- 172.21.15.115:0/1568818131 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c00f670 con 0x7fae3814b1e0 2023-07-27T14:39:43.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.181+0000 7fae35ffb700 1 -- 172.21.15.115:0/1568818131 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00f9f0 con 0x7fae3814b1e0 2023-07-27T14:39:43.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.182+0000 7fae3d7ff700 1 -- 172.21.15.115:0/1568818131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814b1e0 msgr2=0x7fae38062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.182+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/1568818131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814b1e0 0x7fae38062b50 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7fae38155580 tx=0x7fae2c009060).stop 2023-07-27T14:39:43.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.182+0000 7fae3d7ff700 1 -- 172.21.15.115:0/1568818131 shutdown_connections 2023-07-27T14:39:43.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.182+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/1568818131 >> v2:172.21.15.159:3300/0 conn(0x7fae3814ae00 0x7fae38154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.182+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/1568818131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814b1e0 0x7fae38062b50 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.182+0000 7fae3d7ff700 1 -- 172.21.15.115:0/1568818131 >> 172.21.15.115:0/1568818131 conn(0x7fae3805e940 msgr2=0x7fae380cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:43.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.182+0000 7fae3d7ff700 1 -- 172.21.15.115:0/1568818131 shutdown_connections 2023-07-27T14:39:43.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.182+0000 7fae3d7ff700 1 -- 172.21.15.115:0/1568818131 wait complete. 2023-07-27T14:39:43.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.183+0000 7fae3d7ff700 1 Processor -- start 2023-07-27T14:39:43.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.183+0000 7fae3d7ff700 1 -- start start 2023-07-27T14:39:43.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae3d7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae380c5c50 0x7fae38149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae3d7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814ae00 0x7fae380c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae3d7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae3814b1e0 0x7fae380c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae3d7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae380ca3c0 con 0x7fae3814ae00 2023-07-27T14:39:43.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae3d7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae380ae400 con 0x7fae3814b1e0 2023-07-27T14:39:43.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae3d7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae380ae6c0 con 0x7fae380c5c50 2023-07-27T14:39:43.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae367fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814ae00 0x7fae380c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae367fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814ae00 0x7fae380c3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49736/0 (socket says 172.21.15.115:49736) 2023-07-27T14:39:43.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.184+0000 7fae367fc700 1 -- 172.21.15.115:0/2159477383 learned_addr learned my addr 172.21.15.115:0/2159477383 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:43.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae36ffd700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae380c5c50 0x7fae38149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae377fe700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae3814b1e0 0x7fae380c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae367fc700 1 -- 172.21.15.115:0/2159477383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae380c5c50 msgr2=0x7fae38149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae367fc700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae380c5c50 0x7fae38149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae367fc700 1 -- 172.21.15.115:0/2159477383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae3814b1e0 msgr2=0x7fae380c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae367fc700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae3814b1e0 0x7fae380c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae367fc700 1 -- 172.21.15.115:0/2159477383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0092a0 con 0x7fae3814ae00 2023-07-27T14:39:43.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae367fc700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814ae00 0x7fae380c3430 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7fae2c011000 tx=0x7fae2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:43.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae1effd700 1 -- 172.21.15.115:0/2159477383 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00f7e0 con 0x7fae3814ae00 2023-07-27T14:39:43.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae1effd700 1 -- 172.21.15.115:0/2159477383 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c00f940 con 0x7fae3814ae00 2023-07-27T14:39:43.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae380ae9a0 con 0x7fae3814ae00 2023-07-27T14:39:43.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae1effd700 1 -- 172.21.15.115:0/2159477383 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c022630 con 0x7fae3814ae00 2023-07-27T14:39:43.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.185+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae380c3e10 con 0x7fae3814ae00 2023-07-27T14:39:43.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.186+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae380aeec0 con 0x7fae3814ae00 2023-07-27T14:39:43.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.187+0000 7fae1effd700 1 -- 172.21.15.115:0/2159477383 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fae2c00f070 con 0x7fae3814ae00 2023-07-27T14:39:43.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.188+0000 7fae1effd700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae2405fcc0 0x7fae24062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.188+0000 7fae1effd700 1 -- 172.21.15.115:0/2159477383 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fae2c07cab0 con 0x7fae3814ae00 2023-07-27T14:39:43.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.188+0000 7fae36ffd700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae2405fcc0 0x7fae24062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.189+0000 7fae36ffd700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae2405fcc0 0x7fae24062180 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fae28009bc0 tx=0x7fae28008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:43.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.192+0000 7fae1effd700 1 -- 172.21.15.115:0/2159477383 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae2c04cfb0 con 0x7fae3814ae00 2023-07-27T14:39:43.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.368+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae3806c470 con 0x7fae3814ae00 2023-07-27T14:39:43.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.369+0000 7fae1effd700 1 -- 172.21.15.115:0/2159477383 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v191) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae2c0505d0 con 0x7fae3814ae00 2023-07-27T14:39:43.424 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:39:43.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae2405fcc0 msgr2=0x7fae24062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae2405fcc0 0x7fae24062180 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fae28009bc0 tx=0x7fae28008040).stop 2023-07-27T14:39:43.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814ae00 msgr2=0x7fae380c3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814ae00 0x7fae380c3430 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7fae2c011000 tx=0x7fae2c017000).stop 2023-07-27T14:39:43.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 shutdown_connections 2023-07-27T14:39:43.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fae2405fcc0 0x7fae24062180 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae3814b1e0 0x7fae380c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fae380c5c50 0x7fae38149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 --2- 172.21.15.115:0/2159477383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae3814ae00 0x7fae380c3430 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 >> 172.21.15.115:0/2159477383 conn(0x7fae3805e940 msgr2=0x7fae38062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:43.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 shutdown_connections 2023-07-27T14:39:43.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.371+0000 7fae3d7ff700 1 -- 172.21.15.115:0/2159477383 wait complete. 2023-07-27T14:39:43.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:39:43.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.580+0000 7fdc117ff700 1 Processor -- start 2023-07-27T14:39:43.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.580+0000 7fdc117ff700 1 -- start start 2023-07-27T14:39:43.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.582+0000 7fdc117ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c13a730 0x7fdc0c065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.582+0000 7fdc117ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdc0c0c36b0 0x7fdc0c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.582+0000 7fdc117ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c0bd9a0 con 0x7fdc0c13a350 2023-07-27T14:39:43.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.582+0000 7fdc117ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c066400 con 0x7fdc0c0c36b0 2023-07-27T14:39:43.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.582+0000 7fdc117ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c158ae0 con 0x7fdc0c13a730 2023-07-27T14:39:43.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.582+0000 7fdc0affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdc0c13a350 0x7fdc0c0c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47206/0 (socket says 172.21.15.115:47206) 2023-07-27T14:39:43.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.582+0000 7fdc0affd700 1 -- 172.21.15.115:0/3055520770 learned_addr learned my addr 172.21.15.115:0/3055520770 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:43.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc0b7fe700 1 --2- 172.21.15.115:0/3055520770 >> v2:172.21.15.159:3300/0 conn(0x7fdc0c0c36b0 0x7fdc0c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868544073 0 0) 0x7fdc0c0bd9a0 con 0x7fdc0c13a350 2023-07-27T14:39:43.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf40033f0 con 0x7fdc0c13a350 2023-07-27T14:39:43.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc0a7fc700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c13a730 0x7fdc0c065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1562020578 0 0) 0x7fdbf40033f0 con 0x7fdc0c13a350 2023-07-27T14:39:43.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c13a730 msgr2=0x7fdc0c065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:43.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c13a730 0x7fdc0c065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 >> v2:172.21.15.159:3300/0 conn(0x7fdc0c0c36b0 msgr2=0x7fdc0c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:43.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 --2- 172.21.15.115:0/3055520770 >> v2:172.21.15.159:3300/0 conn(0x7fdc0c0c36b0 0x7fdc0c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c066610 con 0x7fdc0c13a350 2023-07-27T14:39:43.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fdbfc001470 con 0x7fdc0c13a350 2023-07-27T14:39:43.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc0b7fe700 1 --2- 172.21.15.115:0/3055520770 >> v2:172.21.15.159:3300/0 conn(0x7fdc0c0c36b0 0x7fdc0c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:43.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 >> v1:172.21.15.115:6789/0 conn(0x7fdc0c13a350 legacy=0x7fdc0c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c13a730 0x7fdbf40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdbf4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbf4004b80 0x7fdbf4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c066400 con 0x7fdbf4003e10 2023-07-27T14:39:43.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c158ae0 con 0x7fdbf4004b80 2023-07-27T14:39:43.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf400b910 con 0x7fdc0c13a730 2023-07-27T14:39:43.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc0a7fc700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdbf4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.583+0000 7fdc0b7fe700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbf4004b80 0x7fdbf4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc0affd700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c13a730 0x7fdbf40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc0a7fc700 1 -- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c13a730 msgr2=0x7fdbf40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:43.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc0a7fc700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c13a730 0x7fdbf40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc0a7fc700 1 -- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbf4004b80 msgr2=0x7fdbf4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:43.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc0a7fc700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdbf4004b80 0x7fdbf4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc0a7fc700 1 -- 172.21.15.115:0/3055520770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40033f0 con 0x7fdbf4003e10 2023-07-27T14:39:43.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc0a7fc700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdbf4004690 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7fdc00009a80 tx=0x7fdc00009060).ready entity=mon.0 client_cookie=cdb1b616e58fcb21 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:43.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00009430 con 0x7fdbf4003e10 2023-07-27T14:39:43.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0000e5e0 con 0x7fdbf4003e10 2023-07-27T14:39:43.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.584+0000 7fdc09ffb700 1 -- 172.21.15.115:0/3055520770 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000e960 con 0x7fdbf4003e10 2023-07-27T14:39:43.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.585+0000 7fdc117ff700 1 -- 172.21.15.115:0/3055520770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 msgr2=0x7fdbf4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.585+0000 7fdc117ff700 1 --2- 172.21.15.115:0/3055520770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdbf4004690 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7fdc00009a80 tx=0x7fdc00009060).stop 2023-07-27T14:39:43.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.585+0000 7fdc0b7fe700 1 -- 172.21.15.115:0/3055520770 reap_dead start 2023-07-27T14:39:43.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.585+0000 7fdc117ff700 1 -- 172.21.15.115:0/3055520770 shutdown_connections 2023-07-27T14:39:43.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.585+0000 7fdc117ff700 1 -- 172.21.15.115:0/3055520770 >> 172.21.15.115:0/3055520770 conn(0x7fdc0c05e8f0 msgr2=0x7fdc0c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:43.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.585+0000 7fdc117ff700 1 -- 172.21.15.115:0/3055520770 shutdown_connections 2023-07-27T14:39:43.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.585+0000 7fdc117ff700 1 -- 172.21.15.115:0/3055520770 wait complete. 2023-07-27T14:39:43.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.586+0000 7fdc117ff700 1 Processor -- start 2023-07-27T14:39:43.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.586+0000 7fdc117ff700 1 -- start start 2023-07-27T14:39:43.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.587+0000 7fdc117ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdc0c0c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.587+0000 7fdc117ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c168630 0x7fdc0c157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.587+0000 7fdc117ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c157c30 0x7fdc0c164420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.587+0000 7fdc117ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c1681a0 con 0x7fdbf4003e10 2023-07-27T14:39:43.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.587+0000 7fdc117ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0c7290 con 0x7fdc0c168630 2023-07-27T14:39:43.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.587+0000 7fdc117ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c1580b0 con 0x7fdc0c157c30 2023-07-27T14:39:43.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdc0c0c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdc0c0c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50724/0 (socket says 172.21.15.115:50724) 2023-07-27T14:39:43.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 -- 172.21.15.115:0/3388315748 learned_addr learned my addr 172.21.15.115:0/3388315748 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:43.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 -- 172.21.15.115:0/3388315748 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c157c30 msgr2=0x7fdc0c164420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c157c30 0x7fdc0c164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:43.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 -- 172.21.15.115:0/3388315748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c168630 msgr2=0x7fdc0c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c168630 0x7fdc0c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:43.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 -- 172.21.15.115:0/3388315748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c165150 con 0x7fdbf4003e10 2023-07-27T14:39:43.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc0affd700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdc0c0c6da0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7fdbfc00e830 tx=0x7fdbfc001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:43.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdbf2ffd700 1 -- 172.21.15.115:0/3388315748 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc00c580 con 0x7fdbf4003e10 2023-07-27T14:39:43.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdbf2ffd700 1 -- 172.21.15.115:0/3388315748 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc00c6e0 con 0x7fdbf4003e10 2023-07-27T14:39:43.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c167b50 con 0x7fdbf4003e10 2023-07-27T14:39:43.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.588+0000 7fdbf2ffd700 1 -- 172.21.15.115:0/3388315748 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc00ca80 con 0x7fdbf4003e10 2023-07-27T14:39:43.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.589+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c164910 con 0x7fdbf4003e10 2023-07-27T14:39:43.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.590+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c168480 con 0x7fdbf4003e10 2023-07-27T14:39:43.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.590+0000 7fdbf2ffd700 1 -- 172.21.15.115:0/3388315748 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fdbfc014430 con 0x7fdbf4003e10 2023-07-27T14:39:43.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.591+0000 7fdbf2ffd700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdbf805fcc0 0x7fdbf8062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:43.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.591+0000 7fdbf2ffd700 1 -- 172.21.15.115:0/3388315748 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fdbfc07b150 con 0x7fdbf4003e10 2023-07-27T14:39:43.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.591+0000 7fdc0a7fc700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdbf805fcc0 0x7fdbf8062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:43.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.592+0000 7fdc0a7fc700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdbf805fcc0 0x7fdbf8062180 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fdc0c1571e0 tx=0x7fdc0001a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:43.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.595+0000 7fdbf2ffd700 1 -- 172.21.15.115:0/3388315748 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdbfc0498f0 con 0x7fdbf4003e10 2023-07-27T14:39:43.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.764+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc0c1679b0 con 0x7fdbf4003e10 2023-07-27T14:39:43.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.765+0000 7fdbf2ffd700 1 -- 172.21.15.115:0/3388315748 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v191) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc0c1679b0 con 0x7fdbf4003e10 2023-07-27T14:39:43.820 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:39:43.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdbf805fcc0 msgr2=0x7fdbf8062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdbf805fcc0 0x7fdbf8062180 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fdc0c1571e0 tx=0x7fdc0001a000).stop 2023-07-27T14:39:43.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 msgr2=0x7fdc0c0c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:43.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdc0c0c6da0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7fdbfc00e830 tx=0x7fdbfc001df0).stop 2023-07-27T14:39:43.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 shutdown_connections 2023-07-27T14:39:43.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdbf805fcc0 0x7fdbf8062180 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdc0c157c30 0x7fdc0c164420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:43.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbf4003e10 0x7fdc0c0c6da0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:43.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 --2- 172.21.15.115:0/3388315748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc0c168630 0x7fdc0c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:43.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 >> 172.21.15.115:0/3388315748 conn(0x7fdc0c05e8f0 msgr2=0x7fdc0c0ace00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:43.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 shutdown_connections 2023-07-27T14:39:43.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.767+0000 7fdc117ff700 1 -- 172.21.15.115:0/3388315748 wait complete. 2023-07-27T14:39:43.839 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:39:44.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.981+0000 7ff1b71ff700 1 Processor -- start 2023-07-27T14:39:44.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.981+0000 7ff1b71ff700 1 -- start start 2023-07-27T14:39:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.982+0000 7ff1b71ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b013a730 0x7ff1b0065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.982+0000 7ff1b71ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b00bd9a0 con 0x7ff1b013a350 2023-07-27T14:39:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.982+0000 7ff1b71ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b0066610 con 0x7ff1b00c36b0 2023-07-27T14:39:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.982+0000 7ff1b71ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0066400 con 0x7ff1b013a730 2023-07-27T14:39:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1b4f9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff1b013a350 0x7ff1b00c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47220/0 (socket says 172.21.15.115:47220) 2023-07-27T14:39:44.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1b4f9b700 1 -- 172.21.15.115:0/2584765067 learned_addr learned my addr 172.21.15.115:0/2584765067 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:44.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1affff700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b013a730 0x7ff1b0065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583972026 0 0) 0x7ff1b00bd9a0 con 0x7ff1b013a350 2023-07-27T14:39:44.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a00033f0 con 0x7ff1b013a350 2023-07-27T14:39:44.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670178718 0 0) 0x7ff1b0066610 con 0x7ff1b00c36b0 2023-07-27T14:39:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b00bd9a0 con 0x7ff1b00c36b0 2023-07-27T14:39:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3154605118 0 0) 0x7ff1a00033f0 con 0x7ff1b013a350 2023-07-27T14:39:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b013a730 msgr2=0x7ff1b0065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b013a730 0x7ff1b0065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 >> v1:172.21.15.159:6789/0 conn(0x7ff1b00c36b0 legacy=0x7ff1b00be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b00bdc10 con 0x7ff1b013a350 2023-07-27T14:39:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7ff1a40013f0 con 0x7ff1b013a350 2023-07-27T14:39:44.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 >> v1:172.21.15.115:6789/0 conn(0x7ff1b013a350 legacy=0x7ff1b00c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0003aa0 0x7ff1a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b013a730 0x7ff1a0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1a0004b80 0x7ff1a0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0066400 con 0x7ff1a0004b80 2023-07-27T14:39:44.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a000b990 con 0x7ff1a0003aa0 2023-07-27T14:39:44.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.983+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a000bb00 con 0x7ff1b013a730 2023-07-27T14:39:44.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1b579c700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1a0004b80 0x7ff1a0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1affff700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b013a730 0x7ff1a0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1b4f9b700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0003aa0 0x7ff1a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1b579c700 1 -- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b013a730 msgr2=0x7ff1a0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:44.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1b579c700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b013a730 0x7ff1a0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1b579c700 1 -- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0003aa0 msgr2=0x7ff1a0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:44.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1b579c700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0003aa0 0x7ff1a0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1b579c700 1 -- 172.21.15.115:0/2584765067 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00033f0 con 0x7ff1a0004b80 2023-07-27T14:39:44.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.984+0000 7ff1b579c700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1a0004b80 0x7ff1a0005000 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7ff1b0066fa0 tx=0x7ff1a8007f30).ready entity=mon.0 client_cookie=5354d4c47f682f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8006a20 con 0x7ff1a0004b80 2023-07-27T14:39:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a8006b80 con 0x7ff1a0004b80 2023-07-27T14:39:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1af7fe700 1 -- 172.21.15.115:0/2584765067 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800c700 con 0x7ff1a0004b80 2023-07-27T14:39:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1b71ff700 1 -- 172.21.15.115:0/2584765067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1a0004b80 msgr2=0x7ff1a0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1b71ff700 1 --2- 172.21.15.115:0/2584765067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1a0004b80 0x7ff1a0005000 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7ff1b0066fa0 tx=0x7ff1a8007f30).stop 2023-07-27T14:39:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1b579c700 1 -- 172.21.15.115:0/2584765067 reap_dead start 2023-07-27T14:39:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1b71ff700 1 -- 172.21.15.115:0/2584765067 shutdown_connections 2023-07-27T14:39:44.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1b71ff700 1 -- 172.21.15.115:0/2584765067 >> 172.21.15.115:0/2584765067 conn(0x7ff1b005e8f0 msgr2=0x7ff1b00c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1b71ff700 1 -- 172.21.15.115:0/2584765067 shutdown_connections 2023-07-27T14:39:44.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.985+0000 7ff1b71ff700 1 -- 172.21.15.115:0/2584765067 wait complete. 2023-07-27T14:39:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.987+0000 7ff1b71ff700 1 Processor -- start 2023-07-27T14:39:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.987+0000 7ff1b71ff700 1 -- start start 2023-07-27T14:39:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b71ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0004b80 0x7ff1b0154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b71ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b00c0bc0 0x7ff1b0156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b71ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b0156660 0x7ff1b0156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b71ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00c13d0 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b71ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00c16b0 con 0x7ff1a0004b80 2023-07-27T14:39:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b71ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00c1990 con 0x7ff1b0156660 2023-07-27T14:39:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1affff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b00c0bc0 0x7ff1b0156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1affff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b00c0bc0 0x7ff1b0156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50730/0 (socket says 172.21.15.115:50730) 2023-07-27T14:39:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1affff700 1 -- 172.21.15.115:0/3587429709 learned_addr learned my addr 172.21.15.115:0/3587429709 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b4f9b700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0004b80 0x7ff1b0154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b579c700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b0156660 0x7ff1b0156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1affff700 1 -- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b0156660 msgr2=0x7ff1b0156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1affff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b0156660 0x7ff1b0156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1affff700 1 -- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0004b80 msgr2=0x7ff1b0154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1affff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0004b80 0x7ff1b0154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1affff700 1 -- 172.21.15.115:0/3587429709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b00c1c70 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.988+0000 7ff1b4f9b700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0004b80 0x7ff1b0154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:44.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.989+0000 7ff1affff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b00c0bc0 0x7ff1b0156170 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7ff19c0119c0 tx=0x7ff19c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.989+0000 7ff1acff9700 1 -- 172.21.15.115:0/3587429709 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00f8e0 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.989+0000 7ff1acff9700 1 -- 172.21.15.115:0/3587429709 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00fa40 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.989+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b00c1f50 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.989+0000 7ff1acff9700 1 -- 172.21.15.115:0/3587429709 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00fdc0 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.989+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b0156fd0 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.990+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b006c470 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.991+0000 7ff1acff9700 1 -- 172.21.15.115:0/3587429709 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7ff19c024070 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.992+0000 7ff1acff9700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff19405fcc0 0x7ff194062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.992+0000 7ff1acff9700 1 -- 172.21.15.115:0/3587429709 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6628+0+0 (secure 0 0 0) 0x7ff19c07c0a0 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.992+0000 7ff1b4f9b700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff19405fcc0 0x7ff194062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.993+0000 7ff1b4f9b700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff19405fcc0 0x7ff194062180 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7ff1a4001120 tx=0x7ff1a4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:43.996+0000 7ff1acff9700 1 -- 172.21.15.115:0/3587429709 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff19c04c400 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.162+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1b00bdef0 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.162+0000 7ff1acff9700 1 -- 172.21.15.115:0/3587429709 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v192) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff19c04fa20 con 0x7ff1b00c0bc0 2023-07-27T14:39:44.217 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:39:44.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff19405fcc0 msgr2=0x7ff194062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff19405fcc0 0x7ff194062180 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7ff1a4001120 tx=0x7ff1a4009040).stop 2023-07-27T14:39:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b00c0bc0 msgr2=0x7ff1b0156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b00c0bc0 0x7ff1b0156170 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7ff19c0119c0 tx=0x7ff19c009060).stop 2023-07-27T14:39:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 shutdown_connections 2023-07-27T14:39:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff19405fcc0 0x7ff194062180 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff1b0156660 0x7ff1b0156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1a0004b80 0x7ff1b0154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 --2- 172.21.15.115:0/3587429709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1b00c0bc0 0x7ff1b0156170 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 >> 172.21.15.115:0/3587429709 conn(0x7ff1b005e8f0 msgr2=0x7ff1b00ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.164+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 shutdown_connections 2023-07-27T14:39:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.165+0000 7ff1b71ff700 1 -- 172.21.15.115:0/3587429709 wait complete. 2023-07-27T14:39:44.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get new_pool pg_num 2023-07-27T14:39:44.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.382+0000 7fc0ef9ff700 1 Processor -- start 2023-07-27T14:39:44.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.382+0000 7fc0ef9ff700 1 -- start start 2023-07-27T14:39:44.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0ef9ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc0e814ae00 0x7fc0e8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0ef9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0e814b1e0 0x7fc0e8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0ef9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e81553f0 con 0x7fc0e80c5c50 2023-07-27T14:39:44.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0ef9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e8157a50 con 0x7fc0e814b1e0 2023-07-27T14:39:44.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0ef9ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e8157d10 con 0x7fc0e814ae00 2023-07-27T14:39:44.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0ecf9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0e814b1e0 0x7fc0e8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0edf9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc0e80c5c50 0x7fc0e80a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47228/0 (socket says 172.21.15.115:47228) 2023-07-27T14:39:44.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0edf9c700 1 -- 172.21.15.115:0/3602925261 learned_addr learned my addr 172.21.15.115:0/3602925261 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:44.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.384+0000 7fc0ed79b700 1 --2- 172.21.15.115:0/3602925261 >> v2:172.21.15.159:3300/0 conn(0x7fc0e814ae00 0x7fc0e8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0dffff700 1 -- 172.21.15.115:0/3602925261 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131846051 0 0) 0x7fc0e81553f0 con 0x7fc0e80c5c50 2023-07-27T14:39:44.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0dffff700 1 -- 172.21.15.115:0/3602925261 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d40033f0 con 0x7fc0e80c5c50 2023-07-27T14:39:44.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0ecf9a700 1 -- 172.21.15.115:0/3602925261 >> v2:172.21.15.159:3300/0 conn(0x7fc0e814ae00 msgr2=0x7fc0e8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:44.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0ecf9a700 1 --2- 172.21.15.115:0/3602925261 >> v2:172.21.15.159:3300/0 conn(0x7fc0e814ae00 0x7fc0e8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0ecf9a700 1 -- 172.21.15.115:0/3602925261 >> v1:172.21.15.115:6789/0 conn(0x7fc0e80c5c50 legacy=0x7fc0e80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0ecf9a700 1 -- 172.21.15.115:0/3602925261 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8157ff0 con 0x7fc0e814b1e0 2023-07-27T14:39:44.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0ecf9a700 1 --2- 172.21.15.115:0/3602925261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8062b50 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7fc0e8155580 tx=0x7fc0d8009060).ready entity=mon.0 client_cookie=fdafee4a5bced77 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0dffff700 1 -- 172.21.15.115:0/3602925261 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800d4a0 con 0x7fc0e814b1e0 2023-07-27T14:39:44.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0dffff700 1 -- 172.21.15.115:0/3602925261 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d800d600 con 0x7fc0e814b1e0 2023-07-27T14:39:44.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0dffff700 1 -- 172.21.15.115:0/3602925261 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800d980 con 0x7fc0e814b1e0 2023-07-27T14:39:44.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/3602925261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 msgr2=0x7fc0e8062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.385+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/3602925261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8062b50 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7fc0e8155580 tx=0x7fc0d8009060).stop 2023-07-27T14:39:44.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.386+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/3602925261 shutdown_connections 2023-07-27T14:39:44.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.386+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/3602925261 >> v2:172.21.15.159:3300/0 conn(0x7fc0e814ae00 0x7fc0e8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.386+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/3602925261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8062b50 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.386+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/3602925261 >> 172.21.15.115:0/3602925261 conn(0x7fc0e805e940 msgr2=0x7fc0e80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:44.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.386+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/3602925261 shutdown_connections 2023-07-27T14:39:44.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.386+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/3602925261 wait complete. 2023-07-27T14:39:44.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.387+0000 7fc0ef9ff700 1 Processor -- start 2023-07-27T14:39:44.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.387+0000 7fc0ef9ff700 1 -- start start 2023-07-27T14:39:44.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.388+0000 7fc0ef9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0e80c5c50 0x7fc0e8137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.388+0000 7fc0ef9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0e814ae00 0x7fc0e8167370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.388+0000 7fc0ef9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8167860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.388+0000 7fc0ef9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8167d50 con 0x7fc0e814b1e0 2023-07-27T14:39:44.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.388+0000 7fc0ef9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80adb60 con 0x7fc0e80c5c50 2023-07-27T14:39:44.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.388+0000 7fc0ef9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80b09c0 con 0x7fc0e814ae00 2023-07-27T14:39:44.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.388+0000 7fc0edf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8167860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0edf9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8167860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50752/0 (socket says 172.21.15.115:50752) 2023-07-27T14:39:44.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0edf9c700 1 -- 172.21.15.115:0/4110241167 learned_addr learned my addr 172.21.15.115:0/4110241167 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:44.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0ed79b700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0e80c5c50 0x7fc0e8137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0ecf9a700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0e814ae00 0x7fc0e8167370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0edf9c700 1 -- 172.21.15.115:0/4110241167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0e814ae00 msgr2=0x7fc0e8167370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0edf9c700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0e814ae00 0x7fc0e8167370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0edf9c700 1 -- 172.21.15.115:0/4110241167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0e80c5c50 msgr2=0x7fc0e8137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0edf9c700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0e80c5c50 0x7fc0e8137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0edf9c700 1 -- 172.21.15.115:0/4110241167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d80092a0 con 0x7fc0e814b1e0 2023-07-27T14:39:44.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0edf9c700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8167860 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7fc0e000c7c0 tx=0x7fc0e0007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0dd7fa700 1 -- 172.21.15.115:0/4110241167 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0005d30 con 0x7fc0e814b1e0 2023-07-27T14:39:44.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0dd7fa700 1 -- 172.21.15.115:0/4110241167 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0005e90 con 0x7fc0e814b1e0 2023-07-27T14:39:44.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e8156ec0 con 0x7fc0e814b1e0 2023-07-27T14:39:44.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.389+0000 7fc0dd7fa700 1 -- 172.21.15.115:0/4110241167 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0007360 con 0x7fc0e814b1e0 2023-07-27T14:39:44.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.390+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e80ae330 con 0x7fc0e814b1e0 2023-07-27T14:39:44.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.390+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e80ae6a0 con 0x7fc0e814b1e0 2023-07-27T14:39:44.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.391+0000 7fc0dd7fa700 1 -- 172.21.15.115:0/4110241167 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fc0e0019020 con 0x7fc0e814b1e0 2023-07-27T14:39:44.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.392+0000 7fc0dd7fa700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc0cc05fc90 0x7fc0cc062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.392+0000 7fc0dd7fa700 1 -- 172.21.15.115:0/4110241167 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6628+0+0 (secure 0 0 0) 0x7fc0e007ae70 con 0x7fc0e814b1e0 2023-07-27T14:39:44.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.392+0000 7fc0ed79b700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc0cc05fc90 0x7fc0cc062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.393+0000 7fc0ed79b700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc0cc05fc90 0x7fc0cc062150 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fc0e4009c30 tx=0x7fc0e4009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.396+0000 7fc0dd7fa700 1 -- 172.21.15.115:0/4110241167 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0e004ecb0 con 0x7fc0e814b1e0 2023-07-27T14:39:44.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.564+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "new_pool", "var": "pg_num"} v 0) v1 -- 0x7fc0e80ade90 con 0x7fc0e814b1e0 2023-07-27T14:39:44.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.564+0000 7fc0dd7fa700 1 -- 172.21.15.115:0/4110241167 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "new_pool", "var": "pg_num"}]=0 v192) v1 ==== 97+0+11 (secure 0 0 0) 0x7fc0e004e8a0 con 0x7fc0e814b1e0 2023-07-27T14:39:44.620 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 32 2023-07-27T14:39:44.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc0cc05fc90 msgr2=0x7fc0cc062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc0cc05fc90 0x7fc0cc062150 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fc0e4009c30 tx=0x7fc0e4009060).stop 2023-07-27T14:39:44.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 msgr2=0x7fc0e8167860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8167860 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 rx=0x7fc0e000c7c0 tx=0x7fc0e0007f10).stop 2023-07-27T14:39:44.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 shutdown_connections 2023-07-27T14:39:44.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc0cc05fc90 0x7fc0cc062150 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0e814b1e0 0x7fc0e8167860 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0e80c5c50 0x7fc0e8137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 --2- 172.21.15.115:0/4110241167 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc0e814ae00 0x7fc0e8167370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 >> 172.21.15.115:0/4110241167 conn(0x7fc0e805e940 msgr2=0x7fc0e80ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:44.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 shutdown_connections 2023-07-27T14:39:44.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.566+0000 7fc0ef9ff700 1 -- 172.21.15.115:0/4110241167 wait complete. 2023-07-27T14:39:44.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:39:44.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.772+0000 7f61dd7ff700 1 Processor -- start 2023-07-27T14:39:44.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.773+0000 7f61dd7ff700 1 -- start start 2023-07-27T14:39:44.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.774+0000 7f61dd7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d8066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.774+0000 7f61dd7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d8067080 con 0x7f61d8151d70 2023-07-27T14:39:44.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.774+0000 7f61dd7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d8066df0 con 0x7f61d8066960 2023-07-27T14:39:44.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.774+0000 7f61dd7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8063a90 con 0x7f61d8065ff0 2023-07-27T14:39:44.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.774+0000 7f61d6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f61d8151d70 0x7f61d8155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47238/0 (socket says 172.21.15.115:47238) 2023-07-27T14:39:44.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.774+0000 7f61d6ffd700 1 -- 172.21.15.115:0/3876286632 learned_addr learned my addr 172.21.15.115:0/3876286632 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:44.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.774+0000 7f61d67fc700 1 --2- 172.21.15.115:0/3876286632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d8066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d5ffb700 1 -- 172.21.15.115:0/3876286632 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429951915 0 0) 0x7f61d8067080 con 0x7f61d8151d70 2023-07-27T14:39:44.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d5ffb700 1 -- 172.21.15.115:0/3876286632 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c00033f0 con 0x7f61d8151d70 2023-07-27T14:39:44.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d5ffb700 1 -- 172.21.15.115:0/3876286632 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263699870 0 0) 0x7f61d8066df0 con 0x7f61d8066960 2023-07-27T14:39:44.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d5ffb700 1 -- 172.21.15.115:0/3876286632 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d8067080 con 0x7f61d8066960 2023-07-27T14:39:44.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d67fc700 1 -- 172.21.15.115:0/3876286632 >> v1:172.21.15.159:6789/0 conn(0x7f61d8066960 legacy=0x7f61d8067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d5ffb700 1 -- 172.21.15.115:0/3876286632 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3941702554 0 0) 0x7f61c00033f0 con 0x7f61d8151d70 2023-07-27T14:39:44.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d67fc700 1 -- 172.21.15.115:0/3876286632 >> v1:172.21.15.115:6789/0 conn(0x7f61d8151d70 legacy=0x7f61d8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d67fc700 1 -- 172.21.15.115:0/3876286632 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d80634d0 con 0x7f61d8065ff0 2023-07-27T14:39:44.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d67fc700 1 --2- 172.21.15.115:0/3876286632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d8066470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f61cc009790 tx=0x7f61cc009060).ready entity=mon.2 client_cookie=da6cc1e6caacb250 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d5ffb700 1 -- 172.21.15.115:0/3876286632 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8001470 con 0x7f61d8065ff0 2023-07-27T14:39:44.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d5ffb700 1 -- 172.21.15.115:0/3876286632 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc011400 con 0x7f61d8065ff0 2023-07-27T14:39:44.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.775+0000 7f61d5ffb700 1 -- 172.21.15.115:0/3876286632 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc011780 con 0x7f61d8065ff0 2023-07-27T14:39:44.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.776+0000 7f61dd7ff700 1 -- 172.21.15.115:0/3876286632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 msgr2=0x7f61d8066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.776+0000 7f61dd7ff700 1 --2- 172.21.15.115:0/3876286632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d8066470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f61cc009790 tx=0x7f61cc009060).stop 2023-07-27T14:39:44.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.776+0000 7f61dd7ff700 1 -- 172.21.15.115:0/3876286632 shutdown_connections 2023-07-27T14:39:44.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.776+0000 7f61dd7ff700 1 --2- 172.21.15.115:0/3876286632 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d8066470 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.776+0000 7f61dd7ff700 1 -- 172.21.15.115:0/3876286632 >> 172.21.15.115:0/3876286632 conn(0x7f61d80c89a0 msgr2=0x7f61d80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:44.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.776+0000 7f61dd7ff700 1 -- 172.21.15.115:0/3876286632 shutdown_connections 2023-07-27T14:39:44.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.776+0000 7f61dd7ff700 1 -- 172.21.15.115:0/3876286632 wait complete. 2023-07-27T14:39:44.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.777+0000 7f61dd7ff700 1 Processor -- start 2023-07-27T14:39:44.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.778+0000 7f61dd7ff700 1 -- start start 2023-07-27T14:39:44.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.778+0000 7f61dd7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d80ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.778+0000 7f61dd7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d8066960 0x7f61d80a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.778+0000 7f61dd7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d8151d70 0x7f61d8165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.778+0000 7f61dd7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8162120 con 0x7f61d8151d70 2023-07-27T14:39:44.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.778+0000 7f61dd7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80a9660 con 0x7f61d8066960 2023-07-27T14:39:44.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.778+0000 7f61dd7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80aa1e0 con 0x7f61d8065ff0 2023-07-27T14:39:44.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d8151d70 0x7f61d8165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d8151d70 0x7f61d8165830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50764/0 (socket says 172.21.15.115:50764) 2023-07-27T14:39:44.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 -- 172.21.15.115:0/913531669 learned_addr learned my addr 172.21.15.115:0/913531669 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:44.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 -- 172.21.15.115:0/913531669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 msgr2=0x7f61d80ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d6ffd700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d80ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d80ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:44.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 -- 172.21.15.115:0/913531669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d8066960 msgr2=0x7f61d80a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:44.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d8066960 0x7f61d80a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:44.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 -- 172.21.15.115:0/913531669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0092a0 con 0x7f61d8151d70 2023-07-27T14:39:44.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61d77fe700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d8151d70 0x7f61d8165830 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7f61d000c740 tx=0x7f61d000cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61beffd700 1 -- 172.21.15.115:0/913531669 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0002240 con 0x7f61d8151d70 2023-07-27T14:39:44.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61beffd700 1 -- 172.21.15.115:0/913531669 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00023a0 con 0x7f61d8151d70 2023-07-27T14:39:44.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61beffd700 1 -- 172.21.15.115:0/913531669 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0001650 con 0x7f61d8151d70 2023-07-27T14:39:44.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.779+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d80a98b0 con 0x7f61d8151d70 2023-07-27T14:39:44.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.780+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d80a9e70 con 0x7f61d8151d70 2023-07-27T14:39:44.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.781+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d806c470 con 0x7f61d8151d70 2023-07-27T14:39:44.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.782+0000 7f61beffd700 1 -- 172.21.15.115:0/913531669 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f61d0019030 con 0x7f61d8151d70 2023-07-27T14:39:44.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.782+0000 7f61beffd700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61c405fcc0 0x7f61c4062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:44.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.783+0000 7f61beffd700 1 -- 172.21.15.115:0/913531669 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6628+0+0 (secure 0 0 0) 0x7f61d007abb0 con 0x7f61d8151d70 2023-07-27T14:39:44.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.783+0000 7f61d6ffd700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61c405fcc0 0x7f61c4062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:44.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.783+0000 7f61d6ffd700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61c405fcc0 0x7f61c4062180 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f61c8007a00 tx=0x7f61c8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:44.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.786+0000 7f61beffd700 1 -- 172.21.15.115:0/913531669 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f61d0081080 con 0x7f61d8151d70 2023-07-27T14:39:45.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.998+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61d80aa320 con 0x7f61d8151d70 2023-07-27T14:39:45.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:44.998+0000 7f61beffd700 1 -- 172.21.15.115:0/913531669 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4507 (secure 0 0 0) 0x7f61d004b020 con 0x7f61d8151d70 2023-07-27T14:39:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:45.054 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2746189426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2746189426},{"type":"v1","addr":"172.21.15.159:6835","nonce":2746189426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/131117331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":131117331},{"type":"v1","addr":"172.21.15.115:6837","nonce":131117331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":8608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3669259360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3669259360},{"type":"v1","addr":"172.21.15.159:6834","nonce":3669259360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:38:54.165239+0000","modified":"2023-07-27T14:39:13.190759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2564907842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2564907842},{"type":"v1","addr":"172.21.15.115:6836","nonce":2564907842}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26,27],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-07-27T14:39:45.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61c405fcc0 msgr2=0x7f61c4062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61c405fcc0 0x7f61c4062180 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f61c8007a00 tx=0x7f61c8009040).stop 2023-07-27T14:39:45.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d8151d70 msgr2=0x7f61d8165830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d8151d70 0x7f61d8165830 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7f61d000c740 tx=0x7f61d000cb00).stop 2023-07-27T14:39:45.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 shutdown_connections 2023-07-27T14:39:45.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61c405fcc0 0x7f61c4062180 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61d8151d70 0x7f61d8165830 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f61d8065ff0 0x7f61d80ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 --2- 172.21.15.115:0/913531669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61d8066960 0x7f61d80a7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:45.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 >> 172.21.15.115:0/913531669 conn(0x7f61d80c89a0 msgr2=0x7f61d8153700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:45.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 shutdown_connections 2023-07-27T14:39:45.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.000+0000 7f61dd7ff700 1 -- 172.21.15.115:0/913531669 wait complete. 2023-07-27T14:39:45.058 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 104 2023-07-27T14:39:45.073 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:39:45.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.206+0000 7f9e269ff700 1 Processor -- start 2023-07-27T14:39:45.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.206+0000 7f9e269ff700 1 -- start start 2023-07-27T14:39:45.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e269ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 0x7f9e200640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e269ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e201542a0 0x7f9e200645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e269ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e200aa4d0 con 0x7f9e20153ec0 2023-07-27T14:39:45.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e269ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e20064ad0 con 0x7f9e201542a0 2023-07-27T14:39:45.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e269ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200c05c0 con 0x7f9e200aaa40 2023-07-27T14:39:45.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e24f9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e201542a0 0x7f9e200645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e24f9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e201542a0 0x7f9e200645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50770/0 (socket says 172.21.15.115:50770) 2023-07-27T14:39:45.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e24f9c700 1 -- 172.21.15.115:0/977756322 learned_addr learned my addr 172.21.15.115:0/977756322 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:45.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e1f7fe700 1 --2- 172.21.15.115:0/977756322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 0x7f9e200640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e24f9c700 1 -- 172.21.15.115:0/977756322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 msgr2=0x7f9e200640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:45.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e24f9c700 1 --2- 172.21.15.115:0/977756322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 0x7f9e200640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e24f9c700 1 -- 172.21.15.115:0/977756322 >> v1:172.21.15.159:6789/0 conn(0x7f9e20153ec0 legacy=0x7f9e200a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.208+0000 7f9e24f9c700 1 -- 172.21.15.115:0/977756322 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200c1a60 con 0x7f9e201542a0 2023-07-27T14:39:45.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.209+0000 7f9e24f9c700 1 --2- 172.21.15.115:0/977756322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e200645e0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7f9e18006fd0 tx=0x7f9e180090f0).ready entity=mon.0 client_cookie=d817f5ab39a73439 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:45.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.209+0000 7f9e1effd700 1 -- 172.21.15.115:0/977756322 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800b580 con 0x7f9e201542a0 2023-07-27T14:39:45.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.209+0000 7f9e1effd700 1 -- 172.21.15.115:0/977756322 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800b6e0 con 0x7f9e201542a0 2023-07-27T14:39:45.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.209+0000 7f9e1effd700 1 -- 172.21.15.115:0/977756322 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800ba60 con 0x7f9e201542a0 2023-07-27T14:39:45.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.209+0000 7f9e269ff700 1 -- 172.21.15.115:0/977756322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 msgr2=0x7f9e200645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.209+0000 7f9e269ff700 1 --2- 172.21.15.115:0/977756322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e200645e0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7f9e18006fd0 tx=0x7f9e180090f0).stop 2023-07-27T14:39:45.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.210+0000 7f9e269ff700 1 -- 172.21.15.115:0/977756322 shutdown_connections 2023-07-27T14:39:45.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.210+0000 7f9e269ff700 1 --2- 172.21.15.115:0/977756322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e200645e0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.210+0000 7f9e269ff700 1 --2- 172.21.15.115:0/977756322 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 0x7f9e200640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.210+0000 7f9e269ff700 1 -- 172.21.15.115:0/977756322 >> 172.21.15.115:0/977756322 conn(0x7f9e200cb610 msgr2=0x7f9e200c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:45.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.210+0000 7f9e269ff700 1 -- 172.21.15.115:0/977756322 shutdown_connections 2023-07-27T14:39:45.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.210+0000 7f9e269ff700 1 -- 172.21.15.115:0/977756322 wait complete. 2023-07-27T14:39:45.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.211+0000 7f9e269ff700 1 Processor -- start 2023-07-27T14:39:45.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.211+0000 7f9e269ff700 1 -- start start 2023-07-27T14:39:45.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.212+0000 7f9e269ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 0x7f9e201513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.212+0000 7f9e269ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20153ec0 0x7f9e200afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.212+0000 7f9e269ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e2014c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.212+0000 7f9e269ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200c2580 con 0x7f9e201542a0 2023-07-27T14:39:45.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.212+0000 7f9e269ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200c2820 con 0x7f9e20153ec0 2023-07-27T14:39:45.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.212+0000 7f9e269ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201521e0 con 0x7f9e200aaa40 2023-07-27T14:39:45.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e2014c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e1ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 0x7f9e201513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e2014c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50778/0 (socket says 172.21.15.115:50778) 2023-07-27T14:39:45.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 -- 172.21.15.115:0/1959778021 learned_addr learned my addr 172.21.15.115:0/1959778021 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:45.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e1f7fe700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20153ec0 0x7f9e200afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 -- 172.21.15.115:0/1959778021 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 msgr2=0x7f9e201513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 0x7f9e201513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 -- 172.21.15.115:0/1959778021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20153ec0 msgr2=0x7f9e200afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20153ec0 0x7f9e200afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 -- 172.21.15.115:0/1959778021 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e18009370 con 0x7f9e201542a0 2023-07-27T14:39:45.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e24f9c700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e2014c920 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f9e18011000 tx=0x7f9e18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:45.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e07fff700 1 -- 172.21.15.115:0/1959778021 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18006d90 con 0x7f9e201542a0 2023-07-27T14:39:45.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e07fff700 1 -- 172.21.15.115:0/1959778021 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800b850 con 0x7f9e201542a0 2023-07-27T14:39:45.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e20151940 con 0x7f9e201542a0 2023-07-27T14:39:45.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.213+0000 7f9e07fff700 1 -- 172.21.15.115:0/1959778021 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1801c670 con 0x7f9e201542a0 2023-07-27T14:39:45.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.214+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e20151f00 con 0x7f9e201542a0 2023-07-27T14:39:45.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.215+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e200b0210 con 0x7f9e201542a0 2023-07-27T14:39:45.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.216+0000 7f9e07fff700 1 -- 172.21.15.115:0/1959778021 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f9e18022020 con 0x7f9e201542a0 2023-07-27T14:39:45.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.217+0000 7f9e07fff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e0c05fcc0 0x7f9e0c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.217+0000 7f9e07fff700 1 -- 172.21.15.115:0/1959778021 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6628+0+0 (secure 0 0 0) 0x7f9e1807cd00 con 0x7f9e201542a0 2023-07-27T14:39:45.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.217+0000 7f9e1ffff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e0c05fcc0 0x7f9e0c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.217+0000 7f9e1ffff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e0c05fcc0 0x7f9e0c062180 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f9e10003900 tx=0x7f9e10007d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:45.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.221+0000 7f9e07fff700 1 -- 172.21.15.115:0/1959778021 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e1804d170 con 0x7f9e201542a0 2023-07-27T14:39:45.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.392+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e200c8230 con 0x7f9e201542a0 2023-07-27T14:39:45.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.393+0000 7f9e07fff700 1 -- 172.21.15.115:0/1959778021 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18871 (secure 0 0 0) 0x7f9e18050790 con 0x7f9e201542a0 2023-07-27T14:39:45.448 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:45.449 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":192,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:39:43.851444+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:38:51.766720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-27T14:38:53.161829+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":192,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":27,"pool_name":"new_pool","create_time":"2023-07-27T14:39:12.349824+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":192,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]},{"pool":27,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":26,"snaps":[{"begin":2,"length":2}]},{"pool":27,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:39:45.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e0c05fcc0 msgr2=0x7f9e0c062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e0c05fcc0 0x7f9e0c062180 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f9e10003900 tx=0x7f9e10007d40).stop 2023-07-27T14:39:45.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 msgr2=0x7f9e2014c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e2014c920 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f9e18011000 tx=0x7f9e18017000).stop 2023-07-27T14:39:45.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 shutdown_connections 2023-07-27T14:39:45.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9e0c05fcc0 0x7f9e0c062180 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e201542a0 0x7f9e2014c920 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200aaa40 0x7f9e201513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 --2- 172.21.15.115:0/1959778021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20153ec0 0x7f9e200afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 >> 172.21.15.115:0/1959778021 conn(0x7f9e200cb610 msgr2=0x7f9e200aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:45.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 shutdown_connections 2023-07-27T14:39:45.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.395+0000 7f9e269ff700 1 -- 172.21.15.115:0/1959778021 wait complete. 2023-07-27T14:39:45.468 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:39:45.469 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:39:45.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.602+0000 7f6fccfff700 1 Processor -- start 2023-07-27T14:39:45.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.602+0000 7f6fccfff700 1 -- start start 2023-07-27T14:39:45.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fccfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6fc80aaa40 0x7f6fc80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fccfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fccfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc80aa4d0 con 0x7f6fc8153ec0 2023-07-27T14:39:45.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fccfff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc8064ad0 con 0x7f6fc80aaa40 2023-07-27T14:39:45.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fccfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80c05c0 con 0x7f6fc81542a0 2023-07-27T14:39:45.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fc659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6fc8153ec0 0x7f6fc80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47242/0 (socket says 172.21.15.115:47242) 2023-07-27T14:39:45.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fc659c700 1 -- 172.21.15.115:0/1161122284 learned_addr learned my addr 172.21.15.115:0/1161122284 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:45.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fc5d9b700 1 --2- 172.21.15.115:0/1161122284 >> v2:172.21.15.159:3300/0 conn(0x7f6fc80aaa40 0x7f6fc80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fc6d9d700 1 --2- 172.21.15.115:0/1161122284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.604+0000 7f6fc559a700 1 -- 172.21.15.115:0/1161122284 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372031179 0 0) 0x7f6fb8001110 con 0x7f6fc8153ec0 2023-07-27T14:39:45.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc559a700 1 -- 172.21.15.115:0/1161122284 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb00033f0 con 0x7f6fc8153ec0 2023-07-27T14:39:45.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc559a700 1 -- 172.21.15.115:0/1161122284 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1593193107 0 0) 0x7f6fb00033f0 con 0x7f6fc8153ec0 2023-07-27T14:39:45.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc6d9d700 1 -- 172.21.15.115:0/1161122284 >> v2:172.21.15.159:3300/0 conn(0x7f6fc80aaa40 msgr2=0x7f6fc80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:45.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc6d9d700 1 --2- 172.21.15.115:0/1161122284 >> v2:172.21.15.159:3300/0 conn(0x7f6fc80aaa40 0x7f6fc80640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc6d9d700 1 -- 172.21.15.115:0/1161122284 >> v1:172.21.15.115:6789/0 conn(0x7f6fc8153ec0 legacy=0x7f6fc80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc6d9d700 1 -- 172.21.15.115:0/1161122284 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80c1a60 con 0x7f6fc81542a0 2023-07-27T14:39:45.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc6d9d700 1 --2- 172.21.15.115:0/1161122284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc80645e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f6fc0009e60 tx=0x7f6fc0009780).ready entity=mon.2 client_cookie=96e697a01e411a94 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:45.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc559a700 1 -- 172.21.15.115:0/1161122284 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000e070 con 0x7f6fc81542a0 2023-07-27T14:39:45.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc559a700 1 -- 172.21.15.115:0/1161122284 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000b7a0 con 0x7f6fc81542a0 2023-07-27T14:39:45.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.605+0000 7f6fc559a700 1 -- 172.21.15.115:0/1161122284 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8001600 con 0x7f6fc81542a0 2023-07-27T14:39:45.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.606+0000 7f6fccfff700 1 -- 172.21.15.115:0/1161122284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 msgr2=0x7f6fc80645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.606+0000 7f6fccfff700 1 --2- 172.21.15.115:0/1161122284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc80645e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f6fc0009e60 tx=0x7f6fc0009780).stop 2023-07-27T14:39:45.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.606+0000 7f6fccfff700 1 -- 172.21.15.115:0/1161122284 shutdown_connections 2023-07-27T14:39:45.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.606+0000 7f6fccfff700 1 --2- 172.21.15.115:0/1161122284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc80645e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.606+0000 7f6fccfff700 1 --2- 172.21.15.115:0/1161122284 >> v2:172.21.15.159:3300/0 conn(0x7f6fc80aaa40 0x7f6fc80640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.606+0000 7f6fccfff700 1 -- 172.21.15.115:0/1161122284 >> 172.21.15.115:0/1161122284 conn(0x7f6fc80cb610 msgr2=0x7f6fc80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:45.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.606+0000 7f6fccfff700 1 -- 172.21.15.115:0/1161122284 shutdown_connections 2023-07-27T14:39:45.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.606+0000 7f6fccfff700 1 -- 172.21.15.115:0/1161122284 wait complete. 2023-07-27T14:39:45.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.607+0000 7f6fccfff700 1 Processor -- start 2023-07-27T14:39:45.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.607+0000 7f6fccfff700 1 -- start start 2023-07-27T14:39:45.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.608+0000 7f6fccfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc80aaa40 0x7f6fc8142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.608+0000 7f6fccfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fc8153ec0 0x7f6fc81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.608+0000 7f6fccfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc8152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.608+0000 7f6fccfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80c3630 con 0x7f6fc80aaa40 2023-07-27T14:39:45.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.608+0000 7f6fccfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8152fc0 con 0x7f6fc8153ec0 2023-07-27T14:39:45.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.608+0000 7f6fccfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80c3350 con 0x7f6fc81542a0 2023-07-27T14:39:45.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc80aaa40 0x7f6fc8142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc80aaa40 0x7f6fc8142a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50786/0 (socket says 172.21.15.115:50786) 2023-07-27T14:39:45.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 -- 172.21.15.115:0/4291622012 learned_addr learned my addr 172.21.15.115:0/4291622012 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:45.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc5d9b700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fc8153ec0 0x7f6fc81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc6d9d700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc8152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 -- 172.21.15.115:0/4291622012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 msgr2=0x7f6fc8152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc8152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 -- 172.21.15.115:0/4291622012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fc8153ec0 msgr2=0x7f6fc81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fc8153ec0 0x7f6fc81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 -- 172.21.15.115:0/4291622012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0009a20 con 0x7f6fc80aaa40 2023-07-27T14:39:45.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fc659c700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc80aaa40 0x7f6fc8142a50 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f6fb800c810 tx=0x7f6fb8001450).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:45.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.609+0000 7f6fb67fc700 1 -- 172.21.15.115:0/4291622012 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8007170 con 0x7f6fc80aaa40 2023-07-27T14:39:45.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.610+0000 7f6fb67fc700 1 -- 172.21.15.115:0/4291622012 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb80072d0 con 0x7f6fc80aaa40 2023-07-27T14:39:45.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.610+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc8150550 con 0x7f6fc80aaa40 2023-07-27T14:39:45.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.610+0000 7f6fb67fc700 1 -- 172.21.15.115:0/4291622012 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80048c0 con 0x7f6fc80aaa40 2023-07-27T14:39:45.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.610+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc8150b10 con 0x7f6fc80aaa40 2023-07-27T14:39:45.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.611+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc81503b0 con 0x7f6fc80aaa40 2023-07-27T14:39:45.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.611+0000 7f6fb67fc700 1 -- 172.21.15.115:0/4291622012 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f6fb801b060 con 0x7f6fc80aaa40 2023-07-27T14:39:45.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.612+0000 7f6fb67fc700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6fa805fcc0 0x7f6fa8062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:45.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.612+0000 7f6fb67fc700 1 -- 172.21.15.115:0/4291622012 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6628+0+0 (secure 0 0 0) 0x7f6fb807af40 con 0x7f6fc80aaa40 2023-07-27T14:39:45.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.612+0000 7f6fc5d9b700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6fa805fcc0 0x7f6fa8062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:45.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.613+0000 7f6fc5d9b700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6fa805fcc0 0x7f6fa8062180 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f6fc8167960 tx=0x7f6fbc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:45.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.617+0000 7f6fb67fc700 1 -- 172.21.15.115:0/4291622012 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6fc81503b0 con 0x7f6fc80aaa40 2023-07-27T14:39:45.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.829+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fc80aa4d0 con 0x7f6fc80aaa40 2023-07-27T14:39:45.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.830+0000 7f6fb67fc700 1 -- 172.21.15.115:0/4291622012 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4507 (secure 0 0 0) 0x7f6fc80aa4d0 con 0x7f6fc80aaa40 2023-07-27T14:39:45.885 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:45.886 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2746189426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2746189426},{"type":"v1","addr":"172.21.15.159:6835","nonce":2746189426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/131117331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":131117331},{"type":"v1","addr":"172.21.15.115:6837","nonce":131117331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":8608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3669259360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3669259360},{"type":"v1","addr":"172.21.15.159:6834","nonce":3669259360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:38:54.165239+0000","modified":"2023-07-27T14:39:13.190759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2564907842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2564907842},{"type":"v1","addr":"172.21.15.115:6836","nonce":2564907842}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26,27],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-07-27T14:39:45.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6fa805fcc0 msgr2=0x7f6fa8062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6fa805fcc0 0x7f6fa8062180 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f6fc8167960 tx=0x7f6fbc008040).stop 2023-07-27T14:39:45.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc80aaa40 msgr2=0x7f6fc8142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:45.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc80aaa40 0x7f6fc8142a50 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f6fb800c810 tx=0x7f6fb8001450).stop 2023-07-27T14:39:45.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 shutdown_connections 2023-07-27T14:39:45.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6fa805fcc0 0x7f6fa8062180 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fc81542a0 0x7f6fc8152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fc80aaa40 0x7f6fc8142a50 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 --2- 172.21.15.115:0/4291622012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fc8153ec0 0x7f6fc81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:45.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 >> 172.21.15.115:0/4291622012 conn(0x7f6fc80cb610 msgr2=0x7f6fc80c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:45.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 shutdown_connections 2023-07-27T14:39:45.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:45.832+0000 7f6fccfff700 1 -- 172.21.15.115:0/4291622012 wait complete. 2023-07-27T14:39:45.891 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 104 2023-07-27T14:39:45.905 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:39:46.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.043+0000 7f9b94fff700 1 Processor -- start 2023-07-27T14:39:46.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.043+0000 7f9b94fff700 1 -- start start 2023-07-27T14:39:46.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.044+0000 7f9b94fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b90153ec0 0x7f9b900a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b94fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b900aa4d0 con 0x7f9b900aa050 2023-07-27T14:39:46.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b94fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b900c05c0 con 0x7f9b900aaa40 2023-07-27T14:39:46.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b94fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900bfc90 con 0x7f9b90153ec0 2023-07-27T14:39:46.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b8dd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9b900aa050 0x7f9b900640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47256/0 (socket says 172.21.15.115:47256) 2023-07-27T14:39:46.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b8dd9b700 1 -- 172.21.15.115:0/2733549232 learned_addr learned my addr 172.21.15.115:0/2733549232 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:46.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b8e59c700 1 --2- 172.21.15.115:0/2733549232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b90153ec0 0x7f9b900a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b8d59a700 1 -- 172.21.15.115:0/2733549232 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657646040 0 0) 0x7f9b84001110 con 0x7f9b900aa050 2023-07-27T14:39:46.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b8d59a700 1 -- 172.21.15.115:0/2733549232 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b780033f0 con 0x7f9b900aa050 2023-07-27T14:39:46.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b8d59a700 1 -- 172.21.15.115:0/2733549232 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486860472 0 0) 0x7f9b900c05c0 con 0x7f9b900aaa40 2023-07-27T14:39:46.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.045+0000 7f9b8d59a700 1 -- 172.21.15.115:0/2733549232 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b84001110 con 0x7f9b900aaa40 2023-07-27T14:39:46.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b8d59a700 1 -- 172.21.15.115:0/2733549232 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463876241 0 0) 0x7f9b780033f0 con 0x7f9b900aa050 2023-07-27T14:39:46.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b8e59c700 1 -- 172.21.15.115:0/2733549232 >> v1:172.21.15.159:6789/0 conn(0x7f9b900aaa40 legacy=0x7f9b900c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b8e59c700 1 -- 172.21.15.115:0/2733549232 >> v1:172.21.15.115:6789/0 conn(0x7f9b900aa050 legacy=0x7f9b900640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b8e59c700 1 -- 172.21.15.115:0/2733549232 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900bff70 con 0x7f9b90153ec0 2023-07-27T14:39:46.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b8e59c700 1 --2- 172.21.15.115:0/2733549232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b90153ec0 0x7f9b900a9b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9b80009790 tx=0x7f9b80009060).ready entity=mon.2 client_cookie=cebf1d680f4e1c9f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b8d59a700 1 -- 172.21.15.115:0/2733549232 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b84001600 con 0x7f9b90153ec0 2023-07-27T14:39:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b8d59a700 1 -- 172.21.15.115:0/2733549232 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80011400 con 0x7f9b90153ec0 2023-07-27T14:39:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b8d59a700 1 -- 172.21.15.115:0/2733549232 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80011780 con 0x7f9b90153ec0 2023-07-27T14:39:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b94fff700 1 -- 172.21.15.115:0/2733549232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b90153ec0 msgr2=0x7f9b900a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.046+0000 7f9b94fff700 1 --2- 172.21.15.115:0/2733549232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b90153ec0 0x7f9b900a9b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9b80009790 tx=0x7f9b80009060).stop 2023-07-27T14:39:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.047+0000 7f9b94fff700 1 -- 172.21.15.115:0/2733549232 shutdown_connections 2023-07-27T14:39:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.047+0000 7f9b94fff700 1 --2- 172.21.15.115:0/2733549232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b90153ec0 0x7f9b900a9b60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.047+0000 7f9b94fff700 1 -- 172.21.15.115:0/2733549232 >> 172.21.15.115:0/2733549232 conn(0x7f9b900cb610 msgr2=0x7f9b900c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:46.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.047+0000 7f9b94fff700 1 -- 172.21.15.115:0/2733549232 shutdown_connections 2023-07-27T14:39:46.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.047+0000 7f9b94fff700 1 -- 172.21.15.115:0/2733549232 wait complete. 2023-07-27T14:39:46.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.048+0000 7f9b94fff700 1 Processor -- start 2023-07-27T14:39:46.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.048+0000 7f9b94fff700 1 -- start start 2023-07-27T14:39:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b94fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b900aa050 0x7f9b9014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b94fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b900aaa40 0x7f9b901509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b94fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b90153ec0 0x7f9b90150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b94fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b901513b0 con 0x7f9b90153ec0 2023-07-27T14:39:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b94fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900af7d0 con 0x7f9b900aa050 2023-07-27T14:39:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b94fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900aebc0 con 0x7f9b900aaa40 2023-07-27T14:39:46.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b8ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b90153ec0 0x7f9b90150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b8ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b90153ec0 0x7f9b90150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50790/0 (socket says 172.21.15.115:50790) 2023-07-27T14:39:46.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.049+0000 7f9b8ed9d700 1 -- 172.21.15.115:0/3442139534 learned_addr learned my addr 172.21.15.115:0/3442139534 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:46.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b8e59c700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b900aa050 0x7f9b9014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b8dd9b700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b900aaa40 0x7f9b901509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b8ed9d700 1 -- 172.21.15.115:0/3442139534 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b900aaa40 msgr2=0x7f9b901509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b8ed9d700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b900aaa40 0x7f9b901509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b8ed9d700 1 -- 172.21.15.115:0/3442139534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b900aa050 msgr2=0x7f9b9014c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b8ed9d700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b900aa050 0x7f9b9014c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b8ed9d700 1 -- 172.21.15.115:0/3442139534 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800092a0 con 0x7f9b90153ec0 2023-07-27T14:39:46.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b8ed9d700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b90153ec0 0x7f9b90150ec0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7f9b8800c790 tx=0x7f9b88007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b7e7fc700 1 -- 172.21.15.115:0/3442139534 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800e4a0 con 0x7f9b90153ec0 2023-07-27T14:39:46.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b7e7fc700 1 -- 172.21.15.115:0/3442139534 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8800e600 con 0x7f9b90153ec0 2023-07-27T14:39:46.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b900aeea0 con 0x7f9b90153ec0 2023-07-27T14:39:46.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.050+0000 7f9b7e7fc700 1 -- 172.21.15.115:0/3442139534 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800e9a0 con 0x7f9b90153ec0 2023-07-27T14:39:46.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.051+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b900af460 con 0x7f9b90153ec0 2023-07-27T14:39:46.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.051+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b900a9b60 con 0x7f9b90153ec0 2023-07-27T14:39:46.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.052+0000 7f9b7e7fc700 1 -- 172.21.15.115:0/3442139534 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f9b88019030 con 0x7f9b90153ec0 2023-07-27T14:39:46.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.053+0000 7f9b7e7fc700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9b7005fc90 0x7f9b70062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.054+0000 7f9b7e7fc700 1 -- 172.21.15.115:0/3442139534 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6628+0+0 (secure 0 0 0) 0x7f9b8807ab00 con 0x7f9b90153ec0 2023-07-27T14:39:46.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.054+0000 7f9b8e59c700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9b7005fc90 0x7f9b70062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.054+0000 7f9b8e59c700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9b7005fc90 0x7f9b70062150 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f9b800096e0 tx=0x7f9b80016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.058+0000 7f9b7e7fc700 1 -- 172.21.15.115:0/3442139534 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b8804af70 con 0x7f9b90153ec0 2023-07-27T14:39:46.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.267+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b9006c470 con 0x7f9b90153ec0 2023-07-27T14:39:46.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.268+0000 7f9b7e7fc700 1 -- 172.21.15.115:0/3442139534 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4507 (secure 0 0 0) 0x7f9b88017030 con 0x7f9b90153ec0 2023-07-27T14:39:46.324 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:46.324 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2746189426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2746189426},{"type":"v1","addr":"172.21.15.159:6835","nonce":2746189426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/131117331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":131117331},{"type":"v1","addr":"172.21.15.115:6837","nonce":131117331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":8608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3669259360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3669259360},{"type":"v1","addr":"172.21.15.159:6834","nonce":3669259360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:38:54.165239+0000","modified":"2023-07-27T14:39:13.190759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6836/2564907842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2564907842},{"type":"v1","addr":"172.21.15.115:6836","nonce":2564907842}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26,27],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-07-27T14:39:46.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9b7005fc90 msgr2=0x7f9b70062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9b7005fc90 0x7f9b70062150 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f9b800096e0 tx=0x7f9b80016000).stop 2023-07-27T14:39:46.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b90153ec0 msgr2=0x7f9b90150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b90153ec0 0x7f9b90150ec0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7f9b8800c790 tx=0x7f9b88007f20).stop 2023-07-27T14:39:46.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 shutdown_connections 2023-07-27T14:39:46.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9b7005fc90 0x7f9b70062150 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b90153ec0 0x7f9b90150ec0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b900aa050 0x7f9b9014c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 --2- 172.21.15.115:0/3442139534 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b900aaa40 0x7f9b901509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 >> 172.21.15.115:0/3442139534 conn(0x7f9b900cb610 msgr2=0x7f9b900ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 shutdown_connections 2023-07-27T14:39:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.270+0000 7f9b94fff700 1 -- 172.21.15.115:0/3442139534 wait complete. 2023-07-27T14:39:46.328 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 104 2023-07-27T14:39:46.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:39:46.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.477+0000 7f47acdff700 1 Processor -- start 2023-07-27T14:39:46.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.477+0000 7f47acdff700 1 -- start start 2023-07-27T14:39:46.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.478+0000 7f47acdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f47a8153ec0 0x7f47a80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.478+0000 7f47acdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f47a80aa050 0x7f47a80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.478+0000 7f47acdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80aa4d0 con 0x7f47a80aaa40 2023-07-27T14:39:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.478+0000 7f47acdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80c05c0 con 0x7f47a80aa050 2023-07-27T14:39:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.478+0000 7f47acdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80c1a60 con 0x7f47a8153ec0 2023-07-27T14:39:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a5d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f47a80aa050 0x7f47a80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a6d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f47a80aaa40 0x7f47a8157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47270/0 (socket says 172.21.15.115:47270) 2023-07-27T14:39:46.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a6d9d700 1 -- 172.21.15.115:0/497423066 learned_addr learned my addr 172.21.15.115:0/497423066 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:46.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a659c700 1 --2- 172.21.15.115:0/497423066 >> v2:172.21.15.159:3300/0 conn(0x7f47a8153ec0 0x7f47a80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a5d9b700 1 -- 172.21.15.115:0/497423066 >> v2:172.21.15.159:3300/0 conn(0x7f47a8153ec0 msgr2=0x7f47a80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:46.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a5d9b700 1 --2- 172.21.15.115:0/497423066 >> v2:172.21.15.159:3300/0 conn(0x7f47a8153ec0 0x7f47a80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a5d9b700 1 -- 172.21.15.115:0/497423066 >> v1:172.21.15.115:6789/0 conn(0x7f47a80aaa40 legacy=0x7f47a8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a5d9b700 1 -- 172.21.15.115:0/497423066 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80bfc90 con 0x7f47a80aa050 2023-07-27T14:39:46.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a559a700 1 -- 172.21.15.115:0/497423066 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172944892 0 0) 0x7f47a0001490 con 0x7f47a80aaa40 2023-07-27T14:39:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a659c700 1 --2- 172.21.15.115:0/497423066 >> v2:172.21.15.159:3300/0 conn(0x7f47a8153ec0 0x7f47a80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.479+0000 7f47a5d9b700 1 --2- 172.21.15.115:0/497423066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a80aa050 0x7f47a80640f0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f47a8083e30 tx=0x7f479c009060).ready entity=mon.0 client_cookie=96e761d405f46b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47a559a700 1 -- 172.21.15.115:0/497423066 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00b580 con 0x7f47a80aa050 2023-07-27T14:39:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47a559a700 1 -- 172.21.15.115:0/497423066 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c00b6e0 con 0x7f47a80aa050 2023-07-27T14:39:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47a559a700 1 -- 172.21.15.115:0/497423066 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00ba60 con 0x7f47a80aa050 2023-07-27T14:39:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47acdff700 1 -- 172.21.15.115:0/497423066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a80aa050 msgr2=0x7f47a80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47acdff700 1 --2- 172.21.15.115:0/497423066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a80aa050 0x7f47a80640f0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f47a8083e30 tx=0x7f479c009060).stop 2023-07-27T14:39:46.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47acdff700 1 -- 172.21.15.115:0/497423066 shutdown_connections 2023-07-27T14:39:46.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47acdff700 1 --2- 172.21.15.115:0/497423066 >> v2:172.21.15.159:3300/0 conn(0x7f47a8153ec0 0x7f47a80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47acdff700 1 --2- 172.21.15.115:0/497423066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a80aa050 0x7f47a80640f0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47acdff700 1 -- 172.21.15.115:0/497423066 >> 172.21.15.115:0/497423066 conn(0x7f47a80cb610 msgr2=0x7f47a80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:46.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47acdff700 1 -- 172.21.15.115:0/497423066 shutdown_connections 2023-07-27T14:39:46.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.480+0000 7f47acdff700 1 -- 172.21.15.115:0/497423066 wait complete. 2023-07-27T14:39:46.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.482+0000 7f47acdff700 1 Processor -- start 2023-07-27T14:39:46.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.482+0000 7f47acdff700 1 -- start start 2023-07-27T14:39:46.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47acdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a80aa050 0x7f47a80c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47acdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a80aaa40 0x7f47a814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47acdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a8153ec0 0x7f47a8150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47acdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80c4090 con 0x7f47a8153ec0 2023-07-27T14:39:46.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47acdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80c4a10 con 0x7f47a80aa050 2023-07-27T14:39:46.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47acdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80c31a0 con 0x7f47a80aaa40 2023-07-27T14:39:46.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a6d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a8153ec0 0x7f47a8150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a6d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a8153ec0 0x7f47a8150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50812/0 (socket says 172.21.15.115:50812) 2023-07-27T14:39:46.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a6d9d700 1 -- 172.21.15.115:0/540571841 learned_addr learned my addr 172.21.15.115:0/540571841 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:46.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a659c700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a80aa050 0x7f47a80c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a5d9b700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a80aaa40 0x7f47a814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a6d9d700 1 -- 172.21.15.115:0/540571841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a80aaa40 msgr2=0x7f47a814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a6d9d700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a80aaa40 0x7f47a814c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a6d9d700 1 -- 172.21.15.115:0/540571841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a80aa050 msgr2=0x7f47a80c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a6d9d700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a80aa050 0x7f47a80c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.483+0000 7f47a6d9d700 1 -- 172.21.15.115:0/540571841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0092a0 con 0x7f47a8153ec0 2023-07-27T14:39:46.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.484+0000 7f47a6d9d700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a8153ec0 0x7f47a8150160 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f47a000c7c0 tx=0x7f47a0007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.484+0000 7f47967fc700 1 -- 172.21.15.115:0/540571841 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0005d30 con 0x7f47a8153ec0 2023-07-27T14:39:46.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.484+0000 7f47967fc700 1 -- 172.21.15.115:0/540571841 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0005e90 con 0x7f47a8153ec0 2023-07-27T14:39:46.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.484+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a80c3480 con 0x7f47a8153ec0 2023-07-27T14:39:46.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.484+0000 7f47967fc700 1 -- 172.21.15.115:0/540571841 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0007320 con 0x7f47a8153ec0 2023-07-27T14:39:46.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.484+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a80c3a40 con 0x7f47a8153ec0 2023-07-27T14:39:46.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.485+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a80c4200 con 0x7f47a8153ec0 2023-07-27T14:39:46.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.486+0000 7f47967fc700 1 -- 172.21.15.115:0/540571841 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f47a0010030 con 0x7f47a8153ec0 2023-07-27T14:39:46.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.487+0000 7f47967fc700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f478805fc90 0x7f4788062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.487+0000 7f47967fc700 1 -- 172.21.15.115:0/540571841 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6628+0+0 (secure 0 0 0) 0x7f47a007b390 con 0x7f47a8153ec0 2023-07-27T14:39:46.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.487+0000 7f47a659c700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f478805fc90 0x7f4788062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.488+0000 7f47a659c700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f478805fc90 0x7f4788062150 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f479800a9d0 tx=0x7f4798008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.491+0000 7f47967fc700 1 -- 172.21.15.115:0/540571841 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f47a004b6f0 con 0x7f47a8153ec0 2023-07-27T14:39:46.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.663+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a80aa4d0 con 0x7f47a8153ec0 2023-07-27T14:39:46.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.664+0000 7f47967fc700 1 -- 172.21.15.115:0/540571841 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18871 (secure 0 0 0) 0x7f47a80aa4d0 con 0x7f47a8153ec0 2023-07-27T14:39:46.720 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:46.720 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":192,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:39:43.851444+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:38:51.766720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-27T14:38:53.161829+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":192,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":27,"pool_name":"new_pool","create_time":"2023-07-27T14:39:12.349824+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":192,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]},{"pool":27,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":26,"snaps":[{"begin":2,"length":2}]},{"pool":27,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:39:46.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.666+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f478805fc90 msgr2=0x7f4788062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.666+0000 7f47acdff700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f478805fc90 0x7f4788062150 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f479800a9d0 tx=0x7f4798008040).stop 2023-07-27T14:39:46.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.666+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a8153ec0 msgr2=0x7f47a8150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.666+0000 7f47acdff700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a8153ec0 0x7f47a8150160 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f47a000c7c0 tx=0x7f47a0007db0).stop 2023-07-27T14:39:46.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.666+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 shutdown_connections 2023-07-27T14:39:46.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.666+0000 7f47acdff700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f478805fc90 0x7f4788062150 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.666+0000 7f47acdff700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47a8153ec0 0x7f47a8150160 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.666+0000 7f47acdff700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a80aa050 0x7f47a80c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.667+0000 7f47acdff700 1 --2- 172.21.15.115:0/540571841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a80aaa40 0x7f47a814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.667+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 >> 172.21.15.115:0/540571841 conn(0x7f47a80cb610 msgr2=0x7f47a80ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:46.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.667+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 shutdown_connections 2023-07-27T14:39:46.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.667+0000 7f47acdff700 1 -- 172.21.15.115:0/540571841 wait complete. 2023-07-27T14:39:46.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:39:46.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.875+0000 7f65781ff700 1 Processor -- start 2023-07-27T14:39:46.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.875+0000 7f65781ff700 1 -- start start 2023-07-27T14:39:46.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.876+0000 7f65781ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6570153ec0 0x7f65700a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.876+0000 7f65781ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aa050 0x7f65700640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.876+0000 7f65781ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f65700aaa40 0x7f65700645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.876+0000 7f65781ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6570064ad0 con 0x7f65700aaa40 2023-07-27T14:39:46.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.876+0000 7f65781ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700aa4d0 con 0x7f6570153ec0 2023-07-27T14:39:46.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.876+0000 7f65781ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700c05c0 con 0x7f65700aa050 2023-07-27T14:39:46.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f65700aaa40 0x7f65700645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f65700aaa40 0x7f65700645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50818/0 (socket says 172.21.15.115:50818) 2023-07-27T14:39:46.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 -- 172.21.15.115:0/709087477 learned_addr learned my addr 172.21.15.115:0/709087477 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:46.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f6575f9b700 1 --2- 172.21.15.115:0/709087477 >> v2:172.21.15.159:3300/0 conn(0x7f6570153ec0 0x7f65700a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657579a700 1 --2- 172.21.15.115:0/709087477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aa050 0x7f65700640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 -- 172.21.15.115:0/709087477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aa050 msgr2=0x7f65700640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:46.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 --2- 172.21.15.115:0/709087477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aa050 0x7f65700640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 -- 172.21.15.115:0/709087477 >> v2:172.21.15.159:3300/0 conn(0x7f6570153ec0 msgr2=0x7f65700a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:46.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 --2- 172.21.15.115:0/709087477 >> v2:172.21.15.159:3300/0 conn(0x7f6570153ec0 0x7f65700a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 -- 172.21.15.115:0/709087477 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700bfc90 con 0x7f65700aaa40 2023-07-27T14:39:46.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.877+0000 7f657679c700 1 --2- 172.21.15.115:0/709087477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65700aaa40 0x7f65700645e0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7f6570083e30 tx=0x7f6568009840).ready entity=mon.0 client_cookie=3a9c220c568efc88 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f6574f99700 1 -- 172.21.15.115:0/709087477 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800e070 con 0x7f65700aaa40 2023-07-27T14:39:46.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f6574f99700 1 -- 172.21.15.115:0/709087477 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800ba50 con 0x7f65700aaa40 2023-07-27T14:39:46.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f6574f99700 1 -- 172.21.15.115:0/709087477 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800bdd0 con 0x7f65700aaa40 2023-07-27T14:39:46.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 -- 172.21.15.115:0/709087477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65700aaa40 msgr2=0x7f65700645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 --2- 172.21.15.115:0/709087477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65700aaa40 0x7f65700645e0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7f6570083e30 tx=0x7f6568009840).stop 2023-07-27T14:39:46.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 -- 172.21.15.115:0/709087477 shutdown_connections 2023-07-27T14:39:46.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 --2- 172.21.15.115:0/709087477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65700aaa40 0x7f65700645e0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 --2- 172.21.15.115:0/709087477 >> v2:172.21.15.159:3300/0 conn(0x7f6570153ec0 0x7f65700a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 --2- 172.21.15.115:0/709087477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aa050 0x7f65700640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 -- 172.21.15.115:0/709087477 >> 172.21.15.115:0/709087477 conn(0x7f65700cb610 msgr2=0x7f65700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:46.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 -- 172.21.15.115:0/709087477 shutdown_connections 2023-07-27T14:39:46.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.878+0000 7f65781ff700 1 -- 172.21.15.115:0/709087477 wait complete. 2023-07-27T14:39:46.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.880+0000 7f65781ff700 1 Processor -- start 2023-07-27T14:39:46.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.880+0000 7f65781ff700 1 -- start start 2023-07-27T14:39:46.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f65781ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aa050 0x7f657014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f65781ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aaa40 0x7f65700c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f65781ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6570153ec0 0x7f65700ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f65781ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700ca510 con 0x7f6570153ec0 2023-07-27T14:39:46.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f65781ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570164160 con 0x7f65700aa050 2023-07-27T14:39:46.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f65781ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6570150c20 con 0x7f65700aaa40 2023-07-27T14:39:46.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6570153ec0 0x7f65700ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657679c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6570153ec0 0x7f65700ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50830/0 (socket says 172.21.15.115:50830) 2023-07-27T14:39:46.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657679c700 1 -- 172.21.15.115:0/3651106663 learned_addr learned my addr 172.21.15.115:0/3651106663 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:46.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657579a700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aaa40 0x7f65700c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f6575f9b700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aa050 0x7f657014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657679c700 1 -- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aaa40 msgr2=0x7f65700c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657679c700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aaa40 0x7f65700c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657679c700 1 -- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aa050 msgr2=0x7f657014e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:46.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657679c700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aa050 0x7f657014e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:46.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657679c700 1 -- 172.21.15.115:0/3651106663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568009ae0 con 0x7f6570153ec0 2023-07-27T14:39:46.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.881+0000 7f657579a700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aaa40 0x7f65700c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:46.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.882+0000 7f657679c700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6570153ec0 0x7f65700ca020 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f6570060760 tx=0x7f6568009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.882+0000 7f6565ffb700 1 -- 172.21.15.115:0/3651106663 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568013e60 con 0x7f6570153ec0 2023-07-27T14:39:46.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.882+0000 7f6565ffb700 1 -- 172.21.15.115:0/3651106663 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656801e470 con 0x7f6570153ec0 2023-07-27T14:39:46.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.882+0000 7f6565ffb700 1 -- 172.21.15.115:0/3651106663 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656801e830 con 0x7f6570153ec0 2023-07-27T14:39:46.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.882+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6570150f00 con 0x7f6570153ec0 2023-07-27T14:39:46.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.882+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657014ee50 con 0x7f6570153ec0 2023-07-27T14:39:46.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.883+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65701642d0 con 0x7f6570153ec0 2023-07-27T14:39:46.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.884+0000 7f6565ffb700 1 -- 172.21.15.115:0/3651106663 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f6568025030 con 0x7f6570153ec0 2023-07-27T14:39:46.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.885+0000 7f6565ffb700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655405fcc0 0x7f6554062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:46.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.885+0000 7f6565ffb700 1 -- 172.21.15.115:0/3651106663 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6628+0+0 (secure 0 0 0) 0x7f656807cd00 con 0x7f6570153ec0 2023-07-27T14:39:46.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.885+0000 7f6575f9b700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655405fcc0 0x7f6554062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:46.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.885+0000 7f6575f9b700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655405fcc0 0x7f6554062180 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f656c006fd0 tx=0x7f656c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:46.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:46.889+0000 7f6565ffb700 1 -- 172.21.15.115:0/3651106663 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f656804d110 con 0x7f6570153ec0 2023-07-27T14:39:47.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.100+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f65700bff70 con 0x7f6570153ec0 2023-07-27T14:39:47.924 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:39:47.869+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:39:47.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.878+0000 7f6565ffb700 1 -- 172.21.15.115:0/3651106663 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6568023070 con 0x7f6570153ec0 2023-07-27T14:39:47.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655405fcc0 msgr2=0x7f6554062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:47.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655405fcc0 0x7f6554062180 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f656c006fd0 tx=0x7f656c008040).stop 2023-07-27T14:39:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6570153ec0 msgr2=0x7f65700ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6570153ec0 0x7f65700ca020 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f6570060760 tx=0x7f6568009840).stop 2023-07-27T14:39:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 shutdown_connections 2023-07-27T14:39:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f655405fcc0 0x7f6554062180 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6570153ec0 0x7f65700ca020 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65700aa050 0x7f657014e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 --2- 172.21.15.115:0/3651106663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65700aaa40 0x7f65700c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 >> 172.21.15.115:0/3651106663 conn(0x7f65700cb610 msgr2=0x7f65700afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 shutdown_connections 2023-07-27T14:39:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:47.881+0000 7f65781ff700 1 -- 172.21.15.115:0/3651106663 wait complete. 2023-07-27T14:39:47.939 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:39:47.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:39:47.999 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:39:48.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.100+0000 7f40ef7ff700 1 Processor -- start 2023-07-27T14:39:48.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.100+0000 7f40ef7ff700 1 -- start start 2023-07-27T14:39:48.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.101+0000 7f40ef7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f40e814ae00 0x7f40e8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:48.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.101+0000 7f40ef7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f40e814b1e0 0x7f40e8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:48.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.101+0000 7f40ef7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e81553f0 con 0x7f40e80c5c50 2023-07-27T14:39:48.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.101+0000 7f40ef7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e8157a50 con 0x7f40e814ae00 2023-07-27T14:39:48.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.101+0000 7f40ef7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e8157d10 con 0x7f40e814b1e0 2023-07-27T14:39:48.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ed59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f40e814ae00 0x7f40e8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:48.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ed59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f40e814ae00 0x7f40e8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50870/0 (socket says 172.21.15.115:50870) 2023-07-27T14:39:48.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ed59b700 1 -- 172.21.15.115:0/3440307609 learned_addr learned my addr 172.21.15.115:0/3440307609 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:48.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ecd9a700 1 --2- 172.21.15.115:0/3440307609 >> v2:172.21.15.159:3300/0 conn(0x7f40e814b1e0 0x7f40e8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:48.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ed59b700 1 -- 172.21.15.115:0/3440307609 >> v2:172.21.15.159:3300/0 conn(0x7f40e814b1e0 msgr2=0x7f40e8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:48.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ed59b700 1 --2- 172.21.15.115:0/3440307609 >> v2:172.21.15.159:3300/0 conn(0x7f40e814b1e0 0x7f40e8062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ed59b700 1 -- 172.21.15.115:0/3440307609 >> v1:172.21.15.159:6789/0 conn(0x7f40e80c5c50 legacy=0x7f40e80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:48.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ed59b700 1 -- 172.21.15.115:0/3440307609 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8157ff0 con 0x7f40e814ae00 2023-07-27T14:39:48.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.102+0000 7f40ed59b700 1 --2- 172.21.15.115:0/3440307609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e8154f00 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f40e8155580 tx=0x7f40e40090f0).ready entity=mon.0 client_cookie=ab85f86f22dfeac server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:48.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40dffff700 1 -- 172.21.15.115:0/3440307609 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400b600 con 0x7f40e814ae00 2023-07-27T14:39:48.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40dffff700 1 -- 172.21.15.115:0/3440307609 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e400b760 con 0x7f40e814ae00 2023-07-27T14:39:48.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40dffff700 1 -- 172.21.15.115:0/3440307609 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400bae0 con 0x7f40e814ae00 2023-07-27T14:39:48.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40ef7ff700 1 -- 172.21.15.115:0/3440307609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 msgr2=0x7f40e8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:48.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/3440307609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e8154f00 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f40e8155580 tx=0x7f40e40090f0).stop 2023-07-27T14:39:48.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40ef7ff700 1 -- 172.21.15.115:0/3440307609 shutdown_connections 2023-07-27T14:39:48.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/3440307609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e8154f00 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/3440307609 >> v2:172.21.15.159:3300/0 conn(0x7f40e814b1e0 0x7f40e8062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40ef7ff700 1 -- 172.21.15.115:0/3440307609 >> 172.21.15.115:0/3440307609 conn(0x7f40e805e940 msgr2=0x7f40e80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:48.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40ef7ff700 1 -- 172.21.15.115:0/3440307609 shutdown_connections 2023-07-27T14:39:48.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.103+0000 7f40ef7ff700 1 -- 172.21.15.115:0/3440307609 wait complete. 2023-07-27T14:39:48.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.105+0000 7f40ef7ff700 1 Processor -- start 2023-07-27T14:39:48.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.105+0000 7f40ef7ff700 1 -- start start 2023-07-27T14:39:48.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ef7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e80c5c50 0x7f40e814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:48.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ef7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e80c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:48.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ef7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e814b1e0 0x7f40e8164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:48.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ef7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8165130 con 0x7f40e814ae00 2023-07-27T14:39:48.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ef7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8164e00 con 0x7f40e80c5c50 2023-07-27T14:39:48.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ef7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80c4890 con 0x7f40e814b1e0 2023-07-27T14:39:48.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ecd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e80c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:48.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ecd9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e80c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50886/0 (socket says 172.21.15.115:50886) 2023-07-27T14:39:48.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ecd9a700 1 -- 172.21.15.115:0/2751367925 learned_addr learned my addr 172.21.15.115:0/2751367925 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:48.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40ed59b700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e80c5c50 0x7f40e814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:48.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.106+0000 7f40edd9c700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e814b1e0 0x7f40e8164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:48.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40ecd9a700 1 -- 172.21.15.115:0/2751367925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e814b1e0 msgr2=0x7f40e8164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:48.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40ecd9a700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e814b1e0 0x7f40e8164910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40ecd9a700 1 -- 172.21.15.115:0/2751367925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e80c5c50 msgr2=0x7f40e814a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:48.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40ecd9a700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e80c5c50 0x7f40e814a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40ecd9a700 1 -- 172.21.15.115:0/2751367925 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4009370 con 0x7f40e814ae00 2023-07-27T14:39:48.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40ecd9a700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e80c4220 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f40d8006980 tx=0x7f40d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:48.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40dd7fa700 1 -- 172.21.15.115:0/2751367925 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8011590 con 0x7f40e814ae00 2023-07-27T14:39:48.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40dd7fa700 1 -- 172.21.15.115:0/2751367925 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d80116f0 con 0x7f40e814ae00 2023-07-27T14:39:48.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e80c4b70 con 0x7f40e814ae00 2023-07-27T14:39:48.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40dd7fa700 1 -- 172.21.15.115:0/2751367925 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8011a70 con 0x7f40e814ae00 2023-07-27T14:39:48.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.107+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e80c5130 con 0x7f40e814ae00 2023-07-27T14:39:48.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.108+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e806c470 con 0x7f40e814ae00 2023-07-27T14:39:48.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.109+0000 7f40dd7fa700 1 -- 172.21.15.115:0/2751367925 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f40d801c460 con 0x7f40e814ae00 2023-07-27T14:39:48.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.110+0000 7f40dd7fa700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40cc05fcc0 0x7f40cc062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:48.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.110+0000 7f40dd7fa700 1 -- 172.21.15.115:0/2751367925 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6658+0+0 (secure 0 0 0) 0x7f40d807b3f0 con 0x7f40e814ae00 2023-07-27T14:39:48.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.110+0000 7f40ed59b700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40cc05fcc0 0x7f40cc062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:48.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.111+0000 7f40ed59b700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40cc05fcc0 0x7f40cc062180 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f40e8155580 tx=0x7f40e4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:48.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.114+0000 7f40dd7fa700 1 -- 172.21.15.115:0/2751367925 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40d804b6d0 con 0x7f40e814ae00 2023-07-27T14:39:48.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.324+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f40e8165270 con 0x7f40e814ae00 2023-07-27T14:39:48.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.879+0000 7f40dd7fa700 1 -- 172.21.15.115:0/2751367925 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v106) v1 ==== 104+0+0 (secure 0 0 0) 0x7f40d804ecf0 con 0x7f40e814ae00 2023-07-27T14:39:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.881+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40cc05fcc0 msgr2=0x7f40cc062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.881+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40cc05fcc0 0x7f40cc062180 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f40e8155580 tx=0x7f40e4017000).stop 2023-07-27T14:39:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.881+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 msgr2=0x7f40e80c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:48.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.881+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e80c4220 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f40d8006980 tx=0x7f40d8008040).stop 2023-07-27T14:39:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.882+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 shutdown_connections 2023-07-27T14:39:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.882+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f40cc05fcc0 0x7f40cc062180 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.882+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40e814b1e0 0x7f40e8164910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.882+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40e80c5c50 0x7f40e814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.882+0000 7f40ef7ff700 1 --2- 172.21.15.115:0/2751367925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40e814ae00 0x7f40e80c4220 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.882+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 >> 172.21.15.115:0/2751367925 conn(0x7f40e805e940 msgr2=0x7f40e8152330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.882+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 shutdown_connections 2023-07-27T14:39:48.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:48.882+0000 7f40ef7ff700 1 -- 172.21.15.115:0/2751367925 wait complete. 2023-07-27T14:39:48.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:39:49.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.134+0000 7fec157ff700 1 Processor -- start 2023-07-27T14:39:49.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.134+0000 7fec157ff700 1 -- start start 2023-07-27T14:39:49.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.135+0000 7fec157ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fec100c36b0 0x7fec10065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:49.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.135+0000 7fec157ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec100bd9a0 con 0x7fec1013a350 2023-07-27T14:39:49.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.135+0000 7fec157ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec10066610 con 0x7fec1013a730 2023-07-27T14:39:49.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.135+0000 7fec157ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec10066400 con 0x7fec100c36b0 2023-07-27T14:39:49.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fec1013a350 0x7fec100c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47278/0 (socket says 172.21.15.115:47278) 2023-07-27T14:39:49.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0effd700 1 -- 172.21.15.115:0/1287097421 learned_addr learned my addr 172.21.15.115:0/1287097421 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0f7fe700 1 --2- 172.21.15.115:0/1287097421 >> v2:172.21.15.159:3300/0 conn(0x7fec100c36b0 0x7fec10065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944997135 0 0) 0x7fec100bd9a0 con 0x7fec1013a350 2023-07-27T14:39:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf80033f0 con 0x7fec1013a350 2023-07-27T14:39:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155930064 0 0) 0x7fec10066610 con 0x7fec1013a730 2023-07-27T14:39:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec100bd9a0 con 0x7fec1013a730 2023-07-27T14:39:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4025848500 0 0) 0x7febf80033f0 con 0x7fec1013a350 2023-07-27T14:39:49.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 >> v2:172.21.15.159:3300/0 conn(0x7fec100c36b0 msgr2=0x7fec10065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:49.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 --2- 172.21.15.115:0/1287097421 >> v2:172.21.15.159:3300/0 conn(0x7fec100c36b0 0x7fec10065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 >> v1:172.21.15.159:6789/0 conn(0x7fec1013a730 legacy=0x7fec100be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:49.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100bdc10 con 0x7fec1013a350 2023-07-27T14:39:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fec00001470 con 0x7fec1013a350 2023-07-27T14:39:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.136+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 >> v1:172.21.15.115:6789/0 conn(0x7fec1013a350 legacy=0x7fec100c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0dffb700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febf8003a70 0x7febf8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0dffb700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7febf8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0dffb700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf8005000 0x7febf800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:49.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec10066400 con 0x7febf8004690 2023-07-27T14:39:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf800bf60 con 0x7febf8005000 2023-07-27T14:39:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf800c0d0 con 0x7febf8003a70 2023-07-27T14:39:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0f7fe700 1 --2- 172.21.15.115:0/1287097421 >> v2:172.21.15.159:3300/0 conn(0x7fec100c36b0 0x7fec10065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0e7fc700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7febf8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0effd700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febf8003a70 0x7febf8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:49.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0f7fe700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf8005000 0x7febf800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0e7fc700 1 -- 172.21.15.115:0/1287097421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febf8003a70 msgr2=0x7febf8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0e7fc700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febf8003a70 0x7febf8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0e7fc700 1 -- 172.21.15.115:0/1287097421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf8005000 msgr2=0x7febf800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0e7fc700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febf8005000 0x7febf800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0e7fc700 1 -- 172.21.15.115:0/1287097421 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80033f0 con 0x7febf8004690 2023-07-27T14:39:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0f7fe700 1 -- 172.21.15.115:0/1287097421 reap_dead start 2023-07-27T14:39:49.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.137+0000 7fec0e7fc700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7febf8004b10 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7fec04001890 tx=0x7fec04007bb0).ready entity=mon.0 client_cookie=41db786ed812a597 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:49.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04007020 con 0x7febf8004690 2023-07-27T14:39:49.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec04007180 con 0x7febf8004690 2023-07-27T14:39:49.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec0dffb700 1 -- 172.21.15.115:0/1287097421 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04007500 con 0x7febf8004690 2023-07-27T14:39:49.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec157ff700 1 -- 172.21.15.115:0/1287097421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 msgr2=0x7febf8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:49.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec157ff700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7febf8004b10 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7fec04001890 tx=0x7fec04007bb0).stop 2023-07-27T14:39:49.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec157ff700 1 -- 172.21.15.115:0/1287097421 shutdown_connections 2023-07-27T14:39:49.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec157ff700 1 --2- 172.21.15.115:0/1287097421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7febf8004b10 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec157ff700 1 -- 172.21.15.115:0/1287097421 >> 172.21.15.115:0/1287097421 conn(0x7fec1005e8f0 msgr2=0x7fec100c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:49.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec157ff700 1 -- 172.21.15.115:0/1287097421 shutdown_connections 2023-07-27T14:39:49.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.138+0000 7fec157ff700 1 -- 172.21.15.115:0/1287097421 wait complete. 2023-07-27T14:39:49.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.140+0000 7fec157ff700 1 Processor -- start 2023-07-27T14:39:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.140+0000 7fec157ff700 1 -- start start 2023-07-27T14:39:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec157ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7fec10163ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec157ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec100c1400 0x7fec10138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec157ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec100a8230 0x7fec100a8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec157ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100bfb70 con 0x7febf8004690 2023-07-27T14:39:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec157ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec101644c0 con 0x7fec100c1400 2023-07-27T14:39:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec157ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec101647a0 con 0x7fec100a8230 2023-07-27T14:39:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7fec10163ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7fec10163ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50908/0 (socket says 172.21.15.115:50908) 2023-07-27T14:39:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0effd700 1 -- 172.21.15.115:0/385350444 learned_addr learned my addr 172.21.15.115:0/385350444 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0f7fe700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec100a8230 0x7fec100a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:49.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0effd700 1 -- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec100a8230 msgr2=0x7fec100a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:49.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0effd700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec100a8230 0x7fec100a8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0effd700 1 -- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec100c1400 msgr2=0x7fec10138cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:49.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0e7fc700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec100c1400 0x7fec10138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:49.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0effd700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec100c1400 0x7fec10138cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0effd700 1 -- 172.21.15.115:0/385350444 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10164a80 con 0x7febf8004690 2023-07-27T14:39:49.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.141+0000 7fec0e7fc700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec100c1400 0x7fec10138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:49.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.142+0000 7fec0effd700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7fec10163ee0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7fec00001ed0 tx=0x7fec00001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:49.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.142+0000 7febf6ffd700 1 -- 172.21.15.115:0/385350444 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011590 con 0x7febf8004690 2023-07-27T14:39:49.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.142+0000 7febf6ffd700 1 -- 172.21.15.115:0/385350444 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec000116f0 con 0x7febf8004690 2023-07-27T14:39:49.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.142+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec10164d60 con 0x7febf8004690 2023-07-27T14:39:49.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.142+0000 7febf6ffd700 1 -- 172.21.15.115:0/385350444 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011a90 con 0x7febf8004690 2023-07-27T14:39:49.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.142+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec100c1860 con 0x7febf8004690 2023-07-27T14:39:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.143+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec100c1a80 con 0x7febf8004690 2023-07-27T14:39:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.144+0000 7febf6ffd700 1 -- 172.21.15.115:0/385350444 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fec0001b030 con 0x7febf8004690 2023-07-27T14:39:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.145+0000 7febf6ffd700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7febfc05fcc0 0x7febfc062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.145+0000 7febf6ffd700 1 -- 172.21.15.115:0/385350444 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6658+0+0 (secure 0 0 0) 0x7fec0007ad20 con 0x7febf8004690 2023-07-27T14:39:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.145+0000 7fec0e7fc700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7febfc05fcc0 0x7febfc062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:49.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.146+0000 7fec0e7fc700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7febfc05fcc0 0x7febfc062180 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fec04000c00 tx=0x7fec04015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:49.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.149+0000 7febf6ffd700 1 -- 172.21.15.115:0/385350444 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec0004b170 con 0x7febf8004690 2023-07-27T14:39:49.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.317+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec1006c470 con 0x7febf8004690 2023-07-27T14:39:49.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.887+0000 7febf6ffd700 1 -- 172.21.15.115:0/385350444 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v194) v1 ==== 181+0+0 (secure 0 0 0) 0x7fec00019020 con 0x7febf8004690 2023-07-27T14:39:49.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7febfc05fcc0 msgr2=0x7febfc062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:49.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7febfc05fcc0 0x7febfc062180 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fec04000c00 tx=0x7fec04015000).stop 2023-07-27T14:39:49.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 msgr2=0x7fec10163ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:49.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7fec10163ee0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7fec00001ed0 tx=0x7fec00001df0).stop 2023-07-27T14:39:49.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 shutdown_connections 2023-07-27T14:39:49.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7febfc05fcc0 0x7febfc062180 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec100a8230 0x7fec100a8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febf8004690 0x7fec10163ee0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 --2- 172.21.15.115:0/385350444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec100c1400 0x7fec10138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:49.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 >> 172.21.15.115:0/385350444 conn(0x7fec1005e8f0 msgr2=0x7fec100633b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:49.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 shutdown_connections 2023-07-27T14:39:49.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:49.891+0000 7fec157ff700 1 -- 172.21.15.115:0/385350444 wait complete. 2023-07-27T14:39:49.948 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:39:49.967 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:39:50.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.104+0000 7fc9b65ff700 1 Processor -- start 2023-07-27T14:39:50.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.104+0000 7fc9b65ff700 1 -- start start 2023-07-27T14:39:50.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.106+0000 7fc9b65ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b01553f0 0x7fc9b0062b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:50.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.106+0000 7fc9b65ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b0154f60 con 0x7fc9b00cb210 2023-07-27T14:39:50.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.106+0000 7fc9b65ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b00cb780 con 0x7fc9b0151d20 2023-07-27T14:39:50.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.106+0000 7fc9b65ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00cba60 con 0x7fc9b01553f0 2023-07-27T14:39:50.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.106+0000 7fc9b4b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc9b00cb210 0x7fc9b015dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47294/0 (socket says 172.21.15.115:47294) 2023-07-27T14:39:50.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.106+0000 7fc9b4b9c700 1 -- 172.21.15.115:0/3587063252 learned_addr learned my addr 172.21.15.115:0/3587063252 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:50.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.106+0000 7fc9af7fe700 1 --2- 172.21.15.115:0/3587063252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b01553f0 0x7fc9b0062b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:50.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9aeffd700 1 -- 172.21.15.115:0/3587063252 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065301221 0 0) 0x7fc9b0154f60 con 0x7fc9b00cb210 2023-07-27T14:39:50.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9aeffd700 1 -- 172.21.15.115:0/3587063252 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9980033f0 con 0x7fc9b00cb210 2023-07-27T14:39:50.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9aeffd700 1 -- 172.21.15.115:0/3587063252 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052665813 0 0) 0x7fc9b00cb780 con 0x7fc9b0151d20 2023-07-27T14:39:50.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9aeffd700 1 -- 172.21.15.115:0/3587063252 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9b0154f60 con 0x7fc9b0151d20 2023-07-27T14:39:50.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9af7fe700 1 -- 172.21.15.115:0/3587063252 >> v1:172.21.15.159:6789/0 conn(0x7fc9b0151d20 legacy=0x7fc9b00c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:50.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9af7fe700 1 -- 172.21.15.115:0/3587063252 >> v1:172.21.15.115:6789/0 conn(0x7fc9b00cb210 legacy=0x7fc9b015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:50.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9aeffd700 1 -- 172.21.15.115:0/3587063252 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1235887297 0 0) 0x7fc9980033f0 con 0x7fc9b00cb210 2023-07-27T14:39:50.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9af7fe700 1 -- 172.21.15.115:0/3587063252 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0154910 con 0x7fc9b01553f0 2023-07-27T14:39:50.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9af7fe700 1 --2- 172.21.15.115:0/3587063252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b01553f0 0x7fc9b0062b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fc9a4009790 tx=0x7fc9a4009060).ready entity=mon.2 client_cookie=ee0793542e985893 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:50.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9aeffd700 1 -- 172.21.15.115:0/3587063252 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80017f0 con 0x7fc9b01553f0 2023-07-27T14:39:50.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9aeffd700 1 -- 172.21.15.115:0/3587063252 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4011400 con 0x7fc9b01553f0 2023-07-27T14:39:50.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.107+0000 7fc9aeffd700 1 -- 172.21.15.115:0/3587063252 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4011780 con 0x7fc9b01553f0 2023-07-27T14:39:50.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.108+0000 7fc9b65ff700 1 -- 172.21.15.115:0/3587063252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b01553f0 msgr2=0x7fc9b0062b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:50.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.108+0000 7fc9b65ff700 1 --2- 172.21.15.115:0/3587063252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b01553f0 0x7fc9b0062b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fc9a4009790 tx=0x7fc9a4009060).stop 2023-07-27T14:39:50.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.108+0000 7fc9b65ff700 1 -- 172.21.15.115:0/3587063252 shutdown_connections 2023-07-27T14:39:50.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.108+0000 7fc9b65ff700 1 --2- 172.21.15.115:0/3587063252 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b01553f0 0x7fc9b0062b10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:50.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.108+0000 7fc9b65ff700 1 -- 172.21.15.115:0/3587063252 >> 172.21.15.115:0/3587063252 conn(0x7fc9b005e940 msgr2=0x7fc9b00cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:50.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.108+0000 7fc9b65ff700 1 -- 172.21.15.115:0/3587063252 shutdown_connections 2023-07-27T14:39:50.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.108+0000 7fc9b65ff700 1 -- 172.21.15.115:0/3587063252 wait complete. 2023-07-27T14:39:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.109+0000 7fc9b65ff700 1 Processor -- start 2023-07-27T14:39:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.110+0000 7fc9b65ff700 1 -- start start 2023-07-27T14:39:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.110+0000 7fc9b65ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b00cb210 0x7fc9b00af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.110+0000 7fc9b65ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9b0151d20 0x7fc9b014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.110+0000 7fc9b65ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b01553f0 0x7fc9b00adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9b65ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00ae2e0 con 0x7fc9b0151d20 2023-07-27T14:39:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9b65ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00ae5c0 con 0x7fc9b01553f0 2023-07-27T14:39:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9b65ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00ae8a0 con 0x7fc9b00cb210 2023-07-27T14:39:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9b0151d20 0x7fc9b014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9b0151d20 0x7fc9b014a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50924/0 (socket says 172.21.15.115:50924) 2023-07-27T14:39:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 -- 172.21.15.115:0/368805654 learned_addr learned my addr 172.21.15.115:0/368805654 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9affff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b00cb210 0x7fc9b00af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9b4b9c700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b01553f0 0x7fc9b00adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 -- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b00cb210 msgr2=0x7fc9b00af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b00cb210 0x7fc9b00af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 -- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b01553f0 msgr2=0x7fc9b00adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b01553f0 0x7fc9b00adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 -- 172.21.15.115:0/368805654 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40092a0 con 0x7fc9b0151d20 2023-07-27T14:39:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9b4b9c700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b01553f0 0x7fc9b00adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.111+0000 7fc9af7fe700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9b0151d20 0x7fc9b014a6e0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7fc9b006c0c0 tx=0x7fc9a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.112+0000 7fc997fff700 1 -- 172.21.15.115:0/368805654 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4010920 con 0x7fc9b0151d20 2023-07-27T14:39:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.112+0000 7fc997fff700 1 -- 172.21.15.115:0/368805654 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4010a80 con 0x7fc9b0151d20 2023-07-27T14:39:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.112+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b00aeb80 con 0x7fc9b0151d20 2023-07-27T14:39:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.112+0000 7fc997fff700 1 -- 172.21.15.115:0/368805654 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4010e20 con 0x7fc9b0151d20 2023-07-27T14:39:50.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.112+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b014abd0 con 0x7fc9b0151d20 2023-07-27T14:39:50.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.113+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b00af0a0 con 0x7fc9b0151d20 2023-07-27T14:39:50.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.114+0000 7fc997fff700 1 -- 172.21.15.115:0/368805654 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fc9a4023020 con 0x7fc9b0151d20 2023-07-27T14:39:50.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.114+0000 7fc997fff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc99c05fcc0 0x7fc99c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:50.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.114+0000 7fc997fff700 1 -- 172.21.15.115:0/368805654 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6220+0+0 (secure 0 0 0) 0x7fc9a407cc70 con 0x7fc9b0151d20 2023-07-27T14:39:50.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.115+0000 7fc9affff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc99c05fcc0 0x7fc99c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:50.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.115+0000 7fc9affff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc99c05fcc0 0x7fc99c062180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fc9a0003700 tx=0x7fc9a0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:50.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.119+0000 7fc997fff700 1 -- 172.21.15.115:0/368805654 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc9b00af0a0 con 0x7fc9b0151d20 2023-07-27T14:39:50.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.297+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc9b00af0a0 con 0x7fc9b0151d20 2023-07-27T14:39:50.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.892+0000 7fc997fff700 1 -- 172.21.15.115:0/368805654 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v195) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc9b00af0a0 con 0x7fc9b0151d20 2023-07-27T14:39:50.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc99c05fcc0 msgr2=0x7fc99c062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:50.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc99c05fcc0 0x7fc99c062180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fc9a0003700 tx=0x7fc9a0009040).stop 2023-07-27T14:39:50.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9b0151d20 msgr2=0x7fc9b014a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:50.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9b0151d20 0x7fc9b014a6e0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7fc9b006c0c0 tx=0x7fc9a4016000).stop 2023-07-27T14:39:50.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 shutdown_connections 2023-07-27T14:39:50.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc99c05fcc0 0x7fc99c062180 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:50.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b01553f0 0x7fc9b00adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:50.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9b00cb210 0x7fc9b00af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:50.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.894+0000 7fc9b65ff700 1 --2- 172.21.15.115:0/368805654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9b0151d20 0x7fc9b014a6e0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:50.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.895+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 >> 172.21.15.115:0/368805654 conn(0x7fc9b005e940 msgr2=0x7fc9b01561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:50.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.895+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 shutdown_connections 2023-07-27T14:39:50.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:50.895+0000 7fc9b65ff700 1 -- 172.21.15.115:0/368805654 wait complete. 2023-07-27T14:39:50.952 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:39:50.971 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm new_pool new_pool --yes-i-really-really-mean-it 2023-07-27T14:39:51.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.109+0000 7fa37efff700 1 Processor -- start 2023-07-27T14:39:51.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.109+0000 7fa37efff700 1 -- start start 2023-07-27T14:39:51.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.110+0000 7fa37efff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa37813a350 0x7fa378065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.110+0000 7fa37efff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3780bd9a0 con 0x7fa37813a730 2023-07-27T14:39:51.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.110+0000 7fa37efff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa378066610 con 0x7fa3780c36b0 2023-07-27T14:39:51.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.110+0000 7fa37efff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa378066400 con 0x7fa37813a350 2023-07-27T14:39:51.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa377fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa37813a730 0x7fa3780c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47298/0 (socket says 172.21.15.115:47298) 2023-07-27T14:39:51.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa377fff700 1 -- 172.21.15.115:0/685479629 learned_addr learned my addr 172.21.15.115:0/685479629 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:51.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa37cd9b700 1 --2- 172.21.15.115:0/685479629 >> v2:172.21.15.159:3300/0 conn(0x7fa37813a350 0x7fa378065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183384915 0 0) 0x7fa3780bd9a0 con 0x7fa37813a730 2023-07-27T14:39:51.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3680033f0 con 0x7fa37813a730 2023-07-27T14:39:51.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 430610668 0 0) 0x7fa3680033f0 con 0x7fa37813a730 2023-07-27T14:39:51.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 >> v2:172.21.15.159:3300/0 conn(0x7fa37813a350 msgr2=0x7fa378065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:51.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 --2- 172.21.15.115:0/685479629 >> v2:172.21.15.159:3300/0 conn(0x7fa37813a350 0x7fa378065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 >> v1:172.21.15.159:6789/0 conn(0x7fa3780c36b0 legacy=0x7fa3780be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3780bdc10 con 0x7fa37813a730 2023-07-27T14:39:51.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fa364001470 con 0x7fa37813a730 2023-07-27T14:39:51.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 >> v1:172.21.15.115:6789/0 conn(0x7fa37813a730 legacy=0x7fa3780c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3680038e0 0x7fa368003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368004690 0x7fa368004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa368005000 0x7fa36800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.111+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa378066400 con 0x7fa368005000 2023-07-27T14:39:51.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36800bf60 con 0x7fa3680038e0 2023-07-27T14:39:51.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36800c0f0 con 0x7fa368004690 2023-07-27T14:39:51.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa377fff700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368004690 0x7fa368004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37d59c700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa368005000 0x7fa36800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37cd9b700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3680038e0 0x7fa368003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37d59c700 1 -- 172.21.15.115:0/685479629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368004690 msgr2=0x7fa368004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:51.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37d59c700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368004690 0x7fa368004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37d59c700 1 -- 172.21.15.115:0/685479629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3680038e0 msgr2=0x7fa368003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:51.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37d59c700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3680038e0 0x7fa368003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37d59c700 1 -- 172.21.15.115:0/685479629 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3680033f0 con 0x7fa368005000 2023-07-27T14:39:51.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37d59c700 1 -- 172.21.15.115:0/685479629 reap_dead start 2023-07-27T14:39:51.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.112+0000 7fa37d59c700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa368005000 0x7fa36800b8e0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7fa378065cd0 tx=0x7fa370007f30).ready entity=mon.0 client_cookie=447fbc262a3521d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:51.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370006a20 con 0x7fa368005000 2023-07-27T14:39:51.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa370006b80 con 0x7fa368005000 2023-07-27T14:39:51.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa3777fe700 1 -- 172.21.15.115:0/685479629 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000c5d0 con 0x7fa368005000 2023-07-27T14:39:51.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa37efff700 1 -- 172.21.15.115:0/685479629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa368005000 msgr2=0x7fa36800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa37efff700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa368005000 0x7fa36800b8e0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7fa378065cd0 tx=0x7fa370007f30).stop 2023-07-27T14:39:51.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa37efff700 1 -- 172.21.15.115:0/685479629 shutdown_connections 2023-07-27T14:39:51.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa37efff700 1 --2- 172.21.15.115:0/685479629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa368005000 0x7fa36800b8e0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa37efff700 1 -- 172.21.15.115:0/685479629 >> 172.21.15.115:0/685479629 conn(0x7fa37805e8f0 msgr2=0x7fa3780c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:51.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa37efff700 1 -- 172.21.15.115:0/685479629 shutdown_connections 2023-07-27T14:39:51.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.113+0000 7fa37efff700 1 -- 172.21.15.115:0/685479629 wait complete. 2023-07-27T14:39:51.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.115+0000 7fa37efff700 1 Processor -- start 2023-07-27T14:39:51.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.115+0000 7fa37efff700 1 -- start start 2023-07-27T14:39:51.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368005000 0x7fa3781656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37efff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa378165050 0x7fa3780bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37efff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3780bff30 0x7fa378166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37efff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa378157790 con 0x7fa3780bff30 2023-07-27T14:39:51.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37efff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780a9ad0 con 0x7fa378165050 2023-07-27T14:39:51.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780a9200 con 0x7fa368005000 2023-07-27T14:39:51.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37d59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3780bff30 0x7fa378166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37d59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3780bff30 0x7fa378166cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50954/0 (socket says 172.21.15.115:50954) 2023-07-27T14:39:51.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37d59c700 1 -- 172.21.15.115:0/371668265 learned_addr learned my addr 172.21.15.115:0/371668265 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:51.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37cd9b700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368005000 0x7fa3781656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa377fff700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa378165050 0x7fa3780bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37d59c700 1 -- 172.21.15.115:0/371668265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368005000 msgr2=0x7fa3781656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37d59c700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368005000 0x7fa3781656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37d59c700 1 -- 172.21.15.115:0/371668265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa378165050 msgr2=0x7fa3780bfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37d59c700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa378165050 0x7fa3780bfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.116+0000 7fa37d59c700 1 -- 172.21.15.115:0/371668265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3781654b0 con 0x7fa3780bff30 2023-07-27T14:39:51.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.117+0000 7fa37d59c700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3780bff30 0x7fa378166cd0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7fa370001390 tx=0x7fa370015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:51.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.117+0000 7fa374ff9700 1 -- 172.21.15.115:0/371668265 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000c5d0 con 0x7fa3780bff30 2023-07-27T14:39:51.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.117+0000 7fa374ff9700 1 -- 172.21.15.115:0/371668265 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa370013d00 con 0x7fa3780bff30 2023-07-27T14:39:51.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.117+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3780c0390 con 0x7fa3780bff30 2023-07-27T14:39:51.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.117+0000 7fa374ff9700 1 -- 172.21.15.115:0/371668265 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370006a20 con 0x7fa3780bff30 2023-07-27T14:39:51.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.117+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3780a9410 con 0x7fa3780bff30 2023-07-27T14:39:51.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.118+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3780a9c10 con 0x7fa3780bff30 2023-07-27T14:39:51.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.119+0000 7fa374ff9700 1 -- 172.21.15.115:0/371668265 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fa370027070 con 0x7fa3780bff30 2023-07-27T14:39:51.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.120+0000 7fa374ff9700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa35c05fcf0 0x7fa35c0621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.120+0000 7fa374ff9700 1 -- 172.21.15.115:0/371668265 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5806+0+0 (secure 0 0 0) 0x7fa37007bff0 con 0x7fa3780bff30 2023-07-27T14:39:51.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.121+0000 7fa37cd9b700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa35c05fcf0 0x7fa35c0621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.121+0000 7fa37cd9b700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa35c05fcf0 0x7fa35c0621b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fa378064a70 tx=0x7fa36c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:51.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.124+0000 7fa374ff9700 1 -- 172.21.15.115:0/371668265 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3780a9c10 con 0x7fa3780bff30 2023-07-27T14:39:51.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.301+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "new_pool", "pool2": "new_pool", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3780a9c10 con 0x7fa3780bff30 2023-07-27T14:39:51.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.713+0000 7fa374ff9700 1 -- 172.21.15.115:0/371668265 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "new_pool", "pool2": "new_pool", "yes_i_really_really_mean_it": true}]=0 pool 'new_pool' removed v196) v1 ==== 160+0+0 (secure 0 0 0) 0x7fa3780a9c10 con 0x7fa3780bff30 2023-07-27T14:39:51.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa35c05fcf0 msgr2=0x7fa35c0621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa35c05fcf0 0x7fa35c0621b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fa378064a70 tx=0x7fa36c008040).stop 2023-07-27T14:39:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3780bff30 msgr2=0x7fa378166cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3780bff30 0x7fa378166cd0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7fa370001390 tx=0x7fa370015000).stop 2023-07-27T14:39:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 shutdown_connections 2023-07-27T14:39:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa35c05fcf0 0x7fa35c0621b0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3780bff30 0x7fa378166cd0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa368005000 0x7fa3781656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 --2- 172.21.15.115:0/371668265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa378165050 0x7fa3780bfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 >> 172.21.15.115:0/371668265 conn(0x7fa37805e8f0 msgr2=0x7fa378064fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:51.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 shutdown_connections 2023-07-27T14:39:51.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.717+0000 7fa37efff700 1 -- 172.21.15.115:0/371668265 wait complete. 2023-07-27T14:39:51.774 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'new_pool' removed 2023-07-27T14:39:51.794 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:39:51.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.933+0000 7f37327ff700 1 Processor -- start 2023-07-27T14:39:51.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.933+0000 7f37327ff700 1 -- start start 2023-07-27T14:39:51.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f37327ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c0c6b70 0x7f372c0656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f37327ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372c066050 con 0x7f372c065bc0 2023-07-27T14:39:51.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f37327ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372c064a80 con 0x7f372c153e00 2023-07-27T14:39:51.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f37327ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c062320 con 0x7f372c0c6b70 2023-07-27T14:39:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f3730d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f372c065bc0 0x7f372c062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47308/0 (socket says 172.21.15.115:47308) 2023-07-27T14:39:51.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f3730d9c700 1 -- 172.21.15.115:0/1067405562 learned_addr learned my addr 172.21.15.115:0/1067405562 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f372b7fe700 1 --2- 172.21.15.115:0/1067405562 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c0c6b70 0x7f372c0656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f372affd700 1 -- 172.21.15.115:0/1067405562 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968181210 0 0) 0x7f372c066050 con 0x7f372c065bc0 2023-07-27T14:39:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f372affd700 1 -- 172.21.15.115:0/1067405562 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37140033f0 con 0x7f372c065bc0 2023-07-27T14:39:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.935+0000 7f372affd700 1 -- 172.21.15.115:0/1067405562 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390017066 0 0) 0x7f372c064a80 con 0x7f372c153e00 2023-07-27T14:39:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372affd700 1 -- 172.21.15.115:0/1067405562 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f372c066050 con 0x7f372c153e00 2023-07-27T14:39:51.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372b7fe700 1 -- 172.21.15.115:0/1067405562 >> v1:172.21.15.159:6789/0 conn(0x7f372c153e00 legacy=0x7f372c064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372b7fe700 1 -- 172.21.15.115:0/1067405562 >> v1:172.21.15.115:6789/0 conn(0x7f372c065bc0 legacy=0x7f372c062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372affd700 1 -- 172.21.15.115:0/1067405562 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2023623982 0 0) 0x7f37140033f0 con 0x7f372c065bc0 2023-07-27T14:39:51.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372b7fe700 1 -- 172.21.15.115:0/1067405562 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c064d60 con 0x7f372c0c6b70 2023-07-27T14:39:51.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372b7fe700 1 --2- 172.21.15.115:0/1067405562 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c0c6b70 0x7f372c0656d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f3720009790 tx=0x7f3720009060).ready entity=mon.2 client_cookie=5304877550a1a438 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:51.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372affd700 1 -- 172.21.15.115:0/1067405562 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240017f0 con 0x7f372c0c6b70 2023-07-27T14:39:51.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372affd700 1 -- 172.21.15.115:0/1067405562 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3720011400 con 0x7f372c0c6b70 2023-07-27T14:39:51.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.936+0000 7f372affd700 1 -- 172.21.15.115:0/1067405562 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720011780 con 0x7f372c0c6b70 2023-07-27T14:39:51.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.937+0000 7f37327ff700 1 -- 172.21.15.115:0/1067405562 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c0c6b70 msgr2=0x7f372c0656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.937+0000 7f37327ff700 1 --2- 172.21.15.115:0/1067405562 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c0c6b70 0x7f372c0656d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f3720009790 tx=0x7f3720009060).stop 2023-07-27T14:39:51.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.937+0000 7f37327ff700 1 -- 172.21.15.115:0/1067405562 shutdown_connections 2023-07-27T14:39:51.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.937+0000 7f37327ff700 1 --2- 172.21.15.115:0/1067405562 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c0c6b70 0x7f372c0656d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.937+0000 7f37327ff700 1 -- 172.21.15.115:0/1067405562 >> 172.21.15.115:0/1067405562 conn(0x7f372c0c7b90 msgr2=0x7f372c0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:51.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.937+0000 7f37327ff700 1 -- 172.21.15.115:0/1067405562 shutdown_connections 2023-07-27T14:39:51.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.937+0000 7f37327ff700 1 -- 172.21.15.115:0/1067405562 wait complete. 2023-07-27T14:39:51.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.938+0000 7f37327ff700 1 Processor -- start 2023-07-27T14:39:51.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.938+0000 7f37327ff700 1 -- start start 2023-07-27T14:39:51.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.939+0000 7f37327ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c065bc0 0x7f372c142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.939+0000 7f37327ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0c6b70 0x7f372c0bd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.939+0000 7f37327ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f372c153e00 0x7f372c0aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:51.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.939+0000 7f37327ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0abaf0 con 0x7f372c153e00 2023-07-27T14:39:51.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.939+0000 7f37327ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0acf20 con 0x7f372c0c6b70 2023-07-27T14:39:51.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.939+0000 7f37327ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0ac310 con 0x7f372c065bc0 2023-07-27T14:39:51.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f372b7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0c6b70 0x7f372c0bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f372bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c065bc0 0x7f372c142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f372b7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0c6b70 0x7f372c0bd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:58610/0 (socket says 172.21.15.115:58610) 2023-07-27T14:39:51.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f372b7fe700 1 -- 172.21.15.115:0/3790118221 learned_addr learned my addr 172.21.15.115:0/3790118221 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:51.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f3730d9c700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f372c153e00 0x7f372c0aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:51.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f3730d9c700 1 -- 172.21.15.115:0/3790118221 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c065bc0 msgr2=0x7f372c142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f3730d9c700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c065bc0 0x7f372c142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f3730d9c700 1 -- 172.21.15.115:0/3790118221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0c6b70 msgr2=0x7f372c0bd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:51.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f3730d9c700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0c6b70 0x7f372c0bd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:51.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.940+0000 7f3730d9c700 1 -- 172.21.15.115:0/3790118221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200092a0 con 0x7f372c153e00 2023-07-27T14:39:51.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.941+0000 7f3730d9c700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f372c153e00 0x7f372c0aa0c0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f372400cb60 tx=0x7f3724007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:52.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.941+0000 7f3713fff700 1 -- 172.21.15.115:0/3790118221 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372400ce70 con 0x7f372c153e00 2023-07-27T14:39:52.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.941+0000 7f3713fff700 1 -- 172.21.15.115:0/3790118221 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3724004c40 con 0x7f372c153e00 2023-07-27T14:39:52.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.941+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c0ac5f0 con 0x7f372c153e00 2023-07-27T14:39:52.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.941+0000 7f3713fff700 1 -- 172.21.15.115:0/3790118221 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724007170 con 0x7f372c153e00 2023-07-27T14:39:52.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.941+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c0acbb0 con 0x7f372c153e00 2023-07-27T14:39:52.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.942+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c0ac0c0 con 0x7f372c153e00 2023-07-27T14:39:52.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.943+0000 7f3713fff700 1 -- 172.21.15.115:0/3790118221 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f372401b060 con 0x7f372c153e00 2023-07-27T14:39:52.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.945+0000 7f3713fff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f371805fcc0 0x7f3718062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:52.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.945+0000 7f3713fff700 1 -- 172.21.15.115:0/3790118221 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f372407adb0 con 0x7f372c153e00 2023-07-27T14:39:52.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.945+0000 7f372bfff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f371805fcc0 0x7f3718062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:52.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.946+0000 7f372bfff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f371805fcc0 0x7f3718062180 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f371c007fd0 tx=0x7f371c007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:52.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:51.950+0000 7f3713fff700 1 -- 172.21.15.115:0/3790118221 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f372407f070 con 0x7f372c153e00 2023-07-27T14:39:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.119+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f372c06c470 con 0x7f372c153e00 2023-07-27T14:39:52.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.123+0000 7f3713fff700 1 -- 172.21.15.115:0/3790118221 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37240190a0 con 0x7f372c153e00 2023-07-27T14:39:52.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f371805fcc0 msgr2=0x7f3718062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:52.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f371805fcc0 0x7f3718062180 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f371c007fd0 tx=0x7f371c007bd0).stop 2023-07-27T14:39:52.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f372c153e00 msgr2=0x7f372c0aa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:52.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f372c153e00 0x7f372c0aa0c0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f372400cb60 tx=0x7f3724007af0).stop 2023-07-27T14:39:52.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 shutdown_connections 2023-07-27T14:39:52.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f371805fcc0 0x7f3718062180 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f372c153e00 0x7f372c0aa0c0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f372c065bc0 0x7f372c142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 --2- 172.21.15.115:0/3790118221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f372c0c6b70 0x7f372c0bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.125+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 >> 172.21.15.115:0/3790118221 conn(0x7f372c0c7b90 msgr2=0x7f372c0bc070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:52.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.126+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 shutdown_connections 2023-07-27T14:39:52.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.126+0000 7f37327ff700 1 -- 172.21.15.115:0/3790118221 wait complete. 2023-07-27T14:39:52.198 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_snapshot_namespace_and_size' 2023-07-27T14:39:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.330+0000 7f54bf3ff700 1 Processor -- start 2023-07-27T14:39:52.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.330+0000 7f54bf3ff700 1 -- start start 2023-07-27T14:39:52.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bf3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f54b8153ec0 0x7f54b80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:52.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bf3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54b80aa050 0x7f54b80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:52.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bf3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80aa4d0 con 0x7f54b80aaa40 2023-07-27T14:39:52.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bf3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b80c05c0 con 0x7f54b80aa050 2023-07-27T14:39:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bf3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b80c1a60 con 0x7f54b8153ec0 2023-07-27T14:39:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bc99a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54b80aa050 0x7f54b80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bc99a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54b80aa050 0x7f54b80640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50980/0 (socket says 172.21.15.115:50980) 2023-07-27T14:39:52.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bc99a700 1 -- 172.21.15.115:0/1812450278 learned_addr learned my addr 172.21.15.115:0/1812450278 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:52.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bc99a700 1 -- 172.21.15.115:0/1812450278 >> v2:172.21.15.159:3300/0 conn(0x7f54b8153ec0 msgr2=0x7f54b80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:52.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bc99a700 1 --2- 172.21.15.115:0/1812450278 >> v2:172.21.15.159:3300/0 conn(0x7f54b8153ec0 0x7f54b80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:52.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bc99a700 1 -- 172.21.15.115:0/1812450278 >> v1:172.21.15.159:6789/0 conn(0x7f54b80aaa40 legacy=0x7f54b8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:52.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.332+0000 7f54bc99a700 1 -- 172.21.15.115:0/1812450278 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80bfc90 con 0x7f54b80aa050 2023-07-27T14:39:52.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54bc99a700 1 --2- 172.21.15.115:0/1812450278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80aa050 0x7f54b80640f0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f54b8083e30 tx=0x7f54a80090f0).ready entity=mon.0 client_cookie=1be0082bb2f30a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:52.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54affff700 1 -- 172.21.15.115:0/1812450278 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800b5a0 con 0x7f54b80aa050 2023-07-27T14:39:52.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54affff700 1 -- 172.21.15.115:0/1812450278 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a800b700 con 0x7f54b80aa050 2023-07-27T14:39:52.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54affff700 1 -- 172.21.15.115:0/1812450278 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800ba80 con 0x7f54b80aa050 2023-07-27T14:39:52.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54bf3ff700 1 -- 172.21.15.115:0/1812450278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80aa050 msgr2=0x7f54b80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:52.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/1812450278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80aa050 0x7f54b80640f0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f54b8083e30 tx=0x7f54a80090f0).stop 2023-07-27T14:39:52.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54bf3ff700 1 -- 172.21.15.115:0/1812450278 shutdown_connections 2023-07-27T14:39:52.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/1812450278 >> v2:172.21.15.159:3300/0 conn(0x7f54b8153ec0 0x7f54b80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:39:52.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/1812450278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b80aa050 0x7f54b80640f0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.333+0000 7f54bf3ff700 1 -- 172.21.15.115:0/1812450278 >> 172.21.15.115:0/1812450278 conn(0x7f54b80cb610 msgr2=0x7f54b80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:52.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.334+0000 7f54bf3ff700 1 -- 172.21.15.115:0/1812450278 shutdown_connections 2023-07-27T14:39:52.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.334+0000 7f54bf3ff700 1 -- 172.21.15.115:0/1812450278 wait complete. 2023-07-27T14:39:52.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.335+0000 7f54bf3ff700 1 Processor -- start 2023-07-27T14:39:52.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.335+0000 7f54bf3ff700 1 -- start start 2023-07-27T14:39:52.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bf3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b80aa050 0x7f54b80c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:52.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bf3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54b80aaa40 0x7f54b814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:52.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bf3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b8153ec0 0x7f54b80c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:52.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bf3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80c3fa0 con 0x7f54b8153ec0 2023-07-27T14:39:52.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bf3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b814ed30 con 0x7f54b80aa050 2023-07-27T14:39:52.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bf3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80c3390 con 0x7f54b80aaa40 2023-07-27T14:39:52.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bd99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b8153ec0 0x7f54b80c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:52.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bd99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b8153ec0 0x7f54b80c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50986/0 (socket says 172.21.15.115:50986) 2023-07-27T14:39:52.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bd99c700 1 -- 172.21.15.115:0/3253571359 learned_addr learned my addr 172.21.15.115:0/3253571359 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:52.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.336+0000 7f54bd19b700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b80aa050 0x7f54b80c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:52.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bc99a700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54b80aaa40 0x7f54b814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:52.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bd99c700 1 -- 172.21.15.115:0/3253571359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54b80aaa40 msgr2=0x7f54b814e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:52.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bd99c700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54b80aaa40 0x7f54b814e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bd99c700 1 -- 172.21.15.115:0/3253571359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b80aa050 msgr2=0x7f54b80c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:52.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bd99c700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b80aa050 0x7f54b80c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bd99c700 1 -- 172.21.15.115:0/3253571359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8009370 con 0x7f54b8153ec0 2023-07-27T14:39:52.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bd99c700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b8153ec0 0x7f54b80c4430 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f54b000c810 tx=0x7f54b0002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:52.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54ad7fa700 1 -- 172.21.15.115:0/3253571359 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b000e4a0 con 0x7f54b8153ec0 2023-07-27T14:39:52.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54ad7fa700 1 -- 172.21.15.115:0/3253571359 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b000e620 con 0x7f54b8153ec0 2023-07-27T14:39:52.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b80c3670 con 0x7f54b8153ec0 2023-07-27T14:39:52.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54ad7fa700 1 -- 172.21.15.115:0/3253571359 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b000e9e0 con 0x7f54b8153ec0 2023-07-27T14:39:52.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.337+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b80c3c30 con 0x7f54b8153ec0 2023-07-27T14:39:52.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.338+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b80c4110 con 0x7f54b8153ec0 2023-07-27T14:39:52.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.339+0000 7f54ad7fa700 1 -- 172.21.15.115:0/3253571359 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f54b0019030 con 0x7f54b8153ec0 2023-07-27T14:39:52.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.340+0000 7f54ad7fa700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f549c05fc90 0x7f549c062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:52.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.340+0000 7f54ad7fa700 1 -- 172.21.15.115:0/3253571359 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f54b007a5b0 con 0x7f54b8153ec0 2023-07-27T14:39:52.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.340+0000 7f54bd19b700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f549c05fc90 0x7f549c062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:52.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.341+0000 7f54bd19b700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f549c05fc90 0x7f549c062150 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f54b40099c0 tx=0x7f54b4006f10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:52.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.344+0000 7f54ad7fa700 1 -- 172.21.15.115:0/3253571359 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54b00488f0 con 0x7f54b8153ec0 2023-07-27T14:39:52.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.583+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_snapshot_namespace_and_size"]} v 0) v1 -- 0x7f54b80bff70 con 0x7f54b8153ec0 2023-07-27T14:39:52.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.906+0000 7f54ad7fa700 1 -- 172.21.15.115:0/3253571359 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_inherit_snapshot_namespace_and_size"]}]=0 v655) v1 ==== 189+0+0 (secure 0 0 0) 0x7f54b0017020 con 0x7f54b8153ec0 2023-07-27T14:39:52.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f549c05fc90 msgr2=0x7f549c062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:52.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f549c05fc90 0x7f549c062150 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f54b40099c0 tx=0x7f54b4006f10).stop 2023-07-27T14:39:52.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b8153ec0 msgr2=0x7f54b80c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:52.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b8153ec0 0x7f54b80c4430 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f54b000c810 tx=0x7f54b0002530).stop 2023-07-27T14:39:52.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 shutdown_connections 2023-07-27T14:39:52.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f549c05fc90 0x7f549c062150 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b8153ec0 0x7f54b80c4430 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54b80aa050 0x7f54b80c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 --2- 172.21.15.115:0/3253571359 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54b80aaa40 0x7f54b814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:52.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 >> 172.21.15.115:0/3253571359 conn(0x7f54b80cb610 msgr2=0x7f54b80640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:52.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 shutdown_connections 2023-07-27T14:39:52.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:52.908+0000 7f54bf3ff700 1 -- 172.21.15.115:0/3253571359 wait complete. 2023-07-27T14:39:52.981 INFO:tasks.cephfs_test_runner:test_subvolume_clone_inherit_snapshot_namespace_and_size (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:39:52.982 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_clone_retain_snapshot_with_snapshots (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:39:52.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_retain_snapshot_with_snapshots' 2023-07-27T14:39:53.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.116+0000 7f960bfff700 1 Processor -- start 2023-07-27T14:39:53.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.116+0000 7f960bfff700 1 -- start start 2023-07-27T14:39:53.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.117+0000 7f960bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9604153ec0 0x7f96040a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:53.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.117+0000 7f960bfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040aa4d0 con 0x7f96040aaa40 2023-07-27T14:39:53.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.117+0000 7f960bfff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040c05c0 con 0x7f96040aa050 2023-07-27T14:39:53.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.117+0000 7f960bfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040bfc90 con 0x7f9604153ec0 2023-07-27T14:39:53.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.117+0000 7f9609d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9604153ec0 0x7f96040a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:53.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.117+0000 7f9609d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9604153ec0 0x7f96040a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50992/0 (socket says 172.21.15.115:50992) 2023-07-27T14:39:53.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.117+0000 7f9609d9b700 1 -- 172.21.15.115:0/1466526665 learned_addr learned my addr 172.21.15.115:0/1466526665 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:53.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.117+0000 7f960a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f96040aaa40 0x7f96040c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47316/0 (socket says 172.21.15.115:47316) 2023-07-27T14:39:53.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.118+0000 7f9609d9b700 1 -- 172.21.15.115:0/1466526665 >> v1:172.21.15.159:6789/0 conn(0x7f96040aa050 legacy=0x7f96040640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:53.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.118+0000 7f9609d9b700 1 -- 172.21.15.115:0/1466526665 >> v1:172.21.15.115:6789/0 conn(0x7f96040aaa40 legacy=0x7f96040c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:53.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.118+0000 7f9608d99700 1 -- 172.21.15.115:0/1466526665 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321846733 0 0) 0x7f95fc001490 con 0x7f96040aaa40 2023-07-27T14:39:53.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.118+0000 7f9609d9b700 1 -- 172.21.15.115:0/1466526665 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040bff70 con 0x7f9604153ec0 2023-07-27T14:39:53.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.118+0000 7f9609d9b700 1 --2- 172.21.15.115:0/1466526665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96040a9b60 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f9600006fd0 tx=0x7f96000090f0).ready entity=mon.0 client_cookie=e3b060d2128b2e64 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:53.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.118+0000 7f9608d99700 1 -- 172.21.15.115:0/1466526665 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000b600 con 0x7f9604153ec0 2023-07-27T14:39:53.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.118+0000 7f9608d99700 1 -- 172.21.15.115:0/1466526665 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000b760 con 0x7f9604153ec0 2023-07-27T14:39:53.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.118+0000 7f9608d99700 1 -- 172.21.15.115:0/1466526665 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000bae0 con 0x7f9604153ec0 2023-07-27T14:39:53.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.119+0000 7f960bfff700 1 -- 172.21.15.115:0/1466526665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 msgr2=0x7f96040a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:53.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.119+0000 7f960bfff700 1 --2- 172.21.15.115:0/1466526665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96040a9b60 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f9600006fd0 tx=0x7f96000090f0).stop 2023-07-27T14:39:53.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.119+0000 7f960bfff700 1 -- 172.21.15.115:0/1466526665 shutdown_connections 2023-07-27T14:39:53.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.119+0000 7f960bfff700 1 --2- 172.21.15.115:0/1466526665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96040a9b60 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:53.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.119+0000 7f960bfff700 1 -- 172.21.15.115:0/1466526665 >> 172.21.15.115:0/1466526665 conn(0x7f96040cb610 msgr2=0x7f96040c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:53.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.119+0000 7f960bfff700 1 -- 172.21.15.115:0/1466526665 shutdown_connections 2023-07-27T14:39:53.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.119+0000 7f960bfff700 1 -- 172.21.15.115:0/1466526665 wait complete. 2023-07-27T14:39:53.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.120+0000 7f960bfff700 1 Processor -- start 2023-07-27T14:39:53.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.121+0000 7f960bfff700 1 -- start start 2023-07-27T14:39:53.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.121+0000 7f960bfff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96040aa050 0x7f9604152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:53.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.121+0000 7f960bfff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96040aaa40 0x7f9604150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:53.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.121+0000 7f960bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96041647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:53.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.121+0000 7f960bfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040c37d0 con 0x7f9604153ec0 2023-07-27T14:39:53.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.121+0000 7f960bfff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604153340 con 0x7f96040aaa40 2023-07-27T14:39:53.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.121+0000 7f960bfff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604150a80 con 0x7f96040aa050 2023-07-27T14:39:53.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96041647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:53.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96041647e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51000/0 (socket says 172.21.15.115:51000) 2023-07-27T14:39:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 -- 172.21.15.115:0/4039100485 learned_addr learned my addr 172.21.15.115:0/4039100485 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f9609d9b700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96040aa050 0x7f9604152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960959a700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96040aaa40 0x7f9604150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 -- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96040aa050 msgr2=0x7f9604152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96040aa050 0x7f9604152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 -- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96040aaa40 msgr2=0x7f9604150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96040aaa40 0x7f9604150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:53.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 -- 172.21.15.115:0/4039100485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600009370 con 0x7f9604153ec0 2023-07-27T14:39:53.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f9609d9b700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96040aa050 0x7f9604152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:53.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960959a700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96040aaa40 0x7f9604150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:53.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960a59c700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96041647e0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 rx=0x7f95fc002230 tx=0x7f95fc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:53.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f95f9ffb700 1 -- 172.21.15.115:0/4039100485 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc005c70 con 0x7f9604153ec0 2023-07-27T14:39:53.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f95f9ffb700 1 -- 172.21.15.115:0/4039100485 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc005dd0 con 0x7f9604153ec0 2023-07-27T14:39:53.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9604152580 con 0x7f9604153ec0 2023-07-27T14:39:53.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.122+0000 7f95f9ffb700 1 -- 172.21.15.115:0/4039100485 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc007360 con 0x7f9604153ec0 2023-07-27T14:39:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.123+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96041522a0 con 0x7f9604153ec0 2023-07-27T14:39:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.124+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96040a9e60 con 0x7f9604153ec0 2023-07-27T14:39:53.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.124+0000 7f95f9ffb700 1 -- 172.21.15.115:0/4039100485 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f95fc010030 con 0x7f9604153ec0 2023-07-27T14:39:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.125+0000 7f95f9ffb700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f95e805fcc0 0x7f95e8062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.125+0000 7f95f9ffb700 1 -- 172.21.15.115:0/4039100485 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f95fc07ad70 con 0x7f9604153ec0 2023-07-27T14:39:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.125+0000 7f9609d9b700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f95e805fcc0 0x7f95e8062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.126+0000 7f9609d9b700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f95e805fcc0 0x7f95e8062180 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f960000b3c0 tx=0x7f9600017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:53.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.129+0000 7f95f9ffb700 1 -- 172.21.15.115:0/4039100485 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95fc04b750 con 0x7f9604153ec0 2023-07-27T14:39:53.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.362+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_retain_snapshot_with_snapshots"]} v 0) v1 -- 0x7f96040aa4d0 con 0x7f9604153ec0 2023-07-27T14:39:53.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.911+0000 7f95f9ffb700 1 -- 172.21.15.115:0/4039100485 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_retain_snapshot_with_snapshots"]}]=0 v656) v1 ==== 187+0+0 (secure 0 0 0) 0x7f96040aa4d0 con 0x7f9604153ec0 2023-07-27T14:39:53.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f95e805fcc0 msgr2=0x7f95e8062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:53.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f95e805fcc0 0x7f95e8062180 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f960000b3c0 tx=0x7f9600017000).stop 2023-07-27T14:39:53.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 msgr2=0x7f96041647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:53.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96041647e0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 rx=0x7f95fc002230 tx=0x7f95fc007db0).stop 2023-07-27T14:39:53.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 shutdown_connections 2023-07-27T14:39:53.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f95e805fcc0 0x7f95e8062180 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:53.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9604153ec0 0x7f96041647e0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:53.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96040aa050 0x7f9604152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:53.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 --2- 172.21.15.115:0/4039100485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96040aaa40 0x7f9604150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:53.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 >> 172.21.15.115:0/4039100485 conn(0x7f96040cb610 msgr2=0x7f96040640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:53.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 shutdown_connections 2023-07-27T14:39:53.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:53.914+0000 7f960bfff700 1 -- 172.21.15.115:0/4039100485 wait complete. 2023-07-27T14:39:53.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:39:54.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.128+0000 7fa5d67ff700 1 Processor -- start 2023-07-27T14:39:54.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.128+0000 7fa5d67ff700 1 -- start start 2023-07-27T14:39:54.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d0063260 0x7fa5d0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d67ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5d014b1e0 0x7fa5d00a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d67ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d01553f0 con 0x7fa5d014ae00 2023-07-27T14:39:54.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d67ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d0157a50 con 0x7fa5d014b1e0 2023-07-27T14:39:54.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0157d10 con 0x7fa5d0063260 2023-07-27T14:39:54.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d4d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5d014b1e0 0x7fa5d00a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d4d9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5d014b1e0 0x7fa5d00a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45506/0 (socket says 172.21.15.115:45506) 2023-07-27T14:39:54.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d4d9c700 1 -- 172.21.15.115:0/2175313457 learned_addr learned my addr 172.21.15.115:0/2175313457 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:54.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5cffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa5d014ae00 0x7fa5d0062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50346/0 (socket says 172.21.15.115:50346) 2023-07-27T14:39:54.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5cf7fe700 1 --2- 172.21.15.115:0/2175313457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d0063260 0x7fa5d0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d4d9c700 1 -- 172.21.15.115:0/2175313457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d0063260 msgr2=0x7fa5d0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:54.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d4d9c700 1 --2- 172.21.15.115:0/2175313457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d0063260 0x7fa5d0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d4d9c700 1 -- 172.21.15.115:0/2175313457 >> v1:172.21.15.115:6789/0 conn(0x7fa5d014ae00 legacy=0x7fa5d0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5d4d9c700 1 -- 172.21.15.115:0/2175313457 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0157ff0 con 0x7fa5d014b1e0 2023-07-27T14:39:54.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.130+0000 7fa5ceffd700 1 -- 172.21.15.115:0/2175313457 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374264485 0 0) 0x7fa5d01553f0 con 0x7fa5d014ae00 2023-07-27T14:39:54.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d4d9c700 1 --2- 172.21.15.115:0/2175313457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00a98c0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7fa5c8009f20 tx=0x7fa5c8009840).ready entity=mon.0 client_cookie=c4c8d65227bd440b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:54.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5ceffd700 1 -- 172.21.15.115:0/2175313457 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800e070 con 0x7fa5d014b1e0 2023-07-27T14:39:54.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5ceffd700 1 -- 172.21.15.115:0/2175313457 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c800ba80 con 0x7fa5d014b1e0 2023-07-27T14:39:54.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5ceffd700 1 -- 172.21.15.115:0/2175313457 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800be00 con 0x7fa5d014b1e0 2023-07-27T14:39:54.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2175313457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 msgr2=0x7fa5d00a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2175313457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00a98c0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7fa5c8009f20 tx=0x7fa5c8009840).stop 2023-07-27T14:39:54.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2175313457 shutdown_connections 2023-07-27T14:39:54.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2175313457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00a98c0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2175313457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d0063260 0x7fa5d0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2175313457 >> 172.21.15.115:0/2175313457 conn(0x7fa5d005e940 msgr2=0x7fa5d00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:54.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2175313457 shutdown_connections 2023-07-27T14:39:54.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.131+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2175313457 wait complete. 2023-07-27T14:39:54.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.133+0000 7fa5d67ff700 1 Processor -- start 2023-07-27T14:39:54.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.133+0000 7fa5d67ff700 1 -- start start 2023-07-27T14:39:54.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d67ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5d0063260 0x7fa5d00aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d014ae00 0x7fa5d014a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d67ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d67ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0164960 con 0x7fa5d014b1e0 2023-07-27T14:39:54.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d67ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00ae8e0 con 0x7fa5d0063260 2023-07-27T14:39:54.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0164680 con 0x7fa5d014ae00 2023-07-27T14:39:54.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d4d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d4d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45510/0 (socket says 172.21.15.115:45510) 2023-07-27T14:39:54.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5d4d9c700 1 -- 172.21.15.115:0/2711067759 learned_addr learned my addr 172.21.15.115:0/2711067759 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:54.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5cf7fe700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d014ae00 0x7fa5d014a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.134+0000 7fa5cffff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5d0063260 0x7fa5d00aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5d4d9c700 1 -- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d014ae00 msgr2=0x7fa5d014a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5d4d9c700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d014ae00 0x7fa5d014a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5d4d9c700 1 -- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5d0063260 msgr2=0x7fa5d00aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5d4d9c700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5d0063260 0x7fa5d00aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5d4d9c700 1 -- 172.21.15.115:0/2711067759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c8009ae0 con 0x7fa5d014b1e0 2023-07-27T14:39:54.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5cffff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5d0063260 0x7fa5d00aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:54.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5d4d9c700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00c7650 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7fa5d00caac0 tx=0x7fa5c8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:54.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5b7fff700 1 -- 172.21.15.115:0/2711067759 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800be00 con 0x7fa5d014b1e0 2023-07-27T14:39:54.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5b7fff700 1 -- 172.21.15.115:0/2711067759 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8009500 con 0x7fa5d014b1e0 2023-07-27T14:39:54.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d00ae290 con 0x7fa5d014b1e0 2023-07-27T14:39:54.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5b7fff700 1 -- 172.21.15.115:0/2711067759 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c801d6b0 con 0x7fa5d014b1e0 2023-07-27T14:39:54.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.135+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d00af260 con 0x7fa5d014b1e0 2023-07-27T14:39:54.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.136+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d00aea50 con 0x7fa5d014b1e0 2023-07-27T14:39:54.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.137+0000 7fa5b7fff700 1 -- 172.21.15.115:0/2711067759 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fa5c8024030 con 0x7fa5d014b1e0 2023-07-27T14:39:54.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.138+0000 7fa5b7fff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5bc05fcc0 0x7fa5bc062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.138+0000 7fa5b7fff700 1 -- 172.21.15.115:0/2711067759 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fa5c807c600 con 0x7fa5d014b1e0 2023-07-27T14:39:54.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.138+0000 7fa5cffff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5bc05fcc0 0x7fa5bc062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.139+0000 7fa5cffff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5bc05fcc0 0x7fa5bc062180 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fa5d00c1860 tx=0x7fa5c0007b30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:54.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.142+0000 7fa5b7fff700 1 -- 172.21.15.115:0/2711067759 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5c8050850 con 0x7fa5d014b1e0 2023-07-27T14:39:54.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.311+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa5d006c470 con 0x7fa5d014b1e0 2023-07-27T14:39:54.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.316+0000 7fa5b7fff700 1 -- 172.21.15.115:0/2711067759 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5c8022020 con 0x7fa5d014b1e0 2023-07-27T14:39:54.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.318+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5bc05fcc0 msgr2=0x7fa5bc062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.318+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5bc05fcc0 0x7fa5bc062180 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fa5d00c1860 tx=0x7fa5c0007b30).stop 2023-07-27T14:39:54.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.318+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 msgr2=0x7fa5d00c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.318+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00c7650 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7fa5d00caac0 tx=0x7fa5c8009840).stop 2023-07-27T14:39:54.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.319+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 shutdown_connections 2023-07-27T14:39:54.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.319+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa5bc05fcc0 0x7fa5bc062180 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.319+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5d014b1e0 0x7fa5d00c7650 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.319+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5d0063260 0x7fa5d00aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.319+0000 7fa5d67ff700 1 --2- 172.21.15.115:0/2711067759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5d014ae00 0x7fa5d014a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.319+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 >> 172.21.15.115:0/2711067759 conn(0x7fa5d005e940 msgr2=0x7fa5d00a9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:54.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.319+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 shutdown_connections 2023-07-27T14:39:54.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.319+0000 7fa5d67ff700 1 -- 172.21.15.115:0/2711067759 wait complete. 2023-07-27T14:39:54.392 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:39:54.393 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:39:54.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:39:54.601 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:39:54.601 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:39:54.602 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:39:54.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.734+0000 7f8f939ff700 1 Processor -- start 2023-07-27T14:39:54.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.734+0000 7f8f939ff700 1 -- start start 2023-07-27T14:39:54.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f939ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f8c151d70 0x7f8f8c155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f939ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c065ff0 0x7f8f8c066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f939ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8c067080 con 0x7f8f8c066960 2023-07-27T14:39:54.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f939ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8c063a90 con 0x7f8f8c151d70 2023-07-27T14:39:54.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f939ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c068570 con 0x7f8f8c065ff0 2023-07-27T14:39:54.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f9179b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f8c151d70 0x7f8f8c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f9179b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8f8c151d70 0x7f8f8c155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45526/0 (socket says 172.21.15.115:45526) 2023-07-27T14:39:54.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f9179b700 1 -- 172.21.15.115:0/265108004 learned_addr learned my addr 172.21.15.115:0/265108004 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:54.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f90f9a700 1 --2- 172.21.15.115:0/265108004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c065ff0 0x7f8f8c066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f9179b700 1 -- 172.21.15.115:0/265108004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c065ff0 msgr2=0x7f8f8c066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:54.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f9179b700 1 --2- 172.21.15.115:0/265108004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c065ff0 0x7f8f8c066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.736+0000 7f8f9179b700 1 -- 172.21.15.115:0/265108004 >> v1:172.21.15.159:6789/0 conn(0x7f8f8c066960 legacy=0x7f8f8c157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:54.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f9179b700 1 -- 172.21.15.115:0/265108004 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c066df0 con 0x7f8f8c151d70 2023-07-27T14:39:54.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f9179b700 1 --2- 172.21.15.115:0/265108004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c155060 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7f8f88006fd0 tx=0x7f8f880090f0).ready entity=mon.0 client_cookie=95f1ba918a5ac7e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f83fff700 1 -- 172.21.15.115:0/265108004 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800b600 con 0x7f8f8c151d70 2023-07-27T14:39:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f83fff700 1 -- 172.21.15.115:0/265108004 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8800b760 con 0x7f8f8c151d70 2023-07-27T14:39:54.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f83fff700 1 -- 172.21.15.115:0/265108004 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800bae0 con 0x7f8f8c151d70 2023-07-27T14:39:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f939ff700 1 -- 172.21.15.115:0/265108004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 msgr2=0x7f8f8c155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f939ff700 1 --2- 172.21.15.115:0/265108004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c155060 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7f8f88006fd0 tx=0x7f8f880090f0).stop 2023-07-27T14:39:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f939ff700 1 -- 172.21.15.115:0/265108004 shutdown_connections 2023-07-27T14:39:54.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f939ff700 1 --2- 172.21.15.115:0/265108004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c155060 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f939ff700 1 --2- 172.21.15.115:0/265108004 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c065ff0 0x7f8f8c066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.737+0000 7f8f939ff700 1 -- 172.21.15.115:0/265108004 >> 172.21.15.115:0/265108004 conn(0x7f8f8c0c89a0 msgr2=0x7f8f8c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.738+0000 7f8f939ff700 1 -- 172.21.15.115:0/265108004 shutdown_connections 2023-07-27T14:39:54.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.738+0000 7f8f939ff700 1 -- 172.21.15.115:0/265108004 wait complete. 2023-07-27T14:39:54.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.739+0000 7f8f939ff700 1 Processor -- start 2023-07-27T14:39:54.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.739+0000 7f8f939ff700 1 -- start start 2023-07-27T14:39:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f939ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f8c065ff0 0x7f8f8c0c1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f939ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c066960 0x7f8f8c1676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f939ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f939ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0c1910 con 0x7f8f8c151d70 2023-07-27T14:39:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f939ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c164ce0 con 0x7f8f8c065ff0 2023-07-27T14:39:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f939ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c164fc0 con 0x7f8f8c066960 2023-07-27T14:39:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f91f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f9179b700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f8c065ff0 0x7f8f8c0c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f91f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c0c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45532/0 (socket says 172.21.15.115:45532) 2023-07-27T14:39:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f91f9c700 1 -- 172.21.15.115:0/2722346809 learned_addr learned my addr 172.21.15.115:0/2722346809 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.740+0000 7f8f90f9a700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c066960 0x7f8f8c1676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f91f9c700 1 -- 172.21.15.115:0/2722346809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c066960 msgr2=0x7f8f8c1676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f91f9c700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c066960 0x7f8f8c1676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f91f9c700 1 -- 172.21.15.115:0/2722346809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f8c065ff0 msgr2=0x7f8f8c0c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f91f9c700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f8c065ff0 0x7f8f8c0c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:54.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f91f9c700 1 -- 172.21.15.115:0/2722346809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88009370 con 0x7f8f8c151d70 2023-07-27T14:39:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f91f9c700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c0c7a10 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7f8f84002230 tx=0x7f8f840015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f817fa700 1 -- 172.21.15.115:0/2722346809 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400e4a0 con 0x7f8f8c151d70 2023-07-27T14:39:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f817fa700 1 -- 172.21.15.115:0/2722346809 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8400e600 con 0x7f8f8c151d70 2023-07-27T14:39:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c1652a0 con 0x7f8f8c151d70 2023-07-27T14:39:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f817fa700 1 -- 172.21.15.115:0/2722346809 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400e980 con 0x7f8f8c151d70 2023-07-27T14:39:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.741+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c167b90 con 0x7f8f8c151d70 2023-07-27T14:39:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.742+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c0a9490 con 0x7f8f8c151d70 2023-07-27T14:39:54.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.743+0000 7f8f817fa700 1 -- 172.21.15.115:0/2722346809 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f8f84019030 con 0x7f8f8c151d70 2023-07-27T14:39:54.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.744+0000 7f8f817fa700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f7005fc90 0x7f8f70062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:54.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.744+0000 7f8f817fa700 1 -- 172.21.15.115:0/2722346809 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f8f8407a560 con 0x7f8f8c151d70 2023-07-27T14:39:54.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.744+0000 7f8f9179b700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f7005fc90 0x7f8f70062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:54.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.745+0000 7f8f9179b700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f7005fc90 0x7f8f70062150 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f8f88009130 tx=0x7f8f88017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:54.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.748+0000 7f8f817fa700 1 -- 172.21.15.115:0/2722346809 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f840488f0 con 0x7f8f8c151d70 2023-07-27T14:39:55.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.958+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f8c06c470 con 0x7f8f8c151d70 2023-07-27T14:39:55.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.958+0000 7f8f817fa700 1 -- 172.21.15.115:0/2722346809 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+3535 (secure 0 0 0) 0x7f8f8c0a9490 con 0x7f8f8c151d70 2023-07-27T14:39:55.014 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:55.014 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":106,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2746189426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2746189426},{"type":"v1","addr":"172.21.15.159:6835","nonce":2746189426}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/131117331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":131117331},{"type":"v1","addr":"172.21.15.115:6837","nonce":131117331}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":8608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/3669259360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3669259360},{"type":"v1","addr":"172.21.15.159:6834","nonce":3669259360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":10305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/45573420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":45573420},{"type":"v1","addr":"172.21.15.115:6836","nonce":45573420}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[]} 2023-07-27T14:39:55.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f7005fc90 msgr2=0x7f8f70062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:55.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f7005fc90 0x7f8f70062150 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f8f88009130 tx=0x7f8f88017000).stop 2023-07-27T14:39:55.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 msgr2=0x7f8f8c0c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:55.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c0c7a10 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7f8f84002230 tx=0x7f8f840015e0).stop 2023-07-27T14:39:55.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 shutdown_connections 2023-07-27T14:39:55.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8f7005fc90 0x7f8f70062150 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8f8c151d70 0x7f8f8c0c7a10 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f8c065ff0 0x7f8f8c0c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 --2- 172.21.15.115:0/2722346809 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8f8c066960 0x7f8f8c1676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.960+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 >> 172.21.15.115:0/2722346809 conn(0x7f8f8c0c89a0 msgr2=0x7f8f8c0c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:55.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.961+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 shutdown_connections 2023-07-27T14:39:55.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:54.961+0000 7f8f939ff700 1 -- 172.21.15.115:0/2722346809 wait complete. 2023-07-27T14:39:55.018 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 106 2023-07-27T14:39:55.033 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:39:55.034 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:39:55.034 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:39:55.034 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:39:55.034 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:39:55.035 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:39:55.035 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:39:55.035 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:39:55.035 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:39:55.036 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:39:55.036 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:39:55.036 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:39:55.036 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:39:55.036 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:39:55.037 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:39:55.037 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:39:55.047 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:39:55.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:39:55.049 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:39:55.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:39:55.051 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:39:55.051 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:39:55.052 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:39:55.052 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:39:55.093 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:39:55.094 DEBUG:teuthology.parallel:result is None 2023-07-27T14:39:55.097 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:39:55.097 DEBUG:teuthology.parallel:result is None 2023-07-27T14:39:55.099 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:39:55.099 DEBUG:teuthology.parallel:result is None 2023-07-27T14:39:55.101 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:39:55.101 DEBUG:teuthology.parallel:result is None 2023-07-27T14:39:55.102 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:39:55.234 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:39:55.242 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:39:55.243 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:39:55.243 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:39:55.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.260+0000 7fb4b0fff700 1 Processor -- start 2023-07-27T14:39:55.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.260+0000 7fb4b0fff700 1 -- start start 2023-07-27T14:39:55.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.261+0000 7fb4b0fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb4ac153ec0 0x7fb4ac0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:55.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.261+0000 7fb4b0fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac0c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:55.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.261+0000 7fb4b0fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0aa4d0 con 0x7fb4ac0aa050 2023-07-27T14:39:55.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.261+0000 7fb4b0fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac0c05c0 con 0x7fb4ac153ec0 2023-07-27T14:39:55.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.261+0000 7fb4b0fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0bfc90 con 0x7fb4ac0aaa40 2023-07-27T14:39:55.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.261+0000 7fb4a9d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb4ac0aa050 0x7fb4ac0640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50376/0 (socket says 172.21.15.115:50376) 2023-07-27T14:39:55.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.261+0000 7fb4a9d9b700 1 -- 172.21.15.115:0/2429722375 learned_addr learned my addr 172.21.15.115:0/2429722375 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:55.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4aa59c700 1 --2- 172.21.15.115:0/2429722375 >> v2:172.21.15.159:3300/0 conn(0x7fb4ac153ec0 0x7fb4ac0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:55.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4aad9d700 1 --2- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac0c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:55.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4a959a700 1 -- 172.21.15.115:0/2429722375 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873382132 0 0) 0x7fb4a0001110 con 0x7fb4ac0aa050 2023-07-27T14:39:55.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4a959a700 1 -- 172.21.15.115:0/2429722375 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4940033f0 con 0x7fb4ac0aa050 2023-07-27T14:39:55.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4aa59c700 1 -- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 msgr2=0x7fb4ac0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:55.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4aa59c700 1 --2- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac0c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4aa59c700 1 -- 172.21.15.115:0/2429722375 >> v1:172.21.15.115:6789/0 conn(0x7fb4ac0aa050 legacy=0x7fb4ac0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:55.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4aa59c700 1 -- 172.21.15.115:0/2429722375 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0bff70 con 0x7fb4ac153ec0 2023-07-27T14:39:55.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4aad9d700 1 --2- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac0c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:55.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4aa59c700 1 --2- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 0x7fb4ac0a9b60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fb49c009760 tx=0x7fb49c009060).ready entity=mon.1 client_cookie=163f627eddb9ce2f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:55.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4a959a700 1 -- 172.21.15.115:0/2429722375 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00d4a0 con 0x7fb4ac153ec0 2023-07-27T14:39:55.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4a959a700 1 -- 172.21.15.115:0/2429722375 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00d600 con 0x7fb4ac153ec0 2023-07-27T14:39:55.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.262+0000 7fb4a959a700 1 -- 172.21.15.115:0/2429722375 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00d980 con 0x7fb4ac153ec0 2023-07-27T14:39:55.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.263+0000 7fb4b0fff700 1 -- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 msgr2=0x7fb4ac0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:55.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.263+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 0x7fb4ac0a9b60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fb49c009760 tx=0x7fb49c009060).stop 2023-07-27T14:39:55.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.263+0000 7fb4b0fff700 1 -- 172.21.15.115:0/2429722375 shutdown_connections 2023-07-27T14:39:55.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.263+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac0c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.263+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/2429722375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 0x7fb4ac0a9b60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.263+0000 7fb4b0fff700 1 -- 172.21.15.115:0/2429722375 >> 172.21.15.115:0/2429722375 conn(0x7fb4ac0cb610 msgr2=0x7fb4ac0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:55.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.263+0000 7fb4b0fff700 1 -- 172.21.15.115:0/2429722375 shutdown_connections 2023-07-27T14:39:55.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.263+0000 7fb4b0fff700 1 -- 172.21.15.115:0/2429722375 wait complete. 2023-07-27T14:39:55.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.265+0000 7fb4b0fff700 1 Processor -- start 2023-07-27T14:39:55.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.265+0000 7fb4b0fff700 1 -- start start 2023-07-27T14:39:55.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4b0fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4ac0aa050 0x7fb4ac13f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:55.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4b0fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:55.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4b0fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 0x7fb4ac1648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:55.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4b0fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0c2000 con 0x7fb4ac0aa050 2023-07-27T14:39:55.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4b0fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0c1cd0 con 0x7fb4ac153ec0 2023-07-27T14:39:55.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4b0fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0c3120 con 0x7fb4ac0aaa40 2023-07-27T14:39:55.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4ac0aa050 0x7fb4ac13f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:55.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4ac0aa050 0x7fb4ac13f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45568/0 (socket says 172.21.15.115:45568) 2023-07-27T14:39:55.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aa59c700 1 -- 172.21.15.115:0/3210800956 learned_addr learned my addr 172.21.15.115:0/3210800956 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:55.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aad9d700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 0x7fb4ac1648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:55.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4a9d9b700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:55.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aa59c700 1 -- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 msgr2=0x7fb4ac152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:55.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aa59c700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aa59c700 1 -- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 msgr2=0x7fb4ac1648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:55.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aa59c700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 0x7fb4ac1648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:55.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aa59c700 1 -- 172.21.15.115:0/3210800956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4009a20 con 0x7fb4ac0aa050 2023-07-27T14:39:55.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.266+0000 7fb4aad9d700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 0x7fb4ac1648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:55.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.267+0000 7fb4aa59c700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4ac0aa050 0x7fb4ac13f710 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7fb49c009d50 tx=0x7fb49c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:55.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.267+0000 7fb49a7fc700 1 -- 172.21.15.115:0/3210800956 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00dd30 con 0x7fb4ac0aa050 2023-07-27T14:39:55.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.267+0000 7fb49a7fc700 1 -- 172.21.15.115:0/3210800956 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00de90 con 0x7fb4ac0aa050 2023-07-27T14:39:55.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.267+0000 7fb49a7fc700 1 -- 172.21.15.115:0/3210800956 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00d980 con 0x7fb4ac0aa050 2023-07-27T14:39:55.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.267+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49c0092a0 con 0x7fb4ac0aa050 2023-07-27T14:39:55.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.267+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac0c36e0 con 0x7fb4ac0aa050 2023-07-27T14:39:55.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.268+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac06c470 con 0x7fb4ac0aa050 2023-07-27T14:39:55.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.269+0000 7fb49a7fc700 1 -- 172.21.15.115:0/3210800956 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fb49c00f070 con 0x7fb4ac0aa050 2023-07-27T14:39:55.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.270+0000 7fb49a7fc700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb48c05fc90 0x7fb48c062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:55.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.270+0000 7fb49a7fc700 1 -- 172.21.15.115:0/3210800956 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5383+0+0 (secure 0 0 0) 0x7fb49c07c640 con 0x7fb4ac0aa050 2023-07-27T14:39:55.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.271+0000 7fb4a9d9b700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb48c05fc90 0x7fb48c062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:55.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.271+0000 7fb4a9d9b700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb48c05fc90 0x7fb48c062150 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fb4ac1506a0 tx=0x7fb4a0007a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:55.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.275+0000 7fb49a7fc700 1 -- 172.21.15.115:0/3210800956 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb49c04cfd0 con 0x7fb4ac0aa050 2023-07-27T14:39:55.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:55.457+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb4ac0c0250 con 0x7fb4ac0aa050 2023-07-27T14:39:56.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.234+0000 7fb49a7fc700 1 -- 172.21.15.115:0/3210800956 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v201) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb49c0505b0 con 0x7fb4ac0aa050 2023-07-27T14:39:56.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb48c05fc90 msgr2=0x7fb48c062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb48c05fc90 0x7fb48c062150 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fb4ac1506a0 tx=0x7fb4a0007a70).stop 2023-07-27T14:39:56.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4ac0aa050 msgr2=0x7fb4ac13f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4ac0aa050 0x7fb4ac13f710 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7fb49c009d50 tx=0x7fb49c016000).stop 2023-07-27T14:39:56.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 shutdown_connections 2023-07-27T14:39:56.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb48c05fc90 0x7fb48c062150 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4ac153ec0 0x7fb4ac1648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4ac0aa050 0x7fb4ac13f710 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 --2- 172.21.15.115:0/3210800956 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb4ac0aaa40 0x7fb4ac152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 >> 172.21.15.115:0/3210800956 conn(0x7fb4ac0cb610 msgr2=0x7fb4ac0ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:56.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 shutdown_connections 2023-07-27T14:39:56.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.237+0000 7fb4b0fff700 1 -- 172.21.15.115:0/3210800956 wait complete. 2023-07-27T14:39:56.297 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:39:56.310 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:39:56.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.441+0000 7f667c3ff700 1 Processor -- start 2023-07-27T14:39:56.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.441+0000 7f667c3ff700 1 -- start start 2023-07-27T14:39:56.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667c3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6674150af0 0x7f6674150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667c3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f66740a5e40 0x7f66740c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667c3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667406a440 con 0x7f66740c0e80 2023-07-27T14:39:56.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667c3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66740bbc80 con 0x7f6674150af0 2023-07-27T14:39:56.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667c3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6674069e80 con 0x7f66740a5e40 2023-07-27T14:39:56.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6674150af0 0x7f6674150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6674150af0 0x7f6674150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45574/0 (socket says 172.21.15.115:45574) 2023-07-27T14:39:56.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667a19b700 1 -- 172.21.15.115:0/4222603176 learned_addr learned my addr 172.21.15.115:0/4222603176 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:56.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.443+0000 7f667a99c700 1 --2- 172.21.15.115:0/4222603176 >> v2:172.21.15.159:3300/0 conn(0x7f66740a5e40 0x7f66740c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f667a19b700 1 -- 172.21.15.115:0/4222603176 >> v2:172.21.15.159:3300/0 conn(0x7f66740a5e40 msgr2=0x7f66740c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:56.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f667a19b700 1 --2- 172.21.15.115:0/4222603176 >> v2:172.21.15.159:3300/0 conn(0x7f66740a5e40 0x7f66740c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f667a19b700 1 -- 172.21.15.115:0/4222603176 >> v1:172.21.15.115:6789/0 conn(0x7f66740c0e80 legacy=0x7f66740a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f667a19b700 1 -- 172.21.15.115:0/4222603176 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667406a160 con 0x7f6674150af0 2023-07-27T14:39:56.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f6679199700 1 -- 172.21.15.115:0/4222603176 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322676009 0 0) 0x7f667406a440 con 0x7f66740c0e80 2023-07-27T14:39:56.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f667a19b700 1 --2- 172.21.15.115:0/4222603176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6674150af0 0x7f6674150ed0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7f6674065210 tx=0x7f66700090f0).ready entity=mon.0 client_cookie=62217ab77f7b0c72 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:56.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f6679199700 1 -- 172.21.15.115:0/4222603176 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000b600 con 0x7f6674150af0 2023-07-27T14:39:56.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f6679199700 1 -- 172.21.15.115:0/4222603176 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667000b760 con 0x7f6674150af0 2023-07-27T14:39:56.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f6679199700 1 -- 172.21.15.115:0/4222603176 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000bae0 con 0x7f6674150af0 2023-07-27T14:39:56.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f667c3ff700 1 -- 172.21.15.115:0/4222603176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6674150af0 msgr2=0x7f6674150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.444+0000 7f667c3ff700 1 --2- 172.21.15.115:0/4222603176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6674150af0 0x7f6674150ed0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7f6674065210 tx=0x7f66700090f0).stop 2023-07-27T14:39:56.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.445+0000 7f667c3ff700 1 -- 172.21.15.115:0/4222603176 shutdown_connections 2023-07-27T14:39:56.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.445+0000 7f667c3ff700 1 --2- 172.21.15.115:0/4222603176 >> v2:172.21.15.159:3300/0 conn(0x7f66740a5e40 0x7f66740c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.445+0000 7f667c3ff700 1 --2- 172.21.15.115:0/4222603176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6674150af0 0x7f6674150ed0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.445+0000 7f667c3ff700 1 -- 172.21.15.115:0/4222603176 >> 172.21.15.115:0/4222603176 conn(0x7f6674062320 msgr2=0x7f6674062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:56.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.445+0000 7f667c3ff700 1 -- 172.21.15.115:0/4222603176 shutdown_connections 2023-07-27T14:39:56.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.445+0000 7f667c3ff700 1 -- 172.21.15.115:0/4222603176 wait complete. 2023-07-27T14:39:56.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.446+0000 7f667c3ff700 1 Processor -- start 2023-07-27T14:39:56.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.446+0000 7f667c3ff700 1 -- start start 2023-07-27T14:39:56.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.447+0000 7f667c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66740a5e40 0x7f6674164880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.447+0000 7f667c3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66740c0e80 0x7f6674164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.447+0000 7f667c3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6674150af0 0x7f66740a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.447+0000 7f667c3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6674168530 con 0x7f66740c0e80 2023-07-27T14:39:56.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.447+0000 7f667c3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6674167e90 con 0x7f6674150af0 2023-07-27T14:39:56.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.447+0000 7f667c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66741653f0 con 0x7f66740a5e40 2023-07-27T14:39:56.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.447+0000 7f667999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66740c0e80 0x7f6674164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667999a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66740c0e80 0x7f6674164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45576/0 (socket says 172.21.15.115:45576) 2023-07-27T14:39:56.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667999a700 1 -- 172.21.15.115:0/2224795453 learned_addr learned my addr 172.21.15.115:0/2224795453 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:56.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667a19b700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66740a5e40 0x7f6674164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667a99c700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6674150af0 0x7f66740a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667999a700 1 -- 172.21.15.115:0/2224795453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66740a5e40 msgr2=0x7f6674164880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667999a700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66740a5e40 0x7f6674164880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667999a700 1 -- 172.21.15.115:0/2224795453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6674150af0 msgr2=0x7f66740a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667999a700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6674150af0 0x7f66740a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667999a700 1 -- 172.21.15.115:0/2224795453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670009370 con 0x7f66740c0e80 2023-07-27T14:39:56.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667999a700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66740c0e80 0x7f6674164d70 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7f6664001eb0 tx=0x7f6664007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:56.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f666a7fc700 1 -- 172.21.15.115:0/2224795453 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666400f470 con 0x7f66740c0e80 2023-07-27T14:39:56.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f666a7fc700 1 -- 172.21.15.115:0/2224795453 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666400f5f0 con 0x7f66740c0e80 2023-07-27T14:39:56.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f666a7fc700 1 -- 172.21.15.115:0/2224795453 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666400f9b0 con 0x7f66740c0e80 2023-07-27T14:39:56.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.448+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66741656d0 con 0x7f66740c0e80 2023-07-27T14:39:56.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.449+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66740a8cf0 con 0x7f66740c0e80 2023-07-27T14:39:56.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.449+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6674151140 con 0x7f66740c0e80 2023-07-27T14:39:56.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.450+0000 7f666a7fc700 1 -- 172.21.15.115:0/2224795453 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f6664019030 con 0x7f66740c0e80 2023-07-27T14:39:56.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.451+0000 7f666a7fc700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f665805fcc0 0x7f6658062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.451+0000 7f666a7fc700 1 -- 172.21.15.115:0/2224795453 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f666407a4c0 con 0x7f66740c0e80 2023-07-27T14:39:56.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.451+0000 7f667a19b700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f665805fcc0 0x7f6658062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.452+0000 7f667a19b700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f665805fcc0 0x7f6658062180 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f6670009fd0 tx=0x7f6670017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:56.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.455+0000 7f666a7fc700 1 -- 172.21.15.115:0/2224795453 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f666404ad50 con 0x7f66740c0e80 2023-07-27T14:39:56.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.688+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f667406c470 con 0x7f66740c0e80 2023-07-27T14:39:56.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.688+0000 7f666a7fc700 1 -- 172.21.15.115:0/2224795453 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f666404e370 con 0x7f66740c0e80 2023-07-27T14:39:56.744 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:56.744 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:39:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:39:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:39:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:39:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:39:56.745 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:39:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:39:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:39:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:39:56.746 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:39:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:39:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:39:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.747 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:39:56.748 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:39:56.748 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.748 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:39:56.748 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:39:56.748 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:39:56.748 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.749 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:39:56.749 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:39:56.749 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.749 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:39:56.749 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:39:56.750 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:39:56.750 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.750 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:39:56.750 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:39:56.750 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.751 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:39:56.751 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:39:56.751 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.751 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.751 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:39:56.751 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:39:56.752 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.752 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:39:56.752 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:39:56.753 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.754 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.754 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:39:56.754 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:39:56.754 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.754 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:39:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:39:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:39:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:39:56.755 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.756 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:39:56.756 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:39:56.756 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.756 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.756 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:39:56.757 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:39:56.757 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.757 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:39:56.757 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:39:56.757 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.758 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:39:56.758 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:39:56.758 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.758 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:39:56.758 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:39:56.758 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.759 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:39:56.759 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:39:56.759 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.759 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:39:56.759 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:39:56.760 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.760 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.760 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:39:56.760 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:39:56.760 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.761 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:39:56.761 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:39:56.761 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.761 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:39:56.761 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:39:56.762 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.762 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:39:56.762 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:39:56.762 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:39:56.762 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.763 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:39:56.763 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:39:56.764 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.764 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:39:56.765 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:39:56.765 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:39:56.765 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:39:56.765 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.766 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:39:56.767 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:39:56.767 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.767 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:39:56.767 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:39:56.768 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:39:56.768 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:39:56.768 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.769 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:39:56.769 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:39:56.769 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.769 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:39:56.769 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:39:56.770 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:39:56.770 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:39:56.770 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.770 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:39:56.770 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:39:56.770 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.771 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:39:56.771 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:39:56.771 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:39:56.771 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.771 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.771 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:39:56.772 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:39:56.772 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.772 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:39:56.772 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:39:56.772 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.772 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:56.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:56.773 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:39:56.773 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:39:56.773 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:39:56.773 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:39:56.773 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:39:56.773 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:39:56.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:56.774 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:39:56.774 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:39:56.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.690+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f665805fcc0 msgr2=0x7f6658062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.690+0000 7f667c3ff700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f665805fcc0 0x7f6658062180 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f6670009fd0 tx=0x7f6670017000).stop 2023-07-27T14:39:56.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.690+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66740c0e80 msgr2=0x7f6674164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.690+0000 7f667c3ff700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66740c0e80 0x7f6674164d70 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7f6664001eb0 tx=0x7f6664007c40).stop 2023-07-27T14:39:56.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.691+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 shutdown_connections 2023-07-27T14:39:56.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.691+0000 7f667c3ff700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f665805fcc0 0x7f6658062180 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.691+0000 7f667c3ff700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6674150af0 0x7f66740a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.691+0000 7f667c3ff700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66740a5e40 0x7f6674164880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.691+0000 7f667c3ff700 1 --2- 172.21.15.115:0/2224795453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66740c0e80 0x7f6674164d70 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.691+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 >> 172.21.15.115:0/2224795453 conn(0x7f6674062320 msgr2=0x7f6674069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:56.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.691+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 shutdown_connections 2023-07-27T14:39:56.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.691+0000 7f667c3ff700 1 -- 172.21.15.115:0/2224795453 wait complete. 2023-07-27T14:39:56.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:39:56.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.909+0000 7fc898bff700 1 Processor -- start 2023-07-27T14:39:56.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.909+0000 7fc898bff700 1 -- start start 2023-07-27T14:39:56.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc898bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc8940aaa40 0x7fc8940640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc898bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc898bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8940aa4d0 con 0x7fc894153ec0 2023-07-27T14:39:56.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc898bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc894064ad0 con 0x7fc8940aaa40 2023-07-27T14:39:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc898bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940c05c0 con 0x7fc8941542a0 2023-07-27T14:39:56.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc892d9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc892d9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:52644/0 (socket says 172.21.15.115:52644) 2023-07-27T14:39:56.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc892d9d700 1 -- 172.21.15.115:0/3155858750 learned_addr learned my addr 172.21.15.115:0/3155858750 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:56.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.911+0000 7fc891d9b700 1 --2- 172.21.15.115:0/3155858750 >> v2:172.21.15.159:3300/0 conn(0x7fc8940aaa40 0x7fc8940640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc892d9d700 1 -- 172.21.15.115:0/3155858750 >> v2:172.21.15.159:3300/0 conn(0x7fc8940aaa40 msgr2=0x7fc8940640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:56.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc892d9d700 1 --2- 172.21.15.115:0/3155858750 >> v2:172.21.15.159:3300/0 conn(0x7fc8940aaa40 0x7fc8940640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc892d9d700 1 -- 172.21.15.115:0/3155858750 >> v1:172.21.15.159:6789/0 conn(0x7fc894153ec0 legacy=0x7fc8940a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc892d9d700 1 -- 172.21.15.115:0/3155858750 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940c1a60 con 0x7fc8941542a0 2023-07-27T14:39:56.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc892d9d700 1 --2- 172.21.15.115:0/3155858750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940645e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc88c009f20 tx=0x7fc88c009840).ready entity=mon.2 client_cookie=c497b7e976fb0024 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:56.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc89159a700 1 -- 172.21.15.115:0/3155858750 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00e070 con 0x7fc8941542a0 2023-07-27T14:39:56.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc89159a700 1 -- 172.21.15.115:0/3155858750 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c00b9d0 con 0x7fc8941542a0 2023-07-27T14:39:56.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc89159a700 1 -- 172.21.15.115:0/3155858750 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00bd50 con 0x7fc8941542a0 2023-07-27T14:39:56.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc898bff700 1 -- 172.21.15.115:0/3155858750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 msgr2=0x7fc8940645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.912+0000 7fc898bff700 1 --2- 172.21.15.115:0/3155858750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940645e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc88c009f20 tx=0x7fc88c009840).stop 2023-07-27T14:39:56.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.913+0000 7fc898bff700 1 -- 172.21.15.115:0/3155858750 shutdown_connections 2023-07-27T14:39:56.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.913+0000 7fc898bff700 1 --2- 172.21.15.115:0/3155858750 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940645e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.913+0000 7fc898bff700 1 --2- 172.21.15.115:0/3155858750 >> v2:172.21.15.159:3300/0 conn(0x7fc8940aaa40 0x7fc8940640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.913+0000 7fc898bff700 1 -- 172.21.15.115:0/3155858750 >> 172.21.15.115:0/3155858750 conn(0x7fc8940cb610 msgr2=0x7fc8940c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:56.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.913+0000 7fc898bff700 1 -- 172.21.15.115:0/3155858750 shutdown_connections 2023-07-27T14:39:56.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.913+0000 7fc898bff700 1 -- 172.21.15.115:0/3155858750 wait complete. 2023-07-27T14:39:56.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.914+0000 7fc898bff700 1 Processor -- start 2023-07-27T14:39:56.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.914+0000 7fc898bff700 1 -- start start 2023-07-27T14:39:56.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc898bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8940aaa40 0x7fc8941517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc898bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc894153ec0 0x7fc89414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc898bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc898bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc894152bb0 con 0x7fc894153ec0 2023-07-27T14:39:56.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc898bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc894151fa0 con 0x7fc8940aaa40 2023-07-27T14:39:56.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc898bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894152280 con 0x7fc8941542a0 2023-07-27T14:39:56.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc891d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc894153ec0 0x7fc89414e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc891d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc894153ec0 0x7fc89414e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45590/0 (socket says 172.21.15.115:45590) 2023-07-27T14:39:56.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.915+0000 7fc891d9b700 1 -- 172.21.15.115:0/37130662 learned_addr learned my addr 172.21.15.115:0/37130662 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:56.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc892d9d700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc89259c700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8940aaa40 0x7fc8941517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc891d9b700 1 -- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 msgr2=0x7fc8940ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc891d9b700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc891d9b700 1 -- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8940aaa40 msgr2=0x7fc8941517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:56.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc891d9b700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8940aaa40 0x7fc8941517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:56.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc891d9b700 1 -- 172.21.15.115:0/37130662 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c009ae0 con 0x7fc894153ec0 2023-07-27T14:39:56.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc892d9d700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:56.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc89259c700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8940aaa40 0x7fc8941517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:56.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc891d9b700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc894153ec0 0x7fc89414e5c0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7fc88800e900 tx=0x7fc888009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:56.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc8827fc700 1 -- 172.21.15.115:0/37130662 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800eea0 con 0x7fc894153ec0 2023-07-27T14:39:56.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc8827fc700 1 -- 172.21.15.115:0/37130662 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800c850 con 0x7fc894153ec0 2023-07-27T14:39:56.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc8827fc700 1 -- 172.21.15.115:0/37130662 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800cbd0 con 0x7fc894153ec0 2023-07-27T14:39:56.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc894152560 con 0x7fc894153ec0 2023-07-27T14:39:56.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.916+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc894151ca0 con 0x7fc894153ec0 2023-07-27T14:39:56.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.917+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89406c470 con 0x7fc894153ec0 2023-07-27T14:39:56.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.918+0000 7fc8827fc700 1 -- 172.21.15.115:0/37130662 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fc888022070 con 0x7fc894153ec0 2023-07-27T14:39:56.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.919+0000 7fc8827fc700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc87405fcc0 0x7fc874062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:56.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.919+0000 7fc8827fc700 1 -- 172.21.15.115:0/37130662 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fc88807b520 con 0x7fc894153ec0 2023-07-27T14:39:56.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.920+0000 7fc89259c700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc87405fcc0 0x7fc874062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:56.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.920+0000 7fc89259c700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc87405fcc0 0x7fc874062180 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fc884001710 tx=0x7fc884009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:56.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:56.924+0000 7fc8827fc700 1 -- 172.21.15.115:0/37130662 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc88804bdb0 con 0x7fc894153ec0 2023-07-27T14:39:57.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.095+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8940c8230 con 0x7fc894153ec0 2023-07-27T14:39:57.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.096+0000 7fc8827fc700 1 -- 172.21.15.115:0/37130662 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+13910 (secure 0 0 0) 0x7fc888016020 con 0x7fc894153ec0 2023-07-27T14:39:57.152 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:57.152 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":201,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:39:56.229845+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:39:57.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc87405fcc0 msgr2=0x7fc874062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc87405fcc0 0x7fc874062180 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fc884001710 tx=0x7fc884009040).stop 2023-07-27T14:39:57.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc894153ec0 msgr2=0x7fc89414e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc894153ec0 0x7fc89414e5c0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7fc88800e900 tx=0x7fc888009060).stop 2023-07-27T14:39:57.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 shutdown_connections 2023-07-27T14:39:57.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc87405fcc0 0x7fc874062180 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc8941542a0 0x7fc8940ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8940aaa40 0x7fc8941517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 --2- 172.21.15.115:0/37130662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc894153ec0 0x7fc89414e5c0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 >> 172.21.15.115:0/37130662 conn(0x7fc8940cb610 msgr2=0x7fc89414f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:57.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.098+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 shutdown_connections 2023-07-27T14:39:57.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.099+0000 7fc898bff700 1 -- 172.21.15.115:0/37130662 wait complete. 2023-07-27T14:39:57.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:39:57.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:39:57.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.305+0000 7fad34dff700 1 Processor -- start 2023-07-27T14:39:57.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.305+0000 7fad34dff700 1 -- start start 2023-07-27T14:39:57.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad34dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fad30150220 0x7fad30150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad34dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad30065220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad34dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad30069040 0x7fad300c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad34dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad30068bb0 con 0x7fad30069040 2023-07-27T14:39:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad34dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3006a250 con 0x7fad30150220 2023-07-27T14:39:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad34dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300c1380 con 0x7fad300c0ea0 2023-07-27T14:39:57.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad2ed9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad30069040 0x7fad300c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad2ed9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad30069040 0x7fad300c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45594/0 (socket says 172.21.15.115:45594) 2023-07-27T14:39:57.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad2ed9d700 1 -- 172.21.15.115:0/2501003913 learned_addr learned my addr 172.21.15.115:0/2501003913 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:57.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad2e59c700 1 --2- 172.21.15.115:0/2501003913 >> v2:172.21.15.159:3300/0 conn(0x7fad30150220 0x7fad30150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad2dd9b700 1 --2- 172.21.15.115:0/2501003913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad30065220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad2ed9d700 1 -- 172.21.15.115:0/2501003913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 msgr2=0x7fad30065220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:57.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.307+0000 7fad2ed9d700 1 --2- 172.21.15.115:0/2501003913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad30065220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad2ed9d700 1 -- 172.21.15.115:0/2501003913 >> v2:172.21.15.159:3300/0 conn(0x7fad30150220 msgr2=0x7fad30150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:57.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad2ed9d700 1 --2- 172.21.15.115:0/2501003913 >> v2:172.21.15.159:3300/0 conn(0x7fad30150220 0x7fad30150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad2ed9d700 1 -- 172.21.15.115:0/2501003913 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30068560 con 0x7fad30069040 2023-07-27T14:39:57.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad2e59c700 1 --2- 172.21.15.115:0/2501003913 >> v2:172.21.15.159:3300/0 conn(0x7fad30150220 0x7fad30150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:57.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad2ed9d700 1 --2- 172.21.15.115:0/2501003913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad300c1770 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7fad30067850 tx=0x7fad28009840).ready entity=mon.0 client_cookie=2c553392ea05d244 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:57.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad2d59a700 1 -- 172.21.15.115:0/2501003913 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2800e070 con 0x7fad30069040 2023-07-27T14:39:57.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad2d59a700 1 -- 172.21.15.115:0/2501003913 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2800ba50 con 0x7fad30069040 2023-07-27T14:39:57.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad2d59a700 1 -- 172.21.15.115:0/2501003913 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2800bdd0 con 0x7fad30069040 2023-07-27T14:39:57.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad34dff700 1 -- 172.21.15.115:0/2501003913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 msgr2=0x7fad300c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.308+0000 7fad34dff700 1 --2- 172.21.15.115:0/2501003913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad300c1770 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7fad30067850 tx=0x7fad28009840).stop 2023-07-27T14:39:57.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.309+0000 7fad34dff700 1 -- 172.21.15.115:0/2501003913 shutdown_connections 2023-07-27T14:39:57.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.309+0000 7fad34dff700 1 --2- 172.21.15.115:0/2501003913 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad300c1770 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.309+0000 7fad34dff700 1 --2- 172.21.15.115:0/2501003913 >> v2:172.21.15.159:3300/0 conn(0x7fad30150220 0x7fad30150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.309+0000 7fad34dff700 1 --2- 172.21.15.115:0/2501003913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad30065220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.309+0000 7fad34dff700 1 -- 172.21.15.115:0/2501003913 >> 172.21.15.115:0/2501003913 conn(0x7fad30062320 msgr2=0x7fad30062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:57.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.309+0000 7fad34dff700 1 -- 172.21.15.115:0/2501003913 shutdown_connections 2023-07-27T14:39:57.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.309+0000 7fad34dff700 1 -- 172.21.15.115:0/2501003913 wait complete. 2023-07-27T14:39:57.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.310+0000 7fad34dff700 1 Processor -- start 2023-07-27T14:39:57.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.310+0000 7fad34dff700 1 -- start start 2023-07-27T14:39:57.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad34dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad3014bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad34dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad300c0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad34dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad30150220 0x7fad300c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad34dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad300be8c0 con 0x7fad30069040 2023-07-27T14:39:57.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad34dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad300bdcb0 con 0x7fad30150220 2023-07-27T14:39:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad34dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300bdf90 con 0x7fad300c0ea0 2023-07-27T14:39:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad2e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad3014bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad2e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad3014bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45606/0 (socket says 172.21.15.115:45606) 2023-07-27T14:39:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.311+0000 7fad2e59c700 1 -- 172.21.15.115:0/390295087 learned_addr learned my addr 172.21.15.115:0/390295087 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2dd9b700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad300c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2ed9d700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad30150220 0x7fad300c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2e59c700 1 -- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 msgr2=0x7fad300c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2e59c700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad300c0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2e59c700 1 -- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad30150220 msgr2=0x7fad300c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2e59c700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad30150220 0x7fad300c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2e59c700 1 -- 172.21.15.115:0/390295087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad28009ae0 con 0x7fad30069040 2023-07-27T14:39:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2dd9b700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad300c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2ed9d700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad30150220 0x7fad300c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:39:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad2e59c700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad3014bf10 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 rx=0x7fad2000d890 tx=0x7fad20008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:57.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad1e7fc700 1 -- 172.21.15.115:0/390295087 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200125f0 con 0x7fad30069040 2023-07-27T14:39:57.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad1e7fc700 1 -- 172.21.15.115:0/390295087 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20012750 con 0x7fad30069040 2023-07-27T14:39:57.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad300be270 con 0x7fad30069040 2023-07-27T14:39:57.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad1e7fc700 1 -- 172.21.15.115:0/390295087 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20012ad0 con 0x7fad30069040 2023-07-27T14:39:57.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.312+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad300bd940 con 0x7fad30069040 2023-07-27T14:39:57.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.313+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3006c470 con 0x7fad30069040 2023-07-27T14:39:57.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.314+0000 7fad1e7fc700 1 -- 172.21.15.115:0/390295087 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fad20013480 con 0x7fad30069040 2023-07-27T14:39:57.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.315+0000 7fad1e7fc700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad1005fcc0 0x7fad10062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.315+0000 7fad1e7fc700 1 -- 172.21.15.115:0/390295087 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fad2007afc0 con 0x7fad30069040 2023-07-27T14:39:57.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.315+0000 7fad2dd9b700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad1005fcc0 0x7fad10062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.316+0000 7fad2dd9b700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad1005fcc0 0x7fad10062180 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fad24006fd0 tx=0x7fad24008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:57.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.319+0000 7fad1e7fc700 1 -- 172.21.15.115:0/390295087 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad2004b7f0 con 0x7fad30069040 2023-07-27T14:39:57.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.486+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fad300beba0 con 0x7fad30069040 2023-07-27T14:39:57.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.486+0000 7fad1e7fc700 1 -- 172.21.15.115:0/390295087 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v201) v1 ==== 110+0+10 (secure 0 0 0) 0x7fad2004ee10 con 0x7fad30069040 2023-07-27T14:39:57.542 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:39:57.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.488+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad1005fcc0 msgr2=0x7fad10062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.488+0000 7fad34dff700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad1005fcc0 0x7fad10062180 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fad24006fd0 tx=0x7fad24008040).stop 2023-07-27T14:39:57.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.488+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 msgr2=0x7fad3014bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.488+0000 7fad34dff700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad3014bf10 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 rx=0x7fad2000d890 tx=0x7fad20008040).stop 2023-07-27T14:39:57.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.488+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 shutdown_connections 2023-07-27T14:39:57.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.488+0000 7fad34dff700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fad1005fcc0 0x7fad10062180 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.489+0000 7fad34dff700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad30150220 0x7fad300c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.489+0000 7fad34dff700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad30069040 0x7fad3014bf10 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.489+0000 7fad34dff700 1 --2- 172.21.15.115:0/390295087 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad300c0ea0 0x7fad300c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.489+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 >> 172.21.15.115:0/390295087 conn(0x7fad30062320 msgr2=0x7fad300c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:57.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.489+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 shutdown_connections 2023-07-27T14:39:57.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.489+0000 7fad34dff700 1 -- 172.21.15.115:0/390295087 wait complete. 2023-07-27T14:39:57.561 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:39:57.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.697+0000 7fdb65bff700 1 Processor -- start 2023-07-27T14:39:57.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.697+0000 7fdb65bff700 1 -- start start 2023-07-27T14:39:57.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.698+0000 7fdb65bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdb6014ae00 0x7fdb60154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.698+0000 7fdb65bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb60063260 0x7fdb600a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.698+0000 7fdb65bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb601553f0 con 0x7fdb6014b1e0 2023-07-27T14:39:57.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.698+0000 7fdb65bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb60157a50 con 0x7fdb60063260 2023-07-27T14:39:57.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.698+0000 7fdb65bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb60157d10 con 0x7fdb6014ae00 2023-07-27T14:39:57.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdb6014b1e0 0x7fdb60062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50390/0 (socket says 172.21.15.115:50390) 2023-07-27T14:39:57.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5effd700 1 -- 172.21.15.115:0/717443748 learned_addr learned my addr 172.21.15.115:0/717443748 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:57.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5ffff700 1 --2- 172.21.15.115:0/717443748 >> v2:172.21.15.115:3300/0 conn(0x7fdb60063260 0x7fdb600a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5f7fe700 1 --2- 172.21.15.115:0/717443748 >> v2:172.21.15.159:3300/0 conn(0x7fdb6014ae00 0x7fdb60154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5e7fc700 1 -- 172.21.15.115:0/717443748 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219539479 0 0) 0x7fdb601553f0 con 0x7fdb6014b1e0 2023-07-27T14:39:57.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5e7fc700 1 -- 172.21.15.115:0/717443748 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb480033f0 con 0x7fdb6014b1e0 2023-07-27T14:39:57.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5ffff700 1 -- 172.21.15.115:0/717443748 >> v2:172.21.15.159:3300/0 conn(0x7fdb6014ae00 msgr2=0x7fdb60154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:57.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5ffff700 1 --2- 172.21.15.115:0/717443748 >> v2:172.21.15.159:3300/0 conn(0x7fdb6014ae00 0x7fdb60154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5ffff700 1 -- 172.21.15.115:0/717443748 >> v1:172.21.15.115:6789/0 conn(0x7fdb6014b1e0 legacy=0x7fdb60062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5ffff700 1 -- 172.21.15.115:0/717443748 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60157ff0 con 0x7fdb60063260 2023-07-27T14:39:57.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5f7fe700 1 --2- 172.21.15.115:0/717443748 >> v2:172.21.15.159:3300/0 conn(0x7fdb6014ae00 0x7fdb60154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:39:57.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.699+0000 7fdb5ffff700 1 --2- 172.21.15.115:0/717443748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb60063260 0x7fdb600a98c0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7fdb600caaf0 tx=0x7fdb58009780).ready entity=mon.0 client_cookie=b0229bbc9fb53bd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:57.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb5e7fc700 1 -- 172.21.15.115:0/717443748 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800e070 con 0x7fdb60063260 2023-07-27T14:39:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb5e7fc700 1 -- 172.21.15.115:0/717443748 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5800bab0 con 0x7fdb60063260 2023-07-27T14:39:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb5e7fc700 1 -- 172.21.15.115:0/717443748 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800be30 con 0x7fdb60063260 2023-07-27T14:39:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb65bff700 1 -- 172.21.15.115:0/717443748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb60063260 msgr2=0x7fdb600a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb65bff700 1 --2- 172.21.15.115:0/717443748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb60063260 0x7fdb600a98c0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7fdb600caaf0 tx=0x7fdb58009780).stop 2023-07-27T14:39:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb65bff700 1 -- 172.21.15.115:0/717443748 shutdown_connections 2023-07-27T14:39:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb65bff700 1 --2- 172.21.15.115:0/717443748 >> v2:172.21.15.159:3300/0 conn(0x7fdb6014ae00 0x7fdb60154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb65bff700 1 --2- 172.21.15.115:0/717443748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb60063260 0x7fdb600a98c0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb65bff700 1 -- 172.21.15.115:0/717443748 >> 172.21.15.115:0/717443748 conn(0x7fdb6005e940 msgr2=0x7fdb600cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:57.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb65bff700 1 -- 172.21.15.115:0/717443748 shutdown_connections 2023-07-27T14:39:57.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.700+0000 7fdb65bff700 1 -- 172.21.15.115:0/717443748 wait complete. 2023-07-27T14:39:57.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.702+0000 7fdb65bff700 1 Processor -- start 2023-07-27T14:39:57.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.702+0000 7fdb65bff700 1 -- start start 2023-07-27T14:39:57.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb65bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb60063260 0x7fdb60164810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb65bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb6014ae00 0x7fdb6014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb65bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb6014b1e0 0x7fdb60164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb65bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c3dc0 con 0x7fdb6014b1e0 2023-07-27T14:39:57.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb65bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb60164d00 con 0x7fdb60063260 2023-07-27T14:39:57.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb65bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c1cf0 con 0x7fdb6014ae00 2023-07-27T14:39:57.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb5ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb6014b1e0 0x7fdb60164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb5ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb6014b1e0 0x7fdb60164f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45620/0 (socket says 172.21.15.115:45620) 2023-07-27T14:39:57.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb5ffff700 1 -- 172.21.15.115:0/1832107600 learned_addr learned my addr 172.21.15.115:0/1832107600 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:57.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb5f7fe700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb60063260 0x7fdb60164810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb5effd700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb6014ae00 0x7fdb6014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.703+0000 7fdb5ffff700 1 -- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb6014ae00 msgr2=0x7fdb6014a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb5ffff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb6014ae00 0x7fdb6014a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb5ffff700 1 -- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb60063260 msgr2=0x7fdb60164810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb5ffff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb60063260 0x7fdb60164810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb5ffff700 1 -- 172.21.15.115:0/1832107600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500092a0 con 0x7fdb6014b1e0 2023-07-27T14:39:57.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb5effd700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb6014ae00 0x7fdb6014a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:39:57.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb5ffff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb6014b1e0 0x7fdb60164f60 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 rx=0x7fdb58011000 tx=0x7fdb6014eb20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:57.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb477fe700 1 -- 172.21.15.115:0/1832107600 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5801d630 con 0x7fdb6014b1e0 2023-07-27T14:39:57.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb477fe700 1 -- 172.21.15.115:0/1832107600 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5801d790 con 0x7fdb6014b1e0 2023-07-27T14:39:57.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58009a20 con 0x7fdb6014b1e0 2023-07-27T14:39:57.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb477fe700 1 -- 172.21.15.115:0/1832107600 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5801db30 con 0x7fdb6014b1e0 2023-07-27T14:39:57.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.704+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb600c1f90 con 0x7fdb6014b1e0 2023-07-27T14:39:57.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.705+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb600c2150 con 0x7fdb6014b1e0 2023-07-27T14:39:57.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.706+0000 7fdb477fe700 1 -- 172.21.15.115:0/1832107600 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fdb5801c380 con 0x7fdb6014b1e0 2023-07-27T14:39:57.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.707+0000 7fdb477fe700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb4c05fcc0 0x7fdb4c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:57.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.707+0000 7fdb477fe700 1 -- 172.21.15.115:0/1832107600 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fdb5807cff0 con 0x7fdb6014b1e0 2023-07-27T14:39:57.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.707+0000 7fdb5f7fe700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb4c05fcc0 0x7fdb4c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:57.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.707+0000 7fdb5f7fe700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb4c05fcc0 0x7fdb4c062180 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fdb50009270 tx=0x7fdb50008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:57.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.711+0000 7fdb477fe700 1 -- 172.21.15.115:0/1832107600 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb5804d930 con 0x7fdb6014b1e0 2023-07-27T14:39:57.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.881+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb6006c470 con 0x7fdb6014b1e0 2023-07-27T14:39:57.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.881+0000 7fdb477fe700 1 -- 172.21.15.115:0/1832107600 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v201) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb58050f50 con 0x7fdb6014b1e0 2023-07-27T14:39:57.937 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:39:57.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb4c05fcc0 msgr2=0x7fdb4c062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb4c05fcc0 0x7fdb4c062180 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fdb50009270 tx=0x7fdb50008040).stop 2023-07-27T14:39:57.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb6014b1e0 msgr2=0x7fdb60164f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:57.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb6014b1e0 0x7fdb60164f60 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 rx=0x7fdb58011000 tx=0x7fdb6014eb20).stop 2023-07-27T14:39:57.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 shutdown_connections 2023-07-27T14:39:57.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdb4c05fcc0 0x7fdb4c062180 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb6014b1e0 0x7fdb60164f60 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb60063260 0x7fdb60164810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 --2- 172.21.15.115:0/1832107600 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdb6014ae00 0x7fdb6014a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:57.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 >> 172.21.15.115:0/1832107600 conn(0x7fdb6005e940 msgr2=0x7fdb60152c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:57.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 shutdown_connections 2023-07-27T14:39:57.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:57.883+0000 7fdb65bff700 1 -- 172.21.15.115:0/1832107600 wait complete. 2023-07-27T14:39:57.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:39:58.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.090+0000 7f34de9ff700 1 Processor -- start 2023-07-27T14:39:58.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.090+0000 7f34de9ff700 1 -- start start 2023-07-27T14:39:58.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.092+0000 7f34de9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34d8150af0 0x7f34d8150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.092+0000 7f34de9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d80c0e80 0x7f34d80c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.092+0000 7f34de9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d806a440 con 0x7f34d80696f0 2023-07-27T14:39:58.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.092+0000 7f34de9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d80bbc80 con 0x7f34d8150af0 2023-07-27T14:39:58.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.092+0000 7f34de9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8069e80 con 0x7f34d80c0e80 2023-07-27T14:39:58.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.092+0000 7f34d7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34d8150af0 0x7f34d8150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.092+0000 7f34dcf9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f34d80696f0 0x7f34d80a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50392/0 (socket says 172.21.15.115:50392) 2023-07-27T14:39:58.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.092+0000 7f34dcf9c700 1 -- 172.21.15.115:0/3669179035 learned_addr learned my addr 172.21.15.115:0/3669179035 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:39:58.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d77fe700 1 --2- 172.21.15.115:0/3669179035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d80c0e80 0x7f34d80c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d7fff700 1 -- 172.21.15.115:0/3669179035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d80c0e80 msgr2=0x7f34d80c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:58.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d7fff700 1 --2- 172.21.15.115:0/3669179035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d80c0e80 0x7f34d80c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d7fff700 1 -- 172.21.15.115:0/3669179035 >> v1:172.21.15.115:6789/0 conn(0x7f34d80696f0 legacy=0x7f34d80a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d6ffd700 1 -- 172.21.15.115:0/3669179035 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248188560 0 0) 0x7f34d806a440 con 0x7f34d80696f0 2023-07-27T14:39:58.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d7fff700 1 -- 172.21.15.115:0/3669179035 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d806a160 con 0x7f34d8150af0 2023-07-27T14:39:58.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d7fff700 1 --2- 172.21.15.115:0/3669179035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d8150af0 0x7f34d8150ed0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 rx=0x7f34c8009760 tx=0x7f34c8009060).ready entity=mon.0 client_cookie=dded384e8a6627f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:58.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d6ffd700 1 -- 172.21.15.115:0/3669179035 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c800b580 con 0x7f34d8150af0 2023-07-27T14:39:58.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d6ffd700 1 -- 172.21.15.115:0/3669179035 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c800b6e0 con 0x7f34d8150af0 2023-07-27T14:39:58.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.093+0000 7f34d6ffd700 1 -- 172.21.15.115:0/3669179035 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c800ba60 con 0x7f34d8150af0 2023-07-27T14:39:58.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.094+0000 7f34de9ff700 1 -- 172.21.15.115:0/3669179035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d8150af0 msgr2=0x7f34d8150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.094+0000 7f34de9ff700 1 --2- 172.21.15.115:0/3669179035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d8150af0 0x7f34d8150ed0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 rx=0x7f34c8009760 tx=0x7f34c8009060).stop 2023-07-27T14:39:58.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.094+0000 7f34de9ff700 1 -- 172.21.15.115:0/3669179035 shutdown_connections 2023-07-27T14:39:58.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.094+0000 7f34de9ff700 1 --2- 172.21.15.115:0/3669179035 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d8150af0 0x7f34d8150ed0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.094+0000 7f34de9ff700 1 --2- 172.21.15.115:0/3669179035 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d80c0e80 0x7f34d80c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.094+0000 7f34de9ff700 1 -- 172.21.15.115:0/3669179035 >> 172.21.15.115:0/3669179035 conn(0x7f34d8062320 msgr2=0x7f34d8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:58.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.094+0000 7f34de9ff700 1 -- 172.21.15.115:0/3669179035 shutdown_connections 2023-07-27T14:39:58.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.094+0000 7f34de9ff700 1 -- 172.21.15.115:0/3669179035 wait complete. 2023-07-27T14:39:58.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.095+0000 7f34de9ff700 1 Processor -- start 2023-07-27T14:39:58.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.096+0000 7f34de9ff700 1 -- start start 2023-07-27T14:39:58.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.096+0000 7f34de9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34d80696f0 0x7f34d8139130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.096+0000 7f34de9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d80c0e80 0x7f34d80be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.096+0000 7f34de9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d8150af0 0x7f34d80bede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.096+0000 7f34de9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80c06b0 con 0x7f34d80c0e80 2023-07-27T14:39:58.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.096+0000 7f34de9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80bf460 con 0x7f34d80696f0 2023-07-27T14:39:58.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.096+0000 7f34de9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80bf740 con 0x7f34d8150af0 2023-07-27T14:39:58.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d80c0e80 0x7f34d80be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d80c0e80 0x7f34d80be8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45646/0 (socket says 172.21.15.115:45646) 2023-07-27T14:39:58.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 -- 172.21.15.115:0/1809793872 learned_addr learned my addr 172.21.15.115:0/1809793872 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:58.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d7fff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34d80696f0 0x7f34d8139130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34dcf9c700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d8150af0 0x7f34d80bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 -- 172.21.15.115:0/1809793872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d8150af0 msgr2=0x7f34d80bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d8150af0 0x7f34d80bede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 -- 172.21.15.115:0/1809793872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34d80696f0 msgr2=0x7f34d8139130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34d80696f0 0x7f34d8139130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 -- 172.21.15.115:0/1809793872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80092a0 con 0x7f34d80c0e80 2023-07-27T14:39:58.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.097+0000 7f34d77fe700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d80c0e80 0x7f34d80be8f0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 rx=0x7f34cc00d860 tx=0x7f34cc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:58.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.098+0000 7f34bffff700 1 -- 172.21.15.115:0/1809793872 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc011590 con 0x7f34d80c0e80 2023-07-27T14:39:58.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.098+0000 7f34bffff700 1 -- 172.21.15.115:0/1809793872 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc0116f0 con 0x7f34d80c0e80 2023-07-27T14:39:58.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.098+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d8165770 con 0x7f34d80c0e80 2023-07-27T14:39:58.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.098+0000 7f34bffff700 1 -- 172.21.15.115:0/1809793872 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc011a70 con 0x7f34d80c0e80 2023-07-27T14:39:58.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.098+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d8165d30 con 0x7f34d80c0e80 2023-07-27T14:39:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.099+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d81660a0 con 0x7f34d80c0e80 2023-07-27T14:39:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.100+0000 7f34bffff700 1 -- 172.21.15.115:0/1809793872 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f34cc012420 con 0x7f34d80c0e80 2023-07-27T14:39:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.100+0000 7f34bffff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34c405fc90 0x7f34c4062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.100+0000 7f34bffff700 1 -- 172.21.15.115:0/1809793872 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f34cc07aa50 con 0x7f34d80c0e80 2023-07-27T14:39:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.101+0000 7f34d7fff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34c405fc90 0x7f34c4062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.101+0000 7f34d7fff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34c405fc90 0x7f34c4062150 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f34c800b340 tx=0x7f34c8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:58.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.104+0000 7f34bffff700 1 -- 172.21.15.115:0/1809793872 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f34cc04b390 con 0x7f34d80c0e80 2023-07-27T14:39:58.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.277+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f34d806c470 con 0x7f34d80c0e80 2023-07-27T14:39:58.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.277+0000 7f34bffff700 1 -- 172.21.15.115:0/1809793872 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v201) v1 ==== 84+0+143 (secure 0 0 0) 0x7f34cc04e9b0 con 0x7f34d80c0e80 2023-07-27T14:39:58.334 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:39:58.334 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:39:58.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:58.335 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:39:58.335 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:39:58.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:39:58.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:39:58.336 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:39:58.336 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:39:58.336 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:39:58.337 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:39:58.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.279+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34c405fc90 msgr2=0x7f34c4062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.279+0000 7f34de9ff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34c405fc90 0x7f34c4062150 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f34c800b340 tx=0x7f34c8017000).stop 2023-07-27T14:39:58.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.279+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d80c0e80 msgr2=0x7f34d80be8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.279+0000 7f34de9ff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d80c0e80 0x7f34d80be8f0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 rx=0x7f34cc00d860 tx=0x7f34cc008040).stop 2023-07-27T14:39:58.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.280+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 shutdown_connections 2023-07-27T14:39:58.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.280+0000 7f34de9ff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f34c405fc90 0x7f34c4062150 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.280+0000 7f34de9ff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34d8150af0 0x7f34d80bede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.280+0000 7f34de9ff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34d80696f0 0x7f34d8139130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.280+0000 7f34de9ff700 1 --2- 172.21.15.115:0/1809793872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34d80c0e80 0x7f34d80be8f0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.280+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 >> 172.21.15.115:0/1809793872 conn(0x7f34d8062320 msgr2=0x7f34d814bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:58.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.280+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 shutdown_connections 2023-07-27T14:39:58.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.280+0000 7f34de9ff700 1 -- 172.21.15.115:0/1809793872 wait complete. 2023-07-27T14:39:58.352 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:39:58.353 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:39:58.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.489+0000 7f110c3ff700 1 Processor -- start 2023-07-27T14:39:58.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.489+0000 7f110c3ff700 1 -- start start 2023-07-27T14:39:58.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.490+0000 7f110c3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f110414ae00 0x7f1104154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.490+0000 7f110c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414b1e0 0x7f1104062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.490+0000 7f110c3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f11040c5c50 0x7f1104063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.490+0000 7f110c3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1104063530 con 0x7f110414ae00 2023-07-27T14:39:58.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.490+0000 7f110c3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11041553f0 con 0x7f11040c5c50 2023-07-27T14:39:58.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.490+0000 7f110c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1104157a50 con 0x7f110414b1e0 2023-07-27T14:39:58.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f110414ae00 0x7f1104154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f110414ae00 0x7f1104154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45660/0 (socket says 172.21.15.115:45660) 2023-07-27T14:39:58.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 -- 172.21.15.115:0/111285074 learned_addr learned my addr 172.21.15.115:0/111285074 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:58.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110999a700 1 --2- 172.21.15.115:0/111285074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414b1e0 0x7f1104062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a99c700 1 --2- 172.21.15.115:0/111285074 >> v2:172.21.15.159:3300/0 conn(0x7f11040c5c50 0x7f1104063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 -- 172.21.15.115:0/111285074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414b1e0 msgr2=0x7f1104062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:58.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 --2- 172.21.15.115:0/111285074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414b1e0 0x7f1104062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 -- 172.21.15.115:0/111285074 >> v2:172.21.15.159:3300/0 conn(0x7f11040c5c50 msgr2=0x7f1104063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:58.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 --2- 172.21.15.115:0/111285074 >> v2:172.21.15.159:3300/0 conn(0x7f11040c5c50 0x7f1104063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 -- 172.21.15.115:0/111285074 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104157d10 con 0x7f110414ae00 2023-07-27T14:39:58.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f110a19b700 1 --2- 172.21.15.115:0/111285074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414ae00 0x7f1104154f00 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 rx=0x7f1104084190 tx=0x7f11000090f0).ready entity=mon.0 client_cookie=320e0f7029f77d04 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:58.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f1109199700 1 -- 172.21.15.115:0/111285074 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000b600 con 0x7f110414ae00 2023-07-27T14:39:58.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f1109199700 1 -- 172.21.15.115:0/111285074 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110000b760 con 0x7f110414ae00 2023-07-27T14:39:58.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.491+0000 7f1109199700 1 -- 172.21.15.115:0/111285074 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000bae0 con 0x7f110414ae00 2023-07-27T14:39:58.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 -- 172.21.15.115:0/111285074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414ae00 msgr2=0x7f1104154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 --2- 172.21.15.115:0/111285074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414ae00 0x7f1104154f00 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 rx=0x7f1104084190 tx=0x7f11000090f0).stop 2023-07-27T14:39:58.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 -- 172.21.15.115:0/111285074 shutdown_connections 2023-07-27T14:39:58.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 --2- 172.21.15.115:0/111285074 >> v2:172.21.15.159:3300/0 conn(0x7f11040c5c50 0x7f1104063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 --2- 172.21.15.115:0/111285074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414ae00 0x7f1104154f00 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 --2- 172.21.15.115:0/111285074 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414b1e0 0x7f1104062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 -- 172.21.15.115:0/111285074 >> 172.21.15.115:0/111285074 conn(0x7f110405e940 msgr2=0x7f11040cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:58.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 -- 172.21.15.115:0/111285074 shutdown_connections 2023-07-27T14:39:58.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.492+0000 7f110c3ff700 1 -- 172.21.15.115:0/111285074 wait complete. 2023-07-27T14:39:58.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.494+0000 7f110c3ff700 1 Processor -- start 2023-07-27T14:39:58.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.494+0000 7f110c3ff700 1 -- start start 2023-07-27T14:39:58.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110c3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11040c5c50 0x7f11040c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110c3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414ae00 0x7f1104153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110c3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414b1e0 0x7f11040c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110c3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11041642e0 con 0x7f110414b1e0 2023-07-27T14:39:58.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110c3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1104153f70 con 0x7f11040c5c50 2023-07-27T14:39:58.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110c3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11040c36c0 con 0x7f110414ae00 2023-07-27T14:39:58.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414b1e0 0x7f11040c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414b1e0 0x7f11040c25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45670/0 (socket says 172.21.15.115:45670) 2023-07-27T14:39:58.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a99c700 1 -- 172.21.15.115:0/2995353611 learned_addr learned my addr 172.21.15.115:0/2995353611 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:58.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110999a700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414ae00 0x7f1104153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a19b700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11040c5c50 0x7f11040c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a99c700 1 -- 172.21.15.115:0/2995353611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414ae00 msgr2=0x7f1104153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a99c700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414ae00 0x7f1104153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a99c700 1 -- 172.21.15.115:0/2995353611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11040c5c50 msgr2=0x7f11040c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:58.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a99c700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11040c5c50 0x7f11040c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:58.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.495+0000 7f110a99c700 1 -- 172.21.15.115:0/2995353611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100009370 con 0x7f110414b1e0 2023-07-27T14:39:58.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.496+0000 7f110a99c700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414b1e0 0x7f11040c25b0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 rx=0x7f10fc007f20 tx=0x7f10fc009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:58.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.496+0000 7f10fa7fc700 1 -- 172.21.15.115:0/2995353611 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00eb90 con 0x7f110414b1e0 2023-07-27T14:39:58.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.496+0000 7f10fa7fc700 1 -- 172.21.15.115:0/2995353611 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc00ecf0 con 0x7f110414b1e0 2023-07-27T14:39:58.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.496+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1104164560 con 0x7f110414b1e0 2023-07-27T14:39:58.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.496+0000 7f10fa7fc700 1 -- 172.21.15.115:0/2995353611 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc014610 con 0x7f110414b1e0 2023-07-27T14:39:58.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.496+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11040c3100 con 0x7f110414b1e0 2023-07-27T14:39:58.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.497+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11040bff50 con 0x7f110414b1e0 2023-07-27T14:39:58.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.498+0000 7f10fa7fc700 1 -- 172.21.15.115:0/2995353611 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f10fc01b030 con 0x7f110414b1e0 2023-07-27T14:39:58.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.498+0000 7f10fa7fc700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10e805fcc0 0x7f10e8062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:58.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.499+0000 7f10fa7fc700 1 -- 172.21.15.115:0/2995353611 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f10fc07b360 con 0x7f110414b1e0 2023-07-27T14:39:58.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.499+0000 7f110a19b700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10e805fcc0 0x7f10e8062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:58.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.499+0000 7f110a19b700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10e805fcc0 0x7f10e8062180 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f1100009130 tx=0x7f1100017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:58.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.503+0000 7f10fa7fc700 1 -- 172.21.15.115:0/2995353611 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10fc04bbf0 con 0x7f110414b1e0 2023-07-27T14:39:58.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.672+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f11041646f0 con 0x7f110414b1e0 2023-07-27T14:39:58.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.942+0000 7f10fa7fc700 1 -- 172.21.15.115:0/2995353611 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v202) v1 ==== 152+0+0 (secure 0 0 0) 0x7f10fc00ee60 con 0x7f110414b1e0 2023-07-27T14:39:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10e805fcc0 msgr2=0x7f10e8062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10e805fcc0 0x7f10e8062180 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f1100009130 tx=0x7f1100017000).stop 2023-07-27T14:39:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414b1e0 msgr2=0x7f11040c25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:59.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414b1e0 0x7f11040c25b0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 rx=0x7f10fc007f20 tx=0x7f10fc009860).stop 2023-07-27T14:39:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 shutdown_connections 2023-07-27T14:39:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f10e805fcc0 0x7f10e8062180 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f110414b1e0 0x7f11040c25b0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11040c5c50 0x7f11040c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 --2- 172.21.15.115:0/2995353611 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f110414ae00 0x7f1104153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.946+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 >> 172.21.15.115:0/2995353611 conn(0x7f110405e940 msgr2=0x7f110414a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:59.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.949+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 shutdown_connections 2023-07-27T14:39:59.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:58.949+0000 7f110c3ff700 1 -- 172.21.15.115:0/2995353611 wait complete. 2023-07-27T14:39:59.008 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:39:59.025 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:39:59.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.163+0000 7f8a3b7ff700 1 Processor -- start 2023-07-27T14:39:59.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.163+0000 7f8a3b7ff700 1 -- start start 2023-07-27T14:39:59.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.164+0000 7f8a3b7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8a34157400 0x7f8a340c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:59.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.164+0000 7f8a3b7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:59.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.164+0000 7f8a3b7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a340c7ad0 con 0x7f8a340a7940 2023-07-27T14:39:59.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.164+0000 7f8a3b7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a340c5590 con 0x7f8a34157400 2023-07-27T14:39:59.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.164+0000 7f8a3b7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340c0fb0 con 0x7f8a340c7550 2023-07-27T14:39:59.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.165+0000 7f8a39d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.165+0000 7f8a3959b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8a34157400 0x7f8a340c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.165+0000 7f8a39d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:52734/0 (socket says 172.21.15.115:52734) 2023-07-27T14:39:59.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.165+0000 7f8a39d9c700 1 -- 172.21.15.115:0/2693139059 learned_addr learned my addr 172.21.15.115:0/2693139059 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.165+0000 7f8a38d9a700 1 --1- 172.21.15.115:0/2693139059 >> v1:172.21.15.159:6789/0 conn(0x7f8a340a7940 0x7f8a340c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:39788/0 (socket says 172.21.15.115:39788) 2023-07-27T14:39:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.165+0000 7f8a39d9c700 1 -- 172.21.15.115:0/2693139059 >> v2:172.21.15.159:3300/0 conn(0x7f8a34157400 msgr2=0x7f8a340c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:39:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.165+0000 7f8a39d9c700 1 --2- 172.21.15.115:0/2693139059 >> v2:172.21.15.159:3300/0 conn(0x7f8a34157400 0x7f8a340c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.166+0000 7f8a39d9c700 1 -- 172.21.15.115:0/2693139059 >> v1:172.21.15.159:6789/0 conn(0x7f8a340a7940 legacy=0x7f8a340c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.166+0000 7f8a39d9c700 1 -- 172.21.15.115:0/2693139059 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a340c7db0 con 0x7f8a340c7550 2023-07-27T14:39:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.166+0000 7f8a39d9c700 1 --2- 172.21.15.115:0/2693139059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c0ac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f8a2c009f20 tx=0x7f8a2c009840).ready entity=mon.2 client_cookie=fe2a6bf4ad856aab server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.166+0000 7f8a2bfff700 1 -- 172.21.15.115:0/2693139059 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00e070 con 0x7f8a340c7550 2023-07-27T14:39:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.166+0000 7f8a2bfff700 1 -- 172.21.15.115:0/2693139059 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00b9d0 con 0x7f8a340c7550 2023-07-27T14:39:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.166+0000 7f8a2bfff700 1 -- 172.21.15.115:0/2693139059 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00bd50 con 0x7f8a340c7550 2023-07-27T14:39:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.167+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/2693139059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 msgr2=0x7f8a340c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.167+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/2693139059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c0ac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f8a2c009f20 tx=0x7f8a2c009840).stop 2023-07-27T14:39:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.167+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/2693139059 shutdown_connections 2023-07-27T14:39:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.167+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/2693139059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c0ac0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.167+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/2693139059 >> v2:172.21.15.159:3300/0 conn(0x7f8a34157400 0x7f8a340c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.167+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/2693139059 >> 172.21.15.115:0/2693139059 conn(0x7f8a34094280 msgr2=0x7f8a3405e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:39:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.167+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/2693139059 shutdown_connections 2023-07-27T14:39:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.167+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/2693139059 wait complete. 2023-07-27T14:39:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.169+0000 7f8a3b7ff700 1 Processor -- start 2023-07-27T14:39:59.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.169+0000 7f8a3b7ff700 1 -- start start 2023-07-27T14:39:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.170+0000 7f8a3b7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a340a7940 0x7f8a34148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.170+0000 7f8a3b7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.170+0000 7f8a3b7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34157400 0x7f8a340a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.170+0000 7f8a3b7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340ca740 con 0x7f8a34157400 2023-07-27T14:39:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.170+0000 7f8a3b7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340c8960 con 0x7f8a340a7940 2023-07-27T14:39:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.170+0000 7f8a3b7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340c8c40 con 0x7f8a340c7550 2023-07-27T14:39:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34157400 0x7f8a340a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34157400 0x7f8a340a7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45682/0 (socket says 172.21.15.115:45682) 2023-07-27T14:39:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 -- 172.21.15.115:0/3371118553 learned_addr learned my addr 172.21.15.115:0/3371118553 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:39:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a38d9a700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a3959b700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a340a7940 0x7f8a34148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 -- 172.21.15.115:0/3371118553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 msgr2=0x7f8a340c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 -- 172.21.15.115:0/3371118553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a340a7940 msgr2=0x7f8a34148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:39:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a340a7940 0x7f8a34148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:39:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 -- 172.21.15.115:0/3371118553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c009ae0 con 0x7f8a34157400 2023-07-27T14:39:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a39d9c700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34157400 0x7f8a340a7d80 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 rx=0x7f8a2c00b610 tx=0x7f8a2c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a297fa700 1 -- 172.21.15.115:0/3371118553 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00b640 con 0x7f8a34157400 2023-07-27T14:39:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a297fa700 1 -- 172.21.15.115:0/3371118553 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c0092e0 con 0x7f8a34157400 2023-07-27T14:39:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.171+0000 7f8a297fa700 1 -- 172.21.15.115:0/3371118553 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c01e6a0 con 0x7f8a34157400 2023-07-27T14:39:59.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.172+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a340c8f20 con 0x7f8a34157400 2023-07-27T14:39:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.172+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a34148d40 con 0x7f8a34157400 2023-07-27T14:39:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.173+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a340c9440 con 0x7f8a34157400 2023-07-27T14:39:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.174+0000 7f8a297fa700 1 -- 172.21.15.115:0/3371118553 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f8a2c025030 con 0x7f8a34157400 2023-07-27T14:39:59.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.176+0000 7f8a297fa700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8a1805fcc0 0x7f8a18062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:39:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.176+0000 7f8a297fa700 1 -- 172.21.15.115:0/3371118553 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5667+0+0 (secure 0 0 0) 0x7f8a2c07ca40 con 0x7f8a34157400 2023-07-27T14:39:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.176+0000 7f8a3959b700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8a1805fcc0 0x7f8a18062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:39:59.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.177+0000 7f8a3959b700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8a1805fcc0 0x7f8a18062180 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f8a30009c30 tx=0x7f8a30009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:39:59.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.180+0000 7f8a297fa700 1 -- 172.21.15.115:0/3371118553 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a2c04d1e0 con 0x7f8a34157400 2023-07-27T14:39:59.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.349+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8a340c9440 con 0x7f8a34157400 2023-07-27T14:40:00.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.950+0000 7f8a297fa700 1 -- 172.21.15.115:0/3371118553 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v203) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8a340c9440 con 0x7f8a34157400 2023-07-27T14:40:00.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.956+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8a1805fcc0 msgr2=0x7f8a18062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.956+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8a1805fcc0 0x7f8a18062180 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f8a30009c30 tx=0x7f8a30009060).stop 2023-07-27T14:40:00.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.956+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34157400 msgr2=0x7f8a340a7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.957+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34157400 0x7f8a340a7d80 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 rx=0x7f8a2c00b610 tx=0x7f8a2c009840).stop 2023-07-27T14:40:00.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.957+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 shutdown_connections 2023-07-27T14:40:00.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.957+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8a1805fcc0 0x7f8a18062180 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.957+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a34157400 0x7f8a340a7d80 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.957+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a340a7940 0x7f8a34148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.957+0000 7f8a3b7ff700 1 --2- 172.21.15.115:0/3371118553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a340c7550 0x7f8a340c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.957+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 >> 172.21.15.115:0/3371118553 conn(0x7f8a34094280 msgr2=0x7f8a34063960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.959+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 shutdown_connections 2023-07-27T14:40:00.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:39:59.960+0000 7f8a3b7ff700 1 -- 172.21.15.115:0/3371118553 wait complete. 2023-07-27T14:40:00.026 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:40:00.044 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:40:00.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.182+0000 7fd3865ff700 1 Processor -- start 2023-07-27T14:40:00.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.183+0000 7fd3865ff700 1 -- start start 2023-07-27T14:40:00.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.184+0000 7fd3865ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd3801509b0 0x7fd3800c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.184+0000 7fd3865ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd380150d90 0x7fd380154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.184+0000 7fd3865ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3800c0ea0 con 0x7fd3800c3100 2023-07-27T14:40:00.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.184+0000 7fd3865ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd380068e10 con 0x7fd380150d90 2023-07-27T14:40:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.184+0000 7fd3865ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd380155190 con 0x7fd3801509b0 2023-07-27T14:40:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.184+0000 7fd37f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd380150d90 0x7fd380154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.184+0000 7fd37f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd380150d90 0x7fd380154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45694/0 (socket says 172.21.15.115:45694) 2023-07-27T14:40:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.184+0000 7fd37f7fe700 1 -- 172.21.15.115:0/3407178692 learned_addr learned my addr 172.21.15.115:0/3407178692 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37ffff700 1 --2- 172.21.15.115:0/3407178692 >> v2:172.21.15.159:3300/0 conn(0x7fd3801509b0 0x7fd3800c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37f7fe700 1 -- 172.21.15.115:0/3407178692 >> v2:172.21.15.159:3300/0 conn(0x7fd3801509b0 msgr2=0x7fd3800c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37f7fe700 1 --2- 172.21.15.115:0/3407178692 >> v2:172.21.15.159:3300/0 conn(0x7fd3801509b0 0x7fd3800c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37f7fe700 1 -- 172.21.15.115:0/3407178692 >> v1:172.21.15.159:6789/0 conn(0x7fd3800c3100 legacy=0x7fd3800c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37f7fe700 1 -- 172.21.15.115:0/3407178692 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380155470 con 0x7fd380150d90 2023-07-27T14:40:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37f7fe700 1 --2- 172.21.15.115:0/3407178692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd380154940 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 rx=0x7fd380067850 tx=0x7fd3740090f0).ready entity=mon.0 client_cookie=3282ba897f3eff5b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37effd700 1 -- 172.21.15.115:0/3407178692 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37400b520 con 0x7fd380150d90 2023-07-27T14:40:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37effd700 1 -- 172.21.15.115:0/3407178692 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37400b680 con 0x7fd380150d90 2023-07-27T14:40:00.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.185+0000 7fd37effd700 1 -- 172.21.15.115:0/3407178692 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37400ba00 con 0x7fd380150d90 2023-07-27T14:40:00.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.186+0000 7fd3865ff700 1 -- 172.21.15.115:0/3407178692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 msgr2=0x7fd380154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.186+0000 7fd3865ff700 1 --2- 172.21.15.115:0/3407178692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd380154940 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 rx=0x7fd380067850 tx=0x7fd3740090f0).stop 2023-07-27T14:40:00.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.186+0000 7fd3865ff700 1 -- 172.21.15.115:0/3407178692 shutdown_connections 2023-07-27T14:40:00.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.186+0000 7fd3865ff700 1 --2- 172.21.15.115:0/3407178692 >> v2:172.21.15.159:3300/0 conn(0x7fd3801509b0 0x7fd3800c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.186+0000 7fd3865ff700 1 --2- 172.21.15.115:0/3407178692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd380154940 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.186+0000 7fd3865ff700 1 -- 172.21.15.115:0/3407178692 >> 172.21.15.115:0/3407178692 conn(0x7fd380062320 msgr2=0x7fd380062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:00.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.186+0000 7fd3865ff700 1 -- 172.21.15.115:0/3407178692 shutdown_connections 2023-07-27T14:40:00.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.186+0000 7fd3865ff700 1 -- 172.21.15.115:0/3407178692 wait complete. 2023-07-27T14:40:00.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.188+0000 7fd3865ff700 1 Processor -- start 2023-07-27T14:40:00.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.188+0000 7fd3865ff700 1 -- start start 2023-07-27T14:40:00.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd3865ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800c3100 0x7fd380142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd3865ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3801509b0 0x7fd3800a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd3865ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd3800a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd3865ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800a85f0 con 0x7fd380150d90 2023-07-27T14:40:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd3865ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800a88d0 con 0x7fd3800c3100 2023-07-27T14:40:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd3865ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800a8bb0 con 0x7fd3801509b0 2023-07-27T14:40:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd384b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd3800a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd384b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd3800a7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45704/0 (socket says 172.21.15.115:45704) 2023-07-27T14:40:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd384b9c700 1 -- 172.21.15.115:0/70981504 learned_addr learned my addr 172.21.15.115:0/70981504 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd37ffff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800c3100 0x7fd380142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd37f7fe700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3801509b0 0x7fd3800a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd384b9c700 1 -- 172.21.15.115:0/70981504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3801509b0 msgr2=0x7fd3800a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd384b9c700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3801509b0 0x7fd3800a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd384b9c700 1 -- 172.21.15.115:0/70981504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800c3100 msgr2=0x7fd380142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd384b9c700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800c3100 0x7fd380142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.189+0000 7fd384b9c700 1 -- 172.21.15.115:0/70981504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd374009370 con 0x7fd380150d90 2023-07-27T14:40:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.190+0000 7fd384b9c700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd3800a7f60 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 rx=0x7fd378002230 tx=0x7fd3780015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.190+0000 7fd367fff700 1 -- 172.21.15.115:0/70981504 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800e4a0 con 0x7fd380150d90 2023-07-27T14:40:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.190+0000 7fd367fff700 1 -- 172.21.15.115:0/70981504 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37800e600 con 0x7fd380150d90 2023-07-27T14:40:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.190+0000 7fd367fff700 1 -- 172.21.15.115:0/70981504 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800e980 con 0x7fd380150d90 2023-07-27T14:40:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.190+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3800a8e90 con 0x7fd380150d90 2023-07-27T14:40:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.190+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3800bbb40 con 0x7fd380150d90 2023-07-27T14:40:00.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.191+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38006c470 con 0x7fd380150d90 2023-07-27T14:40:00.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.192+0000 7fd367fff700 1 -- 172.21.15.115:0/70981504 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fd378019030 con 0x7fd380150d90 2023-07-27T14:40:00.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.193+0000 7fd367fff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd36c05fcc0 0x7fd36c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.193+0000 7fd367fff700 1 -- 172.21.15.115:0/70981504 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fd37807a870 con 0x7fd380150d90 2023-07-27T14:40:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.193+0000 7fd37ffff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd36c05fcc0 0x7fd36c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.194+0000 7fd37ffff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd36c05fcc0 0x7fd36c062180 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fd370009c30 tx=0x7fd370009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.197+0000 7fd367fff700 1 -- 172.21.15.115:0/70981504 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3780488f0 con 0x7fd380150d90 2023-07-27T14:40:00.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.406+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd380155750 con 0x7fd380150d90 2023-07-27T14:40:00.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.415+0000 7fd367fff700 1 -- 172.21.15.115:0/70981504 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v108) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd37804aec0 con 0x7fd380150d90 2023-07-27T14:40:00.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.423+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd36c05fcc0 msgr2=0x7fd36c062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.423+0000 7fd3865ff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd36c05fcc0 0x7fd36c062180 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fd370009c30 tx=0x7fd370009060).stop 2023-07-27T14:40:00.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.423+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 msgr2=0x7fd3800a7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.424+0000 7fd3865ff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd3800a7f60 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 rx=0x7fd378002230 tx=0x7fd3780015e0).stop 2023-07-27T14:40:00.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.425+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 shutdown_connections 2023-07-27T14:40:00.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.425+0000 7fd3865ff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd36c05fcc0 0x7fd36c062180 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.425+0000 7fd3865ff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd380150d90 0x7fd3800a7f60 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.425+0000 7fd3865ff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3800c3100 0x7fd380142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.425+0000 7fd3865ff700 1 --2- 172.21.15.115:0/70981504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd3801509b0 0x7fd3800a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.425+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 >> 172.21.15.115:0/70981504 conn(0x7fd380062320 msgr2=0x7fd380063da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:00.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.426+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 shutdown_connections 2023-07-27T14:40:00.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.428+0000 7fd3865ff700 1 -- 172.21.15.115:0/70981504 wait complete. 2023-07-27T14:40:00.486 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 28 and data pool 29 2023-07-27T14:40:00.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:40:00.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.642+0000 7fb4029ff700 1 Processor -- start 2023-07-27T14:40:00.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.642+0000 7fb4029ff700 1 -- start start 2023-07-27T14:40:00.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.643+0000 7fb4029ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3fc0aaa40 0x7fb3fc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.643+0000 7fb4029ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb3fc1542a0 0x7fb3fc0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.643+0000 7fb4029ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3fc0aa4d0 con 0x7fb3fc153ec0 2023-07-27T14:40:00.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.643+0000 7fb4029ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3fc064ad0 con 0x7fb3fc0aaa40 2023-07-27T14:40:00.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.643+0000 7fb4029ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3fc0c05c0 con 0x7fb3fc1542a0 2023-07-27T14:40:00.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb3fb7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3fc0aaa40 0x7fb3fc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb3fb7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3fc0aaa40 0x7fb3fc0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45708/0 (socket says 172.21.15.115:45708) 2023-07-27T14:40:00.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb3fb7fe700 1 -- 172.21.15.115:0/1625007130 learned_addr learned my addr 172.21.15.115:0/1625007130 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:00.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb400f9c700 1 --2- 172.21.15.115:0/1625007130 >> v2:172.21.15.159:3300/0 conn(0x7fb3fc1542a0 0x7fb3fc0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb3fb7fe700 1 -- 172.21.15.115:0/1625007130 >> v2:172.21.15.159:3300/0 conn(0x7fb3fc1542a0 msgr2=0x7fb3fc0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:00.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb3fb7fe700 1 --2- 172.21.15.115:0/1625007130 >> v2:172.21.15.159:3300/0 conn(0x7fb3fc1542a0 0x7fb3fc0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb3fb7fe700 1 -- 172.21.15.115:0/1625007130 >> v1:172.21.15.159:6789/0 conn(0x7fb3fc153ec0 legacy=0x7fb3fc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb3fb7fe700 1 -- 172.21.15.115:0/1625007130 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc0c1a60 con 0x7fb3fc0aaa40 2023-07-27T14:40:00.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.644+0000 7fb3fb7fe700 1 --2- 172.21.15.115:0/1625007130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc0aaa40 0x7fb3fc0640f0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 rx=0x7fb3fc0c5470 tx=0x7fb3f00090f0).ready entity=mon.0 client_cookie=d5190828e86cc1ed server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb3faffd700 1 -- 172.21.15.115:0/1625007130 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000b520 con 0x7fb3fc0aaa40 2023-07-27T14:40:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb3faffd700 1 -- 172.21.15.115:0/1625007130 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f000b680 con 0x7fb3fc0aaa40 2023-07-27T14:40:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb3faffd700 1 -- 172.21.15.115:0/1625007130 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000ba00 con 0x7fb3fc0aaa40 2023-07-27T14:40:00.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb4029ff700 1 -- 172.21.15.115:0/1625007130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc0aaa40 msgr2=0x7fb3fc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb4029ff700 1 --2- 172.21.15.115:0/1625007130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc0aaa40 0x7fb3fc0640f0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 rx=0x7fb3fc0c5470 tx=0x7fb3f00090f0).stop 2023-07-27T14:40:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb4029ff700 1 -- 172.21.15.115:0/1625007130 shutdown_connections 2023-07-27T14:40:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb4029ff700 1 --2- 172.21.15.115:0/1625007130 >> v2:172.21.15.159:3300/0 conn(0x7fb3fc1542a0 0x7fb3fc0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb4029ff700 1 --2- 172.21.15.115:0/1625007130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc0aaa40 0x7fb3fc0640f0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb4029ff700 1 -- 172.21.15.115:0/1625007130 >> 172.21.15.115:0/1625007130 conn(0x7fb3fc0cb610 msgr2=0x7fb3fc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:00.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb4029ff700 1 -- 172.21.15.115:0/1625007130 shutdown_connections 2023-07-27T14:40:00.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.645+0000 7fb4029ff700 1 -- 172.21.15.115:0/1625007130 wait complete. 2023-07-27T14:40:00.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.647+0000 7fb4029ff700 1 Processor -- start 2023-07-27T14:40:00.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.647+0000 7fb4029ff700 1 -- start start 2023-07-27T14:40:00.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb4029ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3fc0aaa40 0x7fb3fc141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb4029ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3fc153ec0 0x7fb3fc0c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb4029ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc1542a0 0x7fb3fc0ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb4029ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc14da20 con 0x7fb3fc1542a0 2023-07-27T14:40:00.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb4029ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc141d60 con 0x7fb3fc153ec0 2023-07-27T14:40:00.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb4029ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc14ef60 con 0x7fb3fc0aaa40 2023-07-27T14:40:00.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb400f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc1542a0 0x7fb3fc0ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb400f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc1542a0 0x7fb3fc0ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45724/0 (socket says 172.21.15.115:45724) 2023-07-27T14:40:00.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb400f9c700 1 -- 172.21.15.115:0/772328027 learned_addr learned my addr 172.21.15.115:0/772328027 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:00.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb3fb7fe700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3fc153ec0 0x7fb3fc0c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb400f9c700 1 -- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3fc0aaa40 msgr2=0x7fb3fc141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb3fbfff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3fc0aaa40 0x7fb3fc141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb400f9c700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3fc0aaa40 0x7fb3fc141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb400f9c700 1 -- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3fc153ec0 msgr2=0x7fb3fc0c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb400f9c700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3fc153ec0 0x7fb3fc0c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb400f9c700 1 -- 172.21.15.115:0/772328027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0009370 con 0x7fb3fc1542a0 2023-07-27T14:40:00.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb3fb7fe700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3fc153ec0 0x7fb3fc0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:00.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.648+0000 7fb3fbfff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3fc0aaa40 0x7fb3fc141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:00.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.649+0000 7fb400f9c700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc1542a0 0x7fb3fc0ab340 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 rx=0x7fb3f4009d70 tx=0x7fb3f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:00.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.649+0000 7fb3e3fff700 1 -- 172.21.15.115:0/772328027 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400caf0 con 0x7fb3fc1542a0 2023-07-27T14:40:00.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.649+0000 7fb3e3fff700 1 -- 172.21.15.115:0/772328027 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f400f040 con 0x7fb3fc1542a0 2023-07-27T14:40:00.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.649+0000 7fb3e3fff700 1 -- 172.21.15.115:0/772328027 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400ce60 con 0x7fb3fc1542a0 2023-07-27T14:40:00.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.649+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3fc14e350 con 0x7fb3fc1542a0 2023-07-27T14:40:00.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.649+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc14e910 con 0x7fb3fc1542a0 2023-07-27T14:40:00.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.650+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3fc06c470 con 0x7fb3fc1542a0 2023-07-27T14:40:00.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.651+0000 7fb3e3fff700 1 -- 172.21.15.115:0/772328027 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fb3f4013610 con 0x7fb3fc1542a0 2023-07-27T14:40:00.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.652+0000 7fb3e3fff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3e805fcc0 0x7fb3e8062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:00.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.652+0000 7fb3e3fff700 1 -- 172.21.15.115:0/772328027 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb3f407bd20 con 0x7fb3fc1542a0 2023-07-27T14:40:00.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.652+0000 7fb3fbfff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3e805fcc0 0x7fb3e8062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:00.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.652+0000 7fb3fbfff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3e805fcc0 0x7fb3e8062180 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fb3fc0af790 tx=0x7fb3ec009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:00.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.656+0000 7fb3e3fff700 1 -- 172.21.15.115:0/772328027 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3f404c260 con 0x7fb3fc1542a0 2023-07-27T14:40:00.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.824+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3fc062540 con 0x7fb3fc1542a0 2023-07-27T14:40:00.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.825+0000 7fb3e3fff700 1 -- 172.21.15.115:0/772328027 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+17143 (secure 0 0 0) 0x7fb3f404f880 con 0x7fb3fc1542a0 2023-07-27T14:40:00.881 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:00.881 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":204,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:40:00.407863+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:39:58.717120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-07-27T14:39:59.393690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:40:00.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3e805fcc0 msgr2=0x7fb3e8062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3e805fcc0 0x7fb3e8062180 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fb3fc0af790 tx=0x7fb3ec009040).stop 2023-07-27T14:40:00.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc1542a0 msgr2=0x7fb3fc0ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:00.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc1542a0 0x7fb3fc0ab340 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 rx=0x7fb3f4009d70 tx=0x7fb3f400b040).stop 2023-07-27T14:40:00.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 shutdown_connections 2023-07-27T14:40:00.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb3e805fcc0 0x7fb3e8062180 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3fc1542a0 0x7fb3fc0ab340 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3fc0aaa40 0x7fb3fc141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 --2- 172.21.15.115:0/772328027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3fc153ec0 0x7fb3fc0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:00.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 >> 172.21.15.115:0/772328027 conn(0x7fb3fc0cb610 msgr2=0x7fb3fc0c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:00.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 shutdown_connections 2023-07-27T14:40:00.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:00.828+0000 7fb4029ff700 1 -- 172.21.15.115:0/772328027 wait complete. 2023-07-27T14:40:00.901 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:40:01.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.035+0000 7f0dab9ff700 1 Processor -- start 2023-07-27T14:40:01.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.035+0000 7f0dab9ff700 1 -- start start 2023-07-27T14:40:01.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0dab9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0da4150320 0x7f0da4150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0dab9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c1f70 0x7f0da4069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0dab9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da4068380 con 0x7f0da40c0e80 2023-07-27T14:40:01.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0dab9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da4065790 con 0x7f0da4150320 2023-07-27T14:40:01.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0dab9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4068ee0 con 0x7f0da40c1f70 2023-07-27T14:40:01.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0da979b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0da4150320 0x7f0da4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0da979b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0da4150320 0x7f0da4150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45734/0 (socket says 172.21.15.115:45734) 2023-07-27T14:40:01.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0da979b700 1 -- 172.21.15.115:0/3775188041 learned_addr learned my addr 172.21.15.115:0/3775188041 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:01.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0da9f9c700 1 --2- 172.21.15.115:0/3775188041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c1f70 0x7f0da4069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0da979b700 1 -- 172.21.15.115:0/3775188041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c1f70 msgr2=0x7f0da4069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:01.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0da979b700 1 --2- 172.21.15.115:0/3775188041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c1f70 0x7f0da4069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0da979b700 1 -- 172.21.15.115:0/3775188041 >> v1:172.21.15.115:6789/0 conn(0x7f0da40c0e80 legacy=0x7f0da40c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0da979b700 1 -- 172.21.15.115:0/3775188041 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da40685b0 con 0x7f0da4150320 2023-07-27T14:40:01.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.037+0000 7f0d9bfff700 1 -- 172.21.15.115:0/3775188041 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161984134 0 0) 0x7f0da4068380 con 0x7f0da40c0e80 2023-07-27T14:40:01.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0da979b700 1 --2- 172.21.15.115:0/3775188041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da4150320 0x7f0da4150700 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 rx=0x7f0da0006fd0 tx=0x7f0da000b3b0).ready entity=mon.0 client_cookie=ef14298aed19ea8d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:01.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0d9bfff700 1 -- 172.21.15.115:0/3775188041 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000db40 con 0x7f0da4150320 2023-07-27T14:40:01.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0d9bfff700 1 -- 172.21.15.115:0/3775188041 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000dca0 con 0x7f0da4150320 2023-07-27T14:40:01.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0d9bfff700 1 -- 172.21.15.115:0/3775188041 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0010680 con 0x7f0da4150320 2023-07-27T14:40:01.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0dab9ff700 1 -- 172.21.15.115:0/3775188041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da4150320 msgr2=0x7f0da4150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/3775188041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da4150320 0x7f0da4150700 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 rx=0x7f0da0006fd0 tx=0x7f0da000b3b0).stop 2023-07-27T14:40:01.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0dab9ff700 1 -- 172.21.15.115:0/3775188041 shutdown_connections 2023-07-27T14:40:01.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/3775188041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c1f70 0x7f0da4069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/3775188041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da4150320 0x7f0da4150700 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0dab9ff700 1 -- 172.21.15.115:0/3775188041 >> 172.21.15.115:0/3775188041 conn(0x7f0da4062320 msgr2=0x7f0da4062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:01.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.038+0000 7f0dab9ff700 1 -- 172.21.15.115:0/3775188041 shutdown_connections 2023-07-27T14:40:01.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.039+0000 7f0dab9ff700 1 -- 172.21.15.115:0/3775188041 wait complete. 2023-07-27T14:40:01.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.040+0000 7f0dab9ff700 1 Processor -- start 2023-07-27T14:40:01.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.040+0000 7f0dab9ff700 1 -- start start 2023-07-27T14:40:01.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0dab9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c0e80 0x7f0da4150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0dab9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da40c1f70 0x7f0da40a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0dab9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0da4150320 0x7f0da4152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0dab9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4151120 con 0x7f0da40c1f70 2023-07-27T14:40:01.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0dab9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40a87b0 con 0x7f0da4150320 2023-07-27T14:40:01.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0dab9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4151f70 con 0x7f0da40c0e80 2023-07-27T14:40:01.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0da8f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da40c1f70 0x7f0da40a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0da8f9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da40c1f70 0x7f0da40a82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45746/0 (socket says 172.21.15.115:45746) 2023-07-27T14:40:01.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.041+0000 7f0da8f9a700 1 -- 172.21.15.115:0/4245481023 learned_addr learned my addr 172.21.15.115:0/4245481023 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:01.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0da979b700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c0e80 0x7f0da4150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0da9f9c700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0da4150320 0x7f0da4152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0da8f9a700 1 -- 172.21.15.115:0/4245481023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c0e80 msgr2=0x7f0da4150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0da8f9a700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c0e80 0x7f0da4150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0da8f9a700 1 -- 172.21.15.115:0/4245481023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0da4150320 msgr2=0x7f0da4152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0da8f9a700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0da4150320 0x7f0da4152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0da8f9a700 1 -- 172.21.15.115:0/4245481023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da000b610 con 0x7f0da40c1f70 2023-07-27T14:40:01.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0da8f9a700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da40c1f70 0x7f0da40a82c0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 rx=0x7f0d9400c4e0 tx=0x7f0d94007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:01.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0d997fa700 1 -- 172.21.15.115:0/4245481023 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400f470 con 0x7f0da40c1f70 2023-07-27T14:40:01.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0d997fa700 1 -- 172.21.15.115:0/4245481023 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9400f5f0 con 0x7f0da40c1f70 2023-07-27T14:40:01.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da41530a0 con 0x7f0da40c1f70 2023-07-27T14:40:01.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0d997fa700 1 -- 172.21.15.115:0/4245481023 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400f9b0 con 0x7f0da40c1f70 2023-07-27T14:40:01.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.042+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da4151640 con 0x7f0da40c1f70 2023-07-27T14:40:01.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.043+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da406c470 con 0x7f0da40c1f70 2023-07-27T14:40:01.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.044+0000 7f0d997fa700 1 -- 172.21.15.115:0/4245481023 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f0d94019030 con 0x7f0da40c1f70 2023-07-27T14:40:01.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.045+0000 7f0d997fa700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0d8805fcc0 0x7f0d88062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.045+0000 7f0d997fa700 1 -- 172.21.15.115:0/4245481023 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0d9407a910 con 0x7f0da40c1f70 2023-07-27T14:40:01.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.045+0000 7f0da979b700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0d8805fcc0 0x7f0d88062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.046+0000 7f0da979b700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0d8805fcc0 0x7f0d88062180 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f0da000bf90 tx=0x7f0da000b3b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:01.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.049+0000 7f0d997fa700 1 -- 172.21.15.115:0/4245481023 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d9404ae50 con 0x7f0da40c1f70 2023-07-27T14:40:01.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.221+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0da40c5730 con 0x7f0da40c1f70 2023-07-27T14:40:01.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.223+0000 7f0d997fa700 1 -- 172.21.15.115:0/4245481023 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+17143 (secure 0 0 0) 0x7f0d9404e470 con 0x7f0da40c1f70 2023-07-27T14:40:01.278 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:01.279 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":204,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:40:00.407863+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:39:58.717120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-07-27T14:39:59.393690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:40:01.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.224+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0d8805fcc0 msgr2=0x7f0d88062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.224+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0d8805fcc0 0x7f0d88062180 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f0da000bf90 tx=0x7f0da000b3b0).stop 2023-07-27T14:40:01.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.224+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da40c1f70 msgr2=0x7f0da40a82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da40c1f70 0x7f0da40a82c0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 rx=0x7f0d9400c4e0 tx=0x7f0d94007c70).stop 2023-07-27T14:40:01.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 shutdown_connections 2023-07-27T14:40:01.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0d8805fcc0 0x7f0d88062180 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0da4150320 0x7f0da4152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0da40c0e80 0x7f0da4150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 --2- 172.21.15.115:0/4245481023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0da40c1f70 0x7f0da40a82c0 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 >> 172.21.15.115:0/4245481023 conn(0x7f0da4062320 msgr2=0x7f0da40c5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:01.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 shutdown_connections 2023-07-27T14:40:01.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.225+0000 7f0dab9ff700 1 -- 172.21.15.115:0/4245481023 wait complete. 2023-07-27T14:40:01.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:40:01.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.437+0000 7f55d0bff700 1 Processor -- start 2023-07-27T14:40:01.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.437+0000 7f55d0bff700 1 -- start start 2023-07-27T14:40:01.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55d0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55d0bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f55cc154ee0 0x7f55cc062810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55d0bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc0697d0 con 0x7f55cc069c60 2023-07-27T14:40:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55d0bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc155320 con 0x7f55cc154ee0 2023-07-27T14:40:01.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55d0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc062d00 con 0x7f55cc0c7250 2023-07-27T14:40:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55c9d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f55cc069c60 0x7f55cc1547d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50412/0 (socket says 172.21.15.115:50412) 2023-07-27T14:40:01.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55c9d9b700 1 -- 172.21.15.115:0/3822294008 learned_addr learned my addr 172.21.15.115:0/3822294008 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:01.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55cad9d700 1 --2- 172.21.15.115:0/3822294008 >> v2:172.21.15.159:3300/0 conn(0x7f55cc154ee0 0x7f55cc062810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55ca59c700 1 --2- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55c959a700 1 -- 172.21.15.115:0/3822294008 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191939918 0 0) 0x7f55cc0697d0 con 0x7f55cc069c60 2023-07-27T14:40:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.439+0000 7f55c959a700 1 -- 172.21.15.115:0/3822294008 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b40033f0 con 0x7f55cc069c60 2023-07-27T14:40:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55c959a700 1 -- 172.21.15.115:0/3822294008 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 566446002 0 0) 0x7f55b40033f0 con 0x7f55cc069c60 2023-07-27T14:40:01.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55cad9d700 1 -- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 msgr2=0x7f55cc062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:01.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55cad9d700 1 --2- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55cad9d700 1 -- 172.21.15.115:0/3822294008 >> v1:172.21.15.115:6789/0 conn(0x7f55cc069c60 legacy=0x7f55cc1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55cad9d700 1 -- 172.21.15.115:0/3822294008 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc155520 con 0x7f55cc154ee0 2023-07-27T14:40:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55ca59c700 1 --2- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55cad9d700 1 --2- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc154ee0 0x7f55cc062810 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f55c4009e60 tx=0x7f55c4009780).ready entity=mon.1 client_cookie=7eaa4f92c3f503aa server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:01.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55c959a700 1 -- 172.21.15.115:0/3822294008 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400e070 con 0x7f55cc154ee0 2023-07-27T14:40:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55c959a700 1 -- 172.21.15.115:0/3822294008 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c400b830 con 0x7f55cc154ee0 2023-07-27T14:40:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.440+0000 7f55c959a700 1 -- 172.21.15.115:0/3822294008 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0001470 con 0x7f55cc154ee0 2023-07-27T14:40:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.441+0000 7f55d0bff700 1 -- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc154ee0 msgr2=0x7f55cc062810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.441+0000 7f55d0bff700 1 --2- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc154ee0 0x7f55cc062810 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f55c4009e60 tx=0x7f55c4009780).stop 2023-07-27T14:40:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.441+0000 7f55d0bff700 1 -- 172.21.15.115:0/3822294008 shutdown_connections 2023-07-27T14:40:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.441+0000 7f55d0bff700 1 --2- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc154ee0 0x7f55cc062810 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.441+0000 7f55d0bff700 1 --2- 172.21.15.115:0/3822294008 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.441+0000 7f55d0bff700 1 -- 172.21.15.115:0/3822294008 >> 172.21.15.115:0/3822294008 conn(0x7f55cc0c79a0 msgr2=0x7f55cc0c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.441+0000 7f55d0bff700 1 -- 172.21.15.115:0/3822294008 shutdown_connections 2023-07-27T14:40:01.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.441+0000 7f55d0bff700 1 -- 172.21.15.115:0/3822294008 wait complete. 2023-07-27T14:40:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.442+0000 7f55d0bff700 1 Processor -- start 2023-07-27T14:40:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.442+0000 7f55d0bff700 1 -- start start 2023-07-27T14:40:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.443+0000 7f55d0bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc069c60 0x7f55cc144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.443+0000 7f55d0bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc0a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.443+0000 7f55d0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55cc154ee0 0x7f55cc0a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.443+0000 7f55d0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc150bd0 con 0x7f55cc154ee0 2023-07-27T14:40:01.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.443+0000 7f55d0bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc150eb0 con 0x7f55cc069c60 2023-07-27T14:40:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.443+0000 7f55d0bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0662e0 con 0x7f55cc0c7250 2023-07-27T14:40:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55cc154ee0 0x7f55cc0a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55cc154ee0 0x7f55cc0a8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45750/0 (socket says 172.21.15.115:45750) 2023-07-27T14:40:01.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 -- 172.21.15.115:0/2945748528 learned_addr learned my addr 172.21.15.115:0/2945748528 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:01.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55ca59c700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc069c60 0x7f55cc144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55c9d9b700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc0a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 -- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 msgr2=0x7f55cc0a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc0a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 -- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc069c60 msgr2=0x7f55cc144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:01.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc069c60 0x7f55cc144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 -- 172.21.15.115:0/2945748528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc009250 con 0x7f55cc154ee0 2023-07-27T14:40:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55c9d9b700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc0a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55cad9d700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55cc154ee0 0x7f55cc0a8d90 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 rx=0x7f55c400b610 tx=0x7f55c4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:01.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55ba7fc700 1 -- 172.21.15.115:0/2945748528 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c401d420 con 0x7f55cc154ee0 2023-07-27T14:40:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55ba7fc700 1 -- 172.21.15.115:0/2945748528 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c401d580 con 0x7f55cc154ee0 2023-07-27T14:40:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c4009a20 con 0x7f55cc154ee0 2023-07-27T14:40:01.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.444+0000 7f55ba7fc700 1 -- 172.21.15.115:0/2945748528 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c401d920 con 0x7f55cc154ee0 2023-07-27T14:40:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.445+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc144b00 con 0x7f55cc154ee0 2023-07-27T14:40:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.446+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc06c470 con 0x7f55cc154ee0 2023-07-27T14:40:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.446+0000 7f55ba7fc700 1 -- 172.21.15.115:0/2945748528 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f55c401dd10 con 0x7f55cc154ee0 2023-07-27T14:40:01.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.447+0000 7f55ba7fc700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55ac05fcc0 0x7f55ac062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.447+0000 7f55ba7fc700 1 -- 172.21.15.115:0/2945748528 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f55c407d2f0 con 0x7f55cc154ee0 2023-07-27T14:40:01.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.447+0000 7f55ca59c700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55ac05fcc0 0x7f55ac062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.448+0000 7f55ca59c700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55ac05fcc0 0x7f55ac062180 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f55bc006fd0 tx=0x7f55bc006f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:01.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.451+0000 7f55ba7fc700 1 -- 172.21.15.115:0/2945748528 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55c404d940 con 0x7f55cc154ee0 2023-07-27T14:40:01.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:01.661+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f55cc0c55d0 con 0x7f55cc154ee0 2023-07-27T14:40:02.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:40:02.417 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:40:02.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.431+0000 7f55ba7fc700 1 -- 172.21.15.115:0/2945748528 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v111) v1 ==== 118+0+0 (secure 0 0 0) 0x7f55c4050f60 con 0x7f55cc154ee0 2023-07-27T14:40:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55ac05fcc0 msgr2=0x7f55ac062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55ac05fcc0 0x7f55ac062180 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f55bc006fd0 tx=0x7f55bc006f40).stop 2023-07-27T14:40:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55cc154ee0 msgr2=0x7f55cc0a8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55cc154ee0 0x7f55cc0a8d90 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 rx=0x7f55c400b610 tx=0x7f55c4009780).stop 2023-07-27T14:40:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 shutdown_connections 2023-07-27T14:40:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f55ac05fcc0 0x7f55ac062180 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55cc154ee0 0x7f55cc0a8d90 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55cc069c60 0x7f55cc144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 --2- 172.21.15.115:0/2945748528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55cc0c7250 0x7f55cc0a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 >> 172.21.15.115:0/2945748528 conn(0x7f55cc0c79a0 msgr2=0x7f55cc1513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 shutdown_connections 2023-07-27T14:40:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.434+0000 7f55d0bff700 1 -- 172.21.15.115:0/2945748528 wait complete. 2023-07-27T14:40:02.508 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:40:02.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:40:02.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.643+0000 7f6fbb5ff700 1 Processor -- start 2023-07-27T14:40:02.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.643+0000 7f6fbb5ff700 1 -- start start 2023-07-27T14:40:02.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fbb5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:02.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fbb5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6fb4063260 0x7f6fb40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:02.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fbb5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb41553f0 con 0x7f6fb414b1e0 2023-07-27T14:40:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fbb5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb4157a50 con 0x7f6fb4063260 2023-07-27T14:40:02.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fbb5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4157d10 con 0x7f6fb414ae00 2023-07-27T14:40:02.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fb9b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6fb4063260 0x7f6fb40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:02.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fb9b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6fb4063260 0x7f6fb40a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45752/0 (socket says 172.21.15.115:45752) 2023-07-27T14:40:02.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fb9b9c700 1 -- 172.21.15.115:0/4186953648 learned_addr learned my addr 172.21.15.115:0/4186953648 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:02.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fb939b700 1 --2- 172.21.15.115:0/4186953648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:02.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fb9b9c700 1 -- 172.21.15.115:0/4186953648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 msgr2=0x7f6fb4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:02.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fb9b9c700 1 --2- 172.21.15.115:0/4186953648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.645+0000 7f6fb9b9c700 1 -- 172.21.15.115:0/4186953648 >> v1:172.21.15.115:6789/0 conn(0x7f6fb414b1e0 legacy=0x7f6fb4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:02.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.646+0000 7f6fb9b9c700 1 -- 172.21.15.115:0/4186953648 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4157ff0 con 0x7f6fb4063260 2023-07-27T14:40:02.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.646+0000 7f6fb939b700 1 --2- 172.21.15.115:0/4186953648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:02.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.646+0000 7f6fb9b9c700 1 --2- 172.21.15.115:0/4186953648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb4063260 0x7f6fb40a98c0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 rx=0x7f6fac009f20 tx=0x7f6fac009840).ready entity=mon.0 client_cookie=c807a8ecbdab3788 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.646+0000 7f6fabfff700 1 -- 172.21.15.115:0/4186953648 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00e070 con 0x7f6fb4063260 2023-07-27T14:40:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.646+0000 7f6fabfff700 1 -- 172.21.15.115:0/4186953648 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac00b980 con 0x7f6fb4063260 2023-07-27T14:40:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.646+0000 7f6fabfff700 1 -- 172.21.15.115:0/4186953648 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00bd00 con 0x7f6fb4063260 2023-07-27T14:40:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.646+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4186953648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb4063260 msgr2=0x7f6fb40a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.646+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4186953648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb4063260 0x7f6fb40a98c0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 rx=0x7f6fac009f20 tx=0x7f6fac009840).stop 2023-07-27T14:40:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.647+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4186953648 shutdown_connections 2023-07-27T14:40:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.647+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4186953648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.647+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4186953648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb4063260 0x7f6fb40a98c0 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.647+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4186953648 >> 172.21.15.115:0/4186953648 conn(0x7f6fb405e940 msgr2=0x7f6fb40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.647+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4186953648 shutdown_connections 2023-07-27T14:40:02.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.647+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4186953648 wait complete. 2023-07-27T14:40:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.648+0000 7f6fbb5ff700 1 Processor -- start 2023-07-27T14:40:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.648+0000 7f6fbb5ff700 1 -- start start 2023-07-27T14:40:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.649+0000 7f6fbb5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fb4063260 0x7f6fb413e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.649+0000 7f6fbb5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.649+0000 7f6fbb5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb414b1e0 0x7f6fb40affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:02.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.649+0000 7f6fbb5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40c1ce0 con 0x7f6fb414b1e0 2023-07-27T14:40:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.649+0000 7f6fbb5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40c22a0 con 0x7f6fb4063260 2023-07-27T14:40:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.649+0000 7f6fbb5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40b07f0 con 0x7f6fb414ae00 2023-07-27T14:40:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.649+0000 7f6fb9b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb414b1e0 0x7f6fb40affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb9b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb414b1e0 0x7f6fb40affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45758/0 (socket says 172.21.15.115:45758) 2023-07-27T14:40:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb9b9c700 1 -- 172.21.15.115:0/4130625717 learned_addr learned my addr 172.21.15.115:0/4130625717 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb939b700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fb4063260 0x7f6fb413e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:02.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb8b9a700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:02.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb9b9c700 1 -- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 msgr2=0x7f6fb40afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:02.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb9b9c700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb40afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb9b9c700 1 -- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fb4063260 msgr2=0x7f6fb413e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:02.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb9b9c700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fb4063260 0x7f6fb413e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:02.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb9b9c700 1 -- 172.21.15.115:0/4130625717 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009ae0 con 0x7f6fb414b1e0 2023-07-27T14:40:02.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb8b9a700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb40afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:02.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fb9b9c700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb414b1e0 0x7f6fb40affb0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 rx=0x7f6fac00b6c0 tx=0x7f6fac009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:02.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fa97fa700 1 -- 172.21.15.115:0/4130625717 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0092e0 con 0x7f6fb414b1e0 2023-07-27T14:40:02.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fa97fa700 1 -- 172.21.15.115:0/4130625717 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac007040 con 0x7f6fb414b1e0 2023-07-27T14:40:02.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb40b0ad0 con 0x7f6fb414b1e0 2023-07-27T14:40:02.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fa97fa700 1 -- 172.21.15.115:0/4130625717 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac01e6c0 con 0x7f6fb414b1e0 2023-07-27T14:40:02.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.650+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb40b04a0 con 0x7f6fb414b1e0 2023-07-27T14:40:02.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.651+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb40c2410 con 0x7f6fb414b1e0 2023-07-27T14:40:02.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.652+0000 7f6fa97fa700 1 -- 172.21.15.115:0/4130625717 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f6fac01b040 con 0x7f6fb414b1e0 2023-07-27T14:40:02.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.653+0000 7f6fa97fa700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f9805fcc0 0x7f6f98062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:02.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.653+0000 7f6fa97fa700 1 -- 172.21.15.115:0/4130625717 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f6fac07c850 con 0x7f6fb414b1e0 2023-07-27T14:40:02.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.653+0000 7f6fb939b700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f9805fcc0 0x7f6f98062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:02.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.654+0000 7f6fb939b700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f9805fcc0 0x7f6f98062180 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f6fb0006d80 tx=0x7f6fb0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:02.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.657+0000 7f6fa97fa700 1 -- 172.21.15.115:0/4130625717 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6fac04cd90 con 0x7f6fb414b1e0 2023-07-27T14:40:02.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:02.868+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6fb406c470 con 0x7f6fb414b1e0 2023-07-27T14:40:03.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.434+0000 7f6fa97fa700 1 -- 172.21.15.115:0/4130625717 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v112) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6fac0503b0 con 0x7f6fb414b1e0 2023-07-27T14:40:03.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f9805fcc0 msgr2=0x7f6f98062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:03.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f9805fcc0 0x7f6f98062180 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f6fb0006d80 tx=0x7f6fb0008040).stop 2023-07-27T14:40:03.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb414b1e0 msgr2=0x7f6fb40affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:03.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb414b1e0 0x7f6fb40affb0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 rx=0x7f6fac00b6c0 tx=0x7f6fac009840).stop 2023-07-27T14:40:03.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 shutdown_connections 2023-07-27T14:40:03.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6f9805fcc0 0x7f6f98062180 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fb414b1e0 0x7f6fb40affb0 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6fb4063260 0x7f6fb413e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 --2- 172.21.15.115:0/4130625717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6fb414ae00 0x7f6fb40afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 >> 172.21.15.115:0/4130625717 conn(0x7f6fb405e940 msgr2=0x7f6fb414a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:03.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 shutdown_connections 2023-07-27T14:40:03.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.437+0000 7f6fbb5ff700 1 -- 172.21.15.115:0/4130625717 wait complete. 2023-07-27T14:40:03.511 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:40:03.512 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:40:03.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.647+0000 7f45e69ff700 1 Processor -- start 2023-07-27T14:40:03.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.647+0000 7f45e69ff700 1 -- start start 2023-07-27T14:40:03.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.647+0000 7f45e69ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45e0153ec0 0x7f45e00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:03.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45e69ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00aaa40 0x7f45e00c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:03.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45e69ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00aa4d0 con 0x7f45e00aa050 2023-07-27T14:40:03.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45e69ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e00c05c0 con 0x7f45e0153ec0 2023-07-27T14:40:03.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45e69ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00bfc90 con 0x7f45e00aaa40 2023-07-27T14:40:03.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45dffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45e0153ec0 0x7f45e00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:03.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45dffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45e0153ec0 0x7f45e00a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50462/0 (socket says 172.21.15.115:50462) 2023-07-27T14:40:03.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45dffff700 1 -- 172.21.15.115:0/2730385553 learned_addr learned my addr 172.21.15.115:0/2730385553 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:03.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45e4f9c700 1 --2- 172.21.15.115:0/2730385553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00aaa40 0x7f45e00c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:03.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45dffff700 1 -- 172.21.15.115:0/2730385553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00aaa40 msgr2=0x7f45e00c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:03.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45dffff700 1 --2- 172.21.15.115:0/2730385553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00aaa40 0x7f45e00c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45dffff700 1 -- 172.21.15.115:0/2730385553 >> v1:172.21.15.159:6789/0 conn(0x7f45e00aa050 legacy=0x7f45e00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.648+0000 7f45dffff700 1 -- 172.21.15.115:0/2730385553 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00bff70 con 0x7f45e0153ec0 2023-07-27T14:40:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45dffff700 1 --2- 172.21.15.115:0/2730385553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0153ec0 0x7f45e00a9b60 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 rx=0x7f45d0006fd0 tx=0x7f45d00090f0).ready entity=mon.0 client_cookie=9d02d7a8d7303e73 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45deffd700 1 -- 172.21.15.115:0/2730385553 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000b580 con 0x7f45e0153ec0 2023-07-27T14:40:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45deffd700 1 -- 172.21.15.115:0/2730385553 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d000b6e0 con 0x7f45e0153ec0 2023-07-27T14:40:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45deffd700 1 -- 172.21.15.115:0/2730385553 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000ba60 con 0x7f45e0153ec0 2023-07-27T14:40:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45e69ff700 1 -- 172.21.15.115:0/2730385553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0153ec0 msgr2=0x7f45e00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45e69ff700 1 --2- 172.21.15.115:0/2730385553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0153ec0 0x7f45e00a9b60 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 rx=0x7f45d0006fd0 tx=0x7f45d00090f0).stop 2023-07-27T14:40:03.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45e69ff700 1 -- 172.21.15.115:0/2730385553 shutdown_connections 2023-07-27T14:40:03.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45e69ff700 1 --2- 172.21.15.115:0/2730385553 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00aaa40 0x7f45e00c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45e69ff700 1 --2- 172.21.15.115:0/2730385553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e0153ec0 0x7f45e00a9b60 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45e69ff700 1 -- 172.21.15.115:0/2730385553 >> 172.21.15.115:0/2730385553 conn(0x7f45e00cb610 msgr2=0x7f45e00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:03.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.649+0000 7f45e69ff700 1 -- 172.21.15.115:0/2730385553 shutdown_connections 2023-07-27T14:40:03.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.650+0000 7f45e69ff700 1 -- 172.21.15.115:0/2730385553 wait complete. 2023-07-27T14:40:03.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.652+0000 7f45e69ff700 1 Processor -- start 2023-07-27T14:40:03.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.652+0000 7f45e69ff700 1 -- start start 2023-07-27T14:40:03.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45e69ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e00aa050 0x7f45e00c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:03.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45e69ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00aaa40 0x7f45e014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:03.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45e69ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0153ec0 0x7f45e00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:03.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45e69ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00c3b90 con 0x7f45e00aa050 2023-07-27T14:40:03.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45e69ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00c3e70 con 0x7f45e00aaa40 2023-07-27T14:40:03.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45e69ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00c4150 con 0x7f45e0153ec0 2023-07-27T14:40:03.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45dffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e00aa050 0x7f45e00c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:03.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45dffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e00aa050 0x7f45e00c32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50476/0 (socket says 172.21.15.115:50476) 2023-07-27T14:40:03.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45dffff700 1 -- 172.21.15.115:0/4107608938 learned_addr learned my addr 172.21.15.115:0/4107608938 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:03.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45e4f9c700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0153ec0 0x7f45e00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:03.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.653+0000 7f45df7fe700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00aaa40 0x7f45e014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:03.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45dffff700 1 -- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0153ec0 msgr2=0x7f45e00aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:03.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45dffff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0153ec0 0x7f45e00aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45dffff700 1 -- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00aaa40 msgr2=0x7f45e014cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:03.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45dffff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00aaa40 0x7f45e014cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45dffff700 1 -- 172.21.15.115:0/4107608938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0009370 con 0x7f45e00aa050 2023-07-27T14:40:03.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45e4f9c700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0153ec0 0x7f45e00aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:03.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45dffff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e00aa050 0x7f45e00c32d0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 rx=0x7f45e0060760 tx=0x7f45d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:03.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45c7fff700 1 -- 172.21.15.115:0/4107608938 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000b850 con 0x7f45e00aa050 2023-07-27T14:40:03.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45c7fff700 1 -- 172.21.15.115:0/4107608938 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d000b9b0 con 0x7f45e00aa050 2023-07-27T14:40:03.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45c7fff700 1 -- 172.21.15.115:0/4107608938 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d001b660 con 0x7f45e00aa050 2023-07-27T14:40:03.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e00c4430 con 0x7f45e00aa050 2023-07-27T14:40:03.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.654+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e00c37c0 con 0x7f45e00aa050 2023-07-27T14:40:03.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.655+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e00c4950 con 0x7f45e00aa050 2023-07-27T14:40:03.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.656+0000 7f45c7fff700 1 -- 172.21.15.115:0/4107608938 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f45d002a070 con 0x7f45e00aa050 2023-07-27T14:40:03.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.657+0000 7f45c7fff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45cc05fc90 0x7f45cc062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:03.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.657+0000 7f45c7fff700 1 -- 172.21.15.115:0/4107608938 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f45d007c9d0 con 0x7f45e00aa050 2023-07-27T14:40:03.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.657+0000 7f45df7fe700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45cc05fc90 0x7f45cc062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:03.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.658+0000 7f45df7fe700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45cc05fc90 0x7f45cc062150 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f45e00b0240 tx=0x7f45d4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:03.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.661+0000 7f45c7fff700 1 -- 172.21.15.115:0/4107608938 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45d004cf10 con 0x7f45e00aa050 2023-07-27T14:40:03.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.870+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45e006c470 con 0x7f45e00aa050 2023-07-27T14:40:03.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.871+0000 7f45c7fff700 1 -- 172.21.15.115:0/4107608938 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4515 (secure 0 0 0) 0x7f45d001f020 con 0x7f45e00aa050 2023-07-27T14:40:03.927 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:03.927 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":112,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3608226418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3608226418},{"type":"v1","addr":"172.21.15.115:6837","nonce":3608226418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":9118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3601251920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3601251920},{"type":"v1","addr":"172.21.15.159:6835","nonce":3601251920}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":10386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3139755816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3139755816},{"type":"v1","addr":"172.21.15.115:6835","nonce":3139755816}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:40:00.408365+0000","modified":"2023-07-27T14:40:03.430962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10389":{"gid":10389,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/1326270023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1326270023},{"type":"v1","addr":"172.21.15.159:6834","nonce":1326270023}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-07-27T14:40:03.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45cc05fc90 msgr2=0x7f45cc062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:03.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45cc05fc90 0x7f45cc062150 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f45e00b0240 tx=0x7f45d4009040).stop 2023-07-27T14:40:03.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e00aa050 msgr2=0x7f45e00c32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:03.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e00aa050 0x7f45e00c32d0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 rx=0x7f45e0060760 tx=0x7f45d0017000).stop 2023-07-27T14:40:03.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 shutdown_connections 2023-07-27T14:40:03.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f45cc05fc90 0x7f45cc062150 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e0153ec0 0x7f45e00aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45e00aa050 0x7f45e00c32d0 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 --2- 172.21.15.115:0/4107608938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00aaa40 0x7f45e014cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:03.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 >> 172.21.15.115:0/4107608938 conn(0x7f45e00cb610 msgr2=0x7f45e00ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:03.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 shutdown_connections 2023-07-27T14:40:03.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:03.873+0000 7f45e69ff700 1 -- 172.21.15.115:0/4107608938 wait complete. 2023-07-27T14:40:03.930 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 112 2023-07-27T14:40:03.946 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:40:04.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.078+0000 7f64c85ff700 1 Processor -- start 2023-07-27T14:40:04.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.078+0000 7f64c85ff700 1 -- start start 2023-07-27T14:40:04.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.079+0000 7f64c85ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c0153ec0 0x7f64c00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.079+0000 7f64c85ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64c00aa050 0x7f64c00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.079+0000 7f64c85ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f64c00aaa40 0x7f64c00645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.079+0000 7f64c85ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c0064ad0 con 0x7f64c00aa050 2023-07-27T14:40:04.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.079+0000 7f64c85ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c00aa4d0 con 0x7f64c00aaa40 2023-07-27T14:40:04.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.079+0000 7f64c85ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00c05c0 con 0x7f64c0153ec0 2023-07-27T14:40:04.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64c00aa050 0x7f64c00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64c00aa050 0x7f64c00640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50480/0 (socket says 172.21.15.115:50480) 2023-07-27T14:40:04.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 -- 172.21.15.115:0/3431495472 learned_addr learned my addr 172.21.15.115:0/3431495472 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:04.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c639b700 1 --2- 172.21.15.115:0/3431495472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c0153ec0 0x7f64c00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c6b9c700 1 --2- 172.21.15.115:0/3431495472 >> v2:172.21.15.159:3300/0 conn(0x7f64c00aaa40 0x7f64c00645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 -- 172.21.15.115:0/3431495472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c0153ec0 msgr2=0x7f64c00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:04.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 --2- 172.21.15.115:0/3431495472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c0153ec0 0x7f64c00a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 -- 172.21.15.115:0/3431495472 >> v2:172.21.15.159:3300/0 conn(0x7f64c00aaa40 msgr2=0x7f64c00645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:04.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 --2- 172.21.15.115:0/3431495472 >> v2:172.21.15.159:3300/0 conn(0x7f64c00aaa40 0x7f64c00645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 -- 172.21.15.115:0/3431495472 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c00bfc90 con 0x7f64c00aa050 2023-07-27T14:40:04.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5b9a700 1 --2- 172.21.15.115:0/3431495472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c00aa050 0x7f64c00640f0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 rx=0x7f64c00843b0 tx=0x7f64b00090f0).ready entity=mon.0 client_cookie=b9507af1c0302b3b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.080+0000 7f64c5399700 1 -- 172.21.15.115:0/3431495472 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b000b600 con 0x7f64c00aa050 2023-07-27T14:40:04.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c5399700 1 -- 172.21.15.115:0/3431495472 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b000b760 con 0x7f64c00aa050 2023-07-27T14:40:04.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c5399700 1 -- 172.21.15.115:0/3431495472 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b000bae0 con 0x7f64c00aa050 2023-07-27T14:40:04.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 -- 172.21.15.115:0/3431495472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c00aa050 msgr2=0x7f64c00640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 --2- 172.21.15.115:0/3431495472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c00aa050 0x7f64c00640f0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 rx=0x7f64c00843b0 tx=0x7f64b00090f0).stop 2023-07-27T14:40:04.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 -- 172.21.15.115:0/3431495472 shutdown_connections 2023-07-27T14:40:04.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 --2- 172.21.15.115:0/3431495472 >> v2:172.21.15.159:3300/0 conn(0x7f64c00aaa40 0x7f64c00645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 --2- 172.21.15.115:0/3431495472 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c0153ec0 0x7f64c00a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 --2- 172.21.15.115:0/3431495472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c00aa050 0x7f64c00640f0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 -- 172.21.15.115:0/3431495472 >> 172.21.15.115:0/3431495472 conn(0x7f64c00cb610 msgr2=0x7f64c00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:04.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 -- 172.21.15.115:0/3431495472 shutdown_connections 2023-07-27T14:40:04.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.081+0000 7f64c85ff700 1 -- 172.21.15.115:0/3431495472 wait complete. 2023-07-27T14:40:04.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.083+0000 7f64c85ff700 1 Processor -- start 2023-07-27T14:40:04.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.083+0000 7f64c85ff700 1 -- start start 2023-07-27T14:40:04.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c85ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64c00aa050 0x7f64c00a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c85ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c00aaa40 0x7f64c00af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c85ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c0153ec0 0x7f64c00c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c85ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c0163f00 con 0x7f64c0153ec0 2023-07-27T14:40:04.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c85ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c0152060 con 0x7f64c00aa050 2023-07-27T14:40:04.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c85ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c0152340 con 0x7f64c00aaa40 2023-07-27T14:40:04.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c6b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c0153ec0 0x7f64c00c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c6b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c0153ec0 0x7f64c00c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50496/0 (socket says 172.21.15.115:50496) 2023-07-27T14:40:04.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c6b9c700 1 -- 172.21.15.115:0/328313986 learned_addr learned my addr 172.21.15.115:0/328313986 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:04.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c6b9c700 1 -- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c00aaa40 msgr2=0x7f64c00af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c5b9a700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c00aaa40 0x7f64c00af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c639b700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64c00aa050 0x7f64c00a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.084+0000 7f64c6b9c700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c00aaa40 0x7f64c00af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64c6b9c700 1 -- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64c00aa050 msgr2=0x7f64c00a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64c6b9c700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64c00aa050 0x7f64c00a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64c6b9c700 1 -- 172.21.15.115:0/328313986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0009370 con 0x7f64c0153ec0 2023-07-27T14:40:04.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64c5b9a700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c00aaa40 0x7f64c00af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:04.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64c639b700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64c00aa050 0x7f64c00a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:04.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64c6b9c700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c0153ec0 0x7f64c00c39c0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 rx=0x7f64b8007f20 tx=0x7f64b80098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64b67fc700 1 -- 172.21.15.115:0/328313986 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800eca0 con 0x7f64c0153ec0 2023-07-27T14:40:04.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64b67fc700 1 -- 172.21.15.115:0/328313986 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b800ee00 con 0x7f64c0153ec0 2023-07-27T14:40:04.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c0152620 con 0x7f64c0153ec0 2023-07-27T14:40:04.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64b67fc700 1 -- 172.21.15.115:0/328313986 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8014610 con 0x7f64c0153ec0 2023-07-27T14:40:04.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.085+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c00a9520 con 0x7f64c0153ec0 2023-07-27T14:40:04.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.086+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c0164070 con 0x7f64c0153ec0 2023-07-27T14:40:04.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.087+0000 7f64b67fc700 1 -- 172.21.15.115:0/328313986 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f64b801b030 con 0x7f64c0153ec0 2023-07-27T14:40:04.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.088+0000 7f64b67fc700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f64a405fcc0 0x7f64a4062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.088+0000 7f64b67fc700 1 -- 172.21.15.115:0/328313986 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f64b807b860 con 0x7f64c0153ec0 2023-07-27T14:40:04.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.088+0000 7f64c639b700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f64a405fcc0 0x7f64a4062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.088+0000 7f64c639b700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f64a405fcc0 0x7f64a4062180 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f64bc009810 tx=0x7f64bc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.091+0000 7f64b67fc700 1 -- 172.21.15.115:0/328313986 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f64b804bda0 con 0x7f64c0153ec0 2023-07-27T14:40:04.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.262+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64c00bff70 con 0x7f64c0153ec0 2023-07-27T14:40:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.263+0000 7f64b67fc700 1 -- 172.21.15.115:0/328313986 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+17130 (secure 0 0 0) 0x7f64b804f3c0 con 0x7f64c0153ec0 2023-07-27T14:40:04.320 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:04.320 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":205,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:40:01.410819+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:39:58.717120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-07-27T14:39:59.393690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:40:04.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f64a405fcc0 msgr2=0x7f64a4062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f64a405fcc0 0x7f64a4062180 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f64bc009810 tx=0x7f64bc008040).stop 2023-07-27T14:40:04.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c0153ec0 msgr2=0x7f64c00c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c0153ec0 0x7f64c00c39c0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 rx=0x7f64b8007f20 tx=0x7f64b80098a0).stop 2023-07-27T14:40:04.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 shutdown_connections 2023-07-27T14:40:04.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f64a405fcc0 0x7f64a4062180 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64c0153ec0 0x7f64c00c39c0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64c00aa050 0x7f64c00a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 --2- 172.21.15.115:0/328313986 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64c00aaa40 0x7f64c00af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 >> 172.21.15.115:0/328313986 conn(0x7f64c00cb610 msgr2=0x7f64c00c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:04.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 shutdown_connections 2023-07-27T14:40:04.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.266+0000 7f64c85ff700 1 -- 172.21.15.115:0/328313986 wait complete. 2023-07-27T14:40:04.339 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:40:04.339 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:40:04.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.473+0000 7f6462dff700 1 Processor -- start 2023-07-27T14:40:04.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.473+0000 7f6462dff700 1 -- start start 2023-07-27T14:40:04.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.474+0000 7f6462dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f645c153ec0 0x7f645c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.474+0000 7f6462dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f645c0aa050 0x7f645c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.474+0000 7f6462dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c0aa4d0 con 0x7f645c0aaa40 2023-07-27T14:40:04.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.474+0000 7f6462dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c0c05c0 con 0x7f645c153ec0 2023-07-27T14:40:04.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.474+0000 7f6462dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c0c1a60 con 0x7f645c0aa050 2023-07-27T14:40:04.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f6460b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f645c153ec0 0x7f645c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f6460b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f645c153ec0 0x7f645c0a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50504/0 (socket says 172.21.15.115:50504) 2023-07-27T14:40:04.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f6460b9b700 1 -- 172.21.15.115:0/3258923970 learned_addr learned my addr 172.21.15.115:0/3258923970 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:04.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f645bfff700 1 --2- 172.21.15.115:0/3258923970 >> v2:172.21.15.159:3300/0 conn(0x7f645c0aa050 0x7f645c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f6460b9b700 1 -- 172.21.15.115:0/3258923970 >> v2:172.21.15.159:3300/0 conn(0x7f645c0aa050 msgr2=0x7f645c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:04.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f6460b9b700 1 --2- 172.21.15.115:0/3258923970 >> v2:172.21.15.159:3300/0 conn(0x7f645c0aa050 0x7f645c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f6460b9b700 1 -- 172.21.15.115:0/3258923970 >> v1:172.21.15.159:6789/0 conn(0x7f645c0aaa40 legacy=0x7f645c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:04.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f6460b9b700 1 -- 172.21.15.115:0/3258923970 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0bfc90 con 0x7f645c153ec0 2023-07-27T14:40:04.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f6460b9b700 1 --2- 172.21.15.115:0/3258923970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c153ec0 0x7f645c0a9b60 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 rx=0x7f645c06c0d0 tx=0x7f64500090f0).ready entity=mon.0 client_cookie=bc81ab1cd80d98b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.475+0000 7f645b7fe700 1 -- 172.21.15.115:0/3258923970 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000b600 con 0x7f645c153ec0 2023-07-27T14:40:04.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f645b7fe700 1 -- 172.21.15.115:0/3258923970 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645000b760 con 0x7f645c153ec0 2023-07-27T14:40:04.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f645b7fe700 1 -- 172.21.15.115:0/3258923970 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000bae0 con 0x7f645c153ec0 2023-07-27T14:40:04.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f6462dff700 1 -- 172.21.15.115:0/3258923970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c153ec0 msgr2=0x7f645c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f6462dff700 1 --2- 172.21.15.115:0/3258923970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c153ec0 0x7f645c0a9b60 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 rx=0x7f645c06c0d0 tx=0x7f64500090f0).stop 2023-07-27T14:40:04.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f6462dff700 1 -- 172.21.15.115:0/3258923970 shutdown_connections 2023-07-27T14:40:04.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f6462dff700 1 --2- 172.21.15.115:0/3258923970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c153ec0 0x7f645c0a9b60 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f6462dff700 1 --2- 172.21.15.115:0/3258923970 >> v2:172.21.15.159:3300/0 conn(0x7f645c0aa050 0x7f645c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f6462dff700 1 -- 172.21.15.115:0/3258923970 >> 172.21.15.115:0/3258923970 conn(0x7f645c0cb610 msgr2=0x7f645c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:04.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f6462dff700 1 -- 172.21.15.115:0/3258923970 shutdown_connections 2023-07-27T14:40:04.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.476+0000 7f6462dff700 1 -- 172.21.15.115:0/3258923970 wait complete. 2023-07-27T14:40:04.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.478+0000 7f6462dff700 1 Processor -- start 2023-07-27T14:40:04.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.478+0000 7f6462dff700 1 -- start start 2023-07-27T14:40:04.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6462dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c0aa050 0x7f645c0a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6462dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645c0aaa40 0x7f645c1500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6462dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f645c153ec0 0x7f645c14c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6462dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0a9800 con 0x7f645c0aa050 2023-07-27T14:40:04.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6462dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c1505e0 con 0x7f645c0aaa40 2023-07-27T14:40:04.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6462dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c153510 con 0x7f645c153ec0 2023-07-27T14:40:04.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c0aa050 0x7f645c0a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c0aa050 0x7f645c0a9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50514/0 (socket says 172.21.15.115:50514) 2023-07-27T14:40:04.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 -- 172.21.15.115:0/2205222970 learned_addr learned my addr 172.21.15.115:0/2205222970 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:04.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f645bfff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645c0aaa40 0x7f645c1500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f646139c700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f645c153ec0 0x7f645c14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 -- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f645c153ec0 msgr2=0x7f645c14c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f645c153ec0 0x7f645c14c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 -- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645c0aaa40 msgr2=0x7f645c1500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645c0aaa40 0x7f645c1500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 -- 172.21.15.115:0/2205222970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450009370 con 0x7f645c0aa050 2023-07-27T14:40:04.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f645bfff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645c0aaa40 0x7f645c1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:04.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.479+0000 7f6460b9b700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c0aa050 0x7f645c0a9310 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 rx=0x7f6450009130 tx=0x7f6450017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.480+0000 7f6458ff9700 1 -- 172.21.15.115:0/2205222970 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000bae0 con 0x7f645c0aa050 2023-07-27T14:40:04.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.480+0000 7f6458ff9700 1 -- 172.21.15.115:0/2205222970 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450000c90 con 0x7f645c0aa050 2023-07-27T14:40:04.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.480+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c150aa0 con 0x7f645c0aa050 2023-07-27T14:40:04.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.480+0000 7f6458ff9700 1 -- 172.21.15.115:0/2205222970 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645001b660 con 0x7f645c0aa050 2023-07-27T14:40:04.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.480+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c151060 con 0x7f645c0aa050 2023-07-27T14:40:04.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.481+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c1537f0 con 0x7f645c0aa050 2023-07-27T14:40:04.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.482+0000 7f6458ff9700 1 -- 172.21.15.115:0/2205222970 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f645002b070 con 0x7f645c0aa050 2023-07-27T14:40:04.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.483+0000 7f6458ff9700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f644005fcc0 0x7f6440062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.483+0000 7f6458ff9700 1 -- 172.21.15.115:0/2205222970 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f645007ccc0 con 0x7f645c0aa050 2023-07-27T14:40:04.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.483+0000 7f645bfff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f644005fcc0 0x7f6440062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.483+0000 7f645bfff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f644005fcc0 0x7f6440062180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f645c165470 tx=0x7f6448008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.486+0000 7f6458ff9700 1 -- 172.21.15.115:0/2205222970 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6450083080 con 0x7f645c0aa050 2023-07-27T14:40:04.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.651+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f645c06c470 con 0x7f644005fcc0 2023-07-27T14:40:04.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.661+0000 7f6458ff9700 1 -- 172.21.15.115:0/2205222970 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355318 (secure 0 0 0) 0x7f645c06c470 con 0x7f644005fcc0 2023-07-27T14:40:04.724 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:04.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.665+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f644005fcc0 msgr2=0x7f6440062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.665+0000 7f6462dff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f644005fcc0 0x7f6440062180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f645c165470 tx=0x7f6448008040).stop 2023-07-27T14:40:04.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.665+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c0aa050 msgr2=0x7f645c0a9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.665+0000 7f6462dff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c0aa050 0x7f645c0a9310 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 rx=0x7f6450009130 tx=0x7f6450017000).stop 2023-07-27T14:40:04.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.666+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 shutdown_connections 2023-07-27T14:40:04.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.666+0000 7f6462dff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f644005fcc0 0x7f6440062180 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.666+0000 7f6462dff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f645c153ec0 0x7f645c14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.666+0000 7f6462dff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f645c0aa050 0x7f645c0a9310 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.666+0000 7f6462dff700 1 --2- 172.21.15.115:0/2205222970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645c0aaa40 0x7f645c1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.666+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 >> 172.21.15.115:0/2205222970 conn(0x7f645c0cb610 msgr2=0x7f645c0ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:04.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.666+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 shutdown_connections 2023-07-27T14:40:04.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.666+0000 7f6462dff700 1 -- 172.21.15.115:0/2205222970 wait complete. 2023-07-27T14:40:04.730 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:40:04.738 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2023-07-27T14:40:03.616910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1660,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":132,"acting":132,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":197036,"kb_used_data":20012,"kb_used_omap":0,"kb_used_meta":176960,"kb_avail":754777684,"statfs":{"total":773094113280,"available":772892348416,"internally_reserved":0,"allocated":20492288,"data_stored":9718766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":181207040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-536377,"num_objects":-25,"num_object_clones":-1,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":-1,"num_read":-22,"num_read_kb":-8208,"num_write":-237,"num_write_kb":-17007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.033841"},"pg_stats":[{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417014+0000","last_change":"2023-07-27T14:39:59.980161+0000","last_active":"2023-07-27T14:40:00.417014+0000","last_peered":"2023-07-27T14:40:00.417014+0000","last_clean":"2023-07-27T14:40:00.417014+0000","last_became_active":"2023-07-27T14:39:59.977406+0000","last_became_peered":"2023-07-27T14:39:59.977406+0000","last_unstale":"2023-07-27T14:40:00.417014+0000","last_undegraded":"2023-07-27T14:40:00.417014+0000","last_fullsized":"2023-07-27T14:40:00.417014+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.430754+0000","last_change":"2023-07-27T14:40:00.428058+0000","last_active":"2023-07-27T14:40:00.430754+0000","last_peered":"2023-07-27T14:40:00.430754+0000","last_clean":"2023-07-27T14:40:00.430754+0000","last_became_active":"2023-07-27T14:40:00.427765+0000","last_became_peered":"2023-07-27T14:40:00.427765+0000","last_unstale":"2023-07-27T14:40:00.430754+0000","last_undegraded":"2023-07-27T14:40:00.430754+0000","last_fullsized":"2023-07-27T14:40:00.430754+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414833+0000","last_change":"2023-07-27T14:39:59.969560+0000","last_active":"2023-07-27T14:40:00.414833+0000","last_peered":"2023-07-27T14:40:00.414833+0000","last_clean":"2023-07-27T14:40:00.414833+0000","last_became_active":"2023-07-27T14:39:59.969284+0000","last_became_peered":"2023-07-27T14:39:59.969284+0000","last_unstale":"2023-07-27T14:40:00.414833+0000","last_undegraded":"2023-07-27T14:40:00.414833+0000","last_fullsized":"2023-07-27T14:40:00.414833+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428818+0000","last_change":"2023-07-27T14:40:00.424519+0000","last_active":"2023-07-27T14:40:00.428818+0000","last_peered":"2023-07-27T14:40:00.428818+0000","last_clean":"2023-07-27T14:40:00.428818+0000","last_became_active":"2023-07-27T14:40:00.424269+0000","last_became_peered":"2023-07-27T14:40:00.424269+0000","last_unstale":"2023-07-27T14:40:00.428818+0000","last_undegraded":"2023-07-27T14:40:00.428818+0000","last_fullsized":"2023-07-27T14:40:00.428818+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441990+0000","last_change":"2023-07-27T14:39:59.975564+0000","last_active":"2023-07-27T14:40:00.441990+0000","last_peered":"2023-07-27T14:40:00.441990+0000","last_clean":"2023-07-27T14:40:00.441990+0000","last_became_active":"2023-07-27T14:39:59.975257+0000","last_became_peered":"2023-07-27T14:39:59.975257+0000","last_unstale":"2023-07-27T14:40:00.441990+0000","last_undegraded":"2023-07-27T14:40:00.441990+0000","last_fullsized":"2023-07-27T14:40:00.441990+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428069+0000","last_change":"2023-07-27T14:40:00.423653+0000","last_active":"2023-07-27T14:40:00.428069+0000","last_peered":"2023-07-27T14:40:00.428069+0000","last_clean":"2023-07-27T14:40:00.428069+0000","last_became_active":"2023-07-27T14:40:00.423374+0000","last_became_peered":"2023-07-27T14:40:00.423374+0000","last_unstale":"2023-07-27T14:40:00.428069+0000","last_undegraded":"2023-07-27T14:40:00.428069+0000","last_fullsized":"2023-07-27T14:40:00.428069+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.434568+0000","last_change":"2023-07-27T14:40:00.433310+0000","last_active":"2023-07-27T14:40:00.434568+0000","last_peered":"2023-07-27T14:40:00.434568+0000","last_clean":"2023-07-27T14:40:00.434568+0000","last_became_active":"2023-07-27T14:40:00.432861+0000","last_became_peered":"2023-07-27T14:40:00.432861+0000","last_unstale":"2023-07-27T14:40:00.434568+0000","last_undegraded":"2023-07-27T14:40:00.434568+0000","last_fullsized":"2023-07-27T14:40:00.434568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419495+0000","last_change":"2023-07-27T14:39:59.975414+0000","last_active":"2023-07-27T14:40:00.419495+0000","last_peered":"2023-07-27T14:40:00.419495+0000","last_clean":"2023-07-27T14:40:00.419495+0000","last_became_active":"2023-07-27T14:39:59.975123+0000","last_became_peered":"2023-07-27T14:39:59.975123+0000","last_unstale":"2023-07-27T14:40:00.419495+0000","last_undegraded":"2023-07-27T14:40:00.419495+0000","last_fullsized":"2023-07-27T14:40:00.419495+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428833+0000","last_change":"2023-07-27T14:40:00.424211+0000","last_active":"2023-07-27T14:40:00.428833+0000","last_peered":"2023-07-27T14:40:00.428833+0000","last_clean":"2023-07-27T14:40:00.428833+0000","last_became_active":"2023-07-27T14:40:00.423930+0000","last_became_peered":"2023-07-27T14:40:00.423930+0000","last_unstale":"2023-07-27T14:40:00.428833+0000","last_undegraded":"2023-07-27T14:40:00.428833+0000","last_fullsized":"2023-07-27T14:40:00.428833+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420653+0000","last_change":"2023-07-27T14:39:59.972452+0000","last_active":"2023-07-27T14:40:00.420653+0000","last_peered":"2023-07-27T14:40:00.420653+0000","last_clean":"2023-07-27T14:40:00.420653+0000","last_became_active":"2023-07-27T14:39:59.972166+0000","last_became_peered":"2023-07-27T14:39:59.972166+0000","last_unstale":"2023-07-27T14:40:00.420653+0000","last_undegraded":"2023-07-27T14:40:00.420653+0000","last_fullsized":"2023-07-27T14:40:00.420653+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415169+0000","last_change":"2023-07-27T14:39:59.970599+0000","last_active":"2023-07-27T14:40:00.415169+0000","last_peered":"2023-07-27T14:40:00.415169+0000","last_clean":"2023-07-27T14:40:00.415169+0000","last_became_active":"2023-07-27T14:39:59.970336+0000","last_became_peered":"2023-07-27T14:39:59.970336+0000","last_unstale":"2023-07-27T14:40:00.415169+0000","last_undegraded":"2023-07-27T14:40:00.415169+0000","last_fullsized":"2023-07-27T14:40:00.415169+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.34","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446741+0000","last_change":"2023-07-27T14:39:59.970857+0000","last_active":"2023-07-27T14:40:00.446741+0000","last_peered":"2023-07-27T14:40:00.446741+0000","last_clean":"2023-07-27T14:40:00.446741+0000","last_became_active":"2023-07-27T14:39:59.970436+0000","last_became_peered":"2023-07-27T14:39:59.970436+0000","last_unstale":"2023-07-27T14:40:00.446741+0000","last_undegraded":"2023-07-27T14:40:00.446741+0000","last_fullsized":"2023-07-27T14:40:00.446741+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447435+0000","last_change":"2023-07-27T14:40:00.446561+0000","last_active":"2023-07-27T14:40:00.447435+0000","last_peered":"2023-07-27T14:40:00.447435+0000","last_clean":"2023-07-27T14:40:00.447435+0000","last_became_active":"2023-07-27T14:40:00.446240+0000","last_became_peered":"2023-07-27T14:40:00.446240+0000","last_unstale":"2023-07-27T14:40:00.447435+0000","last_undegraded":"2023-07-27T14:40:00.447435+0000","last_fullsized":"2023-07-27T14:40:00.447435+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.30","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441928+0000","last_change":"2023-07-27T14:39:59.963969+0000","last_active":"2023-07-27T14:40:00.441928+0000","last_peered":"2023-07-27T14:40:00.441928+0000","last_clean":"2023-07-27T14:40:00.441928+0000","last_became_active":"2023-07-27T14:39:59.963693+0000","last_became_peered":"2023-07-27T14:39:59.963693+0000","last_unstale":"2023-07-27T14:40:00.441928+0000","last_undegraded":"2023-07-27T14:40:00.441928+0000","last_fullsized":"2023-07-27T14:40:00.441928+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439272+0000","last_change":"2023-07-27T14:40:00.436081+0000","last_active":"2023-07-27T14:40:00.439272+0000","last_peered":"2023-07-27T14:40:00.439272+0000","last_clean":"2023-07-27T14:40:00.439272+0000","last_became_active":"2023-07-27T14:40:00.435741+0000","last_became_peered":"2023-07-27T14:40:00.435741+0000","last_unstale":"2023-07-27T14:40:00.439272+0000","last_undegraded":"2023-07-27T14:40:00.439272+0000","last_fullsized":"2023-07-27T14:40:00.439272+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420765+0000","last_change":"2023-07-27T14:39:59.964330+0000","last_active":"2023-07-27T14:40:00.420765+0000","last_peered":"2023-07-27T14:40:00.420765+0000","last_clean":"2023-07-27T14:40:00.420765+0000","last_became_active":"2023-07-27T14:39:59.964054+0000","last_became_peered":"2023-07-27T14:39:59.964054+0000","last_unstale":"2023-07-27T14:40:00.420765+0000","last_undegraded":"2023-07-27T14:40:00.420765+0000","last_fullsized":"2023-07-27T14:40:00.420765+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419374+0000","last_change":"2023-07-27T14:39:59.963318+0000","last_active":"2023-07-27T14:40:00.419374+0000","last_peered":"2023-07-27T14:40:00.419374+0000","last_clean":"2023-07-27T14:40:00.419374+0000","last_became_active":"2023-07-27T14:39:59.963055+0000","last_became_peered":"2023-07-27T14:39:59.963055+0000","last_unstale":"2023-07-27T14:40:00.419374+0000","last_undegraded":"2023-07-27T14:40:00.419374+0000","last_fullsized":"2023-07-27T14:40:00.419374+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428862+0000","last_change":"2023-07-27T14:40:00.423749+0000","last_active":"2023-07-27T14:40:00.428862+0000","last_peered":"2023-07-27T14:40:00.428862+0000","last_clean":"2023-07-27T14:40:00.428862+0000","last_became_active":"2023-07-27T14:40:00.423476+0000","last_became_peered":"2023-07-27T14:40:00.423476+0000","last_unstale":"2023-07-27T14:40:00.428862+0000","last_undegraded":"2023-07-27T14:40:00.428862+0000","last_fullsized":"2023-07-27T14:40:00.428862+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438324+0000","last_change":"2023-07-27T14:40:00.432481+0000","last_active":"2023-07-27T14:40:00.438324+0000","last_peered":"2023-07-27T14:40:00.438324+0000","last_clean":"2023-07-27T14:40:00.438324+0000","last_became_active":"2023-07-27T14:40:00.431034+0000","last_became_peered":"2023-07-27T14:40:00.431034+0000","last_unstale":"2023-07-27T14:40:00.438324+0000","last_undegraded":"2023-07-27T14:40:00.438324+0000","last_fullsized":"2023-07-27T14:40:00.438324+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431884+0000","last_change":"2023-07-27T14:40:00.430299+0000","last_active":"2023-07-27T14:40:00.431884+0000","last_peered":"2023-07-27T14:40:00.431884+0000","last_clean":"2023-07-27T14:40:00.431884+0000","last_became_active":"2023-07-27T14:40:00.430033+0000","last_became_peered":"2023-07-27T14:40:00.430033+0000","last_unstale":"2023-07-27T14:40:00.431884+0000","last_undegraded":"2023-07-27T14:40:00.431884+0000","last_fullsized":"2023-07-27T14:40:00.431884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438453+0000","last_change":"2023-07-27T14:40:00.431553+0000","last_active":"2023-07-27T14:40:00.438453+0000","last_peered":"2023-07-27T14:40:00.438453+0000","last_clean":"2023-07-27T14:40:00.438453+0000","last_became_active":"2023-07-27T14:40:00.430671+0000","last_became_peered":"2023-07-27T14:40:00.430671+0000","last_unstale":"2023-07-27T14:40:00.438453+0000","last_undegraded":"2023-07-27T14:40:00.438453+0000","last_fullsized":"2023-07-27T14:40:00.438453+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428295+0000","last_change":"2023-07-27T14:40:00.424022+0000","last_active":"2023-07-27T14:40:00.428295+0000","last_peered":"2023-07-27T14:40:00.428295+0000","last_clean":"2023-07-27T14:40:00.428295+0000","last_became_active":"2023-07-27T14:40:00.423746+0000","last_became_peered":"2023-07-27T14:40:00.423746+0000","last_unstale":"2023-07-27T14:40:00.428295+0000","last_undegraded":"2023-07-27T14:40:00.428295+0000","last_fullsized":"2023-07-27T14:40:00.428295+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.416887+0000","last_change":"2023-07-27T14:39:59.980446+0000","last_active":"2023-07-27T14:40:00.416887+0000","last_peered":"2023-07-27T14:40:00.416887+0000","last_clean":"2023-07-27T14:40:00.416887+0000","last_became_active":"2023-07-27T14:39:59.980179+0000","last_became_peered":"2023-07-27T14:39:59.980179+0000","last_unstale":"2023-07-27T14:40:00.416887+0000","last_undegraded":"2023-07-27T14:40:00.416887+0000","last_fullsized":"2023-07-27T14:40:00.416887+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419078+0000","last_change":"2023-07-27T14:39:59.976359+0000","last_active":"2023-07-27T14:40:00.419078+0000","last_peered":"2023-07-27T14:40:00.419078+0000","last_clean":"2023-07-27T14:40:00.419078+0000","last_became_active":"2023-07-27T14:39:59.976086+0000","last_became_peered":"2023-07-27T14:39:59.976086+0000","last_unstale":"2023-07-27T14:40:00.419078+0000","last_undegraded":"2023-07-27T14:40:00.419078+0000","last_fullsized":"2023-07-27T14:40:00.419078+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427709+0000","last_change":"2023-07-27T14:40:00.425690+0000","last_active":"2023-07-27T14:40:00.427709+0000","last_peered":"2023-07-27T14:40:00.427709+0000","last_clean":"2023-07-27T14:40:00.427709+0000","last_became_active":"2023-07-27T14:40:00.425433+0000","last_became_peered":"2023-07-27T14:40:00.425433+0000","last_unstale":"2023-07-27T14:40:00.427709+0000","last_undegraded":"2023-07-27T14:40:00.427709+0000","last_fullsized":"2023-07-27T14:40:00.427709+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420864+0000","last_change":"2023-07-27T14:39:59.962795+0000","last_active":"2023-07-27T14:40:00.420864+0000","last_peered":"2023-07-27T14:40:00.420864+0000","last_clean":"2023-07-27T14:40:00.420864+0000","last_became_active":"2023-07-27T14:39:59.962537+0000","last_became_peered":"2023-07-27T14:39:59.962537+0000","last_unstale":"2023-07-27T14:40:00.420864+0000","last_undegraded":"2023-07-27T14:40:00.420864+0000","last_fullsized":"2023-07-27T14:40:00.420864+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427352+0000","last_change":"2023-07-27T14:40:00.422356+0000","last_active":"2023-07-27T14:40:00.427352+0000","last_peered":"2023-07-27T14:40:00.427352+0000","last_clean":"2023-07-27T14:40:00.427352+0000","last_became_active":"2023-07-27T14:40:00.422057+0000","last_became_peered":"2023-07-27T14:40:00.422057+0000","last_unstale":"2023-07-27T14:40:00.427352+0000","last_undegraded":"2023-07-27T14:40:00.427352+0000","last_fullsized":"2023-07-27T14:40:00.427352+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415297+0000","last_change":"2023-07-27T14:39:59.970682+0000","last_active":"2023-07-27T14:40:00.415297+0000","last_peered":"2023-07-27T14:40:00.415297+0000","last_clean":"2023-07-27T14:40:00.415297+0000","last_became_active":"2023-07-27T14:39:59.970351+0000","last_became_peered":"2023-07-27T14:39:59.970351+0000","last_unstale":"2023-07-27T14:40:00.415297+0000","last_undegraded":"2023-07-27T14:40:00.415297+0000","last_fullsized":"2023-07-27T14:40:00.415297+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418696+0000","last_change":"2023-07-27T14:39:59.978710+0000","last_active":"2023-07-27T14:40:00.418696+0000","last_peered":"2023-07-27T14:40:00.418696+0000","last_clean":"2023-07-27T14:40:00.418696+0000","last_became_active":"2023-07-27T14:39:59.978442+0000","last_became_peered":"2023-07-27T14:39:59.978442+0000","last_unstale":"2023-07-27T14:40:00.418696+0000","last_undegraded":"2023-07-27T14:40:00.418696+0000","last_fullsized":"2023-07-27T14:40:00.418696+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418997+0000","last_change":"2023-07-27T14:39:59.974113+0000","last_active":"2023-07-27T14:40:00.418997+0000","last_peered":"2023-07-27T14:40:00.418997+0000","last_clean":"2023-07-27T14:40:00.418997+0000","last_became_active":"2023-07-27T14:39:59.973820+0000","last_became_peered":"2023-07-27T14:39:59.973820+0000","last_unstale":"2023-07-27T14:40:00.418997+0000","last_undegraded":"2023-07-27T14:40:00.418997+0000","last_fullsized":"2023-07-27T14:40:00.418997+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442334+0000","last_change":"2023-07-27T14:40:00.441511+0000","last_active":"2023-07-27T14:40:00.442334+0000","last_peered":"2023-07-27T14:40:00.442334+0000","last_clean":"2023-07-27T14:40:00.442334+0000","last_became_active":"2023-07-27T14:40:00.441161+0000","last_became_peered":"2023-07-27T14:40:00.441161+0000","last_unstale":"2023-07-27T14:40:00.442334+0000","last_undegraded":"2023-07-27T14:40:00.442334+0000","last_fullsized":"2023-07-27T14:40:00.442334+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428642+0000","last_change":"2023-07-27T14:40:00.424395+0000","last_active":"2023-07-27T14:40:00.428642+0000","last_peered":"2023-07-27T14:40:00.428642+0000","last_clean":"2023-07-27T14:40:00.428642+0000","last_became_active":"2023-07-27T14:40:00.424127+0000","last_became_peered":"2023-07-27T14:40:00.424127+0000","last_unstale":"2023-07-27T14:40:00.428642+0000","last_undegraded":"2023-07-27T14:40:00.428642+0000","last_fullsized":"2023-07-27T14:40:00.428642+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419473+0000","last_change":"2023-07-27T14:39:59.966964+0000","last_active":"2023-07-27T14:40:00.419473+0000","last_peered":"2023-07-27T14:40:00.419473+0000","last_clean":"2023-07-27T14:40:00.419473+0000","last_became_active":"2023-07-27T14:39:59.966695+0000","last_became_peered":"2023-07-27T14:39:59.966695+0000","last_unstale":"2023-07-27T14:40:00.419473+0000","last_undegraded":"2023-07-27T14:40:00.419473+0000","last_fullsized":"2023-07-27T14:40:00.419473+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"204'3","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440604+0000","last_change":"2023-07-27T14:39:59.962153+0000","last_active":"2023-07-27T14:40:00.440604+0000","last_peered":"2023-07-27T14:40:00.440604+0000","last_clean":"2023-07-27T14:40:00.440604+0000","last_became_active":"2023-07-27T14:39:59.961854+0000","last_became_peered":"2023-07-27T14:39:59.961854+0000","last_unstale":"2023-07-27T14:40:00.440604+0000","last_undegraded":"2023-07-27T14:40:00.440604+0000","last_fullsized":"2023-07-27T14:40:00.440604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440839+0000","last_change":"2023-07-27T14:39:59.973460+0000","last_active":"2023-07-27T14:40:00.440839+0000","last_peered":"2023-07-27T14:40:00.440839+0000","last_clean":"2023-07-27T14:40:00.440839+0000","last_became_active":"2023-07-27T14:39:59.973163+0000","last_became_peered":"2023-07-27T14:39:59.973163+0000","last_unstale":"2023-07-27T14:40:00.440839+0000","last_undegraded":"2023-07-27T14:40:00.440839+0000","last_fullsized":"2023-07-27T14:40:00.440839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431539+0000","last_change":"2023-07-27T14:40:00.426655+0000","last_active":"2023-07-27T14:40:00.431539+0000","last_peered":"2023-07-27T14:40:00.431539+0000","last_clean":"2023-07-27T14:40:00.431539+0000","last_became_active":"2023-07-27T14:40:00.426182+0000","last_became_peered":"2023-07-27T14:40:00.426182+0000","last_unstale":"2023-07-27T14:40:00.431539+0000","last_undegraded":"2023-07-27T14:40:00.431539+0000","last_fullsized":"2023-07-27T14:40:00.431539+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444068+0000","last_change":"2023-07-27T14:39:59.983557+0000","last_active":"2023-07-27T14:40:00.444068+0000","last_peered":"2023-07-27T14:40:00.444068+0000","last_clean":"2023-07-27T14:40:00.444068+0000","last_became_active":"2023-07-27T14:39:59.983347+0000","last_became_peered":"2023-07-27T14:39:59.983347+0000","last_unstale":"2023-07-27T14:40:00.444068+0000","last_undegraded":"2023-07-27T14:40:00.444068+0000","last_fullsized":"2023-07-27T14:40:00.444068+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421067+0000","last_change":"2023-07-27T14:39:59.972458+0000","last_active":"2023-07-27T14:40:00.421067+0000","last_peered":"2023-07-27T14:40:00.421067+0000","last_clean":"2023-07-27T14:40:00.421067+0000","last_became_active":"2023-07-27T14:39:59.972157+0000","last_became_peered":"2023-07-27T14:39:59.972157+0000","last_unstale":"2023-07-27T14:40:00.421067+0000","last_undegraded":"2023-07-27T14:40:00.421067+0000","last_fullsized":"2023-07-27T14:40:00.421067+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.413941+0000","last_change":"2023-07-27T14:39:59.968781+0000","last_active":"2023-07-27T14:40:00.413941+0000","last_peered":"2023-07-27T14:40:00.413941+0000","last_clean":"2023-07-27T14:40:00.413941+0000","last_became_active":"2023-07-27T14:39:59.968014+0000","last_became_peered":"2023-07-27T14:39:59.968014+0000","last_unstale":"2023-07-27T14:40:00.413941+0000","last_undegraded":"2023-07-27T14:40:00.413941+0000","last_fullsized":"2023-07-27T14:40:00.413941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432889+0000","last_change":"2023-07-27T14:40:00.428525+0000","last_active":"2023-07-27T14:40:00.432889+0000","last_peered":"2023-07-27T14:40:00.432889+0000","last_clean":"2023-07-27T14:40:00.432889+0000","last_became_active":"2023-07-27T14:40:00.428213+0000","last_became_peered":"2023-07-27T14:40:00.428213+0000","last_unstale":"2023-07-27T14:40:00.432889+0000","last_undegraded":"2023-07-27T14:40:00.432889+0000","last_fullsized":"2023-07-27T14:40:00.432889+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439610+0000","last_change":"2023-07-27T14:40:00.436729+0000","last_active":"2023-07-27T14:40:00.439610+0000","last_peered":"2023-07-27T14:40:00.439610+0000","last_clean":"2023-07-27T14:40:00.439610+0000","last_became_active":"2023-07-27T14:40:00.436469+0000","last_became_peered":"2023-07-27T14:40:00.436469+0000","last_unstale":"2023-07-27T14:40:00.439610+0000","last_undegraded":"2023-07-27T14:40:00.439610+0000","last_fullsized":"2023-07-27T14:40:00.439610+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439513+0000","last_change":"2023-07-27T14:39:59.972384+0000","last_active":"2023-07-27T14:40:00.439513+0000","last_peered":"2023-07-27T14:40:00.439513+0000","last_clean":"2023-07-27T14:40:00.439513+0000","last_became_active":"2023-07-27T14:39:59.972023+0000","last_became_peered":"2023-07-27T14:39:59.972023+0000","last_unstale":"2023-07-27T14:40:00.439513+0000","last_undegraded":"2023-07-27T14:40:00.439513+0000","last_fullsized":"2023-07-27T14:40:00.439513+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418246+0000","last_change":"2023-07-27T14:39:59.971231+0000","last_active":"2023-07-27T14:40:00.418246+0000","last_peered":"2023-07-27T14:40:00.418246+0000","last_clean":"2023-07-27T14:40:00.418246+0000","last_became_active":"2023-07-27T14:39:59.970964+0000","last_became_peered":"2023-07-27T14:39:59.970964+0000","last_unstale":"2023-07-27T14:40:00.418246+0000","last_undegraded":"2023-07-27T14:40:00.418246+0000","last_fullsized":"2023-07-27T14:40:00.418246+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428953+0000","last_change":"2023-07-27T14:40:00.424947+0000","last_active":"2023-07-27T14:40:00.428953+0000","last_peered":"2023-07-27T14:40:00.428953+0000","last_clean":"2023-07-27T14:40:00.428953+0000","last_became_active":"2023-07-27T14:40:00.424664+0000","last_became_peered":"2023-07-27T14:40:00.424664+0000","last_unstale":"2023-07-27T14:40:00.428953+0000","last_undegraded":"2023-07-27T14:40:00.428953+0000","last_fullsized":"2023-07-27T14:40:00.428953+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433045+0000","last_change":"2023-07-27T14:40:00.428558+0000","last_active":"2023-07-27T14:40:00.433045+0000","last_peered":"2023-07-27T14:40:00.433045+0000","last_clean":"2023-07-27T14:40:00.433045+0000","last_became_active":"2023-07-27T14:40:00.428225+0000","last_became_peered":"2023-07-27T14:40:00.428225+0000","last_unstale":"2023-07-27T14:40:00.433045+0000","last_undegraded":"2023-07-27T14:40:00.433045+0000","last_fullsized":"2023-07-27T14:40:00.433045+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432050+0000","last_change":"2023-07-27T14:40:00.428749+0000","last_active":"2023-07-27T14:40:00.432050+0000","last_peered":"2023-07-27T14:40:00.432050+0000","last_clean":"2023-07-27T14:40:00.432050+0000","last_became_active":"2023-07-27T14:40:00.428434+0000","last_became_peered":"2023-07-27T14:40:00.428434+0000","last_unstale":"2023-07-27T14:40:00.432050+0000","last_undegraded":"2023-07-27T14:40:00.432050+0000","last_fullsized":"2023-07-27T14:40:00.432050+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432022+0000","last_change":"2023-07-27T14:40:00.429569+0000","last_active":"2023-07-27T14:40:00.432022+0000","last_peered":"2023-07-27T14:40:00.432022+0000","last_clean":"2023-07-27T14:40:00.432022+0000","last_became_active":"2023-07-27T14:40:00.429132+0000","last_became_peered":"2023-07-27T14:40:00.429132+0000","last_unstale":"2023-07-27T14:40:00.432022+0000","last_undegraded":"2023-07-27T14:40:00.432022+0000","last_fullsized":"2023-07-27T14:40:00.432022+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448534+0000","last_change":"2023-07-27T14:39:59.970152+0000","last_active":"2023-07-27T14:40:00.448534+0000","last_peered":"2023-07-27T14:40:00.448534+0000","last_clean":"2023-07-27T14:40:00.448534+0000","last_became_active":"2023-07-27T14:39:59.969856+0000","last_became_peered":"2023-07-27T14:39:59.969856+0000","last_unstale":"2023-07-27T14:40:00.448534+0000","last_undegraded":"2023-07-27T14:40:00.448534+0000","last_fullsized":"2023-07-27T14:40:00.448534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428260+0000","last_change":"2023-07-27T14:40:00.425272+0000","last_active":"2023-07-27T14:40:00.428260+0000","last_peered":"2023-07-27T14:40:00.428260+0000","last_clean":"2023-07-27T14:40:00.428260+0000","last_became_active":"2023-07-27T14:40:00.424996+0000","last_became_peered":"2023-07-27T14:40:00.424996+0000","last_unstale":"2023-07-27T14:40:00.428260+0000","last_undegraded":"2023-07-27T14:40:00.428260+0000","last_fullsized":"2023-07-27T14:40:00.428260+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421303+0000","last_change":"2023-07-27T14:39:59.969026+0000","last_active":"2023-07-27T14:40:00.421303+0000","last_peered":"2023-07-27T14:40:00.421303+0000","last_clean":"2023-07-27T14:40:00.421303+0000","last_became_active":"2023-07-27T14:39:59.968054+0000","last_became_peered":"2023-07-27T14:39:59.968054+0000","last_unstale":"2023-07-27T14:40:00.421303+0000","last_undegraded":"2023-07-27T14:40:00.421303+0000","last_fullsized":"2023-07-27T14:40:00.421303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414030+0000","last_change":"2023-07-27T14:39:59.969719+0000","last_active":"2023-07-27T14:40:00.414030+0000","last_peered":"2023-07-27T14:40:00.414030+0000","last_clean":"2023-07-27T14:40:00.414030+0000","last_became_active":"2023-07-27T14:39:59.969454+0000","last_became_peered":"2023-07-27T14:39:59.969454+0000","last_unstale":"2023-07-27T14:40:00.414030+0000","last_undegraded":"2023-07-27T14:40:00.414030+0000","last_fullsized":"2023-07-27T14:40:00.414030+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429829+0000","last_change":"2023-07-27T14:40:00.423000+0000","last_active":"2023-07-27T14:40:00.429829+0000","last_peered":"2023-07-27T14:40:00.429829+0000","last_clean":"2023-07-27T14:40:00.429829+0000","last_became_active":"2023-07-27T14:40:00.422645+0000","last_became_peered":"2023-07-27T14:40:00.422645+0000","last_unstale":"2023-07-27T14:40:00.429829+0000","last_undegraded":"2023-07-27T14:40:00.429829+0000","last_fullsized":"2023-07-27T14:40:00.429829+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.274076+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:39:55.274076+0000","last_peered":"2023-07-27T14:39:55.274076+0000","last_clean":"2023-07-27T14:39:55.274076+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:39:55.274076+0000","last_undegraded":"2023-07-27T14:39:55.274076+0000","last_fullsized":"2023-07-27T14:39:55.274076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417054+0000","last_change":"2023-07-27T14:39:59.980461+0000","last_active":"2023-07-27T14:40:00.417054+0000","last_peered":"2023-07-27T14:40:00.417054+0000","last_clean":"2023-07-27T14:40:00.417054+0000","last_became_active":"2023-07-27T14:39:59.980112+0000","last_became_peered":"2023-07-27T14:39:59.980112+0000","last_unstale":"2023-07-27T14:40:00.417054+0000","last_undegraded":"2023-07-27T14:40:00.417054+0000","last_fullsized":"2023-07-27T14:40:00.417054+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414305+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:40:00.414305+0000","last_peered":"2023-07-27T14:40:00.414305+0000","last_clean":"2023-07-27T14:40:00.414305+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:40:00.414305+0000","last_undegraded":"2023-07-27T14:40:00.414305+0000","last_fullsized":"2023-07-27T14:40:00.414305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420757+0000","last_change":"2023-07-27T14:39:59.973337+0000","last_active":"2023-07-27T14:40:00.420757+0000","last_peered":"2023-07-27T14:40:00.420757+0000","last_clean":"2023-07-27T14:40:00.420757+0000","last_became_active":"2023-07-27T14:39:59.972405+0000","last_became_peered":"2023-07-27T14:39:59.972405+0000","last_unstale":"2023-07-27T14:40:00.420757+0000","last_undegraded":"2023-07-27T14:40:00.420757+0000","last_fullsized":"2023-07-27T14:40:00.420757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273836+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:39:55.273836+0000","last_peered":"2023-07-27T14:39:55.273836+0000","last_clean":"2023-07-27T14:39:55.273836+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:39:55.273836+0000","last_undegraded":"2023-07-27T14:39:55.273836+0000","last_fullsized":"2023-07-27T14:39:55.273836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433860+0000","last_change":"2023-07-27T14:40:00.432392+0000","last_active":"2023-07-27T14:40:00.433860+0000","last_peered":"2023-07-27T14:40:00.433860+0000","last_clean":"2023-07-27T14:40:00.433860+0000","last_became_active":"2023-07-27T14:40:00.432087+0000","last_became_peered":"2023-07-27T14:40:00.432087+0000","last_unstale":"2023-07-27T14:40:00.433860+0000","last_undegraded":"2023-07-27T14:40:00.433860+0000","last_fullsized":"2023-07-27T14:40:00.433860+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273958+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:39:55.273958+0000","last_peered":"2023-07-27T14:39:55.273958+0000","last_clean":"2023-07-27T14:39:55.273958+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:39:55.273958+0000","last_undegraded":"2023-07-27T14:39:55.273958+0000","last_fullsized":"2023-07-27T14:39:55.273958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273837+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:39:55.273837+0000","last_peered":"2023-07-27T14:39:55.273837+0000","last_clean":"2023-07-27T14:39:55.273837+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:39:55.273837+0000","last_undegraded":"2023-07-27T14:39:55.273837+0000","last_fullsized":"2023-07-27T14:39:55.273837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273619+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:39:55.273619+0000","last_peered":"2023-07-27T14:39:55.273619+0000","last_clean":"2023-07-27T14:39:55.273619+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:39:55.273619+0000","last_undegraded":"2023-07-27T14:39:55.273619+0000","last_fullsized":"2023-07-27T14:39:55.273619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437834+0000","last_change":"2023-07-27T14:39:59.977091+0000","last_active":"2023-07-27T14:40:00.437834+0000","last_peered":"2023-07-27T14:40:00.437834+0000","last_clean":"2023-07-27T14:40:00.437834+0000","last_became_active":"2023-07-27T14:39:59.976798+0000","last_became_peered":"2023-07-27T14:39:59.976798+0000","last_unstale":"2023-07-27T14:40:00.437834+0000","last_undegraded":"2023-07-27T14:40:00.437834+0000","last_fullsized":"2023-07-27T14:40:00.437834+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419629+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:40:00.419629+0000","last_peered":"2023-07-27T14:40:00.419629+0000","last_clean":"2023-07-27T14:40:00.419629+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:40:00.419629+0000","last_undegraded":"2023-07-27T14:40:00.419629+0000","last_fullsized":"2023-07-27T14:40:00.419629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273611+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:39:55.273611+0000","last_peered":"2023-07-27T14:39:55.273611+0000","last_clean":"2023-07-27T14:39:55.273611+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:39:55.273611+0000","last_undegraded":"2023-07-27T14:39:55.273611+0000","last_fullsized":"2023-07-27T14:39:55.273611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444752+0000","last_change":"2023-07-27T14:40:00.443893+0000","last_active":"2023-07-27T14:40:00.444752+0000","last_peered":"2023-07-27T14:40:00.444752+0000","last_clean":"2023-07-27T14:40:00.444752+0000","last_became_active":"2023-07-27T14:40:00.443582+0000","last_became_peered":"2023-07-27T14:40:00.443582+0000","last_unstale":"2023-07-27T14:40:00.444752+0000","last_undegraded":"2023-07-27T14:40:00.444752+0000","last_fullsized":"2023-07-27T14:40:00.444752+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415114+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:40:00.415114+0000","last_peered":"2023-07-27T14:40:00.415114+0000","last_clean":"2023-07-27T14:40:00.415114+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:40:00.415114+0000","last_undegraded":"2023-07-27T14:40:00.415114+0000","last_fullsized":"2023-07-27T14:40:00.415114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":1660,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":60,"acting":60,"num_store_stats":4},{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575008,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25584,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":23104,"kb_avail":94346256,"statfs":{"total":96636764160,"available":96610566144,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23658496},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.60999999999999999,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.67300000000000004,"15min":0.69399999999999995},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.2599999999999998,"5min":5.2599999999999998,"15min":5.2599999999999998},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.73299999999999998,"15min":0.70499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":8.952,"5min":8.952,"15min":8.952},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"max":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.72099999999999997,"15min":0.66500000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.318},"max":{"1min":7.5640000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":5.2249999999999996,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.121,"5min":0.78900000000000003,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":8.1630000000000003,"5min":8.1630000000000003,"15min":8.1630000000000003},"last":0.872}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":0.81599999999999995,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":7.6269999999999998,"5min":7.6269999999999998,"15min":7.6269999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.54700000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.94299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25200,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":22720,"kb_avail":94346640,"statfs":{"total":96636764160,"available":96610959360,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23265280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.68400000000000005,"15min":0.627},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.83799999999999997,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.76200000000000001,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36599999999999999},"max":{"1min":0.91700000000000004,"5min":13.975,"15min":13.975},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65800000000000003,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.42199999999999999},"max":{"1min":0.93000000000000005,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92800000000000005,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.753,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.75}]},{"osd":4,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.78800000000000003,"15min":0.67400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68100000000000005,"15min":0.67000000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.72199999999999998,"15min":0.68600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.84399999999999997,"15min":0.73699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":15.461,"15min":15.461},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82899999999999996,"15min":0.78300000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":0.94399999999999995,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.83499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25572,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":23040,"kb_avail":94346268,"statfs":{"total":96636764160,"available":96610578432,"internally_reserved":0,"allocated":2584576,"data_stored":1227961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23592960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.438},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57499999999999996,"5min":0.61499999999999999,"15min":4.75},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.51700000000000002},"min":{"1min":0.25600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":0.65700000000000003,"15min":9.3100000000000005},"last":0.377}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.495},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.7160000000000002},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32800000000000001},"max":{"1min":0.65600000000000003,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.504},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":3.8580000000000001},"last":0.435}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.54200000000000004,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":1.071,"5min":1.111,"15min":2.181},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":2.4180000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.57899999999999996,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.121,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":1.0609999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.72299999999999998},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.052},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.76300000000000001},"min":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0549999999999999,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.625}]},{"osd":7,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44800000000000001},"max":{"1min":1.0349999999999999,"5min":1.1419999999999999,"15min":2.016},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.59999999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1839999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23980,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":21440,"kb_avail":94347860,"statfs":{"total":96636764160,"available":96612208640,"internally_reserved":0,"allocated":2592768,"data_stored":1228923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21954560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.73199999999999998,"5min":1.954,"15min":1.954},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46899999999999997},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":1.0660000000000001,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.48299999999999998,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.97599999999999998,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53100000000000003,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.6020000000000001},"last":0.63}]},{"osd":6,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.498},"max":{"1min":1.0469999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.44,"15min":0.44},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.22},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.113,"5min":2.141,"15min":2.141},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.125,"15min":1.2370000000000001},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":25088,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":2600960,"data_stored":1229463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25690112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23799999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42299999999999999,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.1899999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.96399999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":5.601},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.83499999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.51100000000000001},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.754,"5min":1.002,"15min":1.353},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.42999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.849},"last":0.878},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":6.9660000000000002},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":1.163,"15min":1.163},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.772},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69399999999999995,"15min":0.71499999999999997},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73299999999999998,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":3.1360000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.499,"15min":0.499},"max":{"1min":1.01,"5min":1.024,"15min":1.8089999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72999999999999998,"15min":0.76400000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.84499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23912,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94347928,"statfs":{"total":96636764160,"available":96612278272,"internally_reserved":0,"allocated":2588672,"data_stored":1228515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.497,"5min":0.66800000000000004,"15min":1.202},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.42899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.302},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.54500000000000004,"5min":0.64200000000000002,"15min":1.2390000000000001},"last":0.497}]},{"osd":2,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.48499999999999999,"15min":0.504},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65700000000000003,"5min":0.68899999999999995,"15min":1.8029999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.68799999999999994},"min":{"1min":0.497,"5min":0.436,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.149},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.71699999999999997},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":5.1059999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.56100000000000005,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0229999999999999,"15min":1.232},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70199999999999996,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.90300000000000002,"5min":0.97799999999999998,"15min":1.298},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.504,"5min":0.501,"15min":0.44},"max":{"1min":0.93300000000000005,"5min":1.0129999999999999,"15min":1.343},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.98899999999999999,"5min":1.115,"15min":2.048},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.51700000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":18544,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94353296,"statfs":{"total":96636764160,"available":96617775104,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93200000000000005,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.53000000000000003,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":3.419,"15min":4.4409999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.439,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.79000000000000004,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.51300000000000001,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":2.3010000000000002,"15min":4.476},"last":0.755}]},{"osd":3,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.79700000000000004,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54100000000000004,"5min":0.46700000000000003,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":3.48,"15min":4.3949999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.8620000000000001,"15min":5.194},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85399999999999998,"5min":2.387,"15min":5.5990000000000002},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.78800000000000003,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.34599999999999997},"max":{"1min":0.83899999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26608,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94345232,"statfs":{"total":96636764160,"available":96609517568,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.317},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.443,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":1.026,"15min":6.7489999999999997},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.67500000000000004},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":0.98799999999999999,"15min":1.581},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.69299999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":5.5750000000000002,"5min":5.5750000000000002,"15min":5.5750000000000002},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.67200000000000004},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.874,"5min":0.875,"15min":9.6920000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":1.012}]},{"osd":4,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":1.978},"last":1.071},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":2.4129999999999998},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.78300000000000003,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.96399999999999997,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":1.151}]},{"osd":7,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.3719999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.57199999999999995,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.88600000000000001,"5min":1.115,"15min":1.9419999999999999},"last":1.0960000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:40:04.750 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:40:04.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.911+0000 7ff2197ff700 1 Processor -- start 2023-07-27T14:40:04.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.911+0000 7ff2197ff700 1 -- start start 2023-07-27T14:40:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff2197ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff214153ec0 0x7ff2140a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff2197ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aa050 0x7ff2140640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff2197ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140aa4d0 con 0x7ff2140aaa40 2023-07-27T14:40:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff2197ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140c05c0 con 0x7ff214153ec0 2023-07-27T14:40:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff2197ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c1a60 con 0x7ff2140aa050 2023-07-27T14:40:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff212ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff214153ec0 0x7ff2140a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff2137fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff2140aaa40 0x7ff214157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34794/0 (socket says 172.21.15.115:34794) 2023-07-27T14:40:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff2137fe700 1 -- 172.21.15.115:0/2306823570 learned_addr learned my addr 172.21.15.115:0/2306823570 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:04.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.912+0000 7ff2127fc700 1 --2- 172.21.15.115:0/2306823570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aa050 0x7ff2140640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff212ffd700 1 -- 172.21.15.115:0/2306823570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aa050 msgr2=0x7ff2140640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:04.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff212ffd700 1 --2- 172.21.15.115:0/2306823570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aa050 0x7ff2140640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff212ffd700 1 -- 172.21.15.115:0/2306823570 >> v1:172.21.15.115:6789/0 conn(0x7ff2140aaa40 legacy=0x7ff214157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff212ffd700 1 -- 172.21.15.115:0/2306823570 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140bfc90 con 0x7ff214153ec0 2023-07-27T14:40:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff211ffb700 1 -- 172.21.15.115:0/2306823570 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835440733 0 0) 0x7ff20c001490 con 0x7ff2140aaa40 2023-07-27T14:40:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff212ffd700 1 --2- 172.21.15.115:0/2306823570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff2140a9b60 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 rx=0x7ff204009760 tx=0x7ff204009060).ready entity=mon.0 client_cookie=1c0963206870a74e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff211ffb700 1 -- 172.21.15.115:0/2306823570 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400f510 con 0x7ff214153ec0 2023-07-27T14:40:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff211ffb700 1 -- 172.21.15.115:0/2306823570 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20400f670 con 0x7ff214153ec0 2023-07-27T14:40:04.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.913+0000 7ff211ffb700 1 -- 172.21.15.115:0/2306823570 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400f9f0 con 0x7ff214153ec0 2023-07-27T14:40:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.914+0000 7ff2197ff700 1 -- 172.21.15.115:0/2306823570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 msgr2=0x7ff2140a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.914+0000 7ff2197ff700 1 --2- 172.21.15.115:0/2306823570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff2140a9b60 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 rx=0x7ff204009760 tx=0x7ff204009060).stop 2023-07-27T14:40:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.914+0000 7ff2197ff700 1 -- 172.21.15.115:0/2306823570 shutdown_connections 2023-07-27T14:40:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.914+0000 7ff2197ff700 1 --2- 172.21.15.115:0/2306823570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff2140a9b60 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.914+0000 7ff2197ff700 1 --2- 172.21.15.115:0/2306823570 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aa050 0x7ff2140640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.914+0000 7ff2197ff700 1 -- 172.21.15.115:0/2306823570 >> 172.21.15.115:0/2306823570 conn(0x7ff2140cb610 msgr2=0x7ff2140c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.914+0000 7ff2197ff700 1 -- 172.21.15.115:0/2306823570 shutdown_connections 2023-07-27T14:40:04.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.914+0000 7ff2197ff700 1 -- 172.21.15.115:0/2306823570 wait complete. 2023-07-27T14:40:04.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.915+0000 7ff2197ff700 1 Processor -- start 2023-07-27T14:40:04.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.916+0000 7ff2197ff700 1 -- start start 2023-07-27T14:40:04.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.916+0000 7ff2197ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2140aa050 0x7ff214150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2197ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aaa40 0x7ff214141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2197ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff214150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2197ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2141537b0 con 0x7ff214153ec0 2023-07-27T14:40:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2197ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2141534d0 con 0x7ff2140aa050 2023-07-27T14:40:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2197ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff214151c20 con 0x7ff2140aaa40 2023-07-27T14:40:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2137fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff214150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff212ffd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2140aa050 0x7ff214150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2137fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff214150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50542/0 (socket says 172.21.15.115:50542) 2023-07-27T14:40:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2137fe700 1 -- 172.21.15.115:0/1122848231 learned_addr learned my addr 172.21.15.115:0/1122848231 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2127fc700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aaa40 0x7ff214141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2137fe700 1 -- 172.21.15.115:0/1122848231 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aaa40 msgr2=0x7ff214141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2137fe700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aaa40 0x7ff214141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2137fe700 1 -- 172.21.15.115:0/1122848231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2140aa050 msgr2=0x7ff214150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2137fe700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2140aa050 0x7ff214150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:04.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.917+0000 7ff2137fe700 1 -- 172.21.15.115:0/1122848231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040092a0 con 0x7ff214153ec0 2023-07-27T14:40:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.918+0000 7ff2137fe700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff214150fb0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 rx=0x7ff20c00c760 tx=0x7ff20c007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.918+0000 7ff1faffd700 1 -- 172.21.15.115:0/1122848231 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c005d30 con 0x7ff214153ec0 2023-07-27T14:40:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.918+0000 7ff1faffd700 1 -- 172.21.15.115:0/1122848231 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c005e90 con 0x7ff214153ec0 2023-07-27T14:40:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.918+0000 7ff1faffd700 1 -- 172.21.15.115:0/1122848231 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0072e0 con 0x7ff214153ec0 2023-07-27T14:40:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.918+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff214151f00 con 0x7ff214153ec0 2023-07-27T14:40:04.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.918+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff214150bf0 con 0x7ff214153ec0 2023-07-27T14:40:04.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.919+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21406c470 con 0x7ff214153ec0 2023-07-27T14:40:04.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.920+0000 7ff1faffd700 1 -- 172.21.15.115:0/1122848231 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7ff20c010070 con 0x7ff214153ec0 2023-07-27T14:40:04.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.921+0000 7ff1faffd700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20005fc90 0x7ff200062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:04.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.921+0000 7ff1faffd700 1 -- 172.21.15.115:0/1122848231 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7ff20c07aa40 con 0x7ff214153ec0 2023-07-27T14:40:04.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.921+0000 7ff212ffd700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20005fc90 0x7ff200062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:04.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.921+0000 7ff212ffd700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20005fc90 0x7ff200062150 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7ff204009fd0 tx=0x7ff204017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:04.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:04.924+0000 7ff1faffd700 1 -- 172.21.15.115:0/1122848231 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff20c04af80 con 0x7ff214153ec0 2023-07-27T14:40:05.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.088+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2140aa4d0 con 0x7ff20005fc90 2023-07-27T14:40:05.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.098+0000 7ff1faffd700 1 -- 172.21.15.115:0/1122848231 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355318 (secure 0 0 0) 0x7ff2140aa4d0 con 0x7ff20005fc90 2023-07-27T14:40:05.158 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:05.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20005fc90 msgr2=0x7ff200062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20005fc90 0x7ff200062150 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7ff204009fd0 tx=0x7ff204017000).stop 2023-07-27T14:40:05.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 msgr2=0x7ff214150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff214150fb0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 rx=0x7ff20c00c760 tx=0x7ff20c007d50).stop 2023-07-27T14:40:05.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 shutdown_connections 2023-07-27T14:40:05.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff20005fc90 0x7ff200062150 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff214153ec0 0x7ff214150fb0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2140aa050 0x7ff214150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.102+0000 7ff2197ff700 1 --2- 172.21.15.115:0/1122848231 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff2140aaa40 0x7ff214141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.103+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 >> 172.21.15.115:0/1122848231 conn(0x7ff2140cb610 msgr2=0x7ff2140ab410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:05.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.103+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 shutdown_connections 2023-07-27T14:40:05.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.103+0000 7ff2197ff700 1 -- 172.21.15.115:0/1122848231 wait complete. 2023-07-27T14:40:05.166 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:40:05.175 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2023-07-27T14:40:03.616910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1660,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":132,"acting":132,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":197036,"kb_used_data":20012,"kb_used_omap":0,"kb_used_meta":176960,"kb_avail":754777684,"statfs":{"total":773094113280,"available":772892348416,"internally_reserved":0,"allocated":20492288,"data_stored":9718766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":181207040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-536377,"num_objects":-25,"num_object_clones":-1,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":-1,"num_read":-22,"num_read_kb":-8208,"num_write":-237,"num_write_kb":-17007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.033841"},"pg_stats":[{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417014+0000","last_change":"2023-07-27T14:39:59.980161+0000","last_active":"2023-07-27T14:40:00.417014+0000","last_peered":"2023-07-27T14:40:00.417014+0000","last_clean":"2023-07-27T14:40:00.417014+0000","last_became_active":"2023-07-27T14:39:59.977406+0000","last_became_peered":"2023-07-27T14:39:59.977406+0000","last_unstale":"2023-07-27T14:40:00.417014+0000","last_undegraded":"2023-07-27T14:40:00.417014+0000","last_fullsized":"2023-07-27T14:40:00.417014+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.430754+0000","last_change":"2023-07-27T14:40:00.428058+0000","last_active":"2023-07-27T14:40:00.430754+0000","last_peered":"2023-07-27T14:40:00.430754+0000","last_clean":"2023-07-27T14:40:00.430754+0000","last_became_active":"2023-07-27T14:40:00.427765+0000","last_became_peered":"2023-07-27T14:40:00.427765+0000","last_unstale":"2023-07-27T14:40:00.430754+0000","last_undegraded":"2023-07-27T14:40:00.430754+0000","last_fullsized":"2023-07-27T14:40:00.430754+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414833+0000","last_change":"2023-07-27T14:39:59.969560+0000","last_active":"2023-07-27T14:40:00.414833+0000","last_peered":"2023-07-27T14:40:00.414833+0000","last_clean":"2023-07-27T14:40:00.414833+0000","last_became_active":"2023-07-27T14:39:59.969284+0000","last_became_peered":"2023-07-27T14:39:59.969284+0000","last_unstale":"2023-07-27T14:40:00.414833+0000","last_undegraded":"2023-07-27T14:40:00.414833+0000","last_fullsized":"2023-07-27T14:40:00.414833+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428818+0000","last_change":"2023-07-27T14:40:00.424519+0000","last_active":"2023-07-27T14:40:00.428818+0000","last_peered":"2023-07-27T14:40:00.428818+0000","last_clean":"2023-07-27T14:40:00.428818+0000","last_became_active":"2023-07-27T14:40:00.424269+0000","last_became_peered":"2023-07-27T14:40:00.424269+0000","last_unstale":"2023-07-27T14:40:00.428818+0000","last_undegraded":"2023-07-27T14:40:00.428818+0000","last_fullsized":"2023-07-27T14:40:00.428818+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441990+0000","last_change":"2023-07-27T14:39:59.975564+0000","last_active":"2023-07-27T14:40:00.441990+0000","last_peered":"2023-07-27T14:40:00.441990+0000","last_clean":"2023-07-27T14:40:00.441990+0000","last_became_active":"2023-07-27T14:39:59.975257+0000","last_became_peered":"2023-07-27T14:39:59.975257+0000","last_unstale":"2023-07-27T14:40:00.441990+0000","last_undegraded":"2023-07-27T14:40:00.441990+0000","last_fullsized":"2023-07-27T14:40:00.441990+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428069+0000","last_change":"2023-07-27T14:40:00.423653+0000","last_active":"2023-07-27T14:40:00.428069+0000","last_peered":"2023-07-27T14:40:00.428069+0000","last_clean":"2023-07-27T14:40:00.428069+0000","last_became_active":"2023-07-27T14:40:00.423374+0000","last_became_peered":"2023-07-27T14:40:00.423374+0000","last_unstale":"2023-07-27T14:40:00.428069+0000","last_undegraded":"2023-07-27T14:40:00.428069+0000","last_fullsized":"2023-07-27T14:40:00.428069+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.434568+0000","last_change":"2023-07-27T14:40:00.433310+0000","last_active":"2023-07-27T14:40:00.434568+0000","last_peered":"2023-07-27T14:40:00.434568+0000","last_clean":"2023-07-27T14:40:00.434568+0000","last_became_active":"2023-07-27T14:40:00.432861+0000","last_became_peered":"2023-07-27T14:40:00.432861+0000","last_unstale":"2023-07-27T14:40:00.434568+0000","last_undegraded":"2023-07-27T14:40:00.434568+0000","last_fullsized":"2023-07-27T14:40:00.434568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419495+0000","last_change":"2023-07-27T14:39:59.975414+0000","last_active":"2023-07-27T14:40:00.419495+0000","last_peered":"2023-07-27T14:40:00.419495+0000","last_clean":"2023-07-27T14:40:00.419495+0000","last_became_active":"2023-07-27T14:39:59.975123+0000","last_became_peered":"2023-07-27T14:39:59.975123+0000","last_unstale":"2023-07-27T14:40:00.419495+0000","last_undegraded":"2023-07-27T14:40:00.419495+0000","last_fullsized":"2023-07-27T14:40:00.419495+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428833+0000","last_change":"2023-07-27T14:40:00.424211+0000","last_active":"2023-07-27T14:40:00.428833+0000","last_peered":"2023-07-27T14:40:00.428833+0000","last_clean":"2023-07-27T14:40:00.428833+0000","last_became_active":"2023-07-27T14:40:00.423930+0000","last_became_peered":"2023-07-27T14:40:00.423930+0000","last_unstale":"2023-07-27T14:40:00.428833+0000","last_undegraded":"2023-07-27T14:40:00.428833+0000","last_fullsized":"2023-07-27T14:40:00.428833+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420653+0000","last_change":"2023-07-27T14:39:59.972452+0000","last_active":"2023-07-27T14:40:00.420653+0000","last_peered":"2023-07-27T14:40:00.420653+0000","last_clean":"2023-07-27T14:40:00.420653+0000","last_became_active":"2023-07-27T14:39:59.972166+0000","last_became_peered":"2023-07-27T14:39:59.972166+0000","last_unstale":"2023-07-27T14:40:00.420653+0000","last_undegraded":"2023-07-27T14:40:00.420653+0000","last_fullsized":"2023-07-27T14:40:00.420653+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415169+0000","last_change":"2023-07-27T14:39:59.970599+0000","last_active":"2023-07-27T14:40:00.415169+0000","last_peered":"2023-07-27T14:40:00.415169+0000","last_clean":"2023-07-27T14:40:00.415169+0000","last_became_active":"2023-07-27T14:39:59.970336+0000","last_became_peered":"2023-07-27T14:39:59.970336+0000","last_unstale":"2023-07-27T14:40:00.415169+0000","last_undegraded":"2023-07-27T14:40:00.415169+0000","last_fullsized":"2023-07-27T14:40:00.415169+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.34","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446741+0000","last_change":"2023-07-27T14:39:59.970857+0000","last_active":"2023-07-27T14:40:00.446741+0000","last_peered":"2023-07-27T14:40:00.446741+0000","last_clean":"2023-07-27T14:40:00.446741+0000","last_became_active":"2023-07-27T14:39:59.970436+0000","last_became_peered":"2023-07-27T14:39:59.970436+0000","last_unstale":"2023-07-27T14:40:00.446741+0000","last_undegraded":"2023-07-27T14:40:00.446741+0000","last_fullsized":"2023-07-27T14:40:00.446741+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447435+0000","last_change":"2023-07-27T14:40:00.446561+0000","last_active":"2023-07-27T14:40:00.447435+0000","last_peered":"2023-07-27T14:40:00.447435+0000","last_clean":"2023-07-27T14:40:00.447435+0000","last_became_active":"2023-07-27T14:40:00.446240+0000","last_became_peered":"2023-07-27T14:40:00.446240+0000","last_unstale":"2023-07-27T14:40:00.447435+0000","last_undegraded":"2023-07-27T14:40:00.447435+0000","last_fullsized":"2023-07-27T14:40:00.447435+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.30","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441928+0000","last_change":"2023-07-27T14:39:59.963969+0000","last_active":"2023-07-27T14:40:00.441928+0000","last_peered":"2023-07-27T14:40:00.441928+0000","last_clean":"2023-07-27T14:40:00.441928+0000","last_became_active":"2023-07-27T14:39:59.963693+0000","last_became_peered":"2023-07-27T14:39:59.963693+0000","last_unstale":"2023-07-27T14:40:00.441928+0000","last_undegraded":"2023-07-27T14:40:00.441928+0000","last_fullsized":"2023-07-27T14:40:00.441928+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439272+0000","last_change":"2023-07-27T14:40:00.436081+0000","last_active":"2023-07-27T14:40:00.439272+0000","last_peered":"2023-07-27T14:40:00.439272+0000","last_clean":"2023-07-27T14:40:00.439272+0000","last_became_active":"2023-07-27T14:40:00.435741+0000","last_became_peered":"2023-07-27T14:40:00.435741+0000","last_unstale":"2023-07-27T14:40:00.439272+0000","last_undegraded":"2023-07-27T14:40:00.439272+0000","last_fullsized":"2023-07-27T14:40:00.439272+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420765+0000","last_change":"2023-07-27T14:39:59.964330+0000","last_active":"2023-07-27T14:40:00.420765+0000","last_peered":"2023-07-27T14:40:00.420765+0000","last_clean":"2023-07-27T14:40:00.420765+0000","last_became_active":"2023-07-27T14:39:59.964054+0000","last_became_peered":"2023-07-27T14:39:59.964054+0000","last_unstale":"2023-07-27T14:40:00.420765+0000","last_undegraded":"2023-07-27T14:40:00.420765+0000","last_fullsized":"2023-07-27T14:40:00.420765+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419374+0000","last_change":"2023-07-27T14:39:59.963318+0000","last_active":"2023-07-27T14:40:00.419374+0000","last_peered":"2023-07-27T14:40:00.419374+0000","last_clean":"2023-07-27T14:40:00.419374+0000","last_became_active":"2023-07-27T14:39:59.963055+0000","last_became_peered":"2023-07-27T14:39:59.963055+0000","last_unstale":"2023-07-27T14:40:00.419374+0000","last_undegraded":"2023-07-27T14:40:00.419374+0000","last_fullsized":"2023-07-27T14:40:00.419374+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428862+0000","last_change":"2023-07-27T14:40:00.423749+0000","last_active":"2023-07-27T14:40:00.428862+0000","last_peered":"2023-07-27T14:40:00.428862+0000","last_clean":"2023-07-27T14:40:00.428862+0000","last_became_active":"2023-07-27T14:40:00.423476+0000","last_became_peered":"2023-07-27T14:40:00.423476+0000","last_unstale":"2023-07-27T14:40:00.428862+0000","last_undegraded":"2023-07-27T14:40:00.428862+0000","last_fullsized":"2023-07-27T14:40:00.428862+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438324+0000","last_change":"2023-07-27T14:40:00.432481+0000","last_active":"2023-07-27T14:40:00.438324+0000","last_peered":"2023-07-27T14:40:00.438324+0000","last_clean":"2023-07-27T14:40:00.438324+0000","last_became_active":"2023-07-27T14:40:00.431034+0000","last_became_peered":"2023-07-27T14:40:00.431034+0000","last_unstale":"2023-07-27T14:40:00.438324+0000","last_undegraded":"2023-07-27T14:40:00.438324+0000","last_fullsized":"2023-07-27T14:40:00.438324+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431884+0000","last_change":"2023-07-27T14:40:00.430299+0000","last_active":"2023-07-27T14:40:00.431884+0000","last_peered":"2023-07-27T14:40:00.431884+0000","last_clean":"2023-07-27T14:40:00.431884+0000","last_became_active":"2023-07-27T14:40:00.430033+0000","last_became_peered":"2023-07-27T14:40:00.430033+0000","last_unstale":"2023-07-27T14:40:00.431884+0000","last_undegraded":"2023-07-27T14:40:00.431884+0000","last_fullsized":"2023-07-27T14:40:00.431884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438453+0000","last_change":"2023-07-27T14:40:00.431553+0000","last_active":"2023-07-27T14:40:00.438453+0000","last_peered":"2023-07-27T14:40:00.438453+0000","last_clean":"2023-07-27T14:40:00.438453+0000","last_became_active":"2023-07-27T14:40:00.430671+0000","last_became_peered":"2023-07-27T14:40:00.430671+0000","last_unstale":"2023-07-27T14:40:00.438453+0000","last_undegraded":"2023-07-27T14:40:00.438453+0000","last_fullsized":"2023-07-27T14:40:00.438453+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428295+0000","last_change":"2023-07-27T14:40:00.424022+0000","last_active":"2023-07-27T14:40:00.428295+0000","last_peered":"2023-07-27T14:40:00.428295+0000","last_clean":"2023-07-27T14:40:00.428295+0000","last_became_active":"2023-07-27T14:40:00.423746+0000","last_became_peered":"2023-07-27T14:40:00.423746+0000","last_unstale":"2023-07-27T14:40:00.428295+0000","last_undegraded":"2023-07-27T14:40:00.428295+0000","last_fullsized":"2023-07-27T14:40:00.428295+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.416887+0000","last_change":"2023-07-27T14:39:59.980446+0000","last_active":"2023-07-27T14:40:00.416887+0000","last_peered":"2023-07-27T14:40:00.416887+0000","last_clean":"2023-07-27T14:40:00.416887+0000","last_became_active":"2023-07-27T14:39:59.980179+0000","last_became_peered":"2023-07-27T14:39:59.980179+0000","last_unstale":"2023-07-27T14:40:00.416887+0000","last_undegraded":"2023-07-27T14:40:00.416887+0000","last_fullsized":"2023-07-27T14:40:00.416887+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419078+0000","last_change":"2023-07-27T14:39:59.976359+0000","last_active":"2023-07-27T14:40:00.419078+0000","last_peered":"2023-07-27T14:40:00.419078+0000","last_clean":"2023-07-27T14:40:00.419078+0000","last_became_active":"2023-07-27T14:39:59.976086+0000","last_became_peered":"2023-07-27T14:39:59.976086+0000","last_unstale":"2023-07-27T14:40:00.419078+0000","last_undegraded":"2023-07-27T14:40:00.419078+0000","last_fullsized":"2023-07-27T14:40:00.419078+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427709+0000","last_change":"2023-07-27T14:40:00.425690+0000","last_active":"2023-07-27T14:40:00.427709+0000","last_peered":"2023-07-27T14:40:00.427709+0000","last_clean":"2023-07-27T14:40:00.427709+0000","last_became_active":"2023-07-27T14:40:00.425433+0000","last_became_peered":"2023-07-27T14:40:00.425433+0000","last_unstale":"2023-07-27T14:40:00.427709+0000","last_undegraded":"2023-07-27T14:40:00.427709+0000","last_fullsized":"2023-07-27T14:40:00.427709+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420864+0000","last_change":"2023-07-27T14:39:59.962795+0000","last_active":"2023-07-27T14:40:00.420864+0000","last_peered":"2023-07-27T14:40:00.420864+0000","last_clean":"2023-07-27T14:40:00.420864+0000","last_became_active":"2023-07-27T14:39:59.962537+0000","last_became_peered":"2023-07-27T14:39:59.962537+0000","last_unstale":"2023-07-27T14:40:00.420864+0000","last_undegraded":"2023-07-27T14:40:00.420864+0000","last_fullsized":"2023-07-27T14:40:00.420864+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427352+0000","last_change":"2023-07-27T14:40:00.422356+0000","last_active":"2023-07-27T14:40:00.427352+0000","last_peered":"2023-07-27T14:40:00.427352+0000","last_clean":"2023-07-27T14:40:00.427352+0000","last_became_active":"2023-07-27T14:40:00.422057+0000","last_became_peered":"2023-07-27T14:40:00.422057+0000","last_unstale":"2023-07-27T14:40:00.427352+0000","last_undegraded":"2023-07-27T14:40:00.427352+0000","last_fullsized":"2023-07-27T14:40:00.427352+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415297+0000","last_change":"2023-07-27T14:39:59.970682+0000","last_active":"2023-07-27T14:40:00.415297+0000","last_peered":"2023-07-27T14:40:00.415297+0000","last_clean":"2023-07-27T14:40:00.415297+0000","last_became_active":"2023-07-27T14:39:59.970351+0000","last_became_peered":"2023-07-27T14:39:59.970351+0000","last_unstale":"2023-07-27T14:40:00.415297+0000","last_undegraded":"2023-07-27T14:40:00.415297+0000","last_fullsized":"2023-07-27T14:40:00.415297+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418696+0000","last_change":"2023-07-27T14:39:59.978710+0000","last_active":"2023-07-27T14:40:00.418696+0000","last_peered":"2023-07-27T14:40:00.418696+0000","last_clean":"2023-07-27T14:40:00.418696+0000","last_became_active":"2023-07-27T14:39:59.978442+0000","last_became_peered":"2023-07-27T14:39:59.978442+0000","last_unstale":"2023-07-27T14:40:00.418696+0000","last_undegraded":"2023-07-27T14:40:00.418696+0000","last_fullsized":"2023-07-27T14:40:00.418696+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418997+0000","last_change":"2023-07-27T14:39:59.974113+0000","last_active":"2023-07-27T14:40:00.418997+0000","last_peered":"2023-07-27T14:40:00.418997+0000","last_clean":"2023-07-27T14:40:00.418997+0000","last_became_active":"2023-07-27T14:39:59.973820+0000","last_became_peered":"2023-07-27T14:39:59.973820+0000","last_unstale":"2023-07-27T14:40:00.418997+0000","last_undegraded":"2023-07-27T14:40:00.418997+0000","last_fullsized":"2023-07-27T14:40:00.418997+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442334+0000","last_change":"2023-07-27T14:40:00.441511+0000","last_active":"2023-07-27T14:40:00.442334+0000","last_peered":"2023-07-27T14:40:00.442334+0000","last_clean":"2023-07-27T14:40:00.442334+0000","last_became_active":"2023-07-27T14:40:00.441161+0000","last_became_peered":"2023-07-27T14:40:00.441161+0000","last_unstale":"2023-07-27T14:40:00.442334+0000","last_undegraded":"2023-07-27T14:40:00.442334+0000","last_fullsized":"2023-07-27T14:40:00.442334+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428642+0000","last_change":"2023-07-27T14:40:00.424395+0000","last_active":"2023-07-27T14:40:00.428642+0000","last_peered":"2023-07-27T14:40:00.428642+0000","last_clean":"2023-07-27T14:40:00.428642+0000","last_became_active":"2023-07-27T14:40:00.424127+0000","last_became_peered":"2023-07-27T14:40:00.424127+0000","last_unstale":"2023-07-27T14:40:00.428642+0000","last_undegraded":"2023-07-27T14:40:00.428642+0000","last_fullsized":"2023-07-27T14:40:00.428642+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419473+0000","last_change":"2023-07-27T14:39:59.966964+0000","last_active":"2023-07-27T14:40:00.419473+0000","last_peered":"2023-07-27T14:40:00.419473+0000","last_clean":"2023-07-27T14:40:00.419473+0000","last_became_active":"2023-07-27T14:39:59.966695+0000","last_became_peered":"2023-07-27T14:39:59.966695+0000","last_unstale":"2023-07-27T14:40:00.419473+0000","last_undegraded":"2023-07-27T14:40:00.419473+0000","last_fullsized":"2023-07-27T14:40:00.419473+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"204'3","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440604+0000","last_change":"2023-07-27T14:39:59.962153+0000","last_active":"2023-07-27T14:40:00.440604+0000","last_peered":"2023-07-27T14:40:00.440604+0000","last_clean":"2023-07-27T14:40:00.440604+0000","last_became_active":"2023-07-27T14:39:59.961854+0000","last_became_peered":"2023-07-27T14:39:59.961854+0000","last_unstale":"2023-07-27T14:40:00.440604+0000","last_undegraded":"2023-07-27T14:40:00.440604+0000","last_fullsized":"2023-07-27T14:40:00.440604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440839+0000","last_change":"2023-07-27T14:39:59.973460+0000","last_active":"2023-07-27T14:40:00.440839+0000","last_peered":"2023-07-27T14:40:00.440839+0000","last_clean":"2023-07-27T14:40:00.440839+0000","last_became_active":"2023-07-27T14:39:59.973163+0000","last_became_peered":"2023-07-27T14:39:59.973163+0000","last_unstale":"2023-07-27T14:40:00.440839+0000","last_undegraded":"2023-07-27T14:40:00.440839+0000","last_fullsized":"2023-07-27T14:40:00.440839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431539+0000","last_change":"2023-07-27T14:40:00.426655+0000","last_active":"2023-07-27T14:40:00.431539+0000","last_peered":"2023-07-27T14:40:00.431539+0000","last_clean":"2023-07-27T14:40:00.431539+0000","last_became_active":"2023-07-27T14:40:00.426182+0000","last_became_peered":"2023-07-27T14:40:00.426182+0000","last_unstale":"2023-07-27T14:40:00.431539+0000","last_undegraded":"2023-07-27T14:40:00.431539+0000","last_fullsized":"2023-07-27T14:40:00.431539+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444068+0000","last_change":"2023-07-27T14:39:59.983557+0000","last_active":"2023-07-27T14:40:00.444068+0000","last_peered":"2023-07-27T14:40:00.444068+0000","last_clean":"2023-07-27T14:40:00.444068+0000","last_became_active":"2023-07-27T14:39:59.983347+0000","last_became_peered":"2023-07-27T14:39:59.983347+0000","last_unstale":"2023-07-27T14:40:00.444068+0000","last_undegraded":"2023-07-27T14:40:00.444068+0000","last_fullsized":"2023-07-27T14:40:00.444068+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421067+0000","last_change":"2023-07-27T14:39:59.972458+0000","last_active":"2023-07-27T14:40:00.421067+0000","last_peered":"2023-07-27T14:40:00.421067+0000","last_clean":"2023-07-27T14:40:00.421067+0000","last_became_active":"2023-07-27T14:39:59.972157+0000","last_became_peered":"2023-07-27T14:39:59.972157+0000","last_unstale":"2023-07-27T14:40:00.421067+0000","last_undegraded":"2023-07-27T14:40:00.421067+0000","last_fullsized":"2023-07-27T14:40:00.421067+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.413941+0000","last_change":"2023-07-27T14:39:59.968781+0000","last_active":"2023-07-27T14:40:00.413941+0000","last_peered":"2023-07-27T14:40:00.413941+0000","last_clean":"2023-07-27T14:40:00.413941+0000","last_became_active":"2023-07-27T14:39:59.968014+0000","last_became_peered":"2023-07-27T14:39:59.968014+0000","last_unstale":"2023-07-27T14:40:00.413941+0000","last_undegraded":"2023-07-27T14:40:00.413941+0000","last_fullsized":"2023-07-27T14:40:00.413941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432889+0000","last_change":"2023-07-27T14:40:00.428525+0000","last_active":"2023-07-27T14:40:00.432889+0000","last_peered":"2023-07-27T14:40:00.432889+0000","last_clean":"2023-07-27T14:40:00.432889+0000","last_became_active":"2023-07-27T14:40:00.428213+0000","last_became_peered":"2023-07-27T14:40:00.428213+0000","last_unstale":"2023-07-27T14:40:00.432889+0000","last_undegraded":"2023-07-27T14:40:00.432889+0000","last_fullsized":"2023-07-27T14:40:00.432889+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439610+0000","last_change":"2023-07-27T14:40:00.436729+0000","last_active":"2023-07-27T14:40:00.439610+0000","last_peered":"2023-07-27T14:40:00.439610+0000","last_clean":"2023-07-27T14:40:00.439610+0000","last_became_active":"2023-07-27T14:40:00.436469+0000","last_became_peered":"2023-07-27T14:40:00.436469+0000","last_unstale":"2023-07-27T14:40:00.439610+0000","last_undegraded":"2023-07-27T14:40:00.439610+0000","last_fullsized":"2023-07-27T14:40:00.439610+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439513+0000","last_change":"2023-07-27T14:39:59.972384+0000","last_active":"2023-07-27T14:40:00.439513+0000","last_peered":"2023-07-27T14:40:00.439513+0000","last_clean":"2023-07-27T14:40:00.439513+0000","last_became_active":"2023-07-27T14:39:59.972023+0000","last_became_peered":"2023-07-27T14:39:59.972023+0000","last_unstale":"2023-07-27T14:40:00.439513+0000","last_undegraded":"2023-07-27T14:40:00.439513+0000","last_fullsized":"2023-07-27T14:40:00.439513+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418246+0000","last_change":"2023-07-27T14:39:59.971231+0000","last_active":"2023-07-27T14:40:00.418246+0000","last_peered":"2023-07-27T14:40:00.418246+0000","last_clean":"2023-07-27T14:40:00.418246+0000","last_became_active":"2023-07-27T14:39:59.970964+0000","last_became_peered":"2023-07-27T14:39:59.970964+0000","last_unstale":"2023-07-27T14:40:00.418246+0000","last_undegraded":"2023-07-27T14:40:00.418246+0000","last_fullsized":"2023-07-27T14:40:00.418246+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428953+0000","last_change":"2023-07-27T14:40:00.424947+0000","last_active":"2023-07-27T14:40:00.428953+0000","last_peered":"2023-07-27T14:40:00.428953+0000","last_clean":"2023-07-27T14:40:00.428953+0000","last_became_active":"2023-07-27T14:40:00.424664+0000","last_became_peered":"2023-07-27T14:40:00.424664+0000","last_unstale":"2023-07-27T14:40:00.428953+0000","last_undegraded":"2023-07-27T14:40:00.428953+0000","last_fullsized":"2023-07-27T14:40:00.428953+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433045+0000","last_change":"2023-07-27T14:40:00.428558+0000","last_active":"2023-07-27T14:40:00.433045+0000","last_peered":"2023-07-27T14:40:00.433045+0000","last_clean":"2023-07-27T14:40:00.433045+0000","last_became_active":"2023-07-27T14:40:00.428225+0000","last_became_peered":"2023-07-27T14:40:00.428225+0000","last_unstale":"2023-07-27T14:40:00.433045+0000","last_undegraded":"2023-07-27T14:40:00.433045+0000","last_fullsized":"2023-07-27T14:40:00.433045+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432050+0000","last_change":"2023-07-27T14:40:00.428749+0000","last_active":"2023-07-27T14:40:00.432050+0000","last_peered":"2023-07-27T14:40:00.432050+0000","last_clean":"2023-07-27T14:40:00.432050+0000","last_became_active":"2023-07-27T14:40:00.428434+0000","last_became_peered":"2023-07-27T14:40:00.428434+0000","last_unstale":"2023-07-27T14:40:00.432050+0000","last_undegraded":"2023-07-27T14:40:00.432050+0000","last_fullsized":"2023-07-27T14:40:00.432050+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432022+0000","last_change":"2023-07-27T14:40:00.429569+0000","last_active":"2023-07-27T14:40:00.432022+0000","last_peered":"2023-07-27T14:40:00.432022+0000","last_clean":"2023-07-27T14:40:00.432022+0000","last_became_active":"2023-07-27T14:40:00.429132+0000","last_became_peered":"2023-07-27T14:40:00.429132+0000","last_unstale":"2023-07-27T14:40:00.432022+0000","last_undegraded":"2023-07-27T14:40:00.432022+0000","last_fullsized":"2023-07-27T14:40:00.432022+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448534+0000","last_change":"2023-07-27T14:39:59.970152+0000","last_active":"2023-07-27T14:40:00.448534+0000","last_peered":"2023-07-27T14:40:00.448534+0000","last_clean":"2023-07-27T14:40:00.448534+0000","last_became_active":"2023-07-27T14:39:59.969856+0000","last_became_peered":"2023-07-27T14:39:59.969856+0000","last_unstale":"2023-07-27T14:40:00.448534+0000","last_undegraded":"2023-07-27T14:40:00.448534+0000","last_fullsized":"2023-07-27T14:40:00.448534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428260+0000","last_change":"2023-07-27T14:40:00.425272+0000","last_active":"2023-07-27T14:40:00.428260+0000","last_peered":"2023-07-27T14:40:00.428260+0000","last_clean":"2023-07-27T14:40:00.428260+0000","last_became_active":"2023-07-27T14:40:00.424996+0000","last_became_peered":"2023-07-27T14:40:00.424996+0000","last_unstale":"2023-07-27T14:40:00.428260+0000","last_undegraded":"2023-07-27T14:40:00.428260+0000","last_fullsized":"2023-07-27T14:40:00.428260+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421303+0000","last_change":"2023-07-27T14:39:59.969026+0000","last_active":"2023-07-27T14:40:00.421303+0000","last_peered":"2023-07-27T14:40:00.421303+0000","last_clean":"2023-07-27T14:40:00.421303+0000","last_became_active":"2023-07-27T14:39:59.968054+0000","last_became_peered":"2023-07-27T14:39:59.968054+0000","last_unstale":"2023-07-27T14:40:00.421303+0000","last_undegraded":"2023-07-27T14:40:00.421303+0000","last_fullsized":"2023-07-27T14:40:00.421303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414030+0000","last_change":"2023-07-27T14:39:59.969719+0000","last_active":"2023-07-27T14:40:00.414030+0000","last_peered":"2023-07-27T14:40:00.414030+0000","last_clean":"2023-07-27T14:40:00.414030+0000","last_became_active":"2023-07-27T14:39:59.969454+0000","last_became_peered":"2023-07-27T14:39:59.969454+0000","last_unstale":"2023-07-27T14:40:00.414030+0000","last_undegraded":"2023-07-27T14:40:00.414030+0000","last_fullsized":"2023-07-27T14:40:00.414030+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429829+0000","last_change":"2023-07-27T14:40:00.423000+0000","last_active":"2023-07-27T14:40:00.429829+0000","last_peered":"2023-07-27T14:40:00.429829+0000","last_clean":"2023-07-27T14:40:00.429829+0000","last_became_active":"2023-07-27T14:40:00.422645+0000","last_became_peered":"2023-07-27T14:40:00.422645+0000","last_unstale":"2023-07-27T14:40:00.429829+0000","last_undegraded":"2023-07-27T14:40:00.429829+0000","last_fullsized":"2023-07-27T14:40:00.429829+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.274076+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:39:55.274076+0000","last_peered":"2023-07-27T14:39:55.274076+0000","last_clean":"2023-07-27T14:39:55.274076+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:39:55.274076+0000","last_undegraded":"2023-07-27T14:39:55.274076+0000","last_fullsized":"2023-07-27T14:39:55.274076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417054+0000","last_change":"2023-07-27T14:39:59.980461+0000","last_active":"2023-07-27T14:40:00.417054+0000","last_peered":"2023-07-27T14:40:00.417054+0000","last_clean":"2023-07-27T14:40:00.417054+0000","last_became_active":"2023-07-27T14:39:59.980112+0000","last_became_peered":"2023-07-27T14:39:59.980112+0000","last_unstale":"2023-07-27T14:40:00.417054+0000","last_undegraded":"2023-07-27T14:40:00.417054+0000","last_fullsized":"2023-07-27T14:40:00.417054+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414305+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:40:00.414305+0000","last_peered":"2023-07-27T14:40:00.414305+0000","last_clean":"2023-07-27T14:40:00.414305+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:40:00.414305+0000","last_undegraded":"2023-07-27T14:40:00.414305+0000","last_fullsized":"2023-07-27T14:40:00.414305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420757+0000","last_change":"2023-07-27T14:39:59.973337+0000","last_active":"2023-07-27T14:40:00.420757+0000","last_peered":"2023-07-27T14:40:00.420757+0000","last_clean":"2023-07-27T14:40:00.420757+0000","last_became_active":"2023-07-27T14:39:59.972405+0000","last_became_peered":"2023-07-27T14:39:59.972405+0000","last_unstale":"2023-07-27T14:40:00.420757+0000","last_undegraded":"2023-07-27T14:40:00.420757+0000","last_fullsized":"2023-07-27T14:40:00.420757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273836+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:39:55.273836+0000","last_peered":"2023-07-27T14:39:55.273836+0000","last_clean":"2023-07-27T14:39:55.273836+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:39:55.273836+0000","last_undegraded":"2023-07-27T14:39:55.273836+0000","last_fullsized":"2023-07-27T14:39:55.273836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433860+0000","last_change":"2023-07-27T14:40:00.432392+0000","last_active":"2023-07-27T14:40:00.433860+0000","last_peered":"2023-07-27T14:40:00.433860+0000","last_clean":"2023-07-27T14:40:00.433860+0000","last_became_active":"2023-07-27T14:40:00.432087+0000","last_became_peered":"2023-07-27T14:40:00.432087+0000","last_unstale":"2023-07-27T14:40:00.433860+0000","last_undegraded":"2023-07-27T14:40:00.433860+0000","last_fullsized":"2023-07-27T14:40:00.433860+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273958+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:39:55.273958+0000","last_peered":"2023-07-27T14:39:55.273958+0000","last_clean":"2023-07-27T14:39:55.273958+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:39:55.273958+0000","last_undegraded":"2023-07-27T14:39:55.273958+0000","last_fullsized":"2023-07-27T14:39:55.273958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273837+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:39:55.273837+0000","last_peered":"2023-07-27T14:39:55.273837+0000","last_clean":"2023-07-27T14:39:55.273837+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:39:55.273837+0000","last_undegraded":"2023-07-27T14:39:55.273837+0000","last_fullsized":"2023-07-27T14:39:55.273837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273619+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:39:55.273619+0000","last_peered":"2023-07-27T14:39:55.273619+0000","last_clean":"2023-07-27T14:39:55.273619+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:39:55.273619+0000","last_undegraded":"2023-07-27T14:39:55.273619+0000","last_fullsized":"2023-07-27T14:39:55.273619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437834+0000","last_change":"2023-07-27T14:39:59.977091+0000","last_active":"2023-07-27T14:40:00.437834+0000","last_peered":"2023-07-27T14:40:00.437834+0000","last_clean":"2023-07-27T14:40:00.437834+0000","last_became_active":"2023-07-27T14:39:59.976798+0000","last_became_peered":"2023-07-27T14:39:59.976798+0000","last_unstale":"2023-07-27T14:40:00.437834+0000","last_undegraded":"2023-07-27T14:40:00.437834+0000","last_fullsized":"2023-07-27T14:40:00.437834+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419629+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:40:00.419629+0000","last_peered":"2023-07-27T14:40:00.419629+0000","last_clean":"2023-07-27T14:40:00.419629+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:40:00.419629+0000","last_undegraded":"2023-07-27T14:40:00.419629+0000","last_fullsized":"2023-07-27T14:40:00.419629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273611+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:39:55.273611+0000","last_peered":"2023-07-27T14:39:55.273611+0000","last_clean":"2023-07-27T14:39:55.273611+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:39:55.273611+0000","last_undegraded":"2023-07-27T14:39:55.273611+0000","last_fullsized":"2023-07-27T14:39:55.273611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444752+0000","last_change":"2023-07-27T14:40:00.443893+0000","last_active":"2023-07-27T14:40:00.444752+0000","last_peered":"2023-07-27T14:40:00.444752+0000","last_clean":"2023-07-27T14:40:00.444752+0000","last_became_active":"2023-07-27T14:40:00.443582+0000","last_became_peered":"2023-07-27T14:40:00.443582+0000","last_unstale":"2023-07-27T14:40:00.444752+0000","last_undegraded":"2023-07-27T14:40:00.444752+0000","last_fullsized":"2023-07-27T14:40:00.444752+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415114+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:40:00.415114+0000","last_peered":"2023-07-27T14:40:00.415114+0000","last_clean":"2023-07-27T14:40:00.415114+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:40:00.415114+0000","last_undegraded":"2023-07-27T14:40:00.415114+0000","last_fullsized":"2023-07-27T14:40:00.415114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":1660,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":60,"acting":60,"num_store_stats":4},{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575008,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25584,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":23104,"kb_avail":94346256,"statfs":{"total":96636764160,"available":96610566144,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23658496},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.60999999999999999,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.67300000000000004,"15min":0.69399999999999995},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.2599999999999998,"5min":5.2599999999999998,"15min":5.2599999999999998},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.73299999999999998,"15min":0.70499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":8.952,"5min":8.952,"15min":8.952},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"max":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.72099999999999997,"15min":0.66500000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.318},"max":{"1min":7.5640000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":5.2249999999999996,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.121,"5min":0.78900000000000003,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":8.1630000000000003,"5min":8.1630000000000003,"15min":8.1630000000000003},"last":0.872}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":0.81599999999999995,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":7.6269999999999998,"5min":7.6269999999999998,"15min":7.6269999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.54700000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.94299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25200,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":22720,"kb_avail":94346640,"statfs":{"total":96636764160,"available":96610959360,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23265280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.68400000000000005,"15min":0.627},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.83799999999999997,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.76200000000000001,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36599999999999999},"max":{"1min":0.91700000000000004,"5min":13.975,"15min":13.975},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65800000000000003,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.42199999999999999},"max":{"1min":0.93000000000000005,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92800000000000005,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.753,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.75}]},{"osd":4,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.78800000000000003,"15min":0.67400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68100000000000005,"15min":0.67000000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.72199999999999998,"15min":0.68600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.84399999999999997,"15min":0.73699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":15.461,"15min":15.461},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82899999999999996,"15min":0.78300000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":0.94399999999999995,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.83499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25572,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":23040,"kb_avail":94346268,"statfs":{"total":96636764160,"available":96610578432,"internally_reserved":0,"allocated":2584576,"data_stored":1227961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23592960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.438},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57499999999999996,"5min":0.61499999999999999,"15min":4.75},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.51700000000000002},"min":{"1min":0.25600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":0.65700000000000003,"15min":9.3100000000000005},"last":0.377}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.495},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.7160000000000002},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32800000000000001},"max":{"1min":0.65600000000000003,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.504},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":3.8580000000000001},"last":0.435}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.54200000000000004,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":1.071,"5min":1.111,"15min":2.181},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":2.4180000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.57899999999999996,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.121,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":1.0609999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.72299999999999998},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.052},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.76300000000000001},"min":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0549999999999999,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.625}]},{"osd":7,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44800000000000001},"max":{"1min":1.0349999999999999,"5min":1.1419999999999999,"15min":2.016},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.59999999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1839999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23980,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":21440,"kb_avail":94347860,"statfs":{"total":96636764160,"available":96612208640,"internally_reserved":0,"allocated":2592768,"data_stored":1228923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21954560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.73199999999999998,"5min":1.954,"15min":1.954},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46899999999999997},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":1.0660000000000001,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.48299999999999998,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.97599999999999998,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53100000000000003,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.6020000000000001},"last":0.63}]},{"osd":6,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.498},"max":{"1min":1.0469999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.44,"15min":0.44},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.22},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.113,"5min":2.141,"15min":2.141},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.125,"15min":1.2370000000000001},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":25088,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":2600960,"data_stored":1229463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25690112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23799999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42299999999999999,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.1899999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.96399999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":5.601},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.83499999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.51100000000000001},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.754,"5min":1.002,"15min":1.353},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.42999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.849},"last":0.878},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":6.9660000000000002},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":1.163,"15min":1.163},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.772},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69399999999999995,"15min":0.71499999999999997},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73299999999999998,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":3.1360000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.499,"15min":0.499},"max":{"1min":1.01,"5min":1.024,"15min":1.8089999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72999999999999998,"15min":0.76400000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.84499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23912,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94347928,"statfs":{"total":96636764160,"available":96612278272,"internally_reserved":0,"allocated":2588672,"data_stored":1228515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.497,"5min":0.66800000000000004,"15min":1.202},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.42899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.302},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.54500000000000004,"5min":0.64200000000000002,"15min":1.2390000000000001},"last":0.497}]},{"osd":2,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.48499999999999999,"15min":0.504},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65700000000000003,"5min":0.68899999999999995,"15min":1.8029999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.68799999999999994},"min":{"1min":0.497,"5min":0.436,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.149},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.71699999999999997},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":5.1059999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.56100000000000005,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0229999999999999,"15min":1.232},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70199999999999996,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.90300000000000002,"5min":0.97799999999999998,"15min":1.298},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.504,"5min":0.501,"15min":0.44},"max":{"1min":0.93300000000000005,"5min":1.0129999999999999,"15min":1.343},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.98899999999999999,"5min":1.115,"15min":2.048},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.51700000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":18544,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94353296,"statfs":{"total":96636764160,"available":96617775104,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93200000000000005,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.53000000000000003,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":3.419,"15min":4.4409999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.439,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.79000000000000004,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.51300000000000001,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":2.3010000000000002,"15min":4.476},"last":0.755}]},{"osd":3,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.79700000000000004,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54100000000000004,"5min":0.46700000000000003,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":3.48,"15min":4.3949999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.8620000000000001,"15min":5.194},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85399999999999998,"5min":2.387,"15min":5.5990000000000002},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.78800000000000003,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.34599999999999997},"max":{"1min":0.83899999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26608,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94345232,"statfs":{"total":96636764160,"available":96609517568,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.317},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.443,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":1.026,"15min":6.7489999999999997},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.67500000000000004},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":0.98799999999999999,"15min":1.581},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.69299999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":5.5750000000000002,"5min":5.5750000000000002,"15min":5.5750000000000002},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.67200000000000004},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.874,"5min":0.875,"15min":9.6920000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":1.012}]},{"osd":4,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":1.978},"last":1.071},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":2.4129999999999998},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.78300000000000003,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.96399999999999997,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":1.151}]},{"osd":7,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.3719999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.57199999999999995,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.88600000000000001,"5min":1.115,"15min":1.9419999999999999},"last":1.0960000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:40:05.189 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:40:05.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.348+0000 7f8040dff700 1 Processor -- start 2023-07-27T14:40:05.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.348+0000 7f8040dff700 1 -- start start 2023-07-27T14:40:05.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.349+0000 7f8040dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 0x7f803c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.349+0000 7f8040dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0aa4d0 con 0x7f803c153ec0 2023-07-27T14:40:05.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.349+0000 7f8040dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0c05c0 con 0x7f803c1542a0 2023-07-27T14:40:05.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.349+0000 7f8040dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0aa270 con 0x7f803c0aaa40 2023-07-27T14:40:05.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.349+0000 7f803a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f803c153ec0 0x7f803c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34800/0 (socket says 172.21.15.115:34800) 2023-07-27T14:40:05.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.349+0000 7f803a59c700 1 -- 172.21.15.115:0/2994065137 learned_addr learned my addr 172.21.15.115:0/2994065137 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:05.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f8039d9b700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 0x7f803c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904038487 0 0) 0x7f802c001110 con 0x7f803c153ec0 2023-07-27T14:40:05.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80240033f0 con 0x7f803c153ec0 2023-07-27T14:40:05.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2062887002 0 0) 0x7f80240033f0 con 0x7f803c153ec0 2023-07-27T14:40:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 msgr2=0x7f803c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 0x7f803c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 >> v1:172.21.15.159:6789/0 conn(0x7f803c1542a0 legacy=0x7f803c0c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0bfc90 con 0x7f803c153ec0 2023-07-27T14:40:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f802c001600 con 0x7f803c153ec0 2023-07-27T14:40:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 >> v1:172.21.15.115:6789/0 conn(0x7f803c153ec0 legacy=0x7f803c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 0x7f8024003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8024003e00 0x7f8024004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8024004b80 0x7f8024005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0aa270 con 0x7f8024004b80 2023-07-27T14:40:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802400b8e0 con 0x7f8024003e00 2023-07-27T14:40:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.350+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802400baa0 con 0x7f803c0aaa40 2023-07-27T14:40:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803a59c700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 0x7f8024003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f8039d9b700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8024003e00 0x7f8024004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803ad9d700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8024004b80 0x7f8024005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803a59c700 1 -- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8024003e00 msgr2=0x7f8024004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803a59c700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8024003e00 0x7f8024004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803a59c700 1 -- 172.21.15.115:0/2994065137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8024004b80 msgr2=0x7f8024005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803a59c700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8024004b80 0x7f8024005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803a59c700 1 -- 172.21.15.115:0/2994065137 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240033f0 con 0x7f803c0aaa40 2023-07-27T14:40:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f8039d9b700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8024003e00 0x7f8024004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:05.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803ad9d700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8024004b80 0x7f8024005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.351+0000 7f803a59c700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 0x7f8024003910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f802c00c3c0 tx=0x7f802c0078d0).ready entity=mon.2 client_cookie=52e421eb334e6a8d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c007be0 con 0x7f803c0aaa40 2023-07-27T14:40:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c00cc90 con 0x7f803c0aaa40 2023-07-27T14:40:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f803959a700 1 -- 172.21.15.115:0/2994065137 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0072e0 con 0x7f803c0aaa40 2023-07-27T14:40:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f8040dff700 1 -- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 msgr2=0x7f8024003910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f8040dff700 1 --2- 172.21.15.115:0/2994065137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c0aaa40 0x7f8024003910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f802c00c3c0 tx=0x7f802c0078d0).stop 2023-07-27T14:40:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f803ad9d700 1 -- 172.21.15.115:0/2994065137 reap_dead start 2023-07-27T14:40:05.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f8040dff700 1 -- 172.21.15.115:0/2994065137 shutdown_connections 2023-07-27T14:40:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f8040dff700 1 -- 172.21.15.115:0/2994065137 >> 172.21.15.115:0/2994065137 conn(0x7f803c0cb610 msgr2=0x7f803c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f8040dff700 1 -- 172.21.15.115:0/2994065137 shutdown_connections 2023-07-27T14:40:05.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.352+0000 7f8040dff700 1 -- 172.21.15.115:0/2994065137 wait complete. 2023-07-27T14:40:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.354+0000 7f8040dff700 1 Processor -- start 2023-07-27T14:40:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.355+0000 7f8040dff700 1 -- start start 2023-07-27T14:40:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f8040dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0aaa40 0x7f803c14ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f8040dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c1687f0 0x7f803c0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f8040dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f803c0c8cc0 0x7f803c0c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f8040dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c14f400 con 0x7f803c0aaa40 2023-07-27T14:40:05.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f8040dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0c9140 con 0x7f803c0c8cc0 2023-07-27T14:40:05.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f8040dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0c9420 con 0x7f803c1687f0 2023-07-27T14:40:05.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f803a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0aaa40 0x7f803c14ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f803a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0aaa40 0x7f803c14ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50546/0 (socket says 172.21.15.115:50546) 2023-07-27T14:40:05.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f803a59c700 1 -- 172.21.15.115:0/390243889 learned_addr learned my addr 172.21.15.115:0/390243889 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:05.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f8039d9b700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c1687f0 0x7f803c0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.356+0000 7f803ad9d700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f803c0c8cc0 0x7f803c0c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f803a59c700 1 -- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c1687f0 msgr2=0x7f803c0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f803a59c700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c1687f0 0x7f803c0c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f803a59c700 1 -- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f803c0c8cc0 msgr2=0x7f803c0c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f803a59c700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f803c0c8cc0 0x7f803c0c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f803a59c700 1 -- 172.21.15.115:0/390243889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0c9700 con 0x7f803c0aaa40 2023-07-27T14:40:05.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f8039d9b700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c1687f0 0x7f803c0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:05.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f803a59c700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0aaa40 0x7f803c14ef10 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 rx=0x7f802400bc30 tx=0x7f802c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:05.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f802a7fc700 1 -- 172.21.15.115:0/390243889 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0072e0 con 0x7f803c0aaa40 2023-07-27T14:40:05.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f802a7fc700 1 -- 172.21.15.115:0/390243889 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c001930 con 0x7f803c0aaa40 2023-07-27T14:40:05.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c0af0c0 con 0x7f803c0aaa40 2023-07-27T14:40:05.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f802a7fc700 1 -- 172.21.15.115:0/390243889 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0048e0 con 0x7f803c0aaa40 2023-07-27T14:40:05.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.357+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c0c3690 con 0x7f803c0aaa40 2023-07-27T14:40:05.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.358+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c0af710 con 0x7f803c0aaa40 2023-07-27T14:40:05.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.359+0000 7f802a7fc700 1 -- 172.21.15.115:0/390243889 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f802c010070 con 0x7f803c0aaa40 2023-07-27T14:40:05.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.361+0000 7f802a7fc700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f801c05fc90 0x7f801c062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.361+0000 7f802a7fc700 1 -- 172.21.15.115:0/390243889 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f802c07bfa0 con 0x7f803c0aaa40 2023-07-27T14:40:05.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.361+0000 7f8039d9b700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f801c05fc90 0x7f801c062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.361+0000 7f8039d9b700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f801c05fc90 0x7f801c062150 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f8030009270 tx=0x7f8030008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:05.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.365+0000 7f802a7fc700 1 -- 172.21.15.115:0/390243889 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f802c04c4e0 con 0x7f803c0aaa40 2023-07-27T14:40:05.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.532+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f803c0aa4d0 con 0x7f801c05fc90 2023-07-27T14:40:05.597 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.542+0000 7f802a7fc700 1 -- 172.21.15.115:0/390243889 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355318 (secure 0 0 0) 0x7f803c0aa4d0 con 0x7f801c05fc90 2023-07-27T14:40:05.603 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:05.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f801c05fc90 msgr2=0x7f801c062150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f801c05fc90 0x7f801c062150 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f8030009270 tx=0x7f8030008040).stop 2023-07-27T14:40:05.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0aaa40 msgr2=0x7f803c14ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0aaa40 0x7f803c14ef10 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 rx=0x7f802400bc30 tx=0x7f802c015000).stop 2023-07-27T14:40:05.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 shutdown_connections 2023-07-27T14:40:05.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f801c05fc90 0x7f801c062150 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f803c0c8cc0 0x7f803c0c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0aaa40 0x7f803c14ef10 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 --2- 172.21.15.115:0/390243889 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f803c1687f0 0x7f803c0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 >> 172.21.15.115:0/390243889 conn(0x7f803c0cb610 msgr2=0x7f803c0ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:05.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 shutdown_connections 2023-07-27T14:40:05.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.547+0000 7f8040dff700 1 -- 172.21.15.115:0/390243889 wait complete. 2023-07-27T14:40:05.609 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:40:05.618 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2023-07-27T14:40:03.616910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1660,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":132,"acting":132,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":197036,"kb_used_data":20012,"kb_used_omap":0,"kb_used_meta":176960,"kb_avail":754777684,"statfs":{"total":773094113280,"available":772892348416,"internally_reserved":0,"allocated":20492288,"data_stored":9718766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":181207040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-536377,"num_objects":-25,"num_object_clones":-1,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":-1,"num_read":-22,"num_read_kb":-8208,"num_write":-237,"num_write_kb":-17007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.033841"},"pg_stats":[{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417014+0000","last_change":"2023-07-27T14:39:59.980161+0000","last_active":"2023-07-27T14:40:00.417014+0000","last_peered":"2023-07-27T14:40:00.417014+0000","last_clean":"2023-07-27T14:40:00.417014+0000","last_became_active":"2023-07-27T14:39:59.977406+0000","last_became_peered":"2023-07-27T14:39:59.977406+0000","last_unstale":"2023-07-27T14:40:00.417014+0000","last_undegraded":"2023-07-27T14:40:00.417014+0000","last_fullsized":"2023-07-27T14:40:00.417014+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.430754+0000","last_change":"2023-07-27T14:40:00.428058+0000","last_active":"2023-07-27T14:40:00.430754+0000","last_peered":"2023-07-27T14:40:00.430754+0000","last_clean":"2023-07-27T14:40:00.430754+0000","last_became_active":"2023-07-27T14:40:00.427765+0000","last_became_peered":"2023-07-27T14:40:00.427765+0000","last_unstale":"2023-07-27T14:40:00.430754+0000","last_undegraded":"2023-07-27T14:40:00.430754+0000","last_fullsized":"2023-07-27T14:40:00.430754+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414833+0000","last_change":"2023-07-27T14:39:59.969560+0000","last_active":"2023-07-27T14:40:00.414833+0000","last_peered":"2023-07-27T14:40:00.414833+0000","last_clean":"2023-07-27T14:40:00.414833+0000","last_became_active":"2023-07-27T14:39:59.969284+0000","last_became_peered":"2023-07-27T14:39:59.969284+0000","last_unstale":"2023-07-27T14:40:00.414833+0000","last_undegraded":"2023-07-27T14:40:00.414833+0000","last_fullsized":"2023-07-27T14:40:00.414833+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428818+0000","last_change":"2023-07-27T14:40:00.424519+0000","last_active":"2023-07-27T14:40:00.428818+0000","last_peered":"2023-07-27T14:40:00.428818+0000","last_clean":"2023-07-27T14:40:00.428818+0000","last_became_active":"2023-07-27T14:40:00.424269+0000","last_became_peered":"2023-07-27T14:40:00.424269+0000","last_unstale":"2023-07-27T14:40:00.428818+0000","last_undegraded":"2023-07-27T14:40:00.428818+0000","last_fullsized":"2023-07-27T14:40:00.428818+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441990+0000","last_change":"2023-07-27T14:39:59.975564+0000","last_active":"2023-07-27T14:40:00.441990+0000","last_peered":"2023-07-27T14:40:00.441990+0000","last_clean":"2023-07-27T14:40:00.441990+0000","last_became_active":"2023-07-27T14:39:59.975257+0000","last_became_peered":"2023-07-27T14:39:59.975257+0000","last_unstale":"2023-07-27T14:40:00.441990+0000","last_undegraded":"2023-07-27T14:40:00.441990+0000","last_fullsized":"2023-07-27T14:40:00.441990+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428069+0000","last_change":"2023-07-27T14:40:00.423653+0000","last_active":"2023-07-27T14:40:00.428069+0000","last_peered":"2023-07-27T14:40:00.428069+0000","last_clean":"2023-07-27T14:40:00.428069+0000","last_became_active":"2023-07-27T14:40:00.423374+0000","last_became_peered":"2023-07-27T14:40:00.423374+0000","last_unstale":"2023-07-27T14:40:00.428069+0000","last_undegraded":"2023-07-27T14:40:00.428069+0000","last_fullsized":"2023-07-27T14:40:00.428069+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.434568+0000","last_change":"2023-07-27T14:40:00.433310+0000","last_active":"2023-07-27T14:40:00.434568+0000","last_peered":"2023-07-27T14:40:00.434568+0000","last_clean":"2023-07-27T14:40:00.434568+0000","last_became_active":"2023-07-27T14:40:00.432861+0000","last_became_peered":"2023-07-27T14:40:00.432861+0000","last_unstale":"2023-07-27T14:40:00.434568+0000","last_undegraded":"2023-07-27T14:40:00.434568+0000","last_fullsized":"2023-07-27T14:40:00.434568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419495+0000","last_change":"2023-07-27T14:39:59.975414+0000","last_active":"2023-07-27T14:40:00.419495+0000","last_peered":"2023-07-27T14:40:00.419495+0000","last_clean":"2023-07-27T14:40:00.419495+0000","last_became_active":"2023-07-27T14:39:59.975123+0000","last_became_peered":"2023-07-27T14:39:59.975123+0000","last_unstale":"2023-07-27T14:40:00.419495+0000","last_undegraded":"2023-07-27T14:40:00.419495+0000","last_fullsized":"2023-07-27T14:40:00.419495+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428833+0000","last_change":"2023-07-27T14:40:00.424211+0000","last_active":"2023-07-27T14:40:00.428833+0000","last_peered":"2023-07-27T14:40:00.428833+0000","last_clean":"2023-07-27T14:40:00.428833+0000","last_became_active":"2023-07-27T14:40:00.423930+0000","last_became_peered":"2023-07-27T14:40:00.423930+0000","last_unstale":"2023-07-27T14:40:00.428833+0000","last_undegraded":"2023-07-27T14:40:00.428833+0000","last_fullsized":"2023-07-27T14:40:00.428833+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420653+0000","last_change":"2023-07-27T14:39:59.972452+0000","last_active":"2023-07-27T14:40:00.420653+0000","last_peered":"2023-07-27T14:40:00.420653+0000","last_clean":"2023-07-27T14:40:00.420653+0000","last_became_active":"2023-07-27T14:39:59.972166+0000","last_became_peered":"2023-07-27T14:39:59.972166+0000","last_unstale":"2023-07-27T14:40:00.420653+0000","last_undegraded":"2023-07-27T14:40:00.420653+0000","last_fullsized":"2023-07-27T14:40:00.420653+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415169+0000","last_change":"2023-07-27T14:39:59.970599+0000","last_active":"2023-07-27T14:40:00.415169+0000","last_peered":"2023-07-27T14:40:00.415169+0000","last_clean":"2023-07-27T14:40:00.415169+0000","last_became_active":"2023-07-27T14:39:59.970336+0000","last_became_peered":"2023-07-27T14:39:59.970336+0000","last_unstale":"2023-07-27T14:40:00.415169+0000","last_undegraded":"2023-07-27T14:40:00.415169+0000","last_fullsized":"2023-07-27T14:40:00.415169+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.34","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446741+0000","last_change":"2023-07-27T14:39:59.970857+0000","last_active":"2023-07-27T14:40:00.446741+0000","last_peered":"2023-07-27T14:40:00.446741+0000","last_clean":"2023-07-27T14:40:00.446741+0000","last_became_active":"2023-07-27T14:39:59.970436+0000","last_became_peered":"2023-07-27T14:39:59.970436+0000","last_unstale":"2023-07-27T14:40:00.446741+0000","last_undegraded":"2023-07-27T14:40:00.446741+0000","last_fullsized":"2023-07-27T14:40:00.446741+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447435+0000","last_change":"2023-07-27T14:40:00.446561+0000","last_active":"2023-07-27T14:40:00.447435+0000","last_peered":"2023-07-27T14:40:00.447435+0000","last_clean":"2023-07-27T14:40:00.447435+0000","last_became_active":"2023-07-27T14:40:00.446240+0000","last_became_peered":"2023-07-27T14:40:00.446240+0000","last_unstale":"2023-07-27T14:40:00.447435+0000","last_undegraded":"2023-07-27T14:40:00.447435+0000","last_fullsized":"2023-07-27T14:40:00.447435+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.30","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441928+0000","last_change":"2023-07-27T14:39:59.963969+0000","last_active":"2023-07-27T14:40:00.441928+0000","last_peered":"2023-07-27T14:40:00.441928+0000","last_clean":"2023-07-27T14:40:00.441928+0000","last_became_active":"2023-07-27T14:39:59.963693+0000","last_became_peered":"2023-07-27T14:39:59.963693+0000","last_unstale":"2023-07-27T14:40:00.441928+0000","last_undegraded":"2023-07-27T14:40:00.441928+0000","last_fullsized":"2023-07-27T14:40:00.441928+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439272+0000","last_change":"2023-07-27T14:40:00.436081+0000","last_active":"2023-07-27T14:40:00.439272+0000","last_peered":"2023-07-27T14:40:00.439272+0000","last_clean":"2023-07-27T14:40:00.439272+0000","last_became_active":"2023-07-27T14:40:00.435741+0000","last_became_peered":"2023-07-27T14:40:00.435741+0000","last_unstale":"2023-07-27T14:40:00.439272+0000","last_undegraded":"2023-07-27T14:40:00.439272+0000","last_fullsized":"2023-07-27T14:40:00.439272+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420765+0000","last_change":"2023-07-27T14:39:59.964330+0000","last_active":"2023-07-27T14:40:00.420765+0000","last_peered":"2023-07-27T14:40:00.420765+0000","last_clean":"2023-07-27T14:40:00.420765+0000","last_became_active":"2023-07-27T14:39:59.964054+0000","last_became_peered":"2023-07-27T14:39:59.964054+0000","last_unstale":"2023-07-27T14:40:00.420765+0000","last_undegraded":"2023-07-27T14:40:00.420765+0000","last_fullsized":"2023-07-27T14:40:00.420765+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419374+0000","last_change":"2023-07-27T14:39:59.963318+0000","last_active":"2023-07-27T14:40:00.419374+0000","last_peered":"2023-07-27T14:40:00.419374+0000","last_clean":"2023-07-27T14:40:00.419374+0000","last_became_active":"2023-07-27T14:39:59.963055+0000","last_became_peered":"2023-07-27T14:39:59.963055+0000","last_unstale":"2023-07-27T14:40:00.419374+0000","last_undegraded":"2023-07-27T14:40:00.419374+0000","last_fullsized":"2023-07-27T14:40:00.419374+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428862+0000","last_change":"2023-07-27T14:40:00.423749+0000","last_active":"2023-07-27T14:40:00.428862+0000","last_peered":"2023-07-27T14:40:00.428862+0000","last_clean":"2023-07-27T14:40:00.428862+0000","last_became_active":"2023-07-27T14:40:00.423476+0000","last_became_peered":"2023-07-27T14:40:00.423476+0000","last_unstale":"2023-07-27T14:40:00.428862+0000","last_undegraded":"2023-07-27T14:40:00.428862+0000","last_fullsized":"2023-07-27T14:40:00.428862+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438324+0000","last_change":"2023-07-27T14:40:00.432481+0000","last_active":"2023-07-27T14:40:00.438324+0000","last_peered":"2023-07-27T14:40:00.438324+0000","last_clean":"2023-07-27T14:40:00.438324+0000","last_became_active":"2023-07-27T14:40:00.431034+0000","last_became_peered":"2023-07-27T14:40:00.431034+0000","last_unstale":"2023-07-27T14:40:00.438324+0000","last_undegraded":"2023-07-27T14:40:00.438324+0000","last_fullsized":"2023-07-27T14:40:00.438324+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431884+0000","last_change":"2023-07-27T14:40:00.430299+0000","last_active":"2023-07-27T14:40:00.431884+0000","last_peered":"2023-07-27T14:40:00.431884+0000","last_clean":"2023-07-27T14:40:00.431884+0000","last_became_active":"2023-07-27T14:40:00.430033+0000","last_became_peered":"2023-07-27T14:40:00.430033+0000","last_unstale":"2023-07-27T14:40:00.431884+0000","last_undegraded":"2023-07-27T14:40:00.431884+0000","last_fullsized":"2023-07-27T14:40:00.431884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438453+0000","last_change":"2023-07-27T14:40:00.431553+0000","last_active":"2023-07-27T14:40:00.438453+0000","last_peered":"2023-07-27T14:40:00.438453+0000","last_clean":"2023-07-27T14:40:00.438453+0000","last_became_active":"2023-07-27T14:40:00.430671+0000","last_became_peered":"2023-07-27T14:40:00.430671+0000","last_unstale":"2023-07-27T14:40:00.438453+0000","last_undegraded":"2023-07-27T14:40:00.438453+0000","last_fullsized":"2023-07-27T14:40:00.438453+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428295+0000","last_change":"2023-07-27T14:40:00.424022+0000","last_active":"2023-07-27T14:40:00.428295+0000","last_peered":"2023-07-27T14:40:00.428295+0000","last_clean":"2023-07-27T14:40:00.428295+0000","last_became_active":"2023-07-27T14:40:00.423746+0000","last_became_peered":"2023-07-27T14:40:00.423746+0000","last_unstale":"2023-07-27T14:40:00.428295+0000","last_undegraded":"2023-07-27T14:40:00.428295+0000","last_fullsized":"2023-07-27T14:40:00.428295+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.416887+0000","last_change":"2023-07-27T14:39:59.980446+0000","last_active":"2023-07-27T14:40:00.416887+0000","last_peered":"2023-07-27T14:40:00.416887+0000","last_clean":"2023-07-27T14:40:00.416887+0000","last_became_active":"2023-07-27T14:39:59.980179+0000","last_became_peered":"2023-07-27T14:39:59.980179+0000","last_unstale":"2023-07-27T14:40:00.416887+0000","last_undegraded":"2023-07-27T14:40:00.416887+0000","last_fullsized":"2023-07-27T14:40:00.416887+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419078+0000","last_change":"2023-07-27T14:39:59.976359+0000","last_active":"2023-07-27T14:40:00.419078+0000","last_peered":"2023-07-27T14:40:00.419078+0000","last_clean":"2023-07-27T14:40:00.419078+0000","last_became_active":"2023-07-27T14:39:59.976086+0000","last_became_peered":"2023-07-27T14:39:59.976086+0000","last_unstale":"2023-07-27T14:40:00.419078+0000","last_undegraded":"2023-07-27T14:40:00.419078+0000","last_fullsized":"2023-07-27T14:40:00.419078+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427709+0000","last_change":"2023-07-27T14:40:00.425690+0000","last_active":"2023-07-27T14:40:00.427709+0000","last_peered":"2023-07-27T14:40:00.427709+0000","last_clean":"2023-07-27T14:40:00.427709+0000","last_became_active":"2023-07-27T14:40:00.425433+0000","last_became_peered":"2023-07-27T14:40:00.425433+0000","last_unstale":"2023-07-27T14:40:00.427709+0000","last_undegraded":"2023-07-27T14:40:00.427709+0000","last_fullsized":"2023-07-27T14:40:00.427709+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420864+0000","last_change":"2023-07-27T14:39:59.962795+0000","last_active":"2023-07-27T14:40:00.420864+0000","last_peered":"2023-07-27T14:40:00.420864+0000","last_clean":"2023-07-27T14:40:00.420864+0000","last_became_active":"2023-07-27T14:39:59.962537+0000","last_became_peered":"2023-07-27T14:39:59.962537+0000","last_unstale":"2023-07-27T14:40:00.420864+0000","last_undegraded":"2023-07-27T14:40:00.420864+0000","last_fullsized":"2023-07-27T14:40:00.420864+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427352+0000","last_change":"2023-07-27T14:40:00.422356+0000","last_active":"2023-07-27T14:40:00.427352+0000","last_peered":"2023-07-27T14:40:00.427352+0000","last_clean":"2023-07-27T14:40:00.427352+0000","last_became_active":"2023-07-27T14:40:00.422057+0000","last_became_peered":"2023-07-27T14:40:00.422057+0000","last_unstale":"2023-07-27T14:40:00.427352+0000","last_undegraded":"2023-07-27T14:40:00.427352+0000","last_fullsized":"2023-07-27T14:40:00.427352+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415297+0000","last_change":"2023-07-27T14:39:59.970682+0000","last_active":"2023-07-27T14:40:00.415297+0000","last_peered":"2023-07-27T14:40:00.415297+0000","last_clean":"2023-07-27T14:40:00.415297+0000","last_became_active":"2023-07-27T14:39:59.970351+0000","last_became_peered":"2023-07-27T14:39:59.970351+0000","last_unstale":"2023-07-27T14:40:00.415297+0000","last_undegraded":"2023-07-27T14:40:00.415297+0000","last_fullsized":"2023-07-27T14:40:00.415297+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418696+0000","last_change":"2023-07-27T14:39:59.978710+0000","last_active":"2023-07-27T14:40:00.418696+0000","last_peered":"2023-07-27T14:40:00.418696+0000","last_clean":"2023-07-27T14:40:00.418696+0000","last_became_active":"2023-07-27T14:39:59.978442+0000","last_became_peered":"2023-07-27T14:39:59.978442+0000","last_unstale":"2023-07-27T14:40:00.418696+0000","last_undegraded":"2023-07-27T14:40:00.418696+0000","last_fullsized":"2023-07-27T14:40:00.418696+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418997+0000","last_change":"2023-07-27T14:39:59.974113+0000","last_active":"2023-07-27T14:40:00.418997+0000","last_peered":"2023-07-27T14:40:00.418997+0000","last_clean":"2023-07-27T14:40:00.418997+0000","last_became_active":"2023-07-27T14:39:59.973820+0000","last_became_peered":"2023-07-27T14:39:59.973820+0000","last_unstale":"2023-07-27T14:40:00.418997+0000","last_undegraded":"2023-07-27T14:40:00.418997+0000","last_fullsized":"2023-07-27T14:40:00.418997+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442334+0000","last_change":"2023-07-27T14:40:00.441511+0000","last_active":"2023-07-27T14:40:00.442334+0000","last_peered":"2023-07-27T14:40:00.442334+0000","last_clean":"2023-07-27T14:40:00.442334+0000","last_became_active":"2023-07-27T14:40:00.441161+0000","last_became_peered":"2023-07-27T14:40:00.441161+0000","last_unstale":"2023-07-27T14:40:00.442334+0000","last_undegraded":"2023-07-27T14:40:00.442334+0000","last_fullsized":"2023-07-27T14:40:00.442334+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428642+0000","last_change":"2023-07-27T14:40:00.424395+0000","last_active":"2023-07-27T14:40:00.428642+0000","last_peered":"2023-07-27T14:40:00.428642+0000","last_clean":"2023-07-27T14:40:00.428642+0000","last_became_active":"2023-07-27T14:40:00.424127+0000","last_became_peered":"2023-07-27T14:40:00.424127+0000","last_unstale":"2023-07-27T14:40:00.428642+0000","last_undegraded":"2023-07-27T14:40:00.428642+0000","last_fullsized":"2023-07-27T14:40:00.428642+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419473+0000","last_change":"2023-07-27T14:39:59.966964+0000","last_active":"2023-07-27T14:40:00.419473+0000","last_peered":"2023-07-27T14:40:00.419473+0000","last_clean":"2023-07-27T14:40:00.419473+0000","last_became_active":"2023-07-27T14:39:59.966695+0000","last_became_peered":"2023-07-27T14:39:59.966695+0000","last_unstale":"2023-07-27T14:40:00.419473+0000","last_undegraded":"2023-07-27T14:40:00.419473+0000","last_fullsized":"2023-07-27T14:40:00.419473+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"204'3","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440604+0000","last_change":"2023-07-27T14:39:59.962153+0000","last_active":"2023-07-27T14:40:00.440604+0000","last_peered":"2023-07-27T14:40:00.440604+0000","last_clean":"2023-07-27T14:40:00.440604+0000","last_became_active":"2023-07-27T14:39:59.961854+0000","last_became_peered":"2023-07-27T14:39:59.961854+0000","last_unstale":"2023-07-27T14:40:00.440604+0000","last_undegraded":"2023-07-27T14:40:00.440604+0000","last_fullsized":"2023-07-27T14:40:00.440604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440839+0000","last_change":"2023-07-27T14:39:59.973460+0000","last_active":"2023-07-27T14:40:00.440839+0000","last_peered":"2023-07-27T14:40:00.440839+0000","last_clean":"2023-07-27T14:40:00.440839+0000","last_became_active":"2023-07-27T14:39:59.973163+0000","last_became_peered":"2023-07-27T14:39:59.973163+0000","last_unstale":"2023-07-27T14:40:00.440839+0000","last_undegraded":"2023-07-27T14:40:00.440839+0000","last_fullsized":"2023-07-27T14:40:00.440839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431539+0000","last_change":"2023-07-27T14:40:00.426655+0000","last_active":"2023-07-27T14:40:00.431539+0000","last_peered":"2023-07-27T14:40:00.431539+0000","last_clean":"2023-07-27T14:40:00.431539+0000","last_became_active":"2023-07-27T14:40:00.426182+0000","last_became_peered":"2023-07-27T14:40:00.426182+0000","last_unstale":"2023-07-27T14:40:00.431539+0000","last_undegraded":"2023-07-27T14:40:00.431539+0000","last_fullsized":"2023-07-27T14:40:00.431539+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444068+0000","last_change":"2023-07-27T14:39:59.983557+0000","last_active":"2023-07-27T14:40:00.444068+0000","last_peered":"2023-07-27T14:40:00.444068+0000","last_clean":"2023-07-27T14:40:00.444068+0000","last_became_active":"2023-07-27T14:39:59.983347+0000","last_became_peered":"2023-07-27T14:39:59.983347+0000","last_unstale":"2023-07-27T14:40:00.444068+0000","last_undegraded":"2023-07-27T14:40:00.444068+0000","last_fullsized":"2023-07-27T14:40:00.444068+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421067+0000","last_change":"2023-07-27T14:39:59.972458+0000","last_active":"2023-07-27T14:40:00.421067+0000","last_peered":"2023-07-27T14:40:00.421067+0000","last_clean":"2023-07-27T14:40:00.421067+0000","last_became_active":"2023-07-27T14:39:59.972157+0000","last_became_peered":"2023-07-27T14:39:59.972157+0000","last_unstale":"2023-07-27T14:40:00.421067+0000","last_undegraded":"2023-07-27T14:40:00.421067+0000","last_fullsized":"2023-07-27T14:40:00.421067+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.413941+0000","last_change":"2023-07-27T14:39:59.968781+0000","last_active":"2023-07-27T14:40:00.413941+0000","last_peered":"2023-07-27T14:40:00.413941+0000","last_clean":"2023-07-27T14:40:00.413941+0000","last_became_active":"2023-07-27T14:39:59.968014+0000","last_became_peered":"2023-07-27T14:39:59.968014+0000","last_unstale":"2023-07-27T14:40:00.413941+0000","last_undegraded":"2023-07-27T14:40:00.413941+0000","last_fullsized":"2023-07-27T14:40:00.413941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432889+0000","last_change":"2023-07-27T14:40:00.428525+0000","last_active":"2023-07-27T14:40:00.432889+0000","last_peered":"2023-07-27T14:40:00.432889+0000","last_clean":"2023-07-27T14:40:00.432889+0000","last_became_active":"2023-07-27T14:40:00.428213+0000","last_became_peered":"2023-07-27T14:40:00.428213+0000","last_unstale":"2023-07-27T14:40:00.432889+0000","last_undegraded":"2023-07-27T14:40:00.432889+0000","last_fullsized":"2023-07-27T14:40:00.432889+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439610+0000","last_change":"2023-07-27T14:40:00.436729+0000","last_active":"2023-07-27T14:40:00.439610+0000","last_peered":"2023-07-27T14:40:00.439610+0000","last_clean":"2023-07-27T14:40:00.439610+0000","last_became_active":"2023-07-27T14:40:00.436469+0000","last_became_peered":"2023-07-27T14:40:00.436469+0000","last_unstale":"2023-07-27T14:40:00.439610+0000","last_undegraded":"2023-07-27T14:40:00.439610+0000","last_fullsized":"2023-07-27T14:40:00.439610+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439513+0000","last_change":"2023-07-27T14:39:59.972384+0000","last_active":"2023-07-27T14:40:00.439513+0000","last_peered":"2023-07-27T14:40:00.439513+0000","last_clean":"2023-07-27T14:40:00.439513+0000","last_became_active":"2023-07-27T14:39:59.972023+0000","last_became_peered":"2023-07-27T14:39:59.972023+0000","last_unstale":"2023-07-27T14:40:00.439513+0000","last_undegraded":"2023-07-27T14:40:00.439513+0000","last_fullsized":"2023-07-27T14:40:00.439513+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418246+0000","last_change":"2023-07-27T14:39:59.971231+0000","last_active":"2023-07-27T14:40:00.418246+0000","last_peered":"2023-07-27T14:40:00.418246+0000","last_clean":"2023-07-27T14:40:00.418246+0000","last_became_active":"2023-07-27T14:39:59.970964+0000","last_became_peered":"2023-07-27T14:39:59.970964+0000","last_unstale":"2023-07-27T14:40:00.418246+0000","last_undegraded":"2023-07-27T14:40:00.418246+0000","last_fullsized":"2023-07-27T14:40:00.418246+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428953+0000","last_change":"2023-07-27T14:40:00.424947+0000","last_active":"2023-07-27T14:40:00.428953+0000","last_peered":"2023-07-27T14:40:00.428953+0000","last_clean":"2023-07-27T14:40:00.428953+0000","last_became_active":"2023-07-27T14:40:00.424664+0000","last_became_peered":"2023-07-27T14:40:00.424664+0000","last_unstale":"2023-07-27T14:40:00.428953+0000","last_undegraded":"2023-07-27T14:40:00.428953+0000","last_fullsized":"2023-07-27T14:40:00.428953+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433045+0000","last_change":"2023-07-27T14:40:00.428558+0000","last_active":"2023-07-27T14:40:00.433045+0000","last_peered":"2023-07-27T14:40:00.433045+0000","last_clean":"2023-07-27T14:40:00.433045+0000","last_became_active":"2023-07-27T14:40:00.428225+0000","last_became_peered":"2023-07-27T14:40:00.428225+0000","last_unstale":"2023-07-27T14:40:00.433045+0000","last_undegraded":"2023-07-27T14:40:00.433045+0000","last_fullsized":"2023-07-27T14:40:00.433045+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432050+0000","last_change":"2023-07-27T14:40:00.428749+0000","last_active":"2023-07-27T14:40:00.432050+0000","last_peered":"2023-07-27T14:40:00.432050+0000","last_clean":"2023-07-27T14:40:00.432050+0000","last_became_active":"2023-07-27T14:40:00.428434+0000","last_became_peered":"2023-07-27T14:40:00.428434+0000","last_unstale":"2023-07-27T14:40:00.432050+0000","last_undegraded":"2023-07-27T14:40:00.432050+0000","last_fullsized":"2023-07-27T14:40:00.432050+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432022+0000","last_change":"2023-07-27T14:40:00.429569+0000","last_active":"2023-07-27T14:40:00.432022+0000","last_peered":"2023-07-27T14:40:00.432022+0000","last_clean":"2023-07-27T14:40:00.432022+0000","last_became_active":"2023-07-27T14:40:00.429132+0000","last_became_peered":"2023-07-27T14:40:00.429132+0000","last_unstale":"2023-07-27T14:40:00.432022+0000","last_undegraded":"2023-07-27T14:40:00.432022+0000","last_fullsized":"2023-07-27T14:40:00.432022+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448534+0000","last_change":"2023-07-27T14:39:59.970152+0000","last_active":"2023-07-27T14:40:00.448534+0000","last_peered":"2023-07-27T14:40:00.448534+0000","last_clean":"2023-07-27T14:40:00.448534+0000","last_became_active":"2023-07-27T14:39:59.969856+0000","last_became_peered":"2023-07-27T14:39:59.969856+0000","last_unstale":"2023-07-27T14:40:00.448534+0000","last_undegraded":"2023-07-27T14:40:00.448534+0000","last_fullsized":"2023-07-27T14:40:00.448534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428260+0000","last_change":"2023-07-27T14:40:00.425272+0000","last_active":"2023-07-27T14:40:00.428260+0000","last_peered":"2023-07-27T14:40:00.428260+0000","last_clean":"2023-07-27T14:40:00.428260+0000","last_became_active":"2023-07-27T14:40:00.424996+0000","last_became_peered":"2023-07-27T14:40:00.424996+0000","last_unstale":"2023-07-27T14:40:00.428260+0000","last_undegraded":"2023-07-27T14:40:00.428260+0000","last_fullsized":"2023-07-27T14:40:00.428260+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421303+0000","last_change":"2023-07-27T14:39:59.969026+0000","last_active":"2023-07-27T14:40:00.421303+0000","last_peered":"2023-07-27T14:40:00.421303+0000","last_clean":"2023-07-27T14:40:00.421303+0000","last_became_active":"2023-07-27T14:39:59.968054+0000","last_became_peered":"2023-07-27T14:39:59.968054+0000","last_unstale":"2023-07-27T14:40:00.421303+0000","last_undegraded":"2023-07-27T14:40:00.421303+0000","last_fullsized":"2023-07-27T14:40:00.421303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414030+0000","last_change":"2023-07-27T14:39:59.969719+0000","last_active":"2023-07-27T14:40:00.414030+0000","last_peered":"2023-07-27T14:40:00.414030+0000","last_clean":"2023-07-27T14:40:00.414030+0000","last_became_active":"2023-07-27T14:39:59.969454+0000","last_became_peered":"2023-07-27T14:39:59.969454+0000","last_unstale":"2023-07-27T14:40:00.414030+0000","last_undegraded":"2023-07-27T14:40:00.414030+0000","last_fullsized":"2023-07-27T14:40:00.414030+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429829+0000","last_change":"2023-07-27T14:40:00.423000+0000","last_active":"2023-07-27T14:40:00.429829+0000","last_peered":"2023-07-27T14:40:00.429829+0000","last_clean":"2023-07-27T14:40:00.429829+0000","last_became_active":"2023-07-27T14:40:00.422645+0000","last_became_peered":"2023-07-27T14:40:00.422645+0000","last_unstale":"2023-07-27T14:40:00.429829+0000","last_undegraded":"2023-07-27T14:40:00.429829+0000","last_fullsized":"2023-07-27T14:40:00.429829+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.274076+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:39:55.274076+0000","last_peered":"2023-07-27T14:39:55.274076+0000","last_clean":"2023-07-27T14:39:55.274076+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:39:55.274076+0000","last_undegraded":"2023-07-27T14:39:55.274076+0000","last_fullsized":"2023-07-27T14:39:55.274076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417054+0000","last_change":"2023-07-27T14:39:59.980461+0000","last_active":"2023-07-27T14:40:00.417054+0000","last_peered":"2023-07-27T14:40:00.417054+0000","last_clean":"2023-07-27T14:40:00.417054+0000","last_became_active":"2023-07-27T14:39:59.980112+0000","last_became_peered":"2023-07-27T14:39:59.980112+0000","last_unstale":"2023-07-27T14:40:00.417054+0000","last_undegraded":"2023-07-27T14:40:00.417054+0000","last_fullsized":"2023-07-27T14:40:00.417054+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414305+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:40:00.414305+0000","last_peered":"2023-07-27T14:40:00.414305+0000","last_clean":"2023-07-27T14:40:00.414305+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:40:00.414305+0000","last_undegraded":"2023-07-27T14:40:00.414305+0000","last_fullsized":"2023-07-27T14:40:00.414305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420757+0000","last_change":"2023-07-27T14:39:59.973337+0000","last_active":"2023-07-27T14:40:00.420757+0000","last_peered":"2023-07-27T14:40:00.420757+0000","last_clean":"2023-07-27T14:40:00.420757+0000","last_became_active":"2023-07-27T14:39:59.972405+0000","last_became_peered":"2023-07-27T14:39:59.972405+0000","last_unstale":"2023-07-27T14:40:00.420757+0000","last_undegraded":"2023-07-27T14:40:00.420757+0000","last_fullsized":"2023-07-27T14:40:00.420757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273836+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:39:55.273836+0000","last_peered":"2023-07-27T14:39:55.273836+0000","last_clean":"2023-07-27T14:39:55.273836+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:39:55.273836+0000","last_undegraded":"2023-07-27T14:39:55.273836+0000","last_fullsized":"2023-07-27T14:39:55.273836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433860+0000","last_change":"2023-07-27T14:40:00.432392+0000","last_active":"2023-07-27T14:40:00.433860+0000","last_peered":"2023-07-27T14:40:00.433860+0000","last_clean":"2023-07-27T14:40:00.433860+0000","last_became_active":"2023-07-27T14:40:00.432087+0000","last_became_peered":"2023-07-27T14:40:00.432087+0000","last_unstale":"2023-07-27T14:40:00.433860+0000","last_undegraded":"2023-07-27T14:40:00.433860+0000","last_fullsized":"2023-07-27T14:40:00.433860+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273958+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:39:55.273958+0000","last_peered":"2023-07-27T14:39:55.273958+0000","last_clean":"2023-07-27T14:39:55.273958+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:39:55.273958+0000","last_undegraded":"2023-07-27T14:39:55.273958+0000","last_fullsized":"2023-07-27T14:39:55.273958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273837+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:39:55.273837+0000","last_peered":"2023-07-27T14:39:55.273837+0000","last_clean":"2023-07-27T14:39:55.273837+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:39:55.273837+0000","last_undegraded":"2023-07-27T14:39:55.273837+0000","last_fullsized":"2023-07-27T14:39:55.273837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273619+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:39:55.273619+0000","last_peered":"2023-07-27T14:39:55.273619+0000","last_clean":"2023-07-27T14:39:55.273619+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:39:55.273619+0000","last_undegraded":"2023-07-27T14:39:55.273619+0000","last_fullsized":"2023-07-27T14:39:55.273619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437834+0000","last_change":"2023-07-27T14:39:59.977091+0000","last_active":"2023-07-27T14:40:00.437834+0000","last_peered":"2023-07-27T14:40:00.437834+0000","last_clean":"2023-07-27T14:40:00.437834+0000","last_became_active":"2023-07-27T14:39:59.976798+0000","last_became_peered":"2023-07-27T14:39:59.976798+0000","last_unstale":"2023-07-27T14:40:00.437834+0000","last_undegraded":"2023-07-27T14:40:00.437834+0000","last_fullsized":"2023-07-27T14:40:00.437834+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419629+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:40:00.419629+0000","last_peered":"2023-07-27T14:40:00.419629+0000","last_clean":"2023-07-27T14:40:00.419629+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:40:00.419629+0000","last_undegraded":"2023-07-27T14:40:00.419629+0000","last_fullsized":"2023-07-27T14:40:00.419629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:59.942545+0000","last_change":"2023-07-27T14:39:59.942545+0000","last_active":"2023-07-27T14:39:59.942545+0000","last_peered":"2023-07-27T14:39:59.942545+0000","last_clean":"2023-07-27T14:39:59.942545+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:59.942545+0000","last_undegraded":"2023-07-27T14:39:59.942545+0000","last_fullsized":"2023-07-27T14:39:59.942545+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-27T14:39:55.273611+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:39:55.273611+0000","last_peered":"2023-07-27T14:39:55.273611+0000","last_clean":"2023-07-27T14:39:55.273611+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:39:55.273611+0000","last_undegraded":"2023-07-27T14:39:55.273611+0000","last_fullsized":"2023-07-27T14:39:55.273611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444752+0000","last_change":"2023-07-27T14:40:00.443893+0000","last_active":"2023-07-27T14:40:00.444752+0000","last_peered":"2023-07-27T14:40:00.444752+0000","last_clean":"2023-07-27T14:40:00.444752+0000","last_became_active":"2023-07-27T14:40:00.443582+0000","last_became_peered":"2023-07-27T14:40:00.443582+0000","last_unstale":"2023-07-27T14:40:00.444752+0000","last_undegraded":"2023-07-27T14:40:00.444752+0000","last_fullsized":"2023-07-27T14:40:00.444752+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:39:58.936184+0000","last_change":"2023-07-27T14:39:58.936184+0000","last_active":"2023-07-27T14:39:58.936184+0000","last_peered":"2023-07-27T14:39:58.936184+0000","last_clean":"2023-07-27T14:39:58.936184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:39:58.936184+0000","last_undegraded":"2023-07-27T14:39:58.936184+0000","last_fullsized":"2023-07-27T14:39:58.936184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415114+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:40:00.415114+0000","last_peered":"2023-07-27T14:40:00.415114+0000","last_clean":"2023-07-27T14:40:00.415114+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:40:00.415114+0000","last_undegraded":"2023-07-27T14:40:00.415114+0000","last_fullsized":"2023-07-27T14:40:00.415114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":1660,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":60,"acting":60,"num_store_stats":4},{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575008,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25584,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":23104,"kb_avail":94346256,"statfs":{"total":96636764160,"available":96610566144,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23658496},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.60999999999999999,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.1439999999999999,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.67300000000000004,"15min":0.69399999999999995},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.2599999999999998,"5min":5.2599999999999998,"15min":5.2599999999999998},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.73299999999999998,"15min":0.70499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":8.952,"5min":8.952,"15min":8.952},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"max":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.72099999999999997,"15min":0.66500000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.318},"max":{"1min":7.5640000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":5.2249999999999996,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.121,"5min":0.78900000000000003,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":8.1630000000000003,"5min":8.1630000000000003,"15min":8.1630000000000003},"last":0.872}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":0.81599999999999995,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":7.6269999999999998,"5min":7.6269999999999998,"15min":7.6269999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.54700000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.94299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25200,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":22720,"kb_avail":94346640,"statfs":{"total":96636764160,"available":96610959360,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23265280},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.68400000000000005,"15min":0.627},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.83799999999999997,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.76200000000000001,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36599999999999999},"max":{"1min":0.91700000000000004,"5min":13.975,"15min":13.975},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65800000000000003,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.42199999999999999},"max":{"1min":0.93000000000000005,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92800000000000005,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.753,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.75}]},{"osd":4,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.78800000000000003,"15min":0.67400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68100000000000005,"15min":0.67000000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.72199999999999998,"15min":0.68600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.84399999999999997,"15min":0.73699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":15.461,"15min":15.461},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82899999999999996,"15min":0.78300000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":0.94399999999999995,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.83499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25572,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":23040,"kb_avail":94346268,"statfs":{"total":96636764160,"available":96610578432,"internally_reserved":0,"allocated":2584576,"data_stored":1227961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23592960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.438},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57499999999999996,"5min":0.61499999999999999,"15min":4.75},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.51700000000000002},"min":{"1min":0.25600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":0.65700000000000003,"15min":9.3100000000000005},"last":0.377}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.495},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.7160000000000002},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32800000000000001},"max":{"1min":0.65600000000000003,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.504},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":3.8580000000000001},"last":0.435}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.54200000000000004,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":1.071,"5min":1.111,"15min":2.181},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":2.4180000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.57899999999999996,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.121,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":1.0609999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.72299999999999998},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.052},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.76300000000000001},"min":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0549999999999999,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.625}]},{"osd":7,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44800000000000001},"max":{"1min":1.0349999999999999,"5min":1.1419999999999999,"15min":2.016},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.59999999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1839999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23980,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":21440,"kb_avail":94347860,"statfs":{"total":96636764160,"available":96612208640,"internally_reserved":0,"allocated":2592768,"data_stored":1228923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21954560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.73199999999999998,"5min":1.954,"15min":1.954},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46899999999999997},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":1.0660000000000001,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.48299999999999998,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.97599999999999998,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53100000000000003,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.6020000000000001},"last":0.63}]},{"osd":6,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.498},"max":{"1min":1.0469999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.44,"15min":0.44},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.22},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.113,"5min":2.141,"15min":2.141},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.125,"15min":1.2370000000000001},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":25088,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":2600960,"data_stored":1229463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25690112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23799999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42299999999999999,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.1899999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.96399999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":5.601},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.83499999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.51100000000000001},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.754,"5min":1.002,"15min":1.353},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.42999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.849},"last":0.878},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":6.9660000000000002},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":1.163,"15min":1.163},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.772},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69399999999999995,"15min":0.71499999999999997},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73299999999999998,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":3.1360000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.499,"15min":0.499},"max":{"1min":1.01,"5min":1.024,"15min":1.8089999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72999999999999998,"15min":0.76400000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.84499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23912,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94347928,"statfs":{"total":96636764160,"available":96612278272,"internally_reserved":0,"allocated":2588672,"data_stored":1228515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.497,"5min":0.66800000000000004,"15min":1.202},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.42899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.302},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.54500000000000004,"5min":0.64200000000000002,"15min":1.2390000000000001},"last":0.497}]},{"osd":2,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.48499999999999999,"15min":0.504},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65700000000000003,"5min":0.68899999999999995,"15min":1.8029999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.68799999999999994},"min":{"1min":0.497,"5min":0.436,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.149},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.71699999999999997},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":5.1059999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.56100000000000005,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0229999999999999,"15min":1.232},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70199999999999996,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.90300000000000002,"5min":0.97799999999999998,"15min":1.298},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.504,"5min":0.501,"15min":0.44},"max":{"1min":0.93300000000000005,"5min":1.0129999999999999,"15min":1.343},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.98899999999999999,"5min":1.115,"15min":2.048},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.51700000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":18544,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":94353296,"statfs":{"total":96636764160,"available":96617775104,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93200000000000005,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.53000000000000003,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":3.419,"15min":4.4409999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.439,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.79000000000000004,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.51300000000000001,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":2.3010000000000002,"15min":4.476},"last":0.755}]},{"osd":3,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.79700000000000004,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.63},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54100000000000004,"5min":0.46700000000000003,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":3.48,"15min":4.3949999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.8620000000000001,"15min":5.194},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85399999999999998,"5min":2.387,"15min":5.5990000000000002},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.78800000000000003,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.34599999999999997},"max":{"1min":0.83899999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26608,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":24128,"kb_avail":94345232,"statfs":{"total":96636764160,"available":96609517568,"internally_reserved":0,"allocated":2531328,"data_stored":1200976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24707072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.317},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.443,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":1.026,"15min":6.7489999999999997},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.67500000000000004},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":0.98799999999999999,"15min":1.581},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.69299999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":5.5750000000000002,"5min":5.5750000000000002,"15min":5.5750000000000002},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.67200000000000004},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.874,"5min":0.875,"15min":9.6920000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":1.012}]},{"osd":4,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":1.978},"last":1.071},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":2.4129999999999998},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.78300000000000003,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.96399999999999997,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":1.151}]},{"osd":7,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.3719999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.57199999999999995,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.88600000000000001,"5min":1.115,"15min":1.9419999999999999},"last":1.0960000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:40:05.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.3e is not active+clean 2023-07-27T14:40:05.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3f is not active+clean 2023-07-27T14:40:05.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.3f is not active+clean 2023-07-27T14:40:05.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.3d is not active+clean 2023-07-27T14:40:05.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3c is not active+clean 2023-07-27T14:40:05.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3a is not active+clean 2023-07-27T14:40:05.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.39 is not active+clean 2023-07-27T14:40:05.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.38 is not active+clean 2023-07-27T14:40:05.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.37 is not active+clean 2023-07-27T14:40:05.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.36 is not active+clean 2023-07-27T14:40:05.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.34 is not active+clean 2023-07-27T14:40:05.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.35 is not active+clean 2023-07-27T14:40:05.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.32 is not active+clean 2023-07-27T14:40:05.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.33 is not active+clean 2023-07-27T14:40:05.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.33 is not active+clean 2023-07-27T14:40:05.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.32 is not active+clean 2023-07-27T14:40:05.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.30 is not active+clean 2023-07-27T14:40:05.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.31 is not active+clean 2023-07-27T14:40:05.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.2f is not active+clean 2023-07-27T14:40:05.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2d is not active+clean 2023-07-27T14:40:05.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2c is not active+clean 2023-07-27T14:40:05.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2b is not active+clean 2023-07-27T14:40:05.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2a is not active+clean 2023-07-27T14:40:05.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.29 is not active+clean 2023-07-27T14:40:05.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.27 is not active+clean 2023-07-27T14:40:05.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.26 is not active+clean 2023-07-27T14:40:05.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.25 is not active+clean 2023-07-27T14:40:05.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.22 is not active+clean 2023-07-27T14:40:05.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.23 is not active+clean 2023-07-27T14:40:05.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.22 is not active+clean 2023-07-27T14:40:05.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.21 is not active+clean 2023-07-27T14:40:05.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.20 is not active+clean 2023-07-27T14:40:05.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.16 is not active+clean 2023-07-27T14:40:05.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.17 is not active+clean 2023-07-27T14:40:05.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.17 is not active+clean 2023-07-27T14:40:05.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.14 is not active+clean 2023-07-27T14:40:05.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.15 is not active+clean 2023-07-27T14:40:05.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.13 is not active+clean 2023-07-27T14:40:05.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.10 is not active+clean 2023-07-27T14:40:05.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.11 is not active+clean 2023-07-27T14:40:05.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.10 is not active+clean 2023-07-27T14:40:05.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.f is not active+clean 2023-07-27T14:40:05.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.c is not active+clean 2023-07-27T14:40:05.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.d is not active+clean 2023-07-27T14:40:05.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.d is not active+clean 2023-07-27T14:40:05.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.b is not active+clean 2023-07-27T14:40:05.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.b is not active+clean 2023-07-27T14:40:05.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.a is not active+clean 2023-07-27T14:40:05.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.9 is not active+clean 2023-07-27T14:40:05.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.8 is not active+clean 2023-07-27T14:40:05.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.7 is not active+clean 2023-07-27T14:40:05.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.6 is not active+clean 2023-07-27T14:40:05.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.4 is not active+clean 2023-07-27T14:40:05.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.5 is not active+clean 2023-07-27T14:40:05.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.4 is not active+clean 2023-07-27T14:40:05.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.2 is not active+clean 2023-07-27T14:40:05.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3 is not active+clean 2023-07-27T14:40:05.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.3 is not active+clean 2023-07-27T14:40:05.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.0 is not active+clean 2023-07-27T14:40:05.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.1 is not active+clean 2023-07-27T14:40:05.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.0 is not active+clean 2023-07-27T14:40:05.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.19 is not active+clean 2023-07-27T14:40:05.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.19 is not active+clean 2023-07-27T14:40:05.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.1a is not active+clean 2023-07-27T14:40:05.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1e is not active+clean 2023-07-27T14:40:05.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.1c is not active+clean 2023-07-27T14:40:05.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1d is not active+clean 2023-07-27T14:40:05.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.1e is not active+clean 2023-07-27T14:40:05.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 29.1d is not active+clean 2023-07-27T14:40:05.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '29.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:59.942545+0000', 'last_change': '2023-07-27T14:39:59.942545+0000', 'last_active': '2023-07-27T14:39:59.942545+0000', 'last_peered': '2023-07-27T14:39:59.942545+0000', 'last_clean': '2023-07-27T14:39:59.942545+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:59.942545+0000', 'last_undegraded': '2023-07-27T14:39:59.942545+0000', 'last_fullsized': '2023-07-27T14:39:59.942545+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:59.942545+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1c is not active+clean 2023-07-27T14:40:05.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1a is not active+clean 2023-07-27T14:40:05.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-27T14:39:58.936184+0000', 'last_change': '2023-07-27T14:39:58.936184+0000', 'last_active': '2023-07-27T14:39:58.936184+0000', 'last_peered': '2023-07-27T14:39:58.936184+0000', 'last_clean': '2023-07-27T14:39:58.936184+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-27T14:39:58.936184+0000', 'last_undegraded': '2023-07-27T14:39:58.936184+0000', 'last_fullsized': '2023-07-27T14:39:58.936184+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'last_clean_scrub_stamp': '2023-07-27T14:39:58.936184+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-27T14:40:05.687 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-27T14:40:05.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.819+0000 7f4cf9fff700 1 Processor -- start 2023-07-27T14:40:05.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.819+0000 7f4cf9fff700 1 -- start start 2023-07-27T14:40:05.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf9fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4cf40c6490 0x7f4cf40c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf9fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf40c9a80 con 0x7f4cf41540e0 2023-07-27T14:40:05.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf9fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf40c8e70 con 0x7f4cf40c0b70 2023-07-27T14:40:05.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf9fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf40c9150 con 0x7f4cf40c6490 2023-07-27T14:40:05.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4cf41540e0 0x7f4cf40a79b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34814/0 (socket says 172.21.15.115:34814) 2023-07-27T14:40:05.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf37fe700 1 -- 172.21.15.115:0/3334662060 learned_addr learned my addr 172.21.15.115:0/3334662060 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:05.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf3fff700 1 --2- 172.21.15.115:0/3334662060 >> v2:172.21.15.159:3300/0 conn(0x7f4cf40c6490 0x7f4cf40c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110575059 0 0) 0x7f4cf40c9a80 con 0x7f4cf41540e0 2023-07-27T14:40:05.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.821+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cdc0033f0 con 0x7f4cf41540e0 2023-07-27T14:40:05.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374832794 0 0) 0x7f4cdc0033f0 con 0x7f4cf41540e0 2023-07-27T14:40:05.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 >> v2:172.21.15.159:3300/0 conn(0x7f4cf40c6490 msgr2=0x7f4cf40c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:05.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/3334662060 >> v2:172.21.15.159:3300/0 conn(0x7f4cf40c6490 0x7f4cf40c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 >> v1:172.21.15.159:6789/0 conn(0x7f4cf40c0b70 legacy=0x7f4cf40c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf40c9430 con 0x7f4cf41540e0 2023-07-27T14:40:05.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4ce4001470 con 0x7f4cf41540e0 2023-07-27T14:40:05.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 >> v1:172.21.15.115:6789/0 conn(0x7f4cf41540e0 legacy=0x7f4cf40a79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc0038e0 0x7f4cdc003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc004690 0x7f4cdc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc005000 0x7f4cdc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40c9150 con 0x7f4cdc005000 2023-07-27T14:40:05.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc00be00 con 0x7f4cdc004690 2023-07-27T14:40:05.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc00bfc0 con 0x7f4cdc0038e0 2023-07-27T14:40:05.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf37fe700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc0038e0 0x7f4cdc003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf3fff700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc005000 0x7f4cdc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc004690 0x7f4cdc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf3fff700 1 -- 172.21.15.115:0/3334662060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc0038e0 msgr2=0x7f4cdc003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.822+0000 7f4cf3fff700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc0038e0 0x7f4cdc003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf3fff700 1 -- 172.21.15.115:0/3334662060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc004690 msgr2=0x7f4cdc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf3fff700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cdc004690 0x7f4cdc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf3fff700 1 -- 172.21.15.115:0/3334662060 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0033f0 con 0x7f4cdc005000 2023-07-27T14:40:05.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf3fff700 1 -- 172.21.15.115:0/3334662060 reap_dead start 2023-07-27T14:40:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf3fff700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc005000 0x7f4cdc00b8e0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 rx=0x7f4cec00e210 tx=0x7f4cec00b040).ready entity=mon.0 client_cookie=86ded4c3034c644 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec009ac0 con 0x7f4cdc005000 2023-07-27T14:40:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec00f040 con 0x7f4cdc005000 2023-07-27T14:40:05.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf27fc700 1 -- 172.21.15.115:0/3334662060 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00ed10 con 0x7f4cdc005000 2023-07-27T14:40:05.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf9fff700 1 -- 172.21.15.115:0/3334662060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc005000 msgr2=0x7f4cdc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf9fff700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc005000 0x7f4cdc00b8e0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 rx=0x7f4cec00e210 tx=0x7f4cec00b040).stop 2023-07-27T14:40:05.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf9fff700 1 -- 172.21.15.115:0/3334662060 shutdown_connections 2023-07-27T14:40:05.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf9fff700 1 --2- 172.21.15.115:0/3334662060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc005000 0x7f4cdc00b8e0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.823+0000 7f4cf9fff700 1 -- 172.21.15.115:0/3334662060 >> 172.21.15.115:0/3334662060 conn(0x7f4cf405e650 msgr2=0x7f4cf40cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:05.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.824+0000 7f4cf9fff700 1 -- 172.21.15.115:0/3334662060 shutdown_connections 2023-07-27T14:40:05.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.824+0000 7f4cf9fff700 1 -- 172.21.15.115:0/3334662060 wait complete. 2023-07-27T14:40:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.825+0000 7f4cf9fff700 1 Processor -- start 2023-07-27T14:40:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.825+0000 7f4cf9fff700 1 -- start start 2023-07-27T14:40:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf9fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc005000 0x7f4cf41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf9fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4157740 0x7f4cf40c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf9fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf40c3c80 0x7f4cf40aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf9fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40adef0 con 0x7f4cf4157740 2023-07-27T14:40:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf9fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40aea70 con 0x7f4cf40c3c80 2023-07-27T14:40:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf9fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40ae140 con 0x7f4cdc005000 2023-07-27T14:40:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4157740 0x7f4cf40c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4157740 0x7f4cf40c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50560/0 (socket says 172.21.15.115:50560) 2023-07-27T14:40:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf2ffd700 1 -- 172.21.15.115:0/4179421250 learned_addr learned my addr 172.21.15.115:0/4179421250 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:05.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf37fe700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc005000 0x7f4cf41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.826+0000 7f4cf3fff700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf40c3c80 0x7f4cf40aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cf2ffd700 1 -- 172.21.15.115:0/4179421250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc005000 msgr2=0x7f4cf41506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc005000 0x7f4cf41506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cf2ffd700 1 -- 172.21.15.115:0/4179421250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf40c3c80 msgr2=0x7f4cf40aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:05.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf40c3c80 0x7f4cf40aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:05.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cf2ffd700 1 -- 172.21.15.115:0/4179421250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf40ae420 con 0x7f4cf4157740 2023-07-27T14:40:05.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cf2ffd700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4157740 0x7f4cf40c3790 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 rx=0x7f4ce8002a00 tx=0x7f4ce8007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cdb7fe700 1 -- 172.21.15.115:0/4179421250 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800f6c0 con 0x7f4cf4157740 2023-07-27T14:40:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cdb7fe700 1 -- 172.21.15.115:0/4179421250 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce800f820 con 0x7f4cf4157740 2023-07-27T14:40:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf40ae700 con 0x7f4cf4157740 2023-07-27T14:40:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cdb7fe700 1 -- 172.21.15.115:0/4179421250 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800fba0 con 0x7f4cf4157740 2023-07-27T14:40:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.827+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf40c40c0 con 0x7f4cf4157740 2023-07-27T14:40:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.828+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf40aebe0 con 0x7f4cf4157740 2023-07-27T14:40:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.829+0000 7f4cdb7fe700 1 -- 172.21.15.115:0/4179421250 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f4ce801b030 con 0x7f4cf4157740 2023-07-27T14:40:05.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.830+0000 7f4cdb7fe700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005fcc0 0x7f4ce0062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:05.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.830+0000 7f4cdb7fe700 1 -- 172.21.15.115:0/4179421250 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4ce807afe0 con 0x7f4cf4157740 2023-07-27T14:40:05.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.830+0000 7f4cf37fe700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005fcc0 0x7f4ce0062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:05.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.830+0000 7f4cf37fe700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005fcc0 0x7f4ce0062180 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f4ce4001d00 tx=0x7f4ce4001e70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:05.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:05.834+0000 7f4cdb7fe700 1 -- 172.21.15.115:0/4179421250 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ce804a8f0 con 0x7f4cf4157740 2023-07-27T14:40:05.977 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-07-27T14:40:05.921+0000 7f7e1b7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:40:06.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.066+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4cf406a640 con 0x7f4cf4157740 2023-07-27T14:40:06.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.066+0000 7f4cdb7fe700 1 -- 172.21.15.115:0/4179421250 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1193 (secure 0 0 0) 0x7f4ce804b610 con 0x7f4cf4157740 2023-07-27T14:40:06.122 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:06.122 INFO:teuthology.orchestra.run.smithi115.stdout:{"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":804,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":205,"num_osds":8,"num_up_osds":8,"osd_up_since":1690468012,"num_in_osds":8,"osd_in_since":1690468005,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":71},{"state_name":"active+clean","count":66}],"num_pgs":137,"num_pools":4,"num_objects":11,"data_bytes":1660,"bytes_used":201764864,"bytes_avail":772892348416,"bytes_total":773094113280,"unknown_pgs_ratio":0.51824820041656494},"fsmap":{"epoch":112,"id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"d","status":"up:active","gid":10389}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-07-27T14:39:49.613825+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-27T14:40:06.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005fcc0 msgr2=0x7f4ce0062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:06.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005fcc0 0x7f4ce0062180 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f4ce4001d00 tx=0x7f4ce4001e70).stop 2023-07-27T14:40:06.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4157740 msgr2=0x7f4cf40c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:06.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4157740 0x7f4cf40c3790 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 rx=0x7f4ce8002a00 tx=0x7f4ce8007b90).stop 2023-07-27T14:40:06.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 shutdown_connections 2023-07-27T14:40:06.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4ce005fcc0 0x7f4ce0062180 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf40c3c80 0x7f4cf40aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4cdc005000 0x7f4cf41506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 --2- 172.21.15.115:0/4179421250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cf4157740 0x7f4cf40c3790 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.068+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 >> 172.21.15.115:0/4179421250 conn(0x7f4cf405e650 msgr2=0x7f4cf40c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:06.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.069+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 shutdown_connections 2023-07-27T14:40:06.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.069+0000 7f4cf9fff700 1 -- 172.21.15.115:0/4179421250 wait complete. 2023-07-27T14:40:06.140 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-27T14:40:06.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:40:06.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.274+0000 7f8945fff700 1 Processor -- start 2023-07-27T14:40:06.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.274+0000 7f8945fff700 1 -- start start 2023-07-27T14:40:06.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.275+0000 7f8945fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89401542a0 0x7f894015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:06.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.275+0000 7f8945fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89400aa4d0 con 0x7f8940153ec0 2023-07-27T14:40:06.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.275+0000 7f8945fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89400c05c0 con 0x7f89400aaa40 2023-07-27T14:40:06.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.275+0000 7f8945fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89400c1a60 con 0x7f89401542a0 2023-07-27T14:40:06.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89401542a0 0x7f894015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:06.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8940153ec0 0x7f89400a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34816/0 (socket says 172.21.15.115:34816) 2023-07-27T14:40:06.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893f7fe700 1 -- 172.21.15.115:0/309634087 learned_addr learned my addr 172.21.15.115:0/309634087 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:06.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893e7fc700 1 -- 172.21.15.115:0/309634087 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302602689 0 0) 0x7f8930001110 con 0x7f8940153ec0 2023-07-27T14:40:06.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893e7fc700 1 -- 172.21.15.115:0/309634087 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89280033f0 con 0x7f8940153ec0 2023-07-27T14:40:06.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893ffff700 1 -- 172.21.15.115:0/309634087 >> v1:172.21.15.159:6789/0 conn(0x7f89400aaa40 legacy=0x7f89400640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:06.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893ffff700 1 -- 172.21.15.115:0/309634087 >> v1:172.21.15.115:6789/0 conn(0x7f8940153ec0 legacy=0x7f89400a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:06.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893ffff700 1 -- 172.21.15.115:0/309634087 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89400aa270 con 0x7f89401542a0 2023-07-27T14:40:06.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.276+0000 7f893ffff700 1 --2- 172.21.15.115:0/309634087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89401542a0 0x7f894015efc0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 rx=0x7f8938009e60 tx=0x7f8938009780).ready entity=mon.0 client_cookie=e58f8d42d0cb9a54 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:06.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f893e7fc700 1 -- 172.21.15.115:0/309634087 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800e070 con 0x7f89401542a0 2023-07-27T14:40:06.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f893e7fc700 1 -- 172.21.15.115:0/309634087 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893800bb20 con 0x7f89401542a0 2023-07-27T14:40:06.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f893e7fc700 1 -- 172.21.15.115:0/309634087 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800bea0 con 0x7f89401542a0 2023-07-27T14:40:06.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f8945fff700 1 -- 172.21.15.115:0/309634087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89401542a0 msgr2=0x7f894015efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:06.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f8945fff700 1 --2- 172.21.15.115:0/309634087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89401542a0 0x7f894015efc0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 rx=0x7f8938009e60 tx=0x7f8938009780).stop 2023-07-27T14:40:06.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f8945fff700 1 -- 172.21.15.115:0/309634087 shutdown_connections 2023-07-27T14:40:06.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f8945fff700 1 --2- 172.21.15.115:0/309634087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89401542a0 0x7f894015efc0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f8945fff700 1 -- 172.21.15.115:0/309634087 >> 172.21.15.115:0/309634087 conn(0x7f89400cb610 msgr2=0x7f89400c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:06.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f8945fff700 1 -- 172.21.15.115:0/309634087 shutdown_connections 2023-07-27T14:40:06.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.277+0000 7f8945fff700 1 -- 172.21.15.115:0/309634087 wait complete. 2023-07-27T14:40:06.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.279+0000 7f8945fff700 1 Processor -- start 2023-07-27T14:40:06.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.279+0000 7f8945fff700 1 -- start start 2023-07-27T14:40:06.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f8945fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89400aaa40 0x7f89401580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:06.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f8945fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8940153ec0 0x7f89401569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:06.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f8945fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89401542a0 0x7f89400aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:06.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f8945fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400af1d0 con 0x7f8940153ec0 2023-07-27T14:40:06.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f8945fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8940157c30 con 0x7f89400aaa40 2023-07-27T14:40:06.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f8945fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8940157020 con 0x7f89401542a0 2023-07-27T14:40:06.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8940153ec0 0x7f89401569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:06.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8940153ec0 0x7f89401569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50574/0 (socket says 172.21.15.115:50574) 2023-07-27T14:40:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893effd700 1 -- 172.21.15.115:0/3872737619 learned_addr learned my addr 172.21.15.115:0/3872737619 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893ffff700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89401542a0 0x7f89400aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893f7fe700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89400aaa40 0x7f89401580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893effd700 1 -- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89401542a0 msgr2=0x7f89400aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893effd700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89401542a0 0x7f89400aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893effd700 1 -- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89400aaa40 msgr2=0x7f89401580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893effd700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89400aaa40 0x7f89401580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893effd700 1 -- 172.21.15.115:0/3872737619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938009a20 con 0x7f8940153ec0 2023-07-27T14:40:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.280+0000 7f893ffff700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89401542a0 0x7f89400aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.281+0000 7f893effd700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8940153ec0 0x7f89401569f0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 rx=0x7f893400c490 tx=0x7f8934007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.281+0000 7f89277fe700 1 -- 172.21.15.115:0/3872737619 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400f470 con 0x7f8940153ec0 2023-07-27T14:40:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.281+0000 7f89277fe700 1 -- 172.21.15.115:0/3872737619 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893400f5d0 con 0x7f8940153ec0 2023-07-27T14:40:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.281+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8940157300 con 0x7f8940153ec0 2023-07-27T14:40:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.281+0000 7f89277fe700 1 -- 172.21.15.115:0/3872737619 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400f990 con 0x7f8940153ec0 2023-07-27T14:40:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.281+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89401578c0 con 0x7f8940153ec0 2023-07-27T14:40:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.282+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8940157dc0 con 0x7f8940153ec0 2023-07-27T14:40:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.283+0000 7f89277fe700 1 -- 172.21.15.115:0/3872737619 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f8934019030 con 0x7f8940153ec0 2023-07-27T14:40:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.283+0000 7f89277fe700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f892c05fcc0 0x7f892c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.283+0000 7f89277fe700 1 -- 172.21.15.115:0/3872737619 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f893407a7b0 con 0x7f8940153ec0 2023-07-27T14:40:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.284+0000 7f893f7fe700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f892c05fcc0 0x7f892c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.284+0000 7f893f7fe700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f892c05fcc0 0x7f892c062180 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f8930001270 tx=0x7f8930009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.287+0000 7f89277fe700 1 -- 172.21.15.115:0/3872737619 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89340488f0 con 0x7f8940153ec0 2023-07-27T14:40:06.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.453+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89400bfc90 con 0x7f892c05fcc0 2023-07-27T14:40:06.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.464+0000 7f89277fe700 1 -- 172.21.15.115:0/3872737619 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361678 (secure 0 0 0) 0x7f89400bfc90 con 0x7f892c05fcc0 2023-07-27T14:40:06.522 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:06.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f892c05fcc0 msgr2=0x7f892c062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f892c05fcc0 0x7f892c062180 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f8930001270 tx=0x7f8930009040).stop 2023-07-27T14:40:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8940153ec0 msgr2=0x7f89401569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8940153ec0 0x7f89401569f0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 rx=0x7f893400c490 tx=0x7f8934007db0).stop 2023-07-27T14:40:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 shutdown_connections 2023-07-27T14:40:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f892c05fcc0 0x7f892c062180 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89401542a0 0x7f89400aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89400aaa40 0x7f89401580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 --2- 172.21.15.115:0/3872737619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8940153ec0 0x7f89401569f0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:06.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.468+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 >> 172.21.15.115:0/3872737619 conn(0x7f89400cb610 msgr2=0x7f89400640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:06.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.469+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 shutdown_connections 2023-07-27T14:40:06.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:06.469+0000 7f8945fff700 1 -- 172.21.15.115:0/3872737619 wait complete. 2023-07-27T14:40:06.526 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:40:06.540 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":594,"stamp":"2023-07-27T14:40:05.617364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":227,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":198080,"kb_used_data":20224,"kb_used_omap":0,"kb_used_meta":177792,"kb_avail":754776640,"statfs":{"total":773094113280,"available":772891279360,"internally_reserved":0,"allocated":20709376,"data_stored":9827580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":182059008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-535731,"num_objects":-15,"num_object_clones":-1,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":-1,"num_read":-22,"num_read_kb":-8208,"num_write":-216,"num_write_kb":-16999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.279717"},"pg_stats":[{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446293+0000","last_change":"2023-07-27T14:40:00.444892+0000","last_active":"2023-07-27T14:40:00.446293+0000","last_peered":"2023-07-27T14:40:00.446293+0000","last_clean":"2023-07-27T14:40:00.446293+0000","last_became_active":"2023-07-27T14:40:00.444625+0000","last_became_peered":"2023-07-27T14:40:00.444625+0000","last_unstale":"2023-07-27T14:40:00.446293+0000","last_undegraded":"2023-07-27T14:40:00.446293+0000","last_fullsized":"2023-07-27T14:40:00.446293+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3f","version":"204'3","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449755+0000","last_change":"2023-07-27T14:39:59.984816+0000","last_active":"2023-07-27T14:40:00.449755+0000","last_peered":"2023-07-27T14:40:00.449755+0000","last_clean":"2023-07-27T14:40:00.449755+0000","last_became_active":"2023-07-27T14:39:59.983617+0000","last_became_peered":"2023-07-27T14:39:59.983617+0000","last_unstale":"2023-07-27T14:40:00.449755+0000","last_undegraded":"2023-07-27T14:40:00.449755+0000","last_fullsized":"2023-07-27T14:40:00.449755+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442511+0000","last_change":"2023-07-27T14:40:00.435511+0000","last_active":"2023-07-27T14:40:00.442511+0000","last_peered":"2023-07-27T14:40:00.442511+0000","last_clean":"2023-07-27T14:40:00.442511+0000","last_became_active":"2023-07-27T14:40:00.434811+0000","last_became_peered":"2023-07-27T14:40:00.434811+0000","last_unstale":"2023-07-27T14:40:00.442511+0000","last_undegraded":"2023-07-27T14:40:00.442511+0000","last_fullsized":"2023-07-27T14:40:00.442511+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417014+0000","last_change":"2023-07-27T14:39:59.980161+0000","last_active":"2023-07-27T14:40:00.417014+0000","last_peered":"2023-07-27T14:40:00.417014+0000","last_clean":"2023-07-27T14:40:00.417014+0000","last_became_active":"2023-07-27T14:39:59.977406+0000","last_became_peered":"2023-07-27T14:39:59.977406+0000","last_unstale":"2023-07-27T14:40:00.417014+0000","last_undegraded":"2023-07-27T14:40:00.417014+0000","last_fullsized":"2023-07-27T14:40:00.417014+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.430754+0000","last_change":"2023-07-27T14:40:00.428058+0000","last_active":"2023-07-27T14:40:00.430754+0000","last_peered":"2023-07-27T14:40:00.430754+0000","last_clean":"2023-07-27T14:40:00.430754+0000","last_became_active":"2023-07-27T14:40:00.427765+0000","last_became_peered":"2023-07-27T14:40:00.427765+0000","last_unstale":"2023-07-27T14:40:00.430754+0000","last_undegraded":"2023-07-27T14:40:00.430754+0000","last_fullsized":"2023-07-27T14:40:00.430754+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414833+0000","last_change":"2023-07-27T14:39:59.969560+0000","last_active":"2023-07-27T14:40:00.414833+0000","last_peered":"2023-07-27T14:40:00.414833+0000","last_clean":"2023-07-27T14:40:00.414833+0000","last_became_active":"2023-07-27T14:39:59.969284+0000","last_became_peered":"2023-07-27T14:39:59.969284+0000","last_unstale":"2023-07-27T14:40:00.414833+0000","last_undegraded":"2023-07-27T14:40:00.414833+0000","last_fullsized":"2023-07-27T14:40:00.414833+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447071+0000","last_change":"2023-07-27T14:40:00.440258+0000","last_active":"2023-07-27T14:40:00.447071+0000","last_peered":"2023-07-27T14:40:00.447071+0000","last_clean":"2023-07-27T14:40:00.447071+0000","last_became_active":"2023-07-27T14:40:00.439908+0000","last_became_peered":"2023-07-27T14:40:00.439908+0000","last_unstale":"2023-07-27T14:40:00.447071+0000","last_undegraded":"2023-07-27T14:40:00.447071+0000","last_fullsized":"2023-07-27T14:40:00.447071+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.3c","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437043+0000","last_change":"2023-07-27T14:39:59.984919+0000","last_active":"2023-07-27T14:40:00.437043+0000","last_peered":"2023-07-27T14:40:00.437043+0000","last_clean":"2023-07-27T14:40:00.437043+0000","last_became_active":"2023-07-27T14:39:59.984573+0000","last_became_peered":"2023-07-27T14:39:59.984573+0000","last_unstale":"2023-07-27T14:40:00.437043+0000","last_undegraded":"2023-07-27T14:40:00.437043+0000","last_fullsized":"2023-07-27T14:40:00.437043+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428818+0000","last_change":"2023-07-27T14:40:00.424519+0000","last_active":"2023-07-27T14:40:00.428818+0000","last_peered":"2023-07-27T14:40:00.428818+0000","last_clean":"2023-07-27T14:40:00.428818+0000","last_became_active":"2023-07-27T14:40:00.424269+0000","last_became_peered":"2023-07-27T14:40:00.424269+0000","last_unstale":"2023-07-27T14:40:00.428818+0000","last_undegraded":"2023-07-27T14:40:00.428818+0000","last_fullsized":"2023-07-27T14:40:00.428818+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441990+0000","last_change":"2023-07-27T14:39:59.975564+0000","last_active":"2023-07-27T14:40:00.441990+0000","last_peered":"2023-07-27T14:40:00.441990+0000","last_clean":"2023-07-27T14:40:00.441990+0000","last_became_active":"2023-07-27T14:39:59.975257+0000","last_became_peered":"2023-07-27T14:39:59.975257+0000","last_unstale":"2023-07-27T14:40:00.441990+0000","last_undegraded":"2023-07-27T14:40:00.441990+0000","last_fullsized":"2023-07-27T14:40:00.441990+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428069+0000","last_change":"2023-07-27T14:40:00.423653+0000","last_active":"2023-07-27T14:40:00.428069+0000","last_peered":"2023-07-27T14:40:00.428069+0000","last_clean":"2023-07-27T14:40:00.428069+0000","last_became_active":"2023-07-27T14:40:00.423374+0000","last_became_peered":"2023-07-27T14:40:00.423374+0000","last_unstale":"2023-07-27T14:40:00.428069+0000","last_undegraded":"2023-07-27T14:40:00.428069+0000","last_fullsized":"2023-07-27T14:40:00.428069+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3a","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.436371+0000","last_change":"2023-07-27T14:39:59.976784+0000","last_active":"2023-07-27T14:40:00.436371+0000","last_peered":"2023-07-27T14:40:00.436371+0000","last_clean":"2023-07-27T14:40:00.436371+0000","last_became_active":"2023-07-27T14:39:59.976295+0000","last_became_peered":"2023-07-27T14:39:59.976295+0000","last_unstale":"2023-07-27T14:40:00.436371+0000","last_undegraded":"2023-07-27T14:40:00.436371+0000","last_fullsized":"2023-07-27T14:40:00.436371+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.434568+0000","last_change":"2023-07-27T14:40:00.433310+0000","last_active":"2023-07-27T14:40:00.434568+0000","last_peered":"2023-07-27T14:40:00.434568+0000","last_clean":"2023-07-27T14:40:00.434568+0000","last_became_active":"2023-07-27T14:40:00.432861+0000","last_became_peered":"2023-07-27T14:40:00.432861+0000","last_unstale":"2023-07-27T14:40:00.434568+0000","last_undegraded":"2023-07-27T14:40:00.434568+0000","last_fullsized":"2023-07-27T14:40:00.434568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419495+0000","last_change":"2023-07-27T14:39:59.975414+0000","last_active":"2023-07-27T14:40:00.419495+0000","last_peered":"2023-07-27T14:40:00.419495+0000","last_clean":"2023-07-27T14:40:00.419495+0000","last_became_active":"2023-07-27T14:39:59.975123+0000","last_became_peered":"2023-07-27T14:39:59.975123+0000","last_unstale":"2023-07-27T14:40:00.419495+0000","last_undegraded":"2023-07-27T14:40:00.419495+0000","last_fullsized":"2023-07-27T14:40:00.419495+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449077+0000","last_change":"2023-07-27T14:40:00.445250+0000","last_active":"2023-07-27T14:40:00.449077+0000","last_peered":"2023-07-27T14:40:00.449077+0000","last_clean":"2023-07-27T14:40:00.449077+0000","last_became_active":"2023-07-27T14:40:00.439351+0000","last_became_peered":"2023-07-27T14:40:00.439351+0000","last_unstale":"2023-07-27T14:40:00.449077+0000","last_undegraded":"2023-07-27T14:40:00.449077+0000","last_fullsized":"2023-07-27T14:40:00.449077+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429126+0000","last_change":"2023-07-27T14:39:59.971111+0000","last_active":"2023-07-27T14:40:00.429126+0000","last_peered":"2023-07-27T14:40:00.429126+0000","last_clean":"2023-07-27T14:40:00.429126+0000","last_became_active":"2023-07-27T14:39:59.970596+0000","last_became_peered":"2023-07-27T14:39:59.970596+0000","last_unstale":"2023-07-27T14:40:00.429126+0000","last_undegraded":"2023-07-27T14:40:00.429126+0000","last_fullsized":"2023-07-27T14:40:00.429126+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428833+0000","last_change":"2023-07-27T14:40:00.424211+0000","last_active":"2023-07-27T14:40:00.428833+0000","last_peered":"2023-07-27T14:40:00.428833+0000","last_clean":"2023-07-27T14:40:00.428833+0000","last_became_active":"2023-07-27T14:40:00.423930+0000","last_became_peered":"2023-07-27T14:40:00.423930+0000","last_unstale":"2023-07-27T14:40:00.428833+0000","last_undegraded":"2023-07-27T14:40:00.428833+0000","last_fullsized":"2023-07-27T14:40:00.428833+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420653+0000","last_change":"2023-07-27T14:39:59.972452+0000","last_active":"2023-07-27T14:40:00.420653+0000","last_peered":"2023-07-27T14:40:00.420653+0000","last_clean":"2023-07-27T14:40:00.420653+0000","last_became_active":"2023-07-27T14:39:59.972166+0000","last_became_peered":"2023-07-27T14:39:59.972166+0000","last_unstale":"2023-07-27T14:40:00.420653+0000","last_undegraded":"2023-07-27T14:40:00.420653+0000","last_fullsized":"2023-07-27T14:40:00.420653+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447893+0000","last_change":"2023-07-27T14:40:00.441722+0000","last_active":"2023-07-27T14:40:00.447893+0000","last_peered":"2023-07-27T14:40:00.447893+0000","last_clean":"2023-07-27T14:40:00.447893+0000","last_became_active":"2023-07-27T14:40:00.439985+0000","last_became_peered":"2023-07-27T14:40:00.439985+0000","last_unstale":"2023-07-27T14:40:00.447893+0000","last_undegraded":"2023-07-27T14:40:00.447893+0000","last_fullsized":"2023-07-27T14:40:00.447893+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431982+0000","last_change":"2023-07-27T14:39:59.963470+0000","last_active":"2023-07-27T14:40:00.431982+0000","last_peered":"2023-07-27T14:40:00.431982+0000","last_clean":"2023-07-27T14:40:00.431982+0000","last_became_active":"2023-07-27T14:39:59.963180+0000","last_became_peered":"2023-07-27T14:39:59.963180+0000","last_unstale":"2023-07-27T14:40:00.431982+0000","last_undegraded":"2023-07-27T14:40:00.431982+0000","last_fullsized":"2023-07-27T14:40:00.431982+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429667+0000","last_change":"2023-07-27T14:40:00.426857+0000","last_active":"2023-07-27T14:40:00.429667+0000","last_peered":"2023-07-27T14:40:00.429667+0000","last_clean":"2023-07-27T14:40:00.429667+0000","last_became_active":"2023-07-27T14:40:00.426527+0000","last_became_peered":"2023-07-27T14:40:00.426527+0000","last_unstale":"2023-07-27T14:40:00.429667+0000","last_undegraded":"2023-07-27T14:40:00.429667+0000","last_fullsized":"2023-07-27T14:40:00.429667+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415169+0000","last_change":"2023-07-27T14:39:59.970599+0000","last_active":"2023-07-27T14:40:00.415169+0000","last_peered":"2023-07-27T14:40:00.415169+0000","last_clean":"2023-07-27T14:40:00.415169+0000","last_became_active":"2023-07-27T14:39:59.970336+0000","last_became_peered":"2023-07-27T14:39:59.970336+0000","last_unstale":"2023-07-27T14:40:00.415169+0000","last_undegraded":"2023-07-27T14:40:00.415169+0000","last_fullsized":"2023-07-27T14:40:00.415169+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442575+0000","last_change":"2023-07-27T14:40:00.436081+0000","last_active":"2023-07-27T14:40:00.442575+0000","last_peered":"2023-07-27T14:40:00.442575+0000","last_clean":"2023-07-27T14:40:00.442575+0000","last_became_active":"2023-07-27T14:40:00.435407+0000","last_became_peered":"2023-07-27T14:40:00.435407+0000","last_unstale":"2023-07-27T14:40:00.442575+0000","last_undegraded":"2023-07-27T14:40:00.442575+0000","last_fullsized":"2023-07-27T14:40:00.442575+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.34","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446741+0000","last_change":"2023-07-27T14:39:59.970857+0000","last_active":"2023-07-27T14:40:00.446741+0000","last_peered":"2023-07-27T14:40:00.446741+0000","last_clean":"2023-07-27T14:40:00.446741+0000","last_became_active":"2023-07-27T14:39:59.970436+0000","last_became_peered":"2023-07-27T14:39:59.970436+0000","last_unstale":"2023-07-27T14:40:00.446741+0000","last_undegraded":"2023-07-27T14:40:00.446741+0000","last_fullsized":"2023-07-27T14:40:00.446741+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.434563+0000","last_change":"2023-07-27T14:40:00.426128+0000","last_active":"2023-07-27T14:40:00.434563+0000","last_peered":"2023-07-27T14:40:00.434563+0000","last_clean":"2023-07-27T14:40:00.434563+0000","last_became_active":"2023-07-27T14:40:00.425601+0000","last_became_peered":"2023-07-27T14:40:00.425601+0000","last_unstale":"2023-07-27T14:40:00.434563+0000","last_undegraded":"2023-07-27T14:40:00.434563+0000","last_fullsized":"2023-07-27T14:40:00.434563+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.435761+0000","last_change":"2023-07-27T14:39:59.980889+0000","last_active":"2023-07-27T14:40:00.435761+0000","last_peered":"2023-07-27T14:40:00.435761+0000","last_clean":"2023-07-27T14:40:00.435761+0000","last_became_active":"2023-07-27T14:39:59.980579+0000","last_became_peered":"2023-07-27T14:39:59.980579+0000","last_unstale":"2023-07-27T14:40:00.435761+0000","last_undegraded":"2023-07-27T14:40:00.435761+0000","last_fullsized":"2023-07-27T14:40:00.435761+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437086+0000","last_change":"2023-07-27T14:40:00.430497+0000","last_active":"2023-07-27T14:40:00.437086+0000","last_peered":"2023-07-27T14:40:00.437086+0000","last_clean":"2023-07-27T14:40:00.437086+0000","last_became_active":"2023-07-27T14:40:00.430221+0000","last_became_peered":"2023-07-27T14:40:00.430221+0000","last_unstale":"2023-07-27T14:40:00.437086+0000","last_undegraded":"2023-07-27T14:40:00.437086+0000","last_fullsized":"2023-07-27T14:40:00.437086+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439546+0000","last_change":"2023-07-27T14:39:59.974472+0000","last_active":"2023-07-27T14:40:00.439546+0000","last_peered":"2023-07-27T14:40:00.439546+0000","last_clean":"2023-07-27T14:40:00.439546+0000","last_became_active":"2023-07-27T14:39:59.974210+0000","last_became_peered":"2023-07-27T14:39:59.974210+0000","last_unstale":"2023-07-27T14:40:00.439546+0000","last_undegraded":"2023-07-27T14:40:00.439546+0000","last_fullsized":"2023-07-27T14:40:00.439546+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.430740+0000","last_change":"2023-07-27T14:40:00.428188+0000","last_active":"2023-07-27T14:40:00.430740+0000","last_peered":"2023-07-27T14:40:00.430740+0000","last_clean":"2023-07-27T14:40:00.430740+0000","last_became_active":"2023-07-27T14:40:00.427448+0000","last_became_peered":"2023-07-27T14:40:00.427448+0000","last_unstale":"2023-07-27T14:40:00.430740+0000","last_undegraded":"2023-07-27T14:40:00.430740+0000","last_fullsized":"2023-07-27T14:40:00.430740+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418797+0000","last_change":"2023-07-27T14:39:59.986154+0000","last_active":"2023-07-27T14:40:00.418797+0000","last_peered":"2023-07-27T14:40:00.418797+0000","last_clean":"2023-07-27T14:40:00.418797+0000","last_became_active":"2023-07-27T14:39:59.985872+0000","last_became_peered":"2023-07-27T14:39:59.985872+0000","last_unstale":"2023-07-27T14:40:00.418797+0000","last_undegraded":"2023-07-27T14:40:00.418797+0000","last_fullsized":"2023-07-27T14:40:00.418797+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447435+0000","last_change":"2023-07-27T14:40:00.446561+0000","last_active":"2023-07-27T14:40:00.447435+0000","last_peered":"2023-07-27T14:40:00.447435+0000","last_clean":"2023-07-27T14:40:00.447435+0000","last_became_active":"2023-07-27T14:40:00.446240+0000","last_became_peered":"2023-07-27T14:40:00.446240+0000","last_unstale":"2023-07-27T14:40:00.447435+0000","last_undegraded":"2023-07-27T14:40:00.447435+0000","last_fullsized":"2023-07-27T14:40:00.447435+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.30","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441928+0000","last_change":"2023-07-27T14:39:59.963969+0000","last_active":"2023-07-27T14:40:00.441928+0000","last_peered":"2023-07-27T14:40:00.441928+0000","last_clean":"2023-07-27T14:40:00.441928+0000","last_became_active":"2023-07-27T14:39:59.963693+0000","last_became_peered":"2023-07-27T14:39:59.963693+0000","last_unstale":"2023-07-27T14:40:00.441928+0000","last_undegraded":"2023-07-27T14:40:00.441928+0000","last_fullsized":"2023-07-27T14:40:00.441928+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439272+0000","last_change":"2023-07-27T14:40:00.436081+0000","last_active":"2023-07-27T14:40:00.439272+0000","last_peered":"2023-07-27T14:40:00.439272+0000","last_clean":"2023-07-27T14:40:00.439272+0000","last_became_active":"2023-07-27T14:40:00.435741+0000","last_became_peered":"2023-07-27T14:40:00.435741+0000","last_unstale":"2023-07-27T14:40:00.439272+0000","last_undegraded":"2023-07-27T14:40:00.439272+0000","last_fullsized":"2023-07-27T14:40:00.439272+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420765+0000","last_change":"2023-07-27T14:39:59.964330+0000","last_active":"2023-07-27T14:40:00.420765+0000","last_peered":"2023-07-27T14:40:00.420765+0000","last_clean":"2023-07-27T14:40:00.420765+0000","last_became_active":"2023-07-27T14:39:59.964054+0000","last_became_peered":"2023-07-27T14:39:59.964054+0000","last_unstale":"2023-07-27T14:40:00.420765+0000","last_undegraded":"2023-07-27T14:40:00.420765+0000","last_fullsized":"2023-07-27T14:40:00.420765+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439124+0000","last_change":"2023-07-27T14:40:00.427087+0000","last_active":"2023-07-27T14:40:00.439124+0000","last_peered":"2023-07-27T14:40:00.439124+0000","last_clean":"2023-07-27T14:40:00.439124+0000","last_became_active":"2023-07-27T14:40:00.426804+0000","last_became_peered":"2023-07-27T14:40:00.426804+0000","last_unstale":"2023-07-27T14:40:00.439124+0000","last_undegraded":"2023-07-27T14:40:00.439124+0000","last_fullsized":"2023-07-27T14:40:00.439124+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419374+0000","last_change":"2023-07-27T14:39:59.963318+0000","last_active":"2023-07-27T14:40:00.419374+0000","last_peered":"2023-07-27T14:40:00.419374+0000","last_clean":"2023-07-27T14:40:00.419374+0000","last_became_active":"2023-07-27T14:39:59.963055+0000","last_became_peered":"2023-07-27T14:39:59.963055+0000","last_unstale":"2023-07-27T14:40:00.419374+0000","last_undegraded":"2023-07-27T14:40:00.419374+0000","last_fullsized":"2023-07-27T14:40:00.419374+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428862+0000","last_change":"2023-07-27T14:40:00.423749+0000","last_active":"2023-07-27T14:40:00.428862+0000","last_peered":"2023-07-27T14:40:00.428862+0000","last_clean":"2023-07-27T14:40:00.428862+0000","last_became_active":"2023-07-27T14:40:00.423476+0000","last_became_peered":"2023-07-27T14:40:00.423476+0000","last_unstale":"2023-07-27T14:40:00.428862+0000","last_undegraded":"2023-07-27T14:40:00.428862+0000","last_fullsized":"2023-07-27T14:40:00.428862+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2d","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448022+0000","last_change":"2023-07-27T14:39:59.964414+0000","last_active":"2023-07-27T14:40:00.448022+0000","last_peered":"2023-07-27T14:40:00.448022+0000","last_clean":"2023-07-27T14:40:00.448022+0000","last_became_active":"2023-07-27T14:39:59.964068+0000","last_became_peered":"2023-07-27T14:39:59.964068+0000","last_unstale":"2023-07-27T14:40:00.448022+0000","last_undegraded":"2023-07-27T14:40:00.448022+0000","last_fullsized":"2023-07-27T14:40:00.448022+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438324+0000","last_change":"2023-07-27T14:40:00.432481+0000","last_active":"2023-07-27T14:40:00.438324+0000","last_peered":"2023-07-27T14:40:00.438324+0000","last_clean":"2023-07-27T14:40:00.438324+0000","last_became_active":"2023-07-27T14:40:00.431034+0000","last_became_peered":"2023-07-27T14:40:00.431034+0000","last_unstale":"2023-07-27T14:40:00.438324+0000","last_undegraded":"2023-07-27T14:40:00.438324+0000","last_fullsized":"2023-07-27T14:40:00.438324+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431336+0000","last_change":"2023-07-27T14:39:59.977733+0000","last_active":"2023-07-27T14:40:00.431336+0000","last_peered":"2023-07-27T14:40:00.431336+0000","last_clean":"2023-07-27T14:40:00.431336+0000","last_became_active":"2023-07-27T14:39:59.977440+0000","last_became_peered":"2023-07-27T14:39:59.977440+0000","last_unstale":"2023-07-27T14:40:00.431336+0000","last_undegraded":"2023-07-27T14:40:00.431336+0000","last_fullsized":"2023-07-27T14:40:00.431336+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431884+0000","last_change":"2023-07-27T14:40:00.430299+0000","last_active":"2023-07-27T14:40:00.431884+0000","last_peered":"2023-07-27T14:40:00.431884+0000","last_clean":"2023-07-27T14:40:00.431884+0000","last_became_active":"2023-07-27T14:40:00.430033+0000","last_became_peered":"2023-07-27T14:40:00.430033+0000","last_unstale":"2023-07-27T14:40:00.431884+0000","last_undegraded":"2023-07-27T14:40:00.431884+0000","last_fullsized":"2023-07-27T14:40:00.431884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.445438+0000","last_change":"2023-07-27T14:39:59.968798+0000","last_active":"2023-07-27T14:40:00.445438+0000","last_peered":"2023-07-27T14:40:00.445438+0000","last_clean":"2023-07-27T14:40:00.445438+0000","last_became_active":"2023-07-27T14:39:59.968497+0000","last_became_peered":"2023-07-27T14:39:59.968497+0000","last_unstale":"2023-07-27T14:40:00.445438+0000","last_undegraded":"2023-07-27T14:40:00.445438+0000","last_fullsized":"2023-07-27T14:40:00.445438+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438453+0000","last_change":"2023-07-27T14:40:00.431553+0000","last_active":"2023-07-27T14:40:00.438453+0000","last_peered":"2023-07-27T14:40:00.438453+0000","last_clean":"2023-07-27T14:40:00.438453+0000","last_became_active":"2023-07-27T14:40:00.430671+0000","last_became_peered":"2023-07-27T14:40:00.430671+0000","last_unstale":"2023-07-27T14:40:00.438453+0000","last_undegraded":"2023-07-27T14:40:00.438453+0000","last_fullsized":"2023-07-27T14:40:00.438453+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439652+0000","last_change":"2023-07-27T14:39:59.978311+0000","last_active":"2023-07-27T14:40:00.439652+0000","last_peered":"2023-07-27T14:40:00.439652+0000","last_clean":"2023-07-27T14:40:00.439652+0000","last_became_active":"2023-07-27T14:39:59.974419+0000","last_became_peered":"2023-07-27T14:39:59.974419+0000","last_unstale":"2023-07-27T14:40:00.439652+0000","last_undegraded":"2023-07-27T14:40:00.439652+0000","last_fullsized":"2023-07-27T14:40:00.439652+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428295+0000","last_change":"2023-07-27T14:40:00.424022+0000","last_active":"2023-07-27T14:40:00.428295+0000","last_peered":"2023-07-27T14:40:00.428295+0000","last_clean":"2023-07-27T14:40:00.428295+0000","last_became_active":"2023-07-27T14:40:00.423746+0000","last_became_peered":"2023-07-27T14:40:00.423746+0000","last_unstale":"2023-07-27T14:40:00.428295+0000","last_undegraded":"2023-07-27T14:40:00.428295+0000","last_fullsized":"2023-07-27T14:40:00.428295+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.416887+0000","last_change":"2023-07-27T14:39:59.980446+0000","last_active":"2023-07-27T14:40:00.416887+0000","last_peered":"2023-07-27T14:40:00.416887+0000","last_clean":"2023-07-27T14:40:00.416887+0000","last_became_active":"2023-07-27T14:39:59.980179+0000","last_became_peered":"2023-07-27T14:39:59.980179+0000","last_unstale":"2023-07-27T14:40:00.416887+0000","last_undegraded":"2023-07-27T14:40:00.416887+0000","last_fullsized":"2023-07-27T14:40:00.416887+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442837+0000","last_change":"2023-07-27T14:40:00.436832+0000","last_active":"2023-07-27T14:40:00.442837+0000","last_peered":"2023-07-27T14:40:00.442837+0000","last_clean":"2023-07-27T14:40:00.442837+0000","last_became_active":"2023-07-27T14:40:00.436570+0000","last_became_peered":"2023-07-27T14:40:00.436570+0000","last_unstale":"2023-07-27T14:40:00.442837+0000","last_undegraded":"2023-07-27T14:40:00.442837+0000","last_fullsized":"2023-07-27T14:40:00.442837+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419078+0000","last_change":"2023-07-27T14:39:59.976359+0000","last_active":"2023-07-27T14:40:00.419078+0000","last_peered":"2023-07-27T14:40:00.419078+0000","last_clean":"2023-07-27T14:40:00.419078+0000","last_became_active":"2023-07-27T14:39:59.976086+0000","last_became_peered":"2023-07-27T14:39:59.976086+0000","last_unstale":"2023-07-27T14:40:00.419078+0000","last_undegraded":"2023-07-27T14:40:00.419078+0000","last_fullsized":"2023-07-27T14:40:00.419078+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427709+0000","last_change":"2023-07-27T14:40:00.425690+0000","last_active":"2023-07-27T14:40:00.427709+0000","last_peered":"2023-07-27T14:40:00.427709+0000","last_clean":"2023-07-27T14:40:00.427709+0000","last_became_active":"2023-07-27T14:40:00.425433+0000","last_became_peered":"2023-07-27T14:40:00.425433+0000","last_unstale":"2023-07-27T14:40:00.427709+0000","last_undegraded":"2023-07-27T14:40:00.427709+0000","last_fullsized":"2023-07-27T14:40:00.427709+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420864+0000","last_change":"2023-07-27T14:39:59.962795+0000","last_active":"2023-07-27T14:40:00.420864+0000","last_peered":"2023-07-27T14:40:00.420864+0000","last_clean":"2023-07-27T14:40:00.420864+0000","last_became_active":"2023-07-27T14:39:59.962537+0000","last_became_peered":"2023-07-27T14:39:59.962537+0000","last_unstale":"2023-07-27T14:40:00.420864+0000","last_undegraded":"2023-07-27T14:40:00.420864+0000","last_fullsized":"2023-07-27T14:40:00.420864+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442531+0000","last_change":"2023-07-27T14:40:00.435682+0000","last_active":"2023-07-27T14:40:00.442531+0000","last_peered":"2023-07-27T14:40:00.442531+0000","last_clean":"2023-07-27T14:40:00.442531+0000","last_became_active":"2023-07-27T14:40:00.435243+0000","last_became_peered":"2023-07-27T14:40:00.435243+0000","last_unstale":"2023-07-27T14:40:00.442531+0000","last_undegraded":"2023-07-27T14:40:00.442531+0000","last_fullsized":"2023-07-27T14:40:00.442531+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417634+0000","last_change":"2023-07-27T14:39:59.983757+0000","last_active":"2023-07-27T14:40:00.417634+0000","last_peered":"2023-07-27T14:40:00.417634+0000","last_clean":"2023-07-27T14:40:00.417634+0000","last_became_active":"2023-07-27T14:39:59.983414+0000","last_became_peered":"2023-07-27T14:39:59.983414+0000","last_unstale":"2023-07-27T14:40:00.417634+0000","last_undegraded":"2023-07-27T14:40:00.417634+0000","last_fullsized":"2023-07-27T14:40:00.417634+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427352+0000","last_change":"2023-07-27T14:40:00.422356+0000","last_active":"2023-07-27T14:40:00.427352+0000","last_peered":"2023-07-27T14:40:00.427352+0000","last_clean":"2023-07-27T14:40:00.427352+0000","last_became_active":"2023-07-27T14:40:00.422057+0000","last_became_peered":"2023-07-27T14:40:00.422057+0000","last_unstale":"2023-07-27T14:40:00.427352+0000","last_undegraded":"2023-07-27T14:40:00.427352+0000","last_fullsized":"2023-07-27T14:40:00.427352+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415297+0000","last_change":"2023-07-27T14:39:59.970682+0000","last_active":"2023-07-27T14:40:00.415297+0000","last_peered":"2023-07-27T14:40:00.415297+0000","last_clean":"2023-07-27T14:40:00.415297+0000","last_became_active":"2023-07-27T14:39:59.970351+0000","last_became_peered":"2023-07-27T14:39:59.970351+0000","last_unstale":"2023-07-27T14:40:00.415297+0000","last_undegraded":"2023-07-27T14:40:00.415297+0000","last_fullsized":"2023-07-27T14:40:00.415297+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442597+0000","last_change":"2023-07-27T14:40:00.436452+0000","last_active":"2023-07-27T14:40:00.442597+0000","last_peered":"2023-07-27T14:40:00.442597+0000","last_clean":"2023-07-27T14:40:00.442597+0000","last_became_active":"2023-07-27T14:40:00.436170+0000","last_became_peered":"2023-07-27T14:40:00.436170+0000","last_unstale":"2023-07-27T14:40:00.442597+0000","last_undegraded":"2023-07-27T14:40:00.442597+0000","last_fullsized":"2023-07-27T14:40:00.442597+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418696+0000","last_change":"2023-07-27T14:39:59.978710+0000","last_active":"2023-07-27T14:40:00.418696+0000","last_peered":"2023-07-27T14:40:00.418696+0000","last_clean":"2023-07-27T14:40:00.418696+0000","last_became_active":"2023-07-27T14:39:59.978442+0000","last_became_peered":"2023-07-27T14:39:59.978442+0000","last_unstale":"2023-07-27T14:40:00.418696+0000","last_undegraded":"2023-07-27T14:40:00.418696+0000","last_fullsized":"2023-07-27T14:40:00.418696+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449386+0000","last_change":"2023-07-27T14:40:00.448176+0000","last_active":"2023-07-27T14:40:00.449386+0000","last_peered":"2023-07-27T14:40:00.449386+0000","last_clean":"2023-07-27T14:40:00.449386+0000","last_became_active":"2023-07-27T14:40:00.447900+0000","last_became_peered":"2023-07-27T14:40:00.447900+0000","last_unstale":"2023-07-27T14:40:00.449386+0000","last_undegraded":"2023-07-27T14:40:00.449386+0000","last_fullsized":"2023-07-27T14:40:00.449386+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418997+0000","last_change":"2023-07-27T14:39:59.974113+0000","last_active":"2023-07-27T14:40:00.418997+0000","last_peered":"2023-07-27T14:40:00.418997+0000","last_clean":"2023-07-27T14:40:00.418997+0000","last_became_active":"2023-07-27T14:39:59.973820+0000","last_became_peered":"2023-07-27T14:39:59.973820+0000","last_unstale":"2023-07-27T14:40:00.418997+0000","last_undegraded":"2023-07-27T14:40:00.418997+0000","last_fullsized":"2023-07-27T14:40:00.418997+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447003+0000","last_change":"2023-07-27T14:40:00.445225+0000","last_active":"2023-07-27T14:40:00.447003+0000","last_peered":"2023-07-27T14:40:00.447003+0000","last_clean":"2023-07-27T14:40:00.447003+0000","last_became_active":"2023-07-27T14:40:00.444702+0000","last_became_peered":"2023-07-27T14:40:00.444702+0000","last_unstale":"2023-07-27T14:40:00.447003+0000","last_undegraded":"2023-07-27T14:40:00.447003+0000","last_fullsized":"2023-07-27T14:40:00.447003+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419428+0000","last_change":"2023-07-27T14:39:59.982464+0000","last_active":"2023-07-27T14:40:00.419428+0000","last_peered":"2023-07-27T14:40:00.419428+0000","last_clean":"2023-07-27T14:40:00.419428+0000","last_became_active":"2023-07-27T14:39:59.982140+0000","last_became_peered":"2023-07-27T14:39:59.982140+0000","last_unstale":"2023-07-27T14:40:00.419428+0000","last_undegraded":"2023-07-27T14:40:00.419428+0000","last_fullsized":"2023-07-27T14:40:00.419428+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442334+0000","last_change":"2023-07-27T14:40:00.441511+0000","last_active":"2023-07-27T14:40:00.442334+0000","last_peered":"2023-07-27T14:40:00.442334+0000","last_clean":"2023-07-27T14:40:00.442334+0000","last_became_active":"2023-07-27T14:40:00.441161+0000","last_became_peered":"2023-07-27T14:40:00.441161+0000","last_unstale":"2023-07-27T14:40:00.442334+0000","last_undegraded":"2023-07-27T14:40:00.442334+0000","last_fullsized":"2023-07-27T14:40:00.442334+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421464+0000","last_change":"2023-07-27T14:39:59.985195+0000","last_active":"2023-07-27T14:40:00.421464+0000","last_peered":"2023-07-27T14:40:00.421464+0000","last_clean":"2023-07-27T14:40:00.421464+0000","last_became_active":"2023-07-27T14:39:59.984814+0000","last_became_peered":"2023-07-27T14:39:59.984814+0000","last_unstale":"2023-07-27T14:40:00.421464+0000","last_undegraded":"2023-07-27T14:40:00.421464+0000","last_fullsized":"2023-07-27T14:40:00.421464+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428642+0000","last_change":"2023-07-27T14:40:00.424395+0000","last_active":"2023-07-27T14:40:00.428642+0000","last_peered":"2023-07-27T14:40:00.428642+0000","last_clean":"2023-07-27T14:40:00.428642+0000","last_became_active":"2023-07-27T14:40:00.424127+0000","last_became_peered":"2023-07-27T14:40:00.424127+0000","last_unstale":"2023-07-27T14:40:00.428642+0000","last_undegraded":"2023-07-27T14:40:00.428642+0000","last_fullsized":"2023-07-27T14:40:00.428642+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.422891+0000","last_change":"2023-07-27T14:39:59.974671+0000","last_active":"2023-07-27T14:40:00.422891+0000","last_peered":"2023-07-27T14:40:00.422891+0000","last_clean":"2023-07-27T14:40:00.422891+0000","last_became_active":"2023-07-27T14:39:59.974384+0000","last_became_peered":"2023-07-27T14:39:59.974384+0000","last_unstale":"2023-07-27T14:40:00.422891+0000","last_undegraded":"2023-07-27T14:40:00.422891+0000","last_fullsized":"2023-07-27T14:40:00.422891+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446273+0000","last_change":"2023-07-27T14:40:00.444835+0000","last_active":"2023-07-27T14:40:00.446273+0000","last_peered":"2023-07-27T14:40:00.446273+0000","last_clean":"2023-07-27T14:40:00.446273+0000","last_became_active":"2023-07-27T14:40:00.444537+0000","last_became_peered":"2023-07-27T14:40:00.444537+0000","last_unstale":"2023-07-27T14:40:00.446273+0000","last_undegraded":"2023-07-27T14:40:00.446273+0000","last_fullsized":"2023-07-27T14:40:00.446273+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.422681+0000","last_change":"2023-07-27T14:39:59.980403+0000","last_active":"2023-07-27T14:40:00.422681+0000","last_peered":"2023-07-27T14:40:00.422681+0000","last_clean":"2023-07-27T14:40:00.422681+0000","last_became_active":"2023-07-27T14:39:59.980104+0000","last_became_peered":"2023-07-27T14:39:59.980104+0000","last_unstale":"2023-07-27T14:40:00.422681+0000","last_undegraded":"2023-07-27T14:40:00.422681+0000","last_fullsized":"2023-07-27T14:40:00.422681+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444136+0000","last_change":"2023-07-27T14:40:00.439027+0000","last_active":"2023-07-27T14:40:00.444136+0000","last_peered":"2023-07-27T14:40:00.444136+0000","last_clean":"2023-07-27T14:40:00.444136+0000","last_became_active":"2023-07-27T14:40:00.438761+0000","last_became_peered":"2023-07-27T14:40:00.438761+0000","last_unstale":"2023-07-27T14:40:00.444136+0000","last_undegraded":"2023-07-27T14:40:00.444136+0000","last_fullsized":"2023-07-27T14:40:00.444136+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419473+0000","last_change":"2023-07-27T14:39:59.966964+0000","last_active":"2023-07-27T14:40:00.419473+0000","last_peered":"2023-07-27T14:40:00.419473+0000","last_clean":"2023-07-27T14:40:00.419473+0000","last_became_active":"2023-07-27T14:39:59.966695+0000","last_became_peered":"2023-07-27T14:39:59.966695+0000","last_unstale":"2023-07-27T14:40:00.419473+0000","last_undegraded":"2023-07-27T14:40:00.419473+0000","last_fullsized":"2023-07-27T14:40:00.419473+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447298+0000","last_change":"2023-07-27T14:40:00.446118+0000","last_active":"2023-07-27T14:40:00.447298+0000","last_peered":"2023-07-27T14:40:00.447298+0000","last_clean":"2023-07-27T14:40:00.447298+0000","last_became_active":"2023-07-27T14:40:00.445679+0000","last_became_peered":"2023-07-27T14:40:00.445679+0000","last_unstale":"2023-07-27T14:40:00.447298+0000","last_undegraded":"2023-07-27T14:40:00.447298+0000","last_fullsized":"2023-07-27T14:40:00.447298+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"204'3","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440604+0000","last_change":"2023-07-27T14:39:59.962153+0000","last_active":"2023-07-27T14:40:00.440604+0000","last_peered":"2023-07-27T14:40:00.440604+0000","last_clean":"2023-07-27T14:40:00.440604+0000","last_became_active":"2023-07-27T14:39:59.961854+0000","last_became_peered":"2023-07-27T14:39:59.961854+0000","last_unstale":"2023-07-27T14:40:00.440604+0000","last_undegraded":"2023-07-27T14:40:00.440604+0000","last_fullsized":"2023-07-27T14:40:00.440604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446329+0000","last_change":"2023-07-27T14:40:00.442290+0000","last_active":"2023-07-27T14:40:00.446329+0000","last_peered":"2023-07-27T14:40:00.446329+0000","last_clean":"2023-07-27T14:40:00.446329+0000","last_became_active":"2023-07-27T14:40:00.442022+0000","last_became_peered":"2023-07-27T14:40:00.442022+0000","last_unstale":"2023-07-27T14:40:00.446329+0000","last_undegraded":"2023-07-27T14:40:00.446329+0000","last_fullsized":"2023-07-27T14:40:00.446329+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440839+0000","last_change":"2023-07-27T14:39:59.973460+0000","last_active":"2023-07-27T14:40:00.440839+0000","last_peered":"2023-07-27T14:40:00.440839+0000","last_clean":"2023-07-27T14:40:00.440839+0000","last_became_active":"2023-07-27T14:39:59.973163+0000","last_became_peered":"2023-07-27T14:39:59.973163+0000","last_unstale":"2023-07-27T14:40:00.440839+0000","last_undegraded":"2023-07-27T14:40:00.440839+0000","last_fullsized":"2023-07-27T14:40:00.440839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431539+0000","last_change":"2023-07-27T14:40:00.426655+0000","last_active":"2023-07-27T14:40:00.431539+0000","last_peered":"2023-07-27T14:40:00.431539+0000","last_clean":"2023-07-27T14:40:00.431539+0000","last_became_active":"2023-07-27T14:40:00.426182+0000","last_became_peered":"2023-07-27T14:40:00.426182+0000","last_unstale":"2023-07-27T14:40:00.431539+0000","last_undegraded":"2023-07-27T14:40:00.431539+0000","last_fullsized":"2023-07-27T14:40:00.431539+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444068+0000","last_change":"2023-07-27T14:39:59.983557+0000","last_active":"2023-07-27T14:40:00.444068+0000","last_peered":"2023-07-27T14:40:00.444068+0000","last_clean":"2023-07-27T14:40:00.444068+0000","last_became_active":"2023-07-27T14:39:59.983347+0000","last_became_peered":"2023-07-27T14:39:59.983347+0000","last_unstale":"2023-07-27T14:40:00.444068+0000","last_undegraded":"2023-07-27T14:40:00.444068+0000","last_fullsized":"2023-07-27T14:40:00.444068+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.443293+0000","last_change":"2023-07-27T14:40:00.430903+0000","last_active":"2023-07-27T14:40:00.443293+0000","last_peered":"2023-07-27T14:40:00.443293+0000","last_clean":"2023-07-27T14:40:00.443293+0000","last_became_active":"2023-07-27T14:40:00.430608+0000","last_became_peered":"2023-07-27T14:40:00.430608+0000","last_unstale":"2023-07-27T14:40:00.443293+0000","last_undegraded":"2023-07-27T14:40:00.443293+0000","last_fullsized":"2023-07-27T14:40:00.443293+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421067+0000","last_change":"2023-07-27T14:39:59.972458+0000","last_active":"2023-07-27T14:40:00.421067+0000","last_peered":"2023-07-27T14:40:00.421067+0000","last_clean":"2023-07-27T14:40:00.421067+0000","last_became_active":"2023-07-27T14:39:59.972157+0000","last_became_peered":"2023-07-27T14:39:59.972157+0000","last_unstale":"2023-07-27T14:40:00.421067+0000","last_undegraded":"2023-07-27T14:40:00.421067+0000","last_fullsized":"2023-07-27T14:40:00.421067+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448189+0000","last_change":"2023-07-27T14:40:00.442776+0000","last_active":"2023-07-27T14:40:00.448189+0000","last_peered":"2023-07-27T14:40:00.448189+0000","last_clean":"2023-07-27T14:40:00.448189+0000","last_became_active":"2023-07-27T14:40:00.435831+0000","last_became_peered":"2023-07-27T14:40:00.435831+0000","last_unstale":"2023-07-27T14:40:00.448189+0000","last_undegraded":"2023-07-27T14:40:00.448189+0000","last_fullsized":"2023-07-27T14:40:00.448189+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.413941+0000","last_change":"2023-07-27T14:39:59.968781+0000","last_active":"2023-07-27T14:40:00.413941+0000","last_peered":"2023-07-27T14:40:00.413941+0000","last_clean":"2023-07-27T14:40:00.413941+0000","last_became_active":"2023-07-27T14:39:59.968014+0000","last_became_peered":"2023-07-27T14:39:59.968014+0000","last_unstale":"2023-07-27T14:40:00.413941+0000","last_undegraded":"2023-07-27T14:40:00.413941+0000","last_fullsized":"2023-07-27T14:40:00.413941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438593+0000","last_change":"2023-07-27T14:40:00.428136+0000","last_active":"2023-07-27T14:40:00.438593+0000","last_peered":"2023-07-27T14:40:00.438593+0000","last_clean":"2023-07-27T14:40:00.438593+0000","last_became_active":"2023-07-27T14:40:00.427873+0000","last_became_peered":"2023-07-27T14:40:00.427873+0000","last_unstale":"2023-07-27T14:40:00.438593+0000","last_undegraded":"2023-07-27T14:40:00.438593+0000","last_fullsized":"2023-07-27T14:40:00.438593+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441642+0000","last_change":"2023-07-27T14:39:59.980938+0000","last_active":"2023-07-27T14:40:00.441642+0000","last_peered":"2023-07-27T14:40:00.441642+0000","last_clean":"2023-07-27T14:40:00.441642+0000","last_became_active":"2023-07-27T14:39:59.980627+0000","last_became_peered":"2023-07-27T14:39:59.980627+0000","last_unstale":"2023-07-27T14:40:00.441642+0000","last_undegraded":"2023-07-27T14:40:00.441642+0000","last_fullsized":"2023-07-27T14:40:00.441642+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432889+0000","last_change":"2023-07-27T14:40:00.428525+0000","last_active":"2023-07-27T14:40:00.432889+0000","last_peered":"2023-07-27T14:40:00.432889+0000","last_clean":"2023-07-27T14:40:00.432889+0000","last_became_active":"2023-07-27T14:40:00.428213+0000","last_became_peered":"2023-07-27T14:40:00.428213+0000","last_unstale":"2023-07-27T14:40:00.432889+0000","last_undegraded":"2023-07-27T14:40:00.432889+0000","last_fullsized":"2023-07-27T14:40:00.432889+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449173+0000","last_change":"2023-07-27T14:39:59.977104+0000","last_active":"2023-07-27T14:40:00.449173+0000","last_peered":"2023-07-27T14:40:00.449173+0000","last_clean":"2023-07-27T14:40:00.449173+0000","last_became_active":"2023-07-27T14:39:59.976822+0000","last_became_peered":"2023-07-27T14:39:59.976822+0000","last_unstale":"2023-07-27T14:40:00.449173+0000","last_undegraded":"2023-07-27T14:40:00.449173+0000","last_fullsized":"2023-07-27T14:40:00.449173+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439610+0000","last_change":"2023-07-27T14:40:00.436729+0000","last_active":"2023-07-27T14:40:00.439610+0000","last_peered":"2023-07-27T14:40:00.439610+0000","last_clean":"2023-07-27T14:40:00.439610+0000","last_became_active":"2023-07-27T14:40:00.436469+0000","last_became_peered":"2023-07-27T14:40:00.436469+0000","last_unstale":"2023-07-27T14:40:00.439610+0000","last_undegraded":"2023-07-27T14:40:00.439610+0000","last_fullsized":"2023-07-27T14:40:00.439610+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439513+0000","last_change":"2023-07-27T14:39:59.972384+0000","last_active":"2023-07-27T14:40:00.439513+0000","last_peered":"2023-07-27T14:40:00.439513+0000","last_clean":"2023-07-27T14:40:00.439513+0000","last_became_active":"2023-07-27T14:39:59.972023+0000","last_became_peered":"2023-07-27T14:39:59.972023+0000","last_unstale":"2023-07-27T14:40:00.439513+0000","last_undegraded":"2023-07-27T14:40:00.439513+0000","last_fullsized":"2023-07-27T14:40:00.439513+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447350+0000","last_change":"2023-07-27T14:40:00.440188+0000","last_active":"2023-07-27T14:40:00.447350+0000","last_peered":"2023-07-27T14:40:00.447350+0000","last_clean":"2023-07-27T14:40:00.447350+0000","last_became_active":"2023-07-27T14:40:00.439491+0000","last_became_peered":"2023-07-27T14:40:00.439491+0000","last_unstale":"2023-07-27T14:40:00.447350+0000","last_undegraded":"2023-07-27T14:40:00.447350+0000","last_fullsized":"2023-07-27T14:40:00.447350+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.424520+0000","last_change":"2023-07-27T14:39:59.985236+0000","last_active":"2023-07-27T14:40:00.424520+0000","last_peered":"2023-07-27T14:40:00.424520+0000","last_clean":"2023-07-27T14:40:00.424520+0000","last_became_active":"2023-07-27T14:39:59.984943+0000","last_became_peered":"2023-07-27T14:39:59.984943+0000","last_unstale":"2023-07-27T14:40:00.424520+0000","last_undegraded":"2023-07-27T14:40:00.424520+0000","last_fullsized":"2023-07-27T14:40:00.424520+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447094+0000","last_change":"2023-07-27T14:40:00.440419+0000","last_active":"2023-07-27T14:40:00.447094+0000","last_peered":"2023-07-27T14:40:00.447094+0000","last_clean":"2023-07-27T14:40:00.447094+0000","last_became_active":"2023-07-27T14:40:00.440077+0000","last_became_peered":"2023-07-27T14:40:00.440077+0000","last_unstale":"2023-07-27T14:40:00.447094+0000","last_undegraded":"2023-07-27T14:40:00.447094+0000","last_fullsized":"2023-07-27T14:40:00.447094+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418246+0000","last_change":"2023-07-27T14:39:59.971231+0000","last_active":"2023-07-27T14:40:00.418246+0000","last_peered":"2023-07-27T14:40:00.418246+0000","last_clean":"2023-07-27T14:40:00.418246+0000","last_became_active":"2023-07-27T14:39:59.970964+0000","last_became_peered":"2023-07-27T14:39:59.970964+0000","last_unstale":"2023-07-27T14:40:00.418246+0000","last_undegraded":"2023-07-27T14:40:00.418246+0000","last_fullsized":"2023-07-27T14:40:00.418246+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428953+0000","last_change":"2023-07-27T14:40:00.424947+0000","last_active":"2023-07-27T14:40:00.428953+0000","last_peered":"2023-07-27T14:40:00.428953+0000","last_clean":"2023-07-27T14:40:00.428953+0000","last_became_active":"2023-07-27T14:40:00.424664+0000","last_became_peered":"2023-07-27T14:40:00.424664+0000","last_unstale":"2023-07-27T14:40:00.428953+0000","last_undegraded":"2023-07-27T14:40:00.428953+0000","last_fullsized":"2023-07-27T14:40:00.428953+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448568+0000","last_change":"2023-07-27T14:39:59.973840+0000","last_active":"2023-07-27T14:40:00.448568+0000","last_peered":"2023-07-27T14:40:00.448568+0000","last_clean":"2023-07-27T14:40:00.448568+0000","last_became_active":"2023-07-27T14:39:59.973547+0000","last_became_peered":"2023-07-27T14:39:59.973547+0000","last_unstale":"2023-07-27T14:40:00.448568+0000","last_undegraded":"2023-07-27T14:40:00.448568+0000","last_fullsized":"2023-07-27T14:40:00.448568+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.443315+0000","last_change":"2023-07-27T14:40:00.437306+0000","last_active":"2023-07-27T14:40:00.443315+0000","last_peered":"2023-07-27T14:40:00.443315+0000","last_clean":"2023-07-27T14:40:00.443315+0000","last_became_active":"2023-07-27T14:40:00.437012+0000","last_became_peered":"2023-07-27T14:40:00.437012+0000","last_unstale":"2023-07-27T14:40:00.443315+0000","last_undegraded":"2023-07-27T14:40:00.443315+0000","last_fullsized":"2023-07-27T14:40:00.443315+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419345+0000","last_change":"2023-07-27T14:39:59.969929+0000","last_active":"2023-07-27T14:40:00.419345+0000","last_peered":"2023-07-27T14:40:00.419345+0000","last_clean":"2023-07-27T14:40:00.419345+0000","last_became_active":"2023-07-27T14:39:59.969613+0000","last_became_peered":"2023-07-27T14:39:59.969613+0000","last_unstale":"2023-07-27T14:40:00.419345+0000","last_undegraded":"2023-07-27T14:40:00.419345+0000","last_fullsized":"2023-07-27T14:40:00.419345+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433045+0000","last_change":"2023-07-27T14:40:00.428558+0000","last_active":"2023-07-27T14:40:00.433045+0000","last_peered":"2023-07-27T14:40:00.433045+0000","last_clean":"2023-07-27T14:40:00.433045+0000","last_became_active":"2023-07-27T14:40:00.428225+0000","last_became_peered":"2023-07-27T14:40:00.428225+0000","last_unstale":"2023-07-27T14:40:00.433045+0000","last_undegraded":"2023-07-27T14:40:00.433045+0000","last_fullsized":"2023-07-27T14:40:00.433045+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418817+0000","last_change":"2023-07-27T14:39:59.983735+0000","last_active":"2023-07-27T14:40:00.418817+0000","last_peered":"2023-07-27T14:40:00.418817+0000","last_clean":"2023-07-27T14:40:00.418817+0000","last_became_active":"2023-07-27T14:39:59.983374+0000","last_became_peered":"2023-07-27T14:39:59.983374+0000","last_unstale":"2023-07-27T14:40:00.418817+0000","last_undegraded":"2023-07-27T14:40:00.418817+0000","last_fullsized":"2023-07-27T14:40:00.418817+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432050+0000","last_change":"2023-07-27T14:40:00.428749+0000","last_active":"2023-07-27T14:40:00.432050+0000","last_peered":"2023-07-27T14:40:00.432050+0000","last_clean":"2023-07-27T14:40:00.432050+0000","last_became_active":"2023-07-27T14:40:00.428434+0000","last_became_peered":"2023-07-27T14:40:00.428434+0000","last_unstale":"2023-07-27T14:40:00.432050+0000","last_undegraded":"2023-07-27T14:40:00.432050+0000","last_fullsized":"2023-07-27T14:40:00.432050+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429228+0000","last_change":"2023-07-27T14:39:59.965470+0000","last_active":"2023-07-27T14:40:00.429228+0000","last_peered":"2023-07-27T14:40:00.429228+0000","last_clean":"2023-07-27T14:40:00.429228+0000","last_became_active":"2023-07-27T14:39:59.964847+0000","last_became_peered":"2023-07-27T14:39:59.964847+0000","last_unstale":"2023-07-27T14:40:00.429228+0000","last_undegraded":"2023-07-27T14:40:00.429228+0000","last_fullsized":"2023-07-27T14:40:00.429228+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432022+0000","last_change":"2023-07-27T14:40:00.429569+0000","last_active":"2023-07-27T14:40:00.432022+0000","last_peered":"2023-07-27T14:40:00.432022+0000","last_clean":"2023-07-27T14:40:00.432022+0000","last_became_active":"2023-07-27T14:40:00.429132+0000","last_became_peered":"2023-07-27T14:40:00.429132+0000","last_unstale":"2023-07-27T14:40:00.432022+0000","last_undegraded":"2023-07-27T14:40:00.432022+0000","last_fullsized":"2023-07-27T14:40:00.432022+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448534+0000","last_change":"2023-07-27T14:39:59.970152+0000","last_active":"2023-07-27T14:40:00.448534+0000","last_peered":"2023-07-27T14:40:00.448534+0000","last_clean":"2023-07-27T14:40:00.448534+0000","last_became_active":"2023-07-27T14:39:59.969856+0000","last_became_peered":"2023-07-27T14:39:59.969856+0000","last_unstale":"2023-07-27T14:40:00.448534+0000","last_undegraded":"2023-07-27T14:40:00.448534+0000","last_fullsized":"2023-07-27T14:40:00.448534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448138+0000","last_change":"2023-07-27T14:40:00.440758+0000","last_active":"2023-07-27T14:40:00.448138+0000","last_peered":"2023-07-27T14:40:00.448138+0000","last_clean":"2023-07-27T14:40:00.448138+0000","last_became_active":"2023-07-27T14:40:00.433122+0000","last_became_peered":"2023-07-27T14:40:00.433122+0000","last_unstale":"2023-07-27T14:40:00.448138+0000","last_undegraded":"2023-07-27T14:40:00.448138+0000","last_fullsized":"2023-07-27T14:40:00.448138+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421674+0000","last_change":"2023-07-27T14:39:59.980716+0000","last_active":"2023-07-27T14:40:00.421674+0000","last_peered":"2023-07-27T14:40:00.421674+0000","last_clean":"2023-07-27T14:40:00.421674+0000","last_became_active":"2023-07-27T14:39:59.980413+0000","last_became_peered":"2023-07-27T14:39:59.980413+0000","last_unstale":"2023-07-27T14:40:00.421674+0000","last_undegraded":"2023-07-27T14:40:00.421674+0000","last_fullsized":"2023-07-27T14:40:00.421674+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447368+0000","last_change":"2023-07-27T14:40:00.440397+0000","last_active":"2023-07-27T14:40:00.447368+0000","last_peered":"2023-07-27T14:40:00.447368+0000","last_clean":"2023-07-27T14:40:00.447368+0000","last_became_active":"2023-07-27T14:40:00.439883+0000","last_became_peered":"2023-07-27T14:40:00.439883+0000","last_unstale":"2023-07-27T14:40:00.447368+0000","last_undegraded":"2023-07-27T14:40:00.447368+0000","last_fullsized":"2023-07-27T14:40:00.447368+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.424930+0000","last_change":"2023-07-27T14:39:59.980928+0000","last_active":"2023-07-27T14:40:00.424930+0000","last_peered":"2023-07-27T14:40:00.424930+0000","last_clean":"2023-07-27T14:40:00.424930+0000","last_became_active":"2023-07-27T14:39:59.980628+0000","last_became_peered":"2023-07-27T14:39:59.980628+0000","last_unstale":"2023-07-27T14:40:00.424930+0000","last_undegraded":"2023-07-27T14:40:00.424930+0000","last_fullsized":"2023-07-27T14:40:00.424930+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428260+0000","last_change":"2023-07-27T14:40:00.425272+0000","last_active":"2023-07-27T14:40:00.428260+0000","last_peered":"2023-07-27T14:40:00.428260+0000","last_clean":"2023-07-27T14:40:00.428260+0000","last_became_active":"2023-07-27T14:40:00.424996+0000","last_became_peered":"2023-07-27T14:40:00.424996+0000","last_unstale":"2023-07-27T14:40:00.428260+0000","last_undegraded":"2023-07-27T14:40:00.428260+0000","last_fullsized":"2023-07-27T14:40:00.428260+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431423+0000","last_change":"2023-07-27T14:39:59.969469+0000","last_active":"2023-07-27T14:40:00.431423+0000","last_peered":"2023-07-27T14:40:00.431423+0000","last_clean":"2023-07-27T14:40:00.431423+0000","last_became_active":"2023-07-27T14:39:59.969102+0000","last_became_peered":"2023-07-27T14:39:59.969102+0000","last_unstale":"2023-07-27T14:40:00.431423+0000","last_undegraded":"2023-07-27T14:40:00.431423+0000","last_fullsized":"2023-07-27T14:40:00.431423+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.435080+0000","last_change":"2023-07-27T14:40:00.429382+0000","last_active":"2023-07-27T14:40:00.435080+0000","last_peered":"2023-07-27T14:40:00.435080+0000","last_clean":"2023-07-27T14:40:00.435080+0000","last_became_active":"2023-07-27T14:40:00.429036+0000","last_became_peered":"2023-07-27T14:40:00.429036+0000","last_unstale":"2023-07-27T14:40:00.435080+0000","last_undegraded":"2023-07-27T14:40:00.435080+0000","last_fullsized":"2023-07-27T14:40:00.435080+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417326+0000","last_change":"2023-07-27T14:39:59.969808+0000","last_active":"2023-07-27T14:40:00.417326+0000","last_peered":"2023-07-27T14:40:00.417326+0000","last_clean":"2023-07-27T14:40:00.417326+0000","last_became_active":"2023-07-27T14:39:59.969420+0000","last_became_peered":"2023-07-27T14:39:59.969420+0000","last_unstale":"2023-07-27T14:40:00.417326+0000","last_undegraded":"2023-07-27T14:40:00.417326+0000","last_fullsized":"2023-07-27T14:40:00.417326+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448626+0000","last_change":"2023-07-27T14:40:00.442938+0000","last_active":"2023-07-27T14:40:00.448626+0000","last_peered":"2023-07-27T14:40:00.448626+0000","last_clean":"2023-07-27T14:40:00.448626+0000","last_became_active":"2023-07-27T14:40:00.440374+0000","last_became_peered":"2023-07-27T14:40:00.440374+0000","last_unstale":"2023-07-27T14:40:00.448626+0000","last_undegraded":"2023-07-27T14:40:00.448626+0000","last_fullsized":"2023-07-27T14:40:00.448626+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421303+0000","last_change":"2023-07-27T14:39:59.969026+0000","last_active":"2023-07-27T14:40:00.421303+0000","last_peered":"2023-07-27T14:40:00.421303+0000","last_clean":"2023-07-27T14:40:00.421303+0000","last_became_active":"2023-07-27T14:39:59.968054+0000","last_became_peered":"2023-07-27T14:39:59.968054+0000","last_unstale":"2023-07-27T14:40:00.421303+0000","last_undegraded":"2023-07-27T14:40:00.421303+0000","last_fullsized":"2023-07-27T14:40:00.421303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.443481+0000","last_change":"2023-07-27T14:40:00.434914+0000","last_active":"2023-07-27T14:40:00.443481+0000","last_peered":"2023-07-27T14:40:00.443481+0000","last_clean":"2023-07-27T14:40:00.443481+0000","last_became_active":"2023-07-27T14:40:00.432834+0000","last_became_peered":"2023-07-27T14:40:00.432834+0000","last_unstale":"2023-07-27T14:40:00.443481+0000","last_undegraded":"2023-07-27T14:40:00.443481+0000","last_fullsized":"2023-07-27T14:40:00.443481+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414030+0000","last_change":"2023-07-27T14:39:59.969719+0000","last_active":"2023-07-27T14:40:00.414030+0000","last_peered":"2023-07-27T14:40:00.414030+0000","last_clean":"2023-07-27T14:40:00.414030+0000","last_became_active":"2023-07-27T14:39:59.969454+0000","last_became_peered":"2023-07-27T14:39:59.969454+0000","last_unstale":"2023-07-27T14:40:00.414030+0000","last_undegraded":"2023-07-27T14:40:00.414030+0000","last_fullsized":"2023-07-27T14:40:00.414030+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444106+0000","last_change":"2023-07-27T14:40:00.438411+0000","last_active":"2023-07-27T14:40:00.444106+0000","last_peered":"2023-07-27T14:40:00.444106+0000","last_clean":"2023-07-27T14:40:00.444106+0000","last_became_active":"2023-07-27T14:40:00.438142+0000","last_became_peered":"2023-07-27T14:40:00.438142+0000","last_unstale":"2023-07-27T14:40:00.444106+0000","last_undegraded":"2023-07-27T14:40:00.444106+0000","last_fullsized":"2023-07-27T14:40:00.444106+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429322+0000","last_change":"2023-07-27T14:39:59.965648+0000","last_active":"2023-07-27T14:40:00.429322+0000","last_peered":"2023-07-27T14:40:00.429322+0000","last_clean":"2023-07-27T14:40:00.429322+0000","last_became_active":"2023-07-27T14:39:59.965196+0000","last_became_peered":"2023-07-27T14:39:59.965196+0000","last_unstale":"2023-07-27T14:40:00.429322+0000","last_undegraded":"2023-07-27T14:40:00.429322+0000","last_fullsized":"2023-07-27T14:40:00.429322+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429829+0000","last_change":"2023-07-27T14:40:00.423000+0000","last_active":"2023-07-27T14:40:00.429829+0000","last_peered":"2023-07-27T14:40:00.429829+0000","last_clean":"2023-07-27T14:40:00.429829+0000","last_became_active":"2023-07-27T14:40:00.422645+0000","last_became_peered":"2023-07-27T14:40:00.422645+0000","last_unstale":"2023-07-27T14:40:00.429829+0000","last_undegraded":"2023-07-27T14:40:00.429829+0000","last_fullsized":"2023-07-27T14:40:00.429829+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418690+0000","last_change":"2023-07-27T14:39:59.976589+0000","last_active":"2023-07-27T14:40:00.418690+0000","last_peered":"2023-07-27T14:40:00.418690+0000","last_clean":"2023-07-27T14:40:00.418690+0000","last_became_active":"2023-07-27T14:39:59.976309+0000","last_became_peered":"2023-07-27T14:39:59.976309+0000","last_unstale":"2023-07-27T14:40:00.418690+0000","last_undegraded":"2023-07-27T14:40:00.418690+0000","last_fullsized":"2023-07-27T14:40:00.418690+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432864+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:40:00.432864+0000","last_peered":"2023-07-27T14:40:00.432864+0000","last_clean":"2023-07-27T14:40:00.432864+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:40:00.432864+0000","last_undegraded":"2023-07-27T14:40:00.432864+0000","last_fullsized":"2023-07-27T14:40:00.432864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444436+0000","last_change":"2023-07-27T14:40:00.441715+0000","last_active":"2023-07-27T14:40:00.444436+0000","last_peered":"2023-07-27T14:40:00.444436+0000","last_clean":"2023-07-27T14:40:00.444436+0000","last_became_active":"2023-07-27T14:40:00.441196+0000","last_became_peered":"2023-07-27T14:40:00.441196+0000","last_unstale":"2023-07-27T14:40:00.444436+0000","last_undegraded":"2023-07-27T14:40:00.444436+0000","last_fullsized":"2023-07-27T14:40:00.444436+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417054+0000","last_change":"2023-07-27T14:39:59.980461+0000","last_active":"2023-07-27T14:40:00.417054+0000","last_peered":"2023-07-27T14:40:00.417054+0000","last_clean":"2023-07-27T14:40:00.417054+0000","last_became_active":"2023-07-27T14:39:59.980112+0000","last_became_peered":"2023-07-27T14:39:59.980112+0000","last_unstale":"2023-07-27T14:40:00.417054+0000","last_undegraded":"2023-07-27T14:40:00.417054+0000","last_fullsized":"2023-07-27T14:40:00.417054+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414305+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:40:00.414305+0000","last_peered":"2023-07-27T14:40:00.414305+0000","last_clean":"2023-07-27T14:40:00.414305+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:40:00.414305+0000","last_undegraded":"2023-07-27T14:40:00.414305+0000","last_fullsized":"2023-07-27T14:40:00.414305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449848+0000","last_change":"2023-07-27T14:40:00.448368+0000","last_active":"2023-07-27T14:40:00.449848+0000","last_peered":"2023-07-27T14:40:00.449848+0000","last_clean":"2023-07-27T14:40:00.449848+0000","last_became_active":"2023-07-27T14:40:00.448089+0000","last_became_peered":"2023-07-27T14:40:00.448089+0000","last_unstale":"2023-07-27T14:40:00.449848+0000","last_undegraded":"2023-07-27T14:40:00.449848+0000","last_fullsized":"2023-07-27T14:40:00.449848+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420757+0000","last_change":"2023-07-27T14:39:59.973337+0000","last_active":"2023-07-27T14:40:00.420757+0000","last_peered":"2023-07-27T14:40:00.420757+0000","last_clean":"2023-07-27T14:40:00.420757+0000","last_became_active":"2023-07-27T14:39:59.972405+0000","last_became_peered":"2023-07-27T14:39:59.972405+0000","last_unstale":"2023-07-27T14:40:00.420757+0000","last_undegraded":"2023-07-27T14:40:00.420757+0000","last_fullsized":"2023-07-27T14:40:00.420757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.425011+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:40:00.425011+0000","last_peered":"2023-07-27T14:40:00.425011+0000","last_clean":"2023-07-27T14:40:00.425011+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:40:00.425011+0000","last_undegraded":"2023-07-27T14:40:00.425011+0000","last_fullsized":"2023-07-27T14:40:00.425011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433860+0000","last_change":"2023-07-27T14:40:00.432392+0000","last_active":"2023-07-27T14:40:00.433860+0000","last_peered":"2023-07-27T14:40:00.433860+0000","last_clean":"2023-07-27T14:40:00.433860+0000","last_became_active":"2023-07-27T14:40:00.432087+0000","last_became_peered":"2023-07-27T14:40:00.432087+0000","last_unstale":"2023-07-27T14:40:00.433860+0000","last_undegraded":"2023-07-27T14:40:00.433860+0000","last_fullsized":"2023-07-27T14:40:00.433860+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441025+0000","last_change":"2023-07-27T14:39:59.982545+0000","last_active":"2023-07-27T14:40:00.441025+0000","last_peered":"2023-07-27T14:40:00.441025+0000","last_clean":"2023-07-27T14:40:00.441025+0000","last_became_active":"2023-07-27T14:39:59.982105+0000","last_became_peered":"2023-07-27T14:39:59.982105+0000","last_unstale":"2023-07-27T14:40:00.441025+0000","last_undegraded":"2023-07-27T14:40:00.441025+0000","last_fullsized":"2023-07-27T14:40:00.441025+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.423079+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:40:00.423079+0000","last_peered":"2023-07-27T14:40:00.423079+0000","last_clean":"2023-07-27T14:40:00.423079+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:40:00.423079+0000","last_undegraded":"2023-07-27T14:40:00.423079+0000","last_fullsized":"2023-07-27T14:40:00.423079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442565+0000","last_change":"2023-07-27T14:40:00.436777+0000","last_active":"2023-07-27T14:40:00.442565+0000","last_peered":"2023-07-27T14:40:00.442565+0000","last_clean":"2023-07-27T14:40:00.442565+0000","last_became_active":"2023-07-27T14:40:00.436495+0000","last_became_peered":"2023-07-27T14:40:00.436495+0000","last_unstale":"2023-07-27T14:40:00.442565+0000","last_undegraded":"2023-07-27T14:40:00.442565+0000","last_fullsized":"2023-07-27T14:40:00.442565+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449052+0000","last_change":"2023-07-27T14:39:59.980665+0000","last_active":"2023-07-27T14:40:00.449052+0000","last_peered":"2023-07-27T14:40:00.449052+0000","last_clean":"2023-07-27T14:40:00.449052+0000","last_became_active":"2023-07-27T14:39:59.980384+0000","last_became_peered":"2023-07-27T14:39:59.980384+0000","last_unstale":"2023-07-27T14:40:00.449052+0000","last_undegraded":"2023-07-27T14:40:00.449052+0000","last_fullsized":"2023-07-27T14:40:00.449052+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":174,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.422985+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:40:00.422985+0000","last_peered":"2023-07-27T14:40:00.422985+0000","last_clean":"2023-07-27T14:40:00.422985+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:40:00.422985+0000","last_undegraded":"2023-07-27T14:40:00.422985+0000","last_fullsized":"2023-07-27T14:40:00.422985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417404+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:40:00.417404+0000","last_peered":"2023-07-27T14:40:00.417404+0000","last_clean":"2023-07-27T14:40:00.417404+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:40:00.417404+0000","last_undegraded":"2023-07-27T14:40:00.417404+0000","last_fullsized":"2023-07-27T14:40:00.417404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.443615+0000","last_change":"2023-07-27T14:40:00.438017+0000","last_active":"2023-07-27T14:40:00.443615+0000","last_peered":"2023-07-27T14:40:00.443615+0000","last_clean":"2023-07-27T14:40:00.443615+0000","last_became_active":"2023-07-27T14:40:00.437570+0000","last_became_peered":"2023-07-27T14:40:00.437570+0000","last_unstale":"2023-07-27T14:40:00.443615+0000","last_undegraded":"2023-07-27T14:40:00.443615+0000","last_fullsized":"2023-07-27T14:40:00.443615+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437834+0000","last_change":"2023-07-27T14:39:59.977091+0000","last_active":"2023-07-27T14:40:00.437834+0000","last_peered":"2023-07-27T14:40:00.437834+0000","last_clean":"2023-07-27T14:40:00.437834+0000","last_became_active":"2023-07-27T14:39:59.976798+0000","last_became_peered":"2023-07-27T14:39:59.976798+0000","last_unstale":"2023-07-27T14:40:00.437834+0000","last_undegraded":"2023-07-27T14:40:00.437834+0000","last_fullsized":"2023-07-27T14:40:00.437834+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419629+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:40:00.419629+0000","last_peered":"2023-07-27T14:40:00.419629+0000","last_clean":"2023-07-27T14:40:00.419629+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:40:00.419629+0000","last_undegraded":"2023-07-27T14:40:00.419629+0000","last_fullsized":"2023-07-27T14:40:00.419629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447273+0000","last_change":"2023-07-27T14:40:00.445556+0000","last_active":"2023-07-27T14:40:00.447273+0000","last_peered":"2023-07-27T14:40:00.447273+0000","last_clean":"2023-07-27T14:40:00.447273+0000","last_became_active":"2023-07-27T14:40:00.445135+0000","last_became_peered":"2023-07-27T14:40:00.445135+0000","last_unstale":"2023-07-27T14:40:00.447273+0000","last_undegraded":"2023-07-27T14:40:00.447273+0000","last_fullsized":"2023-07-27T14:40:00.447273+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420215+0000","last_change":"2023-07-27T14:39:59.981798+0000","last_active":"2023-07-27T14:40:00.420215+0000","last_peered":"2023-07-27T14:40:00.420215+0000","last_clean":"2023-07-27T14:40:00.420215+0000","last_became_active":"2023-07-27T14:39:59.981482+0000","last_became_peered":"2023-07-27T14:39:59.981482+0000","last_unstale":"2023-07-27T14:40:00.420215+0000","last_undegraded":"2023-07-27T14:40:00.420215+0000","last_fullsized":"2023-07-27T14:40:00.420215+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420302+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:40:00.420302+0000","last_peered":"2023-07-27T14:40:00.420302+0000","last_clean":"2023-07-27T14:40:00.420302+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:40:00.420302+0000","last_undegraded":"2023-07-27T14:40:00.420302+0000","last_fullsized":"2023-07-27T14:40:00.420302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444752+0000","last_change":"2023-07-27T14:40:00.443893+0000","last_active":"2023-07-27T14:40:00.444752+0000","last_peered":"2023-07-27T14:40:00.444752+0000","last_clean":"2023-07-27T14:40:00.444752+0000","last_became_active":"2023-07-27T14:40:00.443582+0000","last_became_peered":"2023-07-27T14:40:00.443582+0000","last_unstale":"2023-07-27T14:40:00.444752+0000","last_undegraded":"2023-07-27T14:40:00.444752+0000","last_fullsized":"2023-07-27T14:40:00.444752+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439813+0000","last_change":"2023-07-27T14:39:59.976754+0000","last_active":"2023-07-27T14:40:00.439813+0000","last_peered":"2023-07-27T14:40:00.439813+0000","last_clean":"2023-07-27T14:40:00.439813+0000","last_became_active":"2023-07-27T14:39:59.976464+0000","last_became_peered":"2023-07-27T14:39:59.976464+0000","last_unstale":"2023-07-27T14:40:00.439813+0000","last_undegraded":"2023-07-27T14:40:00.439813+0000","last_fullsized":"2023-07-27T14:40:00.439813+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415114+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:40:00.415114+0000","last_peered":"2023-07-27T14:40:00.415114+0000","last_clean":"2023-07-27T14:40:00.415114+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:40:00.415114+0000","last_undegraded":"2023-07-27T14:40:00.415114+0000","last_fullsized":"2023-07-27T14:40:00.415114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25824,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":23296,"kb_avail":94346016,"statfs":{"total":96636764160,"available":96610320384,"internally_reserved":0,"allocated":2580480,"data_stored":1227871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23855104},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.60999999999999999,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.499}]},{"osd":1,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.67300000000000004,"15min":0.69399999999999995},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.2599999999999998,"5min":5.2599999999999998,"15min":5.2599999999999998},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.73299999999999998,"15min":0.70499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":8.952,"5min":8.952,"15min":8.952},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"max":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.72099999999999997,"15min":0.66500000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.318},"max":{"1min":7.5640000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":5.2249999999999996,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.121,"5min":0.78900000000000003,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":8.1630000000000003,"5min":8.1630000000000003,"15min":8.1630000000000003},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":0.81599999999999995,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":7.6269999999999998,"5min":7.6269999999999998,"15min":7.6269999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.54700000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575008,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25584,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":23040,"kb_avail":94346256,"statfs":{"total":96636764160,"available":96610566144,"internally_reserved":0,"allocated":2596864,"data_stored":1228551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23592960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.68400000000000005,"15min":0.627},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.83799999999999997,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.76200000000000001,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36599999999999999},"max":{"1min":0.91700000000000004,"5min":13.975,"15min":13.975},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65800000000000003,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.42199999999999999},"max":{"1min":0.93000000000000005,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92800000000000005,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.495},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.753,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.78800000000000003,"15min":0.67400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68100000000000005,"15min":0.67000000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.72199999999999998,"15min":0.68600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.84399999999999997,"15min":0.73699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":15.461,"15min":15.461},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82899999999999996,"15min":0.78300000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":0.94399999999999995,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.51500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25572,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":23040,"kb_avail":94346268,"statfs":{"total":96636764160,"available":96610578432,"internally_reserved":0,"allocated":2584576,"data_stored":1227961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23592960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.438},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57499999999999996,"5min":0.61499999999999999,"15min":4.75},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.51700000000000002},"min":{"1min":0.25600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":0.65700000000000003,"15min":9.3100000000000005},"last":0.377}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.495},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.7160000000000002},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32800000000000001},"max":{"1min":0.65600000000000003,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.504},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":3.8580000000000001},"last":0.435}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.54200000000000004,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":1.071,"5min":1.111,"15min":2.181},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":2.4180000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.57899999999999996,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.121,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":1.0609999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.72299999999999998},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.052},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.76300000000000001},"min":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0549999999999999,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.625}]},{"osd":7,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44800000000000001},"max":{"1min":1.0349999999999999,"5min":1.1419999999999999,"15min":2.016},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.59999999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1839999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23980,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":21440,"kb_avail":94347860,"statfs":{"total":96636764160,"available":96612208640,"internally_reserved":0,"allocated":2592768,"data_stored":1228923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21954560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.73199999999999998,"5min":1.954,"15min":1.954},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46899999999999997},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":1.0660000000000001,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.48299999999999998,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.97599999999999998,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53100000000000003,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.6020000000000001},"last":0.63}]},{"osd":6,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.498},"max":{"1min":1.0469999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.44,"15min":0.44},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.22},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.113,"5min":2.141,"15min":2.141},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.125,"15min":1.2370000000000001},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":25088,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":2600960,"data_stored":1229463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25690112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23799999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42299999999999999,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.1899999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.96399999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":5.601},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.83499999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.51100000000000001},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.754,"5min":1.002,"15min":1.353},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.42999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.849},"last":0.878},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":6.9660000000000002},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":1.163,"15min":1.163},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.772},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69399999999999995,"15min":0.71499999999999997},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73299999999999998,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":3.1360000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.499,"15min":0.499},"max":{"1min":1.01,"5min":1.024,"15min":1.8089999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72999999999999998,"15min":0.76400000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.84499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23912,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94347928,"statfs":{"total":96636764160,"available":96612278272,"internally_reserved":0,"allocated":2588672,"data_stored":1228515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.497,"5min":0.66800000000000004,"15min":1.202},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.42899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.302},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.54500000000000004,"5min":0.64200000000000002,"15min":1.2390000000000001},"last":0.497}]},{"osd":2,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.48499999999999999,"15min":0.504},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65700000000000003,"5min":0.68899999999999995,"15min":1.8029999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.68799999999999994},"min":{"1min":0.497,"5min":0.436,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.149},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.71699999999999997},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":5.1059999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.56100000000000005,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0229999999999999,"15min":1.232},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70199999999999996,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.90300000000000002,"5min":0.97799999999999998,"15min":1.298},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.504,"5min":0.501,"15min":0.44},"max":{"1min":0.93300000000000005,"5min":1.0129999999999999,"15min":1.343},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.98899999999999999,"5min":1.115,"15min":2.048},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.51700000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575008,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18720,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94353120,"statfs":{"total":96636764160,"available":96617594880,"internally_reserved":0,"allocated":2580480,"data_stored":1227871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93200000000000005,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.53000000000000003,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":3.419,"15min":4.4409999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.439,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.79000000000000004,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.496},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.51300000000000001,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":2.3010000000000002,"15min":4.476},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.79700000000000004,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54100000000000004,"5min":0.46700000000000003,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":3.48,"15min":4.3949999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.8620000000000001,"15min":5.194},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85399999999999998,"5min":2.387,"15min":5.5990000000000002},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.78800000000000003,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.34599999999999997},"max":{"1min":0.83899999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26852,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":24320,"kb_avail":94344988,"statfs":{"total":96636764160,"available":96609267712,"internally_reserved":0,"allocated":2584576,"data_stored":1228425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24903680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.317},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.432},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.443,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":1.026,"15min":6.7489999999999997},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.67500000000000004},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":0.98799999999999999,"15min":1.581},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.69299999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":5.5750000000000002,"5min":5.5750000000000002,"15min":5.5750000000000002},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.67200000000000004},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.874,"5min":0.875,"15min":9.6920000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":1.978},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":2.4129999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.78300000000000003,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.96399999999999997,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.3719999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.57199999999999995,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.88600000000000001,"5min":1.115,"15min":1.9419999999999999},"last":0.72799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:40:09.549 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:40:09.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.692+0000 7fc1eddff700 1 Processor -- start 2023-07-27T14:40:09.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.692+0000 7fc1eddff700 1 -- start start 2023-07-27T14:40:09.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.693+0000 7fc1eddff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc1e80aaa40 0x7fc1e80640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:09.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.693+0000 7fc1eddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e81542a0 0x7fc1e80645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:09.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.693+0000 7fc1eddff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e80aa4d0 con 0x7fc1e8153ec0 2023-07-27T14:40:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.693+0000 7fc1eddff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e8064ad0 con 0x7fc1e80aaa40 2023-07-27T14:40:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.693+0000 7fc1eddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80c05c0 con 0x7fc1e81542a0 2023-07-27T14:40:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.693+0000 7fc1e77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc1e8153ec0 0x7fc1e80a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34830/0 (socket says 172.21.15.115:34830) 2023-07-27T14:40:09.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.693+0000 7fc1e77fe700 1 -- 172.21.15.115:0/2103583991 learned_addr learned my addr 172.21.15.115:0/2103583991 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e6ffd700 1 --2- 172.21.15.115:0/2103583991 >> v2:172.21.15.159:3300/0 conn(0x7fc1e80aaa40 0x7fc1e80640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e7fff700 1 --2- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e81542a0 0x7fc1e80645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:09.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e67fc700 1 -- 172.21.15.115:0/2103583991 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835668744 0 0) 0x7fc1d8001110 con 0x7fc1e8153ec0 2023-07-27T14:40:09.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e67fc700 1 -- 172.21.15.115:0/2103583991 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d00033f0 con 0x7fc1e8153ec0 2023-07-27T14:40:09.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e6ffd700 1 -- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e81542a0 msgr2=0x7fc1e80645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:09.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e6ffd700 1 --2- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e81542a0 0x7fc1e80645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e6ffd700 1 -- 172.21.15.115:0/2103583991 >> v1:172.21.15.115:6789/0 conn(0x7fc1e8153ec0 legacy=0x7fc1e80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:09.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e67fc700 1 -- 172.21.15.115:0/2103583991 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2333148431 0 0) 0x7fc1d00033f0 con 0x7fc1e8153ec0 2023-07-27T14:40:09.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e6ffd700 1 -- 172.21.15.115:0/2103583991 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80c1a60 con 0x7fc1e80aaa40 2023-07-27T14:40:09.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e7fff700 1 --2- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e81542a0 0x7fc1e80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:09.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.694+0000 7fc1e6ffd700 1 --2- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 0x7fc1e80640f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fc1dc009760 tx=0x7fc1dc009060).ready entity=mon.1 client_cookie=3c11096e14c1065b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:09.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1e67fc700 1 -- 172.21.15.115:0/2103583991 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8001600 con 0x7fc1e80aaa40 2023-07-27T14:40:09.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1e67fc700 1 -- 172.21.15.115:0/2103583991 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc011400 con 0x7fc1e80aaa40 2023-07-27T14:40:09.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1e67fc700 1 -- 172.21.15.115:0/2103583991 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc011780 con 0x7fc1e80aaa40 2023-07-27T14:40:09.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1eddff700 1 -- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 msgr2=0x7fc1e80640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:09.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 0x7fc1e80640f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fc1dc009760 tx=0x7fc1dc009060).stop 2023-07-27T14:40:09.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1eddff700 1 -- 172.21.15.115:0/2103583991 shutdown_connections 2023-07-27T14:40:09.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e81542a0 0x7fc1e80645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2103583991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 0x7fc1e80640f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1eddff700 1 -- 172.21.15.115:0/2103583991 >> 172.21.15.115:0/2103583991 conn(0x7fc1e80cb610 msgr2=0x7fc1e80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:09.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1eddff700 1 -- 172.21.15.115:0/2103583991 shutdown_connections 2023-07-27T14:40:09.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.695+0000 7fc1eddff700 1 -- 172.21.15.115:0/2103583991 wait complete. 2023-07-27T14:40:09.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.697+0000 7fc1eddff700 1 Processor -- start 2023-07-27T14:40:09.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.697+0000 7fc1eddff700 1 -- start start 2023-07-27T14:40:09.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1eddff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 0x7fc1e80c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:09.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1eddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e8153ec0 0x7fc1e8152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:09.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1eddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e81542a0 0x7fc1e8163d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:09.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1eddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8151010 con 0x7fc1e81542a0 2023-07-27T14:40:09.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1eddff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80aef70 con 0x7fc1e80aaa40 2023-07-27T14:40:09.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1eddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80af250 con 0x7fc1e8153ec0 2023-07-27T14:40:09.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1e7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e81542a0 0x7fc1e8163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:09.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1e7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e81542a0 0x7fc1e8163d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50588/0 (socket says 172.21.15.115:50588) 2023-07-27T14:40:09.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1e7fff700 1 -- 172.21.15.115:0/2184104499 learned_addr learned my addr 172.21.15.115:0/2184104499 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:09.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1e77fe700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 0x7fc1e80c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:09.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1e6ffd700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e8153ec0 0x7fc1e8152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:09.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1e7fff700 1 -- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e8153ec0 msgr2=0x7fc1e8152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:09.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.698+0000 7fc1e7fff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e8153ec0 0x7fc1e8152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1e7fff700 1 -- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 msgr2=0x7fc1e80c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:09.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1e7fff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 0x7fc1e80c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1e7fff700 1 -- 172.21.15.115:0/2184104499 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0009a20 con 0x7fc1e81542a0 2023-07-27T14:40:09.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1e77fe700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 0x7fc1e80c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:09.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1e7fff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e81542a0 0x7fc1e8163d20 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 rx=0x7fc1e0009ec0 tx=0x7fc1e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:09.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1cf7fe700 1 -- 172.21.15.115:0/2184104499 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000cc20 con 0x7fc1e81542a0 2023-07-27T14:40:09.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1cf7fe700 1 -- 172.21.15.115:0/2184104499 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e000f040 con 0x7fc1e81542a0 2023-07-27T14:40:09.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc0092a0 con 0x7fc1e81542a0 2023-07-27T14:40:09.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1cf7fe700 1 -- 172.21.15.115:0/2184104499 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0013400 con 0x7fc1e81542a0 2023-07-27T14:40:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.699+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e80af810 con 0x7fc1e81542a0 2023-07-27T14:40:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.700+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e806c470 con 0x7fc1e81542a0 2023-07-27T14:40:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.701+0000 7fc1cf7fe700 1 -- 172.21.15.115:0/2184104499 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fc1e00137b0 con 0x7fc1e81542a0 2023-07-27T14:40:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.702+0000 7fc1cf7fe700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1d405fcc0 0x7fc1d4062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.702+0000 7fc1cf7fe700 1 -- 172.21.15.115:0/2184104499 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fc1e007be40 con 0x7fc1e81542a0 2023-07-27T14:40:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.702+0000 7fc1e77fe700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1d405fcc0 0x7fc1d4062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:09.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.702+0000 7fc1e77fe700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1d405fcc0 0x7fc1d4062180 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fc1d8005ca0 tx=0x7fc1d8001250).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:09.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.706+0000 7fc1cf7fe700 1 -- 172.21.15.115:0/2184104499 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1e004c380 con 0x7fc1e81542a0 2023-07-27T14:40:09.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.871+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1e80ca890 con 0x7fc1d405fcc0 2023-07-27T14:40:09.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.881+0000 7fc1cf7fe700 1 -- 172.21.15.115:0/2184104499 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361556 (secure 0 0 0) 0x7fc1e80ca890 con 0x7fc1d405fcc0 2023-07-27T14:40:09.940 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:09.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1d405fcc0 msgr2=0x7fc1d4062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1d405fcc0 0x7fc1d4062180 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fc1d8005ca0 tx=0x7fc1d8001250).stop 2023-07-27T14:40:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e81542a0 msgr2=0x7fc1e8163d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e81542a0 0x7fc1e8163d20 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 rx=0x7fc1e0009ec0 tx=0x7fc1e000b040).stop 2023-07-27T14:40:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 shutdown_connections 2023-07-27T14:40:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1d405fcc0 0x7fc1d4062180 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1e81542a0 0x7fc1e8163d20 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1e80aaa40 0x7fc1e80c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 --2- 172.21.15.115:0/2184104499 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1e8153ec0 0x7fc1e8152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:09.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 >> 172.21.15.115:0/2184104499 conn(0x7fc1e80cb610 msgr2=0x7fc1e8062ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:09.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 shutdown_connections 2023-07-27T14:40:09.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:09.886+0000 7fc1eddff700 1 -- 172.21.15.115:0/2184104499 wait complete. 2023-07-27T14:40:09.944 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:40:09.958 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":596,"stamp":"2023-07-27T14:40:09.618285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":198080,"kb_used_data":20224,"kb_used_omap":0,"kb_used_meta":177792,"kb_avail":754776640,"statfs":{"total":773094113280,"available":772891279360,"internally_reserved":0,"allocated":20709376,"data_stored":9827580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":182059008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-535731,"num_objects":-14,"num_object_clones":-1,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":-1,"num_read":-22,"num_read_kb":-8208,"num_write":-215,"num_write_kb":-16999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.280224"},"pg_stats":[{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446293+0000","last_change":"2023-07-27T14:40:00.444892+0000","last_active":"2023-07-27T14:40:00.446293+0000","last_peered":"2023-07-27T14:40:00.446293+0000","last_clean":"2023-07-27T14:40:00.446293+0000","last_became_active":"2023-07-27T14:40:00.444625+0000","last_became_peered":"2023-07-27T14:40:00.444625+0000","last_unstale":"2023-07-27T14:40:00.446293+0000","last_undegraded":"2023-07-27T14:40:00.446293+0000","last_fullsized":"2023-07-27T14:40:00.446293+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3f","version":"204'3","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449755+0000","last_change":"2023-07-27T14:39:59.984816+0000","last_active":"2023-07-27T14:40:00.449755+0000","last_peered":"2023-07-27T14:40:00.449755+0000","last_clean":"2023-07-27T14:40:00.449755+0000","last_became_active":"2023-07-27T14:39:59.983617+0000","last_became_peered":"2023-07-27T14:39:59.983617+0000","last_unstale":"2023-07-27T14:40:00.449755+0000","last_undegraded":"2023-07-27T14:40:00.449755+0000","last_fullsized":"2023-07-27T14:40:00.449755+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442511+0000","last_change":"2023-07-27T14:40:00.435511+0000","last_active":"2023-07-27T14:40:00.442511+0000","last_peered":"2023-07-27T14:40:00.442511+0000","last_clean":"2023-07-27T14:40:00.442511+0000","last_became_active":"2023-07-27T14:40:00.434811+0000","last_became_peered":"2023-07-27T14:40:00.434811+0000","last_unstale":"2023-07-27T14:40:00.442511+0000","last_undegraded":"2023-07-27T14:40:00.442511+0000","last_fullsized":"2023-07-27T14:40:00.442511+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417014+0000","last_change":"2023-07-27T14:39:59.980161+0000","last_active":"2023-07-27T14:40:00.417014+0000","last_peered":"2023-07-27T14:40:00.417014+0000","last_clean":"2023-07-27T14:40:00.417014+0000","last_became_active":"2023-07-27T14:39:59.977406+0000","last_became_peered":"2023-07-27T14:39:59.977406+0000","last_unstale":"2023-07-27T14:40:00.417014+0000","last_undegraded":"2023-07-27T14:40:00.417014+0000","last_fullsized":"2023-07-27T14:40:00.417014+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.430754+0000","last_change":"2023-07-27T14:40:00.428058+0000","last_active":"2023-07-27T14:40:00.430754+0000","last_peered":"2023-07-27T14:40:00.430754+0000","last_clean":"2023-07-27T14:40:00.430754+0000","last_became_active":"2023-07-27T14:40:00.427765+0000","last_became_peered":"2023-07-27T14:40:00.427765+0000","last_unstale":"2023-07-27T14:40:00.430754+0000","last_undegraded":"2023-07-27T14:40:00.430754+0000","last_fullsized":"2023-07-27T14:40:00.430754+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414833+0000","last_change":"2023-07-27T14:39:59.969560+0000","last_active":"2023-07-27T14:40:00.414833+0000","last_peered":"2023-07-27T14:40:00.414833+0000","last_clean":"2023-07-27T14:40:00.414833+0000","last_became_active":"2023-07-27T14:39:59.969284+0000","last_became_peered":"2023-07-27T14:39:59.969284+0000","last_unstale":"2023-07-27T14:40:00.414833+0000","last_undegraded":"2023-07-27T14:40:00.414833+0000","last_fullsized":"2023-07-27T14:40:00.414833+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447071+0000","last_change":"2023-07-27T14:40:00.440258+0000","last_active":"2023-07-27T14:40:00.447071+0000","last_peered":"2023-07-27T14:40:00.447071+0000","last_clean":"2023-07-27T14:40:00.447071+0000","last_became_active":"2023-07-27T14:40:00.439908+0000","last_became_peered":"2023-07-27T14:40:00.439908+0000","last_unstale":"2023-07-27T14:40:00.447071+0000","last_undegraded":"2023-07-27T14:40:00.447071+0000","last_fullsized":"2023-07-27T14:40:00.447071+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.3c","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437043+0000","last_change":"2023-07-27T14:39:59.984919+0000","last_active":"2023-07-27T14:40:00.437043+0000","last_peered":"2023-07-27T14:40:00.437043+0000","last_clean":"2023-07-27T14:40:00.437043+0000","last_became_active":"2023-07-27T14:39:59.984573+0000","last_became_peered":"2023-07-27T14:39:59.984573+0000","last_unstale":"2023-07-27T14:40:00.437043+0000","last_undegraded":"2023-07-27T14:40:00.437043+0000","last_fullsized":"2023-07-27T14:40:00.437043+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428818+0000","last_change":"2023-07-27T14:40:00.424519+0000","last_active":"2023-07-27T14:40:00.428818+0000","last_peered":"2023-07-27T14:40:00.428818+0000","last_clean":"2023-07-27T14:40:00.428818+0000","last_became_active":"2023-07-27T14:40:00.424269+0000","last_became_peered":"2023-07-27T14:40:00.424269+0000","last_unstale":"2023-07-27T14:40:00.428818+0000","last_undegraded":"2023-07-27T14:40:00.428818+0000","last_fullsized":"2023-07-27T14:40:00.428818+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441990+0000","last_change":"2023-07-27T14:39:59.975564+0000","last_active":"2023-07-27T14:40:00.441990+0000","last_peered":"2023-07-27T14:40:00.441990+0000","last_clean":"2023-07-27T14:40:00.441990+0000","last_became_active":"2023-07-27T14:39:59.975257+0000","last_became_peered":"2023-07-27T14:39:59.975257+0000","last_unstale":"2023-07-27T14:40:00.441990+0000","last_undegraded":"2023-07-27T14:40:00.441990+0000","last_fullsized":"2023-07-27T14:40:00.441990+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428069+0000","last_change":"2023-07-27T14:40:00.423653+0000","last_active":"2023-07-27T14:40:00.428069+0000","last_peered":"2023-07-27T14:40:00.428069+0000","last_clean":"2023-07-27T14:40:00.428069+0000","last_became_active":"2023-07-27T14:40:00.423374+0000","last_became_peered":"2023-07-27T14:40:00.423374+0000","last_unstale":"2023-07-27T14:40:00.428069+0000","last_undegraded":"2023-07-27T14:40:00.428069+0000","last_fullsized":"2023-07-27T14:40:00.428069+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3a","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.436371+0000","last_change":"2023-07-27T14:39:59.976784+0000","last_active":"2023-07-27T14:40:00.436371+0000","last_peered":"2023-07-27T14:40:00.436371+0000","last_clean":"2023-07-27T14:40:00.436371+0000","last_became_active":"2023-07-27T14:39:59.976295+0000","last_became_peered":"2023-07-27T14:39:59.976295+0000","last_unstale":"2023-07-27T14:40:00.436371+0000","last_undegraded":"2023-07-27T14:40:00.436371+0000","last_fullsized":"2023-07-27T14:40:00.436371+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.434568+0000","last_change":"2023-07-27T14:40:00.433310+0000","last_active":"2023-07-27T14:40:00.434568+0000","last_peered":"2023-07-27T14:40:00.434568+0000","last_clean":"2023-07-27T14:40:00.434568+0000","last_became_active":"2023-07-27T14:40:00.432861+0000","last_became_peered":"2023-07-27T14:40:00.432861+0000","last_unstale":"2023-07-27T14:40:00.434568+0000","last_undegraded":"2023-07-27T14:40:00.434568+0000","last_fullsized":"2023-07-27T14:40:00.434568+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419495+0000","last_change":"2023-07-27T14:39:59.975414+0000","last_active":"2023-07-27T14:40:00.419495+0000","last_peered":"2023-07-27T14:40:00.419495+0000","last_clean":"2023-07-27T14:40:00.419495+0000","last_became_active":"2023-07-27T14:39:59.975123+0000","last_became_peered":"2023-07-27T14:39:59.975123+0000","last_unstale":"2023-07-27T14:40:00.419495+0000","last_undegraded":"2023-07-27T14:40:00.419495+0000","last_fullsized":"2023-07-27T14:40:00.419495+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449077+0000","last_change":"2023-07-27T14:40:00.445250+0000","last_active":"2023-07-27T14:40:00.449077+0000","last_peered":"2023-07-27T14:40:00.449077+0000","last_clean":"2023-07-27T14:40:00.449077+0000","last_became_active":"2023-07-27T14:40:00.439351+0000","last_became_peered":"2023-07-27T14:40:00.439351+0000","last_unstale":"2023-07-27T14:40:00.449077+0000","last_undegraded":"2023-07-27T14:40:00.449077+0000","last_fullsized":"2023-07-27T14:40:00.449077+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429126+0000","last_change":"2023-07-27T14:39:59.971111+0000","last_active":"2023-07-27T14:40:00.429126+0000","last_peered":"2023-07-27T14:40:00.429126+0000","last_clean":"2023-07-27T14:40:00.429126+0000","last_became_active":"2023-07-27T14:39:59.970596+0000","last_became_peered":"2023-07-27T14:39:59.970596+0000","last_unstale":"2023-07-27T14:40:00.429126+0000","last_undegraded":"2023-07-27T14:40:00.429126+0000","last_fullsized":"2023-07-27T14:40:00.429126+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428833+0000","last_change":"2023-07-27T14:40:00.424211+0000","last_active":"2023-07-27T14:40:00.428833+0000","last_peered":"2023-07-27T14:40:00.428833+0000","last_clean":"2023-07-27T14:40:00.428833+0000","last_became_active":"2023-07-27T14:40:00.423930+0000","last_became_peered":"2023-07-27T14:40:00.423930+0000","last_unstale":"2023-07-27T14:40:00.428833+0000","last_undegraded":"2023-07-27T14:40:00.428833+0000","last_fullsized":"2023-07-27T14:40:00.428833+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420653+0000","last_change":"2023-07-27T14:39:59.972452+0000","last_active":"2023-07-27T14:40:00.420653+0000","last_peered":"2023-07-27T14:40:00.420653+0000","last_clean":"2023-07-27T14:40:00.420653+0000","last_became_active":"2023-07-27T14:39:59.972166+0000","last_became_peered":"2023-07-27T14:39:59.972166+0000","last_unstale":"2023-07-27T14:40:00.420653+0000","last_undegraded":"2023-07-27T14:40:00.420653+0000","last_fullsized":"2023-07-27T14:40:00.420653+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447893+0000","last_change":"2023-07-27T14:40:00.441722+0000","last_active":"2023-07-27T14:40:00.447893+0000","last_peered":"2023-07-27T14:40:00.447893+0000","last_clean":"2023-07-27T14:40:00.447893+0000","last_became_active":"2023-07-27T14:40:00.439985+0000","last_became_peered":"2023-07-27T14:40:00.439985+0000","last_unstale":"2023-07-27T14:40:00.447893+0000","last_undegraded":"2023-07-27T14:40:00.447893+0000","last_fullsized":"2023-07-27T14:40:00.447893+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431982+0000","last_change":"2023-07-27T14:39:59.963470+0000","last_active":"2023-07-27T14:40:00.431982+0000","last_peered":"2023-07-27T14:40:00.431982+0000","last_clean":"2023-07-27T14:40:00.431982+0000","last_became_active":"2023-07-27T14:39:59.963180+0000","last_became_peered":"2023-07-27T14:39:59.963180+0000","last_unstale":"2023-07-27T14:40:00.431982+0000","last_undegraded":"2023-07-27T14:40:00.431982+0000","last_fullsized":"2023-07-27T14:40:00.431982+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429667+0000","last_change":"2023-07-27T14:40:00.426857+0000","last_active":"2023-07-27T14:40:00.429667+0000","last_peered":"2023-07-27T14:40:00.429667+0000","last_clean":"2023-07-27T14:40:00.429667+0000","last_became_active":"2023-07-27T14:40:00.426527+0000","last_became_peered":"2023-07-27T14:40:00.426527+0000","last_unstale":"2023-07-27T14:40:00.429667+0000","last_undegraded":"2023-07-27T14:40:00.429667+0000","last_fullsized":"2023-07-27T14:40:00.429667+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415169+0000","last_change":"2023-07-27T14:39:59.970599+0000","last_active":"2023-07-27T14:40:00.415169+0000","last_peered":"2023-07-27T14:40:00.415169+0000","last_clean":"2023-07-27T14:40:00.415169+0000","last_became_active":"2023-07-27T14:39:59.970336+0000","last_became_peered":"2023-07-27T14:39:59.970336+0000","last_unstale":"2023-07-27T14:40:00.415169+0000","last_undegraded":"2023-07-27T14:40:00.415169+0000","last_fullsized":"2023-07-27T14:40:00.415169+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442575+0000","last_change":"2023-07-27T14:40:00.436081+0000","last_active":"2023-07-27T14:40:00.442575+0000","last_peered":"2023-07-27T14:40:00.442575+0000","last_clean":"2023-07-27T14:40:00.442575+0000","last_became_active":"2023-07-27T14:40:00.435407+0000","last_became_peered":"2023-07-27T14:40:00.435407+0000","last_unstale":"2023-07-27T14:40:00.442575+0000","last_undegraded":"2023-07-27T14:40:00.442575+0000","last_fullsized":"2023-07-27T14:40:00.442575+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.34","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446741+0000","last_change":"2023-07-27T14:39:59.970857+0000","last_active":"2023-07-27T14:40:00.446741+0000","last_peered":"2023-07-27T14:40:00.446741+0000","last_clean":"2023-07-27T14:40:00.446741+0000","last_became_active":"2023-07-27T14:39:59.970436+0000","last_became_peered":"2023-07-27T14:39:59.970436+0000","last_unstale":"2023-07-27T14:40:00.446741+0000","last_undegraded":"2023-07-27T14:40:00.446741+0000","last_fullsized":"2023-07-27T14:40:00.446741+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.434563+0000","last_change":"2023-07-27T14:40:00.426128+0000","last_active":"2023-07-27T14:40:00.434563+0000","last_peered":"2023-07-27T14:40:00.434563+0000","last_clean":"2023-07-27T14:40:00.434563+0000","last_became_active":"2023-07-27T14:40:00.425601+0000","last_became_peered":"2023-07-27T14:40:00.425601+0000","last_unstale":"2023-07-27T14:40:00.434563+0000","last_undegraded":"2023-07-27T14:40:00.434563+0000","last_fullsized":"2023-07-27T14:40:00.434563+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.435761+0000","last_change":"2023-07-27T14:39:59.980889+0000","last_active":"2023-07-27T14:40:00.435761+0000","last_peered":"2023-07-27T14:40:00.435761+0000","last_clean":"2023-07-27T14:40:00.435761+0000","last_became_active":"2023-07-27T14:39:59.980579+0000","last_became_peered":"2023-07-27T14:39:59.980579+0000","last_unstale":"2023-07-27T14:40:00.435761+0000","last_undegraded":"2023-07-27T14:40:00.435761+0000","last_fullsized":"2023-07-27T14:40:00.435761+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437086+0000","last_change":"2023-07-27T14:40:00.430497+0000","last_active":"2023-07-27T14:40:00.437086+0000","last_peered":"2023-07-27T14:40:00.437086+0000","last_clean":"2023-07-27T14:40:00.437086+0000","last_became_active":"2023-07-27T14:40:00.430221+0000","last_became_peered":"2023-07-27T14:40:00.430221+0000","last_unstale":"2023-07-27T14:40:00.437086+0000","last_undegraded":"2023-07-27T14:40:00.437086+0000","last_fullsized":"2023-07-27T14:40:00.437086+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439546+0000","last_change":"2023-07-27T14:39:59.974472+0000","last_active":"2023-07-27T14:40:00.439546+0000","last_peered":"2023-07-27T14:40:00.439546+0000","last_clean":"2023-07-27T14:40:00.439546+0000","last_became_active":"2023-07-27T14:39:59.974210+0000","last_became_peered":"2023-07-27T14:39:59.974210+0000","last_unstale":"2023-07-27T14:40:00.439546+0000","last_undegraded":"2023-07-27T14:40:00.439546+0000","last_fullsized":"2023-07-27T14:40:00.439546+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.430740+0000","last_change":"2023-07-27T14:40:00.428188+0000","last_active":"2023-07-27T14:40:00.430740+0000","last_peered":"2023-07-27T14:40:00.430740+0000","last_clean":"2023-07-27T14:40:00.430740+0000","last_became_active":"2023-07-27T14:40:00.427448+0000","last_became_peered":"2023-07-27T14:40:00.427448+0000","last_unstale":"2023-07-27T14:40:00.430740+0000","last_undegraded":"2023-07-27T14:40:00.430740+0000","last_fullsized":"2023-07-27T14:40:00.430740+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418797+0000","last_change":"2023-07-27T14:39:59.986154+0000","last_active":"2023-07-27T14:40:00.418797+0000","last_peered":"2023-07-27T14:40:00.418797+0000","last_clean":"2023-07-27T14:40:00.418797+0000","last_became_active":"2023-07-27T14:39:59.985872+0000","last_became_peered":"2023-07-27T14:39:59.985872+0000","last_unstale":"2023-07-27T14:40:00.418797+0000","last_undegraded":"2023-07-27T14:40:00.418797+0000","last_fullsized":"2023-07-27T14:40:00.418797+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447435+0000","last_change":"2023-07-27T14:40:00.446561+0000","last_active":"2023-07-27T14:40:00.447435+0000","last_peered":"2023-07-27T14:40:00.447435+0000","last_clean":"2023-07-27T14:40:00.447435+0000","last_became_active":"2023-07-27T14:40:00.446240+0000","last_became_peered":"2023-07-27T14:40:00.446240+0000","last_unstale":"2023-07-27T14:40:00.447435+0000","last_undegraded":"2023-07-27T14:40:00.447435+0000","last_fullsized":"2023-07-27T14:40:00.447435+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.30","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441928+0000","last_change":"2023-07-27T14:39:59.963969+0000","last_active":"2023-07-27T14:40:00.441928+0000","last_peered":"2023-07-27T14:40:00.441928+0000","last_clean":"2023-07-27T14:40:00.441928+0000","last_became_active":"2023-07-27T14:39:59.963693+0000","last_became_peered":"2023-07-27T14:39:59.963693+0000","last_unstale":"2023-07-27T14:40:00.441928+0000","last_undegraded":"2023-07-27T14:40:00.441928+0000","last_fullsized":"2023-07-27T14:40:00.441928+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439272+0000","last_change":"2023-07-27T14:40:00.436081+0000","last_active":"2023-07-27T14:40:00.439272+0000","last_peered":"2023-07-27T14:40:00.439272+0000","last_clean":"2023-07-27T14:40:00.439272+0000","last_became_active":"2023-07-27T14:40:00.435741+0000","last_became_peered":"2023-07-27T14:40:00.435741+0000","last_unstale":"2023-07-27T14:40:00.439272+0000","last_undegraded":"2023-07-27T14:40:00.439272+0000","last_fullsized":"2023-07-27T14:40:00.439272+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420765+0000","last_change":"2023-07-27T14:39:59.964330+0000","last_active":"2023-07-27T14:40:00.420765+0000","last_peered":"2023-07-27T14:40:00.420765+0000","last_clean":"2023-07-27T14:40:00.420765+0000","last_became_active":"2023-07-27T14:39:59.964054+0000","last_became_peered":"2023-07-27T14:39:59.964054+0000","last_unstale":"2023-07-27T14:40:00.420765+0000","last_undegraded":"2023-07-27T14:40:00.420765+0000","last_fullsized":"2023-07-27T14:40:00.420765+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439124+0000","last_change":"2023-07-27T14:40:00.427087+0000","last_active":"2023-07-27T14:40:00.439124+0000","last_peered":"2023-07-27T14:40:00.439124+0000","last_clean":"2023-07-27T14:40:00.439124+0000","last_became_active":"2023-07-27T14:40:00.426804+0000","last_became_peered":"2023-07-27T14:40:00.426804+0000","last_unstale":"2023-07-27T14:40:00.439124+0000","last_undegraded":"2023-07-27T14:40:00.439124+0000","last_fullsized":"2023-07-27T14:40:00.439124+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419374+0000","last_change":"2023-07-27T14:39:59.963318+0000","last_active":"2023-07-27T14:40:00.419374+0000","last_peered":"2023-07-27T14:40:00.419374+0000","last_clean":"2023-07-27T14:40:00.419374+0000","last_became_active":"2023-07-27T14:39:59.963055+0000","last_became_peered":"2023-07-27T14:39:59.963055+0000","last_unstale":"2023-07-27T14:40:00.419374+0000","last_undegraded":"2023-07-27T14:40:00.419374+0000","last_fullsized":"2023-07-27T14:40:00.419374+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428862+0000","last_change":"2023-07-27T14:40:00.423749+0000","last_active":"2023-07-27T14:40:00.428862+0000","last_peered":"2023-07-27T14:40:00.428862+0000","last_clean":"2023-07-27T14:40:00.428862+0000","last_became_active":"2023-07-27T14:40:00.423476+0000","last_became_peered":"2023-07-27T14:40:00.423476+0000","last_unstale":"2023-07-27T14:40:00.428862+0000","last_undegraded":"2023-07-27T14:40:00.428862+0000","last_fullsized":"2023-07-27T14:40:00.428862+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2d","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448022+0000","last_change":"2023-07-27T14:39:59.964414+0000","last_active":"2023-07-27T14:40:00.448022+0000","last_peered":"2023-07-27T14:40:00.448022+0000","last_clean":"2023-07-27T14:40:00.448022+0000","last_became_active":"2023-07-27T14:39:59.964068+0000","last_became_peered":"2023-07-27T14:39:59.964068+0000","last_unstale":"2023-07-27T14:40:00.448022+0000","last_undegraded":"2023-07-27T14:40:00.448022+0000","last_fullsized":"2023-07-27T14:40:00.448022+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438324+0000","last_change":"2023-07-27T14:40:00.432481+0000","last_active":"2023-07-27T14:40:00.438324+0000","last_peered":"2023-07-27T14:40:00.438324+0000","last_clean":"2023-07-27T14:40:00.438324+0000","last_became_active":"2023-07-27T14:40:00.431034+0000","last_became_peered":"2023-07-27T14:40:00.431034+0000","last_unstale":"2023-07-27T14:40:00.438324+0000","last_undegraded":"2023-07-27T14:40:00.438324+0000","last_fullsized":"2023-07-27T14:40:00.438324+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431336+0000","last_change":"2023-07-27T14:39:59.977733+0000","last_active":"2023-07-27T14:40:00.431336+0000","last_peered":"2023-07-27T14:40:00.431336+0000","last_clean":"2023-07-27T14:40:00.431336+0000","last_became_active":"2023-07-27T14:39:59.977440+0000","last_became_peered":"2023-07-27T14:39:59.977440+0000","last_unstale":"2023-07-27T14:40:00.431336+0000","last_undegraded":"2023-07-27T14:40:00.431336+0000","last_fullsized":"2023-07-27T14:40:00.431336+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431884+0000","last_change":"2023-07-27T14:40:00.430299+0000","last_active":"2023-07-27T14:40:00.431884+0000","last_peered":"2023-07-27T14:40:00.431884+0000","last_clean":"2023-07-27T14:40:00.431884+0000","last_became_active":"2023-07-27T14:40:00.430033+0000","last_became_peered":"2023-07-27T14:40:00.430033+0000","last_unstale":"2023-07-27T14:40:00.431884+0000","last_undegraded":"2023-07-27T14:40:00.431884+0000","last_fullsized":"2023-07-27T14:40:00.431884+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.445438+0000","last_change":"2023-07-27T14:39:59.968798+0000","last_active":"2023-07-27T14:40:00.445438+0000","last_peered":"2023-07-27T14:40:00.445438+0000","last_clean":"2023-07-27T14:40:00.445438+0000","last_became_active":"2023-07-27T14:39:59.968497+0000","last_became_peered":"2023-07-27T14:39:59.968497+0000","last_unstale":"2023-07-27T14:40:00.445438+0000","last_undegraded":"2023-07-27T14:40:00.445438+0000","last_fullsized":"2023-07-27T14:40:00.445438+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438453+0000","last_change":"2023-07-27T14:40:00.431553+0000","last_active":"2023-07-27T14:40:00.438453+0000","last_peered":"2023-07-27T14:40:00.438453+0000","last_clean":"2023-07-27T14:40:00.438453+0000","last_became_active":"2023-07-27T14:40:00.430671+0000","last_became_peered":"2023-07-27T14:40:00.430671+0000","last_unstale":"2023-07-27T14:40:00.438453+0000","last_undegraded":"2023-07-27T14:40:00.438453+0000","last_fullsized":"2023-07-27T14:40:00.438453+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439652+0000","last_change":"2023-07-27T14:39:59.978311+0000","last_active":"2023-07-27T14:40:00.439652+0000","last_peered":"2023-07-27T14:40:00.439652+0000","last_clean":"2023-07-27T14:40:00.439652+0000","last_became_active":"2023-07-27T14:39:59.974419+0000","last_became_peered":"2023-07-27T14:39:59.974419+0000","last_unstale":"2023-07-27T14:40:00.439652+0000","last_undegraded":"2023-07-27T14:40:00.439652+0000","last_fullsized":"2023-07-27T14:40:00.439652+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428295+0000","last_change":"2023-07-27T14:40:00.424022+0000","last_active":"2023-07-27T14:40:00.428295+0000","last_peered":"2023-07-27T14:40:00.428295+0000","last_clean":"2023-07-27T14:40:00.428295+0000","last_became_active":"2023-07-27T14:40:00.423746+0000","last_became_peered":"2023-07-27T14:40:00.423746+0000","last_unstale":"2023-07-27T14:40:00.428295+0000","last_undegraded":"2023-07-27T14:40:00.428295+0000","last_fullsized":"2023-07-27T14:40:00.428295+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.416887+0000","last_change":"2023-07-27T14:39:59.980446+0000","last_active":"2023-07-27T14:40:00.416887+0000","last_peered":"2023-07-27T14:40:00.416887+0000","last_clean":"2023-07-27T14:40:00.416887+0000","last_became_active":"2023-07-27T14:39:59.980179+0000","last_became_peered":"2023-07-27T14:39:59.980179+0000","last_unstale":"2023-07-27T14:40:00.416887+0000","last_undegraded":"2023-07-27T14:40:00.416887+0000","last_fullsized":"2023-07-27T14:40:00.416887+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442837+0000","last_change":"2023-07-27T14:40:00.436832+0000","last_active":"2023-07-27T14:40:00.442837+0000","last_peered":"2023-07-27T14:40:00.442837+0000","last_clean":"2023-07-27T14:40:00.442837+0000","last_became_active":"2023-07-27T14:40:00.436570+0000","last_became_peered":"2023-07-27T14:40:00.436570+0000","last_unstale":"2023-07-27T14:40:00.442837+0000","last_undegraded":"2023-07-27T14:40:00.442837+0000","last_fullsized":"2023-07-27T14:40:00.442837+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419078+0000","last_change":"2023-07-27T14:39:59.976359+0000","last_active":"2023-07-27T14:40:00.419078+0000","last_peered":"2023-07-27T14:40:00.419078+0000","last_clean":"2023-07-27T14:40:00.419078+0000","last_became_active":"2023-07-27T14:39:59.976086+0000","last_became_peered":"2023-07-27T14:39:59.976086+0000","last_unstale":"2023-07-27T14:40:00.419078+0000","last_undegraded":"2023-07-27T14:40:00.419078+0000","last_fullsized":"2023-07-27T14:40:00.419078+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427709+0000","last_change":"2023-07-27T14:40:00.425690+0000","last_active":"2023-07-27T14:40:00.427709+0000","last_peered":"2023-07-27T14:40:00.427709+0000","last_clean":"2023-07-27T14:40:00.427709+0000","last_became_active":"2023-07-27T14:40:00.425433+0000","last_became_peered":"2023-07-27T14:40:00.425433+0000","last_unstale":"2023-07-27T14:40:00.427709+0000","last_undegraded":"2023-07-27T14:40:00.427709+0000","last_fullsized":"2023-07-27T14:40:00.427709+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420864+0000","last_change":"2023-07-27T14:39:59.962795+0000","last_active":"2023-07-27T14:40:00.420864+0000","last_peered":"2023-07-27T14:40:00.420864+0000","last_clean":"2023-07-27T14:40:00.420864+0000","last_became_active":"2023-07-27T14:39:59.962537+0000","last_became_peered":"2023-07-27T14:39:59.962537+0000","last_unstale":"2023-07-27T14:40:00.420864+0000","last_undegraded":"2023-07-27T14:40:00.420864+0000","last_fullsized":"2023-07-27T14:40:00.420864+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442531+0000","last_change":"2023-07-27T14:40:00.435682+0000","last_active":"2023-07-27T14:40:00.442531+0000","last_peered":"2023-07-27T14:40:00.442531+0000","last_clean":"2023-07-27T14:40:00.442531+0000","last_became_active":"2023-07-27T14:40:00.435243+0000","last_became_peered":"2023-07-27T14:40:00.435243+0000","last_unstale":"2023-07-27T14:40:00.442531+0000","last_undegraded":"2023-07-27T14:40:00.442531+0000","last_fullsized":"2023-07-27T14:40:00.442531+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.26","version":"205'1","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-27T14:40:02.276340+0000","last_change":"2023-07-27T14:39:59.983757+0000","last_active":"2023-07-27T14:40:02.276340+0000","last_peered":"2023-07-27T14:40:02.276340+0000","last_clean":"2023-07-27T14:40:02.276340+0000","last_became_active":"2023-07-27T14:39:59.983414+0000","last_became_peered":"2023-07-27T14:39:59.983414+0000","last_unstale":"2023-07-27T14:40:02.276340+0000","last_undegraded":"2023-07-27T14:40:02.276340+0000","last_fullsized":"2023-07-27T14:40:02.276340+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.427352+0000","last_change":"2023-07-27T14:40:00.422356+0000","last_active":"2023-07-27T14:40:00.427352+0000","last_peered":"2023-07-27T14:40:00.427352+0000","last_clean":"2023-07-27T14:40:00.427352+0000","last_became_active":"2023-07-27T14:40:00.422057+0000","last_became_peered":"2023-07-27T14:40:00.422057+0000","last_unstale":"2023-07-27T14:40:00.427352+0000","last_undegraded":"2023-07-27T14:40:00.427352+0000","last_fullsized":"2023-07-27T14:40:00.427352+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415297+0000","last_change":"2023-07-27T14:39:59.970682+0000","last_active":"2023-07-27T14:40:00.415297+0000","last_peered":"2023-07-27T14:40:00.415297+0000","last_clean":"2023-07-27T14:40:00.415297+0000","last_became_active":"2023-07-27T14:39:59.970351+0000","last_became_peered":"2023-07-27T14:39:59.970351+0000","last_unstale":"2023-07-27T14:40:00.415297+0000","last_undegraded":"2023-07-27T14:40:00.415297+0000","last_fullsized":"2023-07-27T14:40:00.415297+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442597+0000","last_change":"2023-07-27T14:40:00.436452+0000","last_active":"2023-07-27T14:40:00.442597+0000","last_peered":"2023-07-27T14:40:00.442597+0000","last_clean":"2023-07-27T14:40:00.442597+0000","last_became_active":"2023-07-27T14:40:00.436170+0000","last_became_peered":"2023-07-27T14:40:00.436170+0000","last_unstale":"2023-07-27T14:40:00.442597+0000","last_undegraded":"2023-07-27T14:40:00.442597+0000","last_fullsized":"2023-07-27T14:40:00.442597+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418696+0000","last_change":"2023-07-27T14:39:59.978710+0000","last_active":"2023-07-27T14:40:00.418696+0000","last_peered":"2023-07-27T14:40:00.418696+0000","last_clean":"2023-07-27T14:40:00.418696+0000","last_became_active":"2023-07-27T14:39:59.978442+0000","last_became_peered":"2023-07-27T14:39:59.978442+0000","last_unstale":"2023-07-27T14:40:00.418696+0000","last_undegraded":"2023-07-27T14:40:00.418696+0000","last_fullsized":"2023-07-27T14:40:00.418696+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449386+0000","last_change":"2023-07-27T14:40:00.448176+0000","last_active":"2023-07-27T14:40:00.449386+0000","last_peered":"2023-07-27T14:40:00.449386+0000","last_clean":"2023-07-27T14:40:00.449386+0000","last_became_active":"2023-07-27T14:40:00.447900+0000","last_became_peered":"2023-07-27T14:40:00.447900+0000","last_unstale":"2023-07-27T14:40:00.449386+0000","last_undegraded":"2023-07-27T14:40:00.449386+0000","last_fullsized":"2023-07-27T14:40:00.449386+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418997+0000","last_change":"2023-07-27T14:39:59.974113+0000","last_active":"2023-07-27T14:40:00.418997+0000","last_peered":"2023-07-27T14:40:00.418997+0000","last_clean":"2023-07-27T14:40:00.418997+0000","last_became_active":"2023-07-27T14:39:59.973820+0000","last_became_peered":"2023-07-27T14:39:59.973820+0000","last_unstale":"2023-07-27T14:40:00.418997+0000","last_undegraded":"2023-07-27T14:40:00.418997+0000","last_fullsized":"2023-07-27T14:40:00.418997+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447003+0000","last_change":"2023-07-27T14:40:00.445225+0000","last_active":"2023-07-27T14:40:00.447003+0000","last_peered":"2023-07-27T14:40:00.447003+0000","last_clean":"2023-07-27T14:40:00.447003+0000","last_became_active":"2023-07-27T14:40:00.444702+0000","last_became_peered":"2023-07-27T14:40:00.444702+0000","last_unstale":"2023-07-27T14:40:00.447003+0000","last_undegraded":"2023-07-27T14:40:00.447003+0000","last_fullsized":"2023-07-27T14:40:00.447003+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419428+0000","last_change":"2023-07-27T14:39:59.982464+0000","last_active":"2023-07-27T14:40:00.419428+0000","last_peered":"2023-07-27T14:40:00.419428+0000","last_clean":"2023-07-27T14:40:00.419428+0000","last_became_active":"2023-07-27T14:39:59.982140+0000","last_became_peered":"2023-07-27T14:39:59.982140+0000","last_unstale":"2023-07-27T14:40:00.419428+0000","last_undegraded":"2023-07-27T14:40:00.419428+0000","last_fullsized":"2023-07-27T14:40:00.419428+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442334+0000","last_change":"2023-07-27T14:40:00.441511+0000","last_active":"2023-07-27T14:40:00.442334+0000","last_peered":"2023-07-27T14:40:00.442334+0000","last_clean":"2023-07-27T14:40:00.442334+0000","last_became_active":"2023-07-27T14:40:00.441161+0000","last_became_peered":"2023-07-27T14:40:00.441161+0000","last_unstale":"2023-07-27T14:40:00.442334+0000","last_undegraded":"2023-07-27T14:40:00.442334+0000","last_fullsized":"2023-07-27T14:40:00.442334+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421464+0000","last_change":"2023-07-27T14:39:59.985195+0000","last_active":"2023-07-27T14:40:00.421464+0000","last_peered":"2023-07-27T14:40:00.421464+0000","last_clean":"2023-07-27T14:40:00.421464+0000","last_became_active":"2023-07-27T14:39:59.984814+0000","last_became_peered":"2023-07-27T14:39:59.984814+0000","last_unstale":"2023-07-27T14:40:00.421464+0000","last_undegraded":"2023-07-27T14:40:00.421464+0000","last_fullsized":"2023-07-27T14:40:00.421464+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428642+0000","last_change":"2023-07-27T14:40:00.424395+0000","last_active":"2023-07-27T14:40:00.428642+0000","last_peered":"2023-07-27T14:40:00.428642+0000","last_clean":"2023-07-27T14:40:00.428642+0000","last_became_active":"2023-07-27T14:40:00.424127+0000","last_became_peered":"2023-07-27T14:40:00.424127+0000","last_unstale":"2023-07-27T14:40:00.428642+0000","last_undegraded":"2023-07-27T14:40:00.428642+0000","last_fullsized":"2023-07-27T14:40:00.428642+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.422891+0000","last_change":"2023-07-27T14:39:59.974671+0000","last_active":"2023-07-27T14:40:00.422891+0000","last_peered":"2023-07-27T14:40:00.422891+0000","last_clean":"2023-07-27T14:40:00.422891+0000","last_became_active":"2023-07-27T14:39:59.974384+0000","last_became_peered":"2023-07-27T14:39:59.974384+0000","last_unstale":"2023-07-27T14:40:00.422891+0000","last_undegraded":"2023-07-27T14:40:00.422891+0000","last_fullsized":"2023-07-27T14:40:00.422891+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446273+0000","last_change":"2023-07-27T14:40:00.444835+0000","last_active":"2023-07-27T14:40:00.446273+0000","last_peered":"2023-07-27T14:40:00.446273+0000","last_clean":"2023-07-27T14:40:00.446273+0000","last_became_active":"2023-07-27T14:40:00.444537+0000","last_became_peered":"2023-07-27T14:40:00.444537+0000","last_unstale":"2023-07-27T14:40:00.446273+0000","last_undegraded":"2023-07-27T14:40:00.446273+0000","last_fullsized":"2023-07-27T14:40:00.446273+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.422681+0000","last_change":"2023-07-27T14:39:59.980403+0000","last_active":"2023-07-27T14:40:00.422681+0000","last_peered":"2023-07-27T14:40:00.422681+0000","last_clean":"2023-07-27T14:40:00.422681+0000","last_became_active":"2023-07-27T14:39:59.980104+0000","last_became_peered":"2023-07-27T14:39:59.980104+0000","last_unstale":"2023-07-27T14:40:00.422681+0000","last_undegraded":"2023-07-27T14:40:00.422681+0000","last_fullsized":"2023-07-27T14:40:00.422681+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444136+0000","last_change":"2023-07-27T14:40:00.439027+0000","last_active":"2023-07-27T14:40:00.444136+0000","last_peered":"2023-07-27T14:40:00.444136+0000","last_clean":"2023-07-27T14:40:00.444136+0000","last_became_active":"2023-07-27T14:40:00.438761+0000","last_became_peered":"2023-07-27T14:40:00.438761+0000","last_unstale":"2023-07-27T14:40:00.444136+0000","last_undegraded":"2023-07-27T14:40:00.444136+0000","last_fullsized":"2023-07-27T14:40:00.444136+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419473+0000","last_change":"2023-07-27T14:39:59.966964+0000","last_active":"2023-07-27T14:40:00.419473+0000","last_peered":"2023-07-27T14:40:00.419473+0000","last_clean":"2023-07-27T14:40:00.419473+0000","last_became_active":"2023-07-27T14:39:59.966695+0000","last_became_peered":"2023-07-27T14:39:59.966695+0000","last_unstale":"2023-07-27T14:40:00.419473+0000","last_undegraded":"2023-07-27T14:40:00.419473+0000","last_fullsized":"2023-07-27T14:40:00.419473+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447298+0000","last_change":"2023-07-27T14:40:00.446118+0000","last_active":"2023-07-27T14:40:00.447298+0000","last_peered":"2023-07-27T14:40:00.447298+0000","last_clean":"2023-07-27T14:40:00.447298+0000","last_became_active":"2023-07-27T14:40:00.445679+0000","last_became_peered":"2023-07-27T14:40:00.445679+0000","last_unstale":"2023-07-27T14:40:00.447298+0000","last_undegraded":"2023-07-27T14:40:00.447298+0000","last_fullsized":"2023-07-27T14:40:00.447298+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"204'3","reported_seq":13,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440604+0000","last_change":"2023-07-27T14:39:59.962153+0000","last_active":"2023-07-27T14:40:00.440604+0000","last_peered":"2023-07-27T14:40:00.440604+0000","last_clean":"2023-07-27T14:40:00.440604+0000","last_became_active":"2023-07-27T14:39:59.961854+0000","last_became_peered":"2023-07-27T14:39:59.961854+0000","last_unstale":"2023-07-27T14:40:00.440604+0000","last_undegraded":"2023-07-27T14:40:00.440604+0000","last_fullsized":"2023-07-27T14:40:00.440604+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.446329+0000","last_change":"2023-07-27T14:40:00.442290+0000","last_active":"2023-07-27T14:40:00.446329+0000","last_peered":"2023-07-27T14:40:00.446329+0000","last_clean":"2023-07-27T14:40:00.446329+0000","last_became_active":"2023-07-27T14:40:00.442022+0000","last_became_peered":"2023-07-27T14:40:00.442022+0000","last_unstale":"2023-07-27T14:40:00.446329+0000","last_undegraded":"2023-07-27T14:40:00.446329+0000","last_fullsized":"2023-07-27T14:40:00.446329+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.440839+0000","last_change":"2023-07-27T14:39:59.973460+0000","last_active":"2023-07-27T14:40:00.440839+0000","last_peered":"2023-07-27T14:40:00.440839+0000","last_clean":"2023-07-27T14:40:00.440839+0000","last_became_active":"2023-07-27T14:39:59.973163+0000","last_became_peered":"2023-07-27T14:39:59.973163+0000","last_unstale":"2023-07-27T14:40:00.440839+0000","last_undegraded":"2023-07-27T14:40:00.440839+0000","last_fullsized":"2023-07-27T14:40:00.440839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431539+0000","last_change":"2023-07-27T14:40:00.426655+0000","last_active":"2023-07-27T14:40:00.431539+0000","last_peered":"2023-07-27T14:40:00.431539+0000","last_clean":"2023-07-27T14:40:00.431539+0000","last_became_active":"2023-07-27T14:40:00.426182+0000","last_became_peered":"2023-07-27T14:40:00.426182+0000","last_unstale":"2023-07-27T14:40:00.431539+0000","last_undegraded":"2023-07-27T14:40:00.431539+0000","last_fullsized":"2023-07-27T14:40:00.431539+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444068+0000","last_change":"2023-07-27T14:39:59.983557+0000","last_active":"2023-07-27T14:40:00.444068+0000","last_peered":"2023-07-27T14:40:00.444068+0000","last_clean":"2023-07-27T14:40:00.444068+0000","last_became_active":"2023-07-27T14:39:59.983347+0000","last_became_peered":"2023-07-27T14:39:59.983347+0000","last_unstale":"2023-07-27T14:40:00.444068+0000","last_undegraded":"2023-07-27T14:40:00.444068+0000","last_fullsized":"2023-07-27T14:40:00.444068+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.443293+0000","last_change":"2023-07-27T14:40:00.430903+0000","last_active":"2023-07-27T14:40:00.443293+0000","last_peered":"2023-07-27T14:40:00.443293+0000","last_clean":"2023-07-27T14:40:00.443293+0000","last_became_active":"2023-07-27T14:40:00.430608+0000","last_became_peered":"2023-07-27T14:40:00.430608+0000","last_unstale":"2023-07-27T14:40:00.443293+0000","last_undegraded":"2023-07-27T14:40:00.443293+0000","last_fullsized":"2023-07-27T14:40:00.443293+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421067+0000","last_change":"2023-07-27T14:39:59.972458+0000","last_active":"2023-07-27T14:40:00.421067+0000","last_peered":"2023-07-27T14:40:00.421067+0000","last_clean":"2023-07-27T14:40:00.421067+0000","last_became_active":"2023-07-27T14:39:59.972157+0000","last_became_peered":"2023-07-27T14:39:59.972157+0000","last_unstale":"2023-07-27T14:40:00.421067+0000","last_undegraded":"2023-07-27T14:40:00.421067+0000","last_fullsized":"2023-07-27T14:40:00.421067+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448189+0000","last_change":"2023-07-27T14:40:00.442776+0000","last_active":"2023-07-27T14:40:00.448189+0000","last_peered":"2023-07-27T14:40:00.448189+0000","last_clean":"2023-07-27T14:40:00.448189+0000","last_became_active":"2023-07-27T14:40:00.435831+0000","last_became_peered":"2023-07-27T14:40:00.435831+0000","last_unstale":"2023-07-27T14:40:00.448189+0000","last_undegraded":"2023-07-27T14:40:00.448189+0000","last_fullsized":"2023-07-27T14:40:00.448189+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.413941+0000","last_change":"2023-07-27T14:39:59.968781+0000","last_active":"2023-07-27T14:40:00.413941+0000","last_peered":"2023-07-27T14:40:00.413941+0000","last_clean":"2023-07-27T14:40:00.413941+0000","last_became_active":"2023-07-27T14:39:59.968014+0000","last_became_peered":"2023-07-27T14:39:59.968014+0000","last_unstale":"2023-07-27T14:40:00.413941+0000","last_undegraded":"2023-07-27T14:40:00.413941+0000","last_fullsized":"2023-07-27T14:40:00.413941+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.438593+0000","last_change":"2023-07-27T14:40:00.428136+0000","last_active":"2023-07-27T14:40:00.438593+0000","last_peered":"2023-07-27T14:40:00.438593+0000","last_clean":"2023-07-27T14:40:00.438593+0000","last_became_active":"2023-07-27T14:40:00.427873+0000","last_became_peered":"2023-07-27T14:40:00.427873+0000","last_unstale":"2023-07-27T14:40:00.438593+0000","last_undegraded":"2023-07-27T14:40:00.438593+0000","last_fullsized":"2023-07-27T14:40:00.438593+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"204'4","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441642+0000","last_change":"2023-07-27T14:39:59.980938+0000","last_active":"2023-07-27T14:40:00.441642+0000","last_peered":"2023-07-27T14:40:00.441642+0000","last_clean":"2023-07-27T14:40:00.441642+0000","last_became_active":"2023-07-27T14:39:59.980627+0000","last_became_peered":"2023-07-27T14:39:59.980627+0000","last_unstale":"2023-07-27T14:40:00.441642+0000","last_undegraded":"2023-07-27T14:40:00.441642+0000","last_fullsized":"2023-07-27T14:40:00.441642+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432889+0000","last_change":"2023-07-27T14:40:00.428525+0000","last_active":"2023-07-27T14:40:00.432889+0000","last_peered":"2023-07-27T14:40:00.432889+0000","last_clean":"2023-07-27T14:40:00.432889+0000","last_became_active":"2023-07-27T14:40:00.428213+0000","last_became_peered":"2023-07-27T14:40:00.428213+0000","last_unstale":"2023-07-27T14:40:00.432889+0000","last_undegraded":"2023-07-27T14:40:00.432889+0000","last_fullsized":"2023-07-27T14:40:00.432889+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449173+0000","last_change":"2023-07-27T14:39:59.977104+0000","last_active":"2023-07-27T14:40:00.449173+0000","last_peered":"2023-07-27T14:40:00.449173+0000","last_clean":"2023-07-27T14:40:00.449173+0000","last_became_active":"2023-07-27T14:39:59.976822+0000","last_became_peered":"2023-07-27T14:39:59.976822+0000","last_unstale":"2023-07-27T14:40:00.449173+0000","last_undegraded":"2023-07-27T14:40:00.449173+0000","last_fullsized":"2023-07-27T14:40:00.449173+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439610+0000","last_change":"2023-07-27T14:40:00.436729+0000","last_active":"2023-07-27T14:40:00.439610+0000","last_peered":"2023-07-27T14:40:00.439610+0000","last_clean":"2023-07-27T14:40:00.439610+0000","last_became_active":"2023-07-27T14:40:00.436469+0000","last_became_peered":"2023-07-27T14:40:00.436469+0000","last_unstale":"2023-07-27T14:40:00.439610+0000","last_undegraded":"2023-07-27T14:40:00.439610+0000","last_fullsized":"2023-07-27T14:40:00.439610+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439513+0000","last_change":"2023-07-27T14:39:59.972384+0000","last_active":"2023-07-27T14:40:00.439513+0000","last_peered":"2023-07-27T14:40:00.439513+0000","last_clean":"2023-07-27T14:40:00.439513+0000","last_became_active":"2023-07-27T14:39:59.972023+0000","last_became_peered":"2023-07-27T14:39:59.972023+0000","last_unstale":"2023-07-27T14:40:00.439513+0000","last_undegraded":"2023-07-27T14:40:00.439513+0000","last_fullsized":"2023-07-27T14:40:00.439513+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447350+0000","last_change":"2023-07-27T14:40:00.440188+0000","last_active":"2023-07-27T14:40:00.447350+0000","last_peered":"2023-07-27T14:40:00.447350+0000","last_clean":"2023-07-27T14:40:00.447350+0000","last_became_active":"2023-07-27T14:40:00.439491+0000","last_became_peered":"2023-07-27T14:40:00.439491+0000","last_unstale":"2023-07-27T14:40:00.447350+0000","last_undegraded":"2023-07-27T14:40:00.447350+0000","last_fullsized":"2023-07-27T14:40:00.447350+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.424520+0000","last_change":"2023-07-27T14:39:59.985236+0000","last_active":"2023-07-27T14:40:00.424520+0000","last_peered":"2023-07-27T14:40:00.424520+0000","last_clean":"2023-07-27T14:40:00.424520+0000","last_became_active":"2023-07-27T14:39:59.984943+0000","last_became_peered":"2023-07-27T14:39:59.984943+0000","last_unstale":"2023-07-27T14:40:00.424520+0000","last_undegraded":"2023-07-27T14:40:00.424520+0000","last_fullsized":"2023-07-27T14:40:00.424520+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447094+0000","last_change":"2023-07-27T14:40:00.440419+0000","last_active":"2023-07-27T14:40:00.447094+0000","last_peered":"2023-07-27T14:40:00.447094+0000","last_clean":"2023-07-27T14:40:00.447094+0000","last_became_active":"2023-07-27T14:40:00.440077+0000","last_became_peered":"2023-07-27T14:40:00.440077+0000","last_unstale":"2023-07-27T14:40:00.447094+0000","last_undegraded":"2023-07-27T14:40:00.447094+0000","last_fullsized":"2023-07-27T14:40:00.447094+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418246+0000","last_change":"2023-07-27T14:39:59.971231+0000","last_active":"2023-07-27T14:40:00.418246+0000","last_peered":"2023-07-27T14:40:00.418246+0000","last_clean":"2023-07-27T14:40:00.418246+0000","last_became_active":"2023-07-27T14:39:59.970964+0000","last_became_peered":"2023-07-27T14:39:59.970964+0000","last_unstale":"2023-07-27T14:40:00.418246+0000","last_undegraded":"2023-07-27T14:40:00.418246+0000","last_fullsized":"2023-07-27T14:40:00.418246+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428953+0000","last_change":"2023-07-27T14:40:00.424947+0000","last_active":"2023-07-27T14:40:00.428953+0000","last_peered":"2023-07-27T14:40:00.428953+0000","last_clean":"2023-07-27T14:40:00.428953+0000","last_became_active":"2023-07-27T14:40:00.424664+0000","last_became_peered":"2023-07-27T14:40:00.424664+0000","last_unstale":"2023-07-27T14:40:00.428953+0000","last_undegraded":"2023-07-27T14:40:00.428953+0000","last_fullsized":"2023-07-27T14:40:00.428953+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448568+0000","last_change":"2023-07-27T14:39:59.973840+0000","last_active":"2023-07-27T14:40:00.448568+0000","last_peered":"2023-07-27T14:40:00.448568+0000","last_clean":"2023-07-27T14:40:00.448568+0000","last_became_active":"2023-07-27T14:39:59.973547+0000","last_became_peered":"2023-07-27T14:39:59.973547+0000","last_unstale":"2023-07-27T14:40:00.448568+0000","last_undegraded":"2023-07-27T14:40:00.448568+0000","last_fullsized":"2023-07-27T14:40:00.448568+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.443315+0000","last_change":"2023-07-27T14:40:00.437306+0000","last_active":"2023-07-27T14:40:00.443315+0000","last_peered":"2023-07-27T14:40:00.443315+0000","last_clean":"2023-07-27T14:40:00.443315+0000","last_became_active":"2023-07-27T14:40:00.437012+0000","last_became_peered":"2023-07-27T14:40:00.437012+0000","last_unstale":"2023-07-27T14:40:00.443315+0000","last_undegraded":"2023-07-27T14:40:00.443315+0000","last_fullsized":"2023-07-27T14:40:00.443315+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419345+0000","last_change":"2023-07-27T14:39:59.969929+0000","last_active":"2023-07-27T14:40:00.419345+0000","last_peered":"2023-07-27T14:40:00.419345+0000","last_clean":"2023-07-27T14:40:00.419345+0000","last_became_active":"2023-07-27T14:39:59.969613+0000","last_became_peered":"2023-07-27T14:39:59.969613+0000","last_unstale":"2023-07-27T14:40:00.419345+0000","last_undegraded":"2023-07-27T14:40:00.419345+0000","last_fullsized":"2023-07-27T14:40:00.419345+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433045+0000","last_change":"2023-07-27T14:40:00.428558+0000","last_active":"2023-07-27T14:40:00.433045+0000","last_peered":"2023-07-27T14:40:00.433045+0000","last_clean":"2023-07-27T14:40:00.433045+0000","last_became_active":"2023-07-27T14:40:00.428225+0000","last_became_peered":"2023-07-27T14:40:00.428225+0000","last_unstale":"2023-07-27T14:40:00.433045+0000","last_undegraded":"2023-07-27T14:40:00.433045+0000","last_fullsized":"2023-07-27T14:40:00.433045+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418817+0000","last_change":"2023-07-27T14:39:59.983735+0000","last_active":"2023-07-27T14:40:00.418817+0000","last_peered":"2023-07-27T14:40:00.418817+0000","last_clean":"2023-07-27T14:40:00.418817+0000","last_became_active":"2023-07-27T14:39:59.983374+0000","last_became_peered":"2023-07-27T14:39:59.983374+0000","last_unstale":"2023-07-27T14:40:00.418817+0000","last_undegraded":"2023-07-27T14:40:00.418817+0000","last_fullsized":"2023-07-27T14:40:00.418817+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432050+0000","last_change":"2023-07-27T14:40:00.428749+0000","last_active":"2023-07-27T14:40:00.432050+0000","last_peered":"2023-07-27T14:40:00.432050+0000","last_clean":"2023-07-27T14:40:00.432050+0000","last_became_active":"2023-07-27T14:40:00.428434+0000","last_became_peered":"2023-07-27T14:40:00.428434+0000","last_unstale":"2023-07-27T14:40:00.432050+0000","last_undegraded":"2023-07-27T14:40:00.432050+0000","last_fullsized":"2023-07-27T14:40:00.432050+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429228+0000","last_change":"2023-07-27T14:39:59.965470+0000","last_active":"2023-07-27T14:40:00.429228+0000","last_peered":"2023-07-27T14:40:00.429228+0000","last_clean":"2023-07-27T14:40:00.429228+0000","last_became_active":"2023-07-27T14:39:59.964847+0000","last_became_peered":"2023-07-27T14:39:59.964847+0000","last_unstale":"2023-07-27T14:40:00.429228+0000","last_undegraded":"2023-07-27T14:40:00.429228+0000","last_fullsized":"2023-07-27T14:40:00.429228+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432022+0000","last_change":"2023-07-27T14:40:00.429569+0000","last_active":"2023-07-27T14:40:00.432022+0000","last_peered":"2023-07-27T14:40:00.432022+0000","last_clean":"2023-07-27T14:40:00.432022+0000","last_became_active":"2023-07-27T14:40:00.429132+0000","last_became_peered":"2023-07-27T14:40:00.429132+0000","last_unstale":"2023-07-27T14:40:00.432022+0000","last_undegraded":"2023-07-27T14:40:00.432022+0000","last_fullsized":"2023-07-27T14:40:00.432022+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448534+0000","last_change":"2023-07-27T14:39:59.970152+0000","last_active":"2023-07-27T14:40:00.448534+0000","last_peered":"2023-07-27T14:40:00.448534+0000","last_clean":"2023-07-27T14:40:00.448534+0000","last_became_active":"2023-07-27T14:39:59.969856+0000","last_became_peered":"2023-07-27T14:39:59.969856+0000","last_unstale":"2023-07-27T14:40:00.448534+0000","last_undegraded":"2023-07-27T14:40:00.448534+0000","last_fullsized":"2023-07-27T14:40:00.448534+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448138+0000","last_change":"2023-07-27T14:40:00.440758+0000","last_active":"2023-07-27T14:40:00.448138+0000","last_peered":"2023-07-27T14:40:00.448138+0000","last_clean":"2023-07-27T14:40:00.448138+0000","last_became_active":"2023-07-27T14:40:00.433122+0000","last_became_peered":"2023-07-27T14:40:00.433122+0000","last_unstale":"2023-07-27T14:40:00.448138+0000","last_undegraded":"2023-07-27T14:40:00.448138+0000","last_fullsized":"2023-07-27T14:40:00.448138+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421674+0000","last_change":"2023-07-27T14:39:59.980716+0000","last_active":"2023-07-27T14:40:00.421674+0000","last_peered":"2023-07-27T14:40:00.421674+0000","last_clean":"2023-07-27T14:40:00.421674+0000","last_became_active":"2023-07-27T14:39:59.980413+0000","last_became_peered":"2023-07-27T14:39:59.980413+0000","last_unstale":"2023-07-27T14:40:00.421674+0000","last_undegraded":"2023-07-27T14:40:00.421674+0000","last_fullsized":"2023-07-27T14:40:00.421674+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447368+0000","last_change":"2023-07-27T14:40:00.440397+0000","last_active":"2023-07-27T14:40:00.447368+0000","last_peered":"2023-07-27T14:40:00.447368+0000","last_clean":"2023-07-27T14:40:00.447368+0000","last_became_active":"2023-07-27T14:40:00.439883+0000","last_became_peered":"2023-07-27T14:40:00.439883+0000","last_unstale":"2023-07-27T14:40:00.447368+0000","last_undegraded":"2023-07-27T14:40:00.447368+0000","last_fullsized":"2023-07-27T14:40:00.447368+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.424930+0000","last_change":"2023-07-27T14:39:59.980928+0000","last_active":"2023-07-27T14:40:00.424930+0000","last_peered":"2023-07-27T14:40:00.424930+0000","last_clean":"2023-07-27T14:40:00.424930+0000","last_became_active":"2023-07-27T14:39:59.980628+0000","last_became_peered":"2023-07-27T14:39:59.980628+0000","last_unstale":"2023-07-27T14:40:00.424930+0000","last_undegraded":"2023-07-27T14:40:00.424930+0000","last_fullsized":"2023-07-27T14:40:00.424930+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.428260+0000","last_change":"2023-07-27T14:40:00.425272+0000","last_active":"2023-07-27T14:40:00.428260+0000","last_peered":"2023-07-27T14:40:00.428260+0000","last_clean":"2023-07-27T14:40:00.428260+0000","last_became_active":"2023-07-27T14:40:00.424996+0000","last_became_peered":"2023-07-27T14:40:00.424996+0000","last_unstale":"2023-07-27T14:40:00.428260+0000","last_undegraded":"2023-07-27T14:40:00.428260+0000","last_fullsized":"2023-07-27T14:40:00.428260+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.431423+0000","last_change":"2023-07-27T14:39:59.969469+0000","last_active":"2023-07-27T14:40:00.431423+0000","last_peered":"2023-07-27T14:40:00.431423+0000","last_clean":"2023-07-27T14:40:00.431423+0000","last_became_active":"2023-07-27T14:39:59.969102+0000","last_became_peered":"2023-07-27T14:39:59.969102+0000","last_unstale":"2023-07-27T14:40:00.431423+0000","last_undegraded":"2023-07-27T14:40:00.431423+0000","last_fullsized":"2023-07-27T14:40:00.431423+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.435080+0000","last_change":"2023-07-27T14:40:00.429382+0000","last_active":"2023-07-27T14:40:00.435080+0000","last_peered":"2023-07-27T14:40:00.435080+0000","last_clean":"2023-07-27T14:40:00.435080+0000","last_became_active":"2023-07-27T14:40:00.429036+0000","last_became_peered":"2023-07-27T14:40:00.429036+0000","last_unstale":"2023-07-27T14:40:00.435080+0000","last_undegraded":"2023-07-27T14:40:00.435080+0000","last_fullsized":"2023-07-27T14:40:00.435080+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417326+0000","last_change":"2023-07-27T14:39:59.969808+0000","last_active":"2023-07-27T14:40:00.417326+0000","last_peered":"2023-07-27T14:40:00.417326+0000","last_clean":"2023-07-27T14:40:00.417326+0000","last_became_active":"2023-07-27T14:39:59.969420+0000","last_became_peered":"2023-07-27T14:39:59.969420+0000","last_unstale":"2023-07-27T14:40:00.417326+0000","last_undegraded":"2023-07-27T14:40:00.417326+0000","last_fullsized":"2023-07-27T14:40:00.417326+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.448626+0000","last_change":"2023-07-27T14:40:00.442938+0000","last_active":"2023-07-27T14:40:00.448626+0000","last_peered":"2023-07-27T14:40:00.448626+0000","last_clean":"2023-07-27T14:40:00.448626+0000","last_became_active":"2023-07-27T14:40:00.440374+0000","last_became_peered":"2023-07-27T14:40:00.440374+0000","last_unstale":"2023-07-27T14:40:00.448626+0000","last_undegraded":"2023-07-27T14:40:00.448626+0000","last_fullsized":"2023-07-27T14:40:00.448626+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.421303+0000","last_change":"2023-07-27T14:39:59.969026+0000","last_active":"2023-07-27T14:40:00.421303+0000","last_peered":"2023-07-27T14:40:00.421303+0000","last_clean":"2023-07-27T14:40:00.421303+0000","last_became_active":"2023-07-27T14:39:59.968054+0000","last_became_peered":"2023-07-27T14:39:59.968054+0000","last_unstale":"2023-07-27T14:40:00.421303+0000","last_undegraded":"2023-07-27T14:40:00.421303+0000","last_fullsized":"2023-07-27T14:40:00.421303+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.443481+0000","last_change":"2023-07-27T14:40:00.434914+0000","last_active":"2023-07-27T14:40:00.443481+0000","last_peered":"2023-07-27T14:40:00.443481+0000","last_clean":"2023-07-27T14:40:00.443481+0000","last_became_active":"2023-07-27T14:40:00.432834+0000","last_became_peered":"2023-07-27T14:40:00.432834+0000","last_unstale":"2023-07-27T14:40:00.443481+0000","last_undegraded":"2023-07-27T14:40:00.443481+0000","last_fullsized":"2023-07-27T14:40:00.443481+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414030+0000","last_change":"2023-07-27T14:39:59.969719+0000","last_active":"2023-07-27T14:40:00.414030+0000","last_peered":"2023-07-27T14:40:00.414030+0000","last_clean":"2023-07-27T14:40:00.414030+0000","last_became_active":"2023-07-27T14:39:59.969454+0000","last_became_peered":"2023-07-27T14:39:59.969454+0000","last_unstale":"2023-07-27T14:40:00.414030+0000","last_undegraded":"2023-07-27T14:40:00.414030+0000","last_fullsized":"2023-07-27T14:40:00.414030+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444106+0000","last_change":"2023-07-27T14:40:00.438411+0000","last_active":"2023-07-27T14:40:00.444106+0000","last_peered":"2023-07-27T14:40:00.444106+0000","last_clean":"2023-07-27T14:40:00.444106+0000","last_became_active":"2023-07-27T14:40:00.438142+0000","last_became_peered":"2023-07-27T14:40:00.438142+0000","last_unstale":"2023-07-27T14:40:00.444106+0000","last_undegraded":"2023-07-27T14:40:00.444106+0000","last_fullsized":"2023-07-27T14:40:00.444106+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429322+0000","last_change":"2023-07-27T14:39:59.965648+0000","last_active":"2023-07-27T14:40:00.429322+0000","last_peered":"2023-07-27T14:40:00.429322+0000","last_clean":"2023-07-27T14:40:00.429322+0000","last_became_active":"2023-07-27T14:39:59.965196+0000","last_became_peered":"2023-07-27T14:39:59.965196+0000","last_unstale":"2023-07-27T14:40:00.429322+0000","last_undegraded":"2023-07-27T14:40:00.429322+0000","last_fullsized":"2023-07-27T14:40:00.429322+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.429829+0000","last_change":"2023-07-27T14:40:00.423000+0000","last_active":"2023-07-27T14:40:00.429829+0000","last_peered":"2023-07-27T14:40:00.429829+0000","last_clean":"2023-07-27T14:40:00.429829+0000","last_became_active":"2023-07-27T14:40:00.422645+0000","last_became_peered":"2023-07-27T14:40:00.422645+0000","last_unstale":"2023-07-27T14:40:00.429829+0000","last_undegraded":"2023-07-27T14:40:00.429829+0000","last_fullsized":"2023-07-27T14:40:00.429829+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.418690+0000","last_change":"2023-07-27T14:39:59.976589+0000","last_active":"2023-07-27T14:40:00.418690+0000","last_peered":"2023-07-27T14:40:00.418690+0000","last_clean":"2023-07-27T14:40:00.418690+0000","last_became_active":"2023-07-27T14:39:59.976309+0000","last_became_peered":"2023-07-27T14:39:59.976309+0000","last_unstale":"2023-07-27T14:40:00.418690+0000","last_undegraded":"2023-07-27T14:40:00.418690+0000","last_fullsized":"2023-07-27T14:40:00.418690+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.432864+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:40:00.432864+0000","last_peered":"2023-07-27T14:40:00.432864+0000","last_clean":"2023-07-27T14:40:00.432864+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:40:00.432864+0000","last_undegraded":"2023-07-27T14:40:00.432864+0000","last_fullsized":"2023-07-27T14:40:00.432864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444436+0000","last_change":"2023-07-27T14:40:00.441715+0000","last_active":"2023-07-27T14:40:00.444436+0000","last_peered":"2023-07-27T14:40:00.444436+0000","last_clean":"2023-07-27T14:40:00.444436+0000","last_became_active":"2023-07-27T14:40:00.441196+0000","last_became_peered":"2023-07-27T14:40:00.441196+0000","last_unstale":"2023-07-27T14:40:00.444436+0000","last_undegraded":"2023-07-27T14:40:00.444436+0000","last_fullsized":"2023-07-27T14:40:00.444436+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417054+0000","last_change":"2023-07-27T14:39:59.980461+0000","last_active":"2023-07-27T14:40:00.417054+0000","last_peered":"2023-07-27T14:40:00.417054+0000","last_clean":"2023-07-27T14:40:00.417054+0000","last_became_active":"2023-07-27T14:39:59.980112+0000","last_became_peered":"2023-07-27T14:39:59.980112+0000","last_unstale":"2023-07-27T14:40:00.417054+0000","last_undegraded":"2023-07-27T14:40:00.417054+0000","last_fullsized":"2023-07-27T14:40:00.417054+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.414305+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:40:00.414305+0000","last_peered":"2023-07-27T14:40:00.414305+0000","last_clean":"2023-07-27T14:40:00.414305+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:40:00.414305+0000","last_undegraded":"2023-07-27T14:40:00.414305+0000","last_fullsized":"2023-07-27T14:40:00.414305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449848+0000","last_change":"2023-07-27T14:40:00.448368+0000","last_active":"2023-07-27T14:40:00.449848+0000","last_peered":"2023-07-27T14:40:00.449848+0000","last_clean":"2023-07-27T14:40:00.449848+0000","last_became_active":"2023-07-27T14:40:00.448089+0000","last_became_peered":"2023-07-27T14:40:00.448089+0000","last_unstale":"2023-07-27T14:40:00.449848+0000","last_undegraded":"2023-07-27T14:40:00.449848+0000","last_fullsized":"2023-07-27T14:40:00.449848+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420757+0000","last_change":"2023-07-27T14:39:59.973337+0000","last_active":"2023-07-27T14:40:00.420757+0000","last_peered":"2023-07-27T14:40:00.420757+0000","last_clean":"2023-07-27T14:40:00.420757+0000","last_became_active":"2023-07-27T14:39:59.972405+0000","last_became_peered":"2023-07-27T14:39:59.972405+0000","last_unstale":"2023-07-27T14:40:00.420757+0000","last_undegraded":"2023-07-27T14:40:00.420757+0000","last_fullsized":"2023-07-27T14:40:00.420757+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.425011+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:40:00.425011+0000","last_peered":"2023-07-27T14:40:00.425011+0000","last_clean":"2023-07-27T14:40:00.425011+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:40:00.425011+0000","last_undegraded":"2023-07-27T14:40:00.425011+0000","last_fullsized":"2023-07-27T14:40:00.425011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.433860+0000","last_change":"2023-07-27T14:40:00.432392+0000","last_active":"2023-07-27T14:40:00.433860+0000","last_peered":"2023-07-27T14:40:00.433860+0000","last_clean":"2023-07-27T14:40:00.433860+0000","last_became_active":"2023-07-27T14:40:00.432087+0000","last_became_peered":"2023-07-27T14:40:00.432087+0000","last_unstale":"2023-07-27T14:40:00.433860+0000","last_undegraded":"2023-07-27T14:40:00.433860+0000","last_fullsized":"2023-07-27T14:40:00.433860+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.441025+0000","last_change":"2023-07-27T14:39:59.982545+0000","last_active":"2023-07-27T14:40:00.441025+0000","last_peered":"2023-07-27T14:40:00.441025+0000","last_clean":"2023-07-27T14:40:00.441025+0000","last_became_active":"2023-07-27T14:39:59.982105+0000","last_became_peered":"2023-07-27T14:39:59.982105+0000","last_unstale":"2023-07-27T14:40:00.441025+0000","last_undegraded":"2023-07-27T14:40:00.441025+0000","last_fullsized":"2023-07-27T14:40:00.441025+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.423079+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:40:00.423079+0000","last_peered":"2023-07-27T14:40:00.423079+0000","last_clean":"2023-07-27T14:40:00.423079+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:40:00.423079+0000","last_undegraded":"2023-07-27T14:40:00.423079+0000","last_fullsized":"2023-07-27T14:40:00.423079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.442565+0000","last_change":"2023-07-27T14:40:00.436777+0000","last_active":"2023-07-27T14:40:00.442565+0000","last_peered":"2023-07-27T14:40:00.442565+0000","last_clean":"2023-07-27T14:40:00.442565+0000","last_became_active":"2023-07-27T14:40:00.436495+0000","last_became_peered":"2023-07-27T14:40:00.436495+0000","last_unstale":"2023-07-27T14:40:00.442565+0000","last_undegraded":"2023-07-27T14:40:00.442565+0000","last_fullsized":"2023-07-27T14:40:00.442565+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"204'2","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.449052+0000","last_change":"2023-07-27T14:39:59.980665+0000","last_active":"2023-07-27T14:40:00.449052+0000","last_peered":"2023-07-27T14:40:00.449052+0000","last_clean":"2023-07-27T14:40:00.449052+0000","last_became_active":"2023-07-27T14:39:59.980384+0000","last_became_peered":"2023-07-27T14:39:59.980384+0000","last_unstale":"2023-07-27T14:40:00.449052+0000","last_undegraded":"2023-07-27T14:40:00.449052+0000","last_fullsized":"2023-07-27T14:40:00.449052+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":174,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.422985+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:40:00.422985+0000","last_peered":"2023-07-27T14:40:00.422985+0000","last_clean":"2023-07-27T14:40:00.422985+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:40:00.422985+0000","last_undegraded":"2023-07-27T14:40:00.422985+0000","last_fullsized":"2023-07-27T14:40:00.422985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.417404+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:40:00.417404+0000","last_peered":"2023-07-27T14:40:00.417404+0000","last_clean":"2023-07-27T14:40:00.417404+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:40:00.417404+0000","last_undegraded":"2023-07-27T14:40:00.417404+0000","last_fullsized":"2023-07-27T14:40:00.417404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.443615+0000","last_change":"2023-07-27T14:40:00.438017+0000","last_active":"2023-07-27T14:40:00.443615+0000","last_peered":"2023-07-27T14:40:00.443615+0000","last_clean":"2023-07-27T14:40:00.443615+0000","last_became_active":"2023-07-27T14:40:00.437570+0000","last_became_peered":"2023-07-27T14:40:00.437570+0000","last_unstale":"2023-07-27T14:40:00.443615+0000","last_undegraded":"2023-07-27T14:40:00.443615+0000","last_fullsized":"2023-07-27T14:40:00.443615+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"204'1","reported_seq":11,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.437834+0000","last_change":"2023-07-27T14:39:59.977091+0000","last_active":"2023-07-27T14:40:00.437834+0000","last_peered":"2023-07-27T14:40:00.437834+0000","last_clean":"2023-07-27T14:40:00.437834+0000","last_became_active":"2023-07-27T14:39:59.976798+0000","last_became_peered":"2023-07-27T14:39:59.976798+0000","last_unstale":"2023-07-27T14:40:00.437834+0000","last_undegraded":"2023-07-27T14:40:00.437834+0000","last_fullsized":"2023-07-27T14:40:00.437834+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.419629+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:40:00.419629+0000","last_peered":"2023-07-27T14:40:00.419629+0000","last_clean":"2023-07-27T14:40:00.419629+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:40:00.419629+0000","last_undegraded":"2023-07-27T14:40:00.419629+0000","last_fullsized":"2023-07-27T14:40:00.419629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.447273+0000","last_change":"2023-07-27T14:40:00.445556+0000","last_active":"2023-07-27T14:40:00.447273+0000","last_peered":"2023-07-27T14:40:00.447273+0000","last_clean":"2023-07-27T14:40:00.447273+0000","last_became_active":"2023-07-27T14:40:00.445135+0000","last_became_peered":"2023-07-27T14:40:00.445135+0000","last_unstale":"2023-07-27T14:40:00.447273+0000","last_undegraded":"2023-07-27T14:40:00.447273+0000","last_fullsized":"2023-07-27T14:40:00.447273+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420215+0000","last_change":"2023-07-27T14:39:59.981798+0000","last_active":"2023-07-27T14:40:00.420215+0000","last_peered":"2023-07-27T14:40:00.420215+0000","last_clean":"2023-07-27T14:40:00.420215+0000","last_became_active":"2023-07-27T14:39:59.981482+0000","last_became_peered":"2023-07-27T14:39:59.981482+0000","last_unstale":"2023-07-27T14:40:00.420215+0000","last_undegraded":"2023-07-27T14:40:00.420215+0000","last_fullsized":"2023-07-27T14:40:00.420215+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.420302+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:40:00.420302+0000","last_peered":"2023-07-27T14:40:00.420302+0000","last_clean":"2023-07-27T14:40:00.420302+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:40:00.420302+0000","last_undegraded":"2023-07-27T14:40:00.420302+0000","last_fullsized":"2023-07-27T14:40:00.420302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.444752+0000","last_change":"2023-07-27T14:40:00.443893+0000","last_active":"2023-07-27T14:40:00.444752+0000","last_peered":"2023-07-27T14:40:00.444752+0000","last_clean":"2023-07-27T14:40:00.444752+0000","last_became_active":"2023-07-27T14:40:00.443582+0000","last_became_peered":"2023-07-27T14:40:00.443582+0000","last_unstale":"2023-07-27T14:40:00.444752+0000","last_undegraded":"2023-07-27T14:40:00.444752+0000","last_fullsized":"2023-07-27T14:40:00.444752+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:59.942545+0000","last_clean_scrub_stamp":"2023-07-27T14:39:59.942545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.439813+0000","last_change":"2023-07-27T14:39:59.976754+0000","last_active":"2023-07-27T14:40:00.439813+0000","last_peered":"2023-07-27T14:40:00.439813+0000","last_clean":"2023-07-27T14:40:00.439813+0000","last_became_active":"2023-07-27T14:39:59.976464+0000","last_became_peered":"2023-07-27T14:39:59.976464+0000","last_unstale":"2023-07-27T14:40:00.439813+0000","last_undegraded":"2023-07-27T14:40:00.439813+0000","last_fullsized":"2023-07-27T14:40:00.439813+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:39:58.936184+0000","last_clean_scrub_stamp":"2023-07-27T14:39:58.936184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-07-27T14:40:00.415114+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:40:00.415114+0000","last_peered":"2023-07-27T14:40:00.415114+0000","last_clean":"2023-07-27T14:40:00.415114+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:40:00.415114+0000","last_undegraded":"2023-07-27T14:40:00.415114+0000","last_fullsized":"2023-07-27T14:40:00.415114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25824,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":23296,"kb_avail":94346016,"statfs":{"total":96636764160,"available":96610320384,"internally_reserved":0,"allocated":2580480,"data_stored":1227871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23855104},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.60999999999999999,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.67300000000000004,"15min":0.69399999999999995},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.71799999999999997,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.2599999999999998,"5min":5.2599999999999998,"15min":5.2599999999999998},"last":0.753}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.73299999999999998,"15min":0.70499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":8.952,"5min":8.952,"15min":8.952},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"max":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.50900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.72099999999999997,"15min":0.66500000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.318},"max":{"1min":7.5640000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.72199999999999998,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":5.2249999999999996,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.121,"5min":0.78900000000000003,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":8.1630000000000003,"5min":8.1630000000000003,"15min":8.1630000000000003},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":0.81599999999999995,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":7.6269999999999998,"5min":7.6269999999999998,"15min":7.6269999999999998},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.54700000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25584,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":23040,"kb_avail":94346256,"statfs":{"total":96636764160,"available":96610566144,"internally_reserved":0,"allocated":2596864,"data_stored":1228551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23592960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.68400000000000005,"15min":0.627},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.83799999999999997,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.751}]},{"osd":1,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.76200000000000001,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36599999999999999},"max":{"1min":0.91700000000000004,"5min":13.975,"15min":13.975},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65800000000000003,"15min":0.64500000000000002},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.42199999999999999},"max":{"1min":0.93000000000000005,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71099999999999997,"15min":0.66500000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92800000000000005,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.79000000000000004,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.879,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.753,"15min":0.69699999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.78800000000000003,"15min":0.67400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.875,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.68100000000000005,"15min":0.67000000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.72199999999999998,"15min":0.68600000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.84399999999999997,"15min":0.73699999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":15.461,"15min":15.461},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.78900000000000003,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.90200000000000002,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82899999999999996,"15min":0.78300000000000003},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.45900000000000002},"max":{"1min":0.94399999999999995,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575009,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25572,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":23040,"kb_avail":94346268,"statfs":{"total":96636764160,"available":96610578432,"internally_reserved":0,"allocated":2584576,"data_stored":1227961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23592960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38600000000000001,"15min":0.438},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57499999999999996,"5min":0.61499999999999999,"15min":4.75},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.51700000000000002},"min":{"1min":0.25600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":0.65700000000000003,"15min":9.3100000000000005},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.66900000000000004,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.495},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":2.7160000000000002},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32800000000000001},"max":{"1min":0.65600000000000003,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.504},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":3.8580000000000001},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.54200000000000004,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":1.071,"5min":1.111,"15min":2.181},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":2.4180000000000001},"last":0.623}]},{"osd":5,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.57899999999999996,"5min":0.51000000000000001,"15min":0.46600000000000003},"max":{"1min":1.121,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.45400000000000001},"max":{"1min":1.0609999999999999,"5min":1.6879999999999999,"15min":2.149},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.72299999999999998},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":2.052},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71399999999999997,"15min":0.76300000000000001},"min":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0549999999999999,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jul 27 14:39:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.44800000000000001},"max":{"1min":1.0349999999999999,"5min":1.1419999999999999,"15min":2.016},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.59999999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1839999999999999,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23980,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":21440,"kb_avail":94347860,"statfs":{"total":96636764160,"available":96612208640,"internally_reserved":0,"allocated":2592768,"data_stored":1228923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21954560},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.73199999999999998,"5min":1.954,"15min":1.954},"last":0.625},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68200000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.46899999999999997},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":1.0660000000000001,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.876},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.48299999999999998,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.97599999999999998,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.53100000000000003,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.6020000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.73199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.498},"max":{"1min":1.0469999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.44,"15min":0.44},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.22},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.753,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.113,"5min":2.141,"15min":2.141},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.48699999999999999},"max":{"1min":0.95399999999999996,"5min":1.125,"15min":1.2370000000000001},"last":0.95899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":25088,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":2600960,"data_stored":1229463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25690112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23799999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42299999999999999,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.1899999999999999},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.96399999999999997},"last":0.437},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":5.601},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.83499999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.498,"15min":0.51100000000000001},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.754,"5min":1.002,"15min":1.353},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.42999999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.849},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":6.9660000000000002},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":1.163,"15min":1.163},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69699999999999995,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.772},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69399999999999995,"15min":0.71499999999999997},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.42499999999999999},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":3.1600000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73299999999999998,"15min":0.755},"min":{"1min":0.51800000000000002,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":0.95999999999999996,"5min":1.105,"15min":3.1360000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.499,"15min":0.499},"max":{"1min":1.01,"5min":1.024,"15min":1.8089999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72999999999999998,"15min":0.76400000000000001},"min":{"1min":0.628,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.5980000000000001},"last":0.98599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23912,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":21376,"kb_avail":94347928,"statfs":{"total":96636764160,"available":96612278272,"internally_reserved":0,"allocated":2588672,"data_stored":1228515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21889024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.377,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"max":{"1min":0.497,"5min":0.66800000000000004,"15min":1.202},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.42899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.302},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.54500000000000004,"5min":0.64200000000000002,"15min":1.2390000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.39800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.48499999999999999,"15min":0.504},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.65700000000000003,"5min":0.68899999999999995,"15min":1.8029999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.68799999999999994},"min":{"1min":0.497,"5min":0.436,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.149},"last":0.876},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.71699999999999997},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":5.1059999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.56100000000000005,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0229999999999999,"15min":1.232},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70199999999999996,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":0.98899999999999999,"15min":2.3959999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.72299999999999998},"min":{"1min":0.56499999999999995,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":0.90300000000000002,"5min":0.97799999999999998,"15min":1.298},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.504,"5min":0.501,"15min":0.44},"max":{"1min":0.93300000000000005,"5min":1.0129999999999999,"15min":1.343},"last":0.80500000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":0.98899999999999999,"5min":1.115,"15min":2.048},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.76400000000000001},"min":{"1min":0.51700000000000002,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":0.97999999999999998,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.90000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":18720,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":16192,"kb_avail":94353120,"statfs":{"total":96636764160,"available":96617594880,"internally_reserved":0,"allocated":2580480,"data_stored":1227871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16580608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63100000000000001,"15min":0.65600000000000003},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.93200000000000005,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.53000000000000003,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.88300000000000001,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":3.419,"15min":4.4409999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.439,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.79000000000000004,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66000000000000003,"15min":0.67600000000000005},"min":{"1min":0.51300000000000001,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":2.3010000000000002,"15min":4.476},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.44700000000000001},"max":{"1min":0.79700000000000004,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.54100000000000004,"5min":0.46700000000000003,"15min":0.45500000000000002},"max":{"1min":1.002,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.62}]},{"osd":5,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":3.48,"15min":4.3949999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.502}]},{"osd":6,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":3.8620000000000001,"15min":5.194},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85399999999999998,"5min":2.387,"15min":5.5990000000000002},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45300000000000001},"max":{"1min":0.78800000000000003,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.76600000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.432,"15min":0.34599999999999997},"max":{"1min":0.83899999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575010,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26852,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":24320,"kb_avail":94344988,"statfs":{"total":96636764160,"available":96609267712,"internally_reserved":0,"allocated":2584576,"data_stored":1228425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24903680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.317},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":0.90100000000000002,"15min":12.127000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.443,"15min":0.377},"max":{"1min":0.91400000000000003,"5min":1.026,"15min":6.7489999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.67500000000000004},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":0.94299999999999995,"15min":6.7370000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":0.98799999999999999,"15min":1.581},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.69299999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":5.5750000000000002,"5min":5.5750000000000002,"15min":5.5750000000000002},"last":0.753}]},{"osd":3,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.67200000000000004},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.874,"5min":0.875,"15min":9.6920000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72599999999999998,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":9.4299999999999997},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":1.978},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":2.4129999999999998},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.36099999999999999},"max":{"1min":0.78300000000000003,"5min":0.88500000000000001,"15min":8.0329999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":0.96399999999999997,"5min":1.0840000000000001,"15min":1.7629999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jul 27 14:39:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.3719999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.57199999999999995,"5min":0.503,"15min":0.46500000000000002},"max":{"1min":0.88600000000000001,"5min":1.115,"15min":1.9419999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:40:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:40:09.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:40:10.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.140+0000 7f20409ff700 1 Processor -- start 2023-07-27T14:40:10.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.140+0000 7f20409ff700 1 -- start start 2023-07-27T14:40:10.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.141+0000 7f20409ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14ae00 0x7f203c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.141+0000 7f20409ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f203c14b1e0 0x7f203c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.141+0000 7f20409ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c1553f0 con 0x7f203c0c5c50 2023-07-27T14:40:10.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.141+0000 7f20409ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c157a50 con 0x7f203c14b1e0 2023-07-27T14:40:10.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.141+0000 7f20409ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c157d10 con 0x7f203c14ae00 2023-07-27T14:40:10.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.141+0000 7f2039d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f203c14b1e0 0x7f203c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.141+0000 7f203ad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f203c0c5c50 0x7f203c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34844/0 (socket says 172.21.15.115:34844) 2023-07-27T14:40:10.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.141+0000 7f203ad9d700 1 -- 172.21.15.115:0/3083915358 learned_addr learned my addr 172.21.15.115:0/3083915358 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:10.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f203a59c700 1 --2- 172.21.15.115:0/3083915358 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14ae00 0x7f203c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f2039d9b700 1 -- 172.21.15.115:0/3083915358 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14ae00 msgr2=0x7f203c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:10.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f2039d9b700 1 --2- 172.21.15.115:0/3083915358 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14ae00 0x7f203c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f2039d9b700 1 -- 172.21.15.115:0/3083915358 >> v1:172.21.15.115:6789/0 conn(0x7f203c0c5c50 legacy=0x7f203c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f203959a700 1 -- 172.21.15.115:0/3083915358 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836898575 0 0) 0x7f203c1553f0 con 0x7f203c0c5c50 2023-07-27T14:40:10.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f2039d9b700 1 -- 172.21.15.115:0/3083915358 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c157ff0 con 0x7f203c14b1e0 2023-07-27T14:40:10.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f2039d9b700 1 --2- 172.21.15.115:0/3083915358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14b1e0 0x7f203c062b50 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 rx=0x7f2030009760 tx=0x7f2030009060).ready entity=mon.0 client_cookie=d8e77a22266c6474 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:10.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f203959a700 1 -- 172.21.15.115:0/3083915358 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000f510 con 0x7f203c14b1e0 2023-07-27T14:40:10.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f203959a700 1 -- 172.21.15.115:0/3083915358 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203000f670 con 0x7f203c14b1e0 2023-07-27T14:40:10.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.142+0000 7f203959a700 1 -- 172.21.15.115:0/3083915358 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000f9f0 con 0x7f203c14b1e0 2023-07-27T14:40:10.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.143+0000 7f20409ff700 1 -- 172.21.15.115:0/3083915358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14b1e0 msgr2=0x7f203c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.143+0000 7f20409ff700 1 --2- 172.21.15.115:0/3083915358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14b1e0 0x7f203c062b50 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 rx=0x7f2030009760 tx=0x7f2030009060).stop 2023-07-27T14:40:10.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.143+0000 7f20409ff700 1 -- 172.21.15.115:0/3083915358 shutdown_connections 2023-07-27T14:40:10.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.143+0000 7f20409ff700 1 --2- 172.21.15.115:0/3083915358 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14ae00 0x7f203c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.143+0000 7f20409ff700 1 --2- 172.21.15.115:0/3083915358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14b1e0 0x7f203c062b50 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.143+0000 7f20409ff700 1 -- 172.21.15.115:0/3083915358 >> 172.21.15.115:0/3083915358 conn(0x7f203c05e940 msgr2=0x7f203c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:10.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.143+0000 7f20409ff700 1 -- 172.21.15.115:0/3083915358 shutdown_connections 2023-07-27T14:40:10.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.143+0000 7f20409ff700 1 -- 172.21.15.115:0/3083915358 wait complete. 2023-07-27T14:40:10.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.144+0000 7f20409ff700 1 Processor -- start 2023-07-27T14:40:10.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.145+0000 7f20409ff700 1 -- start start 2023-07-27T14:40:10.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f20409ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f203c0c5c50 0x7f203c149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f20409ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14ae00 0x7f203c0c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f20409ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14b1e0 0x7f203c0c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f20409ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0b06c0 con 0x7f203c14ae00 2023-07-27T14:40:10.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f20409ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0afab0 con 0x7f203c0c5c50 2023-07-27T14:40:10.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f20409ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0afd90 con 0x7f203c14b1e0 2023-07-27T14:40:10.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14ae00 0x7f203c0c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14ae00 0x7f203c0c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50608/0 (socket says 172.21.15.115:50608) 2023-07-27T14:40:10.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 -- 172.21.15.115:0/1463252319 learned_addr learned my addr 172.21.15.115:0/1463252319 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:10.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 -- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14b1e0 msgr2=0x7f203c0c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f203ad9d700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14b1e0 0x7f203c0c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f203a59c700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f203c0c5c50 0x7f203c149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14b1e0 0x7f203c0c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 -- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f203c0c5c50 msgr2=0x7f203c149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f203c0c5c50 0x7f203c149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 -- 172.21.15.115:0/1463252319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300092a0 con 0x7f203c14ae00 2023-07-27T14:40:10.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f203a59c700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f203c0c5c50 0x7f203c149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:10.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f203ad9d700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14b1e0 0x7f203c0c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:10.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.146+0000 7f2039d9b700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14ae00 0x7f203c0c3090 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 rx=0x7f203c0c53b0 tx=0x7f2030017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:10.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.147+0000 7f202a7fc700 1 -- 172.21.15.115:0/1463252319 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000f7e0 con 0x7f203c14ae00 2023-07-27T14:40:10.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.147+0000 7f202a7fc700 1 -- 172.21.15.115:0/1463252319 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203000f940 con 0x7f203c14ae00 2023-07-27T14:40:10.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.147+0000 7f202a7fc700 1 -- 172.21.15.115:0/1463252319 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203001c670 con 0x7f203c14ae00 2023-07-27T14:40:10.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.147+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c0b0070 con 0x7f203c14ae00 2023-07-27T14:40:10.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.147+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c14a050 con 0x7f203c14ae00 2023-07-27T14:40:10.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.148+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c0b0830 con 0x7f203c14ae00 2023-07-27T14:40:10.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.149+0000 7f202a7fc700 1 -- 172.21.15.115:0/1463252319 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f203000f070 con 0x7f203c14ae00 2023-07-27T14:40:10.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.149+0000 7f202a7fc700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f201c05fcf0 0x7f201c0621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.149+0000 7f202a7fc700 1 -- 172.21.15.115:0/1463252319 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f203007ca20 con 0x7f203c14ae00 2023-07-27T14:40:10.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.150+0000 7f203a59c700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f201c05fcf0 0x7f201c0621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.150+0000 7f203a59c700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f201c05fcf0 0x7f201c0621b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f202c006d80 tx=0x7f202c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:10.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.154+0000 7f202a7fc700 1 -- 172.21.15.115:0/1463252319 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f203004d010 con 0x7f203c14ae00 2023-07-27T14:40:10.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.383+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f203c0b0510 con 0x7f203c14ae00 2023-07-27T14:40:10.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.387+0000 7f202a7fc700 1 -- 172.21.15.115:0/1463252319 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7f20300200e0 con 0x7f203c14ae00 2023-07-27T14:40:10.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f201c05fcf0 msgr2=0x7f201c0621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f201c05fcf0 0x7f201c0621b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f202c006d80 tx=0x7f202c008040).stop 2023-07-27T14:40:10.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14ae00 msgr2=0x7f203c0c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14ae00 0x7f203c0c3090 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 rx=0x7f203c0c53b0 tx=0x7f2030017000).stop 2023-07-27T14:40:10.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 shutdown_connections 2023-07-27T14:40:10.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f201c05fcf0 0x7f201c0621b0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f203c14b1e0 0x7f203c0c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f203c0c5c50 0x7f203c149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 --2- 172.21.15.115:0/1463252319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f203c14ae00 0x7f203c0c3090 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 >> 172.21.15.115:0/1463252319 conn(0x7f203c05e940 msgr2=0x7f203c0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:10.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 shutdown_connections 2023-07-27T14:40:10.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.389+0000 7f20409ff700 1 -- 172.21.15.115:0/1463252319 wait complete. 2023-07-27T14:40:10.447 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:40:10.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:40:10.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.594+0000 7f980bdff700 1 Processor -- start 2023-07-27T14:40:10.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.594+0000 7f980bdff700 1 -- start start 2023-07-27T14:40:10.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f980bdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9804153ec0 0x7f98040a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f980bdff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f98040aa050 0x7f98040640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f980bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aaa40 0x7f98040645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f980bdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9804064ad0 con 0x7f9804153ec0 2023-07-27T14:40:10.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f980bdff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98040aa4d0 con 0x7f98040aa050 2023-07-27T14:40:10.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f980bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98040c05c0 con 0x7f98040aaa40 2023-07-27T14:40:10.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f9809b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9804153ec0 0x7f98040a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f9809b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9804153ec0 0x7f98040a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50614/0 (socket says 172.21.15.115:50614) 2023-07-27T14:40:10.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.595+0000 7f9809b9b700 1 -- 172.21.15.115:0/3111308514 learned_addr learned my addr 172.21.15.115:0/3111308514 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:10.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f980939a700 1 --2- 172.21.15.115:0/3111308514 >> v2:172.21.15.159:3300/0 conn(0x7f98040aa050 0x7f98040640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f980a39c700 1 --2- 172.21.15.115:0/3111308514 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aaa40 0x7f98040645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9809b9b700 1 -- 172.21.15.115:0/3111308514 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aaa40 msgr2=0x7f98040645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:10.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9809b9b700 1 --2- 172.21.15.115:0/3111308514 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aaa40 0x7f98040645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9809b9b700 1 -- 172.21.15.115:0/3111308514 >> v2:172.21.15.159:3300/0 conn(0x7f98040aa050 msgr2=0x7f98040640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:10.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9809b9b700 1 --2- 172.21.15.115:0/3111308514 >> v2:172.21.15.159:3300/0 conn(0x7f98040aa050 0x7f98040640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9809b9b700 1 -- 172.21.15.115:0/3111308514 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040bfc90 con 0x7f9804153ec0 2023-07-27T14:40:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9809b9b700 1 --2- 172.21.15.115:0/3111308514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f98040a9b60 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 rx=0x7f980406c0d0 tx=0x7f98000090f0).ready entity=mon.0 client_cookie=449a70e7dc6c6662 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9808b99700 1 -- 172.21.15.115:0/3111308514 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000f510 con 0x7f9804153ec0 2023-07-27T14:40:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9808b99700 1 -- 172.21.15.115:0/3111308514 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000f670 con 0x7f9804153ec0 2023-07-27T14:40:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.596+0000 7f9808b99700 1 -- 172.21.15.115:0/3111308514 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000fa10 con 0x7f9804153ec0 2023-07-27T14:40:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 -- 172.21.15.115:0/3111308514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 msgr2=0x7f98040a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 --2- 172.21.15.115:0/3111308514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f98040a9b60 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 rx=0x7f980406c0d0 tx=0x7f98000090f0).stop 2023-07-27T14:40:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 -- 172.21.15.115:0/3111308514 shutdown_connections 2023-07-27T14:40:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 --2- 172.21.15.115:0/3111308514 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aaa40 0x7f98040645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 --2- 172.21.15.115:0/3111308514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f98040a9b60 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 --2- 172.21.15.115:0/3111308514 >> v2:172.21.15.159:3300/0 conn(0x7f98040aa050 0x7f98040640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 -- 172.21.15.115:0/3111308514 >> 172.21.15.115:0/3111308514 conn(0x7f98040cb610 msgr2=0x7f98040c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:10.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 -- 172.21.15.115:0/3111308514 shutdown_connections 2023-07-27T14:40:10.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.597+0000 7f980bdff700 1 -- 172.21.15.115:0/3111308514 wait complete. 2023-07-27T14:40:10.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.599+0000 7f980bdff700 1 Processor -- start 2023-07-27T14:40:10.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.599+0000 7f980bdff700 1 -- start start 2023-07-27T14:40:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980bdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aa050 0x7f9804153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980bdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98040aaa40 0x7f98040c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980bdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f9804150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980bdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98040c2460 con 0x7f9804153ec0 2023-07-27T14:40:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980bdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98040c2740 con 0x7f98040aaa40 2023-07-27T14:40:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980bdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98040c2a20 con 0x7f98040aa050 2023-07-27T14:40:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980a39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f9804150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980a39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f9804150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50616/0 (socket says 172.21.15.115:50616) 2023-07-27T14:40:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980a39c700 1 -- 172.21.15.115:0/4037017571 learned_addr learned my addr 172.21.15.115:0/4037017571 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f9809b9b700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aa050 0x7f9804153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980939a700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98040aaa40 0x7f98040c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980a39c700 1 -- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aa050 msgr2=0x7f9804153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980a39c700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aa050 0x7f9804153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980a39c700 1 -- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98040aaa40 msgr2=0x7f98040c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.600+0000 7f980a39c700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98040aaa40 0x7f98040c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.601+0000 7f980a39c700 1 -- 172.21.15.115:0/4037017571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800009370 con 0x7f9804153ec0 2023-07-27T14:40:10.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.601+0000 7f980939a700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98040aaa40 0x7f98040c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:10.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.601+0000 7f980a39c700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f9804150d50 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 rx=0x7f97fc009ec0 tx=0x7f97fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:10.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.601+0000 7f97f9ffb700 1 -- 172.21.15.115:0/4037017571 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00cc20 con 0x7f9804153ec0 2023-07-27T14:40:10.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.601+0000 7f97f9ffb700 1 -- 172.21.15.115:0/4037017571 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00f040 con 0x7f9804153ec0 2023-07-27T14:40:10.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.601+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98040c2d00 con 0x7f9804153ec0 2023-07-27T14:40:10.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.601+0000 7f97f9ffb700 1 -- 172.21.15.115:0/4037017571 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc013400 con 0x7f9804153ec0 2023-07-27T14:40:10.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.601+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040c2120 con 0x7f9804153ec0 2023-07-27T14:40:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.602+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98040c3220 con 0x7f9804153ec0 2023-07-27T14:40:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.603+0000 7f97f9ffb700 1 -- 172.21.15.115:0/4037017571 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f97fc013770 con 0x7f9804153ec0 2023-07-27T14:40:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.604+0000 7f97f9ffb700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97e805fcc0 0x7f97e8062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.604+0000 7f97f9ffb700 1 -- 172.21.15.115:0/4037017571 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f97fc07bdd0 con 0x7f9804153ec0 2023-07-27T14:40:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.604+0000 7f9809b9b700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97e805fcc0 0x7f97e8062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.604+0000 7f9809b9b700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97e805fcc0 0x7f97e8062180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f980406c0d0 tx=0x7f9800017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.608+0000 7f97f9ffb700 1 -- 172.21.15.115:0/4037017571 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f97fc04c310 con 0x7f9804153ec0 2023-07-27T14:40:10.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.819+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98040bff70 con 0x7f9804153ec0 2023-07-27T14:40:10.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.820+0000 7f97f9ffb700 1 -- 172.21.15.115:0/4037017571 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4515 (secure 0 0 0) 0x7f97fc04f930 con 0x7f9804153ec0 2023-07-27T14:40:10.875 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:10.876 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":112,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3608226418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3608226418},{"type":"v1","addr":"172.21.15.115:6837","nonce":3608226418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":9118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3601251920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3601251920},{"type":"v1","addr":"172.21.15.159:6835","nonce":3601251920}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":10386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3139755816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3139755816},{"type":"v1","addr":"172.21.15.115:6835","nonce":3139755816}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:40:00.408365+0000","modified":"2023-07-27T14:40:03.430962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10389":{"gid":10389,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/1326270023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1326270023},{"type":"v1","addr":"172.21.15.159:6834","nonce":1326270023}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-07-27T14:40:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97e805fcc0 msgr2=0x7f97e8062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97e805fcc0 0x7f97e8062180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f980406c0d0 tx=0x7f9800017000).stop 2023-07-27T14:40:10.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 msgr2=0x7f9804150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:10.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f9804150d50 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 rx=0x7f97fc009ec0 tx=0x7f97fc00b040).stop 2023-07-27T14:40:10.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 shutdown_connections 2023-07-27T14:40:10.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f97e805fcc0 0x7f97e8062180 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9804153ec0 0x7f9804150d50 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98040aa050 0x7f9804153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 --2- 172.21.15.115:0/4037017571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98040aaa40 0x7f98040c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:10.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 >> 172.21.15.115:0/4037017571 conn(0x7f98040cb610 msgr2=0x7f98040c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:10.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 shutdown_connections 2023-07-27T14:40:10.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:10.822+0000 7f980bdff700 1 -- 172.21.15.115:0/4037017571 wait complete. 2023-07-27T14:40:10.880 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 112 2023-07-27T14:40:11.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:40:00.408365+0000', 'modified': '2023-07-27T14:40:03.430962+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10389': {'gid': 10389, 'name': 'd', 'rank': 0, 'incarnation': 108, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6834/1326270023', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6832', 'nonce': 1326270023}, {'type': 'v1', 'addr': '172.21.15.159:6834', 'nonce': 1326270023}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:40:11.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:40:11.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-27T14:40:11.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.434+0000 7f97751ff700 1 Processor -- start 2023-07-27T14:40:11.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.434+0000 7f97751ff700 1 -- start start 2023-07-27T14:40:11.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f97751ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9770153ec0 0x7f97700a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f97751ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f97751ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97700aa4d0 con 0x7f97700aa050 2023-07-27T14:40:11.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f97751ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97700c05c0 con 0x7f9770153ec0 2023-07-27T14:40:11.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f97751ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700bfc90 con 0x7f97700aaa40 2023-07-27T14:40:11.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f976f59e700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f976e59c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f97700aa050 0x7f97700640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:34012/0 (socket says 172.21.15.115:34012) 2023-07-27T14:40:11.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f976e59c700 1 -- 172.21.15.115:0/4212565210 learned_addr learned my addr 172.21.15.115:0/4212565210 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:11.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f976f59e700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:34262/0 (socket says 172.21.15.115:34262) 2023-07-27T14:40:11.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.436+0000 7f976ed9d700 1 --2- 172.21.15.115:0/4212565210 >> v2:172.21.15.159:3300/0 conn(0x7f9770153ec0 0x7f97700a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976dd9b700 1 -- 172.21.15.115:0/4212565210 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908790039 0 0) 0x7f9764001110 con 0x7f97700aa050 2023-07-27T14:40:11.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976dd9b700 1 -- 172.21.15.115:0/4212565210 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97580033f0 con 0x7f97700aa050 2023-07-27T14:40:11.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976f59e700 1 -- 172.21.15.115:0/4212565210 >> v2:172.21.15.159:3300/0 conn(0x7f9770153ec0 msgr2=0x7f97700a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976f59e700 1 --2- 172.21.15.115:0/4212565210 >> v2:172.21.15.159:3300/0 conn(0x7f9770153ec0 0x7f97700a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976f59e700 1 -- 172.21.15.115:0/4212565210 >> v1:172.21.15.159:6789/0 conn(0x7f97700aa050 legacy=0x7f97700640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976f59e700 1 -- 172.21.15.115:0/4212565210 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97700bff70 con 0x7f97700aaa40 2023-07-27T14:40:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976ed9d700 1 --2- 172.21.15.115:0/4212565210 >> v2:172.21.15.159:3300/0 conn(0x7f9770153ec0 0x7f97700a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976f59e700 1 --2- 172.21.15.115:0/4212565210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c0a50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f9768009e60 tx=0x7f9768009780).ready entity=mon.2 client_cookie=6cecb6d89dff5c0e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976dd9b700 1 -- 172.21.15.115:0/4212565210 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800e070 con 0x7f97700aaa40 2023-07-27T14:40:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976dd9b700 1 -- 172.21.15.115:0/4212565210 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976800bab0 con 0x7f97700aaa40 2023-07-27T14:40:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.437+0000 7f976dd9b700 1 -- 172.21.15.115:0/4212565210 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800be30 con 0x7f97700aaa40 2023-07-27T14:40:11.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.438+0000 7f97751ff700 1 -- 172.21.15.115:0/4212565210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 msgr2=0x7f97700c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.438+0000 7f97751ff700 1 --2- 172.21.15.115:0/4212565210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c0a50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f9768009e60 tx=0x7f9768009780).stop 2023-07-27T14:40:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.438+0000 7f97751ff700 1 -- 172.21.15.115:0/4212565210 shutdown_connections 2023-07-27T14:40:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.438+0000 7f97751ff700 1 --2- 172.21.15.115:0/4212565210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c0a50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.438+0000 7f97751ff700 1 --2- 172.21.15.115:0/4212565210 >> v2:172.21.15.159:3300/0 conn(0x7f9770153ec0 0x7f97700a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.438+0000 7f97751ff700 1 -- 172.21.15.115:0/4212565210 >> 172.21.15.115:0/4212565210 conn(0x7f97700cb610 msgr2=0x7f97700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.438+0000 7f97751ff700 1 -- 172.21.15.115:0/4212565210 shutdown_connections 2023-07-27T14:40:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.438+0000 7f97751ff700 1 -- 172.21.15.115:0/4212565210 wait complete. 2023-07-27T14:40:11.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.439+0000 7f97751ff700 1 Processor -- start 2023-07-27T14:40:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.439+0000 7f97751ff700 1 -- start start 2023-07-27T14:40:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.440+0000 7f97751ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97700aa050 0x7f977014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.440+0000 7f97751ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.440+0000 7f97751ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9770153ec0 0x7f97701648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.440+0000 7f97751ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700c2120 con 0x7f9770153ec0 2023-07-27T14:40:11.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.440+0000 7f97751ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97701515e0 con 0x7f97700aa050 2023-07-27T14:40:11.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.440+0000 7f97751ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9770164dd0 con 0x7f97700aaa40 2023-07-27T14:40:11.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9770153ec0 0x7f97701648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9770153ec0 0x7f97701648e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50624/0 (socket says 172.21.15.115:50624) 2023-07-27T14:40:11.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 -- 172.21.15.115:0/983502982 learned_addr learned my addr 172.21.15.115:0/983502982 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976e59c700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976ed9d700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97700aa050 0x7f977014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 -- 172.21.15.115:0/983502982 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 msgr2=0x7f97700c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 -- 172.21.15.115:0/983502982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97700aa050 msgr2=0x7f977014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97700aa050 0x7f977014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 -- 172.21.15.115:0/983502982 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600092a0 con 0x7f9770153ec0 2023-07-27T14:40:11.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f976f59e700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9770153ec0 0x7f97701648e0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 rx=0x7f97700bfdd0 tx=0x7f9768009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.441+0000 7f9756ffd700 1 -- 172.21.15.115:0/983502982 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976801d630 con 0x7f9770153ec0 2023-07-27T14:40:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.442+0000 7f9756ffd700 1 -- 172.21.15.115:0/983502982 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976801d790 con 0x7f9770153ec0 2023-07-27T14:40:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.442+0000 7f97751ff700 1 -- 172.21.15.115:0/983502982 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9768009a20 con 0x7f9770153ec0 2023-07-27T14:40:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.442+0000 7f9756ffd700 1 -- 172.21.15.115:0/983502982 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976801db50 con 0x7f9770153ec0 2023-07-27T14:40:11.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.442+0000 7f97751ff700 1 -- 172.21.15.115:0/983502982 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770151b30 con 0x7f9770153ec0 2023-07-27T14:40:11.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.444+0000 7f9756ffd700 1 -- 172.21.15.115:0/983502982 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f9768026410 con 0x7f9770153ec0 2023-07-27T14:40:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.445+0000 7f9756ffd700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f975c05fcc0 0x7f975c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.445+0000 7f9756ffd700 1 -- 172.21.15.115:0/983502982 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f976807d620 con 0x7f9770153ec0 2023-07-27T14:40:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.445+0000 7f976ed9d700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f975c05fcc0 0x7f975c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.446+0000 7f976ed9d700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f975c05fcc0 0x7f975c062180 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f9760009270 tx=0x7f9760008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.447+0000 7f978c5fcb80 1 Processor -- start 2023-07-27T14:40:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.447+0000 7f978c5fcb80 1 -- start start 2023-07-27T14:40:11.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843ac5c0 0x5653843ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843d4830 0x5653843facc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843aef60 0x5653843fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653842e99c0 con 0x5653843d4830 2023-07-27T14:40:11.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653842fecc0 con 0x5653843ac5c0 2023-07-27T14:40:11.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653842c5e10 con 0x5653843aef60 2023-07-27T14:40:11.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f976e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843d4830 0x5653843facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f976e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843d4830 0x5653843facc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50630/0 (socket says 172.21.15.115:50630) 2023-07-27T14:40:11.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.448+0000 7f976e59c700 1 -- 172.21.15.115:0/1221023430 learned_addr learned my addr 172.21.15.115:0/1221023430 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:11.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f976f59e700 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843aef60 0x5653843fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f976ed9d700 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843ac5c0 0x5653843ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f976e59c700 1 -- 172.21.15.115:0/1221023430 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843aef60 msgr2=0x5653843fb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f976e59c700 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843aef60 0x5653843fb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f976e59c700 1 -- 172.21.15.115:0/1221023430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843ac5c0 msgr2=0x5653843ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f976e59c700 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843ac5c0 0x5653843ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f976e59c700 1 -- 172.21.15.115:0/1221023430 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653842f79a0 con 0x5653843d4830 2023-07-27T14:40:11.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f976e59c700 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843d4830 0x5653843facc0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 rx=0x7f9764001570 tx=0x7f9764009040).ready entity=mon.0 client_cookie=71b8801548e1c39c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f974ffff700 1 -- 172.21.15.115:0/1221023430 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640070d0 con 0x5653843d4830 2023-07-27T14:40:11.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f974ffff700 1 -- 172.21.15.115:0/1221023430 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764007230 con 0x5653843d4830 2023-07-27T14:40:11.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.449+0000 7f974ffff700 1 -- 172.21.15.115:0/1221023430 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640075b0 con 0x5653843d4830 2023-07-27T14:40:11.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 -- 172.21.15.115:0/1221023430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843d4830 msgr2=0x5653843facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843d4830 0x5653843facc0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 rx=0x7f9764001570 tx=0x7f9764009040).stop 2023-07-27T14:40:11.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 -- 172.21.15.115:0/1221023430 shutdown_connections 2023-07-27T14:40:11.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843aef60 0x5653843fb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843ac5c0 0x5653843ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/1221023430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843d4830 0x5653843facc0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 -- 172.21.15.115:0/1221023430 >> 172.21.15.115:0/1221023430 conn(0x565384217940 msgr2=0x5653843f56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:11.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 -- 172.21.15.115:0/1221023430 shutdown_connections 2023-07-27T14:40:11.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.450+0000 7f978c5fcb80 1 -- 172.21.15.115:0/1221023430 wait complete. 2023-07-27T14:40:11.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.451+0000 7f978c5fcb80 1 -- start start 2023-07-27T14:40:11.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.451+0000 7f978c5fcb80 1 Processor -- start 2023-07-27T14:40:11.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843aef60 0x5653843daef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843db3e0 0x5653843d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653843d5e20 con 0x5653843aef60 2023-07-27T14:40:11.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653843d7580 con 0x5653843db3e0 2023-07-27T14:40:11.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653843d51a0 con 0x5653843ac5c0 2023-07-27T14:40:11.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f978c5fcb80 10 client.0 ll_register_callbacks cb 0x5653842b14a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:40:11.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f976e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843aef60 0x5653843daef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f976e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843aef60 0x5653843daef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50644/0 (socket says 172.21.15.115:50644) 2023-07-27T14:40:11.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f976e59c700 1 -- 172.21.15.115:0/897696247 learned_addr learned my addr 172.21.15.115:0/897696247 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:11.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f976ed9d700 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.453+0000 7f976f59e700 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843db3e0 0x5653843d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f976e59c700 1 -- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 msgr2=0x5653843cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f976e59c700 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f976e59c700 1 -- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843db3e0 msgr2=0x5653843d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f976e59c700 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843db3e0 0x5653843d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f976e59c700 1 -- 172.21.15.115:0/897696247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976400f040 con 0x5653843aef60 2023-07-27T14:40:11.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f976f59e700 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843db3e0 0x5653843d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:11.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f976e59c700 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843aef60 0x5653843daef0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 rx=0x5653843d8420 tx=0x7f9764009040).ready entity=mon.0 client_cookie=843b62d21cbe59e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f974d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:40:11.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f974d7fa700 1 -- 172.21.15.115:0/897696247 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640070d0 con 0x5653843aef60 2023-07-27T14:40:11.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f974d7fa700 1 -- 172.21.15.115:0/897696247 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f9764023cd0 con 0x5653843aef60 2023-07-27T14:40:11.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f978c5fcb80 1 -- 172.21.15.115:0/897696247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653843a6d50 con 0x5653843aef60 2023-07-27T14:40:11.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f974d7fa700 1 -- 172.21.15.115:0/897696247 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9764023e90 con 0x5653843aef60 2023-07-27T14:40:11.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f978c5fcb80 10 client.10557 fetch_fsmap learned FSMap version 112 2023-07-27T14:40:11.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f978c5fcb80 1 -- 172.21.15.115:0/897696247 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x5653842f3190 con 0x5653843aef60 2023-07-27T14:40:11.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f974d7fa700 1 -- 172.21.15.115:0/897696247 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653843a6d50 con 0x5653843aef60 2023-07-27T14:40:11.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f974d7fa700 1 -- 172.21.15.115:0/897696247 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 112) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9764005450 con 0x5653843aef60 2023-07-27T14:40:11.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f978c5fcb80 10 client.10557 fetch_fsmap finished waiting for FSMap version 112 2023-07-27T14:40:11.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f978c5fcb80 10 client.10557 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-27T14:40:11.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.454+0000 7f978c5fcb80 20 client.10557 populate_metadata read hostname 'smithi115' 2023-07-27T14:40:11.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.455+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] conn(0x5653843be050 0x5653843f3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.455+0000 7f978c5fcb80 4 client.10557 mds_command: new command op to 10389 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:40:11.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.455+0000 7f978c5fcb80 1 -- 172.21.15.115:0/897696247 --> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565384167ef0 con 0x5653843be050 2023-07-27T14:40:11.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.455+0000 7f976ed9d700 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] conn(0x5653843be050 0x5653843f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.455+0000 7f974d7fa700 10 client.10557 ms_handle_connect on v2:172.21.15.159:6832/1326270023 2023-07-27T14:40:11.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.455+0000 7f976ed9d700 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] conn(0x5653843be050 0x5653843f3230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c5eba6f04c8e6ce1 server_cookie=8cb2c45e262b3909 in_seq=0 out_seq=0 2023-07-27T14:40:11.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.456+0000 7f974d7fa700 1 -- 172.21.15.115:0/897696247 <== mds.0 v2:172.21.15.159:6832/1326270023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x565384167ef0 con 0x5653843be050 2023-07-27T14:40:11.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.456+0000 7f974d7fa700 10 client.10557 handle_command_reply: tid=0 2023-07-27T14:40:11.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 client.10557 shutdown 2023-07-27T14:40:11.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 -- 172.21.15.115:0/897696247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843aef60 msgr2=0x5653843daef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843aef60 0x5653843daef0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 rx=0x5653843d8420 tx=0x7f9764009040).stop 2023-07-27T14:40:11.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 -- 172.21.15.115:0/897696247 shutdown_connections 2023-07-27T14:40:11.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] conn(0x5653843be050 0x5653843f3230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843db3e0 0x5653843d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/897696247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843aef60 0x5653843daef0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 -- 172.21.15.115:0/897696247 >> 172.21.15.115:0/897696247 conn(0x565384217940 msgr2=0x5653843a7550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:11.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f974d7fa700 0 client.10557 ms_handle_reset on v2:172.21.15.159:6832/1326270023 2023-07-27T14:40:11.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 -- 172.21.15.115:0/897696247 shutdown_connections 2023-07-27T14:40:11.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 1 -- 172.21.15.115:0/897696247 wait complete. 2023-07-27T14:40:11.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.457+0000 7f978c5fcb80 20 client.10557 trim_cache size 0 max 16384 2023-07-27T14:40:11.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.474+0000 7f978c5fcb80 1 Processor -- start 2023-07-27T14:40:11.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.474+0000 7f978c5fcb80 1 -- start start 2023-07-27T14:40:11.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843d76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x5653843a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653843a96a0 con 0x5653843db3e0 2023-07-27T14:40:11.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653843d97b0 con 0x5653843aef60 2023-07-27T14:40:11.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653843a0e70 con 0x5653843ac5c0 2023-07-27T14:40:11.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f976f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x5653843a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f976f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x5653843a7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50652/0 (socket says 172.21.15.115:50652) 2023-07-27T14:40:11.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f976f59e700 1 -- 172.21.15.115:0/268087439 learned_addr learned my addr 172.21.15.115:0/268087439 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:11.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f976f59e700 1 -- 172.21.15.115:0/268087439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 msgr2=0x5653843d76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f976f59e700 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843d76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:11.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f976f59e700 1 -- 172.21.15.115:0/268087439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 msgr2=0x5653843a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.475+0000 7f976e59c700 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f976f59e700 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f976f59e700 1 -- 172.21.15.115:0/268087439 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653842f2ee0 con 0x5653843db3e0 2023-07-27T14:40:11.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f976e59c700 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:11.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f976f59e700 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x5653843a7c90 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 rx=0x7f976800b670 tx=0x7f976807d040).ready entity=mon.0 client_cookie=261bd1a7c053fb4e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f97549ff700 1 -- 172.21.15.115:0/268087439 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768056f00 con 0x5653843db3e0 2023-07-27T14:40:11.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f97549ff700 1 -- 172.21.15.115:0/268087439 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976804fb60 con 0x5653843db3e0 2023-07-27T14:40:11.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f97549ff700 1 -- 172.21.15.115:0/268087439 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976804ded0 con 0x5653843db3e0 2023-07-27T14:40:11.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 -- 172.21.15.115:0/268087439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 msgr2=0x5653843a7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x5653843a7c90 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 rx=0x7f976800b670 tx=0x7f976807d040).stop 2023-07-27T14:40:11.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 -- 172.21.15.115:0/268087439 shutdown_connections 2023-07-27T14:40:11.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x5653843a7c90 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843d76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:11.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/268087439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 -- 172.21.15.115:0/268087439 >> 172.21.15.115:0/268087439 conn(0x565384217940 msgr2=0x5653844035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:11.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 -- 172.21.15.115:0/268087439 shutdown_connections 2023-07-27T14:40:11.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.476+0000 7f978c5fcb80 1 -- 172.21.15.115:0/268087439 wait complete. 2023-07-27T14:40:11.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.477+0000 7f978c5fcb80 1 -- start start 2023-07-27T14:40:11.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.477+0000 7f978c5fcb80 1 Processor -- start 2023-07-27T14:40:11.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.478+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843da2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.478+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843da790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.478+0000 7f978c5fcb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x565384457010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.478+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653843a9c60 con 0x5653843db3e0 2023-07-27T14:40:11.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.478+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653843dac80 con 0x5653843aef60 2023-07-27T14:40:11.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.478+0000 7f978c5fcb80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653843d3e60 con 0x5653843ac5c0 2023-07-27T14:40:11.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.478+0000 7f978c5fcb80 10 client.0 ll_register_callbacks cb 0x5653842b14a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:40:11.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.478+0000 7f976f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x565384457010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x565384457010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50668/0 (socket says 172.21.15.115:50668) 2023-07-27T14:40:11.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976f59e700 1 -- 172.21.15.115:0/4222878414 learned_addr learned my addr 172.21.15.115:0/4222878414 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:11.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976e59c700 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843da790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976ed9d700 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843da2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976f59e700 1 -- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 msgr2=0x5653843da2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976f59e700 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843da2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976f59e700 1 -- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 msgr2=0x5653843da790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976f59e700 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843da790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976f59e700 1 -- 172.21.15.115:0/4222878414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770151b30 con 0x5653843db3e0 2023-07-27T14:40:11.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f976f59e700 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x565384457010 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 rx=0x7f976802f000 tx=0x7f9768035000).ready entity=mon.0 client_cookie=8a9253466eeb7f90 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f974d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:40:11.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f974d7fa700 1 -- 172.21.15.115:0/4222878414 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976804ded0 con 0x5653843db3e0 2023-07-27T14:40:11.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f974d7fa700 1 -- 172.21.15.115:0/4222878414 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f976804e030 con 0x5653843db3e0 2023-07-27T14:40:11.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f978c5fcb80 1 -- 172.21.15.115:0/4222878414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9764007230 con 0x5653843db3e0 2023-07-27T14:40:11.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f974d7fa700 1 -- 172.21.15.115:0/4222878414 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f976804d7c0 con 0x5653843db3e0 2023-07-27T14:40:11.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f978c5fcb80 10 client.10563 fetch_fsmap learned FSMap version 112 2023-07-27T14:40:11.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.479+0000 7f978c5fcb80 1 -- 172.21.15.115:0/4222878414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x56538416d1d0 con 0x5653843db3e0 2023-07-27T14:40:11.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f974d7fa700 1 -- 172.21.15.115:0/4222878414 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764007230 con 0x5653843db3e0 2023-07-27T14:40:11.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f974d7fa700 1 -- 172.21.15.115:0/4222878414 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 112) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9768037020 con 0x5653843db3e0 2023-07-27T14:40:11.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f978c5fcb80 10 client.10563 fetch_fsmap finished waiting for FSMap version 112 2023-07-27T14:40:11.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f978c5fcb80 10 client.10563 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-27T14:40:11.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f978c5fcb80 20 client.10563 populate_metadata read hostname 'smithi115' 2023-07-27T14:40:11.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] conn(0x5653843a76f0 0x565384457500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f978c5fcb80 4 client.10563 mds_command: new command op to 10389 tid=0[{"prefix": "status"}] 2023-07-27T14:40:11.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f978c5fcb80 1 -- 172.21.15.115:0/4222878414 --> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56538419d040 con 0x5653843a76f0 2023-07-27T14:40:11.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.480+0000 7f976ed9d700 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] conn(0x5653843a76f0 0x565384457500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f976ed9d700 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] conn(0x5653843a76f0 0x565384457500 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ed5b373d49a5f43c server_cookie=3b7c7181600ed440 in_seq=0 out_seq=0 2023-07-27T14:40:11.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f974d7fa700 10 client.10563 ms_handle_connect on v2:172.21.15.159:6832/1326270023 2023-07-27T14:40:11.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f974d7fa700 1 -- 172.21.15.115:0/4222878414 <== mds.0 v2:172.21.15.159:6832/1326270023 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x56538419d040 con 0x5653843a76f0 2023-07-27T14:40:11.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f974d7fa700 10 client.10563 handle_command_reply: tid=0 2023-07-27T14:40:11.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 client.10563 shutdown 2023-07-27T14:40:11.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 -- 172.21.15.115:0/4222878414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 msgr2=0x565384457010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x565384457010 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 rx=0x7f976802f000 tx=0x7f9768035000).stop 2023-07-27T14:40:11.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 -- 172.21.15.115:0/4222878414 shutdown_connections 2023-07-27T14:40:11.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:6832/1326270023,v1:172.21.15.159:6834/1326270023] conn(0x5653843a76f0 0x565384457500 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653843db3e0 0x565384457010 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x5653843ac5c0 0x5653843da2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f974d7fa700 0 client.10563 ms_handle_reset on v2:172.21.15.159:6832/1326270023 2023-07-27T14:40:11.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 --2- 172.21.15.115:0/4222878414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5653843aef60 0x5653843da790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 -- 172.21.15.115:0/4222878414 >> 172.21.15.115:0/4222878414 conn(0x565384217940 msgr2=0x5653843d1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:11.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 -- 172.21.15.115:0/4222878414 shutdown_connections 2023-07-27T14:40:11.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 1 -- 172.21.15.115:0/4222878414 wait complete. 2023-07-27T14:40:11.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.481+0000 7f978c5fcb80 20 client.10563 trim_cache size 0 max 16384 2023-07-27T14:40:11.553 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:40:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:40:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:40:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 10389, 2023-07-27T14:40:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:40:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:40:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:40:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 11.069608326999999, 2023-07-27T14:40:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 112, 2023-07-27T14:40:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 205, 2023-07-27T14:40:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 205, 2023-07-27T14:40:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 16.289112595999999 2023-07-27T14:40:11.556 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:40:11.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 -- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f975c05fcc0 msgr2=0x7f975c062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f975c05fcc0 0x7f975c062180 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f9760009270 tx=0x7f9760008040).stop 2023-07-27T14:40:11.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 -- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9770153ec0 msgr2=0x7f97701648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9770153ec0 0x7f97701648e0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 rx=0x7f97700bfdd0 tx=0x7f9768009780).stop 2023-07-27T14:40:11.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 -- 172.21.15.115:0/983502982 shutdown_connections 2023-07-27T14:40:11.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f975c05fcc0 0x7f975c062180 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9770153ec0 0x7f97701648e0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97700aa050 0x7f977014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 --2- 172.21.15.115:0/983502982 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f97700aaa40 0x7f97700c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 -- 172.21.15.115:0/983502982 >> 172.21.15.115:0/983502982 conn(0x7f97700cb610 msgr2=0x7f97700c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:11.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 -- 172.21.15.115:0/983502982 shutdown_connections 2023-07-27T14:40:11.561 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.482+0000 7f97751ff700 1 -- 172.21.15.115:0/983502982 wait complete. 2023-07-27T14:40:11.562 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:40:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.665+0000 7f31945ff700 1 Processor -- start 2023-07-27T14:40:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.665+0000 7f31945ff700 1 -- start start 2023-07-27T14:40:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.666+0000 7f31945ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f318c154190 0x7f318c0a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.666+0000 7f31945ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c158e00 con 0x7f318c0648e0 2023-07-27T14:40:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.666+0000 7f31945ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c158040 con 0x7f318c0c64b0 2023-07-27T14:40:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.666+0000 7f31945ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0aa640 con 0x7f318c154190 2023-07-27T14:40:11.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3192b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f318c0648e0 0x7f318c154570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34846/0 (socket says 172.21.15.115:34846) 2023-07-27T14:40:11.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3192b9c700 1 -- 172.21.15.115:0/3000498302 learned_addr learned my addr 172.21.15.115:0/3000498302 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:11.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f319239b700 1 --2- 172.21.15.115:0/3000498302 >> v2:172.21.15.159:3300/0 conn(0x7f318c154190 0x7f318c0a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393510529 0 0) 0x7f318c158e00 con 0x7f318c0648e0 2023-07-27T14:40:11.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31780033f0 con 0x7f318c0648e0 2023-07-27T14:40:11.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224236717 0 0) 0x7f318c158040 con 0x7f318c0c64b0 2023-07-27T14:40:11.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f318c158e00 con 0x7f318c0c64b0 2023-07-27T14:40:11.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175704108 0 0) 0x7f31780033f0 con 0x7f318c0648e0 2023-07-27T14:40:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 >> v2:172.21.15.159:3300/0 conn(0x7f318c154190 msgr2=0x7f318c0a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 --2- 172.21.15.115:0/3000498302 >> v2:172.21.15.159:3300/0 conn(0x7f318c154190 0x7f318c0a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 >> v1:172.21.15.159:6789/0 conn(0x7f318c0c64b0 legacy=0x7f318c0641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c158320 con 0x7f318c0648e0 2023-07-27T14:40:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f31840017f0 con 0x7f318c0648e0 2023-07-27T14:40:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 >> v1:172.21.15.115:6789/0 conn(0x7f318c0648e0 legacy=0x7f318c154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3178003a70 0x7f3178003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f3178004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178005050 0x7f317800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0aa640 con 0x7f3178004690 2023-07-27T14:40:11.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317800bfc0 con 0x7f3178005050 2023-07-27T14:40:11.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.667+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317800c180 con 0x7f3178003a70 2023-07-27T14:40:11.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f319239b700 1 --2- 172.21.15.115:0/3000498302 >> v2:172.21.15.159:3300/0 conn(0x7f318c154190 0x7f318c0a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:11.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3191b9a700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f3178004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3192b9c700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178005050 0x7f317800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f319239b700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3178003a70 0x7f3178003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3191b9a700 1 -- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3178003a70 msgr2=0x7f3178003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3191b9a700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3178003a70 0x7f3178003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3191b9a700 1 -- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178005050 msgr2=0x7f317800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:11.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3191b9a700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178005050 0x7f317800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3191b9a700 1 -- 172.21.15.115:0/3000498302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31780033f0 con 0x7f3178004690 2023-07-27T14:40:11.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f319239b700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3178003a70 0x7f3178003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:11.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3192b9c700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178005050 0x7f317800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:11.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3192b9c700 1 -- 172.21.15.115:0/3000498302 reap_dead start 2023-07-27T14:40:11.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.668+0000 7f3191b9a700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f3178004b10 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 rx=0x7f317c001890 tx=0x7f317c007bb0).ready entity=mon.0 client_cookie=2362efe75b5d355e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c007020 con 0x7f3178004690 2023-07-27T14:40:11.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c007180 con 0x7f3178004690 2023-07-27T14:40:11.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f3191399700 1 -- 172.21.15.115:0/3000498302 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c007500 con 0x7f3178004690 2023-07-27T14:40:11.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f31945ff700 1 -- 172.21.15.115:0/3000498302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 msgr2=0x7f3178004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f31945ff700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f3178004b10 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 rx=0x7f317c001890 tx=0x7f317c007bb0).stop 2023-07-27T14:40:11.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f31945ff700 1 -- 172.21.15.115:0/3000498302 shutdown_connections 2023-07-27T14:40:11.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f31945ff700 1 --2- 172.21.15.115:0/3000498302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f3178004b10 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f31945ff700 1 -- 172.21.15.115:0/3000498302 >> 172.21.15.115:0/3000498302 conn(0x7f318c0cb730 msgr2=0x7f318c0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:11.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f31945ff700 1 -- 172.21.15.115:0/3000498302 shutdown_connections 2023-07-27T14:40:11.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.669+0000 7f31945ff700 1 -- 172.21.15.115:0/3000498302 wait complete. 2023-07-27T14:40:11.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.671+0000 7f31945ff700 1 Processor -- start 2023-07-27T14:40:11.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.671+0000 7f31945ff700 1 -- start start 2023-07-27T14:40:11.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f31945ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f318c1639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f31945ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f318c0c4690 0x7f318c0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f31945ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f318c0c4b10 0x7f318c0c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f31945ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0c3000 con 0x7f3178004690 2023-07-27T14:40:11.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f31945ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0abee0 con 0x7f318c0c4b10 2023-07-27T14:40:11.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f31945ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0ac170 con 0x7f318c0c4690 2023-07-27T14:40:11.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f319239b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f318c1639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f319239b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f318c1639b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50696/0 (socket says 172.21.15.115:50696) 2023-07-27T14:40:11.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f319239b700 1 -- 172.21.15.115:0/1395618701 learned_addr learned my addr 172.21.15.115:0/1395618701 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:11.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f3192b9c700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f318c0c4b10 0x7f318c0c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f3191b9a700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f318c0c4690 0x7f318c0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f319239b700 1 -- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f318c0c4690 msgr2=0x7f318c0c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f319239b700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f318c0c4690 0x7f318c0c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f319239b700 1 -- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f318c0c4b10 msgr2=0x7f318c0c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f319239b700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f318c0c4b10 0x7f318c0c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f319239b700 1 -- 172.21.15.115:0/1395618701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0ac450 con 0x7f3178004690 2023-07-27T14:40:11.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.672+0000 7f3191b9a700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f318c0c4690 0x7f318c0c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:11.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.673+0000 7f319239b700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f318c1639b0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 rx=0x7f3188011710 tx=0x7f3188008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.673+0000 7f31827fc700 1 -- 172.21.15.115:0/1395618701 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188015690 con 0x7f3178004690 2023-07-27T14:40:11.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.673+0000 7f31827fc700 1 -- 172.21.15.115:0/1395618701 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31880157f0 con 0x7f3178004690 2023-07-27T14:40:11.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.673+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c0ac730 con 0x7f3178004690 2023-07-27T14:40:11.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.673+0000 7f31827fc700 1 -- 172.21.15.115:0/1395618701 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188015b70 con 0x7f3178004690 2023-07-27T14:40:11.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.673+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c0accf0 con 0x7f3178004690 2023-07-27T14:40:11.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.674+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c0acee0 con 0x7f3178004690 2023-07-27T14:40:11.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.675+0000 7f31827fc700 1 -- 172.21.15.115:0/1395618701 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f3188025070 con 0x7f3178004690 2023-07-27T14:40:11.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.676+0000 7f31827fc700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f317005fcc0 0x7f3170062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:11.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.676+0000 7f31827fc700 1 -- 172.21.15.115:0/1395618701 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f318807baf0 con 0x7f3178004690 2023-07-27T14:40:11.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.676+0000 7f3191b9a700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f317005fcc0 0x7f3170062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:11.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.676+0000 7f3191b9a700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f317005fcc0 0x7f3170062180 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f318c0ab4b0 tx=0x7f317c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:11.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.680+0000 7f31827fc700 1 -- 172.21.15.115:0/1395618701 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f318804c0c0 con 0x7f3178004690 2023-07-27T14:40:11.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.895+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f318c05f0c0 con 0x7f3178004690 2023-07-27T14:40:11.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.896+0000 7f31827fc700 1 -- 172.21.15.115:0/1395618701 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v112) v1 ==== 53+0+73 (secure 0 0 0) 0x7f318807be60 con 0x7f3178004690 2023-07-27T14:40:11.951 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:40:11.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f317005fcc0 msgr2=0x7f3170062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f317005fcc0 0x7f3170062180 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f318c0ab4b0 tx=0x7f317c015000).stop 2023-07-27T14:40:11.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 msgr2=0x7f318c1639b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:11.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f318c1639b0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 rx=0x7f3188011710 tx=0x7f3188008040).stop 2023-07-27T14:40:11.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 shutdown_connections 2023-07-27T14:40:11.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f317005fcc0 0x7f3170062180 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f318c0c4b10 0x7f318c0c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3178004690 0x7f318c1639b0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 --2- 172.21.15.115:0/1395618701 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f318c0c4690 0x7f318c0c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:11.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 >> 172.21.15.115:0/1395618701 conn(0x7f318c0cb730 msgr2=0x7f318c1552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:11.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 shutdown_connections 2023-07-27T14:40:11.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:11.898+0000 7f31945ff700 1 -- 172.21.15.115:0/1395618701 wait complete. 2023-07-27T14:40:11.967 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:40:11.968 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:40:11.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:40:11.968 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:40:11.969 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:40:11.969 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:40:11.969 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:40:11.969 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:40:11.970 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:40:11.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:11.970 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:40:12.019 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:40:12.021 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:40:12.021 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:40:12.021 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:12.021 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:40:12.021 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:12.021 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:40:12.021 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:12.022 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:40:12.022 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:40:12.022 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:12.022 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:40:12.022 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:40:12.022 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:12.023 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:40:12.023 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:12.023 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:40:12.023 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41189sec preferred_lft 41189sec 2023-07-27T14:40:12.023 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:40:12.023 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:12.024 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:40:12.024 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:12.024 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:40:12.024 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:12.024 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:40:12.024 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:12.025 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:40:12.025 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:40:12.025 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:40:12.025 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:12.025 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:40:12.025 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:40:12.026 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:40:12.026 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:12.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:12.026 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:40:12.095 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:40:12.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:12.098 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:40:12.147 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:40:12.147 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:40:12.148 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:40:12.148 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:40:12.148 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:40:12.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:12.149 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:40:12.150 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:40:12.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:40:12.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:40:12.151 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:40:12.151 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:40:12.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:12.321 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:40:12.368 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:40:12.368 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:40:12.369 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:40:12.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:12.370 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:40:12.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:12.440 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:40:12.485 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:40:12.486 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:40:12.623 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:40:12.623 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:40:12.652 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:40:12.653 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:40:12.657 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:40:12.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:12.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:40:12.730 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:40:12.900 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.844+0000 7f6655fff700 1 Processor -- start 2023-07-27T14:40:12.901 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.845+0000 7f6655fff700 1 -- start start 2023-07-27T14:40:12.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f6655fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f66500c64b0 0x7f66500641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:12.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f6655fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:12.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f6655fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6650064b50 con 0x7f6650154190 2023-07-27T14:40:12.905 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f6655fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66500aa640 con 0x7f66500c64b0 2023-07-27T14:40:12.905 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f6655fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6650158e00 con 0x7f66500646c0 2023-07-27T14:40:12.905 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f664effd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f66500c64b0 0x7f66500641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:12.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f664ffff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:12.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f664effd700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f66500c64b0 0x7f66500641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46628/0 (socket says 172.21.15.159:46628) 2023-07-27T14:40:12.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f664effd700 1 -- 172.21.15.159:0/2638953428 learned_addr learned my addr 172.21.15.159:0/2638953428 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:40:12.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f664effd700 1 -- 172.21.15.159:0/2638953428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 msgr2=0x7f6650154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:12.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f664effd700 1 --2- 172.21.15.159:0/2638953428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:12.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f664effd700 1 -- 172.21.15.159:0/2638953428 >> v1:172.21.15.115:6789/0 conn(0x7f6650154190 legacy=0x7f66500a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:12.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.846+0000 7f664effd700 1 -- 172.21.15.159:0/2638953428 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650158040 con 0x7f66500c64b0 2023-07-27T14:40:12.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f664ffff700 1 --2- 172.21.15.159:0/2638953428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:12.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f664effd700 1 --2- 172.21.15.159:0/2638953428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 0x7f66500641d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f6644006fd0 tx=0x7f66440090f0).ready entity=mon.1 client_cookie=dea6dda8bfad02ba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:12.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f664e7fc700 1 -- 172.21.15.159:0/2638953428 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400b580 con 0x7f66500c64b0 2023-07-27T14:40:12.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f664e7fc700 1 -- 172.21.15.159:0/2638953428 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664400b6e0 con 0x7f66500c64b0 2023-07-27T14:40:12.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f664e7fc700 1 -- 172.21.15.159:0/2638953428 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400ba80 con 0x7f66500c64b0 2023-07-27T14:40:12.909 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f6655fff700 1 -- 172.21.15.159:0/2638953428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 msgr2=0x7f66500641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:12.909 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f6655fff700 1 --2- 172.21.15.159:0/2638953428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 0x7f66500641d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f6644006fd0 tx=0x7f66440090f0).stop 2023-07-27T14:40:12.909 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f6655fff700 1 -- 172.21.15.159:0/2638953428 shutdown_connections 2023-07-27T14:40:12.910 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f6655fff700 1 --2- 172.21.15.159:0/2638953428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:12.910 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f6655fff700 1 --2- 172.21.15.159:0/2638953428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 0x7f66500641d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:12.910 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.847+0000 7f6655fff700 1 -- 172.21.15.159:0/2638953428 >> 172.21.15.159:0/2638953428 conn(0x7f66500cb730 msgr2=0x7f66500c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:12.910 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.848+0000 7f6655fff700 1 -- 172.21.15.159:0/2638953428 shutdown_connections 2023-07-27T14:40:12.910 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.848+0000 7f6655fff700 1 -- 172.21.15.159:0/2638953428 wait complete. 2023-07-27T14:40:12.912 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.849+0000 7f6655fff700 1 Processor -- start 2023-07-27T14:40:12.913 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.849+0000 7f6655fff700 1 -- start start 2023-07-27T14:40:12.913 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f6655fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:12.913 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f6655fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 0x7f6650154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:12.913 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f6655fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6650154190 0x7f6650154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:12.914 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f6655fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66501554a0 con 0x7f6650154190 2023-07-27T14:40:12.914 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f6655fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500c1dd0 con 0x7f66500c64b0 2023-07-27T14:40:12.914 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f6655fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500c2670 con 0x7f66500646c0 2023-07-27T14:40:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f664f7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f664effd700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 0x7f6650154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:12.915 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f664f7fe700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:56622/0 (socket says 172.21.15.159:56622) 2023-07-27T14:40:12.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.850+0000 7f664f7fe700 1 -- 172.21.15.159:0/2478976863 learned_addr learned my addr 172.21.15.159:0/2478976863 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:40:12.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f664ffff700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6650154190 0x7f6650154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:12.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f664effd700 1 -- 172.21.15.159:0/2478976863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 msgr2=0x7f6650147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:12.916 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f664effd700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:12.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f664effd700 1 -- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6650154190 msgr2=0x7f6650154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:12.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f664effd700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6650154190 0x7f6650154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:12.917 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f664effd700 1 -- 172.21.15.159:0/2478976863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648009a20 con 0x7f66500c64b0 2023-07-27T14:40:12.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f664f7fe700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:12.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f664effd700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 0x7f6650154ac0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f6644014000 tx=0x7f6644017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:12.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f66377fe700 1 -- 172.21.15.159:0/2478976863 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644006970 con 0x7f66500c64b0 2023-07-27T14:40:12.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f66377fe700 1 -- 172.21.15.159:0/2478976863 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664400be40 con 0x7f66500c64b0 2023-07-27T14:40:12.918 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f66377fe700 1 -- 172.21.15.159:0/2478976863 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400ba80 con 0x7f66500c64b0 2023-07-27T14:40:12.919 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6644009370 con 0x7f66500c64b0 2023-07-27T14:40:12.919 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.851+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66500c2020 con 0x7f66500c64b0 2023-07-27T14:40:12.919 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.852+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665005f0c0 con 0x7f66500c64b0 2023-07-27T14:40:12.919 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.853+0000 7f66377fe700 1 -- 172.21.15.159:0/2478976863 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f664402b070 con 0x7f66500c64b0 2023-07-27T14:40:12.920 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.854+0000 7f66377fe700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f663c05fcc0 0x7f663c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:12.920 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.854+0000 7f66377fe700 1 -- 172.21.15.159:0/2478976863 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f664407ca90 con 0x7f66500c64b0 2023-07-27T14:40:12.920 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.854+0000 7f664f7fe700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f663c05fcc0 0x7f663c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:12.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.855+0000 7f664f7fe700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f663c05fcc0 0x7f663c062180 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f6640001d00 tx=0x7f6640009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:12.921 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:12.858+0000 7f66377fe700 1 -- 172.21.15.159:0/2478976863 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f664404cfd0 con 0x7f66500c64b0 2023-07-27T14:40:13.124 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.069+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6650083500 con 0x7f66500c64b0 2023-07-27T14:40:13.125 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.069+0000 7f66377fe700 1 -- 172.21.15.159:0/2478976863 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v112) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6644020070 con 0x7f66500c64b0 2023-07-27T14:40:13.125 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:40:13.127 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.071+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f663c05fcc0 msgr2=0x7f663c062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:13.127 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.071+0000 7f6655fff700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f663c05fcc0 0x7f663c062180 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f6640001d00 tx=0x7f6640009040).stop 2023-07-27T14:40:13.127 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.071+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 msgr2=0x7f6650154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:13.128 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.071+0000 7f6655fff700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 0x7f6650154ac0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f6644014000 tx=0x7f6644017000).stop 2023-07-27T14:40:13.128 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.072+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 shutdown_connections 2023-07-27T14:40:13.128 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.072+0000 7f6655fff700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f663c05fcc0 0x7f663c062180 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:13.128 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.072+0000 7f6655fff700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6650154190 0x7f6650154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:13.128 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.072+0000 7f6655fff700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f66500646c0 0x7f6650147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:13.129 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.072+0000 7f6655fff700 1 --2- 172.21.15.159:0/2478976863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66500c64b0 0x7f6650154ac0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:13.129 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.072+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 >> 172.21.15.159:0/2478976863 conn(0x7f66500cb730 msgr2=0x7f66500c5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:13.129 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.072+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 shutdown_connections 2023-07-27T14:40:13.130 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:40:13.072+0000 7f6655fff700 1 -- 172.21.15.159:0/2478976863 wait complete. 2023-07-27T14:40:13.141 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:40:13.142 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:40:13.142 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:40:13.143 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:40:13.143 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:40:13.143 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:40:13.143 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:40:13.144 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:40:13.144 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:40:13.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:13.145 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:40:13.192 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:40:13.192 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:40:13.192 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:40:13.193 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:13.193 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:40:13.193 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:13.193 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:40:13.193 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:13.193 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:40:13.194 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:40:13.194 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:13.194 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:40:13.194 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:40:13.194 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:13.195 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:40:13.195 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:13.195 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:40:13.196 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41184sec preferred_lft 41184sec 2023-07-27T14:40:13.196 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:40:13.196 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:13.196 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:40:13.196 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:40:13.196 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:40:13.197 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:13.197 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:40:13.197 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:13.197 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:40:13.197 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:40:13.197 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:40:13.197 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:13.197 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:40:13.198 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:40:13.198 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:40:13.198 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:40:13.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:13.200 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:40:13.268 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:40:13.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:13.272 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:40:13.322 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:40:13.323 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:40:13.323 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:40:13.323 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:40:13.324 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:40:13.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:13.325 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:40:13.326 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:40:13.327 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:40:13.327 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:40:13.328 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:40:13.329 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:40:13.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:13.499 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:40:13.547 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:40:13.547 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:40:13.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:40:13.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:13.549 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:40:13.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:13.659 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:40:13.705 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:40:13.706 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:40:13.847 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:40:13.847 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:40:13.872 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:40:13.873 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:40:13.878 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:40:13.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:13.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:40:13.950 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:40:14.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.097+0000 7f9f60fff700 1 Processor -- start 2023-07-27T14:40:14.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.097+0000 7f9f60fff700 1 -- start start 2023-07-27T14:40:14.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.098+0000 7f9f60fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9f5c14ae00 0x7f9f5c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:14.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f60fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f5c063260 0x7f9f5c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:14.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f60fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c1553f0 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f60fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c157a50 con 0x7f9f5c063260 2023-07-27T14:40:14.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f60fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c157d10 con 0x7f9f5c14ae00 2023-07-27T14:40:14.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f5ad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f5c063260 0x7f9f5c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:14.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f5ad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f5c063260 0x7f9f5c0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50670/0 (socket says 172.21.15.115:50670) 2023-07-27T14:40:14.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f5ad9d700 1 -- 172.21.15.115:0/2857319959 learned_addr learned my addr 172.21.15.115:0/2857319959 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:14.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f5ad9d700 1 -- 172.21.15.115:0/2857319959 >> v2:172.21.15.159:3300/0 conn(0x7f9f5c14ae00 msgr2=0x7f9f5c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:14.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f5ad9d700 1 --2- 172.21.15.115:0/2857319959 >> v2:172.21.15.159:3300/0 conn(0x7f9f5c14ae00 0x7f9f5c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:14.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f5ad9d700 1 -- 172.21.15.115:0/2857319959 >> v1:172.21.15.159:6789/0 conn(0x7f9f5c14b1e0 legacy=0x7f9f5c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:14.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f5ad9d700 1 -- 172.21.15.115:0/2857319959 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c157ff0 con 0x7f9f5c063260 2023-07-27T14:40:14.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.099+0000 7f9f5ad9d700 1 --2- 172.21.15.115:0/2857319959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c063260 0x7f9f5c0a98c0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 rx=0x7f9f5c0caaf0 tx=0x7f9f54009840).ready entity=mon.0 client_cookie=e9b98a4d816b64c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:14.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f5959a700 1 -- 172.21.15.115:0/2857319959 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400e070 con 0x7f9f5c063260 2023-07-27T14:40:14.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f5959a700 1 -- 172.21.15.115:0/2857319959 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5400ba10 con 0x7f9f5c063260 2023-07-27T14:40:14.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f5959a700 1 -- 172.21.15.115:0/2857319959 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400bd90 con 0x7f9f5c063260 2023-07-27T14:40:14.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f60fff700 1 -- 172.21.15.115:0/2857319959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c063260 msgr2=0x7f9f5c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:14.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f60fff700 1 --2- 172.21.15.115:0/2857319959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c063260 0x7f9f5c0a98c0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 rx=0x7f9f5c0caaf0 tx=0x7f9f54009840).stop 2023-07-27T14:40:14.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f60fff700 1 -- 172.21.15.115:0/2857319959 shutdown_connections 2023-07-27T14:40:14.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f60fff700 1 --2- 172.21.15.115:0/2857319959 >> v2:172.21.15.159:3300/0 conn(0x7f9f5c14ae00 0x7f9f5c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:14.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f60fff700 1 --2- 172.21.15.115:0/2857319959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c063260 0x7f9f5c0a98c0 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:14.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f60fff700 1 -- 172.21.15.115:0/2857319959 >> 172.21.15.115:0/2857319959 conn(0x7f9f5c05e940 msgr2=0x7f9f5c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:14.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f60fff700 1 -- 172.21.15.115:0/2857319959 shutdown_connections 2023-07-27T14:40:14.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.100+0000 7f9f60fff700 1 -- 172.21.15.115:0/2857319959 wait complete. 2023-07-27T14:40:14.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.102+0000 7f9f60fff700 1 Processor -- start 2023-07-27T14:40:14.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.102+0000 7f9f60fff700 1 -- start start 2023-07-27T14:40:14.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f60fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f5c063260 0x7f9f5c1490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:14.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f60fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f5c14ae00 0x7f9f5c0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:14.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f60fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c14b1e0 0x7f9f5c0c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:14.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f60fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c149c70 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f60fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c33e0 con 0x7f9f5c063260 2023-07-27T14:40:14.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f60fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c36c0 con 0x7f9f5c14ae00 2023-07-27T14:40:14.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f5ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c14b1e0 0x7f9f5c0c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:14.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f5ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c14b1e0 0x7f9f5c0c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50684/0 (socket says 172.21.15.115:50684) 2023-07-27T14:40:14.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f5ad9d700 1 -- 172.21.15.115:0/4081108643 learned_addr learned my addr 172.21.15.115:0/4081108643 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:14.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f5a59c700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f5c063260 0x7f9f5c1490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:14.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f59d9b700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f5c14ae00 0x7f9f5c0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:14.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f5ad9d700 1 -- 172.21.15.115:0/4081108643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f5c14ae00 msgr2=0x7f9f5c0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:14.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.103+0000 7f9f5ad9d700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f5c14ae00 0x7f9f5c0c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:14.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f5ad9d700 1 -- 172.21.15.115:0/4081108643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f5c063260 msgr2=0x7f9f5c1490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:14.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f5ad9d700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f5c063260 0x7f9f5c1490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:14.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f5ad9d700 1 -- 172.21.15.115:0/4081108643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54009ae0 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f5ad9d700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c14b1e0 0x7f9f5c0c4480 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 rx=0x7f9f54009880 tx=0x7f9f5c14eb20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:14.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f4a7fc700 1 -- 172.21.15.115:0/4081108643 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54013e80 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f4a7fc700 1 -- 172.21.15.115:0/4081108643 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f540092e0 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c0c39a0 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f4a7fc700 1 -- 172.21.15.115:0/4081108643 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5401d620 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.104+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0c3f60 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.105+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c06c470 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.106+0000 7f9f4a7fc700 1 -- 172.21.15.115:0/4081108643 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f9f5401b040 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.107+0000 7f9f4a7fc700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f3c05fcc0 0x7f9f3c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:14.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.107+0000 7f9f4a7fc700 1 -- 172.21.15.115:0/4081108643 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f9f5407ce60 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.107+0000 7f9f5a59c700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f3c05fcc0 0x7f9f3c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:14.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.107+0000 7f9f5a59c700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f3c05fcc0 0x7f9f3c062180 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f9f5c0acbe0 tx=0x7f9f4c009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:14.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.111+0000 7f9f4a7fc700 1 -- 172.21.15.115:0/4081108643 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f5404d3a0 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.322+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9f5c06c470 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.748+0000 7f9f4a7fc700 1 -- 172.21.15.115:0/4081108643 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v113) v1 ==== 136+0+0 (secure 0 0 0) 0x7f9f5401c370 con 0x7f9f5c14b1e0 2023-07-27T14:40:14.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.750+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f3c05fcc0 msgr2=0x7f9f3c062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.750+0000 7f9f60fff700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f3c05fcc0 0x7f9f3c062180 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f9f5c0acbe0 tx=0x7f9f4c009060).stop 2023-07-27T14:40:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.750+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c14b1e0 msgr2=0x7f9f5c0c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.750+0000 7f9f60fff700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c14b1e0 0x7f9f5c0c4480 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 rx=0x7f9f54009880 tx=0x7f9f5c14eb20).stop 2023-07-27T14:40:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.750+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 shutdown_connections 2023-07-27T14:40:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.750+0000 7f9f60fff700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9f3c05fcc0 0x7f9f3c062180 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:14.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.750+0000 7f9f60fff700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f5c14b1e0 0x7f9f5c0c4480 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:14.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.751+0000 7f9f60fff700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f5c063260 0x7f9f5c1490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:14.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.751+0000 7f9f60fff700 1 --2- 172.21.15.115:0/4081108643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9f5c14ae00 0x7f9f5c0c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:14.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.751+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 >> 172.21.15.115:0/4081108643 conn(0x7f9f5c05e940 msgr2=0x7f9f5c152870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:14.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.751+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 shutdown_connections 2023-07-27T14:40:14.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.751+0000 7f9f60fff700 1 -- 172.21.15.115:0/4081108643 wait complete. 2023-07-27T14:40:14.825 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:40:15.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.960+0000 7f2c129ff700 1 Processor -- start 2023-07-27T14:40:15.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.960+0000 7f2c129ff700 1 -- start start 2023-07-27T14:40:15.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.961+0000 7f2c129ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2c0c14e850 0x7f2c0c062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.961+0000 7f2c129ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c062810 0x7f2c0c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.961+0000 7f2c129ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0c0a4840 con 0x7f2c0c14e470 2023-07-27T14:40:15.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.961+0000 7f2c129ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0c062c80 con 0x7f2c0c14e850 2023-07-27T14:40:15.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.961+0000 7f2c129ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0a6ed0 con 0x7f2c0c062810 2023-07-27T14:40:15.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2c0c14e470 0x7f2c0c155110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41628/0 (socket says 172.21.15.115:41628) 2023-07-27T14:40:15.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0bfff700 1 -- 172.21.15.115:0/2419192727 learned_addr learned my addr 172.21.15.115:0/2419192727 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:15.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c10f9c700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c062810 0x7f2c0c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0b7fe700 1 --2- 172.21.15.115:0/2419192727 >> v2:172.21.15.159:3300/0 conn(0x7f2c0c14e850 0x7f2c0c062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116306804 0 0) 0x7f2c0c0a4840 con 0x7f2c0c14e470 2023-07-27T14:40:15.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf40033f0 con 0x7f2c0c14e470 2023-07-27T14:40:15.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2848932675 0 0) 0x7f2bf40033f0 con 0x7f2c0c14e470 2023-07-27T14:40:15.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c062810 msgr2=0x7f2c0c0a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c062810 0x7f2c0c0a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 >> v2:172.21.15.159:3300/0 conn(0x7f2c0c14e850 msgr2=0x7f2c0c062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 --2- 172.21.15.115:0/2419192727 >> v2:172.21.15.159:3300/0 conn(0x7f2c0c14e850 0x7f2c0c062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c0a71b0 con 0x7f2c0c14e470 2023-07-27T14:40:15.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f2bfc001470 con 0x7f2c0c14e470 2023-07-27T14:40:15.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 >> v1:172.21.15.115:6789/0 conn(0x7f2c0c14e470 legacy=0x7f2c0c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40038e0 0x7f2bf4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf4004690 0x7f2bf4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c062810 0x7f2bf4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c062c80 con 0x7f2bf40038e0 2023-07-27T14:40:15.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0a6ed0 con 0x7f2bf4004690 2023-07-27T14:40:15.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.962+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf400b8e0 con 0x7f2c0c062810 2023-07-27T14:40:15.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0bfff700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40038e0 0x7f2bf4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0b7fe700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf4004690 0x7f2bf4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c10f9c700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c062810 0x7f2bf4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0bfff700 1 -- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c062810 msgr2=0x7f2bf4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0bfff700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c062810 0x7f2bf4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0bfff700 1 -- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf4004690 msgr2=0x7f2bf4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0bfff700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf4004690 0x7f2bf4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0bfff700 1 -- 172.21.15.115:0/2419192727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40033f0 con 0x7f2bf40038e0 2023-07-27T14:40:15.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0bfff700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40038e0 0x7f2bf4003d00 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 rx=0x7f2bfc00c210 tx=0x7f2bfc001e90).ready entity=mon.0 client_cookie=50551f2cc7906302 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc007a60 con 0x7f2bf40038e0 2023-07-27T14:40:15.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc00cae0 con 0x7f2bf40038e0 2023-07-27T14:40:15.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.963+0000 7f2c0affd700 1 -- 172.21.15.115:0/2419192727 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00ce80 con 0x7f2bf40038e0 2023-07-27T14:40:15.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.964+0000 7f2c129ff700 1 -- 172.21.15.115:0/2419192727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40038e0 msgr2=0x7f2bf4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.964+0000 7f2c129ff700 1 --2- 172.21.15.115:0/2419192727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bf40038e0 0x7f2bf4003d00 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 rx=0x7f2bfc00c210 tx=0x7f2bfc001e90).stop 2023-07-27T14:40:15.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.964+0000 7f2c10f9c700 1 -- 172.21.15.115:0/2419192727 reap_dead start 2023-07-27T14:40:15.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.964+0000 7f2c129ff700 1 -- 172.21.15.115:0/2419192727 shutdown_connections 2023-07-27T14:40:15.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.964+0000 7f2c129ff700 1 -- 172.21.15.115:0/2419192727 >> 172.21.15.115:0/2419192727 conn(0x7f2c0c0c7990 msgr2=0x7f2c0c0c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:15.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.964+0000 7f2c129ff700 1 -- 172.21.15.115:0/2419192727 shutdown_connections 2023-07-27T14:40:15.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.964+0000 7f2c129ff700 1 -- 172.21.15.115:0/2419192727 wait complete. 2023-07-27T14:40:15.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.966+0000 7f2c129ff700 1 Processor -- start 2023-07-27T14:40:15.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.966+0000 7f2c129ff700 1 -- start start 2023-07-27T14:40:15.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c129ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf40038e0 0x7f2c0c1436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c129ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c0c0c6280 0x7f2c0c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c129ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c0acd30 0x7f2c0c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c129ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c14dd40 con 0x7f2c0c0c6280 2023-07-27T14:40:15.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c129ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0ad9a0 con 0x7f2bf40038e0 2023-07-27T14:40:15.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c129ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0c6bf0 con 0x7f2c0c0acd30 2023-07-27T14:40:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c0c0c6280 0x7f2c0c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c0c0c6280 0x7f2c0c0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50698/0 (socket says 172.21.15.115:50698) 2023-07-27T14:40:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 -- 172.21.15.115:0/769317876 learned_addr learned my addr 172.21.15.115:0/769317876 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0bfff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf40038e0 0x7f2c0c1436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c10f9c700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c0acd30 0x7f2c0c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 -- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c0acd30 msgr2=0x7f2c0c0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c0acd30 0x7f2c0c0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 -- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf40038e0 msgr2=0x7f2c0c1436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf40038e0 0x7f2c0c1436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 -- 172.21.15.115:0/769317876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c156a50 con 0x7f2c0c0c6280 2023-07-27T14:40:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c10f9c700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c0acd30 0x7f2c0c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.967+0000 7f2c0b7fe700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c0c0c6280 0x7f2c0c0c6700 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 rx=0x7f2c00011a20 tx=0x7f2c00009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.968+0000 7f2bf3fff700 1 -- 172.21.15.115:0/769317876 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000f940 con 0x7f2c0c0c6280 2023-07-27T14:40:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.968+0000 7f2bf3fff700 1 -- 172.21.15.115:0/769317876 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000faa0 con 0x7f2c0c0c6280 2023-07-27T14:40:15.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.968+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0c156d30 con 0x7f2c0c0c6280 2023-07-27T14:40:15.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.968+0000 7f2bf3fff700 1 -- 172.21.15.115:0/769317876 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000fe20 con 0x7f2c0c0c6280 2023-07-27T14:40:15.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.968+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0c1572f0 con 0x7f2c0c0c6280 2023-07-27T14:40:15.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.969+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0c06c470 con 0x7f2c0c0c6280 2023-07-27T14:40:15.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.970+0000 7f2bf3fff700 1 -- 172.21.15.115:0/769317876 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f2c00024070 con 0x7f2c0c0c6280 2023-07-27T14:40:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.970+0000 7f2bf3fff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2bf805fcc0 0x7f2bf8062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.970+0000 7f2bf3fff700 1 -- 172.21.15.115:0/769317876 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f2c0007bd80 con 0x7f2c0c0c6280 2023-07-27T14:40:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.971+0000 7f2c0bfff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2bf805fcc0 0x7f2bf8062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.971+0000 7f2c0bfff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2bf805fcc0 0x7f2bf8062180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f2bfc001ed0 tx=0x7f2bfc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:14.974+0000 7f2bf3fff700 1 -- 172.21.15.115:0/769317876 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c0004c2c0 con 0x7f2c0c0c6280 2023-07-27T14:40:15.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.172+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c0c064990 con 0x7f2bf805fcc0 2023-07-27T14:40:15.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.173+0000 7f2bf3fff700 1 -- 172.21.15.115:0/769317876 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2c0c064990 con 0x7f2bf805fcc0 2023-07-27T14:40:15.229 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:40:15.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:15.230 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:40:15.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:15.230 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:40:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2bf805fcc0 msgr2=0x7f2bf8062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2bf805fcc0 0x7f2bf8062180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f2bfc001ed0 tx=0x7f2bfc015000).stop 2023-07-27T14:40:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c0c0c6280 msgr2=0x7f2c0c0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c0c0c6280 0x7f2c0c0c6700 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 rx=0x7f2c00011a20 tx=0x7f2c00009060).stop 2023-07-27T14:40:15.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 shutdown_connections 2023-07-27T14:40:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2bf805fcc0 0x7f2bf8062180 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2c0c0acd30 0x7f2c0c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bf40038e0 0x7f2c0c1436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 --2- 172.21.15.115:0/769317876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c0c0c6280 0x7f2c0c0c6700 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 >> 172.21.15.115:0/769317876 conn(0x7f2c0c0c7990 msgr2=0x7f2c0c145580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 shutdown_connections 2023-07-27T14:40:15.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.176+0000 7f2c129ff700 1 -- 172.21.15.115:0/769317876 wait complete. 2023-07-27T14:40:15.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:40:15.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.383+0000 7f7d539ff700 1 Processor -- start 2023-07-27T14:40:15.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.383+0000 7f7d539ff700 1 -- start start 2023-07-27T14:40:15.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.384+0000 7f7d539ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 0x7f7d4c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.384+0000 7f7d539ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d4c14b1e0 0x7f7d4c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.384+0000 7f7d539ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c1553f0 con 0x7f7d4c0c5c50 2023-07-27T14:40:15.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.384+0000 7f7d539ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c157a50 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.384+0000 7f7d539ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c157d10 con 0x7f7d4c14ae00 2023-07-27T14:40:15.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d50f9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d4c14b1e0 0x7f7d4c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d51f9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7d4c0c5c50 0x7f7d4c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41636/0 (socket says 172.21.15.115:41636) 2023-07-27T14:40:15.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d50f9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d4c14b1e0 0x7f7d4c062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50700/0 (socket says 172.21.15.115:50700) 2023-07-27T14:40:15.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d51f9c700 1 -- 172.21.15.115:0/3628960465 learned_addr learned my addr 172.21.15.115:0/3628960465 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:15.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d5179b700 1 --2- 172.21.15.115:0/3628960465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 0x7f7d4c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d50f9a700 1 -- 172.21.15.115:0/3628960465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 msgr2=0x7f7d4c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d50f9a700 1 --2- 172.21.15.115:0/3628960465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 0x7f7d4c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d50f9a700 1 -- 172.21.15.115:0/3628960465 >> v1:172.21.15.115:6789/0 conn(0x7f7d4c0c5c50 legacy=0x7f7d4c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d50f9a700 1 -- 172.21.15.115:0/3628960465 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c157ff0 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d43fff700 1 -- 172.21.15.115:0/3628960465 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496102702 0 0) 0x7f7d4c1553f0 con 0x7f7d4c0c5c50 2023-07-27T14:40:15.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.385+0000 7f7d50f9a700 1 --2- 172.21.15.115:0/3628960465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c062b50 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 rx=0x7f7d3c009760 tx=0x7f7d3c009060).ready entity=mon.0 client_cookie=2987ce227fbdeb5f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d43fff700 1 -- 172.21.15.115:0/3628960465 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00b580 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d43fff700 1 -- 172.21.15.115:0/3628960465 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c00b6e0 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d43fff700 1 -- 172.21.15.115:0/3628960465 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00ba60 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d539ff700 1 -- 172.21.15.115:0/3628960465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 msgr2=0x7f7d4c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d539ff700 1 --2- 172.21.15.115:0/3628960465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c062b50 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 rx=0x7f7d3c009760 tx=0x7f7d3c009060).stop 2023-07-27T14:40:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d539ff700 1 -- 172.21.15.115:0/3628960465 shutdown_connections 2023-07-27T14:40:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d539ff700 1 --2- 172.21.15.115:0/3628960465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 0x7f7d4c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d539ff700 1 --2- 172.21.15.115:0/3628960465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c062b50 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d539ff700 1 -- 172.21.15.115:0/3628960465 >> 172.21.15.115:0/3628960465 conn(0x7f7d4c05e940 msgr2=0x7f7d4c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d539ff700 1 -- 172.21.15.115:0/3628960465 shutdown_connections 2023-07-27T14:40:15.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.386+0000 7f7d539ff700 1 -- 172.21.15.115:0/3628960465 wait complete. 2023-07-27T14:40:15.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.388+0000 7f7d539ff700 1 Processor -- start 2023-07-27T14:40:15.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.388+0000 7f7d539ff700 1 -- start start 2023-07-27T14:40:15.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d539ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d4c0c5c50 0x7f7d4c13e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d539ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 0x7f7d4c163bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d539ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c0a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d539ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0c3270 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d539ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c13ec70 con 0x7f7d4c0c5c50 2023-07-27T14:40:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d539ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c164490 con 0x7f7d4c14ae00 2023-07-27T14:40:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d51f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c0a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d51f9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c0a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50702/0 (socket says 172.21.15.115:50702) 2023-07-27T14:40:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d51f9c700 1 -- 172.21.15.115:0/118718841 learned_addr learned my addr 172.21.15.115:0/118718841 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d5179b700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d4c0c5c50 0x7f7d4c13e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d50f9a700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 0x7f7d4c163bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d51f9c700 1 -- 172.21.15.115:0/118718841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 msgr2=0x7f7d4c163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d51f9c700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 0x7f7d4c163bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d51f9c700 1 -- 172.21.15.115:0/118718841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d4c0c5c50 msgr2=0x7f7d4c13e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d51f9c700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d4c0c5c50 0x7f7d4c13e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.389+0000 7f7d51f9c700 1 -- 172.21.15.115:0/118718841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0092a0 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.390+0000 7f7d51f9c700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c0a9b50 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 rx=0x7f7d4400c730 tx=0x7f7d44001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.390+0000 7f7d417fa700 1 -- 172.21.15.115:0/118718841 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44005d30 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.390+0000 7f7d417fa700 1 -- 172.21.15.115:0/118718841 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d44005e90 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.390+0000 7f7d417fa700 1 -- 172.21.15.115:0/118718841 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44007340 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.390+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c164770 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.390+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c0c2f00 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.391+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c06c470 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.392+0000 7f7d417fa700 1 -- 172.21.15.115:0/118718841 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f7d44010030 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.393+0000 7f7d417fa700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d3005fcc0 0x7f7d30062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.393+0000 7f7d417fa700 1 -- 172.21.15.115:0/118718841 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f7d4407b180 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.393+0000 7f7d5179b700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d3005fcc0 0x7f7d30062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.393+0000 7f7d5179b700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d3005fcc0 0x7f7d30062180 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f7d4800bb20 tx=0x7f7d48008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.396+0000 7f7d417fa700 1 -- 172.21.15.115:0/118718841 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7d4404b7d0 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.570+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7d4c0c4d20 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.570+0000 7f7d417fa700 1 -- 172.21.15.115:0/118718841 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7d4404edf0 con 0x7f7d4c14b1e0 2023-07-27T14:40:15.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d3005fcc0 msgr2=0x7f7d30062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d3005fcc0 0x7f7d30062180 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f7d4800bb20 tx=0x7f7d48008040).stop 2023-07-27T14:40:15.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 msgr2=0x7f7d4c0a9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c0a9b50 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 rx=0x7f7d4400c730 tx=0x7f7d44001520).stop 2023-07-27T14:40:15.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 shutdown_connections 2023-07-27T14:40:15.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f7d3005fcc0 0x7f7d30062180 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d4c14b1e0 0x7f7d4c0a9b50 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d4c0c5c50 0x7f7d4c13e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 --2- 172.21.15.115:0/118718841 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7d4c14ae00 0x7f7d4c163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 >> 172.21.15.115:0/118718841 conn(0x7f7d4c05e940 msgr2=0x7f7d4c14a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:15.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 shutdown_connections 2023-07-27T14:40:15.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.572+0000 7f7d539ff700 1 -- 172.21.15.115:0/118718841 wait complete. 2023-07-27T14:40:15.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000758326 --mode=777 2023-07-27T14:40:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.783+0000 7f3796bff700 1 Processor -- start 2023-07-27T14:40:15.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.783+0000 7f3796bff700 1 -- start start 2023-07-27T14:40:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f3796bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3790063260 0x7f3790154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f3796bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f379014b1e0 0x7f37900a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f3796bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37901553f0 con 0x7f379014ae00 2023-07-27T14:40:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f3796bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3790157a50 con 0x7f3790063260 2023-07-27T14:40:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f3796bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3790157d10 con 0x7f379014b1e0 2023-07-27T14:40:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f379499b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f379014ae00 0x7f3790062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41644/0 (socket says 172.21.15.115:41644) 2023-07-27T14:40:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f379499b700 1 -- 172.21.15.115:0/1587170770 learned_addr learned my addr 172.21.15.115:0/1587170770 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f378ffff700 1 --2- 172.21.15.115:0/1587170770 >> v2:172.21.15.159:3300/0 conn(0x7f3790063260 0x7f3790154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f379519c700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f379014b1e0 0x7f37900a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122611327 0 0) 0x7f37901553f0 con 0x7f379014ae00 2023-07-27T14:40:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.785+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37800033f0 con 0x7f379014ae00 2023-07-27T14:40:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 681923984 0 0) 0x7f37800033f0 con 0x7f379014ae00 2023-07-27T14:40:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f379014b1e0 msgr2=0x7f37900a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f379014b1e0 0x7f37900a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 >> v2:172.21.15.159:3300/0 conn(0x7f3790063260 msgr2=0x7f3790154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 --2- 172.21.15.115:0/1587170770 >> v2:172.21.15.159:3300/0 conn(0x7f3790063260 0x7f3790154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3790157ff0 con 0x7f379014ae00 2023-07-27T14:40:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f3784001470 con 0x7f379014ae00 2023-07-27T14:40:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 >> v1:172.21.15.115:6789/0 conn(0x7f379014ae00 legacy=0x7f3790062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37800038e0 0x7f3780003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f379014b1e0 0x7f3780004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3780004b80 0x7f3780005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790157a50 con 0x7f37800038e0 2023-07-27T14:40:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790157d10 con 0x7f3780004b80 2023-07-27T14:40:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378000b8e0 con 0x7f379014b1e0 2023-07-27T14:40:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f379499b700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37800038e0 0x7f3780003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f378ffff700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f379014b1e0 0x7f3780004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f379519c700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3780004b80 0x7f3780005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f379499b700 1 -- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f379014b1e0 msgr2=0x7f3780004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f379499b700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f379014b1e0 0x7f3780004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.786+0000 7f379499b700 1 -- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3780004b80 msgr2=0x7f3780005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:15.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f379499b700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3780004b80 0x7f3780005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f379499b700 1 -- 172.21.15.115:0/1587170770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800033f0 con 0x7f37800038e0 2023-07-27T14:40:15.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f379499b700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37800038e0 0x7f3780003d00 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 rx=0x7f378400c210 tx=0x7f3784001e90).ready entity=mon.0 client_cookie=14da2df9ac9b618 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784007a60 con 0x7f37800038e0 2023-07-27T14:40:15.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400cae0 con 0x7f37800038e0 2023-07-27T14:40:15.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f378f7fe700 1 -- 172.21.15.115:0/1587170770 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400ce60 con 0x7f37800038e0 2023-07-27T14:40:15.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f3796bff700 1 -- 172.21.15.115:0/1587170770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37800038e0 msgr2=0x7f3780003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f3796bff700 1 --2- 172.21.15.115:0/1587170770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37800038e0 0x7f3780003d00 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 rx=0x7f378400c210 tx=0x7f3784001e90).stop 2023-07-27T14:40:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.787+0000 7f379519c700 1 -- 172.21.15.115:0/1587170770 reap_dead start 2023-07-27T14:40:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.788+0000 7f3796bff700 1 -- 172.21.15.115:0/1587170770 shutdown_connections 2023-07-27T14:40:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.788+0000 7f3796bff700 1 -- 172.21.15.115:0/1587170770 >> 172.21.15.115:0/1587170770 conn(0x7f379005e940 msgr2=0x7f37900cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.788+0000 7f3796bff700 1 -- 172.21.15.115:0/1587170770 shutdown_connections 2023-07-27T14:40:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.788+0000 7f3796bff700 1 -- 172.21.15.115:0/1587170770 wait complete. 2023-07-27T14:40:15.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.789+0000 7f3796bff700 1 Processor -- start 2023-07-27T14:40:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.789+0000 7f3796bff700 1 -- start start 2023-07-27T14:40:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f3796bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37800038e0 0x7f37900add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f3796bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37900b06b0 0x7f37900c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f3796bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3790156650 0x7f3790156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f3796bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790156fc0 con 0x7f3790156650 2023-07-27T14:40:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f3796bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900b0220 con 0x7f37800038e0 2023-07-27T14:40:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f3796bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37900af650 con 0x7f37900b06b0 2023-07-27T14:40:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f379519c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3790156650 0x7f3790156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f379519c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3790156650 0x7f3790156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50716/0 (socket says 172.21.15.115:50716) 2023-07-27T14:40:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f379519c700 1 -- 172.21.15.115:0/1048693059 learned_addr learned my addr 172.21.15.115:0/1048693059 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f379499b700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37800038e0 0x7f37900add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.790+0000 7f378ffff700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37900b06b0 0x7f37900c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f379519c700 1 -- 172.21.15.115:0/1048693059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37900b06b0 msgr2=0x7f37900c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f379519c700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37900b06b0 0x7f37900c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f379519c700 1 -- 172.21.15.115:0/1048693059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37800038e0 msgr2=0x7f37900add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:15.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f379519c700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37800038e0 0x7f37900add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:15.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f379519c700 1 -- 172.21.15.115:0/1048693059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900af8f0 con 0x7f3790156650 2023-07-27T14:40:15.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f379519c700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3790156650 0x7f3790156ad0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 rx=0x7f379014b5e0 tx=0x7f378800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f378cff9700 1 -- 172.21.15.115:0/1048693059 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800e040 con 0x7f3790156650 2023-07-27T14:40:15.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f378cff9700 1 -- 172.21.15.115:0/1048693059 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800f040 con 0x7f3790156650 2023-07-27T14:40:15.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37900afbd0 con 0x7f3790156650 2023-07-27T14:40:15.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f378cff9700 1 -- 172.21.15.115:0/1048693059 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800fda0 con 0x7f3790156650 2023-07-27T14:40:15.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.791+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37900b0b30 con 0x7f3790156650 2023-07-27T14:40:15.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.792+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37900b03b0 con 0x7f3790156650 2023-07-27T14:40:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.793+0000 7f378cff9700 1 -- 172.21.15.115:0/1048693059 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7f3788015660 con 0x7f3790156650 2023-07-27T14:40:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.794+0000 7f378cff9700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f377405fcc0 0x7f3774062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.794+0000 7f378cff9700 1 -- 172.21.15.115:0/1048693059 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f378807bea0 con 0x7f3790156650 2023-07-27T14:40:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.795+0000 7f379499b700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f377405fcc0 0x7f3774062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.795+0000 7f379499b700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f377405fcc0 0x7f3774062180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f3784001ed0 tx=0x7f3784015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.798+0000 7f378cff9700 1 -- 172.21.15.115:0/1048693059 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f378804c3e0 con 0x7f3790156650 2023-07-27T14:40:16.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:15.999+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000758326", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f379006c470 con 0x7f377405fcc0 2023-07-27T14:40:16.061 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:16.005+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:16.061 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:16.005+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:16.061 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:16.005+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:16.061 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:16.005+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:16.062 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:16.005+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:16.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.040+0000 7f378cff9700 1 -- 172.21.15.115:0/1048693059 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f379006c470 con 0x7f377405fcc0 2023-07-27T14:40:16.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f377405fcc0 msgr2=0x7f3774062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f377405fcc0 0x7f3774062180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f3784001ed0 tx=0x7f3784015000).stop 2023-07-27T14:40:16.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3790156650 msgr2=0x7f3790156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3790156650 0x7f3790156ad0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 rx=0x7f379014b5e0 tx=0x7f378800b040).stop 2023-07-27T14:40:16.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 shutdown_connections 2023-07-27T14:40:16.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f377405fcc0 0x7f3774062180 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3790156650 0x7f3790156ad0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f37800038e0 0x7f37900add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 --2- 172.21.15.115:0/1048693059 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37900b06b0 0x7f37900c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.042+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 >> 172.21.15.115:0/1048693059 conn(0x7f379005e940 msgr2=0x7f37900c03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:16.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.043+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 shutdown_connections 2023-07-27T14:40:16.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.043+0000 7f3796bff700 1 -- 172.21.15.115:0/1048693059 wait complete. 2023-07-27T14:40:16.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000758326 2023-07-27T14:40:16.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.250+0000 7efdf9fff700 1 Processor -- start 2023-07-27T14:40:16.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.250+0000 7efdf9fff700 1 -- start start 2023-07-27T14:40:16.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.251+0000 7efdf9fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf414ae00 0x7efdf4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.251+0000 7efdf9fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efdf4063260 0x7efdf40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.251+0000 7efdf9fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf41553f0 con 0x7efdf414b1e0 2023-07-27T14:40:16.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.251+0000 7efdf9fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf4157a50 con 0x7efdf4063260 2023-07-27T14:40:16.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.251+0000 7efdf9fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4157d10 con 0x7efdf414ae00 2023-07-27T14:40:16.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efdf414b1e0 0x7efdf4062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41654/0 (socket says 172.21.15.115:41654) 2023-07-27T14:40:16.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf2ffd700 1 -- 172.21.15.115:0/648861312 learned_addr learned my addr 172.21.15.115:0/648861312 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:16.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf37fe700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf414ae00 0x7efdf4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf3fff700 1 --2- 172.21.15.115:0/648861312 >> v2:172.21.15.159:3300/0 conn(0x7efdf4063260 0x7efdf40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160579091 0 0) 0x7efdf41553f0 con 0x7efdf414b1e0 2023-07-27T14:40:16.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efddc0033f0 con 0x7efdf414b1e0 2023-07-27T14:40:16.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954514080 0 0) 0x7efddc0033f0 con 0x7efdf414b1e0 2023-07-27T14:40:16.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf414ae00 msgr2=0x7efdf4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:16.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf414ae00 0x7efdf4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 >> v2:172.21.15.159:3300/0 conn(0x7efdf4063260 msgr2=0x7efdf40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:16.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 --2- 172.21.15.115:0/648861312 >> v2:172.21.15.159:3300/0 conn(0x7efdf4063260 0x7efdf40a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4157ff0 con 0x7efdf414b1e0 2023-07-27T14:40:16.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7efde8001470 con 0x7efdf414b1e0 2023-07-27T14:40:16.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 >> v1:172.21.15.115:6789/0 conn(0x7efdf414b1e0 legacy=0x7efdf4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf414ae00 0x7efddc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.252+0000 7efdf27fc700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efddc003e10 0x7efddc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf27fc700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efddc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4157a50 con 0x7efddc004b80 2023-07-27T14:40:16.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4157d10 con 0x7efddc003e10 2023-07-27T14:40:16.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc00b8e0 con 0x7efdf414ae00 2023-07-27T14:40:16.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf3fff700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efddc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf37fe700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf414ae00 0x7efddc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf2ffd700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efddc003e10 0x7efddc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf3fff700 1 -- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf414ae00 msgr2=0x7efddc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:16.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf3fff700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf414ae00 0x7efddc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf3fff700 1 -- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efddc003e10 msgr2=0x7efddc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:16.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf3fff700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efddc003e10 0x7efddc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf3fff700 1 -- 172.21.15.115:0/648861312 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc0033f0 con 0x7efddc004b80 2023-07-27T14:40:16.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.253+0000 7efdf3fff700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efddc005000 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 rx=0x7efdec00e240 tx=0x7efdec00b040).ready entity=mon.0 client_cookie=e994ba85a073fcd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:16.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec009ac0 con 0x7efddc004b80 2023-07-27T14:40:16.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00f040 con 0x7efddc004b80 2023-07-27T14:40:16.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf27fc700 1 -- 172.21.15.115:0/648861312 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00ed00 con 0x7efddc004b80 2023-07-27T14:40:16.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf9fff700 1 -- 172.21.15.115:0/648861312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 msgr2=0x7efddc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf9fff700 1 --2- 172.21.15.115:0/648861312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efddc005000 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 rx=0x7efdec00e240 tx=0x7efdec00b040).stop 2023-07-27T14:40:16.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf3fff700 1 -- 172.21.15.115:0/648861312 reap_dead start 2023-07-27T14:40:16.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf9fff700 1 -- 172.21.15.115:0/648861312 shutdown_connections 2023-07-27T14:40:16.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf9fff700 1 -- 172.21.15.115:0/648861312 >> 172.21.15.115:0/648861312 conn(0x7efdf405e940 msgr2=0x7efdf40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:16.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf9fff700 1 -- 172.21.15.115:0/648861312 shutdown_connections 2023-07-27T14:40:16.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.254+0000 7efdf9fff700 1 -- 172.21.15.115:0/648861312 wait complete. 2023-07-27T14:40:16.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.256+0000 7efdf9fff700 1 Processor -- start 2023-07-27T14:40:16.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.256+0000 7efdf9fff700 1 -- start start 2023-07-27T14:40:16.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf9fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efdf414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf9fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40c3b90 0x7efdf40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf9fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf40c4010 0x7efdf40ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf9fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40ae540 con 0x7efddc004b80 2023-07-27T14:40:16.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf9fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40c3630 con 0x7efdf40c4010 2023-07-27T14:40:16.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf9fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40c2a20 con 0x7efdf40c3b90 2023-07-27T14:40:16.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efdf414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efdf414a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50754/0 (socket says 172.21.15.115:50754) 2023-07-27T14:40:16.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf37fe700 1 -- 172.21.15.115:0/4108574491 learned_addr learned my addr 172.21.15.115:0/4108574491 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:16.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf2ffd700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40c3b90 0x7efdf40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf3fff700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf40c4010 0x7efdf40ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf37fe700 1 -- 172.21.15.115:0/4108574491 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40c3b90 msgr2=0x7efdf40adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf37fe700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40c3b90 0x7efdf40adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf37fe700 1 -- 172.21.15.115:0/4108574491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf40c4010 msgr2=0x7efdf40ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf37fe700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf40c4010 0x7efdf40ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.257+0000 7efdf37fe700 1 -- 172.21.15.115:0/4108574491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf40c2d00 con 0x7efddc004b80 2023-07-27T14:40:16.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.258+0000 7efdf37fe700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efdf414a6a0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 rx=0x7efde4006940 tx=0x7efde4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:16.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.258+0000 7efddb7fe700 1 -- 172.21.15.115:0/4108574491 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400f760 con 0x7efddc004b80 2023-07-27T14:40:16.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.258+0000 7efddb7fe700 1 -- 172.21.15.115:0/4108574491 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde400f8c0 con 0x7efddc004b80 2023-07-27T14:40:16.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.258+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf40c2fe0 con 0x7efddc004b80 2023-07-27T14:40:16.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.258+0000 7efddb7fe700 1 -- 172.21.15.115:0/4108574491 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400fc40 con 0x7efddc004b80 2023-07-27T14:40:16.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.258+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf414ab90 con 0x7efddc004b80 2023-07-27T14:40:16.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.259+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf40ca9d0 con 0x7efddc004b80 2023-07-27T14:40:16.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.260+0000 7efddb7fe700 1 -- 172.21.15.115:0/4108574491 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7efde4024070 con 0x7efddc004b80 2023-07-27T14:40:16.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.261+0000 7efddb7fe700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efde005fcc0 0x7efde0062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.261+0000 7efddb7fe700 1 -- 172.21.15.115:0/4108574491 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7efde407bd50 con 0x7efddc004b80 2023-07-27T14:40:16.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.261+0000 7efdf2ffd700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efde005fcc0 0x7efde0062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.262+0000 7efdf2ffd700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efde005fcc0 0x7efde0062180 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7efdf40acf30 tx=0x7efde80077c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:16.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.265+0000 7efddb7fe700 1 -- 172.21.15.115:0/4108574491 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efde404c290 con 0x7efddc004b80 2023-07-27T14:40:16.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.468+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000758326", "target": ["mon-mgr", ""]}) v1 -- 0x7efdf4154be0 con 0x7efde005fcc0 2023-07-27T14:40:16.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.474+0000 7efddb7fe700 1 -- 172.21.15.115:0/4108574491 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7efdf4154be0 con 0x7efde005fcc0 2023-07-27T14:40:16.531 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4 2023-07-27T14:40:16.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.476+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efde005fcc0 msgr2=0x7efde0062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.476+0000 7efdf9fff700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efde005fcc0 0x7efde0062180 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7efdf40acf30 tx=0x7efde80077c0).stop 2023-07-27T14:40:16.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.476+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 msgr2=0x7efdf414a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.476+0000 7efdf9fff700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efdf414a6a0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 rx=0x7efde4006940 tx=0x7efde4009060).stop 2023-07-27T14:40:16.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.477+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 shutdown_connections 2023-07-27T14:40:16.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.477+0000 7efdf9fff700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efde005fcc0 0x7efde0062180 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.477+0000 7efdf9fff700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdf40c4010 0x7efdf40ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.477+0000 7efdf9fff700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efddc004b80 0x7efdf414a6a0 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.477+0000 7efdf9fff700 1 --2- 172.21.15.115:0/4108574491 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdf40c3b90 0x7efdf40adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.477+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 >> 172.21.15.115:0/4108574491 conn(0x7efdf405e940 msgr2=0x7efdf40aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:16.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.477+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 shutdown_connections 2023-07-27T14:40:16.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.477+0000 7efdf9fff700 1 -- 172.21.15.115:0/4108574491 wait complete. 2023-07-27T14:40:16.550 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000758326 2023-07-27T14:40:16.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.683+0000 7fd71fbff700 1 Processor -- start 2023-07-27T14:40:16.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.684+0000 7fd71fbff700 1 -- start start 2023-07-27T14:40:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.685+0000 7fd71fbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd71814ae00 0x7fd718154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.685+0000 7fd71fbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7181553f0 con 0x7fd71814b1e0 2023-07-27T14:40:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.685+0000 7fd71fbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd718157a50 con 0x7fd718063260 2023-07-27T14:40:16.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.685+0000 7fd71fbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd718157d10 con 0x7fd71814ae00 2023-07-27T14:40:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.685+0000 7fd71d19a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd71814b1e0 0x7fd718062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41664/0 (socket says 172.21.15.115:41664) 2023-07-27T14:40:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.685+0000 7fd71d19a700 1 -- 172.21.15.115:0/1925641914 learned_addr learned my addr 172.21.15.115:0/1925641914 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.685+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022872063 0 0) 0x7fd7181553f0 con 0x7fd71814b1e0 2023-07-27T14:40:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.685+0000 7fd71d99b700 1 --2- 172.21.15.115:0/1925641914 >> v2:172.21.15.159:3300/0 conn(0x7fd71814ae00 0x7fd718154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7040033f0 con 0x7fd71814b1e0 2023-07-27T14:40:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1450450475 0 0) 0x7fd7040033f0 con 0x7fd71814b1e0 2023-07-27T14:40:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 >> v2:172.21.15.159:3300/0 conn(0x7fd71814ae00 msgr2=0x7fd718154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 --2- 172.21.15.115:0/1925641914 >> v2:172.21.15.159:3300/0 conn(0x7fd71814ae00 0x7fd718154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 >> v1:172.21.15.159:6789/0 conn(0x7fd718063260 legacy=0x7fd7180a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718157ff0 con 0x7fd71814b1e0 2023-07-27T14:40:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fd708001470 con 0x7fd71814b1e0 2023-07-27T14:40:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 >> v1:172.21.15.115:6789/0 conn(0x7fd71814b1e0 legacy=0x7fd718062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7040038e0 0x7fd704003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd704004690 0x7fd704004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd704005000 0x7fd70400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718157d10 con 0x7fd704005000 2023-07-27T14:40:16.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400bf60 con 0x7fd7040038e0 2023-07-27T14:40:16.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400c0f0 con 0x7fd704004690 2023-07-27T14:40:16.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71e19c700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd704005000 0x7fd70400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71d19a700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd704004690 0x7fd704004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.686+0000 7fd71d99b700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7040038e0 0x7fd704003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71e19c700 1 -- 172.21.15.115:0/1925641914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd704004690 msgr2=0x7fd704004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:16.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71e19c700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd704004690 0x7fd704004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71e19c700 1 -- 172.21.15.115:0/1925641914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7040038e0 msgr2=0x7fd704003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:16.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71e19c700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7040038e0 0x7fd704003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71e19c700 1 -- 172.21.15.115:0/1925641914 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040033f0 con 0x7fd704005000 2023-07-27T14:40:16.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71e19c700 1 -- 172.21.15.115:0/1925641914 reap_dead start 2023-07-27T14:40:16.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71e19c700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd704005000 0x7fd70400b8e0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 rx=0x7fd710001e00 tx=0x7fd710007f30).ready entity=mon.0 client_cookie=8565d8e92d7242ba server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:16.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710006a20 con 0x7fd704005000 2023-07-27T14:40:16.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd710006b80 con 0x7fd704005000 2023-07-27T14:40:16.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71c999700 1 -- 172.21.15.115:0/1925641914 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000c5d0 con 0x7fd704005000 2023-07-27T14:40:16.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71fbff700 1 -- 172.21.15.115:0/1925641914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd704005000 msgr2=0x7fd70400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.687+0000 7fd71fbff700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd704005000 0x7fd70400b8e0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 rx=0x7fd710001e00 tx=0x7fd710007f30).stop 2023-07-27T14:40:16.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.688+0000 7fd71fbff700 1 -- 172.21.15.115:0/1925641914 shutdown_connections 2023-07-27T14:40:16.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.688+0000 7fd71fbff700 1 --2- 172.21.15.115:0/1925641914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd704005000 0x7fd70400b8e0 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.688+0000 7fd71fbff700 1 -- 172.21.15.115:0/1925641914 >> 172.21.15.115:0/1925641914 conn(0x7fd71805e940 msgr2=0x7fd7180cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:16.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.688+0000 7fd71fbff700 1 -- 172.21.15.115:0/1925641914 shutdown_connections 2023-07-27T14:40:16.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.688+0000 7fd71fbff700 1 -- 172.21.15.115:0/1925641914 wait complete. 2023-07-27T14:40:16.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.689+0000 7fd71fbff700 1 Processor -- start 2023-07-27T14:40:16.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.689+0000 7fd71fbff700 1 -- start start 2023-07-27T14:40:16.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71fbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd704005000 0x7fd718147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71fbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd718154ab0 0x7fd718147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71fbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd718154f30 0x7fd718148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71fbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181469e0 con 0x7fd718154ab0 2023-07-27T14:40:16.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71fbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181479a0 con 0x7fd704005000 2023-07-27T14:40:16.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71fbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71814e4d0 con 0x7fd718154f30 2023-07-27T14:40:16.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71d19a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd718154ab0 0x7fd718147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71d19a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd718154ab0 0x7fd718147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50762/0 (socket says 172.21.15.115:50762) 2023-07-27T14:40:16.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.690+0000 7fd71d19a700 1 -- 172.21.15.115:0/2752549962 learned_addr learned my addr 172.21.15.115:0/2752549962 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:16.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71d99b700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd704005000 0x7fd718147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71e19c700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd718154f30 0x7fd718148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71d19a700 1 -- 172.21.15.115:0/2752549962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd718154f30 msgr2=0x7fd718148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71d19a700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd718154f30 0x7fd718148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71d19a700 1 -- 172.21.15.115:0/2752549962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd704005000 msgr2=0x7fd718147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71d19a700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd704005000 0x7fd718147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71d19a700 1 -- 172.21.15.115:0/2752549962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718156ca0 con 0x7fd718154ab0 2023-07-27T14:40:16.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71d19a700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd718154ab0 0x7fd718147e30 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 rx=0x7fd708004760 tx=0x7fd708001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:16.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd70dffb700 1 -- 172.21.15.115:0/2752549962 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011590 con 0x7fd718154ab0 2023-07-27T14:40:16.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd70dffb700 1 -- 172.21.15.115:0/2752549962 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7080116f0 con 0x7fd718154ab0 2023-07-27T14:40:16.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd718156f40 con 0x7fd718154ab0 2023-07-27T14:40:16.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd70dffb700 1 -- 172.21.15.115:0/2752549962 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011a70 con 0x7fd718154ab0 2023-07-27T14:40:16.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.691+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd718148810 con 0x7fd718154ab0 2023-07-27T14:40:16.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.692+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7180ca900 con 0x7fd718154ab0 2023-07-27T14:40:16.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.693+0000 7fd70dffb700 1 -- 172.21.15.115:0/2752549962 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 36) v1 ==== 77402+0+0 (secure 0 0 0) 0x7fd70801b030 con 0x7fd718154ab0 2023-07-27T14:40:16.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.694+0000 7fd70dffb700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6fc05fcc0 0x7fd6fc062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:16.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.694+0000 7fd70dffb700 1 -- 172.21.15.115:0/2752549962 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd70807ad90 con 0x7fd718154ab0 2023-07-27T14:40:16.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.694+0000 7fd71d99b700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6fc05fcc0 0x7fd6fc062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:16.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.695+0000 7fd71d99b700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6fc05fcc0 0x7fd6fc062180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fd714006d80 tx=0x7fd714009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:16.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.698+0000 7fd70dffb700 1 -- 172.21.15.115:0/2752549962 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd70804b270 con 0x7fd718154ab0 2023-07-27T14:40:16.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.899+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000758326", "target": ["mon-mgr", ""]}) v1 -- 0x7fd71806c470 con 0x7fd6fc05fcc0 2023-07-27T14:40:16.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.904+0000 7fd70dffb700 1 -- 172.21.15.115:0/2752549962 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fd71806c470 con 0x7fd6fc05fcc0 2023-07-27T14:40:16.961 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4 2023-07-27T14:40:16.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.906+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6fc05fcc0 msgr2=0x7fd6fc062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.906+0000 7fd71fbff700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6fc05fcc0 0x7fd6fc062180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fd714006d80 tx=0x7fd714009060).stop 2023-07-27T14:40:16.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.906+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd718154ab0 msgr2=0x7fd718147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:16.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.906+0000 7fd71fbff700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd718154ab0 0x7fd718147e30 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 rx=0x7fd708004760 tx=0x7fd708001e50).stop 2023-07-27T14:40:16.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.907+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 shutdown_connections 2023-07-27T14:40:16.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.907+0000 7fd71fbff700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd6fc05fcc0 0x7fd6fc062180 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.907+0000 7fd71fbff700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd718154f30 0x7fd718148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.907+0000 7fd71fbff700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd704005000 0x7fd718147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.907+0000 7fd71fbff700 1 --2- 172.21.15.115:0/2752549962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd718154ab0 0x7fd718147e30 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:16.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.907+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 >> 172.21.15.115:0/2752549962 conn(0x7fd71805e940 msgr2=0x7fd7181498e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:16.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.907+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 shutdown_connections 2023-07-27T14:40:16.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:16.907+0000 7fd71fbff700 1 -- 172.21.15.115:0/2752549962 wait complete. 2023-07-27T14:40:16.980 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000758326 with 16 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4 2023-07-27T14:40:16.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:16.981 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.059 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.346 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.346 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204355 s, 51.3 MB/s 2023-07-27T14:40:17.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.347 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.414 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.414 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.415 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142731 s, 73.5 MB/s 2023-07-27T14:40:17.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.416 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.482 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.482 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.482 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184351 s, 56.9 MB/s 2023-07-27T14:40:17.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.483 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.548 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.548 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.548 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174679 s, 60.0 MB/s 2023-07-27T14:40:17.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.550 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167574 s, 62.6 MB/s 2023-07-27T14:40:17.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.615 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.676 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.677 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150353 s, 69.7 MB/s 2023-07-27T14:40:17.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.678 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.743 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.743 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.743 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018151 s, 57.8 MB/s 2023-07-27T14:40:17.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.745 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.806 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.806 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.806 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143914 s, 72.9 MB/s 2023-07-27T14:40:17.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.808 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.873 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.873 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.874 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161956 s, 64.7 MB/s 2023-07-27T14:40:17.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.875 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.935 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134075 s, 78.2 MB/s 2023-07-27T14:40:17.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:17.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148363 s, 70.7 MB/s 2023-07-27T14:40:18.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:18.000 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:18.064 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:18.065 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:18.065 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176695 s, 59.3 MB/s 2023-07-27T14:40:18.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:18.067 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:18.132 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:18.132 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:18.132 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184089 s, 57.0 MB/s 2023-07-27T14:40:18.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:18.134 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154113 s, 68.0 MB/s 2023-07-27T14:40:18.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:18.197 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:18.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:18.259 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:18.260 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154688 s, 67.8 MB/s 2023-07-27T14:40:18.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:18.261 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000758326/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:40:18.324 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:40:18.324 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:40:18.324 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162715 s, 64.4 MB/s 2023-07-27T14:40:18.325 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000758326 snapshot_0000000000899050 2023-07-27T14:40:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.460+0000 7f8c091ff700 1 Processor -- start 2023-07-27T14:40:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.460+0000 7f8c091ff700 1 -- start start 2023-07-27T14:40:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.462+0000 7f8c091ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8c0414b1e0 0x7f8c04154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.462+0000 7f8c091ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c041553f0 con 0x7f8c0414ae00 2023-07-27T14:40:18.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.462+0000 7f8c091ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c04157a50 con 0x7f8c04063260 2023-07-27T14:40:18.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.462+0000 7f8c091ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c04157d10 con 0x7f8c0414b1e0 2023-07-27T14:40:18.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c02d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8c0414ae00 0x7f8c04062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41666/0 (socket says 172.21.15.115:41666) 2023-07-27T14:40:18.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c02d9d700 1 -- 172.21.15.115:0/3414290574 learned_addr learned my addr 172.21.15.115:0/3414290574 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:18.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374660856 0 0) 0x7f8c041553f0 con 0x7f8c0414ae00 2023-07-27T14:40:18.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c0359e700 1 --2- 172.21.15.115:0/3414290574 >> v2:172.21.15.159:3300/0 conn(0x7f8c0414b1e0 0x7f8c04154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bec0033f0 con 0x7f8c0414ae00 2023-07-27T14:40:18.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077061401 0 0) 0x7f8bec0033f0 con 0x7f8c0414ae00 2023-07-27T14:40:18.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 >> v2:172.21.15.159:3300/0 conn(0x7f8c0414b1e0 msgr2=0x7f8c04154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:18.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 --2- 172.21.15.115:0/3414290574 >> v2:172.21.15.159:3300/0 conn(0x7f8c0414b1e0 0x7f8c04154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 >> v1:172.21.15.159:6789/0 conn(0x7f8c04063260 legacy=0x7f8c040a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04157ff0 con 0x7f8c0414ae00 2023-07-27T14:40:18.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f8bf4001470 con 0x7f8c0414ae00 2023-07-27T14:40:18.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 >> v1:172.21.15.115:6789/0 conn(0x7f8c0414ae00 legacy=0x7f8c04062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec0038e0 0x7f8bec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec004690 0x7f8bec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec005000 0x7f8bec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04157d10 con 0x7f8bec004690 2023-07-27T14:40:18.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec00bf60 con 0x7f8bec0038e0 2023-07-27T14:40:18.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.463+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec00c0f0 con 0x7f8bec005000 2023-07-27T14:40:18.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0259c700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec004690 0x7f8bec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c02d9d700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec0038e0 0x7f8bec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0359e700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec005000 0x7f8bec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0259c700 1 -- 172.21.15.115:0/3414290574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec005000 msgr2=0x7f8bec00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:18.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0259c700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8bec005000 0x7f8bec00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0259c700 1 -- 172.21.15.115:0/3414290574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec0038e0 msgr2=0x7f8bec003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:18.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0259c700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec0038e0 0x7f8bec003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.527 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0259c700 1 -- 172.21.15.115:0/3414290574 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0033f0 con 0x7f8bec004690 2023-07-27T14:40:18.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0359e700 1 -- 172.21.15.115:0/3414290574 reap_dead start 2023-07-27T14:40:18.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c0259c700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec004690 0x7f8bec004b10 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 rx=0x7f8bf8001700 tx=0x7f8bf8007bb0).ready entity=mon.0 client_cookie=2d3f7cb4915152 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:18.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8007020 con 0x7f8bec004690 2023-07-27T14:40:18.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8007180 con 0x7f8bec004690 2023-07-27T14:40:18.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.464+0000 7f8c01d9b700 1 -- 172.21.15.115:0/3414290574 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8007520 con 0x7f8bec004690 2023-07-27T14:40:18.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.465+0000 7f8c091ff700 1 -- 172.21.15.115:0/3414290574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec004690 msgr2=0x7f8bec004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.465+0000 7f8c091ff700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec004690 0x7f8bec004b10 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 rx=0x7f8bf8001700 tx=0x7f8bf8007bb0).stop 2023-07-27T14:40:18.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.465+0000 7f8c091ff700 1 -- 172.21.15.115:0/3414290574 shutdown_connections 2023-07-27T14:40:18.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.465+0000 7f8c091ff700 1 --2- 172.21.15.115:0/3414290574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8bec004690 0x7f8bec004b10 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.465+0000 7f8c091ff700 1 -- 172.21.15.115:0/3414290574 >> 172.21.15.115:0/3414290574 conn(0x7f8c0405e940 msgr2=0x7f8c040cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:18.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.465+0000 7f8c091ff700 1 -- 172.21.15.115:0/3414290574 shutdown_connections 2023-07-27T14:40:18.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.465+0000 7f8c091ff700 1 -- 172.21.15.115:0/3414290574 wait complete. 2023-07-27T14:40:18.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.467+0000 7f8c091ff700 1 Processor -- start 2023-07-27T14:40:18.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.467+0000 7f8c091ff700 1 -- start start 2023-07-27T14:40:18.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c091ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec004690 0x7f8c040ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c091ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c040c1c50 0x7f8c04149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c091ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c040b0480 0x7f8c041671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c091ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040ab530 con 0x7f8c040c1c50 2023-07-27T14:40:18.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c091ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c23c0 con 0x7f8bec004690 2023-07-27T14:40:18.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c091ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040abdc0 con 0x7f8c040b0480 2023-07-27T14:40:18.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c040c1c50 0x7f8c04149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c040c1c50 0x7f8c04149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50780/0 (socket says 172.21.15.115:50780) 2023-07-27T14:40:18.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 -- 172.21.15.115:0/221231320 learned_addr learned my addr 172.21.15.115:0/221231320 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:18.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 -- 172.21.15.115:0/221231320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c040b0480 msgr2=0x7f8c041671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c040b0480 0x7f8c041671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:18.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 -- 172.21.15.115:0/221231320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec004690 msgr2=0x7f8c040ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec004690 0x7f8c040ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:18.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 -- 172.21.15.115:0/221231320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040c20e0 con 0x7f8c040c1c50 2023-07-27T14:40:18.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.468+0000 7f8c0259c700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c040c1c50 0x7f8c04149df0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 rx=0x7f8bf8006be0 tx=0x7f8bf8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:18.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.469+0000 7f8beaffd700 1 -- 172.21.15.115:0/221231320 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8000c60 con 0x7f8c040c1c50 2023-07-27T14:40:18.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.469+0000 7f8beaffd700 1 -- 172.21.15.115:0/221231320 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf801e440 con 0x7f8c040c1c50 2023-07-27T14:40:18.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.469+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040ab770 con 0x7f8c040c1c50 2023-07-27T14:40:18.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.469+0000 7f8beaffd700 1 -- 172.21.15.115:0/221231320 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf801e800 con 0x7f8c040c1c50 2023-07-27T14:40:18.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.469+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0414a2e0 con 0x7f8c040c1c50 2023-07-27T14:40:18.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.470+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0406c470 con 0x7f8c040c1c50 2023-07-27T14:40:18.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.471+0000 7f8beaffd700 1 -- 172.21.15.115:0/221231320 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 77442+0+0 (secure 0 0 0) 0x7f8bf8025030 con 0x7f8c040c1c50 2023-07-27T14:40:18.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.471+0000 7f8beaffd700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bf005fd00 0x7f8bf00621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.471+0000 7f8beaffd700 1 -- 172.21.15.115:0/221231320 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8bf807bf30 con 0x7f8c040c1c50 2023-07-27T14:40:18.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.472+0000 7f8c02d9d700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bf005fd00 0x7f8bf00621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.472+0000 7f8c02d9d700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bf005fd00 0x7f8bf00621c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f8bf40015a0 tx=0x7f8bf4001e50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:18.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.476+0000 7f8beaffd700 1 -- 172.21.15.115:0/221231320 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8bf804c4e0 con 0x7f8c040c1c50 2023-07-27T14:40:18.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.681+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000758326", "snap_name": "snapshot_0000000000899050", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c040ab530 con 0x7f8bf005fd00 2023-07-27T14:40:18.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.703+0000 7f8beaffd700 1 -- 172.21.15.115:0/221231320 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8c040ab530 con 0x7f8bf005fd00 2023-07-27T14:40:18.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bf005fd00 msgr2=0x7f8bf00621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bf005fd00 0x7f8bf00621c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f8bf40015a0 tx=0x7f8bf4001e50).stop 2023-07-27T14:40:18.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c040c1c50 msgr2=0x7f8c04149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c040c1c50 0x7f8c04149df0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 rx=0x7f8bf8006be0 tx=0x7f8bf8016000).stop 2023-07-27T14:40:18.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 shutdown_connections 2023-07-27T14:40:18.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8bf005fd00 0x7f8bf00621c0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8c040b0480 0x7f8c041671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:18.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bec004690 0x7f8c040ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:18.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.705+0000 7f8c091ff700 1 --2- 172.21.15.115:0/221231320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c040c1c50 0x7f8c04149df0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.706+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 >> 172.21.15.115:0/221231320 conn(0x7f8c0405e940 msgr2=0x7f8c0414a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:18.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.706+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 shutdown_connections 2023-07-27T14:40:18.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.706+0000 7f8c091ff700 1 -- 172.21.15.115:0/221231320 wait complete. 2023-07-27T14:40:18.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000758326 --retain-snapshots 2023-07-27T14:40:18.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.916+0000 7f05381ff700 1 Processor -- start 2023-07-27T14:40:18.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.916+0000 7f05381ff700 1 -- start start 2023-07-27T14:40:18.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.917+0000 7f05381ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05300c58d0 0x7f0530150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.917+0000 7f05381ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05300c3100 0x7f05300c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.917+0000 7f05381ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05300c0ea0 con 0x7f05301509b0 2023-07-27T14:40:18.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.917+0000 7f05381ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0530068e10 con 0x7f05300c3100 2023-07-27T14:40:18.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.917+0000 7f05381ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0530151280 con 0x7f05300c58d0 2023-07-27T14:40:18.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053679c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05300c3100 0x7f05300c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053679c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f05300c3100 0x7f05300c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50792/0 (socket says 172.21.15.115:50792) 2023-07-27T14:40:18.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053679c700 1 -- 172.21.15.115:0/2658883638 learned_addr learned my addr 172.21.15.115:0/2658883638 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:18.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053579a700 1 --2- 172.21.15.115:0/2658883638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05300c58d0 0x7f0530150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053679c700 1 -- 172.21.15.115:0/2658883638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05300c58d0 msgr2=0x7f0530150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:18.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053679c700 1 --2- 172.21.15.115:0/2658883638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05300c58d0 0x7f0530150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053679c700 1 -- 172.21.15.115:0/2658883638 >> v1:172.21.15.159:6789/0 conn(0x7f05301509b0 legacy=0x7f0530154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053679c700 1 -- 172.21.15.115:0/2658883638 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530155190 con 0x7f05300c3100 2023-07-27T14:40:18.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f053679c700 1 --2- 172.21.15.115:0/2658883638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f05300c3590 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 rx=0x7f0528009f20 tx=0x7f0528009840).ready entity=mon.0 client_cookie=190ddbd95595b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:18.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.918+0000 7f0534f99700 1 -- 172.21.15.115:0/2658883638 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800e070 con 0x7f05300c3100 2023-07-27T14:40:18.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f0534f99700 1 -- 172.21.15.115:0/2658883638 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052800ba80 con 0x7f05300c3100 2023-07-27T14:40:18.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f0534f99700 1 -- 172.21.15.115:0/2658883638 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800be00 con 0x7f05300c3100 2023-07-27T14:40:18.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f05381ff700 1 -- 172.21.15.115:0/2658883638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 msgr2=0x7f05300c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f05381ff700 1 --2- 172.21.15.115:0/2658883638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f05300c3590 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 rx=0x7f0528009f20 tx=0x7f0528009840).stop 2023-07-27T14:40:18.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f05381ff700 1 -- 172.21.15.115:0/2658883638 shutdown_connections 2023-07-27T14:40:18.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f05381ff700 1 --2- 172.21.15.115:0/2658883638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f05300c3590 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f05381ff700 1 --2- 172.21.15.115:0/2658883638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05300c58d0 0x7f0530150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f05381ff700 1 -- 172.21.15.115:0/2658883638 >> 172.21.15.115:0/2658883638 conn(0x7f0530062320 msgr2=0x7f0530062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:18.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f05381ff700 1 -- 172.21.15.115:0/2658883638 shutdown_connections 2023-07-27T14:40:18.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.919+0000 7f05381ff700 1 -- 172.21.15.115:0/2658883638 wait complete. 2023-07-27T14:40:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.921+0000 7f05381ff700 1 Processor -- start 2023-07-27T14:40:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.921+0000 7f05381ff700 1 -- start start 2023-07-27T14:40:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f05381ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f0530152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f05381ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05300c58d0 0x7f053014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f05381ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05301509b0 0x7f0530146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f05381ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053014fd40 con 0x7f05300c3100 2023-07-27T14:40:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f05381ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05301513c0 con 0x7f05300c58d0 2023-07-27T14:40:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f05381ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05301516a0 con 0x7f05301509b0 2023-07-27T14:40:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f0535f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f0530152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f0535f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f0530152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50808/0 (socket says 172.21.15.115:50808) 2023-07-27T14:40:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f0535f9b700 1 -- 172.21.15.115:0/1890659515 learned_addr learned my addr 172.21.15.115:0/1890659515 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f053679c700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05301509b0 0x7f0530146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f053579a700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05300c58d0 0x7f053014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f0535f9b700 1 -- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05301509b0 msgr2=0x7f0530146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f0535f9b700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05301509b0 0x7f0530146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f0535f9b700 1 -- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05300c58d0 msgr2=0x7f053014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:18.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f0535f9b700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05300c58d0 0x7f053014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:18.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f0535f9b700 1 -- 172.21.15.115:0/1890659515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009ae0 con 0x7f05300c3100 2023-07-27T14:40:18.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f053679c700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05301509b0 0x7f0530146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:18.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.922+0000 7f053579a700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05300c58d0 0x7f053014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:18.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.923+0000 7f0535f9b700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f0530152460 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 rx=0x7f052c00c440 tx=0x7f052c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:18.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.923+0000 7f0525ffb700 1 -- 172.21.15.115:0/1890659515 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c007020 con 0x7f05300c3100 2023-07-27T14:40:18.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.923+0000 7f0525ffb700 1 -- 172.21.15.115:0/1890659515 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c007180 con 0x7f05300c3100 2023-07-27T14:40:18.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.923+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0530151980 con 0x7f05300c3100 2023-07-27T14:40:18.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.923+0000 7f0525ffb700 1 -- 172.21.15.115:0/1890659515 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c007520 con 0x7f05300c3100 2023-07-27T14:40:18.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.923+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0530151f40 con 0x7f05300c3100 2023-07-27T14:40:18.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.924+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0530152160 con 0x7f05300c3100 2023-07-27T14:40:18.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.925+0000 7f0525ffb700 1 -- 172.21.15.115:0/1890659515 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 77442+0+0 (secure 0 0 0) 0x7f052c010070 con 0x7f05300c3100 2023-07-27T14:40:18.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.925+0000 7f0525ffb700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f051405fd00 0x7f05140621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:18.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.925+0000 7f0525ffb700 1 -- 172.21.15.115:0/1890659515 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f052c07a6b0 con 0x7f05300c3100 2023-07-27T14:40:18.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.926+0000 7f053579a700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f051405fd00 0x7f05140621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:18.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.926+0000 7f053579a700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f051405fd00 0x7f05140621c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f053014bc40 tx=0x7f0520008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:18.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:18.929+0000 7f0525ffb700 1 -- 172.21.15.115:0/1890659515 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f052c0478f0 con 0x7f05300c3100 2023-07-27T14:40:19.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.127+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000758326", "retain_snapshots": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f05300a56a0 con 0x7f051405fd00 2023-07-27T14:40:19.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.172+0000 7f0525ffb700 1 -- 172.21.15.115:0/1890659515 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f05300a56a0 con 0x7f051405fd00 2023-07-27T14:40:19.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f051405fd00 msgr2=0x7f05140621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:19.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f051405fd00 0x7f05140621c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f053014bc40 tx=0x7f0520008040).stop 2023-07-27T14:40:19.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 msgr2=0x7f0530152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:19.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f0530152460 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 rx=0x7f052c00c440 tx=0x7f052c007e00).stop 2023-07-27T14:40:19.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 shutdown_connections 2023-07-27T14:40:19.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f051405fd00 0x7f05140621c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f05301509b0 0x7f0530146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05300c3100 0x7f0530152460 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 --2- 172.21.15.115:0/1890659515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05300c58d0 0x7f053014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.174+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 >> 172.21.15.115:0/1890659515 conn(0x7f0530062320 msgr2=0x7f05300690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:19.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.175+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 shutdown_connections 2023-07-27T14:40:19.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.175+0000 7f05381ff700 1 -- 172.21.15.115:0/1890659515 wait complete. 2023-07-27T14:40:19.235 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.179+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.235 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.179+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.235 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.179+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.235 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.179+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.235 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.179+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.251 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.195+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.251 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.195+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.252 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.195+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.252 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.195+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.252 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:19.195+0000 7fa786918700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:19.254 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000758326 snapshot_0000000000899050 clone_0000000000498154 2023-07-27T14:40:19.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.398+0000 7fa010fff700 1 Processor -- start 2023-07-27T14:40:19.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.398+0000 7fa010fff700 1 -- start start 2023-07-27T14:40:19.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa010fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa00c063260 0x7fa00c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:19.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa010fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c14b1e0 0x7fa00c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:19.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa010fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c1553f0 con 0x7fa00c14ae00 2023-07-27T14:40:19.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa010fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c157a50 con 0x7fa00c063260 2023-07-27T14:40:19.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa010fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c157d10 con 0x7fa00c14b1e0 2023-07-27T14:40:19.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa009d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa00c063260 0x7fa00c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:19.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa009d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa00c063260 0x7fa00c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50858/0 (socket says 172.21.15.115:50858) 2023-07-27T14:40:19.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa009d9b700 1 -- 172.21.15.115:0/46640919 learned_addr learned my addr 172.21.15.115:0/46640919 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:19.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.399+0000 7fa00a59c700 1 --1- 172.21.15.115:0/46640919 >> v1:172.21.15.115:6789/0 conn(0x7fa00c14ae00 0x7fa00c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41674/0 (socket says 172.21.15.115:41674) 2023-07-27T14:40:19.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa00ad9d700 1 --2- 172.21.15.115:0/46640919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c14b1e0 0x7fa00c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:19.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa009d9b700 1 -- 172.21.15.115:0/46640919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c14b1e0 msgr2=0x7fa00c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:19.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa009d9b700 1 --2- 172.21.15.115:0/46640919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c14b1e0 0x7fa00c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa009d9b700 1 -- 172.21.15.115:0/46640919 >> v1:172.21.15.115:6789/0 conn(0x7fa00c14ae00 legacy=0x7fa00c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:19.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa009d9b700 1 -- 172.21.15.115:0/46640919 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c157ff0 con 0x7fa00c063260 2023-07-27T14:40:19.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa00959a700 1 -- 172.21.15.115:0/46640919 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162485416 0 0) 0x7fa00c1553f0 con 0x7fa00c14ae00 2023-07-27T14:40:19.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa009d9b700 1 --2- 172.21.15.115:0/46640919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c063260 0x7fa00c154f00 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 rx=0x7fa000006fd0 tx=0x7fa0000090f0).ready entity=mon.0 client_cookie=8016ff68cb5ca9e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:19.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa00959a700 1 -- 172.21.15.115:0/46640919 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000b580 con 0x7fa00c063260 2023-07-27T14:40:19.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa00959a700 1 -- 172.21.15.115:0/46640919 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000b6e0 con 0x7fa00c063260 2023-07-27T14:40:19.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.400+0000 7fa00959a700 1 -- 172.21.15.115:0/46640919 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000ba60 con 0x7fa00c063260 2023-07-27T14:40:19.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.401+0000 7fa010fff700 1 -- 172.21.15.115:0/46640919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c063260 msgr2=0x7fa00c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:19.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.401+0000 7fa010fff700 1 --2- 172.21.15.115:0/46640919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c063260 0x7fa00c154f00 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 rx=0x7fa000006fd0 tx=0x7fa0000090f0).stop 2023-07-27T14:40:19.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.401+0000 7fa010fff700 1 -- 172.21.15.115:0/46640919 shutdown_connections 2023-07-27T14:40:19.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.401+0000 7fa010fff700 1 --2- 172.21.15.115:0/46640919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c14b1e0 0x7fa00c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.401+0000 7fa010fff700 1 --2- 172.21.15.115:0/46640919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c063260 0x7fa00c154f00 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.401+0000 7fa010fff700 1 -- 172.21.15.115:0/46640919 >> 172.21.15.115:0/46640919 conn(0x7fa00c05e940 msgr2=0x7fa00c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:19.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.401+0000 7fa010fff700 1 -- 172.21.15.115:0/46640919 shutdown_connections 2023-07-27T14:40:19.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.401+0000 7fa010fff700 1 -- 172.21.15.115:0/46640919 wait complete. 2023-07-27T14:40:19.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.402+0000 7fa010fff700 1 Processor -- start 2023-07-27T14:40:19.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.403+0000 7fa010fff700 1 -- start start 2023-07-27T14:40:19.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.403+0000 7fa010fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c063260 0x7fa00c1677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:19.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.403+0000 7fa010fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c14ae00 0x7fa00c0c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:19.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.403+0000 7fa010fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c14b1e0 0x7fa00c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:19.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.403+0000 7fa010fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c46b0 con 0x7fa00c14b1e0 2023-07-27T14:40:19.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.403+0000 7fa010fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c2920 con 0x7fa00c14ae00 2023-07-27T14:40:19.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.403+0000 7fa010fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c167d70 con 0x7fa00c063260 2023-07-27T14:40:19.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c14b1e0 0x7fa00c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:19.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c14b1e0 0x7fa00c0af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50872/0 (socket says 172.21.15.115:50872) 2023-07-27T14:40:19.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 -- 172.21.15.115:0/3925642095 learned_addr learned my addr 172.21.15.115:0/3925642095 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:19.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00a59c700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c063260 0x7fa00c1677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:19.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa009d9b700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c14ae00 0x7fa00c0c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:19.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 -- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c063260 msgr2=0x7fa00c1677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:19.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c063260 0x7fa00c1677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 -- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c14ae00 msgr2=0x7fa00c0c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:19.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c14ae00 0x7fa00c0c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:19.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 -- 172.21.15.115:0/3925642095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000009370 con 0x7fa00c14b1e0 2023-07-27T14:40:19.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa009d9b700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c14ae00 0x7fa00c0c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:19.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7fa00ad9d700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c14b1e0 0x7fa00c0af8d0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 rx=0x7fa004009f20 tx=0x7fa00400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:19.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.404+0000 7f9ffa7fc700 1 -- 172.21.15.115:0/3925642095 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00400cb70 con 0x7fa00c14b1e0 2023-07-27T14:40:19.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.405+0000 7f9ffa7fc700 1 -- 172.21.15.115:0/3925642095 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00400f040 con 0x7fa00c14b1e0 2023-07-27T14:40:19.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.405+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c168050 con 0x7fa00c14b1e0 2023-07-27T14:40:19.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.405+0000 7f9ffa7fc700 1 -- 172.21.15.115:0/3925642095 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00400cee0 con 0x7fa00c14b1e0 2023-07-27T14:40:19.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.405+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c168610 con 0x7fa00c14b1e0 2023-07-27T14:40:19.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.406+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c06c470 con 0x7fa00c14b1e0 2023-07-27T14:40:19.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.406+0000 7f9ffa7fc700 1 -- 172.21.15.115:0/3925642095 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 77442+0+0 (secure 0 0 0) 0x7fa004013610 con 0x7fa00c14b1e0 2023-07-27T14:40:19.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.407+0000 7f9ffa7fc700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fec05fd00 0x7f9fec0621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:19.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.407+0000 7f9ffa7fc700 1 -- 172.21.15.115:0/3925642095 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fa00407be60 con 0x7fa00c14b1e0 2023-07-27T14:40:19.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.407+0000 7fa00a59c700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fec05fd00 0x7f9fec0621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:19.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.408+0000 7fa00a59c700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fec05fd00 0x7f9fec0621c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f9ffc0011e0 tx=0x7f9ffc007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:19.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.411+0000 7f9ffa7fc700 1 -- 172.21.15.115:0/3925642095 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa00404c360 con 0x7fa00c14b1e0 2023-07-27T14:40:19.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.618+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000758326", "snap_name": "snapshot_0000000000899050", "target_sub_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7fa00c06b610 con 0x7f9fec05fd00 2023-07-27T14:40:19.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:19.777+0000 7f9ffa7fc700 1 -- 172.21.15.115:0/3925642095 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 38) v1 ==== 77522+0+0 (secure 0 0 0) 0x7fa004080070 con 0x7fa00c14b1e0 2023-07-27T14:40:20.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.292+0000 7f9ffa7fc700 1 -- 172.21.15.115:0/3925642095 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa00c06b610 con 0x7f9fec05fd00 2023-07-27T14:40:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fec05fd00 msgr2=0x7f9fec0621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fec05fd00 0x7f9fec0621c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f9ffc0011e0 tx=0x7f9ffc007bd0).stop 2023-07-27T14:40:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c14b1e0 msgr2=0x7fa00c0af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c14b1e0 0x7fa00c0af8d0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 rx=0x7fa004009f20 tx=0x7fa00400b040).stop 2023-07-27T14:40:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 shutdown_connections 2023-07-27T14:40:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fec05fd00 0x7f9fec0621c0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa00c14b1e0 0x7fa00c0af8d0 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa00c063260 0x7fa00c1677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 --2- 172.21.15.115:0/3925642095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa00c14ae00 0x7fa00c0c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 >> 172.21.15.115:0/3925642095 conn(0x7fa00c05e940 msgr2=0x7fa00c14a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:20.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 shutdown_connections 2023-07-27T14:40:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.295+0000 7fa010fff700 1 -- 172.21.15.115:0/3925642095 wait complete. 2023-07-27T14:40:20.353 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.297+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.354 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.297+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.354 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.297+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.354 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.297+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.354 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.297+0000 7fa78891c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.370 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000498154 2023-07-27T14:40:20.372 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.315+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.372 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.315+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.372 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.315+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.372 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.315+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.372 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:20.316+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:40:20.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.511+0000 7fc33a7ff700 1 Processor -- start 2023-07-27T14:40:20.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.511+0000 7fc33a7ff700 1 -- start start 2023-07-27T14:40:20.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.512+0000 7fc33a7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc3340bfb50 0x7fc3340c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:20.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc33a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:20.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc33a7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3340c60a0 con 0x7fc334153f30 2023-07-27T14:40:20.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc33a7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3340c0f90 con 0x7fc3340bfb50 2023-07-27T14:40:20.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc33a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340c5d70 con 0x7fc3340c0610 2023-07-27T14:40:20.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc338d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:20.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc3337fe700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc3340bfb50 0x7fc3340c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:20.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc338d9c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340c0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:44958/0 (socket says 172.21.15.115:44958) 2023-07-27T14:40:20.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc338d9c700 1 -- 172.21.15.115:0/3572444648 learned_addr learned my addr 172.21.15.115:0/3572444648 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:20.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.513+0000 7fc333fff700 1 --1- 172.21.15.115:0/3572444648 >> v1:172.21.15.159:6789/0 conn(0x7fc334153f30 0x7fc3340a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:34530/0 (socket says 172.21.15.115:34530) 2023-07-27T14:40:20.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc3337fe700 1 -- 172.21.15.115:0/3572444648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 msgr2=0x7fc3340c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:20.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc3337fe700 1 --2- 172.21.15.115:0/3572444648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340c0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc3337fe700 1 -- 172.21.15.115:0/3572444648 >> v1:172.21.15.159:6789/0 conn(0x7fc334153f30 legacy=0x7fc3340a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:20.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc3337fe700 1 -- 172.21.15.115:0/3572444648 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3340c7d80 con 0x7fc3340bfb50 2023-07-27T14:40:20.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc332ffd700 1 -- 172.21.15.115:0/3572444648 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582564094 0 0) 0x7fc3340c60a0 con 0x7fc334153f30 2023-07-27T14:40:20.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc338d9c700 1 --2- 172.21.15.115:0/3572444648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc3337fe700 1 --2- 172.21.15.115:0/3572444648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3340bfb50 0x7fc3340c7550 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc328009760 tx=0x7fc328009060).ready entity=mon.1 client_cookie=40f9a5b007f43e1f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc332ffd700 1 -- 172.21.15.115:0/3572444648 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800f510 con 0x7fc3340bfb50 2023-07-27T14:40:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc332ffd700 1 -- 172.21.15.115:0/3572444648 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32800f670 con 0x7fc3340bfb50 2023-07-27T14:40:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.514+0000 7fc332ffd700 1 -- 172.21.15.115:0/3572444648 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800f9f0 con 0x7fc3340bfb50 2023-07-27T14:40:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.515+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3572444648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3340bfb50 msgr2=0x7fc3340c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.515+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3572444648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3340bfb50 0x7fc3340c7550 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc328009760 tx=0x7fc328009060).stop 2023-07-27T14:40:20.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.515+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3572444648 shutdown_connections 2023-07-27T14:40:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.515+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3572444648 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.515+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3572444648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3340bfb50 0x7fc3340c7550 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.515+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3572444648 >> 172.21.15.115:0/3572444648 conn(0x7fc334094280 msgr2=0x7fc33405e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.515+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3572444648 shutdown_connections 2023-07-27T14:40:20.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.515+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3572444648 wait complete. 2023-07-27T14:40:20.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.516+0000 7fc33a7ff700 1 Processor -- start 2023-07-27T14:40:20.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.516+0000 7fc33a7ff700 1 -- start start 2023-07-27T14:40:20.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.517+0000 7fc33a7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3340bfb50 0x7fc3340aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:20.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.517+0000 7fc33a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:20.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.517+0000 7fc33a7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc334153f30 0x7fc3340b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:20.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.517+0000 7fc33a7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340b0d70 con 0x7fc3340bfb50 2023-07-27T14:40:20.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.517+0000 7fc33a7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340aa760 con 0x7fc334153f30 2023-07-27T14:40:20.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.517+0000 7fc33a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340ab580 con 0x7fc3340c0610 2023-07-27T14:40:20.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3340bfb50 0x7fc3340aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:20.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3340bfb50 0x7fc3340aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50930/0 (socket says 172.21.15.115:50930) 2023-07-27T14:40:20.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 -- 172.21.15.115:0/3789774819 learned_addr learned my addr 172.21.15.115:0/3789774819 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:20.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc3337fe700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc338d9c700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc334153f30 0x7fc3340b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 -- 172.21.15.115:0/3789774819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 msgr2=0x7fc3340b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 -- 172.21.15.115:0/3789774819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc334153f30 msgr2=0x7fc3340b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc334153f30 0x7fc3340b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 -- 172.21.15.115:0/3789774819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c009ae0 con 0x7fc3340bfb50 2023-07-27T14:40:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc333fff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3340bfb50 0x7fc3340aba10 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 rx=0x7fc32400c560 tx=0x7fc324007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:20.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.518+0000 7fc31bfff700 1 -- 172.21.15.115:0/3789774819 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3240072e0 con 0x7fc3340bfb50 2023-07-27T14:40:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.519+0000 7fc31bfff700 1 -- 172.21.15.115:0/3789774819 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc324007440 con 0x7fc3340bfb50 2023-07-27T14:40:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.519+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280092a0 con 0x7fc3340bfb50 2023-07-27T14:40:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.519+0000 7fc31bfff700 1 -- 172.21.15.115:0/3789774819 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3240058f0 con 0x7fc3340bfb50 2023-07-27T14:40:20.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.519+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3340aa9f0 con 0x7fc3340bfb50 2023-07-27T14:40:20.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.520+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33406c470 con 0x7fc3340bfb50 2023-07-27T14:40:20.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.520+0000 7fc31bfff700 1 -- 172.21.15.115:0/3789774819 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 77522+0+0 (secure 0 0 0) 0x7fc324010070 con 0x7fc3340bfb50 2023-07-27T14:40:20.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.521+0000 7fc31bfff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc32005fdc0 0x7fc320062280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:20.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.521+0000 7fc31bfff700 1 -- 172.21.15.115:0/3789774819 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fc32407a9d0 con 0x7fc3340bfb50 2023-07-27T14:40:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.521+0000 7fc3337fe700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc32005fdc0 0x7fc320062280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.522+0000 7fc3337fe700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc32005fdc0 0x7fc320062280 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fc3340c3bd0 tx=0x7fc328017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:20.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.525+0000 7fc31bfff700 1 -- 172.21.15.115:0/3789774819 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc32404af50 con 0x7fc3340bfb50 2023-07-27T14:40:20.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.734+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3340c80d0 con 0x7fc32005fdc0 2023-07-27T14:40:20.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.742+0000 7fc31bfff700 1 -- 172.21.15.115:0/3789774819 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7fc3340c80d0 con 0x7fc32005fdc0 2023-07-27T14:40:20.799 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:40:20.799 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:40:20.799 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:40:20.799 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:40:20.800 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:40:20.800 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000758326", 2023-07-27T14:40:20.800 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000899050" 2023-07-27T14:40:20.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:20.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:20.800 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:40:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.744+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc32005fdc0 msgr2=0x7fc320062280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.744+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc32005fdc0 0x7fc320062280 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fc3340c3bd0 tx=0x7fc328017000).stop 2023-07-27T14:40:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.744+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3340bfb50 msgr2=0x7fc3340aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:20.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.744+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3340bfb50 0x7fc3340aba10 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 rx=0x7fc32400c560 tx=0x7fc324007c90).stop 2023-07-27T14:40:20.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.744+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 shutdown_connections 2023-07-27T14:40:20.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.745+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc32005fdc0 0x7fc320062280 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.745+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc334153f30 0x7fc3340b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.745+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc3340bfb50 0x7fc3340aba10 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.745+0000 7fc33a7ff700 1 --2- 172.21.15.115:0/3789774819 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc3340c0610 0x7fc3340b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:20.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.745+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 >> 172.21.15.115:0/3789774819 conn(0x7fc334094280 msgr2=0x7fc33405e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:20.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.745+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 shutdown_connections 2023-07-27T14:40:20.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:20.745+0000 7fc33a7ff700 1 -- 172.21.15.115:0/3789774819 wait complete. 2023-07-27T14:40:21.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000498154 2023-07-27T14:40:22.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.965+0000 7f098ebff700 1 Processor -- start 2023-07-27T14:40:22.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.966+0000 7f098ebff700 1 -- start start 2023-07-27T14:40:22.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098ebff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f09881509b0 0x7f09880c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:22.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098ebff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09880c3100 0x7f09880c3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:22.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098ebff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09880c0ea0 con 0x7f0988150d90 2023-07-27T14:40:22.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098ebff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0988068e10 con 0x7f09880c3100 2023-07-27T14:40:22.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098ebff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0988155190 con 0x7f09881509b0 2023-07-27T14:40:22.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098d19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09880c3100 0x7f09880c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:22.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f0987fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0988150d90 0x7f0988154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41680/0 (socket says 172.21.15.115:41680) 2023-07-27T14:40:22.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098d19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09880c3100 0x7f09880c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50934/0 (socket says 172.21.15.115:50934) 2023-07-27T14:40:22.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f0987fff700 1 -- 172.21.15.115:0/110746975 learned_addr learned my addr 172.21.15.115:0/110746975 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:22.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098c99b700 1 --2- 172.21.15.115:0/110746975 >> v2:172.21.15.159:3300/0 conn(0x7f09881509b0 0x7f09880c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:22.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098d19c700 1 -- 172.21.15.115:0/110746975 >> v2:172.21.15.159:3300/0 conn(0x7f09881509b0 msgr2=0x7f09880c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:22.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f098d19c700 1 --2- 172.21.15.115:0/110746975 >> v2:172.21.15.159:3300/0 conn(0x7f09881509b0 0x7f09880c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.968+0000 7f098d19c700 1 -- 172.21.15.115:0/110746975 >> v1:172.21.15.115:6789/0 conn(0x7f0988150d90 legacy=0x7f0988154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:22.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.967+0000 7f09877fe700 1 -- 172.21.15.115:0/110746975 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43939476 0 0) 0x7f09880c0ea0 con 0x7f0988150d90 2023-07-27T14:40:22.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.968+0000 7f098d19c700 1 -- 172.21.15.115:0/110746975 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988155470 con 0x7f09880c3100 2023-07-27T14:40:22.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.968+0000 7f098d19c700 1 --2- 172.21.15.115:0/110746975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880c3540 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 rx=0x7f0988067850 tx=0x7f0980009780).ready entity=mon.0 client_cookie=1152b722d5a02c8a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:22.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.968+0000 7f09877fe700 1 -- 172.21.15.115:0/110746975 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000e070 con 0x7f09880c3100 2023-07-27T14:40:22.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.968+0000 7f09877fe700 1 -- 172.21.15.115:0/110746975 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000bb60 con 0x7f09880c3100 2023-07-27T14:40:22.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.968+0000 7f09877fe700 1 -- 172.21.15.115:0/110746975 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980012410 con 0x7f09880c3100 2023-07-27T14:40:22.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.968+0000 7f098ebff700 1 -- 172.21.15.115:0/110746975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 msgr2=0x7f09880c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:22.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.968+0000 7f098ebff700 1 --2- 172.21.15.115:0/110746975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880c3540 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 rx=0x7f0988067850 tx=0x7f0980009780).stop 2023-07-27T14:40:22.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.969+0000 7f098ebff700 1 -- 172.21.15.115:0/110746975 shutdown_connections 2023-07-27T14:40:22.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.969+0000 7f098ebff700 1 --2- 172.21.15.115:0/110746975 >> v2:172.21.15.159:3300/0 conn(0x7f09881509b0 0x7f09880c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.969+0000 7f098ebff700 1 --2- 172.21.15.115:0/110746975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880c3540 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.969+0000 7f098ebff700 1 -- 172.21.15.115:0/110746975 >> 172.21.15.115:0/110746975 conn(0x7f0988062320 msgr2=0x7f0988062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:22.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.969+0000 7f098ebff700 1 -- 172.21.15.115:0/110746975 shutdown_connections 2023-07-27T14:40:22.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.969+0000 7f098ebff700 1 -- 172.21.15.115:0/110746975 wait complete. 2023-07-27T14:40:22.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.970+0000 7f098ebff700 1 Processor -- start 2023-07-27T14:40:22.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.970+0000 7f098ebff700 1 -- start start 2023-07-27T14:40:22.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.971+0000 7f098ebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:22.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.971+0000 7f098ebff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09881509b0 0x7f09880ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:22.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.971+0000 7f098ebff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0988150d90 0x7f09880a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:22.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.971+0000 7f098ebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988168710 con 0x7f09880c3100 2023-07-27T14:40:22.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.971+0000 7f098ebff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988167a90 con 0x7f0988150d90 2023-07-27T14:40:22.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.971+0000 7f098ebff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0988167d70 con 0x7f09881509b0 2023-07-27T14:40:22.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.971+0000 7f098c99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:22.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098c99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880a9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50936/0 (socket says 172.21.15.115:50936) 2023-07-27T14:40:22.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098c99b700 1 -- 172.21.15.115:0/4233538467 learned_addr learned my addr 172.21.15.115:0/4233538467 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:22.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098d19c700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0988150d90 0x7f09880a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:22.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f0987fff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09881509b0 0x7f09880ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:22.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098c99b700 1 -- 172.21.15.115:0/4233538467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09881509b0 msgr2=0x7f09880ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:22.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098c99b700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09881509b0 0x7f09880ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098c99b700 1 -- 172.21.15.115:0/4233538467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0988150d90 msgr2=0x7f09880a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:22.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098c99b700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0988150d90 0x7f09880a56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098c99b700 1 -- 172.21.15.115:0/4233538467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980009a20 con 0x7f09880c3100 2023-07-27T14:40:22.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098c99b700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880a9180 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 rx=0x7f097c00e930 tx=0x7f097c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:22.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f0984ff9700 1 -- 172.21.15.115:0/4233538467 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00eed0 con 0x7f09880c3100 2023-07-27T14:40:22.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f0984ff9700 1 -- 172.21.15.115:0/4233538467 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c00c850 con 0x7f09880c3100 2023-07-27T14:40:22.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0988168050 con 0x7f09880c3100 2023-07-27T14:40:22.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f0984ff9700 1 -- 172.21.15.115:0/4233538467 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00cbd0 con 0x7f09880c3100 2023-07-27T14:40:22.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.972+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09880ab830 con 0x7f09880c3100 2023-07-27T14:40:22.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.973+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098806c470 con 0x7f09880c3100 2023-07-27T14:40:22.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.974+0000 7f0984ff9700 1 -- 172.21.15.115:0/4233538467 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f097c022070 con 0x7f09880c3100 2023-07-27T14:40:22.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.975+0000 7f0984ff9700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f096c05fe20 0x7f096c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:22.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.975+0000 7f0984ff9700 1 -- 172.21.15.115:0/4233538467 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f097c07b980 con 0x7f09880c3100 2023-07-27T14:40:22.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.975+0000 7f0987fff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f096c05fe20 0x7f096c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:22.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.976+0000 7f0987fff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f096c05fe20 0x7f096c0622e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f09880bc9f0 tx=0x7f0974009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:22.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:21.979+0000 7f0984ff9700 1 -- 172.21.15.115:0/4233538467 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f097c04be70 con 0x7f09880c3100 2023-07-27T14:40:22.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.187+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7f098806b240 con 0x7f096c05fe20 2023-07-27T14:40:22.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.193+0000 7f0984ff9700 1 -- 172.21.15.115:0/4233538467 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f098806b240 con 0x7f096c05fe20 2023-07-27T14:40:22.249 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:40:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:40:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:40:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:40:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:40:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000758326", 2023-07-27T14:40:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000899050" 2023-07-27T14:40:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:22.251 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:40:22.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f096c05fe20 msgr2=0x7f096c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:22.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f096c05fe20 0x7f096c0622e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f09880bc9f0 tx=0x7f0974009040).stop 2023-07-27T14:40:22.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 msgr2=0x7f09880a9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:22.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880a9180 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 rx=0x7f097c00e930 tx=0x7f097c009060).stop 2023-07-27T14:40:22.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 shutdown_connections 2023-07-27T14:40:22.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f096c05fe20 0x7f096c0622e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0988150d90 0x7f09880a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880c3100 0x7f09880a9180 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 --2- 172.21.15.115:0/4233538467 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09881509b0 0x7f09880ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:22.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 >> 172.21.15.115:0/4233538467 conn(0x7f0988062320 msgr2=0x7f09880bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:22.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 shutdown_connections 2023-07-27T14:40:22.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:22.195+0000 7f098ebff700 1 -- 172.21.15.115:0/4233538467 wait complete. 2023-07-27T14:40:23.270 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000498154 2023-07-27T14:40:23.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.408+0000 7f6378fff700 1 Processor -- start 2023-07-27T14:40:23.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.408+0000 7f6378fff700 1 -- start start 2023-07-27T14:40:23.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.409+0000 7f6378fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6374150220 0x7f6374150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.409+0000 7f6378fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f6374065220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.409+0000 7f6378fff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6374068bb0 con 0x7f6374069040 2023-07-27T14:40:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.409+0000 7f6378fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637406a250 con 0x7f6374150220 2023-07-27T14:40:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.409+0000 7f6378fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63740c1380 con 0x7f63740c0ea0 2023-07-27T14:40:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f6371d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f6374065220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f6371d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f6374065220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:44968/0 (socket says 172.21.15.115:44968) 2023-07-27T14:40:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f6371d9b700 1 -- 172.21.15.115:0/1080179376 learned_addr learned my addr 172.21.15.115:0/1080179376 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f637259c700 1 --2- 172.21.15.115:0/1080179376 >> v2:172.21.15.159:3300/0 conn(0x7f6374150220 0x7f6374150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f637159a700 1 -- 172.21.15.115:0/1080179376 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840144896 0 0) 0x7f6374068bb0 con 0x7f6374069040 2023-07-27T14:40:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f637159a700 1 -- 172.21.15.115:0/1080179376 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f635c0033f0 con 0x7f6374069040 2023-07-27T14:40:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f6371d9b700 1 -- 172.21.15.115:0/1080179376 >> v2:172.21.15.159:3300/0 conn(0x7f6374150220 msgr2=0x7f6374150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:23.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f6371d9b700 1 --2- 172.21.15.115:0/1080179376 >> v2:172.21.15.159:3300/0 conn(0x7f6374150220 0x7f6374150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f6371d9b700 1 -- 172.21.15.115:0/1080179376 >> v1:172.21.15.159:6789/0 conn(0x7f6374069040 legacy=0x7f63740c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:23.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f6371d9b700 1 -- 172.21.15.115:0/1080179376 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6374068560 con 0x7f63740c0ea0 2023-07-27T14:40:23.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.410+0000 7f637259c700 1 --2- 172.21.15.115:0/1080179376 >> v2:172.21.15.159:3300/0 conn(0x7f6374150220 0x7f6374150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:23.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f6371d9b700 1 --2- 172.21.15.115:0/1080179376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f6374065220 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f6368006fd0 tx=0x7f63680090f0).ready entity=mon.2 client_cookie=31060375bf8317b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:23.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f637159a700 1 -- 172.21.15.115:0/1080179376 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636800f510 con 0x7f63740c0ea0 2023-07-27T14:40:23.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f637159a700 1 -- 172.21.15.115:0/1080179376 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636800f670 con 0x7f63740c0ea0 2023-07-27T14:40:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f637159a700 1 -- 172.21.15.115:0/1080179376 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636800f9f0 con 0x7f63740c0ea0 2023-07-27T14:40:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f6378fff700 1 -- 172.21.15.115:0/1080179376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 msgr2=0x7f6374065220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f6378fff700 1 --2- 172.21.15.115:0/1080179376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f6374065220 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f6368006fd0 tx=0x7f63680090f0).stop 2023-07-27T14:40:23.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f6378fff700 1 -- 172.21.15.115:0/1080179376 shutdown_connections 2023-07-27T14:40:23.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f6378fff700 1 --2- 172.21.15.115:0/1080179376 >> v2:172.21.15.159:3300/0 conn(0x7f6374150220 0x7f6374150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f6378fff700 1 --2- 172.21.15.115:0/1080179376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f6374065220 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.411+0000 7f6378fff700 1 -- 172.21.15.115:0/1080179376 >> 172.21.15.115:0/1080179376 conn(0x7f6374062320 msgr2=0x7f6374062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:23.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.412+0000 7f6378fff700 1 -- 172.21.15.115:0/1080179376 shutdown_connections 2023-07-27T14:40:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.412+0000 7f6378fff700 1 -- 172.21.15.115:0/1080179376 wait complete. 2023-07-27T14:40:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.414+0000 7f6378fff700 1 Processor -- start 2023-07-27T14:40:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.414+0000 7f6378fff700 1 -- start start 2023-07-27T14:40:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f6378fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6374069040 0x7f6374165f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f6378fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f63741551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f6378fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6374150220 0x7f6374152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f6378fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6374166400 con 0x7f6374069040 2023-07-27T14:40:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f6378fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6374162c90 con 0x7f6374150220 2023-07-27T14:40:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f6378fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637414f9b0 con 0x7f63740c0ea0 2023-07-27T14:40:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f637259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6374069040 0x7f6374165f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f637259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6374069040 0x7f6374165f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50938/0 (socket says 172.21.15.115:50938) 2023-07-27T14:40:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f637259c700 1 -- 172.21.15.115:0/1353906935 learned_addr learned my addr 172.21.15.115:0/1353906935 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:23.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f6372d9d700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6374150220 0x7f6374152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:23.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.415+0000 7f6371d9b700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f63741551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:23.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f637259c700 1 -- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 msgr2=0x7f63741551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:23.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f637259c700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f63741551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f637259c700 1 -- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6374150220 msgr2=0x7f6374152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:23.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f637259c700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6374150220 0x7f6374152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f637259c700 1 -- 172.21.15.115:0/1353906935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636400a440 con 0x7f6374069040 2023-07-27T14:40:23.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f6372d9d700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6374150220 0x7f6374152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:23.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f637259c700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6374069040 0x7f6374165f10 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 rx=0x7f636400e920 tx=0x7f636400a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:23.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f63627fc700 1 -- 172.21.15.115:0/1353906935 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400c6f0 con 0x7f6374069040 2023-07-27T14:40:23.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6368009370 con 0x7f6374069040 2023-07-27T14:40:23.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f63627fc700 1 -- 172.21.15.115:0/1353906935 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636400c850 con 0x7f6374069040 2023-07-27T14:40:23.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f63627fc700 1 -- 172.21.15.115:0/1353906935 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400cbd0 con 0x7f6374069040 2023-07-27T14:40:23.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.416+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6374162360 con 0x7f6374069040 2023-07-27T14:40:23.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.417+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63740c26a0 con 0x7f6374069040 2023-07-27T14:40:23.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.418+0000 7f63627fc700 1 -- 172.21.15.115:0/1353906935 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f6364021070 con 0x7f6374069040 2023-07-27T14:40:23.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.419+0000 7f63627fc700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f635405fe20 0x7f63540622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:23.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.419+0000 7f63627fc700 1 -- 172.21.15.115:0/1353906935 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f636407b6f0 con 0x7f6374069040 2023-07-27T14:40:23.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.419+0000 7f6371d9b700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f635405fe20 0x7f63540622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:23.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.420+0000 7f6371d9b700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f635405fe20 0x7f63540622e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f6368009130 tx=0x7f6368017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:23.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.423+0000 7f63627fc700 1 -- 172.21.15.115:0/1353906935 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f636404bc60 con 0x7f6374069040 2023-07-27T14:40:23.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.634+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7f637406c470 con 0x7f635405fe20 2023-07-27T14:40:23.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.741+0000 7f63627fc700 1 -- 172.21.15.115:0/1353906935 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f637406c470 con 0x7f635405fe20 2023-07-27T14:40:23.798 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:40:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:40:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:40:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:23.798 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:40:23.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f635405fe20 msgr2=0x7f63540622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:23.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f635405fe20 0x7f63540622e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f6368009130 tx=0x7f6368017000).stop 2023-07-27T14:40:23.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6374069040 msgr2=0x7f6374165f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:23.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6374069040 0x7f6374165f10 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 rx=0x7f636400e920 tx=0x7f636400a200).stop 2023-07-27T14:40:23.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 shutdown_connections 2023-07-27T14:40:23.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f635405fe20 0x7f63540622e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6374150220 0x7f6374152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6374069040 0x7f6374165f10 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 --2- 172.21.15.115:0/1353906935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f63740c0ea0 0x7f63741551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:23.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 >> 172.21.15.115:0/1353906935 conn(0x7f6374062320 msgr2=0x7f63740bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:23.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 shutdown_connections 2023-07-27T14:40:23.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.743+0000 7f6378fff700 1 -- 172.21.15.115:0/1353906935 wait complete. 2023-07-27T14:40:23.817 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000498154 2023-07-27T14:40:24.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.953+0000 7f56613ff700 1 Processor -- start 2023-07-27T14:40:24.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.953+0000 7f56613ff700 1 -- start start 2023-07-27T14:40:24.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.954+0000 7f56613ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f565c0c0ea0 0x7f565c150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.954+0000 7f56613ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c068bb0 con 0x7f565c150220 2023-07-27T14:40:24.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.954+0000 7f56613ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c06a250 con 0x7f565c065220 2023-07-27T14:40:24.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.954+0000 7f56613ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0656b0 con 0x7f565c0c0ea0 2023-07-27T14:40:24.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f565a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f565c0c0ea0 0x7f565c150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f565a7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f565c0c0ea0 0x7f565c150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42950/0 (socket says 172.21.15.115:42950) 2023-07-27T14:40:24.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f565a7fc700 1 -- 172.21.15.115:0/232978295 learned_addr learned my addr 172.21.15.115:0/232978295 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:24.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f565affd700 1 --1- 172.21.15.115:0/232978295 >> v1:172.21.15.115:6789/0 conn(0x7f565c150220 0x7f565c069040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54680/0 (socket says 172.21.15.115:54680) 2023-07-27T14:40:24.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f565a7fc700 1 -- 172.21.15.115:0/232978295 >> v1:172.21.15.159:6789/0 conn(0x7f565c065220 legacy=0x7f565c0c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:24.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f565a7fc700 1 -- 172.21.15.115:0/232978295 >> v1:172.21.15.115:6789/0 conn(0x7f565c150220 legacy=0x7f565c069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f5659ffb700 1 -- 172.21.15.115:0/232978295 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437070825 0 0) 0x7f565c068bb0 con 0x7f565c150220 2023-07-27T14:40:24.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f565a7fc700 1 -- 172.21.15.115:0/232978295 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0c1380 con 0x7f565c0c0ea0 2023-07-27T14:40:24.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f565a7fc700 1 --2- 172.21.15.115:0/232978295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c150600 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 rx=0x7f5650009830 tx=0x7f56500090f0).ready entity=mon.0 client_cookie=f212c9b196a7ec40 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:24.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.955+0000 7f5659ffb700 1 -- 172.21.15.115:0/232978295 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000b600 con 0x7f565c0c0ea0 2023-07-27T14:40:24.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f5659ffb700 1 -- 172.21.15.115:0/232978295 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000b760 con 0x7f565c0c0ea0 2023-07-27T14:40:24.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f5659ffb700 1 -- 172.21.15.115:0/232978295 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000bae0 con 0x7f565c0c0ea0 2023-07-27T14:40:24.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f56613ff700 1 -- 172.21.15.115:0/232978295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 msgr2=0x7f565c150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f56613ff700 1 --2- 172.21.15.115:0/232978295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c150600 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 rx=0x7f5650009830 tx=0x7f56500090f0).stop 2023-07-27T14:40:24.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f56613ff700 1 -- 172.21.15.115:0/232978295 shutdown_connections 2023-07-27T14:40:24.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f56613ff700 1 --2- 172.21.15.115:0/232978295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c150600 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f56613ff700 1 -- 172.21.15.115:0/232978295 >> 172.21.15.115:0/232978295 conn(0x7f565c062320 msgr2=0x7f565c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:24.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f56613ff700 1 -- 172.21.15.115:0/232978295 shutdown_connections 2023-07-27T14:40:24.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.956+0000 7f56613ff700 1 -- 172.21.15.115:0/232978295 wait complete. 2023-07-27T14:40:24.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.958+0000 7f56613ff700 1 Processor -- start 2023-07-27T14:40:24.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.958+0000 7f56613ff700 1 -- start start 2023-07-27T14:40:24.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f56613ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c065220 0x7f565c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f56613ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c064340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f56613ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c150220 0x7f565c0aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f56613ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0a7c90 con 0x7f565c0c0ea0 2023-07-27T14:40:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f56613ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0a7f30 con 0x7f565c065220 2023-07-27T14:40:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f56613ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0a8210 con 0x7f565c150220 2023-07-27T14:40:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c064340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c064340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42956/0 (socket says 172.21.15.115:42956) 2023-07-27T14:40:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 -- 172.21.15.115:0/2414399901 learned_addr learned my addr 172.21.15.115:0/2414399901 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565affd700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c065220 0x7f565c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565b7fe700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c150220 0x7f565c0aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 -- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c150220 msgr2=0x7f565c0aa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c150220 0x7f565c0aa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 -- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c065220 msgr2=0x7f565c14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c065220 0x7f565c14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 -- 172.21.15.115:0/2414399901 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650009370 con 0x7f565c0c0ea0 2023-07-27T14:40:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565affd700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c065220 0x7f565c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.959+0000 7f565a7fc700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c064340 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 rx=0x7f5650008000 tx=0x7f5650017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.960+0000 7f5642ffd700 1 -- 172.21.15.115:0/2414399901 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000b8d0 con 0x7f565c0c0ea0 2023-07-27T14:40:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.960+0000 7f5642ffd700 1 -- 172.21.15.115:0/2414399901 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000ba30 con 0x7f565c0c0ea0 2023-07-27T14:40:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.960+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c0a84f0 con 0x7f565c0c0ea0 2023-07-27T14:40:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.960+0000 7f5642ffd700 1 -- 172.21.15.115:0/2414399901 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565001c650 con 0x7f565c0c0ea0 2023-07-27T14:40:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.960+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c0a8ab0 con 0x7f565c0c0ea0 2023-07-27T14:40:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.961+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c0a8ca0 con 0x7f565c0c0ea0 2023-07-27T14:40:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.962+0000 7f5642ffd700 1 -- 172.21.15.115:0/2414399901 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f565002c070 con 0x7f565c0c0ea0 2023-07-27T14:40:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.963+0000 7f5642ffd700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564805fe20 0x7f56480622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.963+0000 7f5642ffd700 1 -- 172.21.15.115:0/2414399901 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f565007d400 con 0x7f565c0c0ea0 2023-07-27T14:40:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.963+0000 7f565affd700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564805fe20 0x7f56480622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.964+0000 7f565affd700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564805fe20 0x7f56480622e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f564c0011e0 tx=0x7f564c007b10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:23.967+0000 7f5642ffd700 1 -- 172.21.15.115:0/2414399901 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f565004d7e0 con 0x7f565c0c0ea0 2023-07-27T14:40:24.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.167+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7f565c068560 con 0x7f564805fe20 2023-07-27T14:40:24.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.173+0000 7f5642ffd700 1 -- 172.21.15.115:0/2414399901 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f565c068560 con 0x7f564805fe20 2023-07-27T14:40:24.230 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1 2023-07-27T14:40:24.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564805fe20 msgr2=0x7f56480622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564805fe20 0x7f56480622e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f564c0011e0 tx=0x7f564c007b10).stop 2023-07-27T14:40:24.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 msgr2=0x7f565c064340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c064340 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 rx=0x7f5650008000 tx=0x7f5650017000).stop 2023-07-27T14:40:24.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 shutdown_connections 2023-07-27T14:40:24.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f564805fe20 0x7f56480622e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565c150220 0x7f565c0aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f565c065220 0x7f565c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 --2- 172.21.15.115:0/2414399901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565c0c0ea0 0x7f565c064340 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 >> 172.21.15.115:0/2414399901 conn(0x7f565c062320 msgr2=0x7f565c0bc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:24.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 shutdown_connections 2023-07-27T14:40:24.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.176+0000 7f56613ff700 1 -- 172.21.15.115:0/2414399901 wait complete. 2023-07-27T14:40:24.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs clone_0000000000498154 2023-07-27T14:40:24.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.383+0000 7fe9a97ff700 1 Processor -- start 2023-07-27T14:40:24.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.383+0000 7fe9a97ff700 1 -- start start 2023-07-27T14:40:24.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.384+0000 7fe9a97ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe9a40c6b70 0x7fe9a40656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.384+0000 7fe9a97ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe9a4065bc0 0x7fe9a4062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a97ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a4066050 con 0x7fe9a4153e00 2023-07-27T14:40:24.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a97ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a4062320 con 0x7fe9a4065bc0 2023-07-27T14:40:24.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a97ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a4064a80 con 0x7fe9a40c6b70 2023-07-27T14:40:24.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe9a4153e00 0x7fe9a4064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54692/0 (socket says 172.21.15.115:54692) 2023-07-27T14:40:24.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a2ffd700 1 -- 172.21.15.115:0/3354970303 learned_addr learned my addr 172.21.15.115:0/3354970303 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:24.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a37fe700 1 --2- 172.21.15.115:0/3354970303 >> v2:172.21.15.115:3300/0 conn(0x7fe9a4065bc0 0x7fe9a4062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a1ffb700 1 -- 172.21.15.115:0/3354970303 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800349067 0 0) 0x7fe9a4066050 con 0x7fe9a4153e00 2023-07-27T14:40:24.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a1ffb700 1 -- 172.21.15.115:0/3354970303 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe98c0033f0 con 0x7fe9a4153e00 2023-07-27T14:40:24.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a27fc700 1 --2- 172.21.15.115:0/3354970303 >> v2:172.21.15.159:3300/0 conn(0x7fe9a40c6b70 0x7fe9a40656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a37fe700 1 -- 172.21.15.115:0/3354970303 >> v2:172.21.15.159:3300/0 conn(0x7fe9a40c6b70 msgr2=0x7fe9a40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:24.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a37fe700 1 --2- 172.21.15.115:0/3354970303 >> v2:172.21.15.159:3300/0 conn(0x7fe9a40c6b70 0x7fe9a40656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a37fe700 1 -- 172.21.15.115:0/3354970303 >> v1:172.21.15.115:6789/0 conn(0x7fe9a4153e00 legacy=0x7fe9a4064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a37fe700 1 -- 172.21.15.115:0/3354970303 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4064d60 con 0x7fe9a4065bc0 2023-07-27T14:40:24.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a27fc700 1 --2- 172.21.15.115:0/3354970303 >> v2:172.21.15.159:3300/0 conn(0x7fe9a40c6b70 0x7fe9a40656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:24.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.385+0000 7fe9a37fe700 1 --2- 172.21.15.115:0/3354970303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a4065bc0 0x7fe9a4062770 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 rx=0x7fe9a40c3b80 tx=0x7fe99c009780).ready entity=mon.0 client_cookie=44bf6896d1da8c1e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:24.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a1ffb700 1 -- 172.21.15.115:0/3354970303 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00e070 con 0x7fe9a4065bc0 2023-07-27T14:40:24.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a1ffb700 1 -- 172.21.15.115:0/3354970303 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c00bb60 con 0x7fe9a4065bc0 2023-07-27T14:40:24.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a1ffb700 1 -- 172.21.15.115:0/3354970303 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c012410 con 0x7fe9a4065bc0 2023-07-27T14:40:24.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a97ff700 1 -- 172.21.15.115:0/3354970303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a4065bc0 msgr2=0x7fe9a4062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/3354970303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a4065bc0 0x7fe9a4062770 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 rx=0x7fe9a40c3b80 tx=0x7fe99c009780).stop 2023-07-27T14:40:24.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a97ff700 1 -- 172.21.15.115:0/3354970303 shutdown_connections 2023-07-27T14:40:24.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/3354970303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a4065bc0 0x7fe9a4062770 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/3354970303 >> v2:172.21.15.159:3300/0 conn(0x7fe9a40c6b70 0x7fe9a40656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a97ff700 1 -- 172.21.15.115:0/3354970303 >> 172.21.15.115:0/3354970303 conn(0x7fe9a40c7b90 msgr2=0x7fe9a40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:24.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a97ff700 1 -- 172.21.15.115:0/3354970303 shutdown_connections 2023-07-27T14:40:24.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.386+0000 7fe9a97ff700 1 -- 172.21.15.115:0/3354970303 wait complete. 2023-07-27T14:40:24.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.388+0000 7fe9a97ff700 1 Processor -- start 2023-07-27T14:40:24.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.388+0000 7fe9a97ff700 1 -- start start 2023-07-27T14:40:24.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a97ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a4065bc0 0x7fe9a4155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a97ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a40c6b70 0x7fe9a4151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a97ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a4153e00 0x7fe9a4156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a97ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a41562e0 con 0x7fe9a40c6b70 2023-07-27T14:40:24.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a97ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40a8e70 con 0x7fe9a4153e00 2023-07-27T14:40:24.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a97ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a41522d0 con 0x7fe9a4065bc0 2023-07-27T14:40:24.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a40c6b70 0x7fe9a4151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a27fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a40c6b70 0x7fe9a4151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42960/0 (socket says 172.21.15.115:42960) 2023-07-27T14:40:24.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a27fc700 1 -- 172.21.15.115:0/710552076 learned_addr learned my addr 172.21.15.115:0/710552076 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:24.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a37fe700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a4153e00 0x7fe9a4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a2ffd700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a4065bc0 0x7fe9a4155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a27fc700 1 -- 172.21.15.115:0/710552076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a4065bc0 msgr2=0x7fe9a4155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a27fc700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a4065bc0 0x7fe9a4155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.389+0000 7fe9a27fc700 1 -- 172.21.15.115:0/710552076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a4153e00 msgr2=0x7fe9a4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.390+0000 7fe9a27fc700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a4153e00 0x7fe9a4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.390+0000 7fe9a27fc700 1 -- 172.21.15.115:0/710552076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c009a20 con 0x7fe9a40c6b70 2023-07-27T14:40:24.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.390+0000 7fe9a27fc700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a40c6b70 0x7fe9a4151de0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 rx=0x7fe99800c880 tx=0x7fe998008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:24.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.390+0000 7fe98affd700 1 -- 172.21.15.115:0/710552076 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998010580 con 0x7fe9a40c6b70 2023-07-27T14:40:24.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.390+0000 7fe98affd700 1 -- 172.21.15.115:0/710552076 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9980106e0 con 0x7fe9a40c6b70 2023-07-27T14:40:24.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.390+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a40a8260 con 0x7fe9a40c6b70 2023-07-27T14:40:24.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.390+0000 7fe98affd700 1 -- 172.21.15.115:0/710552076 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998010a60 con 0x7fe9a40c6b70 2023-07-27T14:40:24.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.390+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a40a8820 con 0x7fe9a40c6b70 2023-07-27T14:40:24.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.391+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a40a9000 con 0x7fe9a40c6b70 2023-07-27T14:40:24.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.392+0000 7fe98affd700 1 -- 172.21.15.115:0/710552076 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fe99801b460 con 0x7fe9a40c6b70 2023-07-27T14:40:24.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.393+0000 7fe98affd700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe99005fe20 0x7fe9900622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:24.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.393+0000 7fe98affd700 1 -- 172.21.15.115:0/710552076 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fe99807b710 con 0x7fe9a40c6b70 2023-07-27T14:40:24.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.393+0000 7fe9a2ffd700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe99005fe20 0x7fe9900622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:24.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.393+0000 7fe9a2ffd700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe99005fe20 0x7fe9900622e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fe994005750 tx=0x7fe994009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:24.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.397+0000 7fe98affd700 1 -- 172.21.15.115:0/710552076 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe99804ba90 con 0x7fe9a40c6b70 2023-07-27T14:40:24.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.602+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9a4065040 con 0x7fe99005fe20 2023-07-27T14:40:24.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.612+0000 7fe98affd700 1 -- 172.21.15.115:0/710552076 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+714 (secure 0 0 0) 0x7fe9a4065040 con 0x7fe99005fe20 2023-07-27T14:40:24.669 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:40:24.669 INFO:teuthology.orchestra.run.smithi115.stdout: "atime": "2023-07-27 14:40:16", 2023-07-27T14:40:24.669 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_pcent": "undefined", 2023-07-27T14:40:24.670 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_quota": "infinite", 2023-07-27T14:40:24.670 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_used": 16777216, 2023-07-27T14:40:24.670 INFO:teuthology.orchestra.run.smithi115.stdout: "created_at": "2023-07-27 14:40:20", 2023-07-27T14:40:24.670 INFO:teuthology.orchestra.run.smithi115.stdout: "ctime": "2023-07-27 14:40:22", 2023-07-27T14:40:24.670 INFO:teuthology.orchestra.run.smithi115.stdout: "data_pool": "cephfs_data", 2023-07-27T14:40:24.670 INFO:teuthology.orchestra.run.smithi115.stdout: "features": [ 2023-07-27T14:40:24.671 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-clone", 2023-07-27T14:40:24.671 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-autoprotect", 2023-07-27T14:40:24.671 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-retention" 2023-07-27T14:40:24.671 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:40:24.671 INFO:teuthology.orchestra.run.smithi115.stdout: "gid": 0, 2023-07-27T14:40:24.671 INFO:teuthology.orchestra.run.smithi115.stdout: "mode": 16895, 2023-07-27T14:40:24.671 INFO:teuthology.orchestra.run.smithi115.stdout: "mon_addrs": [ 2023-07-27T14:40:24.672 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.115:6789", 2023-07-27T14:40:24.672 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6789", 2023-07-27T14:40:24.672 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6790" 2023-07-27T14:40:24.672 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:40:24.672 INFO:teuthology.orchestra.run.smithi115.stdout: "mtime": "2023-07-27 14:40:18", 2023-07-27T14:40:24.672 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1", 2023-07-27T14:40:24.672 INFO:teuthology.orchestra.run.smithi115.stdout: "pool_namespace": "", 2023-07-27T14:40:24.672 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete", 2023-07-27T14:40:24.673 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "clone", 2023-07-27T14:40:24.673 INFO:teuthology.orchestra.run.smithi115.stdout: "uid": 0 2023-07-27T14:40:24.674 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:40:24.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.614+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe99005fe20 msgr2=0x7fe9900622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.614+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe99005fe20 0x7fe9900622e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fe994005750 tx=0x7fe994009040).stop 2023-07-27T14:40:24.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.614+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a40c6b70 msgr2=0x7fe9a4151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:24.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.614+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a40c6b70 0x7fe9a4151de0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 rx=0x7fe99800c880 tx=0x7fe998008040).stop 2023-07-27T14:40:24.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.615+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 shutdown_connections 2023-07-27T14:40:24.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.615+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe99005fe20 0x7fe9900622e0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.615+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a4153e00 0x7fe9a4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.615+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe9a4065bc0 0x7fe9a4155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.615+0000 7fe9a97ff700 1 --2- 172.21.15.115:0/710552076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9a40c6b70 0x7fe9a4151de0 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:24.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.615+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 >> 172.21.15.115:0/710552076 conn(0x7fe9a40c7b90 msgr2=0x7fe9a40a3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:24.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.615+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 shutdown_connections 2023-07-27T14:40:24.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:24.615+0000 7fe9a97ff700 1 -- 172.21.15.115:0/710552076 wait complete. 2023-07-27T14:40:24.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:24.689 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4) 2023-07-27T14:40:24.737 INFO:teuthology.orchestra.run.smithi115.stderr:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4: ceph.quota.max_bytes: No such attribute 2023-07-27T14:40:24.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:40:24.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:24.740 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4) 2023-07-27T14:40:24.788 INFO:teuthology.orchestra.run.smithi115.stdout:cephfs_data 2023-07-27T14:40:24.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:24.789 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4) 2023-07-27T14:40:24.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:24.876 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4) 2023-07-27T14:40:24.923 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4 2023-07-27T14:40:24.924 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.2 2023-07-27T14:40:24.924 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.14 2023-07-27T14:40:24.924 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.13 2023-07-27T14:40:24.924 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.10 2023-07-27T14:40:24.924 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.5 2023-07-27T14:40:24.925 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.4 2023-07-27T14:40:24.925 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.7 2023-07-27T14:40:24.925 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.6 2023-07-27T14:40:24.925 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.0 2023-07-27T14:40:24.925 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.9 2023-07-27T14:40:24.925 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.15 2023-07-27T14:40:24.925 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.8 2023-07-27T14:40:24.925 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.11 2023-07-27T14:40:24.926 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.3 2023-07-27T14:40:24.926 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.12 2023-07-27T14:40:24.926 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.1 2023-07-27T14:40:24.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:24.927 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4) 2023-07-27T14:40:24.973 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:40:24.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:24.974 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/) 2023-07-27T14:40:25.061 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:40:25.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.063 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4) 2023-07-27T14:40:25.109 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:40:25.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.111 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/) 2023-07-27T14:40:25.195 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:40:25.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.197 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4) 2023-07-27T14:40:25.285 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:40:25.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.287 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/) 2023-07-27T14:40:25.333 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:40:25.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.335 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4) 2023-07-27T14:40:25.419 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:25.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.421 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/) 2023-07-27T14:40:25.513 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:25.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.515 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.2) 2023-07-27T14:40:25.601 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:25.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.603 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.2) 2023-07-27T14:40:25.653 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:25.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.655 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.2) 2023-07-27T14:40:25.701 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:25.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.702 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.2) 2023-07-27T14:40:25.788 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:25.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.790 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.2) 2023-07-27T14:40:25.835 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:25.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.836 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.2) 2023-07-27T14:40:25.922 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:25.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.923 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.2) 2023-07-27T14:40:25.969 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:25.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:25.970 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.2) 2023-07-27T14:40:26.016 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:26.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.018 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.14) 2023-07-27T14:40:26.064 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:26.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.067 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.14) 2023-07-27T14:40:26.117 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:26.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.119 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.14) 2023-07-27T14:40:26.164 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:26.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.166 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.14) 2023-07-27T14:40:26.252 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:26.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.253 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.14) 2023-07-27T14:40:26.299 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:26.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.301 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.14) 2023-07-27T14:40:26.346 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:26.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.348 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.14) 2023-07-27T14:40:26.393 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:26.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.394 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.14) 2023-07-27T14:40:26.480 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:26.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.482 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.13) 2023-07-27T14:40:26.528 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:26.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.529 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.13) 2023-07-27T14:40:26.620 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:26.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.621 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.13) 2023-07-27T14:40:26.667 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:26.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.668 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.13) 2023-07-27T14:40:26.754 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:26.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.755 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.13) 2023-07-27T14:40:26.841 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:26.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.842 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.13) 2023-07-27T14:40:26.889 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:26.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.890 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.13) 2023-07-27T14:40:26.936 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:26.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.13) 2023-07-27T14:40:26.984 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:26.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:26.986 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.10) 2023-07-27T14:40:27.032 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:27.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.033 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.10) 2023-07-27T14:40:27.085 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:27.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.086 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.10) 2023-07-27T14:40:27.132 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:27.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.134 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.10) 2023-07-27T14:40:27.179 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:27.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.181 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.10) 2023-07-27T14:40:27.226 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:27.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.228 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.10) 2023-07-27T14:40:27.314 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:27.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.316 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.10) 2023-07-27T14:40:27.361 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:27.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.363 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.10) 2023-07-27T14:40:27.409 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:27.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.411 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.5) 2023-07-27T14:40:27.497 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:27.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.498 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.5) 2023-07-27T14:40:27.587 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:27.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.589 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.5) 2023-07-27T14:40:27.634 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:27.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.636 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.5) 2023-07-27T14:40:27.681 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:27.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.683 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.5) 2023-07-27T14:40:27.768 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:27.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.770 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.5) 2023-07-27T14:40:27.855 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:27.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.856 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.5) 2023-07-27T14:40:27.942 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:27.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:27.944 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.5) 2023-07-27T14:40:28.029 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:28.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.031 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.4) 2023-07-27T14:40:28.076 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:28.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.078 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.4) 2023-07-27T14:40:28.129 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:28.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.130 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.4) 2023-07-27T14:40:28.176 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:28.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.177 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.4) 2023-07-27T14:40:28.223 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:28.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.224 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.4) 2023-07-27T14:40:28.270 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:28.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.271 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.4) 2023-07-27T14:40:28.357 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:28.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.358 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.4) 2023-07-27T14:40:28.403 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:28.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.405 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.4) 2023-07-27T14:40:28.492 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:28.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.493 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.7) 2023-07-27T14:40:28.539 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:28.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.541 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.7) 2023-07-27T14:40:28.590 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:28.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.592 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.7) 2023-07-27T14:40:28.638 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:28.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.640 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.7) 2023-07-27T14:40:28.685 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:28.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.687 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.7) 2023-07-27T14:40:28.772 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:28.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.774 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.7) 2023-07-27T14:40:28.859 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:28.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.860 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.7) 2023-07-27T14:40:28.906 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:28.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.907 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.7) 2023-07-27T14:40:28.954 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:28.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:28.956 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.6) 2023-07-27T14:40:29.003 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:29.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.005 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.6) 2023-07-27T14:40:29.090 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:29.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.092 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.6) 2023-07-27T14:40:29.137 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:29.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.140 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.6) 2023-07-27T14:40:29.224 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:29.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.226 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.6) 2023-07-27T14:40:29.311 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:29.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.313 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.6) 2023-07-27T14:40:29.398 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:29.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.400 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.6) 2023-07-27T14:40:29.486 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:29.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.488 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.6) 2023-07-27T14:40:29.533 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:29.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.536 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.0) 2023-07-27T14:40:29.621 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:29.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.623 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.0) 2023-07-27T14:40:29.669 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:29.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.671 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.0) 2023-07-27T14:40:29.717 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:29.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.718 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.0) 2023-07-27T14:40:29.764 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:29.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.766 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.0) 2023-07-27T14:40:29.812 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:29.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.813 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.0) 2023-07-27T14:40:29.859 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:29.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.860 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.0) 2023-07-27T14:40:29.907 INFO:teuthology.orchestra.run.smithi115.stdout:1690468816 2023-07-27T14:40:29.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.908 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.0) 2023-07-27T14:40:29.954 INFO:teuthology.orchestra.run.smithi115.stdout:1690468816 2023-07-27T14:40:29.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:29.955 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.9) 2023-07-27T14:40:30.001 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:30.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.003 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.9) 2023-07-27T14:40:30.089 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:30.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.091 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.9) 2023-07-27T14:40:30.137 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:30.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.139 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.9) 2023-07-27T14:40:30.224 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:30.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.226 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.9) 2023-07-27T14:40:30.312 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:30.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.315 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.9) 2023-07-27T14:40:30.361 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:30.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.362 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.9) 2023-07-27T14:40:30.448 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:30.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.449 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.9) 2023-07-27T14:40:30.535 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:30.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.536 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.15) 2023-07-27T14:40:30.622 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:30.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.623 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.15) 2023-07-27T14:40:30.669 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:30.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.671 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.15) 2023-07-27T14:40:30.716 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:30.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.719 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.15) 2023-07-27T14:40:30.804 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:30.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.807 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.15) 2023-07-27T14:40:30.893 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:30.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.894 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.15) 2023-07-27T14:40:30.939 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:30.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:30.941 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.15) 2023-07-27T14:40:31.027 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:31.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.029 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.15) 2023-07-27T14:40:31.074 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:31.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.076 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.8) 2023-07-27T14:40:31.161 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:31.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.163 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.8) 2023-07-27T14:40:31.209 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:31.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.211 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.8) 2023-07-27T14:40:31.256 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:31.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.258 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.8) 2023-07-27T14:40:31.343 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:31.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.344 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.8) 2023-07-27T14:40:31.395 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:31.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.397 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.8) 2023-07-27T14:40:31.443 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:31.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.445 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.8) 2023-07-27T14:40:31.530 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:31.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.532 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.8) 2023-07-27T14:40:31.618 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:31.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.619 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.11) 2023-07-27T14:40:31.705 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:31.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.706 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.11) 2023-07-27T14:40:31.753 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:31.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.755 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.11) 2023-07-27T14:40:31.800 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:31.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.802 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.11) 2023-07-27T14:40:31.887 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:31.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.890 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.11) 2023-07-27T14:40:31.936 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:31.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.937 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.11) 2023-07-27T14:40:31.983 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:31.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:31.985 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.11) 2023-07-27T14:40:32.071 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:32.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.072 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.11) 2023-07-27T14:40:32.118 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:32.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.119 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.3) 2023-07-27T14:40:32.205 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:32.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.206 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.3) 2023-07-27T14:40:32.293 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:32.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.295 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.3) 2023-07-27T14:40:32.340 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:32.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.342 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.3) 2023-07-27T14:40:32.387 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:32.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.389 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.3) 2023-07-27T14:40:32.434 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:32.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.436 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.3) 2023-07-27T14:40:32.522 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:32.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.524 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.3) 2023-07-27T14:40:32.535 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:40:32.569 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:32.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.571 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.3) 2023-07-27T14:40:32.573 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:40:32.621 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:32.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.623 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.12) 2023-07-27T14:40:32.708 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:32.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.710 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.12) 2023-07-27T14:40:32.795 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:32.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.797 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.12) 2023-07-27T14:40:32.842 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:32.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.845 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.12) 2023-07-27T14:40:32.930 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:32.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.932 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.12) 2023-07-27T14:40:32.977 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:32.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:32.979 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.12) 2023-07-27T14:40:33.065 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:33.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.068 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.12) 2023-07-27T14:40:33.153 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:33.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.155 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.12) 2023-07-27T14:40:33.240 INFO:teuthology.orchestra.run.smithi115.stdout:1690468818 2023-07-27T14:40:33.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.241 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.1) 2023-07-27T14:40:33.327 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:33.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.329 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.1) 2023-07-27T14:40:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:40:33.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.377 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.1) 2023-07-27T14:40:33.423 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:33.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.425 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.1) 2023-07-27T14:40:33.510 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:40:33.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.511 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.1) 2023-07-27T14:40:33.597 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:33.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.598 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.1) 2023-07-27T14:40:33.644 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:40:33.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.645 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000758326/.snap/snapshot_0000000000899050/05d6bb2b-385f-4dff-b6fe-3f5be2710cc4/subvolume_file.1) 2023-07-27T14:40:33.731 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:33.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:33.732 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000498154/3fba218e-d562-415b-8a2c-151b6cced8d1/subvolume_file.1) 2023-07-27T14:40:33.778 INFO:teuthology.orchestra.run.smithi115.stdout:1690468817 2023-07-27T14:40:33.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs clone_0000000000498154 snapshot_0000000000899051 2023-07-27T14:40:34.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.956+0000 7f3bc3dff700 1 Processor -- start 2023-07-27T14:40:34.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.956+0000 7f3bc3dff700 1 -- start start 2023-07-27T14:40:34.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.957+0000 7f3bc3dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3bbc150220 0x7f3bbc150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.957+0000 7f3bc3dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bbc065220 0x7f3bbc0c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.957+0000 7f3bc3dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc068bb0 con 0x7f3bbc0c0ea0 2023-07-27T14:40:34.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.957+0000 7f3bc3dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc0656b0 con 0x7f3bbc065220 2023-07-27T14:40:34.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.957+0000 7f3bc3dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc06a250 con 0x7f3bbc150220 2023-07-27T14:40:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc239c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bbc065220 0x7f3bbc0c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc239c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bbc065220 0x7f3bbc0c1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56238/0 (socket says 172.21.15.115:56238) 2023-07-27T14:40:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc239c700 1 -- 172.21.15.115:0/2747906075 learned_addr learned my addr 172.21.15.115:0/2747906075 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc139a700 1 --1- 172.21.15.115:0/2747906075 >> v1:172.21.15.115:6789/0 conn(0x7f3bbc0c0ea0 0x7f3bbc069040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60930/0 (socket says 172.21.15.115:60930) 2023-07-27T14:40:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc1b9b700 1 --2- 172.21.15.115:0/2747906075 >> v2:172.21.15.159:3300/0 conn(0x7f3bbc150220 0x7f3bbc150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc239c700 1 -- 172.21.15.115:0/2747906075 >> v2:172.21.15.159:3300/0 conn(0x7f3bbc150220 msgr2=0x7f3bbc150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc239c700 1 --2- 172.21.15.115:0/2747906075 >> v2:172.21.15.159:3300/0 conn(0x7f3bbc150220 0x7f3bbc150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc239c700 1 -- 172.21.15.115:0/2747906075 >> v1:172.21.15.115:6789/0 conn(0x7f3bbc0c0ea0 legacy=0x7f3bbc069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc239c700 1 -- 172.21.15.115:0/2747906075 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0c1380 con 0x7f3bbc065220 2023-07-27T14:40:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc0b99700 1 -- 172.21.15.115:0/2747906075 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726195142 0 0) 0x7f3bbc068bb0 con 0x7f3bbc0c0ea0 2023-07-27T14:40:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc239c700 1 --2- 172.21.15.115:0/2747906075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc0c1770 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 rx=0x7f3bb4009f20 tx=0x7f3bb4009840).ready entity=mon.0 client_cookie=f11acc62e8598711 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.958+0000 7f3bc0b99700 1 -- 172.21.15.115:0/2747906075 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400e070 con 0x7f3bbc065220 2023-07-27T14:40:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc0b99700 1 -- 172.21.15.115:0/2747906075 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb400b990 con 0x7f3bbc065220 2023-07-27T14:40:34.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc0b99700 1 -- 172.21.15.115:0/2747906075 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400bd10 con 0x7f3bbc065220 2023-07-27T14:40:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc3dff700 1 -- 172.21.15.115:0/2747906075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 msgr2=0x7f3bbc0c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/2747906075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc0c1770 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 rx=0x7f3bb4009f20 tx=0x7f3bb4009840).stop 2023-07-27T14:40:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc3dff700 1 -- 172.21.15.115:0/2747906075 shutdown_connections 2023-07-27T14:40:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/2747906075 >> v2:172.21.15.159:3300/0 conn(0x7f3bbc150220 0x7f3bbc150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/2747906075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc0c1770 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc3dff700 1 -- 172.21.15.115:0/2747906075 >> 172.21.15.115:0/2747906075 conn(0x7f3bbc062320 msgr2=0x7f3bbc062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:34.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc3dff700 1 -- 172.21.15.115:0/2747906075 shutdown_connections 2023-07-27T14:40:34.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.959+0000 7f3bc3dff700 1 -- 172.21.15.115:0/2747906075 wait complete. 2023-07-27T14:40:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.961+0000 7f3bc3dff700 1 Processor -- start 2023-07-27T14:40:34.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.961+0000 7f3bc3dff700 1 -- start start 2023-07-27T14:40:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc3dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc3dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bbc0c0ea0 0x7f3bbc14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc3dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bbc150220 0x7f3bbc0be900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc3dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0a5ec0 con 0x7f3bbc065220 2023-07-27T14:40:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc3dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0a6110 con 0x7f3bbc150220 2023-07-27T14:40:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc3dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0a63f0 con 0x7f3bbc0c0ea0 2023-07-27T14:40:34.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc14c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56250/0 (socket says 172.21.15.115:56250) 2023-07-27T14:40:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 -- 172.21.15.115:0/3925566422 learned_addr learned my addr 172.21.15.115:0/3925566422 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc139a700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bbc0c0ea0 0x7f3bbc14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc239c700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bbc150220 0x7f3bbc0be900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 -- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bbc0c0ea0 msgr2=0x7f3bbc14ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bbc0c0ea0 0x7f3bbc14ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 -- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bbc150220 msgr2=0x7f3bbc0be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bbc150220 0x7f3bbc0be900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 -- 172.21.15.115:0/3925566422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb4009ae0 con 0x7f3bbc065220 2023-07-27T14:40:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc239c700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bbc150220 0x7f3bbc0be900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.962+0000 7f3bc1b9b700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc14c2c0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 rx=0x7f3bb800e900 tx=0x7f3bb8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.963+0000 7f3bb1ffb700 1 -- 172.21.15.115:0/3925566422 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800c640 con 0x7f3bbc065220 2023-07-27T14:40:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.963+0000 7f3bb1ffb700 1 -- 172.21.15.115:0/3925566422 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800c7a0 con 0x7f3bbc065220 2023-07-27T14:40:34.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.963+0000 7f3bb1ffb700 1 -- 172.21.15.115:0/3925566422 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800cb20 con 0x7f3bbc065220 2023-07-27T14:40:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.963+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc0bde20 con 0x7f3bbc065220 2023-07-27T14:40:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.963+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc0be3e0 con 0x7f3bbc065220 2023-07-27T14:40:34.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.964+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc06c470 con 0x7f3bbc065220 2023-07-27T14:40:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.965+0000 7f3bb1ffb700 1 -- 172.21.15.115:0/3925566422 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f3bb8022070 con 0x7f3bbc065220 2023-07-27T14:40:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.966+0000 7f3bb1ffb700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ba005fe20 0x7f3ba00622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.966+0000 7f3bb1ffb700 1 -- 172.21.15.115:0/3925566422 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3bb807b8a0 con 0x7f3bbc065220 2023-07-27T14:40:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.966+0000 7f3bc139a700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ba005fe20 0x7f3ba00622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.967+0000 7f3bc139a700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ba005fe20 0x7f3ba00622e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f3bbc14c7b0 tx=0x7f3bac007180).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.027 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:33.970+0000 7f3bb1ffb700 1 -- 172.21.15.115:0/3925566422 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3bb804bc80 con 0x7f3bbc065220 2023-07-27T14:40:34.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.173+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "clone_0000000000498154", "snap_name": "snapshot_0000000000899051", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bbc064d50 con 0x7f3ba005fe20 2023-07-27T14:40:34.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.188+0000 7f3bb1ffb700 1 -- 172.21.15.115:0/3925566422 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3bbc064d50 con 0x7f3ba005fe20 2023-07-27T14:40:34.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.190+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ba005fe20 msgr2=0x7f3ba00622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.190+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ba005fe20 0x7f3ba00622e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f3bbc14c7b0 tx=0x7f3bac007180).stop 2023-07-27T14:40:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.190+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 msgr2=0x7f3bbc14c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.190+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc14c2c0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 rx=0x7f3bb800e900 tx=0x7f3bb8009060).stop 2023-07-27T14:40:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.191+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 shutdown_connections 2023-07-27T14:40:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.191+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3ba005fe20 0x7f3ba00622e0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.191+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bbc150220 0x7f3bbc0be900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.191+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bbc065220 0x7f3bbc14c2c0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.191+0000 7f3bc3dff700 1 --2- 172.21.15.115:0/3925566422 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3bbc0c0ea0 0x7f3bbc14ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.191+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 >> 172.21.15.115:0/3925566422 conn(0x7f3bbc062320 msgr2=0x7f3bbc063da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:34.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.191+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 shutdown_connections 2023-07-27T14:40:34.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.191+0000 7f3bc3dff700 1 -- 172.21.15.115:0/3925566422 wait complete. 2023-07-27T14:40:34.265 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000498154 --retain-snapshots 2023-07-27T14:40:34.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.400+0000 7f4e669ff700 1 Processor -- start 2023-07-27T14:40:34.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.400+0000 7f4e669ff700 1 -- start start 2023-07-27T14:40:34.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e669ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4e600c6b70 0x7f4e600656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e669ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 0x7f4e60062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e669ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e60066050 con 0x7f4e60153e00 2023-07-27T14:40:34.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e669ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e60062320 con 0x7f4e600c6b70 2023-07-27T14:40:34.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e669ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60064a80 con 0x7f4e60065bc0 2023-07-27T14:40:34.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e5ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4e60153e00 0x7f4e60064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60944/0 (socket says 172.21.15.115:60944) 2023-07-27T14:40:34.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e5ffff700 1 -- 172.21.15.115:0/3402895166 learned_addr learned my addr 172.21.15.115:0/3402895166 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:34.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749918885 0 0) 0x7f4e60066050 con 0x7f4e60153e00 2023-07-27T14:40:34.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e480033f0 con 0x7f4e60153e00 2023-07-27T14:40:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e64f9c700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 0x7f4e60062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.402+0000 7f4e5f7fe700 1 --2- 172.21.15.115:0/3402895166 >> v2:172.21.15.159:3300/0 conn(0x7f4e600c6b70 0x7f4e600656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972215478 0 0) 0x7f4e480033f0 con 0x7f4e60153e00 2023-07-27T14:40:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 msgr2=0x7f4e60062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 0x7f4e60062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 >> v2:172.21.15.159:3300/0 conn(0x7f4e600c6b70 msgr2=0x7f4e600656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 --2- 172.21.15.115:0/3402895166 >> v2:172.21.15.159:3300/0 conn(0x7f4e600c6b70 0x7f4e600656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e60064d60 con 0x7f4e60153e00 2023-07-27T14:40:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f4e50001470 con 0x7f4e60153e00 2023-07-27T14:40:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 >> v1:172.21.15.115:6789/0 conn(0x7f4e60153e00 legacy=0x7f4e60064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e480038e0 0x7f4e48003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 0x7f4e48004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e48004b80 0x7f4e48005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60064a80 con 0x7f4e480038e0 2023-07-27T14:40:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480044f0 con 0x7f4e48004b80 2023-07-27T14:40:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4800b960 con 0x7f4e60065bc0 2023-07-27T14:40:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5ffff700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e480038e0 0x7f4e48003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5f7fe700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 0x7f4e48004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e64f9c700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e48004b80 0x7f4e48005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5ffff700 1 -- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 msgr2=0x7f4e48004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5ffff700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 0x7f4e48004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5ffff700 1 -- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e48004b80 msgr2=0x7f4e48005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5ffff700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e48004b80 0x7f4e48005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5ffff700 1 -- 172.21.15.115:0/3402895166 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480033f0 con 0x7f4e480038e0 2023-07-27T14:40:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.403+0000 7f4e5f7fe700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60065bc0 0x7f4e48004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e5ffff700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e480038e0 0x7f4e48003d00 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 rx=0x7f4e5000c210 tx=0x7f4e50001e90).ready entity=mon.0 client_cookie=c8893c9f31b44126 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50007a60 con 0x7f4e480038e0 2023-07-27T14:40:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5000cae0 con 0x7f4e480038e0 2023-07-27T14:40:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e5effd700 1 -- 172.21.15.115:0/3402895166 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000ce60 con 0x7f4e480038e0 2023-07-27T14:40:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e669ff700 1 -- 172.21.15.115:0/3402895166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e480038e0 msgr2=0x7f4e48003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e669ff700 1 --2- 172.21.15.115:0/3402895166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e480038e0 0x7f4e48003d00 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 rx=0x7f4e5000c210 tx=0x7f4e50001e90).stop 2023-07-27T14:40:34.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e64f9c700 1 -- 172.21.15.115:0/3402895166 reap_dead start 2023-07-27T14:40:34.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e669ff700 1 -- 172.21.15.115:0/3402895166 shutdown_connections 2023-07-27T14:40:34.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e669ff700 1 -- 172.21.15.115:0/3402895166 >> 172.21.15.115:0/3402895166 conn(0x7f4e600c7b90 msgr2=0x7f4e600c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:34.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.404+0000 7f4e669ff700 1 -- 172.21.15.115:0/3402895166 shutdown_connections 2023-07-27T14:40:34.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.405+0000 7f4e669ff700 1 -- 172.21.15.115:0/3402895166 wait complete. 2023-07-27T14:40:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.407+0000 7f4e669ff700 1 Processor -- start 2023-07-27T14:40:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.407+0000 7f4e669ff700 1 -- start start 2023-07-27T14:40:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e669ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e480038e0 0x7f4e60063b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e669ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e600625c0 0x7f4e60167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e669ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60150f90 0x7f4e60092f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e669ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60159f00 con 0x7f4e600625c0 2023-07-27T14:40:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e669ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60168130 con 0x7f4e480038e0 2023-07-27T14:40:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e669ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60062aa0 con 0x7f4e60150f90 2023-07-27T14:40:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e600625c0 0x7f4e60167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e600625c0 0x7f4e60167c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56264/0 (socket says 172.21.15.115:56264) 2023-07-27T14:40:34.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 -- 172.21.15.115:0/4272832186 learned_addr learned my addr 172.21.15.115:0/4272832186 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:34.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5ffff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e480038e0 0x7f4e60063b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e64f9c700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60150f90 0x7f4e60092f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 -- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60150f90 msgr2=0x7f4e60092f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60150f90 0x7f4e60092f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 -- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e480038e0 msgr2=0x7f4e60063b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e480038e0 0x7f4e60063b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 -- 172.21.15.115:0/4272832186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e60062d80 con 0x7f4e600625c0 2023-07-27T14:40:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e64f9c700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60150f90 0x7f4e60092f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5ffff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e480038e0 0x7f4e60063b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.408+0000 7f4e5f7fe700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e600625c0 0x7f4e60167c40 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 rx=0x7f4e54011960 tx=0x7f4e54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.409+0000 7f4e47fff700 1 -- 172.21.15.115:0/4272832186 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400f6d0 con 0x7f4e600625c0 2023-07-27T14:40:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.409+0000 7f4e47fff700 1 -- 172.21.15.115:0/4272832186 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400f830 con 0x7f4e600625c0 2023-07-27T14:40:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.409+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e60063060 con 0x7f4e600625c0 2023-07-27T14:40:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.409+0000 7f4e47fff700 1 -- 172.21.15.115:0/4272832186 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400fbb0 con 0x7f4e600625c0 2023-07-27T14:40:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.409+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e60063620 con 0x7f4e600625c0 2023-07-27T14:40:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.410+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e60063840 con 0x7f4e600625c0 2023-07-27T14:40:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.411+0000 7f4e47fff700 1 -- 172.21.15.115:0/4272832186 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f4e54025070 con 0x7f4e600625c0 2023-07-27T14:40:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.412+0000 7f4e47fff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e4c05fe50 0x7f4e4c062310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.412+0000 7f4e47fff700 1 -- 172.21.15.115:0/4272832186 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4e5407bd20 con 0x7f4e600625c0 2023-07-27T14:40:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.412+0000 7f4e5ffff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e4c05fe50 0x7f4e4c062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.412+0000 7f4e5ffff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e4c05fe50 0x7f4e4c062310 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f4e5000cab0 tx=0x7f4e50015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.416+0000 7f4e47fff700 1 -- 172.21.15.115:0/4272832186 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e5404c100 con 0x7f4e600625c0 2023-07-27T14:40:34.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.613+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000498154", "retain_snapshots": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4e60065040 con 0x7f4e4c05fe50 2023-07-27T14:40:34.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.648+0000 7f4e47fff700 1 -- 172.21.15.115:0/4272832186 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4e60065040 con 0x7f4e4c05fe50 2023-07-27T14:40:34.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e4c05fe50 msgr2=0x7f4e4c062310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e4c05fe50 0x7f4e4c062310 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f4e5000cab0 tx=0x7f4e50015000).stop 2023-07-27T14:40:34.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e600625c0 msgr2=0x7f4e60167c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e600625c0 0x7f4e60167c40 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 rx=0x7f4e54011960 tx=0x7f4e54008040).stop 2023-07-27T14:40:34.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 shutdown_connections 2023-07-27T14:40:34.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4e4c05fe50 0x7f4e4c062310 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e60150f90 0x7f4e60092f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e480038e0 0x7f4e60063b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 --2- 172.21.15.115:0/4272832186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e600625c0 0x7f4e60167c40 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 >> 172.21.15.115:0/4272832186 conn(0x7f4e600c7b90 msgr2=0x7f4e600c2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:34.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 shutdown_connections 2023-07-27T14:40:34.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.650+0000 7f4e669ff700 1 -- 172.21.15.115:0/4272832186 wait complete. 2023-07-27T14:40:34.726 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs clone_0000000000498154 2023-07-27T14:40:34.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.867+0000 7fdf5b5ff700 1 Processor -- start 2023-07-27T14:40:34.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.868+0000 7fdf5b5ff700 1 -- start start 2023-07-27T14:40:34.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf5b5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdf5414ae00 0x7fdf54154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf5b5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdf54063260 0x7fdf540a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf5b5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf541553f0 con 0x7fdf5414b1e0 2023-07-27T14:40:34.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf5b5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf54157a50 con 0x7fdf54063260 2023-07-27T14:40:34.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf5b5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf54157d10 con 0x7fdf5414ae00 2023-07-27T14:40:34.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf59b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdf54063260 0x7fdf540a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf59b9c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdf54063260 0x7fdf540a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56278/0 (socket says 172.21.15.115:56278) 2023-07-27T14:40:34.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf59b9c700 1 -- 172.21.15.115:0/1035965454 learned_addr learned my addr 172.21.15.115:0/1035965454 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:34.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.869+0000 7fdf59b9c700 1 -- 172.21.15.115:0/1035965454 >> v2:172.21.15.159:3300/0 conn(0x7fdf5414ae00 msgr2=0x7fdf54154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:34.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf5939b700 1 --2- 172.21.15.115:0/1035965454 >> v2:172.21.15.159:3300/0 conn(0x7fdf5414ae00 0x7fdf54154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf59b9c700 1 --2- 172.21.15.115:0/1035965454 >> v2:172.21.15.159:3300/0 conn(0x7fdf5414ae00 0x7fdf54154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf59b9c700 1 -- 172.21.15.115:0/1035965454 >> v1:172.21.15.159:6789/0 conn(0x7fdf5414b1e0 legacy=0x7fdf54062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:34.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf59b9c700 1 -- 172.21.15.115:0/1035965454 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf54157ff0 con 0x7fdf54063260 2023-07-27T14:40:34.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf5939b700 1 --2- 172.21.15.115:0/1035965454 >> v2:172.21.15.159:3300/0 conn(0x7fdf5414ae00 0x7fdf54154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:34.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf59b9c700 1 --2- 172.21.15.115:0/1035965454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf540a98c0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 rx=0x7fdf540caaf0 tx=0x7fdf4c009840).ready entity=mon.0 client_cookie=b08b57a456234555 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf4bfff700 1 -- 172.21.15.115:0/1035965454 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00e070 con 0x7fdf54063260 2023-07-27T14:40:34.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf4bfff700 1 -- 172.21.15.115:0/1035965454 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c00ba10 con 0x7fdf54063260 2023-07-27T14:40:34.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.870+0000 7fdf4bfff700 1 -- 172.21.15.115:0/1035965454 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00bd90 con 0x7fdf54063260 2023-07-27T14:40:34.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.871+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/1035965454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 msgr2=0x7fdf540a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.871+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/1035965454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf540a98c0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 rx=0x7fdf540caaf0 tx=0x7fdf4c009840).stop 2023-07-27T14:40:34.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.871+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/1035965454 shutdown_connections 2023-07-27T14:40:34.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.871+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/1035965454 >> v2:172.21.15.159:3300/0 conn(0x7fdf5414ae00 0x7fdf54154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.871+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/1035965454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf540a98c0 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.871+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/1035965454 >> 172.21.15.115:0/1035965454 conn(0x7fdf5405e940 msgr2=0x7fdf540cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:34.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.871+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/1035965454 shutdown_connections 2023-07-27T14:40:34.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.871+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/1035965454 wait complete. 2023-07-27T14:40:34.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.872+0000 7fdf5b5ff700 1 Processor -- start 2023-07-27T14:40:34.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.872+0000 7fdf5b5ff700 1 -- start start 2023-07-27T14:40:34.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.873+0000 7fdf5b5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf541648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.873+0000 7fdf5b5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5414ae00 0x7fdf540c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.873+0000 7fdf5b5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf5414b1e0 0x7fdf540b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.873+0000 7fdf5b5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5414a380 con 0x7fdf54063260 2023-07-27T14:40:34.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.873+0000 7fdf5b5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf54167f90 con 0x7fdf5414ae00 2023-07-27T14:40:34.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.873+0000 7fdf5b5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541673c0 con 0x7fdf5414b1e0 2023-07-27T14:40:34.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.873+0000 7fdf5939b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf541648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5939b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf541648b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56282/0 (socket says 172.21.15.115:56282) 2023-07-27T14:40:34.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5939b700 1 -- 172.21.15.115:0/542568208 learned_addr learned my addr 172.21.15.115:0/542568208 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:34.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf59b9c700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf5414b1e0 0x7fdf540b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf58b9a700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5414ae00 0x7fdf540c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5939b700 1 -- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf5414b1e0 msgr2=0x7fdf540b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5939b700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf5414b1e0 0x7fdf540b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5939b700 1 -- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5414ae00 msgr2=0x7fdf540c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5939b700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5414ae00 0x7fdf540c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5939b700 1 -- 172.21.15.115:0/542568208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c009ae0 con 0x7fdf54063260 2023-07-27T14:40:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf58b9a700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5414ae00 0x7fdf540c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:34.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5939b700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf541648b0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 rx=0x7fdf5000c880 tx=0x7fdf50008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf497fa700 1 -- 172.21.15.115:0/542568208 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50010580 con 0x7fdf54063260 2023-07-27T14:40:34.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf497fa700 1 -- 172.21.15.115:0/542568208 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf500106e0 con 0x7fdf54063260 2023-07-27T14:40:34.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf497fa700 1 -- 172.21.15.115:0/542568208 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50010a60 con 0x7fdf54063260 2023-07-27T14:40:34.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.874+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf54167660 con 0x7fdf54063260 2023-07-27T14:40:34.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.875+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf54167c20 con 0x7fdf54063260 2023-07-27T14:40:34.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.875+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf540ac9a0 con 0x7fdf54063260 2023-07-27T14:40:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.876+0000 7fdf497fa700 1 -- 172.21.15.115:0/542568208 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fdf5001b460 con 0x7fdf54063260 2023-07-27T14:40:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.877+0000 7fdf497fa700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3805fe20 0x7fdf380622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.877+0000 7fdf497fa700 1 -- 172.21.15.115:0/542568208 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fdf5007b700 con 0x7fdf54063260 2023-07-27T14:40:34.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.878+0000 7fdf58b9a700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3805fe20 0x7fdf380622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:34.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.878+0000 7fdf58b9a700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3805fe20 0x7fdf380622e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fdf44006fd0 tx=0x7fdf44008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:34.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:34.881+0000 7fdf497fa700 1 -- 172.21.15.115:0/542568208 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf5004ba80 con 0x7fdf54063260 2023-07-27T14:40:35.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.095+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf5406c470 con 0x7fdf3805fe20 2023-07-27T14:40:35.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.108+0000 7fdf497fa700 1 -- 172.21.15.115:0/542568208 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fdf5406c470 con 0x7fdf3805fe20 2023-07-27T14:40:35.165 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:40:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "snapshot_0000000000899051" 2023-07-27T14:40:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:35.165 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:40:35.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3805fe20 msgr2=0x7fdf380622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3805fe20 0x7fdf380622e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fdf44006fd0 tx=0x7fdf44008040).stop 2023-07-27T14:40:35.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 msgr2=0x7fdf541648b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf541648b0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 rx=0x7fdf5000c880 tx=0x7fdf50008040).stop 2023-07-27T14:40:35.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 shutdown_connections 2023-07-27T14:40:35.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fdf3805fe20 0x7fdf380622e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf5414b1e0 0x7fdf540b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf54063260 0x7fdf541648b0 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 --2- 172.21.15.115:0/542568208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5414ae00 0x7fdf540c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 >> 172.21.15.115:0/542568208 conn(0x7fdf5405e940 msgr2=0x7fdf540ac290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:35.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 shutdown_connections 2023-07-27T14:40:35.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.110+0000 7fdf5b5ff700 1 -- 172.21.15.115:0/542568208 wait complete. 2023-07-27T14:40:35.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000498154 2023-07-27T14:40:35.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.320+0000 7fa48f5ff700 1 Processor -- start 2023-07-27T14:40:35.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.320+0000 7fa48f5ff700 1 -- start start 2023-07-27T14:40:35.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.321+0000 7fa48f5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4880c3810 0x7fa488150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.321+0000 7fa48f5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4880c0ea0 con 0x7fa4881509b0 2023-07-27T14:40:35.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.321+0000 7fa48f5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa488068e10 con 0x7fa4880c58d0 2023-07-27T14:40:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.321+0000 7fa48f5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa488151280 con 0x7fa4880c3810 2023-07-27T14:40:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.321+0000 7fa48d39b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa4881509b0 0x7fa488154940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60956/0 (socket says 172.21.15.115:60956) 2023-07-27T14:40:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.321+0000 7fa48d39b700 1 -- 172.21.15.115:0/791092364 learned_addr learned my addr 172.21.15.115:0/791092364 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:35.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa48db9c700 1 --2- 172.21.15.115:0/791092364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4880c3810 0x7fa488150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa47ffff700 1 -- 172.21.15.115:0/791092364 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144778162 0 0) 0x7fa4880c0ea0 con 0x7fa4881509b0 2023-07-27T14:40:35.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa47ffff700 1 -- 172.21.15.115:0/791092364 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4740033f0 con 0x7fa4881509b0 2023-07-27T14:40:35.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa47ffff700 1 -- 172.21.15.115:0/791092364 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579582898 0 0) 0x7fa488068e10 con 0x7fa4880c58d0 2023-07-27T14:40:35.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa47ffff700 1 -- 172.21.15.115:0/791092364 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4880c0ea0 con 0x7fa4880c58d0 2023-07-27T14:40:35.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa47ffff700 1 -- 172.21.15.115:0/791092364 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1565387751 0 0) 0x7fa4740033f0 con 0x7fa4881509b0 2023-07-27T14:40:35.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa48db9c700 1 -- 172.21.15.115:0/791092364 >> v1:172.21.15.159:6789/0 conn(0x7fa4880c58d0 legacy=0x7fa4880c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa48db9c700 1 -- 172.21.15.115:0/791092364 >> v1:172.21.15.115:6789/0 conn(0x7fa4881509b0 legacy=0x7fa488154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa48db9c700 1 -- 172.21.15.115:0/791092364 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488155190 con 0x7fa4880c3810 2023-07-27T14:40:35.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.322+0000 7fa48db9c700 1 --2- 172.21.15.115:0/791092364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4880c3810 0x7fa488150d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fa480009e90 tx=0x7fa480009780).ready entity=mon.2 client_cookie=95dd2688fca7a3de server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:35.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa47ffff700 1 -- 172.21.15.115:0/791092364 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000e070 con 0x7fa4880c3810 2023-07-27T14:40:35.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa47ffff700 1 -- 172.21.15.115:0/791092364 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000b7a0 con 0x7fa4880c3810 2023-07-27T14:40:35.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa47ffff700 1 -- 172.21.15.115:0/791092364 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484001470 con 0x7fa4880c3810 2023-07-27T14:40:35.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa48f5ff700 1 -- 172.21.15.115:0/791092364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4880c3810 msgr2=0x7fa488150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa48f5ff700 1 --2- 172.21.15.115:0/791092364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4880c3810 0x7fa488150d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fa480009e90 tx=0x7fa480009780).stop 2023-07-27T14:40:35.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa48f5ff700 1 -- 172.21.15.115:0/791092364 shutdown_connections 2023-07-27T14:40:35.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa48f5ff700 1 --2- 172.21.15.115:0/791092364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4880c3810 0x7fa488150d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa48f5ff700 1 -- 172.21.15.115:0/791092364 >> 172.21.15.115:0/791092364 conn(0x7fa488062320 msgr2=0x7fa488062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:35.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa48f5ff700 1 -- 172.21.15.115:0/791092364 shutdown_connections 2023-07-27T14:40:35.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.323+0000 7fa48f5ff700 1 -- 172.21.15.115:0/791092364 wait complete. 2023-07-27T14:40:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.325+0000 7fa48f5ff700 1 Processor -- start 2023-07-27T14:40:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.325+0000 7fa48f5ff700 1 -- start start 2023-07-27T14:40:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48f5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4880c3810 0x7fa48814c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48f5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4880c58d0 0x7fa48814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48f5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4881509b0 0x7fa48814e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48f5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48814e880 con 0x7fa4880c3810 2023-07-27T14:40:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48f5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880ac6f0 con 0x7fa4880c58d0 2023-07-27T14:40:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48f5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880abae0 con 0x7fa4881509b0 2023-07-27T14:40:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48d39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4880c3810 0x7fa48814c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48d39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4880c3810 0x7fa48814c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56288/0 (socket says 172.21.15.115:56288) 2023-07-27T14:40:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48d39b700 1 -- 172.21.15.115:0/64848180 learned_addr learned my addr 172.21.15.115:0/64848180 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48db9c700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4881509b0 0x7fa48814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48d39b700 1 -- 172.21.15.115:0/64848180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4881509b0 msgr2=0x7fa48814e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48d39b700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4881509b0 0x7fa48814e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48d39b700 1 -- 172.21.15.115:0/64848180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4880c58d0 msgr2=0x7fa48814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48cb9a700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4880c58d0 0x7fa48814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48d39b700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4880c58d0 0x7fa48814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48d39b700 1 -- 172.21.15.115:0/64848180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480009a20 con 0x7fa4880c3810 2023-07-27T14:40:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48db9c700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4881509b0 0x7fa48814e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.326+0000 7fa48cb9a700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4880c58d0 0x7fa48814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.327+0000 7fa48d39b700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa4880c3810 0x7fa48814c4a0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 rx=0x7fa48400c810 tx=0x7fa484001a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.327+0000 7fa47d7fa700 1 -- 172.21.15.115:0/64848180 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484007170 con 0x7fa4880c3810 2023-07-27T14:40:35.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.327+0000 7fa47d7fa700 1 -- 172.21.15.115:0/64848180 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840072d0 con 0x7fa4880c3810 2023-07-27T14:40:35.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.327+0000 7fa47d7fa700 1 -- 172.21.15.115:0/64848180 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840048c0 con 0x7fa4880c3810 2023-07-27T14:40:35.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.327+0000 7fa48f5ff700 1 -- 172.21.15.115:0/64848180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4880abdc0 con 0x7fa4880c3810 2023-07-27T14:40:35.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.327+0000 7fa48f5ff700 1 -- 172.21.15.115:0/64848180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880ac380 con 0x7fa4880c3810 2023-07-27T14:40:35.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.328+0000 7fa48f5ff700 1 -- 172.21.15.115:0/64848180 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48806c470 con 0x7fa4880c3810 2023-07-27T14:40:35.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.329+0000 7fa47d7fa700 1 -- 172.21.15.115:0/64848180 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fa484010070 con 0x7fa4880c3810 2023-07-27T14:40:35.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.330+0000 7fa47d7fa700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa46c05fe20 0x7fa46c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.330+0000 7fa47d7fa700 1 -- 172.21.15.115:0/64848180 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fa48407aff0 con 0x7fa4880c3810 2023-07-27T14:40:35.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.330+0000 7fa48cb9a700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa46c05fe20 0x7fa46c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.331+0000 7fa48cb9a700 1 --2- 172.21.15.115:0/64848180 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa46c05fe20 0x7fa46c0622e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fa48814d060 tx=0x7fa478009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:35.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.334+0000 7fa47d7fa700 1 -- 172.21.15.115:0/64848180 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa48404b430 con 0x7fa4880c3810 2023-07-27T14:40:35.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.544+0000 7fa48f5ff700 1 -- 172.21.15.115:0/64848180 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4880655d0 con 0x7fa46c05fe20 2023-07-27T14:40:35.608 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:35.551+0000 7fa7af9f9700 -1 mgr.server reply reply (2) No such file or directory subvolume 'clone_0000000000498154' is removed and has only snapshots retained 2023-07-27T14:40:35.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.551+0000 7fa47d7fa700 1 -- 172.21.15.115:0/64848180 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: -2 subvolume 'clone_0000000000498154' is removed and has only snapshots retained) v1 ==== 85+0+0 (secure 0 0 0) 0x7fa4880655d0 con 0x7fa46c05fe20 2023-07-27T14:40:35.609 INFO:teuthology.orchestra.run.smithi115.stderr:Error ENOENT: subvolume 'clone_0000000000498154' is removed and has only snapshots retained 2023-07-27T14:40:35.616 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-27T14:40:35.617 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs clone_0000000000498154 2023-07-27T14:40:35.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.751+0000 7f9943dff700 1 Processor -- start 2023-07-27T14:40:35.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.751+0000 7f9943dff700 1 -- start start 2023-07-27T14:40:35.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.752+0000 7f9943dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f993c14ae00 0x7f993c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.752+0000 7f9943dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f993c14b1e0 0x7f993c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.752+0000 7f9943dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c1553f0 con 0x7f993c0c5c50 2023-07-27T14:40:35.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.752+0000 7f9943dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c157a50 con 0x7f993c14ae00 2023-07-27T14:40:35.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.752+0000 7f9943dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c157d10 con 0x7f993c14b1e0 2023-07-27T14:40:35.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.752+0000 7f9941b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f993c14ae00 0x7f993c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.752+0000 7f9941b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f993c14ae00 0x7f993c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56294/0 (socket says 172.21.15.115:56294) 2023-07-27T14:40:35.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.752+0000 7f9941b9b700 1 -- 172.21.15.115:0/746621948 learned_addr learned my addr 172.21.15.115:0/746621948 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:35.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f994139a700 1 --2- 172.21.15.115:0/746621948 >> v2:172.21.15.159:3300/0 conn(0x7f993c14b1e0 0x7f993c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f9941b9b700 1 -- 172.21.15.115:0/746621948 >> v2:172.21.15.159:3300/0 conn(0x7f993c14b1e0 msgr2=0x7f993c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:35.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f9941b9b700 1 --2- 172.21.15.115:0/746621948 >> v2:172.21.15.159:3300/0 conn(0x7f993c14b1e0 0x7f993c062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f9941b9b700 1 -- 172.21.15.115:0/746621948 >> v1:172.21.15.159:6789/0 conn(0x7f993c0c5c50 legacy=0x7f993c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f9941b9b700 1 -- 172.21.15.115:0/746621948 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c157ff0 con 0x7f993c14ae00 2023-07-27T14:40:35.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f994139a700 1 --2- 172.21.15.115:0/746621948 >> v2:172.21.15.159:3300/0 conn(0x7f993c14b1e0 0x7f993c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:35.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f9941b9b700 1 --2- 172.21.15.115:0/746621948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f993c14ae00 0x7f993c154f00 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 rx=0x7f993c155580 tx=0x7f99380090f0).ready entity=mon.0 client_cookie=d47fa0f7bc46da26 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:35.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f9940b99700 1 -- 172.21.15.115:0/746621948 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993800b600 con 0x7f993c14ae00 2023-07-27T14:40:35.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f9940b99700 1 -- 172.21.15.115:0/746621948 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993800b760 con 0x7f993c14ae00 2023-07-27T14:40:35.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.753+0000 7f9940b99700 1 -- 172.21.15.115:0/746621948 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993800bae0 con 0x7f993c14ae00 2023-07-27T14:40:35.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.754+0000 7f9943dff700 1 -- 172.21.15.115:0/746621948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f993c14ae00 msgr2=0x7f993c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.754+0000 7f9943dff700 1 --2- 172.21.15.115:0/746621948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f993c14ae00 0x7f993c154f00 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 rx=0x7f993c155580 tx=0x7f99380090f0).stop 2023-07-27T14:40:35.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.754+0000 7f9943dff700 1 -- 172.21.15.115:0/746621948 shutdown_connections 2023-07-27T14:40:35.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.754+0000 7f9943dff700 1 --2- 172.21.15.115:0/746621948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f993c14ae00 0x7f993c154f00 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.754+0000 7f9943dff700 1 --2- 172.21.15.115:0/746621948 >> v2:172.21.15.159:3300/0 conn(0x7f993c14b1e0 0x7f993c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.754+0000 7f9943dff700 1 -- 172.21.15.115:0/746621948 >> 172.21.15.115:0/746621948 conn(0x7f993c05e940 msgr2=0x7f993c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:35.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.754+0000 7f9943dff700 1 -- 172.21.15.115:0/746621948 shutdown_connections 2023-07-27T14:40:35.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.754+0000 7f9943dff700 1 -- 172.21.15.115:0/746621948 wait complete. 2023-07-27T14:40:35.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.755+0000 7f9943dff700 1 Processor -- start 2023-07-27T14:40:35.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.755+0000 7f9943dff700 1 -- start start 2023-07-27T14:40:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.756+0000 7f9943dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f993c0c5c50 0x7f993c164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.756+0000 7f9943dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f993c14ae00 0x7f993c0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.756+0000 7f9943dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f993c14b1e0 0x7f993c13f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.756+0000 7f9943dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c164fa0 con 0x7f993c14b1e0 2023-07-27T14:40:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.756+0000 7f9943dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0c2b10 con 0x7f993c14ae00 2023-07-27T14:40:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.756+0000 7f9943dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0c4d10 con 0x7f993c0c5c50 2023-07-27T14:40:35.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f993c14b1e0 0x7f993c13f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f993c14b1e0 0x7f993c13f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56310/0 (socket says 172.21.15.115:56310) 2023-07-27T14:40:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 -- 172.21.15.115:0/664876789 learned_addr learned my addr 172.21.15.115:0/664876789 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994139a700 1 --2- 172.21.15.115:0/664876789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f993c14ae00 0x7f993c0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f9941b9b700 1 --2- 172.21.15.115:0/664876789 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f993c0c5c50 0x7f993c164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 -- 172.21.15.115:0/664876789 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f993c0c5c50 msgr2=0x7f993c164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 --2- 172.21.15.115:0/664876789 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f993c0c5c50 0x7f993c164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 -- 172.21.15.115:0/664876789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f993c14ae00 msgr2=0x7f993c0c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:35.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 --2- 172.21.15.115:0/664876789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f993c14ae00 0x7f993c0c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:35.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 -- 172.21.15.115:0/664876789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938009370 con 0x7f993c14b1e0 2023-07-27T14:40:35.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f994239c700 1 --2- 172.21.15.115:0/664876789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f993c14b1e0 0x7f993c13f5e0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 rx=0x7f993400c7c0 tx=0x7f9934001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:35.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f9931ffb700 1 -- 172.21.15.115:0/664876789 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934010510 con 0x7f993c14b1e0 2023-07-27T14:40:35.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f9931ffb700 1 -- 172.21.15.115:0/664876789 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934010670 con 0x7f993c14b1e0 2023-07-27T14:40:35.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f9943dff700 1 -- 172.21.15.115:0/664876789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c0c43e0 con 0x7f993c14b1e0 2023-07-27T14:40:35.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.757+0000 7f9931ffb700 1 -- 172.21.15.115:0/664876789 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340109f0 con 0x7f993c14b1e0 2023-07-27T14:40:35.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.758+0000 7f9943dff700 1 -- 172.21.15.115:0/664876789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c0c4a20 con 0x7f993c14b1e0 2023-07-27T14:40:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.759+0000 7f9943dff700 1 -- 172.21.15.115:0/664876789 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c0c8460 con 0x7f993c14b1e0 2023-07-27T14:40:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.759+0000 7f9931ffb700 1 -- 172.21.15.115:0/664876789 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f9934010070 con 0x7f993c14b1e0 2023-07-27T14:40:35.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.760+0000 7f9931ffb700 1 --2- 172.21.15.115:0/664876789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f992005fe20 0x7f99200622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:35.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.760+0000 7f9931ffb700 1 -- 172.21.15.115:0/664876789 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f993407b370 con 0x7f993c14b1e0 2023-07-27T14:40:35.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.760+0000 7f9941b9b700 1 --2- 172.21.15.115:0/664876789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f992005fe20 0x7f99200622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:35.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.761+0000 7f9941b9b700 1 --2- 172.21.15.115:0/664876789 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f992005fe20 0x7f99200622e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f993c155580 tx=0x7f9938017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:35.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.764+0000 7f9931ffb700 1 -- 172.21.15.115:0/664876789 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f993404b750 con 0x7f993c14b1e0 2023-07-27T14:40:36.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.975+0000 7f9943dff700 1 -- 172.21.15.115:0/664876789 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "clone_0000000000498154", "target": ["mon-mgr", ""]}) v1 -- 0x7f993c0c5260 con 0x7f992005fe20 2023-07-27T14:40:36.042 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:40:35.985+0000 7fa7af9f9700 -1 mgr.server reply reply (2) No such file or directory subvolume 'clone_0000000000498154' is removed and has only snapshots retained 2023-07-27T14:40:36.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:35.985+0000 7f9931ffb700 1 -- 172.21.15.115:0/664876789 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: -2 subvolume 'clone_0000000000498154' is removed and has only snapshots retained) v1 ==== 85+0+0 (secure 0 0 0) 0x7f993c0c5260 con 0x7f992005fe20 2023-07-27T14:40:36.043 INFO:teuthology.orchestra.run.smithi115.stderr:Error ENOENT: subvolume 'clone_0000000000498154' is removed and has only snapshots retained 2023-07-27T14:40:36.050 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-27T14:40:36.051 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000758326 snapshot_0000000000899050 2023-07-27T14:40:36.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.187+0000 7f90d09ff700 1 Processor -- start 2023-07-27T14:40:36.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.187+0000 7f90d09ff700 1 -- start start 2023-07-27T14:40:36.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90d09ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f90cc13a350 0x7f90cc065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90d09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90d09ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90cc0c2fa0 0x7f90cc0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90d09ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc066400 con 0x7f90cc0c2fa0 2023-07-27T14:40:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90d09ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc158ae0 con 0x7f90cc13a350 2023-07-27T14:40:36.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90d09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0bd9a0 con 0x7f90cc13a730 2023-07-27T14:40:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90cad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90cc0c2fa0 0x7f90cc0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90cad9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90cc0c2fa0 0x7f90cc0c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56324/0 (socket says 172.21.15.115:56324) 2023-07-27T14:40:36.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90cad9d700 1 -- 172.21.15.115:0/3196684659 learned_addr learned my addr 172.21.15.115:0/3196684659 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.189+0000 7f90c9d9b700 1 --2- 172.21.15.115:0/3196684659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90ca59c700 1 --2- 172.21.15.115:0/3196684659 >> v2:172.21.15.159:3300/0 conn(0x7f90cc13a350 0x7f90cc065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90cad9d700 1 -- 172.21.15.115:0/3196684659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 msgr2=0x7f90cc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90cad9d700 1 --2- 172.21.15.115:0/3196684659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90cad9d700 1 -- 172.21.15.115:0/3196684659 >> v2:172.21.15.159:3300/0 conn(0x7f90cc13a350 msgr2=0x7f90cc065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90cad9d700 1 --2- 172.21.15.115:0/3196684659 >> v2:172.21.15.159:3300/0 conn(0x7f90cc13a350 0x7f90cc065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90cad9d700 1 -- 172.21.15.115:0/3196684659 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0c3910 con 0x7f90cc0c2fa0 2023-07-27T14:40:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90c9d9b700 1 --2- 172.21.15.115:0/3196684659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90ca59c700 1 --2- 172.21.15.115:0/3196684659 >> v2:172.21.15.159:3300/0 conn(0x7f90cc13a350 0x7f90cc065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90cad9d700 1 --2- 172.21.15.115:0/3196684659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc0c2fa0 0x7f90cc0c3420 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 rx=0x7f90cc066fd0 tx=0x7f90c4009840).ready entity=mon.0 client_cookie=1a28562633bef71d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90c959a700 1 -- 172.21.15.115:0/3196684659 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400e070 con 0x7f90cc0c2fa0 2023-07-27T14:40:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90c959a700 1 -- 172.21.15.115:0/3196684659 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c400ba50 con 0x7f90cc0c2fa0 2023-07-27T14:40:36.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90c959a700 1 -- 172.21.15.115:0/3196684659 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400bdd0 con 0x7f90cc0c2fa0 2023-07-27T14:40:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90d09ff700 1 -- 172.21.15.115:0/3196684659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc0c2fa0 msgr2=0x7f90cc0c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.190+0000 7f90d09ff700 1 --2- 172.21.15.115:0/3196684659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc0c2fa0 0x7f90cc0c3420 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 rx=0x7f90cc066fd0 tx=0x7f90c4009840).stop 2023-07-27T14:40:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.191+0000 7f90d09ff700 1 -- 172.21.15.115:0/3196684659 shutdown_connections 2023-07-27T14:40:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.191+0000 7f90d09ff700 1 --2- 172.21.15.115:0/3196684659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc0c2fa0 0x7f90cc0c3420 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.191+0000 7f90d09ff700 1 --2- 172.21.15.115:0/3196684659 >> v2:172.21.15.159:3300/0 conn(0x7f90cc13a350 0x7f90cc065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.191+0000 7f90d09ff700 1 --2- 172.21.15.115:0/3196684659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.191+0000 7f90d09ff700 1 -- 172.21.15.115:0/3196684659 >> 172.21.15.115:0/3196684659 conn(0x7f90cc05e8f0 msgr2=0x7f90cc0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:36.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.191+0000 7f90d09ff700 1 -- 172.21.15.115:0/3196684659 shutdown_connections 2023-07-27T14:40:36.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.191+0000 7f90d09ff700 1 -- 172.21.15.115:0/3196684659 wait complete. 2023-07-27T14:40:36.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.192+0000 7f90d09ff700 1 Processor -- start 2023-07-27T14:40:36.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.192+0000 7f90d09ff700 1 -- start start 2023-07-27T14:40:36.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.193+0000 7f90d09ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90cc0c2fa0 0x7f90cc1394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.193+0000 7f90d09ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc13a350 0x7f90cc0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.193+0000 7f90d09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.193+0000 7f90d09ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0c7690 con 0x7f90cc13a350 2023-07-27T14:40:36.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.193+0000 7f90d09ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0c7970 con 0x7f90cc0c2fa0 2023-07-27T14:40:36.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.193+0000 7f90d09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0c7c50 con 0x7f90cc13a730 2023-07-27T14:40:36.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.193+0000 7f90c9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc13a350 0x7f90cc0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90c9d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc13a350 0x7f90cc0c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56326/0 (socket says 172.21.15.115:56326) 2023-07-27T14:40:36.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90c9d9b700 1 -- 172.21.15.115:0/1449062588 learned_addr learned my addr 172.21.15.115:0/1449062588 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:36.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90ca59c700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90cc0c2fa0 0x7f90cc1394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90cad9d700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90c9d9b700 1 -- 172.21.15.115:0/1449062588 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 msgr2=0x7f90cc156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90c9d9b700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90c9d9b700 1 -- 172.21.15.115:0/1449062588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90cc0c2fa0 msgr2=0x7f90cc1394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90c9d9b700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90cc0c2fa0 0x7f90cc1394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90c9d9b700 1 -- 172.21.15.115:0/1449062588 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4009ae0 con 0x7f90cc13a350 2023-07-27T14:40:36.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90c9d9b700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc13a350 0x7f90cc0c6dd0 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 rx=0x7f90c000c880 tx=0x7f90c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:36.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90ba7fc700 1 -- 172.21.15.115:0/1449062588 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0010580 con 0x7f90cc13a350 2023-07-27T14:40:36.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90ba7fc700 1 -- 172.21.15.115:0/1449062588 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00106e0 con 0x7f90cc13a350 2023-07-27T14:40:36.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc154570 con 0x7f90cc13a350 2023-07-27T14:40:36.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.194+0000 7f90ba7fc700 1 -- 172.21.15.115:0/1449062588 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0010a60 con 0x7f90cc13a350 2023-07-27T14:40:36.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.195+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc1399a0 con 0x7f90cc13a350 2023-07-27T14:40:36.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.195+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90cc154a90 con 0x7f90cc13a350 2023-07-27T14:40:36.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.196+0000 7f90ba7fc700 1 -- 172.21.15.115:0/1449062588 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f90c001b460 con 0x7f90cc13a350 2023-07-27T14:40:36.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.197+0000 7f90ba7fc700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f90ac05fdf0 0x7f90ac0622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.197+0000 7f90ba7fc700 1 -- 172.21.15.115:0/1449062588 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f90c007b6d0 con 0x7f90cc13a350 2023-07-27T14:40:36.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.197+0000 7f90ca59c700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f90ac05fdf0 0x7f90ac0622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.198+0000 7f90ca59c700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f90ac05fdf0 0x7f90ac0622b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f90bc00abd0 tx=0x7f90bc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:36.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.201+0000 7f90ba7fc700 1 -- 172.21.15.115:0/1449062588 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f90cc154a90 con 0x7f90cc13a350 2023-07-27T14:40:36.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.406+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000758326", "snap_name": "snapshot_0000000000899050", "target": ["mon-mgr", ""]}) v1 -- 0x7f90cc154a90 con 0x7f90ac05fdf0 2023-07-27T14:40:36.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.460+0000 7f90ba7fc700 1 -- 172.21.15.115:0/1449062588 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f90cc154a90 con 0x7f90ac05fdf0 2023-07-27T14:40:36.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f90ac05fdf0 msgr2=0x7f90ac0622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f90ac05fdf0 0x7f90ac0622b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f90bc00abd0 tx=0x7f90bc008040).stop 2023-07-27T14:40:36.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc13a350 msgr2=0x7f90cc0c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc13a350 0x7f90cc0c6dd0 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 rx=0x7f90c000c880 tx=0x7f90c0008040).stop 2023-07-27T14:40:36.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 shutdown_connections 2023-07-27T14:40:36.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f90ac05fdf0 0x7f90ac0622b0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90cc13a730 0x7f90cc156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90cc0c2fa0 0x7f90cc1394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 --2- 172.21.15.115:0/1449062588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc13a350 0x7f90cc0c6dd0 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 >> 172.21.15.115:0/1449062588 conn(0x7f90cc05e8f0 msgr2=0x7f90cc064560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:36.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 shutdown_connections 2023-07-27T14:40:36.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.462+0000 7f90d09ff700 1 -- 172.21.15.115:0/1449062588 wait complete. 2023-07-27T14:40:36.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs clone_0000000000498154 snapshot_0000000000899051 2023-07-27T14:40:36.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.674+0000 7f6209bff700 1 Processor -- start 2023-07-27T14:40:36.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.674+0000 7f6209bff700 1 -- start start 2023-07-27T14:40:36.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f6209bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f620414ae00 0x7f6204154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f6209bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 0x7f62040a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f6209bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62041553f0 con 0x7f620414b1e0 2023-07-27T14:40:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f6209bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6204157a50 con 0x7f620414ae00 2023-07-27T14:40:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f6209bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6204157d10 con 0x7f6204063260 2023-07-27T14:40:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f62037fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f620414ae00 0x7f6204154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f62037fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f620414ae00 0x7f6204154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56338/0 (socket says 172.21.15.115:56338) 2023-07-27T14:40:36.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f62037fe700 1 -- 172.21.15.115:0/1771217843 learned_addr learned my addr 172.21.15.115:0/1771217843 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:36.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f6203fff700 1 --2- 172.21.15.115:0/1771217843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 0x7f62040a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f62037fe700 1 -- 172.21.15.115:0/1771217843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 msgr2=0x7f62040a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:36.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f62037fe700 1 --2- 172.21.15.115:0/1771217843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 0x7f62040a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.676+0000 7f62037fe700 1 -- 172.21.15.115:0/1771217843 >> v1:172.21.15.159:6789/0 conn(0x7f620414b1e0 legacy=0x7f6204062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.677+0000 7f62037fe700 1 -- 172.21.15.115:0/1771217843 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204157ff0 con 0x7f620414ae00 2023-07-27T14:40:36.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.677+0000 7f62037fe700 1 --2- 172.21.15.115:0/1771217843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f6204154f00 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 rx=0x7f61f4006fd0 tx=0x7f61f40090f0).ready entity=mon.0 client_cookie=a56150bd9a75061b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:36.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.677+0000 7f62027fc700 1 -- 172.21.15.115:0/1771217843 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400b600 con 0x7f620414ae00 2023-07-27T14:40:36.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.677+0000 7f62027fc700 1 -- 172.21.15.115:0/1771217843 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f400b760 con 0x7f620414ae00 2023-07-27T14:40:36.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.677+0000 7f62027fc700 1 -- 172.21.15.115:0/1771217843 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400bae0 con 0x7f620414ae00 2023-07-27T14:40:36.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.677+0000 7f6209bff700 1 -- 172.21.15.115:0/1771217843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 msgr2=0x7f6204154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.677+0000 7f6209bff700 1 --2- 172.21.15.115:0/1771217843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f6204154f00 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 rx=0x7f61f4006fd0 tx=0x7f61f40090f0).stop 2023-07-27T14:40:36.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.678+0000 7f6209bff700 1 -- 172.21.15.115:0/1771217843 shutdown_connections 2023-07-27T14:40:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.678+0000 7f6209bff700 1 --2- 172.21.15.115:0/1771217843 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 0x7f62040a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.678+0000 7f6209bff700 1 --2- 172.21.15.115:0/1771217843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f6204154f00 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.678+0000 7f6209bff700 1 -- 172.21.15.115:0/1771217843 >> 172.21.15.115:0/1771217843 conn(0x7f620405e940 msgr2=0x7f62040cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.678+0000 7f6209bff700 1 -- 172.21.15.115:0/1771217843 shutdown_connections 2023-07-27T14:40:36.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.678+0000 7f6209bff700 1 -- 172.21.15.115:0/1771217843 wait complete. 2023-07-27T14:40:36.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.679+0000 7f6209bff700 1 Processor -- start 2023-07-27T14:40:36.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.679+0000 7f6209bff700 1 -- start start 2023-07-27T14:40:36.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.680+0000 7f6209bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 0x7f6204168210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.680+0000 7f6209bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f62040c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.680+0000 7f6209bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f620414b1e0 0x7f62040c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.680+0000 7f6209bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6204167d80 con 0x7f620414ae00 2023-07-27T14:40:36.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.680+0000 7f6209bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62040ca450 con 0x7f620414b1e0 2023-07-27T14:40:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.680+0000 7f6209bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62040ca170 con 0x7f6204063260 2023-07-27T14:40:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.680+0000 7f6202ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f62040c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6202ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f62040c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56350/0 (socket says 172.21.15.115:56350) 2023-07-27T14:40:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6202ffd700 1 -- 172.21.15.115:0/2966863676 learned_addr learned my addr 172.21.15.115:0/2966863676 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f62037fe700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 0x7f6204168210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6203fff700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f620414b1e0 0x7f62040c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6202ffd700 1 -- 172.21.15.115:0/2966863676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 msgr2=0x7f6204168210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6202ffd700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 0x7f6204168210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6202ffd700 1 -- 172.21.15.115:0/2966863676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f620414b1e0 msgr2=0x7f62040c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:36.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6202ffd700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f620414b1e0 0x7f62040c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:36.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6202ffd700 1 -- 172.21.15.115:0/2966863676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4009370 con 0x7f620414ae00 2023-07-27T14:40:36.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6202ffd700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f62040c9990 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 rx=0x7f61f800c4c0 tx=0x7f61f8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:36.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f61eb7fe700 1 -- 172.21.15.115:0/2966863676 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f800ce10 con 0x7f620414ae00 2023-07-27T14:40:36.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f61eb7fe700 1 -- 172.21.15.115:0/2966863676 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f8007020 con 0x7f620414ae00 2023-07-27T14:40:36.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6204167730 con 0x7f620414ae00 2023-07-27T14:40:36.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f61eb7fe700 1 -- 172.21.15.115:0/2966863676 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f80073e0 con 0x7f620414ae00 2023-07-27T14:40:36.742 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.681+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62040c9e80 con 0x7f620414ae00 2023-07-27T14:40:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.682+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6204167ef0 con 0x7f620414ae00 2023-07-27T14:40:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.683+0000 7f61eb7fe700 1 -- 172.21.15.115:0/2966863676 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f61f8010070 con 0x7f620414ae00 2023-07-27T14:40:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.684+0000 7f61eb7fe700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61f005fe20 0x7f61f00622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.684+0000 7f61eb7fe700 1 -- 172.21.15.115:0/2966863676 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f61f807a6a0 con 0x7f620414ae00 2023-07-27T14:40:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.684+0000 7f62037fe700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61f005fe20 0x7f61f00622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:36.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.685+0000 7f62037fe700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61f005fe20 0x7f61f00622e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f61f4009130 tx=0x7f61f4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:36.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.688+0000 7f61eb7fe700 1 -- 172.21.15.115:0/2966863676 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f61f80478f0 con 0x7f620414ae00 2023-07-27T14:40:36.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.897+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "clone_0000000000498154", "snap_name": "snapshot_0000000000899051", "target": ["mon-mgr", ""]}) v1 -- 0x7f620406c470 con 0x7f61f005fe20 2023-07-27T14:40:36.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.940+0000 7f61eb7fe700 1 -- 172.21.15.115:0/2966863676 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f620406c470 con 0x7f61f005fe20 2023-07-27T14:40:37.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61f005fe20 msgr2=0x7f61f00622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:37.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61f005fe20 0x7f61f00622e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f61f4009130 tx=0x7f61f4017000).stop 2023-07-27T14:40:37.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 msgr2=0x7f62040c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:37.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f62040c9990 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 rx=0x7f61f800c4c0 tx=0x7f61f8007dd0).stop 2023-07-27T14:40:37.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 shutdown_connections 2023-07-27T14:40:37.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f61f005fe20 0x7f61f00622e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f620414b1e0 0x7f62040c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6204063260 0x7f6204168210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 --2- 172.21.15.115:0/2966863676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f620414ae00 0x7f62040c9990 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 >> 172.21.15.115:0/2966863676 conn(0x7f620405e940 msgr2=0x7f6204153430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:37.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 shutdown_connections 2023-07-27T14:40:37.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:36.943+0000 7f6209bff700 1 -- 172.21.15.115:0/2966863676 wait complete. 2023-07-27T14:40:37.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2023-07-27T14:40:37.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.152+0000 7f721edff700 1 Processor -- start 2023-07-27T14:40:37.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.152+0000 7f721edff700 1 -- start start 2023-07-27T14:40:37.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.154+0000 7f721edff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f721813a350 0x7f7218065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:37.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.154+0000 7f721edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72180c36b0 0x7f72181585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:37.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.154+0000 7f721edff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72180bd9a0 con 0x7f721813a730 2023-07-27T14:40:37.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.154+0000 7f721edff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7218066400 con 0x7f721813a350 2023-07-27T14:40:37.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.154+0000 7f721edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7218158ae0 con 0x7f72180c36b0 2023-07-27T14:40:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.154+0000 7f721d39c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72180c36b0 0x7f72181585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:37.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f721d39c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72180c36b0 0x7f72181585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:35868/0 (socket says 172.21.15.115:35868) 2023-07-27T14:40:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f721d39c700 1 -- 172.21.15.115:0/3915764155 learned_addr learned my addr 172.21.15.115:0/3915764155 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f721cb9b700 1 --2- 172.21.15.115:0/3915764155 >> v2:172.21.15.159:3300/0 conn(0x7f721813a350 0x7f7218065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f72177fe700 1 -- 172.21.15.115:0/3915764155 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213832915 0 0) 0x7f72180bd9a0 con 0x7f721813a730 2023-07-27T14:40:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f721d39c700 1 -- 172.21.15.115:0/3915764155 >> v2:172.21.15.159:3300/0 conn(0x7f721813a350 msgr2=0x7f7218065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f721d39c700 1 --2- 172.21.15.115:0/3915764155 >> v2:172.21.15.159:3300/0 conn(0x7f721813a350 0x7f7218065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f721d39c700 1 -- 172.21.15.115:0/3915764155 >> v1:172.21.15.159:6789/0 conn(0x7f721813a730 legacy=0x7f72180c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f721d39c700 1 -- 172.21.15.115:0/3915764155 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7218066610 con 0x7f72180c36b0 2023-07-27T14:40:37.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f721d39c700 1 --2- 172.21.15.115:0/3915764155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72180c36b0 0x7f72181585f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7210009f20 tx=0x7f7210009840).ready entity=mon.2 client_cookie=cedd4eb78b440c39 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.155+0000 7f72177fe700 1 -- 172.21.15.115:0/3915764155 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000e070 con 0x7f72180c36b0 2023-07-27T14:40:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f72177fe700 1 -- 172.21.15.115:0/3915764155 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721000b9d0 con 0x7f72180c36b0 2023-07-27T14:40:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f72177fe700 1 -- 172.21.15.115:0/3915764155 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000bd50 con 0x7f72180c36b0 2023-07-27T14:40:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f721edff700 1 -- 172.21.15.115:0/3915764155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72180c36b0 msgr2=0x7f72181585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f721edff700 1 --2- 172.21.15.115:0/3915764155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72180c36b0 0x7f72181585f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7210009f20 tx=0x7f7210009840).stop 2023-07-27T14:40:37.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f721edff700 1 -- 172.21.15.115:0/3915764155 shutdown_connections 2023-07-27T14:40:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f721edff700 1 --2- 172.21.15.115:0/3915764155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72180c36b0 0x7f72181585f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f721edff700 1 --2- 172.21.15.115:0/3915764155 >> v2:172.21.15.159:3300/0 conn(0x7f721813a350 0x7f7218065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f721edff700 1 -- 172.21.15.115:0/3915764155 >> 172.21.15.115:0/3915764155 conn(0x7f721805e8f0 msgr2=0x7f72180c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f721edff700 1 -- 172.21.15.115:0/3915764155 shutdown_connections 2023-07-27T14:40:37.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.156+0000 7f721edff700 1 -- 172.21.15.115:0/3915764155 wait complete. 2023-07-27T14:40:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.158+0000 7f721edff700 1 Processor -- start 2023-07-27T14:40:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.158+0000 7f721edff700 1 -- start start 2023-07-27T14:40:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721edff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72180c36b0 0x7f7218163b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f721813a350 0x7f7218166920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:37.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721edff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f721813a730 0x7f7218154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721edff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180aa080 con 0x7f721813a730 2023-07-27T14:40:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721edff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218163ff0 con 0x7f72180c36b0 2023-07-27T14:40:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180c7950 con 0x7f721813a350 2023-07-27T14:40:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f721813a730 0x7f7218154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f721813a730 0x7f7218154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56358/0 (socket says 172.21.15.115:56358) 2023-07-27T14:40:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 -- 172.21.15.115:0/1528409352 learned_addr learned my addr 172.21.15.115:0/1528409352 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721cb9b700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72180c36b0 0x7f7218163b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:37.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f7217fff700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f721813a350 0x7f7218166920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 -- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f721813a350 msgr2=0x7f7218166920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f721813a350 0x7f7218166920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 -- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72180c36b0 msgr2=0x7f7218163b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72180c36b0 0x7f7218163b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 -- 172.21.15.115:0/1528409352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210009ae0 con 0x7f721813a730 2023-07-27T14:40:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721cb9b700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72180c36b0 0x7f7218163b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.159+0000 7f721d39c700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f721813a730 0x7f7218154570 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 rx=0x7f7218066540 tx=0x7f7210009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.160+0000 7f7214ff9700 1 -- 172.21.15.115:0/1528409352 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000b640 con 0x7f721813a730 2023-07-27T14:40:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.160+0000 7f7214ff9700 1 -- 172.21.15.115:0/1528409352 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721001e470 con 0x7f721813a730 2023-07-27T14:40:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.160+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72180a9750 con 0x7f721813a730 2023-07-27T14:40:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.160+0000 7f7214ff9700 1 -- 172.21.15.115:0/1528409352 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721001e810 con 0x7f721813a730 2023-07-27T14:40:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.160+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72180a9d10 con 0x7f721813a730 2023-07-27T14:40:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.161+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72180aa1f0 con 0x7f721813a730 2023-07-27T14:40:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.162+0000 7f7214ff9700 1 -- 172.21.15.115:0/1528409352 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f7210025030 con 0x7f721813a730 2023-07-27T14:40:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.163+0000 7f7214ff9700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71fc05fe20 0x7f71fc0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.163+0000 7f7214ff9700 1 -- 172.21.15.115:0/1528409352 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f721007cc60 con 0x7f721813a730 2023-07-27T14:40:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.163+0000 7f721cb9b700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71fc05fe20 0x7f71fc0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.163+0000 7f721cb9b700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71fc05fe20 0x7f71fc0622e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f720c009c00 tx=0x7f720c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:37.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.167+0000 7f7214ff9700 1 -- 172.21.15.115:0/1528409352 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f721004d0f0 con 0x7f721813a730 2023-07-27T14:40:37.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.363+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f721806c470 con 0x7f71fc05fe20 2023-07-27T14:40:37.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.368+0000 7f7214ff9700 1 -- 172.21.15.115:0/1528409352 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f721806c470 con 0x7f71fc05fe20 2023-07-27T14:40:37.425 INFO:teuthology.orchestra.run.smithi115.stdout:[] 2023-07-27T14:40:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71fc05fe20 msgr2=0x7f71fc0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71fc05fe20 0x7f71fc0622e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f720c009c00 tx=0x7f720c008040).stop 2023-07-27T14:40:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f721813a730 msgr2=0x7f7218154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f721813a730 0x7f7218154570 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 rx=0x7f7218066540 tx=0x7f7210009840).stop 2023-07-27T14:40:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 shutdown_connections 2023-07-27T14:40:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f71fc05fe20 0x7f71fc0622e0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f721813a730 0x7f7218154570 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72180c36b0 0x7f7218163b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 --2- 172.21.15.115:0/1528409352 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f721813a350 0x7f7218166920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 >> 172.21.15.115:0/1528409352 conn(0x7f721805e8f0 msgr2=0x7f72180633b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 shutdown_connections 2023-07-27T14:40:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:37.370+0000 7f721edff700 1 -- 172.21.15.115:0/1528409352 wait complete. 2023-07-27T14:40:37.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:37.445 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-27T14:40:37.538 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-07-27T14:40:37.539 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:40:37.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:40:37.641 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:40:37.755 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:40:37.756 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-27T14:40:37.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:37.756 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-27T14:40:37.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-07-27T14:40:37.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:37.862 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-27T14:40:37.911 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-27T14:40:37.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:40:37.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-27T14:40:38.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-07-27T14:40:38.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:40:38.008 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-27T14:40:38.055 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:40:38.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.185+0000 7fbfa21ff700 1 Processor -- start 2023-07-27T14:40:38.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.185+0000 7fbfa21ff700 1 -- start start 2023-07-27T14:40:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.187+0000 7fbfa21ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbf9c1542a0 0x7fbf9c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.187+0000 7fbfa21ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c0aa4d0 con 0x7fbf9c153ec0 2023-07-27T14:40:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.187+0000 7fbfa21ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c0c05c0 con 0x7fbf9c0aaa40 2023-07-27T14:40:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.187+0000 7fbfa21ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c1a60 con 0x7fbf9c1542a0 2023-07-27T14:40:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.187+0000 7fbf9b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbf9c153ec0 0x7fbf9c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60972/0 (socket says 172.21.15.115:60972) 2023-07-27T14:40:38.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.187+0000 7fbf9b7fe700 1 -- 172.21.15.115:0/1070572502 learned_addr learned my addr 172.21.15.115:0/1070572502 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:38.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.187+0000 7fbf9bfff700 1 --2- 172.21.15.115:0/1070572502 >> v2:172.21.15.159:3300/0 conn(0x7fbf9c1542a0 0x7fbf9c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.187+0000 7fbf9a7fc700 1 -- 172.21.15.115:0/1070572502 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019852343 0 0) 0x7fbf8c001110 con 0x7fbf9c153ec0 2023-07-27T14:40:38.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9a7fc700 1 -- 172.21.15.115:0/1070572502 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf840033f0 con 0x7fbf9c153ec0 2023-07-27T14:40:38.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9a7fc700 1 -- 172.21.15.115:0/1070572502 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006098388 0 0) 0x7fbf9c0c05c0 con 0x7fbf9c0aaa40 2023-07-27T14:40:38.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9a7fc700 1 -- 172.21.15.115:0/1070572502 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8c001110 con 0x7fbf9c0aaa40 2023-07-27T14:40:38.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9bfff700 1 -- 172.21.15.115:0/1070572502 >> v1:172.21.15.159:6789/0 conn(0x7fbf9c0aaa40 legacy=0x7fbf9c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9bfff700 1 -- 172.21.15.115:0/1070572502 >> v1:172.21.15.115:6789/0 conn(0x7fbf9c153ec0 legacy=0x7fbf9c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9bfff700 1 -- 172.21.15.115:0/1070572502 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c0aa270 con 0x7fbf9c1542a0 2023-07-27T14:40:38.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9bfff700 1 --2- 172.21.15.115:0/1070572502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c15efc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fbf94009e60 tx=0x7fbf94009780).ready entity=mon.1 client_cookie=5af91e0dc6653df6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:38.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9a7fc700 1 -- 172.21.15.115:0/1070572502 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400e070 con 0x7fbf9c1542a0 2023-07-27T14:40:38.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9a7fc700 1 -- 172.21.15.115:0/1070572502 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9400bab0 con 0x7fbf9c1542a0 2023-07-27T14:40:38.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.188+0000 7fbf9a7fc700 1 -- 172.21.15.115:0/1070572502 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400be30 con 0x7fbf9c1542a0 2023-07-27T14:40:38.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.189+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1070572502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c1542a0 msgr2=0x7fbf9c15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.189+0000 7fbfa21ff700 1 --2- 172.21.15.115:0/1070572502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c15efc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fbf94009e60 tx=0x7fbf94009780).stop 2023-07-27T14:40:38.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.189+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1070572502 shutdown_connections 2023-07-27T14:40:38.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.189+0000 7fbfa21ff700 1 --2- 172.21.15.115:0/1070572502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c15efc0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.189+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1070572502 >> 172.21.15.115:0/1070572502 conn(0x7fbf9c0cb610 msgr2=0x7fbf9c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:38.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.189+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1070572502 shutdown_connections 2023-07-27T14:40:38.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.189+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1070572502 wait complete. 2023-07-27T14:40:38.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.190+0000 7fbfa21ff700 1 Processor -- start 2023-07-27T14:40:38.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.190+0000 7fbfa21ff700 1 -- start start 2023-07-27T14:40:38.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.191+0000 7fbfa21ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c0aaa40 0x7fbf9c0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.191+0000 7fbfa21ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf9c153ec0 0x7fbf9c14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.191+0000 7fbfa21ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c0aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.191+0000 7fbfa21ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0ae8f0 con 0x7fbf9c1542a0 2023-07-27T14:40:38.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.191+0000 7fbfa21ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0adce0 con 0x7fbf9c0aaa40 2023-07-27T14:40:38.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.191+0000 7fbfa21ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0adfc0 con 0x7fbf9c153ec0 2023-07-27T14:40:38.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c0aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c0aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56360/0 (socket says 172.21.15.115:56360) 2023-07-27T14:40:38.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 -- 172.21.15.115:0/1708628635 learned_addr learned my addr 172.21.15.115:0/1708628635 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:38.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9b7fe700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c0aaa40 0x7fbf9c0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9affd700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf9c153ec0 0x7fbf9c14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 -- 172.21.15.115:0/1708628635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf9c153ec0 msgr2=0x7fbf9c14c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf9c153ec0 0x7fbf9c14c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 -- 172.21.15.115:0/1708628635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c0aaa40 msgr2=0x7fbf9c0c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c0aaa40 0x7fbf9c0c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 -- 172.21.15.115:0/1708628635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94009a20 con 0x7fbf9c1542a0 2023-07-27T14:40:38.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf9bfff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c0aed80 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 rx=0x7fbf94011000 tx=0x7fbf9c0c0530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:38.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf837fe700 1 -- 172.21.15.115:0/1708628635 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94012e30 con 0x7fbf9c1542a0 2023-07-27T14:40:38.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf837fe700 1 -- 172.21.15.115:0/1708628635 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9401d630 con 0x7fbf9c1542a0 2023-07-27T14:40:38.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbf837fe700 1 -- 172.21.15.115:0/1708628635 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9401d9b0 con 0x7fbf9c1542a0 2023-07-27T14:40:38.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.192+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c0ae2a0 con 0x7fbf9c1542a0 2023-07-27T14:40:38.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.193+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c0c2b30 con 0x7fbf9c1542a0 2023-07-27T14:40:38.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.193+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c06c470 con 0x7fbf9c1542a0 2023-07-27T14:40:38.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.194+0000 7fbf837fe700 1 -- 172.21.15.115:0/1708628635 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fbf9401dd20 con 0x7fbf9c1542a0 2023-07-27T14:40:38.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.195+0000 7fbf837fe700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf8805fdf0 0x7fbf880622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.195+0000 7fbf837fe700 1 -- 172.21.15.115:0/1708628635 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fbf9407d380 con 0x7fbf9c1542a0 2023-07-27T14:40:38.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.195+0000 7fbf9b7fe700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf8805fdf0 0x7fbf880622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.196+0000 7fbf9b7fe700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf8805fdf0 0x7fbf880622b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fbf8c005750 tx=0x7fbf8c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:38.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.199+0000 7fbf837fe700 1 -- 172.21.15.115:0/1708628635 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbf9404d760 con 0x7fbf9c1542a0 2023-07-27T14:40:38.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.408+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf9c0aea30 con 0x7fbf9c1542a0 2023-07-27T14:40:38.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.409+0000 7fbf837fe700 1 -- 172.21.15.115:0/1708628635 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4515 (secure 0 0 0) 0x7fbf94050d80 con 0x7fbf9c1542a0 2023-07-27T14:40:38.466 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:38.466 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":113,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3608226418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3608226418},{"type":"v1","addr":"172.21.15.115:6837","nonce":3608226418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":9118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3601251920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3601251920},{"type":"v1","addr":"172.21.15.159:6835","nonce":3601251920}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":10386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3139755816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3139755816},{"type":"v1","addr":"172.21.15.115:6835","nonce":3139755816}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:40:00.408365+0000","modified":"2023-07-27T14:40:03.430962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10389":{"gid":10389,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/1326270023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1326270023},{"type":"v1","addr":"172.21.15.159:6834","nonce":1326270023}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-07-27T14:40:38.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf8805fdf0 msgr2=0x7fbf880622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf8805fdf0 0x7fbf880622b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fbf8c005750 tx=0x7fbf8c009040).stop 2023-07-27T14:40:38.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf9c1542a0 msgr2=0x7fbf9c0aed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c0aed80 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 rx=0x7fbf94011000 tx=0x7fbf9c0c0530).stop 2023-07-27T14:40:38.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 shutdown_connections 2023-07-27T14:40:38.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf8805fdf0 0x7fbf880622b0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf9c1542a0 0x7fbf9c0aed80 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf9c0aaa40 0x7fbf9c0c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 --2- 172.21.15.115:0/1708628635 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf9c153ec0 0x7fbf9c14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 >> 172.21.15.115:0/1708628635 conn(0x7fbf9c0cb610 msgr2=0x7fbf9c14f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:38.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 shutdown_connections 2023-07-27T14:40:38.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.411+0000 7fbfa21ff700 1 -- 172.21.15.115:0/1708628635 wait complete. 2023-07-27T14:40:38.470 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 113 2023-07-27T14:40:38.485 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:40:38.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.617+0000 7f3c72dff700 1 Processor -- start 2023-07-27T14:40:38.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.617+0000 7f3c72dff700 1 -- start start 2023-07-27T14:40:38.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c72dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c6c0aaa40 0x7f3c6c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c72dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c72dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c0aa4d0 con 0x7f3c6c153ec0 2023-07-27T14:40:38.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c72dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c064ad0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c72dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0c05c0 con 0x7f3c6c1542a0 2023-07-27T14:40:38.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c7139c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c7139c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:35886/0 (socket says 172.21.15.115:35886) 2023-07-27T14:40:38.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c70b9b700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f3c6c153ec0 0x7f3c6c0a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:46518/0 (socket says 172.21.15.115:46518) 2023-07-27T14:40:38.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c7139c700 1 -- 172.21.15.115:0/3332444192 learned_addr learned my addr 172.21.15.115:0/3332444192 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:38.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.619+0000 7f3c6bfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c6c0aaa40 0x7f3c6c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c7139c700 1 -- 172.21.15.115:0/3332444192 >> v2:172.21.15.159:3300/0 conn(0x7f3c6c0aaa40 msgr2=0x7f3c6c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:38.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c7139c700 1 --2- 172.21.15.115:0/3332444192 >> v2:172.21.15.159:3300/0 conn(0x7f3c6c0aaa40 0x7f3c6c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c7139c700 1 -- 172.21.15.115:0/3332444192 >> v1:172.21.15.159:6789/0 conn(0x7f3c6c153ec0 legacy=0x7f3c6c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c7139c700 1 -- 172.21.15.115:0/3332444192 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0c1a60 con 0x7f3c6c1542a0 2023-07-27T14:40:38.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c6bfff700 1 --2- 172.21.15.115:0/3332444192 >> v2:172.21.15.159:3300/0 conn(0x7f3c6c0aaa40 0x7f3c6c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:38.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c7139c700 1 --2- 172.21.15.115:0/3332444192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0645e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f3c64009f20 tx=0x7f3c64009840).ready entity=mon.2 client_cookie=9a5e804dfafb6a6f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:38.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c6b7fe700 1 -- 172.21.15.115:0/3332444192 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400e070 con 0x7f3c6c1542a0 2023-07-27T14:40:38.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c6b7fe700 1 -- 172.21.15.115:0/3332444192 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6400b9d0 con 0x7f3c6c1542a0 2023-07-27T14:40:38.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.620+0000 7f3c6b7fe700 1 -- 172.21.15.115:0/3332444192 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400bd50 con 0x7f3c6c1542a0 2023-07-27T14:40:38.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.621+0000 7f3c72dff700 1 -- 172.21.15.115:0/3332444192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 msgr2=0x7f3c6c0645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.621+0000 7f3c72dff700 1 --2- 172.21.15.115:0/3332444192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0645e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f3c64009f20 tx=0x7f3c64009840).stop 2023-07-27T14:40:38.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.621+0000 7f3c72dff700 1 -- 172.21.15.115:0/3332444192 shutdown_connections 2023-07-27T14:40:38.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.621+0000 7f3c72dff700 1 --2- 172.21.15.115:0/3332444192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0645e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.621+0000 7f3c72dff700 1 --2- 172.21.15.115:0/3332444192 >> v2:172.21.15.159:3300/0 conn(0x7f3c6c0aaa40 0x7f3c6c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.621+0000 7f3c72dff700 1 -- 172.21.15.115:0/3332444192 >> 172.21.15.115:0/3332444192 conn(0x7f3c6c0cb610 msgr2=0x7f3c6c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:38.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.621+0000 7f3c72dff700 1 -- 172.21.15.115:0/3332444192 shutdown_connections 2023-07-27T14:40:38.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.621+0000 7f3c72dff700 1 -- 172.21.15.115:0/3332444192 wait complete. 2023-07-27T14:40:38.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.622+0000 7f3c72dff700 1 Processor -- start 2023-07-27T14:40:38.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.622+0000 7f3c72dff700 1 -- start start 2023-07-27T14:40:38.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.623+0000 7f3c72dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c6c0aaa40 0x7f3c6c1517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.623+0000 7f3c72dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c6c153ec0 0x7f3c6c14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.623+0000 7f3c72dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.623+0000 7f3c72dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c152bb0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.623+0000 7f3c72dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c151fa0 con 0x7f3c6c153ec0 2023-07-27T14:40:38.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.623+0000 7f3c72dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c152280 con 0x7f3c6c1542a0 2023-07-27T14:40:38.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.623+0000 7f3c70b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c6c0aaa40 0x7f3c6c1517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c70b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c6c0aaa40 0x7f3c6c1517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56368/0 (socket says 172.21.15.115:56368) 2023-07-27T14:40:38.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c70b9b700 1 -- 172.21.15.115:0/2799120412 learned_addr learned my addr 172.21.15.115:0/2799120412 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:38.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c7139c700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c6bfff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c6c153ec0 0x7f3c6c14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c70b9b700 1 -- 172.21.15.115:0/2799120412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 msgr2=0x7f3c6c0ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c70b9b700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c70b9b700 1 -- 172.21.15.115:0/2799120412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c6c153ec0 msgr2=0x7f3c6c14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c70b9b700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c6c153ec0 0x7f3c6c14e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c70b9b700 1 -- 172.21.15.115:0/2799120412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580092a0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c70b9b700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c6c0aaa40 0x7f3c6c1517b0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 rx=0x7f3c60007fd0 tx=0x7f3c60007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c68ff9700 1 -- 172.21.15.115:0/2799120412 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6000ce10 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c68ff9700 1 -- 172.21.15.115:0/2799120412 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c600072e0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c64009ae0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.624+0000 7f3c68ff9700 1 -- 172.21.15.115:0/2799120412 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c600056e0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.625+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c152840 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.626+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c06c470 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.626+0000 7f3c68ff9700 1 -- 172.21.15.115:0/2799120412 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f3c60010070 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.627+0000 7f3c68ff9700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3c5005fe20 0x7f3c500622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:38.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.627+0000 7f3c68ff9700 1 -- 172.21.15.115:0/2799120412 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f3c6007a8a0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.627+0000 7f3c6bfff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3c5005fe20 0x7f3c500622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:38.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.628+0000 7f3c6bfff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3c5005fe20 0x7f3c500622e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f3c6c14f6e0 tx=0x7f3c58009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:38.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.631+0000 7f3c68ff9700 1 -- 172.21.15.115:0/2799120412 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c6004ad90 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.802+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c6c0aa4d0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.803+0000 7f3c68ff9700 1 -- 172.21.15.115:0/2799120412 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+17130 (secure 0 0 0) 0x7f3c6c0aa4d0 con 0x7f3c6c0aaa40 2023-07-27T14:40:38.861 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:38.861 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":205,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:40:01.410819+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:39:58.717120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-07-27T14:39:59.393690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:40:38.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.805+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3c5005fe20 msgr2=0x7f3c500622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.805+0000 7f3c72dff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3c5005fe20 0x7f3c500622e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f3c6c14f6e0 tx=0x7f3c58009060).stop 2023-07-27T14:40:38.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.805+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c6c0aaa40 msgr2=0x7f3c6c1517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:38.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.805+0000 7f3c72dff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c6c0aaa40 0x7f3c6c1517b0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 rx=0x7f3c60007fd0 tx=0x7f3c60007df0).stop 2023-07-27T14:40:38.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.806+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 shutdown_connections 2023-07-27T14:40:38.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.806+0000 7f3c72dff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f3c5005fe20 0x7f3c500622e0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.806+0000 7f3c72dff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c6c1542a0 0x7f3c6c0ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.806+0000 7f3c72dff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c6c0aaa40 0x7f3c6c1517b0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.806+0000 7f3c72dff700 1 --2- 172.21.15.115:0/2799120412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c6c153ec0 0x7f3c6c14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:38.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.806+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 >> 172.21.15.115:0/2799120412 conn(0x7f3c6c0cb610 msgr2=0x7f3c6c14f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:38.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.806+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 shutdown_connections 2023-07-27T14:40:38.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:38.806+0000 7f3c72dff700 1 -- 172.21.15.115:0/2799120412 wait complete. 2023-07-27T14:40:38.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 28, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-27T14:39:58.717120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '204', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2023-07-27T14:39:59.393690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '205', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-27T14:40:38.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:40:39.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.017+0000 7f642a7ff700 1 Processor -- start 2023-07-27T14:40:39.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.017+0000 7f642a7ff700 1 -- start start 2023-07-27T14:40:39.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.018+0000 7f642a7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64240c6b70 0x7f64240656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.018+0000 7f642a7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6424066050 con 0x7f6424153e00 2023-07-27T14:40:39.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.018+0000 7f642a7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6424064a80 con 0x7f6424065bc0 2023-07-27T14:40:39.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.018+0000 7f642a7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6424062320 con 0x7f64240c6b70 2023-07-27T14:40:39.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.018+0000 7f64237fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64240c6b70 0x7f64240656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f64237fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f64240c6b70 0x7f64240656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56380/0 (socket says 172.21.15.115:56380) 2023-07-27T14:40:39.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f64237fe700 1 -- 172.21.15.115:0/3718357466 learned_addr learned my addr 172.21.15.115:0/3718357466 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:39.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f6423fff700 1 --1- 172.21.15.115:0/3718357466 >> v1:172.21.15.115:6789/0 conn(0x7f6424153e00 0x7f6424064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60978/0 (socket says 172.21.15.115:60978) 2023-07-27T14:40:39.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f64237fe700 1 -- 172.21.15.115:0/3718357466 >> v1:172.21.15.159:6789/0 conn(0x7f6424065bc0 legacy=0x7f6424062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f64237fe700 1 -- 172.21.15.115:0/3718357466 >> v1:172.21.15.115:6789/0 conn(0x7f6424153e00 legacy=0x7f6424064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f64237fe700 1 -- 172.21.15.115:0/3718357466 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424064d60 con 0x7f64240c6b70 2023-07-27T14:40:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f6422ffd700 1 -- 172.21.15.115:0/3718357466 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28802582 0 0) 0x7f6424066050 con 0x7f6424153e00 2023-07-27T14:40:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f64237fe700 1 --2- 172.21.15.115:0/3718357466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f64240656d0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 rx=0x7f6418006fd0 tx=0x7f64180090f0).ready entity=mon.0 client_cookie=d89b87b8336c1382 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f6422ffd700 1 -- 172.21.15.115:0/3718357466 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800b600 con 0x7f64240c6b70 2023-07-27T14:40:39.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f6422ffd700 1 -- 172.21.15.115:0/3718357466 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641800b760 con 0x7f64240c6b70 2023-07-27T14:40:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.019+0000 7f6422ffd700 1 -- 172.21.15.115:0/3718357466 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800bae0 con 0x7f64240c6b70 2023-07-27T14:40:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.020+0000 7f642a7ff700 1 -- 172.21.15.115:0/3718357466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 msgr2=0x7f64240656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.020+0000 7f642a7ff700 1 --2- 172.21.15.115:0/3718357466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f64240656d0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 rx=0x7f6418006fd0 tx=0x7f64180090f0).stop 2023-07-27T14:40:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.020+0000 7f642a7ff700 1 -- 172.21.15.115:0/3718357466 shutdown_connections 2023-07-27T14:40:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.020+0000 7f642a7ff700 1 --2- 172.21.15.115:0/3718357466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f64240656d0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.020+0000 7f642a7ff700 1 -- 172.21.15.115:0/3718357466 >> 172.21.15.115:0/3718357466 conn(0x7f64240c7b90 msgr2=0x7f64240c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:39.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.020+0000 7f642a7ff700 1 -- 172.21.15.115:0/3718357466 shutdown_connections 2023-07-27T14:40:39.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.020+0000 7f642a7ff700 1 -- 172.21.15.115:0/3718357466 wait complete. 2023-07-27T14:40:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.022+0000 7f642a7ff700 1 Processor -- start 2023-07-27T14:40:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.022+0000 7f642a7ff700 1 -- start start 2023-07-27T14:40:39.081 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f642a7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6424065bc0 0x7f64240aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f642a7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f6424094200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f642a7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6424153e00 0x7f64240bc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f642a7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424167920 con 0x7f64240c6b70 2023-07-27T14:40:39.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f642a7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424167c00 con 0x7f6424153e00 2023-07-27T14:40:39.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f642a7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6424167ee0 con 0x7f6424065bc0 2023-07-27T14:40:39.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f64237fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f6424094200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f64237fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f6424094200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56386/0 (socket says 172.21.15.115:56386) 2023-07-27T14:40:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f64237fe700 1 -- 172.21.15.115:0/1860625673 learned_addr learned my addr 172.21.15.115:0/1860625673 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f6423fff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6424065bc0 0x7f64240aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f64237fe700 1 -- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6424065bc0 msgr2=0x7f64240aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f6428d9c700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6424153e00 0x7f64240bc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f64237fe700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6424065bc0 0x7f64240aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f64237fe700 1 -- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6424153e00 msgr2=0x7f64240bc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f64237fe700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6424153e00 0x7f64240bc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f64237fe700 1 -- 172.21.15.115:0/1860625673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418009370 con 0x7f64240c6b70 2023-07-27T14:40:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f6423fff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6424065bc0 0x7f64240aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.023+0000 7f6428d9c700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6424153e00 0x7f64240bc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.024+0000 7f64237fe700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f6424094200 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 rx=0x7f64240680d0 tx=0x7f6418017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.024+0000 7f640bfff700 1 -- 172.21.15.115:0/1860625673 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641800bae0 con 0x7f64240c6b70 2023-07-27T14:40:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.024+0000 7f640bfff700 1 -- 172.21.15.115:0/1860625673 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6418000d10 con 0x7f64240c6b70 2023-07-27T14:40:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.024+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64241681c0 con 0x7f64240c6b70 2023-07-27T14:40:39.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.024+0000 7f640bfff700 1 -- 172.21.15.115:0/1860625673 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641801c650 con 0x7f64240c6b70 2023-07-27T14:40:39.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.024+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6424168780 con 0x7f64240c6b70 2023-07-27T14:40:39.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.025+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642406c470 con 0x7f64240c6b70 2023-07-27T14:40:39.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.026+0000 7f640bfff700 1 -- 172.21.15.115:0/1860625673 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f641802c070 con 0x7f64240c6b70 2023-07-27T14:40:39.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.027+0000 7f640bfff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f641005fe20 0x7f64100622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.027+0000 7f640bfff700 1 -- 172.21.15.115:0/1860625673 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f641807d300 con 0x7f64240c6b70 2023-07-27T14:40:39.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.027+0000 7f6423fff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f641005fe20 0x7f64100622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.027+0000 7f6423fff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f641005fe20 0x7f64100622e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f6414007fd0 tx=0x7f6414009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.031+0000 7f640bfff700 1 -- 172.21.15.115:0/1860625673 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f641804d7f0 con 0x7f64240c6b70 2023-07-27T14:40:39.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.198+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f64240c4390 con 0x7f64240c6b70 2023-07-27T14:40:39.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.199+0000 7f640bfff700 1 -- 172.21.15.115:0/1860625673 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v205) v1 ==== 110+0+10 (secure 0 0 0) 0x7f64180200b0 con 0x7f64240c6b70 2023-07-27T14:40:39.256 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:40:39.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.200+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f641005fe20 msgr2=0x7f64100622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.200+0000 7f642a7ff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f641005fe20 0x7f64100622e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f6414007fd0 tx=0x7f6414009040).stop 2023-07-27T14:40:39.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.200+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 msgr2=0x7f6424094200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.200+0000 7f642a7ff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f6424094200 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 rx=0x7f64240680d0 tx=0x7f6418017000).stop 2023-07-27T14:40:39.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.200+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 shutdown_connections 2023-07-27T14:40:39.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.200+0000 7f642a7ff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f641005fe20 0x7f64100622e0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.259 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.200+0000 7f642a7ff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6424153e00 0x7f64240bc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.201+0000 7f642a7ff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6424065bc0 0x7f64240aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.201+0000 7f642a7ff700 1 --2- 172.21.15.115:0/1860625673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64240c6b70 0x7f6424094200 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.201+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 >> 172.21.15.115:0/1860625673 conn(0x7f64240c7b90 msgr2=0x7f64241523e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:39.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.201+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 shutdown_connections 2023-07-27T14:40:39.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.201+0000 7f642a7ff700 1 -- 172.21.15.115:0/1860625673 wait complete. 2023-07-27T14:40:39.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:40:39.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.408+0000 7f098ddff700 1 Processor -- start 2023-07-27T14:40:39.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.409+0000 7f098ddff700 1 -- start start 2023-07-27T14:40:39.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f098ddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098814ae00 0x7f0988154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f098ddff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f098814b1e0 0x7f0988062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f098ddff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09881553f0 con 0x7f09880c5c50 2023-07-27T14:40:39.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f098ddff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0988157a50 con 0x7f098814b1e0 2023-07-27T14:40:39.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f098ddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0988157d10 con 0x7f098814ae00 2023-07-27T14:40:39.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f0987fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f09880c5c50 0x7f09880a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60982/0 (socket says 172.21.15.115:60982) 2023-07-27T14:40:39.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f0987fff700 1 -- 172.21.15.115:0/2969654212 learned_addr learned my addr 172.21.15.115:0/2969654212 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:39.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f09877fe700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098814ae00 0x7f0988154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.410+0000 7f0986ffd700 1 --2- 172.21.15.115:0/2969654212 >> v2:172.21.15.159:3300/0 conn(0x7f098814b1e0 0x7f0988062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868826561 0 0) 0x7f09881553f0 con 0x7f09880c5c50 2023-07-27T14:40:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09700033f0 con 0x7f09880c5c50 2023-07-27T14:40:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165249628 0 0) 0x7f09700033f0 con 0x7f09880c5c50 2023-07-27T14:40:39.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098814ae00 msgr2=0x7f0988154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:39.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f098814ae00 0x7f0988154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 >> v2:172.21.15.159:3300/0 conn(0x7f098814b1e0 msgr2=0x7f0988062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:39.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 --2- 172.21.15.115:0/2969654212 >> v2:172.21.15.159:3300/0 conn(0x7f098814b1e0 0x7f0988062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988157ff0 con 0x7f09880c5c50 2023-07-27T14:40:39.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f09800017f0 con 0x7f09880c5c50 2023-07-27T14:40:39.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 >> v1:172.21.15.115:6789/0 conn(0x7f09880c5c50 legacy=0x7f09880a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09700038e0 0x7f0970003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0970004690 0x7f0970004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0970005000 0x7f097000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988157a50 con 0x7f0970005000 2023-07-27T14:40:39.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988157d10 con 0x7f0970004690 2023-07-27T14:40:39.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097000bdd0 con 0x7f09700038e0 2023-07-27T14:40:39.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f0987fff700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0970005000 0x7f097000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f09877fe700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09700038e0 0x7f0970003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.411+0000 7f0986ffd700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0970004690 0x7f0970004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f0987fff700 1 -- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09700038e0 msgr2=0x7f0970003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:39.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f0987fff700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09700038e0 0x7f0970003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f0987fff700 1 -- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0970004690 msgr2=0x7f0970004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:39.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f0987fff700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0970004690 0x7f0970004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f0987fff700 1 -- 172.21.15.115:0/2969654212 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700033f0 con 0x7f0970005000 2023-07-27T14:40:39.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f0986ffd700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0970004690 0x7f0970004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:39.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f0987fff700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0970005000 0x7f097000b8e0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 rx=0x7f098000c560 tx=0x7f0980002210).ready entity=mon.0 client_cookie=9bc7cb8a44eb20df server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980007de0 con 0x7f0970005000 2023-07-27T14:40:39.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000ce50 con 0x7f0970005000 2023-07-27T14:40:39.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f09867fc700 1 -- 172.21.15.115:0/2969654212 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980005d50 con 0x7f0970005000 2023-07-27T14:40:39.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f098ddff700 1 -- 172.21.15.115:0/2969654212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0970005000 msgr2=0x7f097000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f098ddff700 1 --2- 172.21.15.115:0/2969654212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0970005000 0x7f097000b8e0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 rx=0x7f098000c560 tx=0x7f0980002210).stop 2023-07-27T14:40:39.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.412+0000 7f0987fff700 1 -- 172.21.15.115:0/2969654212 reap_dead start 2023-07-27T14:40:39.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.413+0000 7f098ddff700 1 -- 172.21.15.115:0/2969654212 shutdown_connections 2023-07-27T14:40:39.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.413+0000 7f098ddff700 1 -- 172.21.15.115:0/2969654212 >> 172.21.15.115:0/2969654212 conn(0x7f098805e940 msgr2=0x7f09880cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:39.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.413+0000 7f098ddff700 1 -- 172.21.15.115:0/2969654212 shutdown_connections 2023-07-27T14:40:39.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.413+0000 7f098ddff700 1 -- 172.21.15.115:0/2969654212 wait complete. 2023-07-27T14:40:39.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.415+0000 7f098ddff700 1 Processor -- start 2023-07-27T14:40:39.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.415+0000 7f098ddff700 1 -- start start 2023-07-27T14:40:39.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f098ddff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09880af840 0x7f09880c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f098ddff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880c24c0 0x7f09880afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f098ddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880b0110 0x7f0988155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f098ddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880c4c40 con 0x7f09880b0110 2023-07-27T14:40:39.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f098ddff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880c2940 con 0x7f09880c24c0 2023-07-27T14:40:39.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f098ddff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880c2bb0 con 0x7f09880af840 2023-07-27T14:40:39.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f0987fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880b0110 0x7f0988155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f0987fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880b0110 0x7f0988155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56412/0 (socket says 172.21.15.115:56412) 2023-07-27T14:40:39.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.416+0000 7f0987fff700 1 -- 172.21.15.115:0/2860486179 learned_addr learned my addr 172.21.15.115:0/2860486179 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:39.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f09877fe700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09880af840 0x7f09880c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f0986ffd700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880c24c0 0x7f09880afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f0987fff700 1 -- 172.21.15.115:0/2860486179 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09880af840 msgr2=0x7f09880c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f0987fff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09880af840 0x7f09880c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f0987fff700 1 -- 172.21.15.115:0/2860486179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880c24c0 msgr2=0x7f09880afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f0987fff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880c24c0 0x7f09880afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f0987fff700 1 -- 172.21.15.115:0/2860486179 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880c2e90 con 0x7f09880b0110 2023-07-27T14:40:39.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f0987fff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880b0110 0x7f0988155760 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 rx=0x7f098000a000 tx=0x7f0980015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f096f7fe700 1 -- 172.21.15.115:0/2860486179 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980018030 con 0x7f09880b0110 2023-07-27T14:40:39.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f096f7fe700 1 -- 172.21.15.115:0/2860486179 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09800072e0 con 0x7f09880b0110 2023-07-27T14:40:39.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f096f7fe700 1 -- 172.21.15.115:0/2860486179 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09800076c0 con 0x7f09880b0110 2023-07-27T14:40:39.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.417+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880c3170 con 0x7f09880b0110 2023-07-27T14:40:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.418+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098814a1e0 con 0x7f09880b0110 2023-07-27T14:40:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.419+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09880c37c0 con 0x7f09880b0110 2023-07-27T14:40:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.419+0000 7f096f7fe700 1 -- 172.21.15.115:0/2860486179 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f098001d070 con 0x7f09880b0110 2023-07-27T14:40:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.420+0000 7f096f7fe700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097405fe20 0x7f09740622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.420+0000 7f096f7fe700 1 -- 172.21.15.115:0/2860486179 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f098007c3d0 con 0x7f09880b0110 2023-07-27T14:40:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.420+0000 7f09877fe700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097405fe20 0x7f09740622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.421+0000 7f09877fe700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097405fe20 0x7f09740622e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f09880caaf0 tx=0x7f0978009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.424+0000 7f096f7fe700 1 -- 172.21.15.115:0/2860486179 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f098004c8c0 con 0x7f09880b0110 2023-07-27T14:40:39.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.591+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09881555b0 con 0x7f09880b0110 2023-07-27T14:40:39.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.592+0000 7f096f7fe700 1 -- 172.21.15.115:0/2860486179 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v205) v1 ==== 92+0+10 (secure 0 0 0) 0x7f098004fee0 con 0x7f09880b0110 2023-07-27T14:40:39.649 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:40:39.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097405fe20 msgr2=0x7f09740622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097405fe20 0x7f09740622e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f09880caaf0 tx=0x7f0978009060).stop 2023-07-27T14:40:39.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880b0110 msgr2=0x7f0988155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880b0110 0x7f0988155760 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 rx=0x7f098000a000 tx=0x7f0980015000).stop 2023-07-27T14:40:39.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 shutdown_connections 2023-07-27T14:40:39.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f097405fe20 0x7f09740622e0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09880b0110 0x7f0988155760 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09880af840 0x7f09880c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 --2- 172.21.15.115:0/2860486179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880c24c0 0x7f09880afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 >> 172.21.15.115:0/2860486179 conn(0x7f098805e940 msgr2=0x7f098814a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:39.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 shutdown_connections 2023-07-27T14:40:39.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.594+0000 7f098ddff700 1 -- 172.21.15.115:0/2860486179 wait complete. 2023-07-27T14:40:39.668 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-27T14:40:39.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.802+0000 7f17a89ff700 1 Processor -- start 2023-07-27T14:40:39.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.803+0000 7f17a89ff700 1 -- start start 2023-07-27T14:40:39.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a89ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a414ae00 0x7f17a4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a89ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17a414b1e0 0x7f17a4062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a89ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f17a40c5c50 0x7f17a4063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a89ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a4063530 con 0x7f17a414b1e0 2023-07-27T14:40:39.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a89ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a41553f0 con 0x7f17a40c5c50 2023-07-27T14:40:39.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a89ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4157a50 con 0x7f17a414ae00 2023-07-27T14:40:39.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a1d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17a414b1e0 0x7f17a4062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a1d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f17a414b1e0 0x7f17a4062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56416/0 (socket says 172.21.15.115:56416) 2023-07-27T14:40:39.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a1d9b700 1 -- 172.21.15.115:0/668953852 learned_addr learned my addr 172.21.15.115:0/668953852 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:39.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a2d9d700 1 --2- 172.21.15.115:0/668953852 >> v2:172.21.15.159:3300/0 conn(0x7f17a40c5c50 0x7f17a4063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.804+0000 7f17a259c700 1 --2- 172.21.15.115:0/668953852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a414ae00 0x7f17a4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a1d9b700 1 -- 172.21.15.115:0/668953852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a414ae00 msgr2=0x7f17a4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:39.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a1d9b700 1 --2- 172.21.15.115:0/668953852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a414ae00 0x7f17a4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a1d9b700 1 -- 172.21.15.115:0/668953852 >> v2:172.21.15.159:3300/0 conn(0x7f17a40c5c50 msgr2=0x7f17a4063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:39.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a1d9b700 1 --2- 172.21.15.115:0/668953852 >> v2:172.21.15.159:3300/0 conn(0x7f17a40c5c50 0x7f17a4063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a1d9b700 1 -- 172.21.15.115:0/668953852 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4157d10 con 0x7f17a414b1e0 2023-07-27T14:40:39.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a2d9d700 1 --2- 172.21.15.115:0/668953852 >> v2:172.21.15.159:3300/0 conn(0x7f17a40c5c50 0x7f17a4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:39.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a259c700 1 --2- 172.21.15.115:0/668953852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a414ae00 0x7f17a4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:39.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a1d9b700 1 --2- 172.21.15.115:0/668953852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414b1e0 0x7f17a4062b50 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 rx=0x7f17a405fbe0 tx=0x7f17980090f0).ready entity=mon.0 client_cookie=f1b5360b190d0a3f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a159a700 1 -- 172.21.15.115:0/668953852 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179800b600 con 0x7f17a414b1e0 2023-07-27T14:40:39.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a159a700 1 -- 172.21.15.115:0/668953852 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179800b760 con 0x7f17a414b1e0 2023-07-27T14:40:39.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.805+0000 7f17a159a700 1 -- 172.21.15.115:0/668953852 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179800bae0 con 0x7f17a414b1e0 2023-07-27T14:40:39.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 -- 172.21.15.115:0/668953852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414b1e0 msgr2=0x7f17a4062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 --2- 172.21.15.115:0/668953852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414b1e0 0x7f17a4062b50 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 rx=0x7f17a405fbe0 tx=0x7f17980090f0).stop 2023-07-27T14:40:39.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 -- 172.21.15.115:0/668953852 shutdown_connections 2023-07-27T14:40:39.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 --2- 172.21.15.115:0/668953852 >> v2:172.21.15.159:3300/0 conn(0x7f17a40c5c50 0x7f17a4063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 --2- 172.21.15.115:0/668953852 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a414ae00 0x7f17a4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 --2- 172.21.15.115:0/668953852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414b1e0 0x7f17a4062b50 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 -- 172.21.15.115:0/668953852 >> 172.21.15.115:0/668953852 conn(0x7f17a405e940 msgr2=0x7f17a40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:39.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 -- 172.21.15.115:0/668953852 shutdown_connections 2023-07-27T14:40:39.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.806+0000 7f17a89ff700 1 -- 172.21.15.115:0/668953852 wait complete. 2023-07-27T14:40:39.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.807+0000 7f17a89ff700 1 Processor -- start 2023-07-27T14:40:39.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.807+0000 7f17a89ff700 1 -- start start 2023-07-27T14:40:39.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.808+0000 7f17a89ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a40c5c50 0x7f17a40af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.808+0000 7f17a89ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414ae00 0x7f17a40a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.808+0000 7f17a89ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17a414b1e0 0x7f17a40a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.808+0000 7f17a89ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40aa4d0 con 0x7f17a414ae00 2023-07-27T14:40:39.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.808+0000 7f17a89ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4164f50 con 0x7f17a414b1e0 2023-07-27T14:40:39.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.808+0000 7f17a89ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4167770 con 0x7f17a40c5c50 2023-07-27T14:40:39.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414ae00 0x7f17a40a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414ae00 0x7f17a40a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56430/0 (socket says 172.21.15.115:56430) 2023-07-27T14:40:39.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 -- 172.21.15.115:0/206248548 learned_addr learned my addr 172.21.15.115:0/206248548 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:39.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a259c700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a40c5c50 0x7f17a40af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a2d9d700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17a414b1e0 0x7f17a40a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 -- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a40c5c50 msgr2=0x7f17a40af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a40c5c50 0x7f17a40af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 -- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17a414b1e0 msgr2=0x7f17a40a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:39.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17a414b1e0 0x7f17a40a9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:39.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 -- 172.21.15.115:0/206248548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798009370 con 0x7f17a414ae00 2023-07-27T14:40:39.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a2d9d700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17a414b1e0 0x7f17a40a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:39.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a1d9b700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414ae00 0x7f17a40a9af0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 rx=0x7f1798011000 tx=0x7f1798017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17927fc700 1 -- 172.21.15.115:0/206248548 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179800b8d0 con 0x7f17a414ae00 2023-07-27T14:40:39.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17927fc700 1 -- 172.21.15.115:0/206248548 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179800ba30 con 0x7f17a414ae00 2023-07-27T14:40:39.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17927fc700 1 -- 172.21.15.115:0/206248548 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179801b660 con 0x7f17a414ae00 2023-07-27T14:40:39.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.809+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4167a50 con 0x7f17a414ae00 2023-07-27T14:40:39.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.810+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a4168010 con 0x7f17a414ae00 2023-07-27T14:40:39.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.811+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a40bfe60 con 0x7f17a414ae00 2023-07-27T14:40:39.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.811+0000 7f17927fc700 1 -- 172.21.15.115:0/206248548 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f1798021020 con 0x7f17a414ae00 2023-07-27T14:40:39.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.813+0000 7f17927fc700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f178405fe50 0x7f1784062310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:39.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.813+0000 7f17927fc700 1 -- 172.21.15.115:0/206248548 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f179807cd10 con 0x7f17a414ae00 2023-07-27T14:40:39.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.813+0000 7f17a259c700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f178405fe50 0x7f1784062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:39.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.813+0000 7f17a259c700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f178405fe50 0x7f1784062310 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f1794006fd0 tx=0x7f1794008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:39.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.817+0000 7f17927fc700 1 -- 172.21.15.115:0/206248548 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f179804d170 con 0x7f17a414ae00 2023-07-27T14:40:40.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.991+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17a4168200 con 0x7f17a414ae00 2023-07-27T14:40:40.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.991+0000 7f17927fc700 1 -- 172.21.15.115:0/206248548 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v205) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1798050790 con 0x7f17a414ae00 2023-07-27T14:40:40.048 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:40:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f178405fe50 msgr2=0x7f1784062310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f178405fe50 0x7f1784062310 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f1794006fd0 tx=0x7f1794008040).stop 2023-07-27T14:40:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414ae00 msgr2=0x7f17a40a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414ae00 0x7f17a40a9af0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 rx=0x7f1798011000 tx=0x7f1798017000).stop 2023-07-27T14:40:40.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 shutdown_connections 2023-07-27T14:40:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f178405fe50 0x7f1784062310 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17a414b1e0 0x7f17a40a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f17a40c5c50 0x7f17a40af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 --2- 172.21.15.115:0/206248548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a414ae00 0x7f17a40a9af0 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 >> 172.21.15.115:0/206248548 conn(0x7f17a405e940 msgr2=0x7f17a40c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:40.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 shutdown_connections 2023-07-27T14:40:40.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:39.993+0000 7f17a89ff700 1 -- 172.21.15.115:0/206248548 wait complete. 2023-07-27T14:40:40.067 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-27T14:40:40.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.200+0000 7f0f18dff700 1 Processor -- start 2023-07-27T14:40:40.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.200+0000 7f0f18dff700 1 -- start start 2023-07-27T14:40:40.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.202+0000 7f0f18dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414ae00 0x7f0f14154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.203+0000 7f0f18dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0f1414b1e0 0x7f0f14062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.203+0000 7f0f18dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f141553f0 con 0x7f0f140c5c50 2023-07-27T14:40:40.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.203+0000 7f0f18dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f14157a50 con 0x7f0f1414b1e0 2023-07-27T14:40:40.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.203+0000 7f0f18dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14157d10 con 0x7f0f1414ae00 2023-07-27T14:40:40.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.203+0000 7f0f1259c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414ae00 0x7f0f14154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.203+0000 7f0f1259c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414ae00 0x7f0f14154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:35934/0 (socket says 172.21.15.115:35934) 2023-07-27T14:40:40.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.203+0000 7f0f1259c700 1 -- 172.21.15.115:0/443778453 learned_addr learned my addr 172.21.15.115:0/443778453 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:40.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.203+0000 7f0f0bfff700 1 --2- 172.21.15.115:0/443778453 >> v2:172.21.15.159:3300/0 conn(0x7f0f1414b1e0 0x7f0f14062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f1259c700 1 -- 172.21.15.115:0/443778453 >> v2:172.21.15.159:3300/0 conn(0x7f0f1414b1e0 msgr2=0x7f0f14062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:40.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f1259c700 1 --2- 172.21.15.115:0/443778453 >> v2:172.21.15.159:3300/0 conn(0x7f0f1414b1e0 0x7f0f14062b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f1259c700 1 -- 172.21.15.115:0/443778453 >> v1:172.21.15.159:6789/0 conn(0x7f0f140c5c50 legacy=0x7f0f140a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f1259c700 1 -- 172.21.15.115:0/443778453 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14157ff0 con 0x7f0f1414ae00 2023-07-27T14:40:40.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f0bfff700 1 --2- 172.21.15.115:0/443778453 >> v2:172.21.15.159:3300/0 conn(0x7f0f1414b1e0 0x7f0f14062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:40.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f1259c700 1 --2- 172.21.15.115:0/443778453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414ae00 0x7f0f14154f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f0f04006fd0 tx=0x7f0f040090f0).ready entity=mon.2 client_cookie=2bbd7ba61b0c6026 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:40.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f11d9b700 1 -- 172.21.15.115:0/443778453 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0400b580 con 0x7f0f1414ae00 2023-07-27T14:40:40.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f11d9b700 1 -- 172.21.15.115:0/443778453 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0400b6e0 con 0x7f0f1414ae00 2023-07-27T14:40:40.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.204+0000 7f0f11d9b700 1 -- 172.21.15.115:0/443778453 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0400ba60 con 0x7f0f1414ae00 2023-07-27T14:40:40.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.205+0000 7f0f18dff700 1 -- 172.21.15.115:0/443778453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414ae00 msgr2=0x7f0f14154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.205+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443778453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414ae00 0x7f0f14154f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f0f04006fd0 tx=0x7f0f040090f0).stop 2023-07-27T14:40:40.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.205+0000 7f0f18dff700 1 -- 172.21.15.115:0/443778453 shutdown_connections 2023-07-27T14:40:40.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.205+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443778453 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414ae00 0x7f0f14154f00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.205+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443778453 >> v2:172.21.15.159:3300/0 conn(0x7f0f1414b1e0 0x7f0f14062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.205+0000 7f0f18dff700 1 -- 172.21.15.115:0/443778453 >> 172.21.15.115:0/443778453 conn(0x7f0f1405e940 msgr2=0x7f0f140cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:40.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.205+0000 7f0f18dff700 1 -- 172.21.15.115:0/443778453 shutdown_connections 2023-07-27T14:40:40.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.205+0000 7f0f18dff700 1 -- 172.21.15.115:0/443778453 wait complete. 2023-07-27T14:40:40.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.207+0000 7f0f18dff700 1 Processor -- start 2023-07-27T14:40:40.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.207+0000 7f0f18dff700 1 -- start start 2023-07-27T14:40:40.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f18dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f140c5c50 0x7f0f140aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f18dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1414ae00 0x7f0f14148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f18dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414b1e0 0x7f0f14064270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f18dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140ac000 con 0x7f0f140c5c50 2023-07-27T14:40:40.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f18dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140ac490 con 0x7f0f1414ae00 2023-07-27T14:40:40.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f18dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140ab3f0 con 0x7f0f1414b1e0 2023-07-27T14:40:40.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f1259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f140c5c50 0x7f0f140aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f1259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f140c5c50 0x7f0f140aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56432/0 (socket says 172.21.15.115:56432) 2023-07-27T14:40:40.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f1259c700 1 -- 172.21.15.115:0/443827089 learned_addr learned my addr 172.21.15.115:0/443827089 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:40.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f0bfff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1414ae00 0x7f0f14148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.208+0000 7f0f12d9d700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414b1e0 0x7f0f14064270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f1259c700 1 -- 172.21.15.115:0/443827089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414b1e0 msgr2=0x7f0f14064270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f1259c700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414b1e0 0x7f0f14064270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f1259c700 1 -- 172.21.15.115:0/443827089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1414ae00 msgr2=0x7f0f14148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f1259c700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1414ae00 0x7f0f14148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f1259c700 1 -- 172.21.15.115:0/443827089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0092a0 con 0x7f0f140c5c50 2023-07-27T14:40:40.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f1259c700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f140c5c50 0x7f0f140aae50 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 rx=0x7f0f140caac0 tx=0x7f0f04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:40.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f0a7fc700 1 -- 172.21.15.115:0/443827089 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04000bc0 con 0x7f0f140c5c50 2023-07-27T14:40:40.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f0a7fc700 1 -- 172.21.15.115:0/443827089 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0400b850 con 0x7f0f140c5c50 2023-07-27T14:40:40.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f04009370 con 0x7f0f140c5c50 2023-07-27T14:40:40.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f0a7fc700 1 -- 172.21.15.115:0/443827089 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04000d20 con 0x7f0f140c5c50 2023-07-27T14:40:40.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.209+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f140aba30 con 0x7f0f140c5c50 2023-07-27T14:40:40.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.210+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f140abdb0 con 0x7f0f140c5c50 2023-07-27T14:40:40.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.211+0000 7f0f0a7fc700 1 -- 172.21.15.115:0/443827089 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f0f0402b070 con 0x7f0f140c5c50 2023-07-27T14:40:40.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.212+0000 7f0f0a7fc700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ef405fdf0 0x7f0ef40622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.212+0000 7f0f0a7fc700 1 -- 172.21.15.115:0/443827089 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0f0407ce70 con 0x7f0f140c5c50 2023-07-27T14:40:40.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.212+0000 7f0f0bfff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ef405fdf0 0x7f0ef40622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.212+0000 7f0f0bfff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ef405fdf0 0x7f0ef40622b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f0f140632a0 tx=0x7f0efc009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:40.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.216+0000 7f0f0a7fc700 1 -- 172.21.15.115:0/443827089 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0f0404d300 con 0x7f0f140c5c50 2023-07-27T14:40:40.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.384+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f1406c470 con 0x7f0f140c5c50 2023-07-27T14:40:40.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.384+0000 7f0f0a7fc700 1 -- 172.21.15.115:0/443827089 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v205) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f04020020 con 0x7f0f140c5c50 2023-07-27T14:40:40.441 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 64 2023-07-27T14:40:40.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ef405fdf0 msgr2=0x7f0ef40622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ef405fdf0 0x7f0ef40622b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f0f140632a0 tx=0x7f0efc009060).stop 2023-07-27T14:40:40.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f140c5c50 msgr2=0x7f0f140aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f140c5c50 0x7f0f140aae50 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 rx=0x7f0f140caac0 tx=0x7f0f04017000).stop 2023-07-27T14:40:40.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 shutdown_connections 2023-07-27T14:40:40.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0ef405fdf0 0x7f0ef40622b0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0f1414b1e0 0x7f0f14064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f140c5c50 0x7f0f140aae50 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 --2- 172.21.15.115:0/443827089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f1414ae00 0x7f0f14148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 >> 172.21.15.115:0/443827089 conn(0x7f0f1405e940 msgr2=0x7f0f14152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:40.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 shutdown_connections 2023-07-27T14:40:40.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.386+0000 7f0f18dff700 1 -- 172.21.15.115:0/443827089 wait complete. 2023-07-27T14:40:40.461 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:40:40.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.594+0000 7fcebf3ff700 1 Processor -- start 2023-07-27T14:40:40.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.594+0000 7fcebf3ff700 1 -- start start 2023-07-27T14:40:40.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.595+0000 7fcebf3ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fceb8151d70 0x7fceb8155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.595+0000 7fcebf3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8065ff0 0x7fceb8066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.595+0000 7fcebf3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fceb8066960 0x7fceb8157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.595+0000 7fcebf3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb8063a90 con 0x7fceb8066960 2023-07-27T14:40:40.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.595+0000 7fcebf3ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb8067080 con 0x7fceb8151d70 2023-07-27T14:40:40.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.595+0000 7fcebf3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8066df0 con 0x7fceb8065ff0 2023-07-27T14:40:40.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.595+0000 7fcebd99c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fceb8066960 0x7fceb8157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd99c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fceb8066960 0x7fceb8157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56440/0 (socket says 172.21.15.115:56440) 2023-07-27T14:40:40.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd99c700 1 -- 172.21.15.115:0/3141667033 learned_addr learned my addr 172.21.15.115:0/3141667033 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:40.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd19b700 1 --2- 172.21.15.115:0/3141667033 >> v2:172.21.15.159:3300/0 conn(0x7fceb8151d70 0x7fceb8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebc99a700 1 --2- 172.21.15.115:0/3141667033 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8065ff0 0x7fceb8066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd99c700 1 -- 172.21.15.115:0/3141667033 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8065ff0 msgr2=0x7fceb8066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:40.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd99c700 1 --2- 172.21.15.115:0/3141667033 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8065ff0 0x7fceb8066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd99c700 1 -- 172.21.15.115:0/3141667033 >> v2:172.21.15.159:3300/0 conn(0x7fceb8151d70 msgr2=0x7fceb8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:40.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd99c700 1 --2- 172.21.15.115:0/3141667033 >> v2:172.21.15.159:3300/0 conn(0x7fceb8151d70 0x7fceb8155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd99c700 1 -- 172.21.15.115:0/3141667033 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80634d0 con 0x7fceb8066960 2023-07-27T14:40:40.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd19b700 1 --2- 172.21.15.115:0/3141667033 >> v2:172.21.15.159:3300/0 conn(0x7fceb8151d70 0x7fceb8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:40.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebc99a700 1 --2- 172.21.15.115:0/3141667033 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8065ff0 0x7fceb8066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:40.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fcebd99c700 1 --2- 172.21.15.115:0/3141667033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8066960 0x7fceb8157bf0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 rx=0x7fceb80c88b0 tx=0x7fceb0009840).ready entity=mon.0 client_cookie=b90db031ff214f76 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:40.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fceaffff700 1 -- 172.21.15.115:0/3141667033 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000e070 con 0x7fceb8066960 2023-07-27T14:40:40.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fceaffff700 1 -- 172.21.15.115:0/3141667033 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000ba50 con 0x7fceb8066960 2023-07-27T14:40:40.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.596+0000 7fceaffff700 1 -- 172.21.15.115:0/3141667033 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000bdd0 con 0x7fceb8066960 2023-07-27T14:40:40.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 -- 172.21.15.115:0/3141667033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8066960 msgr2=0x7fceb8157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/3141667033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8066960 0x7fceb8157bf0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 rx=0x7fceb80c88b0 tx=0x7fceb0009840).stop 2023-07-27T14:40:40.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 -- 172.21.15.115:0/3141667033 shutdown_connections 2023-07-27T14:40:40.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/3141667033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8066960 0x7fceb8157bf0 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/3141667033 >> v2:172.21.15.159:3300/0 conn(0x7fceb8151d70 0x7fceb8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/3141667033 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8065ff0 0x7fceb8066470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 -- 172.21.15.115:0/3141667033 >> 172.21.15.115:0/3141667033 conn(0x7fceb80c89a0 msgr2=0x7fceb80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:40.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 -- 172.21.15.115:0/3141667033 shutdown_connections 2023-07-27T14:40:40.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.597+0000 7fcebf3ff700 1 -- 172.21.15.115:0/3141667033 wait complete. 2023-07-27T14:40:40.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.599+0000 7fcebf3ff700 1 Processor -- start 2023-07-27T14:40:40.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.599+0000 7fcebf3ff700 1 -- start start 2023-07-27T14:40:40.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebf3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb8065ff0 0x7fceb80c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebf3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8066960 0x7fceb80c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebf3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8151d70 0x7fceb814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebf3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80bfed0 con 0x7fceb8151d70 2023-07-27T14:40:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebf3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80c01b0 con 0x7fceb8065ff0 2023-07-27T14:40:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebf3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80c0490 con 0x7fceb8066960 2023-07-27T14:40:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebd99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8151d70 0x7fceb814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebd99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8151d70 0x7fceb814b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56444/0 (socket says 172.21.15.115:56444) 2023-07-27T14:40:40.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebd99c700 1 -- 172.21.15.115:0/2980321922 learned_addr learned my addr 172.21.15.115:0/2980321922 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:40.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebd19b700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb8065ff0 0x7fceb80c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebc99a700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8066960 0x7fceb80c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebd99c700 1 -- 172.21.15.115:0/2980321922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8066960 msgr2=0x7fceb80c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebd99c700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8066960 0x7fceb80c21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebd99c700 1 -- 172.21.15.115:0/2980321922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb8065ff0 msgr2=0x7fceb80c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.600+0000 7fcebd99c700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb8065ff0 0x7fceb80c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.601+0000 7fcebd99c700 1 -- 172.21.15.115:0/2980321922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0009ae0 con 0x7fceb8151d70 2023-07-27T14:40:40.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.601+0000 7fcebd99c700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8151d70 0x7fceb814b3b0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 rx=0x7fceb0009fd0 tx=0x7fceb0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:40.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.601+0000 7fcead7fa700 1 -- 172.21.15.115:0/2980321922 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000bdd0 con 0x7fceb8151d70 2023-07-27T14:40:40.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.601+0000 7fcead7fa700 1 -- 172.21.15.115:0/2980321922 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb001d460 con 0x7fceb8151d70 2023-07-27T14:40:40.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.601+0000 7fcead7fa700 1 -- 172.21.15.115:0/2980321922 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb001d820 con 0x7fceb8151d70 2023-07-27T14:40:40.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.601+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb80c0770 con 0x7fceb8151d70 2023-07-27T14:40:40.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.601+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb80c1460 con 0x7fceb8151d70 2023-07-27T14:40:40.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.602+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb80c0c70 con 0x7fceb8151d70 2023-07-27T14:40:40.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.603+0000 7fcead7fa700 1 -- 172.21.15.115:0/2980321922 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fceb0024030 con 0x7fceb8151d70 2023-07-27T14:40:40.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.604+0000 7fcead7fa700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce9c05fe20 0x7fce9c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:40.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.604+0000 7fcead7fa700 1 -- 172.21.15.115:0/2980321922 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fceb007cc20 con 0x7fceb8151d70 2023-07-27T14:40:40.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.604+0000 7fcebd19b700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce9c05fe20 0x7fce9c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:40.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.605+0000 7fcebd19b700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce9c05fe20 0x7fce9c0622e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fceb80aea90 tx=0x7fceb4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:40.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.608+0000 7fcead7fa700 1 -- 172.21.15.115:0/2980321922 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fceb004d110 con 0x7fceb8151d70 2023-07-27T14:40:40.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.818+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fceb806c470 con 0x7fceb8151d70 2023-07-27T14:40:40.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.819+0000 7fcead7fa700 1 -- 172.21.15.115:0/2980321922 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4515 (secure 0 0 0) 0x7fceb0022070 con 0x7fceb8151d70 2023-07-27T14:40:40.876 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:40.876 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":113,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3608226418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3608226418},{"type":"v1","addr":"172.21.15.115:6837","nonce":3608226418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":9118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3601251920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3601251920},{"type":"v1","addr":"172.21.15.159:6835","nonce":3601251920}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":10386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3139755816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3139755816},{"type":"v1","addr":"172.21.15.115:6835","nonce":3139755816}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:40:00.408365+0000","modified":"2023-07-27T14:40:03.430962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10389":{"gid":10389,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/1326270023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1326270023},{"type":"v1","addr":"172.21.15.159:6834","nonce":1326270023}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-07-27T14:40:40.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce9c05fe20 msgr2=0x7fce9c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce9c05fe20 0x7fce9c0622e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fceb80aea90 tx=0x7fceb4008040).stop 2023-07-27T14:40:40.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8151d70 msgr2=0x7fceb814b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:40.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8151d70 0x7fceb814b3b0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 rx=0x7fceb0009fd0 tx=0x7fceb0009840).stop 2023-07-27T14:40:40.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 shutdown_connections 2023-07-27T14:40:40.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce9c05fe20 0x7fce9c0622e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceb8151d70 0x7fceb814b3b0 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb8065ff0 0x7fceb80c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 --2- 172.21.15.115:0/2980321922 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fceb8066960 0x7fceb80c21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 >> 172.21.15.115:0/2980321922 conn(0x7fceb80c89a0 msgr2=0x7fceb8067f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 shutdown_connections 2023-07-27T14:40:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:40.821+0000 7fcebf3ff700 1 -- 172.21.15.115:0/2980321922 wait complete. 2023-07-27T14:40:40.881 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 113 2023-07-27T14:40:40.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:40:41.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.045+0000 7f798edff700 1 Processor -- start 2023-07-27T14:40:41.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.046+0000 7f798edff700 1 -- start start 2023-07-27T14:40:41.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f798edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 0x7f79880a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f798edff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f79880aaa40 0x7f79880c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f798edff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79880aa4d0 con 0x7f79880aa050 2023-07-27T14:40:41.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f798edff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79880c05c0 con 0x7f79880aaa40 2023-07-27T14:40:41.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f798edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79880bfc90 con 0x7f7988153ec0 2023-07-27T14:40:41.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f7987fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f79880aa050 0x7f79880640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60992/0 (socket says 172.21.15.115:60992) 2023-07-27T14:40:41.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f7987fff700 1 -- 172.21.15.115:0/1470825885 learned_addr learned my addr 172.21.15.115:0/1470825885 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:41.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f798cb9b700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 0x7f79880a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f798d39c700 1 --2- 172.21.15.115:0/1470825885 >> v2:172.21.15.159:3300/0 conn(0x7f79880aaa40 0x7f79880c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.047+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853326192 0 0) 0x7f7974001110 con 0x7f79880aa050 2023-07-27T14:40:41.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79780033f0 con 0x7f79880aa050 2023-07-27T14:40:41.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2517917769 0 0) 0x7f79780033f0 con 0x7f79880aa050 2023-07-27T14:40:41.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 msgr2=0x7f79880a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 0x7f79880a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 >> v2:172.21.15.159:3300/0 conn(0x7f79880aaa40 msgr2=0x7f79880c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 --2- 172.21.15.115:0/1470825885 >> v2:172.21.15.159:3300/0 conn(0x7f79880aaa40 0x7f79880c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880bff70 con 0x7f79880aa050 2023-07-27T14:40:41.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f7974001600 con 0x7f79880aa050 2023-07-27T14:40:41.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 >> v1:172.21.15.115:6789/0 conn(0x7f79880aa050 legacy=0x7f79880640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79780038e0 0x7f7978003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7978004690 0x7f7978004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 0x7f7978005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c05c0 con 0x7f79780038e0 2023-07-27T14:40:41.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880bfc90 con 0x7f7978004690 2023-07-27T14:40:41.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797800b8e0 con 0x7f7988153ec0 2023-07-27T14:40:41.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f798cb9b700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79780038e0 0x7f7978003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f798d39c700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 0x7f7978005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.048+0000 7f7987fff700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7978004690 0x7f7978004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f798cb9b700 1 -- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 msgr2=0x7f7978005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f798cb9b700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 0x7f7978005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f798cb9b700 1 -- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7978004690 msgr2=0x7f7978004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f798cb9b700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7978004690 0x7f7978004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f798cb9b700 1 -- 172.21.15.115:0/1470825885 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780033f0 con 0x7f79780038e0 2023-07-27T14:40:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f7987fff700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7978004690 0x7f7978004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:41.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f798d39c700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7988153ec0 0x7f7978005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f798cb9b700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79780038e0 0x7f7978003d00 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 rx=0x7f797c009a80 tx=0x7f797c009060).ready entity=mon.0 client_cookie=9063759c21f132be server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c009430 con 0x7f79780038e0 2023-07-27T14:40:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c00e640 con 0x7f79780038e0 2023-07-27T14:40:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.049+0000 7f79877fe700 1 -- 172.21.15.115:0/1470825885 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c00e9c0 con 0x7f79780038e0 2023-07-27T14:40:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.050+0000 7f798edff700 1 -- 172.21.15.115:0/1470825885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79780038e0 msgr2=0x7f7978003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.050+0000 7f798edff700 1 --2- 172.21.15.115:0/1470825885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79780038e0 0x7f7978003d00 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 rx=0x7f797c009a80 tx=0x7f797c009060).stop 2023-07-27T14:40:41.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.050+0000 7f798d39c700 1 -- 172.21.15.115:0/1470825885 reap_dead start 2023-07-27T14:40:41.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.050+0000 7f798edff700 1 -- 172.21.15.115:0/1470825885 shutdown_connections 2023-07-27T14:40:41.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.050+0000 7f798edff700 1 -- 172.21.15.115:0/1470825885 >> 172.21.15.115:0/1470825885 conn(0x7f79880cb610 msgr2=0x7f79880c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:41.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.050+0000 7f798edff700 1 -- 172.21.15.115:0/1470825885 shutdown_connections 2023-07-27T14:40:41.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.050+0000 7f798edff700 1 -- 172.21.15.115:0/1470825885 wait complete. 2023-07-27T14:40:41.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.051+0000 7f798edff700 1 Processor -- start 2023-07-27T14:40:41.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.051+0000 7f798edff700 1 -- start start 2023-07-27T14:40:41.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.052+0000 7f798edff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79780038e0 0x7f79880c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.052+0000 7f798edff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880c25d0 0x7f7988153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.052+0000 7f798edff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798814c140 0x7f79880aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.052+0000 7f798edff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798814cff0 con 0x7f798814c140 2023-07-27T14:40:41.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.052+0000 7f798edff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c2a50 con 0x7f79880c25d0 2023-07-27T14:40:41.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.052+0000 7f798edff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c2140 con 0x7f79780038e0 2023-07-27T14:40:41.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.052+0000 7f798d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798814c140 0x7f79880aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.052+0000 7f798d39c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798814c140 0x7f79880aebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56452/0 (socket says 172.21.15.115:56452) 2023-07-27T14:40:41.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798d39c700 1 -- 172.21.15.115:0/1299913291 learned_addr learned my addr 172.21.15.115:0/1299913291 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f7987fff700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880c25d0 0x7f7988153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798cb9b700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79780038e0 0x7f79880c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798d39c700 1 -- 172.21.15.115:0/1299913291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79780038e0 msgr2=0x7f79880c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798d39c700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79780038e0 0x7f79880c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798d39c700 1 -- 172.21.15.115:0/1299913291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880c25d0 msgr2=0x7f7988153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798d39c700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880c25d0 0x7f7988153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798d39c700 1 -- 172.21.15.115:0/1299913291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988153710 con 0x7f798814c140 2023-07-27T14:40:41.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798d39c700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798814c140 0x7f79880aebe0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 rx=0x7f79880c5490 tx=0x7f798000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f7984ff9700 1 -- 172.21.15.115:0/1299913291 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798000e030 con 0x7f798814c140 2023-07-27T14:40:41.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f7984ff9700 1 -- 172.21.15.115:0/1299913291 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7980011b20 con 0x7f798814c140 2023-07-27T14:40:41.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f7984ff9700 1 -- 172.21.15.115:0/1299913291 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7980009b70 con 0x7f798814c140 2023-07-27T14:40:41.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798814ca30 con 0x7f798814c140 2023-07-27T14:40:41.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.053+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79880c1dd0 con 0x7f798814c140 2023-07-27T14:40:41.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.054+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79880c1c30 con 0x7f798814c140 2023-07-27T14:40:41.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.055+0000 7f7984ff9700 1 -- 172.21.15.115:0/1299913291 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f7980015600 con 0x7f798814c140 2023-07-27T14:40:41.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.056+0000 7f7984ff9700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f796c05fdf0 0x7f796c0622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.056+0000 7f7984ff9700 1 -- 172.21.15.115:0/1299913291 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f798000f070 con 0x7f798814c140 2023-07-27T14:40:41.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.056+0000 7f798cb9b700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f796c05fdf0 0x7f796c0622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.057+0000 7f798cb9b700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f796c05fdf0 0x7f796c0622b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f79880c3c50 tx=0x7f797c01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.060+0000 7f7984ff9700 1 -- 172.21.15.115:0/1299913291 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79880c1c30 con 0x7f798814c140 2023-07-27T14:40:41.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.231+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79880c1c30 con 0x7f798814c140 2023-07-27T14:40:41.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.232+0000 7f7984ff9700 1 -- 172.21.15.115:0/1299913291 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) v1 ==== 74+0+17242 (secure 0 0 0) 0x7f79880c1c30 con 0x7f798814c140 2023-07-27T14:40:41.289 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:41.289 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":206,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:40:40.841646+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:39:58.717120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-07-27T14:39:59.393690+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":206,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]},{"pool":29,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":29,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:40:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f796c05fdf0 msgr2=0x7f796c0622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f796c05fdf0 0x7f796c0622b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f79880c3c50 tx=0x7f797c01a000).stop 2023-07-27T14:40:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798814c140 msgr2=0x7f79880aebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798814c140 0x7f79880aebe0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 rx=0x7f79880c5490 tx=0x7f798000b040).stop 2023-07-27T14:40:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 shutdown_connections 2023-07-27T14:40:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f796c05fdf0 0x7f796c0622b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798814c140 0x7f79880aebe0 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f79780038e0 0x7f79880c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 --2- 172.21.15.115:0/1299913291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79880c25d0 0x7f7988153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 >> 172.21.15.115:0/1299913291 conn(0x7f79880cb610 msgr2=0x7f79880c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 shutdown_connections 2023-07-27T14:40:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.234+0000 7f798edff700 1 -- 172.21.15.115:0/1299913291 wait complete. 2023-07-27T14:40:41.308 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-27T14:40:41.308 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:40:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.440+0000 7f1ee09ff700 1 Processor -- start 2023-07-27T14:40:41.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.440+0000 7f1ee09ff700 1 -- start start 2023-07-27T14:40:41.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.441+0000 7f1ee09ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1edc151d70 0x7f1edc155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.441+0000 7f1ee09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc065ff0 0x7f1edc066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.441+0000 7f1ee09ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc067080 con 0x7f1edc066960 2023-07-27T14:40:41.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.441+0000 7f1ee09ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1edc063a90 con 0x7f1edc151d70 2023-07-27T14:40:41.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.441+0000 7f1ee09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc068570 con 0x7f1edc065ff0 2023-07-27T14:40:41.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1edad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1edc066960 0x7f1edc157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:32772/0 (socket says 172.21.15.115:32772) 2023-07-27T14:40:41.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1edad9d700 1 -- 172.21.15.115:0/3830213241 learned_addr learned my addr 172.21.15.115:0/3830213241 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:41.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed9d9b700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc065ff0 0x7f1edc066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1eda59c700 1 --2- 172.21.15.115:0/3830213241 >> v2:172.21.15.159:3300/0 conn(0x7f1edc151d70 0x7f1edc155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468046699 0 0) 0x7f1edc067080 con 0x7f1edc066960 2023-07-27T14:40:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec40033f0 con 0x7f1edc066960 2023-07-27T14:40:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4269411009 0 0) 0x7f1ec40033f0 con 0x7f1edc066960 2023-07-27T14:40:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc065ff0 msgr2=0x7f1edc066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc065ff0 0x7f1edc066470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 >> v2:172.21.15.159:3300/0 conn(0x7f1edc151d70 msgr2=0x7f1edc155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 --2- 172.21.15.115:0/3830213241 >> v2:172.21.15.159:3300/0 conn(0x7f1edc151d70 0x7f1edc155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc066df0 con 0x7f1edc066960 2023-07-27T14:40:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1ed40017f0 con 0x7f1edc066960 2023-07-27T14:40:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 >> v1:172.21.15.115:6789/0 conn(0x7f1edc066960 legacy=0x7f1edc157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.442+0000 7f1ed959a700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec40038e0 0x7f1ec4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1ed959a700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc065ff0 0x7f1ec4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1ed959a700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1ec4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc063a90 con 0x7f1ec4004b80 2023-07-27T14:40:41.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc068570 con 0x7f1ec40038e0 2023-07-27T14:40:41.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec400b8e0 con 0x7f1edc065ff0 2023-07-27T14:40:41.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1edad9d700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1ec4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1eda59c700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec40038e0 0x7f1ec4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1ed9d9b700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc065ff0 0x7f1ec4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1edad9d700 1 -- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc065ff0 msgr2=0x7f1ec4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1edad9d700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc065ff0 0x7f1ec4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1edad9d700 1 -- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec40038e0 msgr2=0x7f1ec4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1edad9d700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec40038e0 0x7f1ec4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1edad9d700 1 -- 172.21.15.115:0/3830213241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec40033f0 con 0x7f1ec4004b80 2023-07-27T14:40:41.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.443+0000 7f1edad9d700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1ec4005000 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 rx=0x7f1ed400c530 tx=0x7f1ed4002210).ready entity=mon.0 client_cookie=9670b3a92886115b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4007de0 con 0x7f1ec4004b80 2023-07-27T14:40:41.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed400ce60 con 0x7f1ec4004b80 2023-07-27T14:40:41.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ed959a700 1 -- 172.21.15.115:0/3830213241 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4005d50 con 0x7f1ec4004b80 2023-07-27T14:40:41.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ee09ff700 1 -- 172.21.15.115:0/3830213241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 msgr2=0x7f1ec4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ee09ff700 1 --2- 172.21.15.115:0/3830213241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1ec4005000 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 rx=0x7f1ed400c530 tx=0x7f1ed4002210).stop 2023-07-27T14:40:41.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1edad9d700 1 -- 172.21.15.115:0/3830213241 reap_dead start 2023-07-27T14:40:41.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ee09ff700 1 -- 172.21.15.115:0/3830213241 shutdown_connections 2023-07-27T14:40:41.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ee09ff700 1 -- 172.21.15.115:0/3830213241 >> 172.21.15.115:0/3830213241 conn(0x7f1edc0c89a0 msgr2=0x7f1edc0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:41.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ee09ff700 1 -- 172.21.15.115:0/3830213241 shutdown_connections 2023-07-27T14:40:41.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.444+0000 7f1ee09ff700 1 -- 172.21.15.115:0/3830213241 wait complete. 2023-07-27T14:40:41.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.446+0000 7f1ee09ff700 1 Processor -- start 2023-07-27T14:40:41.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.446+0000 7f1ee09ff700 1 -- start start 2023-07-27T14:40:41.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1ee09ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1edc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1ee09ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1edc0ae4c0 0x7f1edc0ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1ee09ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc0abe40 0x7f1edc0ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1ee09ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0a63b0 con 0x7f1ec4004b80 2023-07-27T14:40:41.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1ee09ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0ac7b0 con 0x7f1edc0ae4c0 2023-07-27T14:40:41.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1ee09ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0a57a0 con 0x7f1edc0abe40 2023-07-27T14:40:41.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1edc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1edc0a50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56472/0 (socket says 172.21.15.115:56472) 2023-07-27T14:40:41.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 -- 172.21.15.115:0/4191463516 learned_addr learned my addr 172.21.15.115:0/4191463516 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:41.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 -- 172.21.15.115:0/4191463516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc0abe40 msgr2=0x7f1edc0ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc0abe40 0x7f1edc0ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:41.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 -- 172.21.15.115:0/4191463516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1edc0ae4c0 msgr2=0x7f1edc0ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1edc0ae4c0 0x7f1edc0ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:41.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 -- 172.21.15.115:0/4191463516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc0a5a80 con 0x7f1ec4004b80 2023-07-27T14:40:41.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.448+0000 7f1eda59c700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1edc0a50e0 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 rx=0x7f1ecc0119f0 tx=0x7f1ecc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.449+0000 7f1eca7fc700 1 -- 172.21.15.115:0/4191463516 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00f8e0 con 0x7f1ec4004b80 2023-07-27T14:40:41.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.449+0000 7f1eca7fc700 1 -- 172.21.15.115:0/4191463516 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc00fa40 con 0x7f1ec4004b80 2023-07-27T14:40:41.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.449+0000 7f1eca7fc700 1 -- 172.21.15.115:0/4191463516 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00fdc0 con 0x7f1ec4004b80 2023-07-27T14:40:41.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.449+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc0a5d60 con 0x7f1ec4004b80 2023-07-27T14:40:41.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.449+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc0ae940 con 0x7f1ec4004b80 2023-07-27T14:40:41.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.450+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc0a6690 con 0x7f1ec4004b80 2023-07-27T14:40:41.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.451+0000 7f1eca7fc700 1 -- 172.21.15.115:0/4191463516 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f1ecc024070 con 0x7f1ec4004b80 2023-07-27T14:40:41.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.452+0000 7f1eca7fc700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ebc05fe20 0x7f1ebc0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.452+0000 7f1eca7fc700 1 -- 172.21.15.115:0/4191463516 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f1ecc07c090 con 0x7f1ec4004b80 2023-07-27T14:40:41.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.452+0000 7f1ed9d9b700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ebc05fe20 0x7f1ebc0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.452+0000 7f1ed9d9b700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ebc05fe20 0x7f1ebc0622e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f1ed0006d30 tx=0x7f1ed0009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.456+0000 7f1eca7fc700 1 -- 172.21.15.115:0/4191463516 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ecc04c440 con 0x7f1ec4004b80 2023-07-27T14:40:41.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.663+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1edc06c470 con 0x7f1ec4004b80 2023-07-27T14:40:41.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.664+0000 7f1eca7fc700 1 -- 172.21.15.115:0/4191463516 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4515 (secure 0 0 0) 0x7f1ecc04fa60 con 0x7f1ec4004b80 2023-07-27T14:40:41.721 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:41.721 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":113,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3608226418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3608226418},{"type":"v1","addr":"172.21.15.115:6837","nonce":3608226418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":9118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3601251920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3601251920},{"type":"v1","addr":"172.21.15.159:6835","nonce":3601251920}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":10386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3139755816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3139755816},{"type":"v1","addr":"172.21.15.115:6835","nonce":3139755816}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:40:00.408365+0000","modified":"2023-07-27T14:40:03.430962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10389":{"gid":10389,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/1326270023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1326270023},{"type":"v1","addr":"172.21.15.159:6834","nonce":1326270023}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-07-27T14:40:41.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ebc05fe20 msgr2=0x7f1ebc0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ebc05fe20 0x7f1ebc0622e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f1ed0006d30 tx=0x7f1ed0009060).stop 2023-07-27T14:40:41.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 msgr2=0x7f1edc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1edc0a50e0 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 rx=0x7f1ecc0119f0 tx=0x7f1ecc009060).stop 2023-07-27T14:40:41.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 shutdown_connections 2023-07-27T14:40:41.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1ebc05fe20 0x7f1ebc0622e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1edc0abe40 0x7f1edc0ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:41.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ec4004b80 0x7f1edc0a50e0 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 --2- 172.21.15.115:0/4191463516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1edc0ae4c0 0x7f1edc0ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:41.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 >> 172.21.15.115:0/4191463516 conn(0x7f1edc0c89a0 msgr2=0x7f1edc0c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:41.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 shutdown_connections 2023-07-27T14:40:41.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.666+0000 7f1ee09ff700 1 -- 172.21.15.115:0/4191463516 wait complete. 2023-07-27T14:40:41.725 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 113 2023-07-27T14:40:41.740 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:40:41.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.873+0000 7f4a229ff700 1 Processor -- start 2023-07-27T14:40:41.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.873+0000 7f4a229ff700 1 -- start start 2023-07-27T14:40:41.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.875+0000 7f4a229ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4a1c153ec0 0x7f4a1c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.875+0000 7f4a229ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aa050 0x7f4a1c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.875+0000 7f4a229ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c0aa4d0 con 0x7f4a1c0aaa40 2023-07-27T14:40:41.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.875+0000 7f4a229ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0c05c0 con 0x7f4a1c153ec0 2023-07-27T14:40:41.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.875+0000 7f4a229ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0c1a60 con 0x7f4a1c0aa050 2023-07-27T14:40:41.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.875+0000 7f4a1bfff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4a1c153ec0 0x7f4a1c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.875+0000 7f4a20f9c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f4a1c0aaa40 0x7f4a1c157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:46548/0 (socket says 172.21.15.115:46548) 2023-07-27T14:40:41.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a20f9c700 1 -- 172.21.15.115:0/2391855428 learned_addr learned my addr 172.21.15.115:0/2391855428 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:41.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1b7fe700 1 --2- 172.21.15.115:0/2391855428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aa050 0x7f4a1c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1affd700 1 -- 172.21.15.115:0/2391855428 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513055657 0 0) 0x7f4a14001490 con 0x7f4a1c0aaa40 2023-07-27T14:40:41.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1affd700 1 -- 172.21.15.115:0/2391855428 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a040033f0 con 0x7f4a1c0aaa40 2023-07-27T14:40:41.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1b7fe700 1 -- 172.21.15.115:0/2391855428 >> v2:172.21.15.159:3300/0 conn(0x7f4a1c153ec0 msgr2=0x7f4a1c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:41.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1b7fe700 1 --2- 172.21.15.115:0/2391855428 >> v2:172.21.15.159:3300/0 conn(0x7f4a1c153ec0 0x7f4a1c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1b7fe700 1 -- 172.21.15.115:0/2391855428 >> v1:172.21.15.159:6789/0 conn(0x7f4a1c0aaa40 legacy=0x7f4a1c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1b7fe700 1 -- 172.21.15.115:0/2391855428 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0bfc90 con 0x7f4a1c0aa050 2023-07-27T14:40:41.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1bfff700 1 --2- 172.21.15.115:0/2391855428 >> v2:172.21.15.159:3300/0 conn(0x7f4a1c153ec0 0x7f4a1c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:41.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.876+0000 7f4a1b7fe700 1 --2- 172.21.15.115:0/2391855428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aa050 0x7f4a1c0640f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f4a10009760 tx=0x7f4a10009060).ready entity=mon.2 client_cookie=2a73831b617ba74b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a1affd700 1 -- 172.21.15.115:0/2391855428 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000d4a0 con 0x7f4a1c0aa050 2023-07-27T14:40:41.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a1affd700 1 -- 172.21.15.115:0/2391855428 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000d600 con 0x7f4a1c0aa050 2023-07-27T14:40:41.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a1affd700 1 -- 172.21.15.115:0/2391855428 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000d980 con 0x7f4a1c0aa050 2023-07-27T14:40:41.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a229ff700 1 -- 172.21.15.115:0/2391855428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aa050 msgr2=0x7f4a1c0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a229ff700 1 --2- 172.21.15.115:0/2391855428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aa050 0x7f4a1c0640f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f4a10009760 tx=0x7f4a10009060).stop 2023-07-27T14:40:41.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a229ff700 1 -- 172.21.15.115:0/2391855428 shutdown_connections 2023-07-27T14:40:41.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a229ff700 1 --2- 172.21.15.115:0/2391855428 >> v2:172.21.15.159:3300/0 conn(0x7f4a1c153ec0 0x7f4a1c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a229ff700 1 --2- 172.21.15.115:0/2391855428 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aa050 0x7f4a1c0640f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a229ff700 1 -- 172.21.15.115:0/2391855428 >> 172.21.15.115:0/2391855428 conn(0x7f4a1c0cb610 msgr2=0x7f4a1c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:41.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a229ff700 1 -- 172.21.15.115:0/2391855428 shutdown_connections 2023-07-27T14:40:41.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.877+0000 7f4a229ff700 1 -- 172.21.15.115:0/2391855428 wait complete. 2023-07-27T14:40:41.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.879+0000 7f4a229ff700 1 Processor -- start 2023-07-27T14:40:41.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.879+0000 7f4a229ff700 1 -- start start 2023-07-27T14:40:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a229ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a1c0aa050 0x7f4a1c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a229ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aaa40 0x7f4a1c150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a229ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a1c153ec0 0x7f4a1c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a229ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c13b510 con 0x7f4a1c0aa050 2023-07-27T14:40:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a229ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c151f50 con 0x7f4a1c153ec0 2023-07-27T14:40:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a229ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c14f270 con 0x7f4a1c0aaa40 2023-07-27T14:40:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a1c0aa050 0x7f4a1c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a1c0aa050 0x7f4a1c1542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56480/0 (socket says 172.21.15.115:56480) 2023-07-27T14:40:41.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1bfff700 1 -- 172.21.15.115:0/1094489970 learned_addr learned my addr 172.21.15.115:0/1094489970 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:41.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a20f9c700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a1c153ec0 0x7f4a1c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1b7fe700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aaa40 0x7f4a1c150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1bfff700 1 -- 172.21.15.115:0/1094489970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aaa40 msgr2=0x7f4a1c150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1bfff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aaa40 0x7f4a1c150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1bfff700 1 -- 172.21.15.115:0/1094489970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a1c153ec0 msgr2=0x7f4a1c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:41.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1bfff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a1c153ec0 0x7f4a1c13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:41.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.880+0000 7f4a1bfff700 1 -- 172.21.15.115:0/1094489970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c0092a0 con 0x7f4a1c0aa050 2023-07-27T14:40:41.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.881+0000 7f4a1bfff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a1c0aa050 0x7f4a1c1542a0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 rx=0x7f4a0c00e980 tx=0x7f4a0c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.881+0000 7f4a03fff700 1 -- 172.21.15.115:0/1094489970 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00c850 con 0x7f4a1c0aa050 2023-07-27T14:40:41.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.881+0000 7f4a03fff700 1 -- 172.21.15.115:0/1094489970 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00c9b0 con 0x7f4a1c0aa050 2023-07-27T14:40:41.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.881+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a100092a0 con 0x7f4a1c0aa050 2023-07-27T14:40:41.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.881+0000 7f4a03fff700 1 -- 172.21.15.115:0/1094489970 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00cd30 con 0x7f4a1c0aa050 2023-07-27T14:40:41.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.881+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c151900 con 0x7f4a1c0aa050 2023-07-27T14:40:41.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.882+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c06c470 con 0x7f4a1c0aa050 2023-07-27T14:40:41.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.883+0000 7f4a03fff700 1 -- 172.21.15.115:0/1094489970 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f4a0c022070 con 0x7f4a1c0aa050 2023-07-27T14:40:41.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.883+0000 7f4a03fff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805fdf0 0x7f4a080622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:41.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.884+0000 7f4a03fff700 1 -- 172.21.15.115:0/1094489970 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f4a0c07b9c0 con 0x7f4a1c0aa050 2023-07-27T14:40:41.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.884+0000 7f4a1b7fe700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805fdf0 0x7f4a080622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:41.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.884+0000 7f4a1b7fe700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805fdf0 0x7f4a080622b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f4a1c0c4c30 tx=0x7f4a10016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:41.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:41.888+0000 7f4a03fff700 1 -- 172.21.15.115:0/1094489970 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a0c04be80 con 0x7f4a1c0aa050 2023-07-27T14:40:42.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.114+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a1c0c4c60 con 0x7f4a1c0aa050 2023-07-27T14:40:42.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.115+0000 7f4a03fff700 1 -- 172.21.15.115:0/1094489970 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4515 (secure 0 0 0) 0x7f4a0c04f4a0 con 0x7f4a1c0aa050 2023-07-27T14:40:42.172 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:42.172 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":113,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3608226418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3608226418},{"type":"v1","addr":"172.21.15.115:6837","nonce":3608226418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":9118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3601251920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3601251920},{"type":"v1","addr":"172.21.15.159:6835","nonce":3601251920}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":10386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3139755816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3139755816},{"type":"v1","addr":"172.21.15.115:6835","nonce":3139755816}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:40:00.408365+0000","modified":"2023-07-27T14:40:03.430962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10389":{"gid":10389,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/1326270023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1326270023},{"type":"v1","addr":"172.21.15.159:6834","nonce":1326270023}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-07-27T14:40:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.117+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805fdf0 msgr2=0x7f4a080622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.117+0000 7f4a229ff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805fdf0 0x7f4a080622b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f4a1c0c4c30 tx=0x7f4a10016000).stop 2023-07-27T14:40:42.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.117+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a1c0aa050 msgr2=0x7f4a1c1542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.117+0000 7f4a229ff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a1c0aa050 0x7f4a1c1542a0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 rx=0x7f4a0c00e980 tx=0x7f4a0c009060).stop 2023-07-27T14:40:42.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.118+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 shutdown_connections 2023-07-27T14:40:42.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.118+0000 7f4a229ff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4a0805fdf0 0x7f4a080622b0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.118+0000 7f4a229ff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a1c153ec0 0x7f4a1c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.118+0000 7f4a229ff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a1c0aa050 0x7f4a1c1542a0 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.118+0000 7f4a229ff700 1 --2- 172.21.15.115:0/1094489970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4a1c0aaa40 0x7f4a1c150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.118+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 >> 172.21.15.115:0/1094489970 conn(0x7f4a1c0cb610 msgr2=0x7f4a1c0ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:42.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.118+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 shutdown_connections 2023-07-27T14:40:42.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.118+0000 7f4a229ff700 1 -- 172.21.15.115:0/1094489970 wait complete. 2023-07-27T14:40:42.179 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 113 2023-07-27T14:40:42.197 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:40:42.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.327+0000 7fe8a9dff700 1 Processor -- start 2023-07-27T14:40:42.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.327+0000 7fe8a9dff700 1 -- start start 2023-07-27T14:40:42.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a9dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe8a40aaa40 0x7fe8a40640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a9dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40aa4d0 con 0x7fe8a41542a0 2023-07-27T14:40:42.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a9dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40c05c0 con 0x7fe8a4153ec0 2023-07-27T14:40:42.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a9dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40aa270 con 0x7fe8a40aaa40 2023-07-27T14:40:42.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a3fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe8a41542a0 0x7fe8a40c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:32780/0 (socket says 172.21.15.115:32780) 2023-07-27T14:40:42.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a3fff700 1 -- 172.21.15.115:0/915182770 learned_addr learned my addr 172.21.15.115:0/915182770 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:42.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a2ffd700 1 --2- 172.21.15.115:0/915182770 >> v2:172.21.15.159:3300/0 conn(0x7fe8a40aaa40 0x7fe8a40640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a27fc700 1 -- 172.21.15.115:0/915182770 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543006028 0 0) 0x7fe89c001490 con 0x7fe8a41542a0 2023-07-27T14:40:42.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a27fc700 1 -- 172.21.15.115:0/915182770 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe88c0033f0 con 0x7fe8a41542a0 2023-07-27T14:40:42.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a27fc700 1 -- 172.21.15.115:0/915182770 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956241476 0 0) 0x7fe8a40c05c0 con 0x7fe8a4153ec0 2023-07-27T14:40:42.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.329+0000 7fe8a27fc700 1 -- 172.21.15.115:0/915182770 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe89c001490 con 0x7fe8a4153ec0 2023-07-27T14:40:42.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a2ffd700 1 -- 172.21.15.115:0/915182770 >> v1:172.21.15.159:6789/0 conn(0x7fe8a4153ec0 legacy=0x7fe8a40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a2ffd700 1 -- 172.21.15.115:0/915182770 >> v1:172.21.15.115:6789/0 conn(0x7fe8a41542a0 legacy=0x7fe8a40c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a2ffd700 1 -- 172.21.15.115:0/915182770 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40bfc90 con 0x7fe8a40aaa40 2023-07-27T14:40:42.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a2ffd700 1 --2- 172.21.15.115:0/915182770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a40aaa40 0x7fe8a40640f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fe898009760 tx=0x7fe898009060).ready entity=mon.1 client_cookie=32294dd222c3ab74 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:42.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a27fc700 1 -- 172.21.15.115:0/915182770 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800d4a0 con 0x7fe8a40aaa40 2023-07-27T14:40:42.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a27fc700 1 -- 172.21.15.115:0/915182770 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89800d600 con 0x7fe8a40aaa40 2023-07-27T14:40:42.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a27fc700 1 -- 172.21.15.115:0/915182770 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800d980 con 0x7fe8a40aaa40 2023-07-27T14:40:42.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a9dff700 1 -- 172.21.15.115:0/915182770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a40aaa40 msgr2=0x7fe8a40640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.330+0000 7fe8a9dff700 1 --2- 172.21.15.115:0/915182770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a40aaa40 0x7fe8a40640f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fe898009760 tx=0x7fe898009060).stop 2023-07-27T14:40:42.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.331+0000 7fe8a9dff700 1 -- 172.21.15.115:0/915182770 shutdown_connections 2023-07-27T14:40:42.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.331+0000 7fe8a9dff700 1 --2- 172.21.15.115:0/915182770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a40aaa40 0x7fe8a40640f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.331+0000 7fe8a9dff700 1 -- 172.21.15.115:0/915182770 >> 172.21.15.115:0/915182770 conn(0x7fe8a40cb610 msgr2=0x7fe8a40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:42.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.331+0000 7fe8a9dff700 1 -- 172.21.15.115:0/915182770 shutdown_connections 2023-07-27T14:40:42.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.331+0000 7fe8a9dff700 1 -- 172.21.15.115:0/915182770 wait complete. 2023-07-27T14:40:42.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.332+0000 7fe8a9dff700 1 Processor -- start 2023-07-27T14:40:42.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.332+0000 7fe8a9dff700 1 -- start start 2023-07-27T14:40:42.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a9dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a40aaa40 0x7fe8a41673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a9dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8a4153ec0 0x7fe8a40c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a9dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a41542a0 0x7fe8a40c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a9dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40c4cb0 con 0x7fe8a40aaa40 2023-07-27T14:40:42.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a9dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40c40a0 con 0x7fe8a41542a0 2023-07-27T14:40:42.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a9dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40c4380 con 0x7fe8a4153ec0 2023-07-27T14:40:42.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a40aaa40 0x7fe8a41673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a40aaa40 0x7fe8a41673c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56496/0 (socket says 172.21.15.115:56496) 2023-07-27T14:40:42.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.333+0000 7fe8a37fe700 1 -- 172.21.15.115:0/4231238152 learned_addr learned my addr 172.21.15.115:0/4231238152 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:42.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a2ffd700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8a4153ec0 0x7fe8a40c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a3fff700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a41542a0 0x7fe8a40c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a37fe700 1 -- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8a4153ec0 msgr2=0x7fe8a40c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a37fe700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8a4153ec0 0x7fe8a40c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a37fe700 1 -- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a41542a0 msgr2=0x7fe8a40c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a37fe700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a41542a0 0x7fe8a40c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a37fe700 1 -- 172.21.15.115:0/4231238152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8980092a0 con 0x7fe8a40aaa40 2023-07-27T14:40:42.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a3fff700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a41542a0 0x7fe8a40c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:42.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a37fe700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a40aaa40 0x7fe8a41673c0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 rx=0x7fe89400c490 tx=0x7fe894007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:42.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe88b7fe700 1 -- 172.21.15.115:0/4231238152 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400f470 con 0x7fe8a40aaa40 2023-07-27T14:40:42.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe88b7fe700 1 -- 172.21.15.115:0/4231238152 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400f5d0 con 0x7fe8a40aaa40 2023-07-27T14:40:42.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe88b7fe700 1 -- 172.21.15.115:0/4231238152 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400f970 con 0x7fe8a40aaa40 2023-07-27T14:40:42.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a40c4660 con 0x7fe8a40aaa40 2023-07-27T14:40:42.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.334+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a41678b0 con 0x7fe8a40aaa40 2023-07-27T14:40:42.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.335+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a406c470 con 0x7fe8a40aaa40 2023-07-27T14:40:42.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.336+0000 7fe88b7fe700 1 -- 172.21.15.115:0/4231238152 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fe894019030 con 0x7fe8a40aaa40 2023-07-27T14:40:42.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.337+0000 7fe88b7fe700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe89005fe20 0x7fe8900622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.337+0000 7fe88b7fe700 1 -- 172.21.15.115:0/4231238152 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fe89407aaa0 con 0x7fe8a40aaa40 2023-07-27T14:40:42.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.337+0000 7fe8a2ffd700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe89005fe20 0x7fe8900622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.338+0000 7fe8a2ffd700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe89005fe20 0x7fe8900622e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7fe8a40aae20 tx=0x7fe898016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:42.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.341+0000 7fe88b7fe700 1 -- 172.21.15.115:0/4231238152 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe89404af60 con 0x7fe8a40aaa40 2023-07-27T14:40:42.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.510+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8a40bff70 con 0x7fe8a40aaa40 2023-07-27T14:40:42.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.511+0000 7fe88b7fe700 1 -- 172.21.15.115:0/4231238152 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) v1 ==== 74+0+17242 (secure 0 0 0) 0x7fe89404e580 con 0x7fe8a40aaa40 2023-07-27T14:40:42.568 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:42.568 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":206,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:40:40.841646+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:39:58.717120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-07-27T14:39:59.393690+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":206,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]},{"pool":29,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":29,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:40:42.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe89005fe20 msgr2=0x7fe8900622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe89005fe20 0x7fe8900622e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7fe8a40aae20 tx=0x7fe898016000).stop 2023-07-27T14:40:42.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a40aaa40 msgr2=0x7fe8a41673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a40aaa40 0x7fe8a41673c0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 rx=0x7fe89400c490 tx=0x7fe894007c90).stop 2023-07-27T14:40:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 shutdown_connections 2023-07-27T14:40:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe89005fe20 0x7fe8900622e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8a41542a0 0x7fe8a40c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a40aaa40 0x7fe8a41673c0 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 --2- 172.21.15.115:0/4231238152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe8a4153ec0 0x7fe8a40c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 >> 172.21.15.115:0/4231238152 conn(0x7fe8a40cb610 msgr2=0x7fe8a40afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:42.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 shutdown_connections 2023-07-27T14:40:42.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.513+0000 7fe8a9dff700 1 -- 172.21.15.115:0/4231238152 wait complete. 2023-07-27T14:40:42.587 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-27T14:40:42.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.718+0000 7f69935ff700 1 Processor -- start 2023-07-27T14:40:42.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.719+0000 7f69935ff700 1 -- start start 2023-07-27T14:40:42.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.720+0000 7f69935ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f698c0c0e80 0x7f698c150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.720+0000 7f69935ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c06a440 con 0x7f698c0a5e40 2023-07-27T14:40:42.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.720+0000 7f69935ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c0bbc80 con 0x7f698c150af0 2023-07-27T14:40:42.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.720+0000 7f69935ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c069e80 con 0x7f698c0c0e80 2023-07-27T14:40:42.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.720+0000 7f6991b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f698c0a5e40 0x7f698c0bc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:32788/0 (socket says 172.21.15.115:32788) 2023-07-27T14:40:42.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.720+0000 7f6991b9c700 1 -- 172.21.15.115:0/2527480089 learned_addr learned my addr 172.21.15.115:0/2527480089 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:42.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.720+0000 7f6990b9a700 1 --2- 172.21.15.115:0/2527480089 >> v2:172.21.15.159:3300/0 conn(0x7f698c0c0e80 0x7f698c150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6983fff700 1 -- 172.21.15.115:0/2527480089 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617252550 0 0) 0x7f698c06a440 con 0x7f698c0a5e40 2023-07-27T14:40:42.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6983fff700 1 -- 172.21.15.115:0/2527480089 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69780033f0 con 0x7f698c0a5e40 2023-07-27T14:40:42.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6983fff700 1 -- 172.21.15.115:0/2527480089 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31495441 0 0) 0x7f698c0bbc80 con 0x7f698c150af0 2023-07-27T14:40:42.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6983fff700 1 -- 172.21.15.115:0/2527480089 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f698c06a440 con 0x7f698c150af0 2023-07-27T14:40:42.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6990b9a700 1 -- 172.21.15.115:0/2527480089 >> v1:172.21.15.159:6789/0 conn(0x7f698c150af0 legacy=0x7f698c0a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6990b9a700 1 -- 172.21.15.115:0/2527480089 >> v1:172.21.15.115:6789/0 conn(0x7f698c0a5e40 legacy=0x7f698c0bc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6990b9a700 1 -- 172.21.15.115:0/2527480089 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c06a160 con 0x7f698c0c0e80 2023-07-27T14:40:42.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6990b9a700 1 --2- 172.21.15.115:0/2527480089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c0c0e80 0x7f698c150ed0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f697c009760 tx=0x7f697c009060).ready entity=mon.1 client_cookie=5d3c949e7391778d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:42.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6983fff700 1 -- 172.21.15.115:0/2527480089 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00d4a0 con 0x7f698c0c0e80 2023-07-27T14:40:42.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6983fff700 1 -- 172.21.15.115:0/2527480089 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c00d600 con 0x7f698c0c0e80 2023-07-27T14:40:42.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.721+0000 7f6983fff700 1 -- 172.21.15.115:0/2527480089 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00d980 con 0x7f698c0c0e80 2023-07-27T14:40:42.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.722+0000 7f69935ff700 1 -- 172.21.15.115:0/2527480089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c0c0e80 msgr2=0x7f698c150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.722+0000 7f69935ff700 1 --2- 172.21.15.115:0/2527480089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c0c0e80 0x7f698c150ed0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f697c009760 tx=0x7f697c009060).stop 2023-07-27T14:40:42.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.722+0000 7f69935ff700 1 -- 172.21.15.115:0/2527480089 shutdown_connections 2023-07-27T14:40:42.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.722+0000 7f69935ff700 1 --2- 172.21.15.115:0/2527480089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c0c0e80 0x7f698c150ed0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.722+0000 7f69935ff700 1 -- 172.21.15.115:0/2527480089 >> 172.21.15.115:0/2527480089 conn(0x7f698c062320 msgr2=0x7f698c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:42.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.722+0000 7f69935ff700 1 -- 172.21.15.115:0/2527480089 shutdown_connections 2023-07-27T14:40:42.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.722+0000 7f69935ff700 1 -- 172.21.15.115:0/2527480089 wait complete. 2023-07-27T14:40:42.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.723+0000 7f69935ff700 1 Processor -- start 2023-07-27T14:40:42.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.724+0000 7f69935ff700 1 -- start start 2023-07-27T14:40:42.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.724+0000 7f69935ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698c0a5e40 0x7f698c168c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f69935ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698c0c0e80 0x7f698c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f69935ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c150af0 0x7f698c0ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f69935ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1687b0 con 0x7f698c0a5e40 2023-07-27T14:40:42.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f69935ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1681a0 con 0x7f698c150af0 2023-07-27T14:40:42.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f69935ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0aa590 con 0x7f698c0c0e80 2023-07-27T14:40:42.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698c0a5e40 0x7f698c168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698c0a5e40 0x7f698c168c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56512/0 (socket says 172.21.15.115:56512) 2023-07-27T14:40:42.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 -- 172.21.15.115:0/1505684542 learned_addr learned my addr 172.21.15.115:0/1505684542 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:42.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 -- 172.21.15.115:0/1505684542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698c0c0e80 msgr2=0x7f698c0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698c0c0e80 0x7f698c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:42.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 -- 172.21.15.115:0/1505684542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c150af0 msgr2=0x7f698c0ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:42.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f6991b9c700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c150af0 0x7f698c0ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c150af0 0x7f698c0ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:42.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 -- 172.21.15.115:0/1505684542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0092a0 con 0x7f698c0a5e40 2023-07-27T14:40:42.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f6991b9c700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c150af0 0x7f698c0ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:42.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.725+0000 7f699139b700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698c0a5e40 0x7f698c168c40 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 rx=0x7f698800c440 tx=0x7f6988007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:42.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.726+0000 7f69817fa700 1 -- 172.21.15.115:0/1505684542 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800f470 con 0x7f698c0a5e40 2023-07-27T14:40:42.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.726+0000 7f69817fa700 1 -- 172.21.15.115:0/1505684542 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800f5d0 con 0x7f698c0a5e40 2023-07-27T14:40:42.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.726+0000 7f69817fa700 1 -- 172.21.15.115:0/1505684542 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800f990 con 0x7f698c0a5e40 2023-07-27T14:40:42.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.726+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c0aa870 con 0x7f698c0a5e40 2023-07-27T14:40:42.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.726+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c0a7320 con 0x7f698c0a5e40 2023-07-27T14:40:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.727+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c06c470 con 0x7f698c0a5e40 2023-07-27T14:40:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.728+0000 7f69817fa700 1 -- 172.21.15.115:0/1505684542 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f6988019030 con 0x7f698c0a5e40 2023-07-27T14:40:42.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.729+0000 7f69817fa700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f697005fe20 0x7f69700622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:42.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.729+0000 7f69817fa700 1 -- 172.21.15.115:0/1505684542 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f698807aa30 con 0x7f698c0a5e40 2023-07-27T14:40:42.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.729+0000 7f6990b9a700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f697005fe20 0x7f69700622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:42.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.729+0000 7f6990b9a700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f697005fe20 0x7f69700622e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f698c0c1260 tx=0x7f697c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:42.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.732+0000 7f69817fa700 1 -- 172.21.15.115:0/1505684542 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f698804aef0 con 0x7f698c0a5e40 2023-07-27T14:40:43.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:42.944+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f698c0bb910 con 0x7f698c0a5e40 2023-07-27T14:40:43.911 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-07-27T14:40:43.854+0000 7f407ddf7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-27T14:40:43.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.862+0000 7f69817fa700 1 -- 172.21.15.115:0/1505684542 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v114) v1 ==== 161+0+0 (secure 0 0 0) 0x7f698804e510 con 0x7f698c0a5e40 2023-07-27T14:40:43.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.864+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f697005fe20 msgr2=0x7f69700622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:43.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.864+0000 7f69935ff700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f697005fe20 0x7f69700622e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f698c0c1260 tx=0x7f697c016000).stop 2023-07-27T14:40:43.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698c0a5e40 msgr2=0x7f698c168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:43.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698c0a5e40 0x7f698c168c40 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 rx=0x7f698800c440 tx=0x7f6988007c90).stop 2023-07-27T14:40:43.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 shutdown_connections 2023-07-27T14:40:43.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f697005fe20 0x7f69700622e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:43.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f698c150af0 0x7f698c0ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:43.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698c0a5e40 0x7f698c168c40 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:43.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 --2- 172.21.15.115:0/1505684542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f698c0c0e80 0x7f698c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:43.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 >> 172.21.15.115:0/1505684542 conn(0x7f698c062320 msgr2=0x7f698c0c3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:43.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 shutdown_connections 2023-07-27T14:40:43.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:43.865+0000 7f69935ff700 1 -- 172.21.15.115:0/1505684542 wait complete. 2023-07-27T14:40:43.924 INFO:teuthology.orchestra.run.smithi115.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-27T14:40:43.943 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-27T14:40:43.983 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:40:44.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.080+0000 7f6cd41ff700 1 Processor -- start 2023-07-27T14:40:44.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.080+0000 7f6cd41ff700 1 -- start start 2023-07-27T14:40:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.081+0000 7f6cd41ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ccc063260 0x7f6ccc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.081+0000 7f6cd41ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc14b1e0 0x7f6ccc0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.081+0000 7f6cd41ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc1553f0 con 0x7f6ccc14ae00 2023-07-27T14:40:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.081+0000 7f6cd41ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc157a50 con 0x7f6ccc063260 2023-07-27T14:40:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.081+0000 7f6cd41ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc157d10 con 0x7f6ccc14b1e0 2023-07-27T14:40:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.081+0000 7f6cd179a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ccc063260 0x7f6ccc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd179a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ccc063260 0x7f6ccc154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32826/0 (socket says 172.21.15.115:32826) 2023-07-27T14:40:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd179a700 1 -- 172.21.15.115:0/235190284 learned_addr learned my addr 172.21.15.115:0/235190284 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd279c700 1 --2- 172.21.15.115:0/235190284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc14b1e0 0x7f6ccc0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd179a700 1 -- 172.21.15.115:0/235190284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc14b1e0 msgr2=0x7f6ccc0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd179a700 1 --2- 172.21.15.115:0/235190284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc14b1e0 0x7f6ccc0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd179a700 1 -- 172.21.15.115:0/235190284 >> v1:172.21.15.159:6789/0 conn(0x7f6ccc14ae00 legacy=0x7f6ccc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd179a700 1 -- 172.21.15.115:0/235190284 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc157ff0 con 0x7f6ccc063260 2023-07-27T14:40:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd279c700 1 --2- 172.21.15.115:0/235190284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc14b1e0 0x7f6ccc0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:44.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd179a700 1 --2- 172.21.15.115:0/235190284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc063260 0x7f6ccc154f00 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 rx=0x7f6cbc006fd0 tx=0x7f6cbc0090f0).ready entity=mon.0 client_cookie=870256f5392e964 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd0f99700 1 -- 172.21.15.115:0/235190284 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00b600 con 0x7f6ccc063260 2023-07-27T14:40:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd0f99700 1 -- 172.21.15.115:0/235190284 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc00b760 con 0x7f6ccc063260 2023-07-27T14:40:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.082+0000 7f6cd0f99700 1 -- 172.21.15.115:0/235190284 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00bae0 con 0x7f6ccc063260 2023-07-27T14:40:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.083+0000 7f6cd41ff700 1 -- 172.21.15.115:0/235190284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc063260 msgr2=0x7f6ccc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.083+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/235190284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc063260 0x7f6ccc154f00 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 rx=0x7f6cbc006fd0 tx=0x7f6cbc0090f0).stop 2023-07-27T14:40:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.083+0000 7f6cd41ff700 1 -- 172.21.15.115:0/235190284 shutdown_connections 2023-07-27T14:40:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.083+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/235190284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc14b1e0 0x7f6ccc0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.083+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/235190284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc063260 0x7f6ccc154f00 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.083+0000 7f6cd41ff700 1 -- 172.21.15.115:0/235190284 >> 172.21.15.115:0/235190284 conn(0x7f6ccc05e940 msgr2=0x7f6ccc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.083+0000 7f6cd41ff700 1 -- 172.21.15.115:0/235190284 shutdown_connections 2023-07-27T14:40:44.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.083+0000 7f6cd41ff700 1 -- 172.21.15.115:0/235190284 wait complete. 2023-07-27T14:40:44.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.084+0000 7f6cd41ff700 1 Processor -- start 2023-07-27T14:40:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.085+0000 7f6cd41ff700 1 -- start start 2023-07-27T14:40:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.085+0000 7f6cd41ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc063260 0x7f6ccc164030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd41ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc14ae00 0x7f6ccc1651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd41ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc14b1e0 0x7f6ccc0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd41ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0c41c0 con 0x7f6ccc14ae00 2023-07-27T14:40:44.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd41ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0aef40 con 0x7f6ccc14b1e0 2023-07-27T14:40:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd41ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0aea20 con 0x7f6ccc063260 2023-07-27T14:40:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc14ae00 0x7f6ccc1651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc14ae00 0x7f6ccc1651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32828/0 (socket says 172.21.15.115:32828) 2023-07-27T14:40:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 -- 172.21.15.115:0/3785816423 learned_addr learned my addr 172.21.15.115:0/3785816423 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd279c700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc14b1e0 0x7f6ccc0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd1f9b700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc063260 0x7f6ccc164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:44.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 -- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc063260 msgr2=0x7f6ccc164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc063260 0x7f6ccc164030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 -- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc14b1e0 msgr2=0x7f6ccc0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc14b1e0 0x7f6ccc0ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 -- 172.21.15.115:0/3785816423 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc009370 con 0x7f6ccc14ae00 2023-07-27T14:40:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd1f9b700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc063260 0x7f6ccc164030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:44.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.086+0000 7f6cd179a700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc14ae00 0x7f6ccc1651e0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 rx=0x7f6ccc0c53b0 tx=0x7f6cbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.087+0000 7f6cc1ffb700 1 -- 172.21.15.115:0/3785816423 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00bae0 con 0x7f6ccc14ae00 2023-07-27T14:40:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.087+0000 7f6cc1ffb700 1 -- 172.21.15.115:0/3785816423 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc000c90 con 0x7f6ccc14ae00 2023-07-27T14:40:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.087+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc1645f0 con 0x7f6ccc14ae00 2023-07-27T14:40:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.087+0000 7f6cc1ffb700 1 -- 172.21.15.115:0/3785816423 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc01b660 con 0x7f6ccc14ae00 2023-07-27T14:40:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.087+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc164bb0 con 0x7f6ccc14ae00 2023-07-27T14:40:44.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.088+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc06c470 con 0x7f6ccc14ae00 2023-07-27T14:40:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.089+0000 7f6cc1ffb700 1 -- 172.21.15.115:0/3785816423 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f6cbc00f070 con 0x7f6ccc14ae00 2023-07-27T14:40:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.089+0000 7f6cc1ffb700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6cb005fe20 0x7f6cb00622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:44.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.089+0000 7f6cc1ffb700 1 -- 172.21.15.115:0/3785816423 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6263+0+0 (secure 0 0 0) 0x7f6cbc07caa0 con 0x7f6ccc14ae00 2023-07-27T14:40:44.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.090+0000 7f6cd1f9b700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6cb005fe20 0x7f6cb00622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:44.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.090+0000 7f6cd1f9b700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6cb005fe20 0x7f6cb00622e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f6cc8002780 tx=0x7f6cc8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:44.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.093+0000 7f6cc1ffb700 1 -- 172.21.15.115:0/3785816423 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6cbc04cfa0 con 0x7f6ccc14ae00 2023-07-27T14:40:44.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.301+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6ccc0c4d00 con 0x7f6ccc14ae00 2023-07-27T14:40:44.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.863+0000 7f6cc1ffb700 1 -- 172.21.15.115:0/3785816423 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v115) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6cbc01f070 con 0x7f6ccc14ae00 2023-07-27T14:40:44.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6cb005fe20 msgr2=0x7f6cb00622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:44.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6cb005fe20 0x7f6cb00622e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f6cc8002780 tx=0x7f6cc8009040).stop 2023-07-27T14:40:44.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc14ae00 msgr2=0x7f6ccc1651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:44.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc14ae00 0x7f6ccc1651e0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 rx=0x7f6ccc0c53b0 tx=0x7f6cbc017000).stop 2023-07-27T14:40:44.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 shutdown_connections 2023-07-27T14:40:44.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f6cb005fe20 0x7f6cb00622e0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc14b1e0 0x7f6ccc0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc063260 0x7f6ccc164030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 --2- 172.21.15.115:0/3785816423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ccc14ae00 0x7f6ccc1651e0 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:44.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 >> 172.21.15.115:0/3785816423 conn(0x7f6ccc05e940 msgr2=0x7f6ccc0ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:44.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 shutdown_connections 2023-07-27T14:40:44.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:44.866+0000 7f6cd41ff700 1 -- 172.21.15.115:0/3785816423 wait complete. 2023-07-27T14:40:44.943 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-27T14:40:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.082+0000 7f7150bff700 1 Processor -- start 2023-07-27T14:40:45.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.082+0000 7f7150bff700 1 -- start start 2023-07-27T14:40:45.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.083+0000 7f7150bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f714c0c6b70 0x7f714c0656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.083+0000 7f7150bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c065bc0 0x7f714c062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.083+0000 7f7150bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c066050 con 0x7f714c153e00 2023-07-27T14:40:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.083+0000 7f7150bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c062320 con 0x7f714c0c6b70 2023-07-27T14:40:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.083+0000 7f7150bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c064a80 con 0x7f714c065bc0 2023-07-27T14:40:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f7149d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f714c0c6b70 0x7f714c0656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:45.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f7149d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f714c0c6b70 0x7f714c0656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32842/0 (socket says 172.21.15.115:32842) 2023-07-27T14:40:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f7149d9b700 1 -- 172.21.15.115:0/963341326 learned_addr learned my addr 172.21.15.115:0/963341326 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:45.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f714ad9d700 1 --2- 172.21.15.115:0/963341326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c065bc0 0x7f714c062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:45.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f7149d9b700 1 -- 172.21.15.115:0/963341326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c065bc0 msgr2=0x7f714c062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:45.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f7149d9b700 1 --2- 172.21.15.115:0/963341326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c065bc0 0x7f714c062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f7149d9b700 1 -- 172.21.15.115:0/963341326 >> v1:172.21.15.115:6789/0 conn(0x7f714c153e00 legacy=0x7f714c064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f7149d9b700 1 -- 172.21.15.115:0/963341326 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c064d60 con 0x7f714c0c6b70 2023-07-27T14:40:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f7149d9b700 1 --2- 172.21.15.115:0/963341326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c0c6b70 0x7f714c0656d0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 rx=0x7f7140006fd0 tx=0x7f71400090f0).ready entity=mon.0 client_cookie=9f9da5e1cf770899 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f714959a700 1 -- 172.21.15.115:0/963341326 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000b600 con 0x7f714c0c6b70 2023-07-27T14:40:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.084+0000 7f714959a700 1 -- 172.21.15.115:0/963341326 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714000b760 con 0x7f714c0c6b70 2023-07-27T14:40:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f714959a700 1 -- 172.21.15.115:0/963341326 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000bae0 con 0x7f714c0c6b70 2023-07-27T14:40:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f7150bff700 1 -- 172.21.15.115:0/963341326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c0c6b70 msgr2=0x7f714c0656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:45.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f7150bff700 1 --2- 172.21.15.115:0/963341326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c0c6b70 0x7f714c0656d0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 rx=0x7f7140006fd0 tx=0x7f71400090f0).stop 2023-07-27T14:40:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f7150bff700 1 -- 172.21.15.115:0/963341326 shutdown_connections 2023-07-27T14:40:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f7150bff700 1 --2- 172.21.15.115:0/963341326 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c065bc0 0x7f714c062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f7150bff700 1 --2- 172.21.15.115:0/963341326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c0c6b70 0x7f714c0656d0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f7150bff700 1 -- 172.21.15.115:0/963341326 >> 172.21.15.115:0/963341326 conn(0x7f714c0c7b90 msgr2=0x7f714c0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f7150bff700 1 -- 172.21.15.115:0/963341326 shutdown_connections 2023-07-27T14:40:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.085+0000 7f7150bff700 1 -- 172.21.15.115:0/963341326 wait complete. 2023-07-27T14:40:45.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.087+0000 7f7150bff700 1 Processor -- start 2023-07-27T14:40:45.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.087+0000 7f7150bff700 1 -- start start 2023-07-27T14:40:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f7150bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c065bc0 0x7f714c13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f7150bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c0c6b70 0x7f714c0929a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f7150bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f714c153e00 0x7f714c0aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f7150bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c094340 con 0x7f714c065bc0 2023-07-27T14:40:45.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f7150bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c140130 con 0x7f714c153e00 2023-07-27T14:40:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f7150bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c093eb0 con 0x7f714c0c6b70 2023-07-27T14:40:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c065bc0 0x7f714c13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c065bc0 0x7f714c13fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32848/0 (socket says 172.21.15.115:32848) 2023-07-27T14:40:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 -- 172.21.15.115:0/25816666 learned_addr learned my addr 172.21.15.115:0/25816666 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f7149d9b700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c0c6b70 0x7f714c0929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 -- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c0c6b70 msgr2=0x7f714c0929a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:45.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714ad9d700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f714c153e00 0x7f714c0aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c0c6b70 0x7f714c0929a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 -- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f714c153e00 msgr2=0x7f714c0aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f714c153e00 0x7f714c0aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 -- 172.21.15.115:0/25816666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140009370 con 0x7f714c065bc0 2023-07-27T14:40:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714ad9d700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f714c153e00 0x7f714c0aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.088+0000 7f714a59c700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c065bc0 0x7f714c13fc40 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 rx=0x7f713c00c470 tx=0x7f713c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:45.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.089+0000 7f713a7fc700 1 -- 172.21.15.115:0/25816666 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c007020 con 0x7f714c065bc0 2023-07-27T14:40:45.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.089+0000 7f713a7fc700 1 -- 172.21.15.115:0/25816666 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c007180 con 0x7f714c065bc0 2023-07-27T14:40:45.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.089+0000 7f713a7fc700 1 -- 172.21.15.115:0/25816666 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c007520 con 0x7f714c065bc0 2023-07-27T14:40:45.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.089+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c0932a0 con 0x7f714c065bc0 2023-07-27T14:40:45.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.089+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c093860 con 0x7f714c065bc0 2023-07-27T14:40:45.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.090+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c094190 con 0x7f714c065bc0 2023-07-27T14:40:45.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.091+0000 7f713a7fc700 1 -- 172.21.15.115:0/25816666 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f713c010070 con 0x7f714c065bc0 2023-07-27T14:40:45.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.091+0000 7f713a7fc700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f712c05fe20 0x7f712c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:45.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.092+0000 7f713a7fc700 1 -- 172.21.15.115:0/25816666 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6263+0+0 (secure 0 0 0) 0x7f713c07a7d0 con 0x7f714c065bc0 2023-07-27T14:40:45.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.092+0000 7f7149d9b700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f712c05fe20 0x7f712c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:45.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.092+0000 7f7149d9b700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f712c05fe20 0x7f712c0622e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f7140009130 tx=0x7f7140017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:45.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.095+0000 7f713a7fc700 1 -- 172.21.15.115:0/25816666 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f713c0478f0 con 0x7f714c065bc0 2023-07-27T14:40:45.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.265+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f714c06c470 con 0x7f714c065bc0 2023-07-27T14:40:45.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.875+0000 7f713a7fc700 1 -- 172.21.15.115:0/25816666 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v208) v1 ==== 181+0+0 (secure 0 0 0) 0x7f713c04e680 con 0x7f714c065bc0 2023-07-27T14:40:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f712c05fe20 msgr2=0x7f712c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f712c05fe20 0x7f712c0622e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f7140009130 tx=0x7f7140017000).stop 2023-07-27T14:40:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c065bc0 msgr2=0x7f714c13fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:45.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c065bc0 0x7f714c13fc40 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 rx=0x7f713c00c470 tx=0x7f713c007e00).stop 2023-07-27T14:40:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 shutdown_connections 2023-07-27T14:40:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f712c05fe20 0x7f712c0622e0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f714c153e00 0x7f714c0aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714c065bc0 0x7f714c13fc40 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 --2- 172.21.15.115:0/25816666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f714c0c6b70 0x7f714c0929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 >> 172.21.15.115:0/25816666 conn(0x7f714c0c7b90 msgr2=0x7f714c152350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:45.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 shutdown_connections 2023-07-27T14:40:45.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:45.878+0000 7f7150bff700 1 -- 172.21.15.115:0/25816666 wait complete. 2023-07-27T14:40:45.937 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' removed 2023-07-27T14:40:45.957 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-27T14:40:46.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.095+0000 7ff0e13ff700 1 Processor -- start 2023-07-27T14:40:46.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.096+0000 7ff0e13ff700 1 -- start start 2023-07-27T14:40:46.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0e13ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff0dc063260 0x7ff0dc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:46.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0e13ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0dc14b1e0 0x7ff0dc0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:46.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0e13ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc1553f0 con 0x7ff0dc14ae00 2023-07-27T14:40:46.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0e13ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc157a50 con 0x7ff0dc14b1e0 2023-07-27T14:40:46.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0e13ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc157d10 con 0x7ff0dc063260 2023-07-27T14:40:46.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0db7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0dc14b1e0 0x7ff0dc0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:46.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0db7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0dc14b1e0 0x7ff0dc0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32858/0 (socket says 172.21.15.115:32858) 2023-07-27T14:40:46.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0db7fe700 1 -- 172.21.15.115:0/3046085237 learned_addr learned my addr 172.21.15.115:0/3046085237 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:46.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.097+0000 7ff0da7fc700 1 --2- 172.21.15.115:0/3046085237 >> v2:172.21.15.159:3300/0 conn(0x7ff0dc063260 0x7ff0dc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:46.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.098+0000 7ff0db7fe700 1 -- 172.21.15.115:0/3046085237 >> v2:172.21.15.159:3300/0 conn(0x7ff0dc063260 msgr2=0x7ff0dc154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:46.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.098+0000 7ff0db7fe700 1 --2- 172.21.15.115:0/3046085237 >> v2:172.21.15.159:3300/0 conn(0x7ff0dc063260 0x7ff0dc154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.098+0000 7ff0db7fe700 1 -- 172.21.15.115:0/3046085237 >> v1:172.21.15.159:6789/0 conn(0x7ff0dc14ae00 legacy=0x7ff0dc062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:46.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.098+0000 7ff0db7fe700 1 -- 172.21.15.115:0/3046085237 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc157ff0 con 0x7ff0dc14b1e0 2023-07-27T14:40:46.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.098+0000 7ff0db7fe700 1 --2- 172.21.15.115:0/3046085237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc14b1e0 0x7ff0dc0a98c0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 rx=0x7ff0dc0cbc00 tx=0x7ff0d4009840).ready entity=mon.0 client_cookie=bcaa624cb9909ff9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:46.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.098+0000 7ff0d9ffb700 1 -- 172.21.15.115:0/3046085237 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400e070 con 0x7ff0dc14b1e0 2023-07-27T14:40:46.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.098+0000 7ff0d9ffb700 1 -- 172.21.15.115:0/3046085237 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400ba50 con 0x7ff0dc14b1e0 2023-07-27T14:40:46.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.098+0000 7ff0d9ffb700 1 -- 172.21.15.115:0/3046085237 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400bdd0 con 0x7ff0dc14b1e0 2023-07-27T14:40:46.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.099+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3046085237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc14b1e0 msgr2=0x7ff0dc0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:46.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.099+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3046085237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc14b1e0 0x7ff0dc0a98c0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 rx=0x7ff0dc0cbc00 tx=0x7ff0d4009840).stop 2023-07-27T14:40:46.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.099+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3046085237 shutdown_connections 2023-07-27T14:40:46.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.099+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3046085237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc14b1e0 0x7ff0dc0a98c0 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.099+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3046085237 >> v2:172.21.15.159:3300/0 conn(0x7ff0dc063260 0x7ff0dc154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.099+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3046085237 >> 172.21.15.115:0/3046085237 conn(0x7ff0dc05e940 msgr2=0x7ff0dc0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:46.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.099+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3046085237 shutdown_connections 2023-07-27T14:40:46.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.099+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3046085237 wait complete. 2023-07-27T14:40:46.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.100+0000 7ff0e13ff700 1 Processor -- start 2023-07-27T14:40:46.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.100+0000 7ff0e13ff700 1 -- start start 2023-07-27T14:40:46.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.101+0000 7ff0e13ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc063260 0x7ff0dc0c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.101+0000 7ff0e13ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0dc14ae00 0x7ff0dc149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.101+0000 7ff0e13ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0dc14b1e0 0x7ff0dc0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.101+0000 7ff0e13ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0af290 con 0x7ff0dc063260 2023-07-27T14:40:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.101+0000 7ff0e13ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc14d270 con 0x7ff0dc14b1e0 2023-07-27T14:40:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.101+0000 7ff0e13ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0c31a0 con 0x7ff0dc14ae00 2023-07-27T14:40:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc063260 0x7ff0dc0c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:46.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc063260 0x7ff0dc0c2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32868/0 (socket says 172.21.15.115:32868) 2023-07-27T14:40:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 -- 172.21.15.115:0/3061685700 learned_addr learned my addr 172.21.15.115:0/3061685700 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0db7fe700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0dc14b1e0 0x7ff0dc0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0da7fc700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0dc14ae00 0x7ff0dc149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 -- 172.21.15.115:0/3061685700 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0dc14ae00 msgr2=0x7ff0dc149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0dc14ae00 0x7ff0dc149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 -- 172.21.15.115:0/3061685700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0dc14b1e0 msgr2=0x7ff0dc0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:46.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0dc14b1e0 0x7ff0dc0ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 -- 172.21.15.115:0/3061685700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4009ae0 con 0x7ff0dc063260 2023-07-27T14:40:46.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0daffd700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc063260 0x7ff0dc0c2cb0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 rx=0x7ff0cc00c4f0 tx=0x7ff0cc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:46.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0c2ffd700 1 -- 172.21.15.115:0/3061685700 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc007020 con 0x7ff0dc063260 2023-07-27T14:40:46.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.102+0000 7ff0c2ffd700 1 -- 172.21.15.115:0/3061685700 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc001e90 con 0x7ff0dc063260 2023-07-27T14:40:46.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.103+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0aefb0 con 0x7ff0dc063260 2023-07-27T14:40:46.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.103+0000 7ff0c2ffd700 1 -- 172.21.15.115:0/3061685700 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0073b0 con 0x7ff0dc063260 2023-07-27T14:40:46.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.103+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc14cf00 con 0x7ff0dc063260 2023-07-27T14:40:46.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.104+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc06c470 con 0x7ff0dc063260 2023-07-27T14:40:46.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.105+0000 7ff0c2ffd700 1 -- 172.21.15.115:0/3061685700 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7ff0cc010070 con 0x7ff0dc063260 2023-07-27T14:40:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.105+0000 7ff0c2ffd700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0c805fe20 0x7ff0c80622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.105+0000 7ff0c2ffd700 1 -- 172.21.15.115:0/3061685700 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff0cc07ad20 con 0x7ff0dc063260 2023-07-27T14:40:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.106+0000 7ff0da7fc700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0c805fe20 0x7ff0c80622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:46.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.106+0000 7ff0da7fc700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0c805fe20 0x7ff0c80622e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7ff0dc0aa060 tx=0x7ff0d0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:46.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.109+0000 7ff0c2ffd700 1 -- 172.21.15.115:0/3061685700 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0cc04b240 con 0x7ff0dc063260 2023-07-27T14:40:46.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.282+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0dc0c1400 con 0x7ff0dc063260 2023-07-27T14:40:46.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.725+0000 7ff0c2ffd700 1 -- 172.21.15.115:0/3061685700 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v209) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff0cc04e860 con 0x7ff0dc063260 2023-07-27T14:40:46.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0c805fe20 msgr2=0x7ff0c80622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:46.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0c805fe20 0x7ff0c80622e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7ff0dc0aa060 tx=0x7ff0d0008040).stop 2023-07-27T14:40:46.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc063260 msgr2=0x7ff0dc0c2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:46.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc063260 0x7ff0dc0c2cb0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 rx=0x7ff0cc00c4f0 tx=0x7ff0cc007e00).stop 2023-07-27T14:40:46.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 shutdown_connections 2023-07-27T14:40:46.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff0c805fe20 0x7ff0c80622e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0dc14b1e0 0x7ff0dc0ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0dc063260 0x7ff0dc0c2cb0 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 --2- 172.21.15.115:0/3061685700 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0dc14ae00 0x7ff0dc149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:46.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 >> 172.21.15.115:0/3061685700 conn(0x7ff0dc05e940 msgr2=0x7ff0dc0ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:46.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 shutdown_connections 2023-07-27T14:40:46.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.728+0000 7ff0e13ff700 1 -- 172.21.15.115:0/3061685700 wait complete. 2023-07-27T14:40:46.787 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' removed 2023-07-27T14:40:46.803 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-27T14:40:46.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.940+0000 7fe16fbff700 1 Processor -- start 2023-07-27T14:40:46.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.940+0000 7fe16fbff700 1 -- start start 2023-07-27T14:40:46.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.941+0000 7fe16fbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe16814b1e0 0x7fe168154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.941+0000 7fe16fbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1681553f0 con 0x7fe168063260 2023-07-27T14:40:47.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.941+0000 7fe16fbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe168157a50 con 0x7fe16814ae00 2023-07-27T14:40:47.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.941+0000 7fe16fbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe168157d10 con 0x7fe16814b1e0 2023-07-27T14:40:47.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.941+0000 7fe16d19a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe168063260 0x7fe1680a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60334/0 (socket says 172.21.15.115:60334) 2023-07-27T14:40:47.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.941+0000 7fe16d19a700 1 -- 172.21.15.115:0/2705473572 learned_addr learned my addr 172.21.15.115:0/2705473572 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:47.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.942+0000 7fe16e19c700 1 --2- 172.21.15.115:0/2705473572 >> v2:172.21.15.115:3300/0 conn(0x7fe16814b1e0 0x7fe168154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.942+0000 7fe16e19c700 1 -- 172.21.15.115:0/2705473572 >> v1:172.21.15.159:6789/0 conn(0x7fe16814ae00 legacy=0x7fe168062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.942+0000 7fe16e19c700 1 -- 172.21.15.115:0/2705473572 >> v1:172.21.15.115:6789/0 conn(0x7fe168063260 legacy=0x7fe1680a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.942+0000 7fe16e19c700 1 -- 172.21.15.115:0/2705473572 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168157ff0 con 0x7fe16814b1e0 2023-07-27T14:40:47.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.942+0000 7fe16e19c700 1 --2- 172.21.15.115:0/2705473572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe16814b1e0 0x7fe168154f00 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 rx=0x7fe160009e60 tx=0x7fe160009780).ready entity=mon.0 client_cookie=1fedcc5dea518f93 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:47.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.942+0000 7fe16c999700 1 -- 172.21.15.115:0/2705473572 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16000e070 con 0x7fe16814b1e0 2023-07-27T14:40:47.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.942+0000 7fe16c999700 1 -- 172.21.15.115:0/2705473572 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16000bc30 con 0x7fe16814b1e0 2023-07-27T14:40:47.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.942+0000 7fe16c999700 1 -- 172.21.15.115:0/2705473572 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160012410 con 0x7fe16814b1e0 2023-07-27T14:40:47.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.943+0000 7fe16fbff700 1 -- 172.21.15.115:0/2705473572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe16814b1e0 msgr2=0x7fe168154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.943+0000 7fe16fbff700 1 --2- 172.21.15.115:0/2705473572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe16814b1e0 0x7fe168154f00 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 rx=0x7fe160009e60 tx=0x7fe160009780).stop 2023-07-27T14:40:47.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.943+0000 7fe16fbff700 1 -- 172.21.15.115:0/2705473572 shutdown_connections 2023-07-27T14:40:47.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.943+0000 7fe16fbff700 1 --2- 172.21.15.115:0/2705473572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe16814b1e0 0x7fe168154f00 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.943+0000 7fe16fbff700 1 -- 172.21.15.115:0/2705473572 >> 172.21.15.115:0/2705473572 conn(0x7fe16805e940 msgr2=0x7fe1680cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:47.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.943+0000 7fe16fbff700 1 -- 172.21.15.115:0/2705473572 shutdown_connections 2023-07-27T14:40:47.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.943+0000 7fe16fbff700 1 -- 172.21.15.115:0/2705473572 wait complete. 2023-07-27T14:40:47.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.945+0000 7fe16fbff700 1 Processor -- start 2023-07-27T14:40:47.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.945+0000 7fe16fbff700 1 -- start start 2023-07-27T14:40:47.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16fbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe168063260 0x7fe1680af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16fbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe16814ae00 0x7fe168149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16fbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16814b1e0 0x7fe1680adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16fbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680af150 con 0x7fe168063260 2023-07-27T14:40:47.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16fbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680ae540 con 0x7fe16814b1e0 2023-07-27T14:40:47.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16fbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680ae820 con 0x7fe16814ae00 2023-07-27T14:40:47.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe168063260 0x7fe1680af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe168063260 0x7fe1680af5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32890/0 (socket says 172.21.15.115:32890) 2023-07-27T14:40:47.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d99b700 1 -- 172.21.15.115:0/2134477542 learned_addr learned my addr 172.21.15.115:0/2134477542 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:47.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16e19c700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16814b1e0 0x7fe1680adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d19a700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe16814ae00 0x7fe168149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d99b700 1 -- 172.21.15.115:0/2134477542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe16814ae00 msgr2=0x7fe168149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d99b700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe16814ae00 0x7fe168149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d99b700 1 -- 172.21.15.115:0/2134477542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16814b1e0 msgr2=0x7fe1680adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d99b700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16814b1e0 0x7fe1680adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.946+0000 7fe16d99b700 1 -- 172.21.15.115:0/2134477542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160009a20 con 0x7fe168063260 2023-07-27T14:40:47.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.947+0000 7fe16d99b700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe168063260 0x7fe1680af5e0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 rx=0x7fe16400c4c0 tx=0x7fe164007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:47.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.947+0000 7fe15dffb700 1 -- 172.21.15.115:0/2134477542 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164007020 con 0x7fe168063260 2023-07-27T14:40:47.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.947+0000 7fe15dffb700 1 -- 172.21.15.115:0/2134477542 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe164001e90 con 0x7fe168063260 2023-07-27T14:40:47.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.947+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1680aeb00 con 0x7fe168063260 2023-07-27T14:40:47.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.947+0000 7fe15dffb700 1 -- 172.21.15.115:0/2134477542 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640073b0 con 0x7fe168063260 2023-07-27T14:40:47.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.947+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1680c46e0 con 0x7fe168063260 2023-07-27T14:40:47.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.948+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1680af430 con 0x7fe168063260 2023-07-27T14:40:47.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.949+0000 7fe15dffb700 1 -- 172.21.15.115:0/2134477542 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fe164010070 con 0x7fe168063260 2023-07-27T14:40:47.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.949+0000 7fe15dffb700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe14c05fe20 0x7fe14c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.949+0000 7fe15dffb700 1 -- 172.21.15.115:0/2134477542 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fe16407aca0 con 0x7fe168063260 2023-07-27T14:40:47.014 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.950+0000 7fe16d19a700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe14c05fe20 0x7fe14c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.950+0000 7fe16d19a700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe14c05fe20 0x7fe14c0622e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7fe158007fd0 tx=0x7fe158009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:47.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:46.954+0000 7fe15dffb700 1 -- 172.21.15.115:0/2134477542 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe16404b360 con 0x7fe168063260 2023-07-27T14:40:47.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.121+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe16806c470 con 0x7fe168063260 2023-07-27T14:40:47.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.125+0000 7fe15dffb700 1 -- 172.21.15.115:0/2134477542 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe16404e980 con 0x7fe168063260 2023-07-27T14:40:47.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe14c05fe20 msgr2=0x7fe14c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe14c05fe20 0x7fe14c0622e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7fe158007fd0 tx=0x7fe158009040).stop 2023-07-27T14:40:47.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe168063260 msgr2=0x7fe1680af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe168063260 0x7fe1680af5e0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 rx=0x7fe16400c4c0 tx=0x7fe164007e00).stop 2023-07-27T14:40:47.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 shutdown_connections 2023-07-27T14:40:47.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fe14c05fe20 0x7fe14c0622e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16814b1e0 0x7fe1680adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe168063260 0x7fe1680af5e0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 --2- 172.21.15.115:0/2134477542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe16814ae00 0x7fe168149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 >> 172.21.15.115:0/2134477542 conn(0x7fe16805e940 msgr2=0x7fe16814a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:47.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 shutdown_connections 2023-07-27T14:40:47.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.127+0000 7fe16fbff700 1 -- 172.21.15.115:0/2134477542 wait complete. 2023-07-27T14:40:47.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_retain_snapshot_with_snapshots' 2023-07-27T14:40:47.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.341+0000 7fbea0fff700 1 Processor -- start 2023-07-27T14:40:47.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.342+0000 7fbea0fff700 1 -- start start 2023-07-27T14:40:47.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbea0fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbe9c150af0 0x7fbe9c150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbea0fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe9c0c0e80 0x7fbe9c0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbea0fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c06a440 con 0x7fbe9c0696f0 2023-07-27T14:40:47.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbea0fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0bbc80 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbea0fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c069e80 con 0x7fbe9c150af0 2023-07-27T14:40:47.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbe99d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe9c0c0e80 0x7fbe9c0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbe99d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbe9c0c0e80 0x7fbe9c0c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32892/0 (socket says 172.21.15.115:32892) 2023-07-27T14:40:47.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbe99d9b700 1 -- 172.21.15.115:0/2468905428 learned_addr learned my addr 172.21.15.115:0/2468905428 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:47.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.343+0000 7fbe9ad9d700 1 --1- 172.21.15.115:0/2468905428 >> v1:172.21.15.115:6789/0 conn(0x7fbe9c0696f0 0x7fbe9c0a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60346/0 (socket says 172.21.15.115:60346) 2023-07-27T14:40:47.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe9a59c700 1 --2- 172.21.15.115:0/2468905428 >> v2:172.21.15.159:3300/0 conn(0x7fbe9c150af0 0x7fbe9c150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe99d9b700 1 -- 172.21.15.115:0/2468905428 >> v2:172.21.15.159:3300/0 conn(0x7fbe9c150af0 msgr2=0x7fbe9c150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:47.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe99d9b700 1 --2- 172.21.15.115:0/2468905428 >> v2:172.21.15.159:3300/0 conn(0x7fbe9c150af0 0x7fbe9c150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe99d9b700 1 -- 172.21.15.115:0/2468905428 >> v1:172.21.15.115:6789/0 conn(0x7fbe9c0696f0 legacy=0x7fbe9c0a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe99d9b700 1 -- 172.21.15.115:0/2468905428 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c06a160 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe9a59c700 1 --2- 172.21.15.115:0/2468905428 >> v2:172.21.15.159:3300/0 conn(0x7fbe9c150af0 0x7fbe9c150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:47.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe99d9b700 1 --2- 172.21.15.115:0/2468905428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0c3960 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 rx=0x7fbe9c0a95d0 tx=0x7fbe900090f0).ready entity=mon.0 client_cookie=d471b7ef9a022422 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:47.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe9959a700 1 -- 172.21.15.115:0/2468905428 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000b600 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe9959a700 1 -- 172.21.15.115:0/2468905428 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9000b760 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbe9959a700 1 -- 172.21.15.115:0/2468905428 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000bae0 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbea0fff700 1 -- 172.21.15.115:0/2468905428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 msgr2=0x7fbe9c0c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.344+0000 7fbea0fff700 1 --2- 172.21.15.115:0/2468905428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0c3960 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 rx=0x7fbe9c0a95d0 tx=0x7fbe900090f0).stop 2023-07-27T14:40:47.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.345+0000 7fbea0fff700 1 -- 172.21.15.115:0/2468905428 shutdown_connections 2023-07-27T14:40:47.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.345+0000 7fbea0fff700 1 --2- 172.21.15.115:0/2468905428 >> v2:172.21.15.159:3300/0 conn(0x7fbe9c150af0 0x7fbe9c150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.345+0000 7fbea0fff700 1 --2- 172.21.15.115:0/2468905428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0c3960 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.345+0000 7fbea0fff700 1 -- 172.21.15.115:0/2468905428 >> 172.21.15.115:0/2468905428 conn(0x7fbe9c062320 msgr2=0x7fbe9c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.345+0000 7fbea0fff700 1 -- 172.21.15.115:0/2468905428 shutdown_connections 2023-07-27T14:40:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.345+0000 7fbea0fff700 1 -- 172.21.15.115:0/2468905428 wait complete. 2023-07-27T14:40:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.346+0000 7fbea0fff700 1 Processor -- start 2023-07-27T14:40:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.346+0000 7fbea0fff700 1 -- start start 2023-07-27T14:40:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.347+0000 7fbea0fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe9c0696f0 0x7fbe9c0a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.347+0000 7fbea0fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.347+0000 7fbea0fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9c150af0 0x7fbe9c0c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.347+0000 7fbea0fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c152460 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.347+0000 7fbea0fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0a6e00 con 0x7fbe9c0696f0 2023-07-27T14:40:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.347+0000 7fbea0fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0a70e0 con 0x7fbe9c150af0 2023-07-27T14:40:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0a8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32904/0 (socket says 172.21.15.115:32904) 2023-07-27T14:40:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 -- 172.21.15.115:0/1845492649 learned_addr learned my addr 172.21.15.115:0/1845492649 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe9a59c700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe9c0696f0 0x7fbe9c0a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 -- 172.21.15.115:0/1845492649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9c150af0 msgr2=0x7fbe9c0c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9c150af0 0x7fbe9c0c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:47.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 -- 172.21.15.115:0/1845492649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe9c0696f0 msgr2=0x7fbe9c0a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe9c0696f0 0x7fbe9c0a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 -- 172.21.15.115:0/1845492649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90009370 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe9a59c700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe9c0696f0 0x7fbe9c0a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:47.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe99d9b700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0a8b00 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 rx=0x7fbe90009130 tx=0x7fbe90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:47.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe8a7fc700 1 -- 172.21.15.115:0/1845492649 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000bae0 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe8a7fc700 1 -- 172.21.15.115:0/1845492649 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe90000c90 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbe8a7fc700 1 -- 172.21.15.115:0/1845492649 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9001c670 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.348+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c1520f0 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.349+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c153f80 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.350+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c154170 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.350+0000 7fbe8a7fc700 1 -- 172.21.15.115:0/1845492649 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fbe9000f070 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.351+0000 7fbe8a7fc700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe7c05fe20 0x7fbe7c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.351+0000 7fbe8a7fc700 1 -- 172.21.15.115:0/1845492649 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fbe9007caa0 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.351+0000 7fbe9a59c700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe7c05fe20 0x7fbe7c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.352+0000 7fbe9a59c700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe7c05fe20 0x7fbe7c0622e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7fbe8c006fd0 tx=0x7fbe8c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:47.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.355+0000 7fbe8a7fc700 1 -- 172.21.15.115:0/1845492649 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe9c154170 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.587+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_retain_snapshot_with_snapshots"]} v 0) v1 -- 0x7fbe9c154170 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.877+0000 7fbe8a7fc700 1 -- 172.21.15.115:0/1845492649 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_clone_retain_snapshot_with_snapshots"]}]=0 v704) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbe9c154170 con 0x7fbe9c0c0e80 2023-07-27T14:40:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe7c05fe20 msgr2=0x7fbe7c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe7c05fe20 0x7fbe7c0622e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7fbe8c006fd0 tx=0x7fbe8c008040).stop 2023-07-27T14:40:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 msgr2=0x7fbe9c0a8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0a8b00 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 rx=0x7fbe90009130 tx=0x7fbe90017000).stop 2023-07-27T14:40:47.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 shutdown_connections 2023-07-27T14:40:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbe7c05fe20 0x7fbe7c0622e0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe9c150af0 0x7fbe9c0c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe9c0696f0 0x7fbe9c0a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 --2- 172.21.15.115:0/1845492649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c0c0e80 0x7fbe9c0a8b00 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 >> 172.21.15.115:0/1845492649 conn(0x7fbe9c062320 msgr2=0x7fbe9c0a5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 shutdown_connections 2023-07-27T14:40:47.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:47.880+0000 7fbea0fff700 1 -- 172.21.15.115:0/1845492649 wait complete. 2023-07-27T14:40:47.954 INFO:tasks.cephfs_test_runner:test_subvolume_clone_retain_snapshot_with_snapshots (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ... ok 2023-07-27T14:40:47.955 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_retain_snapshot_clone (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-07-27T14:40:47.955 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_retain_snapshot_clone' 2023-07-27T14:40:48.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.085+0000 7fce8b5ff700 1 Processor -- start 2023-07-27T14:40:48.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.086+0000 7fce8b5ff700 1 -- start start 2023-07-27T14:40:48.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.087+0000 7fce8b5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce840aaa40 0x7fce840640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:48.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.087+0000 7fce8b5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840aa4d0 con 0x7fce841542a0 2023-07-27T14:40:48.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.087+0000 7fce8b5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840c05c0 con 0x7fce84153ec0 2023-07-27T14:40:48.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.087+0000 7fce8b5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce840aa270 con 0x7fce840aaa40 2023-07-27T14:40:48.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.087+0000 7fce89b9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fce841542a0 0x7fce840c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60352/0 (socket says 172.21.15.115:60352) 2023-07-27T14:40:48.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.087+0000 7fce89b9c700 1 -- 172.21.15.115:0/3628308066 learned_addr learned my addr 172.21.15.115:0/3628308066 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:48.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.087+0000 7fce88b9a700 1 --2- 172.21.15.115:0/3628308066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce840aaa40 0x7fce840640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:48.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce7bfff700 1 -- 172.21.15.115:0/3628308066 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887721360 0 0) 0x7fce7c001490 con 0x7fce841542a0 2023-07-27T14:40:48.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce7bfff700 1 -- 172.21.15.115:0/3628308066 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce700033f0 con 0x7fce841542a0 2023-07-27T14:40:48.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce7bfff700 1 -- 172.21.15.115:0/3628308066 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59929242 0 0) 0x7fce840c05c0 con 0x7fce84153ec0 2023-07-27T14:40:48.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce7bfff700 1 -- 172.21.15.115:0/3628308066 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce7c001490 con 0x7fce84153ec0 2023-07-27T14:40:48.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce7bfff700 1 -- 172.21.15.115:0/3628308066 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042698737 0 0) 0x7fce700033f0 con 0x7fce841542a0 2023-07-27T14:40:48.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce88b9a700 1 -- 172.21.15.115:0/3628308066 >> v1:172.21.15.159:6789/0 conn(0x7fce84153ec0 legacy=0x7fce840a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:48.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce88b9a700 1 -- 172.21.15.115:0/3628308066 >> v1:172.21.15.115:6789/0 conn(0x7fce841542a0 legacy=0x7fce840c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:48.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce88b9a700 1 -- 172.21.15.115:0/3628308066 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840bfc90 con 0x7fce840aaa40 2023-07-27T14:40:48.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce88b9a700 1 --2- 172.21.15.115:0/3628308066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce840aaa40 0x7fce840640f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fce74009790 tx=0x7fce74009060).ready entity=mon.2 client_cookie=ed5e80ae792e438f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:48.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce7bfff700 1 -- 172.21.15.115:0/3628308066 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c001980 con 0x7fce840aaa40 2023-07-27T14:40:48.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.088+0000 7fce7bfff700 1 -- 172.21.15.115:0/3628308066 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74011400 con 0x7fce840aaa40 2023-07-27T14:40:48.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.089+0000 7fce7bfff700 1 -- 172.21.15.115:0/3628308066 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011780 con 0x7fce840aaa40 2023-07-27T14:40:48.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.089+0000 7fce8b5ff700 1 -- 172.21.15.115:0/3628308066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce840aaa40 msgr2=0x7fce840640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:48.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.089+0000 7fce8b5ff700 1 --2- 172.21.15.115:0/3628308066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce840aaa40 0x7fce840640f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fce74009790 tx=0x7fce74009060).stop 2023-07-27T14:40:48.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.089+0000 7fce8b5ff700 1 -- 172.21.15.115:0/3628308066 shutdown_connections 2023-07-27T14:40:48.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.089+0000 7fce8b5ff700 1 --2- 172.21.15.115:0/3628308066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce840aaa40 0x7fce840640f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:48.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.089+0000 7fce8b5ff700 1 -- 172.21.15.115:0/3628308066 >> 172.21.15.115:0/3628308066 conn(0x7fce840cb610 msgr2=0x7fce840c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:48.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.089+0000 7fce8b5ff700 1 -- 172.21.15.115:0/3628308066 shutdown_connections 2023-07-27T14:40:48.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.089+0000 7fce8b5ff700 1 -- 172.21.15.115:0/3628308066 wait complete. 2023-07-27T14:40:48.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.091+0000 7fce8b5ff700 1 Processor -- start 2023-07-27T14:40:48.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.091+0000 7fce8b5ff700 1 -- start start 2023-07-27T14:40:48.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.092+0000 7fce8b5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840aaa40 0x7fce840af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:48.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce8b5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce84153ec0 0x7fce8414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:48.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce8b5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce841542a0 0x7fce84167790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:48.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce8b5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840aec40 con 0x7fce841542a0 2023-07-27T14:40:48.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce8b5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840c1c30 con 0x7fce840aaa40 2023-07-27T14:40:48.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce8b5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce840c1f10 con 0x7fce84153ec0 2023-07-27T14:40:48.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce89b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce841542a0 0x7fce84167790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:48.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce89b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce841542a0 0x7fce84167790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32908/0 (socket says 172.21.15.115:32908) 2023-07-27T14:40:48.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce89b9c700 1 -- 172.21.15.115:0/2502900829 learned_addr learned my addr 172.21.15.115:0/2502900829 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:48.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce8939b700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840aaa40 0x7fce840af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:48.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce88b9a700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce84153ec0 0x7fce8414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:48.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce89b9c700 1 -- 172.21.15.115:0/2502900829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce84153ec0 msgr2=0x7fce8414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:48.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce89b9c700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce84153ec0 0x7fce8414f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:48.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce89b9c700 1 -- 172.21.15.115:0/2502900829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840aaa40 msgr2=0x7fce840af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:48.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce89b9c700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840aaa40 0x7fce840af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:48.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.093+0000 7fce89b9c700 1 -- 172.21.15.115:0/2502900829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740092a0 con 0x7fce841542a0 2023-07-27T14:40:48.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.094+0000 7fce89b9c700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce841542a0 0x7fce84167790 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 rx=0x7fce7c00cb90 tx=0x7fce7c001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:48.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.094+0000 7fce797fa700 1 -- 172.21.15.115:0/2502900829 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c004c40 con 0x7fce841542a0 2023-07-27T14:40:48.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.094+0000 7fce797fa700 1 -- 172.21.15.115:0/2502900829 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c004dc0 con 0x7fce841542a0 2023-07-27T14:40:48.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.094+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce840aeee0 con 0x7fce841542a0 2023-07-27T14:40:48.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.094+0000 7fce797fa700 1 -- 172.21.15.115:0/2502900829 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0073c0 con 0x7fce841542a0 2023-07-27T14:40:48.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.094+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce840c21f0 con 0x7fce841542a0 2023-07-27T14:40:48.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.095+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8406c470 con 0x7fce841542a0 2023-07-27T14:40:48.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.096+0000 7fce797fa700 1 -- 172.21.15.115:0/2502900829 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fce7c01b060 con 0x7fce841542a0 2023-07-27T14:40:48.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.097+0000 7fce797fa700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce6805fdf0 0x7fce680622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:48.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.097+0000 7fce797fa700 1 -- 172.21.15.115:0/2502900829 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fce7c07af20 con 0x7fce841542a0 2023-07-27T14:40:48.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.097+0000 7fce8939b700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce6805fdf0 0x7fce680622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:48.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.097+0000 7fce8939b700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce6805fdf0 0x7fce680622b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7fce80003930 tx=0x7fce80007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:48.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.100+0000 7fce797fa700 1 -- 172.21.15.115:0/2502900829 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce7c04b5e0 con 0x7fce841542a0 2023-07-27T14:40:48.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.336+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_retain_snapshot_clone"]} v 0) v1 -- 0x7fce840aa4d0 con 0x7fce841542a0 2023-07-27T14:40:48.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.879+0000 7fce797fa700 1 -- 172.21.15.115:0/2502900829 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_subvolume_retain_snapshot_clone"]}]=0 v705) v1 ==== 172+0+0 (secure 0 0 0) 0x7fce840aa4d0 con 0x7fce841542a0 2023-07-27T14:40:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce6805fdf0 msgr2=0x7fce680622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce6805fdf0 0x7fce680622b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7fce80003930 tx=0x7fce80007bd0).stop 2023-07-27T14:40:48.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce841542a0 msgr2=0x7fce84167790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce841542a0 0x7fce84167790 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 rx=0x7fce7c00cb90 tx=0x7fce7c001b30).stop 2023-07-27T14:40:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 shutdown_connections 2023-07-27T14:40:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fce6805fdf0 0x7fce680622b0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce841542a0 0x7fce84167790 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce840aaa40 0x7fce840af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:48.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 --2- 172.21.15.115:0/2502900829 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce84153ec0 0x7fce8414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 >> 172.21.15.115:0/2502900829 conn(0x7fce840cb610 msgr2=0x7fce840abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 shutdown_connections 2023-07-27T14:40:48.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:48.882+0000 7fce8b5ff700 1 -- 172.21.15.115:0/2502900829 wait complete. 2023-07-27T14:40:48.957 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:40:49.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.091+0000 7f72ff5ff700 1 Processor -- start 2023-07-27T14:40:49.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.091+0000 7f72ff5ff700 1 -- start start 2023-07-27T14:40:49.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.092+0000 7f72ff5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814ae00 0x7f72f8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.092+0000 7f72ff5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f72f814b1e0 0x7f72f8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.092+0000 7f72ff5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f72f80c5c50 0x7f72f8063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.092+0000 7f72ff5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f8063530 con 0x7f72f814b1e0 2023-07-27T14:40:49.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.092+0000 7f72ff5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f81553f0 con 0x7f72f80c5c50 2023-07-27T14:40:49.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.092+0000 7f72ff5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8157a50 con 0x7f72f814ae00 2023-07-27T14:40:49.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f72f814b1e0 0x7f72f8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f72f814b1e0 0x7f72f8062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32924/0 (socket says 172.21.15.115:32924) 2023-07-27T14:40:49.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 -- 172.21.15.115:0/67102816 learned_addr learned my addr 172.21.15.115:0/67102816 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:49.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fd39b700 1 --2- 172.21.15.115:0/67102816 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814ae00 0x7f72f8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fdb9c700 1 --2- 172.21.15.115:0/67102816 >> v2:172.21.15.159:3300/0 conn(0x7f72f80c5c50 0x7f72f8063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 -- 172.21.15.115:0/67102816 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814ae00 msgr2=0x7f72f8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:49.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 --2- 172.21.15.115:0/67102816 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814ae00 0x7f72f8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 -- 172.21.15.115:0/67102816 >> v2:172.21.15.159:3300/0 conn(0x7f72f80c5c50 msgr2=0x7f72f8063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:49.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 --2- 172.21.15.115:0/67102816 >> v2:172.21.15.159:3300/0 conn(0x7f72f80c5c50 0x7f72f8063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 -- 172.21.15.115:0/67102816 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8157d10 con 0x7f72f814b1e0 2023-07-27T14:40:49.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72fcb9a700 1 --2- 172.21.15.115:0/67102816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f814b1e0 0x7f72f8062b50 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 rx=0x7f72f805fbe0 tx=0x7f72e80090f0).ready entity=mon.0 client_cookie=24465dee7e68daf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:49.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72effff700 1 -- 172.21.15.115:0/67102816 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e800b600 con 0x7f72f814b1e0 2023-07-27T14:40:49.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72effff700 1 -- 172.21.15.115:0/67102816 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e800b760 con 0x7f72f814b1e0 2023-07-27T14:40:49.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.093+0000 7f72effff700 1 -- 172.21.15.115:0/67102816 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e800bae0 con 0x7f72f814b1e0 2023-07-27T14:40:49.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 -- 172.21.15.115:0/67102816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f814b1e0 msgr2=0x7f72f8062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/67102816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f814b1e0 0x7f72f8062b50 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 rx=0x7f72f805fbe0 tx=0x7f72e80090f0).stop 2023-07-27T14:40:49.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 -- 172.21.15.115:0/67102816 shutdown_connections 2023-07-27T14:40:49.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/67102816 >> v2:172.21.15.159:3300/0 conn(0x7f72f80c5c50 0x7f72f8063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/67102816 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814ae00 0x7f72f8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/67102816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f814b1e0 0x7f72f8062b50 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 -- 172.21.15.115:0/67102816 >> 172.21.15.115:0/67102816 conn(0x7f72f805e940 msgr2=0x7f72f80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:49.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 -- 172.21.15.115:0/67102816 shutdown_connections 2023-07-27T14:40:49.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.094+0000 7f72ff5ff700 1 -- 172.21.15.115:0/67102816 wait complete. 2023-07-27T14:40:49.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.096+0000 7f72ff5ff700 1 Processor -- start 2023-07-27T14:40:49.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.096+0000 7f72ff5ff700 1 -- start start 2023-07-27T14:40:49.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72ff5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f80c5c50 0x7f72f8149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72ff5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f814ae00 0x7f72f80ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72ff5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814b1e0 0x7f72f80c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72ff5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80b0a10 con 0x7f72f80c5c50 2023-07-27T14:40:49.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72ff5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80adb60 con 0x7f72f814ae00 2023-07-27T14:40:49.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72ff5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80ae400 con 0x7f72f814b1e0 2023-07-27T14:40:49.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f80c5c50 0x7f72f8149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f80c5c50 0x7f72f8149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32938/0 (socket says 172.21.15.115:32938) 2023-07-27T14:40:49.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 -- 172.21.15.115:0/794847857 learned_addr learned my addr 172.21.15.115:0/794847857 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:49.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fcb9a700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f814ae00 0x7f72f80ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fdb9c700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814b1e0 0x7f72f80c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 -- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814b1e0 msgr2=0x7f72f80c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814b1e0 0x7f72f80c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 -- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f814ae00 msgr2=0x7f72f80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f814ae00 0x7f72f80ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 -- 172.21.15.115:0/794847857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8009370 con 0x7f72f80c5c50 2023-07-27T14:40:49.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fcb9a700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f814ae00 0x7f72f80ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:49.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.097+0000 7f72fd39b700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f80c5c50 0x7f72f8149960 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 rx=0x7f72f400d8c0 tx=0x7f72f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:49.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.098+0000 7f72ed7fa700 1 -- 172.21.15.115:0/794847857 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40095b0 con 0x7f72f80c5c50 2023-07-27T14:40:49.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.098+0000 7f72ed7fa700 1 -- 172.21.15.115:0/794847857 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4009710 con 0x7f72f80c5c50 2023-07-27T14:40:49.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.098+0000 7f72ed7fa700 1 -- 172.21.15.115:0/794847857 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4009a90 con 0x7f72f80c5c50 2023-07-27T14:40:49.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.098+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f80c5020 con 0x7f72f80c5c50 2023-07-27T14:40:49.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.098+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f80ae090 con 0x7f72f80c5c50 2023-07-27T14:40:49.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.099+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f80ae6e0 con 0x7f72f80c5c50 2023-07-27T14:40:49.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.100+0000 7f72ed7fa700 1 -- 172.21.15.115:0/794847857 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f72f4013480 con 0x7f72f80c5c50 2023-07-27T14:40:49.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.101+0000 7f72ed7fa700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72dc05fe20 0x7f72dc0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.101+0000 7f72ed7fa700 1 -- 172.21.15.115:0/794847857 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f72f407b220 con 0x7f72f80c5c50 2023-07-27T14:40:49.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.101+0000 7f72fcb9a700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72dc05fe20 0x7f72dc0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.102+0000 7f72fcb9a700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72dc05fe20 0x7f72dc0622e0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f72f80c1c00 tx=0x7f72e8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:49.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.105+0000 7f72ed7fa700 1 -- 172.21.15.115:0/794847857 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72f404b880 con 0x7f72f80c5c50 2023-07-27T14:40:49.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.274+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f72f80c4de0 con 0x7f72f80c5c50 2023-07-27T14:40:49.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.278+0000 7f72ed7fa700 1 -- 172.21.15.115:0/794847857 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72f80c4de0 con 0x7f72f80c5c50 2023-07-27T14:40:49.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72dc05fe20 msgr2=0x7f72dc0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72dc05fe20 0x7f72dc0622e0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f72f80c1c00 tx=0x7f72e8017000).stop 2023-07-27T14:40:49.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f80c5c50 msgr2=0x7f72f8149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f80c5c50 0x7f72f8149960 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 rx=0x7f72f400d8c0 tx=0x7f72f4008040).stop 2023-07-27T14:40:49.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 shutdown_connections 2023-07-27T14:40:49.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f72dc05fe20 0x7f72dc0622e0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f72f814b1e0 0x7f72f80c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72f80c5c50 0x7f72f8149960 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 --2- 172.21.15.115:0/794847857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f814ae00 0x7f72f80ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 >> 172.21.15.115:0/794847857 conn(0x7f72f805e940 msgr2=0x7f72f80c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:49.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.280+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 shutdown_connections 2023-07-27T14:40:49.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.281+0000 7f72ff5ff700 1 -- 172.21.15.115:0/794847857 wait complete. 2023-07-27T14:40:49.355 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-27T14:40:49.355 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:40:49.452 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-27T14:40:49.557 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-27T14:40:49.557 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-27T14:40:49.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:40:49.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.688+0000 7ffb323ff700 1 Processor -- start 2023-07-27T14:40:49.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.689+0000 7ffb323ff700 1 -- start start 2023-07-27T14:40:49.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.690+0000 7ffb323ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffb2c153ec0 0x7ffb2c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.690+0000 7ffb323ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb2c0aaa40 0x7ffb2c0c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.690+0000 7ffb323ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c0aa4d0 con 0x7ffb2c0aa050 2023-07-27T14:40:49.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.690+0000 7ffb323ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0c05c0 con 0x7ffb2c0aaa40 2023-07-27T14:40:49.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.690+0000 7ffb323ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0bfc90 con 0x7ffb2c153ec0 2023-07-27T14:40:49.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.690+0000 7ffb3099c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb2c0aaa40 0x7ffb2c0c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb3099c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb2c0aaa40 0x7ffb2c0c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32940/0 (socket says 172.21.15.115:32940) 2023-07-27T14:40:49.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb3099c700 1 -- 172.21.15.115:0/3432229982 learned_addr learned my addr 172.21.15.115:0/3432229982 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:49.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb2bfff700 1 --2- 172.21.15.115:0/3432229982 >> v2:172.21.15.159:3300/0 conn(0x7ffb2c153ec0 0x7ffb2c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb3099c700 1 -- 172.21.15.115:0/3432229982 >> v2:172.21.15.159:3300/0 conn(0x7ffb2c153ec0 msgr2=0x7ffb2c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:49.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb3099c700 1 --2- 172.21.15.115:0/3432229982 >> v2:172.21.15.159:3300/0 conn(0x7ffb2c153ec0 0x7ffb2c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb3099c700 1 -- 172.21.15.115:0/3432229982 >> v1:172.21.15.159:6789/0 conn(0x7ffb2c0aa050 legacy=0x7ffb2c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb3099c700 1 -- 172.21.15.115:0/3432229982 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0bff70 con 0x7ffb2c0aaa40 2023-07-27T14:40:49.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb2bfff700 1 --2- 172.21.15.115:0/3432229982 >> v2:172.21.15.159:3300/0 conn(0x7ffb2c153ec0 0x7ffb2c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:49.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb3099c700 1 --2- 172.21.15.115:0/3432229982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c0aaa40 0x7ffb2c0c0a50 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 rx=0x7ffb2c083e30 tx=0x7ffb24009840).ready entity=mon.0 client_cookie=72034b85a49ae248 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:49.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb2affd700 1 -- 172.21.15.115:0/3432229982 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400e070 con 0x7ffb2c0aaa40 2023-07-27T14:40:49.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb2affd700 1 -- 172.21.15.115:0/3432229982 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2400ba50 con 0x7ffb2c0aaa40 2023-07-27T14:40:49.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.691+0000 7ffb2affd700 1 -- 172.21.15.115:0/3432229982 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400bdd0 con 0x7ffb2c0aaa40 2023-07-27T14:40:49.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.692+0000 7ffb323ff700 1 -- 172.21.15.115:0/3432229982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c0aaa40 msgr2=0x7ffb2c0c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.692+0000 7ffb323ff700 1 --2- 172.21.15.115:0/3432229982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c0aaa40 0x7ffb2c0c0a50 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 rx=0x7ffb2c083e30 tx=0x7ffb24009840).stop 2023-07-27T14:40:49.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.692+0000 7ffb323ff700 1 -- 172.21.15.115:0/3432229982 shutdown_connections 2023-07-27T14:40:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.692+0000 7ffb323ff700 1 --2- 172.21.15.115:0/3432229982 >> v2:172.21.15.159:3300/0 conn(0x7ffb2c153ec0 0x7ffb2c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.692+0000 7ffb323ff700 1 --2- 172.21.15.115:0/3432229982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c0aaa40 0x7ffb2c0c0a50 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.692+0000 7ffb323ff700 1 -- 172.21.15.115:0/3432229982 >> 172.21.15.115:0/3432229982 conn(0x7ffb2c0cb610 msgr2=0x7ffb2c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.692+0000 7ffb323ff700 1 -- 172.21.15.115:0/3432229982 shutdown_connections 2023-07-27T14:40:49.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.692+0000 7ffb323ff700 1 -- 172.21.15.115:0/3432229982 wait complete. 2023-07-27T14:40:49.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.693+0000 7ffb323ff700 1 Processor -- start 2023-07-27T14:40:49.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.694+0000 7ffb323ff700 1 -- start start 2023-07-27T14:40:49.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.694+0000 7ffb323ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb2c0aa050 0x7ffb2c142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.694+0000 7ffb323ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb2c0aaa40 0x7ffb2c0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.694+0000 7ffb323ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c153ec0 0x7ffb2c0ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.694+0000 7ffb323ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c1506d0 con 0x7ffb2c153ec0 2023-07-27T14:40:49.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.694+0000 7ffb323ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0ab800 con 0x7ffb2c0aa050 2023-07-27T14:40:49.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.694+0000 7ffb323ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0add70 con 0x7ffb2c0aaa40 2023-07-27T14:40:49.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c153ec0 0x7ffb2c0ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c153ec0 0x7ffb2c0ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32954/0 (socket says 172.21.15.115:32954) 2023-07-27T14:40:49.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 -- 172.21.15.115:0/182331142 learned_addr learned my addr 172.21.15.115:0/182331142 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:49.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb2bfff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb2c0aa050 0x7ffb2c142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb2b7fe700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb2c0aaa40 0x7ffb2c0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 -- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb2c0aaa40 msgr2=0x7ffb2c0aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb2c0aaa40 0x7ffb2c0aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 -- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb2c0aa050 msgr2=0x7ffb2c142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb2c0aa050 0x7ffb2c142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 -- 172.21.15.115:0/182331142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009ae0 con 0x7ffb2c153ec0 2023-07-27T14:40:49.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb2b7fe700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb2c0aaa40 0x7ffb2c0aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:49.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb3099c700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c153ec0 0x7ffb2c0ab310 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 rx=0x7ffb24009fd0 tx=0x7ffb24009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:49.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.695+0000 7ffb13fff700 1 -- 172.21.15.115:0/182331142 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240032d0 con 0x7ffb2c153ec0 2023-07-27T14:40:49.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.696+0000 7ffb13fff700 1 -- 172.21.15.115:0/182331142 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb24013e30 con 0x7ffb2c153ec0 2023-07-27T14:40:49.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.696+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c1528c0 con 0x7ffb2c153ec0 2023-07-27T14:40:49.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.696+0000 7ffb13fff700 1 -- 172.21.15.115:0/182331142 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2401d620 con 0x7ffb2c153ec0 2023-07-27T14:40:49.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.696+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c152e80 con 0x7ffb2c153ec0 2023-07-27T14:40:49.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.697+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c1530a0 con 0x7ffb2c153ec0 2023-07-27T14:40:49.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.697+0000 7ffb13fff700 1 -- 172.21.15.115:0/182331142 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7ffb2401b040 con 0x7ffb2c153ec0 2023-07-27T14:40:49.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.698+0000 7ffb13fff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb1805fe20 0x7ffb180622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:49.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.698+0000 7ffb13fff700 1 -- 172.21.15.115:0/182331142 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5411+0+0 (secure 0 0 0) 0x7ffb2407cca0 con 0x7ffb2c153ec0 2023-07-27T14:40:49.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.698+0000 7ffb2bfff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb1805fe20 0x7ffb180622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:49.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.699+0000 7ffb2bfff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb1805fe20 0x7ffb180622e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7ffb1c006fd0 tx=0x7ffb1c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:49.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.702+0000 7ffb13fff700 1 -- 172.21.15.115:0/182331142 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffb2404d360 con 0x7ffb2c153ec0 2023-07-27T14:40:49.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.914+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb2c06c470 con 0x7ffb2c153ec0 2023-07-27T14:40:49.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.914+0000 7ffb13fff700 1 -- 172.21.15.115:0/182331142 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+3547 (secure 0 0 0) 0x7ffb24050980 con 0x7ffb2c153ec0 2023-07-27T14:40:49.972 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:49.972 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":115,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/3608226418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":3608226418},{"type":"v1","addr":"172.21.15.115:6837","nonce":3608226418}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/1351642564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1351642564},{"type":"v1","addr":"172.21.15.159:6834","nonce":1351642564}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":9118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3601251920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":3601251920},{"type":"v1","addr":"172.21.15.159:6835","nonce":3601251920}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":10386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3139755816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3139755816},{"type":"v1","addr":"172.21.15.115:6835","nonce":3139755816}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[]} 2023-07-27T14:40:49.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb1805fe20 msgr2=0x7ffb180622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb1805fe20 0x7ffb180622e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7ffb1c006fd0 tx=0x7ffb1c008040).stop 2023-07-27T14:40:49.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c153ec0 msgr2=0x7ffb2c0ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:49.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c153ec0 0x7ffb2c0ab310 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 rx=0x7ffb24009fd0 tx=0x7ffb24009840).stop 2023-07-27T14:40:49.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 shutdown_connections 2023-07-27T14:40:49.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ffb1805fe20 0x7ffb180622e0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb2c153ec0 0x7ffb2c0ab310 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb2c0aa050 0x7ffb2c142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 --2- 172.21.15.115:0/182331142 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffb2c0aaa40 0x7ffb2c0aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:49.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 >> 172.21.15.115:0/182331142 conn(0x7ffb2c0cb610 msgr2=0x7ffb2c1591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:49.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 shutdown_connections 2023-07-27T14:40:49.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:49.917+0000 7ffb323ff700 1 -- 172.21.15.115:0/182331142 wait complete. 2023-07-27T14:40:49.976 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 115 2023-07-27T14:40:49.991 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-27T14:40:49.991 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-27T14:40:49.992 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-27T14:40:49.992 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:40:49.992 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-27T14:40:49.992 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-27T14:40:49.993 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-27T14:40:49.993 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:40:49.993 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-27T14:40:49.993 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-27T14:40:49.994 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-27T14:40:49.994 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:40:49.994 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-27T14:40:49.994 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-27T14:40:49.994 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-27T14:40:49.995 INFO:teuthology.orchestra.run:waiting for 300 2023-07-27T14:40:50.006 INFO:tasks.ceph.mds.a:Stopped 2023-07-27T14:40:50.006 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-27T14:40:50.007 INFO:tasks.ceph.mds.c:Stopped 2023-07-27T14:40:50.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-27T14:40:50.014 INFO:tasks.ceph.mds.d:Stopped 2023-07-27T14:40:50.014 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-27T14:40:50.051 INFO:tasks.ceph.mds.a:Started 2023-07-27T14:40:50.052 DEBUG:teuthology.parallel:result is None 2023-07-27T14:40:50.054 INFO:tasks.ceph.mds.c:Started 2023-07-27T14:40:50.054 DEBUG:teuthology.parallel:result is None 2023-07-27T14:40:50.059 INFO:tasks.ceph.mds.d:Started 2023-07-27T14:40:50.059 DEBUG:teuthology.parallel:result is None 2023-07-27T14:40:50.191 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-07-27T14:40:50.191 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-07-27T14:40:50.205 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-07-27T14:40:52.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-27T14:40:56.014 INFO:tasks.ceph.mds.b:Stopped 2023-07-27T14:40:56.015 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-27T14:40:56.019 INFO:tasks.ceph.mds.b:Started 2023-07-27T14:40:56.020 DEBUG:teuthology.parallel:result is None 2023-07-27T14:40:56.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-27T14:40:56.165 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-07-27T14:40:56.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.164+0000 7f89c05ff700 1 Processor -- start 2023-07-27T14:40:56.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.164+0000 7f89c05ff700 1 -- start start 2023-07-27T14:40:56.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.165+0000 7f89c05ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:56.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.165+0000 7f89c05ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89b80aaa40 0x7f89b80c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:56.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.165+0000 7f89c05ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b80aa4d0 con 0x7f89b80aa050 2023-07-27T14:40:56.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.165+0000 7f89c05ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80c05c0 con 0x7f89b80aaa40 2023-07-27T14:40:56.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.165+0000 7f89c05ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80bfc90 con 0x7f89b8153ec0 2023-07-27T14:40:56.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89bdb9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f89b80aa050 0x7f89b80640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33260/0 (socket says 172.21.15.115:33260) 2023-07-27T14:40:56.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89bdb9a700 1 -- 172.21.15.115:0/1552217757 learned_addr learned my addr 172.21.15.115:0/1552217757 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:56.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89be39b700 1 --2- 172.21.15.115:0/1552217757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:56.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89beb9c700 1 --2- 172.21.15.115:0/1552217757 >> v2:172.21.15.159:3300/0 conn(0x7f89b80aaa40 0x7f89b80c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:56.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89bd399700 1 -- 172.21.15.115:0/1552217757 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531799399 0 0) 0x7f89a8001110 con 0x7f89b80aa050 2023-07-27T14:40:56.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89bd399700 1 -- 172.21.15.115:0/1552217757 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a40033f0 con 0x7f89b80aa050 2023-07-27T14:40:56.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89be39b700 1 -- 172.21.15.115:0/1552217757 >> v2:172.21.15.159:3300/0 conn(0x7f89b80aaa40 msgr2=0x7f89b80c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:56.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89be39b700 1 --2- 172.21.15.115:0/1552217757 >> v2:172.21.15.159:3300/0 conn(0x7f89b80aaa40 0x7f89b80c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:56.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89be39b700 1 -- 172.21.15.115:0/1552217757 >> v1:172.21.15.115:6789/0 conn(0x7f89b80aa050 legacy=0x7f89b80640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:56.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89be39b700 1 -- 172.21.15.115:0/1552217757 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80bff70 con 0x7f89b8153ec0 2023-07-27T14:40:56.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89beb9c700 1 --2- 172.21.15.115:0/1552217757 >> v2:172.21.15.159:3300/0 conn(0x7f89b80aaa40 0x7f89b80c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:56.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.166+0000 7f89be39b700 1 --2- 172.21.15.115:0/1552217757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80a9b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f89b4009760 tx=0x7f89b4009060).ready entity=mon.2 client_cookie=87c6e6210743bf5b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:56.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89bd399700 1 -- 172.21.15.115:0/1552217757 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400d4a0 con 0x7f89b8153ec0 2023-07-27T14:40:56.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89bd399700 1 -- 172.21.15.115:0/1552217757 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b400d600 con 0x7f89b8153ec0 2023-07-27T14:40:56.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89bd399700 1 -- 172.21.15.115:0/1552217757 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400d980 con 0x7f89b8153ec0 2023-07-27T14:40:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89c05ff700 1 -- 172.21.15.115:0/1552217757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 msgr2=0x7f89b80a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1552217757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80a9b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f89b4009760 tx=0x7f89b4009060).stop 2023-07-27T14:40:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89c05ff700 1 -- 172.21.15.115:0/1552217757 shutdown_connections 2023-07-27T14:40:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1552217757 >> v2:172.21.15.159:3300/0 conn(0x7f89b80aaa40 0x7f89b80c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1552217757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80a9b60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89c05ff700 1 -- 172.21.15.115:0/1552217757 >> 172.21.15.115:0/1552217757 conn(0x7f89b80cb610 msgr2=0x7f89b80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89c05ff700 1 -- 172.21.15.115:0/1552217757 shutdown_connections 2023-07-27T14:40:56.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.167+0000 7f89c05ff700 1 -- 172.21.15.115:0/1552217757 wait complete. 2023-07-27T14:40:56.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.169+0000 7f89c05ff700 1 Processor -- start 2023-07-27T14:40:56.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.169+0000 7f89c05ff700 1 -- start start 2023-07-27T14:40:56.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89c05ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b80aa050 0x7f89b8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89c05ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b80aaa40 0x7f89b80c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89c05ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89c05ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8165f30 con 0x7f89b80aaa40 2023-07-27T14:40:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89c05ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8143070 con 0x7f89b80aa050 2023-07-27T14:40:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89c05ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8165320 con 0x7f89b8153ec0 2023-07-27T14:40:56.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89bdb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b80aaa40 0x7f89b80c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89bdb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b80aaa40 0x7f89b80c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51488/0 (socket says 172.21.15.115:51488) 2023-07-27T14:40:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89bdb9a700 1 -- 172.21.15.115:0/1849423353 learned_addr learned my addr 172.21.15.115:0/1849423353 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89be39b700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b80aa050 0x7f89b8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.170+0000 7f89beb9c700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89bdb9a700 1 -- 172.21.15.115:0/1849423353 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 msgr2=0x7f89b80aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89bdb9a700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:56.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89bdb9a700 1 -- 172.21.15.115:0/1849423353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b80aa050 msgr2=0x7f89b8142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89bdb9a700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b80aa050 0x7f89b8142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89bdb9a700 1 -- 172.21.15.115:0/1849423353 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0009a20 con 0x7f89b80aaa40 2023-07-27T14:40:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89bdb9a700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b80aaa40 0x7f89b80c4780 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 rx=0x7f89a8005750 tx=0x7f89a8007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89ae7fc700 1 -- 172.21.15.115:0/1849423353 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80070d0 con 0x7f89b80aaa40 2023-07-27T14:40:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89ae7fc700 1 -- 172.21.15.115:0/1849423353 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8007230 con 0x7f89b80aaa40 2023-07-27T14:40:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89ae7fc700 1 -- 172.21.15.115:0/1849423353 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80075d0 con 0x7f89b80aaa40 2023-07-27T14:40:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b40092a0 con 0x7f89b80aaa40 2023-07-27T14:40:56.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.171+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b81658e0 con 0x7f89b80aaa40 2023-07-27T14:40:56.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.172+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b81660a0 con 0x7f89b80aaa40 2023-07-27T14:40:56.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.173+0000 7f89ae7fc700 1 -- 172.21.15.115:0/1849423353 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f89a8010070 con 0x7f89b80aaa40 2023-07-27T14:40:56.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.174+0000 7f89ae7fc700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f899c05fe20 0x7f899c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:56.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.174+0000 7f89ae7fc700 1 -- 172.21.15.115:0/1849423353 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 5383+0+0 (secure 0 0 0) 0x7f89a807a710 con 0x7f89b80aaa40 2023-07-27T14:40:56.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.174+0000 7f89be39b700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f899c05fe20 0x7f899c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:56.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.174+0000 7f89be39b700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f899c05fe20 0x7f899c0622e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f89b400d260 tx=0x7f89b4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:56.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.178+0000 7f89ae7fc700 1 -- 172.21.15.115:0/1849423353 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89a804adf0 con 0x7f89b80aaa40 2023-07-27T14:40:56.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:56.362+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f89b80aa4d0 con 0x7f89b80aaa40 2023-07-27T14:40:57.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.132+0000 7f89ae7fc700 1 -- 172.21.15.115:0/1849423353 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v214) v1 ==== 97+0+0 (secure 0 0 0) 0x7f89b80aa4d0 con 0x7f89b80aaa40 2023-07-27T14:40:57.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f899c05fe20 msgr2=0x7f899c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f899c05fe20 0x7f899c0622e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f89b400d260 tx=0x7f89b4016000).stop 2023-07-27T14:40:57.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b80aaa40 msgr2=0x7f89b80c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b80aaa40 0x7f89b80c4780 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 rx=0x7f89a8005750 tx=0x7f89a8007a70).stop 2023-07-27T14:40:57.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 shutdown_connections 2023-07-27T14:40:57.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f899c05fe20 0x7f899c0622e0 secure :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0x7f89b400d260 tx=0x7f89b4016000).stop 2023-07-27T14:40:57.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89b8153ec0 0x7f89b80aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89b80aa050 0x7f89b8142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 --2- 172.21.15.115:0/1849423353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89b80aaa40 0x7f89b80c4780 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 >> 172.21.15.115:0/1849423353 conn(0x7f89b80cb610 msgr2=0x7f89b80640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:57.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.134+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 shutdown_connections 2023-07-27T14:40:57.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.135+0000 7f89c05ff700 1 -- 172.21.15.115:0/1849423353 wait complete. 2023-07-27T14:40:57.194 INFO:teuthology.orchestra.run.smithi115.stderr: removed all blocklist entries 2023-07-27T14:40:57.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-27T14:40:57.399 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.342+0000 7fd80dbff700 1 Processor -- start 2023-07-27T14:40:57.400 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.343+0000 7fd80dbff700 1 -- start start 2023-07-27T14:40:57.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.344+0000 7fd80dbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8080a4cc0 0x7fd8080bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.344+0000 7fd80dbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080639d0 con 0x7fd8080a4840 2023-07-27T14:40:57.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.344+0000 7fd80dbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080a5150 con 0x7fd808151bd0 2023-07-27T14:40:57.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.344+0000 7fd80dbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd808137610 con 0x7fd8080a4cc0 2023-07-27T14:40:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.344+0000 7fd807fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8080a4cc0 0x7fd8080bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.344+0000 7fd806ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd8080a4840 0x7fd8080bc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33266/0 (socket says 172.21.15.115:33266) 2023-07-27T14:40:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.344+0000 7fd806ffd700 1 -- 172.21.15.115:0/1101087049 learned_addr learned my addr 172.21.15.115:0/1101087049 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.345+0000 7fd807fff700 1 -- 172.21.15.115:0/1101087049 >> v1:172.21.15.159:6789/0 conn(0x7fd808151bd0 legacy=0x7fd808062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.345+0000 7fd807fff700 1 -- 172.21.15.115:0/1101087049 >> v1:172.21.15.115:6789/0 conn(0x7fd8080a4840 legacy=0x7fd8080bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.345+0000 7fd807fff700 1 -- 172.21.15.115:0/1101087049 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808062dc0 con 0x7fd8080a4cc0 2023-07-27T14:40:57.402 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.345+0000 7fd8067fc700 1 -- 172.21.15.115:0/1101087049 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777475939 0 0) 0x7fd8080639d0 con 0x7fd8080a4840 2023-07-27T14:40:57.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.345+0000 7fd807fff700 1 --2- 172.21.15.115:0/1101087049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4cc0 0x7fd8080bc760 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 rx=0x7fd800009e60 tx=0x7fd800009780).ready entity=mon.0 client_cookie=984b65429a9eb47b server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.345+0000 7fd8067fc700 1 -- 172.21.15.115:0/1101087049 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000e070 con 0x7fd8080a4cc0 2023-07-27T14:40:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.345+0000 7fd8067fc700 1 -- 172.21.15.115:0/1101087049 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80000bc30 con 0x7fd8080a4cc0 2023-07-27T14:40:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.345+0000 7fd8067fc700 1 -- 172.21.15.115:0/1101087049 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800012410 con 0x7fd8080a4cc0 2023-07-27T14:40:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.346+0000 7fd80dbff700 1 -- 172.21.15.115:0/1101087049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4cc0 msgr2=0x7fd8080bc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.346+0000 7fd80dbff700 1 --2- 172.21.15.115:0/1101087049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4cc0 0x7fd8080bc760 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 rx=0x7fd800009e60 tx=0x7fd800009780).stop 2023-07-27T14:40:57.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.346+0000 7fd80dbff700 1 -- 172.21.15.115:0/1101087049 shutdown_connections 2023-07-27T14:40:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.346+0000 7fd80dbff700 1 --2- 172.21.15.115:0/1101087049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4cc0 0x7fd8080bc760 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.346+0000 7fd80dbff700 1 -- 172.21.15.115:0/1101087049 >> 172.21.15.115:0/1101087049 conn(0x7fd808064700 msgr2=0x7fd808064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.346+0000 7fd80dbff700 1 -- 172.21.15.115:0/1101087049 shutdown_connections 2023-07-27T14:40:57.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.346+0000 7fd80dbff700 1 -- 172.21.15.115:0/1101087049 wait complete. 2023-07-27T14:40:57.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.348+0000 7fd80dbff700 1 Processor -- start 2023-07-27T14:40:57.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.348+0000 7fd80dbff700 1 -- start start 2023-07-27T14:40:57.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.349+0000 7fd80dbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4840 0x7fd808135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.349+0000 7fd80dbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080a4cc0 0x7fd8081535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.349+0000 7fd80dbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd808151bd0 0x7fd808153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.349+0000 7fd80dbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808153fc0 con 0x7fd8080a4840 2023-07-27T14:40:57.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.349+0000 7fd80dbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80813c850 con 0x7fd8080a4cc0 2023-07-27T14:40:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.349+0000 7fd80dbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80813c240 con 0x7fd808151bd0 2023-07-27T14:40:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.349+0000 7fd8077fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4840 0x7fd808135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd8077fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4840 0x7fd808135dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51500/0 (socket says 172.21.15.115:51500) 2023-07-27T14:40:57.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd8077fe700 1 -- 172.21.15.115:0/1912959983 learned_addr learned my addr 172.21.15.115:0/1912959983 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd8077fe700 1 -- 172.21.15.115:0/1912959983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd808151bd0 msgr2=0x7fd808153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd8077fe700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd808151bd0 0x7fd808153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd8077fe700 1 -- 172.21.15.115:0/1912959983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080a4cc0 msgr2=0x7fd8081535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd806ffd700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080a4cc0 0x7fd8081535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd8077fe700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080a4cc0 0x7fd8081535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd8077fe700 1 -- 172.21.15.115:0/1912959983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009a20 con 0x7fd8080a4840 2023-07-27T14:40:57.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd806ffd700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080a4cc0 0x7fd8081535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd8077fe700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4840 0x7fd808135dd0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 rx=0x7fd7f800c4c0 tx=0x7fd7f8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd7ef7fe700 1 -- 172.21.15.115:0/1912959983 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8007020 con 0x7fd8080a4840 2023-07-27T14:40:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd7ef7fe700 1 -- 172.21.15.115:0/1912959983 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8001e90 con 0x7fd8080a4840 2023-07-27T14:40:57.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8080a8320 con 0x7fd8080a4840 2023-07-27T14:40:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd7ef7fe700 1 -- 172.21.15.115:0/1912959983 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80073b0 con 0x7fd8080a4840 2023-07-27T14:40:57.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.350+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80813c4e0 con 0x7fd8080a4840 2023-07-27T14:40:57.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.352+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd808159890 con 0x7fd8080a4840 2023-07-27T14:40:57.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.353+0000 7fd7ef7fe700 1 -- 172.21.15.115:0/1912959983 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fd7f8010070 con 0x7fd8080a4840 2023-07-27T14:40:57.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.354+0000 7fd7ef7fe700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7f405fe20 0x7fd7f40622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.354+0000 7fd7ef7fe700 1 -- 172.21.15.115:0/1912959983 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fd7f807ac20 con 0x7fd8080a4840 2023-07-27T14:40:57.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.354+0000 7fd806ffd700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7f405fe20 0x7fd7f40622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.355+0000 7fd806ffd700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7f405fe20 0x7fd7f40622e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fd808154270 tx=0x7fd7fc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:57.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.358+0000 7fd7ef7fe700 1 -- 172.21.15.115:0/1912959983 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7f804b350 con 0x7fd8080a4840 2023-07-27T14:40:57.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.588+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd80806c470 con 0x7fd8080a4840 2023-07-27T14:40:57.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.589+0000 7fd7ef7fe700 1 -- 172.21.15.115:0/1912959983 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd7f804e970 con 0x7fd8080a4840 2023-07-27T14:40:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:57.646 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:40:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "auth_dump": [ 2023-07-27T14:40:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.a", 2023-07-27T14:40:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkZgGQIhAA6hVMTYZzAoRItTCN6TCUxw==", 2023-07-27T14:40:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:40:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:40:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:40:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.b", 2023-07-27T14:40:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJk9qmkORAADORrqsssktU+rEa327ZmMA==", 2023-07-27T14:40:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:40:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:40:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:40:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.c", 2023-07-27T14:40:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJkR9TILRAAEKCD9kyM34GdAaHPLDs5gA==", 2023-07-27T14:40:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:40:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:40:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:40:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mds.d", 2023-07-27T14:40:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJk/ASRCRAAQXcr0IF2d0rrAiidpNb/cw==", 2023-07-27T14:40:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:40:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:40:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:40:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.0", 2023-07-27T14:40:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB/fsJkSz5TCxAAUUzWqbUButNGDLm4PViLoA==", 2023-07-27T14:40:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:40:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:40:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.1", 2023-07-27T14:40:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCCfsJk9Cf/HBAAMf3PiPsK7z9/rTPTbzRfFQ==", 2023-07-27T14:40:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:40:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:40:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.2", 2023-07-27T14:40:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCFfsJkMybALhAA6y9VXm76+RV7GRNubebKcQ==", 2023-07-27T14:40:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:40:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:40:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.3", 2023-07-27T14:40:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCJfsJkll9VBBAA1ZLzRX+vuro+O7rQa/in/w==", 2023-07-27T14:40:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:40:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:40:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.4", 2023-07-27T14:40:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCPfsJk/HOdKRAAj2dNRQuhojPLF9MgENh1mg==", 2023-07-27T14:40:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:40:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:40:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.5", 2023-07-27T14:40:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCSfsJkZfN6OxAAMWKddrOE5/j+igqQKwT/oA==", 2023-07-27T14:40:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:40:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:40:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.6", 2023-07-27T14:40:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCWfsJkq9hsERAAeYN+Llluzt+pT3sXQ7JNZg==", 2023-07-27T14:40:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:40:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:40:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "osd.7", 2023-07-27T14:40:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQCZfsJkMD4pIxAAFCflOC8sZ8lWtut6rtv6gg==", 2023-07-27T14:40:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow profile osd", 2023-07-27T14:40:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile osd", 2023-07-27T14:40:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.0", 2023-07-27T14:40:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkEd1yExAAGPI3bwm+C2CZF4g8ICYjDg==", 2023-07-27T14:40:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:40:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow r", 2023-07-27T14:40:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-27T14:40:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.1", 2023-07-27T14:40:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkkgCcIRAA5w5S8zRfdfVeSa0xgonL+g==", 2023-07-27T14:40:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:40:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:40:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:40:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:40:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.2", 2023-07-27T14:40:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkGwt6GhAAW2bcavoSTOFXYTJ5Fj8kBg==", 2023-07-27T14:40:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:40:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:40:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:40:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:40:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.3", 2023-07-27T14:40:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB7fsJkmv7HKBAAeMh5M9uvsnFDg2yJ6epoLQ==", 2023-07-27T14:40:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow", 2023-07-27T14:40:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow r", 2023-07-27T14:40:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow rw", 2023-07-27T14:40:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow rwx" 2023-07-27T14:40:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "client.admin", 2023-07-27T14:40:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB4fsJk4as4IxAAGMt5aX+2gwew76TMhLOSFw==", 2023-07-27T14:40:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:40:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": "allow *", 2023-07-27T14:40:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow *", 2023-07-27T14:40:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.x", 2023-07-27T14:40:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB6fsJksCnJGhAA8hl5XwDhtTfipI3mKefzug==", 2023-07-27T14:40:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:40:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:40:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "entity": "mgr.y", 2023-07-27T14:40:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "key": "AQB5fsJkBGKEDhAA/BYlY6MMV4ux9ndfNuh9pg==", 2023-07-27T14:40:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": { 2023-07-27T14:40:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": "allow *", 2023-07-27T14:40:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": "allow profile mgr", 2023-07-27T14:40:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": "allow *" 2023-07-27T14:40:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2023-07-27T14:40:57.670 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:40:57.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7f405fe20 msgr2=0x7fd7f40622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7f405fe20 0x7fd7f40622e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fd808154270 tx=0x7fd7fc009040).stop 2023-07-27T14:40:57.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4840 msgr2=0x7fd808135dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4840 0x7fd808135dd0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 rx=0x7fd7f800c4c0 tx=0x7fd7f8007e00).stop 2023-07-27T14:40:57.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 shutdown_connections 2023-07-27T14:40:57.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd7f405fe20 0x7fd7f40622e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd808151bd0 0x7fd808153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:40:57.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8080a4840 0x7fd808135dd0 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 --2- 172.21.15.115:0/1912959983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8080a4cc0 0x7fd8081535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 >> 172.21.15.115:0/1912959983 conn(0x7fd808064700 msgr2=0x7fd808136760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:57.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 shutdown_connections 2023-07-27T14:40:57.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.591+0000 7fd80dbff700 1 -- 172.21.15.115:0/1912959983 wait complete. 2023-07-27T14:40:57.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:40:57.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.804+0000 7f73d3dff700 1 Processor -- start 2023-07-27T14:40:57.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.804+0000 7f73d3dff700 1 -- start start 2023-07-27T14:40:57.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d3dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73cc0aaa40 0x7f73cc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d3dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc1542a0 0x7f73cc0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d3dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc0aa4d0 con 0x7f73cc153ec0 2023-07-27T14:40:57.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d3dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc064ad0 con 0x7f73cc0aaa40 2023-07-27T14:40:57.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d3dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0c05c0 con 0x7f73cc1542a0 2023-07-27T14:40:57.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d239c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc1542a0 0x7f73cc0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d139a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73cc0aaa40 0x7f73cc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d139a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f73cc0aaa40 0x7f73cc0640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.115:60128/0 (socket says 172.21.15.115:60128) 2023-07-27T14:40:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d139a700 1 -- 172.21.15.115:0/3761277437 learned_addr learned my addr 172.21.15.115:0/3761277437 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.806+0000 7f73d239c700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc1542a0 0x7f73cc0645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:46466/0 (socket says 172.21.15.115:46466) 2023-07-27T14:40:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d139a700 1 -- 172.21.15.115:0/3761277437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc1542a0 msgr2=0x7f73cc0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:57.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d139a700 1 --2- 172.21.15.115:0/3761277437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc1542a0 0x7f73cc0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d139a700 1 -- 172.21.15.115:0/3761277437 >> v1:172.21.15.159:6789/0 conn(0x7f73cc153ec0 legacy=0x7f73cc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d0b99700 1 -- 172.21.15.115:0/3761277437 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307723661 0 0) 0x7f73c8001110 con 0x7f73cc153ec0 2023-07-27T14:40:57.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d139a700 1 -- 172.21.15.115:0/3761277437 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc0c1a60 con 0x7f73cc0aaa40 2023-07-27T14:40:57.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d239c700 1 --2- 172.21.15.115:0/3761277437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc1542a0 0x7f73cc0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:57.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d139a700 1 --2- 172.21.15.115:0/3761277437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 0x7f73cc0640f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f73bc006fd0 tx=0x7f73bc0090f0).ready entity=mon.1 client_cookie=d87be22cf88fd68e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:57.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d0b99700 1 -- 172.21.15.115:0/3761277437 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00b580 con 0x7f73cc0aaa40 2023-07-27T14:40:57.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d0b99700 1 -- 172.21.15.115:0/3761277437 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc00b6e0 con 0x7f73cc0aaa40 2023-07-27T14:40:57.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.807+0000 7f73d0b99700 1 -- 172.21.15.115:0/3761277437 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00ba60 con 0x7f73cc0aaa40 2023-07-27T14:40:57.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.808+0000 7f73d3dff700 1 -- 172.21.15.115:0/3761277437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 msgr2=0x7f73cc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.808+0000 7f73d3dff700 1 --2- 172.21.15.115:0/3761277437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 0x7f73cc0640f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f73bc006fd0 tx=0x7f73bc0090f0).stop 2023-07-27T14:40:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.808+0000 7f73d3dff700 1 -- 172.21.15.115:0/3761277437 shutdown_connections 2023-07-27T14:40:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.808+0000 7f73d3dff700 1 --2- 172.21.15.115:0/3761277437 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc1542a0 0x7f73cc0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.808+0000 7f73d3dff700 1 --2- 172.21.15.115:0/3761277437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 0x7f73cc0640f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.808+0000 7f73d3dff700 1 -- 172.21.15.115:0/3761277437 >> 172.21.15.115:0/3761277437 conn(0x7f73cc0cb610 msgr2=0x7f73cc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.808+0000 7f73d3dff700 1 -- 172.21.15.115:0/3761277437 shutdown_connections 2023-07-27T14:40:57.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.808+0000 7f73d3dff700 1 -- 172.21.15.115:0/3761277437 wait complete. 2023-07-27T14:40:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.809+0000 7f73d3dff700 1 Processor -- start 2023-07-27T14:40:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.810+0000 7f73d3dff700 1 -- start start 2023-07-27T14:40:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.810+0000 7f73d3dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 0x7f73cc1647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.810+0000 7f73d3dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc153ec0 0x7f73cc1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.810+0000 7f73d3dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73cc1542a0 0x7f73cc1513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.810+0000 7f73d3dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0adbd0 con 0x7f73cc1542a0 2023-07-27T14:40:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.810+0000 7f73d3dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc164de0 con 0x7f73cc0aaa40 2023-07-27T14:40:57.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.810+0000 7f73d3dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc1650c0 con 0x7f73cc153ec0 2023-07-27T14:40:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73cc1542a0 0x7f73cc1513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73cc1542a0 0x7f73cc1513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51506/0 (socket says 172.21.15.115:51506) 2023-07-27T14:40:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 -- 172.21.15.115:0/2824400481 learned_addr learned my addr 172.21.15.115:0/2824400481 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d139a700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc153ec0 0x7f73cc1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d1b9b700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 0x7f73cc1647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 -- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc153ec0 msgr2=0x7f73cc1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc153ec0 0x7f73cc1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 -- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 msgr2=0x7f73cc1647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:57.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 0x7f73cc1647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:57.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 -- 172.21.15.115:0/2824400481 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4009a20 con 0x7f73cc1542a0 2023-07-27T14:40:57.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d139a700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc153ec0 0x7f73cc1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:57.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.811+0000 7f73d239c700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73cc1542a0 0x7f73cc1513a0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 rx=0x7f73c4009ec0 tx=0x7f73c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.812+0000 7f73c1ffb700 1 -- 172.21.15.115:0/2824400481 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c400cc20 con 0x7f73cc1542a0 2023-07-27T14:40:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.812+0000 7f73c1ffb700 1 -- 172.21.15.115:0/2824400481 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c400f040 con 0x7f73cc1542a0 2023-07-27T14:40:57.872 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.812+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc009370 con 0x7f73cc1542a0 2023-07-27T14:40:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.812+0000 7f73c1ffb700 1 -- 172.21.15.115:0/2824400481 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4013400 con 0x7f73cc1542a0 2023-07-27T14:40:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.812+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc165680 con 0x7f73cc1542a0 2023-07-27T14:40:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.813+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc06c470 con 0x7f73cc1542a0 2023-07-27T14:40:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.814+0000 7f73c1ffb700 1 -- 172.21.15.115:0/2824400481 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f73c40137b0 con 0x7f73cc1542a0 2023-07-27T14:40:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.814+0000 7f73c1ffb700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73b005fe20 0x7f73b00622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.815+0000 7f73c1ffb700 1 -- 172.21.15.115:0/2824400481 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f73c407bc10 con 0x7f73cc1542a0 2023-07-27T14:40:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.815+0000 7f73d1b9b700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73b005fe20 0x7f73b00622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:57.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.815+0000 7f73d1b9b700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73b005fe20 0x7f73b00622e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f73c8007fd0 tx=0x7f73c8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:57.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.819+0000 7f73c1ffb700 1 -- 172.21.15.115:0/2824400481 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73c404c450 con 0x7f73cc1542a0 2023-07-27T14:40:58.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.988+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73cc062540 con 0x7f73cc1542a0 2023-07-27T14:40:58.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.989+0000 7f73c1ffb700 1 -- 172.21.15.115:0/2824400481 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v214) v1 ==== 74+0+13910 (secure 0 0 0) 0x7f73c404fa70 con 0x7f73cc1542a0 2023-07-27T14:40:58.046 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:58.046 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":214,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:40:57.128289+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:40:58.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73b005fe20 msgr2=0x7f73b00622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73b005fe20 0x7f73b00622e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f73c8007fd0 tx=0x7f73c8009040).stop 2023-07-27T14:40:58.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73cc1542a0 msgr2=0x7f73cc1513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73cc1542a0 0x7f73cc1513a0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 rx=0x7f73c4009ec0 tx=0x7f73c400b040).stop 2023-07-27T14:40:58.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 shutdown_connections 2023-07-27T14:40:58.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f73b005fe20 0x7f73b00622e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73cc1542a0 0x7f73cc1513a0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73cc0aaa40 0x7f73cc1647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 --2- 172.21.15.115:0/2824400481 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f73cc153ec0 0x7f73cc1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.991+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 >> 172.21.15.115:0/2824400481 conn(0x7f73cc0cb610 msgr2=0x7f73cc0ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:58.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.992+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 shutdown_connections 2023-07-27T14:40:58.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:57.992+0000 7f73d3dff700 1 -- 172.21.15.115:0/2824400481 wait complete. 2023-07-27T14:40:58.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-07-27T14:26:52.614088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-27T14:26:54.184416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-07-27T14:40:58.066 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-07-27T14:40:58.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.202+0000 7f90057ff700 1 Processor -- start 2023-07-27T14:40:58.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.202+0000 7f90057ff700 1 -- start start 2023-07-27T14:40:58.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.203+0000 7f90057ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f900013a350 0x7f9000065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.203+0000 7f90057ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90000c36b0 0x7f90001585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.203+0000 7f90057ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90000bd9a0 con 0x7f900013a730 2023-07-27T14:40:58.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.203+0000 7f90057ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9000066400 con 0x7f90000c36b0 2023-07-27T14:40:58.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.203+0000 7f90057ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9000158ae0 con 0x7f900013a350 2023-07-27T14:40:58.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8fff7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90000c36b0 0x7f90001585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8fff7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90000c36b0 0x7f90001585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51510/0 (socket says 172.21.15.115:51510) 2023-07-27T14:40:58.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8fff7fe700 1 -- 172.21.15.115:0/1712931072 learned_addr learned my addr 172.21.15.115:0/1712931072 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:58.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8ffeffd700 1 --2- 172.21.15.115:0/1712931072 >> v2:172.21.15.159:3300/0 conn(0x7f900013a350 0x7f9000065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8fff7fe700 1 -- 172.21.15.115:0/1712931072 >> v2:172.21.15.159:3300/0 conn(0x7f900013a350 msgr2=0x7f9000065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:58.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8fff7fe700 1 --2- 172.21.15.115:0/1712931072 >> v2:172.21.15.159:3300/0 conn(0x7f900013a350 0x7f9000065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8fff7fe700 1 -- 172.21.15.115:0/1712931072 >> v1:172.21.15.159:6789/0 conn(0x7f900013a730 legacy=0x7f90000c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8fff7fe700 1 -- 172.21.15.115:0/1712931072 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9000066610 con 0x7f90000c36b0 2023-07-27T14:40:58.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.204+0000 7f8fff7fe700 1 --2- 172.21.15.115:0/1712931072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90000c36b0 0x7f90001585f0 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 rx=0x7f9000066fd0 tx=0x7f8ff8009840).ready entity=mon.0 client_cookie=e7afec0dfea925d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:58.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f8ffdffb700 1 -- 172.21.15.115:0/1712931072 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff800e070 con 0x7f90000c36b0 2023-07-27T14:40:58.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f8ffdffb700 1 -- 172.21.15.115:0/1712931072 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff800ba20 con 0x7f90000c36b0 2023-07-27T14:40:58.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f8ffdffb700 1 -- 172.21.15.115:0/1712931072 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff800bda0 con 0x7f90000c36b0 2023-07-27T14:40:58.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f90057ff700 1 -- 172.21.15.115:0/1712931072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90000c36b0 msgr2=0x7f90001585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f90057ff700 1 --2- 172.21.15.115:0/1712931072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90000c36b0 0x7f90001585f0 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 rx=0x7f9000066fd0 tx=0x7f8ff8009840).stop 2023-07-27T14:40:58.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f90057ff700 1 -- 172.21.15.115:0/1712931072 shutdown_connections 2023-07-27T14:40:58.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f90057ff700 1 --2- 172.21.15.115:0/1712931072 >> v2:172.21.15.159:3300/0 conn(0x7f900013a350 0x7f9000065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f90057ff700 1 --2- 172.21.15.115:0/1712931072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90000c36b0 0x7f90001585f0 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f90057ff700 1 -- 172.21.15.115:0/1712931072 >> 172.21.15.115:0/1712931072 conn(0x7f900005e8f0 msgr2=0x7f90000c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:58.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f90057ff700 1 -- 172.21.15.115:0/1712931072 shutdown_connections 2023-07-27T14:40:58.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.205+0000 7f90057ff700 1 -- 172.21.15.115:0/1712931072 wait complete. 2023-07-27T14:40:58.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.207+0000 7f90057ff700 1 Processor -- start 2023-07-27T14:40:58.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.207+0000 7f90057ff700 1 -- start start 2023-07-27T14:40:58.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f90057ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000c36b0 0x7f9000153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f90057ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900013a350 0x7f9000156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f90057ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f900013a730 0x7f9000156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f90057ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9000154200 con 0x7f900013a730 2023-07-27T14:40:58.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f90057ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9000156f60 con 0x7f900013a350 2023-07-27T14:40:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f90057ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90000a9f00 con 0x7f90000c36b0 2023-07-27T14:40:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f900013a730 0x7f9000156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f900013a730 0x7f9000156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51514/0 (socket says 172.21.15.115:51514) 2023-07-27T14:40:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 -- 172.21.15.115:0/2148322114 learned_addr learned my addr 172.21.15.115:0/2148322114 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8ffeffd700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000c36b0 0x7f9000153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8ffe7fc700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900013a350 0x7f9000156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 -- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000c36b0 msgr2=0x7f9000153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000c36b0 0x7f9000153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 -- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900013a350 msgr2=0x7f9000156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900013a350 0x7f9000156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 -- 172.21.15.115:0/2148322114 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8009ae0 con 0x7f900013a730 2023-07-27T14:40:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8ffe7fc700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900013a350 0x7f9000156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:40:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.208+0000 7f8fff7fe700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f900013a730 0x7f9000156a70 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 rx=0x7f9000067240 tx=0x7f8ff8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.209+0000 7f8fe6ffd700 1 -- 172.21.15.115:0/2148322114 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80092e0 con 0x7f900013a730 2023-07-27T14:40:58.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.209+0000 7f8fe6ffd700 1 -- 172.21.15.115:0/2148322114 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff801e470 con 0x7f900013a730 2023-07-27T14:40:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.209+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90000a9330 con 0x7f900013a730 2023-07-27T14:40:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.209+0000 7f8fe6ffd700 1 -- 172.21.15.115:0/2148322114 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff801e830 con 0x7f900013a730 2023-07-27T14:40:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.209+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90000a98b0 con 0x7f900013a730 2023-07-27T14:40:58.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.210+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90000aa0b0 con 0x7f900013a730 2023-07-27T14:40:58.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.211+0000 7f8fe6ffd700 1 -- 172.21.15.115:0/2148322114 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f8ff8025030 con 0x7f900013a730 2023-07-27T14:40:58.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.212+0000 7f8fe6ffd700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fec05fe20 0x7f8fec0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.212+0000 7f8fe6ffd700 1 -- 172.21.15.115:0/2148322114 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f8ff807c8e0 con 0x7f900013a730 2023-07-27T14:40:58.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.213+0000 7f8ffeffd700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fec05fe20 0x7f8fec0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.213+0000 7f8ffeffd700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fec05fe20 0x7f8fec0622e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f8ff0009bc0 tx=0x7f8ff0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:58.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.216+0000 7f8fe6ffd700 1 -- 172.21.15.115:0/2148322114 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f90000aa0b0 con 0x7f900013a730 2023-07-27T14:40:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.385+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f90000aa070 con 0x7f900013a730 2023-07-27T14:40:58.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.386+0000 7f8fe6ffd700 1 -- 172.21.15.115:0/2148322114 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v214) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8ff8023070 con 0x7f900013a730 2023-07-27T14:40:58.443 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-07-27T14:40:58.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fec05fe20 msgr2=0x7f8fec0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fec05fe20 0x7f8fec0622e0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f8ff0009bc0 tx=0x7f8ff0008040).stop 2023-07-27T14:40:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f900013a730 msgr2=0x7f9000156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f900013a730 0x7f9000156a70 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 rx=0x7f9000067240 tx=0x7f8ff8009840).stop 2023-07-27T14:40:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 shutdown_connections 2023-07-27T14:40:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8fec05fe20 0x7f8fec0622e0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f900013a730 0x7f9000156a70 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90000c36b0 0x7f9000153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 --2- 172.21.15.115:0/2148322114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f900013a350 0x7f9000156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 >> 172.21.15.115:0/2148322114 conn(0x7f900005e8f0 msgr2=0x7f90000c2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:58.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 shutdown_connections 2023-07-27T14:40:58.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.388+0000 7f90057ff700 1 -- 172.21.15.115:0/2148322114 wait complete. 2023-07-27T14:40:58.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-27T14:40:58.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.595+0000 7fbc623ff700 1 Processor -- start 2023-07-27T14:40:58.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.595+0000 7fbc623ff700 1 -- start start 2023-07-27T14:40:58.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.596+0000 7fbc623ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbc5c14ae00 0x7fbc5c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.596+0000 7fbc623ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc5c14b1e0 0x7fbc5c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc623ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c063040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc623ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c063530 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc623ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c1553f0 con 0x7fbc5c14ae00 2023-07-27T14:40:58.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc623ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c157a50 con 0x7fbc5c0c5c50 2023-07-27T14:40:58.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc5c14b1e0 0x7fbc5c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbc5c14b1e0 0x7fbc5c062b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51516/0 (socket says 172.21.15.115:51516) 2023-07-27T14:40:58.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 -- 172.21.15.115:0/1672658223 learned_addr learned my addr 172.21.15.115:0/1672658223 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:58.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5bfff700 1 --2- 172.21.15.115:0/1672658223 >> v2:172.21.15.159:3300/0 conn(0x7fbc5c14ae00 0x7fbc5c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc6099c700 1 --2- 172.21.15.115:0/1672658223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c063040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 -- 172.21.15.115:0/1672658223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 msgr2=0x7fbc5c063040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:58.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 --2- 172.21.15.115:0/1672658223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c063040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 -- 172.21.15.115:0/1672658223 >> v2:172.21.15.159:3300/0 conn(0x7fbc5c14ae00 msgr2=0x7fbc5c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:58.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 --2- 172.21.15.115:0/1672658223 >> v2:172.21.15.159:3300/0 conn(0x7fbc5c14ae00 0x7fbc5c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 -- 172.21.15.115:0/1672658223 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c157d10 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.597+0000 7fbc5b7fe700 1 --2- 172.21.15.115:0/1672658223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c062b50 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 rx=0x7fbc5c0caaf0 tx=0x7fbc500090f0).ready entity=mon.0 client_cookie=32415864771fb166 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:58.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc5affd700 1 -- 172.21.15.115:0/1672658223 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5000b600 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc5affd700 1 -- 172.21.15.115:0/1672658223 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5000b760 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc5affd700 1 -- 172.21.15.115:0/1672658223 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5000bae0 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 -- 172.21.15.115:0/1672658223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 msgr2=0x7fbc5c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 --2- 172.21.15.115:0/1672658223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c062b50 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 rx=0x7fbc5c0caaf0 tx=0x7fbc500090f0).stop 2023-07-27T14:40:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 -- 172.21.15.115:0/1672658223 shutdown_connections 2023-07-27T14:40:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 --2- 172.21.15.115:0/1672658223 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c063040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 --2- 172.21.15.115:0/1672658223 >> v2:172.21.15.159:3300/0 conn(0x7fbc5c14ae00 0x7fbc5c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 --2- 172.21.15.115:0/1672658223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c062b50 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 -- 172.21.15.115:0/1672658223 >> 172.21.15.115:0/1672658223 conn(0x7fbc5c05e940 msgr2=0x7fbc5c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 -- 172.21.15.115:0/1672658223 shutdown_connections 2023-07-27T14:40:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.598+0000 7fbc623ff700 1 -- 172.21.15.115:0/1672658223 wait complete. 2023-07-27T14:40:58.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.600+0000 7fbc623ff700 1 Processor -- start 2023-07-27T14:40:58.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.600+0000 7fbc623ff700 1 -- start start 2023-07-27T14:40:58.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc623ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc623ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc5c14ae00 0x7fbc5c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc623ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc623ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0c8af0 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc623ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0c8dd0 con 0x7fbc5c14ae00 2023-07-27T14:40:58.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc623ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0c90b0 con 0x7fbc5c0c5c50 2023-07-27T14:40:58.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc6099c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc6099c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c0ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51520/0 (socket says 172.21.15.115:51520) 2023-07-27T14:40:58.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc6099c700 1 -- 172.21.15.115:0/526714974 learned_addr learned my addr 172.21.15.115:0/526714974 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:58.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc5bfff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.601+0000 7fbc5b7fe700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc5c14ae00 0x7fbc5c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc6099c700 1 -- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 msgr2=0x7fbc5c149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc6099c700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc6099c700 1 -- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc5c14ae00 msgr2=0x7fbc5c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc6099c700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc5c14ae00 0x7fbc5c0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc6099c700 1 -- 172.21.15.115:0/526714974 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50009370 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc5b7fe700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc5c14ae00 0x7fbc5c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc5bfff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc6099c700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c0ca080 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 rx=0x7fbc54007f30 tx=0x7fbc540098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc43fff700 1 -- 172.21.15.115:0/526714974 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400ecf0 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc43fff700 1 -- 172.21.15.115:0/526714974 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5400ee50 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c0c9390 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc43fff700 1 -- 172.21.15.115:0/526714974 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54014610 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.602+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c149c20 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.603+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c06c470 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.604+0000 7fbc43fff700 1 -- 172.21.15.115:0/526714974 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fbc5401b030 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.605+0000 7fbc43fff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc4805fe20 0x7fbc480622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:58.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.605+0000 7fbc43fff700 1 -- 172.21.15.115:0/526714974 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fbc5407b7a0 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.605+0000 7fbc5bfff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc4805fe20 0x7fbc480622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:58.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.606+0000 7fbc5bfff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc4805fe20 0x7fbc480622e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fbc4c00bb60 tx=0x7fbc4c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:58.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.608+0000 7fbc43fff700 1 -- 172.21.15.115:0/526714974 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc5404bed0 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.777+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbc5c06b9c0 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.777+0000 7fbc43fff700 1 -- 172.21.15.115:0/526714974 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v214) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbc5404f4f0 con 0x7fbc5c14b1e0 2023-07-27T14:40:58.834 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-07-27T14:40:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc4805fe20 msgr2=0x7fbc480622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc4805fe20 0x7fbc480622e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fbc4c00bb60 tx=0x7fbc4c008040).stop 2023-07-27T14:40:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 msgr2=0x7fbc5c0ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:58.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c0ca080 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 rx=0x7fbc54007f30 tx=0x7fbc540098e0).stop 2023-07-27T14:40:58.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 shutdown_connections 2023-07-27T14:40:58.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbc4805fe20 0x7fbc480622e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc5c14b1e0 0x7fbc5c0ca080 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbc5c0c5c50 0x7fbc5c149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 --2- 172.21.15.115:0/526714974 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc5c14ae00 0x7fbc5c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:58.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.779+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 >> 172.21.15.115:0/526714974 conn(0x7fbc5c05e940 msgr2=0x7fbc5c14a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:58.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.780+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 shutdown_connections 2023-07-27T14:40:58.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.780+0000 7fbc623ff700 1 -- 172.21.15.115:0/526714974 wait complete. 2023-07-27T14:40:58.853 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-27T14:40:59.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.986+0000 7fd543bff700 1 Processor -- start 2023-07-27T14:40:59.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.986+0000 7fd543bff700 1 -- start start 2023-07-27T14:40:59.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.987+0000 7fd543bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd53c151bd0 0x7fd53c062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.987+0000 7fd543bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd53c0a4f50 0x7fd53c0bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.987+0000 7fd543bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c0639d0 con 0x7fd53c062810 2023-07-27T14:40:59.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.987+0000 7fd543bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c137610 con 0x7fd53c0a4f50 2023-07-27T14:40:59.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.987+0000 7fd543bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c062dc0 con 0x7fd53c151bd0 2023-07-27T14:40:59.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54219c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd53c0a4f50 0x7fd53c0bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54119a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd53c062810 0x7fd53c0a4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33276/0 (socket says 172.21.15.115:33276) 2023-07-27T14:40:59.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54119a700 1 -- 172.21.15.115:0/1599616606 learned_addr learned my addr 172.21.15.115:0/1599616606 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:59.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54199b700 1 --2- 172.21.15.115:0/1599616606 >> v2:172.21.15.159:3300/0 conn(0x7fd53c151bd0 0x7fd53c062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54219c700 1 -- 172.21.15.115:0/1599616606 >> v2:172.21.15.159:3300/0 conn(0x7fd53c151bd0 msgr2=0x7fd53c062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:59.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54219c700 1 --2- 172.21.15.115:0/1599616606 >> v2:172.21.15.159:3300/0 conn(0x7fd53c151bd0 0x7fd53c062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd540999700 1 -- 172.21.15.115:0/1599616606 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376792980 0 0) 0x7fd53c0639d0 con 0x7fd53c062810 2023-07-27T14:40:59.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54219c700 1 -- 172.21.15.115:0/1599616606 >> v1:172.21.15.115:6789/0 conn(0x7fd53c062810 legacy=0x7fd53c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54219c700 1 -- 172.21.15.115:0/1599616606 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0630a0 con 0x7fd53c0a4f50 2023-07-27T14:40:59.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54199b700 1 --2- 172.21.15.115:0/1599616606 >> v2:172.21.15.159:3300/0 conn(0x7fd53c151bd0 0x7fd53c062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:59.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd54219c700 1 --2- 172.21.15.115:0/1599616606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0bc050 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 rx=0x7fd53c066fb0 tx=0x7fd534009780).ready entity=mon.0 client_cookie=35d9b4d67878c40a server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:59.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd540999700 1 -- 172.21.15.115:0/1599616606 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400e070 con 0x7fd53c0a4f50 2023-07-27T14:40:59.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.988+0000 7fd540999700 1 -- 172.21.15.115:0/1599616606 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53400bc30 con 0x7fd53c0a4f50 2023-07-27T14:40:59.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd540999700 1 -- 172.21.15.115:0/1599616606 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534012410 con 0x7fd53c0a4f50 2023-07-27T14:40:59.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd543bff700 1 -- 172.21.15.115:0/1599616606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 msgr2=0x7fd53c0bc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd543bff700 1 --2- 172.21.15.115:0/1599616606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0bc050 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 rx=0x7fd53c066fb0 tx=0x7fd534009780).stop 2023-07-27T14:40:59.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd543bff700 1 -- 172.21.15.115:0/1599616606 shutdown_connections 2023-07-27T14:40:59.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd543bff700 1 --2- 172.21.15.115:0/1599616606 >> v2:172.21.15.159:3300/0 conn(0x7fd53c151bd0 0x7fd53c062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd543bff700 1 --2- 172.21.15.115:0/1599616606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0bc050 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd543bff700 1 -- 172.21.15.115:0/1599616606 >> 172.21.15.115:0/1599616606 conn(0x7fd53c064700 msgr2=0x7fd53c064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:59.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd543bff700 1 -- 172.21.15.115:0/1599616606 shutdown_connections 2023-07-27T14:40:59.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.989+0000 7fd543bff700 1 -- 172.21.15.115:0/1599616606 wait complete. 2023-07-27T14:40:59.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.991+0000 7fd543bff700 1 Processor -- start 2023-07-27T14:40:59.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.991+0000 7fd543bff700 1 -- start start 2023-07-27T14:40:59.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd543bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd53c062810 0x7fd53c151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd543bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd543bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53c151bd0 0x7fd53c164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd543bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0a9160 con 0x7fd53c0a4f50 2023-07-27T14:40:59.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd543bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0a9aa0 con 0x7fd53c062810 2023-07-27T14:40:59.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd543bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0a84e0 con 0x7fd53c151bd0 2023-07-27T14:40:59.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54119a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54119a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0a7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51542/0 (socket says 172.21.15.115:51542) 2023-07-27T14:40:59.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54119a700 1 -- 172.21.15.115:0/3074173511 learned_addr learned my addr 172.21.15.115:0/3074173511 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:59.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54199b700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd53c062810 0x7fd53c151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54219c700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53c151bd0 0x7fd53c164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54119a700 1 -- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53c151bd0 msgr2=0x7fd53c164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54119a700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53c151bd0 0x7fd53c164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54119a700 1 -- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd53c062810 msgr2=0x7fd53c151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54119a700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd53c062810 0x7fd53c151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54119a700 1 -- 172.21.15.115:0/3074173511 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009a20 con 0x7fd53c0a4f50 2023-07-27T14:40:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.992+0000 7fd54219c700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53c151bd0 0x7fd53c164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.993+0000 7fd54119a700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0a7e60 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 rx=0x7fd52c001eb0 tx=0x7fd52c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.993+0000 7fd531ffb700 1 -- 172.21.15.115:0/3074173511 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00ce90 con 0x7fd53c0a4f50 2023-07-27T14:40:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.993+0000 7fd531ffb700 1 -- 172.21.15.115:0/3074173511 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c0072e0 con 0x7fd53c0a4f50 2023-07-27T14:40:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.993+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c0a87c0 con 0x7fd53c0a4f50 2023-07-27T14:40:59.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.993+0000 7fd531ffb700 1 -- 172.21.15.115:0/3074173511 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c007680 con 0x7fd53c0a4f50 2023-07-27T14:40:59.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.993+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c0a8d80 con 0x7fd53c0a4f50 2023-07-27T14:40:59.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.994+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c06c470 con 0x7fd53c0a4f50 2023-07-27T14:40:59.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.995+0000 7fd531ffb700 1 -- 172.21.15.115:0/3074173511 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fd52c010070 con 0x7fd53c0a4f50 2023-07-27T14:40:59.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.996+0000 7fd531ffb700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd52005fe20 0x7fd5200622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.996+0000 7fd531ffb700 1 -- 172.21.15.115:0/3074173511 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 5297+0+0 (secure 0 0 0) 0x7fd52c07a7c0 con 0x7fd53c0a4f50 2023-07-27T14:40:59.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.996+0000 7fd54199b700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd52005fe20 0x7fd5200622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.996+0000 7fd54199b700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd52005fe20 0x7fd5200622e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fd53c13d370 tx=0x7fd538008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:59.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:58.999+0000 7fd531ffb700 1 -- 172.21.15.115:0/3074173511 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd52c04b000 con 0x7fd53c0a4f50 2023-07-27T14:40:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.169+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd53c06a2b0 con 0x7fd53c0a4f50 2023-07-27T14:40:59.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.170+0000 7fd531ffb700 1 -- 172.21.15.115:0/3074173511 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v214) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd52c04e620 con 0x7fd53c0a4f50 2023-07-27T14:40:59.227 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:40:59.227 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:40:59.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:59.227 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-07-27T14:40:59.227 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "device_health_metrics" 2023-07-27T14:40:59.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-07-27T14:40:59.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:40:59.228 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-07-27T14:40:59.228 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-07-27T14:40:59.228 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:40:59.228 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:40:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd52005fe20 msgr2=0x7fd5200622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd52005fe20 0x7fd5200622e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fd53c13d370 tx=0x7fd538008040).stop 2023-07-27T14:40:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 msgr2=0x7fd53c0a7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0a7e60 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 rx=0x7fd52c001eb0 tx=0x7fd52c007e90).stop 2023-07-27T14:40:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 shutdown_connections 2023-07-27T14:40:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fd52005fe20 0x7fd5200622e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd53c151bd0 0x7fd53c164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd53c062810 0x7fd53c151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 --2- 172.21.15.115:0/3074173511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd53c0a4f50 0x7fd53c0a7e60 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 >> 172.21.15.115:0/3074173511 conn(0x7fd53c064700 msgr2=0x7fd53c068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:59.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 shutdown_connections 2023-07-27T14:40:59.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.172+0000 7fd543bff700 1 -- 172.21.15.115:0/3074173511 wait complete. 2023-07-27T14:40:59.246 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-27T14:40:59.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-07-27T14:40:59.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.383+0000 7f0562dff700 1 Processor -- start 2023-07-27T14:40:59.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.383+0000 7f0562dff700 1 -- start start 2023-07-27T14:40:59.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.384+0000 7f0562dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c14ae00 0x7f055c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.384+0000 7f0562dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f055c063260 0x7f055c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.384+0000 7f0562dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c1553f0 con 0x7f055c14b1e0 2023-07-27T14:40:59.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.384+0000 7f0562dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c157a50 con 0x7f055c063260 2023-07-27T14:40:59.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.384+0000 7f0562dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c157d10 con 0x7f055c14ae00 2023-07-27T14:40:59.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.384+0000 7f055bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f055c14b1e0 0x7f055c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33288/0 (socket says 172.21.15.115:33288) 2023-07-27T14:40:59.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.384+0000 7f055bfff700 1 -- 172.21.15.115:0/285223897 learned_addr learned my addr 172.21.15.115:0/285223897 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:40:59.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f056139c700 1 --2- 172.21.15.115:0/285223897 >> v2:172.21.15.159:3300/0 conn(0x7f055c063260 0x7f055c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f0560b9b700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c14ae00 0x7f055c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128373249 0 0) 0x7f055c1553f0 con 0x7f055c14b1e0 2023-07-27T14:40:59.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f054c0033f0 con 0x7f055c14b1e0 2023-07-27T14:40:59.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 9308690 0 0) 0x7f054c0033f0 con 0x7f055c14b1e0 2023-07-27T14:40:59.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c14ae00 msgr2=0x7f055c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:59.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c14ae00 0x7f055c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 >> v2:172.21.15.159:3300/0 conn(0x7f055c063260 msgr2=0x7f055c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:59.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 --2- 172.21.15.115:0/285223897 >> v2:172.21.15.159:3300/0 conn(0x7f055c063260 0x7f055c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c157ff0 con 0x7f055c14b1e0 2023-07-27T14:40:59.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f0548001470 con 0x7f055c14b1e0 2023-07-27T14:40:59.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 >> v1:172.21.15.115:6789/0 conn(0x7f055c14b1e0 legacy=0x7f055c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f054c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c14ae00 0x7f054c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f054c004b80 0x7f054c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c157a50 con 0x7f054c0038e0 2023-07-27T14:40:59.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c157d10 con 0x7f054c004b80 2023-07-27T14:40:59.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c00b8e0 con 0x7f055c14ae00 2023-07-27T14:40:59.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f056139c700 1 --2- 172.21.15.115:0/285223897 >> v2:172.21.15.159:3300/0 conn(0x7f055c063260 0x7f055c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:40:59.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.385+0000 7f0560b9b700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f054c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f055bfff700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c14ae00 0x7f054c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f056139c700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f054c004b80 0x7f054c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f0560b9b700 1 -- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c14ae00 msgr2=0x7f054c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:59.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f0560b9b700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c14ae00 0x7f054c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f0560b9b700 1 -- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f054c004b80 msgr2=0x7f054c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:40:59.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f0560b9b700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f054c004b80 0x7f054c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f0560b9b700 1 -- 172.21.15.115:0/285223897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0033f0 con 0x7f054c0038e0 2023-07-27T14:40:59.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f056139c700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f054c004b80 0x7f054c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:59.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f0560b9b700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f054c003d00 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 rx=0x7f0550009a80 tx=0x7f0550009060).ready entity=mon.0 client_cookie=466d2a39382aae50 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:59.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0550009430 con 0x7f054c0038e0 2023-07-27T14:40:59.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000e640 con 0x7f054c0038e0 2023-07-27T14:40:59.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.386+0000 7f055b7fe700 1 -- 172.21.15.115:0/285223897 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000e9c0 con 0x7f054c0038e0 2023-07-27T14:40:59.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.387+0000 7f0562dff700 1 -- 172.21.15.115:0/285223897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 msgr2=0x7f054c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.387+0000 7f0562dff700 1 --2- 172.21.15.115:0/285223897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f054c003d00 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 rx=0x7f0550009a80 tx=0x7f0550009060).stop 2023-07-27T14:40:59.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.387+0000 7f056139c700 1 -- 172.21.15.115:0/285223897 reap_dead start 2023-07-27T14:40:59.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.387+0000 7f0562dff700 1 -- 172.21.15.115:0/285223897 shutdown_connections 2023-07-27T14:40:59.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.387+0000 7f0562dff700 1 -- 172.21.15.115:0/285223897 >> 172.21.15.115:0/285223897 conn(0x7f055c05e940 msgr2=0x7f055c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:59.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.387+0000 7f0562dff700 1 -- 172.21.15.115:0/285223897 shutdown_connections 2023-07-27T14:40:59.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.387+0000 7f0562dff700 1 -- 172.21.15.115:0/285223897 wait complete. 2023-07-27T14:40:59.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.388+0000 7f0562dff700 1 Processor -- start 2023-07-27T14:40:59.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.388+0000 7f0562dff700 1 -- start start 2023-07-27T14:40:59.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.389+0000 7f0562dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f055c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.389+0000 7f0562dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c0c2dd0 0x7f055c0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.389+0000 7f0562dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055c1495a0 0x7f055c0c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.389+0000 7f0562dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1568e0 con 0x7f054c0038e0 2023-07-27T14:40:59.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.389+0000 7f0562dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0c3250 con 0x7f055c1495a0 2023-07-27T14:40:59.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.389+0000 7f0562dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0c3510 con 0x7f055c0c2dd0 2023-07-27T14:40:59.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f055c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f055c1544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51560/0 (socket says 172.21.15.115:51560) 2023-07-27T14:40:59.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 -- 172.21.15.115:0/1744575695 learned_addr learned my addr 172.21.15.115:0/1744575695 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:40:59.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f055bfff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c0c2dd0 0x7f055c0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f056139c700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055c1495a0 0x7f055c0c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 -- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c0c2dd0 msgr2=0x7f055c0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c0c2dd0 0x7f055c0adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 -- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055c1495a0 msgr2=0x7f055c0c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055c1495a0 0x7f055c0c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 -- 172.21.15.115:0/1744575695 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c155fb0 con 0x7f054c0038e0 2023-07-27T14:40:59.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f056139c700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055c1495a0 0x7f055c0c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:40:59.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0560b9b700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f055c1544b0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 rx=0x7f054c004490 tx=0x7f055001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:59.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.390+0000 7f0558ff9700 1 -- 172.21.15.115:0/1744575695 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000ed30 con 0x7f054c0038e0 2023-07-27T14:40:59.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.391+0000 7f0558ff9700 1 -- 172.21.15.115:0/1744575695 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000ee90 con 0x7f054c0038e0 2023-07-27T14:40:59.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.391+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c156290 con 0x7f054c0038e0 2023-07-27T14:40:59.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.391+0000 7f0558ff9700 1 -- 172.21.15.115:0/1744575695 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0550026440 con 0x7f054c0038e0 2023-07-27T14:40:59.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.391+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c0ae4d0 con 0x7f054c0038e0 2023-07-27T14:40:59.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.392+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c156bc0 con 0x7f054c0038e0 2023-07-27T14:40:59.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.392+0000 7f0558ff9700 1 -- 172.21.15.115:0/1744575695 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f055002c020 con 0x7f054c0038e0 2023-07-27T14:40:59.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.393+0000 7f0558ff9700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f054005fe20 0x7f05400622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:40:59.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.394+0000 7f0558ff9700 1 -- 172.21.15.115:0/1744575695 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 5297+0+0 (secure 0 0 0) 0x7f055007cee0 con 0x7f054c0038e0 2023-07-27T14:40:59.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.394+0000 7f055bfff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f054005fe20 0x7f05400622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:40:59.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.394+0000 7f055bfff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f054005fe20 0x7f05400622e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f0548001620 tx=0x7f05480077c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:40:59.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.397+0000 7f0558ff9700 1 -- 172.21.15.115:0/1744575695 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f055004d610 con 0x7f054c0038e0 2023-07-27T14:40:59.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.569+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f055c0ae6f0 con 0x7f054c0038e0 2023-07-27T14:40:59.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-27T14:40:59.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.924+0000 7f0558ff9700 1 -- 172.21.15.115:0/1744575695 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v215) v1 ==== 152+0+0 (secure 0 0 0) 0x7f0550016020 con 0x7f054c0038e0 2023-07-27T14:40:59.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.927+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f054005fe20 msgr2=0x7f05400622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.927+0000 7f0562dff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f054005fe20 0x7f05400622e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f0548001620 tx=0x7f05480077c0).stop 2023-07-27T14:40:59.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.927+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 msgr2=0x7f055c1544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:40:59.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.927+0000 7f0562dff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f055c1544b0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 rx=0x7f054c004490 tx=0x7f055001a000).stop 2023-07-27T14:40:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.930+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 shutdown_connections 2023-07-27T14:40:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.930+0000 7f0562dff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f054005fe20 0x7f05400622e0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.930+0000 7f0562dff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f055c1495a0 0x7f055c0c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.930+0000 7f0562dff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054c0038e0 0x7f055c1544b0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.930+0000 7f0562dff700 1 --2- 172.21.15.115:0/1744575695 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f055c0c2dd0 0x7f055c0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:40:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.930+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 >> 172.21.15.115:0/1744575695 conn(0x7f055c05e940 msgr2=0x7f055c14a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:40:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.931+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 shutdown_connections 2023-07-27T14:40:59.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:40:59.931+0000 7f0562dff700 1 -- 172.21.15.115:0/1744575695 wait complete. 2023-07-27T14:40:59.991 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-07-27T14:41:00.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-27T14:41:00.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.145+0000 7fc6b0dff700 1 Processor -- start 2023-07-27T14:41:00.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.145+0000 7fc6b0dff700 1 -- start start 2023-07-27T14:41:00.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.146+0000 7fc6b0dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6ac1516c0 0x7fc6ac155020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:00.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6b0dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac0c5790 con 0x7fc6ac0698b0 2023-07-27T14:41:00.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6b0dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac0c5d10 con 0x7fc6ac151aa0 2023-07-27T14:41:00.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6b0dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c5a30 con 0x7fc6ac1516c0 2023-07-27T14:41:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6aa59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6ac1516c0 0x7fc6ac155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6aa59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc6ac1516c0 0x7fc6ac155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51568/0 (socket says 172.21.15.115:51568) 2023-07-27T14:41:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6aa59c700 1 -- 172.21.15.115:0/2135051416 learned_addr learned my addr 172.21.15.115:0/2135051416 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6aad9d700 1 --1- 172.21.15.115:0/2135051416 >> v1:172.21.15.115:6789/0 conn(0x7fc6ac0698b0 0x7fc6ac062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33292/0 (socket says 172.21.15.115:33292) 2023-07-27T14:41:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6aa59c700 1 -- 172.21.15.115:0/2135051416 >> v1:172.21.15.159:6789/0 conn(0x7fc6ac151aa0 legacy=0x7fc6ac0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:00.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6aa59c700 1 -- 172.21.15.115:0/2135051416 >> v1:172.21.15.115:6789/0 conn(0x7fc6ac0698b0 legacy=0x7fc6ac062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6a959a700 1 -- 172.21.15.115:0/2135051416 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081623214 0 0) 0x7fc6ac0c5790 con 0x7fc6ac0698b0 2023-07-27T14:41:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.147+0000 7fc6aa59c700 1 -- 172.21.15.115:0/2135051416 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac0690b0 con 0x7fc6ac1516c0 2023-07-27T14:41:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6aa59c700 1 --2- 172.21.15.115:0/2135051416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac1516c0 0x7fc6ac155020 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 rx=0x7fc69c006fd0 tx=0x7fc69c0090f0).ready entity=mon.0 client_cookie=ac46ac6576a883be server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6a959a700 1 -- 172.21.15.115:0/2135051416 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00b600 con 0x7fc6ac1516c0 2023-07-27T14:41:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6a959a700 1 -- 172.21.15.115:0/2135051416 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00b760 con 0x7fc6ac1516c0 2023-07-27T14:41:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6a959a700 1 -- 172.21.15.115:0/2135051416 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00bae0 con 0x7fc6ac1516c0 2023-07-27T14:41:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6b0dff700 1 -- 172.21.15.115:0/2135051416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac1516c0 msgr2=0x7fc6ac155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:00.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6b0dff700 1 --2- 172.21.15.115:0/2135051416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac1516c0 0x7fc6ac155020 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 rx=0x7fc69c006fd0 tx=0x7fc69c0090f0).stop 2023-07-27T14:41:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6b0dff700 1 -- 172.21.15.115:0/2135051416 shutdown_connections 2023-07-27T14:41:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6b0dff700 1 --2- 172.21.15.115:0/2135051416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac1516c0 0x7fc6ac155020 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6b0dff700 1 -- 172.21.15.115:0/2135051416 >> 172.21.15.115:0/2135051416 conn(0x7fc6ac0c7a10 msgr2=0x7fc6ac0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.148+0000 7fc6b0dff700 1 -- 172.21.15.115:0/2135051416 shutdown_connections 2023-07-27T14:41:00.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.149+0000 7fc6b0dff700 1 -- 172.21.15.115:0/2135051416 wait complete. 2023-07-27T14:41:00.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.150+0000 7fc6b0dff700 1 Processor -- start 2023-07-27T14:41:00.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.150+0000 7fc6b0dff700 1 -- start start 2023-07-27T14:41:00.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6b0dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac0698b0 0x7fc6ac0a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:00.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6b0dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac1516c0 0x7fc6ac15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:00.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6b0dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac151aa0 0x7fc6ac0a8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:00.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6b0dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0a9770 con 0x7fc6ac0698b0 2023-07-27T14:41:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6b0dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0a8b60 con 0x7fc6ac1516c0 2023-07-27T14:41:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6b0dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0a8e40 con 0x7fc6ac151aa0 2023-07-27T14:41:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6aa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac0698b0 0x7fc6ac0a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6aa59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac0698b0 0x7fc6ac0a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51574/0 (socket says 172.21.15.115:51574) 2023-07-27T14:41:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.151+0000 7fc6aa59c700 1 -- 172.21.15.115:0/3529929492 learned_addr learned my addr 172.21.15.115:0/3529929492 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc6aa59c700 1 -- 172.21.15.115:0/3529929492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac151aa0 msgr2=0x7fc6ac0a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc6aa59c700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac151aa0 0x7fc6ac0a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:00.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc6aa59c700 1 -- 172.21.15.115:0/3529929492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac1516c0 msgr2=0x7fc6ac15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc6aa59c700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac1516c0 0x7fc6ac15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc6aa59c700 1 -- 172.21.15.115:0/3529929492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009370 con 0x7fc6ac0698b0 2023-07-27T14:41:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc6aa59c700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac0698b0 0x7fc6ac0a9c00 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 rx=0x7fc69c009130 tx=0x7fc69c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc69a7fc700 1 -- 172.21.15.115:0/3529929492 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00b8d0 con 0x7fc6ac0698b0 2023-07-27T14:41:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc69a7fc700 1 -- 172.21.15.115:0/3529929492 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00ba30 con 0x7fc6ac0698b0 2023-07-27T14:41:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc69a7fc700 1 -- 172.21.15.115:0/3529929492 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c01c670 con 0x7fc6ac0698b0 2023-07-27T14:41:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac0a9120 con 0x7fc6ac0698b0 2023-07-27T14:41:00.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.152+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac137c00 con 0x7fc6ac0698b0 2023-07-27T14:41:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.153+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac0aa0f0 con 0x7fc6ac0698b0 2023-07-27T14:41:00.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.154+0000 7fc69a7fc700 1 -- 172.21.15.115:0/3529929492 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fc69c02c070 con 0x7fc6ac0698b0 2023-07-27T14:41:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.156+0000 7fc69a7fc700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc68c05fe20 0x7fc68c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.156+0000 7fc69a7fc700 1 -- 172.21.15.115:0/3529929492 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 5667+0+0 (secure 0 0 0) 0x7fc69c07d180 con 0x7fc6ac0698b0 2023-07-27T14:41:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.156+0000 7fc6a9d9b700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc68c05fe20 0x7fc68c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:00.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.157+0000 7fc6a9d9b700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc68c05fe20 0x7fc68c0622e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fc6ac0670d0 tx=0x7fc6a0006b60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:00.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.161+0000 7fc69a7fc700 1 -- 172.21.15.115:0/3529929492 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc69c04d740 con 0x7fc6ac0698b0 2023-07-27T14:41:00.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.330+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc6ac06c470 con 0x7fc6ac0698b0 2023-07-27T14:41:00.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.928+0000 7fc69a7fc700 1 -- 172.21.15.115:0/3529929492 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v216) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc69c02a0d0 con 0x7fc6ac0698b0 2023-07-27T14:41:00.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.934+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc68c05fe20 msgr2=0x7fc68c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.934+0000 7fc6b0dff700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc68c05fe20 0x7fc68c0622e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fc6ac0670d0 tx=0x7fc6a0006b60).stop 2023-07-27T14:41:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.934+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac0698b0 msgr2=0x7fc6ac0a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.934+0000 7fc6b0dff700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac0698b0 0x7fc6ac0a9c00 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 rx=0x7fc69c009130 tx=0x7fc69c017000).stop 2023-07-27T14:41:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.935+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 shutdown_connections 2023-07-27T14:41:00.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.935+0000 7fc6b0dff700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc68c05fe20 0x7fc68c0622e0 secure :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0x7fc6ac0670d0 tx=0x7fc6a0006b60).stop 2023-07-27T14:41:00.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.935+0000 7fc6b0dff700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc6ac151aa0 0x7fc6ac0a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:00.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.935+0000 7fc6b0dff700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6ac0698b0 0x7fc6ac0a9c00 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:00.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.935+0000 7fc6b0dff700 1 --2- 172.21.15.115:0/3529929492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6ac1516c0 0x7fc6ac15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:00.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.935+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 >> 172.21.15.115:0/3529929492 conn(0x7fc6ac0c7a10 msgr2=0x7fc6ac069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:00.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.938+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 shutdown_connections 2023-07-27T14:41:00.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:00.939+0000 7fc6b0dff700 1 -- 172.21.15.115:0/3529929492 wait complete. 2023-07-27T14:41:01.003 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-07-27T14:41:01.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-27T14:41:01.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.162+0000 7fc203dff700 1 Processor -- start 2023-07-27T14:41:01.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.162+0000 7fc203dff700 1 -- start start 2023-07-27T14:41:01.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc203dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc1fc069c60 0x7fc1fc1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc203dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc1fc062a30 0x7fc1fc154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc203dff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc0697d0 con 0x7fc1fc0c7250 2023-07-27T14:41:01.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc203dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc155520 con 0x7fc1fc062a30 2023-07-27T14:41:01.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc203dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc068ea0 con 0x7fc1fc069c60 2023-07-27T14:41:01.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc20239c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc1fc062a30 0x7fc1fc154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc20239c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc1fc062a30 0x7fc1fc154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51586/0 (socket says 172.21.15.115:51586) 2023-07-27T14:41:01.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc20239c700 1 -- 172.21.15.115:0/3989862248 learned_addr learned my addr 172.21.15.115:0/3989862248 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:01.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc20139a700 1 --2- 172.21.15.115:0/3989862248 >> v2:172.21.15.159:3300/0 conn(0x7fc1fc069c60 0x7fc1fc1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc20239c700 1 -- 172.21.15.115:0/3989862248 >> v2:172.21.15.159:3300/0 conn(0x7fc1fc069c60 msgr2=0x7fc1fc1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:01.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.164+0000 7fc20239c700 1 --2- 172.21.15.115:0/3989862248 >> v2:172.21.15.159:3300/0 conn(0x7fc1fc069c60 0x7fc1fc1547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.165+0000 7fc20239c700 1 -- 172.21.15.115:0/3989862248 >> v1:172.21.15.159:6789/0 conn(0x7fc1fc0c7250 legacy=0x7fc1fc062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.165+0000 7fc20239c700 1 -- 172.21.15.115:0/3989862248 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc069180 con 0x7fc1fc062a30 2023-07-27T14:41:01.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.165+0000 7fc20239c700 1 --2- 172.21.15.115:0/3989862248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc062a30 0x7fc1fc154cc0 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 rx=0x7fc1fc157bb0 tx=0x7fc1f4009840).ready entity=mon.0 client_cookie=1a4c706db7a1266d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:01.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.165+0000 7fc200b99700 1 -- 172.21.15.115:0/3989862248 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400e070 con 0x7fc1fc062a30 2023-07-27T14:41:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.165+0000 7fc200b99700 1 -- 172.21.15.115:0/3989862248 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f400bab0 con 0x7fc1fc062a30 2023-07-27T14:41:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.165+0000 7fc200b99700 1 -- 172.21.15.115:0/3989862248 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400be30 con 0x7fc1fc062a30 2023-07-27T14:41:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.165+0000 7fc203dff700 1 -- 172.21.15.115:0/3989862248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc062a30 msgr2=0x7fc1fc154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.165+0000 7fc203dff700 1 --2- 172.21.15.115:0/3989862248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc062a30 0x7fc1fc154cc0 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 rx=0x7fc1fc157bb0 tx=0x7fc1f4009840).stop 2023-07-27T14:41:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.166+0000 7fc203dff700 1 -- 172.21.15.115:0/3989862248 shutdown_connections 2023-07-27T14:41:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.166+0000 7fc203dff700 1 --2- 172.21.15.115:0/3989862248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc062a30 0x7fc1fc154cc0 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.166+0000 7fc203dff700 1 --2- 172.21.15.115:0/3989862248 >> v2:172.21.15.159:3300/0 conn(0x7fc1fc069c60 0x7fc1fc1547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.166+0000 7fc203dff700 1 -- 172.21.15.115:0/3989862248 >> 172.21.15.115:0/3989862248 conn(0x7fc1fc0c79a0 msgr2=0x7fc1fc0c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.166+0000 7fc203dff700 1 -- 172.21.15.115:0/3989862248 shutdown_connections 2023-07-27T14:41:01.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.166+0000 7fc203dff700 1 -- 172.21.15.115:0/3989862248 wait complete. 2023-07-27T14:41:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.167+0000 7fc203dff700 1 Processor -- start 2023-07-27T14:41:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.167+0000 7fc203dff700 1 -- start start 2023-07-27T14:41:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc203dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1fc062a30 0x7fc1fc0667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc203dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc069c60 0x7fc1fc150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc203dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1fc0c7250 0x7fc1fc0bd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc203dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0a82d0 con 0x7fc1fc069c60 2023-07-27T14:41:01.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc203dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0a85b0 con 0x7fc1fc062a30 2023-07-27T14:41:01.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc203dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0a8890 con 0x7fc1fc0c7250 2023-07-27T14:41:01.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc20139a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc069c60 0x7fc1fc150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc20139a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc069c60 0x7fc1fc150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51598/0 (socket says 172.21.15.115:51598) 2023-07-27T14:41:01.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.168+0000 7fc20139a700 1 -- 172.21.15.115:0/792415005 learned_addr learned my addr 172.21.15.115:0/792415005 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:01.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc201b9b700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1fc062a30 0x7fc1fc0667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc20239c700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1fc0c7250 0x7fc1fc0bd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc20139a700 1 -- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1fc0c7250 msgr2=0x7fc1fc0bd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc20139a700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1fc0c7250 0x7fc1fc0bd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc20139a700 1 -- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1fc062a30 msgr2=0x7fc1fc0667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc20139a700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1fc062a30 0x7fc1fc0667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc20139a700 1 -- 172.21.15.115:0/792415005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f4009ae0 con 0x7fc1fc069c60 2023-07-27T14:41:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc20239c700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1fc0c7250 0x7fc1fc0bd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc20139a700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc069c60 0x7fc1fc150640 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 rx=0x7fc1ec00e950 tx=0x7fc1ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc1f1ffb700 1 -- 172.21.15.115:0/792415005 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00c8e0 con 0x7fc1fc069c60 2023-07-27T14:41:01.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc1f1ffb700 1 -- 172.21.15.115:0/792415005 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec00ca40 con 0x7fc1fc069c60 2023-07-27T14:41:01.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc0a8b70 con 0x7fc1fc069c60 2023-07-27T14:41:01.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc1f1ffb700 1 -- 172.21.15.115:0/792415005 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00cdc0 con 0x7fc1fc069c60 2023-07-27T14:41:01.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.169+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc0a6d90 con 0x7fc1fc069c60 2023-07-27T14:41:01.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.170+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1fc0aa930 con 0x7fc1fc069c60 2023-07-27T14:41:01.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.171+0000 7fc1f1ffb700 1 -- 172.21.15.115:0/792415005 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fc1ec022070 con 0x7fc1fc069c60 2023-07-27T14:41:01.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.172+0000 7fc1f1ffb700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1e005fdf0 0x7fc1e00622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.172+0000 7fc1f1ffb700 1 -- 172.21.15.115:0/792415005 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc1ec07be10 con 0x7fc1fc069c60 2023-07-27T14:41:01.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.172+0000 7fc201b9b700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1e005fdf0 0x7fc1e00622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.173+0000 7fc201b9b700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1e005fdf0 0x7fc1e00622b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fc1f8007fd0 tx=0x7fc1f8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:01.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.176+0000 7fc1f1ffb700 1 -- 172.21.15.115:0/792415005 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc1ec04c3e0 con 0x7fc1fc069c60 2023-07-27T14:41:01.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.386+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc1fc0aa930 con 0x7fc1fc069c60 2023-07-27T14:41:01.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.394+0000 7fc1f1ffb700 1 -- 172.21.15.115:0/792415005 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 30 and data pool 31 v118) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc1fc0aa930 con 0x7fc1fc069c60 2023-07-27T14:41:01.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.411+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1e005fdf0 msgr2=0x7fc1e00622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.411+0000 7fc203dff700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1e005fdf0 0x7fc1e00622b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fc1f8007fd0 tx=0x7fc1f8009040).stop 2023-07-27T14:41:01.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.411+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc069c60 msgr2=0x7fc1fc150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.411+0000 7fc203dff700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc069c60 0x7fc1fc150640 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 rx=0x7fc1ec00e950 tx=0x7fc1ec009060).stop 2023-07-27T14:41:01.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.412+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 shutdown_connections 2023-07-27T14:41:01.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.412+0000 7fc203dff700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc1e005fdf0 0x7fc1e00622b0 secure :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0x7fc1f8007fd0 tx=0x7fc1f8009040).stop 2023-07-27T14:41:01.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.412+0000 7fc203dff700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1fc0c7250 0x7fc1fc0bd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.412+0000 7fc203dff700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1fc062a30 0x7fc1fc0667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.412+0000 7fc203dff700 1 --2- 172.21.15.115:0/792415005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1fc069c60 0x7fc1fc150640 secure :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 rx=0x7fc1ec00e950 tx=0x7fc1ec009060).stop 2023-07-27T14:41:01.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.412+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 >> 172.21.15.115:0/792415005 conn(0x7fc1fc0c79a0 msgr2=0x7fc1fc156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:01.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.415+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 shutdown_connections 2023-07-27T14:41:01.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.417+0000 7fc203dff700 1 -- 172.21.15.115:0/792415005 wait complete. 2023-07-27T14:41:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 30 and data pool 31 2023-07-27T14:41:01.497 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:41:01.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.629+0000 7f632d9ff700 1 Processor -- start 2023-07-27T14:41:01.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.629+0000 7f632d9ff700 1 -- start start 2023-07-27T14:41:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f632d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f6328062320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f632d9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6328062810 0x7f63280a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f632d9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63280639d0 con 0x7f63280a4d30 2023-07-27T14:41:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f632d9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6328137610 con 0x7f6328062810 2023-07-27T14:41:01.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f632d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280a51e0 con 0x7f6328151bd0 2023-07-27T14:41:01.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f63267fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6328062810 0x7f63280a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f63267fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6328062810 0x7f63280a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51604/0 (socket says 172.21.15.115:51604) 2023-07-27T14:41:01.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f63277fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f63280a4d30 0x7f6328157ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33294/0 (socket says 172.21.15.115:33294) 2023-07-27T14:41:01.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.630+0000 7f63267fc700 1 -- 172.21.15.115:0/2912075276 learned_addr learned my addr 172.21.15.115:0/2912075276 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:01.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f6326ffd700 1 --2- 172.21.15.115:0/2912075276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f6328062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f63267fc700 1 -- 172.21.15.115:0/2912075276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 msgr2=0x7f6328062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:01.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f63267fc700 1 --2- 172.21.15.115:0/2912075276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f6328062320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f63267fc700 1 -- 172.21.15.115:0/2912075276 >> v1:172.21.15.115:6789/0 conn(0x7f63280a4d30 legacy=0x7f6328157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f63267fc700 1 -- 172.21.15.115:0/2912075276 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328062dc0 con 0x7f6328062810 2023-07-27T14:41:01.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f6326ffd700 1 --2- 172.21.15.115:0/2912075276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f6328062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:01.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f6325ffb700 1 -- 172.21.15.115:0/2912075276 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104665391 0 0) 0x7f63280639d0 con 0x7f63280a4d30 2023-07-27T14:41:01.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f63267fc700 1 --2- 172.21.15.115:0/2912075276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f63280a4840 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 rx=0x7f631c006fd0 tx=0x7f631c0090f0).ready entity=mon.0 client_cookie=f478381a2f799410 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:01.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f6325ffb700 1 -- 172.21.15.115:0/2912075276 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00b600 con 0x7f6328062810 2023-07-27T14:41:01.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f6325ffb700 1 -- 172.21.15.115:0/2912075276 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00b760 con 0x7f6328062810 2023-07-27T14:41:01.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.631+0000 7f6325ffb700 1 -- 172.21.15.115:0/2912075276 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00bae0 con 0x7f6328062810 2023-07-27T14:41:01.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.632+0000 7f632d9ff700 1 -- 172.21.15.115:0/2912075276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 msgr2=0x7f63280a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.632+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2912075276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f63280a4840 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 rx=0x7f631c006fd0 tx=0x7f631c0090f0).stop 2023-07-27T14:41:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.632+0000 7f632d9ff700 1 -- 172.21.15.115:0/2912075276 shutdown_connections 2023-07-27T14:41:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.632+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2912075276 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f6328062320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.632+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2912075276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f63280a4840 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.632+0000 7f632d9ff700 1 -- 172.21.15.115:0/2912075276 >> 172.21.15.115:0/2912075276 conn(0x7f6328064700 msgr2=0x7f6328064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.632+0000 7f632d9ff700 1 -- 172.21.15.115:0/2912075276 shutdown_connections 2023-07-27T14:41:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.632+0000 7f632d9ff700 1 -- 172.21.15.115:0/2912075276 wait complete. 2023-07-27T14:41:01.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.633+0000 7f632d9ff700 1 Processor -- start 2023-07-27T14:41:01.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.634+0000 7f632d9ff700 1 -- start start 2023-07-27T14:41:01.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.634+0000 7f632d9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f6328163d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.634+0000 7f632d9ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63280a4d30 0x7f63280bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f632d9ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f63280bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f632d9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280a7540 con 0x7f6328062810 2023-07-27T14:41:01.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f632d9ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c0b40 con 0x7f63280a4d30 2023-07-27T14:41:01.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f632d9ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280bff30 con 0x7f6328151bd0 2023-07-27T14:41:01.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f6328163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f6328163d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51614/0 (socket says 172.21.15.115:51614) 2023-07-27T14:41:01.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 -- 172.21.15.115:0/2385653434 learned_addr learned my addr 172.21.15.115:0/2385653434 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:01.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f63277fe700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f63280bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f63267fc700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63280a4d30 0x7f63280bf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 -- 172.21.15.115:0/2385653434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 msgr2=0x7f63280bf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f63280bf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 -- 172.21.15.115:0/2385653434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63280a4d30 msgr2=0x7f63280bf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63280a4d30 0x7f63280bf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 -- 172.21.15.115:0/2385653434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c009370 con 0x7f6328062810 2023-07-27T14:41:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.635+0000 7f6326ffd700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f6328163d40 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 rx=0x7f631800d890 tx=0x7f6318008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.636+0000 7f630effd700 1 -- 172.21.15.115:0/2385653434 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63180125f0 con 0x7f6328062810 2023-07-27T14:41:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.636+0000 7f630effd700 1 -- 172.21.15.115:0/2385653434 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318012750 con 0x7f6328062810 2023-07-27T14:41:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.636+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63280c0210 con 0x7f6328062810 2023-07-27T14:41:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.636+0000 7f630effd700 1 -- 172.21.15.115:0/2385653434 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318012ad0 con 0x7f6328062810 2023-07-27T14:41:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.636+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63280c07d0 con 0x7f6328062810 2023-07-27T14:41:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.637+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63280625d0 con 0x7f6328062810 2023-07-27T14:41:01.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.638+0000 7f630effd700 1 -- 172.21.15.115:0/2385653434 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f6318013480 con 0x7f6328062810 2023-07-27T14:41:01.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.638+0000 7f630effd700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405fe50 0x7f6314062310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:01.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.638+0000 7f630effd700 1 -- 172.21.15.115:0/2385653434 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f631807b480 con 0x7f6328062810 2023-07-27T14:41:01.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.639+0000 7f63267fc700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405fe50 0x7f6314062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:01.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.639+0000 7f63267fc700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405fe50 0x7f6314062310 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f631c006fd0 tx=0x7f631c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:01.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.643+0000 7f630effd700 1 -- 172.21.15.115:0/2385653434 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f631804b8b0 con 0x7f6328062810 2023-07-27T14:41:01.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.816+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63280c0e20 con 0x7f6328062810 2023-07-27T14:41:01.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.817+0000 7f630effd700 1 -- 172.21.15.115:0/2385653434 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) v1 ==== 74+0+17143 (secure 0 0 0) 0x7f631804eed0 con 0x7f6328062810 2023-07-27T14:41:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:41:01.875 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":217,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:41:01.387587+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:40:59.612599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":31,"pool_name":"cephfs_data","create_time":"2023-07-27T14:41:00.373474+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:41:01.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405fe50 msgr2=0x7f6314062310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405fe50 0x7f6314062310 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f631c006fd0 tx=0x7f631c017000).stop 2023-07-27T14:41:01.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 msgr2=0x7f6328163d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:01.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f6328163d40 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 rx=0x7f631800d890 tx=0x7f6318008040).stop 2023-07-27T14:41:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 shutdown_connections 2023-07-27T14:41:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f631405fe50 0x7f6314062310 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6328151bd0 0x7f63280bf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6328062810 0x7f6328163d40 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 --2- 172.21.15.115:0/2385653434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63280a4d30 0x7f63280bf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 >> 172.21.15.115:0/2385653434 conn(0x7f6328064700 msgr2=0x7f63280c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 shutdown_connections 2023-07-27T14:41:01.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:01.819+0000 7f632d9ff700 1 -- 172.21.15.115:0/2385653434 wait complete. 2023-07-27T14:41:01.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:41:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.026+0000 7fcee55ff700 1 Processor -- start 2023-07-27T14:41:02.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.027+0000 7fcee55ff700 1 -- start start 2023-07-27T14:41:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcee55ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcee0153ec0 0x7fcee00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcee55ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcee00aa050 0x7fcee00640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcee55ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee00aa4d0 con 0x7fcee00aaa40 2023-07-27T14:41:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcee55ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee00c05c0 con 0x7fcee0153ec0 2023-07-27T14:41:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcee55ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee00c1a60 con 0x7fcee00aa050 2023-07-27T14:41:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcedeffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcee0153ec0 0x7fcee00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcedeffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcee0153ec0 0x7fcee00a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51620/0 (socket says 172.21.15.115:51620) 2023-07-27T14:41:02.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcedf7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcee00aaa40 0x7fcee0157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33296/0 (socket says 172.21.15.115:33296) 2023-07-27T14:41:02.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcedeffd700 1 -- 172.21.15.115:0/3703924637 learned_addr learned my addr 172.21.15.115:0/3703924637 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:02.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.028+0000 7fcede7fc700 1 --2- 172.21.15.115:0/3703924637 >> v2:172.21.15.159:3300/0 conn(0x7fcee00aa050 0x7fcee00640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fcedeffd700 1 -- 172.21.15.115:0/3703924637 >> v2:172.21.15.159:3300/0 conn(0x7fcee00aa050 msgr2=0x7fcee00640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:02.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fcedeffd700 1 --2- 172.21.15.115:0/3703924637 >> v2:172.21.15.159:3300/0 conn(0x7fcee00aa050 0x7fcee00640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fcedeffd700 1 -- 172.21.15.115:0/3703924637 >> v1:172.21.15.115:6789/0 conn(0x7fcee00aaa40 legacy=0x7fcee0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fcedeffd700 1 -- 172.21.15.115:0/3703924637 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00bfc90 con 0x7fcee0153ec0 2023-07-27T14:41:02.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fceddffb700 1 -- 172.21.15.115:0/3703924637 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693642422 0 0) 0x7fced8001490 con 0x7fcee00aaa40 2023-07-27T14:41:02.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fcedeffd700 1 --2- 172.21.15.115:0/3703924637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee0153ec0 0x7fcee00a9b60 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 rx=0x7fcee006c0d0 tx=0x7fced00090f0).ready entity=mon.0 client_cookie=127f08a95a27921f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:02.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fceddffb700 1 -- 172.21.15.115:0/3703924637 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000b520 con 0x7fcee0153ec0 2023-07-27T14:41:02.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fceddffb700 1 -- 172.21.15.115:0/3703924637 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced000b680 con 0x7fcee0153ec0 2023-07-27T14:41:02.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.029+0000 7fceddffb700 1 -- 172.21.15.115:0/3703924637 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000ba00 con 0x7fcee0153ec0 2023-07-27T14:41:02.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.030+0000 7fcee55ff700 1 -- 172.21.15.115:0/3703924637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee0153ec0 msgr2=0x7fcee00a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.030+0000 7fcee55ff700 1 --2- 172.21.15.115:0/3703924637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee0153ec0 0x7fcee00a9b60 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 rx=0x7fcee006c0d0 tx=0x7fced00090f0).stop 2023-07-27T14:41:02.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.030+0000 7fcee55ff700 1 -- 172.21.15.115:0/3703924637 shutdown_connections 2023-07-27T14:41:02.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.030+0000 7fcee55ff700 1 --2- 172.21.15.115:0/3703924637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee0153ec0 0x7fcee00a9b60 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.030+0000 7fcee55ff700 1 --2- 172.21.15.115:0/3703924637 >> v2:172.21.15.159:3300/0 conn(0x7fcee00aa050 0x7fcee00640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.030+0000 7fcee55ff700 1 -- 172.21.15.115:0/3703924637 >> 172.21.15.115:0/3703924637 conn(0x7fcee00cb610 msgr2=0x7fcee00c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:02.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.030+0000 7fcee55ff700 1 -- 172.21.15.115:0/3703924637 shutdown_connections 2023-07-27T14:41:02.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.030+0000 7fcee55ff700 1 -- 172.21.15.115:0/3703924637 wait complete. 2023-07-27T14:41:02.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.032+0000 7fcee55ff700 1 Processor -- start 2023-07-27T14:41:02.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.032+0000 7fcee55ff700 1 -- start start 2023-07-27T14:41:02.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.033+0000 7fcee55ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00aa050 0x7fcee00aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.033+0000 7fcee55ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee00aaa40 0x7fcee0163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.033+0000 7fcee55ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee0153ec0 0x7fcee0163c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.033+0000 7fcee55ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee00c1c30 con 0x7fcee00aaa40 2023-07-27T14:41:02.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.033+0000 7fcee55ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0164100 con 0x7fcee00aa050 2023-07-27T14:41:02.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.033+0000 7fcee55ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee00c1e80 con 0x7fcee0153ec0 2023-07-27T14:41:02.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee00aaa40 0x7fcee0163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee00aaa40 0x7fcee0163720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51624/0 (socket says 172.21.15.115:51624) 2023-07-27T14:41:02.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 -- 172.21.15.115:0/1415712762 learned_addr learned my addr 172.21.15.115:0/1415712762 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:02.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcedeffd700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00aa050 0x7fcee00aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcedf7fe700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee0153ec0 0x7fcee0163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 -- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee0153ec0 msgr2=0x7fcee0163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee0153ec0 0x7fcee0163c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 -- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00aa050 msgr2=0x7fcee00aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00aa050 0x7fcee00aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 -- 172.21.15.115:0/1415712762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0009370 con 0x7fcee00aaa40 2023-07-27T14:41:02.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcedeffd700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00aa050 0x7fcee00aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:02.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcede7fc700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee00aaa40 0x7fcee0163720 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 rx=0x7fced400e930 tx=0x7fced4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:02.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcec6ffd700 1 -- 172.21.15.115:0/1415712762 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400eed0 con 0x7fcee00aaa40 2023-07-27T14:41:02.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcec6ffd700 1 -- 172.21.15.115:0/1415712762 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400c850 con 0x7fcee00aaa40 2023-07-27T14:41:02.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee00c2160 con 0x7fcee00aaa40 2023-07-27T14:41:02.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.034+0000 7fcec6ffd700 1 -- 172.21.15.115:0/1415712762 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400cbd0 con 0x7fcee00aaa40 2023-07-27T14:41:02.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.035+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee00c2720 con 0x7fcee00aaa40 2023-07-27T14:41:02.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.035+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee00c2a90 con 0x7fcee00aaa40 2023-07-27T14:41:02.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.036+0000 7fcec6ffd700 1 -- 172.21.15.115:0/1415712762 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fced4022070 con 0x7fcee00aaa40 2023-07-27T14:41:02.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.037+0000 7fcec6ffd700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcecc05fe20 0x7fcecc0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.037+0000 7fcec6ffd700 1 -- 172.21.15.115:0/1415712762 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fced407bab0 con 0x7fcee00aaa40 2023-07-27T14:41:02.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.037+0000 7fcedeffd700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcecc05fe20 0x7fcecc0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.038+0000 7fcedeffd700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcecc05fe20 0x7fcecc0622e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fced0009130 tx=0x7fced0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:02.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.041+0000 7fcec6ffd700 1 -- 172.21.15.115:0/1415712762 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fced404be90 con 0x7fcee00aaa40 2023-07-27T14:41:02.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.212+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcee006c470 con 0x7fcee00aaa40 2023-07-27T14:41:02.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.213+0000 7fcec6ffd700 1 -- 172.21.15.115:0/1415712762 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) v1 ==== 74+0+17143 (secure 0 0 0) 0x7fced407b070 con 0x7fcee00aaa40 2023-07-27T14:41:02.270 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:41:02.270 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":217,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:41:01.387587+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:40:59.612599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":31,"pool_name":"cephfs_data","create_time":"2023-07-27T14:41:00.373474+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:41:02.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcecc05fe20 msgr2=0x7fcecc0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcecc05fe20 0x7fcecc0622e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fced0009130 tx=0x7fced0017000).stop 2023-07-27T14:41:02.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee00aaa40 msgr2=0x7fcee0163720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee00aaa40 0x7fcee0163720 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 rx=0x7fced400e930 tx=0x7fced4009060).stop 2023-07-27T14:41:02.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 shutdown_connections 2023-07-27T14:41:02.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcecc05fe20 0x7fcecc0622e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcee0153ec0 0x7fcee0163c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcee00aa050 0x7fcee00aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 --2- 172.21.15.115:0/1415712762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcee00aaa40 0x7fcee0163720 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 >> 172.21.15.115:0/1415712762 conn(0x7fcee00cb610 msgr2=0x7fcee00640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:02.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 shutdown_connections 2023-07-27T14:41:02.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.215+0000 7fcee55ff700 1 -- 172.21.15.115:0/1415712762 wait complete. 2023-07-27T14:41:02.289 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-27T14:41:02.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.426+0000 7fb8701ff700 1 Processor -- start 2023-07-27T14:41:02.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.426+0000 7fb8701ff700 1 -- start start 2023-07-27T14:41:02.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb8701ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb868063260 0x7fb868154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb8701ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb8680a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb8701ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8681553f0 con 0x7fb86814ae00 2023-07-27T14:41:02.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb8701ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb868157a50 con 0x7fb868063260 2023-07-27T14:41:02.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb8701ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb868157d10 con 0x7fb86814b1e0 2023-07-27T14:41:02.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb86d79a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb868063260 0x7fb868154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb86d79a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb868063260 0x7fb868154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51638/0 (socket says 172.21.15.115:51638) 2023-07-27T14:41:02.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb86d79a700 1 -- 172.21.15.115:0/3133429616 learned_addr learned my addr 172.21.15.115:0/3133429616 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:02.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb86df9b700 1 --1- 172.21.15.115:0/3133429616 >> v1:172.21.15.115:6789/0 conn(0x7fb86814ae00 0x7fb868062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:33308/0 (socket says 172.21.15.115:33308) 2023-07-27T14:41:02.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb86d79a700 1 -- 172.21.15.115:0/3133429616 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 msgr2=0x7fb8680a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:02.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb86e79c700 1 --2- 172.21.15.115:0/3133429616 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb8680a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.428+0000 7fb86cf99700 1 -- 172.21.15.115:0/3133429616 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878653482 0 0) 0x7fb8681553f0 con 0x7fb86814ae00 2023-07-27T14:41:02.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb86d79a700 1 --2- 172.21.15.115:0/3133429616 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb8680a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb86d79a700 1 -- 172.21.15.115:0/3133429616 >> v1:172.21.15.115:6789/0 conn(0x7fb86814ae00 legacy=0x7fb868062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb86d79a700 1 -- 172.21.15.115:0/3133429616 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb868157ff0 con 0x7fb868063260 2023-07-27T14:41:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb86e79c700 1 --2- 172.21.15.115:0/3133429616 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb8680a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb86d79a700 1 --2- 172.21.15.115:0/3133429616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868154f00 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 rx=0x7fb858006fd0 tx=0x7fb8580090f0).ready entity=mon.0 client_cookie=d8ccdf05815bb6f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb86cf99700 1 -- 172.21.15.115:0/3133429616 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800b600 con 0x7fb868063260 2023-07-27T14:41:02.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb86cf99700 1 -- 172.21.15.115:0/3133429616 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800b760 con 0x7fb868063260 2023-07-27T14:41:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb86cf99700 1 -- 172.21.15.115:0/3133429616 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800bae0 con 0x7fb868063260 2023-07-27T14:41:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb8701ff700 1 -- 172.21.15.115:0/3133429616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 msgr2=0x7fb868154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.429+0000 7fb8701ff700 1 --2- 172.21.15.115:0/3133429616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868154f00 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 rx=0x7fb858006fd0 tx=0x7fb8580090f0).stop 2023-07-27T14:41:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.430+0000 7fb8701ff700 1 -- 172.21.15.115:0/3133429616 shutdown_connections 2023-07-27T14:41:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.430+0000 7fb8701ff700 1 --2- 172.21.15.115:0/3133429616 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb8680a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.430+0000 7fb8701ff700 1 --2- 172.21.15.115:0/3133429616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868154f00 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.430+0000 7fb8701ff700 1 -- 172.21.15.115:0/3133429616 >> 172.21.15.115:0/3133429616 conn(0x7fb86805e940 msgr2=0x7fb8680cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:02.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.430+0000 7fb8701ff700 1 -- 172.21.15.115:0/3133429616 shutdown_connections 2023-07-27T14:41:02.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.430+0000 7fb8701ff700 1 -- 172.21.15.115:0/3133429616 wait complete. 2023-07-27T14:41:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.432+0000 7fb8701ff700 1 Processor -- start 2023-07-27T14:41:02.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.432+0000 7fb8701ff700 1 -- start start 2023-07-27T14:41:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb8701ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb8701ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb86814ae00 0x7fb8680af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb8701ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb868166e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb8701ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680afbd0 con 0x7fb868063260 2023-07-27T14:41:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb8701ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680afeb0 con 0x7fb86814ae00 2023-07-27T14:41:02.492 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb8701ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680b0190 con 0x7fb86814b1e0 2023-07-27T14:41:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb86df9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb86df9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51646/0 (socket says 172.21.15.115:51646) 2023-07-27T14:41:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.433+0000 7fb86df9b700 1 -- 172.21.15.115:0/2805307875 learned_addr learned my addr 172.21.15.115:0/2805307875 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb86d79a700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb86814ae00 0x7fb8680af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb86e79c700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb868166e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb86df9b700 1 -- 172.21.15.115:0/2805307875 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 msgr2=0x7fb868166e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb86df9b700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb868166e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb86df9b700 1 -- 172.21.15.115:0/2805307875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb86814ae00 msgr2=0x7fb8680af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb86df9b700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb86814ae00 0x7fb8680af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb86df9b700 1 -- 172.21.15.115:0/2805307875 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009370 con 0x7fb868063260 2023-07-27T14:41:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb86df9b700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868153190 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 rx=0x7fb86400c560 tx=0x7fb864007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:02.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb85dffb700 1 -- 172.21.15.115:0/2805307875 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8640072e0 con 0x7fb868063260 2023-07-27T14:41:02.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb85dffb700 1 -- 172.21.15.115:0/2805307875 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864007440 con 0x7fb868063260 2023-07-27T14:41:02.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8680b0470 con 0x7fb868063260 2023-07-27T14:41:02.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb85dffb700 1 -- 172.21.15.115:0/2805307875 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864005930 con 0x7fb868063260 2023-07-27T14:41:02.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.434+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8681674d0 con 0x7fb868063260 2023-07-27T14:41:02.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.435+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8680b0660 con 0x7fb868063260 2023-07-27T14:41:02.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.436+0000 7fb85dffb700 1 -- 172.21.15.115:0/2805307875 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fb864010070 con 0x7fb868063260 2023-07-27T14:41:02.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.437+0000 7fb85dffb700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb84c05fe50 0x7fb84c062310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:02.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.437+0000 7fb85dffb700 1 -- 172.21.15.115:0/2805307875 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb86407ab30 con 0x7fb868063260 2023-07-27T14:41:02.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.437+0000 7fb86d79a700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb84c05fe50 0x7fb84c062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.438+0000 7fb86d79a700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb84c05fe50 0x7fb84c062310 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fb868063660 tx=0x7fb858017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:02.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.441+0000 7fb85dffb700 1 -- 172.21.15.115:0/2805307875 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb86404af10 con 0x7fb868063260 2023-07-27T14:41:02.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:41:02.682 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:41:02.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:02.656+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb86806c470 con 0x7fb868063260 2023-07-27T14:41:03.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.399+0000 7fb85dffb700 1 -- 172.21.15.115:0/2805307875 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v120) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb86404e530 con 0x7fb868063260 2023-07-27T14:41:03.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb84c05fe50 msgr2=0x7fb84c062310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:03.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb84c05fe50 0x7fb84c062310 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fb868063660 tx=0x7fb858017000).stop 2023-07-27T14:41:03.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 msgr2=0x7fb868153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:03.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868153190 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 rx=0x7fb86400c560 tx=0x7fb864007c90).stop 2023-07-27T14:41:03.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 shutdown_connections 2023-07-27T14:41:03.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb84c05fe50 0x7fb84c062310 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb86814b1e0 0x7fb868166e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb868063260 0x7fb868153190 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 --2- 172.21.15.115:0/2805307875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb86814ae00 0x7fb8680af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.401+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 >> 172.21.15.115:0/2805307875 conn(0x7fb86805e940 msgr2=0x7fb8680c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:03.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.402+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 shutdown_connections 2023-07-27T14:41:03.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.402+0000 7fb8701ff700 1 -- 172.21.15.115:0/2805307875 wait complete. 2023-07-27T14:41:03.477 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-27T14:41:03.478 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-27T14:41:03.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.616+0000 7f9c843ff700 1 Processor -- start 2023-07-27T14:41:03.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.616+0000 7f9c843ff700 1 -- start start 2023-07-27T14:41:03.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.617+0000 7f9c843ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c0c6b70 0x7f9c7c0656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:03.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.617+0000 7f9c843ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9c7c065bc0 0x7f9c7c062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:03.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.617+0000 7f9c843ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c066050 con 0x7f9c7c153e00 2023-07-27T14:41:03.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.617+0000 7f9c843ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c062320 con 0x7f9c7c065bc0 2023-07-27T14:41:03.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.617+0000 7f9c843ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c064a80 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.617+0000 7f9c8219b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9c7c153e00 0x7f9c7c064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36200/0 (socket says 172.21.15.115:36200) 2023-07-27T14:41:03.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.617+0000 7f9c8219b700 1 -- 172.21.15.115:0/247719095 learned_addr learned my addr 172.21.15.115:0/247719095 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:03.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c8299c700 1 --2- 172.21.15.115:0/247719095 >> v2:172.21.15.159:3300/0 conn(0x7f9c7c065bc0 0x7f9c7c062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:03.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c8199a700 1 --2- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c0c6b70 0x7f9c7c0656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:03.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c81199700 1 -- 172.21.15.115:0/247719095 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520444709 0 0) 0x7f9c7c066050 con 0x7f9c7c153e00 2023-07-27T14:41:03.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c81199700 1 -- 172.21.15.115:0/247719095 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c680033f0 con 0x7f9c7c153e00 2023-07-27T14:41:03.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c81199700 1 -- 172.21.15.115:0/247719095 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184086572 0 0) 0x7f9c680033f0 con 0x7f9c7c153e00 2023-07-27T14:41:03.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c8299c700 1 -- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c0c6b70 msgr2=0x7f9c7c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:03.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c8299c700 1 --2- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c0c6b70 0x7f9c7c0656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c8299c700 1 -- 172.21.15.115:0/247719095 >> v1:172.21.15.115:6789/0 conn(0x7f9c7c153e00 legacy=0x7f9c7c064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:03.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.618+0000 7f9c8299c700 1 -- 172.21.15.115:0/247719095 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c064d60 con 0x7f9c7c065bc0 2023-07-27T14:41:03.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.619+0000 7f9c8199a700 1 --2- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c0c6b70 0x7f9c7c0656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:41:03.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.619+0000 7f9c8299c700 1 --2- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 0x7f9c7c062770 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f9c74009e60 tx=0x7f9c74009780).ready entity=mon.1 client_cookie=14e35519de433e98 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:03.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.619+0000 7f9c81199700 1 -- 172.21.15.115:0/247719095 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400e070 con 0x7f9c7c065bc0 2023-07-27T14:41:03.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.619+0000 7f9c81199700 1 -- 172.21.15.115:0/247719095 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400b7a0 con 0x7f9c7c065bc0 2023-07-27T14:41:03.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.619+0000 7f9c81199700 1 -- 172.21.15.115:0/247719095 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78001470 con 0x7f9c7c065bc0 2023-07-27T14:41:03.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.620+0000 7f9c843ff700 1 -- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 msgr2=0x7f9c7c062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:03.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.620+0000 7f9c843ff700 1 --2- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 0x7f9c7c062770 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f9c74009e60 tx=0x7f9c74009780).stop 2023-07-27T14:41:03.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.620+0000 7f9c843ff700 1 -- 172.21.15.115:0/247719095 shutdown_connections 2023-07-27T14:41:03.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.620+0000 7f9c843ff700 1 --2- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 0x7f9c7c062770 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.620+0000 7f9c843ff700 1 --2- 172.21.15.115:0/247719095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c0c6b70 0x7f9c7c0656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.620+0000 7f9c843ff700 1 -- 172.21.15.115:0/247719095 >> 172.21.15.115:0/247719095 conn(0x7f9c7c0c7b90 msgr2=0x7f9c7c0c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:03.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.620+0000 7f9c843ff700 1 -- 172.21.15.115:0/247719095 shutdown_connections 2023-07-27T14:41:03.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.620+0000 7f9c843ff700 1 -- 172.21.15.115:0/247719095 wait complete. 2023-07-27T14:41:03.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.621+0000 7f9c843ff700 1 Processor -- start 2023-07-27T14:41:03.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.622+0000 7f9c843ff700 1 -- start start 2023-07-27T14:41:03.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.622+0000 7f9c843ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 0x7f9c7c163400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:03.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.622+0000 7f9c843ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c7c0c6b70 0x7f9c7c0a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:03.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.622+0000 7f9c843ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c153e00 0x7f9c7c154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:03.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.622+0000 7f9c843ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c155af0 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.622+0000 7f9c843ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1596f0 con 0x7f9c7c065bc0 2023-07-27T14:41:03.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.622+0000 7f9c843ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c155530 con 0x7f9c7c153e00 2023-07-27T14:41:03.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c7c0c6b70 0x7f9c7c0a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:03.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c7c0c6b70 0x7f9c7c0a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48682/0 (socket says 172.21.15.115:48682) 2023-07-27T14:41:03.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 -- 172.21.15.115:0/3158963768 learned_addr learned my addr 172.21.15.115:0/3158963768 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:03.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8299c700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c153e00 0x7f9c7c154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:03.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8219b700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 0x7f9c7c163400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:03.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 -- 172.21.15.115:0/3158963768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c153e00 msgr2=0x7f9c7c154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:03.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c153e00 0x7f9c7c154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 -- 172.21.15.115:0/3158963768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 msgr2=0x7f9c7c163400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:03.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 0x7f9c7c163400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:03.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 -- 172.21.15.115:0/3158963768 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0092a0 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.623+0000 7f9c8199a700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c7c0c6b70 0x7f9c7c0a6bf0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 rx=0x7f9c6c00ea20 tx=0x7f9c6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:03.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.624+0000 7f9c727fc700 1 -- 172.21.15.115:0/3158963768 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00c850 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.624+0000 7f9c727fc700 1 -- 172.21.15.115:0/3158963768 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c00c9b0 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.624+0000 7f9c727fc700 1 -- 172.21.15.115:0/3158963768 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00cd30 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.624+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c74009a20 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.624+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c1599b0 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.625+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c159d20 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.626+0000 7f9c727fc700 1 -- 172.21.15.115:0/3158963768 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f9c6c022070 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.626+0000 7f9c727fc700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6005fe20 0x7f9c600622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:03.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.626+0000 7f9c727fc700 1 -- 172.21.15.115:0/3158963768 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f9c6c07bb10 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.627+0000 7f9c8219b700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6005fe20 0x7f9c600622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:03.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.627+0000 7f9c8219b700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6005fe20 0x7f9c600622e0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f9c78005b00 tx=0x7f9c780018a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:03.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.630+0000 7f9c727fc700 1 -- 172.21.15.115:0/3158963768 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c6c04bef0 con 0x7f9c7c0c6b70 2023-07-27T14:41:03.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:03.842+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9c7c06c470 con 0x7f9c7c0c6b70 2023-07-27T14:41:04.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.405+0000 7f9c727fc700 1 -- 172.21.15.115:0/3158963768 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v121) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9c6c04f510 con 0x7f9c7c0c6b70 2023-07-27T14:41:04.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6005fe20 msgr2=0x7f9c600622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6005fe20 0x7f9c600622e0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f9c78005b00 tx=0x7f9c780018a0).stop 2023-07-27T14:41:04.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c7c0c6b70 msgr2=0x7f9c7c0a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c7c0c6b70 0x7f9c7c0a6bf0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 rx=0x7f9c6c00ea20 tx=0x7f9c6c009060).stop 2023-07-27T14:41:04.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 shutdown_connections 2023-07-27T14:41:04.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9c6005fe20 0x7f9c600622e0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9c7c153e00 0x7f9c7c154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c7c065bc0 0x7f9c7c163400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 --2- 172.21.15.115:0/3158963768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c7c0c6b70 0x7f9c7c0a6bf0 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 >> 172.21.15.115:0/3158963768 conn(0x7f9c7c0c7b90 msgr2=0x7f9c7c0c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:04.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 shutdown_connections 2023-07-27T14:41:04.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.407+0000 7f9c843ff700 1 -- 172.21.15.115:0/3158963768 wait complete. 2023-07-27T14:41:04.482 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-27T14:41:04.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:41:04.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.614+0000 7f546fbff700 1 Processor -- start 2023-07-27T14:41:04.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.614+0000 7f546fbff700 1 -- start start 2023-07-27T14:41:04.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.615+0000 7f546fbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54680aaa40 0x7f54680640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:04.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.615+0000 7f546fbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54680aa4d0 con 0x7f54681542a0 2023-07-27T14:41:04.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.615+0000 7f546fbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54680c05c0 con 0x7f5468153ec0 2023-07-27T14:41:04.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.615+0000 7f546fbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54680aa270 con 0x7f54680aaa40 2023-07-27T14:41:04.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546e19c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f54681542a0 0x7f54680c0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36212/0 (socket says 172.21.15.115:36212) 2023-07-27T14:41:04.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546e19c700 1 -- 172.21.15.115:0/2230156147 learned_addr learned my addr 172.21.15.115:0/2230156147 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:04.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546d19a700 1 --2- 172.21.15.115:0/2230156147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54680aaa40 0x7f54680640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:04.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546c999700 1 -- 172.21.15.115:0/2230156147 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526085897 0 0) 0x7f5460001490 con 0x7f54681542a0 2023-07-27T14:41:04.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546c999700 1 -- 172.21.15.115:0/2230156147 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54540033f0 con 0x7f54681542a0 2023-07-27T14:41:04.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546c999700 1 -- 172.21.15.115:0/2230156147 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287483733 0 0) 0x7f54680c05c0 con 0x7f5468153ec0 2023-07-27T14:41:04.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546c999700 1 -- 172.21.15.115:0/2230156147 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5460001490 con 0x7f5468153ec0 2023-07-27T14:41:04.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546d19a700 1 -- 172.21.15.115:0/2230156147 >> v1:172.21.15.159:6789/0 conn(0x7f5468153ec0 legacy=0x7f54680a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546d19a700 1 -- 172.21.15.115:0/2230156147 >> v1:172.21.15.115:6789/0 conn(0x7f54681542a0 legacy=0x7f54680c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546c999700 1 -- 172.21.15.115:0/2230156147 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 423117352 0 0) 0x7f54540033f0 con 0x7f54681542a0 2023-07-27T14:41:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.616+0000 7f546d19a700 1 -- 172.21.15.115:0/2230156147 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54680bfc90 con 0x7f54680aaa40 2023-07-27T14:41:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546d19a700 1 --2- 172.21.15.115:0/2230156147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54680aaa40 0x7f54680640f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f5458009790 tx=0x7f5458009060).ready entity=mon.2 client_cookie=31311e7f5acec51d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:04.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546c999700 1 -- 172.21.15.115:0/2230156147 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460001980 con 0x7f54680aaa40 2023-07-27T14:41:04.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546c999700 1 -- 172.21.15.115:0/2230156147 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5458011400 con 0x7f54680aaa40 2023-07-27T14:41:04.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546c999700 1 -- 172.21.15.115:0/2230156147 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458011780 con 0x7f54680aaa40 2023-07-27T14:41:04.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546fbff700 1 -- 172.21.15.115:0/2230156147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54680aaa40 msgr2=0x7f54680640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546fbff700 1 --2- 172.21.15.115:0/2230156147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54680aaa40 0x7f54680640f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f5458009790 tx=0x7f5458009060).stop 2023-07-27T14:41:04.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546fbff700 1 -- 172.21.15.115:0/2230156147 shutdown_connections 2023-07-27T14:41:04.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546fbff700 1 --2- 172.21.15.115:0/2230156147 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f54680aaa40 0x7f54680640f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.617+0000 7f546fbff700 1 -- 172.21.15.115:0/2230156147 >> 172.21.15.115:0/2230156147 conn(0x7f54680cb610 msgr2=0x7f54680c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:04.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.618+0000 7f546fbff700 1 -- 172.21.15.115:0/2230156147 shutdown_connections 2023-07-27T14:41:04.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.618+0000 7f546fbff700 1 -- 172.21.15.115:0/2230156147 wait complete. 2023-07-27T14:41:04.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.619+0000 7f546fbff700 1 Processor -- start 2023-07-27T14:41:04.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.619+0000 7f546fbff700 1 -- start start 2023-07-27T14:41:04.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546fbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54680aaa40 0x7f54681581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:04.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546fbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5468153ec0 0x7f5468156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:04.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546fbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54681542a0 0x7f54681510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:04.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546fbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5468157d50 con 0x7f54680aaa40 2023-07-27T14:41:04.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546fbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681515c0 con 0x7f54681542a0 2023-07-27T14:41:04.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546fbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5468157140 con 0x7f5468153ec0 2023-07-27T14:41:04.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546d99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54680aaa40 0x7f54681581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:04.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546d99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54680aaa40 0x7f54681581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48698/0 (socket says 172.21.15.115:48698) 2023-07-27T14:41:04.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546d99b700 1 -- 172.21.15.115:0/3575751516 learned_addr learned my addr 172.21.15.115:0/3575751516 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:04.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546d19a700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5468153ec0 0x7f5468156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:04.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.620+0000 7f546e19c700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54681542a0 0x7f54681510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:04.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f546d99b700 1 -- 172.21.15.115:0/3575751516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5468153ec0 msgr2=0x7f5468156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f546d99b700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5468153ec0 0x7f5468156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f546d99b700 1 -- 172.21.15.115:0/3575751516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54681542a0 msgr2=0x7f54681510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f546d99b700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54681542a0 0x7f54681510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f546d99b700 1 -- 172.21.15.115:0/3575751516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580092a0 con 0x7f54680aaa40 2023-07-27T14:41:04.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f546d99b700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54680aaa40 0x7f54681581e0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 rx=0x7f546400c4c0 tx=0x7f5464007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:04.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f545dffb700 1 -- 172.21.15.115:0/3575751516 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400ce30 con 0x7f54680aaa40 2023-07-27T14:41:04.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f545dffb700 1 -- 172.21.15.115:0/3575751516 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546400f470 con 0x7f54680aaa40 2023-07-27T14:41:04.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f545dffb700 1 -- 172.21.15.115:0/3575751516 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400f810 con 0x7f54680aaa40 2023-07-27T14:41:04.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5468157420 con 0x7f54680aaa40 2023-07-27T14:41:04.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.621+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54681579e0 con 0x7f54680aaa40 2023-07-27T14:41:04.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.622+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546806c470 con 0x7f54680aaa40 2023-07-27T14:41:04.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.623+0000 7f545dffb700 1 -- 172.21.15.115:0/3575751516 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f5464019030 con 0x7f54680aaa40 2023-07-27T14:41:04.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.624+0000 7f545dffb700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544c05fe20 0x7f544c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:04.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.624+0000 7f545dffb700 1 -- 172.21.15.115:0/3575751516 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f546407aa10 con 0x7f54680aaa40 2023-07-27T14:41:04.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.624+0000 7f546d19a700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544c05fe20 0x7f544c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:04.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.625+0000 7f546d19a700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544c05fe20 0x7f544c0622e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f54680aae20 tx=0x7f5458016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:04.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.628+0000 7f545dffb700 1 -- 172.21.15.115:0/3575751516 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f546404adf0 con 0x7f54680aaa40 2023-07-27T14:41:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.837+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5468158030 con 0x7f54680aaa40 2023-07-27T14:41:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.837+0000 7f545dffb700 1 -- 172.21.15.115:0/3575751516 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4512 (secure 0 0 0) 0x7f546404e410 con 0x7f54680aaa40 2023-07-27T14:41:04.895 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:41:04.895 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":121,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1467451236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1467451236},{"type":"v1","addr":"172.21.15.159:6835","nonce":1467451236}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":9550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3231212144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3231212144},{"type":"v1","addr":"172.21.15.159:6833","nonce":3231212144}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":10890,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/260341074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":260341074},{"type":"v1","addr":"172.21.15.115:6836","nonce":260341074}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:41:01.387930+0000","modified":"2023-07-27T14:41:04.397833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10893":{"gid":10893,"name":"c","rank":0,"incarnation":118,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6837/4284501602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4284501602},{"type":"v1","addr":"172.21.15.115:6837","nonce":4284501602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-07-27T14:41:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544c05fe20 msgr2=0x7f544c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544c05fe20 0x7f544c0622e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f54680aae20 tx=0x7f5458016000).stop 2023-07-27T14:41:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54680aaa40 msgr2=0x7f54681581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54680aaa40 0x7f54681581e0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 rx=0x7f546400c4c0 tx=0x7f5464007c90).stop 2023-07-27T14:41:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 shutdown_connections 2023-07-27T14:41:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f544c05fe20 0x7f544c0622e0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54681542a0 0x7f54681510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54680aaa40 0x7f54681581e0 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 --2- 172.21.15.115:0/3575751516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5468153ec0 0x7f5468156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:04.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 >> 172.21.15.115:0/3575751516 conn(0x7f54680cb610 msgr2=0x7f5468152e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:04.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 shutdown_connections 2023-07-27T14:41:04.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:04.839+0000 7f546fbff700 1 -- 172.21.15.115:0/3575751516 wait complete. 2023-07-27T14:41:04.899 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 121 2023-07-27T14:41:04.914 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-27T14:41:05.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.045+0000 7fec7fdff700 1 Processor -- start 2023-07-27T14:41:05.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.045+0000 7fec7fdff700 1 -- start start 2023-07-27T14:41:05.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.046+0000 7fec7fdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fec780a4cc0 0x7fec780bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.046+0000 7fec7fdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec780639d0 con 0x7fec780a4840 2023-07-27T14:41:05.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.046+0000 7fec7fdff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec780a5150 con 0x7fec78151bd0 2023-07-27T14:41:05.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.046+0000 7fec7fdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec78137610 con 0x7fec780a4cc0 2023-07-27T14:41:05.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7d39a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fec780a4840 0x7fec780bc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36222/0 (socket says 172.21.15.115:36222) 2023-07-27T14:41:05.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7d39a700 1 -- 172.21.15.115:0/177486610 learned_addr learned my addr 172.21.15.115:0/177486610 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:05.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7e39c700 1 --2- 172.21.15.115:0/177486610 >> v2:172.21.15.115:3300/0 conn(0x7fec780a4cc0 0x7fec780bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7cb99700 1 -- 172.21.15.115:0/177486610 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425611297 0 0) 0x7fec780639d0 con 0x7fec780a4840 2023-07-27T14:41:05.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7cb99700 1 -- 172.21.15.115:0/177486610 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec640033f0 con 0x7fec780a4840 2023-07-27T14:41:05.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7e39c700 1 -- 172.21.15.115:0/177486610 >> v1:172.21.15.159:6789/0 conn(0x7fec78151bd0 legacy=0x7fec78062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7e39c700 1 -- 172.21.15.115:0/177486610 >> v1:172.21.15.115:6789/0 conn(0x7fec780a4840 legacy=0x7fec780bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7e39c700 1 -- 172.21.15.115:0/177486610 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec78062dc0 con 0x7fec780a4cc0 2023-07-27T14:41:05.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7e39c700 1 --2- 172.21.15.115:0/177486610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4cc0 0x7fec780bc760 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 rx=0x7fec70009e60 tx=0x7fec70009780).ready entity=mon.0 client_cookie=ef693f3e8fcd0b47 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.047+0000 7fec7cb99700 1 -- 172.21.15.115:0/177486610 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000e070 con 0x7fec780a4cc0 2023-07-27T14:41:05.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7cb99700 1 -- 172.21.15.115:0/177486610 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7000bb60 con 0x7fec780a4cc0 2023-07-27T14:41:05.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7cb99700 1 -- 172.21.15.115:0/177486610 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70012410 con 0x7fec780a4cc0 2023-07-27T14:41:05.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7fdff700 1 -- 172.21.15.115:0/177486610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4cc0 msgr2=0x7fec780bc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7fdff700 1 --2- 172.21.15.115:0/177486610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4cc0 0x7fec780bc760 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 rx=0x7fec70009e60 tx=0x7fec70009780).stop 2023-07-27T14:41:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7fdff700 1 -- 172.21.15.115:0/177486610 shutdown_connections 2023-07-27T14:41:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7fdff700 1 --2- 172.21.15.115:0/177486610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4cc0 0x7fec780bc760 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7fdff700 1 -- 172.21.15.115:0/177486610 >> 172.21.15.115:0/177486610 conn(0x7fec78064700 msgr2=0x7fec78064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7fdff700 1 -- 172.21.15.115:0/177486610 shutdown_connections 2023-07-27T14:41:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.048+0000 7fec7fdff700 1 -- 172.21.15.115:0/177486610 wait complete. 2023-07-27T14:41:05.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.050+0000 7fec7fdff700 1 Processor -- start 2023-07-27T14:41:05.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.050+0000 7fec7fdff700 1 -- start start 2023-07-27T14:41:05.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4840 0x7fec78139a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7fdff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec780a4cc0 0x7fec78135610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7fdff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec78151bd0 0x7fec780a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec78137760 con 0x7fec780a4840 2023-07-27T14:41:05.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7fdff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780a7c10 con 0x7fec780a4cc0 2023-07-27T14:41:05.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7fdff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec780a7ef0 con 0x7fec78151bd0 2023-07-27T14:41:05.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4840 0x7fec78139a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7db9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4840 0x7fec78139a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48712/0 (socket says 172.21.15.115:48712) 2023-07-27T14:41:05.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7db9b700 1 -- 172.21.15.115:0/4212025039 learned_addr learned my addr 172.21.15.115:0/4212025039 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:05.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7db9b700 1 -- 172.21.15.115:0/4212025039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec78151bd0 msgr2=0x7fec780a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7db9b700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec78151bd0 0x7fec780a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:05.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7db9b700 1 -- 172.21.15.115:0/4212025039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec780a4cc0 msgr2=0x7fec78135610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7db9b700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec780a4cc0 0x7fec78135610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:05.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.051+0000 7fec7db9b700 1 -- 172.21.15.115:0/4212025039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec70009a20 con 0x7fec780a4840 2023-07-27T14:41:05.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.052+0000 7fec7db9b700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4840 0x7fec78139a00 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 rx=0x7fec7400c4c0 tx=0x7fec74007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.052+0000 7fec6dffb700 1 -- 172.21.15.115:0/4212025039 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74007020 con 0x7fec780a4840 2023-07-27T14:41:05.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.052+0000 7fec6dffb700 1 -- 172.21.15.115:0/4212025039 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec74001e90 con 0x7fec780a4840 2023-07-27T14:41:05.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.052+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec781379b0 con 0x7fec780a4840 2023-07-27T14:41:05.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.052+0000 7fec6dffb700 1 -- 172.21.15.115:0/4212025039 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec740073b0 con 0x7fec780a4840 2023-07-27T14:41:05.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.052+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec780aa710 con 0x7fec780a4840 2023-07-27T14:41:05.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.053+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec78137e50 con 0x7fec780a4840 2023-07-27T14:41:05.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.054+0000 7fec6dffb700 1 -- 172.21.15.115:0/4212025039 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fec74010070 con 0x7fec780a4840 2023-07-27T14:41:05.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.055+0000 7fec6dffb700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec5c05fe20 0x7fec5c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.055+0000 7fec6dffb700 1 -- 172.21.15.115:0/4212025039 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fec7407ad50 con 0x7fec780a4840 2023-07-27T14:41:05.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.055+0000 7fec7d39a700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec5c05fe20 0x7fec5c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.055+0000 7fec7d39a700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec5c05fe20 0x7fec5c0622e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fec68005750 tx=0x7fec68007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.059+0000 7fec6dffb700 1 -- 172.21.15.115:0/4212025039 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec7404b240 con 0x7fec780a4840 2023-07-27T14:41:05.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.232+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec7813a670 con 0x7fec780a4840 2023-07-27T14:41:05.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.233+0000 7fec6dffb700 1 -- 172.21.15.115:0/4212025039 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) v1 ==== 74+0+17130 (secure 0 0 0) 0x7fec7404e860 con 0x7fec780a4840 2023-07-27T14:41:05.290 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:41:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":218,"fsid":"0ede6e86-fb6a-4237-aa30-ce93d50f4d08","created":"2023-07-27T14:26:41.756898+0000","modified":"2023-07-27T14:41:02.390481+0000","last_up_change":"2023-07-27T14:26:52.552729+0000","last_in_change":"2023-07-27T14:26:45.089531+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-07-27T14:26:52.614088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-27T14:26:54.184416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2023-07-27T14:40:59.612599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"217","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":31,"pool_name":"cephfs_data","create_time":"2023-07-27T14:41:00.373474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"218","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b6afaa2a-decb-4ace-a5f7-029b4d847b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":111291},{"type":"v1","addr":"172.21.15.115:6825","nonce":111291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":111291},{"type":"v1","addr":"172.21.15.115:6827","nonce":111291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":111291},{"type":"v1","addr":"172.21.15.115:6831","nonce":111291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":111291},{"type":"v1","addr":"172.21.15.115:6829","nonce":111291}]},"public_addr":"172.21.15.115:6825/111291","cluster_addr":"172.21.15.115:6827/111291","heartbeat_back_addr":"172.21.15.115:6831/111291","heartbeat_front_addr":"172.21.15.115:6829/111291","state":["exists","up"]},{"osd":1,"uuid":"fa8a1b32-3d88-4eea-8cc6-2046fc002bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":111288},{"type":"v1","addr":"172.21.15.115:6810","nonce":111288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":111288},{"type":"v1","addr":"172.21.15.115:6813","nonce":111288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6821","nonce":111288},{"type":"v1","addr":"172.21.15.115:6823","nonce":111288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":111288},{"type":"v1","addr":"172.21.15.115:6819","nonce":111288}]},"public_addr":"172.21.15.115:6810/111288","cluster_addr":"172.21.15.115:6813/111288","heartbeat_back_addr":"172.21.15.115:6823/111288","heartbeat_front_addr":"172.21.15.115:6819/111288","state":["exists","up"]},{"osd":2,"uuid":"c9616e0b-b6b7-4caa-a515-239d3c36116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6809","nonce":111293},{"type":"v1","addr":"172.21.15.115:6811","nonce":111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":111293},{"type":"v1","addr":"172.21.15.115:6815","nonce":111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":111293},{"type":"v1","addr":"172.21.15.115:6822","nonce":111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":111293},{"type":"v1","addr":"172.21.15.115:6818","nonce":111293}]},"public_addr":"172.21.15.115:6811/111293","cluster_addr":"172.21.15.115:6815/111293","heartbeat_back_addr":"172.21.15.115:6822/111293","heartbeat_front_addr":"172.21.15.115:6818/111293","state":["exists","up"]},{"osd":3,"uuid":"915cb3df-6f6f-47f7-92a8-fa4ae4167471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":111287},{"type":"v1","addr":"172.21.15.115:6801","nonce":111287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":111287},{"type":"v1","addr":"172.21.15.115:6803","nonce":111287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":111287},{"type":"v1","addr":"172.21.15.115:6807","nonce":111287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":111287},{"type":"v1","addr":"172.21.15.115:6805","nonce":111287}]},"public_addr":"172.21.15.115:6801/111287","cluster_addr":"172.21.15.115:6803/111287","heartbeat_back_addr":"172.21.15.115:6807/111287","heartbeat_front_addr":"172.21.15.115:6805/111287","state":["exists","up"]},{"osd":4,"uuid":"88231f0c-75b9-431e-9f8b-3661fe57ffe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":111537},{"type":"v1","addr":"172.21.15.159:6801","nonce":111537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":111537},{"type":"v1","addr":"172.21.15.159:6803","nonce":111537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":111537},{"type":"v1","addr":"172.21.15.159:6807","nonce":111537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":111537},{"type":"v1","addr":"172.21.15.159:6805","nonce":111537}]},"public_addr":"172.21.15.159:6801/111537","cluster_addr":"172.21.15.159:6803/111537","heartbeat_back_addr":"172.21.15.159:6807/111537","heartbeat_front_addr":"172.21.15.159:6805/111537","state":["exists","up"]},{"osd":5,"uuid":"d6202331-b147-42cd-b935-d857c25b32bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":111548},{"type":"v1","addr":"172.21.15.159:6825","nonce":111548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":111548},{"type":"v1","addr":"172.21.15.159:6827","nonce":111548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":111548},{"type":"v1","addr":"172.21.15.159:6831","nonce":111548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":111548},{"type":"v1","addr":"172.21.15.159:6829","nonce":111548}]},"public_addr":"172.21.15.159:6825/111548","cluster_addr":"172.21.15.159:6827/111548","heartbeat_back_addr":"172.21.15.159:6831/111548","heartbeat_front_addr":"172.21.15.159:6829/111548","state":["exists","up"]},{"osd":6,"uuid":"f62d46d3-3060-4a27-b34e-954afc2fed95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":111538},{"type":"v1","addr":"172.21.15.159:6809","nonce":111538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":111538},{"type":"v1","addr":"172.21.15.159:6811","nonce":111538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":111538},{"type":"v1","addr":"172.21.15.159:6815","nonce":111538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":111538},{"type":"v1","addr":"172.21.15.159:6813","nonce":111538}]},"public_addr":"172.21.15.159:6809/111538","cluster_addr":"172.21.15.159:6811/111538","heartbeat_back_addr":"172.21.15.159:6815/111538","heartbeat_front_addr":"172.21.15.159:6813/111538","state":["exists","up"]},{"osd":7,"uuid":"271856c5-2665-4174-bebd-58bc2c1dde74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":216,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":111541},{"type":"v1","addr":"172.21.15.159:6817","nonce":111541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":111541},{"type":"v1","addr":"172.21.15.159:6819","nonce":111541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":111541},{"type":"v1","addr":"172.21.15.159:6823","nonce":111541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":111541},{"type":"v1","addr":"172.21.15.159:6821","nonce":111541}]},"public_addr":"172.21.15.159:6817/111541","cluster_addr":"172.21.15.159:6819/111541","heartbeat_back_addr":"172.21.15.159:6823/111541","heartbeat_front_addr":"172.21.15.159:6821/111541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.663779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.706117+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.700060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.607287+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.581531+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.667252+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.724769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-07-27T14:26:50.699121+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-27T14:41:05.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec5c05fe20 msgr2=0x7fec5c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec5c05fe20 0x7fec5c0622e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7fec68005750 tx=0x7fec68007850).stop 2023-07-27T14:41:05.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4840 msgr2=0x7fec78139a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4840 0x7fec78139a00 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 rx=0x7fec7400c4c0 tx=0x7fec74007e00).stop 2023-07-27T14:41:05.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 shutdown_connections 2023-07-27T14:41:05.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fec5c05fe20 0x7fec5c0622e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fec78151bd0 0x7fec780a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:05.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec780a4840 0x7fec78139a00 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 --2- 172.21.15.115:0/4212025039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fec780a4cc0 0x7fec78135610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:05.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 >> 172.21.15.115:0/4212025039 conn(0x7fec78064700 msgr2=0x7fec78151160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:05.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 shutdown_connections 2023-07-27T14:41:05.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.235+0000 7fec7fdff700 1 -- 172.21.15.115:0/4212025039 wait complete. 2023-07-27T14:41:05.309 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-27T14:41:05.310 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:41:05.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.440+0000 7f2deb3ff700 1 Processor -- start 2023-07-27T14:41:05.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.441+0000 7f2deb3ff700 1 -- start start 2023-07-27T14:41:05.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.442+0000 7f2deb3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.442+0000 7f2deb3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40639d0 con 0x7f2de40bc050 2023-07-27T14:41:05.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.442+0000 7f2deb3ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40a51b0 con 0x7f2de4151bd0 2023-07-27T14:41:05.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.442+0000 7f2deb3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4137610 con 0x7f2de40a4840 2023-07-27T14:41:05.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.442+0000 7f2de999c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2de40bc050 0x7f2de40bc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36238/0 (socket says 172.21.15.115:36238) 2023-07-27T14:41:05.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.442+0000 7f2de999c700 1 -- 172.21.15.115:0/2155236658 learned_addr learned my addr 172.21.15.115:0/2155236658 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:05.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.442+0000 7f2de899a700 1 --2- 172.21.15.115:0/2155236658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2ddbfff700 1 -- 172.21.15.115:0/2155236658 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234257322 0 0) 0x7f2de40639d0 con 0x7f2de40bc050 2023-07-27T14:41:05.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2ddbfff700 1 -- 172.21.15.115:0/2155236658 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd00033f0 con 0x7f2de40bc050 2023-07-27T14:41:05.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2ddbfff700 1 -- 172.21.15.115:0/2155236658 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208127604 0 0) 0x7f2de40a51b0 con 0x7f2de4151bd0 2023-07-27T14:41:05.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2ddbfff700 1 -- 172.21.15.115:0/2155236658 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de40639d0 con 0x7f2de4151bd0 2023-07-27T14:41:05.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2de899a700 1 -- 172.21.15.115:0/2155236658 >> v1:172.21.15.159:6789/0 conn(0x7f2de4151bd0 legacy=0x7f2de4062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2de899a700 1 -- 172.21.15.115:0/2155236658 >> v1:172.21.15.115:6789/0 conn(0x7f2de40bc050 legacy=0x7f2de40bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2de899a700 1 -- 172.21.15.115:0/2155236658 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4062dc0 con 0x7f2de40a4840 2023-07-27T14:41:05.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2de899a700 1 --2- 172.21.15.115:0/2155236658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a4cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2dd4009790 tx=0x7f2dd4009060).ready entity=mon.2 client_cookie=82d31aa957ac8196 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.443+0000 7f2ddbfff700 1 -- 172.21.15.115:0/2155236658 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400f510 con 0x7f2de40a4840 2023-07-27T14:41:05.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2ddbfff700 1 -- 172.21.15.115:0/2155236658 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd400f670 con 0x7f2de40a4840 2023-07-27T14:41:05.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2ddbfff700 1 -- 172.21.15.115:0/2155236658 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400f9f0 con 0x7f2de40a4840 2023-07-27T14:41:05.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2deb3ff700 1 -- 172.21.15.115:0/2155236658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 msgr2=0x7f2de40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2deb3ff700 1 --2- 172.21.15.115:0/2155236658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a4cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2dd4009790 tx=0x7f2dd4009060).stop 2023-07-27T14:41:05.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2deb3ff700 1 -- 172.21.15.115:0/2155236658 shutdown_connections 2023-07-27T14:41:05.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2deb3ff700 1 --2- 172.21.15.115:0/2155236658 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a4cc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2deb3ff700 1 -- 172.21.15.115:0/2155236658 >> 172.21.15.115:0/2155236658 conn(0x7f2de4064700 msgr2=0x7f2de4064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:05.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2deb3ff700 1 -- 172.21.15.115:0/2155236658 shutdown_connections 2023-07-27T14:41:05.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.444+0000 7f2deb3ff700 1 -- 172.21.15.115:0/2155236658 wait complete. 2023-07-27T14:41:05.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.446+0000 7f2deb3ff700 1 Processor -- start 2023-07-27T14:41:05.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.446+0000 7f2deb3ff700 1 -- start start 2023-07-27T14:41:05.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2deb3ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2deb3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2de40bc050 0x7f2de413d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2deb3ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2de4151bd0 0x7f2de4135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2deb3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4152ee0 con 0x7f2de40bc050 2023-07-27T14:41:05.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2deb3ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de413dac0 con 0x7f2de4151bd0 2023-07-27T14:41:05.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2deb3ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de41525b0 con 0x7f2de40a4840 2023-07-27T14:41:05.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2de40bc050 0x7f2de413d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2de40bc050 0x7f2de413d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48718/0 (socket says 172.21.15.115:48718) 2023-07-27T14:41:05.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 -- 172.21.15.115:0/1757894507 learned_addr learned my addr 172.21.15.115:0/1757894507 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:05.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de919b700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de999c700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2de4151bd0 0x7f2de4135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 -- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 msgr2=0x7f2de40a86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 -- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2de4151bd0 msgr2=0x7f2de4135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2de4151bd0 0x7f2de4135af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 -- 172.21.15.115:0/1757894507 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd40092a0 con 0x7f2de40bc050 2023-07-27T14:41:05.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de999c700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2de4151bd0 0x7f2de4135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:05.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.447+0000 7f2de899a700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2de40bc050 0x7f2de413d230 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 rx=0x7f2de4067f10 tx=0x7f2dd4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.448+0000 7f2dd97fa700 1 -- 172.21.15.115:0/1757894507 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400f7e0 con 0x7f2de40bc050 2023-07-27T14:41:05.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.448+0000 7f2dd97fa700 1 -- 172.21.15.115:0/1757894507 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd400f940 con 0x7f2de40bc050 2023-07-27T14:41:05.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.448+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de4152890 con 0x7f2de40bc050 2023-07-27T14:41:05.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.448+0000 7f2dd97fa700 1 -- 172.21.15.115:0/1757894507 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd401b690 con 0x7f2de40bc050 2023-07-27T14:41:05.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.448+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de413d720 con 0x7f2de40bc050 2023-07-27T14:41:05.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.449+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de406c470 con 0x7f2de40bc050 2023-07-27T14:41:05.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.450+0000 7f2dd97fa700 1 -- 172.21.15.115:0/1757894507 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f2dd400f070 con 0x7f2de40bc050 2023-07-27T14:41:05.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.451+0000 7f2dd97fa700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2dc805fe20 0x7f2dc80622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.451+0000 7f2dd97fa700 1 -- 172.21.15.115:0/1757894507 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f2dd407cc00 con 0x7f2de40bc050 2023-07-27T14:41:05.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.451+0000 7f2de919b700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2dc805fe20 0x7f2dc80622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.451+0000 7f2de919b700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2dc805fe20 0x7f2dc80622e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f2de0003700 tx=0x7f2de0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.454+0000 7f2dd97fa700 1 -- 172.21.15.115:0/1757894507 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2dd404cf80 con 0x7f2de40bc050 2023-07-27T14:41:05.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.618+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2de40628e0 con 0x7f2dc805fe20 2023-07-27T14:41:05.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.628+0000 7f2dd97fa700 1 -- 172.21.15.115:0/1757894507 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+356350 (secure 0 0 0) 0x7f2de40628e0 con 0x7f2dc805fe20 2023-07-27T14:41:05.689 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:41:05.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2dc805fe20 msgr2=0x7f2dc80622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2dc805fe20 0x7f2dc80622e0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f2de0003700 tx=0x7f2de0009040).stop 2023-07-27T14:41:05.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2de40bc050 msgr2=0x7f2de413d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2de40bc050 0x7f2de413d230 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 rx=0x7f2de4067f10 tx=0x7f2dd4017000).stop 2023-07-27T14:41:05.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 shutdown_connections 2023-07-27T14:41:05.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2dc805fe20 0x7f2dc80622e0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2de4151bd0 0x7f2de4135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2de40a4840 0x7f2de40a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 --2- 172.21.15.115:0/1757894507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2de40bc050 0x7f2de413d230 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 >> 172.21.15.115:0/1757894507 conn(0x7f2de4064700 msgr2=0x7f2de40c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:05.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 shutdown_connections 2023-07-27T14:41:05.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.633+0000 7f2deb3ff700 1 -- 172.21.15.115:0/1757894507 wait complete. 2023-07-27T14:41:05.693 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:41:05.707 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":636,"stamp":"2023-07-27T14:41:03.630735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":768,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":212580,"kb_used_data":21284,"kb_used_omap":0,"kb_used_meta":191232,"kb_avail":754762140,"statfs":{"total":773094113280,"available":772876431360,"internally_reserved":0,"allocated":21794816,"data_stored":10347902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":195821568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-34398751,"num_objects":-91,"num_object_clones":-34,"num_object_copies":-182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-91,"num_whiteouts":-34,"num_read":-36,"num_read_kb":-16406,"num_write":-268,"num_write_kb":-33680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.876356"},"pg_stats":[{"pgid":"31.3e","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426920+0000","last_change":"2023-07-27T14:41:01.425607+0000","last_active":"2023-07-27T14:41:01.426920+0000","last_peered":"2023-07-27T14:41:01.426920+0000","last_clean":"2023-07-27T14:41:01.426920+0000","last_became_active":"2023-07-27T14:41:01.425344+0000","last_became_peered":"2023-07-27T14:41:01.425344+0000","last_unstale":"2023-07-27T14:41:01.426920+0000","last_undegraded":"2023-07-27T14:41:01.426920+0000","last_fullsized":"2023-07-27T14:41:01.426920+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3f","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422945+0000","last_change":"2023-07-27T14:41:01.414140+0000","last_active":"2023-07-27T14:41:01.422945+0000","last_peered":"2023-07-27T14:41:01.422945+0000","last_clean":"2023-07-27T14:41:01.422945+0000","last_became_active":"2023-07-27T14:41:01.412039+0000","last_became_peered":"2023-07-27T14:41:01.412039+0000","last_unstale":"2023-07-27T14:41:01.422945+0000","last_undegraded":"2023-07-27T14:41:01.422945+0000","last_fullsized":"2023-07-27T14:41:01.422945+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.398612+0000","last_change":"2023-07-27T14:41:00.941273+0000","last_active":"2023-07-27T14:41:01.398612+0000","last_peered":"2023-07-27T14:41:01.398612+0000","last_clean":"2023-07-27T14:41:01.398612+0000","last_became_active":"2023-07-27T14:41:00.940983+0000","last_became_peered":"2023-07-27T14:41:00.940983+0000","last_unstale":"2023-07-27T14:41:01.398612+0000","last_undegraded":"2023-07-27T14:41:01.398612+0000","last_fullsized":"2023-07-27T14:41:01.398612+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.417157+0000","last_change":"2023-07-27T14:41:01.415033+0000","last_active":"2023-07-27T14:41:01.417157+0000","last_peered":"2023-07-27T14:41:01.417157+0000","last_clean":"2023-07-27T14:41:01.417157+0000","last_became_active":"2023-07-27T14:41:01.414765+0000","last_became_peered":"2023-07-27T14:41:01.414765+0000","last_unstale":"2023-07-27T14:41:01.417157+0000","last_undegraded":"2023-07-27T14:41:01.417157+0000","last_fullsized":"2023-07-27T14:41:01.417157+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393809+0000","last_change":"2023-07-27T14:41:00.943027+0000","last_active":"2023-07-27T14:41:01.393809+0000","last_peered":"2023-07-27T14:41:01.393809+0000","last_clean":"2023-07-27T14:41:01.393809+0000","last_became_active":"2023-07-27T14:41:00.942783+0000","last_became_peered":"2023-07-27T14:41:00.942783+0000","last_unstale":"2023-07-27T14:41:01.393809+0000","last_undegraded":"2023-07-27T14:41:01.393809+0000","last_fullsized":"2023-07-27T14:41:01.393809+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426439+0000","last_change":"2023-07-27T14:41:01.424061+0000","last_active":"2023-07-27T14:41:01.426439+0000","last_peered":"2023-07-27T14:41:01.426439+0000","last_clean":"2023-07-27T14:41:01.426439+0000","last_became_active":"2023-07-27T14:41:01.423797+0000","last_became_peered":"2023-07-27T14:41:01.423797+0000","last_unstale":"2023-07-27T14:41:01.426439+0000","last_undegraded":"2023-07-27T14:41:01.426439+0000","last_fullsized":"2023-07-27T14:41:01.426439+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.414882+0000","last_change":"2023-07-27T14:41:01.411475+0000","last_active":"2023-07-27T14:41:01.414882+0000","last_peered":"2023-07-27T14:41:01.414882+0000","last_clean":"2023-07-27T14:41:01.414882+0000","last_became_active":"2023-07-27T14:41:01.411181+0000","last_became_peered":"2023-07-27T14:41:01.411181+0000","last_unstale":"2023-07-27T14:41:01.414882+0000","last_undegraded":"2023-07-27T14:41:01.414882+0000","last_fullsized":"2023-07-27T14:41:01.414882+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.392643+0000","last_change":"2023-07-27T14:41:00.951838+0000","last_active":"2023-07-27T14:41:01.392643+0000","last_peered":"2023-07-27T14:41:01.392643+0000","last_clean":"2023-07-27T14:41:01.392643+0000","last_became_active":"2023-07-27T14:41:00.951388+0000","last_became_peered":"2023-07-27T14:41:00.951388+0000","last_unstale":"2023-07-27T14:41:01.392643+0000","last_undegraded":"2023-07-27T14:41:01.392643+0000","last_fullsized":"2023-07-27T14:41:01.392643+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.397783+0000","last_change":"2023-07-27T14:41:00.959911+0000","last_active":"2023-07-27T14:41:01.397783+0000","last_peered":"2023-07-27T14:41:01.397783+0000","last_clean":"2023-07-27T14:41:01.397783+0000","last_became_active":"2023-07-27T14:41:00.959600+0000","last_became_peered":"2023-07-27T14:41:00.959600+0000","last_unstale":"2023-07-27T14:41:01.397783+0000","last_undegraded":"2023-07-27T14:41:01.397783+0000","last_fullsized":"2023-07-27T14:41:01.397783+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393504+0000","last_change":"2023-07-27T14:41:00.953910+0000","last_active":"2023-07-27T14:41:01.393504+0000","last_peered":"2023-07-27T14:41:01.393504+0000","last_clean":"2023-07-27T14:41:01.393504+0000","last_became_active":"2023-07-27T14:41:00.952852+0000","last_became_peered":"2023-07-27T14:41:00.952852+0000","last_unstale":"2023-07-27T14:41:01.393504+0000","last_undegraded":"2023-07-27T14:41:01.393504+0000","last_fullsized":"2023-07-27T14:41:01.393504+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410613+0000","last_change":"2023-07-27T14:41:01.406780+0000","last_active":"2023-07-27T14:41:01.410613+0000","last_peered":"2023-07-27T14:41:01.410613+0000","last_clean":"2023-07-27T14:41:01.410613+0000","last_became_active":"2023-07-27T14:41:01.406218+0000","last_became_peered":"2023-07-27T14:41:01.406218+0000","last_unstale":"2023-07-27T14:41:01.410613+0000","last_undegraded":"2023-07-27T14:41:01.410613+0000","last_fullsized":"2023-07-27T14:41:01.410613+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.417926+0000","last_change":"2023-07-27T14:41:01.408818+0000","last_active":"2023-07-27T14:41:01.417926+0000","last_peered":"2023-07-27T14:41:01.417926+0000","last_clean":"2023-07-27T14:41:01.417926+0000","last_became_active":"2023-07-27T14:41:01.408548+0000","last_became_peered":"2023-07-27T14:41:01.408548+0000","last_unstale":"2023-07-27T14:41:01.417926+0000","last_undegraded":"2023-07-27T14:41:01.417926+0000","last_fullsized":"2023-07-27T14:41:01.417926+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.401617+0000","last_change":"2023-07-27T14:41:01.400704+0000","last_active":"2023-07-27T14:41:01.401617+0000","last_peered":"2023-07-27T14:41:01.401617+0000","last_clean":"2023-07-27T14:41:01.401617+0000","last_became_active":"2023-07-27T14:41:01.400421+0000","last_became_peered":"2023-07-27T14:41:01.400421+0000","last_unstale":"2023-07-27T14:41:01.401617+0000","last_undegraded":"2023-07-27T14:41:01.401617+0000","last_fullsized":"2023-07-27T14:41:01.401617+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399639+0000","last_change":"2023-07-27T14:41:00.948585+0000","last_active":"2023-07-27T14:41:01.399639+0000","last_peered":"2023-07-27T14:41:01.399639+0000","last_clean":"2023-07-27T14:41:01.399639+0000","last_became_active":"2023-07-27T14:41:00.948140+0000","last_became_peered":"2023-07-27T14:41:00.948140+0000","last_unstale":"2023-07-27T14:41:01.399639+0000","last_undegraded":"2023-07-27T14:41:01.399639+0000","last_fullsized":"2023-07-27T14:41:01.399639+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424278+0000","last_change":"2023-07-27T14:41:01.417718+0000","last_active":"2023-07-27T14:41:01.424278+0000","last_peered":"2023-07-27T14:41:01.424278+0000","last_clean":"2023-07-27T14:41:01.424278+0000","last_became_active":"2023-07-27T14:41:01.417475+0000","last_became_peered":"2023-07-27T14:41:01.417475+0000","last_unstale":"2023-07-27T14:41:01.424278+0000","last_undegraded":"2023-07-27T14:41:01.424278+0000","last_fullsized":"2023-07-27T14:41:01.424278+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393597+0000","last_change":"2023-07-27T14:41:00.953540+0000","last_active":"2023-07-27T14:41:01.393597+0000","last_peered":"2023-07-27T14:41:01.393597+0000","last_clean":"2023-07-27T14:41:01.393597+0000","last_became_active":"2023-07-27T14:41:00.952096+0000","last_became_peered":"2023-07-27T14:41:00.952096+0000","last_unstale":"2023-07-27T14:41:01.393597+0000","last_undegraded":"2023-07-27T14:41:01.393597+0000","last_fullsized":"2023-07-27T14:41:01.393597+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.411341+0000","last_change":"2023-07-27T14:41:01.405804+0000","last_active":"2023-07-27T14:41:01.411341+0000","last_peered":"2023-07-27T14:41:01.411341+0000","last_clean":"2023-07-27T14:41:01.411341+0000","last_became_active":"2023-07-27T14:41:01.405108+0000","last_became_peered":"2023-07-27T14:41:01.405108+0000","last_unstale":"2023-07-27T14:41:01.411341+0000","last_undegraded":"2023-07-27T14:41:01.411341+0000","last_fullsized":"2023-07-27T14:41:01.411341+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.2b","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422082+0000","last_change":"2023-07-27T14:41:00.945184+0000","last_active":"2023-07-27T14:41:01.422082+0000","last_peered":"2023-07-27T14:41:01.422082+0000","last_clean":"2023-07-27T14:41:01.422082+0000","last_became_active":"2023-07-27T14:41:00.944895+0000","last_became_peered":"2023-07-27T14:41:00.944895+0000","last_unstale":"2023-07-27T14:41:01.422082+0000","last_undegraded":"2023-07-27T14:41:01.422082+0000","last_fullsized":"2023-07-27T14:41:01.422082+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399851+0000","last_change":"2023-07-27T14:41:00.947860+0000","last_active":"2023-07-27T14:41:01.399851+0000","last_peered":"2023-07-27T14:41:01.399851+0000","last_clean":"2023-07-27T14:41:01.399851+0000","last_became_active":"2023-07-27T14:41:00.947580+0000","last_became_peered":"2023-07-27T14:41:00.947580+0000","last_unstale":"2023-07-27T14:41:01.399851+0000","last_undegraded":"2023-07-27T14:41:01.399851+0000","last_fullsized":"2023-07-27T14:41:01.399851+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424354+0000","last_change":"2023-07-27T14:41:01.420551+0000","last_active":"2023-07-27T14:41:01.424354+0000","last_peered":"2023-07-27T14:41:01.424354+0000","last_clean":"2023-07-27T14:41:01.424354+0000","last_became_active":"2023-07-27T14:41:01.420299+0000","last_became_peered":"2023-07-27T14:41:01.420299+0000","last_unstale":"2023-07-27T14:41:01.424354+0000","last_undegraded":"2023-07-27T14:41:01.424354+0000","last_fullsized":"2023-07-27T14:41:01.424354+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.401894+0000","last_change":"2023-07-27T14:41:00.959770+0000","last_active":"2023-07-27T14:41:01.401894+0000","last_peered":"2023-07-27T14:41:01.401894+0000","last_clean":"2023-07-27T14:41:01.401894+0000","last_became_active":"2023-07-27T14:41:00.959496+0000","last_became_peered":"2023-07-27T14:41:00.959496+0000","last_unstale":"2023-07-27T14:41:01.401894+0000","last_undegraded":"2023-07-27T14:41:01.401894+0000","last_fullsized":"2023-07-27T14:41:01.401894+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.417212+0000","last_change":"2023-07-27T14:41:01.414408+0000","last_active":"2023-07-27T14:41:01.417212+0000","last_peered":"2023-07-27T14:41:01.417212+0000","last_clean":"2023-07-27T14:41:01.417212+0000","last_became_active":"2023-07-27T14:41:01.414127+0000","last_became_peered":"2023-07-27T14:41:01.414127+0000","last_unstale":"2023-07-27T14:41:01.417212+0000","last_undegraded":"2023-07-27T14:41:01.417212+0000","last_fullsized":"2023-07-27T14:41:01.417212+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393684+0000","last_change":"2023-07-27T14:41:00.953730+0000","last_active":"2023-07-27T14:41:01.393684+0000","last_peered":"2023-07-27T14:41:01.393684+0000","last_clean":"2023-07-27T14:41:01.393684+0000","last_became_active":"2023-07-27T14:41:00.952472+0000","last_became_peered":"2023-07-27T14:41:00.952472+0000","last_unstale":"2023-07-27T14:41:01.393684+0000","last_undegraded":"2023-07-27T14:41:01.393684+0000","last_fullsized":"2023-07-27T14:41:01.393684+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424321+0000","last_change":"2023-07-27T14:41:01.419482+0000","last_active":"2023-07-27T14:41:01.424321+0000","last_peered":"2023-07-27T14:41:01.424321+0000","last_clean":"2023-07-27T14:41:01.424321+0000","last_became_active":"2023-07-27T14:41:01.419219+0000","last_became_peered":"2023-07-27T14:41:01.419219+0000","last_unstale":"2023-07-27T14:41:01.424321+0000","last_undegraded":"2023-07-27T14:41:01.424321+0000","last_fullsized":"2023-07-27T14:41:01.424321+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410594+0000","last_change":"2023-07-27T14:41:01.406574+0000","last_active":"2023-07-27T14:41:01.410594+0000","last_peered":"2023-07-27T14:41:01.410594+0000","last_clean":"2023-07-27T14:41:01.410594+0000","last_became_active":"2023-07-27T14:41:01.405872+0000","last_became_peered":"2023-07-27T14:41:01.405872+0000","last_unstale":"2023-07-27T14:41:01.410594+0000","last_undegraded":"2023-07-27T14:41:01.410594+0000","last_fullsized":"2023-07-27T14:41:01.410594+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.398860+0000","last_change":"2023-07-27T14:41:00.954396+0000","last_active":"2023-07-27T14:41:01.398860+0000","last_peered":"2023-07-27T14:41:01.398860+0000","last_clean":"2023-07-27T14:41:01.398860+0000","last_became_active":"2023-07-27T14:41:00.953865+0000","last_became_peered":"2023-07-27T14:41:00.953865+0000","last_unstale":"2023-07-27T14:41:01.398860+0000","last_undegraded":"2023-07-27T14:41:01.398860+0000","last_fullsized":"2023-07-27T14:41:01.398860+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410630+0000","last_change":"2023-07-27T14:41:01.405092+0000","last_active":"2023-07-27T14:41:01.410630+0000","last_peered":"2023-07-27T14:41:01.410630+0000","last_clean":"2023-07-27T14:41:01.410630+0000","last_became_active":"2023-07-27T14:41:01.404217+0000","last_became_peered":"2023-07-27T14:41:01.404217+0000","last_unstale":"2023-07-27T14:41:01.410630+0000","last_undegraded":"2023-07-27T14:41:01.410630+0000","last_fullsized":"2023-07-27T14:41:01.410630+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422915+0000","last_change":"2023-07-27T14:41:01.414357+0000","last_active":"2023-07-27T14:41:01.422915+0000","last_peered":"2023-07-27T14:41:01.422915+0000","last_clean":"2023-07-27T14:41:01.422915+0000","last_became_active":"2023-07-27T14:41:01.412892+0000","last_became_peered":"2023-07-27T14:41:01.412892+0000","last_unstale":"2023-07-27T14:41:01.422915+0000","last_undegraded":"2023-07-27T14:41:01.422915+0000","last_fullsized":"2023-07-27T14:41:01.422915+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.401986+0000","last_change":"2023-07-27T14:41:00.952996+0000","last_active":"2023-07-27T14:41:01.401986+0000","last_peered":"2023-07-27T14:41:01.401986+0000","last_clean":"2023-07-27T14:41:01.401986+0000","last_became_active":"2023-07-27T14:41:00.952688+0000","last_became_peered":"2023-07-27T14:41:00.952688+0000","last_unstale":"2023-07-27T14:41:01.401986+0000","last_undegraded":"2023-07-27T14:41:01.401986+0000","last_fullsized":"2023-07-27T14:41:01.401986+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421199+0000","last_change":"2023-07-27T14:41:01.418776+0000","last_active":"2023-07-27T14:41:01.421199+0000","last_peered":"2023-07-27T14:41:01.421199+0000","last_clean":"2023-07-27T14:41:01.421199+0000","last_became_active":"2023-07-27T14:41:01.418475+0000","last_became_peered":"2023-07-27T14:41:01.418475+0000","last_unstale":"2023-07-27T14:41:01.421199+0000","last_undegraded":"2023-07-27T14:41:01.421199+0000","last_fullsized":"2023-07-27T14:41:01.421199+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426938+0000","last_change":"2023-07-27T14:41:01.425772+0000","last_active":"2023-07-27T14:41:01.426938+0000","last_peered":"2023-07-27T14:41:01.426938+0000","last_clean":"2023-07-27T14:41:01.426938+0000","last_became_active":"2023-07-27T14:41:01.425353+0000","last_became_peered":"2023-07-27T14:41:01.425353+0000","last_unstale":"2023-07-27T14:41:01.426938+0000","last_undegraded":"2023-07-27T14:41:01.426938+0000","last_fullsized":"2023-07-27T14:41:01.426938+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421383+0000","last_change":"2023-07-27T14:41:01.416512+0000","last_active":"2023-07-27T14:41:01.421383+0000","last_peered":"2023-07-27T14:41:01.421383+0000","last_clean":"2023-07-27T14:41:01.421383+0000","last_became_active":"2023-07-27T14:41:01.416237+0000","last_became_peered":"2023-07-27T14:41:01.416237+0000","last_unstale":"2023-07-27T14:41:01.421383+0000","last_undegraded":"2023-07-27T14:41:01.421383+0000","last_fullsized":"2023-07-27T14:41:01.421383+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393778+0000","last_change":"2023-07-27T14:41:00.954079+0000","last_active":"2023-07-27T14:41:01.393778+0000","last_peered":"2023-07-27T14:41:01.393778+0000","last_clean":"2023-07-27T14:41:01.393778+0000","last_became_active":"2023-07-27T14:41:00.953228+0000","last_became_peered":"2023-07-27T14:41:00.953228+0000","last_unstale":"2023-07-27T14:41:01.393778+0000","last_undegraded":"2023-07-27T14:41:01.393778+0000","last_fullsized":"2023-07-27T14:41:01.393778+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.411361+0000","last_change":"2023-07-27T14:41:01.405984+0000","last_active":"2023-07-27T14:41:01.411361+0000","last_peered":"2023-07-27T14:41:01.411361+0000","last_clean":"2023-07-27T14:41:01.411361+0000","last_became_active":"2023-07-27T14:41:01.405472+0000","last_became_peered":"2023-07-27T14:41:01.405472+0000","last_unstale":"2023-07-27T14:41:01.411361+0000","last_undegraded":"2023-07-27T14:41:01.411361+0000","last_fullsized":"2023-07-27T14:41:01.411361+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.15","version":"217'3","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426590+0000","last_change":"2023-07-27T14:41:00.958346+0000","last_active":"2023-07-27T14:41:01.426590+0000","last_peered":"2023-07-27T14:41:01.426590+0000","last_clean":"2023-07-27T14:41:01.426590+0000","last_became_active":"2023-07-27T14:41:00.958028+0000","last_became_peered":"2023-07-27T14:41:00.958028+0000","last_unstale":"2023-07-27T14:41:01.426590+0000","last_undegraded":"2023-07-27T14:41:01.426590+0000","last_fullsized":"2023-07-27T14:41:01.426590+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.14","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426613+0000","last_change":"2023-07-27T14:41:00.955937+0000","last_active":"2023-07-27T14:41:01.426613+0000","last_peered":"2023-07-27T14:41:01.426613+0000","last_clean":"2023-07-27T14:41:01.426613+0000","last_became_active":"2023-07-27T14:41:00.955627+0000","last_became_peered":"2023-07-27T14:41:00.955627+0000","last_unstale":"2023-07-27T14:41:01.426613+0000","last_undegraded":"2023-07-27T14:41:01.426613+0000","last_fullsized":"2023-07-27T14:41:01.426613+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.13","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.427697+0000","last_change":"2023-07-27T14:41:00.948767+0000","last_active":"2023-07-27T14:41:01.427697+0000","last_peered":"2023-07-27T14:41:01.427697+0000","last_clean":"2023-07-27T14:41:01.427697+0000","last_became_active":"2023-07-27T14:41:00.948482+0000","last_became_peered":"2023-07-27T14:41:00.948482+0000","last_unstale":"2023-07-27T14:41:01.427697+0000","last_undegraded":"2023-07-27T14:41:01.427697+0000","last_fullsized":"2023-07-27T14:41:01.427697+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.392977+0000","last_change":"2023-07-27T14:41:00.955633+0000","last_active":"2023-07-27T14:41:01.392977+0000","last_peered":"2023-07-27T14:41:01.392977+0000","last_clean":"2023-07-27T14:41:01.392977+0000","last_became_active":"2023-07-27T14:41:00.955357+0000","last_became_peered":"2023-07-27T14:41:00.955357+0000","last_unstale":"2023-07-27T14:41:01.392977+0000","last_undegraded":"2023-07-27T14:41:01.392977+0000","last_fullsized":"2023-07-27T14:41:01.392977+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413385+0000","last_change":"2023-07-27T14:41:01.407595+0000","last_active":"2023-07-27T14:41:01.413385+0000","last_peered":"2023-07-27T14:41:01.413385+0000","last_clean":"2023-07-27T14:41:01.413385+0000","last_became_active":"2023-07-27T14:41:01.407338+0000","last_became_peered":"2023-07-27T14:41:01.407338+0000","last_unstale":"2023-07-27T14:41:01.413385+0000","last_undegraded":"2023-07-27T14:41:01.413385+0000","last_fullsized":"2023-07-27T14:41:01.413385+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.10","version":"217'4","reported_seq":14,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424849+0000","last_change":"2023-07-27T14:41:00.954989+0000","last_active":"2023-07-27T14:41:01.424849+0000","last_peered":"2023-07-27T14:41:01.424849+0000","last_clean":"2023-07-27T14:41:01.424849+0000","last_became_active":"2023-07-27T14:41:00.954691+0000","last_became_peered":"2023-07-27T14:41:00.954691+0000","last_unstale":"2023-07-27T14:41:01.424849+0000","last_undegraded":"2023-07-27T14:41:01.424849+0000","last_fullsized":"2023-07-27T14:41:01.424849+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421296+0000","last_change":"2023-07-27T14:41:01.419118+0000","last_active":"2023-07-27T14:41:01.421296+0000","last_peered":"2023-07-27T14:41:01.421296+0000","last_clean":"2023-07-27T14:41:01.421296+0000","last_became_active":"2023-07-27T14:41:01.418466+0000","last_became_peered":"2023-07-27T14:41:01.418466+0000","last_unstale":"2023-07-27T14:41:01.421296+0000","last_undegraded":"2023-07-27T14:41:01.421296+0000","last_fullsized":"2023-07-27T14:41:01.421296+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.414086+0000","last_change":"2023-07-27T14:41:01.409815+0000","last_active":"2023-07-27T14:41:01.414086+0000","last_peered":"2023-07-27T14:41:01.414086+0000","last_clean":"2023-07-27T14:41:01.414086+0000","last_became_active":"2023-07-27T14:41:01.408677+0000","last_became_peered":"2023-07-27T14:41:01.408677+0000","last_unstale":"2023-07-27T14:41:01.414086+0000","last_undegraded":"2023-07-27T14:41:01.414086+0000","last_fullsized":"2023-07-27T14:41:01.414086+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.e","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.418782+0000","last_change":"2023-07-27T14:41:00.943827+0000","last_active":"2023-07-27T14:41:01.418782+0000","last_peered":"2023-07-27T14:41:01.418782+0000","last_clean":"2023-07-27T14:41:01.418782+0000","last_became_active":"2023-07-27T14:41:00.943533+0000","last_became_peered":"2023-07-27T14:41:00.943533+0000","last_unstale":"2023-07-27T14:41:01.418782+0000","last_undegraded":"2023-07-27T14:41:01.418782+0000","last_fullsized":"2023-07-27T14:41:01.418782+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399338+0000","last_change":"2023-07-27T14:41:00.953238+0000","last_active":"2023-07-27T14:41:01.399338+0000","last_peered":"2023-07-27T14:41:01.399338+0000","last_clean":"2023-07-27T14:41:01.399338+0000","last_became_active":"2023-07-27T14:41:00.952779+0000","last_became_peered":"2023-07-27T14:41:00.952779+0000","last_unstale":"2023-07-27T14:41:01.399338+0000","last_undegraded":"2023-07-27T14:41:01.399338+0000","last_fullsized":"2023-07-27T14:41:01.399338+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.b","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413471+0000","last_change":"2023-07-27T14:41:00.950797+0000","last_active":"2023-07-27T14:41:01.413471+0000","last_peered":"2023-07-27T14:41:01.413471+0000","last_clean":"2023-07-27T14:41:01.413471+0000","last_became_active":"2023-07-27T14:41:00.950524+0000","last_became_peered":"2023-07-27T14:41:00.950524+0000","last_unstale":"2023-07-27T14:41:01.413471+0000","last_undegraded":"2023-07-27T14:41:01.413471+0000","last_fullsized":"2023-07-27T14:41:01.413471+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423197+0000","last_change":"2023-07-27T14:41:01.414546+0000","last_active":"2023-07-27T14:41:01.423197+0000","last_peered":"2023-07-27T14:41:01.423197+0000","last_clean":"2023-07-27T14:41:01.423197+0000","last_became_active":"2023-07-27T14:41:01.413252+0000","last_became_peered":"2023-07-27T14:41:01.413252+0000","last_unstale":"2023-07-27T14:41:01.423197+0000","last_undegraded":"2023-07-27T14:41:01.423197+0000","last_fullsized":"2023-07-27T14:41:01.423197+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399123+0000","last_change":"2023-07-27T14:41:00.943797+0000","last_active":"2023-07-27T14:41:01.399123+0000","last_peered":"2023-07-27T14:41:01.399123+0000","last_clean":"2023-07-27T14:41:01.399123+0000","last_became_active":"2023-07-27T14:41:00.943482+0000","last_became_peered":"2023-07-27T14:41:00.943482+0000","last_unstale":"2023-07-27T14:41:01.399123+0000","last_undegraded":"2023-07-27T14:41:01.399123+0000","last_fullsized":"2023-07-27T14:41:01.399123+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410716+0000","last_change":"2023-07-27T14:41:01.406069+0000","last_active":"2023-07-27T14:41:01.410716+0000","last_peered":"2023-07-27T14:41:01.410716+0000","last_clean":"2023-07-27T14:41:01.410716+0000","last_became_active":"2023-07-27T14:41:01.405784+0000","last_became_peered":"2023-07-27T14:41:01.405784+0000","last_unstale":"2023-07-27T14:41:01.410716+0000","last_undegraded":"2023-07-27T14:41:01.410716+0000","last_fullsized":"2023-07-27T14:41:01.410716+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.7","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421886+0000","last_change":"2023-07-27T14:41:00.951539+0000","last_active":"2023-07-27T14:41:01.421886+0000","last_peered":"2023-07-27T14:41:01.421886+0000","last_clean":"2023-07-27T14:41:01.421886+0000","last_became_active":"2023-07-27T14:41:00.951278+0000","last_became_peered":"2023-07-27T14:41:00.951278+0000","last_unstale":"2023-07-27T14:41:01.421886+0000","last_undegraded":"2023-07-27T14:41:01.421886+0000","last_fullsized":"2023-07-27T14:41:01.421886+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425741+0000","last_change":"2023-07-27T14:41:01.422508+0000","last_active":"2023-07-27T14:41:01.425741+0000","last_peered":"2023-07-27T14:41:01.425741+0000","last_clean":"2023-07-27T14:41:01.425741+0000","last_became_active":"2023-07-27T14:41:01.418361+0000","last_became_peered":"2023-07-27T14:41:01.418361+0000","last_unstale":"2023-07-27T14:41:01.425741+0000","last_undegraded":"2023-07-27T14:41:01.425741+0000","last_fullsized":"2023-07-27T14:41:01.425741+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410661+0000","last_change":"2023-07-27T14:41:01.408494+0000","last_active":"2023-07-27T14:41:01.410661+0000","last_peered":"2023-07-27T14:41:01.410661+0000","last_clean":"2023-07-27T14:41:01.410661+0000","last_became_active":"2023-07-27T14:41:01.408181+0000","last_became_peered":"2023-07-27T14:41:01.408181+0000","last_unstale":"2023-07-27T14:41:01.410661+0000","last_undegraded":"2023-07-27T14:41:01.410661+0000","last_fullsized":"2023-07-27T14:41:01.410661+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421353+0000","last_change":"2023-07-27T14:41:01.416807+0000","last_active":"2023-07-27T14:41:01.421353+0000","last_peered":"2023-07-27T14:41:01.421353+0000","last_clean":"2023-07-27T14:41:01.421353+0000","last_became_active":"2023-07-27T14:41:01.416541+0000","last_became_peered":"2023-07-27T14:41:01.416541+0000","last_unstale":"2023-07-27T14:41:01.421353+0000","last_undegraded":"2023-07-27T14:41:01.421353+0000","last_fullsized":"2023-07-27T14:41:01.421353+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399428+0000","last_change":"2023-07-27T14:41:00.953066+0000","last_active":"2023-07-27T14:41:01.399428+0000","last_peered":"2023-07-27T14:41:01.399428+0000","last_clean":"2023-07-27T14:41:01.399428+0000","last_became_active":"2023-07-27T14:41:00.952449+0000","last_became_peered":"2023-07-27T14:41:00.952449+0000","last_unstale":"2023-07-27T14:41:01.399428+0000","last_undegraded":"2023-07-27T14:41:01.399428+0000","last_fullsized":"2023-07-27T14:41:01.399428+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399979+0000","last_change":"2023-07-27T14:41:00.957093+0000","last_active":"2023-07-27T14:41:01.399979+0000","last_peered":"2023-07-27T14:41:01.399979+0000","last_clean":"2023-07-27T14:41:01.399979+0000","last_became_active":"2023-07-27T14:41:00.956794+0000","last_became_peered":"2023-07-27T14:41:00.956794+0000","last_unstale":"2023-07-27T14:41:01.399979+0000","last_undegraded":"2023-07-27T14:41:01.399979+0000","last_fullsized":"2023-07-27T14:41:01.399979+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.392848+0000","last_change":"2023-07-27T14:41:00.951677+0000","last_active":"2023-07-27T14:41:01.392848+0000","last_peered":"2023-07-27T14:41:01.392848+0000","last_clean":"2023-07-27T14:41:01.392848+0000","last_became_active":"2023-07-27T14:41:00.950844+0000","last_became_peered":"2023-07-27T14:41:00.950844+0000","last_unstale":"2023-07-27T14:41:01.392848+0000","last_undegraded":"2023-07-27T14:41:01.392848+0000","last_fullsized":"2023-07-27T14:41:01.392848+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426461+0000","last_change":"2023-07-27T14:41:01.425101+0000","last_active":"2023-07-27T14:41:01.426461+0000","last_peered":"2023-07-27T14:41:01.426461+0000","last_clean":"2023-07-27T14:41:01.426461+0000","last_became_active":"2023-07-27T14:41:01.424846+0000","last_became_peered":"2023-07-27T14:41:01.424846+0000","last_unstale":"2023-07-27T14:41:01.426461+0000","last_undegraded":"2023-07-27T14:41:01.426461+0000","last_fullsized":"2023-07-27T14:41:01.426461+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393498+0000","last_change":"2023-07-27T14:41:00.954851+0000","last_active":"2023-07-27T14:41:01.393498+0000","last_peered":"2023-07-27T14:41:01.393498+0000","last_clean":"2023-07-27T14:41:01.393498+0000","last_became_active":"2023-07-27T14:41:00.954374+0000","last_became_peered":"2023-07-27T14:41:00.954374+0000","last_unstale":"2023-07-27T14:41:01.393498+0000","last_undegraded":"2023-07-27T14:41:01.393498+0000","last_fullsized":"2023-07-27T14:41:01.393498+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.419742+0000","last_change":"2023-07-27T14:41:01.414552+0000","last_active":"2023-07-27T14:41:01.419742+0000","last_peered":"2023-07-27T14:41:01.419742+0000","last_clean":"2023-07-27T14:41:01.419742+0000","last_became_active":"2023-07-27T14:41:01.414258+0000","last_became_peered":"2023-07-27T14:41:01.414258+0000","last_unstale":"2023-07-27T14:41:01.419742+0000","last_undegraded":"2023-07-27T14:41:01.419742+0000","last_fullsized":"2023-07-27T14:41:01.419742+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.402252+0000","last_change":"2023-07-27T14:41:00.953776+0000","last_active":"2023-07-27T14:41:01.402252+0000","last_peered":"2023-07-27T14:41:01.402252+0000","last_clean":"2023-07-27T14:41:01.402252+0000","last_became_active":"2023-07-27T14:41:00.953491+0000","last_became_peered":"2023-07-27T14:41:00.953491+0000","last_unstale":"2023-07-27T14:41:01.402252+0000","last_undegraded":"2023-07-27T14:41:01.402252+0000","last_fullsized":"2023-07-27T14:41:01.402252+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-07-27T14:40:56.123937+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:40:56.123937+0000","last_peered":"2023-07-27T14:40:56.123937+0000","last_clean":"2023-07-27T14:40:56.123937+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:40:56.123937+0000","last_undegraded":"2023-07-27T14:40:56.123937+0000","last_fullsized":"2023-07-27T14:40:56.123937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399941+0000","last_change":"2023-07-27T14:41:00.947779+0000","last_active":"2023-07-27T14:41:01.399941+0000","last_peered":"2023-07-27T14:41:01.399941+0000","last_clean":"2023-07-27T14:41:01.399941+0000","last_became_active":"2023-07-27T14:41:00.947086+0000","last_became_peered":"2023-07-27T14:41:00.947086+0000","last_unstale":"2023-07-27T14:41:01.399941+0000","last_undegraded":"2023-07-27T14:41:01.399941+0000","last_fullsized":"2023-07-27T14:41:01.399941+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.406336+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:41:01.406336+0000","last_peered":"2023-07-27T14:41:01.406336+0000","last_clean":"2023-07-27T14:41:01.406336+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:41:01.406336+0000","last_undegraded":"2023-07-27T14:41:01.406336+0000","last_fullsized":"2023-07-27T14:41:01.406336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413254+0000","last_change":"2023-07-27T14:41:01.408262+0000","last_active":"2023-07-27T14:41:01.413254+0000","last_peered":"2023-07-27T14:41:01.413254+0000","last_clean":"2023-07-27T14:41:01.413254+0000","last_became_active":"2023-07-27T14:41:01.407962+0000","last_became_peered":"2023-07-27T14:41:01.407962+0000","last_unstale":"2023-07-27T14:41:01.413254+0000","last_undegraded":"2023-07-27T14:41:01.413254+0000","last_fullsized":"2023-07-27T14:41:01.413254+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-07-27T14:40:56.942391+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:40:56.942391+0000","last_peered":"2023-07-27T14:40:56.942391+0000","last_clean":"2023-07-27T14:40:56.942391+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:40:56.942391+0000","last_undegraded":"2023-07-27T14:40:56.942391+0000","last_fullsized":"2023-07-27T14:40:56.942391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393398+0000","last_change":"2023-07-27T14:41:00.956145+0000","last_active":"2023-07-27T14:41:01.393398+0000","last_peered":"2023-07-27T14:41:01.393398+0000","last_clean":"2023-07-27T14:41:01.393398+0000","last_became_active":"2023-07-27T14:41:00.955892+0000","last_became_peered":"2023-07-27T14:41:00.955892+0000","last_unstale":"2023-07-27T14:41:01.393398+0000","last_undegraded":"2023-07-27T14:41:01.393398+0000","last_fullsized":"2023-07-27T14:41:01.393398+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-07-27T14:40:56.942390+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:40:56.942390+0000","last_peered":"2023-07-27T14:40:56.942390+0000","last_clean":"2023-07-27T14:40:56.942390+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:40:56.942390+0000","last_undegraded":"2023-07-27T14:40:56.942390+0000","last_fullsized":"2023-07-27T14:40:56.942390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:41:00.920800+0000","last_change":"2023-07-27T14:41:00.920800+0000","last_active":"2023-07-27T14:41:00.920800+0000","last_peered":"2023-07-27T14:41:00.920800+0000","last_clean":"2023-07-27T14:41:00.920800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:41:00.920800+0000","last_undegraded":"2023-07-27T14:41:00.920800+0000","last_fullsized":"2023-07-27T14:41:00.920800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1f","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.416256+0000","last_change":"2023-07-27T14:41:00.951173+0000","last_active":"2023-07-27T14:41:01.416256+0000","last_peered":"2023-07-27T14:41:01.416256+0000","last_clean":"2023-07-27T14:41:01.416256+0000","last_became_active":"2023-07-27T14:41:00.950894+0000","last_became_peered":"2023-07-27T14:41:00.950894+0000","last_unstale":"2023-07-27T14:41:01.416256+0000","last_undegraded":"2023-07-27T14:41:01.416256+0000","last_fullsized":"2023-07-27T14:41:01.416256+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":182,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-07-27T14:40:56.942423+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:40:56.942423+0000","last_peered":"2023-07-27T14:40:56.942423+0000","last_clean":"2023-07-27T14:40:56.942423+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:40:56.942423+0000","last_undegraded":"2023-07-27T14:40:56.942423+0000","last_fullsized":"2023-07-27T14:40:56.942423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":183,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-07-27T14:40:56.942345+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:40:56.942345+0000","last_peered":"2023-07-27T14:40:56.942345+0000","last_clean":"2023-07-27T14:40:56.942345+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:40:56.942345+0000","last_undegraded":"2023-07-27T14:40:56.942345+0000","last_fullsized":"2023-07-27T14:40:56.942345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410643+0000","last_change":"2023-07-27T14:41:01.407565+0000","last_active":"2023-07-27T14:41:01.410643+0000","last_peered":"2023-07-27T14:41:01.410643+0000","last_clean":"2023-07-27T14:41:01.410643+0000","last_became_active":"2023-07-27T14:41:01.407271+0000","last_became_peered":"2023-07-27T14:41:01.407271+0000","last_unstale":"2023-07-27T14:41:01.410643+0000","last_undegraded":"2023-07-27T14:41:01.410643+0000","last_fullsized":"2023-07-27T14:41:01.410643+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423277+0000","last_change":"2023-07-27T14:41:00.942559+0000","last_active":"2023-07-27T14:41:01.423277+0000","last_peered":"2023-07-27T14:41:01.423277+0000","last_clean":"2023-07-27T14:41:01.423277+0000","last_became_active":"2023-07-27T14:41:00.942228+0000","last_became_peered":"2023-07-27T14:41:00.942228+0000","last_unstale":"2023-07-27T14:41:01.423277+0000","last_undegraded":"2023-07-27T14:41:01.423277+0000","last_fullsized":"2023-07-27T14:41:01.423277+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.402058+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:41:01.402058+0000","last_peered":"2023-07-27T14:41:01.402058+0000","last_clean":"2023-07-27T14:41:01.402058+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:41:01.402058+0000","last_undegraded":"2023-07-27T14:41:01.402058+0000","last_fullsized":"2023-07-27T14:41:01.402058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413020+0000","last_change":"2023-07-27T14:41:01.408616+0000","last_active":"2023-07-27T14:41:01.413020+0000","last_peered":"2023-07-27T14:41:01.413020+0000","last_clean":"2023-07-27T14:41:01.413020+0000","last_became_active":"2023-07-27T14:41:01.408368+0000","last_became_peered":"2023-07-27T14:41:01.408368+0000","last_unstale":"2023-07-27T14:41:01.413020+0000","last_undegraded":"2023-07-27T14:41:01.413020+0000","last_fullsized":"2023-07-27T14:41:01.413020+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-27T14:40:59.912838+0000","last_change":"2023-07-27T14:40:59.912838+0000","last_active":"2023-07-27T14:40:59.912838+0000","last_peered":"2023-07-27T14:40:59.912838+0000","last_clean":"2023-07-27T14:40:59.912838+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-27T14:40:59.912838+0000","last_undegraded":"2023-07-27T14:40:59.912838+0000","last_fullsized":"2023-07-27T14:40:59.912838+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":183,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-07-27T14:40:56.942345+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:40:56.942345+0000","last_peered":"2023-07-27T14:40:56.942345+0000","last_clean":"2023-07-27T14:40:56.942345+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:40:56.942345+0000","last_undegraded":"2023-07-27T14:40:56.942345+0000","last_fullsized":"2023-07-27T14:40:56.942345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.417821+0000","last_change":"2023-07-27T14:41:01.407952+0000","last_active":"2023-07-27T14:41:01.417821+0000","last_peered":"2023-07-27T14:41:01.417821+0000","last_clean":"2023-07-27T14:41:01.417821+0000","last_became_active":"2023-07-27T14:41:01.407661+0000","last_became_peered":"2023-07-27T14:41:01.407661+0000","last_unstale":"2023-07-27T14:41:01.417821+0000","last_undegraded":"2023-07-27T14:41:01.417821+0000","last_fullsized":"2023-07-27T14:41:01.417821+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.392997+0000","last_change":"2023-07-27T14:41:00.946429+0000","last_active":"2023-07-27T14:41:01.392997+0000","last_peered":"2023-07-27T14:41:01.392997+0000","last_clean":"2023-07-27T14:41:01.392997+0000","last_became_active":"2023-07-27T14:41:00.946162+0000","last_became_peered":"2023-07-27T14:41:00.946162+0000","last_unstale":"2023-07-27T14:41:01.392997+0000","last_undegraded":"2023-07-27T14:41:01.392997+0000","last_fullsized":"2023-07-27T14:41:01.392997+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.403923+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:41:01.403923+0000","last_peered":"2023-07-27T14:41:01.403923+0000","last_clean":"2023-07-27T14:41:01.403923+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:41:01.403923+0000","last_undegraded":"2023-07-27T14:41:01.403923+0000","last_fullsized":"2023-07-27T14:41:01.403923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":768,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":68,"acting":68,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575020,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26452,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":23808,"kb_avail":94345388,"statfs":{"total":96636764160,"available":96609677312,"internally_reserved":0,"allocated":2699264,"data_stored":1281603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24379392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":3.093,"15min":3.093},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.71799999999999997,"15min":0.67300000000000004},"min":{"1min":0.46200000000000002,"5min":0.41899999999999998,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72699999999999998,"15min":0.70999999999999996},"min":{"1min":0.502,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":5.2599999999999998,"15min":5.2599999999999998},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86899999999999999,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73499999999999999,"15min":0.69999999999999996},"min":{"1min":0.48999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79300000000000004,"5min":8.952,"15min":8.952},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"max":{"1min":0.81299999999999994,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84799999999999998,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.70499999999999996,"15min":0.65900000000000003},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.318},"max":{"1min":0.875,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.503},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":0.86299999999999999,"5min":2.343,"15min":2.343},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.68400000000000005},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":0.92000000000000004,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.77400000000000002,"15min":0.72399999999999998},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":0.872,"5min":8.1630000000000003,"15min":8.1630000000000003},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.76800000000000002},"min":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":0.97799999999999998,"5min":7.6269999999999998,"15min":7.6269999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72299999999999998,"15min":0.71899999999999997},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94299999999999995,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575019,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26196,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":23552,"kb_avail":94345644,"statfs":{"total":96636764160,"available":96609939456,"internally_reserved":0,"allocated":2699264,"data_stored":1281603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24117248},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.63800000000000001},"min":{"1min":0.46999999999999997,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.82499999999999996,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.92100000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.752}]},{"osd":1,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.76100000000000001,"15min":0.66200000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":13.975,"15min":13.975},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.43099999999999999,"15min":0.42199999999999999},"max":{"1min":0.89900000000000002,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70999999999999996,"15min":0.66600000000000004},"min":{"1min":0.46300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79300000000000004,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":1.016},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.79700000000000004,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.76100000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73299999999999998,"15min":0.68600000000000005},"min":{"1min":0.495,"5min":0.48699999999999999,"15min":0.41199999999999998},"max":{"1min":0.84999999999999998,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75900000000000001,"15min":0.70099999999999996},"min":{"1min":0.55200000000000005,"5min":0.45700000000000002,"15min":0.433},"max":{"1min":0.82299999999999995,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.79100000000000004,"15min":0.67700000000000005},"min":{"1min":0.46999999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86099999999999999,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39900000000000002},"max":{"1min":0.94599999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72199999999999998,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.85899999999999999,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.84999999999999998,"15min":0.74099999999999999},"min":{"1min":0.50900000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":15.461,"15min":15.461},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.75800000000000001},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.92500000000000004,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83199999999999996,"15min":0.78400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26452,"kb_used_data":2700,"kb_used_omap":0,"kb_used_meta":23744,"kb_avail":94345388,"statfs":{"total":96636764160,"available":96609677312,"internally_reserved":0,"allocated":2764800,"data_stored":1309266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24313856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38,"15min":0.42299999999999999},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53000000000000003,"5min":0.57499999999999996,"15min":4.75},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.40600000000000003,"15min":0.49099999999999999},"min":{"1min":0.314,"5min":0.255,"15min":0.255},"max":{"1min":0.56299999999999994,"5min":0.65700000000000003,"15min":9.3100000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.49399999999999999},"min":{"1min":0.36199999999999999,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.624,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.629,"5min":0.68600000000000005,"15min":2.7160000000000002},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46000000000000002,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32800000000000001},"max":{"1min":0.59199999999999997,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.495},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45500000000000002,"15min":0.49299999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":3.8580000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.51200000000000001,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":0.85699999999999998,"5min":1.111,"15min":2.181},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":1.1459999999999999,"15min":2.4180000000000001},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83499999999999996,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89200000000000002,"5min":1.6879999999999999,"15min":2.149},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88100000000000001,"5min":1.2050000000000001,"15min":2.052},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70799999999999996,"15min":0.745},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92800000000000005,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96099999999999997,"5min":1.1419999999999999,"15min":2.016},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.46700000000000003},"max":{"1min":0.94499999999999995,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.78400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25292,"kb_used_data":2692,"kb_used_omap":0,"kb_used_meta":22592,"kb_avail":94346548,"statfs":{"total":96636764160,"available":96610865152,"internally_reserved":0,"allocated":2756608,"data_stored":1308602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23134208},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40600000000000003,"15min":0.39300000000000002},"min":{"1min":0.26500000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.625,"5min":1.954,"15min":1.954},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.51700000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29899999999999999,"15min":0.26900000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45900000000000002,"15min":0.46700000000000003},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.307},"max":{"1min":0.64000000000000001,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56499999999999995,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.58099999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70299999999999996,"15min":0.69599999999999995},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.53200000000000003,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.96899999999999997,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.54400000000000004,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.84399999999999997,"5min":1.0489999999999999,"15min":1.25},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.56899999999999995,"5min":0.443,"15min":0.41499999999999998},"max":{"1min":0.93899999999999995,"5min":1.016,"15min":1.6020000000000001},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.498},"max":{"1min":0.89800000000000002,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72599999999999998},"min":{"1min":0.59399999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.97999999999999998,"5min":1.0840000000000001,"15min":1.22},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.60299999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97199999999999998,"5min":2.141,"15min":2.141},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48699999999999999},"max":{"1min":0.95899999999999996,"5min":1.125,"15min":1.2370000000000001},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":30336,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":2740224,"data_stored":1301856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31064064},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.433,"15min":0.41299999999999998},"min":{"1min":0.30099999999999999,"5min":0.26300000000000001,"15min":0.23799999999999999},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":0.379},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42999999999999999,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75800000000000001,"5min":0.76800000000000002,"15min":1.1899999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.48999999999999999,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":5.601},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.50900000000000001,"15min":0.47799999999999998},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.52500000000000002,"15min":0.51600000000000001},"min":{"1min":0.39700000000000002,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.42999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.849},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.76000000000000001,"15min":0.73999999999999999},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":4.8869999999999996,"5min":4.8869999999999996,"15min":6.9660000000000002},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54600000000000004,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.772},"last":0.624}]},{"osd":6,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.76700000000000002,"15min":0.73699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.42499999999999999},"max":{"1min":6.7050000000000001,"5min":6.7050000000000001,"15min":6.7050000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.81399999999999995,"15min":0.79200000000000004},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":5.9020000000000001,"5min":5.9020000000000001,"15min":5.9020000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.80700000000000005,"15min":0.78400000000000003},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":6.4409999999999998,"5min":6.4409999999999998,"15min":6.4409999999999998},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575020,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24632,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94347208,"statfs":{"total":96636764160,"available":96611540992,"internally_reserved":0,"allocated":2736128,"data_stored":1301766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.23400000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":1.202},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":1.302},"last":0.37}]},{"osd":1,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.42899999999999999},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.44900000000000001,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":1.2390000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.504},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":1.8029999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.436,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.149},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68899999999999995,"15min":0.71599999999999997},"min":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":5.1059999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.46000000000000002},"max":{"1min":0.96799999999999997,"5min":1.0229999999999999,"15min":1.232},"last":0.621},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":2.3959999999999999},"last":0.629}]},{"osd":6,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.55700000000000005,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.44},"max":{"1min":0.999,"5min":0.999,"15min":1.343},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.745,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":1.04,"5min":1.115,"15min":2.048},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":1.107,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":23316,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":20672,"kb_avail":94348524,"statfs":{"total":96636764160,"available":96612888576,"internally_reserved":0,"allocated":2699264,"data_stored":1281603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21168128},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.745}]},{"osd":1,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39500000000000002},"max":{"1min":0.85299999999999998,"5min":3.419,"15min":4.4409999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.65300000000000002},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.86599999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":2.3010000000000002,"15min":4.476},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66900000000000004},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.98099999999999998,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.52200000000000002,"5min":0.46700000000000003,"15min":0.45500000000000002},"max":{"1min":0.79600000000000004,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.35999999999999999},"max":{"1min":0.81200000000000006,"5min":3.48,"15min":4.3949999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.38900000000000001},"max":{"1min":1.133,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":3.8620000000000001,"15min":5.194},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.60699999999999998,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.89900000000000002,"5min":2.387,"15min":5.5990000000000002},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.012,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.76500000000000001},"min":{"1min":0.56999999999999995,"5min":0.48699999999999999,"15min":0.34599999999999997},"max":{"1min":0.99399999999999999,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.81999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575020,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":24576,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":2699264,"data_stored":1281603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25165824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.621},"min":{"1min":0.432,"5min":0.379,"15min":0.317},"max":{"1min":0.871,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.63500000000000001},"min":{"1min":0.371,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":0.84799999999999998,"15min":12.127000000000001},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.67900000000000005,"15min":0.69499999999999995},"min":{"1min":0.49199999999999999,"5min":0.443,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":6.7489999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64700000000000002,"15min":0.67500000000000004},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":6.7370000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.624,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":1.581},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":1.0169999999999999,"5min":5.5750000000000002,"15min":5.5750000000000002},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.84099999999999997,"5min":0.874,"15min":9.6920000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.52000000000000002,"5min":0.50600000000000001,"15min":0.48199999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":9.4299999999999997},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.70299999999999996},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.978},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":2.4129999999999998},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":8.0329999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40200000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.7629999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96599999999999997,"5min":0.99399999999999999,"15min":2.3719999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.9419999999999999},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:41:05.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-27T14:41:05.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.878+0000 7f1f87bff700 1 Processor -- start 2023-07-27T14:41:05.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.878+0000 7f1f87bff700 1 -- start start 2023-07-27T14:41:05.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f87bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f801542a0 0x7f1f8015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f87bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800aa4d0 con 0x7f1f80153ec0 2023-07-27T14:41:05.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f87bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800c05c0 con 0x7f1f800aaa40 2023-07-27T14:41:05.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f87bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800c1a60 con 0x7f1f801542a0 2023-07-27T14:41:05.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f8599b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1f80153ec0 0x7f1f800a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36254/0 (socket says 172.21.15.115:36254) 2023-07-27T14:41:05.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f8599b700 1 -- 172.21.15.115:0/1184969426 learned_addr learned my addr 172.21.15.115:0/1184969426 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:05.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f8619c700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f801542a0 0x7f1f8015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723925531 0 0) 0x7f1f7c001110 con 0x7f1f80153ec0 2023-07-27T14:41:05.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f6c0033f0 con 0x7f1f80153ec0 2023-07-27T14:41:05.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1960373661 0 0) 0x7f1f6c0033f0 con 0x7f1f80153ec0 2023-07-27T14:41:05.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f801542a0 msgr2=0x7f1f8015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:05.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f84999700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f801542a0 0x7f1f8015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 >> v1:172.21.15.159:6789/0 conn(0x7f1f800aaa40 legacy=0x7f1f800640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.880+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800aa270 con 0x7f1f80153ec0 2023-07-27T14:41:05.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f1f7c001600 con 0x7f1f80153ec0 2023-07-27T14:41:05.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 >> v1:172.21.15.115:6789/0 conn(0x7f1f80153ec0 legacy=0x7f1f800a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f84999700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f801542a0 0x7f1f6c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f84999700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c003e00 0x7f1f6c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f84999700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f6c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800c1a60 con 0x7f1f6c004b80 2023-07-27T14:41:05.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c00b8e0 con 0x7f1f6c003e00 2023-07-27T14:41:05.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c00baa0 con 0x7f1f801542a0 2023-07-27T14:41:05.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8619c700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f6c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8599b700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f801542a0 0x7f1f6c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8519a700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c003e00 0x7f1f6c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8619c700 1 -- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f801542a0 msgr2=0x7f1f6c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8619c700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f801542a0 0x7f1f6c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8619c700 1 -- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c003e00 msgr2=0x7f1f6c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8619c700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c003e00 0x7f1f6c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8619c700 1 -- 172.21.15.115:0/1184969426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0033f0 con 0x7f1f6c004b80 2023-07-27T14:41:05.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8519a700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f6c003e00 0x7f1f6c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:05.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.881+0000 7f1f8619c700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f6c005000 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 rx=0x7f1f800843d0 tx=0x7f1f7800b040).ready entity=mon.0 client_cookie=3eed80f339a4a4bc server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78009ac0 con 0x7f1f6c004b80 2023-07-27T14:41:05.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7800f040 con 0x7f1f6c004b80 2023-07-27T14:41:05.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f84999700 1 -- 172.21.15.115:0/1184969426 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800ec10 con 0x7f1f6c004b80 2023-07-27T14:41:05.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f87bff700 1 -- 172.21.15.115:0/1184969426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 msgr2=0x7f1f6c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f87bff700 1 --2- 172.21.15.115:0/1184969426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f6c005000 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 rx=0x7f1f800843d0 tx=0x7f1f7800b040).stop 2023-07-27T14:41:05.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f8619c700 1 -- 172.21.15.115:0/1184969426 reap_dead start 2023-07-27T14:41:05.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f87bff700 1 -- 172.21.15.115:0/1184969426 shutdown_connections 2023-07-27T14:41:05.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f87bff700 1 -- 172.21.15.115:0/1184969426 >> 172.21.15.115:0/1184969426 conn(0x7f1f800cb610 msgr2=0x7f1f800c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:05.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f87bff700 1 -- 172.21.15.115:0/1184969426 shutdown_connections 2023-07-27T14:41:05.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.882+0000 7f1f87bff700 1 -- 172.21.15.115:0/1184969426 wait complete. 2023-07-27T14:41:05.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.884+0000 7f1f87bff700 1 Processor -- start 2023-07-27T14:41:05.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.884+0000 7f1f87bff700 1 -- start start 2023-07-27T14:41:05.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f87bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f80168360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f87bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f800adf80 0x7f1f8014ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f87bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f8014f360 0x7f1f80158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f87bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800c3190 con 0x7f1f6c004b80 2023-07-27T14:41:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f87bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800ae790 con 0x7f1f800adf80 2023-07-27T14:41:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f87bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800aea70 con 0x7f1f8014f360 2023-07-27T14:41:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8599b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f80168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8599b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f80168360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48738/0 (socket says 172.21.15.115:48738) 2023-07-27T14:41:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8599b700 1 -- 172.21.15.115:0/361611046 learned_addr learned my addr 172.21.15.115:0/361611046 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:05.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8619c700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f8014f360 0x7f1f80158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8519a700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f800adf80 0x7f1f8014ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8599b700 1 -- 172.21.15.115:0/361611046 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f8014f360 msgr2=0x7f1f80158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8599b700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f8014f360 0x7f1f80158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8599b700 1 -- 172.21.15.115:0/361611046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f800adf80 msgr2=0x7f1f8014ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:05.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8599b700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f800adf80 0x7f1f8014ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:05.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.885+0000 7f1f8599b700 1 -- 172.21.15.115:0/361611046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800aed50 con 0x7f1f6c004b80 2023-07-27T14:41:05.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.886+0000 7f1f8599b700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f80168360 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 rx=0x7f1f7c007960 tx=0x7f1f7c007850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.886+0000 7f1f75ffb700 1 -- 172.21.15.115:0/361611046 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c011590 con 0x7f1f6c004b80 2023-07-27T14:41:05.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.886+0000 7f1f75ffb700 1 -- 172.21.15.115:0/361611046 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c0116f0 con 0x7f1f6c004b80 2023-07-27T14:41:05.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.886+0000 7f1f75ffb700 1 -- 172.21.15.115:0/361611046 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c011a70 con 0x7f1f6c004b80 2023-07-27T14:41:05.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.886+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f800af030 con 0x7f1f6c004b80 2023-07-27T14:41:05.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.886+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f80158d50 con 0x7f1f6c004b80 2023-07-27T14:41:05.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.887+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8006c470 con 0x7f1f6c004b80 2023-07-27T14:41:05.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.888+0000 7f1f75ffb700 1 -- 172.21.15.115:0/361611046 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f1f7c01b030 con 0x7f1f6c004b80 2023-07-27T14:41:05.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.888+0000 7f1f75ffb700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1f6405fe20 0x7f1f640622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:05.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.889+0000 7f1f75ffb700 1 -- 172.21.15.115:0/361611046 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f1f7c07ac50 con 0x7f1f6c004b80 2023-07-27T14:41:05.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.889+0000 7f1f8519a700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1f6405fe20 0x7f1f640622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:05.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.889+0000 7f1f8519a700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1f6405fe20 0x7f1f640622e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f1f70000f60 tx=0x7f1f70009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:05.950 INFO:tasks.ceph.mds.c.smithi115.stderr:2023-07-27T14:41:05.892+0000 7f643f1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-27T14:41:05.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:05.892+0000 7f1f75ffb700 1 -- 172.21.15.115:0/361611046 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1f7c04a8f0 con 0x7f1f6c004b80 2023-07-27T14:41:06.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.058+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f800c32d0 con 0x7f1f6405fe20 2023-07-27T14:41:06.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.068+0000 7f1f75ffb700 1 -- 172.21.15.115:0/361611046 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361925 (secure 0 0 0) 0x7f1f70003650 con 0x7f1f6405fe20 2023-07-27T14:41:06.128 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:41:06.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1f6405fe20 msgr2=0x7f1f640622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1f6405fe20 0x7f1f640622e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f1f70000f60 tx=0x7f1f70009040).stop 2023-07-27T14:41:06.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 msgr2=0x7f1f80168360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f80168360 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 rx=0x7f1f7c007960 tx=0x7f1f7c007850).stop 2023-07-27T14:41:06.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 shutdown_connections 2023-07-27T14:41:06.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f1f6405fe20 0x7f1f640622e0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1f8014f360 0x7f1f80158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f6c004b80 0x7f1f80168360 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 --2- 172.21.15.115:0/361611046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f800adf80 0x7f1f8014ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 >> 172.21.15.115:0/361611046 conn(0x7f1f800cb610 msgr2=0x7f1f800ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:06.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 shutdown_connections 2023-07-27T14:41:06.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.072+0000 7f1f87bff700 1 -- 172.21.15.115:0/361611046 wait complete. 2023-07-27T14:41:06.132 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-07-27T14:41:06.146 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":637,"stamp":"2023-07-27T14:41:05.631115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":213576,"kb_used_data":21512,"kb_used_omap":0,"kb_used_meta":192000,"kb_avail":754761144,"statfs":{"total":773094113280,"available":772875411456,"internally_reserved":0,"allocated":22028288,"data_stored":10459132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":196608000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-34397213,"num_objects":-81,"num_object_clones":-34,"num_object_copies":-162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-81,"num_whiteouts":-34,"num_read":-36,"num_read_kb":-16406,"num_write":-247,"num_write_kb":-33671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.098626"},"pg_stats":[{"pgid":"31.3e","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426920+0000","last_change":"2023-07-27T14:41:01.425607+0000","last_active":"2023-07-27T14:41:01.426920+0000","last_peered":"2023-07-27T14:41:01.426920+0000","last_clean":"2023-07-27T14:41:01.426920+0000","last_became_active":"2023-07-27T14:41:01.425344+0000","last_became_peered":"2023-07-27T14:41:01.425344+0000","last_unstale":"2023-07-27T14:41:01.426920+0000","last_undegraded":"2023-07-27T14:41:01.426920+0000","last_fullsized":"2023-07-27T14:41:01.426920+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.3f","version":"217'3","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424181+0000","last_change":"2023-07-27T14:41:00.954798+0000","last_active":"2023-07-27T14:41:01.424181+0000","last_peered":"2023-07-27T14:41:01.424181+0000","last_clean":"2023-07-27T14:41:01.424181+0000","last_became_active":"2023-07-27T14:41:00.954481+0000","last_became_peered":"2023-07-27T14:41:00.954481+0000","last_unstale":"2023-07-27T14:41:01.424181+0000","last_undegraded":"2023-07-27T14:41:01.424181+0000","last_fullsized":"2023-07-27T14:41:01.424181+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3f","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422945+0000","last_change":"2023-07-27T14:41:01.414140+0000","last_active":"2023-07-27T14:41:01.422945+0000","last_peered":"2023-07-27T14:41:01.422945+0000","last_clean":"2023-07-27T14:41:01.422945+0000","last_became_active":"2023-07-27T14:41:01.412039+0000","last_became_peered":"2023-07-27T14:41:01.412039+0000","last_unstale":"2023-07-27T14:41:01.422945+0000","last_undegraded":"2023-07-27T14:41:01.422945+0000","last_fullsized":"2023-07-27T14:41:01.422945+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.398612+0000","last_change":"2023-07-27T14:41:00.941273+0000","last_active":"2023-07-27T14:41:01.398612+0000","last_peered":"2023-07-27T14:41:01.398612+0000","last_clean":"2023-07-27T14:41:01.398612+0000","last_became_active":"2023-07-27T14:41:00.940983+0000","last_became_peered":"2023-07-27T14:41:00.940983+0000","last_unstale":"2023-07-27T14:41:01.398612+0000","last_undegraded":"2023-07-27T14:41:01.398612+0000","last_fullsized":"2023-07-27T14:41:01.398612+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.417157+0000","last_change":"2023-07-27T14:41:01.415033+0000","last_active":"2023-07-27T14:41:01.417157+0000","last_peered":"2023-07-27T14:41:01.417157+0000","last_clean":"2023-07-27T14:41:01.417157+0000","last_became_active":"2023-07-27T14:41:01.414765+0000","last_became_peered":"2023-07-27T14:41:01.414765+0000","last_unstale":"2023-07-27T14:41:01.417157+0000","last_undegraded":"2023-07-27T14:41:01.417157+0000","last_fullsized":"2023-07-27T14:41:01.417157+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393809+0000","last_change":"2023-07-27T14:41:00.943027+0000","last_active":"2023-07-27T14:41:01.393809+0000","last_peered":"2023-07-27T14:41:01.393809+0000","last_clean":"2023-07-27T14:41:01.393809+0000","last_became_active":"2023-07-27T14:41:00.942783+0000","last_became_peered":"2023-07-27T14:41:00.942783+0000","last_unstale":"2023-07-27T14:41:01.393809+0000","last_undegraded":"2023-07-27T14:41:01.393809+0000","last_fullsized":"2023-07-27T14:41:01.393809+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426439+0000","last_change":"2023-07-27T14:41:01.424061+0000","last_active":"2023-07-27T14:41:01.426439+0000","last_peered":"2023-07-27T14:41:01.426439+0000","last_clean":"2023-07-27T14:41:01.426439+0000","last_became_active":"2023-07-27T14:41:01.423797+0000","last_became_peered":"2023-07-27T14:41:01.423797+0000","last_unstale":"2023-07-27T14:41:01.426439+0000","last_undegraded":"2023-07-27T14:41:01.426439+0000","last_fullsized":"2023-07-27T14:41:01.426439+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422115+0000","last_change":"2023-07-27T14:41:00.953885+0000","last_active":"2023-07-27T14:41:01.422115+0000","last_peered":"2023-07-27T14:41:01.422115+0000","last_clean":"2023-07-27T14:41:01.422115+0000","last_became_active":"2023-07-27T14:41:00.953560+0000","last_became_peered":"2023-07-27T14:41:00.953560+0000","last_unstale":"2023-07-27T14:41:01.422115+0000","last_undegraded":"2023-07-27T14:41:01.422115+0000","last_fullsized":"2023-07-27T14:41:01.422115+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.414882+0000","last_change":"2023-07-27T14:41:01.411475+0000","last_active":"2023-07-27T14:41:01.414882+0000","last_peered":"2023-07-27T14:41:01.414882+0000","last_clean":"2023-07-27T14:41:01.414882+0000","last_became_active":"2023-07-27T14:41:01.411181+0000","last_became_peered":"2023-07-27T14:41:01.411181+0000","last_unstale":"2023-07-27T14:41:01.414882+0000","last_undegraded":"2023-07-27T14:41:01.414882+0000","last_fullsized":"2023-07-27T14:41:01.414882+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3b","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424449+0000","last_change":"2023-07-27T14:41:00.961656+0000","last_active":"2023-07-27T14:41:01.424449+0000","last_peered":"2023-07-27T14:41:01.424449+0000","last_clean":"2023-07-27T14:41:01.424449+0000","last_became_active":"2023-07-27T14:41:00.961175+0000","last_became_peered":"2023-07-27T14:41:00.961175+0000","last_unstale":"2023-07-27T14:41:01.424449+0000","last_undegraded":"2023-07-27T14:41:01.424449+0000","last_fullsized":"2023-07-27T14:41:01.424449+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.418108+0000","last_change":"2023-07-27T14:41:01.411487+0000","last_active":"2023-07-27T14:41:01.418108+0000","last_peered":"2023-07-27T14:41:01.418108+0000","last_clean":"2023-07-27T14:41:01.418108+0000","last_became_active":"2023-07-27T14:41:01.409855+0000","last_became_peered":"2023-07-27T14:41:01.409855+0000","last_unstale":"2023-07-27T14:41:01.418108+0000","last_undegraded":"2023-07-27T14:41:01.418108+0000","last_fullsized":"2023-07-27T14:41:01.418108+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.3a","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423796+0000","last_change":"2023-07-27T14:41:00.952044+0000","last_active":"2023-07-27T14:41:01.423796+0000","last_peered":"2023-07-27T14:41:01.423796+0000","last_clean":"2023-07-27T14:41:01.423796+0000","last_became_active":"2023-07-27T14:41:00.951565+0000","last_became_peered":"2023-07-27T14:41:00.951565+0000","last_unstale":"2023-07-27T14:41:01.423796+0000","last_undegraded":"2023-07-27T14:41:01.423796+0000","last_fullsized":"2023-07-27T14:41:01.423796+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425231+0000","last_change":"2023-07-27T14:41:01.422597+0000","last_active":"2023-07-27T14:41:01.425231+0000","last_peered":"2023-07-27T14:41:01.425231+0000","last_clean":"2023-07-27T14:41:01.425231+0000","last_became_active":"2023-07-27T14:41:01.422189+0000","last_became_peered":"2023-07-27T14:41:01.422189+0000","last_unstale":"2023-07-27T14:41:01.425231+0000","last_undegraded":"2023-07-27T14:41:01.425231+0000","last_fullsized":"2023-07-27T14:41:01.425231+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.392643+0000","last_change":"2023-07-27T14:41:00.951838+0000","last_active":"2023-07-27T14:41:01.392643+0000","last_peered":"2023-07-27T14:41:01.392643+0000","last_clean":"2023-07-27T14:41:01.392643+0000","last_became_active":"2023-07-27T14:41:00.951388+0000","last_became_peered":"2023-07-27T14:41:00.951388+0000","last_unstale":"2023-07-27T14:41:01.392643+0000","last_undegraded":"2023-07-27T14:41:01.392643+0000","last_fullsized":"2023-07-27T14:41:01.392643+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.416790+0000","last_change":"2023-07-27T14:41:01.414813+0000","last_active":"2023-07-27T14:41:01.416790+0000","last_peered":"2023-07-27T14:41:01.416790+0000","last_clean":"2023-07-27T14:41:01.416790+0000","last_became_active":"2023-07-27T14:41:01.413608+0000","last_became_peered":"2023-07-27T14:41:01.413608+0000","last_unstale":"2023-07-27T14:41:01.416790+0000","last_undegraded":"2023-07-27T14:41:01.416790+0000","last_fullsized":"2023-07-27T14:41:01.416790+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.395957+0000","last_change":"2023-07-27T14:41:00.952993+0000","last_active":"2023-07-27T14:41:01.395957+0000","last_peered":"2023-07-27T14:41:01.395957+0000","last_clean":"2023-07-27T14:41:01.395957+0000","last_became_active":"2023-07-27T14:41:00.952589+0000","last_became_peered":"2023-07-27T14:41:00.952589+0000","last_unstale":"2023-07-27T14:41:01.395957+0000","last_undegraded":"2023-07-27T14:41:01.395957+0000","last_fullsized":"2023-07-27T14:41:01.395957+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422384+0000","last_change":"2023-07-27T14:41:01.417736+0000","last_active":"2023-07-27T14:41:01.422384+0000","last_peered":"2023-07-27T14:41:01.422384+0000","last_clean":"2023-07-27T14:41:01.422384+0000","last_became_active":"2023-07-27T14:41:01.417456+0000","last_became_peered":"2023-07-27T14:41:01.417456+0000","last_unstale":"2023-07-27T14:41:01.422384+0000","last_undegraded":"2023-07-27T14:41:01.422384+0000","last_fullsized":"2023-07-27T14:41:01.422384+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.397783+0000","last_change":"2023-07-27T14:41:00.959911+0000","last_active":"2023-07-27T14:41:01.397783+0000","last_peered":"2023-07-27T14:41:01.397783+0000","last_clean":"2023-07-27T14:41:01.397783+0000","last_became_active":"2023-07-27T14:41:00.959600+0000","last_became_peered":"2023-07-27T14:41:00.959600+0000","last_unstale":"2023-07-27T14:41:01.397783+0000","last_undegraded":"2023-07-27T14:41:01.397783+0000","last_fullsized":"2023-07-27T14:41:01.397783+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.419933+0000","last_change":"2023-07-27T14:41:01.413801+0000","last_active":"2023-07-27T14:41:01.419933+0000","last_peered":"2023-07-27T14:41:01.419933+0000","last_clean":"2023-07-27T14:41:01.419933+0000","last_became_active":"2023-07-27T14:41:01.413511+0000","last_became_peered":"2023-07-27T14:41:01.413511+0000","last_unstale":"2023-07-27T14:41:01.419933+0000","last_undegraded":"2023-07-27T14:41:01.419933+0000","last_fullsized":"2023-07-27T14:41:01.419933+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393504+0000","last_change":"2023-07-27T14:41:00.953910+0000","last_active":"2023-07-27T14:41:01.393504+0000","last_peered":"2023-07-27T14:41:01.393504+0000","last_clean":"2023-07-27T14:41:01.393504+0000","last_became_active":"2023-07-27T14:41:00.952852+0000","last_became_peered":"2023-07-27T14:41:00.952852+0000","last_unstale":"2023-07-27T14:41:01.393504+0000","last_undegraded":"2023-07-27T14:41:01.393504+0000","last_fullsized":"2023-07-27T14:41:01.393504+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422450+0000","last_change":"2023-07-27T14:41:01.417980+0000","last_active":"2023-07-27T14:41:01.422450+0000","last_peered":"2023-07-27T14:41:01.422450+0000","last_clean":"2023-07-27T14:41:01.422450+0000","last_became_active":"2023-07-27T14:41:01.417509+0000","last_became_peered":"2023-07-27T14:41:01.417509+0000","last_unstale":"2023-07-27T14:41:01.422450+0000","last_undegraded":"2023-07-27T14:41:01.422450+0000","last_fullsized":"2023-07-27T14:41:01.422450+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413110+0000","last_change":"2023-07-27T14:41:00.955596+0000","last_active":"2023-07-27T14:41:01.413110+0000","last_peered":"2023-07-27T14:41:01.413110+0000","last_clean":"2023-07-27T14:41:01.413110+0000","last_became_active":"2023-07-27T14:41:00.955074+0000","last_became_peered":"2023-07-27T14:41:00.955074+0000","last_unstale":"2023-07-27T14:41:01.413110+0000","last_undegraded":"2023-07-27T14:41:01.413110+0000","last_fullsized":"2023-07-27T14:41:01.413110+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410613+0000","last_change":"2023-07-27T14:41:01.406780+0000","last_active":"2023-07-27T14:41:01.410613+0000","last_peered":"2023-07-27T14:41:01.410613+0000","last_clean":"2023-07-27T14:41:01.410613+0000","last_became_active":"2023-07-27T14:41:01.406218+0000","last_became_peered":"2023-07-27T14:41:01.406218+0000","last_unstale":"2023-07-27T14:41:01.410613+0000","last_undegraded":"2023-07-27T14:41:01.410613+0000","last_fullsized":"2023-07-27T14:41:01.410613+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.34","version":"217'4","reported_seq":14,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.427832+0000","last_change":"2023-07-27T14:41:00.949112+0000","last_active":"2023-07-27T14:41:01.427832+0000","last_peered":"2023-07-27T14:41:01.427832+0000","last_clean":"2023-07-27T14:41:01.427832+0000","last_became_active":"2023-07-27T14:41:00.948750+0000","last_became_peered":"2023-07-27T14:41:00.948750+0000","last_unstale":"2023-07-27T14:41:01.427832+0000","last_undegraded":"2023-07-27T14:41:01.427832+0000","last_fullsized":"2023-07-27T14:41:01.427832+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.417926+0000","last_change":"2023-07-27T14:41:01.408818+0000","last_active":"2023-07-27T14:41:01.417926+0000","last_peered":"2023-07-27T14:41:01.417926+0000","last_clean":"2023-07-27T14:41:01.417926+0000","last_became_active":"2023-07-27T14:41:01.408548+0000","last_became_peered":"2023-07-27T14:41:01.408548+0000","last_unstale":"2023-07-27T14:41:01.417926+0000","last_undegraded":"2023-07-27T14:41:01.417926+0000","last_fullsized":"2023-07-27T14:41:01.417926+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.33","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422975+0000","last_change":"2023-07-27T14:41:00.952757+0000","last_active":"2023-07-27T14:41:01.422975+0000","last_peered":"2023-07-27T14:41:01.422975+0000","last_clean":"2023-07-27T14:41:01.422975+0000","last_became_active":"2023-07-27T14:41:00.951636+0000","last_became_peered":"2023-07-27T14:41:00.951636+0000","last_unstale":"2023-07-27T14:41:01.422975+0000","last_undegraded":"2023-07-27T14:41:01.422975+0000","last_fullsized":"2023-07-27T14:41:01.422975+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410377+0000","last_change":"2023-07-27T14:41:01.406683+0000","last_active":"2023-07-27T14:41:01.410377+0000","last_peered":"2023-07-27T14:41:01.410377+0000","last_clean":"2023-07-27T14:41:01.410377+0000","last_became_active":"2023-07-27T14:41:01.406375+0000","last_became_peered":"2023-07-27T14:41:01.406375+0000","last_unstale":"2023-07-27T14:41:01.410377+0000","last_undegraded":"2023-07-27T14:41:01.410377+0000","last_fullsized":"2023-07-27T14:41:01.410377+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399820+0000","last_change":"2023-07-27T14:41:00.949265+0000","last_active":"2023-07-27T14:41:01.399820+0000","last_peered":"2023-07-27T14:41:01.399820+0000","last_clean":"2023-07-27T14:41:01.399820+0000","last_became_active":"2023-07-27T14:41:00.948905+0000","last_became_peered":"2023-07-27T14:41:00.948905+0000","last_unstale":"2023-07-27T14:41:01.399820+0000","last_undegraded":"2023-07-27T14:41:01.399820+0000","last_fullsized":"2023-07-27T14:41:01.399820+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.401617+0000","last_change":"2023-07-27T14:41:01.400704+0000","last_active":"2023-07-27T14:41:01.401617+0000","last_peered":"2023-07-27T14:41:01.401617+0000","last_clean":"2023-07-27T14:41:01.401617+0000","last_became_active":"2023-07-27T14:41:01.400421+0000","last_became_peered":"2023-07-27T14:41:01.400421+0000","last_unstale":"2023-07-27T14:41:01.401617+0000","last_undegraded":"2023-07-27T14:41:01.401617+0000","last_fullsized":"2023-07-27T14:41:01.401617+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399639+0000","last_change":"2023-07-27T14:41:00.948585+0000","last_active":"2023-07-27T14:41:01.399639+0000","last_peered":"2023-07-27T14:41:01.399639+0000","last_clean":"2023-07-27T14:41:01.399639+0000","last_became_active":"2023-07-27T14:41:00.948140+0000","last_became_peered":"2023-07-27T14:41:00.948140+0000","last_unstale":"2023-07-27T14:41:01.399639+0000","last_undegraded":"2023-07-27T14:41:01.399639+0000","last_fullsized":"2023-07-27T14:41:01.399639+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.415993+0000","last_change":"2023-07-27T14:41:01.410729+0000","last_active":"2023-07-27T14:41:01.415993+0000","last_peered":"2023-07-27T14:41:01.415993+0000","last_clean":"2023-07-27T14:41:01.415993+0000","last_became_active":"2023-07-27T14:41:01.409989+0000","last_became_peered":"2023-07-27T14:41:01.409989+0000","last_unstale":"2023-07-27T14:41:01.415993+0000","last_undegraded":"2023-07-27T14:41:01.415993+0000","last_fullsized":"2023-07-27T14:41:01.415993+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.30","version":"217'4","reported_seq":14,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.419709+0000","last_change":"2023-07-27T14:41:00.948470+0000","last_active":"2023-07-27T14:41:01.419709+0000","last_peered":"2023-07-27T14:41:01.419709+0000","last_clean":"2023-07-27T14:41:01.419709+0000","last_became_active":"2023-07-27T14:41:00.948129+0000","last_became_peered":"2023-07-27T14:41:00.948129+0000","last_unstale":"2023-07-27T14:41:01.419709+0000","last_undegraded":"2023-07-27T14:41:01.419709+0000","last_fullsized":"2023-07-27T14:41:01.419709+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424278+0000","last_change":"2023-07-27T14:41:01.417718+0000","last_active":"2023-07-27T14:41:01.424278+0000","last_peered":"2023-07-27T14:41:01.424278+0000","last_clean":"2023-07-27T14:41:01.424278+0000","last_became_active":"2023-07-27T14:41:01.417475+0000","last_became_peered":"2023-07-27T14:41:01.417475+0000","last_unstale":"2023-07-27T14:41:01.424278+0000","last_undegraded":"2023-07-27T14:41:01.424278+0000","last_fullsized":"2023-07-27T14:41:01.424278+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399296+0000","last_change":"2023-07-27T14:41:00.956718+0000","last_active":"2023-07-27T14:41:01.399296+0000","last_peered":"2023-07-27T14:41:01.399296+0000","last_clean":"2023-07-27T14:41:01.399296+0000","last_became_active":"2023-07-27T14:41:00.956393+0000","last_became_peered":"2023-07-27T14:41:00.956393+0000","last_unstale":"2023-07-27T14:41:01.399296+0000","last_undegraded":"2023-07-27T14:41:01.399296+0000","last_fullsized":"2023-07-27T14:41:01.399296+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425200+0000","last_change":"2023-07-27T14:41:01.422889+0000","last_active":"2023-07-27T14:41:01.425200+0000","last_peered":"2023-07-27T14:41:01.425200+0000","last_clean":"2023-07-27T14:41:01.425200+0000","last_became_active":"2023-07-27T14:41:01.421678+0000","last_became_peered":"2023-07-27T14:41:01.421678+0000","last_unstale":"2023-07-27T14:41:01.425200+0000","last_undegraded":"2023-07-27T14:41:01.425200+0000","last_fullsized":"2023-07-27T14:41:01.425200+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393597+0000","last_change":"2023-07-27T14:41:00.953540+0000","last_active":"2023-07-27T14:41:01.393597+0000","last_peered":"2023-07-27T14:41:01.393597+0000","last_clean":"2023-07-27T14:41:01.393597+0000","last_became_active":"2023-07-27T14:41:00.952096+0000","last_became_peered":"2023-07-27T14:41:00.952096+0000","last_unstale":"2023-07-27T14:41:01.393597+0000","last_undegraded":"2023-07-27T14:41:01.393597+0000","last_fullsized":"2023-07-27T14:41:01.393597+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.411341+0000","last_change":"2023-07-27T14:41:01.405804+0000","last_active":"2023-07-27T14:41:01.411341+0000","last_peered":"2023-07-27T14:41:01.411341+0000","last_clean":"2023-07-27T14:41:01.411341+0000","last_became_active":"2023-07-27T14:41:01.405108+0000","last_became_peered":"2023-07-27T14:41:01.405108+0000","last_unstale":"2023-07-27T14:41:01.411341+0000","last_undegraded":"2023-07-27T14:41:01.411341+0000","last_fullsized":"2023-07-27T14:41:01.411341+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423783+0000","last_change":"2023-07-27T14:41:00.959656+0000","last_active":"2023-07-27T14:41:01.423783+0000","last_peered":"2023-07-27T14:41:01.423783+0000","last_clean":"2023-07-27T14:41:01.423783+0000","last_became_active":"2023-07-27T14:41:00.955907+0000","last_became_peered":"2023-07-27T14:41:00.955907+0000","last_unstale":"2023-07-27T14:41:01.423783+0000","last_undegraded":"2023-07-27T14:41:01.423783+0000","last_fullsized":"2023-07-27T14:41:01.423783+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423149+0000","last_change":"2023-07-27T14:41:01.419857+0000","last_active":"2023-07-27T14:41:01.423149+0000","last_peered":"2023-07-27T14:41:01.423149+0000","last_clean":"2023-07-27T14:41:01.423149+0000","last_became_active":"2023-07-27T14:41:01.419363+0000","last_became_peered":"2023-07-27T14:41:01.419363+0000","last_unstale":"2023-07-27T14:41:01.423149+0000","last_undegraded":"2023-07-27T14:41:01.423149+0000","last_fullsized":"2023-07-27T14:41:01.423149+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.397382+0000","last_change":"2023-07-27T14:41:00.953424+0000","last_active":"2023-07-27T14:41:01.397382+0000","last_peered":"2023-07-27T14:41:01.397382+0000","last_clean":"2023-07-27T14:41:01.397382+0000","last_became_active":"2023-07-27T14:41:00.952709+0000","last_became_peered":"2023-07-27T14:41:00.952709+0000","last_unstale":"2023-07-27T14:41:01.397382+0000","last_undegraded":"2023-07-27T14:41:01.397382+0000","last_fullsized":"2023-07-27T14:41:01.397382+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.412418+0000","last_change":"2023-07-27T14:41:01.409037+0000","last_active":"2023-07-27T14:41:01.412418+0000","last_peered":"2023-07-27T14:41:01.412418+0000","last_clean":"2023-07-27T14:41:01.412418+0000","last_became_active":"2023-07-27T14:41:01.408727+0000","last_became_peered":"2023-07-27T14:41:01.408727+0000","last_unstale":"2023-07-27T14:41:01.412418+0000","last_undegraded":"2023-07-27T14:41:01.412418+0000","last_fullsized":"2023-07-27T14:41:01.412418+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2b","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422082+0000","last_change":"2023-07-27T14:41:00.945184+0000","last_active":"2023-07-27T14:41:01.422082+0000","last_peered":"2023-07-27T14:41:01.422082+0000","last_clean":"2023-07-27T14:41:01.422082+0000","last_became_active":"2023-07-27T14:41:00.944895+0000","last_became_peered":"2023-07-27T14:41:00.944895+0000","last_unstale":"2023-07-27T14:41:01.422082+0000","last_undegraded":"2023-07-27T14:41:01.422082+0000","last_fullsized":"2023-07-27T14:41:01.422082+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425668+0000","last_change":"2023-07-27T14:41:01.423156+0000","last_active":"2023-07-27T14:41:01.425668+0000","last_peered":"2023-07-27T14:41:01.425668+0000","last_clean":"2023-07-27T14:41:01.425668+0000","last_became_active":"2023-07-27T14:41:01.422800+0000","last_became_peered":"2023-07-27T14:41:01.422800+0000","last_unstale":"2023-07-27T14:41:01.425668+0000","last_undegraded":"2023-07-27T14:41:01.425668+0000","last_fullsized":"2023-07-27T14:41:01.425668+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399851+0000","last_change":"2023-07-27T14:41:00.947860+0000","last_active":"2023-07-27T14:41:01.399851+0000","last_peered":"2023-07-27T14:41:01.399851+0000","last_clean":"2023-07-27T14:41:01.399851+0000","last_became_active":"2023-07-27T14:41:00.947580+0000","last_became_peered":"2023-07-27T14:41:00.947580+0000","last_unstale":"2023-07-27T14:41:01.399851+0000","last_undegraded":"2023-07-27T14:41:01.399851+0000","last_fullsized":"2023-07-27T14:41:01.399851+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424354+0000","last_change":"2023-07-27T14:41:01.420551+0000","last_active":"2023-07-27T14:41:01.424354+0000","last_peered":"2023-07-27T14:41:01.424354+0000","last_clean":"2023-07-27T14:41:01.424354+0000","last_became_active":"2023-07-27T14:41:01.420299+0000","last_became_peered":"2023-07-27T14:41:01.420299+0000","last_unstale":"2023-07-27T14:41:01.424354+0000","last_undegraded":"2023-07-27T14:41:01.424354+0000","last_fullsized":"2023-07-27T14:41:01.424354+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.401894+0000","last_change":"2023-07-27T14:41:00.959770+0000","last_active":"2023-07-27T14:41:01.401894+0000","last_peered":"2023-07-27T14:41:01.401894+0000","last_clean":"2023-07-27T14:41:01.401894+0000","last_became_active":"2023-07-27T14:41:00.959496+0000","last_became_peered":"2023-07-27T14:41:00.959496+0000","last_unstale":"2023-07-27T14:41:01.401894+0000","last_undegraded":"2023-07-27T14:41:01.401894+0000","last_fullsized":"2023-07-27T14:41:01.401894+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425067+0000","last_change":"2023-07-27T14:41:01.422277+0000","last_active":"2023-07-27T14:41:01.425067+0000","last_peered":"2023-07-27T14:41:01.425067+0000","last_clean":"2023-07-27T14:41:01.425067+0000","last_became_active":"2023-07-27T14:41:01.421898+0000","last_became_peered":"2023-07-27T14:41:01.421898+0000","last_unstale":"2023-07-27T14:41:01.425067+0000","last_undegraded":"2023-07-27T14:41:01.425067+0000","last_fullsized":"2023-07-27T14:41:01.425067+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.400387+0000","last_change":"2023-07-27T14:41:00.951436+0000","last_active":"2023-07-27T14:41:01.400387+0000","last_peered":"2023-07-27T14:41:01.400387+0000","last_clean":"2023-07-27T14:41:01.400387+0000","last_became_active":"2023-07-27T14:41:00.951158+0000","last_became_peered":"2023-07-27T14:41:00.951158+0000","last_unstale":"2023-07-27T14:41:01.400387+0000","last_undegraded":"2023-07-27T14:41:01.400387+0000","last_fullsized":"2023-07-27T14:41:01.400387+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.416781+0000","last_change":"2023-07-27T14:41:01.414556+0000","last_active":"2023-07-27T14:41:01.416781+0000","last_peered":"2023-07-27T14:41:01.416781+0000","last_clean":"2023-07-27T14:41:01.416781+0000","last_became_active":"2023-07-27T14:41:01.414211+0000","last_became_peered":"2023-07-27T14:41:01.414211+0000","last_unstale":"2023-07-27T14:41:01.416781+0000","last_undegraded":"2023-07-27T14:41:01.416781+0000","last_fullsized":"2023-07-27T14:41:01.416781+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.401988+0000","last_change":"2023-07-27T14:41:00.957456+0000","last_active":"2023-07-27T14:41:01.401988+0000","last_peered":"2023-07-27T14:41:01.401988+0000","last_clean":"2023-07-27T14:41:01.401988+0000","last_became_active":"2023-07-27T14:41:00.957109+0000","last_became_peered":"2023-07-27T14:41:00.957109+0000","last_unstale":"2023-07-27T14:41:01.401988+0000","last_undegraded":"2023-07-27T14:41:01.401988+0000","last_fullsized":"2023-07-27T14:41:01.401988+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.417212+0000","last_change":"2023-07-27T14:41:01.414408+0000","last_active":"2023-07-27T14:41:01.417212+0000","last_peered":"2023-07-27T14:41:01.417212+0000","last_clean":"2023-07-27T14:41:01.417212+0000","last_became_active":"2023-07-27T14:41:01.414127+0000","last_became_peered":"2023-07-27T14:41:01.414127+0000","last_unstale":"2023-07-27T14:41:01.417212+0000","last_undegraded":"2023-07-27T14:41:01.417212+0000","last_fullsized":"2023-07-27T14:41:01.417212+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393684+0000","last_change":"2023-07-27T14:41:00.953730+0000","last_active":"2023-07-27T14:41:01.393684+0000","last_peered":"2023-07-27T14:41:01.393684+0000","last_clean":"2023-07-27T14:41:01.393684+0000","last_became_active":"2023-07-27T14:41:00.952472+0000","last_became_peered":"2023-07-27T14:41:00.952472+0000","last_unstale":"2023-07-27T14:41:01.393684+0000","last_undegraded":"2023-07-27T14:41:01.393684+0000","last_fullsized":"2023-07-27T14:41:01.393684+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424321+0000","last_change":"2023-07-27T14:41:01.419482+0000","last_active":"2023-07-27T14:41:01.424321+0000","last_peered":"2023-07-27T14:41:01.424321+0000","last_clean":"2023-07-27T14:41:01.424321+0000","last_became_active":"2023-07-27T14:41:01.419219+0000","last_became_peered":"2023-07-27T14:41:01.419219+0000","last_unstale":"2023-07-27T14:41:01.424321+0000","last_undegraded":"2023-07-27T14:41:01.424321+0000","last_fullsized":"2023-07-27T14:41:01.424321+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413217+0000","last_change":"2023-07-27T14:41:00.955351+0000","last_active":"2023-07-27T14:41:01.413217+0000","last_peered":"2023-07-27T14:41:01.413217+0000","last_clean":"2023-07-27T14:41:01.413217+0000","last_became_active":"2023-07-27T14:41:00.954726+0000","last_became_peered":"2023-07-27T14:41:00.954726+0000","last_unstale":"2023-07-27T14:41:01.413217+0000","last_undegraded":"2023-07-27T14:41:01.413217+0000","last_fullsized":"2023-07-27T14:41:01.413217+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410594+0000","last_change":"2023-07-27T14:41:01.406574+0000","last_active":"2023-07-27T14:41:01.410594+0000","last_peered":"2023-07-27T14:41:01.410594+0000","last_clean":"2023-07-27T14:41:01.410594+0000","last_became_active":"2023-07-27T14:41:01.405872+0000","last_became_peered":"2023-07-27T14:41:01.405872+0000","last_unstale":"2023-07-27T14:41:01.410594+0000","last_undegraded":"2023-07-27T14:41:01.410594+0000","last_fullsized":"2023-07-27T14:41:01.410594+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.398309+0000","last_change":"2023-07-27T14:41:00.951153+0000","last_active":"2023-07-27T14:41:01.398309+0000","last_peered":"2023-07-27T14:41:01.398309+0000","last_clean":"2023-07-27T14:41:01.398309+0000","last_became_active":"2023-07-27T14:41:00.950909+0000","last_became_peered":"2023-07-27T14:41:00.950909+0000","last_unstale":"2023-07-27T14:41:01.398309+0000","last_undegraded":"2023-07-27T14:41:01.398309+0000","last_fullsized":"2023-07-27T14:41:01.398309+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.412648+0000","last_change":"2023-07-27T14:41:01.407114+0000","last_active":"2023-07-27T14:41:01.412648+0000","last_peered":"2023-07-27T14:41:01.412648+0000","last_clean":"2023-07-27T14:41:01.412648+0000","last_became_active":"2023-07-27T14:41:01.406713+0000","last_became_peered":"2023-07-27T14:41:01.406713+0000","last_unstale":"2023-07-27T14:41:01.412648+0000","last_undegraded":"2023-07-27T14:41:01.412648+0000","last_fullsized":"2023-07-27T14:41:01.412648+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.398860+0000","last_change":"2023-07-27T14:41:00.954396+0000","last_active":"2023-07-27T14:41:01.398860+0000","last_peered":"2023-07-27T14:41:01.398860+0000","last_clean":"2023-07-27T14:41:01.398860+0000","last_became_active":"2023-07-27T14:41:00.953865+0000","last_became_peered":"2023-07-27T14:41:00.953865+0000","last_unstale":"2023-07-27T14:41:01.398860+0000","last_undegraded":"2023-07-27T14:41:01.398860+0000","last_fullsized":"2023-07-27T14:41:01.398860+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410630+0000","last_change":"2023-07-27T14:41:01.405092+0000","last_active":"2023-07-27T14:41:01.410630+0000","last_peered":"2023-07-27T14:41:01.410630+0000","last_clean":"2023-07-27T14:41:01.410630+0000","last_became_active":"2023-07-27T14:41:01.404217+0000","last_became_peered":"2023-07-27T14:41:01.404217+0000","last_unstale":"2023-07-27T14:41:01.410630+0000","last_undegraded":"2023-07-27T14:41:01.410630+0000","last_fullsized":"2023-07-27T14:41:01.410630+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.396663+0000","last_change":"2023-07-27T14:41:00.960205+0000","last_active":"2023-07-27T14:41:01.396663+0000","last_peered":"2023-07-27T14:41:01.396663+0000","last_clean":"2023-07-27T14:41:01.396663+0000","last_became_active":"2023-07-27T14:41:00.959906+0000","last_became_peered":"2023-07-27T14:41:00.959906+0000","last_unstale":"2023-07-27T14:41:01.396663+0000","last_undegraded":"2023-07-27T14:41:01.396663+0000","last_fullsized":"2023-07-27T14:41:01.396663+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422915+0000","last_change":"2023-07-27T14:41:01.414357+0000","last_active":"2023-07-27T14:41:01.422915+0000","last_peered":"2023-07-27T14:41:01.422915+0000","last_clean":"2023-07-27T14:41:01.422915+0000","last_became_active":"2023-07-27T14:41:01.412892+0000","last_became_peered":"2023-07-27T14:41:01.412892+0000","last_unstale":"2023-07-27T14:41:01.422915+0000","last_undegraded":"2023-07-27T14:41:01.422915+0000","last_fullsized":"2023-07-27T14:41:01.422915+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.401986+0000","last_change":"2023-07-27T14:41:00.952996+0000","last_active":"2023-07-27T14:41:01.401986+0000","last_peered":"2023-07-27T14:41:01.401986+0000","last_clean":"2023-07-27T14:41:01.401986+0000","last_became_active":"2023-07-27T14:41:00.952688+0000","last_became_peered":"2023-07-27T14:41:00.952688+0000","last_unstale":"2023-07-27T14:41:01.401986+0000","last_undegraded":"2023-07-27T14:41:01.401986+0000","last_fullsized":"2023-07-27T14:41:01.401986+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421199+0000","last_change":"2023-07-27T14:41:01.418776+0000","last_active":"2023-07-27T14:41:01.421199+0000","last_peered":"2023-07-27T14:41:01.421199+0000","last_clean":"2023-07-27T14:41:01.421199+0000","last_became_active":"2023-07-27T14:41:01.418475+0000","last_became_peered":"2023-07-27T14:41:01.418475+0000","last_unstale":"2023-07-27T14:41:01.421199+0000","last_undegraded":"2023-07-27T14:41:01.421199+0000","last_fullsized":"2023-07-27T14:41:01.421199+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.396936+0000","last_change":"2023-07-27T14:41:00.952877+0000","last_active":"2023-07-27T14:41:01.396936+0000","last_peered":"2023-07-27T14:41:01.396936+0000","last_clean":"2023-07-27T14:41:01.396936+0000","last_became_active":"2023-07-27T14:41:00.952059+0000","last_became_peered":"2023-07-27T14:41:00.952059+0000","last_unstale":"2023-07-27T14:41:01.396936+0000","last_undegraded":"2023-07-27T14:41:01.396936+0000","last_fullsized":"2023-07-27T14:41:01.396936+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426938+0000","last_change":"2023-07-27T14:41:01.425772+0000","last_active":"2023-07-27T14:41:01.426938+0000","last_peered":"2023-07-27T14:41:01.426938+0000","last_clean":"2023-07-27T14:41:01.426938+0000","last_became_active":"2023-07-27T14:41:01.425353+0000","last_became_peered":"2023-07-27T14:41:01.425353+0000","last_unstale":"2023-07-27T14:41:01.426938+0000","last_undegraded":"2023-07-27T14:41:01.426938+0000","last_fullsized":"2023-07-27T14:41:01.426938+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.412052+0000","last_change":"2023-07-27T14:41:00.954610+0000","last_active":"2023-07-27T14:41:01.412052+0000","last_peered":"2023-07-27T14:41:01.412052+0000","last_clean":"2023-07-27T14:41:01.412052+0000","last_became_active":"2023-07-27T14:41:00.954222+0000","last_became_peered":"2023-07-27T14:41:00.954222+0000","last_unstale":"2023-07-27T14:41:01.412052+0000","last_undegraded":"2023-07-27T14:41:01.412052+0000","last_fullsized":"2023-07-27T14:41:01.412052+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421383+0000","last_change":"2023-07-27T14:41:01.416512+0000","last_active":"2023-07-27T14:41:01.421383+0000","last_peered":"2023-07-27T14:41:01.421383+0000","last_clean":"2023-07-27T14:41:01.421383+0000","last_became_active":"2023-07-27T14:41:01.416237+0000","last_became_peered":"2023-07-27T14:41:01.416237+0000","last_unstale":"2023-07-27T14:41:01.421383+0000","last_undegraded":"2023-07-27T14:41:01.421383+0000","last_fullsized":"2023-07-27T14:41:01.421383+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393778+0000","last_change":"2023-07-27T14:41:00.954079+0000","last_active":"2023-07-27T14:41:01.393778+0000","last_peered":"2023-07-27T14:41:01.393778+0000","last_clean":"2023-07-27T14:41:01.393778+0000","last_became_active":"2023-07-27T14:41:00.953228+0000","last_became_peered":"2023-07-27T14:41:00.953228+0000","last_unstale":"2023-07-27T14:41:01.393778+0000","last_undegraded":"2023-07-27T14:41:01.393778+0000","last_fullsized":"2023-07-27T14:41:01.393778+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.411361+0000","last_change":"2023-07-27T14:41:01.405984+0000","last_active":"2023-07-27T14:41:01.411361+0000","last_peered":"2023-07-27T14:41:01.411361+0000","last_clean":"2023-07-27T14:41:01.411361+0000","last_became_active":"2023-07-27T14:41:01.405472+0000","last_became_peered":"2023-07-27T14:41:01.405472+0000","last_unstale":"2023-07-27T14:41:01.411361+0000","last_undegraded":"2023-07-27T14:41:01.411361+0000","last_fullsized":"2023-07-27T14:41:01.411361+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.15","version":"217'3","reported_seq":13,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426590+0000","last_change":"2023-07-27T14:41:00.958346+0000","last_active":"2023-07-27T14:41:01.426590+0000","last_peered":"2023-07-27T14:41:01.426590+0000","last_clean":"2023-07-27T14:41:01.426590+0000","last_became_active":"2023-07-27T14:41:00.958028+0000","last_became_peered":"2023-07-27T14:41:00.958028+0000","last_unstale":"2023-07-27T14:41:01.426590+0000","last_undegraded":"2023-07-27T14:41:01.426590+0000","last_fullsized":"2023-07-27T14:41:01.426590+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410449+0000","last_change":"2023-07-27T14:41:01.406714+0000","last_active":"2023-07-27T14:41:01.410449+0000","last_peered":"2023-07-27T14:41:01.410449+0000","last_clean":"2023-07-27T14:41:01.410449+0000","last_became_active":"2023-07-27T14:41:01.406382+0000","last_became_peered":"2023-07-27T14:41:01.406382+0000","last_unstale":"2023-07-27T14:41:01.410449+0000","last_undegraded":"2023-07-27T14:41:01.410449+0000","last_fullsized":"2023-07-27T14:41:01.410449+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.14","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426613+0000","last_change":"2023-07-27T14:41:00.955937+0000","last_active":"2023-07-27T14:41:01.426613+0000","last_peered":"2023-07-27T14:41:01.426613+0000","last_clean":"2023-07-27T14:41:01.426613+0000","last_became_active":"2023-07-27T14:41:00.955627+0000","last_became_peered":"2023-07-27T14:41:00.955627+0000","last_unstale":"2023-07-27T14:41:01.426613+0000","last_undegraded":"2023-07-27T14:41:01.426613+0000","last_fullsized":"2023-07-27T14:41:01.426613+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422806+0000","last_change":"2023-07-27T14:41:01.417627+0000","last_active":"2023-07-27T14:41:01.422806+0000","last_peered":"2023-07-27T14:41:01.422806+0000","last_clean":"2023-07-27T14:41:01.422806+0000","last_became_active":"2023-07-27T14:41:01.417338+0000","last_became_peered":"2023-07-27T14:41:01.417338+0000","last_unstale":"2023-07-27T14:41:01.422806+0000","last_undegraded":"2023-07-27T14:41:01.422806+0000","last_fullsized":"2023-07-27T14:41:01.422806+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.13","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.427697+0000","last_change":"2023-07-27T14:41:00.948767+0000","last_active":"2023-07-27T14:41:01.427697+0000","last_peered":"2023-07-27T14:41:01.427697+0000","last_clean":"2023-07-27T14:41:01.427697+0000","last_became_active":"2023-07-27T14:41:00.948482+0000","last_became_peered":"2023-07-27T14:41:00.948482+0000","last_unstale":"2023-07-27T14:41:01.427697+0000","last_undegraded":"2023-07-27T14:41:01.427697+0000","last_fullsized":"2023-07-27T14:41:01.427697+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.419207+0000","last_change":"2023-07-27T14:41:01.414134+0000","last_active":"2023-07-27T14:41:01.419207+0000","last_peered":"2023-07-27T14:41:01.419207+0000","last_clean":"2023-07-27T14:41:01.419207+0000","last_became_active":"2023-07-27T14:41:01.413319+0000","last_became_peered":"2023-07-27T14:41:01.413319+0000","last_unstale":"2023-07-27T14:41:01.419207+0000","last_undegraded":"2023-07-27T14:41:01.419207+0000","last_fullsized":"2023-07-27T14:41:01.419207+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.392977+0000","last_change":"2023-07-27T14:41:00.955633+0000","last_active":"2023-07-27T14:41:01.392977+0000","last_peered":"2023-07-27T14:41:01.392977+0000","last_clean":"2023-07-27T14:41:01.392977+0000","last_became_active":"2023-07-27T14:41:00.955357+0000","last_became_peered":"2023-07-27T14:41:00.955357+0000","last_unstale":"2023-07-27T14:41:01.392977+0000","last_undegraded":"2023-07-27T14:41:01.392977+0000","last_fullsized":"2023-07-27T14:41:01.392977+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413385+0000","last_change":"2023-07-27T14:41:01.407595+0000","last_active":"2023-07-27T14:41:01.413385+0000","last_peered":"2023-07-27T14:41:01.413385+0000","last_clean":"2023-07-27T14:41:01.413385+0000","last_became_active":"2023-07-27T14:41:01.407338+0000","last_became_peered":"2023-07-27T14:41:01.407338+0000","last_unstale":"2023-07-27T14:41:01.413385+0000","last_undegraded":"2023-07-27T14:41:01.413385+0000","last_fullsized":"2023-07-27T14:41:01.413385+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.403522+0000","last_change":"2023-07-27T14:41:00.948470+0000","last_active":"2023-07-27T14:41:01.403522+0000","last_peered":"2023-07-27T14:41:01.403522+0000","last_clean":"2023-07-27T14:41:01.403522+0000","last_became_active":"2023-07-27T14:41:00.948156+0000","last_became_peered":"2023-07-27T14:41:00.948156+0000","last_unstale":"2023-07-27T14:41:01.403522+0000","last_undegraded":"2023-07-27T14:41:01.403522+0000","last_fullsized":"2023-07-27T14:41:01.403522+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.412376+0000","last_change":"2023-07-27T14:41:01.408957+0000","last_active":"2023-07-27T14:41:01.412376+0000","last_peered":"2023-07-27T14:41:01.412376+0000","last_clean":"2023-07-27T14:41:01.412376+0000","last_became_active":"2023-07-27T14:41:01.408643+0000","last_became_peered":"2023-07-27T14:41:01.408643+0000","last_unstale":"2023-07-27T14:41:01.412376+0000","last_undegraded":"2023-07-27T14:41:01.412376+0000","last_fullsized":"2023-07-27T14:41:01.412376+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.10","version":"217'4","reported_seq":14,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424849+0000","last_change":"2023-07-27T14:41:00.954989+0000","last_active":"2023-07-27T14:41:01.424849+0000","last_peered":"2023-07-27T14:41:01.424849+0000","last_clean":"2023-07-27T14:41:01.424849+0000","last_became_active":"2023-07-27T14:41:00.954691+0000","last_became_peered":"2023-07-27T14:41:00.954691+0000","last_unstale":"2023-07-27T14:41:01.424849+0000","last_undegraded":"2023-07-27T14:41:01.424849+0000","last_fullsized":"2023-07-27T14:41:01.424849+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421296+0000","last_change":"2023-07-27T14:41:01.419118+0000","last_active":"2023-07-27T14:41:01.421296+0000","last_peered":"2023-07-27T14:41:01.421296+0000","last_clean":"2023-07-27T14:41:01.421296+0000","last_became_active":"2023-07-27T14:41:01.418466+0000","last_became_peered":"2023-07-27T14:41:01.418466+0000","last_unstale":"2023-07-27T14:41:01.421296+0000","last_undegraded":"2023-07-27T14:41:01.421296+0000","last_fullsized":"2023-07-27T14:41:01.421296+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424706+0000","last_change":"2023-07-27T14:41:00.949567+0000","last_active":"2023-07-27T14:41:01.424706+0000","last_peered":"2023-07-27T14:41:01.424706+0000","last_clean":"2023-07-27T14:41:01.424706+0000","last_became_active":"2023-07-27T14:41:00.949269+0000","last_became_peered":"2023-07-27T14:41:00.949269+0000","last_unstale":"2023-07-27T14:41:01.424706+0000","last_undegraded":"2023-07-27T14:41:01.424706+0000","last_fullsized":"2023-07-27T14:41:01.424706+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.414086+0000","last_change":"2023-07-27T14:41:01.409815+0000","last_active":"2023-07-27T14:41:01.414086+0000","last_peered":"2023-07-27T14:41:01.414086+0000","last_clean":"2023-07-27T14:41:01.414086+0000","last_became_active":"2023-07-27T14:41:01.408677+0000","last_became_peered":"2023-07-27T14:41:01.408677+0000","last_unstale":"2023-07-27T14:41:01.414086+0000","last_undegraded":"2023-07-27T14:41:01.414086+0000","last_fullsized":"2023-07-27T14:41:01.414086+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.e","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.418782+0000","last_change":"2023-07-27T14:41:00.943827+0000","last_active":"2023-07-27T14:41:01.418782+0000","last_peered":"2023-07-27T14:41:01.418782+0000","last_clean":"2023-07-27T14:41:01.418782+0000","last_became_active":"2023-07-27T14:41:00.943533+0000","last_became_peered":"2023-07-27T14:41:00.943533+0000","last_unstale":"2023-07-27T14:41:01.418782+0000","last_undegraded":"2023-07-27T14:41:01.418782+0000","last_fullsized":"2023-07-27T14:41:01.418782+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.424556+0000","last_change":"2023-07-27T14:41:01.420579+0000","last_active":"2023-07-27T14:41:01.424556+0000","last_peered":"2023-07-27T14:41:01.424556+0000","last_clean":"2023-07-27T14:41:01.424556+0000","last_became_active":"2023-07-27T14:41:01.420275+0000","last_became_peered":"2023-07-27T14:41:01.420275+0000","last_unstale":"2023-07-27T14:41:01.424556+0000","last_undegraded":"2023-07-27T14:41:01.424556+0000","last_fullsized":"2023-07-27T14:41:01.424556+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.400772+0000","last_change":"2023-07-27T14:41:00.959985+0000","last_active":"2023-07-27T14:41:01.400772+0000","last_peered":"2023-07-27T14:41:01.400772+0000","last_clean":"2023-07-27T14:41:01.400772+0000","last_became_active":"2023-07-27T14:41:00.958146+0000","last_became_peered":"2023-07-27T14:41:00.958146+0000","last_unstale":"2023-07-27T14:41:01.400772+0000","last_undegraded":"2023-07-27T14:41:01.400772+0000","last_fullsized":"2023-07-27T14:41:01.400772+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423131+0000","last_change":"2023-07-27T14:41:01.419681+0000","last_active":"2023-07-27T14:41:01.423131+0000","last_peered":"2023-07-27T14:41:01.423131+0000","last_clean":"2023-07-27T14:41:01.423131+0000","last_became_active":"2023-07-27T14:41:01.418472+0000","last_became_peered":"2023-07-27T14:41:01.418472+0000","last_unstale":"2023-07-27T14:41:01.423131+0000","last_undegraded":"2023-07-27T14:41:01.423131+0000","last_fullsized":"2023-07-27T14:41:01.423131+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399338+0000","last_change":"2023-07-27T14:41:00.953238+0000","last_active":"2023-07-27T14:41:01.399338+0000","last_peered":"2023-07-27T14:41:01.399338+0000","last_clean":"2023-07-27T14:41:01.399338+0000","last_became_active":"2023-07-27T14:41:00.952779+0000","last_became_peered":"2023-07-27T14:41:00.952779+0000","last_unstale":"2023-07-27T14:41:01.399338+0000","last_undegraded":"2023-07-27T14:41:01.399338+0000","last_fullsized":"2023-07-27T14:41:01.399338+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422761+0000","last_change":"2023-07-27T14:41:01.418219+0000","last_active":"2023-07-27T14:41:01.422761+0000","last_peered":"2023-07-27T14:41:01.422761+0000","last_clean":"2023-07-27T14:41:01.422761+0000","last_became_active":"2023-07-27T14:41:01.417876+0000","last_became_peered":"2023-07-27T14:41:01.417876+0000","last_unstale":"2023-07-27T14:41:01.422761+0000","last_undegraded":"2023-07-27T14:41:01.422761+0000","last_fullsized":"2023-07-27T14:41:01.422761+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.b","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413471+0000","last_change":"2023-07-27T14:41:00.950797+0000","last_active":"2023-07-27T14:41:01.413471+0000","last_peered":"2023-07-27T14:41:01.413471+0000","last_clean":"2023-07-27T14:41:01.413471+0000","last_became_active":"2023-07-27T14:41:00.950524+0000","last_became_peered":"2023-07-27T14:41:00.950524+0000","last_unstale":"2023-07-27T14:41:01.413471+0000","last_undegraded":"2023-07-27T14:41:01.413471+0000","last_fullsized":"2023-07-27T14:41:01.413471+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423197+0000","last_change":"2023-07-27T14:41:01.414546+0000","last_active":"2023-07-27T14:41:01.423197+0000","last_peered":"2023-07-27T14:41:01.423197+0000","last_clean":"2023-07-27T14:41:01.423197+0000","last_became_active":"2023-07-27T14:41:01.413252+0000","last_became_peered":"2023-07-27T14:41:01.413252+0000","last_unstale":"2023-07-27T14:41:01.423197+0000","last_undegraded":"2023-07-27T14:41:01.423197+0000","last_fullsized":"2023-07-27T14:41:01.423197+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399123+0000","last_change":"2023-07-27T14:41:00.943797+0000","last_active":"2023-07-27T14:41:01.399123+0000","last_peered":"2023-07-27T14:41:01.399123+0000","last_clean":"2023-07-27T14:41:01.399123+0000","last_became_active":"2023-07-27T14:41:00.943482+0000","last_became_peered":"2023-07-27T14:41:00.943482+0000","last_unstale":"2023-07-27T14:41:01.399123+0000","last_undegraded":"2023-07-27T14:41:01.399123+0000","last_fullsized":"2023-07-27T14:41:01.399123+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410716+0000","last_change":"2023-07-27T14:41:01.406069+0000","last_active":"2023-07-27T14:41:01.410716+0000","last_peered":"2023-07-27T14:41:01.410716+0000","last_clean":"2023-07-27T14:41:01.410716+0000","last_became_active":"2023-07-27T14:41:01.405784+0000","last_became_peered":"2023-07-27T14:41:01.405784+0000","last_unstale":"2023-07-27T14:41:01.410716+0000","last_undegraded":"2023-07-27T14:41:01.410716+0000","last_fullsized":"2023-07-27T14:41:01.410716+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.400108+0000","last_change":"2023-07-27T14:41:00.956186+0000","last_active":"2023-07-27T14:41:01.400108+0000","last_peered":"2023-07-27T14:41:01.400108+0000","last_clean":"2023-07-27T14:41:01.400108+0000","last_became_active":"2023-07-27T14:41:00.955884+0000","last_became_peered":"2023-07-27T14:41:00.955884+0000","last_unstale":"2023-07-27T14:41:01.400108+0000","last_undegraded":"2023-07-27T14:41:01.400108+0000","last_fullsized":"2023-07-27T14:41:01.400108+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425160+0000","last_change":"2023-07-27T14:41:01.422491+0000","last_active":"2023-07-27T14:41:01.425160+0000","last_peered":"2023-07-27T14:41:01.425160+0000","last_clean":"2023-07-27T14:41:01.425160+0000","last_became_active":"2023-07-27T14:41:01.421959+0000","last_became_peered":"2023-07-27T14:41:01.421959+0000","last_unstale":"2023-07-27T14:41:01.425160+0000","last_undegraded":"2023-07-27T14:41:01.425160+0000","last_fullsized":"2023-07-27T14:41:01.425160+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.397941+0000","last_change":"2023-07-27T14:41:00.951334+0000","last_active":"2023-07-27T14:41:01.397941+0000","last_peered":"2023-07-27T14:41:01.397941+0000","last_clean":"2023-07-27T14:41:01.397941+0000","last_became_active":"2023-07-27T14:41:00.950544+0000","last_became_peered":"2023-07-27T14:41:00.950544+0000","last_unstale":"2023-07-27T14:41:01.397941+0000","last_undegraded":"2023-07-27T14:41:01.397941+0000","last_fullsized":"2023-07-27T14:41:01.397941+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422361+0000","last_change":"2023-07-27T14:41:01.416218+0000","last_active":"2023-07-27T14:41:01.422361+0000","last_peered":"2023-07-27T14:41:01.422361+0000","last_clean":"2023-07-27T14:41:01.422361+0000","last_became_active":"2023-07-27T14:41:01.415910+0000","last_became_peered":"2023-07-27T14:41:01.415910+0000","last_unstale":"2023-07-27T14:41:01.422361+0000","last_undegraded":"2023-07-27T14:41:01.422361+0000","last_fullsized":"2023-07-27T14:41:01.422361+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.7","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421886+0000","last_change":"2023-07-27T14:41:00.951539+0000","last_active":"2023-07-27T14:41:01.421886+0000","last_peered":"2023-07-27T14:41:01.421886+0000","last_clean":"2023-07-27T14:41:01.421886+0000","last_became_active":"2023-07-27T14:41:00.951278+0000","last_became_peered":"2023-07-27T14:41:00.951278+0000","last_unstale":"2023-07-27T14:41:01.421886+0000","last_undegraded":"2023-07-27T14:41:01.421886+0000","last_fullsized":"2023-07-27T14:41:01.421886+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425741+0000","last_change":"2023-07-27T14:41:01.422508+0000","last_active":"2023-07-27T14:41:01.425741+0000","last_peered":"2023-07-27T14:41:01.425741+0000","last_clean":"2023-07-27T14:41:01.425741+0000","last_became_active":"2023-07-27T14:41:01.418361+0000","last_became_peered":"2023-07-27T14:41:01.418361+0000","last_unstale":"2023-07-27T14:41:01.425741+0000","last_undegraded":"2023-07-27T14:41:01.425741+0000","last_fullsized":"2023-07-27T14:41:01.425741+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.397332+0000","last_change":"2023-07-27T14:41:00.952947+0000","last_active":"2023-07-27T14:41:01.397332+0000","last_peered":"2023-07-27T14:41:01.397332+0000","last_clean":"2023-07-27T14:41:01.397332+0000","last_became_active":"2023-07-27T14:41:00.951598+0000","last_became_peered":"2023-07-27T14:41:00.951598+0000","last_unstale":"2023-07-27T14:41:01.397332+0000","last_undegraded":"2023-07-27T14:41:01.397332+0000","last_fullsized":"2023-07-27T14:41:01.397332+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410661+0000","last_change":"2023-07-27T14:41:01.408494+0000","last_active":"2023-07-27T14:41:01.410661+0000","last_peered":"2023-07-27T14:41:01.410661+0000","last_clean":"2023-07-27T14:41:01.410661+0000","last_became_active":"2023-07-27T14:41:01.408181+0000","last_became_peered":"2023-07-27T14:41:01.408181+0000","last_unstale":"2023-07-27T14:41:01.410661+0000","last_undegraded":"2023-07-27T14:41:01.410661+0000","last_fullsized":"2023-07-27T14:41:01.410661+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.400827+0000","last_change":"2023-07-27T14:41:00.957851+0000","last_active":"2023-07-27T14:41:01.400827+0000","last_peered":"2023-07-27T14:41:01.400827+0000","last_clean":"2023-07-27T14:41:01.400827+0000","last_became_active":"2023-07-27T14:41:00.956350+0000","last_became_peered":"2023-07-27T14:41:00.956350+0000","last_unstale":"2023-07-27T14:41:01.400827+0000","last_undegraded":"2023-07-27T14:41:01.400827+0000","last_fullsized":"2023-07-27T14:41:01.400827+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.421353+0000","last_change":"2023-07-27T14:41:01.416807+0000","last_active":"2023-07-27T14:41:01.421353+0000","last_peered":"2023-07-27T14:41:01.421353+0000","last_clean":"2023-07-27T14:41:01.421353+0000","last_became_active":"2023-07-27T14:41:01.416541+0000","last_became_peered":"2023-07-27T14:41:01.416541+0000","last_unstale":"2023-07-27T14:41:01.421353+0000","last_undegraded":"2023-07-27T14:41:01.421353+0000","last_fullsized":"2023-07-27T14:41:01.421353+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399428+0000","last_change":"2023-07-27T14:41:00.953066+0000","last_active":"2023-07-27T14:41:01.399428+0000","last_peered":"2023-07-27T14:41:01.399428+0000","last_clean":"2023-07-27T14:41:01.399428+0000","last_became_active":"2023-07-27T14:41:00.952449+0000","last_became_peered":"2023-07-27T14:41:00.952449+0000","last_unstale":"2023-07-27T14:41:01.399428+0000","last_undegraded":"2023-07-27T14:41:01.399428+0000","last_fullsized":"2023-07-27T14:41:01.399428+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.422826+0000","last_change":"2023-07-27T14:41:01.419328+0000","last_active":"2023-07-27T14:41:01.422826+0000","last_peered":"2023-07-27T14:41:01.422826+0000","last_clean":"2023-07-27T14:41:01.422826+0000","last_became_active":"2023-07-27T14:41:01.419039+0000","last_became_peered":"2023-07-27T14:41:01.419039+0000","last_unstale":"2023-07-27T14:41:01.422826+0000","last_undegraded":"2023-07-27T14:41:01.422826+0000","last_fullsized":"2023-07-27T14:41:01.422826+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.398675+0000","last_change":"2023-07-27T14:41:00.949930+0000","last_active":"2023-07-27T14:41:01.398675+0000","last_peered":"2023-07-27T14:41:01.398675+0000","last_clean":"2023-07-27T14:41:01.398675+0000","last_became_active":"2023-07-27T14:41:00.949657+0000","last_became_peered":"2023-07-27T14:41:00.949657+0000","last_unstale":"2023-07-27T14:41:01.398675+0000","last_undegraded":"2023-07-27T14:41:01.398675+0000","last_fullsized":"2023-07-27T14:41:01.398675+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425186+0000","last_change":"2023-07-27T14:41:01.422386+0000","last_active":"2023-07-27T14:41:01.425186+0000","last_peered":"2023-07-27T14:41:01.425186+0000","last_clean":"2023-07-27T14:41:01.425186+0000","last_became_active":"2023-07-27T14:41:01.421832+0000","last_became_peered":"2023-07-27T14:41:01.421832+0000","last_unstale":"2023-07-27T14:41:01.425186+0000","last_undegraded":"2023-07-27T14:41:01.425186+0000","last_fullsized":"2023-07-27T14:41:01.425186+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399979+0000","last_change":"2023-07-27T14:41:00.957093+0000","last_active":"2023-07-27T14:41:01.399979+0000","last_peered":"2023-07-27T14:41:01.399979+0000","last_clean":"2023-07-27T14:41:01.399979+0000","last_became_active":"2023-07-27T14:41:00.956794+0000","last_became_peered":"2023-07-27T14:41:00.956794+0000","last_unstale":"2023-07-27T14:41:01.399979+0000","last_undegraded":"2023-07-27T14:41:01.399979+0000","last_fullsized":"2023-07-27T14:41:01.399979+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.425119+0000","last_change":"2023-07-27T14:41:01.422385+0000","last_active":"2023-07-27T14:41:01.425119+0000","last_peered":"2023-07-27T14:41:01.425119+0000","last_clean":"2023-07-27T14:41:01.425119+0000","last_became_active":"2023-07-27T14:41:01.421607+0000","last_became_peered":"2023-07-27T14:41:01.421607+0000","last_unstale":"2023-07-27T14:41:01.425119+0000","last_undegraded":"2023-07-27T14:41:01.425119+0000","last_fullsized":"2023-07-27T14:41:01.425119+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.392848+0000","last_change":"2023-07-27T14:41:00.951677+0000","last_active":"2023-07-27T14:41:01.392848+0000","last_peered":"2023-07-27T14:41:01.392848+0000","last_clean":"2023-07-27T14:41:01.392848+0000","last_became_active":"2023-07-27T14:41:00.950844+0000","last_became_peered":"2023-07-27T14:41:00.950844+0000","last_unstale":"2023-07-27T14:41:01.392848+0000","last_undegraded":"2023-07-27T14:41:01.392848+0000","last_fullsized":"2023-07-27T14:41:01.392848+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.426461+0000","last_change":"2023-07-27T14:41:01.425101+0000","last_active":"2023-07-27T14:41:01.426461+0000","last_peered":"2023-07-27T14:41:01.426461+0000","last_clean":"2023-07-27T14:41:01.426461+0000","last_became_active":"2023-07-27T14:41:01.424846+0000","last_became_peered":"2023-07-27T14:41:01.424846+0000","last_unstale":"2023-07-27T14:41:01.426461+0000","last_undegraded":"2023-07-27T14:41:01.426461+0000","last_fullsized":"2023-07-27T14:41:01.426461+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393498+0000","last_change":"2023-07-27T14:41:00.954851+0000","last_active":"2023-07-27T14:41:01.393498+0000","last_peered":"2023-07-27T14:41:01.393498+0000","last_clean":"2023-07-27T14:41:01.393498+0000","last_became_active":"2023-07-27T14:41:00.954374+0000","last_became_peered":"2023-07-27T14:41:00.954374+0000","last_unstale":"2023-07-27T14:41:01.393498+0000","last_undegraded":"2023-07-27T14:41:01.393498+0000","last_fullsized":"2023-07-27T14:41:01.393498+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.419742+0000","last_change":"2023-07-27T14:41:01.414552+0000","last_active":"2023-07-27T14:41:01.419742+0000","last_peered":"2023-07-27T14:41:01.419742+0000","last_clean":"2023-07-27T14:41:01.419742+0000","last_became_active":"2023-07-27T14:41:01.414258+0000","last_became_peered":"2023-07-27T14:41:01.414258+0000","last_unstale":"2023-07-27T14:41:01.419742+0000","last_undegraded":"2023-07-27T14:41:01.419742+0000","last_fullsized":"2023-07-27T14:41:01.419742+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.402252+0000","last_change":"2023-07-27T14:41:00.953776+0000","last_active":"2023-07-27T14:41:01.402252+0000","last_peered":"2023-07-27T14:41:01.402252+0000","last_clean":"2023-07-27T14:41:01.402252+0000","last_became_active":"2023-07-27T14:41:00.953491+0000","last_became_peered":"2023-07-27T14:41:00.953491+0000","last_unstale":"2023-07-27T14:41:01.402252+0000","last_undegraded":"2023-07-27T14:41:01.402252+0000","last_fullsized":"2023-07-27T14:41:01.402252+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399508+0000","last_change":"2023-07-27T14:26:55.589384+0000","last_active":"2023-07-27T14:41:01.399508+0000","last_peered":"2023-07-27T14:41:01.399508+0000","last_clean":"2023-07-27T14:41:01.399508+0000","last_became_active":"2023-07-27T14:26:55.589049+0000","last_became_peered":"2023-07-27T14:26:55.589049+0000","last_unstale":"2023-07-27T14:41:01.399508+0000","last_undegraded":"2023-07-27T14:41:01.399508+0000","last_fullsized":"2023-07-27T14:41:01.399508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.419229+0000","last_change":"2023-07-27T14:41:01.414319+0000","last_active":"2023-07-27T14:41:01.419229+0000","last_peered":"2023-07-27T14:41:01.419229+0000","last_clean":"2023-07-27T14:41:01.419229+0000","last_became_active":"2023-07-27T14:41:01.413734+0000","last_became_peered":"2023-07-27T14:41:01.413734+0000","last_unstale":"2023-07-27T14:41:01.419229+0000","last_undegraded":"2023-07-27T14:41:01.419229+0000","last_fullsized":"2023-07-27T14:41:01.419229+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.399941+0000","last_change":"2023-07-27T14:41:00.947779+0000","last_active":"2023-07-27T14:41:01.399941+0000","last_peered":"2023-07-27T14:41:01.399941+0000","last_clean":"2023-07-27T14:41:01.399941+0000","last_became_active":"2023-07-27T14:41:00.947086+0000","last_became_peered":"2023-07-27T14:41:00.947086+0000","last_unstale":"2023-07-27T14:41:01.399941+0000","last_undegraded":"2023-07-27T14:41:01.399941+0000","last_fullsized":"2023-07-27T14:41:01.399941+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.406336+0000","last_change":"2023-07-27T14:26:55.585719+0000","last_active":"2023-07-27T14:41:01.406336+0000","last_peered":"2023-07-27T14:41:01.406336+0000","last_clean":"2023-07-27T14:41:01.406336+0000","last_became_active":"2023-07-27T14:26:55.585508+0000","last_became_peered":"2023-07-27T14:26:55.585508+0000","last_unstale":"2023-07-27T14:41:01.406336+0000","last_undegraded":"2023-07-27T14:41:01.406336+0000","last_fullsized":"2023-07-27T14:41:01.406336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413254+0000","last_change":"2023-07-27T14:41:01.408262+0000","last_active":"2023-07-27T14:41:01.413254+0000","last_peered":"2023-07-27T14:41:01.413254+0000","last_clean":"2023-07-27T14:41:01.413254+0000","last_became_active":"2023-07-27T14:41:01.407962+0000","last_became_peered":"2023-07-27T14:41:01.407962+0000","last_unstale":"2023-07-27T14:41:01.413254+0000","last_undegraded":"2023-07-27T14:41:01.413254+0000","last_fullsized":"2023-07-27T14:41:01.413254+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.403413+0000","last_change":"2023-07-27T14:41:00.951214+0000","last_active":"2023-07-27T14:41:01.403413+0000","last_peered":"2023-07-27T14:41:01.403413+0000","last_clean":"2023-07-27T14:41:01.403413+0000","last_became_active":"2023-07-27T14:41:00.950898+0000","last_became_peered":"2023-07-27T14:41:00.950898+0000","last_unstale":"2023-07-27T14:41:01.403413+0000","last_undegraded":"2023-07-27T14:41:01.403413+0000","last_fullsized":"2023-07-27T14:41:01.403413+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.400860+0000","last_change":"2023-07-27T14:26:56.608232+0000","last_active":"2023-07-27T14:41:01.400860+0000","last_peered":"2023-07-27T14:41:01.400860+0000","last_clean":"2023-07-27T14:41:01.400860+0000","last_became_active":"2023-07-27T14:26:56.607899+0000","last_became_peered":"2023-07-27T14:26:56.607899+0000","last_unstale":"2023-07-27T14:41:01.400860+0000","last_undegraded":"2023-07-27T14:41:01.400860+0000","last_fullsized":"2023-07-27T14:41:01.400860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423107+0000","last_change":"2023-07-27T14:41:01.418903+0000","last_active":"2023-07-27T14:41:01.423107+0000","last_peered":"2023-07-27T14:41:01.423107+0000","last_clean":"2023-07-27T14:41:01.423107+0000","last_became_active":"2023-07-27T14:41:01.418143+0000","last_became_peered":"2023-07-27T14:41:01.418143+0000","last_unstale":"2023-07-27T14:41:01.423107+0000","last_undegraded":"2023-07-27T14:41:01.423107+0000","last_fullsized":"2023-07-27T14:41:01.423107+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.393398+0000","last_change":"2023-07-27T14:41:00.956145+0000","last_active":"2023-07-27T14:41:01.393398+0000","last_peered":"2023-07-27T14:41:01.393398+0000","last_clean":"2023-07-27T14:41:01.393398+0000","last_became_active":"2023-07-27T14:41:00.955892+0000","last_became_peered":"2023-07-27T14:41:00.955892+0000","last_unstale":"2023-07-27T14:41:01.393398+0000","last_undegraded":"2023-07-27T14:41:01.393398+0000","last_fullsized":"2023-07-27T14:41:01.393398+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":185,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.400587+0000","last_change":"2023-07-27T14:26:55.590300+0000","last_active":"2023-07-27T14:41:01.400587+0000","last_peered":"2023-07-27T14:41:01.400587+0000","last_clean":"2023-07-27T14:41:01.400587+0000","last_became_active":"2023-07-27T14:26:55.589915+0000","last_became_peered":"2023-07-27T14:26:55.589915+0000","last_unstale":"2023-07-27T14:41:01.400587+0000","last_undegraded":"2023-07-27T14:41:01.400587+0000","last_fullsized":"2023-07-27T14:41:01.400587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.415263+0000","last_change":"2023-07-27T14:41:01.410223+0000","last_active":"2023-07-27T14:41:01.415263+0000","last_peered":"2023-07-27T14:41:01.415263+0000","last_clean":"2023-07-27T14:41:01.415263+0000","last_became_active":"2023-07-27T14:41:01.407035+0000","last_became_peered":"2023-07-27T14:41:01.407035+0000","last_unstale":"2023-07-27T14:41:01.415263+0000","last_undegraded":"2023-07-27T14:41:01.415263+0000","last_fullsized":"2023-07-27T14:41:01.415263+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1f","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.416256+0000","last_change":"2023-07-27T14:41:00.951173+0000","last_active":"2023-07-27T14:41:01.416256+0000","last_peered":"2023-07-27T14:41:01.416256+0000","last_clean":"2023-07-27T14:41:01.416256+0000","last_became_active":"2023-07-27T14:41:00.950894+0000","last_became_peered":"2023-07-27T14:41:00.950894+0000","last_unstale":"2023-07-27T14:41:01.416256+0000","last_undegraded":"2023-07-27T14:41:01.416256+0000","last_fullsized":"2023-07-27T14:41:01.416256+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":186,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.400482+0000","last_change":"2023-07-27T14:26:54.580560+0000","last_active":"2023-07-27T14:41:01.400482+0000","last_peered":"2023-07-27T14:41:01.400482+0000","last_clean":"2023-07-27T14:41:01.400482+0000","last_became_active":"2023-07-27T14:26:54.580265+0000","last_became_peered":"2023-07-27T14:26:54.580265+0000","last_unstale":"2023-07-27T14:41:01.400482+0000","last_undegraded":"2023-07-27T14:41:01.400482+0000","last_fullsized":"2023-07-27T14:41:01.400482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:53.562833+0000","last_clean_scrub_stamp":"2023-07-27T14:26:53.562833+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.397187+0000","last_change":"2023-07-27T14:26:55.582100+0000","last_active":"2023-07-27T14:41:01.397187+0000","last_peered":"2023-07-27T14:41:01.397187+0000","last_clean":"2023-07-27T14:41:01.397187+0000","last_became_active":"2023-07-27T14:26:55.581834+0000","last_became_peered":"2023-07-27T14:26:55.581834+0000","last_unstale":"2023-07-27T14:41:01.397187+0000","last_undegraded":"2023-07-27T14:41:01.397187+0000","last_fullsized":"2023-07-27T14:41:01.397187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.410643+0000","last_change":"2023-07-27T14:41:01.407565+0000","last_active":"2023-07-27T14:41:01.410643+0000","last_peered":"2023-07-27T14:41:01.410643+0000","last_clean":"2023-07-27T14:41:01.410643+0000","last_became_active":"2023-07-27T14:41:01.407271+0000","last_became_peered":"2023-07-27T14:41:01.407271+0000","last_unstale":"2023-07-27T14:41:01.410643+0000","last_undegraded":"2023-07-27T14:41:01.410643+0000","last_fullsized":"2023-07-27T14:41:01.410643+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"217'2","reported_seq":12,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.423277+0000","last_change":"2023-07-27T14:41:00.942559+0000","last_active":"2023-07-27T14:41:01.423277+0000","last_peered":"2023-07-27T14:41:01.423277+0000","last_clean":"2023-07-27T14:41:01.423277+0000","last_became_active":"2023-07-27T14:41:00.942228+0000","last_became_peered":"2023-07-27T14:41:00.942228+0000","last_unstale":"2023-07-27T14:41:01.423277+0000","last_undegraded":"2023-07-27T14:41:01.423277+0000","last_fullsized":"2023-07-27T14:41:01.423277+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.402058+0000","last_change":"2023-07-27T14:26:55.615090+0000","last_active":"2023-07-27T14:41:01.402058+0000","last_peered":"2023-07-27T14:41:01.402058+0000","last_clean":"2023-07-27T14:41:01.402058+0000","last_became_active":"2023-07-27T14:26:55.614718+0000","last_became_peered":"2023-07-27T14:26:55.614718+0000","last_unstale":"2023-07-27T14:41:01.402058+0000","last_undegraded":"2023-07-27T14:41:01.402058+0000","last_fullsized":"2023-07-27T14:41:01.402058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.413020+0000","last_change":"2023-07-27T14:41:01.408616+0000","last_active":"2023-07-27T14:41:01.413020+0000","last_peered":"2023-07-27T14:41:01.413020+0000","last_clean":"2023-07-27T14:41:01.413020+0000","last_became_active":"2023-07-27T14:41:01.408368+0000","last_became_peered":"2023-07-27T14:41:01.408368+0000","last_unstale":"2023-07-27T14:41:01.413020+0000","last_undegraded":"2023-07-27T14:41:01.413020+0000","last_fullsized":"2023-07-27T14:41:01.413020+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1e","version":"217'1","reported_seq":11,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.416345+0000","last_change":"2023-07-27T14:41:00.951141+0000","last_active":"2023-07-27T14:41:01.416345+0000","last_peered":"2023-07-27T14:41:01.416345+0000","last_clean":"2023-07-27T14:41:01.416345+0000","last_became_active":"2023-07-27T14:41:00.950852+0000","last_became_peered":"2023-07-27T14:41:00.950852+0000","last_unstale":"2023-07-27T14:41:01.416345+0000","last_undegraded":"2023-07-27T14:41:01.416345+0000","last_fullsized":"2023-07-27T14:41:01.416345+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.396768+0000","last_change":"2023-07-27T14:26:55.583546+0000","last_active":"2023-07-27T14:41:01.396768+0000","last_peered":"2023-07-27T14:41:01.396768+0000","last_clean":"2023-07-27T14:41:01.396768+0000","last_became_active":"2023-07-27T14:26:55.583208+0000","last_became_peered":"2023-07-27T14:26:55.583208+0000","last_unstale":"2023-07-27T14:41:01.396768+0000","last_undegraded":"2023-07-27T14:41:01.396768+0000","last_fullsized":"2023-07-27T14:41:01.396768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":9,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.417821+0000","last_change":"2023-07-27T14:41:01.407952+0000","last_active":"2023-07-27T14:41:01.417821+0000","last_peered":"2023-07-27T14:41:01.417821+0000","last_clean":"2023-07-27T14:41:01.417821+0000","last_became_active":"2023-07-27T14:41:01.407661+0000","last_became_peered":"2023-07-27T14:41:01.407661+0000","last_unstale":"2023-07-27T14:41:01.417821+0000","last_undegraded":"2023-07-27T14:41:01.417821+0000","last_fullsized":"2023-07-27T14:41:01.417821+0000","mapping_epoch":216,"log_start":"0'0","ondisk_log_start":"0'0","created":216,"last_epoch_clean":217,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:41:00.920800+0000","last_clean_scrub_stamp":"2023-07-27T14:41:00.920800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":10,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.392997+0000","last_change":"2023-07-27T14:41:00.946429+0000","last_active":"2023-07-27T14:41:01.392997+0000","last_peered":"2023-07-27T14:41:01.392997+0000","last_clean":"2023-07-27T14:41:01.392997+0000","last_became_active":"2023-07-27T14:41:00.946162+0000","last_became_peered":"2023-07-27T14:41:00.946162+0000","last_unstale":"2023-07-27T14:41:01.392997+0000","last_undegraded":"2023-07-27T14:41:01.392997+0000","last_fullsized":"2023-07-27T14:41:01.392997+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":215,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:40:59.912838+0000","last_clean_scrub_stamp":"2023-07-27T14:40:59.912838+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-07-27T14:41:01.403923+0000","last_change":"2023-07-27T14:26:56.610035+0000","last_active":"2023-07-27T14:41:01.403923+0000","last_peered":"2023-07-27T14:41:01.403923+0000","last_clean":"2023-07-27T14:41:01.403923+0000","last_became_active":"2023-07-27T14:26:56.609728+0000","last_became_peered":"2023-07-27T14:26:56.609728+0000","last_unstale":"2023-07-27T14:41:01.403923+0000","last_undegraded":"2023-07-27T14:41:01.403923+0000","last_fullsized":"2023-07-27T14:41:01.403923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-27T14:26:54.568168+0000","last_clean_scrub_stamp":"2023-07-27T14:26:54.568168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575021,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26636,"kb_used_data":2692,"kb_used_omap":0,"kb_used_meta":23936,"kb_avail":94345204,"statfs":{"total":96636764160,"available":96609488896,"internally_reserved":0,"allocated":2756608,"data_stored":1309122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24510464},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":3.093,"15min":3.093},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.71799999999999997,"15min":0.67300000000000004},"min":{"1min":0.46200000000000002,"5min":0.41899999999999998,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72699999999999998,"15min":0.70999999999999996},"min":{"1min":0.502,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":5.2599999999999998,"15min":5.2599999999999998},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86899999999999999,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73499999999999999,"15min":0.69999999999999996},"min":{"1min":0.48999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79300000000000004,"5min":8.952,"15min":8.952},"last":0.502}]},{"osd":3,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.42599999999999999},"max":{"1min":0.81299999999999994,"5min":3.1299999999999999,"15min":3.1299999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84799999999999998,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.70499999999999996,"15min":0.65900000000000003},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.318},"max":{"1min":0.875,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.36499999999999999},"max":{"1min":0.86299999999999999,"5min":2.343,"15min":2.343},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70899999999999996,"15min":0.68400000000000005},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.38500000000000001},"max":{"1min":0.92000000000000004,"5min":5.2249999999999996,"15min":5.2249999999999996},"last":0.622},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.77400000000000002,"15min":0.72399999999999998},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.40000000000000002},"max":{"1min":0.872,"5min":8.1630000000000003,"15min":8.1630000000000003},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.76800000000000002},"min":{"1min":0.54700000000000004,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":0.97799999999999998,"5min":7.6269999999999998,"15min":7.6269999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72299999999999998,"15min":0.71899999999999997},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94299999999999995,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.745}]}]},{"osd":6,"up_from":13,"seq":55834575020,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26508,"kb_used_data":2692,"kb_used_omap":0,"kb_used_meta":23808,"kb_avail":94345332,"statfs":{"total":96636764160,"available":96609619968,"internally_reserved":0,"allocated":2756608,"data_stored":1309412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24379392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70299999999999996,"15min":0.63800000000000001},"min":{"1min":0.46999999999999997,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.82499999999999996,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.92100000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.753}]},{"osd":1,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.76100000000000001,"15min":0.66200000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":13.975,"15min":13.975},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.43099999999999999,"15min":0.42199999999999999},"max":{"1min":0.89900000000000002,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70999999999999996,"15min":0.66600000000000004},"min":{"1min":0.46300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79300000000000004,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.79700000000000004,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.76100000000000001,"5min":14.018000000000001,"15min":14.018000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73299999999999998,"15min":0.68600000000000005},"min":{"1min":0.495,"5min":0.48699999999999999,"15min":0.41199999999999998},"max":{"1min":0.84999999999999998,"5min":5.9530000000000003,"15min":5.9530000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75900000000000001,"15min":0.70099999999999996},"min":{"1min":0.55200000000000005,"5min":0.45700000000000002,"15min":0.433},"max":{"1min":0.82299999999999995,"5min":7.9800000000000004,"15min":7.9800000000000004},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.79100000000000004,"15min":0.67700000000000005},"min":{"1min":0.46999999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86099999999999999,"5min":15.638999999999999,"15min":15.638999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39900000000000002},"max":{"1min":0.94599999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72199999999999998,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.85899999999999999,"5min":8.0169999999999995,"15min":8.0169999999999995},"last":0.439},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.84999999999999998,"15min":0.74099999999999999},"min":{"1min":0.50900000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":0.88800000000000001,"5min":15.461,"15min":15.461},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jul 27 14:40:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.75800000000000001},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.92500000000000004,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83199999999999996,"15min":0.78400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":8.0670000000000002,"15min":8.0670000000000002},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":26452,"kb_used_data":2700,"kb_used_omap":0,"kb_used_meta":23744,"kb_avail":94345388,"statfs":{"total":96636764160,"available":96609677312,"internally_reserved":0,"allocated":2764800,"data_stored":1309266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24313856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38,"15min":0.42299999999999999},"min":{"1min":0.27100000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53000000000000003,"5min":0.57499999999999996,"15min":4.75},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.40600000000000003,"15min":0.49099999999999999},"min":{"1min":0.314,"5min":0.255,"15min":0.255},"max":{"1min":0.56299999999999994,"5min":0.65700000000000003,"15min":9.3100000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.49399999999999999},"min":{"1min":0.36199999999999999,"5min":0.33700000000000002,"15min":0.31},"max":{"1min":0.624,"5min":0.68500000000000005,"15min":3.7210000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.34799999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.629,"5min":0.68600000000000005,"15min":2.7160000000000002},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46000000000000002,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.32800000000000001},"max":{"1min":0.59199999999999997,"5min":0.73499999999999999,"15min":2.4809999999999999},"last":0.495},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45500000000000002,"15min":0.49299999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":3.8580000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.51200000000000001,"5min":0.42799999999999999,"15min":0.41699999999999998},"max":{"1min":0.85699999999999998,"5min":1.111,"15min":2.181},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":1.1459999999999999,"15min":2.4180000000000001},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.70099999999999996,"15min":0.71899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83499999999999996,"5min":1.5629999999999999,"15min":3.7440000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89200000000000002,"5min":1.6879999999999999,"15min":2.149},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88100000000000001,"5min":1.2050000000000001,"15min":2.052},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70799999999999996,"15min":0.745},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92800000000000005,"5min":1.0940000000000001,"15min":6.1980000000000004},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96099999999999997,"5min":1.1419999999999999,"15min":2.016},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.46700000000000003},"max":{"1min":0.94499999999999995,"5min":1.2929999999999999,"15min":3.7799999999999998},"last":0.78400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25292,"kb_used_data":2692,"kb_used_omap":0,"kb_used_meta":22592,"kb_avail":94346548,"statfs":{"total":96636764160,"available":96610865152,"internally_reserved":0,"allocated":2756608,"data_stored":1308602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23134208},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40600000000000003,"15min":0.39300000000000002},"min":{"1min":0.26500000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.625,"5min":1.954,"15min":1.954},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.27300000000000002,"15min":0.24399999999999999},"max":{"1min":0.51700000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.30199999999999999,"5min":0.29899999999999999,"15min":0.26900000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45900000000000002,"15min":0.46700000000000003},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.307},"max":{"1min":0.64000000000000001,"5min":0.69099999999999995,"15min":1.5589999999999999},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45600000000000002,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56499999999999995,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.58099999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70299999999999996,"15min":0.69599999999999995},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.0800000000000001,"15min":1.6399999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.53200000000000003,"5min":0.45300000000000001,"15min":0.36499999999999999},"max":{"1min":0.96899999999999997,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.71599999999999997},"min":{"1min":0.54400000000000004,"5min":0.46500000000000002,"15min":0.45000000000000001},"max":{"1min":0.84399999999999997,"5min":1.0489999999999999,"15min":1.25},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.56899999999999995,"5min":0.443,"15min":0.41499999999999998},"max":{"1min":0.93899999999999995,"5min":1.016,"15min":1.6020000000000001},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.498},"max":{"1min":0.89800000000000002,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72599999999999998},"min":{"1min":0.59399999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.97999999999999998,"5min":1.0840000000000001,"15min":1.22},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jul 27 14:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.60299999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97199999999999998,"5min":2.141,"15min":2.141},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48699999999999999},"max":{"1min":0.95899999999999996,"5min":1.125,"15min":1.2370000000000001},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":30336,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":2740224,"data_stored":1301856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31064064},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.433,"15min":0.41299999999999998},"min":{"1min":0.30099999999999999,"5min":0.26300000000000001,"15min":0.23799999999999999},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":0.379},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42999999999999999,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75800000000000001,"5min":0.76800000000000002,"15min":1.1899999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.48999999999999999,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79900000000000004,"5min":0.81399999999999995,"15min":5.601},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.50900000000000001,"15min":0.47799999999999998},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.52500000000000002,"15min":0.51600000000000001},"min":{"1min":0.39700000000000002,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.42999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.849},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.76000000000000001,"15min":0.73999999999999999},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.434},"max":{"1min":4.8869999999999996,"5min":4.8869999999999996,"15min":6.9660000000000002},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54600000000000004,"5min":0.47199999999999998,"15min":0.45000000000000001},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.772},"last":0.624}]},{"osd":6,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.76700000000000002,"15min":0.73699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.42499999999999999},"max":{"1min":6.7050000000000001,"5min":6.7050000000000001,"15min":6.7050000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.58099999999999996,"5min":0.502,"15min":0.47899999999999998},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.81399999999999995,"15min":0.79200000000000004},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":5.9020000000000001,"5min":5.9020000000000001,"15min":5.9020000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.80700000000000005,"15min":0.78400000000000003},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52400000000000002},"max":{"1min":6.4409999999999998,"5min":6.4409999999999998,"15min":6.4409999999999998},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575020,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":24632,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":21952,"kb_avail":94347208,"statfs":{"total":96636764160,"available":96611540992,"internally_reserved":0,"allocated":2736128,"data_stored":1301766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":22478848},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.23400000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":1.202},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":1.302},"last":0.37}]},{"osd":1,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.42899999999999999},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.88900000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.44900000000000001,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":1.2390000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.81499999999999995,"15min":1.0640000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.504},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":1.8029999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.436,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.149},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68899999999999995,"15min":0.71599999999999997},"min":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":5.1059999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.46000000000000002},"max":{"1min":0.96799999999999997,"5min":1.0229999999999999,"15min":1.232},"last":0.621},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":2.3959999999999999},"last":0.629}]},{"osd":6,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.55700000000000005,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.44},"max":{"1min":0.999,"5min":0.999,"15min":1.343},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jul 27 14:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.745,"15min":0.76600000000000001},"min":{"1min":0.624,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":1.04,"5min":1.115,"15min":2.048},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.49299999999999999},"max":{"1min":1.107,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575020,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23568,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":20864,"kb_avail":94348272,"statfs":{"total":96636764160,"available":96612630528,"internally_reserved":0,"allocated":2760704,"data_stored":1309164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":21364736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.442,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":2.4300000000000002,"15min":4.3479999999999999},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.39500000000000002},"max":{"1min":0.85299999999999998,"5min":3.419,"15min":4.4409999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.65300000000000002},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.504}]},{"osd":2,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.41299999999999998},"max":{"1min":0.86599999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.46100000000000002,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":2.3010000000000002,"15min":4.476},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66400000000000003,"15min":0.66900000000000004},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":0.98099999999999998,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.52200000000000002,"5min":0.46700000000000003,"15min":0.45500000000000002},"max":{"1min":0.79600000000000004,"5min":3.7559999999999998,"15min":4.4829999999999997},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.35999999999999999},"max":{"1min":0.81200000000000006,"5min":3.48,"15min":4.3949999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.38900000000000001},"max":{"1min":1.133,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":3.8620000000000001,"15min":5.194},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.60699999999999998,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.89900000000000002,"5min":2.387,"15min":5.5990000000000002},"last":0.745}]},{"osd":7,"last update":"Thu Jul 27 14:40:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.012,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.76500000000000001},"min":{"1min":0.56999999999999995,"5min":0.48699999999999999,"15min":0.34599999999999997},"max":{"1min":0.99399999999999999,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575021,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":2692,"kb_used_omap":0,"kb_used_meta":24768,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":2756608,"data_stored":1309944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25362432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.621},"min":{"1min":0.432,"5min":0.379,"15min":0.317},"max":{"1min":0.871,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.63500000000000001},"min":{"1min":0.371,"5min":0.37,"15min":0.35599999999999998},"max":{"1min":0.73799999999999999,"5min":0.84799999999999998,"15min":12.127000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.67900000000000005,"15min":0.69499999999999995},"min":{"1min":0.49199999999999999,"5min":0.443,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":6.7489999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64700000000000002,"15min":0.67500000000000004},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":6.7370000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.624,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":1.581},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"max":{"1min":1.0169999999999999,"5min":5.5750000000000002,"15min":5.5750000000000002},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":0.84099999999999997,"5min":0.874,"15min":9.6920000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.52000000000000002,"5min":0.50600000000000001,"15min":0.48199999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":9.4299999999999997},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.70299999999999996},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.35099999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.978},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":2.4129999999999998},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":8.0329999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40200000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.7629999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jul 27 14:40:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96599999999999997,"5min":0.99399999999999999,"15min":2.3719999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.9419999999999999},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-27T14:41:06.154 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-27T14:41:06.154 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-27T14:41:06.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.324+0000 7f4fff5ff700 1 Processor -- start 2023-07-27T14:41:06.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.325+0000 7f4fff5ff700 1 -- start start 2023-07-27T14:41:06.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4fff5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff80c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4fff5ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4ff80a7940 0x7f4ff80c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4fff5ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80c7ad0 con 0x7f4ff80c7550 2023-07-27T14:41:06.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4fff5ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff80c5590 con 0x7f4ff80a7940 2023-07-27T14:41:06.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4fff5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80c0fb0 con 0x7f4ff8157400 2023-07-27T14:41:06.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4ffd39b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff80c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4ffcb9a700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4ff80a7940 0x7f4ff80c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4ffdb9c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f4ff80c7550 0x7f4ff80c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.115:48478/0 (socket says 172.21.15.115:48478) 2023-07-27T14:41:06.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.326+0000 7f4ffdb9c700 1 -- 172.21.15.115:0/3995884671 learned_addr learned my addr 172.21.15.115:0/3995884671 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:06.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4ffd39b700 1 -- 172.21.15.115:0/3995884671 >> v2:172.21.15.159:3300/0 conn(0x7f4ff80a7940 msgr2=0x7f4ff80c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:06.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4ffd39b700 1 --2- 172.21.15.115:0/3995884671 >> v2:172.21.15.159:3300/0 conn(0x7f4ff80a7940 0x7f4ff80c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4ffd39b700 1 -- 172.21.15.115:0/3995884671 >> v1:172.21.15.159:6789/0 conn(0x7f4ff80c7550 legacy=0x7f4ff80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4ffd39b700 1 -- 172.21.15.115:0/3995884671 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80c7db0 con 0x7f4ff8157400 2023-07-27T14:41:06.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4ffcb9a700 1 --2- 172.21.15.115:0/3995884671 >> v2:172.21.15.159:3300/0 conn(0x7f4ff80a7940 0x7f4ff80c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:41:06.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4feffff700 1 -- 172.21.15.115:0/3995884671 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232617180 0 0) 0x7f4ff80c7ad0 con 0x7f4ff80c7550 2023-07-27T14:41:06.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4ffd39b700 1 --2- 172.21.15.115:0/3995884671 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff80c05d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f4ff4009760 tx=0x7f4ff4009060).ready entity=mon.2 client_cookie=c7e1df1edc7a77d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:06.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4feffff700 1 -- 172.21.15.115:0/3995884671 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400f510 con 0x7f4ff8157400 2023-07-27T14:41:06.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4feffff700 1 -- 172.21.15.115:0/3995884671 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff400f670 con 0x7f4ff8157400 2023-07-27T14:41:06.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.327+0000 7f4feffff700 1 -- 172.21.15.115:0/3995884671 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400f9f0 con 0x7f4ff8157400 2023-07-27T14:41:06.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.328+0000 7f4fff5ff700 1 -- 172.21.15.115:0/3995884671 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 msgr2=0x7f4ff80c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.328+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/3995884671 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff80c05d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f4ff4009760 tx=0x7f4ff4009060).stop 2023-07-27T14:41:06.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.328+0000 7f4fff5ff700 1 -- 172.21.15.115:0/3995884671 shutdown_connections 2023-07-27T14:41:06.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.328+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/3995884671 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff80c05d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.328+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/3995884671 >> v2:172.21.15.159:3300/0 conn(0x7f4ff80a7940 0x7f4ff80c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.328+0000 7f4fff5ff700 1 -- 172.21.15.115:0/3995884671 >> 172.21.15.115:0/3995884671 conn(0x7f4ff8094280 msgr2=0x7f4ff805e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:06.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.328+0000 7f4fff5ff700 1 -- 172.21.15.115:0/3995884671 shutdown_connections 2023-07-27T14:41:06.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.328+0000 7f4fff5ff700 1 -- 172.21.15.115:0/3995884671 wait complete. 2023-07-27T14:41:06.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.330+0000 7f4fff5ff700 1 Processor -- start 2023-07-27T14:41:06.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.330+0000 7f4fff5ff700 1 -- start start 2023-07-27T14:41:06.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4fff5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff80a7940 0x7f4ff80cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4fff5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ff80c7550 0x7f4ff8098230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4fff5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff8168230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4fff5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80cb040 con 0x7f4ff80c7550 2023-07-27T14:41:06.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4fff5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff8098720 con 0x7f4ff80a7940 2023-07-27T14:41:06.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4fff5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80ca430 con 0x7f4ff8157400 2023-07-27T14:41:06.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffcb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ff80c7550 0x7f4ff8098230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffcb9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ff80c7550 0x7f4ff8098230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48752/0 (socket says 172.21.15.115:48752) 2023-07-27T14:41:06.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffcb9a700 1 -- 172.21.15.115:0/2567239806 learned_addr learned my addr 172.21.15.115:0/2567239806 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:06.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffd39b700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff80a7940 0x7f4ff80cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffdb9c700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff8168230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffcb9a700 1 -- 172.21.15.115:0/2567239806 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 msgr2=0x7f4ff8168230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffcb9a700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff8168230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffcb9a700 1 -- 172.21.15.115:0/2567239806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff80a7940 msgr2=0x7f4ff80cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffcb9a700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff80a7940 0x7f4ff80cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.331+0000 7f4ffcb9a700 1 -- 172.21.15.115:0/2567239806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe80092a0 con 0x7f4ff80c7550 2023-07-27T14:41:06.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.332+0000 7f4ffcb9a700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ff80c7550 0x7f4ff8098230 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 rx=0x7f4fe800e930 tx=0x7f4fe8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:06.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.332+0000 7f4fed7fa700 1 -- 172.21.15.115:0/2567239806 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8012600 con 0x7f4ff80c7550 2023-07-27T14:41:06.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.332+0000 7f4fed7fa700 1 -- 172.21.15.115:0/2567239806 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe8012760 con 0x7f4ff80c7550 2023-07-27T14:41:06.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.332+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff40092a0 con 0x7f4ff80c7550 2023-07-27T14:41:06.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.332+0000 7f4fed7fa700 1 -- 172.21.15.115:0/2567239806 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8012ae0 con 0x7f4ff80c7550 2023-07-27T14:41:06.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.332+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff80ca9f0 con 0x7f4ff80c7550 2023-07-27T14:41:06.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.333+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff806c470 con 0x7f4ff80c7550 2023-07-27T14:41:06.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.334+0000 7f4fed7fa700 1 -- 172.21.15.115:0/2567239806 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f4fe8022070 con 0x7f4ff80c7550 2023-07-27T14:41:06.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.335+0000 7f4fed7fa700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4fdc05fe20 0x7f4fdc0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.335+0000 7f4fed7fa700 1 -- 172.21.15.115:0/2567239806 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f4fe807b970 con 0x7f4ff80c7550 2023-07-27T14:41:06.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.335+0000 7f4ffd39b700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4fdc05fe20 0x7f4fdc0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.336+0000 7f4ffd39b700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4fdc05fe20 0x7f4fdc0622e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f4ff4009fd0 tx=0x7f4ff4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:06.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.339+0000 7f4fed7fa700 1 -- 172.21.15.115:0/2567239806 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4fe804bd50 con 0x7f4ff80c7550 2023-07-27T14:41:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.573+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4ff814ccc0 con 0x7f4ff80c7550 2023-07-27T14:41:06.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.577+0000 7f4fed7fa700 1 -- 172.21.15.115:0/2567239806 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4fe80160e0 con 0x7f4ff80c7550 2023-07-27T14:41:06.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4fdc05fe20 msgr2=0x7f4fdc0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4fdc05fe20 0x7f4fdc0622e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f4ff4009fd0 tx=0x7f4ff4017000).stop 2023-07-27T14:41:06.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ff80c7550 msgr2=0x7f4ff8098230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ff80c7550 0x7f4ff8098230 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 rx=0x7f4fe800e930 tx=0x7f4fe8009060).stop 2023-07-27T14:41:06.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 shutdown_connections 2023-07-27T14:41:06.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f4fdc05fe20 0x7f4fdc0622e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4ff8157400 0x7f4ff8168230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff80a7940 0x7f4ff80cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 --2- 172.21.15.115:0/2567239806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ff80c7550 0x7f4ff8098230 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 >> 172.21.15.115:0/2567239806 conn(0x7f4ff8094280 msgr2=0x7f4ff80a85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:06.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 shutdown_connections 2023-07-27T14:41:06.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.580+0000 7f4fff5ff700 1 -- 172.21.15.115:0/2567239806 wait complete. 2023-07-27T14:41:06.640 INFO:teuthology.orchestra.run.smithi115.stderr:updated caps for client.0 2023-07-27T14:41:06.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-27T14:41:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.785+0000 7f0a26fff700 1 Processor -- start 2023-07-27T14:41:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.786+0000 7f0a26fff700 1 -- start start 2023-07-27T14:41:06.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.787+0000 7f0a26fff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0a200a4840 0x7f0a200a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.787+0000 7f0a26fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a200bc050 0x7f0a200bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.787+0000 7f0a26fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a200639d0 con 0x7f0a20151bd0 2023-07-27T14:41:06.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.787+0000 7f0a26fff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a20137610 con 0x7f0a200a4840 2023-07-27T14:41:06.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.787+0000 7f0a26fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a200a51b0 con 0x7f0a200bc050 2023-07-27T14:41:06.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.787+0000 7f0a24d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0a20151bd0 0x7f0a20062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36266/0 (socket says 172.21.15.115:36266) 2023-07-27T14:41:06.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.787+0000 7f0a24d9b700 1 -- 172.21.15.115:0/2701174544 learned_addr learned my addr 172.21.15.115:0/2701174544 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:06.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.787+0000 7f0a1ffff700 1 --2- 172.21.15.115:0/2701174544 >> v2:172.21.15.159:3300/0 conn(0x7f0a200a4840 0x7f0a200a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053940400 0 0) 0x7f0a200639d0 con 0x7f0a20151bd0 2023-07-27T14:41:06.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a100033f0 con 0x7f0a20151bd0 2023-07-27T14:41:06.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a2559c700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a200bc050 0x7f0a200bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 803218950 0 0) 0x7f0a100033f0 con 0x7f0a20151bd0 2023-07-27T14:41:06.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a200bc050 msgr2=0x7f0a200bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:06.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a200bc050 0x7f0a200bc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 >> v2:172.21.15.159:3300/0 conn(0x7f0a200a4840 msgr2=0x7f0a200a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:06.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 --2- 172.21.15.115:0/2701174544 >> v2:172.21.15.159:3300/0 conn(0x7f0a200a4840 0x7f0a200a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20062dc0 con 0x7f0a20151bd0 2023-07-27T14:41:06.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f0a14001470 con 0x7f0a20151bd0 2023-07-27T14:41:06.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1ffff700 1 --2- 172.21.15.115:0/2701174544 >> v2:172.21.15.159:3300/0 conn(0x7f0a200a4840 0x7f0a200a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:41:06.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 >> v1:172.21.15.115:6789/0 conn(0x7f0a20151bd0 legacy=0x7f0a20062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a100038e0 0x7f0a10003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a200bc050 0x7f0a10004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10004b80 0x7f0a10005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a200a51b0 con 0x7f0a100038e0 2023-07-27T14:41:06.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100044f0 con 0x7f0a10004b80 2023-07-27T14:41:06.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1000b960 con 0x7f0a200bc050 2023-07-27T14:41:06.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.788+0000 7f0a24d9b700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a100038e0 0x7f0a10003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a2559c700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10004b80 0x7f0a10005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a1ffff700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a200bc050 0x7f0a10004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a24d9b700 1 -- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a200bc050 msgr2=0x7f0a10004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:06.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a24d9b700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a200bc050 0x7f0a10004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a24d9b700 1 -- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10004b80 msgr2=0x7f0a10005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:06.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a24d9b700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a10004b80 0x7f0a10005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a24d9b700 1 -- 172.21.15.115:0/2701174544 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100033f0 con 0x7f0a100038e0 2023-07-27T14:41:06.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a24d9b700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a100038e0 0x7f0a10003d00 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 rx=0x7f0a1400c210 tx=0x7f0a14001e90).ready entity=mon.0 client_cookie=d4cecf8557fcb7de server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:06.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14007a60 con 0x7f0a100038e0 2023-07-27T14:41:06.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1400cae0 con 0x7f0a100038e0 2023-07-27T14:41:06.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.789+0000 7f0a1f7fe700 1 -- 172.21.15.115:0/2701174544 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400cea0 con 0x7f0a100038e0 2023-07-27T14:41:06.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.790+0000 7f0a26fff700 1 -- 172.21.15.115:0/2701174544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a100038e0 msgr2=0x7f0a10003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.790+0000 7f0a26fff700 1 --2- 172.21.15.115:0/2701174544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a100038e0 0x7f0a10003d00 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 rx=0x7f0a1400c210 tx=0x7f0a14001e90).stop 2023-07-27T14:41:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.790+0000 7f0a2559c700 1 -- 172.21.15.115:0/2701174544 reap_dead start 2023-07-27T14:41:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.790+0000 7f0a26fff700 1 -- 172.21.15.115:0/2701174544 shutdown_connections 2023-07-27T14:41:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.790+0000 7f0a26fff700 1 -- 172.21.15.115:0/2701174544 >> 172.21.15.115:0/2701174544 conn(0x7f0a20064700 msgr2=0x7f0a20064b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.790+0000 7f0a26fff700 1 -- 172.21.15.115:0/2701174544 shutdown_connections 2023-07-27T14:41:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.790+0000 7f0a26fff700 1 -- 172.21.15.115:0/2701174544 wait complete. 2023-07-27T14:41:06.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.791+0000 7f0a26fff700 1 Processor -- start 2023-07-27T14:41:06.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.791+0000 7f0a26fff700 1 -- start start 2023-07-27T14:41:06.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.792+0000 7f0a26fff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a100038e0 0x7f0a200c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.792+0000 7f0a26fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20136bf0 0x7f0a201535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.792+0000 7f0a26fff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a20153ad0 0x7f0a20068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.792+0000 7f0a26fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2013bbd0 con 0x7f0a20136bf0 2023-07-27T14:41:06.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.792+0000 7f0a26fff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a20153f50 con 0x7f0a20153ad0 2023-07-27T14:41:06.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.792+0000 7f0a26fff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a20137070 con 0x7f0a100038e0 2023-07-27T14:41:06.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20136bf0 0x7f0a201535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20136bf0 0x7f0a201535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48770/0 (socket says 172.21.15.115:48770) 2023-07-27T14:41:06.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 -- 172.21.15.115:0/1815880548 learned_addr learned my addr 172.21.15.115:0/1815880548 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:06.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a24d9b700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a100038e0 0x7f0a200c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a2559c700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a20153ad0 0x7f0a20068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 -- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a100038e0 msgr2=0x7f0a200c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a100038e0 0x7f0a200c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 -- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a20153ad0 msgr2=0x7f0a20068610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:06.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a20153ad0 0x7f0a20068610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:06.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 -- 172.21.15.115:0/1815880548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2013afc0 con 0x7f0a20136bf0 2023-07-27T14:41:06.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a2559c700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a20153ad0 0x7f0a20068610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:06.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1ffff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20136bf0 0x7f0a201535e0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 rx=0x7f0a0c011da0 tx=0x7f0a0c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:06.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1cff9700 1 -- 172.21.15.115:0/1815880548 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c009e30 con 0x7f0a20136bf0 2023-07-27T14:41:06.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1cff9700 1 -- 172.21.15.115:0/1815880548 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00fc70 con 0x7f0a20136bf0 2023-07-27T14:41:06.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2013b2a0 con 0x7f0a20136bf0 2023-07-27T14:41:06.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.793+0000 7f0a1cff9700 1 -- 172.21.15.115:0/1815880548 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c014440 con 0x7f0a20136bf0 2023-07-27T14:41:06.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.794+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2013b860 con 0x7f0a20136bf0 2023-07-27T14:41:06.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.794+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2006c470 con 0x7f0a20136bf0 2023-07-27T14:41:06.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.795+0000 7f0a1cff9700 1 -- 172.21.15.115:0/1815880548 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f0a0c024070 con 0x7f0a20136bf0 2023-07-27T14:41:06.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.796+0000 7f0a1cff9700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0a0405fe20 0x7f0a040622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:06.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.796+0000 7f0a1cff9700 1 -- 172.21.15.115:0/1815880548 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f0a0c07c1f0 con 0x7f0a20136bf0 2023-07-27T14:41:06.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.797+0000 7f0a24d9b700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0a0405fe20 0x7f0a040622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:06.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.797+0000 7f0a24d9b700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0a0405fe20 0x7f0a040622e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f0a14001ed0 tx=0x7f0a14015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:06.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:06.800+0000 7f0a1cff9700 1 -- 172.21.15.115:0/1815880548 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0a0c04c5d0 con 0x7f0a20136bf0 2023-07-27T14:41:07.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.009+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a200c5ee0 con 0x7f0a20136bf0 2023-07-27T14:41:07.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.010+0000 7f0a1cff9700 1 -- 172.21.15.115:0/1815880548 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4512 (secure 0 0 0) 0x7f0a0c018090 con 0x7f0a20136bf0 2023-07-27T14:41:07.066 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-07-27T14:41:07.067 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":121,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/1467451236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":1467451236},{"type":"v1","addr":"172.21.15.159:6835","nonce":1467451236}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":9550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3231212144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3231212144},{"type":"v1","addr":"172.21.15.159:6833","nonce":3231212144}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":10890,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6836/260341074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":260341074},{"type":"v1","addr":"172.21.15.115:6836","nonce":260341074}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-27T14:41:01.387930+0000","modified":"2023-07-27T14:41:04.397833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10893},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10893":{"gid":10893,"name":"c","rank":0,"incarnation":118,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6837/4284501602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6835","nonce":4284501602},{"type":"v1","addr":"172.21.15.115:6837","nonce":4284501602}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-07-27T14:41:07.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.011+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0a0405fe20 msgr2=0x7f0a040622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.011+0000 7f0a26fff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0a0405fe20 0x7f0a040622e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f0a14001ed0 tx=0x7f0a14015000).stop 2023-07-27T14:41:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.011+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20136bf0 msgr2=0x7f0a201535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.011+0000 7f0a26fff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20136bf0 0x7f0a201535e0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 rx=0x7f0a0c011da0 tx=0x7f0a0c009060).stop 2023-07-27T14:41:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.012+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 shutdown_connections 2023-07-27T14:41:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.012+0000 7f0a26fff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f0a0405fe20 0x7f0a040622e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.012+0000 7f0a26fff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a20153ad0 0x7f0a20068610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.012+0000 7f0a26fff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a100038e0 0x7f0a200c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.012+0000 7f0a26fff700 1 --2- 172.21.15.115:0/1815880548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a20136bf0 0x7f0a201535e0 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.012+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 >> 172.21.15.115:0/1815880548 conn(0x7f0a20064700 msgr2=0x7f0a20065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.012+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 shutdown_connections 2023-07-27T14:41:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.012+0000 7f0a26fff700 1 -- 172.21.15.115:0/1815880548 wait complete. 2023-07-27T14:41:07.070 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 121 2023-07-27T14:41:07.488 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 121, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-27T14:41:01.387930+0000', 'modified': '2023-07-27T14:41:04.397833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10893}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10893': {'gid': 10893, 'name': 'c', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.115:6837/4284501602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6835', 'nonce': 4284501602}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 4284501602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [31], 'metadata_pool': 30, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-07-27T14:41:07.488 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-27T14:41:07.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-27T14:41:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.621+0000 7f8d92dff700 1 Processor -- start 2023-07-27T14:41:07.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.621+0000 7f8d92dff700 1 -- start start 2023-07-27T14:41:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.622+0000 7f8d92dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8d8c153ec0 0x7f8d8c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.622+0000 7f8d92dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aa050 0x7f8d8c0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.622+0000 7f8d92dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8d8c0aaa40 0x7f8d8c0645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.622+0000 7f8d92dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c064ad0 con 0x7f8d8c153ec0 2023-07-27T14:41:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.622+0000 7f8d92dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c0aa4d0 con 0x7f8d8c0aaa40 2023-07-27T14:41:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.622+0000 7f8d92dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0c05c0 con 0x7f8d8c0aa050 2023-07-27T14:41:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8d8c153ec0 0x7f8d8c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8d8c153ec0 0x7f8d8c0a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48786/0 (socket says 172.21.15.115:48786) 2023-07-27T14:41:07.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 -- 172.21.15.115:0/3943617659 learned_addr learned my addr 172.21.15.115:0/3943617659 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/3943617659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aa050 0x7f8d8c0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 -- 172.21.15.115:0/3943617659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aa050 msgr2=0x7f8d8c0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d9139c700 1 --2- 172.21.15.115:0/3943617659 >> v2:172.21.15.159:3300/0 conn(0x7f8d8c0aaa40 0x7f8d8c0645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/3943617659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aa050 0x7f8d8c0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 -- 172.21.15.115:0/3943617659 >> v2:172.21.15.159:3300/0 conn(0x7f8d8c0aaa40 msgr2=0x7f8d8c0645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/3943617659 >> v2:172.21.15.159:3300/0 conn(0x7f8d8c0aaa40 0x7f8d8c0645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 -- 172.21.15.115:0/3943617659 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0bfc90 con 0x7f8d8c153ec0 2023-07-27T14:41:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/3943617659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aa050 0x7f8d8c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d9139c700 1 --2- 172.21.15.115:0/3943617659 >> v2:172.21.15.159:3300/0 conn(0x7f8d8c0aaa40 0x7f8d8c0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.623+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/3943617659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0a9b60 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 rx=0x7f8d8c05fc30 tx=0x7f8d800090f0).ready entity=mon.0 client_cookie=501971d1ac9a73d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d8b7fe700 1 -- 172.21.15.115:0/3943617659 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000b600 con 0x7f8d8c153ec0 2023-07-27T14:41:07.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d8b7fe700 1 -- 172.21.15.115:0/3943617659 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8000b760 con 0x7f8d8c153ec0 2023-07-27T14:41:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d8b7fe700 1 -- 172.21.15.115:0/3943617659 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000bae0 con 0x7f8d8c153ec0 2023-07-27T14:41:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 -- 172.21.15.115:0/3943617659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 msgr2=0x7f8d8c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3943617659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0a9b60 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 rx=0x7f8d8c05fc30 tx=0x7f8d800090f0).stop 2023-07-27T14:41:07.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 -- 172.21.15.115:0/3943617659 shutdown_connections 2023-07-27T14:41:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3943617659 >> v2:172.21.15.159:3300/0 conn(0x7f8d8c0aaa40 0x7f8d8c0645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3943617659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0a9b60 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3943617659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aa050 0x7f8d8c0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 -- 172.21.15.115:0/3943617659 >> 172.21.15.115:0/3943617659 conn(0x7f8d8c0cb610 msgr2=0x7f8d8c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 -- 172.21.15.115:0/3943617659 shutdown_connections 2023-07-27T14:41:07.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.624+0000 7f8d92dff700 1 -- 172.21.15.115:0/3943617659 wait complete. 2023-07-27T14:41:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.626+0000 7f8d92dff700 1 Processor -- start 2023-07-27T14:41:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.627+0000 7f8d92dff700 1 -- start start 2023-07-27T14:41:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d92dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0aa050 0x7f8d8c14cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d92dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aaa40 0x7f8d8c0a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d92dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d92dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c14d040 con 0x7f8d8c153ec0 2023-07-27T14:41:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d92dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0a9730 con 0x7f8d8c0aa050 2023-07-27T14:41:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d92dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c1641a0 con 0x7f8d8c0aaa40 2023-07-27T14:41:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d9139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d9139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48788/0 (socket says 172.21.15.115:48788) 2023-07-27T14:41:07.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d9139c700 1 -- 172.21.15.115:0/3764608676 learned_addr learned my addr 172.21.15.115:0/3764608676 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0aa050 0x7f8d8c14cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aaa40 0x7f8d8c0a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d9139c700 1 -- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aaa40 msgr2=0x7f8d8c0a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d9139c700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aaa40 0x7f8d8c0a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d9139c700 1 -- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0aa050 msgr2=0x7f8d8c14cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d9139c700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0aa050 0x7f8d8c14cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d9139c700 1 -- 172.21.15.115:0/3764608676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80009370 con 0x7f8d8c153ec0 2023-07-27T14:41:07.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.628+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aaa40 0x7f8d8c0a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.629+0000 7f8d9139c700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0aeb10 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 rx=0x7f8d8400cf80 tx=0x7f8d84007890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.629+0000 7f8d88ff9700 1 -- 172.21.15.115:0/3764608676 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d84016470 con 0x7f8d8c153ec0 2023-07-27T14:41:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.629+0000 7f8d88ff9700 1 -- 172.21.15.115:0/3764608676 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d840165d0 con 0x7f8d8c153ec0 2023-07-27T14:41:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.629+0000 7f8d88ff9700 1 -- 172.21.15.115:0/3764608676 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d84016950 con 0x7f8d8c153ec0 2023-07-27T14:41:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.629+0000 7f8d92dff700 1 -- 172.21.15.115:0/3764608676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c164480 con 0x7f8d8c153ec0 2023-07-27T14:41:07.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.629+0000 7f8d92dff700 1 -- 172.21.15.115:0/3764608676 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c164a40 con 0x7f8d8c153ec0 2023-07-27T14:41:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.632+0000 7f8d88ff9700 1 -- 172.21.15.115:0/3764608676 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f8d8400d440 con 0x7f8d8c153ec0 2023-07-27T14:41:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.632+0000 7f8d88ff9700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8d7005fe20 0x7f8d700622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.633+0000 7f8d88ff9700 1 -- 172.21.15.115:0/3764608676 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8d8407c340 con 0x7f8d8c153ec0 2023-07-27T14:41:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.633+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8d7005fe20 0x7f8d700622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.633+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8d7005fe20 0x7f8d700622e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f8d80009130 tx=0x7f8d80017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.634+0000 7f8daa159b80 1 Processor -- start 2023-07-27T14:41:07.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.634+0000 7f8daa159b80 1 -- start start 2023-07-27T14:41:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.635+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5b5c0 0x561095b5b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.635+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b83830 0x561095ba9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.635+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5df60 0x561095baa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.635+0000 7f8daa159b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x561095a989c0 con 0x561095b5df60 2023-07-27T14:41:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.635+0000 7f8daa159b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x561095aadcc0 con 0x561095b5b5c0 2023-07-27T14:41:07.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.635+0000 7f8daa159b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x561095a74e10 con 0x561095b83830 2023-07-27T14:41:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5df60 0x561095baa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5df60 0x561095baa1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48802/0 (socket says 172.21.15.115:48802) 2023-07-27T14:41:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 -- 172.21.15.115:0/292212698 learned_addr learned my addr 172.21.15.115:0/292212698 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5b5c0 0x561095b5b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b83830 0x561095ba9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 -- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b83830 msgr2=0x561095ba9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b83830 0x561095ba9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 -- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5b5c0 msgr2=0x561095b5b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5b5c0 0x561095b5b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 -- 172.21.15.115:0/292212698 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561095aa69a0 con 0x561095b5df60 2023-07-27T14:41:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b83830 0x561095ba9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d9139c700 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5df60 0x561095baa1b0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 rx=0x7f8d84007a60 tx=0x7f8d8400f070).ready entity=mon.0 client_cookie=53f5e7f01ac63818 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d759fe700 1 -- 172.21.15.115:0/292212698 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8404ffd0 con 0x561095b5df60 2023-07-27T14:41:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d759fe700 1 -- 172.21.15.115:0/292212698 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8404e830 con 0x561095b5df60 2023-07-27T14:41:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.636+0000 7f8d759fe700 1 -- 172.21.15.115:0/292212698 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8404cba0 con 0x561095b5df60 2023-07-27T14:41:07.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 -- 172.21.15.115:0/292212698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5df60 msgr2=0x561095baa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5df60 0x561095baa1b0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 rx=0x7f8d84007a60 tx=0x7f8d8400f070).stop 2023-07-27T14:41:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 -- 172.21.15.115:0/292212698 shutdown_connections 2023-07-27T14:41:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5df60 0x561095baa1b0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5b5c0 0x561095b5b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 --2- 172.21.15.115:0/292212698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b83830 0x561095ba9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 -- 172.21.15.115:0/292212698 >> 172.21.15.115:0/292212698 conn(0x5610959c6940 msgr2=0x561095ba46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 -- 172.21.15.115:0/292212698 shutdown_connections 2023-07-27T14:41:07.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.637+0000 7f8daa159b80 1 -- 172.21.15.115:0/292212698 wait complete. 2023-07-27T14:41:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.638+0000 7f8daa159b80 1 -- start start 2023-07-27T14:41:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.638+0000 7f8daa159b80 1 Processor -- start 2023-07-27T14:41:07.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b7d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095b9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b824e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8daa159b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x561095ba3e70 con 0x561095b5b5c0 2023-07-27T14:41:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8daa159b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x561095b9bcb0 con 0x561095b82060 2023-07-27T14:41:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8daa159b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x561095b9cb10 con 0x561095b5df60 2023-07-27T14:41:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8daa159b80 10 client.0 ll_register_callbacks cb 0x561095a604a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:41:07.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8d90b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b7d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8d90b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b7d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48818/0 (socket says 172.21.15.115:48818) 2023-07-27T14:41:07.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8d90b9b700 1 -- 172.21.15.115:0/142087443 learned_addr learned my addr 172.21.15.115:0/142087443 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:07.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8d9139c700 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b824e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.639+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095b9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d90b9b700 1 -- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 msgr2=0x561095b9e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095b9e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d90b9b700 1 -- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 msgr2=0x561095b824e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b824e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d90b9b700 1 -- 172.21.15.115:0/142087443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c164a40 con 0x561095b5b5c0 2023-07-27T14:41:07.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095b9e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:07.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b7d420 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 rx=0x7f8d8c060760 tx=0x7f8d8001e070).ready entity=mon.0 client_cookie=d160b0390024896 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d6affd700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:41:07.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d6affd700 1 -- 172.21.15.115:0/142087443 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80027620 con 0x561095b5b5c0 2023-07-27T14:41:07.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8daa159b80 1 -- 172.21.15.115:0/142087443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561095b55d50 con 0x561095b5b5c0 2023-07-27T14:41:07.705 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d6affd700 1 -- 172.21.15.115:0/142087443 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8d80027780 con 0x561095b5b5c0 2023-07-27T14:41:07.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8d6affd700 1 -- 172.21.15.115:0/142087443 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d80027940 con 0x561095b5b5c0 2023-07-27T14:41:07.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8daa159b80 10 client.11046 fetch_fsmap learned FSMap version 121 2023-07-27T14:41:07.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.640+0000 7f8daa159b80 1 -- 172.21.15.115:0/142087443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x561095aa2190 con 0x561095b5b5c0 2023-07-27T14:41:07.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8d6affd700 1 -- 172.21.15.115:0/142087443 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561095b55d50 con 0x561095b5b5c0 2023-07-27T14:41:07.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8d6affd700 1 -- 172.21.15.115:0/142087443 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8d80027aa0 con 0x561095b5b5c0 2023-07-27T14:41:07.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8daa159b80 10 client.11046 fetch_fsmap finished waiting for FSMap version 121 2023-07-27T14:41:07.706 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8daa159b80 10 client.11046 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:41:07.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8daa159b80 20 client.11046 populate_metadata read hostname 'smithi115' 2023-07-27T14:41:07.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8daa159b80 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] conn(0x561095bbb940 0x561095bbdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8daa159b80 4 client.11046 mds_command: new command op to 10893 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-27T14:41:07.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8daa159b80 1 -- 172.21.15.115:0/142087443 --> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561095916ef0 con 0x561095bbb940 2023-07-27T14:41:07.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.641+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] conn(0x561095bbb940 0x561095bbdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.642+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] conn(0x561095bbb940 0x561095bbdd30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3343ef5b951fbad5 server_cookie=22d8f397175d55c in_seq=0 out_seq=0 2023-07-27T14:41:07.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.642+0000 7f8d6affd700 10 client.11046 ms_handle_connect on v2:172.21.15.115:6835/4284501602 2023-07-27T14:41:07.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.642+0000 7f8d6affd700 1 -- 172.21.15.115:0/142087443 <== mds.0 v2:172.21.15.115:6835/4284501602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16739 (crc 0 0 0) 0x561095916ef0 con 0x561095bbb940 2023-07-27T14:41:07.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.642+0000 7f8d6affd700 10 client.11046 handle_command_reply: tid=0 2023-07-27T14:41:07.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.642+0000 7f8daa159b80 1 client.11046 shutdown 2023-07-27T14:41:07.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 -- 172.21.15.115:0/142087443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 msgr2=0x561095b7d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b7d420 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 rx=0x7f8d8c060760 tx=0x7f8d8001e070).stop 2023-07-27T14:41:07.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 -- 172.21.15.115:0/142087443 shutdown_connections 2023-07-27T14:41:07.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] conn(0x561095bbb940 0x561095bbdd30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b824e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b7d420 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 --2- 172.21.15.115:0/142087443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095b9e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8d6affd700 0 client.11046 ms_handle_reset on v2:172.21.15.115:6835/4284501602 2023-07-27T14:41:07.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 -- 172.21.15.115:0/142087443 >> 172.21.15.115:0/142087443 conn(0x5610959c6940 msgr2=0x561095b9e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:07.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 -- 172.21.15.115:0/142087443 shutdown_connections 2023-07-27T14:41:07.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 1 -- 172.21.15.115:0/142087443 wait complete. 2023-07-27T14:41:07.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.643+0000 7f8daa159b80 20 client.11046 trim_cache size 0 max 16384 2023-07-27T14:41:07.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.659+0000 7f8daa159b80 1 Processor -- start 2023-07-27T14:41:07.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.660+0000 7f8daa159b80 1 -- start start 2023-07-27T14:41:07.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.660+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095ba4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.660+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5df60 0x561095b58f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.660+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b82060 0x561095b59460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.660+0000 7f8daa159b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x561095b57560 con 0x561095b5b5c0 2023-07-27T14:41:07.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.660+0000 7f8daa159b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x561095ba2650 con 0x561095b5df60 2023-07-27T14:41:07.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.660+0000 7f8daa159b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x561095b551d0 con 0x561095b82060 2023-07-27T14:41:07.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095ba4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095ba4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48832/0 (socket says 172.21.15.115:48832) 2023-07-27T14:41:07.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 -- 172.21.15.115:0/2941745109 learned_addr learned my addr 172.21.15.115:0/2941745109 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:07.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 -- 172.21.15.115:0/2941745109 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b82060 msgr2=0x561095b59460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/2941745109 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b82060 0x561095b59460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:07.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 -- 172.21.15.115:0/2941745109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5df60 msgr2=0x561095b58f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/2941745109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5df60 0x561095b58f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:07.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 -- 172.21.15.115:0/2941745109 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561095b9af30 con 0x561095b5b5c0 2023-07-27T14:41:07.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/2941745109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095ba4490 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 rx=0x7f8d80006ec0 tx=0x7f8d80029070).ready entity=mon.0 client_cookie=b38f88e9da901704 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d761ff700 1 -- 172.21.15.115:0/2941745109 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80009160 con 0x561095b5b5c0 2023-07-27T14:41:07.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d761ff700 1 -- 172.21.15.115:0/2941745109 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8000bbe0 con 0x561095b5b5c0 2023-07-27T14:41:07.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.661+0000 7f8d761ff700 1 -- 172.21.15.115:0/2941745109 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80027830 con 0x561095b5b5c0 2023-07-27T14:41:07.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 -- 172.21.15.115:0/2941745109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 msgr2=0x561095ba4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 --2- 172.21.15.115:0/2941745109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095ba4490 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 rx=0x7f8d80006ec0 tx=0x7f8d80029070).stop 2023-07-27T14:41:07.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 -- 172.21.15.115:0/2941745109 shutdown_connections 2023-07-27T14:41:07.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 --2- 172.21.15.115:0/2941745109 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b82060 0x561095b59460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:07.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 --2- 172.21.15.115:0/2941745109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095ba4490 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 --2- 172.21.15.115:0/2941745109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b5df60 0x561095b58f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:07.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 -- 172.21.15.115:0/2941745109 >> 172.21.15.115:0/2941745109 conn(0x5610959c6940 msgr2=0x561095b57ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:07.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 -- 172.21.15.115:0/2941745109 shutdown_connections 2023-07-27T14:41:07.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.662+0000 7f8daa159b80 1 -- 172.21.15.115:0/2941745109 wait complete. 2023-07-27T14:41:07.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.663+0000 7f8daa159b80 1 -- start start 2023-07-27T14:41:07.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.663+0000 7f8daa159b80 1 Processor -- start 2023-07-27T14:41:07.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b58780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095c03500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8daa159b80 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b9e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8daa159b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x561095b7dd50 con 0x561095b5b5c0 2023-07-27T14:41:07.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8daa159b80 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x561095c06d70 con 0x561095b82060 2023-07-27T14:41:07.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8daa159b80 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x561095c05e60 con 0x561095b5df60 2023-07-27T14:41:07.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8daa159b80 10 client.0 ll_register_callbacks cb 0x561095a604a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-27T14:41:07.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8d90b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b58780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8d90b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b58780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48840/0 (socket says 172.21.15.115:48840) 2023-07-27T14:41:07.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8d90b9b700 1 -- 172.21.15.115:0/1743591339 learned_addr learned my addr 172.21.15.115:0/1743591339 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:07.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8d9139c700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b9e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8d90b9b700 1 -- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 msgr2=0x561095c03500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.664+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095c03500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095c03500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d90b9b700 1 -- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 msgr2=0x561095b9e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b9e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d90b9b700 1 -- 172.21.15.115:0/1743591339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561095aa2190 con 0x561095b5b5c0 2023-07-27T14:41:07.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d9139c700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b9e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:07.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095c03500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:07.729 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d90b9b700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b58780 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 rx=0x7f8d8000b730 tx=0x7f8d80034000).ready entity=mon.0 client_cookie=29d6ed45138c99d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d6affd700 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2023-07-27T14:41:07.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d6affd700 1 -- 172.21.15.115:0/1743591339 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800304f0 con 0x561095b5b5c0 2023-07-27T14:41:07.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d6affd700 1 -- 172.21.15.115:0/1743591339 <== mon.0 v2:172.21.15.115:3300/0 2 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f8d80044410 con 0x561095b5b5c0 2023-07-27T14:41:07.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8daa159b80 1 -- 172.21.15.115:0/1743591339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d8404e830 con 0x561095b5b5c0 2023-07-27T14:41:07.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d6affd700 1 -- 172.21.15.115:0/1743591339 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d80044820 con 0x561095b5b5c0 2023-07-27T14:41:07.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8daa159b80 10 client.11052 fetch_fsmap learned FSMap version 121 2023-07-27T14:41:07.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8daa159b80 1 -- 172.21.15.115:0/1743591339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x561095aa1ee0 con 0x561095b5b5c0 2023-07-27T14:41:07.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.665+0000 7f8d6affd700 1 -- 172.21.15.115:0/1743591339 <== mon.0 v2:172.21.15.115:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8404e830 con 0x561095b5b5c0 2023-07-27T14:41:07.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8d6affd700 1 -- 172.21.15.115:0/1743591339 <== mon.0 v2:172.21.15.115:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8d80044980 con 0x561095b5b5c0 2023-07-27T14:41:07.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8daa159b80 10 client.11052 fetch_fsmap finished waiting for FSMap version 121 2023-07-27T14:41:07.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8daa159b80 10 client.11052 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-27T14:41:07.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8daa159b80 20 client.11052 populate_metadata read hostname 'smithi115' 2023-07-27T14:41:07.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8daa159b80 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] conn(0x561095b5c5d0 0x561095c09750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8daa159b80 4 client.11052 mds_command: new command op to 10893 tid=0[{"prefix": "status"}] 2023-07-27T14:41:07.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8daa159b80 1 -- 172.21.15.115:0/1743591339 --> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56109594c040 con 0x561095b5c5d0 2023-07-27T14:41:07.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] conn(0x561095b5c5d0 0x561095c09750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8d8bfff700 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] conn(0x561095b5c5d0 0x561095c09750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4b440f46157e9009 server_cookie=e898d534f14b810b in_seq=0 out_seq=0 2023-07-27T14:41:07.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8d6affd700 10 client.11052 ms_handle_connect on v2:172.21.15.115:6835/4284501602 2023-07-27T14:41:07.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8d6affd700 1 -- 172.21.15.115:0/1743591339 <== mds.0 v2:172.21.15.115:6835/4284501602 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x56109594c040 con 0x561095b5c5d0 2023-07-27T14:41:07.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8d6affd700 10 client.11052 handle_command_reply: tid=0 2023-07-27T14:41:07.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.666+0000 7f8daa159b80 1 client.11052 shutdown 2023-07-27T14:41:07.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 -- 172.21.15.115:0/1743591339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 msgr2=0x561095b58780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b58780 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 rx=0x7f8d8000b730 tx=0x7f8d80034000).stop 2023-07-27T14:41:07.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 -- 172.21.15.115:0/1743591339 shutdown_connections 2023-07-27T14:41:07.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.115:6835/4284501602,v1:172.21.15.115:6837/4284501602] conn(0x561095b5c5d0 0x561095c09750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561095b82060 0x561095b9e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561095b5b5c0 0x561095b58780 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8d6affd700 0 client.11052 ms_handle_reset on v2:172.21.15.115:6835/4284501602 2023-07-27T14:41:07.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 --2- 172.21.15.115:0/1743591339 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x561095b5df60 0x561095c03500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 -- 172.21.15.115:0/1743591339 >> 172.21.15.115:0/1743591339 conn(0x5610959c6940 msgr2=0x561095b58f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:07.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 -- 172.21.15.115:0/1743591339 shutdown_connections 2023-07-27T14:41:07.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 1 -- 172.21.15.115:0/1743591339 wait complete. 2023-07-27T14:41:07.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8daa159b80 20 client.11052 trim_cache size 0 max 16384 2023-07-27T14:41:07.734 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:41:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "cluster_fsid": "0ede6e86-fb6a-4237-aa30-ce93d50f4d08", 2023-07-27T14:41:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "whoami": 0, 2023-07-27T14:41:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "id": 10893, 2023-07-27T14:41:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "want_state": "up:active", 2023-07-27T14:41:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "up:active", 2023-07-27T14:41:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "fs_name": "cephfs", 2023-07-27T14:41:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "rank_uptime": 6.2770736170000001, 2023-07-27T14:41:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "mdsmap_epoch": 121, 2023-07-27T14:41:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch": 218, 2023-07-27T14:41:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_epoch_barrier": 218, 2023-07-27T14:41:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "uptime": 17.529187651000001 2023-07-27T14:41:07.736 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:41:07.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8d92dff700 1 -- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8d7005fe20 msgr2=0x7f8d700622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.667+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8d7005fe20 0x7f8d700622e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f8d80009130 tx=0x7f8d80017000).stop 2023-07-27T14:41:07.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 -- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 msgr2=0x7f8d8c0aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0aeb10 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 rx=0x7f8d8400cf80 tx=0x7f8d84007890).stop 2023-07-27T14:41:07.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 -- 172.21.15.115:0/3764608676 shutdown_connections 2023-07-27T14:41:07.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f8d7005fe20 0x7f8d700622e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d8c153ec0 0x7f8d8c0aeb10 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.738 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d8c0aa050 0x7f8d8c14cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 --2- 172.21.15.115:0/3764608676 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8d8c0aaa40 0x7f8d8c0a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 -- 172.21.15.115:0/3764608676 >> 172.21.15.115:0/3764608676 conn(0x7f8d8c0cb610 msgr2=0x7f8d8c0ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:07.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 -- 172.21.15.115:0/3764608676 shutdown_connections 2023-07-27T14:41:07.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.668+0000 7f8d92dff700 1 -- 172.21.15.115:0/3764608676 wait complete. 2023-07-27T14:41:07.742 DEBUG:teuthology.orchestra.run.smithi115:> ceph fs ls 2023-07-27T14:41:07.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.844+0000 7feb5719d700 1 Processor -- start 2023-07-27T14:41:07.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.844+0000 7feb5719d700 1 -- start start 2023-07-27T14:41:07.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5719d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb500bfe80 0x7feb500c0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5719d700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7feb5006a6e0 0x7feb500c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5719d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb500c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5719d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb500c0c40 con 0x7feb500bfe80 2023-07-27T14:41:07.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5719d700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb500c8a70 con 0x7feb5006a6e0 2023-07-27T14:41:07.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5719d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb500c95f0 con 0x7feb500a79f0 2023-07-27T14:41:07.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5619b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb500bfe80 0x7feb500c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5619b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb500bfe80 0x7feb500c0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48856/0 (socket says 172.21.15.115:48856) 2023-07-27T14:41:07.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.845+0000 7feb5619b700 1 -- 172.21.15.115:0/2191687039 learned_addr learned my addr 172.21.15.115:0/2191687039 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:07.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5699c700 1 --2- 172.21.15.115:0/2191687039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb500c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5599a700 1 --2- 172.21.15.115:0/2191687039 >> v2:172.21.15.159:3300/0 conn(0x7feb5006a6e0 0x7feb500c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5619b700 1 -- 172.21.15.115:0/2191687039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 msgr2=0x7feb500c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5619b700 1 --2- 172.21.15.115:0/2191687039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb500c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5619b700 1 -- 172.21.15.115:0/2191687039 >> v2:172.21.15.159:3300/0 conn(0x7feb5006a6e0 msgr2=0x7feb500c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:07.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5619b700 1 --2- 172.21.15.115:0/2191687039 >> v2:172.21.15.159:3300/0 conn(0x7feb5006a6e0 0x7feb500c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5619b700 1 -- 172.21.15.115:0/2191687039 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500c8cc0 con 0x7feb500bfe80 2023-07-27T14:41:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5699c700 1 --2- 172.21.15.115:0/2191687039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb500c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5599a700 1 --2- 172.21.15.115:0/2191687039 >> v2:172.21.15.159:3300/0 conn(0x7feb5006a6e0 0x7feb500c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb5619b700 1 --2- 172.21.15.115:0/2191687039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb500c0260 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 rx=0x7feb500842a0 tx=0x7feb4c009060).ready entity=mon.0 client_cookie=6f768b576193c85f server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb55199700 1 -- 172.21.15.115:0/2191687039 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c005880 con 0x7feb500bfe80 2023-07-27T14:41:07.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb55199700 1 -- 172.21.15.115:0/2191687039 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c0059e0 con 0x7feb500bfe80 2023-07-27T14:41:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.846+0000 7feb55199700 1 -- 172.21.15.115:0/2191687039 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c005d60 con 0x7feb500bfe80 2023-07-27T14:41:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 -- 172.21.15.115:0/2191687039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 msgr2=0x7feb500c0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 --2- 172.21.15.115:0/2191687039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb500c0260 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 rx=0x7feb500842a0 tx=0x7feb4c009060).stop 2023-07-27T14:41:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 -- 172.21.15.115:0/2191687039 shutdown_connections 2023-07-27T14:41:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 --2- 172.21.15.115:0/2191687039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb500c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 --2- 172.21.15.115:0/2191687039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb500c0260 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 --2- 172.21.15.115:0/2191687039 >> v2:172.21.15.159:3300/0 conn(0x7feb5006a6e0 0x7feb500c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 -- 172.21.15.115:0/2191687039 >> 172.21.15.115:0/2191687039 conn(0x7feb5006a300 msgr2=0x7feb500cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:07.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 -- 172.21.15.115:0/2191687039 shutdown_connections 2023-07-27T14:41:07.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.847+0000 7feb5719d700 1 -- 172.21.15.115:0/2191687039 wait complete. 2023-07-27T14:41:07.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.848+0000 7feb5719d700 1 Processor -- start 2023-07-27T14:41:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.848+0000 7feb5719d700 1 -- start start 2023-07-27T14:41:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.849+0000 7feb5719d700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb5006a6e0 0x7feb50098660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.849+0000 7feb5719d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb501670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.849+0000 7feb5719d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb501654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.849+0000 7feb5719d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb50166c20 con 0x7feb500bfe80 2023-07-27T14:41:07.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.849+0000 7feb5719d700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb500a8190 con 0x7feb5006a6e0 2023-07-27T14:41:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.849+0000 7feb5719d700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb50166010 con 0x7feb500a79f0 2023-07-27T14:41:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb501654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb501654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48860/0 (socket says 172.21.15.115:48860) 2023-07-27T14:41:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 -- 172.21.15.115:0/4219882899 learned_addr learned my addr 172.21.15.115:0/4219882899 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5599a700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb501670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5619b700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb5006a6e0 0x7feb50098660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 -- 172.21.15.115:0/4219882899 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 msgr2=0x7feb501670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb501670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 -- 172.21.15.115:0/4219882899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb5006a6e0 msgr2=0x7feb50098660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb5006a6e0 0x7feb50098660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 -- 172.21.15.115:0/4219882899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c009300 con 0x7feb500bfe80 2023-07-27T14:41:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb5699c700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb501654a0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 rx=0x7feb4800a380 tx=0x7feb48007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb467fc700 1 -- 172.21.15.115:0/4219882899 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48016470 con 0x7feb500bfe80 2023-07-27T14:41:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb467fc700 1 -- 172.21.15.115:0/4219882899 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb480165d0 con 0x7feb500bfe80 2023-07-27T14:41:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.850+0000 7feb467fc700 1 -- 172.21.15.115:0/4219882899 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48016950 con 0x7feb500bfe80 2023-07-27T14:41:07.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.851+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb501662f0 con 0x7feb500bfe80 2023-07-27T14:41:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.851+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb501668b0 con 0x7feb500bfe80 2023-07-27T14:41:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.852+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb50166dd0 con 0x7feb500bfe80 2023-07-27T14:41:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.852+0000 7feb467fc700 1 -- 172.21.15.115:0/4219882899 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7feb4800d440 con 0x7feb500bfe80 2023-07-27T14:41:07.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.854+0000 7feb467fc700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb3405fe20 0x7feb340622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.854+0000 7feb467fc700 1 -- 172.21.15.115:0/4219882899 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7feb4807c700 con 0x7feb500bfe80 2023-07-27T14:41:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.854+0000 7feb5619b700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb3405fe20 0x7feb340622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.854+0000 7feb5619b700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb3405fe20 0x7feb340622e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7feb4c00b3c0 tx=0x7feb4c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:07.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:07.858+0000 7feb467fc700 1 -- 172.21.15.115:0/4219882899 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb50166dd0 con 0x7feb500bfe80 2023-07-27T14:41:08.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.071+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feb50166dd0 con 0x7feb500bfe80 2023-07-27T14:41:08.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.071+0000 7feb467fc700 1 -- 172.21.15.115:0/4219882899 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v121) v1 ==== 53+0+73 (secure 0 0 0) 0x7feb50166dd0 con 0x7feb500bfe80 2023-07-27T14:41:08.130 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:41:08.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb3405fe20 msgr2=0x7feb340622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:08.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb3405fe20 0x7feb340622e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7feb4c00b3c0 tx=0x7feb4c016000).stop 2023-07-27T14:41:08.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 msgr2=0x7feb501654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:08.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb501654a0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 rx=0x7feb4800a380 tx=0x7feb48007900).stop 2023-07-27T14:41:08.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 shutdown_connections 2023-07-27T14:41:08.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7feb3405fe20 0x7feb340622e0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:08.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb500bfe80 0x7feb501654a0 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:08.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb5006a6e0 0x7feb50098660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:08.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 --2- 172.21.15.115:0/4219882899 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feb500a79f0 0x7feb501670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:08.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 >> 172.21.15.115:0/4219882899 conn(0x7feb5006a300 msgr2=0x7feb500caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:08.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 shutdown_connections 2023-07-27T14:41:08.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:08.073+0000 7feb5719d700 1 -- 172.21.15.115:0/4219882899 wait complete. 2023-07-27T14:41:08.145 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:41:08.146 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:41:08.146 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-07-27T14:41:08.146 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-27T14:41:08.147 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-27T14:41:08.147 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:41:08.147 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:41:08.147 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:41:08.148 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:41:08.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:08.148 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-07-27T14:41:08.195 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:41:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:41:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:41:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-07-27T14:41:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:08.197 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:41:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-07-27T14:41:08.197 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:41:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-07-27T14:41:08.198 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:41:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:08.198 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:41:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:41:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41133sec preferred_lft 41133sec 2023-07-27T14:41:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-07-27T14:41:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:08.199 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:41:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:41:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::90f2:f1ff:fece:1a80/64 scope link 2023-07-27T14:41:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:08.200 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:41:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether d6:fa:81:3d:9f:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-27T14:41:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::d4fa:81ff:fe3d:9f39/64 scope link 2023-07-27T14:41:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:08.200 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:41:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b6:03:99:21:a8:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-27T14:41:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b403:99ff:fe21:a8ea/64 scope link 2023-07-27T14:41:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:08.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:08.203 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:41:08.270 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-07-27T14:41:08.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:08.273 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-07-27T14:41:08.321 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-07-27T14:41:08.322 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:41:08.322 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:41:08.322 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:41:08.322 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:41:08.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:08.323 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-07-27T14:41:08.324 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-07-27T14:41:08.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:41:08.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:41:08.325 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:41:08.325 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-07-27T14:41:08.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:08.495 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-07-27T14:41:08.542 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-27T14:41:08.542 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-27T14:41:08.543 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-27T14:41:08.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:08.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-07-27T14:41:08.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:08.616 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-07-27T14:41:08.662 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:41:08.663 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:41:08.799 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:41:08.800 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:41:08.826 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:41:08.826 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:41:08.830 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:41:08.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:08.831 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-27T14:41:08.902 DEBUG:teuthology.orchestra.run.smithi159:> ceph fs ls 2023-07-27T14:41:09.076 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.018+0000 7fcdb63ff700 1 Processor -- start 2023-07-27T14:41:09.076 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.019+0000 7fcdb63ff700 1 -- start start 2023-07-27T14:41:09.077 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.020+0000 7fcdb63ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcdb0154490 0x7fcdb00bb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:09.077 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.020+0000 7fcdb63ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0068de0 0x7fcdb0154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:09.078 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.020+0000 7fcdb63ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb00c1a30 con 0x7fcdb0154d60 2023-07-27T14:41:09.078 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.020+0000 7fcdb63ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb0065a90 con 0x7fcdb0154490 2023-07-27T14:41:09.078 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.020+0000 7fcdb63ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00bbcc0 con 0x7fcdb0068de0 2023-07-27T14:41:09.078 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.020+0000 7fcdb499c700 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fcdb0154d60 0x7fcdb0153720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:52932/0 (socket says 172.21.15.159:52932) 2023-07-27T14:41:09.078 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.020+0000 7fcdb499c700 1 -- 172.21.15.159:0/2628541131 learned_addr learned my addr 172.21.15.159:0/2628541131 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-07-27T14:41:09.078 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.020+0000 7fcdaf7fe700 1 --2- 172.21.15.159:0/2628541131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0068de0 0x7fcdb0154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:09.079 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaffff700 1 --2- 172.21.15.159:0/2628541131 >> v2:172.21.15.115:3300/0 conn(0x7fcdb0154490 0x7fcdb00bb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:09.080 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaeffd700 1 -- 172.21.15.159:0/2628541131 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302136252 0 0) 0x7fcdb00c1a30 con 0x7fcdb0154d60 2023-07-27T14:41:09.080 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaeffd700 1 -- 172.21.15.159:0/2628541131 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd980033f0 con 0x7fcdb0154d60 2023-07-27T14:41:09.080 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaf7fe700 1 -- 172.21.15.159:0/2628541131 >> v2:172.21.15.115:3300/0 conn(0x7fcdb0154490 msgr2=0x7fcdb00bb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:09.080 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaf7fe700 1 --2- 172.21.15.159:0/2628541131 >> v2:172.21.15.115:3300/0 conn(0x7fcdb0154490 0x7fcdb00bb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.080 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaf7fe700 1 -- 172.21.15.159:0/2628541131 >> v1:172.21.15.159:6789/0 conn(0x7fcdb0154d60 legacy=0x7fcdb0153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:09.080 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaf7fe700 1 -- 172.21.15.159:0/2628541131 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00692c0 con 0x7fcdb0068de0 2023-07-27T14:41:09.081 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaf7fe700 1 --2- 172.21.15.159:0/2628541131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0068de0 0x7fcdb0154870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fcda400a900 tx=0x7fcda400a200).ready entity=mon.2 client_cookie=d878dcb26be291a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:09.081 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaeffd700 1 -- 172.21.15.159:0/2628541131 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400c6b0 con 0x7fcdb0068de0 2023-07-27T14:41:09.081 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaeffd700 1 -- 172.21.15.159:0/2628541131 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda400c810 con 0x7fcdb0068de0 2023-07-27T14:41:09.081 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.021+0000 7fcdaeffd700 1 -- 172.21.15.159:0/2628541131 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400cb90 con 0x7fcdb0068de0 2023-07-27T14:41:09.081 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.022+0000 7fcdb63ff700 1 -- 172.21.15.159:0/2628541131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0068de0 msgr2=0x7fcdb0154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:09.081 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.022+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/2628541131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0068de0 0x7fcdb0154870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fcda400a900 tx=0x7fcda400a200).stop 2023-07-27T14:41:09.081 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.022+0000 7fcdb63ff700 1 -- 172.21.15.159:0/2628541131 shutdown_connections 2023-07-27T14:41:09.082 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.022+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/2628541131 >> v2:172.21.15.115:3300/0 conn(0x7fcdb0154490 0x7fcdb00bb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.082 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.022+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/2628541131 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0068de0 0x7fcdb0154870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.082 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.022+0000 7fcdb63ff700 1 -- 172.21.15.159:0/2628541131 >> 172.21.15.159:0/2628541131 conn(0x7fcdb0062ec0 msgr2=0x7fcdb00c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:09.082 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.022+0000 7fcdb63ff700 1 -- 172.21.15.159:0/2628541131 shutdown_connections 2023-07-27T14:41:09.082 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.022+0000 7fcdb63ff700 1 -- 172.21.15.159:0/2628541131 wait complete. 2023-07-27T14:41:09.084 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.023+0000 7fcdb63ff700 1 Processor -- start 2023-07-27T14:41:09.084 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.024+0000 7fcdb63ff700 1 -- start start 2023-07-27T14:41:09.084 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.024+0000 7fcdb63ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb0068de0 0x7fcdb014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:09.084 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.024+0000 7fcdb63ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb0154490 0x7fcdb00c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:09.084 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdb63ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0154d60 0x7fcdb00c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:09.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdb63ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00c3e80 con 0x7fcdb0068de0 2023-07-27T14:41:09.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdb63ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb014fdd0 con 0x7fcdb0154490 2023-07-27T14:41:09.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdb63ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0150950 con 0x7fcdb0154d60 2023-07-27T14:41:09.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb0154490 0x7fcdb00c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:09.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb0154490 0x7fcdb00c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56260/0 (socket says 172.21.15.159:56260) 2023-07-27T14:41:09.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 -- 172.21.15.159:0/1366011822 learned_addr learned my addr 172.21.15.159:0/1366011822 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-07-27T14:41:09.085 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdb499c700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0154d60 0x7fcdb00c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:09.086 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaffff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb0068de0 0x7fcdb014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:09.086 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 -- 172.21.15.159:0/1366011822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0154d60 msgr2=0x7fcdb00c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:09.086 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0154d60 0x7fcdb00c3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.086 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 -- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb0068de0 msgr2=0x7fcdb014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:09.086 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb0068de0 0x7fcdb014f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 -- 172.21.15.159:0/1366011822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda400a440 con 0x7fcdb0154490 2023-07-27T14:41:09.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaffff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb0068de0 0x7fcdb014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:09.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.025+0000 7fcdaf7fe700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb0154490 0x7fcdb00c34a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fcda400a300 tx=0x7fcda400a200).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:09.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.026+0000 7fcd97fff700 1 -- 172.21.15.159:0/1366011822 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4000d10 con 0x7fcdb0154490 2023-07-27T14:41:09.087 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.026+0000 7fcd97fff700 1 -- 172.21.15.159:0/1366011822 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda400cb90 con 0x7fcdb0154490 2023-07-27T14:41:09.088 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.026+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb0150de0 con 0x7fcdb0154490 2023-07-27T14:41:09.088 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.026+0000 7fcd97fff700 1 -- 172.21.15.159:0/1366011822 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4023680 con 0x7fcdb0154490 2023-07-27T14:41:09.088 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.026+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb0150300 con 0x7fcdb0154490 2023-07-27T14:41:09.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.027+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb005f0c0 con 0x7fcdb0154490 2023-07-27T14:41:09.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.028+0000 7fcd97fff700 1 -- 172.21.15.159:0/1366011822 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fcda400e040 con 0x7fcdb0154490 2023-07-27T14:41:09.090 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.028+0000 7fcd97fff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9c05fe20 0x7fcd9c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:09.091 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.029+0000 7fcd97fff700 1 -- 172.21.15.159:0/1366011822 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fcda407ca50 con 0x7fcdb0154490 2023-07-27T14:41:09.091 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.029+0000 7fcdaffff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9c05fe20 0x7fcd9c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:09.091 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.029+0000 7fcdaffff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9c05fe20 0x7fcd9c0622e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fcda0006d80 tx=0x7fcda0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:09.092 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.033+0000 7fcd97fff700 1 -- 172.21.15.159:0/1366011822 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcda404ce10 con 0x7fcdb0154490 2023-07-27T14:41:09.302 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.244+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcdb00652e0 con 0x7fcdb0154490 2023-07-27T14:41:09.302 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.244+0000 7fcd97fff700 1 -- 172.21.15.159:0/1366011822 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v121) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcda4028070 con 0x7fcdb0154490 2023-07-27T14:41:09.302 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-27T14:41:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9c05fe20 msgr2=0x7fcd9c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:09.306 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9c05fe20 0x7fcd9c0622e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fcda0006d80 tx=0x7fcda0008040).stop 2023-07-27T14:41:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb0154490 msgr2=0x7fcdb00c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb0154490 0x7fcdb00c34a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fcda400a300 tx=0x7fcda400a200).stop 2023-07-27T14:41:09.307 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 shutdown_connections 2023-07-27T14:41:09.308 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fcd9c05fe20 0x7fcd9c0622e0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.308 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcdb0154d60 0x7fcdb00c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.308 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdb0068de0 0x7fcdb014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.308 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 --2- 172.21.15.159:0/1366011822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdb0154490 0x7fcdb00c34a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:09.309 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 >> 172.21.15.159:0/1366011822 conn(0x7fcdb0062ec0 msgr2=0x7fcdb00c2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:09.309 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 shutdown_connections 2023-07-27T14:41:09.309 INFO:teuthology.orchestra.run.smithi159.stderr:2023-07-27T14:41:09.247+0000 7fcdb63ff700 1 -- 172.21.15.159:0/1366011822 wait complete. 2023-07-27T14:41:09.319 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-27T14:41:09.319 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-27T14:41:09.319 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-07-27T14:41:09.320 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-27T14:41:09.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-27T14:41:09.321 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-27T14:41:09.321 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-27T14:41:09.322 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-27T14:41:09.322 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:41:09.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:09.324 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-07-27T14:41:09.371 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-27T14:41:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-27T14:41:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-07-27T14:41:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-07-27T14:41:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:09.372 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:41:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-07-27T14:41:09.373 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:41:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-07-27T14:41:09.373 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-27T14:41:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:09.374 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-27T14:41:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-27T14:41:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41127sec preferred_lft 41127sec 2023-07-27T14:41:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-07-27T14:41:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:09.375 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-27T14:41:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff 2023-07-27T14:41:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-27T14:41:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::64f8:66ff:fe74:d0b6/64 scope link 2023-07-27T14:41:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:09.375 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:41:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether a6:a7:d5:ad:30:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-27T14:41:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::a4a7:d5ff:fead:304c/64 scope link 2023-07-27T14:41:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:09.376 INFO:teuthology.orchestra.run.smithi159.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-27T14:41:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether f2:d2:f2:06:70:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-27T14:41:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::f0d2:f2ff:fe06:7040/64 scope link 2023-07-27T14:41:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-07-27T14:41:09.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:09.378 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-27T14:41:09.445 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-07-27T14:41:09.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:09.450 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-07-27T14:41:09.502 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-07-27T14:41:09.502 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-27T14:41:09.502 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-27T14:41:09.502 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-27T14:41:09.502 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-27T14:41:09.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:09.503 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-07-27T14:41:09.503 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-07-27T14:41:09.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-27T14:41:09.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-27T14:41:09.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-27T14:41:09.505 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-07-27T14:41:09.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:09.677 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-07-27T14:41:09.723 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-27T14:41:09.724 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-27T14:41:09.724 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-27T14:41:09.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:09.725 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-07-27T14:41:09.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:09.837 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-07-27T14:41:09.883 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-07-27T14:41:09.884 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:41:10.021 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:41:10.022 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:41:10.048 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-07-27T14:41:10.048 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-07-27T14:41:10.052 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-27T14:41:10.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-27T14:41:10.052 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-27T14:41:10.123 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-27T14:41:10.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.267+0000 7f3442dff700 1 Processor -- start 2023-07-27T14:41:10.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.267+0000 7f3442dff700 1 -- start start 2023-07-27T14:41:10.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f3442dff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f343c14ae00 0x7f343c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:10.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f3442dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f343c063260 0x7f343c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:10.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f3442dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c1553f0 con 0x7f343c14b1e0 2023-07-27T14:41:10.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f3442dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c157a50 con 0x7f343c063260 2023-07-27T14:41:10.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f3442dff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c157d10 con 0x7f343c14ae00 2023-07-27T14:41:10.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f344139c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f343c063260 0x7f343c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f343bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f343c14b1e0 0x7f343c062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36278/0 (socket says 172.21.15.115:36278) 2023-07-27T14:41:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f343bfff700 1 -- 172.21.15.115:0/4177055716 learned_addr learned my addr 172.21.15.115:0/4177055716 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f344139c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f343c063260 0x7f343c0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48862/0 (socket says 172.21.15.115:48862) 2023-07-27T14:41:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.269+0000 7f3440b9b700 1 --2- 172.21.15.115:0/4177055716 >> v2:172.21.15.159:3300/0 conn(0x7f343c14ae00 0x7f343c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.270+0000 7f344139c700 1 -- 172.21.15.115:0/4177055716 >> v2:172.21.15.159:3300/0 conn(0x7f343c14ae00 msgr2=0x7f343c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:10.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.270+0000 7f344139c700 1 --2- 172.21.15.115:0/4177055716 >> v2:172.21.15.159:3300/0 conn(0x7f343c14ae00 0x7f343c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.270+0000 7f344139c700 1 -- 172.21.15.115:0/4177055716 >> v1:172.21.15.115:6789/0 conn(0x7f343c14b1e0 legacy=0x7f343c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.270+0000 7f344139c700 1 -- 172.21.15.115:0/4177055716 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c157ff0 con 0x7f343c063260 2023-07-27T14:41:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.270+0000 7f344139c700 1 --2- 172.21.15.115:0/4177055716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c0a98c0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 rx=0x7f343c0caaf0 tx=0x7f3434009780).ready entity=mon.0 client_cookie=7509591f9d50a1e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.270+0000 7f343b7fe700 1 -- 172.21.15.115:0/4177055716 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400e070 con 0x7f343c063260 2023-07-27T14:41:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.270+0000 7f343b7fe700 1 -- 172.21.15.115:0/4177055716 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343400bc30 con 0x7f343c063260 2023-07-27T14:41:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.270+0000 7f343b7fe700 1 -- 172.21.15.115:0/4177055716 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434012410 con 0x7f343c063260 2023-07-27T14:41:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.271+0000 7f3442dff700 1 -- 172.21.15.115:0/4177055716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 msgr2=0x7f343c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:10.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.271+0000 7f3442dff700 1 --2- 172.21.15.115:0/4177055716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c0a98c0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 rx=0x7f343c0caaf0 tx=0x7f3434009780).stop 2023-07-27T14:41:10.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.271+0000 7f3442dff700 1 -- 172.21.15.115:0/4177055716 shutdown_connections 2023-07-27T14:41:10.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.271+0000 7f3442dff700 1 --2- 172.21.15.115:0/4177055716 >> v2:172.21.15.159:3300/0 conn(0x7f343c14ae00 0x7f343c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:10.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.271+0000 7f3442dff700 1 --2- 172.21.15.115:0/4177055716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c0a98c0 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:10.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.271+0000 7f3442dff700 1 -- 172.21.15.115:0/4177055716 >> 172.21.15.115:0/4177055716 conn(0x7f343c05e940 msgr2=0x7f343c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:10.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.271+0000 7f3442dff700 1 -- 172.21.15.115:0/4177055716 shutdown_connections 2023-07-27T14:41:10.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.271+0000 7f3442dff700 1 -- 172.21.15.115:0/4177055716 wait complete. 2023-07-27T14:41:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.272+0000 7f3442dff700 1 Processor -- start 2023-07-27T14:41:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.272+0000 7f3442dff700 1 -- start start 2023-07-27T14:41:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.273+0000 7f3442dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.273+0000 7f3442dff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f343c14ae00 0x7f343c14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:10.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.273+0000 7f3442dff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f343c14b1e0 0x7f343c1678c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.273+0000 7f3442dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0adef0 con 0x7f343c063260 2023-07-27T14:41:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.273+0000 7f3442dff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c14cb90 con 0x7f343c14ae00 2023-07-27T14:41:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.273+0000 7f3442dff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c14ce70 con 0x7f343c14b1e0 2023-07-27T14:41:10.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c14bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48874/0 (socket says 172.21.15.115:48874) 2023-07-27T14:41:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 -- 172.21.15.115:0/2011813457 learned_addr learned my addr 172.21.15.115:0/2011813457 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f343bfff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f343c14ae00 0x7f343c14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f344139c700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f343c14b1e0 0x7f343c1678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 -- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f343c14b1e0 msgr2=0x7f343c1678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f343c14b1e0 0x7f343c1678c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:10.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 -- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f343c14ae00 msgr2=0x7f343c14c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f343c14ae00 0x7f343c14c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 -- 172.21.15.115:0/2011813457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3434009a20 con 0x7f343c063260 2023-07-27T14:41:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f343bfff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f343c14ae00 0x7f343c14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3440b9b700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c14bfe0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 rx=0x7f343000d890 tx=0x7f3430008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3438ff9700 1 -- 172.21.15.115:0/2011813457 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300125f0 con 0x7f343c063260 2023-07-27T14:41:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3438ff9700 1 -- 172.21.15.115:0/2011813457 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3430012750 con 0x7f343c063260 2023-07-27T14:41:10.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c14d150 con 0x7f343c063260 2023-07-27T14:41:10.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.274+0000 7f3438ff9700 1 -- 172.21.15.115:0/2011813457 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430012ad0 con 0x7f343c063260 2023-07-27T14:41:10.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.275+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c156b00 con 0x7f343c063260 2023-07-27T14:41:10.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.276+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c0ae200 con 0x7f343c063260 2023-07-27T14:41:10.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.276+0000 7f3438ff9700 1 -- 172.21.15.115:0/2011813457 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f3430013480 con 0x7f343c063260 2023-07-27T14:41:10.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.277+0000 7f3438ff9700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f342005fe20 0x7f34200622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:10.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.277+0000 7f3438ff9700 1 -- 172.21.15.115:0/2011813457 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f343007b7c0 con 0x7f343c063260 2023-07-27T14:41:10.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.278+0000 7f343bfff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f342005fe20 0x7f34200622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:10.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.278+0000 7f343bfff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f342005fe20 0x7f34200622e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f343c155810 tx=0x7f3428009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:10.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.281+0000 7f3438ff9700 1 -- 172.21.15.115:0/2011813457 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f343004bc50 con 0x7f343c063260 2023-07-27T14:41:10.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:10.498+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f343c06c470 con 0x7f343c063260 2023-07-27T14:41:11.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.435+0000 7f3438ff9700 1 -- 172.21.15.115:0/2011813457 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v122) v1 ==== 136+0+0 (secure 0 0 0) 0x7f343004f270 con 0x7f343c063260 2023-07-27T14:41:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f342005fe20 msgr2=0x7f34200622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f342005fe20 0x7f34200622e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f343c155810 tx=0x7f3428009040).stop 2023-07-27T14:41:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 msgr2=0x7f343c14bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c14bfe0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 rx=0x7f343000d890 tx=0x7f3430008040).stop 2023-07-27T14:41:11.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 shutdown_connections 2023-07-27T14:41:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f342005fe20 0x7f34200622e0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f343c14b1e0 0x7f343c1678c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f343c063260 0x7f343c14bfe0 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 --2- 172.21.15.115:0/2011813457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f343c14ae00 0x7f343c14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 >> 172.21.15.115:0/2011813457 conn(0x7f343c05e940 msgr2=0x7f343c153710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 shutdown_connections 2023-07-27T14:41:11.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.438+0000 7f3442dff700 1 -- 172.21.15.115:0/2011813457 wait complete. 2023-07-27T14:41:11.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-27T14:41:11.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.653+0000 7f80823ff700 1 Processor -- start 2023-07-27T14:41:11.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.653+0000 7f80823ff700 1 -- start start 2023-07-27T14:41:11.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.654+0000 7f80823ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f807c14e470 0x7f807c14e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:11.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.654+0000 7f80823ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f807c062a30 0x7f807c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:11.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.654+0000 7f80823ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c0a4840 con 0x7f807c155110 2023-07-27T14:41:11.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.654+0000 7f80823ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807c0a6ed0 con 0x7f807c062a30 2023-07-27T14:41:11.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.654+0000 7f80823ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807c0a71b0 con 0x7f807c14e470 2023-07-27T14:41:11.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f807b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f807c155110 0x7f807c062320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36292/0 (socket says 172.21.15.115:36292) 2023-07-27T14:41:11.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f807b7fe700 1 -- 172.21.15.115:0/3850462052 learned_addr learned my addr 172.21.15.115:0/3850462052 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:11.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f808099c700 1 --2- 172.21.15.115:0/3850462052 >> v2:172.21.15.115:3300/0 conn(0x7f807c062a30 0x7f807c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:11.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f807bfff700 1 --2- 172.21.15.115:0/3850462052 >> v2:172.21.15.159:3300/0 conn(0x7f807c14e470 0x7f807c14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:11.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f807affd700 1 -- 172.21.15.115:0/3850462052 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331468703 0 0) 0x7f807c0a4840 con 0x7f807c155110 2023-07-27T14:41:11.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f808099c700 1 -- 172.21.15.115:0/3850462052 >> v2:172.21.15.159:3300/0 conn(0x7f807c14e470 msgr2=0x7f807c14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:11.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f808099c700 1 --2- 172.21.15.115:0/3850462052 >> v2:172.21.15.159:3300/0 conn(0x7f807c14e470 0x7f807c14e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f808099c700 1 -- 172.21.15.115:0/3850462052 >> v1:172.21.15.115:6789/0 conn(0x7f807c155110 legacy=0x7f807c062320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:11.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f808099c700 1 -- 172.21.15.115:0/3850462052 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c0a4a90 con 0x7f807c062a30 2023-07-27T14:41:11.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f807bfff700 1 --2- 172.21.15.115:0/3850462052 >> v2:172.21.15.159:3300/0 conn(0x7f807c14e470 0x7f807c14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:11.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.655+0000 7f808099c700 1 --2- 172.21.15.115:0/3850462052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c0a5290 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 rx=0x7f807c0c5790 tx=0x7f8074009780).ready entity=mon.0 client_cookie=978aabcfc403811d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:11.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f807affd700 1 -- 172.21.15.115:0/3850462052 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400e070 con 0x7f807c062a30 2023-07-27T14:41:11.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f807affd700 1 -- 172.21.15.115:0/3850462052 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400bc30 con 0x7f807c062a30 2023-07-27T14:41:11.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f807affd700 1 -- 172.21.15.115:0/3850462052 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074012410 con 0x7f807c062a30 2023-07-27T14:41:11.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f80823ff700 1 -- 172.21.15.115:0/3850462052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 msgr2=0x7f807c0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:11.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f80823ff700 1 --2- 172.21.15.115:0/3850462052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c0a5290 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 rx=0x7f807c0c5790 tx=0x7f8074009780).stop 2023-07-27T14:41:11.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f80823ff700 1 -- 172.21.15.115:0/3850462052 shutdown_connections 2023-07-27T14:41:11.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f80823ff700 1 --2- 172.21.15.115:0/3850462052 >> v2:172.21.15.159:3300/0 conn(0x7f807c14e470 0x7f807c14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f80823ff700 1 --2- 172.21.15.115:0/3850462052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c0a5290 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f80823ff700 1 -- 172.21.15.115:0/3850462052 >> 172.21.15.115:0/3850462052 conn(0x7f807c0c7990 msgr2=0x7f807c0c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:11.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f80823ff700 1 -- 172.21.15.115:0/3850462052 shutdown_connections 2023-07-27T14:41:11.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.656+0000 7f80823ff700 1 -- 172.21.15.115:0/3850462052 wait complete. 2023-07-27T14:41:11.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.658+0000 7f80823ff700 1 Processor -- start 2023-07-27T14:41:11.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.658+0000 7f80823ff700 1 -- start start 2023-07-27T14:41:11.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f80823ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:11.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f80823ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f807c14e470 0x7f807c14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:11.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f80823ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f807c155110 0x7f807c0c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f80823ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c153970 con 0x7f807c062a30 2023-07-27T14:41:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f80823ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c14f160 con 0x7f807c14e470 2023-07-27T14:41:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f80823ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c14c4e0 con 0x7f807c155110 2023-07-27T14:41:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48884/0 (socket says 172.21.15.115:48884) 2023-07-27T14:41:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 -- 172.21.15.115:0/3914292047 learned_addr learned my addr 172.21.15.115:0/3914292047 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:11.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 -- 172.21.15.115:0/3914292047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f807c155110 msgr2=0x7f807c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f807c155110 0x7f807c0c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 -- 172.21.15.115:0/3914292047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f807c14e470 msgr2=0x7f807c14bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f807c14e470 0x7f807c14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 -- 172.21.15.115:0/3914292047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8074009a20 con 0x7f807c062a30 2023-07-27T14:41:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.660+0000 7f807bfff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c150230 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 rx=0x7f806c00d860 tx=0x7f806c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.661+0000 7f8063fff700 1 -- 172.21.15.115:0/3914292047 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011590 con 0x7f807c062a30 2023-07-27T14:41:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.661+0000 7f8063fff700 1 -- 172.21.15.115:0/3914292047 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c0116f0 con 0x7f807c062a30 2023-07-27T14:41:11.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.661+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c0c02d0 con 0x7f807c062a30 2023-07-27T14:41:11.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.661+0000 7f8063fff700 1 -- 172.21.15.115:0/3914292047 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c011a70 con 0x7f807c062a30 2023-07-27T14:41:11.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.661+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c0c0b70 con 0x7f807c062a30 2023-07-27T14:41:11.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.662+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c0c11c0 con 0x7f807c062a30 2023-07-27T14:41:11.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.663+0000 7f8063fff700 1 -- 172.21.15.115:0/3914292047 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f806c012420 con 0x7f807c062a30 2023-07-27T14:41:11.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.663+0000 7f8063fff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f806805fe20 0x7f80680622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:11.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.664+0000 7f8063fff700 1 -- 172.21.15.115:0/3914292047 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f806c07b240 con 0x7f807c062a30 2023-07-27T14:41:11.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.664+0000 7f807b7fe700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f806805fe20 0x7f80680622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:11.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.664+0000 7f807b7fe700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f806805fe20 0x7f80680622e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f807c14cb60 tx=0x7f8070007a50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:11.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.668+0000 7f8063fff700 1 -- 172.21.15.115:0/3914292047 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f806c04b6d0 con 0x7f807c062a30 2023-07-27T14:41:11.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.866+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f807c1549d0 con 0x7f806805fe20 2023-07-27T14:41:11.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.867+0000 7f8063fff700 1 -- 172.21.15.115:0/3914292047 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f807c1549d0 con 0x7f806805fe20 2023-07-27T14:41:11.925 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-07-27T14:41:11.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-07-27T14:41:11.925 INFO:teuthology.orchestra.run.smithi115.stdout: "name": "cephfs" 2023-07-27T14:41:11.926 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:41:11.926 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-07-27T14:41:11.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.869+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f806805fe20 msgr2=0x7f80680622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:11.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.869+0000 7f80823ff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f806805fe20 0x7f80680622e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f807c14cb60 tx=0x7f8070007a50).stop 2023-07-27T14:41:11.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.869+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 msgr2=0x7f807c150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:11.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.869+0000 7f80823ff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c150230 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 rx=0x7f806c00d860 tx=0x7f806c008040).stop 2023-07-27T14:41:11.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.870+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 shutdown_connections 2023-07-27T14:41:11.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.870+0000 7f80823ff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f806805fe20 0x7f80680622e0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.870+0000 7f80823ff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f807c155110 0x7f807c0c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:11.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.870+0000 7f80823ff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f807c062a30 0x7f807c150230 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:11.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.870+0000 7f80823ff700 1 --2- 172.21.15.115:0/3914292047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f807c14e470 0x7f807c14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:11.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.870+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 >> 172.21.15.115:0/3914292047 conn(0x7f807c0c7990 msgr2=0x7f807c0c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:11.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.870+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 shutdown_connections 2023-07-27T14:41:11.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:11.870+0000 7f80823ff700 1 -- 172.21.15.115:0/3914292047 wait complete. 2023-07-27T14:41:11.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-27T14:41:12.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.077+0000 7fc9c85ff700 1 Processor -- start 2023-07-27T14:41:12.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.078+0000 7fc9c85ff700 1 -- start start 2023-07-27T14:41:12.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c85ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9c01509b0 0x7fc9c00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c85ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c0150d90 0x7fc9c0154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c85ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00c0ea0 con 0x7fc9c00c3100 2023-07-27T14:41:12.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c85ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c0068e10 con 0x7fc9c01509b0 2023-07-27T14:41:12.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c85ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0155190 con 0x7fc9c0150d90 2023-07-27T14:41:12.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c639b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9c01509b0 0x7fc9c00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c639b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc9c01509b0 0x7fc9c00c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48890/0 (socket says 172.21.15.115:48890) 2023-07-27T14:41:12.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c639b700 1 -- 172.21.15.115:0/603896294 learned_addr learned my addr 172.21.15.115:0/603896294 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:12.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.079+0000 7fc9c5b9a700 1 --2- 172.21.15.115:0/603896294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c0150d90 0x7fc9c0154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.080+0000 7fc9c639b700 1 -- 172.21.15.115:0/603896294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c0150d90 msgr2=0x7fc9c0154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:12.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.080+0000 7fc9c639b700 1 --2- 172.21.15.115:0/603896294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c0150d90 0x7fc9c0154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.080+0000 7fc9c639b700 1 -- 172.21.15.115:0/603896294 >> v1:172.21.15.159:6789/0 conn(0x7fc9c00c3100 legacy=0x7fc9c00c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.080+0000 7fc9c639b700 1 -- 172.21.15.115:0/603896294 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0155470 con 0x7fc9c01509b0 2023-07-27T14:41:12.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.080+0000 7fc9c639b700 1 --2- 172.21.15.115:0/603896294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c01509b0 0x7fc9c00c58d0 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 rx=0x7fc9bc006fd0 tx=0x7fc9bc0090f0).ready entity=mon.0 client_cookie=6d75057805a1b535 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:12.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.080+0000 7fc9c5399700 1 -- 172.21.15.115:0/603896294 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00b580 con 0x7fc9c01509b0 2023-07-27T14:41:12.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.080+0000 7fc9c5399700 1 -- 172.21.15.115:0/603896294 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc00b6e0 con 0x7fc9c01509b0 2023-07-27T14:41:12.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.080+0000 7fc9c5399700 1 -- 172.21.15.115:0/603896294 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00ba60 con 0x7fc9c01509b0 2023-07-27T14:41:12.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.081+0000 7fc9c85ff700 1 -- 172.21.15.115:0/603896294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c01509b0 msgr2=0x7fc9c00c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.081+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/603896294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c01509b0 0x7fc9c00c58d0 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 rx=0x7fc9bc006fd0 tx=0x7fc9bc0090f0).stop 2023-07-27T14:41:12.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.081+0000 7fc9c85ff700 1 -- 172.21.15.115:0/603896294 shutdown_connections 2023-07-27T14:41:12.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.081+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/603896294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c01509b0 0x7fc9c00c58d0 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.081+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/603896294 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c0150d90 0x7fc9c0154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.081+0000 7fc9c85ff700 1 -- 172.21.15.115:0/603896294 >> 172.21.15.115:0/603896294 conn(0x7fc9c0062320 msgr2=0x7fc9c0062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:12.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.081+0000 7fc9c85ff700 1 -- 172.21.15.115:0/603896294 shutdown_connections 2023-07-27T14:41:12.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.081+0000 7fc9c85ff700 1 -- 172.21.15.115:0/603896294 wait complete. 2023-07-27T14:41:12.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.082+0000 7fc9c85ff700 1 Processor -- start 2023-07-27T14:41:12.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.082+0000 7fc9c85ff700 1 -- start start 2023-07-27T14:41:12.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.083+0000 7fc9c85ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c00c3100 0x7fc9c014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.083+0000 7fc9c85ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c01509b0 0x7fc9c014b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.083+0000 7fc9c85ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0150d90 0x7fc9c00ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.083+0000 7fc9c85ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c014ed80 con 0x7fc9c0150d90 2023-07-27T14:41:12.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.083+0000 7fc9c85ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00a6420 con 0x7fc9c00c3100 2023-07-27T14:41:12.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.083+0000 7fc9c85ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00aa490 con 0x7fc9c01509b0 2023-07-27T14:41:12.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0150d90 0x7fc9c00ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0150d90 0x7fc9c00ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48904/0 (socket says 172.21.15.115:48904) 2023-07-27T14:41:12.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 -- 172.21.15.115:0/2768204923 learned_addr learned my addr 172.21.15.115:0/2768204923 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:12.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c5b9a700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c01509b0 0x7fc9c014b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c639b700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c00c3100 0x7fc9c014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 -- 172.21.15.115:0/2768204923 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c01509b0 msgr2=0x7fc9c014b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c01509b0 0x7fc9c014b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 -- 172.21.15.115:0/2768204923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c00c3100 msgr2=0x7fc9c014e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c00c3100 0x7fc9c014e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 -- 172.21.15.115:0/2768204923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc009370 con 0x7fc9c0150d90 2023-07-27T14:41:12.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9c6b9c700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0150d90 0x7fc9c00ac2b0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 rx=0x7fc9b8002230 tx=0x7fc9b80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:12.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.084+0000 7fc9b67fc700 1 -- 172.21.15.115:0/2768204923 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800e4a0 con 0x7fc9c0150d90 2023-07-27T14:41:12.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.085+0000 7fc9b67fc700 1 -- 172.21.15.115:0/2768204923 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800e600 con 0x7fc9c0150d90 2023-07-27T14:41:12.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.085+0000 7fc9b67fc700 1 -- 172.21.15.115:0/2768204923 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800e980 con 0x7fc9c0150d90 2023-07-27T14:41:12.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.085+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c014bcf0 con 0x7fc9c0150d90 2023-07-27T14:41:12.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.085+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c014f250 con 0x7fc9c0150d90 2023-07-27T14:41:12.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.086+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c006c470 con 0x7fc9c0150d90 2023-07-27T14:41:12.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.086+0000 7fc9b67fc700 1 -- 172.21.15.115:0/2768204923 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7fc9b8019030 con 0x7fc9c0150d90 2023-07-27T14:41:12.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.087+0000 7fc9b67fc700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc9a405fe20 0x7fc9a40622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.087+0000 7fc9b67fc700 1 -- 172.21.15.115:0/2768204923 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fc9b807aac0 con 0x7fc9c0150d90 2023-07-27T14:41:12.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.088+0000 7fc9c639b700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc9a405fe20 0x7fc9a40622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.088+0000 7fc9c639b700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc9a405fe20 0x7fc9a40622e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fc9bc009fd0 tx=0x7fc9bc017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:12.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.092+0000 7fc9b67fc700 1 -- 172.21.15.115:0/2768204923 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc9b80488f0 con 0x7fc9c0150d90 2023-07-27T14:41:12.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.259+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc9c00655d0 con 0x7fc9c0150d90 2023-07-27T14:41:12.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.259+0000 7fc9b67fc700 1 -- 172.21.15.115:0/2768204923 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc9b804e980 con 0x7fc9c0150d90 2023-07-27T14:41:12.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc9a405fe20 msgr2=0x7fc9a40622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc9a405fe20 0x7fc9a40622e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fc9bc009fd0 tx=0x7fc9bc017000).stop 2023-07-27T14:41:12.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0150d90 msgr2=0x7fc9c00ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0150d90 0x7fc9c00ac2b0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 rx=0x7fc9b8002230 tx=0x7fc9b80015e0).stop 2023-07-27T14:41:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 shutdown_connections 2023-07-27T14:41:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fc9a405fe20 0x7fc9a40622e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9c0150d90 0x7fc9c00ac2b0 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9c00c3100 0x7fc9c014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 --2- 172.21.15.115:0/2768204923 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc9c01509b0 0x7fc9c014b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 >> 172.21.15.115:0/2768204923 conn(0x7fc9c0062320 msgr2=0x7fc9c00c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:12.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 shutdown_connections 2023-07-27T14:41:12.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.261+0000 7fc9c85ff700 1 -- 172.21.15.115:0/2768204923 wait complete. 2023-07-27T14:41:12.336 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000904001 --mode=777 2023-07-27T14:41:12.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.474+0000 7efeb03ff700 1 Processor -- start 2023-07-27T14:41:12.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.474+0000 7efeb03ff700 1 -- start start 2023-07-27T14:41:12.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.475+0000 7efeb03ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efea814ae00 0x7efea8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.475+0000 7efeb03ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea81553f0 con 0x7efea814b1e0 2023-07-27T14:41:12.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.475+0000 7efeb03ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea8157a50 con 0x7efea8063260 2023-07-27T14:41:12.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.475+0000 7efeb03ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea8157d10 con 0x7efea814ae00 2023-07-27T14:41:12.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.475+0000 7efeae19b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efea814ae00 0x7efea8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.475+0000 7efead99a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efea814b1e0 0x7efea8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36300/0 (socket says 172.21.15.115:36300) 2023-07-27T14:41:12.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.475+0000 7efead99a700 1 -- 172.21.15.115:0/4035711686 learned_addr learned my addr 172.21.15.115:0/4035711686 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:12.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.476+0000 7efeae19b700 1 -- 172.21.15.115:0/4035711686 >> v1:172.21.15.159:6789/0 conn(0x7efea8063260 legacy=0x7efea80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:12.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.476+0000 7efeae19b700 1 -- 172.21.15.115:0/4035711686 >> v1:172.21.15.115:6789/0 conn(0x7efea814b1e0 legacy=0x7efea8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.476+0000 7efeae19b700 1 -- 172.21.15.115:0/4035711686 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea8157ff0 con 0x7efea814ae00 2023-07-27T14:41:12.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.476+0000 7efead199700 1 -- 172.21.15.115:0/4035711686 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912812668 0 0) 0x7efea81553f0 con 0x7efea814b1e0 2023-07-27T14:41:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.476+0000 7efeae19b700 1 --2- 172.21.15.115:0/4035711686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814ae00 0x7efea8154f00 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 rx=0x7efea4009760 tx=0x7efea4009060).ready entity=mon.0 client_cookie=845f5dbf908c6b2e server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.476+0000 7efead199700 1 -- 172.21.15.115:0/4035711686 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400b520 con 0x7efea814ae00 2023-07-27T14:41:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.476+0000 7efead199700 1 -- 172.21.15.115:0/4035711686 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400b680 con 0x7efea814ae00 2023-07-27T14:41:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.476+0000 7efead199700 1 -- 172.21.15.115:0/4035711686 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400ba00 con 0x7efea814ae00 2023-07-27T14:41:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.477+0000 7efeb03ff700 1 -- 172.21.15.115:0/4035711686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814ae00 msgr2=0x7efea8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.477+0000 7efeb03ff700 1 --2- 172.21.15.115:0/4035711686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814ae00 0x7efea8154f00 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 rx=0x7efea4009760 tx=0x7efea4009060).stop 2023-07-27T14:41:12.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.477+0000 7efeb03ff700 1 -- 172.21.15.115:0/4035711686 shutdown_connections 2023-07-27T14:41:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.477+0000 7efeb03ff700 1 --2- 172.21.15.115:0/4035711686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814ae00 0x7efea8154f00 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.477+0000 7efeb03ff700 1 -- 172.21.15.115:0/4035711686 >> 172.21.15.115:0/4035711686 conn(0x7efea805e940 msgr2=0x7efea80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.477+0000 7efeb03ff700 1 -- 172.21.15.115:0/4035711686 shutdown_connections 2023-07-27T14:41:12.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.477+0000 7efeb03ff700 1 -- 172.21.15.115:0/4035711686 wait complete. 2023-07-27T14:41:12.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.478+0000 7efeb03ff700 1 Processor -- start 2023-07-27T14:41:12.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.478+0000 7efeb03ff700 1 -- start start 2023-07-27T14:41:12.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.479+0000 7efeb03ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea8063260 0x7efea8156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.479+0000 7efeb03ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea814ae00 0x7efea8149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.479+0000 7efeb03ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814b1e0 0x7efea80c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.479+0000 7efeb03ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8157440 con 0x7efea814b1e0 2023-07-27T14:41:12.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.479+0000 7efeb03ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8149ef0 con 0x7efea814ae00 2023-07-27T14:41:12.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.479+0000 7efeb03ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea80c3de0 con 0x7efea8063260 2023-07-27T14:41:12.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814b1e0 0x7efea80c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814b1e0 0x7efea80c2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48936/0 (socket says 172.21.15.115:48936) 2023-07-27T14:41:12.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 -- 172.21.15.115:0/1067414300 learned_addr learned my addr 172.21.15.115:0/1067414300 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:12.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efead99a700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea814ae00 0x7efea8149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae19b700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea8063260 0x7efea8156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 -- 172.21.15.115:0/1067414300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea8063260 msgr2=0x7efea8156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea8063260 0x7efea8156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 -- 172.21.15.115:0/1067414300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea814ae00 msgr2=0x7efea8149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea814ae00 0x7efea8149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 -- 172.21.15.115:0/1067414300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40092a0 con 0x7efea814b1e0 2023-07-27T14:41:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeae99c700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814b1e0 0x7efea80c2a40 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 rx=0x7efea000b810 tx=0x7efea00092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efe9e7fc700 1 -- 172.21.15.115:0/1067414300 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0001500 con 0x7efea814b1e0 2023-07-27T14:41:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efe9e7fc700 1 -- 172.21.15.115:0/1067414300 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea00016a0 con 0x7efea814b1e0 2023-07-27T14:41:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea80c2f30 con 0x7efea814b1e0 2023-07-27T14:41:12.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.480+0000 7efe9e7fc700 1 -- 172.21.15.115:0/1067414300 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0001a60 con 0x7efea814b1e0 2023-07-27T14:41:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.481+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea80c34b0 con 0x7efea814b1e0 2023-07-27T14:41:12.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.481+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea806c470 con 0x7efea814b1e0 2023-07-27T14:41:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.482+0000 7efe9e7fc700 1 -- 172.21.15.115:0/1067414300 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7efea0018030 con 0x7efea814b1e0 2023-07-27T14:41:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.483+0000 7efe9e7fc700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe8c05fe20 0x7efe8c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.483+0000 7efe9e7fc700 1 -- 172.21.15.115:0/1067414300 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7efea007afa0 con 0x7efea814b1e0 2023-07-27T14:41:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.483+0000 7efeae19b700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe8c05fe20 0x7efe8c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:12.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.484+0000 7efeae19b700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe8c05fe20 0x7efe8c0622e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7efea400b2e0 tx=0x7efea4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:12.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.487+0000 7efe9e7fc700 1 -- 172.21.15.115:0/1067414300 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efea00478f0 con 0x7efea814b1e0 2023-07-27T14:41:12.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.688+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000904001", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7efea80c3f20 con 0x7efe8c05fe20 2023-07-27T14:41:12.753 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:12.695+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:12.753 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:12.695+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:12.753 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:12.695+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:12.753 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:12.695+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:12.753 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:12.695+0000 7fa7af9f9700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:12.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.729+0000 7efe9e7fc700 1 -- 172.21.15.115:0/1067414300 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7efea80c3f20 con 0x7efe8c05fe20 2023-07-27T14:41:12.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe8c05fe20 msgr2=0x7efe8c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe8c05fe20 0x7efe8c0622e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7efea400b2e0 tx=0x7efea4017000).stop 2023-07-27T14:41:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814b1e0 msgr2=0x7efea80c2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814b1e0 0x7efea80c2a40 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 rx=0x7efea000b810 tx=0x7efea00092d0).stop 2023-07-27T14:41:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 shutdown_connections 2023-07-27T14:41:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7efe8c05fe20 0x7efe8c0622e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea814b1e0 0x7efea80c2a40 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efea8063260 0x7efea8156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 --2- 172.21.15.115:0/1067414300 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efea814ae00 0x7efea8149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.731+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 >> 172.21.15.115:0/1067414300 conn(0x7efea805e940 msgr2=0x7efea814a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.732+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 shutdown_connections 2023-07-27T14:41:12.791 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.732+0000 7efeb03ff700 1 -- 172.21.15.115:0/1067414300 wait complete. 2023-07-27T14:41:12.807 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000904001 2023-07-27T14:41:12.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.940+0000 7f2fa8bff700 1 Processor -- start 2023-07-27T14:41:12.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.940+0000 7f2fa8bff700 1 -- start start 2023-07-27T14:41:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.941+0000 7f2fa8bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2fa4063260 0x7f2fa4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.941+0000 7f2fa8bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414b1e0 0x7f2fa40a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:12.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.941+0000 7f2fa8bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa41553f0 con 0x7f2fa414ae00 2023-07-27T14:41:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.941+0000 7f2fa8bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa4157a50 con 0x7f2fa4063260 2023-07-27T14:41:13.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.941+0000 7f2fa8bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4157d10 con 0x7f2fa414b1e0 2023-07-27T14:41:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.942+0000 7f2fa2d9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414b1e0 0x7f2fa40a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.942+0000 7f2fa1d9b700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2fa4063260 0x7f2fa4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.942+0000 7f2fa2d9d700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414b1e0 0x7f2fa40a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.115:41904/0 (socket says 172.21.15.115:41904) 2023-07-27T14:41:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.942+0000 7f2fa2d9d700 1 -- 172.21.15.115:0/859864290 learned_addr learned my addr 172.21.15.115:0/859864290 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.942+0000 7f2fa2d9d700 1 -- 172.21.15.115:0/859864290 >> v2:172.21.15.159:3300/0 conn(0x7f2fa4063260 msgr2=0x7f2fa4154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.942+0000 7f2fa2d9d700 1 --2- 172.21.15.115:0/859864290 >> v2:172.21.15.159:3300/0 conn(0x7f2fa4063260 0x7f2fa4154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.942+0000 7f2fa2d9d700 1 -- 172.21.15.115:0/859864290 >> v1:172.21.15.159:6789/0 conn(0x7f2fa414ae00 legacy=0x7f2fa4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.942+0000 7f2fa2d9d700 1 -- 172.21.15.115:0/859864290 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa4157ff0 con 0x7f2fa414b1e0 2023-07-27T14:41:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa2d9d700 1 --2- 172.21.15.115:0/859864290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414b1e0 0x7f2fa40a98c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f2f9c009f20 tx=0x7f2f9c009840).ready entity=mon.2 client_cookie=183d34d353b9da27 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa159a700 1 -- 172.21.15.115:0/859864290 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00e070 con 0x7f2fa414b1e0 2023-07-27T14:41:13.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa159a700 1 -- 172.21.15.115:0/859864290 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c00b9d0 con 0x7f2fa414b1e0 2023-07-27T14:41:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa159a700 1 -- 172.21.15.115:0/859864290 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00bd50 con 0x7f2fa414b1e0 2023-07-27T14:41:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa8bff700 1 -- 172.21.15.115:0/859864290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414b1e0 msgr2=0x7f2fa40a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/859864290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414b1e0 0x7f2fa40a98c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f2f9c009f20 tx=0x7f2f9c009840).stop 2023-07-27T14:41:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa8bff700 1 -- 172.21.15.115:0/859864290 shutdown_connections 2023-07-27T14:41:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/859864290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414b1e0 0x7f2fa40a98c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/859864290 >> v2:172.21.15.159:3300/0 conn(0x7f2fa4063260 0x7f2fa4154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.943+0000 7f2fa8bff700 1 -- 172.21.15.115:0/859864290 >> 172.21.15.115:0/859864290 conn(0x7f2fa405e940 msgr2=0x7f2fa40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:13.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.944+0000 7f2fa8bff700 1 -- 172.21.15.115:0/859864290 shutdown_connections 2023-07-27T14:41:13.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.944+0000 7f2fa8bff700 1 -- 172.21.15.115:0/859864290 wait complete. 2023-07-27T14:41:13.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.945+0000 7f2fa8bff700 1 Processor -- start 2023-07-27T14:41:13.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.945+0000 7f2fa8bff700 1 -- start start 2023-07-27T14:41:13.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.946+0000 7f2fa8bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fa4063260 0x7f2fa40b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.946+0000 7f2fa8bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414ae00 0x7f2fa40c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.946+0000 7f2fa8bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa414b1e0 0x7f2fa40aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.946+0000 7f2fa8bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa414aa20 con 0x7f2fa4063260 2023-07-27T14:41:13.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.946+0000 7f2fa8bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40ae930 con 0x7f2fa414b1e0 2023-07-27T14:41:13.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.946+0000 7f2fa8bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40b0c10 con 0x7f2fa414ae00 2023-07-27T14:41:13.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.946+0000 7f2fa259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fa4063260 0x7f2fa40b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa1d9b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414ae00 0x7f2fa40c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fa4063260 0x7f2fa40b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48966/0 (socket says 172.21.15.115:48966) 2023-07-27T14:41:13.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa259c700 1 -- 172.21.15.115:0/142988702 learned_addr learned my addr 172.21.15.115:0/142988702 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:13.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa2d9d700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa414b1e0 0x7f2fa40aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa259c700 1 -- 172.21.15.115:0/142988702 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414ae00 msgr2=0x7f2fa40c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa259c700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414ae00 0x7f2fa40c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa259c700 1 -- 172.21.15.115:0/142988702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa414b1e0 msgr2=0x7f2fa40aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa259c700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa414b1e0 0x7f2fa40aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa259c700 1 -- 172.21.15.115:0/142988702 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c009ae0 con 0x7f2fa4063260 2023-07-27T14:41:13.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa1d9b700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414ae00 0x7f2fa40c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:41:13.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa259c700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fa4063260 0x7f2fa40b0720 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 rx=0x7f2f9400c4c0 tx=0x7f2f94007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:13.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2f927fc700 1 -- 172.21.15.115:0/142988702 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400ce70 con 0x7f2fa4063260 2023-07-27T14:41:13.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2f927fc700 1 -- 172.21.15.115:0/142988702 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f94001e90 con 0x7f2fa4063260 2023-07-27T14:41:13.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa40a1d40 con 0x7f2fa4063260 2023-07-27T14:41:13.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.947+0000 7f2f927fc700 1 -- 172.21.15.115:0/142988702 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94007250 con 0x7f2fa4063260 2023-07-27T14:41:13.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.948+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa40ae2e0 con 0x7f2fa4063260 2023-07-27T14:41:13.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.949+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa40aec10 con 0x7f2fa4063260 2023-07-27T14:41:13.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.949+0000 7f2f927fc700 1 -- 172.21.15.115:0/142988702 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f2f94010070 con 0x7f2fa4063260 2023-07-27T14:41:13.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.951+0000 7f2f927fc700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f8405fe20 0x7f2f840622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.951+0000 7f2f927fc700 1 -- 172.21.15.115:0/142988702 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f2f9407acd0 con 0x7f2fa4063260 2023-07-27T14:41:13.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.951+0000 7f2fa1d9b700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f8405fe20 0x7f2f840622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.951+0000 7f2fa1d9b700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f8405fe20 0x7f2f840622e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f2fa4153a60 tx=0x7f2f98009060).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:13.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:12.955+0000 7f2f927fc700 1 -- 172.21.15.115:0/142988702 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f9404b1c0 con 0x7f2fa4063260 2023-07-27T14:41:13.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.156+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000904001", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fa406c470 con 0x7f2f8405fe20 2023-07-27T14:41:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.161+0000 7f2f927fc700 1 -- 172.21.15.115:0/142988702 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f2fa406c470 con 0x7f2f8405fe20 2023-07-27T14:41:13.220 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa 2023-07-27T14:41:13.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f8405fe20 msgr2=0x7f2f840622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f8405fe20 0x7f2f840622e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f2fa4153a60 tx=0x7f2f98009060).stop 2023-07-27T14:41:13.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fa4063260 msgr2=0x7f2fa40b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fa4063260 0x7f2fa40b0720 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 rx=0x7f2f9400c4c0 tx=0x7f2f94007e00).stop 2023-07-27T14:41:13.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 shutdown_connections 2023-07-27T14:41:13.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f2f8405fe20 0x7f2f840622e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fa414b1e0 0x7f2fa40aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fa4063260 0x7f2fa40b0720 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 --2- 172.21.15.115:0/142988702 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fa414ae00 0x7f2fa40c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.163+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 >> 172.21.15.115:0/142988702 conn(0x7f2fa405e940 msgr2=0x7f2fa40649f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:13.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.164+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 shutdown_connections 2023-07-27T14:41:13.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.164+0000 7f2fa8bff700 1 -- 172.21.15.115:0/142988702 wait complete. 2023-07-27T14:41:13.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000904001 2023-07-27T14:41:13.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.372+0000 7f09b67ff700 1 Processor -- start 2023-07-27T14:41:13.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.373+0000 7f09b67ff700 1 -- start start 2023-07-27T14:41:13.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09b67ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09b0153e00 0x7f09b00c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09b67ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f09b0064230 0x7f09b00656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09b67ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0066050 con 0x7f09b0065bc0 2023-07-27T14:41:13.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09b67ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b0062320 con 0x7f09b0153e00 2023-07-27T14:41:13.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09b67ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b0064a80 con 0x7f09b0064230 2023-07-27T14:41:13.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09affff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09b0153e00 0x7f09b00c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09affff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f09b0153e00 0x7f09b00c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48968/0 (socket says 172.21.15.115:48968) 2023-07-27T14:41:13.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09affff700 1 -- 172.21.15.115:0/4203476273 learned_addr learned my addr 172.21.15.115:0/4203476273 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:13.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09b4d9c700 1 --1- 172.21.15.115:0/4203476273 >> v1:172.21.15.115:6789/0 conn(0x7f09b0065bc0 0x7f09b0157a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36308/0 (socket says 172.21.15.115:36308) 2023-07-27T14:41:13.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09af7fe700 1 --2- 172.21.15.115:0/4203476273 >> v2:172.21.15.159:3300/0 conn(0x7f09b0064230 0x7f09b00656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09affff700 1 -- 172.21.15.115:0/4203476273 >> v2:172.21.15.159:3300/0 conn(0x7f09b0064230 msgr2=0x7f09b00656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:13.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09affff700 1 --2- 172.21.15.115:0/4203476273 >> v2:172.21.15.159:3300/0 conn(0x7f09b0064230 0x7f09b00656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09affff700 1 -- 172.21.15.115:0/4203476273 >> v1:172.21.15.115:6789/0 conn(0x7f09b0065bc0 legacy=0x7f09b0157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09affff700 1 -- 172.21.15.115:0/4203476273 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0064d60 con 0x7f09b0153e00 2023-07-27T14:41:13.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09aeffd700 1 -- 172.21.15.115:0/4203476273 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052599273 0 0) 0x7f09b0066050 con 0x7f09b0065bc0 2023-07-27T14:41:13.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.375+0000 7f09af7fe700 1 --2- 172.21.15.115:0/4203476273 >> v2:172.21.15.159:3300/0 conn(0x7f09b0064230 0x7f09b00656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:13.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09affff700 1 --2- 172.21.15.115:0/4203476273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0153e00 0x7f09b00c6b70 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 rx=0x7f09b00c3b80 tx=0x7f09a00090f0).ready entity=mon.0 client_cookie=70aeb335f8362b70 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:13.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09aeffd700 1 -- 172.21.15.115:0/4203476273 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000b600 con 0x7f09b0153e00 2023-07-27T14:41:13.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09aeffd700 1 -- 172.21.15.115:0/4203476273 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000b760 con 0x7f09b0153e00 2023-07-27T14:41:13.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09aeffd700 1 -- 172.21.15.115:0/4203476273 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000bae0 con 0x7f09b0153e00 2023-07-27T14:41:13.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09b67ff700 1 -- 172.21.15.115:0/4203476273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0153e00 msgr2=0x7f09b00c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09b67ff700 1 --2- 172.21.15.115:0/4203476273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0153e00 0x7f09b00c6b70 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 rx=0x7f09b00c3b80 tx=0x7f09a00090f0).stop 2023-07-27T14:41:13.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09b67ff700 1 -- 172.21.15.115:0/4203476273 shutdown_connections 2023-07-27T14:41:13.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09b67ff700 1 --2- 172.21.15.115:0/4203476273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0153e00 0x7f09b00c6b70 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09b67ff700 1 --2- 172.21.15.115:0/4203476273 >> v2:172.21.15.159:3300/0 conn(0x7f09b0064230 0x7f09b00656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09b67ff700 1 -- 172.21.15.115:0/4203476273 >> 172.21.15.115:0/4203476273 conn(0x7f09b00c7b90 msgr2=0x7f09b00c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:13.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.376+0000 7f09b67ff700 1 -- 172.21.15.115:0/4203476273 shutdown_connections 2023-07-27T14:41:13.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.377+0000 7f09b67ff700 1 -- 172.21.15.115:0/4203476273 wait complete. 2023-07-27T14:41:13.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.378+0000 7f09b67ff700 1 Processor -- start 2023-07-27T14:41:13.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.378+0000 7f09b67ff700 1 -- start start 2023-07-27T14:41:13.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09b67ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09b0064230 0x7f09b00a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09b67ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0065bc0 0x7f09b00a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09b67ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09b0153e00 0x7f09b0164a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09b67ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00a9ba0 con 0x7f09b0065bc0 2023-07-27T14:41:13.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09b67ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0163eb0 con 0x7f09b0153e00 2023-07-27T14:41:13.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09b67ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0164190 con 0x7f09b0064230 2023-07-27T14:41:13.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0065bc0 0x7f09b00a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0065bc0 0x7f09b00a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48970/0 (socket says 172.21.15.115:48970) 2023-07-27T14:41:13.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09af7fe700 1 -- 172.21.15.115:0/2861578833 learned_addr learned my addr 172.21.15.115:0/2861578833 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:13.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.379+0000 7f09affff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09b0064230 0x7f09b00a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09b4d9c700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09b0153e00 0x7f09b0164a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09af7fe700 1 -- 172.21.15.115:0/2861578833 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09b0064230 msgr2=0x7f09b00a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09af7fe700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09b0064230 0x7f09b00a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09af7fe700 1 -- 172.21.15.115:0/2861578833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09b0153e00 msgr2=0x7f09b0164a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09af7fe700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09b0153e00 0x7f09b0164a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09af7fe700 1 -- 172.21.15.115:0/2861578833 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009370 con 0x7f09b0065bc0 2023-07-27T14:41:13.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09af7fe700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0065bc0 0x7f09b00a72e0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 rx=0x7f09a400d860 tx=0x7f09a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:13.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f0997fff700 1 -- 172.21.15.115:0/2861578833 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a400f520 con 0x7f09b0065bc0 2023-07-27T14:41:13.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f0997fff700 1 -- 172.21.15.115:0/2861578833 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a400f680 con 0x7f09b0065bc0 2023-07-27T14:41:13.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b0164470 con 0x7f09b0065bc0 2023-07-27T14:41:13.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f0997fff700 1 -- 172.21.15.115:0/2861578833 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a400fa00 con 0x7f09b0065bc0 2023-07-27T14:41:13.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.380+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b00a91c0 con 0x7f09b0065bc0 2023-07-27T14:41:13.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.382+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b006c470 con 0x7f09b0065bc0 2023-07-27T14:41:13.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.382+0000 7f0997fff700 1 -- 172.21.15.115:0/2861578833 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 77602+0+0 (secure 0 0 0) 0x7f09a401a030 con 0x7f09b0065bc0 2023-07-27T14:41:13.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.383+0000 7f0997fff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f099c05fe20 0x7f099c0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:13.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.383+0000 7f0997fff700 1 -- 172.21.15.115:0/2861578833 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f09a407aff0 con 0x7f09b0065bc0 2023-07-27T14:41:13.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.383+0000 7f09affff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f099c05fe20 0x7f099c0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:13.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.384+0000 7f09affff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f099c05fe20 0x7f099c0622e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f09a0009fd0 tx=0x7f09a0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:13.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.387+0000 7f0997fff700 1 -- 172.21.15.115:0/2861578833 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09a404b4e0 con 0x7f09b0065bc0 2023-07-27T14:41:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.589+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000904001", "target": ["mon-mgr", ""]}) v1 -- 0x7f09b00c4390 con 0x7f099c05fe20 2023-07-27T14:41:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.593+0000 7f0997fff700 1 -- 172.21.15.115:0/2861578833 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f09b00c4390 con 0x7f099c05fe20 2023-07-27T14:41:13.651 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa 2023-07-27T14:41:13.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.595+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f099c05fe20 msgr2=0x7f099c0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.595+0000 7f09b67ff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f099c05fe20 0x7f099c0622e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f09a0009fd0 tx=0x7f09a0017000).stop 2023-07-27T14:41:13.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.595+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0065bc0 msgr2=0x7f09b00a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:13.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.595+0000 7f09b67ff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0065bc0 0x7f09b00a72e0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 rx=0x7f09a400d860 tx=0x7f09a4008040).stop 2023-07-27T14:41:13.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.596+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 shutdown_connections 2023-07-27T14:41:13.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.596+0000 7f09b67ff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f099c05fe20 0x7f099c0622e0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.596+0000 7f09b67ff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09b0153e00 0x7f09b0164a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.596+0000 7f09b67ff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09b0064230 0x7f09b00a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.596+0000 7f09b67ff700 1 --2- 172.21.15.115:0/2861578833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09b0065bc0 0x7f09b00a72e0 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:13.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.596+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 >> 172.21.15.115:0/2861578833 conn(0x7f09b00c7b90 msgr2=0x7f09b00bc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:13.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.596+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 shutdown_connections 2023-07-27T14:41:13.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:13.596+0000 7f09b67ff700 1 -- 172.21.15.115:0/2861578833 wait complete. 2023-07-27T14:41:13.671 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000904001 with 16 files each 1MB size under directory volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa 2023-07-27T14:41:13.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:13.672 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:13.744 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:13.745 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:13.745 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173665 s, 60.4 MB/s 2023-07-27T14:41:13.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:13.746 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:13.815 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:13.816 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:13.816 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220568 s, 47.5 MB/s 2023-07-27T14:41:13.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:13.817 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:13.877 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:13.878 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:13.878 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143624 s, 73.0 MB/s 2023-07-27T14:41:13.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:13.879 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176685 s, 59.3 MB/s 2023-07-27T14:41:13.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:13.944 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.004 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.004 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.005 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139645 s, 75.1 MB/s 2023-07-27T14:41:14.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.006 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.066 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.067 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.067 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145943 s, 71.8 MB/s 2023-07-27T14:41:14.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.068 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.131 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.132 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.132 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166368 s, 63.0 MB/s 2023-07-27T14:41:14.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.134 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.194 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.195 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.195 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145365 s, 72.1 MB/s 2023-07-27T14:41:14.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.196 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.257 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.257 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.257 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146209 s, 71.7 MB/s 2023-07-27T14:41:14.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.259 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.320 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.320 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.320 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147257 s, 71.2 MB/s 2023-07-27T14:41:14.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.322 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.385 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.386 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.386 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016518 s, 63.5 MB/s 2023-07-27T14:41:14.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.387 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017758 s, 59.0 MB/s 2023-07-27T14:41:14.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.453 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170912 s, 61.4 MB/s 2023-07-27T14:41:14.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.518 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.579 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.579 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.579 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143499 s, 73.1 MB/s 2023-07-27T14:41:14.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.581 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.641 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.641 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.641 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132562 s, 79.1 MB/s 2023-07-27T14:41:14.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:14.642 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000904001/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-07-27T14:41:14.703 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-07-27T14:41:14.704 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-07-27T14:41:14.704 INFO:teuthology.orchestra.run.smithi115.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154021 s, 68.1 MB/s 2023-07-27T14:41:14.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000904001 snapshot_0000000000736501 2023-07-27T14:41:14.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.840+0000 7f949fbff700 1 Processor -- start 2023-07-27T14:41:14.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.840+0000 7f949fbff700 1 -- start start 2023-07-27T14:41:14.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.841+0000 7f949fbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94980c6b70 0x7f94980656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:14.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.841+0000 7f949fbff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9498065bc0 0x7f9498062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:14.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.841+0000 7f949fbff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498066050 con 0x7f9498153e00 2023-07-27T14:41:14.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.841+0000 7f949fbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9498062320 con 0x7f94980c6b70 2023-07-27T14:41:14.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.841+0000 7f949fbff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9498064a80 con 0x7f9498065bc0 2023-07-27T14:41:14.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949d19a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94980c6b70 0x7f94980656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:14.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949d19a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94980c6b70 0x7f94980656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56268/0 (socket says 172.21.15.115:56268) 2023-07-27T14:41:14.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949d19a700 1 -- 172.21.15.115:0/2831017469 learned_addr learned my addr 172.21.15.115:0/2831017469 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:14.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949e19c700 1 --2- 172.21.15.115:0/2831017469 >> v2:172.21.15.159:3300/0 conn(0x7f9498065bc0 0x7f9498062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:14.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949d19a700 1 -- 172.21.15.115:0/2831017469 >> v2:172.21.15.159:3300/0 conn(0x7f9498065bc0 msgr2=0x7f9498062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:14.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949d19a700 1 --2- 172.21.15.115:0/2831017469 >> v2:172.21.15.159:3300/0 conn(0x7f9498065bc0 0x7f9498062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:14.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949d19a700 1 -- 172.21.15.115:0/2831017469 >> v1:172.21.15.159:6789/0 conn(0x7f9498153e00 legacy=0x7f9498064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:14.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949d19a700 1 -- 172.21.15.115:0/2831017469 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498064d60 con 0x7f94980c6b70 2023-07-27T14:41:14.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.842+0000 7f949d19a700 1 --2- 172.21.15.115:0/2831017469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94980c6b70 0x7f94980656d0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 rx=0x7f949805e5b0 tx=0x7f94880090f0).ready entity=mon.0 client_cookie=3283df6915720677 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:14.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949c999700 1 -- 172.21.15.115:0/2831017469 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800b5a0 con 0x7f94980c6b70 2023-07-27T14:41:14.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949c999700 1 -- 172.21.15.115:0/2831017469 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800b700 con 0x7f94980c6b70 2023-07-27T14:41:14.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949c999700 1 -- 172.21.15.115:0/2831017469 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800ba80 con 0x7f94980c6b70 2023-07-27T14:41:14.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949fbff700 1 -- 172.21.15.115:0/2831017469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94980c6b70 msgr2=0x7f94980656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:14.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949fbff700 1 --2- 172.21.15.115:0/2831017469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94980c6b70 0x7f94980656d0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 rx=0x7f949805e5b0 tx=0x7f94880090f0).stop 2023-07-27T14:41:14.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949fbff700 1 -- 172.21.15.115:0/2831017469 shutdown_connections 2023-07-27T14:41:14.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949fbff700 1 --2- 172.21.15.115:0/2831017469 >> v2:172.21.15.159:3300/0 conn(0x7f9498065bc0 0x7f9498062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:14.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949fbff700 1 --2- 172.21.15.115:0/2831017469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94980c6b70 0x7f94980656d0 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:14.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949fbff700 1 -- 172.21.15.115:0/2831017469 >> 172.21.15.115:0/2831017469 conn(0x7f94980c7b90 msgr2=0x7f94980c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:14.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949fbff700 1 -- 172.21.15.115:0/2831017469 shutdown_connections 2023-07-27T14:41:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.843+0000 7f949fbff700 1 -- 172.21.15.115:0/2831017469 wait complete. 2023-07-27T14:41:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.845+0000 7f949fbff700 1 Processor -- start 2023-07-27T14:41:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.845+0000 7f949fbff700 1 -- start start 2023-07-27T14:41:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949fbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9498065bc0 0x7f9498063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949fbff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94980c6b70 0x7f9498156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949fbff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9498153e00 0x7f9498156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949fbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94980a6bf0 con 0x7f9498065bc0 2023-07-27T14:41:14.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949fbff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94980a7490 con 0x7f94980c6b70 2023-07-27T14:41:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949fbff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94981570a0 con 0x7f9498153e00 2023-07-27T14:41:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9498065bc0 0x7f9498063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d99b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9498065bc0 0x7f9498063620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56280/0 (socket says 172.21.15.115:56280) 2023-07-27T14:41:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d99b700 1 -- 172.21.15.115:0/2630749037 learned_addr learned my addr 172.21.15.115:0/2630749037 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d19a700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94980c6b70 0x7f9498156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949e19c700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9498153e00 0x7f9498156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d99b700 1 -- 172.21.15.115:0/2630749037 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9498153e00 msgr2=0x7f9498156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:14.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d99b700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9498153e00 0x7f9498156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:14.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d99b700 1 -- 172.21.15.115:0/2630749037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94980c6b70 msgr2=0x7f9498156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d99b700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94980c6b70 0x7f9498156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.846+0000 7f949d99b700 1 -- 172.21.15.115:0/2630749037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488009370 con 0x7f9498065bc0 2023-07-27T14:41:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.847+0000 7f949d99b700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9498065bc0 0x7f9498063620 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 rx=0x7f949400b460 tx=0x7f9494006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.847+0000 7f948dffb700 1 -- 172.21.15.115:0/2630749037 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400be60 con 0x7f9498065bc0 2023-07-27T14:41:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.847+0000 7f948dffb700 1 -- 172.21.15.115:0/2630749037 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494012410 con 0x7f9498065bc0 2023-07-27T14:41:14.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.847+0000 7f948dffb700 1 -- 172.21.15.115:0/2630749037 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940127b0 con 0x7f9498065bc0 2023-07-27T14:41:14.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.847+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94980a6e40 con 0x7f9498065bc0 2023-07-27T14:41:14.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.847+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9498168960 con 0x7f9498065bc0 2023-07-27T14:41:14.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.848+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9498065660 con 0x7f9498065bc0 2023-07-27T14:41:14.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.849+0000 7f948dffb700 1 -- 172.21.15.115:0/2630749037 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 40) v1 ==== 77642+0+0 (secure 0 0 0) 0x7f949400f030 con 0x7f9498065bc0 2023-07-27T14:41:14.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.850+0000 7f948dffb700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f947c05fe70 0x7f947c062330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:14.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.850+0000 7f948dffb700 1 -- 172.21.15.115:0/2630749037 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f949407b190 con 0x7f9498065bc0 2023-07-27T14:41:14.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.850+0000 7f949d19a700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f947c05fe70 0x7f947c062330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:14.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.850+0000 7f949d19a700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f947c05fe70 0x7f947c062330 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f9488009130 tx=0x7f9488015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:14.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:14.854+0000 7f948dffb700 1 -- 172.21.15.115:0/2630749037 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f949404b630 con 0x7f9498065bc0 2023-07-27T14:41:15.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.055+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000904001", "snap_name": "snapshot_0000000000736501", "target": ["mon-mgr", ""]}) v1 -- 0x7f949806c470 con 0x7f947c05fe70 2023-07-27T14:41:15.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.075+0000 7f948dffb700 1 -- 172.21.15.115:0/2630749037 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f949806c470 con 0x7f947c05fe70 2023-07-27T14:41:15.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f947c05fe70 msgr2=0x7f947c062330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f947c05fe70 0x7f947c062330 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f9488009130 tx=0x7f9488015000).stop 2023-07-27T14:41:15.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9498065bc0 msgr2=0x7f9498063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9498065bc0 0x7f9498063620 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 rx=0x7f949400b460 tx=0x7f9494006f20).stop 2023-07-27T14:41:15.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 shutdown_connections 2023-07-27T14:41:15.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f947c05fe70 0x7f947c062330 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9498153e00 0x7f9498156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9498065bc0 0x7f9498063620 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 --2- 172.21.15.115:0/2630749037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94980c6b70 0x7f9498156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.078+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 >> 172.21.15.115:0/2630749037 conn(0x7f94980c7b90 msgr2=0x7f9498062770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:15.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.079+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 shutdown_connections 2023-07-27T14:41:15.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.079+0000 7f949fbff700 1 -- 172.21.15.115:0/2630749037 wait complete. 2023-07-27T14:41:15.154 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000904001 --retain-snapshots 2023-07-27T14:41:15.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.287+0000 7ff84afff700 1 Processor -- start 2023-07-27T14:41:15.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.287+0000 7ff84afff700 1 -- start start 2023-07-27T14:41:15.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.288+0000 7ff84afff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff844063260 0x7ff844154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.288+0000 7ff84afff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84414b1e0 0x7ff8440a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.288+0000 7ff84afff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8441553f0 con 0x7ff84414ae00 2023-07-27T14:41:15.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.288+0000 7ff84afff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff844157a50 con 0x7ff844063260 2023-07-27T14:41:15.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.288+0000 7ff84afff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff844157d10 con 0x7ff84414b1e0 2023-07-27T14:41:15.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff848d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff84414ae00 0x7ff844062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44424/0 (socket says 172.21.15.115:44424) 2023-07-27T14:41:15.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff848d9b700 1 -- 172.21.15.115:0/2438828643 learned_addr learned my addr 172.21.15.115:0/2438828643 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:15.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff84959c700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84414b1e0 0x7ff8440a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff843fff700 1 --2- 172.21.15.115:0/2438828643 >> v2:172.21.15.159:3300/0 conn(0x7ff844063260 0x7ff844154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048027485 0 0) 0x7ff8441553f0 con 0x7ff84414ae00 2023-07-27T14:41:15.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8340033f0 con 0x7ff84414ae00 2023-07-27T14:41:15.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1027550991 0 0) 0x7ff8340033f0 con 0x7ff84414ae00 2023-07-27T14:41:15.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84414b1e0 msgr2=0x7ff8440a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:15.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84414b1e0 0x7ff8440a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 >> v2:172.21.15.159:3300/0 conn(0x7ff844063260 msgr2=0x7ff844154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:15.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 --2- 172.21.15.115:0/2438828643 >> v2:172.21.15.159:3300/0 conn(0x7ff844063260 0x7ff844154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844157ff0 con 0x7ff84414ae00 2023-07-27T14:41:15.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7ff838001470 con 0x7ff84414ae00 2023-07-27T14:41:15.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.289+0000 7ff843fff700 1 --2- 172.21.15.115:0/2438828643 >> v2:172.21.15.159:3300/0 conn(0x7ff844063260 0x7ff844154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-07-27T14:41:15.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 >> v1:172.21.15.115:6789/0 conn(0x7ff84414ae00 legacy=0x7ff844062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff8437fe700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8340038e0 0x7ff834003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff8437fe700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84414b1e0 0x7ff834004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff8437fe700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff834004b80 0x7ff834005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844157a50 con 0x7ff834004b80 2023-07-27T14:41:15.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844157d10 con 0x7ff8340038e0 2023-07-27T14:41:15.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83400b8e0 con 0x7ff84414b1e0 2023-07-27T14:41:15.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff84959c700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff834004b80 0x7ff834005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff848d9b700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8340038e0 0x7ff834003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff843fff700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84414b1e0 0x7ff834004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff84959c700 1 -- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84414b1e0 msgr2=0x7ff834004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:15.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff84959c700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84414b1e0 0x7ff834004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff84959c700 1 -- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8340038e0 msgr2=0x7ff834003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:15.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff84959c700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8340038e0 0x7ff834003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff84959c700 1 -- 172.21.15.115:0/2438828643 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340033f0 con 0x7ff834004b80 2023-07-27T14:41:15.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.290+0000 7ff84959c700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff834004b80 0x7ff834005000 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 rx=0x7ff84414b5e0 tx=0x7ff83c00b040).ready entity=mon.0 client_cookie=9755b8f39c6e77a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:15.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c009ac0 con 0x7ff834004b80 2023-07-27T14:41:15.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00f040 con 0x7ff834004b80 2023-07-27T14:41:15.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff8437fe700 1 -- 172.21.15.115:0/2438828643 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00ec70 con 0x7ff834004b80 2023-07-27T14:41:15.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff84afff700 1 -- 172.21.15.115:0/2438828643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff834004b80 msgr2=0x7ff834005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff84afff700 1 --2- 172.21.15.115:0/2438828643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff834004b80 0x7ff834005000 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 rx=0x7ff84414b5e0 tx=0x7ff83c00b040).stop 2023-07-27T14:41:15.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff84959c700 1 -- 172.21.15.115:0/2438828643 reap_dead start 2023-07-27T14:41:15.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff84afff700 1 -- 172.21.15.115:0/2438828643 shutdown_connections 2023-07-27T14:41:15.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff84afff700 1 -- 172.21.15.115:0/2438828643 >> 172.21.15.115:0/2438828643 conn(0x7ff84405e940 msgr2=0x7ff8440cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:15.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff84afff700 1 -- 172.21.15.115:0/2438828643 shutdown_connections 2023-07-27T14:41:15.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.291+0000 7ff84afff700 1 -- 172.21.15.115:0/2438828643 wait complete. 2023-07-27T14:41:15.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.293+0000 7ff84afff700 1 Processor -- start 2023-07-27T14:41:15.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.293+0000 7ff84afff700 1 -- start start 2023-07-27T14:41:15.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84afff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834004b80 0x7ff84413e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84afff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84413e910 0x7ff8440c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84afff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff844163970 0x7ff8440c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84afff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440c36a0 con 0x7ff844163970 2023-07-27T14:41:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84afff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440c2a90 con 0x7ff834004b80 2023-07-27T14:41:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84afff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440c2d70 con 0x7ff84413e910 2023-07-27T14:41:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84959c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff844163970 0x7ff8440c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84959c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff844163970 0x7ff8440c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56304/0 (socket says 172.21.15.115:56304) 2023-07-27T14:41:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84959c700 1 -- 172.21.15.115:0/560132731 learned_addr learned my addr 172.21.15.115:0/560132731 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff848d9b700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834004b80 0x7ff84413e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff843fff700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84413e910 0x7ff8440c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84959c700 1 -- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84413e910 msgr2=0x7ff8440c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84959c700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84413e910 0x7ff8440c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84959c700 1 -- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834004b80 msgr2=0x7ff84413e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.294+0000 7ff84959c700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834004b80 0x7ff84413e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.295+0000 7ff84959c700 1 -- 172.21.15.115:0/560132731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440c3050 con 0x7ff844163970 2023-07-27T14:41:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.295+0000 7ff848d9b700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834004b80 0x7ff84413e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.295+0000 7ff84959c700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff844163970 0x7ff8440c4f70 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 rx=0x7ff8340044c0 tx=0x7ff83c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.295+0000 7ff840ff9700 1 -- 172.21.15.115:0/560132731 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c013c20 con 0x7ff844163970 2023-07-27T14:41:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.295+0000 7ff840ff9700 1 -- 172.21.15.115:0/560132731 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c013d80 con 0x7ff844163970 2023-07-27T14:41:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.295+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8440c3330 con 0x7ff844163970 2023-07-27T14:41:15.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.295+0000 7ff840ff9700 1 -- 172.21.15.115:0/560132731 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c01c640 con 0x7ff844163970 2023-07-27T14:41:15.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.295+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8440a9a80 con 0x7ff844163970 2023-07-27T14:41:15.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.296+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84406c470 con 0x7ff844163970 2023-07-27T14:41:15.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.297+0000 7ff840ff9700 1 -- 172.21.15.115:0/560132731 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 40) v1 ==== 77642+0+0 (secure 0 0 0) 0x7ff83c02c070 con 0x7ff844163970 2023-07-27T14:41:15.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.298+0000 7ff840ff9700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff82805fe70 0x7ff828062330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.298+0000 7ff840ff9700 1 -- 172.21.15.115:0/560132731 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7ff83c07d1a0 con 0x7ff844163970 2023-07-27T14:41:15.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.298+0000 7ff848d9b700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff82805fe70 0x7ff828062330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.299+0000 7ff848d9b700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff82805fe70 0x7ff828062330 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7ff8380015a0 tx=0x7ff838009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:15.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.302+0000 7ff840ff9700 1 -- 172.21.15.115:0/560132731 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff83c04d530 con 0x7ff844163970 2023-07-27T14:41:15.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.502+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000904001", "retain_snapshots": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff8440c34c0 con 0x7ff82805fe70 2023-07-27T14:41:15.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.531+0000 7ff840ff9700 1 -- 172.21.15.115:0/560132731 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff8440c34c0 con 0x7ff82805fe70 2023-07-27T14:41:15.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff82805fe70 msgr2=0x7ff828062330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff82805fe70 0x7ff828062330 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7ff8380015a0 tx=0x7ff838009040).stop 2023-07-27T14:41:15.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff844163970 msgr2=0x7ff8440c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.592 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff844163970 0x7ff8440c4f70 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 rx=0x7ff8340044c0 tx=0x7ff83c01a000).stop 2023-07-27T14:41:15.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 shutdown_connections 2023-07-27T14:41:15.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7ff82805fe70 0x7ff828062330 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff844163970 0x7ff8440c4f70 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff834004b80 0x7ff84413e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 --2- 172.21.15.115:0/560132731 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84413e910 0x7ff8440c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 >> 172.21.15.115:0/560132731 conn(0x7ff84405e940 msgr2=0x7ff84414a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:15.593 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 shutdown_connections 2023-07-27T14:41:15.594 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.534+0000 7ff84afff700 1 -- 172.21.15.115:0/560132731 wait complete. 2023-07-27T14:41:15.597 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.539+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.597 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.539+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.597 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.539+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.597 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.539+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.597 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.539+0000 7fa785916700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvolume_0000000000904001 snapshot_0000000000736501 clone_0000000000297312 2023-07-27T14:41:15.613 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.555+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.614 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.555+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.614 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.555+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.614 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.555+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.614 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:15.555+0000 7fa786117700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.767+0000 7f0322bff700 1 Processor -- start 2023-07-27T14:41:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.767+0000 7f0322bff700 1 -- start start 2023-07-27T14:41:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f0322bff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f031c0c3810 0x7f031c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f0322bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031c0c0ea0 con 0x7f031c0c58d0 2023-07-27T14:41:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f0322bff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031c068e10 con 0x7f031c1509b0 2023-07-27T14:41:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f0322bff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031c151280 con 0x7f031c0c3810 2023-07-27T14:41:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f031bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f031c0c58d0 0x7f031c0c3100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44428/0 (socket says 172.21.15.115:44428) 2023-07-27T14:41:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f031bfff700 1 -- 172.21.15.115:0/880418364 learned_addr learned my addr 172.21.15.115:0/880418364 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:15.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f032119c700 1 --2- 172.21.15.115:0/880418364 >> v2:172.21.15.159:3300/0 conn(0x7f031c0c3810 0x7f031c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642933996 0 0) 0x7f031c0c0ea0 con 0x7f031c0c58d0 2023-07-27T14:41:15.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.769+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f030c0033f0 con 0x7f031c0c58d0 2023-07-27T14:41:15.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518472186 0 0) 0x7f030c0033f0 con 0x7f031c0c58d0 2023-07-27T14:41:15.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 >> v2:172.21.15.159:3300/0 conn(0x7f031c0c3810 msgr2=0x7f031c150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:15.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 --2- 172.21.15.115:0/880418364 >> v2:172.21.15.159:3300/0 conn(0x7f031c0c3810 0x7f031c150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 >> v1:172.21.15.159:6789/0 conn(0x7f031c1509b0 legacy=0x7f031c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c155190 con 0x7f031c0c58d0 2023-07-27T14:41:15.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f0308001470 con 0x7f031c0c58d0 2023-07-27T14:41:15.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 >> v1:172.21.15.115:6789/0 conn(0x7f031c0c58d0 legacy=0x7f031c0c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0038e0 0x7f030c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f030c004690 0x7f030c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f030c005000 0x7f030c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c151280 con 0x7f030c005000 2023-07-27T14:41:15.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c00bf60 con 0x7f030c0038e0 2023-07-27T14:41:15.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030c00c0f0 con 0x7f030c004690 2023-07-27T14:41:15.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f032119c700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f030c005000 0x7f030c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f032099b700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0038e0 0x7f030c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.770+0000 7f031bfff700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f030c004690 0x7f030c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f032119c700 1 -- 172.21.15.115:0/880418364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f030c004690 msgr2=0x7f030c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:15.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f032119c700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f030c004690 0x7f030c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f032119c700 1 -- 172.21.15.115:0/880418364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0038e0 msgr2=0x7f030c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:15.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f032119c700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c0038e0 0x7f030c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f032119c700 1 -- 172.21.15.115:0/880418364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c0033f0 con 0x7f030c005000 2023-07-27T14:41:15.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f032119c700 1 -- 172.21.15.115:0/880418364 reap_dead start 2023-07-27T14:41:15.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f032119c700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f030c005000 0x7f030c00b8e0 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 rx=0x7f031400e210 tx=0x7f031400b040).ready entity=mon.0 client_cookie=18b1a0af08925a91 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:15.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314009ac0 con 0x7f030c005000 2023-07-27T14:41:15.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031400f040 con 0x7f030c005000 2023-07-27T14:41:15.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f031b7fe700 1 -- 172.21.15.115:0/880418364 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400ed10 con 0x7f030c005000 2023-07-27T14:41:15.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f0322bff700 1 -- 172.21.15.115:0/880418364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f030c005000 msgr2=0x7f030c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.771+0000 7f0322bff700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f030c005000 0x7f030c00b8e0 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 rx=0x7f031400e210 tx=0x7f031400b040).stop 2023-07-27T14:41:15.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.772+0000 7f0322bff700 1 -- 172.21.15.115:0/880418364 shutdown_connections 2023-07-27T14:41:15.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.772+0000 7f0322bff700 1 --2- 172.21.15.115:0/880418364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f030c005000 0x7f030c00b8e0 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.772+0000 7f0322bff700 1 -- 172.21.15.115:0/880418364 >> 172.21.15.115:0/880418364 conn(0x7f031c062320 msgr2=0x7f031c062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:15.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.772+0000 7f0322bff700 1 -- 172.21.15.115:0/880418364 shutdown_connections 2023-07-27T14:41:15.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.772+0000 7f0322bff700 1 -- 172.21.15.115:0/880418364 wait complete. 2023-07-27T14:41:15.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.773+0000 7f0322bff700 1 Processor -- start 2023-07-27T14:41:15.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.773+0000 7f0322bff700 1 -- start start 2023-07-27T14:41:15.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.774+0000 7f0322bff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c005000 0x7f031c0bd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.774+0000 7f0322bff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f031c165400 0x7f031c165880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.774+0000 7f0322bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f031c153880 0x7f031c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.774+0000 7f0322bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c1660e0 con 0x7f031c153880 2023-07-27T14:41:15.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.774+0000 7f0322bff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c0a8220 con 0x7f030c005000 2023-07-27T14:41:15.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.774+0000 7f0322bff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c0a8500 con 0x7f031c165400 2023-07-27T14:41:15.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.774+0000 7f032119c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f031c153880 0x7f031c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032119c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f031c153880 0x7f031c153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56354/0 (socket says 172.21.15.115:56354) 2023-07-27T14:41:15.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032119c700 1 -- 172.21.15.115:0/3275073573 learned_addr learned my addr 172.21.15.115:0/3275073573 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:15.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032099b700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c005000 0x7f031c0bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f031bfff700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f031c165400 0x7f031c165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032119c700 1 -- 172.21.15.115:0/3275073573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f031c165400 msgr2=0x7f031c165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032119c700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f031c165400 0x7f031c165880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032119c700 1 -- 172.21.15.115:0/3275073573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c005000 msgr2=0x7f031c0bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:15.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032119c700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c005000 0x7f031c0bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032119c700 1 -- 172.21.15.115:0/3275073573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c0a87e0 con 0x7f031c153880 2023-07-27T14:41:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f032119c700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f031c153880 0x7f031c153cc0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 rx=0x7f031400afd0 tx=0x7f0314018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f0318ff9700 1 -- 172.21.15.115:0/3275073573 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031401d460 con 0x7f031c153880 2023-07-27T14:41:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f0318ff9700 1 -- 172.21.15.115:0/3275073573 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031401d5c0 con 0x7f031c153880 2023-07-27T14:41:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f0318ff9700 1 -- 172.21.15.115:0/3275073573 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031401d980 con 0x7f031c153880 2023-07-27T14:41:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.775+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c0a8ac0 con 0x7f031c153880 2023-07-27T14:41:15.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.776+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c0bde30 con 0x7f031c153880 2023-07-27T14:41:15.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.776+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031c162ea0 con 0x7f031c153880 2023-07-27T14:41:15.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.777+0000 7f0318ff9700 1 -- 172.21.15.115:0/3275073573 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 40) v1 ==== 77642+0+0 (secure 0 0 0) 0x7f0314019040 con 0x7f031c153880 2023-07-27T14:41:15.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.778+0000 7f0318ff9700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f030005fe70 0x7f0300062330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:15.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.778+0000 7f0318ff9700 1 -- 172.21.15.115:0/3275073573 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f031407d6c0 con 0x7f031c153880 2023-07-27T14:41:15.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.779+0000 7f032099b700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f030005fe70 0x7f0300062330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.779+0000 7f032099b700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f030005fe70 0x7f0300062330 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f0310007fd0 tx=0x7f0310007bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:15.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.782+0000 7f0318ff9700 1 -- 172.21.15.115:0/3275073573 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f031c162ea0 con 0x7f031c153880 2023-07-27T14:41:16.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:15.991+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvolume_0000000000904001", "snap_name": "snapshot_0000000000736501", "target_sub_name": "clone_0000000000297312", "target": ["mon-mgr", ""]}) v1 -- 0x7f031c162ea0 con 0x7f030005fe70 2023-07-27T14:41:16.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:16.465+0000 7f0318ff9700 1 -- 172.21.15.115:0/3275073573 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 41) v1 ==== 77722+0+0 (secure 0 0 0) 0x7f031407a3b0 con 0x7f031c153880 2023-07-27T14:41:20.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.230+0000 7f0318ff9700 1 -- 172.21.15.115:0/3275073573 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f031c162ea0 con 0x7f030005fe70 2023-07-27T14:41:20.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f030005fe70 msgr2=0x7f0300062330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:20.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f030005fe70 0x7f0300062330 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f0310007fd0 tx=0x7f0310007bb0).stop 2023-07-27T14:41:20.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f031c153880 msgr2=0x7f031c153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:20.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f031c153880 0x7f031c153cc0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 rx=0x7f031400afd0 tx=0x7f0314018000).stop 2023-07-27T14:41:20.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 shutdown_connections 2023-07-27T14:41:20.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f030005fe70 0x7f0300062330 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f031c153880 0x7f031c153cc0 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c005000 0x7f031c0bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 --2- 172.21.15.115:0/3275073573 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f031c165400 0x7f031c165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 >> 172.21.15.115:0/3275073573 conn(0x7f031c062320 msgr2=0x7f031c0c2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:20.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 shutdown_connections 2023-07-27T14:41:20.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.233+0000 7f0322bff700 1 -- 172.21.15.115:0/3275073573 wait complete. 2023-07-27T14:41:20.296 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.238+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.296 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.238+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.296 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.238+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.296 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.238+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.296 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.238+0000 7fa78811b700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000297312 2023-07-27T14:41:20.319 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.257+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.319 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.257+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.319 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.257+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.319 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.257+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.319 INFO:tasks.ceph.mgr.y.smithi115.stderr:2023-07-27T14:41:20.257+0000 7fa78991e700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-27T14:41:20.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.449+0000 7f9fdf7ff700 1 Processor -- start 2023-07-27T14:41:20.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.449+0000 7f9fdf7ff700 1 -- start start 2023-07-27T14:41:20.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fdf7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9fd81509b0 0x7f9fd80c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:20.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fdf7ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9fd8150d90 0x7f9fd8154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:20.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fdf7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd80c0ea0 con 0x7f9fd80c3100 2023-07-27T14:41:20.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fdf7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd8068e10 con 0x7f9fd81509b0 2023-07-27T14:41:20.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fdf7ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd8155190 con 0x7f9fd8150d90 2023-07-27T14:41:20.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fdd59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9fd81509b0 0x7f9fd80c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:20.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fddd9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9fd80c3100 0x7f9fd80c3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44432/0 (socket says 172.21.15.115:44432) 2023-07-27T14:41:20.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fdd59b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9fd81509b0 0x7f9fd80c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56394/0 (socket says 172.21.15.115:56394) 2023-07-27T14:41:20.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.450+0000 7f9fddd9c700 1 -- 172.21.15.115:0/1743684681 learned_addr learned my addr 172.21.15.115:0/1743684681 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:20.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fdcd9a700 1 --2- 172.21.15.115:0/1743684681 >> v2:172.21.15.159:3300/0 conn(0x7f9fd8150d90 0x7f9fd8154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:20.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fdd59b700 1 -- 172.21.15.115:0/1743684681 >> v2:172.21.15.159:3300/0 conn(0x7f9fd8150d90 msgr2=0x7f9fd8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:20.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fdd59b700 1 --2- 172.21.15.115:0/1743684681 >> v2:172.21.15.159:3300/0 conn(0x7f9fd8150d90 0x7f9fd8154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fdd59b700 1 -- 172.21.15.115:0/1743684681 >> v1:172.21.15.115:6789/0 conn(0x7f9fd80c3100 legacy=0x7f9fd80c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:20.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fdd59b700 1 -- 172.21.15.115:0/1743684681 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8155470 con 0x7f9fd81509b0 2023-07-27T14:41:20.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fcffff700 1 -- 172.21.15.115:0/1743684681 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459966757 0 0) 0x7f9fd80c0ea0 con 0x7f9fd80c3100 2023-07-27T14:41:20.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fdcd9a700 1 --2- 172.21.15.115:0/1743684681 >> v2:172.21.15.159:3300/0 conn(0x7f9fd8150d90 0x7f9fd8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-07-27T14:41:20.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fdd59b700 1 --2- 172.21.15.115:0/1743684681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd81509b0 0x7f9fd80c58d0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 rx=0x7f9fd8062ef0 tx=0x7f9fd400b300).ready entity=mon.0 client_cookie=991a465a339b0e40 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:20.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fcffff700 1 -- 172.21.15.115:0/1743684681 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400da70 con 0x7f9fd81509b0 2023-07-27T14:41:20.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fcffff700 1 -- 172.21.15.115:0/1743684681 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd400dbd0 con 0x7f9fd81509b0 2023-07-27T14:41:20.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.451+0000 7f9fcffff700 1 -- 172.21.15.115:0/1743684681 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4010470 con 0x7f9fd81509b0 2023-07-27T14:41:20.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.452+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/1743684681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd81509b0 msgr2=0x7f9fd80c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:20.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.452+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/1743684681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd81509b0 0x7f9fd80c58d0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 rx=0x7f9fd8062ef0 tx=0x7f9fd400b300).stop 2023-07-27T14:41:20.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.452+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/1743684681 shutdown_connections 2023-07-27T14:41:20.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.452+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/1743684681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd81509b0 0x7f9fd80c58d0 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.452+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/1743684681 >> v2:172.21.15.159:3300/0 conn(0x7f9fd8150d90 0x7f9fd8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.452+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/1743684681 >> 172.21.15.115:0/1743684681 conn(0x7f9fd8062320 msgr2=0x7f9fd8062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:20.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.452+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/1743684681 shutdown_connections 2023-07-27T14:41:20.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.452+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/1743684681 wait complete. 2023-07-27T14:41:20.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.454+0000 7f9fdf7ff700 1 Processor -- start 2023-07-27T14:41:20.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.454+0000 7f9fdf7ff700 1 -- start start 2023-07-27T14:41:20.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.455+0000 7f9fdf7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd80c3100 0x7f9fd813f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:20.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.455+0000 7f9fdf7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd81509b0 0x7f9fd80a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:20.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.455+0000 7f9fdf7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd8150d90 0x7f9fd80bc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:20.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.455+0000 7f9fdf7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd813fb30 con 0x7f9fd8150d90 2023-07-27T14:41:20.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.455+0000 7f9fdf7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80aacd0 con 0x7f9fd81509b0 2023-07-27T14:41:20.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.455+0000 7f9fdf7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd80aa0c0 con 0x7f9fd80c3100 2023-07-27T14:41:20.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd8150d90 0x7f9fd80bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:20.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd8150d90 0x7f9fd80bc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56402/0 (socket says 172.21.15.115:56402) 2023-07-27T14:41:20.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 -- 172.21.15.115:0/3221733665 learned_addr learned my addr 172.21.15.115:0/3221733665 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:20.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fdd59b700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd80c3100 0x7f9fd813f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:20.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fdcd9a700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd81509b0 0x7f9fd80a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:20.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 -- 172.21.15.115:0/3221733665 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd80c3100 msgr2=0x7f9fd813f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:20.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd80c3100 0x7f9fd813f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 -- 172.21.15.115:0/3221733665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd81509b0 msgr2=0x7f9fd80a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:20.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd81509b0 0x7f9fd80a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 -- 172.21.15.115:0/3221733665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd400b540 con 0x7f9fd8150d90 2023-07-27T14:41:20.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fddd9c700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd8150d90 0x7f9fd80bc810 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 rx=0x7f9fd000c7e0 tx=0x7f9fd0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:20.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fcd7fa700 1 -- 172.21.15.115:0/3221733665 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0005d30 con 0x7f9fd8150d90 2023-07-27T14:41:20.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fcd7fa700 1 -- 172.21.15.115:0/3221733665 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd0005e90 con 0x7f9fd8150d90 2023-07-27T14:41:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd80aa3a0 con 0x7f9fd8150d90 2023-07-27T14:41:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.456+0000 7f9fcd7fa700 1 -- 172.21.15.115:0/3221733665 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0007320 con 0x7f9fd8150d90 2023-07-27T14:41:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.457+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd80aa960 con 0x7f9fd8150d90 2023-07-27T14:41:20.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.458+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd806c470 con 0x7f9fd8150d90 2023-07-27T14:41:20.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.458+0000 7f9fcd7fa700 1 -- 172.21.15.115:0/3221733665 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 41) v1 ==== 77722+0+0 (secure 0 0 0) 0x7f9fd0010030 con 0x7f9fd8150d90 2023-07-27T14:41:20.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.460+0000 7f9fcd7fa700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fbc05ff00 0x7f9fbc0623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:20.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.460+0000 7f9fcd7fa700 1 -- 172.21.15.115:0/3221733665 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f9fd007b660 con 0x7f9fd8150d90 2023-07-27T14:41:20.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.460+0000 7f9fdd59b700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fbc05ff00 0x7f9fbc0623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:20.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.461+0000 7f9fdd59b700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fbc05ff00 0x7f9fbc0623c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f9fd400b340 tx=0x7f9fd8068f50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:20.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.464+0000 7f9fcd7fa700 1 -- 172.21.15.115:0/3221733665 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9fd004b9b0 con 0x7f9fd8150d90 2023-07-27T14:41:20.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.672+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000297312", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fd8155750 con 0x7f9fbc05ff00 2023-07-27T14:41:20.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.679+0000 7f9fcd7fa700 1 -- 172.21.15.115:0/3221733665 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f9fd8155750 con 0x7f9fbc05ff00 2023-07-27T14:41:20.737 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:41:20.737 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:41:20.737 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:41:20.737 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:41:20.737 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:41:20.738 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000904001", 2023-07-27T14:41:20.738 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000736501" 2023-07-27T14:41:20.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:41:20.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:41:20.738 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:41:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.680+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fbc05ff00 msgr2=0x7f9fbc0623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.680+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fbc05ff00 0x7f9fbc0623c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f9fd400b340 tx=0x7f9fd8068f50).stop 2023-07-27T14:41:20.739 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.680+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd8150d90 msgr2=0x7f9fd80bc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.680+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd8150d90 0x7f9fd80bc810 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 rx=0x7f9fd000c7e0 tx=0x7f9fd0007f90).stop 2023-07-27T14:41:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.681+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 shutdown_connections 2023-07-27T14:41:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.681+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f9fbc05ff00 0x7f9fbc0623c0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.681+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9fd8150d90 0x7f9fd80bc810 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.681+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fd80c3100 0x7f9fd813f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.681+0000 7f9fdf7ff700 1 --2- 172.21.15.115:0/3221733665 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fd81509b0 0x7f9fd80a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:20.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.681+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 >> 172.21.15.115:0/3221733665 conn(0x7f9fd8062320 msgr2=0x7f9fd80692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.681+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 shutdown_connections 2023-07-27T14:41:20.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:20.681+0000 7f9fdf7ff700 1 -- 172.21.15.115:0/3221733665 wait complete. 2023-07-27T14:41:21.757 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000297312 2023-07-27T14:41:21.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.897+0000 7f27e71ff700 1 Processor -- start 2023-07-27T14:41:21.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.897+0000 7f27e71ff700 1 -- start start 2023-07-27T14:41:21.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.899+0000 7f27e71ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f27e014ae00 0x7f27e0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:21.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.899+0000 7f27e71ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e01553f0 con 0x7f27e0063260 2023-07-27T14:41:21.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.899+0000 7f27e71ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e0157a50 con 0x7f27e014b1e0 2023-07-27T14:41:21.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.899+0000 7f27e71ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e0157d10 con 0x7f27e014ae00 2023-07-27T14:41:21.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27e579c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f27e0063260 0x7f27e00a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44440/0 (socket says 172.21.15.115:44440) 2023-07-27T14:41:21.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27e579c700 1 -- 172.21.15.115:0/3686271761 learned_addr learned my addr 172.21.15.115:0/3686271761 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:21.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27e4f9b700 1 --2- 172.21.15.115:0/3686271761 >> v2:172.21.15.159:3300/0 conn(0x7f27e014ae00 0x7f27e0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:21.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354292670 0 0) 0x7f27e01553f0 con 0x7f27e0063260 2023-07-27T14:41:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d00033f0 con 0x7f27e0063260 2023-07-27T14:41:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2770382629 0 0) 0x7f27d00033f0 con 0x7f27e0063260 2023-07-27T14:41:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 >> v2:172.21.15.159:3300/0 conn(0x7f27e014ae00 msgr2=0x7f27e0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 --2- 172.21.15.115:0/3686271761 >> v2:172.21.15.159:3300/0 conn(0x7f27e014ae00 0x7f27e0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 >> v1:172.21.15.159:6789/0 conn(0x7f27e014b1e0 legacy=0x7f27e0062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0157ff0 con 0x7f27e0063260 2023-07-27T14:41:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f27d80017f0 con 0x7f27e0063260 2023-07-27T14:41:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 >> v1:172.21.15.115:6789/0 conn(0x7f27e0063260 legacy=0x7f27e00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d00038e0 0x7f27d0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27d0004690 0x7f27d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27d0005000 0x7f27d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0157d10 con 0x7f27d0005000 2023-07-27T14:41:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d000bf60 con 0x7f27d0004690 2023-07-27T14:41:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.900+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d000c0f0 con 0x7f27d00038e0 2023-07-27T14:41:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e579c700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27d0005000 0x7f27d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e4f9b700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d00038e0 0x7f27d0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:21.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27dffff700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27d0004690 0x7f27d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:21.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e579c700 1 -- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d00038e0 msgr2=0x7f27d0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:21.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e579c700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d00038e0 0x7f27d0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:21.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e579c700 1 -- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27d0004690 msgr2=0x7f27d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:21.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e579c700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27d0004690 0x7f27d0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:21.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e579c700 1 -- 172.21.15.115:0/3686271761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00033f0 con 0x7f27d0005000 2023-07-27T14:41:21.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27dffff700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27d0004690 0x7f27d0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:21.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e579c700 1 -- 172.21.15.115:0/3686271761 reap_dead start 2023-07-27T14:41:21.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27e579c700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27d0005000 0x7f27d000b8e0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 rx=0x7f27d800c450 tx=0x7f27d800c760).ready entity=mon.0 client_cookie=2fa5d3eba16178bf server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:21.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8002030 con 0x7f27d0005000 2023-07-27T14:41:21.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d800cdf0 con 0x7f27d0005000 2023-07-27T14:41:21.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.901+0000 7f27df7fe700 1 -- 172.21.15.115:0/3686271761 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8005d70 con 0x7f27d0005000 2023-07-27T14:41:21.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.902+0000 7f27e71ff700 1 -- 172.21.15.115:0/3686271761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27d0005000 msgr2=0x7f27d000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:21.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.902+0000 7f27e71ff700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27d0005000 0x7f27d000b8e0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 rx=0x7f27d800c450 tx=0x7f27d800c760).stop 2023-07-27T14:41:21.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.902+0000 7f27e71ff700 1 -- 172.21.15.115:0/3686271761 shutdown_connections 2023-07-27T14:41:21.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.902+0000 7f27e71ff700 1 --2- 172.21.15.115:0/3686271761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27d0005000 0x7f27d000b8e0 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:21.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.902+0000 7f27e71ff700 1 -- 172.21.15.115:0/3686271761 >> 172.21.15.115:0/3686271761 conn(0x7f27e005e940 msgr2=0x7f27e00cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:21.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.902+0000 7f27e71ff700 1 -- 172.21.15.115:0/3686271761 shutdown_connections 2023-07-27T14:41:21.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.902+0000 7f27e71ff700 1 -- 172.21.15.115:0/3686271761 wait complete. 2023-07-27T14:41:21.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.903+0000 7f27e71ff700 1 Processor -- start 2023-07-27T14:41:21.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.904+0000 7f27e71ff700 1 -- start start 2023-07-27T14:41:21.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e71ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d0005000 0x7f27e01533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:21.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e71ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e01538b0 0x7f27e0149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:21.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e71ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27e0149960 0x7f27e01504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:21.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e71ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0149de0 con 0x7f27e01538b0 2023-07-27T14:41:21.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e71ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e014d2d0 con 0x7f27e0149960 2023-07-27T14:41:21.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e71ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e014d5b0 con 0x7f27d0005000 2023-07-27T14:41:21.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e01538b0 0x7f27e0149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:21.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e01538b0 0x7f27e0149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56426/0 (socket says 172.21.15.115:56426) 2023-07-27T14:41:21.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 -- 172.21.15.115:0/3676574849 learned_addr learned my addr 172.21.15.115:0/3676574849 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:21.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e4f9b700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d0005000 0x7f27e01533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:21.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e579c700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27e0149960 0x7f27e01504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:21.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 -- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d0005000 msgr2=0x7f27e01533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:21.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d0005000 0x7f27e01533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:21.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 -- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27e0149960 msgr2=0x7f27e01504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:21.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27e0149960 0x7f27e01504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 -- 172.21.15.115:0/3676574849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e014d890 con 0x7f27e01538b0 2023-07-27T14:41:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27e4f9b700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d0005000 0x7f27e01533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.905+0000 7f27dffff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e01538b0 0x7f27e0149470 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 rx=0x7f27cc000c00 tx=0x7f27cc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:21.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.906+0000 7f27dcff9700 1 -- 172.21.15.115:0/3676574849 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00ee60 con 0x7f27e01538b0 2023-07-27T14:41:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.906+0000 7f27dcff9700 1 -- 172.21.15.115:0/3676574849 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc010040 con 0x7f27e01538b0 2023-07-27T14:41:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.906+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e014db70 con 0x7f27e01538b0 2023-07-27T14:41:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.906+0000 7f27dcff9700 1 -- 172.21.15.115:0/3676574849 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc015650 con 0x7f27e01538b0 2023-07-27T14:41:21.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.906+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e01509e0 con 0x7f27e01538b0 2023-07-27T14:41:21.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.907+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e014ebf0 con 0x7f27e01538b0 2023-07-27T14:41:21.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.908+0000 7f27dcff9700 1 -- 172.21.15.115:0/3676574849 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 41) v1 ==== 77722+0+0 (secure 0 0 0) 0x7f27cc01c060 con 0x7f27e01538b0 2023-07-27T14:41:21.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.908+0000 7f27dcff9700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27c405ff00 0x7f27c40623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:21.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.909+0000 7f27dcff9700 1 -- 172.21.15.115:0/3676574849 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f27cc07aa40 con 0x7f27e01538b0 2023-07-27T14:41:21.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.909+0000 7f27e4f9b700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27c405ff00 0x7f27c40623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:21.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.909+0000 7f27e4f9b700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27c405ff00 0x7f27c40623c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f27d4006d80 tx=0x7f27d4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:21.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:21.913+0000 7f27dcff9700 1 -- 172.21.15.115:0/3676574849 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27cc04ad40 con 0x7f27e01538b0 2023-07-27T14:41:22.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.124+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000297312", "target": ["mon-mgr", ""]}) v1 -- 0x7f27e006c470 con 0x7f27c405ff00 2023-07-27T14:41:22.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.131+0000 7f27dcff9700 1 -- 172.21.15.115:0/3676574849 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+189 (secure 0 0 0) 0x7f27e006c470 con 0x7f27c405ff00 2023-07-27T14:41:22.190 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:41:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:41:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "pending", 2023-07-27T14:41:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "source": { 2023-07-27T14:41:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "volume": "cephfs", 2023-07-27T14:41:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "subvolume": "subvolume_0000000000904001", 2023-07-27T14:41:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot": "snapshot_0000000000736501" 2023-07-27T14:41:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:41:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:41:22.191 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:41:22.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.133+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27c405ff00 msgr2=0x7f27c40623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:22.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.133+0000 7f27e71ff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27c405ff00 0x7f27c40623c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f27d4006d80 tx=0x7f27d4008040).stop 2023-07-27T14:41:22.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e01538b0 msgr2=0x7f27e0149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:22.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e01538b0 0x7f27e0149470 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 rx=0x7f27cc000c00 tx=0x7f27cc009040).stop 2023-07-27T14:41:22.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 shutdown_connections 2023-07-27T14:41:22.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f27c405ff00 0x7f27c40623c0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:22.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f27e0149960 0x7f27e01504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:22.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f27d0005000 0x7f27e01533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:22.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 --2- 172.21.15.115:0/3676574849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27e01538b0 0x7f27e0149470 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:22.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 >> 172.21.15.115:0/3676574849 conn(0x7f27e005e940 msgr2=0x7f27e014a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:22.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 shutdown_connections 2023-07-27T14:41:22.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:22.134+0000 7f27e71ff700 1 -- 172.21.15.115:0/3676574849 wait complete. 2023-07-27T14:41:23.210 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs clone_0000000000297312 2023-07-27T14:41:23.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.348+0000 7fa46efff700 1 Processor -- start 2023-07-27T14:41:23.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.348+0000 7fa46efff700 1 -- start start 2023-07-27T14:41:23.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa46efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4681509b0 0x7fa4680c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa46efff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa468150d90 0x7fa468154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa46efff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4680c0ea0 con 0x7fa4680c3100 2023-07-27T14:41:23.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa46efff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa468068e10 con 0x7fa468150d90 2023-07-27T14:41:23.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa46efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa468155190 con 0x7fa4681509b0 2023-07-27T14:41:23.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa467fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa468150d90 0x7fa468154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa46d59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa4680c3100 0x7fa4680c35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44454/0 (socket says 172.21.15.115:44454) 2023-07-27T14:41:23.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa46d59c700 1 -- 172.21.15.115:0/812478603 learned_addr learned my addr 172.21.15.115:0/812478603 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:23.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa46cd9b700 1 --2- 172.21.15.115:0/812478603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4681509b0 0x7fa4680c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa4677fe700 1 -- 172.21.15.115:0/812478603 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085696768 0 0) 0x7fa4680c0ea0 con 0x7fa4680c3100 2023-07-27T14:41:23.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.350+0000 7fa4677fe700 1 -- 172.21.15.115:0/812478603 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4580033f0 con 0x7fa4680c3100 2023-07-27T14:41:23.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa467fff700 1 -- 172.21.15.115:0/812478603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4681509b0 msgr2=0x7fa4680c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:23.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa467fff700 1 --2- 172.21.15.115:0/812478603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4681509b0 0x7fa4680c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa467fff700 1 -- 172.21.15.115:0/812478603 >> v1:172.21.15.115:6789/0 conn(0x7fa4680c3100 legacy=0x7fa4680c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa467fff700 1 -- 172.21.15.115:0/812478603 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468155470 con 0x7fa468150d90 2023-07-27T14:41:23.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa467fff700 1 --2- 172.21.15.115:0/812478603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa468154940 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 rx=0x7fa454009760 tx=0x7fa454009060).ready entity=mon.0 client_cookie=58dc53db6e9af1b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:23.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa4677fe700 1 -- 172.21.15.115:0/812478603 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400f510 con 0x7fa468150d90 2023-07-27T14:41:23.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa4677fe700 1 -- 172.21.15.115:0/812478603 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45400f670 con 0x7fa468150d90 2023-07-27T14:41:23.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa4677fe700 1 -- 172.21.15.115:0/812478603 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400f9f0 con 0x7fa468150d90 2023-07-27T14:41:23.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa46efff700 1 -- 172.21.15.115:0/812478603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 msgr2=0x7fa468154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.351+0000 7fa46efff700 1 --2- 172.21.15.115:0/812478603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa468154940 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 rx=0x7fa454009760 tx=0x7fa454009060).stop 2023-07-27T14:41:23.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.352+0000 7fa46efff700 1 -- 172.21.15.115:0/812478603 shutdown_connections 2023-07-27T14:41:23.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.352+0000 7fa46efff700 1 --2- 172.21.15.115:0/812478603 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4681509b0 0x7fa4680c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.352+0000 7fa46efff700 1 --2- 172.21.15.115:0/812478603 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa468154940 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.352+0000 7fa46efff700 1 -- 172.21.15.115:0/812478603 >> 172.21.15.115:0/812478603 conn(0x7fa468062320 msgr2=0x7fa468062730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:23.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.352+0000 7fa46efff700 1 -- 172.21.15.115:0/812478603 shutdown_connections 2023-07-27T14:41:23.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.352+0000 7fa46efff700 1 -- 172.21.15.115:0/812478603 wait complete. 2023-07-27T14:41:23.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.353+0000 7fa46efff700 1 Processor -- start 2023-07-27T14:41:23.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.353+0000 7fa46efff700 1 -- start start 2023-07-27T14:41:23.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.354+0000 7fa46efff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4680c3100 0x7fa46814a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.354+0000 7fa46efff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4681509b0 0x7fa4680a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.354+0000 7fa46efff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa4680a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.354+0000 7fa46efff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680a6d50 con 0x7fa468150d90 2023-07-27T14:41:23.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.354+0000 7fa46efff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680a60a0 con 0x7fa4681509b0 2023-07-27T14:41:23.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.354+0000 7fa46efff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680a6420 con 0x7fa4680c3100 2023-07-27T14:41:23.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa4680a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa4680a5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56450/0 (socket says 172.21.15.115:56450) 2023-07-27T14:41:23.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 -- 172.21.15.115:0/611446461 learned_addr learned my addr 172.21.15.115:0/611446461 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:23.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46cd9b700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4680c3100 0x7fa46814a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa467fff700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4681509b0 0x7fa4680a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 -- 172.21.15.115:0/611446461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4680c3100 msgr2=0x7fa46814a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4680c3100 0x7fa46814a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 -- 172.21.15.115:0/611446461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4681509b0 msgr2=0x7fa4680a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4681509b0 0x7fa4680a71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 -- 172.21.15.115:0/611446461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540092a0 con 0x7fa468150d90 2023-07-27T14:41:23.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa46d59c700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa4680a5690 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 rx=0x7fa460005ad0 tx=0x7fa460001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:23.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.355+0000 7fa464ff9700 1 -- 172.21.15.115:0/611446461 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460005d30 con 0x7fa468150d90 2023-07-27T14:41:23.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.356+0000 7fa464ff9700 1 -- 172.21.15.115:0/611446461 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa460005e90 con 0x7fa468150d90 2023-07-27T14:41:23.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.356+0000 7fa464ff9700 1 -- 172.21.15.115:0/611446461 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460007320 con 0x7fa468150d90 2023-07-27T14:41:23.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.356+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4680a6700 con 0x7fa468150d90 2023-07-27T14:41:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.356+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa468153550 con 0x7fa468150d90 2023-07-27T14:41:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.357+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4680bbfd0 con 0x7fa468150d90 2023-07-27T14:41:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.357+0000 7fa464ff9700 1 -- 172.21.15.115:0/611446461 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 42) v1 ==== 77802+0+0 (secure 0 0 0) 0x7fa460010030 con 0x7fa468150d90 2023-07-27T14:41:23.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.359+0000 7fa464ff9700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa44c05ffc0 0x7fa44c062480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.359+0000 7fa464ff9700 1 -- 172.21.15.115:0/611446461 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fa46007b4e0 con 0x7fa468150d90 2023-07-27T14:41:23.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.359+0000 7fa46cd9b700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa44c05ffc0 0x7fa44c062480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.360+0000 7fa46cd9b700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa44c05ffc0 0x7fa44c062480 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fa45c00bbc0 tx=0x7fa45c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:23.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.363+0000 7fa464ff9700 1 -- 172.21.15.115:0/611446461 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa46004b8b0 con 0x7fa468150d90 2023-07-27T14:41:23.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.573+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "clone_0000000000297312", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4680a6e90 con 0x7fa44c05ffc0 2023-07-27T14:41:23.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.624+0000 7fa464ff9700 1 -- 172.21.15.115:0/611446461 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fa4680a6e90 con 0x7fa44c05ffc0 2023-07-27T14:41:23.683 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:41:23.683 INFO:teuthology.orchestra.run.smithi115.stdout: "status": { 2023-07-27T14:41:23.683 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete" 2023-07-27T14:41:23.683 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-07-27T14:41:23.684 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:41:23.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.626+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa44c05ffc0 msgr2=0x7fa44c062480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.626+0000 7fa46efff700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa44c05ffc0 0x7fa44c062480 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fa45c00bbc0 tx=0x7fa45c008040).stop 2023-07-27T14:41:23.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 msgr2=0x7fa4680a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa4680a5690 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 rx=0x7fa460005ad0 tx=0x7fa460001650).stop 2023-07-27T14:41:23.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 shutdown_connections 2023-07-27T14:41:23.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fa44c05ffc0 0x7fa44c062480 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa468150d90 0x7fa4680a5690 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa4680c3100 0x7fa46814a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 --2- 172.21.15.115:0/611446461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4681509b0 0x7fa4680a71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 >> 172.21.15.115:0/611446461 conn(0x7fa468062320 msgr2=0x7fa4681549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:23.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 shutdown_connections 2023-07-27T14:41:23.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.627+0000 7fa46efff700 1 -- 172.21.15.115:0/611446461 wait complete. 2023-07-27T14:41:23.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs clone_0000000000297312 2023-07-27T14:41:23.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.835+0000 7fb5bf5ff700 1 Processor -- start 2023-07-27T14:41:23.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.835+0000 7fb5bf5ff700 1 -- start start 2023-07-27T14:41:23.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bf5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5b814ae00 0x7fb5b8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bf5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 0x7fb5b80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bf5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b81553f0 con 0x7fb5b814b1e0 2023-07-27T14:41:23.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bf5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b8157a50 con 0x7fb5b814ae00 2023-07-27T14:41:23.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bf5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8157d10 con 0x7fb5b8063260 2023-07-27T14:41:23.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bd39b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5b814ae00 0x7fb5b8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bcb9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb5b814b1e0 0x7fb5b8062b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57604/0 (socket says 172.21.15.115:57604) 2023-07-27T14:41:23.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bcb9a700 1 -- 172.21.15.115:0/2163495465 learned_addr learned my addr 172.21.15.115:0/2163495465 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:23.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bd39b700 1 -- 172.21.15.115:0/2163495465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 msgr2=0x7fb5b80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:23.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bd39b700 1 --2- 172.21.15.115:0/2163495465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 0x7fb5b80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:23.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5bd39b700 1 -- 172.21.15.115:0/2163495465 >> v1:172.21.15.115:6789/0 conn(0x7fb5b814b1e0 legacy=0x7fb5b8062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5bd39b700 1 -- 172.21.15.115:0/2163495465 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8157ff0 con 0x7fb5b814ae00 2023-07-27T14:41:23.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.837+0000 7fb5affff700 1 -- 172.21.15.115:0/2163495465 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951868831 0 0) 0x7fb5b81553f0 con 0x7fb5b814b1e0 2023-07-27T14:41:23.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5bd39b700 1 --2- 172.21.15.115:0/2163495465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814ae00 0x7fb5b8154f00 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 rx=0x7fb5b4009760 tx=0x7fb5b4009060).ready entity=mon.0 client_cookie=fd6f739dca651bc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:23.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5affff700 1 -- 172.21.15.115:0/2163495465 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400b580 con 0x7fb5b814ae00 2023-07-27T14:41:23.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5affff700 1 -- 172.21.15.115:0/2163495465 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b400b6e0 con 0x7fb5b814ae00 2023-07-27T14:41:23.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5affff700 1 -- 172.21.15.115:0/2163495465 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400ba60 con 0x7fb5b814ae00 2023-07-27T14:41:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/2163495465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814ae00 msgr2=0x7fb5b8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/2163495465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814ae00 0x7fb5b8154f00 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 rx=0x7fb5b4009760 tx=0x7fb5b4009060).stop 2023-07-27T14:41:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/2163495465 shutdown_connections 2023-07-27T14:41:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/2163495465 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 0x7fb5b80a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-07-27T14:41:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/2163495465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814ae00 0x7fb5b8154f00 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.838+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/2163495465 >> 172.21.15.115:0/2163495465 conn(0x7fb5b805e940 msgr2=0x7fb5b80cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.839+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/2163495465 shutdown_connections 2023-07-27T14:41:23.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.839+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/2163495465 wait complete. 2023-07-27T14:41:23.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.840+0000 7fb5bf5ff700 1 Processor -- start 2023-07-27T14:41:23.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.840+0000 7fb5bf5ff700 1 -- start start 2023-07-27T14:41:23.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.841+0000 7fb5bf5ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 0x7fb5b80af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.841+0000 7fb5bf5ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5b814ae00 0x7fb5b8156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.841+0000 7fb5bf5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814b1e0 0x7fb5b814a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.841+0000 7fb5bf5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b81547b0 con 0x7fb5b814b1e0 2023-07-27T14:41:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.841+0000 7fb5bf5ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b80afeb0 con 0x7fb5b814ae00 2023-07-27T14:41:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.841+0000 7fb5bf5ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b80b0190 con 0x7fb5b8063260 2023-07-27T14:41:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.841+0000 7fb5bdb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814b1e0 0x7fb5b814a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bd39b700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 0x7fb5b80af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bdb9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814b1e0 0x7fb5b814a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55222/0 (socket says 172.21.15.115:55222) 2023-07-27T14:41:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bdb9c700 1 -- 172.21.15.115:0/1357214541 learned_addr learned my addr 172.21.15.115:0/1357214541 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bcb9a700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5b814ae00 0x7fb5b8156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bdb9c700 1 -- 172.21.15.115:0/1357214541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 msgr2=0x7fb5b80af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bdb9c700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 0x7fb5b80af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bdb9c700 1 -- 172.21.15.115:0/1357214541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5b814ae00 msgr2=0x7fb5b8156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bdb9c700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5b814ae00 0x7fb5b8156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:23.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bdb9c700 1 -- 172.21.15.115:0/1357214541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40092a0 con 0x7fb5b814b1e0 2023-07-27T14:41:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bdb9c700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814b1e0 0x7fb5b814a1c0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 rx=0x7fb5b000bb60 tx=0x7fb5b0009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5ad7fa700 1 -- 172.21.15.115:0/1357214541 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000c7e0 con 0x7fb5b814b1e0 2023-07-27T14:41:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5ad7fa700 1 -- 172.21.15.115:0/1357214541 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b000c960 con 0x7fb5b814b1e0 2023-07-27T14:41:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5ad7fa700 1 -- 172.21.15.115:0/1357214541 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000cb10 con 0x7fb5b814b1e0 2023-07-27T14:41:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.842+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b80b0470 con 0x7fb5b814b1e0 2023-07-27T14:41:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.843+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b80afb30 con 0x7fb5b814b1e0 2023-07-27T14:41:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.843+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b80caf70 con 0x7fb5b814b1e0 2023-07-27T14:41:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.844+0000 7fb5ad7fa700 1 -- 172.21.15.115:0/1357214541 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 42) v1 ==== 77802+0+0 (secure 0 0 0) 0x7fb5b0015420 con 0x7fb5b814b1e0 2023-07-27T14:41:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.845+0000 7fb5ad7fa700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb59c05ff90 0x7fb59c062450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.845+0000 7fb5ad7fa700 1 -- 172.21.15.115:0/1357214541 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fb5b007ba70 con 0x7fb5b814b1e0 2023-07-27T14:41:23.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.846+0000 7fb5bd39b700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb59c05ff90 0x7fb59c062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:23.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.846+0000 7fb5bd39b700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb59c05ff90 0x7fb59c062450 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fb5b4006be0 tx=0x7fb5b4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:23.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:23.849+0000 7fb5ad7fa700 1 -- 172.21.15.115:0/1357214541 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5b004bdf0 con 0x7fb5b814b1e0 2023-07-27T14:41:24.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.051+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "clone_0000000000297312", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5b806c470 con 0x7fb59c05ff90 2023-07-27T14:41:24.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.056+0000 7fb5ad7fa700 1 -- 172.21.15.115:0/1357214541 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7fb5b806c470 con 0x7fb59c05ff90 2023-07-27T14:41:24.115 INFO:teuthology.orchestra.run.smithi115.stdout:/volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7 2023-07-27T14:41:24.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb59c05ff90 msgr2=0x7fb59c062450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb59c05ff90 0x7fb59c062450 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fb5b4006be0 tx=0x7fb5b4017000).stop 2023-07-27T14:41:24.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814b1e0 msgr2=0x7fb5b814a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814b1e0 0x7fb5b814a1c0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 rx=0x7fb5b000bb60 tx=0x7fb5b0009810).stop 2023-07-27T14:41:24.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 shutdown_connections 2023-07-27T14:41:24.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fb59c05ff90 0x7fb59c062450 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5b814b1e0 0x7fb5b814a1c0 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5b8063260 0x7fb5b80af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 --2- 172.21.15.115:0/1357214541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5b814ae00 0x7fb5b8156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.058+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 >> 172.21.15.115:0/1357214541 conn(0x7fb5b805e940 msgr2=0x7fb5b80c0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:24.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.059+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 shutdown_connections 2023-07-27T14:41:24.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.059+0000 7fb5bf5ff700 1 -- 172.21.15.115:0/1357214541 wait complete. 2023-07-27T14:41:24.134 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs clone_0000000000297312 2023-07-27T14:41:24.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.267+0000 7f5ddb7ff700 1 Processor -- start 2023-07-27T14:41:24.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.267+0000 7f5ddb7ff700 1 -- start start 2023-07-27T14:41:24.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.269+0000 7f5ddb7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd4063260 0x7f5dd4154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:24.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.269+0000 7f5ddb7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd41553f0 con 0x7f5dd414b1e0 2023-07-27T14:41:24.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.269+0000 7f5ddb7ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd4157a50 con 0x7f5dd414ae00 2023-07-27T14:41:24.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.269+0000 7f5ddb7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4157d10 con 0x7f5dd4063260 2023-07-27T14:41:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.269+0000 7f5dd9d9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5dd414b1e0 0x7f5dd40a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57606/0 (socket says 172.21.15.115:57606) 2023-07-27T14:41:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.269+0000 7f5dd9d9c700 1 -- 172.21.15.115:0/3623436581 learned_addr learned my addr 172.21.15.115:0/3623436581 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:24.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.269+0000 7f5dd8d9a700 1 --2- 172.21.15.115:0/3623436581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd4063260 0x7f5dd4154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:24.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dcbfff700 1 -- 172.21.15.115:0/3623436581 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204343052 0 0) 0x7f5dd41553f0 con 0x7f5dd414b1e0 2023-07-27T14:41:24.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dcbfff700 1 -- 172.21.15.115:0/3623436581 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc00033f0 con 0x7f5dd414b1e0 2023-07-27T14:41:24.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dd8d9a700 1 -- 172.21.15.115:0/3623436581 >> v1:172.21.15.159:6789/0 conn(0x7f5dd414ae00 legacy=0x7f5dd4062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dcbfff700 1 -- 172.21.15.115:0/3623436581 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298798258 0 0) 0x7f5dd4157a50 con 0x7f5dd414ae00 2023-07-27T14:41:24.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dd8d9a700 1 -- 172.21.15.115:0/3623436581 >> v1:172.21.15.115:6789/0 conn(0x7f5dd414b1e0 legacy=0x7f5dd40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dd8d9a700 1 -- 172.21.15.115:0/3623436581 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4157ff0 con 0x7f5dd4063260 2023-07-27T14:41:24.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dd8d9a700 1 --2- 172.21.15.115:0/3623436581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd4063260 0x7f5dd4154f00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f5dc4009790 tx=0x7f5dc4009060).ready entity=mon.2 client_cookie=6f73cfedfae29f5d server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:24.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dcbfff700 1 -- 172.21.15.115:0/3623436581 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc400f510 con 0x7f5dd4063260 2023-07-27T14:41:24.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dcbfff700 1 -- 172.21.15.115:0/3623436581 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc400f670 con 0x7f5dd4063260 2023-07-27T14:41:24.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.270+0000 7f5dcbfff700 1 -- 172.21.15.115:0/3623436581 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc400f9f0 con 0x7f5dd4063260 2023-07-27T14:41:24.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.271+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/3623436581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd4063260 msgr2=0x7f5dd4154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.271+0000 7f5ddb7ff700 1 --2- 172.21.15.115:0/3623436581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd4063260 0x7f5dd4154f00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f5dc4009790 tx=0x7f5dc4009060).stop 2023-07-27T14:41:24.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.271+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/3623436581 shutdown_connections 2023-07-27T14:41:24.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.271+0000 7f5ddb7ff700 1 --2- 172.21.15.115:0/3623436581 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd4063260 0x7f5dd4154f00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.271+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/3623436581 >> 172.21.15.115:0/3623436581 conn(0x7f5dd405e940 msgr2=0x7f5dd40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:24.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.271+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/3623436581 shutdown_connections 2023-07-27T14:41:24.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.271+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/3623436581 wait complete. 2023-07-27T14:41:24.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.273+0000 7f5ddb7ff700 1 Processor -- start 2023-07-27T14:41:24.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.273+0000 7f5ddb7ff700 1 -- start start 2023-07-27T14:41:24.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.274+0000 7f5ddb7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd4063260 0x7f5dd414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:24.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.274+0000 7f5ddb7ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd414ae00 0x7f5dd40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:24.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.274+0000 7f5ddb7ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd414b1e0 0x7f5dd40ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:24.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.274+0000 7f5ddb7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c2a50 con 0x7f5dd4063260 2023-07-27T14:41:24.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.274+0000 7f5ddb7ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4156f00 con 0x7f5dd414ae00 2023-07-27T14:41:24.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.274+0000 7f5ddb7ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c2450 con 0x7f5dd414b1e0 2023-07-27T14:41:24.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.274+0000 7f5dd959b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd4063260 0x7f5dd414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:24.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd959b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd4063260 0x7f5dd414a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55238/0 (socket says 172.21.15.115:55238) 2023-07-27T14:41:24.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd959b700 1 -- 172.21.15.115:0/322314663 learned_addr learned my addr 172.21.15.115:0/322314663 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:24.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd8d9a700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd414ae00 0x7f5dd40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:24.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd9d9c700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd414b1e0 0x7f5dd40ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:24.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd959b700 1 -- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd414b1e0 msgr2=0x7f5dd40ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd959b700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd414b1e0 0x7f5dd40ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd959b700 1 -- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd414ae00 msgr2=0x7f5dd40adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd959b700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd414ae00 0x7f5dd40adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd959b700 1 -- 172.21.15.115:0/322314663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40092a0 con 0x7f5dd4063260 2023-07-27T14:41:24.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd8d9a700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd414ae00 0x7f5dd40adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:24.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dd959b700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd4063260 0x7f5dd414a4b0 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 rx=0x7f5dd0007fd0 tx=0x7f5dd0007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:24.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dc97fa700 1 -- 172.21.15.115:0/322314663 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000f470 con 0x7f5dd4063260 2023-07-27T14:41:24.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dc97fa700 1 -- 172.21.15.115:0/322314663 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd000f5f0 con 0x7f5dd4063260 2023-07-27T14:41:24.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd4156660 con 0x7f5dd4063260 2023-07-27T14:41:24.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.275+0000 7f5dc97fa700 1 -- 172.21.15.115:0/322314663 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000f9b0 con 0x7f5dd4063260 2023-07-27T14:41:24.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.276+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd4156c20 con 0x7f5dd4063260 2023-07-27T14:41:24.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.276+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd40c2d30 con 0x7f5dd4063260 2023-07-27T14:41:24.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.277+0000 7f5dc97fa700 1 -- 172.21.15.115:0/322314663 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 42) v1 ==== 77802+0+0 (secure 0 0 0) 0x7f5dd0019030 con 0x7f5dd4063260 2023-07-27T14:41:24.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.278+0000 7f5dc97fa700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5db805ffc0 0x7f5db8062480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:24.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.278+0000 7f5dc97fa700 1 -- 172.21.15.115:0/322314663 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f5dd007acf0 con 0x7f5dd4063260 2023-07-27T14:41:24.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.279+0000 7f5dd8d9a700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5db805ffc0 0x7f5db8062480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:24.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.279+0000 7f5dd8d9a700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5db805ffc0 0x7f5db8062480 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f5dd4063660 tx=0x7f5dc4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:24.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.282+0000 7f5dc97fa700 1 -- 172.21.15.115:0/322314663 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5dd004af60 con 0x7f5dd4063260 2023-07-27T14:41:24.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.484+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "clone_0000000000297312", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dd406c470 con 0x7f5db805ffc0 2023-07-27T14:41:24.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.492+0000 7f5dc97fa700 1 -- 172.21.15.115:0/322314663 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+714 (secure 0 0 0) 0x7f5dd406c470 con 0x7f5db805ffc0 2023-07-27T14:41:24.550 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2023-07-27T14:41:24.550 INFO:teuthology.orchestra.run.smithi115.stdout: "atime": "2023-07-27 14:41:12", 2023-07-27T14:41:24.550 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_pcent": "undefined", 2023-07-27T14:41:24.551 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_quota": "infinite", 2023-07-27T14:41:24.551 INFO:teuthology.orchestra.run.smithi115.stdout: "bytes_used": 16777216, 2023-07-27T14:41:24.551 INFO:teuthology.orchestra.run.smithi115.stdout: "created_at": "2023-07-27 14:41:20", 2023-07-27T14:41:24.551 INFO:teuthology.orchestra.run.smithi115.stdout: "ctime": "2023-07-27 14:41:22", 2023-07-27T14:41:24.551 INFO:teuthology.orchestra.run.smithi115.stdout: "data_pool": "cephfs_data", 2023-07-27T14:41:24.551 INFO:teuthology.orchestra.run.smithi115.stdout: "features": [ 2023-07-27T14:41:24.551 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-clone", 2023-07-27T14:41:24.551 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-autoprotect", 2023-07-27T14:41:24.552 INFO:teuthology.orchestra.run.smithi115.stdout: "snapshot-retention" 2023-07-27T14:41:24.552 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:41:24.552 INFO:teuthology.orchestra.run.smithi115.stdout: "gid": 0, 2023-07-27T14:41:24.552 INFO:teuthology.orchestra.run.smithi115.stdout: "mode": 16895, 2023-07-27T14:41:24.552 INFO:teuthology.orchestra.run.smithi115.stdout: "mon_addrs": [ 2023-07-27T14:41:24.552 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.115:6789", 2023-07-27T14:41:24.552 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6789", 2023-07-27T14:41:24.553 INFO:teuthology.orchestra.run.smithi115.stdout: "172.21.15.159:6790" 2023-07-27T14:41:24.553 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2023-07-27T14:41:24.553 INFO:teuthology.orchestra.run.smithi115.stdout: "mtime": "2023-07-27 14:41:14", 2023-07-27T14:41:24.553 INFO:teuthology.orchestra.run.smithi115.stdout: "path": "/volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7", 2023-07-27T14:41:24.553 INFO:teuthology.orchestra.run.smithi115.stdout: "pool_namespace": "", 2023-07-27T14:41:24.553 INFO:teuthology.orchestra.run.smithi115.stdout: "state": "complete", 2023-07-27T14:41:24.553 INFO:teuthology.orchestra.run.smithi115.stdout: "type": "clone", 2023-07-27T14:41:24.553 INFO:teuthology.orchestra.run.smithi115.stdout: "uid": 0 2023-07-27T14:41:24.554 INFO:teuthology.orchestra.run.smithi115.stdout:} 2023-07-27T14:41:24.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5db805ffc0 msgr2=0x7f5db8062480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5db805ffc0 0x7f5db8062480 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f5dd4063660 tx=0x7f5dc4017000).stop 2023-07-27T14:41:24.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd4063260 msgr2=0x7f5dd414a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:24.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd4063260 0x7f5dd414a4b0 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 rx=0x7f5dd0007fd0 tx=0x7f5dd0007c20).stop 2023-07-27T14:41:24.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 shutdown_connections 2023-07-27T14:41:24.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f5db805ffc0 0x7f5db8062480 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5dd414b1e0 0x7f5dd40ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dd4063260 0x7f5dd414a4b0 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 --2- 172.21.15.115:0/322314663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dd414ae00 0x7f5dd40adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 >> 172.21.15.115:0/322314663 conn(0x7f5dd405e940 msgr2=0x7f5dd40c1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 shutdown_connections 2023-07-27T14:41:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:24.494+0000 7f5ddb7ff700 1 -- 172.21.15.115:0/322314663 wait complete. 2023-07-27T14:41:24.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:24.569 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa) 2023-07-27T14:41:24.616 INFO:teuthology.orchestra.run.smithi115.stderr:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa: ceph.quota.max_bytes: No such attribute 2023-07-27T14:41:24.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-27T14:41:24.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:24.618 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa) 2023-07-27T14:41:24.664 INFO:teuthology.orchestra.run.smithi115.stdout:cephfs_data 2023-07-27T14:41:24.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:24.665 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa) 2023-07-27T14:41:24.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:24.752 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa) 2023-07-27T14:41:24.799 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa 2023-07-27T14:41:24.800 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.2 2023-07-27T14:41:24.800 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.14 2023-07-27T14:41:24.800 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.13 2023-07-27T14:41:24.800 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.10 2023-07-27T14:41:24.800 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.5 2023-07-27T14:41:24.801 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.4 2023-07-27T14:41:24.801 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.7 2023-07-27T14:41:24.801 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.6 2023-07-27T14:41:24.801 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.0 2023-07-27T14:41:24.801 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.9 2023-07-27T14:41:24.801 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.15 2023-07-27T14:41:24.801 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.8 2023-07-27T14:41:24.801 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.11 2023-07-27T14:41:24.802 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.3 2023-07-27T14:41:24.802 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.12 2023-07-27T14:41:24.802 INFO:teuthology.orchestra.run.smithi115.stdout:volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.1 2023-07-27T14:41:24.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:24.803 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa) 2023-07-27T14:41:24.849 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:41:24.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:24.850 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/) 2023-07-27T14:41:24.897 INFO:teuthology.orchestra.run.smithi115.stdout:41ff 2023-07-27T14:41:24.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:24.898 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa) 2023-07-27T14:41:24.944 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:41:24.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:24.947 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/) 2023-07-27T14:41:25.035 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:41:25.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.037 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa) 2023-07-27T14:41:25.083 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:41:25.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.085 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/) 2023-07-27T14:41:25.171 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-07-27T14:41:25.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.172 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa) 2023-07-27T14:41:25.219 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:25.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.220 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/) 2023-07-27T14:41:25.266 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:25.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.268 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.2) 2023-07-27T14:41:25.314 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:25.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.316 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.2) 2023-07-27T14:41:25.367 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:25.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.369 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.2) 2023-07-27T14:41:25.415 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:25.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.417 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.2) 2023-07-27T14:41:25.506 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:25.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.508 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.2) 2023-07-27T14:41:25.554 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:25.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.555 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.2) 2023-07-27T14:41:25.640 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:25.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.641 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.2) 2023-07-27T14:41:25.726 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:25.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.727 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.2) 2023-07-27T14:41:25.813 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:25.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.815 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.14) 2023-07-27T14:41:25.861 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:25.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.862 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.14) 2023-07-27T14:41:25.912 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:25.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.914 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.14) 2023-07-27T14:41:25.959 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:25.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:25.960 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.14) 2023-07-27T14:41:26.046 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:26.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.047 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.14) 2023-07-27T14:41:26.133 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:26.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.134 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.14) 2023-07-27T14:41:26.180 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:26.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.181 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.14) 2023-07-27T14:41:26.266 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:26.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.269 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.14) 2023-07-27T14:41:26.354 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:26.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.356 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.13) 2023-07-27T14:41:26.401 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:26.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.402 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.13) 2023-07-27T14:41:26.452 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:26.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.454 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.13) 2023-07-27T14:41:26.499 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:26.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.500 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.13) 2023-07-27T14:41:26.585 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:26.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.587 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.13) 2023-07-27T14:41:26.672 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:26.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.673 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.13) 2023-07-27T14:41:26.719 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:26.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.720 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.13) 2023-07-27T14:41:26.766 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:26.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.767 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.13) 2023-07-27T14:41:26.814 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:26.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.816 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.10) 2023-07-27T14:41:26.861 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:26.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.863 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.10) 2023-07-27T14:41:26.914 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:26.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.916 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.10) 2023-07-27T14:41:26.963 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:26.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:26.964 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.10) 2023-07-27T14:41:27.050 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:27.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.051 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.10) 2023-07-27T14:41:27.097 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:27.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.098 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.10) 2023-07-27T14:41:27.183 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:27.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.185 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.10) 2023-07-27T14:41:27.269 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:27.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.270 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.10) 2023-07-27T14:41:27.356 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:27.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.358 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.5) 2023-07-27T14:41:27.404 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:27.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.406 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.5) 2023-07-27T14:41:27.457 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:27.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.458 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.5) 2023-07-27T14:41:27.504 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:27.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.505 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.5) 2023-07-27T14:41:27.551 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:27.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.552 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.5) 2023-07-27T14:41:27.598 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:27.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.599 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.5) 2023-07-27T14:41:27.685 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:27.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.686 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.5) 2023-07-27T14:41:27.733 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:27.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.735 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.5) 2023-07-27T14:41:27.781 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:27.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.783 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.4) 2023-07-27T14:41:27.869 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:27.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.870 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.4) 2023-07-27T14:41:27.960 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:27.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:27.962 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.4) 2023-07-27T14:41:28.008 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:28.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.009 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.4) 2023-07-27T14:41:28.095 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:28.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.096 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.4) 2023-07-27T14:41:28.142 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:28.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.143 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.4) 2023-07-27T14:41:28.189 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:28.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.191 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.4) 2023-07-27T14:41:28.237 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:28.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.239 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.4) 2023-07-27T14:41:28.326 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:28.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.328 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.7) 2023-07-27T14:41:28.374 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:28.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.375 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.7) 2023-07-27T14:41:28.464 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:28.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.466 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.7) 2023-07-27T14:41:28.512 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:28.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.513 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.7) 2023-07-27T14:41:28.599 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:28.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.602 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.7) 2023-07-27T14:41:28.647 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:28.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.649 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.7) 2023-07-27T14:41:28.735 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:28.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.737 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.7) 2023-07-27T14:41:28.822 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:28.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.824 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.7) 2023-07-27T14:41:28.870 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:28.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.871 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.6) 2023-07-27T14:41:28.957 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:28.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:28.959 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.6) 2023-07-27T14:41:29.005 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:29.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.007 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.6) 2023-07-27T14:41:29.052 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:29.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.057 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.6) 2023-07-27T14:41:29.143 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:29.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.144 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.6) 2023-07-27T14:41:29.229 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:29.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.232 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.6) 2023-07-27T14:41:29.317 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:29.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.320 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.6) 2023-07-27T14:41:29.367 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:29.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.368 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.6) 2023-07-27T14:41:29.414 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:29.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.415 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.0) 2023-07-27T14:41:29.501 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:29.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.503 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.0) 2023-07-27T14:41:29.589 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:29.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.591 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.0) 2023-07-27T14:41:29.637 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:29.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.639 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.0) 2023-07-27T14:41:29.725 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:29.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.727 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.0) 2023-07-27T14:41:29.774 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:29.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.776 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.0) 2023-07-27T14:41:29.822 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:29.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.823 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.0) 2023-07-27T14:41:29.869 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:29.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.871 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.0) 2023-07-27T14:41:29.916 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:29.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:29.918 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.9) 2023-07-27T14:41:30.004 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:30.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.006 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.9) 2023-07-27T14:41:30.052 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:30.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.053 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.9) 2023-07-27T14:41:30.099 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:30.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.100 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.9) 2023-07-27T14:41:30.185 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:30.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.187 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.9) 2023-07-27T14:41:30.273 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:30.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.302 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.9) 2023-07-27T14:41:30.386 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:30.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.388 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.9) 2023-07-27T14:41:30.474 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:30.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.475 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.9) 2023-07-27T14:41:30.521 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:30.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.522 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.15) 2023-07-27T14:41:30.608 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:30.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.609 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.15) 2023-07-27T14:41:30.695 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:30.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.696 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.15) 2023-07-27T14:41:30.742 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:30.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.744 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.15) 2023-07-27T14:41:30.831 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:30.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.833 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.15) 2023-07-27T14:41:30.879 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:30.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.881 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.15) 2023-07-27T14:41:30.926 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:30.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.927 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.15) 2023-07-27T14:41:30.973 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:30.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:30.975 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.15) 2023-07-27T14:41:31.020 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:31.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.022 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.8) 2023-07-27T14:41:31.108 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:31.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.109 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.8) 2023-07-27T14:41:31.156 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:31.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.158 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.8) 2023-07-27T14:41:31.205 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:31.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.206 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.8) 2023-07-27T14:41:31.252 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:31.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.254 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.8) 2023-07-27T14:41:31.300 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:31.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.301 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.8) 2023-07-27T14:41:31.387 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:31.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.389 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.8) 2023-07-27T14:41:31.434 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:31.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.435 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.8) 2023-07-27T14:41:31.481 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:31.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.482 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.11) 2023-07-27T14:41:31.568 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:31.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.569 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.11) 2023-07-27T14:41:31.655 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:31.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.657 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.11) 2023-07-27T14:41:31.704 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:31.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.705 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.11) 2023-07-27T14:41:31.791 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:31.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.793 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.11) 2023-07-27T14:41:31.839 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:31.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.840 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.11) 2023-07-27T14:41:31.926 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:31.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:31.928 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.11) 2023-07-27T14:41:32.013 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:32.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.014 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.11) 2023-07-27T14:41:32.060 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:32.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.065 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.3) 2023-07-27T14:41:32.111 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:32.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.113 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.3) 2023-07-27T14:41:32.199 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:32.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.200 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.3) 2023-07-27T14:41:32.246 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:32.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.247 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.3) 2023-07-27T14:41:32.333 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:32.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.334 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.3) 2023-07-27T14:41:32.380 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:32.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.381 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.3) 2023-07-27T14:41:32.467 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:32.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.468 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.3) 2023-07-27T14:41:32.514 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:32.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.515 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.3) 2023-07-27T14:41:32.561 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:32.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.562 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.12) 2023-07-27T14:41:32.608 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:32.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.609 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.12) 2023-07-27T14:41:32.656 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:32.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.658 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.12) 2023-07-27T14:41:32.704 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:32.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.705 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.12) 2023-07-27T14:41:32.791 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:32.792 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:41:32.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.793 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.12) 2023-07-27T14:41:32.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-27T14:41:32.883 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:32.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.885 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.12) 2023-07-27T14:41:32.970 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:32.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:32.971 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.12) 2023-07-27T14:41:33.058 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:33.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.059 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.12) 2023-07-27T14:41:33.105 INFO:teuthology.orchestra.run.smithi115.stdout:1690468874 2023-07-27T14:41:33.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.106 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.1) 2023-07-27T14:41:33.192 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:33.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.193 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.1) 2023-07-27T14:41:33.280 INFO:teuthology.orchestra.run.smithi115.stdout:81b4 2023-07-27T14:41:33.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.281 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.1) 2023-07-27T14:41:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:33.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.368 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.1) 2023-07-27T14:41:33.414 INFO:teuthology.orchestra.run.smithi115.stdout:1000 2023-07-27T14:41:33.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.416 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.1) 2023-07-27T14:41:33.461 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:33.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.463 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.1) 2023-07-27T14:41:33.550 INFO:teuthology.orchestra.run.smithi115.stdout:1285 2023-07-27T14:41:33.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.551 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvolume_0000000000904001/.snap/snapshot_0000000000736501/6fb1b5be-ef67-46a6-885a-e5a5fcdb2bfa/subvolume_file.1) 2023-07-27T14:41:33.596 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:33.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-07-27T14:41:33.598 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/clone_0000000000297312/ceff0ab8-f788-414d-8439-330014bd77a7/subvolume_file.1) 2023-07-27T14:41:33.683 INFO:teuthology.orchestra.run.smithi115.stdout:1690468873 2023-07-27T14:41:33.685 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000904001 snapshot_0000000000736501 2023-07-27T14:41:33.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.819+0000 7f23e25ff700 1 Processor -- start 2023-07-27T14:41:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.819+0000 7f23e25ff700 1 -- start start 2023-07-27T14:41:33.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.820+0000 7f23e25ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f23dc13a350 0x7f23dc065f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:33.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23e25ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0bd9a0 con 0x7f23dc13a730 2023-07-27T14:41:33.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23e25ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc066610 con 0x7f23dc0c36b0 2023-07-27T14:41:33.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23e25ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc066400 con 0x7f23dc13a350 2023-07-27T14:41:33.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23db7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f23dc13a730 0x7f23dc0c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50662/0 (socket says 172.21.15.115:50662) 2023-07-27T14:41:33.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23db7fe700 1 -- 172.21.15.115:0/2876155502 learned_addr learned my addr 172.21.15.115:0/2876155502 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23dbfff700 1 --2- 172.21.15.115:0/2876155502 >> v2:172.21.15.159:3300/0 conn(0x7f23dc13a350 0x7f23dc065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023900330 0 0) 0x7f23dc0bd9a0 con 0x7f23dc13a730 2023-07-27T14:41:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c40033f0 con 0x7f23dc13a730 2023-07-27T14:41:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2428986934 0 0) 0x7f23c40033f0 con 0x7f23dc13a730 2023-07-27T14:41:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.821+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 >> v2:172.21.15.159:3300/0 conn(0x7f23dc13a350 msgr2=0x7f23dc065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 --2- 172.21.15.115:0/2876155502 >> v2:172.21.15.159:3300/0 conn(0x7f23dc13a350 0x7f23dc065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 >> v1:172.21.15.159:6789/0 conn(0x7f23dc0c36b0 legacy=0x7f23dc0be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0bdc10 con 0x7f23dc13a730 2023-07-27T14:41:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7f23d0001470 con 0x7f23dc13a730 2023-07-27T14:41:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 >> v1:172.21.15.115:6789/0 conn(0x7f23dc13a730 legacy=0x7f23dc0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40038e0 0x7f23c4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4004690 0x7f23c4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4005000 0x7f23c400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc066400 con 0x7f23c4005000 2023-07-27T14:41:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c400bf60 con 0x7f23c4004690 2023-07-27T14:41:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c400c0f0 con 0x7f23c40038e0 2023-07-27T14:41:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23e0b9c700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4005000 0x7f23c400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23db7fe700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4004690 0x7f23c4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23dbfff700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40038e0 0x7f23c4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23e0b9c700 1 -- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40038e0 msgr2=0x7f23c4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23e0b9c700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40038e0 0x7f23c4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23e0b9c700 1 -- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4004690 msgr2=0x7f23c4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23e0b9c700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23c4004690 0x7f23c4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23e0b9c700 1 -- 172.21.15.115:0/2876155502 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40033f0 con 0x7f23c4005000 2023-07-27T14:41:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23dbfff700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c40038e0 0x7f23c4003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.822+0000 7f23e0b9c700 1 -- 172.21.15.115:0/2876155502 reap_dead start 2023-07-27T14:41:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23e0b9c700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4005000 0x7f23c400b8e0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 rx=0x7f23dc065cd0 tx=0x7f23d4007f30).ready entity=mon.0 client_cookie=e119504a056acc6c server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4006a20 con 0x7f23c4005000 2023-07-27T14:41:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4006b80 con 0x7f23c4005000 2023-07-27T14:41:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23daffd700 1 -- 172.21.15.115:0/2876155502 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400c5d0 con 0x7f23c4005000 2023-07-27T14:41:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23e25ff700 1 -- 172.21.15.115:0/2876155502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4005000 msgr2=0x7f23c400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23e25ff700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4005000 0x7f23c400b8e0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 rx=0x7f23dc065cd0 tx=0x7f23d4007f30).stop 2023-07-27T14:41:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23e25ff700 1 -- 172.21.15.115:0/2876155502 shutdown_connections 2023-07-27T14:41:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23e25ff700 1 --2- 172.21.15.115:0/2876155502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23c4005000 0x7f23c400b8e0 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:33.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23e25ff700 1 -- 172.21.15.115:0/2876155502 >> 172.21.15.115:0/2876155502 conn(0x7f23dc05e8f0 msgr2=0x7f23dc0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23e25ff700 1 -- 172.21.15.115:0/2876155502 shutdown_connections 2023-07-27T14:41:33.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.823+0000 7f23e25ff700 1 -- 172.21.15.115:0/2876155502 wait complete. 2023-07-27T14:41:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.825+0000 7f23e25ff700 1 Processor -- start 2023-07-27T14:41:33.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.825+0000 7f23e25ff700 1 -- start start 2023-07-27T14:41:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e25ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c4005000 0x7f23dc0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e25ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23dc1655a0 0x7f23dc0a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e25ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23dc156820 0x7f23dc156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e25ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc1677a0 con 0x7f23dc156820 2023-07-27T14:41:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e25ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc156390 con 0x7f23dc1655a0 2023-07-27T14:41:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e25ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc155a60 con 0x7f23c4005000 2023-07-27T14:41:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e0b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23dc156820 0x7f23dc156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e0b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23dc156820 0x7f23dc156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42380/0 (socket says 172.21.15.115:42380) 2023-07-27T14:41:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e0b9c700 1 -- 172.21.15.115:0/511306417 learned_addr learned my addr 172.21.15.115:0/511306417 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23db7fe700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23dc1655a0 0x7f23dc0a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23dbfff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c4005000 0x7f23dc0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e0b9c700 1 -- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c4005000 msgr2=0x7f23dc0a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e0b9c700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c4005000 0x7f23dc0a5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:33.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e0b9c700 1 -- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23dc1655a0 msgr2=0x7f23dc0a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e0b9c700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23dc1655a0 0x7f23dc0a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23e0b9c700 1 -- 172.21.15.115:0/511306417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc155d40 con 0x7f23dc156820 2023-07-27T14:41:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.826+0000 7f23db7fe700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23dc1655a0 0x7f23dc0a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.827+0000 7f23e0b9c700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23dc156820 0x7f23dc156ca0 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 rx=0x7f23dc0a8200 tx=0x7f23d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.827+0000 7f23c3fff700 1 -- 172.21.15.115:0/511306417 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4006a20 con 0x7f23dc156820 2023-07-27T14:41:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.827+0000 7f23c3fff700 1 -- 172.21.15.115:0/511306417 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d400c3f0 con 0x7f23dc156820 2023-07-27T14:41:33.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.827+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc156020 con 0x7f23dc156820 2023-07-27T14:41:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.827+0000 7f23c3fff700 1 -- 172.21.15.115:0/511306417 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4020430 con 0x7f23dc156820 2023-07-27T14:41:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.827+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc0a7f10 con 0x7f23dc156820 2023-07-27T14:41:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.828+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc156500 con 0x7f23dc156820 2023-07-27T14:41:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.829+0000 7f23c3fff700 1 -- 172.21.15.115:0/511306417 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 42) v1 ==== 77802+0+0 (secure 0 0 0) 0x7f23d4027070 con 0x7f23dc156820 2023-07-27T14:41:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.830+0000 7f23c3fff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23c805ff90 0x7f23c8062450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.830+0000 7f23c3fff700 1 -- 172.21.15.115:0/511306417 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f23d407c580 con 0x7f23dc156820 2023-07-27T14:41:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.830+0000 7f23dbfff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23c805ff90 0x7f23c8062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:33.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.830+0000 7f23dbfff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23c805ff90 0x7f23c8062450 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f23cc0030c0 tx=0x7f23cc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:33.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:33.834+0000 7f23c3fff700 1 -- 172.21.15.115:0/511306417 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f23d404c790 con 0x7f23dc156820 2023-07-27T14:41:34.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.040+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000904001", "snap_name": "snapshot_0000000000736501", "target": ["mon-mgr", ""]}) v1 -- 0x7f23dc06c470 con 0x7f23c805ff90 2023-07-27T14:41:34.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.082+0000 7f23c3fff700 1 -- 172.21.15.115:0/511306417 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f23dc06c470 con 0x7f23c805ff90 2023-07-27T14:41:34.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23c805ff90 msgr2=0x7f23c8062450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23c805ff90 0x7f23c8062450 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f23cc0030c0 tx=0x7f23cc008040).stop 2023-07-27T14:41:34.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23dc156820 msgr2=0x7f23dc156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23dc156820 0x7f23dc156ca0 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 rx=0x7f23dc0a8200 tx=0x7f23d4015000).stop 2023-07-27T14:41:34.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 shutdown_connections 2023-07-27T14:41:34.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7f23c805ff90 0x7f23c8062450 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23dc156820 0x7f23dc156ca0 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23c4005000 0x7f23dc0a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 --2- 172.21.15.115:0/511306417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23dc1655a0 0x7f23dc0a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 >> 172.21.15.115:0/511306417 conn(0x7f23dc05e8f0 msgr2=0x7f23dc0633b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:34.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 shutdown_connections 2023-07-27T14:41:34.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.084+0000 7f23e25ff700 1 -- 172.21.15.115:0/511306417 wait complete. 2023-07-27T14:41:34.163 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs clone_0000000000297312 2023-07-27T14:41:34.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.295+0000 7fbf745ff700 1 Processor -- start 2023-07-27T14:41:34.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.295+0000 7fbf745ff700 1 -- start start 2023-07-27T14:41:34.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.296+0000 7fbf745ff700 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbf6c14b1e0 0x7fbf6c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:34.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.296+0000 7fbf745ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c1553f0 con 0x7fbf6c063260 2023-07-27T14:41:34.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.296+0000 7fbf745ff700 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c157a50 con 0x7fbf6c14ae00 2023-07-27T14:41:34.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.296+0000 7fbf745ff700 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6c157d10 con 0x7fbf6c14b1e0 2023-07-27T14:41:34.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71b9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbf6c063260 0x7fbf6c0a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50674/0 (socket says 172.21.15.115:50674) 2023-07-27T14:41:34.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71b9a700 1 -- 172.21.15.115:0/2283379972 learned_addr learned my addr 172.21.15.115:0/2283379972 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-07-27T14:41:34.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf72b9c700 1 --2- 172.21.15.115:0/2283379972 >> v2:172.21.15.159:3300/0 conn(0x7fbf6c14b1e0 0x7fbf6c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:34.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548702280 0 0) 0x7fbf6c1553f0 con 0x7fbf6c063260 2023-07-27T14:41:34.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf580033f0 con 0x7fbf6c063260 2023-07-27T14:41:34.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1361975017 0 0) 0x7fbf580033f0 con 0x7fbf6c063260 2023-07-27T14:41:34.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 >> v2:172.21.15.159:3300/0 conn(0x7fbf6c14b1e0 msgr2=0x7fbf6c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:34.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 --2- 172.21.15.115:0/2283379972 >> v2:172.21.15.159:3300/0 conn(0x7fbf6c14b1e0 0x7fbf6c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 >> v1:172.21.15.159:6789/0 conn(0x7fbf6c14ae00 legacy=0x7fbf6c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c157ff0 con 0x7fbf6c063260 2023-07-27T14:41:34.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2691244050 0 0) 0x7fbf5c001470 con 0x7fbf6c063260 2023-07-27T14:41:34.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 >> v1:172.21.15.115:6789/0 conn(0x7fbf6c063260 legacy=0x7fbf6c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf580038e0 0x7fbf58003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:34.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.297+0000 7fbf71399700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf58004690 0x7fbf58004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:34.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf71399700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf5800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:34.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c157d10 con 0x7fbf58005000 2023-07-27T14:41:34.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5800beb0 con 0x7fbf58004690 2023-07-27T14:41:34.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5800c070 con 0x7fbf580038e0 2023-07-27T14:41:34.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf72b9c700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf5800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:34.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf71b9a700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf58004690 0x7fbf58004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:34.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf7239b700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf580038e0 0x7fbf58003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:34.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf72b9c700 1 -- 172.21.15.115:0/2283379972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf580038e0 msgr2=0x7fbf58003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:34.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf72b9c700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf580038e0 0x7fbf58003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf72b9c700 1 -- 172.21.15.115:0/2283379972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf58004690 msgr2=0x7fbf58004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-27T14:41:34.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf72b9c700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf58004690 0x7fbf58004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf72b9c700 1 -- 172.21.15.115:0/2283379972 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf580033f0 con 0x7fbf58005000 2023-07-27T14:41:34.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf72b9c700 1 -- 172.21.15.115:0/2283379972 reap_dead start 2023-07-27T14:41:34.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.298+0000 7fbf72b9c700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf5800b8e0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 rx=0x7fbf6c14b5e0 tx=0x7fbf6400b040).ready entity=mon.0 client_cookie=523bf1f17223df42 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:34.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64009ac0 con 0x7fbf58005000 2023-07-27T14:41:34.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6400f040 con 0x7fbf58005000 2023-07-27T14:41:34.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf71399700 1 -- 172.21.15.115:0/2283379972 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6400eca0 con 0x7fbf58005000 2023-07-27T14:41:34.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf745ff700 1 -- 172.21.15.115:0/2283379972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 msgr2=0x7fbf5800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf745ff700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf5800b8e0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 rx=0x7fbf6c14b5e0 tx=0x7fbf6400b040).stop 2023-07-27T14:41:34.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf745ff700 1 -- 172.21.15.115:0/2283379972 shutdown_connections 2023-07-27T14:41:34.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf745ff700 1 --2- 172.21.15.115:0/2283379972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf5800b8e0 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf745ff700 1 -- 172.21.15.115:0/2283379972 >> 172.21.15.115:0/2283379972 conn(0x7fbf6c05e940 msgr2=0x7fbf6c0cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:34.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf745ff700 1 -- 172.21.15.115:0/2283379972 shutdown_connections 2023-07-27T14:41:34.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.299+0000 7fbf745ff700 1 -- 172.21.15.115:0/2283379972 wait complete. 2023-07-27T14:41:34.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.301+0000 7fbf745ff700 1 Processor -- start 2023-07-27T14:41:34.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.301+0000 7fbf745ff700 1 -- start start 2023-07-27T14:41:34.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf745ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf6c149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:34.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf745ff700 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c14ed20 0x7fbf6c167140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:34.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf745ff700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c167630 0x7fbf6c0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:34.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf745ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c14db20 con 0x7fbf58005000 2023-07-27T14:41:34.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf745ff700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c14cf60 con 0x7fbf6c167630 2023-07-27T14:41:34.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf745ff700 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c167ab0 con 0x7fbf6c14ed20 2023-07-27T14:41:34.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf7239b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf6c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:34.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf7239b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf6c149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42400/0 (socket says 172.21.15.115:42400) 2023-07-27T14:41:34.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf7239b700 1 -- 172.21.15.115:0/2416106818 learned_addr learned my addr 172.21.15.115:0/2416106818 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-07-27T14:41:34.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf72b9c700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c167630 0x7fbf6c0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:34.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf71b9a700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c14ed20 0x7fbf6c167140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:34.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf7239b700 1 -- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c14ed20 msgr2=0x7fbf6c167140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.302+0000 7fbf7239b700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c14ed20 0x7fbf6c167140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf7239b700 1 -- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c167630 msgr2=0x7fbf6c0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf7239b700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c167630 0x7fbf6c0adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf7239b700 1 -- 172.21.15.115:0/2416106818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c14d1f0 con 0x7fbf58005000 2023-07-27T14:41:34.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf72b9c700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c167630 0x7fbf6c0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-27T14:41:34.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf7239b700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf6c149720 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 rx=0x7fbf6800e4d0 tx=0x7fbf68009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:34.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf627fc700 1 -- 172.21.15.115:0/2416106818 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680014d0 con 0x7fbf58005000 2023-07-27T14:41:34.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf627fc700 1 -- 172.21.15.115:0/2416106818 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf68010040 con 0x7fbf58005000 2023-07-27T14:41:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf627fc700 1 -- 172.21.15.115:0/2416106818 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68001840 con 0x7fbf58005000 2023-07-27T14:41:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c14d4d0 con 0x7fbf58005000 2023-07-27T14:41:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.303+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c149c10 con 0x7fbf58005000 2023-07-27T14:41:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.304+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c06c470 con 0x7fbf58005000 2023-07-27T14:41:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.305+0000 7fbf627fc700 1 -- 172.21.15.115:0/2416106818 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 42) v1 ==== 77802+0+0 (secure 0 0 0) 0x7fbf68001c30 con 0x7fbf58005000 2023-07-27T14:41:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.306+0000 7fbf627fc700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf5005ff90 0x7fbf50062450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-07-27T14:41:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.306+0000 7fbf627fc700 1 -- 172.21.15.115:0/2416106818 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fbf6807b850 con 0x7fbf58005000 2023-07-27T14:41:34.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.306+0000 7fbf71b9a700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf5005ff90 0x7fbf50062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-07-27T14:41:34.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.306+0000 7fbf71b9a700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf5005ff90 0x7fbf50062450 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fbf5c0015a0 tx=0x7fbf5c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-27T14:41:34.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.310+0000 7fbf627fc700 1 -- 172.21.15.115:0/2416106818 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbf6804bac0 con 0x7fbf58005000 2023-07-27T14:41:34.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.507+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 --> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "clone_0000000000297312", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf6c14dc60 con 0x7fbf5005ff90 2023-07-27T14:41:34.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.523+0000 7fbf627fc700 1 -- 172.21.15.115:0/2416106818 <== mgr.4107 v2:172.21.15.115:6832/110949 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbf5c007e20 con 0x7fbf5005ff90 2023-07-27T14:41:34.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf5005ff90 msgr2=0x7fbf50062450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf5005ff90 0x7fbf50062450 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fbf5c0015a0 tx=0x7fbf5c009040).stop 2023-07-27T14:41:34.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 msgr2=0x7fbf6c149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-27T14:41:34.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf6c149720 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 rx=0x7fbf6800e4d0 tx=0x7fbf68009040).stop 2023-07-27T14:41:34.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 shutdown_connections 2023-07-27T14:41:34.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:6832/110949,v1:172.21.15.115:6833/110949] conn(0x7fbf5005ff90 0x7fbf50062450 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf6c167630 0x7fbf6c0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf58005000 0x7fbf6c149720 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 --2- 172.21.15.115:0/2416106818 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbf6c14ed20 0x7fbf6c167140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-07-27T14:41:34.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 >> 172.21.15.115:0/2416106818 conn(0x7fbf6c05e940 msgr2=0x7fbf6c14a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-27T14:41:34.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 shutdown_connections 2023-07-27T14:41:34.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-07-27T14:41:34.526+0000 7fbf745ff700 1 -- 172.21.15.115:0/2416106818 wait complete. 2023-07-27T14:41:34.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2023-07-27T14:41:34.753 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-27T14:41:34.770 DEBUG:teuthology.task.console_log:Killing console logger for smithi115 2023-07-27T14:41:34.770 DEBUG:teuthology.task.console_log:Killing console logger for smithi159 2023-07-27T14:41:34.771 DEBUG:teuthology.exit:Finished running handlers